cs.CL [Total: 36]
cs.CV [Total: 69]
eess.AS [Total: 1]
cs.RO [Total: 4]
cs.AI [Total: 1]
cs.LG [Total: 5]
eess.IV [Total: 1]
cs.HC [Total: 1]

cs.CL [Back]

Chenyang Yang, Shen Yan, Yibo Yang, Litao Hu, Yuchen Liu

TL;DR: 本文提出了一种基于多模态语言模型的AI生成内容检测方法，旨在解决社交媒体上AIGC检测面临的泛化性差、单模态依赖和缺乏可解释性等问题。该方法通过持续收集多样化的多模态社交媒体数据，并训练一个紧凑的视觉语言模型来实现检测和解释。

Details

Motivation: 生成式AI产生的逼真图像和视频在社交媒体上广泛传播，常被用于垃圾信息、虚假信息、操纵和欺诈，而现有AIGC检测方法存在泛化性不足、依赖单模态和缺乏可解释解释等挑战。

Result: 模型在公开基准测试中达到了最先进的检测性能，并在多个平台的内部社交媒体数据集上展示了鲁棒的检测和解释能力。部署于社交媒体平台进行帖子推荐后，观察到对用户参与度的积极下游影响。

Insight: 创新点在于通过持续更新的多模态数据收集和紧凑的视觉语言模型训练，实现了在动态真实社交媒体环境中有效的AIGC检测与解释，并验证了其实际应用价值。

Abstract: Generative AI has enabled the creation of photorealistic images and videos that are increasingly disseminated on social media, often used for spam, misinformation, manipulation, and fraud. Existing AI-generated content (AIGC) detection methods face challenges including poor generalization to new generation models, reliance on single modalities, and lack of interpretable explanations. We present our pipeline that mitigates these issues by continuously curating diverse multi-modal social media data and training a compact vision-language model for detection and explanation. Our model achieves state-of-the-art detection performance on public benchmarks and demonstrates robust detection and explanation capabilities on internal social media datasets across multiple platforms. We deployed our model for post recommendation on social media platforms and observed positive downstream impacts on user engagement, demonstrating that it is feasible to perform effective AIGC detection in dynamic, real-world social media environments.

[2] One Jailbreak, Many Tongues: Learning Language-Insensitive Intention Representations for Multilingual Jailbreak Detection cs.CLPDF

Shuyu Jiang, Kaiyu Xu, Xingshu Chen, Hao Ren, Rui Tang

TL;DR: 本文提出了一种名为MLJailDe的多语言越狱检测框架，旨在解决大语言模型（LLM）在安全训练上多语言能力不足的问题。该框架通过多语言回译数据增强构建了一个覆盖11种语言的语义一致数据集，并利用相对距离约束和类别不平衡感知分类目标来学习语言不敏感的意图表示，以提升多语言鲁棒性和跨语言泛化能力。

Details

Motivation: 动机在于LLM越来越多地部署于全球多语言用户，但其安全训练主要集中在主流语言，与多语言能力发展不匹配，导致存在可利用的越狱攻击漏洞。现有的越狱防御方法主要在主流语言中开发和评估，其效果受限于对齐的多语言监督数据稀缺以及语言差异导致的表示分散问题。

Result: 实验结果表明，MLJailDe在多种语言上超越了现有最先进的基线方法，取得了98.5%的F1分数，并且在未见语言上平均F1分数达到97.1%，证明了其强大的有效性和跨语言泛化能力。

Insight: 创新点在于提出了一个结合多语言回译数据增强、相对距离约束和类别不平衡感知分类目标的统一框架，以学习语言不敏感的意图表示，从而有效缓解多语言表示分散和类别不平衡问题，为多语言安全防御提供了新思路。

Abstract: Large language models (LLMs) are increasingly deployed in applications for global multilingual users, yet safety training remains concentrated in dominant languages and has not progressed in parallel with multilingual capability, creating exploitable gaps for jailbreak attacks. Current jailbreak defenses are largely developed and evaluated in dominant languages, and their effectiveness is limited by the scarcity of aligned multilingual supervision and representations dispersion caused by language variation. To address this issue, we propose MLJailDe, a multilingual jailbreak detection framework designed to improve both multilingual robustness and cross-lingual generalization. MLJailDe first introduces a multilingual back-translation data augmentation algorithm to construct a semantically consistent and functionally effective dataset spanning 11 languages, consisting of 2,232 benign and 1,239 jailbreak samples. On this basis, MLJailDe employs relative-distance constraints to reduce cross-lingual representation dispersion and encourage jailbreak prompts with similar intent to form consistent clusters across languages, while an imbalance-aware classification objective is further used to alleviate class imbalance and learn more reliable multilingual decision boundaries. Experimental results show that MLJailDe outperforms state-of-the-art baselines across multiple languages, achieving an F1 score of 98.5%, and obtains an average F1 score of 97.1% on unseen languages, demonstrating strong effectiveness and cross-lingual generalization.

[3] Compatibility-Aware Dynamic Fine-Tuning for Large Language Models cs.CL | cs.LGPDF

Yucheng Zhou, Junwei Sheng, Qianning Wang, Jianbing Shen

TL;DR: 本文提出兼容性感知动态微调（CADFT），一种针对大规模指令数据异构性问题的有监督微调方法。该方法通过模型似然度推导动态的、策略相关的兼容性信号来调节监督更新，抑制来自不兼容样本的高方差梯度，并引入延迟的低频兼容性引导重写策略将不兼容样本转化为可学习目标。

Details

Motivation: 现有动态微调（DFT）方法假设所有演示样本都是同等合适的学习目标，但大规模指令数据存在强异构性，演示-策略不匹配会导致样本级更新的高方差，从而影响优化稳定性和泛化能力。

Result: 大量实验表明，CADFT在保持完全有监督且不依赖显式奖励建模的前提下，改善了微调的稳定性、泛化能力以及冷启动强化学习的初始化效果。

Insight: 核心创新在于将DFT的令牌级稳定化推广到样本级，通过兼容性信号构建了一个方差可控的估计器，并设计了将不兼容样本渐进转化为可学习目标的策略，为解决指令数据异构性导致的优化问题提供了新思路。

Abstract: Supervised Fine-Tuning (SFT) is the predominant paradigm for aligning large language models (LLMs), yet it suffers from optimization instability and limited generalization. Recent work attributes this issue to pathological gradient scaling and proposes Dynamic Fine-Tuning (DFT) to correct it at the token level. However, DFT assumes all demonstrations are equally suitable learning targets, an assumption violated by the strong heterogeneity of large-scale instruction data, where demonstration-policy mismatch induces high-variance updates at the sample level. We introduce Compatibility-Aware Dynamic Fine-Tuning (CADFT), a principled extension of DFT that controls sample-level optimization variance. CADFT derives a dynamic, policy-dependent compatibility signal from model likelihoods to modulate supervised updates, suppressing high-variance gradients from incompatible demonstrations. We further propose a delayed, low-frequency compatibility-guided rewriting strategy to transform persistently incompatible demonstrations into learnable targets. We show that CADFT can be interpreted as a variance-controlled estimator that generalizes token-level stabilization in DFT to the sample level. Extensive experiments demonstrate improved stability, generalization, and cold-start reinforcement learning initialization, while remaining fully supervised and independent of explicit reward modeling.

Jingpei Wu, Xiao Han, Weixiang Shen, Boer Zhang, Zifeng Ding

TL;DR: 本文提出了一种名为ProcessThinker的后训练方法，旨在增强多模态大语言模型（MLLM）在视觉问答等任务中的多步推理能力。该方法通过基于rollout的过程奖励机制，为推理过程中的每个步骤提供密集的监督信号，从而减少推理过程中的不一致性，而无需训练显式的过程奖励模型（PRM）。

Details

Motivation: 当前基于强化学习的后训练方法（如RLVR和GRPO）主要依赖稀疏的最终答案奖励，难以区分错误是源于推理后期的微小失误还是整个轨迹从一开始就无效。虽然训练过程奖励模型（PRM）可以提供步骤级监督，但这通常需要大规模高质量思维链标注和额外的训练成本。

Result: 在四个具有挑战性的视频基准测试（Video-MMMU、MMVU、VideoMathQA和LongVideoBench）上，ProcessThinker方法在基线模型Qwen3-VL-8B-Instruct的基础上取得了持续一致的性能提升。

Insight: 论文的核心创新点在于提出了一种无需训练显式PRM的实用后训练流程。其关键机制是为每个中间推理步骤采样多个后续推理路径，并使用这些路径的最终答案验证成功率作为该步骤的奖励。这种基于rollout的过程奖励实现了密集的信用分配，鼓励生成更可靠支持正确结论的推理步骤，从而缓解了逻辑推理中跨步骤不一致或自相矛盾的关键问题。

Abstract: Visual question answering increasingly requires multi-step reasoning. Recent post-training with reinforcement learning under verifiable rewards (RLVR) and Group Relative Policy Optimization (GRPO) can improve multimodal reasoning, but most approaches rely on sparse outcome-only rewards. As a result, they struggle to tell whether an incorrect answer comes from a small mistake late in the reasoning or from an unhelpful trajectory from the start. A common solution is to train a process reward model (PRM) for step-level supervision, but this typically requires large-scale high-quality chain-of-thought annotations and additional training cost. We propose ProcessThinker, a practical post-training pipeline that provides step-level process rewards without training an explicit PRM. ProcessThinker first rewrites reasoning traces into a step-tagged format for cold-start supervised fine-tuning, then applies GRPO with a standard format reward and our rollout-based process reward. Concretely, for each intermediate step, we sample multiple continuations from that step and use the empirical success rate (final-answer verification) as the step reward. This gives dense credit assignment and encourages reasoning steps that more reliably support a correct conclusion, helping reduce inconsistent or self-contradictory progress across steps – a key issue in logical reasoning. Across four challenging video benchmarks (Video-MMMU, MMVU, VideoMathQA, and LongVideoBench), ProcessThinker consistently improves over the baseline model Qwen3-VL-8B-Instruct

[5] T2MM: An LLM Supported Architecture For Inquiry-Based Modeling cs.CL | cs.AI | cs.MMPDF

John Kos, Rudra Singh, Ashok Goel

TL;DR: 本文提出T2MM（文本到多模态模型）架构，这是一个由大型语言模型（LLM）支持的动态系统，旨在增强基于探究的生态建模软件VERA中的模型构建过程。它能够根据学习者的当前建模上下文生成交互式模型（而非静态图像），并保持模型对手动调整的响应能力。

Details

Motivation: 当前在教育领域集成的多模态LLM工具缺乏某些学习场景所需的视觉交互性，特别是在科学学习中依赖可视化与交互性的模型构建实践。

Result: 在VERA系统中使用程序生成的自然语言学习者建模请求数据集进行评估，T2MM在各项成功指标上均优于通过LLM支持的全代码生成实现的基线模型生成架构。

Insight: 创新点在于提出了一种支持动态、上下文感知的交互式模型生成的LLM架构，而不仅仅是生成静态图像或代码；这为创建更交互式的多模态LLM工具提供了一种可能的架构思路。

Abstract: Model Construction is a foundational practice in science learning that relies on visualization and interactivity. Large Language Models, increasingly augmented with multimodal capabilities, have been integrated in education contexts to support learning. However, these tools lack visual interactivity that is required by some learning contexts. We introduce Text to Multimodal Model (T2MM), a robust, dynamic LLM supported architecture that assists in model construction within the open inquiry ecology-based modeling software Virtual Experimental Research Assistant (VERA). T2MM accounts for the current context of the learner’s model and creates interactive models, rather than static images, enabling the model to remain responsive to manual adjustment. To measure technical feasibility, we evaluate T2MM through a custom procedurally generated dataset of natural language learner modeling requests and target models within the VERA system. T2MM outperforms a baseline model generation architecture implemented through LLM-supported full code generation, common in the literature, across all measured success metrics. Our contribution not only outlines LLM integration into a inquiry-based learning modeling tool, but also describes a possible architecture through which more interactive multimodal LLM tools can be created.

[6] Calibration Drift Under Reasoning: How Chain-of-Thought Budgets Induce Overconfidence in Large Language Models cs.CL | cs.AI | cs.LGPDF

Prakul Sunil Hiremath, Harshit R. Hiremath

TL;DR: 本文研究了大型语言模型在思维链推理过程中出现的校准漂移现象。研究发现，当推理预算超过特定阈值时，模型会变得系统性过度自信，对错误答案赋予高置信度。论文提出了一个假设锁定模型来解释该行为，并引入了一种校准感知的停止规则CABStop来缓解此问题。

Details

Motivation: 动机在于探究思维链推理对大型语言模型校准性的影响。虽然CoT被广泛用于提升准确性和可靠性，但其对模型置信度校准的具体效应尚未被充分理解，这对于模型的安全部署至关重要。

Result: 在47个推理陷阱问题上评估了Llama-3.1-8B和Llama-3.3-70B模型。8B模型表现出非单调的校准行为（预期校准误差先降后升），而70B模型的结果在预算依赖效应方面尚无定论。

Insight: 主要创新点在于揭示了‘推理校准漂移’这一新现象，并提出了‘假设锁定’理论模型进行解释。从工程角度看，CABStop这种基于置信度与辅助准确度估计发散的早期停止规则，为动态控制推理过程提供了可借鉴的思路。

Abstract: The ability of large language models (LLMs) to express calibrated uncertainty is important for safe deployment. Chain-of-thought (CoT) reasoning is widely used to improve accuracy and reliability, but its effect on calibration is not fully understood. We show that this picture is incomplete: in some settings, increasing the reasoning budget beyond a task-specific threshold can cause models to become systematically overconfident, assigning high confidence to incorrect answers. We call this phenomenon Calibration Drift Under Reasoning (CDUR) and study it both theoretically and empirically. We define reasoning budget B and analyze conditions under which Expected Calibration Error ECE(B) follows a non-monotonic pattern: it first decreases as reasoning corrects errors, then increases as longer reasoning produces internally consistent but incorrect explanations. We propose a Hypothesis Lock-In model based on autoregressive generation to explain this behavior. We evaluate Llama-3.1-8B and Llama-3.3-70B on 47 reasoning-trap questions across four reasoning budgets and three seeds (1,368 API calls; 574 valid responses). The 8B model shows non-monotonic calibration behavior, while results for the 70B model are limited to baseline evaluation and are inconclusive for budget-dependent effects. We introduce CABStop, a calibration-aware stopping rule that halts reasoning when confidence diverges from an auxiliary accuracy estimate. These results suggest that increasing reasoning depth does not always improve reliability and should be monitored carefully.

[7] Beyond Compaction: Structured Context Eviction for Long-Horizon Agents cs.CLPDF

Andrew Semenov, Svyatoslav Dorofeev

TL;DR: 本文提出了上下文窗口生命周期（CWL）方案，这是一种用于长视野LLM智能体的上下文管理机制。CWL通过基于语义感知的逐级淘汰策略，在超出token预算时，优先淘汰已持久化效果的行动片段，从而维持稳定的活跃上下文，为智能体提供近乎无限的工作视野。与基于摘要的压缩方法相比，CWL避免了不可预测的信息丢失、因果结构破坏、模型阻塞成本和压缩引发的幻觉等问题。

Details

Motivation: 解决长视野LLM智能体在长时间会话中，因上下文窗口有限而面临的历史信息管理难题。传统方法如摘要压缩或最近截断存在信息丢失、破坏因果结构或忽略语义相关性等局限，CWL旨在提供一种语义感知的、可扩展的上下文管理方案。

Result: 在长视野智能体基准测试中，单个智能体会话完成了89个顺序任务，处理了8000万个token，其任务准确率相对于每个任务独立会话没有出现可测量的下降，证明了CWL的有效性和稳定性。

Insight: 创新点在于将智能体轨迹注释为类型化、依赖链接的片段图，并采用确定性的、无需LLM的淘汰策略，根据依赖关系优先淘汰最旧且最可恢复的内容。这为长序列任务中的上下文管理提供了结构化、语义感知的新思路，避免了传统压缩方法的固有缺陷。

Abstract: We present Context Window Lifecycle (CWL), a context-management scheme that gives long-horizon LLM agents an effectively unbounded working horizon. As a session accumulates history, CWL keeps the context within budget through graduated, semantically-aware eviction: the agent annotates its trajectory as typed, dependency-linked episodes as work proceeds, and a deterministic, LLM-free policy evicts content in priority order within that structure when a token budget is exceeded. CWL preserves user turns and the exploratory context the agent is actively reasoning over, while aggressively shedding action episodes whose effects are already persisted in the environment, keeping active context near a stable ceiling that also avoids the performance degradation associated with very large prompts. Compared to summarization-based compaction, CWL avoids four well-known limitations: unpredictable lossiness, destruction of causal structure, blocking model cost, and compression-induced hallucination. Compared to recency truncation, CWL is semantically aware: it drops the oldest-and-most-recoverable content according to the dependency graph rather than oldest-in-time regardless of relevance. We describe the annotation protocol, the episode graph, the eviction policy, and the token-accounting loop, and evaluate CWL on long-horizon agentic benchmarks: a single agent session completing 89 sequential tasks across 80 million tokens with no measurable degradation in task accuracy relative to per-task isolated sessions

[8] LifeSentence: Language models can encode human life course trajectories from longitudinal panel data cs.CLPDF

Samuel Liu, Muchen Xi, William Yeoh, Joshua J. Jackson

TL;DR: 本文提出了LifeSentence模型，该模型通过将人生事件表示为结构化自然语言记录，并基于预训练的240亿参数语言模型进行指令微调，从而利用纵向面板数据预测人生轨迹。模型在包含预测、鲁棒性和推理的18个任务评估体系上表现优异，仅需约6.5万名德国社会经济面板数据个体（比先前基于Transformer的方法少约45倍）进行训练，即可超越传统和深度学习基线。

Details

Motivation: 预测人生结果对于理解个体如何获得长寿健康生活至关重要，但传统统计方法因忽略人生历程的序列结构而精度有限，而Transformer等现代方法需要大规模训练数据，大多数纵向面板研究无法满足。

Result: LifeSentence在所有任务类别上均优于经典和深度学习基线，在联合事件与时间预测上比最佳基线提升三倍，在从无时间戳事件集重建时序时达到91.2%的Kendall’s tau系数。模型无需显式监督即可从离散事件序列中恢复社会分层模式（如教育溢价、性别工资差距和母职惩罚）。

Insight: 创新点在于将人生事件编码为自然语言记录，通过指令微调将预训练语言模型的分布知识补充到面板数据中，实现了小数据下的高效预测；同时，自然语言接口支持反事实探索，使模型兼具预测工具和人生传记探针功能。

Abstract: Forecasting human life outcomes is important to gain insights into how individuals attain long and healthy lives. Conventional statistical approaches yield limited accuracy, potentially due to discarding the sequential structure of the life course. Modern methods such as transformer architectures require large scale training data that most longitudinal panel studies lack. Here we introduce LifeSentence, a model for life-course reasoning that bridges large language models with longitudinal panel data. By representing each life event as a structured natural-language record and instruction-tuning a pretrained 24-billion-parameter language model across an 18-task evaluation taxonomy spanning prediction, robustness and reasoning, LifeSentence supplements panel data with distributional knowledge already encoded during pretraining. Trained on approximately 65,000 individuals from the German Socio-Economic Panel - roughly 45 times fewer than prior transformer-based approaches - LifeSentence outperforms classical and deep learning baselines across all task families, achieving a threefold improvement in joint event-and-timing prediction from best baselines and 91.2% Kendall’s tau when reconstructing chronological order from timestamp-stripped event sets. Without explicit supervision, the model recovers documented patterns of social stratification, including the education premium, the gender wage gap and the motherhood penalty, from discrete event sequences alone. A natural-language interface further enables qualitatively new research queries, such as connecting an early-life history to a specified late-life endpoint, establishing LifeSentence as both a predictive tool and a probe for counterfactual exploration of human biographies.

[9] Afrispeech Semantics: Evaluating Audio Semantic Reasoning in Spoken Language Models Across Domains and Accents cs.CL | cs.AI | cs.SDPDF

Chibuzor Okocha, Christan Grant

TL;DR: 该论文提出了Afrispeech Semantics基准，用于评估音频语言模型在跨领域和口音下的语义推理能力。研究通过五个任务（蕴含、一致性、合理性、口音漂移和口音约束）系统测试模型对口语音频的推理性能，揭示了现有评估的局限性。

Details

Motivation: 当前音频语言模型在语音理解中的应用日益增多，但其在转录之外的语义推理能力（如文本-音频检索、字幕生成和问答准确性）缺乏充分的基准测试。特别是口音变化、领域转移和语义过度推理对音频推理的影响尚未被充分理解。

Result: 论文通过五个语义和副语言推理任务评估音频语言模型，发现当前模型在这些任务上存在显著局限性，尤其是在处理口音变化和语义推理时表现不稳定。该基准旨在为更稳健和公平的ALM设计与评估提供指导。

Insight: 创新点在于构建了一个专注于音频语义推理的综合评估框架，特别关注口音和领域变化的影响。从客观角度看，该研究强调了现有评估的不足，并提出了多任务基准，有助于推动音频语言模型在真实世界场景中的鲁棒性发展。

Abstract: Audio language models (ALMs) are increasingly used for speech-based understanding, yet their ability to perform semantic reasoning beyond transcription, Text-to-Audio Retrieval, Captioning, and Question-Answering accuracy remains insufficiently benchmarked. In particular, the effects of accent variation, domain shift, and semantic over-inference on audio reasoning are poorly understood. We evaluate audio language models across five semantic and paralinguistic reasoning tasks: entailment, consistency, plausibility, accent drift, and accent restraint. Collectively, these tasks assess a model’s ability to reason over spoken audio as the primary evidence source, including whether a textual hypothesis can be inferred, contradicted, or left undetermined by the audio, whether statements align or conflict with spoken content, whether claims are plausible given the discourse, and whether model predictions remain stable or appropriately constrained across accent variation. These findings highlight critical limitations in current audio reasoning evaluations and hope to provide guidance for more robust and equitable ALM design and assessment

[10] Benchmarking Large Language Models for Safety Data Extraction cs.CL | cs.IRPDF

Jonas Grill, Thomas Bayer, Sören Berlinger

TL;DR: 本研究对Gemini 1.5 Pro、GPT-4o、Claude 3.7 Sonnet和Llama 3.1-70B等先进大语言模型在安全数据表（SDS）结构化信息提取任务上进行了系统性基准测试，比较了基于文本和多模态的处理流程以及零样本、少样本和思维链三种提示策略。结果表明，基于文本的提取在所有指标上均优于多模态处理，其中Gemini 1.5 Pro结合思维链提示取得了最高准确率（84%），但所有模型均未达到实际部署所需的90%可靠性阈值。

Details

Motivation: 解决工业安全领域中，由于安全数据表格式异构且传统基于规则的方法存在局限，导致从中准确提取结构化信息仍然具有挑战性的问题。

Result: 在超过50,000个提取数据字段的评估中，基于文本的提取在准确性、延迟和成本方面均优于多模态处理。Gemini 1.5 Pro结合思维链提示取得了最高准确率（84%），优于GPT-4o（81%）和Claude 3.7 Sonnet（79%），但所有模型均未达到90%的可靠性阈值，表明通用大语言模型尚未达到无监督工业应用的鲁棒性要求。

Insight: 论文宣称的创新点在于首次对多种先进LLM在SDS数据提取任务上进行了系统性基准测试，并比较了文本与多模态流程及不同提示策略。客观来看，其构建的评估框架（涵盖准确性、延迟、成本）和对“通用LLM尚不足以用于无监督工业场景，但通过任务特定微调潜力巨大”的结论，对领域应用具有重要指导价值。未来研究方向（领域自适应训练、模型校准、人机协同验证）也指出了提升安全关键可靠性的具体路径。

Abstract: Accurate extraction of structured information from Safety Data Sheets (SDS) remains challenging in industrial safety due to heterogeneous document formats and the limitations of traditional rule-based methods. This study benchmarks state-of-the-art Large Language Models (LLMs) for automated SDS data extraction, comparing text-based and multimodal processing pipelines. We systematically evaluate four models: Gemini 1.5 Pro, GPT-4o, Claude 3.7 Sonnet, and Llama 3.1-70B, across three prompting strategies: zero-shot, few-shot, and chain-of-thought. The evaluation framework assessed accuracy, latency, and cost across more than 50,000 extracted data fields. Results show that text-based extraction consistently outperforms multimodal processing across all metrics. Gemini 1.5 Pro combined with a Chain-of-Thought prompt achieved the highest accuracy (84%), outperforming GPT-4o (81%) and Claude 3.7 Sonnet (79%). However, no model surpassed the 90% accuracy threshold commonly required for reliable real-world deployment. These findings indicate that general-purpose LLMs are not yet robust enough for unsupervised industrial use, though performance suggests strong potential with task-specific fine-tuning. Future research should focus on domain-adapted training, model calibration, and the integration of Human-in-the-Loop verification to ensure safety-critical reliability.

[11] Context-Aware Multimodal Claim Verification in Spoken Dialogues cs.CL | cs.SIPDF

Chaewan Chun, Delvin Ce Zhang, Dongwon Lee

TL;DR: 该论文提出了MAD2基准，这是一个用于口语对话中多模态声明验证的新基准，包含1000个双人对话、3368个值得核查的声明和约10小时的音频。论文提出了一种校准的多模态融合方法，结合了上下文感知的音频编码器和对话感知的文本模型，以验证口语对话中的声明。研究发现，对话上下文能改善验证效果，但增益取决于场景类型，且对话结构对验证的影响比错误信息框架更大。

Details

Motivation: 解决口语对话中错误信息验证的不足，因为现有事实核查主要关注孤立文本，而忽略了对话音频，且口语错误信息是通过对话构建的，可信度不仅取决于事实，还取决于声明在对话轮次中的框架、强化或未受挑战的方式。

Result: 在MAD2基准上的实验表明，添加对话上下文能提高验证性能，但增益因场景类型而异；仅使用前文上下文通常能达到离线性能水平，支持实时审核设置；当基于转录的模型因额外上下文而不稳定时，音频贡献最大。

Insight: 创新点包括引入MAD2基准用于口语对话声明验证，以及提出校准的多模态融合方法结合音频和文本模型；客观分析认为，研究强调了对话结构在验证中的重要性，并展示了多模态方法在口语错误信息检测中的潜力。

Abstract: Every day, millions absorb claims from podcasts and streams that no fact-checker ever sees. Spoken misinformation is built through conversation, where credibility comes not from facts alone but from how claims are framed, reinforced, or left unchallenged across turns. Yet fact-checking has focused on isolated text, leaving dialogue audio under-studied. We introduce MAD2, a new Multi-turn Audio Dialogues benchmark for spoken claim verification, containing 1,000 two-speaker dialogues with 3,368 check-worthy claims and approximately 10 hours of audio, and propose calibrated multimodal fusion of a context-aware audio encoder and a dialogue-aware text model. Across settings, adding dialogue context improves verification, but the gains depend on scenario type. Using only preceding context often matches offline performance, supporting live-moderation settings, and audio contributes most when transcript-based models are destabilized by additional context. Overall, conversational structure matters more for verification than misinformation framing.

[12] Agent Skill Evaluation and Evolution: Frameworks and Benchmarks cs.CLPDF

Kexin Ding, Yang Zhou, Can Jin, Feng Tong, Mu Zhou

TL;DR: 这篇论文是一篇关于智能体技能评估与演化的综述，系统性地梳理了从孤立技能创建到自动化、评估驱动的技能演化的范式转变。文章将技能演化分为四种范式，并分析了六类以技能为中心的基准测试，旨在推动构建通用、高效且可验证安全的技能生态系统。

Details

Motivation: 随着智能体技能库的不断扩展，严格的评估对于确保其在实际应用中的效用、质量和安全性变得至关重要，因此需要从孤立技能创建转向评估驱动的自动化技能演化。

Result: 论文未提及具体的定量实验结果，但通过分析六类技能基准测试，揭示了基准覆盖范围的结构性差距、权衡以及度量丰富度，以推动技能研究。

Insight: 创新点在于系统性地将技能演化分类为执行反馈、轨迹蒸馏、压缩和强化学习四种范式，并识别了技能基准测试的不足，为构建可泛化、高效且可验证安全的技能生态系统指明了开放方向。

Abstract: The growth of agent skills has transformed how agentic systems are built, evaluated, and deployed. As skill libraries continue to scale, rigorous evaluation becomes critical to ensuring their utility, quality, and safety in real-world applications. Consequently, the field is undergoing an emerging paradigm shift from isolated skill creation to automated, evaluation-driven skill evolution. In this survey, we systematically examine the landscape of skill evolution and evaluation beyond foundational skill creation. We categorize evolution into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, showing how each element contributes to improving skill utility and reliability. We also provide an analysis of six skill-centric benchmark categories, identifying structural gaps in benchmark coverage, trade-offs, and metric richness to advance skill research. Finally, we identify open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe. The project URL is https://github.com/Cassie07/AgentSkill_Survey

[13] The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes cs.CLPDF

Avinash Anand, Mahisha Ramesh, Avni Mittal, Ashutosh Kumar, Erik Cambria

TL;DR: 这篇论文是一篇关于大语言模型推理能力的系统性综述，分析了超过300篇近期文献，旨在梳理LLM推理研究的现状、方法和局限性。

Details

Motivation: 尽管大语言模型在自然语言处理任务上表现出色，但其推理能力仍不稳定且不可靠，对提示策略、任务设计和模型规模敏感，因此需要系统性地梳理其推理能力如何涌现及在何处失败。

Result: 论文未报告具体的定量实验结果，但通过文献综述，系统性地总结了当前LLM推理研究的分类、方法趋势和评估基准，并识别了常见的失败模式。

Insight: 论文的主要创新点在于提出了一个结构化的LLM推理研究分类法，并综合分析了不同推理范式的趋势和局限性，为未来开发更鲁棒、可解释和可泛化的推理系统提供了参考框架。

Abstract: Large Language Models (LLMs) have achieved strong performance across natural language processing tasks, yet reliable reasoning remains an open challenge. Although modern LLMs show progress in structured inference, multi-step problem solving, and contextual understanding, their reasoning behavior is often inconsistent and sensitive to prompting strategies, task design, and model scale. This survey provides a systematic analysis of more than 300 recent papers from arXiv, Semantic Scholar, Google Scholar, Papers with Code, and the ACL Anthology to examine how reasoning capabilities emerge in LLMs and where they fail. We make three main contributions. First, we introduce a structured taxonomy of LLM reasoning research, covering Chain-of-Thought reasoning, multi-hop reasoning, mathematical reasoning, common sense reasoning, visual and temporal reasoning, code and algorithmic reasoning, retrieval-augmented reasoning, tool-augmented and agentic reasoning, and reinforcement learning-based reasoning. Second, we analyze methodological trends across these paradigms, including prompting methods, model architectures, training objectives, reward modeling, and evaluation benchmarks. Third, we synthesize recurring limitations and failure modes, such as reasoning hallucinations, brittle multi-step inference, weak causal abstraction, and poor cross-domain generalization. By organizing a rapidly expanding literature, this survey offers a unified view of the current capabilities and limitations of reasoning in LLMs. We also identify emerging research directions, including meta-reasoning, self-evolving reasoning frameworks, multimodal reasoning, and socially grounded reasoning. Overall, this work aims to serve as a reference for developing more robust, interpretable, and generalizable reasoning systems in future language models.

[14] Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality cs.CL | cs.AIPDF

Vedant Badoni, Danqi Chen, Xinyi Wang

TL;DR: 本文提出WebGraphMix，一种基于网络图中心性进行预训练数据选择的轻量级框架。该方法通过计算Common Crawl主机级网络图的结构中心性分数，调整中心与边缘文档在预训练混合中的比例，无需模型训练或标注数据。实验表明，中心与边缘网络区域编码了互补能力，结合两者能提升模型在23个任务上的平均性能。

Details

Motivation: 现有数据选择方法依赖辅助分类器进行文档评分或混合优化，增加了计算开销和对标注数据的依赖。本文旨在探索网络图拓扑结构作为预训练数据筛选的新维度，以更高效地选择数据。

Result: 在DataComp-LM流程中，使用400M和1B参数模型分别在8B和28B token上训练，评估23个任务（从事实知识到符号推理）。中心与边缘文档1:1混合使平均性能从均匀采样的39.8%提升至41.4%；结合结构分数与文档质量分类器分数可进一步提升至43.8%。

Insight: 创新点在于利用网络图结构中心性作为数据选择指标，揭示了中心主机提供可重用抽象、边缘主机编码长尾知识的互补性。该方法与现有基于内容的方法正交，为数据筛选提供了新的结构视角。

Abstract: The performance of modern language models depends critically on pretraining data composition. Yet existing data selection methods rely on auxiliary classifiers for document scoring or mixture optimization, adding computational overhead and dependence on labeled data. We propose WebGraphMix, a lightweight data selection framework that computes structural centrality scores over the Common Crawl host-level web graph and uses them to vary the proportion of central versus peripheral documents in the pretraining mixture. We hypothesize that central hosts expose models to reusable abstractions, while peripheral hosts encode specialized, long-tail knowledge. WebGraphMix computes centrality scores efficiently at web scale, requiring no model training, labeled data, or downstream supervision. We integrate WebGraphMix into the DataComp-LM pipeline and train models at 400M and 1B parameter scales with 8B and 28B tokens respectively, evaluating on 23 tasks ranging from factual knowledge to symbolic reasoning. Our experiments show that central and peripheral web regions encode complementary capabilities. Mixture combining both at a ratio of 1:1 achieves 41.4% on average, compared to 39.8% for uniform sampling. Combining structural scores with document-level quality classifier scores further improves performance to 43.8%. These findings demonstrate that web graph topology is a meaningful axis for pretraining data curation, capturing information that is largely orthogonal to existing content-based approaches.

Meysam Alizadeh, Mohsen Mosleh, Fabrizio Gilardi, Atoosa Kasirzadeh, Joshua Tucker

TL;DR: 本文介绍了SocSci-Repro-Bench基准测试，用于评估AI编码代理在社会科学领域的可复现性能力。研究发现，Claude Code和Codex等前沿编码代理能够复现大量社会科学研究结果，其中Claude Code表现显著优于Codex，且其复现率远超通用LLM代理在类似基准上的表现。

Details

Motivation: 现有评估基准规模有限，且常将代理性能与复现材料本身的问题（如代码无法正确执行）混淆，因此需要构建一个能够隔离代理复现能力的系统性基准。

Result: 在包含221个任务、覆盖四个学科和13个实质领域的SocSci-Repro-Bench上，Claude Code和Codex均能复现大部分社会科学发现，Claude Code表现更优；同时，代理在识别基础研究问题的推理任务上也表现强劲。

Insight: 研究创新点在于构建了首个能够明确区分材料可复现性与代理自身能力的基准，并揭示了提示设计对代理行为的影响（如可能引导其进行确认性规范搜索），强调了在科学工作流中谨慎使用AI系统的重要性。

Abstract: Recent anecdotal evidence suggests that AI coding agents can reproduce published findings when provided with original data and code; yet systematic evaluation across social sciences remains limited. Existing evaluation benchmarks are insufficient, either small or conflate agent performance with problems in the reproduction materials themselves, such as code that fails to execute correctly. Here we introduce SocSci-Repro-Bench, a benchmark of 221 tasks spanning four disciplines and 13 substantive domains, constructed from studies whose results are either fully reproducible with available materials or demonstrably non-reproducible due to missing data, allowing us to isolate agents’ reproduction capacity. Evaluating two frontier coding agents, Claude Code and Codex, we find that both can reproduce a large share of social science findings, with Claude Code substantially outperforming Codex. These reproduction rates considerably exceed those previously reported for general-purpose LLM-based agents on comparable reproducibility benchmarks. Both agents also perform strongly on a reasoning task requiring identification of underlying research questions, and additional analyses suggest that results are not primarily driven by memorization. Providing the original paper PDF alongside replication materials modestly improves performance but introduces bias on tasks where reproduction is impossible. We also show that agents can be nudged toward confirmatory specification search through subtle prompt framing. Together, these findings suggest that at least some frontier coding agents can serve as reliable executors of computational workflows while underscoring the need for careful benchmarking and prompt design as AI systems assume larger roles in scientific production.

[16] When Roleplaying, Do Models Believe What They Say? cs.CL | cs.AIPDF

Benjamin Sturgeon, David Africa, Sid Black

TL;DR: 该论文研究了语言模型在角色扮演时是否真正内化了角色的信念。通过线性真值探针分析模型在扮演历史人物时的内部表示，发现角色扮演主要改变模型输出而非内部真实信念，而有害训练导致的‘涌现错位’则显著改变了模型对虚假信息的内部表征。

Details

Motivation: 探究语言模型角色扮演时是否仅改变输出，还是同时影响了模型内部对真实性的表征，以区分表面行为与深层信念变化。

Result: 在Qwen 2.5 14B、Qwen 3 8B和Llama 3.3 70B模型上，角色扮演仅轻微抑制时代相关虚假陈述，而有害训练导致的涌现错位使虚假主张在探针空间中大幅移向真实区域，并在挑战中更频繁地被辩护。

Insight: 角色扮演与涌现错位构成信念内化谱系的两端：前者主要改变输出，后者显著改变内部表征；线性探针方法可有效区分模型表面行为与深层信念变化。

Abstract: Language models can state that “the Earth orbits the Sun” and, when role-playing Aristotle, assert the opposite. Recent work argues that persona adoption is fundamental to how language models operate, with models constantly selecting the most appropriate persona for a given context. Does such role-playing merely change the model’s outputs, or does it also affect what the model internally represents as truthful? We study this question with linear truth probes, applying them to LLMs role-playing historical personas whose likely beliefs differ from modern consensus. For each persona, we compare false claims the persona would likely have endorsed (era-believed) with topic-matched false claims they would not have endorsed (era-false). Across prompting, in-context learning, and supervised fine-tuning, persona induction suppresses era-believed statements less than equally false alternatives, yet they remain classified as false overall. Role-play therefore shifts what these models say more than what they internally represent as true. We contrast this with models trained on harmful advice that exhibit Emergent Misalignment (EM). Across three model families (Qwen 2.5 14B, Qwen 3 8B, and Llama 3.3 70B), their false claims move substantially toward the true region of probe space, are defended under challenge roughly half the time versus about a sixth for role-play, and are used in downstream reasoning. Role-play and Emergent Misalignment thus are points on a spectrum of belief internalization, where role-play changes what a model says with little representational change, while Emergent Misalignment shifts the internal representation of false claims without fully marking them as true.

[17] SAGE: Answer-Conditioned Uncertainty Targets for Verbal Uncertainty Alignment cs.CLPDF

Kaiwen Shi, Zheyuan Zhang, Yanfang Ye

TL;DR: 本文提出SAGE（语义答案引导的熵）作为群体层面的不确定性目标，通过构建基于采样响应的答案条件不确定性几何结构来校准语言模型的口头不确定性表达。作者进一步提出GUPO（群体不确定性偏好优化）训练框架，专门监督模型的不确定性表达而非完整回答。实验表明该方法在多项推理任务中提升了不确定性排序能力、降低了校准误差并减少了过度自信。

Details

Motivation: 针对当前大语言模型通过自然语言表达不确定性的方式往往无法反映其实际采样行为的问题，作者将口头不确定性对齐视为分布校准问题，旨在从重复模型输出中估计合适的不确定性目标，而非依赖孤立响应。

Result: 在事实性、数学和多项选择推理任务上的实验显示，该方法改善了不确定性排序（uncertainty ranking），降低了校准误差（calibration error），并减少了过度自信（overconfidence）。

Insight: 创新点在于提出答案条件的不确定性几何结构（answer-conditioned uncertainty geometry），能同时保持分类、数值和符号答案的区分度，并提供平滑且保持尺度的校准信号；同时开发了专门针对不确定性通道的GUPO训练框架，实现了对不确定性表达的直接监督。

Abstract: Large language models increasingly express uncertainty through natural-language statements, yet these expressions often fail to reflect the model’s sampled behavior. We study verbal uncertainty alignment as a distributional calibration problem: the appropriate uncertainty target for a prompt should be estimated from repeated model outputs rather than from an isolated response. However, group rollouts alone are insufficient, since the resulting target must provide a useful training signal. Existing targets only partially satisfy this requirement. We propose SAGE, Semantic-Answer Guided Entropy, a group-level uncertainty target that constructs an answer-conditioned uncertainty geometry over sampled responses. SAGE preserves categorical, numeric, and symbolic answer distinctions while maintaining a smooth and scale-preserving calibration signal. We further apply this target through Group-Uncertainty Preference Optimization, or GUPO, an uncertainty-channel training framework that supervises verbal uncertainty expressions rather than the full response. Experiments across factual, mathematical, and multiple-choice reasoning tasks show improved uncertainty ranking, lower calibration error, and reduced overconfidence.

[18] Teaching Diffusion to Speculate Left-to-Right cs.CL | cs.LGPDF

Lexington Whalen, Yuki Ito, Ryo Sakamoto

TL;DR: 本文提出三种训练时干预方法（token位置加权、首次错误焦点损失和链式损失项），以弥合扩散语言模型作为草稿模型生成双向块与自回归目标模型左到右验证之间的差距，从而提升推测解码中草稿的接受长度。

Details

Motivation: 解决扩散语言模型作为草稿模型在推测解码中，其双向块生成与自回归目标模型左到右验证方式不匹配的问题，以提高草稿接受率并降低推理成本。

Result: 在四个目标模型和六个推理、代码、对话基准测试中，三种干预方法相比位置均匀基线，将每个基准的接受草稿长度提升了21-76%，且未增加额外前向传播或改变推理流程。

Insight: 通过位置加权、首次错误焦点损失和链式损失项这三个正交的干预措施，在训练时对齐扩散草稿模型与自回归验证的不对称性，可有效提升推测解码效率，且能与测试时对齐机制（如多草稿自选择）结合。

Abstract: Large language models (LLMs) achieve remarkable performance across a wide range of tasks, but their autoregressive decoding process incurs substantial inference costs due to inherently sequential token generation. Speculative decoding addresses this bottleneck by employing a lightweight draft model to propose multiple future tokens that are subsequently verified in parallel by a larger target model. Recent work has demonstrated that diffusion language models are well suited for this setting, as they can generate entire blocks of draft tokens in parallel and thereby alleviate the sequential constraints of autoregressive drafting. A subtlety of this regime is that block-diffusion drafters generate tokens bidirectionally within a block, whereas verification is performed by an autoregressive target model that evaluates tokens in a strictly left-to-right manner, leaving a gap between the symmetric training-time objective and the asymmetric verification-time reward. In this work, we offer an empirical analysis of three training-time interventions that narrow this gap: token positional weighting, a first-error focal loss that targets the position that breaks the accepted prefix within each block, and a chain loss term that substitutes a differentiable surrogate for the expected accepted length. The three interventions act along orthogonal axes (position, block-conditional first error, joint prefix) and compose additively; they are likewise orthogonal to test-time alignment mechanisms such as multi-draft self-selection, with which they can in principle be combined. Across four target models and six reasoning, code, and dialogue benchmarks, the three interventions raise accepted draft length by 21-76% per benchmark over a position-uniform baseline, without adding additional forward passes and without changing the inference pipeline or the rejection-sampling exactness contract.

[19] Pretrained self-supervised speech models can recognize unseen consonants cs.CL | cs.AIPDF

Chihiro Taguchi, Éric Le Ferrand, Hirosi Nakagawa, Hitomi Ono, Kanji Kato

TL;DR: 该论文研究了预训练自监督语音识别模型对罕见辅音（如科伊桑语中的搭嘴音）的识别能力。通过在两种富含搭嘴音的科伊桑语言（G|ui 和 West !Xoon）数据上微调 Wav2Vec2 和 HuBERT 模型，发现微调后的模型对搭嘴音的识别准确率甚至高于非搭嘴音。

Details

Motivation: 当前预训练自监督语音模型的训练数据严重偏向高资源语言，可能导致对低资源语言中罕见的语音类型（如搭嘴音）表征不足，因此研究这些模型是否能准确识别罕见辅音。

Result: 在两种科伊桑语言数据上微调 Wav2Vec2 和 HuBERT 模型后，模型对搭嘴音的识别准确率一致地高于非搭嘴音。

Insight: 研究表明，自监督学习能够实现跨人类语音（包括罕见音素）的泛化能力，即使预训练数据中罕见音素代表性不足，模型仍可通过微调有效学习并识别它们。

Abstract: Modern pretrained self-supervised automatic speech recognition models are trained on large-scale audio data to encode speech into contextualized representations. However, their training data are heavily skewed toward high-resource languages with little data from low-resource languages, raising concerns about the potential underrepresentation of typologically uncommon speech sounds such as click consonants primarily found in Khoisan languages. This leads to our central research question: Can these models recognize click consonants as accurately as other speech sounds? To address this question, we fine-tune and compare pretrained self-supervised speech models (Wav2Vec2 and HuBERT) on data from two click-rich Khoisan languages (G|ui and West !Xoon). Our results reveal that the fine-tuned models consistently recognize clicks more accurately than non-clicks, suggesting that self-supervision enables generalization across human speech sounds including rare phonemes.

[20] Improving Cross-Format Robustness in Language Models with Multi-Format Training cs.CLPDF

June M. Liu, Shaomian Zheng, He Cao, Dingnan Jin, Qing Cui

TL;DR: 该论文研究了大型语言模型对答案格式的敏感性，提出了跨格式鲁棒性的概念，并比较了全格式训练与FormatMix方法的效果。研究发现，多格式监督能显著提升任务性能和跨格式鲁棒性，而仅使用多项选择题监督则效果有限甚至有害。论文还发现，仅将约30%的训练集扩展为多格式即可获得大部分增益，表明格式多样性是鲁棒性的关键驱动因素。

Details

Motivation: 大型语言模型通常对答案格式敏感，同一问题在不同语义等价格式下可能得到不同答案，这影响了模型的鲁棒性和一致性。论文旨在通过多格式训练来减少这种敏感性，提升模型的跨格式鲁棒性。

Result: 在GLM4和Llama-3.1模型上，多格式监督一致提高了任务性能和跨格式鲁棒性，而仅使用多项选择题监督则益处不大甚至降低鲁棒性。实验表明，仅扩展约30%的训练集为多格式即可恢复全格式训练的大部分增益，这一效果在不同模型家族和规模中均出现。

Insight: 论文的创新点在于定义了跨格式鲁棒性，并提出了轻量级的FormatMix方法，通过有选择地扩展训练数据格式来提升模型鲁棒性。客观分析认为，其核心洞察是格式多样性而非额外监督本身是鲁棒性的关键，这为在不改变基础模型的情况下减少格式敏感性提供了实用方案。

Abstract: Large language models often remain sensitive to answer format: a question solved correctly in one form may fail in another semantically equivalent form. To study this gap, we define cross-format robustness as the extent to which a model answers the same underlying question consistently across formats. We then compare full-format training with FormatMix, which expands only a subset of training items into multiple equivalent formats using either random or targeted selection. Across GLM4 and Llama-3.1, multi-format supervision consistently improves both task performance and cross-format robustness, whereas Multiple-choice question (MCQ)-only supervision alone brings little benefit and can even reduce robustness. We further find that expanding only about 30% of the training set into multiple formats often recovers most of the gain from full-format training, and this effect appears across the model families and sizes we study. These results suggest that format diversity, rather than additional supervision alone, is the key driver of robustness. That lightweight multi-format augmentation is a practical way to make LLMs less sensitive to answer format without changing the base model.

[21] Multi-Agent Reasoning with Adaptive Worker Allocation for Stance Detection cs.CLPDF

Meysam Sabbaghan, Arman Zareian Jahromi, Doina Caragea

TL;DR: 本文提出了一种用于立场检测的多智能体推理框架，采用自适应工作者分配机制。该框架采用Manager-Worker架构，Manager根据输入复杂性动态分配不同数量的Worker智能体，每个Worker从不同角度分析输入并生成纯推理解释，最后由Manager综合这些解释得出最终预测。该方法在多个立场检测数据集上进行了评估，尤其在隐式和上下文依赖的立场案例上取得了显著提升。

Details

Motivation: 解决现有立场检测方法（如多数投票或自一致性）在聚合时丢弃中间推理过程的问题，这些方法在面对多种合理解释时可能不够鲁棒。

Result: 在SemEval-2016、P-Stance和COVID-19 Stance数据集上使用Llama、Mistral和Gemini模型进行评估，在COVID-19数据集上达到86.07 Macro-F1，在SemEval-2016上达到82.90 Macro-F1，在隐式和上下文依赖的立场案例上提升最大，在P-Stance等更显式的数据集上保持竞争力。

Insight: 创新点在于将聚合从标签级投票转向推理级综合，通过自适应分配多智能体进行多角度推理，有效处理立场隐晦或间接的文本，提升了模型在复杂情况下的鲁棒性和解释性。

Abstract: Stance detection requires identifying an author’s position toward a target, often from short-form texts where stance is implicit, indirect, or rhetorically framed. Although large language models (LLMs) achieve strong performance on this task, single-pass prompting can be brittle when multiple interpretations are plausible. Existing aggregation strategies, such as majority voting or self-consistency, improve robustness by combining labels, but they discard the intermediate reasoning needed to resolve conflicting interpretations. We introduce a multi-agent reasoning framework with adaptive worker allocation for stance detection that shifts aggregation from label-level voting to reasoning-level synthesis. The framework employs a Manager-Worker architecture in which a Manager adaptively allocates a variable number of Worker agents based on input complexity. Each Worker analyzes the input from a distinct perspective and produces a reasoning-only explanation without emitting a stance label; the Manager then synthesizes these explanations to produce the final prediction. We evaluate the proposed framework on SemEval-2016, P-Stance, and COVID-19 Stance using Llama, Mistral, and Gemini. Results show that the framework yields the largest gains on implicit and context-dependent stance cases, achieving 86.07 Macro-F1 on COVID-19 and 82.90 on SemEval-2016, while remaining competitive on more explicit stance datasets such as P-Stance. These findings suggest that adaptive reasoning-level aggregation is most beneficial when stance cannot be reliably inferred from surface cues alone.

[22] Can AI Reason Like an Urban Planner? Benchmarking Large Language Models Against Professional Judgment cs.CLPDF

Yijie Deng, He Zhu, Wen Wang, Junyou Su, Minxin Chen

TL;DR: 本文介绍了Urban Planning Bench（UPBench），一个用于评估大语言模型在城市规划领域推理能力的专业评估框架。研究发现，LLMs在高层分析任务上表现优于事实记忆和综合判断，揭示了规划知识中制度、管辖和时间背景的重要性，并总结了四种认知诊断：监管幻觉、概念混淆、棘手问题瘫痪和实践智慧缺陷。

Details

Motivation: 研究旨在系统评估大语言模型能否复制城市规划中的专业推理能力，特别是情境敏感性、价值意识和制度素养，以填补现有AI工具在规划实践中缺乏系统性测试框架的空白。

Result: 通过UPBench框架对25个LLMs进行自动评分和专家评审，发现模型在高层分析任务上表现更好，但在事实回忆和综合判断上存在困难，揭示了规划知识的背景依赖性。

Insight: 创新点在于提出了一个结合知识支柱和认知水平的领域特定评估矩阵，并识别了LLMs在规划推理中的具体认知局限，为AI在规划中的差异化委托提供了实证依据。

Abstract: Problem, Research Strategy, and Findings: The rise of large language models (LLMs) raises a key question for urban planning: which forms of professional planning knowledge can AI replicate, and which still require human judgment? Although AI tools are increasingly used in planning practice, there is still no systematic framework for testing whether they can reason with the contextual sensitivity, value awareness, and institutional literacy central to planning expertise. This paper introduces Urban Planning Bench (UPBench), a domain-specific evaluation framework that assesses LLM reasoning through a 4x5 matrix of four knowledge pillars and five cognitive levels adapted from Bloom’s revised taxonomy. Evaluating 25 LLMs with automated scoring and expert review, we find a non-monotonic cognitive curve: models perform better on higher-order analytical tasks than on factual recall and integrative judgment. This suggests that planning knowledge often treated as lower-order is deeply shaped by institutional, jurisdictional, and temporal context, making it hard for LLMs to generalize. We summarize these limits as four epistemic diagnostics: regulatory hallucination, conceptual conflation, wickedness paralysis, and phronetic deficit. Takeaway for Practice: The findings support differential delegation in planning. LLMs can assist with cross-disciplinary synthesis, literature review, scenario generation, and preliminary policy analysis. However, they remain unreliable for jurisdiction-specific regulation, normative conflict resolution, and context-sensitive procedure. Agencies should require verification for AI-assisted regulatory analysis, while planning education should emphasize institutional literacy, normative judgment, and contextual sensitivity.

[23] Automated Creativity Evaluation of Language Models Across Open-Ended Tasks cs.CL | cs.AIPDF

Min Sen Tan, Zachary Kit Chun Choy, Syed Ali Redha Alsagoff, Nadya Yuki Wangsajaya, Mohor Banerjee

TL;DR: 本文提出了一种自动化、领域无关的框架，用于评估大型语言模型（LLMs）在开放式任务中的创造力。该框架将测量工具与创造性任务本身分离，通过语义熵度量发散性创造力（新颖性和多样性），并通过一种新颖的基于检索的多智能体评判框架来评估收敛性创造力（任务完成度）。

Details

Motivation: 现有的大多数创造力评估指标都与特定任务紧密耦合，将领域假设嵌入评估过程，限制了可扩展性和通用性。为了解决这一差距，需要一种系统且可扩展的方法来评估LLMs在不同任务中的创造力。

Result: 该框架在三个不同领域（问题解决MacGyver、研究构思HypoGen和创意写作BookMIA）上进行了验证，使用了一系列LLMs。结果表明，该框架能可靠地捕捉创造力的关键方面（新颖性、多样性和任务完成度），并揭示了模型属性（如大小、温度、时效性和推理能力）对创造性表现的影响。

Insight: 创新点在于将创造力评估解耦为任务无关的测量装置，并引入了语义熵作为无参考的、鲁棒的发散性创造力度量，以及一个高效的、基于检索的多智能体评判框架来评估收敛性创造力。这为自动化、可复现和可推广的LLM创造力评估建立了标准。

Abstract: Large language models (LLMs) have achieved remarkable progress in language understanding, reasoning, and generation, sparking growing interest in their creative potential. Realizing this potential requires systematic and scalable methods for evaluating creativity across diverse tasks. However, most existing creativity metrics are tightly coupled to specific tasks, embedding domain assumptions into the evaluation process, and limiting scalability and generality. To address this gap, we introduce an automated, domain-agnostic framework for quantifying LLM creativity across open-ended tasks. Our approach separates the measurement apparatus from the creative task itself, enabling scalable, task-agnostic assessment. Divergent creativity is measured using semantic entropy, a reference-free and robust metric for novelty and diversity, validated against human annotations, LLM-based novelty judgments and baseline diversity measures. Convergent creativity is assessed via a novel retrieval-based multi-agent judge framework that delivers context-sensitive evaluation of task fulfilment with over 60% improved efficiency. We validate our framework in three qualitatively distinct domains: problem-solving (MacGyver), research ideation (HypoGen), and creative writing (BookMIA), using a broad suite of LLMs. Empirical results show that our framework reliably captures key facets of creativity, including novelty, diversity, and task fulfilment, and reveal how model properties, such as size, temperature, recency, and reasoning, impact creative performance. Our work establishes a reproducible and generalizable standard for automated LLM creativity evaluation, paving the way for scalable benchmarking and accelerating progress in creative AI.

[24] Notes2Skills: From Lab Notebooks to Certainty-Aware Scientific Agent Skills cs.CLPDF

Shi Liu, Jiayao Chen, Chengwei Qin, Yanqing Hu, Jufan Zhang

TL;DR: Notes2Skills是一个将实验室笔记转化为科学AI代理可验证技能的两阶段框架，其核心在于保留作者在笔记中表达的不确定性。该框架能有效区分笔记中的已验证观察、不确定判断和潜在实验步骤，避免AI代理将不确定的科学判断误认为确定结论或可执行指令。

Details

Motivation: 现有AI科学工作大多关注论文、协议或结构化数据库，而忽视了非正式的实验室笔记作为AI代理输入的价值。实验室笔记混杂了已验证的观察、不确定的判断和可能的后续步骤，若不加区分，AI代理可能混淆这些信号，导致错误决策。

Result: 在七个条件和三个湿实验室会话的评估中，Notes2Skills是唯一一个既不会将不确定的笔记误认为确定指令，也不会丢弃确定指令的配置，证明了其有效性。

Insight: 论文的核心创新在于提出了保留作者确定性（certainty preservation）作为连接实验室笔记与可靠AI代理技能的关键缺失环节。这为构建更安全的AI协科学家系统开辟了路径，其两阶段框架（可能包括信息提取与不确定性标注）的设计思路具有借鉴意义。

Abstract: Scientific discovery workflows usually contain and rely heavily on lab notes, where researchers record observations, interpret uncertain results, and plan follow-up experiments. Such informative lab notes preserve evolving scientific reasoning and author uncertainty, rather than polished final results exhibited in publications, providing a valuable opportunity for AI to engage in scientific exploration at a more comprehensive and deeper level. However, most prior work on scientific text focuses on papers, protocols, or structured databases, leaving informal laboratory notes underexplored as inputs to AI agents for science. This gap matters because lab notes often intermingle validated observations, tentative judgments, and possible experimental next steps within the same passage. If these signals are conflated, an AI agent may mistake uncertain scientific judgments for confirmed conclusions or executable actions. To this end, we present Notes2Skills, a two-stage framework for turning lab notebooks into verifiable skills for scientific AI agents while preserving the author’s certainty. Across seven conditions and three wet-lab sessions, Notes2Skills is the only configuration that neither mistakes uncertain notes for firm instructions nor discards firm ones. We show that certainty preservation is the missing piece between lab notebooks and reliable agent skills, opening a path toward safer AI co-scientist systems.

[25] WorldReasoner: Evaluating Whether Language Model Agents Forecast Events with Valid Reasoning cs.CL | cs.AIPDF

Yizhou Chi, Eric Chamoun, Zifeng Ding, Andreas Vlachos

TL;DR: 论文提出了WorldReasoner评估框架，用于评估语言模型代理在时间有效约束下的事件预测能力。该框架通过模拟预测日期、限制访问该日期前的证据，并要求模型提交概率、引用证据和可选因果事件图，从结果准确性、证据质量和推理质量三个维度进行综合评分。

Details

Motivation: 当前评估语言模型代理的事件预测能力主要依赖最终答案的准确性，但这无法区分模型是基于有效推理、记忆训练事实、捏造证据还是生成无支持的因果故事来做出预测。因此，需要一个新的评估框架来确保预测是基于时间有效的证据和推理。

Result: 在六个受控代理设置中，时间有效的检索是结果准确性的最强驱动因素；因果图构建提高了关键事件的恢复能力；启用正确图的预测能更好地基于关键事件和相关来源，但代理仍难以将扎实的证据转化为校准良好的概率。基准包含345个已解决的任务，源自14,141篇文章，其图覆盖了8,087个提取的事件。

Insight: 创新点在于提出了一个多维度（结果、证据、推理）且时间敏感的评估框架，通过模拟预测日期和事后构建的参考因果图来确保评估的有效性。客观来看，其代理驱动的构建流程实现了大规模基准生成，并将因果图明确纳入评估，这为深入分析模型预测的推理过程提供了新工具。

Abstract: Forecasting real-world events requires language-model agents to reason under uncertainty from incomplete, time-bounded information. Yet evaluating whether agents genuinely forecast requires more than final-answer accuracy: a model may be correct by recalling memorized training facts, citing fabricated evidence, or producing an unsupported causal story. We present WorldReasoner, an evaluation framework for temporally valid event forecasting. Each task gives an agent a resolved forecasting question, a simulated forecast date, and access only to evidence available before that date; after resolution, the framework scores the submitted probability, cited evidence, and optional causal event graph. WorldReasoner reports three complementary axes: outcome quality against resolved answers, evidence quality over cited sources, and reasoning quality against post-resolution hindsight graphs. The benchmark is built by an agentic construction pipeline that generates forecasting questions, collects time-stamped evidence, and builds hindsight reference graphs at scale, yielding 345 resolved tasks derived from 14,141 articles with graphs covering 8,087 extracted events. Across six controlled agent settings, temporally valid retrieval is the strongest driver of outcome accuracy; causal graph construction improves key-event recovery; and correct graph-enabled forecasts are more strongly grounded in key events and relevant sources, yet agents still struggle to convert grounded evidence into calibrated probabilities.

[26] When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models cs.CLPDF

Xuan Dong, Zhe Han, Tianhao Niu, Qingfu Zhu, Wanxiang Che

TL;DR: 本文首次对视觉-语言-动作模型进行了系统的多语言评估，通过将LIBERO基准翻译成十种语言，揭示了在非英语指令下模型性能严重下降30-50%。研究发现语言影响在任务步骤中高度不均匀，并基于此提出了一种基于步骤语言敏感性的推理时干预方法，显著提升了语言变体下的性能。

Details

Motivation: 解决VLA模型在语言条件机器人操作中对语言变化的鲁棒性理解不足的问题，探究多语言指令下模型性能下降的原因。

Result: 在LIBERO基准的多语言翻译版本上，非英语指令导致成功率下降30-50%；提出的步骤敏感表征对齐干预方法显著改善了性能。

Insight: 创新点在于揭示了VLA模型的语言鲁棒性本质上是一个步骤级控制问题，并提出了基于步骤语言敏感性的推理时干预方法；客观分析认为其将时间结构化分析引入语言鲁棒性评估是关键洞见。

Abstract: Vision-Language-Action (VLA) models have shown strong performance in language-conditioned robotic manipulation, yet their robustness to linguistic variation remains poorly understood. In this work, we present the first systematic multilingual evaluation of VLA models by translating the LIBERO benchmark into ten languages, revealing severe performance degradation under non-English instructions, with success rates dropping by 30-50%. Through fine-grained analysis of task executions, we find that language influence is highly non-uniform across steps: certain steps exhibit strong language dependence and dominate overall task failure, while others are largely language-agnostic. Based on this insight, we propose a step-wise inference-time intervention that aligns representations according to step language sensitivity, substantially improving performance under linguistic variation. Our results indicate that language robustness in VLA models is fundamentally a step-wise control problem, highlighting the importance of temporally structured analysis for reliable embodied agents.

[27] An Ontology-Guided Multi-Anchor Graph Retrieval Framework for Traffic Legal Liability Determination cs.CLPDF

Xu Li, Shuqi Tian, Xun Han, Kuncheng Zhao, Xinyi Li

TL;DR: 本文提出了一种名为OMAGR的本体引导多锚点图检索框架，用于解决交通法律责任判定中的多维检索瓶颈问题。该方法通过将查询分解为与本体对齐的锚点，并在多个法律维度上执行并行图检索，确保在融合前实现跨维度的独立检索。

Details

Motivation: 现有检索增强生成方法在处理交通法律问题时存在多维检索瓶颈，即单一架构将复杂的法律查询压缩到单一通路，导致相互依赖的法定维度被忽视。

Result: 在构建的专家验证基准数据集TrafficLaw-QA（包含200个问题和527条法律条款）上，所提方法在上下文精确度和忠实度指标上优于基线模型。

Insight: 核心创新在于通过本体引导的并行多锚点检索机制，有效解决了法律领域多维度相互依赖条款的检索瓶颈，为法律责任判定研究提供了新方向。

Abstract: Traffic law liability determination is critical for assigning legal penalties, requiring the simultaneous identification of interdependent statutory provisions across multiple legal dimensions. However, existing retrieval-augmented generation methods suffer from a multi-dimensional retrieval bottleneck: single axis architectures compress complex legal queries into a single pathway, causing interdependent statutory dimensions to be overlooked. To address this, we propose OMAGR, an ontology-guided framework that decomposes queries into ontology-aligned anchors and executes parallel graph retrieval across each dimension, ensuring independent retrieval across dimensions before fusion. To evaluate the proposed method, we created the TrafficLaw-QA dataset, an expert-validated benchmark dataset containing 200 questions and 527 legal provisions. Results show that TrafficOmni-RAG outperforms baselines on Context Precision and Faithfulness metrics. The findings demonstrate that parallel multi-anchor retrieval effectively resolves the multi-dimensional retrieval bottleneck, offering a promising direction for traffic law liability determination research.

Jiajie Jin, Yuyang Hu, Kai Qiu, Qi Dai, Chong Luo

TL;DR: 本文提出Arbor框架，通过假设树精炼机制实现自主科学研究。该框架包含长期协调器、短期执行器和持久化假设树，将研究过程从局部尝试转变为跨时间累积的策略、执行与证据整合。

Details

Motivation: 旨在解决AI代理如何自主运行长期科学研究循环（探索、实验、抽象）的问题，将自主研究从离散尝试转变为可持续累积过程。

Result: 在自主优化场景的六个真实研究任务中，Arbor在所有任务上取得最佳保持结果，相对增益超过Codex和Claude Code的2.5倍；在MLE-Bench Lite上使用GPT-5.5达到86.36%任意奖牌率，为对比中最强结果。

Insight: 创新点在于假设树精炼机制，通过树结构关联假设、工件与证据，实现跨时间知识传播；框架设计将协调策略与执行解耦，支持可复用的经验积累与搜索边界动态优化。

Abstract: Scientific progress depends on a repeated loop of exploration, experimentation, and abstraction. Researchers test candidate directions, interpret the evidence, and carry the resulting lessons into later attempts. We study how an AI agent can run this loop autonomously over long horizons. We introduce Arbor, a general framework for autonomous research that combines a long-lived coordinator, short-lived executors, and Hypothesis Tree Refinement (HTR), a persistent tree that links hypotheses, artifacts, evidence, and distilled insights across time. The coordinator manages global research strategy over the tree, while executors implement and test individual hypotheses in isolated worktrees. As results return, Arbor updates the tree, propagates reusable lessons, refines the search frontier, and admits verified improvements. This design turns autonomous research from a sequence of local attempts into a cumulative process in which strategy, execution, and evidence are carried across time. We evaluate Arbor under Autonomous Optimization (AO), an operational setting where an agent improves an initial research artifact through iterative experimentation without step-level human supervision. Across six real research tasks in model training, harness engineering, and data synthesis, Arbor achieves the best held-out result on all six tasks, attaining more than 2.5x the average relative held-out gain of Codex and Claude Code under the same task interface and resource budget. On MLE-Bench Lite, Arbor reaches 86.36% Any Medal with GPT-5.5, the strongest result in our comparison.

[29] Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videos cs.CLPDF

Junyu Lu, Deyi Ji, Liqun Liu, Xiaokun Zhang, Youlin Wu

TL;DR: 该论文提出了一种可解释的仇恨视频检测方法，通过引入两个带有细粒度多模态有害元素标注和上下文理由的数据集（Ex-HateMM和Ex-ImpliHateVid），并设计了一个信息增强与推理增强框架（IARE），该框架利用多模态思维链整合证据，并通过直接偏好优化引导模型推理路径，从而在检测仇恨视频的同时生成准确的解释性理由。

Details

Motivation: 现有仇恨视频检测研究主要关注二元分类，缺乏揭示判断背后隐含意义的上下文理由，严重损害了模型的可解释性。因此，本文旨在实现可解释的仇恨视频检测，使模型能够结合相关证据和逻辑推理提供决策理由。

Result: 在Ex-HateMM和Ex-ImpliHateVid两个数据集上的广泛实验表明，IARE框架在仇恨视频检测任务上达到了最先进的性能，并且能够生成准确的解释性理由。

Insight: 论文的创新点在于构建了首个用于可解释仇恨视频检测的细粒度多模态标注数据集，并提出了IARE框架，该框架通过多模态思维链进行信息增强，并利用直接偏好优化技术来引导和纠正模型的推理路径，从而同时提升检测性能和理由的逻辑连贯性。

Abstract: Hateful videos have become prevalent on online platforms, highlighting an urgent need for effective detection. However, existing studies primarily focus on binary classification and fail to provide contextual rationales that reveal the implicit meanings behind these judgments, significantly undermining model explainability. To fill this gap, we aim to achieve explainable hateful video detection, enabling models to provide contextual rationales that integrate relevant evidence and logical reasoning alongside decisions. This approach can comprehensively enhance the understanding of video content and the explainability of the decision-making process. We first introduce two datasets, Ex-HateMM and Ex-ImpliHateVid, for explainable hateful video detection. Each dataset provides fine-grained annotations of multimodal harmful elements, along with contextual rationales. We then propose an Information Augmentation and Reasoning Enhancement (IARE) framework designed for explainable detection. The framework employs an information augmentation phase that leverages the multimodal chain-of-thought to integrate harmful elements, thereby enriching rationale evidence. Additionally, IARE incorporates a reasoning enhancement phase, in which Direct Preference Optimization guides the model toward correct reasoning paths and away from incorrect ones, thereby improving the logical coherence of its justifications. We conduct extensive experiments on the two datasets, comparing multiple baselines with our proposed IARE framework. The results demonstrate that IARE achieves state-of-the-art performance while also generating accurate rationales.

[30] Agreement in Representation Space for Open-Ended Self-Consistency cs.CLPDF

Paula Ontalvilla, Gorka Azkune, Aitor Ormazabal

TL;DR: 本文提出了一种基于表示空间一致性的方法（EBA），用于开放生成任务中的自一致性评估。该方法通过聚类生成样本在嵌入空间中的分布来估计一致性，无需训练即可应用于代码合成、文本摘要等任务。实验表明，EBA在数学推理、代码生成和摘要任务中优于随机选择，且比基于LLM评估或不确定性估计的方法具有更稳定的扩展性。

Details

Motivation: 现有自一致性方法主要依赖精确匹配，仅适用于分类输出任务，无法有效处理开放生成任务。本文旨在探索将一致性理解为生成空间的几何属性，即语义兼容的生成内容在表示空间中聚集于相似区域。

Result: 在数学推理、代码生成和文本摘要任务上的实验表明，EBA一致性地优于随机选择，且比基于LLM评估或不确定性估计的近期选择方法表现出更稳定的扩展行为。此外，表示空间中生成样本的几何位置与生成质量强相关：靠近中心区域的生成往往更可靠，而边缘区域的生成准确性显著较低。

Insight: 创新点在于将自一致性重新定义为生成样本的几何组织属性，而非精确符号重叠，并提出了无需训练的嵌入空间聚类方法（EBA）来量化一致性。客观来看，该方法为开放生成任务提供了一种可扩展且稳健的一致性评估框架，且其几何解释具有跨模型家族和嵌入空间的稳定性。

Abstract: Self-consistency improves LLM reasoning by sampling multiple outputs and selecting the most consistent answer, but existing formulations largely rely on exact matching and therefore remain limited to tasks with categorical outputs. In this work, we study self-consistency in open-ended generation tasks such as code synthesis and text summarization. We hypothesize that consistency can be understood as a geometric property of the generation space, where semantically compatible generations concentrate in similar regions of representation space. To study this hypothesis, we introduce Embedding-Based Agreement (EBA), a simple training-free operationalization that estimates agreement by clustering sampled generations in embedding space. Through experiments on mathematical reasoning, code generation, and summarization, we show that agreement in representation space provides a robust and scalable signal of self-consistency for open-ended tasks. In particular, EBA consistently outperforms random selection and exhibits more stable scaling behavior than recent selection approaches based on LLM evaluation or uncertainty estimation. We further show that these agreement signals remain stable across model families and embedding spaces, even with native hidden representations. Finally, our analysis shows that the geometric location occupied by sampled generations is strongly correlated with generation quality: generations concentrated near central regions of representation space tend to correspond to more reliable outputs, whereas peripheral generations are substantially less accurate. Overall, our findings support viewing self-consistency as a property of the geometric organization of sampled generations rather than exact symbolic overlap.

[31] Reassessing High-Performing LLMs on Polish Medical Exams: True Competence or Bias-Driven Performance? cs.CLPDF

Antoni Lasik, Jakub Pokrywka, Łukasz Grzybowski, Jeremi Ignacy Kaczmarek, Gabriela Korzańska

TL;DR: 本文重新评估了大型语言模型在波兰医学考试上的表现，通过构建一个包含超过15,000道题目的扩展且更具挑战性的基准测试，揭示了传统多项选择题评估可能因猜测策略和答案偏差而高估模型真实临床能力的问题。

Details

Motivation: 动机在于解决当前医学领域LLM评估主要依赖多项选择题，这可能导致因猜测和偏差而高估模型真实临床能力的问题，因此需要更严谨的基准来测试其推理能力。

Result: 在更严格的评估设置下，最佳模型（Qwen3.5-122B）在英语和波兰语考试上的得分分别下降了28.4和31个百分点，表明标准MCQA分数不能可靠反映真实的医学能力。

Insight: 创新点在于构建了一个减少MCQA特定伪影、更好测试推理能力的扩展基准，并提供了公开可用的数据集，强调了评估设计对结果的重要影响，为更准确的医学AI能力评估提供了新视角。

Abstract: Large language models (LLMs) in medicine are mainly evaluated using multiple-choice question answering (MCQA), which can overestimate real clinical ability due to guessing strategies and answer biases. To address these limitations, we introduce an expanded and more challenging benchmark based on Polish medical exams, adding over 15,000 questions, two new domains, and four structural modifications that reduce MCQA-specific artifacts and better test reasoning. We evaluate 21 LLMs and show that evaluation design strongly affects results. Under our harder setup, the best model (Qwen3.5-122B) drops by 28.4 and 31 pp on English and Polish exams, respectively. Despite low evidence of data contamination, standard MCQA scores do not reliably reflect true medical competence. To facilitate further research, we make our benchmark publicly available.

[32] Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models cs.CLPDF

Jia Deng, Junyi Li, Wayne Xin Zhao, Jinpeng Wang, Hongyu Lu

TL;DR: 本文提出了一种名为AGDO的注意力引导去噪与优化框架，用于改进扩散大语言模型（dLLMs）。该方法通过分析注意力机制，识别对上下文依赖更强的关键token，并基于此指导去噪顺序和优化过程，以替代传统的随机掩码策略，从而提升模型在数学和代码生成等推理任务上的性能。

Details

Motivation: 现有扩散大语言模型的后训练方法主要依赖随机掩码策略，忽视了token之间的内在依赖关系，这限制了模型在推理任务中的表现。论文通过实证分析发现，注意力机制中与未掩码上下文关联更强的token对生成稳定性和推理至关重要。

Result: 在数学和代码生成基准测试上的实验表明，AGDO框架能持续提升推理性能，其表现优于当前最先进的扩散大语言模型后训练方法。

Insight: 创新点在于将注意力结构直接用于指导去噪顺序和优化过程（如监督微调和强化学习），从而更有效地利用token依赖关系，这为扩散模型的训练优化提供了新的方向。从客观角度看，该方法通过数据驱动的注意力分析替代随机假设，可能提高了训练效率和模型泛化能力。

Abstract: Diffusion large language models (dLLMs) offer an efficient alternative to autoregressive models through parallel decoding, yet existing post-training methods largely rely on random masking strategies that overlook intrinsic token dependencies. In this work, we present an empirical analysis of attention in dLLMs and show that tokens attending more strongly to unmasked context exhibit greater generation stability and play a critical role in reasoning. Motivated by these findings, we propose AGDO, an attention-guided denoising and optimization framework that aligns both training and optimization with attention-derived dependencies. AGDO determines the denoising order based on attention structure and emphasizes attention-critical tokens during supervised fine-tuning and reinforcement learning. Experiments on mathematical and coding benchmarks demonstrate that AGDO consistently improves reasoning performance, outperforming state-of-the-art post-training methods for dLLMs.

[33] Measuring Epistemic Resilience of LLMs Under Misleading Medical Context cs.CLPDF

Hongjian Zhou, Xinyu Zou, Jinge Wu, Sean Wu, Junchi Yu

TL;DR: 这篇论文提出了‘认知韧性’的概念，用于衡量大语言模型在误导性医疗语境下维持正确判断的能力。作者构建了名为MedMisBench的基准测试，包含超过一万个医疗问题项和近五万个误导性语境-选项对。研究发现，当在LLMs原本能正确回答的问题中注入误导性上下文时，模型的平均准确率从71.1%大幅下降至38.0%，攻击成功率高达51.5%，其中以权威框架的虚假信息和例外中毒类误导最为有效。

Details

Motivation: 当前LLMs在医疗执照考试中已达到专家水平，这容易让人误以为高分等同于安全的医疗判断能力。然而，随着患者越来越多地使用LLMs获取健康建议，模型在误导性信息下的脆弱性成为一个关键的安全隐患。论文旨在揭示和量化这一风险。

Result: 在MedMisBench基准上测试了11种模型配置，结果显示，在集中性误导语境下，模型平均准确率从71.1%骤降至38.0%，总体攻击成功率为51.5%。最具破坏性的误导类型是权威框架的虚假信息（攻击成功率69.5%）和例外中毒声明（64.1%）。一个由7个国家14名临床医生组成的专家组评估认为，38.2%的案例存在严重的潜在危害风险。

Insight: 论文的核心创新点在于提出了‘认知韧性’这一评估维度，并构建了专门的基准MedMisBench。这揭示了当前医疗领域LLM评估的一个结构性盲点：现有基准主要测试模型‘知道什么’，而未能评估其在误导性语境下‘是否坚持正确的医疗判断’。这为未来构建更鲁棒、更安全的医疗AI系统指明了关键的评估方向。

Abstract: Large language models (LLMs) now reach expert-level scores on medical licensing exams, encouraging the assumption that high scores imply safe medical judgment while patients increasingly use them for health advice. We show this assumption is fragile: when misleading context is injected into questions that LLMs originally answer correctly, they abandon the correct answer. We call the ability to maintain correct judgment under adversarial context epistemic resilience, and introduce MedMisBench to measure it. MedMisBench contains 10,932 medical question items and 48,889 misleading context-option pairs spanning medical reasoning, agentic capability, and patient-journey evaluation. Across 11 model configurations, mean accuracy falls from 71.1% on original questions to 38.0% under focused misleading context, with 51.5% attack success. The most damaging injections are formal, rule-like fabrications: authority-framed falsehoods reach 69.5% attack success and exception-poisoning claims reach 64.1%. A 14-member clinical panel from 7 countries identified serious potential harm in 38.2% of reviewed cases. MedMisBench exposes a structural blind spot in LLM evaluation in medical settings: existing benchmarks measure what models know, but not whether they preserve correct medical judgment under misleading context.

[34] Verifiable Environments Are LEGO Bricks: Recursive Composition for Reasoning Generalization cs.CLPDF

Hao Xiang, Qiaoyu Tang, Le Yu, Yaojie Lu, Xianpei Han

TL;DR: 本文提出RACES框架，将可验证环境视为可组合的乐高积木，通过递归自动组合来扩展强化学习训练环境。该框架定义了四种组合算子，能够从少量基础环境递归生成大量复合环境，从而提升大语言模型的推理泛化能力。实验表明，在未见过的基准测试上，该方法能显著提升模型性能，且仅需少量基础环境即可达到与大量独立环境相当的效果。

Details

Motivation: 现有基于可验证环境的强化学习方法依赖人工或独立构建环境，其扩展性受限于线性增长，难以实现可扩展的推理泛化。本文旨在通过环境自动递归组合来解决这一瓶颈。

Result: 在六个未见过的基准测试上，RACES将DeepSeek-R1-Distill-Qwen-14B的平均性能提升3.1分（从48.2到51.3），将Qwen3-14B从58.8提升至61.1。仅使用50个基础环境即可达到与使用300个独立环境相当的性能，显著提升了环境利用效率。

Insight: 核心创新在于将可验证环境形式化为输入输出类型匹配的可组合模块，并定义了序列、并行、排序和选择四种组合算子来实现递归自动组合。这为大规模生成多样化推理模式训练环境提供了一种高效、可扩展的自动化方法。

Abstract: Reinforcement Learning (RL) with verifiable environments has emerged as a powerful approach for enhancing the reasoning capabilities of Large Language Models (LLMs). While prior research demonstrates that scaling environment quantity improves RL performance, existing manual or individual construction methods suffer from linear scaling limits, thereby hindering scalable reasoning generalization. This paper introduces RACES (\textbf{R}ecursive \textbf{A}utomated \textbf{C}omposition for \textbf{E}nvironment \textbf{S}caling), a framework that conceptualizes verifiable environments as composable building blocks that can be recursively assembled. The key insight is that when the codomain (output type) of one environment matches the domain (input type) of another, they can be automatically fused into a new verifiable environment, enabling recursive composition. RACES is implemented with 300 individual environments and defines a set of composition operators (\textsc{SEQUENTIAL}, \textsc{PARALLEL}, \textsc{SORT}, and \textsc{SELECT}) that induce diverse reasoning patterns. Extensive experiments show that RL training on these composite environments consistently enhances reasoning generalization. Specifically, RACES improves DeepSeek-R1-Distill-Qwen-14B by an average of 3.1 points (from 48.2 to 51.3) and boosts Qwen3-14B performance from 58.8 to 61.1 on six benchmarks, which are unseen during the construction of training environments. Moreover, RACES achieves performance comparable to training on 300 individual environments using only 50 base environments, demonstrating significant efficiency in environment utilization.

[35] Doc-to-Atom: Learning to Compile and Compose Memory Atoms cs.CL | cs.IRPDF

Xingjian Diao, Wenbo Li, Yashas Malur Saidutta, Avinash Amballa, Lazar Valkov

TL;DR: 本文提出Doc-to-Atom（Doc2Atom）框架，用于解决大语言模型处理长文档时注意力机制带来的高计算和内存开销问题。该方法将文档分解为语义化的知识原子，每个原子编译成一个独立的微LoRA适配器和检索键；推理时，通过轻量级查询路由器选择并组装相关原子，形成查询特定的适配器注入冻结的基础模型，从而提升效率与准确性。

Details

Motivation: 动机在于解决长序列输入（如文档理解）中注意力机制的二次计算成本导致推理缓慢和内存密集的问题，同时克服现有上下文蒸馏方法（如Doc-to-LoRA）因生成单一整体适配器而带来的无关查询干扰、组合召回能力有限以及长文档推理可扩展性差等挑战。

Result: 在六个不同的问答基准测试上的实验表明，Doc2Atom在减少文档内化内存成本的同时，性能优于Doc-to-LoRA基线方法。

Insight: 创新点包括：将文档分解为可组合的语义知识原子（微LoRA适配器），通过端到端多目标蒸馏框架训练，并引入轻量级查询路由器动态组装相关原子，这提高了推理的灵活性和效率，减少了无关信息干扰，增强了长文档的可扩展性。

Abstract: Long input sequences are central to document understanding and multi-step reasoning in Large Language Models, yet the quadratic cost of attention makes inference both memory-intensive and slow. Context distillation mitigates this by compressing contextual information into model parameters, and recent work such as Doc-to-LoRA amortizes context distillation into a single forward pass that generates one LoRA adapter per document. However, producing a single monolithic adapter for all queries leads to irrelevant-query interference, limited compositional recall, and poor scalability to long-document reasoning. To address these challenges, we propose Doc-to-Atom (Doc2Atom), a compositional parametric memory framework that decomposes each document into semantically typed knowledge atoms. Each atom is compiled into an independent micro-LoRA adapter and a provenance retrieval key. At inference time, a lightweight query router selects and assembles only the relevant atoms into a query-specific adapter, which is then injected into a frozen base model. The entire system is trained end-to-end through a multi-objective distillation framework. Experiments on six diverse QA benchmarks demonstrate that Doc2Atom outperforms Doc-to-LoRA baselines while reducing the memory cost of document internalization.

[36] Context-Driven Incremental Compression for Multi-Turn Dialogue Generation cs.CL | cs.LGPDF

Yeongseo Jung, Jaehyeok Kim, Eunseo Jung, Jiachuan Wang, Yongqi Zhang

TL;DR: 本文提出了一种面向多轮对话生成的上下文驱动增量压缩方法（C-DIC），旨在解决长对话历史带来的冗余计算和编码成本问题。该方法将对话视为交织的上下文线程，在紧凑的对话记忆中存储可修订的每线程压缩状态，并通过轻量级的检索、修订和写回循环实现跨轮次信息共享与更新，从而在保证对话质量的同时显著提升效率。

Details

Motivation: 现代对话系统在每一轮对话中都需要处理不断增长的对话历史，导致注意力机制和编码成本随对话长度增加而冗余上升。简单的截断或摘要方法会降低保真度，而现有的上下文压缩方法缺乏跨轮次的记忆共享或修订能力，导致长对话中的信息丢失和误差累积。

Result: 在长形式对话基准测试上的广泛实验表明，C-DIC在性能和效率上均表现优异；特别地，C-DIC在数百轮对话中展现出稳定的推理延迟和困惑度，为高质量对话建模提供了可扩展的路径。

Insight: 论文的创新点在于将对话视为交织的上下文线程，并引入可修订的每线程压缩状态记忆机制，通过轻量级的检索-修订-写回循环实现跨轮次信息共享与更新，从而提升长对话的鲁棒性和效率。此外，作者将截断的通过时间反向传播（TBPTT）适配到多轮设置中，实现了无需完整历史反向传播的跨轮次依赖学习。

Abstract: Modern conversational agents condition on an ever-growing dialogue history at each turn, incurring redundant attention and encoding costs that grow with conversation length. Naive truncation or summarization degrades fidelity, while existing context compressors lack cross-turn memory sharing or revision, causing information loss and compounding errors in long dialogues. We revisit the context compression under conversational dynamics and empirically present its fragility. To improve both efficiency and robustness, we introduce Context-Driven Incremental Compression (C-DIC), which treats a conversation as interleaved contextual threads and stores revisable per-thread compression states in a single, compact dialogue memory. At each turn, a lightweight retrieve, revise, and write-back loop shares information across turns and updates stale memories, stabilizing long-horizon behavior. In addition, we adapt truncated backpropagation-through-time (TBPTT) to our multi-turn setting, learning cross-turn dependencies without full-history backpropagation. Extensive experiments on long-form dialogue benchmarks demonstrate superior performance and efficiency of C-DIC; notably, C-DIC shows stable inference latency and perplexity over hundreds of dialogue turns, supporting a scalable path to high-quality dialogue modeling.

cs.CV [Back]

[37] LAST: Bridging Vision-Language and Action Manifolds via Gromov-Wasserstein Alignment cs.CVPDF

Huaihai Lyu, Chaofan Chen, Yuheng Ji, Xiansheng Chen, Pengwei Wang

TL;DR: 本文提出LAST方法，通过Gromov-Wasserstein视角解决视觉-语言-动作学习中的几何对齐问题。该方法利用李代数映射线性化动作流形，并通过分层离散化建立与视觉-语言语义度量的局部兼容性，从而提升VLA模型的收敛性和泛化能力。

Details

Motivation: 解决视觉-语言嵌入的语义几何与机器人动作表示的关系几何之间的不兼容问题，由于两者在数学上的异构性（视觉-语言空间是线性各向同性，而动作流形是非欧几里得且各向异性），导致直接回归方法不适定。

Result: 通过LAST方法，VLA模型在收敛性和泛化性方面表现出优越性能，但摘要未提及具体基准测试或定量结果。

Insight: 创新点在于采用两阶段变换（全局拓扑线性化和局部度量离散化）来重构动作空间，使其在局部度量上与视觉-语言模态兼容，从而解决结构不匹配问题；从客观角度看，该方法将Gromov-Wasserstein对齐与李代数理论结合，为跨模态学习提供了新的几何视角。

Abstract: We take a Gromov-Wasserstein perspective on Vision-Language-Action (VLA) learning, where the goal is to make the relational geometry of action representations compatible with the semantic geometry of VL embeddings. However, this alignment is non-trivial due to the mathematical heterogeneity between the domains: the semantic space of vision-language is topologically linear and isotropic, whereas the physical manifold of robotic action is non-Euclidean and anisotropic. Their disjoint metric structures render direct regression ill-posed. To resolve this incompatibility, we introduce LAST (Lie-algebraic Action Space Tokenizer), which reconstructs the action space to establish local metric compatibility with the VL modality via a two-stage transformation: (1) Global Topological Linearization: linearizing the action manifold via Lie-algebraic mapping, converting trajectories into a fixed-length, physically additive representation. (2) Local Metric Discretization: hierarchically discretizing the representation into schemas and whitened residuals, yielding approximately isotropic local charts that are statistically aligned with the semantic metric. By resolving the structural mismatch at both global and local levels, LAST enables VLA models with superior convergence and generalizability.

[38] CFCamo: A Counterfactual Detect-or-Abstain Framework for Camouflaged Object Detection cs.CVPDF

Suhang Li, Osamu Yoshie, Yuya Ieiri

TL;DR: 本文针对伪装目标检测任务中模型可能存在的过度检测偏差问题，提出了一个反事实检测-弃权框架CFCamo。该框架通过构建包含原始图像和移除伪装目标的反事实图像的成对数据集CF-COD来评估模型在目标存在时的检测能力和目标不存在时的弃权能力，并使用反事实序列策略优化和成对奖励来训练模型，实现了检测与弃权的耦合。

Details

Motivation: 标准伪装目标检测的训练和评估数据仅包含目标存在的正样本，导致优化后的模型在面对无伪装目标的普通图像时，可能产生过度检测偏差，即一种特定于任务的目标幻觉，而现有评估方法无法衡量这种行为。

Result: 在CAMO-test基准上，CFCamo将S_alpha指标比之前的基于强化学习的COD基线提升了3.7个百分点。在CF-COD基准上，其成对准确率达到了80.0%至90.8%。消融实验表明，移除反事实耦合后，尽管目标存在时的检测分数很高，但成对准确率会骤降至1.4%-5.2%。

Insight: 核心创新在于提出了一个反事实评估框架CF-COD来量化模型在目标不存在时的弃权行为，并设计了CFCamo训练框架，通过反事实序列策略优化和成对奖励，将目标存在时的检测与目标不存在时的弃权进行耦合优化，而不仅仅是增强目标定位能力。这为解决视觉任务中模型可能产生的幻觉或过度自信问题提供了一个新的思路。

Abstract: Vision-language reinforcement learning has recently shown strong target-present localization for camouflaged object detection (COD). Yet localization is only one side of the decision: when the agent faces an ordinary image with no camouflaged target, will it still claim that a camouflaged object exists? Standard COD training and evaluation data are positive-only, so agents optimized under this setting can acquire an over-detect bias, a task-specific form of object hallucination that standard COD evaluation leaves unmeasured. To quantify this target-absent behavior, we construct Counterfactual COD (CF-COD), a paired benchmark that removes the camouflaged target from each held-out COD evaluation image while preserving a plausible background. CF-COD evaluates whether a model detects the target on the original image and abstains on the target-absent counterfactual, summarized by Pair Accuracy (PA). We further introduce CFCamo, a paired counterfactual framework for COD with abstention. For training, CFCamo optimizes a Qwen3-VL-4B-Instruct agent with Counterfactual Sequence Policy Optimization (CSPO), which samples paired original-counterfactual rollouts and uses a Counterfactual Paired Reward (CPR) to couple original-image detection with counterfactual abstention. On CAMO-test, CFCamo improves S_alpha by +3.7 pp over the prior RL-based COD baseline; across CF-COD, it reaches 80.0-90.8% PA. Ablations show that removing counterfactual coupling reduces PA to 1.4-5.2% despite strong target-present COD scores, showing that target-present evaluation alone does not characterize detect-or-abstain behavior. Overall, these results indicate that CFCamo improves COD agents by coupling target-present detection with target-absent abstention, rather than merely strengthening target-present localization. Code and data are available at https://github.com/suhang2000/CFCamo.

[39] Traits Run Deeper: Trait-Specific Asymmetric Fusion for Personality Assessment cs.CV | cs.HCPDF

Jia Li, Qian Chen, Wei Wang, Xinyu Li, Zhenzhen Hu

TL;DR: 本文提出了一种名为Traits Run Deeper的人格评估框架，旨在从语言、语音和面部线索等多模态动态行为中推断稳定的人格特质。该框架通过三个核心组件解决现有方法的问题：MFR模块构建面向人格的多模态输入并利用心理学语义模板作为锚点；TSMF模块作为非对称融合机制，允许每个特质维度选择性地利用不同的模态通路；DCPR模块通过目标分布校准来缓解标签不平衡和中心趋势偏差。

Details

Motivation: 现有的人格评估方法通常对所有特质维度采用统一的多模态融合策略，假设各模态贡献相同，这忽视了特质特定的模态偏好并引入了跨模态干扰。本文旨在解决这一问题，实现对不同人格特质维度进行更精确、特异性的建模。

Result: 在AVI Challenge 2026验证集上，所提框架将均方误差（MSE）降低了约25%。在官方测试集上也观察到一致的改进，该方法取得了最佳性能，并在人格评估赛道中排名第一。

Insight: 主要创新点在于提出了特质特定的非对称融合机制（TSMF），允许每个特质维度自主选择模态融合路径，从而捕获异质的模态偏好并减少跨模态污染。此外，利用心理学知识构建语义模板作为锚点（MFR）以及通过分布校准来应对数据偏差（DCPR）也是值得借鉴的思路。

Abstract: Personality assessment aims to infer stable personality traits from dynamic behaviors across language, voice, and facial cues. Since different personality dimensions are revealed through distinct behavioral perspectives, modeling trait-specific evidence is challenging. However, most existing approaches adopt a uniform multimodal fusion strategy across all dimensions, assuming identical modality contributions. This overlooks trait-specific modality preferences and introduces cross-modal interference. To address this issue, we propose a novel personality assessment framework called Traits Run Deeper, which consists of three components. Specifically, the Multimodal Foundation Representation (MFR) module constructs personality-oriented multimodal inputs and leverages psychology-informed semantic templates as anchors, enabling foundation models to capture trait-relevant information. Building upon MFR, the Trait-Specific Modality Fusion (TSMF) module acts as an asymmetric fusion mechanism, allowing each dimension to selectively exploit different modality pathways from modality-specific modeling to complementary fusion. Thus, TSMF captures heterogeneous modality preferences while reducing cross-modal contamination. Furthermore, the Distribution-Calibrated Personality Regression (DCPR) module mitigates label imbalance and central tendency bias through target distribution calibration, improving robustness and stability. Experimental results on the AVI Challenge 2026 validation set demonstrate the effectiveness of the proposed framework, reducing mean squared error (MSE) by approximately 25% compared with the baseline. Consistent improvements are observed on the official test set, where our method achieves the best performance and ranks first in the Personality Assessment Track. The source code will be made available at https://github.com/MSA-LMC/AVI2026.

[40] DeceptionX: Explainable Deception Detection with Multimodal Large Language Models cs.CVPDF

Jiayu Zhang, Shuo Ye, Jiajian Huang, Yawen Cui, Taorui Wang

TL;DR: 本文提出了DeceptionX，一个基于多模态大语言模型（MLLM）的可解释欺骗检测框架。它将欺骗检测任务从黑盒分类范式转变为可观察、思考、总结的推理过程，并构建了高质量推理数据集DeceptChain来支持训练。实验表明，该方法在标准现实基准测试中超越了现有MLLM基线和最先进方法，同时提供了透明的专家级推理路径。

Details

Motivation: 现有深度学习欺骗检测方法缺乏可解释性，无法模拟人类专家识别谎言时复杂的逻辑推理过程。多模态大语言模型虽有潜力，但需要弥合低层次视听线索与高层次逻辑推理之间的鸿沟。

Result: 在标准现实基准测试上，DeceptionX超越了现有的MLLM基线和最先进（SOTA）方法，实现了更高的准确性。

Insight: 核心创新在于将欺骗检测范式从黑盒分类转变为可解释的“观察-思考-总结”推理过程，并构建了高质量、细粒度、结构化的思维链推理数据集（DeceptChain）。此外，提出的三阶段训练流程和差异感知冗余消除（DARE）策略增强了模型的泛化能力，在准确性和可解释性之间架起了桥梁。

Abstract: Deception detection is a critical and highly challenging task within affective computing and behavioral analysis. Existing deep learning methods typically treat this task as a straightforward classification problem; however, this black-box approach lacks interpretability and fails to capture the complex logical deduction processes utilized by human experts when identifying lies. While Multimodal Large Language Models (MLLMs) have shown potential, applying them effectively requires a bridge between low-level audiovisual cues and high-level logical reasoning. In this paper, we propose DeceptionX, a novel MLLM framework that shifts the paradigm of deception detection from black-box classification to an interpretable Observe-Think-Summarize reasoning process. To address the scarcity of high-quality reasoning data, we first constructed DeceptChain, a high-quality dataset developed through a human-in-the-loop process. This dataset synthesizes fine-grained visual and auditory evidence (such as micro-expressions and vocal tremors) into structured chain-of-thought reasoning data. Furthermore, we propose a three-stage training pipeline and a Discrepancy-Aware Redundancy Elimination~(DARE) strategy for DeceptionX to further enhance the model’s generalization capabilities. Extensive experiments demonstrate that DeceptionX not only outperforms existing MLLM baselines and state-of-the-art methods on standard real-world benchmarks but also provides transparent, expert-level reasoning paths, bridging the critical gap between accuracy and interpretability in multimodal deception detection.

[41] 3D-CBM: A Framework for Concept-Based Interpretability in Generative 3D Modeling cs.CV | cs.GRPDF

Ahmad Al-Kabbany

TL;DR: 本文提出了3D-CBM框架，将概念瓶颈模型（CBMs）引入3D生成架构，以解决深度几何学习中的‘语义鸿沟’问题。该框架将原始几何输入（如点云和网格）映射到可解释的基元和功能属性的多层次分类中，并通过实验验证了其在概念预测和几何重建方面的有效性。

Details

Motivation: 随着深度模型在3D内容创作中变得至关重要，在医疗和制造等安全关键领域，可解释性从边缘特性转变为信任和责任的基本要求。现有CBMs在非结构化3D数据中的应用尚未充分探索，因此需要开发一个框架来提供内在可解释性。

Result: 在3D部件操作的概念验证实验中，该框架实现了88.8%的概念预测准确率和0.0115的Chamfer距离，证明了其有效性。模型还支持精确的测试时干预，允许交互式修正结构错误。

Insight: 创新点在于将CBMs扩展到3D生成建模，通过约束潜在表示与人类定义概念对齐来实现内在可解释性，并建立了语义可引导的3D生成基础，为协作式人在回路设计系统开辟了新方向。

Abstract: This research introduces a framework for incorporating Concept Bottleneck Models (CBMs) into 3D generative architectures to address the inherent ‘semantic gap’ in deep geometric learning. As deep models become central to 3D content creation, explainability shifts from a peripheral feature to a fundamental requirement for trust and accountability in safety-critical domains such as healthcare and manufacturing. CBMs provide an intrinsic interpretability solution by constraining latent representations to align with human-defined concepts, yet their application to unstructured 3D data remains largely unexplored. We design, implement, and validate a formal 3D-CBM architecture that maps raw geometric inputs, including point clouds and meshes, into a multi-tiered taxonomy of interpretable primitives and functional attributes. The framework further identifies strategic datasets, such as PartNet and ShapeNet, specialized for concept-based supervision. Experimental results from a 3D part-manipulation proof-of-concept experiment demonstrate the framework’s efficacy, achieving a concept prediction accuracy of 88.8% and a Chamfer Distance of 0.0115. Critically, the model enables precise test-time intervention, allowing for the interactive correction of structural errors. This work establishes a foundation for semantically-steerable 3D generation and invites further exploration into collaborative human-in-the-loop design systems.

[42] Towards Fully Automated Exam Grading: Fairness-Aware Recognition of Handwritten Answers with Foundation Models cs.CV | cs.AIPDF

Hartwig Grabowski

TL;DR: 本文提出利用通用视觉-语言基础模型（VLMs）实现手写考试答案的自动化公平评分。该方法通过将答案记录为表格中的大写字母，结合VLM的页面理解能力而非像素模板匹配，显著提升了识别准确率。研究重点关注公平性，区分假阴性和假阳性错误，并通过轻量级提示降低假阴性率，证明了大规模自动化评分的可行性。

Details

Motivation: 手动批改手写试卷耗时且易错，而全数字化考试又限制了开放式问题形式。现有自动化方法识别准确率仅88%-91%，且对答案超出单元格、划掉或草写等情况处理不佳，无法满足无监督评分的公平性要求。

Result: 在包含61份匿名试卷（3141个答案位置）的基准测试中，最佳模型达到98.4%的准确率，远超先前基线。通过提供参考答案上下文的轻量级提示，假阴性率降至0.58%；在示例评分方案下，仅3份试卷可能被误评，且可通过学生自查步骤发现。

Insight: 创新点在于利用VLM的语义理解能力替代传统模板匹配，解决了手写答案的复杂变体识别问题；通过区分错误类型并引入上下文提示优化公平性，为自动化评分系统提供了可辩护的公平性保障。研究发布的匿名基准数据集支持可复现性。

Abstract: Correcting handwritten exams by hand is time-consuming and error-prone, particularly for large cohorts, while fully digital exams tend to force a didactic narrowing towards closed question formats. A practical middle ground keeps paper-based, problem-oriented tasks but records the assessment-relevant answers as single capital letters in a table that a machine can read. The open question is whether this reading can be made accurate and, above all, fair enough for unsupervised grading. Earlier automated approaches reached only about 88%–91% recognition – too low – and failed on the cases that matter most: answers placed outside the cell, crossed out, or written in cursive. We show that general-purpose vision-language foundation models (VLMs), which interpret the page rather than match pixel templates, close this gap. On a benchmark of 61 anonymised exams (3141 answer positions) the best model reaches 98.4% accuracy, well above the previous baseline. Crucially, we centre the evaluation on fairness: we distinguish false negatives (a correct answer marked wrong, which disadvantages the student) from false positives, and a lightweight prompt that supplies the reference solution as context lowers the false-negative rate to 0.58%. Under an exemplary grading scheme only three of the 61 exams would be graded worse, all caught by a student self-review step. Fully automated, fairness-aware exam grading at scale is therefore defensible; we release the anonymised benchmark to support reproducibility.

[43] SceneMiner: Identity-Preserving Multi-Task Fine-Tuning for Unified BEV Scene Mining cs.CVPDF

Abdalmalek Aburaddaha, Venkatraman Narayanan, Keval Thaker, Samir A. Rawashdeh

TL;DR: 本文提出SceneMiner，一个统一的、仅使用摄像头的鸟瞰图（BEV）流程，用于从驾驶日志中挖掘困难、安全关键场景。该方法通过一次前向传播，从一个冻结的视觉-语言骨干网络中生成互补的挖掘信号，包括用于文本提示场景搜索的检索嵌入、多标签场景标签分布以及基于物理的连续风险评分。核心贡献是提出了一种身份保持的多任务微调方法，解决了跨任务干扰问题，使模型在仅训练约10.2万个参数的情况下，保持各任务头的性能不变。

Details

Motivation: 从驾驶日志中挖掘困难、安全关键场景的瓶颈在于缺乏难度标签，且单一的代理指标（如碰撞风险、轨迹模糊性或语义稀有性）均不足以独立找到此类场景。

Result: 在20个场景标签上，标签头的mAP达到0.4614（micro-F1为0.5557）；嵌入头支持文本提示检索，并进行了定性验证。

Insight: 主要创新点是发现了跨任务干扰这一故障模式，并提出了身份保持的多任务微调方法，通过零初始化每个新子模块并冻结所有馈送到共享流的参数，在微调时保持其他任务头的权重完全不变，从而高效地构建多任务模型。

Abstract: Mining hard, safety-critical scenes from driving logs is bottlenecked by the absence of difficulty labels, and no single proxy, collision risk, trajectory ambiguity, or semantic rarity suffices to find such scenes on its own. We present SceneMiner, a unified, camera-only bird’s-eye-view pipeline that emits complementary mining signals from a frozen vision-language backbone in a single forward pass, with no LiDAR or radar: a retrieval embedding for text-prompted scenario search, a multi-label scene-tag distribution, and a continuous physics-based risk score (a motion forecast is a byproduct, not a contribution). Building such a multi-head model exposes our central finding, a failure mode we term cross-task interference: adding or upgrading one head shifts a shared activation stream and degrades weight-frozen sibling heads, so freezing parameters alone is insufficient. Our contribution, identity-preserving multi-task fine-tuning, removes this interference by zero-initializing every new sub-module and freezing every parameter that feeds the shared stream. The mining heads are thereby preserved bit-identically while training only ~102k parameters. The tagging head reaches mAP 0.4614 (micro-F1 0.5557) on 20 scene tags by pooling each scene into 32 visual tokens, and the embedding head supports text-prompted retrieval, validated qualitatively. Code is available at: https://anonymous.4open.science/r/sceneminer_anonymous-64E5

[44] VL-DINO: Leveraging CLIP Vision-Language Knowledge for Open-Vocabulary Object Detectio cs.CVPDF

Hao Zhang, Qinran Lin, Linqi Song, Yong Li

TL;DR: 本文提出VL-DINO，一种开放词汇目标检测器，通过更有效地利用CLIP的视觉-语言知识来增强DINO检测框架。它设计了三个模块：QPSC用于构建高质量正样本以促进异构数据混合训练和视觉-语言对齐；VSE用于将CLIP视觉知识蒸馏到骨干网络特征中；ORSA用于对齐物体区域特征与文本嵌入。在零样本设置下，该方法在LVIS基准上取得了SOTA性能。

Details

Motivation: 尽管CLIP等视觉-语言模型能为开放词汇目标检测提供丰富的语义先验，但如何将文本和视觉知识共同整合到检测架构中仍然具有挑战性。

Result: 在零样本设置下，VL-DINO-T和VL-DINO-L在LVIS基准上分别达到36.3和38.1 AP，持续优于先前先进方法，实现了SOTA性能。

Insight: 创新点在于通过三个模块系统性地整合CLIP的视觉和文本知识：QPSC模块通过构建额外正样本解决异构数据训练问题并增强对齐信号；VSE模块实现视觉知识蒸馏；ORSA模块实现物体区域与文本的语义对齐。这种分层融合策略有效提升了开放词汇检测能力。

Abstract: Vision-language models like CLIP can provide rich semantic priors for open-vocabulary object detection. However, jointly integrating both textual and visual knowledge into detection architectures remains challenging. In this paper, we propose VL-DINO, an open-vocabulary detector that enhances DINO through more effective exploitation of CLIP’s vision-language knowledge. Specifically, a Query-guided Positive Sample Construction (QPSC) module is first developed to construct additional high-quality positive samples, enabling the vanilla DINO framework to better accommodate mixed training across heterogeneous data sources while providing more vision-language alignment signals, thereby incorporating richer textual knowledge during training. A Visual Semantic Encoder (VSE) module is then introduced to distill CLIP visual knowledge into backbone-extracted features, producing fused features for subsequent encoder refinement. Based on the fused features, an Object-Region Semantic Alignment (ORSA) module extracts object-centric region features and aligns them with the corresponding textual embeddings, further incorporating textual cues. In the zero-shot setting, VL-DINO-T and VL-DINO-L achieve 36.3 and 38.1 AP on the LVIS benchmark, respectively, consistently outperforming prior advanced approaches. Extensive experiments demonstrate the effectiveness and competitive performance of the proposed design.

David Hall, Joshua Knights, Mark Cox, Peyman Moghadam

TL;DR: 本文介绍了WildCross基准测试，这是一个用于大规模自然环境中地点识别和度量深度估计的跨模态基准。该基准包含超过476K个序列RGB帧，带有半稠密深度和表面法线标注，并与精确的6DoF姿态及同步稠密激光雷达子图对齐。论文扩展了对基准结果的分析，特别关注度量深度估计实验。

Details

Motivation: 当前机器人感知模型（尤其是视觉基础模型）主要在结构化城市环境中训练，导致在野外机器人任务中感知能力存在缺陷。论文旨在通过WildCross基准揭示这些模型在自然复杂环境中的局限性。

Result: 通过WildCross基准测试，论文展示了现有模型在自然环境中地点识别和度量深度估计任务上的性能不足，提供了扩展的度量深度估计实验结果分析。

Insight: 创新点在于提出了一个专门针对自然环境的跨模态基准WildCross，整合了RGB、深度、表面法线、6DoF姿态和激光雷达数据，为评估和提升野外机器人感知能力提供了重要工具。从客观角度看，该基准填补了当前模型在非结构化环境评估上的空白，促进了跨模态感知研究。

Abstract: Natural environments present a complex challenge to robotics perception systems. Current models, particularly vision foundation models, are largely trained on structured, urban environments leading to weaknesses in their perception for field robotics tasks. We showcase the limitations of current models using our recently released WildCross benchmark, a new cross-modal benchmark for place recognition and metric depth estimation in large-scale natural environments. WildCross comprises over 476K sequential RGB frames with semi-dense depth and surface normal annotations, each aligned with accurate 6DoF pose and synchronized dense lidar submaps. In this work, we provide an expanded analysis of the benchmark results from the recent WildCross benchmark, with particular emphasis on expanded metric depth estimation experiments. Access to the code repository and dataset for this work can be found at https://csiro-robotics.github.io/WildCross.

[46] 4DP-QA: Scalable QA for 4D Perception in Vision Language Models cs.CVPDF

Seokju Cho, Abhishek Badki, Hang Su, Jindong Jiang, Ziyao Zeng

TL;DR: 本文提出了4DP-QA，一个专注于4D场景（3D空间+时间）感知理解的大规模视觉语言问答数据集生成流程。该方法通过一种新颖的’真实运动跟踪’技术来解耦相机和物体运动，并生成了包含40万个样本的训练集和一个2200个样本的基准测试集。在现有模型上使用该数据集训练，提升了其在外部基准上的性能。

Details

Motivation: 当前视觉语言模型在理解世界动态方面存在不足，主要挑战在于模型只能通过2D图像投影间接观察运动，且现有数据集未能有效分离相机运动和物体运动。

Result: 使用生成的4DP-QA数据集训练现有模型，在外部基准测试上取得了性能提升，验证了方法的有效性。

Insight: 核心创新在于提出了’真实运动跟踪’这一新颖的参考系统，为运动提供了更直观的描述，并构建了一个专门针对解耦相机与物体运动的、可扩展的4D感知问答数据集生成流程。

Abstract: Despite recent advances, Vision Language Models (VLMs) still struggle to grasp the dynamics of the world. We note that the ability to reason about a 4D scene, challenging in itself, is further complicated by two factors. First, VLMs observe motion indirectly via its projection onto 2D images. Second, existing datasets fail to disentangle object and camera motion. To address these challenges, we present a QA generation pipeline that focuses on motion-related scene understanding. We take particular care of the entanglement of camera and object motion by casting tracking in both the traditional way and in a novel, fixed reference system, dubbed True-Motion Tracking, which provides an intuitive description of motion. From this pipeline, we generate a large-scale training dataset of 400K samples, 4DP-QA (4D Perception QA), and a 2.2K-sample benchmark, 4DP-QA-Bench. Training existing models on our dataset yields performance improvements on an external benchmark, validating the effectiveness of our method.

Keval Thaker, Venkatraman Narayanan, Abdalmalek Aburaddaha, Samir A. Rawashdeh

TL;DR: 本文提出了一种名为FreqKD的频率解耦跨模态知识蒸馏方法，用于提升红外目标检测性能。该方法通过分析RGB与红外图像模态差异的频谱结构，发现低频成分（如形状、布局）的跨模态对齐性优于高频成分（如纹理、细边缘）。因此，FreqKD采用非对称监督策略，对低频带使用严格的均方误差损失以保留共享结构信息，对高频带使用宽松的对数均方误差损失以提供边缘指导同时容忍纹理差异。

Details

Motivation: 由于RGB与红外图像在成像物理上存在根本差异，将大规模RGB基础模型的知识通过蒸馏迁移到红外图像领域面临挑战。本文旨在通过分析模态差异的频谱结构，设计更有效的跨模态知识蒸馏方法。

Result: 在KAIST多光谱行人检测数据集上，FreqKD达到了64.1 mAP50，比DINOv2基线提升了2.4个点。该方法学到的表征具有良好的泛化能力，在FLIR ADAS数据集上提升2.1 mAP50，在MFNet分割任务上提升1.85 mIoU，并且适用于ResNet-50等其他架构。

Insight: 核心创新点在于从空间频率角度解耦并量化了RGB-IR模态差异，并据此设计了频率自适应的非对称蒸馏损失。这为跨模态知识迁移提供了一种新的分析视角和解决方案，即根据特征成分的跨模态一致性差异进行差异化监督。

Abstract: Transfer learning from large-scale RGB foundation models to infrared (IR) imagery through knowledge distillation (KD) remains challenging due to fundamental differences in image formation physics. We investigate the spectral structure of the RGB–IR modality gap and observe that feature divergence is not uniform across spatial frequencies: low-frequency components (shape, layout) show greater cross-modal alignment than high-frequency components (texture, fine edges), which reflect modality-specific characteristics. Based on this analysis, we propose FreqKD, a frequency-decoupled distillation framework that applies asymmetric supervision adapted to each band’s cross-modal consistency. The method employs strict mean squared error (MSE) on the low-frequency band to preserve shared structural information and a relaxed log-MSE loss (weighted at 0.1) on the high-frequency band to provide edge guidance while tolerating texture differences. Spectral divergence analysis on 500 paired samples shows that high-frequency divergence exceeds low-frequency divergence by a factor of 2.4x on average across all analysed transformer layers. On KAIST multispectral pedestrian detection, FreqKD achieves 64.1 mAP50, improving 2.4 points over the DINOv2 baseline. The learned representation transfers across datasets (FLIR ADAS, +2.1 mAP50), tasks (MFNet segmentation, +1.85 mean intersection-over-union), and architectures (ResNet-50, +1.0 mAP50). Code is available at: https://anonymous.4open.science/r/freq_decoupled_kd-5E5A

[48] AVIS: Adaptive Test-Time Scaling for Vision-Language Models cs.CV | cs.AIPDF

Ahmadreza Jeddi, Minh Ngoc Le, Amirhossein Kazerouni, Hakki Can Karaimer, Hue Nguyen

TL;DR: 本文提出AVIS（自适应视觉推理缩放），一种轻量级策略，用于在视觉语言模型（VLM）推理时联合优化视觉上下文缩放（VCS）和视觉推理缩放（VRS）。AVIS通过基于关键多样性的视觉剪枝（KDV）实现VCS以去除冗余视觉令牌，并通过自适应自一致性实现VRS以动态选择推理路径数量。该方法在多种图像和视频推理基准上提升了精度-计算权衡，且部署友好，可与共享预填充推理兼容。

Details

Motivation: 现有视觉语言模型在利用思维链提示和测试时缩放时，常因巨大的视觉上下文和长解码链导致推理成本过高。现有方法通常单独优化视觉上下文或推理搜索，而联合优化这两个计算轴的研究不足。

Result: 在多样化的图像和视频推理基准测试中，AVIS相比仅优化VCS或VRS的基线方法，在精度-计算权衡上表现更优，且在强化学习后训练的VLM上依然有效，同时保持低计算和延迟。

Insight: 创新点在于将视觉推理成本分解为VCS和VRS两个耦合轴，并首次提出联合自适应优化策略。具体技术包括训练无关的O(N)关键多样性视觉剪枝（KDV）用于VCS，以及基于学习难度预测器的自适应自一致性用于VRS，实现了部署友好的高效推理。

Abstract: Modern Vision-Language Models (VLMs) benefit from chain-of-thought prompting and test-time scaling, but these gains often come with prohibitive inference cost due to large visual contexts and long decoding chains. We view this cost through two coupled axes: Visual Context Scaling (VCS), which controls how much visual evidence is passed to the language model, and Visual Reasoning Scaling (VRS), which controls how much inference-time reasoning search is performed. Existing methods typically optimize one axis at a time, leaving the joint allocation of compute across these axes underexplored. We introduce Adaptive Visual Inference Scaling (AVIS), a lightweight policy that adapts both VCS and VRS per query. AVIS realizes VCS through Key Diversity Visual (KDV) pruning, a training-free $O(N)$ key-based rule for removing redundant visual tokens before prefilling, and realizes VRS through adaptive self-consistency, using a learned difficulty predictor to select the number of reasoning rollouts. AVIS is deployment-friendly and compatible with shared-prefill inference, where all rollouts reuse a single prefilling pass and KV cache. Across diverse image and video reasoning benchmarks, AVIS improves the accuracy–compute trade-off relative to VCS-only and VRS-only baselines, and remains effective on top of RL post-trained VLMs while keeping compute and latency low.

[49] Spatially Coupled Phase-to-Depth Calibration for Fringe Projection Profilometry cs.CVPDF

Sehoon Tak, Jae-Sang Hyun

TL;DR: 本文提出了一种空间耦合的相位-深度标定方法，用于条纹投影轮廓术（FPP）。该方法通过共享一个低维映射（全局相位标量与无畸变参考相机网格上的仿射空间项相结合）来替代传统的逐像素独立标定，从而减少空间不一致性和表面伪影。此外，引入了一种原生网格配对方案，直接在参考相机网格上构建相位-深度标定对，避免了相位图的重采样。

Details

Motivation: 在传统FPP中，逐像素独立标定相位-深度关系虽然局部精度高，但相邻像素可能获得显著不同的标定函数，导致空间几何不一致和结构化表面伪影。本文旨在解决这一问题，提高标定的空间一致性。

Result: 在具有高分辨率扫描仪真值的牙科目标上，所提模型的点对表面RMSE与主动立体参考方法相当（约12μm），同时在空间一致性上显著优于逐像素多项式或有理标定方法，且运行时映射仅需每个像素几次逐元素操作，参数存储可忽略。

Insight: 创新点在于提出空间耦合的相位-深度变换，通过共享低维映射和仿射空间项来增强全局一致性，并引入原生网格配对方案以避免重采样误差。这为FPP标定提供了更高效、一致且存储友好的解决方案。

Abstract: In fringe projection profilometry (FPP), depth is commonly recovered by fitting a phase-to-depth relation independently at each camera pixel. Although such pixel-wise calibration achieves high local accuracy, neighboring pixels can acquire markedly different calibration functions even when they observe the same smooth surface, producing spatially inconsistent geometry and structured surface artifacts. We propose a spatially coupled phase-depth transformation in which all pixels share a single low-dimensional mapping-global phase scalars combined with affine spatial terms on the undistorted reference-camera grid-rather than independent per-pixel fits, optionally augmented by a bounded, spatially smooth correction field. We further introduce a native-grid pairing scheme that constructs phase-depth calibration pairs directly on the reference-camera grid: when depth supervision comes from a rectified active-stereo pipeline, planes are fitted in stereo 3D and sampled back onto the camera grid along native rays, so the phase maps are never rectified. On a dental target with high-resolution scanner ground truth, the proposed model attains point-to-surface RMSE comparable to an active-stereo reference (about 12μm aggregate) while substantially improving spatial coherence over pixel-wise polynomial and rational calibration, and reduces the runtime mapping to a few element-wise operations per pixel with negligible parameter storage.

[50] Frozen Foundation-Model Embeddings Discard Small-Lesion Signal in Chest Radiography: Implications for Pre-Deployment Evaluation cs.CVPDF

Raajitha Muthyala, Zhenan Yin, Alekhya Jilla, Frank Li, Theo Dapamede

TL;DR: 该论文系统评估了五种冻结视觉Transformer基础模型嵌入在胸部X光影像下游任务中保留或丢失小尺度、低对比度信号的能力。研究发现，全局聚合的分类令牌嵌入几乎无法检测小病灶信号，而基于感兴趣区域的局部补丁令牌嵌入能有效恢复这些信号，揭示了当前预部署评估方法的潜在缺陷。

Details

Motivation: 动机在于量化冻结视觉Transformer基础模型嵌入在胸部X光影像分析中，对于小尺度、低对比度病灶信号的保留或丢失情况，以评估其在临床部署前的可靠性。

Result: 在三个大型CXR队列和ChestX-Det10数据集上的实验表明，分类令牌嵌入的AUC接近随机水平（0.500-0.524），而局部补丁嵌入能显著提升性能（AUC提升+0.412至+0.488，在ChestX-Det10上达到≥0.899），揭示了全局聚合步骤会抑制小病灶信号。

Insight: 创新点在于系统揭示了冻结基础模型嵌入在全局聚合时无声丢弃小病灶信号的问题，并证明通过区域感知的局部补丁令牌嵌入可有效恢复信号，这对预部署模型评估具有重要启示。

Abstract: Frozen vision-transformer (ViT) foundation-model embeddings increasingly serve as the substrate for downstream chest-radiography (CXR) pipelines, yet where small-scale, low-contrast signal is retained or lost in the frozen forward pass has not been systematically quantified across architectures, pretraining domains, and objectives. We probed five frozen ViTs (RAD-DINO, DINOv2-B/14, DINOv3 ViT-7B, BiomedCLIP, MedSigLIP) and a frozen DINO-pretrained ResNet-50 architectural control across three large CXR cohorts (NIH-CXR14, MIMIC-CXR, Emory-CXR; aggregate pool n=492,724) and ChestX-Det10 (n=3,543; 1,462 small-lesion bounding boxes across Calcification, Nodule, Mass). Each model was evaluated with a small-scale-perturbation panel and a region-aware bounding-box-stratified probe on real lesions, comparing three pooling modes from the same forward pass: classification token (CLS), patch-mean (mean over all final-layer patch tokens), and bounding-box-restricted patch-local. On the perturbation panel, CLS embeddings sat at the chance floor (area under the ROC curve [AUC] 0.500-0.524); patch-mean was indistinguishable from CLS on iso-blur and reticular-fine cells but rose with CLS on larger directional-blur footprints, while disease AUC on globally decided tasks ranged 0.642-0.913. Patch-local probes recovered AUC ~1.0 from the same forward pass (per-model mean improvement +0.412 to +0.488); the ResNet-50 control reproduced the chance floor. On ChestX-Det10, image-level CLS classification showed within-class small-versus-large stratum gaps up to +0.243 AUC; bounding-box-level patch-local pooling on the same forward pass recovered AUC >= 0.899 on every (model x class) cell. Frozen ViT embeddings silently suppress small-scale signal at the global-aggregation step; the signal is recoverable from patch tokens conditional on a region of interest.

[51] Understanding Cross-Sensor Feature Variations for Generalizable 3D Perception cs.CVPDF

Xin Qiu, Wenjie Liu, Fuyuan Ai, YuChen Tan, Zhiwei Xu

TL;DR: 本文提出了一种通过建模源域变化来提升雷达-相机BEV感知跨数据集泛化能力的方法。该方法在频域中表征视觉场景变化并合成多样化的源域视图，通过对比融合BEV表征来捕捉图像级变化对多模态特征的影响，并利用这些变化模式正则化检测器。

Details

Motivation: 解决雷达-相机BEV感知在跨数据集评估时性能下降的问题，因为驾驶场景、传感器配置和环境条件的变化会改变输入观测和内部融合表征。

Result: 在View-of-Delft和TJ4DRadSet的跨数据集雷达-相机3D检测实验中，该方法在多个BEV融合骨干网络上取得了一致的性能提升，并且在有少量目标域数据可用时增益依然有效。

Insight: 创新点在于从源域变化建模的角度提升泛化性，无需依赖目标域样本；通过频域分析和合成视图来表征并利用场景变化，以正则化方式稳定融合空间，这是一种新颖的域泛化思路。

Abstract: Radar-camera BEV perception often suffers from degraded performance when evaluated across datasets, as changes in driving scenes, sensor configurations, and environmental conditions can alter both the input observations and the internal fused representations. This work studies this issue from the perspective of source-domain variation modeling, aiming to improve the robustness of BEV-based 3D detectors without relying on target-domain samples. We introduce a framework that characterizes visual scene variations in the frequency domain and uses them to synthesize diverse source-domain views. By comparing the resulting fused BEV representations, the framework further captures how image-level variations influence multi-modal BEV features. These variation patterns are then used to regularize the detector, encouraging the learned fusion space to remain stable under latent scene changes. The proposed method is applied only during training and leaves the inference pipeline unchanged. Experiments on cross-dataset radar-camera 3D detection between View-of-Delft and TJ4DRadSet demonstrate consistent improvements over multiple BEV fusion backbones, and the gains remain effective when a small amount of target-domain data is available.

[52] Precision-Aware Illumination-Disentangled Vision Transformer for Spacecraft 6D Pose Estimation cs.CVPDF

Zongwu Xie, Yifan Yang, Yonglong Zhang, Guanghu Xie, Yang Liu

TL;DR: 本文提出了一种名为PAID-ViT的Vision Transformer模型，用于解决单目航天器6D位姿估计在光照变化、镜面反射、阴影、弱纹理和背景干扰下的难题。该模型通过分离与位姿相关的结构特征和对光照敏感的外观特征、估计图像块可靠性、以及利用前景掩码监督来提升鲁棒性。

Details

Motivation: 单目视觉传感器在航天器近距离操作中应用广泛，但光照变化、镜面反射等因素会导致局部视觉证据不可靠，从而影响位姿回归的稳定性。

Result: 在SPEED+ V2数据集（包括验证集、lightbox和sunlamp评估配置）上的实验表明，PAID-ViT在具有挑战性的sunlamp场景中降低了平移误差并提升了鲁棒性。消融实验验证了光照解耦、可靠性感知的token聚合、掩码监督和训练正则化的互补作用。

Insight: 创新点在于将视觉特征明确解耦为与位姿相关的结构特征和对光照敏感的外观特征，并结合了可靠性感知的token聚合机制与前景掩码监督，以增强模型在恶劣光照条件下的鲁棒性。此外，采用无参数的几何恢复模块将归一化坐标、对数深度和连续6D旋转表示转换为最终的相机坐标系位姿。

Abstract: Vision sensors provide a lightweight solution for spacecraft proximity operations, but monocular spacecraft 6D pose estimation remains difficult under illumination variation, specular reflection, shadowing, weak texture, and background interference. These factors make local visual evidence spatially unreliable and can destabilize pose regression. This article proposes a Precision-Aware Illumination-Disentangled Vision Transformer (PAID-ViT) for robust spacecraft pose estimation.The proposed model separates pose-relevant structure tokens from illumination-sensitive appearance tokens, estimates patch reliability before pose aggregation, and uses foreground mask supervision to preserve silhouette cues. A parameter-free geometric recovery module converts normalized crop coordinates, log-depth, and a continuous 6D rotation representation into camera-frame rotation and translation. Experiments on SPEED+ V2, the SPEED+ validation/lightbox/sunlamp evaluation configuration used in this study, suggest that PAID-ViT reduces translation error and improves robustness in the challenging sunlamp domain, while ablation studies support the complementary roles of illumination disentanglement, reliability-aware token aggregation, mask supervision, and training-side regularization.

[53] Adapting Vision-Language Models from Iconic to Inclusive for Multi-Label Recognition Without Labels cs.CVPDF

Cheng Chen, Jingyu Zhou, Yifan Zhao, Jia Li

TL;DR: 本文提出了一种无监督框架，通过‘裁剪’和‘缝合’两个关键阶段，将视觉语言模型从专注于最具标志性物体的‘标志性识别’适应为更全面的‘包容性理解’，从而实现无需标注数据的多标签图像识别。

Details

Motivation: 现有视觉语言模型在零样本识别中往往因内在设计偏向于识别图像中最具标志性的单个物体，而忽略其他上下文相关的正例，这与多标签学习需要识别多个标签的本质相冲突，限制了其应用。

Result: 在四个公共数据集上的大量实验表明，该框架显著优于现有的无监督方法，甚至超过了一些代表性的弱监督基线方法。

Insight: 创新点在于通过多采样响应估计器防止模型仅关注单一对象，以及通过多对象混合适应在仅一个训练周期内调整标签以更好地符合多标签分布，同时保留原始模型的内在特性，展示了无需人工标注即可使预训练VLM适应更全面视觉理解的潜力。

Abstract: Understanding multi-label images remains a challenging task in computer vision. With the rapid progress of vision-language multimodal learning, vision-language models (VLMs) enable zero-shot recognition without labeled data. However, due to their intrinsic design, these models often prioritize the most iconic object and omit other contextual positives. This intrinsic bias conflicts with the nature of multi-label learning, thereby limiting their applicability. In this work, we propose an unsupervised framework that adapts VLMs from iconic recognition toward inclusive understanding, enabling label-free multi-label image recognition. Our approach consists of two key stages, cutting'' and sewing’’: In the cutting stage, we present the multi-sampling response estimator to prevent the model from concentrating only on one single object. In the second sewing stage, the multi-object blend adaptation is introduced to adjust the labels to better conform to the multi-label distribution while preserving the intrinsic characteristics of the original model within only one epoch. Extensive experiments show that our framework significantly outperforms existing unsupervised approaches on four public datasets, even surpassing several representative weakly supervised baselines. These results demonstrate the potential of adapting pre-trained VLMs for more comprehensive visual understanding without manual annotations. Our code is publicly available at https://github.com/iCVTEAM/TailorCLIP.

[54] Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition cs.CVPDF

Jialin Liu, Xinwen He, Pengyu Liu, Jiale Shi, Huaijuan Zang

TL;DR: 本文提出DyFADet+模型，用于微手势在线识别任务。该模型将RGB视频流和骨骼流投影到共享的多尺度时间嵌入中，并通过门控残差模块自适应融合，最后通过动态TAD头进行在线分类和边界回归。在SMG数据集上取得了40.88的F1分数，在微手势在线识别赛道中排名第二。

Details

Motivation: 微手势在线识别需要从未修剪视频中定位和分类每个手势实例，而微手势具有高度自发性，仅依赖单一模态难以捕捉完整准确的多模态线索。

Result: 在SMG数据集上，该方法F1分数达到40.88，在微手势在线识别赛道中排名第二。

Insight: 创新点在于将DyFADet扩展为双流RGB-骨骼框架，并通过门控残差模块自适应地将骨骼运动信息注入RGB表示，而非简单拼接，实现了更有效的多模态融合。

Abstract: Micro-gesture analysis attracts increasing attention for inferring spontaneous emotion from subtle body movements. Micro-gesture online recognition, which localizes and classifies each gesture instance in untrimmed videos, is a core task in the 4th EI-MiGA-IJCAI Challenge. Compared with typical temporal action detection, MGR emphasizes the localization and classification of actions, requiring the model to output the start time, end time, and category of each micro-gesture. Moreover, since micro-gestures are highly spontaneous, relying solely on a single modality makes it difficult to capture the complete and accurate multi-modal cues. In this work, we propose DyFADet+, which extends DyFADet into a dual-stream RGB-skeleton framework. In our model, both modalities are projected into shared multi-scale temporal embeddings and fused through a gated residual module, which adaptively injects skeleton motion into the RGB representation rather than using naive concatenation. Finally, these fused features are decoded by a Dynamic TAD head for online classification and boundary regression. On the SMG dataset, our method achieves an F1 score of 40.88, ranking 2nd in the Micro-gesture Online Recognition track.

[55] Learning Instance-Adaptive Low-Rank Orthogonal Subspaces for Clothes-Changing Person Re-Identification cs.CV | cs.LGPDF

Dong-Woo Kim, Tae-Kyun Kim

TL;DR: 本文提出了一种名为Ortho-ReID的新方法，用于解决换装行人重识别（CC-ReID）问题，该方法通过显式建模一个低秩的服装子空间，并利用几何正交约束来提取与服装无关的身份特征。核心创新在于一个基于Transformer的Basis Maker模块，它能将共享的低维服装先验细化为实例自适应的低秩子空间，并通过与视觉语言模型（VLM）的文本描述对齐进行监督。

Details

Motivation: 现有方法通常依赖对抗学习来解耦服装特征，但效果有限。本文旨在通过显式的几何约束和低秩正交子空间建模，更直接、鲁棒地提取换装场景下不受服装变化影响的身份表示。

Result: 在多个标准CC-ReID基准测试上取得了最先进的性能：在PRCC数据集上top-1准确率提升5.9%，在Celeb-reID-light上提升3.5%，在LaST上提升5.3%，在LTCC上也取得了有竞争力的结果。

Insight: 主要创新点在于：1）利用VLM文本描述显式构建低秩服装子空间作为监督信号；2）提出实例自适应的低秩正交子空间建模方法（Basis Maker），能适应不同可见度条件；3）通过严格的几何正交约束直接分离身份与服装特征，而非依赖对抗学习。

Abstract: Clothes-changing person re-identification (CC-ReID) aims to recognize individuals despite drastic appearance changes caused by clothing variation. While existing methods rely on adversarial learning to disentangle clothing features, we propose Ortho-ReID, which explicitly models a low-rank clothing subspace from VLM text descriptions and extracts clothing-invariant representations via direct geometric constraints. A critical component is our transformer-based Basis Maker, which refines a shared, low-dimensional clothing prior into an instance-adaptive low-rank subspace through cross-attention with image patches, enabling robust clothing feature extraction even under varying visibility conditions. This instance-adaptive subspace is supervised via alignment with clothing text embeddings, while identity features are extracted via a learnable projection head and geometrically constrained to be strictly orthogonal to it. Extensive experiments demonstrate state-of-the-art performance on PRCC (+5.9% top-1), Celeb-reID-light (+3.5%), and LaST (+5.3%), with competitive results on LTCC.

[56] ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation cs.CV | cs.AIPDF

Zijie Meng, Jiwen Liu, Yufei Liu, Chengzhuo Tong, Xiaoqiang Liu

TL;DR: 本文提出了ARGUS框架，用于解决主体保持视频生成中的身份一致性难题。该框架的核心是堆叠多视角身份马赛克注入技术，将多模态大模型选取的身份证据转换为动态分布，并结合无配对反事实训练等方法，在无需成对主体视频监督的情况下提升鲁棒性。

Details

Motivation: 现有方法仅依赖正面人脸相似性无法保证主体在运动、大视角变化、遮挡等复杂场景下的可识别性，其根本瓶颈在于将身份信息压缩为单点静态参考，导致其与姿态、光照等无关因素纠缠。

Result: 在OpenS2V-Eval Human-Domain基准测试中达到SOTA，总分为64.38，并在新提出的HardID-Celeb基准上，FaceSim达到76.80，YawScore和OccScore分别比最强基线提升12.60和15.10分。

Insight: 核心创新在于将身份从外部适配器或单张参考图转变为紧凑的动态分布（SMII），并通过大规模无配对反事实自监督学习来增强鲁棒性，这为解决多条件冲突和复杂场景下的身份保持提供了新思路。

Abstract: Subject-preserving video generation is not solved by frontal-face similarity alone: a generated person must remain recognizable across motion, large viewpoint changes, expression shifts, occlusion, scale variation, and conflicts among text, first-frame, and identity references. We argue that the central bottleneck is the point-reference paradigm, which collapses identity into a single static observation entangled with pose, accessories, lighting, background, and camera statistics. We introduce Argus, a Wan-based framework centered on Stacked Multi-View Identity Mosaic Injection (SMII). SMII converts MLLM-selected image/video identity evidence into a 3*3 stacked mosaic, synchronizes the mosaic with the current diffusion time, and injects it as negative-time read-only memory in Wan’s native token space. This turns identity from an external clean adapter or a single reference image into a compact dynamic distribution. Around SMII, an MLLM Identity Director selects informative identity moments and resolves condition conflicts, while no-cross-pair counterfactual training, Temporal Identity Annealing, and Adaptive Self-Likeness Guidance improve robustness without paired subject-video supervision. We further release HardID-Celeb, a public-figure identity-stress benchmark, and introduce YawScore and OccScore to probe large-yaw and first-frame-occlusion robustness. Argus achieves state-of-the-art results on OpenS2V-Eval Human-Domain, reaching 64.38 Total Score, 71.86 FaceSim, 51.62 NexusScore, and 79.14 NaturalScore. On HardID-Celeb, Argus obtains 76.80 FaceSim and improves YawScore and OccScore by 12.60 and 15.10 points over the strongest baselines, demonstrating that dynamic identity memory and large-scale counterfactual self-supervision are highly effective for subject-preserving video generation.

[57] Parameter-Efficient Adapter Tuning for Tabular-Image Multimodal Learning cs.CV | cs.LGPDF

Jiaqi Luo

TL;DR: 本文提出了一种名为TI-Adapter的参数高效适配器调优框架，用于表格-图像多模态学习。该方法通过冻结预训练的表格编码器，并在其嵌入层后学习一个适配器，同时为图像分支使用嵌入层和瓶颈层适配器，而非完全微调。在20个数据集上的实验表明，该方法在显著减少可训练参数的同时，取得了与完全微调相当或更优的预测性能。

Details

Motivation: 旨在解决表格-图像多模态学习中，完全微调预训练编码器计算成本高昂，而冻结编码器又可能限制任务特定适应性的问题。

Result: 在20个表格-图像数据集上的实验表明，TI-Adapter在预测性能上达到或超越了完全微调，同时使用了显著更少的可训练参数。消融研究进一步证明了适配器放置位置对于平衡性能和实际效率的重要性。

Insight: 创新点在于为表格和图像模态分别设计了参数高效的适配器调优策略，特别是为图像分支引入了嵌入层和瓶颈层双重适配器，实现了性能与效率的良好权衡。这为多模态模型的高效适应提供了一种通用且有效的方案。

Abstract: Tabular-image multimodal learning aims to improve predictive modeling by jointly using structured tabular attributes and visual data. Although pretrained encoders provide strong modality-specific representations, full fine-tuning can be computationally expensive, while keeping encoders frozen may limit task-specific adaptation. We propose the Tabular-Image Adapter (TI-Adapter), a modality-specific adapter-based fine-tuning framework for efficient multimodal adaptation. TI-Adapter freezes the pretrained tabular encoder and learns an adapter after the extracted tabular embedding, while adapting the image branch with embedding-level and bottleneck-level adapters instead of full fine-tuning. Experiments on 20 tabular-image datasets show that TI-Adapter achieves competitive or better predictive performance than full fine-tuning while using substantially fewer trainable parameters. Ablation studies further demonstrate the importance of adapter placement for balancing performance and practical efficiency.

[58] Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning cs.CV | cs.AIPDF

Chaofan Ma, Zhenjie Mao, Yuhuan Yang, Fanqin Zeng, Yue Shi

TL;DR: 本文提出了一种名为Reason, then Re-reason (ReRe)的训练免费推理框架，用于提升多模态大语言模型在空间推理任务上的性能。该框架通过两个阶段工作：首先基于原始视频形成空间假设，然后通过观察合成的互补新视角视频来验证或修正该假设。

Details

Motivation: 解决现有方法在自我中心视频空间推理中，因证据受限而依赖语义先验进行单次推理的问题，主张空间推理应是可重新审视的，即当获得互补视角时能修正先前结论。

Result: 在VSI-Bench和STI-Bench基准测试上的广泛评估表明，ReRe显著提升了开源MLLMs的性能，使其能够媲美专有的最先进模型。

Insight: 核心创新在于提出了一个可重新审视的推理范式，并设计了一个Geometry-to-Video流程来生成具有战略互补性的新视角视频，该流程无需修改模型架构，保持了MLLM的原生视频接口。

Abstract: Spatial reasoning from egocentric videos is inherently challenging because the observable evidence is constrained by the camera trajectory. Existing methods rely on single-turn inference, forcing models to resolve geometric ambiguity through semantic priors rather than verifiable evidence. We argue that spatial reasoning should be revisitable: conclusions formed under limited evidence should remain open to revision when complementary viewpoints become available. Building on this insight, we propose Reason, then Re-reason (ReRe), a training-free, inference-time framework with two phases: in the Reason Phase, an MLLM forms a spatial hypothesis from the original video; in the Re-reason Phase, it verifies or revises the hypothesis by observing a synthesized novel-view video. To enable effective cross-view revisiting, we design a Geometry-to-Video pipeline that renders strategically complementary novel views from predicted 3D geometry. These views feature an elevated, oblique perspective with scene-spanning coverage, while preserving the MLLM’s native video interface without architectural modifications. Extensive evaluations on VSI-Bench and STI-Bench demonstrate that ReRe substantially boosts open-source MLLMs to rival proprietary state-of-the-art performance. Project page: https://zhenjiemao.github.io/ReRe/

Marius Bayizere

TL;DR: 本文提出了DroneShield-AI，一个用于实时自主无人机威胁检测、行为意图分类和群体智能分析的多模态传感器融合统一开源框架。该框架集成了射频信号分类、声学特征检测、视觉检测、证据加权传感器融合、行为意图分类引擎（BICE）和图神经网络群体智能模块（GNN-SIM）六个处理层。

Details

Motivation: 解决21世纪日益严峻的无人机安全威胁挑战，需要一个能够实时、准确检测无人机、分类其行为意图并分析群体智能的综合性系统。

Result: 在三个公开的真实世界数据集上评估，融合流水线实现了96.1%的检测准确率、3.2%的误报率、AUC-ROC为0.981，并在总成本约500-780美元的商用CPU硬件上达到142毫秒的端到端延迟。

Insight: 创新点包括：首次提出了针对无人机飞行模式的系统性六类威胁分类法（BICE），实现了30秒的提前预警；首次提出了使用图注意力网络进行对抗性多无人机编队分析的开放框架（GNN-SIM）。该框架将多种传感器模态与行为意图预测、群体智能分析相结合，提供了一个低成本、高性能的完整解决方案。

Abstract: Unmanned Aerial Vehicle (UAV) threats have emerged as a defining security challenge of the 21st century. This paper presents DroneShield-AI, a unified open framework integrating six processing layers: RF signal classification, acoustic motor-signature detection, YOLOv8-based visual detection, evidence-weighted sensor fusion, a Behavioral Intent Classification Engine (BICE), and a Graph Neural Network Swarm Intelligence Module (GNN-SIM). BICE introduces the first systematic six-class threat taxonomy for drone flight patterns, enabling predictive operator alerts with a 30-second advance-warning horizon. GNN-SIM is the first open framework for adversarial multi-drone formation analysis using Graph Attention Networks. Evaluated on three publicly available real-world datasets, the fused pipeline achieves 96.1% detection accuracy, 3.2% false alarm rate, AUC-ROC: 0.981, and 142ms end-to-end latency on commodity CPU-class hardware at approximately $500-$780 USD total system cost. All code, model weights, and simulation datasets are publicly released at submission.

[60] RankVR: Low-Rank Structure Perception and Value Recalibration for Robust Composed Image Retrieval cs.CVPDF

Jiale Huang, Zixu Li, Zhiheng Fu, Zhiwei Chen, Qinlei Huang

TL;DR: 本文提出RankVR框架，旨在解决组合图像检索（CIR）任务中大规模数据集普遍存在的噪声三元组对应（NTC）问题。该框架通过全局结构一致性感知（GSCP）模块解耦干净样本与结构噪声，并利用自适应语义价值校准（ASVC）模块动态量化三元组的语义价值，以区分高价值困难干净样本并抑制逻辑冲突噪声。

Details

Motivation: 现有去噪方法主要针对二元不匹配或依赖基于标量的逐点估计，忽略了样本群体间丰富的全局结构关联以及训练过程中的动态价值变化，导致次优结果。论文识别出两个关键未解决挑战：语义关联的全局结构不一致性和困难样本判别不确定性。

Result: 在FashionIQ和CIRR基准数据集上的大量实验表明，RankVR显著优于现有的最先进（SOTA）方法，验证了其在噪声环境下的卓越鲁棒性。

Insight: 创新点在于引入全局结构一致性感知（GSCP）模块，利用相关矩阵的有效秩来识别破坏宏观语义对称性的样本；以及自适应语义价值校准（ASVC）模块，通过整合训练潜力和可靠性来动态量化每个三元组的语义价值。这为处理噪声数据提供了结构感知和价值重校准的新思路。

Abstract: Composed Image Retrieval (CIR) constitutes a pivotal paradigm requiring models to perform joint reasoning on reference images and modification texts. However, the prevalence of Noisy Triplet Correspondence (NTC) in large-scale datasets severely constrains model performance. Existing denoising methods either target binary mismatches or rely on scalar-based point-wise estimation, neglecting rich global structural correlations among sample populations and dynamic value variations during training, thereby yielding suboptimal results. This paper identifies two critical unresolved challenges: Global Structural Inconsistency of Semantic Correlations and Hard Sample Discrimination Uncertainty. To address these, we propose RankVR, a framework designed to construct a robust CIR model via global structure consistency and dynamic value perception. Specifically, we introduce the Global Structure Consistency Perception (GSCP) module, which utilizes the Effective Rank of the Correlation Matrix to decouple clean samples from structural noise. By measuring rank difference, GSCP identifies samples disrupting macroscopic semantic symmetry. Furthermore, we develop the Adaptive Semantic Value Calibration (ASVC) module to distinguish high-value hard clean samples. By integrating training potential and reliability, it dynamically quantifies the semantic value of each triplet, ensuring effective utilization of hard samples while suppressing noise characterized by logical conflicts. Extensive experiments on the FashionIQ and CIRR benchmark datasets demonstrate that RankVR significantly outperforms existing state-of-the-art methods, validating its superior robustness in noisy environments.

[61] MedCTA: A Benchmark for Clinical Tool Agents cs.CV | cs.AI | cs.CLPDF

Tajamul Ashraf, Hyewon Jeong, Fida Mohammad Thoker, Bernard Ghanem

TL;DR: MedCTA是一个用于评估医疗工具智能体的基准测试，专注于临床验证的、步骤隐含的多模态任务，涵盖放射影像、病理切片和报告。该基准包含107个真实世界临床任务，支持对工具选择、参数有效性、执行稳定性、轨迹保真度和结果质量的过程感知评估。

Details

Motivation: 现有基准主要评估孤立的感知或单轮问答，无法充分揭示医疗AI智能体在规划、工具调用和部署可靠性方面的失败。因此，需要一个新的基准来评估医疗工具智能体在真实临床环境中的多步骤决策能力。

Result: 在评估18个开源和闭源多模态模型后，发现即使是前沿系统在多步骤临床工具使用中仍表现脆弱：自主部署主要受协议失败、过早停止和错误工具调用影响，而黄金标准工具路由能带来显著但不完全的提升。

Insight: 创新点在于提出了首个专注于临床工具智能体多步骤任务的过程感知评估基准，强调强骨干感知能力不能直接转化为可靠的临床智能体行为，为审计、诊断和推进可信医疗AI提供了严格测试平台。

Abstract: To make clinically grounded decisions, medical AI agents are expected to go beyond simple recognition and be capable of tool retrieval, evidence acquisition, and integration. Existing benchmarks largely evaluate isolated perception or single-turn question answering, and therefore provide limited visibility into failures of planning, tool recruitment, and rollout reliability. We introduce MedCTA, a benchmark for evaluating medical tool agents on clinician-validated, step-implicit tasks grounded in realistic multimodal clinical inputs, including radiology images, pathology slides, and reports. MedCTA comprises 107 real-world clinical tasks with clinician-verified executable trajectories over 5 deployed tools, and supports process-aware evaluation of tool selection, argument validity, execution stability, trajectory fidelity, and outcome quality. We benchmark 18 open- and closed-source multimodal models and find that even frontier systems remain brittle in multi-step clinical tool use: autonomous rollouts are dominated by protocol failures, premature stopping, and incorrect tool recruitment, while gold-standard tool routing yields large but still incomplete gains. These results show that strong backbone perception does not translate into reliable agentic behavior in clinical settings. MedCTA provides a rigorous testbed for auditing, diagnosing, and advancing trustworthy medical AI agents. The dataset and evaluation suite are available at https://ivul-kaust.github.io/MedCTA/

[62] ERN-Net : Evolving Reason Node-Net for Document Binarization cs.CVPDF

Hsin-Jui Pan, Sheng-Wei Chan, Jen-Shiung Chiang

TL;DR: 本文提出了ERN-Net，一种用于高效文档图像二值化的演化推理节点网络。该网络通过演化推理节点和多尺度推理来增强对退化敏感的区域，如模糊笔画、断裂字符和噪声背景。实验表明，在低数据和低内存设置下，ERN-Net是有效的。

Details

Motivation: 解决文档图像二值化中，对模糊笔画、断裂字符和噪声背景等退化敏感区域增强不足的问题，旨在实现高效且准确的二值化。

Result: 在DIBCO风格的基准测试上，ERN-Net在低数据和低内存设置下表现有效。通过对比发现，ConvNeXt-Tiny在准确性和内存使用之间提供了最佳平衡，且基于DIBCO的预训练提升了性能而不增加模型内存消耗。

Insight: 创新点在于引入了演化推理节点和多尺度推理机制来针对性增强退化区域。从架构选择（ConvNeXt-Tiny）和预训练策略（DIBCO-based）中获得的效率与性能平衡的实践经验也具有借鉴价值。

Abstract: This paper presents ERN-Net, an Evolving Reason Node-Net for efficient document image binarization. ERN-Net enhances degradation-sensitive regions, such as faint strokes, broken characters, and noisy backgrounds, through evolving reason nodes and multi-scale reasoning. We further compare ResNet-101, ConvNeXt-Tiny, and ConvNeXt-Base, and find that ConvNeXt-Tiny provides the best practical trade-off between accuracy and memory usage. In addition, DIBCO-based pretraining improves binarization performance without increasing model memory consumption, requiring only about 1.5 additional training hours. Experiments on DIBCO-style benchmarks show that ERN-Net is effective under low-data and low-memory settings.

[63] Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning cs.CV | cs.AIPDF

Enhan Zhao, Wei Wu, Yuanrui Zhang, Xueliang Zhao, Di He

TL;DR: 本文提出了Ouroboros-Spatial，一个用于提升多模态大语言模型空间推理能力的自进化训练框架。该框架通过让模型同时扮演提议者和求解者的双重角色，形成一个数据-模型的闭环，使训练数据的分布能够与模型能力协同进化，从而用更少的数据实现更高效的训练。

Details

Motivation: 现有方法主要依赖大规模、静态策划的数据集，这种范式数据效率低下，因为无论模型当前能力如何，所有训练样本都被同等对待，导致训练容量浪费在过于简单或过于困难的样本上。

Result: 在六个空间推理基准测试中，Ouroboros-Spatial显著提升了Qwen3-VL-4B和Qwen3-VL-8B模型的性能，且使用的训练样本数量比近期大规模策划数据集少一个数量级。在VSI-Bench上，它分别给4B和8B模型带来了9.9和6.8个百分点的绝对增益，使两者均超越了一系列强大的开源和专有基线模型。

Insight: 核心创新在于提出了一个数据-模型协同进化的闭环训练范式，利用模型自身的预测置信度作为难度信号，动态指导训练数据的生成，从而实现了数据的高效利用和训练过程的自我优化。

Abstract: Spatial reasoning remains a persistent challenge for multimodal large language models (MLLMs). Existing approaches largely rely on large-scale, statically curated datasets, where all training samples are treated uniformly regardless of the model’s evolving capabilities. This static paradigm is inherently data-inefficient: training capacity is often spent on samples that are either trivial or overly difficult for the model at its current stage. To address this limitation, we propose Ouroboros-Spatial, a self-evolving training framework in which the model plays dual roles as a proposer and a solver. In each iteration, a frozen proposer generates spatial question-answer (QA) pairs from 3D scene metadata and raw video frames, together with executable code for deriving reliable ground truth. A learnable solver is then fine-tuned on the accepted samples, and its per-sample prediction confidence is used as a difficulty signal. This signal is fed back to the proposer in the next iteration, guiding it to generate questions better matched to the solver’s current capabilities. Through this closed-loop design, the training distribution co-evolves with model ability, reducing redundant trivial examples while filtering out ambiguous or uninformative samples with limited learning value. Across six spatial reasoning benchmarks, Ouroboros-Spatial substantially improves Qwen3-VL-4B and Qwen3-VL-8B while using an order of magnitude fewer training examples than recent large-scale curated datasets. On VSI-Bench, it yields absolute gains of 9.9 and 6.8 points for the 4B and 8B models, respectively, enabling both to outperform a wide range of strong open-source and proprietary baselines.

[64] AnchorEdit: Maintaining Temporal Consistency in Multi-turn Image Editing via Causal Memory cs.CV | cs.AIPDF

Hang Xu, Xiaoxiao Ma, Guohui Zhang, Yu Hu, Siming Fu

TL;DR: 本文提出了AnchorEdit，一种基于自回归扩散模型的多轮图像编辑框架，旨在解决迭代编辑过程中的身份漂移和错误累积问题。该框架通过三阶段训练课程（单轮预训练、因果自回归微调和一致性蒸馏）以及推理时的记忆机制，实现了高分辨率、长序列编辑中的时序一致性。

Details

Motivation: 现有多轮图像编辑模型依赖视频先验的双向注意力机制，这与交互编辑的因果、顺序性质不匹配，导致身份漂移和错误累积。本文旨在设计一个专门针对高分辨率、长序列编辑的自回归框架，以保持时序一致性。

Result: 在提出的高分辨率多轮编辑基准测试中，AnchorEdit取得了最先进（SOTA）的结果，即使在超过10轮的交互编辑中也能保持优异的主体保真度和指令跟随能力。

Insight: 创新点包括：首次将自回归扩散模型应用于多轮图像编辑，通过三阶段训练课程（特别是自展开策略缓解暴露偏差）和记忆机制来桥接视频先验与因果推理，从而确保长序列编辑的稳定性。

Abstract: Multi-turn image editing is essential for iterative design, yet current models often struggle with identity drift and error accumulation over successive steps. While existing research leverages video priors for consistency, their reliance on bidirectional attention is fundamentally misaligned with the causal, sequential nature of interactive editing. In this paper, we propose AnchorEdit, the first autoregressive (AR) diffusion-based framework designed specifically for high-resolution, long-term multi-turn editing. AnchorEdit bridges the gap between video priors and causal inference through a three-stage training curriculum: identity-preserving sing-turn pretraining, causal AR forcing fine-tuning with a novel self-rollout strategy to mitigate exposure bias, and consistency distillation for efficient 4-step generation. During inference, we introduce a memory mechanism to anchor the initial subject identity and ensure stable extrapolation across extended editing trajectories. To evaluate performance, we provide a new high-resolution multi-turn editing benchmark designed to stress-test long-horizon stability. Extensive experiments demonstrate that AnchorEdit achieves state-of-the-art results, maintaining exceptional subject fidelity and instruction following even over 10+ interaction rounds.

[65] From Prompts to Tokens: Internalizing Causal Supervision in Vision-Language Model for Multi-Image Causal Reasoning cs.CV | cs.AIPDF

Haoping Yu, Yuanxi Li, Jing Ma

TL;DR: 本文提出BridgeVLM模型，旨在解决大型视觉-语言模型在多图像因果推理任务中的脆弱性问题。该方法通过从多图像输入中推导因果图，并将其转换为由注入LLM解码器的RAMP层执行的结构化因果令牌，从而将因果知识内化到模型内部。

Details

Motivation: 现有方法主要通过文本提示注入因果知识，这使得因果机制外在于模型执行过程，限制了推理过程中的可靠控制。因此，需要一种能够将视觉因果推理内化到模型架构中的方法。

Result: 在CausalVLBench的干预任务上，BridgeVLM达到了54.4%的准确率（相比提示级监督的33.2%），在Causal3D上将结果从43.6%提升至49.0%，并在CausalVLBench的因果结构学习任务上显著提升了F1分数（从33.4%到75.1%）。

Insight: 核心创新点在于将因果图显式地转化为结构化令牌，并通过专门的RAMP层在LLM内部进行因果消息传递，实现了因果机制的内化。同时，提出的M3S统一训练接口实现了从局部到全局不同粒度的细粒度因果监督。

Abstract: Visual causal reasoning is essential for understanding and intervening in the physical world, requiring identification of causal variables from visual inputs and reasoning over intervention effects. Despite recent progress, large vision–language models (VLMs) remain brittle at such tasks, especially for interventional and counterfactual queries over multi-image inputs. Most existing explorations inject causal knowledge via textual prompts, leaving causal mechanisms external to model execution and limiting reliable control during inference. To address this problem, we propose BridgeVLM, which internalizes visual causal reasoning by inducing a causal graph from multi-image inputs and converting it into structured Causal Tokens executed by RAMP layers injected into the LLM decoder for causal message passing. We further introduce a unified training interface M3S for fine-grained causal supervision from different granularities (local/global level). BridgeVLM achieves 54.4% accuracy on intervention tasks on CausalVLBench (vs. 33.2% with prompt-level supervision), improves results on Causal3D from 43.6% to 49.0%, and substantially improves causal structure learning on CausalVLBench ($F_1$: 33.4% $\rightarrow$ 75.1%).

[66] A Comprehensive Ecosystem for Open-Domain Customized Video Generation cs.CVPDF

Jingxu Zhang, Yuqian Hong, Daneul Kim, Kai Qiu, Qi Dai

TL;DR: 本文提出了一个面向开放域定制化视频生成的综合生态系统，包括首个百万级身份保持视频生成数据集PexelsCustom-1M、参数高效的定制视频生成框架CustoMDiT以及一个覆盖1000+类别的全新评测基准OpenCustom。

Details

Motivation: 现有开放域定制化视频生成受限于缺乏大规模、标注了多样化身份特定属性的数据集，无法满足实际应用需求。

Result: 在构建的OpenCustom基准（1000+类别）上，提出的CustoMDiT框架超越了现有方法，达到了最先进的性能水平。

Insight: 通过跨数据集知识融合（ImageNet与MS-COCO）构建大规模、细粒度的评测基准，以及采用参数高效微调策略（仅需8%额外可学习参数）将预训练多模态扩散Transformer适配为定制视频生成器，是两项核心创新。

Abstract: Recent progress in video generation has shown impressive visual synthesis capabilities. However, open-domain customized video generation remains limited by the lack of large-scale, annotated datasets capturing diverse identity-specific attributes. To address this, we introduce PexelsCustom-1M, the first publicly available million-scale dataset for identity-preserving video generation, containing one million curated <identity, text, video> triplets across 8,000+ categories. Leveraging this, we propose CustoMDiT, a parameter-efficient framework that adapts a pretrained multimodal Diffusion Transformer into a customized video generator with only 8% additional learnable parameters. Our method surpasses prior state-of-the-art. However, benchmarks such as DreamBooth cover only 100 classes, which is insufficient for real-world applications. To overcome this, we construct OpenCustom, a new benchmark with 1,000+ categories, created via cross-dataset knowledge fusion from ImageNet and MS-COCO. Extensive experiments confirm the advantages of both our dataset and model. We will open-source the entire ecosystem–including dataset, pipeline, benchmark, and implementations–to support further research.

[67] UniReason-Med: A Shared Grounded Reasoning Interface for 2D-to-3D Transfer in Medical VQA cs.CV | cs.CLPDF

Mengzhuo Chen, Yan Shu, Chi Liu, Hongming Piao, Xidong Wang

TL;DR: 本文提出了UniReason-Med，一个统一的、基于共享推理接口的医学视觉问答框架，能够处理2D图像和序列化切片的3D体积数据，并生成交织的文本推理和定位的视觉证据。通过构建包含22万条指令调优数据的UniMed-CoT数据集，并结合监督微调与结果级强化学习进行训练，该模型实现了从丰富的2D医学图像到3D医学VQA的推理能力迁移。

Details

Motivation: 研究动机是探索在输入类型（2D和3D医学图像）通过一个共同的推理接口对齐的情况下，来自大量2D医学图像的、基于定位的推理监督是否能提升3D医学视觉问答的性能。

Result: 实验结果表明，联合的2D+3D定位监督训练相比仅使用3D数据的训练，能显著提升3D推理能力；同时，定位机制和区域-令牌注入技术对2D和3D任务均有持续增益。这些结果验证了共享的、基于定位的推理接口可以将推理结构从2D图像迁移到序列化切片的3D医学理解中。

Insight: 核心创新点在于提出了一个统一的、共享的、基于定位的推理接口，该接口通过共享的边界框语法、区域-令牌注入和共同的定位推理策略，实现了跨模态（2D到3D）的推理能力迁移。其训练方法（监督微调+结果级强化学习，无需基于IoU/Dice的定位奖励）也颇具新意，为构建统一的医学多模态理解模型提供了新思路。

Abstract: We study whether grounded reasoning supervision from abundant 2D medical images can improve 3D medical VQA when both input types are aligned through a common reasoning interface. We introduce UniReason-Med, a single-checkpoint framework that processes either a 2D image or a slice-serialized 3D volume at inference time, generating interleaved textual reasoning and localized visual evidence through shared box syntax, region-token injection, and a common grounded reasoning policy. To train this interface, we construct UniMed-CoT, a 220K instruction-tuning dataset with interleaved textual reasoning and grounded visual evidence, including 170K 2D and 50K 3D samples. Through supervised fine-tuning followed by outcome-level reinforcement learning, UniReason-Med learns to generate grounded reasoning traces without IoU/Dice-based localization rewards during RL. Data-mixture and component ablations show that joint 2D+3D grounded supervision substantially improves 3D reasoning over 3D-only training, while grounding and region-token injection consistently benefit both 2D and 3D tasks. These results suggest that a shared grounded reasoning interface can transfer reasoning structure from 2D images to slice-serialized volumetric medical understanding. The code and data are publicly available at https://github.com/IQuestLab/unireason-med.

[68] MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models cs.CV | cs.AI | cs.CLPDF

Yuansheng Gao, Wenbin Xing, Jiahao Yuan, Kaiwen Zhou, Han Bao

TL;DR: 本文提出了MultiToP，一个多模态上下文感知的视觉令牌修补框架，旨在缓解视频大语言模型中的幻觉问题。该方法通过一个轻量级的视觉令牌修补器，在语言生成前预测并替换不可靠的视觉令牌，并引入了信息引导的排序校准来有效训练修补器。实验表明，该方法在Vript-HAL基准上显著减少了幻觉，并保持了模型的通用视频理解能力。

Details

Motivation: 视频大语言模型在视频理解方面取得了显著进展，但仍然容易产生幻觉，即生成的回答没有忠实于输入视频内容。

Result: 在Vript-HAL基准上，该方法有效减少了幻觉，将Qwen3-VL-4B-Instruct的F1分数比原始模型提高了50.60%。同时，在ActivityNet-QA上，Video-LLaVA-7B的相对准确率提升了18.58%，且推理开销可忽略。

Insight: 创新点在于提出了一个无需修改原始模型、专注于局部视觉证据细化的轻量级视觉令牌修补框架，并引入了结合答案监督和信息引导排序校准的训练策略，实现了对不可靠视觉令牌的动态、选择性替换。

Abstract: Video Large Multimodal Models have achieved remarkable progress in video understanding, yet they remain prone to hallucinations, where generated responses are not faithfully supported by the input video. In this paper, we propose MultiToP, a multimodal-context-aware visual token patching framework that mitigates hallucinations by refining unreliable visual tokens before language generation. MultiToP introduces a lightweight Visual Token Patcher to predict token-level replacement distributions and selectively substitute unreliable visual tokens with a dynamic global patch token. To train the patcher effectively, we further propose information-guided rank calibration, which uses answer-conditioned frame-level information cues derived from the backbone to guide token replacement. Combined with ground-truth answer supervision and sparsity regularization, MultiToP enables localized visual evidence refinement without modifying the original model. Extensive experiments demonstrate that MultiToP effectively reduces hallucinations on Vript-HAL with negligible inference overhead, improving the F1 scores of Qwen3-VL-4B-Instruct by 50.60% over the vanilla model. Meanwhile, MultiToP preserves general video understanding ability, yielding an 18.58% relative accuracy gain on ActivityNet-QA for Video-LLaVA-7B.

[69] Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding cs.CVPDF

Hyomin Kim, Junghye Kim, Joanie Hayoun Chung, Yoonjin Oh, Kyungjae Lee

TL;DR: 本文提出SG-PVR，一种基于时空场景图进行规划与验证的视频奖励模型，旨在解决现有基于推理的奖励模型在文本到视频生成中细粒度语义对齐不足的问题。该模型通过将提示分解为原子声明进行验证规划，并利用从视频中提取的时空场景图作为结构化视觉证据，确保每个判断都有明确的视觉依据。

Details

Motivation: 现有基于推理的文本到视频奖励模型存在两个结构性弱点：未能系统性地验证提示中的每个条件，且其自由形式推理中的视觉证据支持是隐含的，导致细粒度语义对齐失败。

Result: SG-PVR在语义对齐（包括细粒度时序语义）上取得了强劲性能。作为测试时重排序器，它进一步提升了文本到视频生成的组合对齐能力。

Insight: 创新点在于将规划与验证推理机制与时空场景图相结合，通过分解提示为原子声明并利用结构化视觉参考进行显式验证，从而实现了更可靠、可解释的细粒度语义对齐评估。

Abstract: Reward models for text-to-video (T2V) generation guide post-training but often fail at fine-grained semantic alignment. We trace this to two structural weaknesses in existing reasoning-based reward models: they do not systematically verify every condition described in the prompt, and the visual evidence supporting each judgment remains implicit in their free-form reasoning. We propose SG-PVR, a video reward model that addresses these limitations through plan-and-verify reasoning grounded in spatio-temporal scene graphs. The verification plan decomposes the prompt into atomic claims, ensuring every requirement is checked. The spatio-temporal scene graph, encoding entities, attributes, and temporally-grounded relations, is extracted from the video and maintained as a persistent structured visual reference throughout reasoning. Each claim is verified against both the video and the scene graph, anchoring judgments in explicit visual evidence. SG-PVR achieves strong performance on semantic alignment, including fine-grained temporal semantics. As a test-time reranker, it further enhances compositional alignment in T2V generation.

[70] LASA: A Weak Supervision Method for Open-Vocabulary Scene Sketch Semantic Segmentation cs.CV | cs.AIPDF

Liwen Yi, Xianlin Zhang, Yue Zhang, Yue Ming, Xueming Li

TL;DR: 本文提出了一种名为LASA的弱监督方法，用于解决开放词汇场景草图语义分割问题。该方法通过聚合Vision Transformer不同层的注意力图来获取互补的空间结构线索，从而在无需像素级标注的训练条件下，实现对稀疏线稿的语义分割。

Details

Motivation: 开放词汇场景草图语义分割面临的主要挑战是草图缺乏纹理和颜色信息，语义理解严重依赖笔画布局和空间结构，这导致单层视觉语言特征不稳定。论文旨在利用不同Transformer层注意力图编码的互补空间线索来构建更鲁棒的结构先验。

Result: 在FS-COCO、SFSD和FrISS三个基准数据集上的实验表明，LASA方法相比之前的弱监督基线，mIoU分别提升了+3.43、+8.01和+15.74，在分割精度和空间一致性方面均取得了显著且一致的提升。

Insight: 核心创新点在于观察到ViT不同层的注意力图编码了互补的结构信息（浅层关注全局布局，深层关注局部笔画交叉和物体部件），并据此提出了层间累积结构注意力（LASA）框架，通过聚合多层注意力来指导弱监督下的分层语义对齐和推理时的预测细化。这为缺乏纹理信息的草图理解提供了一种新颖且有效的结构建模思路。

Abstract: Open-vocabulary scene sketch semantic segmentation aims to assign dense semantic labels to sparse line drawings based on flexible category vocabularies specified at inference time, without relying on pixel-level annotations during training. Unlike natural images, sketches lack texture and color cues, making semantic understanding heavily dependent on stroke layout and spatial configuration, a challenge that renders single-layer vision-language features inherently unstable. Our key observation is that attention maps from different Vision Transformer layers encode complementary spatial cues: shallow layers capture global structural layouts, while deeper layers focus on local stroke intersections and object parts. This suggests that cross-layer aggregation provides a more robust structural prior than any individual layer alone. Leveraging this insight, we propose a structure-aware framework built upon \textbf{L}ayer-wise \textbf{A}ccumulated \textbf{S}tructural \textbf{A}ttention (\textbf{LASA}), which aggregates multi-layer attention to guide hierarchical semantic alignment under weak supervision and refine predictions during inference. Experiments on FS-COCO, SFSD, and FrISS show that LASA improves mIoU by $+3.43$, $+8.01$, and $+15.74$ over the prior weakly supervised baselines, demonstrating consistent gains in both segmentation accuracy and spatial coherence. Our source code will be made publicly available.

[71] Scene-Adaptive Nonlinear Tone Curves for Pseudo Ground-Truth Generation in Low-Light 3D Gaussian Splatting cs.CVPDF

Mingzhe Lyu, Jinqiang Cui, Hong Zhang

TL;DR: 该论文提出了一种场景自适应的非线性色调曲线框架，用于在低光3D高斯泼溅（3DGS）中生成伪地面真值（pseudo-GT）。该方法通过基于百分比的归一化、场景自适应偏移以及两种互补的非线性曲线（自适应软指数曲线ASE和自适应三次多项式曲线AP3），替代了现有方法中使用的统一线性增益，以更好地增强暗区并保留亮区细节，从而提升3D重建质量。

Details

Motivation: 解决低光新视角合成中，由于暗光多视图图像存在噪声、结构细节弱和动态范围压缩，而现有伪地面真值生成方法采用统一线性增益导致亮区裁剪和暗区增强不足，从而限制3DGS重建质量的问题。

Result: 在涵盖21个场景的三个基准测试（LOM和RealX3D）上，所提出的两种非线性曲线均一致优于线性基线，PSNR提升最高达+4.34 dB（LOM）和+3.25 dB（RealX3D），两种曲线性能相似。

Insight: 创新点在于将2D低光增强中成熟的非线性色调映射思想首次引入3D重建的伪地面真值生成，提出了一个场景自适应的框架，其改进与具体曲线形式无关，且仅改变伪地面真值计算而不修改3DGS主干网络，易于集成。

Abstract: Low-light novel view synthesis is challenging because dark multi-view images contain noise, weak structural detail, and compressed dynamic range. Recent 3D Gaussian Splatting (3DGS) methods address these challenges by generating pseudo ground-truth (pseudo-GT) images as supervision targets when paired normal-light references are unavailable. Existing pseudo-GT methods apply a uniform linear gain to all pixels, which clips bright regions while providing insufficient enhancement in dark regions, limiting reconstruction quality. We observe that nonlinear tone mappings, long established in 2D low-light enhancement, have not been explored for pseudo-GT generation in 3D reconstruction. Accordingly, we propose a scene-adaptive nonlinear tone-curve framework that replaces linear pseudo-GT with nonlinear alternatives. The framework introduces percentile-based normalisation for scene-agnostic curve application, a scene-adaptive offset for automatic black-level adjustment, and two complementary curves: Adaptive SoftExp (ASE), a bounded exponential curve, and Adaptive Poly3 (AP3), a data-driven cubic polynomial. The module changes only the pseudo-GT computation and leaves the 3DGS backbone unchanged. Experiments on three benchmarks covering 21 scenes show that both curves consistently outperform the linear baseline with PSNR improvements up to +4.34 dB on LOM and +3.25 dB on RealX3D. Both curves achieve similar performance despite their different mathematical forms, suggesting the improvement is curve-agnostic. Code is available at https://github.com/lvmingzhe/adaptiveToneCurve

[72] SheafStain: Sheaf-Theoretic Schrödinger Bridge for Spatially and Biologically Coherent Virtual Staining cs.CVPDF

Hyeongyeol Lim, Hongjun Yoon, Eunjin Jang, Daeky Jeong, Won June Cho

TL;DR: 本文提出SheafStain方法，用于解决全切片图像虚拟染色中的空间不连续和生物不一致性问题。该方法将视觉基础模型的特征重新解释为层状截面，并整合到薛定谔桥框架中，以实现空间和生物一致的虚拟染色。

Details

Motivation: 现有虚拟染色方法在千兆像素全切片图像上进行分块推理时，会破坏空间连续性并产生伪影，导致与真实图像严重不匹配。此外，视觉基础模型的自注意力机制会导致同一物理区域在不同全局上下文下产生不一致的嵌入，即’上下文污染’问题。

Result: 在HER2、ER、PR和Ki-67等生物标志物数据集上，SheafStain在拼接后的1024×1024图像上评估，相比六种先前方法取得了有希望的结果，并有效缓解了分块边界拼接伪影。

Insight: 创新点在于将层论形式化引入虚拟染色问题，将’上下文污染’建模为预层违反粘接公理的问题，并提出通过整合类别和分块令牌作为层状截面来保证一致性。同时，在H&E和IHC双染色上预训练的主干网络能产生非退化的跨染色茎，使单一特征空间能同时监督输入条件和输出染色对齐。

Abstract: Current virtual staining approaches offer the potential for time- and cost-efficient biomarker quantification in cancer diagnostics and prognostics. However, patch-wise inference for gigapixel whole slide images (WSIs) fails to maintain spatial continuity, yielding artifacts that cause catastrophic mismatches with ground-truth images. Although pathology Vision Foundation Models (VFMs) offer rich representations, their self-attention causes varying global contexts to produce inconsistent embeddings for the same physical region. We formalize and validate this ``context contamination’’ as a sheaf-theoretic problem where these embeddings form a presheaf that violates the gluing axiom. To address this, we propose SheafStain, a new approach that reinterprets VFM features as sheaf-like sections for spatially and biologically coherent virtual staining. Specifically, SheafStain integrates class and patch tokens into a Schrödinger Bridge framework as sheaf-like sections. While the class token anchors biological consistency, patch tokens form a per-position spatial map. A backbone co-pretrained on Hematoxylin & Eosin (H&E) and Immunohistochemistry (IHC) yields non-degenerate cross-stain stalks, so a single VFM feature space supervises both input conditioning and output stain alignment. Departing from prior work that evaluates on isolated $256 \times 256$ patches and either random-crops or resizes the $1024 \times 1024$ ground truth, we translate at $256 \times 256$ and evaluate on the stitched $1024 \times 1024$ outputs across HER2, ER, PR, and Ki-67. SheafStain demonstrates promising results against six prior methods while mitigating patch-boundary stitching artifacts. Code will soon be released.

Zhirui Chen, Ziwei Chen, Ling Shao

TL;DR: 本文提出了一种名为TASM（Task-Aware Structured Memory）的无训练框架，旨在解决多模态大语言模型（MLLMs）在上下文学习（ICL）中因有限上下文窗口和长序列KV缓存成本而面临的可扩展性问题。TASM通过任务感知、结构保持和动态访问的内存构建，实现了高效压缩，同时保持性能。

Details

Motivation: 多模态大语言模型依赖上下文学习进行快速任务适应，但有限上下文窗口和长多模态序列中KV缓存成本的增长严重限制了其可扩展性。现有内存压缩方法通常依赖僵化的令牌移除或样本依赖的重要性估计，这会引入偏差、破坏语义结构（尤其是视觉表示），并产生无法适应新查询的静态内存。

Result: 评估证实TASM在重度压缩下仍能保持高性能，有效平衡效率与适应性。

Insight: 创新点包括：使用任务向量引导的压缩，以任务级方向替代样本特定信号，捕捉演示间的共享相关性；通过二分图匹配实现语义感知的令牌合并，聚合令牌而不进行破坏性修剪；将内存结构化为包含紧凑核心内存和潜在库的层次结构，支持查询自适应的动态检索。从客观角度看，该方法结合了任务感知和结构保持，为多模态上下文学习的内存管理提供了新思路。

Abstract: Multi-modal large language models (MLLMs) depend on in-context learning (ICL) for rapid task adaptation, but their scalability is severely limited by finite context windows and the growing cost of key-value (KV) caches in long multi-modal sequences. Existing memory compression approaches typically rely on rigid token removal or sample-dependent importance estimation, which introduces bias, disrupts semantic structure, particularly for visual representations, and yields static memories that cannot adapt to new queries. We introduce TASM (Task-Aware Structured Memory), a training-free framework that addresses these limitations through task-aware, structure-preserving, and dynamically accessible memory construction. TASM employs task-vector guided compression to replace sample-specific signals with a task-level direction that captures shared relevance across demonstrations. To preserve the underlying manifold, it applies semantics-aware token merging via bipartite graph matching, aggregating tokens without destructive pruning. Finally, TASM structures memory into a hierarchy comprising a compact Core Memory and a Latent Bank, facilitating query-adaptive dynamic retrieval. Evaluations confirm TASM maintains high performance under heavy compression, effectively balancing efficiency with adaptability.

[74] Task-Aligned Stability Analysis of Vision-Language Models for Autonomous Driving Hazard Detection cs.CV | cs.AI | cs.ROPDF

Everett Richards

TL;DR: 本文研究了自动驾驶危险检测中视觉语言模型（VLMs）的鲁棒性，分析了图像损坏导致的嵌入漂移与任务对齐的危险评分变化之间的关系。通过在BDD100K数据集上应用受控损坏，发现嵌入漂移与决策漂移（即危险评分的变化）的关系高度依赖于损坏类型，且不同损坏家族会导致不对称的故障模式。

Details

Motivation: 当前VLM在自动驾驶场景理解中的鲁棒性分析通常仅依赖于任务无关的嵌入稳定性，本文旨在探究损坏引起的嵌入漂移是否能预测任务对齐的危险评分变化，以更全面地评估模型鲁棒性。

Result: 在BDD100K道路场景上使用受控损坏进行实验，结果表明嵌入漂移与决策漂移的关系因损坏家族而异：某些家族表现出强耦合，而另一些则在嵌入变化较小的情况下导致危险的决策不稳定；此外，不同损坏家族的故障方向不同，多数通过假阴性抑制危险检测，而遮挡则引发误报。

Insight: 创新点在于提出了任务对齐的稳定性度量（如危险评分变化），并揭示了嵌入级扰动统计的局限性；客观分析认为，该研究强调了鲁棒性基准测试应纳入任务对齐的稳定性指标，并考虑不对称故障模式，而不仅仅是整体不稳定率。

Abstract: Vision-language models (VLMs) are increasingly used for scene understanding in autonomous driving, but robustness analysis often relies on task-agnostic embedding stability alone. We study whether corruption-induced embedding drift predicts changes in a task-aligned hazard score derived from CLIP image-text similarities. Using controlled corruptions on BDD100K road scenes, we compare embedding drift against margin drift, defined as the change in hazard score under perturbation. The relationship is highly corruption-dependent: some families exhibit strong coupling between representation drift and decision drift, while others induce hazardous decision instability despite relatively modest embedding change. Furthermore, corruption families differ in failure direction: most suppress hazard detections via false negatives, while occlusion instead triggers false alarms, suggesting that benchmark design should account for asymmetric failure modes, not just overall instability rates. These results suggest that robustness benchmarks should include task-aligned stability measures in addition to embedding-level perturbation statistics.

[75] Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching cs.CV | cs.LGPDF

Zsolt Robotka, Ádám Rák, Jalal Al-Afandi, András Horváth, György Cserey

TL;DR: 本文提出了一种无需额外人工标注、外部手语视频语料库或生成式视频模型的手语翻译语料库增强方法。该方法仅利用现有的带注释训练语料库和LLM进行句子生成，通过CTC强制对齐从训练视频中提取每个手语词汇片段，由语料库锚定的LLM生成新的词汇-句子对，并通过随机句子采样和片段分配组装合成序列。

Details

Motivation: 手语翻译旨在将手语视频转换为口语文本，以提升无障碍沟通。尽管已有大规模弱对齐数据集用于预训练且无注释方法减少了对专家标注的依赖，但高质量并行的视频-文本对仍稀缺，限制了模型在长尾词汇和未见结构上的泛化能力。

Result: 在Sincan等人严格相同条件下重新评估的五个近期无注释方法中，最大改进仅比GFSLT-VLP基线高0.98 BLEU-4。而本文提出的增强方法在同一框架下应用，无需改变架构或训练协议，实现了+2.92 BLEU-4的提升。

Insight: 创新点在于提出了一种完全基于现有资源的语料库增强流程，无需额外标注或视频生成模型。研究发现合成数据可能损害视觉-语言预训练目标，且基于L2准则优化片段过渡的视觉平滑性可能适得其反，提出突变的边界可能作为一种隐式正则化形式。

Abstract: Sign language translation (SLT) converts sign language video into spoken language text and holds significant promise for improving accessibility and enabling communication between signing and non-signing communities. While large weakly-aligned datasets have enabled pre-training at scale and gloss-free methods have reduced reliance on expert annotation, high-quality parallel sign video-text pairs for fine-tuning remain scarce, limiting generalisation on long-tail vocabulary and unseen constructions. We propose a corpus augmentation approach that requires no additional human annotation, external sign-language video corpora, or generative video models, relying only on the existing gloss-annotated training corpus and an LLM for sentence generation: per-gloss clips are extracted from training videos via CTC forced-alignment, novel gloss-sentence pairs are generated by a corpus-anchored LLM, and synthetic sequences are assembled through random sentence sampling and clip assignment. The resulting synthetic RGB video-text pairs are architecture-agnostic at the downstream training stage and can be consumed directly by RGB-based SLT models, or converted into pose or feature representations by pipelines that derive such inputs from video. Sincan et al. re-evaluated five recent gloss-free methods under strictly identical conditions; the largest verified gain over the GFSLT-VLP baseline was only 0.98 BLEU-4. Our augmentation, applied within the same framework, achieves +2.92 BLEU-4 without any change to architecture or training protocol. We further identify that synthetic data harms vision-language pretraining despite improving its objectives, and that optimising clip transitions for visual smoothness is counter-productive under L2-based criteria; we propose that abrupt boundaries may act as a form of implicit regularisation. Code is available at https://github.com/robizso/slt-datagen.

[76] From Content to Knowledge: Lightning Fast Long-Video Understanding with Neural Knowledge Representations cs.CVPDF

Yuchen Guan, Xiao Li, Zongyu Guo, Xiaoyi Zhang, Xiulian Peng

TL;DR: 本文提出了一种用于长视频理解的新范式，将长视频视为一种神经知识表示（NKR）。NKR不是将视频内容表示为令牌流或预组织的数据库，而是作为附加到视觉语言模型（VLM）主干上的少量网络权重。通过一种新颖的代理知识蒸馏（AKD）过程优化这些权重，以封装视频的语义内容，从而将视频转化为轻量、可移植、可重用的资产。在推理时，只需将NKR加载到冻结的VLM上，即可实现基于查询的直接理解，无需重新加载或编码原始视频，从而将视频长度与推理成本解耦。

Details

Motivation: 解决长视频理解中，由于视频长度导致的计算成本高、推理延迟大的问题，旨在实现高效、交互式的长视频理解。

Result: 在LVBench基准测试中，该方法达到了与最先进方法相当的性能，同时将端到端延迟降低了两个数量级以上。

Insight: 核心创新在于提出了神经知识表示（NKR）的概念，将视频内容编码为模型权重本身，并通过代理知识蒸馏（AKD）自动化生成训练数据来完成知识封装。这实现了视频内容与推理计算的解耦，为高效的多轮交互式视频理解提供了新思路。

Abstract: We propose a new paradigm for long video understanding by treating a long video as a Neural Knowledge Representation (NKR). NKR represents video contents neither as a stream of tokens nor pre-organized databases, but as an individual small portion of network weights attached to the VLM backbone. The NKR weights are optimized to encapsulate the video’s semantic content via a novel Agentic Knowledge Distillation (AKD) process, where an agent automatically synthesizes dense descriptions and question-answer pairs to distill the video’s knowledge into the NKR. While AKD serves as a comprehensive, one-time encoding phase, the resulting NKR transforms the video into a portable, reusable asset. At inference, the lightweight NKR is mounted onto a frozen Vision-Language Model (VLM), enabling direct, query-based understanding without reloading or re-encoding the original video. This approach decouples video length from inference cost, offering high amortized efficiency for multi-turn video understanding. Experiments on the LVBench benchmark show our method achieves performance comparable to state-of-the-art approaches while reducing end-to-end latency by over two orders of magnitude, opening new possibilities for interactive long-video understanding.

[77] SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation cs.CVPDF

Xu Zhang, Yu Lu, Ruijie Quan, Zhaozheng Chen, Bohan Wang

TL;DR: 本文提出了一种名为SpecLoR的即插即用推理方法，用于解决基于流匹配的文本到视频生成中因速度近似和数值离散化误差累积导致的采样轨迹漂移问题。该方法通过前瞻预测绕过噪声，并在频域中进行校正，利用自然视频的通用统计先验来减少时空不一致性，从而显著提升生成视频的运动连贯性。

Details

Motivation: 动机在于流匹配方法在文本到视频生成中，由于速度近似和数值离散化误差的累积，导致采样轨迹漂移，从而引起生成视频严重的时空不一致问题。直接校正这些漂移的噪声潜在表示具有挑战性，因为时间步相关的噪声会掩盖可靠的结构线索，而空间干预则可能破坏复杂的局部几何结构并带来高昂计算成本。

Result: 在Wan2.2数据集上的实验表明，SpecLoR显著减少了物理伪影，并在多个基准测试中增强了运动连贯性，同时计算开销极小（仅增加4个NFEs）。

Insight: 创新点在于提出了一种频域校正策略，通过前瞻预测估计干净潜在表示并计算其3D时空频谱，然后校正幅度谱以匹配自然视频的统计先验，同时保持相位不变，从而有效规避了噪声和时空纠缠问题，实现了高效的运动一致性提升。

Abstract: Flow Matching has enabled robust text-to-video generation via latent ODE sampling. However, velocity approximation and numerical discretization errors inevitably accumulate, causing sampling trajectories to drift. Consequently, generated videos often suffer from severe spatiotemporal inconsistencies. Nevertheless, directly correcting these drifted, noisy latents is challenging: (i) timestep-dependent noise obscures reliable structural cues; (ii) spatial interventions risk disrupting intricate local geometry while incurring heavy computational costs. To address this, we propose Spectral Lookahead Rectification (SpecLoR), a plug-and-play inference method that bypasses noise via lookahead prediction, and circumvents spatiotemporal entanglement by shifting corrections to the frequency domain, where universal statistical priors of natural videos are readily available. First, during early sampling stages, SpecLoR looks ahead to estimate the clean latent $z_{t,0}$ and computes its 3D spatiotemporal spectrum. Next, SpecLoR rectifies the amplitude spectrum to match the prior, leaving the phase intact. Finally, the corrected state is re-noised to resume ODE integration. Experiments on Wan2.2 demonstrate that SpecLoR significantly reduces physical artifacts and enhances motion coherence across multiple benchmarks with minimal computational overhead (4 additional NFEs).

[78] ParseFixer: An Agentic Framework for Document Parsing via Selective Multimodal Correction cs.CVPDF

LeKai Yu, Hao Liu, Kun Wang, Zhiran Li, Ruping Cao

TL;DR: 本文提出了ParseFixer，一个用于文档解析的智能体框架，通过选择性多模态校正来从文档页面图像中恢复结构化的Markdown文档。该框架包含全页骨干解析和智能体选择性校正两个核心模块，在DataMFM挑战赛Track 1中取得了第三名的成绩。

Details

Motivation: 为了解决文档解析任务中准确恢复文本内容与忠实重建文档结构这两个互补需求之间的矛盾。

Result: 在测试集上，最终系统获得了61.78的总分，在Track 1中排名第三，证明了其有效性。

Insight: 创新点在于将选择性多模态校正置于开源骨干解析之后，通过验证-回滚的校正过程修复高价值解析错误，而非重写可靠的骨干预测，从而在保持稳定性的同时提升关键文档元素的恢复能力。

Abstract: In this report, we present our third-place solution for the DataMFM Challenge Track 1: Document Parsing. This track requires models to recover structured Markdown documents from document page images while preserving textual content and document structure. To address the complementary requirements of accurate content recovery and faithful structure reconstruction, we propose ParseFixer, an agentic framework for backbone parsing and selective correction. ParseFixer consists of two key modules: Full-Page Backbone Parsing (FBP) and Agentic Selective Correction (ASC). FBP produces stable initial Markdown outputs with MinerU2.5 Pro, while ASC detects high-value parsing failures and repairs them through a verify-and-rollback correction process. By placing selective multimodal correction after open-source backbone parsing, ParseFixer improves the recovery of key document elements without rewriting reliable backbone predictions. On the test set, our final system achieves an overall score of 61.78 and ranks third in Track 1, demonstrating its effectiveness for accurate document parsing. Our code will be released at: https://github.com/iLearn-Lab/CVPRW26-ParseFixer.

[79] ViT-FREE: Efficient Face Recognition via Early Exiting and Synthetic Adaptation cs.CVPDF

Tahar Chettaoui, Guray Ozgur, Eduarda Caldeira, Naser Damer, Fadi Boutros

TL;DR: 本文提出ViT-FREE，一种用于高效人脸识别的训练无关多出口框架，通过利用预训练ViT中间层的稳定表示实现早期退出，以减少推理成本。同时，引入ViT-FREE_FT，一种轻量级微调策略，使用合成数据仅调整投影层以提升浅层出口性能。

Details

Motivation: Vision Transformers在人脸识别中表现出色，但计算成本高，难以部署在资源受限设备上，因此需要平衡效率与准确性的方法。

Result: 在IJB-C等基准测试中，在第10层退出可实现高达20%的加速，验证性能仅下降1.5%；ViT-FREE_FT微调策略能提升浅层出口性能，同时保持效率优势。

Insight: 创新点在于利用ViT块间特征相似性和注意力收敛特性，实现无需修改或重训练主干模型的早期退出；客观分析表明，该方法通过合成数据轻量微调，有效缓解了效率与准确性的权衡问题。

Abstract: Vision Transformers (ViTs) have gained significant attention in computer vision and shown strong potential for face recognition (FR). However, their high computational cost makes deployment on resource-constrained devices challenging, motivating the need for methods that balance efficiency and accuracy. In this work, we investigate early exiting in pretrained ViTs as a simple yet effective training-free strategy for efficient FR inference. Leveraging the uniform feature dimensionality across transformer encoder blocks, we introduce ViT-FREE, a multi-exit framework that enables face verification directly from intermediate representations without modifying or retraining the backbone model, and thus, reducing inference cost. Empirically, we show that patch embeddings and attention maps evolve progressively across depth, exhibiting high similarity between consecutive ViT blocks and increasing alignment with the final representation. This indicates gradual feature refinement and attention convergence, suggesting that intermediate layers already provide stable and discriminative representations suitable for early exiting. Through extensive experiments on multiple FR benchmarks, we systematically analyze the accuracy-efficiency trade-off across exit depths. Our results demonstrate that later exits achieve a highly favorable balance, with exiting at layer 10 yielding up to a 20% speedup while incurring only a 1.5 drop in verification performance on benchmarks such as IJB-C. Also, we propose ViT-FREE_FT, a lightweight exit-specific fine-tuning strategy that adapts only the projection layers using a small synthetic dataset while keeping the transformer backbone frozen. This approach improves the performance of shallow exits while preserving the efficiency benefits and leaving deeper exits largely unaffected.

[80] FitVTON: Fit-aware Virtual Try-On via Body-Garment Size Control cs.CVPDF

Yiqun Ning, Ao Shen, Chenhang He, Lei Zhang

TL;DR: FitVTON是一种基于扩散模型的虚拟试穿方法，专注于在多样化体型上实现真实、符合物理尺寸的服装合身效果，而不仅仅是纹理保持。它通过结构化文本提示编码服装-身体尺寸，并利用参数化服装模型生成的模拟数据进行训练。该方法还引入了辅助头部预测服装和暴露身体的掩码，以及一个纹理校正阶段来提升真实感。

Details

Motivation: 现有基于扩散的虚拟试穿方法大多将其视为2D修复任务，优先考虑纹理保持，但忽略了物理合理性，导致生成的图像在不同体型上无法反映真实的服装合身度。

Result: 在构建的真实世界数据集FittingEffect3K上，主观和定量实验表明，FitVTON在尺寸准确性和形状保持方面显著优于现有最先进方法，同时保持了有竞争力的图像质量。

Insight: 核心创新在于将服装合身度（fit-aware）作为关键优化目标，通过结构化文本提示控制尺寸、利用参数化模型生成模拟训练数据，并引入掩码预测和纹理校正来提升物理合理性与视觉质量。这为虚拟试穿从纯视觉合成转向物理可信合成提供了新思路。

Abstract: While diffusion-based virtual try-on has achieved impressive visual realism, most methods treat the task as 2D inpainting, prioritizing texture preservation over physical plausibility. Consequently, they often produce plausible-looking images that fail to reflect authentic garment fit across diverse body shapes. We present FitVTON, a Fit-aware virtual try-on model on different bodies in the wild. FitVTON encodes garment-body size through structured text prompts, and learn from simulated try-on triplets from parameterized garment model. To improve the fitting effects over garment silhouettes, we introduce two auxiliary head to predict the masks for both the garment and the exposed body. We further introduce a texture rectification stage to improve realistic appearance from simulated data. To evaluate the fitting fidelity, we curate a real-world dataset, FittingEffect3K, combining VLM-based scoring protocol. Both subjective and quantitive experiments show that FitVTON demonstrate authentic fitting fidelity, with significant sizing accuracy and shape preservation over state-of-the-art methods while maintaining competitive image quality. Project Page: https://zenoning.github.io/FitVTON/.

[81] SpikeTAD: Spiking Neural Networks for End-to-End Temporal Action Detection cs.CVPDF

Min Yang, Mi Zhou, Limin Wang

TL;DR: 该论文提出了首个基于脉冲神经网络（SNN）的端到端时序动作检测（TAD）架构SpikeTAD。该模型旨在解决现有视频理解模型因体积大、功耗高而难以在移动设备上部署的问题，通过在THUMOS14和ActivityNet-1.3基准上取得有竞争力的性能，证明了低功耗TAD模型的可行性。

Details

Motivation: 现有视频理解模型（如基于人工神经网络ANN的模型）存在模型体积大、功耗高的问题，难以部署在日益普及的移动设备上。脉冲神经网络（SNN）具有生物合理性和低功耗优势，尤其适合未来的神经形态芯片，但其应用受到转换时间步过长和性能下降问题的限制。

Result: SpikeTAD在THUMOS14数据集上实现了67.2%的平均mAP，在ActivityNet-1.3数据集上实现了37.42%的平均mAP，同时保持了极低的功耗，展示了其在时序动作检测任务上的有效性。

Insight: 论文的主要创新点是首次将SNN应用于端到端的时序动作检测任务，构建了SpikeTAD架构，在显著降低功耗的同时，缓解了SNN应用中常见的性能下降问题，为在移动设备上部署高效视频理解模型提供了新思路。

Abstract: Video understanding is a crucial part of computer vision, with numerous application scenarios. With the increasing popularity of mobile devices, an increasing number of efforts are trying to deploy video understanding models on them. However, existing video understanding models are difficult to deploy due to their large size and prohibitive power consumption. Spiking Neural Networks (SNNs) have shown bioplausibility and low power advantages over Artificial Neural Networks (ANNs), especially on neuromorphic chips which are regarded as essential components of future mobile devices. However, excessively long conversion time-steps and severe performance degradation problems limit their application. To solve the problems above, we explore the application of SNNs on temporal action detection (TAD), which is an important task in video understanding, and propose the first SNN-based end-to-end TAD architecture coined as SpikeTAD. While maintaining extremely low power consumption, SpikeTAD achieves an average mAP of 67.2% in THUMOS14 and 37.42% in ActivityNet-1.3, demonstrating the feasibility of a low-power TAD model. Our code is available at https://github.com/MCG-NJU/SpikeTAD.

[82] Vision Transformers for Face Recognition Need More Registers cs.CVPDF

Tahar Chettaoui, Guray Ozgur, Eduarda Caldeira, Naser Damer, Fadi Boutros

TL;DR: 本文针对基于Vision Transformers的人脸识别方法，指出当前流行的拼接补丁嵌入（CPE）范式虽然性能优于传统的CLS-token范式，但其注意力图存在伪影，影响了可解释性。为此，论文提出引入可学习的寄存器令牌（register tokens）来缓解这一问题，并构建了ViT-8R模型，在保持高性能的同时显著提升了注意力图的结构清晰度和可解释性。

Details

Motivation: 基于拼接补丁嵌入（CPE）的ViT人脸识别模型虽然性能优于CLS-token范式，但其生成的注意力图存在伪影，限制了模型的可解释性。论文旨在解决这一问题，提升ViT在FR任务中注意力机制的可解释性。

Result: 在大型基准IJB-B和IJB-C上，提出的ViT-8R模型（基于ViT-B架构并添加8个寄存器令牌）达到了基于ViT的人脸识别模型的SOTA性能。添加8个寄存器令牌能获得最高的验证精度和最平滑的注意力结构。

Insight: 创新点在于将寄存器令牌机制引入基于CPE的ViT人脸识别框架，这不仅能有效减轻注意力图中的伪影、提升可解释性，还能同时提高模型性能。这为改进ViT的表示学习与可解释性提供了一种简单有效的技术路径。

Abstract: Recent advances in Vision Transformers (ViTs) for face recognition (FR) have moved beyond the standard CLS-token paradigm. In this paradigm, a special classification token (CLS) is prepended to the patch embeddings and used as a representation of the input for downstream tasks. An alternative approach, Concatenated Patch Embeddings (CPE), instead leverages all patch tokens by concatenating them into a single vector, which is then projected into a compact face representation. CPE has been shown to improve recognition performance in comparison to CLS-based ones, but our qualitative analysis of attention maps showed the presence of artifacts that limit their interpretability. To address this issue, we incorporate register tokens, learnable tokens concatenated to the initial patch embeddings, and processed jointly through the ViT encoder blocks. This mechanism has been shown to produce more structured and interpretable attention maps compared to baseline ViT. We empirically demonstrate that these artifacts consistently appear across various ViT backbones, including small and large models, and that introducing register tokens effectively mitigates them. Adding four or eight registers significantly enhances interpretability, with eight registers providing the highest verification accuracies and smoothest attention structures. Our resulting model, ViT-8R, corresponds to a CPE-based ViT-B architecture augmented with eight register tokens achieves state-of-the-art performance among ViT-based FR models on large-scale IJB-B and IJB-C benchmarks. Also, ViT-8R produces substantially clearer attention maps compared with the baseline model, which offer deeper insight into the model’s attention behavior (https://github.com/TaharChettaoui/ViT-FR-Registers)

[83] Metadata-Aware Multi-Prompt Reasoning for Zero-Shot Accident Understanding cs.CV | cs.AI | stat.MLPDF

Tarandeep Singh, Soumyanetra Pal, Soham Biswas, Nishanth Chandran

TL;DR: 本文提出了一种用于零样本事故理解的三阶段方法，通过分解为‘何时’、‘何物’和‘何地’三个子任务，利用视觉语言模型进行推理。该方法首先定位事故发生的时间窗口，然后通过元数据驱动的多提示推理进行语义分类，最后使用开放词汇检测器进行空间定位。

Details

Motivation: 解决从监控视频中零样本理解事故的问题，即无需特定训练数据，仅使用自然语言来识别事故的发生时间、类型和位置。

Result: 在零样本ACCIDENT @ CVPR基准测试中，该方法在调和平均分数上相比帧中心基线有显著提升。

Insight: 将零样本视频理解分解为时序定位、语义分类和空间定位三个子任务，比直接提示更可靠；创新性地使用元数据驱动的多提示推理（包含五个互补视角）和熵门控成对裁决器来解决分歧，并通过分数加权质心聚合跨关键帧的检测结果。

Abstract: In this paper, we address the problem of zero-shot understanding of accidents from surveillance videos by identifying when an impact event occurs, what type of impact it is, and where in the frame it occurs using natural language. We propose a three-stage pipeline that decomposes the accident understanding into when, what, and where. The first stage extracts a short temporal window around the impact using vision-language similarity. In the second stage, we perform metadata-driven multi-prompt reasoning with five complementary views (baseline, motion, geometry, contrast, and tiebreaker) and resolve disagreement via an entropy-gated pairwise adjudicator. Finally, we localize the impact of an open-vocabulary detector queried on the predicted accident type and scene layout, and aggregate detections across keyframes using a score-weighted centroid. Our pipeline achieves a substantial improvement in the harmonic-mean score over a centre-of-frame baseline on the zero-shot ACCIDENT @ CVPR benchmark. We show that decomposing zero-shot video understanding into temporal localization, semantic classification, and spatial grounding enable more reliable reasoning with vision-language models than direct prompting alone.

[84] Tac-DINO: Learning Vision-Tactile Features with Patch Alignment cs.CVPDF

Hong Li, Yankang Dong, Yue Xu, Yihan Tang, Mingzhu Li

TL;DR: 该论文提出了Tac-DINO方法，通过构建大规模触觉数据集和视觉-触觉全息匹配基准，研究视觉与触觉信号的局部到全局对齐能力，并设计了视觉-触觉补丁对齐方法进行表征学习。

Details

Motivation: 触觉是人类与环境交互的主要方式，但现有触觉学习主要关注图像级预训练或对齐，缺乏对尺度对齐和全息匹配的研究，且缺少合适的数据集和基准。

Result: 实验表明，所提出的视觉-触觉补丁对齐方法在性能上超过了未对齐的方法，并与整体对象图像对齐方法相当，在构建的Vis-Tac Holographic Matching Benchmark上进行了评估。

Insight: 创新点包括构建大规模触觉数据集（包含505个真实物体的超过20K个触觉接触）、设计视觉-触觉全息匹配基准，以及提出视觉-触觉补丁对齐方法，专注于局部到全局的对齐学习，弥补了现有研究的不足。

Abstract: Touch is the primary medium through which humans interact with the environment. Currently, tactile learning mainly focuses on image-level pretraining or alignment. However, tactile signals correspond to local object contact, while research into scale alignment and holographic matching remains limited and proper datasets and benchmarks also lack. To bridge this gap, we first construct a data collection system to acquire a large-scale tactile dataset, with over 20 K tactile contacts from 505 real-world objects. Building on this dataset, we design a Vis-Tac Holographic Matching Benchmark to evaluate vision-tactile local-to-global alignment ability. Then we propose Vision-Tactile Patch Alignment (VTPA) methods for vision-tactile representation learning. Experiments demonstrate that these exceed the performance of methods without alignment and align with whole-object images.

[85] World Model Self-Distillation: Training World Models to Solve General Tasks cs.CVPDF

Sebastian Stapf, Pablo Acuaviva Huertos, Aram Davtyan, Paolo Favaro

TL;DR: 本文提出了一种名为世界模型自蒸馏（World Model Self-Distillation）的可扩展框架，旨在提升预训练视频生成模型（作为视觉世界模型）的任务解决能力，而无需依赖昂贵的配对任务执行视频数据。该方法结合了自蒸馏与强化学习，利用视觉语言模型（VLM）生成候选任务和解决方案，指导一个演示者（Demonstrator）视频扩散模型生成视频，并将其执行知识蒸馏到一个仅需图像和简短任务提示的执行者（Executor）模型中。

Details

Motivation: 预训练视频生成器作为视觉世界模型展现出任务解决能力，但其严重依赖详细的文本描述，限制了其在规划和决策中的直接应用。现有方法要么依赖语言或视觉语言模型进行推理，要么需要成本高昂且难以扩展的配对任务执行视频进行监督微调。

Result: 在提出的WorldTasks-Benchmark和DreamGen机器人基准测试中，执行者模型在基于VLM的评估协议下超越了演示者模型，并且在机器人任务上表现出有竞争力的迁移能力。

Insight: 核心创新点在于通过自蒸馏将基于详细描述的生成能力迁移到仅需简短指令的任务解决能力，避免了昂贵的监督数据。同时，利用VLM反馈进行强化学习，巧妙地利用了“判断视频是否满足任务”与“生成解决方案”之间的不对称性，进一步提升了模型性能。

Abstract: Pretrained video generators are promising visual world models that exhibit emergent task-solving abilities; however, their reliance on detailed textual descriptions limits their direct use for planning and decision-making. Existing approaches either outsource this reasoning to language or vision-language models, or rely on supervised fine-tuning with paired task-execution videos, which are costly to collect and difficult to scale. We propose a scalable framework that elicits task-solving ability in such models by combining self-distillation with reinforcement learning. Given an unlabeled scene image, a vision-language model generates a candidate task and a detailed step-by-step solution. The solution conditions a pretrained video diffusion model, the Demonstrator; we distill its behavior into an Executor conditioned only on the image and a short task prompt. This transfers execution knowledge from caption-guided generation to instruction-conditioned task solving without curated task-video supervision. We further improve the Executor with reinforcement learning from VLM feedback, exploiting the asymmetry between judging whether a sampled video satisfies a task and generating the solution. Experiments on our proposed WorldTasks-Benchmark and the DreamGen robotics benchmark show that the Executor surpasses the Demonstrator under our VLM-based evaluation protocol and transfers competitively to robotic tasks.

[86] Q-Fold: Query-Aware Focus-Context Spatio-Temporal Folding for Long Video Understanding cs.CVPDF

Biao Tang, Xu Chen, Shuxiang Gou, Jingyi Yuan, Yuhan Zhang

TL;DR: 本文提出Q-Fold，一种无需训练的输入构建框架，用于解决多模态大语言模型在长视频理解中面临的挑战。该方法通过查询引导，将连续时间片段构建为异质的Focus-Context表示，将相关片段保留为高保真焦点帧，将不相关片段折叠为保持时序的上下文布局，从而在有限视觉预算内平衡视觉保真度和时间覆盖范围。

Details

Motivation: 现有长视频理解方法通常在有限视觉预算下构建紧凑视觉输入，但大多仍遵循以帧为中心的范式，对保留内容采用相似表示，难以同时保持高保真视觉证据和广泛的时间覆盖。

Result: 在四个长视频基准测试和多个视频MLLM上的实验表明，Q-Fold在不增加输入预算的情况下持续提升性能，在超长视频基准上最高获得9.1个百分点的增益。

Insight: 创新点在于将建模单元从孤立帧转向连续时间片段，并引入查询引导的异质Focus-Context表示；从客观角度看，其通过动态折叠机制在固定计算成本下优化信息保留的策略具有借鉴意义。

Abstract: Long-video understanding remains challenging for multimodal large language models, because temporally extended videos often contain thousands of frames and are therefore expensive to process exhaustively. Existing methods usually construct compact visual inputs from long videos under a limited visual budget. However, most of them still follow a frame-centric paradigm and apply similar representations to retained content regardless of its importance. This makes it difficult to preserve both high-fidelity visual evidence and broad temporal coverage. To address this issue, we propose Q-Fold, a training-free input construction framework for long-video understanding. Instead of treating isolated frames as the basic modeling unit, Q-Fold operates on contiguous temporal segments and constructs a heterogeneous Focus–Context representation under query guidance. Query-relevant segments are preserved as high-fidelity Focus Frames, while less relevant segments are folded into chronology-preserving contextual layouts. In this way, Q-Fold preserves critical visual evidence and broad temporal coverage, while better maintaining local temporal continuity within short segments. Experiments on four long-video benchmarks with multiple Video-MLLMs show that Q-Fold consistently improves performance without increasing the input budget. Notably, it achieves gains of up to 9.1 percentage points on an ultra-long video benchmark. Code will be made publicly available.

Litao Li, Yibo Yu, Yufeng Hu, Zhuo Yang, Jiali Wen

TL;DR: 本文提出了MSUE（多模态足球理解专家）系统，作为2026年SoccerNet VQA挑战赛的解决方案。该系统首先利用视觉语言模型（VLM）构建了一个高效的数据合成流程，将原始领域数据重构为多样化的视觉问答（VQA）样本。其次，它设计了一个多专家问答架构，通过大型语言模型（LLM）动态地将问题分配给文本、图像和视频专家（分别基于Gemini3-Flash、微调的Qwen3-VL和外部知识库），以协同提升VQA性能。

Details

Motivation: 旨在解决足球领域多模态视觉问答（VQA）任务中，如何有效整合文本、图像和视频信息以准确回答复杂问题。

Result: 在SoccerNet VQA挑战赛基准测试中，MSUE达到了0.95的准确率，在排行榜上获得了第三名。

Insight: 创新点在于：1）利用VLM驱动构建低成本、多样化的领域特定VQA数据合成流程；2）提出一个由LLM协调的动态多专家（文本、图像、视频/知识）协作架构，灵活处理不同模态的问题。这为领域特定的多模态理解任务提供了一种可扩展的框架设计思路。

Abstract: This paper presents our solution to the 2026 SoccerNet VQA Challenge. We first develop a cost-effective data synthesis pipeline driven by a Vision-Language Model (VLM), which systematically restructures raw domain data into diverse VQA samples, including concise answers and long-form responses. Second, we propose MSUE, a multi-expert question answering architecture that employs a Large Language Model (LLM) to dynamically dispatch questions to text, image, and video experts. These experts are instantiated as a strong text baseline Gemini3-Flash, a fine-tuned Qwen3-VL, and an external knowledge base, respectively, working collaboratively to enhance VQA performance. MSUE achieves an accuracy of \textbf{0.95} on the challenge benchmark, securing third place in the leaderboard.

[88] ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generation cs.CVPDF

Junlin Hao, Haoshuai Fu, Xibin Song, Wei Li, Ruigang Yang

TL;DR: ISAP-3D提出了一种身份-槽位对齐的部件感知3D生成框架，旨在解决现有方法因身份与布局纠缠导致的结构模糊性问题。该方法通过语义身份令牌锚定每个部件，执行身份条件的一对一布局预测，再进行布局条件的几何合成，从而在语义、空间和几何阶段保持身份对齐。

Details

Motivation: 现有部件感知3D生成方法存在结构模糊性，源于身份-槽位的排列自由度，导致部件分配不稳定（如槽位交换或部件合并）。论文旨在通过显式的身份-槽位对齐，建立语义部件与生成槽位之间可识别的一一对应关系，以实现稳定的结构化生成。

Result: 在部件感知生成基准上的大量实验表明，该方法在结构稳定性、可控性和鲁棒性方面优于当前最先进的基线模型。

Insight: 核心创新点是提出了身份对齐的一对一槽位建模思想，通过结构化局部-全局条件机制，将语义身份、空间布局和几何生成阶段统一对齐。此外，构建具有统一语义协议的部件级数据集，为实现可学习且一致的身份-槽位对齐提供了关键支持。

Abstract: Part-aware 3D generation aims to synthesize structured objects with semantically meaningful components, yet often suffers from structural ambiguity due to identity-layout entanglement. Existing methods either infer part identity and spatial layout implicitly, which can lead to unstable part allocation (e.g., slot swapping or part merging), or rely on strong layout conditions that are difficult to obtain in practice. We attribute this ambiguity to identity-slot permutation freedom: without explicit identity-slot alignment, the correspondence between semantic parts and generation slots is not identifiable during training, allowing multiple slot assignments to fit the same supervision and leading to inconsistent decomposition. Based on this insight, we argue that stable part-aware generation requires identity-aligned one-to-one slot modelling. We therefore propose an identity-slot aligned framework, ISAP-3D, which anchors each part with semantic identity tokens and performs identity-conditioned one-to-one layout prediction, followed by layout-conditioned geometry synthesis. Structured local-global conditioning maintains identity alignment across semantic, spatial, and geometric stages. We also construct a part-level dataset with a unified semantic protocol to enable learnable and consistent identity-slot alignment. Extensive experiments demonstrate improved structural stability, controllability, and robustness over state-of-the-art part-aware generation baselines.

[89] AGE-MIL: Anchor-Guided Evidence Learning for Patient-Level Prediction cs.CVPDF

Jiawei Niu, Jian Chen, Di Zhang, Junbo Lu, Zhangcheng Liao

TL;DR: 本文提出了一种名为AGE-MIL的弱监督框架，用于解决计算病理学中患者级别预测的问题。该方法通过构建患者级别的锚点来捕获全局病理学背景，并引导检索和整合诊断相关的局部图像块，将患者风险建模为证据积累过程，从而在弱监督下实现稳定优化。

Details

Motivation: 现有计算病理学方法主要基于单张全切片图像（WSI）级别的多实例学习（MIL），而患者级别建模探索不足。临床实践中，病理学家通过整合多张WSI的证据得出结论，直接将患者级别监督应用于传统MIL框架会导致优化不稳定和预测可靠性下降。

Result: 该方法在两个独立队列的六个临床相关患者级别预测任务上进行了评估。实验结果表明，AGE-MIL在性能上持续优于八种最先进的（SOTA）MIL方法。

Insight: 创新点在于引入了患者级别的锚点来引导局部证据的检索与整合，并将患者风险建模为一个证据积累过程，这为弱监督下的患者级别建模提供了更稳定和鲁棒的优化框架。

Abstract: Existing computational pathology methods predominantly operate within whole-slide image (WSI)-level multiple instance learning (MIL) paradigms, while patient-level modeling remains underexplored. In routine pathological practice, however, pathologists derive diagnostic and prognostic conclusions by integrating evidence across multiple WSIs rather than relying on any single slide. This discrepancy creates a fundamental misalignment when patient-level supervision is directly imposed on conventional MIL frameworks, often leading to unstable optimization and degraded predictive reliability. To address this issue, we propose Anchor-Guided Evidence MIL (AGE-MIL), a weakly supervised framework for patient-level prediction. AGE-MIL constructs a patient-level anchor from slide representations to capture global pathological context and guide the retrieval and integration of diagnostically relevant local patches, enabling robust patient-level modeling. Patient-level risk is further modeled as an evidence accumulation process, promoting stable optimization under weak supervision. AGE-MIL is evaluated on six clinically relevant patient-level prediction tasks from two independent cohorts. Experimental results show that the proposed framework consistently outperforms eight state-of-the-art MIL methods. Code is available at https://github.com/wodeniua/AGE-MIL.

[90] TopoCap: Learning Topology-Agnostic Motion Priors for Monocular Video-to-Animation cs.CV | cs.GRPDF

Cheng-Feng Pu, Jia-Peng Zhang, Meng-Hao Guo, Yan-Pei Cao, Shi-Min Hu

TL;DR: TopoCap是一个统一的框架，能够从单目视频中提取运动，并将其重定向到具有任意、未见过的骨骼拓扑结构（如从双足动物到六足动物和无生命物体）的角色上，无需测试时优化。其核心是通过两阶段生成流程实现：首先学习一个通用运动流形，将异构运动链压缩为共享的固定长度潜在编码；然后将视频到动画视为条件流匹配问题，从视觉特征预测这些与拓扑无关的编码。

Details

Motivation: 当前运动捕捉方法存在局限性，要么局限于特定物种模板（如SMPL），要么需要大量人工绑定，而生成式3D资产的爆炸式增长对动画制作提出了巨大需求，因此需要一种能够处理任意骨骼拓扑的通用运动提取和重定向框架。

Result: 在人类和四足动物基准测试中，TopoCap超越了专用模型，同时能够对长尾3D生物实现零样本重定向。实验使用了新构建的大规模数据集Mobjaverse，该数据集包含超过5000种独特骨骼拓扑和200万帧数据，结构多样性超过现有数据集两个数量级。

Insight: 关键创新在于将运动物理视为连续低维流形，与离散组合的骨骼结构解耦，通过图CVAE学习通用运动流形，并结合条件流匹配实现拓扑无关的运动编码预测；此外，构建的大规模多样化数据集Mobjaverse为学习广义先验提供了重要支撑。

Abstract: The explosion of generative 3D assets has created a massive demand for animation, yet current motion capture methods remain brittle, restricted to species-specific templates (e.g., SMPL) or requiring labor-intensive manual rigging. We introduce TopoCap, the first unified framework capable of extracting motion from monocular video and retargeting it onto characters with arbitrary, unseen skeletal topologies, i.e., from bipeds to hexapods and inanimate objects, without test-time optimization. Our key insight is that while skeletal structures are combinatorial and discrete, the underlying physics of motion occupy a continuous, low-dimensional manifold. We materialize this insight via a two-stage generative pipeline. First, we learn a Universal Motion Manifold using a Graph CVAE that compresses heterogeneous kinematic chains into a shared, fixed-length latent code. By explicitly conditioning the decoder on a structural embedding of the target rig, we disentangle motion dynamics from skeletal topology. Second, we treat video-to-animation as a conditional flow matching problem, predicting these topology-agnostic codes from visual features. To learn this generalized prior, we introduce Mobjaverse, a massive-scale dataset curated from Objaverse-XL. Comprising over 5,000 unique skeletal topologies and 2 million frames, it exceeds the structural diversity of existing datasets by two orders of magnitude. Extensive experiments demonstrate that \MethodMotion outperforms specialist models on human and quadruped benchmarks while enabling zero-shot retargeting for the long tail of 3D creatures. Dataset is publicly available at https://huggingface.co/datasets/duckduckplz/Mobjaverse.

[91] InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning cs.CVPDF

Ziang Yan, Sheng Xia, Jiashuo Yu, Yue Wu, Tianxiang Jiang

TL;DR: 本文提出了InternVideo3框架，通过多模态上下文推理（MCR）增强基础模型在长时视频任务中的代理能力。MCR将理解视为一个基于共享、演化的上下文（包含观察、指令、推理、工具动作和记忆）的闭环过程，将长视频理解构建为证据积累和验证。为提高效率，引入了多模态多头潜在注意力（M^2LA），这是一种保留完整令牌流的KV缓存状态压缩重参数化方法。

Details

Motivation: 当前开源基础模型的研究主要集中在文本主导场景，而需要持续时序理解和迭代交互的长时程多模态任务（如视频任务）探索不足。

Result: 实验表明，InternVideo3在Video-MME、MLVU和EgoSchema等基准测试上取得了强劲性能。

Insight: 核心创新点是提出了多模态上下文推理（MCR）闭环框架，以及用于高效上下文处理的多模态多头潜在注意力（M^2LA）机制。研究强调了高效上下文处理和闭环推理对于使开放多模态模型适应长时程、视觉基础的代理行为至关重要。

Abstract: Recent progress in foundation models has shifted toward agentic behavior involving multi-step reasoning and tool use. However, open-source efforts largely focus on text-dominant settings, leaving long-horizon multimodal tasks underexplored. This gap is evident in video tasks requiring sustained temporal understanding and iterative interaction. We present InternVideo3, a framework enhancing these capabilities via Multimodal Contextual Reasoning (MCR). MCR treats understanding as a closed-loop process over a shared, evolving context containing observations, instructions, reasoning, tool actions, and memory. This frames long-video understanding as evidence accumulation and verification. To ensure efficiency, we introduce Multimodal Multi-head Latent Attention (M^2LA), a token-preserving reparameterization compressing KV-cache states while retaining the full token stream. Our staged training includes continued pretraining, short-to-long supervised fine-tuning, rule-based reinforcement learning, and on-policy distillation. Experiments show InternVideo3 achieves strong performance on benchmarks like Video-MME, MLVU, and EgoSchema. We further instantiate the model as a video agent with retrieval tools, demonstrating robust evidence-grounded behavior. Our results suggest that efficient context handling and closed-loop reasoning are vital for adapting open multimodal models toward long-horizon visually grounded agency.

[92] OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models cs.CV | cs.AI | cs.CL | cs.LGPDF

Negin Baghbanzadeh, Pritam Sarkar, Michael Colacci, Abeer Badawi, Adibvafa Fallahpour

TL;DR: 本文介绍了OpenMedReason，一个大规模、开放的多模态医学推理数据集，包含约45万个图像-问题-答案实例，其推理轨迹主要源自生物医学领域的人工撰写科学文章。该数据集提供超越合成思维链的高保真监督，涵盖放射扫描、显微图像、可见光照片、图表等多种医学视觉模态。作者还提出了OpenMedReason-Bench基准，用于从感知、医学知识和推理依据三个互补维度对大型视觉语言模型进行细粒度评估。实验表明，使用OpenMedReason进行监督微调和基于强化的对齐训练，能显著提升模型性能。

Details

Motivation: 临床应用中大型视觉语言模型需要基于视觉证据和临床知识进行推理，而不仅仅是给出正确答案。现有方法缺乏高质量、大规模的医学推理监督数据。

Result: 在监督微调中，使用OpenMedReason使VQA准确率平均提升20%，性能达到最强可比规模医学LVLMs的4.2%以内。细粒度分析显示，模型在感知、医学知识和推理依据三个维度上均有提升，其推理轨迹在86.1%的配对比较中优于基础模型。

Insight: 创新点在于构建了首个大规模、基于真实生物医学文献推理轨迹的开放医学多模态数据集，提供了超越合成数据的监督信号。同时提出了一个细粒度评估基准，能够诊断模型在医学推理中的具体能力短板，为医学LVLM的可靠发展提供了重要资源。

Abstract: High-stakes clinical use of large vision-language models (LVLMs) requires reasoning that is grounded in visual evidence and clinical knowledge, not just correct final answers. We introduce OpenMedReason, a large-scale, open multimodal medical reasoning corpus comprising approximately 450K image-question-answer instances whose reasoning traces are primarily derived from curated biomedical, human-authored scientific articles. OpenMedReason provides high-fidelity supervision beyond synthetic chains of thought, covering diverse medical domain vision modalities such as radiological scans, microscopic images, visible light photographs, charts, and others. We complement it with OpenMedReason-Bench, a held-out benchmark that allows fine-grained evaluation of LVLMs along three complementary axes of capability, including perception, medical knowledge, and rationale, enabling diagnostic evaluation beyond final-answer accuracy. OpenMedReason is a rich training resource that exhibits its effectiveness in both supervised fine-tuning (SFT) and reinforcement-based alignment. Training with OpenMedReason yields a 20% average improvement in VQA accuracy over the base model and achieves performance within 4.2% of the strongest comparable-scale medical LVLMs. Fine-grained performance analysis confirms that the gains are not concentrated in any single axis: OpenMedReason improves perception, medical knowledge, and rationale jointly, and its reasoning traces are preferred over those of the base model in 86.1% of pairwise comparisons. We release the code and dataset at huggingface.co/datasets/neginb/OpenMedReason.

[93] MLT-Dedup: Efficient Large-Scale Online Video Deduplication via Multi-Level Representations and Spatial-Temporal Matching cs.CV | cs.IR | cs.LGPDF

David Yuchen Wang, Haoying Li, Hailun Xu, Wei Chee Yew, Zirui Zhu

TL;DR: 本文提出MLT-Dedup，一种用于大规模在线视频去重的高效框架。该框架通过多级视频编码器提取稀疏的片段级嵌入用于高效候选检索，以及细粒度的帧级嵌入用于精确匹配，并结合差分特征增强的相似性模块进行时空匹配与决策。

Details

Motivation: 在线平台用户生成视频的爆炸式增长导致大量近似重复视频出现，这些重复视频损害用户体验并增加存储与带宽成本。现有去重框架在有限索引预算下难以检索到足够的高质量候选视频，且在效率与精度之间存在权衡。

Result: 在真实世界的大规模平台上的大量实验表明，MLT-Dedup在90%的精确度下将在线重复率降低了91%。其稀疏检索设计使索引容量提升了5倍，从而在实际部署中实现了更广泛的候选覆盖。

Insight: 创新点在于提出了结合多级表示（稀疏片段级与细粒度帧级嵌入）与时空匹配的去重框架。其稀疏检索设计显著提升了索引容量，而差分特征增强的相似性模块能定位重复的时序片段，为策略驱动的去重决策提供可靠依据。

Abstract: The explosive growth of user-generated video content on online platforms is accompanied by the emergence of numerous near-duplicate videos–videos that are identical or highly similar but differ by partial edits. These duplicates degrade user experience and increase storage and bandwidth costs, making large-scale video deduplication a critical task. Existing video deduplication frameworks face a fundamental challenge in retrieving sufficient high-quality candidates under a limited index budget, as well as trade-offs between efficiency and precision. To address these issues, we propose MLT-Dedup, an efficient large-scale online video deduplication framework with Multi-Level representations and spatial-Temporal matching. Our approach employs a Multi-Level Video Encoder (ML-VE) to extract both fine-grained frame-level and sparse clip-level embeddings: sparse embeddings support efficient candidate retrieval, while fine-grained embeddings are loaded for precise pairwise matching. During matching, we introduce DiF-SiM, a Differential Feature-enhanced Similarity Module capable of locating duplicated temporal segments and providing reliable similarity evidence to support policy-driven deduplication decisions. Extensive experiments on a real-world large-scale platform demonstrate that MLT-Dedup reduces online repetition rates by 91% at 90% precision. Furthermore, our sparse retrieval design achieves a 5x increase in indexing capacity, enabling broader candidate coverage in real-world deployment.

[94] CellNet – Localizing Cells using Sparse and Noisy Point Annotations cs.CVPDF

Benjamin Eckhardt, Dmytro Fishman, Stuart Fawke, Andrew Curtis, Bo Fussing

TL;DR: 本文提出了一种基于回归的深度学习计算机视觉算法CellNet，用于在相位对比显微镜图像中检测和计数活细胞。该方法仅使用稀疏且带有噪声的点标注来减少标注工作量，并在低数据量场景下展示了其作为零样本方法替代方案的潜力。

Details

Motivation: 大规模饱和基因组编辑筛选等生物研究需要大量重复的细胞计数，基于计算机视觉的自动化对于高通量和资源效率至关重要，而标注工作常成为瓶颈。

Result: 与最先进的零样本方法相比，该方法在低数据量情况下显示出作为有前景替代方案的潜力，但摘要中未提及具体的定量结果或基准测试。

Insight: 创新点在于专注于使用快速易得的稀疏点标注进行细胞计数，这减少了标注负担；从客观角度看，将回归方法应用于低数据量且标注噪声的场景是一个实用的研究方向。

Abstract: Counting living cells is an important step in many biological research workflows. Our collaborators at the Wellcome Sanger Institute study vital genes in humans via large scale saturation genome editing screening, which requires repeatedly counting cells a great number of times. Computer Vision based automation is crucial for high throughput and resource efficiency. In this work, we develop a regression-based deep learning computer vision algorithm to detect and count cells in phase-contrast microscopy images. To reduce annotation effort, which in practice often becomes a bottleneck, we focus on counting cells only using sparse point annotations, which are fast and easy to acquire. By comparison to state-of-the-art 0-shot methods, we show that regression-based counting is a promising alternative in low data regimes. Through developing methods to automatically count living cells in microscopy images, we contribute to valuable research on the human genome. The code is available at https://github.com/beijn/cellnet.

[95] Adapting Prithvi-EO for Fallow Detection for Food-Water Nexus: ViT-Adapter Necks and Parameter-Efficient Backbone tuning of Geospatial Foundation Model cs.CV | cs.AIPDF

Sk Muhammad Asif, Orhun Aydin

TL;DR: 该论文提出了一种用于休耕地检测的参数高效微调方法，结合了LoRA和混合PEFT方案，并评估了三种不同的ViT-Adapter颈部设计。最佳配置（Lite ViT-Adapter与单阶段检测头）在Diou损失下实现了0.9479的mAP@50，显著提升了检测精度。

Details

Motivation: 休耕地在食品-水关系中至关重要，但USDA Cropland Data Layer中其检测精度较低。现有地理空间基础模型（如Prithvi-EO）的ViT骨干网络仅生成单尺度特征，不适合多尺度目标检测，且全骨干微调计算成本过高。

Result: 在休耕地检测任务中，最佳配置（Lite ViT-Adapter与单阶段头）的mAP@50达到0.9479，比无适配器的基于锚点方法提升25.70%，并优于依赖重塑单步长ViT令牌的方法。

Insight: 创新点包括结合轻量级空间先验融合（ViT-Adapter颈部）和选择性骨干解冻（PEFT），以参数高效的方式增强多尺度特征提取，特别适用于不规则休耕田的定位检测。

Abstract: Understanding spatial distribution of fallow land is important for optimizing the food-water (FW) nexus, given fallowing’s role in crop rotation and water conservation. Fallow is a low accuracy class in USDA Cropland Data Layer (CDL). Geospatial foundation model (GFM), Prithvi-EO has shown strong transferability across computer vision tasks. However, its Vision Transformer (ViT) backbone produces features at a single spatial scale that are ill-suited for the multi-scale features required by object detection heads. Existing approaches synthesise multi-scale pyramids through scaling of single stride tokens, sacrificing spatial heterogeneity, and full backbone fine-tuning is computationally prohibitive for GFMs. We evaluate a fallow detection pipeline combining two parameter-efficient fine tuning (PEFT) schemes: Low-Rank Adaptation (LoRA) and a hybrid PEFT, with three neck designs: pseudo multi-scale, Lite ViT-Adapter, and Full ViT-Adapter. Our best configuration, Lite ViT-Adapter with a one-stage head, achieves a mAP@50 of 0.9479 with the Diou loss, suggesting the effectiveness of center-aware localization for irregular fallow field detection. ViT-Adapter free one-stage detection under LoRA improves the adapter-free anchor-based approach by 6.42%, and the best configuration improves baseline adapter-free anchor-based approach by 25.70%. These results demonstrate that lightweight spatial prior fusion and selective backbone unfreezing enable Prithvi-EO to capture local fallow patterns more effectively, outperforming approaches that rely on reshaped single-stride ViT tokens.

[96] Making Foresight Actionable: Repurposing Representation Alignment in World Action Models cs.CV | cs.AI | cs.ROPDF

Lu Qiu, Yizhuo Li, Yi Chen, Yuying Ge, Yixiao Ge

TL;DR: 本文提出了一种名为AGRA（Action-Grounded Representation Alignment）的目标函数，用于解决世界动作模型（WAMs）中视频生成模型虽然能产生合理的视觉未来预测，但提取的动作却不准确的问题。该方法通过对齐视频扩散模型的中间特征与基础视觉编码器的语义表示，使表示更适用于低级动作控制，从而提升机器人在真实世界操作任务中的性能与泛化能力。

Details

Motivation: 研究发现，世界动作模型中用于视觉重建优化的隐藏状态表示，并未自然地组织成对低级动作控制有用的形式，导致动作解码器无法聚焦于任务相关的交互区域，并对不相关区域的扰动敏感，从而造成视觉预测与动作提取之间的不匹配。

Result: 在真实世界操作任务上的实验表明，AGRA通过引导动作解码器关注正确的交互区域，提高了物体定位精度和可供性理解，并使策略对任务无关区域的扰动更具鲁棒性。与基线世界动作模型相比，AGRA在分布内性能和分布外泛化能力上均取得了一致的提升。

Insight: 核心创新点在于提出了一个动作驱动的表示对齐目标（AGRA），通过正则化世界-动作接口，将视频生成模型的中间特征与基础模型的语义表示对齐，从而弥合了视觉重建表示与动作控制需求之间的鸿沟，这是一种将通用视觉模型的语义知识有效注入到具身智能决策流程中的方法。

Abstract: World Action Models (WAMs) offer a promising route for robot manipulation by using video generation models to model future scene evolution before producing control actions. However, our empirical observations reveal a phenomenon: generating plausible visual futures does not always guarantee the extraction of accurate actions. To diagnose this failure, we conduct action-head attention analysis and causal interventions. We find that the action decoder fails to focus on task-relevant interaction regions and remains sensitive to perturbations in task-irrelevant areas. This reveals a representation mismatch: hidden states optimized for visual reconstruction are not inherently organized in a form useful for low-level action control. In this paper, we propose AGRA, an Action-Grounded Representation Alignment objective that regularizes the world-action interface by aligning intermediate video diffusion features with spatially coherent semantic representations from a foundation visual encoder. We evaluate AGRA on real-world manipulation tasks. Experiments show that AGRA makes world model representations more action-grounded: by focusing the action decoder on the correct interaction regions, it improves object localization accuracy and affordance understanding, and makes the policy more robust to perturbations in task-irrelevant regions. As a result, AGRA consistently improves both in-distribution performance and out-of-distribution generalization over the baseline world action model.

[97] Bridging Day and Night: Unsupervised Cross-Domain Re-Identification with Synergistic Prompt and Prototype Learning cs.CVPDF

Jiyang Xu, Rui Liu, Hang Dai

TL;DR: 本文提出了一种无监督的跨域昼夜行人重识别框架，通过协同提示学习和原型学习来关联白天和夜晚场景中的身份，无需人工标注。该方法采用两阶段训练策略：第一阶段利用视觉语言模型生成实例特定的文本提示，并通过实例级对齐机制将视觉特征与文本提示嵌入统一语义空间；第二阶段构建域特定的原型记忆库，引入域内身份关联模块和跨域原型匹配模块，以增强特征判别性并建立跨域身份对应关系。

Details

Motivation: 解决跨域昼夜行人重识别中因白天和夜晚场景视觉外观差异大而带来的挑战，避免现有全监督方法对昂贵人工标注的依赖以及跨域泛化能力有限的问题。

Result: 在公开基准测试上的大量实验验证了方法的有效性，在无监督设置下，该框架的Rank-1准确率达到了与最先进的全监督方法相当的水平。

Insight: 创新点在于将提示学习和原型学习协同结合，通过实例级对齐和动态偏置适应实现无标注的跨域对齐，并利用域内身份关联和跨域原型匹配模块增强鲁棒性；从客观角度看，该方法有效利用了视觉语言模型的先验知识，并通过两阶段策略逐步优化跨域身份对应，为无监督跨域ReID提供了新思路。

Abstract: Cross-domain day-night re-identification (ReID) is fundamentally challenged by the substantial visual appearance discrepancies between daytime and nighttime scenes. Existing fully supervised methods rely heavily on labor-intensive annotations, which are costly and exhibit limited generalization across domains. In this work, we investigate unsupervised day-night ReID and propose a novel framework that synergistically combines prompt learning and prototype-based representation learning to associate identities across domains without requiring manual labels. Our approach follows a progressive two-stage training strategy. In the first stage, we exploit the vision-language model to generate instance-specific textual prompts in an annotation-free manner. We employ an instance-level alignment mechanism to embed visual features and textual prompts into a unified semantic space, aligning unlabeled day/night images with learnable prompts via instance-aware dynamic-bias adaptation. In the second stage, we construct domain-specific prototype memory banks and introduce two complementary modules: i) an intra-domain identity association module to enhance feature discriminability within each domain, and ii) a cross-domain prototype matching module to reliably identify positive and negative prototype pairs, thereby establishing robust identity correspondences across day and night. Extensive experiments on public benchmarks validate the effectiveness of our method. Under the unsupervised setting, our framework attains Rank-1 accuracy comparable to state-of-the-art fully supervised methods.

[98] Findings of the MAGMaR 2026 Shared Task cs.CV | cs.CL | cs.IRPDF

Alexander Martin, Dengjia Zhang, Joel Brogan, Francis Ferraro, Jeremy Gwinnup

TL;DR: 本文介绍了第二届多模态检索增强生成（MAGMaR）研讨会共享任务的结果。该任务包含视频检索和基于检索视频的文本生成两个子任务。在检索任务中，2个团队提交的17个系统均超越了去年优胜者的基线；在生成任务中，4个团队提交的16个系统均产生了被人工标注为最佳的报告。

Details

Motivation: 该共享任务旨在推动多模态检索增强生成领域的发展，具体聚焦于视频检索以及基于检索到的视频进行文本生成这两个核心挑战。

Result: 在检索任务中，所有17个提交系统均超越了基于去年优胜者建立的基线。在生成任务中，所有4个参与团队都至少有一个生成的报告被人工标注为最佳。

Insight: 共享任务的组织形式有效促进了该领域的技术进步，并设定了可超越的基准。结果表明，当前方法在视频检索和基于视频的文本生成任务上均能取得优于历史最佳模型的性能，且生成质量得到了人工评估的认可。

Abstract: This overview paper presents the results of the shared task for the second workshop on Multimodal Augmented Generation via Multimodal Retrieval (MAGMaR). In this shared task participants submitted systems focused on either (i) video retrieval or (ii) grounded generation of articles given retrieved videos. Teams could submit to either task. For the retrieval task, we had 2 participating teams that submitted a total of 17 systems – all of which beat a baseline derived from the winner of last year’s shared task. On the generation side, we had 4 teams submit 16 systems. All teams had at least one generated report that was labeled the best by a human annotator.

[99] From 2D Grids to 1D Tokens: Reforming Shared Representations for Multimodal Image Fusion cs.CVPDF

Yuchen Xian, Yunqiu Xu, Yang He, Yi Yang

TL;DR: 该论文提出了一种用于多模态图像融合的新方法，将传统的2D特征网格表示与基于预训练图像分词器的1D令牌表示相结合。该方法通过选择性令牌编辑（STE）机制，稀疏地更新关键令牌来引导全局外观一致性，同时保留2D空间路径以恢复局部结构，从而在多个基准测试中实现了最佳的整体性能。

Details

Motivation: 现有方法基于2D特征网格构建共享表示，擅长建模局部结构，但对图像级全局外观因素的利用有限。为了平衡局部细节保留与全局外观一致性这两个目标，需要一种新的表示方法。

Result: 在四个常用基准测试上的实验表明，该方法在全局一致性和局部保真度方面均取得了多指标的持续改进，实现了最佳的整体性能。

Insight: 核心创新点在于引入了一个紧凑的1D令牌接口作为全局载体，并结合了选择性令牌编辑（STE）这一轻量级机制来引导全局外观，同时保持融合主干网络不变。这为多模态融合任务提供了一种新的、平衡全局与局部信息的表示范式。

Abstract: Multimodal image fusion aims to integrate complementary information from different modalities into a fused image that preserves rich local details while maintaining globally consistent appearance. Existing approaches build shared representations on 2D feature grids, which excel at modeling local structures but offer limited leverage over image-level global appearance factors. To balance these objectives, we introduce a compact 1D token interface based on a frozen pretrained image tokenizer for modeling non-local appearance/base factors. Rather than using the tokenizer as a reconstruction backbone, our design uses the 1D token space as a global carrier while retaining the 2D spatial pathway for local structure restoration. Specifically, we introduce Selective Token Editing (STE), which sparsely updates/replaces a small set of critical tokens, providing a lightweight mechanism to steer global appearance coherence while keeping the fusion backbone unchanged and avoiding extra losses. Experiments on four commonly used benchmarks show that our method achieves the best overall performance, with consistent, multi-metric improvements in both global coherence and local fidelity. Project page: https://zju-xyc.github.io/1D-Fusion-Project-Page/

[100] Bridging the Modality Gap in Forensic Image Retrieval cs.CV | eess.IVPDF

Ricardo González-Gazapo, Annette Morales-González, Yoanna Martínez-Díaz, Heydi Méndez-Vázquez, Milton García-Borroto

TL;DR: 本文提出了一种统一的多模态检索框架，用于法证图像检索，涵盖纹身图像查询、专家文本描述引导的纹身检索、手绘草图纹身检索和法证人脸草图检索四个关键任务。该系统利用多模态大语言模型自动生成结构化文本描述，并结合基于句子转换器的文本嵌入与先进的视觉特征提取器，通过多模态融合策略提升检索精度和鲁棒性。

Details

Motivation: 解决现有法证图像检索研究多集中于优化多模态检索系统，而缺乏对其在不同真实场景中法证适用性评估的问题，旨在通过统一框架应对视觉信息受限或嘈杂的挑战性任务。

Result: 在纹身和人脸草图等法证任务上，多模态融合策略相比仅使用视觉或文本嵌入，能持续提高检索精度和鲁棒性，尤其在草图、部分纹身或碎片化证人描述等场景中表现更优。

Insight: 创新点在于利用MLLM自动生成结构化文本描述以桥接模态鸿沟，并通过融合文本与图像相似度得分实现多模态检索，为依赖手动专家分析的传统法证任务提供了自动化解决方案。

Abstract: Automated image retrieval plays an increasingly critical role in modern forensic analysis, supporting investigative workflows that rely on efficient comparison of visual evidence. While prior work has focused primarily on developing and optimizing multimodal retrieval systems, limited attention has been paid to evaluating the forensic applicability of these technologies across diverse real-world scenarios. In this study, we present a unified retrieval framework adapted to four key forensic tasks: (1) tattoo image retrieval given a tattoo query image; (2) tattoo retrieval guided by human-expert textual descriptions, modelling the common situation where a witness verbally describes a tattoo; (3) tattoo retrieval from hand-drawn sketches; and (4) face retrieval from forensic face sketches. Our system leverages a multimodal large language model (MLLM) to automatically generate structured textual descriptions for all queries and gallery images, followed by sentence-transformer embedding for text-based comparison. We evaluate retrieval using visual-only embeddings, text-only embeddings and a multimodal fusion strategy that combines text- and image-based similarity scores derived from state-of-the-art visual feature extractors relevant to each task. The fusion of modalities consistently improves retrieval precision and robustness, especially in scenarios where visual information is limited or noisy (e.g., sketches, partial tattoos, or fragmented witness statements). This work highlights the forensic value of a unified multimodal retrieval pipeline and demonstrates how modern MLLMs can operationalize challenging forensic tasks that traditionally rely on manual expert analysis. Our results position multimodal retrieval as a promising tool for supporting investigative workflows involving tattoos, facial composites, and witness descriptions.

[101] Natural-Language Temporal Grounding in Hour-Long Videos is a Search Problem: A Benchmark and Empirical Decomposition cs.CV | cs.AIPDF

Sukmin Seo, Geewook Kim

TL;DR: 本文研究了在长达数小时的视频中进行自然语言时间定位的问题，认为在长视频尺度下，主要瓶颈是搜索而非识别。为此，作者发布了首个公开的小时级时间定位基准ExtremeWhenBench，并发现现有视频大语言模型（Video-LLMs）在该任务上完全失效，而检索-定位混合方法能显著提升性能。

Details

Motivation: 现有时间定位研究主要集中于短视频，而小时级长视频的自然语言时间定位的动态特性尚未得到充分探索。作者认为，在长视频中，约束因素从识别事件转变为搜索相关视频片段。

Result: 在ExtremeWhenBench基准（包含194个视频，平均时长75.7分钟，最长9小时，共2,273个查询）上，所有公开的Video-LLMs均失效，而帧级检索基线优于它们；失败分类表明85%的失败源于搜索问题；检索-定位混合方法相比单一Video-LLM恢复了6.7倍的性能。

Insight: 论文的核心创新点在于提出了长视频时间定位本质上是搜索问题的新观点，并构建了首个公开的小时级基准来验证。从客观角度看，其将检索-阅读范式（类似开放域问答）引入视频时间定位的混合方法，为解决长视频理解中的搜索瓶颈提供了有效思路。

Abstract: Temporal grounding–returning the interval $[t_s, t_e]$ for a natural-language query over a video–is the language interface to long-form video, yet has been studied on short videos; the dynamics of hour-scale natural-language grounding remain underexplored. We take the position that at hour-scale, the binding constraint is search, not recognition: Video-LLMs are bottlenecked not by localizing a nearby event, but–given a natural-language query–by searching for the relevant region of a long video. To test this, we release ExtremeWhenBench, the first open hour-scale grounding benchmark (2,273 queries over 194 videos, mean 75.7 min, max 9 hr) with an open-form query distribution. Every open Video-LLM collapses while a frame-level retrieval baseline outperforms them; a failure taxonomy attributes 85% of failures to search; and a retrieve-then-ground hybrid recovers 6.7x over the monolithic Video-LLM–mirroring retrieve-then-read in open-domain QA.

Juraj Perić, Marija Habijan, Dario Mužević, Irena Galić, Danilo Babin

TL;DR: 本文提出了一种名为AC2RUNet的解剖学条件循环细化U-Net，用于从磁共振血管造影（MRA）图像中分割具有复杂拓扑结构的Willis环（CoW）。该方法通过解耦的静态流和动态流，结合动态课程学习策略，有效减少了血管断裂等拓扑错误。

Details

Motivation: 标准卷积神经网络（CNN）在分割Willis环时，难以捕捉其复杂的拓扑结构和纤细的血管形态，容易产生血管断裂的伪影，因此需要一种能有效处理拓扑约束的分割方法。

Result: 在TopCoW数据集上的实验表明，AC2RUNet显著降低了Hausdorff距离（4.72 mm vs 9.17 mm）和Betti数误差（0.19 vs 0.40），在拓扑连通性上优于nnU-Net基线，同时保持了相当的体积Dice系数。

Insight: 创新点在于将分割任务解耦为提取不变解剖特征的静态流和迭代细化拓扑错误的轻量级动态流，并引入了从高召回几何监督过渡到拓扑感知约束的动态课程学习策略，从而实现了对拓扑结构的显式建模和优化。

Abstract: Segmenting the Circle of Willis (CoW) from Magnetic Resonance Angiography (MRA) is challenging due to complex topology and thin vascular structures that are prone to fragmentation. Standard Convolutional Neural Networks (CNNs) often fail to capture these topological constraints, resulting in “broken vessel” artifacts. To address this, we propose the Anatomically Conditioned Recurrent Refinement U-Net (AC2RUNet). Our architecture decouples segmentation into two streams: a Static Stream that extracts invariant anatomical features and a lightweight Dynamic Stream that iteratively refines topological errors over time. We further introduce a dynamic curriculum learning strategy that transitions from high-recall geometric supervision to topology-aware constraints. Validated on the TopCoW dataset, AC2RUNet substantially reduces Hausdorff Distance (4.72 mm vs 9.17 mm) and Betti number errors (0.19 vs 0.40), improving topological connectivity over the nnU-Net baseline while maintaining comparable volumetric Dice.

[103] Illumination-Robust Camera-Based Heart-Rate Estimation for Physiological Sensing in Robots cs.CV | cs.AIPDF

Zhi Wei Xu, Torbjörn E. M. Nordling

TL;DR: 本文提出了一种用于机器人远程心率估计的端到端时空Transformer框架，旨在解决光照变化对基于摄像头的非接触式心率监测（rPPG）带来的挑战。该方法整合了3D人脸对齐、光照增强、残差时间标准化模块以及混合时频监督，并在包含不同光照水平的新数据集上进行了评估。

Details

Motivation: 服务、社交和辅助机器人需要生理感知能力，而基于摄像头的远程光电容积描记术（rPPG）是一种有前景的非接触式心率监测方式，但光照变化是其鲁棒部署的主要障碍。

Result: 在覆盖三个光照水平的静态全级别混合协议实验中，当β=5时取得了最佳结果：心率平均绝对误差（MAE）为0.79 bpm，心率相关性为0.982。与PhysFormer基线相比，心率MAE降低了93.6%，相关性从0.088提升至0.982，表明其在光照变化下具有可用性。

Insight: 创新点包括端到端的时空Transformer架构、结合PRNet的3D人脸对齐、残差时间标准化模块以及通过可调权重β控制的混合时频监督损失函数（Soft-Shifted Pearson波形损失与谱KL散度损失），有效提升了光照变化下的心率估计鲁棒性。

Abstract: Physiological awareness is important for service, social, and assistive robots that interact with humans in everyday environments. Remote photoplethysmography (rPPG) enables non-contact heart-rate (HR) estimation from an RGB camera, making it a promising sensing modality for robot-mounted vision systems. However, illumination variation remains a major barrier to robust deployment. This paper presents an end-to-end spatial-temporal transformer framework for remote HR estimation on a new dataset with varied illumination. Our estimator integrates PRNet-based 3D face alignment, clip-level illumination augmentation, the Residual Temporal Standardization Module, and controlled hybrid temporal-frequency supervision. The training objective combines a Soft-Shifted Pearson waveform loss with a spectral Kullback-Leibler divergence loss, where a tuned weight ($\mathbfβ$) controls the contribution of frequency-domain heart-rate guidance. Experiments on a static all-level mix protocol covering three illumination levels show that $\mathbfβ=5$ provides the strongest result among the tested beta settings, achieving a best-run HR mean absolute error (MAE) of 0.79 bpm and an HR correlation of 0.982. Compared with the PhysFormer baseline evaluated on our dataset, our estimator reduces HR MAE by 93.6 %, while increasing HR correlation from 0.088 to 0.982, making it usable when illumination varies.

[104] VLGA: Vision-Language-Geometry-Action Models for Autonomous Driving cs.CV | cs.ROPDF

Jin Yao, Dhruva Dixith Kurra, Tom Lampo, Zezhou Cheng, Danhua Guo

TL;DR: 本文提出了VLGA模型，这是首个通过密集3D世界重建进行监督的视觉-语言-几何-动作模型。VLGA将几何作为第四种模态，通过专门的专家模块和基于LiDAR的逐像素点云回归损失进行训练。在nuScenes和Bench2Drive数据集上的开环和闭环评估实验表明，VLGA在自动驾驶任务中优于现有的VLA方法。

Details

Motivation: 现有的视觉-语言-动作模型虽然能描述和推理场景，但难以将其动作与密集的3D世界进行有效关联。现有方法要么简单地注入冻结的3D基础模型特征而缺乏确保策略使用的监督目标，要么使用稀疏的边界框和地图损失来约束几何，无法提供密集的空间信号。

Result: 在开环nuScenes评估中，VLGA在没有自车状态信息的VLA方法中达到了新的SOTA，取得了最低的L2误差（平均0.50米）和3秒碰撞率（0.18%）。在闭环Bench2Drive评估中，VLGA获得了79.08的驾驶分数，比之前最强的VLA方法高出0.71，同时在效率和舒适性上表现相当。

Insight: 核心创新点在于将几何明确作为第四模态引入VLA框架，并通过密集的逐像素点云回归损失进行监督，这为模型提供了直接且丰富的3D空间信号。这种方法确保了策略能够有效地利用几何信息，从而在自动驾驶任务中实现更精确的动作规划和控制。

Abstract: Vision-language-action (VLA) models can describe scenes and reason about them in language, yet still struggle to ground their actions in the dense 3D world around them. Existing approaches either inject features from a frozen 3D foundation model without an objective that ensures the policy uses them, or constrain geometry with sparse box and map losses that provide no dense spatial signal. We introduce VLGA, the first vision-language-action model supervised to reconstruct the dense 3D world it drives through. VLGA introduces geometry as a fourth modality alongside vision, language, and action through a dedicated expert supervised by a per-pixel pointmap regression loss against LiDAR. Extensive experiments conducted on challenging nuScenes and Bench2Drive datasets for open-loop and closed-loop evaluations, respectively, show the superiority of VLGA over counterpart VLA methods. In particular, on open-loop nuScenes, VLGA sets a new state of the art among VLA methods without ego status, with the lowest L2 (0.50,m average) and 3-second collision rate (0.18%). On closed-loop Bench2Drive, VLGA attains the state-of-the-art driving score of 79.08, +0.71 over the strongest prior VLA, at comparable efficiency and comfort.

[105] Reroute, Don’t Remove: Recoverable Visual Token Routing for Vision-Language Models cs.CV | cs.AIPDF

Cheng-Yu Yang, Shao-Yuan Lo, Yu-Lun Liu

TL;DR: 本文提出了一种名为Reroute的训练免费插件方法，用于改进视觉语言模型（VLMs）中的视觉令牌减少过程。该方法将传统的’排序并永久移除’范式替换为’可恢复的路由’机制，允许被延迟的令牌在后续解码器阶段重新进入候选池，从而在保持计算和内存预算的同时，更好地处理对视觉基础敏感的查询。

Details

Motivation: 现有视觉令牌减少方法通常采用’排序并移除’的范式，永久丢弃低分令牌，但作者发现令牌的重要性会随解码器深度变化，早期被丢弃的令牌可能在后续层变得相关，尤其是在需要视觉基础的任务中，这种不可逆操作是脆弱的。

Result: 在LLaVA-1.5和Qwen骨干网络上，结合FastV、PDrop和Nüwa等变体进行实验，Reroute在激进的令牌减少设置下，提升了视觉基础能力，同时保持了通用视觉问答（VQA）性能。

Insight: 核心创新点在于将视觉令牌减少重新定义为可恢复的路由问题，而非不可逆的剪枝。该方法无需训练，可即插即用，复用了现有注意力评分排序规则和分阶段调度策略，在理论计算量（TFLOPs）和KV缓存预算类别上与所增强的剪枝方法保持一致，为VLM效率优化提供了新视角。

Abstract: Vision-language models (VLMs) project images into hundreds to thousands of visual tokens, making decoder inference expensive in both attention computation and KV-cache memory. Existing visual-token reduction methods largely follow a rank-and-remove paradigm: they score visual tokens, keep a compact subset, and permanently discard the rest. We show that this irreversible action is fragile because visual-token importance changes across decoder depth; tokens ranked low at one stage may become relevant in later layers, especially for grounding-sensitive queries. We propose Reroute, a training-free plug-in that replaces removal with recoverable routing. At each routing stage, selected vision tokens pass through decoder blocks, while deferred tokens bypass the stage and re-enter the candidate pool at the next routing decision. Reroute reuses existing attention-score ranking rules and stage-wise schedules, preserving the theoretical TFLOPs and KV-cache budget class of the pruning method it augments. Across FastV, PDrop, and Nüwa variants on LLaVA-1.5 and Qwen backbones, reroute improves grounding under aggressive token reduction while maintaining general VQA performance. These results suggest that VLM token reduction should not be viewed only as irreversible pruning, but also as recoverable routing. The code can be found here: https://github.com/elmma/mllm-reroute/

eess.AS [Back]

[106] Which Speech Representation Better Matches Text-Native Reasoning? A Study of Speech-Text Alignment on Frame Rate and Representation eess.AS | cs.CL | cs.SDPDF

Zhen Ye, Xu Tan, Yiming Li, Guangyan Zhang, Chimin Chan

TL;DR: 该论文研究了语音对话模型中语音表示与文本推理的匹配问题，指出语音标记的时间冗余性导致语义密度稀释，从而削弱了基于文本的推理能力。通过引入因子化FSQ和轻量级非自回归音频LM头，作者在固定信息率下探索了不同帧率（从50Hz到2.08Hz）和表示对齐深度，发现4.17Hz帧率与中间层表示对齐在语音问答任务中表现最佳。

Details

Motivation: 解决语音对话模型在基于语音而非文本时推理能力下降的问题，归因于语音与文本之间的时间粒度不匹配，即语音标记在语义匹配下比文本更长且冗余，降低了每标记的语义密度。

Result: 在固定信息率的冻结LLM骨干上，通过因子化FSQ和音频LM头实现低帧率（低至2.08Hz），并在语音问答任务中观察到4.17Hz帧率与中间层表示对齐达到最佳性能，但未明确提及是否达到SOTA水平。

Insight: 创新点包括将语音标记设计视为表示选择问题，引入因子化FSQ和轻量级非自回归音频LM头以支持低帧率，并通过系统实验揭示了帧率和对齐深度对语音推理的关键影响，为优化语音-文本对齐提供了新视角。

Abstract: Spoken dialogue models typically start from text LLM backbones, yet reasoning often degrades when conditioning on speech instead of text. We attribute part of this modality gap to a temporal-granularity mismatch: speech tokens are temporally redundant and far longer than text under matched semantics, diluting per-token semantic density and weakening text-native reasoning dynamics. We study speech token design as a representation selection problem and sweep frame rates under a frozen LLM backbone with a fixed information rate. To make low frame rates feasible, we introduce factorized FSQ and a lightweight non-autoregressive audio LM head, scaling capacity to nearly 300,bits/frame without sacrificing efficient prediction. With the bottleneck removed, we sweep frame rates (50$\rightarrow$2.08,Hz) and alignment depth, and observe a consistent best regime for speech QA at 4.17,Hz with intermediate-layer representation alignment.

cs.RO [Back]

[107] DrivingAgent: Design and Scheduling Agents for Autonomous Driving Systems cs.RO | cs.CVPDF

Zhongyu Xia, Wenhao Chen, Yongtao Wang, Ming-Hsuan Yang

TL;DR: 本文提出了DrivingAgent，一个专为自动驾驶系统设计和调度定制的智能体框架。该框架通过自动化模块开发和基于强化学习的轻量级LLM动态调度，解决了自动驾驶系统中模型集成与实时调度的双重挑战。实验表明，DrivingAgent在nuScenes和Bench2Drive基准测试上实现了更优的速度-精度权衡。

Details

Motivation: 针对自动驾驶系统日益依赖基础模型带来的两大挑战：一是手动设计和集成新模型的劳动密集型过程，二是缺乏满足严格实时约束的智能动态调度机制。现有基于LLM的智能体框架不适用于自动驾驶，因为它们未能区分系统设计与实时调度的不同需求，将模块视为黑箱，且不支持连续操作。

Result: 在nuScenes和Bench2Drive基准测试上，DrivingAgent实现了更优的速度-精度权衡，达到了先进的性能水平。

Insight: 创新点在于提出了一个统一的框架，将系统设计（通过解释架构、生成代码和超网络训练验证模块）与实时调度（使用基于强化学习训练的轻量级LLM和结合长期存储与时间戳短期上下文的结构化记忆）解耦并专门优化，从而专门针对自动驾驶的连续、实时操作需求。

Abstract: Many autonomous driving systems are increasingly incorporating foundation models to improve generalization and handle long-tail scenarios. However, this trend introduces two key challenges: (i) the manual and labor-intensive process of designing and integrating new models, and (ii) the lack of intelligent, dynamic scheduling mechanisms to meet strict real-time constraints. While Large Language Model (LLM)-based agents offer a promising avenue for automation, existing frameworks are ill-suited for autonomous driving. Specifically, they fail to distinguish between the fundamentally different requirements of system design and real-time scheduling, treat modules as opaque black boxes, and are not designed for continuous operation. To address these limitations, we propose DrivingAgent, a novel agent framework tailored to the dual challenges of autonomous driving system design and scheduling. In the design phase, DrivingAgent automates module development by interpreting system architecture, generating code, and validating modules via super-network training. In the scheduling phase, it employs a lightweight LLM trained with reinforcement learning to dynamically orchestrate system modules in real time, supported by a structured memory that integrates long-term storage with timestamped short-term context. Experimental results demonstrate that DrivingAgent achieves a superior speed–accuracy trade-off on both the nuScenes and Bench2Drive benchmarks.

[108] DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action model cs.RO | cs.CV | cs.LGPDF

Pankhuri Vanjani, Zhuoyue Li, Jakub Suliga, Moritz Reuss, Gianluca Geraci

TL;DR: 本文提出了DAM-VLA模型，一种解耦的异步多模态视觉-语言-动作模型。该模型针对传统同步VLA模型在处理不同频率模态（如高速触觉与低速视觉）时的不匹配问题，通过为每个模态维护以传感器速率更新的潜在缓冲区，并由动作头持续读取，实现了模态间的异步处理。在七项接触丰富的真实世界操作任务中，该模型将最强同步基线的平均成功率提高了一倍以上，并保持了平滑、反应迅速的100Hz控制。

Details

Motivation: 传统同步VLA模型在处理物理交互时存在根本性错配：它以一个统一的时钟处理所有输入，导致对变化缓慢的模态（如视觉）过采样，对高速模态（如触觉）欠采样，并将动作生成限制在最低有效频率。这限制了在真实世界机器人操作中的表现。

Result: 在七项接触丰富的真实世界操作任务上，DAM-VLA的平均成功率达到了95.2%，而最强的同步基线仅为40.95%，实现了超过一倍的性能提升。模型同时保持了平滑、反应迅速的100Hz控制频率。

Insight: 核心创新在于将多模态处理从同步时钟解耦，允许每个模态以其自身的传感器速率更新和保留信息。具体实现上，通过维护模态特定的潜在缓冲区和采用门控交叉注意力机制来整合高频新模态，同时保持预训练主干网络不变，这为构建更鲁棒、反应更快的具身智能体提供了新思路。

Abstract: Vision-language-action (VLA) models inherit a shared synchronous clock from vision-language pretraining, processing every input at one rate. This is misaligned with physical interaction, where a high-frequency modality changes at hundreds of hertz, vision evolves more slowly, and language stays constant across an episode. A synchronous VLA oversamples slow modalities, undersamples fast ones, and caps action generation at the lowest effective frequency. We hypothesize that decoupling temporal processing per modality, letting each update and retain information at its own sensor rate, yields stronger representations and more robust control. We present DAM-VLA, which maintains per-modality latent buffers refreshed at sensor rates and read continuously by the action head, integrating new high-frequency modalities through gated cross-attention that leaves the pretrained backbone intact. Across seven contact-rich real-world manipulation tasks, DAM-VLA more than doubles the average success rate of the strongest synchronous baseline (95.2% vs.\ 40.95%) while sustaining smooth, reactive 100,Hz control. Project website: \href{https://intuitive-robots.github.io/DAM-VLA/}{intuitive-robots.github.io/DAM-VLA/}

[109] Semantically-Aware Diver Activity Recognition Framework for Effective Underwater Multi-Human-Robot Collaboration cs.RO | cs.CVPDF

Sadman Sakib Enan, Junaed Sattar

TL;DR: 本文提出了一种名为DAR-Net的新型基于Transformer的框架，用于分析复杂水下场景以对潜水员活动进行分类。该框架采用语义引导的学习方法，将基于Transformer的时间推理与像素级场景监督相结合，以解决水下多人类-机器人协作中的活动识别问题。此外，研究还首次构建了包含超过2600张带像素级标注图像的Underwater Diver Activity (UDA)数据集，以应对该领域数据稀缺的挑战。

Details

Motivation: 为了实现自主水下航行器（AUVs）成为真正的协作伙伴，它们需要理解周围环境并识别潜水员的活动，以提供协助并确保安全，尤其是在具有挑战性和高风险的水下环境中。

Result: 在受控环境中的严格实验评估表明，DAR-Net在识别六种不同的潜水员活动方面取得了有前景的准确率，并且性能优于现有最先进的模型。

Insight: 论文的创新点在于提出了一种语义引导的多损失训练策略，该策略明确地将全局活动识别与局部人机交互语义对齐，这对于低能见度水下条件尤为重要。同时，构建首个UDA数据集为未来研究提供了重要的基准和基础资源。

Abstract: Effective multi-human-robot collaboration is essential for expanding human-led operations in the challenging and high-risk underwater environment. For autonomous underwater vehicles (AUVs) to become true teammates, they must be able to comprehend their surroundings and recognize a diver’s activities to offer assistance and ensure safety. Towards this goal, we introduce DAR-Net, a novel transformer-based framework that analyzes complex underwater scenes to classify diver activities. Our contribution lies in a semantically guided learning formulation that couples transformer-based temporal reasoning with pixel-level scene supervision. This multi-loss training strategy explicitly aligns global activity recognition with local human-robot interaction semantics, which is particularly critical in low-visibility underwater conditions. To address the significant challenge of data scarcity in this domain, we present the first-ever Underwater Diver Activity (UDA) dataset, a foundational resource containing over 2,600 annotated images with pixel-level masks. Through rigorous experimental evaluations in a controlled environment, we demonstrate that DAR-Net achieves promising accuracy in recognizing six distinct diver activities, outperforming state-of-the-art models. While this dataset provides a crucial baseline, our work serves as a pioneering step, laying the groundwork for future research and facilitating the development of more intelligent, collaborative underwater robotic systems.

[110] DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners? cs.RO | cs.AI | cs.CVPDF

Jadelynn Dao, Milan Ganai, Yasmina Abukhadra, Ajay Sridhar, Mozhgan Nasr Azadani

TL;DR: 本文提出了DIRECT框架，旨在优化具身智能体规划中视觉语言模型（VLM）的测试时计算资源分配。研究发现，简单地增加测试时计算（如思维链深度、模型规模、记忆历史）会带来不均衡的收益和显著的成本增加。DIRECT通过多模态场景上下文动态分配计算资源，在VLABench和RoboMME基准测试以及真实Franka机械臂的零样本操作和长视野任务链实验中，实现了更好的成功率-成本帕累托前沿。

Details

Motivation: 当前部署VLM作为高级规划器时，普遍采用增加测试时计算（如扩展思维链）来提升能力，但这会导致延迟、token使用量和计算量大幅增加，而下游任务成功率提升却不均衡甚至收益递减，限制了具身智能体的实际部署。因此，需要一种智能方法来决定何时、在何处投入测试时计算资源。

Result: 在VLABench和RoboMME基准测试中，DIRECT框架相比固定模型选择，显著改善了成功率与成本的帕累托前沿。在真实机器人（Franka机械臂）的DROID设置中，其路由器在平均延迟降低高达65%的情况下，匹配甚至超过了更强模型的成功率。

Insight: 主要创新点是提出了一个基于多模态场景上下文的路由框架（DIRECT），能够动态、按需地为每个提示分配测试时计算资源，而非盲目统一扩展。客观分析认为，其核心洞察在于揭示了不同计算扩展轴（深度、规模、历史）带来的能力增益性质不同，这为高效、低成本地实现前沿水平的具身规划提供了新思路。

Abstract: Vision-Language Models (VLMs) are increasingly deployed as high-level planners for embodied agents, with an emerging strategy of scaling test-time compute to improve capability. However, we observe that doing so increases latency, token usage, and FLOPs while yielding uneven, often diminishing gains in downstream success, limiting where embodied agents can be deployed. We argue that choosing when and where to spend test-time compute is central to bringing frontier performance to the real world. We introduce DIRECT, a routing framework that uses multimodal scene context to allocate compute per prompt, improving the success–cost Pareto frontier over fixed model selection. Across three dominant scaling axes, namely chain-of-thought depth, model size, and memory history, our experiments on VLABench and RoboMME show that test-time compute is not a uniform lever: different axes yield qualitatively distinct capability gains. We validate these insights on a physical Franka arm in a DROID setup spanning zero-shot manipulation and long-horizon chaining, where our router matches or exceeds a stronger model’s success rate at up to 65% lower average latency. Ultimately, our results show that naively scaling test-time compute is wasteful, and that DIRECT can provide frontier-level embodied planning in robotic systems at a fraction of the cost. Project page can be found at jadee-dao.github.io/direct/.

cs.AI [Back]

Hao-Lun Hsu, Nikki Lijing Kuang, Boyi Liu, Zhewei Yao, Yuxiong He

TL;DR: 本文提出HORMA（分层组织与检索记忆智能体），一种解决LLM智能体在长视野任务中因状态缺失导致推理质量下降、成本增加和延迟问题的分层记忆机制。该方法将经验组织成类似文件系统的层次结构，将摘要实体与原始轨迹链接，实现高效访问且不丢失细节。HORMA将工作记忆分解为结构化记忆构建和基于导航的检索两个阶段，通过强化学习训练的轻量级智能体遍历层次结构选择最小但充分的上下文，显著减少关键执行路径的延迟。

Details

Motivation: 解决LLM智能体在长视野任务中因固有无状态性导致的挑战，即所有任务相关信息需编码在增长的输入上下文中，这会降低推理质量、增加推理成本和延迟，因此需要高效的工作记忆机制。现有方法依赖有损压缩或基于相似性的检索，往往无法捕捉多步智能体任务所需的时间结构和因果依赖。

Result: 在ALFWorld、LoCoMo和LongMemEval基准测试中，HORMA在受限上下文预算下提高了任务性能，在长对话任务中最多仅需基线22.17%的token使用量。与现有方法相比，它始终实现更好的效率-性能权衡，并能有效泛化到未见任务。

Insight: 创新点在于将工作记忆明确分解为结构化构建和导航检索两阶段，并采用类似文件系统的层次化组织来链接摘要与原始数据，避免了信息丢失。通过强化学习训练轻量级导航智能体来选择最小充分上下文，这是一种新颖的、可学习的记忆访问机制，能更好地捕捉任务的时间与因果结构，提升效率与泛化能力。

Abstract: Large language model (LLM) agents struggle with long-horizon tasks due to their inherent statelessness, requiring all task-relevant information to be encoded in growing input contexts. The resulting degraded reasoning quality, increased inference cost, and higher latency necessitate efficient working memory mechanisms. However, existing approaches either rely on lossy compression or similarity-based retrieval, which often fail to capture temporal structure and causal dependencies required for multi-step agentic tasks. In this work, we present HORMA, a Hierarchical Organize-and-Retrieve Memory Agent that organizes experience into a file-system-like hierarchical structure, where summarized entities are linked to the corresponding raw trajectories, enabling efficient access without losing detailed information. HORMA decomposes working memory into two stages: structured memory construction and navigation-based retrieval. The construction module iteratively refines how experiences are structured by distinguishing between failures caused by missing information and those caused by misleading or overloaded context. The navigation module retrieves task-relevant context by traversing the hierarchy using a lightweight agent trained with reinforcement learning to select minimal yet sufficient context, thereby reducing latency along the critical execution path. Across ALFWorld, LoCoMo, and LongMemEval, HORMA improves task performance under constrained context budgets while requiring at most 22.17% of the baseline token usage in long conversation tasks. Compared to existing methods, it consistently achieves better efficiency-performance trade-offs and generalizes effectively to unseen tasks.

cs.LG [Back]

[112] RLCSD: Reinforcement Learning with Contrastive On-Policy Self-Distillation cs.LG | cs.CLPDF

Leyi Pan, Shuchang Tao, Yunpeng Zhai, Lingzhe Zhang, Zhaoyang Liu

TL;DR: 本文提出了RLCSD方法，旨在解决策略内自蒸馏（OPSD）中存在的‘特权诱导风格漂移’问题。该方法通过对比模型在正确提示和错误提示下的师生分布差异，抑制与任务无关的风格令牌上的学习信号，从而将监督信号更集中于任务相关的令牌上。实验在数学和逻辑推理任务上验证了其有效性。

Details

Motivation: OPSD方法通过将模型自身分布与在特权上下文（如已验证的解决方案）下产生的分布对齐，为推理模型提供密集的令牌级监督。然而，研究发现由此产生的学习信号集中在风格令牌而非任务令牌上，导致训练不稳定或输出长度缩短，即‘特权诱导风格漂移’问题。

Result: 在Qwen3 (1.7B/4B/8B) 和 Olmo-3-7B-Think模型上的数学与逻辑推理实验表明，RLCSD方法在性能上持续优于GRPO和先前的OPSD方法。

Insight: 核心创新点是引入了对比机制来缓解风格漂移：通过对比正确提示与错误提示下的师生分布差异，有效抑制了与提示正确性无关的风格偏移，从而提取出更集中于任务令牌的学习信号。此外，这种对比原则具有通用性，可以集成到现有OPSD方法中以改进它们，并可扩展至更广泛的跨模型策略内蒸馏场景。

Abstract: On-policy self-distillation (OPSD) provides dense, token-level supervision for reasoning models by aligning a model’s own distribution with the distribution it produces under privileged context, typically a verified solution. However, we show that the learning signal drawn from this distributional gap concentrates on style tokens rather than task-bearing ones, as the hinted model tends to produce more direct, shorter outputs. We term this pathology \emph{privilege-induced style drift}, which destabilizes training or causes response length to shrink. To address this, we propose \textbf{RLCSD} (Reinforcement Learning with Contrastive on-policy Self-Distillation), which mitigates this drift by contrasting the teacher-student gap under a correct hint against that under a wrong hint, suppressing the style shift that conditioning on a hint tends to induce regardless of correctness, and yielding a signal that is more concentrated on task-bearing tokens. Experiments on Qwen3 (1.7B/4B/8B) and Olmo-3-7B-Think across mathematical and logical reasoning show that RLCSD consistently outperforms GRPO and prior OPSD methods. We further show that the contrastive principle is general: it plugs into existing OPSD methods to improve them, and its underlying insight extends to the broader cross-model on-policy distillation setting.

Michal Chudoba, Sergey Alyaev, Petra Galuscakova, Tomasz Wiktorski

TL;DR: 本文提出了一种名为ART（基于艺术的强化训练）的参数高效微调方法，用于多模态大语言模型（MLLM）。该方法通过仅优化原始视觉输入，将信息注入冻结的MLLM中，从而支持在预编译计算图上进行软令牌式微调，且优化的视觉输入可被风格化为任务相关的计算艺术作品。

Details

Motivation: 现有参数高效微调技术（如LoRA和软提示）需要修改预编译、预优化LLM的计算图，导致无法完全支持vLLM等高吞吐量引擎。ART旨在解决这一问题，实现无需修改模型计算图的微调。

Result: 在流行的开源Qwen架构的不同规模模型及多个文本基准测试中验证了有效性。具体而言，ART在数学和结构化工具使用基准测试中达到了与LoRA竞争性的准确率水平。

Insight: 创新点在于将微调目标转化为仅优化视觉输入（像素数组），通过梯度回传实现信息注入，同时保持模型参数冻结，从而兼容预编译计算图；优化的视觉输入可艺术化，为任务提供直观表示。

Abstract: There are two main Parameter-Efficient Fine-Tuning (PEFT) techniques for Large Language Models (LLMs). While Low-Rank Adaptation (LoRA) introduces additional weights between the LLM layers, Soft Prompting introduces additional fine-tuning-specific raw tokens to an LLM input. However, both require modification to the computational graphs of precompiled, preoptimized LLMs. As a result, neither is fully supported in high-throughput engines like vLLM. We propose fine-tuning with ART (Art-based Reinforcement Training). The method injects information into a frozen Multimodal Large Language Model (MLLM) by optimizing only its raw visual input, thus enabling the soft-token approach on pre-compiled computational graphs. It relies on backpropagation of gradients back into a plain pixel array and thus supports any fine-tuning objective. Moreover, the optimized visual input can be stylized as task-relevant computational artworks. The approach’s effectiveness is confirmed for different sizes of a popular open Qwen architecture and for several textual benchmarks. Specifically, ART reaches accuracy competitive with LoRA across mathematics and structured-tool-use benchmarks.

[114] Beyond representational alignment with brain-guided language models for robust reasoning cs.LG | cs.AI | cs.CL | q-bio.NCPDF

Mingqing Xiao, Kai Du, Zhouchen Lin

TL;DR: 本文探讨了大型语言模型（LLM）与人类高阶认知神经机制之间的对应关系，特别是演绎推理任务。研究发现LLM的内部表征与任务fMRI活动部分对齐，并提出了一个脑信号引导的框架，通过干预和微调来增强LLM的推理能力，在多个模型上实现了性能提升。

Details

Motivation: 动机在于探究LLM是否与推理相关脑区的神经信号对齐，以及这些信号能否直接用于改进LLM的推理鲁棒性，从而推动AI与人类认知的更紧密对齐。

Result: 在10个LLM（1.5B-72B参数）上，通过脑信号引导的干预和微调，实现了推理准确率的提升，最高达到13%的绝对增益，且这种提升与纯语言监督正交，并能跨推理类型迁移。

Insight: 创新点在于将LLM与脑信号的对应关系从相关性推进到引导性，提出了一种基于脑信号联合表征结构的干预框架，为构建更鲁棒和认知对齐的AI提供了新途径。

Abstract: The correspondence between large language models (LLMs) and the neural mechanisms underlying human higher-order cognition remains insufficiently characterized. Given that language and reasoning in the human brain appear dissociable, an open question is whether LLMs align with neural signals from reasoning-related regions and whether such signals can improve them. Here, focusing on deductive reasoning, we show that LLM internal representations are not only partially aligned with task-fMRI activity but can also be directly enhanced by these signals. Using a neural-predictivity metric, we find that LLMs explain a substantial fraction of the explainable variance in reasoning-related regions at the aggregate level, whereas predictivity within specific reasoning types is lower, indicating both alignment and divergence. Building on this, we propose a brain-guided framework: we steer model representations along directions induced by the joint structure of model and brain representations, applying intervention at inference and fine-tuning during training. We demonstrate that task-evoked brain signals can directly enhance LLM reasoning, yielding gains orthogonal to language-only supervision across 10 LLMs (1.5B-72B), with transfer across reasoning types and up to 13% absolute accuracy gain. Our results advance LLM-brain correspondences from correlation to guidance, establishing a brain-signal-driven pathway toward more robust and cognitively aligned AI.

[115] Information-Theoretic Decomposition for Multimodal Interaction Learning cs.LG | cs.AI | cs.CVPDF

Zequn Yang, Yake Wei, Haotian Ni, Zhihao Xu, Di Hu

TL;DR: 本文提出了一种基于信息论分解的多模态交互学习方法DMIL，旨在动态捕捉样本特定的冗余、独特和协同信息。该方法通过变分分解架构显式建模不同交互成分，并利用微调策略实现全面的交互学习。实验表明DMIL在多种任务和架构上均能通过适应样本特定交互实现优越性能。

Details

Motivation: 多模态学习的关键在于捕捉模态间的冗余、独特和协同信息，但这些交互在样本间动态变化，现有方法难以自适应学习这些差异化的交互类型。

Result: 在多种任务和架构上的广泛实验表明，DMIL通过适应全面的样本特定交互，始终实现优越性能，其框架灵活且广泛适用。

Insight: 创新点在于首次系统性地从信息论角度分析样本特定交互的重要性，并提出显式分解和利用交互成分的变分架构与学习策略，为多模态学习建立了以交互为中心的范式。

Abstract: Multimodal learning hinges on capturing redundant, unique, and synergistic information across modalities, which collectively constitute multimodal interactions. A critical yet underexplored challenge is that these implicit interactions vary dynamically across samples. In this work, we present the first systematic, information-theoretic analysis highlighting why learning these dynamic, sample-specific interactions is critical for effective multimodal learning. Our analysis further reveals deficits in conventional paradigms at learning these distinct interaction types: modality ensemble approaches struggle to capture synergy, while joint learning paradigms often under-utilize redundant information. This highlights the need for an approach that can adaptively learn from different interaction types on a per-sample basis. To this end, we propose Decomposition-based Multimodal Interaction Learning (DMIL), a novel paradigm that explicitly models and learns from sample-specific interactions. First, we design a variational decomposition architecture to isolate the constituent interaction components. Second, we employ a new learning strategy that leverages these explicit interaction components in a fine-tuning process to achieve comprehensive interaction learning. Extensive experiments across diverse tasks and architectures demonstrate that DMIL consistently achieves superior performance by adapting to holistic sample-specific interactions. Our framework is flexible and broadly applicable, establishing an interaction-centric paradigm for multimodal learning. The code is available at https://github.com/GeWu-Lab/DMIL.

[116] Breaking Entropy Bounds: Accelerating RL Training via MTP with Rejection Sampling cs.LG | cs.CLPDF

Yucheng Li, Huiqiang Jiang, Yang Xu, Jianxin Yang, Yi Zhang

TL;DR: 本文提出了Bebop方法，旨在解决强化学习训练中多令牌预测接受率下降导致的加速瓶颈。通过分析发现接受率受模型熵波动限制，提出使用概率拒绝采样缓解熵扰动，并设计了一种新颖的端到端TV损失函数直接优化多步拒绝采样接受率，从而显著提升接受率和推理吞吐量。实验表明该方法在Qwen系列模型的异步RL训练中实现了最高1.8倍的端到端加速。

Details

Motivation: 强化学习已成为现代大语言模型的关键组成部分，但rollout阶段仍是RL训练流程的主要瓶颈。尽管多令牌预测通过推测解码提供了加速rollout的自然解决方案，但许多研究发现MTP接受率在RL训练期间显著下降，导致加速性能有限。

Result: 提出的端到端TV损失使接受率提升约10%，达到最高95%的接受率，并在数学推理、代码生成和智能体任务中实现最高25%的额外推理吞吐量增益。在Qwen3.5、Qwen3.6和Qwen3.7模型的异步RL训练中实现了最高1.8倍的端到端加速。

Insight: 创新点在于揭示了MTP接受率受模型熵波动限制的根本原因，提出了概率拒绝采样替代贪婪草稿采样以缓解熵扰动，并设计了直接优化多步拒绝采样接受率的端到端TV损失函数。客观分析认为，该方法通过系统性地解决RL训练中MTP性能下降问题，提供了实用的端到端优化方案，且预RL MTP训练结合TV损失和拒绝采样的策略避免了昂贵的在线更新需求。

Abstract: Reinforcement learning (RL) has become a key component in modern large language models, yet the rollout stage remains the key bottleneck in RL training pipelines. Although Multi-Token Prediction (MTP) offers a natural solution to accelerate rollouts through speculative decoding, many studies have observed that MTP acceptance rates degrade significantly during RL training, leading to limited speedup performance. To address this bottleneck, we present Bebop, a systematic study of MTP in LLM post-training, and offer practical recipes to integrate MTP into large-scale RL pipelines. First, we reveal that the MTP acceptance rate is fundamentally bounded by the fluctuation of model entropy, which demonstrates a clear negative linear relationship with the rise of entropy in the RL stage. Second, we show that probabilistic rejection sampling largely alleviates the disturbance introduced by entropy in RL compared to greedy draft sampling. We further identify that the conventional MTP training objectives (cross-entropy or KL) are suboptimal in such settings, and therefore we propose a novel end-to-end TV loss that directly optimizes multi-step rejection sampling acceptance rate, yielding ~10% acceptance rate improvements, achieving up to 95% acceptance rates and up to 25% extra inference throughput gains across mathematical reasoning, code generation, and agentic tasks. Third, we test various online MTP training strategies during RL and show that pre-RL MTP training with e2e TV loss and rejection sampling achieves a consistent acceptance rate and speedup throughout the entire RL, eliminating the need for costly online MTP updating. We provide extensive experiments and analysis that validate our findings. Experimental results show our method achieves up to 1.8x end-to-end acceleration in async RL training of Qwen3.5, Qwen3.6, and Qwen3.7 models.

eess.IV [Back]

[117] Intelligent Skin Cancer Detection Using a Multispectral Metasurface and a Hybrid eess.IV | cs.CVPDF

Afsane Saee Arezoomand

TL;DR: 本研究提出了一种结合多光谱超表面成像与混合深度学习架构的创新框架，用于智能皮肤癌检测。该方法利用超表面非侵入式获取对组织变化敏感的光谱信息，并通过CNN-ViT混合模型提取局部与全局特征以稳健分类皮肤病变。仿真评估表明，该方法在准确率、敏感性和特异性方面优于传统RGB和单一架构方法，并提高了模型可解释性。

Details

Motivation: 解决传统皮肤癌检测技术（如可见光皮肤镜和视觉成像）局限于可见光谱、难以捕捉早期恶性肿瘤的细微光谱特征的问题，旨在通过多光谱成像和深度学习提升早期检测的准确性和可靠性。

Result: 在仿真评估中，该方法达到约98%的准确率、95%的敏感性和99%的特异性，超越了基于RGB和单一架构的传统方法，并通过注意力图定性分析显示模型能聚焦于临床相关病变区域。

Insight: 创新点在于将多光谱超表面成像（提供丰富光谱数据）与CNN-ViT混合深度学习架构（结合局部和全局特征提取）相结合，为皮肤病学诊断工具提供了便携、快速且高精度的新方向，同时通过注意力机制增强了模型的可解释性。

Abstract: Skin cancer is among the most prevalent malignancies worldwiAdbe satnradcitts early detection is essential for improving patient survival and reducing treatment costs Conventional dermoscopic and visual imaging techniques are primarily limited to the visible spectrum and often fail to capture subtle spectral signatures associated with early stage malignancies This study proposes an innovative framework that integrates a multispectral metasurface for imaging with a hybrid deep learning architecture based on Convolutional Neural Networks and Vision Transformers The designed metasurface enables noninvasive acquisition of rich spectral information highly sensitive to tissue alterations while the hybrid CNN ViT model simultaneously extracts local and global features to robustly classify skin lesions Simulation-based evaluations demonstrate that the proposed method achieves approximately 98 accuracy 95 percentages sensitivity and 99 perentage specificity surpassing conventional RGB-based and single-architecture approaches Qualitative analyses using attention maps reveal that the model focuses on clinically relevant lesion regions improving interpretability Overall the results indicate that combining metasurface based multispectral imaging with hybrid deep learning can introduce a new generation of diagnostic tools in dermatology and pave the way for portable fast and highly accurate clinical systems

cs.HC [Back]

[118] Frozen Multimodal Embeddings for Personality and Cognitive Ability Assessment in Asynchronous Video Interviews cs.HC | cs.AI | cs.CVPDF

Kuo-En Hung, Hung-Yue Suen, Shih-Ching Yeh, Hsiang-Wen Wang

TL;DR: 本文提出了一种基于冻结多模态嵌入的小样本学习方法，用于从异步视频面试中预测人格特质和认知能力。该方法利用CLIP、Whisper、RoBERTa等预训练模型提取视觉、声学和文本特征，并采用低容量下游模型进行预测。在ACM Multimedia AVI Challenge 2026的两个任务中，该方法在人格特质预测上显著优于官方基线，而在认知能力分类中则揭示了数据集中可能存在的捷径效应。

Details

Motivation: 从异步视频面试中预测心理特质是一个具有挑战性的多模态学习问题，因为标注数据有限且信号维度高。本文旨在通过小样本表示学习解决这一难题，避免对大型预训练模型进行微调。

Result: 在人格特质预测任务中，该方法在验证集上的平均MSE为0.2696，优于官方基线0.3334，相对降低了19.1%。在认知能力分类任务中，多模态集成方法达到0.5313的准确率，高于官方基线0.4062，但作者认为这可能源于数据集的捷径而非稳健的推理。

Insight: 创新点在于采用冻结的多模态编码器结合低容量下游模型进行小样本学习，并证明了特质特定的多模态建模的有效性。同时，研究强调了在认知能力预测中控制数据集捷径的重要性，为多模态心理评估提供了方法论启示。

Abstract: Predicting psychological traits from asynchronous video interviews (AVIs) is a challenging multimodal learning problem because labeled datasets are limited while each response contains high-dimensional visual, acoustic, and verbal signals. This paper presents our solution for the ACM Multimedia AVI Challenge 2026, which evaluates two tasks: Track~~1 predicts self-reported HEXACO personality traits from personality-related interview responses, and Track~~2 classifies cognitive ability levels from structured AVI responses. We treat the problem as a small-sample representation learning task. Instead of fine-tuning large pretrained models, we use frozen multimodal encoders, including CLIP for visual features, Whisper for acoustic features and transcripts, and RoBERTa, E5, and DeBERTaV3 for textual representations, followed by low-capacity downstream models. For Track1, our trait-specific regression and late-fusion system achieves an average validation MSE of 0.2696, improving over the official baseline of 0.3334. Ablation results show a three-step improvement from a global model (0.3189), to per-trait modeling (0.2871), to per-trait late fusion (0.2696), corresponding to a 19.1% relative MSE reduction over the official baseline. For Track2, a compact subject-attribute baseline reaches 0.5781 accuracy, while our multimodal ensemble reaches 0.5313, both above the official baseline of 0.4062. We interpret this result as evidence of possible subject-attribute shortcuts in the validation split rather than robust cognitive inference from AVI content. Overall, our findings suggest that AVI-based psychological assessment benefits from trait-specific multimodal modeling, but cognitive ability prediction requires careful control of dataset shortcuts.

Table of Contents

cs.CL [Back]

[1] Detecting AI-Generated Content on Social Media with Multi-modal Language Models cs.CL | cs.CVPDF

[2] One Jailbreak, Many Tongues: Learning Language-Insensitive Intention Representations for Multilingual Jailbreak Detection cs.CLPDF

[3] Compatibility-Aware Dynamic Fine-Tuning for Large Language Models cs.CL | cs.LGPDF

[4] ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward cs.CL | cs.AI | cs.LGPDF

[5] T2MM: An LLM Supported Architecture For Inquiry-Based Modeling cs.CL | cs.AI | cs.MMPDF

[6] Calibration Drift Under Reasoning: How Chain-of-Thought Budgets Induce Overconfidence in Large Language Models cs.CL | cs.AI | cs.LGPDF

[7] Beyond Compaction: Structured Context Eviction for Long-Horizon Agents cs.CLPDF

[8] LifeSentence: Language models can encode human life course trajectories from longitudinal panel data cs.CLPDF

[9] Afrispeech Semantics: Evaluating Audio Semantic Reasoning in Spoken Language Models Across Domains and Accents cs.CL | cs.AI | cs.SDPDF

[10] Benchmarking Large Language Models for Safety Data Extraction cs.CL | cs.IRPDF

[11] Context-Aware Multimodal Claim Verification in Spoken Dialogues cs.CL | cs.SIPDF

[12] Agent Skill Evaluation and Evolution: Frameworks and Benchmarks cs.CLPDF

[13] The Periodic Table of LLM Reasoning: A Structured Survey of Reasoning Paradigms, Methods, and Failure Modes cs.CLPDF

[14] Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality cs.CL | cs.AIPDF

[15] AI Coding Agents Can Reproduce Social Science Findings cs.CLPDF

[16] When Roleplaying, Do Models Believe What They Say? cs.CL | cs.AIPDF

[17] SAGE: Answer-Conditioned Uncertainty Targets for Verbal Uncertainty Alignment cs.CLPDF

[18] Teaching Diffusion to Speculate Left-to-Right cs.CL | cs.LGPDF

[19] Pretrained self-supervised speech models can recognize unseen consonants cs.CL | cs.AIPDF

[20] Improving Cross-Format Robustness in Language Models with Multi-Format Training cs.CLPDF

[21] Multi-Agent Reasoning with Adaptive Worker Allocation for Stance Detection cs.CLPDF

[22] Can AI Reason Like an Urban Planner? Benchmarking Large Language Models Against Professional Judgment cs.CLPDF

[23] Automated Creativity Evaluation of Language Models Across Open-Ended Tasks cs.CL | cs.AIPDF

[24] Notes2Skills: From Lab Notebooks to Certainty-Aware Scientific Agent Skills cs.CLPDF

[25] WorldReasoner: Evaluating Whether Language Model Agents Forecast Events with Valid Reasoning cs.CL | cs.AIPDF

[26] When Does Language Matter? Multilingual Instructions Reveal Step-wise Language Sensitivity in Vision-Language-Action Models cs.CLPDF

[27] An Ontology-Guided Multi-Anchor Graph Retrieval Framework for Traffic Legal Liability Determination cs.CLPDF

[28] Toward Generalist Autonomous Research via Hypothesis-Tree Refinement cs.CL | cs.AIPDF

[29] Decoding Multimodal Cues: Unveiling the Implicit Meaning Behind Hateful Videos cs.CLPDF

[30] Agreement in Representation Space for Open-Ended Self-Consistency cs.CLPDF

[31] Reassessing High-Performing LLMs on Polish Medical Exams: True Competence or Bias-Driven Performance? cs.CLPDF

[32] Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models cs.CLPDF

[33] Measuring Epistemic Resilience of LLMs Under Misleading Medical Context cs.CLPDF

[34] Verifiable Environments Are LEGO Bricks: Recursive Composition for Reasoning Generalization cs.CLPDF

[35] Doc-to-Atom: Learning to Compile and Compose Memory Atoms cs.CL | cs.IRPDF

[36] Context-Driven Incremental Compression for Multi-Turn Dialogue Generation cs.CL | cs.LGPDF

cs.CV [Back]

[37] LAST: Bridging Vision-Language and Action Manifolds via Gromov-Wasserstein Alignment cs.CVPDF

[38] CFCamo: A Counterfactual Detect-or-Abstain Framework for Camouflaged Object Detection cs.CVPDF

[39] Traits Run Deeper: Trait-Specific Asymmetric Fusion for Personality Assessment cs.CV | cs.HCPDF

[40] DeceptionX: Explainable Deception Detection with Multimodal Large Language Models cs.CVPDF

[41] 3D-CBM: A Framework for Concept-Based Interpretability in Generative 3D Modeling cs.CV | cs.GRPDF

[42] Towards Fully Automated Exam Grading: Fairness-Aware Recognition of Handwritten Answers with Foundation Models cs.CV | cs.AIPDF

[43] SceneMiner: Identity-Preserving Multi-Task Fine-Tuning for Unified BEV Scene Mining cs.CVPDF

[44] VL-DINO: Leveraging CLIP Vision-Language Knowledge for Open-Vocabulary Object Detectio cs.CVPDF

[45] Cross-Modal Benchmarking for Robotic Perception in Natural Environments cs.CV | cs.ROPDF

[46] 4DP-QA: Scalable QA for 4D Perception in Vision Language Models cs.CVPDF

[47] FreqKD: Frequency-Decoupled Cross-Modal Knowledge Distillation for Infrared Object Detection cs.CVPDF

[48] AVIS: Adaptive Test-Time Scaling for Vision-Language Models cs.CV | cs.AIPDF

[49] Spatially Coupled Phase-to-Depth Calibration for Fringe Projection Profilometry cs.CVPDF

[50] Frozen Foundation-Model Embeddings Discard Small-Lesion Signal in Chest Radiography: Implications for Pre-Deployment Evaluation cs.CVPDF

[51] Understanding Cross-Sensor Feature Variations for Generalizable 3D Perception cs.CVPDF

[52] Precision-Aware Illumination-Disentangled Vision Transformer for Spacecraft 6D Pose Estimation cs.CVPDF

[53] Adapting Vision-Language Models from Iconic to Inclusive for Multi-Label Recognition Without Labels cs.CVPDF

[54] Motion Reinforces Appearance: RGB-Skeleton Gated Residual Fusion for Micro-Gesture Online Recognition cs.CVPDF

[55] Learning Instance-Adaptive Low-Rank Orthogonal Subspaces for Clothes-Changing Person Re-Identification cs.CV | cs.LGPDF

[56] ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation cs.CV | cs.AIPDF

[57] Parameter-Efficient Adapter Tuning for Tabular-Image Multimodal Learning cs.CV | cs.LGPDF

[58] Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning cs.CV | cs.AIPDF

[59] DroneShield-AI: A Multi-Modal Sensor Fusion Framework for Real-Time Autonomous Drone Threat Detection, Behavioral Intent Classification, and Swarm Intelligence in Contested Airspace cs.CV | cs.LG | cs.ROPDF

[60] RankVR: Low-Rank Structure Perception and Value Recalibration for Robust Composed Image Retrieval cs.CVPDF

[61] MedCTA: A Benchmark for Clinical Tool Agents cs.CV | cs.AI | cs.CLPDF

[62] ERN-Net : Evolving Reason Node-Net for Document Binarization cs.CVPDF

[63] Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning cs.CV | cs.AIPDF

[64] AnchorEdit: Maintaining Temporal Consistency in Multi-turn Image Editing via Causal Memory cs.CV | cs.AIPDF

[65] From Prompts to Tokens: Internalizing Causal Supervision in Vision-Language Model for Multi-Image Causal Reasoning cs.CV | cs.AIPDF

[66] A Comprehensive Ecosystem for Open-Domain Customized Video Generation cs.CVPDF

[67] UniReason-Med: A Shared Grounded Reasoning Interface for 2D-to-3D Transfer in Medical VQA cs.CV | cs.CLPDF

[68] MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models cs.CV | cs.AI | cs.CLPDF

[69] Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding cs.CVPDF

[70] LASA: A Weak Supervision Method for Open-Vocabulary Scene Sketch Semantic Segmentation cs.CV | cs.AIPDF

[71] Scene-Adaptive Nonlinear Tone Curves for Pseudo Ground-Truth Generation in Low-Light 3D Gaussian Splatting cs.CVPDF

[72] SheafStain: Sheaf-Theoretic Schrödinger Bridge for Spatially and Biologically Coherent Virtual Staining cs.CVPDF

[73] Task-Aware Structured Memory for Dynamic Multi-modal In-Context Learning cs.CV | cs.AIPDF

[74] Task-Aligned Stability Analysis of Vision-Language Models for Autonomous Driving Hazard Detection cs.CV | cs.AI | cs.ROPDF

[75] Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching cs.CV | cs.LGPDF

[76] From Content to Knowledge: Lightning Fast Long-Video Understanding with Neural Knowledge Representations cs.CVPDF

[77] SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generation cs.CVPDF