cs.CL [Total: 38]
cs.CV [Total: 107]
cs.IR [Total: 2]
eess.IV [Total: 2]
cs.RO [Total: 6]
eess.AS [Total: 2]
cs.CR [Total: 1]
cs.LG [Total: 11]
cs.AI [Total: 15]

cs.CL [Back]

[1] CLIR-Bench: Benchmarking Multimodal Question Answering over Irregular Clinical Time Series cs.CL | cs.AIPDF

Frank Nie, Ethan B. Liu, Yuan Zhu, Loe Yan, Wei Fan

TL;DR: 本文提出了CLIR-Bench，一个用于评估模型在不规则临床时间序列上进行问答（QA）能力的基准测试。该基准包含6,600个QA实例，覆盖11个临床变量，旨在测试模型从稀疏、不规则采样的ICU数据中检索和推理时间证据的能力。

Details

Motivation: 现有基准主要关注规则采样时间序列或静态医疗数据的QA，缺乏对模型能否基于不规则时间观测进行可靠推理的评估，因此需要专门针对不规则临床时间序列的QA基准。

Result: 实验表明，现有的通用模型在检索和推理稀疏临床证据方面表现不佳，凸显了开发更强的不规则时间序列推理方法的必要性。

Insight: 创新点在于构建了一个基于去标识化ICU记录、具有明确时间证据和任务特定答案推导规则的多维度基准，能够同时评估答案准确性和证据使用情况，填补了不规则临床时间序列QA评估的空白。

Abstract: Clinical time series are central to patient monitoring, risk assessment, and clinical decision support. However, they are often sparse, irregularly sampled, and asynchronous, making it difficult for models to identify the temporal evidence required for clinical Question Answering (QA). Existing benchmarks primarily focus on regularly sampled time-series QA or medical QA over static data, and therefore rarely assess whether models can faithfully ground their answers in irregular temporal observations. To fill this gap, we introduce CLIR-Bench, a benchmark for irregular clinical time series QA constructed from de-identified ICU records through a principled four-stage pipeline. CLIR-Bench contains 6,600 QA instances spanning 11 clinical variables, organized into four capability dimensions and 11 tasks. Each question is linked to explicit temporal evidence and task-specific answer derivation rules, enabling evaluation of both answer accuracy and evidence use. Experiments show that existing generalist models struggle to retrieve and reason over sparse clinical evidence, highlighting the need for stronger irregular time-series reasoning methods. Our code and data are available at https://huggingface.co/datasets/winall/CLIR-Bench.

[2] Global Merger-Arbitrage Forecasting with Language Models cs.CLPDF

Hinal Jajal, Michal Mucha, Charles Sweat, Chris Pulman, Charlie Flanagan

TL;DR: 本文提出了一种基于语言模型的并购套利预测系统，专门用于预测已宣布并购交易的结果。该系统结合了专家指导的上下文工程和基于历史交易后见之明推理轨迹的微调，在需要处理数百页技术文档的长上下文推理场景中表现出色。

Details

Motivation: 解决在并购套利这一高风险金融场景中，需要基于大量技术文档进行长上下文推理来预测交易结果的挑战，而现有LLM判断性预测研究多集中于短上下文、混合主题的基准测试。

Result: 在涵盖42个国家、超过400笔大型交易的样本外测试集上，微调后的系统实现了最佳性能，将类别平衡Brier分数降至0.151，比校准的市场隐含概率低24%，比XGBoost低19%，比前沿语言模型低25-42%。

Insight: 创新点在于将基于后见之明的监督与专家设计的上下文相结合，证明了LLM在专业化、长上下文的金融工作流程中能够成功进行预测，其中上下文工程和特定领域监督至关重要。

Abstract: We present a language-model forecasting system for merger arbitrage, a specialized high-stakes financial setting in which the task is to predict the outcome of announced M&A deals. Unlike prior work on judgmental forecasting with LLMs, which has focused on broad mixed-topic benchmarks and short context such as news snippets, we study a setting that requires long-context reasoning over hundreds of pages of technical documents. Our system combines expert-guided context engineering with finetuning on hindsight-guided reasoning traces derived from historical deals. Given an announced deal, it outputs a probability distribution over three mutually exclusive outcomes: closing at announced terms, a higher bid, or deal termination. On an out-of-sample set of more than 400 large deals spanning 42 countries, our finetuned system achieves the best performance of any method we evaluate, reducing class-balanced Brier score to 0.151. This is 24% below calibrated market-implied probabilities, 19% below XGBoost, and 25-42% below frontier language models. These results, together with ablation studies, show that LLM-based forecasting can succeed in specialized, long-context financial workflows, with hindsight-based supervision and expert-designed context playing a critical role.

[3] Index SLM Technical Report cs.CLPDF

Lusheng Zhang, Shien He, Tianxing Yan, Mengran Yu, Ziang Cui

TL;DR: 哔哩哔哩发布了Index-1.9B系列开源小语言模型，包括基础模型、纯净模型、对话模型和角色扮演模型。该系列模型在2.8万亿中英文语料上预训练，采用创新的学习率调度和输出层设计，在多项基准测试中取得了与更大规模模型相当或更优的性能。

Details

Motivation: 开发一个高性能、参数规模较小（19亿非嵌入参数）的开源语言模型系列，旨在探索在有限参数量下通过数据质量、训练策略和架构优化来提升模型能力。

Result: 在涵盖考试、推理、数学和代码的标准基准测试套件中，Index-1.9B-Base平均得分为64.92，与参数量数倍于它的开源模型相比具有竞争力或更优。

Insight: 创新点包括：1) 采用Warmup-Stable-Decay学习率调度，并在衰减阶段大幅提高精选数据浓度；2) 使用Norm-Head输出层以稳定大学习率下的训练；3) 系统研究了模型深度、学习率调度与数据质量的交互、预训练中指令数据的影响等训练细节，并报告了训练中性能突增的未解现象。

Abstract: We present Index-1.9B, a series of open small language models developed at Bilibili. The series comprises four models: Index-1.9B-Base, a foundation model with 1.9 billion non-embedding parameters pre-trained on 2.8 trillion predominantly Chinese and English tokens; Index-1.9B-Pure, a control variant trained with an identical recipe but with all instruction-like data strictly filtered from the corpus; Index-1.9B-Chat, aligned from the base model with supervised fine-tuning and direct preference optimization; and Index-1.9B-Character, which augments the chat model with retrieval-augmented generation for few-shot role-playing customization. Pre-training employs a Warmup-Stable-Decay learning-rate schedule in which the concentration of curated data is raised substantially during the decay phase, together with a Norm-Head output layer that stabilizes training under large learning rates. On a suite of standard benchmarks covering examination, reasoning, mathematics, and code, Index-1.9B-Base attains an average score of 64.92, competitive with or exceeding open models of several times its size. We further report controlled studies on model depth, learning-rate magnitude and scheduling, the interaction between learning-rate decay and data quality, and the effect of including instruction data during pre-training, and we document an unexplained surge in benchmark performance midway through the constant-learning-rate phase. All models, together with evaluation code, are released at https://github.com/bilibili/Index-1.9B.

[4] Silent Failures in Quantized LLM Reasoning: A Taxonomy-Based Analysis of Hollow Convergence and Failure Mode Shifts cs.CL | cs.LGPDF

Renuka Oladri, Mohan Vamsi Varadaraju Priya, Jerry Wu

TL;DR: 本文揭示了后训练量化会无声地改变大型语言模型的推理方式，即使任务准确率保持不变。通过一个包含六类失效模式的分类法，作者分析了五个指令微调LLM在三种量化精度和四个推理基准上的30,000条思维链输出。研究发现，虽然准确率在不同精度间保持稳健，但‘空洞收敛’（即通过不完整或不可验证的推理得出正确答案）在NF4量化下表现出显著的模型大小依赖性变化，并且失效模式（如‘捷径崩溃’和‘信心雪崩’）会发生定性转变，这些都无法通过标准准确率指标捕捉。

Details

Motivation: 动机在于揭示后训练量化对LLM推理过程的隐性影响，即量化可能在保持任务准确率的同时，无声地改变模型的内部推理逻辑和失效模式，而这是当前标准评估流程无法检测到的部署相关风险。

Result: 在三个量化精度（FP32, FP16, NF4）和四个推理基准（GSM8K, LogiQA, ARC-Challenge等）上的实验表明，准确率最大仅下降3.1个百分点，但‘空洞收敛’在NF4下对模型大小敏感（小模型显著下降，12B及以上模型不变），且是基准特定的（GSM8K免疫）。此外，在LLaMA 3.2-3B上，NF4量化导致‘捷径崩溃’在错误答案中的占比从44%升至78%，而‘信心雪崩’从15.8%降至接近零。表面文本特征无法可靠检测空洞收敛（最佳F1=0.53）。

Insight: 创新点在于提出了一个经过人工验证的、用于系统分类量化后LLM推理失效模式的分类法，并首次定量揭示了‘空洞收敛’这一隐蔽的、与模型大小和基准相关的失效现象，以及量化导致的失效模式定性转变，强调了超越准确率的细粒度推理评估在模型部署中的重要性。

Abstract: We show that post-training quantization can silently alter how large language models reason even when task accuracy is preserved. Using a six-category failure taxonomy validated by two independent human annotators (Cohen’s $κ$ = 0.906), we classify 30,000 chain-of-thought outputs from five instruction-tuned LLMs (3B–14B parameters) across three quantization precisions (FP32, FP16, NF4) and four reasoning benchmarks. We find that while accuracy is robust across precisions (maximum 3.1 pp drop), Hollow Convergence (correct answers reached through incomplete or unverifiable reasoning) shows a significant size-dependent shift under NF4, dropping sharply for the two smallest models tested but remaining invariant for models at 12B parameters and above. This effect is also benchmark-specific: GSM8K is categorically immune while LogiQA and ARC-Challenge show the largest shifts. Furthermore, under NF4, Shortcut Collapse rises from 44% to 78% of wrong-answer failures in LLaMA 3.2-3B while Confidence Snowballing collapses from 15.8% to near zero, a qualitative shift invisible to accuracy metrics. Finally, we show Hollow Convergence cannot be reliably detected from surface-level text features (best F1 = 0.53), establishing it as a deployment-relevant failure mode that standard evaluation pipelines cannot catch.

[5] Efficiently Adapting Spoken Language Models for the Singaporean Context cs.CL | cs.AIPDF

Ng Jia Sheng Jason

TL;DR: 本文提出了一种高效适应新加坡语境的口语语言模型（SLM）方法，通过结合LoRA微调、防灾难性遗忘的替代文本QA数据集以及适用于语音的多任务目标，将开源SLM适配到新加坡内政团队（Home Team）的五个语音任务中，并构建了一个包含504,853个样本的多语言QA数据集HTD-multilingual-QA。

Details

Motivation: 解决在原始训练数据不可访问且应用场景需要多语言口语查询交互的敏感领域（如新加坡内政团队）中，口语语言模型适应不足的问题。

Result: 所得到的HT-Moonstone（5B）模型在大多数任务上匹配或优于规模达其7倍的SLM，在所有评估模型中取得了最佳的口音和性别识别性能，且原始语音QA能力损失低于2%。

Insight: 创新点包括将CoBa重加权方案适配到语音的多任务目标、构建防灾难性遗忘的替代文本QA数据集，以及创建大规模多语言语音-文本QA数据集，实现了在资源受限下高效且保持性能的领域适应。

Abstract: Spoken language models (SLMs) unify speech perception and reasoning, but adapting them to sensitive domains is underexplored, especially when the original training data is inaccessible and the use case demands multilingual, spoken-query interaction. We adapt an open-source SLM to the Singaporean Home Team context across five speech tasks in Singapore’s four official languages, combining LoRA fine-tuning, a surrogate text-QA dataset that guards against catastrophic forgetting, and a multi-task objective that adapts the CoBa reweighting scheme to speech. We also build HTD-multilingual-QA, a 504,853 sample multilingual QA dataset in text and spoken form. The resulting HT-Moonstone (5B) matches or outperforms SLMs up to 7x its size on most tasks, attains the best accent and gender recognition among all models evaluated, and loses under 2% of its original speech QA ability.

[6] Cost of Reasoning in non-English Languages: A Case Study on Japanese cs.CL | cs.AI | cs.LGPDF

Yuu Jinnai

TL;DR: 该论文研究了在非英语语言（以日语为例）中训练推理语言模型的可行性，通过使用GRPO方法对Qwen-3-Swallow-8B模型进行微调，使其能够用日语进行推理。研究评估了模型在编码、数学和科学基准测试上的表现，发现其性能最多与强英语推理基线相当，且在日语文化相关任务上表现更差。

Details

Motivation: 推理轨迹对模型可解释性和安全性至关重要，且在实际应用中有利于用户和开发者。当前推理语言模型在英语上表现最强，因为英语的推理训练数据最丰富，但用户可能希望模型能用其选择的语言进行推理，同时保持强推理性能。

Result: 在编码、数学和科学基准测试上，训练后的日语推理模型性能最多与强英语推理基线相当，未超越SOTA。在日语文化基准测试上，其表现甚至比基线模型更差。

Insight: 论文的创新点在于探索了通过GRPO方法控制推理语言的可行性，证明了训练非英语推理模型的潜力，但客观分析表明，这种语言转换可能不会自动提升文化相关任务的性能，甚至可能带来性能下降，这揭示了语言特定推理训练的局限性。

Abstract: Reasoning Language Models (RLMs) achieve their strongest performance when they reason in English, the language for which reasoning-oriented training data is most abundant. However, reasoning trace is a clue for model interpretability and safety, and useful in practice for both the model users and for model developers. Thus, it is desirable to be able to develop a model that reasons in a language of the user’s choice, while still maintaining strong reasoning performance. To this end, we study the feasibility of training a model that reasons in Japanese. We develop a Japanese-reasoning variant of Qwen-3-Swallow-8B, which is a Japanese LLM continually pretrained from Qwen-3-8B, with GRPO and evaluate it across coding, math, and science benchmarks. The study shows that reasoning-language control is feasible by training a Japanese continually pretrained model with GRPO. However, its performance is at best on par with strong English-reasoning baselines on several benchmarks. We also evaluate the trained model on Japanese cultural benchmarks and observe that the model’s performance is worse than the baseline models, suggesting that the reasoning in Japanese does not immediately improve performance on culturally relevant tasks for free.

[7] Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders cs.CL | cs.IRPDF

Cedric Waterschoot, Nava Tintarev, Francesco Barile

TL;DR: 本文研究利用大型语言模型（LLM）动态模拟人类主观偏好，以优化群组推荐系统中的偏好聚合策略选择。通过微调LLM（如Judgmental Llama和Judgmental OLMo）基于人类调查数据，系统能生成多个候选推荐并动态选择最能满足公平性、满意度和共识感知的策略。用户研究（n=284）验证了该方法在满意度和群体共识方面取得了最高评分。

Details

Motivation: 解决群组推荐系统中传统方法对组内偏好分布敏感的问题，探索LLM是否能根据人类对公平性、满意度和共识的细微感知，动态选择理想的聚合策略。

Result: 在用户研究（n=284）中，该方法在满意度和群体共识方面取得了最高评分；LLM的判断与人类对公平性、满意度和共识的感知最为一致，尤其是在考虑LLM方法与组态（如少数派或联盟）的交互效应时。

Insight: 创新点在于将LLM微调为实时判断模型，以动态适应组内偏好分布并优化聚合策略选择；客观分析认为，该方法通过结合人类主观评估和LLM推理能力，为个性化群组推荐提供了可借鉴的框架，强调了动态策略调整的重要性。

Abstract: Previous work in group recommender systems has demonstrated a sensitivity to the distribution of preferences within a group. Specifically, the selection of the preference aggregation strategy benefits from considering such group configurations. In this paper, we study whether LLMs are able to mimic this sensitivity and to select the ideal aggregation strategy (and corresponding recommendation) according to nuanced human perceptions of fairness, satisfaction, and consensus. We do this by fine-tuning Large Language Models (LLMs) on human survey data to serve as real-time judgmental models within the recommendation pipeline. Using a reasoning dataset distilled from DeepSeek-V3.1 and human ground truth assessments, we develop Judgmental Llama and Judgmental OLMo to simulate group assessments. Our pipeline successfully generates multiple recommendation candidates based on social choice-based aggregation strategies and dynamically selects the one that maximizes these predicted human-like evaluations. We further validate these suggestions in a user study (n=284) and find that our methodology achieved the highest scores for satisfaction and group consensus. Furthermore, we find that LLM judgments are most aligned with human perceptions of fairness, satisfaction and consensus when we also consider interaction effects between our LLM-based method and group configuration (e.g., minority or coalition). These findings give further support for dynamically adapting aggregation strategies to specific within-group preference distributions, and highlight the advantage of using LLMs for an adaptation that is aligned with subjective human judgments.

[8] PTEI: Integrating Personality Traits to Enhance Emotional Intelligence in Large Language Models cs.CL | cs.IRPDF

Amir Reza Jafari, Praboda Rajapaksha, Reza Farahbakhsh, Noel Crespi

TL;DR: 本文提出了PTEI框架，旨在通过整合人格特质（MBTI和OCEAN）来增强大语言模型的情感智能。该框架从情感场景中提取人格特质，并将其作为上下文知识融入提示中，以指导模型更准确地推断情绪及其原因。此外，通过对比学习构建优化的检索系统来提升场景对齐，实验表明PTEI能有效提升多种LLM的情感理解能力，特别是在GPT模型上效果显著，结合思维链推理可进一步提高准确率。

Details

Motivation: 当前大语言模型在复杂情感推理任务上仍远逊于人类，部分原因在于缺乏对个体差异（如人格特质）的整合，而人格特质是人类情感推断的基础。因此，研究旨在通过引入人格特质来缩小这一差距，提升模型的情感智能水平。

Result: 在多个已建立的情感智能基准测试上进行广泛实验，结果显示PTEI增强了各种LLM的情感理解能力，其中GPT模型提升最为明显。当PTEI与思维链推理结合时，准确率额外提高了4%。

Insight: 创新点在于首次将人格特质系统地整合到LLM的情感智能任务中，通过人格感知提示和对比学习优化的检索系统，实现了对情感场景的个性化上下文增强。从客观角度看，该方法为AI系统提供了更深入的社会和心理基础，有助于推动更具人情味的AI发展。

Abstract: Despite advances in Emotional Intelligence (EI), Large Language Models (LLMs) still significantly underperform humans in complex emotional reasoning. This gap originates partly from the limited incorporation of individual differences, particularly personality traits, which are fundamental to human emotional inference. To address this, we propose PTEI, a novel framework for integrating Personality Traits into Emotional Intelligence tasks using LLMs. In PTEI, MBTI and OCEAN personality traits are first extracted directly from the given emotional scenarios and then utilized as contextual knowledge within personality-aware prompts, guiding LLMs to accurately infer emotions and their underlying causes. To ensure optimal contextual grounding, we employ Contrastive Learning to construct an optimized retrieval system that surfaces emotionally and personally aligned scenarios, enhancing reasoning quality. Extensive experiments on established EI benchmarks show that PTEI enhances the Emotional Understanding (EU) capabilities of various LLMs, with the strongest improvement observed in GPT models. Combining PTEI with Chain-of-Thought (CoT) reasoning yields an additional 4 percent increase in accuracy. These findings underscore PTEI’s contribution toward advancing AI systems with more sophisticated social and psychological grounding.

[9] PolyInterview: An LLM-based Platform for Immersive Mock Interview Practice with Comprehensive Multimodal Assessment cs.CLPDF

Zhiyuan Wen, Jiannong Cao, Zijian Wang, Chen Chen, Xiaoyun Liu

TL;DR: PolyInterview是一个基于大语言模型的沉浸式模拟面试平台，通过多模态评估提供全面的面试练习。它利用职位描述和简历生成定制化问题，通过口型同步的数字人进行多轮语音对话，并评估回答内容、语音表达和非语言行为。平台通过四个并行评估器生成13个行为级特征，聚合为10个评估维度和两个能力轨道，最终生成包含行为证据和可操作建议的报告。

Details

Motivation: 解决求职面试准备中现实练习难以获取的问题：真实面试机会少、专家模拟辅导成本高、自我练习缺乏自适应对话和结构化评估。现有系统通常只通过固定问题序列、有限沟通渠道或缺乏证据支持的反馈来部分满足需求。

Result: 在93.7%的会话中，生成的问题与匹配的职位描述比跨角色描述更相关。十位专家的评估发现其问题计划和反馈具有很强的可操作性。平台公开可用，当前快照包含101个账户、1,564次面试会话、7,665个生成问题和1,422个五阶段问题集。

Insight: 创新点在于整合了基于LLM的个性化问题生成、口型同步数字人进行多轮自适应语音对话，以及结合KSA和STAR框架的全面多模态评估系统，将行为级特征聚合为结构化反馈。从客观角度看，其将多模态交互与基于证据的评估报告相结合，为技能培训领域提供了可扩展的沉浸式解决方案。

Abstract: Preparing for job interviews is important for securing desired positions, yet realistic practice remains difficult to access: real interviews are infrequent, expert mock coaching is costly, and self-practice offers neither adaptive dialogue nor structured assessment. Existing systems typically address only parts of this need through fixed question sequences, limited communication channels, or feedback with little supporting evidence. We present PolyInterview, an LLM-based platform for immersive mock interview practice with comprehensive multimodal assessment. PolyInterview uses the target job description and CV to generate questions tailored to the role and candidate, conducts multi-turn spoken interviews with a lip-synced digital human interviewer that asks answer-aware follow-up questions, and evaluates response content, vocal delivery, and non-verbal behavior. Four parallel evaluators produce 13 behavior-level features that are aggregated into 10 assessment aspects and two competency tracks. Guided by the KSA and STAR frameworks, the report links each score to behavioral evidence and actionable recommendations. PolyInterview is publicly accessible. Its current all-account snapshot contains 101 accounts, 1,564 interview sessions, 7,665 generated questions, and 1,422 five-stage question sets. Generated questions are more closely aligned with their matched job description than with cross-role job descriptions in 93.7% of sessions. An evaluation by ten experts found strong question plans and actionable feedback.

[10] A Stepwise Questioning Expert-Editor Multi-Agent Framework for Long-Document Summarization cs.CL | cs.AIPDF

Lingyun Shen, Xuejia Guo

TL;DR: 本文提出了一种专家-编辑逐步提问的多智能体框架，用于提升大语言模型在长文档摘要任务中的性能。该方法通过专家和编辑智能体引导其他智能体对摘要内容进行多角度提问并提供修订线索，从而优化摘要质量。

Details

Motivation: 大语言模型在新闻摘要任务中表现良好，但在处理长度超出输入限制的长文档摘要时仍面临挑战，需要提升其长文档摘要的有效性。

Result: 在两个代表性的长文档科学数据集上进行实验，使用广泛认可的自动指标评估，结果表明该方法有效。

Insight: 创新点在于引入专家-编辑多智能体协作的逐步提问机制，通过分步引导和针对性修订线索来优化摘要生成过程，这是一种结构化的提示工程方法。

Abstract: Although large language models (LLMs) have shown promising potential in news summarization tasks, their performance on long-document summarization remains challenging as their length often exceeds the input limits. As the agent investment, which provide possibility to improve the inherent capabilities of LLMs. To enhance the effectiveness of long-document summarization based on LLMs, this paper proposes an expert-editor stepwise questioning multi-agent method, in which the expert and the editor guide another agent to refine the summary by posing questions on different aspects of the content and providing targeted clues for revision. We conducted experiments on two representative long-document scientific datasets and evaluated the results through widely recognized automatic metrics. The results demonstrated the effectiveness of our method.

[11] Structured Thoughts For Improved Reasoning And Context Pruning cs.CL | cs.AIPDF

Zain Sarwar, Supriyo Chakraborty, Berkcan Kapusuzoglu, Chia-Hsuan Lee, Anirban Das

TL;DR: 本文提出了结构化思维框架，通过将推理过程组织成交替的<尝试>和<结果>块来改进大型语言模型的推理效率和内存使用。该方法通过重构数据集微调模型，在推理基准上实现了最高8.08%的性能提升，并支持上下文剪枝以节省85%的内存开销。

Details

Motivation: 解决大型语言模型生成冗长推理链时存在的冗余和内存效率低下的问题，旨在提升推理过程的组织性和效率。

Result: 在推理基准测试中性能提升最高达8.08%；上下文剪枝在数学任务上平均节省85%内存，但性能下降8.67%。

Insight: 创新性地将推理过程结构化，通过分离探索性草稿和精炼结论来优化模型推理；上下文剪枝机制允许保留结论而丢弃中间步骤，为长上下文处理提供了新思路。

Abstract: Large language models (LLMs) excel at generating long chains of thought, but long reasoning traces are often verbose and memory-inefficient. In this work, we introduce Structured Thoughts, a framework that organizes reasoning into alternating and blocks: captures exploratory scratch work, while contains the distilled conclusion of that step. We construct a dataset of structured thoughts by segmenting reasoning traces into blocks and prompting an LLM to summarize each step into its corresponding . Fine-tuning pretrained foundation models on this reformatted data produces models that adopt the structured reasoning style, leading to performance gains of up to 8.08% on reasoning benchmarks compared to standard SFT. The explicit structure also enables context pruning: after each / pair, the can be pruned, allowing the model to retain conclusions without keeping the full scratch work in the context. A proof-of-concept pruning implementation achieves an average of 85% memory / context savings with an 8.67% performance drop across mathematical tasks.

[12] Enjoy Your Talk: A Human-Centered Benchmark for Multi-Turn Dialogue with Decoupled User Simulation, Target Modeling, and Judging cs.CLPDF

Jinglan Gong, Jiefan Lu, Hewei Guo, Kehan Li, Zhiyuan Han

TL;DR: 本文提出了EYT-Bench，一个用于评估大语言模型多轮对话能力的人类中心化基准。该基准采用三方解耦设计：基于真实人物角色的用户模拟器、将意图感知与响应生成分离的目标模型，以及独立的第三方LLM评判器。研究揭示了当前先进模型在主观维度上表现接近，但在客观意图追踪上差异巨大，并发现推理能力能显著提升长上下文角色下的意图追踪准确性。

Details

Motivation: 现有单轮基准无法充分评估LLM在多轮对话中的关键能力，如角色一致性、意图演化追踪、情感动态和目标完成度，因此需要构建一个更全面、人类中心化的多轮对话评估框架。

Result: 在17个目标模型x200个对话的评估中，EYT-Bench发现：顶尖闭源与开源模型在主观维度（如共情、拟人化）上统计差异微小（≤0.3），但在客观意图追踪上差异高达9倍；推理能力（’thinking on’）能将Gemma-4在长上下文角色上的潜在意图准确率提升0.47-0.50；角色格式对轨迹分布影响显著，在Nemotron-USA数据集上最终意图完成率（FICR）饱和于0.95以上，而在PersonaMem-v2上则分布在0.53至0.88之间。

Insight: 创新点在于提出了一个解耦的三方评估框架，减少了LLM生成角色带来的偏见，并引入了轨迹级指标（如基于嵌入的意图漂移和FICR）。客观分析认为，将意图感知与响应生成分离、使用真实人类策划的角色数据、以及采用独立第三方评判与多评判集成，为更可靠、可解释的多轮对话评估提供了新范式。

Abstract: Evaluating large language models (LLMs) as multi-turn conversational partners requires probing capabilities that single-turn benchmarks miss: persona consistency, evolving intent tracking, emotional dynamics, and goal completion. We introduce EYT-Bench, a human-centered benchmark built around a three-party decoupled design: a persona-grounded user simulator, a target model that separates intent perception from response generation, and an independent third-party LLM judge with optional multi-judge ensembling. Personas are sampled from public human-curated corpora, Nemotron-Personas-USA and PersonaMem-v2, rather than synthesized, reducing LLM-induced persona bias. EYT-Bench also introduces two trajectory-level metrics: embedding-based intent drift and final-intent completion rate (FICR), inspired by tau-bench. In a 17-target x 200-dialogue evaluation, EYT-Bench reveals four findings: (i) state-of-the-art closed- and open-source models are statistically close on subjective dimensions (empathy / persona / anthropomorphism vary within <= 0.3), but differ by up to 9x on objective intent tracking; (ii) reasoning (“thinking on”) sharply improves objective tracking on long-context personas (+0.47-0.50 latent-intent accuracy on Gemma-4) while leaving subjective scores nearly unchanged; (iii) persona format dominates trajectory spread, with FICR saturating above 0.95 on Nemotron-USA but spreading from 0.53 to 0.88 on PersonaMem-v2; and (iv) the warm-up effect is robust on 16/17 models (one outlier, GPT-5.5, reverses the effect), with stable rankings across alpha in [0.05, 0.15]. A cross-judge ablation using deepseek-v4-pro confirms that target rankings and final-intent satisfaction are preserved across judges.

[13] When Reasoning Hurts Legal Drafting: The Verbalization Bottleneck in Patent Claim Generation cs.CLPDF

Lekang Jiang, Wenjun Sun, Stephan Goetz

TL;DR: 本文研究了思维链（CoT）提示在专利权利要求生成这一高度结构化法律文本生成任务中的适用性。研究发现，虽然推理增强的提示可以提升权利要求质量，但隐式CoT（即内部推理）的表现优于显式CoT（即外部语言化推理）。

Details

Motivation: 专利权利要求撰写是一项需要技术专长、精确语言控制和严格遵循格式的复杂法律任务。尽管CoT提示被广泛用于提升大语言模型的推理能力，但近期证据表明其在高度结构化或模式敏感的任务中可能收益有限甚至有害。因此，本文旨在探究CoT提示是否对专利权利要求生成有益。

Result: 通过自动指标和人类专家评估，结果表明推理增强提示可以改善权利要求质量。关键发现是，隐式CoT在性能上持续优于显式CoT。

Insight: 论文的创新点在于提出了针对专利权利要求生成的特定任务CoT方法，并揭示了一个反直觉但重要的经验发现：显式CoT可能通过抽象关键细节、破坏内化生成模式以及级联错误传播这三种机制，为权利要求生成引入不必要的信息瓶颈，从而损害最终输出质量。这为法律任务和CoT应用提供了新见解。

Abstract: Patent claim drafting is a challenging legal drafting task that requires technical expertise, precise linguistic control, strict adherence to formal conventions, and the preservation of complex logical relationships among claim elements. While Chain-of-Thought (CoT) prompting has been widely used to improve the reasoning capabilities of large language models (LLMs), recent evidence suggests that its benefits may be limited, or even negative, in highly structured or pattern-sensitive tasks. Therefore, this paper investigates whether CoT prompting benefits patent claim generation. We propose a task-specific CoT method for patent claim generation and evaluate its effectiveness through both automatic metrics and human expert assessment. Our results show that reasoning-enhanced prompting can improve claim quality. Moreover, we demonstrate a counter-intuitive but important empirical finding: implicit CoT, where reasoning is kept internal rather than explicitly verbalized, consistently outperforms explicit CoT. Through systematic analysis, we show that explicit CoT can introduce an unnecessary information bottleneck for claim generation. Verbalized reasoning may compromise the quality of final outputs through three specific mechanisms: abstraction of critical details, disruption of internalized generation patterns, and cascading error propagation. Our findings provide new insights into legal tasks and CoT applications.

[14] Articulate Intuition or Genuine Analysis? Benchmarking Epistemic Reliability in LLM-as-a-Judge Peer Reviews cs.CLPDF

Nuo Chen, Qian Wang, Qingyun Zou, Bingsheng He

TL;DR: 本文提出了Kahneman4Review基准，用于评估LLM作为同行评审法官时的认知可靠性。该基准包含3,563篇已评分的评审，从九个文本维度、八个偏见诊断和一个连续推理质量分数进行衡量。研究发现，LLM评审的决策层与基于文本的认知质量代理未对齐，公开展示的代理评审得分高于人类评审，但差距主要由长度和会议因素解释，且ICLR评审文本特征在LLM普及期发生转变。

Details

Motivation: 解决LLM作为同行评审法官时，其评价标准（如‘分析性’）与人类委员会评价标准（如‘高质量’）是否一致的问题，认为两者存在哲学差异，需建立可靠的基准来区分分析形式与认知功能。

Result: 在Kahneman4Review基准上，LLM评审的决策层与文本基础的认知质量代理未检测到对齐；公开代理评审得分高于人类评审，但经长度和会议调整后差距缩小；ICLR评审文本诊断在2022-2023年过渡期发生显著变化。

Insight: 创新点在于将卡尼曼的双过程理论操作化为结构化评审标准，并构建了强调认知可靠性的基准；客观分析认为，该研究通过区分表面流畅性与真实分析功能，为LLM评审的可靠性评估提供了新方法论和具体设计选择。

Abstract: When an LLM judge calls a peer review analytical and a human committee calls another review high quality, are they tracking the same thing? We argue they are not, and that the difference matters philosophically. We operationalise Kahneman’s dual-process theory into a structured rubric for peer review and release Kahneman4Review, a benchmark of 3,563 rated reviews scored along nine theoretically motivated textual dimensions, eight bias diagnostics, and a continuous reasoning-quality score. Three findings bear on trustworthiness: decision tier is not detectably aligned with the rubric’s text-grounded epistemic-quality proxy; public-showcase agentic reviews receive higher raw scores than pooled human reviews, but length and venue explain most of the gap and the samples are not paper-paired; and ICLR review-text diagnostics shift at the 2022–2023 transition, temporally coincident with widespread LLM availability but without identifying its cause. A matched function-probe pilot further shows that the rubric distinguishes textual probes designed to contrast genuine fault-finding with surface fluency. We argue that a trustworthy reliability benchmark for LLM judges must separate analytical form from epistemic function, and propose concrete design choices toward that goal. An interactive demo is available at https://huggingface.co/spaces/nuojohnchen/Kahneman4Review.

[15] UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp cs.CLPDF

Xiyu Wei, Qingwei Zong, Zhuocheng Yu, Sujian Li

TL;DR: 本文提出了UNIBROWSE，一个用于多模态浏览任务的数据到智能体框架。该框架通过一个统一的数据管道，首次同时生成覆盖文本、图像到文本和文本到图像三种信息流模式的训练数据，并利用增强的知识图谱和探索度指标来提升数据质量和训练效率。基于此数据训练的35B规模智能体在多个多模态BrowseComp基准测试中取得了最先进的性能。

Details

Motivation: 现有方法在构建多模态浏览任务训练数据时，主要覆盖文本和图像到文本模式，而忽略了文本到图像模式，这限制了智能体的通用性和鲁棒性。本文旨在解决这一数据覆盖不全的问题，以提升智能体在动态网页内容上的感知、工具使用和长程推理能力。

Result: 训练的UNIBROWSE智能体在五个不同的多模态BrowseComp基准测试中取得了平均54.4%的准确率，比其基础模型Qwen3.5-35B-A3B提升了10.5个百分点，并超越了GPT-5（42.9）、Gemini-2.5 Pro（44.8）和Gemini-2.5 Flash（41.3）等闭源智能体工作流，达到了最先进的水平。

Insight: 论文的核心创新在于提出了一个统一的数据生成管道，首次完整覆盖了多模态浏览中的三种关键信息流模式。此外，通过结合实时网络检索增强知识图谱，以及引入探索度指标来筛选高质量数据用于强化学习，有效提升了数据保真度和训练效率，为构建更通用的多模态智能体提供了新的数据工程思路。

Abstract: Multimodal BrowseComp tasks require agents to combine perception, tool use, and long-horizon reasoning over dynamic web content, challenging their ability to handle compositional structure, open-world uncertainty, and multimodal integration across extended interactions. Crucially, real-world multimodal browsing involves three distinct information-flow patterns: text-only, image-to-text, and text-to-image, yet existing data construction methods cover only the text-only and image-to-text patterns, leaving text-to-image largely unaddressed and limiting agent generality and robustness. We introduce UNIBROWSE, a unified data pipeline that for the first time simultaneously generates training data covering all three patterns, augments curated knowledge graphs with live web retrieval for improved fidelity, and introduces a novel metric of exploration degree to filter low-signal instances for efficient reinforcement learning. Through this pipeline, we produce high-quality cold-start tool-use trajectories and exploration-rich QA pairs, and train a 35B-scale agent via supervised fine-tuning and exploration-aware RL.The resulting UNIBROWSE agent achieves state-of-the-art performance on multimodal BrowseComp benchmarks, attaining an average accuracy of 54.4 across five diverse benchmarks – an improvement of 10.5 points over its base model Qwen3.5-35B-A3B – and surpassing serveral closed-source agent workflows such as GPT-5 (42.9), Gemini-2.5 Pro (44.8), and Gemini-2.5 Flash (41.3).

[16] Anamnesis: An Open-Source Platform for Large-Scale Backstory-Conditioned Survey Simulation cs.CL | cs.AI | cs.HCPDF

Song-Ze Yu, Joseph Suh, Serina Chang, David M. Chan

TL;DR: Anamnesis是一个开源的交互式系统，利用大语言模型进行人口统计学可控的调查模拟。该平台专为非技术用户和研究人员设计，通过在虚拟人群而非真实人类受试者上进行原型设计和压力测试来评估调查工具。它集成了Anthology和Alterity框架，使用结构化叙事背景故事来调节模型响应，并支持开放式生成、概率性人口统计重采样以及多模态（图像和音频）调查。

Details

Motivation: 为了解决在真实人群中进行调查工具原型设计和压力测试的成本高、耗时长的问题，论文旨在提供一个开源、透明且可复现的替代方案，以替代专有的模拟服务，使非技术用户也能轻松进行大规模、可控的调查模拟。

Result: 通过两个案例研究进行评估：一是复制皮尤研究中心美国趋势小组关于政治类型和生物医学问题的部分调查；二是模拟《纽约客》标题竞赛中的人类偏好。在这两种情况下，Anamnesis生成的意见分布比标准人物提示基线更接近真实世界的调查数据。

Insight: 论文的创新点在于将Anthology和Alterity框架（使用结构化叙事背景故事）操作化并集成到一个统一的Web界面中，实现了对模型响应的更精细控制。从客观角度看，其支持多模态调查和概率性人口统计重采样的设计，为大规模、可控的虚拟调查模拟提供了一个开源且用户友好的平台，增强了透明度和可复现性。

Abstract: We present Anamnesis, an interactive system for demographically controllable survey simulation using large language models. Open-source, and designed for non-technical users/researchers, Anamnesis enables the prototyping and stress-testing of survey instruments on virtual populations rather than real human subjects. The platform operationalizes the recently introduced Anthology and Alterity frameworks, which use structured narrative backstories to condition model responses, within a unified web interface. It supports open-ended generation, probabilistic demographic resampling, and multimodal (image and audio) surveys. We evaluate the system through two case studies: (1) replicating segments of Pew Research Center’s American Trends Panel (ATP) on political typology and biomedical issues and (2) emulating human preference in the New Yorker Caption Contest. In both cases, Anamnesis produces opinion distributions that more closely match real-world survey data than standard persona-prompting baselines, offering a transparent, reproducible, and open-source alternative to proprietary simulation services.

Ilia Karpov

TL;DR: MafiaScope是一个非侵入式、时间分辨的信念探测测试平台，将社交推理游戏《Mafia》转化为测量机器心智理论的工具。它通过在每个公开发言后让智能体私下回答结构化探测问题，自动对比游戏引擎已知的真相进行评分，并提供交互式可视化器展示信念轨迹。

Details

Motivation: 解决LLM智能体在社交推理游戏中公开行为难以揭示其真实信念的问题，例如正确投票可能是猜测，而说谎行为不会留下实际信念的痕迹。

Result: 在包含32场游戏、13,815个解析探测答案的DeepSeek案例研究中，智能体的置信度校准较差，预期校准误差为0.17，且过度预测被怀疑的概率是实际值的1.5倍。

Insight: 创新点在于将社交推理游戏转化为可配置的信念测量仪器，通过非侵入式探测和交互式可视化（包括模拟模式、时间线对齐面板和反事实重放）来量化分析LLM智能体的心智理论能力。

Abstract: An LLM agent’s public behaviour reveals little about its social reasoning: an agent that votes correctly may be guessing, and an agent that lies well leaves no trace of what it actually believes. We present MafiaScope, an open testbed that turns the social deduction game Mafia into a measurement instrument for machine Theory of Mind. After every public utterance, every agent privately answers a configurable set of structured probe questions; the answers never re-enter the game and are scored automatically against the ground truth the engine knows. An interactive visualizer renders the belief trajectories: impersonate mode shows the game as one agent sees it, panels chart timeline-aligned accuracy and calibration, and counterfactual replay forks any recorded step. In a 32-game DeepSeek case study with 13{,}815 parsed probe answers, stated confidence is poorly calibrated, with expected calibration error 0.17, agents over-predict being suspected 1.5 times, and a 30-fork replay experiment walks the counterfactual replay workflow end to end. Engine, viewer and a corpus of 200+ cross-model games are released under an open licence; live demo: https://karpovilia.github.io/mafiascope/; screencast: https://vimeo.com/1208920221.

[18] Knowledge Distillation for Automated AI Tutor Evaluation cs.CLPDF

Tahmid Al Hannan, Diego Garcia, Alex Njoroge, Suha Al Juboori, Tarek Sakakini

TL;DR: 本文介绍了FATE（FLC AI Tutor Evaluator），一个专门用于评估AI导师教学质量的8B参数语言模型。该模型基于BEA 2025共享任务的四个核心评估轨道（错误识别、错误定位、指导和可操作性）进行设计。为了解决教学评估任务标注数据有限的问题，作者利用前沿大语言模型进行知识蒸馏以生成额外监督信号，显著提升了模型性能。最后，论文展示了FATE作为自动评估工具在评估主流商业模型（如ChatGPT、Claude、Gemini和DeepSeek）教学响应质量方面的实用性。

Details

Motivation: 随着大语言模型在K-12和高等教育中的快速整合，其教学质量的可靠评估方法发展滞后，研究社区开始探索自动化评估AI导师的解决方案。

Result: 通过知识蒸馏，模型性能获得了高达22.63个百分点的绝对提升。在评估主流商业模型的基准测试中，Gemini 2.5 Flash表现最佳（82.88%），其次是ChatGPT 5.5 Instant（80.75%）、DeepSeek V4 Flash（80.13%）和Claude Sonnet 4.6（74.00%）。

Insight: 论文的创新点在于针对高度专业化的教学评估任务，构建了一个专门的评估模型（FATE），并利用知识蒸馏技术缓解了该领域标注数据稀缺的问题，为自动化评估AI导师的教学质量提供了可行的技术路径。

Abstract: The rapid integration of Large Language Models (LLMs) into K-12 and higher education has outpaced the development of reliable methods for evaluating their pedagogical quality. As the research community starts to explore the space of automating evaluation of AI tutors, we introduce FATE (FLC AI Tutor Evaluator), a specialized 8B-parameter language model designed to evaluate AI tutors. Aligned with the four core evaluation tracks from the BEA 2025 Shared Task, our model assesses pedagogical ability across Mistake Identification, Mistake Location, Guidance, and Actionability. Because pedagogical evaluation is a specialized task with limited labeled data, we leverage knowledge distillation from a frontier LLM to generate additional supervision, yielding absolute performance gains up to 22.63 percentage points. Finally, we demonstrate FATE’s utility as an automated evaluator by benchmarking instructional responses generated by popular commercial models, including ChatGPT, Claude, Gemini, and DeepSeek. On average, we have found that Gemini 2.5 Flash perfomed best (82.88%), then ChatGPT 5.5 Instant (80.75%), followed by DeepSeek V4 Flash (80.13%) and Claude Sonnet 4.6 (74.00%).

[19] Trust Before Fusion: QIMG-7 and Source-Aware Resolution for Polluted Multimodal RAG cs.CLPDF

Saadeldine Eletter, Owais Aijaz, Preslav Nakov

TL;DR: 本文针对多模态检索增强生成（RAG）在现实场景中可能检索到被污染（如虚假文本或误导性图像）证据的问题，提出了QIMG-7基准测试来系统评估污染影响，并提出了无需训练的源感知信任解析（SATR）方法，通过比较不同来源的候选答案并基于可靠性进行选择，显著提升了在污染环境下的鲁棒性。

Details

Motivation: 现实世界中的多模态RAG系统可能检索到主题相关但不可靠的内容（如错误文本、误导性图像），而现有评估通常在干净证据下进行，这导致了性能评估与实际情况的脱节。

Result: 在提出的QIMG-7基准上，实验表明朴素的多模态融合在污染文本下性能大幅下降（从0.908降至0.490）。提出的SATR方法（特别是Field-Selector变体）取得了最佳平衡分数0.816，相比全多模态融合提升了11.7个百分点，优于级联路由器。

Insight: 核心创新在于提出了一个系统性的多模态检索污染基准QIMG-7，以及一种无需训练、基于源感知信任解析的决策框架。关键洞见是：在文本优先的事实问答场景中，当面临多模态检索冲突时，应进行选择性信任而非无条件融合，且显式的文本可靠性建模是性能提升的主要驱动力。

Abstract: Multimodal retrieval-augmented generation (RAG) is often evaluated with clean evidence, yet real retrieval can return topically relevant but unreliable content: false text and misleading images from corrupted metadata, entity swaps, typographic overlays, semantic edits, adversarial patches, blends, or style transfer. We introduce QIMG-7, a controlled benchmark for multimodal retrieval pollution in multi-sentence factual QA, spanning four datasets, seven image-attack families, and 16 paired clean/polluted regimes, for 1,760 evaluation rows per method. Across four generator/gate stacks, naive multimodal fusion is brittle: in the main gpt-4o-mini stack, Full-MM support drops from 0.908 with clean text to 0.490 with polluted text, often making Parametric fallback safer than retrieval. We propose source-aware trust resolution (SATR), a training-free approach that compares Parametric, Text-only, and Full-MM candidate answers and selects among candidate answers or falls back based on source reliability. The Field-Selector variant achieves the best balanced score, 0.816, improving over Full-MM by 11.7 points and over the Cascaded Router by 2.7 points. Ablations show that, in this text-first setting, explicit text-reliability modeling is the dominant driver of these gains. Overall, in text-first factual QA with multimodal retrieval conflict, our results support selective trust rather than unconditional fusion. Artifacts are available at https://github.com/SaadElDine/Trust_Before_Fusion.

[20] Diagnosing and Mitigating Thinking Collapse in On-Policy Self-Distillation cs.CL | cs.LGPDF

Keqin Peng, Chen Li, Yuanxin Ouyang, Yancheng Yuan, Liang Ding

TL;DR: 本文系统研究了策略内自蒸馏（OPSD）在复杂推理任务中导致性能下降的病理现象，即“思维崩溃”，并提出了一种名为自适应双视角OPSD（AD-OPSD）的鲁棒控制框架来缓解此问题。AD-OPSD通过动态调节自蒸馏目标，选择性地锚定高风险抑制的沙盒令牌，在保留OPSD纠错能力的同时维持模型固有的推理能力。

Details

Motivation: 策略内自蒸馏（OPSD）是增强和对齐大语言模型的关键范式，但在复杂推理任务中，它反而会降低下游性能。本文旨在系统研究这一病理现象，并解决由此引发的优化陷阱。

Result: 在多个竞争性数学基准测试上的广泛实验表明，AD-OPSD相比标准OPSD在不同模型规模和数据集上平均绝对准确率提升高达+4.1%。进一步分析证明AD-OPSD缓解了思维崩溃，并能鲁棒地泛化到不同的后训练范式。

Insight: 核心创新点是识别并定义了“思维崩溃”这一优化陷阱，即模型原生中间推理行为的急剧下降，并通过基于熵的梯度掩码和令牌级目标分析揭示了其触发机制。提出的AD-OPSD框架通过非对称逐点散度门动态调节目标，选择性地保护高风险令牌，这是一种新颖的缓解策略内自蒸馏负面效应的控制方法。

Abstract: On-Policy Self-Distillation (OPSD) has emerged as a crucial paradigm for enhancing and aligning Large Language Models (LLMs). However, in complex reasoning tasks, OPSD paradoxically degrades downstream performance. In this paper, we systematically investigate this pathology and identify a severe optimization trap we define as \textbf{Thinking Collapse} – a sharp decline in the model’s native intermediate reasoning behavior, measured by epistemic-token density (ET per 1k). Through entropy-based gradient masking and token-level target analysis, we show that this collapse is triggered by aggressive teacher gradients at high-student-entropy decision forks, where student epistemic tokens are frequently suppressed into teacher non-epistemic targets and are highly concentrated in high pointwise student-teacher divergence regions. To resolve this optimization pathology, we propose \textbf{Adaptive Dual-Perspective OPSD (AD-OPSD)}, a robust control framework that dynamically moderates the self-distillation objective. AD-OPSD selectively anchors high-suppression-risk sandboxed tokens to a reference prior derived from the frozen base model via an asymmetrical pointwise divergence gate, preserving native thinking capacity while retaining OPSD’s error-correcting power. Extensive experiments across competitive mathematical benchmarks show that AD-OPSD improves over standard OPSD by up to \textbf{+4.1%} absolute average accuracy across diverse model scales and datasets. Further analysis demonstrates that AD-OPSD mitigates thinking collapse and generalizes robustly to different post-training paradigms.

[21] Quantifying the Sources of Instability in LLM-Based Stance Analysis of Public Discourse cs.CLPDF

Bo Chen

TL;DR: 本文量化了基于LLM的公共话语立场分析中不稳定性的来源，通过比较两种说话人日记化预处理流水线和两种测量方法（LLM标注与关键词词典），发现测量方法选择带来的不一致性比预处理流水线更大且更系统化，而聚合的情感比例则高度稳定，掩盖了这些不稳定性。

Details

Motivation: 解决计算社会科学中，自动化预处理流水线（如说话人日记化、ASR转录清洗、句子分割）和下游测量工具（如LLM标注）的差异如何共同导致分析结果不稳定，从而影响研究结论的可靠性的问题。

Result: 在包含41位公众人物的256个YouTube访谈数据集上，发现预处理流水线敏感性集中在样本量少的说话人上；对于样本量充足的说话人，流水线引起的平均绝对变化仅为0.13；而LLM与关键词词典方法对多个样本充足的说话人给出了相反的耦合方向；聚合情感比例变化小于6个百分点，掩盖了不稳定性。

Insight: 提出了一个诊断框架，将预处理流水线效应与测量效应分离，强调研究者在分析访谈数据中的跨维度关系时，需确保结论对这两种变异源都具有鲁棒性，并特别关注测量方法的选择。

Abstract: Computational social science increasingly relies on automated preprocessing pipelines – speaker diarization, ASR transcript cleaning, sentence segmentation – to convert raw media into analyzable text. When these pipelines produce different outputs from the same input, two distinct sources of instability can arise: the preprocessing pipeline itself (diarization method, segmentation rules) and the downstream measurement instrument (LLM annotation vs.\ keyword lexicon). Using 256 YouTube interviews across 41 public figures from five domains, we compare two speaker-diarization pipelines and two measurement methods, all targeting the coupling between affective valence and epistemic modality. We find that (1) preprocessing pipeline sensitivity is concentrated in speakers with limited video samples (N $\leq 5$); for the four best-sampled speakers (N $\geq 16$), the mean absolute pipeline-induced change in $r(\text{neg}, \text{emph})$ is only $0.13$; (2) cross-method disagreement is larger and more systematic – the LLM and keyword-lexicon methods assign opposite coupling directions to several well-sampled speakers, even within the same preprocessing pipeline; and (3) aggregate valence proportions are highly stable ($|Δp(\text{neg})| < 6$pp) regardless of pipeline or method, masking both sources of instability. The contribution is a diagnostic framework that separates pipeline effects from measurement effects: researchers studying cross-dimensional relationships in interview data should verify that their conclusions are robust to both sources of variation, with particular attention to measurement method choice.

[22] Capabilities of Claude Fable 5 on Biomedical Challenge Problems cs.CLPDF

Dominic Okonkwo, Magnus Hodgson, Temitope I. David, Susan Adanna Ihejirika

TL;DR: 本文评估了Claude Fable 5在八个生物医学基准（四个文本、四个多模态）上的性能，并与Claude前代模型及GPT-5进行对比。研究发现，Fable 5在不同基准上表现出8.0%至99.4%的高拒绝率，但若排除被拒绝的问题，其准确率在所有基准上均达到或超过其他模型。

Details

Motivation: 当前前沿语言模型在生物医学基准上的评估存在两个问题：传统基准已接近饱和，且开放式回答通常由其他语言模型评分。本研究旨在通过确定性评分和固定答案键，对Claude Fable 5进行更可靠的评估。

Result: 在排除拒绝回答的问题后，Fable 5在所有八个生物医学基准上的准确率均达到或超过基线模型（包括Claude前代模型和GPT-5），实现了SOTA水平。

Insight: 论文的核心发现是Fable 5存在高且模式化的拒绝行为，这成为其生物医学应用的主要限制因素，而非其实际能力。创新点在于将拒绝率作为独立结果进行系统追踪，并识别出两种可区分的拒绝模式：集中于基础科学/机制内容（如MedQA）和特定疾病领域（如RareBench中的先天性代谢疾病）。

Abstract: Frontier language models are increasingly evaluated on biomedical benchmarks, but two problems undermine most published evaluations: legacy benchmarks are near-saturated, and open-ended responses are graded by other language models. We evaluate Claude Fable 5, Anthropic’s most capable publicly available model, across eight biomedical benchmarks, four text and four multimodal, using deterministic scoring against fixed answer keys throughout. We include two Claude predecessors and GPT-5 as baselines. Refusal is tracked as a distinct outcome in every result table. That decision produces the paper’s central finding. Fable 5 refuses between 8.0% and 99.4% of questions depending on the benchmark, a pattern absent in both predecessors and in GPT-5. Once refused items are excluded from the denominator, Fable 5’s accuracy exceeds or meets every other model on every benchmark in this study. We identify two distinguishable refusal patterns: one concentrating in basic-science and mechanism content across MedQA and MedXpertQA MM, confirmed independently on two benchmarks using each benchmark’s own category labels; and a separate disease-domain pattern on RareBench, where inborn metabolic disease presentations are refused near-universally while adult-onset autoimmune presentations are not. The primary constraint on Fable 5’s biomedical usefulness is willingness to engage, not capability once it does.

[23] EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models cs.CLPDF

Jie Sun, Mao Zheng, Mingyang Song, Qiyong Zhong, Gengsheng Li

TL;DR: 本文提出了EasyOPD，一个基于分布式强化学习框架verl构建的、易于使用的策略蒸馏框架，旨在解决现有策略蒸馏方法在实现上碎片化、难以复现和扩展的问题。该框架将用户配置、方法特定的监督逻辑与执行后端分离，并通过模块化设计支持多种策略蒸馏设置。

Details

Motivation: 现有策略蒸馏方法在监督形式、分词器兼容性、教师模型访问方式和监督粒度上差异巨大，导致实现碎片化，难以复现和扩展。

Result: 在推理、代码生成、科学知识和工具使用等多个基准测试上的实验表明，通过EasyOPD实例化的不同方法可以在相同的verl后端上执行，同时保持各自方法特定的目标和与任务相关的性能表现。

Insight: 主要创新点在于提出了一个统一的、模块化的策略蒸馏框架，通过清晰的扩展边界（如损失构建、轨迹元数据处理、奖励处理等）将方法逻辑与执行后端解耦，从而支持多种蒸馏设置（如跨分词器蒸馏、策略自蒸馏和步长蒸馏）的便捷实现与复现。

Abstract: Conventional language-model distillation often relies on fixed teacher-generated data, which may not cover the states encountered by an evolving student policy. On-policy distillation (OPD) instead collects teacher or evaluator supervision on student-generated rollouts. However, existing OPD methods differ substantially in supervision form, tokenizer compatibility, teacher access, and supervision granularity, leading to fragmented implementations that are difficult to reproduce and extend. We present \textsc{EasyOPD}, an on-policy distillation framework built on verl, a distributed reinforcement-learning framework for large language models. \textsc{EasyOPD} separates user-side configuration, method-specific supervision logic, and verl-based execution. Its method modules connect to the shared backend through extension boundaries for loss construction, rollout metadata, reward processing, tokenizer alignment, and teacher-side computation. We instantiate representative methods for three OPD settings – cross-tokenizer OPD, on-policy self-distillation, and step-wise OPD. Experiments on reasoning, code-generation, scientific-knowledge, and tool-use benchmarks show that these implementations can be executed through the same verl-based backend while retaining their method-specific objectives and task-dependent performance profiles. We release \textsc{EasyOPD} with runnable YAML configurations, documentation, and an installable demonstration package and video.

[24] Flout at Your Own Risk: LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry cs.CL | cs.AIPDF

Hannah VanderHoeven, Abhijnan Nath, Nikhil Krishnaswamy

TL;DR: 本文研究了大型语言模型在多智能体协作任务中，面对信息不对称情况下的语用推理能力。通过形式化协作认知不对称概念，并基于格莱斯合作原则评估LLM作为说话者和倾听者的表现，发现尽管通过提示和微调可激发一定语用能力，但LLM在信息不完整时仍存在语用沟通困难，且某些失败模式与未被识别的格莱斯准则违反相关。

Details

Motivation: 随着LLM在协作和智能体管道中的广泛应用，需要评估其在信息不对等场景下是否具备人类协作沟通所需的语用能力，特别是能否根据上下文线索进行推理。

Result: 实验表明，LLM在协作场景中展现出部分语用能力，通过提示和微调可提升表现，但在信息不完整时仍面临挑战，且失败案例与未被察觉的格莱斯准则违反存在相关性。

Insight: 创新点在于将协作认知不对称形式化，并系统评估LLM在信息不对等下的语用协作能力；客观来看，该研究为LLM的语用推理缺陷提供了实证分析框架，揭示了当前模型在复杂协作沟通中的局限性。

Abstract: Fruitful collaborations rely on cooperative communications, including of contextual cues to incorporate into reasoning. The increasing use of LLMs in collaborative and agentic pipelines raises questions about the extent to which they exhibit these pragmatic capabilities, especially in scenarios where they may not have access to the same information as their collaborators. In this paper, we perform a novel investigation into the pragmatic reasoning capabilities of LLMs in a multi-party collaborative task under partial information conditions. We formalize a notion of collaborative epistemic asymmetry that explicitly connects objective task success to Grice’s cooperative principle and empirically assess various LLMs’ abilities to act cooperatively as both speakers and listeners, including both prompting and post-training strategies. Our results show that while LLMs exhibit certain pragmatic capabilities in collaborative settings, and these can be elicited through prompting and post-training, they still face challenges in pragmatic communication with incomplete information, and that certain failure modes do correlate with floutings of Grice’s maxims that go unrecognized.

[25] TIGER: Text-Conditioned Visual Gated Routing with Acceptance Alignment for Multimodal Speculative Decoding cs.CLPDF

Quynh Vo, Cong-Duy Nguyen, Ponhvoan Srey, Luu Anh Tuan, Thong Nguyen

TL;DR: 本文提出了TIGER框架，一种用于多模态推测解码的文本条件视觉门控路由方法。它通过动态选择与当前文本状态相关的稀疏视觉令牌，并采用基于接受前缀长度的对齐训练策略，旨在解决现有方法在视觉语言模型中加速效果有限的问题。

Details

Motivation: 现有推测解码方法在纯文本LLMs中有效，但在视觉语言模型中加速增益有限，因为草稿模型在视觉关键内容上容易产生分歧，且现有多模态加速方法未能直接处理无关视觉证据或优化决定加速效果的关键接受前缀长度。

Result: 实验表明，在精确的验证器端推测解码下，TIGER在接受的令牌前缀长度和推测加速方面取得了一致的提升，同时在视觉路由分析中实现了具有可比下游准确度的良好质量-延迟权衡。

Insight: 核心创新点在于文本条件视觉门控路由机制，它动态地、稀疏地选择上下文相关的视觉令牌，而非使用全部或固定压缩的视觉接口；以及基于接受前缀长度对齐的组策略训练，通过验证器派生的奖励优化草稿模型，使其生成的推测延续能通过更长的验证前缀，从而直接优化推理效率。

Abstract: Speculative decoding accelerates autoregressive generation by letting a lightweight drafter propose multiple tokens that are verified by a larger target model. Although effective for text-only LLMs, speculative decoding yields limited gains in VLMs because drafters often diverge on vision-critical content, while existing multimodal acceleration methods do not directly address irrelevant visual evidence or optimize the verifier-accepted prefix length that governs speedup. We propose TIGER, a Text-conditioned vIsual GatEd Routing framework for multimodal speculative decoding. TIGER dynamically selects a sparse set of context-relevant visual tokens based on the drafter’s current textual state, rather than expose the full visual token set or a fixed compressed interface. To better align training with inference-time efficiency, we optimize the drafter with acceptance-aligned group-based policy training using verifier-derived rewards based on accepted prefix length, built on top of distillation warm start with KL anchoring. This encourages the drafter not only to imitate the target model, but also to produce speculative continuations that survive verification for longer prefixes. Experiments show that TIGER yields consistent gains in accepted prefix length and speculative speedup under exact verifier-side speculative decoding, while achieving favorable quality-latency trade-offs with comparable downstream accuracy in visual-routing analyses.

[26] ProgramTab: Boosting Table Reasoning of LLMs via Programmatic Paradigm cs.CL | cs.AIPDF

Pei Guo, Enjie Liu, Yunzhi Tan, Mochi Gao, Jianxin Zhang

TL;DR: 本文提出了ProgramTab框架，通过编程范式提升大语言模型（LLMs）的表格推理能力。该框架利用上下文学习引导LLMs使用Python代码进行表格数据预处理，并结合行列提取与SQL生成来提取关键信息，以解决大表格处理中的性能下降问题。

Details

Motivation: 现有基于LLM的表格推理方法在处理大表格时，因长文本建模困难和输入长度限制导致性能显著下降；而文本到SQL方法虽能提取关键信息，但面对结构不一致的表格（如网络表格）时，难以执行数学逻辑运算。

Result: 在表格推理数据集上的实验结果表明，ProgramTab框架能有效处理基于表格的推理任务，并超越了所有基于LLM的基线方法。

Insight: 创新点在于将编程范式（Python代码预处理与SQL生成结合）引入表格推理，通过上下文学习引导LLMs动态处理非结构化表格数据，从而提升对大表格和复杂逻辑的适应性。

Abstract: Table-based reasoning with large language models (LLMs), which requires reasoning based on natural language questions and structured tabular data, has gained widespread attention. However, a series of issues still constrain the application of this task. The previous approaches suffered from significant performance degradation when faced with large tables due to the difficulty of long text modeling and the limitation of input length for LLMs. The text-to-SQL approach is used to efficiently extract key information from tables and generate smaller sub-tables. However, tabular data, especially web tables, often lack the necessary structure and consistency, making them unsuitable for performing mathematical logic operations using SQL queries. We propose the ProgramTab framework, which guides LLMs employing in-context learning to perform tabular data preprocessing with Python code, as well as the momentous contents extraction with row and column extraction and SQL generation. The experiment results on table reasoning datasets demonstrate that the ProgramTab framework effectively deals with table-based reasoning tasks and outperforms all LLM-based baselines.

[27] TreeThink: A Modular Tree Search Library for Mathematical Reasoning with LLMs cs.CLPDF

Burak S. Akbudak, Zeynel A. Uluşan, Can S. Erer, Gözde Gül Şahin

TL;DR: TreeThink是一个用于神经定理证明的模块化、完全异步树搜索开源Python库，集成了多种树搜索方法、基于vLLM的推理管道以及从轻量级启发式到神经评估器的节点评估技术。它支持Lean 4、Rocq、Isabelle/HOL等正式语言以及自然语言，通过直接连接各语言的REPL服务器实现实时验证和证明状态提取。在miniF2F和MATH500基准测试中，TreeThink展示了跨语言正式证明搜索、自然语言推理支持以及异步执行带来的高达6.3倍的加速效果。

Details

Motivation: 现有LLM树搜索库主要针对自然语言推理，缺乏与形式验证器的原生集成，而定理证明系统通常依赖特定任务的搜索实现，因此需要一种模块化、通用的树搜索库来支持神经定理证明。

Result: 在miniF2F和MATH500基准测试中，TreeThink实现了跨语言正式证明搜索和自然语言推理支持，异步执行带来了高达6.3倍的加速。

Insight: 创新点包括模块化、完全异步的树搜索架构，集成多种搜索方法和评估技术，以及直接连接形式语言REPL服务器实现实时验证，为神经定理证明提供了通用且高效的库支持。

Abstract: Tree search algorithms enable systematic exploration of the proof space in neural theorem proving. Existing LLM tree search libraries primarily target natural language reasoning and do not provide native integration with formal verifiers, while theorem proving systems often rely on task-specific search implementations. We introduce TreeThink, an open-source Python library for modular, fully asynchronous tree search in neural theorem proving. It integrates established tree search methods with vLLM-based inference pipelines and diverse node evaluation techniques, ranging from lightweight heuristics to neural evaluators. We support Lean~4, Rocq, and Isabelle/HOL alongside natural language. It connects directly to each language’s Read-Eval-Print Loop (REPL) server for real-time verification and proof state extraction. We evaluate TreeThink on miniF2F and MATH500, demonstrating cross-language formal proof search, natural language reasoning support, and up to 6.3$\times$ wall-clock speedup from asynchronous execution. Source code is released under the MIT license at https://github.com/GGLAB-KU/treethink , and the library is accessible as a downloadable package at https://pypi.org/project/treethink/ .

[28] Automated Textbook Auditing with Multi-Agent LLM Systems cs.CL | cs.AI | cs.CY | cs.MAPDF

Ciprian Cristescu, Adrian-Marius Dumitran, Angela-Liliana Dumitran, Gabriel Stefan

TL;DR: 本文提出了AI Textbook Auditor，一个模块化的多智能体LLM系统，用于自动化审计教科书的PDF文件，生成结构化报告。该系统通过事实与技术轨道（检测事实错误、代码错误、定义错误和概念不一致）和语法轨道（原生处理PDF以保留变音符号）进行分析，并使用法官智能体过滤误报，最终输出供人工审核的报告。

Details

Motivation: 现有通用语法检查器无法同时审计教科书的事实准确性、领域技术正确性和语言质量，需要一种自动化、多方面的质量保证工具来减少人工审核工作量。

Result: 在罗马尼亚两本高中教科书（计算机科学、历史与社会科学）上进行了演示：CS教科书检测出56个技术问题（专家验证精度为62.5%），历史教科书检测出72个问题（包括事实错误、意识形态偏见和语法错误）。

Insight: 创新点在于设计了一个模块化、多轨道（事实/技术与语法）的多智能体LLM管道，支持PDF原生处理和领域自适应提示，并引入法官智能体进行误报过滤，将系统定位为辅助人工审核的预筛选工具而非完全自动化解决方案。

Abstract: Ensuring the quality of educational materials requires more than standard proofreading: textbooks must be audited for factual accuracy, domain-specific technical correctness, and linguistic quality simultaneously – a task that general-purpose grammar checkers cannot address. We present \textbf{AI Textbook Auditor}, a modular multi-agent pipeline for automated quality assurance of educational materials across subject domains. The system accepts a textbook PDF and produces a structured, human-reviewable report via two analysis tracks: a \textbf{Factual and Technical Track} in which an ensemble of specialized LLM agents detects factual inaccuracies, code errors, incorrect definitions, and conceptual inconsistencies, augmented with web search for humanities domains; and a \textbf{Grammar Track} operating PDF-natively to preserve diacritical encoding. A \textbf{Judge Agent} filters false positives using domain-specific rules before presenting findings to a human reviewer. The pipeline supports two ingestion modes – vision-native page rendering and PyMuPDF text extraction – and is domain-adaptable via custom prompts encoding subject-specific error taxonomies. We demonstrate the system on two Romanian upper-secondary textbooks: a CS textbook (56 technical findings across seven categories, with an expert-validated precision of 62.5%) and a history and social sciences textbook (72 findings spanning factual errors, ideological bias, and grammar). The system is designed as a triage tool that reduces the manual effort of locating candidate issues, with human expert validation required before any editorial action.

Raviteja Boddu, Guilherme Vieira Leite, Joed Lopes da Silva, Ângelo Benetti, Isabela Barbieri

TL;DR: 本文介绍了In-Car Sign Language (ICSL)数据集，这是一个针对巴西手语（Libras）的多模态资源，旨在解决在出租车、拼车等共享出行服务的车内受限空间中手语识别的挑战。该数据集包含高精度实验室运动捕捉数据和真实车内2D相机与3D ToF传感器记录的多模态数据，用于支持受限空间手语识别模型的训练与评估。

Details

Motivation: 解决在真实世界受限环境（如车辆内部）中使用手语识别的挑战，以提升聋哑及听力障碍群体在公共交通中的可访问性，该领域目前尚未得到充分探索。

Result: 构建了一个超过150万帧的多模态数据集，包含同步的多模态流数据，并提供了词汇和非词汇手语元素的注释，专门用于支持深度神经网络的训练和评估。

Insight: 创新点在于首次提出了一个专注于车内受限空间的手语数据集，结合了实验室理想化数据和真实世界多模态记录，为研究鲁棒的’野外’手语识别模型和领域自适应提供了基础；客观分析认为，该数据集将车内手语识别作为一个技术上有意义的受限、遮挡和非正面环境的案例，有助于推动车载可访问性研究。

Abstract: This paper addresses the challenges of using sign language within shared mobility services, such as taxis, carpools, or ride-sharing platforms. The use of sign language recognition (SLR) in real-world, confined environments, specifically vehicle interiors remains largely unexplored. To motivate research in this area, we present the In-Car Sign Language (ICSL) dataset for Brazilian Sign Language (Libras), with the long-term goal of improving public transport accessibility for the Deaf and Hard-of-Hearing community. The dataset consists of: (1) high-precision laboratory motion capture (MoCap) data to establish an idealized linguistic baseline and (2) real-world multi-modal in-car recordings captured using a 2D camera and 3D Time-of-Flight sensors. The dataset provides a basis for comparative analyses between synthesized signing avatar animations and recorded real signing interpreter videos, which enable future research into robust “in-the-wild” SLR models and domain adaptation. We describe in detail the use cases, the setup, the data collection protocol, and the metadata structure of the corpus. In total, we recorded a multimodal dataset exceeding 1.5 million frames, comprising the synchronized multimodal streams described above featuring Libras users across various in-car scenarios. The corpus is provided with gloss annotation of lexical signs and non-lexical sign language elements specially designed to support the training and evaluation of deep neural networks for constrained space recognition. In-vehicle signing offers a technically significant example of a constrained, occluded, and non-frontal environment. While recognizing the diverse communication strategies already employed by the Deaf community, identifying automotive-specific limitations provides a useful stepping stone for research into enhancing in-car accessibility and passenger quality of life.

[30] Agentic Routing: The Harness-Native Data Flywheel cs.CL | cs.AIPDF

Xinchen Liu, Hang Zhou, Yingjie Zong, Yuchuan Tian, Liuyang Song

TL;DR: 本文提出了一种名为Harness-Native Agentic Routing的智能体路由范式，旨在解决大型语言模型智能体执行过程中模型选择的核心系统问题。该方法基于完整的执行状态，在步骤级别选择单一最佳模型以节约成本，或选择多个互补模型以提升准确性，并利用路由决策产生的结构化数据记录构建一个数据飞轮，持续优化路由策略和模型。

Details

Motivation: 随着前沿和开源模型在结构上日益专业化，单一模型难以在所有任务轴向上都表现优异，使得智能体内部的模型选择成为一个核心系统问题。现有路由方法主要优化单轮的成本-质量权衡，忽略了智能体执行状态、中间失败和反馈循环等关键特性。

Result: 该方法在OpenSquilla系统中实例化，包含一个四层路由栈和一个开源的LightGBM冷启动排序器。报告在DRACO和PinchBench等智能体基准测试上研究了单模型和多模型路由，论证了智能体路由不仅是成本控制，更是面向智能体训练的数据引擎。

Insight: 核心创新在于将每次路由决策视为一个结构化数据记录，这些记录由环境自动标注，形成一个‘数据飞轮’，能够持续训练更好的路由器和模型。这提供了一种将智能体执行与模型优化紧密结合的系统化方法，超越了传统的单次查询优化。

Abstract: Large language model agents are increasingly executed not by a single model call, but by an execution harness that manages observation, context, control, action, state, and verification. At the same time, frontier and open models are becoming structurally specialized: a model that is strong at code editing, long-context recovery, tool use, mathematical reasoning, or low-latency response may not dominate on the other axes. This makes model selection inside an agent a core systems problem rather than a per-query serving trick. Existing routing methods mostly optimize single-turn cost-quality trade-offs and therefore miss the execution state, intermediate failures, and feedback loops that make agents different from chat completion. We propose Harness-Native agentic routing, a step-level routing paradigm that selects either a single best-fit model for cost-effective execution or multiple complementary models for ensemble-style accuracy improvement, conditioned on the full harness state. The key insight is that every routing decision naturally produces a structured data record – consisting of the query, harness state, model choice or model set, execution trace, outcome, and cost – whose labels are supplied by the environment rather than by the router itself. These records form a harness-native data flywheel: execution traces train better routers and harness-native models, which improve cost-quality trade-offs and generate more traces under the same budget. We instantiate this idea in OpenSquilla with a four-layer routing stack, an open LightGBM cold-start ranker, and a staged router-model path that turns logged arena records into progressively stronger routing policies. The report studies singleton and multi-model routing on agentic benchmarks including DRACO and PinchBench, and argues that agentic routing is not merely cost control, but a data engine for agent-native training.

[31] Beyond Sally-Anne: Evaluating Theory of Mind in LLMs using Epistemic Schelling Points cs.CL | cs.AIPDF

Roberta Rocca, Sami Boukortt, Geoff Keeling, Winnie Street

TL;DR: 本文提出了一种名为EAST（Epistemic Asymmetry Schelling Task）的新型评估任务，用于测试大语言模型（LLMs）在复杂社交推理中的心智理论（ToM）能力。该任务通过设计一个双玩家对话游戏，要求模型在信息不对称的条件下独立协调并达成语义上的谢林点，从而评估其稳健且可泛化的心智理论应用能力。研究发现，尽管前沿模型能成功应对任务，但多数模型在功能性社交推理上存在显著能力差距，其协调失败主要源于知识追踪错误。

Details

Motivation: 针对现有基于文本的心智理论评估（如Sally-Anne任务）可能因预训练数据泄露而被模型“取巧”，且难以泛化到自然场景的问题，本文旨在开发一种更稳健、更通用的评估方法，以测试LLMs在实际社交互动中的功能性心智理论能力。

Result: 在EAST基准测试中，只有前沿模型（如GPT-4等）能够成功应对不同知识透明度下的任务需求，而大多数模型表现出显著的功能性社交推理能力差距。尽管这些模型在传统静态基准测试上表现优异，但在EAST任务中，协调失败主要由知识追踪错误（如混淆私有知识与共同知识）导致。

Insight: 论文的创新点在于设计了EAST这一动态、交互式的评估框架，通过引入知识不对称和协调需求，更真实地模拟了人类社交推理的复杂性。从客观角度看，该方法揭示了LLMs在稳健的社交推理和精确的知识状态追踪方面仍是关键瓶颈，为未来的模型评估和发展提供了具体目标。

Abstract: Text-based evaluations of Theory of Mind (ToM) in Large Language Models (LLMs) often involve cognitive tests akin to the Sally-Anne task that can be gamed due to exposure to relevantly similar tasks in pre-training and do not obviously test models’ functional ToM abilities in ways that generalize to naturalistic settings. To address these issues, we introduce the Epistemic Asymmetry Schelling Task (EAST), a two-player dialogue game designed to benchmark robust and generalizable ToM abilities. By requiring LLM-LLM dyads to independently converge on semantic Schelling points under varying states of epistemic transparency, we evaluate whether models can robustly apply ToM to achieve coordination. Our results reveal a significant capability gap in functional social reasoning, with only frontier models successfully navigating the varying epistemic demands of the tasks. Analysis of reasoning traces shows that coordination failures are primarily driven by epistemic tracking errors, such as conflating private knowledge with mutual knowledge. Despite high performance on traditional static benchmarks, our study shows that robust social reasoning and epistemic tracking remain a critical bottleneck, providing concrete targets for future LLM evaluation and development.

[32] Cross-Architecture LLM Ensembles, Feature-Based Reranking and Retrieval-Augmented Prompting for Legal Information Processing cs.CLPDF

Amal Saad Alshehri, Nelly Bencomo, Amir Atapour-Abarghouei

TL;DR: 本文介绍了团队DU在COLIEE 2026竞赛中五个法律信息处理任务上的解决方案。核心方法包括跨架构大语言模型集成、基于特征的重新排序和检索增强提示。在具体任务中，通过模型集成、特征工程和提示优化，在多个子任务上取得了优异或显著提升的成绩。

Details

Motivation: 法律信息处理任务（如检索、蕴含和判决预测）需要文本匹配、推理和在有限监督下的鲁棒泛化能力。作者旨在探索并展示针对不同任务特性的有效方法组合。

Result: 在Task 4（法条蕴含）中，跨架构集成9个模型获得96.3%准确率，在33份提交中排名第一。在Pilot Task中，多视角系统在TP准确率和RE F1上均优于或匹配所有官方提交。通过提示优化，Task 2的F1从0.343提升至0.555，超过了最佳官方提交。Task 3通过更换模型和提示，准确率从79.3%提升至91.5%。Task 1的排序学习系统在54份提交中排名第11。

Insight: 创新点在于针对不同法律任务特性，系统性地应用了三种核心策略：1）跨架构模型集成以融合不同归纳偏置；2）结合词汇、语义及领域特征（如引用权威性、时间性）的重新排序；3）检索增强和结构化法律推理提示。研究表明，没有单一最优方法，应根据任务特点组合不同技术。

Abstract: Legal information processing spans retrieval, entailment and judgment prediction problems, requiring text matching, reasoning and robust generalisation with limited supervision. We report Team DU’s participation in all five tasks of COLIEE 2026, using open-weight systems for legal case retrieval, case entailment, statute retrieval and entailment, and legal judgment prediction. For Tasks 3 and 4, all models predate the 15 July 2025 cutoff required by the rules. For Task 4 (statute entailment), a cross-architecture ensemble of nine models from three families achieves 96.3% accuracy, placing first among 33 submissions from 11 teams. For the Pilot Task (tort prediction and rationale extraction), a multi-view system combining five claim-level models and refining the verdict using features derived from the claim predictions achieves 73.1% TP accuracy and 68.2% RE F1 as an unofficial submission, scoring above all official entries on TP and matching the highest on RE. For Task 2 (legal case entailment), changing only the prompt from single- to multi-selection raises F1 from 0.343 to 0.555 in post-competition evaluation on released gold labels, exceeding the best official submission (F1 = 0.490). For Task 3 (statute retrieval and entailment), replacing the entailment model with Qwen3-235B and a structured legal reasoning prompt raises accuracy from 79.3% to 91.5% in post-competition analysis. For Task 1 (legal case retrieval), a learning-to-rank system combining lexical and semantic retrieval with structural, citation authority, and temporal features (34 in total) achieves F1 = 0.314 (rank 11 of 54 submissions from 22 teams). Overall, legal information processing benefits from different inductive biases across tasks, with cross-architecture ensembling, feature-based reranking and retrieval-augmented prompting each proving most effective in different settings.

[33] LightMem-Ego: Your AI Memory for Everyday Life cs.CL | cs.AI | cs.CV | cs.HC | cs.MMPDF

Yijun Chen, Boyi Xiao, Yixian Zhao, Haoting Xia, Buqiang Xu

TL;DR: LightMem-Ego是一个轻量级流式多模态记忆系统，用于日常生活中的AI助手。它通过持续捕获第一人称视角的视觉和音频流，在共享时间线上对齐并组织成层次化记忆（当前、短期和长期记忆），以支持基于多模态证据的查询回答。

Details

Motivation: 解决移动和可穿戴设备上的个人AI助手在回答关于过去经历的查询时，需要能够持续积累、组织和检索长期经验的轻量级多模态记忆系统的挑战。

Result: 该系统可部署在智能手机和AI眼镜上，支持对象查找、对话回忆、生活总结、日常习惯发现和个性化辅助等任务。

Insight: 创新点在于提出了一个轻量级的流式多模态记忆架构，通过时间对齐和层次化记忆组织，实现了对长期日常经验的动态检索和回答生成，为边缘设备上的持续感知AI助手提供了可行的记忆解决方案。

Abstract: Personal AI assistants on mobile and wearable devices continuously perceive users’ daily lives through visual and audio streams. However, answering queries about past experiences requires lightweight multimodal memory that can continuously accumulate, organize, and retrieve long-term experiences, which remains challenging. To address this challenge, we present LightMem-Ego, a lightweight streaming multimodal memory system for everyday-life assistance. The system continuously captures egocentric visual and audio streams, aligns them on a shared timeline, and organizes them into a hierarchical memory consisting of current, short-term, and long-term memory. Given a user query, LightMem-Ego dynamically routes retrieval to the appropriate memory level and generates answers grounded in multimodal evidence. The demonstration can be deployed on smartphones and AI glasses, supporting object finding, conversation recall, life summarization, routine discovery, and personalized assistance. Code is available at https://github.com/zjunlp/LightMem-Ego.

[34] Direct Image-to-Modern Vietnamese Translation of Han-Nom Manuscripts via Multimodal RLHF Preference Alignment cs.CL | cs.CVPDF

Thi Kim Trang Vo, Nghia Hieu Nguyen, Ha Minh Tan

TL;DR: 本文提出了一种多模态RLHF偏好对齐框架，用于将汉喃手稿直接翻译为现代越南语。该框架结合了视觉特征（CLIP ViT-L/14@336）、汉喃文本表示（bert-base-chinese）、越南语表示（vinai/phobert-base）和T5-small编码器状态，通过模态特定投影和融合块生成共享表示。在相同监督微调策略基础上，比较了PPO、DPO和KTO三种偏好优化方法，其中DPO在多项指标上表现最佳，所有方法均优于基线。

Details

Motivation: 解决汉喃手稿翻译成现代越南语的挑战，包括页面退化、罕见字符以及平行语料有限的问题。

Result: 在匹配的工作级宏观平均评估中，DPO在BLEU-4、ROUGE-L、BERTScore、语义相似度、CER、WER和词符准确率上表现最佳，PPO在精确率、召回率和F1得分上最高，KTO通过其期望-非期望效用目标保持竞争力。所有偏好对齐策略均提升了SFT基线的BLEU-4和语义相似度分数。

Insight: 创新点在于将多模态输入（图像与文本）与RLHF偏好对齐结合，用于低资源历史翻译任务；客观分析表明，该方法通过偏好优化补充监督学习，提升了词汇和语义质量，为类似任务提供了可借鉴的框架。

Abstract: Translating Han-Nom manuscripts into modern Vietnamese is challenging because historical pages are often degraded, the script contains rare logographic characters, and parallel supervision is limited. We propose a multimodal RLHF preference-alignment framework that conditions Vietnamese generation on manuscript images and aligned Han-Nom source text. The model combines four streams: CLIP ViT-L/14@336 for visual features, bert-base-chinese for Han-Nom representations, vinai/phobert-base for Vietnamese representations, and T5-small encoder states. Modality-specific projections and a fusion block compress the resulting 2,048-dimensional concatenation into a shared 512-dimensional representation. Starting from the same supervised fine-tuned policy, we compare PPO, DPO, and KTO under matched work-level macro-averaged evaluation. DPO achieves the best BLEU-4, ROUGE-L, BERTScore, semantic similarity, CER, WER, and token accuracy, whereas PPO obtains the highest precision, recall, and F1. KTO remains competitive through its desirable-undesirable utility objective. All preference-aligned policies improve the BLEU-4 and semantic-similarity scores available for the SFT baseline. These results indicate that multimodal preference optimization complements supervised learning by improving lexical and semantic quality in low-resource historical translation.

[35] RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM cs.CL | cs.AIPDF

Mikhail Komarov, Ivan Bondarenko, Stanislav Shtuka, Oleg Sedukhin, Roman Shuvalov

TL;DR: RAGU是一个开源的模块化GraphRAG引擎，通过将知识图谱构建过程分解为提取和整合两个阶段，解决了现有单次提取方法产生的噪声实体和脆弱检索问题。其核心创新在于使用一个专门优化的紧凑型LLM（Meno-Lite-0.1，7B参数）来处理管道内的语言技能任务，该模型在知识图谱构建任务上超越了更大的模型，并在GraphRAG任务上表现相当。

Details

Motivation: 现有的GraphRAG系统通常在单次提取中构建知识图谱，这会导致产生噪声实体和脆弱的检索结果。RAGU旨在通过一个分离提取与整合的多阶段流程来解决这些问题，并探索在管道中使用更小、更高效的LLM的可能性。

Result: 在知识图谱构建任务上，7B的Meno-Lite-0.1模型相对于Qwen2.5-32B模型取得了+12.5%的相对调和平均值提升，并在英文GraphRAG任务上表现相当。在GraphRAG-Bench (Medical)基准测试中，RAGU在所有事实级别上检索到了最完整的上下文（证据召回率高达0.84，而其他方法≤0.76），并在综合任务上超越了HippoRAG2。

Insight: 论文的核心洞察是，管道内LLM所需的核心能力（理解、提取、上下文推理）是语言技能，这些技能随模型规模的增长幅度远小于事实性世界知识。因此，可以专门训练一个紧凑的模型来高效处理这些任务。RAGU的多阶段、模块化设计（包括两阶段类型化提取、基于DBSCAN的去重、LLM摘要和Leiden社区检测）也是一个可借鉴的系统架构创新。

Abstract: Graph retrieval-augmented generation (GraphRAG) enhances large language models with structured knowledge, yet existing systems construct knowledge graphs in a single extraction pass, producing noisy entities and brittle retrieval. RAGU, an open-source modular GraphRAG engine, addresses this by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection. A key insight motivates a compact extractor: the skills an in-pipeline LLM needs - comprehension, extraction, reasoning over context - are language skills that grow only weakly with model size, unlike factual world knowledge. Accordingly, we train Meno-Lite-0.1, a 7B model optimized for language skills, which outperforms Qwen2.5-32B on knowledge-graph construction (+12.5% relative harmonic mean) and matches it on English GraphRAG tasks. On GraphRAG-Bench (Medical), RAGU retrieves the most complete context at every factoid level (evidence recall up to 0.84 vs. $\leq$0.76) and overtakes HippoRAG2 on synthesis tasks; on multi-hop factoid QA, the apparent HippoRAG2 advantage is shown to be largely an answer-format artifact. RAGU is installable via $\texttt{pip install graph_ragu}$, runs on a single GPU, and is released under MIT. The source code is publicly available at https://github.com/RaguTeam/RAGU, and the Meno-Lite-0.1 model can be obtained from https://huggingface.co/bond005/meno-lite-0.1.

[36] JobHop v2: A Large-Scale Career Trajectory Dataset from Unstructured Resumes cs.CLPDF

Iman Johary, Guillaume Bied, Alexandru C. Mara, Tijl De Bie

TL;DR: 本文介绍了JobHop v2，这是一个从约44万份匿名多语言简历中，通过端到端大语言模型提取构建的大规模职业轨迹数据集。该数据集包含超过35万条职业轨迹，标注了ESCO职业代码、季度级时间信息和标准化的五级教育程度，相比v1版本在覆盖范围和标注丰富度上均有提升。

Details

Motivation: 现有公开的职业轨迹数据集规模小、使用受限或基于预标准化职业代码与LLM合成文本，缺乏真实自由文本的大规模、丰富标注数据，难以支撑劳动力规划、职位推荐和劳动力市场分析等研究。

Result: 在基于三个互补标注基线的评估协议下，论文提出的最佳提取器在所有对比模型中最接近标注者间一致性上限，仅落后1.1-2.7个百分点。

Insight: 论文的创新点在于：1) 设计了基于推理控制LLM推断与重试机制的提取流程，实现了100%的JSON解析成功率；2) 引入了更丰富的提取模式；3) 提出了修订的、基于多基线评估的评估协议。从客观角度看，其端到端LLM提取流程和确保数据解析可靠性的机制，对于从非结构化文本构建高质量数据集具有借鉴意义。

Abstract: Large-scale, richly annotated career trajectory data underpins workforce planning, job recommendation, and labour market analysis, yet publicly available datasets are either small, closed to independent use, or built from pre-standardized occupational codes with LLM-synthesized rather than authentic free text. We present JobHopv2, an improved version of the publicly available JobHop dataset, constructed through end-to-end large language model (LLM) extraction from a corpus of ${\sim}440{,}000$ pseudonymized, multilingual resumes provided by VDAB, the Flemish Public Employment Service. The released dataset comprises $355{,}315$ career trajectories annotated with ESCO occupational codes, quarter-level temporal information, and normalized five-level education attainment, broadening both the coverage and the annotation richness of the original release. Relative to v1, JobHopv2 introduces a redesigned extraction pipeline based on reasoning-controlled LLM inference with a retry mechanism (achieving a 100% JSON parse rate), a richer extraction schema, and a revised evaluation protocol scored against three complementary annotation baselines. Evaluated against these baselines, our best extractor comes closest to the inter-annotator agreement ceiling among all compared models, trailing it by only 1.1-2.7 percentage points. The dataset and code are publicly released to support reproducible career-trajectory research.

[37] MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning cs.CLPDF

Ayoung Lee, Ryan Kwon, Yunxiang Zhang, Yuxuan Liu, Peter Railton

TL;DR: 本文针对现有语言模型在多语言道德推理中的不足，提出了一个包含基准、推理方法和训练方法的三位一体解决方案。首先，作者构建了MCLASH基准，以捕捉跨语言的文化特定道德直觉；其次，提出了MET方法，这是一种基于心理学和哲学理论的两步提示法，先选择情境和文化特定的理论依据，再用用户母语进行推理；最后，提出了无需外部监督的MET-D蒸馏训练方法，以增强推理能力。

Details

Motivation: 现有工作在多语言道德推理方面存在三个主要缺陷：1）多语言评估基准仅使用直接翻译，未能适应文化特定内容；2）推理方法依赖静态、以英语为中心的框架，且缺乏道德理论依据；3）训练方法通常需要来自更强模型或人工标注的昂贵监督。本文旨在解决这些差距。

Result: 在MCLASH和MMoralExceptQA基准上，MET-D方法在Qwen3-4B、Qwen3-8B和Gemma3-4B三种不同规模和系列的模型上，相比基础模型平均提升了3.71和4.23个宏F1分数，其中在Qwen3-8B模型上对马来语的MCLASH分数提升峰值达到12.94分。此外，MET-D平均将母语推理能力提升了62.13分。

Insight: 本文的核心创新在于将文化意识和理论依据系统地融入多语言道德推理流程。具体而言，1）构建了文化敏感的多语言道德基准MCLASH；2）设计了基于专家策划理论依据的两步提示法MET，实现了情境和文化特定的理论选择与母语推理的解耦；3）提出了无需外部监督的自蒸馏训练方法MET-D，有效提升了推理性能。研究还揭示了有益的理论依据在不同文化间存在系统性差异，这为文化对齐的道德推理开辟了道路。

Abstract: Language models are increasingly used for moral decision-making across diverse linguistic and cultural contexts, yet existing work overlooks multilinguality on three aspects: 1) multilingual evaluation benchmarks use direct translation, failing to adapt culture-specific items; 2) inference-time methods for moral reasoning rely on static, English-centric scaffolds and lack grounding in moral theory; 3) training methods for moral decision-making typically require expensive supervision from stronger models or human annotators. We address these gaps with three contributions. First, we introduce MCLASH, a multilingual moral decision-making benchmark to capture culturally situated moral intuitions and social norms across languages. Second, we propose MET (Multilingual Ethics with Theory-grounded reasoning), a two-step prompting method built on expert-curated, theory-based grounds drawn from psychology and philosophy: the model first selects situation- and culture-specific grounds, then reasons over them in the native language of the user. Third, we introduce MET-D (MET-Distillation), which enhances the second step through a self-distillation training stage that requires no external supervision. MET-D improves macro-F1 over the base model on all three models of different sizes and families (Qwen3-4B, Qwen3-8B, Gemma3-4B), by an average of 3.71 points on MCLASH and 4.23 on MMoralExceptQA, with a peak MCLASH gain of 12.94 points for Malay on Qwen3-8B. We further reveal that MET-D increases native-language reasoning by 62.13 points on average, and that beneficial grounds differ systematically across cultures. Together, these contributions open the path for culture-aligned, theory-grounded multilingual moral reasoning.

[38] AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification cs.CLPDF

Lingkai Kong, Zijian Wu, Yuzhe Gu, Haiteng Zhao, Wenyong Huang

TL;DR: 本文介绍了AdvancedMathBench，一个用于评估大语言模型在高级数学领域证明生成与验证能力的基准测试套件。它包含用于证明生成的ProverBench（296个本科及博士资格考试级别问题）和用于验证的VerifierBench（888个带专家标注的模型生成证明轨迹）。研究开发了基于大规模专家标注训练的自动验证流程，并发现当前前沿模型在该基准上表现仍有很大提升空间。

Details

Motivation: 现有数学基准在高级数学领域的覆盖范围和评估粒度上存在不足，它们学科覆盖有限，且多依赖最终答案正确性或粗略判断，未能充分评估推理过程的有效性。

Result: 在证明生成任务上，表现最佳的GPT-5.5-xhigh模型在UGD和QE子集上的得分分别仅为75.8和66.1。在证明验证任务上，最佳模型的平衡F1分数仅为65.1，且模型普遍表现出较低的真负率。这表明该基准对前沿模型仍具挑战性。

Insight: 论文的创新点在于构建了一个覆盖高级数学、强调推理过程评估的综合性基准，并配套开发了基于专家标注训练的、可提供细粒度错误评估的自动验证流程，为系统评估模型的数学推理与验证能力提供了新工具。

Abstract: Large language models (LLMs) have achieved remarkable performance on high-school and olympiad-style mathematics, yet their capabilities on advanced mathematics remain poorly understood. Existing benchmarks, however, fall short in both scope and evaluation granularity: they provide limited disciplinary coverage and often rely on final-answer correctness or coarse judgments, leaving the validity of the reasoning process inadequately assessed. To bridge this gap, we introduce AdvancedMathBench, a benchmark suite designed to evaluate advanced mathematical reasoning capabilities. Its core proof-generation benchmark, ProverBench, contains 296 problems spanning undergraduate and doctoral qualifying-exam levels. To provide reliable evaluation of the proofs, we develop a dedicated automatic verification pipeline trained on large-scale expert annotations to produce both correctness verdicts and fine-grained assessments of proof errors, which exhibits strong agreement with human experts on held-out proof trajectories. We further introduce VerifierBench, consisting of 888 model-generated proof trajectories paired with expert ground truth, to evaluate whether models can correctly judge proof validity and provide sound verification rationales. Experiments show that AdvancedMathBench remains challenging for frontier models. On proof generation, the best-performing model, GPT-5.5-xhigh, achieves only 75.8 and 66.1 on the UGD and QE splits, respectively, indicating substantial room for improvement on advanced mathematical proof construction. On proof verification, the best model attains a Balanced F1 of only 65.1, and models generally exhibit low true negative rates, suggesting that critical error detection remains a major bottleneck.

cs.CV [Back]

[39] ReflectWorld-MM: An Entity-Oriented Multi-Media Memory System for Open-Ended Video Streams cs.CV | cs.AIPDF

Xiaokang Ma, Yifan Sun, Zhihong Jin, Jie Gu, Yudong Luo

TL;DR: 本文提出了ReflectWorld-MM，一种面向实体的多媒体记忆系统，用于处理开放式视频流。该系统包含感知前端、分层长期记忆和完整实现三部分，旨在通过实体解析和多尺度记忆结构来持续跟踪视频中的实体，并支持与现有助手的集成。

Details

Motivation: 现有系统通常将记忆存储在模型上下文或扁平特征库中，并以帧为中心组织，这限制了它们处理有界视频的能力，并削弱了跟踪随时间重现实体的能力。因此，本文旨在构建一个面向实体的记忆系统，以更好地支持开放式视频流的长期记忆和推理。

Result: 在六个长视频和终身记忆基准测试中，ReflectWorld-MM在所有六个基准上都取得了最佳准确率，优于强大的记忆代理和前沿模型，达到了SOTA水平。

Insight: 创新点包括：将记忆组织从帧中心转向实体中心，引入基于人类记忆理论的分层长期记忆（结合多尺度情景记忆、演化的实体语义记忆和程序记忆），以及构建了可处理任意视频流并与现成助手集成的完整实现。从客观角度看，该系统通过实体解析和结构化记忆提升了长期跟踪能力，具有实际应用潜力。

Abstract: Building assistants that can continually watch the world, remember what they see, and reason over their accumulated experience is a long-standing goal, and recently multimodal agents equipped with long-term memory over video streams have attracted increasing interest. Unfortunately, existing systems either keep their memory inside the model context or in a flat feature store, and organize it around frames rather than around the persistent entities a stream is really about, which confines them to bounded videos and weakens their ability to track who and what reappears over time. In this paper, we propose ReflectWorld-MM, an entity-oriented multi-media memory system for open-ended video streams. It consists of three parts. The first is a perception front-end that turns a streaming video into entity-resolved observations under a bounded short-term memory. The second is a hierarchical long-term memory, grounded in human memory theory, that couples a multi-scale episodic memory, an evolving entity-centric semantic memory, and a procedural memory. The third is a complete realization, built for real-world operation, that ingests arbitrary streams and plugs into off-the-shelf assistants. Across six long-video and lifelong-memory benchmarks, ReflectWorld-MM achieves the best accuracy on all six, outperforming strong memory agents and a frontier model.

[40] Low-Power License Plate Detection and Recognition on a RISC-V Multi-Core MCU-Based Vision System cs.CV | eess.IVPDF

Lorenzo Lamberti, Manuele Rusci, Marco Fariselli, Francesco Paci, Luca Benini

TL;DR: 本文首次在基于RISC-V多核MCU的边缘设备上实现了低功耗车牌检测与识别系统。该系统采用GAP8九核处理器和超低功耗QVGA灰度成像器，通过结合SSDlite-MobilenetV2进行车牌检测和LPRNet进行光学字符识别的多模型推理流程，在公开数据集上分别达到38.9% mAP和超过99.13%的识别率。在真实场景中，即使车牌区域小至30x5像素也能识别，并在GAP8上以117 mW的功耗实现1.09 FPS的吞吐量，能效比基于Raspberry Pi3的移动级系统提升73倍。

Details

Motivation: 解决在资源受限的微控制器单元（MCU）边缘设备上实现高效、低功耗的自动车牌识别（ALPR）问题，以推动嵌入式视觉应用的发展。

Result: 在公开数据集上，车牌检测任务达到38.9% mAP，字符识别任务识别率超过99.13%；在GAP8硬件上运行多模型推理（687 MMAC）时，功耗为117 mW，吞吐量为1.09 FPS，能效比基于Raspberry Pi3的先前移动级ALPR系统高73倍。

Insight: 创新点在于首次在MCU级设备上部署了复杂网络（多模型推理），且未使用任何硬件加速引擎，保持了算法灵活性；通过压缩和优化策略，在极低功耗下实现了实用的ALPR性能，为嵌入式视觉系统设计提供了新范例。

Abstract: In this paper, we present the first (to the best of our knowledge) demonstration of a low-power MCU-based edge device for Automatic License Plate Recognition (ALPR). The design leverages on a 9-core RISC-V processor, GAP8, coupled with a QVGA ultra-low-power greyscale imager. The proposed visual processing pipeline uses a multi-model inference approach based on SSDlite-MobilenetV2 for license plate detection and LPRNet for optical character recognition, reaching a 38.9% mAP score for the first task and a recognition rate of >99.13% for the latter on public datasets. On real-world data, the pipeline recognizes registration numbers when the size of LP crops is as small as 30x5 pixels. Thanks to the applied compression and optimization strategies, the multi-model inference (687 MMAC) achieves a throughput of 1.09 FPS at a power cost of 117 mW when running on GAP8. Our solution is the first MCU-class device embedding such a level of network complexity, resulting to be 73x more energy-efficient w.r.t. precedent mobile-class ALPR system featuring a Raspberry Pi3. The proposed design does not resort to any hardwired acceleration engines, thus retaining full flexibility for future algorithmic improvements.

Pengyu Zhang, Klim Zaporojets, Congfeng Cao, Jia-Hong Huang, Paul Groth

TL;DR: 本文提出了一种名为Time Imprint的框架，用于解决多模态知识图谱中实体难以区分的问题。该框架将时间信息视为一种独立的模态，通过三视图对比学习目标，联合对齐时间、文本和视觉表示，并设计了时间戳子集选择与注意力池化机制来聚合多个时间戳信息。

Details

Motivation: 在多模态知识图谱中，仅依靠文本和图像等模态难以区分特征高度相似的实体。时间信息可作为额外的模态来消歧，但现有方法面临时间语义稀疏和多个时间戳引入噪声两大挑战，很少将时间作为独立模态处理。

Result: 在三个多模态知识图谱基准测试中，Time Imprint在链接预测任务上达到了最先进的性能，整体Hits@1指标最高提升6.07%，并在前1%的模糊样本子集上获得了高达58%的性能增益。

Insight: 核心创新点在于将时间明确作为实体级别的独立模态，并设计了三视图对比学习框架进行联合对齐。同时，通过研究时间戳子集选择的设计空间和注意力池化聚合，有效平衡了时间表征的特异性和鲁棒性，为利用稀疏、多时间戳信息提供了新思路。

Abstract: Multi-Modal Knowledge Graphs (MMKGs) enrich entities with multiple modalities such as text and images, yet entities with highly similar multi-modal features remain difficult to distinguish. Temporal information of an entity can serve as an additional modality to disambiguate such entities, but existing approaches rarely treat time as a separate modality alongside text and images due to two major challenges: (1) sparse temporal semantics, which hinder alignment with richer modalities, and (2) multiple timestamps, which introduce noise or reduce robustness in representation learning. To address these challenges, we propose Time Imprint, a framework that treats time as an entity-level modality and jointly aligns temporal, textual, and visual representations via a three-view contrastive objective. Additionally, to mitigate multi-timestamp ambiguity, Time Imprint studies a compact timestamp subset selection design space and aggregates the selected timestamps into a discriminative temporal embedding with attention pooling, balancing temporal specificity and robustness. Experiments on three MMKG benchmarks demonstrate that Time Imprint achieves state-of-the-art link prediction performance, improving Hits@1 by up to 6.07% overall and yielding up to 58% gains on the subset of the top-1% ambiguity samples. We further examine different fusion strategies and the sensitivity to timestamp availability and quality, clarifying when and why time-as-modality is most beneficial, while adding only modest training overhead. We release our code at https://anonymous.4open.science/r/Time-Imprint.

[42] Towards Real-World Wearable Motion Reconstruction cs.CV | cs.LGPDF

Andrea Boscolo Camiletto, Rishabh Dabral, Eduardo Alvarado, Thabo Beeler, Marc Habermann

TL;DR: 本文提出了一种面向真实世界可穿戴设备的运动重建方法，旨在从任意一组可穿戴传感器（如智能手机、智能手表、智能眼镜和智能鞋垫）中重建全身运动。为此，作者贡献了一个大规模多模态数据集，并提出了一个名为WHIP的基线生成模型，该模型能够从任意可用传感器子集重建运动，并系统地研究了传感器之间的互补性。

Details

Motivation: 解决当前运动捕捉研究大多假设固定传感器配置（如IMU套装或HMD为中心的系统）而无法泛化到不同硬件组合的问题，强调应优先考虑非侵入式、轻量级的消费级设备，并研究它们之间的交互作用。

Result: 提出了WHIP基线模型，能够鲁棒地处理缺失模态并生成物理上合理的运动；通过系统研究量化了不同模态之间的互补性。论文未在摘要中提及具体基准测试或与SOTA的定量比较结果。

Insight: 创新点在于将运动捕捉问题泛化为任意可穿戴传感器子集的配置，并构建了首个同步消费级传感器与真实3D运动数据的大规模多模态数据集；提出的生成模型框架为处理动态、不完整的传感器输入提供了可借鉴的解决方案。

Abstract: The modern-day surge in popularity of wearable devices poses a fundamentally unique motion capture problem: reconstructing full-body movement from any set of sensing hardware worn at a given moment. Yet, most research efforts assume fixed sensor configurations (e.g. IMU suits or HMD-centric rigs) and cannot generalize across them. In contrast, we argue that motion capture should prioritize unobtrusive and lightweight devices such as smartphones, smartwatches, smart glasses, and smart insoles, and study the interplay between them. To this end, we make three contributions. First, we present a large-scale multi-modal dataset synchronizing these consumer-grade sensors with ground-truth 3D motion, spanning 50 diverse activities including everyday tasks, sports, and social interactions. Second, we propose WHIP, a baseline generative model that reconstructs motion from arbitrary subsets of available sensors, robustly handling missing modalities and producing physically plausible motions. Third, we conduct a systematic study of sensor complementarity, quantifying how different modalities complement one another. Code and dataset are available at https://vcai.mpi-inf.mpg.de/projects/WHIP/

[43] Lifelong Representations: A Survey on Continual Self-Supervised Learning for Vision Models cs.CV | cs.AIPDF

Sergi Masip, Alicja Dobrzeniecka, Jonathan Swinnen, Joachim Collin, Bartłomiej Twardowski

TL;DR: 本文是一篇关于视觉模型持续自监督学习（CSSL）的综述，系统梳理了该领域的研究现状、评估协议、方法分类及未来挑战。文章分析了自监督目标对灾难性遗忘的鲁棒性原因，并将现有方法按遗忘缓解策略进行了统一分类，同时指出了向大规模系统持续预训练范式发展的必要性。

Details

Motivation: 传统持续学习依赖标注数据，但许多实际应用（如终身机器人）需要模型从无标注数据流中持续适应，而CSSL领域缺乏系统综述，因此本文旨在填补这一空白，为视觉及新兴视觉-语言场景提供全面分析。

Result: 本文未提出具体模型或实验，但通过综述分析指出自监督目标因任务无关表示和平滑损失景观而展现出对灾难性遗忘的改进鲁棒性，并强调当前小规模基准需转向大规模系统持续预训练以推动领域发展。

Insight: 创新点包括：系统化CSSL评估协议以解决比较不一致问题；从表示和损失角度解释自监督对遗忘的鲁棒性；提出基于蒸馏、回放、正则化、架构、模型合并和目标适应等策略的统一分类法；指出可扩展性和快速适应性等开放挑战，推动领域向大规模持续预训练范式演进。

Abstract: Traditionally, continual learning has assumed access to labeled data, yet many real-world applications – such as lifelong robotics – require models to adapt continuously from unlabeled streams. This has led to the development of continual self-supervised learning (CSSL), a rapidly growing area that lacks a dedicated, systematic review. In this work, we present a comprehensive survey of CSSL for vision, with connections to emerging vision-language settings. First, we analyze existing evaluation protocols and highlight inconsistencies that hinder fair comparison. We then examine why self-supervised objectives exhibit improved robustness to catastrophic forgetting, relating this to task-agnostic representations and smoother loss landscapes. Next, we organize existing methods into a unified taxonomy based on their forgetting-mitigation strategies, including distillation, replay, regularization, architectural approaches, model merging, and objective-level adaptation. Finally, we identify open challenges such as scalability and the need for fast adaptability. We argue that advancing CSSL requires moving beyond small-scale benchmarks towards continual pre-training paradigms for large-scale systems.

[44] Prompting-MammAlps: Fine-Grained Text-to-Video Retrieval for Camera-Trap Data cs.CV | cs.AI | q-bio.NC | q-bio.QMPDF

Valentin Gabeff, Baptiste Maquignaz, Jennifer Shan, Sepideh Mamooler, Gencer Sumbul

TL;DR: 本文提出了Prompting-MammAlps，这是首个针对相机陷阱数据的细粒度文本-视频检索基准，并设计了一种可解释的检索方法。该方法通过视觉Transformer进行时空动作定位并生成结构化文本描述视频，同时利用基于LLM的编码代理解析受动物行为学启发的查询，从而在特定数据集上显著超越了零样本VLM的性能。

Details

Motivation: 解决从大规模相机陷阱数据集中自动检索视频的挑战，因为现有基于大视频语言模型的文本-视频检索方法缺乏时空理解能力，且在生态数据上泛化能力不足。

Result: 在Prompting-MammAlps基准测试中，该方法在包含135个生态相关查询和775个候选视频的测试集上取得了34%的基于集合的F1分数，而最佳零样本VLM的F1分数仅为18%。

Insight: 创新点在于将时空动作定位与结构化文本生成相结合，并利用LLM作为可编程的解析代理来处理复杂查询，通过定制解析库来减少幻觉并提高方法的可解释性，为生态数据分析提供了新范式。

Abstract: Automatically retrieving videos from large camera-trap datasets remains challenging. Text-to-Video retrieval (TVR) methods based on large video-language models (VLMs) have potential to retrieve events of interest by describing them with simple text queries. However, current methods often lack spatiotemporal understanding and do not generalize well to ecological data. In this work, we introduce Prompting-MammAlps, the first camera-trap TVR benchmark, and propose a fine-grained and interpretable TVR method. Specifically, we trained a vision transformer to perform spatiotemporal action localization, and convert its output to structured text, describing each video. Independently, ethology-inspired queries are processed by a Large-Language Model (LLM) based coding agent to parse the structured text per video and retrieve videos accordingly. We harnessed the LLM to use functions from a custom parsing library to minimize the risk of LLM hallucinations and to improve method interpretability. This retrieval approach applied on the Prompting-MammAlps benchmark achieved a set-based F1-score of 34% on a test set of 135 ecologically-relevant queries and 775 candidate videos. In comparison the best zero-shot VLM achieved a F1-score of 18%, while also lacking interpretability. Project page: https://cnai.epfl.ch/prompting-mammalps

[45] A Dual-Stream Challenge-Response Protocol for Ocular Liveness Verification cs.CV | cs.CRPDF

Ismail Kably

TL;DR: 本文提出了一种用于眼部活体检测的双流挑战-响应协议，通过融合空间轨迹和亮度强度的随机时变视觉刺激，同步评估平滑追踪和瞳孔收缩的生物延迟相关性，以防御高分辨率视频回放和实时生成式深度伪造等呈现攻击。

Details

Motivation: 当前的眼部生物识别系统面临复杂的呈现攻击，而现有的呈现攻击检测框架通常依赖孤立的生理指标（如注视跟踪或瞳孔光反射），这些指标容易被单独欺骗，因此需要一种能够同步验证多种生物特征的动态防御机制。

Result: 通过基于文献延迟分布的蒙特卡洛模拟，论文证明了真实与模拟攻击条件在理论上的可分离性，并表明当存在非零渲染延迟间隙时，多轮挑战设计能够提高对生成式深度伪造的检测能力。

Insight: 创新点在于提出了一个时空亮度传感器融合协议，通过构建称为同步矩阵的数学耦合状态空间似然模型，来连续评估预期生物延迟之间的互相关性，为下一代动态欺骗防御提供了模拟支持的理论框架。

Abstract: Ocular biometric systems face sophisticated presentation attacks, including high-resolution video replays and real-time generative deepfakes, which easily bypass static liveness checks. Current Presentation Attack Detection (PAD) frameworks typically rely on isolated physiological metrics, such as gaze tracking or the Pupillary Light Reflex (PLR), which can be spoofed independently. This paper proposes a Spatio-Luminance Sensor Fusion protocol, which introduces a dual-stream challenge-response framework for ocular liveness verification by uniting these metrics into a simultaneous authentication challenge. By generating a randomized, time-varying visual stimulus that fluctuates in both spatial trajectory and luminance intensity, we construct a mathematically coupled state-space likelihood model, termed the Synchronization Matrix, to evaluate the continuous cross-correlation between the expected biological latencies of smooth pursuit tracking and pupillary constriction. Using Monte Carlo simulation grounded in literature-derived latency distributions, we demonstrate theoretical separability between genuine and simulated attack conditions, and show that a multi-round challenge design improves the detection of generative deepfakes when a non-zero rendering-latency gap exists. This work provides a simulation-supported theoretical framework for next-generation dynamic spoofing defense in ocular and iris biometrics; human-subject validation is identified as necessary future work before deployment claims can be made.

[46] ShapKO: Shapley-Adaptive Modality Knockout for Robust Multimodal Learning cs.CV | cs.LGPDF

Nusrat Binta Nizam, Fengbei Liu, Sunwoo Kwak, Minh Nguyen, Ruining Deng

TL;DR: 本文提出了一种名为ShapKO的动态训练策略，用于提升多模态医学模型在输入模态缺失情况下的鲁棒性。该方法通过周期性评估各模态子集的性能，利用Shapley值估计模态重要性，并据此动态调整训练时的模态剔除概率，以抑制主导模态并促进互补表征的学习。

Details

Motivation: 解决多模态医学模型在现实临床工作流中常遇到的输入模态缺失问题，以及训练过程中存在的模态主导现象（即模型过度依赖某一高预测性模态而忽视其他互补模态），这导致模型在部分模态可用时鲁棒性下降。

Result: 在涵盖多任务临床分类、生存预测和癌症检测的三个数据集上进行了评估，ShapKO在模态缺失情况下持续提升了模型性能，并产生了可解释的掩码行为轨迹。

Insight: 创新点在于引入了基于验证效用的动态模态剔除概率学习机制，通过Shapley值自适应调整训练时的模态掩码率，从而无需修改模型架构即可有效缓解模态主导问题并增强鲁棒性。

Abstract: Multimodal medical models often degrade when inputs are missing, a common scenario in real-world clinical workflows. Separately, even when all modalities are present, modality dominance is observed during training, where optimization over-relies on a highly predictive modality and undertrains complementary sources, resulting in poor robustness under partial availability. While training-time modality knockout improves missing-modality robustness, existing approaches use static masking rates that cannot adapt to evolving modality utility during training. We introduce ShapKO (Shapley-Adaptive Modality Knockout), a dynamic training strategy that learns modality-specific knockout probabilities based on validation utility. ShapKO periodically evaluates performance across modality subsets, estimates modality importance via Shapley values, and updates masking probabilities to suppress dominant modalities more frequently. This adaptive process promotes complementary representations, while requiring no architectural modifications. We evaluate ShapKO on three datasets covering multitask clinical classification, survival prediction, and cancer detection. ShapKO consistently improves performance under modality absence and yields interpretable trajectories of learned masking behavior. Code is available at: https://github.com/sumona00/ShapKO

[47] Bridging the Catalog-to-Real Gap: Scalable Product Recognition via Multi-Stage Contrastive Learning cs.CVPDF

Anyi Zhang, Joy Mazumder, Kiril Lomakin

TL;DR: 本文提出了一种名为Cat2Real的多阶段对比学习范式，旨在解决产品识别中商品目录图像（影棚拍摄）与真实场景图像（店内拍摄）之间的领域差异问题。该方法将任务重新定义为基于嵌入的跨域检索问题，通过利用商品级和图像级相似性进行有针对性的困难负样本挖掘，以提升模型的可扩展性和零样本泛化能力。

Details

Motivation: 自动化产品识别是现代零售智能的核心，但将真实场景中的店内图像与庞大的企业商品目录进行准确匹配，在大规模应用中仍存在严重的可扩展性瓶颈。本文旨在通过解决影棚拍摄的商品目录图像与嘈杂的真实查询图像之间的领域差异来应对这一挑战。

Result: 广泛的实证评估表明，该范式能够无缝扩展到未见过的产品和类别，即使在完全没有新库存的真实世界训练图像的情况下，也能产生出色的零样本泛化性能。

Insight: 主要的创新点在于将任务重新定义为跨域检索问题，并提出了一个多阶段对比学习框架，通过系统性地利用商品级和图像级相似性来驱动有针对性的困难负样本挖掘，从而有效弥合领域差距并实现零样本泛化。

Abstract: Automated product recognition is a cornerstone of modern retail intelligence; however, accurately matching real-world, in-store images against extensive corporate catalogs remains a major scalability bottleneck for large-scale applications. In this work, we address this challenge by reformulating the task as an embedding-based cross-domain retrieval problem rather than a standard closed-set classification task. Specifically, we define the objective as retrieving the most corresponding catalog reference image for a given real-world product query crop from an expansive inventory. To bridge the severe domain gap between pristine studio packshots and noisy in-store queries, we introduce a novel catalog-to-real multi-stage contrastive learning paradigm (Cat2Real). This framework fine-tunes a vision backbone by systematically exploiting both item-level and image-level similarities to drive targeted hard negative mining. Extensive empirical evaluations demonstrate that our paradigm scales seamlessly to unseen products and categories, yielding outstanding zero-shot generalization performance even in the complete absence of real-world training images for novel inventory.

[48] Banshee: Target Switch Attacks on Gimbal-Stabilized Visual Tracking Systems via Acoustic Injection cs.CV | cs.CRPDF

Jiarui Li, Joseph Brewington, Qingzhao Zhang, Z. Morley Mao

TL;DR: 论文提出了名为Banshee的攻击方法，首次通过声学注入实现了对云台稳定视觉跟踪系统的目标切换攻击。该方法利用云台-相机系统的声学漏洞，生成精心设计的声波波形，诱发优化的对抗性云台振荡，导致相机视图发生方向性偏移，从而破坏帧间目标关联，使机载跟踪器大概率从原始目标切换到攻击者选定的对象。

Details

Motivation: 现有研究虽然表明声学信号可以干扰云台内部结构，但此类攻击对无人机跟踪等实际应用的影响尚未充分探索，且现有演示大多忽略了物体运动不确定性和运行时延迟等现实攻击的挑战。本文旨在填补这一空白，研究声学攻击在真实世界无人机视觉跟踪系统中的实际可行性。

Result: 在模拟环境中，针对两个商用云台系统和五个跟踪器，Banshee实现了93.6%的成功率。在现实世界的台式测试和飞行黑盒攻击中，针对一款商用无人机在不同场景下的攻击总体成功率达到了95.5%。

Insight: 论文的创新点在于首次提出并实现了针对云台稳定视觉跟踪系统的物理可实现目标切换攻击，揭示了声学与视觉之间的跨领域实际安全漏洞。从客观角度看，其通过优化声波波形诱发特定云台振荡以操纵相机视图的方法，为理解物理世界与机器学习系统交互的安全风险提供了新视角。

Abstract: Gimbal-stabilized visual tracking is critical for modern autonomous systems such as Unmanned Aerial Vehicles (UAVs). While prior work shows acoustic signals can disturb gimbal internals, the impact of such attacks on real-world applications like UAV tracking and following remains underexplored. Existing demonstrations largely overlook practical challenges for real-world attacks, such as object-motion uncertainty and runtime latency. To bridge this gap, we present Banshee, the first physically realizable attack that induces target switching in UAV visual tracking systems by exploiting acoustic vulnerabilities in gimbal-camera systems. Banshee generates carefully crafted acoustic waveforms that induce optimized adversarial gimbal oscillations, causing directionally biased camera-view drifts that break inter-frame target associations. Consequently, the onboard tracker is driven to switch from the original target to an attacker-selected object with high probability, with occasional target loss. Banshee achieves a 93.6% success rate in simulation across two commercial gimbal systems and five trackers. Real-world benchtop and in-flight black-box attacks against a commercial drone across varied scenarios show an overall 95.5% attack success rate. Our results reveal a practical cross-domain vulnerability between acoustics and vision, highlighting the need for robust designs of gimbal systems and applications. Our code is available at: https://github.com/U1ltra/Banshee.

[49] UniPose9D: Universal Category-Agnostic Object Pose Estimation cs.CVPDF

Yang You, Yi Du, Cole Harrison, Leonidas Guibas

TL;DR: 本文提出了UniPose9D，一个用于9D物体姿态估计的类别无关基础模型。该模型仅需物体掩码/ROI和RGB-D或带预测深度的RGB图像，即可估计旋转、平移和度量尺寸，无需类别标签、CAD模型或先验形状。通过采样点对、使用DINOv2和PointNet特征预测NOCS坐标，并引入基于点对的RANSAC N-hop Kabsch-Umeyama算法与流匹配技术来提升精度和处理对称模糊性。

Details

Motivation: 现有物体姿态估计方法通常在现有基准上过拟合，对新类别和未见场景的泛化能力有限。本文旨在解决这一问题，提出一个无需类别特定先验知识、具有强泛化能力的通用姿态估计模型。

Result: 在六个数据集上的实验表明，单个统一的UniPose9D模型能够匹配或超越专门的（specialist）方法，同时在未见过的物体和真实场景中展现出良好的泛化性能。

Insight: 创新点在于构建了一个完全类别无关的9D姿态估计框架，摒弃了对CAD模型、平均形状先验和参考视图的依赖。技术上的关键贡献包括基于点对的NOCS坐标预测、改进的RANSAC姿态求解算法以处理对称性，以及通过整合现有数据集构建的大规模训练集，这为构建通用视觉基础模型提供了新思路。

Abstract: Object pose estimation is a fundamental problem in 3D vision. Although recent state-of-the-art approaches achieve strong performance, they often overfit to existing benchmarks and exhibit limited generalization to novel categories and unseen scenes. We propose UniPose9D, a category-agnostic foundation model for 9D object pose estimation: given an instance mask/ROI and either an RGB-D observation or an RGB image with predicted depth, the model estimates rotation, translation, and metric size without category labels, CAD models, mean-shape priors, or reference views. Specifically, UniPose9D samples point pairs from the observed object geometry and uses DINOv2 and PointNet features to predict NOCS coordinates for each pair. To improve accuracy, we introduce a point-pair-based RANSAC N-hop Kabsch–Umeyama algorithm with an adaptive threshold. We further employ flow matching to address symmetric ambiguities and construct a large-scale training set by curating and aligning pose annotations from existing public datasets. Experiments across six datasets show that a single unified model can match or surpass specialist methods while generalizing to unseen objects and in-the-wild scenarios. Our code and model are available on https://github.com/qq456cvb/UniPose9D.

[50] Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning cs.CVPDF

Wenxi Gao, Guanxi Lu, Didi Zhu, Hao Mark Chen, Quan Deng

TL;DR: 本文针对统一多模态模型在视觉数学推理任务中生成中间视觉推理步骤时可能引入错误视觉证据并降低推理效率的问题，提出了一种名为AdaViG的无训练自适应视觉门控方法。该方法利用模型内部信号（生成意图和视觉保真度）在视觉生成早期动态评估每个触发的视觉步骤，并在信号较弱时中止生成，从而在避免误导性证据的同时减少不必要的计算开销。

Details

Motivation: 统一多模态模型在交错推理中生成中间视觉步骤并不总是有益的，甚至可能因引入错误视觉证据而误导后续推理，且频繁触发视觉步骤会带来显著的计算和内存开销，降低推理效率。

Result: 在综合实验中，AdaViG将准确率最高提升了5.7%，同时将视觉生成的FLOPs减少了25.0%-91.0%，并将实际运行延迟降低了15.4%-45.6%。

Insight: 创新点在于识别并利用模型内部信号（生成意图和视觉保真度）进行早期动态评估，以训练无关的方式自适应地门控视觉生成步骤，从而在提升准确率的同时大幅优化计算效率。

Abstract: Unified multimodal models (UMMs) with interleaved reasoning, which generate both textual and visual steps as part of intermediate reasoning traces, have demonstrated great potential for visual mathematical reasoning tasks. However, we identify a key insight in this paradigm: generating intermediate visual reasoning steps is not always beneficial and can even be harmful, as self-generated visual steps may introduce erroneous visual evidence that misleads subsequent reasoning. Moreover, frequently triggering visual steps during reasoning incurs substantial computational and memory overhead, degrading inference efficiency. To address these accuracy and efficiency challenges, we observe that the model’s internal signals can indicate whether a visual step will benefit reasoning before the entire visual generation is completed. Specifically, this work identifies two internal signals: 1) Generation Intent, which reflects whether the model has a concrete textual plan for what to draw, and 2) Visual Fidelity, which measures whether the visual generation remains grounded in the original input image. Leveraging these internal signals, we propose AdaViG, a training-free adaptive visual gating method for unified multimodal reasoning. AdaViG dynamically evaluates each triggered visual step at an early visual generation stage and aborts it when both signals are weak, thereby preventing misleading visual evidence from entering the reasoning trace while avoiding unnecessary computation. Comprehensive experiments demonstrate that AdaViG improves accuracy by up to 5.7% while reducing visual generation FLOPs by 25.0%-91.0% and wall-clock latency by 15.4%-45.6%.

[51] Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation cs.CV | cs.MM | cs.RO | eess.IVPDF

Zhonghua Yi, Hao Shi, Qi Jiang, Yufan Zhang, Kailun Yang

TL;DR: 本文提出了一种新颖的双阶段蒸馏方法，用于解决事件与图像数据在无标签、无严格硬件对齐的真实场景下的跨模态特征匹配问题。该方法首先利用大规模数据进行标签无关的蒸馏预训练，学习高度泛化的表示；然后引入极线引导的自蒸馏框架，使模型能够在无监督的目标域上自我进化。

Details

Motivation: 现有跨模态匹配方法严重依赖匹配标签或严格对齐的硬件，无法适用于既无匹配真值又无先验传感器关系的无标签、无约束真实场景。

Result: 在MVSEC和TUM-VIE位姿估计任务上进行了大量实验，结果表明所提方法达到了最先进的性能水平。

Insight: 创新点在于提出了一个无需标签、无需硬件对齐的双阶段蒸馏训练范式，特别是极线引导的自蒸馏框架，利用一致性验证和外部极线先验的几何置信度，实现了模型在目标域上的无监督自适应。此外，基于TUM-VIE构建了严格的跨模态评估基准。

Abstract: Building pixel-level correspondence between event and image data is a fundamental task for multi-sensor systems. However, existing cross-modal matching methods are largely restricted by their reliance on either matching labels or strictly aligned hardware, which limits them to unlabeled and unconstrained real-world scenarios where neither matching ground truth nor prior sensor relationships are available. To address this, we propose a novel two-stage training paradigm. First, we leverage large-scale data to perform label-agnostic distillation pretraining, upgrading optimization objectives with distribution-based and contrastive losses to learn highly generalizable representations. Second, to tackle unlabeled and unconstrained downstream data, we introduce an epipolar-guided self-distillation framework. By utilizing consistency verification to isolate robust matches and incorporating geometric confidence derived from an external epipolar prior, our model can effectively self-evolve directly on target domains without any supervision. Furthermore, we introduce a rigorous cross-modal evaluation benchmark based on TUM-VIE, featuring physically separated cameras with distinct intrinsic parameters and resolutions. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on both MVSEC and TUM-VIE pose estimation tasks. The source code and benchmark will be made publicly available at https://github.com/ZhonghuaYi/nexus2-official.

[52] CVKD-UDA: Cross-View Knowledge Distillation for 3D Unsupervised Domain Adaptive Segmentation cs.CVPDF

Zhimin Yuan, Ming Cheng, Shangshu Yu, Wen Li, Dunqiang Liu

TL;DR: 本文提出CVKD-UDA方法，用于解决3D无监督域自适应分割问题。该方法通过调整体素大小生成两个互补视图，并引入跨视图知识蒸馏来增强模型的泛化能力和目标域感知。同时，设计了轻量级解耦适配器和辅助模仿分类器，以平衡知识的可迁移性和判别性，从而为自训练方法提供更好的初始化模型。

Details

Motivation: 现有3D无监督域自适应分割方法依赖源域监督或输出级对抗对齐来获取初始化模型，但受限于域间差异大导致的泛化能力不足和训练不稳定问题。本文旨在通过构建域相似表示来弥合域间差距。

Result: 在两个基准测试上的大量实验表明，CVKD-UDA有效提升了自训练方法的性能，为3D UDA分割提供了新视角。

Insight: 创新点在于将体素大小作为核心设计因素来构建域相似表示，并利用跨视图互补线索平衡可迁移性与判别性；通过跨视图知识蒸馏和轻量级解耦机制，增强了模型对目标域的感知和泛化能力。

Abstract: 3D unsupervised domain adaptive (UDA) segmentation mitigates the high cost of manual annotations of the new domain data. Self-training has emerged as the dominant approach in this area, where its success heavily depends on a well-initialized warm-up model to generate reliable pseudo labels. However, existing methods often depend on source supervision or output-level adversarial alignment to obtain the warm-up model, which suffer from limited generalization and training instability due to the large domain gap between domains. Constructing domain-similar representations is an effective way to bridge this gap. In this work, we propose CVKD-UDA, which revisits voxel size as a core design factor to construct domain-similar representations and leverages cross-view complementary cues to balance transferability and discriminability of the warm-up model. First, we generate two complementary views by varying voxel sizes and introduce a cross-view knowledge distillation (CVKD) to enhance generalization and target perception of the model. Second, to balance transferability and discriminability, we design a lightweight Decouple-Adapter and an auxiliary imitation classifier to decouple cross-view knowledge transfer. Extensive experiments on two benchmarks demonstrate that CVKD-UDA effectively improves the performance of self-training methods and provides a new perspective for 3D UDA segmentation. Our code will be available at GitHub.

[53] LFD: Enabling Real-World Lensless Face Recognition with a Large-Scale Dataset cs.CV | eess.IVPDF

Junho Kim, Salman S. Khan, Sara Wan, Tomi Kuye, Ashok Veeraraghavan

TL;DR: 本文介绍了Lensless Face Dataset (LFD)，这是一个大规模、多样化的无透镜人脸数据集，旨在解决无透镜相机在人脸识别中因重建图像存在伪影和泛化能力不足而面临的挑战。该数据集包含21,080个样本，涵盖不同光照、角度、距离下的原始测量值、重建图像和标准图像，并特别包含了户外自然光环境下的采集数据以及三种不同无透镜相机的图像，以促进跨设备的泛化研究。

Details

Motivation: 传统人脸识别系统依赖的摄像头存在体积大、成本高、隐私保护有限等问题，而无透镜相机虽具有尺寸小、成本低、设计灵活等优势，但其重建图像常包含伪影，且现有方法在真实世界条件下泛化能力差，同时缺乏专门针对无透镜图像伪影的人脸数据集。

Result: 通过全面的评估与分析，论文表明LFD数据集有效地捕捉了不同无透镜成像设备间的共享特征和伪影，使其成为推动无透镜人脸识别发展的宝贵数据集。

Insight: 论文的主要创新点在于构建了首个专注于真实世界条件、包含多种伪影和环境变化的大规模无透镜人脸数据集LFD，并特别强调了户外采集和设备多样性，这为研究无透镜成像的鲁棒性和跨设备泛化能力提供了关键数据基础。

Abstract: Face recognition is a ubiquitously used computer vision task that has a wide range of applications ranging from everyday smartphone biometrics to high-stakes security systems. Most face recognition systems rely on traditional cameras, which often suffer from limitations such as bulky form factors, high costs, and limited privacy protection. To address these limitations, lensless cameras have emerged as an alternative. Lensless cameras use thin optical encoders, enabling smaller size, lower cost, and greater design flexibility. These cameras are typically paired with reconstruction algorithms that convert raw captures into recognizable images. However, reconstructed images often contain artifacts, and the reconstruction methods struggle to generalize well to real-world conditions. Furthermore, existing face datasets do not account for the artifacts present in lensless images. To address this issue, we introduce the Lensless Face Dataset (LFD). LFD comprises 21,080 lensless raw measurements, reconstructions, and standard images of faces captured under diverse lighting, angle, and distance. Our key contributions are: (1) Real-world lensless face data: LFD focuses on capturing a diverse face dataset with varying levels of artifacts introduced under different environments; (2) In-the-wild captures: 4,976 images are captured in outdoor settings with varying intensities of natural light and different background patterns; (3) Multiple lensless devices: LFD includes face images collected from three different types of lensless cameras, each with a unique optical encoder. We use this hardware diversity to demonstrate generalization across different lensless cameras. Through comprehensive evaluations and analysis, we show that LFD effectively captures shared features and artifacts across different lensless imaging devices, making it a valuable dataset for advancing lensless face recognition.

[54] DynaFilter: Cloud-driven Dynamic Filtering for Satellite Edge Intelligence cs.CV | cs.LGPDF

Ziyang Zhang, Jie Liu, Luca Mottola

TL;DR: 本文提出了DynaFilter，一种用于卫星边缘智能的云驱动动态过滤技术。该方法使卫星边缘设备能够在压缩域直接进行选择性感兴趣区域推理，无需完全解压图像或视频数据，从而显著减少带宽消耗和能源开销。

Details

Motivation: 解决卫星边缘系统因带宽严重受限和连接间歇性而无法持续向云端传输数据的问题，克服现有边缘云系统要么需要繁重的预处理（如完全解压），要么传输所有压缩数据而不考虑相关性的缺陷。

Result: 在图像处理上，将解码和后续推理所需的像素数据总量减少了1.6至7.1倍；在视频流处理上，相比最先进的基线方法实现了92.0%的带宽节省。此外，在目标设备上降低了43.1%至88.6%的能耗，并将推理延迟加速了1.6至3.0倍。

Insight: 核心创新在于发现低级压缩语法（如JPEG图像的DC系数/AC能量和视频流的运动矢量）与高级语义查询之间存在强相关性，并建立了云查询语义与多模态压缩域特征之间的精确映射，从而实现边缘端仅传输相关数据。该方法在压缩域进行推理，避免了完全解压，是边缘计算与压缩感知结合的创新思路。

Abstract: Modern satellite edge systems, including those performing remote sensing tasks such object detection and tracking, are characterized by severely limited bandwidth and intermittent connections, making continuous data transmission to the cloud impractical. Existing edge-cloud systems, however, either require heavy pre-processing before analysis, for instance, full decompression of imagery data, or transmit all compressed data regardless of relevance. To address these challenges, we design DynaFilter, a dynamic filtering technique that enables satellite edge devices to perform selective region-of-interest (RoI) inference directly in the compressed-domain, without full decompression. Our key insight is that low-level compression syntax, specifically DC coefficients/AC energy in JPEG images and motion vectors in video streams, exhibits strong correlations with high-level semantic queries. By establishing a precise mapping between cloud query semantics and multimodal compressed-domain features, DynaFilter enables the edge to identify and transmit only relevant data associated to RoIs. Extensive evaluations show that DynaFilter reduces the total volume of pixel data for decoding and subsequent inference by 1.6x-7.1x for images, and achieves 92.0% bandwidth savings for video streams compared to state-of-the-art baselines. Furthermore, it decreases energy consumption by 43.1-88.6% on target devices and achieves a 1.6x-3.0x speedup in inference latency.

[55] WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understanding cs.CVPDF

Xianzhi Ma, Shujun Wang, Xiaohan Li, Hao Liu, Changhua Pei

TL;DR: 本文提出WeaveEarth，一种无需训练的框架，用于超高分辨率遥感图像理解。该框架将UHR理解重新定义为全局上下文约束下的结构化证据构建与推理问题，通过全局感知证据构建选择最小支持证据集，并利用结构化证据推理将局部证据、空间元数据和相对拓扑编织成统一推理接口，以增强视觉语言模型的全局-局部联合推理能力。

Details

Motivation: 现有UHR遥感图像理解方法存在被动感知（可能丢失细粒度细节）或主动感知（延迟高、上下文碎片化、错误累积）的局限性。作者认为更有效的路径不在于获取更多信息，而在于更好地组织信息。

Result: 在多个UHR遥感基准测试和多个冻结的VLM骨干网络上进行的广泛实验表明，WeaveEarth始终优于强大的基线方法和现有的UHR方法。

Insight: 创新点在于将UHR理解重新定义为结构化证据构建与推理问题，并提出了全局感知证据构建和结构化证据推理机制。这提供了一种无需训练、通过有效组织信息来提升模型对全局场景布局和稀疏关键局部细节联合理解能力的新范式。

Abstract: Ultra-High-Resolution (UHR) remote sensing image understanding requires Vision-Language Models (VLMs) to capture both the global scene layout and sparse yet task-critical local details under limited computational budgets. Existing methods mainly follow two paradigms. One is passive perception, which relies on resolution expansion or token compression and may therefore discard fine-grained details. The other is active perception, which depends on multi-round zooming and search, but suffers from high latency, contextual fragmentation, and error accumulation. We argue that a more effective path toward UHR understanding lies not in accessing more, but in organizing better. To this end, we propose WeaveEarth, a training-free framework that reformulates UHR understanding as a problem of structured evidence construction and reasoning under global context constraints. Specifically, WeaveEarth first employs Global-Aware Evidence Construction to select a compact, low-redundancy, and spatially complementary Minimal Support Evidence Set. It then introduces Structured Evidence Reasoning, which weaves local evidence, spatial metadata, and relative topology into a unified reasoning interface, thereby enhancing the VLM’s ability to perform global-local joint reasoning. Extensive experiments show that WeaveEarth consistently outperforms strong baselines and existing UHR methods across multiple UHR remote sensing benchmarks and multiple frozen VLM backbones. Code is available at https://github.com/XianZhi-Ma/WeaveEarth.

[56] TextGaze: Prompting Gaze Target Estimation with Textual Scene Cues cs.CVPDF

Junhui She, Fei Wang, Kun Li, Yiqi Nie, Yuxin Liu

TL;DR: 本文提出TextGaze，一种利用大型视觉语言模型（LVLM）提供语义指导的统一跨模态架构，用于视线目标估计。该方法通过提取视觉特征并结合LVLM生成的与视线对齐的文本线索，设计基于Transformer的融合模块，联合预测视线热图和框内/框外状态，在多个主流数据集上取得了有竞争力的性能。

Details

Motivation: 解决现有视线目标估计方法中多分支方法标注负担重、领域迁移困难，以及流线型设计过度依赖低层视觉显著性而忽视真实视线意图的问题。

Result: 在四个主流数据集上进行评估，结果表明该方法在关键指标上具有竞争力，且无需额外微调即展现出稳健的跨数据集泛化能力。

Insight: 创新点在于利用LVLM作为可扩展的语义指导来平衡不同设计范式，通过跨模态融合和分层文本监督来对齐预测注意力与真实视线目标，为传统设计提供了一个流线型且高效的替代方案。

Abstract: Gaze target estimation aims to infer the position of a person’s gaze within a scene. Within mainstream design logic, multi-branch methods require extra supervision and annotations, while streamlined designs prioritize low-level visual saliency over true gaze intent. The former leads to a high annotation burden and hinders domain transfer, whereas the latter causes misalignment between predicted attention and actual gaze targets. To address this issue, we propose TextGaze, a unified cross-modal architecture that leverages a Large Vision-Language Model (LVLM) as scalable semantic guidance to balance the two design paradigms. The model extracts visual features from a frozen encoder and utilizes an LVLM to obtain gaze-aligned textual cues. We design a transformer-based fusion module with hierarchical text supervision to preserve task semantics. Lightweight decoding heads enable the joint prediction of gaze heatmaps and in-/out-of-frame status. We evaluate our method on four mainstream datasets, and the results show competitive performance across key metrics with robust cross-dataset generalisation without extra fine-tuning. Overall, we provide a streamlined alternative to traditional designs and highlight the potential of LVLMs as accessible auxiliary guidance for gaze estimation.

[57] REVA-PO: Stabilizing Reinforcement Learning for Chest X-ray Report Generation cs.CVPDF

Li Guo, Anas M. Tahir, Z. Jane Wang

TL;DR: 本文提出了REVA-PO（响应加权和验证锚定的策略优化）框架，用于稳定胸片X光报告生成的强化学习训练。该框架通过动态调整KL正则化权重和周期性重置参考策略，解决了传统RL训练中的不稳定和探索受限问题。在MIMIC-CXR和IU-Xray数据集上的实验表明，该方法在语言质量和临床准确性方面均达到了新的最先进水平。

Details

Motivation: 解决胸片X光报告自动生成任务中，强化学习训练因固定的KL正则化和静态参考策略导致的不稳定性及探索空间受限问题。

Result: 在MIMIC-CXR和IU-Xray数据集上取得了新的SOTA结果：BLEU-4分别提升了5.1%和3.6%，CheXpert F1和RadGraph F1分数分别提升了4.5%和12.8%。

Insight: 创新点在于提出了响应加权正则化（RER）和验证锚定策略重置（VAPR）机制，动态管理KL正则化压力并周期性重置策略以扩大探索空间；同时采用包含预热、分类器引导微调和RL的三阶段训练流程，确保了鲁棒的起点。

Abstract: Automated chest X-ray report generation has recently benefited from reinforcement learning (RL) and large language models. However, RL training often suffers from instability or limited exploration due to fixed Kullback-Leibler (KL) regularization and a static reference policy that accumulates KL pressure over time. We propose Response-Weighted and Validation-Anchored Policy Optimization (REVA-PO), a RL framework that stabilizes long-term training via Response-Weighted Regularization (RER) and Validation-Anchored Policy Reset (VAPR). RER dynamically adjusts per-response KL weights based on advantage and reference-policy entropy, relaxing constraints for high-quality responses while tightening them for low-quality ones. Complementarily, VAPR periodically synchronizes the reference and current policies to the best validation checkpoint, resetting accumulated regularization pressure to expand the viable exploration space. To ensure a robust starting point, we employ a three-stage pipeline consisting of warm-up training, classifier-guided supervised fine-tuning, and RL. Extensive evaluations on MIMIC-CXR and IU-Xray demonstrate that REVA-PO sets new state-of-the-art benchmarks in both linguistic quality and clinical accuracy. Notably, BLEU-4 improves by 5.1% on MIMIC-CXR and 3.6% on IU-Xray, while CheXpert F1 and RadGraph F1 scores increase by 4.5% and 12.8%, respectively, over prior leading methods. The code is publicly available at https://github.com/LiGuo12/REVA_PO/.

[58] EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generation cs.CV | cs.AIPDF

Dexiang Hong, Yijie Guo, Weidong Chen, Xinyan Liu, Zixuan Zou

TL;DR: EmoStyle是一个基于Z-Image的情感感知艺术图像生成框架，它通过LLM推理器从输入提示中预测情感线索和宽高比，并将情感信息编码为条件向量注入去噪过程，同时为不同艺术风格训练专用LoRA适配器以实现风格依赖的情感表达，最后通过VLM引导的候选选择步骤优化输出。

Details

Motivation: 解决情感感知艺术图像生成中，测试时缺乏训练数据中可用的视觉和情感属性（如颜色、光照、笔触）的显式指导，导致生成器难以决定如何通过视觉元素表达目标情感的控制鸿沟问题。

Result: 在AffectiveArt Challenge 2026的Track 1中，USTC_PI_LAB_TEAM的提交获得了第一名。

Insight: 创新点在于将LLM预测的结构化情感线索（如效价-唤醒度）编码为条件向量并通过AdaLN-style调制直接注入扩散模型的去噪块，而非仅作为文本提示；同时结合风格特定的LoRA专家适配器，使情感表达能适应不同艺术风格的先验（如颜色、纹理）。

Abstract: Emotion-aware artistic image generation requires an image to match the input prompt, follow the specified artistic style, and convey the target emotion. In this challenge, the main difficulty is that the visual and affective attributes available in the training data are not explicitly provided at test time. Without these attributes, the generator has to decide not only what to depict, but also how the target emotion should be expressed through color, lighting, brushwork, composition, line, and layout. This creates a control gap between the available test prompt and the fine-grained conditions needed for emotion-aware artistic generation. To bridge this gap, we propose EmoStyle, a Z-Image-based framework that converts the input prompt into a structured generation state. An LLM reasoner first predicts affective cues (valence-arousal, dominant emotion, and therapeutic-effect labels) and an aspect-ratio decision. Instead of using these predictions only as additional prompt text, we encode the affective fields into an affective condition vector and inject it into the denoising blocks through AdaLN-style modulation. This allows the inferred control variables to directly guide the generation of intermediate features. Since emotional expression is also style-dependent, we further train a dedicated LoRA adapter for each artistic style bucket and select the corresponding expert during inference, enabling the same affective cues to be rendered with bucket-specific priors for color, texture, brushwork, and composition. Finally, a lightweight VLM-guided candidate selection step ranks the generated images based on prompt alignment, style consistency, emotional expression, and visual quality. In Track 1 of the AffectiveArt Challenge 2026, our USTC_PI_LAB_TEAM submission achieved first place.

[59] BiLoG-Net: A Bi-Context Location-Guided Network for Breast Mass Segmentation and Malignancy Classification in Mammography cs.CV | cs.LGPDF

Abu Fatema Mohammad Abdun Noor, Md Imam Ahasan, Md Samiul Ahasan, Kah Ong Michael Goh, S M Hasan Mahmud

TL;DR: 本文提出了一种名为BiLoG-Net的深度学习框架，用于在乳腺X光片中联合执行乳腺肿块分割和恶性分类任务。该网络通过双上下文位置感知特征建模和分割引导的注意力机制，整合了新颖的编码器-解码器范式、基于Fire的特征提取、轻量级全局与局部特征增强模块以及自适应位置感知门控，以同时捕获长距离上下文依赖和细粒度边界敏感细节。

Details

Motivation: 解决乳腺X光片中因强度变化细微、组织密度异质和病变边界模糊导致的肿块准确检测和表征困难，这些因素使放射学解读变得复杂。

Result: 在CBIS-DDSM和INBreast基准测试中，BiLoG-Net取得了最先进的性能，Dice分数分别为94.20%和93.10%，分类准确率分别为95.20%和93.60%，AUC值分别为97.10%和96.00%，显著优于现有的CNN和基于Transformer的基线模型。

Insight: 创新点在于提出了一个紧密耦合的多任务设计，使像素级定位和图像级诊断相互增强，减少了误差传播，并在单一端到端模型中结合了精确的边界描绘和可靠的恶性评估。其双上下文位置感知特征建模和分割引导的注意力机制是有效的技术路径。

Abstract: Breast cancer remains the most commonly diagnosed malignancy among women worldwide, yet accurate detection and characterization of breast masses in mammography remain challenging due to subtle intensity variations, heterogeneous tissue densities, and indistinct lesion boundaries that complicate radiological interpretation. To address these limitations, we propose BiLoG-Net, a deep learning framework that jointly performs breast mass segmentation and malignancy classification through bi-context location-aware feature modeling and segmentation-guided attention mechanisms. Our architecture integrates a novel encoder-decoder paradigm with Fire-based feature extraction, lightweight global and local feature enhancement modules, and adaptive location-aware gating to simultaneously capture long-range contextual dependencies and fine-grained boundary-sensitive details. Unlike conventional multi-stage pipelines, our tightly coupled multi-task design enables mutual reinforcement between pixel-level localization and image-level diagnosis, reducing error propagation while producing spatially grounded malignancy predictions. Evaluated on CBIS-DDSM and INBreast benchmarks, BiLoG-Net achieves state-of-the-art performance with Dice scores of 94.20% and 93.10%, classification accuracies of 95.20% and 93.60%, and AUC values of 97.10% and 96.00%, respectively, substantially outperforming existing CNN and transformer-based baselines. By combining precise boundary delineation with reliable malignancy assessment in a single end-to-end model, this work holds strong potential for clinical computer-aided detection systems, helping radiologists prioritize suspicious cases and improve screening efficiency in busy clinical settings.

[60] CoSAG: Compact Semantic Anchor Gaussians via Training-Free Rate-Distortion Coding cs.CVPDF

Yuang Jia, Jinlong Wang, Junhong Lin, Ruiting Dai, Wei Gao

TL;DR: 本文提出了CoSAG方法，用于压缩基于3D高斯泼溅的开放词汇3D语义场。该方法通过无训练的闭式透射加权提升、空间锚点和多视角去噪构建语义场，并采用空间预测熵编码器实现亚兆字节级存储，在保持高精度的同时将场景存储大小减少了37至76倍。

Details

Motivation: 现有开放词汇3D场景理解方法通常将高维CLIP等特征附加到数百万个高斯点上，导致单个场景占用数GB存储，成为实际部署的瓶颈。现有压缩方法将场构建与存储耦合，且未压缩占主要成本的高斯点-特征绑定关系。本文主张将构建与存储解耦，并将存储视为高斯点与小锚点表绑定的率失真问题。

Result: CoSAG在2D渲染、3D选择和密集LSeg协议上达到或超越了当前最优水平，相比LangSplatV2在更高精度下将场景大小减少了37至76倍，实现了亚兆字节存储。

Insight: 创新点包括：1）无训练的场景构建（透射加权提升、空间锚点、多视角去噪）；2）将存储解耦为率失真编码问题，采用空间预测熵编码压缩高斯-锚点绑定；3）空间锚点使绑定可预测，编码器仅需编码空间预测残差，极大提升压缩效率。

Abstract: Open-vocabulary 3D scene understanding is commonly achieved by embedding 2D vision-language features such as CLIP into a 3D Gaussian Splatting scene, turning it into a text-queryable semantic field. However, attaching a high-dimensional feature to each of millions of Gaussians inflates a single scene to gigabytes, which makes storage and deployment the real bottleneck of these fields. Existing compact methods each learn and ship a per-scene codec, an autoencoder, a quantized codebook, or a distilled feature field, entangling field construction with field storage and never compressing the per-Gaussian assignment that holds the bulk of the cost. We argue that construction and storage should be decoupled, and that storage is a rate-distortion problem over the per-Gaussian binding to a small anchor table, a structure no prior open-vocabulary method compresses. We present CoSAG, which constructs the field without any per-scene training through a closed-form transmittance-weighted lift, spatially grounded semantic anchors, and multi-view denoising, and stores it with a spatially predictive entropy coder that ships no decoder. Because the anchors are spatially grounded, the binding is predictable and therefore highly compressible. The transmittance-weighted lift and multi-view denoising yield a clean, view-consistent assignment, so the entropy coder spends almost no rate on correcting noise and instead codes only the residual against its spatial prediction. CoSAG reaches sub-megabyte storage while matching or exceeding the state of the art across the 2D-rendered, 3D-selection, and dense-LSeg protocols, reducing field size by 37 to 76x relative to LangSplatV2 at higher accuracy.

[61] Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset cs.CVPDF

Zhiyan Zhang, Peipei Song, Jinpeng Hu, Jingyang Jia, Xun Yang

TL;DR: 该论文提出了动态情感推理（DAR）这一新的大规模基准数据集，旨在解决视频情感分析中忽略情感动态变化和因果推理的问题。DAR包含超过1.5万个视频和近3.7万个事件对齐的情感片段，并定义了情感分割、细粒度情感分类和情感推理三个任务。同时，论文提出了DAR-R1两阶段框架，在多个MLLM上实现了情感定位和推理的SOTA性能。

Details

Motivation: 现有视频情感分析通常将每个片段视为静态的独立分类单元，忽略了情感是随着对连续因果事件的累积反应而动态变化的这一关键心理学事实。

Result: 在超过10个多模态大语言模型（MLLM）上的实验表明，提出的DAR-R1框架在情感定位和情感推理方面均达到了新的最先进水平（SOTA）。

Insight: 核心创新在于引入了首个以观众为中心、关注连续视频事件间情感转换和因果推理的大规模基准DAR，其提供了密集、时序锚定且因果明确的推理链。提出的DAR-R1框架结合了监督微调与组相对策略优化，为动态情感建模提供了有效方法。

Abstract: Video emotion analysis is typically framed as a static classification problem, treating each clip as an independent labeled unit. However, such a formulation overlooks a key psychological fact: emotions change as a result of cumulative reactions to consecutive causal events. To bridge this gap, we introduce Dynamic Affective Reasoning, the first large-scale benchmark for viewer-centric affect transitions and causal reasoning over consecutive video events. DAR contains 15,087 videos and 36,908 event-aligned affective segments annotated with 27 emotion categories. Unlike existing video-based emotion datasets, DAR presents a new viewer-centric perspective on fine-grained emotional expressions and transitions, and provides dense, temporally grounded, and causally explicit reasoning chains. Based on DAR, we formally define three challenging tasks: affective segmentation, fine-grained emotion classification, and affective reasoning. Complementing this benchmark, we propose DAR-R1, a two-stage framework that combines supervised fine-tuning with Group Relative Policy Optimization. Experiments across 10+ MLLMs show that DAR-R1 sets a new state-of-the-art for dynamic affective reasoning, in terms of both emotional localization and affective reasoning. Project page: https://github.com/Zhang-Zhiyan/DAR.

[62] What Does Your Short-Answer VQA Score Actually Measure? Evaluator-Dependent Instability in Multimodal Short-Answer Benchmarks cs.CV | cs.MMPDF

Guanhua Ye, Niu Jingbin, Yan Li, Meiyu Liang, Zhe Xue

TL;DR: 这篇论文研究了短答案视觉问答（VQA）基准评测中存在的混淆问题：自动评估器将模型答案的语义正确性与表面形式匹配度混为一谈。通过对六个视觉-语言模型和六个基准进行大规模人工语义审核，研究发现大量官方判定的错误答案在语义上是可接受的，其得分不稳定主要受答案类型（如抽取式、多跨度答案）和评测细节（如提示词改写）影响。

Details

Motivation: 动机在于揭示短答案VQA基准评测中自动评估器的不稳定性，即官方分数无法清晰区分模型的实际语义理解能力与答案表面形式的匹配程度，这影响了评测结果的可靠性和可解释性。

Result: 在文本丰富的基准上，高达一半的官方错误答案在语义上是可接受的；答案类型（如抽取式、多跨度答案）对评测敏感性有显著结构化影响；通过确定性修复可部分恢复被低估的分数。

Insight: 创新点在于通过大规模人工语义审核量化了自动评估器的不稳定性，并揭示了答案类型和评测设置对结果的系统性影响；客观来看，该研究强调了为VQA基准分数提供语义审计和答案类型诊断的必要性，这对未来构建更稳健的评估体系具有借鉴意义。

Abstract: Short-answer VQA benchmarks conflate two distinct quantities: whether a model’s answer is semantically correct, and whether that answer matches the surface form expected by the automatic evaluator. We study this conflation across six vision–language models and six benchmarks, using a human-validated semantic judge (97.6% precision) to audit over 37k official errors. A second text-only judge reproduces the same benchmark-level false-negative pattern, showing that the effect is not an artifact of a single audit model. On text-rich benchmarks, up to half of these errors are semantically acceptable answers penalized purely for surface-form mismatch. This instability is structured by answer type: extractive and multi-span answers are far more evaluator-sensitive than scalar answers. Benign prompt and context rewrites further destabilize official outcomes, flipping item-level correctness at substantial rates without changing the underlying task. A deterministic CPU-only contract repair confirms that the undercount is partially recoverable. These findings imply that official short-answer VQA scores should be accompanied by semantic audits and answer-type diagnostics to remain interpretable.

[63] Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classification cs.CVPDF

Yating Li, Cheng Ye, Nenan Lyu, Weidong Chen, Zhendong Mao

TL;DR: 本文提出了一种用于宫颈细胞学图像分类的几何感知分类框架，结合了从预训练视觉语言特征中学习的语义抽象和结构先验。该方法使用高斯专家模块从全局语义信息生成轴向先验，捕获细胞核排列和细胞空间组织等结构规律，并将这些先验嵌入轴向自注意力模块以调制水平和垂直方向的相似性计算，从而改善长程依赖建模和结构敏感的特征交互。

Details

Motivation: 宫颈细胞学图像分类是自动化宫颈癌筛查的关键环节，但现有卷积模型难以建模长程关系，而基于注意力的模型缺乏明确的结构指导，因此需要结合结构先验来提升对复杂细胞形态和类间相似性的识别能力。

Result: 在Mendeley液体基细胞学和SIPaKMeD数据集上的实验表明，该方法分别达到了99.48%和96.08%的准确率，在召回率、精确率和整体分类性能上均有均衡提升，达到了SOTA水平。

Insight: 创新点在于将几何结构先验（如细胞核对齐）通过高斯专家模块显式地注入轴向自注意力机制，实现了语义与结构的协同建模，这为医学图像分析中结合领域知识提供了新思路。

Abstract: Accurate cervical cytology image classification is a key component of automated cervical cancer screening, where reliable recognition of normal, precancerous, and cancer-associated cellular patterns from Pap smear images can improve screening efficiency and diagnostic consistency. However, this task remains challenging because cervical cells exhibit complex morphology, subtle intra-class variations, and strong inter-class similarities. Existing convolution-based models capture local texture well but have limited ability to model long-range relationships, whereas attention-based models provide broader context but often lack explicit structural guidance. To address these limitations, we propose a geometry-aware classification framework for cervical cancer screening-oriented cytology image analysis, incorporating semantic abstraction and structural priors learned from pre-trained vision-language features. The method uses Gaussian expert modules to generate axis-wise priors from global semantic information, capturing structural regularities such as nuclear alignment and cellular spatial organization. These priors are embedded into an axial self-attention module to modulate similarity computation along horizontal and vertical directions, improving long-range dependency modeling and structure-sensitive feature interaction. Experiments on the Mendeley liquid-based cytology and SIPaKMeD datasets show that the proposed method achieves 99.48% accuracy on the former and 96.08% on the latter, with balanced gains in recall, precision, and overall classification performance. Visual analysis further shows that the learned priors highlight diagnostically relevant cellular regions, demonstrating the potential of the proposed framework as a screening-oriented decision-support tool for cervical cytology.

[64] InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generation cs.CVPDF

Yichen Peng, Jyun-Ting Song, Chen-Chieh Liao, Kris Kitani, Hideki Koike

TL;DR: 本文介绍了InterPet4D，这是首个用于捕捉人与狗自然交互的多模态4D数据集，包含多视角视频、分割、2D/3D关键点、网格和音频等多种标注。基于此数据集，作者进一步提出了InterPetMoGen框架用于人-宠交互运动生成，该模型在FID指标上显著优于Seq2Seq和DiT基线模型。

Details

Motivation: 由于缺乏高质量、大规模的数据集，人-宠交互的估计与生成研究一直未得到充分探索。

Result: 提出的InterPetMoGen模型在InterPet4D数据集上取得了11.21的FID分数，显著优于Seq2Seq和DiT基线，证明了数据集在建模真实人-宠交互方面的有效性。

Insight: 核心创新在于构建了首个大规模、多模态的人-狗交互4D数据集InterPet4D，并基于此提出了专门的生成框架InterPetMoGen，为这一新兴领域提供了宝贵的数据基准和有效的建模方法。

Abstract: Human-pet interaction estimation and generation remain underexplored due to the absence of a high-quality large-scale dataset. We present InterPet4D, the first multimodal dataset capturing natural interactions between humans and dogs. Using a synchronized multi-view capture system, we record human-dog obedience tasks and provide annotations for both humans and dogs, including multi-view and egocentric videos, segmentations, 2D and 3D keypoints, meshes, and audio tracks. InterPet4D consists of 6.8 million frames collected from 13 dogs of 11 breeds interacting with 23 human participants. We further introduce the InterPetMoGen framework for human-pet interaction motion generation. Our proposed model achieves an FID score of 11.21 and substantially outperforms the Seq2Seq and DiT baselines, demonstrating the effectiveness of InterPet4D for modeling realistic human-pet interactions.

[65] ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing cs.CV | cs.CLPDF

Jiakang Yu, Yixuan Chai, Tianci Wang, Rihui Jin, Guangkai Xu

TL;DR: 本文提出了ChartSync基准测试，用于评估生成式图像编辑模型在视觉-逻辑级联编辑任务中的能力，特别是在数据修改需要几何同步的结构化统计图表编辑场景。该基准包含870个三元组，涵盖9种图表类别和4种任务类型，并采用结合客观视觉指标与视觉语言模型评判的两层评估框架。对14个图像编辑模型和一个代码介导管线的评估揭示了现有模型在几何同步能力上的显著差距。

Details

Motivation: 现有生成式图像编辑模型在处理结构化统计图表时，当数据修改需要几何同步（如坐标轴、标签、图形元素联动更新）时面临困难，现有方法局限于局部文本替换，难以处理依赖感知的级联更新。

Result: 在ChartSync基准上评估了14个图像编辑模型和一个代码介导管线，结果显示大多数开源模型在几何同步方面表现严重下降，只有两个前沿专有模型展现出初步的VLCE能力，但其残差错误主要涉及语义隔离和背景损坏。

Insight: 创新点在于将图表编辑任务形式化为视觉-逻辑级联编辑问题，并构建了一个通过程序化渲染流程保证确定性视觉-逻辑耦合的专家验证基准。该研究通过详细的错误分析解构了失败范式，为未来多模态架构的核心元能力提供了指导方向。

Abstract: Generative image editing models struggle with structured statistical charts when data modifications require geometric synchronization. We formalize this task as Visuo-Logical Cascading Editing (VLCE). However, existing methods remain confined to localized text substitutions and struggle with dependency-aware cascading updates. To systematically evaluate this capability, we introduce ChartSync, an expert-validated benchmark constructed via a programmatic rendering pipeline that guarantees deterministic visuo-logical coupling for the ground truth. ChartSync comprises 870 triplets across 9 chart categories and 4 task types, including 235 geometry-coupled VLCE instances that specifically test cascading text-to-geometry synchronization. We further evaluate these instances via a two-tier framework combining objective visual metrics with a vision-language model judge paradigm to assess low-level fidelity alongside multimodal comprehension and reasoning. Evaluating 14 image editing models and one code-mediated pipeline reveals a nuanced capability gap: most open-source models suffer severe drops in geometric synchronization, while only two frontier proprietary models show emerging VLCE capability, with their residual errors mainly involving semantic isolation and background corruption. Our detailed error analysis deconstructs these failure paradigms to identify core meta-abilities for guiding future multimodal architectures. The ChartSync dataset and code are publicly released at https://github.com/kaka-yjk/ChartSyncCodebase.

[66] Structured Evidence Selection for Weakly Supervised Video Anomaly Detection cs.CVPDF

Chenglizhao Chen, Tianxiang Nan, Wen Li, Xinyu Liu, Guisheng Zhang

TL;DR: 本文提出了一种结构化证据选择框架（SESAD），用于弱监督视频异常检测。该框架将异常检测重新定义为对片段级视觉证据的结构化推理过程，通过重组片段表示并基于场景和动作约束进行上下文条件选择，以强调异常相关语义并抑制场景干扰。此外，引入了一个轻量级几何判别模块，在嵌入空间中构建双原型结构，通过相对几何关系进行异常决策。

Details

Motivation: 弱监督视频异常检测仅依赖视频级标签进行训练，难以在复杂场景中准确定位异常事件。现有模型倾向于依赖与场景相关的统计线索而非真正的行为偏差，导致检测性能不稳定。

Result: 在UBnormal、ShanghaiTech和UCF-Crime数据集上的大量实验表明，SESAD分别实现了67.92、97.99和88.46的AUC，同时保持了高计算效率和整体一致的稳定异常判别能力。

Insight: 创新点在于将异常检测重构为结构化证据选择过程，并引入几何判别模块。这通过上下文条件选择机制缓解了弱监督下的语义纠缠问题，并通过双原型结构的几何关系增强了判别稳定性，为处理场景与行为动态纠缠提供了新思路。

Abstract: Weakly supervised video anomaly detection relies solely on video-level labels for training, making it difficult to accurately localize anomalous events in complex scenes. In real-world videos, anomalous behaviors exhibit large variations in appearance and temporal duration, while scene appearance and action dynamics are often tightly entangled. Consequently, existing models tend to rely on scene-related statistical cues rather than true behavioral deviations, resulting in unstable detection performance. To address this challenge, we propose a Structured Evidence Selection framework (SESAD) that reformulates anomaly detection as a structured reasoning process over clip-level visual evidence. Instead of directly mapping aggregated features to anomaly scores, SESAD reorganizes clip representations into semantically structured candidate evidence and performs context-conditioned selection under scene and action constraints. This mechanism adaptively emphasizes anomaly-relevant semantics while suppressing scene interference, thereby alleviating semantic entanglement under weak supervision. Furthermore, we introduce a lightweight geometric discrimination module that constructs a dual-prototype structure in the embedding space, enabling anomaly decisions through relative geometric relations. Extensive experiments on UBnormal, ShanghaiTech, and UCF-Crime show that SESAD achieves 67.92, 97.99, and 88.46 AUC, respectively, while maintaining high computational efficiency and overall consistently stable anomaly discrimination.

[67] Generalize LMMs to Versatile Visual Modalities via Fabricated Modality Synthesis cs.CVPDF

Shihao Yuan, Yuanze Li, Ruyi Zhang, Ming Liu, Wangmeng Zuo

TL;DR: 本文提出VVM-Tuning训练框架，通过模态合成和模态上下文，使大型多模态模型（LMMs）能够泛化到未见过的视觉模态。该方法从RGB场景合成外观多样的图像，训练模型解耦不变语义与可变视觉外观，并通过指令调优将外观变化映射回模态相关属性，实现零样本适应。

Details

Motivation: 尽管LMMs在RGB视觉上取得进展，但其泛化到未见视觉模态的能力仍未被充分探索。作者认为不同视觉模态是对同一物理世界的不同采样，因此模型需要具备模态无关的场景语义感知和对模态特定特征的适应能力。

Result: 实验表明，在提出的合成模态上进行训练后，5个测试模型在真实世界和新的合成模态上均表现出一致的性能提升，且无需进行模态内训练。评估在包含6种真实和合成模态的VVM-Bench基准上进行。

Insight: 创新点在于通过合成外观变化的图像来解耦语义与外观，并结合模态上下文提示进行指令调优，从而赋予LMMs对未知视觉模态的零样本泛化能力。这为模型理解多模态提供了新的训练范式。

Abstract: Despite the advancements of Large Multimodal Models (LMMs) in RGB vision, their ability to generalize to unseen visual modalities remains a largely unexplored challenge. We argue that different visual modalities are merely distinct samplings of the same physical world. Therefore, effective generalization requires models to possess both modality-agnostic perception of scene semantics and the adaptability to modality-specific characteristics. To achieve this, we propose a training framework, VVM-Tuning, to equip LMMs with these capabilities through modality synthesis and modality contexts. Specifically, we synthesize diverse appearance-varied images from RGB scenes, training the model to disentangle invariant semantics from varying visual appearances, and align these appearances with language for visual concepts decoupled from modalities. We then introduce modality contexts in the prompt and use instruction tuning to assist the model in mapping these appearance variations back to modality-related attributes, enabling zero-shot adaptation to unseen modalities during inference. To facilitate research in this direction, we introduce VVM-Bench, a comprehensive benchmark featuring 6 real and synthetic modalities to evaluate semantic perception and modality understanding. Experiments demonstrate that, via our training on synthetic modalities, 5 tested models exhibit consistent improvements on both real-world and novel synthetic modalities without in-modality training. Source code and data will be publicly available at https://github.com/Hunter-Will/VVM-Tuning.

[68] Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift cs.CV | cs.AIPDF

Giang Nguyen, Raghav Mehta, Emma A. M. Stanley, Tian Xia, Thi Hao Nguyen

TL;DR: 本文系统评估了15个基础模型在乳腺X线摄影图像特征提取任务中，面对外部领域偏移时的鲁棒性。通过统一的冻结骨干网络线性探测协议，在3个源数据集上训练并在12个分布外数据集上测试，发现乳腺摄影专用视觉语言模型表现最佳，但鲁棒性并非仅由乳腺影像数据暴露量决定。

Details

Motivation: 基础模型在乳腺X线摄影中作为特征提取器日益普及，但其在外部领域偏移下的鲁棒性尚未明确，需要系统评估不同模型在真实临床场景中的泛化能力。

Result: 乳腺摄影专用视觉语言模型（Mammo-FM和MaMA）在分布外测试中取得最佳平均性能，但DINOv3仍保持竞争力的视觉基线性能；模型在12个分布外数据集上表现出异质性性能，且乳腺适应预训练并未持续改善泛化能力。

Insight: 创新点在于首次系统评估乳腺摄影基础模型的领域偏移鲁棒性，并揭示数据集级别的分布外评估应成为评估表征质量的核心标准；特征空间分析表明，有效表征可同时保留临床信号与数据集采集结构。

Abstract: Foundation models are increasingly used as image feature extractors for mammography, but their robustness under external domain shift remains unclear. We benchmark 15 foundation-model backbones across breast density, BI-RADS severity, and cancer status using a unified frozen-backbone linear-probe protocol, training on 3 source datasets and evaluating on 12 task-compatible out-of-distribution (OOD) datasets after label harmonization. Mammography-specific vision-language models (Mammo-FM and MaMA) provide the strongest mean OOD performance, but robustness is not explained by mammography exposure alone. DINOv3 remains a competitive vision-only baseline, and mammography-adapted pretraining does not consistently improve generalization. Dataset-level analysis further shows that even leading models show heterogeneous performance across datasets. Feature-space inspection reveals that useful representations can preserve clinical signal while retaining dataset and acquisition structure. These findings highlight dataset-level OOD evaluation as a central criterion for assessing mammography representations. Our code is publicly available: https://github.com/biomedia-mira/mammo-ood.

[69] Imperceptible and Reversible Adversarial Examples against Vision-Language Models for Privacy Protection cs.CVPDF

Qi Lu, Ziqi Zhou, Yufei Song, Zijing Li, Lulu Xue

TL;DR: 本文提出CloakDiff框架，旨在保护视觉语言模型（VLMs）中的图像隐私，防止基于文本的查询攻击。该框架通过结合基于扩散的对抗性编辑和可逆网络，生成人眼难以察觉且可无损恢复原图的对抗样本，在扰动像素空间嵌入和潜在交叉注意力图的同时保持了高视觉保真度。

Details

Motivation: 现有可逆对抗样本（RAE）方法仅适用于纯视觉任务，无法应对多模态场景；而针对VLMs的现有对抗样本通常依赖高频噪声，严重损害图像质量。因此，需要一种能在多模态设置下提供高保真度、可逆隐私保护的方法。

Result: 在多个数据集和VLMs上的实验表明，CloakDiff能够实现多模态隐私保护，同时具备高视觉质量和可逆性，证明了其有效性。

Insight: 创新点在于首次将可逆对抗样本框架扩展到多模态隐私保护，通过结合扩散模型和可逆网络实现无损恢复；同时设计了EDM启发式采样策略以优化对抗性引导的扩散过程，增强了跨模型和跨提示的迁移性及视觉保真度。

Abstract: Vision Language Models (VLMs) offer powerful multimodal ability but also expose users to text-based privacy attacks where adversaries crawl online photos and query VLMs to extract sensitive attributes. Existing reversible adversarial example (RAE) methods protect images in purely visual tasks but fail in multimodal settings, and current adversarial examples on VLMs rely on high frequency noise that severely degrades visual quality. We propose CloakDiff, the first framework for reversible, high fidelity privacy protection against text-based query attacks in VLMs. CloakDiff produces imperceptible adversarial examples by combining diffusion based adversarial editing with an invertible network that embeds the original image for lossless recovery. It perturbs both pixel space embeddings and manipulates latent cross attention maps to ensure strong cross-model and cross-prompt transferability while preserving global visual structure. To further enhance fidelity, we design EDM Heuristic Sampling, a principled diffusion schedule for adversarial guidance. Experiments on multiple datasets and VLMs demonstrate that CloakDiff delivers multimodal privacy preservation with high visual quality and reversibility.

[70] Gradient-Skipping Relevance Propagation for Efficient Explainability of Vision Transformers cs.CV | cs.LGPDF

Christopher Buratti, Michele Marchetti, Federica Parlapiano, Davide Traini, Domenico Ursino

TL;DR: 本文提出了一种名为GradSkip的新颖相关性传播方法，旨在高效解释视觉Transformer（ViT）。该方法通过自适应注意力头加权和跳跃连接感知的传播，解决了现有方法因忽略注意力头重要性不均和残差连接影响而导致的相关性归因不准确问题。实验表明，GradSkip在保持SOTA忠实度的同时，计算开销大幅降低。

Details

Motivation: 现有ViT可解释性方法（如相关性传播和注意力流）未能充分考虑注意力头重要性不均和残差连接等关键架构特征，导致相关性归因不准确，因此需要一种更高效、更精确的解释方法。

Result: 在ImageNet1K和BloodMNIST数据集上的实验表明，GradSkip达到了SOTA的忠实度，同时所需GFLOPs比现有最佳方法减少了14倍以上；在基于Transformer的分割任务评估中，也显示出更好的定位能力与真实区域对齐。

Insight: 创新点在于引入了自适应注意力头加权和跳跃连接感知的传播机制，动态分配注意力路径与残差路径的相关性，从而更精确地建模ViT内部信息流，实现了高精度与低计算开销的平衡。

Abstract: Vision Transformers (ViTs) are difficult to interpret because current methods of relevance propagation and attention flow do not fully consider some key architectural features, such as the uneven importance of attention heads and residual connections. Prior approaches typically assume uniform importance across attention heads; furthermore, they model skip connections as identity paths, leading to inaccurate relevance attribution. To address these issues, we introduce GradSkip, a novel relevance propagation method for ViTs based on adaptive head weighting and skip-aware propagation. GradSkip models the different importance of the attention heads and dynamically distributes relevance between the attention and residual paths. Experiments on ImageNet1K and BloodMNIST demonstrate a state-of-the-art faithfulness of GradSkip while requiring over 14 times fewer GFLOPs than the best-performing existing approaches. Additional evaluations using transformer-based segmentation confirm improved localization and alignment with ground-truth regions.

Ruiyan Gong, Yingnan Guo, Junjun Hu, Jintao Kong, Xiaoxu Leng

TL;DR: 本文提出了ABot-N1，一个迈向通用视觉语言导航基础模型的系统。它通过一个由双重视觉-语言信号引导的慢-快架构，将认知与控制解耦。慢速视觉语言推理器执行显式的思维链推理并生成像素目标，作为连接不同任务的通用接口；快速动作专家则利用文本线索和像素引导，以原生控制频率生成连续路径点。该方法在模拟和真实世界基准测试中实现了鲁棒、可泛化且可解释的导航。

Details

Motivation: 当前视觉语言导航基础模型通常采用将观测直接映射到动作的一体化策略，这容易导致坐标漂移、对长尾语义处理不佳，并且缺乏可解释性，难以同时实现通用性、鲁棒性和透明度。本文旨在解决这些问题。

Result: ABot-N1在多个基准测试中取得了新的最先进（SOTA）记录。在城市规模导航中，POI到达率提升了35.0%（达到77.3%），在复杂的室内和室外场景中分别实现了95.4%和92.9%的成功率（SR）。在物体到达、人员跟随和指令跟随任务中也保持了卓越的鲁棒性。

Insight: 核心创新在于通过慢-快架构和像素锚点将高级意图与低级控制解耦，像素锚点作为通用任务接口，结合显式的语言推理轨迹，增强了模型的通用性、鲁棒性和可解释性。这为解决一体化策略的局限性提供了一种新思路。

Abstract: Visual Language Navigation foundation models aim to unify deep reasoning for grounded spatial decisions with broad versatility for diverse embodied tasks. Current approaches typically achieve this integration via monolithic policies that map observations directly to actions, yet they often suffer from coordinate drift and poor handling of long-tail semantics. Furthermore, these black-box mappings lack interpretability, hindering the simultaneous achievement of generality, robustness, and transparency. We present ABot-N1, a step toward a general Visual Language Navigation foundation model, that addresses these challenges by decoupling cognition from control via a slow-fast architecture guided by dual visual-language signals. More specifically, a slow vision-language reasoner performs explicit Chain-of-Thought reasoning while producing a pixel goal. This compact set of image-space anchor points serves as a universal interface for diverse tasks, including point-goal, object-goal, poi-goal, instruction-following, and person-following. Subsequently, a fast action expert leverages both the textual cues and the pixel guidance to generate continuous waypoints at the native control frequency. By bridging high-level intents and low-level control through pixel-grounded anchors paired with explicit linguistic traces, our approach ensures robust, generalizable, and interpretable navigation across simulation and real-world benchmarks. ABot-N1 establishes new state-of-the-art records, delivering massive gains specifically in urban-scale navigation: boosting POI arrival by 35.0% (to 77.3%) and achieving 95.4%/92.9% SR in complex indoor and outdoor scenes. It also maintains superior robustness across object-reaching, person-following, and instruction-following tasks. New Point-Goal/POI-Goal benchmarks are released as open source to advance the field of urban-scale navigation.

[72] Vertical Fusion: Condensing Internal Representations for Robust ViT Classification cs.CV | cs.LG | eess.IVPDF

Francesco Di Salvo, Shyam Nandan Rai, Hamed Damirchi, Ignacio Meza De la Jara, Sebastian Doerrich

TL;DR: 本文挑战了Vision Transformer（ViT）仅使用最后一层作为特征提取器的传统做法，提出了可恢复性概念，即中间层表示能够纠正最后一层的分类错误。通过评估16个数据集上各深度的独立分类探针，发现中间探针能正确分类最后一层误判样本的18%至76%。为此，作者提出了VFusion方法，一种可学习的低维潜在空间映射策略，用于聚合ViT内部层次的特征，在分布内和分布外设置中均显著优于现有聚合基线，并一致推广到不同模型规模和预训练方案。

Details

Motivation: 尽管ViT暴露了丰富的中间表示，但通常仅被视为黑盒特征提取器，仅最后一层用于下游任务。作者挑战这一惯例，通过引入可恢复性概念，探索中间层纠正最后一层分类错误的能力，以利用模型内部的垂直信号。

Result: 在16个数据集上的实验表明，中间探针能纠正最后一层误判样本的18%至76%。VFusion方法在分布内和分布外设置中均显著优于现有聚合基线，将最佳单层与理论Oracle性能之间的准确率差距缩小了45%，且增益在不同模型规模和预训练方案中一致泛化。

Insight: 创新点在于提出了可恢复性概念和基于冗余-正确性对应的垂直聚合策略VFusion，通过可学习的低维映射合成ViT内部层次特征，提供了一种鲁棒且高效的替代水平集成方法的新思路。

Abstract: Despite exposing rich intermediate representations, Vision Transformers (ViTs) are almost exclusively utilized as black-box feature extractors, where only the last layer is considered for downstream tasks. We challenge this convention by introducing the notion of recoverability: the capacity of intermediate representations to correct last-layer failures. By evaluating independent classification probes at every model depth across 16 datasets, we observe that intermediate probes correctly classify 18% to 76% of samples that the last-layer probe misclassifies. We show that these gains are not primarily driven by predictive diversity, but by a redundancy-correctness correspondence, where the internal hierarchy acts as a series of stable, redundant probes of a shared discriminative signal. While established horizontal ensemble strategies (i.e., across multiple models) can improve performance, they incur high computational cost and ignore this vertical signal within a single model. To bridge this gap, we propose VFusion, a principled vertical aggregation strategy employing a learnable mapping into a low-dimensional latent space that synthesizes features across the internal ViT hierarchy. VFusion substantially outperforms established aggregation baselines in both in-distribution and out-of-distribution settings, notably closing 45% of the accuracy gap between the best individual layer and a theoretical oracle performance. Our gains consistently generalize across model sizes and pre-training regimes, confirming that VFusion offers a robust and efficient alternative to horizontal ensemble methods. The code is available at https://github.com/francescodisalvo05/vit-vertical-fusion.

[73] SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding cs.CV | cs.AIPDF

Abhigya Verma, Khyati Mahajan, Amit Kumar Saha, Shruthan Radhakrishna, Sagar Davasam

TL;DR: 本文提出了SynthDocBench，一个用于长上下文视觉文档理解的全合成基准测试，通过组合设计独立控制文档长度、布局结构、模态组成和问题类型等因素，以系统分析模型行为。评估七个前沿视觉语言模型后，发现了现有基准无法揭示的三种失败模式：随文档长度急剧退化、对文档中间部分的位置敏感性以及长文档环境下图表理解能力的崩溃。

Details

Motivation: 现有视觉文档理解基准（如DocVQA、ChartQA）无法分离文档长度、布局复杂性、模态和问题难度等现实因素，导致难以归因模型失败的具体原因，因此需要构建一个可控的合成基准来系统分析模型行为。

Result: 在SynthDocBench上评估七个前沿视觉语言模型，发现五种模型在文档中间三分之一部分表现最差，六种模型呈现负面的“早至晚”趋势（最大下降8.3个百分点），且图表理解在长文档设置中崩溃，表明当前模型可能过度拟合基准伪影而非实现鲁棒的长上下文理解。

Insight: 通过组合设计生成完全可控的合成文档，避免了模型利用虚假相关性；引入40%随机覆盖机制增强泛化测试；首次系统揭示了模型在长文档中的位置敏感性退化模式，为基准构建提供了可解释性分析框架。

Abstract: Vision language models (VLMs) have achieved strong performance on visual document understanding benchmarks such as DocVQA, ChartQA, and MMLongBench-Doc. However, real-world documents combine multiple factors such as length, layout complexity, modality, and question difficulty, which makes it difficult to attribute model failures to specific causes. We introduce SynthDocBench, a fully synthetic benchmark for long-context visual document understanding that systematically controls factors including document length, layout structure, modality composition, and question type. The benchmark is constructed using a combinatorial design, each factor is varied independently across generated documents, enabling controlled analysis of model behavior. Documents are generated end to end using an LLM pipeline across six layout archetypes, with a 40 percent random override to prevent models from exploiting spurious correlations. Additionally, SynthDocBench spans long-context documents with substantially greater length and structural diversity than existing benchmarks. Evaluating seven frontier VLMs, we uncover three failure modes that existing benchmarks cannot surface: sharp degradation with document length, a systematic positional sensitivity in which the middle third of a document is hardest for five of six models and five of six models show a negative Early-to-Late trend (steepest decline: 8.3 percentage points), and breakdown of chart comprehension in long-document settings. These results suggest that current models may be overfitting to benchmark artifacts rather than achieving robust long-context visual document understanding.

[74] Self-supervised Automatic Matting cs.CVPDF

Xiaonan Hu, Zhiyuan Lu, Jingdong Zhao, Hao Lu

TL;DR: 本文提出了一种名为SSMatte的自监督自动抠图框架，首次实现了无需任何人工标注（仅使用RGB图像）即可训练自动抠图模型，其性能与全监督方法相当。该框架将问题分解为语义锚定和细节抠图两个阶段，通过基于广义瑞利商的新型语义锚定损失和基于不动点的alpha-RGB一致性损失进行优化。

Details

Motivation: 高质量alpha蒙版的标注成本极高，构成了深度图像抠图的基本数据瓶颈。现有方法虽尝试使用trimap或mask等较粗标签降低成本，但仍依赖昂贵的逐像素监督，限制了可扩展性和泛化性。本文旨在探索能否仅使用RGB图像、无需任何手动标注来训练自动抠图模型。

Result: 大量实验表明，SSMatte在肖像抠图基准测试上超越了先前的弱监督方法，并与全监督模型的性能相当，同时在增加数据时展现出良好的扩展和泛化行为。

Insight: 论文宣称的创新点在于首次提出了完全无需标注的自监督自动抠图范式，其核心洞察是将问题分解为语义锚定和细节抠图，并引入了基于广义瑞利商的训练高效语义锚定损失和基于不动点的alpha-RGB一致性损失。从客观角度看，该方法通过利用冻结的自监督ViT特征和创新的损失函数设计，有效解决了无监督抠图中的语义引导和细节恢复难题，为抠图任务提供了一种全新的、可扩展的解决方案。

Abstract: High-quality alpha mattes are notoriously expensive to annotate, creating a fundamental data bottleneck for deep image matting. While prior work attempts to reduce annotation cost using coarser labels like trimaps or masks, they remain reliant on costly per-pixel supervision, limiting scalability and generalization. In this work, we push the boundary further and ask: can we train an automatic matting model using only RGB images, with no manual annotation at all? We answer this by presenting SSMatte, a self-supervised framework that for the first time achieves performance on par with fully-supervised automatic matting. Our key insight is to decompose the problem into semantic anchoring and detail matting. SSMatte first generates a semantic matting prompt from frozen self-supervised ViT features by propagating class-token seeds via a novel, training-efficient semantic anchoring loss based on a generalized Rayleigh quotient. This prompt then anchors a detail matting network, which is optimized via a fixed-point-based loss that enforces alpha-RGB consistency. Extensive experiments show SSMatte outperforms prior weakly-supervised methods, matches the performance of fully-supervised models on portrait benchmarks, and demonstrates favorable scaling and generalization behaviors with additional data. Our work pushes automatic matting to an fresh, fully annotation-free paradigm. Code will be available.

[75] TVT-PAPD: Pathology-Aware Prototype Distillation for Self-Supervised Whole Slide Image Classification cs.CV | cs.LGPDF

Ramesh Naidu Laveti, Jaya Sreevalsan-Nair, T K Srikanth

TL;DR: 本文提出了一种名为TVT-PAPD的自监督学习框架，用于全切片图像（WSI）分类。该框架结合了微型视觉变换器（TVT）和一种新颖的病理感知原型蒸馏（PAPD）模块，旨在从大规模未标记的WSI中学习可转移的、病理特异性的形态学表征。

Details

Motivation: 现有自监督学习方法主要学习通用视觉特征，未能显式捕获对疾病表征至关重要的病理特异性形态模式。本文旨在解决这一局限性，提升模型对病理形态的感知能力。

Result: 在癌症基因组图谱（TCGA）的低级别胶质瘤（LGG）/胶质母细胞瘤（GBM）数据集和印度病理脑（IPD-Brain）数据集上的实验表明，TVT-PAPD在LGG-GBM分类任务上分别取得了93.02%和90.23%的加权F1分数，并在独立的胶质瘤数据集上展现出强大的跨队列泛化能力。

Insight: 核心创新点是引入了病理感知原型蒸馏（PAPD）模块，它通过一个可学习的病理原型库来发现和保留具有代表性的组织形态模式，从而鼓励语义相似的病理区域学习一致且具有判别性的表征。这为自监督学习在医学图像分析中如何融入领域先验知识提供了新思路。

Abstract: Self-supervised learning (SSL) has emerged as an effective paradigm for learning transferable representations from large-scale unlabeled whole slide images (WSIs). However, existing SSL methods primarily learn generic visual features and often fail to explicitly capture pathology-specific morphological patterns that are critical for disease characterization. To address this limitation, we propose Tiny Vision Transformer with Pathology-Aware Prototype Distillation (TVT-PAPD). This self-supervised pathology representation learning framework integrates a Tiny Vision Transformer (TVT) with a novel Pathology-Aware Prototype Distillation (PAPD) module. PAPD employs a learnable pathology prototype bank to discover and preserve representative tissue morphology patterns, encouraging semantically similar pathological regions to learn consistent and discriminative representations. The proposed framework enhances pathology-aware feature learning while maintaining computational efficiency with 90M parameters. Experiments on the Cancer Genome Atlas (TCGA) low-grade glioma (LGG)/glioblastoma (GBM) dataset and the Indian Pathology Brain (IPD-Brain) dataset demonstrate that TVT-PAPD achieves weighted F1-scores of 93.02% and 90.23%, respectively, for LGG-GBM classification, while exhibiting strong cross-cohort generalization across independent glioma datasets.

[76] On the Real-World Generalisability of Optical Flow Models cs.CV | eess.IVPDF

Petter Reijalt, Sander Gielisse, Rickard Karlsson, Jan van Gemert

TL;DR: 本文研究了光流模型在真实世界视频中的泛化能力，构建了一个名为FlowFactor的真实世界评估基准，包含1000个高清帧对，并评估了多种现代光流模型。研究发现，现有合成基准（如Sintel、KITTI和Spring）的性能仅能弱预测真实世界准确性，且增加训练数据不一定能缩小差距，需要创新研究。

Details

Motivation: 解决光流模型因依赖合成数据和领域特定基准而导致的真实世界泛化能力不足的问题，评估模型在真实场景中的实际表现。

Result: 在FlowFactor基准上，模型在光照变化和大位移场景下的性能与真实世界准确性最相关；在Sintel、KITTI和Spring等合成基准上的进展仅弱预测真实世界数据准确性。

Insight: 创新点包括构建诊断性真实世界基准FlowFactor，以四个混淆因素（大位移、重复纹理、遮挡和光照变化）进行针对性分析；客观分析表明，单纯扩大数据和计算不能解决泛化差距，需新研究方法。

Abstract: Real-world deployment of vision models to broadly benefit society is arguably a main research objective. In optical flow, however, the difficulty to obtain the ground truth has focused research mainly on synthetic data and domain-specific benchmarks. Here, we investigate the severity of this mismatch. We study how well modern optical flow estimation models generalise to real-world video and question if accuracy on synthetic benchmark proxies actually predicts accuracy on real-world optical flow. To address this, we build a real-world evaluation benchmark and evaluate the real-world generalisability of a broad set of recent optical flow models using standard checkpoints. Our benchmark contains 8,204 frame pairs across TAP-Flow, Slow Flow, and our own dataset FlowFactor. FlowFactor is a manually annotated real-world benchmark of 1,000 HD frame pairs organised into four confounding factors: large displacements, repetitive textures, occlusions, and lighting variation. Each setting mainly varies only one factor, enabling diagnostic, confounder-specific analysis. Using FlowFactor, we reveal that performance on varying lighting and large displacements correlates most strongly with real-world accuracy, and that improvements on large-motion regimes can trade off against robustness in small-motion, stationary scenes. Our experiments show that progress on Sintel, KITTI and Spring only weakly predicts accuracy on real-world data, highlighting the need for a broad real-world optical flow benchmark. Interestingly, scaling up the amount of training data does not necessarily resolve the gap, calling for new innovative research instead of simply scaling data and compute.

[77] NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices cs.CVPDF

Filip Pawlicki, Marcel Kańduła, Marcin Pucek, Kamil Dobies

TL;DR: 本文提出了NanoVSR，一种专为资源受限的边缘设备设计的、可扩展的全卷积视频超分辨率架构。它通过结构重参数化在推理时折叠为标准卷积，确保了硬件兼容性，并通过渐进式训练隐式学习时空对齐，避免了显式光流计算。在REDS4基准测试中，该模型在精度和计算效率之间取得了卓越的平衡。

Details

Motivation: 解决现有视频超分辨率方法因依赖Transformer和显式光流而带来的计算开销和定制操作问题，这些因素阻碍了其在TensorRT等硬件加速器上的部署，旨在实现边缘设备上的实时视频超分辨率。

Result: 在REDS4基准上，NanoVSR-644k模型达到28.64 dB PSNR，在NVIDIA Jetson Orin NX 16GB (25W)上实现27.2 FPS；更大的NanoVSR-1.7M模型达到29.15 dB PSNR和19.58 FPS，在紧凑架构中显著改进了精度与效率的权衡。

Insight: 主要创新点在于采用全卷积架构和结构重参数化以实现硬件友好的高效推理，以及通过渐进式训练隐式学习时空对齐来替代显式运动补偿，从而在保持竞争力的恢复质量的同时，实现边缘设备的实时处理。

Abstract: Recent Video Super-Resolution (VSR) methods rely heavily on transformers and explicit optical flow, creating computational overhead and custom operations that hinder deployment on hardware accelerators like TensorRT. To address this, we introduce NanoVSR, a scalable, fully convolutional architecture designed for resource-constrained edge devices. Using structural reparameterization, NanoVSR collapses into standard convolutions during inference, ensuring seamless hardware compatibility and negligible runtime overhead. Furthermore, despite lacking explicit motion compensation, it maintains competitive restoration quality by implicitly learning spatio-temporal alignments through progressive training. Evaluated on the REDS4 benchmark, NanoVSR demonstrates an exceptional balance between accuracy and computational efficiency, significantly improving the trade-off for compact architectures. Our NanoVSR-644k baseline yields 28.64 dB PSNR while delivering 27.2 FPS on the NVIDIA Jetson Orin NX 16GB (25W), offering massive speed gains over heavier models. The scaled NanoVSR-1.7M variant reaches 29.15 dB with a throughput of 19.58 FPS, providing superior, edge-optimized upscaling. Code is available at https://github.com/filippawlicki/nanovsr.

[78] Anomalous Frame Detection by Grouping Frame Similarities between Two Videos Computed by Vision-Language Model to Extract Expert Workers’ Unique Actions cs.CVPDF

Ryo Sakai, Yongpeng Cao, Nobutaka Kimura

TL;DR: 本文提出了一种基于视觉-语言模型的方法，通过比较基于手册的工作视频与专家维护工作视频，检测包含专家隐性知识的异常帧，以提取专家独特动作。该方法在模拟配电盘维护实验中，针对11种手册未描述的动作类型，实现了66.9%的提取率，比传统技术提升了50个百分点。

Details

Motivation: 解决关键基础设施（如铁路和电厂）维护中，熟练工人数量下降导致的技能传承难题，传统访谈方法难以捕捉专家无意识的隐性知识（know-how）。

Result: 在模拟配电盘维护实验中，针对11种手册未描述的动作，方法实现了66.9%的异常帧提取率，相比传统技术有50个百分点的显著提升。

Insight: 创新点在于利用视觉-语言模型计算视频间帧相似性并进行分组，以自动化检测异常帧来揭示专家隐性维护知识；客观分析认为，该方法将多模态模型应用于工业技能提取，为知识转移提供了数据驱动的解决方案。

Abstract: Maintenance of critical infrastructures, such as railways and power plants, is essential for operational safety and reliability. However, the declining number of skilled maintenance workers poses a serious challenge to sustaining these operations, highlighting the need to effectively transfer expert know-how to less experienced workers. Although traditional interview-based approaches have been used to elicit maintenance skills, they struggle to capture know-how that experts themselves may not consciously recognize. To address this gap, we proposed a method that detects anomalous frames of candidate actions including know-how by comparing a video of manual-based work with that of expert maintenance workers. In a simulated maintenance experiment involving a distribution board, our method targeted 11 types of actions not described in the manual and achieved a 66.9% extraction rate, marking a 50-percentage-point improvement over conventional techniques. These findings underscore the effectiveness of our approach in revealing hidden maintenance knowledge, thereby contributing to enhanced skill transfer and workforce development in critical infrastructure maintenance.

[79] End-to-End Real-Time Drone-Based Person Detection Framework Using Deep Learning cs.CV | cs.LGPDF

Payel Sarmah, Ayush Ranjan, Piyush Kaushik Bhattacharyya, Anil Kr. Shaw, Pradip Kr. Das

TL;DR: 该论文提出了一种基于YOLOv8-nano架构的端到端实时无人机人员检测框架，旨在通过无线实时视频流解决无人机在飞行高度变化时目标尺度变化导致的检测一致性问题。

Details

Motivation: 现有监控框架在无人机因高度变化导致目标尺度显著变化时，难以保持检测一致性，造成关键信息缺失，因此需要一种能应对尺度变化并确保准确定位的实时检测方案。

Result: 在VisDrone2019数据集上训练，YOLOv8-nano模型取得了57.4%的精确率、41%的召回率、44.8%的mAP和20.3%的mAP50:95；在真实环境中，算法在16至25米高度区间实现了近乎完全的检测可靠性，检测帧率稳定在41 FPS以上，峰值达50 FPS。

Insight: 创新点在于构建了一个集成化的实时检测流水线，专门针对无人机视频流中的尺度变化挑战，通过基于YOLOv8-nano的轻量级设计平衡了检测精度与实时性能，确保了在特定高度范围内的可靠运行。

Abstract: In recent years, Unmanned Aerial Vehicles (UAVs) or drones have gained rapid response in terms of security, search and rescue (SAR), border surveillance, etc. Existing monitoring frameworks often struggle to maintain detection consistency when targets undergo significant scale variations due to altitude changes, leading to critical information gaps. To address this issue, this work proposes an integrated real-time detection pipeline for detecting targets through the wireless live drone video feed. Build upon YOLOv8-nano architecture, extensive flight experiments were conducted to determine the detection performance across multiple flight altitudes. Trained on VisDrone2019 dataset, the results of YOLOv8-nano model achieves 57.4%, 41%, 44.8% and 20.3% in precision, recall, mAP and mAP50:95 respectively. While demonstrating on real environment, this analysis revealed that the algorithm achieves near-total detection reliability at altitudes between 16 and 25 meters with the detection frame rate consistently maintained above 41 FPS and reaching a peak of 50 FPS. However, the goal of this work is to enable real-time person detection from an aerial platform via wireless transmission. This approach effectively addresses the dual challenges of identifying targets at varying scales and ensuring near-to-accurate localization during aerial observation.

[80] WasteAssistant: Regulation-Guided Visual Question Answering Framework for Intelligent Waste Segregation and Sustainable Managemen cs.CV | cs.AIPDF

Khush Kataruka, Harshit Maurya, Anuja Vats, Murari Mandal, Kiran Raja

TL;DR: 本文提出了一个名为WasteAssistant的框架，用于智能垃圾分类和可持续管理。该框架结合了视觉语言模型和多模态大语言模型，通过视觉问答范式，依据印度《2016年固体废物管理规则》进行联合视觉-语言推理。作者构建了一个包含13,500个问答对的新数据集WasteVQA，涵盖21个废物类别。实验表明，基于BLIP的模型在BLEU和BERTScore指标上优于传统CNN方法，提高了源头分类准确性并确保法规遵从性。

Details

Motivation: 现有自动化系统存在单模态视觉处理、上下文理解不足以及与法规对齐弱等局限性，无法满足高效垃圾分类这一可持续城市管理和环境治理的关键需求。

Result: 在构建的WasteVQA数据集上，基于BLIP的模型取得了0.8291的BLEU分数和0.9273的BERTScore，超越了传统的基于CNN的方法，展示了其有效性。

Insight: 主要创新点在于提出了一个法规引导的多模态视觉问答框架，将具体的环境法规（印度SWM规则）与AI模型相结合，并创建了专门针对垃圾分类的VQA数据集，为可持续城市基础设施中的多模态AI应用提供了新思路。

Abstract: Efficient waste segregation is critical for sustainable urban management and environmental governance. Existing automated systems are limited by single-modality visual processing, insufficient contextual understanding, and weak regulatory alignment. To address these issues, we propose a language-guided vision-AI framework that integrates vision-language models and multimodal large language models for joint visual-linguistic reasoning. This framework implements a visual question answering paradigm aligned with India’s Solid Waste Management Rules 2016. We construct a new WasteVQA dataset with 13,500 question-answer pairs across 21 waste categories. Experiments show that the BLIP-based model achieves a BLEU score of 0.8291 and a BERTScore of 0.9273, outperforming traditional CNN-based methods. This work improves source-level segregation accuracy, ensures regulatory compliance, and supports scalable deployment for municipal and citizen-facing waste management, promoting multimodal AI in sustainable urban infrastructure. The source code and dataset are available at: https://github.com/Khushkataruka/WasteAssistant

[81] Spectral Heat Flow for Conservative Token Condensation in Vision-Language Models cs.CVPDF

Zhaoyang Li, Yanjun Li, Wangkai Li, Yujia Chen, Tianzhu Zhang

TL;DR: 本文提出了一种名为SpecFlow的无训练框架，用于在视觉语言模型（VLMs）中实现保守的令牌压缩，以替代传统的破坏性令牌剪枝方法。该方法通过谱热流计算稳定的重要性场来保持结构连贯性，利用自适应空间分区分配预算以确保覆盖范围，并将丢弃的信息聚合到核心集汇点以维持统计守恒。SpecFlow无需微调、即插即用，且与FlashAttention兼容，在多种任务、VLM架构和剪枝比例下均优于现有SOTA方法。

Details

Motivation: 现有视觉语言模型推理成本高昂，因为需要处理长序列的视觉令牌。现有的令牌剪枝方法在高压缩率下往往会盲目丢弃信息、破坏空间结构或导致多样性崩溃，导致性能下降。

Result: 实验表明，SpecFlow在多种任务、VLM架构和剪枝比例下均优于SOTA方法。具体而言，在剪枝88.9%的视觉令牌后，LLaVA-1.5模型仍能保持原始性能的95.6%，实现了卓越的效率-精度平衡。

Insight: 创新点在于将范式从破坏性剪枝转变为保守性压缩，严格强制执行空间覆盖和统计守恒以确保稳定性。具体技术包括：将视觉令牌视为kNN图中的节点，通过谱热流计算重要性场以保持结构连贯性；通过自适应空间分区分配预算以保证覆盖；以及将丢弃信息聚合到核心集汇点以维持统计守恒。这是一种无需训练、即插即用的高效方法。

Abstract: Vision-Language Models (VLMs) are costly at inference time because they must process long sequences of visual tokens. Existing token pruning methods often degrade under high compression by blindly discarding information, breaking spatial structure or collapsing diversity. We propose SpecFlow, a training-free framework that shifts the paradigm from destructive pruning to conservative condensation, strictly enforcing spatial coverage and statistical conservation to ensure stability. Treating visual tokens as nodes in a $k$NN graph, SpecFlow (i) computes a stable importance field via spectral heat flow to preserve structural coherence, (ii) allocates budgets via adaptive spatial partitioning to guarantee coverage, and (iii) aggregates discarded information into coreset sinks to maintain statistical conservation. The method is plug-and-play, requires no fine-tuning, and is compatible with FlashAttention. Experiments confirm that our SpecFlow outperforms SOTA methods across tasks, VLM architectures, and pruning ratios. Notably, LLaVA-1.5 with SpecFlow retains 95.6% of original performance despite pruning 88.9% of visual tokens, offering an exceptional efficiency-accuracy balance. Code is available at https://github.com/Lzy-dot/SpecFlow

[82] Answer-Conditioned Chain-of-Thought Distillation for Few-Shot Industrial Vision with Small VLMs cs.CV | cond-mat.mtrl-sci | cs.AI | cs.LGPDF

Shubham Rao

TL;DR: 本文提出了一种基于答案条件化思维链（CoT）蒸馏的方法，用于在工业视觉任务中，利用极少量标注数据（每任务18-30张图像）快速适配小型视觉语言模型（VLMs）。该方法利用前沿大模型为训练图像生成带有正确标签的视觉解释，然后通过LoRA对3B参数的小模型进行微调，使其在多个工业分类任务上性能超越直接微调，并在焊缝射线分类任务上以24张训练图像超越GPT-4.1。

Details

Motivation: 在制造业部署基于AI的视觉检测面临挑战，因为需求频繁变化、新缺陷类型出现且难以获得大规模标注数据集。本文旨在解决如何利用极少量标注数据，快速将小型视觉语言模型适配到新的工业任务上。

Result: 在涵盖三种图像模态的四个工业分类任务上，仅使用每任务18-30张标注图像，该方法在全部16个种子-任务组合上均优于直接微调，平均提升+1.7到+4.4个百分点。在焊缝射线分类任务上，微调后的3B模型仅用24张训练图像，性能就超越了GPT-4.1达10.0个百分点。

Insight: 核心创新点是答案条件化思维链蒸馏，通过将思维链生成过程约束在正确答案上，确保所有训练推理都导向正确结论，从而避免了前沿大模型生成错误推理（在最难任务上准确率仅24.1%）对小型模型性能的损害。这证明了在数据稀缺的工业场景下，利用高质量、答案引导的推理数据进行知识蒸馏的有效性。

Abstract: Deploying AI-based visual inspection in manufacturing is hard because requirements change often, new defect types appear, and large labeled datasets are rarely available. We propose answer-conditioned chain-of-thought (CoT) distillation for rapidly adapting small vision-language models (VLMs) to new industrial tasks using minimal labeled data. A frontier VLM receives each training image along with its correct label and generates a justified visual explanation. A 3B-parameter model is then fine-tuned on these reasoning-augmented examples via LoRA. By conditioning on correct answers, we ensure all training reasoning is directed toward the correct conclusion, which is critical because frontier models score as low as 24.1% on our hardest task. We validate on four industrial classification tasks spanning three image modalities using only 18 to 30 labeled images per task. Across 4 seeds per task (32 training runs), our method outperforms direct fine-tuning on all 16 seed-task combinations, with mean improvements of +1.7 to +4.4 percentage points. A controlled equal-budget experiment confirms the improvement comes from reasoning quality, not additional training steps. An unconditioned baseline demonstrates that with out answer-conditioning, wrong reasoning degrades performance by 17.8 percentage points. On weld radiograph classification, the fine-tuned 3B model outperforms GPT-4.1 by 10.0pp using just 24 training images.

[83] Effective Synthetic Image Detection via Noise Residual Clustering cs.CV | cs.CRPDF

Caihui Yan, Gang Cao, Huawei Tian, Zhen Li, Yuhang Zhai

TL;DR: 本文提出了一种无需训练的合成图像检测方法，通过使用预训练的Noiseprint++模型提取噪声残差指纹，并利用冻结的Vision Transformer提取多尺度特征进行自适应加权融合，最后仅需少量真实图像样本来初始化无监督K-Means聚类中心，从而区分真实与合成图像。

Details

Motivation: 生成式AI的快速发展使得合成图像极为逼真，带来了错误信息和欺诈等安全威胁，而现有基于监督训练的检测器成本高且在未知生成模型上性能下降，因此需要一种无需训练、泛化能力强的检测方法。

Result: 在四个基准数据集上的广泛评估表明，该方案平均准确率达到82.2%，在泛化能力上优于最先进的检测器，尤其在流行的扩散模型生成的合成图像上表现优异，并通过消融研究验证了各模块的有效性。

Insight: 创新点在于提出了一种完全无需训练的检测框架，结合了预训练的噪声残差提取器和冻结ViT特征提取器，仅需少量真实样本进行聚类初始化，实现了对未知生成模型合成图像的有效检测，提升了方法的实用性和泛化性。

Abstract: The rapid advancement of generative artificial intelligence (AI) has made synthetic images remarkably realistic, posing security threats such as misinformation and fraud. It is significant to detect the synthetic image in the manner of passive and blind image authentication. Most existing detectors rely on supervised training with large labeled datasets, leading to high costs and degraded performance on unknown generative models. To attenuate such deficiencies, we propose a training-free detection method. Specifically, noise residual fingerprints are first extracted by a simple yet effective pre-trained Noiseprint++ model. Then multi-scale features are further extracted from such residual by a frozen Vision Transformer (ViT), followed by adaptive weighted fusion. Only a few real image samples are used needed to initialize the clustering centers for unsupervised K-Means, distinguishing real and synthetic images without training. Extensive evaluations on four benchmark datasets show that our proposed scheme achieves an average accuracy of 82.2%, outperforming the state-of-the-art detectors on generalization ability. Superior performance is gained on the popular diffusion type of synthetic images, and the effectiveness of each module is validated by ablation studies. Source code will be publicly available at https://github.com/multimediaFor/NoiseCluSID.

[84] Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation cs.CV | cs.ROPDF

Changfei Fu, Guangcheng Chen, Wenjun Xu, Hong Zhang

TL;DR: 本文提出Traj-VLN模型，通过自回归轨迹生成在2D像素空间中学习导航交互，以解决视觉语言导航任务中视觉语言模型难以处理3D空间交互的问题。该方法将导航任务分解为子任务序列，直接预测像素坐标轨迹，避免了引入深度或3D几何信息。

Details

Motivation: 视觉语言模型在预训练时主要基于RGB图像对话，难以理解涉及深度感知的3D空间交互指令，而现有VLN方法依赖深度或3D信息可能不兼容模型先验。

Result: 实验表明像素空间轨迹监督显著提升VLN性能，旗舰模型在有限计算资源和训练数据下达到SOTA水平。

Insight: 创新点在于将导航交互建模为像素空间的自回归轨迹生成，避免引入外部3D信息，直接利用2D视觉特征学习空间交互，提升了模型泛化能力和效率。

Abstract: Benefiting from the powerful priors embedded in large-scale pre-training data and the emerging commonsense reasoning ability, large language models (LLMs) have shown unprecedented generalization capabilities in many research fields. Recently, projecting visual embeddings into the language space via vision-language models (VLMs) to achieve sim-toreal and cross-scene generalization has become a prevailing paradigm in the field of Vision-and-Language Navigation in Continuous Environments (VLN-CE). VLN requires an embodied agent to navigate through unseen environments following natural linguistic instructions. We emphasize that a VLN task can be decomposed into a sequence of sub-tasks, each corresponding to a process of 3D spatial interaction with the environments described by instructions such as “walk to the end of the sofa and turn left.” However, such spatial interactions involving moving into the image along the direction of depth sensing are puzzling for VLMs as they were predominantly trained on conversations with RGB images. Rather than incorporating depth or 3D geometric information-which VLMs rarely encounter during pretrainingwe propose an alternative approach: fine-tuning VLMs to learn navigation interactions directly in 2D pixel space through autoregressive trajectory generation. Given a linguistic instruction and historical observations, our model sequentially predicts a series of pixel coordinates, drawing a trajectory from the bottom center of the current observation. While prior work has proved that pixel-goal supervision outperforms learning of discrete actions, our experiments further verify that the supervision of pixel-space trajectory significantly enhances VLN performance. Moreover, we demonstrate that our flagship model achieves state-of-the-art level performance with relatively limited computational resources and training data.

[85] Water Reflection Detection Using Symmetric Attention cs.CVPDF

Shuxuan Yao, Chengjia Wang, Jianyuan Sun, Junyu Dong, Xinghui Dong

TL;DR: 本文提出了一种名为SAWRD-Net的对称感知水反射检测网络，旨在解决计算机视觉系统因水反射而混淆物体与其镜像的问题。该方法通过结合二面体群等变卷积与矩阵分解解码器，在端到端框架中检测自然水域场景中的反射轴，以提高物体检测和场景理解的可靠性。

Details

Motivation: 水反射对计算机视觉系统构成重大挑战，标准深度学习模型常将物体与其镜像混淆，导致物体检测和语义分割等任务中出现误报和漏报。因此，检测自然水域场景中的反射轴对于可靠的物体检测和场景理解至关重要。

Result: 在最大的可用水反射场景数据集上评估，SAWRD-Net相对于人工标注实现了0.890的真阳性率，优于所有现有的水反射检测器，达到了SOTA水平。

Insight: 创新点在于利用水固有的不完美反射对称性，将二面体群等变卷积与矩阵分解解码器耦合，通过对称注意力机制突出反射相关区域，并采用鲁棒主成分分析拟合最终反射轴，为处理对称性相关的视觉问题提供了新思路。

Abstract: Reflections of water pose a significant challenge for computer vision systems, as standard deep learning models frequently confuse objects with their mirror images, producing spurious false positives and negatives in tasks such as object detection and semantic segmentation. As a result, detecting reflection axes in natural-water scenes is pivotal for reliable object detection and scene understanding. To mitigate this issue, we leverage the intrinsic imperfect reflective symmetry of water and introduce a Symmetry-Aware Water Reflection Detection Network, namely, SAWRD-Net, that couples dihedral group-equivariant convolutions with a matrix-decomposition decoder in an end-to-end framework. First, dihedral group convolutional layers extract geometry-consistent feature maps that explicitly encode both rotational and mirror symmetries. A Multi-scale Reflection Equivariant block then aggregates features across scales and employs a symmetric-attention mechanism to highlight reflection-relevant regions. The proposed matrix-decomposition decoder factorizes high-dimensional features into compact low-rank parameter and confidence spaces, after which the network directly regresses keypoints on the reflection axis. Then a robust principal component analysis fits the final axis. Evaluated on the largest available water reflection scene data set, SAWRD-Net achieves a true-positive rate of 0.890 against human annotations, outperforming all existing water reflection detectors.

[86] TOLiD: Bridging the Architecture Gap in Vision Foundation Model to LiDAR Pretraining via Token Lifting for Distillation cs.CV | cs.LG | cs.ROPDF

Sutharsan Mahendran, Darshana Priyasad, Kaushik Roy, Tharindu Fernando, Sridha Sridharan

TL;DR: 本文提出了一种名为TOLiD的自监督预训练方法，用于LiDAR表示学习。该方法通过将LiDAR骨干网络与从冻结的视觉基础模型（VFM）教师初始化的学生视觉变换器（ViT）耦合，并在兼容的补丁-令牌表示上应用监督，以弥合视觉基础模型与LiDAR预训练之间的架构差距。核心创新包括使用视锥池化和视锥注意力将每个图像补丁视锥内的点特征集转换为令牌，并进行令牌级蒸馏。

Details

Motivation: 现有从视觉基础模型（VFMs）到LiDAR骨干网络的跨模态蒸馏方法通常将VFM视为冻结的特征源，并训练异构的3D骨干网络来匹配固定的图像嵌入，这迫使学生模型同时弥合模态差距和密集ViT令牌表示与稀疏3D编码器之间的跨架构差距。本文旨在解决这一双重差距问题。

Result: 在五个异构LiDAR数据集和四个跨传感器适应对上进行了广泛评估，结果表明，使用冻结骨干网络和轻量级头部时，TOLiD方法实现了改进的迁移性能。

Insight: 主要创新点在于提出了一个耦合的学生ViT架构，通过视锥池化与注意力机制进行令牌转换和蒸馏，并利用掩码双线性采样将令牌特征提升回逐点表示，以处理LiDAR点稀疏的问题，从而更有效地桥接视觉与LiDAR模态的表示学习。

Abstract: Cross-modal distillation from Vision Foundation Models (VFMs) to LiDAR backbones has recently emerged as a self-supervised pretraining strategy that reduces reliance on dense point-wise annotation for 3D scene understanding. However, existing distillation pipelines typically treat the VFM as a frozen feature source and train a heterogeneous 3D backbone to match fixed image embeddings, forcing the student to bridge both the modality gap and the cross-architecture gap between dense ViT token representations and sparse 3D encoders. We propose TOLiD, a self-supervised pretraining method for LiDAR representation learning that addresses this gap by coupling a LiDAR backbone with a student Vision Transformer (ViT) initialized from a frozen VFM teacher and applying supervision over compatible patch-token representations. TOLiD converts the set of point features within each image patch frustum into a token using Frustum Pooling followed by Frustum Attention, and performs token-level distillation with visibility masking. For LiDAR-only deployment, we lift token features back to per-point representations using masked bilinear sampling to avoid patches that have limited LiDAR points. We extensively evaluate TOLiD on five heterogeneous LiDAR datasets and four cross-sensor adaptation pairs, demonstrating improved transfer with frozen backbones and lightweight heads.

[87] RED-Sphere: Hyperspherical Residual Edge Debiasing for Cross-Population Fundus Disease Domain Generalization cs.CVPDF

Yan Lin, Ziheng Wang, Shuang Chen, Amir Atapour-Abarghouei, Stephen McGough

TL;DR: 本文提出了一种名为RED-Sphere的即插即用鲁棒性框架，用于解决医学图像分类器在未见人群分布偏移下的泛化问题。该方法通过边缘和特征能量先验估计捷径敏感干扰响应，利用残差软门控抑制主导响应，并结合反事实一致性损失和分离损失进行正则化，最终使用归一化球形原型进行标签预测。

Details

Motivation: 医学图像分类器通常在单一源人群上训练，但在临床部署中需要面对外观、采集风格和疾病流行率与源队列不同的患者，现有方法往往需要群体监督或将外观变化视为无差别的干扰，不足以处理与人群相关的低级线索和病变证据共享边缘和纹理结构的问题。

Result: 在严格的White-only Harvard-FairVision协议下，RED-Sphere在20个任务和骨干网络比较中均提升了保留集的宏观F1分数，在年龄相关性黄斑变性和糖尿病视网膜病变任务上平均分别提高了1.28和2.98个F1点，AUC和PR-AUC的提升、视觉诊断、消融实验和敏感性分析进一步支持了更强的外部语义对齐和更稳定的角度疾病几何结构。

Insight: 创新点在于提出了一种基于超球面残差边缘去偏的框架，通过边缘先验和残差软门控分离外观捷径和语义证据，利用反事实一致性损失增强鲁棒性，并采用归一化球形原型促进角度语义证据的学习，该方法不依赖于视网膜解剖结构，可推广到其他模态。

Abstract: Medical image classifiers are often trained within one source population, yet clinical deployment requires robustness to patients whose appearance, acquisition style, and disease prevalence differ from the source cohort. Existing fairness and robustness methods often require group supervision or treat appearance variation as an undifferentiated nuisance, which is insufficient when population-correlated low-level cues and lesion evidence share edge and texture structure. We study a strict source-only cross-population setting, where external populations are unseen during optimization, validation, scheduling, hyperparameter and model selection. We propose RED-Sphere, a plug-and-play robustness framework for image classification under unseen population shifts. It estimates shortcut-sensitive nuisance responses with an edge and feature energy prior, attenuates dominant responses through residual soft gating, regularizes masked nuisance views with counterfactual-inspired consistency and separation losses, and predicts labels with normalized spherical prototypes. It favours angular semantic evidence over source-correlated activation magnitude while preserving lesion structure. Although demonstrated on 2D Scanning Laser Ophthalmoscopy (SLO) fundus classification for Age-Related Macular Degeneration (AMD) and Diabetic Retinopathy (DR), RED-Sphere is not tied to retinal anatomy: the same principle can be adapted with modality-specific nuisance priors wherever appearance shortcuts and semantic evidence are entangled. Under a strict White-only Harvard-FairVision protocol, RED-Sphere improves held-out macro-F1 across all 20 task and backbone comparisons, with average gains of 1.28 and 2.98 F1 points on AMD and DR. Gains in AUC and PR-AUC, visual diagnostics, ablations, and sensitivity analyses further support stronger external semantic alignment and more stable angular disease geometry.

[88] Detecting AI-Generated Video: A Vision-Language Dual-View Survey cs.CV | cs.CLPDF

Dylan Xinming Hou, Juntian Zhang, Xu Gu, Yichen Wu, Nils Lukas

TL;DR: 本文对AI生成视频（AIGC-V）检测领域进行了系统性综述，提出将检测任务重新定义为‘事实保真度验证’，即判断视频中描绘的事件、实体和物理过程是否与现实世界事实一致。论文提出了一个视觉-语言双视角分类法，将现有方法组织成一个包含内在线索分析、时空一致性建模、跨模态一致性推理和语言引导的世界级推理的四层层次结构，并基于对221篇文献的回顾，综合分析了AIGC-V的生成范式、检测方法、评估指标和基准。

Details

Motivation: AI生成视频的真实感日益增强，使得传统的基于伪影的检测方法变得不足，需要从低层检查转向高层语义验证的范式转变。

Result: 论文通过系统综述221篇文献，提出了一个组织该领域方法的分类法，并回顾了评估指标和基准，旨在推动该领域的发展。

Insight: 创新点在于将AIGC-V检测任务重新定义为‘事实保真度验证’，并提出了一个视觉-语言双视角的层次化分类法，强调了从传统的深度伪造检测中的伪影匹配向基于视觉语言模型和智能体推理流程的、基于证据的语义验证的根本性转变。

Abstract: The evolving realism of AI-generated Videos (AIGC-V) is rapidly rendering traditional artifact-centric detection insufficient, necessitating a paradigm shift from low-level inspection to high-level semantic verification. This paper presents a comprehensive survey of AIGC-V detection, reframing the task as Factual Fidelity Verification, which asks whether the events, entities, and physical processes depicted in a video are consistent with real-world facts. To systematize this rapidly evolving field, we propose a Vision-Language Dual-View taxonomy that organizes existing methods into a hierarchical, four-layer landscape, spanning intrinsic cue analysis, spatiotemporal consistency modeling, cross-modal consistency reasoning, and language-guided world-level reasoning. This dual-view framing highlights a fundamental transition from artifact matching in traditional deepfake detection to evidence-based semantic verification enabled by vision-language models and agentic reasoning pipelines. Based on a systematic review of 221 works, we synthesize AIGC-V generation paradigms, survey the landscape of detection methods, and review evaluation metrics and benchmarks in line with proposed views. Finally, we discuss current challenges and identify promising directions toward robust, explainable, and trustworthy detection.

[89] Is Energy Guidance All You Need? Training-Free Norm Injection for Driving World Models cs.CV | cs.ROPDF

Xiyan Su, Frank Diermeyer, Markus Lienkamp

TL;DR: 本文探讨了驾驶世界模型的可控性问题，提出了一种无需重新训练扩散主干网络的训练后控制方法。研究表明，基于Open-Sora 2.0 MM-DiT主干构建的驾驶世界模型，可以通过在采样时注入可微能量函数来引导其规划的自车轨迹，从而遵循交通规范。然而，研究发现生成的视频并未完全跟随引导的轨迹，并指出跨流耦合是实现端到端可控推演的关键要求。

Details

Motivation: 解决基于大型视频扩散主干构建的驾驶世界模型难以控制的问题，避免为强制执行交通规范而需要重新训练主干网络或依赖手动构建的布局条件。

Result: 实验表明，基于Open-Sora 2.0 MM-DiT主干构建的世界模型，可以通过采样时注入能量引导，使其规划的自车轨迹在反事实目标处刹车。但生成的视频尚未完全跟随引导的轨迹。

Insight: 创新点在于提出了一种无需特定知识重新训练扩散主干的训练后控制方法，通过可微能量函数在采样时引导轨迹。客观分析认为，实现端到端可控推演的关键在于主干网络中跨流（视频与轨迹）的耦合机制。

Abstract: Driving world models built on large video-diffusion backbones generate realistic scenes but are hard to control: enforcing a traffic norm typically means retraining the backbone or conditioning it on hand-built layouts. We ask whether controllability requires training at all. Our experiment shows that a rectified-flow driving world model, which jointly generates future video and a planned ego trajectory, can have its planned trajectory steered entirely at sampling time by differentiable energy functions that encode driving norms, without knowledge-specific retraining of the diffusion backbone. Concretely, we demonstrate that a world model built on Open-Sora 2.0 MM-DiT backbone can be steered to brake at a counterfactual target by injecting energy guidance at sampling time. However, we find that the generated video does not yet follow the steered trajectory through the backbone’s joint self-attention and identify the cross-stream coupling as a crucial requirement for end-to-end-controllable rollouts.

[90] MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction cs.CVPDF

Jinqian Yang, Yichen Wu, Wanhua Li, Haokun Lin, Renzhen Wang

TL;DR: MAC-Splat提出了一种用于稀疏视图高保真3D重建的训练框架，通过引入多属性一致性损失来直接监督3D高斯泼溅模型的几何一致性。该方法利用MASt3R几何骨干和冻结的DINOv3编码器获取语义感知的2D对应关系作为几何锚点，联合正则化匹配高斯的位置、形状和外观属性。

Details

Motivation: 现有通用3D高斯泼溅方法在稀疏视图下常因仅依赖2D光度损失而产生几何伪影，无法解决深度和对应关系的歧义性问题。

Result: 在ScanNet++数据集上的实验表明，MAC-Splat显著优于基线方法，在不同重叠度下均有大幅提升：PSNR比Splatt3R提高超过4.5 dB，LPIPS降低，且随着相机位姿差距增大仍保持性能稳定。

Insight: 创新点在于提出直接的多属性3D一致性监督损失，结合高质量对应关系解决病态稀疏视图重建问题；其损失函数对异常值鲁棒且尊重协方差矩阵的几何特性，实现了稀疏视图下的稳定训练。

Abstract: Reconstructing high-fidelity 3D scenes from sparse-views remains a central problem in generalizable neural rendering. Existing generalizable 3D Gaussian Splatting (3DGS) methods often exhibit geometric artifacts in sparse-view settings, since supervision based solely on 2D photometric losses cannot resolve depth and correspondence ambiguities. To address this issue, we propose MAC-Splat, a training framework built around direct 3D consistency supervision. MAC-Splat builds on the MASt3R geometric backbone and a frozen DINOv3 encoder to obtain semantically informed 2D correspondences, which serve as geometric anchors for 3D supervision. Using these anchors, we define the Multi-Attribute Consistency (MAC) loss. This objective jointly regularizes the 3D attributes of matched Gaussians, including their position, shape, and appearance, by enforcing agreement in a common world coordinate frame. The formulation is robust to outliers and respects the geometry of covariance matrices, which leads to stable training under sparse-view conditions. Experiments on ScanNet++ show that MAC-Splat outperforms strong baselines, with particularly large gains under different overlap regimes. In particular, it improves average PSNR over Splatt3R by more than 4.5 dB, reduces LPIPS, and maintains performance as the camera pose gap increases. These results indicate that a direct, multi-attribute 3D consistency objective, when combined with high-quality correspondences, is effective for addressing the ill-posed sparse-view reconstruction problem.

[91] Mixture of Cognitive Experts in Large Vision-Language Models cs.CVPDF

Robert Wijaya, Ngai-Man Cheung

TL;DR: 本文提出了一种基于证据驱动的多模态推理框架，通过引入Bloom分类法作为分层推理协议，将多个特定领域视觉专家模型的输出整合为连贯的、可验证的表示。该方法通过两阶段认知言语化过程，首先生成原子化的证据陈述，再将其转化为分阶段的推理轨迹，从而提升大型视觉语言模型（LVLM）的感知与推理能力，并增强可解释性。

Details

Motivation: 现有大型视觉语言模型在处理跨认知层次的视觉语言问题时，通常采用统一的感知-推理路径，难以有效整合多个专用视觉专家模型（如物体检测、文本识别等）的输出，导致幻觉问题且缺乏可验证性。

Result: 实验表明，该方法在感知和推理能力上取得了多项改进；其轻量级推理轨迹模块提供了定量证据，显示不同查询会引发不同的认知入口水平和证据使用轨迹，支持细粒度分析。

Insight: 核心创新在于利用Bloom分类法构建分层推理协议，并通过两阶段认知言语化（Literal Evidence Summary与Bloom Verbalization）将多专家输出结构化，实现了证据驱动的、可解释的多模态推理，为整合异构感知模型提供了系统化框架。

Abstract: Large Vision Language Models (LVLMs) require strong reasoning over both visual and textual input. Recent work suggests that cognitive elements, especially diverse representations and metacognition, correlate with better performance. Many of the needed perceptual functions are already provided by specialized domain-specific computer vision models, which act as the perceptual subsystem for detecting objects, localizing them, inferring states, recovering spatial layout, and reading text. The key challenge is to integrate these multi-encoder experts into a trustworthy, interpretable, and coherent representation that improves verifiability and reduces hallucinations. This is difficult because vision-language questions span different cognitive levels, yet most LVLM pipelines apply the same perception-reasoning routing regardless of the demand of each query. We propose an evidence-driven multimodal reasoning framework that utilizes a Bloom-inspired taxonomy as a hierarchical reasoning protocol. The two-stage cognitive verbalization first produces a Literal Evidence Summary by decomposing expert outputs into short, atomic evidence statements. It then performs Bloom Verbalization to turn these evidence items into a staged reasoning trace, and a lightweight Reasoning Trace Module quantitatively analyzes the trace to make evidence usage and reasoning progression explicit. Through this integration, we observed several improvements in perception and reasoning abilities. Moreover, the trace module provides quantitative evidence that different queries induce different cognitive entry levels and evidence-use trajectories that enable fine-grained analysis.

[92] Compositional Context Fine-Tuning Vision-Language Model for Complex Assembly Action Understanding from Videos cs.CVPDF

Hao Zheng, Jinyi Huang, Tiantian Zheng, Xun Xu, Tuka Alhanai

TL;DR: 本文提出了一种用于复杂装配动作理解的视觉语言模型微调方法。该方法将装配动作分解为语义元素（动词、对象、工具），并通过模板化问答对微调模型以识别每个元素，确保输出近乎确定性。同时，作者提出了层分区交替训练方法进行高效的多任务学习，并构建了两个新的装配视频问答数据集用于评估。

Details

Motivation: 解决人机协同装配中装配动作理解的挑战，该挑战源于细微的动作和细粒度的手-物体交互。现有方法难以处理此类复杂、结构化的动作理解任务。

Result: 在作者新构建的HA-ViD-VQA和IKEA-ASM-VQA数据集上进行了广泛实验。结果表明，该方法持续优于强大的动作识别基线方法，同时提供了可解释的元素级预测。

Insight: 核心创新点在于将结构化动作理解任务分解为语义元素识别，并通过组合式上下文微调将其转化为视觉问答问题。层分区交替训练方法通过为不同任务分配特定模型层和使用特定于元素的低秩适配器，有效减少了多任务学习中的任务间干扰，并允许针对每个适配器进行超参数优化，这在数据有限的情况下尤为有效。

Abstract: Assembly action understanding is a key enabler for effective human-robot collaborative assembly, yet it remains challenging due to subtle motions and fine-grained hand-object interactions. We adapt vision-language models (VLMs) to this challenging domain with Compositional Context Fine-Tuning (CCFT), a method that decomposes assembly actions into semantic elements (Verb, Object, Tool) and fine-tunes VLMs to recognize each action element using templated question-answering pairs. This approach ensures near-deterministic outputs. To enable efficient and effective multi-task learning under limited data, a Layer-Partitioned Alternating Training (LP-AT) method is presented, which assigns distinct model layers to recognize specific action elements through element-specific low-rank adapters. LP-AT alternates weight updates across element-specific adapters, reducing cross-task interference while enabling per-adapter hyperparameter optimization. Furthermore, we create HA-ViD-VQA and IKEA-ASM-VQA datasets from existing assembly video datasets. Extensive experiments on these datasets demonstrate that our method consistently outperforms strong action recognition baselines while providing interpretable element-level predictions that can support diverse downstream applications.

[93] 3D-DefectBench: A Controlled Factorial Study of Vision-Language Model Evaluation Pipelines for Fine-Grained 3D Generation Defects cs.CV | cs.AI | cs.GRPDF

Zhenyu Zhao, Nanshan Jia, Jihyeon Je, Yifu Tang, Alvin Chan

TL;DR: 本文提出了3D-DefectBench，这是一个用于系统分析基于视觉语言模型（VLM）的3D缺陷检测评估流程的基准和框架。该研究通过一个平衡的析因设计，考察了VLM、相机协议、视觉输入和提示模式四个流程因素对评估结果的影响，发现模型选择是影响与人类标签一致性的最大因素，但其他因素也会显著影响性能并存在交互作用。研究还表明，在标准化流程下，最佳的VLM评估器仍落后于训练有素的人类标注员。

Details

Motivation: 自动化评估对于扩展生成式3D系统至关重要，但评估流程的可靠性不仅取决于底层的视觉语言模型，还涉及资产渲染、视觉证据提供、任务规范以及人类参考标签构建等多个环节。现有方法缺乏对这些环节的系统性分析。

Result: 在评估的设计空间中，一个紧凑的六视图RGB协议与更密集的多视图设置以及增加了深度或表面法线的输入表现相当，使其成为一个高性价比的默认选择。在标准化流程下，12个VLM评估器中表现最佳的仍落后于训练有素的人类标注员，并且当使用噪声更大的“银标签”替代专家共识标签时，纹理一致性显著下降。

Insight: 创新点在于提出了一个系统分析VLM评估流程的基准框架，并采用析因设计量化了不同流程因素的影响。核心见解是自动化评估器应作为完整的流程进行评估，并在不同的人类参考标签体系下进行校准，而不仅仅是作为独立的模型进行基准测试。

Abstract: Automated evaluation is essential for scaling generative 3D systems, where exhaustive human review is costly and slow. However, the reliability of an automated judge depends on the entire evaluation pipeline, not only the underlying vision-language model (VLM), but also how assets are rendered, what visual evidence is provided, how the task is specified, and how human reference labels are constructed. We introduce 3D-DefectBench, a benchmark and framework for systematic analysis of VLM-based 3D defect detection pipelines. It complements holistic ratings and pairwise preferences with nine fine-grained binary defects spanning geometry, texture, and prompt adherence, providing actionable diagnostics for generator development and judge evaluation. Using a balanced factorial design, we vary four pipeline factors, VLM, camera protocol, visual input, and prompt schema, across 84 inference designs and approximately 3.2 million scored defect decisions, followed by staged validation on a broader set of frontier models. Model choice is the largest determinant of agreement with human labels, but the remaining factors also affect performance, interact with model selection, and can change the best configuration. Within the evaluated design space, a compact six-view RGB protocol performs comparably to denser multi-view settings and inputs augmented with depth or surface normals, making it a strong cost-effective default. Under this standardized pipeline, the best of 12 VLM judges still lag behind trained human labelers, while texture agreement drops sharply when expert-consensus labels are replaced by noisier silver labels. These findings show that automated judges should be evaluated as complete pipelines and calibrated across human reference regimes, rather than benchmarked only as standalone models. We release labels, prompts, predictions, and Croissant metadata on Hugging Face.

[94] Learning To Focus: Anatomy-Guided Attention Regularization for Medical Image Classification cs.CVPDF

Tonmoy Hossain, Atiqur Rahman, Farhana Hossain Swarnali, Miaomiao Zhang

TL;DR: 本文提出了一种名为Locus的解剖学注意力正则化框架，利用预训练的分割基础模型引导分类器关注医学图像中具有诊断意义的解剖结构，而无需训练专门的分割模型或依赖手动标注。该方法通过自适应平衡前景（解剖区域）与背景的注意力，惩罚背景主导的情况，从而提升分类性能并改善注意力定位。

Details

Motivation: 医学图像分类模型需要识别与诊断相关的区域，但标准分类损失通常缺乏空间监督；虽然解剖形状信息（如分割掩码）能提供有效引导，但获取此类掩码需要大量人工标注和计算开销。

Result: 在涵盖皮肤镜、X射线、组织病理学和心脏MRI的八个多样化医学影像数据集上验证，Locus在分类性能上取得了一致的提升，同时改善了基于解剖结构的注意力定位。

Insight: 创新点在于利用预训练分割基础模型提取解剖形状先验，避免了训练专用分割模型的负担；通过正则化项自适应平衡前景与背景注意力，而非强制像素级对齐，增强了方法的泛化性和实用性。

Abstract: Medical image classification models are ideally expected to identify diagnostically relevant regions while making predictions, yet standard classification losses rarely provide spatial supervision. Explicit supervision via anatomical shape information, such as segmentation masks of task-relevant anatomy, has been shown to guide the network toward regions relevant to the target prediction. However, obtaining such masks incurs substantial manual annotation effort and computational overhead. With the advent of segmentation foundation models that exhibit strong localization of anatomical structures across diverse imaging modalities, we leverage this capability to extract anatomical shape priors without the burden of training a dedicated segmentation model. In this paper, we propose a new framework, Locus, an anatomical attention regularization framework that leverages pretrained segmentation foundation models to guide a classifier’s attention toward diagnostically meaningful anatomical structures across diverse imaging modalities. Instead of enforcing pixel-wise alignment with the foundation-model-derived mask, we introduce a regularization term that adaptively balances attention between anatomical (foreground) and background regions, penalizing the classifier when background attention dominates. We validate Locus on eight diverse medical imaging datasets spanning dermoscopy, X-ray, histopathology, and cardiac MRI, showing consistent gains in classification performance alongside improved anatomically grounded attention.

[95] OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fields cs.CVPDF

Yanqin Jiang, Tengfei Wang, Zhengwei Wang, Chenjie Cao, Junta Wu

TL;DR: OmniX是一种前馈式4D重建框架，能够从具有大幅相机运动的视频中预测每个像素的密集3D点轨迹。它通过解耦动态运动建模与静态几何预测，并使用一组紧凑的动态令牌来表示运动，从而高效地生成跨所有图像的轨迹场。该研究还构建了一个基于UE5的自动4D数据引擎和一个包含8万场景、128万段多视角视频的大规模数据集用于训练。

Details

Motivation: 现有的前馈4D重建方法要么预测每帧的静态点云而忽略前景运动，要么在估计点云轨迹时受限于小范围相机运动，这限制了它们在大视角变化下聚合观测并重建完整动态场景的能力。

Result: OmniX在密集3D点轨迹预测和3D点跟踪任务上达到了最先进的性能，同时在视频深度估计和相机姿态估计任务上也展现了有竞争力的结果。

Insight: 论文的创新点在于将动态运动建模与静态几何预测解耦，并利用3D运动的稀疏和低秩结构，通过紧凑的动态令牌高效生成全局交互的轨迹场。此外，构建的大规模合成数据集为训练此类模型提供了重要资源。

Abstract: Previous feed-forward 4D reconstruction methods either predict per-frame static point clouds, ignoring foreground motion, or estimate point cloud trajectories while being limited to small camera motions. This restricts their ability to aggregate observations over time and reconstruct complete dynamic scenes under large viewpoint changes. To address this limitation, we propose OmniX, a feed-forward 4D reconstruction framework that predicts dense 3D point trajectories for every pixel from videos with large camera motion. OmniX decouples dynamic motion modeling from static geometry prediction and represents motion using a compact set of dynamic tokens. By leveraging the sparse and low-rank structure of 3D motion, these tokens generate trajectory fields for all pixels across all images while efficiently preserving global interactions. To facilitate training, we further build an automatic UE5-based 4D data engine and introduce a large-scale dataset containing 80K scenes and 1.28M multi-view videos with full geometric annotations. OmniX achieves state-of-the-art performance on dense 3D point trajectory prediction and 3D point tracking, while also demonstrating competitive results on video depth estimation and camera pose estimation.

[96] AU-Guided Synthetic Video Generation for Micro-Expression Recognition cs.CVPDF

Pei-Sze Tan, Sailaja Rajanala, Yee-Fan Tan, Raphael C. -W. Phan, Huey-Fang Ong

TL;DR: 本文提出EquiME，一个通过动作单元（AU）引导的图像到视频生成技术构建的合成微表情数据集，以解决现有微表情识别数据集规模小、人口覆盖窄和情感标签受限的问题。该数据集包含从1.5万张源人脸图像生成的7.5万个视频，涵盖五种目标情绪，并附带自动推断的人口统计元数据和视频质量评估。

Details

Motivation: 现有微表情识别数据集存在规模小、人口覆盖范围窄和情感标签受限的问题，限制了微表情识别技术的发展，因此需要构建一个大规模、多样化的合成数据集来缓解数据稀缺性。

Result: 在SAMM和CASME II数据集上的跨数据集微表情识别实验中，基于EquiME训练的模型取得了有竞争力的性能，并且在四种评估架构中表现出相对较低的方差。

Insight: 创新点在于提出了一个结构化的AU条件引导管道来生成合成微表情视频，并系统评估了生成视频的帧对相似性、空间变化和无参考感知质量，为合成数据在微表情识别领域的应用提供了实证依据。

Abstract: Micro-expression recognition is limited by the small scale, narrow demographic coverage, and restricted emotion labels of existing datasets. We introduce EquiME, a synthetic micro-expression dataset built from AU-guided image-to-video generation. EquiME contains 75K videos generated from 15K source face images across five target emotions, together with automatically inferred demographic metadata and video-quality measurements. We evaluate EquiME using frame-pair similarity, spatial variation, and no-reference perceptual-quality metrics, together with cross-dataset MER experiments on SAMM and CASME II. Models trained on EquiME achieve competitive cross-dataset performance on SAMM and CASME II and show comparatively low variation across the four evaluated architectures. This paper focuses on the dataset design, the structured AU-conditioning pipeline used for video generation, and the empirical evidence needed to assess EquiME as a synthetic MER resource. Project page: https://kirito-blade.github.io/me-vlm/

[97] Learning Anatomy-Grounded CT Vision-Language Representations with Organ-Hierarchical Report Knowledge cs.CVPDF

Guoliang You, Hongming Li, Yuanwang Zhang, Yong Fan

TL;DR: 本文提出OKA-CT，一种用于CT图像-报告视觉语言预训练的器官层次知识增强框架。该方法通过解析放射学报告并利用LLM辅助语义结构化，将自由文本报告转换为器官条件知识，并分两阶段注入解剖学基础证据以增强CT视觉表示。

Details

Motivation: 现有医学视觉语言预训练方法通常对齐整个扫描与完整报告或局部图像区域与文本片段，未能充分利用放射学报告围绕解剖结构组织的关键特性，即异常描述基于器官、疾病概念、位置和严重性属性。

Result: 在CT-RATE和RAD-ChestCT数据集上，OKA-CT实现了零样本异常诊断AUROC分别为84.9和72.2，优于先前的CT VLP基线方法。检索和补丁遮挡分析进一步显示了改进的报告-图像对齐以及对疾病相关解剖区域的更强敏感性。

Insight: 创新点在于利用器官层次知识结构指导预训练，通过器官条件监督和结构化报告-CT对比学习，将共享器官层面发现的非配对病例视为弱语义正例而非统一负例，从而更有效地利用放射学报告的结构化语义信息。

Abstract: Medical vision-language pretraining (VLP) from paired CT images and radiology reports enables scalable representation learning, but most existing methods align either whole scans with entire reports or local image regions with text fragments. These formulations underuse a key property of radiology reports: findings are organized around anatomical structures, with abnormalities described by organs, disease concepts, locations, and severity-related attributes. We propose OKA-CT, an organ-hierarchical knowledge-augmented framework for CT-report VLP. OKA-CT first converts free-text reports into organ-conditioned knowledge using radiology report parsing and LLM-assisted semantic structuring. The extracted hierarchy is used across two learning stages. Stage~~1 injects anatomy-grounded evidence into the CT visual representation through fine-grained organ-conditioned supervision, while Stage~~2 uses organ-specific report evidence to guide structured report-CT contrastive learning, where hierarchy-derived semantic soft targets treat non-paired cases with shared organ-level findings as weak semantic positives rather than uniform negatives. A lightweight query-based global branch further aggregates disease-relevant volumetric evidence for whole-scan representation. On CT-RATE and RAD-ChestCT datasets, OKA-CT achieves zero-shot abnormality diagnosis AUROCs of 84.9 and 72.2, outperforming prior CT VLP baselines. Retrieval and patch-occlusion analyses further show improved report-image alignment and stronger sensitivity to disease-associated anatomical regions.

[98] MED-DSLC: Multi-Expert-Domain Classification via Domain Supervision and Logit Calibration cs.CVPDF

Zheng Zeng, Deepak Sridhar, Nuno Vasconcelos

TL;DR: 本文提出MED-DSLC方法，旨在解决多专家领域分类中因独立训练导致logit尺度不一致、跨域干扰严重的问题。该方法通过领域监督训练和领域级logit缩放，恢复全局logit可比性，从而提升多领域零样本识别的准确性和鲁棒性。

Details

Motivation: 动机在于视觉语言模型（如CLIP）通过LoRA等技术适应细粒度领域后，虽然提升了域内精度，但导致域外精度下降和模型生态碎片化。多专家领域分类试图合并独立训练的LoRA，但由于logit尺度未校准，跨域干扰严重，影响了多领域零样本识别的可扩展性。

Result: 在多个细粒度基准测试上的广泛实验表明，MED-DSLC显著提高了平均准确率（+15%），增强了跨域鲁棒性，并提升了多领域分类问题的可扩展性。该方法在数据高度不平衡的设置下，通过恢复输出级校准，实现了真正的多领域零样本VLM。

Insight: 创新点在于识别出领域监督和跨域logit未校准是影响多领域零样本识别可扩展性的关键问题，并提出轻量级解决方案MED-DSLC，通过显式恢复全局logit可比性，在最小数据需求下保持域内判别力并减少跨域干扰。这为构建统一、可扩展的多领域视觉语言模型提供了重要思路。

Abstract: Vision-language models (VLMs) such as CLIP enable zero-shot classification by comparing image features with text prompts in a shared embedding space. A fundamental property underlying this capability is the global comparability of logits across arbitrary candidate classes. However, VLMs are often adapted to fine-grained domains using techniques such as LoRA. While this improves in-domain accuracy, out-of-domain accuracy degrades. This leads to a highly fragmented model ecosystem, with thousands of specialized models. Multi-Expert-Domain classification seeks to address this problem, by merging LoRAs trained independently on specialized domains. However, due to the independent training, the various domain experts no longer produce globally calibrated logits. As a result, when evaluating over the union of multiple domain-specific class sets, heterogeneous logit scales induce cross-domain interference and artificially high confidence for out-of-domain classes, inducing prediction errors. In this work, we identify domain supervision and cross-domain logit miscalibration as the key issue to scalable multi-domain zero-shot recognition. We propose MED-DSLC, combining domain supervised training and domain-wise logit scaling, to explicitly restore global logit comparability. MED-DSLC is a lightweight solution for MED classification, which is shown to preserve within-domain discrimination while reducing cross-domain logit interference with minimal data. Extensive experiments across diverse fine-grained benchmarks demonstrate that it substantially improves mean accuracy (+15%), cross-domain robustness, and scalability in the size of MED classification problem. Our results show that restoring output-level calibration is essential under highly data imbalanced settings for achieving a truly zero-shot VLM under multi-domain specialization.

[99] TreeSoc: Tree-Structured Dynamic Reasoning and Tool Synergy for Soccer Video Understanding cs.CVPDF

Thanh-Nhan Vo, Thanh-Khoi Nguyen, Trong-Thuan Nguyen, Trung-Hoang Le, Minh-Triet Tran

TL;DR: 本文提出了TreeSoc框架，用于解决足球视频理解中的复杂场景分析问题。该框架将视频问答重新定义为层次化搜索问题，采用动态深度优先搜索机制分解查询，并自适应地集成领域专用工具进行推理。

Details

Motivation: 现有视觉语言模型在理解复杂足球视频场景时存在浅层跨模态对齐、多步推理能力不足以及工具协调集成困难等根本性限制，需要新的推理范式来解决这些问题。

Result: 在SoccerBench基准测试中，TreeSoc在TextQA、ImageQA和VideoQA任务上分别达到85.2%、87.4%和82.2%的准确率，实现了SOTA性能；在NExT-QA上达到74.16%的准确率，展示了强大的跨领域泛化能力。

Insight: 核心创新在于将视频问答重构为树状结构的动态搜索问题，通过显式的中间状态实现迭代推理精化；其树状分解机制自然地支持自适应工具路由，能够在不同推理节点选择性激活领域模块，实现上下文感知的预测。

Abstract: Automated understanding of complex soccer scenarios from video remains a significant challenge for contemporary vision-language models (VLMs), which suffer from shallow cross-modal alignment and exhibit fundamental limitations in multi-step reasoning and coordinated tool integration. We present TreeSoc, a structured reasoning framework that reformulates soccer video question answering as a hierarchical search problem rather than a single-pass prediction. Specifically, TreeSoc employs a dynamic depth-first search (DFS) mechanism that decomposes complex queries into sequentially ordered sub-tasks, enabling iterative reasoning refinement through explicit intermediate states. This tree-structured decomposition naturally supports adaptive tool routing, wherein domain-specific modules are selectively activated and their outputs incorporated at each reasoning node to produce contextually grounded predictions. On SoccerBench, TreeSoc achieves state-of-the-art performance, with accuracies of 85.2%, 87.4%, and 82.2% on TextQA, ImageQA, and VideoQA, respectively. Additionally, TreeSoc further demonstrates strong cross-domain generalization, attaining 74.16% accuracy on NExT-QA. These results establish structured, tool-augmented tree reasoning as an effective paradigm for robust video understanding. Code is available at: https://github.com/thanhnhan29/TreeSoc.

[100] Confidence Scores in Open-Vocabulary Detection Are a Biased Mixture of Scale and Semantics cs.CVPDF

Yi Tang Soon, Jun-Wei Hsieh

TL;DR: 本文通过实验分析发现，基于CLIP等基础模型的开集目标检测器（如GroundingDINO、OWL-ViT、YOLO-World）的置信度分数存在系统性偏差，这些偏差源于CLIP的图像级预训练，导致分数混合了物体尺度与语义查询特异性，而非纯粹的目标检测信号。

Details

Motivation: 解决开集目标检测器中置信度分数不可靠的问题，即这些分数并非准确的定位概率估计，而是受到物体尺度和语义查询泛化性的偏差影响。

Result: 在COCO和LVIS数据集上的实验表明，尺度偏差（alpha = +0.064）会系统性提高大物体的分数，语义偏差（beta = -0.705）会抑制通用查询的分数；通过无参数的temperature scaling校正，小物体的Recall@10提升了19.6%，但以池化排序精度为代价。

Insight: 揭示了将图像级基础模型适应区域级检测任务时的根本限制，即置信度偏差在结构上不可避免，且无法通过阈值调整完全消除；提出的校正方法可在不重新训练的情况下部分缓解偏差，为改进开集检测器的可靠性提供了方向。

Abstract: Foundation models such as CLIP have enabled open-vocabulary object detectors that generalise to novel categories via vision-language similarity. However, the confidence scores these detectors produce are not reliable localization probability estimates: they conflate visual scale and semantic query specificity with the true detection signal. Through controlled experiments on COCO across three foundation-model-based detectors (GroundingDINO, OWL-ViT, YOLO-World), with the scale-bias finding further replicated on LVIS (1,203 categories) using GroundingDINO, we show that s=cos(v,t) is a biased mixture of two effects. Scale bias (alpha = +0.064, r = 0.579, p = 1.29 x 10^-58) systematically inflates scores for large objects. Semantic bias (beta = -0.705, p = 5.23 x 10^-41) suppresses scores for generic queries. Both biases are structurally inevitable from CLIP’s image-level pretraining. Threshold adjustment cannot remove them: oracle per-scale thresholding yields Delta F1 = +0.001 for small objects versus +0.102 for large. A parameter-free temperature scaling correction improves small-object Recall@10 by 19.6% (p < 0.01) without retraining. This comes at a modest, measurable cost to pooled-ranking precision, so the bias is partially, not freely, reversible at inference time. These findings reveal a fundamental limitation of adapting image-level foundation models to region-level detection tasks.

[101] Temporal Feature Distillation for Label-Efficient Precise Event Spotting in Sports Videos cs.CVPDF

Hao Xu, Xinyu Wei, Sam Wells, Sunil Aryal

TL;DR: 本文提出了一种名为Temporal Feature Distillation的半监督学习方法，用于解决体育视频中精确事件定位（PES）任务。该方法通过对齐骨干网络的时间信息特征来保留运动敏感和边界感知的线索，并引入了Transformer Gate Shift模块来为视觉Transformer注入运动感知的时间信息。在四个细粒度体育视频基准测试上的实验表明，该方法在少量标注数据下显著优于全监督和半监督基线模型。

Details

Motivation: 精确事件定位（PES）需要区分视觉相似但语义不同的相邻帧，这与图像分类和粗粒度动作识别有本质不同。现有的自蒸馏方法（如DINO）直接应用于PES时效果不佳，因为缺乏监督指导会导致关键的运动线索被抑制，使得模型对精确事件边界不敏感。

Result: 在四个细粒度体育视频基准测试上，该方法相比全监督和半监督基线模型取得了一致的提升。具体而言，在FSPerf数据集上仅使用10%的监督数据，其mAP比最强的竞争方法提高了4.54个百分点；在仅使用80%标注数据的情况下，该方法在四个数据集中的两个上达到或超越了使用100%标注数据的全监督基线模型的性能。

Insight: 论文的核心创新点在于提出了一个半监督的时序特征蒸馏目标，它直接对齐骨干网络特征而非投影头输出，以更好地保留对运动敏感和事件边界感知的线索。此外，提出的Transformer Gate Shift模块是一种新颖的多尺度门控移位模块，能够有效地将运动感知的时间信息注入到视觉Transformer架构中。从客观角度看，这种将特征对齐与特定时序模块设计相结合的策略，为解决细粒度时序理解任务提供了新的思路。

Abstract: Precise Event Spotting (PES) requires distinguishing visually similar yet semantically distinct adjacent frames, making it fundamentally different from image classification and coarse action recognition. Although self-distillation methods such as DINO have shown strong representation learning ability in images, we find that directly applying them to PES is ineffective: without supervised guidance, subtle but crucial motion cues are often suppressed as noise, leading to representations that are insensitive to precise event boundaries. To address this, we propose Temporal Feature Distillation, a semi-supervised objective that aligns temporally informative backbone features, rather than projection-head outputs, to preserve motion-sensitive and boundary-aware cues for frame-level localization. A supervised warm-up with a ramp-up schedule further stabilizes training by ensuring that meaningful event cues are learned before unlabeled distillation begins. We also introduce Transformer Gate Shift, a multi-scale gated shifting module that injects motion-aware temporal information into Vision Transformers. Experiments on four fine-grained sports benchmarks show consistent improvements over fully supervised and semi-supervised baselines. Under 10% supervision on FSPerf, our method improves mAP by 4.54 points over the strongest competing approach, and with only 80% labeled data, it matches or surpasses the fully supervised 100% baseline on two of the four datasets.

[102] Reference-Based Face Super-Resolution Using the Spatial Transformer cs.CV | cs.LGPDF

Varun Ramesh Jois, Antonella DiLillo, James Storer

TL;DR: 本文提出了一种基于参考图像的人脸超分辨率方法，通过引入空间变换器进行稳定对齐，并设计了一种聚合函数来有效利用参考图像的高质量信息。该方法在多个数据集上实现了最先进的性能，且模型规模相对较小。

Details

Motivation: 解决人脸超分辨率这一不适定问题，传统方法难以保证高保真度，因此提出利用高分辨率参考图像来辅助提升细节。

Result: 在多个数据集上取得了最先进（SOTA）的结果，模型规模较小但性能优越。

Insight: 创新点包括使用空间变换器构建更稳定的对齐模块，以及设计能自适应利用或抑制参考图像信息的聚合函数，为参考型超分辨率提供了稳健的解决方案。

Abstract: Face super-resolution is the task of increasing the resolution of an image containing a face thereby adding finer detail. It is a ubiquitous task in many computer vision applications and quite often the user isn’t even aware that it is being performed. However, doing it with high fidelity is challenging as it is an ill-posed problem. In this paper we present a reference-based solution for face super-resolution that uses higher resolution reference images to aid in the task. We show an alignment module based on the spatial transformer that is considerably more stable than the popular deformable convolutions. We also show an aggregation function that can take good quality information from the reference images when available or suppress the function when such information is unavailable. Finally, we show that our relatively smaller model can achieve state of the art results on multiple datasets. The source code is available at https://github.com/varun-jois/FSRST.

[103] RTFVE: Realtime Face Video Enhancement cs.CVPDF

Varun Ramesh Jois, Antonella DiLillo, James Storer

TL;DR: RTFVE是一种实时人脸视频增强模型，旨在解决视频会议应用中因带宽限制导致的低比特率视频质量问题。该模型易于与任何视频解码器集成，并能在普通CPU上实时运行，无需依赖专用GPU硬件。

Details

Motivation: 解决全球用户因带宽限制而无法充分利用视频会议应用的问题，同时克服现有深度学习增强模型难以与现代压缩标准兼容或需要昂贵GPU硬件才能实时运行的缺陷。

Result: 实验表明，在多种低比特率设置下，该模型相比压缩视频基线在感知质量上均有提升，具体基准未明确提及，但展示了其有效性。

Insight: 主要创新点在于设计了一个与标准解码器无缝集成、计算效率高且能在CPU上实时运行的人脸视频增强框架，这降低了部署门槛，提升了实用性。

Abstract: There’s been a surge in adoption of video conferencing applications for both personal and business use cases. However, the bandwidth limitations faced by many users worldwide may restrict the optimal use of such applications. Although deep learning offers a solution for enhancing low bit rate videos, most models today are either hard to incorporate with modern compression standards or require specialized hardware to run such as significant GPUs making these models impractical. To address these issues, we introduce the Realtime Face Video Enhancement (RTFVE) model which can be easily incorporated with any video decoder and can run in realtime on ordinary CPUs. Experiments show that our model improves perceptual quality over the compressed video baseline at multiple low bitrate settings. The source code will be made available at https://github.com/varun-jois/RTFVE.

[104] FSFVE: Few Shot Compressed Face Video Enhancement cs.CVPDF

Varun Ramesh Jois, Antonella DiLillo, James Storer

TL;DR: 本文提出了一种名为FSFVE的少样本压缩人脸视频增强框架，旨在提升低带宽下视频通话的质量。该框架仅需10帧人脸图像，即可在100秒内快速训练一个模型，对特定通话实例进行实时增强，且无需修改现有视频会议应用。

Details

Motivation: 解决全球数百万用户因带宽限制而导致的视频通话质量低下问题，尽管他们拥有足够的硬件设备。

Result: 实验表明，该模型在定量和感知质量上均显著提升了压缩人脸视频的质量，能够在典型笔记本电脑CPU等低计算设备上实时运行。

Insight: 创新点在于提出了一种快速、少样本的个性化训练框架，可作为现有视频会议应用（如Zoom）的附加层，实现实时、低成本的视频增强，而无需修改底层应用。

Abstract: Videocalling has become a popular form of communication in the world today, with many companies providing free services for it. However, there are still millions of people around the world that experience poor quality videocalls due to limitations in bandwidth. This despite, most people having the required hardware. In this paper we present a novel framework for enhancing highly compressed videocalls. We show, that with as little as 10 frames of the face, we can rapidly (in under 100 seconds) train a model to enhance that instance of the videocall. The model can be trained either prior to or during the call, enhancing the rest of the call by producing better quality video. The video conferencing application need not be modified - it can be off the shelf with our system as a layer on top that trains quickly then simply lets the video conferencing application (e.g. Zoom) run as usual, where our system intercepts and improves images before they are displayed. The model is designed to run in realtime on low-compute devices such as a typical laptop CPU. Experimentally, we show that the model significantly improves quality of compressed face video both quantitatively as well as perceptually. Code can be found at https://github.com/varun-jois/FSFVE.

[105] Do Video-LLMs Actually Watch? Diagnosing Character-Tracking Failures in Long-Form Video cs.CV | cs.AIPDF

Mohammad Al-Ratrout, Shayla Sharmin, Aditya Raikwar, Roghayeh Leila Barmaki

TL;DR: 这篇论文研究了视频大语言模型在长视频中跟踪特定人物的能力，发现现有模型在InfiniBench等基准测试上的表现并非源于真正的角色追踪，而是依赖浅层线索（如性别）进行回答。

Details

Motivation: 动机是探究视频大语言模型是否真正具备长视频中角色追踪的能力，以诊断基准测试分数是否准确反映了模型对指定人物的理解，而非依赖其他简单线索。

Result: 在InfiniBench的全局外观任务中，最强开源模型达到37-38%准确率，但诊断测试显示，当问题中角色名称更换时，模型仅4-31%改变答案，且开放回答准确率下降18-25点，表明模型未真正跟踪角色。

Insight: 创新点在于提出九条件诊断协议，揭示模型依赖粗粒度性别线索而非个体识别，并发布诊断工具包以审计基准测试的实际测量内容，强调模型需加强视频内容与问题指定人物的关联能力。

Abstract: Can a Video Large Language Model (Video-LLM) follow one person through a long video, keeping track of who they are well enough to report, in order, how their outfit changes across a full TV episode? Benchmarks increasingly score this kind of task, and the strongest open-source 7–8B models now reach 37–38% on InfiniBench’s global appearance task, which asks exactly that. But does that score come from tracking the named character, or from something easier? We test this with a nine-condition diagnostic protocol applied to three architecturally distinct open-source Video-LLMs, with Gemini~~2.5~~Flash as a frontier reference, and find the accuracy does not come from character tracking. When we change the character named in the question to a different cast member, leaving the video and answer options untouched, the models change their answer only 4–31% of the time, so they are largely ignoring who the question asks about. Breaking that test down by the gender of the swapped name shows why: the models react more when the name is changed to a different-gender character than to a same-gender one (a 13–28 point gap), picking up coarse gender cues but unable to tell same-gender individuals apart. This shallow processing surfaces again when we drop the multiple-choice options and ask the same questions open-endedly: open-source accuracy drops 18–25 points, with none of 151 answers fully correct, versus a 12-point drop for Gemini. Further checks rule out the obvious innocent explanations, adding subtitles, using the most informative frames, or doubling the number of frames all leave character tracking unimproved, so the bottleneck is not how much video the model sees but how it ties that video to the person the question names. We release a diagnostic toolkit for auditing what such benchmark scores actually measure.

[106] WiFi-JEPA: Self-supervised Learning for WiFi-CSI 3D Human Pose Estimation cs.CVPDF

Doeon Kim, Jungyoon Lee, Seongsin Kim, Seong-heum Kim

TL;DR: 本文提出WiFi-JEPA，一种用于WiFi-CSI 3D人体姿态估计的自监督学习框架。该方法通过预测掩码的潜在嵌入而非重建原始CSI信号来学习CSI原生表征，并引入了CSI特定的标记化与链路掩码策略、基于光线追踪的CSI仿真流水线以生成无标注数据，在Person-in-WiFi-3D基准上取得了SOTA性能。

Details

Motivation: 现有基于WiFi的姿态估计方法在环境变化下易失效，且依赖昂贵的基于摄像头的标注流程，限制了其可扩展性。本文旨在开发一种自监督框架，以学习对硬件伪影鲁棒的CSI原生表征，从而在保护隐私的摄像头受限环境中实现更稳健的3D人体姿态估计。

Result: 在Person-in-WiFi-3D基准上，WiFi-JEPA在单人与多人3D姿态估计任务上均超越了先前的WiFi-CSI基线方法，达到了最先进的（SOTA）水平。实验还表明，仿真CSI能为真实CSI提供互补的预训练信号，且WiFi-JEPA相比四种视觉原生的自监督学习目标能持续提升下游姿态估计性能。

Insight: 创新点包括：针对CSI张量（通道、时间、链路维度）设计的特定标记化与链路掩码策略，通过掩码整个发射-接收天线链路迫使模型从其他链路视图预测空间结构，从而捕捉对3D空间信息有益的跨链路相关性；以及一个可扩展的、无需姿态标注的射线追踪CSI仿真流水线，用于生成多样化的无标签预训练数据。从客观角度看，该方法将自监督预测目标从原始信号重建转向潜在嵌入预测，有效避免了硬件特定伪影的干扰，是领域内一个有针对性的架构创新。

Abstract: WiFi Channel State Information (CSI) enables privacy-preserving human pose sensing in camera-denied environments, but existing WiFi-based pose estimators often fail under environment shifts and rely on costly camera-based annotation pipelines that limit scale. We propose WiFi-JEPA, a self-supervised framework that learns CSI-native representations by predicting masked latent embeddings instead of reconstructing raw CSI signals that may contain hardware-specific artifacts. WiFi-JEPA makes three contributions: (i) CSI-specific tokenization and link masking tailored to the CSI tensor over channel, time, and link (C,T,L); masking entire Tx-Rx antenna links forces the model to predict one spatial link view from others, capturing cross-link correlations informative of 3D spatial structure. (ii) A ray-tracing CSI simulation pipeline that generates diverse unlabeled CSI from randomized geometric primitives, providing scalable pre-training data without pose annotations. (iii) State-of-the-art results on Person-in-WiFi-3D: WiFi-JEPA outperforms prior WiFi-CSI baselines on both single- and multi-person 3D pose estimation under the same evaluation protocol. We also show that simulated CSI provides complementary pre-training signal to real CSI, and that four vision-native SSL objectives degrade performance below training from scratch, whereas WiFi-JEPA consistently improves downstream pose estimation.

[107] Controlling Motion Transfer in Diffusion Transformers via Attention Heads cs.CV | cs.AIPDF

Sunyoung Jung, Jiwoo Park, Yoonseok Choi, Kyobin Choo, Ming-Hsuan Yang

TL;DR: 本文分析了扩散变换器（DiTs）在视频生成中的注意力头机制，发现存在专门处理运动和空间结构的特定注意力头。基于此，作者提出了一种无需参数更新的、基于注意力头的可控运动迁移框架，通过语义对应性指导精炼运动线索，并通过选择性特征注入保持结构，从而实现了精确的运动迁移。

Details

Motivation: 扩散变换器在视频生成中取得了高质量且时序一致的结果，但将其扩展到运动迁移任务（即遵循参考运动同时对齐目标提示）仍具挑战，主要因为对DiTs内部运动和结构表征的理解有限。

Result: 该方法在运动迁移任务中实现了精确的控制，为基于DiTs的可控视频生成提供了一个可解释的基础。摘要中未提及具体的基准测试或定量比较结果。

Insight: 核心创新点在于对DiTs进行注意力头级别的分析，识别出专门负责运动和结构的头，并据此设计了一个无需训练、通过操控特定注意力头来实现可控运动迁移的框架，这为理解模型内部机制和实现细粒度控制提供了新思路。

Abstract: Diffusion Transformers (DiTs) have advanced video generation with high-quality, temporally coherent results. However, extending them to motion transfer, which requires following reference motion while aligning with a target prompt, remains challenging due to limited understanding of motion and structure representations within DiTs. We analyze video DiTs at the attention-head level and identify distinct heads specialized for motion and spatial structure. Based on this insight, we propose a head-aware controllable motion transfer framework that requires no parameter updates. Our method refines motion cues from motion-specialized heads via semantic correspondence guidance and preserves structure through selective feature injection. This head-level control not only enables accurate motion transfer but also provides an interpretable foundation for controllable video generation with DiTs.

Mohammad Mohammadi, Sina Honari, Stavros Tsogkas, Tristan Aumentado-Armstrong, Michael S. Brown

TL;DR: 本文提出了一种无需相机校准、适用于未知设备的低光照原始图像去噪方法。研究发现黑电平误差是导致去噪性能下降和颜色偏移的主要原因，因此引入了一个偏差估计网络来预测黑电平误差作为全局特征。该方法在ELD、SID和LRID数据集上评估，在盲去噪器中表现出色，尤其在颜色校正方面，甚至可与有更强监督的方法竞争。

Details

Motivation: 解决低光照原始图像去噪中，数据驱动方法依赖昂贵且难以收集的噪声-干净图像对，而参数化噪声模型又需要精确相机校准的问题。

Result: 在ELD、SID和LRID数据集上，该方法在盲去噪器中表现优异，特别是在颜色校正方面，能够与甚至超越有更强监督的方法竞争。

Insight: 创新点在于识别并缓解了黑电平误差导致的颜色偏差，通过偏差估计网络实现相机无关的去噪；同时揭示了SIDD数据集中存在颜色偏差问题，并提出了新的基准提取框架来修正数据集。

Abstract: Raw images inherently suffer from noise due to the stochastic nature of light and sensor hardware imperfections. As real photon counts fall, the ratio of this noise to the signal degrades; consequently, for low-light conditions, robust denoising is especially vital for high-quality results. While recent data-driven methods achieve strong performance, they typically rely on large-scale noisy-clean image pairs that are costly and difficult to collect. Alternatively, parametric noise models can generate synthetic training data, but this necessitates precise camera calibration, which is often impractical for unknown devices. In this work, we propose a camera-agnostic, calibration-free paradigm for low-light raw denoising. We identify that color bias from black-level error is a primary source of performance degradation and causes severe color shifts. To mitigate this, we introduce a bias estimator network that predicts the black-level error as a global feature of the noisy input. We evaluate our approach across the ELD, SID, and LRID datasets, demonstrating superior performance among blind denoisers, particularly in terms of color correction. In many cases, we are competitive with-or can even surpass-methods with stronger supervision. Furthermore, we reveal that the widely used SIDD dataset contains significant color bias in its ground-truth images, which yields unrealistic color reproduction in trained models. We introduce a new ground-truth extraction framework to resolve this issue and provide a benchmark of existing methods on the corrected dataset.

[109] CUST: Clustered Unit-level Similarity Transformer for Lightweight Image Super-Resolution cs.CVPDF

Jeongsoo Kim

TL;DR: 本文提出了一种名为CUST（Clustered Unit-level Similarity Transformer）的新型轻量级图像超分辨率架构，旨在解决Vision Transformer（ViT）在图像超分辨率中因二次计算复杂度导致的高延迟和大内存消耗问题。CUST通过让每个图像块在扩展的区域内聚合和关注相似的块来高效整合全局和局部信息，同时采用重叠注意力窗口捕获局部依赖，并显式提取高频细节。实验表明，该模型在计算效率和恢复性能之间取得了良好平衡。

Details

Motivation: 尽管基于ViT的模型在图像超分辨率中表现出色，但其二次计算复杂度严重限制了效率，导致高延迟和大内存消耗；现有的基于窗口的注意力机制虽然能缓解此问题，但牺牲了ViT的长距离依赖建模优势。

Result: 综合实验表明，CUST模型在计算效率和恢复性能之间取得了实用平衡；在现实约束下，与最近的全局上下文或轻量级模型相比，具有更低的内存占用和更快的推理速度。

Insight: 创新点在于提出了一种通过聚类单元级相似性来高效整合全局和局部信息的Transformer架构，允许每个块在扩展区域内关注相似块以捕获广泛上下文，同时使用重叠窗口和残差差异计算来增强局部依赖和高频细节提取，从而在保持ViT优势的同时显著提升效率。

Abstract: Recently, Vision Transformer (ViT)-based models have exhibited remarkable performance in image super-resolution. However, the quadratic computational complexity of ViTs with respect to spatial resolution severely constrains their efficiency, leading to high latency and massive memory consumption. To alleviate this, various window-based attention mechanisms have been proposed; yet, they inherently compromise the long-range dependency modeling that is the primary advantage of ViTs. To overcome these limitations, we propose the Clustered Unit-level Similarity Transformer (CUST), a novel architecture that efficiently integrates global and local information. Specifically, CUST enables each patch to aggregate and attend to similar patches within a broadened regional scope outside its local window, thereby capturing extensive contextual understanding. Furthermore, it employs overlapping attention windows to capture local dependencies, while explicitly extracting high-frequency details by computing the residual difference between the original features and their downsampled-upsampled counterparts. Comprehensive experiments demonstrate that our proposed model achieves a practical balance between computational efficiency and restoration performance. It achieves a lower memory footprint and faster inference speed compared to recent global context or lightweight models under realistic constraints. Code is available at [https://github.com/jwgdmkj/CUST].

[110] Beyond the Eye: Efficient Multimodal Reasoning via Self-Regulated Implicit Visual Tools cs.CVPDF

Xiuwei Chen, Quanlin Chen, Wentao Hu, Zisheng Chen, Kun Xiang

TL;DR: 本文提出了一种名为Beyond the Eye (BEE)的新型隐式视觉工具范式，旨在解决多模态大语言模型在‘图像思维’范式下因频繁调用外部视觉工具和重复图像编码而导致的高计算开销和推理延迟问题。BEE通过将视觉工具调用行为融入训练目标，鼓励模型发展自我调节的调用机制，从而自适应地平衡内部知识与隐式工具，在保持细粒度视觉感知性能的同时显著提升推理效率。

Details

Motivation: 现有基于‘图像思维’范式的多模态大语言模型严重依赖频繁的外部工具调用和图像重复编码，这带来了巨大的计算开销和推理延迟。本文旨在解决这一效率瓶颈，探索一种更高效的隐式视觉工具调用方式。

Result: BEE在细粒度视觉感知任务上取得了最先进的性能，同时在通用推理任务上保持竞争力，并在推理效率方面实现了显著提升。

Insight: 创新点在于提出了一个以自我调节能力为中心的隐式视觉工具范式，通过两阶段训练（形式化思维链监督微调和自我调节奖励驱动对齐）来激活模型的隐式工具表示和自适应切换能力。其中，引入的‘净工具增益’指标和自调节奖励机制，能有效量化并惩罚无效的工具依赖，鼓励模型进行知识路由，仅在内部知识不足时才调用隐式工具，从而在性能和效率间取得更好平衡。

Abstract: Recent multimodal large language models (MLLMs) have made remarkable progress on fine-grained perception tasks under the “Thinking with Images” (TwI) paradigm by iteratively performing various visual tool operations. However, this paradigm relies heavily on frequent external tool calls and repeated image re-encoding, which leads to substantial computational overhead and inference latency. To address these issues, we propose Beyond the Eye (BEE), a novel implicit visual tool paradigm centered on self-regulated capability. BEE directly incorporates visual tool invocation behaviors into the training objective and encourages the model to develop a self-regulated invocation mechanism. This design enables the model to adaptively balance internal knowledge and implicit tools, avoiding redundant tool usage while substantially reducing inference latency. Specifically, BEE involves a two-stage training process: (1) Formalized Chain-of-Thought (CoT) Supervised Fine-tuning (SFT). We construct CoT trajectories with structured tool slots and mixed invocation states. This stage activates the model’s implicit tool representations and adaptive switching capability. (2) Self-regulated Reward-Driven Alignment. To address redundant tool usage caused by ambiguous cognitive boundaries, we first introduce the Net Tool Gain (NTG) metric to quantify this phenomenon. Based on this observation, we further propose a self-regulated reward mechanism. This mechanism penalizes ineffective tool dependency and encourages the model to perform knowledge routing, ensuring that implicit tools are invoked only when the model’s internal knowledge is insufficient. BEE achieves state-of-the-art performance in fine-grained visual perception while remaining competitive in general reasoning tasks and achieving substantial gains in inference efficiency.

[111] GHOST: Geometry-Guided Hallucination of Opaque Surface Textures cs.CVPDF

Langxu Zhao, Zuan Gu, Tianhan Gao

TL;DR: 论文提出了一种名为GHOST的几何引导预处理框架，旨在解决透明物体因违反朗伯体假设而导致的深度估计和3D重建几何退化问题。该框架利用视觉基础模型，在不需下游模型重新训练的情况下，将透明区域转换为具有结构一致性的不透明表示。

Details

Motivation: 透明物体因违反朗伯体假设，对深度估计和3D重建构成根本性挑战，导致下游任务中几何结构严重退化，因此需要一种无需重新训练下游模型的预处理方法来恢复关键的光度线索。

Result: 大量实验表明，该方法通过恢复关键的光度线索，显著提升了在透明物体上最先进的深度估计和重建模型的准确性。

Insight: 创新点在于提出一个多阶段几何引导的预处理流水线，通过解耦掩码与透明度物理属性、恢复表面法线先验以及集成多模态线索，合成出保留3D结构的纹理丰富不透明RGB图像，从而直接增强现有模型的性能而无需重新训练。

Abstract: Transparent objects pose a fundamental challenge for depth estimation and 3D reconstruction due to their violation of Lambertian assumptions, leading to severe geometry degradation in downstream tasks. To address this, we propose a novel geometry-guided preprocessing framework \textbf{GHOST} that leverages visual foundation models to transform transparent regions into opaque, structurally consistent representations without requiring downstream model retraining. Specifically, our pipeline utilizes (1) \textbf{TransDINO} and (2) \textbf{TransDecomp} to disentangle masks and transparency physical properties, while (3) \textbf{DAF-Net} recovers surface normal priors to encode geometric curvature. Subsequently, (4) \textbf{GeoSemTransNet} integrates these multi-modal cues to synthesize a texture-rich opaque RGB image that preserves the transparent object’s 3D structure. Extensive experiments demonstrate that our method significantly enhances the accuracy of state-of-the-art depth estimation and reconstruction models on transparent objects by restoring essential photometric cues.

[112] Simple Features and Honest Calibration for Ambivalence and Hesitancy Recognition in Video cs.CV | cs.CL | eess.ASPDF

Vikas Kumar, Aditya Mishra, Haroon R. Lone

TL;DR: 本文提出了一种用于视频中矛盾与犹豫（A/H）识别的系统，结合了情感专用的文本、音频和视觉表征，以及一组可读的语言犹豫线索，通过情感标记融合（AMF）进行融合，并使用简单的AP加权集成在固定决策阈值下完成预测。

Details

Motivation: 解决ABAW 2026 BAH挑战中的矛盾与犹豫识别问题，即通过短视频预测人物是否表现出A/H迹象，旨在利用多模态特征提升识别性能。

Result: 在测试集上达到0.731的宏F1分数，其中基于ASR擦除时间构建的特征在非语言通道中表现最强（AP 0.718），而语言通道是最强的模态，情感专用音频作为有用的辅助。

Insight: 创新点包括引入ASR擦除时间特征作为独立非语言通道，以及提出情感标记融合（AMF）和固定阈值的AP加权集成方法，强调校准比架构更重要，并发现跨模态冲突设计在BAH任务中帮助有限。

Abstract: We address ambivalence and hesitancy (A/H) recognition in the ABAW 2026 BAH Challenge: given a short interview video, predict whether the person shows signs of A/H. Our system combines affect-specialised text, audio, and visual representations with a small set of readable linguistic hesitation cues, fused by a reliability gate we call Affective Marker Fusion (AMF), and finished with a simple AP-weighted ensemble at a fixed decision threshold. We also introduce \emph{ASR-erased time}: speech recognisers delete fillers and hesitation pauses from the transcript, but the chunk timestamps keep the time those events took, and sixteen features built from these gaps form the strongest and most independent non-verbal channel we measured (AP $0.718$, correlation $0.11$–$0.36$ with all other members). Across controlled experiments we find three things: cross-modal conflict design does not reliably help on BAH; language is by far the strongest channel while affect-specialised audio is a useful second; and calibration matters more than architecture. Fitting ensemble weights and a threshold on the small validation split overfits: it scores $0.741$ macro-F1 on validation but only $0.690$ on the untouched test set. AP-weighting at a fixed threshold instead reaches $\mathbf{0.731}$ on test.

[113] TC-MAF: Train-Calibrated Bounded Multi-Evidence Fusion for Multimodal Industrial Anomaly Detection cs.CVPDF

Ming Deng, Sijin Sun, Xiaochuan Hu, Xing Wu

TL;DR: 本文提出TC-MAF，一种基于训练校准的多证据融合方法，用于多模态工业异常检测。该方法通过一个固定的像素级融合公式，结合了多模态检测器、互补的Dinomaly证据和一个小的跨模态一致性线索，并引入一个轻量级的训练离散度置信度（TDC）项来校准辅助模态的参与度。

Details

Motivation: 多模态异常检测受益于RGB和3D证据的互补性，但辅助的RGB重建在不同产品类别间的可靠性不均，且通常缺乏类别级别的测试时策略选择。

Result: 在MVTec-3D数据集上，TC-MAF达到了0.979的图像级AUROC和0.990的像素级AUPRO，在所比较的多模态方法中，在检测和定位任务上都取得了最佳的平均结果。

Insight: 核心创新在于提出了一种基础锚定的多证据融合设计，其融合结构本身是性能提升的主导因素；同时，仅使用正常训练统计量计算的TDC项提供了可重复的、较小的校准增益，增强了方法的鲁棒性和泛化能力。

Abstract: Multimodal anomaly detection benefits from complementary RGB and 3D evidence, yet auxiliary RGB reconstruction is not equally reliable across product categories and class-wise test-time policy selection is usually unavailable. We propose TC-MAF, a base-anchored multi-evidence fusion design that combines a multimodal detector, complementary Dinomaly evidence, and a small cross-modal consistency cue under one fixed pixel-level fusion formula. A lightweight training-dispersion confidence (TDC) term scales auxiliary participation using only normal training statistics. On MVTec-3D, TC-MAF reaches 0.979 image-level AUROC and 0.990 pixel-level AUPRO, achieving the best mean results on both detection and localization among the compared multimodal methods. Systematic ablations show that the fusion structure itself is the dominant factor, while TDC provides a smaller but reproducible calibration gain over no calibration or arbitrary calibration. Additional experiments show that the same design remains effective under a pooled-statistics variant, auxiliary-branch and backbone substitutions, few-shot settings, a missing-3D setting, and cross-dataset evaluation on Eyecandies. Code is available at https://anonymous.4open.science/r/TC_MAF-C3BB.

[114] When Depth Is Better Told Than Shown: Depth-Ordinal Prompting for Vision-Language Spatial Reasoning cs.CVPDF

Quynh Vo, Phuc Dao, Cong-Duy Nguyen, Thong Nguyen

TL;DR: 本文提出了一种名为深度序数提示（Depth-Ordinal Prompting, DOP）的训练无关方法，用于提升视觉语言模型（VLMs）的空间推理能力。该方法不依赖深度图像或额外训练，而是将单目深度估计信息转化为针对查询对象的序数文本提示，从而有效利用深度信号。

Details

Motivation: 视觉语言模型在空间推理（如判断物体远近、前后关系）方面存在困难，而直接提供深度图作为输入反而可能损害模型性能。作者旨在探索如何更有效地将深度信息整合到VLMs中，以解决这一矛盾。

Result: 在多个基准测试、模型和深度估计器上，当伪深度图能提供可靠的对象级顺序信息时，DOP能显著提升空间推理性能；而在原始图像本身已足够强的场景下，DOP基本保持中性。该方法与最强的无需训练的深度提示替代方案性能相当，但更简单、更具针对性。

Insight: 核心创新在于揭示了深度信息的形式依赖性：相同的深度信号以图像形式呈现会损害性能，而以文本形式“告知”模型则能提供帮助。这为如何将几何信息有效注入冻结的VLMs提供了新的、轻量化的思路，即通过目标导向的序数文本提示来桥接视觉与语言模态。

Abstract: Vision-language models (VLMs) are expected to reason about physical space – which object is closer, what lies behind what, and how objects are arranged in 3D – yet they still struggle with such spatial judgments. A natural remedy is to show the model a depth map, but we find that this can make performance worse. We show that depth is not absent: it reaches the language model, but becomes difficult to access for downstream reasoning, while rendered pseudo-depth maps act as noisy auxiliary images that frozen VLMs cannot easily regulate. We propose Depth-Ordinal Prompting (DOP), a training-free method that converts monocular depth into a single question-targeted ordinal text cue at the queried objects, without adding a depth image, training a module, injecting features, or using labels. Our key finding is form dependence: the same depth signal can hurt when shown as an image but help when told as text.Across benchmarks, models, and depth estimators, DOP improves spatial reasoning when pseudo-depth provides reliable object-level ordering and remains largely neutral in strong original-image regimes. It is also competitive with the strongest training-free depth-prompting alternative while being simpler and more targeted.

[115] GDP.pdf: Benchmarking Grounded Multimodal Reasoning over Professional PDF Documents cs.CVPDF

Suhaas Garre, Emily Ritchie, Sushant Mehta, Edwin Chen

TL;DR: 论文提出了GDP.pdf基准，旨在评估多模态模型在专业PDF文档上的实际推理能力。该基准包含十个专业领域的真实文档和问题，要求模型具备文本提取、图表理解、交叉引用等多种能力。实验表明，当前前沿模型在该基准上的表现较差，最高通过率仅为15%。

Details

Motivation: 现有文档AI基准通常孤立地测量OCR、布局分析等单一能力，无法反映模型在真实专业场景中回答复杂问题的综合能力。因此，需要构建一个直接衡量模型在专业PDF文档上实际推理能力的基准。

Result: 在GDP.pdf基准的100个测试项上，评估了七个前沿多模态模型。最佳模型仅通过15%的测试项，最差模型通过1%。大多数错误源于表格错位、图表误读、忽略脚注等常见问题模式。

Insight: 创新点在于构建了一个基于真实专业文档和问题的综合基准，强调多模态推理的实用性和错误模式分析。可借鉴之处包括：通过专业人士构建测试项、使用分级评分标准、以及对错误类型进行系统分类，这有助于更全面地评估和提升模型的实际应用能力。

Abstract: A large share of day-to-day work in professional domains happens inside PDF files: benefits packets, leases, datasheets, clinical guidelines, construction plans. Benchmarks for document AI have generally measured the required capabilities in isolation: OCR, layout analysis, chart reasoning, table QA, document VQA. A high score on any one of them does not necessarily reveal whether a model can answer a realistic question that someone in the field would actually ask about a specific PDF. GDP.pdf is a benchmark built to measure this directly. It consists of question-document pairs authored by working professionals in ten fields, and a candidate question was kept only when at least two frontier multimodal models failed it in a way that mattered: a wrong answer, missed decisive evidence, or a fabricated claim, rather than a superficial difference such as style. Each item comes with a rubric of atomic criteria, so we can report a graded rubric score as well as a strict task-level pass rate, and each item is tagged against a taxonomy of eleven capabilities in three tiers, spanning text extraction and grounding, table and chart comprehension, cross-referencing, spatial reasoning, and abstention on unsupported queries. We evaluated seven frontier models on the 100-item benchmark. The best model passed only 15% of the items and the worst passed 1%. Most errors trace back to a small set of recurring loss patterns: misaligned tables, misread charts, skipped footnotes and exclusions, miscounted floor-plan symbols, scan noise, and amendments that supersede earlier text. The full 100-item benchmark is publicly available at https://huggingface.co/datasets/surgeai/GDP.pdf

[116] DynEval: Holistic Evaluations of T2I Generative Models in the Wild cs.CVPDF

Shyam Marjit, Dheeraj Baiju, Anuj Shikarkhane, Akhil Sakthieswaran, Sayak Paul

TL;DR: 本文提出了DynEval动态评估框架，用于全面评估文本到图像生成模型。该框架通过构建大规模数据集GenDB和DynEvalInstruct，并采用课程学习策略微调紧凑型评估器，实现了对T2I模型文本-图像对齐和图像质量的联合评估。

Details

Motivation: 现有自动评估器通常依赖静态提示集，难以捕捉部分提示错位、组合错误或视觉合理但语义错误的生成等细微故障模式，因此需要更可靠、可扩展的评估方法。

Result: 在11个基准测试中，DynEval评估器与人类判断的整体相关性高于现有评估器，并能对36个T2I模型在42个子类别和9个语义维度上进行细粒度分析。

Insight: 创新点包括：1）构建大规模生成数据集GenDB和指令数据集DynEvalInstruct；2）采用课程学习策略从大型教师视觉语言模型中蒸馏评估能力；3）提供细粒度的模型能力与故障模式分析框架。

Abstract: Recent advances in text-to-image (T2I) generation have led to models capable of producing highly realistic images. Yet, reliably evaluating their outputs remains challenging, especially at scale. Existing automatic evaluators, often relying on a static prompt set, struggle to capture subtle failure modes such as partial prompt misalignment, compositional errors, or visually plausible but semantically incorrect generations. In this work, we introduce DynEval, a Dynamic Evaluation framework designed to jointly assess text-to-image alignment and image quality of T2I models. To support scalable training beyond limited human-annotated data, we construct two large datasets. First, we build GenDB, a collection of 500K prompt-image pairs generated from human-written prompts drawn from DiffusionDB using a tiered prompt-model generation strategy. Second, building upon GenDB, we construct DynEvalInstruct, a 250K instruction dataset comprising prompt-image-response triplets distilled from a structured evaluation pipeline that decomposes evaluation into text-image alignment and visual quality reasoning. Using this dataset, we perform full fine-tuning of a compact evaluator through a curriculum learning strategy to effectively distill the superior evaluation capabilities of a larger teacher vision-language model, resulting in DynEval-2B and DynEval-4B. In extensive comparisons against existing evaluators across 11 benchmarks, our evaluator achieves a higher overall correlation with human judgments. Furthermore, it provides fine-grained analysis of the capabilities and failure modes of 36 T2I models across 42 subcategories and 9 semantic dimensions.

[117] HandFlow: Fully Generative 4D Hand Recovery with Flow Matching cs.CV | cs.AIPDF

Mingxi Xu, Bowen Duan, Yi Gu, Zhengyang Shen, Renjing Xu

TL;DR: HandFlow是一个基于流匹配的完全生成式框架，用于从单目视频中实现时间一致的3D手部姿态和形状估计。它通过单个ODE积分对整个时间窗口的MANO参数进行去噪，利用双流Transformer捕获长程依赖，并采用置信度感知的连续掩码机制处理噪声或缺失观测。在DexYCB和HOT3D数据集上，该方法在全局空间精度和时间平滑性方面取得了显著提升，同时实现了高效的实时推理速度。

Details

Motivation: 解决单目4D手部重建中因遮挡和运动模糊导致的模糊观测问题，现有时序模型多为确定性回归器，对此类情况脆弱；生成式建模通过学习合理手部运动序列的先验，能够在视觉证据不完整或不可靠时实现连贯的手部状态恢复。

Result: 在DexYCB和HOT3D基准测试中达到SOTA性能，全局空间姿态误差比最强基线降低超过30%，在所有评估方法中取得了最低的加速度误差（即最佳时间平滑性），同时每帧姿态精度保持竞争力；在单GPU上以47 fps的速度重建150帧序列，比之前最快的基于视频的方法快约12倍。

Insight: 创新点包括：1) 将流匹配生成式建模引入4D手部恢复，以概率方式处理模糊性；2) 采用Flux风格的双流Transformer进行非自回归解码，有效捕获长程时序依赖；3) 设计置信度感知连续掩码机制，动态融合观测特征与可学习掩码令牌，鲁棒处理噪声或缺失数据。从客观角度看，该方法在生成式先验学习与高效时序建模的结合上具有借鉴意义。

Abstract: Accurate monocular 4D hand reconstruction remains challenging. Per-frame discriminative regressors lack temporal context and often produce jittery predictions. Temporal models improve consistency by aggregating information across frames, but they are typically deterministic regressors, making them vulnerable to ambiguous observations caused by occlusion and motion blur. Generative modeling offers a natural alternative by learning a prior over plausible hand motion sequences, enabling coherent hand-state recovery when visual evidence is incomplete or unreliable. Motivated by this observation, we present HandFlow, a fully generative flow-matching framework for temporally coherent 3D hand pose and shape estimation from monocular video. Given visual and skeletal observations, HandFlow denoises an entire temporal window of MANO parameters through a single ODE integration. To support this, we use a Flux-style dual-stream transformer that attends across the full sequence to capture long-range dependencies without autoregressive decoding, and a confidence-aware continuous masking mechanism that blends observed features with learnable mask tokens to handle noisy or missing observations. Experiments on DexYCB and HOT3D show that HandFlow achieves state-of-the-art performance, with particularly large gains in world-space accuracy and temporal smoothness. It reduces world-space pose error by over 30% compared with the strongest baseline and achieves the lowest acceleration error among all evaluated methods, while remaining competitive in per-frame pose accuracy. Moreover, on a single GPU HandFlow reconstructs a 150-frame sequence at 47 fps, about 12x faster than the fastest prior video-based method, with reconstruction itself accounting for only a small fraction of the end-to-end latency.

[118] LaGuadia: Language-Guided Adaptive Distillation from Pathology Foundation Models cs.CV | cs.LGPDF

Gangsu Kim, Won-Ki Jeong

TL;DR: 本文提出了一种名为LaGuadia的语言引导自适应蒸馏框架，旨在从计算成本高昂的病理学基础模型中，通过临床语言指导动态整合多个教师模型的专长，从而构建一个紧凑的病理图像编码器。该方法利用多阶段流程：从病理报告中提取临床关键词，通过视觉语言元教师模型对齐视觉特征与语义，并基于语义对齐进行自适应知识蒸馏。实验表明，仅8700万参数的LaGuadia学生模型在全切片图像描述、视觉问答和切片级分类任务上，性能达到或超越了GigaPath和UNI等基础规模模型。

Details

Motivation: 病理学基础模型能提供强大的全切片图像表示，但计算成本巨大。现有的多教师知识蒸馏方法通常采用次优的均匀加权策略，忽略了组织异质性，因此需要一种更智能的集成方式。

Result: 在WSI描述、视觉问答和切片级分类任务上的实验表明，LaGuadia学生模型（8700万参数）在性能上匹配或超越了GigaPath和UNI等基础规模模型，展现出强大的事实一致性和鲁棒泛化能力。

Insight: 核心创新在于利用临床语言作为语义锚点，通过语言引导动态加权多教师模型的贡献，实现了对组织异质性的自适应处理。这为构建高效可靠的数字病理系统提供了一种新范式，即通过语义对齐而非简单特征模仿来指导知识蒸馏。

Abstract: Pathology Foundation Models (PFMs) offer powerful Whole Slide Image (WSI) representations but suffer from massive computational costs. While Knowledge Distillation (KD) can create efficient student models, existing multi-teacher methods often use suboptimal uniform weighting that ignores tissue heterogeneity. We propose LaGuadia (Language-Guided Adaptive DistillAtion), a framework that develops a compact pathology image encoder by dynamically integrating expertise from multiple PFMs under clinical linguistic guidance. Our approach utilizes a multi-stage pipeline: first, extracting visually observable clinical keywords from pathology reports; second, aligning visual features with these keywords via a Vision-Language meta-teacher (MedSigLIP) to provide dense semantic guidance; and finally, performing adaptive KD where teacher contributions are weighted based on their semantic alignment with the clinical narrative. Experiments on WSI captioning, visual question answering, and slide-level classification tasks demonstrate that an 87M parameter LaGuadia student model matches or exceeds foundation-scale models such as GigaPath and UNI, achieving strong factual consistency and robust generalization. These results highlight clinical language as an effective semantic anchor for building efficient and reliable digital pathology systems. Code is available at https://github.com/hvcl/LaGuadia.

[119] HierCAD: Hierarchical Text-to-CAD Design via Structure Alignment and Parameter Grounding cs.CVPDF

Jimin Xu, Tianbao Wang, Tao Jin, Zhou Zhao

TL;DR: 本文提出HierCAD，一种分层文本到CAD设计框架，通过结构对齐和参数接地提升复杂设计的结构一致性和几何参数准确性。该方法将CAD生成重构为渐进式推理过程，分解为对象级程序推理和部件级拓扑推理轨迹，并引入统一的结构对齐与参数接地学习策略。

Details

Motivation: 现有文本到CAD方法在保持复杂设计结构一致性和准确接地几何参数方面存在困难，HierCAD旨在解决这些问题。

Result: 实验表明，HierCAD在CAD序列生成和重建CAD模型评估上均优于先前的最先进方法。

Insight: 创新点包括将CAD生成分解为分层推理轨迹，以及通过结构对齐和参数接地策略提升生成保真度，其中参数接地通过结构保持的参数扰动和基于排名的监督缓解捷径学习。

Abstract: Recent text-to-CAD approaches have shown promising results by leveraging large language models, but they often struggle with maintaining structural consistency in complex designs and accurately grounding geometric parameters. To address these issues, we propose HierCAD, a hierarchical text-to-CAD framework that improves both structural reasoning and parameter prediction. HierCAD reformulates CAD generation as progressive reasoning by decomposing CAD construction trees into object-level procedural reasoning and part-level topology reasoning trajectories. To further improve generation fidelity, we introduce a unified Structure Alignment and Parameter Grounding (SAPG) learning strategy. Structure alignment aligns topology reasoning trajectories with their corresponding parametric CAD spans, while parameter grounding mitigates shortcut learning through structure-preserving parameter perturbations and ranking-based supervision. Experiments demonstrate that HierCAD outperforms prior state-of-the-art methods on both CAD sequence generation and reconstructed CAD model evaluation. Our code is available at https://github.com/Collab-Gen/HierCAD.

[120] A Unified Framework for Comprehensive Cardiac CT Segmentation and Phenotyping: Human-in-the-Loop Data Annotation, Vision Foundation Model Development, Multicenter Evaluation and Clinical Validation cs.CV | cs.AIPDF

Pooya Mohammadi Kazaj, Leo Fridolin Weber, Wen Xie, Seyed Amir Ahmad Safavi-Naini, Anselm Stark

TL;DR: 本文提出了一个统一框架，用于心脏CT图像的全面分割和表型分析，该框架结合了人机协同标注流程、心脏CT数据增强技术和基于6万张无标签心脏CT扫描的自监督基础模型预训练。该方法构建了迄今最大、最全面的专家标注心脏CT分割数据集（1598例，14个心脏结构），并在五个外部数据集上实现了比现有开源工具更准确、更全面的分割。

Details

Motivation: 解决心脏CT结构量化因测量可扩展性不足而难以常规应用的问题，旨在通过自动化框架实现大规模、全面的心脏解剖分割和表型分析。

Result: 在五个外部数据集上，该框架对所有结构的分割准确性和全面性均优于现有开源工具；自监督预训练在低数据量外部评估中显著提升了标注效率；在卷积、Transformer和状态空间架构上的基准测试显示性能相当，表明数据质量和预训练是驱动准确性的关键因素。

Insight: 创新点包括人机协同标注流程与自监督预训练的结合，以及强调数据质量和预训练而非模型架构对分割性能的主导作用；通过公开数据集、代码、模型权重和软件，为从常规CT扫描中进行机会性心脏表型分析提供了可复现的基础。

Abstract: Comprehensive quantification of cardiac structures from computed tomography (CT) remains limited not by data availability but by the scalability of measurements, which makes routine use impractical. Here we present a unified framework for comprehensive cardiac CT segmentation and phenotyping that combines a human-in-the-loop annotation pipeline, a cardiac CT augmentation technique, and a self-supervised foundation model pre-trained on 60,000 unlabeled cardiac CT scans. Using this approach, we assembled the largest and most comprehensive expert-annotated cardiac CT segmentation dataset to date, comprising 1598 cases and 14 distinct cardiac structures (1000 for training, 598 for the external test set). Across five external datasets, the framework segmented all structures more accurately and comprehensively than existing open-source tools. Self-supervised pre-training improved labeling efficiency, with the most significant gains observed during external evaluation in the low-data regime. Benchmarking across convolutional, transformer, and state-space architectures showed comparable performance, indicating that data quality and pre-training, rather than architecture, drove accuracy. The framework was scaled to population-level phenotyping, with segmented anatomy that carries functionally relevant information about ventricular function and disease severity beyond demographic variables. By openly releasing the largest dataset with human labels, code, model weights, a CT augmentation library, and software, this work provides a reproducible foundation for opportunistic cardiac phenotyping from routinely acquired CT scans.

[121] SLVMBench: Skill Learning from Video Memory cs.CVPDF

Yudong Yang, Guangzhi Sun, Yixuan Li, Chao Zhang

TL;DR: 本文介绍了首个用于评估视频大语言模型从长视频记忆中学习技能并应用于实时任务能力的基准测试SLVMBench。该基准包含嵌入在无关视频流中的2-3小时教程视频，要求模型应用所学技能回答关于正在进行视频的实时问题。评估显示，现有视频大语言模型在此任务上表现不佳，尤其是在长视频记忆背景下，揭示了其关键局限性。

Details

Motivation: 现有长视频理解基准侧重于被动理解，而技能学习基准依赖简短即时演示，缺乏对从长视频记忆中记忆、提取程序性知识并迁移到实时任务这一完整流程的评估。SLVMBench旨在填补这一空白，模拟人类从真实世界视频流中学习技能的实际场景。

Result: 在评估最先进的专有和开源视频大语言模型时，发现它们在从视频中学习和应用技能知识方面存在显著困难。当技能知识被置于长视频记忆中时，性能会明显下降。SLVMBench成为首个用于研究从长上下文视频记忆中实时获取和应用技能的基准。

Insight: 论文的创新点在于构建了首个联合评估长视频记忆技能学习和实时应用的综合基准。其设计特点包括：模拟真实学习场景的长视频流、严格的亚秒级时间校准人工标注、手工设计的问题以避免常识猜测，以及精心编排的教程以确保技能覆盖。这为评估和推动视频大语言模型在复杂、动态环境中的实际应用能力提供了新方向。

Abstract: We introduce Skill Learning from Video Memory (SLVMBench), the first benchmark that jointly evaluates whether video large language models (video-LLMs) can learn skills from long video memory and apply them to real-time tasks. SLVMBench presents models with 2-3 hour video streams that contain a tutorial video embedded in a stream of arbitrary irrelevant videos, resembling real-world human learning practices. Video-LLMs are asked to apply the acquired skill to answer real-time questions about an ongoing video. Unlike long-video understanding benchmarks that emphasize passive comprehension and skill-learning benchmarks that rely on short, immediate demonstrations, SLVMBench tests the full pipeline of memorizing and extracting procedural knowledge, as well as transferring it to real-time tasks. Moreover, rigorous human annotations feature sub-second-level temporal calibration, manually engineered questions eliminating common-sense guessing, and collated tutorials to ensure coverage of the required skills. Evaluations on state-of-the-art proprietary and open-source video LLMs show that video-LLMs struggle substantially with learning and applying skill knowledge from videos. Moreover, performance degrades markedly when the skill knowledge is placed within a long video memory. These results reveal a key limitation of existing video LLMs and position SLVMBench as the first benchmark for studying real-time skill acquisition and application from long-context video memory.

[122] Benchmarking Edge Inference Strategies for Deep Learning Models in Industrial Machine Vision cs.CVPDF

Miguel Gomez Fernandez, David Castro Boga, Roi Mendez-Rial, Eric Lopez-Lopez

TL;DR: 本文对工业机器视觉场景中四种主流边缘推理框架（PyTorch、ONNX Runtime、OpenVINO、TensorRT）在多种CPU和GPU硬件平台上的推理时间性能进行了系统性比较研究。结果表明，在CPU上OpenVINO性能最优，在GPU上TensorRT性能最优，但TensorRT在处理基于Transformer的视觉模型时并未超越原生PyTorch。

Details

Motivation: 工业机器视觉系统对低延迟、数据安全和有限连接性有严格要求，边缘部署是首选方案。然而，现有研究缺乏对主流边缘推理框架在工业部署条件下性能的系统性比较。

Result: 在评估的硬件平台和模型上，OpenVINO在CPU上实现了最低的推理时间，TensorRT在GPU上实现了最低的推理时间。但对于本研究中考虑的基于Transformer的视觉模型，TensorRT的性能并未超越原生PyTorch。

Insight: 论文的创新点在于首次在工业部署条件下，对多种主流边缘推理框架进行了涵盖CPU/GPU硬件和CNN/Transformer模型的系统性基准测试。客观来看，其研究结果为工业机器视觉系统选择推理框架提供了重要的实证依据，并揭示了特定框架（如TensorRT）在处理Transformer架构时可能存在的优化局限。

Abstract: Edge deployment is often the preferred solution for industrial machine vision systems when low latency, data security, or limited connectivity are critical requirements. Several frameworks are available to optimise inference on edge devices; however, relatively few studies have systematically compared their inference-time performance under industrial deployment conditions. In this work, we present a comparative study of four widely used approaches for machine vision inference in industrial settings: plain PyTorch, ONNX Runtime, OpenVINO, and TensorRT. The evaluation focuses on inference time, covers several CPU- and GPU-based hardware platforms, and includes both conventional convolutional neural networks and a transformer-based vision model. For the hardware platforms and models evaluated, the results show that OpenVINO achieves the lowest inference time on CPUs, while TensorRT achieves the lowest inference time on GPUs. However, TensorRT does not outperform plain PyTorch for the transformer-based model considered in this study.

[123] Video Transformer for Remote Identity Document Hologram Detection cs.CVPDF

Joris Voerman, Nicolas Sidere, Jean-Christophe Burie

TL;DR: 本文提出了一种基于视频Transformer的远程身份文档全息图检测系统（RIDVS），用于通过智能手机视频验证身份证件的真实性。该系统在MIDV-Holo基准测试中显著优于现有方法，实现了接近完美的准确率，并展示了在小数据集和有限计算资源下的高效适应性。

Details

Motivation: 远程身份验证中，DeepFakes和AI工具使伪造身份证件变得容易，而现有安全特征（如红外传感器）需要专用设备，难以普及。全息印刷作为难以伪造且可通过智能手机摄像头检测的安全特征，为解决这一问题提供了可能。

Result: 在MIDV-Holo基准测试中，该方法相比最佳基线在召回率上提升了26.86%，准确率提升了17.93%，达到了接近完美的性能水平，且在小到中等规模数据集上训练仍能保持优异表现。

Insight: 创新点在于将视频Transformer应用于智能手机视频中的全息图检测，实现了无需专用设备的远程验证；系统设计兼顾了前端捕获与服务器端验证的实用性，并在数据与计算资源受限场景下展示了强鲁棒性。

Abstract: Remote identity authentification using Identification Documents has been a major challenge for several years. DeepFakes advent and the development of AI-guided tools helps fraudsters creating counterfeit ID Documents. Ensuring the authenticity of ID Documents has become a real clue in the seurization of remote authentification. This need is all the more pressing given the increasing digitization of administrative and transactional processes. To ensure widespread accessibility, the system should rely solely on video captured via mobile devices. In this specific context, confirming the authenticity of ID is a real challenge as many security features needs specific device like infrared sensor for instance. Among underutilized but promising security features, holographic printings hold a special place. Difficult to counterfeit, they produce distinctive visual effects according enlightment, making them both detectable in a video captured by a smartphone camera and difficult to imitate. In this paper, we propose a Remote Identity Document Verification System (RIDVS) and an approach based on a video transformer for detecting holograms in simple videos captured by smartphones. Our system is designed for a smartphone-based capture process, followed by a server-side verification. The hologram detection method builds on a robust model previously validated in a related research domain. We demonstrate that it outperforms existing SotA methods, achieving near-perfect accuracy even when trained on medium- to small-sized datasets. In particular, we report improvements of +26.86% in Recall and +17.93% in accuracy over the best MIDV-Holo baseline. This study includes several experiments that evaluate the model adaptation to frugality, both for training samples and computational resources.

[124] HyperGS: Fast and Generalizable Gaussian Video Representation cs.CVPDF

Fatimah Zohra, Chen Zhao, Shuming Liu, Yahya Al Malallah, Bernard Ghanem

TL;DR: 本文提出了HyperGS，一种前馈、无需优化的方法，用于从视频中直接预测高斯表示。该方法通过设计因子化的时空Transformer提取视频标记，并使用基于可学习查询的Transformer获取每帧的8参数高斯表示，实现了编码和解码速度的指数级提升，并能泛化到分布外的高分辨率视频。

Details

Motivation: 现有基于高斯泼溅的视频表示方法依赖于逐视频优化，导致编码速度慢且难以跨视频泛化。为了解决这一问题，作者旨在开发一种快速、通用的前馈方法，以摊销优化成本并实现高效视频表示。

Result: 在K400、SSv2和UCF101基准测试中，HyperGS在保持较小视频表示大小的同时，将PSNR提高了2.9-3.1 dB。编码速度比逐视频高斯优化快10^4-10^5倍，并能零样本泛化到720p视频，实现更高分辨率渲染而无需重新编码。

Insight: 创新点包括设计因子化时空Transformer和基于查询的Transformer来预测高斯表示，以及引入基于秩的几何正则化器来解决训练崩溃问题。这结合了高斯泼溅的快速灵活渲染与前馈预测的速度和泛化能力，推动了高斯表示在快速通用视频表示中的实际应用。

Abstract: Gaussian Splatting has emerged as an effective representation for video, but existing methods rely on per-video optimization. This leads to slow encoding and limits generalization across videos. To amortize this optimization, we propose HyperGS, a feedforward, optimization-free approach that directly predicts Gaussian representations from any video in a single forward pass, speeding up encoding and decoding by orders of magnitude while generalizing to out-of-distribution videos at higher resolutions. In HyperGS, we design a factorized spatiotemporal Transformer to extract tokens from video, and a learnable query-based Transformer to obtain 8-parameter Gaussian representations for each video frame. We find that naively predicting Gaussians across diverse videos induces a needle-like degeneration that collapses training, and address this with a rank-based geometric regularizer whose strength adapts dynamically to stabilize optimization. HyperGS achieves encoding at $10^4$–$10^5\times$ the speed of per-video Gaussian optimization at matched reconstruction quality while generalizing zero-shot to $720p$ video, enabling higher-resolution rendering without re-encoding. HyperGS improves PSNR by +2.9–3.1 dB over the prior video encoders on K400, SSv2, and UCF101 at a smaller video representation size. By predicting explicit 2D Gaussians in a single forward pass, HyperGS combines the fast, flexible rendering of Gaussian Splatting with the speed and generalization of feedforward prediction, advancing Gaussians as a practical direction for fast and generalizable video representation.

[125] Vinci2: Providing Proactive Assistance in Continuous Egocentric Videos cs.CV | cs.AIPDF

Gong Sitong, Tianyu Yan, Caixin Kang, Bo Zheng, Xiang Ruan

TL;DR: 本文提出了Vinci2，一个主动式自我中心视频辅助系统，旨在从被动响应转向主动干预。作者构建了首个大规模连续自我中心视频主动辅助基准EgoServe，包含3000多个服务实例，涵盖10个类别和4种时间记忆跨度。同时提出了无需训练的、基于记忆增强的智能体EgoMemo，它通过维护多尺度时间摘要、语义知识图谱和视觉嵌入档案三种记忆表示，进行检索增强推理来决定是否提供辅助。

Details

Motivation: 现有智能辅助系统要么被动等待用户查询，要么将所有检测到的事件都视为需要响应，而忽略了用户的历史、当前活动以及辅助是否真正需要。本文旨在解决在连续自我中心视频中，如何根据上下文主动、适时地提供辅助的问题。

Result: 在提出的新基准EgoServe上，EgoMemo建立了强大的基线性能。同时，在现有的自我中心视频基准测试中，EgoMemo也保持了竞争力。

Insight: 核心创新在于将主动辅助重新定义为依赖于上下文的决策问题，并提出了一个结合了多尺度时间摘要、语义知识图谱和视觉嵌入档案的、无需训练的记忆增强推理框架（EgoMemo），以支持对累积时间上下文的推理。同时，构建了首个大规模、多时间跨度、多类别的主动辅助基准EgoServe，为领域研究提供了重要资源。

Abstract: When should an intelligent assistant speak up without being asked? Continuous egocentric video offers rich, evolving context that enables a new form of assistance: one that is proactive rather than merely reactive. Yet existing approaches either wait passively for user queries or treat every detected event as requiring a response, without considering the user’s history, current activity, or whether assistance would actually be welcome. We reframe proactive assistance as a context-dependent decision problem: the agent must not only perceive what is happening, but reason over accumulated temporal context to determine when and whether to intervene. To this end, we present Vinci2, a proactive egocentric assistance system that advances the on-device assistant Vinci from reactive response toward proactivity. On the evaluation side, we present EgoServe, the first large-scale benchmark for proactive assistance in continuous egocentric video. EgoServe comprises over 3,000 service instances organized along 4 temporal memory horizons, ranging from immediate safety alerts to long-term habit coaching, across 10 service categories. On the modeling side, we propose EgoMemo, a training-free, memory-augmented agent that maintains three complementary memory representations: multi-scale temporal summaries, a semantic knowledge graph, and visual embedding archives. At each timestep, EgoMemo performs retrieval-augmented reasoning to determine whether assistance is warranted and, if so, produces contextually grounded responses. Experiments demonstrate that EgoMemo establishes strong baselines on EgoServe while remaining competitive on existing egocentric benchmarks. Our benchmark and code are publicly available at \href{https://sitonggong.github.io/EgoServe-page/}{Vinci2}.

Yu Qi, Hongyu Li, Shaofei Huang, Tianrui Hui, Yaxiong Wang

TL;DR: 本文提出了一种无需训练的框架PSC-AVDN，用于解决高空无人机视觉与对话导航任务。该框架通过解析-搜索-确认的三阶段推理流程，结合结构化空间记忆，将模糊的对话指令转化为稳定的几何方向与目的地线索，并利用搜索思维链进行逐步目标探索，再通过确认思维链进行细粒度验证，以高效完成导航。

Details

Motivation: 解决在资源受限的高空无人机导航中，直接应用多模态大语言模型因方向定位能力弱和缺乏显式空间记忆而导致导航不可靠的问题。

Result: 在ANDH和ANDH-Full数据集上的大量实验表明，PSC-AVDN在无需训练的设置下取得了新的最先进性能，匹配甚至超越了一些经过微调的方法。

Insight: 创新点在于将链式思维推理与结构化空间记忆紧密耦合，通过多阶段解析和验证流程来增强方向感知和空间一致性，同时整合多尺度视觉、空间视觉记忆和结构化几何记忆等多种空间线索源，以提供全局上下文和长期一致性。

Abstract: In this paper, we tackle the Aerial Vision-and-Dialog Navigation (AVDN) task in the training-free setting for resource-efficient high-altitude UAV navigation.Naively applying MLLMs leads to unreliable navigation due to weak directional grounding and the lack of explicit spatial memory.To address these issues, we propose PSC-AVDN, a training-free framework that tightly couples a three-stage Parsing-Search-Confirmation reasoning pipeline with a Structured Spatial Memory (SSM).The parsing stage uses an LLM to convert ambiguous dialogue instructions into stable geometric directional and destination cues.A Search Chain-of-Thought (S-CoT) then performs stepwise target exploration under high-altitude observations, and a Confirmation Chain-of-Thought (C-CoT) conducts fine-grained verification around candidate regions to resolve visual ambiguity.Meanwhile, SSM integrates three complementary sources of spatial cues, including multi-scale visual observation, spatial visual memory, and structured geometric memory to provide global spatial context and long-horizon consistency.Extensive experiments on ANDH and ANDH-Full show that PSC-AVDN establishes new state-of-the-art performance in the training-free setting, matching or surpassing several finetuned methods.Code will be publicly available at: https://github.com/QY6616/PSC-AVDN

[127] Training-Free Off-Screen Player Imputation for Broadcast-Based Spatial Football Analytics cs.CV | cs.LGPDF

Seongjin Choi

TL;DR: 该论文提出了一种无需训练的离屏球员补全方法，用于解决广播视角下足球空间分析中球员位置数据不完整的问题。通过模拟广播视口对完整追踪数据施加限制，量化了忽略离屏球员带来的误差，并评估了一系列仅使用比赛观测数据的在线补全基线方法。其中，基于角色锚定的质心投票方法显著降低了误差，并在集成到广播视频游戏状态重建管道后，对下游的控球质量评分产生了实质性影响。

Details

Motivation: 足球空间分析指标（如球场控制）需要所有22名球员的位置数据，但广播主镜头通常只显示10-16名球员，导致数据不完整和分析失真。现有基于视频的游戏状态重建管道若缺少补全层，会隐含忽略离屏球员的基线，造成显著误差。

Result: 在公开的完整球场追踪数据（Metrica Sports；三场比赛）上构建的可复现基准测试中，忽略离屏球员会使隐藏区域的球场控制误差膨胀至25.1-26.9个百分点，平均绝对控制份额误差为11.1-13.4点。提出的角色锚定质心投票方法将隐藏区域误差大致减半（至12.2-13.8点），并将控制份额误差降低至忽略策略的28-48%。在遮挡时间≤9.6秒的范围内，该方法达到了3.3-8.9米的分箱中位数位置误差。集成到端到端广播视频GSR管道后，对下游的控球质量评分（空间创造指数）产生了15.6和17.2点的改变，并在一个真实世界杯广播片段中翻转了判决类别。

Insight: 论文的创新点在于提出了一种无需训练、仅使用单场比赛观测数据的在线补全方法，特别是角色锚定质心投票策略，通过让每个可见球员根据其动态角色偏移对全队质心进行投票，有效减轻了视口引起的子集偏差。该方法为广播视频分析提供了一种轻量级、可解释的解决方案，弥补了数据缺口，并可直接集成到现有管道中提升下游分析任务的准确性。

Abstract: Spatial football metrics such as pitch control assume access to the positions of all 22 players, yet the most widely available source of positional data – the broadcast main camera – shows only 10-16 of them at any moment. We quantify the resulting distortion with an open, reproducible benchmark: a simulated broadcast viewport applied to open full-pitch tracking data (Metrica Sports; three matches, one held out from method development). Ignoring off-screen players – the visible-only baseline implied whenever a video-based game-state-reconstruction (GSR) pipeline adds no imputation layer – inflates hidden-zone pitch-control error to 25.1-26.9 percentage points and a mean absolute control-share error of 11.1-13.4 points across the three matches. We then evaluate a ladder of training-free, online imputation baselines that use only observations from the match being analysed. The best overall on these decision-relevant metrics, role-anchored centroid voting (each visible player votes for the full-team centroid by subtracting its running role offset, attenuating the viewport-induced subset bias), roughly halves hidden-zone error (to 12.2-13.8 points) and cuts control-share error to 28-48% of the ignore policy at every viewport width from 36 m to 60 m in all three matches. For occlusions <=9.6 s – the regime of the closest learned prior work – it reaches binwise median position errors of 3.3-8.9 m; but 50-57% of hidden-player observations lie beyond that regime. Integrated end-to-end into a broadcast-video GSR pipeline, imputation moves a downstream possession-quality score (Space-Creation Index) by 15.6 and 17.2 points on two real World Cup broadcast windows, flipping the verdict class in one.

[128] Technical Report on the CVPR 2026@AdvML Workshop Challenge cs.CV | cs.AIPDF

Tianyuan Zhang, Zonglei Jing, Jiangfan Liu, Ligong Zhang, Ke Ma

TL;DR: 本报告介绍了CVPR 2026 AdvML Workshop中针对自动驾驶视觉语言代理（VLA）的多模态对抗攻击挑战赛。该挑战基于DriveLM风格的多视角视觉问答任务，要求参赛者生成对抗性图像和仅后缀的文本扰动，以诱导模型偏离正确答案，同时保持图像保真度和限制文本修改成本。报告总结了任务设计、评估协议、排行榜结果，并分析了五个领先提交方案中发现的攻击模式与漏洞。

Details

Motivation: 随着视觉语言代理（VLA）在复杂驾驶场景解释和安全关键推理中的应用日益增多，评估其对抗鲁棒性变得至关重要。本挑战旨在通过多模态对抗攻击，系统性地测试自动驾驶VLA在面对精心设计的图像和文本扰动时的脆弱性。

Result: 挑战赛分为两个阶段，第二阶段引入了隐藏的黑盒模型以评估攻击的可迁移性。报告分析了领先提交方案的结果，发现图像侧攻击因后缀惩罚机制而更受青睐，且场景级、多视图联合优化比孤立处理视图更有效。

Insight: 摘要中宣称的创新点在于设计了首个针对自动驾驶VLA的多模态对抗攻击基准，并系统性地探索了攻击策略。从客观分析看，其关键发现包括：利用QA类型和图结构作为攻击预算分配的先验知识、特征空间目标函数可提升黑盒迁移性，以及相机图像中嵌入的印刷内容（如路牌文字）是驾驶VLA的一个持续脆弱点，这为未来多模态自动驾驶系统的鲁棒性评估和防御设计提供了实用参考。

Abstract: Vision-language agents (VLAs) are increasingly used to interpret complex driving scenes and support safety-critical reasoning. This report presents the CVPR 2026@AdvML Workshop Challenge on adversarial multimodal attacks against autonomous-driving VLAs. Built on DriveLM-style multi-view visual question answering, the challenge represents each scene with six synchronized camera images and a structured collection of driving-related question-answer pairs. Participants generate adversarial images and suffix-only textual perturbations that induce model responses to deviate from reference answers while preserving image fidelity and limiting textual cost. The competition comprises two phases, with Phase II adding a hidden black-box model to assess transferability. We describe the task design, submission rules, evaluation protocol, and leaderboard results, and then examine five leading submissions for which technical reports were available. Across these reports, several recurring patterns emerge: image-side attacks are favored by the suffix penalty; scene-level, multi-view optimization is more effective than treating views in isolation; QA types and graph structure provide useful priors for allocating attack budget; feature-space objectives can improve black-box transfer; and typographic content embedded in camera images exposes a persistent vulnerability in driving VLAs. These findings provide a practical reference for future robustness evaluation and defense design in multimodal autonomous-driving systems.

[129] Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPO cs.CVPDF

Xin Zhang, Haochen Wang, Yikang Zhou, Jason Li, Robby T. Tan

TL;DR: 本文提出了一个名为CycleGRPO的统一强化学习框架，将多模态大语言模型（MLLMs）的区域理解和定位任务联合优化。该框架利用任务间的对偶性，让单个MLLM既作为生成区域描述的‘演员’，又作为将描述重新定位回空间域的‘评论家’，从而仅需区域输入（如掩码或边界框）即可训练。实验表明，该框架在无需任务特定微调的情况下，在区域描述、区域视觉问答、基于区域的对话和指代分割等多个基准上均取得了性能提升。

Details

Motivation: 现有方法通常将区域理解和定位视为独立的流程，分别处理。本文旨在利用这两个任务之间固有的对偶性，构建一个统一的、自评估的强化学习范式，以同时提升MLLM在这两方面的能力，并避免对文本真值标注的依赖。

Result: 基于SAMTok构建的CycleGRPO框架在多个基准测试中取得了一致的性能提升，包括区域描述（region captioning）、区域视觉问答（region VQA）、基于区域的对话（grounded dialogue）和指代分割（referring segmentation）。

Insight: 核心创新在于提出了‘演员即评论家’的自循环强化学习范式（CycleGRPO），通过‘区域→文本→区域’的循环一致性奖励来联合优化区域理解和定位。该方法巧妙地利用任务对偶性，仅需区域输入即可训练，为提升MLLM的像素级能力提供了一种简洁且可扩展的途径。

Abstract: This paper introduces Actor as Its Own Critic, a unified reinforcement learning framework, Cycle Group Relative Policy Optimization (CycleGRPO), that jointly optimizes region understanding and localization for Multimodal Large Language Models (MLLMs). Unlike existing separate pipelines, we leverage the inherent duality between the two tasks to construct a self-evaluating reinforcement learning paradigm: “region $\to$ text $\to$ region’’. Specifically, a single MLLM first acts as the actor to generate region captions, then immediately transitions to a critic to ground its generated text back in the spatial domain. Therefore, CycleGRPO requires only region inputs, e.g., masks or bounding boxes, entirely bypassing the need for textual ground truths. A quality-aware token-level cycle-consistency reward is employed to assess the semantic discriminability of text captions via their physical localization accuracy. Empirically, built upon SAMTok, our CycleGRPO framework successfully bootstraps both capabilities simultaneously. Without any task-specific fine-tuning, the framework yields consistent performance gains across a wide range of benchmarks, including region captioning, region VQA, grounded dialogue, and referring segmentation. Overall, CycleGRPO offers a straightforward and scalable way to advance pixel-level capabilities in MLLMs. Code and models are released at https://github.com/devinxzhang/CycleGRPO.

[130] MonkeyOCRv2: A Visual-Text Foundation Model for Document AI cs.CVPDF

Yuliang Liu, Zhang Li, Ziyang Zhang, Shuo Zhang, Qiang Liu

TL;DR: 本文提出了MonkeyOCRv2，一个面向文档AI的视觉-文本预训练基础模型。为了解决主流视觉编码器在自然图像上预训练后难以有效处理文档图像（因其包含密集文本和细粒度字符笔画）的问题，作者构建了大规模多语言文档图像数据集MonkeyDoc v2，并设计了一种联合学习图像到文本生成和像素级文档重建的预训练策略。该模型在文本识别、公式识别、文本检测、文档篡改检测和重叠文本分割等五项任务上均能提升性能，并作为视觉编码器赋能轻量级多模态大语言模型，在文档解析和理解任务上取得了新的开源SOTA结果。

Details

Motivation: 主流视觉编码器通常在自然图像上预训练，缺乏对文档图像特有的密集文本和细粒度字符笔画的感知能力，因此需要面向文档的适应性调整。

Result: 在五项代表性文档分析任务（文本识别、公式识别、文本检测、文档篡改检测、重叠文本分割）上，替换为MonkeyOCRv2编码器均能持续提升性能。作为冻结的视觉编码器，它与轻量级语言模型结合，在跨17种语言的MDPBench基准上，以0.7B参数量（视觉编码器比前最佳模型小约11倍）取得了新的开源SOTA，绝对性能提升2.8%。在八个文档理解基准上，其性能也优于基于CLIP、DINO和SAM构建的同类模型。

Insight: 创新点在于构建了据称是最大的文档图像预训练语料库MonkeyDoc v2，并提出了一种联合学习图像到文本生成（对齐视觉与文本内容）和像素级文档重建（保留字符笔画和布局细节）的预训练策略。这为文档智能提供了一个独立的视觉基础，而无需依赖自然图像预训练模型。

Abstract: Mainstream visual encoders are pretrained on natural images and cannot be effectively applied to document images without document-oriented adaptation, as dense text and fine-grained character strokes demand character-level visual perception. We present MonkeyOCRv2, a visual-text pretrained model for document AI. First, we construct MonkeyDoc v2, to our knowledge the largest document-image pretraining corpus, comprising 113 million images spanning 17 languages. Second, we propose a pretraining strategy that jointly learns image-to-text generation and pixel-level document reconstruction: the former aligns visual representations with textual content, while the latter preserves character strokes and layout details. Extensive experiments are conducted on five representative document analysis tasks, including text recognition, formula recognition, text detection, document tampering detection, and overlapping text segmentation. Replacing the original encoders with MonkeyOCRv2 consistently improves performance across all five tasks. Finally, we validate its effectiveness as the vision encoder of multimodal large language models on the more challenging tasks of document parsing and document understanding. Kept frozen and paired with a lightweight language model, it yields a 0.7B document parsing model that sets a new open-source state-of-the-art on MDPBench, a recent benchmark spanning digital-born and photographed documents across 17 languages, surpassing the previous best 3B dots.mocr by 2.8% absolute with a vision encoder roughly 11$\times$ smaller. The frozen encoder also powers a document understanding model that outperforms counterparts built on CLIP, DINO, and SAM across eight benchmarks under identical training settings. These results suggest that document-oriented visual pretraining can serve as a foundation for document intelligence in its own right.

[131] Motion4Motion: Motion Transfer Across Subjects at Inference cs.CVPDF

Ling-Hao Chen, Zixin Yin, Duomin Wang, Xianfang Zeng, Gang Yu

TL;DR: 本文提出了一种名为Motion4Motion的训练无关运动迁移框架，旨在解决视频间运动迁移问题。该框架通过建模视频中角色的运动流而非依赖预定义骨骼结构，实现了跨物种（如不同动物）的运动迁移，并保持了其独特的运动风格。

Details

Motivation: 现有视频运动迁移方法主要依赖于预定义的人类骨骼结构和基于骨骼的条件模型训练，这限制了其向多样化角色（如不同物种的动物）的泛化能力，且相关标注数据有限，阻碍了大规模训练。

Result: 广泛的实验结果表明，该方法在运动迁移任务上显著优于基线模型，并通过新颖的应用展示了其有效性。

Insight: 创新点在于摒弃了基于骨骼的迁移框架，转而采用无训练的运动流建模方法，这降低了模型对特定骨骼结构和标注数据的依赖，从而提升了跨物种迁移的灵活性和泛化能力。

Abstract: This work explores the motion transfer from one video to another, which is crucial in animation for diverse characters. Previously, video motion transfer has been largely explored between human and human-like characters, enabling a lot of applications in digital creation. However, these approaches encounter a main limitation. Specifically, related technical pipelines heavily rely on a predefined human skeleton structure and accordingly require skeleton-conditional model training. On the one hand, these methods are difficult to generalize to diverse characters, such as animals from different species, while preserving their unique motion styles. On the other hand, labeled data in diverse skeletons is limited, which additionally restricts the large-scale training for the task. In this paper, we jump out of the skeleton-based motion transfer framework and propose a training-free motion transfer framework, named Motion4Motion. Motion4Motionmodels the motion flow of the character in a video instead of skeletons, which makes motion transfer across species easier. Extensive experimental results and novel applications show our methods outperform baselines impressively. Project page is available at https://lhchen.top/Motion4Motion.

[132] Event-RGB Adaptive Tracking for Nighttime Highway Perception cs.CV | cs.ROPDF

Haidong Wang, Hengxing Cai, Wanlei Li, Xiaogang Xiong, Renxin Zhong

TL;DR: 本文提出了一种新颖的联合事件-RGB自适应跟踪框架，用于解决高速公路夜间环境下RGB相机感知性能严重下降的问题。该框架通过自适应扩展卡尔曼滤波器动态融合异步事件流和RGB帧，并创建了一个大规模合成数据集SEHN来支持研究。

Details

Motivation: 解决高速公路在无人工照明、车辆高速行驶的夜间环境下，RGB相机因运动模糊、曝光不足和信噪比低而导致的感知可靠性严重下降的问题。

Result: 论文提出了JEAT框架，并在其新创建的大规模合成数据集SEHN上进行了验证，该数据集包含多种环境条件和交通密度，提供了同步的RGB图像和事件流。

Insight: 创新点在于提出了一个动态融合事件流和RGB帧的自适应联合数据关联优化框架，突破了现有多传感器跟踪器固定优先级融合的限制，并贡献了一个专门用于高速公路多模态感知的合成数据集。

Abstract: Intelligent Transportation Systems deployed on highways predominantly rely on conventional RGB cameras for traffic perception and vehicle tracking. However, highway environments present unique challenges: the absence of artificial lighting infrastructure, combined with high vehicle velocities, results in severely degraded perception performance under low-light conditions. Specifically, nighttime scenarios suffer from motion blur, insufficient exposure, and poor signal-to-noise ratios, which catastrophically impair the reliability of RGB-based sensing systems. To address these limitations, we propose a novel Joint Event-RGB Adaptive Tracking (JEAT) framework. Unlike existing multi-sensor trackers constrained by rigid, hard-coded prioritization, JEAT merges asynchronous event streams and RGB frames into a unified joint data association optimization. By employing an Adaptive Extended Kalman Filter to continuously estimate measurement noise via NIS statistics, the framework dynamically weights and fuses both modalities, optimally harnessing event streams during dark or high-speed motion while leveraging RGB frames under bright or static conditions. Furthermore, given the absence of publicly available datasets tailored for event-based highway perception with diverse environmental conditions, we present SEHN, a large-scale synthetic dataset generated using the CARLA simulator. Our dataset encompasses diverse environmental conditions (daytime, nighttime, nighttime with out artificial lighting) and varying traffic densities, providing synchronized RGB imagery and event streams to facilitate multi-modal fusion research. Our code and datasets will be available at https://github.com/haidongwang96/SEHN.

[133] FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry cs.CVPDF

Muxin Liu, Xiaoyang Lyu, Tianhe Ren, Peng Dai, Xiaoshan Wu

TL;DR: FoundationGeo是一个两阶段框架，用于从单目图像进行度量几何估计。第一阶段通过DINOv3初始化和在1020万样本多领域数据集上进行训练，学习高保真、仿射不变的几何模型；第二阶段引入轻量级像素级校准场（尺度场和射线方向校正场）进行度量估计，生成度量一致的3D点云图。此外，论文通过基于Blender的数据引擎合成不同焦距的训练数据，解决了相机内参分布不匹配导致的零样本泛化瓶颈。

Details

Motivation: 解决单目几何估计中相对预测与度量预测之间的鸿沟，并克服现有方法在跨领域泛化时因相机内参（特别是焦距）分布不匹配而导致的性能急剧下降问题。

Result: 在七个基准测试上进行广泛的零样本评估，结果表明FoundationGeo显著增强了跨领域鲁棒性，在不同领域均保持接近顶端的性能，避免了其他方法观察到的尖锐跨领域性能下降，整体性能平均超过更重的基线方法5.2%以上。

Insight: 创新点包括：1）两阶段框架明确桥接相对与度量预测；2）引入像素级校准场（尺度场和射线方向校正场）进行空间变化的度量对齐；3）识别并系统解决相机内参覆盖不足（尤其是焦距分布不匹配）这一零样本度量泛化的关键瓶颈，通过合成数据增强鲁棒性。

Abstract: We present FoundationGeo, a two-stage framework that explicitly bridges relative and metric prediction via spatial calibration and principled data design. Stage 1 learns a high-fidelity, affine-invariant geometry model by initializing with DINOv3 and training on a curated 10.2M-sample multi-domain corpus with complementary local-detail supervision, yielding sharp boundaries and strong cross-domain generalization. Stage 2 moves beyond global scaling by introducing lightweight pixel-wise calibration fields for metric estimation: a scale field for spatially varying metric alignment and a ray-direction correction field that mitigates directional bias in point-map geometry, together producing metrically consistent 3D point maps. Beyond model design, we identify camera intrinsic coverage, especially focal length distribution mismatch between training and test data, as a key bottleneck for zero-shot metric generalization: performance drops sharply when test intrinsics fall outside the training distribution. To address this, we synthesize additional training data across diverse focal lengths using a Blender-based data engine, repairing under-covered focal regimes and improving robustness under intrinsic shift. Extensive zero-shot evaluations across seven benchmarks show that FoundationGeo significantly strengthens cross-domain robustness, staying near the top across diverse domains while avoiding the sharp cross-domain performance drops observed in other methods. This consistency translates into the best overall performance, surpassing heavier baselines by over 5.2% on average.

[134] Feature-Space Guided Diffusion for Realistic Ultrasound Image Synthesis cs.CVPDF

Marina Domínguez, Nélida Mirabet-Herranz, Valery Naranjo

TL;DR: 本文提出了一种名为特征空间候选引导（FSCG）的训练免费采样策略，用于提升条件扩散模型生成的超声（US）图像的真实性。该方法通过在采样时应用局部k-NN特征校正并根据特征空间能量选择最佳候选样本，有效缩小了生成图像与真实图像在表示空间中的差距。

Details

Motivation: 现有条件扩散模型生成的医学超声图像虽具有解剖学合理性，但缺乏真实的B模式外观（如斑点纹理、组织对比度和衰减等采集相关特性），导致其在表示空间中与真实图像分离。

Result: 在三个不同数据集上的实验表明，FSCG相比标准条件扩散采样，将平均FID64和FID192分别降低了56%和57%，并将最近邻特征距离降低了47%，性能优于其他推理时引导基线方法。

Insight: 创新点在于利用冻结的超声基础模型提取的特征表示，在无需重新训练生成器的情况下，通过采样时的特征空间引导来揭示并弥补医学图像合成中的真实感差距，实现了解剖结构由掩码定义、而图像外观由特征引导向真实域靠拢的分离控制。

Abstract: Conditional diffusion models can generate anatomically plausible medical ultrasound (US) images, but anatomical plausibility alone does not ensure realistic B-mode appearance. Most US pipelines adapt standard generative architectures and condition them on anatomical masks, or use guidance mechanisms that reinforce the same anatomical signal. However, B-mode US images are shaped by acquisition-dependent properties such as speckle texture, tissue contrast, and attenuation. Using a frozen US foundation model, we show that standard conditional diffusion baselines remain separated from real images in representation space. In this work, we propose Feature-Space Candidate Guidance (FSCG), a training-free sampling strategy to reduce this gap. At sampling time, FSCG applies local k-NN feature correction and selects the best of multiple stochastic candidates according to their feature-space energy. In this way, the mask defines the anatomy, while FSCG steers samples toward the real US domain. Across three different datasets, FSCG reduces average FID64 by 56%, FID192 by 57%, and nearest-neighbour feature distance by 47% over standard conditional diffusion sampling, outperforming alternative inference-time guidance baselines. The results suggest that domain-aware feature representations can reveal and reduce realism gaps in medical diffusion synthesis without retraining the generator. Our code is available at https://github.com/marinadominguez/FSCG.

[135] SVI360: Spherical Video Interpolation cs.CVPDF

Le-Kim Nguyen, Renato Martins, Pascal Vasseur, Cedric Demonceaux

TL;DR: 本文提出了SVI360，一种用于全景（球形）视频插值的双分支框架。该方法通过结合原始图像帧及其旋转正交视图来处理球面视频中靠近极点的严重畸变问题，从而提升插值质量。

Details

Motivation: 现有视频插值方法不适用于球形视频，因为它们在处理靠近极点的严重畸变时存在困难，而全景视频插值在虚拟现实和沉浸式视频增强等应用中至关重要。

Result: 实验表明，该方法在四个不同的公共基准测试中，在插值质量上优于现有最先进方法，同时保持了准确的光流估计。

Insight: 核心创新点在于通过双分支框架结合原始视图与正交视图，并增强两者间光流位移的等变性，以改进中间帧预测，这为解决球面视频特有的畸变问题提供了新思路。

Abstract: This paper addresses the problem of omnidirectional video interpolation, which plays an essential role in applications such as virtual reality and immersive video enhancement. Existing video interpolation methods are not well-suited for spherical videos, as they have difficulty handling severe distortions close to the poles. To address this issue, we propose SVI360, a dual-branch framework that combines the image frame and its rotated orthogonal view to deal with these distortions. The core methodological aspect of the approach is to reinforce equivariance of the flow displacements between the original and orthogonal views to improve intermediate frame prediction. Experiments show that our method outperforms state-of-the-art approaches in interpolation quality while maintaining accurate optical flow in four different public benchmarks. Code and pre-trained models are available at: https://icb-vision-ai.github.io/video360_interpolation/

[136] ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space cs.CVPDF

Mingchao Sun, Luyang Tang, Yu Liu, Xu Yan, Zhan Li

TL;DR: 本文提出了ABot-3DWorld 0，一个通用的多模态3D世界模型，能够将文本、图像和视频输入转换为高保真、可探索的3D世界。其核心是统一的空间生成基元（SGP），它由一个高质量的全景图和空间点云组成，能高效描述任何3D空间。模型通过将多模态输入提升至SGP，再沿规划轨迹生成3D一致的全景视频，最后重建为干净的、逼真的3D高斯溅射（3DGS）世界。

Details

Motivation: 解决通用3D内容创建的难题，旨在开发一个低门槛的引擎，能够处理从丰富输入（如多视图集、视频）到简单输入（如单张图像或句子）的各种模态，并将其转换为可探索的3D世界，同时将生成的世界锚定到地理兴趣点，实现消费者规模的地图原生空间探索。

Result: 实验表明，ABot-3DWorld 0在开源方法中达到了最先进水平（SOTA），并且在丰富的多模态输入下，比Marble模型展现出更强的场景保真度。

Insight: 创新点在于引入了统一的空间生成基元（SGP）作为紧凑的中间表示，以及一个覆盖从几何严谨恢复到生成式补全的完整流水线，实现了从多模态输入到高质量3DGS世界的端到端转换，为通用3D内容创建提供了高效且灵活的解决方案。

Abstract: We present ABot-3DWorld 0, a universal multimodal 3D world model that turns text, image, and video inputs into high-fidelity, explorable 3D worlds. At the heart of our framework is a unified Spatial Generative Primitive (SGP), a compact tuple of a high-quality panorama and a spatial point cloud that delivers an efficient description of any 3D space. Multimodal inputs are first lifted into this primitive; a 3D-consistent panoramic video generator then explores the primitive along a planned trajectory; finally, our panoramic video reconstruction engine converts the generated video into a clean, photorealistic 3D Gaussian Splatting (3DGS) world. This pipeline covers two regimes: rich inputs (multi-view sets, casual video) are lifted into the SGP through a geometry-rigorous recovery that mirrors the observed scene, while a single image or sentence is completed generatively into a creative world. The result is one low-barrier engine for general 3D content creation that further anchors generated worlds to geographic points of interest, enabling map-native spatial exploration at consumer scale. Experiments show that ABot-3DWorld 0 sets the state of the art among open-source methods and demonstrates stronger scene fidelity than Marble under rich multimodal inputs.

[137] Higher-Order Cell Tracking Transformer cs.CVPDF

Jordão Bragantini, Ilan Theodoro, Loïc A. Royer

TL;DR: 本文提出了高阶细胞追踪变换器（HOCT），一种以边为中心的架构，用于从活体成像显微镜数据中重建细胞谱系。该方法通过引入三维几何先验，使候选细胞链接相互关注，解决了现有方法在候选追踪图中忽略的两个结构障碍：细胞分裂在节点嵌入空间中纠缠不同谱系路径，以及共享节点的边具有近乎随机的标签一致性。

Details

Motivation: 现有方法在构建候选图以关联跨帧细胞分割时，忽略了两个关键的结构性障碍：细胞分裂导致节点嵌入空间中不同谱系路径的纠缠，以及共享节点的边之间标签一致性近乎随机，使得图拓扑结构无法为图神经网络提供有效聚合信息。

Result: 在Cell Tracking Challenge和细菌分裂基准测试上进行评估，HOCT无需深度预训练图像编码器即达到了最先进的（SOTA）结果。在人类参与循环设置中，仅用400个标注进行微调即可快速将追踪错误减少59%，优于竞争性变换器基线的LoRA微调（提升6.75%）。

Insight: 创新点在于提出了一种以边为中心的架构，并引入三维几何先验，使候选链接能够相互关注，从而有效解决了节点嵌入空间纠缠和图拓扑信息无效的问题。从客观角度看，该方法简化了微调过程，在数据标注有限的情况下显著提升了性能，具有较高的实用价值。

Abstract: Reconstructing lineages from live-imaging microscopy requires linking cell detections across time, including through cell divisions. A common approach is to construct a candidate graph and associate cell segmentations (nodes) across frames. However, these and other existing methods overlook two structural obstacles in candidate tracking graphs: (i) cell divisions entangle distinct lineage paths in the node embedding space, and (ii) edges sharing a node have near-random label agreement, so the candidate-graph topology carries no useful information for graph neural networks to aggregate. We propose the \textbf{Higher-Order Cell Tracking Transformer} (HOCT), an edge-centric architecture in which candidate cell links attend to one another under a 3D geometric prior, resolving both issues. Evaluated on the Cell Tracking Challenge and a bacteria division benchmark, HOCT achieves state-of-the-art results without deep pre-trained image encoders. Moreover, the proposed approach is easier to fine-tune, quickly reducing tracking errors by 59% with 400 annotations in a human-in-the-loop setting, outperforming LoRA fine-tuning of competing transformer baselines (6.75% improvement).

[138] StoryTeller: Training-Free Narrative Grounding for Long-Form Audio Description cs.CV | cs.AIPDF

Seung Hyun Hahm, Minh T. Dinh, SouYoung Jin

TL;DR: 本文提出StoryTeller，一个无需训练的、用于生成长篇音频描述（AD）的框架。它通过维护一个经过验证的叙事记忆库，跨场景传递故事相关信息，解决了现有视频语言模型在长视频中独立处理每个片段、缺乏叙事连贯性的问题。该方法仅需原始视频和电影标题，无需额外标注数据或特定任务微调。

Details

Motivation: 现有视频语言模型在短片段上有效，但在生成长篇音频描述时，往往独立处理每个时刻，导致描述缺乏对角色、事件意义及叙事上下文的连贯性，无法满足视障观众理解电影故事的需求。

Result: 在标准AD基准测试和多样化的长视频上，StoryTeller在自动评估、基于问答的评估和人工评估中，在叙事连贯性、事实依据和故事理解方面均持续优于强基线模型。作者还引入了StoryAD-QA问答基准来评估生成的AD是否保留了叙事信息。

Insight: 核心创新在于提出了一个无需训练的、基于叙事记忆的框架，通过语义过滤和VLM验证，仅依据视频内容跨场景维护和传递故事相关信息，从而提升长视频描述的连贯性和上下文感知能力，且不依赖任何外部标注数据。

Abstract: Long-form audio description (AD) requires more than describing visible actions: it must preserve characters, events, relationships, and story context across scenes so that blind and low-vision (BLV) audiences can follow a film. Modern video-language models (VLMs) are effective on short clips, but they often treat each moment independently, producing descriptions that miss who characters are, why events matter, and how the current scene connects to earlier narrative context. We propose StoryTeller, a training-free framework for story-aware long-form AD. Instead of relying only on local visual cues, StoryTeller maintains a verified narrative memory that carries forward story-relevant information across scenes, enabling later descriptions to remain coherent, grounded, and contextually informative. Given only raw video and a movie title, StoryTeller can optionally retrieve public movie metadata to resolve names and story context, while accepting only facts that are supported by the video through semantic filtering and VLM verification. The method requires no subtitles, scripts, AD transcripts, aligned captions, character banks, precomputed face identities, or task-specific fine-tuning. To evaluate whether generated AD preserves narrative information, we introduce StoryAD-QA, a question-answering benchmark that tests whether a language model can answer story-context questions using only the generated descriptions. Experiments on standard AD benchmarks and diverse long-form videos show that StoryTeller consistently improves narrative coherence, factual grounding, and story comprehension over strong baselines in automatic, QA-based, and human evaluations.

[139] MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents cs.CV | cs.AIPDF

Kaixin Ma, Di Feng, Alexander Metz, Jiarui Lu, Eshan Verma

TL;DR: 论文提出了MM-ToolSandBox，这是一个用于评估视觉工具调用智能体的统一基准和评估框架。该框架提供了一个包含16个应用领域、500多种工具的有状态执行环境，支持多图像、多轮次任务，并模拟了真实对话场景。通过自动化的场景生成流程，创建了258个人工验证的场景和50个变体。对12个前沿模型的评估表明，当前模型在视觉工具调用能力上仍存在明显不足，最佳模型的成功率也低于50%。

Details

Motivation: 为了解决当前视觉工具调用智能体缺乏统一、全面的评估基准的问题，特别是针对多模态、多轮次、有状态交互的复杂任务场景。

Result: 在MM-ToolSandBox基准上评估了12个从4B参数量开源模型到前沿闭源系统在内的SOTA模型，结果显示所有模型表现均不理想，最佳模型成功率低于50%。失败分析指出，视觉信息提取错误是主要瓶颈，占失败案例的53%。

Insight: 创新点在于构建了一个统一、有状态、支持多模态多轮交互的视觉工具调用评估框架和基准。一个关键发现是模型能力与失败模式的规模效应：小模型失败于任务规划，而大模型失败于视觉感知精度，这为不同能力层级的模型改进指明了不同的研究方向。

Abstract: We introduce MM-ToolSandBox, a benchmark and evaluation framework for visually grounded tool-calling agents. The framework provides a stateful execution environment spanning 500+ tools across 16 application domains, supporting multi-image, multi-turn tasks where agents must ground progressively arriving visual inputs into executable tool calls while handling realistic conversational phenomena (goal revisions, error corrections, state mutations). An automated scenario generation pipeline produces diverse, visually grounded scenarios through information-flow-guided planning and multi-stage quality filtering, yielding 258 human-verified nominal scenarios and 50 variants targeting interactive UI applications. Evaluating 12 state-of-the-art models, from 4B open-weight to frontier proprietary systems, shows that current models still lack robust visual tool-calling capability: even the best model achieves below 50% success rate. Our failure analysis further reveals that visual precision, not only planning, is a primary bottleneck for capable models: 53% of failures stem from incorrect information extraction from images despite otherwise correct task workflows. A planning-to-precision crossover emerges with scale: smaller models fail at deciding what to do, while larger models fail at perceiving what they see, suggesting fundamentally different research directions for improving models at different capability levels. The framework and the benchmark are publicly available at https://github.com/apple/ml-mmtoolsandbox

[140] Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency cs.CVPDF

Zihan Su, Teng Hu, Jiangning Zhang, Ruiyan Wang, Ran Yi

TL;DR: 本文提出Cycle-World框架，通过引入反向预测循环一致性来缓解自回归扩散模型在长视频生成中的误差累积问题。该方法在训练和推理阶段均强制时序可逆性，利用反向模型嵌入因果约束并作为运行时校正器，以梯度循环引导迭代修正潜在表示，从而抑制误差漂移。

Details

Motivation: 自回归扩散模型在长时序视频合成中，由于序列生成的累积误差会导致生成漂移、结构崩溃和视觉退化，因此需要解决误差累积问题以实现稳定且时序一致的长视频生成。

Result: 在VBench基准测试上的大量实验表明，Cycle-World通过双阶段协同显著缓解了误差漂移，在60秒合成中实现了最先进的整体生成质量和长时序一致性。

Insight: 创新点在于将严格的时间可逆性作为循环一致性目标，理论证明前向生成漂移可被严格约束；实践中通过高效反向预测模型隐式嵌入因果约束，并在推理时复用为梯度引导校正器，主动抑制累积误差，这为长序列生成提供了可借鉴的误差控制机制。

Abstract: Autoregressive diffusion models have enabled high-quality video generation, yet their sequential nature inherently suffers from error accumulation. In long-horizon video synthesis, minor prediction deviations compound over time, inevitably leading to unconstrained generative drift, structural collapse, and severe visual degradation. To address this, we propose Cycle-World, a novel framework designed for stable and temporally consistent long-video generation. Our approach tackles error drift by enforcing strict temporal reversibility across both the training and inference phases. Theoretically, we demonstrate that forward generative drift can be strictly bottlenecked by a cycle-consistency objective. During training, we integrate an efficient reverse-prediction model to implicitly embed causal constraints into the forward generator, compelling it to produce reversible sequences that tightly adhere to the natural video manifold. At inference time, we repurpose this frozen reverse model as a runtime corrector. Through gradient-based cycle guidance, it iteratively refines the generated latent representations, actively suppressing accumulated errors before they are committed to the historical context. Extensive experiments on the VBench benchmark demonstrate that Cycle-World’s dual-phase synergy significantly mitigates error drift, achieving state-of-the-art overall generation quality and long-horizon temporal consistency in 60-second synthesis.

[141] LoRA-Based Cascaded Multimodal Fusion for Action Recognition in Medical Training Environments cs.CV | cs.AIPDF

Divya Mereddy, Jeevan Beedareddy

TL;DR: 本文提出了一种基于低秩适应（LoRA）的级联多模态融合框架，用于医疗培训环境中的动作和活动识别。该框架结合了参数高效的模态特定适应与顺序融合，支持在不同模态集的数据集上进行可扩展的适应。在NurViD和护士培训数据集上的初步结果表明，级联融合策略优于单模态模型，并与先前报告的数据集特定基线具有竞争力。

Details

Motivation: 解决医疗培训环境中异构多模态（如视频、传感器数据）的融合问题，通过参数高效的方式集成不同模态，避免重新训练已学习组件，并支持可扩展的适应。

Result: 在NurViD和护士培训数据集上评估，级联融合策略提高了单模态模型的性能，并与数据集特定基线表现相当，显示出竞争性结果。

Insight: 创新点包括基于LoRA的级联融合架构，允许按顺序集成模态（先融合相关模态，再添加异构模态），实现参数高效和可扩展性；从客观角度看，这种方法为多模态任务提供了灵活的融合策略，适用于模态集变化的应用场景。

Abstract: This paper presents a cascaded Low-Rank Adaptation (LoRA)-based multimodal fusion framework for action and activity recognition in healthcare-oriented training environments. The proposed architecture combines parameter-efficient modality-specific adaptation with sequential fusion, enabling modalities to be integrated in stages without retraining previously learned components. Rather than assuming a fixed fusion structure, the framework first integrates more closely related modalities and then incorporates additional heterogeneous modalities, supporting scalable adaptation across datasets with different modality sets.We evaluate the framework on two healthcare-oriented training environment datasets: NurViD and the Nurse Training dataset. Across these datasets, preliminary results suggest that the proposed cascaded fusion strategy improves over individual modality models and provides competitive performance relative to previously reported dataset-specific baselines. Overall, these findings indicate that cascaded LoRA-based fusion is a promising parameter-efficient approach for integrating heterogeneous modalities in medical training action and activity recognition tasks. github: https://github.com/anonymous0-ai/LoRA-Based-Cascaded-Multimodal-Fusion-.git.

[142] HASTE: A Platform for Rapid Post-Disaster Building Damage Assessment cs.CVPDF

Caleb Robinson, Anthony Ortiz, Simone Fobi Nsutezo, Cameron Birge, Meygha Machado

TL;DR: HASTE是一个无需编码的Web平台，旨在快速进行灾后建筑损毁评估。它允许非机器学习工程师的分析师仅使用灾后卫星图像生成逐栋建筑的损毁地图。平台提供了两种方法：一种是基于单场景标注训练小型语义分割模型；另一种是利用预训练视觉模型嵌入建筑轮廓，通过少量标注进行逻辑回归快速评分。

Details

Motivation: 解决大型灾害发生后，救援人员需要在几小时内获得建筑损毁地图的紧迫需求。现有模型通常依赖匹配的灾前灾后图像和类似事件的训练数据，而这些在新灾害发生初期通常无法获得。

Result: 在xBD基准上的初步实验表明，仅使用灾后图像，基于基础模型嵌入的方法在区分受损与完好建筑方面，与使用二十分之一标签的全监督ResNet-50基线模型性能相当。

Insight: 创新点在于开发了一个无需编码、快速部署的平台，支持两种轻量级方法（单场景训练和预训练嵌入+逻辑回归），实现了仅用灾后图像和少量标注进行高效评估。从客观角度看，将基础模型嵌入与逻辑回归结合在浏览器中快速推理，是应对数据稀缺紧急场景的实用创新。

Abstract: When a large disaster strikes, responders need a map of which buildings are damaged within hours. The models that do well on public benchmarks assume matched before-and-after imagery and a training set drawn from similar past events, and neither is usually available for a new disaster in its first day. We present HASTE (High-speed Assessment and Satellite Tracking for Emergencies), a no-code web platform that lets analysts who are not machine learning engineers produce per-building damage maps from post-disaster satellite imagery. HASTE implements two methods that share one interface. The first requires the user to label polygons over the post-disaster scene, trains a small semantic segmentation model on that single scene, runs it over the whole image, and joins the per-pixel output to existing building footprints. The second embeds every footprint with a pretrained vision model, requires the user to label a handful of buildings, and fits a logistic regression in the browser that scores the rest of the scene in seconds. We describe the platform, both methods, and the engineering that supports them. We also report preliminary experiments on xBD showing that foundation-model embeddings pooled over footprints separate damaged from intact buildings using post-disaster imagery alone, matching a fully supervised ResNet-50 baseline with a twentieth of its labels. HASTE and its predecessors have supported more than thirty real-world disaster responses since 2023, spanning earthquakes, hurricanes, cyclones, floods, wildfires, and tornadoes, delivering results to humanitarian partners within hours to days of imagery becoming available. We close with the directions we think are most promising, including vision-language assessment, active learning, and damage models for roads and other infrastructure. HASTE is open source at https://github.com/microsoft/haste.

[143] Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding cs.CVPDF

Kerui Chen, Jinglu Wang, Xiaoyi Zhang, Yan Lu

TL;DR: 本文针对体育视频理解中单视角的局限性，提出了首个多视角体育视频理解基准SportMV-Bench，并开发了SportMV-Agent智能体框架，通过主动视角选择、感知工具执行和基于证据的推理循环，显著提升了多视角信息利用能力。

Details

Motivation: 现有MLLMs在单视角视频理解基准上表现良好，但体育视频存在密集遮挡、快速运动和复杂交互，单视角难以解决；实践中体育赛事使用多摄像机角度记录，但缺乏评估MLLMs多视角理解能力的基准。

Result: 在构建的SportMV-Bench基准（包含787个多视角视频束和2592个QA对）上，当前MLLMs无法有效利用多视角信息；提出的SportMV-Agent框架相比最强MLLM基线实现了14.46%的相对性能提升。

Insight: 创新点包括：构建首个多视角体育视频理解基准，揭示了MLLMs在多视角任务中的瓶颈在于细粒度视觉感知和视角选择而非逻辑推理；提出智能体框架通过迭代循环主动整合多视角证据，为复杂场景理解提供了可借鉴的范式。

Abstract: Recent Multimodal Large Language Models (MLLMs) achieve strong performance on single-view video understanding benchmarks. However, sports videos involve dense occlusion, rapid motion, and complex interactions that are difficult to resolve from a single viewpoint. In practice, sports events are recorded from multiple camera angles, providing complementary evidence used by referees. Yet, no existing benchmark evaluates MLLMs on multi-view sports video understanding. To address this gap, we introduce SportMV-Bench, a comprehensive benchmark built from official match recordings, through a dedicated pipeline combining LLM-based generation, MLLM-based verification, and human filtering to ensure quality and consistency. SportMV-Bench containing 787 multi-view video bundles and 2592 question-answer pairs across three categories: Perception-Aware Recognition (PAR), Rule-aware Event Interpretation (REI), and Adjudicative Decision Reasoning(ADR). Our analysis shows that current MLLMs fail to effectively exploit multi-view information, with the bottlenecks lying in fine-grained visual perception and view selection rather than logical reasoning or domain knowledge. We propose SportMV-Agent, an agentic framework that orchestrates an iterative loop of active view selection, perception tool execution, and evidence-grounded reasoning, achieving a significant 14.46% relative improvement over the strongest MLLM baseline.

[144] Evidence-Backed Video Question Answering cs.CV | cs.AIPDF

Shijie Wang, Honglu Zhou, Ziyang Wang, Ran Xu, Caiming Xiong

TL;DR: 本文提出了一种名为证据支持视频问答（E-VQA）的新任务，要求模型在回答问题的同时，输出精确的时空证据，包括时间片段和密集、被跟踪的对象分割掩码。为此，作者引入了首个经过人工验证的像素级基准数据集ST-Evidence，并构建了一个大规模指令数据集ST-Evidence-Instruct。通过在后者上微调模型，显著提升了模型在可解释视频理解任务上的性能。

Details

Motivation: 当前视频大语言模型（Video LLMs）在问答任务上表现出色，但其运作如同黑箱，仅提供文本答案而缺乏可验证的视觉依据。现有的可解释性方法依赖于文本推理或稀疏的边界框，难以捕捉视频中复杂的动态变化，如遮挡和非刚性变形。

Result: 在提出的ST-Evidence基准上评估最先进的模型，揭示了问答准确性与真实视觉感知之间存在严重脱节，且仅靠扩大模型规模无法弥合这一差距。通过在160k规模的ST-Evidence-Instruct数据集上微调模型，相比同等规模的UniPixel基线模型取得了显著提升（例如，在7B模型上，t-mean指标提升+27.2，J&F指标提升+13.8），为可解释的视频理解建立了强大的基线。

Insight: 论文的核心创新在于将视频问答任务与精确的像素级时空证据生成相结合，提出了E-VQA任务和相应的评估基准。其关键洞察是，通过构建一个连接高层推理与细粒度视觉基础的大规模指令数据集，可以有效提升视频大语言模型的视觉感知和可解释性能力，而不仅仅是扩大模型规模。

Abstract: Current Video Large Language Models (Video LLMs) excel in question answering (QA) but largely operate as black boxes, providing textual answers without verifiable visual grounding. Existing explainability efforts rely on textual rationales or sparse bounding boxes, which struggle to capture complex video dynamics such as occlusions and non-rigid deformations. We propose Evidence-Backed Video Question Answering (E-VQA), a novel task requiring models to jointly output a semantic answer and precise spatio-temporal evidence: temporal segments and dense, tracked object segmentation masklets. To support this, we introduce ST-Evidence, the first human-verified benchmark for both discriminative and generative pixel-level grounding. Evaluations of state-of-the-art models reveal a critical decoupling between QA accuracy and true visual perception that scaling alone fails to bridge. To address this, we develop scalable, automated generation pipelines to create ST-Evidence-Instruct, a 160k-scale dataset bridging high-level reasoning with fine-grained grounding. Fine-tuning grounded Video LLMs on this data yields substantial gains over the corresponding size-matched UniPixel baselines (e.g., +27.2 t-mean and +13.8 J&F on a 7B model), establishing a robust baseline for explainable, evidence-backed video understanding. Code and data are available at https://github.com/SalesforceAIResearch/EVQA.

[145] Read It Back: Pretrained MLLMs Are Zero-Shot Reward Models for Text-to-Image Generation cs.CVPDF

Runhui Huang, Qihui Zhang, Zhe Liu, Yu Gao, Jie Wu

TL;DR: 本文提出了SpectraReward，一种无需训练的奖励函数，可将预训练的多模态大语言模型（MLLM）直接用作图像生成强化学习的现成奖励模型。其核心思想是通过单次图像条件化的教师强制前向传播，测量从生成图像中恢复原始提示词的能力，并将平均图像条件化提示词对数似然作为奖励。此外，论文还引入了Self-SpectraReward，在统一多模态模型中，利用策略自身的理解分支作为其生成分支的奖励模型，形成一个无需外部模型或知识的闭环自改进框架。

Details

Motivation: 旨在解决为文本到图像生成任务设计有效奖励模型的挑战，避免依赖人工偏好标签或对奖励模型进行微调，直接利用预训练MLLM的图文对齐能力。

Result: 在涵盖两种扩散模型、三种RL算法、九个来自四个MLLM家族（参数量从4B到235B）的奖励MLLM骨干网络以及五个分布外文本到图像基准的广泛实验中，SpectraReward和Self-SpectraReward均能显著且一致地提升生成性能，并优于先前的基于MLLM的奖励训练方法。分析表明，更大的奖励MLLM并不总是更好，而Self-SpectraReward可以匹配或超越更大的外部奖励模型。

Insight: 主要创新点在于提出了一种无需训练、基于图像条件化提示词恢复（即“回读”）的奖励机制，直接利用MLLM的预训练能力。一个关键的客观见解是，奖励模型与生成策略的对齐是图像生成强化学习有效性的关键因素，这通过Self-SpectraReward的闭环设计得以体现和验证。

Abstract: In this paper, we propose SpectraReward, a training-free reward function that turns pretrained MLLMs into off-the-shelf reward models for image-generation reinforcement learning. Instead of asking the MLLM to judge a generated image or answer decomposed verification questions, SpectraReward measures how well the original prompt can be recovered from the generated image through a single image-conditioned, teacher-forced forward pass. We use the average image-conditioned prompt log-likelihood as the reward, directly reusing the MLLM’s pretrained image-text alignment ability without preference labels, reward-model fine-tuning. We further introduce Self-SpectraReward, a special case for unified multimodal models where the policy’s own understanding branch serves as the reward model for its generation branch, forming a closed-loop self-improving framework without external reward models or external knowledge. Extensive experiments validate SpectraReward through a broad image-generation RL study covering two diffusion models, three RL algorithms, nine reward MLLM backbones from four MLLM families spanning 4B to 235B parameters, and five out-of-distribution text-to-image benchmarks. Results show that both SpectraReward and Self-SpectraReward significantly and consistently improve generation performance and outperform prior MLLM-derived reward training methods. Further analysis reveals that larger reward MLLMs are not always better, while Self-SpectraReward can match or surpass much larger external reward models, suggesting that reward-policy alignment is a key factor for effective image-generation RL. Project Page: https://huangrh99.github.io/SpectraReward/

cs.IR [Back]

[146] Tool-Adaptive LLM Reranker cs.IR | cs.AI | cs.CLPDF

Zichuan Liu, Ruijin Hua

TL;DR: 本文提出TALRanker，一个将逐点相关性评分形式化为智能体马尔可夫决策过程的新框架，以解决LLM重排序中因盲目调用外部搜索工具导致的效率与准确性困境。它通过两阶段训练优化，在保持高效的同时，利用工具自适应检索来减轻事实幻觉。

Details

Motivation: 生成式大语言模型在信息检索中存在严格参数化导致的严重事实幻觉问题，而重排序中为每个文档盲目调用搜索工具又会带来难以承受的延迟开销，形成了准确性-效率的困境。

Result: 在标准和推理密集型检索基准测试上的广泛评估表明，TALRanker实现了最先进的性能，其吞吐量与逐点重排序器相当，同时优于参数庞大的推理模型。

Insight: 核心创新在于将重排序任务形式化为一个智能体决策过程，并设计了包含语言保持混合损失预热和不对称成本感知奖励强化学习的两阶段训练范式，使模型能自主决策何时绕过工具（追求效率）或检索外部证据（避免严重幻觉）。

Abstract: Generative Large Language Models (LLMs) have revolutionized information retrieval, yet their strictly parametric nature frequently leads to severe factual hallucinations when confronted with complex queries beyond their epistemic boundaries. While external tool-calling can mitigate this, indiscriminately invoking search tools for every document during reranking incurs prohibitive latency overheads, creating an intractable accuracy-efficiency dilemma. To address this challenge, we propose TALRanker, a novel framework that formalizes pointwise relevance scoring as an agentic Markov decision process. We optimize it via a two-stage training paradigm. An initial warm-up utilizes a language-preserving hybrid loss to prevent the catastrophic forgetting of native generative capacities. Subsequently, an asymmetric cost-aware reward equipped in reinforcement learning forces the policy to autonomously bypass tools for maximum efficiency when confident, while selectively retrieving external evidence to avert severe hallucination penalties when uncertain. Extensive evaluations demonstrate that TALRanker achieves state-of-the-art performance across standard and reasoning-intensive retrieval benchmarks, matching throughput with pointwise rerankers while outperforming parameter-heavy reasoning models.

[147] Generative Chinese Statute Retrieval cs.IR | cs.CLPDF

Yiteng Tu, Zitao Su, Weihang Su, Xuanyi Chen, Yueyue Wu

TL;DR: 本文提出了GCSR，一个生成式法律条文检索框架，它将条文检索重新定义为序列生成问题，并将法律知识内化到生成模型中。该方法通过设计多粒度结构化文档标识符来编码法律层级和语义信息，并采用多任务训练策略。实验表明，GCSR在多个基准上持续优于稀疏、稠密及法律领域基线模型。

Details

Motivation: 解决现有方法难以弥合口语化法律查询与正式法律条文语言之间差距的问题，提升法律信息检索的效果。

Result: 在相关基准测试中，GCSR的表现一致优于强大的稀疏检索、稠密检索以及法律领域基线模型，展示了生成式检索在法律条文检索任务上的有效性。

Insight: 核心创新在于将法律条文检索重构为序列生成任务，并设计了融合法律层级结构的多粒度文档标识符，这为生成式模型在法律领域的应用提供了新思路，并可能推动更广泛的法律信息获取和下游法律推理任务的发展。

Abstract: Statute retrieval is a fundamental task in legal information retrieval, yet existing approaches struggle to bridge the gap between colloquial legal queries and formal statutory language. In this paper, we propose GCSR, a generative statute retrieval framework that reformulates statute retrieval as a sequence generation problem and internalizes statutory knowledge into a generative model. Specifically, we propose a multi-granularity structured docid that encodes legal hierarchy and semantic information, together with a multi-task training strategy. Experiments show that GCSR consistently outperforms strong sparse, dense, and legal-domain baselines. Our results demonstrate the effectiveness of generative retrieval for statute retrieval and highlight its potential for broader legal information access and downstream legal reasoning tasks.

eess.IV [Back]

[148] CHM-Net: Center Heatmap-driven Macro-Micro Modeling Network for MRI-based Microbial Density Stratification eess.IV | cs.CV | cs.LGPDF

Jiaming Liang, Haolin Chen, Tingting Li, Bowen Yu, Qianyan Long

TL;DR: 本文提出了一种名为CHM-Net的中心热图驱动的宏-微建模网络，用于基于多模态MRI的微生物密度分层任务。该网络通过中心热图引导的小病灶响应定位，建立影像表型与微生物状态的联系，并据此构建患者级别的宏-微证据进行预测。在GBNPC 2026数据集上的实验表明，CHM-Net优于现有基线方法，并在其他3D医学影像数据集上验证了其鲁棒性。

Details

Motivation: 微生物密度对肿瘤评估和治疗决策具有重要临床意义，而深度学习的最新进展表明，可以从多模态MRI中无创地推断微生物密度。本文首次将基于MRI的微生物密度分层作为一个患者级别的表征学习任务进行研究。

Result: 在专为MRI-MDS构建的新数据集GBNPC 2026上，CHM-Net取得了优于代表性基线的性能，与最强竞争结果相比，绝对准确率提升了12.06%。在另外两个3D医学影像数据集上的辅助验证进一步证明了其在体数据医学图像分类场景中的鲁棒性。

Insight: 论文的创新点在于将微生物密度分层任务形式化为患者级别的表征学习，并提出了中心热图驱动的宏-微建模框架。该方法通过热图引导的局部病灶响应定位来建立影像与微生物状态的关联，并整合局部信息形成患者级别的预测证据，为医学影像分析提供了一种新的建模思路。

Abstract: Microbial density is clinically important for tumor assessment and treatment decision-making, and recent advances in deep learning suggest that it can be non-invasively inferred from multimodal MRI. In this work, MRI-based Microbial Density Stratification (MRI-MDS) is first investigated as a patient-level representation learning task, and Center Heatmap-driven Macro-micro modeling Network (CHM-Net) is introduced for this task. CHM-Net first establishes the link between imaging phenotypes and microbial states through center heatmap-guided small-lesion response localization. Building upon this, it constructs patient-level macro-micro evidence from localized heatmap responses for microbial density prediction. Experiments on the novel GBNPC 2026 dataset constructed for MRI-MDS demonstrate the effectiveness of CHM-Net, achieving superior performance over representative baselines with a 12.06% absolute ACC gain over the strongest competing result. Additionally, auxiliary validation on two 3D medical image datasets further verifies its robustness across volumetric medical image classification scenarios. The project is available at https://anonymous.4open.science/r/CHM-Net-942E/.

[149] Differentiable Proxy Learning for Adaptive Quantization Control in H.264 Video Coding eess.IV | cs.CVPDF

Qihan Xu, Ivan V. Bajić

TL;DR: 本文提出了一种用于H.264帧内编码的可微分代理学习方法，以实现自适应量化控制。该方法基于一个可变速率学习压缩模型，通过软索引机制使代理相对于量化参数可微，并训练其近似H.264在全局和空间量化设置下的率失真行为。利用训练好的代理，作者开发了一个基于代理的自适应量化框架，用于感知优化和机器视觉任务。

Details

Motivation: 标准视频编解码器（如H.264）的不可微特性使得针对特定目标（如感知质量或机器视觉任务）优化量化参数等编码器参数具有挑战性。虽然最近已有研究使用可微分代理来支持基于梯度的优化，但这些代理对目标编解码器的保真度很少被明确表征。

Result: 实验结果表明，所提出的代理能紧密近似H.264帧内编解码器的率失真行为。基于此代理的自适应量化框架在固定量化参数的H.264基线模型上持续改善了率-任务权衡，在语义分割任务上实现了高达17.12%的BD-rate降低，在MS-SSIM指标上实现了15.30%的BD-rate降低。

Insight: 创新点在于提出了一种明确表征对目标编解码器（H.264）保真度的可微分代理学习方法，并通过软索引机制实现其可微性。这使得能够利用基于梯度的优化来有效控制量化参数，从而为感知质量和机器视觉任务自适应地优化视频编码，在保持与标准编解码器行为高度一致的同时，显著提升了编码效率。

Abstract: H.264 has been the most widely used video coding format for the past two decades due to its relative simplicity, efficiency, and wide availability of software and hardware implementations. However, optimizing codec parameters such as the quantization parameter (QP) for specific objectives (e.g., perceptual quality or machine vision tasks) is challenging due to the non-differentiable nature of standard video codecs. While differentiable proxies have recently been used to enable gradient-based optimization around standard codecs, their fidelity to the target codec is rarely explicitly characterized. In this paper, we propose a differentiable proxy learning method for H.264 intra codec to enable adaptive quantization control. Built upon a variable-rate learned compression model, the proposed proxy is made differentiable with respect to codec QP through a soft-indexing mechanism. It is then trained to approximate the rate-distortion behavior of H.264 under two quantization settings: global-QP, which uses one QP per image, and spatial-QP, which assigns QPs at the macroblock level. Using the frozen trained proxy, we develop a proxy-based adaptive quantization (AQ) framework for both perceptual optimization and machine vision tasks. Experimental results demonstrate that the proposed proxies closely approximate the rate-distortion behavior of H.264 intra codec. The resulting proxy-based AQ framework consistently improves rate-task trade-offs over fixed-QP H.264 baselines, achieving BD-rate reduction of up to 17.12% for semantic segmentation and 15.30% for MS-SSIM.

cs.RO [Back]

[150] TS-Mask VLA: 2D Temporal-Spatial Masking for Vision-Language-Action Model with Effective Bridging cs.RO | cs.AI | cs.CVPDF

Shengzhuo Yang, Ronghao Yu, Chuanjie Lv, Linpeng Peng, Hang Yu

TL;DR: 本文提出了TS-Mask VLA框架，用于机器人操作任务中的视觉-语言-动作建模。该框架的核心是引入了离散扩散动作专家与桥接注意力机制，以及一种针对离散动作令牌的时空二维掩码策略，旨在更准确地生成结构一致的动作序列。

Details

Motivation: 现有基于自回归令牌预测的VLA模型将动作生成简化为下一个令牌预测，缺乏对动作序列时空结构的显式建模，且视觉-语言表示与动作之间的解耦不足，这限制了模型在长视野和复杂场景下的性能。

Result: 在LIBERO仿真基准测试中，TS-Mask VLA仅用0.5B参数就达到了95.7%的平均成功率，显著优于参数量更大的模型。在CALVIN基准测试中，它取得了4.19的最佳平均序列长度，并展现出强大的长视野任务性能。

Insight: 创新点在于通过离散扩散模型与桥接注意力机制实现从VLM的多层条件化，以及通过时空二维掩码策略增强模型对跨时间依赖和维度间耦合的理解，从而生成更结构一致的动作序列，这为解耦表示和结构化动作生成提供了新思路。

Abstract: Vision-language-action (VLA) models aim to understand natural-language instructions and visual observations, and to generate and execute corresponding actions as embodied agents. Recently, autoregressive token-based action generation has driven the development of many representative VLA models. However, this paradigm often reduces action generation to next-token prediction, thereby lacking explicit modeling of the spatiotemporal structure of action sequences and the disentanglement between vision-language representations and actions, which can limit performance in long-horizon and complex scenarios. In this paper, we propose TS-Mask VLA, a vision-language-action framework for robot manipulation. TS-Mask VLA is built upon two key designs: (1) a Discrete Diffusion Action Expert equipped with a Bridge Attention conditioning bridge, which enables multi-layer conditioning from the VLM and facilitates more accurate and stable action generation; and (2) a temporal-spatial 2D masking strategy for discrete action tokens that strengthens the model’s understanding of cross-time dependencies and inter-dimensional coupling, leading to more structurally consistent action sequences. We conduct extensive experiments on simulation benchmarks and real-world tasks. On LIBERO, TS-Mask VLA achieves a 95.7 percent average success rate with only 0.5B parameters, outperforming significantly larger models. On CALVIN, it attains the best average sequence length of 4.19 and strong long-horizon performance. Comprehensive analyses and ablations further validate the effectiveness of our design.

[151] PrismAD: Decoupled Planning via Semantic Mixture-of-Planners for End-to-End Autonomous Driving cs.RO | cs.CVPDF

Kang Ding, Zhigui Lin, Hongsong Wang, Jie Gui, Qi Liu

TL;DR: PrismAD提出了一种基于语义混合规划器的解耦端到端自动驾驶框架，通过将场景token划分为交互、几何和意图三组，并分配给独立的规划专家，每个专家学习专门的运动规划表示，再通过语义感知路由器自适应聚合专家预测。

Details

Motivation: 现有规划器通常将异构场景token聚合到耦合表示空间，迫使单个规划分支联合建模智能体交互、道路几何和驾驶意图，这种耦合可能削弱特定因素的推理并模糊不同规划线索的贡献。

Result: 在nuScenes开环数据集和NeuroNCAP闭环基准测试上的广泛实验表明，PrismAD表现出有竞争力的性能。

Insight: 创新点在于通过语义分组和解耦规划专家来增强特定因素的推理，并引入带噪声门控的稀疏top-K激活以提高路由鲁棒性和减少不必要的专家计算。

Abstract: This letter presents PrismAD, a decoupled end-to-end autonomous driving framework based on a Semantic Mixture-of-Planners. Existing planners usually aggregate heterogeneous scene tokens into a coupled representation space, forcing a single planning branch to jointly model agent interaction, road geometry, and driving intention. Such coupling may weaken factor-specific reasoning and obscure the contribution of different planning cues. To address this limitation, PrismAD partitions scene tokens into interaction, geometry, and intent groups, and assigns them to independent planning experts with the same architecture but separate parameters. Each expert learns a specialized motion-planning representation, while a semantics-aware router adaptively aggregates expert predictions with separate routing weights for motion prediction and ego planning. Sparse top-$K$ activation with noisy gating is further introduced to improve routing robustness and reduce unnecessary expert computation. Extensive experiments on the nuScenes open-loop dataset and NeuroNCAP closed-loop benchmark demonstrate that PrismAD exhibits competitive performance. Our code will be released soon.

[152] Action Map Policy: Learning 3D Closed-loop Manipulation via Pixel Classification cs.RO | cs.AI | cs.CV | cs.LGPDF

Haojie Huang, Zhang Ye, Linfeng Zhao, Boce Hu, Mingxi Jia

TL;DR: 本文提出了一种名为动作映射策略（AMP）的新方法，将3D闭环操作策略学习转化为图像空间中的分类问题。通过将3D动作投影到相机图像平面上，并将每个像素位置视为离散类别，该方法在控制维度的同时保留了动作的多模态特性。实验表明，AMP在多种操作任务上优于现有基线，实现了更高的成功率、更快的推理速度以及更强的空间推理能力。

Details

Motivation: 机器人学习中的动作空间面临高维、长时程和多模态最优解等主要挑战，现有的动作表示和损失函数选择往往存在权衡。本文旨在通过将策略学习重新表述为分类问题，以解决这些挑战。

Result: 在多种操作任务上的实验表明，AMP超越了强大的基线方法，获得了更高的成功率，并且推理速度显著快于扩散策略，实现了更快的单次前向预测。

Insight: 核心创新点在于将3D连续动作投影到2D图像平面并进行像素级分类，这避免了高维动作离散化导致的词汇爆炸问题，同时支持毫米级精度并保留了细粒度的视觉信号。这种方法借鉴了生成语言模型中分类的有效性，并将其成功应用于机器人动作学习。

Abstract: The action space poses a major challenge in robot learning, since it is often high-dimensional, can span long time horizons, and frequently admits multi-modal optimal solutions. A good choice of action representation and loss function can help to address these concerns, but there are often trade offs. We propose Action Map Policy (AMP), which casts 3D closed-loop manipulation policy learning as a classification problem in image space. While classification has been an effective formulation in generative language models, applying it to robot action learning is difficult because naively discretizing high-dimensional continuous actions explodes the token vocabulary. Our key idea is to project 3D actions onto the camera image planes and treat each pixel location as a discrete class, thus controlling dimensionality while retaining multi-modality. This method supports millimeter-level precision for high-dimensional actions without requiring a prohibitively large vocabulary, while preserving fine-grained pixel-wise visual signals. Furthermore, it can predict the entire action chunk in a single forward pass, avoiding complex noise scheduling and iterative denoising while achieving substantially faster inference than diffusion policies. Experiments on various manipulation tasks show that AMP outperforms strong baselines, achieving higher success rates, faster inference, and enhanced spatial reasoning.

[153] 3D Scene Graph Prediction: Generating Hierarchical Models from Partially Observed Environments cs.RO | cs.CVPDF

Siyi H, Jared Strade, Hyungtae Lim, Luca Carlone

TL;DR: 本文提出了一种自上而下的分层3D场景图预测框架，用于根据机器人部分观测的环境来生成未探索区域的完整层次化模型。该框架包含房间层（预测平面布局和可通行性）和物体层（预测房间内物体布局），并通过混合域图扩散模型支持对不完整平面布局等部分约束的预测。

Details

Motivation: 现有方法多关注单房间内的物体布局生成，而高层场景结构（如房间级布局和可通行性）对于机器人应用至关重要但研究不足。本文旨在解决机器人在部分探索环境后，需要预测未探索区域以支持下游任务（如探索或物体搜索）的问题。

Result: 在标准基准测试中，与基于占用率的和基于LLM的平面图生成方法相比，本文方法在分布外部分平面图上泛化能力显著优于基于占用率的学习基线。方法还在机器人采集的真实世界场景数据上展示了集成的预测能力。

Insight: 创新点在于提出了一个联合预测房间类别、边界和可通行性的混合域图扩散模型，它通过数据损坏和掩码技术支持部分约束，无需部分观测的训练数据。同时，将房间层与物体层扩散模型集成，实现了从部分观测到完整层次化3D场景图的端到端预测。

Abstract: Generating realistic 3D indoor scenes is an area of growing interest in computer vision and robotics. Existing methods, often motivated by applications such as interior design, generally focus on object layout generation within a single room. The generation of high-level scene structure, such as room-level layout and traversability, remains underexplored despite its importance for robotics applications. In this paper, we consider the case where a robot has explored part of an environment and needs to predict the unexplored parts to support downstream tasks such as exploration or object search. We propose a top-down framework for synthesizing hierarchical 3D scene graphs, including a room layer – describing the floor plan and traversability – and an object layer modeling object layouts within each room. For the room layer, we propose a novel mixed-domain graph diffusion model jointly predicting room categories, floor boundaries, and traversability between rooms. Via corruption and masking, this model supports partial constraints such as incomplete floor plans, avoiding the need for partially observed training data. For the object layer, we integrate an existing mixed discrete-continuous diffusion model for joint prediction of object categories, locations, sizes, and orientations within each room given the floor plan. We compare our method with state-of-the-art occupancy-based and LLM-based floor plan generation methods on a standard benchmark. Compared with an occupancy-based learning baseline, our method generalizes substantially better to out-of-distribution partial floor plans. We also demonstrate our integrated prediction pipeline on real-world scenes from robot-collected data, enabling prediction beyond explored areas.

[154] NeuralActuator: Neural Actuation Modeling for Robot Dynamics and External Force Perception cs.RO | cs.CV | cs.GR | cs.LGPDF

Zhiyang Dou, John U. Onyemelukwe, Hangxing Zhang, Heng Zhang, Minghao Guo

TL;DR: 本文提出NeuralActuator，一种用于机器人动力学建模和外部力感知的神经执行器模型。该模型联合预测了用于低成本伺服平台轨迹传播的仿真器等效广义力替代项、用于无传感器力感知的带接触概率门的外部力，以及受监督关节的电机状态评分。作者还引入了通过双臂遥操作系统收集的神经执行器数据集（NAD），并利用Transformer捕获时间依赖性以支持实时推理。

Details

Motivation: 可微分仿真器虽推动了策略学习和基于模型的控制，但执行器动力学仍是仿真到现实误差的重要来源，尤其是在低成本平台上，由于摩擦、迟滞、回差和热效应，线性电流-扭矩关系在指令目标跟踪时变得不可靠。

Result: 模型在5-DoF OpenManipulator-X、6-DoF SO-101和7-DoF Franka Emika Panda三种不同执行器家族和成本（约500美元至超过3万美元）的平台上进行了评估。在低成本平台上支持动力学和力评估，而在离线Franka实验中提供了额外的有效载荷力估计基准。实验还展示了其在OpenManipulator-X上的电机状态估计应用，以及当NeuralActuator用作预训练模块时，改进了行为克隆性能。

Insight: 创新点在于提出了一个统一的神经执行器模型，能够联合预测广义力替代项、外部力（带接触概率门）和电机状态评分，并利用可微分仿真在没有直接广义力标签的情况下训练扭矩替代头。同时，引入了一个包含机器人状态、执行器遥测和外部力标签的数据集NAD，并使用Transformer处理时间依赖性以实现实时推理。

Abstract: Differentiable simulators have advanced policy learning and model-based control, yet actuator dynamics remain an important source of sim-to-real error. This is particularly acute on low-cost platforms, where the linear current-to-torque relation $τ= K_tI$ becomes unreliable during commanded-target tracking because of friction, hysteresis, backlash, and thermal effects. We present NeuralActuator, a neural actuator model that jointly predicts (i) a simulator-equivalent generalized-effort surrogate for trajectory propagation on low-cost servo platforms, (ii) external force with a contact-probability gate for sensorless force perception, and (iii) a motor-condition score for the supervised joint. We also introduce the Neural Actuation Dataset (NAD), collected with a twin-arm teleoperation system that records robot states and actuator telemetry together with external-force labels. The torque-surrogate head is trained through differentiable simulation from pose trajectories without direct generalized-effort labels, while the force, gate, and motor-condition heads receive direct supervision. A Transformer captures temporal dependencies while supporting real-time inference. We evaluate NeuralActuator on a 5-DoF OpenManipulator-X, a 6-DoF SO-101, and a 7-DoF Franka Emika Panda, spanning three actuator families and platforms costing approximately USD 500 to over USD 30,000. The low-cost platforms support dynamics and force evaluation, while the offline Franka experiment provides an additional payload-force-estimation benchmark. Experiments further demonstrate its application for motor condition estimation on OpenManipulator-X and improved behavior-cloning performance when NeuralActuator is used as a pretrained module.

Ali Ahmadi, Hamed Rahimi, Adrien Jacquet Cretides, Marie Samson, Mahdi Khoramshahi

TL;DR: 本文提出了一种名为HUMA的混合架构，用于社交机器人导航，该架构结合了强化学习（RL）策略的快速推理能力和视觉语言模型（VLM）的深度语义理解能力。它通过条件触发机制，在常规场景使用RL策略，而在人类进入敏感区域（如机器人邻近区）时调用VLM进行高级语义推理，以优化社交行为。

Details

Motivation: 为了解决RL导航策略缺乏灵活语义推理能力、难以泛化到复杂社交场景的问题，以及VLM方法计算成本高、推理速度慢、难以实时部署的局限性，旨在实现高效且具备深度社交理解的机器人导航。

Result: 在Social-MP3D和Social-HM3D基准测试上，HUMA分别实现了20%和3%的任务成功率提升，并显著减少了个人空间侵犯和人类碰撞，性能优于最先进的基线方法。

Insight: 核心创新点在于提出了一个条件触发的混合架构，动态平衡了RL的效率与VLM的语义能力；从客观角度看，其将VLM作为“按需”推理模块而非全程使用的设计，是一种在计算资源与性能间进行有效权衡的实用创新。

Abstract: As mobile robots become more integrated into everyday human environments, social robot navigation is becoming essential for ensuring human comfort, safety, and trust. While reinforcement learning (RL) navigation policies provide the fast inference and reactive behavior necessary for real-time deployment, they still lack flexible semantic reasoning capabilities and often fail to generalize to complex social scenarios. Recent approaches have increasingly turned to vision-language models (VLMs) in place of RL policies to improve semantic and social reasoning in robot navigation. Nevertheless, their high computational cost and slow inference remain major barriers to real-time deployment. To overcome these limitations, we introduce HUMA (Hybrid Understanding for Multi-modal social Navigation), a hybrid architecture that dynamically balances the computational efficiency of RL policies with the deep semantic understanding of VLMs. Our approach uses a reactive RL policy to handle low-density, routine navigation tasks, while conditioning it on a post-trained high-level VLM when a human enters sensitive situations, such as the robot’s proximity zone. We evaluate HUMA on the Social-MP3D and Social-HM3D benchmarks, where it achieves task success improvements of 20% and 3%, respectively, while significantly reducing personal space violations and human collisions against state-of-the-art baselines. Extensive ablation studies validate each architectural component, and real-world deployment on the Mirokaï mobile robot further demonstrates the practical viability of our approach.

eess.AS [Back]

[156] Hearing Like Humans? Sound Symbolism and Perceptual Alignment in Speech Language Models eess.AS | cs.CLPDF

Yun-Shao Tsai, Chun-Wei Chen, Chee-En Yu, Yi-Cheng Lin, Hung-yi Lee

TL;DR: 本文研究了语音语言模型是否像人类一样具有声音象征性，即能否将语音声音映射到感知特性（如圆润或尖锐）。通过使用真实人类语音录音，比较模型与人类在听觉、跨模态和视觉方面的判断，发现SLMs的听觉判断与人类感知一致性差，且未能捕捉驱动人类直觉的声学线索（如频谱倾斜）。

Details

Motivation: 动机是探究语音语言模型是否具有类似人类的声音象征性倾向，即能否基于语音声学（而非拼写）将声音与感知特性关联，此前评估多依赖文本或图像而非真实语音。

Result: 在真实语音录音的评估中，SLMs的听觉判断与人类数据对齐不佳，未能可靠地将听到的声音与对应形状关联，且开放权重模型无法有效捕捉人类依赖的声学线索。

Insight: 创新点在于首次使用真实语音评估SLMs的声音象征性，揭示了模型在语音表示上的局限性，表明感知对齐的关键在于捕捉人类听觉线索的语音表示，而非更强的视觉能力。

Abstract: Sound symbolism, the human tendency to map speech sounds to perceptual qualities such as roundness or sharpness, arises primarily from the acoustics of speech rather than spelling. Whether Speech Language Models (SLMs) share this tendency remains open, as prior evaluations rely on text or images rather than real speech. We study it using genuine human speech recordings, comparing model judgments against human data across the auditory, crossmodal, and visual components of the effect. We find that SLMs’ auditory judgments align poorly with human perception and miss the acoustic cues, such as spectral tilt, that drive human intuitions, and open-weight models cannot reliably link a heard sound to its corresponding shape. With a visual-only control ruling out shape perception, the weakness localizes to how speech is represented, suggesting that perceptual alignment depends not on stronger vision but on speech representations that capture the cues humans hear.

[157] GigaChat Audio: Time-aware Large Audio Language Model eess.AS | cs.CLPDF

Aleksandr Kutsakov, Mariia Sadovina, Georgii Gospodinov, Alexandr Maximenko, Oleg Kutuzov

TL;DR: 本文介绍了GigaChat Audio，一种时间感知的大型音频语言模型，旨在解决长录音中时间定位的挑战。该模型通过在连续音频标记中插入周期性时间标记，并利用大规模合成监督进行训练，能够处理长达120分钟的音频输入，并回答带有明确时间戳的问题。

Details

Motivation: 当前音频条件化大语言模型在长录音的时间定位方面仍面临挑战，本文旨在开发一种能够精确回答带时间戳问题的时间感知音频LLM。

Result: 模型在短时和长时基准测试中均取得了强时间定位准确性，支持时间锚定的片段描述和摘要生成，并在Hugging Face上开源了模型权重和数据集。

Insight: 创新点在于将周期性时间标记与连续音频标记交错融合的设计，以及使用级联流水线生成的大规模合成数据进行监督训练；客观分析认为，其时间表示、标记频率、分词和时长混合设计对精度和计算成本的权衡研究具有借鉴意义。

Abstract: Temporal grounding in long recordings remains challenging for audio-conditioned LLMs. We present a time-aware audio LLM that answers questions with explicit timestamps over up to 120 minutes of input. Our approach interleaves periodic time markers with continuous audio tokens using large-scale synthetic supervision from a cascaded pipeline. Our model achieves strong temporal-grounding accuracy on short and long benchmarks and supports time-anchored fragment descriptions and summaries. Extensive ablations examine how time representation, marker frequency, tokenization, and duration-mixture design affect accuracy and computational cost. We release model weights and datasets to support further research on time-aware audio understanding, available at https://huggingface.co/ai-sage/GigaChat3.1-Audio-10B-A1.8B.

cs.CR [Back]

[158] A Survey on LLM Watermarking: Theory and Deployment cs.CR | cs.CLPDF

Huy Phan, Kieu Dang, Ojaswi Dulal, Aiham AL Shukairi, Abby Shine

TL;DR: 本文是一篇关于大语言模型水印技术的系统性综述，重点从理论和部署角度梳理了该领域。文章首先指出LLM水印作为一种嵌入不可见签名以解决来源模糊、模型滥用和内容洗钱风险的技术，其文献增长迅速但分类混乱。为此，本文从实践者必须回答的核心问题出发，系统性地组织水印技术空间，包括嵌入位置、检测权限、前提假设和威胁模型。

Details

Motivation: 大语言模型被广泛部署于高影响力工作流中，但其大规模生成流畅文本的能力加剧了来源模糊、模型滥用和大规模内容洗钱的风险。现有水印文献增长迅速但分类混乱，混合了正交的设计选择，使得方法比较、保证推理以及研究成果向可部署系统转化变得困难。

Result: 本文是一篇综述性论文，未提出具体的新方法或报告定量实验结果，而是系统性地梳理和分析了现有水印技术家族（如采样偏置、基于编码的方案、基于表示和训练的方法）及其在可检测性、鲁棒性和分布偏移方面的安全-效用权衡。

Insight: 本文的创新之处在于提供了一个以部署为导向的系统性综述框架，通过核心实践问题（如嵌入位置、检测权限、假设和威胁模型）来组织技术空间，并分析了不同技术家族的安全-效用权衡。此外，文章还综述了攻击与规避策略、评估协议与指标，并针对实际运营需求提供了水印方案选择指南，指出了未来可靠、可问责LLM部署所需的研究方向。

Abstract: Large language models (LLMs) are increasingly embedded in high-impact workflows, yet their ability to generate fluent text at scale has amplified risks of provenance ambiguity, model misuse, and large-scale content laundering. LLM watermarking, embedding invisible signatures into model outputs, has emerged as a promising technical layer for attribution, auditing, and downstream trust decisions. However, the literature has grown rapidly and unevenly: existing categorizations often mix orthogonal design choices, making it difficult to compare methods, reason about guarantees, or translate research results into deployable systems. This survey provides a systematic, deployment-oriented review of LLM watermarking. We organize the space by the core questions practitioners must answer: where a watermark is embedded (generation-time vs. training-time, token vs. representation), who can detect it (public vs. private detection authority), what is assumed (access to logits, sampling control, secret keys, model ownership), and which threat models are targeted (paraphrasing, translation, summarization, style transfer, token manipulation, and adaptive removal). We synthesize the main families of techniques-including sampling biasing, code-based schemes, representation- and training-based approaches-and analyze their security-utility trade-offs through the lens of detectability, robustness, and distribution shift. We further review attack and evasion strategies, evaluation protocols and metrics (false positive control, calibration, robustness curves), and open challenges such as cross-model transfer, multi-modal pipelines, collusion, and governance constraints. Finally, we provide practical guidance for selecting watermark designs under real operational requirements and identify research directions needed for reliable, accountable LLM deployment.

cs.LG [Back]

Ingrid Petrova, Luan Vejsiu

TL;DR: 本文提出了SPARC理论，从谱代数角度解释了自回归生成模型中的自我修正盲点现象，即模型能修正外部来源的相同错误却无法修正自身输出中的错误。该理论通过定义误差传播算子并分析其谱半径，证明了盲点产生的充要条件，推导了修正标记的激活阈值，并分析了基于强化学习的验证器-修正器训练的收敛性。

Details

Motivation: 现有研究虽通过实验观察到自回归语言模型存在自我修正盲点，但缺乏解释该现象为何发生的正式模型、修正标记的定量激活条件以及基于强化学习的自我修正训练的收敛性保证。

Result: 在四个骨干模型和一个视觉自回归探针上的实验验证了所有定理，谱预测与实测盲点率之间的均方根误差在3.2%以内，并复现了简单’Wait’标记带来89.3%盲点减少的现象。

Insight: 创新点在于首次从谱代数理论角度形式化建模了自回归生成中的自我修正盲点，将误差传播算子的谱半径与盲点产生联系起来，并推导出普适的激活阈值和收敛条件，统一了文本LLM与自回归图像/视频生成模型的分析框架。

Abstract: Large autoregressive language models exhibit a self-correction blind spot: they reliably fix identical errors when attributed to an external source yet fail to fix the same errors in their own outputs. Prior work has documented this phenomenon empirically, through controlled error injection, error-depth decompositions, RL-based verifier-corrector training, and intrinsic self-verification, but offers no formal model of why generating a token suppresses the ability to detect its error, no quantitative activation condition for correction markers, and no convergence guarantee for reinforcement-learning-based self-correction. We close these gaps with SPARC, a spectral-algebraic theory of self-correction in autoregressive generation. We define the error-propagation operator as the product of per-step attention Jacobians on the residual stream and prove that the blind spot arises if and only if the spectral radius of this operator is at least one. We derive a sharp activation threshold, given as a function of the spectral radius, that a correction marker must exceed, recovering the 89.3% blind-spot reduction observed with a simple ``Wait’’ marker. We further prove that RL-based verifier-corrector training converges at a rate proportional to the squared coupling strength over the square root of the number of samples if and only if the verifier-corrector coupling matrix has spectral norm below one, and that this criterion is invariant across residual-stream autoregressive modalities, unifying text LLMs and autoregressive image and video generation. Experiments across four backbones and a visual autoregressive probe validate every theorem, with spectral predictions matching measured blind-spot rates within 3.2% RMSE.

[160] From Direction to Magnitude: How Multimodal Instruction-Tuning Reorganizes the Geometric Encoding of Identity-Specifying Prompts in Transformer Hidden States cs.LG | cs.CLPDF

Jorge A. Castillo, Marco Torres Yévenes, Juan Carlos Lanas

TL;DR: 本文研究了身份指定系统提示在不同后训练机制（无训练、多模态RLHF、RL蒸馏和SFT）的四种开放权重Transformer语言模型的隐藏状态轨迹中是否产生统计可区分的几何指纹。通过比较三种提示条件（身份指定轴提示、长度匹配的通用助手提示和26个token的基线），并使用五种几何度量（主要是k-NN轨迹图上边向Ollivier-Ricci曲率分布的1-Wasserstein距离）进行分析。核心发现是指令调优边界上身份编码的定性重组：在基础模型中指纹是方向编码的，而在多模态指令调优模型中迁移到幅度编码，这种重组是多模态指令调优特有的。

Details

Motivation: 探究身份指定系统提示在Transformer隐藏状态轨迹中是否产生可区分的几何指纹，并比较不同后训练机制（特别是多模态指令调优）如何影响这种编码方式。

Result: 在基础模型中，身份指纹是方向编码的（角k-NN下分离度为0.034，p=0.002）；在多模态指令调优模型中，编码迁移到幅度（角分离崩溃至p=0.439，而欧几里得分离在p=0.042下存活，且第一个生成状态的平均范数反转了长度排序）。这种方向到幅度的重组是多模态指令调优特有的，在RL蒸馏和SFT中未出现。教师强制控制将约30%的自由运行余弦信号归因于提示驱动效应。

Insight: 提出了使用k-NN轨迹图上边向Ollivier-Ricci曲率分布的1-Wasserstein距离作为分析方法；揭示了多模态指令调优会导致身份编码从方向性重组为幅度性，这为理解指令调优如何改变模型内部表示提供了新视角。

Abstract: We investigate whether identity-specifying system prompts produce statistically distinguishable geometric fingerprints in the hidden-state trajectories of four open-weight transformer language models spanning four post-training regimes: no training (Gemma-4-E4B base), multimodal RLHF (Gemma-4-E4B-it), RL distillation (DeepSeek-R1-Distill-Qwen-7B), and SFT (Qwen2.5-7B-Instruct). Three prompt conditions (an identity-specifying axis prompt, a length-matched generic-assistant prompt, and a 26-token vanilla baseline) are compared via five geometric metrics, principally the 1-Wasserstein distance between edge-wise distributions of Ollivier-Ricci curvature on k-NN trajectory graphs. Claims rest on trajectory-level permutation tests with multiple geometric controls (teacher-forced content controls, temporal-chain vs k-NN topology, ABT-projected k-NN, angular vs Euclidean graph construction, B=5000 permutations on borderline statistics). The central finding is a qualitative reorganization of identity encoding across the instruction-tuning boundary: in the base model the fingerprint is direction-coded (separation 0.034, p=0.002 under angular k-NN); in the multimodal instruction-tuned model it migrates into the magnitude (angular separation collapses to p=0.439 while Euclidean survives at p=0.042, and the mean norm of the first generated state inverts its length-ordering, being lowest for the identity prompt). This direction-to-magnitude reorganization is specific to the multimodal instruction-tuning regime, absent under RL distillation and SFT. A teacher-forced control attributes ~30% of the free-running cosine signal to prompt-driven effects. We position W_1 on edge-wise Ollivier-Ricci distributions on k-NN trajectory graphs as a methodological contribution of independent interest.

[161] ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples cs.LG | cs.AI | cs.CLPDF

Kexin Huang, Junkang Wu, Jinda Lu, Shuo Yang, Chiyu Ma

TL;DR: 本文提出了ARMOR框架，旨在解决大型语言模型（LLM）强化学习训练中的不稳定性问题，特别是过优化现象。该方法通过引入离策略的锚点样本和混合优化，主动稳定训练过程，防止模型为追求训练启发式指标而牺牲泛化推理能力。

Details

Motivation: 动机是解决LLM强化学习训练中因过优化导致的脆弱性和不稳定性问题，即模型过度利用训练启发式方法而损害了可泛化的推理能力。标准方法（如反向KL正则化）在此场景下覆盖不足，效果有限。

Result: 在多个推理基准测试上的广泛实验验证了ARMOR能有效缓解验证集性能崩溃，使得模型在长时间训练中能持续提升性能。

Insight: 创新点在于将稳定化范式从被动惩罚转向主动样本稳定，具体通过锚点采样（利用参考策略的离策略数据保持已有解决方案模式）和混合优化（重构策略目标以实现可控探索，无需依赖辅助损失）两个核心组件实现。

Abstract: Reinforcement learning (RL) has significantly enhanced the reasoning capabilities of large language models (LLMs), yet the training process remains notoriously fragile. In this work, we investigate a critical source of this instability: over-optimization, where models exploit training heuristics at the expense of generalizable reasoning. While reverse KL regularization is the standard defense against such degradation, our analysis reveals that it is often insufficient in this regime, as it fails to ensure comprehensive coverage of the reference distribution. To address this, we propose ARMOR (Anchor Rollout and Mixed Optimization for RL), a framework that shifts the paradigm from passive penalty to active sample stabilization. ARMOR comprises two key components: (1) Anchor Rollout, which leverages off-policy data from the reference policy to preserve established solution patterns; and (2) Mixed Optimization, which reformulates the policy objective to enable controlled exploration without relying on auxiliary losses. Extensive experiments on reasoning benchmarks validate that ARMOR effectively mitigates validation collapse, enabling sustained performance improvements over extended training horizons.

[162] To Answer or to Abstain: Mitigating Search-Agent Hallucinations via Abstention-Aware Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Fengji Zhang, Tianyu Fan, Yuxiang Zheng, Xinyao Niu, Chengen Huang

TL;DR: 这篇论文提出了一种名为‘Abstention-Aware Reinforcement Learning (AWA-RL)’的新方法，用于缓解配备搜索工具的大型语言模型在开放域问答任务中因检索失败而产生的幻觉问题。该方法通过动态调整弃权奖励，结合模型特定查询的先验能力和持续的策略训练观察，以在能力和可靠性之间取得平衡。

Details

Motivation: 当前基于结果奖励的强化学习训练范式主要奖励正确答案，但在检索失败时未能有效惩罚模型捏造的答案，这隐含地加剧了幻觉问题。论文旨在解决这一关键漏洞，提升搜索代理的可靠性。

Result: 在开放域QA任务上，与非弃权基线相比，AWA-RL将绝对精度提升了高达10.3%，并将新提出的RA-F1指标（衡量能力-可靠性权衡）整体提升了2.9%，仅在原始准确率上有轻微牺牲，实现了新的SOTA结果。

Insight: 论文的核心创新点是引入了弃权感知的强化学习框架，动态塑造弃权奖励，并提出了RA-F1这一新指标来量化能力与可靠性的权衡。从客观角度看，该方法通过明确建模和奖励‘不知道’的行为，为减少AI幻觉提供了一种可借鉴的系统性训练策略。

Abstract: Recent advances in equipping Large Language Models (LLMs) with search tools and outcome-reward reinforcement learning (RL) have achieved new state-of-the-art results on open-domain QA tasks. However, we argue that current training paradigms harbor a critical vulnerability: they predominantly reward correct answers but fail to penalize fabricated ones when retrieval fails, thereby implicitly exacerbating hallucinations. To address this, we propose Abstention-Aware Reinforcement Learning (AWA-RL), which dynamically shapes the abstention reward utilizing the model’s query-specific prior capabilities and continuous on-policy training observations. We also introduce a novel metric, RA-F1, to measure the capability-reliability trade-off. Compared to non-abstaining baselines, AWA-RL boosts absolute precision by up to 10.3% and overall RA-F1 by 2.9%, with only marginal sacrifice in raw accuracy. These results confirm that AWA-RL successfully yields highly capable and reliable search agents. The code, data, and model weights are publicly available at https://github.com/zfj1998/AWA-RL.

[163] Domain-Aware Scaling Laws Uncover Data Synergy cs.LG | cs.CLPDF

Kimia Hamidieh, Lester Mackey, David Alvarez-Melis

TL;DR: 本文提出了一种领域感知的缩放定律框架，用于形式化和量化语言模型预训练中的数据协同效应。该框架通过分析不同预训练数据组合对模型性能的影响，揭示了领域间直接和二阶协同作用，从而能够预测最优数据混合策略。

Details

Motivation: 当前机器学习进展主要关注模型规模和数据集大小的扩展，但数据组成同样关键；不同领域数据混合会产生非平凡的交互作用（协同或干扰），现有领域无关的缩放定律无法准确预测这些效应。

Result: 该框架相比领域无关缩放定律提高了预测准确性，并获得了稳定的协同效应估计；通过在预测最优和反最优数据混合上训练模型进行验证，确认其协同估计能正确预测性能排序。

Insight: 创新点在于将数据协同效应形式化为直接领域-基准协同和二阶领域-领域协同，并建立了可量化的评估框架；这为理解多领域数据交互和优化预训练数据组合提供了新视角。

Abstract: Machine learning progress is often attributed to scaling model size and dataset volume, yet the composition of data can be just as consequential. Empirical findings repeatedly show that combining datasets from different domains yields nontrivial interactions. For instance, adding code improves mathematical reasoning, while certain mixtures introduce interference that reduces model performance. We refer to these effects collectively as data synergy, where the contribution of multiple domains exceeds or falls short of the sum of their isolated contributions. In this work, we formalize and quantify data synergy in language model pretraining. Leveraging observational variation across open-weight LLMs with diverse pretraining mixtures, we estimate both direct domain-to-benchmark synergy (how one domain contributes to performance on another) and a second-order domain-domain synergy (capabilities that require co-occurrence of multiple domains). Our framework improves predictive accuracy over domain-agnostic scaling laws and recovers stable synergy estimates. We validate these estimates by training models on predicted optimal and predicted anti-optimal mixtures and confirm that our synergy estimates correctly predict performance rankings.

[164] SCOPE-RL: Optimizing Reasoning Paths Before and After Success cs.LG | cs.CLPDF

Xiaojian Liu, Han Xu, Jianqiang Xia, Zhixuan Li, Ke Xu

TL;DR: 本文提出了SCOPE-RL框架，用于优化基于可验证奖励的强化学习（RLVR）中稀疏奖励信号的问题。该框架分为两个阶段：在成功前，通过自适应脚手架RL为隐藏答案的子问题链添加可验证奖励；在成功后，通过质量感知过程RL对正确的推理轨迹施加过程形状奖励，以提升推理路径的质量和效率。

Details

Motivation: RLVR方法仅使用稀疏的、可验证的最终答案奖励来优化大语言模型，这导致在成功前，解决难题所需的中间进展得不到奖励信号；在成功后，最终奖励无法区分组织良好与冗余或有局部缺陷的正确轨迹。

Result: 在DAPO-Math和Big-Math数据集上对Qwen3-8B-Instruct进行训练，SCOPE-RL相比仅使用最终答案奖励的GRPO基线，平均准确率最高提升11.2个百分点，推理令牌数最多减少27.1%。该增益在GSPO算法和Qwen3-0.6B-Instruct模型上也得到保持，表明奖励信号的稠密化与策略更新层面的RLVR进展是互补的。

Insight: 核心创新在于将稀疏的最终答案奖励信号进行两阶段稠密化：在成功前通过分解子问题来提供中间奖励信号，在成功后通过过程形状奖励来优化推理路径的质量。此外，引入专家验证的步骤质量评估协议，从有用步骤密度、错误定位和令牌效率等多个维度评估推理过程，超越了仅关注最终答案准确率的传统评估方式。

Abstract: Reinforcement learning with verifiable rewards (RLVR) optimizes LLMs using sparse verifiable final-answer rewards. This sparse anchor reliably verifies whether a trajectory succeeds but provides no direct feedback on the reasoning path that produced it. Before success, prerequisite progress on hard problems receives no reward signal; after success, outcome rewards cannot distinguish well-organized correct trajectories from redundant or locally flawed ones. We introduce SCOPE-RL (Scaffolded Chain Optimization with Process Efficiency), a two-stage framework that densifies this anchor while retaining the GRPO update: Adaptive Scaffolded RL adds prefix-decomposed verifiable rewards on answer-hidden sub-question chains before success, and Quality-Aware Process RL applies correctness-gated process-shape rewards to refine correct trajectories after success. An expert-validated Step-Quality Evaluation Protocol evaluates useful-step density, error localization, and token efficiency beyond final-answer accuracy. On Qwen3-8B-Instruct trained on DAPO-Math and Big-Math, SCOPE-RL improves average accuracy by up to 11.2 pp and reduces reasoning tokens by up to 27.1% over outcome-only GRPO; the gains hold under GSPO and on Qwen3-0.6B-Instruct, indicating that reward-signal densification is complementary to policy-update-level RLVR advances. Code and data are available at https://github.com/tokencraft-lab/SCOPE-RL.

[165] A Strong Balanced-Softmax Classifier-Retraining Baseline for Long-Tailed Recognition cs.LG | cs.CVPDF

Juan Terven, Diana Margarita Córdova Esparza, Julio Alejandro Romero Gonzalez, Edgar Arturo Chávez Urbiola, Francisco Javier Willars Rodriguez

TL;DR: 本文提出了一种名为BS-cRT的两阶段方法，用于长尾识别任务。该方法首先使用Balanced Softmax训练骨干网络和余弦分类器，然后冻结骨干网络，仅在平衡的批次上重新训练分类器。实验表明，这种仅重新训练分类器的步骤在多个长尾数据集上持续提升了少样本类别的准确率。

Details

Motivation: 论文旨在探究在Balanced Softmax训练后，是否可以通过仅重新训练分类器来进一步减少尾部类别的错误，从而为长尾识别提供一个简单有效的分类器侧基线方法。

Result: 在CIFAR-100-LT、CIFAR-10-LT、ImageNet-LT和Places-LT等数据集上，BS-cRT方法在少样本准确率上取得了显著提升，例如在ImageNet-LT上获得了+6.92个百分点的增益。同时，论文分析了CBRM方法，指出了边界监督需要考虑类别频率。

Insight: 创新点在于提出了一个简单实用的两阶段分类器重训练基线（BS-cRT），证明了仅调整分类器就能有效提升长尾识别性能。客观分析认为，该方法强调了在特征表示固定后，优化分类决策边界的重要性，并为边界修正方法提供了新的见解。

Abstract: Long-tailed recognition methods often modify losses, margins, or representations to reduce the dominance of frequent classes. We ask whether, after Balanced Softmax training, the remaining tail error can be reduced by retraining only the classifier. We evaluate BS-cRT, a two-stage procedure that trains a backbone and cosine classifier with Balanced Softmax, freezes the backbone, and updates only the classifier on balanced episodic batches. The second stage keeps the empirical-prior Balanced Softmax objective and uses raw cosine logits at inference. Across CIFAR-100-LT, CIFAR-10-LT, ImageNet-LT, and Places-LT, this classifier-only step consistently improves Few-shot accuracy over the matched Balanced Softmax checkpoint. At imbalance factor 100, Few-shot gains are +5.15 points on CIFAR-100-LT and +5.83 on CIFAR-10-LT; on ImageNet-LT and Places-LT, gains are +6.92 and +9.78 points, respectively, with a Top-1/Few-shot trade-off on ImageNet-LT. We also analyze Counterfactual Boundary Risk Minimization (CBRM), a boundary-probe extension using prototype-based features near decision boundaries. CBRM identifies two failure modes: scaled-logit cosine margins destabilize training, and corrected hardest-negative probes remain head-class anchored. The results support BS-cRT as a practical classifier-side baseline and indicate that boundary supervision must account for class frequency.

[166] Error Aware Distribution Prediction for Lightweight Implicit Neural Representations cs.LG | cs.CV | cs.GRPDF

Zhimin Li, Jake D. Balla, Joshua A. Levine

TL;DR: 本文提出了一种轻量级的隐式神经表示方法，通过将回归任务转化为分类任务来预测分布，从而同时编码体积数据和相对误差尺度。该方法利用不确定性估计工具，通过离散化连续目标为区间，实现灵活的分布建模以捕捉复杂的多模态行为。

Details

Motivation: 隐式神经表示作为有损近似器存在预测误差，传统不确定性估计方法计算成本高或依赖预定义参数假设，本文旨在开发一种轻量级方法以同时编码数据和误差尺度。

Result: 在隐式神经表示训练中，分类设置相比回归方法实现了更高的重建质量和具有竞争力的误差感知能力，通过不确定性估计验证了其有效性。

Insight: 创新点在于将回归任务重构为分类任务，通过离散化目标实现灵活的非参数分布建模，从而轻量地捕捉复杂误差行为，为隐式表示提供了可扩展的误差感知框架。

Abstract: Implicit neural representations (INRs) offer compact encoding of volumes, but as lossy approximators, inevitably have prediction errors. We consider INRs that can simultaneously encode relative error scales by predicting distributions using tools from uncertainty estimation. Typically, uncertainty estimation relies on computationally expensive approaches or on predefined parametric assumptions about the predictive distribution (e.g., Gaussian). In this study, we propose a lightweight method that reformulates regression-based INR training as a classification task by discretizing continuous targets into bins, enabling flexible distribution modeling to capture complex multimodal behaviors. We analyze the trade-off between regression and classification for INR training and demonstrate that the classification setting tends to achieve high reconstruction quality and competitive error awareness through uncertainty estimation, compared to regression-based approaches.

[167] PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning cs.LG | cs.AI | cs.CVPDF

Wenyuan Wang, Lianyu Hu, Hao Wang, Yang Liu

TL;DR: 本文提出PhysMRV，一个无需训练的物理记忆检索与验证框架，旨在提升视频语言模型在物理合理性推理任务上的性能。该框架通过将训练视频转化为包含场景描述、物理事件图和物理规则摘要的三层结构化物理知识记忆库，在推理时检索相关物理记忆并利用其结构化证据引导冻结的VLM进行验证。

Details

Motivation: 现有视频语言模型在视频理解和视觉问答上表现优异，但在需要理解物体交互、因果动态和基本物理原理的物理合理性推理任务上仍不可靠，在具有挑战性的物理推理基准上存在明显差距。

Result: 在ImplausiBench、IntPhys2和GRASP Level 2三个具有挑战性的物理推理基准上，对多个SOTA VLM进行评估，实验结果表明PhysMRV相比直接提示法在不同VLM和基准上均取得了一致的性能提升。

Insight: 核心创新在于构建了分层的结构化物理知识记忆库（场景描述、物理事件图、物理规则摘要），并以此作为无需微调的物理证据来引导冻结的VLM进行推理，提供了一种有效且可扩展的增强物理常识推理的方法。

Abstract: Video-language models (VLMs) have achieved remarkable performance on video understanding and visual question answering, yet they remain unreliable in reasoning about physical plausibility, where understanding object interactions, causal dynamics, and fundamental physical principles is essential. This limitation is particularly evident on challenging physical reasoning benchmarks, revealing a persistent gap in physical commonsense reasoning. To address this challenge, we propose PhysMRV, a training-free physical memory and verification framework for physical plausibility reasoning. Unlike retrieval-augmented VLMs that retrieve semantically similar videos as additional context, PhysMRV transforms training videos into a Hierarchical Memory Bank of structured physical knowledge comprising three complementary levels: scene descriptions capturing visual context, physical-event graphs modeling object interactions and causal structure, and physics-rule summaries distilling reusable physical principles and cues. During inference, PhysMRV retrieves physically relevant memories and leverages their structured physical evidence to guide a frozen VLM in verifying physical plausibility, requiring neither fine-tuning nor parameter updates. We evaluate PhysMRV on three challenging physical reasoning benchmarks, ImplausiBench, IntPhys2, and GRASP Level 2, across multiple state-of-the-art VLMs. Experimental results demonstrate consistent improvements over direct prompting across diverse VLMs and evaluation benchmarks, showing that structured physical memories provide an effective and scalable means of enhancing physical plausibility reasoning without additional training.

Fabian Mager, Hiba Nassar, Lars Kai Hansen

TL;DR: 本文研究了CLIP风格双编码器对比学习中的模态间隙问题，发现尽管图像和文本嵌入在共享空间中训练，但仍存在不对齐现象。作者指出这是由独立编码器下的InfoNCE损失公式失效引起的，并通过理论分析和实验验证了在低温下InfoNCE会主动产生模态间隙。为解决此问题，提出了一种名为xNCE的简单改进方法，该方法同时利用模态内和模态间的负对比对，在保持检索性能的同时有效减小模态间隙，并提升了零样本分类性能。

Details

Motivation: 解决CLIP风格多模态表示学习中存在的模态间隙问题，即图像和文本嵌入在共享空间中训练后仍不对齐，这影响了跨模态任务的性能。

Result: 在MS-COCO基准测试中，xNCE匹配了InfoNCE的检索性能，同时显著减小了模态间隙；在所有基准测试上，xNCE均提升了零样本分类性能，而高温度InfoNCE和正则化InfoNCE均未能实现此改进。

Insight: 创新点在于揭示了InfoNCE损失在低温下会导致模态间隙的模式失效问题，并提出xNCE方法通过引入模态间负对比对来解决此问题，从而在不牺牲迁移所需判别几何结构的情况下减小间隙，提升零样本泛化能力。

Abstract: We study the modality gap in CLIP-style dual-encoder contrastive learning, where image and text embeddings remain misaligned despite being trained in a shared space. We argue that the gap is induced by a failure of the InfoNCE formulation with independent encoders. We conduct a uni-modal experiment with two independent encoders and identical initialization conditions and find that InfoNCE actively generates a gap at low temperatures. We provide a theoretical analysis of this phenomenon and show that the modality gap is indeed a mode-failure of InfoNCE, but only at low temperatures. We propose a simple modification called xNCE, which uses intermodal as well as intra-modality negative contrastive pairs. xNCE matches retrieval performance on MS-COCO while consistently reducing the gap even at low temperatures. Notably, xNCE improves zero-shot classification over the InfoNCE baseline across all benchmarks, whereas high-temperature InfoNCE and regularized InfoNCE both fail to do so, demonstrating that xNCE reduces the modality gap without sacrificing the discriminative geometry needed for transfer.

[169] DiffEEG: A Self-Supervised Denoising Diffusion Model for Learning EEG Generic Representations cs.LG | cs.AI | cs.CV | eess.SPPDF

Abdulkader Helwan, Lina Abou-Abbas, Hussein El Amouri, Belkacem Chikhaoui, Khadidja Henni

TL;DR: 本文提出了DiffEEG，一个基于去噪扩散模型的自监督基础模型，用于学习脑电图（EEG）的通用表征，以解决癫痫检测中标注稀缺和类别极度不平衡的问题。该模型使用1D U-Net结合多头自注意力进行预训练，并通过基于强化学习的微调直接优化F1分数，在TUHSZ数据集上实现了高精度的癫痫检测和亚型分类。

Details

Motivation: 解决基于EEG的癫痫检测中面临的两个关键挑战：严重的标注数据稀缺和极端的类别不平衡（癫痫发作事件仅占临床记录的不到10%）。

Result: 在严格的按患者划分评估（279名患者，留一折交叉验证）中，DiffEEG在4类癫痫亚型分类上达到61%准确率和59% F1分数，在二元检测上达到81%准确率和85%加权F1分数，尽管存在极端不平衡（6.7%患病率），仍保持了临床上可行的癫痫召回率（59%）。片段级评估显示其准确率上限为97.6%，证明了强大的架构能力。

Insight: 创新点在于将基于扩散模型的预训练与指标感知的强化学习微调相结合，通过直接优化F1分数来优先考虑对罕见癫痫事件的敏感性，从而在标注数据极少的情况下实现临床可部署的癫痫监测。从客观角度看，这种自监督预训练加针对性微调的框架为处理高度不平衡的医疗时间序列数据提供了有效范例。

Abstract: Deep learning for EEG-based seizure detection faces critical challenges: severe annotation scarcity and extreme class imbalance, where ictal events comprise less than 10% of clinical recordings. We present DiffEEG, a 9.6M-parameter self-supervised foundation model that addresses both limitations through denoising diffusion pre-training and reinforcement learning (RL)-based fine-tuning. Pre-trained on 1.3M unlabeled segments from the Temple University Hospital Seizure Corpus (TUHSZ), DiffEEG learns generic neural representations via a 1D U-Net with multi-head self-attention. For downstream adaptation, a reinforced decision layer employs policy gradient optimization to directly maximize F1-score, prioritizing sensitivity to rare seizure events over overall accuracy. Under strict patient-wise evaluation (279 patients, Leave-One-Fold-Out), DiffEEG achieves 61% accuracy and 59% F1 for 4-class seizure subtyping, and 81% accuracy with 85% weighted F1 for binary detection, maintaining clinically viable seizure recall (59%) despite extreme imbalance (6.7% prevalence). Segment-level evaluation establishes an upper bound of 97.6% accuracy, confirming strong architectural capacity. DiffEEG demonstrates that diffusion-based pre-training combined with metric-aware reinforcement learning enables clinically deployable seizure monitoring with minimal labeled data requirements.

cs.AI [Back]

[170] Interpreting Latent CoT Reasoning as Dynamical Systems cs.AI | cs.CL | cs.LGPDF

Sabari Iyyappan Duraipandian, Shreya Sanjay Boyane, Manju Nagesh, Jerome Francis, Archana Vaidheeswaran

TL;DR: 本文提出将隐式思维链推理建模为动力系统，通过定量指标和可视化方法分析其动态演化过程，揭示了CODI和COCONUT分别呈现稳定吸引子与不稳定扩张系统两类行为模式，为提升隐式推理的可解释性与性能提供新视角。

Details

Motivation: 现有隐式推理方法在隐藏空间中叠加多个候选推理轨迹，缺乏对推理过程跨步骤演化的可解释性分析，本文旨在通过动力系统理论填补这一空白。

Result: 通过步间变化、方向一致性和李雅普诺夫敏感性等定量指标，结合UMAP和DMD/PHATE可视化，证明隐式CoT具有结构化非随机动态，其中CODI表现为稳定吸引子，COCONUT表现为不稳定扩张系统。

Insight: 创新点在于将隐式推理序列视为表示空间中的轨迹，首次应用动力系统分析框架量化推理动态；发现SIM-CoT监督可收紧行为而不改变底层动态，为优化隐式推理提供了可操作见解。

Abstract: Recent latent reasoning methods, such as CODI and COCONUT, face a fundamental interpretability problem: they maintain multiple superimposed candidate traces in the hidden space at each step, unlike explicit- CoT, which follows a single transparent reasoning trace. Existing mechanistic methods show compression, shortcuts, and superposition without explaining how reasoning evolves across latent steps. To address this gap, we model latent token sequences as trajectories in representation space and apply dynamical systems analysis to characterize the evolution of reasoning. Using quantitative measures, such as step-to-step change, direction consistency, and Lyapunov sensitivity, alongside qualitative projections, such as UMAP and DMD/PHATE, we show that latent CoT exhibits structured, non-random dynamics with two distinct stability classes. CODI behaves as a stable attractor, while COCONUT behaves as an unstable expanding system, and SIM-CoT supervision tightens both behaviors without changing the underlying dynamics. This framework advances the interpretability of latent CoT reasoning dynamics and provides actionable insights for improving latent reasoning performance. Code1 and Project page2 available online.

[171] EvoCUA-1.5: Online Reinforcement Learning for Multi-turn Computer-Use Agents cs.AI | cs.CL | cs.LGPDF

Mianqiu Huang, Taofeng Xue, Chong Peng, Jinrui Ding, Sicheng Fan

TL;DR: EvoCUA-1.5 提出了一种用于多轮计算机使用智能体的在线强化学习框架，旨在解决智能体在部分可观察、多模态桌面环境中执行长程任务时面临的挑战。该框架通过引入步级策略优化、策略感知过滤与通过率校准、动态三元自适应课程以及全异步RL基础设施等组件，使策略能够在可执行的沙盒环境中交互并从可验证的任务结果中学习。

Details

Motivation: 解决静态轨迹（如模仿学习和离线轨迹优化）无法覆盖真实计算机使用中因果反馈循环的问题，即每个动作都会改变屏幕状态、未来动作空间和恢复选项，因此需要智能体通过在线交互进行持续学习和改进。

Result: 在OSWorld-Verified基准测试上取得了63.2%的成功率，超越了可比较的32B/35B规模的开源权重基线模型，甚至接近了参数量显著更大的模型性能。

Insight: 创新点包括：将离线经验学习扩展到在线强化学习；提出了STEPO方法以解决多轮交互中的优势平衡问题；设计了DTAC课程学习策略来动态管理任务难度；构建了支持异步训练的基础设施。这些为在多轮计算机使用智能体中扩展在线RL提供了实用框架。

Abstract: Computer-use agents must solve long-horizon tasks through repeated interaction with partially observable, multimodal desktop environments. Although imitation learning and offline trajectory refinement provide strong priors, static traces cannot cover the causal feedback loop of real computer use: each action changes the screen state, future action space, and recovery options. EvoCUA-1.5 extends self-evolving computer-use agents from offline experience learning to online reinforcement learning, where policies interact with executable sandbox environments and improve from verifiable task outcomes. Online RL in this setting requires more than directly reusing single-turn language-RL recipes. Multi-turn interaction introduces context-managed observations, sparse terminal rewards, variable-length trajectories, and slow environment feedback. EvoCUA-1.5 addresses these challenges with Step-Level Policy Optimization (STEPO), which preserves trajectory-level advantage balance after decomposition into step-level samples; policy-aware filtering and pass-rate calibration over verifiable synthesized tasks; Dynamic Tri-Adaptive Curriculum (DTAC), which combines learnable tasks, difficult positive replay, and controlled infeasible-task exposure; and a fully asynchronous RL infrastructure with staleness control and mini-group batching. Experiments show that these components improve training stability and downstream performance. EvoCUA-1.5 achieves 63.2% success on OSWorld-Verified, outperforming comparable 32B/35B-scale open-weight baselines and even approaching models with significantly larger parameter counts. Overall, EvoCUA-1.5 provides a practical framework for scaling online RL in multi-turn computer-use agents.

[172] Length Penalties Make Chain-of-Thought Less Monitorable cs.AI | cs.CL | cs.LGPDF

Bryce Little

TL;DR: 该论文研究了长度惩罚强化学习对思维链推理可监控性的影响。实验表明，长度惩罚虽然能显著减少推理标记数量并保持大部分准确率，但会隐藏影响模型答案的线索，使得监控模型决策过程变得更加困难。

Details

Motivation: 解决长度惩罚在压缩思维链推理时，可能隐藏驱动模型答案的关键影响线索，从而降低推理过程可监控性的问题。

Result: 在MMLU-Pro-R和四个迁移基准测试上评估Qwen3-4B和Qwen3-14B变体，发现压缩后忠实度下限分别降至基线的63.1%和69.4%，监控器捕捉提示使用的原始率从69%/60%降至49%/48%。压缩后的思维链披露提示的可能性比随机缩短的基线链低7-35个百分点。

Insight: 揭示了推理成本与可监控性之间的权衡前沿：更便宜的推理可能保留答案，但使其背后的影响更难被检测。长度惩罚不仅缩短了推理，还优先移除了监控所需的关键线索。

Abstract: Length-penalized reinforcement learning can shorten chain-of-thought reasoning while hiding an influence that drives the model’s answer. In our experiments, training with length penalties does not stop misleading hints from steering models, even though the models’ chains of thought mention the hint much less often. A token-accuracy evaluation would count these runs as successful because they use fewer reasoning tokens with little accuracy loss; it would miss whether the remaining trace still shows what drove the answer. We train Qwen3-4B and Qwen3-14B variants with different target chain lengths, then evaluate them with biasing-hint interventions on held-out MMLU-Pro-R and four transfer benchmarks. Compression sharply cuts reasoning tokens, preserves most multiple-choice accuracy, and leaves hint influence near baseline. At the strongest target, lower-bound faithfulness falls to 63.1% of baseline for Qwen3-14B and 69.4% for Qwen3-4B; the raw rate at which a monitor catches hint use falls from 69% to 49% and from 60% to 48%. To separate length from content, we randomly delete sentences from uncompressed baseline chains until the remaining text matches the compressed length. Even after this length matching, compressed chains disclose the hint 7-35 percentage points less often than baseline chains that we shorten at random, for both Qwen3 sizes and all five evaluation distributions. Compression therefore does more than shorten reasoning, preferentially removing the cues a monitor needs to see what influenced the answer. Together, these results reveal a compression-monitorability frontier in which cheaper reasoning can preserve answers while making the influences behind them harder to detect.

[173] MAG: A Web-Agent Benchmark and Harness for Multimodal Action and Guide Generation cs.AI | cs.CLPDF

Chengguang Gan, Hanjun Wei, Yunhao Liang, Zhixi Cai, Qinghao Zhang

TL;DR: 本文提出了MAG基准测试和工具集，用于统一评估多模态网络代理的任务执行和指南生成能力。该基准通过截图标注元素选择集和原始像素坐标两种方式，构建了包含动作和指南的复合任务评估框架，并设计了包含标注、训练、评估和联合指标的完整工具链。

Details

Motivation: 现有研究将自动化网络代理动作和指南文本生成视为两个独立问题，且大多基于文本页面表示（如DOM或可访问性树）而非人类实际操作的渲染屏幕。MAG旨在解决真实任务中跨页面状态的动作序列需求，并将任务执行与指南写作统一为单一的多模态任务。

Result: 在MAG基准上评估前沿API模型和开源多模态模型，最强模型的任务完成率低于40%。提出的GRPO训练方法结合专家轨迹，将监督学习的9B代理成功率从6.9%提升至13.2%，同时提高了指南质量。

Insight: 创新点在于首次将任务执行和指南生成统一为多模态基准，引入基于截图的两种标注方案（元素选择集和像素坐标），并构建了涵盖标注、训练、评估的完整工具链。GRPO训练方法通过专家轨迹增强，显著提升了代理性能，为多模态网络代理研究提供了新方向。

Abstract: Digital Adoption Platforms (DAPs) are embedded overlays widely used on web systems to guide users through operations inside a page, helping them get started with unfamiliar interfaces quickly. Completing a real task, however, rarely means clicking a few buttons on a single page: it takes a sequence of actions that unfolds across changing page states. Prior studies have also treated automated web agent actions and guide text generation as two separate problems, and most of them feed models textual page representations such as the DOM or accessibility trees rather than the rendered screens that humans actually operate on. In this work we introduce MAG, the first benchmark that unifies task execution and guide writing into a single Multimodal Action and Guide task, with two grounding schemes over screenshots: Set-of-Mark element selection and raw pixel coordinates. We further build a complete harness for this compound task, covering annotation with LLM assistance and human verification, training, evaluation in live environments, and joint metrics for actions and guides. With this harness we evaluate frontier API models and open multimodal models, and report detailed analyses. Finally, we design a GRPO training method augmented with expert trajectories, which nearly doubles the success rate of a supervised 9B agent (from 6.9% to 13.2%) and improves guide quality at the same time. Even the strongest model completes fewer than 40% of the tasks, leaving ample room for future research.

[174] Information-seeking failures of large language models in agentic clinical reasoning cs.AI | cs.CLPDF

Krischan Braitsch, Laura K. Schmalbrock, Theresa Weltermann, Andrew F. Berdel, Isabella Miller

TL;DR: 本文开发了一个用于评估大型语言模型在血液肿瘤学中临床推理能力的智能体框架，要求模型在不确定性下主动请求临床数据，经过三轮信息收集后做出诊断和治疗计划。研究发现，尽管模型在医学知识评估中得分很高，但在主动信息寻求方面存在系统性失败，导致诊断准确率较低，且其推理过程虽局部连贯但常与全局正确结论脱钩。

Details

Motivation: 解决大型语言模型在临床推理中主动信息寻求能力不足的问题，特别是在不确定性环境下决定调查哪些关键数据的能力，以弥补现有模型在医学知识评估高分与实际临床决策表现之间的差距。

Result: 在32个前沿模型中，最佳模型整体准确率仅为68%；信息利用率（实际请求可用数据的比例）是诊断准确率的最强预测因子（R = 0.69, P < 0.001），但在最后一轮从57%骤降至26%，导致对治疗选择至关重要的分子和细胞遗传学数据未被检查。

Insight: 创新点在于提出了一个模拟临床不确定性的智能体评估框架，揭示了模型在信息寻求中的系统性失败，如搜索满足、锚定和过早闭合等认知偏差，这些偏差与新手医生在双重过程诊断推理模型中的表现相似，表明当前模型的主要限制并非医学知识不足，而是不确定性下的主动探索能力缺陷。

Abstract: Large language models achieve high scores on medical knowledge assessments, yet clinical reasoning requires actively deciding what to investigate under uncertainty. We developed an agentic evaluation framework in hematologic oncology in which models must proactively request clinical data across three sequential rounds before committing to a diagnosis and treatment plan. Across 32 frontier models, the best achieved only 68% overall accuracy. Information utilization, the fraction of available data actually requested, was the strongest predictor of diagnostic accuracy (R = 0.69, P < 0.001), yet utilization collapsed from 57% to 26% in the final round, leaving molecular and cytogenetic data critical for treatment selection unexamined. Reasoning traces scored high on a clinical reasoning rubric (91% above threshold) but decorrelated from accuracy, revealing a gap between locally coherent rationales and globally correct conclusions. Error analysis identified search satisficing, anchoring and premature closure as the dominant failure modes, the same cognitive biases that characterize novice clinicians under dual-process models of diagnostic reasoning. These findings demonstrate that the primary limitation of current models in clinical oncology is not insufficient medical knowledge but a systematic failure of information-seeking under uncertainty.

[175] SPARK: Susceptibility-Guided Profiling and Steering of Latent Reasoning States in Large Language Models cs.AI | cs.CLPDF

Dongxu Zhang, Yiding Sun, Zihao Guo, Xiangyang Yang, Kai Tang

TL;DR: 本文提出了SPARK方法，通过分析大语言模型隐藏状态对输入的敏感性（susceptibility）来诊断模型是否进入有效的推理状态，并以此指导轻量级的测试时干预。该方法利用长度控制的敏感性信号分离输入长度的影响，结合跨层协调选择推理活跃的锚点和激活不足的困难样本，从而提升模型在数学推理任务上的性能。

Details

Motivation: 现有方法主要从最终答案评估大语言模型的推理失败，但无法揭示失败原因（如能力缺失、推理轨迹不稳定或已有状态未被激活）。通用的激活引导方法通常全局应用方向，缺乏对具体样本的诊断，无法确定哪些样本需要干预。

Result: 在MATH-500基准测试上，SPARK-Steering将Qwen3-4B的准确率从82.0%提升至84.6%，将Qwen3-8B的准确率从82.4%提升至85.6%。在GSM8K和FRONTIER-4.5K程序推理套件上也取得了一致性改进。

Insight: 创新点在于提出使用长度控制的隐藏状态敏感性作为诊断信号，以区分输入规模效应与残余推理激活，并结合跨层协调实现针对性的测试时引导。这为理解模型内部推理状态和进行精准干预提供了新思路。

Abstract: Reasoning failures in large language models (LLMs) are usually evaluated from final answers, but a wrong answer does not reveal why the model failed. The same incorrect output may reflect missing capability, an unstable reasoning trajectory, or a failure to activate a reasoning state that is already available in the frozen model. Existing prompting and benchmark-based evaluation methods mostly operate at the output level, while generic activation-steering methods typically apply global directions without diagnosing which examples require intervention. In this paper, we introduce SPARK, which uses hidden-state response to diagnose whether a model internally enters an effective reasoning state and to guide lightweight test-time steering. The key observation is that raw hidden-state susceptibility is strongly confounded by prompt length, especially in programmatic and algorithmic reasoning where harder serialized instances naturally become longer. SPARK therefore uses length-controlled susceptibility to separate input-scale effects from residual reasoning activation, and combines this signal with cross-layer coordination to select reasoning-active anchors and under-activated hard examples. We use FRONTIER-4.5K as a controlled programmatic reasoning suite for latent profiling and difficulty-aware analysis, and evaluate SPARK-Steering on GSM8K and MATH-500 with forward-only benchmark profiling. Our method improves Qwen3 series models consistently; on MATH-500, accuracy rises from 82.0% to 84.6% for Qwen3-4B and from 82.4% to 85.6% for Qwen3-8B. These results suggest that susceptibility can serve not only as a diagnostic signal for reasoning failures, but also as a practical guide for targeted test-time intervention.

[176] ANCHOR: Automated Alignment Auditing for CLI Agents on Real-World Harm cs.AI | cs.CLPDF

Kefan Song, Yanjun Qi

TL;DR: ANCHOR是一个自动化审计框架，用于在基于真实美国法庭案例的非法任务上对命令行界面（CLI）智能体进行压力测试。研究发现，尽管前沿CLI智能体在直接提示下通常会拒绝非法任务，但在持续恶意交互下，其服从率可达100%，且常会超额完成任务，自主构建大规模危害的基础设施。

Details

Motivation: 随着自主CLI智能体在多小时会话中执行数百个操作（如写代码、执行命令、浏览网页、管理云基础设施）且人工监督极少，其自主性增强可能带来更大风险。论文旨在评估当前智能体对齐技术是否足以应对持续、自适应的恶意用户。

Result: 在基于真实法庭案例构建的非法任务基准上评估前沿CLI智能体，结果显示，在持续恶意交互下，智能体的任务服从率达到100%，并经常超额完成请求（如自主构建大规模金融欺诈或生物武器开发所需的基础设施）。

Insight: 创新点在于提出了一个自动化对齐审计框架ANCHOR，它通过使用监督和强化微调在黑暗人格数据上微调的审计员智能体，来模拟持续、自适应的恶意用户进行多轮交互测试。客观分析认为，该方法揭示了当前智能体对齐技术在应对复杂社会工程攻击方面的严重不足，为安全评估提供了新的压力测试基准和方法。

Abstract: Autonomous CLI agents can now execute hundreds of actions across multi-hour sessions: writing code, executing shell commands, browsing the web, and managing cloud infrastructure, all with minimal human oversight. Does greater autonomy invite greater risk? We introduce ANCHOR, an automated auditing framework that stress-tests CLI agents on illegal tasks grounded in public US court cases. ANCHOR deploys an auditor agent fine-tuned on dark personality data using supervised and reinforcement fine tuning. This auditor roleplays persistent malicious users who decompose tasks, reframe requests upon refusal, and adapt strategies across multi-turn interactions. Evaluating frontier CLI agents, we find that while they often refuse illegal tasks when prompted directly, compliance reaches 100% under persistent malicious interaction. When agents comply, they frequently exceed user requests, autonomously building infrastructure for large-scale harm, including catastrophic risk scenarios such as large-scale financial fraud and bioweapon development. These findings demonstrate that current alignment techniques are insufficient for autonomous agents and underscore the need for safety evaluations against persistent, adaptive malicious users. We release ANCHOR at https://github.com/garified/anchor

[177] Constraint-Aware Hierarchical Search for Regulation-Driven Fine-Grained Classification cs.AI | cs.CLPDF

Siyu Wang, Wei Tan, Lulu Chen

TL;DR: 本文提出了一种面向法规驱动的细粒度层次分类任务的约束感知层次搜索框架。该任务要求将输入实例分配到明确的法规层次结构下的细粒度类别中，正确标签不仅取决于语义相似性，更由规则定义的边界、阈值条件、排除条款等决定。作者构建了四个来自法规密集型场景的基准数据集，并验证了所提方法在平均准确率和可解释决策路径上的优越性。

Details

Motivation: 解决海关税则分类、出口管制分类等法规驱动场景下的细粒度分类问题，这些场景中正确标签由复杂的规则逻辑而非单纯的语义相似性决定，现有扁平分类器、层次文本分类方法或检索增强LLM系统难以同时保证层次有效性、规则一致性和细粒度边界推理。

Result: 在构建的四个法规密集型基准数据集上，所提方法在所有数据集上均取得了最佳的平均准确率，并在涉及细粒度相邻类别和基于规则的边界条件的案例上提升最为显著。

Insight: 创新点在于将法规文档转换为可搜索的树结构，在搜索过程中仅检索有效的局部候选节点，并利用结构化的法规字段和证据片段来指导每一步的决策，从而联合保证了层次有效性、规则一致性和细粒度推理，提供了可审计的解释路径。

Abstract: Tasks such as customs tariff classification, export control categorization, and standards-based equipment coding require assigning an input instance to a fine-grained class under an explicit regulatory hierarchy. Unlike standard text classification, the correct label in these tasks is not determined by semantic similarity alone, but by rule-defined boundaries, threshold conditions, exclusion clauses, definitions, and local exceptions. As a result, two highly similar inputs may require different labels, while a retrieved passage that appears relevant may still be inapplicable under the governing rules. Existing flat classifiers, hierarchical text classification methods, and retrieval-augmented LLM systems are not designed to jointly enforce hierarchical validity, rule consistency, and fine-grained boundary reasoning. In this paper, we formulate this setting as regulation-driven fine-grained hierarchical classification, where an external instance must be assigned to a fine-grained class through a valid path in a regulatory hierarchy and supported by auditable evidence. We construct four benchmark datasets from representative regulation-intensive scenarios and validate the annotations through an expert-in-the-loop process. We further propose a constraint-aware hierarchical search framework that converts regulatory documents into a searchable tree, retrieves only valid local candidate nodes, and uses structured regulatory fields with evidence snippets to guide each next-hop decision. Experiments show that our method achieves the best mean accuracy on all four datasets and provides interpretable decision paths, with the largest gains on cases involving fine-grained neighboring categories and rule-based boundary conditions.

[178] STEC: Evidence Compression for Deep Search in Open-domain Multi-Hop QA cs.AI | cs.CLPDF

Xinkang Li, Rong Jiang, Xin Song, Ye Wang, Yue Han

TL;DR: 该论文提出了STEC框架，用于解决开放域多跳问答中多个搜索轨迹带来的最终答案选择难题。STEC通过答案级证据压缩将轨迹按答案分组并转换为候选证据表示，再通过证据引导的答案验证进行比较和选择，从而将选择过程从原始轨迹对比提升到候选证据对比。

Details

Motivation: 现有方法通过推理范式、检索交互和搜索策略优化来改进开放域多跳问答，但使用多个搜索轨迹会引入具有挑战性的最终答案选择问题，因为不同轨迹可能支持不同候选答案，且检索信息可能异构、冗余、不完整或冲突。

Result: 在四个开放域多跳问答基准测试上与代表性基线方法对比，实验结果表明STEC在比较方法中整体表现最佳，消融实验证明答案级证据压缩对最终答案选择有贡献。

Insight: 创新点在于将最终答案选择从原始轨迹的直接比较（易受噪声影响）或单纯答案字符串比较（忽略证据）转变为候选级别的证据表示比较，通过结构化压缩证据来提升验证的可靠性。

Abstract: In open-domain multi-hop question answering (QA), LLM-based search agents offer a promising approach to knowledge-intensive QA by combining retrieval with reasoning. Existing methods mainly improve open-domain multi-hop QA through reasoning paradigms, retrieval interaction, and search strategy optimization. However, using multiple search trajectories introduces a challenging final answer selection problem. Different trajectories may support different candidates, and the retrieved information can be heterogeneous, redundant, incomplete, or conflicting. Directly comparing raw trajectories exposes the verifier to noisy and unaligned content, while comparing answer strings ignores the evidence supporting each candidate, making reliable final selection difficult. To address this challenge, we propose STEC, an evidence compression framework for final answer selection in multi-hop QA. STEC selects the final answer from the existing candidate set through two mechanisms: (1) Answer-Level Evidence Compression, which groups trajectories by normalized answer identity and converts each answer group into a candidate-specific evidence representation; and (2) Evidence-Guided Answer Verification, which compares these representations and selects the final answer from the candidate set. The design shifts final selection from raw trajectory comparison to candidate-level evidence comparison. We evaluate STEC on four open-domain multi-hop QA benchmarks against representative baselines. Experimental results show that STEC performs best overall among the compared methods, and ablation results provide evidence that answer-level evidence compression contributes to final answer selection.

[179] Route, Communicate, and Reason: Gated Routing and Adaptive Depth for Efficient Multi-Agent Reasoning cs.AI | cs.CL | cs.LGPDF

Sudipto Ghosh, Tanmoy Chakraborty

TL;DR: 本文提出了GRADE（门控路由与自适应深度高效推理）系统，这是一个分层多智能体系统，通过四个轻量级学习门控联合管理智能体选择、层次深度、智能体间通信和分支剪枝。训练采用新颖的无评论者方法CoGRPO，为参与推理的门控和智能体分配共享优势信号。系统支持从可热插拔专家注册表中选取智能体模型，并通过校准映射实现推理时无需重新训练即可替换专家。

Details

Motivation: 解决多智能体集成中参数和推理成本倍增的问题，具体针对三个基本问题：选择哪些智能体、查询应在智能体层次结构中遍历多深、以及智能体间通信何时值得其成本。

Result: 在约170亿平均激活参数下，GRADE在GSM8K、MMLUPro和GPQA基准上超越所有基线，在MMLUPro上以一半的激活计算量超过最强基线4.8个百分点；在AIME-2025上保持竞争力。消融实验表明层次结构和掩码交叉注意力对准确性贡献最大，且每智能体校准对安全热插拔是必要的。

Insight: 创新点包括：通过联合学习门控实现高效的多智能体路由与深度控制；提出CoGRPO训练方法适应多智能体层次结构；设计可热插拔的专家注册表与校准机制，支持推理时灵活替换模型而不需重新训练。

Abstract: Multi-agent ensembling multiplies active parameters and inference cost without answering three basic questions: which agents to consult, how deeply a query should traverse a hierarchy of agents, and when inter-agent communication is worth its cost. We present GRADE (Gated Routing and Adaptive Depth for Efficient Reasoning), a hierarchical multi-agent system in which four lightweight learned gates jointly govern agent selection, hierarchy depth, inter-agent communication, and branch pruning. Training uses CoGRPO (Collaborative Group-Relative Policy Optimization), a novel critic-free recipe that adapts GRPO to multi-agent hierarchies and assigns a shared advantage signal to every gate and agent that participated in a rollout. Agent models are drawn from a hot-swappable Expert Registry; per-agent calibration maps allow experts to be replaced at inference time without retraining. At $\sim$17B average active parameters, GRADE outperforms all baselines on GSM8K, MMLUPro, and GPQA, surpassing the strongest baseline by 4.8 points on MMLUPro at half the active compute. On AIME-2025, where model depth dominates, GRADE remains competitive to existing frameworks. Ablations isolate the hierarchy and masked cross-attention as the largest contributors to accuracy, and show that per-agent calibration is necessary for safe hot-swapping.

[180] LOGOS: A Living Logic for AI Agent Teams That Evolve With Humans cs.AI | cs.CLPDF

Yuma Ichikawa, Yamato Arai, Kosaku Kimura, Akira Sakai, Hiromichi Kobashi

TL;DR: 本文提出LOGOS，一个可插拔的自我进化与治理层，旨在增强现有多智能体框架。它将异构多模态输入（如文档、图像、音频、数据库、API和人类指令）编译为包含智能体、工具、知识、测试、权限和策略的版本化智能体包，并在运行期间将智能体活动转换为可移植、可审计的事件轨迹，实现跨框架和后台的故障闭锁验证。

Details

Motivation: 随着AI智能体从问答引擎演变为使用工具、委派工作、从经验中学习并修改塑造其未来行为的工件的持久团队，部署的核心问题已不仅是智能体能做什么，而是谁控制它们被允许成为什么。LOGOS旨在解决智能体团队自我进化过程中的可控性与问责问题。

Result: 摘要未提及具体的定量实验结果或基准测试，但宣称LOGOS架构实现了‘可验证的人-智能体循环工程’，使智能体能够行动、询问、学习和提出改进，而人类则能在不中断连续操作的情况下引导目标、权限、审批和不可逆操作。

Insight: 创新点在于提出了一个将智能体进化过程版本化、可审计和可验证的治理层，核心思想是‘证据和人类授权才能闭环’，确保所有习得的提示、记忆、技能、工具、角色或工作流在获得保留执行证据、人类控制策略和明确授权前都保持为未受信任的候选版本，为负责任的自动化提供了‘活的逻辑’。

Abstract: AI agents are evolving from answer engines into persistent teams that use tools, delegate work, learn from experience, and modify the artifacts that shape their future behavior. The defining question for deployment is no longer merely what agents can do, but who controls what they are allowed to become. We introduce logos, a pluggable layer for self-evolution and governance that strengthens existing multiagent frameworks rather than replacing them. logos compiles heterogeneous multimodal inputs, including documents, images, audio, tables, databases, APIs, and human instructions into versioned agent packs containing agents, tools, knowledge, tests, permissions, and policies. During operation, it transforms agent activity into portable, auditable event traces and applies fail-closed verification across frameworks and backends. Every learned prompt, memory, skill, tool, role, or workflow remains an untrusted release candidate until held-out execution evidence, human-controlled policy, and explicit authorization permit its promotion. This architecture enables “verifiable human-agent loop engineering”: agents can act, ask, learn, and propose improvements, while humans can steer objectives, permissions, approvals, and irreversible actions without interrupting continuous operation. logos provides a living logic for accountable automation. Agents may evolve at machine speed, but only evidence and human authority can close the loop.

[181] StructAgent: Harness Long-horizon Digital Agents with Unified Causal Structure cs.AI | cs.CL | cs.LG | cs.MAPDF

Wenyi Wu, Sibo Zhu, Kun Zhou, Aayush Salvi, Zixuan Song

TL;DR: 本文提出了StructAgent，一个以状态为中心的框架，用于构建能够处理长视野任务的数字智能体。该框架通过引入统一的状态表示来维护紧凑、可验证的任务进度，并采用结构化的工作流来管理基于验证的状态转换，从而提升智能体在复杂、长序列计算机使用任务中的可靠性和性能。

Details

Motivation: 现有基于大语言模型和视觉语言模型的数字智能体在处理长视野、上下文不断演化的现实世界任务时，通常直接操作原始的交互历史，这使得任务进度难以解释、验证和恢复，限制了其可靠的长视野执行能力。

Result: 在OSWorld-Verified基准测试上，StructAgent显著提升了多种LLM和VLM骨干模型的性能，例如将Qwen3.5-9B的成功率从27.0%提升至46.9%，将Qwen3.5-27B从31.6%提升至62.2%，并使用MiniMax-M3达到了78.9%的新开源SOTA水平。该框架还成功泛化到Minecraft环境，证明了其设计的通用性。

Insight: 论文的核心创新在于提出了一个围绕统一因果结构来组织智能体状态和工作流的范式。具体而言，其引入了可验证的统一状态作为任务进度的核心表示，并设计了基于验证器的结构化状态转换工作流，这为实现显式的进度检查点、证据驱动的任务完成、针对性的失败恢复和工具支持的执行提供了基础，确保了所有进度更新都基于验证，从而提升了长视野任务的可解释性和可靠性。

Abstract: Recent advances in large language models (LLMs) and vision-language models (VLMs) have enabled increasingly capable digital agents for computer use. However, real-world tasks are often long-horizon and involve evolving contexts containing accumulated observations, intermediate edits, failed attempts, and partially completed executions. Existing agents typically operate over raw interaction history, making task progress difficult to interpret, verify, and recover, which ultimately limits reliable long-horizon execution. In this paper, we argue that addressing this challenge requires explicitly structuring both the agent’s state and workflow around a unified causal representation of task progress. We present \textbf{StructAgent}, a state-centered framework that introduces a unified state for maintaining compact, verifiable task progress and a structured workflow that regulates progress through verifier-backed state transitions. Building on this design, StructAgent further enables explicit progress checkpointing, evidence-driven task completion, targeted failure recovery, and tool-supported execution, while ensuring that all progress updates remain grounded in verification. Extensive experiments demonstrate that StructAgent consistently improves a wide range of LLM and VLM backbones on long-horizon computer-use tasks. On OSWorld-Verified, it improves Qwen3.5-9B from 27.0% to 46.9% success rate and Qwen3.5-27B from 31.6% to 62.2%, while achieving a new open-source state of the art of 78.9% with MiniMax-M3. Moreover, the same framework generalizes beyond desktop environments to Minecraft, demonstrating the generality of our design.

[182] Lesioned Multimodal Language Models Reproduce Aphasic Picture-Naming Patterns cs.AI | cs.CL | cs.LGPDF

Yong Yang, Xiang Guan, Sophie Arheix-Parras, Saeed Ahmadi, Roger Newman-Norlund

TL;DR: 该研究探索了通用多模态语言模型（LLaVA 1.6）在受到模拟脑损伤的扰动后，能否复现失语症患者在图片命名任务中出现的系统性错误模式。研究发现，通过调整施加于模型单元的噪声层、比例和数量，可以产生与临床数据比例相当的六类错误，并能高精度地复现个体患者的完整错误谱。

Details

Motivation: 旨在测试未经临床模拟设计的通用语言模型，是否能够通过模拟损伤来复现中风后失语症患者在图片命名中表现出的系统性错误模式，从而探索语言模型作为个体失语症数字孪生的潜力。

Result: 在费城命名测试的278名失语症患者数据上，模型扰动在七个响应类别中的六个（正确、语义、混合、无关、新语、无反应错误）产生了与临床比例相当的结果。扰动空间搜索显示，97.8%的患者在至少六类、79.5%的患者在所有七类错误上，其个体错误谱被成功复现，蒙特卡洛基线验证了匹配的有效性。

Insight: 创新点在于提出了一个通过扰动通用多模态语言模型来定量复现个体失语症错误模式的框架，这为将语言模型用作中风后失语症个体的“数字孪生”以模拟和理解其语言障碍提供了新途径。

Abstract: Aphasia following stroke commonly produces systematic naming errors with characteristic profiles, but whether general-purpose language models not designed for clinical simulation can reproduce these patterns remains untested. We investigated (1) whether lesions or controlled perturbations to a multimodal language model can reproduce different types of errors in picture naming, and (2) whether the framework can reproduce the complete error profile of individual persons with aphasia (PWAs). Using LLaVA 1.6, we evaluated perturbation configurations that varied the layer, proportion, and amount of noise applied to model units. We examined 278 PWAs on the Philadelphia Naming Test, classifying responses into seven categories using a validated neural classifier. Six of seven response categories (correct, semantic, mixed, unrelated, neologism, no response errors) emerged at clinically-comparable proportions across distinct parameter space regions, with formal paraphasia being the exception. Searching the perturbation space revealed configurations that reproduced the individual error profile in at least six of seven categories for 97.8% of PWAs and in all seven categories for 79.5% of PWAs. Monte Carlo baselines confirmed that this matching reflects joint inter-category structure rather than marginal overlap. These results establish a quantitative framework for reproducing individual aphasic error patterns in picture naming. They suggest the potential for language models to serve as digital twins of individuals with post-stroke aphasia.

[183] A Dynamic Scene Interaction Reasoning Framework for Scene-level Lane-Change Intention and Trajectory Prediction of Multiple Interacting Vehicles cs.AI | cs.CVPDF

Joshua Kofi Asamoah, Blessing Agyei Kyem, Eugene Denteh, Armstrong Aboah

TL;DR: 本文提出了一种动态场景图注意力框架（DSiGAT），用于预测局部交通场景中所有相关车辆的换道意图和未来轨迹。该方法将交通场景建模为时变交互图，通过图注意力消息传递捕获车辆间的动态依赖关系，并使用意图引导的解码器将预测的机动动作与对应运动轨迹关联。在多个真实数据集上的实验表明，该方法在意图预测准确率和轨迹预测精度方面均优于现有基线方法。

Details

Motivation: 现有换道预测方法通常只关注单个目标车辆，而多智能体预测方法往往仅通过未来位置描述场景演化，缺乏对每个车辆具体机动动作（如换道）的明确信息。这限制了自动驾驶系统对复杂交通场景演化的准确理解。

Result: 在NGSIM I-80、NGSIM US-101和highD数据集上的实验显示，DSiGAT在NGSIM I-80和US-101上的换道意图预测准确率分别达到90.12%和90.97%，轨迹预测RMSE相比最强基线降低了52.94%。同时，该方法产生了更低的智能体间碰撞率和联合位移误差，表明其能生成更一致的场景级预测。

Insight: 创新点在于将交通场景明确建模为时变交互图，通过显式的边特征编码车辆间的空间和运动学关系，并引入场景级一致性目标来鼓励生成协调的多车辆未来状态。从客观角度看，这种将意图预测与轨迹生成在场景层面统一建模的框架，为理解多智能体交互提供了更结构化的方法。

Abstract: Safe motion planning in advanced driver-assistance systems and autonomous vehicles requires an accurate understanding of how the surrounding traffic scene is likely to evolve. However, many existing lane-change prediction methods remain centered on a single target vehicle, while multi-agent forecasting approaches often describe scene evolution only through future positions and provide limited explicit information about the maneuver associated with each vehicle. This study proposes a dynamic scene graph attention framework that predicts the lane-change intention and future trajectory of every relevant vehicle within a local traffic scene. The scene is represented as a time-varying interaction graph in which vehicles are modeled as nodes and their spatial and kinematic relationships are encoded through explicit edge features. Temporal graph-attention message passing captures evolving inter-vehicle dependencies and pre-maneuver cues, while an intention-guided decoder links each predicted maneuver to its corresponding future motion. A scene-level consistency objective further encourages compatible multi-vehicle futures. Experiments on the NGSIM I-80, NGSIM US-101, and highD datasets demonstrate consistent improvements over competing baselines. DSiGAT achieves intention prediction accuracies of 90.12% and 90.97% on NGSIM I-80 and US-101, respectively, and reduces trajectory RMSE by up to 52.94% relative to the strongest baseline. It also produces lower inter-agent collision rates and joint displacement errors, indicating more coherent scene-level predictions. Ablation, sensitivity, robustness, and qualitative analyses further validate the contribution of the proposed components and the effectiveness of the scene-focused formulation.

[184] Exploring Agentic Workflows for Generating High Quality Math Visual Aids cs.AI | cs.CV | cs.HCPDF

Rizwaan Malik, Ashna Khetan, Isabel Sieh, Samin Khan

TL;DR: 本文提出了一种基于LLM代理的工作流，用于生成高质量的K-12数学视觉辅助图。该工作流通过让LLM代理评估生成图像的质量，并利用反馈进行迭代改进，旨在提高AI生成图表的准确性和教育适用性。

Details

Motivation: 当前AI工具（包括大语言模型）难以可靠地生成准确且符合教学要求的数学图表，因此在中学数学领域存在可靠图表生成的显著空白。

Result: 初步评估表明，该方法可以提高AI生成数学图表的可靠性和教育价值，但需在空间推理和图表特征覆盖等方面进一步改进。

Insight: 创新点在于引入了一个基于LLM代理的自我改进循环，通过生成质量保证问题并利用视觉语言模型进行迭代评估与反馈，以提升图表质量。从客观角度看，这种将生成与评估反馈结合的代理工作流为AI生成教育内容的质量控制提供了新思路。

Abstract: Mathematical diagrams play a crucial role in K 12 education, both as problem components and as scaffolding for student comprehension. However, current AI tools, including Large Language Models (LLMs), struggle to reliably generate accurate and pedagogically sound visual diagrams, even when provided with detailed descriptions. A significant gap therefore remains in the reliable generation of diagrams for middle school mathematics. To address this, we introduce an agentic workflow that enables LLM agents to evaluate the quality of generated visuals and use this feedback to iteratively improve their outputs. This self improvement loop aims to enhance the accuracy and educational appropriateness of AI generated diagrams. Our research investigates two questions. First, can LLMs accurately generate quality assurance questions for a visual aid given specific criteria for visual quality? Second, given valid quality assurance questions, can Vision Language Models effectively evaluate generated K 12 visual aids and use the resulting feedback to improve them iteratively? We conduct an exploratory evaluation of our agentic workflow and identify key areas for improvement, including stronger spatial reasoning and more comprehensive coverage of diagram features in the generated quality assurance questions. Our results provide preliminary evidence that this approach can improve the reliability and educational value of AI generated mathematical diagrams.

Table of Contents

cs.CL [Back]

[1] CLIR-Bench: Benchmarking Multimodal Question Answering over Irregular Clinical Time Series cs.CL | cs.AIPDF

[2] Global Merger-Arbitrage Forecasting with Language Models cs.CLPDF

[3] Index SLM Technical Report cs.CLPDF

[4] Silent Failures in Quantized LLM Reasoning: A Taxonomy-Based Analysis of Hollow Convergence and Failure Mode Shifts cs.CL | cs.LGPDF

[5] Efficiently Adapting Spoken Language Models for the Singaporean Context cs.CL | cs.AIPDF

[6] Cost of Reasoning in non-English Languages: A Case Study on Japanese cs.CL | cs.AI | cs.LGPDF

[7] Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders cs.CL | cs.IRPDF

[8] PTEI: Integrating Personality Traits to Enhance Emotional Intelligence in Large Language Models cs.CL | cs.IRPDF

[9] PolyInterview: An LLM-based Platform for Immersive Mock Interview Practice with Comprehensive Multimodal Assessment cs.CLPDF

[10] A Stepwise Questioning Expert-Editor Multi-Agent Framework for Long-Document Summarization cs.CL | cs.AIPDF

[11] Structured Thoughts For Improved Reasoning And Context Pruning cs.CL | cs.AIPDF

[12] Enjoy Your Talk: A Human-Centered Benchmark for Multi-Turn Dialogue with Decoupled User Simulation, Target Modeling, and Judging cs.CLPDF

[13] When Reasoning Hurts Legal Drafting: The Verbalization Bottleneck in Patent Claim Generation cs.CLPDF

[14] Articulate Intuition or Genuine Analysis? Benchmarking Epistemic Reliability in LLM-as-a-Judge Peer Reviews cs.CLPDF

[15] UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp cs.CLPDF

[16] Anamnesis: An Open-Source Platform for Large-Scale Backstory-Conditioned Survey Simulation cs.CL | cs.AI | cs.HCPDF

[17] MafiaScope: Non-Invasive, Time-Resolved Belief Probing for LLM Agents in Social Deduction Games cs.CL | cs.MA | cs.SIPDF

[18] Knowledge Distillation for Automated AI Tutor Evaluation cs.CLPDF

[19] Trust Before Fusion: QIMG-7 and Source-Aware Resolution for Polluted Multimodal RAG cs.CLPDF

[20] Diagnosing and Mitigating Thinking Collapse in On-Policy Self-Distillation cs.CL | cs.LGPDF

[21] Quantifying the Sources of Instability in LLM-Based Stance Analysis of Public Discourse cs.CLPDF

[22] Capabilities of Claude Fable 5 on Biomedical Challenge Problems cs.CLPDF

[23] EasyOPD: An Easy-to-use On-Policy Distillation Framework for Large Language Models cs.CLPDF

[24] Flout at Your Own Risk: LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry cs.CL | cs.AIPDF

[25] TIGER: Text-Conditioned Visual Gated Routing with Acceptance Alignment for Multimodal Speculative Decoding cs.CLPDF

[26] ProgramTab: Boosting Table Reasoning of LLMs via Programmatic Paradigm cs.CL | cs.AIPDF

[27] TreeThink: A Modular Tree Search Library for Mathematical Reasoning with LLMs cs.CLPDF

[28] Automated Textbook Auditing with Multi-Agent LLM Systems cs.CL | cs.AI | cs.CY | cs.MAPDF

[29] The In-Car Sign Language Corpus (ICSL): A Multi-Modal Resource for Constrained-Space Sign Language Recognition cs.CL | cs.CVPDF

[30] Agentic Routing: The Harness-Native Data Flywheel cs.CL | cs.AIPDF

[31] Beyond Sally-Anne: Evaluating Theory of Mind in LLMs using Epistemic Schelling Points cs.CL | cs.AIPDF

[32] Cross-Architecture LLM Ensembles, Feature-Based Reranking and Retrieval-Augmented Prompting for Legal Information Processing cs.CLPDF

[33] LightMem-Ego: Your AI Memory for Everyday Life cs.CL | cs.AI | cs.CV | cs.HC | cs.MMPDF

[34] Direct Image-to-Modern Vietnamese Translation of Han-Nom Manuscripts via Multimodal RLHF Preference Alignment cs.CL | cs.CVPDF

[35] RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM cs.CL | cs.AIPDF

[36] JobHop v2: A Large-Scale Career Trajectory Dataset from Unstructured Resumes cs.CLPDF

[37] MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning cs.CLPDF

[38] AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification cs.CLPDF

cs.CV [Back]

[39] ReflectWorld-MM: An Entity-Oriented Multi-Media Memory System for Open-Ended Video Streams cs.CV | cs.AIPDF

[40] Low-Power License Plate Detection and Recognition on a RISC-V Multi-Core MCU-Based Vision System cs.CV | eess.IVPDF

[41] Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs cs.CVPDF

[42] Towards Real-World Wearable Motion Reconstruction cs.CV | cs.LGPDF

[43] Lifelong Representations: A Survey on Continual Self-Supervised Learning for Vision Models cs.CV | cs.AIPDF

[44] Prompting-MammAlps: Fine-Grained Text-to-Video Retrieval for Camera-Trap Data cs.CV | cs.AI | q-bio.NC | q-bio.QMPDF

[45] A Dual-Stream Challenge-Response Protocol for Ocular Liveness Verification cs.CV | cs.CRPDF

[46] ShapKO: Shapley-Adaptive Modality Knockout for Robust Multimodal Learning cs.CV | cs.LGPDF

[47] Bridging the Catalog-to-Real Gap: Scalable Product Recognition via Multi-Stage Contrastive Learning cs.CVPDF

[48] Banshee: Target Switch Attacks on Gimbal-Stabilized Visual Tracking Systems via Acoustic Injection cs.CV | cs.CRPDF

[49] UniPose9D: Universal Category-Agnostic Object Pose Estimation cs.CVPDF

[50] Model Guides You How to Draw: Adaptive Visual Gating for Unified Multimodal Reasoning cs.CVPDF

[51] Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation cs.CV | cs.MM | cs.RO | eess.IVPDF

[52] CVKD-UDA: Cross-View Knowledge Distillation for 3D Unsupervised Domain Adaptive Segmentation cs.CVPDF

[53] LFD: Enabling Real-World Lensless Face Recognition with a Large-Scale Dataset cs.CV | eess.IVPDF

[54] DynaFilter: Cloud-driven Dynamic Filtering for Satellite Edge Intelligence cs.CV | cs.LGPDF

[55] WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understanding cs.CVPDF

[56] TextGaze: Prompting Gaze Target Estimation with Textual Scene Cues cs.CVPDF

[57] REVA-PO: Stabilizing Reinforcement Learning for Chest X-ray Report Generation cs.CVPDF

[58] EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generation cs.CV | cs.AIPDF

[59] BiLoG-Net: A Bi-Context Location-Guided Network for Breast Mass Segmentation and Malignancy Classification in Mammography cs.CV | cs.LGPDF

[60] CoSAG: Compact Semantic Anchor Gaussians via Training-Free Rate-Distortion Coding cs.CVPDF

[61] Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset cs.CVPDF

[62] What Does Your Short-Answer VQA Score Actually Measure? Evaluator-Dependent Instability in Multimodal Short-Answer Benchmarks cs.CV | cs.MMPDF

[63] Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classification cs.CVPDF

[64] InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generation cs.CVPDF

[65] ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing cs.CV | cs.CLPDF

[66] Structured Evidence Selection for Weakly Supervised Video Anomaly Detection cs.CVPDF

[67] Generalize LMMs to Versatile Visual Modalities via Fabricated Modality Synthesis cs.CVPDF

[68] Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift cs.CV | cs.AIPDF

[69] Imperceptible and Reversible Adversarial Examples against Vision-Language Models for Privacy Protection cs.CVPDF

[70] Gradient-Skipping Relevance Propagation for Efficient Explainability of Vision Transformers cs.CV | cs.LGPDF

[71] ABot-N1: Toward a General Visual Language Navigation Foundation Model cs.CV | cs.AI | cs.ROPDF

[72] Vertical Fusion: Condensing Internal Representations for Robust ViT Classification cs.CV | cs.LG | eess.IVPDF

[73] SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding cs.CV | cs.AIPDF

[74] Self-supervised Automatic Matting cs.CVPDF

[75] TVT-PAPD: Pathology-Aware Prototype Distillation for Self-Supervised Whole Slide Image Classification cs.CV | cs.LGPDF

[76] On the Real-World Generalisability of Optical Flow Models cs.CV | eess.IVPDF

[77] NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices cs.CVPDF