cs.CL [Total: 18]
cs.CV [Total: 114]
cs.DL [Total: 1]
cs.AI [Total: 9]
eess.SP [Total: 1]
cs.LG [Total: 11]
cs.MM [Total: 1]
cs.CR [Total: 2]
cs.RO [Total: 3]
cs.HC [Total: 2]

cs.CL [Back]

[1] Committed Before Reasoning: Behavioral Reproduction and Preliminary Activation-Level Evidence of Answer Pre-Commitment in an Open-Weight LLM cs.CL | cs.AIPDF

Heejin Jo

TL;DR: 该论文研究了大型语言模型在回答问题时可能存在的答案预先承诺现象，即模型在生成推理过程之前就已经‘决定’了答案，即使该答案与任务前提相矛盾。作者通过一个简单的汽车清洗场景（‘我应该步行还是开车？’）作为探针，在Qwen3-8B模型上进行了行为复现和初步的激活水平分析。研究发现，模型在绝大多数情况下（85-100%）会错误地承诺‘步行’答案，即使给予大量思考预算也无法修复。初步的激活证据表明，在答案文本生成之前，模型的隐藏状态就已经偏向于‘步行’答案。

Details

Motivation: 研究动机是探究聊天模型在推理过程中可能存在的‘先承诺后推理’的行为模式，即模型可能先确定一个答案，然后生成支持该答案的推理，即使该答案与任务的基本事实（如必须开车去洗车）相矛盾。这揭示了模型推理过程可能存在的缺陷。

Result: 在Qwen3-8B模型上的行为复现结果显示，在五种不同的系统提示条件下，模型错误地承诺‘步行’答案的比例高达85%到100%（贪婪解码为100%），即使给予4096个token的思考预算也无法纠正。初步的激活水平证据显示，在答案生成前，模型隐藏状态对‘步行’的读出概率显著高于中性基线（68% vs. 17%），且这种偏向并非源于词汇偏见或文本恢复。

Insight: 论文的创新点在于：1）设计了一个简洁的探针任务来揭示LLM中潜在的答案预先承诺行为；2）采用了一种无需任务特定训练、基于预训练激活的‘预言机’方法来探测模型隐藏状态，为理解模型内部决策过程提供了初步证据；3）强调了在分析激活结果时，问题措辞（如开放式与封闭式问题）作为正控制的重要性，以避免对负结果做出错误解释。这为模型可解释性研究提供了新的方法论视角。

Abstract: Chat models sometimes commit to an answer and then produce reasoning that justifies it rather than deriving it – even when the answer contradicts a task premise. We study a minimal probe: “I want to wash my car. The car wash is 100 meters away. Should I walk or drive?” Only drive works (the car must be at the car wash), yet models overwhelmingly recommend walking. (1) Behavioral reproduction: on Qwen3-8B across five system-prompt conditions (210 rollouts), the wrong commitment occurs in 85-100% of sampled rollouts per condition and 100% of greedy rollouts, in both thinking and non-thinking modes; a 4,096-token thinking budget does not repair it. (2) Preliminary activation-level evidence: probing hidden states with a pretrained, training-free activation oracle (no task-specific probe training) at positions before the answer text is emitted, “walk” read-outs exceed a neutral-context baseline (68% vs. 17%; walk-committing rollouts p=.005, drive-committing rollouts p=.005, Fisher exact) – notably, rollouts that eventually answer drive also read as walk-leaning before commitment (5/6). The oracle’s default on unrelated content is “drive” (83%), so the read-outs are not lexical bias; stratifying by literal walk/drive occurrence shows they are not text recovery either (spans containing “drive” still read out walk; in balanced lexical fields, per-rollout walk-majorities beat a per-prompt neutral baseline 15/22 vs. 1/8, p=.01; drive-committing rollouts 6/6, p=.002). Samples are small and the within-rollout positional gradient is not significant (p=.34); we frame these results as preliminary. (3) Methodological: with fixed oracle, activations, and positions, question wording alone moves a positive control from 2/16 (open question) to 11/16 (closed); negative oracle results are uninterpretable without per-wording positive controls.

[2] NOWJ@COLIEE 2026: Adaptive Pipelines for Legal Retrieval and Reasoning cs.CLPDF

Thuong-Hieu Ngo, Hoang-Trung Nguyen, Huu-Dong Nguyen, Xuan-Bach Le, Le-Dung Nguyen

TL;DR: 本文介绍了NOWJ团队在COLIEE 2026竞赛所有五个任务中采用的方法与结果。针对法律案例检索任务，提出了一个包含候选过滤、互补嵌入模型密集检索、微调生成式重排与MLP分类重排、以及自适应查询截止预测的四阶段流程。对于法律案例蕴含任务，结合了BM25过滤、T5重排和基于LLM的蕴含验证与共识集成。在法律条文检索与蕴含任务中，采用了检索增强生成框架，结合密集检索、基于注意力的重排和少样本提示的LLM推理。在法律文本蕴含任务中，引入了动态路由流程，根据查询难度将案例分配给平衡的少样本求解器或结构化的零样本思维链求解器。在试点任务法律判决预测中，结合了分层Transformer、CRF层、论据关系挖掘和概率论据图推理。

Details

Motivation: 旨在解决COLIEE竞赛中复杂的法律信息检索与推理任务，通过构建自适应、多阶段的混合流程来应对不同子任务的独特挑战，提升法律AI系统的准确性和鲁棒性。

Result: 论文总结了团队在COLIEE 2026竞赛五个任务上的方法论，但摘要中未提及具体的定量结果（如准确率、F1分数）或与基准/SOTA的比较。

Insight: 主要创新点在于为不同法律任务设计了模块化、自适应的混合流程，灵活结合了传统检索、密集检索、重排、微调模型、LLM推理以及难度感知的动态路由策略，展示了针对复杂领域问题集成多种技术路径的有效工程实践。

Abstract: This paper presents the methodologies and results of the NOWJ team’s participation across all five tasks of the COLIEE 2026 competition. For Task 1 (Legal Case Retrieval), we propose a four-stage pipeline comprising candidate filtering, dense retrieval with complementary embedding models, cross-encoder reranking via fine-tuned generative rerankers and MLP-based pairwise classification, and adaptive per-query cutoff prediction. For Task 2 (Legal Case Entailment), we combine BM25 filtering, T5-based reranking, and LLM-based entailment verification with consensus ensemble. For Task 3 (Statute Law Retrieval and Entailment), we adopt a retrieval-augmented generation framework with dense retrieval, attention-based reranking, and few-shot-prompted LLM reasoning. For Task 4 (Legal Textual Entailment), we introduce a dynamic routing pipeline that classifies query difficulty and dispatches cases to either a balanced few-shot solver or a structured zero-shot chain-of-thought solver. For the Pilot Task (Legal Judgment Prediction), we combine hierarchical transformers with CRF layers, argument relation mining, and probabilistic argumentation graph reasoning.

[3] Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generation cs.CLPDF

Mingqiao Mo, Yunlong Tan, Hao Zhang

TL;DR: 本文提出了一种名为科学可行性控制（SFC）的图结构共形预测框架，旨在为大型语言模型生成科学内容提供统计保证。该方法通过将科学推理分解为原子化的绝对-连贯-事实性单元，并进行渐进式验证，以解决早期科学错误污染后续推理的级联效应。

Details

Motivation: 大型语言模型在生成技术内容时经常违反基本科学原理，这削弱了其在科学应用中的可靠性。因此，需要一种方法来保证科学推理的有效性。

Result: 在PhyX多模态物理、MATH、ScienceQA和ARC Challenge等科学推理基准测试中，SFC在PhyX物理推理上达到了50.1%的准确率，显著优于DeepSeek-R1（49.8%）和GPT-4（45.8%），同时以α=0.10的置信水平提供了91.7%的科学有效性保证，并在多个模型架构上将违反科学定律的情况减少了73%。

Insight: 创新点在于将共形预测与图结构结合，对科学推理进行依赖关系建模和渐进式验证，而非孤立处理每个主张。这提供了形式化的统计保证，并通过动态分支在检测到违规时切换到替代生成路径，从而系统性提升科学内容的可靠性。

Abstract: Large language models frequently violate fundamental scientific principles when generating technical content, undermining their reliability in scientific applications. We introduce Scientific Feasibility Control SFC, a graph-structured conformal prediction framework that provides statistical guarantees for scientific reasoning validity through progressive absolute-coherent-factuality validation. Our approach decomposes scientific reasoning into atomic absolute-coherent-factuality units requiring both individual correctness against physical laws and logical substantiation from preceding context, addressing the cascade effect where early scientific errors contaminate subsequent reasoning steps. Unlike independence-based methods that treat claims in isolation, SFC models logical dependencies as approximate deducibility graphs and operates through real-time validation with dynamic branching when scientific violations are detected, the system branches to alternative generation paths using verified context as foundation. We demonstrate SFC across established scientific reasoning benchmarks including PhyX multimodal physics, MATH, ScienceQA, and ARC Challenge, achieving 50.1 percent accuracy on PhyX physics reasoning, substantially outperforming recent reasoning models including DeepSeek-R1 49.8 percent and GPT-4 45.8 percent while providing 91.7 percent scientific validity with formal conformal coverage guarantees at alpha equals 0.10 confidence level and reducing scientific law violations by 73 percent across multiple model architectures.

[4] Diagnosing Correctness Probes under Self-Judgement Confounding cs.CL | cs.LGPDF

Yi-Long Lu

TL;DR: 该论文研究了语言模型隐藏状态读出信号在预测输出正确性时的语义模糊问题，指出传统基于正确性标签的对比方法容易受到模型自我判断的干扰。通过构建客观正确性与自我判断相冲突的案例，论文发现隐藏状态中最可迁移的成分与自我判断而非客观正确性相关。

Details

Motivation: 动机在于揭示语言模型隐藏状态读出信号在预测输出正确性时存在的根本性混淆：由于客观正确性通常与模型自我判断一致，解码出的信号在语义上是模糊的，无法区分其究竟反映了客观正确性还是自我判断。

Result: 在数学推理和事实回忆任务上，对四个参数规模达140亿的指令调优模型进行测试，发现与自我判断相关的方向在所有模型的跨域迁移中均优于随机水平，而与客观正确性相关的方向在所有对应条件下的点估计均低于随机水平。该结果在MMLU和TruthfulQA基准测试中无需目标域方向拟合也得以保持。

Insight: 创新点在于通过构建客观正确性与自我判断相冲突的‘诊断探针’来解耦这两种信号，并系统证明了隐藏状态中最稳定可迁移的成分与模型自我判断而非客观正确性语义相关联。这一发现挑战了‘可迁移性即代表客观正确性语义’的常见假设，为理解模型内部表示提供了新视角。

Abstract: Hidden-state readouts can predict whether language-model outputs are correct, but objective correctness (OC) usually agrees with the model’s own self-judgement (SJ), leaving the decoded signal semantically ambiguous. We construct conflict cases in which OC and SJ predict opposite readout orderings. On high-confidence disagreements, conventional correctness-labelled contrasts often rank incorrect/self-endorsed responses above correct/self-rejected responses, following SJ rather than OC. We estimate factorial SJ- and OC-associated directions and evaluate their polarity across mathematical reasoning and factual recall. Across four instruction-tuned models up to 14B parameters, the SJ-associated direction transfers above chance in both cross-domain directions for every model, whereas the OC-associated direction has a below-chance point estimate for the expected OC ordering in every corresponding condition. This transfer asymmetry develops across middle-to-late layers, persists under answer-likelihood, sequence-length, and null-direction controls, and extends to MMLU and binary TruthfulQA without target-domain direction fitting. Across the studied models and diagnostic subsets, the most reliably transferable component preserves SJ-associated polarity. Transferability alone therefore does not establish objective-correctness semantics.

[5] Group Entropy-Controlled Policy Optimization cs.CLPDF

Guangran Cheng, Chengqi Lyu, Songyang Gao, Wenwei Zhang, Kai Chen

TL;DR: 本文提出了一种名为GEPO（Group Entropy-Controlled Policy Optimization）的强化学习方法，作为对GRPO的轻量级扩展。该方法通过利用从分组样本中估计的组熵，进行熵条件化的非对称优势塑形，以解决在异构任务混合训练中，全局或令牌级熵调控不足以及GRPO式归一化优势存在熵依赖偏差的问题。实验表明，GEPO在多个基准测试上持续优于GRPO和近期其他熵控制方法。

Details

Motivation: 在大语言模型对齐过程中，强化学习常在异构任务混合上进行，这导致同一策略下产生不同的熵状态，使得全局或令牌级的熵调控无法满足异构的探索需求。这种异质性进一步使得GRPO风格的优势归一化产生熵依赖偏差，导致不同提示组间的优势信号在统计上不可比。

Result: 在两个基础模型上，跨越数学、物理、科学、代码生成和指令遵循等十三个基准测试的广泛实验表明，GEPO始终优于GRPO和近期的熵控制方法，在保持任务特定探索水平的同时，实现了跨任务的平衡改进。

Insight: 论文宣称的创新点在于提出了组熵控制策略优化（GEPO），利用分组熵统计进行熵条件化的非对称优势塑形（例如，在低熵组衰减正优势以减少过度利用，在高熵组衰减负优势以保持探索）。从客观角度看，其核心创新在于将熵调控从全局或令牌级细化到任务组级别，并利用历史熵统计自适应地调整优势信号，从而更精细地处理异构任务混合训练中的探索-利用权衡问题。

Abstract: Entropy control has become an effective tool in reinforcement learning (RL) of large language models (LLMs), helping balance exploration-exploitation trade-off during alignment process. Such RL paradigm is often conducted on mixtures of heterogeneous tasks, which induce distinct entropy regimes under the same policy, making global or token-level entropy regulation insufficient to corresponding heterogeneous needs of exploration. This heterogeneity further makes GRPO-style normalized advantages induce an entropy-dependent bias, making advantage signals across prompt groups statistically non-comparable. To address this issue, we propose Group Entropy-Controlled Policy Optimization (GEPO), a lightweight extension to GRPO that uses group entropy, estimated from existing grouped samples to perform entropy-conditioned asymmetric advantage shaping. GEPO attenuates positive advantages in low-entropy groups to reduce over-exploitation, and negative advantages in high-entropy groups to preserve exploration, with adaptive thresholds derived from historical entropy statistics. Extensive experiments on two base models across thirteen benchmarks spanning mathematics, physics, science, code generation, and instruction following show that GEPO consistently outperforms GRPO and recent entropy-controlled methods, delivering balanced cross-task improvements while preserving task-specific exploration levels throughout training.

[6] Trace-Based On-Policy Distillation for Masked Diffusion Language Models cs.CL | cs.AI | cs.LGPDF

Haolin Ren, Ziyang Huang, Chenhao Yuan, Jun Zhao, Kang Liu

TL;DR: 本文提出了基于轨迹的在线策略蒸馏（TOPD）方法，用于提升扩散大语言模型（dLLMs）的推理能力。该方法通过监督模型自身去噪轨迹中的对齐标记决策，将教师模型的推理能力蒸馏到目标dLLM中，无需奖励估计。在数学推理基准测试中，TOPD使模型在减少计算开销的同时达到了与强化学习训练模型相当的精度。

Details

Motivation: 扩散大语言模型（dLLMs）作为自回归生成的有前景替代方案，其面向推理的后训练面临挑战：监督微调（SFT）需要密集但通常是离线策略的掩码状态，而强化学习（RL）依赖稀疏奖励或价值建模。本文旨在解决这些限制，提出一种无需奖励估计的教师监督框架来提升dLLMs的推理能力。

Result: 在数学推理基准MATH500上，TOPD使SDAR-4B-Chat模型达到了与RL训练的TraDo-4B-Instruct模型相当的准确率，静态评估提升+5.7，动态评估提升+4.5。同时，TOPD仅需1/4的展开轮数，实现了估计96.0倍的到准确率模型计算加速，达到了与SOTA RL方法相当的性能水平。

Insight: 创新点在于提出基于轨迹的在线策略蒸馏（TOPD），通过监督模型自身去噪轨迹中的对齐标记决策，结合反向KL散度目标，实现了密集教师监督与模型自身去噪状态的对齐。这避免了强化学习的奖励建模复杂性，同时提升了训练效率，为扩散模型的推理能力蒸馏提供了新思路。

Abstract: Diffusion large language models (dLLMs) are a promising alternative to autoregressive generation. However, reasoning-oriented post-training for dLLMs remains challenging. Supervised fine-tuning (SFT) for dLLMs requires dense but often off-policy masked states, while reinforcement learning (RL) relies on sparse rewards or value modeling. This paper proposes \textbf{trace-based on-policy distillation (TOPD)}, a teacher-supervised framework that transfers reasoning ability to a target dLLM without reward estimation. The key idea is to supervise a dLLM on its own denoising trajectory, focusing on the trace-aligned token decisions that form the final response. Specifically, TOPD samples on-policy diffusion trajectories from the target dLLM, obtains teacher token distributions from a teacher model on the corresponding partially denoised states, and updates the target dLLM with a token-level Reverse Kullback-Leibler (Reverse-KL) objective. This design preserves dense teacher supervision while aligning training with the model’s own denoising states. On mathematical reasoning benchmarks, TOPD enables SDAR-4B-Chat to match the MATH500 accuracy of its RL-trained counterpart TraDo-4B-Instruct, with gains of +5.7 under static evaluation and +4.5 under dynamic evaluation. Compared with the RL-trained counterpart, TOPD achieves this with 4$\times$ fewer rollout rounds, corresponding to an estimated 96.0$\times$ to-accuracy model-compute speedup.

[7] Learning from Synthetic Data without Model Collapse in Iterative Instruction Tuning cs.CLPDF

Xiaonan Luo, Yue Huang, Kehan Guo, Ping He, Chuan Zou

TL;DR: 本文提出KITE框架，通过两阶段方法（失败引导的数据生成和边界感知的不确定性筛选）解决迭代指令微调中模型崩溃问题，实验表明该方法能比现有基线更稳定地提升模型性能。

Details

Motivation: 解决迭代指令微调中模型崩溃问题，特别是模型在合成数据训练中出现的‘能力极化’现象（强技能被强化而弱技能进一步退化），而非简单的性能均匀下降。

Result: 在多个数据集和开源大语言模型上的实验表明，KITE框架相比现有合成数据基线方法能实现更稳定的性能提升。

Insight: 创新点在于将模型崩溃重新定义为能力极化现象，并提出通过失败案例引导数据生成和边界不确定性筛选的组合策略来诊断和缓解崩溃，为迭代数据优化提供了可操作粒度的方法。

Abstract: Model collapse is a central challenge in learning from synthetic data: as later-generation large language models (LLMs) are trained on an increasing proportion of model-generated data, performance can degrade due to narrowed coverage and accumulated bias. Existing work mainly studies how to bound this degradation. In iterative model evolution, however, the more meaningful objective is to ensure that each successive model improves over its predecessor, which requires diagnosing collapse at a granularity that is actionable for data curation. We study this problem in synthetic data self-improving for instruction tuning. We show that collapse in this setting is not simply uniform performance degradation, but can appear as a polarization of competence, where synthetic training reinforces already strong skills while further degrading weak ones. Motivated by this observation, we propose KITE (Knowledge-boundary Instruction Tuning via Exploration), a two-stage framework that combines failure-guided data generation with boundary-aware uncertainty curation. Experiments across several datasets and multiple open-source LLMs show that KITE yields more stable improvement than strong synthetic-data baselines.

[8] Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reports cs.CLPDF

Siyuan Zheng, Yifan Duan, Chao Xue, Flora D. Salim

TL;DR: Scope3Trace是一个基于证据的信息提取框架，旨在从ESG和可持续发展报告中提取可解释、可追溯的Scope 3温室气体排放信息。该框架集成了文档信息提取流程，包括PDF收集与OCR解析、LLM辅助的页面定位与表格重建，以及结合规则与LLM的混合提取方法，并进行基于证据的验证。

Details

Motivation: 解决Scope 3排放占企业碳足迹主要部分但难以大规模分析的问题，原因是披露稀疏、报告格式异构且证据可追溯性有限；现有方法依赖大语言模型提取但缺乏明确证据基础或需昂贵人工标注。

Result: 在可持续发展报告中提取Scope 1-3总量和类别级披露方面实现了高准确率，并贡献了一个双层级、基于证据的多模态数据集。

Insight: 创新点在于提出证据基础的验证机制，结合规则与LLM的混合提取方法，以及构建多模态数据集以提高提取可靠性和透明度；客观分析认为其框架设计增强了异构报告处理的自动化与可解释性。

Abstract: Scope 3 greenhouse gas (GHG) emissions account for the majority of corporate carbon footprints, yet remain difficult to analyze at scale due to sparse disclosures, heterogeneous report document formats, and limited evidence traceability. Existing approaches typically rely on large language models to extract emissions information from ESG reports, but often lack explicit evidence grounding or depend on costly manual annotation and verification to ensure extraction reliability. To address these challenges, we propose Scope3Trace, an evidence-grounded information extraction framework designed to extract interpretable and traceable Scope 3 emissions information from real-world ESG and sustainability reports. The framework integrates a document information extraction pipeline that performs PDF collection and OCR parsing, LLM-assisted page localization and table reconstruction, and hybrid rule-LLM extraction of organization- and building-level emissions disclosures with evidence-grounded verification. Building upon this framework, we further contribute a dual-level, evidence-grounded, multimodal dataset comprising organization-level Scope 3 disclosures extracted from heterogeneous sustainability reports. Scope3Trace enables reliable extraction and transparent integration of heterogeneous sustainability disclosures, achieving high accuracy in extracting Scope 1-3 totals and category-level disclosures from sustainability reports.

[9] Robust Summarization of Doctor-Patient Conversations: TalTech Systems for the Beyond Transcription Challenge cs.CL | eess.ASPDF

Aivo Olev, Tanel Alumäe

TL;DR: 本文介绍了TalTech团队在Beyond Transcription Challenge（BeTraC）中的提交系统，该挑战要求直接从长篇医患对话录音生成SOAP病历，无需中间转录。团队筛选了开源的语音大语言模型，对Voxtral Mini（轻量级赛道）和Voxtral Small（重量级赛道）进行了LoRA监督微调，并采用基于挑战指标Open Medical Concept F1作为奖励的DAPO强化学习。系统在两个赛道均排名第一，且独立LLM评估显示其幻觉率最低，表明针对概念匹配指标的强化学习不会损害事实可靠性。

Details

Motivation: 解决直接从医患对话录音生成SOAP病历的挑战，避免转录步骤，并确保生成的医疗摘要具有鲁棒性和低幻觉率。

Result: 在BeTraC挑战的两个赛道（轻量级和重量级）中均获得第一名；使用Open Medical Concept F1作为奖励的强化学习方法在独立LLM评估中实现了所有提交中最低的幻觉率。

Insight: 创新点包括：将语音大语言模型直接应用于长音频医疗对话摘要，结合LoRA微调和基于特定医疗概念指标的强化学习（DAPO），证明了从文本转录微调到语音输入的迁移有效性，并提升了在领域外真实录音上的鲁棒性。

Abstract: This paper describes TalTech’s submissions to the Beyond Transcription Challenge (BeTraC), which requires generating SOAP notes directly from long doctor-patient conversation recordings, without intermediate transcription. After screening open-weight speech LLMs for long-audio robustness, we adapted Voxtral Mini (lightweight track) and Voxtral Small (heavyweight track) with LoRA supervised fine-tuning followed by DAPO reinforcement learning that uses the challenge metric, Open Medical Concept F1, as its reward. Our systems ranked first in both tracks, and an independent LLM-as-a-judge evaluation showed the lowest hallucination rate among all submissions, indicating that reinforcement learning against a concept-matching metric need not compromise factual reliability. We also find that fine-tuning on text transcripts transfers well to speech input and appears to improve robustness on out-of-domain real recordings.

Yubo Gao, Haotian Wu, Xiaoyu Xu, Yibo Yan, Hong Chen

TL;DR: 本文挑战了多模态情感分析中缺失模态必须修复的普遍假设，通过样本级的神谕分析发现，并非所有样本都需要完整模态输入，不同模态子集对不同样本的预测效果更优。基于此，作者提出了SIEVE方法，将’是否修复缺失模态’转化为一个样本级、可学习的决策，该方法作为一个即插即用的决策模块，可与任何修复方法结合使用。

Details

Motivation: 现有方法通常遵循’先修复后分析’的范式来处理多模态情感分析中的模态缺失问题，但作者质疑这一假设的必要性，即是否每个缺失的模态都必须被修复。

Result: 在CMU-MOSI和IEMOCAP数据集上的实验表明，SIEVE方法在不同缺失率下，均能持续提升代表性修复骨干模型的性能，并接近样本级双分支可达到的最优性能。

Insight: 核心创新在于揭示了模态效用是样本依赖的，并据此将’是否修复’转化为一个显式的、可学习的决策问题。SIEVE通过一个证据门控机制，联合建模充分性和认知不确定性，实现了一个与具体修复方法无关的即插即用决策模块，这是一个新颖的视角和实用的框架设计。

Abstract: Existing methods for multimodal sentiment analysis (MSA) under missing modalities usually follow a repair-first paradigm. We revisit this assumption and ask: \emph{should every missing modality be repaired?} A per-sample oracle analysis shows the answer is not always: full-modality input is optimal for only a small fraction of samples, and every modality subset is preferred by some samples. These results suggest that adding or repairing modalities may not always improve prediction, and that the utility of each modality is sample-dependent. Building on this finding, we propose \textbf{S}ufficiency-\textbf{I}nformed \textbf{E}vidential \textbf{V}al\textbf{vE} (\textbf{SIEVE}) that turns ``whether to repair’’ into an explicit, learnable decision at the sample level. SIEVE compares a direct prediction branch with a repair branch, derives an empirical sufficiency signal from their per-sample loss gap, and routes each input through an evidential gate that jointly models sufficiency and its epistemic uncertainty. SIEVE is repair-agnostic: it operates as a plug-and-play decision on top of any explicit or implicit repair module, without modifying its internal design. Experiments on CMU-MOSI and IEMOCAP show that SIEVE consistently improves representative repair backbones across evaluated missing rates, and approaches the per-sample dual-branch achievable optimum.

[11] Debate-on-Graph: Reliable and Adaptive Reasoning of Large Language Model on Uncertain Knowledge Graph cs.CL | cs.AIPDF

Peiji Yu, Xin Chen, Tianxing Wu

TL;DR: 本文提出了一种名为Debate-on-Graph（DoG）的新框架，旨在利用不确定知识图谱（UKG）来增强大语言模型（LLM）在问答任务中的可靠推理能力。该框架首先通过启发式搜索算法从UKG中提取可靠且与问题相关的子图以减少噪声，然后引入多智能体辩论机制，通过自适应的对抗性辩论来生成可靠答案。

Details

Motivation: 大语言模型在处理问答任务时存在幻觉和知识缺失问题，而现有的知识图谱增强方法无法有效处理图谱中的噪声和错误，这反而可能放大幻觉。不确定知识图谱（UKG）通过置信度分数量化不确定性，为解决这一挑战提供了方向。

Result: 在四个基准问答数据集上的大量实验表明，DoG在现有LLM推理方法和基于知识图谱的基线方法中实现了最先进的性能，同时实现了可靠且自适应的推理。

Insight: 创新点在于将不确定知识图谱（UKG）与LLM结合，通过启发式搜索提取可靠子图以减少噪声，并引入多智能体辩论机制进行自适应对抗性推理，从而充分利用UKG知识的同时保证证据的可靠性，提升了问答系统的鲁棒性。

Abstract: Large language models (LLMs) have demonstrated remarkable capabilities in natural language processing. However, LLMs often suffer from hallucinations and lack of relevant knowledge when dealing with question answering (QA) tasks. To mitigate these issues, knowledge graphs (KGs) have been utilized to enhance LLM reasoning. Nevertheless, KGs often contain noise and errors, while existing KG-enhanced LLM approaches are generally unable to identify and filter such noisy and erroneous content, which can instead amplify hallucinations and pose challenges for reliable reasoning. Uncertain knowledge graphs (UKGs), which associate each triple with a confidence score to quantify uncertainty, offer a promising direction to address this challenge. Compared with prior work, we investigate how to leverage UKGs to support LLMs for QA. We propose Debate-on-Graph (DoG), a new framework that enables LLMs and UKGs to collaborate adaptively for reliable reasoning. Specifically, we first design a heuristic search algorithm tailored for UKGs to extract reliable and question-relevant subgraphs, thereby reducing noise and errors in retrieved knowledge. We then introduce a Multi-Agent Debate mechanism, which yields reliable answers through adaptive adversarial debates, aiming to fully exploit the knowledge in UKGs while preserving the reliability of retrieved evidence. Extensive experiments on four benchmark QA datasets show that DoG achieves state-of-the-art performance over existing LLM reasoning methods and KG-based baselines, while enabling reliable and adaptive reasoning. Our code is available at https://github.com/seucoin/Debate-on-Graph.

[12] How Reliable Are Multimodal Signals of Conversational State? Evidence from Remote Dyadic Collaborative Tasks cs.CLPDF

Tahiya Chowdhury

TL;DR: 本文提出一个三维评估框架（预测准确性、跨任务泛化性和重测可靠性），用于评估从远程协作对话中提取的多模态特征（交互、声学和语言特征）在测量认知负荷和对话权力等对话状态时的可靠性。研究发现，没有单一特征族在所有三个维度上均占优：语言特征对认知负荷预测最准但跨任务泛化差；声学特征在控制说话人身份后可靠性骤降；交互特征是唯一真正可靠的特征。

Details

Motivation: 从多模态行为中测量对话状态（如认知负荷和对话权力）需要既具预测性又在不同任务背景下可靠的特征，但现有研究缺乏对特征可靠性的系统评估。

Result: 在AVCAffe数据集（53个二人组，9个任务）上的实验表明：语言特征对认知负荷预测准确性最高（但跨任务泛化性差）；控制说话人身份后，声学特征的可靠性降至接近零；交互特征在所有条件下保持可靠；所有条件下对话权力角色的分类准确率均接近随机基线。

Insight: 主要创新点包括：提出了一个综合评估特征预测性、泛化性和可靠性的三维框架；揭示了语言特征对任务特定词汇的敏感性以及声学特征对说话人身份的依赖性；证明了交互特征（如发言主导权）是预测对话状态最可靠的信号，并强调了说话人归一化和多维评估对鲁棒特征选择的重要性。

Abstract: Measuring conversational states such as cognitive load and conversational power from multimodal behavior requires characteristic features that are not only predictive but also reliable across task contexts. We present a three-dimensional evaluation framework assessing predictive accuracy, cross-task generalizability, and test-retest reliability, applied to interactional, acoustic, and linguistic features extracted from dyadic conversations during collaborative tasks performed over a video-conferencing platform (AVCAffe dataset; 53 dyads, 9 tasks). Our results show that no single feature family dominates all three dimensions. Linguistic features show the highest predictive accuracy for cognitive load but collapse under cross-task evaluation, revealing sensitivity to task-specific vocabulary. Additionally, acoustic reliability, often reported as evidence of feature stability, degrades once speaker identity is controlled, confirming that standard prosodic features measure vocal characteristics rather than conversational state. Interaction features provide the only genuinely reliable signal, unchanged after speaker normalization. Interestingly, classifying power role remained near chance baseline across all conditions, indicating limitations of task-level aggregated behavior for predicting power role in conversation. Our findings reveal three insights: (1) linguistic features predict best but generalize poorly across task contexts; (2) acoustic reliability collapses to near-zero once speaker identity is controlled, challenging standard evaluation practice; and (3) interaction features provide the only genuinely reliable signal, with floor dominance predicting within-dyad cognitive load asymmetry. These results argue for speaker normalization and multi-dimensional evaluation as prerequisites for context-aware, robust multimodal feature selection in conversational systems.

[13] Oracle Gap and Signal Fidelity: A Fixed-Pool Diagnostic for Test-Time Collaboration cs.CL | cs.AIPDF

Jie Hu

TL;DR: 本文提出了一种用于评估测试时协作（如自洽性、最佳N选择、评判模型等）效果的诊断框架，将协作视为候选选择问题而非多智能体拓扑的固有属性。通过将协作的净增益分解为可恢复质量、验证信号覆盖、条件选择质量和已正确输出的损害等可测量因素，揭示了协作增益受限于预言机间隙和信号保真度。在LiveCodeBench、MATH Level-5和GPQA-Diamond等基准上的实验表明，该框架可提供实用的部署前诊断。

Details

Motivation: 测试时协作（如自洽性、最佳N选择等）虽被广泛认为能提升LLM推理能力，但其增益不均衡甚至有时为负。本文旨在探究无训练协作何时应被预期有效，并提供一个可测量的诊断框架来理解协作增益的边界。

Result: 在LiveCodeBench上，公开测试验证器（MCC 0.825）比首次采样基线提升8.14个百分点；生成测试验证器（MCC 0.248）提升2.70个百分点，与LLM选择器统计上无差异，但损害率接近零（选择器为4.69%）。在MATH上，符号答案等价选择器比自洽性提升4.67个百分点，而LLM选择器为负增益。在GPQA-Diamond上，可恢复质量仅为3.03%，且87.54%的候选池答案相同。

Insight: 创新点在于将测试时协作重构为候选选择问题，并提出了可测量的分解因素（预言机间隙、信号保真度等）来诊断协作效果。客观来看，该框架强调了协作增益受任务、模型和采样配置共同影响，为部署前评估提供了实用工具，有助于避免盲目投资协作策略。

Abstract: Test-time collaboration, including self-consistency, best-of-N selection, critic models, and verifier pipelines, is often credited with broadly improving LLM reasoning, yet its gains are uneven and sometimes negative. We ask when training-free collaboration should be expected to help. For a fixed candidate pool, we decompose a selector or verifier’s net gain into measurable factors: recoverable mass, verification-signal coverage, conditional selection quality, and harm to already-correct outputs. This reframes collaboration as a candidate-selection problem rather than as an intrinsic property of a multi-agent topology. Across LiveCodeBench, MATH Level-5 hard subjects, and GPQA-Diamond, gains are bounded first by the oracle gap and then by signal fidelity, which we measure directly as candidate-level agreement between verifier verdicts and official labels. On LiveCodeBench, a public-test verifier (MCC 0.825) gains +8.14 percentage points (pp) over a first-sample baseline; a generated-test verifier (MCC 0.248) improves by +2.70pp and is not statistically distinguishable from an LLM selector, but operates at near-zero harm versus the selector’s 4.69% harm rate. On MATH, a symbolic answer-equivalence selector beats self-consistency by +4.67pp, while LLM selectors are negative. On GPQA-Diamond, recoverable mass is only 3.03% and 87.54% of candidate pools are answer-identical; a weaker model’s pools shrink both further, suggesting that oracle gap is a joint property of task, model, and sampling configuration. Our framework yields a practical pre-deployment diagnostic: estimate the oracle gap, then measure coverage, signal fidelity, and harm before investing in collaboration.

[14] C$^2$KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inference cs.CLPDF

Chuheng Du, Junyi Chen, Hanlin Tang, Kan Liu, Tao Lan

TL;DR: 本文提出了C^2KV框架，旨在解决大语言模型长上下文推理中KV缓存存储和访问成本高的问题。该框架通过联合优化KV提取和推理时拼接，学习一个可组合、可压缩且位置无关的KV缓存流形，从而显著减少KV缓存的存储和传输开销。

Details

Motivation: 动机是缓解长上下文LLM推理中日益增长的成本，现有KV缓存重用方法主要关注计算节省，但忽略了存储和访问大型KV缓存这一关键瓶颈，且单纯将压缩与非前缀KV重用结合会导致严重的精度下降。

Result: 在多个长上下文基准测试和模型系列上的广泛实验表明，C^2KV显著降低了KV缓存的存储和传输成本，在长上下文下实现了高达17倍的推理加速，同时保持了生成质量。

Insight: 创新点在于提出了一个统一的非前缀KV重用框架，通过轻量级侧挂提取器、可学习的压缩令牌和结构化注意力流，实现了模块化且位置无关的KV表示，并采用压缩-拼接协同训练策略来对齐提取时表示与下游重用行为。

Abstract: Long-context inference is central to modern large language model (LLM) applications such as retrieval-augmented generation and multi-document reasoning. To mitigate the growing inference cost, recent work has explored key-value (KV) cache reuse to reduce redundant prefill computation. However, existing reuse methods primarily focus on computation savings and overlook a critical bottleneck in long-context LLM serving: the cost of storing and accessing large KV caches. While KV compression appears to be a natural complement, naively combining compression with non-prefix KV reuse often leads to severe accuracy degradation. In this work, we propose C$^2$KV, a unified framework for non-prefix KV reuse that jointly optimizes KV extraction and inference-time concatenation. C$^2$KV learns a composable and compressed KV cache manifold that is explicitly designed to be position-agnostic. Our approach introduces a lightweight sidecar Extractor with learnable compression tokens and a structured attention flow, enabling modular KV representations that can be flexibly reused and concatenated without modifying the frozen base model. We further employ a compression-concatenation co-training strategy to align extraction-time representations with their downstream reuse behavior. Extensive experiments across multiple long-context benchmarks and model families demonstrate that C$^2$KV significantly reduces KV cache storage and transfer costs, achieving up to 17$\times$ inference speedup under long contexts, while preserving generation quality.

[15] ESCUCHA: A Spanish Speech Benchmark for Heterogeneous Acoustic Conditions cs.CLPDF

Fernando López, Ana Ayala, Guillermo Segovia, Fernando Ibáñez, Ana Martínez

TL;DR: 本文介绍了ESCUCHA，这是首个针对西班牙语语音理解设计的基准测试，旨在评估大型音频语言模型在多样化声学条件和推理能力下的表现。该基准包含1000个人工标注的问题-音频对，总时长162.9小时，直接来源于真实场景，覆盖多种西班牙语口音和非标准语音，并强调感知与推理能力。

Details

Motivation: 随着大型音频语言模型的发展，需要稳健的评估框架，而西班牙语在真实声学条件下的语音理解研究此前关注不足。

Result: 在ESCUCHA基准上对多个最先进的多模态和语音模型进行测试，结果显示这些模型与经过训练的人类表现相比存在显著性能差距。

Insight: 创新点在于构建了首个专注于西班牙语、强调真实声学多样性和复杂推理的语音理解基准，其数据直接来自野外采集而非现有数据集，并包含多音频问题、口语问题等新颖任务类型，为模型评估提供了更全面的测试环境。

Abstract: As large audio language models (LALMs) advance, robust evaluation frameworks have become essential. In this context, Spanish speech understanding under realistic acoustic conditions has received particularly little attention. We introduce ESCUCHA, the first Spanish speech understanding benchmark designed to evaluate LALMs across heterogeneous acoustic conditions and reasoning abilities. ESCUCHA comprises 1,000 human-curated questions paired with audio, totaling 162.9 hours sourced directly ``from the wild’’ rather than drawn from existing datasets, with durations ranging from a few seconds to over 80 minutes. The benchmark emphasizes reasoning, spanning 9 perceptual and 10 reasoning categories, and it captures linguistic diversity through multiple Spanish accents and non-normative speech. ESCUCHA further includes multi-audio questions, spoken questions, and audio instructions, and it flags which questions support open-ended evaluation. Benchmarking several state-of-the-art multimodal and speech models reveals substantial performance gaps relative to trained humans.

[16] When a Name Is Not a Name: A Benchmark Dataset and Distilled Reasoning for Culturally Entangled Bangla Homographs in Low-Resource LLMs cs.CLPDF

Md. Asaduzzaman Shuvo

TL;DR: 本文针对孟加拉语中文化纠缠同形异义词（CEH）的消歧问题，提出了一个包含1,516个专家验证句子的基准数据集（BanglaCEH），并揭示了当前语言模型在处理此类词汇时存在系统性主导意义偏见（偏向常见名词含义而忽略人名含义）。研究发现，通过对比性思维链提示和提炼文化解释的方法，可以有效减少这种偏见，显著提升小规模模型（1-3B）的推理能力。

Details

Motivation: 解决孟加拉语中许多词汇同时作为人名和文化负载常见名词（如’Maya’既是女孩名又表示’深情同情’）的消歧问题，这需要模型具备稀缺的文化知识，而现有预训练数据中缺乏此类信息。

Result: 在开源和闭源模型上的实验表明，模型普遍存在主导意义偏见，孟加拉语专用模型在所有提示策略下均失败。通过对比性思维链提示和提炼文化解释，小模型（1-3B）的主导意义偏见从高达100%降至5%以下，并将失败的孟加拉语专用模型转变为最强系统。

Insight: 创新点在于构建了首个针对孟加拉语文化纠缠同形异义词的专家验证基准数据集，并提出了无需训练的对比性思维链提示和知识蒸馏方法，使小模型能够通过文化推理而非记忆标签来正确消歧，这为低资源语言模型的文化接地提供了有效途径。

Abstract: Many Bangla words are at once personal names and culturally loaded common nouns, “Maya” is both a girl’s name and a word for affectionate compassion. Choosing the right reading demands cultural knowledge that is scarce in the pretraining data of modern language models. We introduce Culturally Entangled Homograph (CEH) disambiguation and build a Bangla benchmark of 1,516 expert-verified sentences (3,032 labelled occurrences) in which one word appears twice with two distinct readings, each labelled with a culturally grounded category and an explanation of the reasoning behind it. Across open- and closed-source models, we find a systematic dominant-meaning bias: models default to the common-noun sense and overlook the name. A Bangla-specific model fails under every prompting regime we test, showing that language-specific pretraining alone does not confer cultural grounding. We further show that contrastive chain-of-thought prompting can sharply reduce this bias without training, and that distilling cultural explanations teaches small (1-3B) models to reason toward the correct reading rather than memorise labels, cutting dominant-meaning bias from as high as 100% to under 5% and turning the failed Bangla-specific model into our strongest system. Dataset and code are available at https://github.com/ashuvo25/BanglaCEH.

[17] DeLIVeR: Decomposed Learning for Information-grounded Veracity Recognition via Reinforced Knowledge Graph Exploration cs.CL | cs.AIPDF

Cong Hoan Nguyen, Thomas Hoang, Hieu Minh Duong, Long Nguyen

TL;DR: 论文提出了DeLIVeR框架，用于解决大语言模型在自动化事实核查中因传统检索系统‘查询脆弱性’而面临的挑战。该框架将证据检索视为一个强化战略探索任务，通过一个规划器LLM将复杂声明分解为有针对性的问题集，用以遍历结构化知识图谱获取高精度证据。

Details

Motivation: 传统检索系统存在‘查询脆弱性’，导致大语言模型在自动化事实核查任务中表现不佳。论文旨在通过一个强化学习驱动的、可分解的检索策略来克服这一挑战，以提升证据检索的精确性和可解释性。

Result: 在LIAR、FEVER和PolitiFact三个基准数据集上的评估表明，DeLIVeR显著优于现有最先进基线。使用Qwen2.5-7B模型，该框架在上述数据集上分别达到了83.73、84.57和79.70的峰值F1分数，相比HippoRAG2有10-15%的提升。

Insight: 核心创新点在于将证据检索重构为基于强化学习的战略探索任务，并引入了声明分解和结构化知识图谱遍历的机制。这为多跳推理提供了可审计、透明的路径，有效弥合了推理鸿沟，提升了事实核查的准确性和可解释性。

Abstract: Automated fact-checking remains a challenge for Large Language Models (LLMs) due to “query brittleness” in traditional retrieval systems. We propose DeLIVeR (Decomposed Learning for Information-grounded Veracity Recognition), a framework that treats evidence retrieval as a reinforced strategic exploration task. DeLIVeR utilizes a Planner LLM to decompose complex claims into targeted question sets, which are used to traverse structured Knowledge Graphs (KGs) for high-precision evidence. We optimize the Planner’s policy using Group Relative Policy Optimization (GRPO) with a reward system prioritizing structural diversity and verdict accuracy. Our evaluation on LIAR, FEVER, and PolitiFact shows that DeLIVeR significantly outperforms state-of-the-art baselines. Using Qwen2.5-7B, our framework achieved peak F1-scores of 83.73, 84.57, and 79.70 respectively, representing a 10-15% improvement over HippoRAG2. By shifting to a reinforced question-planning strategy, DeLIVeR effectively bridges multi-hop reasoning gaps and provides an auditable, transparent path for verifiable misinformation detection.

[18] PPL-Factory: Task-Aware and Budget-Aware Data Selection from Language Modeling to Reasoning cs.CL | cs.LGPDF

Hang Zhang, Warren J. Gross

TL;DR: 这篇论文提出了PPL-Factory，一个用于大语言模型高效微调的数据选择框架。它通过结合任务感知的困惑度评分和预算感知的选择标准，从训练数据中筛选出信息量最大的样本。实验表明，该方法在数学推理任务上，仅使用少量数据就能达到或超过全数据微调的性能。

Details

Motivation: 现有数据选择方法（如基于数据质量、多样性或推理链长度的启发式方法）的效果依赖于具体任务，难以泛化。基于困惑度的方法虽然简单且模型感知，但通常对整个序列评分，忽略了语言建模任务与推理任务在学习目标上的差异。

Result: 在GSM8K基准测试上，PPL-Factory仅使用1%的训练数据就超越了其他最先进的数据选择方法。使用10%的数据时，其在GSM8K和MATH上的准确率分别超过了全数据微调0.9和4.8个百分点。

Insight: 核心创新在于提出了一个任务感知和预算感知的困惑度评分框架，将数据选择与具体的下游任务（如推理）目标对齐，而不仅仅是通用的语言建模目标。这提供了一种简单、可解释且高效的数据选择方法，适用于资源受限的微调场景。

Abstract: Not all training samples contribute equally to large language model fine-tuning. Selecting informative training samples can reduce the computational cost while preserving downstream performance. Many existing data selection methods rely on indirect heuristics, such as data quality, diversity or reasoning trace length. However, the effectiveness of these fixed criteria is task-dependent and difficult to generalize across diverse downstream tasks. Perplexity-based data selection provides a simple and model-aware solution to estimate the sample difficulty, but existing approaches typically score the entire training sequence and ignore the difference in learning objectives of language modeling and reasoning tasks. In this paper, we propose PPL-Factory, a simple and interpretable data selection framework that combines task-aware perplexity-based scores and data budget-aware selection criteria. Experiments on GSM8K demonstrate that PPL-Factory outperforms other state-of-the-art data selection methods using only $1%$ of the training set. With $10%$ of the data, PPL-Factory exceeds full-data fine-tuning accuracy by 0.9 on GSM8K and 4.8 on MATH. Overall, our results demonstrate that task-aware and budget-aware perplexity-based selection provides an effective and applicable approach for efficient fine-tuning.

cs.CV [Back]

[19] 3D FaceShell: Attribute Transfer in 3D Face Avatars as a VLM Defense Mechanism cs.CVPDF

Weston Bondurant, Srijan Das, Hieu Le, Stephanie Schuckers

TL;DR: 本文提出了一种名为3D FaceShell的防御框架，旨在保护3D人脸头像的隐私。该方法通过在原始3D模型上添加一个可学习的高斯壳层，生成微妙的、空间分布的扰动，从而误导视觉语言模型（VLM）对人脸属性的推断，同时保持几何保真度和身份一致性。

Details

Motivation: 随着逼真3D人脸头像在远程呈现、动画等应用中的广泛部署，视觉语言模型（VLM）能够无需微调即通过开放式语义推理从渲染图像中推断出敏感属性，这带来了新的隐私挑战。现有防御方法主要在2D图像空间操作，无法解决3D人脸表示中保持身份的语义操纵问题。

Result: 在重建的名人3D头像和多个黑盒VLM上的大量实验表明，3D FaceShell显著提高了属性注入和不匹配率，同时保持了高感知相似性和身份一致性。

Insight: 论文的创新点在于首次提出在3D表示空间进行防御，通过可学习的高斯壳层实现多视图嵌入对齐优化，从而以视图一致的方式操纵VLM的语义解释，而不影响人类可识别的外观。这为3D数字资产的隐私保护提供了一种新思路。

Abstract: Photorealistic 3D face avatars are increasingly deployed as reusable digital assets across applications such as telepresence, animation, and personalized media. At the same time, vision-language models (VLMs) can infer sensitive attributes from rendered images with open-ended semantic reasoning without any fine-tuning. This creates a new privacy challenge: once a 3D face avatar is shared, any of its renderings can be analyzed to extract high-level facial attributes. Existing defenses largely operate in 2D image space and do not address identity-preserving semantic manipulation of 3D facial representations. We propose 3D FaceShell, a framework for steering VLM interpretations of faces rendered from 3D models while preserving geometric fidelity and facial identity. 3D FaceShell augments the original 3D representation with a learnable Gaussian shell that produces subtle, spatially distributed perturbations optimized through multi-view embedding alignment. The perturbations are designed to be visually inconspicuous yet sufficient to redirect VLM-based attribute inference in a view-consistent manner. Extensive experiments on reconstructed celebrity face avatars and multiple black-box VLMs demonstrate that 3D FaceShell significantly increases attribute injection and mismatch rates while maintaining high perceptual similarity and identity consistency. Our results show that it is possible to manipulate VLM-level semantic interpretation of 3D faces without compromising their human-recognizable appearance.

[20] Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware cs.CVPDF

Akbar Anbar Jafari, Cagri Ozcinar, Gholamreza Anbarjafari

TL;DR: 本文提出了一种名为EMTS-Det的实时无人机人员跟踪系统，该系统专为毫瓦级硬件（如树莓派Zero 2W）设计。通过估计无人机自身运动（ego-motion），将视频帧转换为运动归一化的残差运动通道，并使用一个极轻量级的网络（仅22k参数）检测人员中心，结合卡尔曼滤波和1D卷积分类器进行跟踪验证，实现了在有限计算资源下的高效、鲁棒跟踪。

Details

Motivation: 解决在无人机上实时进行‘跟随我’人员跟踪的挑战，其核心难点在于机载廉价计算设备（仅提供每秒数int8 GFLOPs算力）的计算资源有限，且典型跟随距离下目标人物在图像中仅占10-60像素，难以与背景杂波区分，单帧外观检测器无法有效工作。

Result: 在VisDrone-DET测试集上，所提方法在域内达到0.694 AP25，在特定划分上达到0.444 AP25，显著优于仅使用亮度信息的变体（0.051 AP25）和计算量高出1100倍的YOLOv8n（0.172 AP25）。在树莓派Zero 2W上，整个流水线以31.85 FPS运行，在1000个真实世界无人机视频上达到0.462 AP25和0.714召回率，而YOLOv8n仅1.95 FPS和0.172 AP25。现场测试显示系统在1.3秒内自动锁定目标，锁定召回率达97.9%，并能从所有九次遮挡中恢复且无错误重锁。

Insight: 核心创新在于将时间证据（运动信息）通过分析计算（而非学习）直接嵌入输入表示（即自运动归一化的残差运动通道），从而在极低计算开销下实现了对小目标（低像素人员）的鲁棒检测。此外，采用合成运动课程进行训练、部署无状态（stateless）轻量检测器以避免时序模块带来的精度损失，以及详细研究并解决了int8量化中的静默校准失败问题，都是极具工程实践价值的创新点。

Abstract: Follow-me person tracking must run on the drone itself, where affordable companion computers offer only a few effective int8 GFLOP/s. At typical follow distances a person spans 10-60 pixels, indistinguishable from clutter and beyond the reach of single-frame appearance detectors. The missing evidence is temporal and belongs in the input representation, computed analytically, rather than in learned temporal machinery. EMTS-Det is a five-stage system that estimates ego-motion, converts each frame into ego-motion-normalized residual-motion channels, detects person centers with a 22k-parameter, 7.6-MFLOP network, tracks a locked target with a Kalman filter in stabilized coordinates, and verifies tracks with a 1-D convolutional classifier of human motion (ROC AUC 0.941). Training uses a synthetic-motion curriculum with motion channels generated by the deployed ego-motion code. Multi-seed ablations locate the value in generalization: on held-out VisDrone-DET a luminance-only variant collapses to 0.051 AP25 versus 0.415, as does YOLOv8n fine-tuned identically despite 1,100 times the compute, while the deployed int8 detector reaches 0.694 AP25 in-domain and 0.444 on this split. Temporal-shift modules lower accuracy, so the deployed detector is stateless. Silent int8 calibration failures are documented; min-max calibration with propagated caches matches float within 0.008 AP. On a Raspberry Pi Zero 2W the pipeline runs at 31.85 FPS with 0.462 AP25 and 0.714 recall over 1,000 real-world UAV videos, versus 1.95 FPS and 0.172 AP25 for YOLOv8n. A 57-second field sequence shows auto-lock at 1.3 s, 97.9% lock recall, and recovery from all nine occlusions with zero false re-locks.

[21] GenSyn10: A Multi-Generative AI Dataset For Benchmarking Image Classification cs.CV | cs.AIPDF

Md Faraz Kabir Khan, Saeed Anwar, Ghulam Mubashar Hassan

TL;DR: 本文介绍了GenSyn10，一个与CIFAR-10对齐的多生成式AI合成图像数据集，包含60,000张图像，由三种架构不同的最先进模型生成，旨在推动AI生成图像检测的研究。该数据集通过标准化生成协议，为评估检测器对未见生成器的分布外泛化能力提供了一个可控的基准。

Details

Motivation: 生成式AI的快速发展超过了我们可靠检测其输出的能力，尤其是在检测器遇到未见过的生成器时。现有检测器在已知生成器上表现良好，但在未见生成器上性能会下降。

Result: 在四阶段评估协议下，CIFAR-10训练的模型在GenSyn10上实现了高达96.86%的零样本准确率，微调后可达99.88%。在二分类任务中，微调模型在见过的生成器上达到97-99.9%的准确率，但在未见生成器图像上降至79-96%，突显了分布外泛化的持续局限性。

Insight: 论文的创新点在于构建了一个包含多种当代架构生成图像的标准数据集，以系统评估检测器对新型生成器的泛化能力。这为研究鲁棒性、领域适应和跨生成器泛化提供了受控基准，超越了单一生成器的设置。

Abstract: The rapid advancement of generative AI has outpaced our ability to reliably detect its outputs, particularly when detectors encounter generators they have not seen before. We introduce GenSyn10, a CIFAR-10-aligned synthetic image dataset of 60,000 images (10 classes, 32$\times$32, 50k/10k split) generated using three architecturally diverse state-of-the-art models: FLUX.2-dev (Rectified Flow Transformer), HunyuanImage-3.0 (MoE Transformer), and Qwen-Image-2512 (Multimodal Diffusion Transformer), to advance research in AI-generated image detection. A central challenge in this domain is that detectors perform well on known generators but degrade on unseen ones. GenSyn10 addresses this limitation by curating data from multiple contemporary architectures under a standardized generation protocol, enabling controlled and systematic evaluation of out-of-distribution (OOD) generalization to novel generators. Images are generated using a template-based prompt engine and downsampled to ensure consistency. We evaluate 17 image classification models under a four-stage protocol: real-data baseline, zero-shot transfer, fine-tuning, and retention. Despite a measurable domain gap, CIFAR-10-trained models achieve up to 96.86% zero-shot accuracy on GenSyn10, increasing to 99.88% after fine-tuning. In binary real-vs-synthetic classification, fine-tuned models achieve 97-99.9% accuracy on seen generators but drop to 79-96% on images from an unseen generator, highlighting persistent limitations in OOD generalization. These results establish GenSyn10 as a controlled benchmark for studying synthetic image detection beyond single-generator settings, supporting research on robustness, domain adaptation, and cross-generator generalization.

[22] MAC 2026: Advancing Micro-Action Analysis Towards Fine-Grained Understanding cs.CV | cs.MMPDF

Kun Li, Dan Guo, Jihao Gu, Pengyu Liu, Xiaobai Li

TL;DR: 本文介绍了第三届微动作分析大挑战（MAC 2026），该挑战旨在推动微动作分析领域的研究，从传统的识别与检测任务转向细粒度的微动作理解。挑战引入了在大型多模态语言模型辅助下评估的新任务，并总结了相关数据集、评估协议、竞赛结果及优秀解决方案。

Details

Motivation: 微动作是社交互动和情感交流中重要的非语言线索，但其持续时间短、运动模式弱、语义差异细微，导致标注、建模和标准化评估困难。MAC挑战赛旨在为这一新兴领域建立公共基准平台，促进学术研究。

Result: MAC 2026在ACM Multimedia 2026期间举办，引入了细粒度微动作理解新任务，并借助多模态大语言模型进行评估。论文总结了竞赛结果和顶尖团队的解决方案，但未具体说明定量性能指标或是否达到SOTA水平。

Insight: 创新点在于将微动作分析从识别/检测扩展到细粒度理解任务，并利用多模态大语言模型进行辅助评估，这为深入解释人类细微行为提供了新方向。从客观角度看，这推动了以人为中心的视频理解向更精细语义层面发展。

Abstract: Micro-Actions (MAs) are subtle and spontaneous human behaviors that provide important non-verbal cues in social interaction and affective communication. However, their short duration, weak motion patterns, and fine-grained semantic differences make them difficult to annotate, model, and evaluate in a standardized manner. To promote academic research on micro-action analysis, we proposed and have annually organized the Micro-Action Analysis Grand Challenge (MAC) as a public benchmark platform for this emerging field. The first two editions of MAC established standardized evaluation settings for micro-action recognition and detection, providing publicly accessible datasets and protocols. Building upon these editions, this paper presents the 3rd MAC, held in conjunction with ACM Multimedia 2026. Under the theme of moving from recognition to fine-grained micro-action understanding, this edition further expands the scope of the challenge beyond conventional recognition and detection. In particular, we introduce a new task named fine-grained micro-action understanding, evaluated with the assistance of multimodal large language models, aiming to assess models’ ability to capture fine-grained semantic cues and interpret subtle human micro-actions at a deeper level. We summarize the datasets, task settings, evaluation protocols, competition results, and representative solutions from top-performing teams. Finally, we discuss future directions for micro-action analysis and its broader role in human-centric video understanding.

[23] It Depends on the Dataset: When a Brain-Encoding Model’s Predicted Responses Beat Their Visual Backbone for Video Memorability cs.CV | cs.AI | cs.LGPDF

Carson Rodrigues

TL;DR: 本文研究了基于大脑编码基础模型（TRIBE v2）预测的fMRI响应是否比其视觉骨干网络（V-JEPA2）的特征更能有效预测短视频的记忆度。研究发现，结果高度依赖于数据集：在Memento10k数据集上，视觉骨干表现更优（Spearman 0.594 vs 0.544）；而在VideoMem数据集上，大脑预测特征表现更好（0.415 vs 0.368）。跨数据集迁移实验进一步证实了这种数据集依赖性。

Details

Motivation: 探究大脑编码模型预测的皮层响应（无需实际扫描）是否能为下游人类行为任务（如视频记忆度预测）提供比其视觉骨干网络更有效的特征表示。

Result: 在Memento10k数据集上，视觉骨干的Spearman相关系数为0.594，优于大脑预测特征的0.544；在VideoMem数据集上，大脑预测特征以0.415优于视觉骨干的0.368（提升+0.047）。跨数据集迁移中，大脑预测特征在从Memento10k训练、VideoMem测试时仍优于骨干（+0.076），反之则大幅落后（-0.311）。

Insight: 大脑预测特征携带了视觉骨干所忽略的、与记忆度相关的小而真实的信号，但这种优势是数据集特定的，而非领域通用的先验。创新点在于揭示了大脑编码特征在下游任务中的有效性高度依赖于数据集特性，并识别出与记忆度相关的视觉正交成分定位于腹侧枕颞皮层。

Abstract: Brain-encoding foundation models predict fMRI responses to video, audio, and text well enough to win the Algonauts 2025 challenge. We ask whether their predicted responses, obtained with no scanner, are a useful feature lens for a downstream human-behavior task: forecasting the memorability of short videos. We project each clip into TRIBE v2’s predicted cortical space and forecast short-term memorability with ridge regression, against a matched control: the model’s own V-JEPA2 visual backbone taken before the brain projection. The answer is dataset-dependent, and cleanly so. Within Memento10k the backbone wins (Spearman 0.594 vs 0.544 for the brain projection); within VideoMem the brain projection wins (0.415 vs 0.368, delta +0.047, 95% CI [+0.009, +0.088]). Both within-dataset gaps have bootstrap intervals excluding zero, in opposite directions. Cross-dataset transfer inherits the split: trained on Memento10k and tested on VideoMem the brain projection beats the backbone (+0.076), while the reverse loses heavily (-0.311). Each representation transfers best onto the dataset it already fits better. The VideoMem advantage is not a sample-size artifact (it survives matched training size and a PCA-then-ridge pipeline) and not mere compression of the backbone (a compressed or heavily regularized backbone tops out below the brain projection, which also beats a transfer-tuned backbone, +0.053). So predicted-brain features carry a small but real memorability signal the backbone misses on one dataset and not the other: not a domain-general prior, but a dataset-specific representation. A vision-orthogonal component (partial Spearman 0.19, permutation p=2.5e-4) localizes to ventral occipito-temporal cortex. Code and predicted-response arrays are released; source videos and scores are not redistributed.

[24] Emergent Hierarchical Monosemantic Neurons from the Group-Contrastive Forward-Forward Algorithm cs.CV | cs.AIPDF

Yiming Tang, Qinglin Qi, Zhaoqian Yao, Harshvardhan Saini, Dianbo Liu

TL;DR: 本文提出了一种名为Group-Contrastive Forward-Forward (GCFF)的生物启发式训练算法，旨在通过架构约束而非稀疏性来获得单语义神经元。该算法在CLIP表征上成功恢复了抽象层次递增的单语义神经元，并能从头训练网络，在多个图像分类基准上取得了前向-前向算法中的最先进性能。

Details

Motivation: 针对稀疏字典学习（SDL）方法在机制可解释性中的局限性（如非可识别性、对线性表征假设的依赖以及无法捕获非线性概念），作者受生物视觉系统中由局部层间学习规则产生的层次化、高选择性神经元启发，探索一种生物合理的学习算法是否能同样产生单语义神经元。

Result: 在CLIP表征上，单个GCFF模块无需稀疏约束或抽象层次监督，即可恢复抽象度随深度递增的单语义神经元，捕获独立于图像前景的环境属性。此外，GCFF能从头训练网络，在多个图像分类基准上达到了前向-前向算法中的SOTA性能。

Insight: 核心创新在于提出了一种结合类别特定路由和类内对比目标的前向-前向训练算法（GCFF），通过架构设计而非稀疏惩罚来强制单语义性，从而能够捕获非线性编码的概念。这为绕过SDL的局限性、实现层次化可解释表征提供了一条新路径。

Abstract: Mechanistic interpretability has made significant strides in understanding neural network representations, with sparse dictionary learning (SDL) methods, most prominently sparse autoencoders, as a central paradigm. However, recent work has reported several limitations of this paradigm: SDL objectives are non-identifiable; SDL methods rely heavily on the Linear Representation Hypothesis; and a growing body of evidence points to concepts that are encoded non-linearly and are therefore not expressible as any single direction. We hypothesise that a different route to monosemanticity is available. Biological visual systems exhibit highly selective neurons organised into hierarchies of increasing abstraction, and this organisation emerges from local, layer-wise learning rules rather than from a global error signal; we therefore ask whether a biologically plausible learning algorithm will likewise yield monosemantic neurons. To test this, we propose Group-Contrastive Forward-Forward (GCFF), a forward-forward training algorithm that combines class-specific routing with within-class contrastive objectives, reaching monosemanticity through architectural constraints rather than sparsity. Because GCFF attaches multiple non-linear layers to the representation under study, its neurons can therefore capture the non-linear concepts. On CLIP representations, a single trained GCFF module recovers monosemantic neurons whose abstraction increases progressively with depth, reaching environmental properties that hold independently of an image’s foreground, without any sparsity constraint or supervision of abstraction level. We further demonstrate that GCFF can train networks from scratch, achieving state-of-the-art performance among forward-forward algorithms on various image classification benchmarks.

[25] A${}^2$BM: Alignment-Aware Bridge Matching for Image-to-Image Translation cs.CV | cs.AIPDF

Aimi Okabayashi, Georges Le Bellier, Nicolas Audebert, Charlotte Pelletier, Thomas Corpetti

TL;DR: 本文提出了对齐感知桥匹配（A²BM），一种用于图像到图像转换的新方法，专门处理训练数据对未完美对齐的现实场景。该方法通过在桥匹配框架中引入对齐分数，使模型能够区分真实的语义对应关系和错位伪影，并在推理时通过调整对齐分数来控制转换的保真度。

Details

Motivation: 现有桥匹配和流匹配方法假设训练图像对完美对齐，但实际应用（如异步捕获、不同光照或配准错误）常导致弱对齐数据，这限制了模型性能。

Result: 在合成实验和真实任务（如跨传感器超分辨率和像素空间无监督域适应）中，A²BM在翻译保真度上持续优于基于GAN、扩散和Schrödinger桥的基线方法。

Insight: 创新点在于将数据对齐信息作为条件变量整合到桥匹配框架中，提供了一种处理弱对齐数据的原理性解决方案，并允许通过调整对齐分数灵活控制输出质量。

Abstract: Paired image-to-image translation underpins a wide range of computer vision tasks, including image editing, sensor translation, and domain adaptation. Bridge matching and flow matching have recently emerged as powerful frameworks, extending diffusion models to arbitrary source and target distributions. However, their standard formulations assume perfectly aligned training pairs, treating all source-target correspondences as equally reliable. In practice, real-world applications often involve weakly aligned pairs due to changes of acquisition conditions, including e.g. asynchronous captures, different illuminations, or misregistration. In this work, we introduce Alignment-Aware Bridge Matching (A${}^2$BM), a bridge matching method that leverages image pairs alignment during training. By incorporating alignment scores, the model learns to disentangle true semantic correspondences from misalignment artifacts. At inference time, we use the alignment score as a control variable over translation fidelity, with strongly aligned outputs obtained when prompting the model with the highest alignment score. We validate A${}^2$BM on both controlled synthetic experiments and on challenging real-world tasks, including cross-sensor super-resolution and pixel-space unsupervised domain adaptation. In all settings, A${}^2$BM consistently improves translation fidelity over strong GAN-, diffusion-, and Schr{ö}dinger bridge-based baselines, establishing alignment conditioning as a principled solution for image translation models with weakly aligned data.

[26] Rethinking Feature Reliance Evaluation with Semantically Matched Suppression cs.CVPDF

Ning Jiang, Tianyi Luo, Zhengyong Huang, Yao Sui

TL;DR: 本文重新审视了视觉识别模型对形状、纹理等特征的依赖评估方法，提出了语义匹配的抑制框架，发现ImageNet训练的CNN对纹理的依赖高于形状，而Vision Transformers在两种抑制下均表现出更强的鲁棒性，且其表征与人类视觉皮层更兼容。

Details

Motivation: 传统线索冲突研究认为CNN偏向纹理，但这种方法在人工冲突下测量线索偏好，而非自然识别中的特征依赖，因此需要更可靠的评估框架来准确理解模型的行为。

Result: 在语义匹配的抑制框架下，ImageNet训练的CNN在纹理抑制下性能下降更显著；Vision Transformers在形状和纹理抑制下均保持更高准确率，且其表征在神经预测任务中下降更小。

Insight: 创新点在于引入语义匹配的抑制评估框架，确保不同抑制操作在类别可分性损失上可比，从而更可靠地衡量特征依赖；客观分析表明ViT的鲁棒性优势可能源于其表征与人类视觉系统的对齐。

Abstract: Understanding whether visual recognition models rely on shape, texture, or color is central to interpreting their behavior. Prior cue-conflict studies have strongly influenced the view that CNNs are texture-biased, yet such tests measure cue preference under artificial conflicts rather than feature reliance during natural recognition. We revisit this question through controlled feature suppression and show that performance drops are difficult to interpret unless different suppression operations impose comparable category-level damage. We introduce a semantically matched evaluation framework that compares shape and texture suppression at matched levels of category separability loss. Under this framework, ImageNet-trained CNNs show stronger degradation under texture suppression than under shape suppression, revealing greater texture reliance than suggested by unmatched suppression analyses. Extending the comparison across architectures, we find that Vision Transformers retain higher accuracy than CNNs under both shape and texture suppression. Brain encoding further shows that ViT representations exhibit smaller suppression-induced decreases in neural prediction performance under the tested suppression settings. These findings indicate that semantic comparability is essential for interpreting feature reliance from suppression experiments, and suggest that the robustness advantage of ViTs may be related to representations more compatible with human visual cortex.

[27] FedDP-PALD: A Privacy-Preserving Federated Latent Diffusion Framework with Prototype Aggregation for Medical Data Synthesis cs.CVPDF

Md. Sajeebul Islam Sk., Khan Enaet Hossain, Md. Mehedi Hasan Shawon

TL;DR: 本文提出了一种名为FedDP-PALD的隐私保护联邦潜在扩散框架，用于在正式隐私保证下合成多模态医学数据（如胸部X光图像和心电图信号）。该框架通过门控多头注意力处理多模态数据，并引入差分隐私原型混合聚合（DP-PMA）机制，在服务器端聚合类别级潜在原型时添加噪声，以保护患者隐私。实验表明，该方法生成的合成数据能有效抵抗成员推理攻击，同时保持接近真实数据训练的决策性能。

Details

Motivation: 动机在于解决联邦学习中两个关键问题：一是训练过程中交换的信息可能泄露患者数据是否被使用，二是现有的合成数据方法往往无法保持原始数据的预测结构，限制了其在临床中的应用。

Result: 在PneumoniaMNIST、ChestMNIST和MIT-BIH数据集上的评估显示，差分隐私将摘要级攻击的AUROC从0.6229±0.0026降低到0.5016至0.5093（隐私预算ε=1到8）。使用合成潜在表示训练的模型F1分数达到0.8993±0.0006，AUROC为0.9057±0.0503，接近使用真实潜在表示训练的0.9747±0.0132。

Insight: 创新点包括：1）结合潜在扩散模型与联邦学习，为多模态医学数据合成提供正式隐私保证；2）提出DP-PMA机制，通过裁剪和噪声注入保护类别级原型，实现差分隐私；3）采用门控多头注意力处理模态缺失情况，增强了框架的鲁棒性。从客观角度看，该方法在隐私保护与数据效用之间取得了较好平衡，为医疗联邦学习提供了可借鉴的合成数据生成方案。

Abstract: Medical images and physiological signals provide valuable information for accurate diagnosis. Developing diagnostic models often requires patient data from multiple institutions, although strict privacy regulations limit the sharing of sensitive clinical records. Federated learning enables multiple hospitals to train a shared model without exchanging raw data. However, existing methods face two problems: the information exchanged during training can reveal whether a patient’s data were used, and synthetic data meant to replace real records often fail to preserve their predictive structure, which limits clinical use. To address this issue, we propose FedDP-PALD, a privacy-preserving federated latent diffusion framework for multimodal medical data synthesis under formal privacy guarantees. It jointly processes chest X-ray images and electrocardiogram (ECG) signals through gated multi-head attention with modality-availability masks, remaining effective even when a modality is missing. We also introduce Differentially Private Prototype Mixture Aggregation (DP-PMA), which clips class-level latent prototypes and adds calibrated Gaussian noise before combining them on the server to maintain $(ε, δ)$ differential privacy. We evaluate FedDP-PALD on PneumoniaMNIST, ChestMNIST, and MIT-BIH datasets, where differential privacy reduced summary-level attack AUROC from 0.6229 $\pm$ 0.0026 to between 0.5016 and 0.5093 for privacy budgets from $ε= 1$ to $ε= 8$. On the test data, synthetic-latent training achieved an F1 score of 0.8993 $\pm$ 0.0006 and an AUROC of 0.9057 $\pm$ 0.0503, close to the 0.9747 $\pm$ 0.0132 real-latent training. These results show that FedDP-PALD generates private synthetic representations that preserve useful decision performance while strongly resisting membership inference.

[28] Med-OPD: Improving Medical Vision-Language Models via Evidence-Aware On-Policy Distillation cs.CV | cs.AIPDF

Yunhang Qian, Jiaquan Yu, Jiawei Liu, Meng Wang, Hongwei Bran Li

TL;DR: 本文提出Med-OPD，一种针对医学视觉语言模型（Med-VLMs）的后训练框架，通过证据感知的在线策略蒸馏来增强模型对关键视觉证据的依赖，从而提升可靠的多模态医学推理能力。

Details

Motivation: 现有Med-VLMs可能依赖语言先验或医学模板而非真正关注诊断关键区域，导致推理不可靠；在线策略蒸馏（OPD）虽能提供密集的token级监督且兼容隐私保护，但标准OPD均匀蒸馏所有token，稀释了稀疏的证据依赖token。

Result: 在OmniMedVQA子集（包括CT、MRI、疾病诊断和病变分级）上的实验表明，Med-OPD在性能上持续优于监督微调（SFT）和标准OPD，达到了当前最优水平（SOTA）。

Insight: 创新点在于引入了医学证据优势（MEA），这是一种基于教师的反事实信号，通过答案感知提示使教师评分聚焦于支持目标诊断的证据，并在token和轨迹两个层面重新分配蒸馏信号，强调诊断关键token和证据依赖的轨迹。

Abstract: Medical Vision-Language Models (Med-VLMs) require reliable reasoning from fine-grained visual evidence, yet existing models can produce plausible clinical answers by relying on language priors or medical templates rather than truly attending to diagnosis-critical regions. On-Policy Distillation (OPD) offers dense token-level supervision on student-generated trajectories and provides a privacy-compatible means of capability transfer without requiring the redistribution of raw patient data. However, standard OPD uniformly distills all tokens, causing sparse evidence-dependent tokens to be diluted by abundant clinical narrative tokens. Inspired by the success of OPD in the large language model community, we propose \textbf{Med-OPD}, to our knowledge the first unified post-training framework that integrates on-policy distillation with medical evidence-aware supervision for Med-VLMs. We introduce \textbf{Medical Evidence Advantage} (MEA), a teacher-grounded counterfactual signal that uses an answer-aware hint to focus teacher scoring on evidence supporting the target diagnosis, and measures each token’s dependence on medical visual evidence by comparing teacher likelihoods under the original and evidence-degraded imaging modalities. Based on MEA, Med-OPD redistributes the distillation signal at both the token and trajectory levels, emphasizing diagnosis-critical tokens and evidence-reliant rollouts. Experiments on OmniMedVQA subsets show that Med-OPD consistently outperforms SFT and standard OPD across CT, MRI, Disease Diagnosis, and Lesion Grading. These results demonstrate that evidence-aware distillation can better strengthen medical VLMs’ reliance on key visual evidence and improve reliable multimodal medical reasoning. The source code and data is publicly available at: https://github.com/yunhang8658/MedOPD.git

[29] LookME: Lookup-Based Multimodal Embeddings for Layer Injection in Vision-Language Models cs.CV | cs.AIPDF

Zeyu Xu, Xingzhong Hou, Pengkai Guo, Siling Lin, Xiao Xu

TL;DR: 本文提出了LookME框架，首次在视觉语言模型中实现了基于查找的多模态嵌入增强，支持分区存储和按需加载。该方法采用分层两级查找策略，从场景级到场景内基元级进行粗到细的检索，并结合稀疏注入策略自适应地优先处理关键嵌入，促进跨层嵌入表重用，从而在效率、模型大小和性能之间取得更好平衡。

Details

Motivation: 现有基于每层嵌入（PLE）的方法主要针对文本嵌入设计，由于基于ID检索的便利性，限制了其在包含更丰富视觉信息的多模态嵌入中的有效性，而密集或稀疏混合专家模型在资源受限环境中的部署面临内存使用与延迟的权衡问题。

Result: 在多个视觉基准测试上的实验表明，LookME优于仅文本的PLE风格方法，验证了基于查找的多模态嵌入增强的有效性。

Insight: 创新点在于首次将查找机制扩展到多模态嵌入，提出了分层两级查找和稀疏注入策略，实现了对连续多模态嵌入的高效检索与自适应增强，提升了视觉语言模型在资源受限场景下的部署可行性。

Abstract: Vision-Language Models (VLMs) have achieved strong progress in multimodal understanding. However, scaling dense or sparse Mixture-of-Experts (MoE) models to improve performance limits deployment in resource-constrained environments due to the trade-off between high memory usage from full loading and increased latency from on-demand loading. Recently, the Per-Layer Embedding (PLE) architecture addresses this by scaling models with large external embedding tables stored in ROM and performing lightweight lookup to retrieve relevant embeddings to enhance token representations. Nevertheless, existing PLE-style methods are primarily designed for text embeddings due to the convenience of ID-based retrieval, limiting their effectiveness in VLMs where multimodal embeddings contain richer information for visual tasks. In this paper, we propose LookME, the first framework that enables lookup-based enhancement for multimodal embeddings in VLMs while supporting partitioned storage and on-demand loading. To efficiently lookup arbitrary continuous multimodal embeddings from large-scale embedding tables, we propose a hierarchical two-level lookup method employing a coarse-to-fine strategy that performs lookups from the scene-level to the intra-scene primitive-level. Furthermore, we integrate the lookup method with a sparse injection strategy, which adaptively prioritizes critical embeddings over voluminous multimodal embeddings within layers, and facilitates embedding table reuse across neighboring layers, improving the trade-off among efficiency, model size, and performance. Experiments on multiple visual benchmarks show that LookME outperforms text-only PLE-style methods, validating the effectiveness of lookup-based multimodal embedding enhancement.

[30] xperception – Making Robotic Grasping Easier cs.CV | cs.ROPDF

Matteo Bortolon, Andrea Caraffa, Alice Fasoli, Fabio Poiesi

TL;DR: 本文提出了xperception，一种零样本6D姿态估计技术，旨在解决高混合低产量制造中机器人抓取的灵活性问题。它直接利用CAD模型并结合基础模型（如DINOv2、GeDi）的语义特征，无需针对特定对象进行微调或数据标注，即可实现毫米级精度的姿态估计，并已在工业边缘硬件上验证部署。

Details

Motivation: 传统视觉系统在引入新物体时需要大量数据收集和模型重新训练，成为机器人操作灵活性的瓶颈，无法适应高混合低产量制造的需求。

Result: xperception在工业任务（如箱体拣选）中表现出对严重遮挡的鲁棒性，其核心方法FreeZe算法赢得了2024年国际BOP挑战赛，技术成熟度达到TRL 6，为可扩展的即插即用自动化铺平了道路。

Insight: 创新点在于结合CAD模型与基础模型的语义特征实现零样本6D姿态估计，避免了对象特定的训练和数据标注，从而提升了系统在非结构化环境中的部署效率和灵活性。

Abstract: The transition toward high-mix low-volume manufacturing demands flexibility in robotic manipulation. However, conventional vision systems remain a bottleneck, requiring extensive data collection and model retraining whenever a new object is introduced to the production line. To overcome this rigidity, we present xperception, a zero-shot 6D pose estimation technology that eliminates the need for object-specific fine-tuning and laborious data annotation. By directly utilizing typical CAD models and integrating the rich semantic features of foundation models (e.g. DINOv2, GeDi), xperception achieves millimeter-accurate 6D pose estimation. xperception showed robustness against severe occlusions in industrial tasks like bin picking and is engineered for deployment on industrial edge hardware, such as NVIDIA Jetson Thor. Validated at a TRL of 6, the core methodology behind xperception is based on the FreeZe algorithm, which won the international BOP Challenge 2024, paving the way for scalable, plug-and-play robotic automation in unstructured high-mix low-volume manufacturing industries.

[31] Seeing What Is Actually There: PriVE-Bench and PriVE-Tools for Counterfactual Evaluation of Agentic Visual Evidence in VLMs cs.CV | cs.AIPDF

Jingyu Sun, Jiachen Tu, Yuyang Xue, Yaoxin Jiang, Guoyi Xu

TL;DR: 本文提出了PriVE-Bench基准和PriVE-Tools工具集，用于评估视觉语言模型（VLMs）在反事实图像场景下，能否利用额外视觉证据（如边界框、裁剪、缩放面板等）来克服其固有的语言和类别先验，从而进行基于视觉的推理。

Details

Motivation: 现有反事实基准主要关注VLM是否遵循先验，而本文进一步探究在工具增强和智能体视觉系统兴起的背景下，额外的视觉证据视图能否帮助VLM对抗其先验进行推理。

Result: 在开源和闭源VLM上的实验表明，视觉证据工具在某些设置下（尤其是模型能有效利用局部化证据时）有帮助，但并非万能解决方案：即使明确提供了相关视觉证据，多个模型仍会遵循语言和类别先验。评估指标包括准确率、先验遵循错误率和其他响应率。

Insight: 创新点在于构建了专门用于区分视觉接地答案与先验一致错误的配对图像基准（PriVE-Bench），并引入了受智能体视觉启发的可控工具扩展（PriVE-Tools）来系统评估工具衍生视觉证据的效果。客观来看，该工作为诊断和改善VLM的视觉接地能力提供了更精细的评估框架。

Abstract: Vision-language models (VLMs) often answer visual questions using learned language and category priors rather than grounding their predictions in the image itself. Counterfactual images provide a natural diagnostic setting for this failure mode: when visible evidence contradicts what is usually true, a grounded model should answer from the pixels, while a prior-following model will produce a canonical but visually incorrect response. However, existing counterfactual benchmarks mainly ask whether such prior-following behavior exists. In this paper, we ask a further question motivated by the rise of tool-augmented and agentic vision systems: can additional visual evidence views help VLMs reason against their priors? We introduce PriVE-Bench, a Prior-vs-Visual Evidence Benchmark that uses paired original and counterfactual images to distinguish visually grounded answers from prior-consistent errors. We further introduce PriVE-Tools, a controlled agentic-vision-inspired extension that evaluates whether tool-derived visual evidence – including bounding boxes, crops, zoom panels, and contours – improves grounding under the same counterfactual conflicts. Across open- and closed-source VLMs, we compare raw, paired-image, and tool-conditioned inputs using accuracy, prior-following error rate, and other-response rate. Our results show that visual evidence tools can help in some settings, especially when models can use localized evidence effectively, but they are not a universal remedy: several models continue to follow language and category priors even when relevant visual evidence is explicitly provided.

[32] Eddy-VL 1.9B: Structural Pruning and Layered Distillation for Edge-Deployable Multimodal Embedding cs.CVPDF

HanYeong Cho, Changwoo Kim, Taeuk Chu, Jimin Park

TL;DR: 本文介绍了Eddy-VL 1.9B，一个基于Qwen3-VL-Embedding-2B压缩的多模态嵌入模型，专为离线、边缘部署的视觉语言检索设计。通过结构剪枝和分层知识蒸馏技术，模型参数量减少约9.5%，在保持教师模型91.7%性能的同时，推理延迟降低约10%。

Details

Motivation: 针对无法使用云API且需要低延迟的隔离取证和调查场景，开发一个可在边缘设备离线部署的高效多模态嵌入模型。

Result: 在MMEB-V2基准测试（78个任务）上，Eddy-VL总体得分为63.2，达到教师模型（68.9）的91.7%性能；在SugarCrepe、MR2-Bench和ARO等组合推理任务上表现接近教师模型，但Winoground任务性能（6.8）仍是主要限制。

Insight: 创新点包括基于相邻层线性CKA的探针驱动结构剪枝，以及结合空洞覆盖师生映射、中间层注意力图1-CKA和嵌套维度（Matryoshka）最终层损失的分层知识蒸馏方法，有效平衡了模型压缩与性能保留。

Abstract: In this report, we introduce Eddy-VL 1.9B, a compressed multimodal embedding model built on Qwen3-VL-Embedding-2B for offline, edge-deployable vision-language retrieval. Eddy-VL targets air-gapped forensic and investigative settings where cloud APIs are unavailable and low latency is essential. Compression combines (i) probe-driven structural pruning that removes four redundant text-decoder layers (28 to 24) ranked by adjacent-layer linear CKA, and (ii) layered knowledge distillation with hole-covering teacher-student mappings, mid-layer attention-map 1-CKA, and final-layer MSE and cosine losses with Matryoshka dimensions {128, 256, 512, 1024, 2048}. The released model contains 1,926,188,032 parameters (3.85 GB bf16), representing approximately 9.5% fewer parameters than the 2.13B teacher model. Empirical evaluations on MMEB-V2 (78 tasks, VLM2Vec protocol) show that Eddy-VL achieves an overall score of 63.2 compared with 68.9 for the teacher, retaining 91.7% of the teacher’s performance while recovering 6.4 of the 12.1 points lost through pruning alone (56.8). Compositional reasoning performance remains close to the teacher on SugarCrepe (86.1 vs. 86.4), MR2-Bench (24.5 vs. 24.7), and ARO (59.5 vs. 60.4), while Winoground group performance (6.8 vs. 8.5) remains the primary limitation. Depth pruning also reduces forward latency by approximately 10% (150.0 to 136.4 ms per image on NVIDIA DGX Spark using FlashAttention-2). We present the architecture, compression methodology, training procedures, and evaluation results, demonstrating the effectiveness of Eddy-VL for multimodal retrieval under constrained edge deployment. Model weights and inference code are publicly available on Hugging Face.

[33] Depth-Regularized JEPA World Models Learn More Transferable Representations from Real Outdoor Robot Data cs.CV | cs.LG | cs.ROPDF

Usman M. Khan

TL;DR: 本文提出了一种结合深度几何先验和潜在空间正则化的JEPA世界模型训练方法，旨在从真实户外机器人视频数据中学习更具可迁移性的表示。该方法通过深度监督与各向同性诱导正则化（SIGReg）相结合，在约束潜在多样性组织方式的同时最大化任务无关的表示熵，并引入仅训练时的过参数化以应对复杂性。在真实农业机器人视频上训练的1800万参数模型，在视觉里程计、意外检测和潜在状态预测等多个任务上均优于基线。

Details

Motivation: 动机在于解决从视觉复杂的真实世界数据（特别是不可预测的户外环境）中学习鲁棒动态模型的挑战。现有基于JEPA架构的世界模型在处理此类数据时仍有局限，因此需要引入几何先验来增强模型的鲁棒性和可迁移性。

Result: 在真实农业机器人数据上评估，相比基线LeWM，该方法将视觉里程计探针误差降低了33%，在域内和域外（TartanGround基准）的意外检测分数分离度上均有显著提升，并在域转移下的多步潜在状态预测保真度上获得改进，且增益随预测步长增加而增长。模型在光照和阴影等非直接3D几何相关的物理理解任务上也表现出改进。

Insight: 创新点在于将深度信息作为物理基础的几何先验，与旨在最大化熵的各向同性正则化（SIGReg）相结合，以学习更紧凑、信息更丰富且可迁移的潜在表示。同时，通过仅训练时的过参数化策略，在不增加推理开销的前提下提升了模型容量和性能。这表明轻量级的几何先验能有效增强世界模型在真实户外数据上的泛化能力。

Abstract: World models, especially based on JEPA architectures, have been shown to learn robust dynamics of various environments. However, learning from visually complex real-world data remains a challenge, especially in unpredictable outdoor environments. We introduce depth as a geometric prior during training in learning more robust latent dynamics directly from robot video data and handling visual complexity. This combines depth supervision with an isotropy-inducing latent regularizer (SIGReg), maximizing task-agnostic latent diversity while constraining how that diversity is organized, with the combined objective targeting the highest-entropy representation consistent with scene geometry. To satisfy this greater complexity without increasing inference time, we also add training-only overparameterization. Training an 18M-parameter model on video from a real agricultural robot, we evaluate with frozen-representation visual odometry probes, predictor-based surprise detection, and multi-step latent rollout fidelity. Compared to the baseline LeWM, our method lowers visual odometry probe error by 33%, substantially increases surprise-score separation both in-domain and on the out-of-domain TartanGround benchmark, and improves multi-step rollout fidelity under domain shift, with gains that grow with rollout horizon. Notably, we also see improvements in surprise-score separation on physics understanding that is not directly tied to 3D geometry, such as lighting and shadows. These results show that a lightweight training-time geometric prior makes a compact JEPA world model more useful and more transferable on real outdoor data with strong underlying representations, without adding inference overhead. Our work suggests that depth as a physically grounded prior can enhance world model generalization on a variety of tasks.

[34] Art Beyond Semantics: Sheaf-Informed Contrastive Learning for Multi-Relational Representations cs.CV | cs.IRPDF

Ludovica Schaerf, Antonio Purificato, Piera Riccio, Fabrizio Silvestri, Noa Garcia

TL;DR: 本文提出CANVAS框架，一种基于层理论的多关系对比学习模型，用于解决艺术图像理解中单一共享嵌入空间无法捕捉风格、图像志、历史背景等多维度语义关系的问题。该方法将每件艺术品投影到多个关系感知的嵌入中，并通过新颖的对比损失进行训练，在三个新构建的艺术品基准测试中取得了优于基线模型的表现。

Details

Motivation: 现有视觉语言模型（如CLIP）将艺术品的多维度语义关系压缩到单一同质对齐空间中，丢失了定义艺术史推理的多关系结构，无法满足艺术史分析中对风格、图像志、历史背景等不同且不可互换维度的理解需求。

Result: 在WikiArt+、HertzianaDP和SemArt+三个新引入的多关系艺术理解基准测试上，CANVAS在多模态检索和艺术理解任务中均超越了基线模型，证明了多关系对齐不仅在理论上有动机，而且在实践中至关重要。

Insight: 创新点在于引入层理论思想，通过关系条件化的多重嵌入投影来显式建模多维度语义关系，并设计了不依赖推理时外部数据的新型对比损失；客观来看，该方法为多模态表示学习提供了可分离且可解释的关系感知框架，超越了传统单一对齐空间的局限性。

Abstract: Understanding a painting is never a single act. Art historians may analyze the same work through concepts of style, iconography, or historical context, dimensions that are not interchangeable, and each carries distinct semantic relationships between the visual and the textual. Vision-Language Models (VLMs) like CLIP, which learn a single shared embedding space, collapse this richness into a single homogeneous alignment, thereby losing the multi-relational structure that defines art-historical reasoning. We introduce CANVAS (Contrastive Art-aware Network for Vision-Language Alignment with Sheaves), a framework for learning relation-aware multimodal representations inspired by sheaf theory. Each artwork is projected into multiple embeddings conditioned on the type of relation (i.e., the context), and a novel contrastive loss encodes contextual information during training, with no dependency on external data at inference. We evaluate on three newly introduced benchmarks of artworks for multi-relational art understanding: WikiArt+, derived from WikiArt and Wikipedia, HertzianaDP, from the Bibliotheca Hertziana collection, and SemArt+, refined from the SemArt dataset. In multimodal retrieval and art understanding, CANVAS outperforms the baselines, supporting the view that multi-relational alignment is not just theoretically motivated but also practically essential.

[35] Deep Learning-based Filtering for Video Coding: A Survey on Architectures, Algorithms, and Complexity Analysis cs.CVPDF

Young-Woon Lee, Byung-Gyu Kim

TL;DR: 本文是一篇关于深度学习滤波在视频编码中应用的综述，系统性地回顾了相关架构、算法和复杂度分析。论文提出了一个三维分类法，从集成方案、编码信息利用和网络设计策略三个维度对现有方法进行分类，并重点分析了率失真性能与硬件可行性之间的权衡。

Details

Motivation: 随着超高清显示和沉浸式媒体服务在物联网和消费电子领域的普及，对高效视频编码的需求日益增长。深度学习滤波虽能有效减轻HEVC/H.265和VVC/H.266等标准中的压缩伪影，但其在消费电子设备上的部署受限于计算复杂度、内存带宽和功耗。本文旨在弥合学术研究与实际部署之间的差距。

Result: 论文未提供具体的定量实验结果，但综述了现有方法的性能趋势，指出研究正从重型性能导向模型转向针对神经处理单元（NPUs）的轻量级硬件友好架构。

Insight: 创新点在于提出了一个硬件导向的全面综述框架，强调性能与硬件可行性的权衡，并整合了JVET在基于神经网络的视频编码（NNVC）方面的最新标准化活动，为下一代消费电子视觉端点的低功耗智能视频编码提供了路线图。

Abstract: As Ultra-High-Definition (UHD) displays and immersive media services become ubiquitous in the Internet of Things (IoT) and Consumer Electronics (CE) sectors, including 8K display and mobile devices, the demand for high-efficiency video coding is unprecedented. While Deep Learning-based Filtering (DLF) has emerged as a promising solution to mitigate compression artifacts inherent in standards like High Efficiency Video Coding (HEVC/H.265) and Versatile Video Coding (VVC/H.266), its deployment in CE devices is severely constrained by computational complexity, memory bandwidth, and power consumption. To bridge the gap between academic research and practical deployment, this paper presents a comprehensive, hardware-oriented survey of DLF techniques. We propose a systematic three-dimensional taxonomy classifying methods into (1) Integration Scheme within the Video Coding, (2) Coding Information Utilization, and (3) Network Design Strategy. Unlike prior reviews, this work critically analyzes the trade-offs between Rate-Distortion (RD) performance and hardware feasibility, highlighting the evolution from heavy, performance-oriented models to lightweight, hardware-friendly architectures targeting Neural Processing Units (NPUs). Furthermore, we incorporate the latest standardization activities from the Joint Video Experts Team (JVET) on Neural Network-based Video Coding (NNVC) to provide realistic guidelines. We also identify open challenges such as real-time inference latency and error propagation, providing a roadmap toward robust, low-power intelligent video coding in next-generation CE vision endpoints.

[36] GMoT: Gated Motion-Aware Tokenization for Fine-Grained Micro-Gesture Video Reasoning with Multimodal LLMs cs.CV | cs.AIPDF

Taorui Wang, Wei Xia, Hui Ma, Zijia Song, Jiayu Zhang

TL;DR: 本文提出了GMoT（门控运动感知标记化）模块，用于增强多模态大语言模型（MLLMs）在细粒度微手势视频推理中的性能。该方法通过空间加权池化动态关注动作相关区域，提取相邻帧的时间差分以捕捉精确运动能量，并利用保守初始化的语义门自适应地将这些线索融合到视觉流中。此外，论文还引入了渐进式奖励引导的策略精炼范式和一个半监督标注流程，以生成基于解剖学聚焦的描述，从而将任务从简单分类转向基于证据的推理。

Details

Motivation: 微手势识别需要检测短暂、空间局部的运动，这些运动常被主导的静态外观和背景噪声所淹没。现有的多模态大语言模型虽然在通用视频理解方面表现出色，但本质上难以处理细微的运动学特征，且往往依赖静态姿态先验。

Result: 在iMiGUE和SMG数据集上，该方法分别取得了67.32%和73.11%的Top-1准确率，相比Qwen3-VL-8B基线分别提升了6.80和3.11个百分点，达到了最佳性能。评估表明，该方法不仅提升了域内准确率，在标签保持的损坏下仍保持明显增益，并在明确的小分割限制下改善了以准确率为导向的跨域迁移性能，同时在其生成的推理中保持了较高的解剖学基础。

Insight: 核心创新点在于GMoT模块，它显式地将稀疏的运动学证据提炼成紧凑的序列，作为时序建模的先验。这通过动态的空间加权池化、精确的时序差分提取和自适应语义门融合来实现。此外，论文提出的渐进式奖励引导精炼范式、半监督解剖学聚焦标注流程，以及引入的Body-Region Grounding (BRG) Recall指标和跨域迁移协议，为细粒度视频推理任务提供了新的评估框架和方法论。

Abstract: Micro-gesture recognition demands the detection of fleeting, spatially localized movements that are frequently overwhelmed by dominant static appearances and background noise. While Multimodal Large Language Models (MLLMs) excel at general video understanding, they inherently struggle with subtle kinematics and often rely on static posture priors. To this end, we propose GMoT, a Gated Motion-Aware Tokenization module that explicitly distills sparse kinematic evidence into a compact sequence prior to temporal modeling. GMoT dynamically spotlights action-relevant regions via spatially weighted pooling, extracts adjacent-frame temporal differencing to capture precise motion energy, and adaptively fuses these cues into the visual stream using a conservatively initialized semantic gate. To transition from simple classification to evidence-grounded reasoning, we further introduce a progressive reward-guided policy refinement paradigm, supported by a semi-supervised annotation pipeline that generates anatomically focused captions. Beyond achieving the best Top-1 accuracy among the compared methods on iMiGUE (67.32%) and SMG (73.11%), improving the Qwen3-VL-8B baseline by +6.80 and +3.11 points, our framework introduces Body-Region Grounding (BRG) Recall as an anatomical-grounding proxy conditioned on correct predictions, together with an overlapping-label cross-domain transfer protocol between iMiGUE and SMG. Extensive evaluations demonstrate that our GMoT-augmented model improves in-domain accuracy, retains clear gains under label-preserving corruptions, and improves accuracy-oriented cross-domain transfer under explicit small-split caveats while maintaining high anatomical grounding in its generated rationales.

[37] SGMCE: Segment-Grounded Morphological Concept Explanation for Malaria Parasite Species Identification in Thick Blood Smears cs.CV | cs.LGPDF

Ahmed Tahiru Issah, Charles B. Delahunt, Carine Mukamakuza

TL;DR: 本文提出了一种名为SGMCE的后处理解释框架，用于在厚血涂片疟疾寄生虫物种识别任务中，为深度学习检测器的预测结果提供基于形态学的自然语言解释。该方法无需额外训练、形态学标注或解释数据，通过提取掩码引导的裁剪缩略图、计算手工设计的计算机视觉形态特征，并结合GPT-4o和世界卫生组织知识库生成结构化解释。

Details

Motivation: 解决在疟疾流行地区，深度学习检测器虽然能识别厚血涂片中的寄生虫物种，但无法提供形态学证据来支持其预测，从而限制了显微镜专家在病例层面审核预测结果的能力。

Result: 在包含四种疟原虫物种和白细胞的139张厚血涂片图像的737个检测结果上，寄生虫类别的平均知识库一致性（KBC）为0.91，平均判别分数（DS）为0.99，平均CV声明忠实度（CCF）为0.97，表明生成的解释具有高一致性和忠实性。

Insight: 创新点在于提出了一种无需额外标注或训练的后处理解释框架，将手工设计的形态特征与大型语言模型（GPT-4o）及领域知识库（WHO指南）相结合，生成可审计的、基于形态学的自然语言解释，并通过自动指标验证解释质量。

Abstract: Malaria diagnosis in endemic regions depends on species-level identification of Plasmodium parasites in thick blood smears, but deep learning detectors classify detections without providing morphological evidence for their predictions, limiting the ability of microscopists to audit those predictions at the case level. We present SGMCE (Segment-Grounded Morphological Concept Explanation), a post-hoc explanation framework that requires no additional training, no morphological annotations, and no labelled explanation data, yet produces per-detection natural-language explanations anchored in thick-smear morphology. For each detection, SGMCE extracts mask-guided crop thumbnails, computes fourteen handcrafted computer-vision morphological features (shape, colour, chromatin, haemozoin pigment) using adaptive within-mask thresholds, and queries GPT-4o with both visual evidence and computed measurements, conditioned on a thick-smear-specific knowledge base compiled from the World Health Organization bench aids. The primary output is a structured explanation identifying which morphological features support the detected species and why the competing species are excluded. Explanations are validated by four automatic metrics: Knowledge-Base Consistency (KBC), CV-Claim Faithfulness (CCF), Discriminativeness Score (DS), and LLM-as-Judge (LLMj). A sentence-level semantic scoring rule with species-aware negation filtering resolves the vocabulary mismatch between clinical prose and knowledge-base terms. Across 737 detections from 139 thick-smear images spanning four Plasmodium species and white blood cells, parasite-class mean KBC is 0.91, mean DS is 0.99, and mean CCF is 0.97, while a per-rule CCF breakdown confirms that the CV-grounded claims made by the vision-language model are consistent with the measurements they cite.

[38] RegionFM: Interpretable Region-Based Brain MRI Classification Using Foundation Model Embeddings cs.CV | cs.LGPDF

Wei Zhang

TL;DR: RegionFM是一种基于解剖区域的可解释脑MRI分类框架，它结合了预训练基础模型的嵌入表示与解剖分割技术。该方法将MRI扫描分割为多个解剖区域，为每个区域构建独立的MRI体积，并使用冻结的基础模型提取区域嵌入，最后通过区域可加性逻辑模型整合这些嵌入，使每个解剖区域对最终预测做出明确的标量贡献。

Details

Motivation: 现有基础模型在脑MRI分析中虽能提供强大的表示，但其预测结果难以用解剖学上有意义的方式进行解释。临床评估通常围绕解剖结构和区域异常展开，而传统解释方法（如体素或块级重要性图）无法明确量化单个脑区域的贡献，因此需要一种能更好对齐临床解剖推理的解释框架。

Result: 在认知障碍分类任务中，RegionFM使用多个预训练脑MRI基础模型的嵌入进行评估，其性能与可解释性较差的微调方法相当，同时提供了基于解剖结构的解释。随机嵌入消融实验导致性能接近随机水平，表明预测依赖于基础模型嵌入捕获的有意义结构而非简单特征统计。

Insight: 创新点在于将解剖分割与基础模型嵌入相结合，通过区域可加性模型实现每个解剖区域的显式贡献量化，支持个体和群体层面的区域贡献分析，从而在保持竞争力的预测性能的同时，使模型解释更符合基于解剖的临床推理逻辑。

Abstract: Foundation models provide powerful representations for brain MRI analysis, but their predictions remain difficult to interpret in anatomically meaningful terms. Clinical assessment of brain MRI is commonly organized around anatomically defined structures and regional abnormalities, whereas conventional explanation methods typically produce voxel- or patch-level importance maps that do not explicitly quantify the contributions of individual brain regions. To address this mismatch, we propose RegionFM, an interpretable framework that integrates anatomical segmentation with brain MRI foundation-model embeddings. RegionFM first divides each MRI scan into anatomical regions and constructs a separate MRI volume for each region. A frozen foundation model then encodes each region into an embedding, and a region-additive logistic model combines these embeddings such that every anatomical region contributes an explicit scalar term to the final prediction. This formulation supports both subject-level and cohort-level analyses of regional contributions. We evaluate RegionFM on cognitive-impairment classification using embeddings from multiple pretrained brain MRI foundation models. The results show that RegionFM maintains performance comparable to less interpretable fine-tuning approaches while providing anatomically grounded explanations. Randomized embedding ablations yield near-chance performance, indicating that the predictions rely on meaningful structure captured by the foundation-model embeddings rather than simple feature statistics. Overall, RegionFM better aligns model explanations with anatomy-based clinical reasoning while maintaining competitive predictive performance.

[39] CRISP: Pre-LLM Yet Text-Driven Visual Token Pruning for Efficient LVLM Inference cs.CVPDF

Xu Li, Yi Zheng, Mengyang Zhao, Yuxuan Liang, Zhe Liu

TL;DR: 本文提出了CRISP框架，一种在大型视觉语言模型推理前进行、基于文本驱动的视觉令牌剪枝方法，旨在减少LVLM处理大量视觉令牌带来的计算开销。该方法通过两阶段流程（文本对齐令牌识别和语义多样性增强）保留指令相关证据和关键场景上下文，在LLaVA-1.5和LLaVA-NeXT上实验表明，能在高剪枝率下保持高达99.5%的准确率，同时将推理成本和延迟降低2倍以上。

Details

Motivation: 现有视觉令牌剪枝方法要么在LLM前使用与文本无关的启发式方法，要么在LLM内部剪枝但牺牲效率并引入噪声跨模态注意力，CRISP旨在解决这些限制，实现高效且保留关键信息的LVLM推理。

Result: 在LLaVA-1.5和LLaVA-NeXT基准测试中，CRISP在激进剪枝比率下实现了卓越的性能保持，准确率高达99.5%，同时推理成本和延迟降低超过2倍，展示了其高效性。

Insight: 创新点在于提出了一种预LLM但文本驱动的视觉令牌剪枝框架，结合文本对齐和语义多样性增强，在剪枝时兼顾指令相关性和场景完整性，为资源受限场景提供了实用的高效推理解决方案。

Abstract: Large Vision-Language Models (LVLMs) typically require processing hundreds to thousands of visual tokens, leading to substantial inference overhead. Existing visual token pruning methods either operate before the LLM using text-agnostic heuristics or prune inside the LLM at the cost of efficiency and noisy cross-modal attention. To address these limitations, we propose CRISP, a pre-LLM yet text-driven visual token pruning framework that preserves both instruction-relevant evidence and essential scene context. CRISP works in a two-stage pipeline: Stage 1 first identifies text-aligned visual tokens, and Stage 2 enhances contextual completeness through semantic diversity. Extensive experiments on LLaVA-1.5 and LLaVA-NeXT demonstrate that CRISP achieves superior performance retention under aggressive pruning ratios, maintaining up to 99.5% accuracy while reducing inference cost and latency by more than 2 times. CRISP serves as a practical solution for efficient LVLM inference, especially in resource-constrained scenarios.

[40] Local Brushstroke Quality Assessment via Vision-Language Feedback cs.CVPDF

Mio Mitamura, Hirokatsu Kataoka

TL;DR: 本文研究多模态大语言模型（GPT-4o、Claude Sonnet 4、Gemini 2.5 Flash）能否评估书法中局部笔触的质量并生成有教育意义的自然语言反馈。通过构建评估框架，将模型对书法作品前后图像对的评分（五点序数量表）与三位书法专家的评分进行比较，并考察了Claude的检索增强生成（RAG）变体。

Details

Motivation: 旨在探索多模态LLMs在书法教育中评估局部笔触质量并提供有用反馈的潜力，解决传统人工评估耗时且难以规模化的问题。

Result: 所有模型在绝对评分准确性（MAE）上均达到有用水平，其中GPT-4o表现最佳（MAE = 0.885），但所有模型与人类专家的整体排名相关性（Kendall’s tau）均未达到统计显著性。RAG变体提高了排名相关性但降低了绝对准确性。

Insight: 创新点在于将多模态LLMs应用于书法笔触的细粒度质量评估与反馈生成，并系统比较了不同模型的表现。客观分析表明，模型存在特征性的评估偏见，且基于文本规则注入的RAG方法在准确性与相关性间存在权衡，这为多模态评估任务的设计提供了重要负向结果参考。

Abstract: This paper investigates whether multimodal LLMs can evaluate local brushstroke quality in calligraphy and generate educationally useful natural language feedback. We construct an evaluation framework in which three multimodal LLMs (GPT-4o, Claude Sonnet 4, and Gemini 2.5 Flash) assess before-after image pairs of calligraphic works using a five-point ordinal scale, and compare their outputs against scores assigned by three expert calligraphers. We additionally examine a Retrieval-Augmented Generation (RAG) variant of Claude as a preliminary condition. Results show that all models achieve useful levels of absolute score accuracy (MAE), with GPT-4o performing best (MAE = 0.885). However, none of the models produce statistically significant overall rank correlations with human experts (Kendall’s tau). Vocabulary analysis of generated rationales reveals characteristic evaluative biases in each model, and RAG is shown to improve rank correlation while worsening absolute accuracy, constituting an important negative result for text-based rule injection.

[41] Privacy-Aware Synthetic Video Benchmarking and Relational Evaluation for Worker-Under-Suspended-Load Detection cs.CV | cs.AIPDF

Anshu Singh, Alejandro Seif

TL;DR: 本文针对建筑工地中工人处于悬吊载荷下的安全风险检测问题，提出了一种名为SynthSite的合成视频基准数据集，并研究了在保护工人隐私（如进行全身模糊处理）的同时，如何保持对危险场景的识别能力。

Details

Motivation: 公开可共享的建筑视频基准数据集稀缺，尤其是对于罕见、危险且难以发布的悬吊载荷风险。该研究旨在解决这一数据缺口，并探索如何在隐私保护（如模糊工人外观）的情况下，不损害对几何关系和时间持续性依赖的危险识别。

Result: 在五种全身隐私条件下进行评估，发现保持结构的模糊方法比外观平滑的基线方法保留了更多的下游任务效用，并且仅保留原始视觉参考并不能保证与人工危险标签的最高一致性。

Insight: 创新点在于提出了一个专注于关系性危险（工人-载荷几何与时间持续性）的隐私感知合成视频基准生成工作流。核心洞察是，建筑安全分析中的隐私评估不仅应关注外观抑制，还应评估对危险推理所需的几何线索的保留程度。

Abstract: Publicly shareable construction-video benchmarks remain scarce, especially for safety-critical hazards that are rare, dangerous to stage, and difficult to release. We study worker under suspended load, a relational hazard that depends on worker-load geometry and temporal persistence rather than object detection alone. We introduce SynthSite, a focused synthetic video benchmark of 55 clips spanning varied load configurations, viewpoints, clutter, occlusions, and surveillance conditions, together with a privacy-aware hybrid generation workflow that supports both publicly shareable benchmark creation and privacy-constrained synthetic video generation. We then ask whether worker appearance can be suppressed without undermining downstream hazard recognition. Under five whole-body privacy conditions, we evaluate worker and load retention, localization stability, and clip-level hazard recognition. We find that structure-preserving obfuscations retain substantially more downstream utility than appearance-smoothing baselines, and that preserving a raw visual reference alone does not guarantee the strongest agreement with human hazard labels. These findings suggest that privacy evaluation for construction safety analytics should assess not only appearance suppression, but also preservation of the geometric cues required for hazard reasoning. Our dataset and code are available at https://huggingface.co/datasets/govtech/SynthSite .

[42] Localization-Infused Vision-Language Semantic Fusion for Text-Guided Medical Image Segmentation cs.CVPDF

Songyue Han, Mingye Zou, Shuchang Ye, Lei Bi, Mingyuan Meng

TL;DR: 本文提出了一种名为LoG的定位信息融合视觉-语言框架，用于文本引导的医学图像分割。该框架通过联合执行多尺度目标定位任务，显式地捕获面向目标的视觉-语言语义，并实现了三个层次的定位信息融合，以更好地利用文本报告中包含的目标位置等关键语义信息。在三个包含配对文本报告的医学影像基准数据集上的实验表明，LoG方法在多个模态上均取得了优异的Dice分数，性能超越了现有最先进的方法。

Details

Motivation: 现有文本引导分割方法通常通过预训练文本编码器隐式提取文本语义，并进行简单的图像-文本特征融合，未能显式捕获文本报告中嵌入的面向目标的信息（特别是目标位置），也未能探索超越基本特征级融合的多层次信息融合策略，这限制了关键文本语义的提取与整合。

Result: 在QaTa-COV19、MosMedData+和Kvasir-SEG三个基准数据集上的广泛实验表明，LoG分别取得了91.59%、80.71%和94.59%的Dice分数，持续超越了最先进的医学图像分割方法。

Insight: 创新点在于提出了一个显式捕获目标位置信息的视觉-语言融合框架，并设计了三个层次的定位信息融合策略：定位引导的特征融合、定位门控的注意力融合和定位约束的损失融合，从而实现了更精细的语义整合与分割监督。

Abstract: Medical image segmentation is essential for modern computer-aided medicine. Recently, text-guided segmentation has shown promise by incorporating clinician-formulated textual reports as semantic guidance for image segmentation. These reports describe target appearance, location, and neighboring anatomy, providing explicit guidance for localization and delineation. Existing text-guided segmentation methods typically extract textual semantics implicitly through a pretrained text encoder and then integrate vision-language semantics via straightforward image-text feature fusion. However, these methods do not explicitly capture target-oriented information embedded in textual reports, particularly target location, and do not explore multi-level information fusion strategies beyond basic feature-level fusion, limiting the extraction and integration of critical textual semantics. In this study, we propose LoG, a localization-infused vision-language fusion framework for text-guided medical image segmentation. By jointly performing multi-scale target localization tasks, LoG explicitly captures target-oriented vision-language semantics and enables three-level localization-infused semantic fusion: (i) localization-guided feature fusion that directly infuses location-relevant semantics into visual features, (ii) localization-gated attention fusion that redirects multi-scale localization predictions to reinforce critical regions, and (iii) localization-constrained loss fusion that supervises segmentation based on spatial consistency with target localization. Extensive experiments on three benchmark datasets, involving three medical imaging modalities with paired textual reports, demonstrate that LoG achieves Dice scores of 91.59%, 80.71%, and 94.59% on QaTa-COV19, MosMedData+, and Kvasir-SEG, respectively, consistently outperforming state-of-the-art medical image segmentation methods.

[43] PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation cs.CV | cs.AIPDF

Qirui Li, Jinkun Hao, Yibo Li, Ran Yi, Paul L. Rosin

TL;DR: 本文提出PhysAgent，一种反思性智能体框架，用于提升物理基础视频生成的物理合理性。该框架通过物理程序生成、物理模拟、阶段验证和程序修复的闭环机制，解决了现有方法在细粒度物体动力学、复杂运动轨迹和时间结构化交互方面的不足。

Details

Motivation: 现有基于物理模拟的视频生成方法通常通过视觉语言模型一次性生成物理参数，难以准确地将用户意图转化为可执行的模拟，特别是在处理精细物体动态、复杂轨迹和多阶段交互时存在局限。

Result: 大量实验表明，PhysAgent能生成更具物理合理性的视频，在提示对齐方面表现更好，并能更有效地泛化到多样化的物理场景中。

Insight: 创新点在于将每个物理程序视为可执行假设，通过智能体驱动的闭环反思机制逐步优化物理参数控制，并设计了支持更稳定复杂运动行为的物理控制API，从而实现了对复杂轨迹和交互的渐进式精确实现。

Abstract: Recent advances in physics-grounded video generation leverage physics simulation as a physical prior to guide video synthesis toward physically plausible outcomes. The simulation process is controlled by physical specifications, which are typically generated by a vision-language model in a single pass. Such one-shot prediction often fails to accurately translate user intent into executable simulations, particularly for fine-grained object dynamics, complex motion trajectories, and temporally structured interactions. In this paper, we propose PhysAgent, a reflective agentic framework that closes the loop among physical program generation, physics simulation, stage-specific verification, and targeted program repair. Beyond improving the control of coupled physical parameters, our framework enables the agent to progressively realize complex trajectories, multi-stage interactions, and precise event outcomes by treating each physical program as an executable hypothesis. In addition, we design a set of physics-control APIs to support more stable and complex motion behaviors. Extensive experiments demonstrate that PhysAgent produces more physically plausible videos, achieves better prompt alignment, and generalizes more effectively across diverse physical scenarios.

[44] OmniStyle-INR: Universal and Multimodal Style Transfer for INRs cs.CVPDF

Rafał Kajca, Michał Miziołek, Kornel Howil, Rafał Tobiasz, Przemysław Spurek

TL;DR: 本文提出OmniStyle-INR框架，利用基于网络的连续隐式神经表示作为通用域，实现跨所有视觉模态（如图像、视频、3D场景）的高质量风格迁移，并支持文本提示和视觉示例的引导。

Details

Motivation: 针对现有基于高斯溅射的方法在表示视频和2D图像等密集连续域时结构次优、所需高斯数量接近像素总数的问题，本文旨在利用隐式神经表示的自然优势（如数据压缩、超分辨率能力）构建一个真正通用的风格迁移框架。

Result: 论文声称其方法能够成功执行跨所有视觉模态的高质量风格迁移，但摘要中未提及具体的定量结果或基准测试。

Insight: 创新点在于将隐式神经表示确立为通用域，实现了跨模态的统一风格迁移，并同时支持文本和视觉引导，这为多模态内容创作提供了更灵活和高效的解决方案。

Abstract: Style transfer remains a fundamental and highly important task across various data modalities, enabling creative manipulation conditioned by both reference images and textual descriptions. Recently, methods utilizing Gaussian Splatting have emerged as a unified representation for 2D images, video, 3D scenes, and 4D dynamics. However, representing videos and 2D images with Gaussian Splatting is structurally sub-optimal for dense continuous domains. The number of required Gaussians often approaches the total number of pixels, raising questions about the actual utility of such a representation for these specific modalities. In contrast, Implicit Neural Representations have established themselves as a much more popular and natural choice across all these data domains. Implicit Neural Representations naturally provide significant advantages, including data compression, inherent capabilities for super resolution, and seamless integration with deep generative models. To this end, we introduce OmniStyle-INR, a novel framework that leverages network-based continuous representations as a truly universal domain. Our approach successfully performs high-quality style transfer across all visual modalities, guided seamlessly by both text prompts and visual exemplars.

[45] Disentangling Model and Human Data Uncertainty in Apparent Facial Age Estimation cs.CV | cs.LGPDF

Andrei Foitos, Ivo Pascal de Jong, Matias Valdenegro-Toro

TL;DR: 本文研究了人脸表观年龄估计中的不确定性量化问题，利用APPA-REAL数据集，通过贝叶斯神经网络（BNN）的三种近似方法（MC-DropConnect、Flipout和深度集成）来联合估计认知不确定性和偶然不确定性。结果表明，偶然不确定性在不同数据集规模下保持稳定，而认知不确定性随训练数据减少而增加。

Details

Motivation: 人脸表观年龄估计因感知的主观性和数据的固有变异性而具有挑战性，本文旨在量化模型不确定性（认知）和人类数据不确定性（偶然）的不同来源。

Result: 在APPA-REAL数据集上的实验证实了假设：偶然不确定性在不同数据集规模下保持稳定，而认知不确定性随训练数据减少而增加，从而实现了不确定性在面部年龄估计中的量化。

Insight: 创新点在于利用人类标注的偶然不确定性监督训练BNN，并区分了认知和偶然不确定性；客观分析表明，该方法为理解模型和数据不确定性在主观任务中的作用提供了框架，有助于提高模型的可靠性和解释性。

Abstract: Estimating the apparent age of individuals from facial images is challenging due to the subjective nature of perception and the inherent variability of the data. We investigate the role of uncertainty estimation, attributing uncertainty jointly to a lack of knowledge (epistemic) or inherent noise/chance (aleatoric). Leveraging the APPA-REAL dataset, we train Bayesian Neural Networks on datasets of varying sizes using three BNN approximations: MC-DropConnect, Flipout, and Deep Ensembles using supervision on human aleatoric uncertainty available in the APPA-REAL dataset. Each model outputs both the predicted apparent age and the amount of aleatoric and epistemic uncertainty. Our results confirm the hypothesis that the inherent aleatoric uncertainty remains stable across dataset sizes, while epistemic uncertainty increases as training data decreases. These findings demonstrate that different sources of uncertainty can be quantified in face age estimation.

[46] Apple-$π$: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence cs.CVPDF

Runmao Yao, Kairui Hu, Yukang Cao, Ruisi Wang, Shulin Tian

TL;DR: 本文提出了Apple-PI基准测试，旨在评估视频生成模型是否基于物理定律进行推理。该基准包含Orchard数据集、三阶段评估协议和混合评估套件，用于诊断模型在感知、公式化和演绎阶段的失败点。对11个模型的测试表明，当前模型远未成为可靠的、基于物理定律的世界模拟器。

Details

Motivation: 现有基准主要评估视频生成模型输出层面的物理合理性，但缺乏对其推理过程是否忠实于物理定律的验证。本文旨在填补这一空白，建立首个明确锚定于物理定律的视频模型评估基准。

Result: 在Apple-PI基准上测试了11个模型，最佳视频模型得分仅为0.473，表明当前模型与可靠的、基于物理定律的世界模拟器相去甚远。分析揭示了感知-公式化-演绎的瓶颈、弱的多定律状态转移以及持续的仿真到现实的差距。

Insight: 创新点在于提出了首个将视频模型评估明确锚定于物理定律的基准，并设计了包含三阶段推理（感知、公式化、演绎）的诊断协议，以及结合主观评分和客观物理定律度量的混合评估套件，实现了对模型失败点的精细化定位。

Abstract: Modern video generation models are increasingly hailed as emerging world models with an internalized grasp of physical law. Yet existing benchmarks largely evaluate physical plausibility only at the output level, without verifying whether the model arrives there through a faithful, law-grounded reasoning process. We introduce Apple-PI, the first benchmark that anchors video-model evaluation explicitly in physical laws. Apple-PI comprises three components. 1) Orchard: a dataset of 400 videos covering ten canonical tasks in classical mechanics. It separates single-law tasks for confounder-free diagnosis from multi-law tasks for probing generalization. 2) Benchmark Protocol: a three-stage protocol based on scientific reasoning, including Perception, Formulation, and Deduction. It uses chain-of-frames prompting on infographic-annotated first frames, treating the generated video as the model’s visible reasoning trace. 3) Evaluation Suite: a hybrid evaluation suite that combines MLLM-based subjective scoring with physics-law-grounded objective measures. This enables stage-resolved diagnosis of not only whether a model fails, but where it fails. Benchmarking 11 models shows that current video models remain far from reliable law-grounded world simulators, with the best video model scoring only 0.473. Our stage-, pillar-, and source-resolved analyses further expose a Perception-to-Formulation-to-Deduction bottleneck, weak multi-law state transfer, and a persistent Sim-to-Real gap. These findings position Apple-PI as a diagnostic foundation for guiding future video models toward world models with law-grounded physical intelligence.

Sudharshan Balaji, Yili Ren, Guangjing Wang, Yimin Chen, Ning Wang

TL;DR: 本文首次系统研究了视觉语言模型（VLM）中跨模态遗忘的传递性，发现文本遗忘能部分传递到视觉模态，但这种传递是不对称且不完整的，且在排版攻击下脆弱。为应对此问题，论文提出了基于影响力引导的缓解策略CrossInf，有效缩小了传递差距并提升了对抗攻击的鲁棒性。

Details

Motivation: 动机在于探究现代视觉语言模型（VLMs）中，针对单一模态（如文本）的遗忘操作，其效果是否会传递到另一模态（视觉），这关系到模型安全性的根本问题。

Result: 在LLaVA-1.5、InstructBLIP和IDEFICS三种VLM架构上的实验表明，CrossInf方法在具有强融合能力的架构中，能将跨模态传递差距减少一半以上，并将排版攻击的成功率降至接近零，同时保持了模型效用。

Insight: 创新点在于首次对VLM进行双向跨模态遗忘的系统性研究，揭示了遗忘传递的不对称性和浅层遗忘问题，并提出了基于影响力分析（聚焦于对跨模态泛化影响最大的Transformer块）的针对性缓解策略CrossInf，为模型安全遗忘提供了新思路。

Abstract: Machine unlearning is widely used to remove hazardous knowledge from large language models. Modern Vision-Language Models (VLMs), however, process both text and visual inputs, raising a fundamental security question: does unlearning in one modality transfer to the other? We present the first systematic, bidirectional study of cross-modal unlearning transfer across three VLM architectures: LLaVA-1.5 (MLP projection), InstructBLIP (Q-Former), and IDEFICS (gated cross-attention). We find that unlearning transfers across modalities, but the transfer is asymmetric and incomplete. In some cases, text unlearning strongly transfers to vision. However, this robustness is not preserved under typographic attacks that manipulate the visual presentation of text. Under such attacks, previously unlearned knowledge can be readily recovered, indicating shallow unlearning. To address the transfer gap and shallow robustness, we propose \textsc{CrossInf}, an influence-guided mitigation strategy. Motivated by the observation that different model components contribute unequally to cross-modal transfer, \textsc{CrossInf} focuses unlearning on transformer blocks that most influence cross-modal generalization. It reduces the transfer gap by more than half in architectures with strong fusion, while preserving model utility. It also improves robustness under typographic attacks, reducing the attack success rate to near zero. We further conduct human evaluation with three annotators ($κ{=}0.77$) to validate our findings. Finally, we analyze shallow unlearning using Centered Kernel Alignment (CKA), providing insights into the observed transfer behavior and robustness limitations.

[48] Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models cs.CV | cs.AI | cs.LGPDF

Junhao Liu, Jian-Wei Zhang, Tao Huang, Miles Yang, Zhao Zhong

TL;DR: 本文提出了ATLAS框架，通过’思考、规划、绘制’的范式，将布局作为共享表示，以增强统一多模态大语言模型在可控图像生成中遵循复杂空间指令和逻辑约束的能力。该框架利用强化学习进行布局对齐，提升了规划到图像的保真度，并在多个尺度上实现了SOTA性能，同时支持指令引导编辑和多模态接地任务。

Details

Motivation: 现有统一多模态大语言模型在可控图像生成中难以遵循复杂的空间指令和逻辑约束，因此需要一种能够进行空间推理和显式规划的框架来弥合这一差距。

Result: ATLAS在7B和80B规模上实例化，在图像生成基准测试中达到了SOTA水平，相比现有基于布局的统一MLLMs平均提升了65.31%，在空间相关任务上相比基础模型平均获得了23.06%的提升。

Insight: 创新点在于引入布局作为连接推理、规划和生成三阶段的共享表示，并采用强化学习进行布局对齐以提高生成保真度；客观来看，这种结构化推理范式为统一模型处理复杂空间约束提供了可扩展的解决方案。

Abstract: Unified Multimodal Large Language Models (MLLMs) offer a promising paradigm for unifying visual understanding and generation, yet they still struggle to follow complex spatial instructions and logical constraints in controllable image generation. To address this gap, we present ATLAS, a unified framework that equips MLLMs with a human-like “Think, Plan, and Paint” paradigm. We adopt layout as the shared representation that connects the three stages, enabling the model to reason about spatial requirements, plan explicit object arrangements, and render the final image. We further improve plan-to-image fidelity with reinforcement-learning-based layout alignment. We instantiate ATLAS at 7B and 80B scales, achieving state-of-the-art performance among MLLMs on image generation benchmarks and an average 65.31% improvement over existing layout-based unified MLLMs. On spatially related tasks, ATLAS obtains an average 23.06% gain over the base models. Through the same layout interface, ATLAS also supports instruction-guided editing and multimodal grounding. We further introduce ATLAS-Reasoning, a benchmark for evaluating generation under complex spatial instructions.

[49] WeedExpert-R1: Incentivizing Botanical Reasoning in MLLMs with Reinforcement Learning for Precision Weed Grounding cs.CVPDF

Zonglin Yang, Wei-Zhen Liang, Nevin Lawrence, Xin Qiao, Benjamin Riggan

TL;DR: 该论文提出了WeedExpert-R1模型，这是一个通过强化学习激励植物学推理的多模态大语言模型，用于实现精准杂草定位。它通过一个结合人类标注植物性状词典和LLM审计-合成工作流的特定领域思维链合成管道来生成监督微调数据，并应用组相对策略优化进行训练。

Details

Motivation: 解决精准杂草控制中需要物种级识别和实例级定位的问题，传统目标检测器使用封闭词汇表，限制了跨区域部署，且无法解释复杂农业场景中的预测，而现有MLLMs在细粒度杂草识别中因植物学知识不足容易产生幻觉。

Result: 在来自六个数据集的37种杂草物种上，WeedExpert-R1-4B在IoU阈值为0.5时取得了75.82%的精确集精度、89.30%的精确率和87.81%的召回率。它超越了包括GPT-5.4和Gemini-3.1-Pro在内的专有模型，以及包括Qwen3-VL-30B-Instruct和Gemma-4-31B-it在内的更大开源模型。在未见物种上的结果进一步证明了其开放词汇能力和无需重新训练即可跨不同区域和作物部署的潜力。

Insight: 创新点在于提出了一个结合领域知识（植物性状词典）和LLM工作流来合成高质量监督微调数据的管道，以及应用组相对策略优化来激励模型进行可验证的、基于视觉的植物学推理，从而提升开放词汇场景下的细粒度识别和定位性能。

Abstract: Precision weed control requires species-level identification and instance-level localization. However, conventional object detectors use a closed vocabulary, limiting their deployment across regions, and cannot explain their predictions in complex agricultural scenes. Multimodal large language models (MLLMs) offer visual grounding and reasoning capabilities, but insufficient botanical knowledge can cause hallucinations in fine-grained weed identification. This study introduces WeedExpert-R1, a multimodal model that learns visually grounded botanical reasoning through verifiable rewards. A domain-specific Chain-of-Thought synthesis pipeline combines a human-curated botanical trait dictionary with an Auditor-Synthesizer LLM workflow to generate reasoning data for supervised fine-tuning. Group Relative Policy Optimization is then applied with rewards for format, accuracy, instance count, and response length. Across 37 weed species from six datasets, WeedExpert-R1-4B achieved 75.82 percent exact-set precision at an IoU threshold of 0.5, 89.30 percent precision, and 87.81 percent recall. It outperformed proprietary models, including GPT-5.4 and Gemini-3.1-Pro, and larger open-source models, including Qwen3-VL-30B-Instruct and Gemma-4-31B-it. Results on unseen species further demonstrate its open-vocabulary capability and potential for deployment across diverse regions and crops without retraining.

[50] Do Vision Encoders Exhibit Human-like Color Thresholds? cs.CVPDF

Engy Ehab, Pablo Hernández-Cámara, Nahla Belal, Jesús Malo, Javier Vazquez-Corral

TL;DR: 本文通过大规模探索性研究，比较了超过50个预训练视觉编码器（包括卷积网络和视觉变换器）的色彩敏感度与人类色彩辨别阈值。研究发现，模型表示与人类感知阈值之间的对齐性普遍较弱，且自监督编码器表现优于监督模型，而语言监督模型则呈现两极分化。

Details

Motivation: 研究动机在于探究深度视觉编码器的内部表示是否展现出类似人类的色彩辨别阈值，以理解其与人类色彩感知的差异。

Result: 在多个色度水平下，模型衍生的色彩辨别阈值与人类辨别椭圆通过区域重叠度量（mIoU）比较，最佳mIoU低于0.25，表明对齐性弱。自监督编码器表现优于监督模型，语言监督模型在排名中占据最高和最低位置。

Insight: 创新点在于首次大规模评估视觉编码器的色彩敏感度与人类阈值的对齐性，揭示当前大规模视觉训练目标未能自然产生人类般的色彩敏感性，为模型感知能力评估提供了新视角。

Abstract: Understanding and characterizing human color perception is a longstanding research goal. One of the most traditional approaches is looking for the human color discrimination thresholds, the minimum chromatic differences perceptible to human observers. In recent years, deep neural networks have become the standard networks for computer vision tasks. In particular, deep vision encoders, foundation models trained on large-scale visual data, map images into latent feature representations. Despite the widespread use of deep vision encoders, few studies have investigated whether their internal representations exhibit human-like discrimination thresholds. In this work, we present a large-scale exploratory study probing the chromatic sensitivity of more than 50 pretrained vision encoders, including convolutional networks and vision transformers, against human discrimination thresholds. Using controlled chromatic stimuli at multiple chroma levels, we compare model-derived chromatic discrimination thresholds with human discrimination ellipses through a region-overlap metric (mIoU). Our analysis reveals generally weak alignment between model representations and human perceptual thresholds across all model families, with the best mIoU < 0.25. Moreover, we find that self-supervised encoders consistently outperform supervised ones, while language-supervised models show the most polarized behavior, occupying both the top and bottom of the ranking. These findings suggest that human-like chromatic sensitivity does not emerge naturally from current large-scale visual training objectives for any of the analyzed architectures.

[51] Geometry-Enhanced Portion Estimation for Multimodal LLMs cs.CV | cs.AIPDF

Lin Liao, Peng Li

TL;DR: 本文提出了一种几何增强的份量估计方法，用于增强多模态大语言模型（MLLMs）在基于图像的饮食评估中的能力。该方法通过一个冻结的DINOv2骨干网络和一个结构化的softmax-ownership体积，构建了一个精确的份量估计头，无需深度传感器或微调MLLM。在三个真实世界基准测试中，该方法显著降低了份量估计误差，并超越了现有旗舰MLLMs和基准测试中原始图像模型的性能。

Details

Motivation: 基于图像的饮食评估旨在替代成本高、易产生偏差的人工记录，但份量估计仍是主要障碍。现有MLLMs虽能零样本识别多种食物，但在份量估计方面表现较弱，存在明显差距。

Result: 在三个真实世界基准测试上进行全开放词汇评估，该方法将每份食物的份量误差相对于单独使用MLLM降低了33-41%，超越了所有旗舰MLLMs的直接估计结果，并在各自报告的指标上超过了每个基准测试中最初发布的仅图像模型。

Insight: 创新点在于设计了一个几何增强的份量估计头，该头利用冻结的MLLM输出的食物名称、边界框和密度范围，结合DINOv2骨干和结构化softmax-ownership体积，实现了无需深度传感器或MLLM微调的精确份量估计，有效弥补了MLLMs在几何感知任务上的不足。

Abstract: Image-based dietary assessment promises to replace costly, bias-prone manual recalls, but portion estimation remains a major blocker. Multimodal LLMs (MLLMs) recognize a wide range of foods zero-shot in uncontrolled photos, yet they are weak at portion estimation – a gap we measure across the current frontier (Gemini, GPT, and Claude flagships alike). We present a method that enhances a frozen, commercial MLLM with an accurate portion head: a small geometry-enhanced network on a frozen DINOv2 backbone with a structured softmax-ownership volume, consuming the MLLM’s per-food name, bounding box, and density range – no depth sensor, no MLLM fine-tuning. Evaluated fully open-vocabulary on three real-world benchmarks, the head cuts per-food portion error by 33-41% relative to the MLLM alone, outperforms every flagship MLLM’s direct estimates, and surpasses each benchmark’s originally published image-only model at its own reported metric.

[52] Digital measurement of droplet flame diameter in microgravity combustion images using Segment Anything Model 2 with automatic prompt selection cs.CVPDF

Minghui Xu, Chaoyi Zhou, Aaron P. Cecil, Xi Liu, Siyu Huang

TL;DR: 本文提出了一种基于Segment Anything Model 2 (SAM2)的AI驱动数字测量工作流，用于从微重力液滴燃烧图像中自动提取火焰直径。该方法集成了自动提示点生成、视频内存机制和基于RANSAC的圆拟合，以克服烟尘尾迹、模糊边界等挑战。

Details

Motivation: 在微重力液滴燃烧研究中，火焰直径是关键测量参数，但自发光图像中的烟尘尾迹、模糊边界、腔室反射和液滴漂移等因素导致传统测量存在显著偏差和操作者依赖性，需要一种自动化、可重复的解决方案。

Result: 在包含19,537张正庚烷、正癸烷和正辛烷液滴火焰图像的数据集上验证，与人工参考测量相比，该方法平均相对一致性达96.9%，平均绝对百分比误差为3.1%，显著优于传统霍夫圆检测，并实现了约229倍的效率提升。

Insight: 创新点在于将SAM2与自动提示生成策略和RANSAC圆拟合相结合，消除了主观手动点选择，并通过视频内存机制保持了时间一致性。这展示了基于AI的分割技术可集成到定量测量工作流中，支持高通量燃烧诊断和数字化图像计量学。

Abstract: Flame diameter is a key measurable parameter in microgravity droplet combustion, but its extraction from self-illuminated frames remains difficult because soot tails, blurred luminous boundaries, chamber reflections, and droplet drift introduce substantial measurement bias and operator dependence. This work presents an AI-enabled digital measurement workflow for automated flame diameter from combustion images. The workflow integrates automatic prompt-point generation into Segment Anything Model 2, employing Random Sample Consensus (RANSAC)-based circle fitting. The automatic prompt strategy removes subjective manual point selection, while the video memory mechanism maintains temporal consistency for drifting droplets, and the RANSAC fitting rejects soot-tail pixels as geometric outliers. The method is validated by 19,537 flame images of n-heptane, n-decane, and n-octane droplets with varying initial diameters. Compared with manual-reference measurements, the proposed workflow achieves a mean relative agreement of 96.9%, a mean absolute percentage error of 3.1%, and substantially outperforms conventional Hough circle detection, which performed worse under the same evaluation conditions. The results also show that the measurement accuracy improves with increasing droplet size. The proposed workflow has a combined standard uncertainty of 8.54% and achieves approximately a 229-fold improvement in efficiency over manual measurement. These results demonstrate that the proposed SAM2-based workflow provides a reproducible, fully automated, and metrologically characterized digital measurement system for extracting flame diameter from challenging combustion images. The approach supports high-throughput combustion diagnostics and illustrates that AI-based segmentation can be integrated into quantitative measurement workflows for digitalized image-based metrology.

[53] PAVXploreRL: Physical-Action-Visual World Model Reinforcement Learning with Action Exploration cs.CVPDF

Han Wang, Zijun Wang, Shuoshuo Xue, Rui Cao, Fenjiao Cheng

TL;DR: 论文提出PAVXploreRL，一个基于预训练潜在世界模型的强化学习框架，旨在优化物理动作视觉世界模型的三个关键目标：物理合理性、动作一致性和视觉保真度。该方法结合分布内专家轨迹和噪声驱动的分布外动作探索，无需配对视频监督，以提升动作泛化能力。

Details

Motivation: 现有基于动作条件的世界模型主要依赖分布内动作-视频对和像素级重建损失，未能显式优化PAV目标，且在专家数据外泛化能力差。论文旨在解决这一问题，构建一个能准确捕捉多样化动作诱导动态且对分布内外数据鲁棒的世界模型。

Result: 实验表明，PAVXploreRL在多个基准测试中持续优于预训练基线模型，平均性能提升5.6%，并生成更高质量的PAV属性。作为策略评估器，它提供了更可靠的性能估计，并减少了如Ctrl-World等仅依赖专家数据的世界模型的过高估计偏差。

Insight: 创新点在于显式通过奖励驱动训练优化PAV目标，并联合利用分布内轨迹和无监督的分布外动作探索来提升泛化。从客观角度看，该方法将强化学习与预训练世界模型结合，为具身AI中的可扩展策略评估提供了一种新范式，减少了对昂贵真实世界交互的依赖。

Abstract: Action-conditioned world models are a key component of embodied AI, serving as scalable policy evaluators that reduce reliance on expensive real-world rollouts. To accurately capture diverse action-induced dynamics, such models should satisfy three key objectives-Physical Plausibility (P), Action Adherence (A), and Visual Fidelity (V), collectively referred to as PAV-while remaining robust to both in-distribution (ID) expert demonstrations and out-of-distribution (OOD) actions. However, existing methods primarily rely on ID action-video pairs and pixel-level reconstruction losses, which do not explicitly optimize PAV objectives and generalize poorly beyond expert data. To address this, we propose PAVXploreRL, a reinforcement learning framework built on a pretrained latent world model that explicitly optimizes PAV objectives through reward-driven training. To improve action generalization, our method jointly leverages ID trajectories and noise-driven OOD action exploration, without paired video supervision. Experiments show that PAVXploreRL consistently outperforms pretrained baselines, achieving a 5.6% average gain across benchmarks and producing higher-quality PAV properties. As a policy evaluator, it also yields more reliable performance estimates and reduces the overestimation bias of prior expert-only world models such as Ctrl-World. Code: https://github.com/Social-AI-Studio/PAVXploreRL

[54] TellTale: Blending Multi-Instance LoRA Text Encoders and a Zero-Shot LLM Judge for Ambivalence/Hesitancy Recognition in Videos cs.CV | cs.AIPDF

Abdel-Karim Al-Tamimi, Ali Rodan

TL;DR: TellTale是一种仅使用文本的方法，用于识别访谈视频中的矛盾/犹豫情绪。该方法结合了两个经过多实例学习LoRA微调的文本编码器和一个零样本LLM法官的预测概率，在BAH数据集上取得了远超官方视觉基线的性能。

Details

Motivation: 解决在访谈视频中识别矛盾/犹豫情绪的任务，尽管数据集提供了多模态信息，但作者探索仅依赖文本转录的轻量级方法的有效性。

Result: 在BAH数据集（ECCV 2026 ABAW Workshop挑战赛）的152个未见参与者视频的私有测试集上，Macro-F1达到0.7364，平均精度0.7940，显著优于官方视觉基线的0.2827 Macro-F1。

Insight: 创新点在于将多实例学习与参数高效的LoRA微调结合用于文本编码器，并创新性地融合了零样本LLM法官的预测，证明了纯文本方法在该任务上的强大潜力，且无需视频级标注。

Abstract: We present TellTale, a text-only approach to ambivalence/hesitancy (A/H) recognition in interview videos, evaluated on the BAH dataset as part of the 3rd A/H Video Recognition Challenge (11th ABAW Workshop, ECCV 2026). Although the dataset provides video, audio, facial crops, and transcripts, TellTale relies on the transcript alone and combines three probability streams. Two text encoders, multilingual-e5-large and mDeBERTa-v3-base, are fine-tuned with parameter-efficient LoRA adapters under a multiple-instance learning (MIL) objective, in which transcript chunks are scored individually and pooled with a smooth maximum so that only the video-level label is needed for supervision. The third stream requires no training: a quantized 14B instruction LLM is prompted, zero-shot, to rate each transcript for A/H. The three probabilities are combined by a weighted average and a single decision threshold, both selected on participant-grouped cross-validated predictions. On the organizer-scored private test set of 152 videos from unseen participants, TellTale achieves a Macro-F1 of 0.7364 and an average precision of 0.7940, compared with 0.2827 Macro-F1 for the official vision-based baseline.

[55] Can Multimodal Large Language Models Understand OCT? cs.CV | cs.CLPDF

Baochen Fu, Wenzhi Deng, Baihao Jin, Yang Li, Zihan Nie

TL;DR: 本文介绍了OCT-Bench，一个专门用于评估多模态大语言模型（MLLMs）理解光学相干断层扫描（OCT）图像能力的综合基准。该基准包含来自七个公共数据集的4,137张OCT图像构建的10,076个高质量选择题，并遵循真实临床工作流程，将能力划分为感知、认知和推理三个维度下的20个细粒度任务。作者系统评估了20个代表性MLLM，发现现有模型远未达到可靠的OCT理解水平，且医学领域适应或增大模型规模并不能一致提升性能。

Details

Motivation: 现有基准将OCT理解简化为粗粒度疾病分类或孤立的视觉问答，未能充分评估从视觉感知到临床推理的完整认知过程。因此，需要建立一个更全面的基准来填补这一空白。

Result: 在OCT-Bench上对20个代表性MLLM（包括专有模型、开源通用模型和医学领域模型）的系统评估表明，当前模型在可靠的OCT理解方面仍有很大差距。医学领域适应或增大模型规模并不能在所有能力层级上一致提升性能。

Insight: 创新点在于提出了一个遵循真实临床工作流程、具有层次化能力分类（感知、认知、推理）的细粒度OCT理解基准（OCT-Bench），超越了简单的分类或问答。客观来看，该基准为系统识别MLLM在医学图像理解中的能力瓶颈提供了基础，并强调了需要超越领域适应和规模扩展的更根本性改进。

Abstract: Optical coherence tomography (OCT) imaging is essential for the diagnosis and treatment of retinal diseases. Although multimodal large language models (MLLMs) have demonstrated considerable potential in medical image analysis, existing benchmarks largely reduce OCT understanding to coarse-grained disease classification or isolated visual question answering, leaving the complete cognitive process from visual perception to clinical reasoning insufficiently evaluated. To address this limitation, we introduce OCT-Bench, a comprehensive benchmark dedicated to OCT image understanding. OCT-Bench comprises 10,076 high-quality multiple-choice questions constructed from 4,137 OCT images across seven public datasets. Following the real-world clinical interpretation workflow, we establish a hierarchical capability taxonomy consisting of 20 fine-grained tasks across three dimensions: Perception, Cognition, and Reasoning. These tasks cover a broad range of capabilities, including imaging attributes, retinal anatomy, lesion characteristics, spatial relationships, disease assessment, therapeutic decision-making, and prognostic management. We systematically evaluate 20 representative MLLMs, including proprietary models, open-source general-purpose models, and medical-domain models. Experimental results demonstrate that current models remain substantially short of reliable OCT understanding. Moreover, neither medical-domain adaptation nor increased model scale consistently improves performance across capability levels. OCT-Bench enables comprehensive and fine-grained evaluation of MLLMs, providing a foundation for identifying capability bottlenecks and advancing clinically grounded OCT understanding.

[56] Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editing cs.CV | cs.CL | cs.CRPDF

Weiwei Tan, Junxian Li, Rui Wang, Zhenhua Xu, Yanjun Zhang

TL;DR: 本文提出了一种名为CCS的统一对抗保护框架，旨在防止统一多模态模型（UMMs）对肖像图像进行未经授权的身份保留编辑。通过联合扰动ViT理解分支和VAE生成分支的特征表示，并显式破坏它们之间的跨分支兼容性，该方法能有效阻止UMM在编辑过程中恢复可靠的身份信息。

Details

Motivation: 统一多模态模型（UMMs）强大的基于指令的图像编辑能力引发了对其可能被用于未经授权肖像操纵的担忧。现有的对抗保护方法主要针对单一视觉理解或图像生成模型设计，在迁移到通过多个互补视觉通路处理图像的UMMs时往往失效。

Result: 大量实验表明，在抑制身份保留编辑方面，CCS方法在多个基准测试中始终优于现有的保护方法，实现了更优的保护效果。

Insight: 核心创新在于揭示了单分支特征扰动不足以持续破坏统一图像编辑，并据此提出了同时扰动双分支特征并显式破坏其跨分支兼容性（通过线性CKA）的联合对抗保护框架。这为保护多模态模型中的敏感信息提供了新思路，即需要针对其多通路融合的特性进行协同攻击。

Abstract: Unified multimodal models (UMMs) have recently demonstrated powerful instruction-based image editing capabilities, but they also raise serious concerns about unauthorized manipulation of personal portraits. Existing adversarial protection methods are mainly designed for either visual understanding or image generation models and often become ineffective when transferred to UMMs, which process an image through multiple complementary visual pathways. In this work, we first conduct a feature-level analysis of unified image editing. We observe that the ViT-based understanding branch and the VAE-based generation branch exhibit non-trivial structural agreement for the same input image. Although perturbing an individual branch can reduce this agreement and induce intermediate hidden-state deviations, such effects are asymmetric and gradually attenuated during multimodal fusion and generation. These observations reveal that single-branch feature distortion is insufficient for consistently disrupting unified image editing. Motivated by this finding, we propose CCS, a unified adversarial protection framework that jointly drives the ViT and VAE representations away from their clean counterparts while explicitly disrupting their cross-branch compatibility through linear CKA. By simultaneously removing stable information from both visual pathways and creating incompatible visual contexts, CCS prevents the UMM from recovering reliable identity information during editing. Extensive experiments demonstrate that CCS consistently outperforms existing protection methods in suppressing identity-preserving edits.

[57] OFD-Net: Teacher-Free Reliable Semi-supervised Medical Image Segmentation with Orthogonal Feature Disentanglement Net of Foreground-Background cs.CV | cs.AIPDF

Shao-feng Jiang, Zhe-yang Jing, Qin Lu, Huan-huan Shi, Zhen Chen

TL;DR: 本文提出OFD-Net，一种无需教师网络的可靠半监督医学图像分割框架。该方法通过正交特征解耦模块将未标注数据解耦为前景和背景表示，以获取可靠的结构分布，从而减少误差累积和缓解确认偏差。进一步结合解耦引导模块和可靠性感知伪标签学习机制，提升分割的可靠性。

Details

Motivation: 现有半监督学习方法主要依赖师生监督或跨网络一致性生成伪标签，但缺乏判断伪标签质量的明确结构参考，低质量伪标签在处理外观变化大的未标注数据时可能导致不可靠训练、误差累积和确认偏差。

Result: 在ISIC-2016、Kvasir-SEG、Synapse和ACDC四个公开医学图像分割基准上的大量实验验证了OFD-Net的有效性，结果表明正交前景-背景解耦使其在无教师单网络框架内建立了高效可靠的训练范式。

Insight: 创新点在于引入正交特征解耦模块来显式获取可靠的结构分布作为参考，并结合解耦引导模块和可靠性感知伪标签机制，在单网络框架内实现更可靠的半监督学习，避免了传统师生框架的复杂性。

Abstract: Semi-supervised learning (SSL) is an effective solution for medical image segmentation with limited annotations. Existing SSL methods mainly rely on pseudo-labels generated by teacher-student supervision or cross-network consistency. However, these methods lack an explicit structural reference for judging pseudo-label quality. Low-quality pseudo-labels may lead to unreliable training, error accumulation and confirmation bias when processing unlabeled data with substantial appearance variations. To address this issue, we proposed OFD-Net, a teacher-free single-network framework for reliable semi-supervised medical image segmentation. OFD-Net employs an Orthogonal Feature Disentanglement Module (OFDM) to capture OFD features for reliable SSL by disentangling unlabeled data into background and foreground representations with a reliable structural distribution, thereby effectively reducing error accumulation and alleviating confirmation bias among unlabeled data. Specifically, OFD-Net explicitly employs a Disentanglement Guidance Module (DGM) to inject the resulting structural priors of foreground-background into the decoder by deformable convolution processing, and outputs predictions with clearer foreground representations. Based on DGM and the OFDM, we further develop a reliability-aware pseudo-label learning mechanism that evaluates unlabeled supervision according to the structural consistency between the main prediction and the disentangled foreground-background responses, and then down-weights unreliable regions during training. Extensive experiments on four public medical image segmentation benchmarks, namely ISIC-2016, Kvasir-SEG, Synapse, and ACDC, validate the effectiveness of OFD-Net. These results confirm that orthogonal foreground-background disentanglement enables OFD-Net to establish an efficient and reliable training paradigm within a teacher-free single-network framework.

[58] Can Experts Adapt Without Training? On Test-Time Modality Generalization in MVLMs cs.CVPDF

Raza Imam, Darakshan Rashid, Yutong Xie, Dwarikanath Mahapatra, Brejesh Lall

TL;DR: 本文针对医学视觉语言模型（MVLMs）在未见模态和领域下可靠性下降的问题，提出了一种无需优化的测试时模态泛化框架MoBE。该框架基于混合专家（MoE）视角，通过熵引导的动态路由和专家级贝叶斯适应，在推理时动态选择并调整专家，无需梯度更新即可提升模型对已见、未见及异构医学数据的泛化能力。

Details

Motivation: 医学视觉语言模型在零样本泛化方面潜力巨大，但在面对未见模态和领域时可靠性显著下降，而这正是临床鲁棒性最关键之处。本文旨在解决测试时模态泛化问题，探索专家能否在推理过程中无需优化即可进行路由和适应。

Result: MoBE在已见、未见和异构医学基准测试上，相比最先进的测试时适应（TTA）方法，平均准确率分别提升了4.72、7.17和4.3个百分点，实现了显著的性能增益。

Insight: 创新点在于揭示了测试时存在的专业化与泛化困境，并提出了一个完全无需优化的框架MoBE，它结合了熵引导的动态路由和专家级贝叶斯适应，使静态MVLM能够通过测试时路由和在线统计进行增强，为鲁棒的模态泛化提供了有效的训练免费适应策略。

Abstract: Medical vision-language models (MVLMs) promise broad zero-shot generalization, yet their reliability collapses when confronted with unseen modalities and domains, precisely where clinical robustness matters most. To address this gap, we revisit test-time modality generalization from the perspective of Mixture-of-Experts (MoE) and ask: can experts route-and-adapt without any optimization during inference? We identify a fundamental specialization-generalization dilemma at test time, where blindly aggregating modality experts dilutes modality-specific knowledge, while selecting one highly confident expert risks mismatch under shift. To address this, we propose MoBE: a fully optimization-free framework that performs dynamic expert selection and adaptation at test time. MoBE combines entropy-guided dynamic routing in MoE settings with expert-wise Bayesian adaptation, enabling experts to update their confidence and adapt online without gradient updates. Without parametric updates, MoBE augments a static MVLM with test-time routing and online statistics, achieving average accuracy gains of +4.72, +7.17, and +4.3 over state-of-the-art TTA methods across seen, unseen, and heterogeneous medical benchmarks, highlighting the effectiveness of training-free expert adaptation for robust modality generalization.

[59] VisionAssist: An Open-Source Smartphone Assistant for AI-Based Visual Accessibility cs.CVPDF

Ayşe Özlem Çalışkan, Jordi Sanchez-Riera

TL;DR: VisionAssist是一款开源的智能手机助手应用，旨在通过AI技术为低视力人群提供视觉辅助。该应用集成了三大核心功能：通过实时摄像头分析定位特定物体、生成图像的口头描述以识别内容（如食品标签、文档和日常物品），以及与手机通讯录和日历集成以支持紧急呼叫和语音提醒。应用支持免提语音交互和文本转语音反馈，将所有辅助服务整合到一个统一平台，并以开源形式发布以促进社区贡献。

Details

Motivation: 解决低视力人群在日常任务中因难以解读视觉信息而面临的挑战，旨在通过AI驱动的移动应用提升他们的独立生活能力。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试，但描述了应用的功能实现和开源发布，强调其作为统一平台的实用性和可访问性。

Insight: 创新点在于将物体定位、图像描述生成和紧急通信/提醒三大互补功能集成到单一移动界面中，并通过开源模式鼓励社区协作，加速无障碍技术的发展；从客观角度看，这种多模态AI辅助与日常工具（如通讯录、日历）的深度整合，为视觉无障碍应用提供了可扩展的范例。

Abstract: People with low vision often face challenges in performing everyday tasks that require interpreting visual information. We present \textbf{VisionAssist}, an open-source mobile application designed to improve independence by providing AI-powered visual assistance through a smartphone. The application integrates three complementary functionalities within a single interface. First, it enables users to locate specific objects by analyzing the live camera feed. Second, it generates spoken descriptions of captured images, allowing users to identify visual content such as food labels, documents, and everyday objects. Third, it integrates with the smartphone’s contacts and calendar to facilitate emergency calls and provide voice-based reminders. The application supports hands-free interaction through voice commands and delivers all feedback using text-to-speech synthesis, making it fully accessible to users with visual impairments. By combining multiple assistive services into a unified platform and releasing the project as open-source software, the proposed solution aims to encourage community contributions and accelerate the development of accessible technologies. The source code is publicly available at: https://github.com/AOzlemC/LowVisionProject.git

[60] Spatiotemporal Facial Action Unit Detection using Twin Cycle Autoencoders for Driver Monitoring cs.CV | cs.AIPDF

Sai Sidharth D

TL;DR: 本文提出了一种名为Twin Cycle Autoencoder (TCA)的时空架构，用于驾驶员监控中的面部动作单元（AU）检测。该模型通过耦合的空间循环自编码器和时间循环自编码器，分别解耦AU相关外观与身份信息，并捕捉AU激活的时序动态，从而在低光照、遮挡等挑战性驾驶场景中实现鲁棒检测。

Details

Motivation: 现有AU检测器通常将空间外观与时间动态分开处理，难以充分利用大量未标记驾驶视频中的自监督信号，且驾驶场景中存在光照变化、遮挡、头部姿态变化以及AU激活短暂微妙等挑战。

Result: 在DISFA、BP4D基准测试和一个真实驾驶数据集上，TCA模型在AU检测性能上持续优于CNN-RNN、3D-CNN和图神经网络基线，尤其在与疲劳（AU45、AU43）和打哈欠（AU26）相关的低强度、快速转换的AU上表现突出，并能在嵌入式Jetson Xavier NX平台上实现实时处理。

Insight: 创新点在于提出了耦合的双循环自编码器架构，通过图像级循环一致性解耦身份与AU特征，并通过前后向一致性约束捕捉AU的时序动态；同时，跨分支潜在对齐损失和注意力融合机制有效整合了时空信息，为在复杂真实场景中实现鲁棒、可解释的面部行为分析提供了新思路。

Abstract: Driver monitoring systems (DMS) increasingly rely on facial cues to infer drowsiness, distraction, and cognitive load in real time. Facial Action Units (AUs), grounded in the Facial Action Coding System (FACS), provide an objective and interpretable representation of such states, but their automatic detection in the driving context is complicated by low and variable illumination, partial occlusion, head-pose variation, and the subtlety and short duration of relevant AU activations. Existing AU detectors largely treat spatial appearance and temporal dynamics separately, limiting their ability to exploit self-supervisory signal from abundant unlabeled driving video. We propose the Twin Cycle Autoencoder (TCA), a spatiotemporal architecture composed of two coupled cycle-consistent autoencoder branches: a Spatial Cycle Autoencoder that disentangles AU-relevant appearance from identity through image-level cycle consistency, and a Temporal Cycle Autoencoder that enforces forward-backward consistency over latent AU trajectories to capture onset-apex-offset dynamics. The two branches are coupled through a cross-branch latent alignment loss and fused via an attention module before multi-label AU classification. We evaluate TCA on the DISFA and BP4D benchmarks and on an in-cabin naturalistic driving dataset, and observe consistent improvements over CNN-RNN, 3D-CNN, and graph-based AU baselines, particularly for low-intensity and rapidly transitioning AUs relevant to fatigue (AU45, AU43) and yawning (AU26). We further show the model sustains real-time throughput on an embedded Jetson Xavier NX platform, supporting its use in production-grade advanced driver assistance systems (ADAS).

[61] HTT-Net: Hierarchical Text-guided Transition Modeling for Surgical Video Phase Recognition cs.CVPDF

Kunjie Deng, Jinghui Zhang, Weidong Chen, Ganbin Li, Xiangjun Lyu

TL;DR: 本文提出HTT-Net，一种用于手术视频阶段识别的分层文本引导过渡建模网络。该方法通过构建包含阶段内描述、阶段间过渡描述和细粒度语义单元的分层手术语义记忆，引入结构化语义知识来指导阶段感知片段的构建与校准，以解决局部视觉模糊、瞬时预测噪声和程序语义利用不足的挑战。

Details

Motivation: 手术视频阶段识别是计算机辅助干预的基础任务，但现有视觉-时序模型因局部视觉模糊、瞬时预测噪声以及对程序语义利用不足，难以实现准确且时序连贯的阶段识别。

Result: 在Cholec80和LCRS-100数据集上的实验证明了HTT-Net在鲁棒的手术视频阶段识别方面的有效性。

Insight: 创新点在于构建了分层手术语义记忆，并基于此设计了过渡感知片段构建（TAS-Con）与校准（TAS-Calib）模块，将结构化文本语义知识引入视觉时序建模，以增强对视觉模糊片段的判别力，避免了密集的帧级视觉-语言融合。

Abstract: Surgical video phase recognition is a fundamental task in computer-assisted intervention, supporting workflow understanding, intraoperative guidance, and surgical quality assessment. Although recent visual-temporal models have achieved promising progress, accurate and temporally coherent phase recognition remains challenging due to local visual ambiguity, transient prediction noise, and insufficient use of procedural semantics. To address these challenges, we propose HTT-Net, a Hierarchical Text-guided Transition modeling Network for surgical video phase recognition. The key idea is to introduce structured surgical semantic knowledge into phase-aware segment construction and semantic refinement. Specifically, we construct a hierarchical surgical semantic memory with intra-phase descriptions, inter-phase transition descriptions, and fine-grained semantic units. Based on this memory, the proposed Transition-Aware Segment Construction (TAS-Con) organizes frame-level evidence into coherent segment representations and handles boundary clips with inter-phase transition descriptions. Furthermore, we introduce Transition-Aware Segment Calibration (TAS-Calib), which calibrates phase-aware segment representations through hierarchical surgical semantics and improves discrimination under visual ambiguity without dense frame-level vision-language fusion. Experiments on Cholec80 and LCRS-100 demonstrate the effectiveness of HTT-Net for robust surgical video phase recognition.

[62] Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Model cs.CVPDF

Sijing Wu, Yunhao Li, Huiyu Duan, Yucheng Zhu, Xiongkuo Min

TL;DR: 本文提出了HVEval+数据集和MoE-Rater模型，用于AI生成的人为中心视频的多维度质量评估。HVEval+是目前最大的此类视频整体质量评估数据集，包含基于综合分类法的1k个提示词、24个T2V模型生成的20k个视频，以及涵盖空间质量、时间质量和文本-视频对应性三个维度的广泛人工标注（60k MOS评分和60k偏好对）和20k类别特定问答对。MoE-Rater是一个基于混合专家（MoE）和多模态大语言模型（MLLM）的一体化方法，支持单模型内进行多维度质量评分、多维度成对比较和类别特定问答，通过引入MoPE和MoLE模块以及三阶段训练策略实现多任务统一，在HVEval+和Human-AGVQA数据集上表现出优越性能。

Details

Motivation: AI生成的人为中心视频在现代应用中至关重要，但常存在质量问题和语义不匹配，因此需要有效的质量评估方法。现有评估资源不足，需构建大规模、多维度标注的数据集和统一的多任务评估模型。

Result: 在HVEval+和Human-AGVQA数据集上的大量实验表明，MoE-Rater方法取得了优越性能，展示了其在推进AI生成视频质量评估方面的显著潜力。

Insight: 创新点包括：1) 构建了大规模、多维度（空间、时间、文本-视频对应性）标注的HVEval+数据集；2) 提出了基于MoE和MLLM的一体化评估模型MoE-Rater，支持评分、比较和问答多任务；3) 设计了MoPE和MoLE模块以及三阶段训练策略，有效统一多任务并提升性能。从客观角度看，该工作为T2V模型评估提供了标准化基准和高效工具，其任务统一框架和自适应路由优化策略具有借鉴意义。

Abstract: AI-generated human-centric videos play a crucial role in a wide range of modern applications. However, they often suffer from quality issues and semantic mismatches, underscoring the importance of effective quality assessment for such videos. To this end, we extend our previous dataset HVEval with pairwise preference annotations, resulting in HVEval+, the largest holistic quality assessment dataset for AI-generated human-centric videos, which comprises 1k prompts based on a comprehensive taxonomy, 20k videos generated by 24 text-to-video (T2V) models, and extensive human annotations, including 60k mean opinion scores (MOSs) and 60k preference pairs across 3 dimensions (i.e., spatial quality, temporal quality, and text-video correspondence), as well as 20k category-specific question-answer (Q&A) pairs. Along with the HVEval+ dataset, we further propose MoE-Rater, a Mixture-of-Experts (MoE)-inspired and multimodal large language model (MLLM)-based all-in-one method that supports multi-dimensional quality rating, multi-dimensional pairwise comparison, and category-specific question answering within a single model. Specifically, we introduce Mixture of Projector Experts (MoPE) and Mixture of LoRA Experts (MoLE), together with a three-stage training strategy consisting of task-aware pre-training, task-specific adaptation, and adaptive routing optimization, to effectively unify multiple tasks, resulting in superior performance on both HVEval+ and Human-AGVQA datasets. Extensive experiments and comprehensive analysis demonstrate the significant potential of the HVEval+ dataset and the MoE-Rater method in advancing AI-generated video quality assessment and further facilitating the evaluation and optimization of T2V models.

[63] Test-Time Registers as Global Priors for Tokenized Image Generation cs.CVPDF

Cheng-Yao Hong, Yifan Wang, Yuewei Lin, Chenyu You

TL;DR: 本文研究了视觉Transformer中的寄存器（registers）现象，提出了一种无需训练的RegToken方法，将寄存器结构转化为全局先验令牌，以提升令牌化图像生成的性能。

Details

Motivation: 现有研究主要通过可解释性分析和线性探针对寄存器进行诊断，但未探索其能否作为即插即用的生成信号。本文旨在验证寄存器是否可作为轻量级全局先验，用于令牌化图像生成。

Result: 在ImageNet上，RegToken将FID-5k从20.5提升至20.1，SigLIP从3.6提升至3.9，并加速了测试时优化（Steps@τ从74降至52），无需修改预训练权重。

Insight: 创新点在于将通常被视为注意力伪影的寄存器结构重新用作生成先验，通过NFN层定位、TokenRank子空间提取和投影-守恒更新，实现了训练自由的性能提升。

Abstract: Attention-based models often develop attention sinks, where a small number of tokens repeatedly attract attention and accumulate unusually large activations. In vision transformers, these outliers are closely related to registers, which have been diagnostically linked to global, low-frequency image structure. Existing work has largely studied registers through interpretability analyses and linear probes, leaving open whether they can be operationalized as plug-and-play signals for generation without retraining. We revisit this question in tokenized image generation. Using OpenCLIP and DINOv2 on ImageNet, we find that test-time register features exhibit stronger low-frequency concentration than both [CLS] readouts and patch-mean features, and show a consistent (albeit moderate) correlation with pixel-space DCT low-frequency energy. Motivated by these diagnostics, we introduce RegToken, a training-free procedure that converts register structure into a small set of global prior tokens by (i) NFN-based layer localization, (ii) TokenRank-guided subspace extraction, and (iii) a projection-and-conservation update on the register subspace. Inserted into a frozen compact 1D token generation pipeline, RegToken improves ImageNet generation and alignment metrics (e.g., FID-5k 20.5 to 20.1, SigLIP 3.6 to 3.9) without modifying pretrained weights, and accelerates test-time optimization (Steps@$τ$ 74 to 52). Overall, our results suggest that structures often viewed as attention artifacts can be repurposed as lightweight global priors for tokenized generation.

[64] UniNDM: A Unified Noise-driven Detection and Mitigation Framework Against Sexual Content in Text-to-Image Generation cs.CVPDF

Yao Huang, Yitong Sun, Huanran Chen, Ruochen Zhang, Shouwei Ruan

TL;DR: 本文提出UniNDM，一个统一的噪声驱动框架，用于检测和缓解文本到图像生成中的隐性色情内容。该框架通过分析扩散过程中的噪声动态，利用早期预测噪声的可分离性进行轻量级检测，并采用噪声增强的自适应负向引导进行缓解，同时支持U-Net和扩散Transformer架构。

Details

Motivation: 现有文本到图像扩散模型容易受到隐性色情提示的攻击，这些提示伪装成良性术语或对抗性令牌，由于模型偏见或训练数据中的潜在关联而生成不当内容。现有的安全机制存在根本性限制：检测方法主要识别显性内容而无法捕捉隐性恶意意图，缓解方法则依赖静态负向提示，难以应对多样化的隐性场景。

Result: 在U-Net模型和DiT模型上，对自然和对抗性数据集进行的综合实验表明，该方法相比现有最先进方法（如SLD、UCE、Safree等）有显著提升。

Insight: 核心创新在于从扩散过程的噪声动态视角重新思考安全机制，理论证明了早期噪声在正常与色情内容间的固有可分离性及其语义集中度随时间步的二次增长。据此设计了轻量级噪声检测器和噪声增强的自适应负向引导缓解策略，并针对扩散Transformer架构定制了区域约束语义引导以实现扩展。

Abstract: Despite the impressive generative capabilities of text-to-image diffusion models, they remain vulnerable to implicit sexual prompts, where subtle cues disguised as benign terms or adversarial tokens unexpectedly generate the inappropriate content due to model biases or latent correlations in training data. Existing safety mechanisms face fundamental limitations: detection methods primarily identify explicit content and fail to capture implicit malicious intent, while mitigation approaches rely on static negative prompts inadequate for diverse implicit scenarios. To address these challenges, we propose UniNDM, a unified noise-driven framework that rethinks safety mechanisms through the lens of noise dynamics in diffusion processes. Our key insight is that early-stage predicted noise exhibits inherent separability between normal and sexually explicit content, which we theoretically demonstrates quadratically increasing semantic concentration with timestep. Leveraging this property, we develop a lightweight noise-based detector achieving superior accuracy with virtually no computational overhead. For mitigation, we introduce noise-enhanced adaptive negative guidance: dynamically generating context-specific negative prompts via large language models to handle diverse implicit content, while optimizing initial noise by suppressing attention concentration on explicit tokens to provide comprehensive protection. Besides the U-Net-based diffusion models, we further extend our framework to emerging Diffusion Transformer architectures through region-constrained semantic guidance tailored for their unified multimodal attention. Comprehensive experiments across U-Net models and DiT models on both natural and adversarial datasets demonstrate substantial improvements over state-of-the-art methods, including SLD, UCE, Safree, etc. Our code is publicly available at https://github.com/Aries-iai/UniNDM.

[65] TopoGS: Planar Reconstruction via Topology-aware 3D Gaussian Splatting cs.CV | cs.GRPDF

Shanshan Pan, Jiale Chen, Yilin Liu, Hui Huang

TL;DR: TopoGS是首个将平面与拓扑约束显式结合的3D高斯溅射框架，通过从多视角图像分割中提取全局二维拓扑关系，并将高斯基元锚定到这些结构元素上，联合优化平面参数、渲染保真度和拓扑邻接性，从而生成连贯、结构化且拓扑正确的三维场景重建。

Details

Motivation: 现有基于3D高斯溅射（3DGS）的方法在引入平面基元时通常将其视为孤立离散集合，缺乏拓扑连通性，导致重建结果碎片化、边界错位，难以满足精确空间分析和专业设计流程的需求。

Result: 在ScanNet++数据集上的大量评估表明，TopoGS达到了最先进的性能，能够生成准确、拓扑合理且视觉保真的场景表示。

Insight: 创新点在于首次在3DGS框架中显式整合了平面与拓扑约束，通过多视角一致的拓扑约束显著缓解了几何错位问题，实现了连接且结构化的三维模型重建。

Abstract: Extracting structured, parametric 3D representations from raw images remains a fundamental challenge in computer vision and graphics. While recent advancements in the 3D Gaussian Splatting (3DGS) pipeline integrate planar primitives to yield compact and editable geometry, these approaches typically treat planes as isolated, discrete sets. This lack of topological connectivity hinders robust geometric reasoning, leading to fragmented reconstructions and misaligned boundaries that fall short of the precision for rigorous spatial analysis and professional design workflows. To address this, we introduce TopoGS, the first 3DGS framework to explicitly integrate both planar and topological constraints for coherent 3D reconstruction. Specifically, we extract global 2D topological relationships from multi-view image segmentations and anchor Gaussian primitives to these structural elements. This formulation enables the joint optimization of plane parameters, rendering fidelity, and topological adjacency. By enforcing strict multi-view consistency alongside these topological constraints, our method significantly mitigates geometric misalignments and produces connected, structured 3D models. Extensive evaluations on the ScanNet++ dataset demonstrate that TopoGS achieves state-of-the-art performance, providing a highly robust solution for generating accurate, topologically sound, and visually faithful scene representations.

[66] Look Clearly Before Answering: Mitigating Hallucinations in LVLMs via Saliency-Driven Perceptual Realignment cs.CV | cs.MMPDF

Pengxu Chen, Yao Zhu, Guangming Zhu, Jun Sheng, Jincai Huang

TL;DR: 本文提出了一种名为SDPR的训练免费框架，旨在缓解大型视觉语言模型中的幻觉问题。该方法通过显著性驱动的注意力重分配、KV缓存对齐以及先验约束的对比解码，在推理过程中对齐视觉感知，从而减少与视觉证据不一致的生成。

Details

Motivation: 现有方法主要解决语言先验偏差或跨模态不平衡问题，而视觉感知和记忆过程中的渐进性退化尚未得到充分探索，因此需要一种在推理过程中保持视觉感知一致性的方法。

Result: 在多种LVLM架构上的广泛实验表明，SDPR在幻觉和通用基准测试上均优于现有最先进方法，且无需额外训练，运行时开销最小。

Insight: 创新点在于通过显著性机制在推理过程中动态调整注意力分布和KV缓存，以保持视觉特征的完整性，并结合对比解码来惩罚不忠实的预测，实现了对生成轨迹中视觉感知的整体对齐。

Abstract: Large vision-language models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding. However, they remain prone to hallucinations, generating responses that are inconsistent with the visual evidence. Existing mitigation methods largely address language-prior bias or cross-modal imbalance, while progressive visual degradation across perception and memory remains underexplored. In this work, we propose Saliency-Driven Perceptual Realignment (SDPR), a training-free framework that mitigates the degradation of visual awareness throughout inference. Specifically, we first introduce saliency-driven attention redistribution to release attention hijacked by non-semantic sink tokens, thereby recovering critical visual evidence. Second, we identify spatial distortion in the KV cache and propose saliency-driven cache alignment to preserve query-relevant visual features during generation. Finally, we introduce prior-constrained contrastive decoding to penalize unfaithful predictions induced by dominant language priors. Our proposed SDPR is robust against hallucinations due to its holistic alignment of visual awareness across the entire generative trajectory. Extensive experiments across diverse LVLM architectures show that SDPR outperforms state-of-the-art methods on both hallucination and general-purpose benchmarks, requiring no additional training and incurring minimal runtime overhead. The code is available \href{https://github.com/PengSyuChen/SDPR}{\color{blue}{here}}.

[67] Dataset Distillation by Influence Matching cs.CVPDF

Haoru Tan, Wang Wang, Sitong Wu, Xiuzhe Wu, Yangtian Sun

TL;DR: 本文提出了一种名为Influence Matching（Inf-Match）的数据集蒸馏新方法。该方法从结果中心视角出发，通过匹配合成数据集与完整数据集对最终训练参数的影响来学习一个紧凑的合成集，而不是对齐训练过程中的梯度或轨迹。该方法在标准分类基准（如Tiny-ImageNet）和视觉-语言任务（如Flickr30K）上均取得了最佳性能。

Details

Motivation: 动机是重新审视数据集蒸馏问题，旨在解决现有方法侧重于对齐训练过程（如每步梯度或训练轨迹）的启发式模仿，而非最终训练结果的问题。目标是学习一个合成数据集，使其对收敛参数的影响与完整数据集相匹配。

Result: 在Tiny-ImageNet数据集上（IPC=10），Inf-Match达到了31.5%的准确率，比NCFM方法提升了4.7%。在Flickr30K的视觉-语言蒸馏任务中，使用200到1000个合成样本，该方法在图像/文本检索任务上取得了领先的平均性能，比NCFM高出2.5%。这些结果表明Inf-Match在多个基准上达到了SOTA水平。

Insight: 宣称的创新点在于从结果中心视角出发，通过匹配最终训练结果的影响来蒸馏数据集，并引入了一个完全可微、样本级别的高效影响估计器。客观来看，其核心创新在于将优化目标从过程模仿转向结果对齐，并设计了一个无需计算逆Hessian矩阵、具有线性时间复杂度的实用影响估计方法，这为数据集蒸馏提供了新的范式。

Abstract: We revisit dataset distillation from an outcome-centric perspective. Rather than aligning process surrogates (per-step gradients or training trajectories), Influence Matching (Inf-Match) aligns the final outcome of training: it learns a compact synthetic set whose effect on the converged parameters matches that of the full dataset. Concretely, we introduce a fully differentiable, sample-level influence estimator that quantifies parameter shifts from adding or removing data, without time-consuming inverse-Hessian products or convexity assumptions. The estimator runs in linear time by unrolling the optimization dynamics and applying a first-order Taylor approximation. We then learn the synthetic set by minimizing the mismatch between its influence and that of the real dataset, yielding outcome alignment rather than heuristic process imitation. Inf-Match delivers the best accuracy across standard classification benchmarks. For instance, on Tiny-ImageNet (IPC=10), Inf-Match attains 31.5%, a +4.7% improvement over NCFM. Beyond classification, Inf-Match scales to vision-language distillation on Flickr30K, outperforming strong process-matching baselines. For instance, with 200 to 1000 synthetic samples, our method achieved a leading impressive average on image/text retrieval tasks, higher than NCFM by 2.5%. The code will be released via https://github.com/hrtan/infmatch.

[68] Thinking in Video: Can Video Generators Really Reason About the Real World? cs.CV | cs.AI | cs.CLPDF

Yongheng Zhang, Guang Yang, Ruihan Hou, Qiguang Chen, Ziang Liu

TL;DR: 本文提出了一种名为’Thinking in Video’的推理范式，即利用视频生成模型来模拟、预测和推理现实世界动态。为了评估视频生成器是否真正支持这种因果推理，作者引入了因果-生成双重评判框架，从显式因果感知和隐式生成感知-预测差距两个角度进行审计。研究发现，开源模型和闭源模型在因果理解与视频生成的一致性上均存在显著差距，挑战了当前’世界模拟器’的叙事。

Details

Motivation: 当前，利用视频生成模型进行世界模拟和推理的范式兴起，但其承诺尚未被验证：生成的视频可能只是记忆了外观而非真正的因果理解，且现有评估指标将感知保真度与语义逻辑分离。本文旨在评估视频生成器是否真的能作为推理媒介来理解和预测现实世界的因果关系。

Result: 应用因果-生成双重评判框架对代表性开源和闭源生成器进行评估，结果揭示了明显的感知-预测差距：开源模型能生成看似合理的动态，但其显式因果感知能力几乎为零；而先进的闭源系统在推理与生成之间表现出更强但仍有限的一致性。进一步分析还暴露了视听不一致的问题。

Insight: 论文的创新点在于提出了一个系统性的评估框架，将因果推理能力与视频生成质量结合起来进行双重审计，揭示了当前模型在作为’世界模拟器’时的根本局限性。从客观角度看，该方法为评估生成模型的’理解’能力提供了新的视角，强调了语义逻辑与生成结果一致性的重要性。

Abstract: Recent advances in world models and video generation have given rise to an emerging reasoning paradigm that leverages video generative models to simulate, predict, and reason about real-world dynamics. We redefine this paradigm as Thinking in Video, where video is not merely an output artifact but a medium for constructing, extending, and verifying causal thought. However, this promise remains unverified: convincing rollouts may reflect memorized appearances rather than causal understanding, while existing metrics separate perceptual fidelity from semantic logic. To evaluate whether video generators support such reasoning, we introduce the Causal-Generative Dual-Judge (CGDJ), auditing World Model Consistency from two perspectives. Explicit Causal Perception tests whether a generator reads a video scenario as a reasoning problem through spatio-temporal flattened visual question answering, while Implicit Generative Perception-Prediction Gap evaluates whether it renders the causal consequence as a consistent future video. Applying CGDJ to representative open- and closed-source generators reveals a clear Perception-Prediction Gap: open-source models produce plausible dynamics despite near-zero explicit causal perception, whereas advanced closed-source systems show stronger but still limited alignment between reasoning and generation. Further analysis exposes audio-visual misalignment, where models verbalize correct causal logic more reliably than they render it, challenging the “world simulator” narrative.

[69] Pedestrian Archetypes Extension – More Pedestrian Models for Autonomous Vehicle Safety Testing cs.CVPDF

Taorui Huang, Namita Gaidhani, Ritvik Bansal, S M Jubaer, Regina Lim

TL;DR: 本文是《行人原型》工作的扩展，在先前提出的12个行人原型基础上，通过对YouTube行车记录仪视频的进一步标注，识别并定义了7个新的行人原型。这些新原型捕捉了原有分类法无法完全解释的行为模式，旨在为自动驾驶安全测试提供更全面、更自然的行人行为模型。

Details

Motivation: 动机是超越单一行为标签，更自然地描述真实交通场景中行人逐步表现出的危险行为模式，以提升自动驾驶系统的安全测试覆盖度。

Result: 研究结果是在原有12个原型的基础上，新增了7个具有可观察且显著行为差异的行人原型，并通过视频帧证据展示了其行为表现。

Insight: 创新点在于通过细粒度行为集合（原型）而非单一标签来建模行人，并持续通过真实视频数据扩展原型库，这为构建更贴近现实、用于安全测试的行人行为模型提供了系统化方法。

Abstract: In our prior work, Pedestrian Archetypes, we defined pedestrian archetypes as collections of behaviors that uniquely identify a specific type of pedestrian. The first paper proposed 12 pedestrian archetypes, including the Wanderer, Drunk, Distracted, Flash, Indecisive, Blind, Flock, Jaywalker, Elderly, Kid, Eventful, and Parked Pedestrian. These archetypes were introduced to move beyond single behavior labels and provide a more natural way to describe how dangerous pedestrians actually behave progressively in real-world traffic scenarios. However, upon further annotation of YouTube dash-cam videos, we identified 7 additional pedestrian archetypes with observable and significant behavioral differences from the previously proposed ones. These new archetypes capture pedestrian behavior patterns that could not be fully explained by the original taxonomy. In this pre-print, we introduce each new archetype, define its essential and optional behaviors, explain how it differs from previously proposed archetypes, and provide video-frame evidence showing the archetype in action.

[70] What Do They See? Interpreting Complex Road Scenarios Through the Eyes of Vision-Language-Action Models for Safe and Trustworthy Autonomous Vehicle Learning cs.CV | cs.AI | cs.LG | cs.ROPDF

Kalpana Panda, Wesley Maia, Vinti Agarwal, Ross Greer

TL;DR: 本文提出了一种名为Counterfactual Vision Action Analysis (CVAA)的反事实消融框架，用于解释端到端自动驾驶模型在复杂道路场景中的决策逻辑。该框架通过生成式图像修复技术系统性地移除前视摄像头图像中的检测对象，创建反事实图像集，以评估模型响应差异，从而量化每个对象对模型规划行为的因果影响。研究基于Alpamayo 1轨迹预测器在nuScenes数据集上的210个驾驶场景，构建了Counter-nuScenes数据集，并进一步结合机制可解释性技术分析模型中间表示，以揭示模型内部特征与人类可理解场景元素之间的差异。

Details

Motivation: 当前端到端自动驾驶模型虽能处理复杂道路场景，但其内部决策逻辑仍不透明，这阻碍了安全关键系统的可信度建立。论文旨在通过可解释性方法，理解模型如何感知和响应场景中的对象，以提升自动驾驶系统的安全性和可信赖性。

Result: 在Counter-nuScenes数据集上的实验表明，模型对位于其路径上的车辆和行人具有预期的显著因果影响，交通灯的影响也远超其图像占比。但同时也发现模型会对人类驾驶员认为无关的对象产生强烈响应。通过机制可解释性技术分析，进一步揭示了模型内部表示与人类可读场景元素的不一致性。

Insight: 创新点在于提出了CVAA反事实消融框架，将行为审计与表示理解相结合，为端到端自动驾驶模型提供了从对象级因果影响到内部特征分析的系统性可解释性路径。这有助于构建可解释的驾驶系统，并强化人机信任。

Abstract: End-to-end autonomous driving models are now able to navigate complex road scenarios, mapping raw sensor observations directly to observed paths for open-loop evaluation and often effective driving in closed-loop evaluation. Yet the internal logic of these safety-critical systems remains largely opaque, due to the complexity of traffic scenes. We propose a counterfactual ablation framework called Counterfactual Vision Action Analysis (CVAA) that systematically removes individual detected objects from front-camera images using photorealistic generative inpainting to prepare counterfactual sets to evaluate the difference in the model’s response. This isolates the causal effect of each object’s presence on the model’s planning behaviour. Applied to the Alpamayo 1 trajectory predictor across 210 nuScenes driving scenes, we create a dataset Counter -nuScenes, using which we see that vehicles and pedestrians within the model’s ‘path’ dominate causal influence as expected, while traffic lights, as expected, exert disproportionate effect relative to their image footprint. However, we also find cases where the model responds strongly to objects a human driver would consider irrelevant. This brings forth a deeper question: does the model itself view the scene as a sum of individual objects influencing the outcome, or does it encode an entirely different set of internal features that do not correspond to human-legible scene elements? To further understand this, we compare intermediate representations of original and inpainted image pairs using mechanistic interpretability techniques and examine the effect of the removal through the various model layers. Together, these two stages offer a path from behavioral auditing to representational understanding, creating explainable driving systems and solidifying human-AI trust.

[71] When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generation cs.CVPDF

Siwei Meng, Yawei Luo, Shu Zhang, Ping Liu

TL;DR: 本文提出物理与语义直接偏好优化（PSDPO）方法，用于解决文本到视频生成中物理合理性与语义一致性之间的冲突。该方法将问题建模为约束偏好优化，通过调节偏好对的贡献来平衡物理和语义信号，无需额外模型或损失项。实验表明PSDPO在VideoPhy-2基准上物理合理性提升高达2倍，同时在VBench上保持强语义一致性。

Details

Motivation: 现有文本到视频生成模型在提升物理合理性时，往往以牺牲输入文本的语义一致性为代价，这是因为物理偏好通常通过比较两个视频的动态性来确定，而未考虑视频是否准确描绘提示词指定的场景，导致物理-语义冲突成为该监督范式下的系统性问题。

Result: 在VideoPhy-2基准上，PSDPO将物理合理性提升至基线的2倍；在VBench上保持了强语义一致性，相比现有基于偏好的方法实现了更可靠的平衡。

Insight: 创新点在于将物理-语义冲突建模为约束偏好优化问题，并通过梯度分析证明PSDPO可将冲突对导致的语义漂移限制为可控残差；方法完全基于标准DPO框架，无需辅助模型或额外损失项，且可进一步采用分阶段优化协议以减少累积漂移。

Abstract: Text-to-video (T2V) generation models have achieved strong visual realism, but improving physical plausibility can come at the cost of semantic consistency with the input text. This tension arises because physical preference is typically determined by comparing dynamics between two videos, without accounting for whether either video faithfully depicts the scene specified by the prompt, making physical-semantic conflict a systematic tendency under this supervision paradigm. We formulate this challenge as a constrained preference optimization problem and propose Physical and Semantic Direct Preference Optimization (PSDPO), which modulates each preference pair’s contribution based on the agreement between its physical and semantic signals. A gradient-level analysis shows that PSDPO bounds the semantic drift from conflicting pairs to a controllable residual, and further motivates a staged optimization protocol that provably reduces cumulative drift. The resulting method operates entirely within the standard DPO framework, requiring no auxiliary models or additional loss terms. Experiments show that PSDPO improves physical plausibility by up to $2\times$ over the baseline on VideoPhy-2, while maintaining strong semantic consistency on VBench, achieving a more reliable balance than existing preference-based methods.

[72] EvoGUI: An Evolution-Aware Benchmark for GUI State-Transition Understanding cs.CV | cs.AIPDF

Yaohan Yang, Minglei Shi, Borui Zhang, Jie Zhou, Jiwen Lu

TL;DR: 本文介绍了EvoGUI，一个用于诊断GUI智能体状态转换理解能力的基准测试框架。该框架将标准化的GUI轨迹转化为三种互补的视觉问答任务：时序排序、逆向动作/值预测和对比性一步后继状态判别。作者基于Mind2Web和WebLINX数据集构建了EvoGUI-Bench，包含120个领域的3000个实例，并对28种视觉语言模型进行了零样本评估。

Details

Motivation: 现有的端到端GUI智能体评估方法将状态转换理解能力与感知、落地、规划和恢复等其他能力耦合在一起，难以进行针对性诊断。本文旨在提供一个可扩展的诊断性基准，以分离并专门评估智能体对动作如何改变界面状态的理解能力。

Result: 在构建的EvoGUI-Bench上对28种视觉语言模型配置进行零样本评估，最强的模型仅达到60.4的EvoGain得分。实验发现，模型规模和GUI领域专门化并不能可靠地预测其在该基准上的性能，表明当前模型在状态转换理解方面仍有巨大提升空间。

Insight: 创新点在于提出了一种无需额外任务标注、直接从轨迹顺序和记录动作中生成诊断标签的框架。该框架通过三种互补的视觉问答探针任务，将复杂的端到端GUI交互分解为可诊断的状态转换理解子问题，为模型能力评估提供了一个新的、可扩展的视角。

Abstract: GUI agents must reason about how actions transform interface states, but end-to-end success rates entangle this ability with perception, grounding, planning, and recovery. We introduce EvoGUI, a diagnostic framework that converts normalized GUI trajectories into three complementary visual question answering probes: temporal ordering, inverse action/value prediction, and contrastive one-step successor discrimination. Their labels are derived from trajectory order and logged actions, requiring no additional task-label annotation after trajectory normalization. We instantiate EvoGUI-Bench from Mind2Web and WebLINX, yielding 3,000 instances across 120 domains, and evaluate 28 vision-language model configurations zero-shot. The strongest model reaches only 60.4 EvoGain, while model scale and GUI specialization do not reliably predict performance. These results establish EvoGUI-Bench as a scalable diagnostic complement to end-to-end GUI-agent evaluation while exposing substantial headroom in state-transition understanding. The source code is publicly available at https://github.com/Yyhhh6/EvoGUI.

[73] ALLUDE: A Unified Evaluation System for Configurable Attacks in Differentiable Environments cs.CV | cs.AIPDF

Mansi Phute, Alexander Greenhalgh, Matthew Hull, Haoran Wang, Alec Helbling

TL;DR: 本文提出了ALLUDE，一个用于评估可配置对抗攻击的统一评估系统，支持在可微渲染环境中进行端到端的攻击评估。该系统提供了丰富的自定义配置选项，涵盖多种场景、物体、天气条件、光照和相机轨迹，并在Linux和Windows平台上实现了首次跨平台评估能力。

Details

Motivation: 现有针对视觉模型（如目标检测器）的对抗攻击评估通常受限于有限条件，导致其性能未被充分表征。缺乏一个易于使用的统一系统来支持跨多个场景、物体、环境和相机轨迹的可定制对抗攻击配置。

Result: 通过拉丁超立方采样从5400种配置中选取代表性子集进行演示，涵盖10个场景-物体对、9种天气条件、4种优化器、5种相机轨迹和3种检测模型。在多样化天气条件和连续相机轨迹下对现有攻击（如CAMOU、RAUCA、FCA）进行压力测试，揭示了所有攻击成功率均下降，暴露了先前工作的评估缺陷。

Insight: ALLUDE通过端到端可微渲染实现了对抗攻击在动态真实世界部署条件下的优化，提供了一个开源、跨平台的统一评估框架，填补了现有评估系统的空白，增强了对抗攻击的鲁棒性评估能力。

Abstract: Adversarial attacks against vision models like object detectors are often evaluated under limited conditions, leaving their performance under-characterized. Bridging simulation and differentiable rendering enables more robust, end-to-end evaluation of these adversarial attacks, yet there is no easy-to-use, unified system that offers a rich set of customizable configurations for adversarial attacks across multiple scenes, objects, environmental and lighting conditions, and camera trajectories. We present ALLUDE, which addresses these gaps, offering first-of-its-kind evaluation capabilities across Linux and Windows. We comprehensively demonstrate ALLUDE’s evaluation breadth through a two-pronged strategy: (1) using Latin Hypercube Sampling, we draw a representative subset from 5,400 configurations spanning 10 scene-object pairs, 9 weather conditions, 4 optimizers, 5 camera trajectories, and 3 detection models; (2) we stress-test existing attacks (CAMOU, RAUCA, FCA) under diverse weather conditions and continuous camera trajectories, revealing degradation of attack success across every attack, exposing evaluation gaps in prior work. Through ALLUDE’s end-to-end differentiable rendering, adversarial attacks can be optimized against shifting real-world deployment conditions. Our cross-platform code is open source.

[74] O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning cs.CV | cs.AI | cs.CL | cs.MAPDF

Mei Yuan, Qi Long, Qifeng Wu, Zhenyang Li, Yizhou Zhao

TL;DR: 本文提出了一种名为O-VAD的无训练、基于代理的工业视频异常检测框架，专注于通过对象中心跟踪和推理来识别工业过程中的异常对象和事件。该方法通过跟踪检测对象在时空中的动态和底层变换，并基于对象级时间状态轨迹进行推理，以在接地帧中识别异常对象，克服了现有方法依赖正常片段重训练或注入领域知识的限制。

Details

Motivation: 现有基于视觉语言模型（VLM）的异常推理方法在通用领域能检测开放式异常，但在具有复杂对象变换、严格物理和程序约束的工业环境中性能下降，因此需要一种无需领域特定知识、能像人类检查员一样关注对象状态演化的方法来应对这种交互密集检测的复杂性。

Result: 在三个工业视频异常检测（IVAD）数据集上的广泛实验表明，该方法优于前沿的VLM、代理框架以及在各自数据集上微调的传统VAD方法，同时能提供关于异常过程和类型的可解释报告。

Insight: 创新点在于提出了一种无训练、代理式的对象中心框架，强调跟踪对象状态演化并进行时间轨迹推理，无需依赖重训练或领域知识注入，从而实现了在复杂工业场景中更优的异常检测和可解释性。

Abstract: Industrial Video Anomaly Detection (IVAD) aims to identify anomalous objects and events in an industrial process, which is crucial for modern manufacturing and quality control systems. Existing VLM-based anomaly reasoning methods are capable of detecting open-ended anomalies in general domains. However, their performance declines in industrial settings characterized by intricate object transformations, strict physics, and procedural constraints. To tackle the complexity of such interaction-intensive detection, we introduce a training-free agentic framework for anomaly detection free of domain-specific knowledge, emphasizing object state evolution like humans inspectors. It is designed to track spatial-temporal dynamics and underlying transformations of detected objects over time, and then reason over the object-wise temporal state trajectories to identify abnormal objects in grounded frames. Our method overcomes limitations of prior approaches that rely on retraining on normal clips or injecting domain knowledge as context for test-time inference. Extensive experiments on three IVAD datasets demonstrate that our method outperforms frontier VLMs, agentic frameworks, and traditional VAD methods fine-tuned on the respective datasets, while providing interpretable reports over anomaly processes and types.

[75] Searching for Task-Specific Vision Paths: Evolutionary Block Pruning Across Vision-Language Models cs.CVPDF

Tarun Tomar

TL;DR: 该论文研究在视觉语言模型中，针对不同任务（如OCR、计数、物体识别等）动态跳过部分视觉编码器块的可能性，而无需微调模型。作者提出了两种方法：共享K块路径（为所有问题跳过相同的一组K个块）和能力特定的K块策略（根据已知的能力标签选择相同大小的路径）。他们引入了一种源平衡进化搜索方法，并在固定计算预算下与其他方法（如独立排序、连续移除和随机路径）进行了比较。

Details

Motivation: 动机在于，当前的视觉语言模型通常对每个问题都执行完整的视觉编码器，即使不同查询（如OCR、计数、物体、属性、空间查询）可能不需要相同的计算量。这导致了不必要的计算开销，因此研究是否可以在不微调的情况下，根据任务跳过固定的视觉块组合，以提高效率。

Result: 实验在Qwen2.5-VL-3B-Instruct和SmolVLM2-2.2B-Instruct模型上进行，使用876个图像不重叠的选择分割数据集。结果显示，在SmolVLM2上，搜索到的共享四块路径比独立构建方法提高了4.91个百分点。在Qwen上，六块能力特定策略比共享路径提高了2.17个百分点，其中OCR任务增益达7.10点。但在密封的IIIT5K数据集上，SmolVLM2的OCR特定路径比其共享路径低了13.6点，表明能力标签的通用性有限。

Insight: 创新点包括提出源平衡进化搜索方法来优化视觉块跳过策略，以及探索能力特定路径的可行性。从客观角度看，该研究展示了通过组合搜索可以有效构建任务特定的视觉路径，但能力标签并不能保证跨架构或数据集的通用可转移性，这为动态模型剪枝和效率优化提供了新思路。

Abstract: Vision-language models normally execute the same complete vision encoder for every question, even when OCR, counting, object, attribute, and spatial queries may not require identical computation. We study whether fixed-budget combinations of vision blocks can be skipped without fine-tuning. A shared K-block route skips one searched set of exactly K blocks for every question, while a capability-specific K-block policy selects one same-size route using a known capability label. We introduce a source-balanced evolutionary search and compare it with independent ranking, contiguous removal, and random routes at matched budgets. Experiments use Qwen2.5-VL-3B-Instruct, SmolVLM2-2.2B-Instruct, and an 876-example image-disjoint selection split. Search transfers across architectures: on SmolVLM2, the searched shared four-block route beats independent construction by 4.91 percentage points. Capability specialization is less stable. On Qwen, the six-block capability policy beats the shared route by 2.17 points, driven by a 7.10-point OCR gain. On sealed IIIT5K, however, the SmolVLM2 OCR-specific route trails its shared route by 13.6 points. Combinatorial search reliably improves route construction, but capability labels do not define universally transferable vision pathways.

[76] HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis cs.CVPDF

Lingwei Dang, Juntong Li, Zonghan Li, Hongwen Zhang, Liang An

TL;DR: 本文提出了HarmoHOI，一个统一的扩散框架，用于联合生成同步的多视角手-物交互（HOI）视频和全局对齐的3D点轨迹。其核心是通过将3D点轨迹表示为伪视频，在扩散去噪过程中协同演化2D外观和3D运动，并利用混合数据课程学习策略，将单视图数据的先验知识迁移到多视图生成任务中。

Details

Motivation: 手-物交互合成是动画制作和具身AI的基础。尽管视频基础模型具有强大的先验，但由于复杂的手部运动和遮挡，实现多视角一致的HOI合成仍然具有挑战性。

Result: 实验结果表明，HarmoHOI在视觉质量、运动合理性和多视角几何一致性方面达到了最先进的（SOTA）性能。

Insight: 主要创新点在于：1）提出了混合多视角扩散Transformer，共同建模RGB视频和3D点轨迹，通过将点轨迹表示为伪视频来对齐3D几何信号与2D潜在空间，从而最小化领域差距；2）引入了全局运动对齐扩散，将粗略的点轨迹细化为度量尺度、全局对齐的3D轨迹；3）采用混合数据课程学习策略，有效解决了多视角HOI数据稀缺的问题，实现了从单视图到多视图的泛化先验迁移。

Abstract: Hand-Object Interaction (HOI) synthesis is a cornerstone for animation production and embodied AI. Despite the strong priors of video foundation models, multi-view consistent HOI synthesis remains challenging due to complex hand motions and occlusions. We present HarmoHOI, a unified diffusion framework that jointly and harmoniously generates synchronized multi-view HOI videos and globally aligned 3D point tracks. Our core insight is that robust multi-view consistency fundamentally requires globally aligned 3D geometry and motion. To this end, we propose a Mixture of Multi-view Diffusion Transformer that co-models RGB videos and 3D point tracks. By representing point tracks as pseudo-videos, we align 3D geometric signals with the 2D latent space of foundation models, thereby minimizing the domain gap and easing adaptation of priors. To further ensure geometry consistency, we introduce Global Motion Aligning Diffusion, which refines coarse point tracks into metric-scale, globally aligned 3D trajectories. HarmoHOI enables on-the-fly co-evolution of 2D appearance and 3D motion during denoising. To overcome the scarcity of multi-view HOI data, we employ a hybrid data curriculum learning strategy that successfully transfers generic priors from single-view data to synchronized multi-view generation. Experimental results show that HarmoHOI achieves state-of-the-art performance in visual quality, motion plausibility, and multi-view geometric consistency. Project page available at https://droliven.github.io/HarmoHOI_project.

[77] Denoising Models Develop Human-Like Perceptual Illusion Representations Across Architectures cs.CVPDF

Gautam Ranka, Paras Chopra

TL;DR: 该论文研究了去噪模型在内部层中如何形成对人类亮度错觉敏感的表示，发现这些表示与人类心理物理模型高度相关，但在输出层面不可见，作者称之为‘感知幻象’。

Details

Motivation: 尽管已有研究表明深度神经网络在输出层面能产生与人类观察者一致的亮度错觉响应，但模型内部是否、在何处以及如何表示这些错觉仍未知。

Result: 在特定内部层和通道中，去噪模型能区分错觉区域与物理匹配的控制区域，其激活与人类亮度感知模型FLODOG高度相关（Spearman ρ≥0.70），且随错觉强度单调缩放。

Insight: 去噪目标比架构本身更关键地驱动了错觉敏感表示的形成；这些内部表示（感知幻象）在信号处理中活跃，但输出评估中不可见，揭示了视觉模型内部与输出的解耦现象。

Abstract: Deep neural networks trained on natural images are shown to produce outputs consistent with human observers for brightness illusions. While this phenomenon has been documented across architectures, all evidence, to date, is measured at the output level: restored pixels, decoded trajectories, or classification decisions. Whether these models actually represent illusions internally, and if so where and how, remains unknown. We show that denoising models develop illusion-sensitive representations at specific internal layers, across varied architectures. Specifically, we identify the layers and channels that discriminate illusory from physically matched control regions. We show that the denoising objective is a more important driver of the effect than the architecture. On domain-appropriate stimuli, these activations track a validated psychophysical model of human brightness perception (FLODOG; Spearman $ρ\geq 0.70$) and scale monotonically with parametric illusion strength. Leveraging these findings, we provide causal evidence via channel ablation showing that illusion-sensitive channels specifically and substantially affect the internal signal. Yet injecting these representations into the generation pipeline produces no measurable pixel shift across all tested architectures; we term such representations perceptual phantoms: active in internal processing yet invisible to any output-based evaluation. While related internal-output dissociations have been characterized in language models, this is the first such characterization for perceptual representations in denoising vision models.

[78] STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMs cs.CVPDF

Ye Wang, Hongjun Wang, Hao Fang, Tongyuan Bai, Zuwei Long

TL;DR: 本文提出STBridge框架，旨在解决统一多模态模型（UMMs）中视觉理解与生成任务之间的语义对齐差距。通过共享目标状态，将目标描述与编辑图像在语义上对齐，采用先对齐后优化的策略（监督微调与强化学习）来提升模型的一致性。

Details

Motivation: 现有UMMs虽然在架构上统一了视觉理解与生成，但两者输出常存在语义不一致，尤其是在细粒度实体、属性、空间关系和局部细节方面，这揭示了理解与生成之间的对齐鸿沟。

Result: 在视觉理解、图像生成和图像编辑等多个基准测试中，STBridge均优于初始模型，对齐分析证实其有效缩小了模型描述与生成内容之间的差距。

Insight: 创新点在于提出共享目标对齐框架，将目标描述作为视觉结果的语义表达，并通过共享信息流连接理解与生成；采用先对齐后优化的两阶段训练策略，为UMMs的后训练对齐提供了有效方案。

Abstract: Unified multimodal models (UMMs) aim to integrate visual understanding and generation within a single architecture, but architectural unification alone does not ensure semantic consistency. A model may describe the intended target correctly while generating an inconsistent edit. This exposes an understanding-generation alignment gap: linguistic and visual outputs live in different spaces, yet should be governed by the same target semantics. We study this gap in image editing, where an instruction defines a target state that can be both described and visually realized. Given a source image and an edit instruction, we compare a UMM’s target caption with its edited image to test whether the two outputs converge on the same result. Our analysis shows that existing UMMs remain weakly aligned, especially for fine-grained entities, attributes, spatial relations, and local details, indicating that semantic unification is not achieved by architecture alone. To bridge this gap, we propose STBridge, a shared-target alignment framework that connects understanding and generation through a common target state. Here the target caption expresses the desired visual result, while the edited image realizes it visually, replacing separate task-specific paths with a shared information flow from target expression to target realization. STBridge follows an align-then-optimize strategy: supervised fine-tuning first establishes the shared-target channel, and sequential reinforcement learning further refines target-centered coordination. Across visual understanding, image generation, and image editing benchmarks, STBridge consistently improves over the initialization model. Alignment analysis confirms that STBridge narrows the gap between what the model describes and what it generates, demonstrating shared-target alignment as an effective post-training strategy for bridging understanding and generation in UMMs.

[79] The generator is the tracker: Multi-object tracking by painting persistent identity colours cs.CVPDF

Haiyu Yang, Miel Hostens

TL;DR: 该论文提出了一种基于视频生成模型的多目标跟踪新方法，通过微调大型文本到视频扩散模型（LTX-2.3），将RGB视频帧转换为ID图序列，其中每个行人被涂上持久且独特的颜色以实现身份关联。该方法在长视频中采用链式窗口生成，无需传统检测器、运动模型或重识别模块，在DanceTrack基准测试中取得了40.3 HOTA的关联性能。

Details

Motivation: 传统多目标跟踪（MOT）通常分解为检测和关联两个步骤，依赖外部状态（如轨迹缓冲区、运动模型和外观嵌入）来维持目标身份。本文探索是否可以通过视频生成模型在像素层面直接维持这种状态，从而简化跟踪流程。

Result: 在DanceTrack测试集上，该方法达到40.3 HOTA，远低于当前SOTA（≥70 HOTA），但其关联分数（AssA 44.1）超过了原始基准测试中的所有跟踪器，主要缺陷在于检测性能。在383个挖掘的遮挡事件中，生成模型在遮挡后以42%的条件率重新获取身份，而基于外观嵌入的基线方法得分为零。

Insight: 创新点在于将跟踪任务重构为视频到视频的生成问题，利用扩散模型在像素层面直接编码持久身份信息（通过颜色分配），实现了无需显式检测和关联模块的端到端跟踪。生成模型的身份颜色分配表现出一种新兴的重识别信号能力，能够处理长时遮挡和身份延续问题。

Abstract: Multi-object tracking (MOT) is conventionally decomposed into detection followed by association, with object identity maintained as external state: track buffers, motion models, and appearance embeddings. We ask whether a video generator can maintain that state in pixels. We fine-tune a 22B text-to-video diffusion model (LTX-2.3) with a lightweight in-context LoRA to translate an RGB clip into an ID-map clip, a video in which every person is painted a flat, distinct color that persists over time: same color, same identity. Long videos are generated as chained windows, where each window is conditioned on the cleaned tail of the previous one. A brief continuation fine-tune teaches the model to extend a given coloring, after which identity flows through the chain with no tracker, no motion model, and no re-identification module. On the DanceTrack test server, our system, to our knowledge the first generative tracker evaluated there and the only entry with no detector and no tracking stack, reaches 40.3 HOTA. This is well below today’s specialist state of the art (>=70 HOTA), but with a unique, inverted error profile: its association score (AssA 44.1) exceeds every tracker of the original benchmark suite while detection remains the sole deficit. Controlled comparisons show the mechanism matters: the same generated windows linked by classical post-hoc association score 2x worse (18.2 HOTA), and frame-to-frame IoU association fragments tracks that the generator’s colors keep whole. On 383 mined occlusion events, the generator re-acquires identities after gaps at a 42% conditional rate where appearance-embedding baselines score zero, including gaps longer than its temporal context, evidence that the generator’s color assignment functions as an emergent re-identification signal. We release code, checkpoints, and the full pre-registered experimental log.

[80] Noise-Robust Box-Supervised Infrared Small Target Detection via Physics-Inspired Soft Label Optimization cs.CV | cs.AIPDF

Xizhe Zhang, Fan Shi, Mianzhao Wang, Jiangpeng Zheng, Xu Cheng

TL;DR: 本文提出了一种名为HALO（Hotspot-Anchored Label Optimization）的噪声鲁棒性框监督红外小目标检测方法。该方法通过物理启发的软标签优化，将含噪声的边界框监督转换为像素级的连续软标签，从而解决了传统像素级标注成本高且不确定的问题。

Details

Motivation: 红外小目标检测通常依赖像素级掩码监督，但这类标注成本高昂，且由于红外目标边界模糊、纹理弱，标注本身存在不确定性。因此，本文旨在探索一种更实用、对标注噪声更鲁棒的框监督方法。

Result: 在公开数据集上的实验表明，在标准的紧密边界框标注下，HALO与代表性的框监督方法性能相当。在更宽松或偏移的框标注（更接近真实场景）下，HALO表现出显著更强的鲁棒性，且在不同骨干网络上保持一致性。

Insight: 核心创新点在于将框监督IRSTD定义为一个独特问题，并提出HALO方法：在局部背景统计约束下定位每个框内的辐射锚点，并围绕锚点合成物理锚定的高斯软标签。该方法离线进行，与检测器主干解耦，无需在线标签更新。此外，引入了污染感知的操作区域分析来刻画此类方法的有效边界，揭示了内在信杂比与性能的关系。

Abstract: Infrared small target detection (IRSTD) commonly relies on pixel-level mask supervision. Such annotations, however, are costly and inherently uncertain because infrared targets have blurred boundaries and weak textures. We formulate box-supervised IRSTD as a problem distinct from generic box-to-mask segmentation and point-supervised IRSTD. Its central challenge is to construct stable pixel-level soft supervision from highly contaminated boxes. To this end, we propose Hotspot-Anchored Label Optimization (HALO). HALO localizes a radiometric anchor inside each box under local background-statistics constraints, then synthesizes a Physically Anchored Gaussian (PAG) soft label around the anchor. This turns noisy box supervision into continuous, pixel-level soft labels. The entire process is performed offline before training, remains decoupled from the detector backbone, and requires no online label updates. Experiments on public datasets show that HALO is competitive with representative box-supervised methods under standard tight boxes. Under looser or shifted box annotations that better approximate real scenarios, HALO is substantially more robust while remaining consistent across backbones. We further introduce a contamination-aware operating-regime analysis to characterize the effective boundary of this class of methods and reveal how intrinsic signal-to-clutter ratio relates to performance.

[81] VLA-ReID: Video-Level Association for Re-Identification in Multi-Object Tracking with Highly Similar Objects cs.CV | cs.AIPDF

Yanrong Qin, Xiaoyan Cao, Yao Yao

TL;DR: 本文提出VLA-ReID方法，将多目标跟踪中的重识别任务重新定义为视频级关联建模，通过聚合历史轨迹特征作为查询、当前帧检测作为候选，直接优化全局关联。同时引入帧共同外观估计和共同外观抑制技术，增强高度相似对象间的判别性差异。

Details

Motivation: 现有跟踪器使用单实例分配训练重识别模型，但推理时需进行多轨迹与检测的全局分配，导致训练-推理不匹配，在视觉相似对象间易发生身份切换。现有方法通常需要大量额外标注来增强外观判别力。

Result: 在BEE24数据集上，VLA-ReID相比SOTA跟踪器将HOTA提升1.1、MOTA提升0.3、AssR提升2.6、AssA提升0.7、IDF1提升0.8，身份切换减少28%。

Insight: 将重识别建模为视频级关联问题，直接优化全局分配；通过帧共同外观估计与抑制技术，无需额外标注即可增强高度相似对象间的判别特征；该方法特别适用于小目标、密集分布且外观高度相似的场景（如蜂群）。

Abstract: Multi-object tracking (MOT) aims to localize multiple objects in videos while preserving their identities over time. Long-term identity preservation remains difficult when objects are small, densely distributed, and highly similar in appearance, as in bee swarm scenes. Existing trackers rely on re-identification (re-ID) models trained through single-instance assignment (instance-level querying). At inference, however, MOT requires global assignment between multiple trajectories and detections, corresponding to video-level querying. This training-inference mismatch can cause identity switches among visually similar objects. Existing approaches also often require substantial additional annotations to enhance appearance discrimination. We propose Video-Level Association re-ID (VLA-ReID), which reformulates re-ID as video-level association modeling. It uses aggregated historical trajectory features as queries and all current-frame detections as candidates, enabling direct optimization of their global association at each frame. In addition, Frame-Common Appearance Estimation (FCAE) estimates a common appearance direction from current-frame detections, while Common-Appearance Suppression (CAS) removes the corresponding component along this direction from trajectory and detection features. This amplifies discriminative differences among highly similar objects without additional annotations. Experiments on BEE24 show that VLA-ReID improves HOTA by 1.1, MOTA by 0.3, AssR by 2.6, AssA by 0.7, and IDF1 by 0.8 over state-of-the-art trackers, while reducing identity switches by 28%. These results demonstrate the effectiveness of video-level re-ID modeling for appearance-based association in MOT.

[82] BanClickThumb: A Multimodal Dataset and Transformer Fusion Benchmarks for Clickbait Detection in Bengali YouTube Videos cs.CVPDF

Md. Ariful Islam, Md Tanvirul Islam, Md. Maruf Hossain Miru, Md Khalid Syfullah

TL;DR: 该论文针对孟加拉语YouTube视频中的点击诱饵检测问题，构建了一个名为BanClickThumb的多模态数据集，包含7,147个缩略图-标题对，并评估了单模态与多模态方法的性能。研究发现，结合视觉与文本信息的多模态模型BanClickFusionFormer取得了最佳检测准确率（0.84）。

Details

Motivation: 点击诱饵会损害用户信任、浪费注意力并传播错误信息，而孟加拉语领域缺乏公开的多模态数据集，使得检测任务面临挑战。

Result: 在构建的数据集上，文本单模态模型（XLM-RoBERTa）准确率为0.82，图像单模态模型（SwiftFormer）为0.68，而提出的多模态融合模型（BanClickFusionFormer）达到了0.84的SOTA准确率。

Insight: 论文的创新点在于创建了首个公开的孟加拉语多模态点击诱饵检测数据集，并通过中间融合策略有效结合了视觉（ViT）与文本（XLM-RoBERTa）特征，证明了多模态融合在低资源语言内容分析中的有效性。

Abstract: Clickbait, where video titles and thumbnails exaggerate or misrepresent content, reduces user trust, wastes attention, and promotes misinformation on video-sharing platforms. Detecting Bengali clickbait remains challenging because publicly available multimodal datasets are limited. To address this gap, we introduce BanClickThumb, a curated dataset of 7,147 Bengali YouTube thumbnail-title pairs from five content domains, annotated by ten annotators with high agreement (Cohen’s Kappa: 0.83-0.93). Using this dataset, we benchmark text-only, image-only, and multimodal approaches. Among unimodal models, BanClickTextFormer (XLM-RoBERTa) achieves 0.82 accuracy, while BanClickImageFormer (SwiftFormer) reaches 0.68. Our proposed multimodal model, BanClickFusionFormer, combines ViT and XLM-RoBERTa through intermediate fusion and achieves the best accuracy of 0.84. Error analysis shows that dense thumbnail text, figurative language, and culturally specific slang remain challenging. Our findings demonstrate the effectiveness of multimodal fusion for Bengali clickbait detection and provide a publicly available benchmark to support future research on low-resource multimodal content analysis.

[83] Induce to Empower: Improving Lightweight Baselines via Foundation Model Induction for Generalized Polyp Segmentation cs.CVPDF

Shivanshu Agnihotri, Snehashis Majhi, Deepak Ranjan Nayak, Dwarikanath Mahapatra, Debesh Jha

TL;DR: 本文提出了一种名为Lite-Polyp Inductor (Lite-Pi)的新型基础模型诱导框架，旨在通过利用基础模型（如DINOv2、SAM、OneFormer）的先验知识来增强轻量级息肉分割基线模型（如U-Net、PraNet）的泛化能力。该框架通过生成基础模型特定的原型表示并进行语义对齐，再通过基于Transformer的融合来突出息肉相关特征，从而以极小的计算开销显著提升模型在多个数据集上的泛化性能。

Details

Motivation: 解决息肉分割任务中，轻量级模型泛化能力不足，而大型基础模型又因缺乏大规模标注数据和计算需求高而难以直接部署的难题。

Result: 在五个息肉分割基准数据集上的广泛实验表明，Lite-Pi显著提升了轻量级基线的性能，实现了优异的泛化性能，且计算开销极小。

Insight: 创新点在于提出了一种基础模型诱导框架，通过原型表示生成与语义对齐，将多个基础模型的互补先验知识高效迁移到轻量级模型中，并通过Transformer融合机制强化关键特征（如边界信息），为广义息肉分割提供了一个实用的解决方案。

Abstract: Automated polyp segmentation in colonoscopy continues to pose challenges due to substantial appearance variations and indistinct polyp boundaries. Although emerging foundation models (FMs) such as DINOv2, SAM, and OneFormer, demonstrate remarkable generalization capabilities, their direct transfer to the polyp segmentation task and deployment in real-time clinical settings are difficult due to lack of large-scale labeled data and high computational demands. In addition, adopting multiple FMs together raises concerns, even though they encode complementary semantic and structural information. While lightweight models, including U-Net, PraNet and U-Net++, are computationally efficient, they often struggle to generalize across datasets due to limited representational capacity. To address this gap, we propose Lite-Polyp Inductor (Lite-Pi), a novel foundation model induction framework that significantly enhances lightweight polyp segmentation baselines. Our proposed framework generates FM-specific prototype representations and aligns them semantically with the corresponding foundation model priors through reconstruction-based supervision. Subsequently, transformer-based fusion is introduced to highlight the polyp relevant representations, including salient boundary information, while preserving complementary semantic cues. Extensive experiments across five polyp segmentation benchmark datasets demonstrate that Lite-π significantly improves lightweight baselines, achieving superior generalization performance with minimal computational overhead and thereby, offering a practical solution for generalized polyp segmentation. Our code is available at GitHub. https://github.com/lostinrepo/Lite-Pi

[84] VecFontLLM: Anchor-Guided Direct Synthesis of Chinese Vector Fonts cs.CVPDF

Hao Yuan, Yuxuan Luo, Xing Chen, Zhouhui Lian

TL;DR: 本文提出VecFontLLM，一种基于锚点引导的多模态大语言模型，用于直接进行中文矢量字体的少样本合成。该方法通过预测和细化锚点支架来固定部件和轮廓的粗略布局，然后补全贝塞尔曲线控制点以恢复局部曲率和风格，从而避免了传统矢量序列生成或栅格域方法后矢量化的复杂性。

Details

Motivation: 解决中文矢量字体直接生成的挑战，因为中文矢量字形包含复杂的部件结构、锚点布局和贝塞尔曲线细节，传统矢量序列生成方法在复杂字符上效果不佳，而栅格域方法需要后续矢量化，导致质量损失。

Result: 在多个中文字体数据集上的实验表明，该方法相比现有矢量字体合成方法有显著提升，在字形渲染质量上与栅格域基线方法相当，且生成的矢量命令分布接近真实字体。

Insight: 创新点在于采用锚点引导的生成策略，将矢量字形分解为锚点支架预测和贝塞尔曲线补全两个阶段，并通过置信度引导的生成链提高复杂字形的稳定性，首次实现了在矢量域直接高质量少样本合成复杂中文矢量字形。

Abstract: Direct generation of Chinese vector fonts is a challenging and ongoing problem. A Chinese vector glyph contains complex component structure, anchor layout, and Bézier curve details, which work at different scales, but a standard vector sequence writes them together in one long sequence, making the task of vector font synthesis challenging. Existing direct vector generators often fail on complex characters, while raster-domain methods must vectorize the synthesized glyph images afterward. To address the above-mentioned problem, this paper proposes VecFontLLM, an anchor-guided multimodal large language model for direct few-shot synthesis of Chinese vector fonts. Our key idea is to generate vector glyphs through anchors rather than a standard vector sequence. Specifically, the proposed VecFontLLM first predicts and refines an anchor scaffold that fixes the coarse layout of components and contours, and then completes Bézier control points to recover local curvature and style. At test time, a confidence-guided generation chain samples multiple component candidates and continues synthesis from the highest-confidence one, improving stability for complex glyphs. This work demonstrates, for the first time, high-quality few-shot synthesis of complex Chinese vector glyphs directly in the vector domain, without raster generation or vectorization. Experiments on several Chinese font datasets show substantial improvements over existing vector font synthesis methods, competitive glyph rendering quality against raster-domain baselines, and vector command distributions close to real fonts.

[85] Understanding From Human Perspective: A Multi-agent System for Interactive Egocentric Medical Image Segmentation cs.CVPDF

Rongjun Ge, Dongyang Wang, Heng Zhu, Zhirui Li, Yang Chen

TL;DR: 本文提出EgoMed-Agent，一个用于交互式第一人称医学图像分割的多智能体系统。该系统通过两个工作流解决第一人称视角带来的语义模糊和视觉变化挑战：目标确认工作流通过可靠性评分确认用户意图目标，并在不确定时请求用户澄清；定位引导传播工作流结合每帧目标定位来校正掩码传播，确保分割在视频中持续跟踪目标。

Details

Motivation: 解决第一人称视角下交互式医学图像分割的两个核心挑战：指令的语义模糊导致模型无法确认用户意图目标，以及视频帧间的视觉变化导致分割结果不稳定。

Result: 在广泛的实验中，EgoMed-Agent达到了71.34%的平均Dice分数，远超过最佳文本提示基线方法的11.70%，展现了显著的性能提升。

Insight: 创新点在于从人类视角理解目标，通过多智能体协作的工作流设计，将目标确认与定位引导的掩码传播相结合，有效解决了第一人称交互中的歧义和跟踪漂移问题，为智能眼镜辅助医疗图像审阅提供了可靠的技术方案。

Abstract: Interactive egocentric medical image segmentation (IEMIS) plays an important role in smart-glasses-assisted medical image review, segmenting the medical targets a clinician refers to from their egocentric view. Once it succeeds, the object-level visual evidence it provides strengthens the review and underpins fine-grained analysis and clinical decision-making. However, the instruction and the video both come from the user’s egocentric perspective, which poses two challenges. (1) Semantic ambiguity leaves the model unable to confirm the user-intended target. (2) Visual variability makes the segmentation jump from frame to frame. In this paper, we propose EgoMed-Agent, a multi-agent system that understands the target from the human perspective through two workflows. (1) The \textit{Target Confirmation Workflow} grounds the instruction against candidate targets with a reliability score, confirming the target when the grounding is reliable and asking the user to clarify when it is not, thereby confirming the segmentation target. (2) The \textit{Localization-Guided Propagation Workflow} couples mask propagation with per-frame target localization, using the localized target to correct the propagated mask whenever the two diverge, so the segmentation stays on the target across the egocentric video. Extensive experiments show that EgoMed-Agent reaches 71.34% average Dice, far above the best text-prompted baseline (11.70%). Our code is available at \href{https://github.com/wdyyyyyy/EgoMed-Agent}{our project page}.

[86] SkyVLaM: Multimodal Large Language Model for UAV Video Understanding in Remote Sensing cs.CVPDF

Kaiwen Jing, Ruixu Jia, Bingyao Li, Ruizhe Ou, Ming Wu

TL;DR: 本文提出了SkyVLaM，一个用于无人机视频理解的多模态大语言模型。该模型通过时间基感知器从视频表示中构建稀疏令牌，并自适应选择高分辨率密集片段，结合大语言模型进行查询条件下的视频分割。作者还构建了SkyVid数据集，包含视频对话生成和参考视频对象分割任务。

Details

Motivation: 解决无人机视频中细粒度目标理解（如语言条件分割）的挑战，这些挑战源于目标小、视觉模糊以及动态的空中视角。

Result: 实验表明，SkyVLaM在视觉令牌预算分配上更有效，并提升了无人机场景下的语言条件视频分割性能。

Insight: 创新点在于通过时间基感知器构建稀疏令牌并正则化以获取互补时序线索，以及自适应选择高分辨率密集片段进行联合处理，实现了对无人机视频中复杂目标的精细理解。

Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved remote sensing (RS) multimodal understanding. Language-conditioned segmentation is crucial for fine-grained target understanding in Unmanned Aerial Vehicle (UAV) videos. However, this task remains challenging due to the prevalence of small, visually ambiguous targets and dynamic aerial perspectives. In this paper, we propose SkyVLaM, a multimodal large language model for UAV video understanding. SkyVLaM constructs sparse tokens directly from patch-level video representations through a temporal basis perceiver, regularizes the sparse basis to encourage complementary temporal cues, and adaptively selects a temporally coherent dense segment for high-resolution inspection. The resulting sparse and dense tokens are jointly processed by a large language model for query-conditioned segmentation. We further build SkyVid, consisting of SkyVid-VGCG and SkyVid-RVOS for video grounded conversation generation and referring video object segmentation, respectively. SkyVid contains 101 videos, 33.6K frames, and 1.53M pixel-level object instances. Experiments show that SkyVLaM provides a more effective allocation of the visual token budget and improves language-conditioned video segmentation in UAV scenarios.

[87] STAR: Skeletal Token Alignment and Rearrangement for Interaction Recognition cs.CV | cs.AIPDF

Yuhang Wen, Mengyuan Liu, Zixuan Tang, Junsong Yuan, Sirui Li

TL;DR: 本文提出了一种名为STAR（骨骼令牌对齐与重排）的方法，用于解决基于骨骼序列的人机与人际交互识别中的两大挑战：有效学习交互线索并补偿骨骼数据缺乏视觉信息的问题。该方法通过将骨骼与RGB视频表示在共享潜在空间中对齐，学习交互特定的骨骼特征并利用视觉线索进行增强，在推理时仅需骨骼数据即可保持高效性。

Details

Motivation: 现有基于骨骼序列的交互识别方法难以有效学习交互线索，且骨骼数据本身缺乏视觉信息，导致识别性能受限。本文旨在通过结合骨骼与RGB视频数据，在训练时学习鲁棒的交互表示，并在推理时仅依赖骨骼数据以保持效率。

Result: 在Chico、HARPER、NTU Mutual 11和26等多个数据集上的实验表明，STAR方法在交互识别任务上优于现有最先进方法，实现了SOTA性能。

Insight: 创新点包括：1）设计骨骼编码器，通过实体重排（ER）和交互时空令牌（ISTs）捕获细粒度依赖关系；2）提出视觉交互编码，采用关注交互（FoI）策略聚焦RGB视频中的相关时空区域；3）通过对比学习目标对齐骨骼与视觉表示，使推理时仅需骨骼数据即可受益于视觉信息。这为低光照或隐私敏感环境下的交互识别提供了高效解决方案。

Abstract: Understanding physical human-robot and human-human interactions is a challenging yet emerging topic in 3D vision. While most existing methods rely on skeleton sequences–effective in low-light and privacy-sensitive environment–they face two major challenges: 1) learning and effectively exploiting interaction cues from skeletal data, and 2) compensating for the lack of visual information absent in skeletons alone. To address these challenges, we propose skeletal token alignment and rearrangement (STAR) for human-robot and human-human interaction recognition. It learns interaction-specific skeleton features and enriches them using visual cues by aligning skeleton and RGB video representations in a shared latent space. Specifically, STAR consists of three key components. First, we design a skeleton encoder that captures fine-grained interdependencies using Entity Rearrangement (ER) and Interactive Spatiotemporal Tokens (ISTs). Second, we present Visual Interaction Encoding that introduces a Focus on Interactions (FoI) strategy to attend to spatiotemporal regions relevant to interactions in RGB videos. Finally, these representations are aligned via a contrastive learning objective, with a refinement head further refines predictions. During training, STAR leverages both skeleton and RGB video data to learn robust, discriminative interaction representations. At inference time, it operates on skeletons alone, retaining visual-informed benefits while preserving skeleton-only efficiency. Extensive experiments on Chico, HARPER, NTU Mutual 11 and 26 datasets consistently validate our approach by demonstrating superior performance over state-of-the-art methods. Our code is publicly available at https://github.com/Necolizer/STAR.

[88] Automating Visual Recognition of Leprosy in Wild Chimpanzees cs.CVPDF

Katie I. Murray, Anna C. Bowland, Marina Ramon, Elena Bersacola, Aissa Regalla

TL;DR: 本文提出了首个用于野生动物麻风病检测的深度学习流程，并贡献了PanLep300数据集。论文通过比较空间（2D）、时间聚合（2.5D）和视频（3D）分类方法，发现简单的裁剪级别预测聚合方法在检测野生黑猩猩麻风病方面表现最佳，并针对部分可见个体帧的性能下降问题提出了改进策略。

Details

Motivation: 野生黑猩猩中麻风病的视觉症状明显，但人工审查大规模相机陷阱视频不可行，因此需要自动化筛查。

Result: 在PanLep300数据集上，简单的裁剪级别预测聚合方法在性能上持续匹配或优于学习的时间模型和端到端视频架构。

Insight: 创新点在于构建了首个野生动物麻风病检测数据集和流程，并发现针对静态皮肤表现的疾病，简单的空间预测聚合优于复杂的时间建模，同时提出了处理部分可见个体帧的针对性构建和聚合策略。

Abstract: Leprosy (Mycobacterium leprae) has been confirmed in wild western chimpanzees (Pan troglodytes verus) in West Africa, presenting as clear and progressive visual symptoms. Manual review of camera-trap footage at landscape scale is infeasible, motivating the need for automated screening. We present the first deep learning pipeline for wildlife leprosy detection and contribute the PanLep300 dataset of 125,670 annotated bounding-box crops across 953 tracks from 303 camera-trap videos with ecologically-motivated splits that withhold whole individuals and camera installations. We benchmark spatial (2D), temporally aggregated (2.5D), and video-based (3D) classification approaches to investigate which approach is best suited to automated leprosy detection in wild apes. We find that simple aggregation of crop-level predictions consistently matches or outperforms both learned temporal models and end-to-end video architectures – consistent with leprosy’s static cutaneous presentation. We further find that performance is suppressed when tracklets contain frames of partially visible individuals – as commonly occurs at the start and end of a track – and demonstrate that this can be addressed through targeted construction and aggregation strategies.

[89] DA-MergeLoRA: Hypernetwork-Based LoRA Merging for Few-Shot Test-Time Domain Adaptation cs.CV | cs.LGPDF

Siobhan Reid, Zhixiang Chi, Li Gu, Omid Reza Heidari, Ziqiang Wang

TL;DR: 本文提出DA-MergeLoRA，一种用于少样本测试时域适应（FSTT-DA）的新框架。该方法通过为每个源域在CLIP视觉编码器上微调独立的LoRA模块来学习领域特定知识，并引入一个通过元学习训练的超网络，该网络根据少量目标图像生成合并权重，以融合源LoRA模块，从而适应新目标域。

Details

Motivation: 现有的FSTT-DA方法（如浅层批量归一化更新、基于提示的黑盒方法或集成策略）未能有效利用源领域特定知识，且未捕获跨领域关系。本文旨在解决这些局限性。

Result: 该方法在多个域适应数据集上实现了最先进的（SOTA）性能。

Insight: 核心创新点在于将LoRA微调与基于超网络的模型合并相结合，通过元学习训练的超网络动态生成合并因子，实现了源领域知识的有效融合与目标域的自适应，同时保持了基础模型的泛化知识。

Abstract: Few-shot Test-Time Domain Adaptation (FSTT-DA) seeks to adapt models to novel domains using only a handful of unlabeled target samples. This setting is more realistic than typical domain adaptation setups, which assume access to target data during source training. However, prior FSTT-DA approaches fail to effectively leverage source domain-specific knowledge, relying on shallow batch normalization updates, prompt-based methods that treat the model as a black box, or ensembling strategies that do not capture cross-domain relationships. To address these limitations, we introduce a new FSTT-DA framework that integrates LoRA fine-tuning with model merging. In our approach, separate LoRA modules are fine-tuned on CLIP’s vision encoder for each source domain. Since LoRA modifies only a small fraction of the model’s parameters, it retains the base model’s generalized knowledge while internally learning domain-specific features. To adapt the learned knowledge to a specific target domain, we propose a hypernetwork trained via meta-learning that generates per-column merging factors to combine LoRA modules. Given a small batch of target images, the hypernetwork produces merging weights that fuse source LoRA modules into a single adapted representation. Our results demonstrate state-of-the-art performance across various domain adaptation datasets. Our code is publicly available at https://github.com/nahbois4321/DA-MergeLoRA.

Maciej Braszczok, Otto Brookes, Xiaoxuan Ma, Federico Rossano, Yixin Zhu

TL;DR: 该论文介绍了PanAf-SBR数据集，这是首个针对野生大猿的社会行为识别数据集，包含来自相机陷阱的100个视频和36,063帧图像，带有81,096个注释，如边界框、分割掩码和七种社会行为类别。研究使用AlphaChimp架构建立了野生大猿社会行为识别的基准，并通过与圈养数据集ChimpACT的迁移学习实验，发现跨数据集预训练对特定行为类别有益，同时探讨了背景上下文在行为识别中的作用。

Details

Motivation: 野生大猿的社会行为变化（如社会结构崩溃）可作为种群衰退的早期指标，自动化检测这些行为对保护至关重要。现有数据集缺乏野生环境下的细粒度社会行为注释，因此需要填补这一空白。

Result: 研究使用PanAf-SBR数据集和AlphaChimp架构，首次建立了野生大猿相机陷阱视频中细粒度社会行为识别的基准。迁移学习实验表明，跨数据集预训练对特定行为类别（而非所有类别）有显著益处。

Insight: 创新点包括引入首个野生大猿社会行为数据集PanAf-SBR，采用ChimpACT的行为给予者和接收者约定进行注释，并通过分割掩码反转实验探索背景上下文对行为识别的影响，为保护生物学中的自动化监测提供了新工具。

Abstract: Behavioural shifts in wild great ape populations, particularly the breakdown of social structures, can serve as an early indicator of population decline. Automating the detection of behaviours indicative of these shifts is therefore a critical task for conservation. Several valuable datasets have recently been introduced for the automated recognition of great ape behaviour, yet few include fine-grained social behaviour annotations, and those that do are captured either in captive settings or via aerial platforms such as UAVs. We address this gap by introducing PanAf-SBR, the first wild great ape camera trap dataset annotated with social behaviours. PanAf-SBR extends PanAf500 with 100 additional videos covering 36,063 frames. These come with 81,096 annotations including bounding boxes, segmentation masks, intra-video identities, and seven social behaviour classes defined under the action giver and receiver convention of ChimpACT. We use this data together with the AlphaChimp architecture to establish the first benchmarks for fine-grained social behaviour recognition in wild great apes from camera trap footage. We further conduct bidirectional transfer learning experiments between PanAf-SBR and the captive ChimpACT dataset, finding that cross-dataset pre-training is highly beneficial for specific classes rather than of uniform benefit. Finally, we examine the role of background context by inverting the segmentation masks to suppress non-ape pixels.

[91] TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs cs.CVPDF

Yuhan Zhu, Changlian Ma, Xiangyu Zeng, Xinhao Li, Zhiqiu Zhang

TL;DR: 论文提出了TimeLens2，一个用于通用视频时序定位的多模态大语言模型。它旨在解决现有视频MLLM模型只能描述视频内容但难以准确定位证据发生时间的问题。该方法通过构建TimeLens2-93K数据集提供可靠的多段监督，并设计了时序Wasserstein奖励和时序IoU相结合的优化策略，以处理集合值预测任务。

Details

Motivation: 现有视频多模态大语言模型主要关注描述视频内容，但很少能识别支持证据发生的具体时间区间。论文旨在研究通用视频时序定位问题，即让一个模型能够预测视频中可变数量的证据时间区间，并适应不同的视频长度、领域、查询形式和视角。

Result: 在七个基准测试上，TimeLens2-2B模型在所有规模匹配的基线模型中均表现最佳。其4B和8B变体实现了最先进的性能，超越了参数量高达397B的开源模型。具体而言，2B、4B和8B变体相比其Qwen3-VL主干网络，分别提升了14.2、13.0和18.1个mIoU点。

Insight: 论文的核心创新在于将时序证据视为一个区间集合来进行监督和优化，而非传统的单段或独立片段处理。这通过构建包含多段监督的TimeLens2-93K数据集，以及设计无需片段匹配、能处理不同基数预测的时序Wasserstein奖励函数来实现，为集合值时序定位任务提供了更鲁棒的训练框架。

Abstract: Video multimodal large language models (MLLMs) can describe what happens in a video, but rarely identify when the supporting evidence occurs. We study generalist video temporal grounding, in which one model predicts a variable-cardinality set of evidence intervals across video lengths, domains, query forms, and viewpoints. Existing training strategies are misaligned with this set-valued task: long-video labels often rely on brittle one-pass annotation, while reinforcement-learning rewards either fail to distinguish non-overlapping predictions or require fragile segment matching. TimeLens2 treats temporal evidence as an interval set throughout supervision and optimization. TimeLens2-93K constructs reliable multi-span supervision through caption-derived proposals, independent localization, cross-agent consensus, semantic verification, and boundary refinement. Our temporal Wasserstein reward computes exact one-dimensional (W_1) between uniform distributions over merged interval supports, providing dense, matching-free feedback under unequal cardinalities and equivalent fragmentation; temporal IoU complements it with precise-overlap feedback. Across seven benchmarks, TimeLens2-2B outperforms all size-matched baselines on every benchmark, while the 4B and 8B variants achieve state-of-the-art performance, surpassing open-source models with up to 397B parameters. The 2B, 4B, and 8B variants improve over their Qwen3-VL backbones by 14.2, 13.0, and 18.1 mIoU points, respectively.

[92] TraversRL: Traversable Pedestrian Pathway Generation With Reinforcement Learning cs.CVPDF

Bin Han, Robert Wolfe, Bill Howe

TL;DR: 本文提出TraversRL，一种基于强化学习的视觉条件模型，用于从航拍图像自动生成可通行的行人路径网络。该方法将路径提取建模为模拟旅行者导航环境的顺序决策过程，通过长短距离段动作空间适应复杂模式并跨越遮挡，结合图级和逐步奖励平衡整体连通性与边缘定位精度。

Details

Motivation: 现有基于分割的方法主要关注像素标记以推断路段，但常产生不连通或碎片化的图，不适用于导航；需要生成适合路由的连通网络，而人行道和交叉口可能被部分遮挡、隐式定义且具有复杂连通模式。

Result: 在三个视觉骨干网络和三个交叉口数据集上，TraversRL相比最先进的分割基线显著提高了与真实图的缓冲IoU，并将连通性指标提升了一倍以上；结合全局和局部奖励能生成更清晰、伪分支更少的图，同时进一步提升整体性能。

Insight: 创新点在于将路径提取视为从旅行者视角的顺序决策过程，并用强化学习优化最终图质量；通过设计长短距离段动作空间适应复杂模式与遮挡，结合图级和逐步奖励平衡连通性与定位，从而生成更可靠的行人网络。

Abstract: Automatically generating pedestrian pathways from aerial images requires producing a connected network suitable for routing, not just detecting where sidewalks appear. Sidewalks and crossings, in contrast to roads, may be partially occluded, implicitly defined, and exhibit complex connectivity patterns. Existing segmentation-based approaches focus on labeling pixels to infer segments, but often produce disconnected or fragmentary graphs that are unreliable for navigation. We introduce TraversRL, a vision-conditioned model that iteratively grows a pathway network from an aerial image, simulating a traveler navigating the built environment. TraversRL uses an action space of short and long direction-distance segments designed to adapt to complex patterns and span occlusions, and uses a combination of graph-level and step-wise rewards to balance overall connectivity with precise edge placement. Across three visual backbones and three intersection datasets, TraversRL substantially improves buffered IoU with the ground-truth graph relative to a state-of-the-art segmentation baseline, and more than doubles metrics of connectivity. Moreover, combining global and local rewards produces cleaner graphs with fewer spurious branches while further improving overall performance. These results demonstrate that modeling pathway extraction as a sequential decision process from the perspective of a traveler, while optimizing for final graph quality with reinforcement learning, produces significantly more reliable pedestrian networks.

[93] FlexiGrad: Adaptive Gradient Modulation for Hierarchical Fine-Grained Classification cs.CVPDF

Zilu Zhou, Dongliang Chang, Junhan Chen, Zhanyu Ma

TL;DR: 本文提出FlexiGrad，一种自适应梯度调制方法，用于解决细粒度分类中因层次标签（如目、科、种）联合优化导致的梯度冲突问题。该方法在反向传播中通过无参数的层次感知加权函数，消除有害的冲突梯度分量并增强共享方向，从而稳定训练并提升多粒度分类精度。

Details

Motivation: 细粒度识别任务常包含层次化标签，但联合优化所有层级会导致粗粒度和细粒度分类器对共享主干网络施加不一致的梯度，引发训练不稳定和层次梯度冲突，阻碍模型学习连贯的从粗到细的表征。

Result: 在CUB-200-2011、FGVC-Aircraft和Stanford Cars等细粒度分类基准上，FlexiGrad无需修改现有架构即可提升多粒度分类准确率。

Insight: 创新点在于提出了一种简单、无参数的梯度调制机制，通过层次感知的平滑加权动态调节梯度交互，在任务分歧时仅移除有害冲突分量，在部分一致时强化共享方向，从而协调多层级优化并保留全局结构和细粒度判别线索。

Abstract: Many fine-grained recognition tasks contain hierarchical labels such as order, family and species. Although this supervision should be beneficial, jointly optimising all levels often leads to unstable training because coarse and fine classifiers impose inconsistent gradients on the shared backbone. This hierarchical gradient conflict prevents the model from learning a coherent coarse-to-fine representation. In this paper, we propose FlexiGrad, a simple and parameter-free method that regulates gradient interactions during backpropagation. FlexiGrad removes only the harmful conflicting component when tasks disagree and reinforces the shared direction when they partially agree through a smooth hierarchy-aware weighting function. This produces stable optimisation and preserves both global structure and fine-grained discriminative cues. FlexiGrad integrates into existing architectures without modification while improves multi-granularity accuracy on CUB-200-2011, FGVC-Aircraft and Stanford Cars. The code will be available at PRIS-CV/FlexiGrad.

[94] Generative Transmission: Rethinking Computation, Bandwidth, and Memory in Communication cs.CVPDF

Xiangyu Chen, Jixiang Luo, Yuankai Fan, Haibin Huang, Chi Zhang

TL;DR: 本文提出了一种名为生成式传输（GenTrans）的视频通信方法，旨在解决超低带宽和弱网络条件下传统视频编码与传输方法在视觉可用性、传输效率和链路鲁棒性之间难以平衡的问题。该方法基于生成式视频压缩（GVC），将视频传输重新定义为涉及带宽、计算和内存的联合优化问题，而非单纯的信号编码任务。通过利用生成先验、跨片段内存重用、运行时状态重用和弱网络感知传输，GenTrans显著降低了传输开销，同时实现了视觉连贯且实用的重建。

Details

Motivation: 在AI Flow框架下，通信正从传输保真度导向的信息流转向跨异构网络资源传递任务导向和感知导向的令牌流。传统视频编码方法主要针对像素级保真度优化，在超低带宽和弱网络条件下难以平衡视觉可用性、传输效率和链路鲁棒性。随着生成模型的快速发展，视频通信也从精确信号重建转向接收端感知效用和系统级可用性。

Result: 实验结果表明，GenTrans在超低码率和弱网络条件下支持有效的视频传输，在保持感知质量的同时，实现了传输效率、解码效率和鲁棒性的提升。

Insight: 论文的核心创新在于将视频传输重新定义为带宽、计算和内存的联合优化问题，而不仅仅是信号编码。具体技术亮点包括利用生成先验进行压缩、跨片段内存重用以减少冗余、运行时状态重用提升解码效率，以及弱网络感知传输增强鲁棒性。这为未来面向感知和任务的通信系统设计提供了新思路。

Abstract: Under the AI Flow framework, communication is shifting from transmitting fidelity-oriented information flows toward delivering task-oriented and perception-oriented token flows across heterogeneous network resources. Video communication is a fundamental component of modern information networks. However, under ultra-low-bandwidth and weak-network conditions, conventional video coding and transmission methods, which are primarily optimized for pixel-level fidelity, often struggle to balance visual usability, transmission efficiency, and robustness to unstable links. With the rapid advancement of generativemodels, video communication is also moving from precise signal reconstruction toward receiver-side perceptual utility and system-level usability. In this paper, we propose Generative Transmission (GenTrans) for video communication under ultra-low-bandwidth and weak-network conditions. Built upon Generative Video Compression (GVC), GenTrans formulates video transmission as a joint optimization problem involving bandwidth, computation, and memory, rather than treating it merely as a signal coding task. By leveraging generative priors, cross-clip memory reuse, runtime state reuse, and weak-network-aware transport, GenTrans significantly reduces transmission overhead while enabling visually coherent and practically useful reconstruction. Experimental results show that GenTrans supports effective video transmission under ultra-low-bitrate and weak-network conditions, achieving improved transmission efficiency, decoding efficiency, and robustness while preserving perceptual quality.

[95] Hierarchy-Aware and Anatomy-Guided Learning for Lung Ultrasound Video Classification cs.CV | cs.AIPDF

Alya Almsouti, Lotfi Mecharbat, Noha Aboukhater, Yousef Alabrach, Siddiq Anwar

TL;DR: 本文提出了一种用于肺部超声（LUS）视频多分类的深度学习框架，该框架结合了层次感知训练和解剖学引导学习。通过引入层次化训练策略和胸膜线掩码监督，引导模型关注解剖相关区域，以提高分类性能并增强模型的可解释性。

Details

Motivation: 肺部超声是评估心力衰竭或肾功能不全患者肺水肿的重要床边工具，但其自动化分析因斑点噪声、成像伪影和操作者依赖性采集差异而面临挑战。本文旨在开发一个鲁棒且可解释的LUS视频分类方法。

Result: 在包含1,886个视频的公开数据集上，使用患者级五折交叉验证进行评估。结果表明，层次感知训练改善了病理类别间的区分度，而掩码引导的注意力监督实现了最高的平均宏观F1分数65.7%，并产生了更局部的注意力模式。在外部COVID-BLUeS数据集上的迁移实验也显示出具有竞争力的、参数高效的适应能力。

Insight: 主要创新点在于将临床结构化的层次化训练目标与解剖学引导的注意力监督相结合。这提供了一种实用的方法，既能提升模型在复杂医学影像任务上的性能，又能增强其可解释性，使模型注意力更集中于胸膜线等关键解剖结构。

Abstract: Lung ultrasound (LUS) is a bedside tool for assessing pulmonary edema in patients at risk due to heart failure or impaired kidney function. However, automated LUS analysis remains challenging because of speckle noise, imaging artifacts, and operator-dependent acquisition variability. In this work, we present a deep learning framework for multi-class LUS video classification that explores two components: hierarchy-aware training, and anatomy-guided learning. Starting from a strong baseline, we introduce hierarchical training strategies and then introduce pleural line mask supervision to guide model attention toward anatomically relevant regions. We study four clinically relevant classes–healthy, B-lines, consolidations, and mixed B-lines with consolidations–using an open-access dataset of 1,886 videos from 219 patients, evaluated with patient-level five-fold cross-validation. Results show that hierarchy-aware training improves pathological separation relative to flat classification, while mask-guided attention supervision achieves the highest mean macro-F1 of 65.7% and produces more localized attention patterns. Transfer experiments on the external COVID-BLUeS dataset further show competitive and parameter-efficient adaptation while preserving pleural-focused attention behavior. These findings suggest that combining clinically structured objectives with anatomy-guided supervision is a practical approach to robust, interpretable LUS video analysis. Code and model implementations are available at https://github.com/Alya-Almsouti/LUS-video-classification.

[96] ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning cs.CVPDF

Ting Huang, Zhenyu Zhang, Wenyuan Huang, Jian Yang, Hao Tang

TL;DR: 论文提出ConsiSpace框架，通过几何一致性感知来解决视频空间推理问题。该框架将空间一致性转化为证据组织原则和显式的监督微调后学习信号，构建了包含隐式证据令牌和显式几何线索的几何一致性记忆，并利用统一的一致性自监督强化学习来提高跨视图推理的稳定性。

Details

Motivation: 现有多模态大语言模型（MLLMs）主要关注语义，难以从冗余的视频观察中可靠地聚合一致的空间证据，导致视频空间推理效率低下或不稳定。论文旨在解决模型在变化视角下进行长时程空间关系推理时证据聚合不可靠的问题。

Result: 在VSI-Bench、OSI-Bench和MMSI-Video-Bench三个空间推理基准测试上进行了广泛实验，ConsiSpace框架相比最强基线平均得分提高了12.6分，取得了显著的性能提升。

Insight: 创新点在于将几何一致性作为核心设计原则，构建几何一致性记忆（GCM）来紧凑保存任务相关空间证据，并提出统一的一致性自监督强化学习（UC-SSRL）方法，通过答案、度量和拓扑一致性奖励来增强模型的跨视图稳定性。从客观角度看，该工作强调了在视频理解中显式建模几何一致性的重要性，为多模态模型的空间推理能力提升提供了新思路。

Abstract: Video spatial reasoning is essential for navigation-oriented perception and long-video question answering, where models must infer spatial relations across long horizons under changing viewpoints. However, existing multimodal large language models (MLLMs) remain largely semantic-centric, and often fail to reliably aggregate consistent spatial evidence from redundant video observations, leading to inefficient or unstable reasoning. To address these issues, we propose ConsiSpace, a geometry-consistency-aware framework for geometry-sensitive video spatial reasoning that turns spatial consistency into both an evidence organization principle and an explicit post-SFT learning signal. We build a geometry-consistent memory (GCM) including implicit evidence tokens and explicit geometric cues, and leverage efficient organization strategies to compactly preserve task-related spatial evidence. Furthermore, we utilize unified consistency self-supervised reinforcement learning (UC-SSRL) after supervised fine-tuning to improve cross-view stability, with answer-, metric-, and topology-consistency rewards. Extensive experiments on three spatial-reasoning benchmarks, VSI-Bench, OSI-Bench, and MMSI-Video-Bench, show consistent gains, improving the average score by 12.6 points over the strongest baselines.

[97] Pixel-Space Diffusion Transformers cs.CVPDF

Renye Yan, Jikang Cheng, You Wu, Ling Liang, Wei Peng

TL;DR: 本文综述了像素空间扩散变换器（pDiTs）的研究进展，重点探讨了直接在像素空间进行扩散建模以克服潜在扩散模型（LDMs）局限性的方法。论文从模型架构、连续生成机制和统一多模态建模三个角度进行回顾，总结了代表性方法、关键技术挑战以及未来构建集成生成与理解的高保真端到端视觉基础模型的方向。

Details

Motivation: 潜在扩散模型（LDMs）虽然高效，但其固定的视觉分词器会丢失精细纹理和结构细节，且其表示学习与扩散训练分离导致重建与生成目标不匹配。这促使研究者重新关注直接在像素空间建模的扩散方法，以消除VAE瓶颈、支持端到端优化，并更好地满足高保真生成的需求。

Result: 摘要未提及具体的定量实验结果或基准测试排名，但指出像素空间建模为构建统一的多模态系统提供了有前景的基础，能够在共享的令牌空间中联合处理原始像素、文本和任务条件。

Insight: 核心创新点在于倡导并系统性地回顾了直接在像素空间进行扩散建模的范式转变，这有望移除VAE瓶颈、实现端到端优化，并作为统一视觉理解与生成的共享基础。从客观角度看，将原始像素、文本等多模态输入统一到单一Transformer处理的共享令牌空间，是迈向集成式视觉基础模型的关键技术洞察。

Abstract: Latent diffusion models (LDMs) enable efficient high-resolution image synthesis by denoising in a VAE-compressed latent space. However, fixed visual tokenizers can discard fine textures and structural details, while separate representation and diffusion training creates a mismatch between reconstruction and generation objectives. These limitations have renewed interest in pixel-space diffusion, which models raw pixels directly, removes the VAE bottleneck, and supports end-to-end optimization. This formulation better matches the demands of high-fidelity generation but introduces challenges in high-dimensional modeling, including noise scheduling, loss weighting, token efficiency, and scalable architecture design. Pixel-space modeling also offers a promising basis for unified multimodal systems: raw pixels, text, and task conditions can be represented in a shared token space and jointly processed by a single Transformer, narrowing the gap between visual understanding and generation. This paper reviews Pixel-Space Diffusion Transformers (pDiTs) from the perspectives of model architecture, continuous generative mechanisms, and unified multimodal modeling. We summarize representative methods, identify key technical challenges, and discuss future directions toward high-fidelity, end-to-end vision foundation models that integrate generation and understanding.

[98] Rarity-Aware Discrete Diffusion with Spatially Consistent Decoding for Photo-Realistic Image Super-Resolution cs.CVPDF

Ao Li, Yapeng Du, Yi Xin, Lei Zhu, Le Zhang

TL;DR: 本文提出DiMOO-SR，一种用于照片级真实感图像超分辨率的稀有性感知多模态离散扩散框架。该方法通过逆频率采样（IFS）在训练中优先处理信息丰富但出现频率低的视觉标记，并通过空间一致性排序（SCR）在推理中利用局部邻域一致性来优化标记置信度，以提高结构连贯性。

Details

Motivation: 连续扩散模型是当前照片级真实感图像超分辨率（SR）的主流方法，但其基于连续信号去噪的范式难以直接利用现代多模态模型基于统一标记的扩展能力。自回归模型虽能提供更原生的语义表示，但其因果解码对高分辨率重建效率低下。离散扩散模型在视觉标记上实现非因果、并行预测，是一个有前景的折中方案，但直接应用于SR面临两个特定挑战：视觉标记的长尾分布（稀有但感知关键的纹理表征不足）和空间不一致的并行解码（可能引入孤立伪影）。

Result: 在广泛使用的真实世界超分辨率基准测试上进行的大量实验表明，DiMOO-SR仅需少量并行解码步骤即可实现具有竞争力的感知质量。

Insight: 创新点在于针对超分辨率任务中离散扩散模型的两个关键挑战（长尾分布和空间不一致性）提出了针对性解决方案：训练阶段的逆频率采样（IFS）和推理阶段的空间一致性排序（SCR）。这为生成式图像超分辨率探索离散扩散模型的潜力提供了新思路，特别是在利用多模态模型的统一标记化范式方面。

Abstract: Continuous diffusion models have become the dominant paradigm for photo-realistic image Super-Resolution (SR), but they typically formulate reconstruction as continuous signal-level denoising and incorporate semantic priors through external conditioning modules. This makes it less direct to exploit the unified token-based scaling paradigm of modern multimodal models. Autoregressive models provide a more native semantic representation by modeling images as discrete visual tokens, yet their causal decoding is inefficient for high-resolution reconstruction. Discrete diffusion offers a promising middle ground by enabling non-causal, parallel prediction over visual tokens. However, directly adapting discrete diffusion to SR remains non-trivial due to two task-specific challenges: (1) the long-tailed distribution of visual tokens, which under-represents rare but perceptually critical textures; and (2) spatially inconsistent parallel decoding, which may introduce isolated artifacts. To address these issues, we propose DiMOO-SR, a rarity-aware multimodal discrete diffusion framework for photo-realistic image SR. During training, Inverse Frequency Sampling (IFS) prioritizes under-represented but information-rich tokens. During inference, Spatial Consistency Ranking (SCR) refines token confidence using local neighborhood agreement to improve structural coherence. Extensive experiments on widely used real-world SR benchmarks demonstrate that DiMOO-SR achieves competitive perceptual quality with only a few parallel decoding steps, highlighting the potential of discrete diffusion for generative image super-resolution. The code will be released upon publication.

[99] Scalable Model-Assisted Multi-Target Estimation in Large Image Collections cs.CVPDF

Max Hamilton, Jinlin Lai, Daniel Sheldon, Subhransu Maji

TL;DR: 本文提出了一种可扩展的模型辅助多目标估计框架，用于从大规模图像集合中同时估计多个群体级数量（如类别计数或比例）。该框架通过结合有偏的计算机视觉模型预测和有限的人工标注，利用调查抽样中的采样与估计策略，为科学应用提供具有统计保证的无偏估计。

Details

Motivation: 现有基于蒙特卡洛的方法主要解决单标量估计问题，而科学应用常需同时估计多个目标（如多类别计数），且模型预测误差会引入偏差，缺乏统计保证。本文旨在扩展该框架以处理多目标估计问题。

Result: 在包含7至80个类别的五个检测和分割数据集上的评估表明，在中等标注预算或目标较少时，重要性采样表现优异；而在估计大量目标或标注极少时，带控制变量的均匀采样更优；基于子集的比率估计器在所有情况下都保持高度竞争力。

Insight: 创新点在于将调查抽样中的多目标估计策略（如重要性采样、控制变量、比率估计）适配到计算机视觉的模型辅助测量框架中，实现了从单标量到多目标估计的泛化，为科学测量提供了可扩展且具有统计保证的解决方案。

Abstract: Computer vision models are increasingly used as measurement tools to estimate population-level quantities from large image collections, but prediction errors introduce bias and the resulting estimates lack statistical guarantees required in scientific applications. Prior work uses a Monte Carlo framework to combine model predictions with ground-truth annotations by sampling some images for humans to label and is able to provide unbiased estimates with controllable accuracy, but primarily addresses single-scalar estimation. We study the more general problem of multi-target estimation, where many quantities (e.g., class counts or proportions) must be estimated simultaneously, and adapt sampling and estimation strategies from survey sampling to this setting. Evaluations on five detection and segmentation datasets with 7-80 classes show that importance sampling excels with moderate annotation budgets or fewer targets, whereas uniform sampling with control variates is superior when estimating many targets or operating with minimal labels. Additionally, a subset-based ratio estimator remains highly competitive across all regimes. Ultimately, our framework effectively combines biased model predictions and limited human labels into rigorous scientific measurements.

[100] Reviving Ancient Paintings via Poem: A Colorization Framework for Aligning Cultural Semantics cs.CVPDF

Junming Gao, Biao Zhu, Xiaosong Wang, Tan Tang

TL;DR: 本文提出PoemColor，一个基于诗歌引导的古画着色框架，旨在通过诗歌的文化语义对齐来恢复古画的真实色彩。该方法通过Poetic Painting Projector将诗歌隐式语境转换为古典色彩感知条件，并利用Structure-Aware Semantic Attention调控色彩语义的注入方式，从而减少现代语义偏差和色彩泄漏问题。

Details

Motivation: 古画的不可逆褪色破坏了’诗画合一’的核心美学原则，而现有基于扩散模型的着色方法存在视觉恢复的模糊性、现代语义偏差、过饱和和跨边界色彩泄漏等问题，难以实现历史真实的色彩恢复。

Result: 在构建的混合修复数据集上进行广泛实验，结果表明PoemColor显著优于现有最先进方法，实现了可控的着色效果，既恢复了历史真实性，又复活了诗歌语义。

Insight: 创新点在于通过诗歌到调色板的预训练减少诗歌到色彩映射的模糊性，并结合结构感知的语义注意力机制调控色彩语义的传播方向和区域注入强度，从而将诗歌文化语义与绘画修复对齐；同时，混合数据集结合了合成退化和专家修复的文物，提供了可扩展的监督和真实的古典色彩参考。

Abstract: The irreversible fading of ancient paintings disrupts the “congruence between poems and paintings”, a core aesthetic principle where visual imagery harmonizes with literary inscriptions. Although diffusion models provide strong generative priors, restoring historically faithful colors remains difficult: visual restoration is inherently ambiguous, while direct text guidance often causes modern semantic bias, over-saturation, and cross-boundary color leakage. To address this, we propose PoemColor, a poem-guided ancient painting colorization framework. Our method aligns poetic cultural semantics with painting restoration through two key designs. First, the Poetic Painting Projector (P3) converts implicit poetic context into a classical color-aware condition via poem-to-palette pretraining, reducing the ambiguity of poem-to-color mapping. Second, Structure-Aware Semantic Attention (SASA) regulates how poetic color semantics are injected into the diffusion backbone by jointly controlling their propagation direction and regional injection strength. In addition, we construct a hybrid restoration dataset that integrates synthetic degradation with expert-restored artifacts, providing both scalable supervision and real classical color references. Extensive experiments demonstrate that our framework significantly outperforms state-of-the-art methods, delivering controllable colorization that revives both historical authenticity and poetic semantics.

[101] Direct Clinical Joint Angle Extraction from Parametric Body Model Rotation Matrices cs.CV | q-bio.QMPDF

Joey Páolo Kardolus, Daan Hendriks, Jaap Jansen

TL;DR: 本文提出了一种直接从参数化人体模型旋转矩阵中提取临床关节角度的方法，无需逆向运动学或肌肉骨骼模型拟合步骤。该方法在OpenCap LabValidation数据集上，使用GEM-X身体模型估计器处理单智能手机视频，对15个关节角度的平均绝对误差为4.50度，与OpenCap Monocular的4.8度精度相当，但流程更简单。该方法仅需一个校准表，可实时运行，且无需额外输入（如身高、相机内参），适用于临床、家庭、远程康复和大规模分散研究。

Details

Motivation: 解决常规护理中定量关节角度测量工具速度慢、成本高或局限于实验室的问题，旨在简化从视频中提取临床关节角度的流程。

Result: 在OpenCap LabValidation队列上，使用GEM-X模型对单智能手机视频的15个关节角度平均绝对误差为4.50度，与OpenCap Monocular的4.8度精度相当；在SAM 3D Body模型上仅调整校准表后误差为4.66度，统计上无差异，且可实时处理单摄像头流。

Insight: 创新点在于通过校准表直接映射参数化人体模型的旋转矩阵到临床关节角度，避免了复杂的优化步骤，实现了流程简化、实时性和模型通用性，降低了运动分析的门槛。

Abstract: Quantitative joint angles are rarely available in routine care because the tools are slow, costly, or confined to a laboratory. We show that clinical joint angles can be read directly from the per-segment rotation matrices a parametric body model already produces, with no inverse-kinematics or musculoskeletal-model fitting step. On the OpenCap LabValidation cohort, using the GEM-X body-model estimator on single-smartphone video, our pooled mean absolute error is 4.50 degrees over the fifteen joint angles that match the OpenCap Monocular reference set, the same accuracy range as OpenCap Monocular’s 4.8 degrees on the same cohort and reference standard, from a much simpler pipeline. The step that connects a body model to clinical angles is a small calibration table rather than an optimisation, so the same procedure transfers unchanged to other body models: repeating it on SAM 3D Body, changing only the table, gives 4.66 degrees, statistically indistinguishable from GEM-X, and runs in real time from a live single-camera stream. The method needs no per-recording inputs beyond the video itself: no participant height, no camera-intrinsics database, no per-subject model scaling. This broadens where movement analysis is practical, from in-clinic and at-home recording to telerehabilitation and large-scale decentralised studies.

[102] Brain-Aligned Multi-Stream Video Transformers with Sparse Self-Selection cs.CV | cs.LGPDF

Amir Hosein Fadaei, Mahyar Maleki, Mohammad-Reza A. Dehaqani

TL;DR: 本文提出了一种受灵长类视觉启发的多流视频Transformer模型，通过稀疏赢家通吃令牌选择模块替代密集自注意力，并设计了高分辨率低帧率的’what’流与低分辨率高帧率的’where’流双通路融合架构。该模型在Kinetics-400和Something-Something V2数据集上实现了精度与推理时间的帕累托前沿，同时通过表征相似性分析验证了其与脑电信号的高度对齐。

Details

Motivation: 现有视频Transformer通常忽略灵长类视觉原理且缺乏神经数据验证，限制了其生物可解释性。本文旨在构建更高效且与大脑视觉处理机制对齐的视频理解模型。

Result: 在Kinetics-400和Something-Something V2基准测试中，模型在同等规模和预训练条件下达到精度-推理时间的帕累托前沿，对空间扰动具有更强鲁棒性。通过EEG表征相似性分析，模型获得0.18的峰值脑模型相关性（达到噪声上限的78%），显著优于现有视频Transformer基线。

Insight: 创新点包括：1）稀疏赢家通吃令牌选择机制模拟生物视觉竞争路由；2）神经启发的’what/where’双通路专业化设计与融合策略；3）首次系统利用EEG神经数据验证视频模型与大脑表征的对齐性，为构建生物可解释的AI模型提供了新范式。

Abstract: Modern video transformers typically ignore principles from primate vision and are rarely evaluated against neural data, limiting their biological interpretability. We introduce a sparse winner-takes-all token selection module that replaces dense self-attention to improve efficiency and approximate competitive routing observed in biological visual circuits. We further propose a neuro-inspired split-and-fuse video transformer which uses two complementary pathways: a high-resolution, low-frame-rate “what” stream and a low-resolution, high-frame-rate “where” stream, fused before classification. On Kinetics-400 and Something-Something V2, our best variant operates on the Pareto frontier of accuracy versus inference time among models of comparable scale and pretraining, and showing improved robustness to spatial perturbations. Using representational similarity analysis between model embeddings and time-resolved EEG recordings for the same video stimuli, our model attains a peak brain-model correlation of 0.18 (about 78% of the noise ceiling) and consistently outperforms strong video transformer baselines, suggesting that pathway specialization and sparse competition are useful inductive biases for efficient, brain-aligned video understanding.

[103] LFM: Leveraging Foundation Models for Source-Free Universal Domain Adaptation cs.CV | cs.LG | cs.MMPDF

Jing Li, Pan Liu, Meng Zhao, Wanli Xue, Yanhong Yang

TL;DR: 本文提出了一种名为LFM的框架，用于解决源数据不可用的通用域自适应（SF-UniDA）问题。该框架利用基础模型（特别是视觉语言模型）计算目标样本与文本标签（包括由大型语言模型生成的未知类标签）之间的相似度，通过分析相似度指标的变异系数来确定标签偏移类型，并使用高斯混合模型识别未知样本。在共识策略下，结合源域预训练模型和基础模型的知识来精炼伪标签，并最终训练目标模型。

Details

Motivation: 现有的SF-UniDA方法依赖于阈值调整和聚类等低效技术，而具有强大泛化和零样本能力的基础模型在该领域尚未得到充分探索。本文旨在利用基础模型来更有效地处理SF-UniDA中的协变量偏移和标签偏移问题。

Result: 在涵盖所有可能标签偏移的多个基准测试上进行的广泛实验表明，所提出的LFM框架具有有效性和优越性。

Insight: 创新点在于将视觉语言模型和大型语言模型等基础模型引入SF-UniDA任务，通过基于相似度的指标分析来判定标签偏移类型和识别未知样本，并设计了一种共识策略来整合源域模型和基础模型的知识以精炼伪标签，从而避免了传统方法的低效操作。

Abstract: Source-free universal domain adaptation (SF-UniDA) adapts a pre-trained source model to an unlabeled target domain under both covariate and label shifts, without access to source data. However, existing SF-UniDA methods rely on inefficient techniques such as threshold tuning and clustering. Foundation models (FMs), known for their generalization and zero-shot capabilities, remain underexplored in SF-UniDA. In this paper, we propose a framework that leverages foundation models (LFM) for SF-UniDA. We use a vision-language model (VLM) to compute similarities between target samples and text labels, including those for unknown classes generated by prompting a large language model. The label shift type is determined by analyzing the coefficient of variation of a similarity-based sample-level score. Unknown samples are identified using a binary Gaussian mixture model fitted to another similarity-based metric. Under a consensus strategy, the pseudo-labels generated by the VLM are refined by the target model initialized with the pre-trained source model, integrating knowledge from both the source domain and foundation models. Finally, these refined pseudo-labels are used to train the target model. Extensive experiments across all possible label shifts and multiple benchmarks demonstrate the effectiveness and superiority of our proposed LFM framework. Our code is available at https://github.com/iamjingli/LFM.

[104] ShotPlan: Cinematic Video Generation with Learnable Planning Token cs.CVPDF

Su Guo, Guangce Liu, Haosen Yang, Jiepeng Wang, Cong Liu

TL;DR: ShotPlan是一个基于视频扩散基础模型的框架，用于生成具有明确镜头规划的电影风格视频。该方法引入了可学习的规划令牌来捕捉镜头级过渡线索，并与原始视频生成令牌无缝集成以控制过渡时间戳。实验表明，ShotPlan在电影视频生成方面显著优于现有方法，提供了更灵活的镜头管理和更强的镜头间一致性。

Details

Motivation: 当前视频生成模型在单镜头生成方面取得了显著成果，但在电影视频生成中仍存在局限，因为连贯的叙事和有效的多镜头组合需要明确的镜头规划。

Result: 实验证明，ShotPlan在电影视频生成任务上显著优于现有方法，提供了更灵活的镜头管理和更强的镜头间一致性。

Insight: 创新点在于引入了可学习的规划令牌，并配备了分数时间旋转位置嵌入（FRoPE），使镜头过渡能够在帧级别进行建模，从而实现了对多镜头视频生成的精确控制。

Abstract: Current video generation models achieve impressive results in single-shot generation, yet remain limited in cinematic video generation, where coherent narratives and effective multi-shot composition require explicit shot planning. To address this challenge, we propose ShotPlan, a framework for explicit multi-shot cinematic video generation built upon a video diffusion foundation model. Our method introduces learnable planning tokens that capture shot-level transition cues and can be seamlessly integrated with the original video generation tokens to control transition timestamps. Unlike standard video generation tokens, the proposed planning tokens are equipped with Fractional Temporal Rotary Position Embedding (FRoPE), enabling shot transitions to be modeled at the frame level. Experiments demonstrate that ShotPlan significantly outperforms existing cinematic video generation methods, offering more flexible shot management and stronger inter-shot consistency.

[105] Early Yield Prediction for Sugar Beet Fields using Satellite Data – Learnings from Specialized Vision Transformers cs.CV | cs.LGPDF

Philipp Vaeth, Bhumika Laxman Sadbhave, Denise Dejon, Gunther Schorcht, Magda Gregorova

TL;DR: 本研究利用Sentinel-2卫星光学影像，通过将领域知识与机器学习紧密结合，实现了甜菜产量的早期预测。研究发现，采用非常小的视觉Transformer（ViT）图像块尺寸和所有可用的光谱波段能提升模型性能，并通过改进的训练设置和基于排名的检测方法，在生长周期早期识别出大量低产田块。

Details

Motivation: 解决如何将农业领域知识有效整合到遥感与机器学习方法中，以提升甜菜早期产量预测的准确性和实用性。

Result: 在甜菜产量预测任务中，所提方法在早期生长阶段成功识别出不同年份的大量低产田块，展示了其实际应用潜力。

Insight: 创新点在于将领域知识深度融入模型设计（如小尺寸ViT图像块和全光谱波段利用），并提出了一种改进的训练与基于排名的低产田检测策略，为农业遥感提供了可借鉴的模型架构与实用框架。

Abstract: Remote sensing has become an increasingly valuable tool for agricultural monitoring, particularly through the use of publicly available satellite imagery. However, effectively integrating domain knowledge into machine learning methods remains challenging. This study presents a real-world example of early sugar beet harvest yield forecasting from purely optical Sentinel-2 imagery, demonstrating how a tight integration of domain knowledge and machine learning can lead to synergistic gains. We empirically find that using very small vision transformer patch sizes and all available Sentinel-2 spectral bands improves our model despite being uncommon design choices in the domain. As a practical contribution, we were able to identify a large fraction of low-yield fields in a different year early on in the growth cycle through a modified training setup and a ranking-based detection of underperforming fields.

[106] Attention from Above: A Multimodal Model for Drone-Based Object Localization cs.CVPDF

Hyun-Ki Jung

TL;DR: 本文提出了一种基于多模态的无人机目标检测模型，旨在提升小目标检测性能。该方法在YOLO-World框架基础上，将YOLOv8主干网络中的C2f层替换为基于注意力的A2C2f层，以更精确地表示局部特征，并结合注意力机制与并行处理结构提升计算精度。在VisDrone数据集上的实验表明，模型在精确率、召回率、F1分数和mAP等指标上均优于原始YOLO-World模型。

Details

Motivation: 针对无人机图像中指定目标（如通过文本提示指定）的检测需求，特别是提升小目标或边界清晰目标的检测性能。

Result: 在VisDrone数据集上，精确率从43.0%提升至45.1%，召回率从32.8%提升至35.0%，F1分数从37.2%提升至39.4%，mAP@0.5从32.5%提升至35.2%，mAP@0.5-0.95从18.5%提升至19.9%，均优于原始YOLO-World模型。

Insight: 创新点在于将YOLOv8主干中的C2f层替换为注意力增强的A2C2f层，以更好地捕捉局部特征，特别是小目标特征；结合注意力机制与并行结构，提升了模型的计算精度，为无人机图像中的多模态目标检测提供了高效解决方案。

Abstract: Drone-based object detection technology has advanced rapidly, becoming increasingly sophisticated and efficient. Recently, research trends have expanded beyond the detection of predefined objects toward the identification of specified target objects. For example, desired targets can be specified through textual prompts, enabling accurate detection of objects of interest. To address this demand, this paper proposes an efficient multimodal-based object detection model aimed at improving small object detection performance. The proposed method is built upon the YOLO-World framework and replaces the C2f layers used in the YOLOv8 backbone with attention-based A2C2f layers. This modification enables more precise representation of local features, particularly for small objects or objects with well-defined boundaries. In addition, the incorporation of attention mechanisms and parallel processing structures significantly enhances the model’s computational accuracy. Comparative experiments conducted on the VisDrone dataset demonstrate that the proposed model outperforms the original YOLO-World model. Specifically, precision increases from 43.0% to 45.1%, recall from 32.8% to 35.0%, the F1 score from 37.2% to 39.4%, mAP@0.5 from 32.5% to 35.2%, and mAP@0.5-0.95 from 18.5% to 19.9%, confirming a substantial improvement in detection accuracy. These results verify that the proposed approach provides an effective and highly accurate solution for object detection in drone-based image and video application environments.

[107] BMFA: Boundary-Minority Free-Energy Adaptive Screening cs.CVPDF

Wenyan Xu, Alizer Wong

TL;DR: 本文提出了一种名为边界-少数自由能自适应筛选（BMFA）的方法，旨在解决视觉Transformer在处理空间冗余token时，因粗粒度token摘要无法捕捉高响应但空间范围小的边界-少数区域而导致的低估失败问题。该方法通过构建分层分段常数近似，并基于局部自由能的可计算下界增量递归细化块，以更精确地保留关键证据。

Details

Motivation: 动机在于解决视觉Transformer中存在的边界-少数低估失败问题，即空间小但响应高的区域在指数注意力聚合中贡献主导的吉布斯质量，却在块均值摘要中几乎不可见，这影响了模型对关键信息的捕捉效率。

Result: 在合成测试、COCO和LVIS诊断探针、闭环DeiT-Tiny评估以及ImageNet-1K实验中，BMFA将合成低估均值从2.582降至0.261（叶节点比例为5.794%），将COCO图像边缘平均差距从2.254降至0.526，并在叶节点比例为55.861%时保持71.520%的ImageNet Top-1准确率，展现了方法的有效性。

Insight: 创新点在于从自由能角度形式化分析了边界-少数低估问题，并提出了基于可计算局部自由能下界增量的自适应递归筛选机制，为视觉Transformer的token稀疏化提供了理论指导和实用方法，但当前原型尚未实现已验证的稀疏核加速。

Abstract: Vision Transformers process spatially redundant tokens efficiently only when coarse token summaries preserve the evidence required by exponential attention aggregation. We identify a boundary-minority underestimation failure in which a spatially small, high-response region contributes dominant Gibbs mass while remaining nearly invisible to a block mean. We formalize the failure through the discrepancy between normalized log-mean-exp free energy and mean summarization, prove that minority Gibbs mass can remain non-vanishing as its spatial support and mean contribution vanish, and characterize the limitations of finite-order moment corrections. Building on the resulting analysis, we introduce Boundary-Minority Free-Energy Adaptive Screening (BMFA), which constructs a hierarchical piecewise-constant approximation and recursively refines blocks according to a computable lower-bound increment of local free energy. Controlled synthetic tests, COCO and LVIS diagnostic probes, closed-loop DeiT-Tiny evaluations, and ImageNet-1K experiments establish a consistent evidence chain. BMFA reduces the mean synthetic underestimate from 2.582 to 0.261 at a 5.794% leaf ratio, lowers the COCO image-edge mean gap from 2.254 to 0.526, and preserves 71.520% ImageNet Top-1 accuracy at a 55.861% leaf ratio. The current prototype evaluates selection quality after full QK computation; the reported leaf ratio therefore characterizes representation granularity rather than verified sparse-kernel speedup.

[108] Memory-Supported Synergistic Adaptation for Training-Free Test-Time Medical Image Segmentation cs.CVPDF

Lingrui Li, Nan Pu, Dong Zhao, Wenjing Li, Andrew P French

TL;DR: 本文提出了一种名为记忆支持协同适应（MSSA）的新型免训练测试时适应（TTA）框架，用于解决医学图像分割任务中的分布偏移问题。该方法通过动态构建在线记忆库，利用可靠的图像-文本预测作为语义先验，并结合跨图像结构对齐来实现鲁棒的适应，避免了因更新模型参数而导致的预训练特征退化。

Details

Motivation: 动机在于将基于视觉语言模型（VLM）的测试时适应（TTA）从分类任务扩展到医学图像分割时面临挑战：基于噪声预测的更新驱动学习会损害VLM强大的预训练特征，导致改进有限且不稳定。

Result: 在多个医学图像分割基准测试上的广泛实验表明，MSSA能持续提升基于VLM的分割模型性能，并显著优于现有的基于微调的TTA方法，DSC和mIoU指标分别提升高达12.2%和11.7%，达到了新的SOTA水平。

Insight: 创新点在于提出了一种免参数更新的TTA框架，其核心是噪声感知记忆构建模块和相关性驱动的原型对齐模块，通过协同利用可靠的跨模态预测和结构一致性先验来实现稳定、高效的适应，避免了传统TTA方法中特征退化的核心问题。

Abstract: Test-time adaptation (TTA) aims to mitigate distribution shifts by adapting models with unlabeled target data at inference time. While TTA with vision-language models (VLMs) has shown promising results in classification, extending it to medical image segmentation remains challenging. In this setting, the adaptation gains from optimizing on VLM-generated predictions are often outweighed by the degradation to the VLM’s strong pretrained features caused by noisy, update-driven learning, resulting in limited and unstable improvements. We therefore propose Memory-Supported Synergistic Adaptation (MSSA), a novel training-free TTA framework for medical image segmentation. Without updating model parameters, MSSA dynamically selects reliable image-text predictions to construct an online memory, uses them as text-guided semantic priors, and couples them with cross-image structural alignment for robust adaptation. Specifically, MSSA consists of (i) a noise-aware memory construction module that filters and stabilizes cross-modal predictions, and (ii) a relevance-driven prototype alignment module that aligns the target sample with structurally consistent memory samples and their reliable predictions to improve adaptation. Extensive experiments on multiple medical segmentation benchmarks demonstrate that MSSA consistently improves VLM-based segmentation models and outperforms existing fine-tuning-based TTA methods by a clear margin, with gains of up to 12.2% DSC and 11.7% mIoU. Project page: https://lingrayy.github.io/MSSA/ .

[109] CDIS: Cross-Dimensional Class-Agnostic 3D Instance Segmentation via 2D Mask Tracking and 3D-2D Projection Merging cs.CV | cs.AIPDF

Juno Kim, Hye-Jung Yoon, Yesol Park, Byoung-Tak Zhang

TL;DR: CDIS是一个零样本的跨维度类无关3D实例分割框架，通过在2D和3D之间建立反馈循环，显式地跨帧跟踪2D实例掩码并将其与3D超点关联，从而生成全局一致的3D实例标签，无需任何3D特定训练。

Details

Motivation: 解决在未知环境中运行的机器人系统对未见物体的感知需求，现有方法将逐帧2D实例掩码投影到3D并合并，常导致跨时间的物体身份断裂和3D实例碎片化。

Result: 在基准数据集上的实验表明，CDIS比最先进的零样本方法实现了更高的准确性和一致性，同时保持高效性并能扩展到多样化的真实世界环境。

Insight: 核心创新在于建立了2D掩码跟踪与3D超点关联的跨维度推理反馈循环，将时间稳定的2D轨迹与空间连贯的3D区域链接，实现了无需3D训练的全局一致分割。

Abstract: Class-agnostic 3D instance segmentation is critical for robotic systems operating in unknown environments, enabling perception of previously unseen objects for reliable manipulation and navigation. Existing approaches typically project per-frame 2D instance masks into 3D and merge them, which often breaks object identities across time and yields fragmented 3D instances. We introduce Cross-Dimensional Class-Agnostic 3D Instance Segmentation (CDIS), a zero-shot framework that explicitly tracks 2D instance masks across frames and associates them with 3D superpoints, creating a feedback loop between 2D and 3D. This cross-dimensional reasoning links temporally stable 2D tracks with spatially coherent 3D regions, producing globally consistent 3D instance labels without any 3D-specific training. Experiments on benchmark datasets demonstrate that CDIS achieves higher accuracy and consistency than state-of-the-art zero-shot methods, while remaining efficient and scalable to diverse real-world environments.

[110] BrainNext: A General-Purpose Self-Supervised Foundation Model for Brain MRI Analysis cs.CV | cs.AIPDF

Moona Mazher, Abdul Qayyum, Steven A. Niederer, Daniel C. Alexander

TL;DR: 本文提出了BrainNext，一种用于脑部MRI体积分析的自监督基础模型。该模型结合了掩码自编码器（MAE）预训练和三维Bi-Directional xLSTM-UNet架构，从60,551个未标记的脑部MRI扫描中学习丰富的解剖学表征，并通过轻量级任务特定微调适应下游任务。

Details

Motivation: 现有神经影像基础模型存在任务特定训练、基于切片的学习策略或预训练数据集较小等问题，限制了其在多样化脑部MRI应用中的泛化能力，因此需要开发一个通用的自监督基础模型。

Result: 在FOMO 2025方法赛道（涵盖分类、分割和脑龄估计任务）的官方挑战排行榜上，BrainNext获得总排名第二，并在脑膜瘤分割任务中排名第一，展示了其在异构神经影像任务间的强可迁移性。

Insight: 创新点在于将MAE预训练与原生三维Bi-Directional xLSTM-UNet架构结合，进行大规模无标签脑部MRI体积数据学习，证明了大规模自监督预训练能学习到稳健且可迁移的体积表征，为多样化脑部MRI应用建立了可扩展的基础模型。

Abstract: Foundation models pretrained using self-supervised learning have transformed computer vision by learning transferable representations from large-scale unlabeled data. However, existing foundation models for neuroimaging remain limited by task-specific training, slice-based learning strategies, or relatively small pretraining datasets, restricting their generalizability across diverse brain MRI applications. In this work, we present BrainNext, a general-purpose self-supervised foundation model for volumetric brain MRI analysis. BrainNext combines masked autoencoder (MAE) pretraining with a native three-dimensional Bi-Directional xLSTM-UNet architecture to learn rich anatomical representations from 60,551 unlabeled brain MRI examinations spanning multiple MRI modalities. The pretrained model is subsequently adapted to downstream tasks through lightweight task-specific fine-tuning. We evaluate BrainNext on the Foundation Models for Medical Imaging (FOMO) 2025 Method Track, encompassing classification, segmentation, and brain-age estimation, where it achieved second place overall and ranked first in the meningioma segmentation task on the official FOMO 2025 challenge leaderboard, demonstrating strong transferability across heterogeneous neuroimaging tasks. These results highlight the potential of large-scale self-supervised pretraining to learn robust and transferable volumetric representations, establishing BrainNext as a scalable foundation model for diverse brain MRI applications.

[111] Measuring Monosemanticity in Sparse Autoencoders via Latent Activation Coherence cs.CV | cs.AI | cs.LGPDF

Katarzyna Filus, Sebastian Pokuciński

TL;DR: 本文提出了一种名为Tversky Monosemanticity Score (TMS)的无标签度量方法，用于评估稀疏自编码器（SAEs）提取特征的单一语义性（monosemanticity）。该方法通过二值化SAE潜在激活的集合一致性来量化单一语义性，无需外部概念标签或预训练嵌入模型。论文在多种预训练视觉和视觉-语言模型（如DINOv3、CLIP、BLIP2）的特征上训练的SAEs上评估了TMS，并比较了不同稀疏度水平和扩展因子的影响。

Details

Motivation: 在可解释人工智能领域，稀疏自编码器被用于从神经表示中提取更可解释的特征，但评估其单一语义性（即特征是否对应单一概念）仍具挑战性。现有度量方法依赖外部概念标签或预训练嵌入模型，易受编码器几何结构的影响。

Result: 实验结果表明，TMS比基于嵌入的替代方法更少受编码器各向异性的影响，同时与已有的单一语义性指标保持一致。TMS还揭示了不同基础模型上SAE训练动态的差异，并在编码器各向异性条件下，能更强地指示基于探针的概念删除效果。

Insight: 创新点在于提出了一种无需外部标签或嵌入模型的单一语义性度量TMS，它通过激活集合一致性来量化特征解释质量，减少了对编码器几何的敏感性。这为评估和比较不同SAE配置提供了一种更稳健的工具，有助于推动可解释性研究。

Abstract: Within Explainable Artificial Intelligence, mechanistic interpretability uses Sparse Autoencoders (SAEs) to extract more interpretable features from neural representations. However, assessing their monosemanticity, and thus explanation quality, remains challenging. Existing metrics require external concept labels or depend on pretrained embedding models, making them sensitive to encoder’s geometry. We introduce the Tversky Monosemanticity Score (TMS), a label-free metric that operationalizes monosemanticity as activation-set coherence of binarized SAE latents, and does not require external embedding encoders. We evaluate TMS on SAEs trained on features from pretrained vision and vision-language models (DINOv3, CLIP, BLIP2), two common SAE regimes (TopK, BatchTopK), multiple sparsity levels, and expansion factors. Our results show that TMS is less affected by encoder anisotropy than its embedding-based alternative, while remaining aligned with established monosemanticity indicators. TMS also reveals distinct SAE training dynamics across base models. Moreover, under encoder anisotropy, TMS provides a stronger indication of probe-based concept deletion effectiveness, while being competitive otherwise.

[112] Medical Imaging Fusing Vision Transformer: Laryngeal Cancer Screening with Explanation cs.CV | cs.AIPDF

Haiyang Wang, Luca Mainardi

TL;DR: 本研究提出了一种融合视觉Transformer和注意力机制的医学影像分析方法，用于喉癌筛查。该方法通过窄带成像（NBI）内窥镜图像区分良恶性病变，并利用先进的医学图像分割模型（MedSAM）为临床医生提供可解释的病理区域信息。

Details

Motivation: 喉癌的早期及时筛查对改善临床结果至关重要，但当前依赖NBI内窥镜的诊断方法需要训练有素的临床医生，且耗时、存在观察者间差异，因此需要人工智能（AI）来辅助临床决策。

Result: 该方法在喉癌筛查任务中表现出良好的分类性能，F1分数达到82.72%，准确率达到82.33%。

Insight: 创新点在于将Transformer和注意力机制用于NBI图像分析，并融合分类与分割任务，通过MedSAM提供可解释的病理区域，增强了临床决策的可信度和实用性。

Abstract: Early and timely screening of laryngeal cancer is crucial for improving clinical outcomes. In recent years, NBI endoscopy has become a standard diagnostic tool for the detection of laryngeal lesions. However, its effective use requires well-trained clinicians and the procedure is time-consuming and subject to interobserver variability. In this context, the application of artificial intelligence (AI) offers a promising solution to support clinical decision-making. In this work, we proposed applying transformer and attention mechanism for analyzing the narrow band imaging and distinguish benign and malignant lesions. Results show it has good classification performance with F1 (82.72%), accuracy(82.33%). In addition, the result of laryngeal cancer screening is explainable for clinicians. The explainability is utilizing the state of art segmentation method (MedSAM) to provide the useful pathological information area for clinicians. The proposed methodology fusing classification and segmentation provides a translating on laryngeal cancer screening.

[113] ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video cs.CV | cs.AIPDF

Xiaozhong Lyu, Gen Li, Zhiyin Qian, Xucong Zhang, Marc Pollefeys

TL;DR: 本文提出了ReViV，首个从单目RGB视频中统一重建第一人称4D表示（包括观察者和场景动态）的框架。它通过一个掩码生成式第一人称Transformer，在一个前馈架构中同时重建时间一致的观察者（全身运动、手部运动、视线方向）和场景（相机轨迹、深度），实现了快速推理。

Details

Motivation: 现有方法通常依赖预计算相机轨迹等辅助输入，将场景感知和人体自我运动建模视为独立问题，且推理速度慢。ReViV旨在解决这些限制，从单一单目RGB视频中整体重建第一人称4D交互。

Result: 在HoloAssist、HOT3D、ARCTIC、Aria Digital Twin和TACO等多个基准测试上的广泛实验表明，ReViV在整体自我身体、手部和视线重建、相机跟踪方面达到了最先进的精度和效率，同时在无需繁重任务特定先验的情况下保持了极具竞争力的第一人称深度估计性能。

Insight: 核心创新在于将任务形式化为学习多模态信号（RGB视频、相机轨迹、视线、全身运动、手部运动、深度）的完整联合概率分布，并通过一个统一的掩码生成Transformer架构实现高效、同步的重建，解决了现有方法中场景与观察者动态分离建模的问题。

Abstract: Egocentric devices, such as wearable front-facing cameras, provide a unique perspective for capturing the continuous interaction between a human viewer and the surrounding environment. A holistic and efficient multimodal model capable of reconstructing this 4D representation is therefore highly desirable. However, existing approaches often rely on auxiliary inputs such as pre-computed camera trajectories, treat scene perception and human ego-motion modeling as separate problems despite their strong interdependency, and suffer from slow inference time. To address these limitations, we present ReViV, the first unified framework for holistic egocentric 4D reconstruction that extracts both viewer and view dynamics from a single monocular RGB video. We formulate the task as learning the full joint probability distribution over multimodal signals, including RGB video, camera trajectory, gaze direction, full-body motion, hand motion, and depth. Powered by a Masked Generative Egocentric Transformer, ReViV operates within a single feed-forward architecture to simultaneously reconstruct the temporally consistent 4D reconstruction across the viewer and the view with fast inference speed. Extensive experiments on diverse benchmarks, including HoloAssist, HOT3D, ARCTIC, Aria Digital Twin, and TACO, demonstrate that ReViV achieves state-of-the-art accuracy and efficiency across holistic ego-body, hand, and gaze reconstruction, camera tracking, while maintaining highly competitive egocentric depth estimation without relying on heavy task-specific priors. Code and models are fully open-sourced: https://reviv4d.github.io/.

[114] Vis2Reg: Visibility-Aware Landmark-Free Geometric 3D–2D Registration for Liver Laparoscopy cs.CV | cs.AI | cs.HCPDF

Jiaming Feng, Xukun Zhang, Shahid Farid, Sharib Ali

TL;DR: 本文提出了Vis2Reg，一种用于肝脏腹腔镜手术的可见性感知、无地标几何3D-2D配准框架。该框架通过显式约束掩码一致的可见区域变形，并引入基于可微分点栅格化和掩码引导反投影的可见域自监督信号，以解决严重遮挡和缺乏3D真值监督下的鲁棒配准问题。

Details

Motivation: 解决腹腔镜手术中，由于严重遮挡、视野有限以及缺乏3D真值监督，导致术前3D模型与术中部分表面观测之间进行精确配准的挑战。现有无地标方法在极端部分可见性下的鲁棒自监督仍然困难。

Result: 在真实术中数据集上，Vis2Reg达到了92.6%的Dice分数和1.43 mm的Chamfer距离，每帧推理时间为111毫秒，在准确性和实际效率上均表现出色。

Insight: 核心创新在于提出了可见性感知的自监督机制，通过术中掩码推导可见域的3D监督信号，从而在严重遮挡下提升鲁棒性。结合鲁棒的几何刚性初始化模块与隐式神经变形场，实现了稳定且完全自监督的配准框架。

Abstract: Accurate 3D–2D liver registration, which aligns preoperative 3D models to partial, view-dependent intraoperative surface observations, is critical for AR-guided laparoscopic surgery but remains challenging due to severe occlusion, limited visibility, and the lack of 3D ground-truth supervision. Existing landmark-free approaches perform partial-to-complete geometric alignment, yet robust self-supervision under extreme partial visibility remains difficult. We propose Vis2Reg, a visibility-aware registration framework that explicitly constrains deformation using mask-consistent visible regions. We introduce a visibility-aware self-supervision that derives a visible-domain 3D supervision signal from intraoperative masks, enabled by differentiable point rasterization and mask-guided back-projection. This formulation improves robustness under severe occlusion while maintaining fully self-supervised learning. Vis2Reg combines a robust geometric rigid initialization module with an implicit neural deformation field for stable alignment. Vis2Reg achieves a Dice score of 92.6% and a Chamfer Distance of 1.43 mm on real intraoperative datasets, with 111 ms per-frame inference time, demonstrating both accuracy and practical efficiency.

[115] Consistent Feature Transport for Image Relighting cs.CVPDF

Bohan Zhang, Huanwei Liang, Yuhan He, Hongteng Xu, Quxiao Chao

TL;DR: 本文提出了一种名为一致特征传输（CFT）的训练原则，将图像重光照问题重新表述为光照特征传输问题。该方法基于整流流，通过轨迹级监督联合建模噪声到图像的生成以及源图像到目标图像的光照一致传输，旨在稳定地改变光照并保持非光照内容的一致性。

Details

Motivation: 现有基于扩散模型的重光照方法在复杂光照下常出现光照变化不稳定或内容保存不一致的问题，因为它们缺乏学习图像间特征变换的显式机制。

Result: 实验表明，该方法在构建的大规模人像重光照数据集上，相比现有最先进的重光照方法取得了持续改进，并能泛化到风格迁移等其他编辑任务。

Insight: 核心创新在于将重光照定义为光照特征传输问题，并提出了CFT这一显式强制光照一致传输的训练原则，其双传输公式有助于分离光照特定变化并保留内容对齐特征。

Abstract: Image relighting modifies illumination while preserving non-lighting content such as identity and geometry. Existing diffusion-based methods often suffer from unstable illumination changes or inconsistent content preservation under complex lighting, as they lack an explicit mechanism to learn feature transformations between images. We reformulate relighting as an illumination feature transport problem and introduce Consistent Feature Transport (CFT), a training principle that explicitly enforces illumination-consistent transport between source and target image distributions. Built upon rectified flow, CFT jointly models noise-to-image generation and illumination-consistent source-to-target transport through trajectory-level supervision. This dual-transport formulation encourages isolation of illumination-specific variations while preserving content-aligned features. To support complex lighting scenarios, we construct a large-scale portrait relighting dataset with diverse relighting effects. Experiments show consistent improvements over existing state-of-the-art relighting approaches and demonstrate that CFT can generalize to other editing tasks, including style transfer. Code is available at https://github.com/Dixin-Lab/CFT.

[116] PRiSM: Prototype Regularization for Few-Shot VLMs cs.CVPDF

Ghassen Baklouti, Omprakash Chakraborty, Jose Dolz, Ismail Ben Ayed

TL;DR: 本文提出了PRiSM方法，一种用于少样本视觉语言模型的原型正则化技术。作者首先质疑了现有少样本适应方法对数据类别平衡的强假设，并引入了一个更现实的、通过狄利克雷采样改变类别平衡和有效类别数量的新基准。在该基准下，现有SOTA方法性能显著下降。PRiSM作为一个即插即用的模块，通过优化一个包含最大化类间距离正则项的多项损失函数，显著提升了基线方法的性能。

Details

Motivation: 现有训练无关的少样本适应方法及其基准依赖于类别平衡等简化假设，这与现实场景不符。本文旨在解决在更现实的、存在类别不平衡和类别数量变化的少样本任务中，现有方法性能显著下降的问题。

Result: 在引入的新基准上进行大量实验表明，PRiSM显著提升了多个训练无关基线方法的性能，尤其是在处理严重类别不平衡和类别数量较多的情况下，取得了大幅度的性能增益。

Insight: 主要创新点包括：1）提出了一个更现实的、通过狄利克雷采样模拟类别不平衡和类别数量变化的少样本评估基准；2）设计了PRiSM原型正则化方法，其核心是一个包含类间距离最大化、支持特征对齐和基线原型保真度的多目标损失函数；3）为优化该目标，提出了一种计算高效的块Majorize-Minimize优化器，并利用Gershgorin圆盘定理高效计算块Lipschitz常数。

Abstract: Training-free few-shot adaptation methods have gained significant attention recently in the context of Vision-language Models (VLMs). Yet, current benchmarks rely on strong assumptions about the statistics of the adaptation data, e.g., class balance. We question these simplifying assumptions and introduce a more realistic benchmark that varies both the levels of class balance and the effective number of classes in few-shot tasks via Dirichlet sampling. Surprisingly, under our setting, we observe substantial drops in the performances of state-of-the-art methods, more so when the number of labeled samples increases. To mitigate this, we introduce PRiSM, a class-prototype regularization that can be deployed as a plug and play module on top of any existing baseline method, significantly improving performances. Our method optimizes a novel multi-term loss, which includes a regularizer maximizing inter-class pairwise distances, along with additional terms promoting support-feature alignment and fidelity to the baseline prototypes. Furthermore, we introduce an effective and computationally efficient block Majorize-Minimize optimizer for our objective. More specifically, we derive a valid blockwise Lipschitz constant (i.e., a bound on the Hessian’s spectral norm), which can be computed efficiently via the Gershgorin circle theorem. Extensive experiments show that PRiSM improves several training-free baselines, with large gains when dealing with severe class imbalance and high numbers of classes.

[117] Keyframe-Anchored Identity Preservation for Sequential-Action Video Generation cs.CV | cs.MMPDF

Zhenjie Liu, Binyan Chen, Hao Chen, Tong Pan, Shangfei Wang

TL;DR: 该论文提出了一种名为Keyframe-Anchored Identity Preservation的三阶段无训练框架，用于解决时序动作视频生成中的身份保持问题。该方法首先通过动作感知提示优化将时序动作描述重写为图像生成提示，然后通过身份保持生成阶段生成关键帧序列，最后利用身份感知推理增强阶段合成中间帧，以在生成一系列指定动作的视频时保持主体身份的一致性。

Details

Motivation: 动机是解决IPVG26挑战中提出的时序动作视频生成任务的核心难题：在主体连续执行一系列脚本化动作时，如何防止端到端视频生成器因动作累积和变化而导致的外观漂移，从而保持主体身份在整个视频中的可识别性。

Result: 该方法在IPVG26挑战赛的官方Track 2排行榜上排名第三，展示了具有竞争力的性能和强大的泛化能力。

Insight: 创新点在于提出了一个无训练的三阶段流水线框架，通过将时序动作描述解耦为关键帧生成和中间帧插值，并引入基于参考身份和前驱帧的联合条件生成、多参考引导和身份驱动的噪声搜索等技术，有效分离了时不变的外观和时变的姿态，从而在复杂时序动作序列中稳定地保持了身份一致性。

Abstract: Identity-preserving text-to-video generation aims to synthesize a video that accurately follows a textual description while maintaining the recognizability of a user-specified subject throughout. The IPVG26 challenge extends this framework from a single holistic prompt to a temporally structured specification. The model additionally receives a sequence of timestamped action captions and must render the subject performing these actions in the specified order. This temporal structure presents a challenge not encountered in previous identity-preserving generation tasks, as the subject must continuously perform a scripted sequence of distinct actions while maintaining a consistent identity. However, end-to-end video generators are prone to appearance drift as motion accumulates and the depicted actions change. We address this challenge with a training-free, three-stage pipeline framework. An action-aware prompt polishment stage first rewrites the inputs into image-generation prompts that specify the terminal state of each action. An identity-preserving generation stage then produces the keyframe sequence by conditioning each frame jointly on the reference identity and its predecessor, thereby decoupling time-invariant appearance from time-varying pose. Finally, an identity-aware inference enhancement stage synthesizes the intermediate segments using multi-reference guidance and identity-driven noise searching, both of which reinforce identity fidelity during sampling. Our method ranked third on the official Track 2 leaderboard, demonstrating competitive performance and strong generality.

[118] HAS: Highlight-guided Attention Steering for Multimodal LLM Video Summarization cs.CV | cs.AIPDF

Rui Chu, Yingjie Lao

TL;DR: 本文提出了一种名为HAS（Highlight-guided Attention Steering）的方法，用于多模态大语言模型（M-LLM）的视频摘要任务。该方法通过全局计算视频的连续帧级高亮分布，并将其作为注意力引导向量应用于MLLM，以提升视频理解能力，在推理时使模型更关注高亮帧，同时不完全忽略低亮帧的信息。

Details

Motivation: 现有视频摘要方法主要依赖离散的关键帧和片段字幕，但忽视了从全局视角评估帧的重要性，这可能导致理解连贯性下降、重要信息丢失，并浪费MLLM的原始能力。

Result: 该方法在多个基准测试上进行了评估，并在视频摘要任务中展示了令人信服的性能。

Insight: 创新点在于提出了一种连续帧级高亮分布来全局指导MLLM的注意力机制，从而在保持视频连续性的前提下，利用高亮引导实现更优的摘要生成，避免了传统离散关键帧方法的局限性。

Abstract: Video understanding has become more and more important with the growth of Artificial Intelligence (AI) for video generation. Recently, Multimodal Large Language Model(M-LLM) has shown its capability in video understanding. Video summarization, a specific domain of video understanding, has proven its importance for efficient navigation and retrieval. Both video understanding and video summarization require a good selection of key frames in a video. Current video summarization methods heavily focus on the selected key frames and correlated segment captions. However, existing approaches overlook the perspective of treating the importance of the frames globally. We argue that using discrete selected frames for summarization will not only reduce the understanding coherence, but also lost important information in the video, as well as wasting the original capacity of the MLLMs. In this paper, we propose HAS, a Highlight-guided Attention Steering method for video summarization. We consider a challenging but practical setting where the video given to MLLMs for summarize should be continuous but with highlight guidance. HAS mainly consists of two parts: The first part is to find a continuous frame-level highlight distribution for the video globally. The second part is to apply the highlight distribution as an attention steering vector for the MLLM, targeting a better understanding of the video, and thus during the model inference time, putting more attention on the highlighted frames, while avoiding lost entire information on less highlighted frames through putting less attention instead of forgetting them. We evaluated HAS on a variety of benchmarks, and it has shown convincing performance in video summarization.

[119] Measuring and Improving Complex-Atomic Answer Consistency in Endoscopic VQA cs.CV | cs.AIPDF

Yuhao Liu, Cheng Zhao, Guanghui Yue

TL;DR: 本文针对内窥镜视觉问答（VQA）中复杂答案与原子答案不一致的问题，提出了一个名为EndoCA的成对复杂-原子答案一致性评测基准，并引入了一种无需训练的原子支持协调（ASR）机制来减少不一致性。

Details

Motivation: 解决内窥镜VQA中模型对复杂问题的回答可能正确，但对相关原子问题的回答却失败，导致答案不一致的问题。

Result: 在EndoCA基准上评估了11个视觉语言模型（VLM），发现一些模型在复杂答案准确率高的同时，原子答案准确率和一致性显著较低。提出的ASR机制（包括ASR-Revise和ASR-Selective）在四个公开模型上提升了成对复杂-原子答案的正确性，并在回答案例中提高了准确率。

Insight: 创新点在于构建了专门评估复杂-原子答案一致性的内窥镜领域基准（EndoCA），并提出了一种无需训练、利用模型自身生成的原子答案作为上下文前提进行答案修订和一致性引导选择性回答的机制（ASR）。

Abstract: Endoscopic visual question answering (VQA) increasingly asks complex questions that combine several endoscopic answer components rather than isolated factual queries. Such complex answers may be scored as correct even when the same model fails on associated atomic questions. We introduce EndoCA, a paired complex-atomic answer consistency benchmark for evaluating whether complex answers remain consistent with same-image atomic answers. EndoCA contains two suites: EndoCA-Core evaluates compact question-complexity patterns commonly seen in practical endoscopic VQA, and EndoCA-Diagnostic supports controlled analysis across increasing question complexity. We evaluate 11 VLMs spanning open, medical, endoscopy-adapted, and closed-source models on EndoCA. Some VLMs achieve high complex-answer accuracy, yet their atomic-answer accuracy and complex-atomic answer consistency remain substantially lower. To reduce this complex-atomic inconsistency, we introduce Atomic-Support Reconciliation (ASR), a training-free mechanism that uses model-generated atomic answers as contextual premises for answer revision and consistency-guided selective answering. On four selected publicly available models, ASR-Revise improves paired complex-atomic correctness with modest changes in complex-answer accuracy, while ASR-Selective improves accuracy on answered cases by allowing the model to abstain from less reliable cases. Together, EndoCA and ASR provide a consistency-aware benchmark and a training-free mechanism for answer reconciliation and selective answering in endoscopic VQA.

[120] When 2D Cues Fail: Improving Image Manipulation Localization with Reliable 3D Geometry cs.CVPDF

Guofeng Yu, Zhiqing Guo, Dan Ma, Gaobo Yang

TL;DR: 该论文提出了一种几何感知的图像篡改定位框架（GFrame），通过引入可靠的3D几何线索（如深度和表面法线）来弥补传统2D取证线索（如低级伪影和语义不一致）在篡改区域与周围环境外观融合良好时失效的局限性。该方法利用单目重建获取几何信息，但通过估计其可靠性并选择性融合到RGB特征中，实现了跨尺度的精细定位。实验表明，该方法在有限计算预算下取得了优异性能，证明了可靠3D几何信息对图像篡改定位的补充价值。

Details

Motivation: 现有图像篡改定位方法严重依赖2D取证线索，但当篡改区域在视觉上与周围环境高度融合时，这些线索的区分能力会大幅下降。尽管局部外观一致，篡改区域仍可能违反场景的几何结构，因此需要引入几何推理来突破纯2D证据的局限。

Result: 大量实验表明，所提出的GFrame方法在有限计算预算约束下取得了优异性能，证明了可靠3D几何线索能为图像篡改定位提供超越传统2D线索的互补性取证证据。

Insight: 论文的核心创新在于将单目重建获得的3D几何线索（深度和法线）作为辅助证据，但并非直接使用，而是通过估计其可靠性进行选择性融合，从而构建了一个几何感知的多尺度特征传播框架。这为图像取证领域提供了从纯2D分析转向2D-3D联合推理的新思路。

Abstract: Existing image manipulation localization (IML) methods rely heavily on 2D forensic cues, such as low-level artifacts, noise traces, and semantic inconsistencies in the manipulated image. While effective in many cases, these cues become much less discriminative when manipulated regions are well blended with their surrounding context in appearance. In such cases, a manipulated region may remain locally appearance-consistent, but still violate the geometric structure of the surrounding scene. This limitation motivates us to go beyond purely 2D evidence and introduce geometric reasoning into IML. To this end, we leverage monocular reconstruction to obtain auxiliary geometric cues, including depth and surface normals. However, a key challenge lies in the fact that reconstructed geometry on manipulated images is inherently noisy and cannot be used naively. Rather than treating depth and normals as direct evidence, we estimate their reliability and exploit them selectively for localization. Based on this principle, we design a geometry-aware framework (GFrame) that fuses reliable geometric cues with RGB features and propagates them across scales to improve fine-grained localization. Extensive experiments show that the proposed method achieves excellent performance under limited budget constraints. These results indicate that reliable 3D geometry provides complementary forensic evidence beyond traditional 2D cues for IML. Related code will be released.

[121] SAMRI-3D: Adapting SAM2 for 3D MRI Segmentation with Global Volume Tokens cs.CVPDF

Zhao Wang, Wei Dai, Hongfu Sun, Craig Engstrom, Shekhar S. Chandra

TL;DR: 本文提出了SAMRI-3D，一个针对3D MRI分割的基准和方法，通过引入全局体积令牌（GVT）和截断符号距离场（TSDF）重建目标来适应SAM2模型，以解决MRI图像中软组织对比度低、边界不可见的问题。

Details

Motivation: 现有基于SAM2的医学图像适应模型多为通用型，缺乏针对MRI的大规模建模和基准测试，而MRI固有的低软组织对比度使得许多边界在单个切片上不可见，需要专门的3D建模方法。

Result: 在包含10,392个体积、34个数据集的SAMRI-3D基准上，该方法将平均Dice分数从零样本SAM2的0.58提升至0.78，超越了SAMed-2（0.69）、Medical-SAM2（0.49）和SAM-Med3D（0.37）等近期模型，并在8个未见数据集上保持了性能（0.79 vs. 0.78）。

Insight: 创新点在于提出了全局体积令牌（GVT）作为持久记忆令牌，结合仅在训练时使用的TSDF重建目标来增强对不可见边界的建模，且推理时无额外成本；这为适应基础模型到特定3D医学模态提供了高效、可泛化的范例。

Abstract: Foundation models such as Segment Anything Model 2 (SAM2) have transformed natural-image and video segmentation, and recent work has begun adapting them to medical imaging. These adaptations, however, are largely general-purpose models that treat MRI as one modality among many; large-scale, MRI-specific modelling and benchmarking remain limited, even though MRI’s low soft-tissue contrast leaves many boundaries effectively invisible on individual slices. We present SAMRI-3D, a benchmark and method for 3D MRI segmentation with SAM2. The SAMRI-3D benchmark is the largest MRI-only evaluation to date - 10,392 volumes from 34 datasets (27 public, 7 in-house) spanning 12 anatomical domains and 10+ sequences, with explicit seen/unseen splits. Freezing the image encoder and fine-tuning only the lightweight decoder and memory modules raises mean Dice from 0.58 (zero-shot SAM2) to 0.76, surpassing recent SAM-based medical models (SAMed-2 0.69, Medical-SAM2 0.49, SAM-Med3D 0.37) with strong statistical significance. To target invisible boundaries, we introduce Global Volume Tokens (GVT): persistent memory tokens trained with a Truncated Signed Distance Field (TSDF) reconstruction objective that is discarded at inference (zero added cost). This full model, SAMRI-3D, attains the best accuracy (0.78) and lowest variance across all 34 datasets and, uniquely, shows no drop on 8 held-out datasets (0.79 unseen vs. 0.78 seen); per-sequence analysis confirms the TSDF objective helps most where per-slice contrast is weakest. We will release the benchmark, code, and models in this paper.

[122] VGOcc: Learning Visual-Geometric Gaussians for Vision-Centric 3D Driving Occupancy Prediction cs.CVPDF

Junhong Lin, Xianda Guo, Kangli Wang, Yuqi Ye, Xiaoyu Liang

TL;DR: 本文提出VGOcc方法，用于解决仅基于视觉的3D驾驶场景占用预测问题。该方法通过从基础模型中学习视觉和几何线索，构建了称为视觉-几何高斯（Visual-Geometric Gaussians）的表示，专门用于语义占用预测。VGOcc在nuScenes数据集上实现了最先进的性能。

Details

Motivation: 现有基于高斯原语的视觉占用预测方法主要依赖图像域特征，其提供的显式几何信息有限，不足以进行有效的体积推理。本文旨在通过融合更丰富的几何和语义学习线索来改进高斯占用建模。

Result: 在nuScenes数据集上的实验表明，VGOcc在仅视觉的3D占用预测任务中达到了最先进的（state-of-the-art）性能。

Insight: 核心创新点在于提出了视觉-几何高斯表示，并设计了视觉-几何高斯生成（Visual-Geometric Gaussian Birth）和姿态感知特征学习（Pose-Aware Feature Learning）模块，将来自基础模型的视觉语义特征和几何深度假设有效结合，用于初始化并细化高斯原语，从而提升了3D场景表示的几何和语义丰富性。

Abstract: Vision-only occupancy prediction requires recovering a semantic 3D occupancy field from calibrated surround-view images, where each view provides observations with ambiguous depth along camera rays. Existing methods have progressed from dense structured representations to sparse Gaussian primitives, improving the efficiency of 3D scene representation. However, Gaussian learning still relies primarily on image domain features, which provide limited explicit geometric information for volumetric reasoning. Our key observation is that effective Gaussian occupancy modeling requires not only sparse primitives, but also richer geometric and semantic learning cues. In this paper, we propose VGOcc, which learns visual and geometric cues from foundation models for Gaussian modeling. VGOcc incorporates these cues into primitive initialization and refinement, yielding a representation termed Visual-Geometric Gaussians tailored to semantic occupancy prediction. Specifically, we propose Visual-Geometric Gaussian Birth to form spatially balanced Gaussian centers from ray depth hypotheses, while visual semantic features initialize primitive attributes. Next, we design Pose-Aware Feature Learning to combine foundation tokens with camera embeddings and calibrated ray information. Features from neighboring views are then aggregated at projected 3D locations for each Gaussian refinement stage. Finally, Gaussian decoder refines birth Gaussians with pose-aware features and renders them into semantic occupancy. Experiments on nuScenes demonstrate that VGOcc achieves state-of-the-art performance in vision-only 3D occupancy prediction. Codes will be available at https://github.com/JHLin42in/VGOcc.

Lingfeng Zhang, Zhanguang Zhang, Liheng Ma, Tongtong Cao, Yingxue Zhang

TL;DR: 本文提出了一种名为未来状态条件视觉语言导航（FSC-VLN）的方法，旨在通过引入未来视觉信息的监督来增强端到端视觉语言导航（VLN）模型的性能。该方法在训练时使用一个额外的未来查询令牌，并将其隐藏状态与未来视觉嵌入对齐，以学习预测未来状态，从而帮助当前动作决策，而在推理时则移除这一分支，仅依赖当前观测。

Details

Motivation: 标准的行为克隆方法在VLN中仅监督下一个动作，而未显式训练策略状态以预测未来视觉结果，这限制了模型利用未来信息的能力。本文旨在探索如何在不依赖测试时未来图像的情况下，通过训练时的未来视觉监督来提升导航性能。

Result: 在R2R val-unseen数据集上，FSC-VLN在两种训练数据机制下均优于StreamVLN风格的基线模型，显著提高了成功率（SR）、Oracle成功率（OSR）和路径长度加权成功率（SPL），尤其在长视野任务中增益更大。消融实验进一步验证了双查询设计（分离未来查询和动作查询）的有效性。

Insight: 创新点在于提出了一种训练时使用未来视觉潜在表示作为监督的机制，通过未来查询令牌对齐未来状态，增强了模型对未来信息的利用能力，而无需在推理时访问未来图像。这为VLN任务提供了一种可部署的未来状态条件学习方法，有助于提升长视野导航的鲁棒性。

Abstract: End-to-end vision-language navigation (VLN) with causal vision-language models can map instructions and egocentric observations directly to actions, but standard behavior cloning supervises only the next action and does not explicitly train the policy state to be predictive of future visual outcomes. We first ask a diagnostic question: if the policy is given an expert-trajectory future image as privileged input at training and testing time, is that additional visual evidence useful for choosing the current action? (These expert-trajectory future images are unavailable at test time in real deployment, so we use this setting only as a privileged-input diagnostic.) The answer is yes; this sanity check shows that future observations can provide rich, actionable cues. We then ask a deployable question: without accessing future images at inference, can we still benefit from future information by using a compressed future visual latent only as training supervision? We propose Future-State-Conditioned VLN (FSC-VLN), which adds a future-query token and aligns its hidden state to a frozen visual embedding $Δ$ steps ahead via a training-only target branch that is removed after training. On R2R val-unseen, FSC-VLN improves SR/OSR/SPL over a StreamVLN-style baseline under two training-data regimes, with larger gains on long-horizon episodes; ablations further support the dual-query design (separating future and action queries).

[124] Sparse Evidence Can Suffice: Agentic Evidence Seeking for Multimodal Video Misinformation Detection cs.CV | cs.AIPDF

Haochen Zhao, Yongxiu Xu, Xinkui Lin, Dong Xie, Jiarui Lu

TL;DR: 本文提出了一种名为SIEVE的稀疏交互式证据验证框架，用于多模态视频虚假信息检测。该框架将证据获取与验证解耦，通过一个主动探索多模态证据的智能体构建紧凑的证据包，再由验证器判断真伪，旨在解决传统整体视频理解方法在处理稀疏、组合性证据结构时存在的冗余和效率低下问题。

Details

Motivation: 现实世界中的虚假信息通常具有稀疏且组合性的证据结构，可靠的判断可能仅依赖于少数几个耦合的线索，而传统将整个视频内容一次性处理的方法会引入大量冗余并掩盖关键证据。因此，需要将证据获取与验证过程解耦。

Result: 在多个视频虚假信息检测基准测试上的实验表明，SIEVE框架持续优于所评估的基线方法，并且能够使用紧凑的证据包实现可靠的验证。

Insight: 核心创新在于将证据获取与验证解耦，并引入一个通过监督轨迹和证据感知强化学习目标训练的智能体来主动、稀疏地探索证据。这不仅提高了检测性能，还通过显式的证据获取过程增强了模型的可解释性和透明度。

Abstract: Multimodal video misinformation detection is commonly formulated as a holistic video-understanding task, where the entire video and its associated content are processed and judged in a single pass. However, real-world misinformation often exhibits a sparse and compositional evidence structure: a reliable decision may depend on only a few coupled clues, while most video content contributes limited additional information. Exhaustive multimodal reasoning may therefore introduce substantial redundancy and obscure decisive evidence. This motivates decoupling evidence acquisition from verification: first identifying sparse, decision-relevant clues and then judging veracity based on the acquired evidence. Accordingly, we propose SIEVE, a framework for Sparse Interactive Evidence Verification via Extraction in multimodal video misinformation detection. An evidence-seeking agent actively explores the available multimodal evidence and constructs a compact evidence package, which is then used by a verifier to determine veracity. The agent is trained with supervised evidence-seeking trajectories and an evidence-aware reinforcement learning objective that promotes informative evidence acquisition while discouraging unnecessary or invalid interactions. Experiments on multiple video misinformation benchmarks show that SIEVE consistently outperforms the evaluated baselines and supports reliable verification using compact evidence packages. Moreover, the resulting acquisition process provides an explicit and inspectable evidence trail, improving the transparency and groundedness of multimodal misinformation detection.

[125] SpEmoC: A Balanced Speaker-Segment Multimodal Emotion Benchmark cs.CVPDF

Sania Bano, Shahzad Ahmad, Santosh Kumar Vipparthi, Sukalpa Chanda, Subrahmanyam Murala

TL;DR: 该论文提出了SpEmoC数据集，一个用于对话中说话片段情感识别的多模态基准。该数据集包含从3100部英文影视作品中提取的30,000个高质量、类别平衡的片段，涵盖视觉、音频和文本三种同步模态，并标注了七种情感。研究通过严格的影视级别数据划分和平衡的类别分布，旨在解决现有数据集在规模、分布、模态对齐和划分策略上的不一致问题，以提升模型跨数据集的泛化能力和对少数情感类别的建模。

Details

Motivation: 现有情感识别数据集在规模、情感分布、模态对齐和数据划分策略上存在差异，这影响了模型可靠的跨数据集泛化能力和对少数情感类别的建模。为了解决这些问题，需要一个高质量、平衡且划分严谨的多模态基准数据集。

Result: 广泛的实验包括域内基准测试、跨数据集迁移、低数据训练、类别不平衡分析和模态迁移。结果表明，平衡的数据和严谨的数据划分使得模型在其他数据集上评估时，在不同情感类别上表现出更稳定的性能。

Insight: 主要创新点在于构建了一个规模大、类别平衡、模态同步且划分严谨（影视级别划分以防止内容泄露）的多模态情感数据集。客观来看，该研究强调了数据集设计本身（如平衡性和划分策略）对于构建鲁棒且可迁移的多模态情感识别模型的重要性，而不仅仅是模型架构的创新。

Abstract: Understanding human emotions in spoken conversations is a key challenge in affective computing, with applications in empathetic AI, human computer interaction, and mental health monitoring. However, existing datasets vary in scale, emotion distribution, modality alignment, and data partitioning strategies, which can influence reliable cross-dataset generalization and minority-emotion modeling. We introduce SpEmoC a Speaking segment Emotion for Conversations comprising 306,544 raw clips from 3,100 English language movies and TV series. From these, 30,000 high quality, class balanced clips are curated, featuring synchronized visual, audio, and textual modalities annotated for seven emotions through a hybrid pipeline that integrates pretrained models with human validation. SpEmoC uses strict movie- and series-level splits to prevent content overlap between split sets, allowing more reliable evaluation of model generalization. The dataset also maintains a near-balanced distribution across seven emotions, including minority classes such as Fear and Disgust, which supports more balanced learning across categories. Extensive experiments, including in-domain benchmarking, cross-dataset transfer, low-data training, class-imbalance analysis, and modality transfer show that balanced data and careful splitting lead to more stable performance across emotions when models are evaluated on other datasets. These results highlight the importance of dataset design for robust and transferable multimodal emotion recognition.

[126] Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention cs.CVPDF

Wenbo Wei, Jun Wang, Shan Raza, Abhir Bhalerao

TL;DR: 本文提出了一种名为PEMOLA的遮挡感知全景分割模块，该模块通过联合位置嵌入调制和遮挡级别注意力，将遮挡先验信息优雅地集成到基于Transformer的全景分割模型中。作者在COCO-OLAC数据集上训练遮挡分类器以获取遮挡线索，并进一步标注了Cityscapes-OLAC数据集用于评估跨数据集泛化能力。

Details

Motivation: 复杂场景中的全景分割因遮挡问题而具有挑战性，但现有方法常常忽略遮挡建模。本文旨在通过引入遮挡感知模块来改进这一状况。

Result: 在COCO-OLAC和Cityscapes-OLAC数据集上的大量实验表明，PEMOLA能够持续提升全景分割质量，且仅引入极小的计算开销，证明了遮挡建模的重要性。

Insight: 创新点在于提出了一个可无缝集成到Transformer架构中的遮挡感知模块（PEMOLA），它通过联合调制将遮挡级别注意力（作为空间引导）和编码后的遮挡标签（产生通道权重）引入位置嵌入。此外，创建了新的带遮挡标注的数据集（Cityscapes-OLAC）以评估跨数据集性能。

Abstract: Panoptic segmentation in complex scenes remains challenging because of occlusions, yet modern approaches often neglect occlusion modelling. In this paper, we propose \textbf{P}osition \textbf{E}mbedding \textbf{M}odulation with \textbf{O}cclusion-\textbf{L}evel \textbf{A}ttention (PEMOLA), a novel occlusion-aware module that can be seamlessly integrated into transformer-based panoptic segmentation. To obtain occlusion cues, we train an occlusion classifier on the COCO-OLAC dataset. The classifier derives the occlusion-level attention, which serves as spatial guidance, while the occlusion labels are encoded into a learnable embedding to produce channel-wise weights. Through joint modulation, PEMOLA elegantly introduces the occlusion priors into the position embedding, thereby improving the occlusion modelling. We further annotate the Cityscapes dataset with occlusion levels, termed Cityscapes Occlusion Labels for All Computer Vision Tasks (Cityscapes-OLAC), following the same labelling protocol as COCO-OLAC, to evaluate the cross-dataset generalisation ability of PEMOLA. Extensive experiments on COCO-OLAC and Cityscapes-OLAC demonstrate that PEMOLA consistently improves panoptic segmentation quality while introducing minimal computational overhead. These results highlight the importance of occlusion modelling, where incorporating occlusion-level attention helps deliver robust panoptic segmentation under occlusion. Code and dataset are available at https://github.com/wenbo-wei/PEMOLA.

[127] Certified Training for Convolutional Perturbations cs.CV | cs.LGPDF

Benedikt Brückner, Alessio Lomuscio

TL;DR: 本文提出了一种名为Certified Training的新型认证训练方法，用于提升视觉模型对运行时卷积扰动（如相机抖动引起的运动模糊）的鲁棒性。该方法通过高效编码卷积扰动来训练可证明鲁棒的模型，在CIFAR10数据集上针对合理强度的运动模糊实现了超过80%的鲁棒准确率，同时保持了可比较的标准准确率。

Details

Motivation: 视觉模型在运行时易受卷积扰动（如运动模糊）影响，这可能导致关键应用中的失败（例如物体检测器漏检）。现有方法（如数据增强或对抗训练）缺乏形式化的安全保证，难以识别和缓解隐藏的脆弱性。

Result: 在CIFAR10数据集上，该方法显著优于对抗训练，针对合理强度的运动模糊实现了超过80%的鲁棒准确率，同时保持了可比较的标准准确率。

Insight: 创新点在于提出了一种利用卷积扰动高效编码的认证训练框架，为模型鲁棒性提供了形式化安全保证；客观来看，该方法将认证鲁棒性训练扩展到卷积扰动领域，实现了经验性能与理论保证的有效结合。

Abstract: Vision models have been found to be susceptible to perturbations such as motion blur induced at runtime by a shaking camera. This impedes their deployment in critical applications since phenomena such as slightly blurred vision might lead to failures, for example an object detector missing objects. While methods such as data augmentation or Adversarial Training can improve empirical robustness, they lack formal safety guarantees, making it difficult to identify and mitigate hidden vulnerabilities. We introduce a novel Certified Training approach that leverages an efficient encoding of convolutional perturbations to train provably robust models. Our method significantly outperforms Adversarial Training, achieving, for example, over 80% robust accuracy against motion blur of reasonable intensity on CIFAR10 while maintaining comparable standard accuracy.

[128] Robust Multimodal Dynamic Object Segmentation cs.CVPDF

Zhe Xin, Hanzhi Chang, Penghui Huang, Yinian Mao, Guoquan Huang

TL;DR: 本文提出了一种鲁棒的多模态动态物体分割框架，通过整合2D点轨迹、3D重建和语义信息等多模态线索，生成精确且完整的动态掩码。该方法结合Transformer架构与特征聚类聚合模块，对多模态特征轨迹进行静态/动态分类，并引入了一种基于点查询的SAM后处理方法以处理单个掩码内的多个物体。

Details

Motivation: 现有基于光流的方法无法确保物体边界处静态/动态分割的一致性，而基于3D重建的方法对重建误差高度敏感，因此需要一种更鲁棒的方法来生成精确且完整的动态物体分割。

Result: 大量实验表明，该方法在动态物体分割和静态场景重建任务上均达到了最先进的性能水平。

Insight: 创新点在于设计了一个结合Transformer与特征聚类聚合模块的网络，能够根据场景特征自适应地确定主导特征类型并减轻特征退化影响；同时，提出了一种新颖的基于点查询的SAM后处理方法，提升了处理多物体掩码的能力。

Abstract: Dynamic object segmentation plays a critical role in many visual applications such as static scene reconstruction from dynamic videos. However, existing optical flow-based methods fail to ensure consistent static/dynamic segmentation along object boundaries, while 3D reconstruction-based approaches are highly sensitive to reconstruction errors. To address these limitations, we present a dynamic object segmentation framework that can generate both precise and complete dynamic masks by integrating multimodal cues including 2D point tracks, 3D reconstruction, and semantic information. We design a network combining Transformer architectures with feature clustering aggregation modules to perform static/dynamic classification of multimodal feature trajectories. It enables the model to adaptively determine which type of feature should dominate based on the characteristics of each scene, while also mitigating the impact of feature degradation. Additionally, we introduce a novel point-query-based SAM post-processing method capable of handling multiple objects within a single mask. Extensive experiments demonstrate that our approach achieves state-of-the-art performance in both dynamic object segmentation and static scene reconstruction tasks.

[129] HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enchancement cs.CVPDF

Yiyang Cai, Nan Chen, Rongchang Xie, Junwen Pan, Chunyang Jiang

TL;DR: 本文提出HOMIE框架，用于解决以人和物体为中心的个性化视频生成任务。该框架通过改进的多模态大语言模型集成策略，在保持文本编码器可控性的同时，更好地提取参考级关系知识，从而在主体间和主体内两种输入设置下实现高保真度和准确交互模式的平衡。

Details

Motivation: 现有方法在主体间个性化任务中难以平衡高主体保真度与准确的人-物交互模式，尤其是在物体代表抽象概念（如标志）时；同时，现有方法缺乏理解主体内参考（如OCR图、多视图输入）潜在对应关系的机制。

Result: 大量实验验证了该方法在各种以人和物体为中心的个性化视频生成任务上达到了最先进的性能水平。

Insight: 创新点包括：提出了一种统一的框架处理主体间和主体内输入设置；引入了全局多模态引导机制，以更好地对齐MLLM语义特征与VAE标记；提出了模态参考嵌入，以区分来自MLLM特征和VAE标记的标记，并关联主体内参考图像标记。从客观角度看，其MLLM集成策略避免了昂贵的重新对齐成本，是一个高效的设计。

Abstract: Human-object centric video personalization (HOCVP) is a core task within subject-driven video generation. However, existing methods suffer from two key limitations. First, most approaches focusing on inter-subject personalization still struggle to strike a balance between high subject fidelity and accurate interaction patterns between humans and diverse objects, especially when objects represent abstract concepts such as logos. Second, while intra-subject references (e.g., OCR maps, multi-view inputs) are expected to enhance subject fidelity, most existing works lack mechanisms to understand such latent correspondence. To address both challenges, we propose HOMIE, an HOCVP framework that tackles both inter- and intra-subject input settings in a unified manner. Compared to previous approaches, HOMIE proposes a better MLLM integration strategy to extract knowledge of reference-level relationships without compromising the controllability of text encoders or incurring costly re-alignment. Specifically, we introduce global multimodal guidance within self-attention to better align MLLM-derived semantic features with VAE tokens. Furthermore, we propose modality-reference embedding to differentiate tokens from MLLM features and VAE tokens and associate intra-subject reference image tokens. Extensive experiments validate that our method achieves state-of-the-art performance across various HOCVP tasks. Project Page: https://yiyangcai.github.io/homie-page.github.io/

[130] FlowMimic: Mask-free Visual Editing and Generation with Pixel-pair Warped Flow Field for Online Video Editing Data Generation and Modality Mimicry cs.CVPDF

Dingyun Zhang, Lixue Gong, Wei Liu

TL;DR: FlowMimic提出了一种基于像素对时序扭曲流场的方法，能够从图像编辑样本实时生成对应的视频编辑数据，用于训练统一的视频与图像生成编辑模型。该方法通过模态模仿损失对齐两种模态的能力，并引入感知相关任务和编辑区域感知损失，使模型能够内化基于语言的视觉编辑能力，无需依赖外部掩码或额外模型微调。

Details

Motivation: 当前视频编辑数据收集方法依赖人工标注、易出错的I2V模型合成以及基于VLM的质量过滤，流程繁琐且任务可扩展性有限，导致视频编辑任务多样性远低于图像编辑。本文旨在开发一种高效、可扩展的方法，从丰富的图像编辑数据中直接生成视频编辑数据，并训练一个统一模型同时具备视频和图像的生成与编辑能力。

Result: 论文在多个层级的视频编辑任务上进行了验证，结果表明模型仅使用通过所提方法生成的数据即可有效学习视频编辑。虽然没有明确提及具体基准和SOTA对比，但展示了该方法在任务多样性和数据生成效率上的优势。

Insight: 核心创新点在于提出了像素对时序扭曲流场，实现了从图像到视频编辑数据的实时、免掩码转换。通过模态模仿损失（生成和编辑）对齐视频和图像模态的输出分布，以及引入编辑区域感知的潜在层和注意力层损失，使模型能够内化对编辑指令的理解和区域定位能力，减少对外部辅助的依赖。

Abstract: In line with the prevailing direction of vision research, we explore the integration of both generation and editing capabilities for video and image modalities within a single model. Current approaches to collecting video editing data typically depend on labour-intensive, time-consuming curated procedures–involving object mask annotation, the use of error-introducing pair synthesis via I2V model and ControlNet-like guidance, and VLM-based quality filtering or refinement–and demonstrate limited task scalability. As a result, the diversity of editing tasks remains substantially narrower than that available for image editing models. We develop a pixel-pair temporal warped flow field that can directly generate corresponding video editing samples in real time from image editing samples, and we demonstrate across multiple levels of video editing tasks that a model can learn video editing using only such data. We regard the image modality as a particular form of the video modality. Accordingly, we design a modality mimic generation loss and a modality mimic editing loss to relatively align the capabilities–and thereby the output distributions–of the two modalities through mutual imitation. Moreover, language-based visual editing entails the comprehension of the editing instruction and the reference visual content, the localization of the region corresponding to that instruction within the reference visual contents, and the modification of that region alone. Existing approaches predominantly rely on external aids, such as fine-tuning an additional MLLM or explicitly supplying a mask sequence as auxiliary input during inference. In contrast, we aspire for the model to internalize this capability. To that end, we introduce sense-related tasks–for instance, referring expression segmentation–along with corresponding editing-region-aware latent-level loss and attention-level loss.

[131] Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs cs.CV | cs.AIPDF

Yi Tang, Xinyi Shang, Jiacheng Cui, Sondos Mahmoud Bsharat, Jiacheng Liu

TL;DR: 本文针对现代视觉语言模型（VLMs）生成的图像篡改检测任务，提出了一种简单而有效的领域泛化训练框架，旨在提升像素级篡改定位模型在跨模型和分布外场景下的鲁棒性。该框架通过平衡小批量采样策略和后期注入策略，有效防止训练偏差和过拟合，从而在多种VLM生成的篡改图像上实现更强的泛化能力。

Details

Motivation: 现代VLMs（如ChatGPT、Gemini等）的图像生成和编辑能力显著提升，使得像素级图像篡改检测在跨模型和分布外偏移下变得日益重要且具有挑战性。本文旨在学习能够在不同VLM生成的篡改分布中保持鲁棒的篡改定位模型。

Result: 在OOD VLMs（包括GPT-Images-2.0、Gemini-3.1、FLUX.2和Seedream 4.5）上，该框架大幅超越了先前的最先进方法PIXAR，平均gIoU和cIoU分别相对提升了26.1%和26.8%，达到了新的SOTA水平。

Insight: 创新点包括平衡小批量采样策略，防止优化偏向篡改伪影或干净图像先验；以及后期注入策略，先在大规模基础数据上训练至稳定收敛，再引入少量新兴VLM分布的支持数据，提升适应性而不易过拟合。这些简单策略的组合有效增强了模型的领域泛化能力。

Abstract: Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cross-model and out-of-distribution shifts. This work studies domain generalization for pixel-level image tampering detection in modern VLMs like ChatGPT, Gemini, Qwen-Image, etc., aiming to learn tampering localization models that remain robust across diverse VLM-generated manipulation distributions. We propose a simple yet effective domain-generalized training framework built on two practical strategies. First, we introduce a balanced minibatch sampling scheme that strategically samples tampered and real images in each minibatch, preventing biased optimization toward either manipulated artifacts or clean-image priors and avoiding training collapse, ensuring that each optimization step receives proper sampled gradient signals. Second, we adopt a simple late-injection strategy, where the detector is first trained on large-scale base data until stable convergence, and then exposed to a small amount of newly selected supporting data from emerging VLM distributions, improving adaptability without overfitting to limited new domains. Together, these components provide a simple yet strong recipe for improving pixel-level tampering localization and OOD robustness across modern VLMs. Despite the conceptual simplicity, our framework outperforms the prior state-of-the-art PIXAR by a large margin of 26.1% and 26.8% relative improvement in average gIoU and cIoU, respectively, across OOD VLMs of GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5. Our code is available at https://github.com/VILA-Lab/PIXAR-DG

[132] The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric cs.CV | cs.LGPDF

Sheng-Yu Wang, Yotam Nitzan, Aaron Hertzmann, Jun-Yan Zhu, Eli Shechtman

TL;DR: 本文提出了一种文本提示的图像感知相似性度量方法TPIPS，旨在解决现有感知相似性度量将视觉相似性压缩为单一标量值、无法考虑上下文依赖性的问题。作者构建了一个大规模的人类相似性判断数据集，并基于此微调视觉语言模型，使TPIPS能够根据文本提示捕捉视觉相似性的多个语义方面。

Details

Motivation: 现有感知相似性度量（如LPIPS）将人类复杂的、上下文依赖的视觉相似性判断（例如，形状相似但颜色不同）简化为单一标量，缺乏根据特定方面进行条件判断的机制。

Result: 在作者构建的大规模人类标注数据集上，前沿视觉语言模型（VLMs）与人类共识之间存在显著的性能差距。微调得到的TPIPS模型在感知对齐方面优于基线模型，并能可靠地泛化到训练分布之外。

Insight: 核心创新在于通过文本提示（text prompt）来条件化感知相似性度量，从而捕捉视觉相似性的多个“感官”或语义维度。这为文本引导检索、组合搜索以及生成模型的细粒度评估等任务解锁了新能力。

Abstract: Human visual similarity judgments are context-dependent. For example, two images may be similar in shape but distinct in color. Existing perceptual similarity metrics, however, collapse these nuances into a single scalar value, offering no mechanism to condition on specific aspects. To bridge this gap, we introduce a large-scale dataset of human similarity judgments over image triplets, where each triplet is annotated across multiple, free-form semantic aspects of similarity. Benchmarking a broad range of frontier vision-language models (VLMs) reveals a considerable performance gap compared to human annotators’ consensus. Leveraging our data, we fine-tune a VLM to produce our Text-Prompted Image Perceptual Similarity (TPIPS) metric, capturing multiple senses of visual similarity depending on the specified text prompt. We demonstrate that TPIPS aligns more closely with human perception and generalizes reliably beyond the training distribution. Finally, we show that TPIPS unlocks new capabilities in text-guided retrieval, compositional search, and the fine-grained evaluation of generative models. Our code, data, and trained models are at https://peterwang512.github.io/TPIPS

cs.DL [Back]

[133] Benchmarking Resource-Efficient LLMs for Research Topic Ontology Generation in the Biomedical Field cs.DL | cs.CLPDF

Tanay Aggarwal, Angelo Salatino, Francesco Osborne, Enrico Motta

TL;DR: 本文评估了五种小型开源大语言模型（参数最多90亿）在生物医学领域本体生成任务中的表现，重点关注它们识别概念间语义关系的能力。研究引入了MeSH-Rel-4K数据集，并比较了标准提示、思维链提示和微调三种适应策略。结果表明，针对性的微调能显著提升模型性能，为构建专业生物医学本体提供了一种准确、自动化的方法。

Details

Motivation: 解决知识组织系统（如本体和分类法）手动构建效率低下的瓶颈问题，探索利用资源高效的大语言模型实现生物医学领域本体自动生成的可行性。

Result: 在基于MeSH-Rel-4K数据集的评估中，针对性的微调策略将平均F1分数提升了34.1个百分点，有效克服了较小模型在上下文逻辑推理上的局限，实现了准确的语义关系识别。

Insight: 论文的创新点在于系统评估了资源受限的小型LLM在专业领域（生物医学）本体生成任务中的潜力，并证明了直接微调是超越其固有推理瓶颈、实现高性能的关键策略；同时贡献了一个新的领域语义关系数据集MeSH-Rel-4K用于基准测试。

Abstract: Knowledge Organization Systems like Ontologies and taxonomies are fundamental for structuring scientific knowledge, yet their manual curation presents a persistent bottleneck in knowledge management. While Large Language Models (LLMs) offer a scalable mechanism for automated ontology generation, their capacity to classify complex, domain-specific semantics requires systematic evaluation. In this paper, we assess the performance of five small, open-source LLMs (up to 9 billion parameters) in identifying semantic relationships between biomedical concepts. To support this evaluation, we introduce MeSH-Rel-4K, a dataset comprising 4K semantic relationships extracted from the Medical Subject Headings (MeSH). We analyse three adaptation strategies: standard prompting, Chain-of-Thought prompting, and fine-tuning. While parameter-constrained models traditionally struggle with the nuances of in-context logic, our results reveal that targeted fine-tuning increases the average F1-score by 34.1 percentage points. These results confirm that direct fine-tuning effectively exceeds the reasoning bottlenecks of smaller LLMs, providing an accurate, automated methodology for the construction and evolution of specialised biomedical ontologies.

cs.AI [Back]

[134] ColGraphRAG: Late-Interaction Evidence Retrieval for Multimodal GraphRAG cs.AI | cs.CLPDF

Seonok Kim

TL;DR: 该论文提出了ColGraphRAG方法，旨在改进多模态图检索增强生成（GraphRAG）中的视觉证据检索。核心创新在于将图关联图像节点的候选排序操作，从传统的单向量双编码器相似度计算，替换为基于ColBERT/ColPali谱系的晚期交互式多向量评分（MaxSim风格），以保留细粒度的图像块和标记级结构信息，从而提升检索精度。

Details

Motivation: 现有基于图的多模态问答系统，其端到端精度高度依赖于检索阶段对多模态资产（如图像）的排序质量。传统单向量双编码器在处理图关联图像时，会丢失图像块和标记级别的结构信息，导致细粒度对齐能力不足，影响下游推理效果。

Result: 在MultimodalQA基准测试中，该方法改进了图关联图像候选在检索阶段的点估计，并带来了下游问答性能的提升。在视觉证据至关重要的任务上提升更为明显，而在文本主导的问题上结果则好坏参半。

Insight: 主要创新点是将晚期交互、多向量检索范式（如ColBERT）成功应用于多模态图结构中的视觉证据检索，证明了细粒度、结构化的视觉特征对齐对于提升图关联证据检索效果的重要性。这为改进多模态RAG系统的视觉组件提供了新的机制层面的思路。

Abstract: Graph-grounded multimodal question answering organizes text, tables, and images in a structured evidence graph, yet end-to-end accuracy depends on which multimodal assets are ranked highly enough to enter downstream reasoning; for graph-linked images, single-vector bi-encoder similarity can discard patch- and token-level structure needed for fine-grained alignment. We evaluate replacing the visual candidate-ranking operator over graph-linked image nodes with late-interaction MaxSim-style multi-vector scoring in the ColBERT/ColPali lineage, while keeping offline graph construction, text- and table-side retrieval, structured extraction, and downstream reasoning unchanged. On MultimodalQA, this change is associated with improved retrieval-stage point estimates for graph-linked image candidates and downstream QA gains, with larger movement where visual evidence matters most and mixed trends on text-dominant questions; we interpret the pattern as mechanism-level evidence for graph-linked visual evidence inclusion, while broader validation and finer graph-level diagnostics remain important future work.

[135] DS@GT ARC at eRisk 2026: Hybrid Multi-Agent LLM System with Structured Algorithmic Guidance for Conversational Depression Screening cs.AI | cs.CLPDF

Victor Gong, David Guecha

TL;DR: 本文介绍了DS@GT团队为eRisk 2026任务1（对话式抑郁症筛查）提交的系统。该系统通过多智能体LLM架构，以对话形式访谈模拟不同抑郁状况的LLM角色，并生成BDI-II评分和四个关键症状。最终采用混合配置，用开源模型Gemma 27B替代付费GPT-5-nano作为访谈者，并通过结构化算法组件（预计算对话树、可靠性加权共识聚合、基于聚类的症状插补）来弥补模型能力的不足。

Details

Motivation: 解决在对话式抑郁症筛查任务中，如何在不直接询问敏感心理健康问题的情况下，有效且低成本地评估LLM模拟角色的抑郁状况。核心动机是验证通过充分的算法监督，较弱的开源模型能否在对话访谈者角色中与更强的专有模型竞争。

Result: 在eRisk 2026任务1的20个角色上进行了三次全自动运行。混合配置的Run 3取得了0.9063的ADODL分数，在所有完整提交中排名第3，使DS@GT在21支队伍中总排名第2，且性能优于付费基线Run 1（0.8841），同时将每人物的API成本降至约四分之一。

Insight: 创新点在于提出了一个结合多智能体LLM与结构化算法指导的混合系统。关键设计包括：使用预计算对话树标准化访谈流程，引入可靠性加权共识聚合提高评分鲁棒性，以及采用基于聚类的插补处理未探查症状。这为在资源受限下，利用算法监督提升较弱开源模型在复杂对话任务中的性能提供了可行方案。

Abstract: We describe DS@GT’s submission to the eRisk 2026 Task 1 challenge on conversational depression screening, in which systems interview LLM personas that simulate individuals with varying depression profiles and produce a Beck Depression Inventory II (BDI-II) score plus four key symptoms per persona, without directly asking sensitive mental health questions. Our pipeline evolved through three stages: a monolithic single-model prototype to start off, a baseline multi-agent architecture that separates conversational interviewing from BDI-II scoring under a coordinating orchestration layer, and a final hybrid configuration that replaces the paid GPT-5-nano interviewer with the open-source Gemma 27B. To offset the model’s weaker reasoning and instruction-following, the hybrid adds three algorithmic components: a precomputed dialogue tree that standardizes interview openers and follow-ups, a reliability-weighted consensus aggregation inspired by the Weaver framework, and a cluster-based imputation step for unprobed symptoms. We submitted three fully automated runs across all 20 personas, with Run 1 from the paid baseline and Runs 2 and 3 from the hybrid. Hybrid Run 3 achieved an ADODL of 0.9063, ranking 3rd among all complete-submission runs and placing DS@GT 2nd among the 21 teams overall, while outperforming our paid baseline Run 1 (0.8841) at roughly one-quarter of the per-persona API cost. These results support our central hypothesis that with sufficient algorithmic supervision, a weaker open-source model can compete with a stronger proprietary model in the conversational interviewer role. Our source code is available at https://github.com/dsgt-arc/erisk-task1-2026.

[136] Training Continuous Chain of Thought Models: A Tale of Two Regimes cs.AI | cs.CLPDF

Varun Yerram, He He, Eunsol Choi

TL;DR: 本文提出了一种新的连续思维链（Continuous CoT）训练方法C-MTP，它通过直接监督将冗长的推理轨迹压缩为密集的潜在表示序列。该方法在简化任务上性能与较慢的间接监督方法相当，但在复杂长推理任务上，现有连续CoT方法均表现不佳，性能下降约65%。

Details

Motivation: 现有连续CoT方法通过间接监督训练潜在表示，训练时需要自回归生成，速度慢；本文旨在提出一种更简单、更快的直接监督方法。

Result: 在简化CoT轨迹（少于100个token）的现有评估设置中，C-MTP优于先前的直接监督方法，并与较慢的间接监督方法性能相当；但在更复杂的、推理轨迹长达数百token的任务上，所有方法均表现不佳，性能大幅下降。

Insight: 创新点在于提出了C-MTP，一种将每个潜在向量建模为待压缩CoT轨迹嵌入平均的直接监督方法，简化了训练；关键发现是当前连续CoT方法在处理长、复杂推理任务时存在根本性局限。

Abstract: Continuous Chain-of-Thought methods replace verbose reasoning traces with a short sequence of dense latent representations. Earlier continuous CoT methods indirectly supervise the latent representations such that its final state match that of verbose reasoning traces, requiring autoregressive, slow generation during training. We introduce C-MTP, a simpler, faster direct supervision approach that models each latent as an average of the embeddings in the CoT traces to be compressed. Our approach outperforms a prior direct supervision method that approximates the distribution of compressed tokens, and performs competitively to slower indirect supervision approaches in existing evaluation setup with simplified CoT traces (less than 100 tokens). Lastly, we extend the evaluation of Continuous CoT methods to complex tasks with longer reasoning traces ($\ge$ few hundreds reasoning tokens). We find both direct and indirect supervision training methods perform poorly (roughly 65% performance drop) in this setting, revealing the limitations of current continuous CoT methods. The code and checkpoints are released at https://github.com/Varun221/cmtp_research

[137] Logical Judgments Under Pressure: Diagnosing Syllogistic Stability with Learned Soft Prefixes cs.AI | cs.CLPDF

Brian K Chen

TL;DR: 本文通过在学习的三段论推理基准前添加软前缀（soft prefixes）来测试逻辑判断在上下文压力下的稳定性，发现这些不透明的连续向量能有效改变多个大型语言模型的正确答案，并在未见过的逻辑形式和界面变化中保持效果，揭示了模型逻辑稳定性的局限性。

Details

Motivation: 研究动机是探究正确的逻辑判断如何受到学习到的上下文影响，通过软前缀施加压力来诊断模型在逻辑推理中的稳定性，即模型是否容易被诱导而推翻原本正确的答案。

Result: 在Qwen3.6-35B-A3B MoE、Qwen3-8B和Gemma 4 31B模型上，学习到的软前缀能显著重定向正确答案，在16个模型-方向-分割比较中优于随机控制37到99个百分点；Qwen3.6 MoE的翻转率在72%到90%之间，Gemma的有效前缀翻转率在54%到56%，而匹配的随机前缀低于1%。

Insight: 创新点在于使用软前缀作为诊断工具来量化模型逻辑稳定性，发现其主要效应是诱导广泛的答案偏好而非固定的符号强制或可靠的任务间逻辑操作，且不同模型表现出特异性偏差，这为理解大型语言模型的推理鲁棒性提供了新视角。

Abstract: To test how correct logical judgments respond to learned context, we prepend a soft prefix to an exactly labeled syllogistic reasoning benchmark while keeping the model fixed. Soft prefixes are opaque continuous vectors, so we characterize them through the behavior they induce across controlled variations in logical form and interface. By studying which prefixes succeed and how their effects generalize, we characterize how learned contextual pressure can override correct judgments and expose limits in a model’s logical stability. Across Qwen3.6-35B-A3B MoE, Qwen3-8B, and Gemma 4 31B, learned prefixes redirect many correct answers and remain effective across unseen forms and interface changes. In repeated tests with Qwen3.6 MoE and Gemma, they outperform paired random controls in all 16 model–direction–split comparisons by 37 to 99 percentage points. Qwen3.6 MoE flip rates remain between 72% and 90% across wording and prompt changes, while Gemma validity prefixes retain 54% to 56% flip compared with less than 1% for matched random prefixes. Diagnostic tests show that the dominant effect is a broad preference for one answer meaning rather than fixed-symbol forcing or a logical operation that transfers reliably between tasks. The form of this bias differs across models. In both Qwen models, simple score models often predict which judgments will flip but not how far their margins will move, whereas Gemma’s overall response is more closely approximated by the same models. These results show that the dominant behavioral effect of successful soft prefixes is a broad answer preference, while the remaining response reveals substantial model-specific differences in logical stability.

[138] From Modalities to Propositions: A Language-Centric Framework for Multimodal Intelligence cs.AI | cs.CV | cs.LG | cs.MMPDF

Nadine Chang, Maying Shen, Shizhe Diao, Jialiang Wang, Jingde Chen

TL;DR: 本文提出了一种以语言为中心的多模态智能框架，将图像、视频或文本等任何观测数据表示为原子命题的集合，即关于场景中实体、动作和关系的简单陈述。通过一个全局语义码本将这些命题统一为规范原子命题的共享词汇表，将所有模态和观测置于一个可解释的空间中，实现从细粒度事实到高层概念的跨越，并可组合成更丰富的命题。该框架支持可解释推理、跨模态理解与检索以及组合性，从而促进复杂的多模态理解、丰富的数据管理和结构化检索，并在自动驾驶和开放世界数据上进行了演示。

Details

Motivation: 解决多模态数据（如图像、视频、文本）在表示和理解上的碎片化问题，旨在通过统一的语言表示实现跨模态的语义对齐和可解释性，以支持更复杂的推理和检索任务。

Result: 在自动驾驶和开放世界数据上演示了该框架的有效性，展示了其在跨模态理解、结构化检索和组合性方面的潜力，但摘要未提及具体的定量基准或与现有方法的比较结果。

Insight: 创新点在于将多模态数据统一表示为原子命题的集合，并通过全局语义码本实现跨模态的语义共享和组合，这为多模态智能提供了可解释、可推理的语言中心基础，可能推动更灵活的数据管理和复杂查询应用。

Abstract: We propose a language representation for multimodal data in which any observation, whether image, video, or text, is expressed as a bag of atomic propositions, simple statements about the entities, actions, and relations in a scene. A global semantic codebook unifies these into a shared vocabulary of canonical atomic propositions, placing every modality and observation into one interpretable space that spans fine grained facts to high level concepts and composes into richer ones. This brings interpretability with reasoning, cross-modal understanding and retrieval, and compositionality that enables complex multimodal understanding, rich data curation and complex structured retrieval. We demonstrate the framework on autonomous driving and open-world data.

[139] Constraint-Anchored Reasoning Traces cs.AI | cs.CVPDF

Zehua Cheng, Wei Dai, Jiahao Sun

TL;DR: 本文针对自回归多模态大语言模型在思维链推理中存在的错误雪崩问题，提出了一种名为CART的神经符号框架。该框架通过在自然语言推理步骤中插入可机器检查的符号约束断言，并利用约束传播模块进行持续验证和逻辑一致性检查，当检测到矛盾时进行回溯，从而有效阻止错误传播。

Details

Motivation: 现有MLLMs在思维链推理中存在错误雪崩问题，即早期的一个错误推理会污染所有后续步骤。现有缓解方法（如采样多条链、事后自我验证或完全程序合成）要么缺乏符号基础，要么错误发现太晚，要么牺牲了自然语言推理的灵活性。

Result: 在五个基准测试上，CART将雪崩率从0.65降至0.14，在GQA上比仅训练的基线准确率提高了4.6个百分点，在POPE上达到89.1的F1分数，且推理开销最多增加18%。

Insight: 核心创新在于将神经与符号方法结合，通过插入轻量级、可验证的符号约束断言作为“锚点”，并设计约束传播模块和回溯控制器，实现了对推理过程的实时监控和错误遏制。其自适应锚点密度控制机制也避免了推理轨迹的过度膨胀。

Abstract: Autoregressive multimodal large language models (MLLMs) suffer from error snowballing: a single incorrect inference early in a chainof-thought (CoT) trace corrupts all downstream reasoning. We find that in state-of-the-art open-source MLLMs, once the first error occurs, the reasoning cascades into failure across all remaining steps in 65% of such cases (a metric we term the snowball rate). Existing mitigations-sampling multiple chains, post-hoc self-verification, or full program synthesis-either lack symbolic grounding, catch errors too late, or sacrifice the flexibility of natural language reasoning. We propose Constraint-Anchored Reasoning Traces (CART), a neuro-symbolic framework that trains MLLMs to interleave natural language reasoning steps with symbolic constraint assertions: lightweight, machine-checkable statements about visual content (e.g., count(red_objects) = 3). A dual-pronged Constraint Propagation Module-combining a learned neural grounding head with Boolean Constraint Propagation-continuously verifies these anchors against extracted visual features and checks their mutual logical consistency. When a contradiction is detected, a backtrack controller halts generation and reverts to the last consistent checkpoint, preventing error propagation. A variable-frequency emission mechanism allows the model to adaptively control anchor density, avoiding trace bloat. We construct 218K training instances by augmenting GQA, CLEVR-CoGenT, and VCR with ground-truth constraint annotations derived from scene graphs, and fine-tune open-source MLLMs (LLaVA-NeXT, Qwen2-VL) via LoRA. On five benchmarks, CART reduces the snowball rate from 0.65 to 0.14, improves GQA accuracy by +4.6 percentage points over trainingonly baselines, and achieves 89.1 F1 on POPE-all with at most 18% inference overhead.

[140] OrientSAM: Mitigating Camera-Centric Shortcut in Multimodal Spatial Reasoning via Orientation-Aware Spatial Alignment cs.AI | cs.CV | cs.MMPDF

Wenxiao Fan, Hang Yin, Kan Li

TL;DR: 本文提出OrientSAM框架，通过方向感知的空间对齐来解决多模态大语言模型在空间推理中过度依赖相机中心线索的问题。该方法通过方向感知令牌和傅里叶角度编码显式注入方向信息，并采用课程学习策略逐步提升视角感知推理能力。

Details

Motivation: 多模态大语言模型在需要视角转换的空间推理任务中存在系统误差，倾向于依赖相机中心线索而非从参考对象视角进行推理，导致在非相机参考设置中表现不佳。

Result: 在Spatial-MM、ViewSpatial和3DSRBench基准测试中，OrientSAM均优于强基线模型，尤其在非相机视角、以人为中心和方向敏感的任务上表现突出。

Insight: 创新点在于揭示了物体方向是导致相机中心捷径行为的关键因素，并提出了通过显式方向建模和课程学习来缓解该问题的方法，同时构建了大规模方向感知空间监督数据生成流程。

Abstract: Multimodal large language models (MLLMs) still struggle with spatial reasoning that requires perspective transformation. In particular, they often rely on camera-centric cues rather than reasoning from the reference object’s viewpoint, leading to systematic errors in non-camera reference settings. In this paper, we first analyze this failure mode and show that object orientation is a key factor underlying such camera-centric shortcut behavior. To address this issue, we propose OrientSAM, an orientation-aware spatial alignment framework for multimodal models. OrientSAM injects explicit orientation information into multimodal representations through orientation-aware tokens and Fourier-based angle encoding, and further adopts a curriculum learning strategy to progressively improve perspective-aware reasoning. In addition, we build a spatial data construction pipeline to generate orientation-aware spatial supervision from large-scale images. Experiments on Spatial-MM, ViewSpatial, and 3DSRBench show that OrientSAM consistently outperforms strong baselines, especially on non-camera-view, person-centric, and orientation-sensitive tasks. The results further demonstrate that explicit orientation modeling is important for mitigating camera-centric shortcut behavior and enabling more robust allocentric spatial reasoning in multimodal models.

[141] Do Maps Still Matter for Machines: Revisiting the Role of Choropleth Maps in Foundation Model Spatial Understanding cs.AI | cs.CVPDF

Zhiwei Wei, Yonghe Sun, Zhenjia Liu, Wenjia Xu, Chao He

TL;DR: 本研究探讨了在基础模型可直接处理结构化地理数据的情况下，等值区域图是否仍对机器空间理解有用。通过构建ChoroplethMap-Bench基准测试，评估了22个模型在三种输入条件下的表现，发现地图与数据结合能显著提升空间推理能力。

Details

Motivation: 研究动机是探究地图作为人类长期使用的空间信息组织工具，在基础模型时代是否仍是有效的机器空间理解外部表征，特别是当模型可直接处理结构化地理数据时。

Result: 在包含12,000个问题的ChoroplethMap-Bench基准测试中，Data + Map输入条件取得了最强性能，尤其在需要高层次空间模式理解的任务上提升显著。

Insight: 创新点在于构建了首个系统评估等值区域图对机器空间理解价值的可控基准，并实证了地图作为外部表征与符号数据结合能有效增强基础模型的空间推理能力，这为多模态空间智能提供了设计启示。

Abstract: Spatial understanding is crucial for foundation models (FMs), and maps have long helped humans organize and reason about geographic information. This study examines whether choropleth maps remain useful for machine spatial understanding when models can directly process structured geodata. We introduce ChoroplethMap-Bench, a controlled benchmark containing 2,400 synthetic choropleth maps, corresponding GeoJSON data, and 12,000 questions across five cognitive dimensions: Identify, Spatial Recognition, Compare, Rank, and Delineate. We evaluate 22 open-source and proprietary models under three input conditions: Data Only, Map Only, and Data + Map. The results show that maps substantially improve spatial reasoning, especially when combined with symbolic data and for tasks requiring higher-level understanding of spatial patterns. We further analyze the effects of map type, color hue, and spatial structure, as well as prompting strategies, language, geographic context, decoding settings, classification methods, and response stability. Overall, the Data + Map condition achieves the strongest performance, demonstrating that maps remain valuable external representations for foundation model spatial reasoning.

[142] SGA: Plug&Play Geometric Verification for Educational Video Synthesis cs.AI | cs.CV | cs.GR | cs.MA | cs.MMPDF

Lopez Jhon, Hinojosa Carlos, Ghanem Bernard

TL;DR: 本文提出了一种名为符号几何代理（SGA）的即插即用模块，用于增强基于大型语言模型（LLM）生成教育视频动画代码的流程。SGA通过拦截LLM生成的代码，进行部分执行以提取符号场景图，并在检测到空间冲突时进行针对性优化，从而确保动画的空间正确性和视觉清晰度。

Details

Motivation: 现有利用LLM生成教育动画代码的框架侧重于教学内容，但忽视了几何遮挡问题，导致难以保证空间正确性和视觉可读性。

Result: 在MMMC-Code基准测试上，使用四种LLM主干和两种代理流程的实验表明，SGA在Code2Video + GPT-5.1配置下取得了73.11的峰值MVQS分数，相对于原始基线实现了16.1%的相对提升，并在8个主干x流程配置中的7个中改善了MVQS。

Insight: 创新点在于提出了一个即插即用的几何验证模块（SGA）和一个无需渲染的确定性代理指标（MVQS），用于在代码生成流程中自动检测和修复空间冲突，从而提升教育动画的几何质量。从客观角度看，将符号推理与代码执行相结合来解决LLM生成内容的空间一致性问题是一个有前景的方向。

Abstract: Recent work leverages Large Language Models (LLMs) to generate executable code for pedagogical animations using libraries such as Manim. However, ensuring spatial correctness and visual legibility remains challenging, as existing frameworks emphasize pedagogical content while overlooking geometric occlusions. We propose the Symbolic Geometric Agent (SGA), a plug-and-play module for code-centric animation pipelines that intercepts LLM-generated code, performs partial execution to extract symbolic scene graphs, and applies targeted refinement when spatial conflicts are detected. We further introduce the Manim Visual Quality Score (MVQS), a deterministic rendering-free proxy for spatial integrity. Experiments on the MMMC-Code benchmark across four LLM backbones and two agentic pipelines show that SGA achieves a peak MVQS of 73.11 (Code2Video + GPT-5.1), corresponding to a 16.1% relative improvement over the raw baseline, and improves MVQS in 7 of 8 backbone x pipeline configurations.

eess.SP [Back]

[143] ECG-LLM: Foundation Model for ECG-Based Cardiac Reasoning eess.SP | cs.CV | cs.LG | eess.IVPDF

Alexander Selivanov, Friederike Jungmann, Jan Kehrer, Karl-Ludwig Laugwitz, Eimo Martens

TL;DR: 本文提出了ECG-LLM，一个基于心电图（ECG）的心脏推理基础模型。该模型通过一种新颖的多模态到语言的监督策略进行训练，能够仅凭12导联心电图回答广泛的、临床结构化的心血管问题，包括传统解读和标准ECG上不可见的表型。

Details

Motivation: 现有ECG人工智能系统通常局限于固定的诊断标签或自动报告，限制了其在患者特异性临床推理中的应用。为了解决这一问题，并弥补一线分诊中无法立即获得确定性影像（如超声心动图或心脏磁共振）的不足，作者开发了ECG-LLM。

Result: 在标准ECG理解任务上，ECG-LLM在诊断报告生成和ECG-QA基准测试中达到或超过了现有基线。模型成功恢复了心率等常规测量，并强有力地预测了复杂的心脏磁共振衍生表型（如心室和心房容积、心室功能），还能检测关键的超声心动图表型。

Insight: 核心创新在于采用统一的多模态到语言监督策略，将ECG信号、临床背景及影像数据转化为结构化的问答对进行训练，从而构建了一个能够进行开放式、问题驱动的心血管推理的基础模型，超越了传统的固定标签预测范式。

Abstract: Electrocardiography (ECG) is an inexpensive, standard-of-care test for cardiac symptoms, but front-line triage often lacks immediate access to definitive imaging such as echocardiography (ECHO) or cardiac magnetic resonance (CMR). Furthermore, most existing ECGAI systems are limited to fixed diagnostic labels or automated reports, constraining their use for patient-specific clinical reasoning. To address this gap, we introduce ECG-LLM, an ECG-conditioned large language model trained across four cohorts comprising 679,112 ECG studies from 186,409 patients. Using a novel multimodal-to-language supervision strategy, ECG-LLM is trained on clinically structured question-answer pairs derived from ECG signals, clinical context, CMR, and ECHO. This unified approach enables the model to answer diverse cardiovascular questions from a 12-lead ECG alone, spanning both conventional interpretation and phenotypes not directly visible on standard ECGs. ECG-LLM successfully recovers conventional ECG measurements, such as heart rate, and strongly predicts complex CMR-derived phenotypes, including ventricular and atrial volumes and ventricular function. Crucially, it detects vital echocardiographic phenotypes, including increased LV wall thickness, aortic stenosis, and right-ventricular systolic dysfunction. On standard ECG understanding tasks, ECG-LLM matches or exceeds existing baselines for diagnostic report generation and the ECG-QA benchmark. By moving beyond fixed-label prediction, this multimodal framework provides clinically valuable, question-driven cardiovascular reasoning to support general practitioner and front-line triage decisions when specialist review is delayed.

cs.LG [Back]

[144] DocOCR-Eval: A Correction-Based Framework for OCR Tool Selection Without Ground Truth cs.LG | cs.AI | cs.CLPDF

Zihan Xu, Puzhen Wu, Lawrence Chun Man Lau, Wei Liu, Sirui Li

TL;DR: 本文提出了DocOCR-Eval，一个无需真实标注的、基于校正的评估框架，用于自动评估和选择OCR工具。该框架采用三阶段校正和排序策略，在缺乏真实标签的情况下，近似基于标注的工具排序效果。

Details

Motivation: 动机在于解决在标签稀缺的实际场景中，为特定文档集合选择合适的文档解析解决方案（包括OCR引擎和多模态大语言模型）的挑战。许多OCR引擎的上下文推理能力有限，而人工标注成本高昂。

Result: 在多个涵盖不同领域和语言的扫描文档基准测试上，对多种OCR引擎和SOTA MLLMs进行了系统评估。实验表明，聚合多个MLLMs的结果能逐步改善与基于标注排序的一致性，并且在现实的标签有限场景中可以实现可靠的OCR工具选择。

Insight: 宣称的创新点是提出了一个无需真实标注的自动评估框架，通过多阶段校正和聚合多个MLLM的输出来逼近真实排序。客观来看，其核心创新在于将工具选择问题转化为一个无需真实标签的、基于模型间相互校正和共识的排序问题，为实际部署提供了实用指导。

Abstract: Document parsing is a foundational step for document understanding tasks such as visual question answering and key information extraction, as it transforms unstructured scanned images into structured representations by extracting textual, visual, and layout information. While numerous Optical Character Recognition (OCR) engines and multimodal large language models (MLLMs) have been developed for this purpose, selecting an appropriate document parsing solution for a given document collection remains challenging, particularly in label-scarce settings. In this work, we conduct a systematic evaluation of text recognition performance across a diverse set of OCR engines and state-of-the-art MLLMs on multiple scanned document benchmarks spanning different domains and languages. Motivated by the limited contextual reasoning capabilities of many OCR engines and the high cost of manual annotations, we propose DocOCR-Eval, an annotation-free evaluation framework for automatic OCR assessment and selection. DocOCR-Eval employs a three-staged correction and ranking strategy to approximate annotation-based tool ordering without ground-truth labels. We show that aggregating across multiple MLLMs progressively improves alignment with annotation-based rankings. Extensive experiments further demonstrate that reliable OCR tool selection can be achieved in realistic, label-limited settings, providing practical guidance for deploying document parsing systems across diverse real-world document collections.

[145] Feature Generation Using LLMs: An Evolutionary Algorithm Approach cs.LG | cs.AI | cs.CLPDF

Aria Nourbakhsh, Benoît Alcaraz, Christoph Schommer

TL;DR: 本文提出了一种利用大型语言模型（LLMs）结合进化算法进行特征生成的方法。该方法通过LLM基于现有表格特征生成新特征，并使用选择算法筛选最优特征集，在八个不同领域的数据集上验证了其有效性。

Details

Motivation: 机器学习流程中，特征工程是发现属性间关系的关键步骤，而传统ML算法可能无法有效处理这些关系。同时，LLMs在编码、数学推理和世界知识处理方面展现出潜力，因此研究利用LLM从表格数据生成新特征。

Result: 在八个不同领域和数据类型的数据集上的实验结果表明，在大多数情况下，LLM能够基于数学和逻辑运算符生成对任务有益的新特征，并能提升分类性能。

Insight: 创新点在于将LLM的生成能力与进化选择算法结合，自动化地从表格数据中生成和筛选特征。这为特征工程提供了一种新的、基于自然语言理解和逻辑推理的自动化解决方案。

Abstract: A crucial step in machine learning pipelines is to present each entity with features or attributes that are representative of the characteristics of the processed entities. Feature engineering is an important step in finding a relation among attributes that otherwise may not be processed by the ML algorithms. Meanwhile, Large Language Models have shown promising abilities in coding, mathematical reasoning, and processing world knowledge. In this work, we utilize an LLM for the problem of feature generation from tabular data based on the previously given features. We have created a pipeline that takes a set of attributes and a prompt to generate new features. Then, our selection algorithm selects the best-performing sets of attributes. We apply our method to eight datasets from different domains and data types. Our results show that, in most cases, the language model can produce new features based on mathematical and logical operators that are useful for the given tasks and can improve classification results.

[146] CIGPO: Contextual Information-Gain Policy Optimization for Multi-Turn Evidence-Reading LLM Agents cs.LG | cs.AI | cs.CLPDF

Hao Dou

TL;DR: 本文提出CIGPO（上下文信息增益策略优化）方法，用于解决在多轮证据阅读任务中，仅基于最终结果的强化学习（如GRPO）因中间轮次缺乏直接奖励信号而导致的训练不稳定和崩溃问题。通过在中间轮次引入基于参考模型对真实答案对数似然边际增益的信息增益奖励，并采用分离归一化和课程学习策略，CIGPO在HotpotQA基准上显著提升了3B规模模型的性能。

Details

Motivation: 在多轮证据阅读任务中，仅依赖最终结果的强化学习（如GRPO）存在训练不稳定问题，中间轮次因缺乏直接奖励信号而难以获得有效优化，导致模型最终崩溃为完全违反输出格式的模式。

Result: 在HotpotQA基准上使用Qwen2.5-3B-Instruct模型，CIGPO将标准F1分数从基线0.252提升至0.518（相对提升105%），显著优于最佳GRPO检查点的0.430和最终GRPO检查点的0.000，达到了3B规模的SOTA水平。

Insight: 核心创新在于识别了‘奖励方差崩溃’这一具体失效模式，并提出通过为中间轮次分配基于信息增益的逐轮奖励来维持奖励分布的方差，从而避免GRPO中因优势函数归零导致的优化死锁；该方法结合了分离归一化和课程学习策略，为多轮交互式LLM智能体的稳定训练提供了新思路。

Abstract: Training multi-turn evidence-reading agents with outcome-only reinforcement learning is unstable because intermediate turns receive little direct credit. In HotpotQA experiments with Qwen2.5-3B-Instruct, GRPO initially improves (standard F1 0.430) but subsequently collapses to 100% format-violating outputs. Training-log diagnosis reveals a zero-advantage lock-in mechanism: all sampled trajectories receive the minimum format penalty (-2.0), group-relative advantages vanish, and the policy-gradient loss becomes zero–an optimization deadlock. We propose a variance-injection strategy: by assigning per-turn rewards to intermediate evidence-reading turns, we prevent the group reward distribution from collapsing to a single value–preserving the variation that GRPO’s group-relative advantage requires. Contextual Information-Gain Policy Optimization (CIGPO) implements this strategy using the marginal increase in the frozen reference model’s log-likelihood of the ground-truth answer as the per-turn signal. With separate normalization of IG and F1 rewards and an IG-weight curriculum, CIGPO reaches a standard F1 of 0.518 on HotpotQA at the 3B scale (from 0.252 base; +105%), compared with 0.430 for the best GRPO checkpoint and 0.000 for the final GRPO checkpoint. CIGPO maintains meaningful reward variance and avoids zero-advantage lock-in throughout training. These results identify reward-variance collapse as a concrete failure mode of outcome-only GRPO and show that turn-level IG rewards can prevent it in this HotpotQA setting.

[147] From Outcomes to Actions: Leveraging Hindsight for Long-Horizon Language Agent Training cs.LG | cs.AI | cs.CLPDF

Zishang Jiang, Tingyun Li, Jinyi Han, Xinyi Wang, Sihang Jiang

TL;DR: 本文提出了一种名为Hindsight Policy Optimization (HPO)的新策略梯度方法，旨在解决强化学习在训练长视野交互语言智能体时面临的高方差优化问题。该方法通过将当前策略分布和后见分布投影到意图空间，并计算它们之间的Wasserstein距离来提取低方差学习信号。

Details

Motivation: 现有强化学习方法在训练长视野交互的智能体时，难以区分不同动作的贡献，导致优化方差过高，这是主要瓶颈。

Result: 论文从理论和实验上证明，在意图空间中聚合语义相似的状态和动作能产生有界方差估计器，并稳定提升策略性能。

Insight: 核心创新点在于利用后见之明（hindsight）构建意图空间投影，通过Wasserstein距离度量来降低策略梯度方差，为长视野任务提供更稳定的训练信号。

Abstract: Reinforcement learning (RL) has become a widely adopted technique for improving large language models (LLMs) on complex tasks. Despite this progress, existing RL methods still face challenges in training agents with longer-horizon interactions. One major bottleneck is distinguishing the contribution of different actions in long-horizon interaction, leading to high optimization variance. To address this, we introduce a novel policy gradient method, Hindsight Policy Optimization (HPO), that projects both the current policy distribution and the hindsight distribution into an intent space and extracts low-variance learning signals from the Wasserstein distance between them. We theoretically and empirically show that aggregating semantically similar states and actions in the intent space yields a bounded-variance estimator and improves policy performance stably. Our code is available online.

[148] WAR: Workload-Aware Rollouts for Synchronous Agentic Reinforcement Learning cs.LG | cs.AI | cs.CL | cs.OSPDF

Ryan Xu, Atlas Zhao, David Bao, Frank Du

TL;DR: 本文提出了WAR（Workload-Aware Rollouts）系统，旨在解决同步智能体强化学习中长轨迹生成成为系统瓶颈的问题。WAR通过联合优化解码和调度来加速训练，其核心是根据运行时负载动态调整策略：在低负载时采用无模型的推测解码（SuffixDecoding），在高负载时转向缓存感知的调度。

Details

Motivation: 在智能体强化学习中，随着智能体与环境交互步数增加，轨迹长度迅速增长至数万个token，使得同步RL训练越来越受限于轨迹生成（rollout）过程，这已成为主要的系统瓶颈。

Result: WAR在低负载下将长上下文智能体轨迹生成吞吐量提升了1.4倍，在高负载下最高提升1.6倍，有效缓解了同步智能体RL中的轨迹生成瓶颈。

Insight: 论文的创新点在于提出了一个负载感知的联合优化框架，将解码层级的后缀重用（SuffixDecoding）与系统层级的缓存感知调度相结合，无需改变底层RL算法即可在不同负载状态下实现稳健的吞吐量提升。其关键洞察是优化策略应随运行时负载动态变化。

Abstract: Long-horizon rollout generation has become the dominant systems bottleneck in agentic reinforcement learning (RL). As agents interact with environments over many turns, trajectories rapidly grow to tens of thousands of tokens, making synchronous RL training increasingly constrained by rollout. We propose WAR, a workload-aware rollout system that substantially accelerates synchronous agentic RL by jointly optimizing decoding and scheduling. WAR is built on a key observation: the optimal rollout optimization strategy depends on runtime load: (1) Under low load, WAR enables model-free speculative decoding with SuffixDecoding, which reuses suffix patterns from previously completed trajectories as speculative drafts for future rollouts. Unlike model-based drafters, SuffixDecoding introduces no additional draft model and avoids GPU contention with rollout generation. (2) Under high load, where saturated batched decoding leaves limited room for speculative speedup, WAR shifts the optimization focus to cache-aware scheduling. A global scheduler places requests across rollout replicas based on cache locality, trajectory progress and server load, reducing redundant KV-cache recomputation and mitigating load imbalance. By combining decoding-level suffix reuse with system-level rollout scheduling, WAR delivers robust throughput improvements across workload regimes without changing the underlying RL algorithm. WAR improves long-context agentic rollout throughput by 1.4x under low load and up to 1.6x under high load. These results show that WAR removes a major rollout bottleneck in synchronous agentic RL and provides a practical path toward scalable long-context agent training.

[149] MADA-RL: Multi-Agent Debate-Aware Reinforcement Learning for Parameter-Efficient Reasoning in Compact Models cs.LG | cs.AI | cs.CL | cs.MAPDF

Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov, Zifeng Ding, Volker Tresp

TL;DR: 本文提出了MADA-RL，一种用于紧凑模型（≤4B参数）的后训练框架，通过将模型划分为生成器和评论家角色，并利用辩论感知的学习信号进行训练，仅微调LoRA适配器中的少量参数，以实现参数高效的推理。该框架在部署时采用轻量级多轮协议组合这些专门化的智能体。

Details

Motivation: 解决大型语言模型推理能力强但训练成本高昂的问题，特别是在计算资源有限的紧凑模型上，旨在通过参数高效的后训练方法提升其数学推理能力。

Result: 在五个数学推理基准测试中，MADA-RL将DeepSeek-R1-Distill-Qwen-1.5B模型的准确率从39.9%提升至41.9%（+2.0分，p<0.001），且可训练参数比完全微调的基线少16倍，达到了准确率-可训练参数的帕累托前沿；虽然未超越在更大数据集上训练的强基线（如DeepScaleR、STILL-3），但分析了性能差距和推理成本。

Insight: 核心创新是反事实评论家优势，这是一种动态的、角色条件化的基线，通过将评论家的优势重新定义为奖励减去生成器集合的每实例准确率，使评论家学会改进生成器共识而非仅复制正确答案，从而实现了更精准的信用分配；控制研究表明，该方法能有效提升评论家纠正生成器错误的能力。

Abstract: Large language models achieve strong reasoning performance, but often at prohibitive training cost - a challenge that is especially acute for compact models ($\leq 4 , \mathrm{B}$ parameters) trained under limited budgets. We introduce MADA-RL, a post-training framework that specializes compact models into generator and critic roles and trains them with a debate-aware learning signal, fine-tuning only a small subset of parameters via LoRA adapters. Our central contribution is a counterfactual critic advantage: a dynamic, role-conditioned baseline that redefines the critic’s advantage as its reward minus the generator ensemble’s per-instance accuracy. This explicitly optimizes critics to improve over generator consensus rather than to merely reproduce a correct answer, yielding more targeted credit assignment than static mean-reward normalization. At deployment, the specialized agents are composed in a lightweight multi-round protocol. Across five mathematical reasoning benchmarks, MADA-RL raises the accuracy of the DeepSeek-R1-Distill-Qwen-1.5B model from $39.9 , %$ to $41.9 , %$ ($+2.0$ points, $p < 0.001$) using $16$ times fewer trainable parameters than fully fine-tuned baselines, placing it on the accuracy-trainable-parameter Pareto front. It approaches, but does not surpass, the strongest baselines (DeepScaleR, STILL-3), which are trained on substantially larger datasets; we analyse this gap and the associated inference-time cost directly. A controlled study isolates the source of MADA-RL’s gains: the counterfactual advantage produces the highest critic improvement rate of any model evaluated, indicating that trained critics learn to correct generator errors rather than to imitate them.

[150] LLM-as-a-Coach: Experiential Learning for Non-Verifiable Tasks cs.LG | cs.CLPDF

Tianzhu Ye, Li Dong, Guanheng Chen, He Zhu, Xun Wu

TL;DR: 本文提出了一种名为Experiential Learning（EL）的新方法，将LLM从评判者（Judge）转变为教练（Coach），通过提炼其评估为可迁移的经验知识，为策略模型提供密集的文本反馈，以替代传统强化学习中基于标量奖励的评估方式。该方法在开放式、不可验证的任务上，相比基于规则的强化学习，展现出更好的泛化能力和对奖励作弊的缓解效果。

Details

Motivation: 传统强化学习在开放式任务中将LLM基于规则的评估压缩为标量奖励，丢弃了丰富的文本反馈，并混淆了不同质量特征的响应。本文旨在利用LLM的反馈作为更丰富的监督信号，以解决这一问题。

Result: 在两个策略族上，无论是使用策略自身还是专有模型的反馈，EL在保留和未见过的开放式任务上均持续优于基于规则的强化学习。具体表现为更好的分布外泛化能力，并有效缓解了奖励作弊问题。

Insight: 核心创新在于将LLM的评估反馈重构为可迁移的“经验知识”，并通过策略内上下文蒸馏进行内化，这为不可验证任务的训练提供了一个更高带宽、更细粒度且更可泛化的学习信号。从客观角度看，该方法巧妙地将生成模型的文本理解能力转化为一种结构化、可传递的监督形式，是提升开放式任务学习效率的有效途径。

Abstract: Reinforcement learning (RL) on open-ended tasks compresses an LLM’s rubric-based evaluation into a scalar reward, discarding rich textual feedback and conflating responses with distinct quality profiles. We propose Experiential Learning (EL), which repurposes the feedback model from an LLM-as-a-Judge into an LLM-as-a-Coach. The coach distills its assessment of each on-policy response into transferable experiential knowledge, which conditions a teacher model and is internalized by the policy through on-policy context distillation. Compared with scalar rewards, this higher-bandwidth feedback channel provides dense supervision and preserves fine-grained preferences among high-quality responses. Across two policy families, with feedback from the policy itself or a proprietary model, EL consistently outperforms rubric-based RL on held-out and unseen open-ended tasks. Notably, EL generalizes better beyond the training distribution, and mitigates reward hacking. These findings establish experiential knowledge as a richer and more generalizable learning signal for post-training on non-verifiable tasks.

[151] Self-Evolving Just-In-Time Memory for Proactive Embodied Safety cs.LG | cs.CVPDF

Bingrui Sima, Lizhong Wang, Xiaoya Lu, Kun He, Xiao Yang

TL;DR: 本文提出了一种名为Self-Evolving Just-In-Time Memory的框架，旨在解决具身智能体在执行家庭任务时难以主动处理动态出现的安全隐患的问题。该框架通过重构安全机制，从阻碍任务进展的运行时护栏转变为主动的风险缓解，包含用于状态跟踪的拓扑信念图、用于风险预测的事实记忆以及注入程序性元技能的经验记忆。

Details

Motivation: 现有的安全方法（如运行时护栏）通常会阻塞不安全动作或导致过度谨慎，严重阻碍任务进展，而非主动解决潜在风险。本文旨在打破这种安全与进展之间的权衡。

Result: 在IS-Bench基准测试上的实验表明，该框架显著提升了多个VLM骨干模型（如Qwen3-VL-8B）的安全成功率（例如提升+30.3%），使智能体能够在不阻碍任务进展的情况下主动缓解风险。

Insight: 核心创新在于将具身安全重新定义为主动的风险缓解，而非被动的阻断。框架通过结合拓扑信念图进行状态跟踪、事实记忆进行精确预测以及经验记忆注入可执行的元技能，实现了安全与效率的平衡。此外，提出的自动化Test-Verify-Write循环允许智能体从执行轨迹中持续改进其缓解技能。

Abstract: While Vision-Language Models (VLMs) have empowered embodied agents to execute complex household tasks, they struggle to proactively handle dynamically emerging hazards during closed-loop interactions. Existing safety approaches often rely on runtime guardrails to block unsafe actions or induce excessive caution, which severely stalls task progress instead of actively resolving the underlying risks. To break this safety-progress trade-off, we introduce the Self-Evolving Just-In-Time Memory framework, which reframes embodied safety from progress-stalling guardrails to proactive hazard mitigation. The framework consists of a Risk-Sufficient Topological Belief Graph (RSG) for persistent safety-relevant state tracking under partial observability, an Agency-Grounded Factual Memory for precise hazard anticipation, and an Experience Memory that injects procedural Meta-Skills to guide executable, progress-preserving mitigation. Furthermore, we propose an automated Test-Verify-Write loop, allowing agents to continually refine their mitigation Meta-Skills from execution traces at test time. Experiments on IS-Bench demonstrate that our framework substantially boosts the Safe-Success rate across multiple VLM backbones (e.g., +30.3% on Qwen3-VL-8B), enabling agents to proactively mitigate hazards without stalling task progress. Code is available at https://github.com/DyMessi/JIT-Memory.

[152] AdaSurvMamba: Dynamic Fusion and Semantic Scanning for Multimodal Survival Analysis cs.LG | cs.AI | cs.CVPDF

Jialong Zhong, Tingwei Liu, Baokun Yue, Jingjing Li, Yongri Piao

TL;DR: 本文提出了一种名为AdaSurvMamba的新型自适应框架，用于结合全切片图像和基因组谱的多模态生存分析。该框架通过双尺度重要性感知重建模块动态调节跨模态交互强度，并通过语义聚合扫描模块重组离散标记以保持语义连续性，从而克服了传统融合策略的静态假设和标准Mamba架构的语义碎片化问题。

Details

Motivation: 现有基于Mamba等状态空间模型的多模态生存分析方法存在两个关键局限：一是传统融合策略假设模态交互强度是静态的，忽略了不同患者和局部区域中各模态诊断重要性的动态变化；二是标准Mamba架构沿预定义物理路径处理标记，破坏了空间分散的医学特征的语义连续性并加剧了长程衰减。

Result: 在五个TCGA队列上的实验表明，该方法相比现有方法取得了持续的性能提升。

Insight: 创新点在于引入了动态的、自适应的融合与扫描机制：DSIR模块在序列和标记两个尺度评估诊断重要性以重建输入表示；SAS模块通过共享原型池将离散标记动态重组为语义连续的序列，并利用全局模态上下文和语义先验显式调节状态转移步长，从而自适应控制信息吸收率。这为处理复杂、动态的多模态医学数据提供了新思路。

Abstract: Multimodal survival analysis utilizing whole slide images (WSIs) and genomic profiles is fundamental for cancer prognosis. Recently, state-space models like Mamba have emerged as powerful tools for sequence modeling. However, translating this success to complex multimodal tasks is hindered by two critical limitations. First, conventional fusion strategies assume a static multimodal interaction strength, ignoring the fluctuating diagnostic importance of each modality across different patients and local regions. Second, the standard Mamba architecture processes tokens along predefined physical paths. This rigid scanning disrupts the semantic continuity of spatially scattered medical features and exacerbates long-range decay. To address these challenges, we introduce AdaSurvMamba as a novel adaptive framework for multimodal survival analysis. The framework features a Dual-Scale Importance-Aware Reconstruction (DSIR) module to dynamically modulate cross-modal interaction strength. It evaluates diagnostic importance at both the sequence and token levels to reconstruct the input representations. Furthermore, we propose a Semantic Aggregation Scanning (SAS) module to overcome contextual fragmentation. The SAS module dynamically reorganizes discrete tokens into semantically continuous sequences via a shared prototype pool. It explicitly modulates the state transition step size using global modality context and semantic priors to adaptively control the information absorption rate. Experiments across five TCGA cohorts demonstrate consistent gains over existing methods. Code is available at https://github.com/zjlGO/AdaSurvMamba.

[153] AGG: Jacobian-Aggregated Group Gradient for Efficient GRPO Training of Diffusion Models cs.LG | cs.CV | eess.SYPDF

Ruiyi Ding, Jie Li, He Kang, Ziyan Liu, Chengru Song

TL;DR: 本文提出了一种名为JAGG（Jacobian-Aggregated Group Gradient）的高效梯度计算方法，旨在解决在扩散模型中使用GRPO（Group Relative Policy Optimization）进行强化学习训练时面临的计算瓶颈问题。该方法通过利用DiT（Diffusion Transformer）在采样轨迹上状态变化的平滑线性特性，将一组连续时间步的完整Transformer反向传播次数从W次减少到2次，从而显著加速训练过程。

Details

Motivation: GRPO算法在大型语言模型与人类偏好对齐方面取得了成功，但将其扩展到扩散模型和流匹配模型时，由于需要在采样轨迹的每个时间步对高容量的DiT主干进行反向传播，导致了严重的计算瓶颈，使得高分辨率文生图（T2I）训练成本过高。

Result: 在文生图基准测试上的实验表明，JAGG方法能实现约2倍的反向传播加速，同时生成质量下降可忽略不计。

Insight: 核心创新点在于利用DiT隐藏状态和速度预测沿轨迹平滑且近似线性变化的特性，通过端点Jacobian的t加权插值来近似中间步的Jacobian，并将每步的上游信号聚合为两个复合梯度，通过一次联合反向传播应用。论文还证明了当速度在(z,t)上呈线性时该插值是精确的，并设计了一个余弦相似度路由规则（jagg_frac）来仅在假设成立的区域部署JAGG。

Abstract: Group Relative Policy Optimization (GRPO) is a powerful reinforcement learning algorithm for aligning generative models with human preferences. While successful in large language models~\cite{shao2024deepseekmathpushinglimitsmathematical}, its extension to diffusion and flow matching models introduces a severe computational bottleneck: gradients must be back-propagated through the high-capacity DiT backbone at \emph{every} timestep of the sampling trajectory, making high-resolution text-to-image (T2I) training prohibitively expensive. Training-free DiT inference acceleration methods (e.g., $Δ$-DiT, ScalingCache) exploit the fact that DiT hidden states and velocity predictions vary \emph{smoothly and nearly linearly} along the trajectory. We ask whether the same linearity can reduce the backward-pass cost of DiT RL training, and answer affirmatively with \textbf{JAGG} (\textbf{J}acobian-\textbf{A}ggregated \textbf{G}roup \textbf{G}radient), which reduces full transformer backward passes from $W$ to $2$ per group of $W$ consecutive steps. JAGG approximates intermediate-step Jacobians via $t$-weighted interpolation of the endpoint Jacobians, then aggregates per-step upstream signals into two composite gradients applied through a single joint backward pass. We prove this interpolation is \emph{exact} when the velocity is linear in $(z,t)$, and a cosine-similarity routing rule (\texttt{jagg_frac}) deploys JAGG only where the assumption holds. Experiments on T2I benchmarks show JAGG delivers $\sim$2$\times$ backward speedup with negligible quality degradation.

[154] Three-Body Scattering for Generative Modeling cs.LG | cs.CVPDF

Peng Sun, Zhenglin Cheng, Deyuan Liu, Jun Xie, Xinyi Shang

TL;DR: 本文提出了一种名为三体散射建模（TBSM）的新生成模型，它通过一个分布能量函数诱导样本级运动，为一步式生成器提供直接的回归监督。该方法将能量距离转化为每个“弹体”与其实样本和生成样本间的吸引-排斥相互作用，从而避免了依赖对抗性判别器、预设噪声路径或自回归分解的传统方法。

Details

Motivation: 旨在摆脱现代生成模型对对抗性判别器、预设噪声路径或自回归分解的依赖，探索一种基于分布能量和直接回归监督的新生成范式。

Result: 在ImageNet-256数据集上，TBSM训练的一步式生成器取得了SOTA结果：像素空间的PixelDiT-XL模型FID为2.23，潜在空间的DiT-XL模型FID为1.63（NFE=1）。

Insight: 核心创新在于将能量距离转化为可在线跟踪的条件期望相互作用（三体散射），这减少了场噪声，并提供了一种将扩散相关监督、漂移动力学和GAN式目标联系起来的统一设计框架，为高维一步生成开辟了新途径。

Abstract: Modern generative models typically rely on an adversarial critic, a prescribed noise-to-data path, or an autoregressive factorization. Instead, we show that a proper distributional energy can induce sample-level motion and provide direct regression supervision for a one-step generator. Three-Body Scattering Modeling (TBSM) for generation turns the energy distance into a constant-size per-projectile interaction: each projectile is attracted toward one real source and repelled from one independently generated source. Conditioned on the projectile and its condition, its expectation equals the $2$-Wasserstein gradient-flow velocity of $\frac12D_E^2(P_θ,Q)$. A batch of $B$ frozen-target events yields $O(B)$ sample-level losses, each using one reference for its condition instead of the minibatch-wide all-pairs field used by methods such as Drifting Models. Tracking this conditional expectation online can reduce field noise. Using scattering in frozen image features, TBSM trains one-step generators on ImageNet-256, achieving FID${}=2.23$ with pixel-space PixelDiT-XL and FID${}=1.63$ with latent-space DiT-XL at NFE${}=1$. We provide a design map relating diffusion-related supervision, Drift-like dynamics, and GAN-like objectives. These results establish tracked scattering as a route to high-dimensional one-step generation. Code: https://github.com/sp12138/TBSM.

cs.MM [Back]

[155] EII-SCL: Harnessing Emotional Inertia for Multimodal Emotion Recognition in Conversation cs.MM | cs.CL | cs.HC | eess.SPPDF

Zilong Huang, Kong Aik Lee, Chong-Xin Gan, Zezhong Jin, Ruichen Zuo

TL;DR: 本文提出了一种名为EII-SCL的新方法，用于提升对话中的多模态情感识别（MERC）性能。该方法通过构建受情感惯性影响的样本，将情感惯性作为先验知识融入监督对比学习目标，从而更好地建模对话中的情感变化。实验表明，该方法在IEMOCAP和MELD数据集上超越了现有最优方法。

Details

Motivation: 当前MERC方法主要关注建模对话中复杂的上下文依赖关系，但往往忽视了情感转换过程中上下文情感惯性的影响，这导致了次优的性能。本文旨在解决这一问题。

Result: 在IEMOCAP和MELD两个基准数据集上进行的广泛实验表明，该方法持续地超越了最先进的（SOTA）方法。

Insight: 核心创新点在于提出了情感惯性感知的监督对比学习模块（EII-SCL），它通过时间窗口内构建受惯性影响的样本来利用情感惯性作为先验，并且无需额外数据即可与现有MERC模型无缝集成。从客观角度看，将情感惯性这一心理学概念形式化并融入对比学习框架，是一个新颖且有潜力的研究方向。

Abstract: Multimodal emotion recognition in conversation (MERC) achieves accurate predictions by integrating multimodal and contextual information in dialogues. While current MERC approaches focus on modeling complex contextual dependencies in conversation, they often overlook the impact of contextual emotional inertia in emotion shift, leading to sub-optimal performance. To address this issue, we propose a novel Emotional Inertia-Informed Supervised Contrastive Learning module (EII-SCL) that informs the contrastive objective by constructing inertia-affected samples within temporal windows, effectively leveraging emotional inertia as a prior while enabling seamless integration with existing MERC models without requiring additional data. Extensive experiments on IEMOCAP and MELD show that our approach consistently outperforms state-of-the-art methods.

cs.CR [Back]

[156] SlotGuard: Stop Oversharing Private Local Context in LLM Agent Transcri cs.CR | cs.CLPDF

Haocheng Xia, Yongjoo Park

TL;DR: SlotGuard是一种保护LLM智能体隐私的本地转录边界方法，通过将结构化绑定重写为类型化、后缀感知的槽位，用格式保持的合成值替换敏感数据，并使用轻量级会话图链接跨轮次引用，从而在隐藏敏感数据的同时保持智能体性能。

Details

Motivation: 解决LLM智能体在转录中因附加观察数据（如工具输出、shell日志、文件读取）而泄露隐私（如路径、电子邮件）和凭证（如API密钥）的问题，现有占位符编辑方法脆弱，可能遗漏嵌入或跨轮次引用、过度编辑良性相似项并破坏推理有用的结构。

Result: 在受控的面向仓库的智能体转录上，SlotGuard移除了9,229条路径中所有20,814个注释的结构敏感字符，并将852个植入值的凭证泄露率降至0.0%；在四个上游模型中，任务成功率接近原始转录，而通用编辑方法降至2.5%；每轮智能体转录重写中位时间为14.424微秒。

Insight: 创新点在于提出一种类型化槽位和格式保持合成值的重写机制，结合轻量级会话图管理跨轮次引用，在可信运行时内恢复原始值，实现了隐私保护与性能保留的平衡，避免了传统编辑方法的脆弱性。

Abstract: LLM agents can leak privacy (e.g., paths, emails) and credentials (e.g., API keys) as agent observations (e.g., tool outputs, shell logs, and file reads) are appended to provider-bound transcripts. Existing placeholder redaction is brittle: it can miss embedded or cross-turn references, over-redact benign lookalikes, and destroy the structure useful for reasoning. We present SlotGuard, a local transcript boundary that can hide sensitive data while retaining agents’ performance. SlotGuard rewrites structural bindings as typed, suffix-aware slots, replaces secrets with format-preserving synthetic values, links cross-turn references with a lightweight session graph, and restores raw values only inside the trusted runtime. On controlled repository-oriented agent transcripts, SlotGuard removes all 20,814 annotated structurally sensitive characters across 9,229 paths and reduces credential leakage to 0.0% across 852 planted values. It remains close to raw-transcript task success across four upstream models, while generic redaction drops to 2.5%. Transcript rewriting takes a median of 14.424~$μ$s per agent turn. The code is publicly accessible at https://github.com/illinoisdata/SlotGuard.

[157] Salience Induction against Multi-Hop RAG Agents: Threat and Defense cs.CR | cs.CLPDF

Xingfu Zhou, Pengfei Wang, Yuan Zhou, Wei Xie, Xu Zhou

TL;DR: 本文提出了一种针对多跳RAG（检索增强生成）代理的新型攻击方法——显著性诱导攻击，该方法通过编辑事实的显著性（如位置、强调、语义邻近性）来误导代理的推理过程，同时保持所有检索内容在语义上的真实性。作者构建了SalientWiki-MH基准数据集进行评估，并提出了名为显著性归一化的轻量级防御方法。

Details

Motivation: 现有防御主要关注内容投毒（注入虚假事实）和提示注入（嵌入指令），但忽略了显著性通道这一攻击面，即通过操纵事实的呈现方式（如位置、强调）来误导多跳推理，即使所有检索声明都是真实的且无恶意指令。

Result: 在五个前沿模型家族（GPT、Claude、Gemini、DeepSeek、Qwen）和三种代理架构（ReAct、Reflexion、工具调用）上的评估显示，在30%的编辑预算下，显著性诱导攻击的成功率达到83.3%；最强的基线防御后攻击成功率仍为75.7%。作者提出的显著性归一化防御将标准攻击下的成功率降至15.3%，自适应攻击下为23.6%。

Insight: 论文的创新点在于首次形式化并系统性地研究了通过操纵事实显著性（而非内容真实性）来攻击多跳RAG代理的威胁，并提出了相应的基准和防御方法。这揭示了仅保证真实性和过滤指令不足以实现鲁棒的代理RAG系统，还必须防御显著性与相关性的解耦攻击。

Abstract: Agentic retrieval-augmented generation (RAG) systems increasingly retrieve external evidence and orchestrate tools for knowledge-intensive applications. In Multi-Hop question answering, agents chain facts across documents. Existing defenses focus on content poisoning, which injects false facts, and prompt injection, which embeds directives. We identify a third attack surface: the salience channel, through which fact position, emphasis, framing, and semantic proximity can redirect reasoning even when all retrieved claims are true and no instructions are present. We formalize Salience Induction as truth-preserving edits that redirect Multi-Hop attribute binding while leaving the retrieval trace semantically intact. We define six Salience-Editing operator classes and build an iterative proposer-verifier pipeline under factual and stealth constraints. We also introduce SalientWiki-MH, a decoy-annotated Multi-Hop benchmark. Evaluations across five frontier model families (GPT, Claude, Gemini, DeepSeek, and Qwen) and three agent architectures (ReAct, Reflexion, and tool-calling) show broad generalization. Under a 30% edit budget, Salience Induction achieves an 83.3% attack success rate; the strongest evaluated baseline defense leaves 75.7% post-defense ASR. Untargeted rewriting further reduces attacks only by degrading neutral task success. Our lightweight input-side defense, Salience Normalization, reduces attack success to 15.3% under standard attacks and 23.6% under an adaptive attack. These results show that truthfulness and instruction filtering alone are insufficient: robust agentic RAG also requires defenses against salience-relevance decoupling.

cs.RO [Back]

[158] Autonomous VR-Based Risk Detection for Situational Awareness in Dangerous Settings cs.RO | cs.AI | cs.CVPDF

Mohammad Eskandari, Murali Krishna Varma Indukuri, Stephanie M. Lukin, Cynthia Matuszek

TL;DR: 本文提出了一种基于VR的人机交互框架，用于研究视觉语言模型（VLM）辅助的机器人如何在模拟危险环境中支持态势感知。系统通过机器人探索虚拟场景，利用VLM识别潜在危险并标注面向用户的兴趣点，再通过沉浸式VR界面将标注信息呈现给操作员。

Details

Motivation: 在灾难响应等高危环境中，态势感知不仅依赖于危险检测，还依赖于向人类操作员清晰传达信息。尽管VLM在安全关键场景的视觉理解方面显示出强大潜力，但其作为面向人类的机器人系统一部分的价值仍未得到充分探索。

Result: 研究结果表明，带标注的VR界面比无标注的基线更受用户青睐，参与者在与系统交互时报告了高清晰度、高实用性和高舒适度。

Insight: 创新点在于将基于VLM的机器人感知与沉浸式可视化相结合，构建了一个可控的评估框架，用于同时评估机器人危险识别和安全关键信息向用户的传达效果，为高危环境下的态势感知支持提供了一种有前景的方法。

Abstract: In high-risk environments such as disaster response, situational awareness depends not only on detecting hazards but also on communicating them clearly to human operators. Vision Language Models (VLMs) have shown strong potential for scene understanding in safety-critical settings, yet their value as part of human-facing robotic systems remains underexplored. We present a VR-based Human Robot Interaction framework for studying how VLM-assisted robots can support situational awareness in simulated hazardous environments. In our system, a robot explores a virtual scene and queries a VLM to identify potential hazards and annotate user-facing points of interest. These annotations are presented to a human operator through an immersive VR interface. This framework enables controlled evaluation of both robotic hazard identification and the communication of safety-critical information to users. Results from our study indicate that the annotated VR interface was preferred over the unannotated baseline and that participants reported high clarity, usefulness, and comfort when interacting with the system. These findings suggest that combining VLM-based robotic perception with immersive visualization is a promising approach for supporting situational awareness in hazardous settings.

[159] From Perception to Assistance: Open-Vocabulary Shared Autonomy for Robotic Manipulation cs.RO | cs.CV | cs.HC | eess.SYPDF

Murilo Vinicius da Silva, Ricardo V. Godoy, Juliano Negri, Gustavo J. G. Lahr, Ranulfo Bezerra

TL;DR: 本文提出了一种用于机器人操作的开放词汇共享自主框架，通过单目RGB-D摄像头无穿戴地捕捉操作者手臂运动和手势，结合视觉语言模型和可提示视频分割模型，实现基于文本提示的目标指定与跟踪，并利用GPU加速的模型预测控制器和势场校正，在避免自碰撞和环境碰撞的同时辅助操作者完成精确操作。

Details

Motivation: 解决工业环境中仅依靠摄像头遥操作机器人机械臂时，因深度感知有限、目标在杂乱环境中难以对准以及避免碰撞结构困难而导致的精度不足问题。

Result: 在四足移动机械臂上验证，接口相对于运动捕捉地面真值的位置RMSE为59毫米，控制器在操作者故意将手臂命令移向障碍物6厘米时，能保持手臂至少距离障碍物18厘米；在工业阀门操作和拾放任务中，完整框架在所有试验中均成功，而移除碰撞或辅助模块则通过互补机制导致失败，自主执行在每项任务中五分之四的试验成功。

Insight: 创新点包括无穿戴、无标定、无单独感知流程的手势与文本提示结合的目标指定与跟踪方法，以及集成在线体积重建的GPU加速模型预测控制器与势场校正的共享自主控制框架，实现了从感知到辅助的端到端操作提升。

Abstract: Teleoperating a robotic manipulator in industrial environments demands precision that camera-based interfaces alone struggle to deliver. The operator must align the end-effector with a target in clutter, under limited depth perception, and without colliding with the surrounding structures. This paper presents a shared-autonomy framework that assists the operator throughout this process. A single RGB-D camera captures the operator’s arm motion and hand gestures without wearables, fiducials, or a calibration stage. The intended target is specified by a free-form text prompt, grounded by a vision-language model in the robot’s gripper camera, and tracked across its onboard cameras by a promptable video-segmentation model, resulting in a grasp frame continuously separated from the obstacle map. Every commanded motion is executed by a GPU-accelerated model-predictive controller that enforces self- and environment-collision avoidance against an online volumetric reconstruction, while a potential field corrects the operator’s reference toward the grounded target during the final approach. An autonomous mode can be gesture-triggered to complete the grasp on the same target without a separate perception pipeline. The framework is validated on a quadruped mobile manipulator. The interface achieves a positional RMSE of 59 mm relative to motion-capture ground truth, and the controller keeps the arm at least 18 cm from obstacles while the operator deliberately commands the arm into them by 6 cm. In an industrial valve manipulation and a pick-and-place task, the full framework succeeded in all trials, while ablating either the collision or the assistance module produced failures through complementary mechanisms, and autonomous execution succeeded in four of five trials per task.

[160] From Sign Language Generation to Humanoid Execution: Vision-Language Guided Retargeting with Collision Mitigation cs.RO | cs.CV | cs.HCPDF

Nabeela Khan, Bowen Wu, Runwu Shi, Benjamin Yen, Takeshi Ashizawa

TL;DR: 本文提出一个系统级框架，将手语生成（SLG）系统的输出转化为人形机器人的关节空间执行。框架包含两个核心组件：一个基于SMPL-X模型的碰撞缓解模块，用于修正生成动作中的自相交问题；以及一个基于视觉语言模型（VLM）引导的逆运动学（IK）重定向算法，通过视觉反馈识别并修正执行中的特定故障模式。

Details

Motivation: 当前手语生成系统输出的密集3D人体表示常包含手-手、手-躯干等自相交穿透伪影，这在离线渲染中尚可容忍，但在人形机器人执行时会导致逆运动学无解、碰撞和不稳定的重定向轨迹，因此需要解决从生成到安全执行的桥梁问题。

Result: 论文结果表明，碰撞处理和感知引导的精细化是确保人形机器人可靠执行手语动作的关键缺失组件，但摘要中未提及具体的定量基准测试结果或SOTA比较。

Insight: 创新点在于将碰撞缓解（通过体积化SMPL-X投影）与基于VLM的视觉批评机制相结合，构建了一个感知-动作闭环，以任务空间修正的方式提升人形机器人执行生成动作的物理可行性和可靠性。

Abstract: Recent sign language generation (SLG) systems increasingly output dense 3D body representations, which better preserve full-body kinematics and geometry for downstream embodiment on humanoid robots. However, these generated motions frequently exhibit self-intersections such as hand-hand and hand-torso penetration. While such artifacts may be tolerated in offline rendering, they become critical in humanoid execution as they lead to infeasible inverse-kinematics (IK) solutions, collisions, and unstable retargeted trajectories. We present a system-level framework that bridges SLG outputs to humanoid joint-space execution via two components. First, we introduce a volumetric SMPL-X collision-mitigation module that projects generated signing motions toward physically plausible configurations while minimally deviating from the original trajectory. Second, we propose a vision-language-guided retargeting algorithm built on an IK backbone: a VLM serves as a visual critic over rendered humanoid motion, identifies embodiment-specific failure modes, and triggers targeted task-space corrections. Our results highlight collision handling and perception-guided refinement as key missing components for reliable humanoid signing.

cs.HC [Back]

[161] It Matters How You Say It: Exploring Rhetorical Patterns for AI-Assisted Information Evaluation cs.HC | cs.CLPDF

Sadra Sabouri, Zeinabsadat Saghi, Jordan Lee Boyd-Graber, Jonathan May, Jonathan K. Kummerfeld

TL;DR: 本文研究了AI辅助信息评估中不同修辞模式对用户批判性思维的影响，比较了八种旨在引发反思的修辞策略，发现脚手架解释能最有效地提升事实核查准确性并促进深度反思，而对抗性条件也能适度提高准确性，用户偏好替代框架但最不喜欢解释性替代。

Details

Motivation: 现有AI辅助信息评估研究主要关注系统传达的内容和解释形式，且多采用指令性修辞，导致用户被动接受结论；本研究旨在探索能激发用户反思、不确定性或独立推理的不同修辞模式，以弥补这一研究空白。

Result: 在n=98参与者的受试者内研究中，基于提示按需事实核查任务，脚手架解释与最高的准确性提升相关；对抗性条件也适度提高了准确性；在用户偏好上，替代框架最受欢迎，解释性替代最不受欢迎。

Insight: 创新点在于系统性地将修辞学理论（如苏格拉底提问法、替代框架等）应用于AI对话设计，以结构化方式诱导用户批判性评估，而非仅仅提供结论；客观分析表明，设计具有不同修辞风格的对话代理需权衡用户表现、满意度和沉思深度。

Abstract: Prior work on AI-assisted information evaluation has largely focused on what AI systems communicate, comparing explanation types and formats, with responses predominantly cast in directive rhetoric where the system delivers a verdict and the user passively accepts it. While debate-style interactions have recently shown promise in prompting critical evaluation over deference, the rhetorical patterns that structure AI responses and how they might induce reflection, uncertainty, or independent reasoning remain largely unexamined. To address this, we investigated eight rhetorical patterns known to induce contemplation: Intentional Misleading, Interpretive Alternative, Scaffold Explanation, Triggering Distrust, Information Distortion, Alternative Framing, Socratic Questioning, and an Oracle baseline. Through a within-subject study with n=98 participants on a hint-on-demand fact verification task, we observed preliminary evidence that Scaffold Explanation were associated with the highest accuracy gains, and encouraging deeper reflection. Surprisingly, the adversarial conditions also improved accuracy modestly. Participants preferred Alternative Framing most and Interpretive Alternative least, largely due to the latter’s perceived time cost. We discuss the implications of designing conversational agents with varied rhetorical styles and the trade-offs among user performance, satisfaction, and contemplation.

[162] AlphaOracle: Oracle bone script decipherment via human-workflow-inspired deep learning cs.HC | cs.CL | cs.CVPDF

Yuliang Liu, Haisu Guan, Pengjie Wang, Xinyu Wang, Jinpeng Wan

TL;DR: AlphaOracle是一个受专家工作流程启发的深度学习框架，用于系统化地破译甲骨文。它通过多阶段流水线（包括拓片解析、基于部首的形态分析、上下文检索和文献学验证）生成可解释的证据链，显著提高了破译效率和准确性。

Details

Motivation: 当前AI方法无法复现专家整合字形分析、上下文语义和文献学推理的工作流程，而约3000个甲骨文字符因铭文残缺和证据稀疏仍未被破译，需要一种系统化的计算方法来辅助研究。

Result: 在多个测试字符上，AlphaOracle的解读与专家解释高度一致；在86名领域专家的研究中，它减少了64%的分析时间，且79%的参与者认为其非常有用。该框架还成功解析了字符“Lao”作为地名或氏族名称，为商代行政和社会解释提供了具体修订。

Insight: 创新点在于将人类专家工作流程系统化为可计算的多阶段流水线，并生成置信度加权的显式证据链，使结果可验证。这为其他未破译文字的研究提供了概念参考，表明与文献学实践对齐的计算方法能有效促进古文字研究。

Abstract: Approximately 3,000 of the 4,500 oracle bone script (OBS) characters remain undeciphered due to fragmentary inscriptions and sparse evidence. Current AI approaches fail to replicate expert workflows that integrate form analysis, contextual semantics, and philological reasoning. We introduce AlphaOracle, a human-workflow-inspired framework that systematizes OBS decipherment using the largest digitized corpus to date. Its multi-stage pipeline comprises: (i) rubbing parsing; (ii) radical-based morphological analysis with diachronic modeling; (iii) contextual retrieval with semantic alignment; and (iv) philological validation against classical sources. Each stage generates explicit, confidence-weighted evidence chains, culminating in interpretable reports for scholarly verification. Across multiple test characters, AlphaOracle’s readings strongly agreed with expert interpretations. In a study of 86 domain specialists, it reduced analysis time by 64% and 79% of participants rated it highly useful. Notably, AlphaOracle resolves the character “Lao” as a toponymic or clan designation, offering concrete revisions to Shang administrative and social interpretations. These results suggest that computational methods aligned with philological practice can facilitate OBS research and provide a conceptual reference for studies of other undeciphered scripts.

Table of Contents

cs.CL [Back]

[1] Committed Before Reasoning: Behavioral Reproduction and Preliminary Activation-Level Evidence of Answer Pre-Commitment in an Open-Weight LLM cs.CL | cs.AIPDF

[2] NOWJ@COLIEE 2026: Adaptive Pipelines for Legal Retrieval and Reasoning cs.CLPDF

[3] Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generation cs.CLPDF

[4] Diagnosing Correctness Probes under Self-Judgement Confounding cs.CL | cs.LGPDF

[5] Group Entropy-Controlled Policy Optimization cs.CLPDF

[6] Trace-Based On-Policy Distillation for Masked Diffusion Language Models cs.CL | cs.AI | cs.LGPDF

[7] Learning from Synthetic Data without Model Collapse in Iterative Instruction Tuning cs.CLPDF

[8] Scope3Trace: Evidence-Based Identification and Extraction of Scope 3 GHG Emissions from Sustainability Reports cs.CLPDF

[9] Robust Summarization of Doctor-Patient Conversations: TalTech Systems for the Beyond Transcription Challenge cs.CL | eess.ASPDF

[10] Should Missing Modalities Always Be Necessary to Repair for Multi-modal Sentiment Analysis? cs.CLPDF

[11] Debate-on-Graph: Reliable and Adaptive Reasoning of Large Language Model on Uncertain Knowledge Graph cs.CL | cs.AIPDF

[12] How Reliable Are Multimodal Signals of Conversational State? Evidence from Remote Dyadic Collaborative Tasks cs.CLPDF

[13] Oracle Gap and Signal Fidelity: A Fixed-Pool Diagnostic for Test-Time Collaboration cs.CL | cs.AIPDF

[14] C$^2$KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inference cs.CLPDF

[15] ESCUCHA: A Spanish Speech Benchmark for Heterogeneous Acoustic Conditions cs.CLPDF

[16] When a Name Is Not a Name: A Benchmark Dataset and Distilled Reasoning for Culturally Entangled Bangla Homographs in Low-Resource LLMs cs.CLPDF

[17] DeLIVeR: Decomposed Learning for Information-grounded Veracity Recognition via Reinforced Knowledge Graph Exploration cs.CL | cs.AIPDF

[18] PPL-Factory: Task-Aware and Budget-Aware Data Selection from Language Modeling to Reasoning cs.CL | cs.LGPDF

cs.CV [Back]

[19] 3D FaceShell: Attribute Transfer in 3D Face Avatars as a VLM Defense Mechanism cs.CVPDF

[20] Moving Like a Human: Ego-Motion-Normalized Temporal Signatures for Real-Time Aerial Person Tracking on Milliwatt-Class Hardware cs.CVPDF

[21] GenSyn10: A Multi-Generative AI Dataset For Benchmarking Image Classification cs.CV | cs.AIPDF

[22] MAC 2026: Advancing Micro-Action Analysis Towards Fine-Grained Understanding cs.CV | cs.MMPDF

[23] It Depends on the Dataset: When a Brain-Encoding Model’s Predicted Responses Beat Their Visual Backbone for Video Memorability cs.CV | cs.AI | cs.LGPDF

[24] Emergent Hierarchical Monosemantic Neurons from the Group-Contrastive Forward-Forward Algorithm cs.CV | cs.AIPDF

[25] A${}^2$BM: Alignment-Aware Bridge Matching for Image-to-Image Translation cs.CV | cs.AIPDF

[26] Rethinking Feature Reliance Evaluation with Semantically Matched Suppression cs.CVPDF

[27] FedDP-PALD: A Privacy-Preserving Federated Latent Diffusion Framework with Prototype Aggregation for Medical Data Synthesis cs.CVPDF

[28] Med-OPD: Improving Medical Vision-Language Models via Evidence-Aware On-Policy Distillation cs.CV | cs.AIPDF

[29] LookME: Lookup-Based Multimodal Embeddings for Layer Injection in Vision-Language Models cs.CV | cs.AIPDF

[30] xperception – Making Robotic Grasping Easier cs.CV | cs.ROPDF

[31] Seeing What Is Actually There: PriVE-Bench and PriVE-Tools for Counterfactual Evaluation of Agentic Visual Evidence in VLMs cs.CV | cs.AIPDF

[32] Eddy-VL 1.9B: Structural Pruning and Layered Distillation for Edge-Deployable Multimodal Embedding cs.CVPDF

[33] Depth-Regularized JEPA World Models Learn More Transferable Representations from Real Outdoor Robot Data cs.CV | cs.LG | cs.ROPDF

[34] Art Beyond Semantics: Sheaf-Informed Contrastive Learning for Multi-Relational Representations cs.CV | cs.IRPDF

[35] Deep Learning-based Filtering for Video Coding: A Survey on Architectures, Algorithms, and Complexity Analysis cs.CVPDF

[36] GMoT: Gated Motion-Aware Tokenization for Fine-Grained Micro-Gesture Video Reasoning with Multimodal LLMs cs.CV | cs.AIPDF

[37] SGMCE: Segment-Grounded Morphological Concept Explanation for Malaria Parasite Species Identification in Thick Blood Smears cs.CV | cs.LGPDF

[38] RegionFM: Interpretable Region-Based Brain MRI Classification Using Foundation Model Embeddings cs.CV | cs.LGPDF

[39] CRISP: Pre-LLM Yet Text-Driven Visual Token Pruning for Efficient LVLM Inference cs.CVPDF

[40] Local Brushstroke Quality Assessment via Vision-Language Feedback cs.CVPDF

[41] Privacy-Aware Synthetic Video Benchmarking and Relational Evaluation for Worker-Under-Suspended-Load Detection cs.CV | cs.AIPDF

[42] Localization-Infused Vision-Language Semantic Fusion for Text-Guided Medical Image Segmentation cs.CVPDF

[43] PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation cs.CV | cs.AIPDF

[44] OmniStyle-INR: Universal and Multimodal Style Transfer for INRs cs.CVPDF

[45] Disentangling Model and Human Data Uncertainty in Apparent Facial Age Estimation cs.CV | cs.LGPDF

[46] Apple-$π$: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence cs.CVPDF

[47] One Modality to Forget Them All: Enhancing Cross-Modal Unlearning in Vision-Language Models cs.CV | cs.CL | cs.CRPDF

[48] Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models cs.CV | cs.AI | cs.LGPDF

[49] WeedExpert-R1: Incentivizing Botanical Reasoning in MLLMs with Reinforcement Learning for Precision Weed Grounding cs.CVPDF

[50] Do Vision Encoders Exhibit Human-like Color Thresholds? cs.CVPDF

[51] Geometry-Enhanced Portion Estimation for Multimodal LLMs cs.CV | cs.AIPDF

[52] Digital measurement of droplet flame diameter in microgravity combustion images using Segment Anything Model 2 with automatic prompt selection cs.CVPDF

[53] PAVXploreRL: Physical-Action-Visual World Model Reinforcement Learning with Action Exploration cs.CVPDF

[54] TellTale: Blending Multi-Instance LoRA Text Encoders and a Zero-Shot LLM Judge for Ambivalence/Hesitancy Recognition in Videos cs.CV | cs.AIPDF

[55] Can Multimodal Large Language Models Understand OCT? cs.CV | cs.CLPDF

[56] Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editing cs.CV | cs.CL | cs.CRPDF

[57] OFD-Net: Teacher-Free Reliable Semi-supervised Medical Image Segmentation with Orthogonal Feature Disentanglement Net of Foreground-Background cs.CV | cs.AIPDF

[58] Can Experts Adapt Without Training? On Test-Time Modality Generalization in MVLMs cs.CVPDF

[59] VisionAssist: An Open-Source Smartphone Assistant for AI-Based Visual Accessibility cs.CVPDF

[60] Spatiotemporal Facial Action Unit Detection using Twin Cycle Autoencoders for Driver Monitoring cs.CV | cs.AIPDF

[61] HTT-Net: Hierarchical Text-guided Transition Modeling for Surgical Video Phase Recognition cs.CVPDF

[62] Multi-Dimensional Quality Assessment for AI-Generated Human-Centric Videos: Dataset and Model cs.CVPDF

[63] Test-Time Registers as Global Priors for Tokenized Image Generation cs.CVPDF

[64] UniNDM: A Unified Noise-driven Detection and Mitigation Framework Against Sexual Content in Text-to-Image Generation cs.CVPDF

[65] TopoGS: Planar Reconstruction via Topology-aware 3D Gaussian Splatting cs.CV | cs.GRPDF

[66] Look Clearly Before Answering: Mitigating Hallucinations in LVLMs via Saliency-Driven Perceptual Realignment cs.CV | cs.MMPDF

[67] Dataset Distillation by Influence Matching cs.CVPDF

[68] Thinking in Video: Can Video Generators Really Reason About the Real World? cs.CV | cs.AI | cs.CLPDF

[69] Pedestrian Archetypes Extension – More Pedestrian Models for Autonomous Vehicle Safety Testing cs.CVPDF

[70] What Do They See? Interpreting Complex Road Scenarios Through the Eyes of Vision-Language-Action Models for Safe and Trustworthy Autonomous Vehicle Learning cs.CV | cs.AI | cs.LG | cs.ROPDF

[71] When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generation cs.CVPDF

[72] EvoGUI: An Evolution-Aware Benchmark for GUI State-Transition Understanding cs.CV | cs.AIPDF

[73] ALLUDE: A Unified Evaluation System for Configurable Attacks in Differentiable Environments cs.CV | cs.AIPDF

[74] O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning cs.CV | cs.AI | cs.CL | cs.MAPDF

[75] Searching for Task-Specific Vision Paths: Evolutionary Block Pruning Across Vision-Language Models cs.CVPDF

[76] HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis cs.CVPDF

[77] Denoising Models Develop Human-Like Perceptual Illusion Representations Across Architectures cs.CVPDF