cs.CL [Total: 22]
cs.CV [Total: 40]
cs.MA [Total: 1]
cs.RO [Total: 5]
cs.LG [Total: 5]
cs.AI [Total: 3]
cs.AR [Total: 1]
cs.CR [Total: 1]
cs.IR [Total: 1]

cs.CL [Back]

[1] Learning Stateful Predictive Knowledge From Experience cs.CL | cs.LGPDF

Yan Song, Xidong Feng, Bo Liu, Xinyu Cui, Haotian Fu

TL;DR: 本文提出状态化知识学习（SKL）方法，旨在解决大型语言模型（LLM）智能体从经验中学习时过度依赖轨迹级反思的问题。SKL将学习焦点从轨迹总结转向维护与状态锚定的、显式的声明性预测评估（即状态化知识），以增强智能体的泛化能力和知识引导。

Details

Motivation: 当前LLM智能体主要基于轨迹级反思从经验中提取洞察，这本质上是基于事后回顾而非预测性前瞻，导致产生脆弱且路径依赖的启发式策略。

Result: 在交互环境（WebShop, ScienceWorld）和复杂推理任务（ChessPuzzles）上的实验表明，赋予模型学习状态化预测知识的内在能力，其性能显著超越了当前基于反思的训练范式。

Insight: 核心创新在于将知识学习范式从轨迹级总结转向状态锚定的预测知识，并提出了通过自蒸馏（SKL-SD）和强化学习（SKL-RL）两种算法来实现该思想的规模化应用，这为构建更具泛化性和可引导性的智能体提供了新思路。

Abstract: As large language model (LLM) agents increasingly learn from experience, they primarily rely on trajectory-level reflection to extract insights. Viewed through the lens of predictive knowledge, we argue that this approach operates on episodic hindsight rather than predictive foresight, yielding brittle, path-dependent heuristics. To address this, we propose Stateful Knowledge Learning (SKL). SKL shifts the agent’s focus from trajectory-level summarization to maintaining Stateful Knowledge: explicit, declarative predictive assessments anchored to state. We first demonstrate a motivating example showing how stateful knowledge provides granularity, enhances generalization, and enables knowledge bootstrapping. To further scale up the idea, we introduce two algorithms via self-distillation (SKL-SD) and reinforcement learning (SKL-RL), training agents to autonomously extract state-grounded predictive knowledge from experience and learn to leverage it for policy making. Experiments on interactive environments (WebShop, ScienceWorld) and a complex reasoning task (ChessPuzzles) demonstrate that equipping models with the inherent ability to learn stateful predictive knowledge significantly outpaces current reflection-based training paradigms.

[2] ZeroR@CHiPSAL 2026: Two-Stage Vision-Language Adaptation with Contrastive Learning for Nepali Meme Classification cs.CLPDF

Nitiz Khanal

TL;DR: 本文介绍了参加CHiPSAL 2026共享任务的系统，该任务旨在检测尼泊尔语模因中的仇恨言论和情感。方法采用两阶段训练流程，基于支持天城文的Qwen3-VL-8B-Instruct模型进行适配，通过集成生成分类和对比学习的结果，在仇恨言论检测和情感分析子任务中分别获得第二名和第四名。

Details

Motivation: 解决在低资源南亚语言（尼泊尔语）环境下，对多模态（图像-文本）模因进行仇恨言论和情感检测的挑战，并避免传统OCR和翻译流程带来的误差传播。

Result: 在CHiPSAL 2026共享任务中，仇恨言论检测（二元分类）F1得分为0.797，排名第二；情感分析（三分类）F1得分为0.518，排名第四。

Insight: 创新点在于采用两阶段适配策略（LoRA微调生成分类与对比学习微调骨干网络）并集成结果，同时利用原生支持天城文的大规模视觉语言模型进行端到端处理，避免了额外的OCR和翻译步骤，为低资源语言的多模态分析提供了有效方案。

Abstract: This paper presents our system for the CHiPSAL 2026 shared task on multimodal hate speech and sentiment detection in Nepali memes. We address both subtasks: binary hate speech classification and three-class sentiment analysis. Our approach adapts the Robust Adaptation of Hateful Meme Detection (RA-HMD) framework using Qwen3-VL-8B-Instruct, a state-of-the-art vision-language model with native Devanagari support. We employ a two-stage training pipeline: (1) LoRA fine-tuning with an MLP projection head for generative classification, and (2) contrastive backbone fine-tuning with supervised InfoNCE loss. We handle class imbalance through minority oversampling, image augmentation, and focal loss. At inference, we ensemble Stage 1 token probabilities with Stage 2 classifier scores using validation-tuned weights. Our end-to-end approach eliminates error propagation from separate OCR and translation pipelines by leveraging the model’s native Devanagari understanding. Our system achieved \textbf{2nd place} on hate speech detection (F1: 0.797) and \textbf{4th place} on sentiment analysis (F1: 0.518). We provide detailed ablations, error analysis, and insights into adapting large vision-language models for low-resource South Asian languages.

[3] Chain-of-Models: Cross-Model Auditing for Bias-Robust LLM Judges cs.CL | cs.CYPDF

Qian Wang, Zhanzhi Lou, Zhenheng Tang, Nuo Chen, Bingsheng He

TL;DR: 该论文提出了一种名为Chain-of-Models（CoM）的自动化审计流程，用于减轻大语言模型（LLM）作为自动评判者时存在的认知偏见。该方法通过引入第二个模型（审计者）来检查第一个模型（被审计者）的推理轨迹，从而产生最终判断。研究发现，审计者的身份（相同模型、同族模型或不同族模型）对审计效果有显著影响，且最佳审计者的选择取决于具体的偏见类型。

Details

Motivation: 大语言模型越来越多地充当自动评判者，但其判断容易受到认知偏见的影响。现有的缓解方法主要依赖于提示驱动的去偏见（对不同偏见类型效果不稳定）或人工评估（难以扩展），因此需要一种可扩展且鲁棒的自动化解决方案。

Result: 在涵盖9个模型、6个模型族、4种认知偏见和4个事实性数据集的实验中，研究发现：1）独立偏见抵抗力强的模型不一定能成为有效的审计者；2）最佳审计者的选择是偏见特定的（例如，GPT-4o在从众、权威和分心偏见上表现最强，而GLM-5在谄媚偏见上最强）。基于这些发现，论文提出了一种针对特定偏见的审计者选择规则，在测试集上取得了最高准确率（0.884），优于最强的单一固定审计者（0.824）和无审计基线（0.805）。

Insight: 论文的创新点在于提出了一个跨模型审计框架（CoM），并系统性地研究了审计者身份对偏见缓解效果的影响。其核心洞察是：审计效果不仅取决于模型的独立性能，还取决于模型间的功能多样性和对特定偏见的针对性。这为构建鲁棒的LLM评判系统提供了一种新的、可自动化的方法，即根据偏见类型动态选择最合适的审计模型。

Abstract: LLMs increasingly serve as automated judges, but their judgments remain vulnerable to cognitive biases. Existing mitigations mostly rely on prompt-driven debiasing, which is brittle across bias types, or human evaluation, which does not scale. We study \emph{Chain-of-Models} (CoM), an automated audit pipeline in which a second model inspects the first model’s reasoning trace before producing the final judgment. The key design question is whether the auditor should be the same model, a same-family model, or a different-family model. Across 9 models from 6 families, 4 cognitive biases, and 4 factual datasets, we find that auditor identity matters in two ways. First, standalone bias resistance does not predict audit effectiveness: Kimi-K2.5 is the strongest standalone model on several biases, yet is a weak auditor for Qwen2.5-72B’s biased traces. Second, the best auditor is bias-specific: GPT-4o is strongest on bandwagon, authority, and distraction, while GLM-5 is strongest on sycophancy. We operationalize these findings with a per-bias auditor selection rule that, given the bias type, scores candidates along functional diversity, per-bias standalone resistance, and calibrated audit effectiveness. Under a calibration/test split, the selector reaches the highest accuracy across the four biased slices ($0.884$ vs.\ $0.824$ for the strongest single fixed auditor and $0.805$ for the no-audit baseline). We release data, configurations, and an LLM-agent skill at https://anonymous.4open.science/r/chain-of-models-B585 .

[4] TokenSwap: Benchmarking and Reducing the Modality Gap in Multimodal LLMs cs.CL | cs.CVPDF

Andong Hua, Colton Bishop, Igor Mordatch, Arian Hosseini, Jindong Gu

TL;DR: 本文提出了TokenSwap方法，用于构建语义等价的文本和多模态输入，并基于此创建了TokenSwap-Bench基准来评估多模态大语言模型（MLLMs）中的模态差距。研究发现，42个MLLMs普遍存在模态差距，当输入从纯文本转换为图像交错形式时，性能平均下降19.6%。研究还表明，推理模型的模态差距更小，而训练时融入TokenSwap能有效减少这一差距。

Details

Motivation: 多模态大语言模型（MLLMs）在语义等价的跨模态输入下应生成一致响应，但作者观察到模型预测存在系统性差异，即模态差距，这影响了模型的一致性和可靠性。

Result: 在TokenSwap-Bench（基于MMLU等文本基准转换而来）上评估42个MLLMs，发现从纯文本到图像交错输入时，性能下降范围在4.2%至47.4%之间，平均下降19.6%。推理模型的平均差距为10.1%，显著低于非推理模型的25.5%。

Insight: 创新点在于提出TokenSwap方法来量化和缓解模态差距，并构建了相应的基准；客观分析表明，推理模型架构可能更鲁棒，而将TokenSwap融入训练是一种有效的缓解策略，这为提升MLLMs的跨模态一致性提供了新方向。

Abstract: Multimodal large language models (MLLMs) should generate consistent responses given semantically equivalent inputs across modalities. However, we observe a systematic discrepancy in model predictions under such cross-modal variations. Specifically, we define the modality gap as the difference in model performance under semantically equivalent textual and multimodal inputs. We introduce TokenSwap, a method that constructs such inputs by replacing textual concepts with semantically aligned images, resulting in sequences where visual tokens are interleaved with text tokens. Based on TokenSwap, we transform existing text-based benchmarks such as MMLU into image-interleaved counterparts, resulting in TokenSwap-Bench. Across 42 MLLMs, we observe a pervasive modality gap, with performance decreasing by 4.2% to 47.4% when moving from text-only to image-interleaved inputs, averaging 19.6% +/- 3.3% across models. Notably, we observe that reasoning models exhibit consistently smaller gaps, achieving an average gap of 10.1% compared to 25.5% for non-reasoning models. In contrast, neither prompting strategies nor scaling training compute alone reliably reduces the modality gap. Finally, we demonstrate that incorporating TokenSwap during training effectively mitigates this gap while preserving strong text-only and vision-language performance.

[5] Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements cs.CLPDF

Xinke Tong, Xuanming Zhang, Tianyi Tang, An Yang, Jiatu Hu

TL;DR: 本文提出了FinIndices基准测试，用于评估大语言模型在未裁剪财务报表（长达32K token）上的数据处理保真度。研究发现LLMs存在‘知识瓶颈’和‘结构瓶颈’两大脆弱性，导致其在复杂金融推理中表现脆弱，而监督微调可部分恢复结构化逻辑。

Details

Motivation: 现有基准测试未能捕捉真实工业复杂性，主要依赖选择题或裁剪表格的单跳问答，忽略了跨报表动态和时间去累积的复杂性。本文旨在通过FinIndices基准测试，评估LLMs在长上下文金融领域中的真实结构推理能力。

Result: 在FinIndices基准上，移除显式公式提示会导致性能崩溃（如Gemini-3.1-Pro在表格任务中从70.70%降至38.22%），暴露了时间去累积和存量-流量口径不匹配的致命缺陷。监督微调在零提示下带来显著增益（单指标+8.54%，表格+3.82%）。

Insight: 创新点在于引入了自动化合成流水线生成对抗性陷阱的FinIndices基准，测试复杂领域、时间和口径推理。客观分析揭示了LLMs在金融推理中依赖表面模式匹配而非深层结构推理，以及通过数据中心的对齐可部分缓解这一问题。

Abstract: Do Large Language Models (LLMs) possess genuine structural reasoning, or merely rely on surface-level pattern matching? The financial domain, demanding numerical precision and multi-step logic over long contexts, is an ideal testbed. Existing benchmarks fail to capture real-world industrial complexity, predominantly relying on multiple-choice questions or single-hop QA over cropped tables while ignoring intricate cross-statement dynamics and temporal de-cumulation. To bridge this gap, we introduce FinIndices, a large-scale benchmark evaluating data-processing fidelity over uncropped financial statements (up to 32K tokens). Utilizing an automated synthesis pipeline with adversarial traps, FinIndices encompasses Single-Index computation and Table-Index tabulation to test complex domain, temporal, and caliber reasoning. Our evaluation reveals two severe LLM vulnerabilities. First, a “Knowledge Bottleneck”: despite memorizing formulas during pre-training, models demonstrate fragile pattern matching. Removing explicit formula hints causes performance to collapse (e.g., Gemini-3.1-Pro drops from 70.70% to 38.22% on table tasks), exposing fatal flaws in temporal de-cumulation and stock-flow caliber mismatch. Second, a “Structural Bottleneck”: the intense cognitive load of generating multi-metric, multi-period tables actively drains reasoning capacity. Under structural pressure, LLMs that flawlessly execute isolated derivations regress to shallow heuristics, such as fetching incorrect adjacent columns or substituting deep accounting adjustments with lazy literal arithmetic. Finally, Supervised Fine-Tuning (SFT) yields substantial zero-hint gains (+8.54% Single, +3.82% Table), validating that structured logic can be partially restored via data-centric alignment.

[6] Demystifying Entropy-based Selection for Chain-of-Thought Compression in Large Reasoning Models cs.CLPDF

Sara Candussio, Daniel Scalena, Luca Bortolussi, Elisabetta Fersini, Malvina Nissim

TL;DR: 本文研究了基于熵的剪枝方法在压缩大语言模型思维链推理中的有效性，通过多种模型和任务测试发现，基于熵的句子级剪枝相比随机剪枝并无优势；在词元级别，保留低熵词元仅在数学基准上有效，这源于数字词元固有的低熵特性；最后，通过激活补丁实验证明，任务信息并非集中于少数可启发式识别的词元，而是分布在完整推理链中。

Details

Motivation: 探究基于熵的剪枝方法在压缩思维链推理时是否真的有效，并验证其在不同模型和任务中的鲁棒性。

Result: 在多个模型和推理任务中，基于熵的句子级剪枝与随机剪枝效果相当，无显著优势；词元级低熵剪枝仅在数学基准（如GSM8K）上有效；通过激活补丁可恢复接近完整思维链的性能。

Insight: 揭示了基于熵的剪枝方法在思维链压缩中的局限性，挑战了其作为有效启发式的普遍性；提供了因果证据表明任务信息在推理链中分布广泛，而非集中于少数低熵词元。

Abstract: Entropy-based pruning has been proposed as an effective method for compressing Chain-of-Thought (CoT) reasoning with negligible accuracy loss. We test the robustness of low- and high-entropy CoT step selection methods across various models and reasoning tasks, showing that entropy offers no advantage over random pruning in any evaluated setting. Moving from sentences to tokens, we then show that retaining low-entropy tokens seems effective only on mathematical benchmarks. We find this is due to the inherently low-entropy nature of numeric tokens, which also convey semantic content in such problems. Finally, we demonstrate that patching a subset of a few CoT tokens with their original activations recovers near-perfect full-trace performance, providing causal evidence that task information is not concentrated in a small set of CoT tokens identifiable by heuristics, but rather distributed across the full reasoning chain.

[7] TELLER: Dual-Path Iterative Preference Optimization for Table Entity Linking cs.CL | cs.LGPDF

Yixin Peng, Kehao Li, Stefan Decker

TL;DR: 本文提出了TELLER模型，用于解决表格实体链接任务，即匹配表格中简短且模糊的单元格提及到知识库中的对应实体。该方法采用双路径迭代偏好优化框架：直接答案路径通过迭代直接偏好优化并利用模型更新后的残差错误刷新偏好数据；推理路径则使用过滤和压缩的思维链理由进行监督微调，然后进行迭代长度归一化正则化偏好优化。

Details

Motivation: 现有方法通常依赖静态的训练监督，固定的偏好数据无法适应演化模型的残差错误，而推理长度的变化会偏向序列级偏好学习。TELLER旨在通过从错误和推理中学习，解决这些限制。

Result: 在TableInstruct实体链接子集上，直接答案路径将准确率从94.35%提升至94.50%；在MammoTab V2评估集上，从87.59%提升至88.20%。推理路径在TableInstruct上从92.90%提升至92.95%，在MammoTab V2上从79.09%提升至81.85%，同时保持高完整推理生成率。

Insight: 创新点在于提出了双路径迭代偏好优化框架，结合了动态更新的偏好数据和长度归一化的推理优化，有效提升了实体链接的准确性和推理的鲁棒性，为基于指令调优模型的实体链接任务提供了新的训练范式。

Abstract: Entity linking in tables matches short and ambiguous cell mentions to their corresponding knowledge-base entities. Existing approaches typically rely on data preprocessing pipelines that retain either compact or extensive table content as contextual evidence, and then formulate entity linking as a language generation task for instruction-tuned models; recent systems further incorporate explicit reasoning to disambiguate challenging mentions. However, their training supervision is usually static: fixed preference data cannot adapt to the residual errors of an evolving model, while variations in reasoning length can bias sequence-level preference learning. To address these limitations, we present TELLER: Table Entity Linking through Learning from Errors and Reasoning. We first retrieve and rank Wikidata candidates and retain reduced table evidence in the prompt. The direct-answer path applies iterative direct preference optimization and refreshes its preference data with residual errors from the updated model. The reasoning path uses filtered and compressed chain-of-thought rationales for supervised fine-tuning, followed by our iterative length-normalized regularized preference optimization. On the TableInstruct entity-linking subset, the direct-answer path improves accuracy from 94.35% to 94.50%; on the MammoTab V2 evaluation set, it improves accuracy from 87.59% to 88.20%. The reasoning path improves accuracy from 92.90% to 92.95% on TableInstruct and from 79.09% to 81.85% on MammoTab V2, while maintaining high rates of complete reasoning generation. These results show that iterative preference learning benefits both concise entity prediction and explicit reasoning.

[8] Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation cs.CL | cs.AI | cs.LGPDF

Philipp D. Siedler, Jordan Sassoon

TL;DR: 本文提出了一种数据集中心的元评估框架，用于在样本层面审计LLM基准数据集，揭示了传统整体评估方法所忽视的内部异质性。该框架从认知与知识需求、语言与内容质量、任务属性、上下文、伦理安全与公平性五个潜在维度对样本进行标注，并应用于MMLU、ARC、WinoGrande、HellaSwag和TruthfulQA五个有影响力的基准。研究表明，这些标注支持跨数据集的准则驱动编排，能够构建针对特定模型能力（如推理深度或伦理敏感性）的复合基准子集，从而将基准评估重构为数据集内省，为分析和重组现有基准以更好地满足多样化评估需求提供了原则性方法。

Details

Motivation: 当前LLM评估通常将基准数据集视为整体任务，这掩盖了单个样本需求之间的显著差异，无法精确反映模型在不同维度的能力。

Result: 应用该框架对五个主流基准（MMLU等）进行标注，揭示了聚合准确率分数无法捕捉的显著内部异质性，并展示了如何利用标注实现跨数据集的准则驱动编排，以支持对模型特定能力（如推理深度）的针对性评估。

Insight: 创新点在于提出了一个系统性的样本级审计框架，将基准评估从整体任务评分转向细粒度的数据集内省与可组合性，使得评估能够更灵活、更有针对性地匹配多样化的评估目标，而非依赖单一的聚合指标。

Abstract: Benchmark datasets are central to evaluating Large Language Models (LLMs), yet they are typically conceived as monolithic tasks, obscuring substantial variation in the demands of individual samples. We introduce a dataset-centric meta-evaluation framework that audits benchmark datasets at the sample level along five latent dimensions: 1. Cognitive and Knowledge Demands, 2. Language and Content Quality, 3. Task Properties, 4. Context, and 5. Ethics, Safety, and Fairness. Applying this framework, we annotate five influential benchmarks – MMLU, ARC, WinoGrande, HellaSwag, and TruthfulQA – revealing pronounced internal heterogeneity that is not captured by aggregate accuracy scores. We show how these annotations enable criterion-driven orchestration of composite benchmark subsets across datasets, supporting targeted evaluation of model capabilities such as Reasoning Depth or Ethical Sensitivity. This approach reframes benchmark evaluation as dataset introspection, providing a principled methodology for analyzing and re-composing existing benchmarks to better reflect diverse evaluation needs.

[9] BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning cs.CLPDF

Keshu Fu, Keqin Peng, Jun Bai, Shuhan Qin, Chen Li

TL;DR: 本文提出了BLADE框架，旨在通过动态提前终止推理来提升大语言模型的推理效率。该方法通过构建多粒度检查点（句子、自我怀疑、段落边界）并学习信息丰富的探测层子集，来估计已生成的前缀是否足以给出正确答案，从而在保持准确率的同时显著减少生成的token数量。

Details

Motivation: 大语言模型通过生成长推理链来提升任务性能，但大量计算浪费在冗余的验证和修订上。现有的基于探测的提前退出方法主要检查显式的自我怀疑表达，未能充分利用更早的终止机会。

Result: 在五个基准测试和两个Qwen3推理模型上的实验表明，BLADE在保持接近基线准确率的同时，将Qwen3-8B生成的token减少了24.8%，将Qwen3-4B生成的token减少了15.8%。消融研究证实了多样化检查点和自动层选择的有效性。

Insight: 创新点在于将检查点扩展到普通的推理边界（句子、段落），并自适应地学习一个紧凑的、信息丰富的探测层子集，而不是依赖固定层或所有层的昂贵表示。通过结合校准预测和检查点特定的确认规则，在响应性和过早退出风险之间取得了平衡。

Abstract: Large language models often improve task performance by generating long reasoning traces, but the resulting computation is frequently wasted on redundant verification and revision. Existing probe-based early-exit approaches mainly inspect explicit self-doubt expressions, leaving many earlier termination opportunities undetected. Expanding inspection to ordinary reasoning boundaries improves coverage, but also exposes highly diverse intermediate states whose predictive information may reside in different hidden layers. We present Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning (BLADE), a lightweight framework that dynamically terminates reasoning by estimating whether the generated prefix is sufficient for correct answering. BLADE constructs multi-granular checkpoints from sentence, self-doubt, and paragraph boundaries, and derives robust training labels through repeated answer completions. It further learns a compact subset of informative probe layers instead of relying on fixed choices or expensive representations from all layers. At inference time, calibrated predictions are combined with checkpoint-specific confirmation rules to balance responsiveness and premature-exit risk. Experiments on five benchmarks and two Qwen3 reasoning models show that BLADE preserves near-baseline accuracy while reducing generated tokens by 24.8% on Qwen3-8B and 15.8% on Qwen3-4B. Ablation studies further confirm the benefits of diverse checkpoints and automatic layer selection, demonstrating an effective approach to more efficient LLM reasoning.

[10] Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models cs.CLPDF

Jin-woo Lee, Minkyung Song, Junghyun Oh, Seunghoon Han, Soyoung Park

TL;DR: 本文提出了Mixture-of-Translators (MoT)框架，用于在异构大语言模型之间翻译键值缓存，以解决不同模型无法重用KV缓存导致的重复预填充和存储开销问题。该方法通过多个翻译器模块和上下文校正损失来提升翻译质量，并在问答任务和多智能体推理等场景中验证了其有效性。

Details

Motivation: 异构大语言模型系统依赖共享上下文，但模型特定的KV缓存无法跨架构重用，导致多模型推理和长上下文生成的可扩展性受限。

Result: 在Qwen2.5、GPT-2和OPT模型间的同构和异构翻译实验中，MoT保持了下游QA性能，例如在Qwen2.5-7B规模翻译中达到51.0%的平均闭集QA准确率和0.43的平均抽取式QA F1分数；在实际案例中，长上下文缓存增强生成保留了96.3%的直接上下文质量。

Insight: 创新点在于使用多个翻译器模块捕捉多样化的源-目标映射，而非单一投影路径，并引入上下文校正损失来对齐轨迹；客观来看，该方法通过混合翻译器和目标端校正，有效解决了早期注入的传播偏移和晚期注入的末态偏移这两种竞争性失败模式。

Abstract: Heterogeneous Large Language Model (LLM) systems increasingly rely on shared contexts, retrieved evidence, and multi-agent dialogue histories, yet their internal key-value (KV) caches remain model-specific and cannot be reused across architectures. Consequently, each model must repeatedly prefill or store caches for the same context, limiting the scalability of multi-model reasoning and long-context generation. We propose Mixture-of-Translators(MoT), a cache translation framework that maps context KV caches from a source LLM into the cache space of a target LLM. Unlike prior approaches that depend on a single projection path or global shared latent space, MoT uses multiple translator modules to capture diverse source–target mappings. To further reduce residual translation error, we introduce a Context Correction Loss that aligns the replayed target trajectory with the native target trajectory. We reveal two competing failure modes in cache translation: propagated translation shift from early injection and last-state shift from late injection. MoT addresses them through translator mixtures and target-side correction. Across homogeneous and heterogeneous translations among Qwen2.5, GPT-2, and OPT models, MoT preserves downstream QA performance, including Qwen2.5-7B-scale translation with 51.0% average closed-set QA accuracy and 0.43 average extractive QA F1. In practical case studies, MoT enables quality-preserving memory reuse for multi-agent reasoning and retains 96.3% of direct-context quality in long-context cache-augmented generation, demonstrating scalable KV cache reuse across heterogeneous LLMs.

[11] Tokenizer-Agnostic Engram Module cs.CLPDF

Jia Peng Lim, Hai Leong Chieu

TL;DR: 本文提出了一种改进Deepseek Engram模块的方法，使其与分词器无关。原Engram模块通过基于分词器生成的N-gram哈希进行嵌入查找，导致其与特定分词器紧密耦合。新方法将N-gram视为从跨分词器的所有可能字节序列中采样的方法，并使用多项式哈希替换原有的XOR哈希，从而实现了字节等效的标记序列具有相同的哈希值，提升了嵌入的可重用性。

Details

Motivation: 为了解决原Engram模块因其基于分词器N-gram哈希的嵌入查找机制而与特定分词器紧密耦合的问题，导致使用不同分词器的模型必须从头训练自己的Engram嵌入，限制了嵌入的可重用性。

Result: 研究表明，这种简单的哈希替换方法在性能上与原方法相当，并成功实现了分词器无关性，即字节等效的标记序列具有哈希等价性。

Insight: 核心创新点在于将N-gram的视角从建模分词器相关的离散空间，转变为从所有可能的字节序列中采样的方法，并通过多项式哈希在联合嵌入空间中实现跨N的兼容性，从而解耦了模块与分词器的依赖关系。

Abstract: Deepseek’s Engram, a conditional memory module, was introduced to trade-off storage versus reasoning in large language models. However, the module relies on token-level $N$-gram hashing for Engram embedding lookup, introducing a tight coupling to the tokenizer used: a model with a different tokenizer would have to train its own Engram embeddings from scratch. To improve the reusability of Engram embeddings, we propose a change to the hashing routine, enabling compatibility between Engram models using different tokenizers. Instead of modelling disjoint $N$-gram spaces, we treat $N$-gram as a method to sample potentially useful byte sequences, from all possible byte sequences across tokens. We replace the XOR-based hashing with the general polynomial hashing with a joint embedding space across $N$. This work investigates the possible trade-offs and shows that this simple substitution produces comparable performance and achieves tokenizer-agnosticism: hash equivalence for byte-equivalent token sequences.

[12] PARALLEL: A Prefrontal-Aligned Reinforcement inspired Approach for Language-Model Learning under Explicit Limits cs.CL | cs.AIPDF

Namkyung Yoon, Sanghong Kim, Hwangnam Kim

TL;DR: 本文提出了一种名为PARALLEL的、受前额叶对齐和强化学习启发的语言模型学习方法。该方法通过分离目标相关和不确定性相关的控制信号，并结合即时效用-成本反馈，为每个训练样本分配自适应的更新强度，从而优先进行有益的更新并限制不必要的参数变化。

Details

Motivation: 传统的语言模型适应方法对训练样本进行均匀更新，忽略了不同样本的局部更新效益差异。本文旨在解决这一问题，通过受神经科学启发的控制机制，更高效、更有选择性地进行模型更新。

Result: 在多项选择推理任务（ARC）上，PARALLEL在保持94.1%到99.2%的完全适应性能的同时，更高效地利用了可用更新。在文本摘要任务（XSum和CNN/DailyMail）上，其ROUGE-1和ROUGE-2分数达到了完全适应方法的96.9%到98.6%，ROUGE-L分数达到了98.8%到98.9%。在相同的累计适应时间或GPU能耗下，PARALLEL在ARC上获得了更高的准确率，并展现出更稳定的后期适应轨迹。

Insight: 核心创新点在于将神经科学中前额叶的互补控制机制（目标导向与不确定性导向）形式化为独立的控制器信号，并与强化学习中的即时反馈相结合，实现了样本级别的、自适应的更新强度决策。这为模型在部署后的持续流式适应提供了一种稳定且高效的策略，避免了不必要的计算开销。

Abstract: Recent language models achieve strong performance across a variety of tasks, but conventional adaptation applies updates uniformly across training samples regardless of their local update benefit. We propose PARALLEL, a prefrontal-aligned reinforcement inspired approach for language-model learning. Inspired by the complementary roles of goal-related and uncertainty-related control, PARALLEL represents these forms of information as separate controller signals and combines them with the current model representation. A reinforcement-inspired controller assigns sample-dependent update intensity using immediate utility-cost feedback. PARALLEL therefore learns when and how strongly to adapt to each sample, prioritizing beneficial updates while limiting unnecessary parameter changes. PARALLEL uses available updates more efficiently than selective baselines while retaining 94.1–99.2% of Full-adaptation performance. Beyond multiple-choice reasoning, experiments on XSum and CNN/DailyMail show that PARALLEL retains 96.9–98.6% of the ROUGE-1 and ROUGE-2 scores achieved by Full adaptation and 98.8–98.9% of the corresponding ROUGE-L scores. When compared at the same cumulative adaptation time or GPU energy, PARALLEL achieves higher ARC accuracy and exhibits a more stable late-stage adaptation trajectory than Full adaptation in the representative run. These results show that learning when and how strongly to update each sample supports stable and efficient post-deployment stream adaptation while avoiding unnecessary updates.

[13] Faster but Different: Diagnosing and Controlling Content Drift in Accelerated Multimodal Diffusion Language Models cs.CLPDF

Yaoxuan Dou, Yang Shu

TL;DR: 本文研究了加速多模态扩散大语言模型（dMLLMs）在无训练加速过程中产生的‘内容漂移’问题。通过对比加速模型（Fast-dLLM）与未加速模型的输出，诊断出过时的视觉和生成文本状态是导致内容不一致的主要原因，并提出通过缩短KV缓存刷新间隔来控制漂移，在1.3倍加速下实现近乎一致的输出。

Details

Motivation: 无训练加速使得基于扩散的多模态大语言模型更易于部署，但可能在不被察觉的情况下改变生成内容。本文旨在诊断和控制这种服务时的一致性（内容漂移）问题。

Result: 在300张真实图像的长文本生成设置下，缩短KV缓存刷新间隔能在1.3倍加速时实现近乎一致的输出。对dLLM-Cache和LaViDa的初步诊断也发现了类似问题，但dLLM-Cache在收紧缓存后失去了速度优势。盲审评估未检测到加速与基线在事实错误率上的显著差异。

Insight: 创新点在于系统地诊断了加速dMLLMs中内容漂移的根源（过时的视觉和文本状态），并提出了一种实现层面的、基于固定刷新间隔的一致性控制方法，为加速模型的可靠性评估提供了诊断框架。

Abstract: Training-free acceleration makes diffusion-based multimodal large language models (dMLLMs) more deployable, but it may silently change generated content. We study this serving-time consistency problem on 300 real images, comparing Fast-dLLM outputs with the same model’s unaccelerated outputs. Across the mild parallelism induced in our long-form setting (1.05–1.25 committed tokens per step), confidence-threshold tuning changes decoding behavior but not baseline agreement. State-refresh ablations and an image-swap intervention instead identify stale visual and generated-text states as contributors to drift. For the tested Fast-dLLM implementation, shortening the KV-cache refresh interval yields a monotonic speed–agreement frontier and near-exact agreement at a measured 1.3x speedup. The initial diagnosis also appears with dLLM-Cache and LaViDa, although dLLM-Cache recovers agreement only after both caches are tightened, which removes its speed advantage. Independent prompts and images reproduce the threshold-insensitivity and refresh recovery. A targeted audit finds genuine content substitution in half of 50 low-agreement pairs. In a separate blinded two-annotator evaluation, the pooled accelerated-minus-baseline factual-error difference is 0.00 (95% CI [-0.17,+0.17]); this sample detects no difference but does not establish factual equivalence. Finally, none of the tested adaptive or smoothed-refresh variants beats the fixed interval at matched compute. Our contribution is a paired diagnostic and an implementation-scoped consistency control, not an accuracy or safety guarantee.

[14] Authorship Verification of Transcribed German-Language Videos cs.CLPDF

Oren Halvani, Sophie Titze

TL;DR: 该论文将作者验证（AV）任务应用于德语视频转录文本，评估了十种AV方法在三个自建语料库上的表现。研究发现，基于字符和词符n-gram的传统方法表现最佳（准确率高达88%，AUC达90%），而基于Transformer的现代方法在所有语料库上均表现显著更差。

Details

Motivation: 解决作者验证领域两个研究不足的挑战：现有研究主要集中于书面文本而非口语转录，且多关注英语而忽视了其他语言（如德语）。

Result: 在包含150位说话人、300个视频的自建德语语料库上，传统n-gram方法达到最高88%准确率和90% AUC，显著优于Transformer方法。

Insight: 论文创新点在于将AV任务拓展至德语口语转录领域，并实证表明在该特定场景下，简单有效的传统特征方法可能比复杂深度学习模型更具竞争力，这对资源有限或领域特定的文本分析具有借鉴意义。

Abstract: Authorship Verification (AV) represents an important subfield of digital text forensics and addresses the fundamental question of whether two texts were written by the same author. Although the field has made substantial progress over the past two decades, several important challenges remain unresolved or underexplored. For instance, most AV research has focused on written texts, despite the fact that language is expressed not only in written but also in spoken form, such as in videos. Moreover, existing AV studies have predominantly concentrated on English, while other languages, including German, have received comparatively little attention. To address these research gaps, we apply AV to spoken language in the form of transcripts of German-language videos and examine the effectiveness of established AV methods in verifying a speaker’s identity across video pairs. Our experimental evaluation, based on a total of ten AV methods applied to three self-compiled corpora comprising 300 videos from 150 speakers, shows that the best performance (up to 88% accuracy and 90% AUC) is achieved by traditional AV approaches based on simple character- and token n-gram representations. In contrast, more modern transformer-based approaches perform significantly worse on all evaluated corpora. Our results therefore suggest that traditional methods in the field of AV remain both competitive and relevant.

[15] Learning Latent Reasoning Traces for Scalar Reward Models End-to-End cs.CLPDF

Sanwoo Lee, Clive Bai, Hsiu-Yuan Huang, Kun Liang, Weijie Liu

TL;DR: 本文提出LatentRM框架，通过将中间推理轨迹建模为离散隐变量，以端到端方式学习显式最大化下游标量奖励似然的奖励模型。该方法在分布内和分布外数据集及RLHF实验中，在开放式对话和复杂推理任务上均优于标量、生成式和混合奖励模型。

Details

Motivation: 传统标量奖励模型依赖表面线索，泛化能力差；生成式奖励模型虽能利用推理提升鲁棒性，但缺乏数值灵活性和概率可解释性。现有混合方法无法保证生成的推理轨迹与下游标量奖励预测对齐。

Result: 在分布内和分布外数据集上的实验表明，LatentRM在偏好建模和策略对齐任务中优于标量、生成式和混合奖励模型，实现了SOTA性能。

Insight: 将推理轨迹作为离散隐变量进行端到端优化，实现了深度推理评估与精确评分的紧密耦合，为奖励模型提供了可解释的中间推理表示。

Abstract: Reward models (RMs) are central to aligning large language models with human preferences via reinforcement learning. Although traditional scalar RMs enable efficient and probabilistic reward modeling, they rely on superficial cues that fail to generalize to complex or out-of-distribution (OOD) tasks. Conversely, generative RMs leverage extensive reasoning to improve robustness on challenging tasks, but their natural language-based scores lack the numerical flexibility and probabilistic interpretability that scalar RMs offer. While recent approaches combine both paradigms through off-policy multi-task learning, such parallel optimization does not guarantee that generated reasoning traces actively align with or benefit downstream scalar reward prediction. To address this mismatch, we propose LatentRM, a reward modeling framework that learns intermediate reasoning traces as discrete latent variables to explicitly maximize the likelihood of downstream scalar rewards. Through on-policy optimization of the latent reasoning space end-to-end, LatentRM tightly couples deep reasoning-based evaluation with precise scoring. Extensive validations on in-distribution and OOD datasets and RLHF show that LatentRM outperforms scalar, generative, and hybrid RMs on preference modeling and policy alignment across tasks ranging from open-ended conversation to complex reasoning.

[16] Hy-MultiTurn: A Six-Dimensional Benchmark for Deep Multi-Turn Dialogue Understanding cs.CLPDF

Eileen Ye, Jiawen Tao, Yaoming Li, Chenxu Liu, Wenhan Yu

TL;DR: 该论文提出了Hy-MultiTurn，一个用于深度多轮对话理解的中文基准测试，包含六个评估维度，旨在全面衡量模型在长对话中处理复杂任务的能力。

Details

Motivation: 现有基准测试通常只覆盖短对话，无法充分评估模型在长多轮交互中的关键能力（如记忆、推理、指代消解等），且缺乏对模型失败原因的深入洞察。

Result: 在构建的209个任务上评估了22个前沿模型配置，结果显示该基准具有广泛挑战性，即使最强的GPT-5.5模型也仅在41.1%的响应中满足所有要求，且没有模型在所有六个维度上都表现最佳。

Insight: 创新点在于从真实聊天机器人失败案例中抽象出六种常见失效机制，并据此构建了可控的、维度丰富的评估框架，为深入分析模型在多轮对话中的能力短板提供了系统性工具。

Abstract: Long-running multi-turn interactions with chatbots and agents are now common, and a correct response often depends on remembering earlier details, tracking later revisions, identifying intended objects or referents, and withholding action when required conditions are unmet. Existing multi-turn benchmarks typically cover short exchanges and do not fully evaluate these capabilities in long multi-turn interactions, particularly in Chinese, while offering limited insight into how and why models fail. To address these limitations, we analyze real chatbot failures to identify six recurring mechanisms and use them to define six controlled evaluation modes in Hy-MultiTurn, a Chinese benchmark for deep multi-turn dialogue understanding. The six modes evaluate constraint memory, precise execution, constraint synthesis, object localization, action suppression, and reference resolution. Across the six modes, we construct 209 controlled tasks spanning 12-76 turns, with dialogue length, irrelevant-topic distraction, and colloquial phrasing adding further difficulty. Evaluation of 22 frontier model configurations shows that Hy-MultiTurn is broadly challenging, as even GPT-5.5, the strongest overall configuration, satisfies all requirements in only 41.1 percent of responses and no model performs best in all six modes.

[17] Knowing When to Quit: Diagnosing and Training LLMs to Abort Futile Reasoning cs.CLPDF

Xinyan Guan, Jiali Zeng, Chunlei Xin, Yaojie Lu, Hongyu Lin

TL;DR: 该论文研究了大型语言模型在超出其能力范围的任务上生成计算成本高昂但语义空洞的推理（即无效推理）的问题，并提出了CaRL（能力对齐强化学习）方法。该方法通过奖励塑造激励模型拒绝而非进行无效推理，并通过后见之明拒绝增强将失败案例转化为拒绝监督，从而将模型行为与其能力边界对齐。实验表明，该方法能显著减少无效推理，同时在不同难度的任务上保持性能。

Details

Motivation: 大型语言模型在面对超出其能力范围的任务时，会产生看似合理但实则错误的推理（即无效推理），这存在误导用户的风险。论文旨在诊断这一现象，并训练模型学会在遇到此类任务时主动放弃推理。

Result: 实验表明，提出的CaRL方法能显著减少无效推理，同时在不同难度的任务上保持性能，有效地实现了能力对齐的行为而不牺牲实用性。

Insight: 论文的创新点在于系统地诊断了LLM的“无效推理”现象，并提出了通过强化学习进行能力边界对齐的训练框架（CaRL），其核心是通过奖励塑造和利用失败案例进行监督来教会模型“知难而退”。这为解决模型过度自信和生成错误但看似合理的输出提供了一个有前景的方向。

Abstract: Large language models generate computationally expensive yet semantically void reasoning on beyond-capability tasks, creating risks where plausible-sounding but incorrect derivations mislead users. We characterize this \textit{futile reasoning} phenomenon through systematic analysis, revealing universal capability overreach and systematic miscalibration between capability and behavior. The dominant failure mode is specious reasoning, which outputs look superficially valid but contain subtle errors, escalating with task difficulty. To address this, we introduce \textbf{CaRL} (\textbf{Ca}pability-\textbf{a}ligned \textbf{R}einforcement \textbf{L}earning), which aligns model behavior with capability boundaries through reward shaping that incentivizes refusal over futile reasoning and hindsight refusal augmentation that converts failures into refusal supervision. Experiments demonstrate a substantial reduction in futile reasoning while preserving performance across task difficulties, effectively achieving capability-aligned behavior without sacrificing utility. \footnote{https://github.com/icip-cas/Knowing-When-to-Quit}

[18] Translation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation cs.CL | cs.AIPDF

Yongshi Ye, Biao Fu, Chongxuan Huang, Yidong Chen, Xiaodong Shi

TL;DR: 本文提出了一种名为TwT（Translation with Thought）的资源理性框架，用于解决多领域机器翻译中不同领域语言复杂度差异带来的挑战。该框架通过强化学习训练，学习在直觉推理和深思熟虑推理之间进行自适应调节，以优化翻译质量和推理效率。

Details

Motivation: 动机源于人类翻译者能根据翻译难度自适应调整推理努力，旨在解决多领域机器翻译中因领域间语言复杂度差异而导致的挑战。

Result: 在涵盖领域内和领域外设置的15个基准测试，以及3种已见和59种未见语言上进行评估，TwT-7B和TwT-14B在翻译质量上超越了更大的SOTA推理模型，同时将token使用量减少了32%至60%。

Insight: 创新点在于将翻译行为与认知原则（如资源理性推理）对齐，通过两阶段训练（监督微调和强化学习）实现难度自适应的推理，从而在保证翻译质量的同时显著提升推理效率，促进模型在多领域和未见语言上的鲁棒泛化。

Abstract: Multi-domain machine translation (MDMT) poses a unique challenge due to varying levels of linguistic complexity across domains. Inspired by human translators’ ability to adapt reasoning effort based on difficulty, we propose TwT (Translation with Thought), a resource-rational framework that learns to modulate inference between intuitive and deliberate reasoning. TwT is trained in two stages: (1) supervised fine-tuning on difficulty-aware long chain-of-thought traces distilled from DeepSeek-R1 and rewritten by GPT-4o to reflect human-like reasoning economy, and (2) reinforcement learning with a hybrid reward to optimize translation quality and reasoning efficiency. Evaluated on 15 benchmarks spanning in-domain and out-of-domain settings, as well as 3 seen and 59 unseen languages, with ablations across three backbone models, TwT-7B and TwT-14B outperform much larger SOTA reasoning models in translation quality, while reducing token usage by 32–60%. These results confirm that aligning translation behavior with cognitive principles enables robust generalization, high translation quality, and efficient reasoning in MDMT.

[19] Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation cs.CLPDF

Goutham Ramakrishnan, Megha Sharma

TL;DR: 本文提出了Data Turnstile，一个用于生成高质量函数调用（function-calling）训练数据的开源框架。该框架通过将多轮工具使用交互分解为受约束的、分步的生成过程，并结合验证和错误反馈循环，来为小型语言模型（SLMs）生成合成数据，以解决其在工具使用任务上因数据稀缺和噪声而表现不佳的问题。

Details

Motivation: 小型语言模型（SLMs）因延迟低、成本低和端侧隐私等优势适合智能体部署，但其在工具使用任务上表现不佳，主要瓶颈在于高质量训练数据的稀缺和噪声。SLMs无法像大模型那样通过巨大参数量来弥补低质量监督，因此数据质量成为关键限制。

Result: 在BFCL单轮基准测试上，使用Turnstile数据微调的Qwen3-0.6B（无思维链）达到了75.9%的整体准确率，优于其启用思维链的基模型（67.4%），并接近了更大的Qwen3-1.7B（78.4%）和Qwen3-4B（79.9%）。在τ²-bench多轮智能体基准测试的Telecom领域，Turnstile训练的Qwen3-1.7B达到了31.1%的pass¹率，是其基模型（6.6%）的4.7倍，并超过了更大的Qwen2.5-32B-Instruct（27.4%）。

Insight: 论文宣称的创新点在于提供了一个可扩展的开放框架，通过将复杂的多轮交互分解为受约束的、可验证的步骤式生成过程，实现了对API多样性、对话复杂度和输出正确性的细粒度控制。从客观角度看，其核心创新在于提出了一种系统化的、可验证的高质量合成数据生成方法论，有效解决了SLMs在特定任务上的数据瓶颈，并通过实验证明了该方法能显著提升小模型性能，甚至使其接近或超越大得多的模型。

Abstract: Small language models (SLMs) are attractive for agentic deployment due to low latency, reduced cost, and on-device privacy, yet they struggle with tool-use tasks where training data is scarce and noisy. Unlike larger models, SLMs cannot compensate for low-quality supervision through sheer capacity, making data quality the critical bottleneck. We present Data Turnstile, an open-source framework that takes user-defined API specifications and generates high-quality synthetic training data for function calling. Turnstile decomposes multi-turn tool-use interactions into constrained, stepwise generation with validation and error-feedback loops, providing fine-grained control over API diversity, conversation complexity, and output correctness. We demonstrate effectiveness of domain adaptation with Turnstile data on two challenging function calling benchmarks. On the BFCL single-turn benchmark, a Qwen3-0.6B fine-tuned on Turnstile data without chain-of-thought achieves 75.9% overall accuracy (versus 67.4% for the base model with thinking enabled), closing the gap with thinking-enabled Qwen3-1.7B (78.4%) and Qwen3-4B (79.9%) despite being 3$\times$ and 7$\times$ smaller respectively. On $τ^2$-bench, a multi-turn agentic benchmark, Turnstile-trained Qwen3-1.7B achieves 31.1% pass^1 on the Telecom domain, improving 4.7$\times$ over its 6.6% base and surpassing Qwen2.5-32B-Instruct (27.4%), a model 19$\times$ larger. Turnstile-trained Qwen3-0.6B achieves 24.6%, improving 7$\times$ over its 3.5% base and approaching the 32B model (53$\times$ larger). We release Data Turnstile along with a dataset spanning 1,000+ APIs and 100K+ multi-turn interactions.

[20] Evidence-Type Competition: When Can Interventional Data Teach Language Models Causal Direction? cs.CL | cs.LGPDF

Xining Xun

TL;DR: 本文通过受控合成环境研究干预数据在训练语言模型因果推理能力中的作用，发现干预数据比例增加并不直接提升模型对因果方向的判断，而是推理时上下文中的证据类型主导模型行为。在Simpson悖论场景中，模型倾向于复制观测相关性而非因果效应，但通过上下文操纵可释放其潜在的因果插值能力。

Details

Motivation: 探究干预数据是否如广泛认为的那样是训练模型因果推理的黄金标准，特别是在观测相关性与因果效应符号相反的系统性场景（如Simpson悖论）中，检验干预数据在预训练中的作用及其与推理时上下文的交互。

Result: 在50个合成世界中，纯观测上下文导致29/50世界出现系统性符号反转，混合上下文为19/50，而仅使用对齐的干预探针时正确率达到41/50。通过消除上下文中的观测证据，因果插值能力立即释放（真实比率提升+0.56）。模型在0.93B参数规模下仍保持稳健的抑制现象（反转率31.8% vs. 仅探针组的6%）。基于探针的因果评估采样噪声下限被量化，且证据平均协议将符号错误从26%降至9%。

Insight: 创新点在于揭示了因果推理能力由模型权重编码，而行为切换由推理上下文介导，并通过激活修补将切换定位到中间层的观测行。研究还量化了基于探针评估的噪声下限，并提出证据平均协议以显著减少符号错误，为理解干预数据在因果学习中的实际作用提供了新视角。

Abstract: Interventional data is widely regarded as the gold standard for teaching models causal reasoning. We test this assumption in a fully controlled synthetic environment pitting observational correlation against causal effect, and find it fails instructively. In Simpson’s-paradox worlds, where the two have systematically opposite signs, increasing the fraction of interventional samples in pretraining does not improve causal direction: the magnitude of the model’s do()-response grows monotonically, yet its sign is copied from the observational context. What governs whether interventional evidence is used is not the training mixture but the evidence type present in the context at inference time. Under an identical training recipe, a purely observational context induces systematic sign reversal in 29/50 worlds, a mixed context in 19/50, while aligned interventional probes alone yield 41/50 correct. Erasing observational evidence from the context immediately releases the suppressed causal interpolation ability (ratio_true = +0.56); a four-state content manipulation shows the switch is content-mediated and graded. The suppression is stable across training seeds (11/11 strong reversals persist on a matched-protocol second seed) and robust as a rate at 0.93B parameters (31.8% vs. 6% reversals in the matched probe-only arm), even as absolute gains shrink four-fold. An external audit on CLadder exposes a learned positive-effect prior with a two-layer structure: sign-randomized retraining removes it in-distribution but not out-of-distribution. We summarize: the capability lives in the weights; the switch lives in the context, and activation patching localizes the switch to the middle layers’ observational rows. We further quantify the sampling noise floor of probe-based causal evaluation and an evidence-averaging protocol that cuts sign errors from 26% to 9%.

[21] Sycophancy Undermines Epistemic Vigilance in Cooperative Vision-Language Tasks cs.CLPDF

Rupak Sarkar, Neha Srikanth, Saloni Gupta, Claire Bonial, Philip Resnik

TL;DR: 本文研究了视觉语言模型在合作性对话任务中的认知警惕性缺陷，提出了一个信息不对称的’找不同’对话任务来评估模型。研究发现，模型倾向于过度迎合对话伙伴而忽视自身私有图像证据，表现出谄媚行为。通过使用从任务无关的谄媚示例中学习的向量进行模型引导，可以减少认知警惕性错误，提升模型在信息不对称合作任务中的可靠性。

Details

Motivation: 为了解决AI系统在复杂合作任务中作为可靠伙伴时，必须能够权衡输入信息与自身私有证据及共享上下文，并在出现不一致时适当指出，从而模拟人类的认知警惕性。

Result: 在信息不对称的对话式’找不同’任务中，模型经常失败，表现为忽视私有图像关键证据而过度同意对话伙伴。通过使用任务无关谄媚示例学习的向量进行引导，可以减少认知警惕性相关错误，使模型更忠实于自身证据。

Insight: 创新点在于提出了一个评估视觉语言模型认知警惕性的新任务，并将模型失败与更广泛的谄媚行为（表现为过度迁就和弱证据基础）联系起来。客观来看，使用任务无关示例学习的向量进行模型引导是一种可借鉴的减少谄媚、提升证据忠实性的方法。

Abstract: To maintain common ground in cooperative conversation, humans iteratively update their beliefs as conversation participants share new information; participants who are epistemically vigilant detect when new information conflicts with prior beliefs and take steps to repair these conflicts. In order for AI systems to serve as reliable partners in complex cooperative tasks, they must similarly weigh incoming information against their own private evidence and shared context and appropriately surface inconsistencies when they arise. To measure the epistemic vigilance of vision-language models in cooperative settings, we present an information-asymmetric, dialog-based “spot-the-difference” task. Two models are privately shown one image each, and must determine through conversation whether the images are identical or, if not, identify the difference. Models routinely fail at this: they frequently overlook key evidence in their private image in favor of agreeing with their conversational partner, even when their agreement is unwarranted. We relate these violations of epistemic vigilance to the broader behavior of sycophancy, which manifests itself in cooperative goal-oriented dialog as over-accommodation and weak evidential grounding. Our results show that model steering to reduce sycophancy with a vector learned from task-agnostic sycophancy examples can reduce epistemic vigilance-related errors, making models more faithful reporters of their evidence, and in turn, more reliable partners in information-asymmetric cooperative tasks.

[22] FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language Models cs.CL | cs.AI | cs.CV | cs.HCPDF

Jeffrey M. Girard, Jason Z. Zheng, Jacqueline R. Vertino, Antony D’Avirro, Benjamin Peloquin

TL;DR: FriendBench是一个用于评估人类和多模态大语言模型在推断两人是否熟悉方面的基准，基于20秒的双人破冰对话片段。研究比较了26个模型与人类在文本、音频和视频模态上的表现，发现最佳模型与人类在准确率上无统计差异，但模型倾向于预测’陌生人’，而人类保持平衡。

Details

Motivation: 解决从社交互动中推断熟悉度的问题，强调行为而非言语在理解社交情境中的重要性。

Result: 在96个平衡双人组上，最佳模型与人类在每种模态的准确率上无统计差异，但模型偏向’陌生人’预测；人类从可见行为中获益，而模型未充分利用。

Insight: 创新点在于引入FriendBench基准，揭示模型与人类在推断熟悉度时的差异，强调多模态数据中行为信息的重要性，可借鉴于社交AI的评估和改进。

Abstract: Reading a social situation often depends on behavior, not words alone. We introduce FriendBench, a benchmark for inferring whether two people are already familiar or are meeting as strangers, from a 20-second clip of a dyadic ice-breaker conversation. Every pair answers the same type of prompt, so only the manner of interaction can reveal the answer. Across text, audio, and video, we compare 26 models from seven companies against matched human panels over 96 balanced dyads. The best model and the human crowd are statistically indistinguishable on accuracy in every modality, but reach it differently: humans stay balanced across the two answers, while the strongest models lean toward “stranger”—a difference in effective prior, not discrimination. Richer channels help both unequally, and only humans gain from visible behavior on top of speech. We release the stimuli, human ratings, and model predictions.

cs.CV [Back]

[23] ReLoop-UME: Recurrent Depth with Learnable Retrieval Registers for Universal Multimodal Embedding cs.CVPDF

Shijie Wang, Xiangzhao Hao, Yueti Li, Guangyu Cao, Xinyu Tang

TL;DR: 本文提出ReLoop-UME，一种用于通用多模态嵌入（UME）的新方法。它通过固定令牌工作空间，在模型深度上扩展有用计算，具体采用一次执行早期层、循环复用参数共享的检索形成块、并在最后循环后应用最终映射层的策略。可学习的检索寄存器提供了持久的检索特定状态，在循环间积累和交换证据，最终寄存器作为嵌入读出。

Details

Motivation: 现有UME模型要么通过单次前向编码形成嵌入，要么通过显式推理令牌和潜在自回归状态增加计算，这增加了检索延迟并使最终嵌入依赖于生成的中间状态。本文旨在探索是否能在保持令牌工作空间固定的同时，沿模型深度扩展有用计算。

Result: 在MMEB-V2和MRMR基准测试上，ReLoop-UME在不同骨干网络上持续改进了检索性能，同时运行速度比UME-R1快44.9倍，比PLUME快1.5倍。

Insight: 创新点在于基于对独立训练的UME模型各层正负相似度分离的分析，提出了一个分阶段的深度扩展架构（早期层、循环检索形成块、最终映射层），并引入了可学习的检索寄存器作为跨循环的持久状态积累机制，从而在提升性能的同时显著降低延迟。

Abstract: Universal multimodal embedding (UME) maps heterogeneous multimodal inputs into a shared embedding space. Existing UME models either form embeddings through single forward encoding or add computation through explicit rationale tokens and latent autoregressive states. Although token expansion can improve complex matching, serial generation increases retrieval latency and makes the final embedding depend on generated intermediate states. This raises a different question: can useful computation be expanded along model depth while keeping the token workspace fixed? We analyze positive-negative similarity separation at every layer of independently trained UME models and observe a shared progression: early layers contextualize multimodal inputs, a contiguous middle-to-late stage forms retrieval-discriminative features, and the final layers map them into the embedding space. Based on this finding, we propose ReLoop-UME, which executes the early layers once, recurrently reuses a parameter-shared retrieval-forming block, and applies the final mapping layers after the last loop. Learnable Retrieval Registers provide persistent retrieval-specific states that accumulate and exchange evidence across loops, with the final register serving as the embedding readout. On MMEB-V2 and MRMR, ReLoop-UME consistently improves retrieval across different backbones while running 44.9x faster than UME-R1 and 1.5x faster than PLUME.

[24] WaiT for the Signal: Simple Frequency-Aware Flow-Matching cs.CV | cs.AI | cs.LG | stat.MLPDF

Krunoslav Lehman Pavasovic, Théophane Vallaeys, Stéphane Mallat, Giulio Biroli, Luke Zettlemoyer

TL;DR: 本文提出了WaiT，一种基于小波变换的图像Transformer模型，用于改进高分辨率图像生成。该方法通过无损小波分解将生成过程分为粗结构和细纹理频带，让高频带在粗结构形成前保持纯噪声，随后共同参与优化，从而提升生成图像的全局一致性、局部细节和纹理保真度。

Details

Motivation: 标准流匹配方法对所有空间频率一视同仁，忽略了自然频率层次结构，即高频带比粗结构更早变得与纯噪声难以区分，这限制了高分辨率图像生成的质量。

Result: 在ImageNet 512x512上，WaiT实现了像素空间FID 1.43，并在所有三个评估轴上达到帕累托最优，采样计算量减少高达50%。其最大的20亿参数模型在ImageNet 512分辨率上取得了像素空间模型新的SOTA FID 1.3，在纹理保真度上甚至优于最强的潜空间模型，并可无缝扩展到高分辨率OpenImages和视频生成，在Kinetics-600上取得了SOTA FVD 0.84。

Insight: 核心创新在于利用小波分解显式建模图像生成的频率层次，让高频成分’等待’低频结构信号出现后再参与优化，这是一种新颖的、物理启发的生成建模视角。该方法还引入了更严格的三轴评估协议来评估原生分辨率下的质量，弥补了标准FID因激进下采样而丢失细节的不足。

Abstract: As image generation models scale to ever higher resolutions, global coherence, local detail, and texture fidelity become critical axes for generation quality. However, standard flow matching treats all spatial frequencies uniformly, ignoring the natural frequency hierarchy where high-frequency bands become indistinguishable from pure noise far earlier than coarse structures. We introduce WaiT, a Wavelet-aware image Transformer that decomposes generation into coarse and fine bands via lossless wavelets. True to its name, the high-frequency bands wait for the signal: staying pure noise until coarse structure has emerged, then joining the flow for joint refinement. Since standard FID discards fine-grained detail through aggressive downsampling, we introduce a more stringent three-axis evaluation protocol to assess quality at native resolution. On ImageNet 512x512, WaiT achieves a pixel-space FID of 1.43 and is Pareto-optimal across all three axes, reducing sampling compute by up to 50%. With our largest 2B model, we set a new state-of-the-art FID of 1.3 for pixel-space models on ImageNet 512 resolution. Our formulation outperforms even the strongest latent-space models on texture fidelity, and scales seamlessly to high-resolution OpenImages and to video generation, achieving a state-of-the-art FVD of 0.84 on Kinetics-600 with no algorithmic modifications.

[25] Can Synthetic Data Overcome the Generalization Limits of AI-Based Flower and Pod Detection Across Cowpea Breeding Genotypes and Environments? cs.CVPDF

Hamid Kamangir, Jonathan Berlingeri, Earl Ranario, Isaac Kazuo Uyehara, Lars Lundqvist

TL;DR: 本文研究了AI模型在豇豆花和荚果检测中跨基因型与环境（G x E）组合时的泛化能力下降问题，发现检测性能在未见条件下显著降低。通过使用基于程序化3D豇豆模型生成的合成图像，并结合针对相机图像形成过程的领域差距感知增强策略，优化后的合成数据仅需少量真实图像即可匹配或超越真实数据基准，从而克服泛化限制。

Details

Motivation: 高通量表型分析需要AI模型能够泛化到不同的基因型、地点和生长季节，但现有模型在新条件下准确性下降，而针对每个G x E组合标注真实图像成本过高。

Result: 在未见G x E偏移下，花朵检测mAP@50从76.3%降至最低50.6%，荚果检测更敏感。优化后的HDR合成数据结合仅5张真实图像，在空间泛化上匹配或超越了真实数据基线，尤其在低样本量时荚果检测受益最大。

Insight: 创新点在于通过测量和优化合成数据与真实数据之间的领域差距（而非忽略），采用领域差距感知的相机真实感增强策略和线性HDR表示，有效缩小了差距并提升了检测性能，为合成数据在农业AI中的实用化提供了方法。

Abstract: High-throughput phenotyping requires AI-enabled computer vision models that generalize across genotypes, locations, and growing seasons, yet such models often lose accuracy under new conditions. Annotating real imagery for every genotype-by-environment (G x E) combination a breeding program encounters is prohibitively expensive. We quantify how G x E shifts affect AI-based detection of cowpea flowers and pods across two California locations and two growing seasons. Flower detection mAP@50 fell from 76.3% to as low as 50.6% under unseen shifts, and pod detection was more sensitive. Feature-space and image-quality diagnostics confirmed these losses track measurable distributional shifts. Because closing this gap with real data alone is not practical, we test whether synthetic imagery, rendered from a procedural 3D cowpea model, can substitute for that annotation burden. Synthetic supervision alone improved over pretraining but remained limited by a domain gap driven by camera image formation, not scene content. A domain-gap-aware camera-realism augmentation strategy, optimized against measured real-image statistics via Wasserstein distance, narrowed this gap, and a linear HDR representation converted a smaller measured gap into a larger detection gain than an 8-bit representation. Optimized HDR synthetic data combined with as few as five real images matched or exceeded the real-data baseline for spatial generalization, and pod detection benefited most at the lowest shot counts, with more modest gains under temporal shift. These results show that synthetic data can overcome the generalization limits of AI-based flower and pod detection, but only when the domain gap is measured and optimized rather than assumed away.

[26] Group-wise Supervision with Focal-Dice Loss for Long-Tailed Indoor Semantic Occupancy Prediction cs.CVPDF

Qi Zheng, Zihuang Su, Xiao Pan

TL;DR: 本文提出了一种名为Group-UFD Occ的新方法，用于解决室内3D语义占据预测中因物体类别长尾分布而导致的性能瓶颈问题。该方法在架构层面引入了细粒度语义分组策略和多尺度并行‘主-专家’预测头，以通过深度正则化引导模型高效学习尾部类别特征；在优化层面提出了统一焦点-骰子（UFD）损失函数，该函数在体素级别动态关注困难样本，同时从区域角度优化预测物体的几何完整性。

Details

Motivation: 室内3D语义占据预测面临的核心挑战是室内场景物体类别高度多样且呈现严重的长尾分布，这限制了现有模型的性能。

Result: 在大规模EmbodiedScan数据集上的实验表明，该方法相比基线模型取得了11.38%的相对性能提升，并在多个关键的长尾类别上获得了显著的准确率增益。

Insight: 主要创新点在于结合了架构层面的细粒度语义分组与多尺度‘主-专家’头设计，以及优化层面的协同损失函数（UFD损失），该损失融合了体素级困难样本聚焦与区域级几何完整性优化，为处理长尾分布问题提供了新的思路。

Abstract: Recently, 3D semantic occupancy prediction has garnered increasing attention for understanding the indoor scene. However, unlike structured outdoor environments, indoor scenes feature a high diversity of object categories that exhibit a severe long-tailed distribution, which has become a core bottleneck limiting the performance of existing models. To tackle this challenge, we propose a novel method, Group-UFD Occ, based on hierarchical semantic supervision and synergistic loss optimization. At the architectural level, we introduce a fine-grained semantic grouping strategy and design multi-scale, parallel ``main-expert’’ prediction heads to guide the model in efficiently learning tail-class features through deep regularization. At the optimization level, we introduce the Unified Focal-Dice (UFD) loss. This synergistic loss function dynamically focuses on hard samples at the per-voxel level. Meanwhile, it simultaneously optimizes the geometric integrity of predicted objects from a region-based perspective. We conducted experiments on the large-scale EmbodiedScan dataset. The results demonstrate that our method yields a relative improvement of 11.38% over the baseline, with substantial accuracy gains in several critical long-tailed categories.

[27] Visual Distribution Anchoring for Efficient Prompt Tuning cs.CV | cs.LGPDF

Pouya Parsa, Raoof Zare Moayedi, Seongjin Choi

TL;DR: 本文提出了一种名为视觉分布锚定（VDA）的无训练目标域适应框架，用于高效提示调优。该方法通过离线从未标注的目标域图像池中估计类级别的视觉原型，来增强冻结的语义分类器，无需目标域标签或优化过程。

Details

Motivation: 现有提示调优方法在效率和适应性之间存在权衡：静态文本提示可能过拟合源域类别，图像条件提示增加计算开销，多模态调优则修改视觉分支。VDA旨在实现无需训练、高效且能适应目标域外观变化的模型适应。

Result: 在十个ImageNet到目标域的迁移任务中，VDA将零样本CLIP、TCP和MaPLe的性能分别提升了3.22、3.39和3.35个百分点，在绝大多数设置下改进了九个目标域。此外，其视觉校正进一步将无泄漏的PromptKD提升了2.79个百分点。

Insight: 创新点在于利用冻结的语义和域模板分类器对未标注目标图像进行类相关分组，构建归一化视觉原型，并通过全局权重与语义分类器融合。该方法无需目标标签、优化或迭代，且类特定分区策略和视觉局部伪标签的有效利用是关键增益来源。

Abstract: Prompt tuning adapts vision–language models with few trainable parameters, but existing approaches trade off efficiency and adaptation: static textual prompts can overfit source classes, image-conditioned prompts add per-instance computation, and multimodal tuning modifies the visual branch. We propose VDA (Visual Distribution Anchoring), a training-free target adaptation framework that augments a frozen semantic classifier with class-level visual prototypes estimated offline from an unlabeled target pool. We first ask whether prototypes can be synthesized from class names. A text-to-centroid mapper reconstructs held-out source prototypes but fails under dataset shift because class names specify semantic identity, not target-domain appearance. An oracle analysis confirms that true target prototypes are highly discriminative. VDA therefore uses frozen semantic and domain-template classifiers to partition unlabeled target images into class-correlated groups. Confidence-ranked image features form normalized prototypes, fused with the semantic classifier using one global weight. Adaptation requires no target labels, target-side optimization, uniform class-prior assumption, iterative refinement, or test-query access, and yields a fixed, cacheable classifier. Controlled experiments show that class-specific partitioning drives gains and that visually local pseudo-label errors can remain useful despite being class-incorrect. Across ten ImageNet-to-target transfers, the same frozen design improves zero-shot CLIP, TCP, and MaPLe by 3.22, 3.39, and 3.35 points, respectively, improving nine of ten targets in every setting. Its visual correction further improves leakage-free PromptKD by 2.79 points, complementing zero-shot, source-prompted, multimodal-prompted, and target-distilled classifiers.

[28] Retrieval-Driven Training-Free AI-Generated Video Attribution cs.CV | cs.AIPDF

Renxi Cheng, Chaolei Han, Jie Gui, Hongsong Wang

TL;DR: 本文提出了一种无需训练的AI生成视频溯源方法，将视频溯源问题构建为实例检索任务，并设计了一个基于生成指纹的流程。该方法通过自适应正交颜色变换、多尺度量化残差生成和时序语义聚合，逐步捕获并整合生成模型在视频帧中引入的伪影。在GenVidBench基准测试上的实验表明，该方法在AI生成视频检测和溯源任务上均取得了优于现有SOTA方法的性能。

Details

Motivation: AI生成的视频越来越逼真，难以与真实视频区分，这助长了恶意滥用，并对网络安全和社会治理构成威胁。因此，将AI生成视频溯源到其特定的生成来源对于取证调查和法律监管至关重要。现有视觉溯源方法主要针对图像且依赖图像生成模型，缺乏对大规模AI生成视频数据的泛化能力。

Result: 在GenVidBench基准上进行的大量实验表明，该方法在AI生成视频检测和溯源方面均取得了强劲性能，优于现有的最先进方法，其Rank-1准确率为20.5%，平均精度均值为16.6%。

Insight: 创新点在于提出了一种无需训练的AI生成视频溯源新范式，将问题形式化为实例检索，并设计了基于生成指纹的流程。该流程通过颜色变换、残差生成和时序聚合来捕获跨帧的生成伪影，这是一种新颖的、不依赖模型训练的特征提取和融合方法，对视频取证领域有借鉴意义。

Abstract: AI-generated videos are becoming increasingly realistic and difficult to distinguish from authentic ones, which facilitates malicious misuse and poses growing threats to cybersecurity and social governance. Attributing AI-generated videos to their specific generative sources is therefore of critical importance for forensic investigation and legal regulation. However, most existing visual attribution methods focus on images and particularly rely on the image generation model, thereby lacking the ability to generalize to large-scale AI-generated video data. To address these limitations, we introduce an training-free AI-generated video attribution paradigm. Specifically, we formulates AI-generated video attribution as an instance retrieval task, and design a generative fingerprint-based pipeline. This pipeline consists of an adapted orthogonal color transformation, multi-scale quantized residual generation, and temporal-semantic aggregation, progressively capturing and integrating artifacts introduced by generative models across video frames. Extensive experiments on the GenVidBench benchmark demonstrate that our method achieves strong performance in both AI-generated video detection and attribution, outperforming existing state-of-the-art methods with a Rank-1 accuracy of 20.5% and a mean Average Precision of 16.6%. The code is at https://github.com/renxi-seu/Video_Attribution.

[29] SafeNexus: Discovering and Steering Modality-Universal Safety Neurons in MLLMs cs.CVPDF

Jian Yu, Fei Shen, Cong Wang, Jian Wang, Lu Jin. Xiaoyu Du

TL;DR: 本文提出SafeNexus框架，用于在多模态大语言模型中发现并调控模态通用的安全神经元，以应对跨模态安全威胁。该方法通过神经元定位范式识别模态绑定安全神经元，并从中提取出模态通用安全神经元作为防御核心，进而设计了激活级安全放大器和安全神经元校准器两种策略来增强模型安全性。

Details

Motivation: 现有LLM的安全机制在扩展到MLLM时存在显著差距，当前防御方法多局限于特定模态，难以应对更广泛的跨模态安全威胁。

Result: 在涵盖多种模态组合的安全基准测试中，该方法优于当前最先进的方法，同时有效保持了模型的实用性。

Insight: 创新点在于提出了一个神经元级别的跨模态安全对齐框架，通过识别和调控模态通用安全神经元来统一防御跨模态攻击，这为理解模型内部安全机制和进行针对性干预提供了新视角。

Abstract: Although Large Language Models (LLMs) have demonstrated promising safety performance, extending them to Multimodal Large Language Models (MLLMs) exposes a significant gap between expanded multimodal capabilities and existing safety mechanisms. Current defenses remain predominantly confined to specific modal settings, thereby limiting their robustness against broader cross-modal threats. To bridge this gap, we introduce SafeNexus, a cross-modal safety alignment framework that adopts a dedicated neuron-level intervention strategy. First, we formulate a neuron localization paradigm that identifies functionally specialized neurons by characterizing intermediate-layer activation patterns and quantifying their functional salience through importance scoring. Building upon this paradigm, we exploit contrastive data to identify modality-bound safety neurons (BS-Neurons), and validate their role in regulating safety behavior within each modality via targeted suppression. Further cross-modal analysis defines modality-universal safety neurons (US-Neurons) as the shared subset of BS-Neurons identified across individual modalities, serving as the core for defending against harmful cross-modal attacks. We observe that suppressing these neurons substantially degrades safety performance across modalities, while leaving overall utility largely unaffected. Building on these insights, we propose two safety alignment strategies: activation-level safety amplifier and safety neuron calibrator. The proposed strategies enhance model safety through two distinct routes: the former amplifies the activation magnitudes of US-Neurons, while the latter selectively calibrates them via targeted fine-tuning. Extensive experiments demonstrate that our method outperforms prevailing state-of-the-art approaches on safety benchmarks spanning diverse modality combinations, while effectively preserving utility.

[30] Classification of COVID-19 cases from chest CT volumes using hybrid model of 3D CNN and 3D MLP-Mixer cs.CVPDF

Masahiro Oda, Tong Zheng, Yuichiro Hayashi, Yoshito Otake, Masahiro Hashimoto

TL;DR: 本文提出了一种用于COVID-19胸部CT体积自动分类的混合模型，该模型结合了3D CNN和3D MLP-Mixer。该方法旨在通过同时利用局部和全局图像特征来辅助诊断，并在包含1205个CT体积的数据集上实现了79.5%的分类准确率。

Details

Motivation: COVID-19大流行导致医疗资源紧张，需要计算机辅助诊断系统来提供快速、定量的诊断结果，以缓解人力短缺。由于病毒性肺炎（包括COVID-19）在肺部影像中同时涉及局部和广泛的病变特征，因此需要一种能有效捕捉这两类特征的分类方法。

Result: 在包含1205个CT体积的数据集上，所提出的混合模型达到了79.5%的分类准确率，其性能优于仅由3D CNN层和简单MLP层组成的传统3D CNN模型。

Insight: 主要创新点在于将3D CNN与3D版本的MLP-Mixer结合，构建了一个混合模型，以同时提取CT体积中的局部和全局特征。这借鉴了Vision Transformer架构的思路，并将其成功应用于3D医学影像分类任务，为处理具有复杂空间特征的体积数据提供了一种新思路。

Abstract: This paper proposes an automated classification method of COVID-19 chest CT volumes using improved 3D MLP-Mixer. Novel coronavirus disease 2019 (COVID-19) spreads over the world, causing a large number of infected patients and deaths. Sudden increase in the number of COVID-19 patients causes a manpower shortage in medical institutions. Computer-aided diagnosis (CAD) system provides quick and quantitative diagnosis results. CAD system for COVID-19 enables efficient diagnosis workflow and contributes to reduce such manpower shortage. In image-based diagnosis of viral pneumonia cases including COVID-19, both local and global image features are important because viral pneumonia cause many ground glass opacities and consolidations in large areas in the lung. This paper proposes an automated classification method of chest CT volumes for COVID-19 diagnosis assistance. MLP-Mixer is a recent method of image classification using Vision Transformer-like architecture. It performs classification using both local and global image features. To classify 3D CT volumes, we developed a hybrid classification model that consists of both a 3D convolutional neural network (CNN) and a 3D version of the MLP-Mixer. Classification accuracy of the proposed method was evaluated using a dataset that contains 1205 CT volumes and obtained 79.5% of classification accuracy. The accuracy was higher than that of conventional 3D CNN models consists of 3D CNN layers and simple MLP layers.

[31] Adjudicated Captioning: Multi-Agent Alignment Scoring and Consensus-Distilled Beam Arbitration for Strict Zero-Shot Image Captioning cs.CV | cs.AI | cs.CL | cs.MAPDF

Duy Tran Thanh, Thien-Phuc Doan, Long Nguyen-Vu, Ngo Tan Vu Khanh

TL;DR: 本文提出了一种名为’裁决式图像描述’的推理时多智能体框架，用于严格的零样本图像描述任务。该方法在无需重新训练描述生成器的情况下，通过引入一个更强的检索编码器、一个交叉注意力验证器和一个基于蒸馏学习的重排序器，在推理过程中多个检查点提供视觉基础反馈，从而显著提升了图像描述的生成质量。

Details

Motivation: 现有零样本图像描述方法在检索阶段进行一次图像-文本对齐评分后，解码过程仅依赖语言模型概率，缺乏持续的视觉基础反馈，导致性能提升停滞。本文旨在解决这一视觉基础反馈缺失的问题。

Result: 在COCO Karpathy测试集上，该方法将CIDEr分数从IFCap的108.0提升至117.6，SPICE从20.3提升至21.9，实现了+9.6的CIDEr增益，超越了当前最强的合成图像增强方法NES（CIDEr 109.9）。该方法在Flickr30k和NoCaps数据集上同样有效，实现了+8.1和+5.7的CIDEr增益。

Insight: 核心创新在于推理时多智能体架构，通过冻结的检索编码器、交叉注意力验证器和基于Borda共识蒸馏训练的重排序器，在多个阶段提供视觉对齐反馈。该方法的大部分性能增益（+7.8 CIDEr）来自非学习的架构干预，而非参数学习，展示了通过改进推理流程而非模型训练来提升零样本任务性能的有效路径。

Abstract: Zero-shot image captioning (ZIC) describes images without paired image-caption supervision during captioner training, relying on text-only corpora and frozen pretrained image-text scorers. Existing retrieval-augmented methods score image-text alignment once, at retrieval, then commit the captioner’s autoregressive beam under language-model probability alone, leaving the decoder without further visual grounding feedback. Progress has stalled, with no method improving on the strict-regime best since 2024. We propose Adjudicated Captioning, an inference-time multi-agent framework that restores grounding feedback at multiple checkpoints over an unchanged IFCap captioner. First, we install a stronger frozen Retrieval Encoder at the input. Second, between retrieval and decoding we insert a frozen Cross-Attention Verifier that re-ranks the top-9 retrievals to top-5. Third, at the output beam we attach a learned Reranker pairing TriFuse, a multilayer perceptron, with MemAttend, a memory-attended transformer, the pipeline’s only learned components; both are trained self-supervised by Borda-consensus distillation across the three frozen scorers, using no paired image-caption labels and no reference captions. Under the inductive headline protocol, with rerankers fit on the disjoint COCO Karpathy validation beam and applied frozen to test, the framework reaches CIDEr 117.6 and SPICE 21.9 on COCO Karpathy, up from 108.0 and 20.3 for IFCap, a +9.6 CIDEr gain, and +7.7 above NES, the strongest synthetic-image-augmented method at 109.9, without retraining the captioner. A training-free fixed-fusion baseline reaches 115.8 CIDEr, so +7.8 of the +9.6 gain comes from the non-learned architectural intervention and the remaining +1.8 from the learned rerankers. The same recipe transfers off-COCO without captioner retraining: +8.1 CIDEr on Flickr30k Karpathy and +5.7 on NoCaps overall.

[32] CAER: Conflict-Aware Evidence Routing with Dual Prefix Experts for Multimodal Large Language Models cs.CVPDF

Zixuan Liu, Juntao Cai, Xiaoxu Cai, Haishuai Wang, Jiajun Bu

TL;DR: 本文提出CAER框架，用于解决多模态大语言模型在处理文本与视觉证据冲突时产生的幻觉问题。该框架通过跨度锚定证据路由实现细粒度冲突检测，并利用双前缀专家路由机制实现冲突感知的生成，无需更新主干模型参数即可提升模型可靠性。

Details

Motivation: 现有方法在文本输入与视觉证据冲突时缺乏细粒度的冲突定位和冲突感知生成能力，导致模型产生与视觉内容不一致的幻觉响应。

Result: 在公开的MMMC基准和新构建的AgriConflict数据集上，CAER能有效检测视觉-语言冲突，并提升开源MLLMs的可靠性，无需更新主干参数。

Insight: 创新点包括跨度锚定证据路由将声明转化为软查询以检索视觉证据，以及双前缀专家路由机制通过显式专家选择实现冲突感知生成，框架与主干模型无关，具有通用性。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in multimodal understanding and generation. However, when textual inputs conflict with visual evidence, they still suffer from hallucinations and produce responses inconsistent with visual content. Existing approaches mainly rely on decoding strategies, additional training, verification methods, or prompting techniques, but often lack fine-grained conflict localization and conflict-aware generation. In this work, we propose CAER, a backbone-agnostic framework for visual-language conflict detection and conflict-aware generation. CAER introduces a span-grounded evidence router that transforms claim representations into soft textual queries and retrieves corresponding evidence from frozen visual tokens, enabling fine-grained conflict estimation. Furthermore, we design a dual-prefix expert routing mechanism that learns separate experts for visually supported and contradicted inputs, enabling conflict-aware generation through explicit expert selection. Experiments on the public MMMC benchmark and our newly curated AgriConflict dataset demonstrate that CAER effectively detects visual-language conflicts and improves the reliability of open-source MLLMs without updating their backbone parameters.

[33] Evaluation-Verification Reward for Consistent Multi-Reference Image Editing cs.CVPDF

Yingmao Miao, Pengfei Zhang, Xiaochen Lv, Meng Yu, Lei Sun

TL;DR: 本文提出了一种名为评估-验证奖励（EVR）的新方法，用于提升多参考图像编辑任务中的视觉一致性与和谐度。该方法通过将评估分解为多个视觉标准，并利用多模态大语言模型（MLLM）生成假设，再由验证器基于具体视觉证据进行验证，从而产生可靠的细粒度奖励信号。结合可扩展的数据管道，该方法能够在不改变模型架构的情况下，对现成的图像编辑器进行强化学习微调。

Details

Motivation: 当前多参考图像编辑面临的主要挑战是如何在多个参考图像之间保持视觉一致性并确保整体视觉和谐。虽然强化学习在文本到图像生成和单图像编辑中效果显著，但其在多参考编辑中的应用因缺乏能够捕捉多图像关系约束的合适奖励模型而受阻。此外，直接使用多模态大语言模型（MLLMs）作为零样本评估器存在幻觉倾向的长篇推理与短篇判断有限演绎能力之间的关键矛盾。

Result: 大量实验表明，该方法在基础模型Qwen-Image-Edit上取得了显著提升，在一致性与和谐度方面达到或超越了当前先进模型NanoBanana的水平。

Insight: 核心创新点在于提出的多维评估-验证奖励（EVR）机制，它将主观评估任务分解并引入假设生成与证据验证的分离流程，从而提高了奖励信号的可靠性和细粒度。从客观角度看，这种将大模型评估与具体视觉证据锚定相结合的方法，为解决多模态任务中评估的模糊性和不可靠性提供了一种可借鉴的思路，且其无需修改编辑器架构的设计具有良好的通用性和可扩展性。

Abstract: While recent image editing models have made rapid progress, multi-reference editing remains challenging, particularly in maintaining visual consistency across references and ensuring overall visual harmony. Reinforcement learning has proven highly effective for text-to-image generation and single-image editing, but its extension to multi-reference editing is hindered by the absence of suitable reward models that capture multi-image relational constraints. Moreover, naively using multimodal large language models(MLLMs) as zero-shot evaluators faces a key tension between hallucination-prone long-form reasoning and the limited deductive power of short-form judgments. We address these issues with a Multi-dimensional Evaluation-Verification Reward(EVR). EVR decomposes evaluation into distinct visual criteria; for each criterion, an MLLM Evaluator generates multiple candidate hypotheses, and a Verifier grounds each claim in concrete visual evidence to accept or reject it, producing reliable and fine-grained reward signals. Together with a scalable data pipeline, our method enables RL fine-tuning of off-the-shelf editors without architectural changes. Extensive experiments show substantial gains over the base Qwen-Image-Edit, improving consistency and harmony to match or surpass NanoBanana.

[34] SAM+D: Parameter-Efficient Dimensional Lifting of SAM-Family Models via Depth-Routed LoRA and Depth Shifting cs.CVPDF

Yu Song, Hao Sun, Shiyu Teng, Ikuko Nishikawa, Yen-wei Chen

TL;DR: 本文提出了SAM+D框架，通过引入深度路由LoRA（DRLoRA）和深度移位模块（DSM）两个轻量级模块，以参数高效的方式将2D基础模型（如SAM）提升至3D体积分割，并首次通过参数高效微调实现基于视频的SAM2的端到端4D时空分割。该方法在多个CT基准数据集和细胞追踪数据集上取得了竞争性或更优的结果，同时仅需微调少量参数。

Details

Motivation: 现有方法将2D基础模型（如SAM）适配到3D体积时，要么独立处理切片而忽略切片间上下文，要么需要大量架构修改和重新训练。本文旨在以参数高效的方式解决这一问题，在保持预训练参数冻结的同时，实现跨维度的上下文建模。

Result: 在3D分割任务中，SAM+D在KiTS、Pancreas、LiTS和Colon四个CT基准数据集上评估；在4D分割任务中，在CTC数据集Fluo-N3DH-SIM+上评估。SAM+D在单点提示设置下取得了竞争性或更优的结果，同时仅微调了约2.8%（SAM）和3.7%（SAM2）的参数，优于现有方法。

Insight: 创新点包括：1) 深度路由LoRA（DRLoRA）专家，通过学习路由实现空间自适应的低秩更新；2) 深度移位模块（DSM），以零额外参数成本实现跨切片特征交换。这些模块是模型无关的，可推广到不同SAM家族架构、目标维度（3D、4D）和领域（如医学成像和生物场景理解）。

Abstract: Existing methods for adapting 2D foundation models such as SAM to 3D volumes either process slices independently—ignoring inter-slice context—or require substantial architectural changes and retraining. In this paper, we present \textbf{SAM+D}, a parameter-efficient framework that lifts SAM-family models by one spatial dimension—enabling 3D volumetric segmentation from 2D SAM and, for the first time via parameter-efficient fine-tuning, end-to-end 4D (3D+T) spatiotemporal segmentation from video-based SAM2—while keeping the vast majority of pre-trained parameters frozen. SAM+D introduces two lightweight, model-agnostic modules into frozen transformer blocks: (1)~~\textbf{Depth-Routed LoRA (DRLoRA)} experts with learned routing for spatially adaptive low-rank updates, and (2)~~\textbf{Depth Shift Modules (DSM)} for cross-slice feature exchange at zero additional parameter cost. Together, they provide volume-level context while tuning only ${\sim}$2.8% of parameters for SAM and ${\sim}$3.7% for SAM2. We evaluate SAM+D in two distinct settings, each lifting the base model by one spatial dimension: 3D segmentation, where SAM(2D$,\to,$3D) is evaluated on four CT benchmarks (KiTS, Pancreas, LiTS, Colon), and 4D segmentation, where SAM2 (2D+T$,\to,$3D+T) is evaluated on a cell tracking challenge (CTC) dataset (Fluo-N3DH-SIM+). In both settings SAM+D achieves competitive or superior results under the single-point prompt setting while using fewer trainable parameters than existing methods, demonstrating that SAM+D generalizes across SAM-family architectures, target dimensionalities (3D, 4D), and domains spanning medical imaging and bio-scene understanding. Code is publicly available at https://github.com/JerrySongCST/SAM-Plus-D.

[35] Adaptive Emotional Video Captioning via Affective Heterogeneous Graph Reasoning and Multi-task Joint Learning cs.CVPDF

Junbo Wang, Liangyu Fu, Yuke Li, Xuecheng Wu, Zhiyong Wang

TL;DR: 本文提出了一种名为SAGML的自适应情感视频描述框架，通过构建软情感异构图和引入多任务语言建模，旨在生成兼具事实准确性和情感表现力的视频描述。该方法解决了现有方法依赖全局情感向量或刚性层次先验的局限性，特别是针对粗粒度类别预测不准确时可能错误抑制正确词汇情感，以及难以表示真实视频中常见混合或重叠情感的问题。

Details

Motivation: 现有情感视频描述方法大多依赖全局情感向量或刚性层次先验（如树状结构），当粗粒度情感类别预测不准确时，其硬性隶属掩码会不可逆地抑制正确的词汇级情感，且难以有效表示真实视频中频繁出现的混合或重叠情感。

Result: SAGML框架通过软情感异构图推理和多任务联合学习，提供了一个对错误具有弹性且能感知多情感的情感视频描述基线模型。

Insight: 创新点在于将离散的情感先验树结构转化为一个包含目录级情感节点和词汇级情感词节点的软情感异构图，并通过软门控机制作为视频到情感图注意力的连续偏置，使得视觉支持的词汇情感保持可恢复性。同时，采用结合自回归描述生成和情感分布监督的联合目标进行训练。

Abstract: Emotional video captioning (EVC) aims to describe a video with both factual correctness and affective expressiveness. It requires a model to perceive subtle, ambiguous, and temporally varying emotional cues and translate them into natural language without weakening objective visual content. Existing methods have progressively introduced contextual attention, emotion interpretation, emotion priors, dynamic emotion perception and emotion-cause reasoning. Nevertheless, most of them still depend on either global emotion vectors or rigid hierarchical priors. In recent methods, the tree-structured emotion prior establishes a coarse-to-fine connection between psychological emotion categories and daily emotion words, but its hard subordinate masking may irreversibly suppress correct lexical emotions once the coarse category prediction is inaccurate. It is also limited in representing mixed or overlapping emotions that frequently occur in real videos. To address the issues, we propose SAGML, an adaptive EVC framework via affective heterogeneous graph and multi-task language modeling. Instead of treating the emotion prior as a discrete tree, SAGML constructs a soft affective heterogeneous graph containing catalog-level emotion nodes and lexical-level emotion word nodes. The soft gate is injected into video-to-emotion graph attention as a continuous bias, allowing visually supported lexical emotions to remain recoverable rather than being removed by a hard mask. The resulting affective representation is fed together with visual tokens into a causal language decoder, while dual catalog and lexical heads impose explicit emotion distribution learning on the prompt hidden states. The overall model is trained with a joint objective that combines autoregressive caption generation and emotion distribution supervision. SAGML provides an error-resilient and multi-emotion-aware baseline for EVC.

[36] ReMoE: Report-Guided Mixture-of-Experts for Multimodal OCT/OCTA Anomaly Detection cs.CVPDF

Zihan Nie, Qincheng Qiao, Muhao Xu, Wei Feng, Xinguo Hou

TL;DR: 本文提出了一种名为ReMoE（Report-Guided Mixture-of-Experts）的新方法，用于视网膜光学相干断层扫描（OCT）和光学相干断层扫描血管成像（OCTA）的多模态异常检测。该方法通过将正常医学报告中的语义信息蒸馏到图像-文本先验学生模型中，构建模态感知先验，并利用报告引导的模态调制（RMM）通过专家混合路由来调制特征，从而更好地捕捉多模态正常模式。

Details

Motivation: 现有的无监督方法主要依赖视觉特征分布、重建残差或编码器-解码器差异，其异常评分仅基于外观层面的偏差，而忽略了正常医学报告所描述的语义组织信息。因此，本文旨在利用报告中的语义信息来增强多模态异常检测。

Result: 在包含配对正常报告的私有OCT/OCTA数据集以及使用固定正常报告的公开OCTA500-3MM设置上进行的实验表明，该方法取得了最先进的性能。

Insight: 创新点在于将医学报告的语义信息显式地整合到异常检测框架中，通过报告引导的模态调制和专家混合路由机制，使模型能够学习到超越视觉外观的、包含语义组织的正常模式，这为多模态医学异常检测提供了新的思路。

Abstract: Multimodal medical anomaly detection identifies samples deviating from normal patterns, where scarce abnormal cases make normality modeling from normal data practical. In retinal Optical Coherence Tomography (OCT) and OCT Angiography (OCTA) anomaly detection, existing unsupervised methods rely on visual feature distributions, reconstruction residuals, or encoder-decoder discrepancies, making anomaly scores depend on appearance-level deviations, while multimodal normality also contains semantic organization described in normal medical reports. To this end, we propose Report-Guided Mixture-of-Experts (ReMoE), which distills normal report semantics into an image-to-text prior student, builds modality-aware priors, and uses Report-Guided Modality Modulation (RMM) to modulate features through mixture-of-experts routing. Experiments on a private OCT/OCTA dataset with paired normal reports and a public OCTA500-3MM setting using a fixed normal report demonstrate state-of-the-art performance.

[37] Parameter-Efficient Fine-Tuning for Spiking Point Cloud Models cs.CVPDF

Zihao Guo, Jihua Zhu, Yiding Sun, Lin Chen, Danwei Wang

TL;DR: 本文提出了SpikePEFT，首个用于脉冲点云模型的参数高效微调框架。该框架通过Intrinsic Dynamics Tuning（IDT）自适应调制神经元膜电位衰减和发放阈值，并利用Silent-State Disambiguation Adaptation（SSDA）从信息丰富的静默状态中恢复任务相关信息，从而在仅更新约5%参数的情况下实现高效下游任务适应。

Details

Motivation: 现有预训练脉冲点云模型依赖全参数微调进行下游任务适应，导致巨大的参数和存储开销；同时，二值脉冲传播抑制了任务相关的亚阈值信息。

Result: 在多个基准测试中验证了方法的有效性和效率，在ModelNet40上达到92.4%准确率，在最具挑战性的ScanObjectNN(PB_T50_RS)分类任务上达到85.6%准确率，同时保持了SNNs的能效优势。

Insight: 创新点在于提出了针对脉冲神经网络的参数高效微调框架，核心是IDT（神经元内在动力学调优）和SSDA（静默状态消歧适应），前者实现了高效的神经元内在适应，后者从静默状态中挖掘了被抑制的任务相关信息，为脉冲模型的高效适应提供了新思路。

Abstract: Spiking Neural Networks (SNNs) offer energy-efficient solutions for point cloud analysis on resource-constrained devices through event-driven computation. However, existing pre-trained spiking point cloud models rely on full fine-tuning for downstream task adaptation, incurring substantial parameter and storage overhead. Furthermore, binary spike propagation suppresses task-relevant sub-threshold information. To address these issues, we propose SpikePEFT, the first parameter-efficient fine-tuning framework for spiking point cloud models. Specifically, Intrinsic Dynamics Tuning (IDT) adaptively modulates membrane decay and firing thresholds, enabling efficient neuron-intrinsic adaptation while keeping the pre-trained synaptic transformations frozen. Moreover, Silent-State Disambiguation Adaptation (SSDA) recovers task-relevant information from informative silent states, thereby providing richer evidence for downstream adaptation. Extensive experiments across multiple benchmarks demonstrate the effectiveness and efficiency of SpikePEFT. In particular, our method achieves 92.4% accuracy on ModelNet40 and 85.6% on the most challenging classification split ScanObjectNN(PB_T50_RS) while updating only about 5% of the trainable parameters and preserving the energy efficiency of SNNs. This work provides a promising step toward parameter-efficient adaptation of neuromorphic vision models.

[38] MHRGait: Gait Recognition from Momentum Human Rig Pose cs.CVPDF

Huiran Duan, Qian Zhou, Xianda Guo, Hua Zou, Guoying Zhao

TL;DR: 该论文提出了一种新的步态识别表示方法MHRGait，使用从单目视频估计的184维动量人体骨骼（MHR）姿态参数作为输入，通过建模其帧内协调和时序演化来生成紧凑的步态描述符。进一步提出的MHRGait++融合了MHR姿态和剪影信息，在多个基准测试上取得了优异性能，并实现了高效的识别网络。

Details

Motivation: 现有步态识别方法依赖于剪影、骨架或3D网格等几何载体，这些载体本身会随衣物、体型等因素变化，可能混淆身份信息。本文旨在探索是否可以从紧凑的、语义化的关节控制参数（即MHR姿态）中识别步态，以更直接地捕捉身份相关的运动模式。

Result: 在CCPG和SUSTech1K基准测试上，MHRGait在基于模型的方法中取得了最佳整体性能，并能有效跨数据集迁移。其识别网络仅需2.76M参数和0.69 GFLOPs（处理30帧输入）。MHRGait++能持续提升基于剪影的识别器性能，并在准确性和效率间取得良好平衡。

Insight: 创新点在于首次将人体骨骼（rig）空间的关节控制参数作为独立的步态表示，并证明其有效性。通过按解剖结构分组参数、建模其协调性和时序动态，以及提出模态平衡的距离融合方法（MHRGait++），实现了对步态运动更本质的编码，并能与现有剪影表示互补。

Abstract: Gait recognition is shaped by its input representation. Silhouettes encode projected body shape, skeletons encode sparse joint coordinates, and 3D meshes encode dense surface geometry. In each case, identity-bearing articulation is observed through geometric carriers that also vary with clothing, skeletal scale, or body shape. We investigate whether gait can instead be recognized from compact articulated controls. We introduce Momentum Human Rig (MHR) pose as a gait representation, describing each frame using 184 semantically organized body and hand parameters estimated from monocular video. MHRGait groups these heterogeneous controls by anatomy, models their intra-frame coordination and temporal evolution, and produces compact body and hand descriptors. We further introduce MHRGait++, which combines MHR pose with silhouettes through modality-balanced distance fusion, preventing descriptor count from determining modality importance. Experiments on four benchmarks show that MHRGait attains the best overall performance among compared model-based methods on CCPG and SUSTech1K and transfers effectively across datasets, while its recognition network requires only 2.76M parameters and 0.69 GFLOPs for a 30-frame input. MHRGait++ consistently improves silhouette recognizers with a favorable accuracy-efficiency trade-off. These results establish rig-space articulation as an effective standalone gait representation and a complementary cue to projected body shape. Our code is available at https://github.com/duanhuiran/MHRGait.

[39] SciFigPlag-Bench: A Benchmark for Provenance-Aware Scientific Figure Plagiarism Detection cs.CV | cs.LGPDF

Zhiying Cui, Minghao Yang, Linlin Gao, Jie Liu, Pengyuan Li

TL;DR: 本文提出了SciFigPlag-Bench，一个用于溯源感知科学图表抄袭检测的基准测试。该基准不同于一般的图像相似性或取证基准，它专注于评估可疑图表是否复用了特定源图表中的证据、如何转换以及复用证据的位置。基准包含2,582个正例对和2,541个负例对，支持四种诊断任务，并通过实验揭示了现有视觉语言模型在细粒度溯源推理方面的挑战。

Details

Motivation: 科学图表是科学发现的重要视觉证据，但图表抄袭作为一个多模态评估问题尚未得到充分探索，缺乏专门的基准测试。

Result: 实验使用多种视觉语言模型建立了初始基线，结果表明模型在细粒度溯源推理、复用类型理解和空间证据定位方面仍面临持续挑战。

Insight: 创新点在于提出了一个因子化的分类法，将“复用内容”与“转换方式”分离，并构建了一个结合真实案例、合成示例和视觉相似负例的混合基准，以支持更全面的诊断任务评估。从客观角度看，该工作将抄袭检测从简单的相似性匹配提升到了需要理解内容和转换的溯源推理层面，为多模态文档分析提供了新的评估框架。

Abstract: Scientific figures often encode the visual evidence behind scientific findings, yet figure plagiarism remains underexplored as a benchmarked multimodal evaluation problem. We present SciFigPlag-Bench, a benchmark for provenance-aware reasoning over scientific figures in scholarly documents. Unlike general image-similarity or image-forensics benchmarks, SciFigPlag-Bench evaluates whether a suspicious figure reuses evidence from a specific source figure, how the reused content has been transformed, and where the reused evidence appears. We introduce a factorized taxonomy that separates what is reused from how it is transformed, covering material-preserving reuse, such as full-figure and subfigure reuse, as well as abstract-content reuse, such as data re-expression and structural redraw. Guided by this taxonomy, we construct a hybrid benchmark with 2,582 positive pairs and 2,541 negative pairs, combining documented real-world cases, taxonomy-guided synthetic examples, and visually similar negatives. The benchmark supports four diagnostic tasks: pairwise detection, source attribution, hierarchical reuse-type classification, and reuse correspondence localization. Experiments with diverse vision-language models establish initial baselines and reveal persistent challenges in fine-grained provenance reasoning, reuse-type understanding, and spatial evidence grounding.

[40] On the Efficacy of Self-Supervised Point Cloud Encoders for Efficient 3D Large Language Models cs.CVPDF

Yao Zheng, Tian Zhang

TL;DR: 本文系统研究了低成本自监督点云编码器（如PCP-MAE和Point-MAE）能否替代昂贵的多模态编码器，用于构建高效的3D大语言模型。通过在MiniGPT-3D测试平台上进行大量实验，评估了不同编码器初始化、预训练设置、架构和目标组合的性能。

Details

Motivation: 现有3D点云-语言模型依赖计算成本高昂的多模态编码器（如ULIP-2），需要图像-文本-点云对齐和大量算力，这阻碍了研究和部署。本文旨在探索低成本自监督点云编码器作为有效替代方案的可行性。

Result: 在MiniGPT-3D上，随机初始化的编码器经过端到端训练后达到52.50%的开放词汇准确率和44.45的标题生成分数，接近顶级预训练变体。最佳自监督组合（PCP-MAE + MaskTransformer）达到59.00%准确率，但纯几何编码器在ModelNet40封闭集分类上表现较弱（仅13-18% vs 多模态基线约62%）。

Insight: 研究发现：1）从随机初始化开始端到端训练3D编码器是可行的；2）架构（如MaskTransformer与PointTransformer）与预训练目标（如PCP-MAE与Point-MAE）存在强烈的交叉交互效应；3）纯几何编码器在封闭集分类任务上仍是核心弱点。这为成本效益高的3D-LLM设计提供了实用指南，并揭示了自监督目标与编码器架构间的交互模式。

Abstract: 3D point cloud-language models (3D-LLMs) enable 3D understanding by pairing point cloud encoders with large language models, but existing methods rely on costly multi-modal encoders (e.g., ULIP-2) that require image-text-point cloud alignment on 8x A100-scale compute, creating high barriers for research and deployment. In this work, we systematically investigate whether low-cost self-supervised point cloud encoders, specifically PCP-MAE and Point-MAE, can serve as effective alternatives. Using MiniGPT-3D as our testbed, we evaluate 7 encoder initialization/pre-training setups (1 multi-modal baseline, 5 self-supervised, 1 random init) under frozen and unfrozen fine-tuning (12 total groups), across 2 architectures (MaskTransformer, PointTransformer), 3 objectives (PCP-MAE, Point-MAE, random init), and 2 datasets (Objaverse 660K, ShapeNet55-34 approximately 50K). Our experiments reveal three key findings: (1) The four-stage MiniGPT-3D pipeline can effectively train a 3D encoder from random initialization: an end-to-end trained random init encoder reaches 52.50% open-vocabulary accuracy and 44.45 captioning score, approaching top pre-trained variants; (2) Architecture and pre-training objective show strong crossover interaction: PCP-MAE + MaskTransformer achieves 59.00% accuracy (best self-supervised), while Point-MAE + MaskTransformer drops to 46.50%, with the pattern reversed for PointTransformer; (3) Closed-set ModelNet40 classification remains a core weakness of purely geometric encoders, reaching only ~13-18% accuracy vs. ~62% for the multi-modal baseline, even after end-to-end fine-tuning. Our results offer practical guidelines for cost-effective 3D-LLM design and reveal interaction patterns between self-supervised objectives and encoder architectures.

[41] Locally Consistent Transductive Information Maximization for Few-Shot Remote Sensing Scene Classification cs.CVPDF

Karim El Khoury, Benoît Gérin, Benoît Macq, Christophe De Vleeschouwer

TL;DR: 本文提出了一种名为LC-TIM的局部一致转导信息最大化方法，用于少样本遥感场景分类。该方法扩展了最先进的TIM++目标，通过引入一个局部一致性正则化器，强制每个查询样本与其特征空间中的k个最近邻在预测上保持一致，并以可忽略的计算开销融入模型。此外，论文还提出了一个多源扩展版本，融合多个遥感基础模型的亲和图以进一步提升分类精度。

Details

Motivation: 遥感场景分类日益依赖在大规模地球观测数据上预训练的基础模型。转导推理利用整个未标记查询集的集体统计结构，天然匹配遥感处理流程（大图像通常被分割成补丁并批量推理）。本文旨在改进少样本设置下的转导分类性能。

Result: 论文在首个全面的、开源的转导少样本遥感场景分类基准上进行了评估，涵盖了十个不同数据集、两个遥感视觉语言模型以及多种少样本设置。实验表明，转导方法持续优于零样本基线，且LC-TIM实现了最先进的准确率，在低样本情况下（邻域线索信息最丰富时）提升最大。

Insight: 主要创新点在于将局部一致性正则化器引入转导信息最大化框架，通过强制查询样本与其最近邻的预测一致性来提升性能，且该正则化器以闭式解形式融入，计算开销极小。另一个创新点是提出了多源扩展，融合多个基础模型的亲和图，进一步提高了分类精度。

Abstract: Remote sensing scene classification is increasingly relying on foundation models pre-trained on large-scale Earth-observation data. Moreover, transductive inference, which exploits the collective statistical structure of the entire unlabeled query set, appears to naturally match remote sensing pipelines where large images are routinely split into patches and inferred as a batch. In this work, we introduce LC-TIM (Locally Consistent Transductive Information Maximization), which extends the state-of-the-art Transductive Information Maximization for Few-Shot CLIP (TIM++) objective with a local consistency regularizer that enforces prediction agreement between each query sample and its $κ$ nearest feature-space neighbors. The regularizer enters as a single multiplicative factor in the closed-form $q$-update, adding negligible computational overhead. We further propose a multi-source extension that fuses the affinity graph from multiple remote sensing foundation model, further boosting classification accuracy. To assess these methods, we establish the first comprehensive, open-source benchmark for transductive few-shot RS scene classification, evaluating LP++, TransCLIP, TIM++, and LC-TIM across ten diverse datasets, two remote sensing vision-language models, and across various few-shot settings. Our experiments show that transductive methods consistently outperform zero-shot baselines, and that LC-TIM achieves state-of-the-art accuracy, with the largest gains in the low-shot regime where neighborhood cues are most informative. Code is publicly available at: https://github.com/elkhouryk/LC-TIM

[42] Domain-Division based Progressive Learning for Source-Free Domain Adaptation cs.CVPDF

Pan Liu, Jing Li, Meng Zhao, Wanli Xue, Qinghua Hu

TL;DR: 本文提出了一种基于域划分的渐进式学习方法DPL，用于解决源自由域适应问题。该方法通过将目标域划分为易适应和难适应子域，并分阶段应用不确定性感知自训练、子域间类别对齐以及一致性学习等策略，逐步挖掘目标数据的内在特性，实现有效适应。

Details

Motivation: 针对源自由域适应中现有自训练方法通常只关注可靠预测样本而忽视其他样本的问题，受深度模型学习干净样本快于噪声样本的启发，旨在更全面地利用目标域数据。

Result: 在多个广泛使用的基准测试上进行的广泛实验验证了该方法的有效性，其性能优于最先进的方法。

Insight: 创新点在于提出了一种基于适应难度进行目标域划分并分阶段渐进学习的框架，结合了不确定性感知自训练、子域间类别对齐以及针对不同难度子域的定制化学习策略（如一致性学习和局部结构信息利用），以更全面地挖掘目标域数据潜力。

Abstract: With growing privacy and portability concerns, source-free domain adaptation requires only a source pre-trained model and an unlabeled target domain, allowing for effective adaptation to the target data. Most existing self-training methods focus on selecting and exploiting samples with reliable predictions, often neglecting others. Inspired by the finding that deep models learn clean samples faster than noisy ones, we propose a domain-division based progressive learning method named DPL. Specifically, our approach consists of two alternating stages, each beginning with the division of the target domain into easy-to-adapt and hard-to-adapt subdomains based on adaptation difficulty, followed by neighborhood-based pseudo label assignment. In stage one, we enhance classification accuracy through uncertainty-aware self-training and alignment of corresponding classes between subdomains. Stage two then applies tailored learning strategies to each subdomain, starting with consistency learning on the easy-to-adapt samples and progressing to utilizing local structural information for the more challenging ones, thereby mining the intrinsic properties of the target data. Extensive experiments on several widely used benchmarks validate the effectiveness of our approach, demonstrating superior performance compared to state-of-the-art methods. Our code is available at https://github.com/iamjingli/DPL.

Weixiang Zhou, Xingguo Xu, Yuhao Wang, Cong Wang, Yang Yang

TL;DR: 本文提出了一种用于多模态目标重识别（ReID）的鲁棒框架，该框架通过双语义引导和全局-局部互调制来解决现有方法在利用语义先验和特征建模方面的不足。该框架包含三个核心组件：文本语义注入器（TSI）、掩码全局-局部调制器（MGLM）和分层MoE融合（HMF），旨在增强语义感知、改善细粒度跨模态对齐并自适应聚合特征。

Details

Motivation: 现有多模态ReID方法面临两个主要挑战：一是未能充分利用对齐良好且可靠的语义先验，易受背景干扰和跨模态错位影响；二是通常依赖整体特征建模，忽视了全局与局部表征之间的协同作用。

Result: 在三个多模态ReID基准测试上进行的广泛实验证明了所提方法的有效性，具体性能指标未在摘要中详细说明，但暗示了其优越性。

Insight: 创新点包括：通过文本语义注入器将干净连贯的文本特征融入视觉标记以增强语义感知；利用掩码全局-局部调制器在软掩码和全局上下文联合引导下实现部件感知的跨模态交互，改善细粒度对齐；以及采用分层MoE融合在局部语义监督下自适应聚合多光谱特征，生成判别性强且鲁棒的表征。

Abstract: Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at https://github.com/zw-absin/DSGM upon acceptance.

[44] Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs? cs.CVPDF

Wenzhuo Zhao, Xiuzhi Li, Zhongkuan Mao, Ronghao Xian, Yao Jiang

TL;DR: 本文探讨了在多模态大语言模型（MLLMs）时代，显著目标检测（SOD）的复兴可能性。作者将SOD分解为定位和分割两个子任务，并构建了一个诊断基准SaliLLM来评估MLLMs的显著性感知能力。研究发现MLLMs在定位任务上超越了现有SOTA方法，但在分割任务上表现较弱。基于此诊断，作者提出了一个无需训练的零样本SOD框架FOCUS，该框架通过结合自上而下的贝叶斯惊奇校准和自下而上的证据传播，在多个SOD基准上取得了优于现有方法的性能。

Details

Motivation: 动机是探究MLLMs的零样本能力能否推动SOD超越传统的任务特定监督范式，并通过分解任务和构建诊断基准来深入理解MLLMs在显著性感知上的能力与局限。

Result: 在13个RGB、RGB-D和RGB-T SOD基准测试中，提出的FOCUS框架无需训练，其性能普遍超越了SOTA方法。与全监督、弱监督和自监督方法相比，平均绝对误差分别降低了11%、34%和48%。

Insight: 创新点在于将SOD分解为定位与分割进行诊断性评估，揭示了MLLMs在此任务上的能力不匹配问题，并据此提出了首个基于格式塔启发的协作注意力、无需训练的零样本SOD框架FOCUS，实现了从任务特定监督到零样本前景组织的范式转变。

Abstract: The zero-shot capabilities of multimodal large language models (MLLMs) are pushing salient object detection (SOD) beyond task-specific supervision. To disentangle MLLMs beyond conventional mask-based evaluation, we decompose SOD into localization and segmentation, and re-engineer datasets with phrases, boxes, and attributes, establishing a diagnostic benchmark for MLLM saliency perception (SaliLLM). SaliLLM uncovers a striking capability mismatch: MLLMs outperform state-of-the-art (SOTA) methods in localization, yet remain substantially weaker in segmentation. Further analyses attribute this gap primarily to mismatches between MLLMs and annotations over foreground cardinality, granularity, and extent. Motivated by this diagnosis, we recast zero-shot SOD as protocol-aligned Foreground Organization and introduce the first training-free framework that leverages Gestalt-inspired Collaborative attention for Unified SOD (FOCUS). FOCUS couples top-down Bayesian-surprise calibration of protocol-conditioned foreground granularity with bottom-up propagation of MLLMs evidence over entity-centric perceptual manifolds induced by self-supervised features, yielding coherent object extents as prompts for a general segmenter. Across 13 RGB, RGB-D, and RGB-T SOD benchmarks, FOCUS generally surpasses SOTA methods without training, reducing mean absolute error by 11%, 34%, and 48% compared with fully, weakly, and self-supervised methods, respectively. Our findings signal the renaissance of SOD: from task-specific supervision to zero-shot foreground organization. Code is available in the supplementary material.

[45] CorrelationFlow: A Training-Free Geometric Approach for LiDAR Scene Flow Estimation cs.CV | cs.ROPDF

Minh-Quan Dao, Yancong Lin, Julie Stephany Berrio Perez, Holger Caesar

TL;DR: 本文提出了一种无需训练的几何方法CorrelationFlow，用于LiDAR场景流估计。该方法将场景流问题简化为两个经典操作：在鸟瞰图占用图像上进行连通分量标记和相关性最大化，从而恢复物体运动。

Details

Motivation: 当前LiDAR场景流估计方法普遍采用前馈架构和自监督损失，存在共同的假设和盲点，导致在稀疏、远距离或快速移动物体上失效。本文旨在通过无需训练的几何框架避免这些假设的局限性。

Result: 在Argoverse 2 2026场景流挑战赛的多域测试集（涵盖五个异构传感器和平台的数据集）上，CorrelationFlow在无监督方法中排名第二，且在长距离场景中性能下降最缓慢，而学习方法在该场景下因共享假设失效而表现不佳。

Insight: 创新点在于将场景流估计问题转化为经典的计算机视觉操作，无需训练即可处理多域数据，挑战了当前依赖学习方法的范式，表明部分场景流问题可通过几何方法解决，而非单纯扩展模型规模。

Abstract: LiDAR scene flow estimation has settled into a monoculture: nearly all recent methods share the same feed-forward architecture and the same family of self-supervised losses, inheriting each other’s assumptions, and each other’s blind spots. When those assumptions fail, as they do for sparse, distant, or fast-moving objects, every method built on them fails together, and adding parameters or simulated training data does not fix what the formulation itself gets wrong. This paper takes the opposite path. We present CorrelationFlow, a training-free geometric framework that reduces scene flow to two textbook operations: connected-component labeling and correlation maximization on bird’s-eye-view occupancy images. Objects are isolated as spatio-temporal connected components, their motions recovered as correlation peaks, and the resulting velocities propagated to all member points. However, this dense correlation evaluates every candidate displacement of every cluster and requires a window of past sweeps; therefore, we develop a sparse counterpart that operates on a single sweep pair by matching lightweight occupancy descriptors at boundary key points. Because nothing is trained, nothing is inherited: on the multi-domain test set of the Argoverse 2 2026 Scene Flow Challenge, spanning five datasets with heterogeneous sensors and platforms, CorrelationFlow ranked second among unsupervised methods and degrades most gracefully at long range, where the shared assumptions of learned methods break down. Our results suggest that a substantial share of the scene flow problem is solvable by classical computer vision, and that progress may require questioning the formulation, not scaling it.

[46] When Model Priors Conflict with Visual Evidence: Mitigating Commonsense-Driven Hallucinations by Selective Prior Calibration cs.CV | cs.AIPDF

Kesheng Chen, Yamin Hu, Wenjian Luo

TL;DR: 本文提出选择性先验校准（SPC）方法，以缓解视觉-语言模型中常识驱动幻觉（CDH）问题。该方法通过实例依赖的强度调整候选答案的先验偏好估计，仅在强烈支持替代答案时修正原始预测，从而在反事实图像上提升准确性，同时保持匹配常识图像的准确性。

Details

Motivation: 解决视觉-语言模型中常识先验与视觉证据冲突导致的幻觉问题，例如模型可能忽略六指手的视觉证据而错误报告为五指，这种错误在反事实图像中系统性地偏向模型无图像时的先验偏好。

Result: 在反事实图像上，SPC显著提高了准确性，同时在匹配常识图像上基本保持了原有准确性；该方法在多种CDH类别、候选答案排列和其他冲突基准测试中具有泛化能力，且在不含冲突的基准测试中很少改变预测结果。

Insight: 创新点在于提出选择性先验校准机制，通过动态调整先验偏好来平衡视觉证据与常识先验，避免无差别抑制先验导致的性能下降，从而在冲突场景中实现更鲁棒的预测修正。

Abstract: In vision–language models, commonsense-driven hallucination (CDH) occurs when a model’s commonsense prior overrides clear visual evidence of an atypical state. For example, a model may report that a visibly six-fingered hand has five fingers. We show that these errors are systematically directed: when a model answers a question about a counterfactual (CF) image incorrectly, its answer often coincides with the candidate it prefers without access to the image. Suppressing this prior indiscriminately can repair CF errors, but may also disrupt correct answers on matched commonsense (CS) images, where the same prior is helpful. We therefore propose Selective Prior Calibration (SPC), which subtracts candidate-level prior-preference estimates from image-conditioned scores with an instance-dependent strength and revises the original prediction only when the resulting score pattern strongly supports an alternative. Extensive experiments demonstrate that SPC substantially improves accuracy on CF images while largely preserving accuracy on matched CS images. Furthermore, these gains generalize across CDH categories, candidate-answer permutations, and other conflict benchmarks, while SPC rarely alters predictions on benchmarks without such conflicts.

Takashi Otonari, Toshihiko Yamasaki

TL;DR: 本文提出FillGS方法，通过主动选择时空虚拟视点并结合生成式模型来填补4D高斯溅射（4DGS）在动态场景重建中的观测空白区域，从而减少因视角覆盖有限和大运动导致的伪影。该方法基于渲染敏感性和运动感知的观测密度选择虚拟视点，并过滤生成结果中的不可靠区域进行微调。

Details

Motivation: 现有基于生成模型的方法依赖启发式虚拟视点选择，无法主动探索4DGS中稀疏观测的时空区域，导致重建伪影，尤其是在大运动场景中。

Result: 在专门设计用于诱导观测空白的新训练/测试划分的多视角视频基准测试中，该方法在定性和定量评估上均优于先前的视点选择策略和微调方法，并减少了伪影。

Insight: 创新点在于主动选择虚拟视点的策略（基于渲染敏感性和运动感知观测密度）以及仅使用可靠区域进行微调的机制，这有助于更精准地填补观测空白并避免生成伪影的干扰。

Abstract: 4D Gaussian Splatting (4DGS) can render dynamic scenes photorealistically. However, with limited viewpoint coverage, some spatiotemporal regions remain sparsely observed, leading to artifacts, particularly in scenes with large motion. Existing approaches leveraging generative models rely on heuristic virtual-viewpoint selection before refining rendered views. As a result, they cannot actively explore such sparsely observed regions. To address this issue, we propose a pipeline that actively selects spatiotemporal virtual viewpoints to improve 4DGS reconstruction. Our method selects virtual viewpoints for generative enhancement based on the rendering sensitivity and motion-aware observation density of 4D Gaussians, prioritizing views that alleviate observation sparsity. In the refined images, we filter out regions that conflict with captured observations or are likely to contain generative artifacts and then fine-tune 4DGS using only the reliable regions. We evaluate our method on multi-view video benchmarks using new train/test splits designed to induce observation gaps. Results show consistent improvements over prior viewpoint selection strategies and fine-tuning methods in both qualitative and quantitative evaluations, while reducing artifacts.

Xueting Bai, Huan Ni

TL;DR: 本文提出了一种无需训练的实体级少样本分割框架ELFSS-AR，用于遥感图像分割。该方法利用SAM3生成类别无关的实体基元，将少样本推理从像素级预测重构为实体级推理，并构建多模态语义势场。通过引入基于平流方程的语义细化机制，在特征和相似度空间中传播类别感知信息，从而增强语义连续性并抑制局部纹理噪声。

Details

Motivation: 现有跨域少样本分割方法因源域情景训练和像素级密集预测导致训练成本高，且预测结果往往存在碎片化和噪声问题。本文旨在克服这些问题，为遥感图像开发一种高效、无需训练的少样本分割方案。

Result: 在多个遥感数据集上的大量实验表明，所提框架能有效缓解域偏移和局部噪声，在不进行额外训练的情况下，显著提升了SAM3在遥感少样本分割任务上的适应能力。

Insight: 创新点在于将少样本分割重构为实体级推理，并引入基于平流方程的跨空间语义细化机制。这提供了一种无需训练即可有效利用基础视觉模型（如SAM3）进行跨域少样本分割的新范式，通过几何先验与语义响应的结合以及跨空间信息传播来提升分割的鲁棒性和连续性。

Abstract: Existing cross-domain few-shot segmentation approaches suffer from high training costs due to source-domain episodic training and pixel-wise dense prediction, while often producing fragmented and noisy predictions. To overcome these issues, we propose a training-free entity-level few-shot segmentation framework for remote sensing images with advection refinement. Specifically, we first leverage SAM3’s generic geometric priors to generate category-agnostic entity primitives. By reformulating few-shot inference from pixel-level prediction to entity-level reasoning, foreground and background prototypes are constructed and combined with dense textual semantic responses from SAM3 to build a multi-modal semantic potential field. Furthermore, an advection equation-based semantic refinement mechanism is introduced to propagate category-aware information across both feature and similarity spaces, enhancing semantic continuity and suppressing local texture noise. Extensive experiments on multiple remote sensing datasets demonstrate that the proposed framework effectively mitigates domain shift and local noise, substantially improving SAM3’s adaptation capability for remote sensing few-shot segmentation without additional training. Our code will be publicly available at https://github.com/yu-ni1989/ELFSS-AR.

[49] CALM-AH: An ABAW11-Calibrated Multimodal Ensemble with Reliability-Gated Multi-Expert Consensus for Video-Level Ambivalence and Hesitancy Recognition cs.CVPDF

Wenzhuo Sun, Mingjian Liang, Richard Attfield, Zongyuan Ge, Xuelian Cheng

TL;DR: 本文提出了CALM-AH，一种用于视频级别矛盾与犹豫（A/H）识别的多模态集成方法，并结合了可靠性门控的多专家共识（RG-MEC）机制。该方法融合了文本、声学、视觉及行为统计特征，通过特征分支组合与分类器优化，并利用RG-MEC整合初始预测与三个互补的校正专家，以提升决策可靠性。在ABAW11数据集上，CALM-AH的Macro-F1达到0.7525，完整RG-MEC系统达到0.7771。

Details

Motivation: 解决ABAW11挑战赛中视频级别矛盾与犹豫（A/H）的识别问题，这些细微行为状态通过语言、声音、面部活动等多模态线索表达，需要平衡A/H与非A/H样本的识别性能。

Result: 在ABAW11数据集上，CALM-AH的Macro-F1为0.7525，结合RG-MEC后提升至0.7771，表明该方法在视频级A/H识别任务中达到了较高性能水平。

Insight: 创新点包括多模态特征组合与分类器优化策略，以及可靠性门控的多专家共识（RG-MEC）机制，该机制通过一致性门控设计，在保持锚点预测的同时，仅当所有校正专家一致时才覆盖初始标签，从而减少孤立错误并利用多源证据进行双向校正。

Abstract: Ambivalence and hesitancy (A/H) are subtle behavioural states that may be expressed through language, voice, facial activity, and other non-verbal cues. The ABAW11 A/H Video Recognition Challenge asks systems to assign a binary A/H label to each naturalistic interview video. Performance is measured using Macro-F1 so that recognition of both A/H and No-A/H samples receives equal importance. We present CALM-AH, a multimodal ensemble that combines textual, acoustic, visual, and derived behavioural-statistical features. We construct 15 non-empty combinations of these feature branches. For each combination, we select the best of three classifier families using validation binary cross-entropy and optimise its decision threshold for validation Macro-F1. The resulting binary decisions are combined using fixed hard-voting weights transferred from BROTHER. We further introduce Reliability-Gated Multi-Expert Consensus(RG-MEC), an anchor-preserving decision-level ensemble that combines an initial prediction with three complementary correction experts: CALM-AH, AffectGPT, and a GPT-based semantic verifier. The initial system provides the default prediction. Its label is overridden only when all three correction experts unanimously support the same alternative class; otherwise, the anchor prediction is retained. This unanimity-gated design limits the influence of isolated expert errors while permitting bidirectional correction when task-specific, multimodal-affective, and semantic-pragmatic evidence are fully consistent. On the participant-disjoint ABAW11 dataset, CALM-AH achieves a Macro-F1 of 0.7525, and the complete RG-MEC system achieves 0.7771.

[50] VFAD: Variational Semantic Prompting Meets Frequency-Adaptive Representation Learning for Zero-Shot Anomaly Detection cs.CVPDF

Peng Chen, Kaige Li, Wei Wang, Mingbo Yang, Wenqiang Wang

TL;DR: 本文提出VFAD框架，用于零样本异常检测（ZSAD），通过结合变分语义提示与频率自适应表示学习，提升对未见类别中异常语义的捕获和细粒度定位能力。

Details

Motivation: 现有基于CLIP的ZSAD方法在捕捉多样异常语义和细微局部变化方面存在局限，VFAD旨在通过增强语义引导和视觉表示学习来解决这些问题。

Result: 在13个工业和医学基准测试上的广泛实验表明，VFAD在多种异常场景下持续优于现有最先进的ZSAD方法，达到了SOTA水平。

Insight: 创新点包括变分语义提示提取器（VSPE）通过变分信息瓶颈正则化细粒度视觉线索，以及频率自适应表示聚合（FARA）模块利用小波频率分解和专家聚合增强异常判别表示，实现了更精确的跨模态对齐。

Abstract: Zero-shot anomaly detection (ZSAD) aims to detect and localize anomalies in unseen categories without access to target-specific training data. Although recent CLIP-based methods have demonstrated promising generalization through vision-language alignment, they remain limited in capturing diverse anomaly semantics and subtle local variations. To address these limitations, we propose VFAD, a unified framework that combines variational semantic prompting with frequency-adaptive representation learning. Specifically, we introduce a Variational Semantic Prompt Extractor (VSPE), which adaptively aggregates anomaly-relevant local semantics from dense patch tokens and regularizes them through a variational information bottleneck, thereby incorporating fine-grained visual cues and enabling more precise cross-modal alignment. Furthermore, we develop a Frequency-Adaptive Representation Aggregation (FARA) module that leverages wavelet-based frequency decomposition and frequency-specific expert aggregation to enhance anomaly-discriminative visual representations. By jointly strengthening semantic guidance and visual representation learning, VFAD improves both anomaly discrimination and fine-grained localization. Extensive experiments on 13 industrial and medical benchmarks demonstrate that VFAD consistently outperforms existing state-of-the-art ZSAD methods across diverse anomaly scenarios. The code will be publicly available upon publication.

[51] SatEdit: Mask-Conditioned Image Editing via VLM-Guided Segment Annotation cs.CVPDF

Muhammad Talha, Muhammad Ahmed Amer

TL;DR: 本文提出了SatEdit，一个用于卫星图像编辑的掩码条件框架。该框架利用分割基础模型生成对象掩码，通过视觉语言模型为采样片段分配语义标签，并经过轻量级人工验证后，通过掩码引导的图像修复生成配对的添加和移除示例。作者在包含1,014张图像和91个类别852个已验证对象标注的数据集上，使用LoRA微调了一个高分辨率图像编辑骨干网络。

Details

Motivation: 卫星图像编辑需要精确的空间对象级控制，但用于俯视图像的监督编辑数据集构建成本高昂，因为对象掩码、语义标签和配对编辑数据难以大规模获取。

Result: 在开源和专有图像编辑模型的受控比较中，SatEdit在掩码区域的语义对齐方面取得了最高的综合得分，CLIP分数为0.6322，CLIP delta为0.0726，同时在定性上保持了周围场景的完整性。

Insight: 论文的创新点在于提出了一种利用视觉语言模型辅助片段标注的流程，以数据高效的方式构建训练监督，从而实现空间可控的卫星图像编辑。这为缺乏大规模标注数据的领域提供了一种实用的弱监督或自监督解决方案。

Abstract: Satellite image editing requires spatially precise object-level control, but supervised editing datasets for overhead imagery are costly to build because object masks, semantic labels, and paired edits are rarely available at scale. We introduce SatEdit, a mask-conditioned satellite image editing framework that constructs training supervision from unlabeled imagery. SatEdit proposes object masks with a seg- mentation foundation model, assigns semantic la- bels to sampled segments with a Vision-Language Model, and applies lightweight human verification before generating paired addition and removal exam- ples through mask-guided inpainting. We fine-tune a high-resolution image editing backbone with LoRA on a SODA-A-derived dataset containing 1,014 im- ages and 852 verified object annotations across 91 classes. In controlled comparisons with open- source and proprietary image editing models, SatE- dit achieves the highest aggregate masked-region se- mantic alignment, with a CLIP score of 0.6322 and CLIP delta of 0.0726, while preserving the surround- ing scene qualitatively. These results suggest that VLM-assisted segment annotation is a practical route to data-efficient, spatially controllable satellite image editing.

[52] OSEF: One-Step Evidence Fusion for Cross-Video Scene Procedure Planning cs.CVPDF

Zhentong Ye, Lei Zhang, Sijia Zhou, Yingda Yu, Yuehan Shi

TL;DR: 本文提出了跨视频场景程序规划（CVSPP）任务，要求模型从多个候选视频中检索支持性证据、定位相关片段并规划动作序列。针对早期硬选择方法易传递错误场景链的问题，作者构建了一个包含11个来源的基准测试，并提出了单步证据融合（OSEF）方法，该方法对所有候选视频构建查询条件化的网格，并通过全局令牌适配器将完整软网格馈送给规划器，无需预先裁剪窗口。

Details

Motivation: 动机在于解决视频场景程序规划（VSPP）中证据必须被检索时的规划问题，即当目标起始-目标观察已给出，但支持性证据本身需要从多个候选视频中检索时，如何规划动作序列。现有方法早期硬选择会传递错误场景链，阻碍规划。

Result: 在基准测试认证的6个可进行方法排名的单元上，OSEF均排名第一。在COIN和CrossTask的4个匹配同任务单元上，相比增强的硬选择SOTA方法，其精确视频和规划成功率提高了2.9-10.7个百分点。五个转换来源的单元结果接近或处于多数序列基线水平。

Insight: 创新点在于提出了CVSPP任务及相应基准，并设计了OSEF方法，其核心是通过查询条件化的单元-跨度网格对所有候选视频进行软评分，并利用全局令牌适配器将完整软网格信息传递给规划器，避免了早期硬选择带来的信息损失，显著提升了性能。

Abstract: Video Scene Procedure Planning (VSPP) supplies the target start-goal observations in advance, leaving open how a planner should act when the evidence must itself be retrieved. We introduce Cross-Video Scene Procedure Planning (CVSPP): given an answer-redacted start-goal query and K candidate videos, a model must retrieve the supporting video, localize the relevant window, and predict the action sequence. Two obstacles couple here. Same-task demonstrations share stages and windows, and an early hard selection passes the wrong scene chain to the planner. We build an eleven-source benchmark with typed negative roles, a fail-closed answer-leakage gate, and separate Evidence- and Plan-axis metrics. On its 14 source-horizon cells we adapt nine planner families against a majority-sequence floor. We then present One-Step Evidence Fusion (OSEF), which scores a query-conditioned cell-and-span lattice over all candidates and feeds the full soft lattice to the planner through a token-global adapter, cropping no window beforehand. OSEF ranks first on all six cells the benchmark certifies as method-rankable. On four matched same-task COIN and CrossTask cells it improves exact-video-and-plan success by 2.9-10.7 points over an enhanced hard-selection SOTA, and a component study assigns the largest single increment to the token-global interface. Five converted-source cells sit at or near the majority-sequence floor, the benchmark’s remaining headroom. The supplementary package includes model constructors and evaluation code.

[53] Role-Break in Attention Heads: Understanding and Detecting Hallucinations in VLMs cs.CVPDF

Mingyu Wang, Weilin Jin, Wenbo Li, Haoyang Huang, Nan Duan

TL;DR: 本文提出了一种名为Role-Break的新视角来理解和检测视觉语言模型（VLMs）中的幻觉问题。研究发现，幻觉会导致注意力头偏离其原本的忠实上下文行为，这些偏离在注意力头、上下文来源和偏离方向上呈现出系统性模式。基于此，作者构建了一个无需微调VLM的轻量级线性检测器，在多个模型和基准测试上实现了高检测性能。

Details

Motivation: 尽管视觉语言模型取得了显著进展，但它们仍然容易产生幻觉，生成与输入图像不一致或无依据的内容。现有方法通常针对单一幻觉模式设计，而实际幻觉由多种模式混合导致，因此现有方法的信号在不同模型和任务中不稳定。

Result: 提出的基于Role-Break的线性检测器特征维度低于5000，在六个VLMs和四个基准测试上的平均AUROC达到93.23。小规模干预实验进一步表明，在判别式设置中可以直接对被检测出的幻觉标记进行操作。

Insight: 创新点在于从注意力头层面统一理解幻觉，提出了Role-Break现象，即幻觉表现为注意力头对其忠实上下文行为的局部偏离。研究发现这些偏离信号具有系统性且线性可分，从而能够构建一个无需模型微调、轻量且通用的幻觉检测器。

Abstract: Despite remarkable progress in vision-language generation, Vision-Language Models (VLMs) remain prone to hallucinations, producing content that is inconsistent with or unsupported by the input image. Existing works largely design detection or mitigation methods around one specific hallucination pattern, such as visual-textual imbalance, but real VLM hallucinations arise from a mixture of multiple patterns, so signals bound to a single pattern struggle to remain stable across models and tasks. Under a unified head-level view, we find that hallucination-induced changes manifest as localized deviations from each head’s faithful contextual behavior, a phenomenon we term Role-Break. Detailed analysis reveals that these deviations are systematically organized across attention heads, contextual sources, and deviation directions, and that the resulting signal is linearly readable once head identity is preserved. Based on these findings, we build a lightweight linear detector on top of Role-Break that requires no fine-tuning of the VLM, whose feature dimension stays below 5,000 and reaches an average AUROC of 93.23 across six VLMs and four benchmarks. A small-scale intervention experiment further shows that the detected tokens can be directly acted upon in the discriminative setting.

[54] QR-Structured Thermal Triggers for Targeted Semantic Attacks on Infrared Vision-Language Models cs.CV | cs.AIPDF

Xiang Chen, Yingying Zhao, Chao Li, Jiaju Han, Ben Zhang

TL;DR: 本文提出了一种名为QR-STructured Thermal Triggers (QR-STT) 的对抗攻击框架，旨在针对红外视觉语言模型（IR-VLMs）进行隐蔽、无需训练的黑盒目标语义攻击。该方法通过优化QR码图案内部模块的热状态（冷、中性、热）及其拓扑结构和渲染参数，引导模型将输入图像与攻击者指定的目标概念对齐，同时抑制原始类别的证据。实验表明，该攻击在多种CLIP风格编码器上有效，并能迁移到图像描述和视觉问答任务，导致输出语义漂移。

Details

Motivation: 红外视觉语言模型（IR-VLMs）在开放词汇分类、图像描述和视觉问答等任务中扩展了热感知能力，但其对结构化热扰动的鲁棒性以及跨模态语义对齐的稳定性尚未得到充分研究。

Result: 在多个CLIP风格的编码器上进行实验，QR-STT能持续地将图像-文本对齐重定向到选定的目标概念，同时保持视觉隐蔽性。针对分类任务优化的扰动还能迁移到图像描述和VQA任务，导致生成输出中出现与目标一致的语义漂移。

Insight: 创新点在于将QR码的结构化图案作为一种可解释的攻击面，通过联合搜索离散的模块拓扑和连续的渲染参数（位置、尺度、旋转、强度等），实现了对语言驱动红外感知系统的目标语义操控。该方法采用无需梯度的三阶段贪心优化，高效处理混合搜索空间，并强调了针对结构化跨任务语义攻击进行鲁棒性评估的必要性。

Abstract: Infrared vision-language models (IR-VLMs) extend thermal perception to open-vocabulary classification, image captioning, and visual question answering. However, their robustness to structured thermal perturbations and the stability of cross-modal semantic alignment remain insufficiently studied. We propose QR-Structured Thermal Triggers (QR-STT), a stealthy, training-free, black-box framework for targeted semantic steering of IR-VLMs. QR-STT preserves the functional regions of a QR pattern while optimizing its internal modules, each of which is assigned a cold, neutral, or hot thermal state. The framework jointly searches module topology and rendering parameters, including position, scale, rotation, intensity, blur, and roundness. A three-stage gradient-free procedure with greedy module-flip refinement efficiently handles the mixed discrete and continuous search space. The objective promotes alignment with an attacker-selected target, suppresses source-class evidence, and regularizes QR structure and visual similarity. Experiments on multiple CLIP-style encoders show that QR-STT consistently redirects image-text alignment toward chosen concepts while maintaining visual stealth. Perturbations optimized for classification also transfer to image captioning and VQA, causing target-consistent semantic drift in generated outputs. These results identify QR-structured thermal patterns as an interpretable attack surface for language-driven infrared perception and highlight the need for robustness evaluation against structured cross-task semantic attacks.

[55] MoRoute: Dynamic Routing for In-Context Multimodal Video Generation cs.CVPDF

Chong Gao, Jie Ma, Zhan Peng, Chongxiao Wang, Haoxue Wu

TL;DR: 本文提出了MoRoute，一个用于多模态视频生成的统一框架。它通过动态层路由机制，将预训练的视觉语言模型（VLM）和视频扩散Transformer（DiT）这两种异构专家连接起来，并采用统一的上下文条件化方法处理参考图像和源视频，以支持多样化的视频生成和编辑任务。

Details

Motivation: 现有方法在连接VLM的层次化多模态表征与预训练视频DiT时存在局限，要么仅使用VLM的最终层或手动选择的少数层特征，要么需要联合训练架构匹配的理解和生成流，难以复用异构的预训练骨干网络。本文旨在解决如何有效桥接这两种异构预训练模型以进行统一多模态视频生成的挑战。

Result: 在IntelligentVBench、OpenVE-Bench和RefVIE-Bench三个基准测试上的实验表明，MoRoute在每个基准上都持续超越了最佳竞争方法，在1-5分的评分尺度上，平均得分分别提升了0.15、0.18和0.34，达到了新的SOTA水平。

Insight: 核心创新点在于提出了动态层路由机制，通过一个轻量级的块级路由器，使每个DiT块能自适应地选择与其生成阶段最相关的VLM层，从而学习多模态理解与视频合成之间的自适应对应关系。此外，通过统一的上下文条件化方法直接整合参考视觉信息，也是一个有效的设计。

Abstract: Multimodal video generation aims to generate and edit videos conditioned on arbitrary combinations of text, images, and videos within a single model, allowing diverse tasks to share complementary data and generative priors. Unifying these tasks requires multimodal understanding of diverse conditions, which is typically provided by a pretrained vision-language model (VLM). A key challenge is how to connect the VLM’s hierarchical multimodal representations with a pretrained video diffusion transformer (DiT). Existing methods either inject features from only the final or a few manually selected VLM layers, or jointly train architecture-matched understanding and generation streams, making it difficult to reuse heterogeneous pretrained backbones. We introduce MoRoute, a unified multimodal video generation framework that formulates a frozen VLM and a pretrained video DiT with different architectures as heterogeneous experts connected through dynamic layer routing. For each input, a lightweight block-wise router enables every DiT block to select the VLM layer most relevant to its generation stage, thereby learning an adaptive correspondence between multimodal understanding and video synthesis. MoRoute further incorporates reference images and source videos directly into the DiT token sequence through unified in-context conditioning, preserving fine-grained visual details across diverse generation and editing tasks. Experiments on IntelligentVBench, OpenVE-Bench, and RefVIE-Bench show that MoRoute consistently surpasses the best competing method on each benchmark, improving the average score by 0.15, 0.18, and 0.34 on a 1-5 scale, respectively.

[56] DynoDINO: Harnessing Dynamic Latent Information from DINO Features for Multi-Phase Medical Image Segmentation cs.CVPDF

Yu-Pu Hsu, Jen-Jee Chen, Yu-Chee Tseng

TL;DR: 本文提出了一种名为DynoDINO的统一框架，用于解决多期相增强CT图像中病灶分割的挑战。该框架首先进行切片级对齐以建立期相间的解剖对应关系，然后通过一个包含混合注意力机制和自适应门控机制的多期相融合模型，来联合增强跨期相的时间相关性并抑制错位伪影。

Details

Motivation: 多期相增强CT在病灶诊断中至关重要，但解剖不一致性、呼吸运动和不完整采集常导致期相间错位和时间信息中断，而现有分割框架通常独立处理各期相或采用简单融合策略，限制了其时间推理能力。

Result: 在LiTS、PLC-CECT和WAW-TACE三个大规模数据集上的实验表明，DynoDINO在标准、偏移和缺失期相条件下，均能持续改善边界描绘和结构保真度。

Insight: 创新点在于提出了一个结合切片级对齐和专门多期相融合模型的统一框架，其融合模型中的混合注意力机制用于特征校准，而基于差异的自适应门控残差学习能选择性地保留诊断相关的对比度变化并提高训练稳定性。

Abstract: Multi-phase Contrast-Enhanced Computed Tomography (CECT) plays a central role in the diagnosis and characterization of focal lesions by capturing temporal enhancement patterns across multiple acquisition phases. Accurate lesion segmentation from such data remains challenging because clinically relevant contrast kinetics are distributed across phases, while anatomical inconsistencies, respiratory motion, and incomplete acquisitions often lead to inter-phase misalignment and interrupted temporal information. Conventional segmentation frameworks typically process each phase independently or rely on simple fusion strategies, limiting their temporal reasoning capability. To address these challenges, we propose DynoDINO, a unified framework tailored to address the core challenges of multi-phase medical image segmentation. DynoDINO first performs slice-level alignment to establish inter-phase anatomical correspondence and then employs a Multi-phase Fusion Model to jointly enhance temporal correlations across phases. Our fusion model incorporates a Mix-attention (MA) mechanism for efficient multi-phase feature calibration and an Adaptive Gating Mechanism with difference-based residual learning to selectively preserve diagnostically relevant contrast variations while suppressing artifacts caused by residual misalignment. In addition, the adaptive gating mechanism improves training stability by preventing feature degradation caused by unguided subtraction operations. Experiments on three large-scale datasets, including LiTS, PLC-CECT, and WAW-TACE, demonstrate that DynoDINO consistently improves boundary delineation and structural fidelity under standard, shifted, and missing-phase conditions.

[57] FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control cs.CVPDF

Songchun Zhang, Sitong Guo, Xianghao Kong, Pengwei Liu, Yuwei Guo

TL;DR: FlexComposer是一个统一的视频合成框架，能够将静态图像或动态素材无缝集成到现有视频序列中，并通过灵活的轨迹控制实现高保真的运动和环境融合。

Details

Motivation: 现有视频合成方法存在控制与保真度的权衡：要么从静态图像生成运动而无法保留预动画素材的动态，要么缺乏细粒度空间控制以实现沿用户定义轨迹的精确资产放置。

Result: 大量实验表明，FlexComposer在视觉质量、时间一致性和轨迹遵循方面优于最先进的方法。

Insight: 创新点包括：统一的规范前景表示法解耦物体固有运动与全局位移；利用VAE潜在空间平移等变性的空间感知潜在注入策略；以及结合程序模拟、真实电影镜头和生成数据的混合数据集与合成到真实的课程学习，以隐式学习物理上合理的照明和阴影协调。

Abstract: Generative video compositing, which involves inserting external assets seamlessly into existing video sequences, is essential for content creation and visual effects. However, existing approaches suffer from a control-fidelity trade-off: they either hallucinate motion from static images, failing to preserve the dynamics of pre-animated assets, or lack fine-grained spatial control for precise asset placement along user-defined trajectories. We propose FlexComposer, a unified framework that standardizes video compositing as a trajectory-guided conditional generation task, enabling the seamless integration of both static images and dynamic footage. Our approach introduces three key designs: (1) a Unified Canonical Foreground Representation that decouples an object’s intrinsic motion from its global displacement, standardizing heterogeneous inputs into a stabilized, centered latent space; (2) a Spatial-Aware Latent Injection strategy that exploits the translation equivariance of VAE latent spaces to transport canonical features onto target trajectories via a parameter-free mechanism; and (3) a Hybrid Dataset and Synthetic-to-Real Curriculum that synergizes procedural simulation, real-world cinematic footage, and generative data to implicitly learn physically plausible illumination and shadow harmonization. This unified design handles diverse inputs from product photos to dynamic subjects achieving high-fidelity motion control and environmental integration without the need for explicit 3D reconstruction or auxiliary learnable adapters. Extensive experiments demonstrate that FlexComposer outperforms state-of-the-art methods in visual quality, temporal consistency, and trajectory adherence.

[58] CoDe-SSM: Context-Detail Decoupled State Space Model for Efficient UHD Image Restoration cs.CVPDF

Jiaxu Su, Zhijian Wu, Jun Li, Bo Zhang, Yefeng Zheng

TL;DR: 本文提出了一种上下文-细节解耦的状态空间模型（CoDe-SSM），用于高效的超高清图像恢复。该模型通过全局聚类扫描模块聚合上下文信息，并通过局部高频模块处理聚类残差以恢复细节，从而在保持计算效率的同时显著提升恢复质量。

Details

Motivation: 超高清图像恢复需要平衡对空间重复退化线索的聚合与对局部图像结构的保留，现有方法（如下采样、窗口划分或基于聚类的令牌缩减）往往无法显式保留那些难以通过共享聚合很好表示的信息。

Result: 在五个超高清基准测试和五种退化类型上的广泛实验表明，该显式的上下文-细节解耦策略在恢复质量上取得了显著提升，同时保持了理想的效率。

Insight: 创新点在于显式地将上下文建模与细节恢复解耦为两个并行路径：全局聚类扫描模块实现跨区域上下文共享且计算成本与空间分辨率解耦，局部高频模块利用输入相关的高频掩码和稀疏卷积专家混合处理聚类残差，有效保留了边缘和纹理等精细结构。

Abstract: Ultra-high-definition (UHD) image restoration must balance the aggregation of spatially recurring degradation cues with the preservation of localized image structures. Compact aggregation can reduce redundant processing but may attenuate edges, textures, and other fine structures. Existing approaches manage UHD restoration cost through downsampling, window partitioning, or cluster-based token reduction; yet many of them do not explicitly retain information that is poorly represented by shared aggregation. In this study, we propose a Context-Detail Decoupled State Space Model (CoDe-SSM) for UHD restoration, which processes aggregated context and clustering residuals in separate pathways. The context modeling pathway, implemented by the Global Cluster Scan Module (GCSM), aggregates features into $K$ input-dependent cluster centers and applies selective SSM reasoning over the resulting fixed-order sequence, enabling cross-region context sharing while decoupling computational cost from spatial resolution. The detail recovery pathway, implemented by the Local High-Frequency Module (LHFM), processes the clustering residual with an input-derived high-frequency mask and a sparse mixture of convolutional experts. Extensive experiments on five UHD benchmarks and five degradation types demonstrate that our explicit context-detail decoupling strategy yields substantial gains in restoration quality while maintaining desirable efficiency.

[59] TraceViT: Grounded Trace Supervision for Visual Abstract Reasoning cs.CV | cs.AIPDF

Binnan Liu, Yechi Ma, Tian Xie, Wei Hua

TL;DR: TraceViT是一种循环视觉推理模型，通过语义单调变换链进行训练，用于解决抽象推理语料库（ARC）中的视觉抽象推理任务。该方法将任务分解为中间网格状态，并通过软轨迹对齐确保迭代顺序，使模型能够自由分配迭代次数。

Details

Motivation: 传统循环视觉推理器仅约束最终输出，而中间细化过程缺乏监督，导致推理过程不透明。论文提出通过逐步跟踪变换过程来约束中间细化，以提高推理的准确性和可解释性。

Result: 在ARC-AGI-1基准测试中达到67.8% pass@2，在ARC-AGI-2中达到24.3%。消融实验表明，轨迹监督仅在与任务参考和对象工作空间结合时才有效。

Insight: 创新点在于引入语义单调变换链和软轨迹对齐，将程序化任务分解为中间状态进行监督，同时结合任务参考和对象工作空间进行接地，增强了模型对复杂视觉推理任务的处理能力。

Abstract: The Abstraction and Reasoning Corpus (ARC) tests whether a model can infer an unseen transformation from a few input-output examples and apply it to a new grid. Looped visual reasoners refine predictions over multiple iterations, but conventional training constrains only the final output, leaving intermediate refinements unconstrained. We propose that these refinements should instead follow the transformation step by step. We introduce TraceViT, a looped visual reasoner trained with semantically monotonic transformation chains. We obtain these chains by rewriting and verifying programmatic task implementations, decomposing each solution into intermediate grid states. Each iteration is grounded by a task reference derived from the few-shot demonstrations and an object workspace representing the current grid state. Because these chains may differ in length from the loop, soft trace alignment enforces only their ordering, letting the model allocate iterations freely. TraceViT achieves 67.8% pass@2 on ARC-AGI-1 and 24.3% on ARC-AGI-2. Controlled ablations on ARC-AGI-1 show that trace supervision becomes beneficial only when paired with grounding. Code and data will be available at https://github.com/LiuBinnan/TraceViT.

[60] CodeShrink: Adaptive Visual Compression for Efficient Multimodal Code Understanding cs.CV | cs.SEPDF

Wenxin Tang, Jingyu Xiao, Zhenyu Liu, Zipeng Xie, Junliang Liu

TL;DR: CodeShrink是一个用于多模态代码理解的自适应视觉压缩框架。它通过消除代码图像中的空白区域、根据输入自适应选择压缩配置以及根据指令剪枝任务无关的视觉标记，显著减少了多模态大语言模型（MLLM）的视觉标记使用量。

Details

Motivation: 将源代码渲染为图像可以降低多模态大语言模型的输入成本，但仅调整图像分辨率存在效率问题，如换行和缩进产生的空白区域、与当前指令无关的代码区域，且最佳压缩设置因输入、任务和模型而异，固定比例策略效果有限。

Result: 在代码问答、克隆检测和代码补全任务上，CodeShrink将视觉标记使用量减少了高达71.2%，同时性能匹配或超过了未压缩的纯文本输入，并且在所有三个任务上持续优于基于文本和视觉压缩的基线方法。

Insight: 创新点在于结合了布局压缩（用紧凑布局和显式结构标记替换依赖空白的布局）、自适应配置（通过强化学习训练的轻量代理预测每输入设置）和指令感知剪枝（联合分析指令和代码图像以剪枝无关标记），从而实现了更高效的多模态代码理解。

Abstract: Rendering source code as images offers a promising way to reduce the input costs of Multimodal Large Language Models (MLLMs). Adjusting image resolution can trade visual token cost against content fidelity. However, resolution scaling alone overlooks two sources of inefficiency: blank regions created by line breaks and indentation, and code regions irrelevant to the current instruction. Moreover, the best compression setting varies across inputs, tasks, and models, limiting fixed-ratio strategies. We propose CodeShrink, an adaptive visual compression framework with three components. Blank-Free Rendering replaces whitespace-dependent layouts with compact layouts and explicit structural markers, removing layout-induced tokens. Adaptive Compression Configuration uses a lightweight agent trained with reinforcement learning to predict a per-input setting that balances token efficiency and readability. Dominant Token Selection jointly analyzes the instruction and code image to prune task-irrelevant visual tokens during inference. We evaluate CodeShrink on code question answering, clone detection, and code completion. CodeShrink reduces visual token use by up to 71.2% while matching or exceeding uncompressed text-only inputs, and consistently outperforms text-based and visual compression baselines across all three tasks. These results show that combining layout compaction, adaptive configuration, and instruction-aware pruning can make multimodal code understanding more efficient. Our code is available at https://github.com/vinsontang1/CodeShrink.

[61] Scaling Properties of Text Conditioning in Visual Generation cs.CVPDF

Zilong Chen, Chaorui Deng, Kunchang Li, Hongyi Yuan, Haoqi Fan

TL;DR: 本文研究了视觉生成中文本条件化的经验缩放特性，发现扩散模型的收敛损失与提示中结构化语言的数量相关，并基于此改进了扩散性和提示性，最终在多项基准测试中超越了现有模型。

Details

Motivation: 探索文本条件在视觉生成中的缩放特性，以解决扩散损失与自然语言提示长度不匹配的问题。

Result: 在多个组合、推理和世界知识基准测试中，该系统超越了所有评估的开源模型，并在大多数评估中匹配或超越了最强的闭源模型。

Insight: 通过量化结构化语言（使用GPG和ED度量）来指导模型改进，包括构建结构化提示和训练提示器，从而提升生成性能。

Abstract: We study empirical scaling properties for text conditioning in visual generation. Such properties have rarely been measured because diffusion loss does not scale with the number of tokens in natural-language prompts. Surprisingly, we find that the converged diffusion loss scales with the amount of structured language in the prompt. To quantify structured language, we adapt two complementary measures: a white-box likelihood metric (GPG) and a black-box attribute metric (ED). Across controlled training runs, the converged diffusion loss decreases approximately linearly with GPG and follows a power law with ED. Guided by these scaling properties, we improve \emph{diffusability} by constructing structured prompts with semantic and geometric annotations derived from images, and improve \emph{promptability} by training a prompter through supervised fine-tuning, cold-start, and verifier-gated on-policy distillation. The resulting system outperforms all evaluated open-weight models on nearly every compositional, reasoning, and world-knowledge benchmark, while matching or surpassing the strongest closed-weight models on most evaluations.

[62] Toward Robust and 3D-Aware RGB-NIR Imaging in the Dark cs.CVPDF

Muyao Niu, Mingze Ma, Yifan Zhan, Qingtian Zhu, Zhihang Zhong

TL;DR: 本文提出了一种新颖的RGB-NIR低光成像方法，通过引入3D感知的神经建模，在无需干净RGB图像监督的情况下，优化模型以在3D空间中隐式融合极度噪声的RGB观测与NIR线索，从而有效恢复干净的RGB图像。该方法摆脱了对精心配对的训练数据的依赖，并展现出对不同噪声水平的泛化能力。

Details

Motivation: 解决现有RGB-NIR低光增强方法严重依赖精心配对的训练数据、在不同场景下鲁棒性有限的问题，旨在实现更鲁棒且无需干净RGB监督的低光成像。

Result: 在合成数据和真实数据上的广泛评估表明，该方法具有优越性，能够有效恢复图像并泛化至不同噪声水平。

Insight: 核心创新点在于将3D感知神经建模引入RGB-NIR融合任务，实现了无监督的隐式融合，从而摆脱了对配对干净数据的依赖，提升了方法的鲁棒性和泛化能力。

Abstract: Robust low-light imaging remains challenging for the community. Recent studies have explored fusing Near-Infrared (NIR) with noisy RGB to achieve improved enhancement, yet most methods depend on carefully curated training data pairs, with limited robustness under different scenarios. This paper offers a new perspective for RGB-NIR low-light imaging by incorporating 3D-aware neural modeling. Without using clean RGB supervision, a powerful model can be optimized to implicitly fuse extremely noisy RGB observations with NIR cues in 3D space, effectively recovering clean RGB images. The proposed model obviates the requirement for clean RGB data collection, generalizes across different noise levels. Extensive evaluations on synthetic and real data demonstrate its superiority. Codes available: https://github.com/MyNiuuu/3DarkFusion

cs.MA [Back]

[63] TransMem: Transforming Hidden States into Memory for Large Language Models cs.MA | cs.CLPDF

Haodong Lei, Junming Liu, Yirong Chen, Pinlong Cai, Botian Shi

TL;DR: 本文提出了TransMem，一种轻量级的推理时参数化记忆模块，用于增强大型语言模型（LLM）在长上下文交互中的推理能力。该方法通过一个门控网络，将稀疏的历史隐藏状态转化为可重用的记忆表示，并动态干预当前状态，无需重复编码历史上下文。通过证据条件自蒸馏训练，模型学习可迁移的记忆利用能力，而非特定任务知识。

Details

Motivation: 当前LLM智能体在处理长交互历史时，往往未能充分利用先前计算中编码的有用信息，导致对分布在历史观测和行动中的任务相关证据利用不足。

Result: 在LoCoMo、HotpotQA和MemoryAgentBench基准测试上，TransMem带来了持续的提升。具体而言，在LoCoMo上F1分数提升了11.58-29.25，在HotpotQA上提升了10.20-13.03，并将MemoryAgentBench的平均准确率从29.54%提升至40.00%。

Insight: 核心创新点在于将稀疏的历史隐藏状态作为高效的内存基底，并通过轻量级门控网络实现动态干预。其训练方法（证据条件自蒸馏）旨在学习通用的记忆利用模式，而非记忆特定知识，这有助于提升方法的可迁移性和泛化能力。

Abstract: Large language model (LLM) agents increasingly operate over long interaction histories, where effective reasoning requires identifying and exploiting task-relevant evidence distributed across past observations and actions. However, useful information encoded in previously computed representations is often underutilized during subsequent generation. We propose \textbf{TransMem}, a lightweight inference-time parametric memory module that transforms sparse historical hidden states from a frozen LLM backbone into reusable memory representations. TransMem uses a lightweight gating network to dynamically apply the latent intervention to the current hidden states, without repeatedly encoding the preceding context. To learn transferable memory utilization rather than task-specific knowledge, we introduce evidence-conditioned self-distillation. A memory-augmented student processes the full context and matches the predictive distribution of an evidence-only teacher that shares the same frozen backbone. Experiments on LoCoMo, HotpotQA, and MemoryAgentBench demonstrate consistent improvements across different model architectures and scales. TransMem yields gains of 11.58–29.25 $F_1$ on LoCoMo and 10.20–13.03 $F_1$ on HotpotQA, while improving the average MemoryAgentBench accuracy from 29.54% to 40.00%. These results establish sparse historical hidden states as an effective and efficient memory substrate for long-context LLM agents. Our code is available at https://github.com/Haodong-Lei-Ray/TransMem.

cs.RO [Back]

[64] WCM: A World Critic Model for Vision-Language-Action Reinforcement Learning cs.RO | cs.CL | cs.CVPDF

Senyu Fei, Xiaopeng Yu, Siyin Wang, Xianzhong Zhao, Jingjing Gong

TL;DR: 本文提出了一种名为世界评论家模型（WCM）的新方法，用于解决视觉-语言-动作（VLA）模型在机器人操作任务中进行强化学习后训练时面临的挑战。该方法通过一个基于LeJEPA架构的轻量级模型，联合预测未来潜在状态并估计价值，从而显式地学习跨时间动态，以改进在部分可观测环境下的价值估计。

Details

Motivation: 现有基于评论家的强化学习方法主要依赖单帧观测或VLA主干潜在特征进行价值估计，这与机器人控制的部分可观测性本质不匹配。简单地融入观测历史会导致高维视觉空间的指数级复杂度，且纯标量回报回归无法为学习跨时间动态提供足够的监督。

Result: 在四个基准测试的149个任务上进行的大量实验表明，WCM在分布内和分布外设置下均能持续实现最先进的性能，并展现出特别强的泛化增益。使用OpenVLA-OFT和Pi0.5模型在七个真实世界操作任务上进行的离策略强化学习验证了WCM在不同设置下的稳定部署能力。

Insight: 核心创新在于将世界建模目标（预测未来潜在状态）与价值估计目标联合起来，迫使评论家的表征显式地捕捉时间动态，而不仅仅是回归标量回报。这为解决部分可观测环境下的价值估计问题提供了一个新的、可无缝集成到多种策略训练流程中的架构思路。

Abstract: Reinforcement learning (RL) post-training of Vision-Language-Action (VLA) models has shown strong promise for robotic manipulation. Among RL methods, critic-based approaches rely on a value estimator that predominantly operates on single-frame observations or single-frame VLM backbone latents, which is a fundamental mismatch with the partially observable nature of robot control. A naive approach to incorporate observation history into the critic incurs exponential complexity with high-dimensional visual space, and still fails because pure scalar-return regression provides insufficient supervision for learning cross-temporal dynamics. We identify the root cause as a state approximation problem: without an explicit world modeling objective, the critic’s representation cannot capture the temporal structure needed for accurate value estimation. To address this, we propose the World Critic Model (WCM), built on a lightweight LeJEPA architecture; WCM jointly predicts future latent state and estimates values, such that the critic’s representation is explicitly trained to capture temporal dynamics rather than merely regress scalar returns. WCM integrates seamlessly into both on-policy and off-policy training pipelines and is compatible with state-of-the-art VLA backbones including Pi0, Pi0.5, and OpenVLA-OFT. Extensive experiments on 149 tasks across four benchmarks demonstrate that WCM consistently achieves state-of-the-art performance in both in-distribution and out-of-distribution settings, with particularly strong generalization gains. We further validate WCM on seven real-world manipulation tasks using OpenVLA-OFT and Pi0.5 with off-policy RL, confirming stable deployment across diverse settings.

[65] ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts cs.RO | cs.CVPDF

Mingxin Wang, Bin Hu, Bin Qian, Kaitao Jiang, Haoning Wu

TL;DR: 本文提出了语义-时序世界动作模型（ST-WAM），旨在解决现有世界动作模型（WAMs）在视觉分布偏移下鲁棒性不足的问题。该模型利用DINOv3作为共享语义表示来预测未来和检索历史，同时保留细粒度的VAE动态，从而在无需显式生成未来图像的情况下实现更鲁棒的机器人操作。

Details

Motivation: 现有世界动作模型（WAMs）依赖于像素生成式的未来监督，这会将与动作相关的状态转换与任务无关的视觉内容纠缠在一起，导致在视觉分布偏移（如光照、背景变化）下出现‘训练分布幻觉’问题，即模型会基于偏移的观测幻觉出训练域的内容而非忠实于当前场景，从而限制了操作的鲁棒性。

Result: 在LIBERO基准测试上达到98.7%的成功率，在RoboTwin 2.0上达到92.8%。更重要的是，与Fast-WAM相比，在零样本的LIBERO-Plus上性能提升了21.3个百分点，在视觉分布偏移下的真实世界成功率从25.8%提升至61.5%，实现了显著的鲁棒性改进。

Insight: 核心创新在于将语义（DINOv3特征）与时序建模相结合，以补充像素生成动态的不足。具体通过双空间未来专家（DSFE）联合预测未来VAE潜变量和DINO特征，以及当前锚定意图检索（CAIR）在视觉-语言上下文中从最近的DINO历史中检索任务相关证据。这种方法避免了显式的未来图像生成，并利用更稳定的语义表示来增强对视觉变化的鲁棒性。

Abstract: World Action Models (WAMs) have emerged as a promising paradigm by jointly modeling robot actions and future visual dynamics. However, their reliance on pixel-generative future supervision can entangle action-relevant state transitions with task-irrelevant visual content, limiting robustness under visual distribution shifts. We identify Training-Distribution Hallucination, a recurring phenomenon in which futures conditioned on visually shifted observations hallucinate training-domain content rather than remain faithful to the current scene. A controlled frame-triplet diagnosis further shows that DINOv3 features remain more stable across visual shifts while better preserving task-state distinctions than Wan-VAE latents. Rather than correcting the predicted futures, we propose Semantic-Temporal WAM (ST-WAM) to improve action robustness by using DINOv3 as a shared semantic representation for future prediction and history retrieval while retaining fine-grained VAE dynamics. Its Dual-Space Future Experts (DSFE) jointly predict future VAE latents and DINO features, while Current-Anchored Intent Retrieval (CAIR) retrieves task-relevant evidence from recent DINO history under the current visual-language context. ST-WAM is trained end-to-end without additional embodied pretraining or task-specific annotations, and requires no explicit future generation at inference. It achieves 98.7% on LIBERO and 92.8% on RoboTwin 2.0; more importantly, compared with Fast-WAM, it improves zero-shot LIBERO-Plus performance by 21.3 percentage points and more than doubles real-world success under visual shifts from 25.8% to 61.5%. These results demonstrate that semantic-temporal modeling effectively complements pixel-generative dynamics for robust manipulation.

[66] BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning cs.RO | cs.CVPDF

BWM Team

TL;DR: 本文提出了Boundless World Model (BWM)，一个用于机器人操作的开源、低成本、高保真世界模拟器。它通过结合初始环境引导、动态视觉历史和时序对齐的机器人动作条件，以自回归方式预测未来观测。BWM可作为数据引擎增强模仿学习数据，也可作为策略评估器进行闭环评估和风险预测。

Details

Motivation: 现有物理模拟器需要大量资产构建和校准，且存在仿真到现实的差距；而视频生成器通常缺乏对细粒度机器人动作响应的精确控制。因此，需要一种可靠、低成本且高保真的世界模拟器来预测动作后果，以支持机器人学习。

Result: 在WorldArena基准测试和物理机器人上的实验表明，BWM在模拟器保真度和功能效用方面均有提升。在WorldArena挑战赛中，BWM在Track 1及其两个Track 2应用中总体排名第一。

Insight: 创新点在于提出了一个动作条件化的世界模型架构，结合了初始环境引导和动态视觉历史以实现状态感知的预测。通过轨迹回放、重叠片段采样和初始观测增强构建动作对齐的训练片段，这为生成高质量仿真数据提供了新方法。

Abstract: Reliable robot learning requires a world simulator that can predict action consequences before execution on physical hardware, including risky and failure-prone outcomes. Existing physics simulators require substantial asset construction and calibration and still face a sim-to-real gap, while video generators often lack precise control over their responses to fine-grained robot actions. In this paper, we present the Boundless World Model (BWM), an open-source, low-cost, high-fidelity world simulator for robot manipulation. BWM is an action-conditioned world model that combines initial-environment guidance, dynamic visual history, and temporally aligned robot-action conditioning for stateful autoregressive prediction of future observations. We construct action-aligned training clips through trajectory replay, overlapping clip sampling, and initial-observation enhancement. BWM serves as a data engine that augments imitation-learning data with action-aligned rollouts, and as a policy evaluator for closed-loop assessment, risk anticipation, and policy ranking. Experiments on the WorldArena benchmark and physical robots demonstrate improved simulator fidelity and functional utility across the data-engine and policy-evaluator settings. BWM ranks first overall in the WorldArena Challenge across Track 1 and its two Track 2 applications. We release the BWM open-source ecosystem, including model checkpoints, training and inference code, and interfaces for data generation and policy evaluation.

[67] FibVLA: An Efficient Temporal Vision-Language-Action Model with Fibonacci Sampling cs.RO | cs.CVPDF

Li Lin, Wujun Xu, Weiwei Meng, Kaiwen Xia, Kang Hao Cheong

TL;DR: 本文提出FibVLA，一种高效的时序视觉-语言-动作模型，通过斐波那契采样解决长时上下文历史感知与推理效率之间的冲突。该方法采用对数后见采样捕获长时依赖，并利用流匹配和斐波那契循环推理策略生成动作。实验表明，FibVLA在不重新训练大规模视觉编码器的情况下，显著提升了动作平滑度和成功率，并具有优异的实时响应能力。

Details

Motivation: 传统视觉-语言-动作模型主要关注当前数字认知，而增强其时序推理能力的长上下文编码会导致效率下降。本文旨在调和捕获时序信息与保持推理效率之间的矛盾。

Result: 实验证明，FibVLA显著提升了动作平滑度和成功率。在真实世界评估中，其效率分析显示，相较于基于视频的基线方法，FibVLA具有更优的实时响应性。

Insight: 创新点在于提出了对数后见采样来高效捕获长时依赖，以及结合流匹配和斐波那契循环推理策略来生成长程规划动作。这为具身AI应用提供了一种兼顾性能与效率的通用时序感知框架。

Abstract: Vision-language-action models (VLAs), which leverage the cognition of multimodal information to infer physical-world actions, provide a generalized solution for embodied AI applications. Conventional VLAs usually concentrate on current digital cognition. While some efforts are made to enhance VLAs’ reasoning capabilities by capturing temporal information, encoding the long-context history causes an efficiency-decreasing issue. To reconcile the conflict between capturing temporal information and maintaining inference efficiency in VLAs, this paper introduces FibVLA, an efficient framework featuring temporal perception of long-context history. Specifically, we leverage logarithmic hindsight sampling to both proprioceptive states and visual frames to capture long-term temporal dependencies with minimal redundancy. For the action expert, we introduce the flow matching to produce action distributions, and the Fibonacci recurrent inference strategy to generate long-range planning steps based on real-time closed-loop feedback. Experiments demonstrate that FibVLA significantly improves action smoothness and success rates without retraining large-scale visual encoders. Efficiency analysis demonstrates superior real-time responsiveness compared to video-based baselines in real-world evaluations.

[68] RayViT: Ray-Conditioned Visual Representations for Viewpoint-Robust Imitation Learning cs.RO | cs.CVPDF

Qian Wang, Longrui Chen, Peiran Sun, Aleksandar Taranovic, Niklas Freymuth

TL;DR: 本文提出RayViT，一种轻量级架构，通过将相机几何信息注入预训练的ViT骨干网络，以提升视觉模仿学习在相机扰动下的鲁棒性。该方法将相机几何表示为普吕克射线图，并通过门控交叉注意力生成射线条件化的类别令牌，结合辅助余弦相似度损失来增强几何感知表示。在仿真和真实机器人任务上的实验表明，RayViT显著提高了策略在相机扰动下的性能与鲁棒性。

Details

Motivation: 视觉模仿学习使机器人能够直接从图像中学习视觉运动技能，但RGB观测缺乏显式的几何线索，导致学习到的策略对相机扰动敏感。为了解决这一问题，论文旨在将相机几何信息融入视觉表示中，以增强策略的视角鲁棒性。

Result: 在仿真多任务RoboCasa基准测试中，RayViT在相机扰动下的鲁棒性提升了约13个百分点；在真实世界的多任务成功率上，平均完成阶段数比基线提高了1.78个阶段。

Insight: 创新点在于提出了一种将相机几何（普吕克射线图）作为条件信息注入预训练ViT的方法，通过门控交叉注意力和射线条件化类别令牌来生成几何感知的视觉表示，并结合辅助损失函数来稳定训练，从而在不显著增加模型复杂度的情况下提升视角不变性。

Abstract: Visual imitation learning enables robots to acquire visuomotor skills directly from images, yet RGB observations lack explicit geometric cues, making learned policies brittle to camera perturbations. To address this, we propose \textbf{Ray-conditioned Vision Transformer Encoder (RayViT)}, a lightweight architecture that injects camera geometry into pretrained ViT backbones. RayViT represents camera geometry as a Plücker ray map, patchifies it into ray features, and uses gated cross-attention to produce a ray-conditioned class token. These ray features are added as dense positional embeddings, while the ray class token replaces the original ViT class token to provide a geometry-aware summary representation. We combine this approach with an auxiliary cosine similarity loss to consistently improve the performance and robustness for geometry-aware tokens. Experiments on sim- and real-robot tasks demonstrate that RayViT improves robustness by approximately 13 percentage points under camera perturbations in multi-task RoboCasa benchmark and by 1.78 average completed stages in real-world multi-task success rate compared to baselines.

cs.LG [Back]

[69] Predicting Steel Fatigue Life from Micrographs Using Physics-Informed Deep Learning cs.LG | cs.AI | cs.CVPDF

Aryuemaan Kumar Chowdhury

TL;DR: 该论文提出了一种名为CV的计算机视觉框架，能够直接从光学显微图像预测轻质合金钢的疲劳寿命（log Nf），无需物理测试。该框架包含七阶段OpenCV预处理、28维物理信息特征提取器和CNN回归模型，在合成显微图像基准测试中，ResNet-50架构取得了R²=0.93的优异性能，且运行速度极快（每图像<65毫秒）。

Details

Motivation: 传统评估结构钢疲劳寿命需要进行长达数十至数百小时的机械测试，无法满足快速质量控制的需求。因此，研究旨在开发一种直接从显微图像快速预测疲劳寿命的方法，以替代耗时费力的物理测试。

Result: 在合成显微图像基准测试上，ResNet-50架构实现了R²=0.93、RMSE=0.18 log-cycles和macro-F1=0.91的优异性能。使用高斯负对数似然损失函数将预期校准误差降低了76%（从0.089降至0.021），达到了模拟条件下的方法有效性验证。

Insight: 创新点包括：1）将物理信息特征（裂纹形态、晶粒结构、孔隙率和纹理）与深度学习相结合；2）采用GNLL损失函数联合预测疲劳寿命和样本特定不确定性，显著改善了校准性能；3）Grad-CAM可视化证实网络关注冶金学上有意义的微观结构特征，增强了模型可解释性。

Abstract: Here is the plain text version optimized for arXiv’s submission form. Custom macros (like \CV and \SI) have been converted to standard text/math so they render correctly on the webpage: Evaluating the fatigue life of structural steels conventionally requires mechanical testing lasting tens to hundreds of hours, making it impractical for rapid quality control. We present CV, a computer vision framework that estimates the fatigue life ($\log N_f$) of lightweight alloy steels directly from optical micrographs without physical testing.The pipeline features a seven-stage OpenCV preprocessing routine to remove artifacts, a 28-dimensional physics-informed feature extractor (quantifying crack morphology, grain structure, porosity, and texture), and a CNN regression model trained with a Gaussian negative log-likelihood (GNLL) loss to jointly predict $\log N_f$ and sample-specific uncertainty $\hatσ$.Evaluating three architectures (SE-CNN, ResNet-50, VGG-16) on a synthetic micrograph benchmark, ResNet-50 achieves $R^2 = 0.93$, RMSE = 0.18 log-cycles, and macro-F1 = 0.91. The GNLL objective reduces Expected Calibration Error by 76% compared to a mean-squared-error baseline (ECE: $0.089 \rightarrow 0.021$). Grad-CAM maps confirm the network attends to metallurgically meaningful microstructural features.Running in under 65 ms per image, the pipeline and synthetic dataset generator are open-sourced. Because validation relies entirely on synthetic micrographs, these results demonstrate methodological soundness under simulated conditions; a domain-transfer study on real field samples is the immediate next step.

[70] Mitigating Class-Tail Undercoverage in Medical Vision-Language Models under Clinical Shift cs.LG | cs.CVPDF

Mushir Akhtar, M. Tanveer

TL;DR: 本文提出了一种名为CALCoDe的后处理可靠性层，用于缓解医学视觉语言模型在临床分布偏移下对特定疾病类别的覆盖不足问题。该方法通过交叉验证识别有风险的类别，并结合局部保形预测和类别条件尾部阈值来保证覆盖。

Details

Motivation: 医学视觉语言模型在临床分布偏移后，虽然整体边际覆盖率保持较高，但可能对单个疾病类别出现显著覆盖不足，且现有方法无法有效建模这种类别层面的覆盖失败。

Result: 在两个皮肤病学数据集偏移（HAM10000到ISIC 2019和HAM10000到PAD-UFES-20）和四种冻结VLM骨干上的实验中，CALCoDe是唯一在所有八种设置中观测边际覆盖和最差类别接受覆盖均达到0.95的方法，在HAM10000到ISIC 2019上最差类别接受覆盖平均为0.970，优于sTACP（0.926）和LCP-VLM（0.864）。

Insight: 创新点在于将类别尾部自适应与局部保形预测结合，通过识别风险类别并应用类别条件阈值，在保证整体覆盖的同时针对性地保护尾部类别，且提供了有限样本覆盖的理论保证。

Abstract: Medical vision-language models (VLMs) can retain high observed marginal coverage after clinical shift while substantially under-covering an individual disease class. The affected class varies with acquisition protocol and backbone geometry, so source prevalence does not reliably reveal the failure. Existing localized and tail-aware conformal methods respectively adapt to test neighborhoods and source-frequency tails, leaving held-out class-wise coverage failure unmodeled. We introduce Class-Tail Adaptive Localized Conformal Deferral (CALCoDe), a post-hoc reliability layer for frozen medical VLMs. Cross-fitted validation predictions identify classes at risk of undercoverage, and a disjoint calibration split estimates their class-conditional tail thresholds. CALCoDe combines each protected threshold with a localized conformal threshold using a one-sided maximum. The resulting set contains every label admitted by the localized rule, with additional protection confined to validation-identified classes. An independently calibrated support audit defers cases with insufficient inlier support. Under exchangeability among accepted examples within each protected class, CALCoDe provides finite-sample coverage at the prespecified guard level and contains the corresponding localized conformal sets; coverage on shifted external cohorts is evaluated empirically. Among standard conformal baselines and recent VLM-specific conformal methods evaluated across two dermatology shifts (HAM10000 to ISIC 2019 and HAM10000 to PAD-UFES-20) and four frozen VLM backbones (BiomedCLIP, OpenAI CLIP ViT-B/32, PubMedCLIP ViT-B/32, and MedSigLIP-448), CALCoDe is the only approach whose observed marginal and worst-class accepted coverage both reach 0.95 in all eight settings. On HAM10000 to ISIC 2019, its average worst-class accepted coverage is 0.970, compared with 0.926 for sTACP and 0.864 for LCP-VLM.

[71] Mirror Learning cs.LG | cs.CV | cs.ROPDF

Yunpeng Liu, Matthew Niedoba, Oluwanifemi A. Adekanye, Jason Yoo, Yingchen He

TL;DR: 本文提出了一种名为‘镜像学习’的框架，用于从第三人称观察中学习可执行策略。该方法结合了经过微调的视频扩散模型学习视角转换，以及逆动力学模型推断动作轨迹，从而从第三人称演示生成伪第一人称专家数据（镜像数据）。实验表明，仅使用镜像数据即可训练有效策略，并且将其与第一人称行为克隆数据结合能进一步提升策略性能。

Details

Motivation: 解决行为克隆（BC）无法有效利用丰富的第三人称观察信号的问题，旨在从被动观察中学习可执行策略，模仿人类和动物利用第三人称演示的能力。

Result: 在实验中，仅使用生成的镜像数据就能训练出有效的策略，并且将其作为第一人称BC训练的增强数据，能进一步提升下游策略的性能。

Insight: 创新点在于通过组合视角转换模型和逆动力学模型，将第三人称观察转化为可用的第一人称专家数据。客观来看，该方法展示了现代生成式世界模型隐含编码了足够结构，为减少对大量遥操作数据收集的依赖提供了一种可扩展且安全的替代方案。

Abstract: We investigate imitation learning through the lens of third-person observation and propose a framework for mirror learning: acquiring actionable policies from passive observation. While behavior cloning (BC) excels under dense, well-aligned first-person data, it fundamentally fails to leverage the rich observational signals arising from third-person demonstrations that humans and animals routinely exploit. We introduce a method that composes (i) a learned perspective transformation that places learners in demonstrators’ shoes using a fine-tuned video diffusion model and (ii) an inverse dynamics model that infers action trajectories in the learners’ control space. This enables the synthesis of mirror data, pseudo first-person expert data generated from third-person observations of demonstrator behavior. Empirically, we show that mirror data alone can train effective policies, and that augmenting first-person BC training with mirror data further improves downstream policy performance. Our results suggest that modern generative world models implicitly encode sufficient structure to enable a scalable and safe alternative to teleoperation-heavy data collection.

[72] StraightDP: Geometry-Aware Differential Privacy for Rectified-Flow Transformers cs.LG | cs.CR | cs.CVPDF

Xujun Che, Depeng Xu, Xintao Wu

TL;DR: 本文提出StraightDP，一种用于整流流变换器的几何感知差分隐私方法。该方法利用整流流在噪声端和数据端几何特性的差异，将隐私预算分为两部分：小部分预算一次性发布白化的类条件矩，其余预算用于数据端的DP-SGD训练。在MNIST数据集上，该方法在ε=1时实现了0.81的准确率和56的FID，显著优于均匀DP-SGD。

Details

Motivation: 解决文本条件生成模型在强隐私约束下进行差分隐私训练时出现的效用悬崖问题，即模型性能在强隐私保护下急剧下降。

Result: 在MNIST数据集上，当ε=1时，仅发布类条件矩即可达到0.76的下游准确率和237的FID；完整流程在公共潜在空间中达到0.81的准确率和56的FID，优于均匀DP-SGD的0.21准确率。该方法也成功迁移到冻结的SD3-medium模型，采样时注入优于DP-LoRA训练。

Insight: 创新点在于利用整流流的几何特性（噪声端由类条件矩主导，数据端由样本特定结构主导）进行端到端的异质性隐私预算分配。通过约束多模态主干网络的每令牌流范数，在不改变预训练损失的情况下，改善了极端噪声像素空间区域的下游性能。

Abstract: Differentially private (DP) training of text-conditioned generative models suffers a utility cliff at strong privacy. We revisit this problem through the geometry of rectified flows: along the straight interpolation between noise and data, the Bayes-optimal velocity is governed to leading order at the noise end by a few class-conditional moments, and increasingly sample-specific structure matters toward the data end. StraightDP exploits this heterogeneity end to end. A small budget share releases whitened class-conditional moments once, to be distilled into the weights or injected at sampling time. The rest is spent by pre-declared DP-SGD toward the data end, beyond the moments’ reach. At $\varepsilon=1$ on MNIST, the released moments alone already attain $0.76$ downstream accuracy with prototype-like samples and an FID of $237$, and uniform DP-SGD attains $0.21$. The pipeline built on the release reaches $0.81$ accuracy at FID $56$ in a public latent space. Constraining per-token stream norms of the multimodal backbone leaves the pretraining loss unchanged yet improves downstream accuracy in the extreme-noise pixel-space regime, and its accuracy effect becomes monotonically more favorable as privacy strengthens. The released moments also port to frozen SD3-medium, where sampling-time injection beats DP-LoRA training at a fraction of the budget.

Andy J. Phu, James Mooney, Karin de Langis, Khanh Chi Le, Dongyeop Kang

TL;DR: SERUM是一个从非结构化第一人称视角视频中提取结构化用户行为模型的多轮框架。它通过分层视觉语言模型标注，交替进行活动识别和意图推断，并利用累积上下文迭代优化标签以减少幻觉和时间混淆。最终通过合并同义状态生成紧凑、连贯的分类法，并在四个领域的61个视频上验证了其有效性。

Details

Motivation: 构建能够主动、个性化交互的智能助手需要结构化的用户意图和工作流模型，但从原始非结构化屏幕活动中构建这些模型仍是一个开放挑战。

Result: 在编码、烹饪、体育活动和日常生活四个领域的61个第一人称视频上评估，结果表明：迭代标签优化收敛到稳定的状态词汇表（称为图式平衡）；归一化马尔可夫模型相比频率基线实现了显著更低的困惑度和更高的动作预测准确率，在编码等结构化任务上提升最大；人工标注者认为最终轮标签准确且比第一轮有显著改进。

Insight: 创新点在于提出首个无需人工标注、直接从非结构化第一人称屏幕视频生成可解释过程模型的系统，通过多轮上下文感知的VLM标注和同义状态合并，实现了可扩展的用户建模和行为理解。其迭代优化和状态合并方法可借鉴于其他时序行为分析任务。

Abstract: Agentic assistants capable of proactive, personalized interactions require structured models of user intent and workflow. However, building these models from raw, unstructured screen activity remains an open challenge. We present SERUM, a multi-pass framework that extracts finite-state behavioral models directly from unstructured egocentric video using hierarchical VLM annotation. Processing screen recordings through a sliding window, SERUM alternates between activity-recognition and intent-inference passes, with each pass refining labels using accumulated prior context to reduce hallucination and temporal conflation seen in single-pass annotation. Synonymous states are then merged via sentence embeddings and human-calibrated thresholds into a compact, coherent taxonomy. We evaluate behavioral structure by fitting first-order Markov models over the resulting label sequences (both actions and intents) and measuring predictive accuracy against frequency baselines. Across 61 egocentric videos in four domains (coding, cooking, physical activities, and daily life), we find: (1) iterative label refinement converges to a stable state vocabulary, which we term schematic equilibrium, after several passes; (2) normalized Markov models achieve substantially lower perplexity and higher action predictions than frequency baselines, with the largest gains on structured tasks like coding; and (3) human annotators rate final-pass labels as accurate and meaningfully improved over first-pass labels. To our knowledge, SERUM is the first system to produce interpretable process models from unstructured egocentric screen video without manual annotation, opening a scalable pathway for user modeling and behavioral understanding in the wild. Our demo, code, and results are publicly available

cs.AI [Back]

[74] ThinkReset: Learnable Intermediate Interface Construction for Bounded-Context Long-Horizon Reasoning cs.AI | cs.CL | cs.LGPDF

Fei Ding, Yongkang Zhang, Runhao Liu, Yuhao Liao, Zijian Zeng

TL;DR: 论文提出ThinkReset方法，针对长链思维推理中因上下文窗口限制导致的冗余积累、上下文溢出和错误锚定问题，通过构建可重用的中间接口来替代被丢弃的历史信息，从而支持持续推理。该方法通过接口回写和重置机制，直接优化重置后的继续推理成功率。

Details

Motivation: 动机在于解决长链思维推理在有限上下文窗口下的核心瓶颈，即缺乏可重用的中间接口来替代丢弃的历史，避免因最终答案奖励驱动的强化学习导致过早猜测而非持续推理。

Result: 在多个长视野推理基准测试中，该方法在固定上下文窗口下持续提高了成功率，但未明确提及是否达到SOTA水平。

Insight: 创新点在于将中间接口构建为可学习的文本空间实例，通过接口回写和重置机制直接优化推理连续性，而非依赖轨迹压缩或测试时控制，这为长链推理提供了新的可扩展解决方案。

Abstract: Long chain-of-thought reasoning improves performance on complex problems, but it also introduces redundancy accumulation, context overflow, and error anchoring. We argue that under bounded context windows, the core bottleneck is not trajectory compression or test-time control, but the absence of a reusable intermediate interface that can replace discarded history and support continued solving. We further identify a key failure mode of outcome-reward-driven long-chain reinforcement learning: when the model has not solved the task before the window is nearly exhausted, the final-answer reward encourages premature guessing rather than continued careful reasoning. We propose ThinkReset, a text-space instantiation of this view. ThinkReset explicitly constructs reusable intermediate interfaces through interface writeback and reset, and directly optimizes post-reset continuation success. Across multiple long-horizon reasoning benchmarks, this perspective consistently improves success rates under fixed context windows.

[75] How Hard Does It Think? Analyzing Step-Aware Reasoning Energy in LLM Chain-of-Thought Trajectories cs.AI | cs.CL | cs.LGPDF

Hui Wei, Junda Wu, Sheldon Yu, Sizhe Zhou, Yizhu Jiao

TL;DR: 本文提出了一种名为Step-Aware Reasoning Energy (SARE)的几何框架，用于量化大型语言模型（LLM）在思维链（CoT）推理过程中每一步的计算努力。该方法通过相邻Transformer层间token隐藏状态的Gram矩阵的Centered Kernel Alignment (CKA)来捕获token间关系结构，并将CoT轨迹建模为潜在语义状态间的转换，从而在语义进展的背景下分析推理能量。

Details

Motivation: 现有可解释性方法依赖于输出层面的信号或将处理深度压缩为单个轨迹层面的标量，导致难以理解计算努力在思维链推理的各个步骤中是如何分配的，这是一个尚未解决的挑战。

Result: 在六个推理基准测试和三个开源权重的LLM上的实验表明，推理能量在不同步骤类型间高度不均匀，显示出轨迹层面指标无法观察到的类似相变的转换；错误的推理轨迹在关键推理节点上表现出系统性的能量降低；在大多数设置中，基于SARE的特征匹配或超越了基于输出的置信度基线。

Insight: 创新点在于提出了SARE框架，它能够在无需特征向量对齐或聚类对应的情况下，在单个CoT步骤的粒度上量化推理努力，并将这种能量置于语义进展的上下文中进行分析。客观来看，该方法揭示了LLM内部几何动态编码了超越表面信号的预测信息，为理解模型推理过程提供了新的视角。

Abstract: Understanding how computational effort is allocated across individual chain-of-thought (CoT) reasoning steps remains an open challenge: existing interpretability methods rely on output-level signals or collapse processing depth into a single trajectory-level scalar, leaving step-wise effort opaque. We propose Step-Aware Reasoning Energy (SARE), a geometric framework that quantifies effort at the granularity of individual CoT steps via Centered Kernel Alignment (CKA) between Gram matrices of token hidden states across adjacent transformer layers, capturing inter-token relational structure without requiring eigenvector alignment or cluster correspondence. SARE further contextualizes this energy within reasoning’s semantic progression by modeling CoT trajectories as transitions among latent semantic states. Across six reasoning benchmarks and three open-weight LLMs, we find that reasoning energy is highly non-uniform across step types, exhibiting phase-like transitions invisible to trajectory-level metrics; incorrect trajectories show systematically lower energy at critical reasoning junctions; and SARE-based features match or outperform output-based confidence baselines in most settings, indicating that internal geometric dynamics encode predictive information beyond surface-level signals.

[76] ViSAGE: Constructing Self-Correcting Memories for Long-Form Video Understanding cs.AI | cs.CVPDF

Xinkui Zhao, Enbo Chen, Yifan Zhang, Chang Liu, Guanjie Cheng

TL;DR: 本文提出ViSAGE框架，用于构建自校正、以实体为中心的多模态记忆，以支持长视频理解。该方法通过跨模态绑定锚定实体身份，并应用双向记忆精炼和跨代理验证来纠正错误、减少幻觉，在长视频问答任务上显著优于基线模型。

Details

Motivation: 解决现有智能体记忆方法因过度压缩和分段处理丢失细粒度实体线索，以及过度依赖向量相似性检索导致实体混淆、错误传播和答案幻觉的问题。

Result: 在长视频问答基准测试中，ViSAGE始终优于最强基线，准确率提高了5.9%。

Insight: 创新点在于通过跨模态长期绑定锚定实体身份，并引入双向记忆精炼和基于身份-证据对齐约束的多代理交叉验证机制，实现了记忆的自校正和可靠推理，减少了无证据支持的答案。

Abstract: Multimodal agents operating in long-horizon environments must build and continually update multimedia memories to support entity-consistent, temporally grounded reasoning. However, existing agentic memory approaches often discard fine-grained dentity cues under aggressive compression and segment-wise processing. They also rely heavily on vector similarity retrieval, which can surface semantically related yet identity-mismatched evidence, leading to entity confusion, error propagation, and hallucinated answers. We propose ViSAGE, a multimodal agentic memory framework that constructs self-correcting, entity-centric memories. Specifically, ViSAGE anchors entity identity via cross-modal binding over long temporal ranges. It then applies bidirectional memory refinement to propagate delayed identity evidence, retroactively unifying historical records and improving future reasoning. We also introduce multi-agent cross-verification to assess retrieved evidence under an identity-evidence alignment onstraint, enabling abstention instead of unsupported answers when evidence is missing. Extensive results demonstrate that ViSAGE consistently outperforms the strongest baseline, achieving 5.9% higher accuracy.

cs.AR [Back]

[77] Optical Flow Sensor: A Direction-Selective Bionic Retina Design cs.AR | cs.CV | cs.ET | eess.IVPDF

Juchen Zhou, Bonan Yan, Yuchao Yang

TL;DR: 本文提出了一种像素级光学流传感器集成电路，通过结合动态视觉传感器的ON/OFF事件比较与时间差测量，实现片上全并行光学流计算。该设计还引入了光学流专用地址事件表示接口以支持低功耗、高吞吐量读出，并进一步探索了基于光学忆阻器的传感器以降低功耗和面积开销。

Details

Motivation: 传统基于帧的光学流方法依赖密集采样和全局计算，导致高延迟和高功耗，而生物视网膜通过局部ON/OFF通路和并行处理高效提取运动信息。本文旨在克服传统方法的局限性，设计一种仿生视网膜结构的光学流传感器。

Result: 实验结果表明，与FPGA加速的动态视觉传感器系统相比，所提出的光学流传感器功耗降低了303倍，同时保持微秒级延迟；通过直接输出光流向量，输出数据大小减少了约3.3倍。

Insight: 创新点包括将动态视觉传感器事件比较与时间差测量结合实现片上全并行光流计算，以及光学流专用地址事件表示接口的设计；从客观角度看，该传感器在实现超高速、低功耗视觉感知应用方面显示出潜力，特别是通过光学忆阻器进一步优化功耗和面积。

Abstract: Optical flow characterizes motion in the visual field and is fundamental to motion perception and tracking in biological and artificial vision systems. Biological retinas extract motion efficiently through local ON/OFF pathways and parallel processing, while conventional frame-based optical flow relies on dense sampling and global computation, resulting in high latency and power consumption. To overcome these limitations, we present a pixel-level Optical Flow Sensor (OFS) integrated circuit. The design combines Dynamic Vision Sensor (DVS) ON/OFF event comparison with time-difference measurement to enable fully parallel optical flow computation on-chip. An optical-flow-specific Address-Event Representation (OF-AER) interface supports low-power, high-throughput readout. \rev{Based on the CMOS-based OFS, we further propose optical memristor-based OFS to reduce sensor power consumption and area overhead.} Experimental results show that the proposed OFS achieves a 303$\times$ reduction in power consumption compared with FPGA-accelerated DVS systems while maintaining microsecond-level latency. Moreover, by directly outputting optical flow vectors, the OFS reduces output data size by approximately 3.3$\times$, demonstrating strong potential for ultra-high-speed, low-power vision sensing applications.

cs.CR [Back]

[78] A Biometric Sensor Network to Enable Real-Time Measurement of Individual Student Engagement in STEM Lecture Environments cs.CR | cs.CV | cs.SE | eess.IVPDF

Ahmed Elsayed

TL;DR: 该论文提出了一种新型的生物识别传感器网络（BSN），用于在STEM课堂环境中实时测量和持续追踪学生的个体参与度。系统通过摄像头传感器捕捉行为、情感和认知指标，同时满足非侵入性、实时性和隐私保护等设计要求。

Details

Motivation: 现有测量学生参与度的方法通常具有侵入性、手动操作繁琐或不适合实时课堂使用，因此需要一种非侵入、自动且能实时测量的系统来准确评估STEM教育中的学生参与度。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试，但描述了系统支持两种操作模式（数据集收集模式和实时分析模式），并实现了完全在设备上进行处理（包括人脸检测、视线估计和情感分析），确保数据隐私。

Insight: 创新点在于设计了一个分布式传感器网络（BSN）和学生处理单元（SPU），通过硬件与软件集成实现非侵入式实时测量，同时强调隐私保护（如不存储或传输原始视频帧），为教育技术中的生物识别应用提供了可借鉴的架构。

Abstract: Student engagement (SE) is a critical predictor of academic performance and retention in STEM education, yet existing measurement approaches are often intrusive, manually intensive, or unsuitable for real-time classroom use. This thesis proposes a novel $\textit{Biometric Sensor Network}$ (BSN) designed to enable real-time measurement and continuous tracking of individual student engagement in STEM classroom environments. The system enables capturing of behavioral, emotional, and cognitive indicators through camera-based sensing while preserving ethical and privacy constraints. To measure these indicators unobtrusively and ethically, we propose a BSN composed of $\textit{Student Processing Units}$ (SPUs) that function as distributed sensing nodes. The network is explicitly designed to satisfy five objectives: it must be $\textbf{non-intrusive}, \textbf{non-invasive}, \textbf{non-stigmatizing}, \textbf{real-time}$, and $\textbf{automatic}$, while ensuring rigorous protection of student data security and privacy. Each SPU supports two operational modes: (i) a $\textit{dataset-collection mode}$, in which raw student video is temporarily recorded to construct a private SE dataset for model training and validation, and (ii) an $\textit{analysis mode}$, in which the SPU performs real-time inference on 10-second video segments without storing or transmitting raw frames. In this analysis role, each SPU enables fully on-device processing—including face detection, gaze estimation, and affective analysis—ensuring that no identifiable video data leaves the device. A secure backend infrastructure manages device authentication, session orchestration, and encrypted data ingestion. The full system integrates hardware design, computer-vision pipelines, wireless networking, security protocols, and session-level data management.

cs.IR [Back]

[79] RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems cs.IR | cs.AI | cs.CLPDF

Haoran Ling, Yuecheng Li, Zeyu Song, Jing Yao, Shuwen Kang

TL;DR: 本文提出了RecHarness，一个基于多臂老虎机路由的智能体框架，用于自动化推荐系统模型的优化。它将优化过程分解为两步：一个老虎机路由器根据历史验证反馈选择下一个修改方向，然后LLM在该方向内生成具体的优化假设和可执行代码编辑。该方法在多个推荐任务、数据集和模型骨干上实现了比纯LLM推理搜索更稳定的性能提升，并在一个大规模短视频广告平台的在线A/B测试中显著提升了关键业务指标。

Details

Motivation: 当前优化现代推荐模型严重依赖工程师手动迭代架构、目标和训练策略的更改。虽然基于LLM的智能体可以自动化此试错过程，但让LLM同时选择修改方向和生成具体假设，在有限的实验预算下往往导致搜索不稳定。

Result: 在多个推荐任务、数据集和模型骨干上，RecHarness比LLM推理搜索实现了更稳定的性能提升，并更有效地利用了有限的试验预算。在一个大规模短视频广告平台的7天在线A/B测试中，选出的候选模型将ADVV提升了2.084%，收入提升了0.534%，曝光量提升了0.559%。

Insight: 论文的核心创新点在于将优化过程解耦为方向选择（由基于老虎机算法的路由器负责）和具体假设生成（由LLM负责），并引入了“跳跃盆地”机制以在局部编辑停滞时激活结构性跳跃臂，从而支持长期探索。这为解决LLM智能体在自动化模型优化中搜索不稳定的问题提供了一个新颖且有效的框架。

Abstract: Optimizing modern recommender models still depends heavily on engineers manually iterating over architectural, objective, and training-strategy changes. While LLM-based agents can automate this trial-and-error process, allowing the LLM to both select modification directions and generate concrete hypotheses often leads to unstable search under limited experiment budgets. Inspired by the above challenge, we propose RecHarness, a Bandit-Routed Agentic Harness for automated recommender model optimization. RecHarness separates the optimization process into two steps: a bandit router selects the next modification direction according to historical validation feedback, while the LLM generates a concrete optimization hypothesis and executable code edit within the selected direction. To sustain long-horizon exploration, RecHarness uses a jump-basin mechanism to activate a structural-jump arm when local edits stagnate. Across multiple recommendation tasks, datasets, and model backbones, RecHarness achieves more stable performance improvements and uses limited trial budgets more effectively than LLM-reasoning search. During a 7-day online A/B test on a large-scale short-video advertising platform, the selected candidate improves ADVV by 2.084%, Revenue by 0.534%, and Exposure by 0.559%. Code is available at https://github.com/6lyc/RecHarness.

Table of Contents

cs.CL [Back]

[1] Learning Stateful Predictive Knowledge From Experience cs.CL | cs.LGPDF

[2] ZeroR@CHiPSAL 2026: Two-Stage Vision-Language Adaptation with Contrastive Learning for Nepali Meme Classification cs.CLPDF

[3] Chain-of-Models: Cross-Model Auditing for Bias-Robust LLM Judges cs.CL | cs.CYPDF

[4] TokenSwap: Benchmarking and Reducing the Modality Gap in Multimodal LLMs cs.CL | cs.CVPDF

[5] Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements cs.CLPDF

[6] Demystifying Entropy-based Selection for Chain-of-Thought Compression in Large Reasoning Models cs.CLPDF

[7] TELLER: Dual-Path Iterative Preference Optimization for Table Entity Linking cs.CL | cs.LGPDF

[8] Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation cs.CL | cs.AI | cs.LGPDF

[9] BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning cs.CLPDF

[10] Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models cs.CLPDF

[11] Tokenizer-Agnostic Engram Module cs.CLPDF

[12] PARALLEL: A Prefrontal-Aligned Reinforcement inspired Approach for Language-Model Learning under Explicit Limits cs.CL | cs.AIPDF

[13] Faster but Different: Diagnosing and Controlling Content Drift in Accelerated Multimodal Diffusion Language Models cs.CLPDF

[14] Authorship Verification of Transcribed German-Language Videos cs.CLPDF

[15] Learning Latent Reasoning Traces for Scalar Reward Models End-to-End cs.CLPDF

[16] Hy-MultiTurn: A Six-Dimensional Benchmark for Deep Multi-Turn Dialogue Understanding cs.CLPDF

[17] Knowing When to Quit: Diagnosing and Training LLMs to Abort Futile Reasoning cs.CLPDF

[18] Translation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation cs.CL | cs.AIPDF

[19] Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation cs.CLPDF

[20] Evidence-Type Competition: When Can Interventional Data Teach Language Models Causal Direction? cs.CL | cs.LGPDF

[21] Sycophancy Undermines Epistemic Vigilance in Cooperative Vision-Language Tasks cs.CLPDF

[22] FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language Models cs.CL | cs.AI | cs.CV | cs.HCPDF

cs.CV [Back]

[23] ReLoop-UME: Recurrent Depth with Learnable Retrieval Registers for Universal Multimodal Embedding cs.CVPDF

[24] WaiT for the Signal: Simple Frequency-Aware Flow-Matching cs.CV | cs.AI | cs.LG | stat.MLPDF

[25] Can Synthetic Data Overcome the Generalization Limits of AI-Based Flower and Pod Detection Across Cowpea Breeding Genotypes and Environments? cs.CVPDF

[26] Group-wise Supervision with Focal-Dice Loss for Long-Tailed Indoor Semantic Occupancy Prediction cs.CVPDF

[27] Visual Distribution Anchoring for Efficient Prompt Tuning cs.CV | cs.LGPDF

[28] Retrieval-Driven Training-Free AI-Generated Video Attribution cs.CV | cs.AIPDF

[29] SafeNexus: Discovering and Steering Modality-Universal Safety Neurons in MLLMs cs.CVPDF

[30] Classification of COVID-19 cases from chest CT volumes using hybrid model of 3D CNN and 3D MLP-Mixer cs.CVPDF

[31] Adjudicated Captioning: Multi-Agent Alignment Scoring and Consensus-Distilled Beam Arbitration for Strict Zero-Shot Image Captioning cs.CV | cs.AI | cs.CL | cs.MAPDF

[32] CAER: Conflict-Aware Evidence Routing with Dual Prefix Experts for Multimodal Large Language Models cs.CVPDF

[33] Evaluation-Verification Reward for Consistent Multi-Reference Image Editing cs.CVPDF

[34] SAM+D: Parameter-Efficient Dimensional Lifting of SAM-Family Models via Depth-Routed LoRA and Depth Shifting cs.CVPDF

[35] Adaptive Emotional Video Captioning via Affective Heterogeneous Graph Reasoning and Multi-task Joint Learning cs.CVPDF

[36] ReMoE: Report-Guided Mixture-of-Experts for Multimodal OCT/OCTA Anomaly Detection cs.CVPDF

[37] Parameter-Efficient Fine-Tuning for Spiking Point Cloud Models cs.CVPDF

[38] MHRGait: Gait Recognition from Momentum Human Rig Pose cs.CVPDF

[39] SciFigPlag-Bench: A Benchmark for Provenance-Aware Scientific Figure Plagiarism Detection cs.CV | cs.LGPDF

[40] On the Efficacy of Self-Supervised Point Cloud Encoders for Efficient 3D Large Language Models cs.CVPDF

[41] Locally Consistent Transductive Information Maximization for Few-Shot Remote Sensing Scene Classification cs.CVPDF

[42] Domain-Division based Progressive Learning for Source-Free Domain Adaptation cs.CVPDF

[43] Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation cs.CVPDF

[44] Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs? cs.CVPDF

[45] CorrelationFlow: A Training-Free Geometric Approach for LiDAR Scene Flow Estimation cs.CV | cs.ROPDF

[46] When Model Priors Conflict with Visual Evidence: Mitigating Commonsense-Driven Hallucinations by Selective Prior Calibration cs.CV | cs.AIPDF

[47] FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement cs.CVPDF

[48] Training-Free Entity-Level Few-Shot Segmentation of Remote Sensing Images with Advection Refinement cs.CVPDF

[49] CALM-AH: An ABAW11-Calibrated Multimodal Ensemble with Reliability-Gated Multi-Expert Consensus for Video-Level Ambivalence and Hesitancy Recognition cs.CVPDF

[50] VFAD: Variational Semantic Prompting Meets Frequency-Adaptive Representation Learning for Zero-Shot Anomaly Detection cs.CVPDF

[51] SatEdit: Mask-Conditioned Image Editing via VLM-Guided Segment Annotation cs.CVPDF

[52] OSEF: One-Step Evidence Fusion for Cross-Video Scene Procedure Planning cs.CVPDF

[53] Role-Break in Attention Heads: Understanding and Detecting Hallucinations in VLMs cs.CVPDF

[54] QR-Structured Thermal Triggers for Targeted Semantic Attacks on Infrared Vision-Language Models cs.CV | cs.AIPDF

[55] MoRoute: Dynamic Routing for In-Context Multimodal Video Generation cs.CVPDF

[56] DynoDINO: Harnessing Dynamic Latent Information from DINO Features for Multi-Phase Medical Image Segmentation cs.CVPDF

[57] FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control cs.CVPDF

[58] CoDe-SSM: Context-Detail Decoupled State Space Model for Efficient UHD Image Restoration cs.CVPDF

[59] TraceViT: Grounded Trace Supervision for Visual Abstract Reasoning cs.CV | cs.AIPDF

[60] CodeShrink: Adaptive Visual Compression for Efficient Multimodal Code Understanding cs.CV | cs.SEPDF

[61] Scaling Properties of Text Conditioning in Visual Generation cs.CVPDF

[62] Toward Robust and 3D-Aware RGB-NIR Imaging in the Dark cs.CVPDF

cs.MA [Back]

[63] TransMem: Transforming Hidden States into Memory for Large Language Models cs.MA | cs.CLPDF

cs.RO [Back]

[64] WCM: A World Critic Model for Vision-Language-Action Reinforcement Learning cs.RO | cs.CL | cs.CVPDF

[65] ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts cs.RO | cs.CVPDF

[66] BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning cs.RO | cs.CVPDF

[67] FibVLA: An Efficient Temporal Vision-Language-Action Model with Fibonacci Sampling cs.RO | cs.CVPDF

[68] RayViT: Ray-Conditioned Visual Representations for Viewpoint-Robust Imitation Learning cs.RO | cs.CVPDF

cs.LG [Back]

[69] Predicting Steel Fatigue Life from Micrographs Using Physics-Informed Deep Learning cs.LG | cs.AI | cs.CVPDF

[70] Mitigating Class-Tail Undercoverage in Medical Vision-Language Models under Clinical Shift cs.LG | cs.CVPDF

[71] Mirror Learning cs.LG | cs.CV | cs.ROPDF

[72] StraightDP: Geometry-Aware Differential Privacy for Rectified-Flow Transformers cs.LG | cs.CR | cs.CVPDF

[73] SERUM: State Extraction and Refinement for User Modeling cs.LG | cs.AI | cs.CVPDF

cs.AI [Back]