cs.CL [Total: 25]
cs.CV [Total: 59]
cs.RO [Total: 1]
cs.LG [Total: 3]
cs.GR [Total: 2]
cs.AI [Total: 2]
eess.IV [Total: 1]
cs.AR [Total: 1]

cs.CL [Back]

[1] Emotion Across Speech and Faces: Shared Affective Mechanisms in Multimodal Foundation Models cs.CL | eess.AS | eess.IVPDF

Xiutian Zhao, Luqi Sun, Björn Schuller, Berrak Sisman

TL;DR: 本文研究了三种多模态基础模型（Gemma-4-12B-it、MiniCPM-o-4.5、Qwen2.5-Omni-7B）中的情感识别机制，发现它们通过稀疏的情感敏感神经元（ESNs）来处理语音和面部的情感信息。研究表明，这些ESNs在跨模态间存在部分结构对齐，并且可以通过激活或失活进行因果操控，实现跨模态的情感特异性影响。

Details

Motivation: 尽管现代多模态基础模型在情感识别等任务上取得了进展，但其识别语音和面部情感是通过共享的情感功能单元还是模态特定通路尚不清楚。本文旨在探索并揭示其背后的跨模态情感表征机制。

Result: 研究通过语音情感识别和面部表情识别作为互补探针，识别出模型中的声学和视觉ESNs。实验表明，失活视觉ESNs会选择性损害相关面部情感的识别，而引导其激活则会选择性增强该情感的识别。跨模态干预实验进一步揭示了ESNs具有双向因果转移效应。

Insight: 创新点在于首次在多模态基础模型中进行跨模态激活层面的情感功能单元分析，揭示了语音和面部情感识别部分汇聚于稀疏的解码器层级组件，这些组件无需训练即可被定位和操控，为理解模型内部跨模态表征对齐提供了新视角。

Abstract: Modern multimodal foundation models (MFMs) have made rapid progress on tasks requiring integrated perception across speech, vision, and language, including emotion recognition. However, it remains unclear whether they recognize speech and facial emotion through shared affective functional units or modality-specific pathways. We explore emotion-sensitive neurons (ESNs), sparse decoder neurons selectively associated with emotion categories, in three MFMs: Gemma-4-12B-it, MiniCPM-o-4.5, and Qwen2.5-Omni-7B. Using speech emotion recognition and facial expression recognition as complementary probes, we identify acoustic and visual ESNs. Visual ESNs are causally meaningful: deactivating them selectively impairs recognition of the associated facial emotion, whereas steering their activations selectively enhances recognition of that emotion relative to other emotion categories. Acoustic and visual ESNs further show emotion-matched overlap and similar layer-wise distributions, indicating partial structural alignment between affective representations across speech and faces. Finally, cross-modal interventions reveal bidirectional causal transfer: ESNs identified from one modality produce emotion-specific effects when applied to the other. Our findings provide one of the first cross-modality activation-level analyses of affective functional units in MFMs, suggesting that speech and facial emotion recognition partially converge onto sparse decoder-level components that can be localized and manipulated without training.

[2] Uncertainty-Aware Decision Making in Multimodal Large Language Models cs.CLPDF

Abderrahmene Boudiaf, Irfan Hussain, Sajid Javed

TL;DR: 这篇综述论文围绕不确定性感知的多模态大语言模型（MLLMs）的决策过程，系统梳理了相关文献。论文提出一个以决策为中心的框架，将不确定性来源、可观测信号、风险校准以及系统行动联系起来，强调不确定性评估应关注其在证据不足、冲突或高风险情境下对系统行为的改进效果。

Details

Motivation: MLLMs在回答依赖多模态证据的问题时，其失败不仅源于语言错误，还可能由输入质量差、感知错误、模态冲突、推理不稳定或分布偏移等多种不确定性因素导致，因此需要系统性地理解和处理这些不确定性以提升决策可靠性。

Result: 论文是一篇综述，未报告具体的定量实验结果，但回顾了包括token/logit不确定性、语义分歧、扰动不稳定性、归因分数、验证器评分、共形预测、选择性回答和弃权等多种不确定性估计与决策方法的研究。

Insight: 核心创新观点是将不确定性评估从单纯的置信度数值，转向其在实际决策行为（如弃权、澄清、检索、自检）中的效用。论文提出了一个整合的决策框架，并指出了源感知分解、行动感知基准、分布偏移下的校准等未来开放问题。

Abstract: Multimodal large language models (MLLMs) increasingly answer questions whose correctness depends on visual, textual, temporal, acoustic, document, chart, or embodied evidence. Their failures are therefore not only linguistic. A fluent answer may conceal poor input quality, a perceptual error, weak grounding, conflict between modalities, unstable reasoning, distribution shift, or a question that is not answerable from the supplied evidence. This survey organizes the literature on uncertainty-aware MLLMs around a decision-centered framework: uncertainty sources give rise to observable signals, signals must be calibrated or controlled for risk, and calibrated uncertainty should determine the system action. We review work on token and logit uncertainty, semantic disagreement, perturbation instability, grounding and attribution scores, verbalized confidence, verifier and judge scores, conformal prediction, selective answering, abstention, clarification, retrieval, self-checking, and escalation. The central argument is that uncertainty should not be evaluated only as a confidence number; it should be evaluated by whether it improves behavior under insufficient, conflicting, shifted, or high-risk multimodal evidence. We position this survey against text-only uncertainty and abstention surveys, broad MLLM surveys, MLLM hallucination surveys, and safety-oriented reviews. We conclude with open problems in source-aware decomposition, action-aware benchmarks, calibration under shift, black-box uncertainty estimation, broader modality coverage, reproducible reporting, and human-centered uncertainty communication.

[3] Towards Safer RAG: Only Agents Capable of System 2 Thinking may Access Untrusted Documents cs.CLPDF

Mehrdad Ghassabi

TL;DR: 本文针对检索增强生成（RAG）系统易受知识投毒攻击的问题，提出了一种改进的安全原则：只有具备审慎性系统2思维能力的智能体才能访问不可信文档。作者引入了量化错误信息检测与下游影响之间差异的新指标，并通过实验证明具备推理能力的大语言模型对污染证据具有更强的鲁棒性，无需依赖严格的隔离机制。

Details

Motivation: RAG系统虽然提升了LLM性能，但仍易受检索文档中错误信息的影响，即使模型能检测到错误，其输出仍可能被误导。现有工作通过Cordon原则隔离证据访问，但这带来了显著的计算开销。

Result: 作者在提出的新指标上，对最先进的推理语言模型与标准语言模型进行了实证比较。结果表明，具备推理能力的模型对污染证据的鲁棒性显著更强，且无需Cordon原则的严格隔离。

Insight: 论文的核心创新在于提出并实证支持了一个更精细的安全设计原则，即基于智能体的推理能力（系统2思维）来分级控制对不可信文档的访问，这为构建更实用、安全的RAG系统提供了新的理论基础和评估方法。

Abstract: Retrieval-Augmented Generation (RAG) has significantly enhanced the performance of large language models (LLMs), yet these systems remain vulnerable to knowledge-poisoning attacks, in which misinformation in retrieved documents can influence the model’s final outputs. Notably, an LLM may correctly detect that a document contains incorrect information while nevertheless being influenced by it. Prior work has addressed this vulnerability through the Cordon Principle, which prevents models responsible for final answer synthesis from directly accessing raw evidence. Although effective, this strict isolation can introduce substantial computational overhead. In this work, we propose a refined security principle: only agents capable of deliberative System 2 reasoning may access untrusted documents. To evaluate this principle, we introduce novel metrics that quantify the discrepancy between misinformation detection and downstream influence. We then empirically compare state-of-the-art reasoning language models with standard language models across these metrics. Our results show that reasoning-capable models are substantially more robust to corrupted evidence, without requiring the strict isolation imposed by the Cordon Principle. These findings provide empirical support for our refined principle and suggest a more practical foundation for secure RAG system design.

[4] Can LLMs Reason in a Legally Meaningful Manner? A Small-scale Study on European Court of Human Rights Cases cs.CL | cs.AIPDF

Amogh Raina, Ilias Chalkidis, Daniel Hershcovich, Henrik Palmer Olsen

TL;DR: 本研究探讨了大语言模型在法律案例预测任务中的推理能力，以欧洲人权法院（ECtHR）案例为测试平台，评估了GPT-5.4模型在不同提示策略下的表现。研究发现，模型在法律推理方面表现不佳，其分析结构完整但内容肤浅，且基于LLM的自动评估与人类评估一致性较弱。

Details

Motivation: 尽管推理已成为当代大语言模型的标准能力，但其在要求严格的法律导向任务（如法律案例预测）中的应用和质量仍未得到充分探索。

Result: 在ECtHR案例测试中，GPT-5.4模型的法律推理得分远不理想；专家精心设计的提示能产生更全面的推理，但并未比其他设置带来更准确的预测。LLM-as-a-Judge评估者内部一致，但与训练有素的人类标注者仅弱相关。

Insight: 论文揭示了当前顶级LLM在法律推理任务中的实质性局限，并提出了重要警示：不应仅依赖自动化的LLM评估，也不应将任务准确率作为推理质量的合适代理指标。

Abstract: Reasoning has become a standard technique and feature for contemporary LLMs; however, its application and quality in the context of demanding legal-oriented tasks, such as legal case forecasting, remain under explored. We investigate how LLMs reason in the context of legal case forecasting, using legal cases from the European Court of Human Rights (ECtHR) as a testbed. We evaluate OpenAI GPT 5.4, a recent top-tier LLM, by exploring alternative prompting strategies that are more or less suggestive of what counts as legally meaningful reasoning in the context of ECtHR jurisprudence. We present our findings derived from assessing the model’s responses with both human and LLM evaluation. We find that the examined model scores far from ideal in legal reasoning, the model produces structurally complete but substantively shallow analyses, and that LLM-as-a-Judge evaluators are internally consistent yet align only weakly with our trained annotators, i.e., reliable but not a valid substitute for human evaluation. Overall, the expert-curated prompt leads to more comprehensive reasoning, which does not result in more accurate predictions compared to the other examined settings. Based on our findings, we urge the community not to rely solely on automated LLM-based evaluation and to avoid using task accuracy as an appropriate proxy for reasoning quality.

[5] Polaris: Learning to Generate Table Descriptions from Retrieval Feedback cs.CL | cs.DBPDF

Ting Cai, Tuan Minh Phan, AnHai Doan

TL;DR: Polaris是一个系统，它通过检索反馈来训练大型语言模型（LLM）生成表格描述，旨在提升表格检索效果。其核心方法是利用现有表格检索基准中的查询-表格相关性判断，生成多个候选描述，通过BM25检索效果进行排序，并使用直接偏好优化（DPO）对LLM进行微调。

Details

Motivation: 解决现有使用LLM生成表格描述的方法通常只优化流畅性而非检索有效性的问题，旨在直接提升表格在NL2SQL等任务中的检索性能。

Result: 在广泛的实验中，Polaris显著优于当前最先进的AutoDDG解决方案，证明了其有效性。

Insight: 创新点在于将检索基准重新用作监督信号，通过检索反馈（DPO）直接优化LLM生成面向检索的元数据；同时，在生成前扩展表格和列名的缩写以减少词汇不匹配，这是提升检索效果的关键技术细节。

Abstract: Many table-centric NLP tasks such as NL2SQL first retrieve relevant tables from large collections using keyword search. Recent work uses LLMs to generate natural-language table descriptions to improve retrieval, but they are typically optimized for fluency rather than retrieval effectiveness. We present Polaris, a system that trains an LLM to generate table descriptions directly from retrieval feedback. Our key insight is that existing table retrieval benchmarks already contain the supervision needed for this task: given query-table relevance judgments, we generate multiple candidate descriptions for each table, rank them by their BM25 retrieval effectiveness, and use the resulting preference pairs to fine-tune the LLM with Direct Preference Optimization (DPO). Polaris further expands abbreviated table and column names before generation to reduce vocabulary mismatch. Extensive experiments show that Polaris outperforms the state-of-the-art AutoDDG solution, often by a significant margin. More broadly, our results demonstrate that retrieval benchmarks can be repurposed as supervision for training LLMs to generate retrieval-oriented metadata.

[6] Which Source Wins? Task-Dependent Reliance in Vision-Language Models cs.CL | cs.CVPDF

Rodela Ghosh, Aviral Gupta, Guangjing Wang

TL;DR: 该论文研究了视觉语言模型（VLMs）在图像和文本信息冲突时的模态依赖转移问题。通过构建可控实验，在GSM8K、SVAMP算术数据集和手动标注的ChartQA-Conflict图表问答基准上，系统评估了六种开源VLM和两种前沿API模型。研究发现，模型对模态的依赖并非固定，而是随任务类型、证据结构、模型架构和评估方式动态变化。

Details

Motivation: 当视觉语言模型（VLMs）处理的图像和文本信息发生冲突且其中一种模态可读性下降时，模型如何在两种模态间重新分配依赖尚不明确。本文旨在通过受控实验探究这种模态依赖的动态转移机制。

Result: 在GSM8K和SVAMP算术冲突任务中，六分之五的开源模型更倾向于从退化文本转向图像；而在ChartQA-Conflict图表冲突任务中，所有六个模型都表现出相反模式，更强烈地转向退化视觉源。GPT-5.6-Luna和Gemini-3.5-Flash等前沿API模型也复现了ChartQA-Conflict的反转现象。

Insight: 创新点在于构建了ChartQA-Conflict人工审核基准，并采用条件对数似然边际等细粒度评估指标。核心发现是VLM的模态依赖具有任务依赖性，这挑战了“视觉模态始终优先”的假设，为理解多模态模型决策机制提供了新视角。

Abstract: Vision-language models (VLMs) combine images and text, but when the two conflict and one becomes harder to read, it is unclear how a model shifts its reliance between them. We study this modality reallocation with a controlled setup: we degrade either the image or the text across four levels of legibility while keeping the other clean, and track how the model’s preference changes. We build conflicts from GSM8K and SVAMP by pairing the rendered image of one arithmetic problem with the text of another, so the two sources support different answers. We also introduce ChartQA-Conflict, a manually reviewed benchmark of 229 chart-report conflicts with matched chart and table-image representations. We evaluate six open-weight VLMs using both generated answers and a length-normalized conditional log-likelihood margin. On GSM8K and SVAMP, five of six models shift more strongly away from degraded text than from degraded images. On ChartQA-Conflict, all six likelihood-scored models exhibit the opposite pattern, shifting more strongly away from the degraded visual source. This reversal persists after calibrating for unimodal accuracy loss and after replacing charts with plain table images. Two frontier API models, GPT-5.6-Luna and Gemini-3.5-Flash, behaviorally replicate the ChartQA-Conflict reversal, with GPT-5.6-Luna also matching the arithmetic direction. These results show that modality reliance in VLMs is not fixed, but varies across tasks, evidence structures, models, and evaluation settings. The source code is available at https://github.com/Ro-netizen004/multimodal-arbitration-artifact.

[7] Q-Interference: Memory-Efficient Phase-Aware Quantum-Inspired Attention cs.CLPDF

Emama Nahid, Tahmid Imtiaz Imu, Huayue Gu, Liran Ma, Zhipeng Cai

TL;DR: 本文提出了一种名为Q-Interference的量子启发注意力机制，用于自回归语言建模。该机制通过为查询和键特征添加振幅和可学习相位，实现了相位感知的注意力评分，使相位一致的token相互增强，相位冲突的token相互抑制。为了解决朴素实现中内存消耗大的问题，论文提出了一种精确的三角分解方法，通过两次标准矩阵乘法计算相同分数，避免了大型中间张量的显式存储。

Details

Motivation: GPT中的注意力机制通过点积相似度衡量token兼容性，虽然简单有效且内存高效，但未能显式建模强token特征之间是应相互增强还是抑制。本文旨在引入相位信息来丰富token间的交互规则。

Result: 在公开基准数据集和基线模型上的实验表明，所提出的重构方法在受控的GPT风格设置下能够稳定训练，并且相比朴素的相位感知干扰注意力，提供了持续的内存优势。

Insight: 核心创新点在于将量子力学中的相位干涉概念引入经典注意力机制，并提出了一个精确且内存高效的重构方法，使相位感知的干扰注意力能够在标准GPT流程中变得实用。这为丰富注意力交互模式提供了一种新思路，同时保持了计算可行性。

Abstract: GPT attention measures token compatibility through dot-product similarity. This mechanism is simple, effective, and memory-efficient. But it does not explicitly model whether strong token features should reinforce or suppress one another. We introduce Q-Interference, a fully classical quantum-inspired attention mechanism for autoregressive language modeling that augments each query and key feature with an amplitude and a learned phase. The resulting attention score is phase-aware which aligned phases contribute constructively while conflicting phases contribute destructively. Although Q-Interference yields a richer interaction rule than similarity alone, a naive implementation of Q-Interference requires a large token-pair-feature interaction tensor, making it memory-intensive and often impractical. To address this limitation, we propose an exact trigonometric factorization that computes the same score using two standard matrix multiplications avoiding materialization of the large intermediate tensor. Q-Interference fits directly into a Transformer block in GPT and leaves the remainder of the model architecture and next-token prediction objective unchanged. Experiments on public benchmark datasets and baseline models show that the proposed reformulation trains stably in a controlled GPT-style setting and provides a consistent memory advantage over naive phase-aware interference attention. These results support the specific contribution of this work: an exact memory-efficient reformulation that makes phase-aware interference attention practical within a standard GPT pipeline.

[8] PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX cs.CL | cs.AIPDF

Genghan Zhang, Yixin Dong, Chengze Fan, Zhichen Zeng, Yueming Yuan

TL;DR: 本文提出了PTXBench基准测试，用于评估和适配大语言模型（LLM）在GPU内核优化中利用架构特定PTX（并行线程执行）指令的能力。该基准在H100和B200 GPU上，针对GEMM和注意力计算负载，衡量功能正确性、目标指令执行情况以及相对于前沿库的加速比。评估发现现有模型的PTX能力参差不齐，在复杂注意力反向计算任务上成功率显著下降，且指令执行不一定带来有竞争力的性能。作者进一步通过监督微调适配了Qwen3.6-27B模型，发现修复条件训练能提升部分任务，但泛化能力仍不均衡，数据覆盖、平衡和推理教师模型质量与数据集规模同样重要。

Details

Motivation: 为了解决大语言模型在利用特定GPU架构（如H100、B200）的PTX指令进行内核优化时，其能力缺乏系统评估和适配的问题，作者旨在创建一个可审计的测试平台，以衡量和提升LLMs利用不断演进的GPU架构的能力。

Result: 在PTXBench基准测试中，评估显示没有模型能在所有任务上持续匹配前沿库的性能；在复杂的注意力反向计算工作负载上，成功率大幅下降。通过对Qwen3.6-27B进行监督微调，修复条件训练改善了部分任务，但泛化效果不均。

Insight: 论文的创新点在于提出了首个专注于评估LLMs利用架构特定PTX进行GPU内核优化的基准测试PTXBench，并揭示了成功执行目标指令与实现有竞争力性能之间的差距。从客观角度看，其研究强调了在适配LLMs进行低级代码优化时，数据质量（覆盖、平衡、教师模型）与数量同等重要，为未来模型在该领域的改进提供了明确的评估框架和方向。

Abstract: We introduce PTXBench, a benchmark for evaluating and adapting large language models (LLMs) to use architecture-specific PTX for GPU kernel optimization. PTXBench measures functional correctness, whether selected target instructions execute at runtime, and speedup over frontier libraries across GEMM and attention workloads on H100 and B200 GPUs. Our evaluation shows that architecture-specific PTX capability remains uneven: success rates fall substantially on complex attention backward workloads, and executing the target instructions does not necessarily translate into competitive performance. No evaluated model consistently matches frontier libraries across the suite. We further adapt Qwen3.6-27B using supervised fine-tuning. Repair-conditioned training improves several tasks, but generalization remains uneven; data coverage, balance, and the quality of the reasoning teacher matter in addition to dataset size. PTXBench provides an auditable testbed for measuring and improving LLMs’ ability to exploit evolving GPU architectures.

[9] An Investigation of Translationese in the Generations of Multilingual Large Language Models cs.CLPDF

Maria Valentini, Téa Wright, Julisa Granados, Eliana Colunga, Katharina von der Wense

TL;DR: 本文研究了多语言大语言模型（MLLMs）生成的文本是否表现出翻译腔（translationese）。作者利用已建立的翻译文本指标，评估了五种语言中先进MLLMs生成的文本，并与非翻译及人工撰写的基线进行比较，以区分翻译腔与其他干扰。通过高精度分类模型、对个体语言特征的方差分析，以及在德语和西班牙语子集中收集的人工标注，评估了MLLM生成文本的翻译腔内容，并检查了区分MLLM生成文本与典型翻译相关干扰的关键特征。

Details

Motivation: 动机在于探究MLLMs生成多种语言文本时，是否类似于内部翻译（可能来自英语或其他语言），从而产生翻译腔，并比较MLLMs产生的翻译腔与直接翻译产生的翻译腔有何不同。

Result: 研究评估了五种语言中先进MLLMs生成的文本，通过分类模型、方差分析和人工标注（在德语和西班牙语子集中）进行分析，以量化翻译腔的存在和特征。

Insight: 创新点在于首次系统性地调查MLLMs生成文本中的翻译腔现象，并利用多种分析方法（包括机器学习分类和人工评估）来区分MLLM生成文本与直接翻译文本的差异，为理解MLLMs的语言生成机制提供了新视角。

Abstract: Text which has been translated from another language tends to carry with it evidence of translation$\unicode{x2014}$hence, it is often referred to as $\textit{translationese}$. Multilingual large language models (MLLMs) generate text in a variety of languages. However, it is still unclear if MLLMs’ generations resemble internal translation (from English or, potentially, other languages) and, thus, result in translationese. Here, we ask the following research questions: (1) Does text generated by MLLMs resemble translationese? (2) How does translationese produced by MLLMs differ from translationese produced through direct translation? We leverage established indicators of translated text to evaluate text generated by state-of-the-art MLLMs in five languages, comparing to both non-translated and human-written baselines in order to isolate translationese from other kinds of interference. Through the use of high-accuracy classification models, analyses of variance on individual linguistic features, and the collection of human annotations in a subset of two languages (German and Spanish), we assess the translationese content of MLLM generations and examine the key features that distinguish MLLM-generated text from typical translation-related interference.

[10] CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method cs.CL | cs.AIPDF

Jin Su, Zhuofeng Zhao, Huanhuan Wang, Hao Chen

TL;DR: 本文提出了一种复杂度感知的法律检索增强生成方法CoAL-RAG，通过构建基于’问题本质’和’检索一致性’的多维评估机制，实现检索策略的自适应路由。该方法根据问题的逻辑结构量化推理需求，并利用语义检索与关键词检索的差异间接反映问题复杂度，从而动态选择最合适的检索策略并过滤上下文信息。

Details

Motivation: 法律咨询问题具有多层次复杂性，单一检索策略常导致简单问题过度推理、复杂问题可解释性差，难以在高风险场景下同时满足答案质量和效率的要求。

Result: 实验表明，该方法在中文法律基准（SocialLawQA、LawBench）上显著优于基线模型，BLEU分数提升42.5%，ROUGE-L达到基于知识图谱方法的3.6倍；在英文数据集（LexGLUE、CaseHold）上也展现出强大的跨司法管辖区泛化能力，保持了高度竞争力的准确率。

Insight: 创新点在于构建了复杂度感知的多维评估机制，通过量化推理需求和利用检索差异自适应选择策略，实现了生成质量、深度逻辑推理与系统效率之间的最优平衡，尤其在跨司法体系场景下表现出色。

Abstract: Legal consultation questions exhibit multi-level complexity. A single retrieval strategy often leads to over-reasoning for simple questions and poor interpretability for complex ones, making it difficult to meet the requirements for both answer quality and efficiency in high-risk scenarios. To address this issue, this paper proposes CoAL-RAG, a complexity-aware legal retrieval-augmented generation method, which constructs a multi-dimensional evaluation mechanism based on question essence'' and retrieval consistency’’ to enable adaptive routing of retrieval strategies. First, the reasoning demand is quantified according to the logical structure of the question. Then, the discrepancy between semantic retrieval and keyword retrieval is utilized to indirectly reflect problem complexity, thereby selecting the most appropriate retrieval strategy and dynamically filtering contextual information. Experimental results demonstrate that the proposed method significantly outperforms baseline models not only on Chinese legal benchmarks (SocialLawQA, LawBench) but also demonstrates strong cross-jurisdictional generalization on English datasets (LexGLUE, CaseHold). Specifically, on Chinese datasets, the BLEU score improves by 42.5% and ROUGE-L reaches 3.6 times that of knowledge graph-based methods. On English benchmarks, CoAL-RAG maintains highly competitive accuracy, achieving an optimal balance between generation quality, deep logical reasoning, and system efficiency across different legal systems.

[11] ArborMem: Navigating Interaction States with Memory Forests cs.CLPDF

Zongwei Lv, Yuemeng Xu, Yilun Yao, Siyi Ding, Xinyu Tan

TL;DR: 本文提出了ArborMem，一个用于长程对话的在线记忆框架，它将对话建模为一个可导航的交互状态森林。该方法通过定位当前输入相关的状态分支，并跨分支检索可重用证据，以解决现有方法在交织、可恢复的多任务对话中难以维持交互连续性的问题。

Details

Motivation: 现有LLM对话记忆系统通常直接检索相关历史信息，而未能首先确定当前对话轮次应恢复哪个先前的交互状态。这在对话交织多个可能被中断后重新访问的任务、人物和计划时，成为一个关键限制。

Result: 在LongMemEval、LoCoMo、BEAM 100K和作者提出的BranchMemEval基准测试上，ArborMem比最强基线高出3.36到10.31个百分点，在BranchMemEval上高出5.0个百分点。在受限读取预算下优势更明显，且完整记忆查询时间保持在0.5秒以内。

Insight: 核心创新在于将长程对话建模为交互状态森林，实现了对话状态的定位与恢复，并支持跨分支的证据检索。这为解决交织、可恢复的多任务对话中的记忆连续性挑战提供了结构化框架。作者还为此类问题引入了专门的诊断基准BranchMemEval。

Abstract: Large language models increasingly serve as persistent conversational assistants, requiring memory that preserves relevant experience and maintains continuity across interactions. Existing methods improve access to conversational history through long-context processing, selective retrieval, and structured memory organization. However, most systems treat memory access as retrieving relevant past information without first determining which prior interaction state the current turn resumes. This limitation becomes particularly important when conversations interleave multiple tasks, people, and plans that may be interrupted and later revisited. We introduce ArborMem, an online memory framework that represents a long-running conversation as a navigable forest of interaction states. Each branch preserves a locally coherent trajectory, while the forest maintains multiple trajectories that may later be resumed. For each new input, ArborMem localizes the relevant state, restores its branch-local context, and augments it with reusable evidence retrieved across branches, preserving interaction continuity without conflating semantically related but structurally distinct trajectories. Existing long-term memory benchmarks cover diverse memory and reasoning capabilities but do not explicitly isolate branch-structured challenges. We therefore introduce BranchMemEval, a controlled diagnostic benchmark for interleaved and resumable interaction trajectories. Experiments on LongMemEval, LoCoMo, BEAM 100K, and BranchMemEval show that ArborMem outperforms the strongest baselines by 3.36 to 10.31 percentage points on the three established benchmarks and by 5.0 points on BranchMemEval. Its advantage grows under constrained read budgets, while complete memory queries remain below half a second.

[12] Auditing Exposure to Harmful Content on TikTok using Multimodal Language Models: A Cross-National, Age-Stratified Study cs.CLPDF

Hamidreza Saffari, Francesco Pierri

TL;DR: 本研究利用多模态大语言模型（MLLM）对TikTok在法国、意大利和瑞典三个国家、针对四个年龄段用户（13、16、19、40岁）进行了有害内容暴露审计。通过创建模拟账户进行被动浏览和主动关键词搜索，收集了近3.7万个视频，并使用经过验证的Gemini 2.5 Flash模型（结合8帧采样和文本）进行低成本、可扩展的自动标注。研究发现，主动搜索会显著增加有害内容暴露，且平台安全过滤机制存在漏报。

Details

Motivation: 在线视频平台可能使年轻用户暴露于有害内容，但独立审计面临视频标注成本高昂、不同语言间审核标准不一等挑战。本研究旨在开发一种可扩展的多模态方法，对TikTok进行跨国、分年龄段的系统性安全审计。

Result: 在验证集上，Gemini 2.5 Flash模型（结合8帧采样和文本）与母语标注者的一致性最高（综合kappa系数为0.42），且API调用成本仅为原生视频上传的一半。审计结果显示：主动关键词搜索导致有害内容比例（35-56%）比被动浏览基线高出1.5-7.5倍；被动浏览下，意大利各年龄段有害内容率最高，19岁用户达48.6%；平台安全过滤器拒绝率仅为1.1%，对最露骨的有害内容存在漏报。

Insight: 创新点在于提出并验证了一种基于多模态大语言模型（MLLM）的低成本、可扩展的跨国视频平台审计框架，该方法结合了被动和主动用户行为模拟。客观来看，该研究为平台治理和监管提供了可复现的量化审计工具，并揭示了平台现有安全过滤机制的局限性以及用户行为（如搜索）对内容暴露风险的显著影响。

Abstract: Online video platforms can expose young users to harmful content, but independent audits remain difficult because video annotation is costly and moderation judgments vary across languages. We audit TikTok in France, Italy, and Sweden with sockpuppet accounts representing four age personas (13, 16, 19, 40), collecting 36,971 videos from passive For-You-page scrolling and active sessions that scroll, search for harm keywords, and scroll again. To scale annotation, we validate four multimodal LLMs against native-speaker labels on a 300-video reference set. Gemini 2.5 Flash with eight sampled frames plus text performs best (aggregate kappa = 0.42), at half the per-call cost of native-video upload, and we apply it to a 10% sample for approximately $50 in total API spend across both modalities. Keyword search returns 35-56% harmful content, a 1.5-7.5x increase over the scrolling baseline in ten of twelve country-age combinations; the spike is temporary and flattens the age differences observed in France and Sweden. Under passive scrolling, Italy has the highest harm rate at every age, with Italian age-19 reaching 48.6%. Overall, MLLM-based auditing offers a scalable approach for cross-national youth-safety audits, while provider safety filters (1.1% refusal rate) under-count the most explicit harms.

[13] Write, Execute, Refine: From Skill Followers to Skill Optimizers via Reinforcement Learning from Execution Feedback cs.CLPDF

Kang Peng, Zhiwei Zhang, Yichen Zhang, Zezhong Wang, Yiming Du

TL;DR: 本文提出WER（Write, Execute, Refine）框架，通过强化学习从执行反馈中训练一个独立的技能优化器，以提升工具使用智能体生成自然语言技能的质量。该框架将技能执行经验组织为训练状态，使优化器能从其先前输出的成功与失败轨迹中学习，从而将智能体从单纯的技能跟随者转变为技能优化者。

Details

Motivation: 现有智能体自生成的技能性能甚至比不使用技能更差，这表明遵循程序性指导与根据执行证据改进技能是两种不同的能力。研究旨在解决如何利用中间技能的执行经验来训练一个能持续优化技能的模型。

Result: 在BFCL v4多轮任务和tau2-bench基准测试中，WER相比无技能基线分别将平均Pass@1提高了7.80和3.85个百分点；在相同的优化流程下，比未经优化器训练的相同骨干模型分别高出9.35和10.29个百分点。训练后的40亿参数优化器在BFCL v4上达到76.63%的性能，超过了所有作为技能优化器评估的现成通用模型。

Insight: 核心创新在于将技能优化过程解耦为一个独立的、可从执行反馈中学习的优化器模块，并通过程序化验证器评分来构建包含成功与失败轨迹的混合结果记录作为训练状态，使模型能从自身输出的后果中进行强化学习，从而持续提升技能生成质量。

Abstract: Expert-written natural language skills can improve tool-using agents, yet agent-authored skills perform 8-11 points worse than using no skill. This gap suggests that following procedural guidance and improving it from execution evidence are distinct capabilities. Inference time loops can repair skills but do not improve the model that writes the next one. We study how to organize execution experience from intermediate skills into training states for an optimizer. We introduce WER (Write, Execute, and Refine), a multi-phase framework that trains a Skill Optimizer outside a frozen executor. The optimizer proposes skills, a frozen agent executes each repeatedly, and a programmatic verifier scores the outcomes. The scores provide relative credit and select mixed-outcome records. Matched successful and failed trajectories from these records form the next phase’s refinement states, so the optimizer learns from the consequences of its earlier outputs. On BFCL v4 multi-turn and tau2-bench, WER improves average Pass@1 over the no-skill baseline by 7.80 and 3.85 points, respectively. Under an identical refinement workflow, it outperforms the same backbone without optimizer training by 9.35 and 10.29 points. The trained 4B optimizer reaches 76.63 percent on BFCL v4, outperforming all evaluated off-the-shelf general-purpose models used as skill optimizers on average.

[14] Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges cs.CL | cs.AI | cs.SDPDF

Syeda Faiza Ahmed, Zien Sheikh Ali, Hunzalah Hassan Bhatti, Firoj Alam, Shammur Absar Chowdhury

TL;DR: 这篇综述论文探讨了多轮对话式人工智能从纯文本交互向多模态交互的演进，系统回顾了相关数据集、模型、评估方法和开放挑战。文章指出，尽管多模态感知与生成能力进步显著，但系统在维持跨轮次连贯交互、持久记忆、跨模态信息关联等方面仍面临困难。

Details

Motivation: 动机在于对话式AI正从孤立的文本提示转向持续的、多模态的交互。真实对话要求系统能够在多轮对话中保持上下文、处理用户的目标澄清、请求修订、话题切换等复杂行为，并跨模态、工具和外部知识进行信息关联。

Result: 论文是一项综述研究，未提出具体模型或报告定量结果。它通过分析现有文献，总结了当前多轮对话AI在数据集、基准测试、建模范式、训练策略和评估设置等方面的现状与不足。

Insight: 论文的核心洞察是，当前系统的多模态支持能力发展快于维持会话连贯交互的能力。创新之处在于系统性地将多轮对话AI的挑战组织为记忆、跨轮次关联、全双工交互、鲁棒评估和文化对齐等关键维度，并提出了一个涵盖记忆、修订、关联、听说、行动和跨文化适应的未来研究议程。

Abstract: Conversational AI is moving beyond isolated text prompts toward sustained, multimodal interaction. In real conversations, users clarify goals, revise requests, interrupt responses, switch topics, and introduce new evidence while expecting systems to preserve context across turns. This makes multi-turn dialogue a distinct challenge requiring systems to maintain and update memory, ground responses across modalities, tools, and external knowledge, and adapt across languages and cultures. This study reviews multi-turn conversational AI across text-only dialogue, AudioLLMs and speech-native systems, multimodal and omni-modal systems, and tool-augmented agents. We organize the literature around datasets and benchmarks, modeling paradigms, training strategies, evaluation setups, and cross-cutting challenges. Our analysis shows that support for multiple modalities has advanced faster than the ability to sustain coherent interaction across a session. Despite stronger capabilities to perceive, speak, and act across modalities, current systems still struggle with persistent memory, cross-turn grounding, full-duplex interaction, robust evaluation, and cultural alignment. We conclude with a research agenda for systems that can remember, revise, ground, speak, listen, act, and adapt across turns, modalities, and cultures. (https://github.com/faiza-sfa/multiturn-conversational-ai-survey)

[15] Thinking in a Low-Resource Language: What SFT Builds, What RL Fixes, What Accuracy Cannot See cs.CL | cs.LG | cs.RO | stat.MLPDF

Ayoub Kirouane, Christos Petrocheilos

TL;DR: 该论文研究了在低资源语言（以希腊语为例）上对三个前沿的混合专家模型进行微调的效果。研究发现，在传统的准确性基准测试上几乎没有变化，且基准测试本身存在巨大噪声。真正的变化发生在准确性无法衡量的行为层面：基础模型完全不会用希腊语进行推理，而监督微调后模型能几乎完全使用问题语言进行推理且不损失通用能力，但会引入格式错误等问题。强化学习则可以有效修复这些行为缺陷。

Details

Motivation: 动机是探究如何让前沿的大语言模型在低资源语言环境中进行‘思考’（即推理），并评估监督微调和强化学习在塑造模型行为（而非仅提升准确性）方面的不同作用，因为准确性基准在低资源场景下可能失效且噪声大。

Result: 在准确性基准上，微调带来的变化微乎其微，且基准噪声（仅改变随机种子就导致7.7分的波动）超过了所有数据和配方效应。在行为维度上：SFT将希腊语推理比例从0%提升至~98%，并保持了通用能力；RL则将SFT遗留的格式错误（24%降至2.5%）和答案泄露（3.5%降至0.0%）等问题大幅修复。

Insight: 核心创新在于提出了六个与输出长度无关的行为维度来量化模型在低资源语言上的‘思考’能力，这比传统准确性指标更敏感。研究揭示了SFT能高效建立目标语言的推理习惯但不擅长自我修正，而RL配合可验证奖励能有效纠正行为缺陷。方法论（行为维度、控制组、预注册）具有普适性，可用于评估任何低资源语言场景。

Abstract: Take three frontier mixture-of-experts models (Alibaba, OpenAI, NVIDIA; 3.6-4.0B active parameters each) and fine-tune them to reason in a low-resource language. On accuracy benchmarks almost nothing happens, and the benchmark itself is noise at this scale: changing only the random seed moves the score by 7.7 points, more than every data and recipe effect we measured. That null is our first result. The real changes live where accuracy cannot see. Base models never think in Greek: 0 of 1,000 reasoning traces, even when the question is Greek, so the model answers correctly while reasoning in a form its user cannot read, audit, or correct. After supervised fine-tuning (SFT), every released checkpoint reasons in the language of the question on ~98% of items, one family at 3x fewer tokens, with judged grammaticality improving on all four models and general ability within a few points of each base: nothing was forgotten, and fluency was gained. We propose six behavioural dimensions that make such changes measurable, each gated to reject any metric that correlates with output length, and we report how our own instruments lied: six failures, each caught by a control. What SFT cannot do is fix its own defects: a quarter of answers skip the requested format, answers leak into the reasoning channel, and an explicit “think in English” is obeyed under half the time. Reinforcement learning with verifiable rewards, pre-registered before training, fixes the first two outright (fallback 24% to 2.5%, leak 3.5% to 0.0%, both against a flat random-reward control) and moves the third (+9.1pp), while the Greek reasoning habit survives an accuracy-only gradient untouched. We release five checkpoints. The instruments, the controls and the pre-registration travel to any low-resource language; Greek is the case that let us measure them.

[16] TraceSQL: Traceable Answerability Estimation for Reference-Free Text-to-SQL Verification cs.CLPDF

Neelesh Kumar Shukla, Debasmita Panda, Srutanik Bhaduri, Aditya Banerjee, Viji Krishnamurthy

TL;DR: 本文提出了TraceSQL，一种用于无参考文本到SQL验证的可追溯答案性估计模型。该模型通过结合67个显式诊断特征来评估生成的SQL查询是否可能正确回答用户问题，这些特征涵盖了问题模糊性、需求、一致性、SQL结构和意图对齐等多个方面。

Details

Motivation: 现有的文本到SQL系统在推理时缺乏真实SQL查询或执行结果的监督，导致验证困难；现有方法如LLM作为法官或结果奖励模型（ORMs）存在决策难以追溯或信号可见性有限的问题。

Result: 在BIRD开发数据库上，TraceSQL在生成的SQL评估中实现了66.47%的F1分数和64.48%的ROC-AUC，优于GradeSQL-7B ORM基线的61.87% F1和58.26% ROC-AUC。

Insight: 创新点在于构建了一个轻量级且可追溯的验证模型，通过显式诊断特征提供特征级证据，便于检查和诊断预测；特征归因分析表明模型同时依赖语义基础和确定性SQL结构信号。

Abstract: Text-to-SQL systems are commonly evaluated using ground-truth SQL queries or reference execution results, but such supervision is unavailable at inference time in real-world deployments. This creates a critical verification problem: given only a user question, database context, and generated SQL, can a system estimate whether the generated query is likely to correctly answer the question? Recent approaches use LLMs as judge or specialized agents to inspect generated SQL, but their decisions can be difficult to trace. Outcome Reward Models (ORMs) address this by learning from execution-labeled candidate SQLs and assigning correctness scores to unseen queries, yet they still provide limited visibility into the signals behind each verification. To address this limitation, we propose TraceSQL, a lightweight and traceable verification model built on explicit diagnostic features. TraceSQL combines 67 features capturing question ambiguity, question requirements, question-schema-SQL consistency, SQL structure, and intent alignment. These signals remain available for examining which factors influence each prediction and for tracing decisions back to diagnostic evidence. On BIRD development databases, TraceSQL achieves 66.47% F1 and 64.48% ROC-AUC, compared with 61.87% F1 and 58.26% ROC-AUC for the GradeSQL-7B ORM baseline on the same generated-SQL evaluation. Feature attribution further shows that the model relies on both semantic grounding and deterministic SQL-structure signals. These results show that SQL verification can be performed with a lightweight learned model while retaining feature-level evidence for inspecting and diagnosing its predictions.

[17] Interpretable Humans, Alien LLMs: Expert Analysis of Latent Structures in Assessment Responses cs.CL | cs.AI | cs.HCPDF

Alona Strugatski, Licol Zeinfeld, Jason Cooper, Shelley Rap, Gil Schwarts

TL;DR: 本研究挑战了评估大语言模型（LLM）时的一个隐含假设，即AI与人类使用相似的底层认知结构。通过对比人类和六个LLM在定量推理与化学评估中的回答，并分别进行探索性因子分析（EFA），研究发现领域专家能够解释大部分人类衍生的因子，但无法解释LLM在定量推理中的任何因子，在化学中也仅能解释一半。这表明LLM的运作机制在统计上不透明，且与人类推理存在本质差异。

Details

Motivation: 动机在于质疑当前LLM评估的基石——即假设AI与人类共享可解释的认知结构，并探究LLM性能背后的潜在因子是否与人类学习者的认知结构具有相同的实质性、可解释的含义。

Result: 在定量推理和化学评估的benchmark上，领域专家对EFA生成因子图的盲评结果显示：人类衍生因子大多可被成功解释，而LLM衍生因子在定量推理中完全无法被解释，在化学中仅一半可被解释。这定性地揭示了LLM与人类在潜在结构上的显著差异。

Insight: 论文的创新点在于将数据驱动的探索性因子分析与盲法专家解释相结合，构建了一个评估AI与人类认知对齐性的新框架。客观来看，该方法为揭示LLM“黑箱”内部与人类思维模式的本质差异提供了一种可借鉴的实证分析路径。

Abstract: The evaluation of large language models (LLMs) relies heavily on human-designed assessments, implicitly assuming that AI and humans employ similar underlying cognitive constructs. Challenging this assumption, we investigate whether the latent factors governing LLM performance carry the same substantive, human-interpretable meaning as the cognitive constructs governing human learners. Using responses from humans and six LLMs across quantitative reasoning and chemistry assessments, we conducted Exploratory Factor Analysis (EFA) separately for both groups. Subject-Matter Experts (SMEs) then blindly evaluated the resulting factor graphs to ascribe pedagogical meaning to the emerged constructs. SMEs successfully interpreted most of the human-derived factors. Conversely, they could not ascribe meaning to any LLM-derived factors in quantitative reasoning and interpreted only half of the LLM factors in chemistry. By combining data-driven EFA with blind expert interpretation, this framework shows that LLMs frequently operate on statistically opaque mechanisms distinct from human reasoning.

[18] Encoded but Not Actionable: Auditing the Decode-Generate-Steer Gap in Frozen LLMs for Geometric Constraints cs.CL | cs.AIPDF

Man Liang, Xinzhao Cheng, Faizan Wajid

TL;DR: 本文通过几何推理任务（参数化CAD约束）作为受控测试平台，研究了冻结大语言模型（LLM）中编码信息与模型行为之间的差距。论文对六个仅解码器LLM的隐藏状态进行了探测，分析了线性可解码性、强制选择生成、激活水平影响和行为可操控性四个属性。研究发现，预训练显著改善了局部几何关系的解码，但草图级自由度状态在随机初始化表示中已高度可解码，且预训练后改进有限。更重要的是，可解码的信息并不总是可操作的，生成、激活干预和均值差分操控等方法未能可靠地表达或控制这些编码信息。

Details

Motivation: 尽管大语言模型在结构化推理任务上表现出色，但其内部编码了什么信息以及这些信息是否指导模型行为仍不清楚。本文旨在通过几何推理这一受控任务，探究模型编码信息与行为表达之间的差距。

Result: 在几何约束推理任务中，预训练显著提升了局部几何关系的线性可解码性，但草图级自由度状态的可解码性在随机初始化模型中就已很高。然而，生成任务经常无法表达这些可解码信息，且激活修复干预和均值差分操控均未能可靠地控制模型输出，表明可解码性、生成、激活影响和可操控性在测试场景中发生了分离。

Insight: 论文的创新点在于提供了一个受控的审计框架，用于区分模型在编码几何结构上的失败与在表达或控制已编码信息上的失败。客观来看，其核心洞察是揭示了LLM内部表示中“可解码”与“可操作”信息之间的关键差距，这对于理解模型内部工作机制和评估其真实推理能力具有重要意义。

Abstract: Large language models (LLMs) have demonstrated strong performance on structured reasoning tasks, but what they encode and whether it informs model behavior remain unclear. We investigate this question through geometric reasoning, using parametric CAD constraints as a controlled testbed for separating local pairwise relations from sketch-level constraint status. By probing the hidden states of six frozen decoder-only LLMs, we examine four properties: linear decodability, forced-choice generation, activation-level influence, and behavioral steerability. Pretraining substantially improves the decoding of local geometric relations, and this advantage persists after accounting for positional cues with shuffled-order controls. In contrast, sketch-level DOF status is already highly decodable from randomly initialized representations and improves only modestly with pretraining, indicating that much of its probe performance is available without learned weights. Further analyses show that decodable information is not always actionable. Generation often fails to express this information, and on the two intervention-tested backbones, activation-restoration effects at the patched entity position vanish while decodability persists across depth. Mean-difference steering also does not reliably control outputs. These results show that decodability, generation, activation-level influence, and steerability can diverge in the tested setting. The audit provides a controlled way to distinguish failures to encode geometric structure from failures to express or control encoded information.

[19] BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models cs.CL | cs.AIPDF

Liubov Chubarova, Alexandra Kuleshova, Daniil Volkov, Kirill Sultanov, Alexey Zaytsev

TL;DR: 本文提出了BEAR-Bench，一个用于评估多模态大语言模型在专业文档上双语推理能力的基准。该基准包含1000个基于英文和俄文商业与科学文档的人工标注问题，并评估了16个模型，发现即使是顶级模型仍有明显提升空间。此外，研究还利用模型输出来比较现有的幻觉检测方法。

Details

Motivation: 现有基准在评估多模态大语言模型对文本密集的专业文档的推理能力方面存在不足，且多集中于英文或中文，其他语言（尤其是俄语）代表性不足。

Result: 在BEAR-Bench上评估了包括Gemini 3.1 Pro和Qwen3.5-397B在内的16个专有和开源模型，发现即使是最强的系统也存在明显的性能提升空间。

Insight: 创新点在于构建了一个自包含、复杂且双语（英俄）的专业文档推理基准，填补了现有评估在语言覆盖和文档类型上的空白，并利用基准输出来系统评估幻觉检测方法的可靠性。

Abstract: While Multimodal Large Language Models (MLLMs) have made significant strides in visual comprehension, their ability to reason about text-dense, professional documents remains incompletely evaluated. Existing benchmarks emphasize information extraction, require external domain knowledge, or cover professional documents only as one of many settings. They are also largely English- or Chinese-centric, leaving other languages and Russian, in particular, substantially underrepresented. To address these limitations, we introduce BEAR-Bench (Bilingual Enterprise and Academic Reasoning), a self-contained, complex English-and-Russian benchmark comprising 1000 human-annotated questions based on text-rich business and scientific documents. We evaluate 16 proprietary and open-weight MLLMs, including Gemini 3.1 Pro and Qwen3.5-397B, on BEAR-Bench and observe clear headroom even for the strongest systems. Finally, we use the resulting model outputs to compare existing hallucination detection methods, evaluating not only how often models fail on BEAR-Bench but also how reliably those failures can be identified.

[20] CABLE: Extending the Reach of Memory Retrieval via Complementary Antecedent-Based Linking and Expansion cs.CLPDF

Zheling Tan, Jin Gao, Dequan Wang

TL;DR: 论文提出了CABLE（互补基于前因的链接与扩展），一种插件式增强方法，用于解决LLM智能体在长期对话记忆中的证据可达性问题。该方法通过构建稀疏的、与宿主检索器互补的有向图链接，旨在扩展宿主检索器直接的语义覆盖范围，从而在检索时能发现隐性的支持证据。

Details

Motivation: 动机在于解决LLM智能体在结构化工作流和会话中，长期历史记忆无法通过有限内存接口确保后续上下文能检索到相关证据的问题。现有基于语义相似性的检索方法在主题回忆上表现良好，但常常错过与后续事件语义距离较远、却能帮助解释的早期经验、计划或动机。

Result: 在LoCoMo和MA-LongMemEval基准上，使用A-MEM进行评估，并进一步集成到SimpleMem和Mem0g中（使用Qwen3.5-27B、DeepSeek-chat和GPT-4o-mini模型），CABLE在所有评估的系统级设置中都获得了更高的平均LLM-judge分数。在有用证据分布在多个记忆或会话中的类别（如开放域、多会话和偏好导向问题）中提升最大。

Insight: 创新点在于主张链接构建应优先考虑一组稀疏的、与宿主检索器互补的关联，而非主要基于语义重叠（这可能会重复宿主检索器已恢复的内容）。具体实现上，CABLE为每个新记忆生成面向“前因”的查询，检索先前记忆，减去直接语义邻域中的候选，并在验证后将接受的互补关联添加到稀疏有向图中，从而扩展检索的语义覆盖。

Abstract: As LLM agents operate across structured workflows and sessions, preserving long-term history does not ensure that later contexts can recover relevant evidence through a bounded memory interface. We study this evidence-reachability problem in long-term conversational memory, where retrieval still relies heavily on semantic similarity. This works well for topical recall, but it often misses earlier experiences, plans, or motivations that are semantically distant from the later events they help explain. Existing memory graphs provide cross-memory structure, yet links driven mainly by semantic overlap can duplicate what the host retriever already recovers. We argue that link construction should instead prioritize a sparse set of retriever-complementary associations. We present CABLE (Complementary Antecedent-Based Linking and Expansion), a plug-in augmentation that constructs links designed to extend the host retriever’s direct semantic reach. For each new memory, CABLE generates antecedent-oriented queries, retrieves prior memories, subtracts candidates in the direct semantic neighborhood, and verifies the remainder before adding the accepted complementary associations into a sparse directed graph. At retrieval time, CABLE expands the host system’s retrieved seeds along these links to surface implicit supporting evidence. We evaluate CABLE with A-MEM on LoCoMo and MA-LongMemEval, and further integrate it into SimpleMem and Mem0g on LoCoMo, using Qwen3.5-27B, DeepSeek-chat, and GPT-4o-mini. CABLE yields higher mean LLM-judge scores in every evaluated system-level setting, with the largest gains in categories where useful evidence is distributed across memories or sessions, including open-domain, multi-session, and preference-oriented questions. These results support prioritizing sparse, reasoning-relevant associations that complement rather than duplicate the host retriever.

[21] SpeechSense: A Paralinguistic-Focused Dataset for Fine-Grained Speech Sentiment Analysis cs.CL | cs.MM | cs.SDPDF

Shicheng Ma, Wenqian Cui, Irwin King

TL;DR: 本文提出了SpeechSense数据集，用于细粒度的语音情感分析，专注于副语言线索。该数据集基于一个专门定义的8类人际姿态分类法构建，通过高保真语音合成和严格的人工验证创建。实验表明，能够访问声学特征的模型在检测细微说话者态度方面始终优于仅基于文本的基线模型。

Details

Motivation: 现有语音情感分析研究存在两个主要局限：一是依赖以文本为中心的流水线，丢弃了韵律和语调等关键声学特征；二是现有基准标签粒度不匹配，优先考虑基本情绪而非社交敏感性所需的微妙人际姿态。

Result: 在多模态LLM、纯文本LLM和语音编码器上的综合实验表明，能够访问声学特征的模型在检测细微说话者态度方面始终优于纯文本基线，实证了声学线索在检测细微说话者态度方面的首要性。

Insight: 创新点在于提出了一个专注于副语言线索的细粒度语音情感分析数据集，并定义了基于韵律线索的8类人际姿态分类法。这强调了在语音理解中直接建模声学特征的必要性，超越了传统的级联ASR和文本分析方法。

Abstract: Recent advances in AI have revolutionized speech processing, yet effective speech understanding requires discerning not just what is said, but how it is said. Speech Sentiment Analysis plays a critical role in decoding these paralinguistic cues for diverse real-world applications such as recruitment and customer service. However, existing Speech Sentiment Analysis research faces two primary limitations. First, dominant approaches rely on text-centric pipelines that cascade Automatic Speech Recognition with text analysis. This process inevitably discards essential acoustic features like prosody and tone, failing to capture attitudinal meanings in acoustically ambiguous utterances. Second, current benchmarks suffer from a mismatch in label granularity, prioritizing basic emotions (e.g., happy, sad) over the nuanced interpersonal stances (e.g., confident, impatient) necessary for social sensitivity. To address these limitations, we propose a novel dataset, SpeechSense, for fine-grained speech sentiment analysis. Specifically, we define a specialized 8-class taxonomy of interpersonal stances detectable primarily through prosodic cues beyond lexical content alone. We then construct a curated dataset based on this taxonomy, built from high-fidelity speech synthesis and rigorous human validation. Comprehensive experiments across multi-modal LLMs, text-only LLMs, and speech encoders demonstrate that models with acoustic access consistently outperform text-only baselines. These results empirically validate the primacy of acoustic cues in detecting subtle speaker attitudes, highlighting the necessity of SpeechSense. Dataset and supplementary materials are available at https://github.com/Sher13cked/SpeechSense.

[22] Grading Needs a Rubric, Not Intelligence cs.CL | cs.AIPDF

Jhen-Ke Lin

TL;DR: 本文提出了一种基于评分标准的低成本自动评分方法，通过前沿模型一次性提取试题和评分标准，然后由低成本模型执行重复评分任务。研究发现，评分标准的存在使得评分结果与评分模型的智能水平解耦，评分标准中的标准答案起到了决定性作用，而评分模型的身份和推理能力对分数影响微乎其微。

Details

Motivation: 解决开放性问题自动评分成本高昂的问题，探索是否可以通过明确的评分标准（rubric）来降低对评分模型智能水平的要求，从而实现可靠且低成本的自动评分。

Result: 在24个开放性问题上的实验表明，使用评分标准时，低成本模型的评分可靠性与前沿模型相当，评分方差中95.6%由答案本身解释，评分者身份仅解释0.2%。移除标准答案会显著降低评分可靠性（ICC从0.888降至0.628）。

Insight: 核心创新在于提出了’评分标准优先’的设计原则（any-to-bench），证明了明确的评分标准（尤其是标准答案）是实现可靠、低成本自动评分的关键，而非依赖评分模型本身的智能水平。这为构建高效的教育评估系统提供了新思路。

Abstract: Small language models can grade open-ended examination answers as reliably as substantially more expensive models when they grade against an explicit rubric. We test this claim as the design principle behind any-to-bench: a frontier model reads source documents once, at ingestion, to extract each question and its rubric; lower-cost models then perform all repeated grading work. We evaluate six cost-efficient model configurations from two model families at three reasoning-effort levels. Each configuration answers 24 open-ended examination questions, and each also grades every answer sheet three times, yielding 3,456 per-question grades. Scores depend overwhelmingly on the answer being graded: answer identity explains 95.6% of score variance, whereas judge identity explains only 0.2%. Raising a writer’s reasoning effort moves earned scores by as much as 0.143 of full marks, while raising a judge’s reasoning effort moves assigned scores by at most 0.006. Six frontier-tier judges, added as a check, reproduce these scores and are no more reliable as a panel. Two ablations then decompose the rubric on the same questions and answers. Removing its criteria and levels while keeping the official answer changes nothing measurable. Removing the official answer as well collapses reliability (ICC 0.888 to 0.628), inflates scores, and makes judge reasoning effort matter again. The rubric is what decouples grading from judge intelligence, and within the rubric the official answer does nearly all the work. We find no evidence of length preference or same-family preference under rubric-anchored grading.

[23] Do Large Language Models Play Six Degrees of Separation? Measuring Topological Compression in Long-Context Manifolds cs.CLPDF

Md. Faiyaz Abdullah Sayeedi

TL;DR: 该论文通过分析大语言模型（LLM）隐藏状态流形的动态几何结构，揭示了其长上下文推理的内部机制。研究发现，深层LLM的潜在空间会自发组织成小世界网络，并在深层推理层发生急剧的拓扑相变，将巨大的概念距离压缩成严格受限于“六度分隔”理论（≤6个语义跳转）的可导航路径。该框架被应用于RAG中的零样本幻觉检测，证明了事实性生成与幻觉在拓扑结构上的显著差异。

Details

Motivation: 尽管大语言模型展现出卓越的长上下文多跳推理能力，但其内部实现这种远距离认知跳跃的机制尚不明确。传统的基于注意力的可解释性方法常因注意力汇等路由伪影而无法捕捉真实的语义邻近性，因此需要绕过注意力权重，直接分析隐藏状态流形的动态几何结构。

Result: 研究在两个不同的模型架构上验证了发现，揭示了从早期句法层的完全断裂到深层推理层急剧压缩的拓扑相变。在应用层面，该框架在RAGognize数据集上用于RAG的零样本幻觉检测，结果表明事实性生成与其源上下文保持结构完整性（约3跳），而幻觉则导致严重的拓扑塌缩。

Insight: 论文的创新点在于绕过注意力权重，直接通过将长上下文表示的连续相似度矩阵稀疏化为无权图来追踪语义锚点间的连通性，从而形式化地揭示了Transformer执行抽象推理的拓扑压缩机制。这为评估事实可靠性提供了一种新颖且严格的几何特征签名。

Abstract: Large Language Models (LLMs) demonstrate remarkable multi-hop reasoning capabilities over long contexts, yet the internal mechanisms enabling these distant cognitive leaps remain poorly understood. Traditional attention-based interpretability often fails to capture true semantic proximity due to routing artifacts like attention sinks. In this paper, we bypass attention weights to directly analyze the dynamic geometry of the hidden state manifold, proving that deep LLM latent spaces natively organize into Small-World networks. By sparsifying the continuous similarity matrices of long-context representations into unweighted graphs, we trace the connectivity between highly disjoint semantic anchors across two distinct architectures. Our findings reveal a sharp topological phase transition: while early syntactic layers remain entirely fractured, deep reasoning layers abruptly compress massive conceptual distances into highly navigable pathways strictly bounded by the “Six Degrees of Separation” limit (=< 6 semantic hops). Furthermore, we demonstrate the practical efficacy of this framework by applying it to zero-shot hallucination detection within Retrieval-Augmented Generation (RAG) using the RAGognize dataset. We show that factually grounded generations maintain structural integrity with their source context (approximately 3 hops), whereas hallucinations induce severe topological collapse. Ultimately, this work mathematically formalizes how transformers execute abstract reasoning and provides a novel, strictly geometric signature for evaluating factual reliability.

[24] The IOL-AI Challenge: An Open Challenge towards Advancing Linguistic Reasoning cs.CLPDF

Eduardo Sánchez, Rita Berrada, Dan-Mircea Mirea, Sara Rajaee, Alexander Piperski

TL;DR: 本文介绍了IOL-AI挑战赛，这是一个基于国际语言学奥林匹克竞赛（IOL）2026年个人赛题目的开放科学竞赛，旨在评估大型语言模型在语言推理任务上的能力。挑战赛在严格的计算预算下吸引了大量提交，并对前沿模型进行了基准测试，发现Claude Opus 4.8获得了相当于人类金牌的评分，而资源受限的系统表现较差。研究还表明，能力不取决于模型规模，自动评分与人工评分一致但压缩了评分尺度，且语言推理可作为通用推理技能的有效基准。

Details

Motivation: 当前LLM的推理研究主要集中在数学和代码等提供明确规则的领域，而语言谜题需要模型先发现系统再进行推理，这为评估模型的通用推理能力提供了新方向。

Result: 在IOL-AI挑战赛中，Claude Opus 4.8获得了评审评分相当于人类金牌水平，而资源受限的系统评分仅处于参赛者底部5%的范围。自动评分与人工评审排名一致，但弱系统被高估约13分，强系统被低估。

Insight: 创新点在于首次将IOL问题用于AI竞赛并引入官方评审的人工评估，揭示了模型能力不依赖规模而更多来自解码和输出处理，且语言推理可作为评估通用推理技能的有效代理任务，不受先验语言知识的显著影响。

Abstract: Reasoning in LLMs is overwhelmingly studied in domains that provide a model with rules: mathematics and code. Linguistic puzzles invert this: the solver must first discover the system before reasoning within it. We present the IOL-AI Challenge, an open-science competition run on the unseen problems of the International Linguistics Olympiad (IOL) 2026 Individual Contest, evaluated both automatically and, for the first time, by members of the official IOL Jury under the same rubrics applied to human contestants. The challenge drew 731 submissions from 46 teams under a strict compute budget (one T4, 30 mins). We additionally benchmark 15 unconstrained frontier and open models, with Claude Opus 4.8 earning a jury score equivalent to a gold medal, while both resource-constrained systems we submitted for jury grading scored in the range of the bottom 5% of contestants. Capability was not determined by scale: 14B submissions outperform models twice their size, and gains come from decoding and output-handling rather than model capacity. We also found that automatic metrics rank systems exactly as the jury does, but compress the scale, upscoring weak systems by ~13 points and understating strong ones. Our analysis shows that while frontier models might have prior knowledge about some of the problem languages, it does not significantly help them solve the linguistic reasoning tasks, leaving linguistic reasoning as a strong benchmarking proxy for generalizable reasoning skills.

[25] TokEval: A Tokenizer Evaluation Suite cs.CL | cs.LGPDF

Clara Meister

TL;DR: 本文介绍了TokEval，一个用于评估语言模型分词器的框架，它超越了传统的生育率和压缩率等指标，引入了捕捉语言和结构属性的新度量标准，如UTF-8字符边界完整性和数字位值边界对齐。通过控制实验验证这些指标对下游模型性能的预测能力，发现不同内在属性对模型能力有不同影响。

Details

Motivation: 当前语言模型分词器的选择通常缺乏充分评估，而分词器设计直接影响模型能力，这源于对分词器属性如何影响下游性能的理解有限。

Result: 实验表明，信息论指标（如Spearman rho高达0.80）预测语言建模能力，而结构敏感指标（如处理数字和换行符）与任务准确率相关，在bits-per-byte和多个基准测试（涵盖语言理解、数学推理和代码生成）上验证了这些发现。

Insight: 创新点在于提出了一个全面的分词器评估框架TokEval，通过引入语言和结构属性指标，并实证验证其与下游性能的相关性，为更原则性的分词器评估提供了工具，可能减少预训练调优的需求。

Abstract: Language model tokenizers are typically selected with minimal evaluation, despite the fact that their design choices directly impact model capabilities. This can be partly attributed to a limited understanding of which tokenizer properties affect which aspects of downstream performance. We introduce TokEval, a framework of tokenizer evaluation metrics that goes beyond standard measures like fertility and compression rate to capture linguistically and structurally meaningful properties, e.g., UTF-8 character boundary integrity and digit place-value boundary alignment for mathematics. To validate whether these metrics are predictive of downstream model performance, we conduct controlled language model pretraining experiments, varying solely the tokenizers’ training data mixture, pretokenization strategy, and training algorithm. We evaluate the resulting models on bits-per-byte (a tokenizer-agnostic version of perplexity) and several benchmarks, spanning linguistic understanding, mathematical reasoning, and code generation. Our experiments suggest that different intrinsic properties have different impacts on model abilities: information-theoretic metrics predict language modeling abilities (Spearman rho up to 0.80), while structure-sensitive metrics, such as those measuring digit and line-break handling, correlate with task accuracy. We hope TokEval enables more principled tokenizer evaluation, replacing pretraining sweeps with intrinsic measurement wherever the two agree.

cs.CV [Back]

[26] YILDIZ-VPR: A Novel Dataset with Dense Coverage Under Diverse Environmental Conditions for Visual Place Recognition cs.CV | cs.AIPDF

Serdar Yildiz, Abbas Memiş, Songül Varli

TL;DR: 本文介绍了YILDIZ-VPR，这是一个为视觉地点识别（VPR）任务构建的新数据集。该数据集在伊斯坦布尔耶尔德兹技术大学的Davutpasa校区通过重复步行穿越收集，包含了不同时间、季节和天气条件下的户外场景密集图像，并提供了GPS坐标及陀螺仪、速度、温度等辅助传感器数据。

Details

Motivation: 尽管已有许多VPR数据集，但从行人视角收集密集且多样化的视觉数据仍然是一个重要需求，现有数据集在覆盖密度和环境多样性方面存在不足。

Result: 该论文主要贡献是数据集本身，未提及具体的基准测试或SOTA性能比较，但指出该数据集因其密集覆盖和长期视觉变化性，为在真实户外条件下研究基于图像和时序的视觉地点识别提供了有用资源。

Insight: 创新点在于构建了一个具有高时空密度和丰富环境变化（时间、季节、天气）的行人视角VPR数据集，并同步提供了多模态传感器信息，这有助于推动对VPR鲁棒性的研究，尤其是在长期变化和动态环境下的挑战。

Abstract: Visual Place Recognition (VPR) aims to recognize the location of a query image by comparing it with a set of geo-referenced images. Although many datasets have been proposed for VPR, collecting dense and diverse visual data from pedestrian-level viewpoints is still an important need. In this paper, we introduce YILDIZ-VPR, a visual geo-localization dataset collected through repeated walking traversals on the Davutpasa campus of Yildiz Technical University. The dataset includes outdoor scenes captured at different times of day, seasons, and weather conditions. It contains a wide range of visual content, including historical buildings, modern structures, roads, green areas, and wooded regions. Each video was recorded with a GoPro 9 camera and synchronized with GPS sensor data to provide location labels for the extracted frames. In addition to GPS coordinates, the dataset also includes auxiliary sensor information such as gyroscope, speed, and temperature data. With its dense coverage and long-term visual variability, YILDIZ-VPR provides a useful resource for studying image-based and temporal visual place recognition under realistic outdoor conditions.

[27] AerialYield-B2D: A Greenhouse Blueberry Dataset with Five-Stage Ripeness Masks and Fruit Counts cs.CV | eess.IVPDF

Iyyakutti Iyappan Ganapathi, Afeefa Azam, Muhammad Owais, Irfan Hussain, Yusra Abdulrahman

TL;DR: 本文介绍了AerialYield-B2D数据集，这是一个包含514张RGB图像和30,195个蓝莓实例标注的温室蓝莓数据集，涵盖五个成熟度阶段（绿色未成熟、淡粉色、粉转紫、完全成熟和过熟），提供了类别特定的二进制掩码、语义标签图、图像级计数表等标注信息，旨在支持成熟度分割、浆果计数和类别不平衡分析任务。

Details

Motivation: 目前公开的温室图像资源中，密集的成熟度阶段掩码标注仍然有限，而蓝莓成熟度判断依赖于浆果颜色、簇组成和植株内成熟阶段的分布，因此需要构建一个高质量的数据集来促进相关研究。

Result: 该数据集包含514张图像和30,195个标注实例，图像来源包括智能手机、视频帧和无人机采样，为成熟度分割、浆果计数等任务提供了可复现的数据基础。

Insight: 创新点在于提供了首个包含五个成熟度阶段密集掩码标注的温室蓝莓数据集，并包含了图像级计数标签，有助于解决农业视觉中类别不平衡和精细粒度分割的挑战；从客观角度看，其多源数据采集（手机、视频、无人机）增强了数据集的多样性和实用性。

Abstract: Blueberry ripeness is judged by berry colour, cluster composition, and the distribution of maturity stages within a plant, however, public green house image resources with dense ripeness-stage masks remain limited. We present AerialYield-B2D, where B2D denotes BlueBerry Dataset, acurated real-image resource containing 514 RGB images and 30,195 annotated blueberry instances across five ripeness stages: green immature, pale pink, pink-turns-purple, fully ripe and over-ripe. The release provides class-specific binary masks, overall berry masks, semantic label maps, image-level count tables, SHA-256 hashes, source metadata, recommended train/validation/test splits and technical validations. AerialYield is the broader project name; this release does not provide harvest weight, fruit mass or per-area yield measurements, and the count labels should therefore be interpreted as image-level berry counts rather than yield estimates. The images include 424 smartphone greenhouse images, 67 video-derived frames, and 23 DJI Fly video-frame samples, providing a reproducible dataset for ripeness segmentation, berry counting, and class-imbalance analysis in controlled-environment blueberry production.

[28] The 10th AI City Challenge cs.CV | cs.AIPDF

Zheng Tang, Shuo Wang, David C. Anastasiu, Ming-Ching Chang, Anuj Sharma

TL;DR: 本文总结了第十届AI City Challenge的竞赛设置、数据集、评估协议、排行榜结果及研讨会论文。该挑战赛已发展为一个涵盖多摄像头感知、多模态推理、合成到真实学习、生成式预测和隐私保护评估的综合性基准套件。2026年版本吸引了来自26个国家和地区的325支队伍参与，包含六个主要赛道及两个额外赛道。

Details

Motivation: AI City Challenge旨在为智能交通、智慧城市和物理AI领域提供社区基准测试，推动多摄像头感知、多模态推理、合成到真实学习等技术的发展。

Result: 竞赛结果显示，成功的系统通常结合了基础模型与几何基础、检索或重排序、合成数据设计、领域适应和受控推理等方法。

Insight: 挑战赛的创新之处在于其广泛且不断扩展的基准套件设计，特别是新增的鱼眼交通违规理解和行人情境意图VQA等跨领域赛道，促进了多技术融合的解决方案发展。

Abstract: The 10th AI City Challenge, held with ECCV 2026, marks a decade of community benchmarking for intelligent transportation, smart cities, and physical AI. Since its 2017 start with vehicle detection, classification, and tracking, the challenge has grown into a broad benchmark suite for multi-camera perception, multimodal reasoning, synthetic-to-real learning, generative forecasting, and privacy-preserving evaluation. The 2026 edition continued this growth with 325 registered teams, up from 245 in 2025, and participation from 26 countries and regions, up from 15. Its six primary tracks cover multi-camera 3D perception, transportation safety captioning and VQA, traffic anomaly reasoning, text-based person anomaly search, generative traffic video forecasting, and cross-city object detection. Track 3 further includes two out-of-domain leaderboards, submitted as Tracks 7 and 8, for fisheye traffic-violation understanding and pedestrian situated-intent VQA. This paper summarizes the challenge setup, datasets, evaluation protocols, leaderboard results, and workshop papers. Across tracks, successful systems combine foundation models with geometric grounding, retrieval or reranking, synthetic-data design, domain adaptation, and controlled inference.

[29] Inference-Time Attention Steering for Vision-Language-Action Driving Models cs.CVPDF

Darshan Nagendra Prasad, Lars Ullrich, Knut Graichen

TL;DR: 本文研究了在视觉-语言-动作（VLA）驾驶模型的推理阶段，通过向视觉token施加有界加性预softmax注意力偏置，无需重新训练即可将模型注意力引导至安全关键交通参与者。实验在Alpamayo-R1的Qwen3-VL骨干网络上进行，使用检测器定位的交通参与者，并分析了偏置大小、层数对轨迹解码器的影响。

Details

Motivation: 现有VLA驾驶模型在推理时缺乏直接、无需重新训练的方法来将注意力重定向至安全关键的交通参与者，这限制了模型在安全关键场景下的可控性和适应性。

Result: 在Physical AI World Model Synthetic数据集的50个变道场景上，轨迹解码器对偏置大小表现出单调剂量响应，最大横向位移可达约140厘米；层消融实验表明，动作相关信号存在于深层，效果随挂钩层数增加而增强（全部36层可达67.6厘米位移）。

Insight: 创新点在于提出了一种推理时注意力引导方法，通过无权重修改的前向预钩子施加注意力偏置，实现对模型“看哪里”的直接控制；研究发现偏置仅影响视觉路径而非推理路径，确保了文本推理的因果链不变性，这为安全关键系统的可解释干预提供了新思路。

Abstract: Vision-language-action (VLA) driving models couple a reasoning stage with a diffusion-based trajectory decoder, but do not give a direct way to redirect attention toward safety-critical actors at inference time without retraining. We studied a bounded additive pre-softmax attention bias on the visual tokens of detector localized traffic actors on Alpamayo-R1’s Qwen3-VL backbone. It is applied as a fail open forward pre-hook with no weight changes. On 50 lane-change scenarios from the Physical AI World Model Synthetic dataset. The trajectory decoder shows a monotonic dose response in the bias magnitude, separate from a paired zero bias control at every tested magnitude. It reaches $\approx 17$,cm mean displacement with lateral shifts up to $\sim 140$\ cm at the clamp. A layer ablation places the action-relevant signal in late layers, where the effect increases with the number of hooked layers (2.0cm for the first 8 layers; 67.6cm for all 36). A per call injection audit explains why the Chain-of-Causation text never changes. The mask based bias never reaches the reasoning pathway in this serving stack, so the invariance is verified exposure, not robustness. Steered trajectories tend to shift toward the attended actor, suggesting the bias governs where the model looks rather than encoding a target behavior.

[30] OV3D-Bench: A Diagnostic Benchmark for Open-Vocabulary Monocular 3D Detection cs.CVPDF

Mariia Gladkova, Neehar Peri, Ishan Khatri, Deva Ramanan, Daniel Cremers

TL;DR: 本文介绍了OV3D-Bench，一个用于评估开放词汇单目3D检测器的诊断性基准测试。该基准在七个室内外数据集上，在更贴近实际部署的条件下（如使用数据集级类别提示而非图像级提示），从定位、语义鲁棒性和跨域迁移三个维度解耦并评估检测性能。评估发现现有方法在定位上表现良好，但语义识别对提示词敏感且易混淆相邻类别，同时揭示了广泛采用的目标感知协议会掩盖真实错误。

Details

Motivation: 现有开放词汇单目3D检测器评估协议不统一，常依赖实际部署中不可用的图像级类别提示，且将所有性能混入单一AP指标，难以诊断具体问题。

Result: 在OV3D-Bench上评估了七个代表性检测器，发现其定位准确但语义识别易受提示词影响（如WildDet3D的AP从18.6降至5.4）且易混淆语义相邻类别；目标感知协议会显著高估性能（如使DetAny3D在ScanNet上的AP膨胀1.9倍）。

Insight: 提出了一个解耦定位、语义和跨域能力的诊断性评估基准；关键发现是几何定位已相对成熟，而开放词汇语义理解是主要瓶颈；一个简单的基线方法（使用冻结的闭词汇检测器配合SigLIPv2等视觉语言编码器重映射预测）与专用方法表现相当，这为未来研究指明了方向。

Abstract: Open-vocabulary monocular 3D detectors report strong in-domain performance, but each evaluates under a different protocol, several rely on per-image category oracles unavailable at deployment, and all collapse geometry and semantics into a single AP metric. To address this, we introduce OV3D-Bench, a diagnostic benchmark that compares open-vocabulary monocular 3D detectors under deployment-realistic conditions across seven indoor and outdoor datasets. Our benchmark replaces the per-image class name oracle with test-time dataset-level class name prompts, and decouples detection accuracy along three axes: localization, semantic robustness, and cross-domain transfer. We evaluate seven representative detectors and find that (i) they localize objects well yet often mislabel a correctly localized box as a semantically adjacent category; (ii) accuracy is highly sensitive to prompt phrasing (e.g. WildDet3D’s performance collapses from 18.6 to 5.4 AP when prompted with “a detailed high-resolution photo of a car” rather than “car”); and (iii) the widely adopted target-aware protocol hides these errors (e.g. inflating DetAny3D’s AP by 1.9 $\times$ on ScanNet). Lastly, we demonstrate that simply remapping a frozen closed-vocabulary detector’s predictions using a contrastive vision-language encoder such as SigLIPv2 performs competitively against recent purpose-built open-vocabulary methods. This indicates that geometric localization is more mature, while open-vocabulary semantics remains the primary bottleneck.

[31] Lymphocyte Mimicry Correction via Region-Level Tissue Reasoning and Unbalanced Optimal Transport cs.CV | cs.LGPDF

Xiang Li, Yuqi Wang, Casey C. Heirman, Jihye Heo, Kyle J. Lafata

TL;DR: 本文提出Loki-OT方法，通过不平衡最优传输将区域级别的组织推理传播到单个细胞预测，以解决细胞形态相似性导致的分类模糊问题。该方法利用多模态大语言模型（MLLM）生成的密度先验作为软指导，重新分配模糊细胞，并蒸馏出一个轻量级学生MLP分类器。

Details

Motivation: 动机在于解决细胞拟态问题，即不同细胞类型形态相似导致分类困难。人类病理学家利用周围组织上下文解决此问题，而现有视觉模型要么缺乏上下文推理（细胞基础模型），要么无法在细胞级别操作（病理学MLLMs）。

Result: 在独立的TCGA-BRCA队列上，Loki-OT实现了比完全监督的领域内PanopTILs分类器更低的患者级平均绝对误差（MAE），并在上皮丰富的拟态组织中提高了F1分数。

Insight: 创新点在于将区域级组织推理通过不平衡最优传输传播到细胞级预测，并利用MLLM先验作为软指导。客观来看，其核心洞察是预训练的细胞基础模型特征已编码了判别性信息（包括组织上下文），但标准细胞级监督未能有效利用，该方法通过传输和蒸馏实现了上下文感知的决策边界。

Abstract: Cell mimicry arises when different cell types appear morphologically similar. Human pathologists resolve this ambiguity using surrounding tissue context, whereas current vision models either lack contextual reasoning (cell foundation models) or cannot operate at the cell level (pathology MLLMs). We present Loki-OT, which propagates region-level tissue reasoning to individual cell predictions via Unbalanced Optimal Transport, using MLLM-derived density priors as soft guidance for ambiguous cell reassignment. Loki-OT is motivated by the observation that pretrained cell foundation model features already encode discriminative information, including tissue context, but standard cell-level supervision fails to use tissue context effectively. The resulting transport plan is distilled into a lightweight student MLP classifier that learns context-aware decision boundaries within the pretrained feature space. On the independent TCGA-BRCA cohort, Loki-OT achieved lower patient-level MAE than the fully supervised in-domain PanopTILs classifier and improved F1 in epithelium-rich mimicry tissues, using 278 weak region-level MLLM estimates built on a general-domain cell foundation model. Code: https://github.com/xiangli980/Lymphocyte_Mimicry_Correction_via_Loki_OT

[32] PROBE: Manipulation-Grounded Visual Question Answering with VLM Agents cs.CV | cs.ROPDF

Vineet Bhat, Siyi Chen, Alex Zook, Xuning Yang, Stan Birchfield

TL;DR: 该论文提出了操纵基础视觉问答（MG-VQA）这一新任务，并引入了PROBE框架来评估和微调VLM智能体在此类任务上的表现。PROBE包括一个高保真桌面模拟器（PROBE-Sim）、一个包含150个任务的评估基准（PROBE-Bench），以及一个微调方法（PROBE-Agent），用于将大型教师模型的成功轨迹蒸馏到更小的开源模型中，并在真实世界环境中验证了模拟到现实的迁移能力。

Details

Motivation: 解决在现实世界杂乱动态场景中，需要通过物理操纵（如移动遮挡物）来揭示被遮挡物体后才能回答的视觉问答问题，例如询问机器人“我的药还在柜子里吗？”。

Result: 在PROBE-Bench基准测试中，基于工具的智能体方法在所有任务类型上均优于纯感知基线（平均提升8.0%）。经过PROBE-Agent微调的模型优于其现成的智能体基线（平均提升11.5%），并能正向迁移到未见过的物体和任务上，且在真实桌面环境中验证了模拟到现实的迁移。

Insight: 论文的创新点在于形式化了需要物理操纵的动态场景VQA任务（MG-VQA），并构建了完整的模拟、基准和微调框架。其核心洞察是，对于此类任务，主动操纵是必要且有效的，并且可以通过从大型教师模型蒸馏轨迹来高效提升较小模型的性能，实现模拟到现实的迁移。

Abstract: Vision-language Models (VLMs) excel at 2D grounding, spatial reasoning and agentic tool-based planning in static scenes. However, consider asking a home robot “Is my medication still in the cabinet?” The answer may be physically hidden behind a row of containers that must first be moved aside. Answering such questions in real-world cluttered environments requires reasoning in dynamic scenes: distractors must be manipulated to reveal occluded objects, and each action changes the scene the model must reason over. We formalize this setting as Manipulation-Grounded Visual Question Answering (MG-VQA) and introduce PROBE, a framework for benchmarking and finetuning VLM agents on such tasks. We first develop PROBE-Sim, a high-fidelity tabletop simulator with everyday objects and a robot manipulator equipped with grasping and pushing tools. PROBE-Sim is used to create PROBE-Bench: an evaluation suite of 150 tasks across 6 question types on cluttered tabletop scenes, where a VLM perceives, picks up or pushes objects before answering. We observe consistent trend across all frontier VLMs: agentic tool-based methods outperform their perception-only baselines (8.0% on average) across all task types. We further design PROBE-Agent, a finetuning recipe to distill successful trajectories from a powerful teacher foundation model to a smaller open-weight model using a mixed data recipe that encourages manipulation-efficient question answering. PROBE Agent finetuned models outperform their off-the-shelf agent baseline (11.5% on average) and demonstrate positive transfer to unseen objects and a held-out task. We validate sim-to-real transfer by deploying PROBE-Agent finetuned policies in real-world tabletop environments.

[33] Rapid Debris-Volume Estimation from Post-Hurricane Aerial Imagery cs.CV | eess.IVPDF

Kooshan Amini, Jamie Ellen Padgett, Guha Balakrishnan

TL;DR: 本文提出了DebrisHeightNet，一种基于分割条件的单目碎片高度网络，能够从飓风后单次航拍的RGB图像中估计空间明确的碎片体积。该方法仅需在冻结的视觉基础模型上训练一个轻量级的头部，并通过置信度加权的LiDAR-单目融合（CW-LMF）合成训练目标，无需地面真值。经过区域级幂律校准后，模型在多个飓风区域验证中与无人机调查结果高度相关（Spearman ρ=0.87），且显著优于现有参数化预测方法。

Details

Motivation: 解决飓风后碎片体积估计依赖参数化预测（存在41-90%高估）或卡车装载统计（延迟）的问题，旨在利用常规航拍图像快速、准确地提供空间明确的体积估算，以支持灾后清理规划与联邦报销。

Result: 在跨越五个飓风、三个州的十个区域中，未校准模型与训练区域的独立无人机调查结果Spearman相关系数ρ=0.87；校准后模型体积估计与报告清运记录误差在30%以内，而Hazus和FEMA混合参数化预测高估了2.7-4.8倍。

Insight: 创新点包括：1）分割条件单目高度网络架构，结合冻结基础模型实现轻量化训练；2）CW-LMF合成训练目标方法，解决缺乏地面真值数据的问题；3）区域级幂律校准机制，将模型输出转化为可报告体积并量化不确定性。该方法仅需单次航拍图像，无需LiDAR或地面访问，部署便捷。

Abstract: Hurricane debris removal is planned, contracted, and federally reimbursed on the basis of volume estimates, yet operational practice still relies on parametric forecasts with 41-90% documented over-estimation or on truck-load tallies that arrive only after hauling begins. We present DebrisHeightNet, a segmentation-conditioned monocular debris-height network that estimates spatially explicit debris volume from a single pass of post-event aerial RGB imagery, the kind of survey routinely flown within days of a hurricane landfall. We train only a lightweight 1.08 M-parameter head on top of two frozen vision foundation models. This head regresses height from a Depth Anything V2 backbone, conditioned on the debris segmentation of CLIPSeg-debris from our prior work. Because no post-hurricane debris-height ground truth exists, we synthesize the training target by confidence-weighted LiDAR-monocular fusion (CW-LMF), designed to suppress non-debris LiDAR returns. This fused target is a constructed supervision signal rather than ground truth, so we corroborate it against external references rather than claiming it as truth. A region-level power-law calibration, driven by each region’s low-density debris fraction, converts model volume into an estimate of the reported hauled debris with quantified uncertainty. Across ten regions spanning five hurricanes and three states, the uncalibrated model agrees with an independent uncrewed-aerial-vehicle (UAV) survey of the training region at Spearman $ρ= 0.87$ and lands within 30% of the reported record where the Hazus and FEMA-hybrid parametric forecasts over-predict it by 2.7-4.8$\times$. Deployment requires no LiDAR, no ground access, and no second flight, so the method can produce spatially explicit volume estimates wherever single-pass post-event imagery is flown.

[34] Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking cs.CVPDF

Riku Inoue, Shogo Sato, Kazuhiko Murasaki, Tomoyasu Shimada, Toshihiko Nishimura

TL;DR: 本文提出了一种名为QPID的片段级主动学习方法，用于查询传播式多目标跟踪（MOT）。该方法通过扰动内部轨迹状态来估计关联不稳定性，并利用不确定性加权的视觉覆盖选择代表性标注批次，以减少视频序列标注成本。在DanceTrack和SportsMOT数据集上的实验表明，QPID在相同标注预算下优于现有主动学习基线方法。

Details

Motivation: 训练查询传播式端到端MOT模型需要密集的边界框和身份标注，成本高昂。现有基于输出级时间不确定性的片段级主动学习方法可能忽略由传播轨迹状态中的关联不稳定性带来的信息量，因此需要一种能直接针对这种不稳定性的选择标准。

Result: 在DanceTrack和SportsMOT数据集上，使用MeMOTR和SambaMOTR模型进行实验，QPID在相同标注预算下相比主动学习基线取得了更强的性能。

Insight: 创新点在于提出了针对查询传播MOT中轨迹状态关联不稳定性的扰动评估方法（如定位漂移和熵加权置信度差异），并引入不确定性加权的视觉覆盖来避免冗余选择，这为主动学习中如何更精细地衡量内部状态不确定性提供了新思路。

Abstract: Training query-propagation end-to-end multi-object tracking (MOT) models requires dense bounding-box and identity annotations across video sequences, making dataset construction expensive. Clip-level active learning reduces this cost by selecting video clips for annotation, but prior acquisition criteria based on output-level temporal uncertainty may miss clips whose informativeness comes from association instability in propagated track states. We propose QPID (Query-Propagation Instability and Diversity), a clip acquisition method for query-propagation MOT that targets association instability in propagated track states. QPID estimates this instability by applying two-sided perturbations to internal track states and measuring prediction differences from a clean reference branch. The key idea is that, in stable clips, each propagated track should continue to follow the same target under small perturbations, whereas in ambiguous clips, small changes in the track state can alter which target the track follows, leading to changes in localization or confidence. QPID measures these perturbation-induced prediction differences with two metrics: Localization Drift and Entropy-Weighted Confidence Discrepancy. These metrics are aggregated into a clip-level association-instability score. To avoid redundant uncertainty-only selection, QPID selects a representative annotation batch from high-instability clips using Uncertainty-Weighted Visual Coverage with track-level visual prototypes. Experiments on DanceTrack and SportsMOT with MeMOTR and SambaMOTR show that QPID achieves strong performance compared with active learning baselines under the same annotation budget.

[35] Mask What Matters: Saliency-Guided Video Self-Supervised Learning for Autonomous Driving cs.CVPDF

Christopher Lang, Alexander Braun, Abhinav Valada

TL;DR: 本文提出了一种用于自动驾驶视频自监督学习的新方法V-JEPA4A，它通过一种新颖的显著性引导的掩码策略来改进现有的时空掩码预测范式。该方法在预训练时，根据语义重要性和时间相关性来保留和预测上下文，而不是进行随机掩码，从而学习到更具信息量的特征表示。

Details

Motivation: 现有基于掩码时空预测的视频自监督学习方法通常采用随机掩码，这可能会忽略或削弱对自动驾驶至关重要的、在帧中占比较小的安全关键线索（如行人、车辆、车道线和动态交互）。

Result: 在BDD100k多目标跟踪（MOT）上，V-JEPA4A相比随机掩码的V-JEPA减少了25%的身份切换；在Cityscapes语义分割上达到73.2 mIoU；在KITTI-2015深度估计上达到3.75 RMSE，且仅带来约14%的额外预训练迭代开销。

Insight: 核心创新点是提出了一个领域专用的、显著性引导的掩码策略，该策略考虑了语义重要性和时间相关性，从而增强了预训练任务与下游自动驾驶感知任务（如跟踪、分割、深度估计）的相关性，提升了学习效率与效果。

Abstract: Video self-supervised learning through masked spatiotemporal prediction has emerged as a promising paradigm for learning feature representations from unlabeled data. However, existing methods typically rely on random masking, which indiscriminately removes regions irrespective of their semantic or temporal relevance. In ego-centric driving videos, this can weaken the pretext signal since safety-critical cues such as pedestrians, vehicles, lane boundaries, and dynamic interactions often occupy only a small portion of the frame, yet are central to downstream perception. We introduce V-JEPA4A, a domain-specialized variant of V-JEPA for autonomous driving that is pre-trained on publicly available driving videos with a novel saliency-driven masking policy. It accounts for semantically and temporally relevant context. The proposed policy preserves and predicts context according to semantic importance and temporal relevance, yielding more informative representation learning while retaining the efficiency of masked prediction. We evaluate the resulting encoders on four driving benchmarks spanning tracking, semantic segmentation, and depth estimation. The results demonstrate that V-JEPA4A reduces identity switches on BDD100k MOT by 25% over V-JEPA with random masking, achieves 73.2 mIoU on Cityscapes, and 3.75 RMSE on KITTI-2015 depth, while incurring only ~14% additional pre-training iteration overhead.

[36] Key-Frame Reasoning with SAM3: Third Place Solution for the MeViS-Text Track of the 8th LSVOS Challenge cs.CVPDF

Ce Bian, Xusheng He, Jinrong Zhang, Canyang Wu, Xianjing Han

TL;DR: 本文提出了一个用于MeViS-Text视频分割任务的两阶段、无需训练的方法。该方法首先利用Gemini-3.1 Pro大语言模型将视频级事件分解为实例级目标，并为每个目标选择关键帧并生成描述性文本。然后，使用SAM3模型在关键帧上生成初始掩码，并通过其视频跟踪器进行双向传播，最后合并各实例的掩码。

Details

Motivation: 解决MeViS-Text任务中，根据包含时间线索（如动作、交互、方向）的自然语言描述，在视频中定位和分割指定对象的难题。

Result: 该方法在挑战赛测试集上排名第三，获得了J&F、J、F、N-acc.、T-acc.和Final分数分别为0.761、0.7367、0.7852、0.8333、0.9755和0.856593。

Insight: 创新点在于将大语言模型（Gemini）用于视频事件分解和关键帧/描述生成，并与强大的视觉基础模型（SAM3）结合，构建了一个无需任务特定训练、端到端推理的流程，展示了多模态模型协同工作的潜力。

Abstract: This report presents a two-stage, training-free solution for the MeViS-Text track of the 8th LSVOS Challenge. The task requires a model to localize and segment the object specified by a natural-language expression throughout a video. Such expressions often depend on temporal cues, including actions, interactions, directions, and relative positions. Our first stage uses Gemini-3.1 Pro via API to decompose a video-level event into instance-level targets, select a key frame for each target, and generate a discriminative description aligned with that frame. In the second stage, SAM3-agent produces a pixel-level seed mask on the selected frame, and the SAM3 video tracker propagates the mask bidirectionally through the video. Valid instances are grounded and propagated independently before their frame-wise masks are merged. All local SAM3 processing runs on a single NVIDIA GeForce RTX 4090 without task-specific training or model ensembling. Our method ranked third on the challenge test set, obtaining J&F, J, F, N-acc., T-acc., and Final scores of 0.761, 0.7367, 0.7852, 0.8333, 0.9755, and 0.856593, respectively.

Mohammad Talebi-Kalaleh, Qipei Mei

TL;DR: 本文提出了一种将结构框架平面图PDF转换为可编辑有限元模型草图的框架，该框架结合了确定性几何提取和受约束的智能视觉-语言代理层进行修正。该方法无需针对特定任务训练检测器，通过确定性阶段提取几何基元并识别五类结构实体，再通过代理阶段提出类型化修正。在包含100个平面图的基准测试中，该方法在保持集上取得了高召回率和精确率。

Details

Motivation: 将结构框架平面图转换为可编辑的有限元模型草案目前仍是劳动密集型且易出错的过程。现有方法要么依赖针对特定任务训练的神经网络检测器，要么语言模型代理仅处理文本或模型数据而非图纸本身。本文旨在解决无需任务特定训练、直接从图纸PDF进行结构构件检测和模型草案生成的问题。

Result: 在作者生成的100个平面图基准上评估，其中50个保持集用于最终测试。比例估计误差在0.1%以内。五类结构构件的召回率/精确率为：柱0.922/0.997，梁0.886/0.990，墙1.000/1.000，支撑1.000/1.000，开口1.000/0.964。受控研究显示，校准通过所有九次试验，构件修复在九次中有五次满足所有严格终态谓词。

Insight: 主要创新点在于首次将智能视觉-语言代理层应用于结构构件检测和模型草案生成，且无需任务特定的检测器训练。框架采用两阶段设计：确定性几何提取确保基础准确性，而受约束的代理修正（通过候选约束、操作特定准入测试、变更级别审查和故障关闭事务）提高了鲁棒性和可靠性。这种混合方法结合了规则系统的确定性和LLM代理的灵活性。

Abstract: Converting structural framing plans into editable finite-element model drafts remains labor-intensive and prone to transcription error. Existing drawing-understanding systems for building components rely on task-specific trained neural detectors, and language-model agents in structural engineering operate on text or model data rather than the drawing itself. This paper presents, to the authors’ knowledge, the first framework applying an agentic vision-language layer to structural component detection and model drafting from framing-plan PDFs, without task-specific detector training or fine-tuning. A deterministic stage extracts primitives, estimates scale by dimension-ratio consensus, recognizes five entity classes with a drafting grammar, and assembles an editable layout. The agentic stage proposes typed corrections constrained by deterministic candidates, operation-specific admission tests, change-level review, and fail-closed transactions. Evaluation used an author-generated benchmark of 100 plans: a development half that informed every rule revision, and a seed-disjoint held-out half generated after the rules froze, evaluated once. All reported scores are end-to-end results of the complete framework on the held-out half. Scale was estimated within 0.1% of the generator reference for every drawing. Recall and precision were 0.922/0.997 for columns, 0.886/0.990 for beams, 1.000/1.000 for walls, 1.000/1.000 for braces, and 1.000/0.964 for openings. A controlled study repeated two corruptions three times on three development drawings. Calibration passed all nine trials; member repair met every strict end-state predicate in five of nine. Guarded review corrected missed framing and false marks within explicit bounds. The held-out half shares the development generator, so the study excludes independently drafted plans, raster evaluation, analytical connectivity, and solver validation.

[38] Learning What Not to Learn: Adversarial Disentangled Prompt Tuning for Robust Vision-Language Models cs.CV | cs.AIPDF

Yang Chen, Zhan Zhuang, Yanbin Wei, Zebin Chen, Hua Liu

TL;DR: 本文提出了一种名为ADAPT的对抗性解耦提示调优框架，旨在解决现有对抗提示调优方法在已见类别上导致的鲁棒泛化过拟合问题，从而提升视觉语言模型对未见类别对抗样本的鲁棒性。该方法采用目标提示和诱饵提示的双提示机制，通过正交约束使目标提示学习鲁棒特征，而诱饵提示则捕获伪鲁棒特征。

Details

Motivation: 现有对抗提示调优方法在训练过程中会加剧模型对已见类别的鲁棒泛化过拟合，导致其在未见类别的对抗样本上性能迅速下降，其根源在于模型倾向于学习伪鲁棒特征（即不可泛化的捷径）。

Result: 广泛的实验表明，ADAPT显著提升了目标提示在未见类别上的鲁棒性。分析表明，正交损失限制了伪鲁棒特征偏移对未见类别的影响，从而提供了测试误差保证。

Insight: 核心创新在于“学习不学什么”的理念，通过双提示机制和正交约束，在嵌入空间中解耦鲁棒特征与伪鲁棒特征，有效防止鲁棒泛化过拟合，为提升模型对未见类别的鲁棒性提供了新思路。

Abstract: While adversarial prompt tuning can enhance robustness of vision-language models efficiently, we find that existing methods aggravate robust generalization overfitting on seen classes, leading to a rapid degradation in performance against adversarial examples of unseen classes as training progresses. We empirically identify that this degradation stems from the tendency of the model to learn pseudo-robust features (i.e., non-generalizable shortcuts). To mitigate this, we propose ADAPT (Adversarial Disentangled Prompt Tuning), a robust prompt tuning framework following the philosophy of ``Learning What Not to Learn’’. Specifically, ADAPT uses a dual-prompt mechanism with a target prompt and a pool of decoy prompts. During training, the decoy prompts are guided to entrap diverse pseudo-robust features, while the target prompt is constrained to be orthogonal to the decoys in the embedding space to learn robust features. By disentangling the robust features from the pseudo-robust features, ADAPT effectively prevents robust generalization overfitting. We further provide an analysis showing that the orthogonal loss bounds the effect of shifts in pseudo-robust features on unseen classes, yielding a testing error guarantee. Empirically, extensive experiments demonstrate that ADAPT substantially improves the robustness of the target prompt on unseen classes. The code is available at https://github.com/cheny02/ADAPT-ACMMM2026.

[39] UniQuery4R: Unified 4D Scene Reconstruction from a Single Query cs.CVPDF

Tiancheng Chen, Sheng Tang, Wenhua Jin, Weiqi Zhang, Juntong Fang

TL;DR: 本文提出UniQuery4R，一个用于从单次查询重建动态4D场景的统一框架。它通过一次编码多帧视频片段，并在解码时通过源-目标交叉注意力灵活选择源视图、目标视图和连续源图像坐标，从而联合预测目标对应关系、目标时刻3D位置和场景流，同时估计每帧的相机参数。该设计支持任意源-目标选择的重用编码，并通过批处理查询实现稀疏推理和密集重建。

Details

Motivation: 现有前馈方法通常预测密集的任务特定映射或独立处理源-目标对，导致对稀疏查询的不必要计算以及不同帧对之间特征重用有限。本文旨在解决动态4D场景重建中联合估计对应关系、几何、物体运动和相机运动的挑战，并提高计算效率和特征利用率。

Result: 在WorldTrack基准测试中，UniQuery4R在场景流估计和动态点重建方面均取得了最佳的宏观平均结果。

Insight: 创新点包括：1) 查询条件化框架，允许编码片段在任意源-目标选择中重用，支持稀疏和密集重建；2) 无需与固定片段长度绑定的学习时间嵌入；3) 对场景流采用方向-幅度参数化，并对移动点和静态点进行分离监督。从客观角度看，该框架通过解耦编码与解码时的视图选择，显著提升了计算灵活性和效率，是一种通用的4D重建方法。

Abstract: Reconstructing dynamic 4D scenes requires jointly estimating correspondence, geometry, object motion, and camera motion. Existing feed-forward methods typically predict dense task-specific maps or independently process source-target pairs, leading to unnecessary computation for sparse queries and limited feature reuse across different frame pairs. We present UniQuery4R, a query-conditioned framework that encodes a multi-frame clip once and selects the source view, target view, and continuous source-image coordinate only at decoding time via source-to-target cross-attention. Each query jointly predicts target correspondence, target-time 3D position, and scene flow, along with source depth, while camera parameters are estimated per view. This design allows the encoded clip to be reused across arbitrary source-target selections and supports both sparse inference and dense reconstruction through batched queries, without learned temporal embeddings tied to a fixed clip length. We further introduce a direction-magnitude parameterization of scene flow with separate supervision for moving and static points. Among the evaluated methods, UniQuery4R achieves the best macro-average results on WorldTrack for both scene-flow estimation and dynamic-point reconstruction.

[40] Scanline-Aware Animatable Gaussian Avatars from Rolling-Shutter Videos cs.CVPDF

Youxiang Wang

TL;DR: 本文提出了RS-Avatar，一种从滚动快门视频中重建清晰、无畸变、可动画化的3D高斯化身的方法。该方法通过将运动感知化身在多个子帧时刻的渲染结果，按扫描线逐行合成，而非平均，来直接处理滚动快门效应。

Details

Motivation: 现有可动画人体化身重建方法通常假设每帧图像的所有像素捕捉的是身体运动的同一瞬间，而滚动快门传感器会逐行曝光，导致单帧内不同扫描线观察到不同的身体姿态，破坏了多视角一致性，并将畸变烘焙到规范表示中。

Result: 在基于ZJU-MoCap构建的RS-ZJU基准测试中，该方法在所有测试对象上都改进了新视角合成效果，优于将帧视为瞬时捕捉进行训练的基线方法。

Insight: 核心创新在于将滚动快门建模为一个按扫描线合成子帧渲染的算子，而非平均（如运动模糊模型），这只需修改渲染合成算子，而无需改变底层子帧渲染机制，实现了对滚动快门效应的直接且有效的建模。

Abstract: Animatable human avatars are routinely reconstructed from multi-view video under a silent assumption: that every pixel of a frame observes the same instant of the body’s motion. Rolling-shutter (RS) sensors expose image rows sequentially, so within one frame the head and the feet of a moving person are separated by tens of milliseconds of articulated motion, and every scanline sees a different pose. Feeding such video to a state-of-the-art avatar bakes the distortion into the canonical representation, where it survives as shear and wobble under novel views and novel poses. Worse, every camera in a rig follows its own readout schedule, so the multi-view consistency that drives the reconstruction is violated even when the geometry is correct. We present RS-Avatar, which reconstructs a sharp, undistorted, animatable 3D Gaussian avatar directly from RS video. The formulation is minimal: a motion-aware avatar already renders the body at several sub-frame instants, and where a blur model averages those renderings, a rolling-shutter model composites them scanline by scanline. Changing that operator is the only modification required. On RS-ZJU, a benchmark we build from ZJU-MoCap, this improves novel-view synthesis over training as if the frames were instantaneous, on every subject. A motion-aware blur model built on the same sub-frame machinery does not transfer, and in fact falls below the shutter-oblivious baseline: the machinery is reusable, the operator is not.

Seoyoung Lee, Neel P. Bhatt, Pranay Samineni, Cong Liu, S P Sharan

TL;DR: 本文提出了CondVLN基准测试，用于诊断视觉语言导航（VLN）中条件分支指令的执行能力。该基准通过程序化生成基于3D场景图谓词的条件指令，包含超过11,500条指令，覆盖多个仿真环境（AI2-THOR、Matterport3D等），并引入分支选择准确率和条件成功率等新评估指标。实验表明，现有SOTA VLN模型在条件分支任务上存在显著缺陷，而作者提出的轻量级神经符号分支选择模型能有效提升性能。

Details

Motivation: 现有VLN评估主要关注固定目标的路由式指令跟随，但真实导航指令常包含条件分支（如“如果…则…否则…”），要求智能体根据环境状态进行逻辑决策。当前评估方法难以区分智能体失败的具体原因（如感知、接地、导航或逻辑决策）。

Result: 在CondVLN基准上评估了四种SOTA VLN智能体（VLN-Zero、NaVid、NaVILA、Open-Nav），发现它们常选择与场景条件不一致的分支，标准成功率或路径长度指标无法捕捉此类失败。作者提出的神经符号分支选择模型将条件接地与导航执行分离，性能提升约2倍。

Insight: 创新点在于构建了首个可系统诊断VLN条件分支能力的基准，通过程序化生成可验证的场景图谓词指令，实现了对分支深度、依赖链长度等关键因素的控制。其提出的分离条件评估与导航执行的架构，为提升智能体的逻辑推理能力提供了新思路。

Abstract: Vision-language navigation agents are often evaluated on their ability to follow route-like instructions toward a fixed goal. Yet, real navigation instructions often depend on observed states of the environment: if a condition holds, then follow one path, otherwise take another. Such instructions require an agent to evaluate scene evidence, select the correct logical branch, and execute the corresponding navigation behavior. Existing evaluations provide limited control over conditional branch execution, making it difficult to determine whether agents fail because of perception, grounding, navigation, or logical decision-making. We introduce CondVLN, a scene-graph-grounded benchmark for diagnosing conditional branching in vision-language navigation. CondVLN programmatically generates instructions whose branch conditions are grounded in verifiable 3D scene-graph predicates, with controlled variation in branch depth, dependency chain length, spatial composition, evidence observability, and instruction horizon. CondVLN contains over 11,500 generated conditional instructions across AI2-THOR, Matterport3D, Gibson, and ReplicaCAD, and evaluates agents using standard VLN metrics and branch-specific diagnostics: Branch Selection Accuracy and Conditional Success Rate. Evaluating four state-of-the-art VLN agents (VLN-Zero, NaVid, NaVILA, and Open-Nav) shows that conditional branching exposes failures that are not captured by standard success rate or path length alone: agents can navigate plausibly while committing to a branch inconsistent with the observed scene condition. We also present a lightweight neurosymbolic branch-selection model that separates condition grounding from navigation execution, improving performance by 2x. CondVLN provides a reusable testbed for measuring whether embodied agents can not only follow instructions, but follow the right instruction under the right condition.

[42] MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection cs.CVPDF

Xiaoyong Yu, Rongzhen Li, Shuming Shi, Xinge You

TL;DR: 该论文提出了一种名为MS-MFAD的多模态大语言模型方法，用于可解释的人脸活体检测。该方法通过细粒度的像素-语义锚定机制激活MLLMs的内在推理能力，并引入跨攻击语义级统一标注范式，仅需少量高质量标注即可生成与欺骗区域严格对应的推理证据链。实验表明，该系统在有限样本下显著提升了域内和跨域性能，并具备高鲁棒性和实时推理能力。

Details

Motivation: 当前人脸识别系统面临生成式AI与高保真物理欺骗交织的复合威胁，现有防御方法存在泛化性差、推理不可审计以及依赖海量低质量数据等系统性瓶颈。

Result: 在Qwen-VL基础模型上进行监督微调后，系统在域内相对ACER降低了40-50%，跨域性能下降限制在11.62%/5.23%以内，显著优于现有框架。在白盒对抗攻击下，检测精度仅下降3.2%。领域从业者对推理路径的证据可靠性评分为4.57/5，推理延迟满足实时部署要求。

Insight: 创新点在于提出了细粒度像素-语义锚定机制来激活MLLMs的推理能力，避免了定位幻觉，并设计了跨攻击语义级统一标注范式，通过极少量（每攻击类别1000个）精确掩码标注即可构建可审计的推理证据链，为实现少样本、高质量、可解释且高效的人脸活体检测系统提供了新思路。

Abstract: Facial biometric recognition systems currently face compound threats intertwining generative AI and high-fidelity physical spoofing. Existing defenses suffer from systemic bottlenecks, including poor generalization, non-auditable reasoning, and reliance on massive, low-quality datasets. To address these challenges, we propose Multimodal Large Language Models (MFAD) for face anti-spoofing detection, an explainable reasoning system for Unified Face Anti-Spoofing Detection (UFAD), accompanied by a semantic-level annotation benchmark. Unlike methods relying on external tools or coarse alignment, MFAD activates the intrinsic reasoning capabilities of Multimodal Large Language Models (MLLMs) via a fine-grained pixel-semantic anchoring mechanism. This eliminates localization hallucinations and ensures auditable reasoning paths. We introduce a cross-attack semantic-level unified annotation paradigm: by annotating only 1,000 precise masks per attack category, we generate reasoning evidence chains strictly corresponding to spoofed regions. Supervised fine-tuning on the Qwen-VL foundation model demonstrates that, using limited high-quality samples, the system achieves a 40-50% relative reduction in in-domain ACER and restricts cross-domain performance degradation to within 11.62%/5.23%, significantly outperforming existing frameworks. Furthermore, under white-box adversarial attacks, detection accuracy drops by only 3.2%, validating the robustness of semantic anchoring compared to models trained on massive short-text data. Domain practitioners rated the evidence reliability of reasoning paths at 4.57/5, with inference latency satisfying real-time deployment requirements. These results confirm that a few-shot, high-quality semantic annotation paradigm is effective for building trustworthy, explainable, and cost-efficient UFAD systems.

[43] Learning latent progression states from spatial heterogeneity in uterine histopathology cs.CV | cs.ETPDF

Qiming He, Yan Liu, Shuang Ge, Fan Yang, Yuxiang Wang

TL;DR: 该论文提出了SpaTIE，一个针对子宫病理学的计算框架，旨在从组织病理学的空间异质性中学习与形态相关的表征，并推断出与肿瘤进展相关的状态。该框架在大型全切片图像数据集上开发，并在TCGA队列中验证，能够支持诊断、分子和生存预测任务，并通过多组学分析揭示了与形态状态相关的分子程序。

Details

Motivation: 肿瘤进展伴随着组织结构和微环境的变化，但传统的组织病理学诊断常将这种异质性压缩为静态的分类，无法捕捉动态的进展状态。因此，需要一种方法从空间形态异质性中学习并组织出与进展相关的肿瘤状态。

Result: 在TCGA-UCEC和TCGA-UCS队列中评估，SpaTIE学习的表征形成了形态流形，支持了诊断、分子和生存预测任务，并定位了信息丰富的肿瘤区域。推断出的肿瘤状态与临床病理变量和生存结果相关，且不简单复现分期或诊断标签。

Insight: 创新点在于从横断面形态数据中无时序或分子监督地推断肿瘤进展状态，建立了空间形态与多组学肿瘤状态发现之间的联系。该方法通过整合多组学数据（如DNA甲基化、拷贝数变异等）和虚拟扰动，优先考虑了与形态状态组织耦合的分子特征，为计算病理学提供了新框架。

Abstract: Tumor progression is accompanied by changes in architecture, morphology and microenvironmental organization, yet progression-associated heterogeneity is usually compressed into static diagnostic categories in histopathology. Here we present SpaTIE, a uterus-specific computational pathology framework that learns morphology-aware representations and organizes spatial histopathological heterogeneity into progression-associated tumor states. SpaTIE was developed using 10,426 uterine hematoxylin and eosin whole-slide images and evaluated in TCGA-UCEC and TCGA-UCS cohorts. The learned representations formed morphology manifolds, supported diagnostic, molecular and survival-related prediction tasks, and localized attention to informative tumor regions. Beyond supervised prediction, SpaTIE inferred tumor-state axes from cross-sectional morphology without temporal or molecular supervision. These morphology-derived states were spatially coherent and showed associations with clinicopathological variables and survival outcomes, while not simply recapitulating staging or diagnostic labels. Integrative multi-omics analyses linked the inferred states to DNA methylation, somatic copy-number variation, mutation, RNA-seq and RPPA profiles, highlighting molecular programs related to chromatin regulation, copy-number-associated structural variation, receptor tyrosine kinase signaling, cell adhesion, extracellular-matrix remodeling and metabolic adaptation. Progression-guided virtual perturbation further prioritized molecular features coupled to the morphology-derived state organization. Together, these findings suggest that uterine histopathology contains recoverable progression-associated tumor-state information and establish SpaTIE as a framework for connecting spatial morphology with multi-omics-informed tumor-state discovery.

[44] Primitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofing cs.CVPDF

Fangling Jiang, Qi Li, Bing Liu, Weining Wang, Quilin Huang

TL;DR: 本文提出了一种基于视觉原语组合的取证视觉提示学习框架，用于开放世界人脸防伪检测。该方法在冻结的视觉基础模型上，通过补丁感知注意力机制将可学习的微观取证原语细化为局部取证证据单元，并利用类别特定的全局上下文提示自适应地选择和组合这些原语，以应对未见攻击类型。

Details

Motivation: 开放世界人脸防伪检测需同时处理协变量偏移和语义偏移，现有基于提示的方法通常通过类别语义或语言指导表达伪造，虽能建模高层概念，但难以显式捕捉未见攻击中不断演变的细粒度、空间异质的取证证据。

Result: 在九个开放世界协议上的大量实验表明，该方法取得了最先进的性能，展现出强大的跨域泛化能力和对未见攻击的鲁棒适应性。

Insight: 创新点在于假设许多未见攻击可由重复出现的视觉线索的新组合来表征，从而提出完全在视觉特征空间中操作的组合式取证视觉提示学习框架；其微观取证原语没有预定义的语义含义，而是通过跨类别的共享参数化和联合优化实现专业化和重用，实现了对细粒度取证证据的显式建模。

Abstract: Open-world face anti-spoofing must address both covariate and semantic shifts: source and target domains differ in imaging conditions, while target domains contain diverse attack types absent from training. Existing prompt-based approaches often express spoofing through category semantics or language guidance, which is effective for modeling high-level concepts but is less suited to explicitly capturing the evolving fine-grained and spatially heterogeneous forensic evidence of unseen attacks. Motivated by the hypothesis that many unseen attacks can be characterized by new combinations of recurring visual cues, we propose a compositional forensic visual prompt learning framework that operates entirely in the visual feature space.Built on a frozen ViT-based vision foundation model, the framework employs patch-aware attention to refine a shared set of learnable micro-forensic primitives into localized forensic evidence units derived from image patches. Class-specific global contextual prompts then provide input-dependent routing weights that adaptively select and compose these primitives into compositional forensic visual prompts for real/spoof discrimination. The primitives are not assigned predefined semantic meanings; instead, their specialization and reuse emerge from shared parameterization and joint optimization across categories.Extensive experiments on nine open-world protocols demonstrate state-of-the-art performance, strong cross-domain generalization, and robust adaptation to unseen attacks.

[45] Continuity-Driven Representation Learning for Industrial Defect Detection cs.CVPDF

Minjong Kim, Hyun Jun Kim, Jeongrae Kim, Heeseung Shin, Changwon Lim

TL;DR: 本文提出了一种连续性驱动的表示学习正则化框架，用于改进工业缺陷检测。该框架利用正常区域作为密集辅助监督，通过多连续性损失和差分损失来稳定正常区域的特征表示，同时保留与缺陷相关的不连续性。

Details

Motivation: 工业缺陷检测图像通常在受控条件下采集，包含大量具有重复结构的正常区域，缺陷表现为可预测模式中的局部中断。传统检测器主要依赖稀疏的边界框监督，导致对正常区域的特征表示约束较弱。

Result: 在两个真实工业数据集和公开基准NEU-DET上，使用包括YOLO系列、MambaYOLO和DETR在内的六种检测器架构进行实验，均显示出对基线模型的持续改进。在全数据设置下，平均mAP@0.5:0.95最高提升3.49至5.38个百分点；在有限数据条件下（如仅使用25%训练数据），NEU-DET上的mAP@0.5提升高达21.07个百分点，mAP@0.5:0.95提升8.23个百分点。

Insight: 创新点在于提出了与检测器无关的正则化目标（多连续性损失和差分损失），利用正常区域作为密集监督来约束特征学习，这为工业缺陷检测，特别是在标注数据稀缺时，提供了一个有效的先验。从客观角度看，该方法将缺陷检测问题重新定义为对正常模式连续性的破坏检测，是一种新颖的表示学习视角。

Abstract: Industrial defect detection differs from natural-image object detection because inspection images are captured under controlled conditions and contain large normal-dominant regions with repetitive structures. Defects therefore appear as localized disruptions of otherwise predictable patterns, while conventional detectors rely mainly on sparse bounding-box supervision, resulting in weakly constrained normal-region representations. We propose a continuity-driven representation regularization framework that exploits normal-dominant regions as dense auxiliary supervision. The framework introduces two detector-agnostic objectives: Multi-Continuity Loss, which combines 1D patch-sequence prediction and 2D masked spatial prediction, and Differencing Loss, which regularizes first-order feature variation and second-order curvature between neighboring patch embeddings. Both objectives are applied with box-derived region weighting to stabilize normal-region representations while preserving defect-related discontinuities. Experiments on two real-world industrial datasets and the public NEU-DET benchmark, using six detector architectures including YOLO-family models, MambaYOLO, and DETR, demonstrate consistent improvements over native detector baselines. In the full-data setting, the proposed regularizers improve average mAP@0.5:0.95 by up to 3.49 percentage points on Industrial Metal, 5.38 percentage points on MEA, and 5.03 percentage points on NEU-DET. Under limited-data conditions, the gains become more pronounced, with Differencing Loss achieving improvements of up to 21.07 percentage points in mAP@0.5 and 8.23 percentage points in mAP@0.5:0.95 on NEU-DET using only 25% of the training data. These results suggest that continuity-driven regularization provides an effective prior for improving industrial defect detection, particularly when annotated data are scarce.

[46] GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly cs.CVPDF

Tinghao Jiang, Sheng Tang, Shengzhe Wei, Juntong Fang, Weiqi Zhang

TL;DR: GeoWeaver是一个用于从RGB视频进行长序列3D重建的统一框架，它通过结合几何先验模型（GPM）和测试时自适应（TTA）来解决现有前馈模型在处理长序列时面临的内存限制和尺度漂移、姿态误差等问题。该框架首先通过GPM预测可调整的块级深度、置信度和相机参数作为几何先验，然后利用TTA进行序列初始化、全局块级Sim(3)对齐以及从粗到精的相机姿态、仿射深度和相机内参优化，从而在保持局部几何精度的同时纠正累积误差。

Details

Motivation: 从RGB视频进行长序列3D重建需要精确的局部几何和全局一致的相机运动。前馈模型虽然能提供较强的深度和姿态预测，但其内存成本阻碍了长序列的联合推理；而分块处理虽提高了可扩展性，但独立预测的块常出现尺度漂移、姿态误差和点云错位问题。

Result: 在多个不同的长序列基准测试上的实验表明，该方法提高了相机精度、全局一致性和点云质量。消融实验验证了每个自适应阶段的贡献，并且将相同的TTA流程应用于不同的几何先验模型都能持续改进其轨迹估计，证明了GeoWeaver不依赖于特定的GPM。

Insight: 论文的核心创新在于提出了一个将可调整的几何先验模型与测试时自适应相结合的层次化几何组装框架。其创新点包括：利用密集对应关系提供相邻、跨块和长距离约束；采用鲁棒的CDF风格目标函数联合优化加权的2D重投影和3D一致性残差；以及一个从粗到精的优化流程，能同时校正累积的姿态、尺度、深度和校准误差，从而在保持局部精度的同时实现全局一致性。

Abstract: Long-sequence 3D reconstruction from RGB videos requires both accurate local geometry and globally consistent camera motion. Feed-forward models provide strong depth and pose predictions, but their memory cost prevents joint inference over long sequences. Chunk-wise processing improves scalability, yet independently predicted chunks often exhibit scale drift, pose errors, and point-cloud misalignment. We present GeoWeaver, a unified framework comprising a Geometric Prior Model (GPM) and Test-Time Adaptation (TTA). The GPM predicts chunk-wise depth, confidence, and camera parameters as adjustable geometric priors. TTA then performs sequential initialization, global chunk-level Sim(3) alignment, and coarse-to-fine refinement of camera poses, affine depth corrections, and intrinsics. Dense correspondences provide adjacent, cross-chunk, and long-range constraints, while a robust CDF-style objective jointly optimizes weighted 2D reprojection and 3D consistency residuals. This design preserves local geometric accuracy while correcting accumulated pose, scale, depth, and calibration errors. Experiments across diverse long-sequence benchmarks demonstrate improved camera accuracy, global consistency, and point-cloud quality. Ablations verify the contribution of each adaptation stage, and applying the same TTA procedure to different geometric prior models consistently improves their trajectory estimates, demonstrating that GeoWeaver is not tied to a specific GPM.

[47] MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding cs.CVPDF

Bonan Zhang, Shiyu Dong, Quan Hung Tran, Katharina Gschwind, Shuqi Yang

TL;DR: 本文提出了MoE-ViE（专家混合视觉编码器），通过系统研究视觉编码器中MoE架构的设计空间，发现细粒度MoE拓扑结构优于密集和标准MoE模型。作者提出了无辅助损失的平衡变体以提高专家利用率，设计了专用MoE内核减少推理延迟，并引入帧级蒸馏与冻结机制来增强视频能力。预训练的一系列模型在多种规模下均优于密集模型，最大模型以76%的延迟达到了1.7倍大小SOTA编码器的零样本性能。

Details

Motivation: 视觉编码器是视觉-语言模型的关键组件，但密集扩展会增加计算成本和推理延迟。MoE架构在LLMs中实现了高效扩展，但在CLIP风格视觉编码器的SOTA水平上，其设计空间尚未充分探索。

Result: 在图像和视频基准测试中，MoE-ViE超越了所有对比编码器（包括激活参数多5倍的模型）。最大模型以76%的延迟匹配了1.7倍大小SOTA编码器的零样本性能。

Insight: 创新点包括：系统探索视觉编码器MoE设计空间，发现细粒度MoE拓扑的优势；提出无辅助损失的平衡方法改善专家利用率；设计专用MoE内核降低延迟；通过帧级蒸馏与冻结机制在增强视频能力的同时保留图像知识。

Abstract: Vision encoders are a critical component of vision-language models, and scaling their capacity effectively improves performance. However, dense scaling increases compute cost and inference latency. Mixture-of-Experts (MoE) architectures offer a compelling alternative, having enabled efficient scaling in LLMs, yet the MoE design space for CLIP-style vision encoders remains underexplored at State-of-the-Art (SOTA) levels. In this work, we systematically study MoE designs for vision encoder scaling and find that fine-grained MoE topologies yield substantial gains over both dense and standard MoE counterparts. We further propose an auxiliary-loss-free balancing variant for better expert utilization, and design a specialized MoE kernel to mitigate inference latency overhead. To enhance video capabilities while preserving image knowledge, we introduce frame-level distillation paired with a novel freezing mechanism. We pretrain a series of Mixture-of-Experts Vision Encoders (MoE-ViE) across a range of sizes, all consistently outperforming their dense counterparts. Our largest model matches the zero-shot performance of a SOTA encoder 1.7x its size at 76% of its latency. When aligned with an LLM, MoE-ViE surpasses all compared encoders on image and video benchmarks, including those with up to 5x more activated parameters. Code is available at https://github.com/facebookresearch/moe_vie.

[48] REChart: Reasoning-Efficient Chart Editing with Large Reasoning Models cs.CV | cs.PLPDF

Yuanbang Liu, Chenxi Ruan, Yihan Hou, Qiong Luo, Wei Zeng

TL;DR: 该论文提出了REChart，一个用于提升大型推理模型在图表编辑任务中推理效率的两阶段训练框架。该框架通过过程级监督和强化学习优化，旨在解决模型因过度推理导致的性能下降问题，在保持高编辑保真度的同时显著减少推理令牌的使用。

Details

Motivation: 图表编辑任务需要多模态大语言模型具备细粒度视觉推理、指令跟随和可执行代码合成能力，而现有大型推理模型在处理此类复杂任务时存在‘过度思考’问题，即推理过程过长反而导致性能下降。

Result: 在ChartEdit和ChartMIMIC基准测试中，该模型在同等规模的开源模型中达到了最先进的图表编辑性能，并在最大16384个令牌的思考预算下，相比基础模型平均减少了79.0%的推理令牌使用。

Insight: 创新点在于揭示了推理长度与图表编辑性能之间的‘倒U型’关系，并提出了一个结合了监督微调和强化学习的框架，通过保真度奖励和效率奖励来共同优化模型的推理过程和最终输出质量。

Abstract: Chart editing requires inferring and modifying visualization code from a reference chart image based on an editing instruction, challenging fine-grained visual reasoning, instruction following, and executable code synthesis capabilities of MLLMs. Large reasoning models (LRMs) with extended Chain-of-Thought (CoT) reasoning are suitable for tackling such complex multimodal tasks. However, our preliminary study reveals an inverted-U'' relationship between reasoning length and chart-editing performance: Excessive reasoning often leads to overthinking,’’ where models drift toward hallucinated visual details or get stuck in redundant reasoning loops. To address the gap, we introduce REChart, a two-stage training framework that provides process-level supervision over intermediate reasoning steps, improving both editing fidelity and reasoning efficiency. First, we synthesize 200k high-quality reasoning trajectories for supervised fine-tuning from a large image-instruction-code pool, using a role-specialized agentic Reason-Score-Refine workflow that iteratively refine the chart code toward higher quality. Second, we optimize the model via reinforcement learning with two complementary rewards: a \emph{fidelity} reward evaluating code correctness, visual fidelity, and structural consistency, and an \emph{efficiency} reward that assigns each rollout a random thinking budget, truncates the reasoning process, and credits the final reasoning segment according to its contribution to the output. On the ChartEdit and ChartMIMIC benchmarks, our model achieves state-of-the-art chart-editing performance among open-source models of comparable scale, while mitigating overthinking and reducing average reasoning token usage by 79.0% under a maximum thinking budget of 16,384 tokens compared with the base model.

[49] Spectral Gradient Orthogonalization Improves Differentially Private Training at Scale cs.CVPDF

Sabari Shanmugam, Nick Barnes, Kerry Taylor

TL;DR: 该论文提出了一种名为谱梯度正交化的后处理方法，用于改进大规模差分隐私训练。该方法通过极分解从噪声梯度的低秩结构中恢复方向信号，无需额外隐私成本。实验表明，该方法在高信噪比条件下能显著提升模型精度，尤其在较大批次训练高容量模型时效果显著。

Details

Motivation: 差分隐私训练中，各向同性高斯噪声会均匀污染所有奇异方向，而视觉模型的梯度能量集中在低秩子空间，导致大部分噪声落入信号较弱的方向，从而降低训练效率。

Result: 在CIFAR-10数据集上（ε=4），结合时间降噪后达到50.3%的准确率，为测试配置中的最高水平；在WRN-28-10模型上（批次大小4096）相比DP-SGD提升20.9%，在ResNet-18上提升14.9%，并将运行间方差降低2-3倍。

Insight: 创新点在于利用谱梯度正交化从噪声梯度中恢复低秩结构信号，其有效性受相变机制控制：仅当每方向信噪比足够高时才能提升精度；该方法特别适用于高容量模型的大批次训练场景，可与时间降噪技术结合实现最优性能。

Abstract: Differentially private training adds isotropic Gaussian noise to clipped gradients, corrupting every singular direction equally. In vision models, where spatial correlation concentrates gradient energy into a low-rank subspace, most of this noise falls in directions that carry little signal. Spectral gradient orthogonalization via polar decomposition is introduced as a post-processing step that recovers directional signal from the noisy gradient’s low-rank structure at zero additional privacy cost. A phase transition governs the utility of this approach: orthogonalization improves accuracy only when the per-direction spectral signal-to-noise ratio (SNR) suffices for singular vector recovery; in low-SNR regimes, the directional bias of the gradient is replaced by a nearly random orthogonal update, and the transformation is harmful. The recovery threshold is determined by the spectral gap of the gradient and is surpassed at large batch sizes. Empirically, the benefit scales with model capacity: spectral orthogonalization achieves a +20.9% improvement over DP-SGD on WRN-28-10 (B = 4096) and +14.9% on ResNet-18, while reducing inter-run variance by a factor of two to three. In the fine-tuning regime, spectral orthogonalization matches the stability of DP-Adam while maintaining a first-order memory footprint. Combining spectral with temporal denoising yields 50.3% on CIFAR-10 (epsilon = 4), the highest accuracy in any tested configuration. These gains are specific to moderate-to-high-SNR regimes such as large-batch training of higher-capacity models. Small-batch or low-SNR settings are better served by DP-SGD or temporal denoising.

[50] SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering cs.CVPDF

Gen Li, Shu Han, Yun Xi Qiao, Hua Chen, Xuyang Dai

TL;DR: 本文提出SPVC框架，一种用于跨数据集驾驶场景渲染的结构化全景视频修复方法，旨在解决3D高斯溅射渲染中因外推轨迹和场景编辑导致的模糊、闪烁和前景背景错位等问题。该方法通过结构化条件（相机位姿、3D边界框、高精地图）引导修复过程，同时处理背景和前景伪影，并利用时序信息在驾驶序列上进行视频级修复，且可跨多个数据集通用。

Details

Motivation: 现有驾驶场景渲染方法在轨迹外推和场景编辑时易产生结构模糊、时序闪烁和前景背景错位等伪影，而现有细化方法通常局限于特定设置（如单图像新视角修复或对象编辑校正），缺乏统一框架。

Result: 通过模拟欠约束3D高斯溅射渲染和前景车辆插入伪影构建退化-干净配对训练数据，训练了一个两阶段可控视频扩散模型，该模型在跨数据集设置下实现了对背景（如道路、建筑）和前景（如车辆外观）伪影的联合修复。

Insight: 创新点在于将结构化空间条件与全景（背景+前景）修复结合，并利用视频时序信息进行端到端校正；其跨数据集通用设计减少了针对特定数据集的定制需求，提升了方法的泛化性和实用性。

Abstract: Driving scene reconstruction and rendering, especially with 3D Gaussian Splatting, has become an important component of autonomous driving simulation. However, rendered views often degrade under extrapolated ego trajectories and scene edits, producing blurry structures, temporal flicker, and foreground-background misalignment. Existing refinement methods are commonly designed for a specific setting, such as image-level novel-view repair or object-editing correction. In this paper, we introduce SPVC, a structured and panoptic video fixing framework for cross-dataset driving scene rendering. The name summarizes four design principles. (1) Structured fixing denotes the use of explicit spatial conditions, including camera pose, 3D bounding boxes, and HD maps, to guide the repair process and reduce uncontrolled hallucination. (2) Panoptic fixing refers to correcting both background rendering artifacts, such as distorted roads, buildings, and lanes, and foreground vehicle artifacts introduced by scene editing, such as inconsistent object appearance. (3) Video fixing means that the model operates on driving sequences rather than isolated frames, allowing temporal cues to be used during artifact correction. (4) Cross-dataset fixing means that a single shared network is trained and applied across multiple driving datasets, reducing the need for dataset-specific or scene-specific fixers. Concretely, we construct paired degraded-clean training data by simulating under-constrained 3DGS rendering and foreground vehicle insertion artifacts, and train a two-stage controllable video diffusion model that first addresses video-level appearance and then refines scene layout with structured controls.

[51] TEAMS: Text-prompted spatiotEmporal dual-heAd Mamba Snake cs.CVPDF

Ruicheng Zhang, Jianhui Lei, Kaiwen Shen, Haowei Guo, Jun Zhou

TL;DR: 本文提出了一种名为TEAMS的新型视觉语言Mamba蛇形框架，用于医学图像实例分割。该方法通过引入时空蛇形演化策略、轮廓形态感知Mamba模块和文本提示协作双头蛇形结构，有效解决了复杂形态变化、细粒度器官细节捕捉和基础检测错误修正等挑战。

Details

Motivation: 现有深度蛇形方法在处理复杂形态变化、准确捕捉细粒度器官细节以及纠正基础检测错误方面存在局限，因此需要一种更强大的框架来提升医学图像分割的精度和鲁棒性。

Result: 在涵盖不同器官和成像模态的五个数据集上的综合评估表明，TEAMS优于现有的语义分割和深度蛇形分割方法，例如在脊柱数据集上实现了6.9%的mDice和9.1%的mBF相对提升，展现了其作为跨场景可靠工具的潜力。

Insight: 创新点包括：1）通过状态空间模型捕获蛇形轮廓双向空间依赖性和演化步骤间时间动态的时空演化策略；2）通过量化局部轮廓形态来调制Mamba2 SSD双形式中结构化注意力掩码的轮廓形态感知模块；3）利用文本提示线索并将演化轮廓信息传递至基础检测头的协作双头设计，增强了工作流并减少了错误检测。

Abstract: Deep snake is a promising family of instance segmentation methods that accurately predicts object-level contours, thereby overcoming common pixel-level misclassification issues such as mask cavities and jagged edges in semantic segmentation approaches. However, existing deep snake methods face challenges in handling complex morphological variations, accurately capturing fine-grained organ details, and correcting base detection errors. To mitigate these limitations, we propose a cohesive Text-prompted spatiotEmporal dual-heAd Mamba Snake (TEAMS), a novel vision-language Mamba snake framework with three key innovations: (1) A Spatiotemporal Snake Evolution Strategy (SSES) is introduced to tackle complex morphological variations by capturing bidirectional spatial dependencies along the snake contour and temporal dynamics across evolution steps in a state space model. (2) A Contour Morphology-Aware Mamba (CMAM) is proposed to quantify local contour morphologies to modulate the structured attention mask in the Mamba2 SSD dual form, which extends Mamba’s capability to perceive the relative importance of its input sequence elements for better delineation of fine-grained organ details. (3) A Text-prompted Collaborative Dual-Head Snake (TCDHS) is designed to incorporate cues from textual prompts and transfer the evolved contour information to the base detection head, which enhances the deep snake workflow and mitigates wrong detections. Comprehensive evaluations on five datasets covering different organs and imaging modalities demonstrate that TEAMS outperforms existing semantic and deep snake segmentation methods (e.g., relative mDice/mBF improvements of 6.9%/9.1% in a spinal dataset), underscoring its potential as a reliable tool across diverse medical image segmentation scenarios.

[52] TF-CADE: Foreground-Concentrated Text-Video Alignment for Zero-Shot Temporal Action Detection cs.CVPDF

Yearang Lee, Ho-Joong Kim, Seong-Whan Lee

TL;DR: 本文提出了TF-CADE模型，用于零样本时序动作检测（ZSTAD），旨在定位和识别未修剪视频中未见动作类别的实例。该模型通过显式对齐文本信息与动作相关的前景区域，解决了现有方法在捕捉动作类别间语义区分度上的不足。

Details

Motivation: 现有零样本时序动作检测方法虽然在架构上改进了文本-视频对齐，但仍难以捕捉动作类别间的语义区分，导致产生与文本无关的预测。本文旨在通过集中对齐文本与动作前景来解决此问题。

Result: 在多个数据集上的广泛评估表明，TF-CADE不仅在分布内设置下达到了最先进的性能，而且在跨数据集泛化到未见动作类别方面表现出色。

Insight: 创新点包括：1）提出动作集中聚合模块，通过提取动作集中分数将时序信息丰富的视频片段聚合为前景加权的视频嵌入，增强文本与视频特征的语义一致性；2）引入基于确定性的置信度重加权策略，利用前景感知相似性细化每个片段的置信度分数，有效抑制推理中的无关动作类别。

Abstract: Zero-Shot Temporal Action Detection (ZSTAD) aims to lo- calize and recognize action instances from unseen action categories in untrimmed videos. Although existing meth- ods have shown effectiveness by advancing architectural text-video alignment, they still struggle with capturing se- mantic distinctions between action classes, resulting in text- irrelevant predictions. To address this issue, we propose a Text-Foreground Concentrated Alignment for zero-shot temporal action DEtector (TF-CADE) that explicitly aligns textual information with action-relevant foreground regions. Specifically, we introduce Action Concentrate Aggregation (ACA), which extracts action concentrate scores to aggregate temporally informative video segments into a foreground- weighted video embedding. This foreground concentrated alignment enhances the semantic consistency between text and video features and improves inter-class discriminabil- ity. In addition, a Certainty-based Confidence Re-weighting (CCR) strategy refines per-snippet confidence scores by lever- aging foreground-aware similarity, effectively suppressing irrelevant action classes during inference. Extensive evalua- tions show that our TF-CADE not only achieves state-of-the- art performance under in-distribution settings but also excels in cross-dataset generalization to unseen action classes.

[53] GSToken: Geometry-Structured Gaussian Tokens for Compact 3D Medical Image Representation cs.CVPDF

Xiaoduo Li, Quan Gu

TL;DR: 本文提出了一种名为GSToken的新方法，用于多模态脑肿瘤MRI分割。该方法通过引入具有几何结构的高斯令牌，每个令牌不仅包含语义特征，还包含学习到的3D中心、各向异性尺度和方向，从而在紧凑的表示中显式编码空间形状信息。此外，论文还设计了一种冻结令牌效用评估协议，用于在严格匹配条件下独立评估不同令牌化器的信息保留能力。

Details

Motivation: 现有方法（如固定补丁编码或学习注意力池化）在压缩3D医学图像为令牌序列时，会丢弃显式的空间形状信息（如病变形态和空间范围），且端到端评估难以分离令牌化器的信息保留能力与下游解码器的重建能力，缺乏统一的容量契约使得性能差异难以归因。

Result: 在冻结探测评估中，GSToken在容量匹配的自适应基线方法上一致且显著优于对手，在所有肿瘤子区域、表面和距离指标上均表现出优势，通过多种子配对统计测试验证了其有效性，证明了显式编码空间几何能显著提高体积表示的信息密度。

Insight: 创新点在于首次将高斯令牌引入多模态脑肿瘤分割，为令牌赋予显式几何支持（中心、尺度和方向），以可忽略的参数成本提升表示能力；同时提出冻结令牌效用评估协议，提供了一种统一、可比较的框架来评估令牌化器的信息保留，为紧凑3D医学图像表示设计提供了新原则。

Abstract: Effective segmentation of multi-modal MRI is central to improving neural network accuracy in brain tumor recognition. Existing methods typically compress 3D volumes into token sequences via fixed patch encoding or learned attention pooling (e.g., TokenLearner). However, these compression schemes discard explicit spatial shape information; the resulting tokens convey no notion of lesion morphology or spatial extent. Meanwhile, end-to-end evaluation entangles a tokenizer’s information retention with the reconstruction capacity of the downstream decoder, and the lack of a unified capacity contract across methods makes performance differences difficult to attribute. In this paper, we introduce Gaussian tokens to multi-modal brain tumor segmentation for the first time: each token carries not only a semantic feature but also a learned 3D center, anisotropic scale, and orientation, endowing the representation with explicit geometric support at negligible parameter cost. We further propose a frozen-token utility evaluation protocol: the trained tokenizer is frozen, its output is cast into a fixed-capacity serialized contract, and a shared lightweight Transformer probe independently measures each tokenizer’s retained information under strictly matched conditions. Multi-seed paired statistical testing shows that GSToken consistently and substantially outperforms capacity-matched adaptive baselines under frozen probing, with uniform advantages across all tumor sub-regions, surface, and distance metrics. These results demonstrate that explicitly encoding spatial geometry within tokens significantly improves the information density of volumetric representations, offering a new design principle for compact 3D medical image representation and downstream reading.

[54] SemComp-Bench: Benchmarking Semantic Task Completion in Video Generation cs.CV | cs.AIPDF

Keyu Tu, Zhuowei Chen, Mengqi Huang, Yuxin Wang, Jiahao Zhu

TL;DR: 该论文提出了语义任务完成视频生成（Semantic Task Completion Video Generation）这一以结果为导向的视频生成任务，并构建了SemComp-Data评估数据集和SemComp-Bench评估协议。该任务要求生成的视频既要实现预期结果，又要与参考图像在任务相关的高级语义上保持一致。

Details

Motivation: 现有视频生成评估通常关注中间步骤的完整性或外观一致性，而本文旨在建立一个以结果和语义对称为核心的新评估范式，以更直接地衡量模型完成指定语义任务的能力。

Result: 在覆盖六个领域的SemComp-Data数据集上，对代表性视频生成模型的实验表明，同时实现预期结果并保持与参考图像的任务相关语义一致性仍然具有挑战性。评估协议SemComp-Bench报告了结果达成（OA）和生成可靠性（GR）两个分数。

Insight: 创新点在于定义了‘语义任务完成’这一新的视频生成任务及其评估框架，其核心是结果导向和高级语义对齐，而非序列完整性或像素级外观一致。同时，提出了一个可扩展的四阶段数据构建流程和一个利用视觉语言模型（VLM）进行结构化二元问答的自动化评估方法（SemComp-Bench）。

Abstract: We introduce Semantic Task Completion Video Generation, an outcome-oriented video generation task. Under this formulation, success requires both achievement of the intended outcome and semantic grounding. Semantic grounding characterizes the correspondence between the reference image and the generated outcome in terms of high-level semantics relevant to the task. Evaluation focuses on the generated outcome and requires neither the presentation of a complete sequence of intermediate task steps nor conventional appearance consistency with the reference image. To support systematic evaluation, we construct SemComp-Data, an evaluation dataset covering six domains. Each instance comprises a reference image, a detailed instruction, a brief instruction, and an outcome-centric video clip. A scalable four-stage curation pipeline converts raw videos into standardized SemComp-Data instances. We further introduce SemComp-Bench, an evaluation protocol that uses a vision-language model (VLM) to answer structured binary questions. SemComp-Bench reports the OA Score and the GR Score for Outcome Achievement and Generation Reliability, respectively. Experiments on representative video generation models show that achieving intended outcomes while maintaining task-relevant semantic grounding in reference images remains challenging.

[55] Counterfactual Anatomy-guided Spatial-Temporal Decoding for Annotation-Free Hallucination Mitigation in Medical VLMs cs.CVPDF

Yifan Lu, Adinath Dukre, Abhijit Das, Ziyun Zou, Haolin Yang

TL;DR: 该论文提出了一个名为CAST的框架，用于在医学视觉语言模型（Med-VLMs）推理过程中，无需人工标注即可缓解幻觉问题。该方法通过广泛的医学分割自动发现与查询相关的解剖区域，并利用反事实干预选择因果信息丰富的紧凑区域，然后结合无分类器引导和逐步时间对比进行统一的对比解码，以纠正空间注意力并调节生成动态。

Details

Motivation: 医学视觉语言模型在医学视觉问答中表现出色，但仍容易产生幻觉，即生成缺乏图像证据支持的临床陈述。现有的解码缓解方法通常缺乏解剖学意识或严重依赖真实标注，限制了其适用性。

Result: 在SLAKE和MIMIC-CXR数据集上对三个Med-VLMs进行的实验表明，CAST始终优于强基线，并超越了依赖真实标注的解码策略，表明自动选择的紧凑区域能提供高效对比指导。

Insight: 创新点在于提出了一种完全在推理阶段运行、无需手动标注的解剖引导反事实时空解码框架。其核心是利用反事实干预自动选择因果信息区域，并结合空间和时间对比机制来统一改善空间基础和减少幻觉，为医学VLM的可靠部署提供了实用且可泛化的解决方案。

Abstract: Medical vision-language models (Med-VLMs) have demonstrated strong performance on medical visual question answering, yet they remain prone to hallucination, generating clinically unsupported statements that are insufficiently grounded in image evidence. Mitigation methods applied during decoding offer a practical solution, but they typically lack anatomical awareness or rely heavily on ground truth annotations, which limits their applicability. We propose Counterfactual Anatomy-guided Spatial-Temporal decoding (CAST), a framework that operates entirely during inference and requires no manual annotations for anatomically grounded hallucination mitigation. CAST automatically discovers anatomical regions relevant to the given query through broad medical segmentation. It then selects a compact, causally informative area using counterfactual intervention based on the drop in answer likelihood under occlusion. Guided by this chosen region, CAST performs a unified contrastive decoding process, combining classifier-free guidance to correct spatial attention with stepwise temporal contrast to regulate generation dynamics. Experiments on the SLAKE and MIMIC-CXR datasets across three Med-VLMs demonstrate that CAST consistently outperforms strong baselines and surpasses decoding strategies reliant on ground truth. Our results indicate that compact, automatically selected regions provide highly effective contrastive guidance without expert annotations, offering a practical and generalizable solution for improving spatial grounding and reducing hallucinations. Code is available at https://github.com/csyifan/CAST.

[56] NGS-Marker: Robust Native Watermarking for 3D Gaussian Splatting cs.CVPDF

Hao Qin, Yukai Sun, Luyuan Chen, Mengxu Lu, Feng Zhang

TL;DR: 本文提出了NGS-Marker，一个针对3D高斯泼溅（3DGS）的新型原生水印框架。该框架通过联合训练的水印注入器和消息解码器，以及基于梯度的渐进式注入策略，实现了对3D高斯基元的直接保护，能够有效防御仅提取和重用部分高斯基元的局部侵权攻击。

Details

Motivation: 随着3DGS的快速发展，其版权保护需求日益迫切。现有水印技术主要保护渲染后的图像，而底层的3D高斯基元本身易被滥用，特别是无法有效防御对手仅提取和重用部分高斯基元的局部侵权。

Result: 广泛的实验表明，NGS-Marker能有效防御局部侵权，并为实际部署提供了实用的灵活性。

Insight: 创新点在于提出了一个原生水印框架，直接保护3D高斯基元本身，通过联合训练和渐进式注入确保全场景覆盖，从而支持从任何局部区域进行鲁棒的所有权解码。此外，还扩展了混合保护（结合原生和间接水印）和多模态水印支持，增强了实用性。

Abstract: With the rapid development and adoption of 3D Gaussian Splatting (3DGS), the need for effective copyright protection has become increasingly critical. Existing watermarking techniques for 3DGS mainly focus on protecting rendered images via pre-trained decoders, leaving the underlying 3D Gaussian primitives vulnerable to misuse. In particular, they are ineffective against Partial Infringement, where an adversary extracts and reuses only a subset of Gaussians. In this paper, we propose NGS-Marker, a novel native watermarking framework for 3DGS. It integrates a jointly trained watermark injector and message decoder, and employs a gradientbased progressive injection strategy to ensure full-scene coverage. This enables robust ownership decoding from any local region. We further extend NGS-Marker with hybrid protection (combining native and indirect watermarks) and support for multimodal watermarking. Extensive experiments demonstrate that NGS-Marker effectively defends against partial infringement while offering practical flexibility for real-world deployment.

Ruichao Hou, Boyue Xu, Tongwei Ren, Dongming Zhou, Gangshan Wu

TL;DR: 本文提出了一种名为S$^3$AM的单流框架，用于多模态显著目标检测。该框架将可靠性校准的频率适配器集成到SAM骨干网络中，避免了双流编码器的计算冗余，并通过混合频率专家模块和双门校准机制，有选择地注入跨模态频率信息。实验表明，该方法在RGB-D、RGB-T和RGB-NIR基准上取得了有竞争力的性能，且仅需训练5.4%的参数。

Details

Motivation: 现有基于SAM的多模态显著目标检测方法通常依赖双流编码器或辅助提示生成器，导致计算冗余。而单流方法虽然能降低成本，但早期融合可能将噪声或未对齐的高频线索传播到骨干网络中，因此需要一种能避免冗余计算并显式控制辅助频率注入的框架。

Result: 在RGB-D、RGB-T和RGB-NIR显著目标检测基准上的综合实验验证了所提框架的竞争力，其仅使用1220万个可训练参数（占总参数的5.4%），达到了与现有方法相当的性能水平。

Insight: 创新点在于设计了混合频率专家模块和可靠性校准的频率适配器，通过平稳小波变换分解模态并聚合跨模态频率信息，利用双门校准机制选择性传播校准残差，从而在单流架构中有效控制高频线索的注入。此外，超网络引导的语义-结构解码器结合了骨干网络的语义掩码特征和基于Mamba的结构细节恢复，增强了细节保留能力。

Abstract: Vision foundation models have recently advanced multi-modal salient object detection (MSOD) through parameter-efficient tuning and prompt learning. However, existing Segment Anything Model (SAM)-adapted MSOD methods often rely on dual-stream encoders or auxiliary prompt generators, leading to redundant computation. Although a single-stream alternative can reduce this cost, early fusion may also propagate noisy or misaligned auxiliary high-frequency cues through the backbone. In this paper, we propose a novel single-stream framework that integrates reliability-calibrated frequency adaptation into the adopted SAM backbone for MSOD. It avoids duplicated foundation backbones while explicitly controlling auxiliary frequency injection. Specifically, we design a mixture of frequency experts module, which uses the stationary wavelet transform to decompose each modality and aggregate cross-modal frequency information. We further introduce a reliability-calibrated frequency adapter with a dual-gate calibration mechanism, which selectively propagates the calibrated residual across transformer stages while jointly controlling its injection strength and cross-modal reliability. A hypernetwork-guided semantic-structural decoder then combines semantic mask features from the adopted backbone with Mamba-based structural detail recovery. Comprehensive experiments on RGB-D, RGB-T, and RGB-NIR salient object detection benchmarks validate that the proposed framework achieves competitive performance with only 12.20M trainable parameters, accounting for 5.4% of the total parameters. The code will be available at https://github.com/xuboyue1999/SSSAM.

[58] SE-MoLoRA: Shared-Expert LoRA Adapters for Domain-Specific Photographic Assessment cs.CV | cs.MMPDF

Bishwash Khanal, Anlan Zhang, Sasu Tarkoma, Tommi Mikkonen, Abhishek Kumar

TL;DR: 本文提出了SE-MoLoRA，一种用于领域特定摄影评估的模块化参数高效微调框架。该方法通过一个始终激活的共享LoRA专家和用于构图、照明、技术质量等领域的路由适配器，将通用摄影知识与专业残差判断分离。一个轻量级查询路由器选择相关专家，无需训练单独的完整模型即可实现针对性评论。

Details

Motivation: 现有的视觉语言模型能够流畅描述图像，但由于语义内容和审美判断仍然纠缠在一起，它们往往无法提供可操作的摄影批评。因此，需要一种方法来分离通用知识和专业判断，以实现更具针对性和可控性的摄影评估。

Result: 在保留的评论生成任务上，SE-MoLoRA将BERTScore-F1从0.2317（单一LoRA基准）提升至0.4215，并且在84.6%的成对比较中被优先选择，同时比训练单独的专家模型使用了更少的激活参数。基于SVD的消融研究表明，共享-专家分解和正交正则化减少了专家间的重叠。

Insight: 核心创新在于模块化的参数高效微调设计：使用一个共享的、低秩的通用适配器（rank-64）捕获广泛的摄影词汇，并结合多个低秩的、领域特定的专家适配器（rank-32）学习残差，并通过正交正则化鼓励解耦表示。这种架构实现了在单一模型中集成多个专家，提高了输出的可控性和领域特异性，同时保持了参数效率。

Abstract: Vision-language models can describe images fluently, but they often fail to provide actionable photographic critique because semantic content and aesthetic judgment remain entangled. We propose SE-MoLoRA, a modular parameter-efficient adaptation framework for domain-specific photographic assessment. The method separates general photographic knowledge from specialist residual judgments using an always-active shared LoRA expert and routed adapters for composition, lighting, and technical quality. A lightweight query router selects the relevant specialist, enabling targeted critique without training separate full models. A rank-64 shared adapter captures broad photographic vocabulary, while rank-32 specialists learn domain-specific residuals with an orthogonal regularization penalty that encourages disentangled representations. Training data is obtained by distilling the Reddit Photo Critique Dataset into domain-labeled critique samples. On held-out critique generation, SE-MoLoRA improves BERTScore-F1 from 0.2317 to 0.4215 over monolithic LoRA and is preferred in 84.6% of pairwise comparisons, while using fewer active parameters than separate specialist models. SVD-based ablation study shows that shared-specialist decomposition and orthogonal regularization reduce expert overlap. These results demonstrate that modular adaptation improves controllability and specificity in multimodal photographic critique.

[59] Looking Beyond the Scale: Do Surgical Skill Models Learn Transferable Representations Across Assessment Rubrics? cs.CV | cs.LGPDF

Hanna Hoffmann, Felix von Bechtolsheim, Stefanie Speidel, Rebecca Hisey

TL;DR: 这篇论文系统分析了基于视觉的手术技能评估模型在不同评估标准（GOALS和OSATS）之间的跨领域可迁移性。研究发现，从JIGSAWS数据集到LASANA数据集的迁移是可行的，但反向迁移失败，揭示了迁移的不对称性，并表明任务特定的预测头承担了主要的技能预测负担。

Details

Motivation: 动机是探究基于视觉的手术技能评估模型是否学习了可迁移的手术熟练度表征，还是仅仅编码了数据集特定的视觉模式，这是一个尚未被研究的基本问题。

Result: 实验结果表明，在JIGSAWS上预训练的骨干网络在LASANA上取得了0.77到0.80的CCC值，与端到端基线相当，表明跨评估标准的迁移是可行的。然而，向JIGSAWS的迁移在所有方法中都失败了，可能归因于标注不一致。

Insight: 论文的创新点在于首次系统研究了技能表征在不同评分系统间的可迁移性问题。客观分析表明，视觉成分在技能预测中占主导地位，但并非唯一因素，将可迁移的技能特征与特定视觉领域绑定的特征分离开来是未来需要进一步研究的方向。

Abstract: Vision-based surgical skill assessment has shown strong in-domain results, yet a fundamental question remains unasked: do these models learn transferable representations of surgical proficiency, or do they merely encode dataset-specific visual patterns? This paper systematically analyzes what limits cross-domain skill transfer between the GOALS and OSATS assessment scales using the LASANA and JIGSAWS datasets. Each evaluated method serves a targeted diagnostic purpose: end-to-end training to test whether supervised skill learning transfers directly, Adaptive Sharpness-Aware Minimization (ASAM) to probe whether flatter loss landscapes improve generalization, and augmentation-based self-supervised and contrastive learning to assess whether domain-invariant pretraining decouples skill from visual context. Transfer is evaluated in both directions using a disjoint-participant held-out test set for JIGSAWS. Results reveal an asymmetry: backbones pretrained on JIGSAWS achieve CCC values of 0.77 to 0.80 on LASANA, closely matching the end-to-end baseline, showing cross-rubric transfer is feasible when the target domain provides consistent supervision. Transfer to JIGSAWS fails across all methods, likely due to annotation inconsistencies. Control experiments with a Kinetics-pretrained backbone suggest task-specific heads carry the majority of the skill prediction burden, while the backbone need only provide adequate spatiotemporal features. These findings offer a new perspective on vision-based skill assessment: the central question of whether skill representations transfer across scoring systems has not been previously investigated. Results indicate the visual component is dominant but not solely responsible for skill prediction; further work is needed to conclusively disentangle transferable skill features from those bound to a specific visual domain.

[60] Explainable AI-Powered Framework for Video-Based Skill Assessment in Cataract Surgery cs.CV | cs.AIPDF

Mohammad Javad Ahmadi, Hamid D. Taghirad

TL;DR: 本文提出了一种可解释的AI框架，用于白内障手术视频的自动技能评估，通过计算机视觉和信号处理技术从手术视频中提取客观性能指标，并与专家主观评分进行对比验证。

Details

Motivation: 针对外科劳动力短缺和传统培训方法的局限性，研究旨在开发自动化、数据驱动的手术教育方法，特别是白内障手术的技能评估。

Result: 在83个白内障手术视频的实验分析中，自动计算的指标与专家主观评估显示出强相关性，技能评估准确率达到87%，使用新引入的囊膜撕开技能评估系统（CSAS）进行验证。

Insight: 创新点在于框架的可解释性输出，超越了传统不透明的技能分类工具，通过结合客观运动指标和主观评分，提供了互补的评估方法，并建立了世界最大的白内障手术视频数据集（2,000个记录）。

Abstract: Persistent shortages in the surgical workforce and inherent limitations of traditional training methods highlight the necessity of automated, data-driven approaches in surgical education. This study addresses these challenges by introducing a novel, explainable AI-powered framework for automated skill assessment, specifically focusing on cataract surgery. We present the world’s largest dataset of cataract surgery videos, comprising 2,000 recordings. Additionally, we propose an AI-powered analytical framework that employs advanced computer vision and signal-processing techniques to automatically evaluate surgical videos to derive objective, quantitative performance indicators that complement or potentially replace subjective scoring methods. A significant advantage of our framework over previous methods lies precisely in its explainability of outputs, elevating it beyond merely an opaque skill classification tool. Through experimental analysis of 83 cataract surgery videos, we demonstrate that the automatically computed metrics exhibit strong correlations with expert-based subjective evaluations, achieving up to 87% accuracy in surgical skill assessment. Each metric was individually examined, and expert surgeons provided subjective ratings using the newly introduced Capsulorhexis Skill Assessment System (CSAS). These subjective assessments were compared with ten objective motion-based metrics extracted through our framework. The results indicated a robust correlation between subjective ratings and automated indicators, underscoring the framework’s capacity to accurately model surgical expertise.

[61] BrainNorm: A Foundation Model that knows Normal via Semantic Atlas Pretraining cs.CVPDF

Madhumitha Venkatesh, Shanawaj S Madarkar, Konda Reddy Mopuri

TL;DR: BrainNorm是一个基于约66,000个T1加权结构MRI扫描训练的规范性基础模型，通过跨年龄健康队列的语言-图像风格对比预训练，学习了一个语义图谱潜在空间（SAL），将每个扫描表示为图谱分区嵌入集，从而支持基于年龄的模板匹配和局部偏差评分。

Details

Motivation: 旨在构建一个能够从健康大脑MRI中学习正常老化轨迹的模型，以量化个体相对于其生理年龄的局部脑结构偏差，从而支持无监督或弱监督的疾病检测和分类。

Result: 在6个下游队列的25个任务设置组合（包括年龄估计、脑龄差估计、分区识别及单/多疾病分类）中，BrainNorm在直接推理、零样本、少样本和全数据线性探测设置下均表现出良好的泛化能力；其冻结嵌入的线性探测在所有分类任务中优于9个端到端监督微调的基线模型。

Insight: 创新点在于通过健康队列的对比预训练学习语义图谱潜在空间，生成分区特异性的健康老化模板轨迹，实现了基于局部偏差的零样本疾病预测，且其发现的神经退行性疾病偏差模式与临床病理学高度一致，为医学影像分析提供了可解释的规范性基础模型框架。

Abstract: We introduce BrainNorm, a normative foundation model, trained and tested on ~66,000 T1-weighted structural MRI (T1w sMRI) scans. By leveraging language-image style contrastive pretraining on healthy cohorts across ages, BrainNorm learns a Semantic Atlas Latent space (SAL), where each scan is represented as a set of atlas-parcel embeddings. This yields parcel-specific healthy aging template trajectories that support age-consistent template matching and localized deviation scoring relative to a subject’s chronological age. Across 6 downstream cohorts, BrainNorm demonstrates generalization evaluated across 25 task-setting combinations spanning age estimation, brain-age gap estimation, parcel identification, and single- & multi-disease classification tasks under direct inference, zero-shot, few-shot & full-data linear-probe settings. The resulting deviation patterns in SAL space enable zero-shot tasks for disease prediction using parcel-wise abnormalities. Fine-tuning on healthy-only cohorts of downstream datasets further improves the performance of various tasks. Across all classification tasks, linear probing on BrainNorm’s frozen embeddings outperforms 9 baselines finetuned under end-to-end supervision. Furthermore, the localized deviations identified by BrainNorm across various neurodegenerative disorders closely align with established neurodegeneration pathology in clinical literature.

[62] GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting cs.CVPDF

Qijian Tian, Zimeng Wu, Xuhong Wang, Lizhuang Ma, Xin Tan

TL;DR: 本文提出了GroupForward，一种实例分组的feed-forward高斯溅射模型，用于从稀疏、无位姿、未标定的多视角图像中重建几何、外观、实例结构和语义。该方法通过紧凑的实例嵌入将高斯点分组为跨视角一致的3D实例，并进一步提出了一个用于复杂3D指代分割的指代场景推理框架（RSRF），该框架构建实例分组的3D场景图，并利用视觉语言模型在候选实例中进行推理。

Details

Motivation: 现有前馈式语义3D高斯溅射方法缺乏显式的实例区分能力，主要支持基于类别或短语的语义查询，无法满足具身智能体同时重建和理解3D环境的需求。

Result: 在语义重建和指代推理任务上的实验证明了所提出的实例分组重建和推理框架的有效性。

Insight: 核心创新在于将前馈式语义3DGS从基于每个高斯的语义特征渲染，重新表述为实例级的语义聚合与传播，并构建了结合结构化实例证据和多视角观察的复杂指代推理框架，将语言交互从简单语义查询扩展到复杂场景推理。

Abstract: Simultaneously reconstructing and understanding 3D environments is essential for embodied agents. Toward this goal, feed-forward semantic 3D Gaussian Splatting (3DGS) efficiently constructs semantic scene representations from sparse multi-view observations. However, existing methods lack explicit instance discrimination and mainly support category- or phrase-based semantic queries. To this end, we propose GroupForward, an instance-grouped feed-forward Gaussian splatting model that reconstructs geometry, appearance, instance structure, and semantics from sparse, unposed, and uncalibrated multi-view images. Unlike existing methods that attach high-dimensional semantic features to each Gaussian, GroupForward learns compact instance embeddings that group Gaussians into cross-view consistent 3D instances, reformulating feed-forward semantic 3DGS from per-Gaussian semantic feature rendering to instance-level semantic aggregation and propagation. Building on these instance groups, we further propose a Referential Scene Reasoning Framework (RSRF) for complex 3D referring segmentation. RSRF constructs an instance-grouped 3D scene graph and retrieves candidate instances for a given referring expression. A vision-language model then reasons over structured instance evidence and multi-view observations to identify the referred instance among the candidates. RSRF thereby extends language interaction from simple semantic querying to complex referential scene reasoning. Experiments on semantic reconstruction and referential reasoning demonstrate the effectiveness of our instance-grouped reconstruction and reasoning framework.

[63] Code as Representation: A Compilable Parsing Paradigm for Academic Documents cs.CV | cs.CLPDF

Rihui Jin, Jun Wang, chengyuan zhu, Liang Mingyu, Yue Gao

TL;DR: 本文提出了一种可编译的学术文档解析范式（CADP），将学术论文页面重建为上下文相关的LaTeX和可执行的Python代码，以保留结构化学术元素（如表格、公式、图表和伪代码）的结构、数据和逻辑。作者还引入了CADP-Bench基准，用于评估模型在生成可编译和可验证的文档表示方面的能力，并发现当前最先进的多模态大语言模型（MLLMs）在此任务上仍面临挑战。

Details

Motivation: 学术论文作为科学知识的主要载体，大多以PDF格式存储，这些PDF为人类阅读优化，但不利于机器使用。现有方法（如Markdown）难以保留结构化学术元素（SAEs）的结构、数据和逻辑，因此需要一种新的解析范式来支持机器可理解和可验证的表示。

Result: 在CADP-Bench基准上，即使使用最先进的多模态大语言模型（SOTA MLLMs）和探索性的多智能体基线，模型在生成高保真可执行重建方面仍表现不佳，表明在结构感知的科学文档解析方面有显著的改进空间。

Insight: 创新点在于提出了一种可编译的解析范式，将文档表示为可重新编译和验证的LaTeX与Python代码，从而直接保留和执行结构化元素。这为学术文档的机器可读性和可验证性提供了新思路，并引入了专门的基准来推动该领域的研究。

Abstract: Academic papers are a primary carrier of scientific knowledge, yet most of this knowledge remains locked in PDFs that are optimized for human reading rather than machine use. For Multimodal Large Language Models (MLLMs), the core challenge is not only perception, but representation: scientific pages interleave text with Structured Academic Elements (SAEs) such as tables, formulas, charts, and pseudocode, whose structure, data, and logic are poorly preserved by common surrogates like Markdown. We therefore propose Compilable Academic Document Parsing (CADP), a paradigm that reconstructs a full page as contextual \LaTeX{} plus executable Python, so that structure-preserving elements and executable chart representations can be reconstructed, recompiled, and directly verified against the source page. To support this setting, we introduce CADP-Bench, an expert-verified benchmark of full academic pages containing tightly coupled text and multiple SAE types, evaluated through a re-injection compilation protocol. We further study current capabilities using SOTA MLLMs and an exploratory multi-agent baseline that incorporates common agentic techniques. Results show that even frontier models still struggle to produce high-fidelity executable reconstructions, highlighting substantial room for improvement in structure-aware scientific document parsing. CADP-Bench is released for future research.

[64] Leveraging existing sparse point annotations for benthic imagery dense segmentation cs.CV | cs.LGPDF

Cesar Borja, Breck A. McCollum, Jarret E. Byrnes, Kenneth Sebens, Ana C. Murillo

TL;DR: 本文提出了一种利用历史稀疏点标注进行海底图像密集分割的方法，通过将现有稀疏专家点标注作为视觉提示输入SAM2模型，并设计了一种新颖机制自动筛选可靠点以生成高质量伪真值掩码，从而训练出更精确的细粒度语义分割模型。

Details

Motivation: 解决海底生态系统监测中因水下观测物理限制和海洋图像处理固有挑战导致的可扩展性不足问题，同时弥补现有视觉基础模型（如SAM系列）在复杂场景细粒度识别方面仍需专家监督的缺陷。

Result: 在公共海底数据上验证了方法的有效性，并引入了一个包含真实世界稀疏专家标注的新挑战性基准，为可扩展生态分析铺平了道路。

Insight: 创新点在于将先进基础模型与现有稀疏监督相结合，通过自动筛选可靠点生成伪真值掩码，以提升细粒度分割性能；客观分析认为该方法巧妙利用了历史标注数据，降低了标注成本并提高了模型实用性。

Abstract: The health of marine ecosystems is a critical indicator of global environmental change, yet the physical constraints of underwater observation and the intrinsic challenges of processing marine imagery severely limit the scalability of systematic monitoring. While recent visual foundation models such as the Segment Anything Model (SAM) series show great promise, they still struggle with the fine-grained recognition required in these complex scenarios and still require expert supervision. Our work addresses this gap by bridging state-of-the-art foundation models with existing sparse supervision. Because historical benthic surveys are typically annotated with only a few sparse expert points per image, we utilize these legacy point-labels as visual prompts for SAM2. Our primary contribution is a novel mechanism to automatically identify which of these points are suitable, and which are actively harmful, when used for propagation. By filtering out unreliable points, we extract high-quality pseudo-ground-truth masks capable of training more accurate, fine-grained semantic segmentation models. We demonstrate the effectiveness of our approach on public benthic data and introduce a new, challenging benchmark featuring real-world sparse expert annotations, paving the way for scalable ecological analysis.

[65] MSEditor: Toward Consistent Multi-Shot Video Editing cs.CVPDF

Kunyu Feng, Yue Ma, Bingyuan Wang, Yuefeng Wang, Zhiyuan Qin

TL;DR: 本文提出了MSEditor，这是首个专门为保持一致性而设计的跨镜头视频编辑框架。它通过重新利用多视角视频数据集进行训练，并引入监督适配器和跨镜头打包策略，以解决多镜头视频编辑中因视角、尺度变化导致的身份漂移和累积误差问题。

Details

Motivation: 解决对多镜头视频序列进行一致、统一编辑的挑战，该挑战源于镜头间的不连续性（如视角、相机尺度、主体姿态的显著变化）导致的严重身份漂移和累积误差传播。

Result: 在作者构建的多镜头视频编辑基准测试上，MSEditor在身份保持、时间稳定性和整体视觉质量方面显著优于现有方法。

Insight: 创新点在于：1）将现有多视角数据集重新用于跨镜头监督，以解决高质量多镜头训练数据稀缺的问题；2）引入监督适配器将跨镜头信息注入扩散模型主干；3）设计跨镜头打包策略，在自注意力窗口内动态聚合语义相关镜头的信息以缓解累积误差。这些方法为解决跨不连续边界的长期一致性编辑提供了新思路。

Abstract: In this paper, we tackle the problem of performing consistent, unified modifications to a multi-shot video sequence. This task is particularly challenging because multi-shot videos consist of discontinuous temporal segments that vary significantly in viewpoint, camera scale, and subject pose, leading to severe identity drift and cumulative error propagation. Achieving coherent edits requires establishing reliable cross-shot semantic awareness to maintain stable subject appearance and visual continuity across these disjointed boundaries. To address this, we propose MSEditor, the first framework designed specifically for consistent multi-shot video editing. To overcome the scarcity of high-quality multi-shot training data, we repurpose existing multi-view video datasets to provide robust cross-shot supervision. Architecturally, we introduce a Supervisory Adapter that injects this cross-shot information into the diffusion backbone, enabling the model to learn identity-consistent representations. Furthermore, to effectively mitigate cumulative errors and ensure long-range temporal coherence, we design a Cross-Shot Packing strategy that dynamically aggregates information from semantically related shots within the self-attention window. Extensive experiments demonstrate that MSEditor significantly outperforms existing methods on our curated multi-shot video editing benchmark in terms of identity preservation, temporal stability, and overall visual quality.

[66] Where a New Concept Must Enter: Entry Point Gates Cross-Task Usability in Unified Multimodal Models cs.CV | cs.AIPDF

Zongyang Qiu, Yihan Wu, Kaixuan Fan, Bo Li, Hui Xiong

TL;DR: 本文通过构建实验分离统一多模态模型中的理解与生成任务，发现跨任务可用性取决于新概念绑定进入共享计算的入口点位置，并提出一种基于对齐探针的中间层对齐目标，能以极低代价实现概念获取。

Details

Motivation: 统一多模态模型期望理解与生成相互促进，但现有联合训练研究无法区分架构与数据的影响，因此需要构建可控实验来探究两个方向间的真实关系。

Result: 在36种配置中，对齐探针预测跨任务输出的Spearman相关系数达+0.68；中间层对齐目标仅导致模型文本到图像生成能力相对损失0.1%，而标准生成路径损失达41%。

Insight: 创新点在于通过渲染3D资产与伪词构建视觉实体，隔离任务方向进行因果分析；核心发现是跨任务可用性由概念绑定入口点在计算栈中的位置决定，且理解路径需为语义视觉编码器才能实现有效共享。

Abstract: Unified multimodal models (UMMs) are motivated by the hope that understanding and generation reinforce each other but controlled ablations repeatedly find that adding a generation objective leaves understanding flat. Joint-training studies cannot settle the disagreement: with overlapping supervision, a gain cannot be attributed to the architecture rather than the data. To further investigate the relationship between the two directions in UMMs, we separate them by construction. A novel visual entity, a rendered 3D asset paired with a pseudo-word screened for absence from the frozen model’s behavior, is bound through exactly one task direction, and the untrained direction is then measured. We find that the channel is real in both directions, but the directions differ in kind: generation training installs a name the model can only match among candidates; understanding training installs one it can also produce. What governs cross-task usability is where the binding enters the shared computation. An alignment probe predicts export across 36 configurations (Spearman $ρ= +0.68$). That objective’s alignment term, maximized in closed form over activations with every weight frozen, makes a concept drawable when injected at layer 7 of 28 and is indistinguishable from the base model from layer 14 on, while the weight-based version of the same edit peaks at layers 10-14. In an observational series of four models, this window appears only where the understanding pathway is a semantic vision encoder, suggesting that unified weights are not enough: the two directions must share a semantic format at the entry point. Exploiting the rule, a mid-stack alignment objective acquires the concept for a $0.1%$ relative loss of the model’s general text-to-image ability, against $41%$ for the standard generative route. Our code is at https://github.com/Zane-ZYQiu/entry-point-umm.

[67] CoinVE-200K: A Large-Scale High-Quality Dataset for Compositional Instruction-Guided Video Editing cs.CVPDF

Fuchen Long, Cong Wang, Zitao Gao, Wenhao Zhong, Yu Cheng

TL;DR: 本文介绍了CoinVE-200K，一个用于组合式指令引导视频编辑的大规模高质量数据集，包含高达201帧的1080p视频-编辑对，覆盖2到5个原子编辑操作的组合场景。同时提出了对应的评估基准CoinVE-Bench以及一个基于Wan2.1-T2V-14B和Qwen3-VL-8B-Instruct构建的22B参数组合视频编辑模型CoinVE-Edit。

Details

Motivation: 现有基于指令的视频编辑数据集主要关注单一编辑操作，缺乏对组合指令（即在同一视频中联合理解和执行多个编辑意图）的支持，因此需要构建专门的数据集和模型来解决这一问题。

Result: 在提出的CoinVE-Bench基准测试上，CoinVE-Edit模型在指令遵循、组合编辑准确性、视觉质量和时间一致性方面均表现出色。

Insight: 核心创新在于构建了首个大规模、高质量的组合式指令视频编辑数据集，并设计了区域感知注意力解耦机制，使模型能精确执行多区域编辑同时保持无关内容不变和时间连贯性。

Abstract: The quality and diversity of instruction-based video editing datasets are steadily improving, yet existing datasets mainly focus on single editing operations and fall short in supporting compositional instruction-guided video editing. In particular, multiple editing intents must be jointly understood and faithfully executed within the same video. To address this issue, we introduce CoinVE-200K, a large-scale, high-quality dataset for Compositional Instruction-Guided Video Editing. CoinVE-200K contains 1080p video-editing pairs of up to 201 frames, covering diverse compositional scenarios where each sample involves 2 to 5 atomic editing operations. The instructions target humans, objects, and backgrounds, and cover edit types such as addition, removal, modification, and stylization. All samples are built through a carefully designed generation and filtering pipeline to ensure instruction faithfulness, visual quality, temporal consistency, and compositional diversity. We also introduce CoinVE-Bench, a benchmark for compositional-instruction video editing across diverse subjects, operation types, and instruction complexities. Furthermore, we present CoinVE-Edit, a 22B compositional video editing model built upon Wan2.1-T2V-14B and Qwen3-VL-8B-Instruct. CoinVE-Edit disentangles region-aware attention for different editing instructions, enabling precise multi-region editing while preserving irrelevant content and temporal coherence. Experiments on CoinVE-Bench show that CoinVE-Edit achieves strong performance in instruction following, compositional editing accuracy, visual quality, and temporal consistency.

[68] PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contexts cs.CVPDF

Bowen Liu, Qixiang Zhang, Xiaomeng Li

TL;DR: 该论文提出了PathoArgus-Bench基准测试和评估协议，用于评估病理学全切片图像（WSI）长上下文视觉推理中的证据链完整性，并引入了PathoArgus模型进行固定预算的上下文读取。研究发现，现有模型在最终答案准确率上表现尚可，但在证据一致性方面存在严重缺陷。

Details

Motivation: 当前病理学问答基准主要衡量最终答案准确率，该指标易受语言先验和基准规律影响，不足以证明预测是基于组织学证据的。因此，需要一个新的基准来明确测试证据链的可用性、可访问性、使用和响应性。

Result: 在PathoArgus-Bench（包含22,078个问题）上评估了20个系统，GPT-5.6总体准确率为57.09%，但在ESG（证据状态四元组）上仅正确完成19/483个四元组（3.93% QExact）。PathoArgus模型总体准确率为50.39%，但QExact仅为1.86%。

Insight: 创新点在于提出了一个强调证据链评估的基准（PathoArgus-Bench）和诊断工具（ESG四元组），揭示了答案准确率与证据一致性之间的巨大差距，并倡导在计算病理学中从以答案为中心转向以证据为基础的评估范式。

Abstract: Whole-slide pathology reasoning requires models to integrate gigapixel-scale visual evidence across complete case-linked slides, yet current question-answering benchmarks primarily measure final answer accuracy–a metric vulnerable to linguistic priors and benchmark regularities, and insufficient to establish that predictions are grounded in the supplied tissue. We introduce PathoArgus-Bench, a benchmark and evaluation protocol that explicitly tests the full evidence chain: availability, accessibility, use, and responsiveness. PathoArgus-Bench comprises 22,078 four-choice questions from 4,913 patients across 15 TCGA projects, covering six pathology capabilities across three levels of evidence demand, and operates under a fixed reader budget that retains only a small fraction of the gigapixel context. To further isolate evidence-grounded reasoning, we contribute ESG (Evidence State Quartets), a controlled set of 483 quartets where the question text is fixed while the target WSI set is moved, replaced, or removed, requiring consistent predictions across all states. Evaluating 20 general-purpose, medical, and pathology-specific systems reveals a stark gap: while GPT-5.6 achieves 57.09% overall accuracy and 57.04% on ESG, it correctly completes only 19 of 483 quartets (3.93% QExact), exposing that row-level accuracy does not translate into reliable evidence grounding. We also introduce PathoArgus, a fixed-budget reader that allocates context via question relevance and spatial coverage, attaining 50.39% overall accuracy yet only 1.86% QExact–demonstrating that improved context access alone does not ensure consistent evidence-based prediction. Our benchmark and diagnostics establish that acquiring useful whole-slide context is necessary but far from sufficient, and call for a shift from answer-centric to evidence-grounded evaluation in computational pathology.

[69] Denoised Variance-Based Pruning with Optimal Brain Bias Compensation cs.CVPDF

Geon Tack Lee, Jaegul Choo, Kang Eun Jeon

TL;DR: 本文提出了一种名为DVBP + OB^2C的新型结构化剪枝方法，用于高效压缩视觉Transformer模型。该方法结合了基于去噪方差的神经元选择和最优脑偏置补偿，旨在无需重新训练的情况下，显著减少模型的计算开销，同时保持高精度。

Details

Motivation: 动机是解决现有结构化剪枝方法（如基于方差的剪枝VBP）在有限样本下因激活协方差统计噪声和仅偏置更新导致的严重精度下降问题，以促进ViT模型在边缘设备上的部署。

Result: 在DeiT、Swin和ConvNeXt架构上的实验表明，该方法在无需训练的情况下达到了最先进的性能；在50% MLP剪枝率下，对于Small和Base变体，能保持超过90%的原始Top-1准确率，相比VBP在ConvNeXt-T上提升高达29.46%，在Swin-S上提升7.33%。

Insight: 创新点在于利用随机矩阵理论对激活协方差谱进行去噪以实现鲁棒的神经元选择，并通过数学证明将均值偏移补偿整合到最优脑压缩目标中，从而推导出基于相同统计量的闭式权重更新公式，有效减少了结构重建误差。

Abstract: Vision Transformers (ViTs) achieve state-of-the-art performance but carry massive computational overhead that restricts edge deployment. Although structural pruning has emerged as a key strategy to reduce these costs, existing methods often suffer from severe accuracy degradation or require expensive retraining. Recently, Variance-Based Pruning (VBP) introduced a promising paradigm by selecting neurons based on activation variance; however, it remains limited by statistical noise in finite-sample activation covariance and reliance on bias-only updates that cannot fully account for structural reconstruction error. To address these limitations, we introduce Denoised Variance-Based Pruning with Optimal Brain Bias Compensation (DVBP + OB$^2$C). We leverage random matrix theory to filter noise from the activation covariance spectrum for robust neuron selection and mathematically prove that integrating mean-shift compensation into the Optimal Brain Compression objective reduces the layer-wise Hessian exactly to the activation covariance matrix. This enables an optimal, closed-form update of the remaining weights using the same statistics gathered for selection. Extensive experiments on DeiT, Swin, and ConvNeXt architectures demonstrate that DVBP + OB$^2$C achieves state-of-the-art training-free performance; at 50% MLP pruning, it retains over 90% of the original Top-1 accuracy on Small and Base variants, outperforming VBP by up to 29.46% (ConvNeXt-T) and 7.33% (Swin-S). The code is available at: https://github.com/geontackee/DVBP_OB2C.

[70] RetiWave-Mamba: A Dual-Stream Network for Retinal Disease Detection based on Multi-scale Context and Frequency-Adaptive Mamba Projection cs.CVPDF

Cheng Cheng, Jin Hong

TL;DR: 本文提出了一种名为RetiWave-Mamba的双流网络，用于基于OCT图像的视网膜疾病检测。该方法通过离散小波变换将图像分解为低频和高频流，分别使用多尺度上下文定位模块和注意力引导的高分辨率网络进行处理，并引入频率自适应Mamba投影器来捕获高频特征中的长程依赖关系。

Details

Motivation: 视网膜疾病是导致不可逆视力损伤的主要原因，而OCT图像的自动分析受到斑点噪声、病变尺度变化以及类间相似性高等固有挑战的阻碍。

Result: 在OCT-C8数据集上的大量实验表明，该方法达到了98.25%的分类准确率，超越了现有方法，实现了最先进的性能。

Insight: 创新点在于将空间-频域学习与先进的状态空间模型结合，通过双流架构解耦处理结构上下文和细粒度细节，并设计了针对不同频率分量的专用模块（MCLM, AG-HRNet, FAMP）来分别应对噪声、多尺度病变和长程依赖问题。

Abstract: Retinal diseases are a leading cause of irreversible vision impairment, making early and accurate diagnosis essential for effective treatment. Optical Coherence Tomography (OCT) serves as a critical imaging modality for this purpose, yet its automated analysis is hindered by inherent speckle noise, varying lesion scales, and subtle inter-class similarities. To address these challenges, we propose a novel framework, RetiWave-Mamba, which integrates spatial-frequency domain learning with state-of-the-art state space models. The framework utilizes Discrete Wavelet Transform (DWT) to decompose OCT images into low- and high-frequency streams, enabling decoupled processing of structural context and fine-grained details. For the low-frequency branch, we design a Multi-scale Contextual Localization Module (MCLM), which synergizes multi-scale dilation with spatial attention to expand the global receptive field and precisely localize lesion regions. For the high-frequency branch, we introduce an Attention-Guided High-Resolution Network (AG-HRNet) equipped with an intelligent gating mechanism to suppress noise propagation during multi-scale interactions. Furthermore, a Frequency-Adaptive Mamba Projector (FAMP) is incorporated to capture long-range dependencies within disjoint high-frequency textural features. Extensive experiments on the OCT-C8 dataset demonstrate that our approach achieves a state-of-the-art (SOTA) classification accuracy of 98.25%, surpassing existing methods. These results highlight the efficacy of RetiWave-Mamba in robustly identifying retinal pathologies under noisy conditions, offering a promising tool for clinical diagnosis.

[71] Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Models cs.CVPDF

Haonan Xu, Feiyang Chen, Songkui Chen, Hongpeng Pan, Zhefeng Wang

TL;DR: 本文提出了一种名为Magnitude-Direction Decoupling（MDD）的方法，用于加速基于流匹配模型的视频生成。该方法通过解耦原始模型输出中的幅度和方向分量，自适应地使用经过方向校准的轻量级模型替代原始模型进行部分去噪步骤，并结合分类器无关引导（CFG）重用幅度信息，从而在保持高视觉保真度和内容丰富度的同时，显著降低计算开销。

Details

Motivation: 流匹配模型在视频生成中表现出色，但其迭代去噪过程导致计算开销巨大。虽然并非所有去噪步骤都需要原始模型，但直接使用缓存或轻量级模型会偏离原始去噪轨迹，导致性能下降。因此，需要一种更可靠且轻量的方法来加速采样。

Result: 实验表明，MDD方法在Wan2.1等基准上优于现有的加速方法，实现了高达2.95倍的加速，同时保持了高视觉保真度和内容丰富度。

Insight: 核心创新在于通过经验分析发现轻量级模型能稳健捕捉原始模型输出的幅度分量，而缓存能提供可靠的方向指导，从而提出幅度-方向解耦策略。该方法自适应地组合两者，并利用CFG重用幅度信息，为加速采样提供了更可靠的轻量级解决方案。

Abstract: Flow matching models for video generation achieve impressive performance but suffer from high computational overhead due to iterative denoising. In fact, the original model is not necessary for all denoising steps, allowing some steps to use lightweight alternatives for faster sampling. However, directly using caching or lightweight models can deviate from the original denoising trajectory, resulting in suboptimal performance. Through empirical analysis, we find that lightweight models can robustly capture the magnitude components of the original model’s output, while caching provides reliable directional guidance. Building on this insight, we propose the Magnitude-Direction Decoupling (MDD) method, which adaptively employs a direction-calibrated lightweight model as a substitute for the original model to accelerate inference and effectively correct deviations in the denoising trajectory. Moreover, MDD further reduces inference costs by reusing magnitude information under classifier-free guidance (CFG). As a result, MDD offers a more reliable and lightweight solution to accelerate sampling. Experiments show that MDD outperforms existing acceleration methods, delivering promising speedups (e.g., up to 2.95x on Wan2.1) while preserving high visual fidelity and content richness.

[72] MaLViL: Multi-axis Low-rank Vision-LSTM for Medical Image Segmentation cs.CVPDF

Afshin Bozorgpour, Sina Ghorbani Kolahi, Moein Heidari, Ilker Hacihaliloglu, Dorit Merhof

TL;DR: 本文提出MaLViL网络，一种用于医学图像分割的多轴低秩Vision-LSTM方法。它通过双向低秩ViL在紧凑正交子空间上推理并保留细节，利用尺度感知SaLViL恢复跨轴邻域关系，并通过交叉方向混合器融合正交遍历路径，同时引入统计引导的跳跃调制来保留边界线索。该方法在多个医学图像分割基准上达到竞争性或最先进的精度，并在精细解码器分辨率下将ViL算子内存大幅降低83倍。

Details

Motivation: 现有分割器将Vision-LSTM（ViL）限制在粗粒度瓶颈中，导致丢失精细解剖细节，且将2D特征栅格化为1D序列会破坏正交扫描轴上的邻接关系，因此需要一种能扩展ViL至解码器分辨率并保持细节的高效全局建模方法。

Result: 在皮肤病变、超声和多器官CT基准测试中，MaLViL实现了竞争性或最先进的分割精度，同时在精细解码器分辨率下将ViL算子内存减少了高达83倍。

Insight: 创新点包括：通过双向低秩ViL在紧凑正交子空间进行高效推理并利用正交残差保留细节；尺度感知SaLViL在序列化前恢复跨轴邻居；交叉方向混合器融合正交水平与垂直遍历路径；以及统计引导跳跃调制保留编码器跳跃连接中的边界线索，这些设计共同提升了医学图像分割的精度与效率。

Abstract: Vision-LSTM (ViL) enables efficient global modeling, but its cost still scales with the number of spatial tokens, so existing segmenters confine ViL to a coarse bottleneck and lose fine anatomical detail. Rasterizing 2D features into a 1D sequence further breaks adjacency across the orthogonal scan axis. We propose MaLViL, a Multi-axis Low-rank Vision-LSTM network that extends ViL across decoder resolutions. Bidirectional low-rank ViL (Bi-LRViL) reasons on a compact orthonormal subspace and preserves detail through an orthogonal residual; scale-aware SaLViL restores cross-axis neighbors before serialization; and a Cross-Directional Mixer (CDM) fuses orthogonal horizontal and vertical traversal paths. Statistics-Guided Skip Modulation (SGSM) further retains boundary cues in encoder skips. On skin-lesion, ultrasound, and multi-organ CT benchmarks, MaLViL achieves competitive or state-of-the-art segmentation accuracy, while reducing ViL operator memory by up to $83\times$ at fine decoder resolutions. Code is available at: https://github.com/xmindflow/malvil.

[73] Vision-Language Models for Analog Gauge Reading: An Empirical Study of Specialization, Transfer and Reliability cs.CVPDF

Abdul Mueez, Aaditya Baranwal, Junior Chaj-Mejia, Guneet Bhatia, Jason T. Voelker

TL;DR: 本文对通用视觉语言模型（Qwen2.5-VL-7B-Instruct）在模拟仪表读数任务上的性能进行了系统性实证研究。研究评估了零样本提示、上下文学习和QLoRA微调等方法，在合成、视频衍生和专有工业数据集上测试了模型的专门化、迁移、鲁棒性和可靠性。

Details

Motivation: 解决工业环境中模拟仪表人工检测成本高或危险的问题，研究通用VLM模型能否绕过传统的指针分割和几何读数流程，直接进行数值读取。

Result: 在合成、压力表和专有工业数据集上，最佳微调模型的归一化平均百分比误差（MPE）分别为2.39%、2.61%和4.43%。留一数据集实验显示迁移性能显著下降，鲁棒性测试中高斯模糊是影响最大的干扰。

Insight: 研究表明，通过QLoRA等参数高效微调方法，通用VLM可以在特定仪表读数任务上达到较低误差，但模型存在迁移性差、高置信度错误和鲁棒性问题，强调了在安全关键应用中需要弃权和独立验证机制。

Abstract: Analog gauges remain common in industrial environments where manual inspection is costly or hazardous. The engineering application addressed here is direct numerical reading of single-target analog-gauge images, while the artificial-intelligence contribution is a systematic evaluation of specialization, transfer, robustness and reliability for a general-purpose vision-language model (VLM) without an explicit pointer-segmentation and geometric-reading pipeline. The Qwen2.5-VL-7B-Instruct model is evaluated using zero-shot prompting, in-context learning (ICL) and parameter-efficient fine-tuning with Quantized Low-Rank Adaptation (QLoRA) on a public synthetic dataset, a video-derived Pressure Gauge dataset and a proprietary industrial dataset. All fine-tuning experiments use a fixed 20-epoch protocol with the final epoch used for analysis; separate models with and without supplied gauge ranges remove prompt-setting confounds. The primary metric is range-normalized mean percentage error (MPE). The best fine-tuned MPE values are 2.39% on the synthetic dataset, with a 95% bootstrap confidence interval (CI) of 1.43-3.90%; 2.61% on the Pressure Gauge dataset, with a CI of 1.66-3.80%; and 4.43% on the proprietary industrial dataset, with a CI of 2.31-7.14%. Leave-one-dataset-out experiments reveal substantial transfer degradation on held-out synthetic and proprietary data, while robustness tests identify Gaussian blur as the strongest tested corruption. Reliability analysis shows that high-confidence errors remain possible, motivating abstention and independent validation in safety-critical use. These results support QLoRA-specialized VLMs for direct single-gauge reading but not yet a deployment-ready plant-monitoring pipeline.

[74] Evaluation of AI-based Visual Crack Detection in Steel Bridges Using Probability of Detection cs.CVPDF

Andrii Kompanets, Finn Michael Sherry, Remco Duits, Davide Leonetti, H. H. Snijder

TL;DR: 本文提出了一种基于概率检测曲线的统计评估框架，用于评估和比较计算机视觉方法与传统人工目视检查在钢桥裂缝检测中的性能，旨在解决现有指标难以预测实际工程有效性的问题。

Details

Motivation: 现有计算机视觉方法在结构工程领域的实际有效性难以通过传统指标（如交并比、平均精度）准确评估，因此需要一种与标准工程方法兼容的性能评估框架，以促进自动化检测方法在工程实践中的系统应用。

Result: 该方法应用于真实世界的’钢桥裂缝’数据集，量化了检测概率及其不确定性，证明了所提出的计算机视觉方法在裂缝检测任务中具有鲁棒性，并可作为传统目视检查的有效补充。

Insight: 创新点在于引入概率检测曲线这一统计框架，能够考虑图像分辨率的影响，为自动化损伤检测方法在结构可靠性分析中的实际效果提供了可量化的评估手段，有助于推动AI方法在安全关键领域的广泛应用。

Abstract: Bridge structures are regularly inspected for structural damage such as cracks and corrosion in order to ensure public safety and reduce maintenance costs. Much research has been done on automating this process using computer vision methods, which are often evaluated and compared using metrics such as intersection over union, mean average precision, etc. However, predicting the actual effectiveness of an inspection method within the field of structural engineering from these metrics remains challenging. To enable the systematic use of these increasingly popular methods in engineering practice, evaluating the performance of these methods in a way that is compatible with standard engineering approaches is therefore an urgent necessity. We present a new statistical evaluation framework to allow the comparison of computer vision methods with conventional visual inspection for crack detection in steel bridges. The framework is based on probability of detection curves and can account for the influence of image resolution. We apply this evaluation method to the real-world ``Cracks in Steel Bridges’’ dataset, which contains annotated images of cracks in bridge structures. The quantification of the probability of detection and its uncertainty enables a practical assessment of the effect of automated methods for damage detection in structural reliability analyses. In turn, this enables the wide-spread use of automated (AI-based) damage detection in safety critical applications. This evaluation method provides evidence that the proposed computer vision approach approach is robust for the crack detection task and can have a high added value as an addition to conventional visual inspection methods.

[75] GenRec: Knowing Where to Reconstruct and Where to Generate cs.CVPDF

Ata Çelen, Jaewoo Jung, Federico Tombari, Marc Pollefeys, Sunghwan Hong

TL;DR: GenRec是一种用于稀疏输入图像生成新视角合成的多视角流匹配模型，它通过架构设计、监督和梯度流明确区分重建区域和生成区域。该方法利用源相机和单目深度估计器导出的观察掩码，引导流匹配主干联合去噪所有目标视角的RGB和场景坐标图，并通过像素空间细化阶段恢复观察像素的高频细节。在RealEstate10K、DL3DV-10K和Mip-NeRF~360数据集上的单视角外推和双视角内插任务中，GenRec在观察区域实现了最佳重建保真度，同时在未观察区域超越了纯生成基线的感知质量。

Details

Motivation: 现有生成式新视角合成方法将重建和生成区域混为一谈，使用统一的损失函数，导致几何保真度与创造性幻觉之间的界限模糊，即使通过扭曲点云或投影深度注入场景几何信息。

Result: 在RealEstate10K、DL3DV-10K和Mip-NeRF~360数据集上，GenRec在单视角外推和双视角内插任务中，在观察区域达到最佳重建保真度，同时在未观察区域超越纯生成基线的感知质量，展示了方法的有效性。

Insight: 论文的创新点在于将重建-生成分割直接融入模型架构、监督和梯度流，通过观察掩码引导区分像素可见区域（需精确重建）和遮挡/超出捕获体积区域（允许合理生成），避免了回归信号污染生成先验，从而在保持几何精度的同时提升生成区域的视觉质量。

Abstract: Generative novel view synthesis from sparse input images is rarely all reconstruction or all generation: pixels visible in some source view have a unique correct value modulated only by view-dependent shading, while pixels in disocclusions or beyond the captured volume admit a distribution of plausible completions. Existing generative novel-view-synthesis methods conflate these regimes under a single uniform loss, blurring the line between geometric fidelity and creative hallucinations even when scene geometry is injected through warped point clouds or projected depth. We introduce GenRec, a multi-view flow matching model that builds the reconstruction–generation split directly into its architecture, supervision, and gradient flow. Guided by an observation mask derived from the source cameras and a monocular depth estimator, a flow matching backbone jointly denoises RGB and scene-coordinate maps across all target views, while a pixel-space refinement stage restores high-frequency detail on observed pixels; the same mask gates supervision so regression signals do not contaminate the generative prior. Across RealEstate10K, DL3DV-10K, and Mip-NeRF~360, in both single-view extrapolation and two-view interpolation, GenRec attains the best reconstruction fidelity in observed regions while also surpassing purely generative baselines on perceptual quality in unobserved ones, showing the effectiveness of our approach.

[76] Improving Complex Moiré Removal with Generative Supervision cs.CVPDF

Xinyang Gu, Zhilu Zhang, Honglei Xu, Yanting Mei, Yukang Ding

TL;DR: 本文提出了一种用于改善复杂摩尔纹去除的数据引擎，通过生成训练监督来构建高质量的训练数据。该方法首先收集包含复杂摩尔纹的真实图像并定位屏幕区域，然后利用多个图像条件生成基础模型生成候选参考图像，并通过块级质量控制筛选最优结果，从而构建了包含6.8K对摩尔纹-真实图像对的WildMoiré数据集。实验表明，该方法能有效提升复杂摩尔纹去除模型的性能。

Details

Motivation: 现有数据集难以覆盖真实世界中复杂、大规模、多色的摩尔纹模式，且这些模式常出现在难以获取干净对应图像的场景中（如公共显示屏或在线资源），因此需要一种新方法来生成高质量的训练监督数据。

Result: 在ESDNet、SDXL和Qwen-Image-Edit等模型上的广泛实验表明，所提出的生成监督方法能持续提升复杂摩尔纹去除的性能，并构建了包含约250对带真实干净图像的独立测试集进行评估。

Insight: 创新点在于利用生成式基础模型和数据质量控制机制自动构建训练数据，解决了复杂摩尔纹数据稀缺问题；客观来看，该方法通过系统化生成和筛选参考图像，为图像去摩尔纹任务提供了可扩展的数据增强方案。

Abstract: The availability of high-quality paired data is essential for training learning-based image demoiréing models. However, it remains challenging for existing datasets to encompass the complex moiré patterns captured in uncontrolled real-world scenarios. Such degradations typically manifest as large-scale, multicolored moiré patterns. Moreover, these patterns frequently occur in images for which clean counterparts are difficult to obtain, such as photographs acquired from public displays or existing online resources. In this work, we propose a novel data engine designed to improve the removal of complex moiré patterns by generating training supervision. Specifically, we initially collect real-world images containing complex moiré patterns and localize the corresponding screen regions. Multiple image-conditioned generative foundation models are subsequently deployed to produce candidate references. To establish reliable supervision, these candidates are subjected to patch-level quality control to filter and select the optimal results. Based on this systematic paradigm, we construct the WildMoiré dataset, which contains 6.8K moiré-GT training pairs. For evaluation, we additionally build an independent test set comprising $\sim$250 pairs with captured clean ground truth. Extensive experiments on ESDNet, SDXL, and Qwen-Image-Edit demonstrate that the proposed generative supervision consistently improves the performance of complex moiré removal.

Alexandre G. Leclercq, Noémie N. Moreau, Hugo Audebert, Andros Nassar, Thomas Cochin

TL;DR: 本文介绍了CFB-GBM v2.0数据集，这是对先前发布的胶质母细胞瘤（GBM）数据集的扩展，新增了所有可用时间点的肿瘤体积（GTV）分割标注，并将标注完成率从35%提升至97%。该数据集还提供了基于RANO 2.0标准的纵向疾病进展标签、脑部掩膜、预计算的影像组学特征以及更新的WHO分类指南，旨在支持治疗反应预测和个性化医疗的计算方法开发。

Details

Motivation: 胶质母细胞瘤是最具侵袭性的原发性脑肿瘤，需要包含全面临床和治疗数据的纵向多模态影像数据集来支持可重复的计算方法开发，以用于治疗反应预测、疾病进展建模和个性化医疗。

Result: 通过使用在BraTS 2021上预训练并在CFB-GBM真实轮廓上微调的nnU-Net模型，实现了所有时间点（t0, t1, t2）的GTV分割，并由五位放射肿瘤学家验证，将GTV标注完成率从35%显著提高到97%。

Insight: 主要创新点在于构建了一个高度完整、多时间点、多模态的公开GBM数据集，并提供了自动化生成且经过专家验证的分割标注、RANO进展标签以及预计算的影像组学特征，极大提升了数据集的可用性和可重复性，为纵向医学影像分析研究提供了宝贵资源。

Abstract: Glioblastoma (GBM) is the most aggressive primary brain tumor in adults, with a median overall survival of 15 months. Longitudinal, multi-modal imaging datasets with comprehensive clinical and treatment data are essential to support the development of reproducible computational methods for treatment response prediction, disease progression modelling, and personalized medicine. We present CFB-GBM v2.0, an extension of our previously released CFB-GBM dataset comprising 264 GBM patients treated according to the standard Stupp protocol. The primary contribution of this release is the completion of Gross Tumour Volume (GTV) delineations across all available timepoints ($t_0$, $t_1$ and $t_2$), increasing the overall GTV completion rate from 35% to 97%. This was achieved using a nnU-Net model pre-trained on BraTS 2021 and fine-tuned on CFB-GBM ground-truth contours, with the generated segmentations validated by five radiation oncologists. From these longitudinal GTV annotations, volumetric RANO 2.0 response category labels were derived for all available temporality pairs ($t_0 \rightarrow t_1$, $t_0 \rightarrow t_2$ and $t_1 \rightarrow t_2$). To further ease dataset usability and reproducibility, brain masks computed with HD-BET and pre-computed radiomic features extracted with PyRadiomics are provided for each patient timepoint and MRI modality. Additionally, the WHO classification guideline (2016 vs. 2021) applicable to each patient’s diagnosis is now explicitly documented. CFB-GBM v2.0 is publicly available on The Cancer Imaging Archive (TCIA) at https://www.cancerimagingarchive.net/collection/cfb-gbm .

[78] Beyond Instrument Motion: Recognizing Tissue Tension Toward Surgical Skill Assessment cs.CVPDF

Marko Haralovi, Zhiqi Miao, Alexander Machiel Bont, Jiapan Guo, Frans van Workum

TL;DR: 该论文提出了一种新的手术视频理解任务——组织张力识别，用于腹腔镜和机器人辅助直肠癌手术的技能评估。作者构建了首个专家标注的组织张力数据集SurgTension，并提出了一个轻量级的基于轨迹的框架TensionTRAC来建模组织张力。

Details

Motivation: 现有的手术视频理解方法（如器械分割、手术阶段识别）未能捕捉精细的组织处理，而这是评估手术质量的关键指标。目前的手术性能评估主要依赖专家手动评审，耗时、主观且难以扩展。

Result: 在构建的SurgTension基准数据集上，所提出的轻量级框架TensionTRAC与强大的预训练视频骨干网络相比，取得了具有竞争力的性能。

Insight: 创新性地将组织张力识别定义为一个新的、具有临床意义的计算机视觉任务，并为此构建了首个专家标注的基准数据集。提出的TensionTRAC框架利用稀疏点轨迹来建模组织张力，是一种轻量且有效的方法，避免了依赖复杂的预训练模型。

Abstract: Surgical performance assessment in minimally invasive surgery largely relies on manual expert review, making it time-consuming, subjective, and difficult to scale. While existing surgical video understanding methods address tasks such as instrument segmentation, surgical phase recognition, and action recognition, they do not explicitly capture fine-grained tissue handling, a key indicator of surgical quality. To address this gap, we introduce tissue tension recognition, a new clinically motivated video understanding task for laparoscopic and robot-assisted rectal cancer surgery. To support this task, we construct SurgTension, the first expert-annotated tissue tension dataset, providing a benchmark for objective tissue tension recognition. We further propose TensionTRAC, a lightweight trajectory-based framework that models tissue tension from sparse point trajectories. Using a compact trajectory encoder, TensionTRAC achieves competitive performance against strong pretrained video backbones.

[79] PerFact: Perception-Derived Fact Prompting for 3D Brain MRI Report Generation cs.CVPDF

Jianyu Sun, Zhenxuan Zhang, Guang Yang, Peter J. Lally

TL;DR: 该论文提出了一种名为PerFact的方法，用于3D脑部MRI报告的生成。研究发现，在3D多序列脑部MRI这一领域，报告质量的关键决定因素不是模型架构或规模，而是输入提示中的信息。PerFact通过上游的3D分割和分类模型提取感知信息，将其序列化为结构化的事实句子，并以此提示一个经过LoRA适配的视觉语言模型来生成报告。

Details

Motivation: 解决现有放射学报告生成方法（主要基于2D胸部X光片）在3D脑部MRI上表现不佳的问题，特别是零样本医疗视觉语言模型迁移效果差，且不同骨干网络微调后性能差异有限，从而探索影响报告质量的根本因素。

Result: 在固定骨干网络、数据划分、目标报告和适配方法，仅改变输入基础信息的控制研究中，感知驱动的事实提示优于检索到的先前报告，且一旦提供事实，检索变得冗余。即使使用预测事实（无需推理时的真实标注），其效果依然有效。报告质量的主要可控因素是基础信息，而非模型选择。

Insight: 创新点在于将感知任务（分割与分类）与报告生成解耦，通过结构化事实句子作为中间表示来提供强基础信息，从而显著提升报告质量。客观分析认为，该方法强调了在复杂3D医学影像领域，高质量、结构化的领域知识注入比单纯扩大模型规模或预训练更为关键，为医学报告生成提供了一种新的、以信息为中心的范式。

Abstract: Radiology report generation has matured almost entirely on 2D chest radiographs, where the default route to better reports is a larger backbone or a pre-training one on medical data. We revisit that assumption on 3D multi-sequence brain MRI, a volumetric multi-disease regime, and find that the model is not the lever. Zero-shot medical and radiology vision-language models transfer poorly to brain MRI, with chest radiograph specialists failing most conspicuously, and five backbones fine-tuned identically across three model families and an order of magnitude in scale differ only marginally. What determines the quality of the report is the information injected into the prompt. We delegate perception to upstream 3D segmentation and classification, serialize their outputs into a structured fact sentence, and prompt a LoRA-adapted vision-language model with it; we call this \textbf{PerFact}. In a controlled study that fixes the backbone, data split, target reports, and adaptation while varying only the injected grounding, perception-derived facts outperform retrieved prior reports, retrieval becomes redundant once facts are present, and end-to-end predicted facts remain effective without any ground-truth annotation at inference. The residual gap between predicted and oracle facts is explained by the granularity of the facts rather than by the generator. Closed-ended visual question answering comes at no measurable cost to report quality, though the grounding source has little effect on it. On 3D brain MRI, grounding information, not model choice, is the dominant controllable factor in report quality.

[80] LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Caching cs.CVPDF

Jinshan Liu, Haoran Qin, Xiaobing Tu, Jiacheng Liu, Jiahui Hu

TL;DR: 本文提出LinCa，一种基于可学习可逆网络的扩散模型特征缓存加速框架。该方法通过轻量级可逆网络将缓存特征分解为具有不同连续性属性的子组件，并为每个组件匹配不同的预测顺序，形成一个统一的分解-预测-重建流程。实验表明，LinCa仅需增加不到0.2%的参数，即可在5-7倍加速下显著超越现有方法并保持近乎无损的生成质量。

Details

Motivation: 扩散模型在图像和视频生成方面取得了显著成功，但其迭代采样的高计算成本是实际部署的关键瓶颈。现有的免训练特征缓存方法采用统一的预测策略，无法适应异构的特征动态，导致在高加速比下质量显著下降。

Result: 在FLUX、Qwen-Image和HunyuanVideo等模型上的实验表明，LinCa在5-7倍加速下显著优于现有方法，并保持了近乎无损的生成质量。

Insight: 创新点在于提出了一个基于可学习可逆网络的特征分解框架，将特征分解为具有不同动态特性的子组件并分别进行预测，严格的逆变换保证了无损重建，从而实现了对异构特征动态的自适应加速。

Abstract: Diffusion models have achieved remarkable success in image and video generation, yet the high computational cost of iterative sampling remains a critical bottleneck for practical deployment. Feature caching has emerged as a promising acceleration paradigm by reusing or predicting intermediate features across timesteps. However, existing training-free methods apply uniform prediction strategies that cannot adapt to the heterogeneous feature dynamics, causing significant quality degradation under high acceleration ratios. We propose LinCa, a feature caching framework based on learnable invertible networks. LinCa decomposes cached features into sub-components with distinct continuity properties via a lightweight invertible network and applies differentiated prediction orders matched to each component. The strict invertibility guarantees lossless reconstruction back to the original feature space, forming a unified Decompose-Predict-Reconstruct pipeline. By training separate predictors for different models and timestep segments, LinCa adapts to heterogeneous feature dynamics. Experiments on FLUX, Qwen-Image, and HunyuanVideo demonstrate that LinCa, with less than 0.2% additional parameters, significantly outperforms existing methods and maintains near-lossless quality at 5-7x speedup. Code: https://github.com/QHR69/LinCa

[81] Memory Tree Guided Key Frame Querying for Efficient 3D Question Answering cs.CVPDF

Hsiang-Wei Huang, Fu-Chen Chen, Li-Wu Tsao, Cheng-Han Lee, Che-Chun Su

TL;DR: 本文提出了一种名为MemTree3D的记忆树引导关键帧选择方法，用于在具身场景中实现高效的三维问答。该方法利用紧凑且可重用的三维场景表示，支持基于相机6-DoF姿态的实时在线构建，并通过基于评分的帧选择机制，使大型语言模型能够高效查询和检索与问题相关的关键帧，而无需重新处理整个视频流。

Details

Motivation: 在具身场景中，由于计算和内存资源有限，视觉语言模型（VLM）进行准确高效的问答面临挑战。现有方法采用视觉搜索关键帧检索，但效率低下，因为需要为每个用户查询在数千个视频帧中进行视觉搜索。

Result: 在OpenEQA基准测试上，该方法将GPT-4o的LLM-Match提高了17.4%，将LLaVA-OneVision-7B提高了5.8%，超越了现有的视觉搜索方法。

Insight: 创新点在于引入了MemTree3D这一紧凑、可重用且支持实时构建的三维场景表示，它捕获多层次的三维场景信息，并通过基于评分的帧选择机制，实现了无需重新处理视频流的高效关键帧查询与检索，显著提升了问答效率。

Abstract: Answering questions accurately and efficiently in embodied scenarios presents significant challenges due to limited computational and memory resources for Vision Language Model (VLM) inference. Existing methods adopt visual search key frame retrieval method to select critical question-related key frames for VLM input. However, visual search methods are inefficient because they require visual search among thousands of video frames for each individual user query. In this work, we propose a memory tree guided key frame selection paradigm for efficient 3D question answering in embodied scenarios. Our method leverages a compact and reusable 3D scene representation, termed MemTree3D, which supports real-time online construction leveraging camera 6-DoF poses. MemTree3D captures multi-level 3D scene information, enabling a Large Language Model to efficiently query and retrieve question-relevant key frames through our scoring-based frame selection without reprocessing the entire video stream. On OpenEQA, our method improves the LLM-Match of GPT-4o by 17.4%, LLaVA-OneVision-7B by 5.8%, outperforms existing visual search methods. Our code is available at https://github.com/hsiangwei0903/MemTree3D

[82] Initialization-Free Bundle Adjustment Revisited: A Controlled Experimental Study cs.CVPDF

Simon Weber, Mateo de Mayo, Je Hyeong Hong, Carl Olsson, Daniel Cremers

TL;DR: 本文对无需初始化的光束法平差（InitFree BA）进行了实验性重访，提出了一个统一的评估框架，结合了现有对象空间误差（OSE）公式的C++实现和基于Blender的数据集生成器。研究发现，优化目标值与有效度量重建之间存在一个被忽视的差距，即具有相似低OSE值的投影解在度量升级后可能导致显著不同的欧几里得重建。

Details

Motivation: 现有InitFree BA方法主要评估优化成功率，但未明确低OSE目标是否产生有效的度量3D重建，因此需要实验性地重新审视该问题，以揭示优化与重建之间的差距。

Result: 实验表明，重建成功的关键因素包括初始化先验、地标点观测密度和度量升级稳定性，而主要挑战在于获得允许可靠度量升级的投影重建，而不仅仅是最小化OSE目标。

Insight: 创新点在于提出了一个结合精确地面实况和受控相机配置的基准测试框架，揭示了优化-重建差距，为未来InitFree BA研究提供了更强的实验基础，强调了度量升级可靠性的重要性。

Abstract: Initialization-free bundle adjustment (InitFree BA) aims to recover camera poses and scene structure directly from image observations, avoiding the geometric initialization stages of conventional structure-from-motion pipelines. Recent methods based on Object-Space Error (OSE) formulations and Variable Projection (VarPro) show encouraging optimization behavior from random camera configurations. However, existing evaluations primarily measure optimization success, leaving unclear whether a low OSE objective yields a valid metric 3D reconstruction. We revisit InitFree BA experimentally through a unified evaluation framework combining a C++ implementation of existing OSE formulations with a Blender-based dataset generator providing exact ground truth and controlled camera configurations and observation densities. Our experiments reveal a previously overlooked optimization–reconstruction gap: projective solutions with similarly low OSE values can lead to substantially different Euclidean reconstructions after metric upgrade. We identify initialization priors, landmark observation density, and metric-upgrade stability as key factors governing reconstruction success. Overall, our results suggest that the main challenge of InitFree BA is not merely minimizing OSE objectives, but obtaining projective reconstructions that admit reliable metric upgrade. We believe that the proposed benchmark, implementation, and analysis establish stronger experimental foundations for future research on initialization-free bundle adjustment, a problem largely unexplored within the computer vision community. Project page is available at https://github.com/simonwebertum/InitFreeBA.git.

[83] Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving cs.CVPDF

Zongzheng Zhang, Jijun Wang, Saining Zhang, Shuo Wang, Yiru Wang

TL;DR: 本文首次系统性地研究了交通元素（如交通灯、路标）对端到端自动驾驶的影响。通过为多个公开驾驶数据集添加全面的交通元素标注，构建了统一的研究基础设施，并采用即插即用的最小化集成设计，将交通元素信号融入多种现有驾驶模型架构中。实验表明，这种简单的集成能持续提升不同范式模型在各种基准测试上的驾驶性能，并在NAVSIM-v2基准上达到了新的最先进水平。

Details

Motivation: 现有端到端驾驶研究主要关注动态道路参与者（如车辆、行人），而交通元素的作用在很大程度上未被探索。社区缺乏对其影响的系统性量化研究，主要是因为公开数据集很少提供结构化的交通元素标注，且现代驾驶系统在架构和训练范式上差异很大。

Result: 在nuScenes、NAVSIM-v1、NAVSIM-v2和Bench2Drive等多个数据集上，对感知-预测-规划管道、视觉-语言-动作模型、基于回归的规划器、基于扩散的策略和轨迹评分框架等多种现代范式进行评估，该集成方法一致地提升了驾驶性能。特别是在具有挑战性的NAVSIM-v2基准上，该方法显著改进了最先进的架构和数据管道，建立了新的SOTA。

Insight: 论文的核心创新点在于首次对交通元素感知进行系统性研究，并提出了一个最小化、通用、即插即用的集成设计，能以极小的架构修改将交通元素信号融入多样化的现有端到端驾驶管道中。这证明了交通元素感知为端到端驾驶系统提供了一个鲁棒且可泛化的信号源。

Abstract: Traffic elements such as traffic lights and road signs play a fundamental role in human driving decisions and should naturally influence end-to-end driving performance. However, existing end-to-end driving research predominantly focuses on dynamic road participants (e.g., vehicles and pedestrians), while the role of traffic elements remains largely unexplored. The community still lacks a systematic study quantifying their impact, largely because public datasets rarely provide structured traffic-element annotations and modern driving systems vary widely in architecture and training paradigm. In this work, we present the first systematic investigation of traffic element awareness for end-to-end autonomous driving. We construct a unified research infrastructure by augmenting multiple public driving datasets with comprehensive traffic-element annotations. To support diverse model families, we adopt a minimal and universal integration design that incorporates traffic-element signals into existing pipelines in a plug-and-play manner with negligible architectural modification. We evaluate this design across modern paradigms, including perception-prediction-planning pipelines, vision-language-action models (VLA), regression-based planners, diffusion-based policies, and trajectory-scoring frameworks, on nuScenes, NAVSIM-v1, NAVSIM-v2, and Bench2Drive. Across all paradigms and datasets, this simple integration consistently improves driving performance, demonstrating that traffic element awareness provides a robust and generalizable signal for end-to-end driving systems. Notably, on the challenging NAVSIM-v2 benchmark, our approach significantly improves state-of-the-art architectures and data pipelines, establishing a new state of the art.

[84] From Corpora to Co-Evolving Capabilities: Capability-Centric Data Design for Generalist Image Generation cs.CV | cs.AIPDF

Xingjian Wang, Zhao Wang, Taihang Hu, Jun Zheng, Qing Jin

TL;DR: 本文提出了一种以能力为中心的数据基础设施，用于通用图像生成。该框架通过三个互补的数据引擎构建文本-图像、图像-图像和图像-知识关联的监督信号，并采用多阶段课程学习策略，根据能力依赖关系联合演化任务组合、视觉概念分布和数据质量。基于此基础设施，作者从零开始训练了30亿和60亿参数的多模态扩散模型，并在CPI-Bench上进行了评估，展示了广泛的视觉覆盖、多功能渲染和跨生成能力的有效迁移。

Details

Motivation: 当前大规模图像生成的数据流水线通常孤立地优化特定任务数据集，核心挑战在于如何根据生成能力之间的依赖关系来组织异构的监督信号，而不仅仅是策划每个任务特定的语料库。

Result: 该框架构建了包含4.4亿张图像的文本到图像语料库、1.2亿个编辑对和超过2700万个图像-实体对。在CPI-Bench上的定量评估以及多样化的文本到图像和编辑场景的定性评估表明，所训练的模型具有广泛的视觉覆盖、多功能渲染和跨生成能力的有效迁移。

Insight: 创新点在于提出了一个能力驱动的数据基础设施，将能力特定的监督构建与能力对齐的课程调度相结合，通过三个互补的数据引擎和跨任务/粒度的专家标注来统一组织异构监督，并采用多阶段课程学习策略根据能力获取的依赖顺序联合演化数据集的多个维度。

Abstract: Large-scale image generation has benefited from advances in data scale, quality, rebalancing, and recaptioning, yet conventional pipelines typically optimize task-specific datasets in isolation. A central challenge is not only how to curate each task-specific corpus, but also how to organize heterogeneous supervision according to the dependencies among generative capabilities. We present a \textbf{capability-driven data infrastructure} that couples capability-specific supervision construction with capability-aligned curriculum scheduling. Its three specialized yet interoperable data engines build complementary relational supervision for text-image grounding, inter-image transformation, and image-knowledge association, while caption experts align T2I and editing supervision across tasks and granularities. A multi-stage curriculum jointly evolves task composition, visual-concept distribution, data quality, and image resolution along the dependency order of capability acquisition, with capability-aware evaluation closing the loop through targeted retrieval, expert construction, and gap-aware resampling. At scale, the framework curates a 440M-image T2I corpus, 120M editing pairs, and over 27M image-entity pairs. With this infrastructure, we train multimodal diffusion models at two scales from scratch, with 3B and 6B sizes respectively. We conduct quantitative evaluation on CPI-Bench, along with qualitative evaluations across diverse text-to-image and editing scenarios. Experimental results present broad visual coverage, versatile rendering, and effective transfer across generative capabilities.

cs.RO [Back]

[85] Teach and Grow: An Agent-Centered Architecture for General Robot Learning cs.RO | cs.AI | cs.CV | cs.LGPDF

Chang Nie, Zhe Liu, Hesheng Wang

TL;DR: 该论文提出了Teach-and-Grow Learning (TGL)架构，一种以智能体为中心的通用机器人学习框架。其核心思想是将少量成功演示转化为可复用的技能块，在新场景中通过组合这些技能块、选择工具并观察物理结果来执行任务，无需针对新任务重新训练策略。该架构将部署视为持续学习过程，使机器人能够积累和重用经验。

Details

Motivation: 解决端到端视觉-语言-动作模型在遇到超出已验证物理覆盖范围的新对象、传感器或接触情况时的可靠性问题，避免因频繁收集新数据、更新策略和回归测试而产生的’再训练税’。

Result: 在LIBERO基准测试中达到了最先进的性能；受控研究展示了技能归纳、持久重用和智能体引导的适应能力。

Insight: 创新点在于将成功演示封装为可组合和可重用的闭环技能块，并构建技能库和结构化经验记忆以实现持续学习；提出了’Teach-and-Grow缩放定律’假设，认为有效可重用经验的积累能以幂律形式降低未来任务错误率和教学需求。

Abstract: End-to-end vision-language-action (VLA) and world-action models offer an elegant route to general-purpose robotics, but their reliability is bounded by validated physical coverage. When an unfamiliar object, sensor, embodiment, or contact falls outside that coverage and no validated fallback exists, correcting the failure requires new robot data, a policy update, and regression testing. This recurring burden is the retraining tax. Unlike text, embodied data must often be created by operating machines. We present Teach-and-Grow Learning (TGL), an agent-centered architecture for general robot learning. In its general form, a multimodal agent turns a few successful demonstrations into reusable Skill Blocks: closed-loop behaviors for meaningful subgoals. In a new scene, the agent grounds and composes these blocks, selects learned or geometric tools, observes the physical outcome, and revises the route when execution departs from intent. A Skill Library stores executable behavior, while structured Experience Memory carries forward success, failure, and repair. New tasks are acquired without task-specific policy retraining. Our LIBERO evaluation attains state-of-the-art performance; controlled studies expose skill induction, persistent reuse, and agent-directed adaptation. Finally, we propose the Teach-and-Grow scaling-law hypothesis: if X denotes effective reusable experience, future-task error and teaching demand should approach irreducible floors as power laws in X. The architecture therefore treats deployment as a period of continued learning, in which one task can make the next easier.

cs.LG [Back]

[86] Efficient RLVR Scheduling via Graph-Structured Online Difficulty Estimation cs.LG | cs.AI | cs.CLPDF

Zhizhao Liu, Zhiliang Tian, Xi Wang, Zhihua Wen, Yihang Xiong

TL;DR: 本文提出了一种基于图结构的在线难度估计器，用于优化RLVR（可验证奖励的强化学习）中的探索调度。该方法通过构建样本间的语义和推理相似性图，共享相关样本的探索反馈，并利用在线变分推理持续更新潜在难度状态，从而无需额外探测即可实现自适应的样本选择和探索资源分配。

Details

Motivation: RLVR提升大语言模型推理能力时，均匀的探索预算分配效率低下，因为不同难度样本所需探索量不同。现有自适应调度器难以获得可靠的在线难度估计：专用探测开销大，而基于历史的估计器面临冷启动、反馈滞后且忽略样本间关系的问题。

Result: 在多个基础模型、RL调度器和基准测试上的实验表明，该框架实现了更好的性能。

Insight: 创新点在于提出了一种即插即用的图结构在线难度估计框架，通过构建难度感知样本图并引入潜在状态与Potts先验来建模样本间关系，利用Beta-Binomial模型聚合状态级反馈，并使用在线变分算法更新估计，从而缓解冷启动和滞后问题，实现无需专用探测的自适应探索。

Abstract: Reinforcement learning with verifiable rewards (RLVR) improves the reasoning capabilities of large language models but relies on costly rollout exploration. Assigning the same exploration budget to samples with different difficulty levels is inefficient: easy samples may receive redundant rollouts, whereas difficult but learnable samples may receive too little exploration. Existing adaptive schedulers address this mismatch through curriculum-based sample selection or non-uniform rollout allocation based on estimated sample difficulty. However, obtaining reliable online difficulty estimates remains challenging: dedicated probing adds substantial generation overhead, whereas history-based estimators face a cold start with no initial observations and stale feedback, and typically ignore relations among samples. To address these limitations, we propose a plug-and-play graph-based online difficulty estimator that shares rollout feedback across related samples and continuously updates their difficulty estimates, mitigating cold start and staleness without dedicated probing. Specifically, we first construct a difficulty-aware sample graph based on semantic and reasoning similarities. Based on this graph, we introduce latent difficulty states and use a Potts prior to encourage neighboring samples to share the same state. We then employ a state-level Beta-Binomial model to aggregate the rollout outcomes associated with each state. Finally, we use an online mean-field variational algorithm to continuously update the latent-state assignments and state-level difficulty as new feedback arrives. Our framework can be integrated into sample-selection and rollout-allocation schedulers, enabling difficulty-adaptive exploration without dedicated probing. Experiments across multiple base models, RL schedulers, and benchmarks demonstrate that our framework achieves better performance.

[87] Hierarchical Data Selection via Manifold Coverage and Sparse Feature Coverage in LLM Post-training cs.LG | cs.CVPDF

Peng Sun, Yi Yang, Antong Zhang, Chunxiao Li, Yanbo Wang

TL;DR: 本文提出了一种名为MASS的分层数据选择方法，用于在大规模监督微调数据中高效选取高价值子集。该方法通过稠密自编码器学习低维主流形坐标进行粗粒度语义分组，再使用TopK稀疏自编码器在各组内进行质量感知的稀疏特征覆盖，从而解决传统方法在原始嵌入空间中度量多样性时语义方向、细粒度监督差异与局部噪声纠缠的问题。

Details

Motivation: 现有数据选择方法通常在原始嵌入空间中直接度量多样性，导致主导语义方向、细粒度监督差异和局部噪声相互纠缠，限制了选择效果。本文旨在通过分层覆盖的框架更有效地从大规模候选池中选取高质量训练数据。

Result: 在Vision Flan和LLaVA-CoT基准上的实验表明，MASS在多种数据预算下均优于强基线方法，并且在某些设置下，仅使用一小部分数据就能达到或超越使用全部数据训练的效果。

Insight: 创新点在于将数据选择建模为从粗到细的分层覆盖问题，结合了主流形学习进行粗粒度语义分组和稀疏特征覆盖进行组内细粒度质量筛选。这种分层结构能更清晰地分离不同层次的语义信息，提升数据选择的效率和效果。

Abstract: As supervised fine-tuning data continues to scale, selecting high-value subsets from large candidate pools is crucial for reducing training cost and improving model performance. Existing methods often measure diversity directly in the original embedding space, where geometric metrics entangle dominant semantic directions, fine-grained supervision differences, and local noise. We address this limitation by formulating data selection as a coarse-to-fine hierarchical coverage problem and propose MASS. MASS learns low-dimensional principal manifold coordinates with a dense autoencoder for coarse semantic grouping, and then performs quality-aware sparse feature coverage within each group using a TopK sparse autoencoder. Experiments on Vision Flan and LLaVA-CoT show that MASS consistently outperforms strong data selection baselines across multiple budgets, and in several settings matches or surpasses full data training with only a small subset of data.

[88] Co-RL: Unsupervised Reasoning Emerges from Diverse Cohort in Multi-agent RL cs.LG | cs.AI | cs.CVPDF

Yunhao Yang, Yuexin Bian, Yunjie Tian, Di Fu, Tianjin Huang

TL;DR: 本文提出了Co-RL框架，一种无需真实标签监督的多智能体强化学习方法。该方法通过让多个解耦的模型（参数不共享）相互提供奖励信号进行协同优化，以促进无监督推理能力的涌现。实验表明，增加智能体队列的多样性（如模型架构、大小和训练样本的改写）能有效减少相关误差，防止训练崩溃，并在文本和多模态基准上取得显著性能提升。

Details

Motivation: 传统强化学习提升语言和视觉语言模型推理能力严重依赖真实监督信号（如可验证的奖励），这些标注成本高昂且在模型能力超越人类可靠评估范围时变得稀缺。现有的自我奖励RL方法虽能减少依赖，但容易强化模型固有偏见、降低响应多样性并导致训练崩溃。

Result: 在七个纯文本LLM基准测试上平均提升3.0-8.6%，在四个多模态VLM基准测试上平均提升2.3-7.2%。该方法在无任何真实标签的情况下，性能超越了基线模型和先前的无标签方法，并达到或超越了有监督方法的水平。

Insight: 核心创新在于利用解耦的多智能体协同训练框架，通过智能体间相互提供奖励来避免自我奖励RL的固有问题。一个关键的客观洞见是，通过引入模型家族、大小和训练样本改写等多种形式的队列多样性，可以有效打破自我强化的反馈循环，这是防止训练崩溃和提升性能的关键机制。

Abstract: Reinforcement learning (RL) has emerged as a powerful approach for improving reasoning in language and vision-language models, yet its strongest successes still depend heavily on ground-truth supervision (e.g., verifiable reward). Such annotations are costly to obtain and become increasingly scarce as reasoning capabilities advance beyond what humans can reliably evaluate. Self-rewarding RL reduces this dependence by enabling models to derive reward signals from their own completions. However, training solely on self-generated feedback can reinforce existing biases and suboptimal behaviors, reduce response diversity, and ultimately lead to homogenized responses and training collapse. In this work, we show that unsupervised reasoning can emerge through cooperative multi-agent training. We introduce Co-RL, a framework in which multiple decoupled models, sharing no parameters, are simultaneously optimized through RL using rewards derived from their peers. We further show that increasing cohort diversity, through heterogeneous model families, sizes, and rephrased training samples, reduces the correlated errors that drive self-reinforcing feedback loops. This diversity consistently improves reasoning performance, maintains behavioral diversity, and mitigates training collapse. Across text-only and multimodal domains, Co-RL consistently outperforms the base models and prior label-free approaches, while matching or surpassing supervised methods, without access to any ground-truth labels. Concretely, Co-RL yields average gains of 3.0-8.6% across seven text-only benchmarks for LLMs and 2.3-7.2% across four multimodal benchmarks for VLMs. Code is available at https://github.com/DrStranded/Co-RL.

cs.GR [Back]

[89] RADmesh: Remesh-Aware Mesh Deformation cs.GR | cs.CVPDF

Nam Anh Dinh, Itai Lang, Oded Stein, Rana Hanocka

TL;DR: 本文提出了一种名为RADmesh的网格变形方法，该方法结合了重网格化技术，通过视觉损失进行生成式形状变形。该方法能够处理大幅度的几何变形，同时通过周期性的各向同性重网格化保持网格质量，支持从粗到细的分辨率增加，并允许局部变形以在基础形状上生长新特征。

Details

Motivation: 现有基于文本和视觉监督的生成式网格变形方法通常不改变网格的三角剖分，这在大幅度变形时容易导致网格元素质量下降，而重网格化作为离散操作难以与噪声较大的视觉损失信号结合。本文旨在解决这一问题，实现既能进行大幅度语义变形又能保持高质量网格的方法。

Result: 该方法在多种形状和提示（包括局部和全局变形）上展示了有效性，证明了其具有优越的视觉质量和三角形效率。

Insight: 创新点在于提出了一种基于顶点的变形优化量，能够处理大变形并对噪声鲁棒，同时通过周期性各向同性重网格化来插值和传递变形优化状态，从而实现几何感知的连续优化和局部化特征生长。

Abstract: We propose a remeshing-enhanced method for generatively deforming shapes with visual losses. It is intuitive that sufficiently drastic deformations of a mesh without changing its triangulation can easily compromise element quality, even if such large geometry changes may be semantically desired. Shape deformation methods could thus benefit from changing the triangulation; however, this is not done by most generative, text-based, visually-supervised mesh deformation methods. Remeshing is a discrete operation, proven to be especially challenging to couple with the notoriously noisy supervision signal provided by visual losses. We propose a vertex-based deformation optimization quantity capable of large deformations and robustness to such noise; we periodically remesh using an isotropic remesher that interpolates and carries forward the deformation optimization state. This enables continuous, geometry-informed progress in coarse-to-fine addition of resolution. The resulting shapes’ triangulations fit their optimized geometry and have neat isotropic elements. Further, our method is localizable, able to grow new features on a base shape with expressive detail, leaving the rest unchanged. We showcase the effectiveness of our method on a variety of shapes and prompts, both local and global deformations, and demonstrate its superior visual quality and triangle efficiency. Our project page is at https://threedle.github.io/radmesh.

[90] aDSL: Agentic 3D Creation via Joint Agent-Program Design cs.GR | cs.CVPDF

Rui-Huan Wang, Si-Tong Wei, Jia-Qi He, Heng-Yi Wei, Baoquan Chen

TL;DR: 该论文提出了一种名为aDSL的面向智能体的领域特定语言，以及一个无需训练的角色专业化多智能体系统，用于解决现有基于大语言模型的3D程序生成方法在将高层意图转化为一致的低层几何结构时存在的脆弱性问题。该方法通过强调可组合性和空间推理，让智能体通过关系运算符而非脆弱的绝对坐标来操纵几何，并通过一个计划-执行-批评循环来分解请求、合成代码并迭代修复错误。

Details

Motivation: 现有基于大语言模型的3D程序化创作方法存在脆弱性，难以将高层意图可靠地转化为一致的低层几何结构，其根源在于现有程序化接口与LLM的推理优势（偏向语义结构和空间关系，而非脆弱的数值选择）不匹配。

Result: 实验表明，该方法在文本到形状和图像到形状任务上优于先前基于LLM的基线方法，同时保持了显式结构、可编辑性和可解释性。

Insight: 核心创新在于联合设计了面向智能体的领域特定语言和无需训练的多智能体系统，通过强调可组合性和空间推理的aDSL语言来弥合语义逻辑与几何约束之间的鸿沟，并利用基于执行反馈的迭代修复循环来提升鲁棒性和可控性。

Abstract: Programmatic representations provide a compelling paradigm for 3D content creation, enabling fine-grained edits, interpretability, and explicit structural control. Yet, agentic workflows that rely on large language models (LLMs) to author 3D programs remain brittle, often failing to translate high-level intent into consistent low-level geometry. We attribute this fragility to a mismatch between existing programmatic interfaces and the reasoning strengths of LLMs, which favor semantic structure and spatial relations over fragile numeric choices. In this paper, we jointly design an Agent-centric Domain-Specific Language (aDSL) and a role-specialized multi-agent system to close this gap. aDSL bridges semantic logic and geometric constraints by emphasizing composability and spatial reasoning; it enables agents to manipulate geometry through relational operators instead of brittle absolute coordinates. Building on aDSL, our training-free multi-agent system follows a Plan-Execute-Critic loop to decompose requests, synthesize code, and iteratively repair errors and constraint violations using execution feedback. Experiments show that this co-design improves robustness, controllability, and faithfulness to user intent. Our method outperforms prior LLM-based baselines on text-to-shape and image-to-shape tasks while preserving explicit structure, editability, and interpretability. It also enables downstream applications such as articulated object creation and structured scene composition. Our code is available at https://github.com/sig-pku/aDSL.

cs.AI [Back]

[91] Grounding Healthcare LLMs in a Causal Knowledge Graph: Framework, Metrics, and a Cardiovascular Pilot cs.AI | cs.CL | cs.IR | q-bio.QMPDF

Ummara Mumtaz, Aimen Noor, Awais Ahmed

TL;DR: 这篇论文提出了一个以知识图谱为中心的、可复现的评估框架，用于评估医疗健康领域大语言模型在干预导向任务中的表现。该框架包含四个核心组件：一个领域因果知识图谱、一个场景驱动的子图提取步骤、四种不同的模型上下文构建条件，以及一个基于断言标识符的自动化评分流程。研究通过一个心血管领域的试点项目对该框架进行了压力测试。

Details

Motivation: 当前医疗健康领域的大语言模型评估主要关注单一答案的准确性，而忽视了模型在干预、机制、危害、证据和不确定性等方面的推理能力。本文旨在解决这一评估缺口，为医疗决策支持提供一个更全面、更严谨的评估方法。

Result: 在心血管试点项目中，该框架的评估指标面板能够沿着可解释、非冗余的维度有效区分不同条件。其中，整合了知识图谱和因果图的条件C4在因果边F1分数（0.838）、不良反应F1分数（0.833）、证据准确性（0.738）和不支持声明率（0.114）上表现最佳。而没有任何知识基础的条件C1虽然获得了最高的原始干预准确性（0.948），但在因果或证据基础方面没有可测量的表现。

Insight: 论文的核心创新点在于将大语言模型的评估锚定在一个结构化的、可追溯的因果知识图谱上，从而能够系统地评估其干预推理、因果理解和证据支持能力。这为医疗AI的可靠性和可解释性评估提供了一个新颖且可操作的框架，强调了将领域知识与模型评估深度结合的重要性。

Abstract: Large language models (LLMs) are increasingly proposed for healthcare decision support, but their evaluations still reward single-answer accuracy rather than reasoning about interventions, mechanisms, harms, evidence, and uncertainty. We propose a reproducible, graph-centered evaluation framework for intervention-oriented LLM behavior in healthcare and stress-test it in a cardiovascular pilot. The framework has four components: (i) a domain causal knowledge graph in which assertions are first-class, provenance-preserving nodes with stable identifiers; (ii) a scenario-conditioned subgraph extraction step that, given any clinical scenario, retrieves the relevant reified-assertion subgraph; (iii) four controlled grounding conditions that vary how the retrieved subgraph is composed into the model’s context (ungrounded C1, knowledge-graph C2, causal-graph C3, integrated C4); and (iv) an automated scoring pipeline, anchored on assertion identifiers, that computes intervention accuracy, and other evaluation measures on a single pass. To test the framework, we built a category-balanced scenario generator across eight reasoning failure modes and instantiated it on a cardiovascular graph. The metric panel discriminates conditions along interpretable, non-redundant axes: C4 obtains the strongest causal edge F1 (0.838), adverse-effect F1 (0.833), evidence accuracy (0.738), and unsupported claim rate (0.114), while C1 obtains the highest raw intervention accuracy (0.948) with no measurable causal or evidential grounding.

[92] The Price of Thinking: Reasoning Effort as a Model-Specific API Contract cs.AI | cs.CL | cs.CY | cs.LGPDF

Yeabin Moon

TL;DR: 这篇论文研究了AI模型API合同中‘推理努力’条款的实际影响，通过对比Anthropic的Claude 3.5 Sonnet模型在‘明确高努力’合同与‘省略努力’合同下的表现，发现高努力合同平均每次调用成本更高（+$0.01031），但准确率提升不显著（+0.0133），导致每个正确答案的成本更高（$0.08665 vs $0.07662）。

Details

Motivation: 动机是探究API购买中‘推理努力’这一合同条款的实际价值，因为合同不仅指定模型，还包括推理努力、输出限制、服务产品和价格等条款，买家需要了解这些条款对性能和成本的具体影响。

Result: 在30个AIME 2026数学竞赛题目上的实验结果显示，高努力合同相比省略合同，准确率提升不显著（95%置信区间为[-0.0267, +0.0467]），但每次调用成本显著更高，导致每个正确答案的成本从$0.07662增加到$0.08665。

Insight: 创新点在于首次通过预注册、对照实验量化评估了API合同中‘推理努力’条款的性价比，揭示了即使同一模型，合同条款的差异可能导致成本显著增加而性能提升有限，为API消费者提供了实证决策依据。

Abstract: API buyers purchase a dated contract, not a model name alone: the contract includes the requested and served model, reasoning-effort term or its omission, output rail, service product, prompt, and price schedule. We study the reasoning-effort term through a registered paired contrast of Sonnet 5 with explicit high effort against the same model with effort omitted, using 30 AIME 2026 items and five calls per item. Every paid attempt was assigned one frozen terminal category, and inference resampled items while retaining their repeated calls. Mean delivered cost was $0.01031 per call higher under the explicit-high contract than under the omitted contract [+$0.00204, +$0.01974]. The corresponding accuracy contrast was +0.0133 [-0.0267, +0.0467]; we did not detect an accuracy difference, and the interval permits a gain of up to 4.67 percentage points that this design cannot rule out. Cost per correct answer was $0.08665 under the high-effort contract and $0.07662 under the omitted contract, as registered point estimates. A dated contract census, Models-API metadata, and preregistered raw-response probes further documented model-specific omission semantics, including within a provider; claims remained at documentation grade when raw structure was indeterminate. The request registry, parser, terminal taxonomy, statistical plan, and analysis pipeline were frozen before outcomes were examined; the resulting claims are bounded to the model, task, and collection date studied.

eess.IV [Back]

[93] ORViT-DR: Ordinally-Robust Hybrid ViT for Low-Resolution Diabetic Retinopathy Grading eess.IV | cs.CVPDF

Soumit Kumar Kundu, Nabil Ashab, Bidhan Biswas, Shahadat Hossain Sohag, Saif Mahmud Parvez

TL;DR: 本文提出了一种名为ORViT-DR的混合深度学习框架，旨在从低分辨率视网膜图像中改进糖尿病视网膜病变（DR）的分级。该方法结合了卷积特征提取与基于Transformer的全局上下文建模，并采用了包含渐进层解冻、指数移动平均等策略的训练方案。在RetinaMNIST数据集上的实验表明，该方法在分类准确率等指标上取得了有效结果。

Details

Motivation: 糖尿病视网膜病变（DR）是导致视力受损的主要原因之一，其严重程度分级任务天然具有序数结构，相邻类别具有相似的视觉特征。本研究旨在设计一个可靠、自动化的分级系统，以提升低分辨率视网膜图像的DR分级性能。

Result: 在MedMNISTv2数据集的RetinaMNIST官方测试集（包含28x28视网膜眼底图像，分为五个严重等级）上，所提方法取得了57.00%的分类准确率、0.5963的二次加权Kappa分数和0.4293的宏平均F1分数。

Insight: 创新点在于提出了一种结合卷积神经网络（BiT-ResNetv2）与视觉Transformer（ViT）的混合架构（ORViT-DR），专门针对具有序数结构的医学图像分类任务。从客观角度看，其采用的渐进层解冻、层间学习率衰减、指数移动平均参数更新及集成预测等训练策略，对于稳定训练和提升模型性能具有借鉴意义。

Abstract: Diabetic retinopathy (DR) is one of the main causes of impaired vision. A good and reliable automated grading system can make the screening process safer and more accurate. Because DR stages progress gradually, the task of grading disease severity naturally follows an ordinal structure in which neighboring classes share similar visual characteristics. In this study, ORViT-DR, a hybrid deep learning framework, is designed to improve DR grading from low-resolution retinal images. The proposed approach combines convolutional feature extraction with transformer-based global context modeling through a pre-trained ViT-Hybrid backbone, which integrates BiT-ResNetv2 with a Vision Transformer architecture. The approach is tested on the RetinaMNIST subset of the MedMNISTv2 dataset, which contains 28x28 retinal fundus images annotated with five levels of disease severity. To promote stable training and better feature learning, the training strategy applies progressive layer unfreezing, layer-wise learning rate decay, exponential moving average (EMA) parameter updates, and ensemble-based prediction during inference. Experimental results on the official RetinaMNIST test set show that the proposed method achieves 57.00% classification accuracy, along with a quadratic weighted kappa score of 0.5963 and a macro-F1 score of 0.4293. These results suggest that hybrid CNN-Transformer architectures can provide effective representations for ordinal retinal image analysis.

cs.AR [Back]

[94] ETHEREAL: A 25.6-$μ$s/inf. Low-latency Event-driven Graph-neural-network Processor for High-resolution Vision at the Edge cs.AR | cs.CVPDF

Adrian Kneip, Martin Lefebvre, Daniel Gehrig, Victoria Catalán Pastor, Davide Scaramuzza

TL;DR: 本文提出了ETHEREAL，这是首个专为事件驱动图神经网络（EV-GNN）设计的处理器芯片，旨在高效处理动态视觉传感器（DVS）产生的稀疏时空事件流。该芯片通过结合邻居并行样条卷积引擎和创新的分裂2D/3D内存层次结构，实现了低延迟和高能效的推理。

Details

Motivation: 动态视觉传感器（DVS）能以微秒级时间分辨率生成事件，有望实现边缘视觉应用的亚毫秒低延迟目标，但需要能够高效处理稀疏时空事件流的新型算法和硬件后端。尽管事件驱动图神经网络（EV-GNN）在算法侧提供了准确且高效的解决方案，但目前缺乏专用硬件来有效支持其密集规则计算操作和稀疏不规则内存访问的混合需求。

Result: 在先进的DAGr-GNN工作负载和VGA分辨率（640x480像素）的DSEC数据集上，测量结果显示，该芯片实现了25.6微秒的端到端每事件推理延迟和1.6微焦耳的能量消耗。

Insight: 论文的主要创新点在于设计了首个EV-GNN专用处理器芯片ETHEREAL，其核心是邻居并行样条卷积引擎与引入新型时空事件缓存机制的分裂2D/3D内存层次结构的结合，这有效解决了EV-GNN计算与访存的混合需求，为高分辨率边缘视觉提供了硬件支持。

Abstract: Dynamic vision sensors (DVS) are enticing candidates to reach the low-latency, sub-ms target of edge-vision applications, as they generate events with a $μ$s-level time resolution. However, using DVS front ends also calls for novel algorithm/hardware back ends capable of efficiently handling streams of sparse spatiotemporal events. While event-driven graph neural networks (EV-GNNs) have emerged as a solution on the algorithmic side that is both accurate and efficient, there is no dedicated hardware to date capable of efficiently supporting their mixed requirements of dense-regular compute operations and sparse-irregular memory accesses. We therefore introduce ETHEREAL, the first EV-GNN processor chip, capable of bridging this gap by means of a neighbor-parallel spline-convolution engine combined with a split-2D/3D memory hierarchy that introduces a novel spatiotemporal event-caching mechanism. Measurement results demonstrate a 25.6$μ$s latency and a 1.6$μ$J energy per end-to-end event-wise inference on the state-of-the art DAGr-GNN workload and VGA-resolution (640x480 pixels) DSEC dataset.

Table of Contents

cs.CL [Back]

[1] Emotion Across Speech and Faces: Shared Affective Mechanisms in Multimodal Foundation Models cs.CL | eess.AS | eess.IVPDF

[2] Uncertainty-Aware Decision Making in Multimodal Large Language Models cs.CLPDF

[3] Towards Safer RAG: Only Agents Capable of System 2 Thinking may Access Untrusted Documents cs.CLPDF

[4] Can LLMs Reason in a Legally Meaningful Manner? A Small-scale Study on European Court of Human Rights Cases cs.CL | cs.AIPDF

[5] Polaris: Learning to Generate Table Descriptions from Retrieval Feedback cs.CL | cs.DBPDF

[6] Which Source Wins? Task-Dependent Reliance in Vision-Language Models cs.CL | cs.CVPDF

[7] Q-Interference: Memory-Efficient Phase-Aware Quantum-Inspired Attention cs.CLPDF

[8] PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX cs.CL | cs.AIPDF

[9] An Investigation of Translationese in the Generations of Multilingual Large Language Models cs.CLPDF

[10] CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method cs.CL | cs.AIPDF

[11] ArborMem: Navigating Interaction States with Memory Forests cs.CLPDF

[12] Auditing Exposure to Harmful Content on TikTok using Multimodal Language Models: A Cross-National, Age-Stratified Study cs.CLPDF

[13] Write, Execute, Refine: From Skill Followers to Skill Optimizers via Reinforcement Learning from Execution Feedback cs.CLPDF

[14] Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges cs.CL | cs.AI | cs.SDPDF

[15] Thinking in a Low-Resource Language: What SFT Builds, What RL Fixes, What Accuracy Cannot See cs.CL | cs.LG | cs.RO | stat.MLPDF

[16] TraceSQL: Traceable Answerability Estimation for Reference-Free Text-to-SQL Verification cs.CLPDF

[17] Interpretable Humans, Alien LLMs: Expert Analysis of Latent Structures in Assessment Responses cs.CL | cs.AI | cs.HCPDF

[18] Encoded but Not Actionable: Auditing the Decode-Generate-Steer Gap in Frozen LLMs for Geometric Constraints cs.CL | cs.AIPDF

[19] BEAR-Bench: A Bilingual Enterprise and Academic Reasoning Benchmark for Multimodal Models cs.CL | cs.AIPDF

[20] CABLE: Extending the Reach of Memory Retrieval via Complementary Antecedent-Based Linking and Expansion cs.CLPDF

[21] SpeechSense: A Paralinguistic-Focused Dataset for Fine-Grained Speech Sentiment Analysis cs.CL | cs.MM | cs.SDPDF

[22] Grading Needs a Rubric, Not Intelligence cs.CL | cs.AIPDF

[23] Do Large Language Models Play Six Degrees of Separation? Measuring Topological Compression in Long-Context Manifolds cs.CLPDF

[24] The IOL-AI Challenge: An Open Challenge towards Advancing Linguistic Reasoning cs.CLPDF

[25] TokEval: A Tokenizer Evaluation Suite cs.CL | cs.LGPDF

cs.CV [Back]

[26] YILDIZ-VPR: A Novel Dataset with Dense Coverage Under Diverse Environmental Conditions for Visual Place Recognition cs.CV | cs.AIPDF

[27] AerialYield-B2D: A Greenhouse Blueberry Dataset with Five-Stage Ripeness Masks and Fruit Counts cs.CV | eess.IVPDF

[28] The 10th AI City Challenge cs.CV | cs.AIPDF

[29] Inference-Time Attention Steering for Vision-Language-Action Driving Models cs.CVPDF

[30] OV3D-Bench: A Diagnostic Benchmark for Open-Vocabulary Monocular 3D Detection cs.CVPDF

[31] Lymphocyte Mimicry Correction via Region-Level Tissue Reasoning and Unbalanced Optimal Transport cs.CV | cs.LGPDF

[32] PROBE: Manipulation-Grounded Visual Question Answering with VLM Agents cs.CV | cs.ROPDF

[33] Rapid Debris-Volume Estimation from Post-Hurricane Aerial Imagery cs.CV | eess.IVPDF

[34] Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking cs.CVPDF

[35] Mask What Matters: Saliency-Guided Video Self-Supervised Learning for Autonomous Driving cs.CVPDF

[36] Key-Frame Reasoning with SAM3: Third Place Solution for the MeViS-Text Track of the 8th LSVOS Challenge cs.CVPDF

[37] Structural Plan-to-Model Conversion with Deterministic Geometry and Guarded Agentic Vision-Language Refinement cs.CV | cs.AIPDF

[38] Learning What Not to Learn: Adversarial Disentangled Prompt Tuning for Robust Vision-Language Models cs.CV | cs.AIPDF

[39] UniQuery4R: Unified 4D Scene Reconstruction from a Single Query cs.CVPDF

[40] Scanline-Aware Animatable Gaussian Avatars from Rolling-Shutter Videos cs.CVPDF

[41] If, Then, Otherwise: Diagnosing Conditional Branching in Vision-Language Navigation cs.CV | cs.ROPDF

[42] MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection cs.CVPDF

[43] Learning latent progression states from spatial heterogeneity in uterine histopathology cs.CV | cs.ETPDF

[44] Primitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofing cs.CVPDF

[45] Continuity-Driven Representation Learning for Industrial Defect Detection cs.CVPDF

[46] GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly cs.CVPDF

[47] MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding cs.CVPDF

[48] REChart: Reasoning-Efficient Chart Editing with Large Reasoning Models cs.CV | cs.PLPDF

[49] Spectral Gradient Orthogonalization Improves Differentially Private Training at Scale cs.CVPDF

[50] SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering cs.CVPDF

[51] TEAMS: Text-prompted spatiotEmporal dual-heAd Mamba Snake cs.CVPDF

[52] TF-CADE: Foreground-Concentrated Text-Video Alignment for Zero-Shot Temporal Action Detection cs.CVPDF

[53] GSToken: Geometry-Structured Gaussian Tokens for Compact 3D Medical Image Representation cs.CVPDF

[54] SemComp-Bench: Benchmarking Semantic Task Completion in Video Generation cs.CV | cs.AIPDF

[55] Counterfactual Anatomy-guided Spatial-Temporal Decoding for Annotation-Free Hallucination Mitigation in Medical VLMs cs.CVPDF

[56] NGS-Marker: Robust Native Watermarking for 3D Gaussian Splatting cs.CVPDF

[57] S$^3$AM: A Single-Stream SAM with Reliability-Calibrated Frequency Adapter for Multi-modal Salient Object Detection cs.CVPDF

[58] SE-MoLoRA: Shared-Expert LoRA Adapters for Domain-Specific Photographic Assessment cs.CV | cs.MMPDF

[59] Looking Beyond the Scale: Do Surgical Skill Models Learn Transferable Representations Across Assessment Rubrics? cs.CV | cs.LGPDF

[60] Explainable AI-Powered Framework for Video-Based Skill Assessment in Cataract Surgery cs.CV | cs.AIPDF

[61] BrainNorm: A Foundation Model that knows Normal via Semantic Atlas Pretraining cs.CVPDF

[62] GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting cs.CVPDF

[63] Code as Representation: A Compilable Parsing Paradigm for Academic Documents cs.CV | cs.CLPDF

[64] Leveraging existing sparse point annotations for benthic imagery dense segmentation cs.CV | cs.LGPDF

[65] MSEditor: Toward Consistent Multi-Shot Video Editing cs.CVPDF

[66] Where a New Concept Must Enter: Entry Point Gates Cross-Task Usability in Unified Multimodal Models cs.CV | cs.AIPDF

[67] CoinVE-200K: A Large-Scale High-Quality Dataset for Compositional Instruction-Guided Video Editing cs.CVPDF

[68] PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contexts cs.CVPDF

[69] Denoised Variance-Based Pruning with Optimal Brain Bias Compensation cs.CVPDF

[70] RetiWave-Mamba: A Dual-Stream Network for Retinal Disease Detection based on Multi-scale Context and Frequency-Adaptive Mamba Projection cs.CVPDF

[71] Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Models cs.CVPDF

[72] MaLViL: Multi-axis Low-rank Vision-LSTM for Medical Image Segmentation cs.CVPDF

[73] Vision-Language Models for Analog Gauge Reading: An Empirical Study of Specialization, Transfer and Reliability cs.CVPDF

[74] Evaluation of AI-based Visual Crack Detection in Steel Bridges Using Probability of Detection cs.CVPDF

[75] GenRec: Knowing Where to Reconstruct and Where to Generate cs.CVPDF

[76] Improving Complex Moiré Removal with Generative Supervision cs.CVPDF

[77] CFB-GBM v2.0: An Augmented Longitudinal Dataset for Multi-Modal Glioblastoma Segmentation, Radiomics, and RANO Progression Tracking cs.CVPDF