Table of Contents
- cs.CL [Total: 30]
- cs.CV [Total: 75]
- cs.SD [Total: 2]
- cs.IR [Total: 1]
- cs.SE [Total: 1]
- eess.AS [Total: 1]
- cs.AI [Total: 4]
- cs.MM [Total: 3]
- cs.LG [Total: 8]
- cs.CR [Total: 4]
- cs.RO [Total: 4]
- cs.DB [Total: 1]
cs.CL [Back]
[1] MemArena: An Ego-Centric Benchmark for On-Device Agentic Personal Memory Assistants at Scale cs.CL | cs.AI | cs.LG | cs.MAPDF
Jiadong Zhang, Xiaosong Ma
TL;DR: MemArena是一个用于评估设备端个人记忆助手的以自我为中心的基准测试，它通过MASim代理模拟器构建了一个包含50个代理、持续15天的单世界对话环境，生成了大规模交互历史和六维评估真值。论文评估了五种开放权重模型与不同记忆后端组合的性能，发现记忆后端选择对内容准确性影响巨大，权限感知访问普遍失败，而搜索延迟在大多数情况下影响较小。
Details
Motivation: 现有记忆基准测试在活动密集交互、自我中心视角和连贯多会话世界组合方面测试不足，无法满足边缘部署的个人记忆助手需在设备端处理私人对话的需求。
Result: 在MemArena基准上评估发现：记忆后端选择对内容准确性影响最大（如Qwen3-0.6B模型上Memobase到MemSearch提升32.5/19.2个百分点）；权限感知访问普遍失败；在Spark GB10边缘节点上，记忆搜索增加的延迟（87/7/48毫秒）对大多数读取器-后端组合的总首字节时间影响较小。
Insight: 创新点在于构建了大规模、以自我为中心、活动密集的单世界对话基准测试（MemArena）及其配套模拟器（MASim），并系统评估了记忆后端对开放权重模型性能的影响，揭示了后端选择比模型缩放更关键、以及当前权限控制机制存在普遍缺陷等洞见。
Abstract: Edge-deployed personal memory assistants must handle private interpersonal conversations on-device with open-weight models. Yet, existing memory benchmarks often under-test the combination of activity-dense interaction, ego-centric perspective, and coherent multi-session worlds. MemArena fills these gaps with a single-world conversational benchmark built with its MASim agent simulator, for 50 agents over 15 days (10.3M dialog-text tokens, 24.1K text-only ego-observed tokens/agent/day). With the interaction history, it co-generates ground truth over six recall, reasoning, and trustworthiness evaluation dimensions. We evaluate five open-weight readers with Vanilla context, BM25-RAG, Oracle retrieval, Memobase, and MemSearch as memory backends. Three results stand out: (1) Memory-backend choice matters more for content accuracy: At Qwen3-0.6B, Memobase-to-MemSearch gains +32.5/+19.2 pp, exceeding MemSearch reader scaling (+10.6/+6.8 pp). (2) Permission-aware access fails universally, with Oracle leaking heavily and other backends too timid to disclose. (3) Search latency bites only at very small reader: on a Spark GB10 edge node, memory-search adds a moderate and fixed 87/7/48 ms (BM25-RAG/Memobase/MemSearch) that composes a small part of TTFT for most reader-backend combinations. Code, the MASim simulator, and the MemArena-L benchmark will be released upon acceptance.
[2] OncoTriad-QA: A Patient-Level Radiology-Pathology-Genomics Benchmark for Pan-Cancer Reasoning cs.CL | cs.AIPDF
Ahnaf Munir, Dannong Wang, Michael W. McDonald, Mubarak Shah, Pegah Khosravi
TL;DR: 本文提出了OncoTriad-QA，一个用于泛癌推理的患者级放射学-病理学-基因组学基准数据集，以及一个参考多模态模型OncoVLM。该基准包含来自TCGA的9,281个患者案例的8.61万个语义问题，整合了CT/MRI影像、全切片组织病理学、体细胞突变、拷贝数变异、DNA甲基化、RNA测序和临床元数据。实验表明，现有模型在需要整合多模态证据的全面泛癌问答上能力有限，而经过微调的OncoVLM在多项指标上超越了现有医学模型。
Details
Motivation: 当前大多数医学大语言模型和视觉语言模型基准只关注单一模态或狭窄的图文任务，缺乏对跨多个证据流（放射学、病理学、基因组学）的患者级肿瘤学综合评估的测试。
Result: 在OncoTriad-QA基准上，经过微调的OncoVLM在使用多选题准确率和BERTScore-F1指标时，平均超过MedGemma-4B模型10.7个百分点，在仅放射学、仅病理学和所有可用模态设置下的多项选择题和开放式问题中均取得了一致的性能提升。
Insight: 论文的主要创新点在于构建了一个大规模、多模态、患者级的肿瘤学问答基准，并通过一个基于源数据的LLM辅助标注流程确保数据质量。提出的OncoVLM模型通过学习的投影器将不同模态的原生证据映射到LLM接口，为整合多模态医学证据进行综合推理提供了有效框架。
Abstract: Cancer diagnosis and characterization require integrating complementary evidence from radiology, pathology, genomics, and clinical metadata. However, most medical large language model (LLM) and vision-language model (VLM) benchmarks focus on isolated modalities or narrow image-text tasks, leaving patient-level oncology assessment across multiple evidence streams largely untested. We introduce OncoTriad-QA, a patient-level radiology-pathology-genomics benchmark for pan-cancer question answering. OncoTriad-QA contains 86.1k semantic questions across 9,281 TCGA patient cases from 32 cancer cohorts, aligning CT/MRI radiology, whole-slide histopathology, somatic mutations, copy-number alterations, DNA methylation, bulk RNA-seq, and clinical metadata. Case-specific annotations are constructed through a source-grounded LLM-assisted pipeline using curated labels, diagnostic reports, molecular profiles, and modality-derived evidence as primary sources of truth, with automated consistency checks and clinician review. We also introduce OncoVLM, a reference multimodal model that maps modality-native radiology, pathology, DNA methylation, and RNA-seq evidence into an LLM interface through learned projectors. Experiments show that existing general-purpose and medical LLMs remain limited on comprehensive pan-cancer QA, especially when questions require integrating imaging findings, tumor morphology, and molecular evidence. After fine-tuning on OncoTriad-QA, OncoVLM exceeds MedGemma-4B by an average of 10.7 points when using MCQ accuracy and BERTScore-F1, with consistent gains across multiple-choice and open-ended questions under radiology-only, pathology-only, and all-available settings. These results demonstrate the benchmark’s value for training and evaluating models for integrated cancer question answering.
[3] Knowing the Form, Not the Function: Automatically Auditing Answer–Authority Decoupling in Legal Benchmarks cs.CL | cs.AIPDF
Hsien-Jyh Liao
TL;DR: 本文研究了法律基准测试中模型答案正确性与法律依据引用之间的脱钩问题，发现仅评估答案正确性会掩盖模型未能引用正确法律条文的情况，并提出了自动联合审计答案与法律依据的方法。
Details
Motivation: 动机在于探究法律基准测试中答案正确性能否作为法律依据引用的代理指标，揭示仅评分最终答案可能忽略模型未正确引用权威法律条文的问题。
Result: 在台湾律师考试238个项目中，四个大语言模型在未要求引用法条的情况下自发产生权威标记，刑法领域有24.0-42.4%的正确答案未引用正确法条，而15.2-21.7%的错误答案却引用了正确法条，展示了答案与引用行为在输出层面的分离。
Insight: 创新点在于提出自动联合审计答案正确性与法律依据引用的方法，利用法律条文的结构化可提取性和外部可验证性，为基于法条的法律基准测试提供了更全面的评估框架，并初步扩展到中国大陆民法领域验证了跨法域的适用性。
Abstract: Legal benchmarks typically score final answers even when models also state legal authority. We test whether answer correctness can serve as a proxy for authority grounding. Under ordinary reasoning prompts that did not request statutory citations, four LLMs spontaneously produced authority markers across 238 Taiwan bar-examination items. Because each item has a verified governing provision, we automatically audit answer correctness and authority grounding jointly. The two dimensions dissociate in both directions. In criminal law, 24.0–42.4% of valid responses were answer-correct but missed the gold authority, while 15.2–21.7% were answer-incorrect but cited it. A separate statutory-retrieval probe and a permissive citation-abstention intervention further show that answer and citation behavior can move separately at the output level. Because this mismatch arises without adversarial or inconsistency-inducing prompting, answer-only scoring treats naturally occurring gold-authority misses as complete benchmark successes. Because statutory authority is structurally extractable and externally verifiable, the failure can be measured automatically. A preliminary PRC civil-law extension also observes citation-unrequested authority marking, motivating a full cross-jurisdictional joint audit. We therefore propose joint answer–authority evaluation for statute-grounded legal benchmarks.
[4] Crayotter: Learning Long-Horizon Video Editing Agents via Group-Relative Preference Backpropagation cs.CL | cs.LGPDF
Lecheng Yan, Jianze Lin, Yichong Zhang, Ben Pan, Wenxi Li
TL;DR: 本文提出了Crayotter，一种通过组相对偏好反向传播（GRPB）学习长视野视频编辑智能体的方法。该方法将主观的编辑质量评估转化为同任务内的序数比较，并通过零和优势分配将信用传播到语义编辑片段，以解决长视野决策中反馈延迟和主观性的问题。
Details
Motivation: 长视野视频编辑智能体在做出许多相互依赖的决策后，只能获得最终产品的反馈。编辑质量是主观的，允许多种有效解决方案，且在不同异构请求间难以校准，使得全局标量目标既模糊又缺乏时序信息。
Result: 在手动构建的、项目无关且按视野分层的一系列真实编辑任务上进行训练和评估，GRPB方法在匹配基线、信用干预、外部基准测试和盲测人工评估中，均改善了编辑行为和渲染结果。由此得到的90亿参数Crayotter模型在AgenticVBench上超越了多个专有系统。
Insight: 核心创新点在于将主观、延迟的全局反馈，通过组内序数比较转化为零和优势，并利用有界的信用反向传播机制（GRPB）来指导学习。这为从主观、延迟结果中学习提供了一种实用的任务局部偏好约简方法，并通过滞后分配器和保护传输机制避免了不可靠估计对同组轨迹的直接影响。
Abstract: Long-horizon video editing agents receive final-product feedback only after many interdependent decisions. Yet editing quality is subjective, admits multiple valid solutions, and is not meaningfully calibrated across heterogeneous requests, making a global scalar objective both ambiguous and temporally uninformative. Our key observation is that fixing the request, materials, and production constraints converts this subjective objective into an ordinal comparison among directly comparable alternatives. We introduce Group-Relative Preference Backpropagation (GRPB), which transforms same-task rankings into zero-sum advantages and redistributes them as bounded credit over semantic editing segments. A lagged allocator and guarded transmission prevent current judgments or unreliable estimates from directly shaping the same rollout group. We manually construct a project-disjoint, horizon-stratified suite of realistic editing tasks for training and controlled evaluation. Across matched baselines, credit interventions, external benchmarking, and blinded human evaluation, GRPB improves both editing behavior and rendered products. The resulting 9B Crayotter model surpasses several proprietary systems on AgenticVBench, supporting task-local preference reduction as a practical approach to learning from subjective, delayed outcomes. Code and all supporting materials are publicly available at https://github.com/idwts/Crayotter.
[5] BODHI: Do LLMs Branch Out and Discover Heterogeneous Inferences? cs.CL | cs.AIPDF
Soumadeep Saha, Krish Sharma, Akshay Chaturvedi, Nicholas Asher
TL;DR: 本文通过迷宫求解实验和基于语义等价性的数学推理轨迹树（BODHI-Trees）分析，研究了经过可验证奖励强化学习（RLVR）训练的大语言模型在测试时的探索本质。研究发现，RLVR虽然提高了模型对环境约束的遵循和回溯能力，但显著减少了语义分支熵，限制了推理路径的多样性，这可能是其样本效率提升的原因。
Details
Motivation: 旨在探究RLVR训练是扩展了大语言模型的推理能力边界，还是仅仅提高了采样效率，并区分风格变化产生的熵与真正的推理分支。
Result: 研究结果表明，RLVR模型观察到的策略熵崩溃不仅仅是句法上的，还伴随着语义分支熵的显著减少。RLVR提高了对约束的遵循和回溯能力，但限制了延续路径的空间。
Insight: 创新点在于提出BODHI-Trees方法，基于语义等价性从推理轨迹中提取树结构，以量化分析推理多样性。客观来看，该方法为评估LLM的推理探索行为提供了新的分析框架，揭示了RLVR在提升效率与限制多样性之间的权衡。
Abstract: Although reinforcement learning with verifiable rewards (RLVR) has improved the performance of large language models (LLMs) across a variety of reasoning tasks, there is significant debate as to whether RLVR expands the reasoning capability boundary, or just improves sampling efficiency. In this paper, we investigate the nature of test-time exploration in RLVR-trained LLMs by employing controlled maze-solving experiments and extracting a tree structure from mathematical reasoning traces (BODHI-Trees) based on semantic equivalence. This helps us delineate between entropy arising from stylistic variations and genuine inferential branching. Our findings demonstrate that the policy entropy collapse observed in RLVR models is not merely syntactic, and is accompanied by a significant reduction in semantic branching entropy. While RLVR improves adherence to environmental constraints and backtracking capabilities, it constricts the space of continuations; we provide evidence suggesting that this might be responsible for the sample efficiency gains of RLVR, albeit at the cost of genuine rollout diversity.
[6] FLARE: Few-shot Learning-based Adaptive Reflective Engine cs.CLPDF
Dhanasekar Sundararaman, Bharat Gandhi, Aashna Garg, Minjie Li
TL;DR: 本文提出了FLARE框架，一种基于少样本学习的自适应反射引擎，用于优化大型语言模型的提示指令。该方法结合了先进的反射机制和少量参考示例，在多个基准测试中超越了当前最先进的GEPA优化器，并在数据效率和稳定性方面表现出显著优势。
Details
Motivation: 针对复杂复合AI系统中提示质量对性能的关键影响，作者挑战了当前认为反射指令演化优于传统强化学习和少样本优化的主流观点，旨在通过少样本学习策略更有效地优化指令。
Result: 在检索增强推理（HotPotQA、MedQA、2WikiMultiHopQA）、工具调用和多标签情感分类（GoEmotions）等多个基准测试中，使用GPT-5系列模型评估，FLARE在所有任务-模型对上均优于GEPA，例如在HotPotQA上获得最高+14.2分提升，在工具调用上达到87.0%准确率，在GoEmotions上F1分数提升至52.7%。
Insight: 创新点在于将少样本学习与自适应反射机制相结合进行指令优化，实现了更高的性能和数据效率；客观来看，该方法强调了少样本学习策略在下一代LLM潜力挖掘中的关键作用，为提示工程提供了新方向。
Abstract: Large language models (LLMs) are increasingly deployed in complex, compound AI systems where performance hinges on the quality of prompts. Recent state-of-the-art optimizers like GEPA (Genetic-Pareto) have argued that reflective instruction evolution can outperform traditional reinforcement learning and few-shot optimization. In this work, we challenge this shift by introducing FLARE (Few-shot Learning-based Adaptive Reflective Engine), a framework that leverages advanced reflective mechanisms and a small set of few-shot reference examples to optimize instructions. We evaluate our method across a diverse suite of benchmarks – spanning retrieval-augmented reasoning (HotPotQA, MedQA, 2WikiMultiHopQA), tool calling, and multi-label emotion classification (GoEmotions) – using the GPT-5 series of models. Our results demonstrate that FLARE consistently outperforms GEPA, winning on every task-model pair: it achieves gains of up to +14.2 points on HotPotQA (52.2 vs. GEPA’s 42.2 with GPT-5-Chat), reaches 87.0% on tool calling (vs. 81.0% for GEPA), and lifts GoEmotions micro-F1 to 52.7% (+15.3) with GPT-5.1 on the full 5408-example test split, more than doubling GEPA’s +5.7 gain. Beyond raw accuracy, FLARE is also strikingly data-efficient: on GoEmotions it reaches its peak performance using as few as 100 validation examples, while remaining markedly more stable across random seeds than GEPA. Our findings suggest that while reflective instructions are powerful, the strategic optimization of few-shot learning remains a critical frontier for maximizing the potential of next-generation LLMs.
[7] Aligned in Form, Not in Meaning: The Comprehension - Containment Decoupling of LLM Safety in Low-Resource Bangla Derogatory Speech cs.CLPDF
Shadab Bin Habib, A K M Ferdous Reza Habib, Subarno Neel, Adib Sakhawat
TL;DR: 本文审计了五个前沿大语言模型在低资源孟加拉语贬损性言论上的安全性表现，提出了‘理解-遏制脱钩’假设，即模型的安全对齐更关注高资源语言的表面形式而非有害含义，导致模型对低资源语言侮辱性内容的理解能力和遏制能力相互独立。实验通过六种协议验证了这一假设，并发现显式思维链推理能提升理解但破坏遏制，专家角色设定会大幅降低拒绝率，表明基于关键词的过滤机制完全忽略了非人化的群体性侮辱。
Details
Motivation: 研究动机是检验当前大语言模型的安全对齐机制是否真正基于有害含义，还是仅仅依赖于高资源语言的表面形式，从而在低资源语言（如孟加拉语）的贬损性言论上出现理解与安全遏制能力的脱钩问题。
Result: 在人类校准基线（kappa = 0.84）上，模型在孟加拉语上表现出7.92个百分点的理解缺陷，同时在两种语言中保持相同的92.83%的令牌泄漏率。显式思维链推理将理解率提升至94.72%（通过率），但系统性地瓦解了遏制能力（使用率达96.23%）。专家角色设定下，模型的拒绝率崩溃至6.57%。
Insight: 创新点在于提出了‘理解-遏制脱钩’概念，并通过多协议审计揭示了当前安全对齐对低资源语言含义的忽视。关键发现是，高资源基准无法保证低资源安全性，安全遏制必须基于含义（meaning-grounded），而非表面形式或令牌化特征，这为跨语言模型安全评估提供了新的视角和方法论警示。
Abstract: We audit five frontier large language models on native Bangla derogatory speech (gali) across six protocols to test a single hypothesis: Comprehension-Containment Decoupling. We propose that contemporary safety alignment is bound to high-resource surface forms rather than harmful meaning, causing a model’s capacity to comprehend a low-resource slur and its capacity to contain it to operate independently. Every protocol corroborates this hypothesis against a human-calibrated baseline (kappa = 0.84). At baseline, models exhibit a 7.92 percentage point comprehension deficit in Bangla while maintaining an identical 92.83% token leakage rate across both languages. Severity calibration tracks surface anatomical cues over compositional harm (+4.00 error on mild slang; -2.00 on threats), while apparent containment gains under orthographic perturbation prove to be a tokenizer-driven “containment mirage.” Crucially, explicit Chain-of-Thought reasoning rescues comprehension (94.72% Pass) while systematically dismantling containment (96.23% Use). Furthermore, expert-persona framing collapses refusal to 6.57%, revealing that keyword-based filters ignore dehumanizing communal slurs entirely. Our findings demonstrate that high-resource benchmarks cannot certify low-resource safety, necessitating meaning-grounded containment.
[8] OPTD: On-Policy Transition Distillation with Consistency-Guided Adaptive Compression for Few-Step Diffusion Language Models cs.CLPDF
Xiaocheng Lu, Hualei Zhang, Shuhan Guo, Jie Zhang, Xiaoyi Pang
TL;DR: 本文提出OPTD方法，一种基于一致性引导自适应压缩的在线策略转移蒸馏技术，用于加速扩散语言模型的推理过程。该方法通过从学生模型自身轨迹中采样部分状态，利用冻结的仅问题教师模型识别结果对齐的未来候选，并选择最长前缀以保持教师模型展开结果，从而在多个数学推理和代码生成基准上实现了质量与效率的最佳权衡。
Details
Motivation: 现有少步蒸馏方法在离线策略轨迹上构建监督，导致推理时学生模型的早期并行承诺改变后续预测的上下文，状态漂移问题在压缩最激进时尤为严重。在线策略蒸馏虽能缓解此不匹配，但未解决每个转移应推进多远的问题：仅匹配教师的下一个动作会限制压缩，而无差别合并未来动作可能违反中间依赖。
Result: 在四个数学推理和代码生成基准测试中，OPTD一致改善了质量-效率权衡，并在评估的少步基线中获得了最强的整体质量约束AUP（Area Under the Performance curve）。
Insight: 创新点在于提出一致性引导的自适应压缩机制，通过冻结教师模型识别结果对齐的候选并排序，选择最长前缀以保持展开结果，同时使用集合瓶颈目标提升验证候选的解码阈值，并以冻结教师KL锚正则化其他活跃位置，无需黄金响应即可构建目标和训练。
Abstract: Diffusion language models (dLLMs) can predict many tokens in parallel, but accurate generation still requires many iterative denoising steps. Few-step distillation accelerates decoding by compressing multiple teacher steps into a single student transition. However, existing methods construct supervision on off-policy trajectories. At inference, the student’s early parallel commitments alter the context of later predictions, so the states it actually visits drift away from the supervised ones–precisely when step compression is most aggressive. On-policy distillation is a natural remedy for this mismatch, but it leaves open how far each transition should advance: matching only the teacher’s next action limits compression, while indiscriminately merging future actions can violate intermediate dependencies. To address this limitation, we propose OPTD, On-Policy Transition Distillation with consistency-guided adaptive compression. It samples partial states from the few-step student’s own trajectories, uses a frozen, question-only teacher to identify outcome-aligned future candidates, and orders them by current-state confidence. The method then selects the longest prefix whose joint commitment preserves the teacher’s rollout outcome. A set-bottleneck objective promotes every verified future candidate to the decoder’s release threshold, while a frozen-teacher KL anchor regularizes all other active positions. Neither target construction nor training uses a gold response. Across four mathematical reasoning and code-generation benchmarks, OPTD consistently improves the quality–efficiency trade-off and attains the strongest overall quality-constrained AUP among the evaluated few-step baselines.
[9] TQLite: Multi-LLM Jury Guided Distillation for Real-time MQM Translation Quality Evaluation cs.CL | cs.AI | cs.LGPDF
Bhavin Jawade, Cameron R. Wolfe
TL;DR: 本文提出了TQLite，一种新颖的蒸馏框架，旨在解决大规模部署大型语言模型（LLM）和大推理模型（LRM）进行MQM翻译质量评估时计算成本高昂的问题。该框架利用多LRM评审团生成高质量合成训练数据，并通过数据整理和聚合技术，使小型语言模型（SLM）能够逼近最佳LRM评估器的性能，从而提供一种可扩展且经济高效的替代方案。
Details
Motivation: LLM和LRM在基于MQM的翻译质量评估中表现出色，但大规模部署计算成本高昂；而SLM虽然高效，却难以胜任评估任务所需的复杂推理。因此，需要一种方法能让SLM达到接近LRM的评估性能，以解决可扩展性挑战。
Result: 通过广泛的实证研究，对SLM、LLM和LRM在各种TQ评估设置中进行基准测试。结果表明，经TQLite训练的SLM在MQM评估性能上远超标准SLM的现成评估能力，为基于LLM和LRM的评估器提供了可扩展且经济高效的替代方案。
Insight: 创新点在于提出了一种利用多模型评审团生成高质量合成训练数据的蒸馏框架，并通过数据整理和响应聚合技术提升SLM的评估能力。从客观角度看，该方法将模型集成与知识蒸馏相结合，为在资源受限环境下部署高性能评估模型提供了新思路。
Abstract: Large language models (LLMs) have demonstrated impressive performance in MQM-based translation quality (TQ) evaluation, and recent advances in large reasoning models (LRMs) promise even greater improvements. However, both LLMs and LRMs are computationally expensive to deploy at scale, while small language models (SLMs)—though much more efficient—struggle with the complex reasoning required for evaluation tasks. In this work, we present an extensive empirical study benchmarking SLMs, LLMs, and LRMs across a wide range of TQ evaluation setups, providing a comprehensive view of the current landscape and establishing best practices. To address the scalability challenge, we introduce TQLite, a novel distillation framework that enables SLMs to approach the MQM evaluation performance of the best LRM-based evaluators. Our approach leverages a multi-LRM jury to generate high-quality synthetic training data via practical data curation techniques and aggregation of evaluation responses across a diverse panel of models. Our results demonstrate that SLMs trained via TQLite achieve strong MQM evaluation performance that far exceeds off-the-shelf evaluation capabilities of standard SLMs, offering a scalable and cost-effective alternative to LLM- and LRM-based evaluators.
[10] Language Models Encode the Contextual Truth of Propositions cs.CLPDF
Rupak Sarkar, Pritika Ramu, Rachel Rudinger
TL;DR: 该论文研究了大型语言模型（LLMs）如何编码命题的上下文真实性，即其真实性由上下文证据而非世界知识决定。研究发现，LLMs在激活空间中维持着关于上下文真实性的线性表示，这种表示在不同输出策略中持续存在，并且可以通过干预实验进行因果验证。通过分析一个需要共享共识的协作视觉语言任务，论文进一步表明，模型对命题真实性的表示会受到合作伙伴断言的影响，即使模型自身已有足够证据确定其真假，且接近决策边界的命题更容易被影响。
Details
Motivation: 先前研究表明LLMs在激活空间中沿线性方向编码事实性命题的真实性，但尚不清楚这种表示如何扩展到上下文真实性（即真实性由上下文证据决定的命题）。本文旨在探究LLMs是否以及如何编码和维持这种上下文真实性的内部表示。
Result: 研究通过干预实验提供了因果证据，表明LLMs确实维持着上下文真实性的线性表示。在协作任务中，模型对命题真实性的表示会显著受到合作伙伴断言的影响，且接近决策边界的命题更容易被改变。研究还区分了两种无法仅通过输出行为识别的谄媚形式。
Insight: 创新点在于揭示了LLMs内部对上下文真实性的线性表示及其与输出策略的分离，并展示了这种表示如何受到社会互动（如合作伙伴断言）的影响。这为理解模型内部表示与社会一致性行为（如谄媚）之间的关系提供了新的视角，并提出了通过分析内部表示而非仅依赖输出来区分不同谄媚形式的方法。
Abstract: Prior work has shown that LLMs encode the truth of factual propositions along linear directions in activation space. It’s unclear how these representations extend to contextual truth: propositions whose truth is determined by in-context evidence rather than world knowledge. We show that LLMs maintain a linear representation of contextual truth that persists across structurally different output policies, even when the output doesn’t require the model to determine a proposition’s truth, and show causal evidence via steering experiments. Using the transcripts from a collaborative vision-language task that requires two LLMs to maintain a shared common ground, we show that truth representations of a proposition are significantly swayed by partner assertions about that proposition, even when the LLM has enough evidence to determine its truth. We find evidence that propositions near the decision boundary are more susceptible to having their truth shifted through partner assertions. Separating representation from output distinguish two forms of sycophancy that output behavior alone cannot: the model may accommodate a false proposition while continuing to represent it as false, or shift its representation across the boundary. The latter is 2.59x more common when the model agrees by restating the false claim explicitly than when it agrees implicitly.
[11] Beyond Accuracy: A Multidimensional Evaluation of Statistical Reasoning in Large Language Models cs.CL | stat.APPDF
Monnie McGee, Mateo Langston Smith, Julian Cabrera
TL;DR: 本研究提出了一种超越准确率的多维评估框架，用于评估大语言模型在统计推理任务中的表现。该框架结合了响应准确率、响应行为、结构主题建模和词汇相似性分析，并应用于15个当前主流大语言模型对90个从高中到研究生级别统计学考试题目的解释生成任务。
Details
Motivation: 当前对大语言模型的评估通常只关注回答准确率，而忽视了模型如何构建和交流统计解释这一多维过程。本研究旨在通过更全面的评估方法来弥补这一不足。
Result: 模型准确率在55%到78%之间差异显著。结构主题建模揭示了所有模型在统计推理概念组织上的共性，而词汇相似性分析则发现了由同一供应商（如Anthropic、OpenAI）开发的模型在解释风格上存在轻微但一致的特定差异。
Insight: 创新点在于提出了一个结合多种分析技术的多维评估框架，证明了仅凭准确率无法全面刻画当代大语言模型的统计推理能力。该框架通过分析响应行为和模型生成的解释，为生成式AI的统计推理能力提供了更全面的评估视角。
Abstract: Statistical reasoning is multidimensional, yet evaluations of large language models (LLMs) typically emphasize response accuracy while overlooking how models construct and communicate statistical explanations. This study demonstrates the value of a multidimensional evaluation by combining response accuracy, response behavior, structural topic modeling, and lexical similarity analysis. The framework is applied to explanations generated by 15 current-generation LLMs responding to 90 questions drawn from four statistics examinations spanning high school, undergraduate, and graduate levels. Accuracy varied substantially across models, ranging from 55% to 78%. In contrast, structural topic modeling revealed a common conceptual organization of statistical reasoning across all models, while lexical similarity analysis identified modest but consistent vendor-specific differences in explanatory style. Models developed by the same vendor (e.g. Anthropic, OpenAI) produced explanations that were slightly more similar than models from different vendors. These findings demonstrate that statistical reasoning in contemporary LLMs cannot be characterized by accuracy alone and illustrate how complementary analyses of response behavior and model-generated explanations provide a more comprehensive evaluation of statistical reasoning in generative AI.
[12] PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory cs.CL | cs.AIPDF
Dawei Liu, Haixu Song, Shuang Cheng, Shijie Wang, Haozheng Hou
TL;DR: 本文提出了PI-Mem（并行迭代记忆）机制，以解决大语言模型在长上下文推理中面临的挑战。该方法通过并行处理所有文本块，并在有限轮次内迭代精炼一个共享记忆，从而避免传统顺序方法的信息覆盖问题并提升效率。在HotpotQA基准测试中，该方法在高达360万令牌的上下文长度下，在准确性和推理速度上均显著超越了循环记忆基线。
Details
Motivation: 长上下文推理是大语言模型的关键瓶颈，现有循环记忆方法存在两个固有挑战：顺序分块更新可能导致早期关键证据被后期无关内容覆盖，以及串行的分块间依赖限制了并行性并导致延迟随上下文长度增加。
Result: 在HotpotQA基准测试中，使用Qwen3.5-35B-A3B和Qwen2.5-7B模型，上下文长度高达360万令牌，PI-Mem相比循环记忆基线在准确率上分别绝对提升了6.25和7.81个百分点，同时推理速度分别提升了6.1倍和2.1倍。
Insight: 核心创新在于将长上下文处理从串行、顺序依赖的模式转变为并行、迭代精炼的模式，并引入基于强化学习的自适应退出机制以优化效率。这打破了长上下文推理中精度与效率的权衡，为超长文档上的复杂多跳问答提供了可扩展的解决方案。
Abstract: Long-context reasoning remains a critical bottleneck for large language models, as recent recurrent-memory approaches face two inherent challenges: sequential chunk-wise updates can overwrite early critical evidence with later irrelevant content, and serial inter-chunk dependencies limit parallelism and cause latency to increase with context length. To address these issues, we propose PI-Mem (Parallel-Iterative Memory), a mechanism that processes all chunks in parallel and iteratively refines a shared memory over a bounded number of turns. In each turn, PI-Mem reads all chunks in parallel conditioned on the current memory, selects new or complementary evidence from each chunk, and merges the selected evidence into a compact shared memory for the next turn. To discourage redundant turns, we optimize the workflow through reinforcement learning with an auxiliary turn-efficiency reward, enabling the model to adaptively exit once sufficient evidence has been accumulated. We evaluate PI-Mem with Qwen3.5-35B-A3B and Qwen2.5-7B on the HotpotQA benchmark across context lengths up to 3.6 million tokens and find that it outperforms the recurrent-memory baseline by +6.25 and +7.81 absolute points while achieving 6.1$\times$ and 2.1$\times$ inference speedups, respectively. These results demonstrate that PI-Mem breaks the accuracy–efficiency trade-off in long-context reasoning and provides a scalable approach to complex multi-hop question answering over extremely long documents.
[13] CVPO: Enhancing LLM Reinforcement Learning Reasoning via Value-Variance Adaptation and Dynamic Curriculum Learning cs.CL | cs.AI | cs.LGPDF
Ziqi Jia, Yalu Ouyang, Bo Pang, Panpan Li, Hangfei Xu
TL;DR: 本文提出CVPO方法，通过价值方差适应和动态课程学习来增强大语言模型的强化学习推理能力。该方法在响应轨迹层面利用标记级价值方差量化生成的内在随机性，并设计方差感知的优势调整机制；在问题层面引入动态课程加权以适应问题难度，使模型在训练各阶段聚焦于匹配其当前能力的任务。
Details
Motivation: 现有强化学习方法在增强大语言模型推理时存在对生成答案轨迹反馈精度不足以及问题难度漂移现象，CVPO旨在解决这些挑战。
Result: 实验结果表明，CVPO在多种数学任务上超越了VAPO等强价值基线方法，实现了更好的性能、更强的探索能力，使语言模型推理更准确和鲁棒。
Insight: 创新点包括发现标记级价值方差与探索强度的相关性，并理论证明其约束策略更新幅度；基于估计的轨迹价值方差设计方差感知优势调整机制；以及引入动态课程加权方法自适应问题难度，可借鉴于强化学习训练中的探索-利用平衡与课程学习设计。
Abstract: Reinforcement learning (RL) has emerged as an effective method for enhancing the reasoning capabilities of large language models (LLMs). However, existing methods suffer from insufficient precision in feedback on generated answer trajectories and exhibit the phenomenon of problem difficulty drift. To address these challenges, we propose CVPO - Curriculum-guided Value-Variance Policy Optimization. At the response trajectory level, we find that token-level value-variance correlates with exploration intensity. Our theoretical analysis shows this variance bounds policy update magnitude. We then use the estimated trajectory value-variance to quantify the intrinsic randomness in generation. Based on this, we design a variance-aware advantage adjustment mechanism for different reward types. At the question level, we introduce a dynamic curriculum weighting method that adapts to question difficulty. This helps the model focus on tasks matched to its current ability during each training stage. Experimental results show our method outperforms strong value-based baselines like VAPO. It achieves better performance and stronger exploration, enabling more accurate and robust reasoning in language models across various math tasks.
[14] PAMT: Process-Aligned Reinforcement Learning for Multi-Domain Machine Translation cs.CLPDF
Yongshi Ye, Biao Fu, Chongxuan Huang, Yidong Chen, Xiaodong Shi
TL;DR: 本文提出了一种名为PAMT的流程对齐强化学习框架，用于解决多领域机器翻译（MDMT）中领域敏感决策（如领域消歧、术语控制和风格适应）的挑战。该框架结合了冷启动领域感知长链思维监督与强化学习，通过引入步骤级流程奖励来精确评估每个显式翻译步骤对最终翻译质量的贡献，从而缓解了传统方法中的信用分配瓶颈问题。
Details
Motivation: 多领域机器翻译不仅要求流畅生成，还需要进行领域敏感的翻译决策。现有大型推理模型通过中间翻译步骤使这些决策显式化，但在术语密集和风格受限的场景中容易产生漂移，其根本原因在于信用分配瓶颈：现有方法无法识别哪些翻译步骤真正有助于最终翻译。
Result: 在15个领域和四个翻译方向上的实验表明，PAMT在两个骨干模型上均优于基础模型，平均表现超过了专门的机器翻译基线，并在领域内、领域外和多语言设置中与强大的LLMs/LRMs保持竞争力。
Insight: 论文的核心创新点是提出了一个流程对齐的训练框架，通过结合序列级格式/结果奖励和步骤级流程奖励，实现了对翻译过程中每个显式步骤贡献的精确评估。从客观角度看，这种细粒度的信用分配机制为解决多领域翻译中的决策漂移问题提供了新思路，可借鉴用于其他需要显式推理步骤的序列生成任务。
Abstract: Multi-domain machine translation (MDMT) requires more than fluent generation: it demands domain-sensitive translation decisions such as domain disambiguation, terminology control, and stylistic adaptation. Large reasoning models (LRMs) make such decisions explicit through intermediate translation steps, but our analysis across 15 domains and four translation directions shows that this explicit reasoning is double-edged: it improves long-form and high-difficulty translation, yet often drifts in terminology-intensive and stylistically constrained settings. We trace this failure to a credit-assignment bottleneck: existing methods optimize final outputs or coarse trajectories, but cannot identify which translation steps actually help the final translation. To address this, we propose PAMT, a process-aligned training framework that combines cold-start domain-aware Long-CoT supervision with reinforcement learning. PAMT uses sequence-level format and outcome rewards for the final translation, together with a step-level process reward that measures how much each explicit translation step increases the likelihood of the reference translation. Across two backbones, PAMT improves over base models, outperforms MT-specialized baselines on average, and remains competitive with strong LLMs/LRMs across in-domain, OOD, and multilingual settings.
[15] Internalizing Academic Writing Workflows for Introduction Generation via Struct-Aware Policy Learning cs.CL | cs.AIPDF
Meicong Zhang, Tiancheng Su, Jiahao Cheng, Guoxiu He, Xinqi Tao
TL;DR: 论文提出StructPO框架，通过结构感知的策略学习，将多阶段的学术论文引言生成工作流内化到单次推理中，使用显式的阶段标记控制生成过程，旨在解决现有基于多阶段提示或智能体工作流方法成本高且易出现跨阶段漂移的问题。
Details
Motivation: 现有大语言模型生成严谨的论文引言面临挑战，需要协调背景、问题识别、方法和贡献等多个部分，而现有方法将其外部化为多阶段流程，导致成本高昂且易出现跨阶段不一致。
Result: 实验表明，StructPO在语义对齐、结构合理性和推理效率上优于基于工作流的基线方法，能泛化到领域外设置，当扩展到Qwen3-32B模型时，在人工评估中与GPT-5.1保持竞争力。
Insight: 创新点在于通过结构感知的信用分配将局部阶段质量与全局连贯性解耦，并通过精炼引导的优化将修订行为内化到首轮策略中，为学术写作提供了一种替代昂贵外部编排的可行方案。
Abstract: Generating a rigorous paper introduction with large language models (LLMs) remains challenging, since it requires coordinating background, gap identification, method and contribution within a coherent narrative. Existing solutions externalize this process as multi-stage prompts or agent workflows which are expensive and vulnerable to cross-stage drift. We propose StructPO, a struct-aware policy learning framework that internalizes the entire multi-stage writing workflow into a single-pass policy controlled by explicit stage tokens. StructPO introduces struct-aware credit assignment to decouple local stage quality from global coherence and refinement-guided optimization to internalize revision behavior into the first-pass policy. Experiments show that StructPO improves semantic alignment, structural rationality and inference efficiency over workflow-based baselines, generalizes to out-of-domain settings, and remains competitive with GPT-5.1 in human evaluation when scaled to Qwen3-32B. These results show that internalizing academic writing workflows through fine-grained policy optimization offers a viable alternative to costly external orchestration.
[16] Aligning Large Vision-Language Models at Test Time: A Trajectory-Guided Structured Sampling Approach cs.CL | cs.AIPDF
Tianbao Jiang, Weicong Ni, Gerard de Melo, Linlin Wang
TL;DR: 本文提出了一种测试时对齐方法，通过轨迹引导的结构化采样实现大型视觉语言模型（LVLM）的动态推理时优化。该方法首先通过轨迹学习算法构建推理记忆库，将复杂问题分解为预定义推理模式的序列；然后在推理时利用马尔可夫链蒙特卡洛（MCMC）算法进行局部多目标优化，提升视觉基础对齐和逻辑一致性。
Details
Motivation: 解决现有基于强化学习的后训练对齐方法资源消耗大、训练目标与推理分布不匹配的问题，旨在实现更高效的模型对齐。
Result: 在多个多模态推理数据集上的实验表明，该方法显著提升了准确性，且未引入过高的推理开销。
Insight: 创新点在于将对齐过程从训练阶段转移到推理阶段，通过轨迹分解和结构化采样实现动态优化；可借鉴之处包括推理记忆库的构建、基于MCMC的局部细化策略，以及测试时对齐的轻量化设计思路。
Abstract: Post-training reinforcement learning (RL) algorithms are commonly used to align large vision-language models (LVLMs) with human intent and the requirements of visual reasoning tasks. However, existing RL-based alignment methods are often resource-intensive and encounter mismatches between training objectives and inference-time distributions. To bridge this gap, we propose a novel test-time alignment approach that leverages trajectory-guided structured sampling for dynamic inference-time refinement, achieving better alignment with visual grounding and ensuring logical consistency. Our approach begins with curating a reasoning memory bank via a trajectory learning algorithm, which decomposes complex question solving into ordered sequences of predefined reasoning patterns. It subsequently accomplishes inference-time alignment by first collecting trajectories from reasoning memory bank to establish a global structural reasoning prior, and then using an iterative Markov Chain Monte Carlo (MCMC) algorithm for localized multi-objective refinement of the reasoning trace. Experiments across multiple multimodal reasoning datasets demonstrate that our approach significantly improves accuracy without incurring prohibitive inference overhead. These results establish trajectory-guided test-time sampling as a scalable and effective alternative to traditional post-training alignment, particularly for complex visual reasoning tasks.
[17] ANCHOR-RE: An Agentic Neuro-Symbolic Framework for Grounded Biomedical Relation Extraction cs.CLPDF
Shufan Ming, Yikun Han, Gibong Hong, Rui Zhang, Halil Kilicoglu
TL;DR: 本文提出了ANCHOR-RE框架，这是一个用于生物医学关系抽取（BioRE）的神经符号智能体框架。该框架将本体引导推理、外部知识锚定和数据驱动的验证规则集成到大型语言模型（LLM）的推理过程中，旨在提高基于LLM的BioRE的可靠性，且无需进行微调。
Details
Motivation: 传统的符号系统（如SemRep）在生物医学关系抽取中精度高但召回率有限，而大型语言模型（LLM）虽然具备更强的上下文推理能力，却容易产生假阳性预测。因此，需要一种结合两者优势的方法来提升BioRE的准确性和泛化能力。
Result: 在三个BioRE基准测试（SemRepGS, DDI, ChemProt）上，使用专有模型时，ANCHOR-RE显著优于直接提示LLM，例如在DDI上将微平均F1分数从0.769提升至0.872。在DDI和ChemProt上，其性能超越了先前报告的仅推理方法，并接近经过微调或指令调优的系统。使用开源模型也观察到了类似的性能提升。在2026年发表的100篇生物医学文章上进行的时间外评估中，对500个随机预测的手动评估获得了69%的精确度，表明其在未见文献上保持了稳定的精度。
Insight: 论文的核心创新点是提出了一个融合神经（LLM）与符号（本体、规则）推理的智能体框架，通过知识锚定和验证规则来约束和增强LLM的推理，从而在不更新模型参数的情况下提升其可靠性和泛化能力。从客观角度看，这是一种将领域知识（本体）和数据驱动规则有效注入LLM推理流程的实用方法，为训练无关的生物医学文本挖掘提供了新思路。
Abstract: Biomedical relation extraction (BioRE) extracts structured knowledge from biomedical literature for applications such as knowledge base construction and hypothesis generation. Traditional symbolic systems such as SemRep provide high precision but limited recall, while large language models (LLMs) offer stronger contextual reasoning but remain prone to false-positive predictions. We developed ANCHOR-RE, a framework that integrates ontology-guided reasoning, external knowledge grounding, and data-driven verification rules into LLM inference. We evaluated it on three BioRE benchmarks (SemRepGS, DDI, and ChemProt) using both proprietary and open-weight LLMs. To assess generalizability beyond benchmark datasets while reducing potential evaluation bias from LLM pretraining contamination, we conducted a temporal evaluation using 100 biomedical articles published in 2026. With the proprietary backbone, ANCHOR-RE outperformed direct LLM prompting, improving micro-F1 from 0.654 to 0.676 on SemRepGS, from 0.769 to 0.872 on DDI, and from 0.939 to 0.941 on ChemProt. On DDI and ChemProt, it also outperformed previously reported inference-only methods and approached fine-tuned or instruction-tuned systems without parameter updates. Similar performance gains observed with open-weight LLMs indicate that the benefits were not limited to the proprietary backbone. On the post-cutoff set, manual assessment of 500 randomly sampled predictions yielded a precision of 69%, maintaining consistent precision on previously unseen biomedical literature. Neuro-symbolic reasoning can improve the reliability of LLM-based BioRE without fine-tuning. Results across multiple benchmarks, model families, and post-cutoff literature support ANCHOR-RE as a practical training-free approach to biomedical literature mining.
[18] MoEGen: Mixture-of-Experts for Instance-Adaptive LoRA Generation cs.CLPDF
Yiming Zeng, Lei Lu, Zexin Li, Zhuochun Li, Shuoqiu Li
TL;DR: MoEGen提出了一种基于专家混合（MoE）的参数高效微调（PEFT）新框架，通过将专家表示为可学习的小向量（专家代码），并利用超网络根据这些代码的加权组合来生成输入特定的低秩更新，从而实现了实例自适应的LoRA生成，避免了存储完整LoRA专家模块带来的线性存储开销。
Details
Motivation: 现有基于MoE的PEFT方法通过存储多个完整的LoRA专家来提高模型容量，导致适配器存储随专家数量线性增长，且只能从固定的专家池中进行适配。本文旨在探索能否在不显式存储每个专家的独立LoRA模块的情况下，实现基于MoE的PEFT并产生实例特定的适配。
Result: 在八个常识推理基准测试和三个骨干模型上的实验表明，MoEGen相比强大的静态和基于MoE的PEFT基线方法取得了持续的性能提升。在联合医疗和法律领域的适配任务中也表现强劲。
Insight: 核心创新在于将基于MoE的PEFT从专家选择范式转变为专家条件参数生成范式，通过专家代码和轻量级超网络解耦了专家容量与适配器存储，实现了实例条件化的自适应，这是一种存储高效且灵活的微调机制。
Abstract: Parameter-efficient fine-tuning (PEFT) enables efficient adaptation of large language models, but existing MoE-based PEFT methods typically improve capacity by storing multiple full LoRA experts, causing adapter storage to grow linearly with the number of experts and restricting adaptation to a fixed expert pool. We ask whether MoE-based PEFT can produce instance-specific adaptations without explicitly storing a separate LoRA module for each expert. To address this gap, we propose MoEGen, an adaptation framework that shifts MoE-based PEFT from expert selection to expert-conditioned parameter generation. Instead of storing each expert as a full LoRA adapter, MoEGen represents each expert as a small learnable vector, termed an expert code. It routes each input over these vectors and uses their weighted combination to condition a lightweight hypernetwork that generates input-specific low-rank updates. This design decouples expert capacity from adapter storage while enabling instance-conditioned adaptation. Experiments on eight commonsense reasoning benchmarks show consistent improvements over strong static and MoE-based PEFT baselines across three backbones. MoEGen also performs strongly in joint medical and legal-domain adaptation.
[19] Benchmarking the Benchmarks: Testing the Predictive Validity of Commonsense Benchmarks cs.CLPDF
Ine Gevers, Walter Daelemans
TL;DR: 本研究评估了常识基准测试在预测大型语言模型下游任务性能方面的有效性，通过对23个模型在多个常识基准、变体、控制任务和下游任务上的测试，发现修订后的基准基本保持原始模型排名但未提升预测能力，常识基准仅对少数下游任务具有跨模型家族的预测有效性。
Details
Motivation: 解决常识基准测试性能是否能够有效预测模型在真实世界下游任务中的能力这一未明确的问题，以评估广泛采用的常识基准的实际可用性。
Result: 结果显示，修订后的基准在模型排名上与原基准相似，但未改善下游预测能力；常识基准仅对需要隐式社会、语用、时间或物理推理的狭窄下游任务子集表现出跨模型家族的一致性预测有效性，在其他任务中增益较小或依赖于特定度量。
Insight: 创新点在于系统性地测试常识基准的预测效度，揭示了标准化常识基准仅提供任务依赖而非广泛的证据来证明下游常识能力，这挑战了常识基准作为通用能力评估工具的假设。
Abstract: Predicting LLM’s capabilities on real-world tasks is essential, yet the extent to which performance on commonsense benchmarks predicts downstream performance remains underspecified. To establish the practical usability of widely adopted commonsense benchmarks, we evaluate 23 models from six families on four established commonsense benchmarks, four reworked variants, three non-commonsense controls, and eight downstream tasks requiring implicit social, pragmatic, temporal, or physical reasoning. We compare model rankings, compute controlled correlations, and use leave-one-family-out cross-validation to assess the criterion validity of commonsense benchmarks. Our results show that revised benchmarks largely preserve original model rankings and do not improve downstream predictive power. Commonsense benchmarks show consistent cross-family predictive validity for only a narrow subset of downstream tasks, with smaller or metric-specific gains elsewhere. Overall, standardized commonsense benchmarks provide task-dependent rather than broad evidence of downstream commonsense competence.
[20] ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models cs.CL | cs.CVPDF
Xiaolin Chen, Xuemeng Song, Wenhao Shi, Xianjing Han, Mong-Li Lee
TL;DR: 本文提出了文化条件视觉情感理解任务，并构建了ArtECulture基准数据集，包含6,792件艺术品，涵盖英语、中文和阿拉伯语文化，平衡了西方与非西方内容。在零样本设置下评估了16个多模态大语言模型，发现任务仍具挑战性，最佳模型准确率低于50%。为解决此问题，作者提出了一个检索增强的文化条件情感理解框架，无需额外训练即可将显式文化知识注入模型。
Details
Motivation: 现有视觉情感理解方法通常忽略情感感知中的文化差异，且相关基准存在个体标注不一致、文化覆盖不平衡的问题，阻碍了获得多数支持的文化层面情感标签。
Result: 在ArtECulture基准上的零样本评估显示，16个开源和闭源MLLMs中表现最佳的模型准确率低于50%。提出的检索增强框架提升了文化对齐的情感预测和基于依据的解释生成能力。
Insight: 创新点在于首次系统性地定义了文化条件视觉情感理解任务，并构建了平衡的文化覆盖基准；提出了一个无需训练、基于概念的文化情感知识库检索增强框架，以显式注入文化知识，改善模型表现。
Abstract: Existing visual emotion understanding methods typically ignore cultural variations in emotional perception. We introduce culture-conditioned visual emotion understanding, a task that predicts the culture-specific emotional perception of a given image and explains the underlying rationale. Although related benchmarks exist, they are limited by inconsistent individual annotations, which hinder the derivation of majority-supported culture-level emotion labels, and imbalanced cultural coverage. Thus, we present ArtECulture, a benchmark containing 6,792 artworks with culture-specific emotion labels and explanations across English, Chinese, and Arabic cultures, with balanced Western and non-Western content. Evaluations of 16 open- and closed-source Multimodal Large Language Models (MLLMs) under a zero-shot setting reveal that the task remains challenging, with the best model achieving below 50% accuracy. To address this limitation, we introduce a retrieval-augmented culture-conditioned emotion understanding framework, which leverages a concept-based cultural emotion knowledge base to inject explicit cultural knowledge into MLLMs without additional training. The framework improves both culturally aligned emotion prediction and grounded explanation generation. Our benchmark and code will be publicly released.
[21] Don’t Let Me Ask for It: LLMs Show Deficiencies in Active Multi-Turn Information Acquisition for Abductive Inference cs.CLPDF
Shahrukh Mohiuddin, Chalamalasetti Kranti, Sherzod Hakimov, David Schlangen
TL;DR: 本文通过引入‘外星人绑架游戏’交互式探针，研究大型语言模型（LLM）在多轮主动信息获取中进行溯因推理时的行为。研究发现，模型在证据一次性提供时表现更好；在多轮设置中，部分模型过早做出结论，而另一些则未能有效利用轮次。此外，模型在由预言机提供示例时成功率更高，但自选查询时其最终假设与所选证据更一致。
Details
Motivation: 当前对LLM的评估多关注其是否能正确解决溯因推理任务，但对其如何获取证据、更新假设以及决定何时停止等主动信息获取过程缺乏了解。本文旨在探究LLM在这些动态交互行为中的表现与缺陷。
Result: 在‘外星人绑架游戏’的实验中，模型在证据一次性提供（upfront）的模式下成功率高于分轮次提供（across turns）。在多轮主动查询设置中，模型在由预言机提供示例（oracle-provided examples）时成功率高于自选查询（self-selected queries），但自选查询时最终假设与所选证据的一致性更高。
Insight: 论文的创新点在于设计了一个交互式游戏来系统评估LLM在动态证据获取中的溯因推理行为。研究发现LLM可能形成与自选证据相符的假设，但缺乏充分区分替代假设的能力，且在验证、精炼假设以及决定停止时机方面存在困难，这揭示了当前LLM在主动多轮推理中的关键局限性。
Abstract: Abductive reasoning requires forming hypotheses that explain observed evidence and revising them as new evidence becomes available. While large language models (LLMs) are often evaluated on whether they solve abductive reasoning tasks correctly, less is known about how they acquire evidence, update their hypotheses, and decide when to stop. We introduce Alien Abduction game, an interactive probe for studying these behaviours under different interaction modes. The modes vary in whether evidence is provided upfront or across turns, and whether queries are selected by the model or examples are provided by the oracle. Across models, providing evidence upfront leads to higher success rates than distributing it across turns. In multi-turn settings, some models commit before using the available evidence, while others exhaust the turn budget without converging. Models also achieve higher success rates when examples are provided by the oracle than when they select their own queries, although their final hypotheses are more consistent with the evidence they selected. These findings suggest that models may form hypotheses that fit self-selected evidence without sufficiently distinguishing them from alternatives, and may struggle to validate and refine their hypotheses or determine when to stop.
[22] Cross-Lingual Bias in Large Language Models: A Comparative Analysis of English and Swahili cs.CLPDF
Ruolei Zhang, Teddy Njuguna, Yue Feng
TL;DR: 本研究通过对比分析GPT-5.2和Gemini 2.5 Flash在英语和斯瓦希里语上的表现，探讨了大语言模型中的跨语言偏见问题。研究发现，偏见并非简单地在语言间转移，而是发生了转化，具体体现在刻板印象比例变化、情感倾向差异、拒绝行为不一致以及语义输出不同等方面。
Details
Motivation: 大语言模型越来越多地在多语言环境中部署，但其安全对齐和偏见评估仍以英语为中心。本研究旨在探究社会偏见是否在不同语言间具有普遍性，以评估仅基于英语的偏见审计是否足以覆盖多语言部署的需求。
Result: 在九个社会人口统计偏见维度上，对4900个对称的英-斯瓦希里语提示对进行了测试，生成了19600个补全结果。具体结果包括：特定维度上的刻板印象率变化高达12个百分点；Gemini在斯瓦希里语中的中性情感率翻倍；GPT-5.2在英语中拒绝了169个提示，而在斯瓦希里语中为零；超过55%的提示对在两个模型中产生了语义不同的补全。
Insight: 论文的核心创新在于通过系统的跨语言对比实验，揭示了偏见在语言间的“转化”而非“转移”现象，并提供了行为层面的证据（如拒绝行为锚定于英语表面形式）。这强调了多语言偏见评估的必要性，挑战了仅依赖英语审计的现有范式，为模型安全对齐提供了新的评估视角。
Abstract: Large language models are increasingly deployed in multilingual contexts, yet safety alignment and bias evaluation remain overwhelmingly English-centric. We investigate whether social biases generalise across languages by submitting 4,900 symmetric English–Swahili prompt pairs to GPT-5.2 and Gemini 2.5 Flash across nine demographic bias axes, yielding 19,600 completions evaluated for stereotype prevalence, sentiment, refusal behaviour, and cross-lingual semantic similarity. Our findings show that bias transforms rather than transfers: stereotype rates shifted by up to 12 percentage points on specific axes, Gemini’s neutral-sentiment rate doubled in Swahili, and GPT-5.2 refused 169 prompts in English and zero in Swahili, consistent with refusal behaviour anchored to English-language surface forms at the behavioural level. Over 55% of prompt pairs produced semantically dissimilar completions across both models. These reinforce the idea that English-only bias audits do not produce adequate coverage for multilingual deployment.
[23] Hi-TTRL: Regulating Consensus with Hints for Test-Time Reinforcement Learning cs.CLPDF
Kunbin Xu, Xingzuo Li, Xuefeng Bai, Kehai Chen
TL;DR: 本文提出了Hi-TTRL框架，用于在测试时强化学习中通过生成提示来调控共识强度。该方法首先估计部分生成序列的共识强度，若其偏离目标区间，则调用一个基于MCMC的提示采样器，通过调整幂指数来生成提示，从而引导共识强度回到理想范围，最终提升模型推理能力。
Details
Motivation: 标准测试时强化学习（TTRL）依赖于多数投票构建伪标签，但其奖励信号对共识强度高度敏感：共识过低会放大不可靠伪标签的更新，共识过高则导致梯度消失。因此需要一种机制来主动调控共识强度。
Result: 在多个数据集和骨干模型上的实验表明，Hi-TTRL相比标准TTRL取得了持续的性能提升，消融实验和共识调控分析验证了自适应提示引导共识调控的有效性。
Insight: 核心创新在于引入了一个基于MCMC的提示采样器，通过幂变换调整目标分布并生成提示，从而主动、自适应地将共识强度调控至理想区间，解决了TTRL中共识强度对训练稳定性和效果的双刃剑问题。
Abstract: Test-time reinforcement learning (TTRL) improves the reasoning capabilities of large language models without labeled data by updating the policy with pseudo-labels constructed through majority voting. While effective, the reward signal assigned from majority voting is highly sensitive to consensus strength, defined as the frequency of the most common answer within a rollout group. In TTRL, consensus strength plays a dual role: it reflects both the reliability of the pseudo-label and the distribution of advantages. Low consensus can amplify updates from unreliable pseudo-labels through disproportionately large advantages, whereas high consensus reduces reward contrast and ultimately yields vanishing gradients. In this paper, we introduce Hi-TTRL, a test-time reinforcement learning framework that utilizes hints during sampling to regulate rollout consensus strength. Hi-TTRL first estimates consensus strength from a partial rollout group. When the consensus strength falls outside a target interval, it invokes a Markov chain Monte Carlo (MCMC) hint sampler. The sampler targets the power-transformed prefix distribution and uses finite-step approximate sampling to generate rollout prefixes as hints. By tuning the power exponent, Hi-TTRL generates hints with a sharpened or flattened power target, steering rollout consensus strength toward the target interval. Experiments on multiple datasets and backbones show that Hi-TTRL consistently improves over standard TTRL, with ablations and consensus-steering analyses validating the effectiveness of adaptive hint-guided consensus regulation.
[24] SFT Conflicts, RL Coexists: A Theoretical and Empirical Analysis of Multi-Task Learning for LLMs cs.CL | cs.LGPDF
Kejian Zhu, Zhuoran Jin, Shangqing Tu, Hongbang Yuan, Yushi Bai
TL;DR: 本文通过理论和实证分析，揭示了监督微调（SFT）与强化学习（RL）在多任务大语言模型训练中的根本差异。研究发现，SFT在多阶段训练中存在严重的任务冲突，而RL则能实现任务的稳定共存。其核心机制在于，RL通过优势归一化和同策略优化，产生了稀疏且近似正交的参数更新，从而限制了任务间的梯度干扰。基于此，作者提出了并行RL（Parallel-RL）范式，以解耦多任务训练，提升效率和灵活性。
Details
Motivation: 旨在探究SFT和RL在增强大语言模型多任务推理能力时表现出的不同行为，特别是解决SFT在多阶段训练中存在的严重任务冲突问题。
Result: 实证分析表明，RL在多任务训练中能实现稳定共存，其参数更新稀疏且近似正交。理论分析揭示了SFT的梯度干扰受梯度范数限制，而RL的干扰受梯度方差限制，后者方差小，导致优化方向接近正交。
Insight: 创新点在于从梯度和优化方向的角度，理论解释了RL在多任务学习中优于SFT的机制（方差限制 vs. 范数限制）。据此提出的Parallel-RL范式，通过解耦训练提升效率，为多任务学习提供了新的优化视角。
Abstract: Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) exhibit fundamentally different behaviors in enhancing multi-task reasoning for large language models (LLMs). Our preliminary experiments revealed a phenomenon: SFT suffers from severe task conflicts under multi-stage training, whereas RL enables stable coexistence across diverse tasks. Empirically, we trace this to the parameter level, observing that RL induces sparse and approximately orthogonal updates across tasks. We provide a theoretical explanation for this mechanism by analyzing multi-task gradient interference. Our results reveal a distinction: interference in SFT is norm-limited, scaling with the absolute gradient magnitude, whereas interference in RL is variance-limited, bounded by the gradient variance induced by advantage normalization and on-policy optimization. This small variance bound yields near-orthogonal optimization directions across tasks. Leveraging this insight, we propose Parallel-RL, a paradigm that decouples multi-task training, significantly improving efficiency and flexibility.
[25] Language-Specialized Multi-Teacher On-Policy Distillation for Multilingual LLM-Based ASR cs.CL | cs.SD | eess.ASPDF
Yuan Xie, Jiaqi Song, Xianliang Wang, Ming Lei, Jie Gao
TL;DR: 本文提出了一种语言专业化多教师同策略蒸馏方法（LS-MOPD），用于解决基于LLM的多语言ASR系统中因联合建模不同语言而导致的优化冲突问题。该方法通过独立训练语言专业化教师模型，再将其知识通过语言路由和令牌级多教师蒸馏整合到一个通用的多语言学生模型中，从而提升多语言识别性能。
Details
Motivation: 动机在于解决现有基于LLM的多语言ASR系统在联合建模具有异质声学、音系和词汇特征的语言时，不可避免产生的优化冲突，这削弱了语言专业化能力。
Result: 在涵盖普通话、普通话子方言、粤语和英语的基准测试上，LS-MOPD显著优于强化学习基线，并持续超越了表现最佳的RL教师模型所定义的经验性能上限，显示出其泛化潜力。
Insight: 创新点在于将语言特定知识获取与多语言能力集成解耦，通过语言路由和令牌级多教师蒸馏减少跨语言优化冲突；并探索了静态和动态声学前缀配置，以研究师生前缀一致性对同策略蒸馏效果的影响。
Abstract: Modern LLM-based ASR systems have established multilingual capability as a standard feature, leveraging large-scale multilingual corpora and LLMs’ cross-lingual knowledge to achieve competitive performance across multilingual benchmarks. However, joint modeling of languages with heterogeneous acoustic, phonological, and lexical characteristics inevitably introduces optimization conflicts, undermining language-wise specialization. To address this challenge, we propose Language-Specialized Multi-Teacher On-Policy Distillation (LS-MOPD), which decouples language-specific knowledge acquisition from multilingual capability integration: language-specialized teachers are independently optimized via reinforcement learning (RL), after which their expertise is integrated into a generalist multilingual student through language routing and token-level multi-teacher distillation, thereby reducing direct cross-lingual optimization conflicts. We further explore two acoustic-prefix configurations, static and dynamic, to examine how teacher–student prefix consistency influences the efficacy of on-policy distillation. Experiments on benchmarks covering Mandarin, Mandarin subdialects, Cantonese, and English demonstrate that LS-MOPD substantially outperforms RL baselines and consistently surpasses the empirical performance envelope defined by best-performing RL teachers, revealing its potential to generalize beyond all teachers in multilingual ASR.
[26] LoopMTP: A looped transformer guided by latent multi-token prediction cs.CLPDF
Behzad Shomali, Markus Frey, David Berghaus, Joachim Koehler, Mehdi Ali
TL;DR: 本文提出了LoopMTP，一种结合循环Transformer与多令牌预测（MTP）的模型。通过将循环迭代中的隐状态与未来令牌的嵌入进行软对齐，并为跨迭代信息保留一个轻量级门控机制，该方法旨在解决现有循环Transformer中的潜在过度思考和计算未分化问题。
Details
Motivation: 现有循环Transformer方法在跨循环迭代时缺乏对中间表示的指导，导致潜在过度思考和计算未分化问题。多令牌预测（MTP）能够提供密集的、前瞻性的监督，恰好弥补了这一缺失。
Result: 在实验中，LoopMTP相对于非循环基线模型的平均准确率提升了高达8.1%（相对值），并且在多达15次循环的训练中保持稳定。
Insight: 核心创新点在于建立了循环次数与可预测的未来令牌数量之间的结构性对应关系，并通过软对齐机制将前瞻性监督引入循环过程。这为循环架构提供了明确的优化目标，缓解了信息退化问题，是一种参数高效的深度扩展方法。
Abstract: Looped transformers have emerged as a parameter-efficient alternative to scaling depth for strong reasoning. By reusing one stack of layers across $T$ iterations, they attain the effective depth and reasoning capabilities of larger models at a fixed parameter count. Yet existing approaches suffer from latent overthinking and undifferentiated computation, largely because intermediate representations receive no guidance across loops. Multi-token prediction (MTP) supplies exactly the dense, forward-looking supervision the loop is missing. We propose \textsc{LoopMTP}, which links the two through a structural correspondence in latent space: a model that loops $T$ times can anticipate $T$ future tokens. \textsc{LoopMTP} realizes this by softly aligning the hidden state of loop $t$ with the embedding of the token $t$ steps ahead, while a lightweight gate preserves useful information across iterations. \textsc{LoopMTP} improves average accuracy by up to 8.1% (relative) over the non-looped baseline, with training remaining stable for up to 15 loops.
[27] M-GATE: Multilingual Grammar, Accuracy in Translation, and Efficiency Benchmark for Large Language Models cs.CL | cs.LGPDF
Tomáš Burkert, Angelika Peljak-Łapińska, David Zelený
TL;DR: 本文提出了M-GATE基准测试，用于评估大语言模型在多语言环境下的语言熟练度，包括语法错误检测、翻译准确性和效率三个任务，覆盖30种类型多样的语言。研究发现，模型的流畅性与熟练度存在显著差异，翻译能力与预训练数据量高度相关，且推理能力对翻译有积极影响但对语法检测作用有限。
Details
Motivation: 现有基准测试大多关注模型在特定语言中执行任务的能力，而非其对该语言本身的掌握程度，混淆了流畅性与熟练度。M-GATE旨在填补这一空白，通过设计专门任务来评估模型的多语言语言熟练度。
Result: 评估了超过50个模型的80多种配置，结果显示：模型在对抗性语法项目上的表现接近随机（最佳Matthews相关系数仅为0.36），翻译质量与预训练数据份额高度相关（r=0.86），且推理能力能可靠提升翻译质量但对语法错误检测影响较小甚至负面。
Insight: 创新点在于构建了一个专注于语言本身熟练度（而非任务执行）的多语言基准，并揭示了模型流畅性与熟练度的分离现象；客观来看，其对抗性语法设计、多提供商LLM评判翻译质量的方法，以及对预训练数据依赖性的量化分析具有借鉴意义。
Abstract: Multilingual language models are deployed across a hundred or more languages, yet most benchmarks test whether a model can perform a task in a language rather than whether it commands the language itself, conflating fluency with proficiency. We introduce M-GATE (Multilingual Grammar, Accuracy in Translation, and Efficiency), a benchmark of linguistic proficiency spanning 30 typologically diverse languages from high- to low-resource. M-GATE comprises three tasks: grammatical error detection on linguist-crafted, adversarially selected sentences that turn on hard, language-specific phenomena; round-trip translation of shared English sources across 29 target languages, scored by a three-provider LLM judge panel validated against professional annotators; and a supplementary tokenizer-efficiency measure. We evaluate over 50 models in more than 80 configurations. Fluency and proficiency come apart sharply: models that translate competently sit near chance on the adversarial grammar items, the best reaching a Matthews correlation coefficient (MCC) of only 0.36, and their errors lean systematically toward under-flagging, accepting ungrammatical text rather than raising false alarms. Translation quality closely tracks a language’s share of pretraining data (r = 0.86 against log Common Crawl share), producing a steep low-resource penalty that is nonetheless narrowing with successive model releases. Enabling reasoning reliably improves translation, while its effect on error detection is smaller and for some models negative, so the best configuration is task-dependent. To resist contamination, test items are kept private behind a continuously updated public leaderboard, with illustrative examples released (https://m-gate.ai).
[28] MultiGlobeQA: A Multilingual and Globally Diverse Benchmark for Geospatial Reasoning cs.CL | cs.AI | cs.IRPDF
Martin Böckling, Elizaveta Nosova, Heiko Paulheim, Andreea Iana
TL;DR: 该论文提出了MultiGlobeQA，一个多语言、全球多样性的地理空间推理基准数据集，包含46,060个问题-答案对，涵盖14种空间功能类别和15种答案格式，覆盖201个国家和地区，并包含英语及其他16种语言的平行问题。研究发现，大语言模型在处理需要网格索引和形状计算的任务时表现不佳，而检索和工具使用能带来显著提升，但性能瓶颈在于计算而非知识获取，且模型在低收入地区表现更差。
Details
Motivation: 现有基准测试在评估大语言模型的地理空间推理能力时存在局限性，如多为合成或小规模、单语言，且地理覆盖范围控制有限。该研究旨在通过构建一个多语言、全球多样性的基准来更全面地定位和评估模型在地理空间推理上的失败。
Result: 在参数化、推理和代理设置下，LLMs在需要网格索引和形状计算的任务上崩溃，而拓扑关系和方向任务表现最好。即使提供黄金事实，性能也停滞在三分之二以下，表明计算是瓶颈。模型在低收入地区表现不佳，且黄金事实反而扩大了这一差距。
Insight: 创新点在于构建了一个大规模、多语言、地理覆盖均衡的基准，并系统揭示了LLMs地理空间推理的瓶颈在于计算而非知识访问，同时发现了模型性能存在地理经济偏差。这为评估和提升模型的空间推理能力提供了更全面的基准和分析框架。
Abstract: Geospatial reasoning, i.e., computing distances, containment, and other spatial relations over real-world entities, is central to navigation and logistics, yet large language models (LLMs) struggle with the required geometric and topological computation despite storing considerable geographic knowledge. Existing benchmarks localize these failures only partially: they are synthetic or smallscale, largely monolingual, and offer limited control over geographic coverage. We introduce MultiGlobeQA, a multilingual benchmark of 46,060 question-answer pairs spanning 14 spatial-function families and 15 answer formats, with execution-based ground truth over three knowledge graphs. It covers 201 countries and territories via income- and density-stratified sampling, with parallel questions in English and 16 additional high- and low-resource languages. Across parametric, reasoning, and agentic settings, LLMs collapse on tasks requiring grid indexing and shape computation, while topological relations and directions fare best. Retrieval and tool use yield considerable gains, yet performance plateaus below two thirds even when gold facts are supplied, indicating that computation, not access to knowledge, is the bottleneck. Models also underperform on low-income regions, a gap that gold facts widen rather than close.
[29] ANNOTARES: A Dataset for Extracting Logical Structures from German Statutory Texts cs.CLPDF
Ronja Schwarz, Jannik Strötgen
TL;DR: 本文介绍了ANNOTARES数据集，用于从德国成文法文本中提取逻辑结构，具体任务是识别和分割法律条件（Tatbestand）与法律后果（Rechtsfolge）。该数据集包含三个不同法典的文本，并提供了跨度级标注，旨在评估领域特定性能和跨法规泛化能力。作者对多种方法进行了基准测试，包括基于规则的方法、CRF、BiLSTM、BiLSTM-CRF以及基于Transformer的模型（如BERT变体和LLM方法），发现BERT和LLM模型在捕捉法律语言复杂句法结构方面表现最佳。
Details
Motivation: 法律文本的自动结构分析是法律技术的基石，但提取其逻辑组件仍是一个重大挑战。本文旨在解决从德国成文法中识别和分割法律条件与法律后果的任务。
Result: 在ANNOTARES数据集上的基准测试表明，基于BERT和LLM的模型在捕捉法律语言复杂句法结构方面取得了优越性能，具体定量结果未在摘要中详细说明，但暗示这些模型优于基于规则、CRF和BiLSTM等方法。
Insight: 创新点在于引入了ANNOTARES这一新颖的德国法律文本数据集，专注于法律条件与法律后果的跨度级标注，并评估了跨法规泛化能力；客观分析认为，该数据集填补了德语法律文本结构化分析资源的空白，且对Transformer模型在法律领域应用的实证研究具有借鉴意义。
Abstract: The automatic structural analysis of legal texts is a cornerstone of legal technology, yet the extraction of their logical components remains a significant challenge. In this paper, we introduce the task of identifying and segmenting legal conditions (Tatbestand) and legal consequences (Rechtsfolge) within German statutory texts. To support this task, we present ANNOTARES (Annotations of Tatbestand-Rechtsfolge Sequences), a novel dataset comprising German law texts with span-level annotations. Spanning three distinct legal codes, the dataset is designed to evaluate both domain-specific performance and cross-statute generalizability. We benchmark diverse architectural approaches: a rule-based baseline, CRFs, BiLSTMs, BiLSTM-CRF, and modern Transformer-based models, including BERT variants and LLM-based methods. Our results demonstrate that BERT and LLM-based models achieve superior performance in capturing the complex syntactic structures of legal language. We release our dataset to facilitate further research in automated legal reasoning.
[30] TurnSight: Turn-Level Hindsight Self-Distillation for Tool-Integrated Reasoning cs.CL | cs.AIPDF
Changle Qu, Sunhao Dai, Hengyi Cai, Yuqi Zhou, Xinran Chen
TL;DR: 本文提出TurnSight，一种用于工具集成推理的回合级后见之明自蒸馏框架。该方法通过执行条件后见之明直接生成监督信号，构建多视野后见视图并通过跨视野方向一致性选择可靠监督，最后将选定的信号归一化并用于自适应调制强化学习优势，同时保持其原始优化方向。
Details
Motivation: 现有工具集成推理的强化学习方法通常依赖轨迹级监督，在长视野场景中限制了细粒度信用分配；而现有的自蒸馏方法其特权上下文通常来自真实答案或检索技能，可能无法反映智能体实际访问的状态，且令牌级监督无法捕捉工具交互的回合级结构。
Result: 在三个基准测试上的广泛实验证明了TurnSight的有效性。
Insight: 创新点在于提出直接从执行条件后见之明推导监督的回合级后见之明自蒸馏框架，并引入多视野后见视图与跨视野方向一致性选择机制来提升监督可靠性，以及通过归一化后见信号自适应调制RL优势的策略。
Abstract: Tool-Integrated Reasoning (TIR) enables LLMs to solve complex tasks through iterative tool interactions. However, existing reinforcement learning methods often rely on trajectory-level supervision, limiting fine-grained credit assignment in long-horizon TIR scenarios. On-policy self-distillation offers denser signals through teacher branches with privileged context, but existing approaches typically derive such context from ground-truth answers or retrieved skills, which may not reflect the states actually visited by the agent. Moreover, token-level supervision fails to capture the turn-level structure of tool interactions. To address this, we propose TurnSight, a turn-level hindsight self-distillation framework that derives supervision directly from execution-conditioned hindsight. It then constructs multiple hindsight views with different lookahead horizons and selects reliable supervision through cross-horizon directional agreement. Finally, the selected hindsight signal is normalized across sibling rollouts and used to adaptively modulate RL advantages while preserving their original optimization direction. Extensive experiments on three benchmarks demonstrate the effectiveness of TurnSight. Our codes are available at https://github.com/quchangle1/TurnSight.
cs.CV [Back]
[31] Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing cs.CVPDF
Junliang Ye, Kenkun Liu, Guocun Wang, Yang Li, Yansong Qu
TL;DR: 本文提出了Hunyuan3D-Buffalo 1.0，一个统一的3D多模态模型框架，支持3D理解、文本到3D生成、指令引导的3D编辑和基于文本的部件生成。为了支持可扩展的训练，作者构建了一个包含8700万个样本的3D多模态数据集。该框架结合了用于语义、结构和空间理解的视觉语言模型（Hunyuan3D-VLM）和用于高保真3D合成的扩散变换器（Hunyuan3D DiT）。
Details
Motivation: 当前统一的3D建模受到多模态数据稀缺的限制，特别是缺乏大规模且几何一致的编辑数据。本文旨在解决这一限制，构建一个能够集成3D理解、生成和编辑的统一框架。
Result: 广泛的实验表明，Hunyuan3D-Buffalo 1.0在文本到3D生成和3D编辑基准测试中达到了最先进的或领先的性能，同时展现出强大的理解和部件生成能力。
Insight: 主要创新点在于提出了一个统一的3D多模态框架，并构建了大规模训练数据集。其核心设计是结合VLM提供语义条件，并在扩散过程中利用源对象表示来保持结构以实现编辑和部件生成，这证明了统一的3D多模态训练的有效性。
Abstract: Recent advances in image generation have demonstrated the potential of unified multimodal models that integrate understanding, generation, and editing. However, unified 3D modeling remains constrained by scarce multimodal data, particularly the lack of large-scale and geometrically consistent editing data. To address this limitation, we propose Hunyuan3D-Buffalo 1.0, a unified framework supporting 3D understanding, text-to-3D generation, instruction-guided 3D editing, and text-grounded part generation within a single architecture. To enable scalable training, we construct an 87M-scale 3D multimodal corpus, comprising 25M understanding samples, 50M text-to-3D pairs, and 12M editing pairs generated using Nano3D-v2. Architecturally, the framework combines Hunyuan3D-VLM for semantic, structural, and spatial understanding with Hunyuan3D DiT for high-fidelity 3D synthesis. The VLM provides multimodal semantic conditions for generation, while editing and part generation additionally condition the diffusion process on the source object representation to preserve its overall structure and unedited regions. Extensive experiments show that Hunyuan3D-Buffalo 1.0 achieves state-of-the-art or leading performance on text-to-3D generation and 3D editing benchmarks, while exhibiting strong understanding and part-generation capabilities. Our analysis further shows that both generation and understanding improve editing, demonstrating the effectiveness of unified 3D multimodal training. Project Page: https://tencent-hunyuan.github.io/Hunyuan3D-Buffalo1.0/
[32] Quo Vadis, World Modeling? cs.CV | cs.AI | cs.ROPDF
Yu Yang, Xuemeng Yang, Licheng Wen, Lingdong Kong, Xiaobin Hu
TL;DR: 本文提出了一种以智能体为中心的交互式世界代理新范式，将传统世界建模从物理状态预测转向为智能体提供多样化、可操作的反馈信息（如执行结果、检索经验、验证信号等），以支持智能体的持续改进。论文系统性地将世界代理归纳为六种功能形式（动态、空间、执行、记忆/经验、技能、奖励/验证代理），并分析了它们在三个渐进层次（推理时指导、训练时优化、智能体-代理协同进化）上赋能智能体的方式。
Details
Motivation: 解决智能体持续改进时面临的挑战：直接与真实环境交互成本高、速度慢、不安全且难以并行化。传统世界模型主要通过预测未来物理状态作为代理，但其反馈形式单一，无法为智能体提供超越原始状态转换的、可操作的多样化反馈。
Result: 论文提出了一个概念性的分析框架，而非具体的实验模型。因此，摘要中未提及在特定基准测试上的定量结果或SOTA比较。其‘结果’是建立了一个系统化的设计空间路线图。
Insight: 核心创新在于范式转变：将世界建模重新定义为‘智能体中心的信息转换’，而不仅仅是物理状态预测。这极大地拓宽了世界建模的范畴，使其能提供更丰富的反馈形式（六种代理）。另一个关键见解是提出了世界代理赋能智能体的三个渐进层次，为构建支持智能体持续进化的系统提供了清晰的路线图。
Abstract: Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to parallelize. World modeling offers a natural intermediate proxy that allows agents to query lower-cost, more controllable feedback before committing to real actions. Classical world models instantiate this proxy primarily through future physical-state prediction, a formulation useful yet narrow for agents that require actionable feedback beyond raw state transitions. In this work, we conceptualize Agent-Centric Interactive World Proxies, shifting the fundamental paradigm from physical state transitions to agent-usable information transitions, such as execution outcomes, retrieved experiences or skills, and verification signals, broadening the scope of world modeling to provide versatile feedback for continually improving agents. To systematically map this design space, we organize world proxies into six functional forms based on their feedback modalities: dynamics, spatial, execution, memory/experience, skill, and reward/verification proxies, which together characterize the primary ways world modeling serves agent improvement. We further analyze how these proxies empower agents across three progressive levels: L.1 Inference-Time Guidance, where proxy outputs enrich in-context information for superior decisions; L.2 Training-Time Optimization, where proxy outputs yield rewards, critiques, or synthetic rollouts for policy learning; and L.3 Agent-Proxy Co-Evolution, where real-environment evidence continuously updates both the proxy and the agent for co-evolution. Ultimately, this work recasts world modeling into an agent-centric paradigm, establishing a roadmap for building world proxies that empower agents to plan better, learn faster, and evolve continually.
[33] Better, Stronger, Faster, and Broader: Structured All-Mask Prediction for MLLM-Based Segmentation cs.CVPDF
Jiazhen Liu, Mingkuan Feng, Long Chen
TL;DR: 本文提出结构化全掩码预测方法STAMPlus，以解决基于MLLM的分割任务中存在的性能、对话能力和推理速度的三难困境。该方法通过解耦自回归对话与非自回归掩码预测，在单次前向传播中联合预测多目标掩码，实现了高效、强性能且保留多模态对话能力的分割。
Details
Motivation: 基于MLLM的分割方法面临分割性能、对话能力保持和推理速度之间的三难问题：嵌入预测方法可能破坏语言建模，而逐令牌生成对密集掩码预测效率低下。
Result: STAMPlus在开放词汇语义分割、实例感知分割和遥感小目标分割等多个设置中达到SOTA性能，保持多模态指令跟随能力，并将12类别的推理延迟从重复STAMP推断的13.50秒降低至5.16秒。
Insight: 创新点在于将结构化目标列表与共享多类掩码空间绑定，实现单次非自回归的多目标联合预测；高分辨率掩码令牌缩放保留了细粒度空间证据，准确的目标提示提升分割性能，学习的空间基础有利于二次推理。
Abstract: MLLM-based segmentation faces a core segmentation trilemma: high segmentation performance, preserved dialogue ability, and fast inference. Embedding-prediction methods may disrupt language modeling through pixel-level objectives, whereas next-token generation is inefficient for dense masks. We propose All-Mask Prediction, decoupling autoregressive dialogue from non-autoregressive mask prediction. Its binary instantiation, STAMP (Simultaneous Textual All-Mask Prediction), emits an in-vocabulary
[34] Confident but Unreliable: A Behavioral Safety Audit of Vision-Language Models on Brain MRI cs.CVPDF
Amir Sabbaghziarani, Mohammadsajad Abavisani, Sergey Plis
TL;DR: 本文对六种指令调优的视觉语言模型（包括通用模型和医学专用模型）在脑部MRI图像上的行为安全性进行了审计研究，发现这些模型虽然回答覆盖率接近完整，但其口头表达的置信度校准性较差，存在大量高置信度错误，且幻觉和弃答行为与多项选择准确性无关。
Details
Motivation: 研究动机在于评估视觉语言模型在医学影像（特别是脑部MRI）应用中的可靠性，尤其是模型陈述的置信度是否与其正确性相匹配，以揭示前沿多模态系统中模型可能表现出能力但缺乏可靠自我认知的普遍故障模式。
Result: 在4,102张图像（包括来自250名受试者的4,032个轴向/冠状/矢状MRI切片以及70个非大脑/噪声对照）上的实验结果显示，所有模型的ECE（预期校准误差）在0.27到0.40之间，错误答案的平均置信度在0.82到0.97之间，33-46%的已回答项目是高置信度错误；最准确的模型在其错误上反而最自信，医学适应提高了肿瘤存在检测的准确性但未改善置信度可靠性。
Insight: 创新点在于提出了一种自动评分的行为审计方法，用于系统评估VLM在医学影像上的置信度校准、高置信度错误、幻觉和弃答行为，并强调医学影像VLM评估应同时报告这些可靠性指标而不仅仅是准确性，这为安全关键领域的模型评估提供了新视角。
Abstract: Vision-language models (VLMs), including medical specialists, are increasingly proposed for medical imaging, yet their stated confidence is rarely evaluated separately from correctness. We use brain MRI as a controlled, high-stakes testbed for a broader failure mode in frontier multimodal systems: models can appear competent while lacking reliable self-knowledge. We present an automatically graded behavioral audit and pilot study of six instruction-tuned VLMs (five general-purpose and one medical specialist) on 4,102 images (4,032 axial/coronal/sagittal MRI slices from 250 subjects plus 70 non-brain/noise controls), with labels derived from public metadata and released expert segmentation masks rather than new human annotation. Across models, answer coverage is near-complete, but verbalized-confidence calibration is poor: ECE ranges from 0.27 to 0.40, mean confidence on incorrect answers ranges from 0.82 to 0.97, and 33-46% of answered items are high-confidence errors. The most accurate model is also the most confident on its errors, while a base/specialist family contrast suggests that medical adaptation improves tumor-presence detection without improving confidence reliability. Open-ended diagnostics further show that hallucination and abstention vary separately from multiple-choice accuracy. These findings argue that medical-image VLM evaluation should report verbalized-confidence reliability, confident error, hallucination, and abstention alongside accuracy.
[35] PixelUp: Zero-Shot Semantic Feature Upsampling for Fine-Grained Vision Tasks cs.CVPDF
Deepank Singh, Anurag Nihal, Vedhus Hoskere
TL;DR: 本文提出了PixelUp，一种零样本、与视觉基础模型无关的特征上采样方法，旨在将自监督视觉基础模型产生的粗糙补丁级特征恢复为像素级细节，以提升密集预测任务的性能。该方法通过一种由多尺度语义特征引导的、从粗到细的窗口化交叉注意力架构实现语义感知，无需针对特定编码器进行训练。
Details
Motivation: 现有的特征上采样方法存在局限性：可学习的上采样器通常针对特定编码器设计，缺乏通用性；而基于图像引导的方法（使用浅层像素编码器）容易引入纹理伪影且缺乏语义指导，难以满足语义分割和深度估计等需要精确细粒度预测的密集预测任务的需求。
Result: PixelUp在密集预测任务上实现了最先进的性能，超越了针对特定视觉基础模型设计的和通用的上采样器。在语义分割任务上平均提升了+1.2 mIoU，在NYUv2深度估计任务上平均提升了+0.25 δ₁。此外，在无需训练的开集词汇和无监督语义分割任务上，也分别平均提升了+1.3 mIoU和+0.5 mIoU。
Insight: 核心创新在于提出了一种通用的、零样本的、具有语义感知能力的上采样架构。其利用多尺度语义特征引导的窗口化交叉注意力机制，以从粗到细的方式恢复细节，避免了针对特定编码器的重新训练，并有效减少了纹理伪影，提升了上采样特征的语义准确性。
Abstract: Self-supervised Vision Foundation Models (VFMs) have become essential backbones for downstream tasks due to their strong and transferable visual representations. However, their patch-token-level features are often too coarse for dense prediction tasks such as semantic segmentation and depth estimation when accurate fine-grained predictions are required. Feature upsampling methods have been developed to recover pixel-level detail but still face limitations. Learnable upsamplers are often designed for a specific encoders and must be retrained for different encoders. Image-guided methods that use shallow pixel encoders often introduce textural artifacts and lack the semantic guidance needed for accurate downstream predictions. We introduce PixelUp, a zero-shot VFM-agnostic upsampler achieving semantic awareness through a coarse-to-fine chain of windowed cross-attention architecture guided by multi-scale semantic features. We demonstrate that PixelUp outperforms both VFM-specific and VFM-agnostic upsamplers, achieving state-of-the-art performance on dense prediction tasks with an average improvement of +1.2 mIoU on semantic segmentation and +0.25 $δ_1$, on NYUv2 depth estimation across VFMs. PixelUp further improves training-free open-vocabulary and unsupervised semantic segmentation by an average of +1.3 mIoU and +0.5 mIoU, respectively. Code available at https://pixelup-project.vercel.app/
[36] A Unified 2D Framework for DeepLesion Detection, Segmentation and Short Report Generation cs.CV | cs.AIPDF
Ruida Cheng, Tejas S. Mathai, Benjamin Hou, Qingqing Zhu, Zhiyong Lu
TL;DR: 本文提出一个统一的2D病灶分析框架，集成基于大语言模型的推理、病灶边界框检测、分割和放射学报告生成，应用于DeepLesion数据集。
Details
Motivation: 解决原始DeepLesion数据集中病灶分割的挑战性问题，并整合空间和解剖学上下文到短报告生成中。
Result: 在测试阶段，病灶边界框检测mAP50为70.1%，mAP50-95为46.4%；病灶分割Dice分数为62.6%；短报告生成BLEU_1为64.3%，BLEU_4为49.6%，METEOR为34.7%，ROUGE_L为60.1%。分割性能相比nnUNet模型提升了28.5%。
Insight: 创新点在于构建了一个统一的2D框架，将LLM推理与视觉任务（检测、分割）和报告生成相结合，并整合空间解剖信息以提升报告质量，实现了多任务协同优化。
Abstract: In previous work, we integrated large language models (LLMs) into the lesion segmentation model based on the ULS23 DeepLesion dataset, using short-form findings from the reports. In this study, we developed a unified 2D lesion analysis framework that integrates LLM-based reasoning, lesion bounding box detection, segmentation, and radiology report generation from the original DeepLesion dataset. In the testing phase, we achieved relatively high lesion bounding box detection accuracy with mAP50 of 70.1%, mAP50-95 of 46.4%; Lesion segmentation performance with a Dice score of 62.6%; short report generation accuracy with BLEU_1 score of 64.3%, BLEU_4 score of 49.6%, METEOR of 34.7%, and ROUGE_L of 60.1%. In this work, we address the challenging issue of segmentation in the original DeepLesion dataset and achieve a 28.5% Dice score improvement over the nnUNet lesion segmentation model. We also integrated spatial and anatomical context into the DeepLesion short report generation. We released the implementation, dataset, and models on Github. https://github.com/ruida/2D_DeepLesion_Foundation
[37] SAGE: Semantic Explainability of Attention-Based Survival Models in Computational Pathology cs.CV | cs.AIPDF
Abdallah Lamane, Abdul Rahman Diab, Ren-Chin Wu, William Lotter
TL;DR: 本文提出了SAGE框架，用于从基于注意力的多实例学习（ABMIL）生存模型中提取全局的、基于语言的解释。SAGE利用病理学视觉语言模型对图像块进行25个组织学概念的评分，并根据模型的注意力权重进行聚合，从而量化每个概念与队列中预测风险的关系。
Details
Motivation: ABMIL模型在计算病理学中广泛用于切片级预测，但其注意力图仅提供局部解释，无法揭示驱动预测的组织学特征或模型在患者队列中的整体行为。
Result: 在七个TCGA癌症队列和三个基础模型上的生存预测实验中，SAGE成功恢复了已知的预后特征（如坏死的不良关联），并揭示了癌症特异性生物学特征（如肾细胞癌中有利的血管生成特征）。消融研究表明这些关联依赖于模型学习的注意力，而非单纯的概念流行度。
Insight: SAGE的创新在于提供了一种可扩展的、模型无关的全局解释框架，通过语义基础的概念字典将视觉特征与语言描述关联，使病理学家能够在队列层面解释模型行为，并具有生物标志物识别的潜力。
Abstract: Attention-based multiple instance learning (ABMIL) is the predominant approach for slide-level prediction in computational pathology, yet its attention maps provide only local explanations: they indicate where a model focuses but not which histological features drive its predictions or how the model behaves across a patient cohort. We present Semantic Attention Global Explanations (SAGE), a post-hoc framework that extracts global, language-grounded explanations from a frozen ABMIL model. Using a pathology vision-language model, SAGE scores image patches against a dictionary of 25 histological concepts, aggregates these scores according to the model’s learned attention, and quantifies how each concept relates to prediction risk across a cohort. Applied to survival prediction using seven TCGA cancer cohorts and three foundation models, SAGE recovered established prognostic features, such as the adverse association of necrosis, while revealing cancer-specific biology, including a favorable angiogenic signature in renal cell carcinoma consistent with known molecular subtypes. Ablation studies demonstrated that these associations depend on the model’s learned attention rather than concept prevalence alone, and that the concept dictionary captures much of the prognostic information encoded by the foundation model features. Through semantically-grounded explanations, SAGE provides a scalable, model-agnostic framework for understanding what ABMIL survival models learn, enabling pathologists to interpret model behavior at the cohort level and offering the potential for biomarker identification.
[38] In-Context Collapse in Vision-Language Models and How to Mitigate it? cs.CV | cs.AIPDF
Mohammad Rostami
TL;DR: 本文研究了视觉语言模型（VLMs）在进行多示例上下文学习（ICL）时出现的“上下文崩溃”现象，即随着演示示例的增多，模型性能反而急剧下降。作者通过实验在多个基准上验证了该现象，并定位其根源在于视觉-语言整合路径的故障。论文提出了一种名为CircA的轻量级干预方法，通过一次性的“整合疫苗”训练，即可将抗崩溃能力迁移到未见任务上，有效缓解了该问题。
Details
Motivation: 论文的动机是挑战一个广泛假设，即视觉语言模型（VLMs）的上下文学习（ICL）性能会随着演示示例数量的增加而单调提升。作者发现并旨在解释与之相反的“上下文崩溃”现象，即性能在演示累积后出现急剧下降。
Result: 在合成分类、自然图像分类和VQA基准测试中，部分VLMs在演示累积后出现准确性急剧下降，有时甚至低于随机猜测水平。通过提出的CircA干预方法，在16个示例下，模型在特定任务上的准确率从0.39恢复到了0.91，并且在未见任务（如CIFAR/Fashion）上，准确率也从随机水平提升至0.71/0.60。
Insight: 论文的核心创新点在于揭示并因果性地定位了“上下文崩溃”现象源于视觉-语言整合路径的故障，而非后期的读出层。提出的CircA方法提供了一个轻量级、可迁移的干预方案，其“整合疫苗”只需在单一合成任务上训练一次即可生效。此外，研究还发现，最适合上下文整合的模型层与最适合基于权重的知识巩固的模型层是不同的，这为模型架构设计提供了新见解。
Abstract: Many-shot in-context learning (ICL) lets vision-language models (VLMs) adapt from image–label demonstrations without weight updates, and is widely assumed to improve as more demonstrations are supplied. We show the opposite: as demonstrations accumulate, a subset of VLMs undergo an \emph{in-context collapse}, a sharp, sometimes catastrophic accuracy drop spanning synthetic classification, natural-image classification, and VQA benchmarks, in some models falling below chance while outputs remain well-formed. Across an open VLM panel ($0.5$B–$11$B) and a frontier model (Claude Sonnet 4.5), the collapse is graded. Two capabilities turn out to be dissociable: robustness to accumulating demonstrations and the ability to learn a novel rule in context, their combinations yield three reproducible regimes. A parameter-matched lesion-and-rescue causally localizes the collapse to the vision-language integration pathway: an adapter on the connector and early/mid layers restores genuine learning (remap accuracy $0.39!\rightarrow!0.91$ at 16 shots), while an equal-capacity adapter on the late readout does not. We propose \textsc{CircA}, whose core is a one-time integration vaccine: trained once on one synthetic task, it transfers collapse-resistance to unseen task families (chance$\rightarrow$$0.71$/$0.60$ on CIFAR/Fashion). The layers best for in-context integration are not the layers best for weight-based consolidation, the late readout achieves higher accuracy and less forgetting at fewer parameters. The collapse is an integration failure at the vision–language interface, correctable by a lightweight, transferable intervention.
[39] CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning cs.CV | cs.AI | cs.CLPDF
Xuehang Guo, Pingyue Zhang, Ruiyi Zhang, Zhenhailong Wang, Hanrui Lyu
TL;DR: 本文提出CURV，一个通过课程学习增强图表理解的框架，将图表问答任务重新定义为多步骤的视觉基础推理，并引入CCQA课程数据集进行训练。实验表明CURV在多个基准测试上显著优于基线模型，并展现出良好的泛化能力。
Details
Motivation: 当前多模态大语言模型在图表问答任务中缺乏内在的视觉基础推理能力，导致感知不准确和推理与视觉证据脱节，需要一种方法来内化视觉推理能力。
Result: CURV在内部评估中比基线模型提升高达20.50%，在真实世界基准测试上提升高达12.30%，在领域外多模态推理任务上提升高达10.20%，验证了其有效性。
Insight: 核心创新在于将图表问答重构为多步骤视觉基础推理，并通过课程学习（从简单到复杂）和动态空间注意力集中机制，系统性地内化视觉推理能力；同时构建了可扩展的合成课程数据集CCQA来辅助学习。
Abstract: Chart question answering (CQA) requires multimodal large language models (MLLMs) to integrate visual comprehension with logical reasoning, yet current models struggle with accurate visual grounding and coherent reasoning chains. While extrinsic chain-of-thought prompting and visual cues significantly improve performance, current MLLMs lack intrinsic visual grounded reasoning capabilities, leading to inaccurate perception and reasoning disconnected from visual evidence. To address these limitations, we propose CURV, a curriculum learning framework that develops intrinsic visual reasoning capabilities by reformulating CQA as multi-step visual grounded reasoning, where each step coordinates logical reasoning with dynamic visual grounding through spatial attention concentration. To assist model learning, we further introduce CCQA, a three-level curriculum dataset with scalable synthetic generation across diverse chart types and reasoning patterns. Our curriculum systematically progresses from basic single-operation reasoning to complex multi-chart compositional tasks. Experiments demonstrate that CURV achieves up to $\uparrow20.50%$ improvements over baselines and is generalizable to real-world benchmarks (up to $\uparrow12.30%$) and out-of-domain multimodal reasoning tasks (up to $\uparrow10.20%$), validating the effectiveness of internalizing visual reasoning with dynamic grounding for enhanced chart understanding capabilities. Code is available at: https://xhguo7.github.io/CURV/.
[40] Modeling Scientific Experiment Scenes: Dataset and Model cs.CVPDF
Minghao Zou, Qingtian Zeng, Shangkun Liu, Cong Liu, Paul L. Rosin
TL;DR: 本文提出了首个针对物理实验场景的Scene Graph Generation (SGG)数据集PhysScene，并设计了跨模态双路径生成器（CM-DPG）模型来解决该场景下存在的长尾关系谓词分布和视觉-文本语义鸿沟两大挑战。
Details
Motivation: 现有的SGG基准主要关注日常生活图像，而忽视了具有专业仪器、特定实验语义以及密集细粒度物理关系的科学实验场景，这些场景对于自动化实验分析和智能教育日益重要。
Result: 在PhysScene和VG150数据集上的大量实验表明，CM-DPG在多种评估设置下均取得了有竞争力的性能，消融研究验证了每个组件的贡献。
Insight: 创新点在于构建了首个物理实验场景SGG数据集，并提出了通过联合视觉-文本编码增强对象级语义表示、利用互补的视觉和几何线索改进关系推理、以及结合关系感知预训练、标题衍生的伪监督和自适应加权来支持头尾谓词平衡学习的CM-DPG模型。
Abstract: Scene Graph Generation (SGG) is fundamental to structured visual understanding, yet existing benchmarks focus mainly on daily life images and overlook scientific experiment scenes with specialized instruments, task-specific experimental semantics, and dense, fine-grained physical relations. These scenes are increasingly important for automated experimental analysis and smart education. To bridge this gap, we introduce PhysScene, the first SGG dataset for physical experiment scenes, providing densely annotated scene graphs and benchmarks under multiple supervision and protocol settings. PhysScene further exposes two key algorithmic challenges for SGG: pronounced long-tail relational predicate distributions and a substantial visual-textual semantic gap. To address these challenges, we propose the Cross-Modal Dual-Path Generator (CM-DPG), a model for robust open-vocabulary SGG. The model enhances object-level semantic representations through joint visual-textual encoding and improves relational reasoning using complementary visual and geometric cues. We also incorporate relation-aware pre-training, caption-derived pseudo-supervision, and adaptive weighting to support balanced learning across head and tail predicates. Extensive experiments on PhysScene and VG150 show that CM-DPG achieves competitive performance across multiple evaluation settings, with ablation studies validating the contribution of each component. The dataset and code are publicly available at https://github.com/ZMH-SDUST/CM-DPG.
[41] Test Time Adaptation Methods for Point Cloud Registration in Laparoscopic Surgery cs.CVPDF
Nina Bodelot, Soufiane Belharbi, Eric Granger
TL;DR: 本文研究了腹腔镜手术中3D点云配准的测试时适应（TTA）方法，旨在解决合成训练数据与真实术中重建点云（存在噪声、稀疏和遮挡）之间的域偏移问题。作者分析并修改了来自模型、归一化和输入适应三个家族的四种先进TTA方法，使其适用于处理术前与术中点云之间的不对称偏移，并在合成和真实目标数据上进行了评估。
Details
Motivation: 腹腔镜手术中的点云配准任务面临合成训练数据与真实术中数据存在域偏移的挑战，导致对应关系估计性能下降。现有的TTA方法主要针对分类任务设计，依赖于分类输出或类别原型等，不适用于配准任务，且配准涉及具有不对称偏移的成对输入。
Result: 在P2P和P2ILReg数据集上，使用在干净合成源数据上训练的对应关系模型，评估了向受损合成和真实目标数据的适应效果。对于合成目标数据，应用了八种损坏（如均匀噪声和全局密度降低）在五个严重级别。所有方法在P2P上改进了配准性能，而归一化适应在P2ILReg上降低了性能。
Insight: 论文的创新点在于将TTA方法系统性地适配到3D点云配准任务，特别是处理了术前与术中点云之间的不对称域偏移，并替换了基于分类的熵目标。从客观角度看，研究指出基于输入的适应方法在腹腔镜手术中最具前景，因其计算开销低、推理延迟小，并在不同数据集上提供了一致的误差减少。
Abstract: 3D point cloud registration in laparoscopic surgery estimates the transformation between an intraoperative organ reconstructed from video and its preoperative mesh. Because ground-truth transformations are unavailable for real data, supervised networks are trained on synthetic organ pairs. At test time, real reconstructions differ from synthetic data and are noisy, sparse, and occluded, which degrades correspondence estimation. Test-time adaptation (TTA) can reduce this domain shift, but existing methods mainly rely on logits, entropy, class prototypes, or cache memories unavailable in registration. Registration also involves paired inputs with an asymmetric shift that primarily affects the intraoperative cloud. We analyse and modify state-of-the-art TTA methods from three families to 3D registration: model, normalization, and input adaptation. We analyze four representative approaches based on auxiliary-task model updates, backpropagation-free token purging, feature alignment, and layer-normalization calibration. We modify them to handle asymmetric shifts between preoperative and intraoperative point clouds and replace classification-based entropy objectives. Using a correspondence-based model trained on clean synthetic source data, we evaluate adaptation to corrupted synthetic and real target data on P2P and P2ILReg. For synthetic targets, we apply eight corruptions, including uniform noise and global density reduction, at five severity levels. All methods improve registration on P2P, whereas normalization adaptation degrades performance on P2ILReg. Considering the computational overhead of backpropagation-based adaptation, input adaptation is the most promising option for laparoscopic surgery, providing low inference latency and consistent error reductions across datasets. Code: https://github.com/ninaa-git/survey_pc_registration_tta
[42] RealWeather: Realistic and Scene-Faithful Weather Translation with Driving World Models cs.CVPDF
Yuwei Ning, Liangzhi Wang, Yi Xiao, Zhenhua Wu, Yun Pang
TL;DR: RealWeather提出了一种基于驾驶世界模型的真实且场景保真的天气转换方法，通过渐进式真实感引导和场景保真强化学习优化，直接从真实世界视频中学习真实的天气动态，实现双向清晰与恶劣天气的转换。
Details
Motivation: 现有天气转换方法依赖合成数据、3D天气编辑或几何条件生成，往往牺牲天气真实感或场景保真度，而大规模收集不同天气条件下的配对真实场景视频不切实际。
Result: 大量实验表明，RealWeather在视觉真实感和结构保持方面显著优于现有方法，同时支持鲁棒的长尾天气场景生成和强大的零样本分布外泛化能力。
Insight: 创新点包括渐进式真实感引导的迭代数据精炼策略，以及通过奖励驱动的策略优化显式惩罚对安全关键驾驶元素的改变，从而确保结构完整性和抑制幻觉生成。
Abstract: Realistic weather translation is valuable for developing and evaluating autonomous driving systems, yet collecting paired videos of the same scenes under different weather conditions at scale is impractical. Existing methods therefore rely on synthetic data, 3D weather editing, or geometry-conditioned generation, often compromising weather realism or scene fidelity. We propose RealWeather, a driving world model for both realistic and scene-faithful weather translation. Our key idea is to learn authentic weather dynamics directly from real-world videos. Specifically, RealWeather employs Progressive Realism Bootstrapping, an iterative data-refinement strategy. Assisted by an auxiliary Pseudo-Clear Generation pipeline, training initially starts with pseudo-style conditioning videos. As training proceeds, these inputs are progressively replaced with increasingly realistic videos generated by the model itself. This strategy bridges the pseudo-to-real domain gap, allowing the model to adapt seamlessly to real-world input distributions and naturally support bidirectional clear adverse translation. Furthermore, to strictly enforce structural integrity and suppress hallucinations, we introduce Scene-Fidelity RL Optimization, a reward-driven policy optimization strategy that explicitly penalizes alterations to safety-critical driving elements. Extensive experiments demonstrate that RealWeather significantly outperforms existing methods in visual realism and structural preservation, while enabling robust long-tail weather scenario generation and strong zero-shot out-of-distribution generalization.
[43] V-FIND: Revealing the Intrinsic Forgery Knowledge Encoded in Video Forgery Detectors cs.CV | cs.AIPDF
Shichao Kan, Chengpeng Hong, Jingtong Dou, Chuancheng Shi, Yuhan Liu
TL;DR: 本文提出了一种名为V-FIND的框架，旨在揭示视频伪造检测器内部编码的稀疏伪造判别知识。研究发现，这种知识并非均匀分布，而是集中在少数功能特化的神经元中。通过定位关键层并识别锚定神经元，构建了一个紧凑的取证子空间，仅需训练一个轻量级线性分类器即可在多个外部基准上实现强大的检测性能。
Details
Motivation: 现有视频伪造检测研究通常将检测器视为黑盒，其内部的伪造判别知识未被充分探索。本文旨在通过揭示和激活检测器内部的稀疏取证知识，避免依赖资源密集的全模型重训练来提升检测性能。
Result: 在多个外部生成视频基准测试中，仅冻结原始主干网络并训练一个轻量级线性分类器，所构建的取证子空间仍能提供强大的检测性能。神经元干预实验为所发现神经元的功能特异性提供了直接证据。
Insight: 创新点在于揭示了视频伪造检测器内部存在稀疏、可提取、可重用的伪造判别知识，并提出了一个框架来定位和利用这些知识。这为理解和利用检测器的内在取证能力提供了新视角，即无需全模型微调，通过激活稀疏神经元子集即可实现高效检测。
Abstract: As generated videos become increasingly realistic, reliable video forgery detection is increasingly important. Existing studies typically optimize and use video forgery detectors as black boxes, while the latent forgery-discriminative knowledge inside them remains largely unexplored. Instead of continuing to rely on resource-intensive full-model retraining to steadily improve detection performance, we ask whether video forgery detection can also be achieved by uncovering and activating sparse forensic knowledge within the detector. We find that forgery-discriminative knowledge is not uniformly distributed across the full representation space, but is concentrated in a sparse set of functionally specialized neurons. Based on this insight, we propose a video forgery-intrinsic neuron discovery (V-FIND) framework. V-FIND first localizes critical layers that exhibit pronounced discrepancies between real and forged videos, and then identifies latent anchor neurons that consistently carry forgery-discriminative signals, organizing them into a compact forensic subspace. With the original backbone frozen and only a lightweight linear classifier trained, this subspace still delivers strong detection performance across multiple external benchmarks for generated videos. Further neuron intervention experiments provide direct evidence for the functional specificity of the discovered neurons. Overall, these results suggest that video forgery detectors contain sparse, extractable, and reusable forgery-discriminative knowledge, offering a new perspective on understanding and exploiting their intrinsic forensic capability.
[44] Qwen-3D: A Generalist 3D Vision-Language Model for Spatial Understanding cs.CVPDF
Lucy Lin, Ayush Jain, Yifan Liu, Katerina Fragkiadaki
TL;DR: 本文提出了Qwen-3D，一个用于空间理解的通用3D视觉-语言模型。该模型通过多视图几何线索在Qwen骨干网络内压缩视觉信息，并引入3D旋转位置嵌入，使注意力机制直接在3D场景空间中操作，从而支持高效的跨视图和时序推理。此外，它集成了一个基于查询的分割解码器，将语言直接关联到底层3D场景表示，统一了图像和视频中的指代定位、实例分割和视觉问答任务。
Details
Motivation: 现有大型多模态模型在图像和短视频上表现出色，但扩展到长视频仍面临挑战，主要受限于以帧为中心的标记化和有限的上下文窗口。同时，尽管近期3D LMMs利用几何感知表示改进了空间推理，但在定位和分割任务上仍落后于专门的3D感知系统。作者认为，几何感知解码是关键瓶颈，现有方法通过语言标记、提议选择或轻量级定位查询来传达3D预测，在语言推理和密集几何预测之间形成了瓶颈。
Result: 在多个基准测试中，Qwen-3D超越了现有的3D LMMs，并优于几个大型专有的2D模型。同时，通过联合训练2D和3D数据，Qwen-3D在标准2D视觉-语言基准测试上保持了强大的性能。
Insight: 创新点在于将3D几何作为一种自然的视觉流压缩机制，并提出了3D旋转位置嵌入，使注意力机制能直接在3D场景空间中操作，而非跨独立图像帧，从而实现了可扩展的跨视图和时序推理。此外，通过基于查询的分割解码器直接桥接语言和几何，统一了多种3D视觉任务，这是从客观角度分析的一个显著进步。
Abstract: Large Multimodal Models (LMMs) have achieved remarkable success on images and short videos, yet scaling them to long videos remains challenging due to frame-centric tokenization and limited context windows. 3D geometry provides a natural compression mechanism for visual streams: depth and camera pose enable observations from multiple views and time steps to be fused into a persistent, world-aligned representation. While recent 3D LMMs leverage geometry-aware representations to improve spatial reasoning, they continue to lag behind specialist 3D perception systems on grounding and segmentation tasks. We argue that a key limitation is geometry-aware decoding: existing methods communicate 3D predictions through language tokens, proposal selection, or lightweight grounding queries, creating a bottleneck between language reasoning and dense geometric prediction. Building on these insights, we introduce Qwen-3D, a geometry-aware LMM that compresses visual information within the Qwen backbone using multi-view geometric cues, enabling efficient long-horizon visual reasoning over static scenes. Qwen-3D augments visual tokens with 3D Rotary Positional Embeddings, allowing attention to operate directly in 3D scene space rather than across independent image frames and thereby facilitating scalable cross-view and temporal reasoning. To bridge language and geometry, Qwen-3D incorporates a query-based segmentation decoder that grounds language directly in the underlying 3D scene representation, unifying referential grounding, instance segmentation, and visual question answering across both images and videos. Across a diverse set of benchmarks, Qwen-3D surpasses existing 3D LMMs and outperforms several large proprietary 2D models. Notably, Qwen-3D achieves these improvements while maintaining strong performance on standard 2D vision-language benchmarks by jointly training on 2D and 3D data.
[45] Clinically-Grounded Hierarchical Classification for Consistent Chest X-ray Interpretation cs.CVPDF
Jong Hak Moon, Minjun Kim, Minjun Kim
TL;DR: 本文提出了一种名为CHASE的层次化分类框架，用于提升胸部X光片解读的准确性和一致性。该方法通过模仿放射科医生从粗到细的推理过程，在统一的视觉Transformer骨干网络中联合优化多级监督、跨级概率对齐和层次违规惩罚，确保细粒度预测与粗粒度的解剖学上下文保持一致。
Details
Motivation: 现有自动化系统将胸部X光片解读视为扁平分类问题，忽略了异常检测中固有的层次性（如解剖区域到具体病理发现）以及不同层级预测间的依赖与一致性，这限制了其临床实用性。
Result: 实验表明，CHASE在所有层级（解剖区域、子区域、病理发现）上的性能均优于扁平和分层基线方法，并实现了更优的概率层次一致性，其层级注意力图也证实了预测具有解剖学依据。
Insight: 核心创新在于将临床驱动的三层分类法（9个解剖区域、17个子区域、28个病理发现）整合到一个单阶段框架中，并通过联合优化层次化损失函数来强制实现跨层级预测的解剖学一致性，这为医学影像分析提供了更符合临床推理范式的建模思路。
Abstract: Accurate chest X-ray interpretation is inherently hierarchical. Clinical decisions depend not only on what abnormality is present but where it is situated, requiring reasoning from broad anatomical systems down to specific pathological findings. Yet existing automated systems largely treat this as a flat classification problem, failing to capture inter-level dependencies or enforce coherence between coarse and fine predictions. We propose CHASE (Classification with Hierarchical Analysis and Structured Enforcement), a unified single-stage framework that mirrors radiologists’ coarse-to-fine reasoning through a clinically driven three-level taxonomy of 9 anatomical regions, 17 sub-regions, and 28 pathological findings. CHASE jointly optimizes multi-level supervision, cross-level probability alignment, and a hierarchy-violation penalty within a shared Vision Transformer backbone. This ensures that fine-grained findings are anatomically supported by their coarser-level context rather than predicted in isolation. Experiments demonstrate that CHASE outperforms flat and hierarchical baselines across all levels while achieving superior probabilistic hierarchy consistency, with level-wise attention maps confirming anatomically grounded predictions. Code is available at: https://github.com/yejix-ai/CHASE.
[46] CAPE-T2V: Captioner-Anchored Prompt Enhancement toward Two-Sided Conditioning Alignment in Text-to-Video Generation cs.CVPDF
Yizhuo Jia, Jingyun Hua, Yuanxing Zhang
TL;DR: 本文提出CAPE-T2V框架，通过一个锚定于视频描述生成器的提示增强器（PE）进行两步微调，旨在弥合文本到视频（T2V）生成中训练时使用的详细视频描述与推理时使用的用户提示之间的差距（PE-Caption gap）。
Details
Motivation: 现有T2V扩散变换器（DiT）使用详细视频描述训练，但推理时依赖提示增强器（PE）重写的用户提示，两者在细节选择、信息组织、描述粒度和措辞上存在不匹配，即PE-Caption gap，影响了生成质量。
Result: 在StoryEval、VBench-2.0和T2V-CompBench基准测试中，CAPE-T2V在Wan2.2和LTX-2.3模型上获得了比基线更高的综合分数；其DiT微调描述与推理时PE输出的分布差距（通过平方最大均值差异衡量）更小。
Insight: 创新点在于构建了三种PE训练样本对（简洁/详细源描述或伪用户提示与描述器生成的目标配对），并两步微调PE和DiT，实现了条件对齐；该方法可推广至其他需要对齐训练与推理文本条件的生成任务。
Abstract: Text-to-video (T2V) diffusion transformers (DiTs) are trained with detailed video captions, whereas inference often relies on user prompts rewritten by a prompt enhancer (PE). Prior work has improved generation by optimizing the PE, the DiT, or both; some methods have also sought to narrow the training-inference mismatch through shared schemas. Yet even within a shared schema, inference-time PE outputs and DiT training captions may still differ in detail selection, information organization, descriptive granularity, and phrasing. We refer to this residual mismatch as the PE-Caption gap and introduce CAPE-T2V, a two-step Captioner-Anchored Prompt Enhancement framework toward two-sided conditioning alignment in T2V generation. First, CAPE-T2V constructs three types of PE training examples, pairing captioner-generated targets with concise source captions, detailed source captions, or pseudo user prompts derived from those targets. It then fine-tunes the PE to map each input to its paired target. Second, CAPE-T2V fine-tunes the DiT on video-derived captions rewritten by the Anchored PE; the same PE rewrites user prompts at inference. Relative to a baseline using the same caption schema, CAPE-T2V achieves higher aggregate scores on StoryEval, VBench-2.0, and T2V-CompBench across Wan2.2 and LTX-2.3. Further, CAPE-T2V exhibits a smaller PE-Caption gap than the baseline: its DiT fine-tuning captions are closer in distribution to inference-time PE outputs, as measured by squared maximum mean discrepancy in a fixed embedding space. Overall, these results support CAPE-T2V as an effective approach to mitigating the PE-Caption gap. The project is available at https://github.com/yizzz927/CAPE-T2V.
[47] Global Graph-Validated Optimization for VLM-based 3D Indoor Scene Generation cs.CVPDF
Jialu Huang, Yingxuan You, Fei Wang, Zheng Dang
TL;DR: 本文提出了一种基于图表示和混合搜索优化的方法，用于解决开放词汇3D室内布局生成中全局一致性和物理可行性的问题。该方法通过全局语义验证（GSV）构建结构化图来确保语义一致性，并结合全局物理可行性搜索（GPFS）进行混合优化，从而生成多样且物理合理的3D场景。
Details
Motivation: 现有方法主要依赖大型语言模型（LLMs）和视觉语言模型（VLMs），但通常隐式建模资产间关系或依赖局部成对约束与优化，导致生成的布局在全局上不一致或物理不可行，因此需要一种能处理全局非凸布局空间的解决方案。
Result: 实验表明，该方法在开放词汇3D室内布局生成任务中达到了最先进（SOTA）性能，显著提升了语义一致性和物理合理性。
Insight: 创新点在于将语义一致性与物理可行性分离，通过图结构的中间表示进行显式全局验证，并结合进化搜索（全局探索）与基于梯度的优化（局部利用）的混合策略，从而减少对VLM初始化的依赖，增强在非凸、不连续可行空间中的鲁棒性。
Abstract: We study open-vocabulary 3D indoor layout generation, which synthesizes diverse and physically plausible scenes from unlabeled 3D assets using free-form language instructions. Recent methods leverage large language models (LLMs) and vision-language models (VLMs) to generate structured scenes from text. However, most model inter-asset relations implicitly or rely on local pairwise constraints and local optimization. These formulations are poorly aligned with the global, highly non-convex layout space, often yielding locally plausible yet globally inconsistent or physically infeasible scenes. We address this problem with a graph-based intermediate representation that separates semantic coherence from physical feasibility, together with a hybrid search-and-refinement strategy. First, Global Semantic Verification (GSV) represents scenes as structured graphs and enforces semantic constraints through rule-based verification. This explicit validation removes contradictory configurations and produces a globally consistent semantic scaffold. Second, Global Physical Feasibility Search (GPFS) combines evolutionary search for global exploration with gradient-based refinement for local exploitation. It reduces dependence on VLM-proposed initialization and improves robustness in non-convex and discontinuous feasible spaces. Together, GSV and GPFS move layout generation beyond local relational modeling and initialization-sensitive optimization toward globally consistent reasoning and search. Experiments show that our method achieves state-of-the-art performance in open-vocabulary 3D indoor layout generation, improving both semantic consistency and physical plausibility.
[48] RIDGE: Re-Noising with Internal Dynamic Guidance for Image Editing cs.CVPDF
Ruiliang Gong, Zhen Wang, Yanghao Wang, Long Chen
TL;DR: RIDGE是一种无需反演和训练的基于流的图像编辑方法，它通过重新加噪和内部动态引导来改进编辑过程。该方法将编辑状态视为对不可用干净目标状态的动态近似，并利用与干净源状态相同的噪声样本进行重新加噪，使噪声位移随噪声水平增加而自然减小。在早期高噪声步骤中，RIDGE应用内部动态引导，通过模型内部生成的软动态掩码，引导临时编辑状态向预测的干净目标状态对齐，无需外部分割或检测模型。
Details
Motivation: 现有的免反演基于流的图像编辑方法（如等位移构造）在每一步都需要目标侧状态，且保持噪声源状态与目标侧状态之间的位移跨噪声水平不变，这与加噪过程中位移应随噪声水平增加而收缩的特性不一致，可能导致高噪声水平下更新过于激进。
Result: 在SD3 Medium和FLUX.1-dev两个骨干网络上，使用两个基准测试的实验表明，RIDGE在源图像保持、目标对齐和感知质量之间实现了有利的综合权衡。
Insight: 创新点在于提出了重新加噪机制以保持噪声位移的自然收缩，并引入了完全内部、无需外部模型的动态引导（通过软动态掩码）来在编辑早期聚焦于需要修改的区域，从而实现了训练免费且反演免费的图像编辑。
Abstract: Inversion-free flow-based image editing avoids latent inversion, but still requires a target-side state at every editing step. The widely used equal-displacement construction keeps the displacement between the noisy source state and the target-side state unchanged across noise levels. This is inconsistent with noising, under which the displacement between two clean states noised with the same noise level and noise sample should contract as the noise level increases. Thus, it can lead to overly aggressive updates at high noise levels. We introduce RIDGE: Re-Noising with Internal Dynamic Guidance for Image Editing, an inversion-free and training-free method that maintains the edited state as an evolving approximation to the unavailable clean target state. RIDGE re-noises this approximation using the same noise level and noise sample as the clean source state, allowing their noisy displacement to decrease naturally with increasing noise. Since the edited state initially contains limited target semantics, RIDGE further applies internal dynamic guidance during the early high-noise steps. A clean target state prediction guides the provisional edited state through a soft dynamic mask derived internally from the model, focusing guidance on regions that require modification without external segmentation or detection models. Experiments on two benchmarks using two backbones, SD3 Medium and FLUX.1-dev, show that RIDGE offers a favorable aggregate trade-off among source preservation, target alignment, and perceptual quality.
[49] LDU-Bench: Multimodal LLM Evaluation for Lithography Defect Understanding under Layout-Varying Circuit Backgrounds cs.CVPDF
Huanglong Ji, Botong Zhao, Shujing Lv, Yue Lv
TL;DR: 本文提出了LDU-Bench，一个用于光刻缺陷理解的多任务多模态基准测试。该基准基于真实的光刻和集成电路检测图像构建，将检测工作流分解为缺陷分类、形态识别、粗定位和图像条件原因分析四个独立任务，并采用任务级指标、诊断报告和光刻闭合分数进行系统评估。
Details
Motivation: 现有多模态大语言模型在工业异常检测中展现出强大的缺陷识别能力，但在光刻检测中，仅判断图像是否包含缺陷对于工程检测是不够的；模型还必须理解缺陷的形态、空间位置以及基于可见证据的潜在原因。
Result: 实验结果表明，尽管现有的MLLMs能够相对可靠地执行缺陷分类任务，但这种能力并不能稳定地迁移到下游检测阶段。形态对齐、有效定位和从证据到原因的映射仍然是主要瓶颈。诊断分析表明，这种能力断层并非单一指标的波动，而是反映了跨语义层次的结构化理解不足。
Insight: 论文的创新点在于构建了一个针对特定工业场景（光刻缺陷理解）的、任务分解精细的多模态基准测试，并提出了一个综合评估指标（LCS）。这为评估工业MLLMs在真实工作流中的可用性、失败点和能力边界提供了一个可量化、可诊断的统一平台。
Abstract: Multimodal large language models have demonstrated strong defect recognition capability in industrial anomaly detection. However, in lithography review, merely determining whether an image contains a defect is insufficient for engineering inspection; models must also understand defect morphology, spatial location, and the potential causes supported by visible evidence. To this end, this paper proposes LDU-Bench, a multi-task multimodal benchmark for lithography defect understanding. Constructed from real lithography and integrated-circuit review images, LDU-Bench decomposes the review workflow into four independent tasks: defect triage, morphology recognition, coarse localization, and image-conditioned cause analysis. It systematically evaluates models using task-level metrics, diagnostic readouts, and the Lithography Closure Score (LCS). Experimental results show that although existing MLLMs can perform defect triage relatively reliably, this ability does not stably transfer to downstream review stages. Morphology alignment, effective localization, and evidence-to-cause mapping remain the major bottlenecks. Further diagnostics indicate that this capability break is not a fluctuation of a single metric, but reflects insufficient structured understanding across semantic levels. Overall, LDU-Bench provides a quantifiable and diagnostic unified platform for evaluating the usability, failure points, and capability boundaries of industrial MLLMs in lithography review chains.
[50] GSTEP: Global Spatio-Temporal Density-Driven Visual Token Pruning for Efficient Video Large Language Models cs.CV | cs.CLPDF
Mengjie Zhang, Qihui Zhu, Tao Zhang, Shuangwu Chen, Huihuang Qin
TL;DR: 本文提出了GSTEP（全局时空密度剪枝），一种即插即用的视觉令牌剪枝框架，旨在高效处理视频大语言模型（VideoLLMs）中冗余的时空视觉令牌。该方法将视频建模为连续的时空信息流，通过结合平滑的帧级变化信号得到的连续时间密度和帧内空间密度，构建令牌级时空密度，并基于信息密度和覆盖范围进行全局令牌采样。实验表明，GSTEP在多个VideoLLM和公开基准测试中实现了优异的准确率-效率权衡，并能泛化到不同模型架构和评估设置。
Details
Motivation: 现有视频大语言模型的推理成本高昂，主要源于长视频中大量冗余的时空视觉令牌。现有令牌剪枝方法多采用分段级局部剪枝，将视频分割为孤立片段并在每个片段内独立选择令牌，这可能导致短但语义密集的片段保留不足，并丢弃局部不显著但从全局视角看关键的令牌。
Result: 在LLaVA-OneVision-7B模型上，GSTEP剪枝了75%的视觉令牌，在多个基准测试中保持了原始平均性能的100.2%，并实现了1.17倍的端到端加速。在多个VideoLLM和公开基准测试上的广泛实验表明，GSTEP始终实现了强大的准确率-效率权衡，并具有良好的泛化能力。
Insight: 创新点在于将视频视为连续的时空信息流进行全局建模，而非孤立片段，通过结合连续时间密度和帧内空间密度来构建令牌级时空密度，并联合平衡信息密度和覆盖范围进行全局令牌采样。这解决了局部剪枝方法可能忽略全局语义重要性的问题，提供了一种更有效的令牌剪枝策略。
Abstract: Video large language models (VideoLLMs) achieve strong video understanding performance, but their inference remains expensive due to the large number of redundant spatio-temporal visual tokens in long videos. Existing token pruning methods alleviate this cost by reducing redundant tokens, yet most of them rely on segment-level local pruning, where videos are partitioned into isolated segments and tokens are selected independently within each segment. Such designs may under-preserve short but semantically dense segments and discard tokens that appear non-salient locally but remain critical from a global perspective. To address this issue, we propose GSTEP (Global Spatio-Temporal Density Pruning), a plug-and-play pruning framework that models video as a continuous spatio-temporal information flow. GSTEP constructs a token-level spatio-temporal density by combining a continuous temporal density, obtained from a smoothed centered frame-level change signal, with intra-frame spatial density, and then performs global token sampling by jointly balancing information density and coverage. Extensive experiments on multiple VideoLLMs and public benchmarks demonstrate that GSTEP consistently achieves strong accuracy-efficiency trade-offs and generalizes well across model architectures and evaluation settings. On LLaVA-OneVision-7B, GSTEP prunes 75% of visual tokens, preserves up to 100.2% of the original average performance across benchmarks, and achieves a 1.17 end-to-end speedup.
[51] Channel-wise Dynamic Knowledge Distillation via Adaptive Sample Generation for Action Recognition cs.CVPDF
Ping Li, Chenhao Ping, Jie Song, Mingli Song
TL;DR: 本文提出了一种用于动作识别的自适应样本感知通道级动态知识蒸馏方法，旨在解决现有知识蒸馏方法在固定输入样本和均匀蒸馏强度方面的局限性。该方法通过自适应样本生成模块创建融合了样本梯度语义的更新样本，并利用通道级动态蒸馏模块根据样本梯度和特征频率动态调整各通道的蒸馏强度，从而更有效地将大型教师模型的知识迁移到小型学生模型中。
Details
Motivation: 现有知识蒸馏方法在动作识别中存在两个关键问题：一是依赖固定输入样本导致教师模型与学生模型之间的特征对齐效果不佳；二是对所有通道采用统一的蒸馏强度，未能考虑不同通道在不同训练阶段捕获不同知识的重要性差异。
Result: 在三个视频基准数据集和两个图像数据集上的大量实验表明，该方法达到了最先进的性能水平。
Insight: 创新点在于提出了一个两阶段框架：1）通过结合样本梯度语义和通道质心频率差异加权特征损失的自适应样本生成模块，动态生成训练样本以优化特征对齐；2）引入通道级动态蒸馏模块，根据样本梯度和特征频率动态调整各通道的蒸馏强度，从而更精细地迁移知识。此外，周期性更新样本而非每轮更新也提高了效率。
Abstract: Knowledge Distillation (KD) offers a promising yet underexplored path for compressing large action recognition models. However, existing KD methods suffer from two key limitations: 1) reliance on fixed input samples leads to suboptimal feature alignment between the frozen teacher (larger model) and the learnable student (smaller model), and 2) applying a uniform distillation strength for all channels fails to account for their varying importance in capturing distinct knowledge (e.g., motion tempo or magnitude) across training epochs. This motivates us to develop an Adaptive Sample-aware Channel-wise Dynamic (ASCD) KD approach, which operates in two stages. First, we use an adaptive sample generation module to create updated samples by incorporating semantics from sample gradients, which are derived by minimizing a feature loss weighted by channel centroid frequency differences at each layer. Meanwhile, crucial motion-related details are preserved by applying a Gaussian mask to frequency features. Second, we employ a channel-wise dynamic distillation module to train student on these generated samples, guided by sample gradients and feature frequencies. For efficiency, samples are updated periodically rather than per epoch. Extensive experiments on three video benchmarks (UCF101, Kinetics-400, Something-Something-v2) and two image datasets (CIFAR-100, ImageNet) demonstrate the state-of-the-art performance of our method. Code is available at https://github.com/mlvccn/ASCD_KD_Action.
[52] CorePath: A Breast-Specialized Pathology Foundation Model for Core Needle Biopsy Diagnosis and Risk-Controlled Report Generation cs.CV | cs.AI | cs.LG | stat.APPDF
Ting Yin, Danning Li, Chen Shu, Xiaoxia Yao, Boyu Fu
TL;DR: 本文提出了CorePath，一个专门针对乳腺核心针穿刺活检（CNB）诊断的多模态病理学基础模型。该模型通过在两个中心的7901对CNB全切片图像和诊断报告上对PRISM模型进行微调得到。评估表明，CorePath在癌症检测、浸润评估和组织学分型等任务上超越了基础模型PRISM和领先的病理学基础模型，并在报告生成中显著减少了非乳腺相关的幻觉。进一步提出的CorePath-CRG结合了风险控制机制，实现了选择性报告生成和零非乳腺幻觉。
Details
Motivation: 乳腺核心针穿刺活检（CNB）是乳腺癌诊断的关键，但由于组织样本有限、病变异质性以及形态学特征重叠，准确区分亚型具有挑战性。因此，需要开发一个专门针对乳腺病理、能够准确诊断并生成可靠报告的AI模型。
Result: 在六个私有CNB队列和两个公共乳腺病理学基准（BCNB和BRACS）上评估，无需任务特定再训练。CorePath在五类CNB组织学分型上加权AUC达到0.9526-0.9735；在公共基准上，其加权AUC在BCNB浸润癌分型、BRACS病变分层和BRACS细粒度分类任务上分别达到0.7780、0.8178和0.8252，均优于领先的病理学基础模型。报告生成中，非乳腺幻觉从30.1%降至2.8%。CorePath-CRG在发布的输出中实现了零非乳腺幻觉，并在基于病理学家验证的LLM评估分数和定量报告生成指标上表现出最强的综合性能。
Insight: 论文宣称的创新点在于开发了一个针对特定领域（乳腺病理）的多模态基础模型，并通过领域专业化微调和风险控制机制（Conformal风险控制与Learn-Then-Test）显著提升了诊断准确性和报告生成的可靠性。从客观角度看，其核心创新在于将领域专业化（而非通用）的病理学基础模型与统计风险控制框架相结合，为AI辅助诊断提供了高可靠性和安全性的新范式。
Abstract: Breast core needle biopsy (CNB) is central to breast cancer diagnosis yet remains challenging because limited tissue sampling, lesion heterogeneity, and subtle morphologic overlap can obscure subtype distinctions. We developed CorePath, a breast-specialized multimodal pathology foundation model fine-tuned from PRISM using 7901 paired CNB whole-slide images and diagnostic reports from two centers. Evaluated across six CNB cohorts and two public breast pathology benchmarks without task-specific retraining, CorePath consistently outperformed PRISM across cancer detection, invasion assessment, and histological subtyping. It achieved weighted area under the receiver operating characteristic curves (AUCs) of 0.9526-0.9735 for five-class CNB histological subtyping across private centers. On public benchmarks, CorePath outperformed leading pathology foundation models, achieving the highest weighted AUCs of 0.7780 for BCNB invasive carcinoma subtyping, 0.8178 for BRACS lesion stratification, and 0.8252 for BRACS fine-grained classification. In report generation, CorePath reduced the overall non-breast hallucinations from 30.1% to 2.8%, demonstrating improved domain fidelity after breast-specific adaptation. CorePath-CRG further combined conformal subtype-confidence gating with Learn-Then-Test risk control to enable selective report release, subtype-level fallback, and deferral. CorePath-CRG achieved zero non-breast hallucinations among released outputs and showed the strongest overall performance in pathologist-validated LLM-based Evaluation Scores and quantitative report-generation metrics across most centers. These results demonstrate that domain-specialized foundation models with statistical risk control offer a promising approach for accurate breast CNB diagnosis and reliable report generation.
[53] SUV: Future Scene Understanding as Video Generation for End-to-End Driving cs.CVPDF
Yibo Yuan, Jiacheng Fu, Jiangtong Zhu, Yi Li, Jianhua Han
TL;DR: 本文提出SUV框架，将端到端驾驶中的未来场景理解统一为视频生成任务，利用预训练视频基础模型预测外观、语义、相对深度和实例级动态等多模态未来流，并通过联合视频-动作注意力机制生成自车轨迹。该方法无需特定任务头或候选轨迹选择，在多个基准测试中达到SOTA性能。
Details
Motivation: 现有端到端驾驶方法使用任务特定的输出头和格式建模未来场景，可扩展性有限；本文旨在探索视频生成能否作为共享预测器，统一未来场景理解与轨迹规划。
Result: 在NAVSIM-v2的navtest和navhard分割上分别取得91.0 EPDMS和36.9的SOTA性能；在长尾WOD-E2E基准上获得7.94 RFS的竞争性结果。
Insight: 创新点包括将多模态未来场景预测统一为视频生成流，并引入联合视频-动作注意力机制直接生成轨迹；结构化未来监督和直接访问未来流可提升规划性能，为端到端驾驶提供了可扩展的统一框架。
Abstract: End-to-end driving requires a coherent understanding of future scenes, yet existing methods model these scenes using task-specific heads and output formats, with limited scalability. Can video generation instead provide a shared predictor? We introduce SUV, a unified end-to-end driving framework that casts future Scene Understanding as Video generation using a pretrained video foundation model. SUV models future appearance, semantics, relative depth, and instance-level dynamics as video streams with a shared video expert, without stream-specific visual prediction heads. Through joint video-action attention, the action expert attends to the latent representations of all future streams and generates the ego trajectory. Experiments show that SUV directly predicts all four future streams, while controlled ablations show that structured future supervision and direct future-stream access yield higher trajectory planning scores. With only a single front camera and no candidate-trajectory selection, SUV outperforms a broad set of recent state-of-the-art methods on both NAVSIM-v2 splits, achieving 91.0 EPDMS on navtest and 36.9 on navhard. On the long-tail WOD-E2E benchmark, SUV achieves a competitive RFS of 7.94.
[54] Multimodal Plant Root Phenotyping with Integration of 3D Skeleton Extraction and Language Analysis cs.CV | cs.ROPDF
Jiakai Lin, Zijun Li, Guoyu Lu
TL;DR: 本文提出了一种多模态机器人AI框架，用于植物根系表型分析，通过结合3D骨架提取和语言引导推理，实现可解释且数据高效的分析。该方法利用基于加权拉普拉斯收缩的无监督骨架提取网络从密集点云生成高保真结构表示，并计算形态描述符，再通过证据优先的语言建模框架微调GPT作为交互式分析聊天机器人，将定量形态学与语义解释相结合。
Details
Motivation: 植物根系表型分析对于理解地下结构、优化作物管理和提高农业可持续性至关重要，但现有方法缺乏可解释性和数据效率，需要一种能够整合几何感知与语义推理的统一框架。
Result: 实验表明，该结构引导框架在12种不同根系结构的植物物种上实现了稳健且可解释的推理，通过集成无监督3D几何感知和大规模语言理解，建立了可解释机器人植物根系表型分析的统一范式。
Insight: 创新点包括基于加权拉普拉斯收缩的无监督骨架提取网络用于高保真结构表示，以及证据优先的语言建模框架，通过先提供可测量证据再进行自然语言推理，使GPT能够基于定量形态学进行接地解释，从而桥接定量分析与语义解释。
Abstract: Plant root phenotyping is fundamental to understanding below-ground structures, optimizing crop management, and improving agricultural sustainability. This paper presents a multimodal robotic AI framework that integrates 3D skeleton extraction with language-guided reasoning for interpretable and data-efficient root analysis. We develop an unsupervised skeleton extraction network based on Weighted Laplacian Contraction (W-LBC) to generate high-fidelity structural representations from dense point clouds captured by robotic 3D sensing platforms. Quantitative morphological descriptors, including root count, length, branching angle, and density, are computed from the reconstructed skeleton graph to capture geometric and topological characteristics. Building on these features, we introduce an Evidence-First language modeling framework that fine-tunes GPT as an interactive analytical chatbot using automatically generated instruction–response pairs. Each training sample provides measurable evidence before natural-language reasoning, enabling the model to ground interpretation in quantitative morphology. Through supervised fine-tuning, GPT associates numerical structure with semantic meaning, producing biologically consistent explanations of growth patterns and adaptive traits. Experiments show that the structure-guided framework achieves robust, interpretable reasoning across 12 plant species with diverse root architectures. By integrating unsupervised 3D geometric perception with large-scale language understanding, our approach bridges quantitative analysis and semantic interpretation, establishing a unified paradigm for explainable robotic plant root phenotyping.
[55] Adaptive Two-Stage Visual Token Pruning for Efficient Inference in Video-Language Models cs.CV | cs.AIPDF
Paribesh Regmi, Qingshuang Chen, Chi Zhang, Heba Aly, Yelin Kim
TL;DR: 本文提出一种用于视频语言模型的自适应两阶段视觉令牌剪枝方法，以降低推理延迟。该方法首先剪除冗余帧，然后在保留的帧内进行令牌级剪枝，其中第二阶段的剪枝比例根据视频内容自适应确定。该方法无需额外训练，在仅保留10%令牌的情况下，在视频描述基准上准确率提升7%，同时计算量减少95%。
Details
Motivation: 现有视觉语言模型因处理大量令牌导致推理延迟高，尤其在视频处理中需同时分析多帧，现有令牌缩减技术主要针对单图像输入，无法利用视频序列中的时间和帧间冗余，且通常采用固定剪枝比例，未能适应不同视频的冗余差异。
Result: 在视频描述基准上，该方法在仅保留10%令牌时准确率提升7%，计算量（TFLOPs）减少95%，实现了显著的效率提升。
Insight: 创新点在于针对视频处理设计了两阶段自适应剪枝策略，利用令牌嵌入的相关性结构量化冗余以动态确定剪枝比例，且该方法为后处理无需训练，兼顾了效率与性能。
Abstract: Vision-language models excel at image and video understanding but suffer from high inference latency due to the need to process thousands of tokens per image, limiting their deployment on resource-constrained edge devices and in real-time surveillance applications. This challenge is further amplified in video processing, where multiple frames must be analyzed simultaneously. Existing token reduction techniques are largely developed for single-image inputs and therefore fail to account for the temporal and inter-frame redundancies present in video sequences. In addition, these methods generally rely on a fixed, uniform pruning ratio applied across all inputs, which is suboptimal because the degree of redundancy can vary significantly between different videos, necessitating content-dependent pruning levels to preserve critical information. To address these limitations, we propose a two-stage adaptive token pruning strategy specifically designed for video processing. In the first stage, we prune out the redundant frames, and in the second stage, token-level pruning is applied within the retained frames. Crucially, the pruning ratio in the second stage is determined adaptively based on the content of each video. This is achieved by analyzing the correlation structure of token embeddings to quantify redundancy, which is used to determine the ratio. Importantly, our method is entirely post-hoc and requires no additional training or fine-tuning, while achieving strong empirical gains; notably, it improves accuracy by +7% on a video captioning benchmark at 10% token retention, while reducing computation TFLOPs by 95%.
[56] SeCo-SBIR: Semantically Consistent Prompt Learning for Zero-Shot Sketch-Based Image Retrieval cs.CVPDF
Long Hoang Dang, Tuan Nguyen Huu, Nguyen Minh Hieu, Tu Minh Phuong
TL;DR: 本文提出了SeCo-SBIR框架，通过语义一致的提示学习来改进CLIP模型在零样本草图-图像检索任务中的性能。该方法采用文本引导的多模态提示策略，将可学习的提示向量通过文本编码器注入视觉编码器，并结合扰动一致性约束来防止过拟合，从而在保持模型泛化能力的同时适应草图-照片的领域差异。
Details
Motivation: 解决在零样本草图-图像检索任务中，通过提示学习适配CLIP模型时面临的矛盾：既需要针对任务进行领域适配以弥合草图与照片的领域差距，又要避免过拟合到已见类别并损害CLIP原有的零样本泛化能力。
Result: 在三个标准的ZS-SBIR基准测试上（包括分类、泛化和跨数据集设置）均取得了最先进的结果，达到了SOTA水平。
Insight: 创新点在于提出了文本引导的多模态提示策略，将文本编码器学习到的抽象语义知识直接注入视觉通路以增强泛化；同时设计了基于扰动的不对称InfoNCE一致性约束，将可学习分支锚定在冻结CLIP的通用特征空间中，有效平衡了领域适应与泛化。
Abstract: Adapting CLIP for zero-shot sketch-based image retrieval (ZS-SBIR) via prompt learning faces a fundamental tension: the model must bridge the sketch-photo domain gap through task-specific adaptation, yet the added flexibility risks overfitting to seen training categories and eroding CLIP’s zero-shot generalization. We present SeCo-SBIR, a semantically consistent prompt learning framework that resolves this tension from both sides. First, a text-guided multi-modal prompting strategy routes learnable prompt vectors through CLIP’s text encoder and projects the resulting intermediate representations into the visual encoder at every layer via learnable coupling functions. Because the text encoder has already learned robust, abstract category-level semantics from large-scale language supervision, this mechanism injects transferable semantic knowledge directly into the visual pathway - adapting the model to the sketch-photo domain while inherently favoring generalization to unseen classes. Second, a perturbation-based consistency constraint addresses the residual overfitting risk from the learnable coupling functions by aligning the adapted model with a frozen CLIP reference branch using an asymmetric InfoNCE objective - augmented inputs feed the frozen branch while clean inputs feed the trainable branch - anchoring the learned representations to CLIP’s generalizable feature space. Together with lightweight adapters and a multi-objective loss combining triplet, NT-Xent, and classification terms, SeCo-SBIR achieves state-of-the-art results on all three standard ZS-SBIR benchmarks across categorical, generalized, and across-dataset settings.
[57] From Routes to Steps: Separating Semantic Progress from Local Execution in Vision-and-Language Navigation cs.CV | cs.ROPDF
Xiangyun Huang, Xiangchen Wang, Runfeng Lin, Yihao Xu, Kangyu Huang
TL;DR: 论文提出Route2Step框架，用于视觉语言导航任务，通过将语义进度跟踪与动作生成解耦来解决现有方法中进度跟踪错误与执行错误难以区分的问题。该框架包含指令分析模块和动作生成模块，并利用E-SPA步骤对齐程序进行无人工标注的监督。
Details
Motivation: 现有基于VLM的导航器通常仅通过下一动作预测来监督进度跟踪和执行能力，导致当智能体偏离路线时，难以区分是选择了错误的子指令还是未能执行正确的指令，从而可能从错误的进度状态继续决策。
Result: 在R2R-CE基准测试上，Route2Step将成功率从48.1%提升至55.3%，将路径长度加权成功率从43.3%提升至48.2%，仅需11.5K个直接动作监督状态，同时利用了190K个状态级纠正样本。在真实室内外环境的实验进一步证明了其实用性。
Insight: 核心创新点在于通过显式的步骤级接口解耦语义进度跟踪与动作生成，并提出了E-SPA这一无需人工时序标注的步骤对齐程序来监督进度状态，从而更有效地利用纠正样本并提升导航性能。
Abstract: Vision-and-Language Navigation (VLN) requires an agent to follow a route-level instruction by executing its constituent steps from egocentric visual observations. Existing VLM-based navigators typically supervise both capabilities through next-action prediction alone, making progress-tracking errors difficult to distinguish from execution errors. When an agent deviates from the route, a corrective action label may recover the next movement but does not indicate whether the agent selected the wrong sub-instruction or failed to execute the correct one. Consequently, the agent may continue making decisions from an erroneous progress state. To resolve this ambiguity, we propose \textbf{Route2Step}, a framework that decouples semantic progress tracking from action generation through an explicit step-level interface. The Instruction Analysis Module ($\mathcal{M}{\mathrm{IA}}$) predicts this state from the global instruction and visual history. Conditioned on the predicted state and recent observations, the Action Generation Module ($\mathcal{M}{\mathrm{AG}}$) generates local action chunks. To supervise the progress state without manual temporal labels, E-SPA, a step-alignment procedure, associates sub-instructions with their corresponding portions of route-level demonstrations. These alignments enable state supervision for incorrect progress estimates, while direct action supervision is reserved for rollout groups that repeatedly fail under the correct active sub-instruction. On R2R-CE, Route2Step improves SR from 48.1% to 55.3% and SPL from 43.3% to 48.2%, using 190K state-level corrective samples while requiring only 11.5K directly action-supervised states. Experiments in real-world indoor and outdoor environments further demonstrate the practical applicability of Route2Step. The project page is: https://sisyphus-hxy.github.io/Route2Step/.
[58] CROSS: Cascaded Distillation and Dual-Constraint Grounding for Remote Sensing Referring Segmentation cs.CVPDF
Tingzhang Luo, Ruizhong Liu, Yichao Liu, Cheng Fan, Yu Liu
TL;DR: 本文提出CROSS框架，通过语言引导级联蒸馏和视角-空间对比学习，解决遥感指代分割中的架构弱耦合和对象中心语义偏差问题，实现了紧密集成的遥感指代分割新范式。
Details
Motivation: 针对现有遥感指代分割方法存在的架构弱耦合（单向信息流导致定位漂移）和对象中心语义偏差（过度依赖主导对象语义而忽视空间推理）两大根本局限。
Result: 在遥感指代分割基准测试上实现了最先进的性能，即使在严重空间描述扰动下也能保持精确定位。
Insight: 创新点包括：1) 语言引导级联蒸馏将SAM的几何亲和力作为软正则化器注入VLM中间层，注入密集结构先验以优化定位；2) 视角-空间对比学习通过挖掘掩码过滤的欺骗性干扰项和空间-语言反事实作为硬负样本，施加跨锚点约束，显式打破语义捷径以强制真正的逻辑一致性。
Abstract: Referring Remote Sensing Image Segmentation (RRSIS) has achieved significant progress through the integration of VLMs and the Segment Anything Model (SAM). However, this progress largely relies on strong pre-trained capabilities, while leaving two fundamental limitations insufficiently addressed: (1) Architectural Weak-Coupling, where the unidirectional flow forces reliance on coarse VLM prompts and wastes SAM’s pixel-level structural guidance, causing localization drift; and (2) Object-Centric Semantic Bias, where models overemphasize dominant object semantics while remaining insensitive to spatial reasoning crucial for RRSIS. Motivated by these observations, we propose CROSS, a tightly integrated paradigm for RRSIS. First, we introduce Linguistic-Guided Cascaded Distillation (LGCD) to bridge the architectural gap, which distills SAM’s geometric affinities as soft regularizers into VLM intermediate layers, injecting dense structural priors to refine localization. Second, Perspective-Spatial Contrastive Learning (PSCL) imposes cross-anchored constraints by mining mask-filtered deceptive distractors and spatial-linguistic counterfactuals as hard negatives, explicitly shattering semantic shortcuts to enforce genuine logical consistency. Extensive experiments on RRSIS benchmarks demonstrate that CROSS achieves state-of-the-art performance and maintains precise localization even under severe spatial description perturbations, standing as a robust new paradigm for RRSIS.
[59] EditFlow3D: Automated Local Editing of 3D Assets with Trajectory Preservation cs.CVPDF
Rui Nie, Chuang Wang, Haitao Zhou, Jiahe Song, Buyu Li
TL;DR: 本文提出了EditFlow3D，一个无需训练的局部3D资产编辑框架。它利用视觉语言模型自动解析编辑指令，生成视觉引导图像和精确的3D编辑掩码，通过在预训练3D生成模型的原生表示空间中进行操作，实现了对目标区域的聚焦编辑和对非目标区域结构与外观的忠实保持。
Details
Motivation: 现有3D资产局部编辑方法难以简单且精确地获取3D掩码，并且在实现期望编辑的同时，难以忠实地保持非目标区域的结构和外观。
Result: 在现有的Edit3D-Bench和新提出的EditFlow-Bench基准测试上，定量结果、定性比较和用户研究表明，EditFlow3D比现有3D编辑方法实现了更准确的目标区域编辑，并更好地保持了非目标区域。
Insight: 核心创新点在于一个VLM驱动的自动化工作流，用于生成视觉引导和精炼3D掩码，以及结合了掩码引导的差分流（用于聚焦编辑）和逐步轨迹保持（用于维持非目标区域一致性）的编辑机制，无需直接替换中间特征。
Abstract: Controllable local editing of 3D assets requires precise target localization and appropriate visual guidance. However, existing methods lack a simple yet accurate way to obtain 3D masks and struggle to achieve the desired edit while faithfully preserving the structure and appearance of non-target regions. To address these challenges, we present EditFlow3D, a training-free framework for local 3D editing. Given a source asset and an edit instruction, a VLM-driven workflow interprets the editing intent and automatically constructs a visual guidance image and a refined 3D editing mask, enabling localized editing in the native representation space of a pretrained 3D generative model. Specifically, mask-guided differential flow focuses the edit on the target region, while step-wise trajectory preservation maintains consistency between non-target regions and the source asset without directly replacing intermediate features. Since the existing Edit3D-Bench covers only a limited range of local editing categories, we further introduce EditFlow-Bench as a complementary benchmark encompassing a broader variety of structural and appearance edits, and evaluate EditFlow3D on both benchmarks. Quantitative results, qualitative comparisons, and a user study demonstrate that EditFlow3D achieves more accurate target-region editing and better preserves non-target regions than existing 3D editing methods.
[60] Frequency-Decorrelated Temporal Ensembles for EEG–fNIRS Imagined-Handwriting Decoding cs.CV | cs.HCPDF
Xiao Fan, Hongbin Guo, Yubo Han, Yi Zhang
TL;DR: 本文提出了一种名为FRED的系统，用于解码想象手写任务的脑电（EEG）和功能性近红外光谱（fNIRS）信号。该系统将想象手写建模为多秒运动序列，在三个互补的EEG频率视图上训练一个紧凑的多尺度时序网络，并通过频率去相关的集成策略提升性能。最终系统在Multimodal BCI Grand Challenge的公开/私有/整体测试集上分别达到了0.8076/0.7242/0.7492的准确率，在私有分割上排名第四。
Details
Motivation: 想象手写为无创神经解码提供了时间信息丰富的范式，但由于头皮EEG信号噪声大，且个体内部生成的手写笔画序列存在差异，实现跨被试的可靠识别仍然困难。本研究旨在利用多模态脑机接口挑战赛提供的同步EEG-fNIRS数据，解决四类、被试独立的想象手写轨迹分类问题。
Result: 在未使用测试集适应或输出约束的情况下，核心的九成员集成模型在公开/私有/整体测试分割上的准确率分别为0.8076、0.7242和0.7492。完整的提交系统（包含伪标签训练、EEG-Conformer成员、后验聚合和范式感知解码器）在私有分割上的整体准确率达到0.7718，排名第四。模态分析表明，仅使用fNIRS的解码性能接近随机水平（0.2511），而将其加入EEG仅带来微小的性能提升（+0.0025）。
Insight: 论文的核心创新点在于提出了频率去相关的时序集成方法，通过在不同EEG频带视图上训练模型并集成，显著降低了成员模型间的误差相关性。另一个关键见解是协议匹配的结构化推理，即利用已知的每12个试次块中包含每类三个实例的先验知识，通过匈牙利算法进行配额分配，从而提升解码性能。这揭示了在该稀疏电极EEG-fNIRS设置下，性能主要来源于频率多样化的EEG时序建模和与实验范式匹配的结构化推断策略。
Abstract: Imagined handwriting offers a temporally rich paradigm for non-invasive neural decoding, yet reliable recognition across unseen participants remains difficult because scalp EEG is noisy and internally generated stroke sequences vary across individuals. The Multimodal Brain-Computer Interface Grand Challenge provides synchronized EEG and fNIRS for four-class subject-independent handwriting-trajectory classification. We propose FRED, a task-adapted system that models imagined handwriting as a multi-second motor sequence and trains a compact multi-scale temporal network on three complementary EEG frequency views. With three seeds per view, cross-band members produce substantially less-correlated errors than same-band replicas, yielding a clean nine-member ensemble accuracy of 0.8076/0.7242/0.7492 on the public/private/overall test partitions without test-set adaptation or output constraints. The submitted pipeline further incorporates transductive pseudo-label training, three EEG-Conformer members, posterior aggregation, and a paradigm-aware decoder. Because every 12-trial randomization block contains three instances of each class, the final predictions are obtained by Hungarian assignment under the known block quota. On one fixed posterior pool, independent, session-constrained, and block-constrained decoding achieve 0.7600, 0.7758, and 0.7952 overall accuracy, respectively. The complete system reaches 0.8498/0.7718/0.7952, ranking fourth on the private split. A modality audit finds fNIRS-only decoding at chance (0.2511 overall), while adding fNIRS to EEG changes accuracy by only +0.0025. These results identify frequency-diverse temporal EEG modeling and protocol-matched structured inference as the principal sources of performance in this sparse-montage EEG–fNIRS setting. The source code is available at https://github.com/XiuFan719/EEG-fNIRS-fuse-method-for-MM-challenge.
[61] CRIL-U-Net: Compact Ratio-Interaction Learning for Focal Cortical Dysplasia Segmentation from T1w and FLAIR MRI cs.CVPDF
Soumen Ghosh, Amit Soni Arya, Tilottama Goswami, Subhojit Mandal, John Phamnguyen
TL;DR: 本文提出了一种名为CRIL-U-Net的3D U-Net模型，用于从T1加权和FLAIR MRI图像中自动分割局灶性皮质发育不良（FCD）。该模型引入了一个紧凑比率交互学习模块，通过结合局部空间特征、体素级跨模态混合和双向比率启发式交互来改进分割性能。在85名FCD患者和25名健康对照的数据集上，使用五折交叉验证进行实验，结果表明CRIL-U-Net在Focal Tversky-Focal损失函数下取得了最高的平均Dice分数，显著优于传统3D U-Net和输入自注意力U-Net。
Details
Motivation: FCD II型是耐药性局灶性癫痫的重要结构性病因，但其尺寸小、外观异质且MRI特征细微，使得自动分割具有挑战性。传统多模态网络通常简单拼接T1w和FLAIR图像，依赖后续层隐式学习跨模态关系，这限制了性能。
Result: 在Focal Tversky-Focal损失函数下，CRIL-U-Net取得了最高的平均Dice分数（0.196 +/- 0.262），显著优于传统3D U-Net（0.136 +/- 0.224）和输入自注意力U-Net（0.135 +/- 0.214）。在85个病例中，CRIL-U-Net在44个病例中产生了非零病灶重叠，优于U-Net的36个。经过错误发现率校正后，CRIL-U-Net在FTF损失下显著优于两个对比架构。
Insight: 论文的创新点在于提出了紧凑比率交互学习模块，该模块显式地结合了局部空间特征、体素级跨模态混合和双向比率交互，以更有效地学习T1w和FLAIR模态之间的互补信息。从客观角度看，将这种显式的跨模态表示学习与处理类别不平衡的损失函数（如Focal Tversky-Focal）相结合，是在小目标、挑战性医学图像分割任务中一个有前景的方向。
Abstract: Focal cortical dysplasia (FCD) type II is an important structural cause of drug-resistant focal epilepsy, but its small size, heterogeneous appearance, and subtle MRI characteristics make automated segmentation challenging. Conventional multimodal networks commonly concatenate T1-weighted (T1w) and fluid-attenuated inversion recovery (FLAIR) images, requiring subsequent layers to learn useful cross-modal relationships implicitly. We propose CRIL-U-Net, a 3D U-Net incorporating a Compact Ratio-Interaction Learning module that combines local spatial features, voxel-wise cross-modal mixing, and bidirectional ratio-inspired interactions. CRIL-U-Net was compared with a conventional 3D U-Net and an input self-attention U-Net using five-fold cross-validation on 85 FCD subjects and 25 healthy controls. Each architecture was trained independently using Dice-binary cross-entropy (Dice-BCE) and Focal Tversky-Focal (FTF) losses. With FTF, CRIL-U-Net achieved the highest mean Dice score (0.196 +/- 0.262), compared with 0.136 +/- 0.224 for the U-Net and 0.135 +/- 0.214 for the attention comparator. It produced nonzero lesion overlap in 44 of 85 cases, compared with 36 for the U-Net. Under FTF, CRIL-U-Net significantly outperformed both comparison architectures after false-discovery-rate correction. These findings suggest that compact cross-modal representation learning can improve FCD segmentation within a controlled U-Net setting when combined with an imbalance-aware objective, although the remaining zero-overlap rate of 48.2% highlights the need for further validation and methodological development.
[62] DRIFT: Derailing Denoising Trajectories of Flow-Matching VLAs with Adversarial Patch Attack cs.CV | cs.LGPDF
Hoseong Tae, Jong-Seok Lee
TL;DR: 本文提出了一种针对流匹配视觉语言动作（VLA）模型的对抗性补丁攻击方法DRIFT。研究表明，此类模型（如pi0）对先前攻击的鲁棒性源于攻击忽略了多步去噪ODE过程。DRIFT通过在机器人夹爪上放置一个通用补丁，攻击现成策略的去噪速度场，仅攻击第一个去噪步骤即可高效地破坏任务性能。
Details
Motivation: 动机在于揭示流匹配VLA模型（如pi0）对对抗性扰动的鲁棒性在很大程度上是虚假的，因为先前的攻击方法忽略了其多步去噪ODE的特性。本文旨在开发一种能够有效攻击此类模型去噪轨迹的测试时攻击方法。
Result: 在pi0和pi0.5模型上，针对四个LIBERO测试套件，DRIFT仅使用一个小的单一补丁就基本上破坏了所有原本可解决的任务，其效果远超动作空间和嵌入空间的基线攻击方法。
Insight: 核心创新点在于发现并利用了针对输入空间优化的独特梯度冲突现象：仅攻击第一个去噪步骤比攻击更宽的步骤窗口更有效且成本更低，这与训练时后门攻击的机制完全相反。这为理解和攻击基于流匹配的生成模型提供了新的视角。
Abstract: Flow-matching vision-language-action (VLA) models such as pi0 generate robot actions by integrating a learned denoising velocity field, and have been reported to resist adversarial perturbations that readily fool autoregressive VLAs. We show that this robustness is largely illusory: it stems from prior attacks ignoring the multi-step denoising ODE. We introduce DRIFT (Denoising Redirection via Input perturbation of the Flow-matching Trajectory), a test-time universal adversarial patch placed on the robot’s gripper that attacks the denoising velocity field of an off-the-shelf policy. Our central finding is counterintuitive: attacking only the first denoising step is both stronger and cheaper than attacking a wider window of steps, which we explain through a gradient conflict unique to input-space optimization and which is exactly opposite to the training-time backdoor regime. On pi0 and pi0.5 across four LIBERO suites, DRIFT breaks essentially all originally-solvable tasks with a small single patch, far exceeding action- and embedding-space attack baselines.
[63] CrossScope: A Role-Asymmetric World Model for Joint Dual-Scope Surgical Video Prediction cs.CV | cs.ROPDF
Wanhao Liu, Jinsong Lin, Rulin Zhou, Chi Kit Ng, Wenbin Pan
TL;DR: 本文提出CrossScope，一种角色不对称的双流手术世界模型，用于联合预测双内窥镜手术视频的未来帧。该模型针对母-子内窥镜逆行胰胆管造影术（ERCP）场景，其中两个柔性内窥镜提供互补但角色依赖的视图。模型通过几何引导的残差交互，实现目标特定的证据路由，让每个视野根据预测目标和空间需求选择性传递跨视图证据。
Details
Motivation: 传统视觉世界模型通常从单一观测流学习未来动态，难以建模具有多个独立移动观察者的协作系统（如双内窥镜手术）。在ERCP等场景中，两个内窥镜提供角色不对称、未标定立体关系的互补视图，需要一种新的方法来处理这种角色不对称的双视野未来预测问题。
Result: 在构建的配对双内窥镜基准测试（包括同步的幻影和真实世界ERCP片段）上，CrossScope在视觉保真度、结构保持、目标定位和运动一致性评估中，持续优于强大的手术视频生成基线模型。
Insight: 创新点在于提出了角色不对称的双视野未来预测框架，以及几何引导的残差交互机制，实现了目标特定的证据路由。模型学习了两个互补的通信方向：母视图的几何运动线索指导子视图的未来动态，而姿态对齐的子视图外观仅在建立有效空间对应时支持母视图预测，从而在不损害视图特定表示的前提下，让每个内窥镜贡献任务相关证据。
Abstract: Visual world models typically learn future dynamics from a single observation stream, limiting their ability to model cooperative systems with multiple independently moving observers. We investigate this challenge in Mother–Child endoscopic retrograde cholangiopancreatography (ERCP), where two flexible scopes provide complementary yet role-dependent views without a calibrated stereo relationship. Unlike conventional multi-view fusion that assumes symmetric information exchange, we formulate \textbf{role-asymmetric dual-scope future prediction}, where cross-view evidence is selectively transferred according to the prediction target and its underlying spatial requirements. We propose \textbf{CrossScope}, a dual-stream surgical world model that preserves view-specific experts while enabling target-specific evidence routing through geometry-guided residual interactions. CrossScope learns two complementary communication directions: geometric motion cues from the Mother view guide Child-view future dynamics, while pose-aligned Child appearance supports Mother-view prediction only when valid spatial correspondence is established. This design allows each scope to contribute task-relevant evidence without compromising its view-specific representation. To evaluate this problem, we establish a paired dual-scope benchmark comprising synchronized phantom and real-world ERCP episodes, with evaluations assessing visual fidelity, structural preservation, target localization, and motion consistency. Experiments demonstrate that CrossScope consistently outperforms strong surgical video generation baselines, validating the importance of role-aware evidence routing for multi-observer visual world modeling.
[64] Self-Supervised Representation-Guided Generative Dataset Distillation cs.CV | cs.AIPDF
Mingzhuo Li, Guang Li, Linfeng Ye, Jiafeng Mao, Takahiro Ogawa
TL;DR: 本文提出了一种自监督表示引导的生成式数据集蒸馏方法（SRG），旨在将大规模训练集压缩为紧凑的合成集，同时保持其在下游任务中的有效性。该方法通过将自监督学习（SSL）的几何结构转化为扩散模型的引导信号，利用原型对齐、类间区分和类内分配三个SSL空间目标来指导生成过程，并采用分阶段引导策略平衡视觉真实性与表示空间判别性。
Details
Motivation: 现有数据集蒸馏方法主要针对随机初始化的网络，而现代视觉系统通常使用轻量模块适配冻结的预训练编码器。因此，蒸馏样本应保留预训练表示空间的判别几何结构，但现有生成目标未明确考虑这一点。
Result: SRG在多个数据集和每个类别的图像数量（IPC）设置下，持续优于评估的生成基线方法。跨编码器评估进一步表明该方法能在不同预训练表示空间之间迁移，证明了其在预训练SSL模型上进行数据集蒸馏的有效性。
Insight: 创新点在于将SSL表示空间的几何结构显式地融入扩散模型的引导过程，通过分阶段引导策略（早期锚定真实图像潜在表示，后期由SSL空间目标引导）来同时保证生成样本的视觉真实性和表示空间的判别性，这为基于预训练模型的数据集蒸馏提供了新思路。
Abstract: Dataset distillation compresses a large training set into a compact synthetic set while retaining its downstream utility. Most existing methods target randomly initialized networks, whereas modern vision systems often adapt frozen pretrained encoders with lightweight modules. Distilled samples should therefore preserve the discriminative geometry of the pretrained representation space, which existing generative objectives do not explicitly consider. We propose self-supervised representation-guided generative dataset distillation (SRG), a framework that translates the SSL geometry into diffusion guidance. Specifically, SRG constructs class-wise prototypes from real-image SSL representations and performs guidance through three SSL-space objectives for prototype alignment, inter-class discrimination, and intra-class assignment. During diffusion sampling, it adopts a stage-wise guidance strategy: early denoising is anchored to the latent of the real image whose SSL representation is nearest to the assigned prototype, whereas later denoising is guided by the SSL-space objectives. This division preserves the visual realism provided by the generative prior while progressively steering samples toward representative and class-discriminative regions of the SSL representation space. SRG consistently outperforms the evaluated generative baselines across multiple datasets and IPC settings. A cross-encoder evaluation further indicates transfer across pretrained representation spaces. These results demonstrate the effectiveness of representation-guided generation for dataset distillation with pretrained SSL models.
[65] Open-Linguistic Concept Unified Learning for Cross-Site Interpretable Dermatology Image Diagnosis cs.CVPDF
Chengyu Wu, Junpeng Tan, Wanxiang Luo, Yaqi Wang, Yandong Wen
TL;DR: 本文提出UniCon框架，旨在解决基于概念的皮肤病图像诊断模型在跨站点、多模态（如皮肤镜和临床照片）场景下泛化能力受限的问题。该框架通过统一概念原型码本构建共享语义空间，利用开放语言的多方面语义规范增强边界敏感性，并引入可靠性门控瓶颈聚合实现可调整的干预接口，从而在保持高诊断准确率的同时，实现了跨站点的一致推理和可转移的临床医生干预能力。
Details
Motivation: 现有基于概念的模型在跨站点泛化时面临挑战，因为不同数据集的模态、概念分类体系（可用性、粒度和语义）存在异质性，导致需要昂贵的标签工程和重复训练，且干预机制僵化，阻碍了皮肤病计算机辅助诊断（CAD）的可扩展部署。
Result: 大量实验表明，UniCon不仅取得了顶级的诊断准确率，而且成功桥接了不同的临床分类体系，解锁了前所未有的跨站点干预能力。
Insight: 创新点包括：通过统一概念原型码本协调异构概念系统，无需针对特定数据集重新训练；利用开放语言的多方面语义规范克服稀疏文本标签限制，提升不确定临床上下文中的边界敏感性；设计基于可靠性门控瓶颈聚合的干预接口，支持可转移的临床医生校正。
Abstract: Human-interpretable computer-aided diagnosis is crucial for clinical decision making. Concept-based models excel by providing transparent reasoning and enabling post-hoc, clinician-in-the-loop interventions. However, their rigid dataset-specific adaptation inherently restricts cross-site generalization. Applying them across diverse modalities, such as dermoscopic and clinical photographs, is challenging due to heterogeneous concept taxonomies varying in availability, granularity, and semantics across cohorts. Consequently, adapting Foundation Vision-Language Models (FVLMs) demands costly label engineering and repeated post-training. Existing intervention mechanisms remain rigidly tied to predefined concepts, lacking adaptability and hindering scalable dermatology CAD deployment. To address these bottlenecks, we propose UniCon, an open-linguistic unified concept learning framework for multimodal interpretable vision-language diagnosis. UniCon resolves these challenges through three contributions: (1) A shared semantic representation space via a unified concept prototype codebook, seamlessly coordinating heterogeneous concept systems across modalities without dataset-specific retraining. (2) Open-linguistic based multi-faceted semantic specifications to overcome sparse textual label limitations, improving boundary sensitivity in uncertain clinical contexts. (3) A robust, cross-site adjustable intervention interface powered by reliability-gated bottleneck aggregation, enabling consistent reasoning and transferable clinician corrections. Extensive experiments demonstrate that beyond securing top-tier diagnostic accuracy, UniCon successfully bridges disparate clinical taxonomies, unlocking unprecedented cross-site intervention capabilities. Code is available at https://github.com/wuchengyu123/UniCon.
[66] CIGTSurv: Clinical Information Guided Tri-modal Survival Prediction with Local Prototype Association and Global Feature Alignment cs.CV | cs.CLPDF
Jing Dai, Qibin Zhang, Weiwei Zhou, Mingde Xu, Jingsong Liu
TL;DR: 该论文提出了CIGTSurv，一个用于生存预测的临床信息引导的三模态学习框架。它通过设计文本模板和预训练基础模型，将离散的临床表格数据转化为高维嵌入，并利用临床信息作为锚点，通过局部原型关联模块和全局特征对齐损失来建模病理图像、基因组数据和临床信息之间的跨模态交互。
Details
Motivation: 当前多模态生存预测研究主要整合病理图像和基因组数据，但关键的临床信息由于其离散、稀疏和低维的特性未被充分利用。此外，不同模态之间的异质性给跨模态交互建模带来了挑战。
Result: 在五个TCGA癌症队列上的广泛实验表明，CIGTSurv在生存预测任务上达到了最先进的性能。
Insight: 创新点在于将临床信息作为引导锚点，并设计了显式的局部原型关联模块和隐式的全局特征对齐损失来协同处理三模态数据。这为整合低维、离散的临床数据到多模态学习框架中提供了有效方法。
Abstract: Multimodal learning has significantly advanced survival prediction by integrating pathology images with genomic data. However, clinical information, despite its critical role in reflecting a patient’ s overall health, remains underutilized due to its discrete, sparse, and low-dimensional nature. Furthermore, the inherent heterogeneity across these modalities pose significant challenges in modeling cross-modal interactions. In this paper, we propose CIGTSurv, a Clinical Information Guided Tri-modal framework for Survival prediction. Specifically, we first design a holistic text template and use pretrained foundation models to transform clinical tabular data into high-dimensional tokenized embeddings. Using clinical information as an anchor, we then introduce a dual-level interaction mechanism: 1) a local prototype association (LPA) module based on cross-attention to explicitly learn token-level correspondences between different modalities, and 2) a global feature alignment (GFA) loss based on Maximum Mean Discrepancy (MMD) to implicitly enhance cross-modal distribution consistency. Extensive experiments on five TCGA cancer cohorts demonstrate that CIGTSurv achieves state-of-the-art (SOTA) survival prediction performance. Our source code is publicly available at https://github.com/Daijing-ai/CIGT-Surv.git.
[67] GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs cs.CV | cs.AIPDF
Zichuan Fu, Shirong Wang, Wenlin Zhang, Guojing Li, Yimin Deng
TL;DR: 本文提出GUI-Lens，一种从粗到细的GUI定位框架，用于将自然语言指令映射到图形用户界面（GUI）上的点击位置。该方法通过主动视觉观察，利用通用视觉语言模型（VLM）逐步放大和裁剪界面区域，直至精确定位目标控件，从而解决高分辨率、密集界面中的定位难题。
Details
Motivation: 现有GUI定位方法在复杂界面上常因视觉模糊或初始估计不准确导致最终点击预测错误，难以实现精确交互。本文旨在通过主动、迭代的视觉观察过程来提升定位精度。
Result: 在四个GUI定位基准测试和三种通用VLM后端上的实验表明，GUI-Lens将整体定位准确率最高提升了24.9个百分点，并在GPT-5.5上达到了最先进的性能水平。
Insight: 创新点在于提出了一种主动的、从粗到细的视觉观察框架，通过迭代裁剪和放大界面区域，结合OCR文本和UI组件检测提供的坐标参考，引导VLM逐步聚焦目标，有效减少了视觉歧义并提升了定位鲁棒性。
Abstract: GUI grounding maps natural-language instructions to click locations and is essential for reliable GUI agents. The task remains difficult on high-resolution, densely populated interfaces because a vision-language model (VLM) may recognize a requested control without locating it precisely enough for interaction. Most existing methods provide various forms of localization assistance, but still rely on a direct click prediction, allowing visual ambiguity or an inaccurate initial estimate to propagate to the final result. In this paper, we introduce GUI-Lens, a coarse-to-fine grounding framework that allows a general-purpose VLM to determine the target through active visual observations. Specifically, GUI-Lens extracts OCR text and detected UI components from the screenshot and presents their positions as coordinate references. Using the instruction, the current view, and these references, the VLM selects the region and scale of the next view, which is cropped and enlarged to provide finer visual details. This process continues over successively focused views until the target is determined. Proposed crops and clicks are checked against the instruction throughout the process, and the final local position is mapped back to the original screen coordinates. Experiments on four GUI grounding benchmarks and three general-purpose VLM backends show that GUI-Lens improves overall grounding accuracy by up to 24.9 percentage points and achieves state-of-the-art performance with GPT-5.5.
[68] Efficient Video Dataset Distillation via Cluster-Guided Prototype Blending cs.CV | cs.AIPDF
Chongle Ren, Guang Li, Wenbo Huang, Naoki Saito, Takahiro Ogawa
TL;DR: 本文提出ProtoBlend，一种高效的基于构造的视频数据集蒸馏框架，旨在将大型视频数据集压缩成一个紧凑的代理集。该方法通过教师引导的时序片段选择、聚类引导的原型分配和原型混合三个步骤，无需对存储视频进行基于梯度的迭代优化，即可生成有效的蒸馏视频。
Details
Motivation: 现有视频数据集蒸馏方法通常通过迭代优化合成压缩视频，其计算成本因时间维度而放大。本文旨在探索是否可以在不进行基于梯度的视频优化的情况下，通过构造方式创建有效的蒸馏视频，以解决选择信息性时序片段、在有限预算下覆盖类内多样性以及增加每个存储样本信息量这三个挑战。
Result: 在四个经过修剪的动作识别基准测试（如UCF101、HMDB51、Kinetics-400、Something-Something V2）上的实验表明，ProtoBlend在无需迭代优化蒸馏视频的情况下，实现了具有竞争力的准确率与效率权衡。
Insight: 创新点在于提出了一种非优化的、基于选择-分配-混合的高效构造框架。其核心是利用教师模型特征空间进行聚类来指导原型分配，并通过混合原型与类内锚点及其对应的教师预测来提供混合源监督，从而有效捕获类内多样性并提升信息密度。
Abstract: Video dataset distillation aims to compress a large video dataset into a compact surrogate set that preserves its training utility. Most existing approaches synthesize condensed videos through iterative optimization, whose cost is amplified by the temporal dimension. Rather than further reducing the number of optimized variables, we investigate whether effective distilled videos can be constructed without gradient-based optimization of the stored videos. Such a construction-based approach must address three challenges: selecting informative temporal segments, covering diverse intra-class variations under a limited videos-per-class budget, and increasing the information carried by each stored sample. To this end, we propose ProtoBlend, an efficient select-allocate-blend framework. First, teacher-guided temporal clip selection retains a high-confidence segment from each source video. Second, cluster-guided prototype allocation partitions the selected clips in the teacher feature space and assigns one distilled slot to each intra-class cluster. Third, each prototype is blended with an in-cluster anchor, while their teacher predictions are combined using the same coefficient to provide mixture-source supervision. Experiments on four trimmed action-recognition benchmarks demonstrate that ProtoBlend achieves a competitive accuracy-efficiency trade-off without iterative optimization of the distilled videos.
[69] 3DGSI-Assessor: A Large-Scale Dataset and An LMM-based Method for 3D Gaussian Splatting Image Quality Assessment cs.CVPDF
Yuke Xing, Jiarui Wang, William Gordon, Zhu Li, Guangtao Zhai
TL;DR: 本文提出了一个用于评估压缩3D高斯泼溅（3DGS）图像质量的大规模数据集3DGS-IEval-15K+，以及一个基于大型多模态模型（LMM）的评估框架3DGSI-Assessor。该框架能够同时预测图像的整体质量、几何质量和色彩质量，解决了传统图像质量评估（IQA）方法无法捕捉3DGS特有失真的问题。
Details
Motivation: 3DGS已成为实时新视角合成（NVS）的主流表示方法，但其存储占用大，需要压缩。然而，3DGS训练和压缩会引入特有的失真（如漂浮伪影和表面散射），且几何与色彩属性的独立压缩可能导致解耦的维度特定失真，而现有IQA指标无法有效捕捉这些失真，且只提供一个总体分数。
Result: 在提出的3DGS-IEval-15K+数据集上，3DGSI-Assessor取得了最先进的性能。同时，在其他NVS基准测试上也表现出有竞争力的泛化能力。
Insight: 创新点在于构建了首个大规模、多维度（整体、几何、色彩）的压缩3DGS IQA数据集，并提出了一个集成全局语义和维度特定局部特征的LMM框架，能单次前向传播预测所有三个维度的质量分数，实现了对3DGS特有失真的全面评估。
Abstract: 3D Gaussian Splatting (3DGS) has become a dominant representation for real-time novel view synthesis (NVS), yet its storage footprint makes compression indispensable for practical deployment. 3DGS training and compression introduce representation-specific distortions such as floating artifacts and surface scattering, which conventional image quality assessment (IQA) metrics fail to capture. Moreover, the independent compression of geometric and color attributes may lead to decoupled dimension-specific distortions that must be diagnosed separately, yet existing metrics report only a single overall score. To address these gaps, we present 3DGS-IEval-15K+, a large-scale, multi-dimensional IQA dataset for compressed 3DGS, comprising 15,200 images from 10 diverse scenes, produced by 6 representative 3DGS algorithms at systematically designed compression levels and rendered from 20 strategically selected viewpoints spanning both training views and challenging novel views, annotated with 45,600 mean opinion scores (MOSs) across overall, geometry, and color quality. Based on 3DGS-IEval-15K+, we propose 3DGSI-Assessor, an all-in-one 3DGS IQA framework that integrates global semantic and dimension-specific local features within a large multimodal model (LMM), predicting all three dimensions in a single forward pass. 3DGSI-Assessor achieves state-of-the-art performance on 3DGS-IEval-15K+, and exhibits competitive generalization on other NVS benchmarks. Dataset and code will be released at https://github.com/YukeXing/3DGSI-Assessor.
[70] LocAnyMed: Vision-Language Grounding for Multimodal Medical Images cs.CVPDF
Zihan Wang, Tong Liu, Zhiwei Wang, Tao Huang, Wentao Jiang
TL;DR: 本文提出了LocAnyMed，一个用于多模态医学图像视觉定位的框架。作者构建了LocAnyMed-200K数据集，统一了多种医学成像模态（如CT、超声、X光）的定位任务，并支持自由形式的临床查询。通过在LocAnyMed-200K上微调通用定位模型LocateAnything-3B，模型在医学图像上的定位能力得到显著提升。此外，还创建了LocAnyMed-CoT-20K子集，通过结构化推理增强模型预测的可解释性。
Details
Motivation: 解决通用视觉定位模型在医学图像上表现不佳的问题，因为现有模型主要在自然图像上训练，而医学定位资源分散在不同成像模态、数据集和任务形式中，缺乏统一的大规模数据集。
Result: 在保留的评估集上，通过在LocAnyMed-200K上进行全参数微调，LocateAnything-3B模型的F1@IoU 0.50分数从10.64大幅提升至85.59，证明了大规模领域特定监督的有效性。
Insight: 创新点在于构建了统一的多模态医学视觉定位数据集LocAnyMed-200K，将异构的检测和定位资源整合为支持自由形式指令的格式；并进一步通过LocAnyMed-CoT-20K子集引入结构化推理链，提升了模型的临床可解释性和跨源泛化能力，为研究医学图像的定位准确性和推理质量提供了统一基础。
Abstract: Medical visual grounding connects free-form clinical queries to spatial evidence in medical images and is an important component of interpretable medical artificial intelligence. However, general-purpose grounding models are predominantly trained on natural images, while existing medical localization resources remain fragmented across imaging modalities, datasets, and task formulations. To address this gap, we construct LocAnyMed-200K, a multimodal medical visual grounding dataset containing approximately 200K image-query-answer examples across computed tomography, optical medical imaging, ultrasound, and X-ray. We harmonize heterogeneous detection and localization resources into a unified free-form instruction format that supports one or multiple bounding boxes, point coordinates, and no-target outputs for negative queries. Full-parameter fine-tuning of LocateAnything-3B on LocAnyMed-200K improves F1@IoU 0.50 from 10.64 to 85.59 on a held-out evaluation split, demonstrating that large-scale domain-specific supervision can equip a general grounding model with effective medical localization capabilities. Beyond spatial coordinates, a clinically interpretable grounding system should also communicate the evidence supporting its prediction. We therefore derive LocAnyMed-CoT-20K, a rationale-augmented subset that connects anatomical context, visual observations, and spatial conclusions through structured reasoning and further improves cross-source generalization through fine-tuning. Together, these resources provide a unified foundation for studying both localization accuracy and rationale quality across heterogeneous medical imaging modalities. The code is publicly available at https://github.com/MiliLab/LocAnyMed.
[71] PolyLayout: Multi-room Manhattan Layout Estimation cs.CVPDF
Gustav Hanning, Shaohui Liu, Rémi Pautrat, Marc Pollefeys, Kalle Åström
TL;DR: PolyLayout是一种多房间布局估计方法，通过将房间布局参数化为曼哈顿3D多边形，并在多个房间间联合优化这些多边形。该方法利用预训练的视觉特征和神经网络预测优化目标，通过端到端训练仅监督输出布局，同时保持相机投影和多边形更新的显式模型。PolyLayout在优化过程中通过迭代的墙壁分割和合并操作自适应细化多边形拓扑，并联合利用房间间的结构线索。
Details
Motivation: 现有方法在室内场景理解中估计多视图图像的房间布局时，通常存在泛化能力差、对房间形状或相机配置的几何假设限制严格的问题，且大多独立估计房间，未能利用共享的建筑结构（如主导方向、地平面或天花板高度）。
Result: PolyLayout在作者新引入的两个多视图多房间布局基准测试中，在准确性和鲁棒性方面均优于先前方法。
Insight: 创新点包括：将房间布局参数化为曼哈顿3D多边形并进行多房间联合优化；结合学习评分和几何模型的分离设计以提升泛化能力；自适应多边形拓扑细化机制；以及通过提供布局注释创建了新的多房间布局基准数据集。
Abstract: Estimating room layouts from multi-view imagery is a core task for indoor scene understanding. Existing methods are typically limited either by poor generalization to new datasets or restrictive geometric assumptions of the room shape or camera configuration. Most also estimate rooms independently, failing to exploit shared building structure such as dominant directions, ground plane or ceiling height. We propose PolyLayout, a multi-room layout estimation method that parameterizes room layouts as Manhattan 3D polygons and optimizes them jointly across multiple rooms. The optimization objective is predicted by a neural network on top of robust pre-trained visual features and trained end-to-end with supervision only on output room layouts. At the same time, camera projection and polygon updates remain explicit and model-based. This separation between learned scoring and geometry improves generalization to new datasets and camera parameters. During optimization, PolyLayout adaptively refines the polygon topology through iterative wall split and merge operations while jointly utilizing structural cues across rooms. We introduce two new multi-view multi-room layout benchmarks by providing layout annotations to existing datasets, and experiments show that PolyLayout outperforms prior approaches, both in terms of accuracy and robustness. Project page: https://ghanning.github.io/PolyLayout
[72] SPADE: An Input-Adaptive Sparse Attention Engine for Fast Video Diffusion Models Inference cs.CVPDF
Shanghao Liu, Renze Chen, Size Zheng, Yuanqiang Liu, Yun
TL;DR: SPADE是一种无需训练的稀疏注意力引擎，旨在加速视频扩散变换器（vDiT）的推理过程。它通过输入自适应的方式动态选择关键注意力token，并利用高效的运行时方案和内核执行器，在保持生成质量的同时显著提升推理速度。
Details
Motivation: 视频扩散变换器（vDiT）虽然能生成高质量视频，但其自注意力机制具有二次方计算成本，在视频token规模下推理开销巨大。核心挑战在于如何以可忽略的开销实现输入自适应的稀疏性，即动态选择关键的Q/K/V token以获得端到端的加速收益。
Result: 在Hunyuan-Video和Wan 2.1/2.2等文本到视频和图像到视频生成模型上，SPADE在保持质量的同时提高了稀疏性和速度，将注意力计算加速了2.26倍至3.40倍，端到端推理加速了1.49倍至1.80倍。
Insight: 创新点包括：1）提出vDiT-SSR规范，通过Summarizer/Estimator表达式形式化动态掩码和3D分块候选；2）基于SICS和头级策略的运行时方案生成；3）包含低开销索引搜索、Flash块稀疏注意力和内核分组的执行器。该方法无需训练，实现了输入自适应的稀疏注意力，为视频扩散模型的高效推理提供了通用解决方案。
Abstract: Video diffusion transformers (vDiTs) generate high quality but pay quadratic self-attention cost, making inference prohibitive at video-token scales. The challenge is input-adaptive sparsity: selecting critical Q/K/V tokens with negligible overhead and executing them for end-to-end gains. We present SPADE, a training-free sparse-attention engine of three parts: (i) vDiT-SSR, a specification defining 3D blocking candidates and formalizing dynamic masks via Summarizer/Estimator expressions; (ii) runtime scheme generation using SICS and a head-wise policy; and (iii) an executor with low-overhead index search, flash block-sparse attention, and kernel grouping. Across Hunyuan-Video and Wan 2.1/2.2 for text-to-video and image-to-video generation, SPADE raises sparsity and speed while preserving quality, accelerating attention by 2.26x-3.40x and end-to-end inference by 1.49x-1.80x. Our code is open-sourced at https://github.com/6somehow/DAC-SPADE.
[73] Can Text-to-Image Models Draw from the Right Frame of Reference? cs.CVPDF
Zheyuan Gu, Ruihang Li, Yong Huang, Yiqian Zhang, XIangzhao Hao
TL;DR: 本文针对文本到图像生成中空间指令跟随的挑战，特别是当方向表达在不同参考系下解释时，提出了FoR-T2I基准来评估模型在指定参考系与相机视图不同时的表现。研究发现，现有模型在通过物体方向描述布局时表现显著下降，并提出了基于视觉反馈的提示重写方法来缓解这一问题。
Details
Motivation: 解决文本到图像生成中，方向表达在不同参考系下（如相机视图与物体内在方向）导致的布局误解问题，现有基准未能有效隔离模型在指定参考系下的表现。
Result: 在22个闭源和开源T2I模型上，FoR提示的平均最终准确率比匹配的相机视图提示低41.8%，最佳模型仅达到44.3%的FoR准确率；提出的VLM门控重写方法将平均FoR准确率从25.0%提升至29.2%。
Insight: 创新点包括引入FoR-T2I基准来系统评估模型在不同参考系下的表现，以及基于视觉反馈的提示重写策略；客观分析认为，该研究揭示了模型在理解物体内在方向性方面的局限性，为改进空间推理提供了新方向。
Abstract: Spatial instruction following has become a crucial requirement for text-to-image (T2I) generation. A common challenge arises when directional expressions are interpreted under different frames of reference. For example, ``the left of’’ may refer to the viewer’s image coordinates or to the intrinsic orientation of an object, leading to different expected layouts. Existing T2I benchmarks reveal important layout failures, yet they rarely isolate whether models can follow a specified frame of reference when it differs from camera view. To mitigate this gap, we introduce FoR-T2I, a benchmark for evaluating this distinction with 1,200 prompt pairs built from controlled spatial layouts. In each pair, the camera-view (Cam) prompt states the target relation in camera view, while the frame-of-reference (FoR) prompt describes the same target placement through an oriented anchor object. Across 22 closed-source and open-source T2I models, mean final accuracy is 41.8% lower on FoR prompts than on matched Cam prompts; even the best-performing model achieves only 44.3% FoR accuracy. This suggests that current models struggle more when the same layout is described through an object’s orientation rather than directly in image coordinates. We further analyze this gap by relation type and camera view, compare several training-free prompting and feedback-based mitigation strategies, and propose a VLM-gated rewriting approach that selects rewritten prompts using visual feedback, improving average FoR accuracy from 25.0% to 29.2% under the same generation budget.
[74] Distilled Roads: Generalisable Road Network Extraction Across Sensors, Resolutions, and Region cs.CV | cs.AI | cs.LGPDF
Sanayya, Rakshith Sathish, Ashwathi Nambiar
TL;DR: 该论文提出了一种名为Distilled Roads的通用道路网络提取框架，通过跨分辨率知识蒸馏、多传感器训练和拓扑感知监督，构建了一个单一模型，能够在0.3-1.0米分辨率的多卫星平台图像上实现泛化。
Details
Motivation: 解决现有道路分割模型因地理差异、遮挡和分辨率/传感器导致的域偏移而泛化能力差的问题，特别是在农村、特殊道路材料或新卫星平台等未见环境中常产生断裂预测，且适应新域通常需要昂贵的重新训练。
Result: 在City-Scale和Global-Scale等公开基准测试中，该模型在F1分数上比SOTA高出22点，APLS分数高出15点，同时推理速度提升3倍，实现了最先进且高效的性能。
Insight: 创新点在于将全局道路提取重构为持续适应问题，而非架构问题，通过数据课程、蒸馏和拓扑感知损失等针对性训练策略提升鲁棒性，而非依赖复杂架构，这为跨传感器和分辨率的泛化提供了新思路。
Abstract: Road network segmentation from satellite imagery remains challenging due to large geographic variation in road appearance, occlusions, and domain shifts introduced by differing resolutions and sensors. Existing models, typically trained under narrow resolution–region combinations, generalise poorly to unseen environments such as rural settings, regions with distinct road materials, or imagery from new satellite platforms, often producing broken or disconnected predictions. Adapting these models to new domains usually requires retraining or fine-tuning, which is costly and risks catastrophic forgetting. In this work, we reframe global road extraction as a continual adaptation problem rather than an architectural one. Our framework combines cross-resolution knowledge distillation across a resolution-decreasing curriculum, multi-sensor training, and topology-aware supervision, yielding a single model that generalises across $0.3-1.0$ m imagery from multiple satellite platforms across continents. On publicly available benchmarks, including City-Scale and Global-Scale, our model outperforms state-of-the-art results by up to $22$ F1 points and $15$ APLS points, while remaining the most efficient, with $3\times$ faster inference. Our results suggest that improved robustness across diverse sub-meter satellite imagery can be achieved through targeted training strategies, such as data curricula, distillation, and topology-aware losses, rather than increasingly complex architectures.
[75] OliveGemma: A 3 Billion Visual Language Model for Recognising the Mediterranean & European Diet cs.CV | cs.AIPDF
Dimitrios I. Zaridis, Traianos Tsiokris, Vasileios C. Pezoulas, Daphni Plati, Eugenia Mylona
TL;DR: 该研究提出了OliveGemma，一个基于PaliGemma-2-3B架构微调的30亿参数视觉语言模型，专门用于识别和推理地中海及欧洲饮食。模型在整合了三个欧洲研究项目数据集（共17,340张图像）的指令式问答语料上进行LoRA微调，在菜品识别任务上取得了92.96%的Top-1准确率，超越了CNN基线模型和多个零样本前沿大模型。
Details
Motivation: 基于图像的饮食评估是自我报告式食物日记的可扩展替代方案，但由于类内差异大和菜品视觉相似性高，细粒度食物识别仍具挑战。本研究旨在开发一个专门用于地中海和欧洲菜肴识别的视觉语言模型。
Result: 在3折交叉验证下，OliveGemma的Top-1准确率达到92.96% ± 0.91%，比最强的CNN基线（DenseNet-121）高出7.31%，并显著超过Gemini Flash、GPT-4o Mini和Claude Haiku等零样本前沿模型。在菜品可能成分的Exact-Set准确率上也达到90.79% ± 1.3%。
Insight: 创新点在于将参数高效微调（PEFT，如LoRA）应用于一个较小的开源视觉语言模型（VLM），使其在特定领域（细粒度食物识别）的任务上能够超越规模大得多的专有模型。这证明了针对特定领域进行高效微调的小型VLM的潜力和实用性。
Abstract: Image based dietary assessment offers a scalable alternative to self reported food diaries, yet fine-grained food recognition remains challenging due to high intra-class variability and visually similar dishes. This study presents OliveGemma, a vision language model for recognising and reasoning about Mediterranean and European cuisine. Built on the open-weight PaliGemma-2-3B architecture, OliveGemma is fine-tuned with LoRA on a unified corpus of 17,340 images from three European research project datasets (MedGR, ODIN, and VIPPSTAR), reconciled into a vocabulary of 216 composed dish categories and paired with 102,642 instruction style question-answer items covering dish recognition, likely and visible ingredients, class boundary discrimination, visual evidence and overall visual food understanding. Under a 3-fold cross-validation scheme, OliveGemma achieves a top-1 accuracy of 92.96% +/- 0.91%, exceeding the strongest CNN baseline (DenseNet-121) by 7.31% and outperforming zero-shot frontier models with exact instructions and bounded classes including Gemini Flash 3 and 3.5, GPT-5.4 Mini, and Claude Haiku 4.6 by 8%, 46%, and 64% respectively. Furthermore, OliveGemma demonstrates competitive performance on Top-3 and Top-5 accuracy, being second best across CNNs and frontier models, surpassed only by DenseNet-121. In addition, OliveGemma achieves 90.79% +/- 1.3% Exact-Set on the likely ingredients of the food categories. These results demonstrate that PEFT adaptation of a small VLM can surpass substantially larger proprietary models on specialised food recognition. The model is publicly available at https://huggingface.co/JamesZar/OliveGemma-3B and the experiments and results can be found at https://github.com/tsiokris/OliveGemma.
[76] Hi-Token: Hierarchical Coordinate Tokenization for Generative Visual Grounding cs.CVPDF
Xiuyuan Zhu, Ke Lu, Kun Dong, Siwen Jiao, Hao Wu
TL;DR: 本文提出了Hi-Token方法，通过分层坐标标记化来改进生成式视觉语言模型（VLMs）中的视觉定位任务。它将每个坐标轴（如x, y）的数值分解为百位、十位、个位等轴特定标记，从而增加了从粗到细的结构并提高了标记重用率，同时保持了现有VLM架构不变。此外，论文还引入了Hi-GAR，一种基于几何的奖励机制，用于组相对策略优化（GRPO），以在训练中利用多尺度的边界框重叠和坐标精度。
Details
Motivation: 当前生成式视觉语言模型通常将边界框坐标视为独立的输出符号，这使得数值顺序和坐标轴语义变得隐式，这是视觉定位错误的一个重要来源。论文旨在通过改进坐标表示来解决这个问题。
Result: 在匹配的训练条件下进行控制比较，Hi-Token在整个评估的IoU范围内都改善了定位性能。Hi-GAR进一步减少了低重叠预测。在三个VLM骨干网络和RefCOCO系列数据集上的实验表明，该方法在模型和基准测试上均取得了一致的性能提升。Hi-R1在大多数报告的指标上优于强大的专业基线模型。
Insight: 主要创新点在于提出了分层坐标标记化（Hi-Token），为坐标生成引入了显式的、结构化的表示，以及用于训练的几何奖励机制（Hi-GAR）。从客观角度看，将坐标分解为轴特定的数字位标记是一种简单而有效的创新，它增强了模型对坐标数值顺序和语义的理解，同时保持了模型架构的兼容性，易于集成到现有VLMs中。
Abstract: Generative Vision-Language Models (VLMs) commonly treat bounding-box coordinates as independent output symbols, leaving numerical order and axis semantics implicit. We identify this representation as an important source of error in visual grounding. Hi-Token encodes each coordinate with axis-specific tokens for the hundreds, tens, and ones digits, which adds coarse-to-fine structure and increases token reuse while retaining the existing VLM architecture. Hi-GAR complements this representation with a geometry-based reward for Group Relative Policy Optimization (GRPO), using box overlap and coordinate accuracy at multiple scales. Controlled comparisons under matched training conditions show that Hi-Token improves localization throughout the evaluated IoU range. Hi-GAR further reduces low-overlap predictions and is used only during training. Experiments on three VLM backbones and the RefCOCO family show consistent gains across models and benchmarks. Hi-R1 achieves higher values than strong specialist baselines on most reported metrics. Analyses of token frequency, digit boundaries, object scale, and IoU distributions explain the effects of coordinate representation and reward training. The results show that structured coordinate generation provides an effective approach to generative visual grounding.
[77] MT-Web2Code: Benchmarking Coding Agents on Multi-Turn Regional Reconstruction and Localized Modification cs.CVPDF
Qiming Li, Shujie Hu, Haohan Liu, Xiaocheng Feng, Songxiang Liu
TL;DR: 该论文提出了MT-Web2Code，这是首个用于评估编码智能体在多轮次、多粒度网页UI代码编辑任务上的基准测试。它专注于从现有代码库中进行宏观区域重建和微观局部修改，包含16个垂直领域的102个任务。论文还开发了一个可扩展的反向损坏轨迹引擎来自动构建测试任务，并提出了一种双轴评估协议来衡量目标区域保真度和未受影响内容的保留情况。
Details
Motivation: 现有的大视觉语言模型在网页UI生成方面的基准测试主要关注单轮次、从零开始的整页生成，忽略了现实前端工程中迭代式的工作流程，即开发者需要反复重建缺失区域和修改现有代码库中的局部元素。
Result: 在13个前沿编码智能体上的实验表明，当前智能体难以在保留未受影响内容的同时忠实地重建目标区域，缺乏用于局部编辑的细粒度视觉-代码对齐能力，并且在多轮次任务中存在错误雪球效应。
Insight: 论文的主要创新点在于提出了首个专注于多轮次、迭代式网页UI代码编辑的基准测试MT-Web2Code，以及用于自动构建确定性测试轨迹的反向损坏轨迹引擎和结合了基于VLM的评分规则与确定性像素对齐的双轴评估协议，为训练迭代式UI编码智能体提供了细粒度的反馈信号。
Abstract: Recent advances in Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in web UI generation. However, existing benchmarks predominantly focus on single-turn full-page generation from scratch, overlooking the iterative workflow of real-world frontend engineering, where developers repeatedly reconstruct missing regions and modify localized elements within existing codebases. To bridge this gap, we introduce MT-Web2Code, the first multimodal coding benchmark for multi-turn Macro-Level Regional Reconstruction and Micro-Level Localized Modification, which contains 102 tasks spanning 16 vertical domains. To construct deterministic repair trajectories without costly turn-level human annotation, we develop a scalable Reverse-Corruption Trajectory Engine that iteratively injects structural and stylistic defects into golden pages. We further propose a dual-axis evaluation protocol that measures target-region fidelity and the preservation of unaffected content, where regional reconstruction is assessed by a 5-dimensional VLM-based rubric and localized modification by deterministic pixel-grounded alignment. Experiments on 13 frontier coding agents reveal that current agents struggle to faithfully reconstruct target regions while preserving unaffected content, lack fine-grained visual-code alignment for localized edits, and suffer from error snowballing over multiple turns. Beyond benchmarking, our deterministic evaluation metrics provide fine-grained feedback signals that may facilitate future research on training iterative UI coding agents. Our evaluation code and data will soon be released.
[78] How Many Labels Are Enough? ALDA: Active Learning Deployment Advisor for Medical Image Classification cs.CV | cs.AI | cs.LGPDF
Julia Machnio, Mads Nielsen, Mostafa Mehdipour Ghazi
TL;DR: 本文提出了ALDA（主动学习部署顾问），一个面向部署的主动学习方法选择框架，用于医学图像分类任务。该框架通过在有限的试点标注阶段拟合学习曲线模型，预测不同采样策略达到临床性能目标所需的标注数量及其不确定性，从而为实际部署提供风险感知的决策建议。
Details
Motivation: 主动学习（AL）旨在降低医学影像项目的标注成本，但在实际部署中，需要在完整标注预算耗尽前选定采样策略，错误的选择反而可能增加成本。因此，需要一种框架来指导在临床性能约束下选择最优的AL方法。
Result: 在四个医学影像分类领域的实验表明，ALDA仅需目标预算的15-30%作为试点，即可预测出部署最优的方法，与较差的策略选择相比，标注成本最多可降低82%。
Insight: 创新点在于将AL方法选择问题形式化为一个部署导向的决策问题，引入了‘部署窗口’来量化成本估计对临床阈值不确定性的敏感性，并提出了基于风险感知的推荐规则（在预测成本接近最优的策略中，优先选择部署窗口最窄、对阈值修订最鲁棒的策略），而非提出新的采样启发式方法。
Abstract: Active learning (AL) promises to reduce the cost of medical imaging projects by lowering the number of clinical labels required. However, practical deployment requires committing to a sampling strategy before the full annotation budget is spent, and choosing the wrong strategy can increase rather than decrease costs. We propose Active-Learning Deployment Advisor (ALDA), a deployment-oriented framework for AL method selection under clinical performance constraints. Given a short pilot phase, ALDA fits a parametric learning-curve model to each candidate strategy, estimates whether that strategy is expected to reach a required clinical performance target, and predicts the number of expert annotations needed to do so. In addition to absolute annotation cost, ALDA introduces a deployment window that quantifies the sensitivity of this cost estimate to uncertainty in the clinical threshold. The final recommendation follows a risk-aware rule: among strategies with near-optimal predicted cost, ALDA prefers the strategy with the narrowest deployment window, the most robust to threshold revisions. Experiments on four medical imaging classification domains show that ALDA predicts the deployment-optimal method from a pilot of 15-30% of the intended budget and reduces annotation costs by up to 82% compared with a poor strategy choice. Rather than introducing a new sampling heuristic, ALDA provides a practical decision layer that answers a deployment-critical question: how many labels are enough?
[79] From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology cs.CVPDF
Basit Alawode, Moshira Ali Abdalla, Dwarikanath Mahapatra, Muhammad Muzammal Naseer, Sajid Javed
TL;DR: 本文提出了一种名为多分辨率金字塔Transformer（MRPT）的计算病理学基础模型，旨在解决现有模型通常仅在单一分辨率上预训练、难以泛化到任意分辨率的问题。MRPT通过分层聚合从细胞到组织再到整个玻片图像（WSI）的多尺度信息，并采用连续的跨分辨率注意力机制和跨分辨率嵌入对齐来学习鲁棒且可泛化的WSI表示。在包含6.24亿个图像块、240万个区域和3.6万张WSI的数据上进行多分辨率自监督预训练后，MRPT在34个不同数据集上的癌症亚型分类、组织表型分析和视觉问答任务中超越了现有基础模型和多模态大语言模型。
Details
Motivation: 现有的视觉Transformer及其变体在计算病理学中表现良好，但大多在单一分辨率的全玻片图像上进行预训练，这限制了它们对不同分辨率的泛化能力。而千兆像素的WSI天然包含从细胞形态到组织结构和全局上下文的多尺度诊断信息，模仿了病理学家的阅片过程，因此需要一种能有效整合多分辨率信息的模型。
Result: 在34个多样化的数据集上进行广泛实验，结果表明MRPT在癌症亚型分类、组织表型分析和针对WSI理解的视觉问答任务上，超越了近期的基础模型和多模态大语言模型，达到了最先进的性能水平。
Insight: 论文的核心创新点在于提出了一个能够分层处理多分辨率信息的金字塔Transformer架构，并引入了具有生物学意义的连续跨分辨率注意力机制来捕获尺度无关的交互，同时通过跨分辨率嵌入对齐来强制多分辨率语义一致性。这为构建能够泛化到任意分辨率、学习从粗到细的丰富组织病理学特征的基础模型提供了新思路。
Abstract: Vision Transformers (ViTs) and their hierarchical variants have achieved strong performance in Computational Pathology (CPath). However, most are pre-trained on single-resolution Whole Slide Images (WSIs), limiting their generalization across arbitrary resolutions. Gigapixel WSIs inherently contain diagnostic patterns at multiple scales, including cellular morphologies, tissue architectures, and global context, mirroring how expert pathologists examine WSIs. We introduce Multi-Resolution Pyramid Transformer (MRPT), a model that hierarchically aggregates multi-resolution information from cellular to tissue and WSI levels. MRPT employs a biologically meaningful Consecutive Cross-Resolution Attention (CCRA) mechanism to capture scale-independent interactions and enforces multi-resolution semantic consistency by aligning embeddings across resolutions, yielding robust and generalizable WSI representations. Pre-trained in a multi-resolution self-supervised manner on 624M patches, 2.4M regions, and 36K WSIs, MRPT learns rich coarse-to-fine histopathology features. Extensive experiments on 34 diverse datasets show that MRPT surpasses recent foundation models and Multimodal Large Language Models (MLLMs) in cancer subtype classification, tissue phenotyping, and Visual Question Answering (VQA) for WSI understanding.
[80] S$^3$-Diff: Structural Semantic Synergy Diffusion Model for High Fidelity Super Resolution of Pathological Images cs.CVPDF
Jiaming Liang, QiHui Han, Guangye Ou, Jiawen Liu, Haolin Chen
TL;DR: 本文提出了一种名为S3-Diff的结构语义协同扩散模型，用于病理图像的高保真超分辨率重建。该模型通过标本感知结构锚定（SSA）模块来保持关键的病理形态，并结合结构引导的语义保真调优（SSFT）来抑制伪影并确保结构一致性。实验表明，该方法在重建质量和下游生存分析性能上均优于现有技术。
Details
Motivation: 数字病理学依赖高分辨率全切片图像进行准确诊断，但成像设备、存储和传输的限制使得低分辨率图像在临床工作流中更常见。现有超分辨率技术往往会平滑掉与诊断相关的形态，导致纹理过度平滑和语义漂移，从而损害下游临床判读。
Result: 广泛的实验结果表明，S3-Diff在重建质量和下游生存分析性能方面始终优于最先进的方法。
Insight: 核心创新在于标本感知结构锚定（SSA）模块，它结合了固定SAM提取的预后感知组织支持与LR-HR梯度差异，生成标本特定的结构锚以保留病理形态。同时，结构引导的语义保真调优（SSFT）利用SSA提供的结构监督来适配DINOv3表征，并结合低分辨率图像的边缘和灰度线索，引导去噪过程以抑制随机伪影并保持结构一致性。
Abstract: Digital pathology relies on high-resolution whole slide images for accurate diagnosis, yet limitations in imaging devices, storage, and transmission often make lower-resolution pathology images more common in clinical workflows. Current super-resolution techniques often tend to smooth diagnostically relevant morphology, leading to over-smoothed textures and semantic drift that compromise downstream clinical interpretation. To this end, we develop the Structural Semantic Synergy Diffusion Model (S3-Diff), a diffusion framework for high-fidelity super-resolution of pathological images. The core of S3-Diff is Specimen-aware Structural Anchoring (SSA), which combines prognosis-aware tissue support extracted by a fixed SAM with LR-HR gradient discrepancies to generate a specimen-specific structural anchor to preserve pathological morphology. Concurrently, we introduce Structure-guided Semantic Fidelity Tuning (SSFT) to adapt DINOv3 representations using SSA-derived structural supervision. SSFT combines the adapted semantic energy with LR-derived edge and grayscale cues. The resulting control guides denoising to suppress stochastic artifacts and maintain structural consistency. Extensive experimental results demonstrate that S3-Diff consistently outperforms state-of-the-art methods in both reconstruction quality and downstream survival analysis performance. The source code will be made public.
[81] Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning cs.CVPDF
Kejian Zhu, Zhuoran Jin, Dongqi Huang, Hongbang Yuan, Yupu Hao
TL;DR: 本文研究如何设计更有效的多模态智能体训练环境分布，指出单纯增加环境数量并不总是有益。论文从多样性和难度结构两个维度提出改进方法：能力感知环境选择（AES）用于获取多样化环境集，分层难度课程（HDC）通过削弱约束和状态规模递进两个难度级别组织课程学习。实验表明这些方法能有效提升多模态智能体训练效果。
Details
Motivation: 当前多模态智能体训练通常通过构建大规模环境池进行，但研究发现单纯增加环境数量并不总能带来性能提升，因此需要分析现有环境分布的局限性并设计更有效的训练环境分布策略。
Result: 实验表明，提出的AES和HDC方法能有效改善多模态智能体训练，但摘要未提及具体基准测试或定量结果（如SOTA比较）。
Insight: 创新点在于从环境分布的多样性和难度结构两个维度系统优化训练过程，特别是AES的环境选择机制和HDC的双层课程学习设计，为多模态智能体训练提供了可借鉴的环境构建方法论。
Abstract: Recent works train agents by constructing large-scale multimodal environment pools. However, we find that simply increasing the number of multimodal environments does not always benefit. We further analyze the limitations in current multimodal environment distributions through a series of experiments. Based on these findings, we study how to build more effective training environment distributions from two dimensions: diversity and difficulty structure. For diversity, we propose Ability-aware Environment Selection (AES) to obtain diverse environment sets. For difficulty structure, we propose Hierarchical Difficulty Curriculum (HDC), which organizes curriculum learning through two difficulty levels: harness weakening and state-scale progression. Experiments show that AES and HDC effectively improve multimodal agent training.
[82] Compass: Degradation-Simulated Reciprocal Learning with Lightweight Needle RWKV for Multimodal Crack Segmentation under Missing Modalities cs.CVPDF
Hui Liu, Chen Jia, Fan Shi, Xu Cheng, Mianzhao Wang
TL;DR: 本文提出Compass框架，用于解决工业设施多模态裂缝分割中模态缺失导致的性能下降问题。该方法包含三个核心组件：退化模拟蒸馏（DSD）通过模拟更严重的模态缺失进行双向蒸馏，解耦完整感知与退化适应；轻量级骨干网络Needle Block通过注入裂缝方向线索和连接感知门控实现结构感知建模；证据拓扑保持融合（ETPF）利用Dempster-Shafer证据理论进行不确定性门控解码，在抑制不可靠特征的同时保持裂缝拓扑结构。
Details
Motivation: 解决多模态裂缝分割中模态缺失导致的语义退化问题，同时保持较低计算成本，实现任意模态缺失下的鲁棒分割。
Result: 在三个数据集上的实验表明，该方法在多种模态缺失场景下达到SOTA性能。在CrackDepth数据集上即使深度模态缺失90%，仍能以2.58M参数量实现F1分数0.8216和mIoU 0.8434。
Insight: 创新点包括：1）退化模拟蒸馏机制通过模拟更严重缺失进行双向知识蒸馏；2）特征感知原型传输器（FAPT）实现模态无关的原型引导特征补全；3）将裂缝方向线索注入WKV调制，结合连接感知门控实现轻量级结构感知建模；4）基于证据理论的不确定性门控融合方法在抑制噪声同时保持拓扑结构。
Abstract: In multimodal crack segmentation for industrial facilities, the key challenge is preventing missing modalities from degrading pixel-level performance while maintaining low computational cost. Existing methods struggle to address semantic degradation caused by missing modalities. We propose Compass, a lightweight network for robust crack segmentation under arbitrary missing modalities. Compass comprises Degradation Simulation Distillation (DSD), Needle Block, and Evidential Topology-Preserving Fusion (ETPF). DSD constructs a degradation simulation stream that mimics more severe missing conditions and performs reciprocal distillation with the original stream, decoupling complete perception from degradation adaptation. Within DSD, Feature-Aware Prototype Transmitter (FAPT) performs modality agnostic prototype-guided feature completion to maintain semantic integrity under incomplete modality conditions. As a lightweight backbone, Needle injects crack-direction cues into WKV modulation and combines connectivity-aware gating with anisotropic context probing for structure-aware modeling. ETPF fuses multimodal features via Dempster-Shafer evidential combination with uncertainty-gated decoding, preserving crack topology while suppressing unreliable features. Experiments on three datasets demonstrate state-of-the-art (SOTA) performance under diverse missing modality scenarios. Even with 90% depth modality missing on CrackDepth, Compass achieves F1 of 0.8216 and mIoU of 0.8434 with only 2.58M parameters. The code is available at https://github.com/Karl1109/Compass.
[83] GVCCTurbo: Rate-Compute Quality Scheduling for Codebook Driven Generative Compression cs.CVPDF
Ziyue Zeng, Dingjie Peng, Xun Su, Hiroshi Watanabe
TL;DR: GVCCTurbo是一种面向码本驱动生成式压缩的码率-计算质量调度方法，它将昂贵的先验模型刷新与码本校正分离，通过一次性校准原子计数操作点和跳过间隔比，将目标码本有效载荷比特率映射为轨迹长度和刷新周期，从而使比特率成为调度输入而非采样器长度的固定结果。该方法适用于GVCC风格的整流流视频压缩和DDCM风格的扩散图像压缩，在保持零训练部署和与未来蒸馏先验兼容性的同时，显著减少解码时间。
Details
Motivation: 当前基于码本的生成式压缩方法将每个有限速率的校正与一次新的先验评估绑定，缩短采样器会同时移除携带目标相关信息的校正槽位。论文旨在解决这一问题，提出一种调度机制，将比特率作为可控的调度输入，而非采样器长度的固定后果，以实现超低比特率下的高效压缩。
Result: 在720p Wan-GVCC的受控研究中，调度器将先验评估次数从20次减少到9次，在整个调度家族中实现了约44%的解码时间减少，在高运动内容上仅带来较小的共享LPIPS损失。在调度家族内部，BPP感知的内部点以2.9%更少的码本有效载荷比特，在可比LPIPS下获得了持续更高的PSNR。原生1080p曲线将完整的零样本编解码器定位在超低比特率区域。
Insight: 创新点在于提出了一种将比特率与计算调度分离的框架，使比特率成为可调度的输入参数，而非固定采样长度的副产品。这为生成式压缩提供了可控的码率-计算权衡扩展，无需分配的调度点支配所有边界点，同时保持了零训练部署和与未来模型的兼容性。
Abstract: Codebook-driven generative compression uses a pretrained image or video generator as a zero-shot visual prior and transmits compact codebook indices to guide reconstruction at ultra-low bitrate. Current codecs tie each finite-rate correction to a fresh prior evaluation, so shortening the sampler also removes correction slots that carry target-dependent information. We propose GVCCTurbo, a BPP-driven scheduler that separates expensive prior refreshes from codebook corrections: after calibrating an atom-count operating point and skip-gap ratio once per protocol, it maps a target codebook-payload bitrate to a trajectory length and refresh period, making BPP a schedule input instead of a fixed consequence of sampler length. The same endpoint-prediction and finite-rate steering interface covers GVCC-style rectified-flow video and DDCM-style diffusion image compression, preserving zero-training deployment and compatibility with future distilled priors. Native 1080p curves position the complete zero-shot codec in the ultra-low-bitrate regime. In a controlled 720p Wan-GVCC study, the scheduler cuts prior evaluations from 20 to 9 for a $\sim!44%$ measured decoding-time reduction shared across the whole schedule family, at a small shared LPIPS cost on high-motion content; within that family, uniform refresh thinning (pure-skip) is a boundary point, and the BPP-aware interior point trades $2.9%$ fewer codebook-payload bits for consistently higher PSNR at comparable LPIPS. These results support BPP-to-compute scheduling as a controllable extension of sampler-length tuning, without requiring the allocated point to dominate every boundary point.
[84] SlimVLM: Sensitivity-aware Dynamic Structured Pruning with Adaptive Visual Token Selection for Efficient Vision-Language Models cs.CVPDF
Yaozhi Wen, Jialong Guo, Zhenliang Ni, Han Shu, Xinghao Chen
TL;DR: 本文提出了SlimVLM，一个用于压缩视觉语言模型（VLMs）的结构化剪枝框架。该框架通过自适应视觉令牌选择策略来去除冗余的视觉令牌，并采用敏感度感知的动态剪枝机制为不同模块确定合适的剪枝比例，从而在减少模型计算开销的同时保持任务性能。
Details
Motivation: 视觉语言模型参数量大，计算开销高，限制了其在资源受限设备上的部署。现有剪枝方法直接应用于VLMs会导致性能显著下降，主要原因是冗余的视觉令牌干扰了重要性评估。
Result: 实验结果表明，SlimVLM在多个多模态基准测试中超越了现有方法，达到了最先进的性能水平。
Insight: 创新点在于提出了基于文本到视觉平均注意力分数的自适应视觉令牌选择策略，以及通过计算剪枝前后模块输出的线性重构误差来确定各模块剪枝比例的敏感度感知动态剪枝机制，这优化了VLMs剪枝中的重要性计算和整体性能稳定性。
Abstract: While Vision-Language Models (VLMs) have demonstrated remarkable performance in processing and understanding both text and images, their large parameter sizes lead to significant computational overhead, limiting their deployment on resource-constrained devices. While pruning has been effective for compressing Large Language Models (LLMs), directly applying it to VLMs leads to significant performance drops, largely due to redundant visual tokens interfering with importance estimation. To this end, we propose SlimVLM, a structured pruning framework designed to compress VLMs while preserving their task performance. We introduce an adaptive visual token selection strategy for VLMs that leverages average text-to-visual attention scores to assess the importance of visual tokens, removing redundant ones during pruning based on a set threshold, thereby optimizing the importance calculation. Recognizing the varying tolerance to sparsity across different modules, we also propose a Sensitivity-aware dynamic pruning mechanism that determines the appropriate pruning ratio for each module by calculating the linear reconstruction error between the outputs of the pruned and unpruned modules, ensuring overall performance stability. Experimental results show that SlimVLM outperforms existing methods across multiple multimodal benchmarks, achieving state-of-the-art performance.
[85] SEER: A Self-Grounded Evidence Interface for Controlled Spatial Relation Classification cs.CVPDF
Feixiang Liu, Likun Wang, Qiang Qiu, Hui Xu, Huawei Shen
TL;DR: 论文提出了一种名为SEER的训练无关推理时证据接口，用于提升冻结视觉语言模型在空间关系分类任务中的性能。该方法通过隐藏候选关系进行实体对定位，构建具有明确主客体角色的查询特定视图，并保留完整图像和稀疏边界框几何信息作为补充证据。
Details
Motivation: 现有视觉语言模型在空间关系问题中，即使能识别实体，也常因错误实例或模糊全局视图而给出错误答案。论文旨在通过显式提供查询特定证据来缓解这一问题。
Result: 在图像不相交的GQA-Train900测试集上，SEER相比完整图像方法提升了+3.94 [2.17,5.72]；在三个模型的2,434个过滤后的EmbSpatial成对关系问题上，提升范围从+4.35到+11.79。
Insight: 创新点在于提出了一种无需训练的证据接口，通过查询特定的证据构建（包括角色明确的视图和几何信息保留）作为主要干预手段，并引入基于互逆一致性的协议特定细化作为辅助优化。
Abstract: Spatial relation questions require a model to identify the queried subject and object before comparing their layout. Yet a VLM can recognize both entities and still answer from the wrong instance or an ambiguous global view. We ask whether making query-specific evidence explicit can mitigate this failure and propose SEER (Self-grounded Evidence for Entity-Relation Reasoning), a training-free inference-time evidence interface for frozen VLMs. SEER hides candidate relations during pair localization, constructs a query-specific view with explicit subject/object roles, and retains the full image and sparse box geometry as complementary evidence. For relation-choice protocols with exact inverse support, an optional refinement swaps the entity roles and changes the forward decision only when exactly one visual state obeys the corresponding inverse relation. On an image-disjoint GQA-Train900 test frozen before model scoring, SEER pools to +3.94 [2.17,5.72] over Full; the gain remains positive under label-independent grounding-order counterbalancing and on the 535 rows whose entity names are unique. The unchanged protocol yields +4.35 to +11.79 on all 2,434 filtered EmbSpatial pair-relation questions across three models. Matched controls separate local refocus from role-explicit conditioning. These results establish query-specific evidence construction as the principal intervention, with reciprocal consistency as a smaller protocol-specific refinement.
[86] When Do Fewer Visual Tokens Accelerate Multimodal Inference? A Break-Even Study Across Decision Locations and Hardware cs.CVPDF
Hao Dou, Ruiwen Tian
TL;DR: 本文研究了在视觉-语言模型中减少视觉令牌数量对端到端推理延迟的影响，发现更少的视觉令牌并不总是带来更低的延迟。通过一个可复现的协议，评估了决策开销、共享工作和不同策略可避免的操作符，并通过阶段级分解将这些组件与实测端到端延迟关联。在30个示例的初步实验中，测试的自回归探针策略仍比完整处理慢，而轻量级视觉后预测器在RTX 3090和A100上显示出显著的延迟降低。视觉前路由策略因能避免预处理和视觉编码，在A100上其优势甚至超过了视觉后策略带来的更大下游令牌减少量。
Details
Motivation: 解决视觉-语言模型中减少视觉令牌以加速推理的直觉与实际情况不符的问题，即更少的视觉令牌并不保证更低的端到端延迟，需要系统性地分析决策位置和硬件的影响。
Result: 在30个示例的初步实验中，视觉后轻量级预测器在RTX 3090和A100上产生了成对置信区间低于零（表明延迟降低），且经过保守的Holm校正后仍显著；视觉前图像大小规则在两个GPU上也显示出区间低于零，但校正后不显著。在A100上，视觉前路由的结构性机会（避免预处理和编码）超过了视觉后策略近八倍的下游令牌减少优势。
Insight: 创新点在于提出了一个可复现的协议来评估视觉令牌减少策略的盈亏平衡点，强调了决策位置（视觉前 vs. 视觉后）和硬件特性的关键作用；客观分析认为，视觉前路由因能避免整个视觉编码流水线，可能比仅减少下游令牌的视觉后修剪更具延迟优势，这为高效多模态推理系统设计提供了新的权衡视角。
Abstract: Fewer visual tokens do not guarantee lower end-to-end latency. We evaluate break-even with a reproducible protocol that accounts for decision overhead, shared work, and the operators each policy can avoid. A stage-level decomposition reconciles these components with measured end-to-end latency. In a 30-example pilot, the two tested autoregressive probes remain slower than Full despite state reuse. A lightweight post-vision predictor yields paired confidence intervals below zero on RTX 3090 and A100 and remains significant after a conservative all-pairs Holm correction. A pre-vision image-size rule also yields intervals below zero on both GPUs, although neither comparison remains significant after the same correction. Pre-vision routing has a structural opportunity unavailable to post-vision pruning: it can avoid preprocessing and vision encoding. On A100, this opportunity outweighs a nearly eightfold larger downstream token reduction by the post-vision policy. Reported quality is conditional on examples answered correctly by Full and is not benchmark accuracy.
[87] XiDepth: a Lightweight and Efficient Network for Self-supervised Monocular Depth Estimation cs.CVPDF
Elena Izzo, Riccardo Toniolo, Lamberto Ballan
TL;DR: 该论文提出了一种名为XiDepth的轻量级高效网络，用于自监督单目深度估计。该网络基于XiNet算子块设计，旨在提升特征提取能力的同时保持低计算复杂度和低能耗。在KITTI数据集上，XiDepth仅用0.8M参数就达到了最先进的性能，并在树莓派4上验证了其在实际嵌入式应用中的适用性，相比领先方法减少了40%的FLOPs和35%的能耗。
Details
Motivation: 自监督单目深度估计因其对昂贵深度传感器的依赖较少，成为在计算受限设备上部署轻量高效模型的吸引人方案。然而，现有最先进模型通常采用深度可分离卷积和注意力机制，这些操作往往带来高能耗，并在嵌入式环境中面临兼容性问题。因此，需要设计一种资源高效的神经网络，在不牺牲整体性能的前提下解决这些问题。
Result: 在KITTI数据集上，XiDepth仅使用0.8M参数就实现了最先进的性能。在树莓派4上的测试进一步证实了其在实际嵌入式应用中的适用性，与领先方法相比，FLOPs减少了40%，能耗降低了35%。
Insight: 论文宣称的创新点在于提出了基于XiNet算子块的轻量级架构XiDepth，该设计增强了特征提取能力，同时保持了低计算复杂度和低能耗。从客观角度看，其创新之处在于通过一种新的算子块设计，有效平衡了模型性能与资源效率，特别是在嵌入式设备上的实际部署能力，为解决自监督深度估计中的资源约束问题提供了新思路。
Abstract: Self-supervised monocular depth estimation has emerged as an appealing solution to design lightweight and effective models for deployment on computationally constrained devices due to its reduced reliance on expensive depth sensors. By eliminating the need for ground-truth annotations and leveraging the simplicity of monocular camera setups, this approach facilitates cost-effective data collection and broad applicability across fields such as computer vision and robotics. A critical challenge is achieving resource-efficient neural networks without compromising the overall performance. State-of-the-art models generally adopt depth-wise convolutions and attention mechanisms; however, these functions often incur high energy costs and face compatibility issues in embedded environments. To address this, we propose XiDepth, a lightweight architecture based on the XiNet operator block, designed to enhance feature extraction while maintaining low computational complexity and energy demand. On the KITTI dataset, XiDepth achieves state-of-the-art performance with only 0.8M parameters. Tests on a Raspberry Pi 4 further confirm its suitability for real-world embedded applications, reducing FLOPs by 40% and energy consumption by 35% compared to leading methods.
[88] Keep the Needle, Prune the Haystack: Defect-Preserving Token Pruning for Efficient Zero-Shot Anomaly Detection cs.CVPDF
Yanning Hou, Jingyuan Zhang, Xiaoyun Wang, Qixiang Ma, Sihang Zhou
TL;DR: 本文提出了一种名为KeepAD的缺陷保留令牌剪枝框架，用于高效的零样本异常检测。该方法通过高召回、异常感知的路由机制，在浅层结合局部覆盖保留选择和确定性异常救援来保留细微缺陷，在深层使用冻结原型引导自适应预算剪枝，从而在显著减少计算令牌的同时最小化检测性能损失。
Details
Motivation: 现有零样本异常检测方法通常对所有图像和空间令牌进行密集计算，而现实中正常样本占主导且异常区域通常很小。直接令牌剪枝存在不对称风险：保留正常令牌导致冗余计算，而移除异常令牌可能丢失检测和定位的唯一证据，尤其在早期层风险更高。
Result: 在六个工业和七个医学零样本异常检测基准测试中，KeepAD将令牌保留率降至20%以下，同时将图像级和像素级AUROC的平均性能下降控制在2.7个百分点以内。在最激进的设置下，相比最强的基于CLIP的基线方法实现了7.9倍的加速。
Insight: 创新点在于将令牌选择形式化为高召回、异常感知的路由问题，并分层处理：浅层采用覆盖保留与异常救援的混合策略以降低早期误剪风险，深层利用冻结原型进行自适应预算剪枝。此外，密集到稀疏的自蒸馏监督早期路由而不增加推理开销，实现了效率与精度的平衡。
Abstract: Zero-shot visual anomaly detection has achieved remarkable progress, with recent vision-only approaches further improving performance while simplifying the inference pipeline. However, existing methods typically perform dense computation over all images and spatial tokens, despite the fact that normal samples dominate real-world scenarios and anomalies usually occupy only small regions. Token pruning offers a promising solution, but introduces an asymmetric pruning risk in anomaly detection: retaining normal tokens mainly incurs redundant computation, whereas removing anomalous tokens may eliminate the only evidence for detection and localization. This risk is particularly severe in early layers, where pruning provides the greatest computational benefit but anomaly semantics remain unreliable. We propose KeepAD, a defect-preserving token pruning framework that formulates token selection as high-recall, anomaly-aware routing. In shallow layers, KeepAD combines coverage-preserving selection over local $2\times2$ patch neighborhoods with deterministic anomaly rescue to reduce the risk of discarding subtle defects. In deeper layers, frozen normal and abnormal prototypes guide pruning under an image-adaptive token budget, aggressively removing low-risk normal tokens while preserving local anomaly evidence. Dense-to-sparse self-distillation further supervises early token routing without introducing additional inference overhead. Experiments on six industrial and seven medical zero-shot anomaly detection benchmarks show that KeepAD reduces the token retention ratio to below $20%$, while limiting the average degradation in image-level and pixel-level AUROC to within $2.7$ percentage points. At the most aggressive operating point, KeepAD achieves a $7.9\times$ speedup over the strongest CLIP-based baseline.
[89] Attention is Case-Sensitive cs.CV | cs.CL | cs.LGPDF
Maximilian Dillitzer, Tin Stribor Sohn, Jason J. Corso, Michael Auerbach
TL;DR: 本文通过系统性实证研究发现，大语言模型（LLMs）和视觉语言模型（VLMs）存在一种与人类视觉感知类似的特性：字母大小写能调节模型内部的注意力分配。具体表现为，在纯小写文本上下文中，将目标信息格式化为交替大小写或全大写，会集中注意力于这些文本片段。然而，这种注意力集中并不总是提升下游任务准确率，有时甚至在高熵上下文中会损害性能。此外，研究还发现推理模型的“思考”阶段可以缓解这种敏感性，而VLMs中的该效应则表现为跨模态注意力的重新组织。
Details
Motivation: 研究动机源于人类视觉中大写字母作为自然显著性线索的现象，旨在探究大语言模型和视觉语言模型是否具有类似的、由字母大小写调节内部注意力分配的潜在特性。
Result: 研究对13个模型（9个LLMs和4个VLMs）进行了分析，结果表明，在文本模型中，这种“大小写效应”在所有被评估的非推理模型中普遍存在，能稳健地转移注意力，但对下游任务准确率的影响复杂，在高熵上下文（如交替大小写）中甚至会降低准确率。在推理模型中，其“思考”阶段起到了语义缓冲作用。在VLMs中，该效应部分存在，主要导致注意力从图像宏观地转向文本提示，并次要地使剩余的视觉注意力集中于目标区域。
Insight: 论文的创新点在于将字母大小写孤立出来，作为一种无需模型访问或微调的零样本注意力引导机制，揭示了预训练模型如何内化排版强调（typographic emphasis）的新基础理解。从客观角度看，这提供了一种简单、无需训练的工具来分析和操控模型内部注意力，并揭示了注意力机制与最终任务性能之间可能存在的脱节，对模型可解释性和鲁棒性研究有启发意义。
Abstract: In human visual perception, uppercase lettering serves as a natural salience cue that captures attention within lowercase text. In this paper, we present a systematic empirical characterization study revealing that Large Language Models (LLMs) exhibit an analogous property: letter casing modulates internal attention allocation. Through analysis across 13 models, nine LLMs and four Vision-Language Models (VLMs), with diverse tokenization schemes, we show that formatting target information in alternating or uppercase against a lowercase context concentrates attention on those textual spans. In text this effect is universal, holding across every evaluated non-reasoning model. We frame it as a previously under-explored latent property of pretrained transformers rather than a prescriptive method. Our investigation reveals a central attention-performance divergence: while this “casing effect” robustly shifts attention, its impact on downstream accuracy is non-trivial, increased concentration does not inherently improve task accuracy and, in high-entropy contexts like alternating case, can degrade it. We further identify a boundary condition: the deliberative “thinking” phase in reasoning models acts as a semantic buffer that mitigates typographic sensitivity in text. Extending the study to VLMs, we find the effect transfers partially: the same prompt-side casing reorganizes cross-modal attention along two coupled axes, predominantly a macroscopic disengagement from the image toward the text prompt, and secondarily a concentration of the residual visual attention on the target region. By isolating casing as a zero-shot mechanism for attention steering that requires no model access or fine-tuning, we provide a new foundational understanding of how pretraining internalizes typographic emphasis.
[90] TDVR: Joint Text Disambiguation and Viewpoint Reasoning for Zero-Shot 3D Visual Grounding cs.CVPDF
Qingxi Du, Junbo Wang, Yuke Li, Yining Zhu
TL;DR: 本文提出了一种名为TDVR的无训练推理框架，用于解决零样本3D视觉定位中的文本歧义和视角缺失问题。该方法首先构建语义3D场景图，并利用大语言模型对查询文本进行消歧和结构化表示；然后通过视角推理获取最优视角，并进一步区分干扰对象；最后通过融合视角、混淆、类别和外观得分来识别目标物体。
Details
Motivation: 现有零样本3D视觉定位方法的性能受到模糊查询文本和缺失视角的显著限制，本文旨在同时解决这两个核心挑战。
Result: 在公开的ScanRefer数据集上，TDVR在Acc@0.25和Acc@0.5指标上分别超过现有SOTA方法15.25%和14.46%，证明了其有效性。
Insight: 创新点在于将文本消歧与视角推理联合在一个无训练框架中，并利用大语言模型进行语义融合与结构化推理，以及通过视角推理和混淆评分机制来增强对相似物体的区分能力。
Abstract: Zero-shot 3D visual grounding aims to localize specific objects based on textual descriptions and 3D visual input. However, the effectiveness of existing methods is significantly hindered by the ambiguous query text and deficient viewpoints. To address these issues, we propose TDVR, a training-free reasoning framework that disambiguates the input text and infers accurate viewpoints for zero-shot 3D visual grounding. First, we construct semantic 3D scene graph from the detected instances in the 3D point cloud. Subsequently, we put the original query, appearance and spatial relationship descriptions into the LLM for fusion, thereby disambiguating the initial input. We leverage chain-of-thought reasoning to generate the structured representation of disambiguated query. Then taking the scene graph and structured query as input, we get the optimal view via viewpoint reasoning to solve the problem of missing viewpoints during grounding. Based on the obtained optimal viewpoint, we further discriminate the distracting objects, enabling the model with the ability to distinguish similar instances. After that, we match the category text and appearance images with the query by computing the similarity of feature vectors. Finally, the target object was identified by integrating the viewpoint score, confusion score, category score, and appearance score. Compared with previous methods, our TDVR has stronger capabilities in viewpoint reasoning, similar object discrimination, and ambiguous query understanding. Experimental results on the public ScanRefer dataset show that our method outperforms the existing state-of-the-art methods by 15.25% and 14.46% in Acc@0.25 and Acc@0.5 respectively, demonstrating the effectiveness of our TDVR in addressing ambiguous query text and deficient viewpoints.
[91] AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding cs.CVPDF
Yuxiang Duan, Huining Li, Ao Li, Shuai Feng, Lanju Kong
TL;DR: 本文提出了AgenticVAU，一个无需训练的多智能体框架，用于视频异常理解（VAU）。该框架将VAU任务建模为探索-验证过程，通过四个专门化的智能体（视觉规则构建、搜索规划、视频观察和最终决策）协作，在共享的证据存储器（锚点注册表）支持下，交替进行广泛的时间探索、密集的局部验证和跨区间比较，以全面解释视频中的异常事件。
Details
Motivation: 现有VAU方法通常依赖专门训练或有限观察，限制了泛化能力或证据覆盖范围；而单智能体方法虽支持自适应观察，但将探索、观察和决策集成在统一推理过程中，缺乏角色专门化和结构化证据协调。
Result: 在VAU-Bench的ECVA、UCF-Crime和MSAD子集上的实验表明，AgenticVAU在零样本推理和基于强化学习的基线方法上取得了更优性能，证明了多智能体协作在视频异常理解中的价值。
Insight: 创新点在于将VAU任务解耦为探索-验证流程，并引入专门化的多智能体架构与共享证据存储器（锚点注册表），实现了角色分工与结构化证据协调，从而无需训练即可提升对视频异常的解释能力。
Abstract: Video anomaly understanding (VAU) focuses on comprehensively interpreting abnormal events in videos, requiring models to identify anomalous occurrences, discover their supporting evidence, and explain the underlying causes beyond simple anomaly detection. Existing VAU methods often rely on specialized training or limited observations, restricting generalization or evidence coverage. Although single-agent alternatives support adaptive video observation, they still integrate exploration, observation, and decision-making within a unified reasoning process, offering limited role specialization and structured evidence coordination. To address these limitations, we present AgenticVAU, a training-free multi-agent framework that casts VAU as an explore–verify process, where the system first discovers potential anomalies and then verifies them through targeted observations. To achieve this, four specialized agents are introduced to handle visual-rule construction, search planning, video observation, and final decision, respectively. These agents communicate through an anchor registry, a shared evidence memory that binds each observation. Guided by this agent framework, AgenticVAU interleaves broad temporal exploration, dense local verification, and cross-interval comparison until sufficient evidence is collected. We conduct extensive experiments on the ECVA, UCF-Crime, and MSAD subsets of VAU-Bench, the results show that AgenticVAU outperforms zero-shot inference and reinforcement learning-based baselines, demonstrating the value of multi-agent collaboration for video anomaly understanding.
[92] UHP Detection: LVLMs have their Unique Hallucination Pattern in the Consistency Space cs.CV | cs.AIPDF
Amir Mohammad Ezzati, Kiyan Rezaee, Bardiya Kariminia, Mohamad Amin Yousefi, Asal Mohammadjafari Mamaqani
TL;DR: 本文提出了一种名为UHP Detection的完全黑盒框架，用于检测大型视觉语言模型（LVLMs）中的幻觉问题。该方法将幻觉建模为一个由扰动模态（图像与文本）和逻辑极性（陈述与其否定）两个轴定义的结构化不确定性模式，通过四个互补的一致性组来捕捉模型不确定性的不同表现，并从中提取特征训练轻量级分类器。
Details
Motivation: 现有黑盒幻觉检测方法通常通过单一的一致性度量来估计不确定性，但幻觉在不同行为探针中表现出多样化的不确定性表现形式，使得单一度量不足以刻画其底层行为。
Result: 在AMBER和PhD基准测试上对三种LVLM进行的综合实验表明，UHP Detection始终优于先前的黑盒和白盒基线方法，相对于最强的黑盒方法，AUC-ROC和AUC-PR分别提升了高达18.72%和20.07%。跨数据集评估表明，学习到的模式在不同基准测试间具有泛化能力。
Insight: 创新点在于将幻觉概念化为一个结构化的、双轴定义的不确定性模式，并利用四个互补的一致性组来提取更丰富的特征。这揭示了幻觉行为反映了模型特定的、可泛化的一致性模式，而非单一的不确定性度量。
Abstract: Large vision–language models (LVLMs) demonstrate strong multimodal reasoning capabilities but remain prone to hallucination, where model predictions are not grounded in visual evidence. Existing black-box hallucination detection methods estimate uncertainty through a single consistency metric, implicitly assuming that model uncertainty can be adequately characterized by a single measure. However, hallucinations exhibit diverse manifestations of uncertainty across different behavioral probes, making a single measure insufficient to characterize their underlying behavior. We propose \emph{Unique Hallucination Pattern (UHP) Detection}, a fully black-box framework that models hallucination as a structured uncertainty pattern defined by two axes: perturbation modality (image vs.\ text) and logical polarity (a statement vs.\ its negation). Their intersection produces four complementary consistency groups that capture distinct manifestations of model uncertainty, from which both within-group and between-group features are extracted to train a lightweight classifier. Through comprehensive experiments on AMBER and PhD across three LVLMs, UHP Detection consistently outperforms prior black-box and white-box baselines, with improvements of up to $+18.72%$ AUC-ROC and $+20.07%$ AUC-PR over the strongest black-box methods. Extensive ablation studies demonstrate that each consistency group contributes complementary information and that their combination forms a structured hallucination pattern. Furthermore, cross-dataset evaluation shows that this learned pattern generalizes across benchmarks, indicating that hallucination behavior reflects a model-specific consistency pattern. \textbf{Code is publicly available at} https://github.com/amirezzati/uhpdet.
[93] OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models cs.CVPDF
Wanshun Su, Yang Shi, Feihu Liu, Ziwen Yu, Yan Min
TL;DR: 本文提出了OmniPack，一个用于全模态大语言模型（Omni-LLMs）的无训练令牌压缩框架，旨在高效处理冗长的视觉和音频令牌序列。它通过协调LLM前的结构化压缩和LLM内的任务相关语义精炼，在多个基准测试和模型上实现了最佳的性能-效率权衡。
Details
Motivation: 现有全模态大语言模型处理长且高度冗余的视听令牌序列时计算开销巨大，而现有压缩方法在低令牌预算下效果不佳：LLM前的压缩可能丢弃结构重要的全局证据，而LLM内的压缩未能充分利用查询条件下的视听协作。
Result: 在三个Omni-LLM骨干网络和五个基准测试上的广泛实验表明，OmniPack在不同保留率下始终实现最佳性能-效率权衡，优于所有现有方法。例如，在Qwen2.5-Omni-7B上，OmniPack在仅使用16.7%原始FLOPs时保留了98.0%的原始性能，在使用6.8%原始FLOPs时仍保留92.9%的原始性能。
Insight: 主要创新点在于提出了一个训练免费的两阶段压缩框架，将LLM前的结构化冗余去除（基于模态重要性、全局覆盖和相似性合并）与LLM内充分多模态交互后的任务相关语义精炼（基于文本指导和视听协作）相结合，有效解决了现有方法的局限性。
Abstract: Omni-modal large language models (Omni-LLMs) have achieved remarkable performance on audio-visual understanding tasks, but processing long and highly redundant visual and audio token sequences incurs substantial computational overhead, demanding aggressive token compression for efficient deployment. Existing methods often degrade at low token budgets: pre-LLM compression may discard structurally important and globally distributed evidence, whereas inner-LLM compression often underexploits query-conditioned audio-visual collaboration. To address these limitations, we propose OmniPack, a training-free framework that coordinates structural compression before the LLM with task-relevant semantic refinement within the LLM. Before the LLM, OmniPack removes structural redundancy through modality-specific importance, global coverage, and similarity-aware merging. After sufficient multimodal interaction, it further consolidates diverse, task-relevant representations through textual guidance and audio-visual collaboration. Extensive experiments on five benchmarks with three Omni-LLM backbones demonstrate that OmniPack consistently achieves the best performance-efficiency trade-off across diverse retention ratios, outperforming all existing methods. Notably, on Qwen2.5-Omni-7B, OmniPack preserves 98.0% of the original performance while reducing FLOPs to 16.7%, and still retains 92.9% of the original performance with only 6.8% of the original FLOPs.
[94] Geo-Embed: Towards Unified Multimodal Embeddings for Urban Understanding cs.CV | cs.LGPDF
Jiapeng Li, Yong Li, Junjie Zhou, Fan Zhang, Yu Liu
TL;DR: 本文提出了Geo-Embed模型和GeoMEB基准，旨在解决城市理解中多模态异构数据统一嵌入的挑战。GeoMEB是一个大规模基准，标准化了45个城市评估任务；Geo-Embed是一个统一的嵌入模型，在共享的视觉-语言骨干网络上进行指令条件化的查询-目标匹配。
Details
Motivation: 现有通用多模态嵌入模型和基准主要围绕通用图像-文本匹配设计，无法有效支持涉及空间关系、细粒度语义和时序变化等异构地理空间任务，因此需要专门针对城市理解场景的统一嵌入空间。
Result: 在GeoMEB基准上，Geo-Embed模型在代表性多模态嵌入器中取得了最强的综合性能，相对于最强基线实现了15.3%的相对提升。
Insight: 创新点在于构建了首个针对城市理解的大规模多模态嵌入基准（GeoMEB），并提出了一个能处理图像、文本、区域、掩码和时序变化等多种异构地理空间输入的统一嵌入模型（Geo-Embed），其核心是通过指令条件化来显式建模查询-目标关系。
Abstract: Geospatial and urban applications increasingly require models to compare heterogeneous evidence across street-view imagery, remote-sensing observations, text descriptions, region proposals, and temporal change cues. However, existing multimodal embedding models and benchmarks are still largely designed and evaluated around general-purpose image-text matching, leaving unclear whether unified embedding space can support heterogeneous geospatial tasks involving spatial relationships, fine-grained semantics, and temporal changes. To address this gap, we make three key contributions. First, we introduce GeoMEB, a large-scale multimodal embedding benchmark that standardizes 45 urban evaluation tasks across retrieval, visual question answering, change detection, classification, and visual grounding, together with training collections comprising 1.32M examples and 286K evaluation queries. Second, we present Geo-Embed, a unified embedding model that adapts a shared vision-language backbone to instruction-conditioned query-target matching over heterogeneous geospatial inputs, including single images, multiple images, text, regions, and masks. On GeoMEB, Geo-Embed achieves the strongest overall performance among representative multimodal embedders, with a 15.3% relative improvement over the strongest baseline. These results motivate future geospatial embedders that organize training and evaluation around explicit query-target relations, including semantic, cross-view, region-level, and temporal correspondence.
[95] LiteMVS: Efficient Multi-View Stereo with Foundation Distillation and Expert Aggregation cs.CVPDF
Tianbao Zhang, Zeyu Liu, Shuyu Wu, Fanxing Li, Zhaoxin Fan
TL;DR: LiteMVS是一个轻量级多视图深度估计模型，旨在通过融合平面扫描几何推理与强大的单目语义和结构先验，为机器人等应用提供实时3D感知。其核心思想是将从轻量级分割模型和大规模视觉基础模型中提取的高级单目知识高效注入到多视图立体框架中，以增强在弱纹理或重复区域的表现。
Details
Motivation: 现有的多视图立体方法主要依赖几何对应，在弱纹理或重复区域容易失效；而单目深度模型虽利用图像级先验，但缺乏稳健的多视图几何约束。在机器人等场景中，高质量的3D几何对于静态重建和后续学习时空一致的4D表示至关重要，因此需要兼具结构感知和时空扩展潜力的视觉表示。
Result: 在ScanNetv2和7-Scenes数据集上的实验表明，LiteMVS能够实现高质量的深度预测和3D重建，同时保持了有竞争力的效率。
Insight: 主要创新点包括：1) 将语义描述子融入代价体以丰富特征；2) 采用混合专家机制实现跨深度假设的自适应几何聚合；3) 从视觉基础模型中蒸馏几何先验以增强单目引导，且不增加推理成本。这为结合几何与语义先验、构建轻量高效的MVS系统提供了新思路。
Abstract: Real-time 3D perception is crucial for robotics, augmented reality, and embodied intelligence applications. Existing multi-view stereo (MVS) methods primarily rely on geometric correspondences, which often fail in textureless or repetitive regions, while monocular depth models leverage strong image-level priors but lack robust multi-view geometric constraints. More importantly, in robotics and embodied manipulation scenarios, high-quality 3D geometry is not only essential for static reconstruction, but also serves as a critical foundation for learning temporally consistent 4D representations. To obtain visual representations with stronger structural awareness and greater potential for spatiotemporal extension, we present LiteMVS, a lightweight multi-view depth estimation model that integrates plane-sweep geometric reasoning with strong monocular semantic and structural priors. The central idea of LiteMVS is to efficiently inject high-level monocular knowledge, obtained from lightweight segmentation models and large-scale vision foundation models, into a multi-view stereo framework. In particular, LiteMVS enriches the cost volume with semantic descriptors and employs a Mixture-of-Experts (MoE) formulation to enable adaptive geometric aggregation across depth hypotheses. Moreover, geometric priors distilled from vision foundation models further strengthen monocular guidance without increasing inference cost. Through this design, LiteMVS not only improves depth estimation and 3D reconstruction quality in static scenes, but also provides a more reliable geometric foundation for subsequent temporal modeling and 4D representation learning. Experiments on ScanNetv2 and 7-Scenes demonstrate that LiteMVS achieves high-quality depth prediction and 3D reconstruction while maintaining competitive efficiency.
[96] MuRA: Multi-Rank Adaptation for Efficient and Effective Test-Time Vision-Language Generalization cs.CVPDF
Gengyuan Liu, Nanzhou Wang, Chang Liu, Qinwen Wu, Zhenhao Wang
TL;DR: 本文提出了一种名为多秩适应（MuRA）的新型测试时适应框架，旨在解决视觉语言模型在分布偏移下性能下降的问题。MuRA通过根据视觉令牌的复杂度动态选择和融合不同容量的适配模块，避免了传统低秩适应方法中固定秩配置导致的优化妥协，从而在提升泛化性能的同时显著降低了计算和内存开销。
Details
Motivation: 当前基于低秩适应（LoRA）的测试时适应方法存在一个根本瓶颈：依赖静态的秩配置。由于视觉输入本身具有不同的信息密度，固定秩会迫使优化妥协，导致在复杂场景下欠拟合，在简单场景下过拟合。
Result: 广泛的实验表明，MuRA在大量的领域泛化和跨数据集基准测试中达到了最先进的准确率，同时显著减少了计算和内存开销。
Insight: 核心创新在于提出了一种动态的多秩适应机制，通过令牌级别的视觉复杂度来动态选择和融合适配模块。该方法结合了多秩正交分解以提供更好的知识保留初始化，以及统一组件融合与连续路由器更新以可持续地学习语义到秩的映射。理论分析证明了该自适应机制的必要性和梯度稳定性，且其动态设计在视觉层最深处（梯度反向传播路径最短）效果最佳。
Abstract: Vision-language models exhibit remarkable zero-shot capabilities but suffer significant performance degradation under distribution shifts. While test-time adaptation (TTA) via Low-Rank Adaptation offers a parameter-efficient solution, we identify a fundamental bottleneck in current methods: the reliance on static rank configurations. Because visual inputs inherently possess varying information densities, a fixed rank forces an inevitable optimization compromise, leading to underfitting on complex scenes and overfitting on simple ones. To bridge this gap, we propose Multi-Rank Adaptation (MuRA), a novel framework that dynamically selects and fuses adaptation modules of varying capacities based on token-level visual complexity. MuRA synergizes Multi-Rank Orthogonal Decomposition to provide a superior, knowledge-preserving initialization, and Unified Component Fusion with Continuous Router Updating to sustainably learn semantic-to-rank mappings. Furthermore, we provide rigorous theoretical justifications mathematically proving the necessity and gradient stability of this adaptive mechanism. Crucially, MuRA’s dynamic design uniquely thrives at the deepest visual layer, capitalizing on the shortest gradient backpropagation path. Extensive experiments demonstrate that MuRA achieves state-of-the-art accuracy across extensive domain generalization and cross-dataset benchmarks while significantly reducing both computational and memory overhead.
[97] BanglaWild: An In-the-Wild Bengali Scene Text Recognition Benchmark for OCR and Vision-Language Models cs.CV | cs.CLPDF
Sadab Shiper, Tawsif Tashwar Dipto, Mir Md Inzamam, Eshat Tanzeem
TL;DR: 该论文提出了BanglaWild基准，包含2,535张孟加拉语自然场景文本图像，并提供了详细标注。论文评估了15个视觉语言模型和3个传统OCR系统，采用多种提示策略和LoRA微调，并引入LLM-as-a-Judge评估。研究发现，同系列大模型性能未优于小模型，视觉误识别是主要错误来源（约60%），而连字相关错误仅占不到2%，挑战了孟加拉语OCR研究的长期假设。
Details
Motivation: 解决孟加拉语自然场景文本识别缺乏全面评估基准的问题，现有资源局限于手写文档或受限标牌解析，且未在同一真实数据上同时评估传统OCR和视觉语言模型。
Result: 在BanglaWild基准上评估了多种模型，结果显示同系列大模型未超越小模型；最强系统中约60%错误源于视觉误识别，连字错误仅占不到2%；提示语言主要影响跨文字漂移，LoRA能减少弱模型的灾难性失败但未提升强模型上限。
Insight: 创新点在于构建了首个全面的孟加拉语自然场景文本识别基准，并系统评估了传统OCR与VLMs；关键发现是视觉误识别是主要瓶颈，而非传统认为的连字问题，这为孟加拉语OCR研究提供了新方向；同时引入了LLM-as-a-Judge等补充评估方法。
Abstract: In-the-wild Bengali scene text recognition is largely unmeasured: existing resources target handwritten documents or constrained sign-board parsing, report only aggregate edit-distance metrics, and evaluate either conventional OCR or VLMs, never both on the same in-the-wild data. To address this gap, we introduce BANGLAWILD, a benchmark of 2,535 Bengali scene text images, each paired with a verbatim gold transcription, two categorical axes, four diagnostic attributes, and an orthographically standard form where the in-image text deviates from canonical spelling. We evaluate fifteen VLMs and three conventional OCR systems under three prompting strategies, fine-tune 6 open-source models with LoRA, and complement edit-distance metrics with an LLM-as-a-Judge evaluation. Our results reveal a persistent gap in which larger models within the same family do not outperform smaller ones. Our fifteen-class error taxonomy shows that visual mis-recognition accounts for ~60% of errors in the strongest systems, while conjunct-related errors contribute under 2%, challenging a long-standing assumption in Bengali OCR research; the same visual dominant profile also holds across architectures, including the one conventional baseline that reads Bengali reliably. Prompt language mainly affects cross-script drift and LoRA reduces catastrophic failures in weak models without lifting the ceiling on already competent ones. Code and data will be publicly released.
[98] CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement cs.CV | cs.AIPDF
Mercy Prasanna Ranjit, Anirban Porya, Sathvik Joel, Niharika Vadlamudi, Nikhilesh Chowdary Eathamukkala
TL;DR: CARE-X是一个面向临床应用的胸部X光视觉语言模型，它通过辅助监督、奖励对齐学习和工具增强测量，统一了报告生成、可调阈值分类、空间定位和解剖测量等功能，旨在弥合放射科医生需求与生成模型能力之间的差距。
Details
Motivation: 当前视觉语言模型通常将胸部X光报告生成、病灶分类与定位、解剖测量等任务视为独立问题，无法满足放射科医生对可调决策阈值、精确空间定位和依赖测量的诊断等临床实用需求。
Result: 在四个报告生成基准测试中，CARE-X在多数指标上达到SOTA；在ReXVQA视觉问答任务上获得94.0%准确率（较次优基线提升6.0个百分点）；其生成式空间解码能力接近专用检测头水平；结合工具调用的混合推理在五种依赖测量的诊断条件下，平均F1分数比纯感知基线提升43.6个百分点。
Insight: 创新点包括：通过辅助监督（焦点损失分类和复合损失定位头）与语言建模目标协同训练，使结构化预测与生成相互增强；提出解耦剪辑和动态采样策略优化（DAPO），直接优化临床质量指标；结合工具调用能力进行确定性测量，同时保留完整的视觉信息访问，实现感知与计算的混合推理。
Abstract: A clinically useful chest X-ray system must go beyond fluent report generation: it should classify findings with tunable decision thresholds, localize them spatially, and derive the anatomical measurements upon which many diagnoses depend. Today’s Vision-Language Models (VLMs) treat these as separate problems, if they address them at all, leaving a gap between what radiologists need and what generative models provide. We introduce CARE-X, a chest X-ray VLM that narrows this gap by unifying auxiliary discriminative supervision with reward-aligned generation. CARE-X augments its generative backbone with focal-loss classification and composite-loss grounding heads, co-trained alongside the language-modeling objective. This auxiliary supervision produces discriminative diagnostic predictions with tunable decision thresholds and precise spatial localization while also improving report quality, providing evidence that structured prediction and generation reinforce one another. Building on this foundation, Decoupled Clip and Dynamic Sampling Policy Optimization (DAPO) leverages task-specific reward signals for report generation, visual question answering (VQA), and spatial grounding, directly optimizing the clinical quality metrics that matter in practice. The result is state-of-the-art performance on the majority of metrics across four report-generation benchmarks, 94.0% VQA accuracy on ReXVQA (+6.0 pp over the next-best baseline), and generative spatial decoding that reaches near parity with dedicated detection heads. Separately, to address measurement-dependent diagnoses, we couple Qwen3-VL-4B-Instruct with native tool-calling capabilities for invoking deterministic measurement tools, while retaining full visual access to the image. This hybrid inference yields +43.6 pp average F1 over perception-only baselines across five measurement-dependent conditions.
[99] UniEvo-RS: Omni-Prompt Unified Remote Sensing Segmentation with Representative Exemplar-Driven Prototype Evolution cs.CVPDF
Kunquan Zhang, Peilang Li, Xikun Hu, Yunkai Yang, Yushan Zou
TL;DR: 本文提出了UniEvo-RS，一个面向遥感图像分割的全提示统一框架。它通过构建多指令提示数据集统一了文本驱动和视觉驱动的提示，并引入了一种基于代表性样本反馈、无需训练的原型进化机制，以提升模型在新场景、未见类别或复杂背景下的分割性能。
Details
Motivation: 现有的提示驱动视觉语言模型在部署到新场景、未见类别或视觉混淆背景时性能会严重下降，且缺乏灵活的任务路由机制来适应多样化的遥感标注工作流。实际批量标注中，标注员通常先精修少量代表性样本再处理大数据集，本文受此实践启发。
Result: 大量实验表明，UniEvo-RS统一了多种提示任务，在大多数设置下达到了最先进的性能。关键的是，通过对少量样本进行最小化交互，它能在批量标注过程中对未见类别实现无需训练的渐进式精度提升。
Insight: 主要创新点在于构建了统一文本与视觉提示的多指令数据集及动态任务路由机制，以及一种基于代表性样本反馈、无需训练的原型进化机制，通过对比人工标注与初始预测来提炼正负原型，以增强LLM查询召回并抑制背景噪声。
Abstract: Prompt-driven vision-language models (VLMs) hold immense promise for accelerating dense remote sensing (RS) annotation, but static models suffer from severe performance degradation when deployed on novel scenes, unseen categories, or visually confusing backgrounds. Moreover, existing unified paradigms primarily rely on intra-image specific prompts, lacking flexible task routing to adapt to multi-intent operational workflows. In practical batch mapping, annotators typically refine a small set of representative samples before processing large datasets. Motivated by this practice, we propose UniEvo-RS, an omni-prompt unified RS segmentation framework equipped with representative exemplar-driven prototype evolution. First, we construct a multi-instruction prompt dataset that unifies text-driven and visual-driven prompts within a single architecture, establishing a dynamic task-routing mechanism for highly diverse RS annotation scenarios. Second, we introduce a representative feedback-driven, training-free prototype evolution mechanism. By contrasting manual annotations with initial predictions on exemplars, UniEvo-RS distills prediction errors into positive and negative prototypes. These prototypes enhance LLM query recall and suppress spatial background noise under a fixed-budget clustering memory. Extensive experiments show that UniEvo-RS unifies diverse prompting tasks, achieving state-of-the-art performance across most settings. Crucially, with minimal interaction on a few exemplars, it enables training-free, progressive accuracy enhancement on unseen categories during batch annotation.
[100] StreamDAM: Presence-Aware Memory for Real-Time Streaming Video Object Segmentation cs.CVPDF
Xiang Chen
TL;DR: StreamDAM是一种用于实时流式视频对象分割（VOS）的模型，它通过重建内存管道来解决现有高质量VOS跟踪器（如DAM4SAM）在流式协议下因内存访问慢而性能崩溃的问题。该方法使内存机制本身以帧率运行，并利用一个学习到的存在信号来控制内存写入、读取范围、输出抑制和重新检测，从而在保持精度的同时满足实时性要求。
Details
Motivation: 现有顶级VOS跟踪器（如DAM4SAM）在离线评估中精度领先，但在实时流式协议（如30 FPS）下，由于内存访问过慢导致无法按时输出，且无法感知对象是否存在，性能大幅下降。论文旨在解决这一内存管道瓶颈，使跟踪器适应流式场景。
Result: 在四个基准测试和五个现代基线模型上，StreamDAM是最强的流式跟踪器，在时钟约束下几乎恢复了离线模型的全部精度，并在最困难的内容上超过了其构建的离线模型。
Insight: 创新点在于将内存机制本身通过模型内优化实现帧率运行，而非依赖外部后备方案，并引入单一学习到的存在信号来统一控制内存的写入、读取、输出抑制和重新检测决策。关键洞察是固定策略无法应对对象消失与难以看见的差异，因此需要每帧动态决策。
Abstract: Quality-tier video object segmentation (VOS) trackers such as DAM4SAM top accuracy leaderboards, but they are measured offline, one frame at a time with no clock. Under an honest streaming protocol at 30 frames per second, where a frame that misses its budget is served the last mask already computed, the winner collapses: the rich memory that makes it accurate is too slow to keep up, and what it emits is blind to whether the object is even present. We trace both failures to one place, the tracker’s memory pipeline, and rebuild it for streaming. \method{} makes the memory machinery itself run at frame rate through in-model optimization rather than a bolted-on fallback, and governs it with a single learned presence signal that decides what enters memory, how far back the tracker reads, when to withhold output, and when to re-detect. A mechanism analysis shows why a fixed policy cannot win: the control that helps when an object truly disappears is the one that hurts when it is merely hard to see, so the choice must be made per frame. Across four benchmarks and five modern baselines, \method{} is the strongest streaming tracker, recovers nearly all of the offline model’s accuracy under the clock, and on the hardest content exceeds the offline model it is built from.
[101] When and Where to Look: Adaptive Visual Evidence Scheduling for Efficient Long Video Understanding cs.CV | cs.AIPDF
Ke Li, Jiayu Chen, Maoliang Li, Zihao Zheng, Hailong Zou
TL;DR: 本文提出EcoFrame，一种无需训练的查询自适应视觉证据调度框架，用于高效长视频理解。它通过利用视觉语言模型的推理反馈，动态决定何时增加帧预算以及在何处搜索额外候选证据，从而在多个基准测试中实现了更好的准确性与效率权衡。
Details
Motivation: 现有基于相关性的方法依赖静态一次性选择，而基于智能体的调度器通过昂贵的多轮推理实现自适应，因此需要一种低开销的查询自适应视觉证据调度方法。
Result: 在Video-MME、LongVideoBench和MLVU上的实验表明，EcoFrame在多个VLM骨干网络上实现了更好的准确性-效率权衡。例如，在Qwen2.5-VL上，EcoFrame平均准确率达到64.4，超过了BOLT的63.5，同时比AKS和BOLT快1.85倍；与基于智能体的A.I.R.相比，在保持相当准确性的同时，推理速度提升高达13.5倍。
Insight: 创新点包括：1）利用输出不确定性（熵门控预算调度）来动态决定何时停止或增加帧预算；2）将帧级注意力转换为时间先验（注意力引导候选提议），以在信息丰富区域进行密集局部搜索，同时在注意力分散时保持全局覆盖。这是一种无需训练、低开销的自适应调度策略。
Abstract: Efficient long-video understanding requires vision–language models (VLMs) to reason over a small number of frames selected as sparse visual evidence. Existing relevance-based methods rely on static one-shot selection with fixed frame budgets and candidate pools, while agent-based schedulers achieve adaptivity through costly multi-round reasoning and interactive search. We propose EcoFrame, a training-free framework for low-overhead query-adaptive visual evidence scheduling. EcoFrame leverages the VLM’s inference feedback to determine when to increase the frame budget and where to search for additional candidate evidence. Specifically, entropy-gated budget scheduling uses output uncertainty to stop early when the current evidence is sufficient or progressively expand the frame budget otherwise. Meanwhile, attention-guided candidate proposal converts frame-level attention into a temporal prior, enabling dense local search in informative regions while preserving global coverage when attention is diffuse. Experiments on Video-MME, LongVideoBench, and MLVU demonstrate that EcoFrame achieves a better accuracy–efficiency trade-off across multiple VLM backbones. On Qwen2.5-VL, EcoFrame achieves an average accuracy of 64.4, surpassing BOLT at 63.5, while providing a $1.85\times$ speedup over AKS and BOLT. Compared with the agent-based A.I.R., EcoFrame maintains comparable accuracy with up to a $13.5\times$ inference speedup. Code will be available at https://github.com/AK-DREAM/EcoFrame.
[102] JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion cs.CVPDF
Yicheng Xiao, Wenxun Dai, Xinran Qin, Lin Song, Maoquan Zhang
TL;DR: 本文提出了JoyAI-Video-Edit，一个160亿参数的自动回归扩散框架，用于实时、开放式视频编辑。该方法无需访问未来帧或预定义视频时长，通过分块自回归适应、源锚定分布匹配蒸馏和长时域自回归蒸馏等技术，解决了训练-推理不匹配、源保真度和时间漂移问题。系统在单块Nvidia B200 GPU上能以约30 FPS的速度实现720p视频的端到端编辑。
Details
Motivation: 解决实时视频编辑中，在有限计算资源下实现低延迟因果生成，同时保持源视频保真度和长期时间一致性的挑战。
Result: 广泛的自动和人工评估表明，JoyAI-Video-Edit在短视频和长视频上都显著优于现有的流式编辑方法，并与强大的离线系统保持竞争力。
Insight: 创新点在于结合了分块自回归适应、源锚定分布匹配蒸馏和长时域自回归蒸馏，有效减少了训练-推理不匹配，并在两步生成中保持了源保真度，同时缓解了累积的时间漂移问题。
Abstract: Real-time video editing requires low-latency causal generation with bounded computational resources while preserving source fidelity and long-term temporal consistency. We present JoyAI-Video-Edit, a 16B-parameter autoregressive diffusion framework for real-time, open-ended video editing without access to future frames or a predefined video duration. Our method combines chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD), and Long-Horizon Autoregressive Distillation to reduce train–inference mismatch, preserve source fidelity during two-step generation, and mitigate accumulated temporal drift. Extensive automatic and human evaluations show that JoyAI-Video-Edit substantially outperforms existing streaming editors and remains competitive with strong offline systems on both short and long videos. The complete system achieves end-to-end 720p video editing at approximately 30 FPS on a single Nvidia B200 GPU. Code is available at https://github.com/jd-opensource/JoyAI-Video-Edit.
[103] UniWorld-Design: From Pixel Generation to Layer-Native Design cs.CVPDF
Zongjian Li, Zhiyuan Yan, Chenxu Bai, Chen Chen, Haoxiang Sun
TL;DR: UniWorld-Design是一个将图像生成从平面像素合成重新定义为结构化视觉合成的框架，其核心是以语义RGBA层作为生成、理解和编辑的原子单元。该框架包含两个模型：Text-to-RGBA模型直接从文本生成独立的RGBA资源；Image-to-Layer模型基于完成的图像、全局指令和每层提示，联合生成有序、完整的语义RGBA层，支持指令寻址的编辑操作。
Details
Motivation: 论文的动机是认识到像素定义了图像的渲染方式，而图层定义了图像的创建、理解和编辑方式。为了让人工智能模型能够像人类设计师一样通过图层而非原始像素来操作视觉内容，作者旨在将多模态生成模型引入一个原生基于图层的设计空间。
Result: 在Crello基准测试中，Image-to-Layer模型将每层RGB L1误差降低了37%，并在Alpha Soft IoU上相对于Qwen-Image-Layered实现了34%的相对提升。Text-to-RGBA模型则取得了最高的CLIP分数，超越了LayerDiffuse和OmniAlpha。
Insight: 论文宣称的创新点在于将图像生成的原子单元从像素提升到语义RGBA层，并提出了一个支持指令寻址（如顶层分解、递归分解和针对性提取）的图层操作框架。从客观角度看，其核心创新在于将生成模型的输出结构化为可独立编辑、语义完整的图层，这为基于智能体的图像编辑和理解提供了更自然和强大的基础。
Abstract: We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA layers as the atomic units of generation, understanding, and editing. Our key insight is that pixels define how an image is rendered, whereas layers define how an image is created, understood, and edited. Just as human designers create and manipulate visual content through layers rather than raw pixels, UniWorld-Design equips multimodal generative models with a layer-native design space. UniWorld-Design comprises two models. The Text-to-RGBA (T2RGBA) model generates standalone RGBA assets directly from text. The Image-to-Layer (I2L) model conditions on a finished image, a global instruction and per-layer prompts, and jointly produces ordered, complete semantic RGBA layers. Its instruction interface supports top-level decomposition, recursive decomposition and targeted extraction, making layering an instruction-addressable operation for agentic editing. Because I2L learns complete semantic objects rather than visible-pixel partitions, its layers stay usable when moved or removed. On the Crello benchmark, I2L reduces per-layer RGB L1 error by 37% and achieves a 34% relative improvement in Alpha Soft IoU over Qwen-Image-Layered. Separately, T2RGBA achieves the highest CLIP Score, outperforming LayerDiffuse and OmniAlpha.
[104] ParVL: Parallel Scaling and Expandable Compute Allocation for Multimodal LLMs cs.CV | cs.CLPDF
Yang Yang, Qinyu Zhao, Mouxiang Chen, Xiaohui Li, Lixin Gu
TL;DR: 本文提出了ParVL框架，用于多模态大语言模型的并行扩展与可分配计算。该框架通过复用视觉Transformer和大型语言模型的骨干参数，在多个视觉和语言分支上扩展并行计算，并系统研究了视觉与语言模态间的计算分配权衡。
Details
Motivation: 现有MLLM扩展策略通常扩展模型参数或顺序推理计算，导致高内存或延迟开销，且无法灵活调整视觉与语言组件间的固定计算分配，限制了任务特定优化。
Result: ParVL在约130亿token上进行全参数监督微调，相比相同配置的单分支基线提升了整体多模态性能，且最佳视觉-语言分配因任务而异。
Insight: 创新点在于提出并行扩展框架，通过分支特定前缀参数在共享骨干上实例化并行计算流，并系统探索视觉与语言模态间的计算分配，为任务自适应优化提供了新思路。
Abstract: Existing scaling strategies for Multimodal Large Language Models (MLLMs) typically expand either model parameters or sequential inference computation, incurring substantial memory or latency overhead. More importantly, most existing methods fail to alter the rigid, fixed computation allocation between the Vision Transformer and the Large Language Model components, limiting task-specific optimization. To address this, we introduce the Parallel Vision-Language (ParVL) scaling framework for MLLMs, which scales parallel computation by reusing the existing ViT and LLM backbone parameters across multiple vision and language branches. This framework raises a central question: given a fixed backbone parameter budget, how should additional shared-backbone computation be allocated between the vision and language modalities? We instantiate each parallel computational stream with branch-specific prefix parameters over a shared backbone, and train the entire model end-to-end via full-parameter supervised fine-tuning on roughly 13B tokens. We systematically study the computation-allocation trade-off between the ViT encoder and LLM decoder. ParVL improves overall multimodal performance over same-recipe single-branch baselines, and the best evaluated vision–language allocation varies across tasks. Code is available at https://github.com/YangYangGirl/ParVL.
[105] Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent cs.CV | cs.AIPDF
Zhen Fang, Yu Zeng, Wenxuan Huang, Yiming Zhao, Shiting Huang
TL;DR: 本文提出了Video-DeepResearch (Video-DR)，一个面向连续视频流的新一代多模态深度研究智能体。它通过解耦的感知-探索流程和分阶段工具解锁机制，强制模型在网页检索前进行详尽的跨帧视觉定位，以解决现有模型在视频理解中的模态偏见和参数知识泄露问题。
Details
Motivation: 将多模态智能体从静态图像扩展到连续视频流，这一场景需要密集的时空定位与开放网络探索相结合。初步评估发现当前模型存在两个关键瓶颈：模态偏见和参数知识泄露，阻碍了真正的工具增强执行。
Result: 在自建的Video-DR-Bench基准（包含200个复杂多跳VQA实例）上，Video-DeepResearch-35B-A3B模型取得了64.0%的平均准确率，超越了Claude-4.5-Sonnet (59.0%)、GPT-5 (52.5%)和Gemini 2.5 Pro (57.5%)，达到了新的SOTA水平。其30B-A3B变体也取得了59.3%的竞争性结果。
Insight: 创新点在于提出了一个解耦的感知-探索流程与分阶段工具解锁机制，强制模型先进行详尽的视觉定位再执行网络检索。训练范式结合了监督微调和Group Relative Policy Optimization (GRPO)，突破了模仿学习的上限，实现了自主探索能力。
Abstract: We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two critical bottlenecks in current models: (1) modality bias, where agents bypass visual tools in favor of textual search, and (2) parametric knowledge leakage, where models rely on internal memory rather than genuine tool-augmented execution. To address these challenges, we propose Video-DR, featuring a decoupled perception-exploration pipeline with stage-wise tool unlocking that compels exhaustive cross-frame visual grounding prior to web retrieval. Our framework adopts a two-stage training recipe: supervised fine-tuning followed by Group Relative Policy Optimization (GRPO), enabling autonomous exploration that breaks the imitation-learning ceiling. Furthermore, we curate Video-DR-Bench, a human-AI collaborative benchmark comprising 200 complex, multi-hop VQA instances. Empirical results demonstrate that our Video-DeepResearch-35B-A3B establishes a new state-of-the-art of 64.0% average accuracy, surpassing proprietary Claude-4.5-Sonnet (59.0%) by 5.0 points and significantly outperforming GPT-5 (52.5%) and Gemini 2.5 Pro (57.5%). The 30B-A3B variant achieves 59.3%, competitive with Claude-4.5-Sonnet and demonstrating the effectiveness of our training paradigm even at compact scale. Code: https://github.com/Osilly/Vision-DeepResearch.
cs.SD [Back]
[106] Reinforcement Learning with Evolving Rubrics as Rewards for Audio Reasoning cs.SD | cs.CLPDF
Fangxu Yu, Tao Feng, Dehai Min, Zinan Lin, Weijia Xu
TL;DR: 本文提出AudioRubrics框架，通过自演化的、基于音频的评分标准作为奖励，来强化学习模型进行音频推理。该方法为每个样本从原始波形生成细粒度的评分标准，并根据模型自身的推理过程动态调整标准权重，从而提供持续的学习信号以针对当前策略的弱点。
Details
Motivation: 现有音频推理的强化学习奖励设计存在局限：基于结果的奖励只监督最终答案，模型可能不关注音频内容；而基于过程的奖励虽评估推理本身，但依赖粗糙、手工制定且固定的标准，无法适应不同问题或保持音频证据的关联。因此，需要细粒度、基于音频且自适应的奖励来监督推理过程。
Result: 在三个音频推理基准测试上的综合评估表明，AudioRubrics显著优于一系列开源和基于训练的基线方法。分析显示，其性能提升与评分标准生成器和评估器的能力成正比，且能收敛到稳定的推理长度，避免退化或无限增长。
Insight: 创新点在于引入自演化的、基于音频的评分标准作为强化学习奖励，实现了细粒度、自适应且音频接地的过程监督。这解决了静态奖励标准在策略改进时失效的问题，并通过动态调整标准权重持续针对模型弱点，提升了音频感知和推理能力。
Abstract: Audio reasoning is essential for machine understanding of the acoustic world. Reinforcement learning with verifiable rewards can elicit such reasoning, yet existing reward designs are complementary in their limitations: outcome-based rewards supervise only the final answer and let the model reach it without attending to the audio, whereas process-based rewards score the reasoning itself but rely on coarse, hand-crafted, and fixed criteria that neither adapt to each question nor stay grounded in the acoustic evidence. Moreover, questions differ in what they demand, with some hinging on perception and others on multi-step reasoning, and any static criterion weakens as the policy improves. Supervising the reasoning process with fine-grained, audio-grounded, and adaptive rewards is therefore crucial, yet challenging since such rewards are impractical to design by hand for every sample. To this end, we introduce AudioRubrics, a reinforcement learning framework that supervises audio reasoning with self-evolving, audio-grounded rubric rewards. AudioRubrics synthesizes per-sample rubrics from the raw waveform and, conditioned on the model’s own rollouts, regenerates and reweights criteria per group, supplying a continuous learning signal that keeps targeting the current policy’s weaknesses as static criteria saturate. Comprehensive evaluations across three audio reasoning benchmarks reveal that AudioRubrics substantially outperforms a wide range of open-source and training-based baselines. Furthermore, our analysis shows that the gains scale with the capability of the rubric generator and judge, and AudioRubrics converges to a stable reasoning length that avoids both degenerate collapse and unbounded growth. The improvement in audio perception further demonstrates the effectiveness of anchoring supervision in the acoustic evidence. Our project page is available at https://audiorubrics.github.io.
[107] Multi-Task Multi-Frame Visual Piano Transcription cs.SD | cs.AI | cs.CV | cs.MM | eess.IVPDF
Yonghyun Kim, Hoyeol Sohn, Juhan Nam, Alexander Lerch
TL;DR: 本文提出了V2N（Video to Notes），首个完整的视觉钢琴转录系统，通过多任务学习框架同时预测音符起始、结束、按键保持和力度，利用长时序上下文提升性能，在PianoVAM和R3数据集上达到SOTA水平。
Details
Motivation: 现有视觉钢琴转录系统主要关注短时窗口内的起始检测，而结束时间精度较差且未报告音符力度，音频方法则因延音踏板影响无法准确预测物理按键释放；本文旨在填补这些空白，实现从视频到完整音符信息的转录。
Result: 在PianoVAM和R3基准测试中，V2N取得了新的SOTA结果；消融实验表明多任务监督能提升结束时间和力度预测，同时改善起始检测精度，长时序上下文进一步带来性能增益。
Insight: 创新点包括采用共享时序骨干网络配合任务特定头部的多任务架构，以及逐帧监督而非仅窗口中心的训练方式；客观分析认为，将视觉转录扩展为包含结束和力度的完整系统，并通过多任务与长时序优化，是解决现有局限的有效途径。
Abstract: Audio-based piano transcription performs well on onset, pitch, and velocity, but the sustain pedal lets sound persist long after key release, so audio systems predict pedal-extended offsets rather than physical key release. Yet existing Visual Piano Transcription (VPT) systems focus on onset detection from short video windows, offset accuracy lags onset by a wide margin, and note-level velocity has not been reported. To address these gaps, we present V2N (Video to Notes), the first complete VPT system: a shared temporal backbone feeds task-specific heads for onset, offset, key hold, and velocity, jointly trained with per-frame supervision rather than only at the window center. Ablations show that multi-task supervision enables offset and velocity prediction while improving onset accuracy; longer temporal context yields further improvements. V2N sets new state-of-the-art results on PianoVAM and R3.
cs.IR [Back]
[108] Training Documents Reranker with Search Rubrics for Deep Research Agent cs.IR | cs.AI | cs.CLPDF
Wenhan Liu, Yu Lu, Qiaolin Xia, Hui Xu, Tong Zhao
TL;DR: 本文提出了一种基于搜索准则的文档重排序器RubricRanker，旨在为深度研究智能体提供高质量文档集合。该方法通过LLM生成层次化搜索准则来定义文档集应满足的多样性、简洁性和权威性等需求，并采用两阶段训练框架（准则引导的监督微调和基于准则的强化学习）优化重排序器。
Details
Motivation: 现有检索系统通常基于相关性匹配选择文档，但单个高相关文档的集合可能无法满足智能体查询的复杂信息需求（如多样性、简洁性和权威性）。
Result: 在四个深度研究基准测试中，RubricRanker比最强基线提升2.6个点，并在五个RAG基准上表现出良好的泛化能力。
Insight: 创新点在于引入显式定义的层次化搜索准则来指导文档集构建，以及结合监督微调与强化学习的训练框架，使重排序器能直接优化文档集合的整体质量而非仅关注单文档相关性。
Abstract: Retrieval systems help deep research agents generate high-quality answers by providing relevant documents. However, existing retrievers typically select documents through relevance matching, while individually well-matched top-$k$ documents may not form a \textit{set} that satisfies the complex information needs of an agent query (\eg, diverse, concise and authoritative documents). In this paper, we propose search-oriented rubrics that \textit{explicitly} define the requirements that high-quality document sets should satisfy for each agent query. Our search rubrics are organized into a hierarchical structure and synthesized using a powerful LLM. Based on these search rubrics, we further train a document reranker \textbf{RubricRanker} to select a high-quality subset from retrieved documents. We design a two-stage training framework that consists of rubrics-guided supervised fine-tuning and rubric-based reinforcement learning. Extensive experiments demonstrate that RubricRanker outperforms the strongest baseline by 2.6 points on four deep research benchmarks and generalizes well to five RAG benchmarks.
cs.SE [Back]
[109] Pattern over Pixels: Measuring Pattern Completion Bias in Multimodal Code Generation cs.SE | cs.AI | cs.CVPDF
Khai-Nguyen Nguyen, Oscar Chaparro, Antonio Mastropaolo
TL;DR: 本文研究了多模态大语言模型（MLLMs）在将网页截图转换为前端代码时，因重复的UI模式而产生的视觉模式补全偏差。作者构建了一个基准测试，通过扰动重复模式中的局部元素（如宽度或字体大小），要求模型从截图和HTML上下文中恢复被遮盖的值，以量化这种偏差。实验发现，所有测试的MLLMs都强烈偏向于重复的基线模式，准确率低而偏差率高，尤其是在文本样式扰动下，且噪声和更微妙的扰动会进一步加剧偏差。
Details
Motivation: 多模态大语言模型在网页截图转代码任务中广泛应用，但重复的UI模式可能导致模型产生视觉上不正确却符合模式一致性的输出，这影响了代码生成的准确性。本文旨在测试这种重复模式如何损害MLLMs的客观性能，并首次引入视觉模式补全偏差的基准来量化这一问题。
Result: 在基于Design2Code数据集构建的1,440个评估截图上，测试了五个前沿MLLMs。结果显示，所有模型都强烈偏向重复基线，平均偏差率在卡片宽度扰动上达到69.78%，在文本字体大小扰动上达到80.22%，而平均准确率分别仅为21.17%和7.89%。Codex-5.3表现最佳，但准确率从卡片的68.61%降至文本的13.89%，而Flash-3.0在文本上的偏差率高达96.11%。噪声、更微妙的扰动和边界位置进一步增加了偏差率。
Insight: 论文的创新点在于首次提出了视觉模式补全偏差的基准，并系统性地量化了MLLMs在重复UI模式下的失败模式。从客观角度看，研究揭示了模型倾向于忽略视觉异常而遵循模式一致性，即使能识别异常元素也会被覆盖，这为多模态代码生成的可靠性提供了重要洞见，强调了视觉显著性与偏差严重性之间的关联。
Abstract: Multimodal large language models (MLLMs) are increasingly used to translate webpage screenshots into front-end code, but repeated UI patterns may sway them toward visually incorrect yet pattern-consistent outputs. In this work, we test how repeated webpage patterns hurt MLLM accuracy on an objective screenshot-to-code fill-in-the-blank task. We introduce the first benchmark for visual pattern-completion bias, where one localized element in a repeated UI pattern is perturbed and the model must recover the masked width or font-size value from the screenshot and HTML context. Starting from 30 webpages curated from the Design2Code dataset, we build 1,440 evaluated screenshots spanning structural card and text-style patterns under standard and noise-overlaid conditions. We evaluate five frontier MLLMs and find that all are strongly biased toward the repeated baseline. Mean bias rate reaches 69.78% on card-width perturbations and 80.22% on text font-size perturbations, while mean accuracy is only 21.17% and 7.89%, respectively. Codex-5.3 performs best but still drops from 68.61% accuracy on cards to 13.89% on text, while Flash-3.0 reaches 96.11% bias on text. Noise, subtler perturbations, and boundary positions further increase bias rate. Reasoning analysis further shows that greater reasoning effort correlates with lower bias, yet qualitative evidence reveals that models can identify the anomalous element and still override it with the pattern-consistent answer. Our results identify a concrete failure mode in multimodal code generation and show that its severity is strongly associated with visual saliency
eess.AS [Back]
[110] GROW: Group-Relative Advantage-Weighted On-Policy Reinforcement Learning of Autoregressive-Diffusion Text-to-Speech model eess.AS | cs.AI | cs.CLPDF
Guanrou Yang, Tian Tan, Qian Chen, Ziyang Ma, Yakun Song
TL;DR: 本文提出了一种名为GROW的强化学习方法，用于优化基于流匹配的自回归扩散文本转语音模型。该方法通过组内相对优势加权，直接在标准流匹配目标上操作，避免了传统方法中引入随机扰动和高开销的问题。
Details
Motivation: 针对流匹配文本转语音中确定性ODE采样带来的强化学习复杂性问题，传统轨迹级策略梯度方法通常将ODE转换为SDE并跟踪每步似然比，这会引入随机扰动和显著开销。
Result: 在LibriSpeech和Seed-TTS EN/ZH数据集上评估，GROW将平均词错误率从2.016降至1.558，说话人相似度从0.676提升至0.715，同时保持UTMOS分数。使用10-NFE训练和32-NFE评估时，性能相当且训练速度比32-NFE DiTAR-GRPO快2.9倍。
Insight: 创新点包括组内相对优势加权机制、Wasserstein-2速度惩罚锚定预训练参考模型，以及组平均奖励基线将奖励加权转换为优势加权。对于奖励集中的预训练TTS模型，零均值符号优势能有效保持组内信用分配。
Abstract: Reinforcement learning for flow-matching text-to-speech is complicated by deterministic ODE sampling: trajectory-level policy-gradient methods typically convert the ODE into an SDE and track per-step likelihood ratios, introducing stochastic perturbations and substantial overhead. We propose GROW, a group-relative advantage-weighted on-policy RL method that acts directly on the standard flow-matching objective. For each prompt, GROW samples a group of on-policy utterances, separately standardizes intelligibility and speaker-similarity rewards within the group, and combines them to reweight flow-matching regression. A Wasserstein-2 velocity penalty anchors the updated model to a frozen pretrained reference. A group-mean reward baseline is introduced to convert reward weighting into advantage weighting. For strong pretrained TTS models with concentrated rewards, positive exponential weighting is dominated by reward-agnostic self-imitation, whereas a zero-mean signed advantage preserves effective within-group credit assignment. Instantiated on DiTAR and evaluated on LibriSpeech and Seed-TTS EN/ZH, GROW reduces average WER from 2.016 to 1.558 and raises speaker similarity from 0.676 to 0.715 while keeping UTMOS. With 10-NFE training rollouts and 32-NFE evaluation, GROW retains comparable performance while training 2.9x faster than 32-NFE DiTAR-GRPO. We will open-source complete GROW codes, faithful DiTAR reproduction, and all model checkpoints.
cs.AI [Back]
[111] Evidence-Grounded Multimodal Knowledge Graph Construction for Multi-Lecture Educational Reasoning cs.AI | cs.CLPDF
Sahil Al Farib, Momota Ahsana Meem, Sheikh Redwanul Islam, Md. Tanvir Raihan
TL;DR: 本文提出了一种基于证据的多模态知识图谱构建方法，用于从包含语音、幻灯片文本、图表、方程和演示顺序的讲座视频中提取知识。该方法通过转录、语义锚点选择、光学字符识别（OCR）和视觉语言模型，仅提取有文本、OCR或视觉证据支持的概念和类型化关系，并构建具有丰富来源信息的知识图谱。
Details
Motivation: 解决仅依赖转录的检索方法无法充分保留讲座视频中多模态知识（如演讲、幻灯片文本、图表、方程和演示顺序）的问题，旨在构建一个可审计的、基于证据的知识图谱以支持教育推理。
Result: 在三个神经网络讲座视频上处理了3,118帧、756个转录片段和559个锚点，保留了1,022个概念提及和312个关系提及，最终生成172个规范概念和282个关系，端点覆盖率达到90.38%。初步的三问题检索测试实现了100%的top-1和top-3准确率以及100%的平均top-5召回率。
Insight: 创新点在于提出了一种可审计的多模态知识图谱构建流程，强调仅提取有证据支持的概念和关系，确保知识图谱的可靠性和可追溯性，而非追求最先进的性能表现。
Abstract: Lecture videos distribute knowledge across speech, slide text, diagrams, equations, and presentation order, which transcript-only retrieval does not fully preserve. This paper presents an evidence-grounded multimodal pipeline that transcribes lectures, selects semantic anchors, applies optical character recognition (OCR), and uses a vision-language model to extract only concepts and typed relationships supported by transcript, OCR, or visual evidence. Mentions are validated and canonicalized into a provenance-rich knowledge graph. On three neural-network lectures, the pipeline processed 3,118 frames, 756 transcript segments, and 559 anchors. It retained 1,022 concept and 312 relationship mentions, yielding 172 canonical concepts and 282 relationships with 90.38% endpoint coverage. A preliminary three question retrieval test achieved 100% top-1 and top-3 accuracy and 100% mean top-5 recall. The contribution is an auditable construction method rather than a state-of-the-art performance claim.
[112] ChartAnno: Evaluating MLLMs for Chart Annotation Generation cs.AI | cs.CL | cs.HCPDF
Zhenghan Chen, Zekai Shao, Lidan Tan, Xin Lin, Xingchen Zeng
TL;DR: 本文提出了ChartAnno基准，用于评估多模态大语言模型（MLLMs）在图表标注生成任务上的能力。该基准包含1200个真实世界图表，并设置了三种不同具体程度的标注指令。研究评估了10个代表性MLLM在两种主要输入设置下的表现，发现专有模型整体更强，更具体的指令能提升标注质量，而提供图表图像带来的整体增益有限。
Details
Motivation: MLLMs在图表理解、生成和编辑方面取得了显著进展，但它们在为现有图表生成标注（一种常见且具有挑战性的沟通任务）的能力尚未得到充分探索。
Result: 在ChartAnno基准上的评估结果表明，专有模型整体表现更强，但大规模开源模型正在缩小差距。更具体的指令能改善标注质量，而推断抽象意图对当前MLLMs来说最为困难。提供图表图像仅带来有限的整体增益，改进主要体现在与设计相关的指标上。
Insight: 论文的创新点在于首次系统性地构建了针对图表标注生成任务的评估基准（ChartAnno），并揭示了该任务对语义基础和有效标注设计的挑战性。从客观角度看，其提出的多层级指令设置和输入模态消融研究为理解MLLMs在该领域的核心能力瓶颈提供了有价值的分析框架。
Abstract: Multimodal large language models (MLLMs) have made significant progress in chart understanding, generation, and editing, but their ability to annotate existing charts remains underexplored. Annotating charts is a common yet challenging communicative task, requiring models to infer intended messages, interpret chart semantics, and place appropriate textual or graphical elements. To address this gap, we introduce ChartAnno, a benchmark for evaluating MLLMs on chart annotation generation. It contains 1,200 real-world charts with paired code and annotation instructions across three levels of instruction specificity. We evaluate 10 representative MLLMs under two primary input settings: (1) chart code alone and (2) both chart code and chart image, and further include a chart image-only ablation study. Results show that proprietary models remain stronger overall, although large-scale open-source models narrow the gap. More specific instructions improve annotation quality, while inferring abstract intent remains most difficult for current MLLMs. Providing chart images brings limited overall gains, with improvements mainly appearing in design-related metrics. These findings highlight chart annotation generation as a challenging task requiring semantic grounding and effective annotation design. Code and data will be released in a future version.
[113] When Outputs Disperse, Does Epistemic Revision Follow? A Black-Box Coupling Diagnostic for Machine Collectives cs.AI | cs.CLPDF
Molood Arman
TL;DR: 本文提出了一种黑盒诊断方法，用于评估LLM集体中输出分散度与认知修正之间的耦合关系。该方法通过测量输出通道的连贯性指数和认知通道的立场标注，独立验证干预措施是否真正改变了集体的认知立场，而非仅仅是前提保留的重新表述。实验在GPT-4o-mini和Gemini-2.5-flash模型上评估了不同干预措施对虚假前提恢复的影响，发现模型间存在显著差异。
Details
Motivation: 在集体智能研究中，分歧通常被视为认知多样性的证据，但LLM集体可能产生看似多样的论点却保持相同结论，导致这一代理指标失效。本文旨在操作化‘分散-修正耦合’，即验证增加输出分散度的干预是否伴随真正的认知立场修正。
Result: 在GPT-4o-mini上，条件性异议将虚假前提恢复率提高了17.7个百分点（p<1e-6），而静态角色多样性则损害了恢复（-8.1，p=.007）。在Gemini-2.5-flash上，相同干预在可比的预算下未带来增益（26.1% vs 27.1%，p=.84），尽管已验证其分散度下降；两种处理效果存在显著差异（z=3.79, p<.001）。机制标注显示，Gemini通过框架内异议保留了虚假前提。
Insight: 创新点在于提出了一个黑盒的‘分散-修正耦合’诊断框架，该框架仅基于生成文本操作，不依赖模型内部表示。具体方法包括连贯性指数与元预测清晰度系统，以及当输出过度收敛时插入的再差异化协议。建议在报告准确性时，同时报告每个干预的立场转变率和前提保留率，以更全面地评估LLM集体的认知修正能力。
Abstract: Collective intelligence research treats disagreement as evidence of epistemic diversity: if agents express different views, the group should retain capacity to revise. In LLM collectives this proxy can break: agents can produce diverse-looking arguments while preserving the same conclusion. We operationalize dispersion-revision coupling: the degree to which an intervention that verifiably increases the dispersion of a collective’s outputs in embedding space is accompanied by genuine revision of its epistemic stance rather than premise-preserving reformulation. The diagnostic is black-box: it operates on generated text alone and makes no claims about the internal representations of the generating models. Two channels are measured independently: an output channel, the Coherence Index (CI), verifies that the intervention changed output dispersion; an epistemic channel, per-turn stance annotation, measures whether the collective revised. We propose CI with the Meta-Predictive Clarity System (MPCS), which inserts a Re-Differentiation Protocol (RDP) when outputs over-converge, as a reusable method for estimating this coupling regime. We evaluate five-agent collectives from two configurations (gpt-4o-mini and gemini-2.5-flash; 310 paired episodes per condition). On gpt-4o-mini, conditional dissent improves false-premise recovery by +17.7 points (p<1e-6) while static persona diversity harms recovery (-8.1, p=.007). On gemini-2.5-flash, the same intervention at a comparable budget yields no gain (26.1% vs 27.1%, p=.84) despite a verified dispersion drop; the two treatment effects differ from each other (z=3.79, p<.001). Mechanism tagging shows Gemini preserves the false premise via intra-framework dissent: 94% of tagged post-RDP responses reformulate rather than concede (vs 24% on GPT). We recommend reporting per-intervention stance shift and premise-preservation rate alongside accuracy.
[114] Risky Business: Measuring The Faithfulness-Safety Tension cs.AI | cs.CLPDF
Dominik Meier, Luca Joshua Francis, Marco Bernhard Kaiser, Terry Ruas, Jan Philip Wahle
TL;DR: 本文研究了大型推理模型（LRMs）中忠实性与安全性之间的权衡关系，提出了一种新的目标推理替换（TRR）方法来直接干预推理链以评估模型，并发现可以通过表征调控来独立增强安全性方向。
Details
Motivation: 论文旨在解决模型监控中存在的对齐张力：模型需要足够忠实以便监控，但又需要足够鲁棒以拒绝不安全的推理。
Result: 在HazMart数据集上的实验表明，DeepSeek-R1-Llama-70B具有高忠实性（97.5%）但安全性低（12.3%），而QwQ-32B安全性更高（73.9%）但忠实性较低（74.7%）；通过表征调控可将安全行为提升9个百分点。
Insight: 创新点在于提出了目标推理替换（TRR）这一直接干预推理链的评估方法，并揭示了忠实性与安全性在模型内部表征中呈现反相关的方向性，且可通过表征调控独立增强安全性。
Abstract: Chain-of-Thought (CoT) reasoning offers a promising window into model monitoring. However, monitoring relies on faithfulness, i.e., the model output strictly derives from its reasoning trace. We identify an alignment tension where a model must be faithful enough to be monitored, yet robust enough to reject unsafe reasoning. We demonstrate that this counterbalance exists in current Large Reasoning Models (LRMs), and show ways in which it can be addressed. We introduce HazMart, a human-written dataset set in an autonomous AI shopkeeper scenario. Unlike prior work that relies on providing hints in prompts to test faithfulness (e.g., “A Stanford professor said it should be Answer A”), we propose a novel replacement-based technique, which we call Targeted Reasoning Replacement (TRR), that directly intervenes in the reasoning chain to substitute in unsafe or illogical thoughts (e.g., “Wait, the answer must be Option B [was Option A] because it is the most fitting”). DeepSeek-R1-Llama-70B exhibits high faithfulness (97.5%) but fails to reject Unsafe Reasoning (12.3%), while QwQ-32B is more robust (73.9% safety) at the cost of lower faithfulness (74.7%). Mechanistic analyses of QwQ-32B reveal that these properties are represented by anti-correlated internal directions peaking at the action-commit token. Finally, we demonstrate that representation steering can independently amplify the safety direction, increasing safe behavior by 9 percentage points while maintaining base capabilities.
cs.MM [Back]
[115] Balancing Efficiency and Efficacy: Training-Free Attention-Guided Switching Between Explicit and Latent Thoughts for MLLMs cs.MM | cs.AI | cs.CL | cs.CVPDF
Haoqian Kang, Liupeng Li, Kuofeng Gao, Jinpeng Wang, Zhenyu Lu
TL;DR: 本文提出了一种无需训练的多模态大语言模型推理策略，通过解耦感知与推理过程，利用视觉-文本注意力比动态评估模型认知焦点，自适应地在显式文本生成与隐式推理之间切换，以平衡效率与准确性。
Details
Motivation: 解决多模态大语言模型中细粒度视觉感知与严谨逻辑推理的平衡问题，避免显式思维链的高计算成本与视觉幻觉，以及现有隐式推理方法需要昂贵训练的缺陷。
Result: 在广泛实验中，该方法实现了最先进的性能，通过减少自回归步骤和延迟，显著提高了准确性和推理效率。
Insight: 创新点在于提出视觉-文本注意力比作为动态评估指标，以解耦感知模糊性与逻辑不确定性，并设计自适应切换机制，在无需训练的情况下优化多模态推理过程。
Abstract: Reasoning in Multimodal Large Language Models (MLLMs) requires both fine-grained visual perception and rigorous logical deduction. Explicit text-based Chain-of-Thought (CoT) is computationally expensive and prone to visual hallucinations, while existing latent reasoning methods typically require costly training. Furthermore, directly adapting training-free LLM reasoning mechanisms to the multimodal setting yields unstable performance. We identify that this failure stems from their reliance on token-level entropy, which fundamentally conflates perceptual ambiguity (e.g., unclear visual details) with logical uncertainty (e.g., complex reasoning steps). To overcome this bottleneck, we present a novel training-free inference strategy for MLLMs that explicitly decouples perception and reasoning. We propose a novel metric, the vision-to-text attention ratio, to dynamically gauge the model’s cognitive focus. Guided by this metric, our proposed framework, Attention-Guided Switching (AGS), adaptively triggers latent reasoning for perceptual tokens to preserve high-fidelity visual information in the continuous space, while enforcing explicit text generation for logical tokens to maintain structural anchoring. Extensive experiments demonstrate that our method achieves state-of-the-art performance, significantly improving both accuracy and inference efficiency by reducing autoregressive steps and latency. Code is released at https://github.com/swordAndSnow/MM26-AGS.
[116] Adaptive Modality Reliability Diagnosis and Restoration for Robust Multimodal Intent Recognition cs.MM | cs.AI | cs.CLPDF
Suraj Kumar, Mohnish Raj, Soumi Chattopadhayay, Chandranath Adak, Ayan Dutta
TL;DR: 本文提出了PRIME框架，用于鲁棒的多模态意图识别。该框架通过闭环的可靠性引导机制，在样本级别联合诊断、恢复和重新评估模态质量，以应对模态噪声、缺失、语义冲突或主导等问题。
Details
Motivation: 现有方法通常隐式推断模态重要性，并对不可靠输入进行重加权或抑制，但未解决退化模态是否可修复及修复后是否可信的问题。
Result: 在多模态意图识别基准测试中，PRIME在保持干净数据性能竞争力的同时，显著提升了在模态缺失、噪声、冲突和不平衡条件下的鲁棒性。
Insight: 创新点在于提出了一种显式训练的可诊断性可靠性估计器，结合原型条件变分恢复模块，并引入修复后可靠性重评估的闭环机制，实现了对退化模态的主动修复与可信度动态判断。
Abstract: Multimodal intent recognition combines linguistic, acoustic, and visual evidence, but individual modalities may be noisy, missing, semantically conflicting, or disproportionately dominant. Existing methods typically infer modality importance implicitly and either reweight or suppress unreliable inputs, without determining whether a degraded modality can be repaired and subsequently trusted. We propose PRIME (Precision-weighted Reliability Inference and Modality rEstoration), a closed-loop reliability guided framework that jointly diagnoses, restores, and reassesses modality quality at the sample level. PRIME represents the weakness of each modality through a contextual log-variance estimated from complementary diagnostic evidence, including predictive confidence, epistemic disagreement, cross-modal consensus, and feature degeneracy. Because modality-reliability annotations are unavailable, the estimator is explicitly trained using controlled modality corruption with known degradation severity, together with a heteroscedastic uncertainty objective. Rather than directly discarding an unreliable modality, PRIME uses its estimated weakness to control a prototype-conditioned variational restoration module that reconstructs the degraded representation from complementary modalities. Crucially, reliability is re-estimated after restoration, allowing the model to determine whether the repaired representation has become sufficiently trustworthy to contribute to prediction. The resulting post-restoration precisions are used for inverse-variance multimodal fusion. Experiments on multimodal intent-recognition benchmarks show that PRIME maintains competitive clean-data performance while improving robustness under missing, noisy, conflicting, and modality-imbalanced conditions.
[117] Caved or Convinced: Temporal Sampling Gates Claim Deference in Video Large Language Models cs.MM | cs.CVPDF
Yuxin Cao, Wei Song, Jingling Xue, Jin Song Dong
TL;DR: 本文研究了视频大语言模型在判断两个事件先后顺序时的两种失败模式：盲目接受错误主张或错误拒绝正确主张。作者通过分离可用性和权重两个因素，提出了一种反转测试方法，有效提升了模型在时序推理任务上的准确率。
Details
Motivation: 现有视频大语言模型在时序推理任务中存在两种对立错误，而先前研究仅关注模型盲目服从用户主张的问题，其解决方案可能加剧另一种错误。本文旨在区分并解决这两种错误背后的根本原因。
Result: 在评估的九个模型中，当事件未被采样时，模型接受真假主张的概率相同。提出的反转测试方法将能够读取时序的模型的顺序判断准确率提升至0.92-1.00，对于无法读取时序的模型则选择弃答而非猜测。
Insight: 创新点在于将模型失败原因分解为证据可用性和证据权重两个独立因素，并设计了反转测试来抵消模型固有的时序先验，从而在不依赖用户主张的情况下做出更可靠的判断或明智的弃答。
Abstract: When asked which of two events came first, video large language models can fail in two opposite ways: cave to a false claim, or reject a true one. Prior video sycophancy work measures only the first and mitigates it by teaching the model to trust the user less, a fix known in text and image models to worsen the second. In video, both failures come from two causes the literature treats as one: availability, whether the sparse sampled frames contain the two events, and weighting, whether that evidence is trusted over the user. We separate them with two interventions that keep the claim fixed: a frame-preserving reorder that flips the claim’s truth, and a sampling-offset shift that captures or misses both events at a fixed frame budget. When the events are missed, the two twins present identical frames, so each of the nine models we evaluate accepts a true and a false claim at the same rate, making Youden’s $J=0$ by construction. Availability is necessary but not sufficient. Five of the nine read the order, yet four of those five still cave to the false claim, so their deference hits a weighting ceiling. Since trust cannot be calibrated over evidence that was never sampled, we propose a reversal test that cancels the model’s order prior by scoring the sampled frames forward and reversed, then answers, resamples, or abstains without reading the claim. The test raises the order accuracy to 0.92-1.00 on the models that read the order and abstains rather than guesses on those that cannot.
cs.LG [Back]
[118] SMOPD: Multi-Reward Reinforcement Learning via Specialize-and-Merge Online Policy Distillation cs.LG | cs.AI | cs.CLPDF
Wen Wang, Jiahua Bao, Tu Yongsiqi, Yihao Liu, Haotian Zhou
TL;DR: 本文提出了一种名为SMOPD的两阶段训练方法，旨在解决多奖励强化学习中不同粒度奖励信号难以平衡的问题。该方法首先训练多个针对特定奖励的教师模型，然后通过在线策略蒸馏将这些能力合并到一个学生策略中，从而在不牺牲细粒度奖励能力的前提下增强稀疏奖励的优化信号。
Details
Motivation: 现有方法GDPO通过归一化每个奖励维度缓解了奖励信号相互掩盖的问题，但在处理不同粒度奖励（如密集奖励和稀疏奖励）时仍难以平衡，稀疏奖励可能因信号不足而无法有效强化其对应能力。
Result: 在互补奖励（工具调用准确性和格式）和冲突奖励（有帮助性和无害性）两种多奖励设置下，SMOPD在1.5B、3B和7B骨干模型上均优于GDPO。
Insight: 论文的创新点在于采用两阶段“专业化-合并”框架，通过奖励优先级配置训练专门化教师模型，再通过在线策略蒸馏整合能力，这为解决多奖励优化中的信号不平衡问题提供了新思路。
Abstract: We aim to improve model performance in multi-reward reinforcement learning training process. Existing Group reward-Decoupled Normalization Policy Optimization (GDPO) has mitigated the issue of reward signals masking one another during direct scalarization by normalizing each reward dimension separately before aggregation. However, our experiments show that GDPO still struggles to balance reward signals with different granularities. Specifically, in some particular training tasks, the model may receive a dense reward that assigns fine-grained scores ranging from 0.1 to 1.0, together with a sparse reward that provides only binary feedback of either 0 or 1. In such cases, we find that the sparse reward may provide an insufficient optimization signal, preventing its corresponding capability from being effectively reinforced. Therefore, how can we strengthen the optimization signal from the sparse reward without sacrificing the capability already learned from the fine-grained reward? To overcome this limitation, we propose Specialize-and-Merge Online Policy Distillation (SMOPD), a two-stage training method for multi-reward optimization. Stage1-Specialize: SMOPD first employs reward-priority configurations to train multiple reward-specialized teachers, allowing each reward to be learned under conditions where its signal can effectively drive optimization. Stage2-Merge: SMOPD then utilizes online policy distillation to combine the reward-specialized capabilities of these teachers into a single student policy, while maintaining balanced task-level optimization. To validate our method, we conduct experiments on two multi-reward settings: complementary rewards(tool-calling accuracy and format) and conflicting rewards (helpful and harmless rewards). Based on above settings, SMOPD outperforms GDPO across 1.5B, 3B and 7B backbones.
[119] Convex-Hull-Neighborhood Smooth Dual Generalization: Controlling Local Correction Propagation in Offline RL cs.LG | cs.CLPDF
Yi Yang, Zhennan Chen, Mingfeng Lv, Hanlei Li, Zhengsen Ruan
TL;DR: 该论文提出了一种名为凸包邻域平滑对偶泛化（CSDG）的离线强化学习方法，将贝尔曼备份表示为样本内价值目标与凸包邻域局部修正项之和。该方法通过显式分离泛化贡献与样本内参考路径，并利用不同扰动半径采样的候选值进行平滑，以控制分布外动作的估计误差传播。实验在Gym-MuJoCo和AntMaze基准上验证了其整体性能和稳定的价值估计。
Details
Motivation: 离线强化学习中，利用分布外动作可能带来收益，但其估计误差会因自举过程而被放大。现有方法通常通过独立机制控制可接受的分布外区域或泛化目标的影响，缺乏统一框架。
Result: 在Gym-MuJoCo和AntMaze基准测试中，CSDG展现出强大的整体性能和稳定的价值估计，代码已开源。
Insight: 创新点在于将贝尔曼备份显式分解为样本内目标与局部修正，通过凸包邻域平滑对偶泛化统一控制泛化贡献；理论推导了单步修正恒等式、时变迭代界和仅依赖于定点分支差异的定点界；实践算法采用非对称有界噪声和期望回归近似，无需精确支持分类或额外的悲观分布外惩罚。
Abstract: Offline reinforcement learning (offline RL) can benefit from nearby out-of-distribution (OOD) actions, but estimation errors at these actions may be amplified by bootstrapping. Existing regularization and local-generalization methods control either the admissible OOD region or the influence of generalized targets, often through separate mechanisms. We propose Convex Hull Neighborhood Smooth Dual Generalization (CSDG), which expresses the Bellman backup as an in-sample value target plus a CHN-local correction. This formulation makes the generalized contribution explicit and separates it from the in-sample reference path. The correction is obtained by smoothing in-sample-oriented and OOD-oriented candidates sampled at different perturbation radii. A mixture coefficient lambda scales its contribution to each backup, while the recursive discount remains gamma. Under boundedness and fixed perturbation kernels, we derive an exact one-step correction identity, a time-varying iterate bound, and a fixed-point bound that depends only on the branch discrepancy at the fixed point. We further characterize the implicit policies induced by the idealized operators and give a conditional non-degradation criterion. The practical algorithm approximates these quantities using asymmetric bounded noise and expectile regression, without exact support classification or an additional pessimistic OOD penalty. Experiments on Gym-MuJoCo and AntMaze show strong aggregate performance and stable value estimation. Code is available at: https://github.com/YOUNG-fnxm/CSDG
[120] Agentic Reinforcement Learning with Self-Distilled Reward Shaping cs.LG | cs.AI | cs.CLPDF
Ranxu Zhang, Guinan Chen, Chenshaodong, Jinghao Lin, Xiaozhou Xu
TL;DR: 本文提出了ADRS框架，旨在解决LLM智能体在强化学习中因轨迹级奖励稀疏而难以进行中间决策信用分配的问题。该方法通过利用特权技能对固定轨迹进行重评分，并结合教师价值优势门控机制，将令牌级信用信号整合到原生RL信用构建中，从而为多轮语言智能体提供与回报关联的密集监督。
Details
Motivation: 现有基于特权技能的强化学习方法未能联合校准跨交互步骤的教师评分、将教师置信度与实际回报关联，并将生成的信号整合到原生奖励-优势值构建中，导致稀疏的轨迹级奖励无法有效识别中间决策的贡献。
Result: 在三个交互式基准测试上的实验表明，ADRS能持续提升长视野任务的性能，其增益在不同RL主干、低数据设置、未见任务和延长训练中均能保持。
Insight: 创新点在于提出了一个系统性的框架，通过中心化与归一化特权令牌分数、基于组内置信度-回报关联的教师价值优势门控，以及将门控信号整合到原生RL信用路径，实现了对中间决策的精细信用分配，同时保持了无技能的轨迹生成与推理过程。
Abstract: Agentic reinforcement learning enables LLM agents to learn through interaction, but sparse trajectory-level rewards reveal success without identifying which intermediate decisions deserve credit. Training-only privileged skills can provide denser supervision by allowing the same frozen policy snapshot to rescore fixed tokens from skill-free trajectories while conditioned on task-matched procedural skills. Existing methods, however, do not jointly calibrate teacher scores across interaction steps, relate teacher confidence to realized returns, and integrate the resulting signal into native reward-to-advantage construction. We introduce Agentic Reinforcement Learning with Self-Distilled Reward Shaping (ADRS), a framework for constructing return-associated token-level credit for multi-turn language agents. ADRS centers and normalizes privileged token scores within each step, modulates them with a return-associated Teacher Value Advantage (TVA) gate based on within-group confidence–return association, and incorporates the gated token signal into native RL credit construction. Together, these components determine what the teacher prefers, when that preference is return-relevant, and how it enters the native reinforcement-learning credit path, while keeping rollouts and inference skill-free. Finally, experiments across three interactive benchmarks show that ADRS consistently improves performance on long-horizon tasks, with gains persisting across RL backbones, reduced-data settings, unseen tasks, and extended training. For anonymous review, our code is available at the following the link: https://github.com/gitrxh/ADRS-arxiv
[121] The Tell-Tale Trace: Detecting Reasoning Failures in LLMs Using Chain-of-Thought Dynamics cs.LG | cs.AI | cs.CLPDF
Shashwat Sourav, Aishwarya Balwani
TL;DR: 本文提出通过分析思维链（CoT）的动态变化来检测大型语言模型（LLM）的推理失败，而无需假设其语言化步骤能忠实反映内部计算。研究在可验证的布尔可满足性问题（SAT/UNSAT）上发现，失败的推理轨迹在结构上表现出特定模式（如过早验证、重复操作等），并设计了一种针对性的提示干预，显著提升了模型性能。
Details
Motivation: 现有方法主要评估思维链中单个步骤的语义正确性或一致性，而忽略了推理过程在轨迹上的演化，且语言化思维链未必忠实反映模型内部推理。因此，本文旨在探索如何利用可见思维链的动态变化来系统区分成功与失败的推理，而不依赖语义忠实性假设。
Result: 在可验证的布尔可满足性任务上，研究发现失败推理轨迹表现出特定结构模式（如SAT问题上的过早验证崩溃、UNSAT问题上的错误SAT结论倾向）。通过针对性的证明搜索提示干预，Llama3-70B的准确率从13.3%提升至85%，纠正了84.6%的错误。
Insight: 创新点在于从思维链的动态结构（而非单个步骤的语义）角度检测分布式推理失败，揭示了能力失败在可见推理结构中的任务依赖性变化。这为诊断和纠正LLM推理错误提供了不依赖语言化步骤忠实性的新方法。
Abstract: Chain-of-thought (CoT) reasoning improves large language model (LLM) performance while also providing an observable interface to the model’s reasoning process. Existing approaches that leverage verbalized CoTs to monitor reasoning correctness, however, largely evaluate the semantic correctness or consistency of individual intermediate steps, rather than how the reasoning process evolves across the trace. As a result, failures distributed across the reasoning trajectory, rather than those localized to a single incorrect step, remain comparatively underexplored. Furthermore, verbalized CoTs need not faithfully reflect the model’s internal reasoning, motivating analyses that do not treat individual statements as literal accounts of internal computation. In this work, we therefore ask whether the dynamics of visible CoT can be leveraged to systematically distinguish successful from failed reasoning without assuming such semantic faithfulness. We study a range of LLMs on verifiable Boolean satisfiability tasks with variable complexity, enabling controlled comparisons near each model’s capability frontier. Tagging CoT sentences by reasoning function reveals premature verification collapse on SAT problems: incorrect traces enter clause checking earlier, repeat similar operations, and finalize sooner. On UNSAT problems, models presumptuously move towards incorrect SAT conclusions, checking candidate assignments rather than deriving contradictions across constructed cases. Subsequently, a targeted proof-search prompt intervention raises Llama3-70B accuracy from 13.3% to 85%, correcting 84.6% of these errors. These results show that capability failures can manifest as distributed, task-dependent changes in the structure of visible reasoning, and that CoT dynamics agnostic to whether the verbalized trace reflects the model’s internal computations can help diagnose and correct failures.
[122] Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging cs.LG | cs.CVPDF
Siming Fu, Zheming Fu, Ruizhe He, Hualiang Wang, Jie Huang
TL;DR: 本文提出Any-OPD框架，首次实现了任意潜在流匹配生成器之间的异构策略蒸馏。该方法将教师模型视为黑盒采样器，通过在冻结的、模型无关的视觉表示空间中比较两者的解码输出，绕过了对潜在空间、架构或时间步网格的依赖，从而成功地将大型FLUX.1-dev模型的知识蒸馏到较小的SD3.5-Medium模型中。
Details
Motivation: 解决异构模型间策略蒸馏的难题：当教师模型与学生模型来自不同家族（潜在空间、架构、时间步规划均不匹配）时，传统的蒸馏方法（如潜在回归或逐像素损失）会失效，导致训练崩溃或结果模糊。
Result: 在将12B参数的FLUX.1-dev蒸馏到2.5B参数的SD3.5-Medium的实验中，Any-OPD将学生的PickScore从0.846提升至0.884，HPSv3从9.12提升至10.97，性能接近教师模型（仅为其1/5参数量），而直接潜在回归方法则完全无法训练。
Insight: 创新点在于采用模型无关的视觉表示空间作为桥梁进行输出比较，并通过匹配连续噪声水平而非离散时间步索引来恢复轨迹对应性；同时，引入短暂的锚定阶段（将教师样本通过学生VAE重编码），确保策略梯度衡量的是样本质量而非领域差异，实现了真正的黑盒异构蒸馏。
Abstract: On-policy distillation, in which a teacher corrects samples that the student itself generates, presupposes that the two models speak the same language: identical VAE latents, matching architectures, and a common timestep grid. We ask what happens when none of this holds, as when the strongest teacher available and the student one wishes to deploy come from different model families, and find that the standard recipes have no answer: teacher latents cannot serve as targets in a foreign coordinate system, per-pixel losses against a teacher that stochastically re-draws local detail degenerate into blur or divergence, and timestep indices lose their meaning across mismatched schedules. We present Any-OPD, to our knowledge the first framework for on-policy distillation between arbitrary pairs of latent flow-matching generators. Any-OPD treats the teacher purely as a black-box sampler and connects the two models at exactly one point: a frozen, model-agnostic vision representation in which their independently decoded outputs are compared, sidestepping every assumption about latents, features, or architecture. Trajectory correspondence is recovered by matching continuous noise levels instead of step indices, and a brief anchoring phase, in which teacher samples are re-encoded through the student’s own VAE, ensures the on-policy gradient measures sample quality rather than domain mismatch. Distilling the 12B FLUX.1-dev into the 2.5B SD3.5-Medium, Any-OPD lifts the student’s PickScore from 0.846 to 0.884 and HPSv3 from 9.12 to 10.97, rivaling the teacher at a fifth of its size, where direct latent regression fails to train at all.
[123] Stop Replacing Noise with Noise: Two-Source Reliability Assessment for Label Correction and Sample Reweighting in Label-Noise Learning cs.LG | cs.CVPDF
Wenxiao Fan, Kan Li
TL;DR: 本文提出了一种名为TRACE的双源可靠性评估框架，用于标签噪声学习中的标签校正和样本重加权。该框架通过分别评估观测标签和伪目标的可靠性，避免了传统方法中因互补性假设而可能用一个不可靠信号替换另一个的问题，从而提高了伪监督的可靠性。
Details
Motivation: 传统基于翻新的标签噪声学习方法通常使用单一的样本清洁度分数来控制观测标签和模型生成的伪目标，这隐含地假设了二者的可靠性是互补的，即减少对观测标签的信任会自动增加对伪目标的信任。然而，从噪声监督中学习到的伪目标可能重现其本应纠正的噪声，导致用一个不可靠信号替换另一个不可靠信号的问题。
Result: 在合成和真实世界的噪声基准测试中，TRACE改进了代表性的翻新基线方法，并产生了更可靠的伪监督。
Insight: 论文的创新点在于提出了双源可靠性评估框架，分别通过损失拟合、浅层关系稳定性和预测一致性来评估观测标签，同时使用模型置信度单独评估伪目标，从而解耦了二者的可靠性评估。从客观角度看，其利用浅层关系稳定性作为额外信息源，超越了仅依赖损失后验的传统方法，为标签噪声学习提供了更稳健的可靠性诊断。
Abstract: Refurbishment-based noisy-label learning mixes an observed label with a model-derived pseudo target, typically using one sample-wise cleanliness score to control both branches. This creates a hidden coupling: reducing trust in the observed label automatically increases trust in the pseudo target. We show that this complementarity can replace one unreliable signal with another because a pseudo target learned from corrupted supervision may reproduce the noise it is meant to correct. Our representation diagnostics provide a consistent account of this mismatch: noisy supervision redirects deeper layers more strongly, whereas shallower relations remain comparatively stable and provide information beyond the loss posterior. We therefore propose TRACE, a Two-Source Reliability Assessment framework for Label Correction and Sample Reweighting. TRACE assesses the observed label using loss fit, shallow relation stability, and prediction agreement, while separately assessing the pseudo target using model confidence. Its source-specific scores control target correction and supervision strength without assuming complementary reliability. Across synthetic and real-world noisy benchmarks, TRACE improves representative refurbishment baselines and yields more reliable pseudo supervision.
[124] PRISM: Powerful Time Series to Image (TS2I) Representations for Multivariate Anomaly Detection cs.LG | cs.AI | cs.CVPDF
Mateusz Smendowski, Kamil Faber, Piotr Nawrocki, Nathalie Japkowicz, Roberto Corizzo
TL;DR: 论文提出了PRISM，一种用于多元时间序列异常检测（TSAD）的即插即用元工作流，可将时间序列转换为图像表示。通过超过7000次实验的系统评估，研究表明精心设计的PRISM配置在14个数据集中的10个上取得了最佳VUS-PR性能，平均比最佳竞争方法提升41%，并且发现通道化是关键的、先前未被充分研究的设计维度。
Details
Motivation: 解决多元时间序列异常检测中表示选择敏感的问题，特别是探索如何将高维多变量序列映射到多通道图像，以及视觉骨干网络能否在TSAD中匹配时域基线方法。
Result: 在14个数据集中的10个上取得了最佳VUS-PR（部分接收者操作特性曲线下体积）性能，平均比最佳竞争方法提升41%，与24种时域基线方法竞争。
Insight: 创新点在于提出了系统构建和评估基于图像的TSAD表示的元工作流PRISM，并识别出通道化这一关键设计维度，提出了基于统计的MSM方案，比基于PCA的方案提升11-27%；同时发现ImageNet预训练编码器能有效迁移到TSAD任务，冻结编码器可保留92%的微调性能且训练快1.8倍。
Abstract: Time series anomaly detection (TSAD) underpins applications in predictive maintenance, finance, and cloud computing, however performance remains sensitive to representation choices, especially in multivariate settings. While transforming time series into images has shown success in forecasting and classification, it remains unclear how multivariate, high-dimensional series should be mapped to multi-channel images and whether vision backbones can match time-domain baselines in TSAD. We introduce PRISM, a plug-and-play meta-workflow enabling systematic construction and evaluation of image-based representations for multivariate TSAD. Our evaluation spanning over 7,000 experiments shows that well-designed PRISM configurations are competitive with 24 time-domain baselines, achieving the best VUS-PR on 10 of 14 datasets, with an average improvement of 41% over the best competing method on those datasets. Further, we identify channelization - how the channel dimension of multi-channel images is constructed - as a critical and previously understudied design dimension, and introduce MSM, a novel statistics-based scheme achieving 11-27% gains over PCA-based alternatives. Finally, ImageNet-pretrained encoders transfer effectively to TSAD, with frozen encoders retaining 92% of fine-tuned performance while training 1.8 times faster. Our code is available at: https://github.com/Smendowski/PRISM.
[125] Latent Reward Registers for Diffusion Preference Alignment cs.LG | cs.CVPDF
Yuanshen Guan, Zipeng Feng, Zhiwei Xiong, Peiqin Sun
TL;DR: 本文提出了一种名为Latent Reward Registers的新机制，用于解决扩散模型与人类偏好对齐中的时间信用分配问题。该方法通过在冻结的扩散变换器（DiT）输入序列前添加可学习的寄存器令牌，直接从中间噪声潜在状态估计最终偏好，从而提供密集的奖励信号。基于此，论文提出了两种对齐策略：用于训练的奖励梯度策略蒸馏（RG-OPD）和用于推理的奖励引导采样（RGS），在提高对齐效果的同时显著降低了计算成本。
Details
Motivation: 当前基于人类偏好对齐扩散模型的方法通常依赖于在最终生成样本上评估的稀疏终端奖励，这导致在多步去噪过程中面临严重的时间信用分配挑战。论文旨在通过直接从中间潜在状态估计奖励，提供更密集、可微分的信号来改进对齐过程。
Result: 在高噪声水平（u = 0.8）下，所提出的寄存器机制在评估的潜在奖励模型中达到了最高的成对准确率。RG-OPD在性能上优于在线强化学习基线，同时将GPU小时数减少了高达33倍；RGS在无需训练的方法中建立了新的最先进水平，严格提升了对齐和感知指标。
Insight: 创新点在于引入了独立于生成器隐藏状态或速度场的潜在奖励寄存器，实现了对终端偏好的直接中间估计。这避免了修改模型内部表示，并支持高效的训练和推理策略，为扩散模型的对齐提供了可扩展且计算高效的解决方案。
Abstract: Aligning diffusion models with human preferences usually relies on a sparse terminal reward evaluated on the final generated samples, presenting a severe temporal credit-assignment challenge across the multi-step denoising process. We propose Latent Reward Registers, a mechanism that estimates terminal preference directly from intermediate noisy latents by prepending learnable, position-free register tokens to the input sequence of a frozen Diffusion Transformer (DiT). This independent readout mechanism extracts latent reward evidence without altering the generator’s hidden states or velocity field. The resulting dense, differentiable reward signal throughout the full denoising process facilitates two alignment strategies. For training, Reward-Gradient On-Policy Distillation (RG-OPD) distills reward-guided updates along on-policy trajectories, bypassing the computationally expensive rollouts of standard policy gradients. For inference, Reward-Guided Sampling (RGS) steers trajectories via magnitude-matched reward gradients without parameter updates. Empirically, at high noise levels (u = 0.8), the registers reach the highest pairwise accuracy among the evaluated latent reward models. Furthermore, RG-OPD outperforms online reinforcement learning baselines while reducing GPU hours by up to 33x, and RGS establishes a new state-of-the-art among training-free methods, strictly enhancing both alignment and perceptual metrics. Code and weights are available at https://github.com/Guanys-dar/latent-reward-register
cs.CR [Back]
[126] AI Security Leaderboard: Methodology, Results and Minimal Standard cs.CR | cs.AI | cs.CLPDF
Jasper Timm, Lukas Struppek, Ziwei Xu, Grace Cheong, Oscar Mata
TL;DR: 该论文提出了FAR.AI安全防护最低标准1.0版，这是一个评估前沿AI模型防护能力的基准。作者通过一个包含67种静态越狱技术的分类法，构建了一个巨大的攻击空间，并对Claude Fable 5、GPT-5.6 Sol、Gemini 3.1 Pro和Grok 4.5等旗舰模型在CBRNE威胁和网络攻击目标上进行了评估。研究发现模型鲁棒性差异巨大，Grok 4.5和Gemini 3.1 Pro存在大量通用越狱漏洞，而Claude和GPT模型则未发现。
Details
Motivation: 解决当前前沿AI模型开发者依赖分层防护措施，但缺乏公开证据证明这些防护措施的有效性和一致性的问题。旨在建立一个公开、可复现的基准来量化评估AI模型的安全防护能力。
Result: 在包含360个攻击目标的两个互补数据集上评估了四个旗舰模型。Grok 4.5和Gemini 3.1 Pro分别发现了63个和18个通用越狱漏洞（随机搜索），平均成本约为58美元和278美元；专家引导组合攻击分别提升至385个和231个。Claude Fable 5和GPT-5.6 Sol在两种策略下均未发现任何通用越狱。模型间的突破成本差异超过百倍。
Insight: 创新点在于提出了一个系统化的安全评估最低标准，包括技术分类法、大规模攻击空间构建方法和“突破成本”量化指标。客观来看，该研究为AI安全领域提供了一个可操作的、透明的基准测试框架，强调了深度防御（结合推理、激活和输入/输出监控）的重要性，并指出现有公开技术足以弥合已发现的安全差距。
Abstract: Frontier AI model developers increasingly rely on layered safeguards to prevent catastrophic misuse, but little public evidence exists on how much protection these safeguards provide, or how consistently across developers. We introduce the FAR.AI Minimal Standard for Safeguards, Version 1.0: a taxonomy of 67 readily accessible static jailbreak techniques, a method for composing them into a very large attack space, and a benchmark of flagship models against a sample of it. We evaluate Claude Fable 5, GPT-5.6 Sol, Gemini 3.1 Pro, and Grok 4.5 on two complementary datasets totalling 360 attacker goals spanning chemical, biological, radiological/nuclear and explosive (CBRNE) threats and offensive cyber, using a three-stage funnel to identify universal jailbreaks: single prompt templates that elicit operationally compliant responses on over 75% of a domain’s goals. We also introduce a cost-to-jailbreak metric that models attacker spend directly, with right-censored lower bounds where no universal jailbreak was found. Robustness is highly uneven: the cost to break these models varies over a hundredfold. Random search over our technique pool found 63 universal jailbreaks against Grok 4.5 and 18 against Gemini 3.1 Pro, at an average cost of roughly $58 and $278 per jailbreak found; expert-guided composition raised these to 385 and 231. Neither Claude Fable 5 nor GPT-5.6 Sol yielded any universal jailbreak under either strategy. Because meeting the Minimal Standard requires only defenses already publicly described and deployed in production elsewhere, these gaps appear closable with current techniques. We recommend defense-in-depth combining reasoning, activation, and input/output monitoring. Results are maintained at leaderboard.far.ai.
[127] Micro-Segmentation Anomaly Detection in Zero-Trust Software-Defined Network Fabrics cs.CR | cs.CV | cs.LG | cs.NIPDF
Ashly Joseph
TL;DR: 本文研究了在零信任软件定义网络（SDN）中通过微分割进行异常检测的方法，开发了Vision Transformer（ViT）和1D卷积神经网络（1D-CNN）模型来处理原始及微分割后的网络流数据。实验表明，微分割能显著提升检测精度，ViT模型在识别细微横向移动模式上略优于1D-CNN。
Details
Motivation: 基于零信任架构（ZTA）原则，需要严格的网络分割和持续验证以减少隐式信任和横向威胁传播，解决传统粗粒度监控可能遗漏有害行为的问题。
Result: 在模拟的零信任SDN数据集上，基于微分割数据的模型在准确率和F1分数（F1=0.95）上优于使用未分割原始数据的模型（F1=0.90），ViT检测器在识别未处理数据中未注意到的细微横向移动模式上表现略好。
Insight: 创新点在于将微分割与深度学习模型（如ViT和1D-CNN）结合用于SDN异常检测，客观分析显示微分割能有效提升检测性能，为增强零信任网络中的入侵检测效果提供了新思路。
Abstract: Zero Trust Architecture (ZTA) principles need rigorous network segmentation and ongoing verification to reduce implicit trust and lateral threat propagation. This paper investigates anomaly detection in software-defined networking (SDN) systems by micro-segmentation, using deep learning models to detect harmful actions that evade traditional coarse-grained monitoring. Two models are developed: a Vision Transformer (ViT) and a 1D Convolutional Neural Network (1D-CNN), which are used to both raw and micro-segmented network flow data. Experimental findings from a simulated zero-trust SDN dataset indicate that micro-segmentation substantially improves detection accuracy. The models trained on segmented input demonstrate enhanced accuracy and F1-scores (F1 = 0.95) compared to those utilizing unsegmented raw data (F1 = 0.90). The ViT-based detector marginally surpasses the 1D-CNN, particularly in recognizing nuanced lateral movement patterns that are unnoticed in unprocessed data. These findings highlight the significance of including micro-segmentation inside zero-trust networks to enhance intrusion detection efficacy. Future efforts will broaden this methodology to include extensive real-world network datasets and dynamic online segmentation techniques.
[128] FakeI2V-Bench: Benchmarking the Applicability of Image-level Deepfake Detectors for Deepfake Video Detection cs.CR | cs.AI | cs.CVPDF
Pei Li, Sihan Chen, Delong Ran, Tianshuo Cong
TL;DR: 本文提出了FakeI2V-Bench基准测试，用于系统评估图像级深度伪造检测器在视频领域的性能，并包含一个名为IV-Bridge的通用框架，通过聚合帧级预测来提升图像级检测器在视频上的适用性。
Details
Motivation: 当前视频生成模型的进步加剧了深度伪造威胁，但现有的深度伪造视频检测基准尚不完善，特别是图像级检测器在视频领域的有效性尚未得到系统评估。
Result: 在FakeI2V-Bench数据集上，最佳图像级检测器达到80.16% AUC，略优于最强的视频级检测器（79.99% AUC）；而通过IV-Bridge框架增强后，最佳图像级检测器变体达到93.80% AUC，超越了现有视频级方法。
Insight: 论文的创新点在于建立了首个系统评估图像级深度伪造检测器在视频领域性能的基准，并提出了IV-Bridge这一通用框架，通过随机森林模型聚合帧级统计特征，有效将图像级检测器扩展至视频域，为未来研究提供了新方向。
Abstract: Recent advances in video generation models have significantly intensified the deepfake threat, yet the current deepfake video detection benchmarks remain underdeveloped. In particular, the effectiveness of image-level detectors in the video domain has not been systematically assessed. To fill this gap, we present FakeI2V-Bench, a benchmark for evaluating state-of-the-art video-level deepfake detectors in challenging scenarios, with a particular focus on systematically assessing the performance of image-level deepfake detectors in the video domain. FakeI2V-Bench comprises 97,548 videos, containing content generated by the latest powerful generation models and covering a broader range of categories. Using this dataset, we conduct a systematic evaluation of eight video-level detectors and twelve representative image-level detectors. Experimental results show that the best-performing image-level detector achieves an 80.16% AUC, slightly outperforming the strongest video-level detector (i.e., 79.99% AUC). Going beyond benchmarking, we present IV-Bridge, a general framework that enhances the applicability of image-level deepfake detectors to videos. IV-Bridge employs a random forest model with statistical features to aggregate frame-level predictions, allowing eleven image-level detectors to surpass state-of-the-art video-level approaches, with the best-performing variant achieving a 93.80% AUC. Overall, FakeI2V-Bench establishes a rigorous benchmark for deepfake video detection and introduces a novel pathway for extending image-level detectors to the video domain, offering new insights and directions for future research. Code and data are available at https://github.com/CryptoAILab/FakeI2V-Bench.
[129] Fast Object Removal Attacks on Safety-Critical Video-based Perception Systems cs.CR | cs.CVPDF
Mohammad Imtiaz Hasan, M Sabbir Salek, Nathan Jones, Mashrur Chowdhury, Rong Ge
TL;DR: 本文提出了一种针对基于视频的安全关键感知系统的近实时目标物体移除攻击方法。该攻击框架通过定位目标、检索连贯补丁、上下文感知的alpha合成以及重建攻击帧四个阶段，能够有效降低下游感知模块的目标检测率。实验表明，该方法在保持高视觉质量的同时，实现了高攻击成功率与近实时性能。
Details
Motivation: 智能交通系统（ITS）依赖视频感知系统来提升道路安全，但攻击者可能通过操纵视频帧来破坏下游感知模块，从而危及安全关键功能。本文旨在研究并演示一种能够隐秘移除视频中特定物体的攻击模型，以揭示此类系统的脆弱性。
Result: 在南卡罗来纳州网联汽车试验台（SC-CVT）交叉路口的实验中，重建帧与原始帧具有高全局相似性（PSNR > 40 dB，SSIM > 0.996）。使用基于YOLO的检测器时，攻击将物体检测减少了高达97.59%，帧级攻击成功率达到94.48%。在GPU硬件上，平均每帧执行时间为0.074至0.172秒，实现了近实时性能。
Insight: 创新点在于提出了一个端到端的近实时目标移除攻击框架，该框架结合了目标定位、连贯补丁检索和上下文感知的alpha合成技术。从客观角度看，该方法在攻击有效性与视觉隐蔽性之间取得了良好平衡，并系统评估了其对多种检测器的攻击效果及现有篡改检测模型的防御能力，为安全关键视频感知系统的对抗性防御研究提供了重要参考。
Abstract: By leveraging data from video-based perception systems, intelligent transportation systems (ITS) support safety-critical applications that improve road safety. However, adversaries may manipulate video frames to compromise downstream perception modules, causing failures in safety-critical functions and increasing risks to vulnerable road users. This paper presents a novel attack model and an end-to-end framework for near-real-time targeted object removal attack on a video-based safety-critical system. The end-to-end attack pipeline consists of four stages: localizing targets in each frame, retrieving coherent patches from earlier frames, blending them using context-aware alpha compositing, and reconstructing attacked frames. Experiments at an intersection on the South Carolina Connected Vehicle Testbed (SC-CVT) show that reconstructed frames have high global similarity to the originals, with frame-level Peak Signal to Noise Ratio (PSNR) above 40 dB and Structural Similarity Index Measure (SSIM) above 0.996. Using the YOLO-based detector, the attack reduces object detections by up to 97.59% and achieves a frame-level attack success rate of 94.48%. Across the evaluated detectors and frame resolutions, the mean execution time ranges from 0.074 to 0.172 seconds per frame on GPU hardware, indicating near-real-time performance in testing. The forensic evaluation using several pretrained tamper-detection models shows limited ability to distinguish reconstructed from authentic frames. The findings suggest that video-based perception is vulnerable to stealthy object removal attacks that can degrade the performance of safety-critical applications by reducing object detectability. These findings can help develop mitigation strategies against adversarial object removal attacks that threaten safety-critical applications, such as vision-based pedestrian safety systems.
cs.RO [Back]
[130] Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control cs.RO | cs.CVPDF
Weili Zeng, Yitong Xing, Fulong Liu, Chengqun Yang, Antao Xiang
TL;DR: 本文提出Enfold方法，将世界生成模型（world generative models）中构建未来轨迹的计算过程内化到仅基于当前视觉上下文和语言指令预测的表征中。该方法通过训练时利用生成器处理观测未来时暴露的多层状态来监督仅基于当前信息的编码器，从而在部署时无需执行生成器即可实现高效控制。
Details
Motivation: 动机在于传统世界生成模型通常需要昂贵的生成分支来渲染未来或计算潜在上下文，其核心可复用资产是构建未来的计算过程。本文旨在探索能否将这种未来生成计算内化到仅从当前信息推断的表征中，以实现更高效的具身控制。
Result: 在LIBERO、RoboTwin2.0和真实机器人任务上，Enfold在保持强控制性能的同时，将动作延迟降低了3.7倍（相对于Fast-WAM），其快速版本Enfold-Flash可达10.1倍。表征分析表明它能抑制干扰变化并优先捕获长时域中出现的变化。
Insight: 创新点在于将世界生成器重新定位为预测性控制表征的来源，通过将生成器的内部结构“折叠”到当前表征中，避免了在每个步骤都具体化生成未来，从而实现了超高效控制。这提供了一种将生成模型的计算优势整合到轻量级推理框架中的新范式。
Abstract: World generative models are typically used through what they produce: a rendered future, a video-conditioned action, or latent context computed by a costly generative branch. We argue that their more reusable asset is the computation that constructs a future. As a generator transforms a corrupted future into a coherent trajectory, its intermediate states organize appearance, spatial layout, and interaction across levels of abstraction. Can this future-generative computation be internalized in a representation inferred from the present alone? We present Enfold, which transfers this computation into a representation predicted from the current visual context and language instruction. During training, multi-level states exposed as the generator processes the observed future supervise a current-only encoder. The learned representation is fed back to condition future generation and is read by task heads without allowing task gradients to reshape the encoder. At deployment, action prediction no longer executes the generator. Across LIBERO, RoboTwin2.0, and real-robot tasks, Enfold supports strong control while reducing action latency by $3.7\times$ relative to Fast–WAM, Enfold-Flash reaches $10.1\times$. Representation analyses show that it suppresses nuisance variation and preferentially captures changes that emerge over longer horizons. When the current scene is altered by human intervention, both the generated continuation and the executed actions adapt, which is inconsistent with fixed trajectory replay. These results recast a world generator as a source of predictive control representations: its future need not be materialized at every step if its internal structure can be enfolded into the present.
[131] PLS-Calib: A Partial Least Squares Framework for Event Camera and Odometry Calibration under Ground Motion Constraints cs.RO | cs.CVPDF
Guangyu Li, Xiao Li, Yujie Wu, Changshuo Wang, Prayag Tiwari
TL;DR: 本文提出了一种名为PLS-Calib的新型旋转标定框架，用于解决地面约束机器人因运动受限而难以进行传感器外参标定的问题。该框架首次利用偏最小二乘回归来建模异步、异构传感器流之间的潜在运动学相关性，特别针对事件相机和里程计进行标定。
Details
Motivation: 现有标定技术通常依赖完整的6自由度运动来激发所有自由度，这对于运动能力有限的地面约束机器人往往不可行。而最近为这种受限场景设计的基于典型相关分析的方法，存在协方差矩阵病态导致数值不稳定和标定精度不佳的问题。
Result: 在合成和真实数据集上的大量实验验证了该方法的有效性，在校准鲁棒性和准确性方面相比最先进方法有显著提升。
Insight: 创新点在于首次将偏最小二乘回归应用于传感器标定，提供了一个闭式、稳定的解，避免了基于CCA方法的矩阵奇异性问题。同时，引入的极性感知事件表示增强了圆形标定目标中的时空对比度，改善了基于事件的模式检测。
Abstract: Accurate extrinsic rotation calibration between sensors is fundamental to the performance of robotic perception systems. However, most existing calibration techniques rely on full 6-DoF motion to excite all degrees of freedom, which is often infeasible for ground-constrained robots with limited motion capabilities. Recent approaches designed for such restricted settings, such as Canonical Correlation Analysis (CCA)-based methods, suffer from ill-conditioned covariance matrices that lead to numerical instability and suboptimal calibration accuracy. To overcome these limitations, we present a novel rotation calibration framework named PLS-Calib that, for the first time, leverages Partial Least Squares (PLS) regression to model the latent kinematic correlations between asynchronous, heterogeneous sensor streams. Specifically, we apply our method to the calibration of an event camera and an odometry onboard a ground robot. To improve event-based pattern detection, we introduce a polarity-aware event representation, which enhances spatiotemporal contrast in circular calibration targets. Our PLS-based formulation yields a closed-form, stable solution that avoids matrix singularities inherent in CCA-based approaches. Extensive experiments on both synthetic and real-world datasets validate the effectiveness of our approach, demonstrating significant improvements in calibration robustness and accuracy over state-of-the-art methods. This work offers a practical and theoretically grounded solution for rotation calibration in constrained robotic systems and opens up new directions for applying statistical learning techniques in neuromorphic vision.
[132] A Low-Cost Hybrid Reservoir Computing Model for Isolated Sign Language Video Recognition cs.RO | cs.AI | cs.CVPDF
Nitin Kumar Singh, Arie Rachmad Syulistyo, Yuichiro Tanaka, Hakaru Tamukoh
TL;DR: 本文提出了一种用于孤立手语视频识别的低成本混合储层计算模型。该方法使用MediaPipe提取身体和手部关键点以捕捉手势的时空动态，然后通过结合深度储层计算和双向储层计算的混合储层计算架构进行处理，最后使用岭回归进行分类。
Details
Motivation: 深度学习在手语识别中性能优异但计算成本高，难以部署在边缘设备上。本文旨在开发一种轻量级、低成本的替代方案。
Result: 在WLASL100视频数据集上，该方法取得了Top-1、Top-5和Top-10准确率分别为61.12%、86.05%和92.56%的竞争性性能，并且训练时间相比基于深度学习的方法（如Bi-GRU）大幅减少至仅几秒。
Insight: 创新点在于将储层计算引入手语识别任务，并设计了混合储层计算架构来高效处理时空序列。其轻量级特性为在边缘设备上部署实时手语识别系统提供了可能。
Abstract: Sign language recognition (SLR) enhances communication between hearing and hearing-impaired individuals. Although deep learning (DL) has achieved promising performance in SLR, its high computational cost limits deployment on edge devices. To address this challenge, we propose a lightweight reservoir computing (RC)-based approach for SLR. In the proposed method, MediaPipe extracts body and hand keypoints to capture the spatial and temporal dynamics of gestures. These keypoints are then processed by a hybrid reservoir computing (HRC) architecture that combines deep reservoir computing (DRC) and bidirectional reservoir computing (BRC), transforming the input into a high-dimensional dynamic representation. A ridge regression model maps the final HRC state to class labels. This HRC-based SLR method achieved Top-1, Top-5, and Top-10 accuracies of 61.12%, 86.05%, and 92.56%, respectively, on the Word-Level American Sign Language 100 (WLASL100) video dataset, demonstrating competitive performance compared to deep learning-based approaches. Additionally, due to the lightweight nature of RC, the training time was drastically reduced to only a few seconds compared with DL-based methods such as Bi-GRU.This method offers low computational cost, showing its potential for deployment on edge devices.
[133] Continue or Replan? Bernoulli-Continuation Policy Learning for Adaptive Horizon Execution cs.RO | cs.AI | cs.CV | cs.LGPDF
Weichen Xu, Zhenhua Liu, Lin Luo, Yaobo Liang, Chengtang Yao
TL;DR: 本文提出了一种名为伯努利延续策略（BCP）的轻量级即插即用框架，用于解决基于分块的视觉-语言-动作（VLA）模型中固定执行视野导致的规划僵化问题。BCP通过一个延续头将执行视野选择分解为一系列“继续或重新规划”的决策序列，并使用强化学习进行训练，以实现自适应的执行视野调整，从而提升任务成功率与模型使用效率。
Details
Motivation: 现有基于分块的VLA模型在执行固定数量的动作后才重新规划，这种与任务进度无关的周期性重新规划机制，可能导致关键操作阶段无法获得新鲜规划，从而影响任务表现。本文旨在解决这种固定执行视野带来的局限性。
Result: 在RoboTwin 2.0基准测试中，以LingBot-VLA为基础策略，BCP在13个低成功率任务上平均成功率提升+11.08%，在所有50个任务上从89.88%提升至93.94%（+4.06%）。BCP展现出良好的泛化与迁移能力，在随机化设置下平均成功率提升+4.06%，并迁移至不同基础策略π_{0.5}，在LIBERO和更难的LIBERO-PRO基准上分别提升+1.7%和+6.8%。在真实机器人上，两个操作任务的成功率分别从74%提升至92%和从44%提升至84%。
Insight: 主要创新点在于将执行视野选择建模为序列化的“继续或重新规划”决策问题，并引入了“重新规划效率奖励”这一强化学习目标，联合优化任务成功与VLA使用效率，避免了策略坍缩到不必要的短视野。该方法是一种轻量级、冻结基础VLA的即插即用框架，具有低开销和良好的泛化迁移能力。
Abstract: Existing chunk-based Vision-Language-Action (VLA) models execute a fixed number of actions (i.e., execution horizon) before replanning, turning replanning into a task-agnostic periodic schedule that is independent of task progress. As a result, when no replanning boundary falls before a critical manipulation stage, it is executed from a stale chunk rather than a freshly replanned one. To address this limitation, we propose Bernoulli-Continuation Policy (BCP), a lightweight, plug-and-play framework for adaptive horizon execution that keeps the base VLA frozen. Given a fixed-length action chunk, its continuation head decomposes execution-horizon selection into a sequence of continue-or-replan decisions, which imposes an ordinal, prefix-sharing inductive bias over candidate horizons rather than treating them as independent classes. Since the optimal horizon for each chunk is not observable, we train this head with reinforcement learning from trajectory-level outcomes and introduce a Replanning-Efficiency Reward that jointly rewards task success and efficient VLA usage, discouraging the policy from collapsing to unnecessarily short horizons. On RoboTwin 2.0 with LingBot-VLA as the base policy, BCP improves the average success rate by +11.08% on 13 low-success tasks and from 89.88% to 93.94% (+4.06%) across all 50 tasks. Although trained only under the Clean setting, BCP generalizes to the Randomized setting, raising the average success rate by +4.06%. It also transfers to a different base policy $π_{0.5}$, achieving a better result on LIBERO (+1.7%) and, notably, on the harder LIBERO-PRO (+6.8%). On a real robot, BCP lifts success from 74% to 92% and from 44% to 84% on two manipulation tasks. Meanwhile, its negligible overhead, combined with higher success, makes BCP’s overall runtime even lower than the fixed-horizon baselines.
cs.DB [Back]
[134] Evaluating LLMs in Database Scenarios: A Lifecycle Benchmark for Assessing Their Potential in Core Database Tasks cs.DB | cs.AI | cs.CLPDF
Shunfan Zheng, Dongsheng Shi, Yue Li, Xin Yi, Linlin Wang
TL;DR: 本文提出了DBLifeBench，首个评估大型语言模型在数据库全生命周期（设计、实现、操作、调试、维护）中能力的基准测试。针对自然语言与SQL逻辑的认知鸿沟，论文还提出了利用结构化推理图模拟人类迭代问题解决的新任务Progressive-Text2SQL。评估发现，通用模型表现均衡，而专用Text-to-SQL模型在非编码阶段（如设计和维护）存在灾难性遗忘问题。
Details
Motivation: 当前评估基准过度集中于Text-to-SQL任务，忽略了从模式设计到部署后维护的完整数据库生命周期，无法反映现实世界数据库管理所需的多样化能力，因此需要构建一个更全面的评估框架。
Result: 在提出的DBLifeBench上进行的广泛评估表明，通用模型在五个生命周期阶段表现均衡，而专门的Text-to-SQL模型在设计和维护等非编码阶段出现灾难性遗忘，性能显著下降。
Insight: 论文的主要创新点在于构建了首个覆盖数据库全生命周期的评估基准DBLifeBench，并提出了Progressive-Text2SQL任务以结构化方式弥合自然语言与SQL逻辑的差距。客观来看，其将评估范围从单一任务扩展到完整工作流，并揭示了模型能力在专业与通用之间的权衡，对构建全栈数据库智能具有基础性意义。
Abstract: Large Language Models (LLMs) are transforming database interaction paradigms, evolving from simple query translators to autonomous database administrators (DBAs). However, current evaluation benchmarks remain disproportionately fixated on Text-to-SQL tasks, neglecting the holistic Database Lifecycle-from initial schema design to post-deployment maintenance. This narrow focus fails to capture the diverse capabilities required for real-world database management. To bridge this gap, we introduce DBLifeBench, the first benchmark to evaluate LLMs across five critical lifecycle phases: Design, Implementation, Operation, Debugging, and Maintenance. Furthermore, addressing the cognitive mismatch between ambiguous natural language and complex SQL logic, we propose Progressive-Text2SQL, a novel task utilizing structured reasoning graphs to mimic human iterative problem-solving. Our extensive evaluation reveals a critical insight: while general-purpose models demonstrate balanced performance, specialized Text-to-SQL models suffer from ``catastrophic forgetting’’ in non-coding phases like design and maintenance. DBLifeBench serves as a foundational step toward evaluating and building true full-stack database intelligence.