cs.CL [Total: 48]
cs.CV [Total: 185]
cs.AI [Total: 14]
cs.IR [Total: 2]
cs.MM [Total: 1]
cs.GR [Total: 1]
cs.LG [Total: 10]
cs.SE [Total: 1]
eess.IV [Total: 2]
cs.RO [Total: 9]
cs.CR [Total: 2]

cs.CL [Back]

[1] RubricReviewer: From Direct Critique to Objective and Comprehensive Rubric-Driven Peer Review cs.CL | cs.AIPDF

Shuyu Guo, Wenxiang Hu, Yuyue Zhao, Yougang Lyu, Xiaohui Yan

TL;DR: 本文提出了RubricReviewer，一个完全由评分标准驱动的框架，用于改进基于大语言模型的同行评审系统。该框架将评分标准生成作为明确的中间步骤，并融合了无训练代理（Scout）收集外部证据和经过人类对齐训练的模型（Aligner）利用证据的优势，以生成更全面、更具判别力的评审。

Details

Motivation: 现有基于LLM的评审系统存在两个结构性局限：一是直接将稿件映射到评审，隐含了评分标准；二是现有范式各自只捕捉了高质量评审的一半特性（无训练代理收集证据但缺乏方向性，有训练模型继承人类判别力但带有噪声和覆盖不均）。

Result: 在真实世界提交的实验中，RubricReviewer生成的评审在全面性和判别力上显著优于现有系统，并且对对抗性提示注入攻击表现出最强的鲁棒性。消融研究进一步证实了每个组件的必要性。

Insight: 创新点在于将评分标准生成作为显式的中间步骤，使评审生成和最终评估都基于论文自适应的评分标准，并创造性地结合了无训练证据收集代理和人类对齐训练模型，融合了两种监督源的优势，提升了评审的客观性和全面性。

Abstract: Peer review at major venues is under unprecedented submission pressure, motivating the use of large language models (LLMs) as review assistants. Existing LLM-based reviewers, however, face two structural limitations. First, they map manuscripts directly to reviews, leaving the underlying rubric implicit and entangling its derivation with the judgement. Second, the prevailing paradigms each capture only half of a good review: training-free agents gather broad evidence but produce undirected critiques, while training-based reviewers inherit human discriminative judgement together with its noise and uneven coverage. We introduce RubricReviewer, a fully rubric-driven framework that addresses both limitations. It makes rubric generation an explicit intermediate step, so that both review generation and the final assessment are conditioned on paper-adaptive rubrics. It further combines a training-free agent (Scout) that gathers external evidence with a human-aligned trained model (Aligner) that consumes this evidence, fusing the strengths of both supervision sources. Experiments on real-world submissions show that RubricReviewer produces reviews that are markedly more comprehensive and more discriminative than prior systems, and exhibits the strongest robustness against adversarial prompt-injection attacks. Ablation studies further confirm the necessity of each component.

[2] Cost-Effective Automated Judging of Natural-Language Mathematical Proofs cs.CL | cs.AI | cs.LGPDF

Benjamin Grayzel

TL;DR: 本文研究了使用低成本开源模型自动评估自然语言数学证明的可行性，发现GPT-OSS 120B、DeepSeek-V4 Flash和Gemma-4 31B等模型在IMO-GradingBench验证集上的判断与人类评分者的一致性，与昂贵的Claude Opus和Gemini Pro等前沿模型相当，但成本降低高达100倍。

Details

Motivation: 评估数学推理系统时，对自然语言证明进行人工评分成本高昂，而前沿大语言模型作为评判者同样昂贵，因此研究低成本开源模型能否成为可靠的自动评分者。

Result: 在IMO-GradingBench的200个验证样本上，三个低成本模型与人类通过/失败决策的一致率，在统计上与Claude Opus 4.7和Gemini 3.1 Pro无差异；在1000个样本的完整基准测试中，要求三个模型一致通过的规则（all-three-pass）达到了最高的通过一致性和精确度。

Insight: 主要创新点在于实证证明了低成本模型在数学证明自动评分任务上可以与前沿模型竞争，且成本低1-2个数量级；方法上提出了使用三个模型一致通过的共识规则作为可部署的默认方案，该规则在后续测试中表现出高稳定性和精确度。

Abstract: Grading natural-language mathematical proofs is a recurring cost in evaluating math-reasoning systems, and frontier LLM judges are expensive. We ask whether cheap open-weight models can serve as reliable judges given a candidate proof, a ground-truth proof, and a human-grading rubric. On a 200-instance validation sample of IMO-GradingBench, three cheap judges (GPT-OSS 120B, DeepSeek-V4 Flash, Gemma-4 31B) agree with human pass/fail decisions at rates statistically indistinguishable from Claude Opus 4.7 and Gemini 3.1 Pro, at up to $100\times$ lower cost. We had expected a majority vote of the three to be the best budget option; it matched the frontier but did not improve on its strongest member. Extending to the full 1000-instance benchmark and exploring consensus rules, we found that requiring unanimous agreement (all-three-pass) reaches the highest pass-agreement and precision and, on four replicate runs, the smallest run-to-run spread. The headline finding is that cheap judges are competitive with the frontier at one to two orders of magnitude lower cost; as a deployable default we recommend all-three-pass, with the caveat that this rule was identified post-hoc and warrants independent replication.

[3] Obshazard-bench: Benchmarking Multimodal Foundation Models for Real-Time Disaster Intelligence from Raw Earth Observation Streams cs.CL | cs.AI | cs.CY | cs.LGPDF

Fengxiang Wang, Qiuyang Yu, Yueying Li, Mingshuo Chen, Chengchi Fei

TL;DR: 本文介绍了Obshazard-bench，一个用于评估多模态大语言模型在实时灾害情报处理能力的基准测试。该基准直接整合原始高频卫星观测数据流、地面站观测、历史灾害记录和社会经济指标，覆盖8大类28子类灾害，包含超过120个历史极端事件案例和数千个面向生命周期的视觉问答样本。它定义了一个与灾害应急工作流对齐的三阶段评估分类法，实验揭示了现有基础模型在将原始多通道物理观测转化为基于时间的、与决策相关的灾害推理方面存在显著局限。

Details

Motivation: 现有遥感基准主要依赖静态、事后、专家处理的产品，难以与灾害快速演变、决策时间紧迫的实际操作场景对齐，因此需要一个新的基准来评估MLLM在真实世界灾害应急响应中的能力。

Result: 在代表性的通用和地球科学专用基础模型上的实验表明，它们在将原始多通道物理观测转化为基于时间的、与决策相关的灾害推理方面存在实质性局限。

Insight: 创新点在于构建了一个直接集成原始卫星数据流、绕过延迟专家处理流程的实时观测驱动基准，并定义了与灾害操作工作流（预测、跟踪、评估）严格对齐的三阶段评估分类法，为评估模型在动态灾害场景下的实际效用提供了新框架。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly used to interpret Earth observation data, yet their capability to support real-world disaster emergency response remains insufficiently evaluated. Existing remote sensing benchmarks largely rely on static, post-hoc, and expert-processed products, such as gridded reanalysis data, which are difficult to align with operational disaster scenarios where hazards evolve rapidly and decisions must be made under strict time constraints. To bridge this gap, we introduce Obshazard-bench, a real-time, observation-driven benchmark for evaluating disaster intelligence in MLLMs. Unlike image-centric or post-event benchmarks, Obshazard-bench directly integrates raw, high-frequency satellite sounding streams from diverse satellite sensors with concurrent ground-station observations, historical disaster records, and socio-economic indicators, bypassing delayed expert-processing and physical-inversion pipelines. The benchmark covers 8 major disaster categories and 28 sub-categories across more than 60 countries, incorporating over 120 historically documented extreme-event cases and thousands of lifecycle-oriented VQA samples. Moreover, Obshazard-bench further defines a three-stage evaluation taxonomy aligned with the operational disaster workflow: Predictive Crisis Anticipation for pre-disaster risk detection and early forecasting, Active Evolution Reasoning for in-situ disaster tracking and termination prediction, and Multi-faceted Impact Quantification for post-disaster magnitude deduction, humanitarian burden estimation, and socio-economic impact assessment. Experiments on representative general-purpose and Earth-focused foundation models reveal substantial limitations in transforming raw multi-channel physical observations into temporally grounded and decision-relevant disaster reasoning.

[4] SLMs as Multi-Agent Routers: A Progressive SFT and Reinforcement Learning Approach cs.CL | cs.AIPDF

Gayathri V Kondapalli, Alexander Ng, Hirsh Pithadia, Rahul Monish, Harvey Yorke

TL;DR: 该论文提出了一种使用小型语言模型作为多智能体路由器的框架，通过监督微调和强化学习联合优化智能体选择和结构化参数生成。该方法利用基于检索相关性和查询-智能体主题对齐的分层奖励函数，使模型能够从检索性能中学习任务相关的智能体适用性。

Details

Motivation: 解决当前基于主题或意图的查询路由方法的根本局限，即无法结合检索内容的信号，也无法检测到主题对齐的智能体产生低相关性结果的情况。

Result: 在目标智能体-查询不匹配子集上，训练模型NDCG@10达到0.918，显著优于仅基于意图路由的两个LLM基线（Amazon Nova Lite的0.539和Claude Haiku 4.5的0.490）。整体平均NDCG@10为0.771，平均选择延迟为120.1ms，比Nova Lite降低了82.4%。

Insight: 创新点在于将智能体选择和参数生成联合建模，并引入基于检索性能的强化学习奖励机制，使路由决策能够动态适应实际检索质量，而不仅仅是静态的主题对齐。

Abstract: Specialised retrieval agents typically surface higher quality results than general-purpose search, but selecting the optimal agent for a given query remains an open problem. Current approaches route queries based on inferred topic or intent, however intent-based selection is fundamentally limited: it does not incorporate signal from retrieved content, and cannot detect when a topically aligned agent produces low-relevance results. We address this by training a small language model via supervised fine-tuning followed by reinforcement learning to jointly perform agent selection and structured parameter generation for downstream tool calls, using a hierarchical reward function grounded in retrieval relevance along with query-agent topic alignment. This enables the model to learn task-dependent agent suitability from retrieval performance: which agents reliably yield high-relevance results for which query distributions, and when to redirect queries away from specialised agents despite surface-level topical overlap. On a targeted subset of such agent-query mismatches, the trained model achieves an NDCG@10 of 0.918 compared to 0.539 and 0.490 for two LLM baselines (Amazon Nova Lite and Claude Haiku 4.5) that route on intent alone. Overall, it achieves a mean NDCG@10 of 0.771 (+0.177 over Nova Lite, +0.219 over Haiku) with a mean selection latency of 120.1ms, an 82.4% reduction over Nova Lite.

[5] What Transfers from Text to Vision? Capability Scaling Laws and Transfer Dynamics for VLMs cs.CL | cs.AI | cs.CVPDF

Ziran Li, Qiang Wang, Zhengyu Chen, Shanglin Lei, Borun Chen

TL;DR: 本文提出了能力驱动的多模态缩放定律（CDMSL），这是首个跨模型家族的框架，通过直接观测的文本能力来预测视觉语言模型（VLM）的基准性能。该框架基于从LLM文本基准中提取的低维能力分数S，将VLM性能建模为S的函数，并引入每个骨干网络的转移率和吸收率来量化数据缩放效率。通过在严格控制的训练方案下对34个LLM（涵盖7个模型家族）训练超过150个VLM，并在超过200个文本和50个多模态基准上进行评估，验证了该定律的准确性。

Details

Motivation: 当前构建视觉语言模型时，选择合适的大型语言模型骨干网络是一个关键但缺乏原则性指导的决策，因为基于计算资源的缩放定律无法跨模型家族泛化，且缺乏在训练前直接预测VLM性能的框架。

Result: 该缩放定律能够准确地将参数规模从8B到72B的骨干网络的转移率进行外推，高保真地预测完整的VLM训练轨迹，并能泛化到完全未见过的模型家族。分析还发现，某些文本基准与多模态性能呈负相关，揭示了潜在的基准博弈行为。

Insight: 创新点在于提出了首个跨模型家族的、基于可观测文本能力的VLM性能预测框架，将骨干网络选择从昂贵的经验性搜索转变为原则性的量化决策。客观分析认为，其核心洞察包括：识别出文本基准与多模态性能的负相关性；发现基础LLM作为VLM骨干优于指令调优版本，因其具有更高的吸收率和更低的数据缩放衰减；以及不同模型家族在转移-吸收空间中占据不同位置。

Abstract: Choosing the right large language model (LLM) backbone is the most consequential decision when building a vision-language model (VLM), yet it remains fundamentally unprincipled: compute-based scaling laws fail to generalize across model families, and no framework exists for directly predicting VLM performance before training begins. We propose the Capability-Driven Multimodal Scaling Law, the first cross-family framework that predicts VLM benchmark accuracy from directly observable textual capability. Given a low-dimensional capability score $S$ extracted from LLM textual benchmarks via PCA, we model VLM performance as a function of $S$, with a per-backbone transfer rate and an absorption rate that quantifies data-scaling efficiency. To fit and validate the framework, we train over 150 VLMs on 34 LLMs spanning 7 model families under a strictly controlled recipe. Evaluations on more than 200 textual and 50 multimodal benchmarks show that the law accurately extrapolates transfer rate from models up to 8B parameters to 72B-scale backbones, predicts full VLM training trajectories with high fidelity, and generalizes to entirely held-out model families. Beyond the scaling law, our analysis surfaces actionable insights: certain textual benchmarks negatively correlate with multimodal performance, exposing latent benchmark-gaming behavior; base LLMs outperform instruction-tuned counterparts as VLM backbones due to higher absorption rates and lower data-scaling decay; and different model families occupy distinct positions in the transfer–absorption space. The framework turns backbone selection from costly empirical sweeps into a principled, quantitative decision. Code and data are available at https://github.com/wangq-dev/CDMScaling.

[6] Exploring More to Solve More: Boosting Diversity in Text Diffusion Models via Entropy-Based Guidance cs.CL | cs.AIPDF

Jingwei Zhang, Haoyu Lei, Zijin Feng, Jiacheng Sun, Farzan Farnia

TL;DR: 本文提出了一种无需训练、基于熵的语义感知核熵（SAKE）引导方法，用于提升文本扩散模型的生成多样性。该方法通过计算捕捉跨令牌语义交互和相对位置信息的核Gram矩阵的二阶Rényi熵，并在嵌入空间线性化目标，从而动态调整采样分布。实验表明，该方法在保真度与多样性之间实现了更优的帕累托前沿，并在代码和数学生成等推理密集型任务上提升了多样本性能。

Details

Motivation: 当前文本扩散模型的采样策略和引导方法在调整令牌似然时未能捕捉更广泛的语义景观，导致保真度与多样性之间的平衡不佳，本文旨在解决这一问题。

Result: 在代码和数学生成等推理密集型任务上，该方法相比温度缩放和离散引导基线，实现了更优的帕累托前沿，并提升了多样本性能。

Insight: 创新点在于引入基于核Gram矩阵的二阶Rényi熵作为引导信号，动态调整采样分布以平衡探索与保真，这是一种无需训练、语义感知的引导方法。

Abstract: Although diffusion models have revolutionized continuous domains like image synthesis through high quality generations and controllable guidance mechanisms, bringing this controllability to the discrete, sequential nature of text remains an open challenge. Meanwhile, current sampling strategies and guidance methods adjust token likelihoods without capturing the broader semantic landscape, leading to a suboptimal balance between fidelity and diversity. In this work, we introduce a novel training-free Semantic-Aware Kernel Entropy (SAKE) guidance method. Our method computes the order-2 Rényi entropy over a kernel Gram matrix that captures both cross-token semantic interactions and relative token positions. By linearizing this objective in the embedding space, we derive a tractable guidance signal that dynamically adjusts the sampling distribution, flattening it to encourage exploration during redundancy and sharpening it for fidelity when diverse. Empirical experiments demonstrate that our approach achieves a superior Pareto frontier between fidelity and diversity, and improves multi-sample performance on reasoning-intensive tasks, such as code and mathematics generation, compared to temperature scaling and discrete guidance baselines.

[7] XL-DocBench: Benchmarking Evidence-Grounded Extra-Long Document Understanding cs.CL | cs.AIPDF

Hongchen Wei, Yuanzhe Wang, Bei Liu, Yifan Yang, Qi Dai

TL;DR: 本文介绍了XL-DocBench，一个用于评估超长文档理解能力的基准测试集。该基准包含来自六个专业领域的1519个人工验证问题，上下文长度可达2303页，强调基于多页证据、多文档、图表和结构化推理的问答。

Details

Motivation: 现实世界中的文档任务（如合规、临床、金融和工程领域）需要处理长达数百或数千页的文档，并要求答案可追溯到具体证据页，现有基准大多只关注短上下文或单页问答，无法满足需求。

Result: 基准测试结果表明，当前系统在处理长上下文、多页证据以及专业文档的结构化推理方面仍然存在困难。

Insight: 创新点在于构建了一个结合超长专业上下文、页面级证据标注和类型化验证规则的全人工验证基准，能够将系统失败归因于检索、证据使用或规则遵循等具体环节，而非单一的排行榜分数。

Abstract: Real-world document tasks often ask professionals to answer questions from annual reports, regulations, clinical guidelines, and technical manuals that span hundreds or thousands of pages. Some questions also require comparing related reports. Reliable long-document understanding is therefore a prerequisite for using LLMs in compliance, clinical, financial, and engineering workflows, where decisions must be traceable to specific evidence pages and the cost of an unsupported answer is high – yet most existing benchmarks still measure short-context or single-page QA. We introduce XL-DocBench, a fully human-verified benchmark for extra-long document understanding, with 1,519 retained questions from six professional domains and contexts up to 2,303 pages. XL-DocBench goes beyond page-level lookup. 1,103 examples (72.6%) use multiple evidence pages. The final set also includes 556 questions (36.6%) that use tables, charts, or figures, and 165 questions (10.9%) that require evidence from multiple documents. Each question has one of twelve reasoning labels, expert-annotated evidence pages, a typed verification rule, and an answer format, including 218 None-answer cases. We build the benchmark with a tree-guided synthesis pipeline followed by artifact filters and full verification by 194 human experts. By coupling extra-long professional contexts with page-level evidence and typed rules, XL-DocBench fills a gap left by prior single-page, short multi-page, or text-only long-context benchmarks, and lets future work attribute system failures to retrieval, evidence use, or rule following rather than to a single leaderboard score. The results show that current systems still struggle with long contexts, multi-page evidence, and structured reasoning over professional documents.

[8] DiffusionGemma Technical Report cs.CL | cs.AIPDF

DiffusionGemma Team, Adrien Ali Taïga, James Assiene, Daniele Calandriello, Rahma Chaabouni

TL;DR: DiffusionGemma 是一个基于离散扩散的开放权重语言模型，通过并行迭代优化256个token块来实现高速文本生成。它通过对Gemma 4混合专家模型（激活参数3.8B，总参数25.2B）进行两阶段微调得到，训练计算成本低。该模型在单块H100 GPU上每秒可生成约1500个token，在生成速度与模型能力之间建立了新的帕累托前沿。

Details

Motivation: 解决传统自回归大语言模型顺序解码导致的生成速度瓶颈，旨在通过并行扩散机制实现更高效的文本生成。

Result: 在完整评估套件中，平均每次前向传播生成约20个token，在单块NVIDIA H100 GPU上达到约1500 token/秒的生成速度，显著快于采用最先进推测解码的自回归模型。

Insight: 创新点在于采用离散扩散并行生成机制替代顺序解码，并通过两阶段微调（监督微调与强化学习结合采样器蒸馏）实现高效训练；模型保留了原始模型的思维模式、多模态输入和长上下文支持，并展示了混合扩散-自回归解码的潜力。

Abstract: We introduce DiffusionGemma, an experimental open-weight language model that uses discrete diffusion to generate text at exceptionally high speed. Rather than decoding one token at a time, DiffusionGemma iteratively refines blocks of 256 tokens in parallel, avoiding the sequential decoding bottleneck of conventional autoregressive (AR) large language models. Instead of training from scratch, we obtain DiffusionGemma by fine-tuning the mixture-of-experts Gemma 4 model with 3.8B activated and 25.2B total parameters. Our compute-efficient two-stage training pipeline uses fewer than 10% of the starting AR model’s total training token budget. The first stage uses supervised fine-tuning to teach bidirectional denoising, while the second stage combines reinforcement learning with sampler distillation to jointly improve generation quality and inference efficiency. DiffusionGemma establishes a new Pareto frontier for the trade-off between generation speed and model capability. Averaged across our full evaluation suite, it generates around 20 tokens per forward pass and achieves roughly 1,500 output tokens per second on a single NVIDIA H100 GPU, which is substantially faster than AR models even with state-of-the-art speculative decoding. DiffusionGemma also retains the starting model’s support for thinking mode, multimodal inputs, and long contexts. Despite diffusion fine-tuning, it remains capable of AR generation with only minor performance degradation, suggesting a path toward hybrid diffusion-AR decoding.

[9] Cross-Task Dissociation in Frontier Vision-Language Model Theory of Mind cs.CL | cs.AI | cs.CV | cs.MA | q-bio.NCPDF

Kejia Zhang, Youran Sun, Chugang Yi, Haizhao Yang

TL;DR: 本文评估了九种前沿视觉语言模型在两项心理学基准任务上的心智理论表现：Keysar导演任务（视觉视角采择）和Frith-Happé动画三角形任务（意图归因）。研究发现，模型群体在两项任务上均未表现出与典型发展成人一致的心智理论剖面，而是呈现出跨任务分离现象。

Details

Motivation: 探究前沿视觉语言模型是否能在不同心智理论任务上呈现一致且与人类参考群体匹配的认知剖面，还是其表现会因任务范式不同而碎片化。

Result: 在导演任务中，模型组在78%的试次中犯自我中心错误，表现更接近儿童而非成人；在三角形任务中，模型组对意图的归因不足，其心智理论剖面更接近高功能自闭症成人均值，而非典型发展成人均值。没有模型在两项任务上均最接近典型发展成人。

Insight: 揭示了当前前沿视觉语言模型的心智理论能力存在跨任务不一致性，其表现可能在某些任务上接近儿童，在另一些任务上接近特定临床群体，而非形成统一的成人水平认知剖面。这挑战了模型具备连贯心智理论的假设。

Abstract: Do frontier vision-language models present a coherent Theory-of-Mind (ToM) profile across tasks, matching the same human reference group, or does that profile fragment from one paradigm to the next? We evaluate a shared panel of nine frontier VLMs on two psychology-derived benchmarks: the Keysar Director Task (visual perspective-taking under egocentric interference) and the Frith-Happé animated triangles scored with the Castelli rubric (intention attribution from pure motion). On the Director Task, without chain-of-thought, the panel makes the egocentric error on 78% of trials like children rather than adults; variation is substantial across models, and reasoning rescues several models. On the triangles, the panel under-attributes intention: its ToM profile sits more than three times closer to the high-functioning-autistic-adult (HF-ASD) mean than to the typical-development-adult (TD) mean, while Goal-Directed and Random stay near TD. No model is nearest TD on both tasks; the model that looks adult-like on the Director Task falls on the HF-ASD side on the triangles, and the most TD-like model on the triangles is child-like on the Director Task. We report group-level descriptions, not diagnostic labels for any model.

[10] SeDeM: Selective Decompression of Hidden-State Memories for Long-Context Question Answering cs.CLPDF

Maryam Haghifam, Jason Cong, Yizhou Sun

TL;DR: 本文提出SeDeM框架，通过选择性解耦压缩记忆存储与解码器条件化，以降低长上下文推理成本。该方法使用轻量级压缩器存储中间层隐藏状态，基于查询选择相关记忆块并仅解压这些块，从而避免全上下文处理。在四个长上下文QA基准测试中，SeDeM在1B和3B骨干模型上均优于现有压缩基线，并在3B设置下超越全上下文微调，同时提升了推理效率。

Details

Motivation: 解决长上下文推理中LLM计算成本高（注意力二次缩放、KV缓存增长）且上下文窗口增大不一定保证可靠证据利用的问题，同时克服现有软压缩方法依赖紧凑记忆令牌进行信息保存和解码器条件化的局限性。

Result: 在四个长上下文QA基准测试（具体数据集未命名）上，SeDeM在1B和3B同骨干模型设置下均取得比基线压缩方法更高的QA分数；使用3B骨干时在三个数据集上超越了全上下文微调结果；同时减少了首令牌生成时间并提升了自回归解码吞吐量（相比ICAE基线）。

Insight: 创新点在于将紧凑记忆存储与解码器条件化解耦，通过查询条件化选择器实现选择性解压，使解码器无需处理全上下文或直接从高压缩记忆槽生成；训练中使用块级证据监督学习选择器，兼顾了效率与准确性。

Abstract: Long-context inference with large language models (LLMs) is costly: self-attention during prefill scales quadratically with sequence length, and the key-value (KV) cache grows with the number of processed tokens. Larger context windows also do not ensure reliable evidence use. Context compression reduces this cost, but many soft-compression methods use LLMs as compressors and rely on compact memory tokens both to preserve information and to condition the decoder. We propose SeDeM, a selective decompression framework that decouples compact memory storage from decoder conditioning. An LLM extracts hidden states from a chosen intermediate Transformer layer, a lightweight compressor stores them as memory blocks, a query-conditioned selector selects relevant blocks, and a decompressor expands only the selected blocks into hidden states compatible with an intermediate decoder layer. Thus, the decoder avoids both full-context processing and direct generation from highly compressed memory slots. On four long-context QA benchmarks, SeDeM achieves higher QA scores than the evaluated compression baselines in both 1B and 3B same-backbone settings, and with the 3B backbone exceeds full-context fine-tuning on three datasets. The learned selector uses block-level evidence supervision during training. SeDeM also reduces online time-to-first-token and improves autoregressive decoding throughput relative to ICAE.

[11] CurveShift: Is Agent Progress Scalar? Separating Level from Shape cs.CL | cs.LGPDF

Hanwen Xing, Pengyun Wang, BingXu Meng, Kumail Alhamoud, Xiang Li

TL;DR: 论文指出，大语言模型的进展通常用单一标量（如时间跨度、潜在能力估计或聚合基准分数）来总结，但这无法捕捉任务难度上的分布差异。研究发现，大部分向困难任务转移的增益并非源于难度-响应曲线的形状变化，而是由天花板效应解释。通过LiveCodeBench基准，论文识别出一个较小的、特定于竞争性编程的硬任务效应，即2024年9月后发布的模型在解决最难题时表现出超出预期的增益。

Details

Motivation: 解决当前大语言模型进展评估中过度依赖单一标量指标的问题，该指标无法区分整体能力提升与不同难度任务上的能力分布变化，旨在探究模型进展是否在任务难度上存在异质性分布。

Result: 在METR时间跨度数据上，单一Rasch模型结合上升的能力参数即可复现向困难任务转移的模式，表明主要由天花板效应驱动。在LiveCodeBench竞争性编程基准上，控制整体能力提升后，2024年9月后发布的模型在最难题上仍有约+0.40 logits的额外增益，将解决率从约18%提升至25%，该效应由最强推理模型主导。

Insight: 创新点在于提出将模型进展的’水平’（整体能力）与’形状’（难度分布）分离的分析框架，并利用LiveCodeBench基准（无智能体支架且包含外生难度排序）打破了模型与支架的混淆，从而识别出特定于竞争性编程的硬任务效应，强调了评估指标选择对’涌现能力’解释的影响。

Abstract: Progress in large language models is often summarized using a single scalar measure, such as a time horizon, a latent ability estimate, or an aggregate benchmark score. These summaries capture the overall performance, but they do not test whether progress is distributed differently across task difficulty. We find that most of the apparent shift in gains toward harder tasks does not reflect a change in the shape of the difficulty-response curve. On METR time-horizon data, a single Rasch model with rising ability reproduces this pattern, so it is largely explained by ceiling effects rather than a qualitative change in capability. This echoes how the choice of metric can make claimed emergent abilities look like a property of the models themselves. We then identify a smaller hard-task effect that survives this control. Isolating it is difficult on agentic benchmarks, because newer models are usually run with newer agentic harnesses, so a gain on hard tasks cannot be assigned to the model or its scaffold. We break the confound with LiveCodeBench, a public competitive programming benchmark that runs no agentic scaffold while pairing dated models with an exogenous difficulty ordering. After accounting for the rise in overall ability, models released after September 2024 still gain on the hardest problems beyond what their easy and medium performance predicts, by about +0.40 logits under our most conservative assumption, raising the hard-problem solve rate from roughly 18% to 25%. The effect is led by the strongest reasoning models and holds for hard tasks that need only short reasoning, not autonomy over long horizons. We present this as a result specific to competitive programming, since our clean identification rests on a single coding benchmark. We release the LiveCodeBench Difficulty Panel (66 dated models x 1,055 problems) and our analysis code.

Jiang Zhou, Zhiyuan Fan, Xing Wu, Tinghao Yu, Feng Zhang

TL;DR: 本文提出了一种名为深度研究预训练（DRP）的离线框架，用于训练深度研究智能体。该框架通过利用学术论文引用图和维基百科超链接等自然存在的证据结构，构建预测性导航监督信号，从而生成搜索-打开-写作轨迹，无需在线检索环境或策略执行。实验表明，在DeepResearch Bench等多个基准上，经过DRP预训练的模型在少量监督微调数据下能显著超越未经过DRP预训练的模型，且优势能迁移到其他任务并持续到后续的强化学习阶段。

Details

Motivation: 解决深度研究智能体训练依赖昂贵、环境交互式的工具使用轨迹（需要反复检索、文档检查和报告评估）的问题，旨在通过离线方式从现有证据结构中学习导航能力。

Result: 在DeepResearch Bench基准上，使用仅四分之一监督微调数据的DRP-Web变体超越了未使用DRP的完整数据检查点；在ResearchQA、WebWalkerQA和SimpleQA等任务上表现出增益迁移；且优势在后续的智能体强化学习中得以保持。

Insight: 创新点在于利用自然证据结构（如引用和超链接）构建预测性导航任务进行离线预训练，使模型学习证据驱动的导航（搜索什么、检查哪些文档、如何综合证据），而非单纯模仿智能体格式或增加领域暴露，为基于轨迹的智能体训练提供了有前景的补充方法。

Abstract: Deep research agents are often trained on expensive, environment-grounded tool-use trajectories that require repeated retrieval, document inspection, and report evaluation. We introduce Deep Research Pretraining (DRP), an offline framework that derives predictive navigation supervision from naturally occurring evidence structures. Given a citation-bearing or hyperlinked passage, DRP constructs a proxy research objective, recovers linked evidence and graph-related alternatives, and converts them into search-open-write trajectories. This teaches models what to search for, which documents to inspect, and how to synthesize evidence, without a live retrieval environment or executed policy rollout. We instantiate DRP on scholarly citation graphs (DRP-Paper) and Wikipedia hyperlinks (DRP-Web), continually pretrain separate Qwen3-14B-Base models on 1B tokens, and fine-tune them on controlled fractions of 13K agent trajectories. Across five independently sampled subsets at each low-data budget, both variants consistently outperform matched no-DRP models on DeepResearch Bench. With one quarter of the SFT data, DRP-Web even surpasses a fixed no-DRP full-data checkpoint, with gains transferring to ResearchQA, WebWalkerQA, and SimpleQA. Starting from matched low-data SFT checkpoints, the DRP-Web advantage also persists through subsequent agentic RL. Source-matched and evidence-mismatch controls indicate that these improvements arise from evidence-conditioned navigation rather than domain exposure or agent-format imitation. DRP thus provides a promising complementary approach to trajectory-based agent training.

[13] AdaMTP: An Adaptive Training Paradigm for Multi-Token Prediction cs.CL | cs.AIPDF

Ziqiang Cui, Han Shi, Bowei He, Yu Pan, Peiyang Liu

TL;DR: 本文提出了AdaMTP，一种用于多令牌预测（MTP）的自适应训练范式。它通过基于熵的分割算法动态检测序列中的语义边界，并根据序列的内在可预测性调整预测范围，从而抑制跨越边界预测带来的噪声梯度，提升模型性能。

Details

Motivation: 现有MTP训练框架采用固定的预测长度，忽视了自然语言和代码中信息密度的不均匀性。强制辅助头跨越高熵语义边界进行预测会注入噪声和冲突的训练信号，这些共享主干网络表示的梯度会干扰模型的核心能力。

Result: 在数学推理、代码生成和通用基准测试中，基于三个主干模型（Llama-3.1-8B, Qwen-2.5-7B, Gemma-3-12B），AdaMTP在任务性能和推理加速方面均持续优于标准MTP。

Insight: 核心创新在于将MTP的预测范围从固定长度变为自适应长度，通过检测语义边界（不确定性激增点）来动态分组序列，并使用动态掩码MTP目标来抑制跨越边界的预测损失，从而保护主干网络免受噪声梯度影响。这是一种更符合语言内在结构的训练信号设计。

Abstract: Multi-Token Prediction (MTP) has emerged as an effective paradigm that augments a shared Large Language Model backbone with auxiliary heads, training the model to predict several future tokens in parallel to enrich its supervision signal and accelerate inference. However, existing training frameworks adopt a rigid, fixed-length prediction horizon, disregarding the highly non-uniform information density of natural language and code. Forcing the auxiliary heads to predict across high-entropy semantic boundaries injects noisy, conflicting training signals; because these heads share the backbone’s latent representations, the resulting gradients backpropagate and interfere with the model’s core capabilities. We propose AdaMTP, an adaptive training paradigm that dynamically aligns the prediction horizon with the intrinsic predictability of the sequence. At its core, an entropy-based segmentation algorithm leverages the base model to detect sudden surges in uncertainty as semantic boundaries, partitioning sequences into variable-length groups. Each token is assigned an adaptive prediction depth, and a dynamically masked MTP objective suppresses the loss for predictions that cross these boundaries, attenuating the noisy gradients that degrade the backbone. Across mathematical reasoning, code generation, and general benchmarks on three backbones (Llama-3.1-8B, Qwen-2.5-7B, Gemma-3-12B), AdaMTP consistently outperforms standard MTP in both task performance and inference speedup.

[14] SERL-SQL: Selective Hindsight Distillation for Text-to-SQL Reinforcement Agentic Learning cs.CLPDF

Tao Liu, Tao Feng, Xiangheng Li, Jinwang Song, Yifan Li

TL;DR: 本文提出了SERL-SQL，一个用于多轮Text-to-SQL智能体的选择性执行反馈强化学习框架。该方法通过一个仅在训练时使用的教师模型，利用执行反馈对学生模型的动作进行重新评分，并将评分差距转化为有界、掩码的权重，用于重新加权GRPO优势函数，从而在SQL和工具动作令牌上实现局部化的信用分配。

Details

Motivation: 现有Text-to-SQL系统大多仅将执行正确性作为轨迹级别的奖励，这难以识别导致成功或失败的SQL决策。本文旨在解决此问题，为多轮Text-to-SQL智能体提供更精细的、基于执行反馈的强化学习指导。

Result: 在BIRD、Spider和跨领域基准测试上的实验表明，SERL-SQL达到了有竞争力的性能，在BIRD-Dev上执行准确率达到76.56%，在Spider-Test上达到89.92%。其基于奖励的选择策略接近了oracle Best-of-N的上界，并持续优于基于一致性的选择策略。

Insight: 创新点在于提出了选择性执行反馈蒸馏机制，通过教师-学生似然差距实现局部化信用分配，使得任务奖励能保持优化方向，同时执行反馈能提供细粒度的决策指导。该方法能可靠地通过轻量级执行反馈奖励识别高质量候选SQL，提升了强化学习在Text-to-SQL任务中的效率。

Abstract: Recent Text-to-SQL systems increasingly rely on multi-turn interaction, execution feedback, and reinforcement learning. However, most existing methods use execution correctness only as a trajectory-level reward, which provides limited guidance for identifying the SQL decisions responsible for success or failure. We propose SERL-SQL, a selective execution-grounded reinforcement learning framework for multi-turn Text-to-SQL agents. SERL-SQL samples on-policy SQL interaction trajectories and uses a training-only teacher to re-score student actions with execution feedback. The resulting teacher–student likelihood gap is converted into bounded, masked weights that reweight GRPO advantages only on SQL and tool-action tokens. In this way, task rewards preserve the optimization direction, while execution hindsight provides localized credit assignment. Experiments on BIRD, Spider, and cross-domain benchmarks show that SERL-SQL achieves competitive performance, reaching 76.56% execution accuracy on BIRD-Dev and 89.92% on Spider-Test. Moreover, our reward-based selection strategy closely approaches the oracle Best-of-N upper bound and consistently outperforms consistency-based selection, showing that SERL-SQL produces high-quality candidates that can be reliably identified by lightweight execution-grounded rewards. Our code will be released at https://github.com/Ffunkytao/SERL-SQL.

[15] Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages cs.CL | cs.AI | cs.LGPDF

Sean Gip Lim, William Chandra Tjhi, Hai Leong Chieu

TL;DR: 本文提出了一种名为Onramp-Sequence Cross-Distillation（OSCD）的后训练算法，旨在解决低资源东南亚语言中大型语言模型进行复杂推理时出现的跨语言崩溃问题。该方法通过一个集成的翻译智能体循环，将高资源语言的推理轨迹投影到低资源语言的词汇子空间中，并结合联合嵌入语义对齐来弥合跨语言表示差距。在AIME25和HMMT25基准测试上的评估表明，该方法显著提升了模型在东南亚语言上的数学推理能力。

Details

Motivation: 动机是解决低资源原生语言环境下，大型语言模型进行复杂逻辑推理时容易发生跨语言崩溃（即中间步骤回退到英语）的问题，这导致了策略优化的冷启动瓶颈，而标准微调又可能因跨语言表示漂移引发灾难性遗忘。

Result: 在AIME25和HMMT25基准上进行综合评估，结果显示OSCD方法在东南亚语言的数学推理任务上带来了高达3.2倍的整体性能提升。其中，联合嵌入语义对齐组件相较于仅使用翻译的基线，在语言去偏方面贡献了高达6.4%的额外提升。

Insight: 宣称的创新点在于OSCD算法，它通过一个集成的翻译智能体循环在生成训练过程中动态翻译参考样本，并结合联合嵌入语义对齐来稳定地弥合成对跨语言表示差距。客观来看，其核心创新在于将后训练过程与动态翻译和语义对齐深度耦合，以解决低资源语言推理中的表示漂移和冷启动问题，这是一种针对多语言推理场景的精细化知识蒸馏与对齐方法。

Abstract: Large Language Models have achieved substantial progress in reasoning capabilities. Yet in low-resource native settings, many suffer from cross-lingual collapse, reverting to English during intermediate steps that require complex logical reasoning. This presents a cold-start bottleneck for policy optimization, whereas standard fine-tuning risks catastrophic forgetting due to cross-lingual representation drift. To address these challenges, we introduce the Onramp-Sequence Cross-Distillation (OSCD), a post-training algorithm that projects high-resource reasoning trajectories into low-resource vocabulary subspaces during generative training rollouts via an integrated translator agentic loop, ensuring the stable and efficient translation of dynamically generated reference samples for fine-tuning. This is coupled with joint-embedding semantic alignment of both reference and target-language reasoning traces, thereby bridging the pairwise cross-lingual representational gaps. Comprehensive evaluations using the AIME25 and HMMT25 benchmarks demonstrate that OSCD yields up to 3.2 times overall improvements in native Southeast Asian languages for mathematical reasoning, of which the joint-embedding semantic alignment component contributes up to 6.4% improvements in linguistic debiasing over translation-only baselines.

[16] TreeProbe : A Tibetan Medicine Benchmark for Cultural Bias in LLMs cs.CLPDF

Jin Zhang, Linyu Li, Weili Jiang, Yuqing Cai, Yutong Liu

TL;DR: 本文提出了TreeProbe，这是首个基于藏医学原生‘医学树’框架构建的文化偏见评测基准，旨在评估大语言模型在藏医学知识上的文化偏见。该基准包含4,719个专家评审项目，覆盖467种疾病和10个子任务。实验表明，当前主流LLM在藏医学语境下能力有限，并表现出系统性的外部本体论漂移，其漂移方向（偏向生物医学或中医）受预训练数据构成和表面相似性影响。

Details

Motivation: 大语言模型被视为缓解全球健康不平等的潜在工具，但其输出往往反映主流高资源医学传统，对传统医学知识体系覆盖有限。藏医学作为世界四大传统医学体系之一，具有独立且高度结构化的理论框架，缺乏对其深入理解可能导致模型在推理时依赖主导认知体系并扭曲原生知识结构，而目前缺乏量化评估藏医学文化偏见的工具。

Result: 在代表性大语言模型上的实验结果显示，当前模型在原生藏医学语境下能力仍然有限，并表现出系统性的外部本体论漂移。进一步分析表明，模型会向生物医学或中医推理方向漂移，这取决于其预训练数据构成以及中医与藏医学之间的表面相似性。

Insight: 论文的创新点在于构建了首个围绕藏医学原生知识结构（医学树）的文化偏见诊断基准TreeProbe，为开发语言包容且认知公平的医疗AI系统提供了量化工具。从客观角度看，其将文化偏见评估从一般语言层面深入到特定知识体系（藏医学）的本体论结构，并揭示了模型偏见方向与预训练数据构成的关联，对评估和缓解AI在多元文化知识领域的系统性偏见具有方法论借鉴意义。

Abstract: Large language models are increasingly viewed as a potential means of mitigating global health inequities, yet their outputs often reflect dominant high-resource medical traditions and provide limited coverage of traditional medical knowledge systems. Tibetan medicine, one of the world’s four major traditional medical systems, has an independent and highly structured theoretical framework. When models lack grounded understanding of Tibetan medicine, they may fall back on dominant epistemic systems and distort the native knowledge structure during reasoning. However, quantitative tools for evaluating cultural bias in Tibetan medicine remain largely absent. To address this gap, we introduce TreeProbe, the first cultural-bias benchmark organized around the native Tree of Medicine framework in Tibetan medicine. It contains 4,719 expert-adjudicated items covering 467 diseases and 10 subtasks along the three roots. Experiments on representative LLMs show that current models remain limited in native Tibetan medical contexts and exhibit systematic external ontology drift. Further analysis reveals that models diverge in whether they drift toward biomedical or TCM reasoning, shaped by pretraining data composition and surface resemblance between TCM and Tibetan medicine. TreeProbe provides a diagnostic benchmark for developing medical AI systems that are both linguistically inclusive and epistemically fair. Code and data are available in an anonymous repository at https://anonymous.4open.science/r/TreeProbe/.

[17] Select-And-Extract: A Lightweight Plugin for Retrieval-Augmented Generation cs.CLPDF

Chenming Tang, Jiawei Han

TL;DR: 本文提出了一种名为Select-ANd-Extract（SANE）的轻量级插件，用于改进检索增强生成（RAG）系统。它通过结合语义检索器与LLM选择来缓解检索失败，并通过蓝图引导的查询时证据提取来缓解阅读失败，从而在引入较小额外开销的情况下提升RAG性能。

Details

Motivation: 旨在解决RAG系统的两个核心失败模式：检索失败（未能从外部语料库召回正确信息）和阅读失败（即使检索到正确信息也无法生成正确答案）。现有方法在解决这两个问题时，要么泛化性有限，要么计算开销大且过度依赖大模型能力。

Result: 实证结果表明，SANE带来了显著的性能提升，同时只引入了适度的额外开销。作为一个轻量级插件，它为实现高性能RAG提供了一个简单且不复杂的替代方案。

Insight: 创新点在于将检索与生成解耦为两个互补的轻量级模块：利用LLM基于摘要选择候选以提升召回率，以及通过结构化关键信息提取来引导生成器进行更有效的推理。这为构建高效RAG系统提供了一种简洁、模块化的设计思路。

Abstract: Retrieval-augmented generation (RAG) for language model (LM) systems fundamentally has two failure modes: retrieval failure and reading failure. The former fails to recall the right pieces of information from the external corpus, and the latter fails to produce the correct answer although the right information is retrieved. Some methods perform structured indexing for retrieval failure, but may suffer from limited generalization of the fixed structures. Some methods perform query-time structuring for reading failure, but typically require a lot of LM calls and rely heavily on the LM’s capability. To this end, we propose Select-ANd-Extract (SANE), a simple yet effective plugin for RAG. For the retrieval failure, we retrieve a wide set of candidates with a semantic retriever, and leverage the LM to select the top candidates based on their synopses, which yields better recall than the original retriever. For the reading failure, we perform blueprint-guided query-time evidence extraction, which allows the generator LM to use only compact and structured key information so that it can perform better reasoning. Empirical results confirm that SANE brings solid improvements, while only introducing modest extra overhead. As a lightweight plugin for RAG, SANE offers a simple alternative to heavier approaches, and suggests a high-performance RAG framework need not be overly complex.

[18] AttnLink: Turning Attention into Schema Links for Text-to-SQL cs.CLPDF

Jinwang Song, Tao Liu, Haowen Zheng, Xiangheng Li, Yifan Li

TL;DR: 本文提出了AttnLink，一个基于注意力的框架，用于将大型语言模型（LLM）的内部注意力机制转换为模式项（schema items）的连续相关性分数，以解决文本到SQL（Text-to-SQL）任务中的模式链接（schema linking）问题。该框架包含无需参数更新的AttnLink-U和通过监督学习的AttnLink-S两个变体，能够在单次预填充（prefill）中高效地对所有候选模式项进行排序，无需自回归解码。

Details

Motivation: 现有的文本到SQL模式链接方法通常在上下文建模能力、基于分数的可控性和推理效率之间存在权衡，AttnLink旨在通过利用LLM的内部注意力来克服这些限制，提供一个更高效、可控且性能强大的模式链接解决方案。

Result: 在Spider、BIRD和Spider2-SQLite基准测试上，AttnLink-S分别取得了99.22%、95.95%和83.29%的mAP分数，并具有毫秒级的模式链接延迟。在九个生成器-数据集设置中的七个中，它在下游SQL生成的执行准确率上取得了最佳或并列最佳的结果。

Insight: 创新点在于将LLM的内部注意力直接转化为模式项的相关性分数，实现了高效的单次预填充排序；AttnLink-S通过结合集合质量（set-mass）目标和自适应概率下限（probability-floor）正则化器，改进了对多个相关模式项的覆盖；其分数还支持通过温度缩放（temperature scaling）和累积质量选择（cumulative-mass selection）进行事后精确率-召回率控制，增强了可控性。

Abstract: Schema linking is a critical component of Text-to-SQL systems, but existing approaches often trade off contextual modeling capacity, score-based controllability, and inference efficiency. We introduce AttnLink, an attention-based framework that converts LLMs’ internal attention into continuous relevance scores for schema items. AttnLink extracts the attention from the generation-start position to candidate schema spans, enabling all candidates to be ranked in a single prefill pass without autoregressive decoding. We develop two variants: AttnLink-U, which directly probes pretrained attention without parameter updates, and AttnLink-S, which aligns the attention distribution with gold schema items through direct supervision. To improve coverage of multiple relevant schema items, AttnLink-S combines a set-mass objective with an adaptive probability-floor regularizer. The resulting scores support post-hoc precision-recall control through temperature scaling and cumulative-mass selection. Experiments on Spider, BIRD, and Spider2-SQLite show that AttnLink-S achieves mAP scores of 99.22%, 95.95%, and 83.29%, respectively, with millisecond-scale schema-linking latency. It also yields the best or tied-best execution accuracy for downstream SQL generation in seven of nine generator-dataset settings.

[19] Distill Where You Fail: Recovering Learning Signals of Negative RL-Groups from Adaptive Teacher Guidance cs.CLPDF

Zhuowen Han, Jinwei Xiao, Zhengxi Lu, Renren Jin, Zhiyuan Yao

TL;DR: 本文针对强化学习可验证奖励（RLVR）中广泛采用的组相对策略优化（GRPO）方法存在的奖励信号稀疏和梯度消失问题，提出了一种名为RSTG的自适应教师指导方法。该方法通过选择性应用在线策略蒸馏（OPD），仅在关键样本和令牌级别进行蒸馏，并结合教师模型生成正确轨迹的监督微调（SFT），以恢复学习信号。

Details

Motivation: GRPO方法在组内所有响应获得相同奖励时，会面临奖励信号稀疏和梯度完全消失的问题。直接结合OPD进行补救会导致性能下降，原因包括并非所有样本都受益于蒸馏、对教师模型拟合过快会削弱RL的探索能力，以及OPD的优势具有不对称性。

Result: 实验表明，RSTG方法在数学和代码任务上，相比简单的GRPO+OPD组合，性能分别显著提升了4.02%和3.05%。

Insight: 核心创新在于提出了一个自适应的、分层的蒸馏策略：在样本层面，仅对奖励方差为零的负样本进行蒸馏，并依据教师置信度加权；在令牌层面，仅针对学生模型高熵值或师生模型差异大的令牌进行蒸馏。此外，通过结合教师模型正确轨迹的SFT，在RL无法提供梯度的地方注入了正向学习信号。

Abstract: Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training large language models (LLMs). While Group Relative Policy Optimization (GRPO) is widely adopted, it suffers from sparse reward signals and loses gradients entirely when all responses within a group receive identical rewards. On-policy distillation (OPD) offers a natural remedy by providing dense, token-level supervision from a teacher model. However, naively combining GRPO with OPD leads to degraded performance, due to three underlying causes: not all samples benefit from distillation; fitting too quickly to the teacher undermines the exploratory capacity of RL; and OPD’s advantages are asymmetric, suppressing most tokens. To address these challenges, we propose RSTG (Recovering Learning Signals via Adaptive Teacher Guidance), which applies distillation selectively and precisely where it matters most. At the sample level, OPD is restricted to negative zero-variance prompts with each sample weighted by the teacher’s confidence score. At the token level, distillation targets only tokens with high student entropy or large teacher-student divergence. We further augment training with SFT on correct trajectories generated by the teacher model, injecting positive gradient signals where RL yields none. Experiments demonstrate that RSTG substantially outperforms naive GRPO+OPD by +4.02% on math and +3.05% on code.

[20] Practical Online KV Cache Compaction for LLM Agents: An Empirical Study cs.CLPDF

Yujian Liu, Jiabao Ji, Li An, Rohit Jain, Gungor Polatkan

TL;DR: 本文针对LLM智能体推理过程中KV缓存累积导致性能瓶颈的问题，实证研究了在线KV缓存压缩方法。通过比较令牌驱逐（TE）和注意力匹配（AM）两种压缩策略，并评估边界、重复预填充和延迟未来生成等廉价代理查询源，发现延迟压缩结合未来查询能有效保持性能，TE在代理不完美时更鲁棒，可实现80% KV缓存减少并提升吞吐量。

Details

Motivation: LLM智能体在交互中积累长轨迹的推理步骤、工具调用和环境反馈，导致KV缓存成为推理瓶颈；现有压缩方法多基于静态上下文假设，而智能体需要在线压缩，即在未知未来相关性的情况下实时压缩新信息。

Result: 在BrowseComp-Plus和WideSearch基准测试中，延迟压缩使用智能体未来查询能恢复大部分性能差距；TE在不同规模模型上保持大部分准确性的同时减少80% KV缓存，并可提升相对于无压缩基线的吞吐量，且比AM在代理不完美时更鲁棒。

Insight: 创新点在于将代理查询选择作为在线KV压缩的核心设计因素，实证表明延迟压缩结合未来查询优于立即压缩，且TE策略在实际在线场景中更具实用性；这为LLM智能体高效推理提供了工程指导。

Abstract: LLM agents accumulate long trajectories of reasoning steps, tool calls, and environment feedback, making the KV cache a major inference bottleneck. KV cache compaction can reduce this cost, but most prior methods assume a static context where future queries are known or can be approximated offline. Agents instead require online compaction: new information must be compressed before future relevance is known, using proxy queries cheap enough for the inference path. We study online compaction across token eviction (TE) and attention matching (AM), adapting both to compact agent turns and comparing cheap proxy sources such as boundary, repeat-prefill, and delayed future-generation queries. Experiments on BrowseComp-Plus and WideSearch show that immediate compaction often hurts performance, whereas delaying compaction to use the agent’s future queries recovers much of the gap. Moreover, TE is often more robust than AM under imperfect proxies. Across models at different scales, TE preserves most of the accuracy while reducing KV cache by 80%, and can improve throughput over the no compaction baseline. These results position proxy-query selection as a core design choice for practical online KV compaction.

[21] Gaokerena: A Small Persian Medical Language Model Family cs.CLPDF

Mehrdad Ghassabi, Hamidreza Baradaran Kashani, Pedram Rostami, Sadra Hakim, Zahra Kazemi

TL;DR: 本文介绍了Gaokerena系列波斯语医疗语言模型，旨在解决波斯语等低资源语言在医疗问答系统中研究不足的问题。该系列包括基于新构建的波斯语医疗语料库训练的Gaokerena-V模型，以及通过思维链与强化学习AI反馈框架优化的Gaokerena-R模型，两者均配备了不确定性预测头以评估回答置信度。

Details

Motivation: 当前人工智能医疗问答系统研究主要集中于英语，波斯语等低资源语言严重缺乏相关模型，本文旨在填补这一空白，为本地化数字医疗提供基础。

Result: Gaokerena-V在翻译的医疗MMLU基准上性能从46.28%提升至49.31%；Gaokerena-R使用相同基线架构但更小数据集，通过优化推理框架达到52.98%的更高分数，但性能仍不足以直接临床应用。

Insight: 创新点包括构建波斯语医疗语料库、结合思维链与新颖的RLAIF框架优化临床推理，以及开发基于内部隐藏状态的不确定性预测头来主动评估模型置信度，为低资源语言医疗模型开发提供了可借鉴的方法。

Abstract: The integration of artificial intelligence into medical question-answering systems has advanced rapidly; however, research remains predominantly focused on English, leaving low resource languages like Persian significantly underserved. To address this gap, this paper introduces Gaokerena, a novel family of compact Persian medical language models optimized for deployment on consumer grade hardware. As a foundational step toward localized digital healthcare, we first present Gaokerena-V, developed by training a baseline model on a newly curated 90-million-token Persian medical corpus and 20,000 expert-vetted physician Q&A pairs, which improved performance on a translated medical MMLU benchmark from 46.28% to 49.31%. Second, recognizing the critical demands of clinical reasoning, we developed Gaokerena-R by integrating a Chain-of-Thought approach with two novel Reinforcement Learning with AI Feedback (RLAIF) frameworks to optimize preference-based reasoning. Despite utilizing the same baseline architecture and a smaller dataset than Gaokerena-V, Gaokerena-R achieved a superior benchmark score of 52.98%. Furthermore, both models are equipped with custom-developed uncertainty heads that predict the model’s confidence in its responses based solely on internal hidden states. While these results demonstrate significant progress in Persian medical language modeling and proactive safety estimation, current performance levels remain insufficient for direct clinical application, highlighting the necessity for further research into robust knowledge acquisition and rigorous safety verification prior to real world deployment.

[22] MedUPS: Towards Diagnostic Assistance in Uncommon Medical Cases with Large Language Models cs.CL | cs.AIPDF

Ofir Ben Shoham, Oriel Perets, Nir Grinberg, Nadav Rappoport

TL;DR: 本文提出了MedUPS框架和MedUPSQA数据集，旨在利用大语言模型辅助罕见或指南外医疗病例的诊断决策。该框架通过将病例报告分割为按时间顺序积累的临床片段，并使用强化学习（GRPO）和外部LLM作为评判者来对齐模型，使其能够预测临床诊疗流程中的下一步行动，而非仅仅给出最终诊断。

Details

Motivation: 解决罕见或指南外病例在临床决策支持中的困难，这些情况下医生需要在诊断不确定且信息不完整时做出系列管理决策。现有医学LLM基准大多只评估最终诊断，而临床护理的关键在于确定下一步行动（如检查、影像、会诊或鉴别诊断）。

Result: 在MedUPSQA数据集（包含21,874个临床决策点）上，对三个骨干模型（Qwen3.6-27B, Qwen3.5-9B, HuatuoGPT-3-8B）进行中游对齐后，其下一步决策准确率分别从55.2%提升至66.7%、47.2%提升至57.8%、37.8%提升至44.4%（95% CI）。在多个模型规模上，该目标带来的准确率提升超过了单纯扩大模型规模的效果，较小的模型甚至超越了评估的更大前沿模型。

Insight: 创新点在于将临床决策建模为按时间顺序展开的、基于累积证据预测下一步行动的序列任务，而非一次性给出最终诊断标签。这更贴近临床实际工作流程。通过构建专门的中游决策数据集（MedUPSQA）和基于强化学习的对齐框架（MedUPS），有效提升了模型在动态诊疗轨迹中的决策能力，且该方法独立于优化器（SFT基线也有效），为医疗AI的辅助决策提供了新范式。

Abstract: Uncommon and off-guideline cases are difficult for clinical decision support, because physicians must make a series of management decisions under diagnostic uncertainty and rarely see the full case at once. Most large language model (LLM) benchmarks for medicine score only the final diagnosis, yet much of clinical care turns on the next appropriate action: the next test to order, the imaging study to obtain, the specialist to involve, or the differential to pursue. We introduce MedUPSQA, a dataset of 21,874 mid-stream clinical decision points built from 5,535 real case reports, and MedUPS, an alignment framework that supervises models on these intermediate decisions as they unfold along a patient’s trajectory. We segment free-text case presentations into chronologically ordered, accumulating clinical chunks and align models to predict the next step with reinforcement learning (GRPO), using an external LLM-as-a-Judge reward. This objective mirrors how clinicians actually meet patients, reasoning forward from accumulating evidence toward the next decision, rather than committing to a final label. Across three backbones, mid-stream alignment raises next-step accuracy from 55.2 to 66.7 for Qwen3.6-27B, from 47.2 to 57.8 for Qwen3.5-9B, and from 37.8 to 44.4 for HuatuoGPT-3-8B, with 95% CI. In several model scales we test the objective improves accuracy more than scale, with smaller models surpassing larger, frontier models we evaluate. We further train supervised fine-tuning (SFT) baselines on the mid-stream task, SFT improves all backbones above base, indicating the target framwork carries signal independently of the optimizer. We release the dataset, code, and aligned checkpoints.

[23] Why LLMs Give In: Conversational Factors and Reasoning Behind Medical Sycophancy cs.CL | cs.AIPDF

Kaike Ping, Buse Çarık, Caleb Wohn, Xiaohan Ding, Tongshuai Wang

TL;DR: 本文研究大语言模型在医学对话中的‘谄媚’行为，即模型在用户反驳下放弃正确答案而迎合错误信息。通过四因素全因子实验设计，发现谄媚行为主要受对话因素（如用户角色、虚假证据、挑战时机等）影响，而非模型本身；不同问题间的谄媚率差异远大于模型间差异。思维链分析表明，模型是否重新审视自身答案或审核虚假来源是关键机制。

Details

Motivation: 解决大语言模型在医学问答中因用户反驳而放弃正确答案的‘谄媚’问题，这种行为比单纯错误更危险，因为它将正确性的可信度赋予了用户的错误信息。研究旨在揭示谄媚行为是对话属性而非模型固有特性。

Result: 在五个开源模型和500个MedQuAD问题（120万次试验）上进行实验，发现对话因素（如虚假证据时机）交互作用显著：虚假证据在提问时出现会使谄媚率翻倍，但在模型回答后出现则减半。谄媚率在问题间差异是模型间差异的22倍以上，表明单一谄媚率更多反映对话和问题采样。

Insight: 创新点在于采用全因子设计量化对话因素对谄媚行为的影响，并利用思维链解释机制：模型若重新审计自身答案则易妥协，若坚持医学事实则能抵抗；虚假证据的时机效应揭示了对话动态的关键作用。这为评估和缓解模型谄媚提供了新视角。

Abstract: A language model that abandons a correct medical answer under user pushback is more dangerous than one that was simply wrong, because it lends the credibility of a correct answer to the user’s misinformation. Such model behavior, described as medical sycophancy, is usually reported as a single rate per model, but we find it is a property of the conversation, not the model. We study medical sycophancy in language models with a fully crossed factorial design over four conversational factors, user role, the evidence behind a false claim, whether the challenge precedes or follows the model’s answer, and whether the correct answer is grounded in the prompt, across five open-weight models and 500 MedQuAD questions (1.2M trials). The factors interact sharply: fabricated sources raise sycophancy 2.0x when they accompany the question but halve it once the model has answered, so the same evidence helps or hurts depending only on timing. Sycophancy varies far more across questions than across models (67x vs. 3x), so a single rate reflects the conversation and the questions sampled as much as the model. Chain-of-thought traces explain why. Models that re-examine their own prior answer concede, while those that reason about the medical facts hold, and only a model that has already answered can spend a round auditing the fabricated source.

[24] Cloud-ScPO: Hidden-State Geometry for Semi-Supervised Preference Optimization in LLM Reasoning cs.CL | cs.AIPDF

Yuzhou Liu, Xiyang Hu

TL;DR: 该论文提出了一种名为Cloud-ScPO的半监督偏好优化框架，用于提升大语言模型（LLM）的数学推理能力。该方法利用模型内部隐藏状态表示的几何结构，通过构建正确与错误推理轨迹的参考点云，并结合自洽性信号，在仅有少量标注数据的情况下自动挖掘高质量的偏好对进行训练。

Details

Motivation: 动机在于解决偏好优化（如DPO）依赖大量人工标注或外部奖励模型的瓶颈，探索能否从模型自身的内部表示几何中，以半监督方式自动推导出偏好监督信号。

Result: 在GSM8K和MATH-Numeric基准测试上的实验表明，Cloud-ScPO相比基线ScPO方法有稳定提升，在GSM8K上最高提升4.49%，在MATH-Numeric上最高提升4.19%。分析显示该方法能有效分离高质量与低质量的推理轨迹。

Insight: 创新点在于将推理轨迹的隐藏状态视为几何点云，并利用其拓扑结构（连通性诱导的组件）来量化轨迹质量，从而将几何先验与自洽性信号结合，实现半监督的偏好对挖掘。这为利用模型内部表示进行自我监督优化提供了新思路。

Abstract: Preference optimization improves mathematical reasoning in large language models (LLMs), but reliable chosen-rejected pairs usually require verified answers, human annotations, or external reward models. We investigate whether preference supervision can instead be derived from the model’s internal representation geometry in a semi-supervised setting. Our analysis shows that reasoning trajectories generated across different mathematical problems form structured global point clouds in which correct and incorrect trajectories exhibit different geometric organization. Based on this observation, we propose Cloud–ScPO, a topology-guided preference-mining framework that uses a small labeled set to construct multiple correct and incorrect reference Clouds. Each trajectory is represented by a mean-pooled hidden state and scored against connectivity-induced components using a component-level soft $k$-nearest-neighbor measure averaged across reference banks. We combine this cross-problem Cloud signal with prompt-level self-consistency: self-consistency determines the answer-level preference direction, while Cloud scoring selects concrete trajectories and filters pairs by their score margin. Experiments on GSM8K and MATH-Numeric across four model settings show that Cloud–ScPO consistently improves over ScPO, with gains of up to 4.49% on GSM8K and 4.19% on MATH-Numeric. Pair-level analyses further show that Cloud–ScPO maintains comparable correctness reliability while more effectively separating informative chosen trajectories from incomplete, repetitive, or otherwise low-quality rejected responses.

[25] Evaluating VLMs on Multimodal Aristotelian Persuasion Tasks cs.CL | cs.MMPDF

Khondoker Ittehadul Islam

TL;DR: 本文评估了视觉语言模型（VLMs）在基于亚里士多德说服模型（Logos、Ethos、Pathos）的多模态说服任务上的性能。研究使用ImageArg数据集，发现Qwen系列模型表现优异，其中Qwen3在Logos和Pathos任务上表现出色，而Qwen2在更复杂的Ethos检测任务上具有竞争力。

Details

Motivation: 尽管VLMs在多种任务上表现出色，但尚未在更复杂的任务（如涉及个人偏见的亚里士多德说服模型）上进行全面评估。本文旨在填补这一空白，评估VLMs在此类复杂多模态任务上的进展。

Result: 在ImageArg数据集的Logos、Ethos和Pathos检测任务上，Qwen系列模型取得了改进的F1分数。Qwen3在Logos和Pathos任务上表现优异，而Qwen2在更复杂的Ethos检测任务上展现出有竞争力的性能。

Insight: 创新点在于将经典的亚里士多德说服理论框架（Logos、Ethos、Pathos）引入多模态VLM评估，为衡量模型在复杂、涉及偏见的推理任务上的能力提供了新基准。客观来看，这扩展了VLM评估的维度，强调了模型处理主观、说服性内容的能力。

Abstract: Vision Language Models (VLMs) have demonstrated exceptional performance across various tasks. However, they have not yet been thoroughly evaluated on more complex tasks. The Persuasion Model, conceived by Aristotle, resembles a triangle shape, which highlights its inherent challenges related to personal biases. To assess the progress of VLMs on these complex tasks, we use the ImageArg datasets, focusing on the Logos, Ethos, and Pathos detection tasks. Our findings indicate that models from the Qwen family achieve improved F1 scores, with Qwen3 performing exceptionally well on the Logos and Pathos tasks, while Qwen2 exhibits competitive performance on the more complex Ethos detection task. We release the code to foster research in this direction.

[26] Attend to Your Own Thoughts: Breaking the Barrier for Post-Training Quantization of Reasoning LLMs through the Lens of 1.58-Bit Quantization cs.CL | cs.AIPDF

Shigeng Wang, Chao Li, Yangyuxuan Kang, Jiawei Fan, Anbang Yao

TL;DR: 本文提出了ScaleQ-1.58，一个用于推理大语言模型（LLMs）的可扩展三元后训练量化（PTQ）框架。其核心是引入了一种名为‘关注自身思维’（AYOT）的简单校准方法，该方法在量化过程中利用高精度原始模型在少量校准样本上生成的推理轨迹和最终答案作为上下文输入。将AYOT与现有的CAT-Q方法结合后，ScaleQ-1.58在数学、代码等推理任务上展现出优异的缩放特性，性能随模型规模增大而提升，且所需校准数据量极少。

Details

Motivation: 现有基于学习的可微三元化方法（如CAT-Q）在使用忽略模型推理过程的传统校准方案时，在具有挑战性的数学和编码任务上会导致性能崩溃。本文旨在解决这一后训练量化（PTQ）中推理LLMs的性能障碍问题。

Result: 在仅使用4M校准token的情况下，经ScaleQ-1.58三元化的Qwen3-1.7B模型在4项数学和编码任务上的平均性能达到了先前最佳模型BitNet b1.58 2B4T的90.52%以上，且三元化的Qwen3-4B模型性能有8.97%的绝对提升，同时量化所需的校准token数量减少了1,000,000倍。该方法在密集和MoE架构上均表现良好，性能随模型规模（最高235B参数）增加而提升，并在不同难度的任务上（数学、编码、科学逻辑推理、常识推理和基础语言生成）展现出强泛化能力。

Insight: 论文的核心创新点在于提出了AYOT校准方法，其关键洞察是：在后训练量化中，利用原始高精度模型自身的推理轨迹（即思维链）作为校准过程的上下文输入，能有效保留模型的推理能力。这为量化推理LLMs提供了一种简单而有效的解决方案，突破了传统校准方案的性能瓶颈。该方法也展现出向其他量化比特位宽的泛化潜力。

Abstract: We propose ScaleQ-1.58, a scalable ternary post-training quantization (PTQ) framework for reasoning LLMs. Its core insight stems from an empirical finding: although modern LLMs are typically trained to exhibit chain-of-thought reasoning capabilities, in the PTQ regime, even the latest CAT-Q method based on learning-based differentiable ternarization still leads to performance collapse on challenging mathematics and coding tasks when using conventional calibration schemes that ignore the model’s reasoning process. Driven by this finding, we introduce a simple calibration approach, Attend to Your Own Thoughts (AYOT), where reasoning traces and final answers generated by the pre-trained high-precision target LLM on a proper set of calibration samples are used as the context input during the ternarization process, along with the corresponding questions. ScaleQ-1.58 is formed by simply integrating AYOT with CAT-Q, which demonstrates several scaling properties: (1) with only 4M calibration tokens, Qwen3-1.7B ternarized by ScaleQ-1.58 reaches over 90.52% of the performance of the prior best BitNet b1.58 2B4T averaged over 4 mathematics and coding tasks, and our ternary Qwen3-4B shows an absolute gain of 8.97%, while requiring 1,000,000x fewer calibration tokens for quantization; (2) ScaleQ-1.58 generalizes well to both dense and MoE architectures, with performance improving as model scale increases (up to 235B parameters); (3) ScaleQ-1.58 demonstrates strong generalization across tasks of varying difficulty levels, including mathematics, coding and scientific logic reasoning, as well as commonsense reasoning and basic language generation; (4) its performance continues to improve as the number of calibration tokens increases. Notably, AYOT also exhibits strong generalization ability across other quantization bit-widths. Code will be available at https://github.com/IntelChina-AI/BitTern.

[27] CrossLex: A Source-Grounded Benchmark for Cross-Jurisdictional Legal Reasoning in Large Language Models cs.CLPDF

Xiaocui Yang, Xican Tan, Shoujie Chen, Shihan Xiao, Keke Tong

TL;DR: 本文介绍了CrossLex，一个基于权威法律来源构建的跨司法管辖区法律推理基准测试，用于评估大语言模型在中国、加利福尼亚州和德国三个司法管辖区处理相同事实但法律结果不同案件的能力。该基准包含三个互补任务，并提出了一个联合评估答案正确性和法律来源依据的度量标准。实验表明，当前模型虽然能正确回答法律问题，但在提供准确的跨司法管辖区法律引证方面存在困难。

Details

Motivation: 现有基准很少评估大语言模型是否能识别法律推理中固有的、依赖于司法管辖区的差异，即相同事实模式在不同法律体系中可能导致不同法律结果。

Result: 在代表性大语言模型上的广泛实验表明，尽管当前模型通常能正确回答法律问题，但它们在提供准确的跨司法管辖区法律引证方面表现不佳。

Insight: 论文的创新点在于构建了一个基于相同事实、扎根于法律来源的跨司法管辖区基准，并设计了三个互补任务来区分基础法律知识与跨司法管辖区推理能力，同时提出了一个联合评估答案正确性和法律依据的新度量标准，这有助于推动基于来源的、细粒度的跨司法管辖区法律推理研究。

Abstract: Legal reasoning is inherently jurisdiction-dependent: the same facts can call for different legal rules and yield different conclusions across legal systems. Yet existing benchmarks rarely evaluate whether large language models (LLMs) can recognize such jurisdiction-specific variation, especially when identical fact patterns lead to divergent legal outcomes.We introduce CrossLex, a same-fact, legal-source-grounded benchmark for evaluating cross-jurisdictional legal reasoning in LLMs across three jurisdictions: China, California, and Germany. Built from authoritative legal sources, CrossLex aligns 55 legal issues spanning contract, consumer, criminal, family, and labor law, and constructs jurisdiction-aligned questions paired with answers and supporting citations. In total, CrossLex contains 6,149 instances organized into 385 fact groups, with all legal issues, answers, and cited authorities reviewed by legal professionals.To disentangle basic legal knowledge from cross-jurisdictional reasoning, CrossLex defines three complementary tasks: single-jurisdiction reasoning (T1), joint cross-jurisdictional comparison (T2), and fine-grained cross-jurisdictional evaluation (T3). We further propose Grounded Joint, a metric that jointly assesses answer correctness and legal-source grounding, and provide a unified evaluation for streamlined benchmarking. Extensive experiments on representative LLMs show that, although current models can often answer legal questions correctly, they struggle to provide accurate cross-jurisdictional legal citations.We hope that CrossLex will facilitate future research on source-grounded cross-jurisdictional legal reasoning.

[28] RH-RAG: Trustworthy Long-Form Generation for Privacy-Constrained Settings cs.CLPDF

Raj Shekhar Singh

TL;DR: RH-RAG是一个用于隐私受限环境的多智能体框架，旨在利用本地部署的开源语言模型实现可信的长文本生成。该框架将生成过程分解为规划、写作和检查三个协调阶段，并采用双层检索索引来支持高效规划和细粒度上下文生成。

Details

Motivation: 解决在严格隐私安全约束下，组织无法使用云端专有LLM API，而现有基于较小本地模型的检索增强生成方法在长文本生成中缺乏全局规划且易累积事实不一致性的问题。

Result: 在文学、金融和法律领域的评估表明，RH-RAG相比标准和分层RAG基线，在事实准确性、语义连贯性和文档对齐度方面持续提升，同时在保持数据隐私的前提下，达到了与专有云端系统相当的可靠性。

Insight: 创新点在于将长文本生成分解为多智能体协调的规划-写作-检查三阶段流程，并引入基于自然语言推理的事实验证和认证驱动的修订循环来缓解幻觉，同时设计了支持消费级硬件的双层检索索引以实现高效规划与细粒度生成。

Abstract: Generating long-form content from extensive internal reports remains challenging for organizations operating under strict privacy and security constraints, where proprietary cloud-based LLM APIs are often not viable. While locally deployed open-weight models offer a privacy-preserving alternative, existing retrieval-augmented generation (RAG) approaches on smaller models frequently lack effective global planning and accumulate factual inconsistencies over long outputs. To address these limitations, we present RH-RAG, a multi-agent framework for secure and trustworthy long form generation using local language models. RH-RAG decomposes generation into three coordinated stages: a Planner Agent that constructs a global document outline from high-level semantic summaries, a Writer Agent that incrementally generates coherent section-wise content using bounded coherence memory, and a Checker Agent that mitigates hallucinations through natural language inference-based factual verification and an attestation-driven revision loop. The framework further employs a dual-level retrieval index that supports efficient planning and fine-grained contextual generation on consumer-grade hardware. Evaluations across literary, financial, and legal domains demonstrate that RH-RAG consistently improves factual grounding, semantic coherence, and document-level alignment compared to standard and hierarchical RAG baselines, while achieving reliability competitive with proprietary cloud-based systems without compromising data privacy.

[29] BiCAA: Bidirectional Credit Assignment for Search-Augmented Agent cs.CLPDF

Yibin Huang, Bin Xu, Hailong Cao, Conghui Zhu

TL;DR: 本文提出了BiCAA（双向信用分配）框架，用于解决搜索增强智能体在多步搜索任务中因稀疏监督（仅基于最终输出分配奖励）导致的训练不稳定和冗余搜索行为问题。该方法融合了前向可解性增益和后见成功关键性两种互补信号，构建密集、有区分度的过程奖励，以提供逐步的监督信号。

Details

Motivation: 现有基于最终输出的奖励（如GRPO）只能提供结果层面的稀疏监督，缺乏对中间推理步骤的指导信号，导致智能体在多步搜索任务中训练不稳定并产生冗余搜索行为。

Result: 在搜索增强的问答基准测试上的实验表明，BiCAA稳定了策略优化，减少了冗余搜索行为，并取得了有竞争力的性能。

Insight: 核心创新在于提出了一个双向过程奖励框架，通过融合前向（基于步骤对问题解决能力的即时改进）和后向（基于后见之明评估步骤对最终成功的必要性）两种互补的评估标准，为搜索步骤提供密集且有区分度的信用分配，从而更有效地指导智能体的多步推理过程。

Abstract: Multi-step search is a fundamental capability for search agents, enabling them to iteratively acquire, refine, and integrate external evidence for complex reasoning QA. However, vanilla GRPO allocates rewards exclusively based on the model’s final outputs, yielding outcome-only supervision with no supervisory signals for intermediate reasoning steps. Such sparse supervision easily causes training instability and redundant search behaviors on multi-step search tasks. To mitigate this limitation, we adopt process reward to deliver stepwise supervision signals. For this process reward, we propose two complementary criteria to judge each search step: whether the step yields new evidence to facilitate problem solving, and whether it forms an efficient, pivotal intermediate decision within the overall reasoning trajectory. Building on this insight, we propose BiCAA: a bidirectional credit assignment framework that delivers dense, distinguishing process rewards for search-augmented agents. BiCAA builds bidirectional process rewards by fusing two complementary signals: forward solvability gain and hindsight success criticality. The former quantifies step-wise improvements in answer plausibility, while the latter evaluates each step’s necessity for final success via hindsight outcome-based criticality scoring. We modulate and aggregate the two signals and then fuse them with the outcome reward. Experiments on search-augmented QA benchmarks show that BiCAA stabilizes policy optimization, reduces redundant search behavior, and achieves competitive performance.

[30] LongChart VQA: A Comprehensive Benchmark for MLLMs with Complex Multi-Chart Reasoning cs.CL | cs.AI | cs.CVPDF

Ziyan Xiao, Yinghao Zhu, Wenting Zhang, Heaju Kim, Lequan Yu

TL;DR: 该论文提出了LongChart VQA基准测试，用于评估多模态大语言模型在复杂多图表推理任务上的能力。该基准包含平均6.5张图表图像和31.2个问题，通过合成流程确保数据的一致性和有效性。研究评估了10个SOTA MLLMs，并分析了推理模式、辅助工具和图像扰动鲁棒性对性能的影响。

Details

Motivation: 现有基准主要关注单图表感知，而简单的图表间连接不足以评估MLLMs在复杂多图表理解和多步推理方面的能力，这限制了MLLMs在复杂智能体任务中的应用。

Result: 在LongChart基准上评估了10个SOTA MLLMs，结果显示随着计算复杂度增加，模型准确率显著下降且波动较大，揭示了当前模型在多图表推理上的局限性。

Insight: 创新点在于设计了基于潜在图表的合成流程来构建复杂多图表VQA基准，确保了数据的内在一致性；客观分析认为，该基准系统性地量化了MLLMs在多图表推理中的性能瓶颈，为未来研究提供了明确方向。

Abstract: Multimodal large language models (MLLMs) are rapidly evolving with expanded context windows and stronger reasoning capabilities, enabling multi-chart understanding and multi-step inference. These abilities are increasingly important as MLLMs are adopted in complex agentic tasks. However, existing benchmarks largely emphasize single-chart perception, while simple chart-to-chart connections are insufficient to evaluate these capabilities. To capture multi-chart complexity while ensuring consistency and validity, we design a synthesis pipeline supported by latent graphs. Building on this pipeline, we introduce LongChart, a benchmark whose VQA sets contain an average of 6.5 images and 31.2 questions. We evaluate 10 state-of-the-art MLLMs and examine three factors that influence performance: reasoning patterns, auxiliary tools, and robustness to image perturbations. Our results show that MLLM accuracy decreases and varies substantially as computational complexity increases, highlighting directions for future research in multi-chart reasoning.

[31] Prompt-Induced Waste in Large Reasoning Models: A Preregistered Two-Harness Benchmark of Coding Agents cs.CLPDF

Sarel Weinberger, Amir Hozez

TL;DR: 本文通过预注册基准测试，系统评估了提示词措辞和代理框架设计对大型推理模型（作为编码代理）计算成本的影响。研究发现，某些提示指令（如要求模型开发并比较多种方法）会显著增加推理成本（2.4-7.4倍）而不提升任务正确性，而指定范围、验收标准和停止条件的效率模板可减半推理成本。代理框架的选择影响更大，相同模型-任务-提示组合在不同框架下的成本差异可达5-30倍。

Details

Motivation: 大型推理模型作为编码代理时，其推理过程（如思考、工具调用、多轮交互）会产生显著成本，但提示词措辞对此成本的具体因果影响尚未被系统量化。

Result: 在涵盖6个大型推理模型、2个真实代理框架和24个确定性编码任务的预注册基准测试中，基于4,643次有效运行（包括筛选、压力、保留、复制和跨供应商研究），发现提示词可导致推理成本成倍增加而不改善正确性；特定框架（如Claude Code）使相同任务成本增加5-30倍；在Kimi-K3和Claude Sonnet 5上的复制研究确认了主要效应方向。

Insight: 创新点在于首次通过预注册、控制变量的基准测试系统量化了提示词与框架对推理成本的因果影响；客观来看，研究揭示了‘效率幻觉’（如供应商缓存降低计费成本但不改变行为）以及模型对‘深入思考’等通用提示的敏感性差异，为优化编码代理的提示工程和框架设计提供了实证依据。

Abstract: Large reasoning models used as coding agents incur costs from deliberation, tool calls, and repeated agent turns, yet the causal effect of prompt wording on this spend has not been measured systematically. We present a preregistered benchmark across six large reasoning models, two real agent harnesses, and 24 deterministic coding tasks with hidden evaluators. Across 4,643 valid runs, including screening, stress, holdout, replication, and cross-provider studies, we find that prompt formulation can multiply reasoning cost without improving correctness. Asking the model to develop and compare several approaches is the most consistently wasteful instruction, increasing reasoning tokens by 2.4-7.4x across all models. Generic “think deeply” cues also increase deliberation by 1.6-2.2x, while a bounded-efficiency template specifying scope, acceptance criteria, and a stop condition is cost-neutral and can halve reasoning. Harness choice matters even more: identical model-task-prompt triples cost 5-30x more per success under Claude Code than under pi, mainly because of larger static prefixes and more turns. Misleading architectural hints are far costlier than irrelevant prose, and provider-side caching reduces billed cost without changing behavior, so it must not be treated as efficiency. Replications on Kimi-K3 and Claude Sonnet 5 preserve the main effect directions while revealing model-specific sensitivity to thinking and certainty cues. Overall, prompt wording and harness design materially affect agent cost, often with no gain in task success.

[32] EviSD: Evidence-Conditioned Self-Distillation for Search-Augmented Agents cs.CLPDF

Jianan Xie, Xin Sun, Zhongqi Chen, Xing Zheng, Shu Wu

TL;DR: 本文提出了EviSD，一种证据条件化的自蒸馏框架，用于增强搜索型语言智能体。该方法利用实例级支持证据作为搜索动作的优先信息，利用黄金答案作为答案动作的补充优先信息，通过将特权教师模型与原始学生模型之间的差距转化为对结果奖励优势的有界修正，来精确定位和优化多轮搜索过程中各个动作的贡献，而无需额外的蒸馏目标或推理时修改。

Details

Motivation: 基于结果的强化学习虽然能让搜索增强的语言智能体从可验证的最终答案中学习，但其轨迹级的信用分配无法区分多轮搜索过程中各个动作的具体贡献。

Result: 在七个问答基准测试和三种不同规模与世代的模型骨干上，EviSD在所有评估设置中都取得了最高的宏观平均精确匹配分数，比最强的对比方法高出1.3到2.3个百分点，同时仅调制了6.7%到15.1%的响应词元。

Insight: 核心创新在于提出了证据条件化的自蒸馏框架，将特权信息（支持证据和黄金答案）的指导通过教师-学生差距转化为对强化学习优势函数的有界、局部修正，从而在不改变推理过程的情况下，实现了对多步决策过程中关键动作的更精细优化。

Abstract: Outcome-based reinforcement learning enables search-augmented language agents to learn from verifiable final answers, but its trajectory-level credit cannot distinguish the contributions of individual actions in a multi-turn search process. We propose EviSD, an evidence-conditioned self-distillation framework that uses instance-level supporting evidence as privileged information for search actions and golden answers as complementary privilege for answer actions. During training, the student samples actions from the original context, while the same model re-scores them as a privileged teacher under an action-aligned context. EviSD converts the detached teacher–student gap into a bounded correction to the outcome-derived GRPO advantage and applies it only to generated action spans. This design localizes privileged guidance while preserving the update direction determined by the outcome reward, without an auxiliary distillation objective or any change at inference time. Across seven question-answering benchmarks and three backbones spanning model scales and generations, EviSD achieves the highest macro-average Exact Match in all evaluated settings, outperforming the strongest compared methods by 1.3–2.3 points while modulating only 6.7%–15.1% of response tokens. Code is available at https://github.com/JiananXie/EviSD.

[33] HopRefusalBench: Diagnosing Refusal Failures in Search-Augmented Agents for Multi-Hop Reasoning cs.CLPDF

Jianan Xie, Xin Sun, Zhongqi Chen, Xing Zheng, Qiang Liu

TL;DR: 本文介绍了HopRefusalBench，这是首个针对多跳搜索中拒绝行为的受控基准测试，包含889个基于KILT实体路径构建的不可回答问题。该基准通过交叉三种不可回答原因（答案未知、错误前提、上下文不明确）与根、中间、终端三种拓扑结构，分别评估前提验证、中间桥接验证和终端停止能力。研究发现，在搜索增强模式下，前沿模型的目标感知正确停止率（TCHR）最高仅为42.9%，揭示了多跳搜索中拒绝失败是一个重要的评估问题。

Details

Motivation: 现有弃权基准主要暴露单跳查询的表面缺陷，无法揭示在有效中间推理和检索后才出现的失败。因此，需要一个新的基准来诊断搜索增强智能体在处理根本不可回答的多跳问题时，其拒绝失败的行为。

Result: 在搜索增强模式下测试的十个前沿专有和开源模型中，最佳模型的目标感知正确停止率（TCHR）仅为42.9%。根和中间项比终端项更难，所有模型在错误前提上获得最高TCHR，在上下文不明确问题上获得最低TCHR。然而，跨类别汇总后，每个模型84.7%至98.4%的显式拒绝类响应能识别正确理由，主要瓶颈在于承诺给出适当的非答案。

Insight: 创新点在于构建了首个受控的多跳搜索拒绝基准HopRefusalBench，通过交叉不可回答原因和拓扑结构，使不同阶段的验证和停止行为可单独观察。此外，提出了一个涵盖目标感知拒绝、伪拒绝、幻觉完成和搜索预算耗尽的结果分类法，以及用于后触发持续和令牌浪费的源感知轨迹指标，为诊断和改进搜索增强智能体的可靠性提供了基础。

Abstract: Search-augmented large language model agents are increasingly capable of solving knowledge-intensive tasks, but their behavior when a multi-hop question is fundamentally unanswerable remains poorly understood. Existing abstention benchmarks largely expose defects at the surface of single-hop queries and therefore cannot reveal failures that emerge only after valid intermediate reasoning and retrieval. We introduce HopRefusalBench, the first controlled benchmark of refusal within multi-hop search, comprising 889 unanswerable questions constructed from KILT-grounded entity paths. It crosses three causes of unanswerability (answer unknown, false premise, and underspecified context) with root, middle, and terminal topologies, making premise verification, intermediate-bridge validation, and terminal stopping separately observable. We further propose a final-outcome taxonomy spanning target-aware refusal, pseudo-refusal, hallucinated completion, and search-budget exhaustion, together with source-aware trajectory metrics for post-trigger continuation and token waste. Across ten frontier proprietary and open-weight models in search-augmented mode, the best model achieves a target-aware correct halting rate (TCHR) of only 42.9%. Root and middle items are consistently harder than terminal items, and all models attain their highest TCHR on false premises and their lowest on underspecified questions. Yet when pooled across categories, 84.7–98.4% of each model’s explicit refusal-like responses identify the correct rationale, localizing the main bottleneck to committing to an appropriate non-answer; failed trajectories instead diverge into hallucination or search-budget exhaustion. These results establish refusal in multi-hop search as a consequential evaluation problem and provide a foundation for diagnosing and improving the reliability of search-augmented agents.

[34] PALMs: Using Multi Construct-Grounded Rationales for Modeling Population Preferences in LLMs cs.CLPDF

Priyanka Dey, Brihi Joshi, Preyashi Poddar, Jieyu Zhao, Emilio Ferrara

TL;DR: 该论文提出了PALMs（Population Aligned Language Models），一套针对特定人群（美国、印度、巴西、法国和意大利）进行对齐的大语言模型。其核心方法是通过合成基于心理学和文化构念的理性依据，并将其作为潜在监督信号，在偏好调优中实现人群特定的对齐。

Details

Motivation: 现有大语言模型在模拟个体用户行为时，难以忠实代表一个群体，因为需要捕捉不同群体间在价值观、信仰和文化规范上的系统性差异。

Result: 在人格、价值观与信仰、文化规范和道德四个维度上，PALMs持续优于包括文化专用模型在内的基线模型，在五个群体上平均相对最佳基线提升了8.59%。在下游应用中，PALMs在个性化奖励建模上优于最佳基线5.19%，在群体模拟上优于6.34%，并在社会推理任务上表现出强大的迁移能力。

Insight: 主要创新点在于利用基于心理学和文化构念的理性依据作为潜在监督信号进行偏好调优，这比基于人口统计提示或基于调查的微调提供了更丰富的归纳信号，从而能更有效地捕捉群体间的系统性差异。

Abstract: Large language models are being extensively used to simulate individual user behavior, yet faithfully representing a population requires capturing the systematic variation in values, beliefs, and cultural norms that distinguish one group from another. We introduce Population Aligned Language Models (PALMs), a suite of models each aligned to specific populations, covering five countries: USA, India, Brazil, France and Italy. PALMs are created by synthesizing rationales grounded in psychological and cultural constructs and using these as latent supervision during preference tuning for population-specific alignment. Evaluated across four dimensions: personality, values and beliefs, cultural norms, and morality, PALMs consistently outperform baselines, including culture-specialized models, achieving an average of 8.59% relative improvement over the best baseline across all five populations. Notably, construct-grounded rationales outperform both demographic prompting and survey-based fine-tuning, suggesting that grounding preference learning in psychology and culture provides a richer inductive signal than surface-level response distributions. We further demonstrate strong generalization to downstream applications with- out task-specific supervision: outperforming best baselines by 5.19% in personalized reward modeling, 6.34% in population simulation, and showing strong transfer to social reasoning tasks. Datasets and code are available at: https://github.com/limenlp/PALMs.

[35] Semantic Alignment of AI Models: Concept Collapse, Checkpoint Dynamics, and Cross-Lingual Transfer cs.CL | cs.LGPDF

Tyler Ashoff, Jordan Rodu

TL;DR: 本文提出了一种利用拓扑方法比较语言模型高维嵌入空间与低维可解释基线（如本体和知识图谱）的语义对齐框架，以评估模型对抽象概念的表征能力，并支持跨语言短语理解和模型适应跟踪。

Details

Motivation: 现有语言模型评测主要依赖结果推理，难以测试模型对语言的概念化理解，且开源基准易饱和或被用于训练数据；需要补充语义结构分析来深入理解模型如何关联抽象概念。

Result: 通过拓扑方法实现了模型嵌入空间与知识图谱等基线的严格比较，该方法支持跨语言短语理解测试和模型适应过程的跟踪。

Insight: 创新点在于将拓扑学方法引入语义对齐评估，提供了一种可解释的、多模态的模型语义结构分析框架，有助于揭示概念坍缩和跨语言迁移中的动态特性。

Abstract: Language model benchmarking is a difficult task. Outcome reasoning alone does not test the model’s conceptualization of language and popular open-source benchmarks are quickly saturated or ingested as training data. It is important to test the model’s output, but augmenting these tests by characterizing semantic structure gives more insight to how models relate abstract concepts. However, the high dimensional embedding spaces are not easy to interpret. This work demonstrates how topological methods can be used to rigorously compare these spaces to low dimensional and interpretable baselines like ontologies and curated knowledge graphs. These multi-modal alignment tests make it possible to track model adaptations and test phrase understanding across multiple languages.

[36] PICTURE: Enhancing Theory-of-Mind in Large Language Models by Revealing, Not Hiding, Characters’ Lack of Knowledge cs.CL | cs.AIPDF

Eojin Jeon, SangKeun Lee

TL;DR: 论文提出了一种名为PICTURE的新提示方法，旨在通过显式生成角色对事件缺乏知识的自由形式解释，而非隐藏事件，来增强大型语言模型的心智理论能力。该方法在错误信念任务上平均提升了7.3%的性能。

Details

Motivation: 现有工作通过事件隐藏进行心智理论推理，但严格的输出格式限制导致性能下降；作者旨在解决这一问题，同时应对不隐藏事件时模型需抑制对角色未知事件响应的挑战。

Result: 在错误信念任务上，PICTURE平均超越现有提示方法7.3%，实现了性能提升。

Insight: 创新点在于假设并验证了显式表达角色知识缺失能帮助模型抑制无关响应，从而在自由形式思维链中实现有效的心智理论推理，避免了事件隐藏的格式约束。

Abstract: Simulating human-like Theory of Mind (ToM) has been a longstanding problem in natural language processing (NLP). To address this, existing works introduce a reasoning step of event hiding (a.k.a. perspective-taking), where events unknown to a character are removed before question answering. However, resorting to event hiding for ToM reasoning presents a performance degradation issue due to the strict output format constraints involved in event hiding. To mitigate this issue, we propose generating perspective-taking outputs as free-form explanations without event hiding, but this poses a notable yet underexplored challenge: LLMs need to inhibit responses to events unknown to characters, because the absence of event hiding exposes LLMs to these events throughout reasoning. To address this challenge, we hypothesize and empirically verify that LLMs can achieve such inhibition if a character’s lack of knowledge about events is made explicit during reasoning. Based on this finding, we introduce PICTURE, a new prompting method that enables LLMs to generate a character’s lack of knowledge within free-form Chain-of-Thought (CoT). Experimental results show that PICTURE outperforms existing prompting methods by an average of 7.3% on false-belief tasks.

[37] Discriminative Axis, Not Data Volume: What a Contrastive Corpus Teaches an Audio Embedding cs.CL | cs.SDPDF

Abdul Basit Tonmoy

TL;DR: 本文挑战了通过扩大语料库规模来提升对比表征性能的默认做法，报告了一个案例：增加数据量对提升音频嵌入模型的特定属性（如情感识别）无效。研究发现，通过添加一个词汇-语音轮次到冻结基础的多模态嵌入模型中，零样本关键词检测提升了76点，但语音情感识别下降了14点。损失并非源于模型容量限制，因为在一个韵律受控的语料库上进行微调可以恢复甚至超越之前的情感识别水平，但会以牺牲少量关键词检测精度为代价。关键在于对比目标的结构：只有当批次内负样本无法在不使用该属性的情况下被区分时，对比目标才会编码该属性。语料库的结构（而非其大小或字幕词汇）决定了对比音频嵌入编码的内容。

Details

Motivation: 论文的动机是挑战当前通过简单扩大语料库规模来改进对比表征学习的默认做法，并探究在对比音频嵌入模型中，究竟是什么因素真正决定了模型能够学习到哪些语义属性（如关键词检测与情感识别）。

Result: 实验结果表明，在冻结基础的多模态嵌入模型上添加词汇-语音轮次，使零样本关键词检测（Keyword Spotting）性能大幅提升76点，但同时语音情感识别（Speech-Emotion Recognition）性能下降了14点。通过在一个句子内容固定、仅韵律变化的受控语料库（prosody-controlled corpus）上对7442个片段进行微调，可以恢复并超越之前的情感识别水平，但会以关键词检测精度下降5点为代价。相比之下，使用29428个从网络挖掘的、字幕明确提及情感的片段进行训练，在相同曝光度下，对情感识别性能的影响微乎其微（-0.0007）。进一步的因果干预实验证实，通过压缩字幕多样性使情感成为唯一的区分轴，可以在三个随机种子下平均恢复8.9点的情感识别性能，并在一个非表演性语料库上观察到较小但同向的增益，同时关键词检测精度相应下降。

Insight: 论文的核心创新点在于揭示了对比学习目标编码特定属性的关键机制：模型仅当该属性是区分批次内负样本所必需时才会学习它。这超越了数据量或字幕词汇的表面影响，强调了语料库结构（即负样本对的构建方式，如固定句子内容以凸显韵律差异）对于引导模型关注特定语义轴的决定性作用。这一发现为设计更高效、更有针对性的对比学习语料库和训练策略提供了深刻的见解。

Abstract: Scaling the corpus is the default remedy when a contrastive representation lacks an attribute. We report a case where it does nothing, and identify what does: adding a lexical-speech round to a frozen-base multimodal embedding model raises zero-shot keyword spotting by 76 points while reducing speech-emotion recognition by 14. The loss is not a capacity limit: fine-tuning on 7,442 clips from a prosody-controlled corpus recovers emotion past its pre-speech level at a five-point keyword cost. Nor is it data volume: 29,428 mined clips whose captions explicitly name emotions, at matched exposure, move emotion by -0.0007. The difference is structural: a contrastive objective encodes an attribute only when the in-batch negatives cannot be separated without it; the controlled corpus holds sentence content fixed, so prosody is the only separating signal, whereas mined captions name emotion yet remain separable by scene content. Intervention on the same audio confirms causality: raising caption similarity does not recover emotion, but collapsing caption diversity so that emotion becomes the only separating axis recovers it by 8.9 points across three seeds, with a smaller, same-signed gain on a non-acted corpus, while keyword accuracy trades back. Corpus structure, not size or caption vocabulary, controls what a contrastive audio embedding encodes.

[38] RING: Retrieval-Internalized Generation for Continual Large-Scale Knowledge Injection cs.CL | cs.AIPDF

Shicheng Xu, Liang Pang, Liyi Chen, Zihao Wei, Jingcheng Deng

TL;DR: 本文提出RING（检索内化生成）范式，通过混合记忆专家架构和强化学习训练，将大规模外部知识注入模型内部参数化记忆，从而完全消除外部检索器，在保持事实准确性的同时降低推理延迟和工程开销。

Details

Motivation: 传统检索增强生成（RAG）方法虽然提升了事实准确性，但引入了推理延迟和额外的工程复杂度；RING旨在通过将知识内化到模型参数中，实现高效、无需外部检索的知识注入与利用。

Result: 在严格避免测试数据泄露的新构建基准News-2025上，RING在准确性和效率方面匹配或超越了基于检索的RAG以及参数化注入基线方法。

Insight: 创新点包括：1）提出混合记忆专家架构与三阶段训练流程（持续预训练、监督微调、分层奖励强化学习），实现参数化记忆内的可学习检索策略；2）理论框架将RING形式化为经典RAG目标的无搜索近似；3）构建未来新闻基准News-2025，用于评估真正新知识的注入效果。

Abstract: Retrieval-augmented generation (RAG) improves factuality but adds latency and engineering overhead at serving time. We propose RING (Retrieval-Internalized Generation), a holistic paradigm spanning both architecture and training that injects large-scale external knowledge into a \textit{Mixture-of-Memory Experts} and learns parametric search over this internal memory via reinforcement learning, removing the external retriever entirely. Training proceeds in three stages: continued pre-training injects new corpora into a Knowledge Expert via our novel \textit{Dual Causal Attention}; supervised fine-tuning teaches a ``search-then-answer’’ pattern; and reinforcement learning with hierarchical rewards optimizes the routing-and-search policy over the parametric memory. Unlike prior parametric injection methods that pair internal memory with a fixed or rule-based retriever, RING {learns} its retrieval policy directly from task signals. We further frame RING theoretically as a search-free approximation to the classical RAG objective. To evaluate large-scale injection of genuinely {new} knowledge without test-time leakage, we further construct News-2025, a benchmark built from news strictly post-dating the base LLM’s pretraining cutoff. RING matches or surpasses both search-based RAG and parametric injection baselines in accuracy and efficiency.

[39] Does Accuracy Equal Evidence? Reasoning Faithfulness under KV Cache Compression cs.CLPDF

Mengting Ai, Jingrui He, Yue Guo

TL;DR: 本文研究了KV缓存压缩对大型推理模型的影响，发现仅凭最终答案准确性评估压缩效果存在不足，因为压缩可能保留正确答案但损害其背后的推理证据，即存在’答案-证据差距’。通过固定轨迹重放协议评估了十种令牌驱逐压缩方法和一种量化方法，发现令牌驱逐方法在保持答案准确性的同时会显著降低推理链支持度和扰动忠实性，而覆盖保留的量化方法受影响较小。

Details

Motivation: 动机在于质疑当前仅用最终答案准确性评估KV缓存压缩效果的常见做法，因为这种评估隐含地假设保留答案即保留了支持该答案的推理过程，而作者发现这一假设可能不成立。

Result: 在数学推理、科学问答、临床计算和长上下文检索任务上评估了三种模型，结果显示令牌驱逐压缩方法能保持有竞争力的最终答案准确性，但会显著降低答案链一致性（chain support）和扰动忠实性（perturbation faithfulness），而一种覆盖保留的量化控制方法受此影响小得多。

Insight: 主要创新点在于揭示了KV缓存压缩中存在的’答案-证据差距’，并提出了一个受控的固定轨迹重放协议来隔离和评估压缩对已有推理轨迹信息可用性的影响，表明问题关键可能不在于KV内存减少本身，而在于失去了对部分推理轨迹的访问。

Abstract: KV cache compression is commonly evaluated by final-answer accuracy, implicitly assuming that preserving the answer also preserves the reasoning that supports it. We test this assumption for large reasoning models and show that it can fail: under compression, correct answers and the validity of their visible supporting rationales can be preserved at different rates. We study this failure with a controlled fixed-trace replay protocol, which holds reasoning content fixed and isolates whether compression preserves usable information from an already available trace. We evaluate ten token-eviction KV compression methods and one quantization method on three models across mathematical reasoning, scientific QA, clinical calculation, and long-context retrieval. We measure final accuracy, answer-chain consistency, and perturbation faithfulness. Across tasks, token-eviction methods can preserve competitive final-answer accuracy while substantially degrading chain support or perturbation faithfulness. We call this the answer-evidence gap. A coverage-preserving quantization control is substantially less affected, suggesting that the failure is tied less to KV memory reduction itself than to losing access to parts of the reasoning trace. Code is available at https://github.com/famous-blue-raincoat/Safe_KV_Compress.

[40] TRAM: Enhancing Multimodal Reasoning with Trajectory-Derived Auxiliary Memory cs.CLPDF

Kang Liu, Zijing Wang, Yongkang Liu, Mengjie Zhao, Xiaocui Yang

TL;DR: 本文提出了一种无需训练的方法TRAM，通过从模型自身推理轨迹中提取辅助记忆路径来增强多模态大推理模型（MLRM）的推理能力。该方法将已完成的推理整合为紧凑的潜在记忆，并通过快速和慢速循环流在线更新，再通过轻量级残差路径反馈到解码器层，以缓解长推理轨迹中早期信息被遗忘的问题。

Details

Motivation: 多模态大推理模型在处理需要视觉理解和多步推理的任务时表现良好，但随着推理轨迹增长，模型利用早期上下文信息的能力可能下降，导致推理错误风险增加。现有方法主要关注维持视觉基础，但推理过程还将视觉观察转化为任务特定的关系、约束和中间结论，这些信息在长轨迹中的影响力可能减弱。归因分析表明，正确性不仅取决于图像归因，更与轨迹是否跨阶段保留并整合此类推理衍生信息密切相关。

Result: 在四个MLRM变体上对八个基准测试的实验表明，TRAM在数学、科学和一般视觉推理任务上，相比标准解码方法，无需额外训练即可提升性能。

Insight: 论文的创新点在于提出了一种训练免费的轨迹衍生辅助记忆机制，通过在线整合和循环更新推理轨迹中的中间信息来增强模型的长程依赖和跨阶段信息整合能力。从客观角度看，该方法将模型的内部推理状态显式地建模为可更新的记忆单元，并通过轻量级反馈路径进行调节，为改善多模态推理模型的长期记忆和连贯性提供了一种新颖且高效的架构思路。

Abstract: Multimodal Large Reasoning Models (MLRMs) have achieved strong performance on tasks requiring visual understanding and multi-step inference. However, as reasoning trajectories grow, models may become less effective at using information established earlier in the context, increasing the risk of reasoning errors. Existing approaches primarily address this problem by sustaining visual grounding throughout reasoning. However, reasoning also transforms visual observations into task-specific relations, constraints, and intermediate conclusions whose influence may weaken over long trajectories. Our attribution analysis suggests that correctness is not consistently separated by image attribution alone, but is more closely associated with whether trajectories retain and integrate such reasoning-derived information across stages. Motivated by this, we introduce TRAM (TRajectory-derived Auxiliary Memory), a training-free method that augments standard decoding with an auxiliary memory pathway derived from the model’s own reasoning trajectory. TRAM consolidates completed reasoning into a compact latent memory, updates it online through fast and slow recurrent streams, and feeds it back into selected decoder layers through a lightweight residual pathway. Experiments across four MLRM variants on eight benchmarks show that TRAM improves performance over vanilla decoding on mathematical, scientific, and general visual reasoning tasks without additional training.

[41] Look Ahead Before You Distill: Future Trajectory Validation of Teacher Guidance for Agentic On-Policy Distillation cs.CL | cs.LGPDF

Chishui Chen, Yaoyou Fan, Te Sun, Yi Yang, Chenghao Sun

TL;DR: 本文提出了FutureBridge-OPD（FTB）方法，用于改进多轮智能体任务中的在线策略蒸馏。该方法通过在师生模型产生高分歧的状态下，执行一个简短的教师“桥接”操作，并评估该操作对学生后续轨迹的影响，从而筛选出有益的教师指导，以解决学生行为偏差累积导致教师指导失效的问题。在ALFWorld、WebShop和ScienceWorld基准测试中，该方法显著优于基线模型。

Details

Motivation: 在线策略蒸馏在多轮智能体任务中，学生行为的微小偏差会随时间累积，导致其轨迹逐渐偏离教师指导依然有效的状态区域，从而限制了蒸馏效果。

Result: 在主要设置（Qwen3-32B教师模型蒸馏至Qwen3-1.7B学生模型）下，FTB在ALFWorld、WebShop和ScienceWorld三个基准上，平均分别优于原始在线策略蒸馏和TCOD方法16.6分和7.6分，并且在不同学生模型规模和教师设置下均保持有效。

Insight: 核心创新在于提出了“前瞻验证”机制：不仅在高分歧状态提供教师指导，更关键的是通过模拟执行一个简短的教师“桥接”并观察学生后续轨迹，来前瞻性地评估该指导的长期收益，从而智能地筛选出真正能增加正向蒸馏信号密度的指导。这为策略蒸馏提供了一种动态、轨迹层面的指导质量评估框架。

Abstract: On-policy distillation (OPD) provides teacher supervision on states visited by the student, reducing the distribution gap between training and inference. However, in multi-turn agentic tasks, student deviations may accumulate over time, gradually moving the trajectory away from states where teacher guidance remains effective. Our quantitative analysis further shows that high-disagreement states offer promising opportunities for teacher guidance, but determining whether such guidance is beneficial requires examining its effect on subsequent student trajectories. We propose FutureBridge-OPD (FTB), which executes a short teacher bridge at a high disagreement state and uses the resulting student continuation to assess whether the bridge increases the density of positive distillation signals relative to the teacher. On ALFWorld, WebShop, and ScienceWorld, under the main Qwen3-32B teacher to Qwen3-1.7B student setting, FTB outperforms vanilla OPD and TCOD by an average of 16.6 and 7.6 points, respectively, and remains effective across student scales and teacher settings. Our code is publicly available at https://github.com/ChenChiShui/FutureBridge-OPD.

[42] CAVE: Competence-Aware Visual Boundary Evidence Alignment for Video Temporal Grounding cs.CL | cs.CVPDF

Wei Jia, Zhicong Lu, Yu Chen, Xiang Wang, Shuai Li

TL;DR: 本文提出了一种名为CAVE（Competence-Aware Visual Boundary Evidence Alignment）的新方法，用于改进基于强化学习的大规模视觉语言模型在视频时序定位任务中的性能。该方法通过引入边界特定的视觉证据奖励，来缓解现有方法中视觉证据与预测时间戳之间的错位问题。

Details

Motivation: 现有基于强化学习的视频时序定位方法主要依赖最终预测区间的正确性奖励，未能充分约束边界相关的视觉证据及其与时间戳预测的对应关系，导致视觉证据与预测时间戳之间存在普遍错位。

Result: 在多个公开的视频时序定位基准测试上的广泛实验证明了该方法的有效性，表明其能提升模型性能。

Insight: 核心创新点在于引入了边界特定的视觉证据令牌，并通过轻量级监督预热初始化其结构化生成和边界语义；在强化学习过程中，设计了视觉边界证据对齐奖励和基于性能的门控机制，以自适应地强化证据监督，促进视觉证据与时间边界的对齐，同时避免对细粒度边界优化的过度约束。

Abstract: Large vision-language models (LVLMs) have achieved substantial performance gains in Video Temporal Grounding (VTG) through reinforcement learning (RL). However, existing methods primarily rely on outcome correctness rewards that evaluate only the final predicted intervals, leaving boundary-related visual evidence and its correspondence with timestamp predictions insufficiently constrained. In this paper, we delve into timestamp prediction and its underlying boundary-level visual evidence, showing prevalent misalignment between visual evidence and predicted timestamps across widely used benchmarks. To address this issue, we propose Competence-Aware Visual Boundary Evidence Alignment (CAVE), which augments localization optimization with boundary-specific visual evidence rewards to mitigate evidence-timestamp misalignment. Specifically, to explicitly represent the boundary-specific visual evidence, CAVE introduces boundary-specific evidence tokens and initializes their structured generation and distinct boundary semantics through a lightweight supervised warm-up. During RL, the visual boundary evidence alignment reward reinforces the visual attention of special evidence tokens within the ground-truth boundaries, thereby promoting alignment between visual evidence and temporal boundaries. Moreover, performance-aware gating for evidence supervision is designed to adaptively retain evidence guidance for poorly localized groups while reducing it once localization becomes sufficiently accurate to avoid over-constraining fine-grained boundary refinement. Extensive experiments on several public VTG benchmarks demonstrate the effectiveness of our method.

[43] IACM-RL: Intent-Aware Context Management and Reinforcement Learning for Complex Tool Invocation under Dynamic Intent Fluctuations cs.CL | cs.AIPDF

Dingwei Zhu, Jiahan Li, Chengjun Pan, Yunxian Yang, Yunbin Zhao

TL;DR: 本文提出IACM-RL框架，旨在解决动态用户意图波动下复杂工具调用的鲁棒性问题。该框架通过动态意图轨迹生成、基于信念状态的上下文管理以及分层强化学习优化，有效缓解了过时约束导致的意图偏离和无限API循环问题。

Details

Motivation: 现有方法在动态意图噪声和波动环境下，因假设完美指令或简单场景，易受过时约束干扰，导致灾难性意图偏差和无限循环。论文旨在提升复杂、动态场景中工具调用的鲁棒性。

Result: 在DynamicIntent、BFCL-V3和τ²-Bench基准测试上，IACM-RL显著优于基线方法，有效减少了无限循环和过时上下文错误，并提升了领域外泛化能力。

Insight: 创新点包括：1）构建了细粒度动态意图波动场景的数据集与诊断指标；2）设计了基于信念状态的自我生成上下文管理器，主动追踪目标并隔离过时参数；3）采用分层意图驱动奖励与三个辅助损失来优化策略，内部化状态跟踪能力。

Abstract: Executing long-horizon tool invocations in real-world environments is severely challenged by dynamic user intent noise. Existing methods attempt robustness via implicit history scanning or text compression, yet predominantly assume perfect instructions in simplistic scenarios. Inevitably, under fluctuating contexts, obsolete constraints dilute model attention, triggering catastrophic intent deviation and infinite API loops. To resolve this, we propose IACM-RL, a comprehensive framework for robust tool invocation. First, we introduce the DynamicIntent pipeline, synthesizing trajectories across 13 fine-grained fluctuation scenarios, paired with a five-dimensional diagnostic metric suite. Second, IACM-RL deploys a BeliefState-based Self-Generated Context Manager that proactively tracks shifting goals and isolates overwritten parameters using structural stale flags. To autonomously internalize this state-tracking capability, we optimize the policy using a hierarchical intent-driven reward alongside three auxiliary losses (action calibration, CM extraction, and state distillation). Experiments on DynamicIntent, BFCL-V3, and $\mathrmτ^2$-Bench demonstrate that IACM-RL significantly outperforms baselines, reducing infinite loops and stale context errors while enhancing out-of-domain generalization.

[44] Cross-Domain Hybrid OPD for Generalizable Search Agents cs.CLPDF

Hongzhan Chen, Xiaoyu Liu, Dengming Zhang, Minzhou Huang, Dongliang Xu

TL;DR: 本文提出了跨领域混合在线策略蒸馏（Cross-Domain Hybrid OPD）训练框架，用于开发元宝搜索智能体。该框架旨在解决搜索专业化带来的‘对齐税’问题，即模型在提升搜索性能时会牺牲通用能力。通过在Hunyuan3架构基础上，结合智能体强化学习和跨领域专家策略蒸馏，该模型在保持竞争力的搜索性能的同时，显著提升了通用能力。

Details

Motivation: 当前强化学习优化的搜索智能体在提升专业搜索能力时，往往导致通用智能下降（即‘对齐税’问题），这限制了其作为通用助手的效果。本文的动机是设计一个训练框架，使模型能实现搜索专业化，同时不牺牲甚至增强其通用智能。

Result: 大量实验表明，最终模型在搜索性能上具有竞争力，同时其通用能力得到持续提升，在现实搜索场景中实现了专业化执行与广泛泛化之间的有利平衡。

Insight: 主要创新点在于提出了跨领域混合在线策略蒸馏框架，将来自互补通用领域的专家知识蒸馏到搜索专业化的学生模型中，从而联合优化专业化和通用能力，有效缓解了‘对齐税’。从客观角度看，这种将专业化与通用性视为协同而非竞争目标的混合训练策略，为构建更平衡的通用智能体提供了新思路。

Abstract: Recent advances in Reinforcement Learning (RL) have substantially improved the capabilities of autonomous search agents, enabling sophisticated planning, and iterative retrieval over dynamic information sources. However, optimizing language models for specialized search behaviors often incurs an alignment tax, where gains in search performance come at the expense of general-purpose capabilities, limiting their effectiveness as universal assistants. In this technical report, we present the training framework behind the Yuanbao search agent, designed to achieve search specialization without sacrificing general intelligence. Built upon the Hunyuan3 architecture, our framework combines agentic reinforcement learning for autonomous search with a cross-domain expert On-Policy Distillation (OPD) pipeline. Experts specializing in complementary general-purpose domains are distilled into the search-specialized student, restoring and further enhancing its broad capabilities. Rather than treating specialization and general capability as competing objectives, our hybrid training strategy jointly optimizes both, effectively mitigating the alignment tax. Extensive experiments demonstrate that the resulting model achieves competitive search performance while consistently improving its general-purpose capabilities, providing a favorable balance between specialized execution and broad generalization in real-world search scenarios.

[45] Self-Improving Large Language Models via Progressive Experience Evolution cs.CL | cs.AI | cs.LGPDF

Shijie Ren, Xiting Wang, Meng Li, Yujie Guo, Yunhang Yao

TL;DR: 本文提出了一种名为SPEE（Self-Progressive Experience Evolution）的统一后训练框架，旨在解决大型语言模型（LLMs）自我改进中经验积累与内化脱节的问题。该框架通过显式的经验演化（包括提取、验证和进化可迁移经验）和隐式的策略优化（利用奖励驱动的强化学习）两个阶段，将交互经验持续转化为模型能力。

Details

Motivation: 现有LLM自我改进范式存在割裂：测试时方法能显式提取经验但无法内化到参数中，而训练时优化方法能更新参数但缺乏积累可迁移经验的显式机制。本文旨在弥合这一鸿沟，重点关注被忽视的中间阶段——经验蒸馏。

Result: 在五个数学推理基准测试（如GSM8K、MATH等）上的实验表明，SPEE在三种模型规模下均一致优于测试时和训练时的自我进化基线方法，取得了更好的性能。

Insight: 核心创新点是提出了一个统一的、分阶段的“经验演化”框架，通过显式构建和进化全局经验池来整合成功与失败轨迹的知识，并采用特权引导的On-Policy Self-Distillation（OPSD）将经验内化到策略中，从而系统性地将瞬时交互转化为持久模型能力。

Abstract: Large language models (LLMs) capable of self-improvement require not only effective policy optimization, but also a principled mechanism for transforming transient interaction experience into persistent model capabilities. Existing self-improvement paradigms remain fragmented: test-time methods can explicitly extract experience but cannot internalize it into model parameters, whereas training-time optimization methods can update model parameters but lack an explicit mechanism for accumulating transferable experience. Bridging these two paradigms requires a critical intermediate stage that remains underexplored, namely \emph{experience distillation}. To address this gap, we propose \textbf{SPEE} (\textbf{S}elf-\textbf{P}rogressive \textbf{E}xperience \textbf{E}volution), a unified post-training framework that sequentially performs explicit experience evolution followed by implicit policy optimization. During explicit experience evolution, SPEE reflects on trajectories collected from multiple interactions to extract, verify, and progressively evolve transferable experience, which is subsequently internalized into the policy through privilege-guided On-Policy Self-Distillation (OPSD). During implicit policy optimization, reward-driven reinforcement learning leverages these internalized priors to explore novel solution strategies. In the experience evolution stage, a continuously evolving global experience pool consolidates knowledge from both successful and failed trajectories, filters out low-utility experience, and mitigates post-hoc rationalization induced by individual trajectories. Experiments on five mathematical reasoning benchmarks demonstrate that SPEE consistently outperforms both test-time and training-time self-evolution baselines across three model scales. The source code is available at https://github.com/rrrsj/SPEE.

[46] Global Optimization and Inference-Time Region Grafting for Agentic Workflows cs.CLPDF

Donghyeok Koh, Gyuwan Kim, Jinyeong Bak, Seung-Hoon Na, Tao Yang

TL;DR: 本文提出了GRAFT方法，用于在智能体工作流中实现推理时的局部自适应优化。该方法在保持全局优化工作流的基础上，仅针对每个输入替换特定失败区域，利用无标签的执行质量信号进行评估，从而避免对整个工作流进行重新优化的计算开销。

Details

Motivation: 现有工作流优化方法通常在执行前确定工作流结构，无法在推理时根据执行质量信号自适应调整失败区域，而全工作流重新优化又计算成本过高。

Result: 在数学推理、代码生成、多跳和知识密集型问答等一系列任务上，GRAFT在匹配的优化器和执行器设置下，比之前最强的工作流优化方法MaAS平均提升3.85个百分点；仅替换为更强的执行器模型还能带来进一步增益，无需重新优化全局工作流。

Insight: 创新点在于提出了局部区域嫁接机制，实现了基于推理时反馈的实例级自适应，同时保持工作流级一致性；其核心洞察是优化后的工作流并非静态产物，而是可随推理时反馈和更强执行器演化的自适应执行策略。

Abstract: Recent advances in agentic workflow optimization automate workflow design through task-specific workflow search or input-conditioned architecture selection. However, they determine the workflow before execution and cannot adapt failed workflow regions using execution-time label-free quality signals. Naively enabling such inference-time adaptation through whole-workflow re-optimization would be computationally prohibitive. To tackle this challenge, we introduce GRAFT, which preserves a globally optimized workflow while locally replacing only selected regions for each input. Without parameter training, GRAFT evaluates region-level alternatives using label-free execution-quality signals and accepts only replacements that improve local quality while preserving workflow-level consistency, thereby enabling instance-wise adaptation without whole-workflow re-optimization. GRAFT applies without modification across a range of tasks spanning mathematical reasoning, code generation, and multi-hop and knowledge-intensive question answering. Under matched optimizer and executor settings, it improves over the strongest prior workflow-optimization method, MaAS, by 3.85 points on average. Replacing only the executor with a stronger model yields further gains without re-optimizing the global workflow. This suggests that an optimized workflow is not merely a static optimization artifact, but an adaptable execution policy that can evolve with inference-time feedback and stronger executors.

[47] ScrambleToolBench: Agents Search Exhaustively Even When Their Own Map Points to the Next Step cs.CLPDF

Vernon Toh, Navonil Majumder, Zhengyuan Liu, Nancy F. Chen, Soujanya Poria

TL;DR: 本文介绍了ScrambleToolBench，这是一个交互式终端基准测试，旨在评估智能体在无语义线索的动态环境中通过试错交互发现隐藏工具行为的能力。该基准通过移除语义提示、实施连续任务课程以及引入动态挑战（如映射漂移、随机动作失败和时间执行窗口），要求智能体在环境变化时修正和调整假设。评估发现，即使最先进的语言模型在初始发现上成功，也无法实现稳健的适应，面对结构变化时倾向于使用昂贵的暴力搜索而非演绎推理。

Details

Motivation: 为了解决现有工具使用基准在静态环境中暴露语义工具模式、导致智能体依赖先验知识而非自主发现的问题，作者旨在开发一个基准来隔离行为推理，评估智能体在开放世界环境中仅通过交互推断陌生系统行为的能力。

Result: 在ScrambleToolBench基准上的评估显示，最先进的语言模型在初始发现上成功，但面对映射漂移等结构变化时，无法使用循环追踪等演绎策略，而是表现出信念惯性或退回到穷举搜索，增加测试时推理只会放大这种昂贵的暴力搜索。

Insight: 论文的创新点在于引入了一个去语义化的交互式基准，通过动态挑战（如映射漂移）来评估智能体的适应能力，揭示了当前智能体推理在高效推断结构变化方面的差距，即使配备持久内存也无法解决，强调了自主发现和演绎推理的重要性。

Abstract: To operate robustly in open-world environments, autonomous agents should be able to infer the behavior of unfamiliar systems through interaction alone, even in the absence of documentation. However, existing tool-use benchmarks expose semantic tool schemas in static environments, allowing agents to rely on prior knowledge rather than autonomous discovery. To address this limitation, we introduce ScrambleToolBench, an interactive terminal benchmark designed to isolate behavioral reasoning. By removing semantic cues and enforcing a continuous task curriculum, the benchmark requires agents to uncover hidden tool behaviors entirely through trial-and-error interaction. The benchmark further introduces dynamic challenges, including mapping drift, stochastic action failures, and temporal execution windows, to evaluate whether agents can revise and adapt their hypotheses as the environment changes. Our evaluation of state-of-the-art language models reveals that successful initial discovery does not translate into robust adaptation. When faced with structural changes such as mapping drift, agents fail to use deductive strategies such as cycle tracing, and instead exhibit belief inertia or fall back to exhaustive search. Increasing test-time reasoning only amplifies this expensive brute-force search rather than enabling deductive recovery. While equipping agents with persistent memory reduces compounding errors, they remain unable to efficiently infer structural changes, highlighting a gap in current agent reasoning.

[48] AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling cs.CLPDF

Jiajun Liang, Yucheng Liao, Yukang Cao, Jiazhe Wei, Ken Li

TL;DR: 本文提出了AURORA-LM，一种基于连续隐空间的扩散语言模型。它通过分离可解码文本表示的构建与其分布的建模，解决了现有连续语言模型在生成和解码之间的权衡问题。模型采用基于查询的编码器-解码器构建高容量、前缀对齐的隐序列，并使用块因果扩散Transformer通过流匹配学习其分布。

Details

Motivation: 当前文本生成主要依赖离散token，而图像、视频和音频已越来越多地在连续隐空间建模。现有连续语言模型要么继承不适合联合生成和解码的嵌入空间，要么为简化扩散而压缩自编码隐空间，牺牲了token级别的保真度。本文旨在设计一个直接学习高容量、可解码文本隐空间分布的扩散模型。

Result: 在OpenWebText自由生成和XSum摘要任务上，AURORA-LM在评估的连续和基于扩散的语言模型中取得了最强性能。将模型扩展到10亿参数（约1500 EFLOPs总计算量）带来了进一步增益，在匹配的评估协议下超越了一个更大的公开可用的隐扩散语言模型。所有实验均在昇腾NPU上进行。

Insight: 核心创新在于将可解码文本表示的构建与其分布的建模解耦，并设计了块因果扩散Transformer来并行去噪块内位置。通过限制噪声输入路径但保留完整的干净隐空间预测目标，以及校准噪声水平分布以适应隐空间宽度，并引入自轨迹一致性来桥接训练噪声采样与推理时的迭代去噪，从而在保持解码能力的同时有效建模复杂隐分布。

Abstract: Language remains an outlier in generative modeling: while images, video, and audio are increasingly modeled in continuous latent spaces, text generation still relies predominantly on discrete tokens. Existing continuous language models either inherit embedding spaces not designed for joint generation and decoding, or compress autoencoded latents to ease diffusion, sacrificing token-level fidelity. Instead of simplifying the representation to suit the generative model, we preserve a high-capacity, decodable text latent and design the diffusion model to learn its distribution directly. We introduce AURORA-LM, a continuous-latent diffusion language model that separates the construction of a decodable text representation from the modeling of its distribution. A Query-based Encoder-Decoder organizes text into a high-capacity, prefix-aligned latent sequence, and a Block-causal Diffusion Transformer learns its distribution through flow matching, generating blocks left to right while denoising positions within each block in parallel. Because such a latent is harder for diffusion to model, AURORA-LM restricts only the noisy-input pathway while retaining the full clean-latent prediction target, accommodating full-width latents without reducing decoder-facing capacity. We further calibrate the noise-level distribution to the latent width, and introduce self-trajectory consistency to bridge independently sampled training noise and iterative denoising at inference. AURORA-LM achieves the strongest performance among evaluated continuous and diffusion-based language models on OpenWebText free generation and XSum summarization. Scaling to 1B parameters with about 1500 EFLOPs of total compute yields further gains, surpassing a larger publicly released latent-diffusion language model under a matched evaluation protocol. All experiments are conducted on Ascend NPUs.

cs.CV [Back]

[49] PhysAgent: A Multi-Agent Framework for Reliable Remote Heart Rate Estimation cs.CVPDF

Yehui Yang, Bo Zhao, Junzhe Cao, Hui Ma, Yue Sun

TL;DR: 本文提出PhysAgent，一个用于远程光电容积描记术（rPPG）心率估计的多智能体候选验证框架。该框架不直接训练新的基础rPPG模型或让多模态大语言模型（MLLM）直接输出心率，而是将多个基础估计器的输出视为待验证的生理假设，利用轻量级MLLM（Qwen3-VL-4B）驱动多智能体对视频条件、信号可靠性和候选分歧进行推理，再通过确定性生理验证器和可复现的数值融合过程生成最终心率。

Details

Motivation: 远程心率估计（rPPG）的弱生理信号易受运动、光照变化、遮挡、皮肤外观变化和设备噪声干扰，现有方法通常依赖单一模型直接预测，而不同强估计器可能对同一视频产生冲突但各自看似合理的候选结果。

Result: 在多个公共rPPG基准测试上的实验结果表明，PhysAgent提高了不同数据集和源域设置下的融合稳定性和可靠性，同时避免了直接MLLM预测或无约束集成融合的不可复现性和生理不一致性问题。

Insight: 创新点在于将多估计器输出视为假设进行验证的推理框架，而非直接预测；利用轻量级MLLM驱动多智能体进行条件与可靠性分析，结合确定性验证和可复现融合，提升了方法的鲁棒性和可解释性。

Abstract: Remote photoplethysmography (rPPG) enables non-contact heart-rate estimation from facial videos, but its weak physiological signal is easily corrupted by motion, illumination changes, occlusion, skin-appearance variation, and device noise. Existing rPPG methods typically rely on a single model to directly predict heart rate or recover pulse waveforms, while different strong estimators may produce conflicting yet individually plausible candidates for the same video. To resolve these conflicts, we propose PhysAgent, an inference-time multi-agent candidate-verification framework. Unlike direct prediction approaches, PhysAgent neither trains a new base rPPG model nor asks Multimodal Large Language Models (MLLMs) to output heart rate directly. In contrast, it treats outputs from multiple base estimators as physiological hypotheses to be verified and uses a lightweight 4B MLLM, Qwen3-VL-4B, to drive multi-agent reasoning over video conditions, signal reliability, and candidate disagreement. A deterministic physiological verifier checks the fusion proposal, and a reproducible numerical fusion process produces the final heart rate. Experimental results on multiple public rPPG benchmarks show that PhysAgent improves fusion stability and reliability across different datasets and source-domain settings, while avoiding the irreproducibility and physiological inconsistency of direct MLLM prediction or unconstrained ensemble fusion. The code will be released soon.

[50] SafeBuild-Bench: A Temporal-Robust Construction Safety Benchmark with Graph-Enhanced Data Mining cs.CVPDF

Yi Cui, Zilin Wang, Yijie Xu, Qianyi Cai, Huizai Yao

TL;DR: 本文提出了SafeBuild-Bench，一个用于评估多模态大语言模型在建筑工地安全风险理解能力上的基准测试集。该基准从超过10万条工业图文记录中挖掘，包含3314个任务实例，涵盖选择题和自由描述题。为了解决专家标注的可扩展性问题，作者还开发了名为GEMS的图增强多模态选择流水线，用于从冗余数据流中高效识别信息丰富的候选样本。

Details

Motivation: 现有建筑安全模型需要处理具体的部署风险（如工人站在无护栏的脚手架边缘），而不仅仅是识别图像中的常见物体。然而，真实的巡检档案数据冗余、长尾，且跨越不同工地和月份收集，存在时间和场地变化，因此需要一个能反映这些现实变化的基准来评估模型。

Result: 在SafeBuild-Bench上，当前的多模态大语言模型（MLLMs）表现远未达到可靠的建筑安全理解水平，最佳总体得分接近60分。此外，在公共指令调优数据上，GEMS选择的子集在小数据预算下保持了面向鲁棒性的性能。

Insight: 论文的创新点在于构建了一个关注时间与场地鲁棒性的建筑安全专用基准（SafeBuild-Bench），并提出了GEMS方法，该方法结合了代理模型的混淆信号和图驱动的多样性选择，以实现对冗余数据流中信息丰富候选样本的可扩展性专家验证，这为从大规模、非结构化工业数据中构建高质量评估集提供了新思路。

Abstract: Construction-safety models must handle concrete deployment risks, such as a worker standing near a scaffold edge without guardrails, rather than only recognize common objects in curated images. Yet real inspection archives are redundant, long-tailed, and collected across changing sites and months. We introduce SafeBuild-Bench, a metadata-driven benchmark for evaluating multimodal large language models on construction safety under realistic temporal and site variation. It is mined from 100K+ industrial image-text records and contains 3,314 task instances from over 3,000 expert-verified images, covering multiple-choice hazard identification and free-form hazard description. To make expert verification scalable, we develop GEMS, a graph-enhanced multimodal selection pipeline that combines a proxy-model confusion signal with graph-based diversity to identify informative candidates from redundant streams. On public instruction-tuning data, GEMS-selected subsets preserve robustness-oriented performance under small data budgets. On SafeBuild-Bench, current MLLMs remain far from reliable construction-safety understanding, with the best overall score near 60. We release the benchmark, evaluation scripts, and GEMS codebase at https://github.com/safebuild/gems.

[51] Explainable Multimodal AI for Adaptive Calibration of Archaeological Sensing Workflows cs.CVPDF

Nevio Dubbini, Daniel P. van Helden, Claudia Sciuto, Martina Naso, Arthur Leck

TL;DR: 本文提出了一种多模态机器学习框架，用于考古数字化工作流程中的校准监控、质量评估和自适应采集支持。该框架通过结合确定性质量指标、统计特征表示、机器学习分类、异常检测和可解释人工智能（XAI），统一处理摄影测量三维重建、高光谱成像、X射线荧光光谱和拉曼光谱数据。

Details

Motivation: 解决考古数字化中多模态传感数据采集的质量监控和校准问题，确保数据在统计上一致、物理上合理且适合下游多模态集成，而非替代仪器级校准。

Result: 在多模态考古数据集上的实验结果表明，该方法能有效捕捉有意义的采集变异性，并在异构传感模态间实现鲁棒的质量评估。

Insight: 创新点在于引入算法层进行跨模态统一质量评估，结合XAI增强可解释性，并支持基于特征空间偏差的自适应反馈和资源感知采集策略。

Abstract: This paper presents a multimodal machine-learning framework for calibration monitoring, quality assessment, and adaptive acquisition support in archaeological digitisation workflows. The proposed approach operates across photogrammetric 3D reconstruction, hyperspectral imaging, X-ray fluorescence spectroscopy, and Raman spectroscopy through a unified pipeline combining deterministic quality indicators, statistical feature representations, machine-learning classification, anomaly detection, and explainable artificial intelligence (XAI). Rather than replacing instrument-level calibration, the framework introduces an additional algorithmic layer that evaluates whether acquisitions are statistically consistent, physically plausible, and suitable for downstream multimodal integration. For each sensing modality, acquisitions are represented through structured feature spaces encoding geometric, spectral, spatial, and statistical properties. These representations are used to identify degradation patterns such as reconstruction artefacts, illumination inconsistencies, spectral distortions, detector instability, baseline fluctuations, and low signal-to-noise conditions. Supervised and unsupervised learning methods are combined with XAI techniques to support both automatic discrimination between acceptable and problematic acquisitions and interpretation of the underlying causes of degradation. The framework additionally supports adaptive feedback and resource-aware acquisition strategies by linking feature-space deviations to acquisition-level corrective actions. Experimental results obtained on multimodal archaeological datasets demonstrate that the proposed methodology captures meaningful acquisition variability and enables robust quality assessment across heterogeneous sensing modalities.

[52] Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs cs.CV | cs.AIPDF

Vahidin Hasic, Chao Wang, Luis C. Garcia-Peraza-Herrera, David Watson, Senka Krivic

TL;DR: 本文提出了一种名为反事实模态归因（CMA）的新颖可解释性框架，旨在量化多模态大语言模型（MLLMs）中图像和文本模态对最终预测的贡献程度。该方法通过耦合扩散先验生成反事实输入，并利用基于Shapley值的合作博弈论公式计算模态归因分数。

Details

Motivation: 现有可解释性方法（如识别有影响的图像区域或文本标记）无法回答一个根本问题：是哪个模态驱动了模型的预测？这可能导致模型基于错误的证据源做出正确预测，从而掩盖了捷径学习和不安全的推理过程。

Result: 在已知真实模态依赖性的受控合成基准测试中，CMA正确识别决策驱动模态的准确率达到98%。在真实世界的多模态临床数据集上，CMA也持续优于基线方法，揭示了仅凭预测准确性无法发现的跨模态推理失败案例。

Insight: 创新点在于将模态归因确立为超越特征归因的补充性可解释性维度，为安全关键应用中的多模态基础模型审计提供了一个原则性框架。其核心是利用反事实生成和博弈论方法，量化模态级别的贡献，从而诊断模型是否依赖了正确的证据源。

Abstract: Multimodal large language models (MLLMs) increasingly support high-stakes decision making by combining complementary information from images and text. While existing explainability methods identify influential image regions or text tokens, they cannot answer a fundamental question: which modality drives a prediction? Consequently, a model may produce the correct output while relying on the wrong source of evidence, masking shortcut learning and unsafe reasoning. We formulate modality attribution as a complementary explainability objective for multimodal foundation models and propose Counterfactual Modality Attribution (CMA), the first framework for quantifying modality-level contributions in MLLMs. CMA generates image-only, text-only, and joint multimodal counterfactuals using coupled diffusion priors and converts them into principled modality attribution scores through a cooperative game-theoretic formulation based on Shapley values. We evaluate CMA on controlled synthetic benchmarks with known ground-truth modality reliance and on a real-world multimodal clinical dataset. CMA correctly identifies the decision-driving modality in 98% of controlled cases and consistently outperforms baselines, revealing failures of cross-modal reasoning that remain invisible to predictive accuracy alone. Our results establish modality attribution as a complementary dimension of explainability beyond feature attribution, providing a principled framework for auditing multimodal foundation models in safety-critical applications.

[53] Beyond Accuracy: Auditing Spatial Provenance in Visual Token Pruning for OCR-Critical MLLM Inference cs.CVPDF

Feixiang Liu, Qiang Qiu, Hao Zhang, Xinyue Wang

TL;DR: 本文针对面向OCR关键任务的多模态大语言模型中的视觉令牌剪枝方法，提出超越传统精度评估的审计框架，重点关注剪枝后保留令牌的空间来源可追溯性。研究发现，在相同保留预算下，不同剪枝策略（如目标区域、随机、网格）虽能达到相近的答案精度，但在支持答案的关键OCR区域的空间覆盖度上存在显著差异，揭示了仅靠精度指标无法暴露的证据风险。

Details

Motivation: 现有视觉令牌剪枝评估通常只关注固定保留预算下的答案质量，忽略了在文本密集型MLLM任务中，即使答案正确，其对应的关键OCR区域可能未被任何保留令牌覆盖的潜在失败模式。

Result: 在Qwen、LLaVA和InternVL等模型上的实验表明，在30%保留率下，目标区域剪枝的精度（0.786）与全模型（0.783）相当，但其对答案支持区域的正向覆盖度（0.620）显著高于随机剪枝（0.270）和网格剪枝（0.318）。剪枝实现了最高4.32倍的批次预填充加速和76.4%的增量峰值内存降低，但在TextVQA和DocVQA任务上的验证表明，良好的目标验证点并不保证任务通用的压缩效果。

Insight: 创新点在于提出了一个结合答案行为、几何令牌来源可追溯性、干预措施和实际成本的证据风险审计框架，并引入了无需训练的可解释选择器来隔离可控操作点。核心启示是视觉令牌剪枝评估应同时报告空间来源可追溯性和实际成本，而不仅仅是质量和压缩率。

Abstract: Visual-token pruning is usually judged by answer quality at a fixed retention budget. For text-rich multimodal large language models (MLLMs), this protocol can miss a distinct failure: an answer remains correct even when no retained token is locally traceable to the small OCR region that supports it. We turn this blind spot into an evidence-risk audit that couples answer behavior with geometric token-origin provenance, interventions, and realized cost; transparent training-free selectors isolate controlled operating points. On locked image-disjoint confirmation, Qwen Target at 30% retention has observed accuracy 0.786 versus 0.783 for Full (paired image-cluster difference +0.003, 95% CI [-0.014, +0.020]), yet same-budget Target, Random, and Grid retain sharply different positive-support coverage: 0.620, 0.270, and 0.318. Across Qwen3-VL-8B, LLaVA-1.5-7B, and InternVL3.5-8B, matched controls, interventions, detector tests, and external methods reveal model-specific quality-risk-traceability frontiers that accuracy alone does not expose. Materialized prefixes yield up to 4.32x batch-prefill speedup and 76.4% lower incremental peak memory; full-validation TextVQA and DocVQA further show that favorable target-verification points do not imply task-general compression. Visual-token pruning should therefore report surviving spatial provenance and realized cost alongside quality and compression.

[54] LeapTalk: Breaking the Latency-Quality Trade-off in Talking Head Generation cs.CV | cs.SDPDF

Rongxiang Zhang, Songhua Liu

TL;DR: LeapTalk是一种新型的说话头部生成框架，旨在打破生成质量与延迟之间的权衡。它通过基于布朗桥的数据到数据传输公式和异构蒸馏方案，实现了仅需单步前向推理即可生成高质量、时序稳定的视频，速度高达200 FPS，并能扩展到任意长度的视频。

Details

Motivation: 解决长格式和实时说话头部生成中存在的延迟-质量权衡问题：多步扩散模型效率低，无法流式生成；而实时自回归方法则存在误差累积和身份漂移的缺陷。

Result: 大量实验表明，该方法仅需1步推理即可生成高保真度和时序一致的视频，速度高达200 FPS，在效率和稳定性方面均显著优于现有方法。

Insight: 核心创新点在于：1）基于布朗桥的数据到数据传输公式，通过持久参考锚点缓解身份漂移和增强长期时序稳定性；2）异构蒸馏框架，通过SNR对齐的时间变换函数来弥合预训练扩散教师模型与学生桥模型之间的功能差异；3）音频驱动的无分类器引导机制，在极端的步数减少下保持精细的唇部同步。

Abstract: Long-form and real-time talking-head generation remains challenging due to a latency-quality trade-off: inefficient multi-step diffusion prohibits streaming generation, whereas real-time autoregressive approaches suffer from error accumulation and identity drift. To address this drawback, we propose LeapTalk, a novel framework that achieves stable and real-time talking-head generation with a single forward step, scaling to arbitrarily long videos. At the heart of our approach lies a single-step bridge distillation scheme. On the one hand, departing from the conventional noise-to-data paradigm, we introduce a data-to-data transport formulation based on a Brownian bridge. Anchored by a persistent reference, this strategy effectively mitigates identity drift and enhances long-term temporal stability. On the other hand, to enable smooth knowledge transfer from a pre-trained diffusion teacher to the student bridge model, we explore a heterogeneous distillation framework with an SNR-aligned time transformation $Φ(τ)$, which bridges the functional discrepancy between the two models. Moreover, we propose an audio-driven classifier-free guidance mechanism to maintain fine-grained lip synchronization under extreme step reduction. Extensive experiments demonstrate that our method achieves high-fidelity and temporally consistent video generation with only 1 step at up to 200 FPS, significantly outperforming existing approaches in both efficiency and stability. Project Page: https://zhangrongxiang.github.io/leaptalk-page/

[55] From Pixels to PCells: A Neurosymbolic Approach to Photonic Component Creation cs.CV | physics.opticsPDF

Aadarsh Agarwal, Kenaish Al Qubaisi, Dirk Englund

TL;DR: PixCell是一个神经符号系统，通过多模态智能体将视觉呈现的光子组件转换为基于几何图元领域特定语言（DSL）的参数化程序。系统利用确定性视觉验证使评估成本远低于生成尝试，实现了从像素到参数化单元（PCell）的可靠转换。

Details

Motivation: 解决从视觉图像中自动、可靠地理解和生成可执行参数化光子组件设计的问题，以降低设计成本并提高准确性。

Result: 在八个组件目标上，PixCell的多模态智能体平均IoU超过0.9（最高达0.974和0.955），远超仅使用多种子采样和迭代修订的模型（平均最佳IoU仅0.416）。在干涉仪等案例中，重建的参数化程序满足了8.0 nm自由光谱范围目标和原始尺寸约束。

Insight: 创新点在于结合神经符号方法（多模态智能体）与确定性验证器，构建了一个非对称的评估-生成框架；该框架不仅能高精度完成视觉到参数的转换，其验证器还可用于生成训练奖励和数据，以无监督演示的方式训练模型（如Qwen3.6-35B-A3B），提升其在未见数据上的性能。

Abstract: We present PixCell, a neurosymbolic system in which multimodal agents convert a visually presented photonic component into a parametric program over a small domain-specific language (DSL) of geometric primitives. A system enabling deterministic visual verification renders evaluation asymmetrically cheaper than the generation attempt. While models using multi-seed sampling and iterative revision reach a mean best-turn IoU of only 0.416, multimodal agents through PixCell’s interface and verifier consistently exceed 0.9 mean IoU, with scores reaching 0.974 and 0.955 across eight component targets while also satisfying source contracts. These results demonstrate that frontier multimodal agents can reliably understand and render executable parametric representations from visual targets. Using these live parameters, cross-stack studies on an interferometer reconstruct primitive programs that satisfy an 8.0 nm free spectral range target and the original footprint constraint on modeled 220-nm SOI, 400-nm SiN, and 400-nm TFLN stacks. PixCell further carries a paper-derived splitter from visual reconstruction through SOI full-wave simulation, producing symmetric propagation and balanced outputs. Finally, the same executable verifier supplies a training reward and dataset used to train a Qwen3.6-35B-A3B model with LoRA and GRPO without supervised demonstrations. On eight training-excluded paper figures, its mean champion IoU rises from 0.422 after eight initial attempts to 0.491 after three verifier-guided revision rounds. These results therefore establish a controlled framework for measuring, retargeting, and improving visual-to-parametric photonic component design.

[56] DS@GT ARC at MEDIQA-CORE-Task-1 2026: Trimodal Model Fusion with Task-Specific Gates for Brain Tumor Subtype Classification cs.CVPDF

Hoang Thanh Thanh Truong, Charles R. Clark

TL;DR: 本文介绍了DS@GT ARC团队在MEDIQA-CORE 2026任务1（脑肿瘤亚型分类）中的工作，提出了一种结合MRI影像、组织病理学特征和放射学报告文本的三模态融合模型。通过探索不同的融合架构和报告编码器，并引入生物学启发的后处理，该模型在完全多模态条件下取得了优于组织者基线的性能，但性能高度依赖于组织病理学模态的可用性。

Details

Motivation: 脑肿瘤诊断是一个时间敏感的过程，患者通常需要等待数周才能获得最终的病理报告。这促使研究者开发自动化系统，利用多模态输入（如MRI、组织病理学和放射学报告）对肿瘤亚型进行分类，以加速诊断流程。

Result: 在完全多模态条件下，模型取得了0.801的平均宏F1分数，超过了组织者基线（0.796），在通过代码验证的团队中排名第二。然而，在模态缺失（尤其是组织病理学模态）的情况下，系统性能会下降至基线以下。

Insight: 创新点包括探索了两种三模态融合架构、使用了两种报告编码器（RadBERT和Llama-3.1-8B-Instruct），并引入了生物学启发的后处理阶段。客观来看，其任务特定的门控融合机制和针对不同模态（特别是文本报告）的编码器选择是值得借鉴的多模态集成策略。

Abstract: Brain tumor diagnosis is a time-sensitive process in which patients may wait weeks for a finalized pathology report. This problem motivates automated systems that classify tumor subtype from multimodal inputs. This paper details the DS@GT ARC team’s work for ImageCLEFmed MEDIQA-CORE 2026 Task~1, Brain Tumor Subtype Classification. The task evaluates three glioma classification problems: Level-1 Molecular Type, LGG vs HGG, and WHO Grade. We combine pre-extracted MRI (NeuroVFM) and histopathology (Prov-GigaPath) embeddings with free-text radiology reports. Our team explored two trimodal fusion architectures, two report encoders (RadBERT and Llama-3.1-8B-Instruct), and a biologically motivated post-processing stage. We achieve a mean macro-F1 of 0.801 under the Fully Multimodal condition, exceeding the organizers’ baseline of 0.796 and ranking second among the teams whose code passed verification. Additional evaluation across modality-dropping conditions shows that this advantage depends heavily on the availability of the histopathology modality, and that our system falls behind the baseline when modalities are missing. Our code is available on GitHub at https://github.com/dsgt-arc/imageclef-mediqacore-2026.

[57] Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh cs.CVPDF

Junhao Chen, Mingjin Chen, Henghaofan Zhang, Minglin Chen, Liaoyuan Fan

TL;DR: 该论文提出了一种名为DAR的参考引导渲染器，它将预训练的视频扩散模型扩展为原生4D渲染器，用于从动画网格生成逼真的视频。DAR通过注入从动画网格投影出的神经4D G-缓冲区（包含跟踪、世界坐标和法线信息）来控制渲染过程，从而同时遵循相机运动和场景内部动画。

Details

Motivation: 论文旨在解决一个表示问题：在4D生成式渲染设置中，当场景状态已由动画网格、相机轨迹和参考图像指定时，什么样的图像格式条件能让视频主干网络同时服从相机运动和场景内部动画？

Result: 在DAR-4D基准测试的68个案例上，LoRA DAR达到了PSNR 23.22、SSIM 0.895和LPIPS 0.134，比现成的Wan2.2-Depth方法在PSNR上提升了1.54 dB；完全微调的版本达到了PSNR 25.36和SSIM 0.917。消融实验表明，用深度图替代世界坐标会使PSNR在每个检查点下降1.26-1.55 dB。

Insight: 核心创新点在于提出了使用跟踪（tracking）和世界坐标（world position）的配对作为4D渲染条件，这比仅使用深度图能更有效地解耦相机和物体运动，从而更好地保持预训练的图像到视频先验。该方法通过一个扩展的控制适配器注入神经4D G-缓冲区，实现了对相机和几何的联合控制。

Abstract: Pretrained video diffusion models can act as renderers when the desired scene state is already specified by an animated mesh, a camera trajectory, and a reference image. This 4D generative rendering setting raises a representation question: what image-format condition lets a video backbone obey both camera motion and scene-internal animation? We propose DAR, a reference-guided renderer that extends Wan2.2 camera control from Plücker rays alone to a joint camera-plus-geometry interface. DAR projects a neural 4D G-buffer (tracking, world position, and normal) from the animated mesh and injects it through a widened control adapter while preserving the pretrained image-to-video prior. The central design choice is the pair of tracking and world position. Tracking identifies the persistent surface element that should carry appearance; world position gives its current scene-coordinate state; normal supplies local shape. Depth plus calibrated rays can recover 3D in principle, but depth is a camera-dependent chart in which camera and object motion are mixed. On the 68-case DAR-4D benchmark, LoRA DAR reaches PSNR 23.22, SSIM 0.895, and LPIPS 0.134, improving over off-the-shelf Wan2.2-Depth by 1.54 dB PSNR; a full fine-tune reaches PSNR 25.36 and SSIM 0.917. Matched ablations show that replacing world position by depth reduces PSNR by 1.26–1.55 dB at every checkpoint, supporting tracking+world-position correspondence as a practical 4D rendering condition.

[58] Logographic Character Visual Pretraining via Semantic-based Contrastive Learning cs.CV | cs.AIPDF

Daqian Shi, Wei Cao, Xiaoyu Zheng, Lida Shi, Xiaolei Diao

TL;DR: 本文提出了一种基于语义对比学习的表意文字视觉预训练方法，旨在解决表意文字（如汉字）数据分布不平衡和罕见实例的问题。该方法通过结合字符的视觉语义和上下文语义，设计了一种新颖的预训练策略来增强深度视觉表示，并在多个数据集和下游任务上验证了其有效性。

Details

Motivation: 当前基于深度学习的字符视觉研究（如文本识别、字符图像去噪和历史文本补全）在数据量大且平衡时表现最佳，但现实中的表意文字数据集常因使用频率差异和新字符不断创建而存在数据分布不平衡问题，限制了模型性能。

Result: 实验结果表明，该方法在多个数据集上的字符识别任务中优于现有最先进方法，并通过多个下游任务进一步验证了对比预训练策略的优越性。

Insight: 创新点在于引入多模态学习方法，结合字符的视觉语义和从语言模型中提取的上下文语义，设计了一种针对不平衡和罕见实例的对比预训练策略，以增强表意文字的视觉表示能力。

Abstract: Current deep learning-based character vision studies, e.g., text recognition, character image denoising, and historical text completion, are offering new solutions for learning, managing, and utilizing character resources. However, the performance of these studies peaks only with large and balanced datasets, which is a rarity with real-world character datasets, especially for logographic character languages, e.g., Chinese. The imbalance in data distribution of logographic characters is a common issue due to differences in character usage frequency and new characters being continuously created. In this paper, we propose a novel method for logographic character recognition, which introduces a multi-modal learning approach using visual semantics and contextual semantics of characters. A novel pre-training strategy is designed to enhance deep visual representations, especially for datasets suffering from issues of imbalanced and rare instances, by extracting the contextual semantics of each character from the corresponding language models. We conduct experiments across various datasets to evaluate our character recognition method and further validate the contrastive pre-training strategy by several downstream tasks. Experimental results demonstrate the superiority of our method compared to state-of-the-art methods.

[59] SPARC-Rad: A Multimodal Benchmark Dataset and Evaluation Pipeline for Spatial and Anatomical Reasoning in Radiology Vision-Language Models cs.CV | cs.AIPDF

Satvik Tripathi, Mustafa Ege Seker, Kristian Quevada, Ebubechukwu D Enwerem, Pratham Khandelwal

TL;DR: 本文介绍了SPARC-Rad基准，这是一个用于评估放射学视觉语言模型（VLMs）空间和解剖推理能力的多模态基准数据集和评估流程。该基准包含300个从健康对照影像中提取的图像-问题对，涵盖多种成像模态和解剖区域，旨在测试模型在解剖识别、定位、空间关系等方面的能力。

Details

Motivation: 当前医学影像领域的VLM评估基准多侧重于疾病分类、报告生成或广义视觉问答，缺乏对放射学所需的空间和解剖推理能力的专门评估，因此需要开发一个针对性的基准来填补这一空白。

Result: 论文提出了SPARC-Rad基准数据集和评估流程，但摘要中未提及具体模型在该基准上的定量结果或SOTA比较，主要贡献在于构建了基准本身。

Insight: 创新点在于首次构建了一个专注于放射学空间和解剖推理的手动策划多模态基准，并设计了标准化的评估流程（包括LLM-as-judge评分和子组分析），为未来模型开发、失败模式分析和部署前评估提供了可重用框架。

Abstract: Vision-language models (VLMs) are increasingly being evaluated for medical imaging, but many available benchmarks emphasize disease classification, report generation, or broad visual question answering rather than the spatial and anatomical reasoning required for radiology. We developed the Spatial Perception and Anatomical Reasoning in Clinical Radiology (SPARC-Rad) Benchmark, a manually curated multimodal benchmark dataset and evaluation pipeline for assessing these capabilities in radiology VLMs. SPARC-Rad includes 300 image-question pairs derived from healthy control imaging studies in The Cancer Imaging Archive (TCIA), spanning CT, MRI, and radiography across the abdomen, chest, breast, neuro, and musculoskeletal categories. Radiology trainees manually designed and annotated questions to evaluate anatomical identification, localization, laterality, regional recognition, device identification, and inter-structure spatial relationships. The evaluation pipeline supports standardized prompting, structured output collection, response normalization, LLM-as-judge grading, human quality review, binary correctness scoring, and subgroup analysis by modality, anatomy, and reasoning type. SPARC-Rad provides a reusable framework for evaluating whether VLMs can provide reasoning for radiologic anatomy as a spatial system, supporting future model development, failure-mode analysis, and pre-deployment assessment.

[60] Distill What RGB Can Recover: Privileged 3D Evidence for RGB-Only Vision-Language Models cs.CVPDF

Yanbin Hu, Jin Cui, Jun Ye, Jiepeng Zhou, Jiangcheng Song

TL;DR: 本文提出了一种特权证据蒸馏框架，旨在将训练时可用的3D证据转化为RGB-only推理时保留的空间推理能力。该框架通过统一的证据接口和受控残差注入构建可蒸馏的教师模型，并通过logit和结构化表示蒸馏将知识迁移至仅接收RGB图像和问题的可部署学生模型。

Details

Motivation: 解决RGB图像在3D场景理解中3D线索不足的问题，同时避免现有3D-VLMs在推理时依赖深度或3D位置感知输入所带来的额外采集、重建或标注成本，从而实现仅使用RGB图像进行部署。

Result: 在四个基准测试中，教师模型在11个报告指标中的7个上取得了最佳结果；仅使用RGB的学生模型在所有11个指标上均优于其匹配基线，例如在ScanQA CIDEr上提升10.4，在Scan2Cap CIDEr@0.5上提升19.1，且无需额外的推理时输入。

Insight: 创新点包括特权证据蒸馏框架、证据敏感性引导的蒸馏以避免模仿RGB无法支持的教师信号，以及基于匹配基线-教师-学生的可恢复性分解来分析特权增益的转移；这为在训练时利用3D证据增强RGB-only模型的3D空间推理能力提供了有效途径。

Abstract: 3D scene understanding requires reasoning about entity existence, spatial layout, and object relations, yet RGB images alone often provide insufficient 3D cues. Existing 3D-VLMs commonly rely on depth or 3D-position-aware inputs at inference time, introducing additional acquisition, reconstruction, or annotation costs that limit RGB-only deployment. We therefore study how training-time 3D evidence can be converted into spatial reasoning capabilities retained under RGB-only inference. We propose a privileged-evidence distillation framework that constructs a distillable teacher through a unified evidence interface and controlled residual injection, and transfers its knowledge to a deployable student receiving only RGB images and questions through logit and structured representation distillation. To avoid imitating teacher signals unsupported by RGB, we further introduce evidence-sensitivity-guided distillation, which uses corrupted evidence to identify highly evidence-dependent targets and down-weight their supervision. We also define a recoverability decomposition based on the matched baseline, teacher, and student, separating privileged gains into RGB-recoverable improvements and residual teacher advantages. Across four benchmarks, the teacher achieves the best result on 7 of 11 reported metrics among the compared methods. The RGB-only student outperforms its matched baseline on all 11 metrics, including gains of 10.4 ScanQA CIDEr and 19.1 Scan2Cap CIDEr@0.5, without additional inference-time inputs. These results validate the effectiveness of training-time privileged 3D evidence distillation for both teacher performance and deployable RGB-only spatial reasoning. Separately, our matched baseline-teacher-student analysis characterizes privileged-gain transfer across evidence types and spatial skills.

[61] Counting the Cost of War Under Satellite Embargo: Zero-Shot Estimation of Impacted Infrastructure cs.CV | cs.AIPDF

Saleh Sakib Ahmed, M. Sohel Rahman

TL;DR: 本文提出一种零样本方法，用于在卫星数据禁运情况下快速估算冲突区受损基础设施。该方法利用战前地图和开源事件报告，通过大语言模型提取武器载荷并基于霍普金森-克兰兹标度计算爆炸影响范围，再结合自适应视场分割与2.5D伪高度深度图技术，使用大型视觉语言模型对密集城区建筑进行计数。

Details

Motivation: 解决冲突区人道主义响应中因卫星数据禁运导致无法及时评估建筑损毁的问题，通过战前地理数据与事件文本实现零样本影响评估。

Result: 在2026年中东冲突数据上评估显示，深度增强的大型视觉语言模型在密集城区显著优于传统分割方法，形成了针对稀疏农村区域的超快2D分割与针对密集城区的深度增强LVLM混合范式。

Insight: 创新点包括将受损建筑测绘重构为零样本几何投影任务，提出消除分辨率偏差的自适应视场分割方法，以及结合2.5D深度图帮助LVLM解析重叠屋顶；技术范式上实现了文本情报、物理模型与多模态AI的跨领域融合。

Abstract: Rapid estimation of impacted structures - critical for conflict-zone humanitarian response - is frequently hindered by post-strike satellite data embargoes and imagery blackouts. We bypass this operational bottleneck by reframing impacted building mapping as a zero-shot geometric projection task on archival, pre-strike maps. Using coordinate and incident text from LiveUAMap and ArcGIS, Large Language Models extract weapon payloads (W) to project kinetic blast perimeters via Hopkinson-Cranz scaling (R_base = Z * W^(1/3)). To count exposed structures within these zones without post-strike imagery, we introduce two technical innovations: Adaptive Field-of-View to eliminate resolution (zoom) bias in 2D segmentation (SAMGeo), and 2.5D pseudo-height depth maps combined with segmentation masks to help Large Vision-Language Models (LVLMs) resolve overlapping, dense rooftops. Evaluated on 2026 Middle East conflict data, depth-augmented LVLMs dramatically outperform traditional segmentation in congested urban centers. This establishes a powerful hybrid paradigm for zero-shot crisis mapping: ultra-fast 2D segmentation for sparse rural zones, and depth-augmented LVLMs for dense urban environments.

[62] RadPRISM: Schema-stratified radiology-report supervision for concept-disentangled image representations and visual grounding cs.CV | cs.LGPDF

Fabian Drexel, Marlene Fritzsche, Era Stambollxhiu, Miriam Kumpf, Lena Schmitzer

TL;DR: RadPRISM是一种新型的视觉-语言预训练方法，通过引入临床医生定义的放射学模式作为分层轴，将自由文本报告中的每个临床概念对齐到其专用的视觉子空间中，从而学习到概念解耦的图像表示。该方法在胸部X光片上进行了实例化，显著提升了零样本分类性能和视觉定位能力，并展示了概念分层检索的优势。

Details

Motivation: 现有的视觉-语言预训练方法通常在单一共享嵌入空间中操作，导致概念级结构和可解释性只能在事后恢复，限制了模型的透明度和临床实用性。

Result: 在内部数据集上，RadPRISM将零样本分类的宏观AUROC从0.717提升至0.868；在外部零样本分类中与专门构建的CARZero模型表现相当，但在视觉定位任务中显著优于后者（最高达4.3倍）。放射科医生阅读研究证实了其概念分层检索能力（排名前3的宏观检索正确率为0.78）。

Insight: 核心创新在于将临床模式作为显式的分层监督，通过大型语言模型提取每个概念对应的文本片段，并让每个概念在其专用子空间中进行对齐，从而实现了原生、可解释且临床医生可检查的概念解耦表示学习。

Abstract: Vision-language pretraining learns rich medical image representations from radiology reports, but previous model variants commonly operate within a single shared embedding space, so concept-level structure and interpretability must be recovered post hoc, limiting model transparency and, hence, clinical utility. We introduce RadPRISM, which makes a clinician-defined radiology schema a designated stratification axis: an on-premise large language model extracts per-concept text spans from free-text reports, and each clinical concept is aligned in its own dedicated visual subspace, turning concept stratification into direct, top-level alignment supervision. Instantiated on chest radiographs with a 19-concept schema over $203{,}602$ examinations from an internal multi-year archive, RadPRISM improved internal dataset zero-shot classification from $0.717$ (95% CI, $0.710-0.723$) to $0.868$ (95% CI, $0.863-0.872$) macro AUROC over a matched global-alignment baseline, performed on par with the purpose-built CARZero reference in external zero-shot classification while substantially outperforming it (up to 4.3-fold) in pointing-game visual grounding. In addition, a radiologist reader study demonstrated concept-stratified retrieval ability ($0.78$ macro retrieval correctness rate within rank 3), surfacing disentangled descriptive findings that report-level retrieval and fixed-label vocabularies cannot express. RadPRISM yields discriminative, spatially faithful, natively concept-stratified representations shaped by and transparently inspectable by clinicians.

[63] Learning How Much, Not Just What: Cross-Patient Burden Order for CT Vision-Language Pretraining cs.CVPDF

Guoliang You, Haifan Gong, Xiaomeng Chu

TL;DR: 本文提出Spectrum框架，通过跨患者CT扫描的弱监督信号学习疾病负担的排序表示，解决了传统CT视觉语言预训练仅关注病变存在性而忽略严重程度的问题。该方法利用解剖结构条件化表示，从不同患者的报告中挖掘疾病负担从轻到重的配对，并通过负担方向对齐（BDA）约束图像与报告差异的一致性。

Details

Motivation: 传统CT视觉语言预训练仅学习病变存在性（what），但无法区分同一病变的严重程度（how much），导致报告中的分级语言信息被简化为存在/缺失信号；纵向匹配数据稀缺，而横断面队列中已隐含跨患者的弱负担线索。

Result: 在CT-RATE数据集上达到85.6的零样本AUROC，在外部RAD-ChestCT数据集上达到72.7 AUROC，在线性探测和检索任务中均取得一致提升。

Insight: 利用跨患者弱监督排序信号作为解剖感知对应的补充，无需纵向数据即可学习负担感知表示；通过病理条件化的图像-报告差异对齐，约束了传统图像-报告对比学习未触及的类内结构。

Abstract: Volumetric CT vision-language pretraining learns 3D representations from scan-report pairs, but global and anatomy-aware objectives supervise only correspondence: they establish what is present and leave how much unconstrained. Nothing separates a mild from an extensive case of the same finding along a consistent direction, so the graded burden language in reports collapses into a present/absent signal. Longitudinal supervision would supply this order, but patient-matched CT pairs are scarce at scale; cross-sectional cohorts already encode weak burden cues across different patients. We introduce Spectrum, an anatomy-conditioned framework that represents each study at whole-study and organ scopes. For each organ-mapped pathology, a rule-based scorer mines confidence-filtered lower-to-higher pairs of different patients, and Burden-Direction Alignment (BDA) aligns the pathology-conditioned image delta with the report delta at each scope, separating that direction from its reverse. Because the endpoints are different people, a target-conditioned aligner first makes them comparable, so the delta reflects burden rather than between-patient variation. BDA further separates the selected direction from its reverse, anchors it to the observed higher-burden endpoint, and enforces consistency across ordered triplets. Since every pair is drawn within a single pathology, BDA is designed to constrain intra-class structure that image-report contrast alone never touches. Spectrum attains 85.6 zero-shot AUROC on CT-RATE and 72.7 on external RAD-ChestCT, with consistent gains in linear probing and retrieval. Weak cross-patient order is thus a scalable complement to anatomy-aware correspondence, yielding burden-aware CT representations without longitudinal data.

[64] Real-Time Visual Obstruction Detection in Surgical Augmented Reality cs.CVPDF

Shih-Chin Yang, Yanming Xiu, Hanting Ye, Qi Chen, Elias Rotondo

TL;DR: 本文提出了一种用于手术增强现实（AR）的实时视觉遮挡检测系统。该系统采用级联的小型到大型视觉语言模型（VLM）架构，结合基于分割的遮挡推理，旨在检测虚拟内容是否遮挡了手术任务相关的真实世界信息（如手术器械）。

Details

Motivation: 手术AR通过叠加虚拟注释来提供指导，但这些虚拟内容可能会遮挡关键的真实手术器械，在时间敏感的任务中干扰用户感知。因此，需要一种能够实时、准确检测此类遮挡的方法。

Result: 在一个通过将虚拟内容叠加到手术工具图像上构建的伪AR遮挡检测基准上，所提系统实现了87.43%的遮挡检测准确率，平均端到端延迟为479毫秒，相比云端大型模型基线延迟降低了62.90%。

Insight: 创新点在于提出了一个延迟感知的级联VLM架构，通过分割一致性引导的早期退出和基于注意力的视觉令牌剪枝来降低推理开销。这为在资源受限环境下实现实时AR交互提供了可行的系统设计思路。

Abstract: Surgical augmented reality (AR) can provide contextual guidance by overlaying virtual annotations, tool cues, and procedural information onto the surgical workspace. However, the virtual content may obstruct task-relevant real-world information, such as surgical instruments, and interfere with users’ perception during time-sensitive surgical tasks. In this paper, we investigate visual obstruction detection for surgical AR and present a latency-aware pipeline that combines vision-language model (VLM)-based surgical-object recognition with segmentation-based obstruction reasoning. To reduce inference overhead, the system adopts a cascaded small-to-large VLM architecture with segmentation-guided early exiting and attention-based visual token pruning. The small VLM handles easy frames when its key-object prediction is supported by segmentation consistency, while difficult frames are forwarded to a large VLM with pruned visual tokens. We construct a pseudo-AR surgical obstruction detection benchmark by overlaying virtual content onto surgical-tool images and labeling whether the virtual content obstructs task-relevant instruments. Evaluation results show that the proposed system achieves 87.43% obstruction detection accuracy with an average end-to-end latency of 479 ms, reducing latency by 62.90% compared with a cloud large-model baseline. These results demonstrate the feasibility of latency-aware obstruction detection for surgical AR and motivate future work on dynamic surgical videos, multi-object scenes, and clinically grounded AR guidance content.

[65] Attention-Steered Vision-Language Models for Sign Language Translation cs.CVPDF

Meibo Hu, Guohao Sun, Annemarie D. Ross, Sheng Li, Zhiqiang Tao

TL;DR: 本文提出AttnSign，一种基于视觉语言模型（VLM）的时空注意力引导框架，用于解决手语翻译任务中现有方法存在的时空视觉定位不佳问题。该方法通过引入空间注意力监督和基于强化学习的运动节奏引导，使模型能更好地关注手语相关的关键区域和关键帧。

Details

Motivation: 现有基于VLM的手语翻译器存在关键失败模式：时空视觉定位能力差，标准的下一个词元交叉熵损失无法直接提供模型应在何时何地注意的信号，导致模型忽略手语相关区域和帧。

Result: 在How2Sign和OpenASL基准测试上的实验结果表明，AttnSign方法持续优于现有方法。

Insight: 创新点在于通过空间注意力监督（针对面部和手部等区域）和基于强化学习的运动节奏引导来显式地引导模型的时空注意力，这为解决多模态视频理解中细粒度时空对齐问题提供了新思路。

Abstract: Vision-language models (VLMs) have emerged as a powerful framework for multimodal video understanding. However, they remain limited in the sign language translation task, where we identify a key failure mode of existing VLMbased translators: poor spatial-temporal visual grounding. In particular, we find that standard next-token cross-entropy does not directly provide signal for where and when the model should attend, causing models to overlook sign-relevant regions and frames. To address this challenge, we propose AttnSign, a VLM-based spatial-temporal attention steering framework for sign language translation. AttnSign first introduces spatial attention supervision for sign-relevant regions, such as face and hands, in each frame; then develops an RL-based motion-cadence steering method that encourages the model to explore and focus on sign-level keyframes. Experimental results on How2Sign and OpenASL benchmarks show that our proposed AttnSign consistently outperforms existing methods.

[66] Latent-Centroid Steering: Single-Pass Classifier-Free Guidance for Command-Aligned Autonomous Driving cs.CV | cs.ROPDF

Meibo Hu, Jiamian Wang, Pichao Wang, Zhiqiang Tao

TL;DR: 本文针对基于视觉语言模型（VLM）的端到端自动驾驶中存在的指令跟随性能不足问题，提出了一种名为潜在质心转向（LCS）的单次无分类器引导方法。该方法通过将条件表示向预计算的指令特定质心投影，在推理时显式放大导航指令的影响，从而在降低约50%推理延迟的同时，提升了指令遵循能力和驾驶性能。

Details

Motivation: 现有基于VLM的自动驾驶模型在实践中表现出持续的指令跟随差距：预测轨迹对导航指令的敏感性较弱，导致在关键决策点出现错误行为。这被识别为一种条件策略崩溃问题，即基于回归的训练在多模态轨迹分布下，鼓励模型依赖主导的视觉先验，而边缘化了语言条件信号。

Result: 在闭环（Bench2Drive）和开环（nuScenes）基准测试上，LCS方法在实现更强指令遵循和改善驾驶性能的同时，将推理延迟降低了约50%。

Insight: 核心创新点在于从均值漂移角度解释无分类器引导（CFG），并提出用类级别的潜在偏移（通过向预计算的指令特定质心投影）替代实例级残差，从而实现了更稳定、计算效率更高的单次引导机制。这为解决回归型VLM中的条件策略崩溃问题提供了一个原则性的、高效的解决方案。

Abstract: Vision-language models (VLMs) have recently emerged as a promising paradigm for end-to-end autonomous driving, enabling agents to map multimodal inputs and high-level navigation instructions directly to executable trajectories. However, in practice, these models exhibit a persistent command-following gap: predicted trajectories often show weak sensitivity to navigation commands, resulting in incorrect behavior at critical decision points. We identify this issue as a form of conditional policy collapse, where regression-based training under multimodal trajectory distributions encourages the model to rely on dominant visual priors while marginalizing the language-conditioned signal. To address this issue, we introduce a principled formulation of classifier-free guidance (CFG) for regression-based vision-language driving. We show that CFG can be interpreted as isolating the instruction-induced residual in the action space by contrasting conditional and unconditional predictions, thereby explicitly amplifying the effect of the navigation command at inference time. However, a standard two-pass CFG introduces prohibitive latency for real-time control and produces noisy instance-level guidance directions. Building on a mean-shift interpretation of CFG, we propose Latent-Centroid Steering (LCS), a single-pass guidance mechanism that replaces instance-level residuals with class-level latent shifts. By projecting conditional representations toward precomputed command-specific centroids, LCS performs class-level latent steering based on cluster geometry that is both more stable and computationally efficient. We demonstrate that LCS reduces inference latency by approximately 50% while achieving stronger command adherence and improved driving performance on both closed-loop (Bench2Drive) and open-loop (nuScenes) benchmarks. Code will be released.

[67] MDWD: A Street-Level Dataset for Municipal Solid Waste Detection in Dense Urban Environments cs.CVPDF

Andrea Filiberto Lucas, Mark Bugeja, Carl James Debono, Dylan Seychell

TL;DR: 本文介绍了马耳他生活垃圾数据集（MDWD），这是一个用于密集城市环境中生活垃圾检测的街景级数据集，包含3,697张高分辨率图像和11,461个手动标注的实例，涵盖五个生活垃圾类别。研究通过跨架构基准测试（包括YOLO系列和基于Transformer的检测器）建立了可重复的基线，其中RF-DETR-M在测试集上取得了最佳性能。

Details

Motivation: 现有废弃物相关数据集主要关注单个垃圾检测、航拍图像或图像级分类，缺乏在结构化市政收集背景下同时提供街景级图像、实例级定位和家庭废弃物分类的数据集，因此需要构建一个专门的基准资源来推动城市环境自动视觉监测的研究。

Result: 在测试集上，RF-DETR-M模型实现了最高的整体性能，mAP50达到94.49%，F1分数为93.56%；同时，较小容量的变体在显著减少参数量的情况下仍保持了有竞争力的准确率。

Insight: 创新点在于首次构建了一个结合街景级图像、实例级定位和市政收集背景分类的生活垃圾数据集，并验证了该数据集能有效支持从紧凑的实时检测器到基于Transformer的模型的训练，为未来基于视觉的市政废弃物监测研究设立了基准。

Abstract: Automated visual monitoring of urban environments is a growing Computer Vision research area, but municipal solid waste detection remains under-represented in dedicated benchmark resources. Existing waste-related datasets predominantly address individual litter detection, aerial imagery, or image-level classification, and none simultaneously provide street-level imagery, instance-level localization, and categorization of domestic waste streams within a structured municipal collection context. This paper introduces the Maltese Domestic Waste Dataset (MDWD), a street-level benchmark comprising 3,697 high-resolution images and 11,461 manually annotated instances across five domestic waste categories representative of Malta’s municipal collection system. The dataset captures substantial variation in location, illumination, object scale, occlusion, and urban context. To establish reproducible baselines, a cross-architecture benchmark is conducted across multiple generations of the YOLO family and a transformer-based detector. On the test set, RF-DETR-M achieves the strongest overall performance with an mAP50 of 94.49% and an F1-score of 93.56%, whilst smaller-capacity variants maintain competitive accuracy at substantially reduced parameter counts. These results indicate that MDWD supports effective training across both compact real-time detectors and transformer-based models, establishing a benchmark for future research in vision-based municipal waste monitoring.

[68] Semantically Calibrated Evidence Composition for CT Vision-Language Learning cs.CVPDF

Guoliang You, Haifan Gong, Xiaomeng Chu

TL;DR: 本文提出了SCOPE框架，用于解决CT影像与报告对的可迁移表示学习问题。该框架通过掩码引导的器官特异性查询提取上下文感知的器官证据，并利用全局查询驱动局部-全局耦合，将器官证据组合成统一的证据表示。随后，该组合证据通过诊断摘要进行语义校准，并作为受控残差集成到与完整报告对齐的、保留上下文的整体容积表示中。

Details

Motivation: 现有方法要么强调全局的CT-报告对齐（保留了广泛的研究背景但局部证据贡献不明确），要么强调细粒度的解剖结构级对应（显式地定位局部发现但未指定独立表示的证据应如何交互、获取研究级意义并贡献于全局CT表示）。SCOPE旨在弥合这一差距，连接局部证据与研究级语义。

Result: 在CT-RATE和RadChestCT基准测试上，SCOPE分别取得了85.0和72.2的宏观AUC，比之前的SOTA方法分别高出7.2和4.2个百分点，同时在线性探测和跨模态检索任务上也取得了显著提升。

Insight: 核心创新在于提出了语义校准的证据组合框架。其通过固定解剖身份的掩码引导查询提取器官证据，并利用全局查询驱动局部-全局耦合进行组合，最后通过诊断摘要进行语义校准并作为受控残差集成，从而在不将CT表示简化为预定义器官集的情况下，将局部证据与研究级语义连接起来。

Abstract: Learning transferable representations from CT-report pairs requires combining whole-volume context with anatomy-specific evidence. Existing methods typically emphasize either global CT-report alignment or fine-grained anatomy-level correspondence. Global alignment preserves broad study context but leaves the contribution of localized evidence implicit, whereas anatomy-level alignment explicitly grounds local findings but does not specify how independently represented evidence should interact, acquire study-level meaning, and contribute to a global CT representation. To address this gap, we propose SCOPE (Semantic Calibration Of comPosed Evidence), a framework for semantically calibrated evidence composition in CT vision-language learning. Under organ-specific report supervision, mask-guided queries with fixed anatomical identities extract context-aware organ evidence from shared, uncropped volumetric features, while an unrestricted global query retains access to whole-volume context. The global query then drives Local-Global Coupling to compose the organ evidence into a unified evidence representation. The composed evidence is subsequently calibrated using the diagnostic summary, providing study-level semantic supervision beyond local organ descriptions, and is finally integrated as a controlled residual into a context-preserving whole-volume representation aligned with the complete report. This progressive pathway connects localized evidence with study-level semantics without reducing the CT representation to a predefined set of organs. On CT-RATE and RadChestCT, SCOPE achieves macro AUCs of 85.0 and 72.2, respectively, outperforming the previous SOTA by 7.2 and 4.2, while also yielding substantial gains in linear probing and cross-modal retrieval. These results demonstrate the effectiveness of semantically calibrated evidence composition.

[69] Interpretability-Guided Soft Pruning of Attention Heads in Vision Transformers cs.CV | cs.AIPDF

Kamil Książek, Piotr Suszyński, Michał Jan Włodarczyk, Jacek Tabor, Przemysław Biecek

TL;DR: 本文提出了一种基于可解释性指导的视觉Transformer注意力头软剪枝方法。首先通过拉普拉斯特征向量对注意力头进行谱分析和可视化，识别功能冗余；然后引入SAPER（Soft Attention PrunER）端到端可微分剪枝框架，在ImageNet-1K上实现了优异的精度-效率权衡。

Details

Motivation: 针对视觉基础模型（如DINOv2）计算开销大、架构不透明的问题，旨在通过可解释性分析指导模型压缩，提升效率同时保持性能。

Result: 在ImageNet-1K上的实验表明，SAPER在FLOPs削减方面优于RAPTOR基线，同时保持了较强的分类性能，实现了良好的精度-效率平衡。

Insight: 创新点包括基于拉普拉斯特征向量的注意力头谱分析与可视化方法，以及利用LapSum Soft Top-K实现的端到端可微分软剪枝框架，为Transformer压缩提供了可解释性驱动的解决方案。

Abstract: Vision foundation models, such as DINOv2, learn highly expressive representations but rely on massive, opaque architectures that demand substantial computational power and memory. To provide an interpretable-guided and efficient solution to this issue, we first propose a spectral analysis and new visualization technique for individual attention heads based on the Laplacian eigenvectors of their attention maps. Building upon recent observations regarding the block structure of Vision Transformers, we perform semantic clustering of attention heads and identify functional redundancies. Leveraging these insights, we introduce SAPER (Soft Attention PrunER), an end-to-end differentiable pruning framework based on the LapSum Soft Top-K approach. Extensive experiments on ImageNet-1K demonstrate that SAPER achieves a highly favorable accuracy-efficiency trade-off, outperforming the competitive RAPTOR baseline in FLOPs reduction while preserving strong classification performance.

[70] The 1st AI Children Challenge cs.CVPDF

Boyi Li, Yifan Shen, Houze Yang, Xu Cao, Guojun Yun

TL;DR: 该论文介绍了首届AI儿童挑战赛，聚焦于计算机视觉和AI在儿童医疗、教育和儿科领域的应用。2026年CV4CHL版本推出了首个赛道：儿童步态视觉分析，旨在从关键点序列中细粒度分析儿童步态行为。挑战赛包含两个问题赛道：爱丁堡视觉步态评分（EVGS）和双侧痉挛性脑瘫步态模式分类，并提供了首个相关数据集和真实标注，以促进解决方案的评估和可重复性。

Details

Motivation: 解决儿童步态视觉分析在现实应用中的空白，因为尽管经验丰富的医生能区分细微差异，但现有AI模型尚未在此领域得到充分测试，挑战赛旨在通过数据集和竞赛推动该方向的发展。

Result: 挑战赛提供了首个儿童步态关键点序列数据集，覆盖3-16岁年龄组，并设置了两个赛道，最终排名将在竞赛结束后公布，以促进可重复性和减少过拟合。

Insight: 创新点在于首次将细粒度儿童步态分析引入AI挑战赛，并基于儿科医生咨询选择赛道，提供了标准化数据集和真实标注，为医疗诊断中的计算机视觉应用开辟了新方向。

Abstract: The First AI Children Challenge aims to advance real-world applications of computer vision and AI in child healthcare, child education, and pediatrics. The 2026 CV4CHL edition featured the first track in this domain: Children Gait Visual Analysis. The main goal of Children Gait Visual Analysis is the fine-grained analysis of children’s gait behaviors from keypoint sequences. This is still a big challenge for human action recognition. Experienced medical doctors can distinguish these subtle nuances, but none of the people test AI models in this domain. To bridge this gap, we introduce thousands of 2D children keypoint sequences walking around videos across various age groups of children (3-16 years old). There is a significant opportunity for batch analysis of these videos to provide clinically relevant insights into medical diagnosis. The Challenge will be launched with two problem tracks: Edinburgh Visual Gait Score (EVGS) Scoring and Classification of Gait Patterns in Bilateral Spastic Cerebral Palsy. Each track is chosen in consultation with board-certified pediatricians based on the value of potential solutions. With the first available dataset for such tasks and ground truth for each track, the challenge enabled participants to evaluate their solutions. Final rankings will be revealed after the competition concludes, fostering reproducibility and mitigating overfitting.

[71] ORCA: ORgan-Centroid Aggregation for Training-Free 3D CT Visual Token Compression cs.CV | cs.AIPDF

Renjie Liang, Zijian Xu, Jinqian Pan, Chengkun Sun, Zhengkang Fan

TL;DR: 本文提出了ORCA（ORgan-Centroid Aggregation），一种用于3D CT扫描的无训练、即插即用视觉令牌压缩方法。该方法通过器官引导聚合相邻令牌，并添加区域质心的正弦编码来保留空间布局，从而在压缩长序列的同时保持下游模型所需的解剖信息。

Details

Motivation: 解决3D CT扫描进入视觉语言模型时产生的超长视觉令牌序列（通常成千上万个）的压缩问题，现有通用方法（如网格平均）可能混合不同解剖结构、病灶和空气，导致信息丢失，而专门针对3D CT的令牌压缩研究较少。

Result: 在CT-RATE和Merlin两个数据集及五种编码器上评估，涵盖属性预测（大小、密度、位置、纹理和疾病）和文本生成（视觉问答和报告生成）两类任务。在相同令牌预算下，ORCA持续优于现有压缩方法，能将视觉上下文压缩64倍、KV缓存压缩50倍，处理每个体素的速度提升31倍。

Insight: 创新点在于利用器官引导进行令牌聚合，并结合区域质心的位置编码来保留关键空间信息，实现了无需训练、可调节且不依赖文本查询的压缩方案，为3D医学图像的视觉令牌高效处理提供了新思路。

Abstract: A 3D CT scan entering a vision-language model produces a long sequence of visual tokens, often thousands to tens of thousands per volume, and this sequence must be compressed before a language model can consume it. Token compression is well studied in general vision, but little of it targets 3D CT specifically. A common baseline is grid average, which pools regular grid cells and can blend distinct anatomy, lesion, and air into one token. We present \textbf{ORCA} (ORgan-Centroid Aggregation), a token compressor for 3D CT. It merges adjacent tokens with organ guidance and adds a sinusoidal encoding of each region’s centroid to preserve spatial layout. This preserves the anatomical information a downstream model needs. ORCA is training-free and plug-and-play, producing an adjustable token set without any model change or text query. We evaluate it across two datasets (CT-RATE and Merlin) and five encoders. The evaluation spans two task types: attribute prediction over five families (size, density, location, texture, and disease) and text generation (visual question answering and report generation). At matched token budgets, ORCA improves consistently over existing compression methods. It shrinks the visual context $64\times$ and its KV-cache $50\times$, and is $31\times$ faster to process each volume. Code released at https://github.com/renjie-liang/ORCA-3DCT.

[72] Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy cs.CV | cs.AIPDF

Simiao Sun, Kenneth Ng, Lynn Lee, Astrid Harth, Asami Odate

TL;DR: 本文提出了一种基于人工智能蒸馏的框架，用于从光学显微镜图像中提取语义丰富的嵌入表示。该框架利用语义锚点，通过多模态教师模型结合视觉和文本信息生成结构化向量，并训练仅使用图像输入的学生视觉Transformer来重建该向量，从而获得可解释且紧凑的图像表示。

Details

Motivation: 解决光学显微镜图像分析中因样本形态、化学成分、放大倍数和照明条件等因素导致的视觉线索复杂且难以解释的问题，旨在通过AI方法提升对颗粒和纤维分散体的表征能力。

Result: 在留一法最近邻检索任务中，框架在细粒度样本描述标签上实现了约80%的伪类验证准确率和75%的Recall@1，表明其能够有效支持检索、分类和探索性分析。

Insight: 创新点包括使用语义锚点和结构化教师向量来增强表示的语义丰富性和可解释性，以及通过HDBSCAN聚类衍生的伪类交叉熵损失作为防坍塌正则化器，避免了对比学习中的负样本挖掘需求。

Abstract: Optical microscopy of particle and fiber dispersions involves interpreting subtle visual cues influenced by specimen morphology, chemical composition, magnification, and illumination conditions. We introduce an artificial intelligence (AI) distillation framework that extracts semantically rich image embeddings from microscopy images using semantic anchors. A multimodal teacher combines each image’s visual embedding with three text embeddings representing illumination modality, magnification, and specimen identity and morphology. Generated by LongCLIP’s extended-context text encoder, this yields a 2304-dimensional block-structured teacher vector whose component blocks remain physically interpretable throughout training and inference. A student vision transformer (ViT) with a multi-layer perceptron (MLP) decoder is trained to reconstruct this teacher vector from the image alone, minimizing a mean absolute error (L1) loss that enforces coordinate-level fidelity to the teacher’s block structure. A cross-entropy term over pseudo-classes derived from HDBSCAN clustering of the teacher embedding space acts as a collapse-prevention regularizer, enforcing inter-cluster separation without requiring contrastive negative mining. At inference, the student operates on image input alone, producing compact embeddings that recover the full semantic content of the teacher vector. The framework achieves approximately 80% pseudo-class validation accuracy and 75% Recall@1 on fine-grained specimen description labels under leave-one-out nearest-neighbor retrieval. These results demonstrate that semantic anchoring enables a vision-only student to acquire richer and more interpretable representations than image-only training, with direct applicability to retrieval, classification, and exploratory analysis of heterogeneous particle and fiber dispersions.

[73] Decoding Children’s Gait Behavior cs.CVPDF

Yifan Shen, Boyi Li, Meihuan Huang, Yuanzhe Liu, Xu Cao

TL;DR: 本文引入了一个新的人类动作识别问题领域：从标准RGB视频中对儿童步态行为进行细粒度分析。论文针对3-17岁儿童的行走模式，旨在解决临床诊断中的实际问题。为此，作者构建了一个包含110名受试者、超过1100个高帧率视频序列的新数据集，并提出了一个统一的端到端框架来解码儿科步态的基本组成部分。

Details

Motivation: 动机在于解决临床诊断（如脑瘫、偏瘫）中对儿童步态进行细粒度分析的需求，因为当前基于3D传感器的步态分析系统昂贵、侵入性强，且对年幼受试者不实用。

Result: 论文通过综合实验结果，展示了该数据集推动新研究问题的潜力，并为自动化儿童步态评估建立了一个严格的基线。同时指出，当前最先进的方法（包括步态基础模型和多模态大语言模型）无法有效解析这些临床细微差别。

Insight: 创新点在于首次将细粒度步态分析引入到基于RGB视频的儿童行为识别领域，并构建了首个针对该任务的大规模、多视角、高帧率数据集。从客观角度看，其核心贡献在于明确了分析儿童不规则、细微运动模式的关键技术挑战，并提出了一个统一的端到端解决方案框架，为临床辅助诊断提供了新的低成本、非侵入性技术路径。

Abstract: We introduce a new problem domain for human action recognition: the fine-grained analysis of children’s gait behaviors from standard RGB video. We specifically target the ambulatory patterns of children aged 3-17 years. Such behaviors arise naturally in the diagnosis and treatment of several critical developmental and neuromuscular disorders, such as cerebral palsy and hemiplegia. Despite their clinical value, current 3D sensor-based gait analysis systems are expensive, intrusive, and often impractical for young subjects. To address this, we introduce a new dataset comprising over 1,100 high-frame-rate (60 FPS) video sequences from 110 subjects, accompanied by synchronized, anonymized pose sequences. In each session, the child performs a 5-second “walk-around” task, capturing the gait cycle from multiple viewpoints. Crucially, we demonstrate that current state-of-the-art approaches, including gait foundation models and Multimodal Large Language Models (MLLMs), fail to effectively resolve these clinical nuances. We identify the key technical challenges in analyzing these erratic and subtle motor patterns and describe a unified end-to-end framework for decoding fundamental components of pediatric gait. Through comprehensive experimental results, we demonstrate the potential of this dataset to drive novel research questions and establish a rigorous baseline for automated child gait assessment.

[74] Poplar: A Scalable Pipeline for Human-Centric Image Dataset Synthesis cs.CVPDF

Zhishan Zou

TL;DR: 本文提出了Poplar，一个可扩展的、用于合成以人为中心的图像数据集的流水线，该流水线包含Specify、Render和Inspect三个阶段，旨在生成覆盖多样人物和场景、避免不合理属性组合、保持日常摄影风格且可大规模质量控制的图像。作者利用该流水线构建了Poplar-9K数据集，包含9,401个精选的图像-文本对。

Details

Motivation: 尽管现有图像生成器能合成逼真的以人为中心的图像，但生成一个有用、高质量的数据集（需覆盖多样性、避免不合理组合、保持真实感并实现规模化质量控制）仍是一个挑战。

Result: 使用Poplar流水线构建了Poplar-9K数据集，从11,765个候选图像中保留了9,401个图像-文本对，接受率为79.9%。

Insight: 创新点在于提出了一个结构化的、可复现的三阶段流水线（Specify-Render-Inspect），通过常识约束采样属性、适配真实感的图像生成与重试机制，以及结构化的视觉-语言审查来系统化地合成和筛选高质量、可定制的人像数据集，并提供了完整的可审计记录。

Abstract: Recent image generators can synthesize convincing human-centric images, yet producing a useful collection remains different from producing a single successful image. A human-centric dataset must cover varied people and contexts, avoid implausible attribute combinations, preserve an everyday photographic character, and expose quality-control decisions at scale. We present Poplar, a reproducible Specify–Render–Inspect pipeline for human-centric image dataset synthesis. Specify samples structured attributes under commonsense constraints and verbalizes them as photography-oriented prompts. Render uses a realism-adapted image generator across composition-aware aspect ratios and retries obvious technical failures. Inspect applies a single structured vision–language review to each candidate, preserving the original prompt while rejecting intrinsic image defects or material prompt mismatches. Using Poplar, we construct Poplar-9K: 9,401 curated human-centric image–text pairs retained from 11,765 reviewed candidates (79.9% acceptance). We release the dataset together with the pipeline, configurations, immutable generation prompts, and auditable inspection records as a compact resource for building customizable human-centric collections.

[75] Beyond Static Anchors: Bounded Prototype Conditioning for Language-Free Medical Anomaly Detection cs.CV | cs.AIPDF

Yibo Wan, Jinyu Cai, Seekiong-Ng

TL;DR: 本文提出了一种名为ReCAP的无语言医学异常检测框架，该框架通过有界门控调制为每个输入图像动态生成条件化的正常与异常视觉原型，以替代现有CLIP方法中固定的文本提示或视觉标记，从而在跨域医学影像场景中实现更可靠的异常检测与定位。

Details

Motivation: 现有基于CLIP的方法在医学异常检测中依赖静态的参考（如文本提示或学习到的视觉标记），这些静态参考在跨域测试时可能无法可靠地迁移到未见目标，因此需要一种能够根据输入自适应调整参考的机制。

Result: 在六个医学基准测试中，ReCAP在所有零样本和24个少样本设置中的23个上取得了最佳的图像级AUROC，并在所有三个分割数据集上获得了最佳的零样本像素级AUROC；与最快基线相比，推理延迟降低了70%以上，且无需文本提示或测试时梯度更新。

Insight: 创新点在于用输入条件化的视觉原型替代静态锚点，通过有界门控调制实现查询自适应的异常评分，同时约束上下文引起的原型漂移；此外，引入非参数正常参考记忆以保留实例级目标域变化，补充条件原型分支，从而提升跨域泛化能力与效率。

Abstract: Medical anomaly detection identifies abnormal images and localizes lesions under scarce supervision while generalizing across organs and modalities. Existing CLIP-based methods reduce annotation requirements through vision–language alignment, but their normal and abnormal references, whether text prompts or learned visual tokens, remain fixed across test images. Such static references may not transfer reliably to unseen targets in a cross-domain medical imaging scenario. To address this, we propose ReCAP, a language-free framework that replaces static anchors with input-conditioned visual prototypes. ReCAP re-centers separated normal and abnormal prototypes for each image through a bounded gated modulation, enabling query-adaptive anomaly scoring while constraining context-induced prototype drift. For the few-shot setting, we introduce a non-parametric normal-reference memory to preserve instance-level target-domain variation and complement the conditional prototype branch. Across six medical benchmarks, ReCAP achieves the best image-level AUROC on all zero-shot and 23 of 24 few-shot settings, and the best zero-shot pixel-level AUROC on all three segmentation datasets. Particularly, it reduces inference latency by over 70% compared to the fastest baseline, without text prompts or test-time gradient updates.

[76] Structured Proxy Features for Multimodal NSCLC Survival Prediction from Pretreatment CT cs.CV | cs.AIPDF

Huu Phong Nguyen, Delower Hossain, Ehsan Saghapour, Zhandos Sembay, Jake Y. Chen

TL;DR: 该论文提出了一种利用结构化代理特征增强非小细胞肺癌（NSCLC）生存预测的方法。该方法通过结合预处理CT图像、放射组学特征、临床变量以及六个模拟衍生的代理特征（旨在捕捉肿瘤异质性与形态学之间的相互作用）进行多模态融合。在公开的Lung1队列上，该方法取得了优于先前多模态基准的预测性能。

Details

Motivation: 肺癌（尤其是NSCLC）生存分层具有挑战性，因为传统的描述符（如标准放射组学或深度学习特征）通常将影像特征视为独立量，忽略了肿瘤特性之间的结构化相互作用。

Result: 在公开的Lung1队列（n=390）上，主要的四模态融合方法取得了C-index为0.641（iAUC 0.731，log-rank p < 0.001）的结果，优于该基准上先前报道的多模态结果（C-index 0.631；iAUC 0.592）。一项探索性系数优化分析甚至观察到了最佳C-index 0.662（iAUC 0.748）。

Insight: 创新点在于引入了模拟衍生的结构化代理特征（如通过放射组学参数化的元胞自动机生成的生长率和坏死率代理特征），以捕捉肿瘤异质性与形态学之间的相互作用，为传统的放射组学、深度学习和临床表征提供了互补的预测信息。同时，采用基于Transformer的掩码自编码器（TMAE）作为影像骨干网络，并能提供基于注意力的可视化，以突出模型更关注的肿瘤区域。

Abstract: Lung cancer results in roughly 1.8 million fatalities annually worldwide, with non-small cell lung cancer (NSCLC) comprising the majority of cases. Despite advancements in treatment, survival stratification remains challenging due to intratumoral heterogeneity inadequately captured by conventional descriptors. Standard radiomic and deep learning techniques regard imaging features as independent quantities, overlooking structured interactions between tumor characteristics. We evaluate whether structured proxy features can enhance multimodal NSCLC survival prediction by augmenting pretreatment computed tomography (CT) representations, radiomics, and clinical variables with six simulation-derived features designed to capture interactions between heterogeneity and morphology. A radiomic-parameterized cellular automaton generates growth-rate and necrosis-ratio proxy features from baseline CT by using entropy and sphericity to compute low-dimensional proxy parameters. The imaging backbone is a Transformer-based Masked Autoencoder (TMAE), which was chosen after a systematic evaluation with alternative encoders within the same pipeline and provides attention-based visualizations that highlight tumor regions receiving higher model attention. On the public Lung1 cohort (n = 390), the primary four-modality fusion attained a C-index of 0.641 (iAUC 0.731, log-rank p < 0.001). The primary result compares favorably with prior multimodal results on Lung1 (C-index 0.631; iAUC 0.592 [15]) under a comparable evaluation protocol, while a separate exploratory coefficient-optimization analysis achieved a best observed C-index of 0.662 (iAUC 0.748). These results indicate that, in addition to conventional radiomic, deep, and clinical representations within the Lung1 benchmark, simulation-derived proxy features may provide complementary predictive information within this fixed Lung1 benchmark.

[77] DreamTraj: Generating 6-DoF Object Trajectories by Reading Unrendered Video Diffusion Latents cs.CVPDF

Tongsheng Ding, Zhen Luo, Yixuan Yang, Boyu Wang, Luyang Xie

TL;DR: 本文提出了DreamTraj方法，用于从单张RGB图像和任务指令预测6自由度物体轨迹，无需视频、深度或CAD模型。该方法通过读取冻结的图像到视频扩散模型在早期去噪步骤中的内部表示来解码运动，并引入了包含5038条物体中心轨迹和细粒度语言指令的MOVE数据集。

Details

Motivation: 解决现有物体轨迹预测方法依赖特权输入（如视频、深度或CAD模型）或从生成视频中通过昂贵、易错的感知流程恢复运动的问题，同时弥补数据集缺乏细粒度语言到运动标注的监督差距。

Result: 在MOVE数据集上，DreamTraj在平移和旋转预测上均达到了新的SOTA水平，优于消耗多帧或特权输入的预测器，且运行速度比生成后提取的流程快4.6倍。

Insight: 创新点在于首次直接从中间视频扩散表示（而非生成像素）解码物体6自由度轨迹，利用冻结扩散模型的内部注意力轨迹和隐藏状态，通过轻量级流匹配阅读器实现高效运动解码。

Abstract: Accurate prediction of object trajectories during manipulation is essential for closing the perception-action loop. Progress is limited on two fronts: available datasets lack fine-grained language-to-motion annotations, and existing predictors either rely on privileged inputs such as video, depth, or CAD models, or recover motion from fully generated videos through costly, error-prone perception pipelines. We close the supervision gap with the MOVE dataset, 5,038 object-centric egocentric trajectories, each paired with a fine-grained natural-language instruction rather than a coarse verb-noun label. We further propose DreamTraj, which predicts a 6-DoF object trajectory from a single RGB image and a task instruction, requiring no video, depth, or CAD model at inference: rather than generating a video, it reads motion from the internal representations of a frozen image-to-video diffusion model at an early denoising step. A lightweight flow-matching Reader decodes query-key attention tracks and pooled hidden states into relative 6-DoF poses. To our knowledge, this is the first approach to directly decode object 6-DoF trajectories from intermediate video diffusion representations rather than generated pixels. DreamTraj sets a new state of the art on both translation and rotation against forecasters that consume multi-frame or privileged inputs, and runs 4.6x faster than generate-then-extract pipelines.

[78] Scene2Sound: Auditory-Grounded Soundscape Generation for 3D Gaussian Worlds cs.CV | cs.MM | cs.SDPDF

Masaki Yoshida, Ren Togo, Takahiro Ogawa, Miki Haseyama

TL;DR: 本文提出了Scene2Sound，一个为3D高斯泼溅（3DGS）世界生成空间一致音景的训练无关框架。该框架通过多视角视觉语言模型检测发声物体，利用高斯集合匹配将其关联为3D实例，并锚定到持久3D位置，再结合基于对象的音频引擎实现实时空间化音频渲染。

Details

Motivation: 现有音频生成方法通常基于单张图像或单一视角，其生成的声音与该观测绑定，无法在听者移动时保持空间一致性。本文旨在为可自由探索的3DGS世界生成一个空间一致的声音景观。

Result: 在生成的3DGS世界和由真实360度捕获生成的3DGS场景上，Scene2Sound在保持强单视角基线音频质量的同时，实现了单视角和单全景方法所不具备的空间一致性。用户研究证实了其感知优势。

Insight: 核心创新在于通过‘听觉接地’任务定义，将声音生成问题分解为物体检测、3D实例关联和音频空间化。提出的高斯集合匹配方法用于跨视角检测关联，以及两个专门评估空间一致性的新指标，是该工作的关键贡献。

Abstract: 3D Gaussian Splatting (3DGS) turns captured or generated imagery into photorealistic 3D world simulations that users can freely explore, yet these worlds remain silent. Because existing audio generation methods condition on a single image or viewpoint, their sound is tied to that observation and cannot stay consistent while a listener moves. We introduce the task of generating a spatially consistent soundscape for a given 3DGS world through auditory grounding, identifying which objects in the world should emit sound and anchoring each to a persistent 3D position, and present Scene2Sound, a training-free framework built on this grounding. From the input world alone, our pipeline selects viewpoints that jointly cover the scene, identifies sound-emitting objects with a vision-language model, and associates the multi-view detections into 3D instances through Gaussian set matching, which measures the overlap between the Gaussian sets that render each detection. Each source then receives generated audio that a standard object-based audio engine spatializes in real time at arbitrary listener poses. We further propose two spatial-consistency metrics, one testing whether rendered audio responds consistently to listener motion and one testing whether the claimed sources are supported by views held out from their placement. On a curated set of generated 3DGS worlds and on 3DGS scenes generated from real-world 360-degree captures, Scene2Sound preserves the audio quality of strong per-viewpoint baselines while remaining spatially consistent where per-viewpoint and single-panorama pipelines do not, and a user study confirms the perceptual benefit. Project page: https://masaki-lmd.github.io/scene2sound/.

[79] CrossProjection: Geometric Grounding Beyond Viewpoint Change in Architectural Drawings cs.CV | cs.AI | cs.CLPDF

Kaho Li, Pengyu Zeng, Yuqin Dai, Jun Yin, Tianjing Feng

TL;DR: 本文介绍了CrossProjection，一个用于评估视觉语言模型在异构建筑图纸（如平面图、剖面图、立面图）中保持组件身份和外部化几何能力的诊断基准。该基准通过分类判断、候选选择以及自由点、线、区域定位任务，评估模型的匹配、配准和几何基础能力。在真实图纸集上的测试表明，现有模型在封闭候选任务上表现尚可，但在自由几何定位上仍很脆弱，与人类专家存在显著差距。

Details

Motivation: 建筑图纸（平面图、剖面图、立面图）违背了多视图推理的通常假设，因为组件在不同视图中的外观变化无法用相机运动来解释。因此，需要一种方法来诊断视觉语言模型是否能在这些异构视图中保持组件身份并理解其几何关系。

Result: 在23个真实图纸集和每个模型1954个分类条件下，GPT-5.5得分为82.4%，Qwen3-VL-32B-Instruct为62.2%，GLM-4.5V为57.2%。在自由几何定位任务中，模型表现脆弱：在自然图纸上，GPT的点/区域PCK@.05为54-76%，而Qwen和GLM仅为8-36%；线端点PCK@.05则低至22%、4%和0%。三名建筑专业参与者的分类准确率达到87.3-93.3%，GT区域命中率为76-92%。

Insight: 论文的创新点在于提出了一个针对建筑图纸异构视图特性的诊断基准CrossProjection，强调封闭候选任务的成功并不等同于可靠的显式几何基础能力。其可借鉴之处包括使用可重复的图纸锚点、固定分母评分和哈希锁定工件来建立审计追踪，以揭示模型在几何理解上的真实差距，这对绘图引导的CAD/BIM系统开发具有重要警示意义。

Abstract: Architectural drawings violate the usual assumption behind multi-view reasoning: plans and sections are cuts, while elevations are facade projections, so corresponding components change appearance in ways camera motion cannot explain. We introduce CrossProjection, an anchor-grounded diagnostic of whether vision-language models preserve component identity and externalize geometry across heterogeneous architectural views. It evaluates Matching, Registration, and Geometric Grounding through categorical judgments, candidate selection, and free point, line, and region localization. Across 23 real drawing sets and 1,954 categorical conditions per model, GPT-5.5 scores 82.4%, Qwen3-VL-32B-Instruct 62.2%, and GLM-4.5V 57.2%. A matched 200-target study crosses natural and vector-text-suppressed drawings with closed-candidate and free-geometry outputs. Candidate-supported performance is often higher, but free localization remains fragile: on natural drawings, point/region PCK@.05 is 54-76% for GPT, 8-10% for Qwen, and 14-36% for GLM; line endpoint PCK@.05 is 22%, 4%, and 0%. A coordinate grid recovers some GPT point/region precision but not lines. Three architecture-trained participants reach 87.3-93.3% categorical accuracy and 76-92% GT-region hit, supporting task feasibility rather than a population-level human ceiling. Because the categorical families do not form a same-item Matching-Registration contrast and interface controls alter multiple burdens, we avoid mechanistic claims. The supported conclusion is narrower: closed-choice or marked-element success does not entail reliable explicit geometric grounding. For drawing-guided CAD/BIM systems, categorical correctness should not be treated as evidence of candidate-free spatial reliability. Reusable on-sheet anchors, fixed-denominator scoring, and hash-locked artifacts establish an audit trail for this gap.

[80] Image-Space Rule Discovery cs.CVPDF

Misora Sugiyama, Toya Oyama, Hirokatsu Kataoka

TL;DR: 本文研究了图像编辑模型是否能在图像空间中端到端地发现视觉规则并解决问题，为此提出了WISRD基准测试，包含11个核心任务和4个补充推理压力测试。评估发现，Nano Banana Pro在现有前沿图像编辑模型中表现最佳，能够部分依赖图像内渲染的指令进行推理。

Details

Motivation: 旨在探究图像编辑模型能否像人类完成工作表测试（如智商测试）一样，直接在图像空间中理解基于图像的指令、识别问题、推断答案并执行编辑，以解决端到端的视觉规则发现问题。

Result: 在WISRD基准的V0-V3无参考子集上，Nano Banana Pro的Auto-Strict代理通过率为48.7%，显著高于其他模型（如Qwen-Image-Edit的13.4%）；在补充诊断中，其在4x4数独任务上达到70.0%准确率，在RAVEN模式发现项目上为22.9%。

Insight: 创新点在于提出了一个全面的图像空间规则发现基准（WISRD），涵盖多种任务类型和信息条件；研究发现当前先进模型能够利用图像内渲染的指令进行部分推理，这为端到端视觉问题解决提供了新视角。

Abstract: Can image-editing models discover visual rules in image space and complete problem-solving end-to-end? We tackle this question in the spirit of a human worksheet test (e.g., an IQ test), using problems that require models to read image-based instructions, recognize the problem, infer the answer, bind it to the correct destination, control output count, suppress unnecessary edits, and preserve the input and format. We introduce WISRD, a Worksheet Image-Space Rule Discovery benchmark with 11 core tasks under eight information conditions, spanning localized marking, filling, copying, counting, and no-edit suppression, together with four supplementary reasoning-stress probes for multi-step spatial manipulation, abstract pattern reasoning, logical inference, and constraint-based problem solving. We identify three key findings as follows. (i) Among the frontier image-editing models evaluated, Nano Banana Pro achieves the highest score. On the shared V0–V3 no-reference subset, the Auto-Strict proxy pass rates are 48.7% for Nano Banana Pro, 13.4% for Qwen-Image-Edit, 11.5% for FLUX.2 Klein 4B API, 11.3% for FLUX.2 Klein 4B open-weight, and 0.0% for InstructPix2Pix. (ii) Analysis reveals that current image-editing models can partially rely on rendered in-image instructions even when the external prompt is absent or merely generic. (iii) In small supplementary diagnostics, Nano Banana Pro achieves 70.0% on 4-by-4 Sudoku and 22.9% on public RAVEN pattern-discovery items in image space.

[81] SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance cs.CVPDF

Yufei Zhang, Chenlu Zhan, Donghui Sun, Xiaoxin Chen, Hongwei Wang

TL;DR: 本文提出SpatialAfford框架，旨在提升紧凑视觉语言模型（VLMs）在功能可供性（affordance）定位任务中的性能。该框架通过两个阶段：首先使用空间注意力对齐（SAA）引导模型关注正确的功能区域，然后利用空间感知GRPO优化坐标预测，从而将任务转化为基于注意力的空间推理。

Details

Motivation: 紧凑自回归VLMs在功能可供性定位任务中面临挑战，因为目标区域更小、更模糊且更依赖任务上下文，导致其交叉注意力分散且难以锚定到真实的功能证据上，即使坐标预测有所改进。

Result: 在ShareRobot-Bench、ReasonAff和PartAfford等基准测试中，SpatialAfford框架显著提升了功能可供性定位性能，一个紧凑的4B参数模型甚至超越了更强的7B+基线模型。

Insight: 核心创新在于将功能可供性定位从纯粹的输出约束目标转变为注意力引导的空间推理过程，通过先明确教导模型“看哪里”（注意力对齐），再优化“定位哪里”（坐标预测），从而解决了紧凑VLMs注意力分散的根本问题。这种两阶段、注意力先行的训练范式具有借鉴意义。

Abstract: Affordance grounding aims to localize the functional region for interaction, such as the handle to grasp or the button to press, rather than the whole object. This makes it more challenging than generic visual grounding because the target region is smaller, more ambiguous, and more dependent on task context, especially for compact vision-language models (VLMs) used in embodied settings. Recent sequence-level supervision and reinforcement learning improve coordinate prediction quality, yet compact autoregressive VLMs still lack reliable affordance-aware visual focus before coordinate generation: the model can produce better coordinate tokens while its cross-modal attention remains diffuse and weakly anchored to the true affordance evidence. To address it, we propose SpatialAfford, a two-stage framework that first aligns attention to the ground-truth affordance region through Spatial Attention Alignment (SAA), then refines coordinate prediction with Spatial-Aware GRPO. By explicitly teaching the model where to look before optimizing where to ground, SpatialAfford turns affordance grounding from a purely output-constrained objective into attention-grounded spatial reasoning. Across ShareRobot-Bench, ReasonAff, and PartAfford, SpatialAfford consistently improves affordance grounding, with a compact 4B model outperforming stronger 7B+ baselines.

[82] DocPO: Advancing Document Policy Optimization via Tailored Step-Aware Rewards cs.CVPDF

Yunhao Wang, Binghong Wu, Zhenyu Huang, Jiacheng Shi, Shuo Huang

TL;DR: 本文提出了一种名为DocPO的文档策略优化框架，通过引入Step-Aware Annealing（SAA）奖励锐化机制，解决了在文档解析强化学习中，基于编辑距离的奖励在高精度区域区分度不足的问题。该方法在训练过程中逐步增加奖励曲率，以放大高质量样本间的细微差异，从而提升模型在困难案例上的学习效果。

Details

Motivation: 文档解析强化学习通常依赖基于编辑距离的参考奖励，但在高精度区域，这些奖励变得区分度较弱，导致对接近正确的输出提供有限的学习信号，难以优化困难案例。

Result: 在OmniDocBench和DocElemHard基准测试上的实验表明，SAA机制在无需额外人工监督的情况下，持续提升了GRPO风格强化学习在各类文档元素上的性能，优于未使用退火处理的奖励。

Insight: 核心创新点是Step-Aware Annealing（SAA）奖励锐化机制，这是一种即插即用的方法，通过动态调整奖励曲率来增强高精度区域的信号区分度。此外，DocPO框架针对文本、表格和公式等不同文档元素，定制了基于编辑距离的特定奖励，实现了细粒度的优化。

Abstract: Reinforcement learning (RL) for document parsing often relies on reference-based rewards rooted in edit distance (e.g., tree edit distance), yet it remains hard to optimize in the high-accuracy regime because such rewards become weakly discriminative: near-correct outputs receive very similar scores, providing limited learning signal for hard cases. We propose Step-Aware Annealing (SAA), a plug-and-play reward sharpening mechanism that progressively increases reward curvature during training, amplifying subtle quality differences among high-scoring samples while preserving stability in early learning. Built on SAA, we introduce DocPO, a document policy optimization framework with element-specific, reference-based rewards anchored by edit-distance signals: normalized string edit distance (NED) for text, tree edit distance similarity (TEDS) for tables, and a hybrid Rubric+edit reward for formulas. Experiments on OmniDocBench and DocElemHard show that SAA consistently improves GRPO-style RL across document elements over non-annealed rewards, without requiring additional human supervision for reward construction.

[83] GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding cs.CVPDF

Yiwen Wang, Yuyang Deng, Yihao Long, Xi Zhao

TL;DR: GuideGround是一个利用视觉语言模型（VLM）增强3D视觉定位的框架，通过VLM提供的开放词汇语义理解和全局场景感知，来补充特定任务模型的不足。它用VLM生成的对象语义描述替代辅助的闭集分类以增强语义理解，并通过逐视图定位保留视角特定的假设，再利用VLM跨候选视角进行显式验证。

Details

Motivation: 现有3D视觉定位方法将语义理解视为辅助的闭集对象分类任务，并依赖多视图特征聚合进行视角推理，这限制了语义泛化能力并削弱了视角特定的证据。论文观察到VLM天然具备开放词汇语义理解和全局场景感知的互补能力，旨在利用VLM来增强语义理解和视角感知推理。

Result: 在ReferIt3D基准测试上的大量实验表明，GuideGround持续优于先前的最先进方法。全面的消融研究进一步证实了所提出的语义理解和视角推理策略的有效性。

Insight: 创新点在于利用VLM作为语义增强和视角特定假设验证的互补工具，而非替代特定任务模型，具体通过开放词汇语义描述替代闭集分类，以及显式的跨视角假设验证来保留和强化视角依赖性推理。这为结合基础模型与特定任务模型提供了新思路。

Abstract: 3D visual grounding aims to localize the target object in a 3D scene from a natural language query, requiring both fine-grained semantic understanding and viewpoint-dependent spatial reasoning. Existing methods typically formulate semantic understanding as an auxiliary closed-set object classification task and rely on multi-view feature aggregation for viewpoint reasoning, limiting semantic generalization and weakening viewpoint-specific evidence. We observe that vision-language models naturally provide complementary capabilities through open-vocabulary semantic understanding and global scene perception. Based on this insight, we propose GuideGround, a VLM-guided framework that complements rather than replaces task-specific grounding models by leveraging VLMs for semantic enhancement and viewpoint-specific hypothesis verification. Specifically, we replace auxiliary closed-set object classification with VLM-generated object semantic descriptions to enhance semantic understanding. Meanwhile, instead of directly aggregating multi-view representations, we preserve viewpoint-specific grounding hypotheses through per-view grounding and explicitly verify them using VLMs across candidate viewpoints. Extensive experiments on the ReferIt3D benchmark demonstrate that GuideGround consistently outperforms previous state-of-the-art methods. Comprehensive ablation studies further confirm the effectiveness of both the proposed semantic understanding and viewpoint reasoning strategies.

[84] DiffuseAgent-MI: Distributionally-Grounded,Tool-Integrated Self-Evolving Agents for Faithful Visual Reasoning cs.CVPDF

An Lanji, Dawei Liu, Jin Li, Haoran Xu, Mei Chen

TL;DR: 本文提出了DiffuseAgent-MI，一种基于分布视角、集成工具的自进化视觉推理智能体，旨在解决现有工具集成智能体在推理路径陈述与实际计算过程之间存在的不可信问题。该方法通过一个基于特征单元的KL最小能量模型来管理感知基础，并结合验证器提供轨迹级可信度奖励，从而提升推理的忠实度和准确性。

Details

Motivation: 现有工具集成的视觉语言智能体在组合式、多步视觉推理方面取得了显著进展，但其输出经常表现出不忠实性，即陈述的推理路径与实际产生答案的计算过程存在分歧，这损害了在安全关键应用中的可靠性。

Result: 在GeoQA、SciVis、VQA-v2以及一个内部多模态推理数据集上，DiffuseAgent-MI相比之前的自进化智能体将准确率提升了高达5.1个百分点，同时将互信息忠实度和人类可解释性一致性提高了一倍以上。

Insight: 核心创新在于引入了一个基于特征单元的KL最小能量模型，从分布视角为视觉机制可解释性提供基础，从而弥合解释与内部表征之间的差距。能量项保证了分布层面的忠实性，验证器保证了轨迹层面的忠实性，两者的结合是互补且必要的。

Abstract: Tool-integrated vision-language agents have made remarkable progress on compositional and multi-step visual reasoning. Yet their outputs frequently exhibit unfaithfulness: the stated reasoning path diverges from the computation that actually produced the answer, undermining reliability in safety-critical applications. We present DiffuseAgent-MI, a self-evolving agent whose perceptual grounding is governed by a KL-minimal energy model over feature units, providing a distributional view of visual mechanistic interpretability. The agent learns an energy landscape that softly constrains generated samples to lie near the native prior conditioned on the chosen interpretable unit, closing the gap between the explanation and the internal representation. A verifier then supplies trajectory-level faithfulness rewards, and a repair branch re-conditions the energy when the verifier flags an unfaithful step. On GeoQA, SciVis, VQA-v2 and an in-house multimodal reasoning set, DiffuseAgent-MI improves accuracy by up to 5.1 points over prior self-evolving agents while more than doubling mutual-information faithfulness and human-interpretability agreement. Our analysis shows the energy term and the verifier are complementary: the former guarantees distributional faithfulness, the latter trajectory-level faithfulness, and only their combination closes both gaps.

[85] DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editable cs.CVPDF

Pu Cao, Qingye Kong, Xuedan Yin, Xuekun Zhao, Rupeng Yan

TL;DR: 本文提出了DrawAI，一个用于将栅格图像转换为可编辑结构的智能体基准和工作流。它包括DrawAI-Bench基准，涵盖科学图表、幻灯片、海报和图表等场景，以及DrawAI-Flow工作流，通过解析和重建智能体实现图像到可编辑代码的转换。

Details

Motivation: 当前图像生成模型和多模态智能体能生成高质量视觉内容，但其栅格输出难以直接编辑，因为内容和关系被扁平化为像素，阻碍了用户检查、修改或重用组件。本文旨在解决图像到可编辑重建问题，在保持视觉和语义内容的同时恢复结构化、可直接操作的作品。

Result: 在DrawAI-Bench上系统评估了13个模型和5个智能体框架，结果显示不同模型-框架配置的重建质量和成本差异显著，而DrawAI-Flow工作流能持续提升可编辑结构。

Insight: 创新点包括提出图像到可编辑重建任务，强调保真度和可编辑性的权衡；引入混合评估协议，结合确定性规则指标和视觉语言准则；设计两阶段智能体工作流，通过解析-重建循环生成可执行图形代码，为实际视觉创作场景提供结构化解决方案。

Abstract: Recent image-generation models and multimodal agents can produce high-quality visuals for increasingly complex visual communication tasks. Yet their raster outputs remain difficult to use directly because meaningful content and relationships are flattened into pixels, preventing users from inspecting, modifying, rearranging, or reusing individual components. We formulate image-to-editable reconstruction, which recovers a structured, directly manipulable artifact from a raster image while preserving its visual and semantic content. The central challenge is to jointly satisfy Fidelity and Editability, which often trade off in practice. To study this task, we introduce DrawAI, comprising an agentic benchmark, DrawAI-Bench, and a reconstruction workflow, DrawAI-Flow. DrawAI-Bench spans scientific figures, presentation slides, posters, and diagrams, combining real and AI-generated images to reflect practical visual-creation scenarios. It evaluates Fidelity and Editability through a hybrid protocol of 39 criteria: deterministic rule-based metrics measure properties with direct correspondences, while asset-specific vision-language rubrics capture semantic and perceptual qualities for which exact matching is misleading. Besides, we propose DrawAI-Flow, a two-stage agentic workflow in which a Parser Agent turns extracted elements evidence into an explicit reconstruction plan, and a Reconstruction Agent realizes the plan as executable graphics code through an iterative code-render-validate-revise loop. On DrawAI-Bench, we systematically evaluate thirteen models across five agent harnesses to study the effects of model capability, harness choice, and workflow design. The results show that reconstruction quality and costs vary substantially across model-harness configurations, while DrawAI-Flow consistently improves editable structure.

[86] Relax Within, Balance Across: Geometry-Guided Load Balancing for Vision-Language Mixture-of-Experts cs.CV | cs.AIPDF

Ziang Wu, Peng Jin, Qishen Yin, Munan Ning, Hao Li

TL;DR: 本文提出了一种名为ReBA（Relax Within, Balance Across）的几何引导负载均衡方法，用于解决视觉-语言混合专家模型中因图像和文本令牌数量变化（如图像分辨率、数量、平铺和提示长度）导致的负载不平衡问题。该方法通过分离图像和文本的负载项，并为每个图像实例分配一个等权重的路由实例，有效降低了各种基准输入下的负载，同时保持了与标准辅助损失相当的任务精度。

Details

Motivation: 标准令牌级Switch辅助损失仅平衡混合负载，导致在不同令牌混合比例（如图像分辨率变化）下，图像和文本的负载误差可能相互抵消，造成显著的负载不平衡，影响模型效率。

Result: 在四个分割骨干网络上，ReBA在所有报告的基准输入上均降低了负载，同时平均任务精度与标准辅助损失相当。此外，ReBA还降低了测试范围内的平均负载，以及在分辨率和平铺变化下的最差物理负载。

Insight: 创新点在于根据模态边界（图像与文本）和图像边界（同一图像的视觉令牌强分组）设计负载均衡策略，分离图像和文本的负载项，并为每个图像实例实施等权重路由，从而更精确地控制负载分布，提升模型鲁棒性。

Abstract: Vision-language MoE batches contain different numbers of image and text tokens. Image resolution, image count, tiling, and prompt length all change this token mix. We call the standard token-level Switch auxiliary loss Std-Aux. Std-Aux balances only the mixed load, so large image and text load errors can cancel at one mix. On our main model, the same trained router shows more than a fivefold change in load imbalance across image resolutions. We hold the image and text load profiles fixed and derive the exact load curve as the token mix varies. The image-text load gap controls sensitivity to the token mix. Physical preprocessing can also change the conditional profiles. The fixed-profile law excludes such changes. To design a remedy, we examine the router input structure. Image and text occupy distinct regions, while visual tokens group strongly by source image. The modality boundary motivates separate image and text terms. The image boundary motivates one equal-weight routing instance per image. ReBA, or Relax Within, Balance Across, implements both choices. Across four split backbones, ReBA lowers load on every reported benchmark input while keeping mean task accuracy comparable to Std-Aux. ReBA also lowers average load over the tested range and worst physical load under resolution and tiling shifts. Code is available at https://github.com/ZiangWu-77/ReBA.

[87] Element-Aware Group Learning for E-Commerce Image Generation cs.CV | cs.AI | cs.LGPDF

Jingtong Chen, Jiahui Wang, Xue Zhao, ShaoGuo Liu, Minghao Li

TL;DR: 本文提出了一种名为EAGLE-GRPO的新方法，用于优化电子商务图像生成的提示词写作。该方法在组相对策略优化（GRPO）框架内，通过将整体奖励分解到预定义的图像设计元素（如构图、背景、卖点呈现）上，解决了细粒度信用分配问题，从而生成更高质量的电商图像提示。

Details

Motivation: 现有基于视觉语言模型（VLM）的电商图像生成方法，其提示词质量是关键瓶颈。虽然GRPO框架可用于基于生成图像结果的奖励优化，但它仅在完整提示词层面分配信用，忽略了图像质量对具体设计元素的依赖。现有细粒度信用分配方法通常需要步骤级监督或学习评论家模型，这带来了额外复杂性。

Result: 实验表明，EAGLE-GRPO在性能达到平台期前能维持更长时间的性能提升，并且相比其他具有竞争力的VLM提示词写作基线方法，其生成的提示能产生更高质量的电商图像。

Insight: 核心创新点在于将组级奖励分解为元素级信用分配问题，并将其形式化为一个核岭回归问题，从而得到一个无需额外推演或独立信用分配模型的闭式解。这不仅能提供可解释的逐元素优势值，还能实现更精确的策略更新，是一种高效且无需额外监督的细粒度优化方法。

Abstract: Recent advances in image generation and editing have made prompt quality a key bottleneck for e-commerce creatives. Vision-language models (VLMs) can generate image-editing prompts from product images and metadata, but further improving their prompt-writing capabilities requires post-training with feedback from the generated images. Group Relative Policy Optimization (GRPO) is a natural framework for such outcome-level reward optimization. However, it assigns credit only at the full-prompt level, even though image quality often depends on specific design elements such as composition, background, and the presentation of selling points. Existing fine-grained credit assignment methods typically require step-level supervision or learned critics. To address this, we propose EAGLE-GRPO (Element-Aware Group Learning for E-Commerce Image Generation), which decomposes the group-centered reward over predefined elements. We cast element-level credit assignment as a kernel ridge regression problem and derive a closed-form solution, without additional rollouts or separate credit-assignment models. This yields interpretable per-element advantages and more precise policy updates. Experiments show that EAGLE-GRPO sustains performance gains over more training steps before plateauing and generates prompts that produce higher-quality e-commerce images than competitive VLM prompt-writing baselines.

[88] Representation Transfer of Foundation Models for Ultra-Widefield Retinal Imaging cs.CVPDF

Mingya Alexa Gong, Da Ma, Lovre Antonio Budimir, Ivana Matovinovic, Sven Loncaric

TL;DR: 该论文研究了不同预训练策略对基础模型在超广角视网膜图像疾病分类任务中表征可迁移性的影响。通过基于补丁的多实例学习框架，比较了监督学习、掩码自编码器和自蒸馏三种预训练目标下Vision Transformer编码器的性能。研究发现预训练策略显著影响冻结表征的迁移效果，且大规模预训练的DINOv3模型在糖尿病视网膜病变分级任务中表现最佳。

Details

Motivation: 探究不同预训练策略如何影响基础模型在弱监督眼科成像任务中的表征可迁移性，特别是在超广角视网膜图像疾病分类中的应用。

Result: 在ImageNet-1k预训练的ViT-B编码器中，监督和自蒸馏模型优于MAE；大规模预训练的DINOv3模型在五类糖尿病视网膜病变分级中达到0.863的二次加权kappa，与DINOv1相当。注意力分析揭示了不同预训练表征的补丁聚合行为差异，部分微调显著缩小了MAE的性能差距。

Insight: 预训练策略不仅影响表征可迁移性，还决定了多实例学习中补丁级证据的聚合方式，进而影响下游分类性能；大规模自监督预训练模型在医学图像任务中展现出强大潜力，而部分微调可有效提升掩码自编码器等方法的性能。

Abstract: Despite the widespread adoption of foundation models as feature extractors for medical imaging, relatively little is understood about how different pretraining strategies influence the transferability of learned representations to weakly supervised ophthalmic imaging tasks. We investigate this question in ultra-widefield (UWF) retinal imaging by evaluating foundation model representations within a patch-based multiple instance learning (MIL) framework for disease classification on UWF images. We compare Vision Transformer encoders pretrained with supervised, Masked Autoencoder (MAE), and self-distillation objectives, while keeping the downstream aggregation architecture unchanged. Within a controlled comparison of ViT-B encoders pretrained on ImageNet-1k, the choice of pretraining objective substantially influenced frozen representation transfer, with supervised and self-distillation-based models outperforming MAE. A contemporary DINOv3 model pretrained at a larger scale achieved the strongest overall performance, with a quadratic weighted kappa of 0.863 for five-class diabetic retinopathy grading, comparable with DINOv1. Attention analysis further revealed distinct patch-aggregation behaviours associated with the different pretrained representations, while partial fine-tuning substantially reduced the performance gap for MAE. These findings suggest that pretraining strategy influences both representation transferability and the subsequent aggregation of patch-level evidence within MIL, resulting in differences in downstream classification performance.

[89] Diagnosing Under-Development of Irreversible Processes in Video Generation cs.CVPDF

Jian Xu, Yanning Wu, Delu Zeng, John Paisley, Qibin Zhao

TL;DR: 该论文研究了视频生成模型在处理不可逆物理属性（如冰融化、纸张燃烧）时的表现，发现现有模型难以真实模拟这些属性的发展过程。论文提出了一种新的评估协议，包括进展度（方向性属性相关性）和静态率两个指标，用于可靠地衡量生成视频中不可逆过程的发展情况。

Details

Motivation: 动机是探究视频生成模型是否尊重现实世界中的不可逆物理过程，并解决现有评估指标（如局部反转度量）在测量时存在退化或噪声天花板问题，导致难以可靠评估生成视频的真实性。

Result: 在七个文本到视频模型上的实验结果显示，真实参考视频的进展度相关系数为+0.40，静态率为35%，而所有生成模型的进展度接近零，静态率高达92%至100%。人工标注验证了真实视频评分（2.75）远高于生成视频（0.99，评分范围0-4），表明生成视频存在明显的“发展不足”问题。

Insight: 创新点在于提出了一种基于进展度和静态率的双部分评估协议，能可靠区分生成与真实视频，并揭示了生成模型在模拟不可逆过程时倾向于保持静态而非错误反转。此外，论文通过解耦属性潜在空间中的单调性强制机制，展示了后验读取指导的可操纵性缺陷，为改进模型设计提供了新思路。

Abstract: Many physical attributes are \emph{irreversible}: ice melts but does not re-freeze, paper chars but does not un-burn. Do video generators respect this? We show the question is hard to measure, and that what can be measured reliably is \emph{development} rather than reversal. Metrics of local reversal are null-degenerate: a per-clip violation rate scores $0.50$ on pure noise, and a variance-normalized reversal residual sits at its noise ceiling. What survives null-testing is a two-part protocol: progress (a directional attribute correlation) and a stasis rate. Under this protocol, generated video separates cleanly from real footage, and the gap is human-validated. Across seven text-to-video models, real reference footage advances ($ρ{=}{+}0.40$, $35%$ static) while every generator shows near-zero progress and $92$–$100%$ stasis; nine annotators rate real footage far above generated ($2.75$ vs.\ $0.99$ on a $0$–$4$ scale). The reliable finding is \emph{under-development}: generators barely advance irreversible attributes rather than reversing them. As a complementary mechanism, we show that post-hoc readout guidance is gameable, whereas enforcing monotonicity by construction in a disentangled attribute latent removes the gameable readout, validated in controlled and semi-synthetic settings.

[90] Geometry-guided Emotion Modulation for Controllable and Photorealistic Emotional Talking Face Generation cs.CVPDF

Chenggong Hu, Shaoyin Ma, Yi Wang, Li Sun, Mingli Song

TL;DR: 本文提出GemTalk，一种基于扩散模型的框架，用于生成可控且逼真的情感化说话人脸。该方法结合了隐式表示的语义丰富性和显式几何先验的结构精确性，通过几何引导的情感调制模块实现情感强度的精确连续控制，同时保持高视觉保真度。

Details

Motivation: 现有音频驱动的情感化说话人脸生成方法难以在可控性和视觉逼真度之间取得平衡：隐式表示缺乏结构指导，导致情感表达平均化；显式几何方法虽可控但牺牲纹理细节。

Result: 大量实验表明，GemTalk在照片真实感和面部情感动态方面均达到优异性能，在相关基准测试中表现出色。

Insight: 创新点在于提出几何引导的情感调制模块，利用显式几何先验重新校准隐式特征幅度，实现情感强度的精确连续控制；同时融合隐式语义与显式结构，兼顾控制精度与视觉质量。

Abstract: Audio-driven emotional talking face generation aims to synthesize realistic videos with expressive facial dynamics. However, existing methods struggle to balance controllability and visual fidelity. Although implicit representations capture rich semantics, they lack structural guidance, often resulting in averaged emotional expressions. In contrast, explicit geometric methods offer better control over facial expressions but tend to sacrifice high-frequency texture details. To address it, we propose GemTalk, a diffusion-based framework that combines the semantic richness of implicit representations with the structural precision of explicit geometric priors. We introduce a Vision-guided Audio Emotion Projection (V-AEP) module to extract implicit emotional lip and expression features. At the same time, a Diffusion-based Geometric Priors Generator (D-GPG) generates identity-aware blendshape coefficients as explicit structural priors. Crucially, our Geometry-guided Emotion Modulation (GEM) module leverages these geometric priors to recalibrate the magnitude of implicit features, enabling precise, continuous control over emotional expressions, especially emotion intensity, without sacrificing visual quality. Extensive experiments show GemTalk achieves superior performance in photo-realism, and facial emotional dynamics.

[91] CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Seconds cs.CVPDF

Peng Zheng, Ruiqi Liu, Rui Ma, Zuxuan Wu

TL;DR: 本文提出CopyCat，一种轻量级模型精炼框架，旨在快速提升主题到图像生成模型在细粒度主题一致性上的表现。该方法通过附加一个轻量级的细粒度一致性LoRA（FCLoRA），并利用单张代理图像进行自重建优化，仅需数秒即可完成对预训练模型的一次性精炼，精炼后的模型可直接应用于未见过的参考主题和提示，无需进一步优化。

Details

Motivation: 现有主题到图像生成模型在个性化图像生成方面取得显著进展，但在保留细粒度的、主题特定的细节方面仍存在困难，主要原因是缺乏高质量的细粒度身份监督数据。

Result: 在DreamBench和XVerseBench基准测试上的大量实验表明，该方法在单主题和多主题设置下，对多个代表性主题到图像模型均能带来细粒度主题一致性的持续改进。

Insight: 创新点在于提出了一种基于单代理图像自重建目标的快速精炼框架（FCLoRA），简化了优化任务；同时发现，在双流扩散Transformer中仅适配视觉流能持续提升主题一致性，这为模型微调提供了新的见解。

Abstract: Recent subject-to-image models have achieved impressive progress in personalized image generation, yet they still struggle to preserve fine-grained subject-specific details. A major reason is the lack of high-quality fine-grained identity supervision: real paired data are expensive to collect, while synthesized training pairs often preserve only coarse subject appearance and fail to capture subtle subject-specific details. In this work, we propose CopyCat, a lightweight model-refinement framework that improves fine-grained subject consistency within only a few seconds. CopyCat performs a one-time refinement of a pretrained subject-to-image model by attaching a lightweight Fine-grained Consistency LoRA (FCLoRA) and optimizing it using a single proxy image, which is used as both the conditioning image and the reconstruction target. This exact self-reconstruction objective substantially simplifies the optimization task, enabling effective fine-grained refinement within only a few seconds. The refinement is performed only once; the resulting model can be directly applied to diverse unseen reference subjects and prompts without further subject-specific optimization. We further revisit subject-to-image LoRA training in double-stream diffusion transformers and find that adapting only the visual stream consistently improves subject consistency. Extensive experiments on DreamBench and XVerseBench demonstrate consistent improvements in fine-grained subject consistency across representative subject-to-image models under both single- and multi-subject settings.

[92] Breaking the Horizontal Prior: From Long-Tailed Orientation Bias to Roll-Robust Monocular Depth Estimation cs.CVPDF

Kaihua Tang, Ziqing Xia, Xiaoxu Zheng, Xiaoxue Zhang, Michael Bi Mi

TL;DR: 本文针对单目深度估计模型对相机滚动（roll）鲁棒性差的问题，提出了一种名为不变深度约束（ID-Constraint）的训练时监督策略。该方法通过引入一系列几何和空间推理任务对深度骨干网络进行微调和联合正则化，以学习旋转稳定的深度相关表示，从而打破由训练数据长尾分布导致的‘水平先验’偏差。

Details

Motivation: 现有最先进的深度基础模型存在鲁棒性问题，特别是轻微的相机滚动就会导致深度估计性能大幅下降。作者将此归因于一个被忽视的现象——‘水平先验’，即由于人类视觉偏好和摄影习惯，大多数训练图像都是近似水平拍摄的，导致了长尾分布偏差。

Result: 在四个滚动设置下的五个基准数据集上进行的广泛实验证明了该方法的有效性。

Insight: 创新点在于提出了ID-Constraint训练策略，通过辅助的几何与空间任务进行正则化，使主干网络学习对旋转不变的深度表征，而无需改变推理时的原始架构。这为解决因数据分布偏差（水平先验）导致的模型鲁棒性问题提供了一种新颖的思路。

Abstract: Despite recent advances in Monocular Depth Estimation, state-of-the-art depth foundation models remain vulnerable to robustness issues. Particularly, even slight camera rolls can result in substantial degradation in depth estimations. We attribute this problem to a previously overlooked phenomenon, termed the Horizontal Prior, which is a manifestation of long-tailed distribution bias: most training images are captured in approximately horizontal orientations due to human visual preferences and photographic habits. While intuitive remedies such as re-balanced data augmentation and horizon leveling provide partial improvements, they fail to fully address the issue. In this paper, we introduce Invariant Depth Constraint (ID-Constraint), a training-time supervision strategy that improves roll robustness by fine-tuning and jointly regularizing the depth backbone with a series of geometric and spatial reasoning tasks. These auxiliary objectives encourage the backbone to learn rotation-stable, depth-relevant representations, while the auxiliary prediction heads are discarded after training, leaving the original inference architecture unchanged. Extensive experiments on five benchmark datasets across four roll settings demonstrate the effectiveness of the proposed method.

[93] E2Pano: Learning Event-to-Panorama Image Reconstruction cs.CVPDF

Zhenyang Li, Zongqi He, Jia Pan, Shijie Lin, Yifan Peng

TL;DR: 本文提出E2Pano，一种几何引导的事件相机到全景图像重建的端到端学习框架。该方法通过保留真实球面坐标、使用轻量级频域监督增强模块以及球形Transformer，从事件流中重建高质量、无运动模糊的全景图像。

Details

Motivation: 事件相机具有微秒级时间分辨率和高动态范围，适合快速旋转扫描下的全景成像，但现有基于优化的方法计算量大，而基于学习的方法主要针对透视图像，缺乏对全景输出的几何感知支持。

Result: 在合成数据和真实旋转扫描数据上的实验表明，该方法相比基于优化的基线在重建质量和光度重建成本上均有提升，并且仅使用合成数据训练就能在真实采集协议下实现良好的迁移效果。

Insight: 创新点在于将几何映射的球面坐标贯穿整个流程，引入频域监督来弥合事件-图像域差距，并采用带3D位置嵌入的球形Transformer进行光度重建；同时构建了包含合成和真实场景的PanoScan数据集。

Abstract: Event cameras offer microsecond-level temporal resolution and high dynamic range, potentially facilitating motion-blur-free panoramic imaging from fast rotational scanning. Nonetheless, existing optimization-based methods remain computationally demanding, while prior learning-based reconstruction methods are largely designed for perspective imagery and lack geometry-aware support for panoramic outputs. We present E2Pano, a geometry-guided event-to-panorama pipeline with an end-to-end learnable photometric reconstruction stage. Our framework preserves real spherical coordinates from geometric mapping throughout the pipeline, employs a lightweight enhancement module with frequency-domain supervision to bridge the event-image domain gap, and leverages a spherical Transformer with 3D positional embeddings for photometric reconstruction. Experiments on synthetic data and captured rotational scans show improved reconstruction quality and lower photometric reconstruction cost than optimization-based baselines, together with encouraging transfer to real captures under our acquisition protocol despite training purely on synthetic data. Additionally, we construct PanoScan, a dataset with 4,370 synthetic and 30 real-world panoramic scenes paired with event streams. Our dataset and code will be released.

[94] AeroLLE: Constrained Pseudo-Supervision for Nighttime Aerial Image Enhancement with the AeroNight-1.5K Benchmark cs.CVPDF

Wei Lu, Hongyuan Liu, Si-Bao Chen

TL;DR: 本文提出了AeroLLE框架和AeroNight-1.5K基准数据集，用于解决夜间航空图像增强问题。该框架采用两阶段方法：首先使用HVI基础增强器恢复可见性，然后通过空间自适应曝光-颜色校准（SAECC）进行精细调整，利用伪参考图像进行约束学习。

Details

Motivation: 夜间航空图像增强面临空间曝光不均、混合光照和结构信息弱等挑战，且难以从移动平台获取配对的正常光照参考图像。现有方法使用生成的正常光照图像作为外观指导，但可能改变几何或纹理。

Result: 在提出的AeroNight-1.5K数据集上，通过互补的伪配对和非配对评估协议进行实验。结果表明，该方法与筛选的外观目标具有更好的一致性，并在不同夜间航空场景中实现了更平衡的曝光和颜色校正。

Insight: 创新点在于构建了首个大规模真实夜间航空图像数据集AeroNight-1.5K，并提出了一种两阶段、受约束的伪监督学习框架。其核心思想是分阶段进行特定校准，在基础增强器固定的前提下，使用低分辨率、有界的RGB增益和偏置场进行空间自适应校正，从而在缺乏配对标定数据时，有效利用生成的外观指导并限制校正幅度与空间变异。

Abstract: Nighttime aerial image enhancement is challenged by spatially nonuniform exposure, mixed illumination, and weak structural evidence, while registered normal-light targets are difficult to capture from moving platforms. Generated normal-light images provide practical appearance guidance but may alter geometry or texture. We introduce \aeronight{}, comprising 1,500 real nighttime aerial RGB images: 1,300 inputs are associated with manually screened pseudo-references, and 200 inputs support unpaired evaluation. We propose AeroLLE, a two-stage framework that first recovers visibility with an HVI Base Enhancer and then performs Spatially Adaptive Exposure–Color Calibration (SAECC). After the Base Enhancer is selected and frozen, SAECC predicts bounded, low-resolution RGB gain and bias fields, restricting the magnitude and spatial variation of the second-stage correction. Experiments under complementary pseudo-paired and unpaired protocols demonstrate improved agreement with screened appearance targets, together with more balanced exposure and color correction across diverse nighttime aerial scenes. These results support constrained, stage-specific calibration as a practical strategy for learning from generated appearance guidance when registered aerial references are unavailable.

[95] Coverage-Driven Adaptive Keyframe Selection for Video Understanding cs.CV | cs.AIPDF

Junyang Zhang, Puhan Luo, Chen Tang, Yuxi Shi, Xiang-Yang Li

TL;DR: 本文提出了一种名为CSES的无训练语义关键帧选择器，用于视频理解任务。该方法通过自适应地确定需要评分的帧数和选择的关键帧数量，以减少大型视觉语言模型处理视频时的计算开销。CSES将关键帧选择建模为一个覆盖问题，综合考虑语义相关性、时间冗余和视觉冗余，并在覆盖饱和时终止选择过程。

Details

Motivation: 现有方法通过评分帧-查询相关性来选择关键帧，但需要处理大量帧，计算成本高，且相关帧的分布因查询而异。本文旨在解决这一局限性，提出一种自适应方法，以减少评分帧数和选择的关键帧数量，同时保持模型性能。

Result: 在四个大型视觉语言模型和两个基准测试上的实验表明，该方法在保持准确性的同时，比现有基线方法减少了4-13倍的评分帧数和18.4%-20.5%的输入关键帧数量，并在帧选择速度上实现了3.1-5.4倍的加速。

Insight: 创新点在于将关键帧选择建模为单调子模覆盖问题，通过贪婪优化保证近似解的质量，并引入覆盖饱和作为终止条件，自适应地调整时间覆盖范围。这为视频理解中的高效帧选择提供了可借鉴的优化框架。

Abstract: Recent advances in large vision-language models (LVLMs) have enabled long-video understanding and analysis. However, processing the large number of frames in a video incurs substantial computational overhead. Existing methods reduce LVLM inference costs by scoring frame-query relevance before inference and selecting keyframes accordingly. Nevertheless, the distribution of relevant frames varies across queries, and these methods often need to score hundreds or thousands of frames. To address this limitation, we propose CSES, a training-free semantic keyframe selector that adaptively determines the numbers of frames to score and keyframes to select. CSES estimates the prominence of the frame-query relevance profile to guide active acquisition and adapt the temporal coverage of each input. It then formulates keyframe selection as a coverage problem that jointly accounts for semantic relevance, temporal redundancy, and visual redundancy. Active acquisition and keyframe selection terminate based on coverage saturation. The selection objective is monotone and submodular, enabling greedy optimization with a standard approximation guarantee. Experiments with four LVLMs on two benchmarks show that our method preserves accuracy while scoring $4$-$13\times$ fewer frames and selecting $18.4%$-$20.5%$ fewer input keyframes than existing baselines. CSES further achieves a $3.1$-$5.4\times$ speedup in frame selection over baselines.

[96] Generated Images Are Easier to Forget: A Machine Unlearning Perspective for Synthetic Image Detection cs.CV | cs.LGPDF

Jun Nie, Yonggang Zhang, Tongliang Liu, Yiu-ming Cheung, Bo Han

TL;DR: 本文提出了一种基于机器遗忘（machine unlearning）新范式的生成图像检测方法。研究发现，大规模视觉模型（LVMs）在遗忘过程中，对生成图像特征的退化速度远快于自然图像。受此启发，作者提出了无需数据的模型剪枝检测和数据驱动的模型优化检测两种方法，并在多个基准测试中超越了传统检测方法。

Details

Motivation: 现有生成图像检测方法依赖人工标注数据集，泛化能力有限。大规模视觉模型（LVMs）虽具有强大的泛化能力，但在自然图像主导的预训练数据上，对自然图像和生成图像的特征捕获能力相近，导致区分度有限。本文旨在探究LVMs在何时、如何对两类图像表现出不同行为，以解决检测泛化问题。

Result: 在多个基准测试上的广泛实验表明，基于遗忘的方法优于传统的检测方法，实现了更优的检测性能。

Insight: 核心创新在于将生成图像检测任务重新定义为机器遗忘问题，揭示了LVMs在遗忘过程中对生成图像和自然图像存在差异化的特征退化动力学。这启发了无需训练数据或利用数据驱动优化的两种新型检测范式，为领域提供了新的研究方向。

Abstract: Robust detection of generated images is critical to counter the misuse of generative models. Existing methods primarily depend on learning from human-annotated training datasets, limiting their generalization to unseen distributions. In contrast, large-scale vision models (LVMs) pre-trained on web-scale datasets exhibit exceptional generalization power through exposure to diverse distributions, offering a transformative paradigm for this task. However, our experimental results reveal that LVMs pre-trained on natural-image-dominated data can effectively capture the features of both natural and generated images, yielding comparably low losses and thus limited discriminative capacity between them. This prompts a key question: When and how do LVMs exhibit different behaviors when capturing features of natural and generated images? This investigation reveals an insight: during unlearning, LVMs exhibit disparate forgetting dynamics with feature degradation for generated images escalating faster than natural ones. Inspired by the disparate dynamics, we introduce two detection methods: 1) data-free detection, which prunes model parameters to induce unlearning without data access, and 2) data-driven detection, which optimizes LVMs to unlearn knowledge tied to generated images. Extensive experiments conducted on various benchmarks demonstrate that our unlearning-based approach outperforms conventional detection methods. By recasting the detection task as a problem of machine unlearning, our work establishes a new paradigm for generated image detection.

[97] FreqAnchorAD: Language-Free Zero-Shot Anomaly Detection via Frequency-Deviation Anchoring cs.CVPDF

Jianfeng Qiu, Peiyuan Li, Juan Xie, Xueliang Ma, Sihang Zhou

TL;DR: 本文提出了一种名为FreqAnchorAD的无语言零样本异常检测方法，该方法通过频率偏差锚定来检测和定位未见目标域中的异常，无需目标域训练数据。该方法利用预训练视觉模型，通过局部频率补偿模块增强空间频率线索，并设计频率偏差锚投影器进行基于锚点的异常判别，在13个工业和医学基准测试中实现了图像级异常识别和像素级缺陷定位的最先进平均性能。

Details

Motivation: 现有零样本异常检测方法主要依赖CLIP等预训练模型在空间特征空间进行判别，但纹理、边界和局部结构的细微变化容易与正常外观变化混淆。尽管这些缺陷在空间上不明显，但它们会破坏局部纹理规律性或边界连续性，从而在频带中引起响应偏差，而现有方法未能显式建模这些频率相关特性。

Result: 在13个工业和医学基准测试上的实验表明，FreqAnchorAD在图像级异常识别和像素级缺陷定位方面达到了最先进的平均性能。

Insight: 创新点在于通过图像域分析发现局部缺陷在低、中、高频带均表现出与正常参考的空间频率偏差，表明异常证据并非普遍由高频响应主导；据此设计了频率感知框架，通过局部频率补偿模块、频率偏差锚投影器和非对称锚监督来组织频率增强响应进行锚点相对异常判别，稳定正常锚对齐同时保留多样异常模式。

Abstract: Zero-shot anomaly detection (ZSAD) aims to detect anomalies and localize defective regions in unseen target domains without target training data. Recent ZSAD methods build on pretrained vision models, particularly CLIP, and construct normal and anomaly references from textual prompts or learnable visual representations. These methods perform anomaly discrimination primarily in spatial feature spaces, where subtle changes in texture, boundaries, and local structures can be confused with normal appearance variations. Although inconspicuous spatially, such defects can disrupt local texture regularity or boundary continuity, inducing response deviations across frequency bands. However, existing ZSAD methods do not explicitly model these frequency-dependent characteristics. Our image-domain analysis reveals that local defects exhibit spatial-frequency deviations from normal references across low-, middle-, and high-frequency bands, indicating that anomaly evidence is not universally dominated by high-frequency responses. Motivated by this observation, we propose FreqAnchorAD, a frequency-aware framework that organizes frequency-enhanced responses for anchor-relative anomaly discrimination. Specifically, the Local Frequency Compensation Module (LFCM) enhances intermediate patch tokens with local spatial-frequency cues. The Frequency-Deviation Anchor Projector (FDAP), our core discrimination module, organizes enhanced responses along a source-derived channel coordinate and measures anomaly evidence through relative similarity to normal and anomaly anchors. Finally, Asymmetric Anchor Supervision (AAS) stabilizes normal-anchor alignment while preserving diverse anomaly patterns. Experiments on thirteen industrial and medical benchmarks show that FreqAnchorAD achieves state-of-the-art mean performance in image-level anomaly recognition and pixel-level defect localization.

[98] Foveated Probes Recover Localized Binding Information in Vision Foundation Models cs.CVPDF

Mateusz Michalkiewicz, Mahsa Baktashmotlagh, Guha Balakrishnan

TL;DR: 本文研究了冻结视觉基础模型中空间信息的读取问题，指出标准的全局嵌入接口会混淆缺失信息与读取时丢失的信息。通过对比全局读取、轻量级注视点读取和带标注目标区域的Oracle读取，在三个局部绑定任务上验证了注视点读取能有效恢复空间信息。

Details

Motivation: 动机在于探究冻结视觉基础模型的评估方式，区分模型本身缺失空间信息与全局嵌入接口导致的信息丢失，以更准确地评估其空间感知能力。

Result: 在合成颜色-形状绑定任务中，全局读取在目标单独出现时表现完美，但在杂乱和反事实编辑下崩溃，而注视点读取恢复了大部分Oracle可访问的信号；在GQA衍生任务中，问题条件化的注视点读取显著提高了局部颜色准确性。

Insight: 创新点在于提出注视点读取方法，通过注意力池化学习或问题条件化的查询来提取局部信息；客观分析表明，全局池化会稀释局部证据并暴露于无关对象的干扰，而轻量级读取接口能有效利用冻结模型中的空间信息。

Abstract: Frozen vision foundation models are commonly evaluated through a single global image embedding, but this interface can conflate missing information with information lost at readout time. We study this distinction by keeping a pretrained vision encoder frozen and varying only the readout applied to its final patch tokens. We compare standard global readouts against a lightweight foveated readout, which attention-pools patch tokens using a learned or question-conditioned query, and against an oracle readout with access to the annotated target region. We evaluate these interfaces on three localized binding problems: a controlled synthetic color–shape binding task under clutter, a color-free crowded shape-detection variant, and a GQA-derived natural-image task where paired questions ask for the colors of different same-category objects in the same image. Global readouts perform near perfectly when the synthetic target appears alone, but collapse under clutter and counterfactual target edits, whereas the foveated readout recovers most of the oracle-accessible signal. On the GQA-derived task, question-independent global image vectors improve only modestly over question-only priors, while question-conditioned foveation substantially improves paired localized color accuracy. A counterfactual nuisance-to-signal ratio explains the synthetic failures: global pooling dilutes localized label-changing evidence while exposing the probe to nuisance variation from irrelevant objects. These results indicate that apparent spatial blindness in frozen vision models can arise from the global embedding interface rather than from an absence of spatial information in the frozen patch tokens.

[99] MDTD-ArtIR: Benchmarking Image Editing and Restoration Models for Art Image Restoration under Texture-Overlay Degradations cs.CVPDF

Mridula Vijendran, Shuang Chen, Hubert P. H. Shum

TL;DR: 该论文提出了一个名为MDTD-ArtIR的基准测试，用于评估图像编辑和修复模型在艺术图像修复任务上的表现，特别是针对纹理覆盖类型的退化。它引入了一个新的公开退化纹理掩码数据集MDTD-Art，并系统性地比较了通用修复模型、图像编辑模型和视觉语言模型在不同退化程度下的性能。

Details

Motivation: 现有修复方法在处理严重退化（如艺术品的裂纹、污渍、颜色/纹理偏差）时，常产生不自然的纹理、难以保持颜色和纹理，或无法有效利用部分保留的图像信息。现有基准测试通常假设退化算子已知，无法捕捉艺术损伤的复杂特性。

Result: 实验表明，在处理任意退化时，图像编辑模型（如基于扩散的模型）持续优于专门的修复架构，并且通过强调细节保存和结构一致性的结构化提示工程，其性能增益会进一步放大。该基准评估了多种最先进的模型在不同掩码不透明度水平下的表现。

Insight: 论文的创新点在于创建了一个针对复杂、语义性、半透明艺术图像退化的可控盲修复基准和数据集。其核心见解是，可恢复的语义信息和提示可控性是艺术图像修复的关键因素，这为利用强大的图像生成/编辑模型（而非传统修复模型）解决此类问题提供了新思路。

Abstract: Restoring severely degraded visual media still remains a formidable challenge, as existing methods often hallucinate unnatural textures and contents, struggle with preserving color and texture, or fail to leverage partially retained image information. Existing restoration benchmarks assume known degradation operators and fail to capture the complex characteristics of artistic damage such as cracks, stains, and color/texture deviation. We introduce a controlled benchmark for blind restoration of semantic, semi-transparent image media degradations, accompanied by a new, publicly open degradation alpha texture mask dataset MDTD-Art. We present a new dataset and benchmark evaluating state-of-the-art universal restoration models against image editing and vision-language models across varying mask opacity levels. Our experiments demonstrate that image editing models consistently outperform specialized restoration architectures for arbitrary degradations, with performance gains amplified by structured prompt engineering emphasizing detail preservation and structural consistency. These findings position recoverable semantic information and prompt controllability as critical factors in art image restoration.

[100] LUT: Latent Utility Training for Visual Reasoning cs.CVPDF

Jiaxuan Kang, Siyu Chen, Mingda Li, Mingjie Liu, Tianyue Wang

TL;DR: 本文提出LUT（Latent Utility Training）框架，一种仅使用标准视觉问答（VQA）数据对进行训练的潜在推理方法。该框架通过轨迹级的效用感知潜在蒸馏监督微调（UAD-SFT）和步骤级的潜在归因策略优化（LAPO），专注于提升潜在状态对最终答案的效用，从而改善感知密集型视觉推理任务。

Details

Motivation: 现有潜在视觉推理方法通常依赖昂贵的中间监督（如边界框、草图或交错文本），这些方法关注如何塑造潜在状态，但未明确评估潜在状态对最终答案是否有用。本文旨在仅使用标准VQA数据对，通过强调潜在效用来训练更有效的视觉推理模型。

Result: 在感知密集型视觉推理基准测试上的实验表明，LUT优于先前的潜在推理方法，并且与需要交错文本标注的方法相比，在标注成本更低的情况下仍保持竞争力。

Insight: 创新点在于提出了以潜在效用为中心的两级训练策略：轨迹级通过信息增益筛选答案相关轨迹并进行课程蒸馏；步骤级利用答案对潜在状态的归因进行差异化强化学习优化。这避免了昂贵的中间监督，并确保潜在计算直接服务于最终答案预测。

Abstract: Multimodal large language models have advanced visual understanding, yet perception-intensive reasoning remains challenging. Recent latent visual reasoning methods introduce hidden-space computation before answering, but they often rely on costly intermediate supervision, such as bounding boxes, sketches, or interleaved rationales. These strategies focus on how latent states should be shaped, but do not explicitly assess whether the latent is useful for the final answer. We propose LUT, a latent reasoning framework trained with only standard VQA pairs. LUT centers training on Latent Utility at two levels. At the trajectory level, we propose Utility-Aware Latent Distillation SFT, which explores answer-relevant latent trajectories, selects qualified trajectories by their information gain, and distills more reliable and learnable supervision through curriculum learning. At the step level, we propose Latent Attribution Policy Optimization, which uses answer-to-latent attribution to differentially optimize latent steps during reinforcement learning. Experiments on perception-intensive visual reasoning benchmarks show that LUT outperforms previous latent reasoning methods and remains competitive with latent-text interleaved methods with lower annotation cost.

[101] ChordVideo: One-Step, Training-Free, Temporally Consistent Video Editing via Low-Energy Transport cs.CVPDF

Zhiqiang Lao

TL;DR: 本文提出了ChordVideo，一种基于低能量传输原理的一步式、无需训练、时序一致的视频编辑方法。该方法通过共享噪声、运动对齐的逐帧Chord场因果聚合以及可选的时间平滑近端校正，将ChordEdit的低能量平滑思想从图像扩展到视频时间维度，有效解决了独立处理视频帧时产生的时序闪烁和编辑强度漂移问题。

Details

Motivation: 现有的一步式文本到图像模型（如ChordEdit）能够实现无需训练和反演的快速图像编辑，但直接应用于视频帧时会导致时序不一致性，如闪烁和编辑强度漂移。因此，需要一种能够保持视频时序一致性的高效编辑方法。

Result: 在TGVE/DAVIS基准测试中，使用两种一步式骨干网络，ChordVideo将扭曲误差降低了78%，闪烁减少了49%，CLIP帧一致性提高了9-10个百分点，背景PSNR提升了约1.5 dB，同时保持每帧仅需2次网络函数评估（NFE）。与七种多步编辑方法相比，它在保持竞争性时序一致性和源视频保留的同时，每个视频片段所需的模型步骤减少了10-60倍。

Insight: 创新点在于将低能量传输原理从图像空间扩展到视频时间维度，通过共享噪声和运动对齐的因果聚合机制实现时序一致性。此外，提出的扭曲误差界限理论分析了运动偏差与随机闪烁的分离，为时间窗口大小的选择提供了理论指导。从客观角度看，该方法在极低计算成本下实现了与多步方法相当的编辑质量，为实时视频编辑提供了新思路。

Abstract: One-step text-to-image models enable training-free, inversion-free editing with only 1–2 network function evaluations (NFE), while ChordEdit stabilizes such edits through low-energy smoothing along sampling time. Applied independently to video frames, however, it produces temporal flicker and edit-strength drift. We introduce \textbf{ChordVideo}, which extends the same low-energy principle to video time through shared noise, motion-aligned causal aggregation of per-frame Chord fields, and an optional temporally smoothed proximal correction. We derive a warping-error bound that separates motion bias from stochastic flicker and predicts diminishing returns with larger temporal windows. On TGVE/DAVIS with two one-step backbones, ChordVideo reduces warping error by \textbf{78%} and flicker by \textbf{49%}, improves CLIP frame consistency by \textbf{9–10 points}, and increases background PSNR by about \textbf{1.5,dB}, while retaining \textbf{2 NFE/frame}. Compared with seven multi-step editors, it achieves competitive temporal consistency and source preservation using \textbf{10–60$\times$ fewer model steps per clip

[102] MIDAL: Math Image Descriptions for Accessible Learning cs.CV | cs.HCPDF

Rebeka Popek, Vaghawan Ojha, Young Hwan You

TL;DR: MIDAL是一个包含2020张数学图像的数据集，旨在为视觉语言模型提供训练资源，以生成符合无障碍最佳实践的图像描述，从而提升STEM教育内容的可访问性。

Details

Motivation: 解决开放教育资源中数学图像缺乏深度描述的问题，特别是在科学和数学领域，复杂表达式和术语使得编写图像描述尤为困难。

Result: 数据集覆盖多个教育级别，可用于训练模型生成无障碍描述，并可能提升语言模型的数学推理和回答能力。

Insight: 创新点在于专门针对数学图像构建描述数据集，促进STEM内容无障碍性的讨论和创新，同时扩展了数据集在数学推理任务中的应用潜力。

Abstract: Many open educational resources are lacking in accessibility, especially in-depth image descriptions. In subjects like Science and Mathematics, however, it can be particularly difficult to write image descriptions since there can be many complicated expressions and names depending upon the course level. To help fill that gap in a small way, we introduce Math Image Descriptions for Accessible Learning (MIDAL), a math image-description dataset of 2,020 mathematical images spanning multiple educational levels, to aid in training vision language models to create image descriptions following accessibility best practices. We hope MIDAL is a valuable resource in enhancing the conversation and innovation regarding accessibility of STEM content in higher education. This dataset is however not just limited in math description generation but can also be used to fine-tune language models that can have improved mathematical reasoning and answers.

[103] Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking cs.CVPDF

Wenrui Cai, Yuzhe Li, Qingjie Liu, Yunhong Wang

TL;DR: 本文提出ACTrack，一种将异构模型作为可调用工具的智能协调框架，用于统一的多模态视觉跟踪。它通过事件触发机制，协调基于跟踪器的实例匹配工具、SAM3运动工具、SAM3感知工具和VLM重新提示工具，以整合不同模型工具的互补优势，解决现有匹配式跟踪器和分割基础模型各自的局限性。

Details

Motivation: 当前基于匹配架构的视觉跟踪器性能提升严重依赖输入上下文长度且已遇瓶颈，而现有利用基础模型的方法多将其单体化改造，未能有效利用互补优势。匹配式跟踪器擅长实例级对应但缺乏语义区分和细粒度前景感知，分割基础模型能生成精确掩码但难以进行实例区分和多模态扩展，且两者都缺乏长期跟踪的纠错能力。

Result: 实验表明，ACTrack在八个RGB基准测试上显著超越了最强和最大的跟踪器。此外，通过参数高效的适配策略，仅需30%的可训练参数即可实现统一的多模态跟踪，并在LasHeR、VisEvent、TNL2K和DepthTrack等多模态基准测试上大幅优于先前方法。

Insight: 核心创新在于将异构模型视为可调用的工具，并通过精心设计的事件触发和工具间协调机制，系统性地整合了它们在实例匹配、运动先验、感知冲突和语义纠错方面的互补优势。参数高效适配策略实现了跨工具的权重共享与复用，为构建统一、鲁棒且可扩展的多模态跟踪系统提供了新范式。

Abstract: Most current visual trackers adopt a matching-based architecture trained exclusively on tracking datasets, whose performance gains depend heavily on the length of the input context, and have now reached a bottleneck. While high-performance tracking increasingly relies on foundation models, existing methods use them monolithically, adapting a foundation model into a tracker or modify a segmentation foundation model into a tracking pipeline, which fails to exploit complementary strengths. Matching-based trackers excel at instance-level correspondence but lack semantic discrimination and fine-grained foreground perception, whereas segmentation foundation models produce precise masks yet struggle with instance discrimination and multimodal extension. Both paradigms also lack error-correction capabilities for long-term tracking. To address these issues, we propose ACTrack, an agentic coordination framework that treats heterogeneous models as invocable tools under an event-triggered mechanism. ACTrack coordinates a Tracker-based Instance Matching Tool for target discrimination, a SAM3 Motion Tool for mask-derived motion priors, a SAM3 Perception Tool for detecting distractors and instance-conflict cues, and a VLM Reprompt Tool activated only under persistent conflict to mitigate error accumulation. We design a complete tool-invocation trigger mechanism and an inter-tool coordination mechanism, enabling the complementary strengths of different model tools to be fully integrated. Experiments show that ACTrack substantially surpasses the strongest and the largest trackers on eight RGB benchmarks. Furthermore, a parameter-efficient adaptation strategy enables parameter sharing and reuse across tools, achieving unified multimodal tracking with only 30% trainable parameters while substantially outperforming prior methods on multimodal benchmarks such as LasHeR, VisEvent, TNL2K, and DepthTrack.

[104] PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series cs.CV | cs.LGPDF

Xuechen Li

TL;DR: PhenoStitch是一种无需任务特定梯度训练的农田全景制图流程，它结合了无标签的田块分割和少样本物候识别。该方法首先使用冻结的Segment Anything模型进行过分割，然后通过解析双谐波物候特征总结每个区域的光学和雷达时间序列，接着通过最小化Potts图能量合并相邻区域形成田块，最后仅使用每类k个标记田块进行最近原型匹配分类。

Details

Motivation: 现有农田全景制图方法通常依赖密集的田块级标注和任务特定模型训练，这限制了其在新区域和新生长季的适用性。本文旨在开发一种无需任务特定训练、在有限监督下仍能有效工作的制图流程。

Result: 在PASTIS-R数据集上，采用5折3种子评估，当每类仅使用k=20个标记田块（少于可用标签的1%）时，PhenoStitch取得了20.0的作物mIoU、76.2的分割质量和6.2的全景质量。它在相同协议下超越了评估的冻结基础模型、少样本和匹配预算的监督基线，在ZueriCrop数据集上也观察到一致的性能排名。

Insight: 创新点在于将无监督的田块分割（基于冻结SAM和图能量合并）与少样本的物候识别（基于紧凑的双谐波特征和原型匹配）相结合，构建了一个无需任务特定训练的完整流程。消融研究表明，雷达观测贡献了最大的性能增益，而图能量合并和紧凑物候特征提供了进一步改进。

Abstract: Panoptic crop mapping requires both delineating individual agricultural parcels and assigning a crop type to each parcel from satellite image time series. Existing approaches typically rely on dense parcel-level annotations and task-specific model training, which limits their applicability to new regions and growing seasons. We introduce PhenoStitch, a panoptic crop-mapping pipeline that requires no task-specific gradient-based training. A frozen Segment Anything model first oversegments each patch into class-agnostic regions. For each region, optical NDVI and Sentinel-1 backscatter series are summarized by an analytic double-harmonic phenological signature. Adjacent regions are then merged into parcels by minimizing a Potts graph energy, and each parcel is classified by nearest-prototype matching using only (k) labeled parcels per class. A final topology-closure step produces the panoptic map. Under a matched budget of (k=20) parcels per class, corresponding to less than 1% of the available labels, PhenoStitch achieves 20.0 crop mIoU, 76.2 segmentation quality, and 6.2 panoptic quality on PASTIS-R under a 5-fold, 3-seed evaluation. It outperforms the evaluated frozen foundation-model, few-shot, and matched-budget supervised baselines under the same protocol, with a consistent ranking also observed on ZueriCrop. Ablation studies show that radar observations contribute the largest performance gain, while the graph-energy merge and compact phenological signature provide further improvements. These results demonstrate the effectiveness of combining label-free parcel delineation with few-shot phenological recognition for panoptic crop mapping under limited supervision.

[105] PeCA: Palette Context Assisted Inference for Test-Time Paint-Bucket Colourisation on Animation Videos cs.CVPDF

Dongheng Lin, Jianbo Jiao

TL;DR: 本文提出PeCA（Palette Context Assisted）框架，用于动画视频的自动填色。该框架无需训练、即插即用，通过利用空间和时序上下文信息来解决现有方法在区域模糊片段上对应关系脆弱的问题，从而提升手绘动画线稿的填色效果。

Details

Motivation: 解决手绘动画制作中，现有自动填色流程在区域模糊或缺乏上下文时对应关系不稳定、导致填色效果不佳的问题。

Result: 在现有基准和新引入的长视频测试案例上的大量实验表明，该方法带来了持续的性能提升。

Insight: 创新点在于提出一种免训练、基于上下文推理的测试时增强框架，通过整合空间和时序上下文来稳定区域对应关系，提升填色鲁棒性。

Abstract: In animation production, paint-bucket colourisation for hand-drawn animation is a labour-intensive procedure that assigns each enclosed region in line sketches a colour from reference design sheets. Recent automatic paint-bucket colourisation pipelines mirror this workflow via region correspondence, but correspondences can be brittle when regions are ambiguous fragments without proper context. In this paper, we propose Palette Context Assisted (PeCA), a new training-free, plug-and-play framework for animation video colourisation that aims to close this gap at test-time via reasoning over spatial and temporal contexts. Extensive experiments on existing benchmarks and a newly introduced long-video test case show consistent performance boosts.

[106] Location-Aware Fine-Grained Representation Learning for Medical Vision Foundation Models cs.CVPDF

Myeongkyun Kang, Yanting Yang, Xiaoxiao Li

TL;DR: 该论文提出了一种名为LoFi的医学视觉基础模型，通过位置感知的细粒度表示学习来增强医学图像分析。该方法结合了定位和基于定位的标题生成目标，利用大规模医学定位数据集MedG进行训练，以同时实现临床意义和空间一致性。

Details

Motivation: 现有医学视觉编码器的训练策略难以同时获得具有临床意义的语义监督和空间一致性，导致大型视觉语言模型在医学图像分析中生成不可靠的响应。

Result: 在短语定位、视觉问答和基于区域的器官分类等任务中，LoFi在多个基准测试上均优于通用和医学视觉基础模型以及最先进的大型视觉语言模型。

Insight: 创新点在于通过定位和标题生成的双重目标，无需显式的补丁级正则化即可实现空间一致性，并构建了大规模医学定位数据集MedG以支持训练。

Abstract: Fine-grained visual representations are essential for medical image analysis, particularly when diagnostically relevant evidence is subtle and spatially localized. Modern transformer-based medical vision encoders must therefore learn patch-level representations that are both clinically meaningful and spatially consistent. Without these properties, large vision-language models (LVLMs) operate on an ambiguous visual foundation, limiting their ability to generate clinically reliable and spatially grounded responses. However, existing training strategies for medical vision encoders rarely achieve both objectives. Image-text alignment provides clinically meaningful supervision primarily at the image level, leaving the spatial localization of diagnostic evidence weakly constrained. In contrast, self-supervised learning promotes spatial consistency but lacks the semantic supervision needed to distinguish visually similar yet clinically distinct regions. To address this gap, we present LoFi, a medical vision foundation model built on location-aware fine-grained representation learning. LoFi trains a vision encoder with a lightweight large language model under grounding and grounded captioning objectives. Because these objectives require predicting location from clinical text and vice versa, spatial consistency emerges without any explicit patch-level regularization. To enable training at scale, we construct MedG, a large-scale medical grounding dataset of 4.48M image-text-box triplets curated from 84 datasets spanning 7 modalities. Across phrase grounding, visual question answering, and region-based organ classification under perturbations, LoFi consistently outperforms general-purpose and medical vision foundation models as well as state-of-the-art LVLMs. Code is available at https://github.com/myeongkyunkang/lofi-medg.

[107] MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection cs.CVPDF

Jiang Wu, Sichao Wu, Yinsong Ma, Lifang Zheng, Jingliang Duan

TL;DR: 该论文提出了MonitorVLM-v2，一个面向部署的视觉语言框架，用于实时安全违规检测。它将基于VLM的安全评估重新定义为在有限规则决策空间上的概率推断，将多模态推理压缩为单步规则ID预测，从而将解码从可变长度序列减少到单个令牌。通过引入符号策略优化（SymPO）算法和基于熵的分流机制，该框架在真实地下采矿设施的部署中实现了19.45倍的推理速度提升，并比人工检查多发现2.78倍的确切违规行为。

Details

Motivation: 解决大型视觉语言模型（VLMs）在工业监控等安全关键、规则驱动的场景中，因开放式、自回归的思维链推理方式导致决策非确定性、高延迟和高计算成本，从而无法满足实时、多流监控需求的问题。

Result: 在真实地下采矿设施中，对10个并发摄像头流进行了为期四个月的前瞻性部署。结果表明，与基线相比，框架实现了19.45倍的推理速度提升，并比现场常规人工检查流程多识别出2.78倍的确切违规行为，证明了其在实时、可审计工业监控中的实用价值。

Insight: 主要创新点在于将开放式的VLM推理重新定义为在有限符号决策空间内的概率推断，实现了从序列生成到单令牌预测的压缩。此外，提出的符号策略优化（SymPO）算法用于锐化决策边界，以及基于熵的不确定性分流机制，共同构成了一个高效、可部署的实时监控框架。其核心思想是将通用模型的强大能力与特定领域（如规则遵循）的确定性、高效性需求相结合。

Abstract: Large vision–language models (VLMs) can reason step by step about complex visual scenes, but this open-ended, autoregressive chain-of-thought (CoT) approach is poorly suited to safety-critical, rule-governed settings such as industrial surveillance, where decisions must be bounded, deterministic, and low-latency. Because CoT inference cost scales jointly with reasoning length and the number of concurrent streams, it creates a throughput bottleneck that precludes the real-time, multistream monitoring required for industrial accountability. Here we present MonitorVLM-v2, a deployment-oriented framework that recasts VLM-based safety assessment as probabilistic inference over a finite regulatory decision space, compressing multimodal reasoning into single-step rule-ID predictions and reducing decoding from a variable-length sequence to a single token. We introduce symbolic policy optimization (SymPO), a novel contrastive policy optimization algorithm that sharpens decision boundaries within this finite symbolic space, together with an entropy-driven triage mechanism that routes uncertain predictions to human reviewers for expert confirmation. In a four-month prospective deployment across 10 concurrent camera feeds in an operational underground mining facility, MonitorVLM-v2 achieved a 19.45-fold increase in inference speed and identified 2.78 times as many confirmed violations as the site’s routine manual inspection workflow, demonstrating the practical value of compressed symbolic decision-making for real-time, auditable industrial monitoring.

Kaifang Long, Lianbo Ma, Liming Liu, Guoyang Xie

TL;DR: 本文从Fisher信息矩阵的角度分析了多模态异常检测（MAD）中的跨模态融合偏差问题，并提出了一个名为UCFB的即插即用框架来缓解此偏差。该框架通过Fisher信息引导的动态校准来调整模态特定的正则化权重，并利用典型相似性分析来改善模态间交互。在MVTec 3D-AD和Eyecandies数据集上的实验表明，UCFB在单类、多类和少样本设置下均能带来一致的性能提升。

Details

Motivation: 当前MAD研究主要关注通过融合RGB和深度数据来增强异常表示，但忽视了跨模态融合偏差这一多模态学习中的已知挑战对性能瓶颈的影响。本文旨在分析并克服这种偏差。

Result: 在MVTec 3D-AD和Eyecandies数据集上进行了广泛实验，UCFB在单类、多类和少样本设置下均实现了性能的持续改进，证明了其有效性。

Insight: 创新点在于首次从Fisher信息矩阵的视角系统分析MAD中的跨模态融合偏差，并据此设计了一个结合动态校准和典型相似性分析的轻量级框架来缓解偏差，为多模态学习中的偏差校正提供了新思路。

Abstract: Current advancements in Multimodal Anomaly Detection (MAD) are largely driven by enhancing multimodal fusion, particularly through the integration of RGB and Depth data for richer anomaly representation. However, less attention was devoted to analyzing the role of cross-modal fusion bias, a well-known challenge in multimodal learning, in MAD. This gap motivates a key question: can we overcome this bias to break the performance bottleneck of current work? In this paper, we first analyze the impact of cross-modal fusion bias in MAD via the Fisher Information Matrix. Then, grounded in these findings, we propose UCFB, a simple yet effective plug-and-play framework designed to mitigate cross-modal fusion bias in MAD. It achieves this by jointly employing Fisher-information-guided dynamic calibration to adjust modality-specific regularization weights and canonical similarity analysis to improve inter-modal interactions. Extensive experiments on the MVTec 3D-AD and Eyecandies datasets demonstrate that UCFB achieves consistent improvements in single-class, multi-class, and few-shot settings.

[109] Swimm3R: Splatting with Medium-aware SfM for Underwater 3D Reconstruction cs.CV | cs.RO | eess.IVPDF

Minseong Kweon, Junaed Sattar

TL;DR: Swimm3R是一个用于水下三维重建的统一框架，它结合了介质感知的运动恢复结构（SfM）与水下Beta Splatting技术，以解决水下散射和衰减导致的重建失败问题。该方法通过前馈骨干网络蒸馏空中几何先验，并使用物理头回归水下成像参数、相机位姿和恢复的点云。此外，作者还引入了水下Beta Splatting，通过Beta基元和散射感知几何梯度扩展了高斯泼溅，并建立了巴巴多斯水下视频数据集来验证方法有效性。

Details

Motivation: 解决水下环境中由于介质散射和光线衰减导致的传统三维重建方法（如SfM）失效的问题，旨在恢复出连贯、准确的水下场景几何结构。

Result: 在提出的巴巴多斯水下视频数据集上，Swimm3R在挑战性散射条件下鲁棒地恢复了水下场景结构。其提出的水下Beta Splatting方法比WaterSplatting的平均PSNR提高了1.47 dB，并在下游定位任务中，将RRA@15和RTA@15指标分别提升了2.0和2.4个百分点。

Insight: 主要创新点包括：1）将介质感知的物理模型与基于学习的SfM框架统一；2）提出水下Beta Splatting，通过Beta基元和散射感知梯度扩展3D高斯泼溅，以更好地适应水下几何表示；3）构建了一个具有挑战性的真实水下视频数据集用于评估。从客观角度看，将物理成像模型与数据驱动方法结合，并专门针对水下特性设计新的可微渲染基元，是解决该领域难题的有效途径。

Abstract: We propose Swimm3R, a unified framework that combines medium-aware structure-from-motion (SfM) with Underwater Beta Splatting to address scattering- and attenuation-induced failures in underwater 3D reconstruction. Swimm3R distills in-air geometric priors into a feed-forward backbone and uses a physics head to regress underwater image-formation parameters, camera poses, and restored point clouds. Additionally, we introduce Underwater Beta Splatting, which extends Gaussian splatting with Beta primitives and scattering-aware geometric gradients for stable underwater geometry representation. We further establish the Barbados underwater video dataset to demonstrate the effectiveness of our method in challenging underwater environments. On this dataset, Swimm3R robustly recovers underwater scene structure under challenging scattering conditions, yielding coherent seafloor geometry. Using these predicted point clouds, the proposed Underwater Beta Splatting improves average PSNR by $1.47$ dB over WaterSplatting while increasing downstream localization performance by $2.0$ and $2.4$ percentage points in RRA@15 and RTA@15, respectively.

[110] Entity-Faithful Repair of Synthetic Supervision for Zero-Shot Image Captioning cs.CV | cs.CLPDF

Zhiyue Liu, Wenkai Zhou, Jian Qin, Qipeng Jiang

TL;DR: 该论文提出了ReCap框架，用于修复零样本图像描述任务中合成数据的实体级错位问题。通过检测图像支持的实体来指导标题重写，并结合自适应动态加权学习策略降低不可靠合成对的影响，从而提升监督保真度。

Details

Motivation: 现有方法利用文本到图像模型从纯文本语料库合成训练数据，但合成图像-文本对常存在细粒度的实体缺失或属性错位问题，导致监督保真度下降。全局相似性匹配方法无法系统修复实体级错位，因此需要显式细粒度重对齐机制。

Result: 在领域内和跨领域零样本图像描述基准测试中，ReCap显著提升了图像-文本一致性，并取得了最先进的性能表现。

Insight: 创新点在于将合成数据优化从隐式全局匹配转向显式细粒度实体重对齐，通过图像支持的实体检测指导标题重写；同时引入自适应动态加权学习策略，可灵活集成到现有合成数据流程中，提升监督信号的可靠性。

Abstract: Zero-shot image captioning aims to generate image descriptions without annotated image-text pairs. Recent approaches exploit text-to-image models to synthesize training data from text-only corpora, but most focus on improving overall data quality. In contrast, we observe that synthetic image-text misalignment is often structured and fine-grained: pairs may remain globally plausible while containing missing entities or misgrounded attributes, thereby degrading supervision fidelity. As a result, methods based on global similarity for image rematching or regeneration may improve apparent plausibility, but cannot systematically repair entity-level misalignment. To address this issue, we propose ReCap, a plug-and-play framework that shifts synthetic data refinement from implicit global matching to explicit fine-grained realignment. Specifically, ReCap enforces entity-level correspondence by using detected image-supported entities to guide caption rewriting, yielding more faithful synthetic supervision. In addition, we introduce an adaptive dynamic weighted learning strategy to downweight unreliable synthetic pairs during training. As a general framework, ReCap can be integrated into existing synthetic-data pipelines. Extensive experiments show that ReCap consistently improves image-text consistency and achieves state-of-the-art performance on both in-domain and cross-domain zero-shot image captioning benchmarks.

[111] Can Humans Dream of Electric Sheep? Human-Written Samples for Fine-Grained Vision-and-Language Hallucination Benchmarking cs.CV | cs.AI | cs.CLPDF

Timothee Mickus, Claudio Savelli, Eduardo Calò, Emilio Raimond, Stella Frank

TL;DR: 本文探讨了在模型快速迭代的时代，如何使幻觉评估更具持久性，提出用人手写的幻觉样本替代模型生成的幻觉样本，以实现基准测试与特定模型的解耦。为此，作者构建了一个包含1,600个人手写样本（涵盖中文、英文、法语、意大利语四种语言）和来自五个视觉语言模型的18,400个样本的数据集，并采用细粒度的跨度级标注方案进行幻觉标注。研究发现，人手写样本能带来更高的一致性、更好的数据集内容控制，同时与视觉语言模型样本分布相似，并能合理反映检测能力，表明人手写数据是替代基于模型的幻觉基准的可行方案。

Details

Motivation: 在模型快速更迭的背景下，如何使幻觉评估更具持久性，并实现基准测试与特定模型的解耦，是本文的核心动机。

Result: 实验表明，人手写样本在标注一致性、数据集内容控制方面优于模型生成样本，且分布与模型样本相似，能有效反映检测能力，验证了其作为基准的可行性。

Insight: 创新点在于提出并验证了用人手写幻觉样本构建持久、模型无关的细粒度视觉语言幻觉基准的可行性，为幻觉评估提供了新的数据来源和方法论。

Abstract: In an age of rapid model turnover, how do we make hallucination evaluation more perennial? We explore whether human-written hallucination samples could take the place of model-generated hallucinations, in order to make benchmarking detection independent of particular models. To this end, we construct a dataset of 1,600 human-written samples, spanning four languages (Chinese, English, French, Italian), and 18,400 samples from five vision-and-language models, all annotated for hallucinations using a fine-grained span-level labeling scheme. We find that human-written samples result in higher agreement and allow greater control of dataset contents, while remaining distributionally similar to samples derived from vision-and-language samples and providing a reasonable portrayal of detection capabilities - suggesting that human data is a viable substitute for model-based hallucination benchmarks.

[112] Struct-GStream: Towards Efficient Free-Viewpoint Video Streaming at Low-Bitrates with Structured 3D Gaussians cs.CVPDF

Han Jiao, Jiakai Sun, Lei Zhao, Wei Xing, Huaizhong Lin

TL;DR: 本文提出Struct-GStream方法，旨在通过结构化3D高斯（3DGs）实现低比特率下的高效自由视点视频（FVV）流式传输。该方法利用动态锚点生成结构化3DGs构建基础场景，并基于物体运动的局部刚性假设建模近似场景运动；同时引入全局自由3DGs修补策略，通过生成、剪枝和优化自由3DGs来修补缺陷区域和新兴物体。

Details

Motivation: 现有基于神经渲染的FVV构建方法难以实现实时渲染，且通常需要完整视频序列进行训练；而一些在线训练方法虽能实时渲染，却无法满足下游应用在存储和训练时间上的要求。本文旨在克服这些问题，实现高效、低比特率的FVV流式传输。

Result: 大量实验表明，Struct-GStream在训练时间、存储和渲染质量方面显著优于现有的FVV构建在线训练方法，同时保持有竞争力的渲染速度。

Insight: 创新点包括引入动态锚点生成结构化3DGs以建模基础场景运动，以及提出全局自由3DGs修补策略来处理场景缺陷和动态变化。从客观角度看，该方法将结构化表示与自由修补相结合，在保证质量的同时优化了训练效率和存储开销，为实时FVV流式传输提供了新思路。

Abstract: Constructing photorealistic Free-Viewpoint Videos (FVVs) of dynamic scenes from a set of posed 2D images has been an intriguing yet challenging task in computer vision. Methods based on neural rendering achieve high-fidelity image quality in FVV construction. However, most of these methods are unable to achieve real-time rendering and often require complete video sequences to train. Despite the existence of some online training methods capable of rendering FVVs in real time, they struggle to meet the requirements for storage and training time for downstream applications. To overcome this problem, we propose Struct-GStream, which can achieve efficient FVV streaming using structured 3D Gaussians (3DGs). Specifically, we introduce dynamic anchor points to generate structured 3DGs to construct basic scenes and model approximate scene movements based on the assumption of local rigidity in object motion. Besides, we introduce a global free 3DGs patching strategy involving free 3DGs’ generation, pruning, and optimization to patch and model deficient areas and emerging objects. Our method achieves fast training at low bitrates while maintaining high rendering quality. Extensive experiments demonstrate that Struct-GStream significantly outperforms existing online training methods for FVV construction in terms of training time, storage, and rendering quality while maintaining competitive rendering speed.

[113] Credit the Right Box: Marginal Contribution Assignment for Structured Visual Perception cs.CV | cs.AIPDF

Xinheng Han, Jianfei Wang, Yu Chen, Xiang Wang, Shuai Li

TL;DR: 本文提出MCR-GRPO框架，通过边际贡献分配解决多模态大语言模型在结构化视觉感知任务中存在的粒度不匹配问题。该方法利用留一法比较直接估计每个预测边界框的贡献，并将归一化的框级优势映射到生成每个框的token上，从而实现对结构化多对象定位的框感知优化。

Details

Motivation: 现有基于群体相对强化学习的方法仅提供响应级监督，导致结构化多对象预测中存在粒度不匹配问题：单个优势被广播给响应中的所有token，无法区分各个边界框的贡献。

Result: 在REC、DOD、分割和计数基准测试上的实验表明，该方法超越了先前基于GRPO的基线，达到了最先进的性能水平。

Insight: 创新点在于提出了边际贡献奖励机制，通过留一法比较和连续匹配集值评估器实现框级信用的稳定分配，从而将响应级比较与框感知优化相结合，提升了结构化多对象定位的精度。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly expected to solve structured perception tasks that require visual recognition, language-to-object binding, object cardinality preservation, and precisely localized grounding and segmentation outputs. However, existing group-relative reinforcement learning methods provide only response-level supervision, creating a granularity mismatch for structured multi-object prediction: a single advantage is broadcast to all tokens in a response, without distinguishing individual box contributions. To address this mismatch, we propose MCR-GRPO, a marginal contribution assignment framework that derives box-level credit directly from each sampled response. Specifically, Marginal Contribution Reward (MCR) estimates each predicted box’s contribution through a leave-one-out comparison, measuring how the matched set value changes when the box is removed from the response. After within-response normalization, records that improve the set value receive positive credit, while redundant or harmful ones are suppressed. To make marginal attribution stable and informative, we further introduce a Continuous Matched Set Value Evaluator that integrates permutation-invariant matching, count-aware normalization, and graded localization. MCR-GRPO maps normalized box-level marginal advantages to the token spans that generated each box, preserving GRPO’s response-level comparison while enabling box-aware optimization of structured multi-object grounding. Experiments across REC, DOD, segmentation, and counting benchmarks show state-of-the-art performance over prior GRPO-based baselines.

[114] Extended KAFR: A kinematic-adaptive paradigm for the efficient analysis of surgical video cs.CVPDF

Huu Phong Nguyen, Shekhar Madhav Khairnar, Ganesh Sankaranarayanan

TL;DR: 本文评估了将机器人手术中的运动自适应帧识别（KAFR）方法推广到腹腔镜手术视频分析的可行性。该方法通过检测手术工具、基于工具位移或速度变化自适应选择关键帧，并使用X3D模型对所选帧进行手术阶段分类。在Cholec80基准测试中，仅使用0.58%的帧就达到了91.0%的F1分数，性能与当前先进方法相当，同时大幅降低了计算负担。

Details

Motivation: 解决腹腔镜手术视频分析中因视频时长长、相机运动伪影多、图像质量相对较低带来的巨大计算负担和挑战，验证基于运动学的帧选择方法在更复杂手术环境中的泛化能力。

Result: 在Cholec80基准测试（80个腹腔镜胆囊切除术视频，标注了7个手术阶段）上，KAFR方法仅使用0.58%的帧进行阶段分类，取得了91.0%的F1分数。这比典型的4%帧采样减少了约7倍的计算量，同时性能与LoViT（90.2%）和Trans-SVNet（89.7%）等先进方法相当。

Insight: 摘要宣称的创新点在于将基于工具运动学的自适应帧选择范式从机器人手术成功迁移并验证于更具挑战性的腹腔镜手术环境。从客观角度看，其核心借鉴价值在于利用低层次的工具运动学特征（位移/速度）作为高效、鲁棒的帧重要性代理指标，以极低的帧采样率实现高性能的阶段识别，为长视频分析提供了计算高效的通用范式。

Abstract: Artificial Intelligence is increasingly applied to surgical video analysis for phase segmentation, skill assessment, and workflow optimization. A key challenge is the length of surgical recordings, often one to several hours, creating substantial computational burden. We previously developed Kinematics-Adaptive Frame Recognition (KAFR) for robotic surgery, showing that tracking tool motion effectively identifies informative frames while filtering redundant content. However, laparoscopic surgery introduces additional challenges: manual camera control causes frequent motion artifacts, and image quality is generally lower than robotic systems. This study evaluates whether KAFR generalizes to laparoscopic surgery using the Cholec80 benchmark, comprising 80 laparoscopic cholecystectomy procedures annotated for seven surgical phases. KAFR operates in three stages: a fine-tuned YOLO model detects and segments surgical tools; frames are adaptively selected based on tool displacement or velocity variation; and an X3D model classifies selected frames into surgical phases. KAFR achieved a 91.0% F1 score using only 0.58% of frames for phase classification, representing an approximately seven-fold reduction compared to typical 4% frame sampling, while maintaining performance comparable to LoViT (90.2%) and Trans-SVNet (89.7%). These results demonstrate that kinematics-based frame selection transfers effectively to the challenging laparoscopic environment.

[115] One Query, Many Scales: Sparse Mixture-of-Experts for Efficient Hierarchical Cross-View Geo-Localization cs.CVPDF

Ruijie Fan, Junyan Ye, Qi Zhu, Weijia Li

TL;DR: 本文提出GeoMoE，一种稀疏混合专家双编码器模型，用于高效的分层跨视角地理定位。该方法将全局多尺度表示学习与局部层次化搜索解耦，通过内容自适应路由将地面和卫星图像映射到可比较的嵌入空间，并利用概率波束搜索在层次结构中高效检索候选区域。

Details

Motivation: 现有跨视角地理定位系统通常采用固定分辨率、穷举式的搜索策略，在大范围区域中计算成本高，且难以适应卫星分辨率变化；而自回归的由粗到细方法虽能减少比较次数，但后期预测受限于早期决策和预定义层次结构，存在误差传播问题。

Result: 在Just Zoom In基准上达到95.78%的R@40m，比之前最佳方法提升2.77个百分点；在提出的VIGOR-M四城市基准上达到62.39%的R@1，同时查询匹配计算量仅为穷举L3扫描的5.27%，且比最强穷举基线在R@1上高出3.12个百分点。模型在L1、L2、L3分辨率上训练后，能在所有六个测试库上超越密集对照模型，并泛化到三个未见分辨率。

Insight: 核心创新在于通过稀疏混合专家架构和内容自适应路由，实现了全局多尺度表示学习与局部层次化搜索的解耦，从而限制了特征级误差传播和对预定义层次的强耦合；同时提出的VIGOR-M基准为单分辨率、跨分辨率和分层评估提供了更全面的测试环境。

Abstract: Cross-view geo-localization (CVGL) retrieves geo-tagged satellite imagery for a ground-view query. Most systems exhaustively search a flat, fixed-resolution gallery, incurring high cost over large areas and adapting poorly to satellite resolution changes. Autoregressive coarse-to-fine alternatives reduce comparisons but bind later predictions to earlier decisions and a predefined hierarchy. We introduce GeoMoE, a sparse mixture-of-experts dual encoder that decouples global multi-scale representation learning from local hierarchical search. Global multi-scale supervision and content-adaptive routing map ground and satellite images across resolutions into a globally comparable embedding space. At inference, each image is encoded once, and probabilistic beam search follows parent–child links to score a small candidate subset. Later levels reuse these descriptors rather than features generated by preceding levels, limiting feature-level error propagation and hierarchy coupling. We further introduce VIGOR-M, a four-city benchmark with an explicit parent–child satellite hierarchy and held-out half-step galleries for single-resolution, cross-resolution, and hierarchical evaluation. GeoMoE achieves 95.78% R@40m on Just Zoom In, 2.77 percentage points above the previous best, and 62.39% R@1 on VIGOR-M. The latter requires 0.885 MMAC/query for descriptor matching, 5.27% of an exhaustive L3 scan, while exceeding the strongest exhaustive baseline by 3.12 percentage points in R@1. One model trained on L1, L2, and L3 also outperforms a matched dense control across all six galleries and transfers to three withheld resolutions. By decoupling globally trained embeddings from local hierarchical search, GeoMoE jointly improves localization accuracy, search efficiency, and cross-resolution transfer.

[116] ReACT-CLIP: Response-Aware Test-Time Defense for Vision–Language Models cs.CVPDF

Hashmat Shadab Malik, Toluwani Aremu, Samuele Poppi, Muzammal Naseer, Salman Khan

TL;DR: 本文提出ReACT-CLIP，一种无需训练、响应感知的测试时防御方法，用于提升CLIP风格视觉-语言模型的对抗鲁棒性。该方法通过样本特定的相对跨噪声漂移和预测不稳定性分数，自适应地确定每个输入所需的校正强度以及是否需要防御干预，从而在多种攻击类型和强度下显著提高鲁棒性，同时保持干净样本的准确率。

Details

Motivation: 现有无需训练的测试时防御方法通常采用固定的校正强度，这导致其在攻击预算未知且样本需求各异的情况下，随着攻击增强而性能急剧下降。因此，需要一种能够根据每个输入样本自适应调整防御强度的机制。

Result: 在12个下游数据集、ImageNet及其分布偏移变体上，ReACT-CLIP针对多种攻击类型和强度均带来了显著的鲁棒性提升，同时基本保持了干净样本的准确率。

Insight: 创新点在于利用低噪声和高噪声探针间CLIP视觉特征漂移的相对增加作为样本特定的校正需求代理，并结合弱空间增强下的预测不稳定性分数，构建了一个自适应、无需训练且跨数据集和攻击预算通用的防御机制。

Abstract: Training-free test-time defenses offer a practical way to improve the adversarial robustness of CLIP-style vision–language models without modifying the pretrained model. However, their correction strength is typically fixed for a narrow range of attack budgets, even though the attack budget is unknown at inference and the required correction varies across samples. We show that this mismatch causes existing defenses to degrade sharply as attacks strengthen. We introduce ReACT-CLIP, a response-conditioned test-time defense that separately determines how strongly each input should be corrected and whether defensive intervention is necessary. Our key observation is that the relative increase in CLIP visual-feature drift between low- and high-noise probes provides a graded, sample-specific proxy for correction demand. ReACT-CLIP maps this relative cross-noise drift to the Gaussian noise scale used to construct a stable, noise-averaged feature anchor, enabling the corrective reach to adapt to each input. To determine whether intervention is necessary, we further observe that clean inputs retain stable class-probability distributions under weak spatial augmentations, whereas adversarial inputs exhibit greater variation. ReACT-CLIP quantifies this variation using a prediction-instability score computed by Jensen–Shannon divergence and combines it with relative cross-noise drift to form the defensive intervention score. ReACT-CLIP requires no model or prompt training, and its correction-strength mapping is calibrated once and fixed across datasets and attack budgets. Across 12 downstream datasets, as well as ImageNet and its distribution-shifted variants, ReACT-CLIP delivers substantial robustness gains across diverse attack types and strengths while largely preserving clean accuracy.

Xiaoqian Lu, Guangfu Guo

TL;DR: 本文提出了一种无需训练的后处理方法SSR，用于改进基于自监督视觉Transformer的对象中心分割掩码质量。该方法通过分析自注意力聚合前后图像块相似度的变化构建稀疏亲和图，从而在单步优化中传播初始软槽分配，有效解决了掩码碎片化、边界泄漏和区域误合并等问题。

Details

Motivation: 现有对象中心模型生成的掩码常出现碎片化、边界泄漏和错误区域合并等问题，需要一种无需重新训练或修改模型的后处理方法来提升掩码质量。

Result: 在自然图像、合成视频和真实视频基准测试中，SSR在所有24个评估模型-数据集组合上均提升了全像素调整兰德指数，平均增益达8.5个百分点。消融实验表明，值空间相似度偏移优于查询和键空间变体及静态Transformer亲和度。

Insight: 创新点在于利用自注意力聚合前后的相似度偏移构建动态亲和图进行掩码优化，该方法简单可迁移且无需训练；但需注意纹理密集场景可能导致视觉相似区域过度分组的问题。

Abstract: Object-centric models often produce fragmented masks, boundary leakage, and incorrect region merging. We introduce Similarity-Shift Refinement (SSR), a training-free post-hoc method for improving object-centric masks with a frozen self-supervised Vision Transformer. SSR measures changes in pairwise patch similarity before and after self-attention value aggregation, retains positively strengthened relations, and constructs a sparse affinity graph. This graph propagates the initial soft slot assignments in a single refinement step, without retraining or modifying either model. Across natural-image, synthetic-video, and real-world-video benchmarks, SSR improves all-pixel Adjusted Rand Index in all 24 evaluated model-dataset combinations, with an average gain of 8.5 percentage points. Ablations show that value-space similarity shifts outperform query- and key-space variants as well as static Transformer affinities. However, texture-dense scenes may cause visually similar regions to be over-grouped. Overall, SSR provides a simple and transferable signal for training-free object-centric mask refinement.

[118] Lethe: How Hard Is It to Forget? A Benchmark for Federated Unlearning in Medical Imaging cs.CVPDF

Shengchao Chen, Ting Shu

TL;DR: 本文提出了Lethe基准测试，用于评估医疗影像联邦学习中的遗忘算法性能。该基准在八个任务家族（包括分类、分割、去噪、跨模态合成和视觉语言问答）上评估了12种方法，涵盖三种遗忘粒度，并从效用、隐私和成本三个维度与重新训练的黄金标准进行比较。核心发现是，不同方法之间的差异主要由遗忘请求的难度决定，而非方法本身。

Details

Motivation: 动机源于医疗领域联邦学习模型需满足隐私法规（如GDPR的‘被遗忘权’）要求，即当患者撤回同意或医院退出协作时，需从模型中移除特定医院、类别或患者的影响。现有遗忘研究主要基于自然图像，其异质性和任务结构与临床数据差异显著，缺乏针对医疗数据的共享评估协议。

Result: 在Lethe基准上的评估结果表明，对于文献中常见的简单遗忘请求，各方法在保持模型效用方面表现相似；仅当面对困难遗忘请求时，方法性能才出现显著差异。更值得注意的是，在许多跨站点泛化良好的医疗任务中，遗忘一个客户端几乎不影响任务性能，残留的成员信息成为必须擦除的关键信号。

Insight: 创新点在于首次建立了针对医疗影像的联邦遗忘基准（Lethe），系统评估了多任务、多粒度下的遗忘算法。客观分析认为，其核心洞察是指出遗忘难度（而非算法设计）是区分方法性能的关键因素，并强调在医疗任务中，隐私擦除（而非效用保持）常成为主要挑战，这为未来研究提供了重要方向。

Abstract: Federated learning enables medical-imaging models to be trained across hospitals, and privacy law, most explicitly the GDPR ``right to be forgotten’’, turns removing a hospital’s, a class’s, or a patient’s influence from such a model into a federated unlearning problem. This need is most acute in medicine, where patients withdraw consent and hospitals leave collaborations. Yet nearly all unlearning evidence comes from natural images, whose heterogeneity and task structure differ sharply from clinical data, so it is unclear whether existing methods transfer, and no shared protocol covers clinical data. We present Lethe, a benchmark for federated unlearning in medical imaging. It evaluates twelve methods across eight task families, from classification and segmentation to denoising, cross-modality synthesis, and vision-language question answering, at three forgetting granularities and against a retrained gold standard on utility, privacy, and cost. The central result is that what separates methods is the difficulty of the forgetting request, not the method itself. The easy removals that dominate the literature leave the methods that preserve utility indistinguishable, while only hard ones separate them. More striking, on the many medical tasks that generalize across sites, forgetting a client barely changes task performance, leaving residual membership as the signal that must be erased.

[119] From Patches to Evidence Balls: Class-Conditioned Evidence Retrieval for Few-Shot Whole Slide Image Classification cs.CVPDF

Di Zhang, Li Zhang, Jiashuai Liu, Junbo Lu, Zhi Zeng

TL;DR: 本文提出EviBall框架，用于解决少样本全切片图像分类中证据稀疏、空间组织且类别依赖的挑战。该方法通过语义-空间分配和中心细化将局部图像块组织成紧凑且空间连贯的’证据球’，并利用任务特定的类别查询检索支持性证据球，生成类别条件化的证据表示以进行直接分类预测。

Details

Motivation: 现有MIL和视觉语言方法将大量图像块特征聚合为单一的全局切片表示，在少样本监督下难以从有限的切片级标签中学习可靠的聚合机制，且共享表示压缩了支持候选类别及其替代类别的证据，限制了类别特定推理和可解释性。

Result: 在四个形态导向和分子终点的WSI任务上的大量实验表明，EviBall在多种少样本设置下始终优于传统和视觉语言MIL基线，同时为每个预测提供空间定位和类别特定的证据。

Insight: 创新点在于将少样本WSI分类重新定义为结构化证据检索和候选类别间的竞争，通过引入结构化证据单元和任务相关语义指导，减少了对从稀缺切片级标签中学习无约束全局聚合机制的依赖，提升了分类性能和可解释性。

Abstract: Whole slide image (WSI) classification is an evidence-driven task, where diagnostic cues are often sparse, spatially organized, and class-dependent. Existing MIL and vision-language methods aggregate a large pool of patch features into a single global slide representation. Under few-shot supervision, limited slide-level labels make it difficult to learn a reliable aggregation mechanism that organizes sparse local cues into compact and coherent diagnostic evidence. Moreover, a shared slide representation compresses evidence supporting a candidate class and its alternatives into the same feature, limiting class-specific reasoning and interpretability. To address these issues, we propose EviBall, a class-conditioned evidence retrieval framework for few-shot WSI classification. EviBall organizes local patches into Evidence Balls through semantic-spatial assignment and center refinement, yielding compact and spatially coherent evidence units under weak supervision. It then uses task-specific class queries, including language-guided queries for morphology-oriented tasks and molecular-guided queries for molecular endpoint prediction, to retrieve supporting evidence balls and produce class-conditioned evidence representations for direct class-wise prediction. By introducing structured evidence units and task-relevant semantic guidance, EviBall reduces the reliance on learning an unconstrained global aggregation mechanism from scarce slide-level labels. It therefore reformulates few-shot WSI classification as structured evidence retrieval and competition among candidate classes. Extensive experiments across four morphology-oriented and molecular endpoint WSI tasks demonstrate that EviBall consistently outperforms conventional and vision-language MIL baselines under diverse few-shot settings, while providing spatially localized and class-specific evidence for each prediction.

[120] SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs cs.CV | cs.AIPDF

Junsheng Wang, Chao Chen, Mengying Xie, Mingyan Li, Fuqiang Gu

TL;DR: 本文提出SG-Layout框架，通过将结构化场景图知识融入大型语言模型，以解决LLMs在从自然语言生成空间连贯布局时难以捕捉显式几何关系和结构依赖的问题。该框架采用两阶段训练范式：图-语言特征对齐和基于LoRA的指令微调，并在图像布局生成、室内场景合成和机器人物体重排任务上进行了评估。

Details

Motivation: 现有大型语言模型在理解和生成空间连贯布局时，难以捕获对象间明确的几何关系和结构依赖性，这构成了一个根本性挑战。

Result: 在图像布局生成、室内场景合成和机器人物体重排任务上的实验表明，SG-Layout相比紧凑的开源骨干模型，提高了空间推理准确性和几何一致性，在关系密集和组合复杂的场景中优势尤为明显。

Insight: 核心创新在于通过图-语言特征对齐，将结构化场景图的空间知识显式注入LLM，并结合两阶段训练（特征对齐与指令微调）来增强可控布局生成能力，这为利用结构化先验知识增强LLM的空间推理提供了有效途径。

Abstract: Understanding and generating spatially coherent layouts from natural language remains a fundamental yet challenging task for large language models (LLMs). Existing LLMs often struggle to capture explicit geometric relationships and structural dependencies between objects. To address this issue, we propose SG-Layout, a graph-guided layout generation framework that explicitly incorporates structured spatial knowledge into LLMs. SG-Layout follows a two-stage training paradigm: (1) a graph-language feature alignment stage, where a relational graph encoder and a projector are trained to map scene-graph embeddings into the LLM’s linguistic space; and (2) an instruction tuning stage, where LoRA-based adapters enable efficient fine-tuning for instruction-driven layout generation while keeping the backbone frozen. We evaluate SG-Layout on image layout generation, indoor scene synthesis and robotic object rearrangement tasks. Experimental results show that SG-Layout improves spatial reasoning accuracy and geometric consistency over the compact open-source backbone, with particularly clear advantages in relation-dense and compositionally complex scenes. These results highlight the effectiveness of graph-structured feature alignment for enhancing controllable layout generation.

[121] CoT-Edit: Let CoT Guide Instruction Video Editing cs.CVPDF

Sen Liang, Fengbin Guan, Youliang Zhang, Xin Li, Zhibo Chen

TL;DR: 本文提出CoT-Edit框架，用于解决复杂场景下基于文本指令的视频编辑中目标模糊和物理不合理的问题。该框架采用‘规划-引导-编辑’三步法，首先利用增强型多模态大语言模型进行结构化推理，生成精确的边界框和属性丰富的编辑指令，然后引导掩码生成器进行局部化、上下文感知的细化，最后通过扩散模型集成这些空间与语义信号，实现高保真、时序一致且空间对齐的视频编辑。

Details

Motivation: 解决复杂场景下纯文本提示在视频编辑中难以捕捉精确空间关系和物理约束，导致目标模糊和物理上不合理结果的问题。

Result: 在多个强基线方法上进行了广泛实验，证明了其达到了最先进的性能，在包含多个相似物体的场景中实现了精确的定位，并实现了物理一致的对象添加。

Insight: 创新点在于提出了一个显式连接语义意图与空间执行的‘规划-引导-编辑’框架，利用CoT增强的MLLM进行结构化推理以生成精确的空间先验，并将模糊的全局检索转化为局部化、上下文感知的细化，从而提升了编辑的精确性和物理合理性。

Abstract: Text-driven instruction-based video editing in complex scenes remains challenging: purely textual prompts often fail to capture precise spatial relationships and physical constraints, resulting in target ambiguity and physically implausible outcomes. To address this, we propose a plan–guide–edit framework that explicitly bridges semantic intent and spatial execution. In our framework, a Chain-of-Thought (CoT)-enhanced multimodal large language model (MLLM) serves as a planner, performing structured reasoning over the video and instructions to derive a precise sequence of bounding boxes and attribute-enriched editing directives. These spatial priors then guide a box-conditioned mask generator, transforming ambiguous global retrieval into localized, context-aware refinement and producing masks that more accurately capture object scale, contact relationships, and placement. Building on these spatial and semantic signals, a diffusion-based editor integrates the masks, enriched instructions, and frame features to render high-fidelity edits that remain temporally coherent and spatially well aligned. Trained first in a modular manner and then jointly, our framework achieves superior performance with reduced data requirements, delivering precise localization in scenes with multiple similar objects and physically consistent object additions, and extensive experiments demonstrate state-of-the-art performance over multiple strong baseline methods. More details are available at: https://github.com/flying-sky999/CoT-Edit

[122] InteracVid: Building a Real Interactive Audio-Visual Response Dataset from Live-Chat Videos cs.CVPDF

Chi Zhang, Haoyang Shi, Yueyi Liu, Zhaokun Yan, Yishu Yin

TL;DR: 该论文提出了InteracVid，一个从直播聊天视频中构建的大规模开源交互式视听响应数据集，旨在为多模态助手和具身智能体提供真实的、由外部用户交互引发的视听响应监督数据，而非仅描述性内容。

Details

Motivation: 现有视听生成模型的监督主要是描述性的（渲染字幕），缺乏针对外部用户交互引发的真实视听响应的训练数据，这限制了多模态交互系统的发展。

Result: 在100个真实直播聊天查询的基准测试中，使用InteracVid微调模型改善了交互规划和视听响应生成；独立人工评估结果与自动评估的排名和结论一致。

Insight: 创新点在于首次构建了大规模、因果性、自然的交互式视听响应数据集，并设计了从嘈杂长视频中提取交互片段的元数据感知流程，强调了交互结构化数据对于交互式多模态生成的关键作用。

Abstract: Large language models have made text the default medium for human–AI interaction, buttext alone cannot express the full range of responses required by multimodal assistants,avatars, and embodied agents. While recent audio-video generative models can synthesizehigh-fidelity synchronized content, existing supervision is largely \emph{descriptive}:models are trained to render captions rather than to produce audio-visual responsescaused by external user interactions. We introduce \textbf{InteracVid}, \emph{the firstopen-source large-scale dataset that addresses this missing supervision}, so that everysample couples a preceding audio-visual context and an external stimulus with the realinteractive response that follows. We design a metadata-aware pipeline that extractsinteractive clips from long, noisy livestreams, yielding over \textbf{454K}context-query-response triplets from more than \textbf{59K} livestream videos andspanning conversation-centered, object-centric, procedural, embodied, and screen-basedscenarios. A ten-rater human study confirms that the extracted interactions are causal,natural, and temporally complete for both genuine and reconstructed queries. On aheld-out benchmark of \textbf{100} genuine live-chat queries, fine-tuning on InteracVidimproves both interaction planning and audio-video response generation, and anindependent human evaluation reproduces the system ranking and the conclusions obtainedwith our automatic judge. These results highlight interaction-structured data as acritical foundation for interactive multimodal generation.

[123] MiniWorld: Democratizing the Training of Video World Models from Scratch cs.CVPDF

Yian Zhao, Ruochong Zheng, Hongcan Guo, Yu Yan, Jian Zhang

TL;DR: 本文提出了MiniWorld，一个用于从零开始训练流式视频世界模型的可复现框架。该框架采用基于块因果的视频扩散Transformer，在预训练视频VAE的潜在空间中进行流匹配训练，并通过改进的噪声调度和两阶段持续训练来提升时序建模和稳定性。整个模型可在单台8-GPU服务器上数天内完成训练，旨在为视频世界建模研究提供轻量、透明且可完全复现的基线。

Details

Motivation: 当前视频世界模型训练多依赖预训练视频生成模型的后训练或蒸馏，存在训练流程复杂、计算资源需求大以及双向预训练与因果流式推理不匹配的问题。社区缺乏一个轻量、透明且能用适度计算资源端到端训练的可复现基线。

Result: 论文提出了一个完整的可复现框架，其模型可在单台8-GPU服务器上数天内完成训练，并支持通过滚动KV缓存和流水线异步去噪实现高效的流式生成。

Insight: 创新点在于提出了一个完全从零开始训练视频世界模型的轻量化框架，通过块因果视频扩散Transformer、分块非递减噪声调度、两阶段持续训练以及高效的流式推理机制，解决了现有方法在训练复杂度、资源需求和推理匹配性上的问题，为相关研究提供了易于复现和扩展的基线。

Abstract: Video world models predict future observations conditioned on historical observations and control signals, enabling long-horizon generation through autoregressive state transitions. Unlike conventional video generation models that primarily capture visual appearance and motion, video world models learn the underlying dynamics governing environment evolution under agent actions, providing a foundation for embodied AI and interactive simulation. Recent progress has largely relied on adapting pretrained video generation models through post-training or distillation. Although effective, these approaches often require complex training pipelines, substantial computational resources, and suffer from the mismatch between bidirectional pretraining and causal streaming inference. Recent studies have shown that training autoregressive video world models from scratch is feasible and scalable. However, the community still lacks a lightweight, transparent, and fully reproducible baseline trainable end-to-end with modest computational resources. We present MiniWorld, a reproducible framework for training streaming video world models from scratch. MiniWorld employs a block-causal Video Diffusion Transformer trained with Flow Matching in the latent space of a pretrained Video VAE. Building on Diffusion Forcing, it adopts a chunk-wise non-decreasing noise schedule and two-stage continued training to improve temporal modeling and stability. During inference, MiniWorld combines a rolling KV cache with pipelined asynchronous denoising for efficient streaming generation under bounded computation. The entire model can be trained within several days on a single 8-GPU server. By releasing the training and inference codebase and pretrained checkpoints, we hope MiniWorld will facilitate future research on video world modeling.

[124] Think in Sets for Streaming Video Token Compression cs.CVPDF

Moxu Duan, Jingwen Fu, Yuwang Wang

TL;DR: 本文提出了NovaCov，一种专为流式视频设计的、无需训练即插即用的集合式令牌压缩器。它通过维护一个容量受限、加权近期的历史参考库，并优化一个双分支子模覆盖目标，来在流式处理中因果地、逐帧地选择令牌集合，从而在保留当前帧代表性内容的同时，优先选择历史覆盖不足的信息。

Details

Motivation: 现有流式视频大语言模型（VideoLLMs）处理时视觉令牌持续增长，压缩对于控制预填充延迟和内存至关重要。现有无需训练的方法独立地对令牌排序，忽略了保留令牌之间的边际增益交互。作者认为流式视频令牌压缩应被表述为集合选择问题，并需解决流式因果决策带来的跨帧交互建模与实时推理的参考集困境。

Result: 在流式和离线基准测试中，NovaCov优于现有的无需训练压缩方法，在保持ReKV准确率99.6%的同时，将LLM预填充延迟降低了46%。

Insight: 核心创新在于将流式视频令牌压缩形式化为一个集合选择问题，并提出了首个为此设计的无需训练、即插即用的集合式压缩器NovaCov。其关键设计是容量受限、加权近期的历史参考库和基于设施选址函数的双分支子模覆盖目标，这既保证了理论近似比，又有效平衡了当前信息与历史覆盖，解决了流式场景下的参考集困境。

Abstract: Streaming VideoLLMs process frames causally while visual tokens grow continuously, making compression essential for controlling prefilling latency and memory. Existing training-free methods independently rank tokens, ignoring marginal-gain interactions among retained tokens. We argue that streaming video token compression should instead be formulated as set selection, where each candidate is valued by what it adds beyond the tokens already retained. Unlike existing set-wise methods designed for offline tasks, streaming makes causal, frame-by-frame pruning decisions, so modeling cross-frame interactions requires an explicit historical reference. This creates a reference-set dilemma: the reference must adequately represent previously conveyed content while remaining bounded for real-time inference. We introduce NovaCov, to our knowledge the first training-free, plug-and-play set-wise token compressor designed for streaming video. NovaCov maintains a capacity-bounded, recency-weighted Historical Reference Bank and optimizes a dual-branch submodular coverage objective that preserves representative current-frame content while prioritizing information insufficiently covered by history. Both branches are facility-location functions, so greedy selection retains the classical (1-1/e) approximation guarantee. Across streaming and offline benchmarks, NovaCov outperforms existing training-free compression methods, retaining 99.6% of ReKV accuracy while reducing LLM prefilling latency by 46%.

[125] 3DZip: Spatial-Aware Feature Diversity-Guided Token Compression for 3D Question Answering cs.CV | cs.LGPDF

Changwoo Baek, Kyeongbo Kong

TL;DR: 本文提出3DZip，一种针对3D视觉语言模型（3D VLM）的三阶段令牌压缩框架，旨在解决3D场景表示中令牌数量过多导致的巨大计算和内存开销问题。该方法首先通过粗体素化去除点级冗余，然后基于特征空间多样性选择锚点令牌，最后在空间约束下合并剩余令牌以保持几何连贯性。

Details

Motivation: 现有3D VLM通过将2D视觉特征投影到世界坐标来构建几何感知令牌，但每个场景会生成数千个令牌，带来显著的计算和内存负担。现有的令牌压缩方法（如基于语义相关性或注意力的选择）忽略了3D令牌的结构化空间特性，且仅靠空间邻近性无法解决对象级令牌不平衡问题。

Result: 在三个3D问答基准测试上的实验表明，3DZip持续优于现有压缩方法，仅使用128个令牌即可保留原始模型94.7%的性能，并实现1.92倍的推理加速。

Insight: 创新点在于提出了一种空间感知、特征多样性引导的令牌压缩框架，通过结合粗体素化、基于行列式点过程的多样性锚点选择以及空间约束合并，有效平衡了压缩效率与几何信息保留。该方法强调了在3D场景中处理令牌冗余时，需同时考虑空间结构和特征多样性，而非仅依赖语义或注意力机制。

Abstract: Recent 3D vision-language models (3D VLMs) construct geometry aware tokens by projecting 2D visual features into world coordinates, enabling spatial reasoning for tasks such as 3D question answering. However, this design generates thousands of tokens per scene, resulting in substantial computational and memory overhead. While token compression has been extensively studied in 2D VLMs, existing approaches rely on semantic relevance or attention-based selection that overlook the structured spatial nature of 3D tokens. Moreover, redundancy in 3D representations cannot be resolved by spatial proximity alone, as object-level token imbalance persists even after spatial aggregation. To address this, we propose 3DZip, a three-stage token compression framework that first applies coarse voxelization to remove point-level redundancy, then selects anchor tokens based on feature-space diversity via a Determinantal Point Process, and finally merges remaining tokens under spatial constraints to preserve geometric coherence. Experiments on three 3D question answering benchmarks demonstrate that 3DZip consistently outperforms existing compression methods, retaining 94.7% of the original performance with only 128 tokens, achieving a $1.92\times$ faster inference speed.

[126] QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Prediction cs.CVPDF

Yinglong Li, Donghui Shen, Xiaoyu Zhang, Zhichao Ye, Hongyu Wu

TL;DR: 本文提出了QuerySplat，一种前馈式的3D高斯泼溅（3DGS）框架，旨在解决现有方法在3D重建中渲染保真度不足的问题。该方法通过解耦几何与外观表示，利用预训练的视觉几何模型作为几何先验，并设计了一个双分支查询解码器来分别处理几何和外观信息，从而实现了高质量、姿态无关的新视角合成。

Details

Motivation: 现有基于像素对齐的方法存在空间灵活性不足和结构冗余的问题，而基于查询的方法则缺乏3D先验知识，并且将几何与外观信息纠缠在一起，导致渲染结果模糊且依赖姿态。本文旨在克服这些缺陷，实现高保真度的前馈式3D重建。

Result: 在具有挑战性的DL3DV基准测试中，QuerySplat实现了最先进的新视角合成性能。与最佳的无姿态基线相比，平均PSNR提升了2.30 dB；与最佳的有姿态基线相比，平均PSNR提升了1.04 dB。

Insight: 核心创新点在于将几何与外观表示解耦，并利用预训练的视觉几何模型作为强大的几何先验。具体来说，设计了一个双分支查询解码器：几何分支利用预训练模型进行空间理解，实现姿态无关建模；外观分支则通过独立于几何属性回归的专用路径恢复高频细节。这种解耦设计有效缓解了早期查询模型的模糊渲染问题。

Abstract: While feed-forward 3D Gaussian Splatting (3DGS) enables efficient 3D reconstruction, achieving high-fidelity rendering remains challenging. Existing pixel-aligned approaches suffer from spatial inflexibility and massive structural redundancy, whereas query-based methods lack 3D priors and entangle geometry with appearance, yielding blurry, pose-dependent results. To overcome these deficiencies, we propose \textbf{QuerySplat}, a feed-forward 3DGS framework driven by geometric priors and explicit appearance decoupling. Specifically, we design a dual-branch query-based decoder: the geometry branch leverages a pretrained Vision Geometric Model for spatial understanding, which intrinsically endows QuerySplat with pose-free modeling capabilities, while the appearance branch recovers high-frequency details through a dedicated pathway separated from geometric attribute regression. Extensive experiments demonstrate that QuerySplat mitigates the blurry rendering issues of early query-based models and consistently outperforms pixel-aligned approaches in rendering fidelity. On the challenging DL3DV benchmark, it achieves state-of-the-art novel view synthesis performance, with average PSNR gains of 2.30 dB and 1.04 dB over the best pose-free and pose-required baselines, respectively. Project Page: https://inspatio.github.io/querysplat.

[127] Fruit-HSNet: A Machine Learning Approach for Hyperspectral Image-Based Fruit Ripeness Prediction cs.CV | cs.LGPDF

Ahmed Baha Ben Jmaa, Faten Chaieb, Anna Fabijańska

TL;DR: 本文提出了一种名为Fruit-HSNet的机器学习架构，专门用于基于高光谱图像的果实成熟度预测分类任务。该架构结合了基于傅里叶变换和中心像素光谱特征的空谱特征提取模块、可学习的特征融合以及针对成熟度分类优化的分类器。

Details

Motivation: 解决基于高光谱图像的果实成熟度预测中面临的挑战，包括标记数据有限以及缺乏能够泛化到不同高光谱相机和水果类型的鲁棒方法。

Result: 在最大的公开真实世界高光谱果实成熟度数据集DeepHS Fruit上评估，Fruit-HSNet显著优于现有深度学习方法（从基线到SOTA模型），提升了12%，达到了70.73%的总体准确率，创造了新的SOTA。

Insight: 创新点在于设计了一个结合空谱特征提取（利用傅里叶变换和中心像素光谱）与可学习特征融合的专用架构，以应对高光谱数据在农业视觉任务中的泛化性和数据稀缺问题。

Abstract: Fruit ripeness prediction (FRP) is a classification-based agricultural computer vision task that has attracted much attention, thanks to its wide-ranging advantages in agriculture field for both pre-harvest and post-harvest management. Accurate and timely FRP can be achieved using machine/deep learning-based hyperspectral image classification techniques. However, challenges including the limited availability of labeled data and the lack of robust methods generalizable to various hyperspectral cameras and fruit types can compromise the effectiveness of hyperspectral image-based FRP. Addressing these challenges, this paper introduces Fruit-HSNet, a machine learning architecture specifically designed for hyperspectral classification of fruit ripeness. Fruit-HSNet incorporates a spatio-spectral feature extraction module based on Fourier Transform and central pixel spectral signature followed by learnable feature fusion and a classifier optimized for ripeness classification. The proposed architecture was evaluated using the DeepHS Fruit dataset, the largest publicly available labeled real-world hyperspectral dataset for predicting fruit ripeness, which includes five different types of fruits-avocado, kiwi, mango, kaki, and papaya-captured with three distinct hyperspectral cameras at various stages of ripeness. Experimental results highlight that Fruit-HSNet substantially outperforms existing deep learning methods, from baseline to state-of-the-art models, with improvements of 12%, achieving a new state-of-the-art overall accuracy of 70.73%.

[128] It’s the Decoding Format, Not the Perturbation: Auditing Consistency-Based Selection for Vision-Language Test-Time Scaling cs.CV | cs.AIPDF

Puzhuo Zheng, Hasan Kurban

TL;DR: 本文研究视觉语言模型（VLM）在测试时扩展中的候选答案选择问题，发现基于模型自验证的选择方法表现不佳，而简单的多数投票效果更好。论文提出并评估了基于扰动一致性的选择方法（Pgs），但通过引入格式匹配的控制组（MatchedCtrl）进行对比实验，最终证明一旦控制解码格式和预算，扰动项并未提供有效的额外选择信号。

Details

Motivation: 动机在于解决视觉语言模型在测试时扩展中，基于自验证的选择方法因无法区分图像依赖答案与语言先验猜测而失效的问题，探索能否通过输入扰动下的答案一致性来构建有效的、无需标注和训练的选择信号。

Result: 在TextVQA、MATH-Vision、MMMU和ViLP等多个基准测试上，使用Qwen和LLaVA-OneVision模型进行实验。虽然Pgs在TextVQA上相比普通多数投票最高提升31.8分，但一旦引入格式匹配的控制组（MatchedCtrl），其在所有基准（包括需要视觉的ViLP）上的表现均与Pgs相当或更好，且无显著增益。

Insight: 核心创新点在于引入了格式匹配的控制组来严格评估选择方法中扰动项的真实贡献。研究的主要洞察是：扰动一致性最多只是视觉依赖的部分诊断指标，在控制解码格式后，其本身并不能作为有效的选择信号；此前基于与仅使用思维链的多数投票比较所报告的增益被高估了。

Abstract: Test-time scaling lifts large language model reasoning by sampling many candidate solutions and selecting among them, yet the same recipe transfers poorly to vision-language models (VLMs): recent work shows that simple majority voting beats selection methods built on the model’s own self-verification, apparently because at the selection layer an image-grounded answer and a confident guess from the language prior look the same. A natural fix is to make the selection signal one that cannot be computed without the image. We study Perturbation Grounded Selection (Pgs), a label-free, training-free rule that scores each candidate by whether the model re-derives it under label-preserving perturbations of the input (cropping, background masking, mild photometric or geometric jitter); Pgs recovers majority voting when the perturbation set is empty. The decisive question is not whether Pgs beats chain-of-thought only majority voting, but whether the perturbation term adds anything once decoding format and budget are controlled. We therefore introduce a format-matched control (MatchedCtrl): the same short, no-CoT draws spent on the original image. Across TextVQA, MATH-Vision, MMMU, and ViLP, with a Qwen headline (three-seed means) and LLaVA-OneVision coverage in matched-budget selector tables, Pgs appears to beat plain majority voting by up to +31.8 points on TextVQA (Qwen), but MatchedCtrl tracks or exceeds Pgs within noise on every benchmark, including the vision-required ViLP; no Qwen category shows a significant gain over this control. The stability gap is real and image-dependent (up to +0.48), yet does not predict per-instance wins. The result is negative and diagnostic: perturbation consistency is at best a partial diagnostic of visual dependence and, on its own, not a usable selection signal once format is controlled; gains reported against CoT-only majority voting overstate such methods.

[129] A Benchmark Dataset for MLLM-Generated Image Detection: GPT Image2 & Nano Banana2 cs.CVPDF

Zirui Zhang, Yinbo Yu, Donghai Guan, Chunwei Tian, Daoqiang Zhang

TL;DR: 本文针对多模态大语言模型（MLLM）生成的图像检测挑战，构建了一个名为GPT Image2和Nano Banana2的基准数据集，覆盖了直接生成、基于参考的重建和局部编辑等多种现实应用场景。论文还提出了一个结构先验引导的双流提示框架（SAP-DSP）作为强基线方法，通过双流提示学习和结构感知路由融合来提升检测性能。

Details

Motivation: 当前MLLM生成的图像质量高、文本渲染逼真，使得传统基于早期生成模型构建的检测基准无法充分评估新生成内容带来的取证挑战，因此需要构建系统且现实的基准数据集来应对这一差距。

Result: 在提出的基准数据集上评估显示，现有检测器在高质量生成图像上性能显著下降；而提出的SAP-DSP方法在该基准上实现了更稳定的检测结果，通过大量实验验证了其有效性。

Insight: 创新点在于构建了首个专门针对MLLM生成图像的检测基准，并提出了结合结构先验和双流提示学习的SAP-DSP框架，通过结构感知路由融合来增强表示学习，为高质量生成图像检测提供了新的解决方案。

Abstract: The realism of images generated by multimodal large language models (MLLMs), such as GPT Image2 and Nano Banana2, has improved rapidly in recent years. Compared with early generative models, current models have made clear progress in text rendering. They can produce high-quality images that closely resemble real-world application scenarios. The enhanced generation capabilities of current MLLMs pose increasingly severe challenges to AI-generated image detection. Detection is no longer limited to identifying obvious artifacts left by early generators. Instead, it requires systematic and realistic benchmarks for the new generation of generated content. However, most existing benchmarks are still built around early generative models and cannot fully evaluate the forensic challenges introduced by high-quality and multi-form generated images. To address this gap, this paper constructs a benchmark dataset for detecting images generated by MLLMs. The benchmark covers several realistic application scenarios and adopts three generation protocols to simulate direct generation, reference-based reconstruction, and local editing. Based on this benchmark, we evaluate detector degradation from traditional scenarios to MLLM-generated images and analyze false positive rates and false negative rates across three sample types, revealing the failure modes of existing methods. We further propose a structural-artifact-prior-guided dual-stream prompt framework (SAP-DSP) as a strong baseline. SAP-DSP uses dual-stream prompt learning and structure-aware routing fusion to improve representation learning. Extensive experiments show that the proposed benchmark exposes the performance degradation of existing detectors on high-quality generated images, while SAP-DSP achieves more stable detection results on this benchmark. Our code and dataset are publicly available at https://github.com/xbrainnet/SAP-DSP.

[130] From Forest to Future Capital: Tracking Land Cover Change in Ibu Kota Nusantara (IKN) from 2021 to 2026 with PlanetScope Imagery cs.CVPDF

Clarissa Rui Min Ong, Elizabeth Tee Inn Loo, Kenneth Woon Hao Soh, William Rachmadi, Qiming Zheng

TL;DR: 本研究利用PlanetScope卫星影像，通过遥感技术系统评估了印度尼西亚新首都核心政府区（KIPP）从2021年至2026年的土地利用和植被覆盖变化。研究应用了NDVI、NDRE、NDWI等光谱指数以及支持向量机监督分类方法，揭示了该区域在快速建设过程中显著的植被损失、碳储量下降和建设用地扩张。

Details

Motivation: 印度尼西亚将首都从雅加达迁至努山塔拉（IKN），并提出了’森林城市’的愿景，但核心政府区的快速建设引发了人们对土地转换、植被损失和碳储量下降的担忧。本研究旨在通过遥感技术客观、系统地监测这一大规模城市发展对环境的影响。

Result: 研究结果显示，从2021年到2026年，KIPP区域的平均NDVI下降了17.1%，总碳储量减少了0.28%，建设用地扩张了672%，总植被覆盖减少了18.1%。植被损失在2023年至2024年间最为严重，但2024年至2025年间，随着主动清理活动减缓，NDVI和碳储量出现了暂时性恢复。

Insight: 论文的创新点在于将高时间分辨率的PlanetScope影像与多种光谱指数（NDVI、NDRE、NDWI）及监督分类（SVM）相结合，对新兴首都的建设过程进行精细化的时序监测。研究客观地指出，尽管遥感是有效的监测工具，但未来需要更高分辨率、高光谱和SAR数据来改进对建设阶段和种植园相关土地覆盖变化的检测能力。

Abstract: Indonesia’s relocation of its political and administrative capital from Jakarta to Ibu Kota Nusantara (IKN) has been framed around a ``Forest City’’ vision, yet rapid construction within the Core Government Area (KIPP) raises concerns over land conversion, vegetation loss, and carbon stock decline. This study applies remote sensing techniques to systematically assess land use and vegetation cover change in KIPP from 2021 to 2026 using PlanetScope SuperDove satellite imagery. Cloud-free mosaics were prepared and analysed through spectral indices, including the Normalised Difference Vegetation Index (NDVI), Normalised Difference Red Edge (NDRE), and Normalised Difference Water Index (NDWI), alongside supervised land use and land cover (LULC) classification using a Support Vector Machine algorithm. Results show substantial environmental transformation, with mean NDVI declined by 17.1%, total carbon stock decreased by 0.28%, developed land expanded by 672%, and total vegetation declined by 18.1%. Vegetation loss was most extensive between 2023 and 2024, although a temporary recovery in NDVI and carbon stock occurred from 2024 to 2025 as active clearing slowed and development shifted towards already-cleared land. Overall, the findings demonstrate that remote sensing provides an effective approach for monitoring the environmental impacts of large-scale urban development, while highlighting the need for higher-resolution, hyperspectral, and SAR-based methods to improve detection of construction stages and plantation-related land cover changes.

[131] Rethinking Video Token Compression with a Global Codebook: Learning Once, Compressing Everywhere cs.CV | cs.AIPDF

Jiayang He, Tianling Xu, Diancheng Kang, Huaide Jiang, Junyan Bai

TL;DR: 本文提出了一种名为ONCE的插件式视频令牌压缩框架，通过引入离线到在线范式来减少视频大语言模型中的冗余计算。该方法利用频率感知的全局码本在视觉特征空间中进行一次性学习，然后通过码本查找和聚合实现轻量级在线压缩，从而避免了现有方法中重复的每视频计算和模型特定设计的需求。

Details

Motivation: 视频大语言模型将视频表示为密集的视觉令牌序列，其长度随输入视频的时空范围增长，这些令牌常因重复的视觉模式而产生大量冗余，导致后续语言模型处理中不必要的计算开销。现有令牌压缩方法（如剪枝和合并）在推理过程中在线执行压缩，每次输入视频都会重复产生额外计算，且通常依赖模型特定设计，限制了通用性。

Result: 在多个视频理解基准测试中与多种压缩基线方法进行广泛实验，结果表明该方法在保持竞争力的性能的同时，实现了所比较方法中最低的推理延迟，达到了较强的准确性与效率权衡。

Insight: 核心创新在于将高成本的压缩过程从在线转移到离线，通过一次性学习全局码本并复用，实现了通用、高效的视频令牌压缩。这种离线到在线范式减少了重复计算，摆脱了对模型特定设计的依赖，为视频大语言模型的效率优化提供了新思路。

Abstract: Video large language models (Video-LLMs) represent videos as dense sequences of visual tokens, whose length grows with the temporal and spatial extent of the input. These tokens often contain substantial redundancy arising from repeated visual patterns, leading to unnecessary computation in the subsequent language-model processing. Existing token compression methods, including pruning and merging, perform compression online during inference, repeatedly incurring additional computation for each input video and often relying on model-specific designs that limit their generality, we instead rethink this paradigm by shifting the costly compression process offline. We propose \textbf{ONCE}, a plug-in video token compression framework that introduces an offline-to-online paradigm: a frequency-aware global codebook is learned once in the visual feature space and reused for lightweight online compression through codebook lookup and aggregation, reducing repeated per-video computation and the need for model-specific compression designs. Extensive experiments across multiple video understanding benchmarks and against diverse compression baselines demonstrate that our approach achieves a strong accuracy-efficiency trade-off, maintaining competitive performance while achieving the lowest inference latency among compared methods.

[132] UDT: Reconciling U-Nets and Diffusion Transformers with Data-Adaptive Token Reduction cs.CV | cs.AI | cs.LGPDF

Junno Yun, Yaşar Utku Alçalar, Mehmet Akçakaya

TL;DR: 本文提出UDT，一种结合U-Net编码解码优势与扩散变换器（DiT）表示能力的U-Net扩散变换器架构。它通过数据自适应的令牌合并进行下采样和上采样，同时保持DiT令牌维度，从而解决了DiT中表示质量下降和编码解码不平衡的问题。UDT在多个模型尺寸上超越了现有U-Net DiT，性能与REPA相当，并在ImageNet 256x256上实现了快速收敛和先进的图像生成质量。

Details

Motivation: 扩散变换器（DiTs）在生成建模中因可扩展性和多模态适应性而成为核心架构，但其各向同性Transformer块导致表示质量下降和编码解码行为不平衡。现有方法如REPA通过训练正则化改进早期表示，而U-Net风格DiT引入显式多尺度结构但存在效率低下和兼容性问题。

Result: 基线UDT架构在所有模型尺寸上优于现有U-Net DiTs，性能与REPA相当。在ImageNet 256x256上，XL模型通过架构优化和REPA，在40个周期内达到SiT在1400个周期（无CFG）的7.9 FID，收敛速度提升约40倍。使用CFG后，在SD-VAE下320个周期达到FID 1.38，在VA-VAE下500个周期达到FID 1.35。

Insight: 创新点在于通过数据自适应的令牌合并实现下采样和上采样，既保留了U-Net的多尺度编码解码优势，又避免了传统可学习下采样操作在Transformer中的低效和兼容性问题。这为DiTs提供了一个兼具强表示能力和高效收敛的新骨干网络。

Abstract: Diffusion Transformers (DiTs) have emerged as a core architecture in generative modeling due to their scalability and adaptability to multimodal tasks. DiTs comprise isotropic transformer blocks, and learn representations progressively across depth, where the denoising objective drives later layers to focus on fine-detail reconstruction. This results in degraded representation quality and an imbalanced encoder-decoder behavior. Prior approaches such as representation alignment (REPA) mitigate this by encouraging stronger early representations via training regularization. Alternatively, U-Net-style DiT architectures introduce explicit multi-scale encoder-decoder structures for improved convergence. But they build on standard U-Net wisdom via learnable operators for spatial downsampling, which are not well-suited to transformer architectures, introducing inefficiencies and compatibility issues with components such as cross-attention and representation regularization. In this work, we propose UDT, a U-Net diffusion transformer that combines the representation power of DiTs with the encoding-decoding benefits of U-Nets, through data-adaptive token merging for downsampling and upsampling, while preserving the DiT token dimension. Our baseline UDT architecture outperforms existing U-Net DiTs and achieves performance comparable to REPA across all model sizes. Furthermore, using architectural optimization and REPA, UDT outperforms SiT’s 7.9 FID at 1400 epochs (w/o CFG) within 40 epochs (~ 40x faster convergence) for XL model size on 256x256 ImageNet. Finally, it achieves strong image generation performance with CFG, reaching FID of 1.38 (320 epochs) with SD-VAE and 1.35 (500 epochs) with VA-VAE, providing a new backbone for DiTs with strong empirical benefits.

[133] Beyond Symmetric Fusion: Exploiting Task-Dependent Modality Strengths for RGB-Event Small Object Detection cs.CVPDF

Ziheng Wang, Chaolang Li, Yutong Yang, Xiaohan Xu, Chongxiang Yang

TL;DR: 本文提出了一种非对称的RGB-事件目标检测方法AERODet，通过分析发现事件数据在类别无关的定位任务中更有效，而RGB数据在目标区域内的精细分类中更强。该方法利用尺度感知不确定性可靠性估计（SURE）来校准两种模态在定位阶段的贡献，并通过任务解耦语义细化（TDSR）使用RGB特征进行精细分类。

Details

Motivation: 现有RGB-事件检测器通常将两种模态对称地融合成一个统一表示用于定位和分类，这与两种模态在不同任务中应发挥不同作用的直觉不符。本文旨在探索并利用任务依赖的模态优势。

Result: 在FRED和NeRDD数据集上的大量实验表明，AERODet实现了最先进的性能，特别是在FRED挑战性分割上，其mAP比最强的RGB-Event基线高出10.7个点。

Insight: 创新点在于揭示了RGB和事件模态在定位与分类任务上的非对称优势，并据此设计了任务解耦的非对称融合架构（SURE和TDSR），而非传统的对称融合，这为多模态感知提供了新的设计思路。

Abstract: State-of-the-art RGB-Event detectors improve the detection of small, fast-moving objects by combining complementary features from RGB and Event data, yet they typically fuse the two modalities into a unified representation for both localization and classification. Such a task-symmetric design is inconsistent with the intuition that the two modalities should play different roles according to their task-specific strengths. To examine this issue, we conduct a modality-specific evaluation and find that the relative advantage of the two modalities reverses across tasks: Event data are substantially more effective for class-agnostic localization, whereas RGB data provide stronger category evidence within localized target regions. Motivated by this task-dependent asymmetry, we propose an Asymmetric Event-RGB Object Detection Transformer (AERODet). During class-agnostic localization, Scale-wise Uncertainty-aware Reliability Estimation (SURE) calculates the relative reliability of the two modalities from their objectness response heatmaps and accordingly calibrates their contributions when the decoder aggregates multimodal features. Once the candidate boxes are obtained, Task-Decoupled Semantic Refinement (TDSR) decouples classification from localization and uses RGB RoI features for fine-grained classification. Extensive experiments on FRED and NeRDD demonstrate that AERODet achieves state-of-the-art performance. In particular, it surpasses the strongest RGB-Event baseline by 10.7 mAP points on the FRED challenging split.

[134] Ranking Image Fusion the Way Humans Do: A Learned Pairwise Preference Metric for Infrared-Visible Fusion Assessment cs.CV | cs.AIPDF

Haoran Liu, Mingzhe Liu, Peng Li, Guibin Zan

TL;DR: 该论文提出了学习感知图像融合度量（LPIFM），这是一种基于源条件约束的模型，旨在模拟人类对红外-可见光图像融合（IVIF）结果的成对偏好判断。LPIFM通过联合观察红外源、可见光源以及两个融合候选图像，预测人类会更偏好哪一个候选结果或认为两者感知等效，从而为IVIF算法提供一种可重复、可扩展的、与人类判断对齐的评估工具。

Details

Motivation: 当前红外-可见光图像融合领域缺乏理想的融合参考图像，通常依赖各种客观指标对算法进行排序，但这些指标代理（如信息传递、结构或源相似性）的评估结果常常与人类的主观偏好不一致。直接进行人类成对比较成本高昂，无法常规使用，因此需要一种能够规模化模拟人类偏好判断的自动化度量方法。

Result: LPIFM在一个覆盖了公开基准测试场景中多种融合方法所有无序比较对的新建密集偏好数据集上进行训练和评估。在场景和方法泛化设置下，LPIFM能够紧密跟踪人类的成对决策，并复现了从人类标签中推导出的、考虑平局情况的Bradley-Terry排名。在完整方法池上，其在成对比较准确率和排名相关性方面均大幅超越了最强的传统指标。

Insight: 论文的核心创新在于将人类主观的A/B/Tie比较协议操作化为一个可学习的、源条件约束的成对偏好度量模型，从而将昂贵的人类评估转化为可扩展的自动化评估。这为图像融合乃至其他缺乏绝对参考任务（如图像生成、图像增强）的评估提供了一种新的、与人类感知对齐的评估范式。同时，论文发布的大规模、经过精心标注的偏好数据集也具有重要价值。

Abstract: Infrared-visible image fusion (IVIF) has no ideal fused reference, so fusion algorithms are routinely ranked by scalar objective metrics that formalize different proxies for information transfer, structure, or source similarity. These proxies often disagree with the judgment that ultimately matters: given the same sources, which of two fused results does a human prefer? Direct pairwise comparison is an established reference protocol for relative subjective assessment, but its cost grows quadratically with the number of algorithms, which prevents routine use. We present the Learned Perceptual Image Fusion Measure (LPIFM), a source-conditioned model that operationalizes the human A/B/Tie comparison protocol as a repeatable, scalable surrogate. LPIFM jointly observes the infrared source, the visible source, and two fused candidates, and predicts whether candidate A is better, candidate B is better, or the two are perceptually equivalent. Supervision comes from a new dense preference corpus that covers every unordered comparison among a broad pool of fusion methods on the scenes of a public benchmark, labeled under a blinded, randomized, two-stage protocol with expert adjudication. Across scene- and method-generalization settings, LPIFM tracks human pairwise decisions closely and reproduces the tie-aware Bradley-Terry rankings derived from human labels; on full method pools it surpasses the strongest conventional metric by a wide margin in both pairwise accuracy and ranking correlation. We release the annotated preference dataset, together with the LPIFM model weights, source code, and evaluation code, to support preference-aligned IVIF assessment. LPIFM offers a practical instrument for human-aligned method comparison and ranking at scale.

[135] Remember-R1: Mitigating Long-Context Visual Forgetting through Reinforcement Learning cs.CVPDF

Jianmin Chen, Jiaqi Tang, Wei Wei, Xiaogang Xu, Jiafei Wu

TL;DR: 本文提出了一种名为Remember-R1的强化学习框架，旨在缓解多模态大语言模型在长链推理任务中出现的视觉遗忘问题。该方法通过在原始推理轨迹上施加过程级监督，鼓励模型更广泛地匹配视觉关键词、在后续推理步骤中保持更强的视觉依赖性，并更关注问题相关的图像区域。

Details

Motivation: 随着多模态大语言模型处理更复杂的任务，其推理链不断增长，导致模型可能逐渐减少对视觉证据的依赖，转而更多地依赖累积的文本上下文，从而产生视觉遗忘。现有方法未能直接约束视觉证据在原始推理轨迹上的使用和维持，因此该问题未得到充分解决。

Result: 在多个模型规模和多样化的多模态基准测试上的实验表明，Remember-R1能够持续提升模型的推理性能。进一步分析显示，该方法减缓了生成过程中视觉注意力的下降，证实了其在缓解长上下文视觉遗忘方面的有效性。

Insight: 论文的核心创新点在于将强化学习应用于过程级监督，直接针对推理轨迹中的视觉证据使用进行优化。从客观角度看，这种将监督信号从最终答案层面细化到推理过程层面的思路，为解决长序列任务中的模态依赖漂移问题提供了一个新颖且可借鉴的框架。

Abstract: Multimodal large language models (MLLMs) increasingly rely on long chain-of-thought reasoning for complex tasks. However, as reasoning sequences lengthen, models may gradually rely less on visual evidence and more on accumulated textual context, leading to visual forgetting. Existing approaches do not directly constrain how visual evidence is used and maintained along the original reasoning trajectory, leaving long-context visual forgetting insufficiently addressed. To address this issue, we propose Remember-R1, a reinforcement learning framework that mitigates long-context visual forgetting by applying process-level supervision directly on the original reasoning trajectory. Specifically, Remember-R1 introduces rewards that encourage broader coverage of matched visual keywords, stronger persistence of visual dependence in later reasoning steps, and greater focus on question-relevant image regions. Experiments across multiple model scales and diverse multimodal benchmarks demonstrate that Remember-R1 consistently improves reasoning performance. Additional analyses further show that it slows the decline of visual attention during generation, supporting its effectiveness in mitigating long-context visual forgetting.

[136] SphereVideo: Prototype-anchored Hyperspherical Boundary for Continual AI-generated Video Detection cs.CVPDF

Fei Li, Yue Yu, Yuran Wang, Xinghan Li, Jingjing Chen

TL;DR: 本文提出SphereVideo，一种用于持续学习（CL）的AI生成视频（AIGV）检测框架。该框架基于两个关键观察：真实视频特征在超球面上围绕一个真实原型紧凑分布，而AI生成样本被排斥；以及现有方法过度依赖空间伪影，因此引入了帧级和片段级的时序动态建模策略。通过原型锚定的超球面边界和增强的时序建模，SphereVideo旨在提升检测器对新生成模型的适应能力并缓解灾难性遗忘。

Details

Motivation: 现有AI生成视频检测器在已见数据上训练后，难以泛化到新出现的生成模型，因此需要持续学习框架来提升适应性，但该任务的CL框架尚未得到充分探索。

Result: 在构建的全面且具有挑战性的基准测试上，大量实验表明，SphereVideo在已见数据上比先前方法提升3.08%，在未见AI生成数据上提升4.00%，实现了更好的可塑性-稳定性权衡。

Insight: 创新点包括：1) 提出原型锚定的超球面边界，利用真实视频特征的紧凑性，以真实原型为稳定锚点来规范边界演化并缓解遗忘；2) 引入帧级和片段级的时序动态建模策略，通过加强真实数据建模来辅助学习真实原型和形成稳定决策边界，超越了仅依赖空间伪影的捷径。

Abstract: AI-generated video (AIGV) detection aims to distinguish real videos from AI-generated ones. In practice, detectors trained on existing data often fail to generalize to newly emerging generative models, making this task challenging. Therefore, continual learning (CL) is essential for improving the adaptability. However, CL frameworks for this task remain underexplored. To this end, we propose SphereVideo, a novel CL framework for AIGV detection built on two key observations. First, real videos exhibit a compact feature distribution. Based on this, we encourage real video features to cluster around a real prototype on a hypersphere while repelling AI-generated samples, thereby establishing a decision boundary. This prototype serves as a stable anchor for CL, regulating boundary evolution and mitigating catastrophic forgetting. Second, existing methods tend to rely solely on spatial artifacts as shortcuts. To enhance temporal modeling, we introduce a strategy that models the temporal dynamics of real data at both frame and clip levels. By strengthening real data modeling, this strategy further facilitates learning a real prototype and forming a stable decision boundary. Moreover, we construct a comprehensive and challenging benchmark. Extensive experiments demonstrate that SphereVideo achieves an improved plasticity-stability trade-off, outperforming prior methods by 3.08% on seen data and 4.00% on unseen AI-generated data.

[137] SPAE: Spectrally Guided Autoencoder for Pretrained Visual Latents cs.CVPDF

Yibin Huang, Jixiang Hong, Zongzhao Li, Yuhan Dai, Zhibin Wang

TL;DR: 本文提出了SPAE（Spectrally Guided Autoencoder），一种用于预训练视觉潜空间（VFM latents）的生成式适应框架。该方法通过一个紧凑的瓶颈结构来提取稳定的语义信息并抑制高频成分，从而改善DiT生成潜空间与编码器潜空间之间的对齐。此外，还采用了通道级掩码策略来促进语义信息与高频细节在瓶颈通道间的解耦。

Details

Motivation: 视觉基础模型（VFM）的潜空间语义丰富，适合视觉理解，但直接建模困难，特别是DiT生成的潜空间与编码器潜空间存在频谱不匹配（尤其是高频成分），且这些高频成分在通道间扩散分布并与语义信息纠缠，导致潜空间难以建模。

Result: 实验表明，SPAE在视觉理解、生成质量和重建保真度之间取得了良好的平衡。

Insight: 创新点在于通过频谱引导的瓶颈结构和通道级掩码策略，解决了VFM潜空间中高频成分与语义信息纠缠的问题，改善了生成模型（如DiT）对潜空间的建模能力，为利用预训练视觉潜空间进行高质量图像生成提供了新思路。

Abstract: Latents from vision foundation models (VFMs) are semantically rich and well suited for visual understanding. Recent representation autoencoder methods such as RAE have shown that they can provide promising latent spaces for image generation. However, VFM latents remain difficult to model directly: DiT-generated latents exhibit spectral mismatch with encoder latents, especially in high-frequency components. Our channel-wise spectral analysis further reveals that these high-frequency components are diffusely distributed across latent channels and entangled with semantic information, making the latent space difficult for DiT to model. To address these challenges, we propose SPAE, latent adaptation framework for generation. Specifically, SPAE employs a compact bottleneck to distill stable semantic information while suppressing high-frequency components, thereby improving the alignment between DiT-generated latents and encoder latents. In addition, we apply a channel-wise masking strategy to promote the decoupling of semantic information and high-frequency details across bottleneck channels. Experiments show that SPAE achieves a favorable balance among visual understanding, generation quality, and reconstruction fidelity.

[138] Asleep at the Wheel: JEPA’s Limitations in Evaluating Novel Driving Data cs.CV | cs.LGPDF

Advait Pavuluri, Shamik Karkhanis, Uzma Mushtaque

TL;DR: 本文研究了基于自监督联合嵌入预测架构（JEPA）的无标签方法在自动驾驶视频片段筛选中的应用，发现其在跨数据集评估中表现优异，但在单一数据集公平基准下效果与随机基线相当，揭示了跨数据集协议可能误导性地奖励领域分离而非真正的新颖性检测。

Details

Motivation: 自动驾驶车队记录的视频数据远超人工审核能力，需要自动筛选机制来发现罕见且值得审查的片段，以优化驾驶模型处理非理想情况的能力。

Result: 在跨数据集协议下，JEPA方法表现高效，但在单一数据集公平基准中，其性能降至随机水平，平均精度仅为简单无训练基线的水平；而轻监督探针在相同嵌入上可实现近双倍的平均精度。

Insight: 创新点在于揭示自监督学习评估中跨数据集协议可能隐藏领域偏移问题，导致虚假成功；瓶颈在于自监督目标而非表示本身，轻监督方法能显著提升性能，为自监督学习有效性评估提供了重要警示。

Abstract: Modern autonomous-driving fleets record far more video than human reviewers can inspect. This motivates the need for an automatic clip triage mechanism, to surface rare and review-worthy clips, so that driving models can be fine-tuned to better handle unideal circumstances. We test a label-free approach that scores clips by the prediction-error “novelty” of a self-supervised joint-embedding predictive architecture (JEPA); a frozen V-JEPA video encoder is paired with a lightweight predictor head to reconstruct masked clip embeddings, and clips whose embeddings are hard to predict are flagged as interesting. Evaluated under a realistic protocol that trains on one dataset and tests against footage from others, this approach appears highly effective. We show that this apparent success is actually a domain-shift consequence: on a fair benchmark drawn from a single dataset, this mechanism collapses to chance and is on par with simple no-training baselines. A lightly supervised probe on the same frozen embeddings results in almost double the average precision, indicating that the bottleneck is indeed the self-supervised objective, rather than the representation. We present this as a study for evaluating the effectiveness of self-supervised learning, where cross-dataset protocols can silently reward domain separation over novelty.

[139] DeVIT: Low-Power Vision Transformer Acceleration Using Delta Computation cs.CV | cs.AI | cs.ARPDF

Reyhaneh Hosseinzadeh, Parham Zilouchian Moghaddam, Mehdi Modarressi

TL;DR: 本文提出了DeVIT，一种用于视觉Transformer的低功耗加速方法。该方法利用量化后模型权重值域受限的特性，通过差分计算来实现无需乘法器的矩阵乘法，旨在降低模型在资源受限设备上的部署难度。

Details

Motivation: Transformer模型虽然性能强大，但其高计算复杂度和巨大的内存与带宽需求，使其在资源受限设备上的部署面临重大挑战。量化虽能降低内存需求，但也带来了权重值域受限（即值局部性）的特性，本文旨在充分利用这一特性进行加速。

Result: 摘要中未提及具体的定量实验结果、基准测试或与SOTA的比较。

Insight: 核心创新点在于利用量化后模型参数的值局部性，提出了一种基于差分计算的加速方案，从而实现了无需乘法器的矩阵乘法运算，这为低功耗Transformer加速提供了一种新思路。

Abstract: The emergence of transformer-based deep learning models has brought unprecedented performance across various domains, particularly in natural language processing and computer vision. However, deploying these models, especially on resource-constrained devices, poses significant challenges due to their high computational complexity and large memory size and bandwidth requirements. This complexity has led researchers to use low-bit model weights to reduce memory usage and improve efficiency. In addition to reducing processing and memory demands, quantization introduces another useful property: value locality, where the extremely large number of parameters are restricted to a limited range of values. To fully take advantage of this locality, this paper presents DeVIT, an acceleration method for vision transformers that leverages differential computation to enable multiplier-less matrix multiplication.

[140] Prompt-Driven Simulation with Feature Perturbation for Cross-Domain Few-Shot Object Detection cs.CVPDF

Linhai Zhuo, Junxi Cai, Tianwen Qian, Qingping Zheng, Yang Liu

TL;DR: 本文提出PSP-FSOD框架，通过提示驱动的域模拟和特征扰动正则化来解决跨域少样本目标检测中的域偏移问题。该方法利用大视觉语言模型进行可控的域合成，生成语义一致且域多样的训练样本，并结合噪声注入的特征扰动机制提升模型的泛化能力。

Details

Motivation: 现有数据增强方法（如Color-Jitter、Mosaic和Domain-RAG）在建模复杂域偏移时能力有限，导致跨域少样本目标检测性能不佳，需要更有效的域适应策略。

Result: 在多个CD-FSOD基准测试中，PSP-FSOD通过生成高质量域多样监督和学习域不变表示，显著提升了检测性能。

Insight: 创新点在于结合提示驱动的域模拟（利用VLM的视觉定位能力联合建模前景和背景变化）与分布校正的多尺度特征扰动，增强了语义一致性和训练稳定性，可借鉴于其他域适应任务。

Abstract: Data augmentation, which simulates diverse visual variations to expand the source distribution and induce synthetic domain shifts, is a simple yet effective strategy for mitigating severe domain shifts and limited labeled target data in cross-domain few-shot object detection (CD-FSOD). Existing approaches rely on conventional data augmentation, such as Color-Jitter, Mosaic, and background-centric adaptation (e.g., Domain-RAG), which are limited in modeling complex domain shifts and often lead to suboptimal performance. In this paper, we propose PSP-FSOD, a principled framework that integrates prompt-driven domain simulation with feature perturbation regularization to improve generalization in CD-FSOD. To enable controllable domain synthesis, we design a prompt-driven strategy that leverages the visual grounding capability of large VLMs to jointly model foreground and background variations, generating semantically consistent yet domain-diverse training samples. Moreover, we adopt a grounding-aware generation scheme that guides object placement and alleviates semantic-spatial misalignment, thereby improving foreground adaptation. To ensure training stability and robustness, we further introduce a noise-induced feature perturbation mechanism that injects Gaussian noise into multi-scale intermediate features with distribution correction, encouraging consistent predictions under perturbations and reducing reliance on domain-specific cues. Extensive experiments demonstrate that PSP-FSOD produces high-quality domain-diverse supervision and learns domain-invariant representations, consistently improving performance across CD-FSOD benchmarks.

[141] PixVL: Self-Supervised Training of Pixel-Level MLLMs via a Unified Mask–Text Consistency Cycle cs.CVPDF

Yicheng Xiao, Haoxuan Ma, Caorui Li, Yucheng Wu, Weijie Wang

TL;DR: PixVL是一个自监督后训练框架，通过引入统一的掩码-文本一致性循环，使像素级多模态大语言模型能够从无标注数据中生成和自验证区域描述，从而解决高质量掩码-文本对稀缺以及区域分割与区域理解任务间优化干扰的问题。

Details

Motivation: 解决像素级多模态大语言模型面临的两个基本挑战：高质量掩码-文本对的稀缺性，以及区域分割与区域理解任务在监督格式和学习信号密度上的差异导致的优化干扰。

Result: 实验表明，PixVL提升了区域理解任务和分割任务的性能，具体基准和定量结果未在摘要中明确提及。

Insight: 创新点包括：引入混淆感知语义验证，利用模型在高度相似候选区域中正确选择目标时的置信度；采用跨视图验证防止循环学习塌缩到位置和形状捷径；以及质量耦合的双向学习策略，将区域理解与分割从竞争任务转变为相互生成和验证的关系。

Abstract: Recent studies develop pixel-level multimodal large language models (MLLMs) that support both Region Segmentation and Region Understanding, extending multimodal interaction from whole images to specific objects and regions. However, these methods face two fundamental challenges. First, the scarcity of high-quality mask–text pairs leaves abundant mask annotations without corresponding language supervision. Second, discrepancies in supervision formats and learning-signal densities induce optimization interference between Region Segmentation and Region Understanding. To address these challenges, we propose PixVL, a self-supervised post-training framework that introduces a unified Mask–Text Consistency Cycle, enabling pixel-level MLLMs to generate and self-verify regional descriptions and learn from unlabeled data. We found that direct cycle based solely on geometric reconstruction is unreliable because re-segmentation IoU does not faithfully reflect the semantic quality and referring sufficiency. PixVL therefore introduces confuser-aware semantic verification, which uses the model’s confidence when it correctly chooses the target among highly similar candidate regions, and assigns zero reward to an incorrect choice. Meanwhile, PixVL performs cross-view verification using temporally separated video frames or geometrically transformed image views, preventing cyclic learning from collapsing to positional and shape shortcuts. Finally, a quality-coupled bidirectional learning strategy uses the highest-reward description to guide Text-to-Mask learning. This strategy transforms Region Understanding and Region Segmentation from competing tasks into mutual generators and verifiers. Experiments demonstrate that PixVL improves both region understanding task and segmentation task.

[142] FineMoLA: Towards Fine-Grained Motion-Language Alignment from Clip-Level Supervision cs.CVPDF

Tongyan Wang, Zhengyuan Li, Muhan Lin, Shengyang Luo, Yifan Shen

TL;DR: FineMoLA是一个弱监督框架，旨在从片段级标注中学习细粒度的运动-语言对齐。该方法通过将长文本描述分割为动作短语，并将运动-语言对齐建模为最优传输问题，从而在没有人工标注的情况下推断出伪帧级对齐。实验表明，该方法在运动-文本对齐任务上优于基线方法。

Details

Motivation: 现有的大规模运动-语言数据集通常只在片段级别提供监督，缺乏运动帧与语言之间的显式时间对应关系，这限制了细粒度的运动-文本对齐和时间精确的生成。

Result: 在SnapMoGen数据集上的实验表明，FineMoLA学习到的对齐在运动-文本对齐任务上优于基线方法。

Insight: 将运动-语言对齐建模为最优传输问题，利用熵正则化和Sinkhorn迭代高效推断伪帧级对齐，无需人工标注，实现了从片段级监督到细粒度对齐的弱监督学习。

Abstract: Text-conditioned human motion generation has made rapid progress with the emergence of large-scale motion–language datasets. However, even datasets with rich long-form descriptions typically provide supervision only at the clip level, without explicit temporal correspondence between motion frames and language. This limits fine-grained motion–text grounding and temporally precise generation. We propose FineMoLA, a weakly supervised framework that learns fine-grained frame–phrase correspondence directly from clip-level annotations. Our method first segments long-form descriptions into action-bearing phrases, and then formulates motion–language alignment as an optimal transport problem, which naturally models many-to-many relations between motion frames and text under global constraints. With entropic regularization and Sinkhorn iterations, FineMoLA efficiently infers pseudo frame-level alignments without human labeling. Experiments on SnapMoGen demonstrate that the learned alignments outperform baselines in motion–text grounding.

[143] CORTIVA: Candidate-Score Fusion of Complementary Visual Teachers for EEG- and MEG-to-Image Retrieval cs.CVPDF

Junhan Wang, Kani Chen

TL;DR: 本文提出了CORTIVA框架，用于从EEG和MEG脑信号中检索图像。该框架通过融合多个独立解码路径的候选图像评分，而非在早期合并视觉嵌入，来保留互补证据，从而在THINGS-EEG2和THINGS-MEG基准上显著提升了图像检索的准确率。

Details

Motivation: 现有基于EEG/MEG的零样本图像检索系统通常在排序前将异构的视觉监督信息合并为单一嵌入，这强制所有候选图像遵循单一的相似性几何结构，并移除了编码器特有的分歧，从而损失了互补证据。

Result: 在THINGS-EEG2基准（200选1）上，CORTIVA在十名参与者中平均达到73.5%的Top-1和95.3%的Top-5准确率，比已报告的最强基线分别高出10.3和5.4个百分点。在THINGS-MEG基准上，使用模态特定的神经编码器，Top-1准确率达到42.4%。

Insight: 核心创新在于提出了候选评分融合框架，将多个独立解码路径的评分向量在排序前进行温度缩放和组合，而非在嵌入层面进行早期合并。这种方法简单、可测试，其增益源于整合互补的路径评分，且无需专门的加权规则，仅使用均匀加权即可保持性能提升。

Abstract: Decoding visual experience from non-invasive brain activity is central to neuroscience and brain-computer interfaces. Functional magnetic resonance imaging (fMRI) offers fine spatial detail, but its slow hemodynamics and burdensome acquisition limit temporally resolved decoding. Electroencephalography (EEG) and magnetoencephalography (MEG) provide millisecond resolution, making image retrieval compelling: identify the viewed image from one neural response and a fixed candidate bank. Contrastive alignment to pretrained visual representations enables zero-shot retrieval from EEG and MEG, but most systems collapse heterogeneous visual supervision into a single embedding before ranking. This early consolidation imposes one similarity geometry on every candidate order and removes encoder-specific disagreements from the final ranking. We propose CORTIVA, a candidate-score fusion framework that preserves this complementary evidence. Three decoding routes are aligned to heterogeneous visual targets, score the same indexed candidates independently, and combine only their temperature-scaled score vectors before ranking. On the 200-way THINGS-EEG2 benchmark, CORTIVA reaches 73.5% Top-1 and 95.3% Top-5 across ten participants, exceeding the strongest reported baseline by 10.3 and 5.4 percentage points. With a modality-specific neural encoder, the same fusion principle reaches 42.4% Top-1 on THINGS-MEG. Matched route-removal retraining and four weight controls demonstrate that CORTIVA’s gain arises from integrating complementary route scores and persists with uniform weighting, without requiring a specialized weighting rule. Independent DINOv2 analyses further reproduce the local error neighborhoods and posterior neural-visual correspondence. These results establish candidate-score fusion as a simple and testable alternative to embedding-level consolidation for neural image retrieval.

[144] Long-Horizon Embodied Decision-Making via Multimodal Memory Compression cs.CV | cs.CLPDF

Bingxuan Li, Rui Yang, Cheng Qian, Jiateng Liu, Jeonghwan Kim

TL;DR: 本文提出了DunphyBench，一个用于评估智能体在长时程、以人为中心的具身决策任务中的新基准，要求智能体在多个具身房屋环境中导航，并根据多维人类偏好做出决策。研究发现当前智能体与人类表现存在显著差距，且多模态历史记忆管理是瓶颈。为此，作者设计了MeMento，一种基于偏好的多模态记忆压缩器，能根据用户偏好从长时程历史中选择性压缩决策相关信息。实验表明，MeMento能提升VLM驱动智能体的准确率7.18%，同时减少85.38%的内存使用。

Details

Motivation: 智能体不仅需要执行任务，还需作为人类用户的决策者，这要求其在长时程中积累证据、解释隐含用户偏好，并在部分观测下比较多个候选方案。现有具身推理任务多关注程序性规划或即时目标完成，而本工作旨在解决长时程、多模态、多源输入下的复杂推理与决策问题。

Result: 在提出的DunphyBench基准上，当前最先进的VLM驱动智能体与人类表现存在显著差距。MeMento方法相比最强基线，将VLM驱动智能体的决策准确率提升了7.18%，同时将内存使用降低了85.38%。

Insight: 创新点在于提出了首个专注于长时程、以人为中心的具身决策评估基准DunphyBench，并诊断出多模态历史记忆管理是关键瓶颈。所设计的MeMento记忆压缩器通过基于用户偏好、使用固定数量记忆令牌进行选择性压缩，有效提升了决策质量并大幅降低了内存开销，为长时程具身决策中的记忆高效处理提供了新思路。

Abstract: Agents are increasingly expected to act not only as task executors, but also as decision-makers on behalf of human users. This shift requires agents to accumulate evidence over long horizons, interpret implicit user preferences, and compare multiple candidates under partial observations. In this work, we propose DunphyBench, a new benchmark for evaluating agents on long-horizon human-centered embodied decision-making, where the agent must navigate through multiple embodied housing environments and make decisions that align with multi-dimensional human preferences. Unlike standard embodied reasoning tasks that often focus on procedural planning or immediate goal completion, our setting requires agents to integrate multimodal, multi-source input into coherent knowledge that supports complex reasoning across long horizon. The evaluation results reveal that there is a substantial gap between current agents and human performance. Furthermore, our diagnosis of state-of-the-art VLM-driven agents reveals that memory management is one of the bottlenecks, where raw multimodal history introduces noise that hinders decision quality. Motivated by this finding, we design MeMento, a preference-conditioned multimodal memory compressor that selectively compresses decision-relevant information from long-horizon history based on user preferences with a fixed set of memory tokens. Experiments show that MeMento helps VLM-driven agents improve accuracy by 7.18%, while reducing memory usage by 85.38% compared to the strongest baseline.

[145] Training-Free Out-of-Distribution Detection for Pathology Whole-Slide Images cs.CVPDF

Sabri Mustafa Kahya, Richard R. Chen, Muhammet Sami Yavuz, Jerry Jierui Lou, Akanimoh Adeleye

TL;DR: 本文提出了一种名为ZIO的训练免费多模态OOD检测方法，专门用于病理学全切片图像（WSI）的分布外检测。该方法利用视觉-语言病理学基础模型构建文本和视觉原型，并通过原型收缩机制整合互补信息来计算OOD分数，以识别输入数据是否偏离训练分布。

Details

Motivation: 在医学AI部署中，需要检测输入数据是否偏离训练分布以确保模型仅在其专业范围内提供预测，而病理学WSI的千兆像素规模、疾病亚型间的细微差异以及组织制备的变异性给传统OOD方法带来了独特挑战。

Result: 在五个独立联盟的超过14,700张WSI上进行广泛评估，涵盖罕见疾病和近OOD设置等临床相关领域偏移，ZIO在一致优于单模态原型和40种最先进的OOD方法，展示了多模态表示在OOD检测中的优势。

Insight: 创新点在于利用视觉-语言病理学基础模型构建多模态原型，并通过原型收缩机制整合文本和视觉信息，实现了无需训练的OOD检测，为临床实践中更安全的AI部署提供了新途径。

Abstract: Safe deployment of AI methods in medicine requires robust guardrails that detect when input data deviate from the training distribution to ensure that models provide predictions only within their scope of expertise and abstain otherwise. Out-of-distribution (OOD) detection can provide such safeguards and is extensively studied in general computer vision. Yet, it remains underdeveloped in computational pathology, where gigapixel whole-slide images (WSIs), subtle differences between disease subtypes, and variability in tissue preparation pose unique challenges for conventional OOD methods. We propose ZIO, a training-free, multimodal OOD detector for pathology WSIs that leverages vision–language pathology foundation models (FMs). ZIO constructs text and visual prototypes of in-distribution classes and integrates their complementary information through a prototype shrinkage mechanism to derive OOD scores. We provide the ZIO formulation for both slide- and patch-level FMs. We evaluate ZIO across diverse clinically relevant domain shifts, including rare diseases and near-OOD settings. Extensive evaluation of over 14,700 WSIs from five independent consortia shows that ZIO consistently outperforms both unimodal prototypes and 40 state-of-the-art OOD methods. These results demonstrate the benefits of multimodal representation for OOD detection and pave the way towards safer AI deployment in clinical practice.

[146] Slot2Text: Object-Centric Visual Tokenization for Efficient and Spatially Traceable Surgical MLLMs cs.CV | cs.CL | cs.LGPDF

Guiqiu Liao, Matjaz Jogan, Daniel A. Hashimoto

TL;DR: Slot2Text是一种用于手术场景理解的双模式多模态大语言模型，它使用一组紧凑的、以槽位潜在变量编码的区域来替代密集的视觉标记表示，从而显著降低了推理成本并增强了生成答案的空间可追溯性。

Details

Motivation: 现有手术MLLMs通常注入数百个密集视觉标记，导致推理成本高昂且生成答案的空间可追溯性有限，Slot2Text旨在解决这一问题。

Result: 在多个视觉问答和视觉定位基准测试中，Slot2Text-Fast在显著降低计算成本（平均总标记消耗减少91.8%，视觉前缀从1295个标记减少到47个）的同时，性能与最先进的基线模型相当。

Insight: 创新点在于使用自监督视觉特征分组得到的槽位作为区域标记的视觉接口，实现了高效的视觉表示和可选的、可追溯的基于区域的推理能力，为手术MLLMs提供了一种新的视觉标记化范式。

Abstract: Multimodal large language models (MLLM) for surgical scene understanding typically inject hundreds of dense visual tokens into a language model, leading to costly inference and limited spatial traceability for generated answers. We present Slot2Text, a dual-mode surgical MLLM that replaces dense representations of visual input with a compact set of regions encoded as slot latents. Instead of relying on contrastive alignment of the visual encoder with language, Slot2Text groups self-supervised vision features into a few regions–slots that are consumed by the language model as area-labeled visual tokens. Slot2Text-Fast uses the slot prefix to answer surgical questions. Slot2Text-Reason also identifies and locates areas relevant for reasoning, linking language outputs to corresponding slot tokens, masks or regions. Experiments on multiple visual question answering and visual grounding benchmarks show that Slot2Text-Fast is competitive with state-of-the-art baseline at a much lower cost, reducing the average total token consumption by a 91.8% and the visual prefix from 1,295 to 47 tokens (a 96.4% reduction). Slot2Text-Reason trades additional tokens and latency for explicit area identities, locations, and traceable spatial evidence. These results establish compact slot latents as an efficient default visual interface for surgical MLLMs, with grounded reasoning invoked when greater spatial traceability is required.

[147] Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning cs.CVPDF

Yuqi Li, Yuedong Tan, Huiran Duan, Weilun Feng, Chuanguang Yang

TL;DR: 本文提出了一种面向紧凑统一多模态目标跟踪的方法，通过结合知识蒸馏与结构剪枝来降低模型计算负担。研究发现预测头是效率瓶颈，通过精简解码器架构实现实时推理，并设计了双对齐蒸馏框架来弥补轻量学生模型与复杂教师模型之间的能力差距。

Details

Motivation: 统一多模态目标跟踪模型虽利用互补传感器数据（如RGB、热成像、深度）实现了显著鲁棒性，但其高计算成本阻碍了在资源受限边缘设备上的部署，因此需要开发紧凑高效的跟踪模型。

Result: 在五个基准测试上的广泛实验表明，该方法显著优于复杂的SOTA方法。蒸馏后的模型在RGBT234基准上达到91.5% MPR，在单张RTX 4090上以54 FPS运行，相比教师模型提速5倍且保持更高精度。

Insight: 创新点在于将预测头识别为效率瓶颈并精简解码器，同时提出双对齐蒸馏框架，将知识转移解耦为空间表示对齐（关注’跟踪位置’）和语义分布对齐（关注’跟踪目标’），从而有效压缩模型并提升性能。

Abstract: Unified multimodal object tracking has achieved remarkable robustness by leveraging complementary sensor data (e.g., RGB, Thermal, Depth), yet the heavy computational burden of state-of-the-art models hinders their deployment on resource-constrained edge devices. In this work, we identify the prediction head as a critical but often overlooked efficiency bottleneck. By strategically streamlining the decoder architecture, we unlock the potential for real-time inference but simultaneously introduce a capacity gap between the lightweight student and the heavy teacher. To resolve this, we conduct a systematic analysis of 17 distillation strategies and introduce a Dual-Alignment Distillation framework. Our key insight is that effective compression requires decoupling knowledge transfer into two complementary streams: (1) Spatial Representation Alignment, which employs feature distillation to sharpen the student’s spatial focus on foreground targets (“Where to track”); and (2) Semantic Distribution Alignment, which utilizes logit-based distillation to align decision boundaries and transfer discriminative dark knowledge (“What to track”). Extensive experiments across five benchmarks demonstrate that our approach significantly outperforms complex state-of-the-art methods. Notably, our distilled model achieves 91.5% MPR on RGBT234 and operates at 54 FPS on a single RTX 4090, representing a 5x speedup over the teacher model while maintaining superior accuracy.

[148] Probing the 3D Object-Level Understanding of Pre-Trained Detection Transformers cs.CVPDF

Robin Kim, Colin Samplawski, Benjamin M. Marlin

TL;DR: 本文研究了预训练的2D检测变换器（如DETR及其扩展）在缺乏3D监督的情况下，其输出的物体级嵌入是否能够表示物体的3D属性。通过使用线性和非线性探针，作者发现这些模型能够从嵌入中恢复物体的深度和相对于摄像机的3D位置信息，显示出对3D物体级理解的意外强大能力。

Details

Motivation: 动机是探究预训练的2D检测变换器模型在仅接受2D监督训练后，是否能够理解和表示物体的3D属性，以评估其隐含的3D理解能力。

Result: 实验结果表明，在一系列检测变换器模型中，2D DETR模型能够从物体级嵌入中有效恢复物体的深度和3D位置信息，尽管训练时完全没有3D监督，这揭示了其先前未知的3D表示能力。

Insight: 创新点在于揭示了预训练的2D检测变换器模型具有隐含的3D物体理解能力，这为利用现有2D模型进行3D任务提供了新视角；从客观角度看，研究通过探针方法量化了这种能力，为模型可解释性和跨模态学习提供了见解。

Abstract: Detection transformer models, including DETR and its extensions, learn to output a set of object-level embeddings that can be simultaneously decoded into 2D bounding boxes and class distributions. In this paper, we investigate what pre-trained 2D detection transformers understand about the 3D properties of objects. Specifically, we investigate the extent to which properties including the depth of objects from the camera and the 3D location of objects relative to the camera can be recovered from object-level embeddings using linear and non-linear probes. Across a range of detection transformer models, our results show a surprisingly strong and previously unknown ability of 2D DETR models to represent useful information about the 3D properties of objects, despite the complete lack of 3D supervision during model pre-training.

[149] Rolling Shutter Camera Self-Calibration cs.CVPDF

Yongcong Zhang, Navid Rabbani, Bangyan Liao, Chengbo Wang, Yizhen Lao

TL;DR: 本文提出了一种针对卷帘快门相机的首个自标定方法，无需标定板或专用硬件，仅通过图像序列直接估计相机内参和读出时间比。该方法通过结合两种互补的卷帘快门成像模型，构建了一个统一的双投影模型，并在自标定光束法平差中实现，以增强几何和时间一致性。

Details

Motivation: 卷帘快门相机在消费设备中广泛使用，但其逐行曝光在运动下会导致失真，使得三维视觉问题依赖于相机内参和读出时间比。现有标定方法依赖标定目标或专用硬件，限制了其在无约束环境中的应用。

Result: 广泛的模拟实验分析了不同条件下多种实现的适用性，真实数据实验证明了所提方法在准确性、鲁棒性和实际有效性方面的表现。

Insight: 创新点在于首次实现了无需标定目标的卷帘快门相机自标定，并通过非平凡地结合两种互补模型（连续时间轨迹估计和时域失真全局快门图像校正）构建了统一的双投影模型，从而在自标定光束法平差中强制了更强的几何和时间一致性约束。

Abstract: Rolling shutter (RS) cameras are widely used in consumer devices, but their row-wise exposure causes distortions under motion, making geometric 3D vision problems dependent on both camera intrinsics and readout time ratio. Existing RS calibration methods rely on calibration targets or specialised hardware, limiting their use in unconstrained settings. We present the first self-calibration method for RS cameras that directly estimates camera intrinsics and the readout time ratio from image sequences, without requiring calibration targets. The method is implemented as a self-calibrating bundle adjustment (BA), which critically depends on the RS imaging model. We combine two known complementary models. The first formulates RS imaging as continuous-time trajectory estimation under a row-wise pose representation. The second interprets RS images as temporally distorted global shutter (GS) images and requires to estimate correction fields. The combination is non-trivial and results in a unified dual-projection model, in which each 3D point is simultaneously constrained at both row-dependent and reference timestamps along a shared continuous trajectory, enforcing stronger geometric and temporal consistency. Extensive simulations analyse the applicability of several implementations under varying conditions, and real data experiments demonstrate the accuracy, robustness, and practical effectiveness of the proposed approach.

[150] UCBound-Net: Uncertainty-Guided Boundary-Aware Continual Learning for Domain-Incremental Ultrasound Segmentation cs.CVPDF

Mohammad Amanour Rahman

TL;DR: 本文提出了UCBound-Net，一种用于领域增量超声图像分割的持续学习框架。该框架利用蒙特卡洛Dropout不确定性作为遗忘风险的空间代理，通过不确定性加权的边界知识蒸馏、不确定性校准正则化和不确定性引导的样本选择三个协同组件，来缓解模型在学习新领域时对旧知识的灾难性遗忘问题。

Details

Motivation: 临床影像中的持续学习面临双重挑战：模型需要吸收新解剖领域的知识，同时保留先前任务学到的表征（即灾难性遗忘问题）。现有缓解策略（如正则化和知识蒸馏）平等对待所有空间区域，忽略了预测不确定性与遗忘倾向高度相关的事实。

Result: 在一个顺序领域增量基准测试（任务1：乳腺超声BUSI，任务2：甲状腺超声TN3K）上评估，UCBound-Net相对于朴素微调显著减少了遗忘，其反向迁移（BWT）为-0.098（对比-0.173），同时在两个任务上获得了0.755的平均Dice相似系数（DSC）。该框架优于基线方法，且无需任务边界监督。消融研究进一步表明每个组件都对缓解遗忘有独立贡献。

Insight: 论文的核心创新在于将预测不确定性（通过MC Dropout量化）作为空间先验来指导持续学习过程，特别是聚焦于边界区域。具体可借鉴的创新点包括：1) 不确定性加权的边界知识蒸馏，在高熵区域增强知识迁移信号；2) 不确定性校准正则化，显式惩罚过度自信的错误预测；3) 不确定性引导的样本选择，优先存储边界区域预测熵最高的样本到记忆缓冲区。这为临床图像分割提供了一条实用的、不确定性感知的持续学习路径。

Abstract: Continual learning in clinical imaging faces a dual challenge: a model must assimilate knowledge from new anatomical domains while retaining representations learned from prior tasks, a problem known as catastrophic forgetting. Existing mitigation strategies, including regularization and knowledge distillation, treat all spatial regions equally, ignoring the fact that prediction uncertainty is strongly correlated with the propensity for forgetting. We introduce UCBound-Net, a continual segmentation framework that exploits Monte Carlo (MC) Dropout uncertainty as a spatial proxy for forgetting risk. Our method contributes three synergistic components: (i) uncertainty-weighted boundary distillation, which amplifies the knowledge transfer signal at high-entropy regions of the frozen teacher; (ii) uncertainty-calibration regularization, which explicitly penalizes overconfident erroneous predictions; and (iii) uncertainty-guided exemplar selection, a memory buffer that preferentially stores samples whose boundary regions exhibit the highest predictive entropy. Evaluated on a sequential domain-incremental benchmark comprising breast ultrasound (BUSI, Task 1) followed by thyroid ultrasound (TN3K, Task 2), UCBound-Net reduces forgetting relative to naive fine-tuning, achieving a backward transfer (BWT) of -0.098 compared with -0.173, while obtaining an average Dice Similarity Coefficient (DSC) of 0.755 across both tasks. The proposed framework outperforms baseline methods without requiring task-boundary supervision. An ablation study further demonstrates that each component contributes independently to forgetting mitigation, providing a practical pathway toward uncertainty-aware continual learning for clinical image segmentation.

[151] STAR-VLM: Spatiotemporal Grounding Vision-Language Models for Motion and Velocity Estimation via Automotive Radar Supervision cs.CV | cs.ROPDF

Pou-Chun Kung, Aryaman Rao, Utkrisht Sahai, Hemanth Murali, Yi Liu

TL;DR: STAR-VLM是一个利用汽车雷达监督增强视觉语言模型时空推理能力的框架，旨在提升自动驾驶场景中的运动分类和度量速度估计性能。该框架通过雷达提供的无标签距离和多普勒测量作为监督信号，避免了复杂预处理、昂贵人工标注或合成数据的使用。

Details

Motivation: 现有提升视觉语言模型时空推理的方法依赖复杂预处理、昂贵人工标注或合成数据，可扩展性有限且存在模拟到现实的差距，同时缺乏对动态场景（如以真实世界单位估计物体运动）的强度量推理能力。

Result: 在驾驶场景实验中，STAR-VLM在运动分类和度量速度估计任务上均达到了最先进的性能，甚至超过了为每个任务专门设计的任务特定方法。

Insight: 创新性地利用低成本、广泛部署的汽车雷达提供的距离和多普勒测量作为无标签监督信号，以增强视觉语言模型的度量时空推理能力，为构建面向现实世界自动驾驶的度量感知时空视觉语言模型提供了一种可扩展且经济高效的监督来源。

Abstract: Vision-language models (VLMs) are emerging as a key component of embodied intelligence, with growing applications in auto-labeling and end-to-end autonomous driving. However, existing approaches for improving spatiotemporal reasoning in VLMs often rely on complex preprocessing pipelines, expensive human annotations, or synthetic data, which limit scalability and introduce potential sim-to-real gaps. Moreover, although these methods have improved spatiotemporal understanding, they still lack strong metric reasoning capabilities for dynamic scenes, such as estimating object motion in real-world units. Prior work has explored LiDAR-based metric depth supervision to enhance spatial perception, but it does not directly address temporal reasoning. We introduce STAR-VLM, an automotive radar-supervised framework that enhances spatiotemporal VLMs with motion reasoning and metric velocity estimation for autonomous driving. Automotive radar is a low-cost and widely deployed sensor that provides complementary spatiotemporal supervision through range and Doppler measurements. By leveraging these measurements as label-free ground truth during training, STAR-VLM improves the metric spatiotemporal reasoning ability of VLMs. Through experiments on driving scenarios, we show that STAR-VLM achieves state-of-the-art performance on both motion classification and metric velocity estimation, outperforming even task-specific methods designed for each task. These results highlight automotive radar as a scalable and cost-effective source of supervision for building metric-aware spatiotemporal VLMs for real-world autonomous driving.

[152] ST-LoRA: Single Trajectory LoRA Ensemble for Uncertainty Aware Agricultural Segmentation cs.CVPDF

Mohamed Farag, Genc Hoxha, Yahia Maleki, Chris McCool, Ribana Roscher

TL;DR: 本文提出ST-LoRA，一种参数高效的集成框架，通过结合低秩适应（LoRA）与快照集成，从单一训练轨迹构建多样化的集成成员，用于农业语义分割任务中的不确定性量化。该方法在保持集成多样性的同时，将可训练参数减少到完整模型的10%以下，并在两个农业数据集上验证了其有效性。

Details

Motivation: 数字农业中的可靠决策支持需要准确的预测和良好校准的不确定性估计，但现有集成方法计算和内存成本高，而单模型近似方法往往在不确定性的质量与效率之间做出妥协。

Result: 在两个农业数据集（GrowliFlower-L和BUP20）上使用SegFormer和Mask2Former进行评估，ST-LoRA在分割精度和校准方面匹配或超越了全秩集成，同时显著减少了训练时间、推理延迟、内存占用和存储需求；在图像/像素级OoD检测、分布偏移下的校准稳定性以及跨种子方差方面，ST-LoRA也一致匹配或优于高效基线方法（如快照集成、MC Dropout和Deep Deterministic Uncertainty）。

Insight: 创新点在于将LoRA与快照集成结合，构建参数高效的集成框架；关键发现是，对于密集预测任务，前馈层而非注意力层是LoRA的关键目标，这与语言模型中仅关注注意力层的惯例相反，为视觉任务的高效不确定性量化提供了新思路。

Abstract: Reliable decision-support in digital agriculture requires accurate predictions and well-calibrated uncertainty estimates, particularly for dense prediction tasks such as semantic segmentation. Ensemble methods provide strong uncertainty quantification, but their computational and memory demands limit practical use, while single-model approximations often trade off uncertainty quality for efficiency. We propose ST-LoRA, a parameter-efficient ensemble framework that builds diverse ensemble members from a single training trajectory by combining Low-Rank Adaptation (LoRA) with snapshot ensembling. Each member shares a frozen pretrained backbone and differs only in lightweight low-rank adapters, reducing trainable parameters to under 10% of the full model while preserving ensemble diversity. We evaluate across two agricultural datasets - GrowliFlower-L (cauliflower, open field) and BUP20 (sweet pepper, glasshouse) - using SegFormer and Mask2Former, covering in-distribution performance, calibration under distribution shift, and out-of-distribution detection. Ablations show feed-forward layers, not attention layers, are the critical LoRA target for dense prediction, contrary to the attention-only convention from language models. ST-LoRA matches or exceeds full-rank ensembles in segmentation accuracy and calibration across both datasets and architectures, while substantially reducing training time, inference latency, memory footprint, and storage requirements. Against efficient baselines - Snapshot Ensemble, MC Dropout, and Deep Deterministic Uncertainty - ST-LoRA consistently matches or outperforms them in image/pixel-level OoD detection, calibration stability under shift, and cross-seed variance, with far fewer parameters and lower compute. These results show LoRA-efficient ensemble adaptation is a highly effective, practical approach for uncertainty-aware agricultural vision systems.

[153] Recursive Vision Language Models for General Symbolic Reasoning cs.CVPDF

Omid Nejati Manzari, Guillaume Lajoie, Hassan Rivaz

TL;DR: 本文提出了R-Qwen，一种基于预训练Qwen骨干的递归推理框架，通过程序化自递归和深度监督迭代优化候选解，结合了递归模型的结构化迭代计算与预训练大语言模型的语言和推理先验。该方法在八个具有挑战性的基准测试中，使用可训练参数量相当的情况下，持续优于先前的递归推理模型和更大规模的大语言模型。

Details

Motivation: 解决大语言模型在解决数独、迷宫寻路、ARC等硬符号推理任务时，因其固定深度的自回归推理而难以进行系统性搜索、细化和回溯的局限性。

Result: 在八个具有挑战性的基准测试中，R-Qwen持续优于先前的递归推理模型和更大规模的大语言模型。特别是在ARC-AGI数据集上，模型性能相比基线提升了27.6%。

Insight: 核心创新在于将递归推理机制与预训练大语言模型先验相结合，提出了程序化自递归和深度监督的迭代优化框架。此外，将分层监督加权（HSW）技术适配到自回归模型中，通过指数加权递归步骤的损失，有效降低了梯度方差，提升了收敛速度。

Abstract: Hard symbolic-reasoning tasks such as Sudoku, maze pathfinding, and ARC remain challenging for LLMs due to their fixed-depth autoregressive reasoning, which limits systematic search, refinement, and backtracking. While recursive models such as Hierarchical Reasoning Model (HRM) and Tiny Recursive Model (TRM) address this limitation through iterative latent-state refinement, they are typically task-specific and do not leverage pretrained language priors. We propose R-Qwen, a recursive reasoning framework built upon a pretrained Qwen backbone. R-Qwen repeatedly refines a candidate solution through programmatic self-recursion and deep supervision, combining the structured iterative computation of recursive models with the linguistic and reasoning priors of pretrained LLMs. We further adapt Hierarchical Supervision Weighting (HSW) to autoregressive models by exponentially weighting losses across recursive steps. HSW reduces gradient variance by at least 50%, improves the signal-to-noise ratio of stochastic gradients, and accelerates convergence. Across eight challenging benchmarks, R-Qwen consistently outperforms prior recursive reasoning models and substantially larger LLMs while using a comparable number of trainable parameters. Notably, on ARC-AGI dataset, our model achieves a 27.6% improvement over the baseline, highlighting the effectiveness of recursive refinement for general symbolic reasoning. These results suggest that recursive reasoning mechanisms and pretrained language model priors are complementary approaches for improving symbolic puzzle-solving. Code and models will be released after acceptance.

[154] D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting cs.CVPDF

Jijian Zhao

TL;DR: 本文提出D^2-4DGS，一种用于稀疏相机动态新视图合成的双深度引导4D高斯溅射框架。该方法通过融合单目深度（密集但尺度模糊）与多视图几何深度（稀疏但坐标系一致）两种互补深度先验，解决了稀疏输入下几何约束不足导致的伪影问题，实现了高质量的动态场景重建与实时渲染。

Details

Motivation: 现有动态4D高斯溅射方法通常依赖密集多视角视频提供充分的几何约束，导致采集成本高昂且难以部署于稀疏相机场景。减少输入视角会削弱几何监督，导致重建结构缺失和漂浮伪影。

Result: 在九个数据集-视角设置的所有实验中，D^2-4DGS均取得了最高的PSNR，平均比每个设置下的最佳竞争方法高出1.33 dB，实现了稀疏相机动态新视图合成的SOTA性能。

Insight: 核心创新在于提出了一种双源深度先验融合策略：通过将单目深度估计与有效的多视图几何深度对齐并验证一致性，获得可靠的几何锚点，用于一致性感知的剪枝、深度监督以及欠重建区域的致密化。RGB-D联合优化进一步提升了稀疏视角下的外观保真度与几何一致性。

Abstract: Dynamic 4D Gaussian Splatting has emerged as an efficient representation for dynamic novel view synthesis through explicit scene modeling and real-time rendering. However, existing methods typically require dense multi-view videos for sufficient geometric constraints, making capture expensive and limiting sparse-camera deployment. Reducing input views lowers acquisition cost but weakens geometry supervision, often causing missing structures and floating Gaussians. Depth priors provide geometric cues, yet no single source offers both dense coverage and reliable geometry. Monocular depth provides dense structure but is scale-ambiguous and locally biased, whereas multi-view geometric depth provides incomplete anchors consistent with the reconstruction coordinate system. To exploit their complementarity, we propose D$^2$-4DGS, a sparse-camera dynamic 4D Gaussian Splatting framework guided by dual-source depth priors. We align monocular estimates with valid multi-view geometric depths and verify their consistency to identify reliable geometric anchors. These verified anchors support consistency-aware pruning and depth supervision, while verified geometric depths and aligned mono-only estimates provide candidate geometry for densification in under-reconstructed regions. Finally, RGB-D joint optimization improves appearance fidelity and geometric consistency under sparse-view supervision. Across all nine dataset–view settings, D$^2$-4DGS achieves the highest PSNR, improving by 1.33 dB on average over the best competing method in each setting.

[155] Motion Beyond Morphology: Bootstrapping Cross-Category Motion Transfer from Abstract Motion Representations cs.CVPDF

Zhixue Fang, Zhimin Zhang, Bi’an Du, Zijie Meng, Yan Zhou

TL;DR: 本文提出了一种名为Motion Beyond Morphology的新视角和两阶段框架，旨在解决视频运动迁移中当参考对象与目标对象在形态、关节或变形机制上差异巨大时，传统基于固定结构对应的方法失效的问题。该框架通过第一阶段学习互补的多粒度抽象运动表示来引导生成跨类别的训练数据对，第二阶段将这些监督内化到直接的参考视频条件生成模型中，从而在推理时无需显式运动提取。

Details

Motivation: 现有视频运动迁移方法严重依赖固定的结构对应关系，当参考对象与目标对象在形态学上差异显著时，这种对应关系变得难以定义，导致迁移失败。本文旨在超越这种形态限制，迁移在不同目标形态下仍有意义的动态信息。

Result: 论文在提出的OpenVMT-Bench上进行了广泛实验，评估了相同、相近和远距离类别间的运动迁移任务。结果表明，该方法在运动保真度和目标对象保持方面达到了最先进的（SOTA）水平。

Insight: 核心创新在于提出了’超越形态的运动’视角，并设计了两阶段框架：首先通过抽象运动表示引导数据构建，然后将监督内化到端到端生成模型中。这避免了推理时对显式运动提取的依赖，并能处理形态差异巨大的跨类别迁移。提出的OpenVMT数据集和评测基准也为该领域提供了新的资源。

Abstract: Video motion transfer aims to animate a target object using dynamics from a reference video. Existing formulations largely rely on fixed structural correspondence, which becomes ill-defined when reference and target objects differ substantially in morphology, articulation, or deformation mechanisms. We introduce Motion Beyond Morphology, a perspective that seeks to transfer motion beyond fixed structural correspondence, by preserving dynamics that remain meaningful across different target morphologies. To realize this, we propose a two-stage framework. Stage~~I learns complementary multi-granularity abstract motion views and uses them to bootstrap cross-category video pairs that preserve transferable dynamics across diverse morphologies. Stage~~II internalizes this supervision into direct reference-video-conditioned generation, removing the need for explicit motion extraction at inference. We further introduce OpenVMT-Dataset and OpenVMT-Bench for training and evaluating image- and text-conditioned motion transfer across Same, Near, and Far category gaps, and plan to release both upon acceptance. Extensive experiments demonstrate state-of-the-art motion fidelity and target preservation. Project page: https://miniz233.github.io/MotionBeyondMorphology/

[156] Linear Multi-Timescale Retention as a Memory-Efficient Vision-Language Bridge cs.CV | cs.AIPDF

Ashfak Yeafi, Mehedi Hasan, Md Khairul Islam

TL;DR: 本文提出了一种名为线性多时间尺度保留（LIA-MTR）的模块，旨在解决视觉语言模型在处理高分辨率图像时，由于Softmax多头注意力（MHA）的O(N^2)内存复杂度而面临的计算瓶颈。该模块通过结合ELU正特征映射、自适应写入门控和对数线性分布的循环衰减，以严格的O(N)序列交互复杂度，将连续视觉序列压缩为有界内存状态，实现了内存高效的跨模态桥接。

Details

Motivation: 解决视觉语言模型在处理高分辨率图像时，因MHA的二次方内存复杂度导致的计算瓶颈；同时，避免使用独立MLP替代MHA时，因缺乏空间序列路由而导致的全局场景理解和物体恒常性严重退化问题。

Result: 在合成检索评估中，LIA-MTR能在16,000个令牌上完美路由上下文，消除了朴素线性注意力典型的“迷失在中间”退化问题；硬件基准测试显示其具备无限上下文扩展能力，能以11.2 GB VRAM原生处理262,144个视觉补丁，而标准MHA在16,384个补丁时即出现内存不足错误；在MME基准测试中，经过665K对话样本的指令微调后，LIA-MTR以71.00%的得分显著优于行业标准MLP基线（68.11%），这主要得益于其在物体恒常性上10%的绝对提升和更优的全局语义提取能力。

Insight: 核心创新在于将ELU正特征映射、自适应写入门控和对数线性分布的循环衰减机制相结合，构建了一个理论上具有严格O(N)复杂度的序列交互模块，为无限上下文的视觉语言集成提供了数学上严谨且计算上平坦的基础；其设计巧妙地平衡了内存效率与模型保持空间序列路由和全局理解能力的需求。

Abstract: Vision-Language Models (VLMs) face a critical computational bottleneck when processing high-resolution imagery due to the $O(N^2)$ memory complexity of Softmax Multi-Head Attention (MHA). While substituting MHA with independent Multi-Layer Perceptrons (MLPs) achieves $O(N)$ scaling, it strips the architecture of spatial sequence routing, severely degrading global scene understanding and object permanence. In this paper, we propose the Linear Multi-Timescale Retention (LIA-MTR) module, a memory-efficient cross-modal bridge. By integrating an ELU-based positive feature mapping with adaptive write-gating and log-linearly distributed recurrent decays, LIA-MTR mathematically compresses continuous visual sequences into bounded memory states. Theoretical analysis proves the architecture operates with strict $O(N)$ sequence-interaction complexity. Empirically, synthetic retrieval evaluations demonstrate that LIA-MTR flawlessly routes context across 16,000 tokens, eliminating the “Lost in the Middle” degradation typical of naive linear attention. Hardware benchmarking reveals infinite-context scaling capabilities, natively processing 262,144 visual patches within an 11.2 GB VRAM footprint, whereas standard MHA suffers out-of-memory failure at 16,384 patches. Furthermore, following instruction tuning on 665K conversational samples, LIA-MTR significantly outperforms an industry-standard MLP baseline on the MME benchmark (71.00% vs. 68.11%), driven by a 10% absolute improvement in object permanence and superior global semantic extraction. This work establishes a mathematically rigorous, computationally flat foundation for infinite-context Vision-Language integration.

[157] Mitigating Visual Degradation in MLLMs via Spatial-Spectral Visual Anchor Learning cs.CVPDF

Qianlong Yang, Bowen Ye, Xianda Guo, Yanlun Peng, Wenke Huang

TL;DR: 本文提出了一种名为空间-频谱视觉锚点学习（SSVAL）的方法，旨在缓解多模态大语言模型（MLLMs）在推理过程中出现的视觉表征退化问题。该方法的核心是视觉锚点提示注入（VAPI），通过在训练中引入从外部视觉基础模型（VFMs）吸收知识的提示，使其在推理时作为稳定的视觉锚点，并结合空间和频域表征对齐损失进行辅助监督。实验表明，SSVAL显著优于现有方法。

Details

Motivation: 尽管多模态大语言模型（MLLMs）取得了进展，但在视觉感知方面仍存在缺陷，特别是在视觉指令微调后，其内部表征在推理过程中会迅速偏离原始语义状态，导致严重的信息退化。现有方法试图利用外部视觉基础模型（VFMs）进行对齐，但直接对齐未能有效缓解表征偏离。

Result: 广泛的实验表明，SSVAL方法显著优于现有方法，在相关基准测试中取得了优越的性能。

Insight: 论文的创新点在于提出了视觉锚点提示注入（VAPI）机制，将外部视觉基础模型的丰富知识作为稳定的视觉锚点引入训练过程，以缓解推理时的表征偏离，并辅以空间和频域的对齐损失提供互补的视觉特定监督。从客观角度看，这种方法通过结合提示工程和跨域表征对齐，为缓解MLLMs的视觉退化问题提供了一种新颖且有效的解决方案。

Abstract: Despite the progress of multimodal large language models (MLLMs), they continue to exhibit deficiencies in visual perception. Following visual instruction tuning, internal MLLM representations rapidly deviate from their original semantic states during inference, causing severe information degradation. While existing methods attempt to leverage external vision foundation models (VFMs) to align internal representations, we find that direct alignment with VFMs enhances visual semantics but fails to mitigate representation deviation. To address this, we propose Spatial-Spectral Visual Anchor Learning (SSVAL). The core of SSVAL is Visual Anchor Prompt Injection (VAPI), which introduces prompts that absorb rich knowledge from external VFMs during training, enabling them to serve as stable visual anchors that mitigate representation deviation during inference. Additionally, we incorporate auxiliary spatial and frequency-domain representation alignment losses to provide complementary vision-specific supervision at intermediate LLM layers. Extensive experiments demonstrate that SSVAL significantly outperforms existing methods. Code are available on our \href{https://msls38.github.io/SSVAL/}{project page}.

[158] Dynamic Resolution Routing for Efficient Egocentric Grounding cs.CVPDF

Huixin Sun, Wangbo Zhao, Fanyue Wei, Qiuxia Lin, Pengzhan Sun

TL;DR: 本文提出了一种名为SmartRes的动态分辨率路由框架，旨在解决以自我为中心（Egocentric）的视觉定位任务中，高分辨率输入带来的视觉令牌处理成本过高的问题。该框架首先编码低分辨率视图获取全局上下文，然后通过轻量级路由器激活以物体为中心区域的高分辨率图像块，并构建保持顺序的视觉序列。通过引入边界正则化路由目标，增强了前景与背景的分离，提高了前景召回率。

Details

Motivation: 动机在于解决自我中心视觉定位任务中，为定位小物体需要高分辨率输入，但多模态大语言模型（MLLM）处理大量视觉令牌成本过高的问题。现有基于令牌缩减的高效策略在选取以物体为中心的空间证据时不可靠。

Result: 在Ego4D和EgoIntention基准测试上的实验表明，SmartRes最多减少了67%的视觉令牌，同时保持了全分辨率性能的86.4%，并且推理速度比最先进的令牌缩减方法快1.66倍，同时准确率更高。在小物体定位任务上也表现出强大性能。

Insight: 创新点在于将效率优化从令牌空间转移到像素空间，通过动态分辨率路由选择性处理高分辨率区域。引入边界正则化路由目标以应对严重的前景-背景不平衡，提高了路由的鲁棒性和前景召回率，为自我中心应用提供了有效的解决方案。

Abstract: Egocentric visual grounding requires high-resolution inputs to localize small objects. However, scaling Multimodal Large Language Models to this domain is constrained by the excessive cost of visual token processing. We identify that current efficient strategies based on token reduction are unreliable for selecting object-centric spatial evidence. To overcome this, we propose SmartRes, a framework that performs efficiency optimization in the pixel space via dynamic resolution routing. SmartRes first encodes a low-resolution view for global context and uses a lightweight router to activate high-resolution patches in object-centric regions and constructs an order-preserving visual sequence. To further enable robust routing under severe foreground-background imbalance, we introduce a margin-regularized routing objective that increases foreground-background logit separation and improves foreground recall. Experiments on Ego4D and EgoIntention show that SmartRes reduces visual tokens by up to 67% while retaining 86.4% of full-resolution performance, and achieves up to 1.66X faster inference than state-of-the-art token reduction methods with higher accuracy. Furthermore, strong performance on small object grounding indicates the effectiveness of SmartRes towards egocentric applications. Code will be publicly available.

[159] CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models cs.CV | cs.AIPDF

Yu Chen, Xiaohong Li, Xiaole Wang, Jianjin Zhang, Jun Sun

TL;DR: 本文提出CRAFT方法，通过递归自适应融合视频token来压缩视觉语言模型（VLMs）中的视觉序列，以解决视频理解中计算和内存成本高的问题。该方法将无参数token选择与可学习token融合解耦，在保持高压缩比的同时保留关键细节，并在多个视频基准测试中优于现有方法。

Details

Motivation: 视频理解中，视觉语言模型需要处理大量视觉token，导致预填充阶段计算和内存成本急剧上升；现有token压缩方法要么缺乏内容自适应性，要么需要昂贵的对齐训练，未能平衡效率与自适应性。

Result: 在多个代表性视频基准测试上，CRAFT一致优于先前的SOTA token压缩方法；在约8倍压缩下，它保留了主干模型约97%的平均准确率，并显著提升了效率。

Insight: 创新点在于将token压缩解耦为无参数全局相似性选择和可学习融合（包括位置感知加权模块和内容自适应通道门），整个流程与查询无关，且保留原始token的时空坐标，与预训练语言模型输入分布对齐。

Abstract: In video understanding, vision-language models (VLMs) must ingest massive numbers of visual tokens, causing the computational and memory cost of the prefill stage to rise sharply. Such visual sequences are highly redundant along the spatio-temporal dimension, yet a high compression ratio is often accompanied by the loss of critical details. Existing token-compression methods either employ heuristic, training-free compression with limited content adaptivity or introduce additional modules that require expensive alignment training, leaving the trade-off between efficiency and adaptivity unresolved. To alleviate this limitation, we propose CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens. CRAFT recursively merges tokens by decoupling parameter-free token selection from learnable token fusion: global similarity determines which tokens to merge, while a position-aware weighting module and a content-adaptive channel-wise gate learn how to fuse them. The whole compression pipeline is query-agnostic. Because every retained token is a linear combination of the original tokens, CRAFT preserves their true spatio-temporal coordinates and stays aligned with the pre-trained language model’s input distribution. Experiments on multiple representative video benchmarks show that CRAFT consistently outperforms prior state-of-the-art token-compression methods. At about $8\times$ compression, it retains roughly $97%$ of the backbone’s average accuracy and shows significant efficiency improvement.

[160] FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection cs.CVPDF

Yaning Zhang, Jiao Wu, Zan Gao, Linlin Shen

TL;DR: 本文针对深度伪造检测中的公平性问题，提出了一个新颖的公平性增强检测方法FairForensics。该方法通过构建一个人口统计学平衡的基准数据集，并设计了一个结合视觉与语言建模的框架，以同时提升模型对未见伪造技术的泛化能力和对不同人口群体的公平性。

Details

Motivation: 现有公平性增强的深度伪造检测器通常在人口统计学不平衡的数据上开发和评估，导致对少数群体的预测存在偏见，并且在面对未见伪造技术时泛化能力不佳。

Result: 在作者构建的平衡人口统计学基准上进行的大量实验表明，该方法在泛化能力和公平性方面均达到了最先进的水平。

Insight: 创新点在于观察到真实与伪造人脸在表情向量分布上的显著差异，并据此设计了表情感知的视觉编码器；同时，通过人口统计学引导的语言编码器和基于原型的公平性目标，利用视觉-语言对齐来解耦伪造特征与人口统计信息，从而提升公平性。

Abstract: The challenge of fair deepfake detection (FDD) has attracted increasing attention. Existing fairness-enhanced detectors often suffer from suboptimal generalization to unseen manipulations and fairness across demographic groups. They are typically developed and evaluated on demographically imbalanced distributions, resulting in biased predictions toward minority groups. In this paper, we construct a novel demographically balanced FDD benchmark to train and evaluate the fairness of detectors under both balanced and imbalanced population scenarios. Additionally, we introduce a novel expression and demographic perceptual vision-language model, termed FairForensics, for generalizable fair deepfake detection. FairForensics conducts face forgery generalization enhancement and demographic-aware fairness regularization. During face forgery generalization enhancement, built upon the novel observation of significant distribution differences between pristine and forged expression vectors, we design an expression encoder to capture high-level expression-guided forgery patterns, and an expression-perceptual visual encoder that integrates global appearance and expression forgery features while mitigating identity bias using an identity-aware patch perturbation module. Under demographic-aware fairness regularization, we propose a demographic-guided language encoder to extract population-aware global language embeddings, which boosts the decoupling of forgery features from demographic information via vision-language alignment. We devise a population-aware prototype fairness objective to enforce both inter-class separability and intra-class alignment across demographic subgroups. Extensive experiments on our balanced demographic benchmark show that our method achieves the state-of-the-art in terms of generalization and fairness.

[161] Ground, Cover, and Refine: Evidence-Centric Frame Selection for Long-Video Question Answering cs.CVPDF

Fan Wei, Siru Zhong, Runmin Dong, Miao Yang, Zhaoyang Luo

TL;DR: 本文提出了一种名为GCR（Ground, Cover, Refine）的训练无关框架，用于解决长视频问答中在有限视觉令牌预算下，从数千帧中高效选择关键证据的问题。该方法通过将时间戳文本转化为时序事件、补充视觉锚点、并优化替换弱证据帧，实现了对稀疏关键证据的联合管理。

Details

Motivation: 现有方法在固定预算下选择视频帧时存在两个关键局限：一是所选帧容易聚集在局部相关峰值区域，导致预算耗尽后遗漏的证据无法恢复；二是文本与视觉证据之间对齐较弱。GCR旨在解决这些问题，实现更有效的证据选择。

Result: 在LongVideoBench和Video-MME基准测试上，使用三个7B骨干模型和8、32、64帧预算进行实验，GCR均取得了持续改进。具体而言，使用7B LLaVA-OV骨干和32帧时，在两个基准上分别达到64.25%和62.15%，比最强的复现基线分别高出2.54和1.93个百分点，实现了SOTA性能。

Insight: 创新点在于将固定预算帧选择视为联合证据管理问题，通过“锚定-覆盖-精炼”三步策略，结合时间戳文本的事件转换、全局最大边际相关性保持多样性，以及可修订的帧替换机制，在无需训练视觉语言模型或修改架构的情况下，有效提升了长视频问答的证据选择质量。

Abstract: Long-video question answering requires identifying sparse yet critical evidence from videos containing thousands of frames under a constrained visual-token budget. Existing methods either select query-aware frames in a single pass or rely on timestamped text solely as retrieval guidance, leading to two key limitations. First, selected frames tend to cluster around local relevance peaks, and once the budget is exhausted, omitted evidence cannot be recovered. Second, textual and visual evidence remain weakly aligned. We propose GCR, a training-free framework that casts fixed-budget frame selection as a joint evidence curation problem. Ground converts timestamped text into temporal events, selects query-relevant real frame anchors, and renders each event text onto its temporally aligned frame. Cover supplements grounded events with direct visual anchors for complementary visual evidence and applies global maximal marginal relevance to preserve diverse context. Refine revisits omitted temporal regions and replaces the weakest revisable context frame with a real-frame medoid—but only when the medoid offers greater evidence value. GCR maintains a fixed number of chronologically ordered frames and requires no VLM training or architectural modification. Experiments on LongVideoBench and Video-MME, across three 7B backbones and frame budgets of 8, 32, and 64, demonstrate consistent improvements in long-video QA. With the 7B LLaVA-OV backbone and 32 frames, GCR achieves 64.25% and 62.15% on the two benchmarks, outperforming the strongest reproduced baselines by 2.54 and 1.93 percentage points, respectively.

[162] FAU at ImageCLEF 2026 Task on Multimodal Reasoning Robust Candidate Scoring and Concise Multilingual Visual Answering cs.CV | cs.LGPDF

Mohamed Basem, Vincent Christlein

TL;DR: 本文介绍了团队在ImageCLEF 2026多模态推理任务中的系统，针对视觉多项选择题问答和视觉开放式问答两个子任务。核心发现是稳健的输出控制与模型选择同等重要，通过候选标签评分、融合投票、图像增强、简洁提示和确定性解码等推理工程技术，在不进行任务特定模型训练的情况下，取得了优异成绩。

Details

Motivation: 解决在多语言、富含密集文本、图表、公式等复杂科学教育图像上进行可靠推理的挑战，并满足严格的答案格式要求。

Result: 在官方提交中，视觉多项选择题问答任务获得第三名（准确率0.7108），视觉开放式问答任务获得第一名（COMET 0.6488, BLEU 0.1391, ROUGE-L 0.2762, METEOR 0.2383）。

Insight: 创新点在于强调并系统实施了推理工程，包括用稳健的候选标签评分替代脆弱的自由生成、通过分数融合与投票进行集成、使用简洁答案提示和针对性后处理来净化输出，这能将强大的视觉语言模型转化为可靠的竞赛系统。

Abstract: We present our ImageCLEF 2026 Multimodal Reasoning system for the Visual Multiple Choice Question Answering (Visual MCQ) and Visual Open Question Answering (Visual OpenQA) subtasks. The challenge requires reliable reasoning over multilingual educational and scientific images with dense text, diagrams, charts, tables, formulas, and units, while enforcing strict answer formats. Our central finding is that robust output control is as important as model choice. For Visual MCQ, we replace fragile free-form generation with direct candidate label scoring from vision-language model logits, then combine complementary runs through score fusion and voting. For Visual OpenQA, we use image enhancement, concise final answer prompting, deterministic decoding, and targeted post-processing to remove reasoning traces and formatting artifacts. Without task-specific model training, our official submissions achieved third place in Visual MCQ with 0.7108 accuracy and first place in Visual OpenQA with 0.6488 COMET, 0.1391 BLEU, 0.2762 ROUGE L, and 0.2383 METEOR. The results highlight the practical value of inference engineering: careful scoring, ensembling, prompting, and cleanup can turn strong VLMs into reliable competition systems.

[163] Few-Shot Concept Prompt Learning for Segmentation Foundation Models via Visual Grounding cs.CV | cs.AIPDF

Rahul Venkataramani, Rachana Sathish

TL;DR: 本文提出了一种名为Few-Shot Concept Prompt Learning (FS-CPL)的方法，旨在解决可提示分割基础模型（如SAM3和Medical SAM3）在医学图像分割中，由于图像-文本配对监督数据稀缺而导致自然语言提示性能不佳的问题。该方法通过从少量图像-掩码对中学习一个连续的视觉概念提示嵌入，以替代自然语言提示，从而提升分割性能。

Details

Motivation: 论文的动机是认识到现有可提示分割基础模型在临床任务中性能不足的根本原因，并非医学预训练不足或提示词表述不当，而是自然语言作为控制信号在图像-文本配对数据稀缺领域（如大多数临床模态）的结构性局限。

Result: 在涵盖超声和内窥镜的四个公共基准测试（BUSI, HC18, TN3K, CVC-Clinic）上，FS-CPL相比标准文本提示实现了高达+0.62的绝对Dice分数提升。该方法与主干网络无关，能同时提升原始SAM3和领域预训练的Medical SAM3的性能。

Insight: 论文的核心创新点在于提出用少量监督数据学习视觉概念提示嵌入来替代自然语言提示，这是一种不依赖额外图像-文本数据或主干网络重训练的性能提升方法。从客观角度看，这种视觉接地（visual grounding）的提示学习策略，为解决数据稀缺领域的基础模型适配问题提供了一个有效且互补的新思路。

Abstract: Promptable segmentation foundation models (FMs) such as SAM3 and Medical SAM3 promise few-shot, interactively-specified segmentation for medical imaging through a natural language interface, yet their performance on clinical tasks falls well short of this promise. We posit that this shortfall is not an artefact of insufficient medical pretraining or imperfect prompt phrasing, but a structural limitation that will persist in any domain where paired image-text supervision is scarce, as it is across most clinical modalities. We further hypothesize that the limitation is specific to natural language as a control signal: a visually grounded prompt, learned directly from the target distribution, should recover the lost performance without additional image-text data or backbone retraining. We propose Few-Shot Concept Prompt Learning (FS-CPL), which learns a continuous concept prompt embedding $\mathbf{p}^* \in \mathbb{R}^{T \times d}$ from a small support set of $K$ image–mask pairs via mask supervision, with the encoder-decoder backbone frozen. Across four public benchmarks spanning ultrasound and endoscopy (BUSI, HC18, TN3K, CVC-Clinic), FS-CPL delivers absolute Dice improvements of up to $+0.62$ over canonical text prompts and is \emph{backbone-agnostic}: it lifts both vanilla SAM3 and the domain-specifically pretrained Medical SAM3, showing that visual concept prompting is complementary to in-domain pretraining.

[164] Illuminating Visual Identity in Universal Multimodal Embeddings cs.CV | cs.AI | cs.CLPDF

Jiawei Cao, Junyi Feng, Jiashen Hua, Ziheng Huang, Bing Deng

TL;DR: 本文针对通用多模态嵌入（UMEs）中视觉身份识别能力不足的问题，提出了一个统一的视觉身份识别（VisID）框架，并构建了大规模基准MVEB。作者还设计了一个简单有效的学习框架，通过身份感知采样机制联合优化通用多模态表示和视觉身份表示，使UMEs在保持通用多模态性能的同时，具备了强大的身份识别能力。

Details

Motivation: 现有通用多模态嵌入方法在视觉身份识别这一关键能力上探索不足，而该能力在实例检索、重识别和AIGC身份保持等任务中至关重要，因此需要弥补这一能力缺口。

Result: 大量实验表明，该方法成功赋予了UMEs强大的身份识别能力，同时在通用多模态性能上保持了竞争力。

Insight: 创新点在于将视觉身份识别问题统一到通用多模态嵌入框架中，并构建了包含真实与合成数据的大规模基准MVEB；其身份感知采样机制是联合优化两种表示的关键设计，为构建更全面的通用多模态嵌入迈出了一步。

Abstract: Universal Multimodal Embeddings (UMEs) aim to unify various modalities and tasks into a shared representation space. In recent years, this field has witnessed substantial progress driven by the development of Multimodal Large Language Models (MLLMs). However, a crucial capability, visual identity discrimination, remains underexplored in existing UME methods, despite its critical role in a wide range of tasks, including instance retrieval, re-identification, and identity preservation in AI-generated content. To bridge this gap, we propose a unified formulation for visual identity discrimination~(VisID) and introduce $\textbf{MVEB}$ ($\textbf{M}$ultimodal $\textbf{V}$isual Identity $\textbf{E}$mbedding $\textbf{B}$enchmark), a large-scale benchmark curated from both real-world and synthetic datasets to support evaluation and training. Furthermore, we present a simple yet effective learning framework that jointly optimizes general multimodal and visual identity representations through a carefully designed identity-aware sampling mechanism. Extensive experiments demonstrate that our approach successfully endows UMEs with strong identity discrimination capability and maintains competitive general multimodal performance. We believe this work not only illuminates a critical yet neglected capability, but also takes a step toward more holistic universal multimodal embeddings. Code and data are available at \href{https://chrisclear3.github.io/MVEB}{MVEB}.

[165] Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting cs.CV | cs.AIPDF

Ruifeng Wang, Di Yang, Jiangtao Wang

TL;DR: 本文提出了一种名为多实体去噪序列转换（ME-DST）的新方法，用于解决以球员为中心的足球动作识别问题。该方法通过保持角色槽维度、使用时序注意力和空间注意力来分别建模球员自身的时间演变和球员间的交互，并结合了可学习的角色嵌入、战术特征和视觉预测。

Details

Motivation: 现有去噪序列转换（DST）基线方法将球员角色维度视为扁平化的帧级表示的一部分，这削弱了建模球员特定时间演变和球员间交互的归纳偏置。本文旨在通过显式的实体建模来解决这一局限性。

Result: 在FOOTPASS数据集上的实验表明，ME-DST达到了0.778的Micro F1分数，比最强的官方TAAD+DST基线提高了10.3个百分点，达到了新的SOTA水平。消融实验证实了保持实体轴和编码角色身份是性能提升的关键。

Insight: 核心创新点是提出了一个因子化设计（ME-DST），将球员实体维度（角色槽）作为模型结构的一部分，通过分离的时序和空间注意力机制来显式建模球员内部演变和球员间上下文。这为以实体为中心的体育视频理解提供了一个有效的归纳偏置。此外，整合多模态特征（战术、视觉）也增强了模型性能。

Abstract: Player-centric ball action spotting requires temporally precise event detection together with actor attribution in crowded, partially observed multi-agent sports videos. Existing Denoising Sequence Transduction (DST) baselines treat the player-role dimension as part of a flattened frame-level representation, which weakens the inductive bias for modeling player-specific temporal evolution and inter-player interactions. To address this limitation, we propose Multi-Entity Denoising Sequence Transduction (ME-DST). ME-DST keeps the role-slot dimension throughout encoding. It uses temporal attention to model the history of each role slot, and spatial attention to exchange information across role slots at each frame. This factorized design gives the model a direct structure for separating within-player evolution from inter-player context. We also add learnable role embeddings, tracking-derived tactical features, and fused visual predictions from X3D-L and Swin3D-S. Experiments on the FOOTPASS dataset show that ME-DST reaches a Micro F1 of 0.778. This improves the strongest official TAAD+DST baseline by 10.3 percentage points. Controlled ablations show that preserving the entity axis and encoding role identity are central to this gain. These results suggest that explicit entity modeling is an effective inductive bias for player-centric sports event understanding.

[166] SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models cs.CV | cs.CL | cs.LGPDF

Jing Wu, Jianhua Wu, Jiayi Guan, Jiahong Chen, Jinghui Lu

TL;DR: 本文提出了SpatioLM，一种参数高效的视觉语言模型，旨在增强模型在物理空间智能方面的能力，而无需额外的3D先验输入或第三方空间编码器。该方法通过设计一个即插即用的空间视觉模块，并利用伪深度和相机信息作为监督，引导模型学习物理上一致的表示。实验表明，SpatioLM在空间感知和理解等任务上取得了显著提升，并在VSI-Bench基准测试中取得了71.6的优异成绩，同时有效限制了通用能力的退化。

Details

Motivation: 现有视觉语言模型在常识推理任务上表现良好，但在视觉空间推理方面存在不足。大多数现有解决方案需要引入额外的3D先验输入或外部空间编码器，这增加了复杂性，并且在空间微调后可能损害基础模型的通用能力。因此，本文旨在开发一种参数高效的方法，在不依赖额外输入或编码器的情况下增强模型的空间智能。

Result: SpatioLM在多样化的空间感知和理解任务上取得了显著改进。在VSI-Bench基准测试中，模型获得了71.6的分数，这是首个超过70分的模型，达到了SOTA水平。此外，在迁移到具身操作任务时，模型也取得了有竞争力的性能。

Insight: 论文的创新点在于设计了一个非侵入式的即插即用空间视觉模块，以激发视觉语言模型固有的空间知识，并创新性地利用伪深度和相机信息作为监督信号来学习物理上一致的表示。从客观角度看，这种方法避免了对外部复杂组件的依赖，在提升空间智能的同时有效保持了模型的通用能力，是一种参数高效且具有良好泛化性的解决方案。

Abstract: Vision-Language Models (VLMs) perform well on commonsense reasoning tasks but struggle with visual spatial reasoning. Most existing solutions introduce extra 3D prior inputs or external spatial encoders, which increase complexity and degrade the underlying VLMs’ general-purpose capabilities after spatial fine-tuning. To this end, we propose a parameter-efficient \textit{\textbf{Spatio}-vision \textbf{L}anguage \textbf{M}odels (SpatioLM)}, that enhances spatial intelligence without extra 3D prior inputs or third-party spatial encoders. Concretely, we design a plug-and-play and non-invasive spatio-vision module that elicits the spatial knowledge inherent in VLMs. Furthermore, we innovatively leverage pseudo depth and camera information as supervision to guide the model in learning physically coherent representations. Extensive experiments show that SpatioLM achieves significant improvements in diverse tasks, including spatial perception and understanding while effectively limiting the degradation of general capabilities. Notably, the model achieves an impressive score of 71.6 on the VSI-Bench (the first model to surpass 70). In addition, it attains competitive performance when transferred to embodied manipulation tasks. Code is available at \href{https://github.com/xiaomi-research/spatio-lm}{\faGithub~spatio-lm}.

[167] UniSim-SLAM: Feed-Forward SLAM with Unified Sim(3) Optimization cs.CVPDF

Inha Lee, Dongjae Jeong, Junhee Lee, Kyungdon Joo

TL;DR: UniSim-SLAM是一个集成的SLAM系统，它在前端运行轻量级的两视图关键帧跟踪，并在后端执行周期性的多视图子地图优化。为了解决不同局部坐标系和尺度不一致的问题，该系统在Sim(3)上构建了一个统一的多层因子图，联合优化全局关键帧位姿和子地图位姿。实验表明，在未标定设置下，该系统在TUM RGB-D和7-Scenes数据集上达到了最先进的精度。

Details

Motivation: 现有的几何基础模型能够进行前馈推理用于SLAM，但其预测严重依赖于输入视图集，导致在长序列中链接结果时出现几何不一致和轨迹漂移。在线部署还暴露了两视图跟踪的低延迟与多视图推理的约束丰富性之间的权衡问题。

Result: 在TUM RGB-D和7-Scenes数据集上的实验显示，UniSim-SLAM在未标定设置下达到了最先进的精度。与先前的最佳结果相比，其在TUM RGB-D上的轨迹误差减少了38.5%，在7-Scenes上减少了45.9%。

Insight: 创新点在于提出了一个集成了前端轻量跟踪和后端周期性子地图优化的系统架构，并构建了一个在Sim(3)上的统一多层因子图，通过整合多种约束（如里程计边、桥接边、连接和尺度约束）来联合优化关键帧和子地图位姿，从而有效处理尺度不一致问题并实现全局一致性。

Abstract: Recent geometric foundation models enable feed-forward inference for SLAM, but their predictions are strongly dependent on the input view set, which leads to geometric inconsistencies and trajectory drift when results are chained over long sequences. Online deployment further exposes a trade-off between the low latency of two-view tracking and the constraint richness of multi-view inference. We introduce UniSim-SLAM, an integrated system that runs lightweight two-view keyframe tracking in the frontend and performs periodic multi-view submap refinement in the backend. To combine predictions defined in heterogeneous local coordinates with inconsistent scales, we formulate a unified multi-level factor graph on $Sim(3)$ that jointly optimizes global keyframe poses and submap poses. The graph integrates temporal view-to-view odometry edges, view-to-submap bridge edges with depth-statistics scale anchoring, and submap-to-submap tie and scale constraints to enforce consistent similarity relations across submaps. Experiments on TUM RGB-D and 7-Scenes show that UniSim-SLAM achieves state-of-the-art accuracy in the uncalibrated setting, reducing trajectory error by $38.5% $ on TUM RGB-D and $45.9%$ on 7-Scenes compared to prior best results. Project page: https://vision3d-lab.github.io/unisim-slam/

[168] SpatialQuery: Benchmarking Geometry-Grounded Multi-Instance Spatial Reasoning in Vision-Language Models cs.CVPDF

Hai Nguyen, Tung Vu, Cong Tran

TL;DR: 该论文提出了SPATIALQUERY框架和SPATIALQUERY-1M基准，用于评估和提升视觉语言模型在几何基础的多实例空间推理任务上的能力。框架通过场景立方化将实例级度量几何转换为鸟瞰图表示，并结合不确定性感知思维链提示，无需微调即可在距离估计和邻近决策任务上超越现有方法。

Details

Motivation: 视觉语言模型在语义理解上表现出色，但在度量空间推理，尤其是需要比较同一类别多个实例的任务中，可靠性不足。本文旨在解决这一特定问题，即最近实例距离查询。

Result: 在SPATIALQUERY-1M基准上，结合Qwen3-VL-8B模型的SPATIALQUERY框架取得了0.259米的Floor-MAE、90.5%的Unc-Acc@0.3m和84.18%的邻近决策准确率，超越了经过微调的空间专家模型、通用VLM以及闭源前沿模型，达到了SOTA水平。

Insight: 主要创新点包括：1）提出了一个无需训练、基于单张RGB图像的推理框架和百万级基准；2）通过场景立方化将复杂3D场景简化为规范鸟瞰图表示；3）将几何不确定性融入VLM的思维链推理过程，提升了决策的可靠性。

Abstract: Vision-language models (VLMs) achieve strong semantic understanding but remain unreliable in metric spatial reasoning, particularly when queries require comparing multiple instances of the same object category. We study this problem through the Closest-Instance Distance Query (CIDQ), where a model must identify the nearest visible candidate to a unique reference object and estimate their gravity-aligned floor-plane distance. We introduce SPATIALQUERY, a training- free framework for CIDQ reasoning from a single RGB image, together with SPATIALQUERY-1M, a benchmark containing over one million RGB-only question-answer pairs from 200 indoor scenes. SPATIALQUERY recovers instance-level metric geometry and transforms it into a canonical Bird’s-Eye View through Scene Cubifying, which represents objects as uniformly sized, category-coded blocks to emphasize their relative floor- plane locations. We further propose Uncertainty-Aware Chain-of-Thought (UA-CoT) prompting, which incorporates geometry- derived per-instance uncertainty into the VLM reasoning process. Without task-specific fine-tuning or architectural modification, SPATIALQUERY with Qwen3-VL-8B achieves a Floor-MAE of 0.259 m, an Unc-Acc@0.3 m of 90.5%, and a proximity-decision accuracy of 84.18%, outperforming fine-tuned spatial specialists, general-purpose VLMs, and closed-source frontier models. Code, benchmark resources, and an interactive demo are available at https://namhai1810.github.io/SpatialQuery/.

[169] CultureVidBench: Benchmarking Cultural Understanding in Text-to-Video Generation cs.CV | cs.CL | cs.MMPDF

Xianjing Han, Yuhan Su, Yang Deng, Dong Ma, Wee Peng Tay

TL;DR: 本文介绍了CultureVidBench，一个用于评估文本到视频生成模型文化理解能力的综合性基准。该基准包含1000个精心设计的提示，覆盖12个国家、6大洲、8个文化区域和14个文化方面，重点关注物质文化、社会实践与表演、仪式与典礼。通过对7个代表性T2V模型进行人工和基于MLLM的自动评估，发现当前模型在语义对齐和视觉质量上表现良好，但在捕捉细粒度文化细节，尤其是对代表性不足的地区、仪式和多模态文化线索方面存在不足。

Details

Motivation: 现有T2V生成模型评估基准主要关注感知质量、物理合理性和文本-视频对齐，而缺乏对模型是否能够准确捕捉特定文化背景（如文化对象、行为、仪式、可见文本或音频线索）的直接评估。

Result: 在CultureVidBench上评估了7个代表性T2V模型，评估维度包括文化忠实度、多模态文化渲染、语义遵从性和感知质量。结果表明，当前模型在语义遵从性和视觉质量上表现强劲，但在忠实捕捉细粒度文化细节方面经常失败，特别是对于代表性不足的地区、仪式和多模态文化线索。

Insight: 论文的创新点在于首次提出了一个专门针对视频生成、强调动态和多模态文化表征（包括社会互动、仪式过程以及文化上恰当的可见文本和音频）的文化理解评估基准。这为评估和推动T2V模型在多样化文化背景下的生成能力提供了新的、更全面的工具和视角。

Abstract: Text-to-video (T2V) generation models have advanced rapidly, yet their ability to represent diverse cultural contexts remains underexplored. Existing benchmarks mainly focus on perceptual quality, physical plausibility, and text-video alignment, but do not directly assess whether generated videos capture culturally specific objects, actions, rituals, visible text, or audio cues. We introduce CultureVidBench, a comprehensive benchmark for evaluating cultural understanding in T2V generation. CultureVidBench contains 1,000 curated prompts covering 12 countries, 6 continents, 8 cultural regions, and 14 cultural aspects organized into three categories: material culture, social practice & performance, and ritual & ceremony. Designed specifically for video generation, CultureVidBench emphasizes dynamic and multimodal cultural representation, including social interactions, ritual procedure, and culturally appropriate visible text and audio. We evaluate seven representative T2V models through human user studies and MLLM-based automatic assessment across cultural faithfulness, multimodal cultural rendering, semantic adherence, and perceptual quality. Results show that although current models achieve strong semantic adherence and visual quality, they often fail to faithfully capture fine-grained cultural details, particularly for underrepresented regions, rituals, and multimodal cultural cues.

[170] G-Skin: Learning to Bind 3D Gaussians with Generative Visual Priors cs.CVPDF

Yuxin Yao, Kendong Liu, Shiqi Zhou, Jiazhi Xia, Junhui Hou

TL;DR: 本文提出G-Skin，一种用于3D高斯表示的新型生成式蒙皮框架，旨在解决为3D高斯资产绑定任意骨骼拓扑的难题。该方法通过利用2D视觉基础模型提取运动先验，并结合几何感知正则化进行优化，实现了高质量、可泛化的蒙皮权重学习。

Details

Motivation: 动机在于3D高斯溅射缺乏高质量的蒙皮数据集，且现有基于网格的方法难以直接迁移到无明确拓扑连接的高斯表示上，同时数据获取成本高昂，导致泛化能力差。

Result: 大量实验验证了该方法的有效性，在表达性和保真度动画方面展现出明显优势，优于现有最先进方法。

Insight: 创新点在于引入骨架可控的图像生成模型，从2D基础模型中蒸馏运动先验作为伪指导，并结合几何正则化来稳定学习过程，确保了蒙皮权重的平滑性和结构一致性，且能灵活泛化到3D高斯表示的增强变体上。

Abstract: 3D Gaussian Splatting has achieved remarkable success in photorealistic and efficient rendering, leading to a rapid increase in 3D assets represented by 3D Gaussian primitives. Directly rigging these assets with arbitrary skeleton topologies is highly desirable. However, training a feed-forward skinning framework is infeasible due to the lack of high-quality 3D Gaussian rigging datasets. An alternative solution is to transfer mesh-based techniques to 3D Gaussian-based representation, but 3D Gaussian primitives are not restricted to the surface and lack explicit topological connectivity. Moreover, this kind of method suffers from poor generalization to unseen data due to its strong dependence on training data, while acquiring high-quality rigging data is prohibitively expensive. To address this challenging problem, we propose G-Skin, a novel generative skinning framework designed for expressive and high-fidelity animation with 3D Gaussian representation. To overcome this 3D data scarcity, we introduce a skeleton-controllable image generation model leveraging 2D vision foundation models to distill powerful motion priors into pseudo-guidance. Guided by these priors, we formulate an optimization pipeline incorporating geometry-aware regularizations, which stabilizes the learning process and ensures smooth, structurally coherent skinning weights. G-Skin also generalizes flexibly to the augmented variants of 3D Gaussian representation designed to mitigate animation-induced rendering artifacts. Extensive experiments validate the effectiveness of our approach, demonstrating clear advantages over state-of-the-art methods. Project page: https://yaoyx689.github.io/GSkin.html.

[171] ET-Prune: Evidence-Aware Dynamic Budgeting for Visual Token Pruning in Text-Rich MLLMs cs.CV | cs.CLPDF

Zizhong Ding, Junxian Li, Kai Liu, Shaoqiu Zhang, Xiao Xiao

TL;DR: 本文提出了ET-Prune，一种无需训练的视觉令牌剪枝框架，用于文本丰富的多模态大语言模型。它将剪枝问题重新定义为证据分配，根据问题动态确定每个样本所需的令牌数量，并通过渐进式的中层事件将序列调整至该预算，从而在保留关键文本证据的同时减少计算开销。

Details

Motivation: 现有视觉令牌剪枝方法采用固定的令牌比例，不适用于文本丰富的输入，因为关键证据（如特定标签或字段）可能只占一小部分，而盲目剪枝可能丢失这些证据却保留视觉上显著但无关的区域。

Result: 在六个主干模型-基准测试的比较中，ET-Prune在仅使用约一半视觉令牌的情况下，性能在所有剪枝方法中领先或持平。具体地，在OCRBench-v2上，使用Qwen3-VL-8B和InternVL3.5-8B时分别领先最强剪枝基线1.80和0.68个百分点；在MMBench v1.1上，以54.45%的平均令牌保留率达到了0.8467的循环精确匹配准确率，接近完整模型（0.8437）。

Insight: 核心创新在于将剪枝视为基于证据的动态预算分配问题，通过解码器侧的部分查询-键块获取问题相关的证据，并利用证据的不确定性和密度来确定样本特定的令牌下限。这种证据感知的动态预算方法，而非固定比例剪枝，为文本丰富的多模态推理提供了更优的质量-成本权衡。

Abstract: Visual token pruning reduces the inference cost of multimodal large language models, but a fixed token ratio is poorly matched to text-rich inputs. In OCR-centric tasks, decisive evidence can be a small number, label, or field whose relevance is specified by the question; indiscriminate pruning can erase that evidence while retaining visually salient but irrelevant regions. We present ET-Prune, a training-free framework that casts pruning as evidence allocation. It derives question-conditioned evidence from a decoder-side partial query-key block, safeguards text-like spatial regions, and converts evidence uncertainty and density into a sample-specific token floor. Three progressive middle-layer events then move the sequence toward this budget, retaining more tokens for diffuse or text-dense evidence and pruning concentrated evidence more aggressively. At the observed point estimates from one deterministic pass per configuration, ET-Prune leads or ties among pruned methods in all six backbone-benchmark comparisons at roughly half tokens. On OCRBench-v2, it leads the strongest pruned baselines by 1.80 and 0.68 percentage points on Qwen3-VL-8B and InternVL3.5-8B, respectively, while retaining about half of the visual tokens; on MMBench v1.1, it reaches 0.8467 circular exact-matching accuracy versus 0.8437 for Vanilla at 54.45% average visual-token retention. These results show a favorable observed quality-cost trade-off for evidence-aware dynamic budgeting in text-rich multimodal inference.

[172] IDraw: Artist Verification from Digital Drawing Images cs.CVPDF

Nayoung Kim, Nan Jiang, Bangjie Sun, Jaewon Shin, Sojeong Kim

TL;DR: 本文提出了IDraw框架，用于从数字绘画图像中验证艺术家身份。该框架通过从训练艺术家的绘画与平板笔传感器信号配对数据中学习，能够从已完成图像中推断绘画行为，并在比较绘画前抑制绘画内容的影响。

Details

Motivation: 随着数字绘画在线分享增多，可靠的作者身份验证对保护艺术家和解决争议变得重要。然而，验证可能仅依赖于争议绘画和已知艺术家的参考绘画，这面临绘画行为信息缺失和绘画内容相似性干扰的挑战。

Result: 在包含37位艺术家的多模态数据集上评估，IDraw在九个图像编码器骨干网络上均优于标准基于图像的验证方法，将验证错误率降低了高达40%。

Insight: 创新点在于从已完成图像推断绘画行为（如笔压和移动速度）并抑制绘画内容的影响，通过跨艺术家共享信息识别和抑制内容相似性，从而提升验证性能，且无需验证艺术家的传感器数据。

Abstract: As digital drawings are increasingly shared online, reliable authorship verification has become important for protecting artists and resolving disputes. Yet when authorship is questioned, verification may have to rely only on the disputed drawing and reference drawings known to be created by the claimed artist. This setting is challenging for two reasons. First, artist-specific drawing behavior, such as pen pressure and movement speed, is informative but is not available from a completed drawing. Second, similarities in the depicted object or scene can obscure similarities arising from the artist. We propose IDraw, a framework that learns from drawings paired with tablet-pen sensor signals collected from separate training artists. This allows IDraw to infer drawing behavior from completed images during a later authorship dispute, without requiring sensor data from the artist being verified. IDraw also reduces the influence of drawing content by identifying information shared by drawings of the same object across different artists and suppressing it before comparing drawings. To support this approach, we construct the first multimodal dataset for digital drawing authorship verification, containing 1,110 drawings from 37 artists and 14 types of tablet-pen sensor signals. Evaluated on previously unseen artists across nine image-encoder backbones, IDraw consistently outperforms standard image-based verification and reduces verification error by up to 40%. These results demonstrate that inferring drawing behavior from completed images and suppressing drawing content improve digital drawing authorship verification.

[173] Learning Where to Look and How to Judge: Resolution-agnostic Image Quality Assessment with Quality-aware Saliency cs.CVPDF

Hakan Emre Gedik, Shashank Gupta, Alan Bovik

TL;DR: 本文提出了一种名为ReLIQS的无参考图像质量评估（NR IQA）模型，旨在解决现有SOTA方法在分辨率适应性、质量线索保留、多数据集联合训练和计算效率方面的不足。该模型基于CLIP构建，采用多尺度分块驱动架构，通过学习’看哪里’（质量感知显著性）和’如何评判’（潜在质量轴）来预测图像质量分数。

Details

Motivation: 现有深度或多模态NR IQA模型常存在缺陷：如通过激进调整尺寸丢弃关键质量线索、无法跨分辨率泛化、难以在MOS尺度不匹配的异构数据集上联合训练，或计算成本过高。ReLIQS旨在设计一个同时满足分辨率无关、保留原始分辨率线索、支持多主观研究学习且计算高效的模型。

Result: 在涵盖真实、合成和AIGC生成图像，包含多种分辨率和失真类型的基准测试中，ReLIQS在匹配或更低计算成本下，比基于CNN、CLIP和MLLM的强基线模型展现出更好的泛化性能。

Insight: 创新点在于提出了一种分辨率无关的、基于CLIP的多尺度分块架构，并引入了轻量级的’感知重要性估计器’来预测IQA特定的重要性图以选择信息丰富的分块，以及’潜在质量轴模块’来聚合分块嵌入为图像级分数。这实现了’看哪里’与’如何评判’的联合学习，兼顾了模型性能与计算效率。

Abstract: No-reference image quality assessment (NR IQA) has recently benefited from deep and multimodal models, yet many SOTA systems still violate at least one basic requirement: they either discard critical quality cues via aggressive resizing, fail to generalize across resolutions, cannot be jointly trained on heterogeneous IQA datasets with mismatched MOS scales, or require prohibitive computation. We present \textbf{ReLIQS}, a model for \textbf{Re}solution-agnostic \textbf{L}earning for \textbf{I}mage \textbf{Q}uality with \textbf{S}aliency, which is resolution-agnostic, preserves original-resolution quality cues, learns from multiple subjective studies, and remains computationally efficient and budget-adaptive. ReLIQS is a CLIP-based multiscale patch-driven architecture that learns both \emph{where to look} and \emph{how to judge} quality. Fixed-size patches are sampled across multiple resolutions, including the original resolution, and encoded with a CLIP vision backbone. A lightweight Perceptual Importance Estimator then predicts IQA-specific importance maps to select a small set of informative patches, and a Latent Quality Axis Module aggregates their embeddings into a single image-level score. Across authentic, synthetic, and AIGC benchmarks spanning diverse resolutions and distortions, ReLIQS generalizes better than strong CNN-, CLIP-, and MLLM-based baselines with matching or reduced computational cost.

[174] Can Urban Blight Be Accessed with Vision-language Models: A Case Study in Detroit cs.CV | cs.AIPDF

Xiaohao Yang, Aohua Tian, Derek Van Berkel, Xu Qiang, Mark Lindquist

TL;DR: 本研究提出了一种基于开源大型视觉语言模型的多视角框架，用于评估城市衰败中的住宅破损情况。通过结构化提示引导模型评估屋顶完整性、墙体损坏和门窗破损等房屋属性，生成二元评估和破损概率估计。研究在底特律案例中验证了多视角图像提升评估准确性，并采用集成学习方法增强模型鲁棒性，为传统衰败调查提供了低成本、可定期更新的补充方案。

Details

Motivation: 传统住宅衰败调查因人力成本高、周期长而难以大规模持续进行，需要一种可扩展的自动化评估方法辅助城市规划、修复目标定位和公共健康保障。

Result: 在专业人工标注数据上对比评估，结果显示多视角街景图像能提升准确性，集成学习器（基于XGBoost）优于单个基础模型，增强了不同住宅条件和衰败评估场景下的鲁棒性。

Insight: 创新点在于将视觉语言模型与多视角图像结合用于城市衰败评估，通过结构化提示实现细粒度属性分析；客观分析表明集成策略有效融合不同模型的推理优势，为计算机视觉在城市管理中的落地提供了可借鉴的框架。

Abstract: Addressing urban blight has seen increased focus in the past 15 years. Assessing urban blight is essential for guiding urban planning, targeting rehabilitation, and safeguarding public health, yet traditional residential blight surveys are difficult to maintain at scale due to the labor-intensive cost and long-term cycle. This study introduced a scalable framework for estimating residential blight using open-source large vision-language models on multiple views. Structured prompts guided models to evaluate housing attributes, including roof integrity, wall damage, and broken or boarded openings, producing both binary assessments and probabilistic estimates of disrepair. To evaluate the performance of these visual assessments, we compared professional human annotations of these features across several models, including an ensemble stacking approach based on XGBoost and a weighted scoring system. Results showed that (i) multiple street views can contribute to the improvement of accuracy, (ii) large vision-language models have different strengths of inference, (iii) the ensemble learner outperforms individual base models, enhancing robustness across all residential conditions and blight assessment. The practical application of the method allows low-cost tracking and management of housing stock conditions, providing a regularly updatable complement to traditional blight surveys.

[175] HAFI-VLM: A Frequency Perspective for Diagnosing and Enhancing Visual Perception in Vision-Language Models cs.CV | cs.CLPDF

Jin Cui, Chuanchang Su, Jiayi Lu, Xinyue Long, Boran Zhao

TL;DR: 本文提出HAFI-VLM，一种从频率视角诊断和增强视觉语言模型视觉感知能力的方法。该方法通过引入任务条件化的频率通路，在保留预训练语义表征的同时，利用文本调制的跨注意力机制，在视觉编码器的多个深度层次自适应地注入互补的低、中、高频视觉证据，以解决视觉语言模型在需要细粒度视觉证据时不可靠的问题。

Details

Motivation: 动机在于发现视觉语言模型不可靠的一个被忽视的原因：频谱响应僵化。预训练的视觉编码器存在特定于编码器的、层级的频谱响应模式，这些模式在不同图像和任务中变化很小，且在下游微调中改变有限，导致其无法根据当前查询所需的证据来调整频谱提取。

Result: 在LLaVA-1.5和Qwen2.5-VL上的实验表明，该方法在通用VQA、文本丰富场景理解和幻觉鲁棒性方面取得了一致的提升，优于表征级增强方法以及大多数基于分辨率或裁剪的方法，且无需额外的高分辨率编码。

Insight: 创新点在于首次从频率视角诊断VLM的视觉感知瓶颈，并提出了一种层次化自适应频率注入机制。其核心洞察是将频率富集确立为一条独立且有效的、不同于单纯提升分辨率或裁剪的路径，以恢复任务依赖的频谱分配，同时保留语义注意力。

Abstract: Vision-language models (VLMs) remain unreliable when predictions require fine-grained visual evidence. We identify a previously overlooked cause: spectral response rigidity. Despite substantial frequency variation across images and tasks, pretrained vision encoders exhibit persistent, encoder-specific layerwise spectral profiles that change only marginally under downstream fine-tuning. Since pretrained vision encoders only receive images, they cannot adapt spectral extraction to the evidence required by the current query. We therefore propose HAFI-VLM, which introduces a task-conditioned frequency pathway while preserving the pretrained semantic representation. Hierarchical Adaptive Frequency Injection (HAFI) retrieves complementary low-, mid-, and high-frequency evidence at multiple encoder depths using text-modulated, spatially aligned cross-attention. A Visual Enrichment Layer Adapter further recalibrates shallow LLM attention to effectively utilize the enriched visual tokens. Experiments on LLaVA-1.5 and Qwen2.5-VL demonstrate consistent improvements in general VQA, text-rich understanding, and hallucination robustness, outperforming representation-level enhancement methods and most resolution- or cropping-based approaches without additional high-resolution encoding. Mechanistic analyses show that HAFI restores task-dependent spectral allocation while retaining semantic attention, establishing frequency enrichment as a distinct and effective route for improving VLM perception.

[176] LiveLight: Real-time Streaming Video Relighting with Interactive Control cs.CVPDF

Yue Ma, Jiangming Wang, Yucheng Wang, Xilai Wang, Zhiyuan Li

TL;DR: LiveLight是首个基于扩散模型的实时流式视频重光照框架，支持交互式3D光照控制。该框架通过三个关键技术解决了动态光照注入、低计算预算下的高保真生成和连续流式处理等挑战，在真实世界和合成基准测试中实现了SOTA的重光照质量与实时运行速度。

Details

Motivation: 解决现有视频重光照方法无法同时实现实时处理、交互式3D光照控制和连续流式生成的难题，克服动态光照注入、低NFE预算下的质量保持和流式连贯性三大挑战。

Result: 在真实世界和合成基准测试中达到SOTA重光照质量，在实时速度下显著超越离线基线方法，在时序稳定性、光照可控性和用户偏好方面表现优异。

Insight: 创新点包括：1）轻量级适配器直接注入深度感知辐照度图（MPLI）实现精确光照控制；2）几何引导反馈分支在训练时利用冻结几何估计器保障低NFE下的几何一致性；3）渐进滚动窗口策略通过传播中间状态实现任意长视频的时序连贯重光照。

Abstract: We present LiveLight, the first diffusion-based framework for real-time streaming video relighting with interactive 3D lighting control. Achieving this is non-trivial, as it requires overcoming three critical challenges: effectively injecting dynamic 3D lighting into a diffusion model, maintaining high-fidelity generation under an extremely low NFE (Number of Function Evaluations) budget for real-time speed, and facilitating continuous streaming for interactive control. To address these pain points, we propose three key designs. First, for accurate lighting injection, we propose a lightweight adapter that feeds Multi-Plane Light Irradiance (MPLI) conditions-depth-aware irradiance maps encoding 3D lighting geometry-directly into the diffusion backbone. Second, to prevent rendering quality degradation at low NFEs towards real-time distillation, we introduce a geometry-guided feedback branch. This training-time constraint leverages a frozen geometry estimator to enforce depth- and normal-consistent relighting, ensuring geometrically plausible shading without adding inference overhead. Finally, to enable streaming interaction, we develop a progressive rolling-window strategy that maintains a denoising ladder of latent chunks at varying noise levels. By propagating intermediate states, this strategy guarantees temporal coherence and supports arbitrarily long video relighting with per-frame reference refresh. Extensive experiments on real-world and synthetic benchmarks demonstrate that LiveLight achieves state-of-the-art relighting quality while running at real-time speed, significantly outperforming offline baselines in temporal stability, lighting controllability, and user preference. To foster real-time interactive relighting research, we will publicly release our models, training data, and synthetic data generator.

[177] Parameter-Dynamic Adaptive Fusion and Calibration Network for RGBT Tracking cs.CVPDF

Zhaoding Ding, Chenglong Li, Jiandong Jin, Kewei Ying, Wentao Wu

TL;DR: 本文提出了一种用于RGB-Thermal（RGBT）跟踪的参数动态自适应融合与校准网络（PAFCNet），旨在解决现有方法中融合参数固定、无法适应目标状态变化的问题。PAFCNet通过目标自适应超网络（TA-HyperNet）动态生成针对特定目标的融合与校准参数，使跟踪过程能够适应目标外观变化和模态质量波动。具体包括目标感知的参数动态融合模块和动态时空校准模块，以提升融合灵活性和时空表示的可靠性。

Details

Motivation: 现有RGBT跟踪器通常在不同目标和场景中使用固定参数的融合函数，动态架构方法虽通过预定义操作选择提高了灵活性，但仍无法根据目标状态动态调整融合参数。本文旨在解决融合参数缺乏自适应能力的问题，使跟踪能更好地适应目标外观变化和复杂场景条件。

Result: 实验结果表明，PAFCNet在多个RGBT跟踪基准测试中取得了具有竞争力的性能，但摘要未明确说明是否达到SOTA水平或与特定模型相当。

Insight: 创新点在于引入目标自适应超网络（TA-HyperNet）动态生成目标条件参数，实现了参数动态化的融合与校准；从客观角度看，该方法将超网络思想应用于多模态跟踪，通过模板表示驱动参数生成，增强了模型对目标身份和外观变化的适应性，同时通过动态校准缓解了时空信息传播中的噪声累积问题。

Abstract: Existing RGBT trackers typically employ fusion functions with fixed parameters across different targets and scenarios. Although dynamic-architecture methods improve fusion flexibility by selecting among predefined operations, they still cannot adapt the fusion parameters to the evolving target state. To address these issues, we propose a Parameter-Dynamic Adaptive Fusion and Calibration Network (PAFCNet) for RGBT tracking. PAFCNet dynamically generates target-conditioned parameters for multimodal fusion and temporal calibration, enabling the tracking process to adapt to target appearance variations and modality quality fluctuations. Specifically, we introduce a Target-Adaptive Hypernetwork (TA-HyperNet) that leverages template representations, which preserve stable target identity and recent appearance changes with less background interference, to generate target-conditioned parameters for subsequent fusion and calibration. Based on TA-HyperNet, we design a target-aware parameter-dynamic fusion module that uses the generated parameters to modulate the fusion process. This enables the fusion module to adapt to changes in target appearance and complex scene conditions. Furthermore, since spatio-temporal information propagation may accumulate tracking noise, we propose a dynamic spatio-temporal calibration module that employs TA-HyperNet to generate calibration parameters for spatio-temporal tokens. By dynamically calibrating historical information before propagation, the module improves the reliability of temporal representations. Experimental results demonstrate that PAFCNet achieves competitive performance on multiple RGBT tracking benchmarks.

[178] DAVET: Denoising-Aware Visual Evidence Trajectory Allocation for Diffusion Vision-Language Models cs.CV | cs.LGPDF

Yongkang Zhou, Xiang Xia, Cheng Yan, Fan Xu, Wuyang Zhang

TL;DR: 本文提出了DAVET框架，用于降低扩散视觉语言模型（dVLMs）的推理成本。该框架通过分析去噪过程中对视觉证据需求的动态变化，自适应地分配视觉证据，从而减少重复的视觉条件计算开销。

Details

Motivation: 扩散视觉语言模型在迭代去噪生成过程中，每一步都依赖于视觉证据，导致巨大的重复推理开销。分析发现，对视觉证据的需求随去噪步骤强烈变化，这促使了跨步骤自适应分配视觉证据的动机。

Result: 在两个代表性的dVLMs（LLaDA-V和LaViDa）上，在多个视觉理解基准测试中，DAVET实现了平均1.55倍的加速，平均相对性能下降仅为1.86%。

Insight: 核心创新在于将视觉证据视为一种随扩散过程演变的资源，并提出了一个无需训练、基于去噪状态感知的视觉证据轨迹分配策略。该方法将“何时需要多少证据”与“如何构建证据视图”解耦，通过单一视觉编码构建层次化证据视图来实现动态预算分配。

Abstract: Diffusion vision-language models (dVLMs) iteratively denoise masked responses while conditioning each denoising step on visual evidence, making visual conditioning a substantial recurring inference cost. Unlike autoregressive decoding, diffusion generation repeatedly revisits the entire response as uncertainty evolves. Our analysis reveals that visual evidence demand is strongly step-dependent, motivating adaptive allocation across denoising steps. Existing inference acceleration methods operate through decoding-side strategies or visual token compression via pruning and merging, but do not explicitly treat visual evidence as a resource whose demand evolves across the diffusion process. Therefore, we present Denoising-Aware Visual Evidence Trajectory Allocation (DAVET), a training-free framework that allocates visual evidence according to the evolving generation state. Starting from a phase-conditioned evidence trajectory, the proposed allocation policy uses operation demand to set an evidence reserve whose allocation at each denoising step is modulated by trajectory risk. DAVET realizes the resulting budgets through a hierarchy of evidence views constructed from a single visual encoding, separating when and how much evidence is needed from how the evidence views are constructed. Evaluated on two representative dVLMs, LLaDA-V and LaViDa, across multiple visual-understanding benchmarks, DAVET achieves an average speedup of 1.55$\times$ with an average relative performance drop of 1.86%, showing that denoising-aware visual evidence allocation can reduce visual conditioning cost while largely preserving generation quality.

[179] SecondOpinion: Anatomy-Aware Gated Reasoning for Efficient Medical Image Analysis cs.CVPDF

Siam Tahsin Bhuiyan, Rashedur Rahman, Sefatul Wasi, Riyadul Islam, Syoji Kobashi

TL;DR: 论文提出SecondOpinion框架，用于高效医学图像分析。该框架包含一个处理所有病例的快速主网络和一个仅在需要时激活的解剖学引导网络，通过一个名为GateKeeper的门控机制判断是否调用第二网络，类似于临床医生在疑难病例上寻求第二意见。

Details

Motivation: 解决现有医学图像分析深度模型对所有输入使用固定计算量，以及现有双流架构无条件评估两个流（即使单个流已能自信解决）导致的效率低下问题。

Result: 在统一的五类胸部X光数据集和骨盆骨折数据集（包含X光不可见但CT确认的骨折子集）上评估，SecondOpinion达到或超越了先前最先进（SOTA）的性能，同时其解剖学引导流仅在9.23%的胸部X光病例、24.12%的可见骨折和45.71%的不可见骨折病例中被激活，激活率直接反映了任务难度。

Insight: 创新点在于通过一个被显式训练为二元正确性分类器的门控机制（GateKeeper）来监督门控信号，使其基于预测正确性而非无监督的置信度来动态分配计算资源（解剖学推理），实现了计算效率与诊断性能的平衡。这为构建自适应、高效的医学AI模型提供了新思路。

Abstract: Deep learning models for medical image analysis typically apply a fixed amount of computation to every input, regardless of case difficulty. Anatomy-guided dual-stream architectures have been shown to improve diagnostic performance, but they evaluate both streams unconditionally, even on cases a single stream could already resolve confidently. We propose SecondOpinion, a framework in which a fast primary stream processes every case, while a second, anatomy-guided stream is invoked only when GateKeeper, a gating mechanism trained explicitly as a binary correctness classifier, judges that the primary stream’s prediction needs additional scrutiny, much as a clinician might seek a second opinion on a difficult case. When activated, the two streams are combined through a lightweight cross-attention fusion module. We evaluate SecondOpinion on a unified five-class chest X-ray dataset and a pelvic fracture dataset, the latter including a held-out, harder subset of fractures that are invisible on X-ray but confirmed via CT. SecondOpinion matches or exceeds prior state-of-the-art performance on both tasks, while activating its anatomy-guided stream on only 9.23% of chest X-ray cases, rising to 24.12% on visible fractures and 45.71% on invisible fractures, an activation rate that tracks task difficulty directly. These results suggest that supervising a gating signal toward correctness, rather than relying on unsupervised confidence, allows a model to allocate anatomical reasoning where it is actually needed.

[180] UEmbed: Unified Sparse and Dense Multimodal Embeddings cs.CV | cs.AI | cs.CL | cs.IRPDF

Tingyu Song, Mingxin Li, Yanzhao Zhang, Dingkun Long, Pengjun Xie

TL;DR: 本文提出了UEmbed，一种仅解码器的多模态嵌入模型，能够在一次因果前向传播中同时生成稀疏词法和密集表示。该模型通过将词汇表划分为N个不相交子集，并利用N个可学习的特殊令牌的隐藏状态预测各自子集的稀疏权重，从而统一了密集和稀疏嵌入。模型在公开数据上训练，发布了2B、4B和9B三个规模，并在多模态和文本检索基准上展示了有效性。

Details

Motivation: 现有学习稀疏检索（LSR）方法局限于编码器式双向架构，且在多模态设置中严重依赖辅助跨模态模块，限制了其扩展性和统一性。UEmbed旨在解决这些限制，提供一个统一的模型来同时处理稀疏和密集嵌入，并扩展到多模态输入。

Result: 在MMEB-v2基准上，UEmbed-9B的密集和稀疏得分分别为71.8和71.0，优于基于公开数据训练的多模态嵌入模型（如RzenEmbed）。在BEIR基准上，UEmbed与强密集和稀疏基线保持竞争力。

Insight: 创新点在于采用仅解码器架构统一生成稀疏和密集嵌入，通过词汇表分区和特殊令牌机制实现高效的多模态稀疏检索，为检索系统提供了新的范式，兼顾效果、效率和智能体应用。

Abstract: Sparse retrieval underpins modern search systems, from web search to retrieval-augmented generation. Existing work has introduced Learned Sparse Retrieval (LSR) to push beyond exact lexical matching toward richer semantics. Yet LSR has so far remained tied to encoder-style bidirectional architectures, and its extension to multimodal settings still relies heavily on auxiliary cross-modal modules. To address these limitations, we introduce UEmbed (Unified Embedding), a decoder-only multimodal embedding model that produces both sparse lexical and dense representations in one causal forward pass. UEmbed appends N learnable special tokens to the input and partitions the vocabulary into N disjoint subsets. Each token’s causal hidden state predicts sparse weights over its assigned subset, and the N subsets are concatenated into the full sparse vector. Trained on public data, we release UEmbed at 2B, 4B, and 9B scales. UEmbed-9B reaches 71.8 (dense) and 71.0 (sparse) on MMEB-v2, outperforming multimodal embedding models trained on publicly available data (e.g., RzenEmbed). On BEIR, UEmbed also remains competitive with strong dense and sparse baselines. Furthermore, we demonstrate the practical utility of UEmbed across three dimensions: effectiveness, efficiency, and agentic applications. Overall, UEmbed offers a new paradigm: it unifies dense and sparse embeddings in one model, while further extending sparse retrieval to unify text and multimodal inputs.

[181] PartMat: Material-Aware 3D Part Decomposition with a Single Global Latent cs.CV | cs.AI | cs.GRPDF

Guangming Fu, Jin Song, Yiyun Fei, Guoqiu Li, Ruigao Yang

TL;DR: 本文提出了PartMat，一种高效的材料感知3D部件分解流程，它使用单个全局潜在表示来生成多部件几何。该方法通过PartVAE学习统一表示以单次前向传播解码所有材料部件，结合扩散模型和强化学习进行部件生成与优化，并引入稀疏体素流匹配模型进行几何后处理。

Details

Motivation: 现有方法通常基于功能语义分解物体，而非实际3D应用（如室内设计）所需的可编辑材料边界（如织物、木材、金属），且独立生成部件导致计算成本随部件数量线性增长。

Result: 大量实验表明，PartMat在材料感知分解准确性上显著优于现有基线，达到可比的几何质量，同时保持高效推理。

Insight: 创新点包括使用单个全局潜在表示统一编码多部件几何以解耦推理成本与部件数量，以及结合扩散模型、强化学习和稀疏体素流匹配的混合生成与优化流程，实现了材料边界感知的高效分解。

Abstract: Part-level 3D generation has recently attracted increasing attention for producing structured and editable 3D assets. However, existing methods typically decompose objects according to functional semantics rather than the editable material boundaries (e.g., fabric, wood, metal) required in practical 3D applications such as interior design. Additionally, current methods often generate parts independently, causing computational costs to scale linearly with the part count. To address these limitations, we present PartMat, an efficient material-aware 3D part decomposition pipeline that represents multi-part geometry with a single global latent. Given a reference image and a single whole-object geometry, PartMat decomposes the object into parts that follow material boundaries. First, we propose PartVAE to learn such a unified representation and decode all material parts in a single forward pass, thereby decoupling inference cost from the number of parts. Second, with this representation, a diffusion model is trained for part generation and refined via reinforcement learning for accurate material assignment and overlap suppression. Finally, to recover fine-grained geometric details, we introduce a sparse-voxel flow-matching model with part attention for geometry post-processing. Extensive experiments demonstrate that PartMat significantly outperforms existing baselines in material-aware decomposition accuracy and achieves comparable geometric quality, while maintaining efficient inference.

[182] Detail Continuation over a Trustworthy Coarse Scale for Autoregressive Super-Resolution cs.CVPDF

Hongyi Fang, Jiahui Wu, Yichen Yue, Benjia Zhou, Dan Zeng

TL;DR: 本文提出K2N方法，用于改进基于视觉自回归（VAR）模型的生成式超分辨率（GSR）任务。该方法将传统的全路径（1到N）自回归生成过程，重构为从相对可靠的粗尺度（k）开始、仅对更不确定的细尺度进行自回归延续（k到N）的细节延续过程，旨在减少幻觉并提高生成结果的可靠性。

Details

Motivation: 生成式超分辨率中普遍存在幻觉问题，即生成内容可能视觉合理但缺乏对低分辨率输入的支持，或出现结构偏差和不自然纹理。现有VAR方法虽提供从粗到细的尺度生成接口，但仍沿用完整的自回归链，可能导致误差累积，而超分辨率任务中粗尺度信息通常更可靠，因此需要重新思考生成路径。

Result: 实验表明，K2N在标准超分辨率指标上与VARSR基线保持竞争力，同时在专注于评估幻觉的指标上表现出更明显的优势。

Insight: 核心创新在于显式地将生成路径重新规划为“k到N”的细节延续过程，即直接从LR建立可靠的粗尺度状态，仅对剩余更不确定的细尺度进行自回归预测。这为通过尺度层面的路径设计来提高生成式超分辨率的可靠性提供了一个有前景的方向。

Abstract: Hallucination remains a persistent challenge in generative super-resolution (GSR), where reconstructed results may contain visually plausible yet weakly supported content, structural deviations, or unnatural textures with respect to the low-resolution (LR) input. Existing GSR methods have extensively explored the trade-off between perceptual realism and reconstruction fidelity, but the division between preserving reliable coarse-scale information and restoring more uncertain fine details is often handled implicitly within the overall restoration process. Visual autoregressive (VAR) modeling provides a natural opportunity to revisit this issue, as its coarse-to-fine next-scale prediction offers an explicit scale-wise generation interface. However, existing VAR-based SR methods still inherit the original full 1-to-$N$ autoregressive generation path, even though, for super-resolution, coarse-scale information in LR is often relatively more reliable, while long autoregressive chains may accumulate prediction errors. Motivated by these observations, we propose \textbf{K2N}, which reformulates VAR-based SR from full-path generation into a $k$-to-$N$ detail continuation process. Specifically, early coarse-scale states are established directly from LR, while only the remaining finer scales are restored autoregressively. Experimental results show that K2N remains competitive with the VARSR baseline on standard SR metrics, while exhibiting clearer advantages on hallucination-focused evaluation. These findings suggest that explicitly rethinking the generation path in a scale-wise manner can be a promising direction for improving the reliability of generative super-resolution. Our code will be released soon at https://github.com/BRL-SYSU/K2NSR.

[183] DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents cs.CV | cs.AIPDF

Huanyao Zhang, Jiepeng Zhou, Runhao Zhao, Yanzhe Shan, Jiaoyang Chen

TL;DR: 本文提出了DeepVoyager-VL，一个用于长视野多模态深度搜索的框架，旨在解决现有方法中视觉证据在中间推理环节作用不足、缺乏长视野交互设计的问题。该方法通过构建多模态事件图来驱动数据合成，设计主动视觉获取和按需图像加载的智能体框架，并在合成数据上微调模型。

Details

Motivation: 当前多模态大语言模型（MLLMs）的静态参数化知识限制了其处理知识密集型、动态演化的开放世界问题的能力。现有多模态深度搜索方法通常将视觉局限于输入或答案阶段，忽视了其在中间推理中的作用，且缺乏针对长视野交互的设计，导致视觉证据难以驱动持续检索，限制了交互深度和推理跨度。

Result: 在十个多模态搜索基准测试上进行的广泛实验证明了该方法的有效性。

Insight: 创新点在于提出了一个“视觉在环”的搜索范式，通过构建多模态事件图来合成具有中间视觉依赖和长推理链的问题数据，并设计了主动视觉获取的智能体框架，从而将视觉证据深度整合到多轮、长视野的搜索推理过程中，无需强化学习即可通过微调提升模型性能。

Abstract: Multimodal large language models (MLLMs) have advanced visual understanding and reasoning, yet their static parametric knowledge limits their ability to address knowledge-intensive and dynamically evolving open-world problems. To move beyond this limitation, multimodal deep search has emerged as a key direction for open-world information access, evolving from single-turn factual retrieval toward long-horizon, multi-turn search guided by visual evidence. However, existing methods typically confine vision to the input or answer stage, overlooking its role in intermediate reasoning, and lack designs tailored to long-horizon interaction. Consequently, visual evidence rarely drives continued retrieval, constraining both interaction depth and reasoning span. To address these limitations, we propose DeepVoyager-VL, a long-horizon multimodal deep-search framework for vision-in-the-loop search. Specifically, we construct a multimodal event graph to drive data synthesis, yielding problems with intermediate visual dependencies and long reasoning chains. We then design an agent framework for active visual acquisition and on-demand image loading. Finally, we fine-tune models on the synthesized data without reinforcement learning. Extensive experiments across ten multimodal search benchmarks demonstrate the effectiveness of our method.

[184] MoCRA: Mixture of Compositional Rank-1 Atoms for 4K All-in-One Video Restoration cs.CVPDF

Yongcong Wang, Pu Wang, Hingchin Chen, Runci Bai, Yucheng Xin

TL;DR: MoCRA是一种无需退化标签、支持原生4K输出且播放稳定的全合一视频修复方法，通过混合成分化秩-1原子字典，结合粗粒度分支和浅层原生分辨率细化器，在单一模型中同时处理雾霾、雨、传感器噪声和低光照四种退化问题。

Details

Motivation: 解决现实世界视频修复中同时面临的三大需求：无需退化标签、原生4K输出和播放稳定性，现有方法无法联合处理这些挑战，且缺乏相应的配对基准数据集。

Result: 在自建的UHV-4K-AIO基准上，MoCRA在四项任务的平均PSNR上优于11个重训练的图像和视频基线模型，保持与基于光流的视频模型相当的扭曲误差（无需运动估计），并在0.5秒内恢复原生4K视频（最快基线需1.7秒）。

Insight: 创新性地提出频带匹配的成分化条件机制，将计算和监督集中在各退化存在的频带；采用稀疏重组的秩-1原子字典统一条件化粗分支和细化器，无需光流且参数量仅360万，实现了多任务联合高效修复。

Abstract: Real-world video arrives hazy, rainy, dark, or noisy, and a deployable restorer faces three demands at once: no degradation label, native 4K output, and stability in playback. Existing methods answer them separately and break on the joint problem, because per-frame degradation readings flip between frames, downsampled proxies erase the rain and noise they are meant to remove, and dense temporal alignment does not fit 4K memory. No paired benchmark even poses that problem, so we build one. UHV-4K-AIO renders physically modeled haze, rain, sensor noise, and low light over the same 100 clean 4K clips with shared depth and motion, and its construction exposes the split MoCRA is built on: haze and low light survive aggressive downsampling, while rain and noise exist only at native scale. Band-matched compositional conditioning follows, spending conditioning capacity, computation, and supervision in the band where each degradation lives. One dictionary of rank-1 atoms, recomposed sparsely per frame, conditions both a once-per-clip coarse branch and a shallow native-resolution refiner, in 3.6M parameters and with no optical flow. Trained once for all four tasks, MoCRA takes the best task-mean PSNR of eleven retrained image and video baselines, holds warping error at the level of the flow-based video models while never estimating motion, and restores native 4K in under half a second, against 1.7 seconds for the fastest baseline.

[185] Decoupling semantics from vision: A framework for faithful visual-text compression evaluation cs.CVPDF

Yonghan Gao, Zehong Chen, Lijian Xu, Jingzhi Chen, Jingwei Guan

TL;DR: 本文针对当前视觉-文本压缩（VTC）方法（如DeepSeek-OCR）的评价问题，指出现有基于下游任务性能的评估协议因多模态大语言模型（MLLMs）固有的强大语言先验而无法准确衡量文本保真度。为此，作者提出了一个新的评估框架，旨在解耦MLLMs的能力以忠实评估VTC质量，并进一步引入了ZeroSense基准来确保测试样本的低语义相关性。

Details

Motivation: 现有VTC方法的评估严重依赖下游任务性能，但由于MLLMs强大的语言先验，这种评估无法准确衡量压缩过程中的文本保真度，因此需要一种能解耦模型能力、纯粹评估VTC质量的新框架。

Result: 在多个数据集上的大量实验表明，VTC质量与下游任务准确率之间存在显著差异，这凸显了所提出的解耦评估框架的必要性。

Insight: 创新点在于提出了一个解耦语义与视觉的VTC评估框架，并通过引入ZeroSense基准（确保低语义相关性的测试样本）来消除文本依赖，从而保证评估结果纯粹反映VTC质量，不受下游模型语义推理能力的影响。

Abstract: Recent visual-text compression (VTC) methods, typified by DeepSeek-OCR, report impressive high token compression ratios for long-context modeling tasks by leveraging text-to-image rendering. However, existing evaluation protocols heavily rely on downstream task performance. Such evaluation metrics fail to accurately measure text preservation due to the strong inherent linguistic priors of Multimodal Large Language Models (MLLMs). In this work, we introduce a new evaluation framework that decouples MLLMs’ capabilities to faithfully assess VTC quality. Within this framework, we further introduce the ZeroSense Benchmark to ensure low semantic correlation of testing samples. By eliminating textual dependencies, our benchmark guarantees that the evaluation results are purely reflective of VTC quality, unaffected by the semantic inference capabilities of downstream models. Extensive experiments across multiple datasets demonstrate that VTC quality and downstream task accuracy diverge significantly, highlighting the necessity of our decoupled evaluation framework.

[186] PhotoHOI: Synthesizing 3D Hand-Object Interactions from a Single RGB Photograph cs.CVPDF

Zhenhao Zhang, Jiajun Zhang, Wei Min, Yebin Liu

TL;DR: PhotoHOI提出了一种从单张RGB照片和开放词汇语言指令合成三维手-物交互序列的方法。该方法首先利用视觉语言模型解析输入，生成结构化任务描述，然后恢复紧凑的3D场景并规划平滑的物体轨迹，最后通过从大规模功能数据和HOI数据中学习的先验知识合成手部运动。

Details

Motivation: 现有方法通常需要预定义的物体几何、轨迹或任务特定条件，限制了其在自然真实世界输入中的应用。本文旨在解决从单张照片和语言指令合成3D手-物交互这一更实际的问题。

Result: 在GRAB和H2O基准测试上的实验表明，该方法在接触质量和减少穿透方面优于代表性基线。在真实世界照片上的结果进一步展示了更高的任务成功率、场景一致性，以及对未见物体和开放词汇指令的泛化能力。

Insight: 创新点包括：1）利用视觉语言模型将图像和指令解析为结构化任务描述；2）从大规模数据中学习可迁移的任务条件接触和接触条件抓取先验；3）在学习的潜在空间中细化抓取，将优化约束在合理的手部姿态流形上。这为从单张图像生成物理合理的交互序列提供了新思路。

Abstract: Hand-object interaction (HOI) is a fundamental human behavior with broad applications in AR/VR, digital humans, and embodied interaction. Existing methods typically require predefined object geometry, object trajectories, or task-specific conditions, limiting their use with natural real-world inputs. To address this, we study a more practical problem of synthesizing 3D hand-object interaction sequences from a single RGB photograph and an open-vocabulary language instruction, and introduce PhotoHOI. PhotoHOI first uses a vision-language model to parse the input image and instruction into a structured task specification, including the interaction object, target region, and spatial relation. It then recovers a compact task-relevant 3D scene and plans a smooth collision-aware object trajectory based on the recovered object states, support relations, and surrounding scene geometry. To synthesize hand motion that generalizes to real-world photographs and unseen objects, it learns transferable task-conditioned contact and contact-conditioned grasp priors from large-scale affordance and HOI data. The grasp is further refined in a learned latent space, constraining the optimization to a plausible hand-pose manifold. Experiments on GRAB and H2O demonstrate improved contact quality and reduced penetration over representative baselines. Results on real-world photographs further demonstrate higher task success and scene consistency, together with generalization to unseen objects and open-vocabulary instructions.

[187] Transformer Geometry Observatory TGO-III: Semantic Geometry Observatory cs.CVPDF

Kaustubh Kapil, Kishor P. Upla

TL;DR: 本文提出了TGO-III语义几何观测台框架，用于分析ViT-Small/16模型训练过程中表征的语义几何演化。该框架通过线性探针准确率、Fisher比率、类中心距离、局部本征维数和局部PCA秩等多个观测指标，量化了表征判别性的渐进演变。研究发现，类表征逐渐变得线性可分，类中心距离增大，局部流形呈现出结构化、类依赖的几何复杂性，为语义扩展假说提供了实证支持。

Details

Motivation: 随着视觉Transformer的广泛应用，分析其内在表征行为变得日益重要。现有研究多关注token几何和训练动态，而对表征协方差结构的演化和类级几何组织的探索相对不足。

Result: 在ViT-Small/16模型上的分析表明，类表征的线性可分性逐步增强，Fisher判别性提高，类中心距离增大，局部表征流形展现出结构化、类依赖的几何复杂性。这些结果为语义扩展假说提供了实证证据。

Insight: 创新点在于提出了一个多指标集成的语义几何观测框架TGO-III，将流形几何、协方差演化和语义组织直接联系起来，深化了对Transformer训练过程中语义结构涌现的理解。

Abstract: With the widespread adoption of Vision Transformers in modern AI, the need to analyze their inherent representational behavior has become increasingly important. While most existing studies emphasize token geometries and training dynamics, the evolution of representational covariance structures and class-level geometric organization remains comparatively underexplored. In this work, we investigate semantic geometry and class separability as representations evolve across the layers of ViT-Small/16 through TGO-III: Semantic Geometry Observatory. It is a framework designed to analyze the emergence of semantic organization, feature evolution, and class-wise representation geometry throughout training. The framework employs multiple complementary observatories, including Linear Probe Accuracy, Fisher Ratio, Class Centroid Distances, Local Intrinsic Dimension, and Local PCA Rank, to quantify the progressive evolution of discriminative representations. Our analysis reveals that class representations become progressively more linearly separable, Fisher discriminability increases, class centroids move farther apart, and local representation manifolds exhibit structured class-dependent geometric complexity. These observations provide empirical evidence supporting the Semantic Expansion Hypothesis, suggesting that the manifold expansion observed in previous observatories is accompanied by the progressive organization of representations into increasingly discriminative semantic structures. Collectively, TGO-III extends the Transformer Geometry Observatory framework by establishing a direct connection between manifold geometry, covariance evolution, and semantic organization during Transformer training.

[188] Recompute or Reuse? Diagnosing and Mitigating Textual Shortcuts in VLM Self-Reflection cs.CV | cs.AIPDF

Wenxiao Fan, Jingling Fu, Fang Li, Luohang Liu, Yu He

TL;DR: 该论文研究了视觉语言模型（VLM）在视觉证据变化时进行自我反思和修正推理的能力。研究发现，先前的思维链（CoT）中携带证据的推理会形成一种‘文本捷径’，与基于当前图像的视觉重新计算竞争，导致模型错误地重用过时信息而非更新。论文提出了一种名为‘Fresh-State Attention Firewall’的无训练干预方法，有效隔离了新鲜计算与先验CoT，显著提升了模型的视觉更新率并降低了先验答案率。

Details

Motivation: 解决VLM在视觉证据变化时未能修正其推理的问题，探究模型是‘重新计算’还是‘重用’过时信息的内在机制，特别是识别先验思维链中证据性内容如何形成行为竞争的文本捷径。

Result: 在16个VLM上的匹配反事实分析表明，证据性内容是先验CoT影响的最强载体。提出的FSAF方法在五个VLM上测试，将视觉更新率从35.28%提升至53.61%，并将先验答案率从39.22%降低至3.67%。

Insight: 创新点在于揭示了VLM自我反思失败的一个核心机制——先验思维链中的证据性文本形成顽固的‘捷径’，并提出了通过注意力隔离（FSAF）来保护新鲜视觉计算的干预策略。客观来看，该研究对理解VLM的推理鲁棒性和设计更可靠的自我修正机制提供了重要洞见。

Abstract: Vision-language models (VLMs) are expected to revise their reasoning when visual evidence changes. Failures to do so are often attributed to insufficient visual attention or contextual inertia, leaving unclear what models reuse instead of recomputing from the current image. We show that evidence-bearing reasoning in a prior chain of thought (CoT) can form a textual shortcut that competes behaviorally with visual recomputation. Across 16 VLMs, a matched counterfactual analysis identifies evidence-bearing content as the most robust carrier of prior-CoT influence. Removing this evidence-bearing content shifts answer preference more than removing length-matched non-evidence context or the final-answer span, with prior control weakening progressively as more stale evidence is removed. Reordering this evidence also weakens prior control, showing that its organization modulates shortcut strength. Beyond the immediate answer, the shortcut can retain residual influence after answer correction: weakening current-image support shifts preference back toward the prior answer, while repeated prior answers and reused premises arise mainly when the shortcut remains active. To limit this influence, we introduce Fresh-State Attention Firewall (FSAF), a training-free intervention that isolates fresh computation from the prior CoT. Across five VLMs, FSAF raises visual update rate from 35.28% to 53.61% and reduces prior-answer rate from 39.22% to 3.67%. Reliable VLM self-reflection therefore requires more than looking again: fresh visual recomputation must be protected from stale textual reuse.

[189] Assessing the Benefits of Combining Advanced Deep Learning Techniques for Post-Disaster Building Damage Assessment from UAV Imagery cs.CVPDF

Huy Quang Ung, Guillaume Habault, Roberto Legaspi, Hao Niu, Lian Cao

TL;DR: 本文提出了一种混合框架，用于无人机影像的灾后建筑损伤评估，该框架将计算机视觉（CV）模型的检测精度与大型视觉语言模型（LVLM）的推理能力相结合。具体而言，CV模型首先检测建筑物并生成边界框，然后由LVLM进行损伤分类和上下文解释。该方法在两个真实世界基准数据集（RescueNet和FloodNet）上进行了评估，在准确计数完好、部分损坏和完全毁坏的建筑物方面超越了孤立基线，同时仅需有限的标注数据用于检测阶段。

Details

Motivation: 现有CV模型进行灾后建筑损伤评估时，通常需要大量标注数据、跨地理区域和评估策略的泛化能力差，且局限于特定训练任务；而LVLM虽具有强大的推理和泛化能力，但在物体检测和精确边界框生成等低层感知任务上表现不足，且对领域特定任务的有效微调也需要大量数据。

Result: 在RescueNet和FloodNet基准测试中，该框架的最佳组合在准确计数完好、部分损坏和完全毁坏的建筑物方面，比孤立基线提升了高达2.1个R^2点，实现了性能提升。

Insight: 创新点在于将检测与损伤评估解耦的混合框架设计，结合了CV模型的精确检测能力和LVLM的语义推理与泛化优势。从客观角度看，这种模块化方法有效利用了不同模型的优势，在减少对大量标注数据依赖的同时，提升了任务的整体性能，并为处理复杂场景和边缘案例提供了可分析的框架。

Abstract: Rapid and accurate post-disaster building damage assessment is essential, yet remains a challenging task. Unmanned Aerial Vehicle (UAV) imagery offers a timely and high-resolution view of affected areas, but existing Computer Vision (CV) models often demand large annotated datasets, generalize poorly across geographic regions and their assessment policies, and are confined to the specific tasks they were trained for. Large Vision-Language Models (LVLMs) offer a promising alternative through their strong reasoning and generalization capabilities, but fall short on precise, low-level perception tasks such as object detection and accurate bounding box generation. Furthermore, they often require a substantial amount of data for effective fine-tuning on domain-specific tasks. In this paper, we propose a hybrid framework that decouples detection from damage assessment, combining the precision of CV models with the reasoning power of LVLMs. A CV model first detects buildings and generates bounding boxes on the image that are then passed to an LVLM for damage classification and contextual interpretation. We evaluated our framework on two real-world benchmarks: RescueNet and FloodNet. In particular, the best combination under this framework accurately counts intact, partially damaged and completely destroyed buildings, surpassing isolated baselines by up to 2.1 R^2 points, while requiring only limited annotated data for the detection stage. Beyond reporting aggregate gains, we provide a detailed analysis of failure scenarios and edge cases, offering practical insights for practitioners and concrete directions for future work. Our source code and data are publicly available to the research community via the following repository: https://github.com/ungquanghuy-kddi/VLM_GDINO.git

[190] UniMoCa: Unifying Motion and Camera Controls as Visual Proxies for Faithful Human Video Generation cs.CVPDF

Liming Tan, Ye Chen, Hao Zhang, Lirong Qian, Feifei Li

TL;DR: UniMoCa提出了一种统一的视觉代理表示（MCVP），将人体运动和相机轨迹控制统一在视觉空间中，以解决多人场景中人体视频生成中运动和相机控制的异质性问题。该方法通过将3D运动与相机轨迹转换为身份无关的视觉代理，替代了传统的骨架图与相机参数分离的控制方式，从而提升了生成视频的忠实度、时序一致性和相机感知鲁棒性。

Details

Motivation: 现有的人体视频生成方法通常使用视觉运动序列（如骨架图）进行运动控制，而使用相机嵌入进行相机控制，这种异质控制接口使得模型难以协调像素对齐的视觉线索与非视觉几何嵌入，导致运动-相机归因困难且对相机估计误差敏感。

Result: 基于Wan2.2 I2V基准的实验表明，UniMoCa在人体运动控制、相机控制、时序一致性和相机感知鲁棒性方面取得了显著提升，且额外复杂度最小。

Insight: 核心创新在于提出了运动-相机视觉代理（MCVP）这一统一表示，将3D人体运动和相机轨迹转换为可共享的视觉代理，使两者在相同视觉空间中兼容，便于联合推理与编辑。此外，构建的MCVP-Video数据集覆盖了复杂动作、多人交互和多样相机轨迹，为相关研究提供了资源。

Abstract: Controlling human motion and camera movement is essential for faithful human-oriented video generation, yet remains challenging in multi-person scenes with large body motions, occlusions, and dynamic cameras. Existing pipelines typically rely on visual motion sequences, such as skeleton maps, pose maps, or rendered body representations, for motion control, while using camera embeddings for camera control. Such heterogeneous control interfaces force video generation models to reconcile pixel-aligned visual cues with non-visual geometric embeddings, making motion-camera attribution difficult and sensitive to camera estimation errors. We propose \textbf{UniMoCa}, a representation-driven framework that unifies motion and camera controls in visual space. At the core of UniMoCa is \textbf{Motion-Camera Visual Proxy} (\textbf{MCVP}), a mutually-sharable novel representation that converts 3D human motion and camera trajectories extracted from driving videos into an identity-neutral visual proxy. MCVP renders temporally aligned human geometry under the recovered camera trajectory and augments it with explicit camera trajectory markers, replacing heterogeneous visual-parametric controls with distinguishable visual cues. As both control factors are represented in the same visual space, they become mutually compatible rather than heterogeneous, enabling consistent joint reasoning and editing during video generation. We further curate a \textbf{MCVP-Video} dataset covering complex actions, multi-person interactions, and diverse camera trajectories. Experiments based on the Wan2.2 I2V show that UniMoCa achieves substantial gains in human motion control, camera control, temporal consistency, and camera-aware robustness with minimal additional complexity. More details are shown in our Project page: https://tanliming-daniel.github.io/UniMoCa/.

[191] Event ActivityNet: A Large-Scale Simulated-Event Benchmark for Untrimmed Action Understanding cs.CVPDF

Cheng-Yao Hong, Ting-Wei Lin, Yun-Chung Lai, Hua-Wei Lee, Hwann-Tzong Chen

TL;DR: 本文提出了Event ActivityNet，一个基于ActivityNet视频生成的大规模模拟事件流基准数据集，用于解决长时程、未修剪视频的动作理解问题。该数据集包含3263个视频、200个动作类别和106.94小时时长，提供了事件体素表示、时间动作标注和时间戳描述，支持动作识别、事件-语言对齐和在线时序动作定位等任务。

Details

Motivation: 现有数据集多为短时、修剪过的视频片段，而采集具有密集时间标注的原生事件流成本高昂，导致长时程基于事件的动作理解研究不足。

Result: 在渐进式嵌套尺度训练协议下，动作识别的Top-1准确率从52.25提升至66.42，在线时序动作定位的平均mAP从21.7提升至29.0。此外，先在Event ActivityNet上预训练再在原生事件数据上微调，在多种监督预算下均优于仅使用目标数据训练或从头联合训练。

Insight: 创新点在于构建了一个大规模、多任务的模拟事件流基准，并提出了直接从非插值源视频按解码帧顺序生成事件体素的方法，保留了视频级帧率元数据用于近似时间映射，并使用动作中心重建LPIPS作为可重建内容的软诊断指标。这为长时程事件建模提供了一个可扩展的基准，尽管面向部署的结论仍需原生相机评估。

Abstract: Long-horizon event-based action understanding remains underexplored because existing datasets largely comprise short, trimmed clips, while collecting native event streams with dense temporal annotations is costly. We introduce Event ActivityNet, a large-scale simulated-event benchmark derived from human-annotated, untrimmed ActivityNet videos. It comprises 3,263 videos, 200 action classes, and 106.94 hours, with matched 5-bin and 9-bin event-voxel representations, temporal action annotations, and timestamped captions. The benchmark supports annotated-segment action recognition, auxiliary event-language alignment, and causal online temporal action localization. We generate event voxels directly from non-interpolated source videos in decoded frame order, retain per-video rational nominal or average frame-rate metadata for approximate time mapping, and use action-center reconstruction LPIPS as a soft diagnostic of retained reconstructable content. We establish baselines for adaptive event framing, prompt-caption alignment, and event-only, RGB-only, and RGB-event localization. Under a progressive nested-scale training protocol, recognition Top-1 accuracy increases from 52.25 to 66.42, while online temporal localization average mAP improves from 21.7 to 29.0. Moreover, staged Event ActivityNet pretraining followed by native-event fine-tuning consistently outperforms target-only and joint-from-scratch training across multiple supervision budgets. Event ActivityNet provides a scalable benchmark for long-horizon event modeling, although native-camera evaluation remains essential for deployment-oriented conclusions.

[192] StyleForge: Indoor Furniture Styling by Counterfactual Reasoning in a Hypergraph Field cs.CVPDF

Lingwei Dang, Shishuo Shang, Pan Liu, Jiajia Cheng, Ziyan Qiu

TL;DR: StyleForge是一个用于固定布局室内家具风格化的场景级结构化选择框架。它基于动态超图风格场构建，通过反事实推理来评估家具候选的上下文兼容性，从而解决现有方法在场景组合后容易产生形状、材料和颜色冲突的问题。

Details

Motivation: 解决固定布局室内家具风格化中，现有方法因独立检索资产或依赖静态局部关系，导致场景组合后出现形状、材料和颜色冲突的问题。

Result: 在3D-FRONT数据集上的实验表明，StyleForge在家具检索和场景级风格一致性方面达到了最先进的水平，比对象级和场景级检索基线产生了更连贯的固定布局家具布置。

Insight: 创新点在于构建了动态超图风格场来捕获家具间的高阶依赖关系，并采用反事实风格偏好学习来评估候选家具的上下文兼容性；其测试时训练策略仅更新特定房间的候选对数，渐进式地修正跨槽位风格冲突，也是一个可借鉴的思路。

Abstract: Fixed-layout indoor furniture styling requires selecting assets that form a coherent room without changing the prescribed furniture categories, positions, orientations, or scales. Existing approaches typically retrieve each asset independently or rely on static local relations, making them prone to shape, material, and color conflicts after scene composition. We introduce StyleForge, a scene-level structured selection framework built on a dynamic hypergraph style field. A frozen multimodal large language model extracts structured style priors from an open-ended style request and the fixed layout, while StyleForge maintains a learnable candidate distribution for each furniture slot. Conditioned on the target style, the dynamic hypergraph style field adaptively activates and weights layout-induced hyperedges to capture higher-order dependencies among furniture. Counterfactual style preference learning then treats each candidate as a local substitution in the current style field and evaluates its contextual compatibility using Mahalanobis energies. Training alternates between optimizing the style field and the candidate logits. At inference, the model remains frozen and test-time training updates only room-specific candidate logits, progressively correcting cross-slot style conflicts as the global scene context evolves. Experiments on 3D-FRONT demonstrate state-of-the-art furniture retrieval and scene-level style coherence, producing more coherent fixed-layout furniture arrangements than object- and scene-level retrieval baselines.

[193] LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks cs.CVPDF

Ziyu Ma, Hailang Huang, Shun Zou, Yong Wang, Shidong Yang

TL;DR: 本文提出LongHorizon-Harness，一种用于大语言模型（LLM）智能体执行长视野任务的框架。它将长视野任务执行重新定义为任务状态管理问题，通过一个明确的、独立于执行过程的任务状态，以及一个包含管理、执行、审计（MEA）的循环来提升任务执行的可靠性和准确性。

Details

Motivation: 现有智能体框架在长视野任务中，将任务执行、任务状态和完成度评估都置于不断增长的上下文窗口中，导致状态难以追踪，且错误的自我评估会传播到后续决策中。

Result: 在WeaveBench上，LongHorizon-Harness将Qwen~~3.7-Plus的性能从51.8%提升至80.7%；在Terminal-Bench~~2.1上从69.7%提升至77.2%；在OSWorld~~2.0上从2.8%提升至8.3%。此外，在OSWorld2.0子集上，将Claude Opus~~4.7的性能从20.0%提升至34.3%，展示了跨模型、框架和交互领域的一致性能提升。

Insight: 核心创新在于将任务状态显式地独立于执行上下文进行管理，并通过独立的审计环节对环境状态进行事实验证，从而阻断错误传播。其提出的Manage-Execute-Audit（MEA）循环和轻量级AgentAdapter设计，为构建更鲁棒、可组合的长视野智能体系统提供了新思路。

Abstract: Large language model (LLM) agents increasingly undertake long-horizon tasks that require sustained reasoning, tool use, and revision across many interdependent steps. However, existing agent harnesses maintain task execution, task state, and completion assessment within a growing context, making the state difficult to track and allowing incorrect self-assessments to propagate into later decisions. We reformulate long-horizon execution as a task-state management problem and propose LongHorizon-Harness, which maintains the task state explicitly outside execution and updates it only with facts independently verified from the environment. Its Manage-Execute-Audit(MEA) loop uses a manager to maintain the task state and determine the next subtask, a fresh-context executor to perform it, and a read-only auditor to verify the resulting environment state before the next round. A lightweight AgentAdapter supports interchangeable model and harness backends without modifying their native agent loops. LongHorizon-Harness improves Qwen~~3.7-Plus from 51.8% to 80.7% on WeaveBench, from 69.7% to 77.2% on Terminal-Bench~~2.1, and from 2.8% to 8.3% on OSWorld~~2.0. It also raises Claude Opus~~4.7 from 20.0% to 34.3% on an OSWorld2.0 subset, demonstrating consistent gains across models, harnesses, and interaction domains.

[194] SVGEval: A Vision-Grounded Framework for Perceptual-Quality Benchmarking and Evaluation in Text-to-SVG Generation cs.CVPDF

Yiming Wang, Ye Chen, Hanqi Chen, Bingbing Ni

TL;DR: 本文提出了SVGEval，一个基于视觉的多模态基准测试框架，用于评估文本到SVG（可缩放矢量图形）生成任务中的感知质量。该框架通过结合视觉渲染结果和多轮人工标注，系统地评估多模态模型在语义对齐、美学、几何和空间布局等方面的表现，并训练了一个可解释的SVG质量评分器。

Details

Motivation: 现有评估方法多为代码中心论或借用光栅图像指标，无法反映人类感知并忽略了SVG特有的几何和空间构图质量，因此需要建立一个更可靠、与人类感知对齐的SVG质量评估基准。

Result: 在代表性多模态模型上的系统评估表明，模型在语义对齐和美学方面表现较好，但在几何和布局相关判断上存在明显不足。基于SVGEval训练的可解释评分器能输出多维度分数和文本理由，消融实验证明显式的视觉基础和推理监督至关重要。

Insight: 创新点在于提出了首个结合视觉渲染进行人类对齐评估的SVG质量基准，强调了在评估生成内容时考虑渲染结果而非仅代码的重要性，并为改进多模态模型的SVG生成能力提供了实用的评估工具和评分器。

Abstract: Multimodal large models are increasingly used to generate scalable vector graphics (SVG), but reliable evaluation remains underexplored. Existing protocols are often code-centric or borrow raster-image metrics after rendering SVGs, which fail to reflect human perception and overlook SVG-specific qualities such as geometry and spatial composition. We introduce SVGEval, a vision-grounded multimodal benchmark for human-aligned SVG quality assessment. SVGEval explicitly incorporates visual renderings to evaluate whether models can judge the rendered outcome rather than only inspect SVG code, and provides high-quality annotations obtained via multi-round human labeling with expert refinement. Systematic evaluations across representative multimodal models reveal a clear gap: models perform relatively well on semantic alignment and aesthetics, yet struggle on geometry- and layout-related judgments. Building on SVGEval, we train an explainable SVG quality scorer that outputs multi-aspect scores with textual rationales. Ablations show that explicit visual grounding and reasoning supervision are crucial, especially for spatial and geometric assessment. SVGEval offers a reliable testbed and practical scorer for evaluating and improving SVG generation in the era of multimodal models.

[195] Proxy Avatar Meets Low-Rank Caching: Real-Time One-Shot Emotion-Controllable Portrait Animation cs.CVPDF

Haijie Yang, Jindi Bao, Yixuan Dong, Hongliang Zhang, Jian Bi

TL;DR: 本文提出了一种名为Proxy Avatar Meets Low-Rank Caching的级联框架，用于实现实时、单样本、情感可控的肖像动画生成。该方法首先使用基于高斯分布的情感代理化身作为可复用的运动生成器，从音频和情感标签生成富有表现力的驱动视频；然后通过大规模单样本重定向模型将运动适配到任意目标肖像；最后通过低秩缓存技术实现零样本外观复用，显著提升推理效率。

Details

Motivation: 解决现有基于扩散模型的音频驱动肖像动画方法在实时单样本生成和精细情感控制方面面临的挑战，具体包括情感感知运动先验不足以及多步去噪过程中外观计算成本高昂的问题。

Result: 大量实验表明，该方法在情感表现力、身份保持动画质量方面表现更强，并显著降低了推理成本，从而实现了实时的单样本肖像动画生成。

Insight: 创新点在于级联框架设计：1) 引入与目标外观/几何解耦的、可复用的情感代理化身作为运动生成器；2) 提出零样本外观复用与低秩缓存机制，通过缓存初始去噪步的外观特征并用轻量级低秩适配器建模后续特征变化，实现了高效推理。

Abstract: Audio-driven portrait animation has advanced rapidly with diffusion-based generative models, yet real-time one-shot generation with expressive emotion control remains challenging. Existing methods often suffer from insufficient emotion-aware motion priors and expensive appearance computation during multi-step denoising. To address these issues, we propose Proxy Avatar Meets Low-Rank Caching, a cascaded framework for real-time one-shot emotion-controllable portrait animation. Instead of directly generating the target portrait from audio, our method uses a Gaussian-based emotion proxy avatar as a reusable motion generator, which is trained once on a single identity to produce expressive driving videos from audio and emotion labels. Since the proxy avatar only provides motion rather than target appearance or geometry, a large-scale one-shot retargeting model further extracts identity-independent motion from the proxy performance and adapts it to arbitrary target portraits. To improve inference efficiency, we introduce zero-shot appearance reuse with low-rank caching, which caches reference appearance features at the initial denoising step and models subsequent feature variations using lightweight low-rank adapters. Extensive experiments demonstrate that our method achieves stronger emotional expressiveness, better identity-preserving animation, and substantially reduced inference cost, enabling real-time one-shot portrait animation.

[196] AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning cs.CV | cs.AIPDF

Jingqi Tian, Haoji Zhang, Lin Chen, Hongbo Jin, Haonan Xu

TL;DR: 本文提出AdaThinkV，一种用于视频推理的自适应框架，旨在根据问题难度动态调整推理努力，避免在简单问题上浪费解码token。该方法通过强化学习学习是否进行显式推理，无需离线难度标签或手动阈值，并引入Variance Recovery Policy Optimization（VRPO）来处理困难但可解的问题。在统一视频推理评估套件上，AdaThinkV以更少的输出token实现了更高的准确率。

Details

Motivation: 解决链式思维（CoT）推理在视频问答中常浪费解码token于简单问题，而无法自适应调整推理努力的问题，旨在提升token效率。

Result: 在统一的视频推理评估套件上，AdaThinkV取得了40.79的平均准确率，平均使用257.20个输出token，比最强的自适应基线准确率高2.98分，同时减少22.7%的token使用。

Insight: 创新点包括无需外部标签或路由器的自适应推理框架、通过ThinkGain平衡准确率增益与响应长度的效用估计，以及VRPO从困难但可解问题中恢复信息信号的方法，提升了token效率和推理性能。

Abstract: Chain-of-thought (CoT) reasoning can improve performance on difficult video questions but often wastes decoding tokens on simple ones. We study whether a video multimodal large language model can adapt its reasoning effort to each question. We propose AdaThinkV, an adaptive framework for video reasoning that learns whether to reason explicitly without offline difficulty labels, manually tuned confidence thresholds, or an external router. During reinforcement learning, AdaThinkV samples matched rollouts in explicit reasoning and direct answering modes for each prompt. ThinkGain estimates the prompt-level utility of explicit reasoning by balancing its accuracy gain against additional response length, providing supervision for both conditional response generation and autonomous mode selection. For difficult prompts, limited rollout exploration can yield groups in which every response is unsuccessful and accuracy rewards show little variation, providing insufficient signal for learning. We therefore introduce Variance Recovery Policy Optimization (VRPO), which retains and progressively expands these groups to recover informative signals from prompts that are difficult yet solvable. At inference, AdaThinkV selects a response mode and generates the response in a single autoregressive sequence. Across a unified suite of video reasoning evaluations, AdaThinkV achieves a mean accuracy of 40.79 with an average of 257.20 output tokens, outperforming the strongest evaluated adaptive baseline by 2.98 points while using 22.7% fewer tokens. Project page: https://trilarflagz.github.io/AdaThinkV/

[197] DiffPrune: differentiable information throttling for token pruning in vision-language models cs.CVPDF

Landi He, Mingde Yao, Shawn Young, Lijian Xu

TL;DR: 本文提出了DiffPrune，一种用于视觉语言模型（VLM）中视觉令牌剪枝的可微分信息节流方法。该方法通过向令牌注入方差保持噪声来直接学习令牌的重要性分数，避免了传统方法依赖Gumbel-Softmax松弛选择带来的不稳定代理路径问题。在推理时，使用学习到的分数进行硬性Top-K剪枝，在十个VLM基准测试中，能以仅0.69毫秒的推理开销，在保持96.5%全模型精度的同时，将LLM预填充速度提升2.85倍。

Details

Motivation: 现有视觉令牌剪枝方法通常依赖Gumbel-Softmax在训练中近似离散选择，这使得重要性分数依赖于松弛剪枝算子的行为，而非直接与信息损失后果挂钩，导致不稳定。本文旨在设计一种方法，让令牌分数具有直接意义，并避免不稳定的代理优化路径。

Result: 在十个VLM基准测试上，DiffPrune在保持96.5%全模型精度的同时，将LLM预填充阶段加速了2.85倍，且仅带来0.69毫秒的推理开销。

Insight: 核心创新在于提出了可微分信息节流器（Information Throttler），它通过向令牌注入方差保持噪声来直接模拟信息衰减过程，使得损失函数能通过实际的信息节流路径进行反向传播，从而让评分器直接学习到信息损失对任务的影响，避免了松弛选择的代理路径。这是一种将软性训练与硬性推理解耦的优雅方法。

Abstract: Visual token pruning reduces the computational cost of Vision-Language Models (VLMs) by removing redundant visual tokens. The key is to learn a score that measures whether a token is useful. Existing methods typically rely on Gumbel-Softmax to approximate discrete selection during training. Such selectors make the score depend on the behavior of a relaxed pruning operator, not directly on the consequence of information loss. In this paper, we propose DiffPrune, which gives token scores a direct meaning. During training, DiffPrune keeps all tokens and weakens each token’s information according to its score. If weakening a token hurts the task, the scorer is pushed to protect it; if not, the token can receive a lower score. Because the loss is differentiated through this actual information-throttling path, the scorer avoids the unstable surrogate path of relaxed token selection. DiffPrune implements this idea with an Information Throttler, which injects variance-preserving noise into visual tokens, where high-score tokens remain close to their original representations, while low-score tokens carry less original information. At inference, the throttler is removed, and hard top-K pruning is applied using the learned scores. Across ten VLM benchmarks, DiffPrune retains 96.5% of full-model accuracy while accelerating LLM prefill by 2.85x, with only 0.69 ms inference overhead. Code will be publicly available.

[198] ASTRA: Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment cs.CVPDF

Junyu Zhu, Hao Zhu, Xinzhuo Zhang, Hongdong Li, Zhan Ma

TL;DR: 论文提出了ASTRA框架，用于解决多相机动态3D场景重建中的时间异步问题。该方法通过引入2D运动轨迹作为与纹理无关的显式监督信号，联合优化时间偏移和动态3D表示，从而克服了现有基于光度监督方法在纹理匮乏区域和复杂运动下的局限性。

Details

Motivation: 现实世界中多相机捕获设备存在时间异步，导致动态3D重建出现严重的运动模糊和几何伪影。现有基于光度匹配的方法在大偏移和复杂运动下提供的时序线索较弱，存在纹理诱导崩溃和形变诱导耦合两大瓶颈。

Result: 在不同动态高斯泼溅骨干网络上的大量实验表明，即使在高达25帧偏移的严重异步情况下，ASTRA也能保持高频空间细节和强鲁棒性，实现了约1.4 dB的PSNR提升，将时间偏移MAE降低了54.0%，并将同步成功率提高了近四倍。

Insight: 核心创新在于使用2D运动轨迹作为显式的、与纹理无关的时序对齐监督信号，并结合动态和确定性掩码来抑制不可靠的轨迹约束。这为解决异步重建中因纹理和形变导致的耦合问题提供了新思路。

Abstract: Dynamic 3D scene reconstruction has achieved remarkable success under the assumption of strictly synchronized multi-camera inputs. However, in real-world scenarios, temporal asynchrony among capturing devices remains a critical challenge, leading to severe motion blur and geometric artifacts. Existing asynchronous reconstruction methods typically estimate temporal offsets through photometric supervision, but appearance matching provides weak temporal cues under large offsets and complex motions. We attribute this limitation to two major bottlenecks: texture-induced collapse, where low-texture regions provide nearly vanishing alignment signals, and deformation-induced coupling, where temporal errors are absorbed into distorted geometry or motion rather than being explicitly corrected. To address these issues, we propose ASTRA (Asynchronous Spatio-Temporal Reconstruction via Trajectory Alignment), a framework that introduces 2D motion trajectories as explicit, texture-agnostic supervision for asynchronous dynamic reconstruction. Instead of synchronizing cameras solely through rendered color residuals, ASTRA jointly optimizes temporal offsets and dynamic 3D representations by aligning the projected motion of reconstructed 3D points with observed 2D trajectories, while using dynamic and certainty masking to suppress unreliable trajectory constraints. Extensive experiments on different dynamic Gaussian Splatting backbones show that ASTRA preserves high-frequency spatial details and sustains strong robustness even under severe asynchrony with up to 25-frame offsets, achieving approximately 1.4 dB PSNR improvement, reducing temporal-offset MAE by 54.0%, and nearly quadrupling the synchronization success rate.

[199] RSVideo: Are Your Vision-Language Models Ready for Remote Sensing Videos? cs.CVPDF

Hongjie Zhou, Shiqin Wang, Haoyang Chen, Haonan Guo, Di Wang

TL;DR: 本文提出了RSVideo-10K数据集和RSVideo-Bench基准，用于评估视觉语言模型在连续遥感视频理解上的能力，并揭示了现有模型在局部证据恢复、短时状态跟踪和空间关系利用上的不足。为解决这些问题，作者进一步提出了一个基于强化学习的小目标时空聚焦框架RSVideo，该框架能跨帧选择问题相关区域并抑制冗余背景，在多个开源视觉语言骨干网络上取得了显著的性能提升。

Details

Motivation: 现有视觉语言模型主要针对单张图像或长时间跨度的离散观测，缺乏一个统一的评估设置来评测模型对连续遥感视频的理解能力，而遥感视频能捕捉目标属性变化、短期活动和场景演化等动态信息。

Result: 在提出的RSVideo-Bench基准上评估了26个开源视觉语言骨干网络，结果显示现有模型表现不佳。提出的RSVideo框架在InternVL3.5-14B上取得了9.01%的最大绝对提升，并在Qwen3.6-27B上达到了40.63%的最高准确率。

Insight: 论文的核心创新点在于构建了首个针对连续遥感视频理解的大规模数据集和评估基准，并提出了一个新颖的、基于强化学习的小目标时空聚焦框架，该框架通过跨帧选择关键区域来有效提升模型对动态遥感场景的理解能力。

Abstract: Remote-sensing videos enable real-time observation of changes in target attributes, short-term activities, and scene evolution. They record motion, actions, interactions, and scene changes that cannot be captured by isolated images. Existing models primarily target single images or discrete temporal observations spanning a long time range. However, a unified evaluation setting for assessing vision-language models on continuous remote-sensing video understanding remains lacking. We introduce RSVideo-10K, a remote-sensing video dataset comprising 10,773 instances, 1.47 million frames, and 17.02 hours of footage, containing both unmanned aerial vehicles and satellite platforms. Its fixed evaluation benchmark, RSVideo-Bench, contains 2,731 test instances and evaluates two complementary aspects of remote-sensing video understanding: L1 Perception and L2 Reasoning, spanning seven capability groups and 17 tasks. Evaluations show that current vision-language models still struggle to recover small local evidence, track short-lived states, and use scene-constrained spatial relations. Based on this analysis, we further propose RSVideo, a reinforcement learning framework for small-target spatiotemporal focusing that selects question-relevant regions across frames and suppresses redundant background tokens. RSVideo achieves a maximum absolute improvement of 9.01% with InternVL3.5-14B and attains the highest accuracy of 40.63% with Qwen3.6-27B across 26 open-source vision-language backbones.Codes will be available at https://github.com/HongjieZhou0329/RSVideo.

[200] TBSG-Net: Temporal Bipartite Scene Graph Network for Fine-Grained Video Moment Retrieval cs.CV | cs.AIPDF

Ji Huang, Yongsheng Dai, Tianyu Ren, Barry Devereux, Hui Wang

TL;DR: 本文提出了TBSG-Net，一种基于动态场景图（DSG）的无候选框视频片段检索模型，旨在解决静态场景图（SSG）在视频表示中缺乏时间动态性和显式时间跨度编码的问题。

Details

Motivation: 现有基于静态场景图的视频片段检索方法存在两个固有局限：一是无法建模对象及其关系随时间的变化，导致丢失关键的时间依赖性；二是未能显式编码关系的持续时间，使得精确定位变得困难。

Result: 实验表明，TBSG-Net在所有基线模型上取得了显著提升，在视频片段检索任务上实现了性能的实质性改进。

Insight: 主要创新点在于首次将动态场景图引入无候选框视频片段检索，并设计了动态场景图嵌入模块，通过时间二分场景图构造器和混合编码器（Transformer变体与图卷积网络结合）来显式编码时间跨度并捕获更全面的时空表示。

Abstract: Recent advances in proposal-free Video Moment Retrieval (VMR) have highlighted the effectiveness of Static Scene Graphs (SSGs). By modeling objects and their relations at the frame level, SSGs enrich retrieval-oriented video representations. However, integrating SSGs into VMR remains constrained by two inherent limitations: (1) Lack of Temporal Dynamics. SSGs fail to model how objects and their relationships evolve over time, leading to the loss of essential temporal dependencies in video representation; and (2) Lack of Explicit Temporal Span Encoding. SSGs do not explicitly encode the duration of relationships, making precise localization challenging. To address these limitations, we propose Temporal Bipartite Scene Graph Network (TBSG-Net)—to the best of our knowledge, the first Dynamic Scene Graph (DSG) based proposal-free VMR model. Specifically, TBSG-Net leverages DSGs to extract event-centric graph representations of the input video, enabling the modeling of object interactions over time and thus addressing limitation (1). These DSGs are then processed by a novel Dynamic Scene Graph Embedding (DSG-E) module to capture both Temporal Span and spatio-temporal information. First, DSG-E utilizes a TBSG Constructor to transform DSGs into TBSGs, explicitly encoding objects, relationships, and time spans to tackle limitation (2). Second, the resultant TBSGs are passed into a hybrid TBSG Encoder that integrates a Transformer variant for global event modeling and a Graph Convolutional Network for detailed relational reasoning, ultimately producing a more comprehensive spatio-temporal representation. Our experiments demonstrate substantial improvements of TBSG-Net over all baselines.

[201] Deep Multimodal Fusion Detection through Spatial Mask and Channel Fusion cs.CV | cs.MMPDF

Guandi Wang, Ming Li, Yunsen Xing, Junle Liu

TL;DR: 本文提出了一种注意力驱动的互补重采样框架，用于提升跨模态目标检测的鲁棒性。该方法通过共享通道空间注意力机制，引入语义掩码交换来主动混合模态边界，并采用可学习的通道竞争进行特征采样与聚合。

Details

Motivation: 现有特征级融合方法主要在双骨干架构中对两种模态进行加权和统一表示，这可能导致单模态统计特性的过拟合或过度专业化，因此需要一种更鲁棒的跨模态融合方法。

Result: 在多个数据集上的实验表明，该方法有效且性能与现有最先进方法相当。

Insight: 创新点在于通过语义掩码交换强制骨干网络学习不依赖固定模态标签的泛化特征，以及可学习的通道竞争机制实现通道级特征采样与聚合，提升了跨模态融合的鲁棒性。

Abstract: Deep multimodal fusion for object detection has demonstrated good performance through mining modal characteristics. However, existing feature-level fusion methods mainly weigh between two modalities and unify them in a unified representation space. This can lead to overfitting or over-specialization of the statistical properties of a single modality within a dual-backbone architecture. This paper proposes an Attention-Driven Complementarity Resampling framework for robust improvement of cross-modality object detection. Based on a shared channel spatial attention mechanism, we first introduce the semantic mask exchange to actively mix the boundaries of the modalities during the training phase, forcing the backbone network to learn generalized features without relying on fixed modal labels. Then we propose a learnable channel competition to sample and aggregate features in a channel-wise and learnable way. Our experiments on multiple datasets demonstrate that the proposed method is effective and yields competitive results among existing state-of-the-art approaches. The source code is provided in the supplementary material.

[202] MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing cs.CV | cs.MMPDF

Zitong Xu, Huiyu Duan, Xinyun Zhang, Weifei Xiong, Tianyi Zheng

TL;DR: 该论文针对多源图像编辑（MIE）任务缺乏有效评估基准的问题，提出了首个大规模多源图像编辑基准MIE-Bench和基于多模态大语言模型的评估模型MIEScore。MIE-Bench包含3000个编辑实例和超过10.8万个人类主观评分，MIEScore通过技能优化和多维监督微调实现了与人类偏好对齐的SOTA性能，并具有良好的泛化能力。

Details

Motivation: 现有的图像编辑评估基准和方法主要集中于单图像编辑任务，忽视了更具挑战性的多源图像编辑（MIE）场景，因此迫切需要建立一个全面且与人类对齐的MIE评估基准。

Result: 在提出的MIE-Bench基准上，MIEScore在与人偏好对齐方面达到了最先进的性能，并在其他图像编辑质量评估数据集上表现出良好的泛化能力。

Insight: 论文的核心创新在于构建了首个大规模、细粒度标注的多源图像编辑基准MIE-Bench，并提出了一个通过技能优化和多维监督微调增强的MLLM评估模型MIEScore，为MIE任务提供了系统化、可量化的评估方案。

Abstract: Recent advances in unified multimodal models have significantly improved text-guided image editing abilities. In particular, models such as Nano-Banana-Pro and GPT-Image-2 demonstrate emerging capabilities in multi-source image editing (MIE), including tasks such as object synthesis, person-background composition, and cross-image style fusion. However, existing benchmarks and image editing assessment (IEQA) methods remain primarily focused on single-image editing tasks and largely overlook the more challenging setting of MIE. This highlights the urgent need for a comprehensive and human-aligned benchmark for MIE. To this end, we introduce MIE-Bench, the first large-scale multiple image editing benchmark with fine-grained human preference annotations. Specifically, MIE-Bench includes 3,000 editing instances across 16 tasks, each involving more than two source images and an editing prompt, together with 36K edited images produced by 12 state-of-the-art editing models and over 108K mean opinion scores (MOSs) covering visual quality, instruction following, and attribute preservation. Based on MIE-Bench, we propose MIEScore, a multimodal large language model (MLLM)-based evaluation model enhanced with skill optimization and multi-dimensional supervised fine-tuning, to provide human-aligned feedback for MIE. Extensive experiments show that MIEScore achieves state-of-the-art performance in aligning with human preferences and generalizes well across other IEQA datasets. Both the dataset and the model are available at https://github.com/IntMeGroup/MIEScore.

[203] Same Semantics, Different Paths: Self-Improving Alignment for Vision-Text Compression cs.CVPDF

Tianyu Liang, Xiangxi Zheng, Yilin Wang, Dongxing Mao

TL;DR: 本文提出SPIRAL框架，通过自监督对齐解决视觉文本压缩（VTC）中因视觉编码器预训练差异导致的渲染图像与原生文本语义表示不一致的问题。该方法结合了token级的策略蒸馏和序列级的偏好优化，在VTCBench上显著提升了模型性能，接近原生文本输入水平。

Details

Motivation: VTC将长文本渲染为图像并通过视觉编码器压缩，但视觉编码器主要针对自然图像预训练，捕获的是视觉属性而非语言语义，导致渲染图像表示与原生文本表示存在跨路径不一致，这是VTC性能的关键瓶颈。

Result: 在VTCBench上，SPIRAL将Qwen3-VL-8B的总体分数从35.10提升至54.02，接近原生文本输入性能（55.60），并超越了规模大30倍的模型；该方法在检索和推理任务上表现出互补优势，且泛化到领域外基准测试。

Insight: 创新点在于提出无需外部监督的自对齐框架SPIRAL，通过双粒度（局部忠实度与全局连贯性）对齐解决VTC的语义偏差问题；客观来看，该方法揭示了VTC性能提升的核心在于将视觉表示重新对齐到文本语义，且自监督设计具有高效性和可扩展性。

Abstract: Vision-Text Compression (VTC) renders long texts into images and encodes them through the vision encoder (ViT), compressing thousands of text tokens into far fewer visual tokens. However, since the ViT is pretrained predominantly on natural images, it captures visual attributes (glyphs, font sizes, layout) rather than linguistic semantics, causing rendered-image representations to diverge from native-text representations. We term this cross-path inconsistency and show, via rendering perturbation experiments, that it is a critical yet overlooked bottleneck of VTC. We propose SPIRAL (Self-improving Path Integration and Realignment), a self-supervised alignment framework that closes this gap using only the model’s own text-path behavior as supervision, requiring no external teachers or additional annotations. SPIRAL operates at two complementary granularities: token-level on-policy distillation (OPD) for local faithfulness, and sequence-level preference optimization (DPO) for global coherence. On VTCBench, SPIRAL improves the overall score of Qwen3-VL-8B from 35.10 to 54.02, approaching the native text-input performance (55.60) and outperforming models up to 30x larger. The two granularities exhibit complementary strengths: OPD excels at retrieval and is sample-efficient, while DPO is stronger on reasoning and memory and scales better with data. SPIRAL’s benefits also generalize to out-of-domain benchmarks, confirming that effective VTC hinges on aligning rendered-image representations back to native-text semantics.

[204] Messages, Not Tokens: Grounded Coresets for Faithful VLM Compression cs.CVPDF

Long Qian, Jiaqi Wei, Bingke Zhu, Yingying Chen, Jinqiao Wang

TL;DR: 本文提出了一种名为Grounded Message Coreset Pruning (GMC)的训练免费方法，用于对视觉语言模型(VLMs)中的视觉token进行压缩。该方法将忠实压缩问题重新定义为构建一个紧凑的核心集来保留解码器所需的消息，而非独立选择重要token。它通过联合考虑查询、外观和坐标感知证据来分配支持，并将被丢弃状态的信息传输到选定的代表token中。

Details

Motivation: 现有基于分数的方法为每个视觉token分配独立的重要性分数并保留Top-K，但文本查询消耗的是来自整个视觉群体的集体、有符号的注意力消息，而非孤立的图像块。这导致Top-K集合可能重复覆盖显著区域、遗漏稀疏但互补的证据，并丢弃被移除群体所携带的信息。

Result: 在多个VLM家族和多样化基准测试上的实验表明，该方法性能强劲。例如，在Qwen2.5-VL-7B模型上，GMC-H2使用减少80.2%的视觉token，保留了97.78%的相对平均能力；GMC-L16甚至达到了100.36%。受控干预验证了集体支持和群体实现共同驱动了这些性能提升。

Insight: 核心创新在于将忠实视觉压缩重新定义为构建一个用于解码器消息的紧凑核心集，并提出了一个无需训练的联合优化框架。该方法将压缩分解为两个耦合组件：选择能覆盖所需消息模式的载体，以及在这些载体上实现有符号的群体消息。这超越了传统的独立token评分方法，考虑了消息的集体性和符号性，从而更忠实地保留了信息。

Abstract: Modern vision language models (VLMs) turn high-resolution images into long sequences of visual tokens. Every token traverses the language decoder and persists in its prompt KV cache, inflating inference cost and motivating aggressive visual compression. Existing score-based methods assign each token an independent importance score and retain the Top-K. However, text queries consume collective, signed attention messages from the visual population, not isolated patches. Consequently, equally sized Top-K sets can repeatedly cover one salient region, omit sparse but complementary evidence and discard information carried by the removed population. We therefore formulate faithful visual compression as constructing a compact coreset for decoder messages, and introduce our training-free Grounded Message Coreset Pruning (GMC) which jointly allocates support across query-grounded, appearance, and coordinate-aware evidence, then transports discarded states into selected representatives at their original multimodal positions before physical compaction and native attention resume. This decomposes faithful compression into two coupled components, including selecting carriers that cover the required message modes and realizing the signed population message on those carriers. We further derive bounds connecting their errors to signed-message distortion, visual innovation, and candidate-margin stability. Experiments across multiple VLM families and diverse benchmarks demonstrate strong performance, with GMC-H2 retaining 97.78% Full-relative mean capability on Qwen2.5-VL-7B using 80.2% fewer visual tokens, while GMC-L16 reaches 100.36%. Controlled interventions verify that collective support and population realization jointly drive these gains.

[205] Two Sides of the Same Coin: Co-Evolving Search for Cross-Task Attacks on Vision-Language Models cs.CVPDF

Xuanhui Lin, Junhao Dong, Mingrong Gong, Yucheng Chen, Xinghua Qu

TL;DR: 本文提出了一种基于进化计算的跨模态对抗攻击框架，用于统一视觉语言模型（VLMs）。该框架通过协同演化搜索文本和视觉空间：在文本侧，演化围绕源类别表示的硬负语义嵌入以提供多样化的跨模态排斥；在视觉侧，维持一个对象区域扰动种群，结合基于动量的梯度更新与进化选择、变异和交叉，以更可靠地探索多个可行轨迹。联合优化语义负引导和局部化扰动，生成的对抗样本能在视觉语言任务中一致地将源对象语义向目标类别偏移。

Details

Motivation: 现有对抗攻击通常遵循单轨迹梯度优化或任务特定目标，限制了搜索空间探索和跨任务可迁移性。本文旨在解决统一视觉语言模型在跨任务攻击中的这些局限性。

Result: 在Florence-2、OFA和UnifiedIO-2等模型上的实验表明，该框架在图像描述、目标检测、区域分类和目标定位等任务上均表现出强大的整体攻击性能。消融研究进一步验证了文本侧语义演化和图像侧扰动演化的互补有效性，以及框架的效率和跨任务可迁移性。

Insight: 创新点在于提出了一种协同演化搜索框架，将文本语义空间的演化与视觉扰动空间的演化相结合，通过进化计算增强搜索多样性和可靠性。理论分析表明，与单轨迹优化相比，该协同演化搜索保持了扰动可行性，防止了最佳适应度退化，并增加了到达高边界对抗区域的概率。

Abstract: Vision-language models (VLMs) exhibit strong generalization across multimodal tasks but remain vulnerable to adversarial perturbations. Existing attacks typically follow single-trajectory gradient optimization or task-specific objectives, limiting search-space exploration and cross-task transferability. We propose an evolutionary-computation-guided cross-modal attack framework for unified VLMs. The framework adaptively searches both textual and visual spaces. On the textual side, it evolves hard negative semantic embeddings around the source-category representation to provide diverse cross-modal repulsion. On the visual side, it maintains a population of object-region perturbations and combines momentum-based gradient updates with evolutionary selection, mutation, and crossover to more reliably explore multiple feasible trajectories. Jointly optimizing semantic negative guidance and localized perturbations generates adversarial examples that consistently shift source-object semantics toward target categories across vision-language tasks. Theoretical analyses show that the co-evolutionary search preserves perturbation feasibility, prevents degradation of the best observed fitness, and increases the probability of reaching high-margin adversarial regions compared with single-trajectory optimization. Experiments on Florence-2, OFA, and UnifiedIO-2 demonstrate strong overall attack performance across image captioning, object detection, region categorization, and object localization. Ablation studies further verify the complementary effectiveness of text-side semantic evolution and image-side perturbation evolution, as well as the framework’s efficiency and cross-task transferability.

[206] HiResNets: Native Full-HD Video Recognition with Foveal Residual Streams cs.CV | cs.PFPDF

Shivani Mall, Swarnim Jain, Joao F. Henriques

TL;DR: 本文提出了一种名为HiResNets的新型残差网络架构，旨在高效处理高分辨率视频识别任务。该网络通过引入对数极坐标图像扭曲操作，使卷积块仅对残差流中的高分辨率缓冲区进行读写，从而避免了传统方法中因图像分辨率增加而导致的计算和内存二次增长问题。

Details

Motivation: 当前图像和视频识别领域的进展往往以增加内存和计算成本为代价，尤其是卷积网络和视觉Transformer中基于网格采样的方法会随分辨率呈二次方增长。本文旨在设计一种能够快速处理极高分辨率视频的网络架构，以解决这一效率瓶颈。

Result: 实验表明，HiResNets在困难的自中心（egocentric）视频识别任务上表现出优越性能，特别是在涉及小物体和细粒度识别的场景中。该模型能够像人类视觉一样学习对场景进行注视（foveate）。

Insight: 核心创新在于将残差网络的残差流用作高分辨率缓冲区，并通过对数极坐标扭曲操作实现自适应聚焦，仅在焦点附近保持极高分辨率，从而理论上消除了分辨率对残差流的二次依赖。这种机制模拟了生物视觉中通过眼动构建完整画面的过程，为高效高分辨率视频处理提供了新思路。

Abstract: Much of the recent progress in image and video recognition has come at the cost of memory: larger models, increased resolution, and longer temporal contexts. An inevitable component is the quadratic (or larger) growth of memory and compute based on image resolution, which is a property of the grid sampling used in convolutional networks and vision transformers. In this work we study residual networks whose convolutional blocks have logarithmic-square growth instead, enabling them to process very high-resolution video quickly. The key insight is to use a residual architecture’s residual stream as a high-resolution buffer, to which convolutional blocks only read and write via log-polar image warp operations. Layers adaptively focus on different parts of each frame, with very high resolution only near the focus point. A complete high-resolution representation is built up in the residual stream, analogous to eye saccades creating a complete picture in biological vision, and a theoretical construction is presented that eliminates the quadratic dependency of the residual stream resolution. Experiments demonstrate that our proposed HiResNets learn to foveate around scenes similarly to human vision, and have superior performance in difficult egocentric video recognition tasks, especially egocentric video with small objects and fine-grained recognition.

[207] Quaternion Tensor Modeling for Joint Color-Polarization Demosaicking cs.CVPDF

Yanqing Song, Jifei Miao, Chaoqian Li, Rui Mei, Kit Ian Kou

TL;DR: 本文提出了一种基于四元数张量和斯托克斯域总变分正则化的联合颜色-偏振去马赛克方法，用于解决分焦平面颜色偏振相机中固有的稀疏采样问题。该方法将四个偏振方向的图像编码为三阶四元数张量，利用低秩先验捕捉全局结构冗余，并通过斯托克斯域自适应正则化分离强度、偏振和残差变化，从而有效减少去马赛克伪影。

Details

Motivation: 分焦平面颜色偏振相机能够快照获取颜色偏振马赛克图像，但其固有的稀疏采样模式使得颜色偏振去马赛克问题严重不适定。现有方法未能充分利用偏振通道间的相关性以及偏振成像固有的物理约束，导致明显的去马赛克伪影。

Result: 大量实验表明，所提方法在去马赛克性能上表现优异，优于现有方法，有效减少了伪影并提升了重建质量。

Insight: 创新点在于将四元数张量建模引入颜色偏振图像处理，通过低秩先验和斯托克斯域自适应总变分正则化，联合利用了偏振通道间的强相关性和物理约束，实现了更精确的联合去马赛克。

Abstract: Division-of-focal-plane (DoFP) color polarization cameras enable snapshot acquisition of color polarization mosaic images, but the inherently sparse sampling pattern makes color polarization demosaicking severely ill-posed. Existing methods often fail to jointly exploit the correlations among polarization channels and the physical constraints inherent in polarization imaging, resulting in noticeable demosaicking artifacts. To address this issue, a quaternion-tensor-based color polarization demosaicking (CPDM) method incorporating Stokes-domain total variation (TV) regularization is proposed. Correlation analysis shows that the correlations among polarization channels are stronger than those among color channels. Accordingly, the color polarization images acquired at $0^\circ$, $45^\circ$, $90^\circ$, and $135^\circ$ are encoded into the four components of a third-order quaternion tensor, with the color channels organized along its third mode. A low-rank prior is then imposed on the quaternion tensor to exploit the global structural redundancy in the color polarization data. Moreover, spatial gradients are mapped to the Stokes domain through an orthogonal transformation to separate intensity, polarization and residual variations, with adaptive quaternion weights enabling component-specific regularization and preserving the energy consistency of the reconstructed Stokes vectors. An efficient optimization algorithm is derived for the resulting model. Extensive experiments demonstrate the superior demosaicking performance of the proposed method.

[208] PhyCheck: Fine-Grained Evidence-Grounded Dataset for Physical Law Understanding in Video-LLMs cs.CV | cs.AIPDF

Zhongjie Ba, Shengwang Xu, Peng Cheng, Jinyang Zou, Ting Yu

TL;DR: 本文提出了PhyCheck数据集，用于评估和改进视频大语言模型对物理规律的理解能力。该数据集包含粗粒度、细粒度和诊断性子集，分别用于判断视频事件是否符合物理规律、识别具体违反细节以及结合外部因果上下文进行推理。实验表明，使用该数据集微调Qwen2.5-VL模型能显著提升物理一致性理解，但模型在整合额外因果条件方面仍存在困难。

Details

Motivation: 当前视频语言模型在通用视频理解任务上表现良好，但难以可靠判断观察事件是否符合特定物理规律，现有基准主要评估生成视频的物理质量，缺乏系统评估和改进VideoLLMs物理规律理解能力的支持。

Result: 在PhyCheck数据集上微调Qwen2.5-VL模型显著提升了物理一致性理解能力，但在诊断性子集（需结合外部因果上下文）的评估显示，当前模型仍难以将额外因果条件纳入决策。

Insight: 创新点在于构建了分层细粒度的证据支撑数据集，将物理规律理解分解为合规性判断、细节识别和因果上下文整合三个层次，为系统评估VideoLLMs的物理理解机制提供了结构化基准，揭示了模型表层不一致识别与底层物理机制理解之间的差距。

Abstract: Embodied intelligence and world models require video understanding systems to go beyond recognizing objects and actions and develop an understanding of physical regularities. However, despite their strong performance on general video understanding tasks, current video-language models still struggle to reliably determine whether an observed event conforms to specific physical laws. Existing benchmarks primarily assess the physical quality of generated videos, providing limited support for systematically evaluating and improving the physical-law understanding of Video Large Language Models (VideoLLMs). To address this gap, we introduce PhyCheck, a video question answering dataset organized at two complementary levels of granularity. The coarse-grained subset asks models to determine whether the phenomenon shown in a video conforms to or violates physical laws, while the fine-grained subset further examines whether models can capture physical details responsible for the violation or compliance. We use these subsets as structured supervision to improve physical understanding. In addition, the dataset contains a diagnostic subset with external causal context that reveal hidden factors affecting physical plausibility, assessing whether models can recalibrate their judgments accordingly. Experiments with Fine-tune Qwen2.5-VL show that training with the proposed data substantially improves the understanding of physical-consistency, while evaluations in the diagnostic subset reveal that current models still have difficulty incorporating additional causal conditions into their decisions. These findings highlight the gap between recognizing surface-level inconsistencies and understanding underlying physical mechanisms, and provide a foundation for evaluating and improving physical understanding in Video-LLMs.

[209] CLEAR: Conflict-aware Learning via Evidence-guided Adaptive Routing for Unified Sparse-View 3D Gaussian Super-Resolution cs.CVPDF

Hantang Li, Qiang Zhu, Xiandong Meng, Debin Zhao, Xiaopeng Fan

TL;DR: 本文提出CLEAR，首个统一的单阶段框架用于稀疏视图3D高斯溅射超分辨率，通过联合优化真实低分辨率观测和外部高分辨率先验，并引入梯度冲突感知优化与证据引导的补丁到高斯路由机制，以解决现有两阶段方法导致的误差累积问题。

Details

Motivation: 稀疏视图3D高斯溅射超分辨率因输入稀疏且低分辨率，缺乏足够的几何和高频信息，现有两阶段方法（先重建低分辨率高斯再细化高分辨率）会导致阶段间高斯传递和重建误差累积，因此需要统一单阶段框架来提升重建质量。

Result: 在合成和真实世界的4倍超分辨率基准测试中，CLEAR在渲染质量和几何保真度方面均达到最先进水平（SOTA）。

Insight: 创新点包括：统一单阶段框架联合优化低分辨率和高分辨率信息；高斯级冲突感知优化策略，以低分辨率梯度为可靠锚点并软校正严重高分辨率冲突；证据引导的补丁到高斯路由机制，选择性路由高频梯度和致密化；共享高斯丢弃和训练中锚定增强框架鲁棒性。

Abstract: Sparse-view 3D Gaussian Splatting Super-resolution is highly challenging since the sparse and low-resolution (LR) inputs lack sufficient geometric and high-frequency information for accurate reconstruction. To achieve high-quality reconstruction, existing sparse-view super-resolution methods adhere to two-stage pipeline that performs LR Gaussian reconstruction and then high-resolution (HR) Gaussian refinement, which directly results in stage-wise Gaussian transfer and reconstruction error accumulation. To this end, we propose CLEAR, a Conflict-aware Learning via Evidence-guided Adaptive Routing, as the first unified single-stage framework for Sparse-view 3D Gaussian Splatting Super-resolution. Specifically, CLEAR performs joint the optimization of authentic LR observations and external HR priors within a unified Gaussian representation. To mitigate the gradient conflicts introduced by sparse supervision during training, we propose a Gaussian-wise conflict-aware optimization strategy that regards the LR gradient as a reliable anchor and applies evidence-conditioned soft correction only to severe HR conflicts. Moreover, to recover high-frequency details, we introduce an evidence-guided Patch-to-Gaussian routing mechanism which estimates patch reliability and detail demand, lifts them into Gaussian space, and selectively routes high-frequency gradients and densification. Finally, we employ shared Gaussian dropout and a detached mid-training anchoring to enhance the robustness of training framework. Extensive experiments on both synthetic and real-world $4\times$ super-resolution benchmarks demonstrate that CLEAR consistently achieves state-of-the-art rendering quality and superior geometric fidelity.

[210] SPIRIT: Spatio-temporal Pairwise Relational Modeling of Instrument-Tissue Interactions for Surgical Action Triplet Recognition cs.CVPDF

Saurav Sharma, Lorenzo Arboit, Nabani Banik, Sarah Meuli, Julia Alekseenko

TL;DR: 本文提出SPIRIT框架，用于手术动作三元组（器械、动词、目标）识别，通过建模器械与组织间的时空成对关系来学习可跨医疗中心可靠迁移的交互表示。

Details

Motivation: 解决现有手术动作三元组识别方法在跨机构（如不同采集条件、外科医生风格）时可靠性不足的问题，现有数据集不支持对中心间迁移性能的显式评估。

Result: 在新建的多中心数据集MultiBypass-4C-T40上，SPIRIT在多种评估协议下均优于近期强基线，证明了其用于多中心三元组识别的有效性。

Insight: 创新点在于将三元组视为结构化组合而非扁平标签，先学习各成分的时空表示，再建模成对关系并组合预测，结合多头蒸馏稳定学习，提升了跨中心泛化能力。

Abstract: Fine-grained understanding of surgical activity is essential for context-aware assistance in the operating room, including safety monitoring, adverse event identification, and skill assessment. Surgical action triplets, defined as tuples of the form <instrument, verb, target>, provide a structured description of instrument-tissue interactions. A key open problem, however, is how to learn triplet representations that remain reliable across institutions, where surgical video varies in acquisition conditions, surgeon style, tool usage, and tissue handling, while existing triplet datasets do not support explicit evaluation of center-wise transfer. To address this problem, we propose \textbf{SPIRIT}, a structured framework for surgical action triplet recognition designed to learn interaction representations that transfer more reliably across centers. Instead of treating each triplet as a flat class label, SPIRIT first learns spatio-temporal representations for instruments, verbs, and targets, then models their pairwise relations, and finally composes them into coherent triplet predictions, with multi-head distillation used to stabilize learning. To evaluate this setting, we establish \textbf{MultiBypass-4C-T40}, a multi-centric dataset for dense surgical action triplet recognition in Roux-en-Y gastric bypass across four geographically distinct centers, with auxiliary phase and step annotations. Across multiple evaluation protocols, SPIRIT consistently outperforms strong recent baselines, highlighting the value of explicit relational reasoning for multi-centric triplet recognition. Code will be available at https://github.com/CAMMA-public/multibypass-4c-t40.

[211] RSC-GestureNet: Reliability-Aware Selective Causal Recognition of Chinese Traffic Police Gestures cs.CVPDF

Cheng Li, Renjun Gao, Boyi Fu

TL;DR: 本文提出了RSC-GestureNet，一种用于中国交通警察手势的可靠性感知选择性因果识别模型。该模型将姿态置信度作为核心信号，通过图推理对不可靠关节点进行降权、因果聚合时序证据，并采用可靠性感知的推理规则进行选择性预测。研究还引入了CTPGesture-C基准测试集，用于评估模型在姿态/RGB退化情况下的鲁棒性。

Details

Motivation: 自动驾驶中，交通警察手势是安全关键感知线索。一个可部署的识别器必须能从连续全帧视频中因果推断指令，在过渡性手臂运动时保持稳定，并避免过度信任损坏的姿态测量数据。

Result: 在完整的官方CTPGesture v1数据集（134,424个标注帧和33,451个因果窗口）上，RSC-GestureNet取得了93.33%的准确率、91.71%的宏F1分数和91.69%的在线宏F1分数，并实现了最佳的鲁棒宏F1分数。在相同设置下，其性能超过复现的交通专用基线模型MD-GCN和HLP-GCN约3-4个宏F1点。

Insight: 创新点在于将姿态可靠性作为一等信号进行显式建模，通过可靠性感知的图推理和选择性因果推断机制，提升了交通指令识别的早期性、稳定性和鲁棒性。同时，提出的特征级损坏基准CTPGesture-C为相关鲁棒性研究提供了可复现的评估标准。

Abstract: Traffic police gestures are safety-critical perception cues for autonomous driving. A deployable recognizer must infer commands causally from continuous full-frame video, remain stable around transitional arm motion, and avoid over-trusting corrupted pose measurements. This study presents RSC-GestureNet, a reliability-aware selective causal recognizer, for Chinese traffic police gestures. The model treats pose confidence as a first-class signal: unreliable joints are down weighted during graph reasoning, temporal evidence is aggregated causally, and calibrated predictions are selectively emitted through a reliability-aware inference rule. We further introduce CTPGesture-C, a reproducible feature-level corruption benchmark with seven pose/RGB degradation families, and an RGB-level diagnostic in which corrupted frames are reprocessed by MediaPipe before recognition. On the complete official CTPGesture v1 split (134,424 labeled frames and 33,451 causal windows), RSC-GestureNet achieves 93.33+-0.24% accuracy, 91.71+-0.27% macro-F1, 91.69+-0.29% online macro-F1, 98.80+-0.07% Early@10, 0.153+-0.013 s TTC, and the best robust macro-F1 among evaluated methods. Under the same split and causal protocol, it exceeds reproduced traffic-specific MD-GCN and HLP-GCN baselines by 3.23-4.11 macro-F1 points and 2.15-3.07 online-F1 points. These results, together with calibration, selective-risk, statistical, adaptive-branching, and image-level re-extraction analyses, indicate that explicit pose-reliability modeling improves early, stable, and robust traffic-command recognition.

[212] VC-Tooler: Learning Compositional and Adaptive Visual Tool Use cs.CVPDF

Yizheng Wu, Jiashen Hua, Bing Deng, Jieping Ye

TL;DR: VC-Tooler是一个学习组合式和自适应视觉工具使用的模型，旨在提升视觉语言模型（VLM）通过主动交互获取和细化视觉证据的能力。它通过分层合成管道构建轨迹库，并采用监督学习和强化学习两阶段训练，在通用和智能体基准测试中达到了最先进的性能。

Details

Motivation: 现有方法主要关注固定工具空间和僵化调用模式下的工具调用基础，未能充分解决工具组合和推理适应性问题。因此，论文旨在开发一个能够学习组合式和自适应视觉工具使用能力的模型。

Result: VC-Tooler在开源模型中实现了最先进的性能，在V*基准上达到95.8%，在VTC-Bench上达到35.3%，并在推理时在更丰富的工具设置下展现出良好的迁移能力。

Insight: 创新点在于将视觉工具使用明确建模为组合式和自适应能力，并通过分层合成管道构建涵盖单工具基础、多工具组合及多样化工具上下文和接口的轨迹库，结合两阶段训练策略来鼓励准确、高效和上下文感知的工具使用。

Abstract: Agentic multimodal reasoning extends passive image understanding by allowing VLMs to actively acquire and refine visual evidence through visual tool interactions. Effective visual tool use requires three capabilities: grounding tool calls in visual context, composing tools across multiple steps, and adapting reasoning to tool-returned observations. However, existing approaches largely focus on grounding within fixed tool spaces and rigid invocation patterns, leaving composition and adaptation insufficiently addressed. We present VC-Tooler, which learns visual tool use as a compositional and adaptive capability. To this end, we first build a trajectory bank through a hierarchical synthesis pipeline covering three capability levels: single-tool grounding, multi-tool composition, and diverse tool contexts and interfaces. We then train the model in two stages: a supervised cold start that establishes these capabilities, followed by reinforcement learning that encourages accurate, efficient, and context-aware visual tool use. VC-Tooler achieves state-of-the-art performance among open-source models on both general-purpose and agentic benchmarks, including $95.8%$ on V* and $35.3%$ on VTC-Bench, and shows promising transfer under richer tool settings at inference time. Project page: https://w1zheng.github.io/VC-Tooler

[213] Self-supervised DXA representations encode multi-system disease risk, biological aging and heritability cs.CV | q-bio.QMPDF

Gil Sasson, Zachary Levine, Smadar Shilo, Sarah Kohn, Guy Lutsker

TL;DR: 该论文提出了一种名为LeDXA的自监督学习模型，用于从全身双能X射线吸收测定法（DXA）扫描图像中提取系统性健康表征。该模型基于联合嵌入预测架构（JEPA），通过预测潜在表征而非像素重建进行学习，在内部和外部数据集上验证了其在疾病风险预测、生物年龄估计和遗传性分析方面的优越性能。

Details

Motivation: DXA扫描通常仅用于测量骨密度和身体成分，其丰富的空间结构信息未被充分利用。本文旨在通过自监督学习挖掘原始DXA图像中蕴含的全身健康信息，以超越传统的表格化测量指标。

Result: 在内部数据集（11,540张未标注扫描）和外部UK Biobank数据集（47,400张扫描）上评估，LeDXA在跨队列疾病和生物标志物预测上超越了传统DXA测量指标和SOTA通用模型DINOv3，尽管其训练图像少约15万倍、参数少近40倍。在UKBB中位4.3年随访中，LeDXA显著改善了髋膝关节炎和2型糖尿病等疾病的发病预测，最高风险四分位捕获了66%的髋关节炎病例（传统指标为41%）。其表征预测实际年龄的相关系数达0.88（MAE=2.90年），且生物年龄差距与疾病负担和死亡率风险相关。

Insight: 创新点在于首次将JEPA架构应用于DXA图像的自监督学习，证明了即使使用相对较少的数据和计算资源，也能从常规医学影像中提取出强大的、可泛化的系统性健康表征。其学习到的表征不仅编码了多系统疾病风险和生物衰老信息，还具有较高的遗传性，且生物年龄差距可能受激素替代疗法等干预措施影响，为可修改的生物标志物提供了新思路。

Abstract: Whole-body dual-energy X-ray absorptiometry (DXA) scans are routinely acquired to measure bone density and regional body composition, leaving their spatial structure largely unused. Here, we show that self-supervised learning (SSL) can convert raw DXA images into representations of systemic health. We introduce LeDXA, a vision model based on a joint-embedding predictive architecture (JEPA) that learns by predicting latent representations rather than reconstructing pixels. Trained from scratch on 11,540 unlabeled Human Phenotype Project scans, LeDXA was evaluated internally and on 47,400 external UK Biobank (UKBB) scans. It improved cross-cohort prediction of prevalent diseases and biomarkers beyond scanner-derived DXA measurements and DINOv3, a state-of-the-art general-purpose model, despite approximately 150,000-fold fewer training images and nearly 40-fold fewer parameters. Over a median 4.3-year UKBB follow-up, LeDXA improved incident disease prediction over tabular DXA measures, with the largest gains for hip and knee arthrosis and type 2 diabetes. For hip arthrosis, 66% of incident cases occurred in the highest-risk quartile versus 41% for tabular measures. Its representations predicted chronological age externally (r = 0.88; mean absolute error = 2.90 years), and the biological-age gap tracked broader disease burden and a 45% higher mortality hazard in the oldest-appearing quartile. The gap also decreased in women after starting hormone-replacement therapy, suggesting it may be modifiable. Genome-wide associations recovered mostly known body-composition and bone-density loci, and LeDXA embeddings were more heritable than DINOv3’s. These findings reveal prognostic information in DXA images that conventional readouts discard, learnable with relatively little data and modest compute.

[214] Local Margin Restoration for Test-Time Adaptation of Vision-Language Models cs.CVPDF

Yan Huang, Guowei Wang, Xu Wang, Kangjun Liu, Xin Lin

TL;DR: 本文提出了一种名为局部边界恢复（LMR）的轻量级、一步式测试时适应（TTA）框架，旨在解决视觉语言模型（如CLIP）在未预料到的测试时分布偏移下性能急剧下降的问题。该方法通过保护样本级的局部语义几何结构和引入流级别的稳定机制，有效防止了错误强化和渐进性偏差累积导致的模型崩溃。

Details

Motivation: 视觉语言模型（如CLIP）在零样本任务中表现出色，但在测试时遇到意外分布偏移时性能会严重下降。传统的测试时适应方法存在两个核心挑战：以top-1为中心的更新会通过破坏相关类别间的局部语义几何结构而强化错误，而迭代适应则会加剧渐进性偏差累积，最终导致模型崩溃。

Result: 在CIFAR-C、ImageNet-C及其变体等基准上的大量实验表明，LMR始终优于最先进的TTA基线方法，即使在具有挑战性的低批量测试场景中也表现出卓越的鲁棒性和效率。

Insight: 论文的创新点在于提出了一个耦合的解决方案：在样本级别，通过受保护的边界恢复（PMR）目标来恢复局部语义几何结构；在流级别，引入了包含自适应边界（AM）控制器和偏差校正（BC）的双阶段稳定机制，以动态地打破渐进性偏差累积。从客观角度看，该方法将局部几何保护与全局流稳定相结合，为TTA提供了一种新颖且高效的框架，避免了复杂的迭代更新。

Abstract: Vision-language models (VLMs) such as CLIP exhibit remarkable zero-shot capabilities, yet their performance frequently degrades sharply under unexpected test-time distribution shifts. While Test-Time Adaptation (TTA) offers a promising solution, continuously adapting VLMs over an unlabeled test stream presents fundamental challenges. Conventional top-1-centric updates often reinforce errors by corrupting the local semantic geometry among related classes, while iterative adaptation exacerbates progressive bias accumulation, ultimately driving the model toward mode collapse. To overcome these coupled vulnerabilities, we propose Local Margin Restoration (LMR), a lightweight, one-step TTA framework. At the sample level, our Protected Margin Restoration (PMR) objective recovers local semantic geometry by shielding plausible near-top candidates from external hard negatives. Concurrently, to combat stream-level degradation, we introduce a dual-stage stabilization mechanism, featuring an Adaptive Margin (AM) controller and Bias Correction (BC), to dynamically disrupt progressive bias accumulation and prevent mode collapse. Extensive experiments on CIFAR-C, ImageNet-C, and ImageNet variants demonstrate that LMR consistently outperforms state-of-the-art TTA baselines, proving exceptionally robust and efficient even in challenging low-batch test-time regimes. Our code is available at https://github.com/DennisHuangYan/LMR.

[215] HarMoE: Multi-Source Chest Radiograph Pretraining with Dataset-Disentangled Experts cs.CV | cs.AIPDF

Haozhe Luo, Ziyu Zhou, Shelley Zixin Shu, Mauricio Reyes

TL;DR: 本文提出HarMoE，一种针对多源胸部X光数据集预训练的视觉语言模型框架，通过数据集感知的专家混合机制，在共享跨数据集医学语义的同时，将源特定变异限制在轻量级残差专家中，并利用掩码多数据集监督统一疾病词汇表进行训练。

Details

Motivation: 现有胸部X光理解模型主要依赖MIMIC-CXR进行图像-报告对齐预训练，但忽视了多标签分类数据集作为更清晰、更明确的监督源，这些数据集组合后能提供更广泛的病理覆盖，然而异构数据集间的差异会导致模型将临床语义与数据集身份纠缠，影响迁移性能。

Result: 在大规模胸部X光基准测试中，HarMoE在零样本分类、分布外迁移和定位任务上均优于强基线模型，表明其能有效提升模型鲁棒性。

Insight: 创新点在于提出数据集感知的专家混合框架和掩码多数据集监督方法，实现了从异构数据集中构建结构化知识，而非仅依赖单源图像-报告对齐，为构建更稳健的放射学视觉语言模型提供了新方向。

Abstract: Recent vision-language models for chest X-ray understanding are largely built on image-report alignment and therefore rely heavily on MIMIC-CXR as the dominant pretraining source. While effective at scale, this paradigm underexplores an important alternative source of supervision: a range of existing multi-label classification datasets, which provide cleaner and more explicit disease signals than free-text reports, and can offer broader pathology coverage when combined across sources. However, learning from such heterogeneous datasets is nontrivial, as differences in label ontologies, annotation protocols, acquisition pipelines, and report styles can cause models to entangle clinical semantics with dataset identity, leading to poor transfer despite increased scale. In this work, we revisit radiology VLM construction from the perspective of harmonized multi-source learning. We propose HarMoE, a dataset-aware mixture-of-experts framework that learns shared cross-dataset medical semantics while confining source-specific variation to lightweight residual experts in deeper decoder layers. To further exploit clean supervision from labeled datasets, we train in a unified disease vocabulary with masked multi-dataset supervision, enabling the model to leverage complementary annotations without introducing false negatives. Experiments on large-scale chest X-ray benchmarks show that HarMoE consistently improves zero-shot classification, out-of-distribution transfer, and grounding over strong baselines. Our results suggest that building robust radiology VLMs requires moving beyond single-source image-report alignment toward structured knowledge construction from heterogeneous datasets with cleaner supervision and broader coverage. Code and the 873k harmonized dataset will be released at https://github.com/Roypic/harmoe.

[216] Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration cs.CVPDF

Aoru Xue, Yujing Sun, Yiming Ren, Kwok-Yan Lam, Mao Ye

TL;DR: 本文提出了Sen-Cap，一个传感器灵活且抗噪声的3D人体运动捕捉框架，它集成了来自LiDAR和相机的多模态数据。该框架通过一个无需传感器标定的统一跨传感器运动估计器和一个抗噪声轨迹跟踪器，解决了多模态传感器部署中的对齐挑战和噪声/故障问题，实现了实时运行。

Details

Motivation: 现有基于多模态传感器的方法面临两大核心挑战：一是依赖显式标定来处理任意部署传感器间的跨模态对齐，这限制了部署的灵活性；二是现有方法在现实环境中常见的严重噪声或部分传感器故障下性能会显著下降。

Result: Sen-Cap在Human-M3和FreeMotion基准测试的主要指标上达到了最先进的性能，并在LiDARHuman26M和RELI11D上表现出强大的跨域性能，且能实时运行。

Insight: 创新点在于提出了一个无需标定、支持传感器数量灵活的统一跨传感器运动估计器，以及一个通过迭代优化在严重点云噪声下保持鲁棒性的抗噪声轨迹跟踪器，这增强了系统在现实世界部署的实用性和鲁棒性。

Abstract: We propose Sen-Cap, a Sensor-Flexible and Noise-Resilient 3D human motion Capture framework that integrates multi-modal data from LiDAR and camera. While multi-modal sensors provide richer information than single-modal sensors, existing approaches still suffer from two core challenges. First, multi-modal alignment/matching across arbitrarily deployed sensors is typically handled by explicit calibration, which propagates errors under changing viewpoints and in turn constrains deployment to fixed, highly overlapped layouts. Second, prior methods degrade under severe noise or partial sensor failures, which are common in real-world environments. To address these challenges, Sen-Cap introduces a Unified Across-Sensor Motion Estimator that reconstructs local pose and shape in a human-centric space without calibrations between sensors, supporting a flexible number of sensors, as well as a Noise-Resistant Trajectory Tracker that maintains robustness under severe point cloud noise through iterative refinement. These sensor-flexible and noise-resilient features make Sen-Cap more practical in real-world deployment. Notably, operating in real time, Sen-Cap achieves state-of-the-art performance on major metrics on Human-M3 and FreeMotion, as well as strong cross-domain performance on LiDARHuman26M and RELI11D. This combination of flexibility and robustness opens new opportunities for motion capture in real-world scenarios, e.g. sports analytics, field robotics, and large-scale immersive environments.

[217] Extended Field of View Analysis for VideoGAN-based Trajectory Generation cs.CV | cs.LGPDF

Annajoyce Mariani, Kira Maag, Hanno Gottschalk

TL;DR: 本文在基于生成对抗网络（GAN）的语义鸟瞰图交通轨迹生成框架基础上，通过改进语义表示、采用基于图的关联方法替代轨迹提取，并系统研究更大视野范围，扩展了视频GAN在轨迹生成中的应用。论文还引入了定量评估框架来评估生成视频中的幻觉和物体持久性，证明了该方法在更大、更复杂的交通场景中仍能生成统计上真实的轨迹并保持交通参与者间连贯的空间关系。

Details

Motivation: 现实且多样的轨迹生成是实现更高级别车辆自动化的核心。基于规则和传统学习方法难以捕捉交通行为的复杂性，而生成模型在其他领域已证明能处理类似复杂程度。本文旨在扩展基于GAN的语义鸟瞰图交通生成框架，以应对更大、更复杂的交通场景。

Result: 实验表明，该框架能泛化到更大、更复杂的交通场景，同时保持统计上真实的轨迹和交通参与者间连贯的空间关系。在150 GPU小时的训练和高达20秒场景下低于20ms的推理时间内，基于视频的GAN在轨迹生成中仍保持高效和可扩展性。

Insight: 创新点包括改进语义表示、采用基于图的关联方法进行轨迹提取，以及系统研究扩展视野范围。此外，引入定量评估框架来评估生成视频中的幻觉和物体持久性，为生成模型的可靠性提供了新的评估维度。从客观角度看，该方法展示了视频GAN在复杂交通场景轨迹生成中的高效性和可扩展性，适用于自动驾驶中的预测、规划和仿真等下游任务。

Abstract: Realistic and diverse trajectory generation is central to enabling higher levels of vehicle automation. While rule-based and classical learning-based methods may struggle to capture the complexity of traffic behavior, generative models have already demonstrated in other fields that they can handle a comparable level of complexity. In this paper, we build upon previous work on generative adversarial network (GAN)-based semantic bird’s-eye-view traffic generation and extend the proposed framework in several key aspects. We improve the semantic representation, replace the trajectory extraction procedure with a graph-based association method, and systematically investigate increasingly larger fields of view. In addition, we introduce a quantitative evaluation framework to assess hallucinations and object permanence in generated videos. Our experiments demonstrate that the framework generalizes to larger and more complex traffic scenes while maintaining statistically realistic trajectories and coherent spatial relationships between traffic participants. Within 150GPU hours of training and with inference times below 20ms for scenes of up to 20s, our results demonstrate that video-based GANs remain an efficient and scalable approach for realistic trajectory generation, even in substantially larger traffic scenes, making them well suited for downstream tasks such as prediction, planning, and simulation in automated driving.

[218] SpikeRestormer: Towards Energy-Efficient All-in-One Image Restoration via Unified Event Reasoning cs.CVPDF

Shengkai Hu, Jie Shao, Jiaqi Ma, Xu Zhang, Keying Wu

TL;DR: 本文提出SpikeRestormer，一种用于All-in-One图像恢复（AiOIR）的高效能脉冲神经网络（SNN）。该方法通过内部生成的脉冲线索进行事件推理，将恢复过程统一为退化事件感知、可靠性推断和恢复事件构建三个互补过程，旨在解决传统ANN方法计算成本高以及SNN应用于静态图像时因缺乏显式事件信号和退化线索与场景结构纠缠而面临的挑战。

Details

Motivation: 基于人工神经网络（ANN）的All-in-One图像恢复方法虽然能统一处理多种退化，但计算成本高昂，限制了实时部署。而低功耗的脉冲神经网络（SNN）在应用于静态图像时，由于缺乏显式事件信号且退化线索与场景结构高度纠缠，难以学习可靠的、面向恢复的脉冲事件。

Result: 大量实验表明，SpikeRestormer在性能上与基于ANN的方法具有竞争力，并在基于SNN的方法中取得了新的最先进（SOTA）结果，同时显著降低了能耗。

Insight: 主要创新点在于提出了一个统一的脉冲事件推理框架，具体包括：通过减性退化事件注意力（SDEA）进行退化事件感知；通过分层贝叶斯跳跃掩码（HBSM）进行事件可靠性推断；通过加性恢复事件注意力（AREA）进行恢复事件构建。这种将恢复任务分解为互补的、基于事件推理的过程，释放了SNN在高效能AiOIR中的潜力。

Abstract: ANN-based All-in-One image restoration (AiOIR) unifies diverse degradation handling but incurs high computational costs, limiting its real-time deployment. While Spiking Neural Networks (SNNs) offer a low-power alternative, applying them to static images remains challenging. This difficulty arises because explicit event signals are absent, and degradation cues are heavily entangled with scene structures, hindering the learning of reliable restoration-oriented spike events. To address these issues, we propose SpikeRestormer, an energy-efficient SNN for AiOIR that performs event reasoning over internally generated spike cues. Specifically, we propose a degradation-event perception process to extract spike-based degradation events through Subtractive Degradation Event Attention (SDEA). Moreover, we introduce Hierarchical Bayesian Skip Masking (HBSM) and Additive Restoration Event Attention (AREA) processes for event-reliability inference and restoration-event construction, respectively. By integrating these complementary processes, SpikeRestormer formulates restoration as a unified process of degradation-event perception, degradation-event reliability inference, and restoration-event construction, liberating the potential of SNNs for energy-efficient AiOIR. Extensive experiments show that SpikeRestormer delivers competitive performance against ANN-based methods and establishes new state-of-the-art results among SNN-based methods with significantly lower energy consumption.

[219] A General-Purpose VLM Can Teach an Astronomy Foundation Model to Better Recognize Galaxy Morphology cs.CVPDF

Dichang Zhang, Jiaqi Deng, Yixuan Shao, Yuanpeng Liu, Jiali Cui

TL;DR: 本文提出利用通用视觉语言模型（VLM）作为弱监督的形态学教师，以提升天文学基础模型在有限人工标注预算下对星系形态的分类性能。研究首先构建了一个面向巡天的视觉问答基准，评估了先进VLM在星系形态问题上的表现，发现其虽能捕捉有用信号但尚不足以替代人工。随后，作者将通用VLM作为教师模型，指导预训练于大规模Galaxy Zoo标注的天文学基础模型Zoobot，在多个巡天领域和标注预算下均实现了下游分类性能的持续提升。

Details

Motivation: 现有天文学基础模型虽能提供强大的星系表征，但将其适配到新的巡天条件及特定形态识别任务仍需大量人工监督。本文旨在探索如何利用通用VLM中蕴含的视觉-语义先验作为弱监督，以在有限人工标注预算下提升形态分类性能。

Result: 在构建的跨两个代表性成像体制的巡天VQA基准上，评估表明先进VLM能捕捉有用的形态信号并提供信息丰富的不确定性，但可靠性不足以替代人工标注。将通用VLM作为教师指导Zoobot后，在两个巡天领域和多个标注预算下，Zoobot的下游形态分类性能均获得一致提升。

Insight: 论文的创新点在于揭示了通用VLM能为天文学基础模型提供互补性知识，并可作为弱监督教师模型，在有限人工监督下有效提升特定领域任务的性能。该方法为面向未来大规模巡天（如LSST和Roman Space Telescope）的高效标注适配提供了可行技术路径。

Abstract: Existing astronomy foundation models provide strong galaxy representations, but adapting them to new survey conditions and survey-specific morphology recognition tasks still requires substantial human supervision. We show that VLM-based VQA systems contain meaningful visual-semantic priors that can serve as weak supervision for downstream morphology classifiers and improve morphology classification under limited human-label budgets. We first introduce a survey-oriented VQA benchmark spanning two representative imaging regimes and evaluate state-of-the-art VLMs on galaxy morphology questions. The results show that these models capture useful morphology signals and informative uncertainty, but are not sufficiently reliable to replace human annotators. Motivated by this finding, we use a general-purpose VLM as a morphology teacher for Zoobot, an astronomy foundation model pretrained on large-scale Galaxy Zoo annotations. Across two survey domains and multiple annotation budgets, the VLM teacher consistently improves Zoobot’s downstream morphology classification. These results demonstrate that a general-purpose VLM provides knowledge complementary to an astronomy foundation model and can teach it to better recognize galaxy morphology under limited human supervision. The resulting pipeline is designed for label-efficient adaptation to forthcoming large-scale surveys, including the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST) and the Nancy Grace Roman Space Telescope. The benchmark and code are publicly available at https://github.com/fw-ic/VLM-morphology-teacher.

[220] Context-Aware Mixture of Domain Experts for Bodily Expression of Emotion in the Wild cs.CV | cs.AIPDF

Mohammad Mahdi Dehshibi, David Masip

TL;DR: 本文提出了一种用于野外身体情感识别的上下文感知混合领域专家模型（CA-MoDE）。该模型通过专门的场景和物体专家生成基于各自领域的情绪类别软分布，作为结构化上下文先验来调节身体专家的预测，并采用一种任务定制的最大认可门控策略来融合多领域信号。

Details

Motivation: 相同的身体姿势在不同上下文环境中可能传达完全不同的情感，而现有方法通常仅将场景和物体线索作为辅助特征增强，而非将其视为情感合理性的结构化先验。

Result: 在Body Language Database上，CA-MoDE取得了0.3269的情感识别分数，超越了现有的时序模型，且仅使用单张静态图像就证明了其有效性。

Insight: 创新点在于将场景和物体信息作为结构化先验在分布层面（而非特征层面）调制身体情感预测，并设计了最大认可门控策略以避免冲突或无信息上下文分布平均导致的信号稀释，这为通常由视频捕捉的行为动态提供了一种互补的判别性代理。

Abstract: The same body posture can convey entirely different emotions depending on its surrounding context, yet most methods for recognising bodily emotions treat scene and object cues as auxiliary feature augmentations rather than as structured priors over the plausibility of emotions. We introduce the Context-Aware Mixture of Domain Experts (CA-MoDE) for bodily emotion recognition. CA-MoDE incorporates dedicated scene and object experts to generate soft distributions over emotion categories conditioned on their respective domains. These domain-conditioned soft predictions serve as structured contextual priors that modulate the body expert’s predictions at the distributional level rather than at the feature level. To fuse these multi-domain signals, we propose a task-tailored max-endorsement gating strategy that selects the strongest contextual signal across experts for each emotion dimension. Our gating strategy mitigates the signal dilution that typically occurs when conflicting or uninformative context distributions are averaged. CA-MoDE achieves an Emotion Recognition Score of 0.3269 on the Body Language Database. By outperforming existing temporal models using only single still images, our framework demonstrates that explicitly modelling structured spatial context can serve as a complementary discriminative proxy for the behavioural dynamics typically captured by video.

[221] Implicit Neural Representations for Multimodal Longitudinal Image Imputation and Interpolation cs.CVPDF

Sina Wendrich, Lukas Förner, Zoe Reinke, Kartikay Tehlan, Ansgar Berlis

TL;DR: 本文提出了一种患者特定的条件隐式神经表示（INR）模型，用于处理多模态纵向MRI图像中的缺失序列、异质采集协议和空间分辨率变化问题。该模型将多模态纵向MRI建模为世界坐标、时间和模态条件的连续函数，通过随机模态丢弃训练处理不完整数据，并支持空间和时间插值。在儿科脑肿瘤患者的纵向MRI数据上评估，结果显示在T1CE和FLAIR序列上相比线性插值有显著改进，并引入了基于自一致性的置信度估计器来预测重建质量。

Details

Motivation: 解决真实世界临床纵向多参数MRI数据中常见的序列缺失、采集协议异质性和时间点间空间分辨率变化的问题，以支持肿瘤随访成像。

Result: 在儿科脑肿瘤患者的纵向MRI上评估，T1CE和FLAIR序列相比线性插值有统计显著改进（p < 0.05），T1CE的平均MS-SSIM达到0.95 ± 0.02；预测置信度与真实重建质量强相关（Pearson r高达0.996）。

Insight: 创新点包括将多模态纵向MRI建模为坐标、时间和模态的连续函数，使用随机模态丢弃处理缺失数据，以及基于跨模态重建性能的自一致性置信度估计，这些方法提升了在异质临床环境中的鲁棒性和实用性。

Abstract: Longitudinal multiparametric MRI is central to follow-up imaging in oncology, yet real-world clinical data are characterised by missing sequences, heterogeneous acquisition protocols, and varying spatial resolutions across time points. We propose a patient-specific conditional implicit neural representation (INR) that models multimodal longitudinal MRI as a continuous function of world coordinates, time, and modality conditioning. The model is trained with stochastic modality dropout to handle incomplete data, and its continuous coordinate-space formulation enables both spatial and temporal interpolation without resampling to a fixed voxel grid. A self-consistency-based confidence estimator is derived from cross-modal reconstruction performance at inference time. We evaluate the framework on longitudinal MRI from paediatric brain tumour patients, demonstrating statistically significant improvements over linear interpolation for T1CE and FLAIR (p < 0.05), with mean MS-SSIM of 0.95 $\pm$ 0.02 for T1CE. Predicted confidence correlates strongly with true reconstruction quality (Pearson r up to 0.996), suggesting reliable deployment potential in heterogeneous clinical settings.

Gaetano Chiriaco, Luca Barco, Andrea Bragagnolo, Claudio Rossi, Edoardo Arnaudo

TL;DR: 本文介绍了GEOID-Flood，一个用于洪水分割的大规模多模态基准数据集，该数据集源自哥白尼应急管理服务，涵盖十年间65个国家的219个事件，提供超过14,000个配准的灾前灾后Sentinel-1 SAR图像、灾前Sentinel-2光学合成图像和DEM数据，并包含手动验证的标签。作者利用该基准评估了基础模型与传统编码器在单图像、多时相和多模态协议下的性能，发现基础模型具有一致但有限的优势，光学-SAR融合与微调能最好地解析瞬时洪水，且在该数据集上训练的模型迁移到未见事件的效果优于现有数据集训练的模型。

Details

Motivation: 现有的洪水测绘数据集很少大规模结合双时相SAR和配准的光学图像，导致基础模型在此下游任务中的价值未得到充分测试，因此需要高质量的多模态基准来评估地理空间基础模型的迁移能力。

Result: 在GEOID-Flood基准上的评估表明，基础模型相比传统编码器提供了稳定但有限的优势；通过微调的光学-SAR融合能最佳解析瞬时洪水；在该数据集上训练的模型迁移到未见洪水事件时，性能优于基于现有数据集训练的模型。

Insight: 论文的创新点在于构建了一个大规模、多模态、手动标注的洪水分割基准数据集，填补了现有数据在双时相SAR与光学图像结合方面的空白，并系统评估了基础模型在洪水测绘任务中的实际价值，强调了多模态融合与微调的重要性。

Abstract: Geospatial foundation models aim to learn representations that transfer across regions and sensors, yet evaluating them on specific tasks requires large, high-quality, multi-modal benchmarks that measure how well such models extract value from data. Concerning flood mapping, existing datasets rarely combine bi-temporal SAR and co-registered optical imagery at scale, leaving the value of foundation models for this downstream task largely untested. We introduce GEOID-Flood, a large-scale multi-modal flood segmentation benchmark, derived from Copernicus Emergency Management Service activations, spanning 219 events across 65 countries over ten years. The dataset provides more than 14,000 tiles with co-registered pre- and post-event Sentinel-1, in GRD and RTC format, pre-event Sentinel-2 composite, and DEM, including manually validated labels that separate background from permanent water and flooded water. Using this benchmark, we evaluate foundation models against conventional encoders across single-image, multi-temporal, and multi-modal protocols. We report three main findings: foundation models offer a consistent but modest advantage; optical-SAR fusion with finetuning best resolves transient flooding; and models trained on GEOID-Flood transfer to unseen events better than those trained on existing datasets. Dataset and code available at https://github.com/links-ads/geoid-flood.

[223] GROVE: Growing and Reasoning over Temporally Stratified Memory from Streaming Video Experience cs.CV | cs.AIPDF

Sitong Gong, Caixin Kang, Tianyu Yan, Guo Chen, Bo Zheng

TL;DR: GROVE是一个无需训练的视频记忆框架，能够从连续视频流中因果地构建分层记忆，支持细粒度感知证据的保留和渐进式整合，形成时间戳时刻、连贯片段和跨日重复模式。该框架通过分层检索技能实现反应式问答和主动式辅助，在多个基准测试中取得最佳性能。

Details

Motivation: 现有视频记忆系统主要支持基于问题的回忆，而主动式助手通常使用分离的记忆和控制机制，缺乏统一框架来同时支持对视觉历史的问答和识别历史对当前情境的有用性。

Result: 在包括挑战性的MM-lifelong和EgoServe在内的多个基准测试中，GROVE取得了相比方法中最好的结果。控制消融实验表明时间分层及其访问技能是互补的，当证据跨越多天时模式层提供最大收益。

Insight: 创新点在于提出了一种无需训练的分层记忆构建框架，将连续视频流因果地整合为不同时间粒度的记忆层（时刻、片段、模式），并配备相应的原生检索技能，统一了反应式和主动式记忆访问接口。从客观角度看，其分层结构和渐进整合机制为处理长期视频流中的时序信息提供了可借鉴的架构设计。

Abstract: A wearable assistant should both answer questions about its visual history and recognize when that history is useful to the present situation. Existing video-memory systems primarily support question-conditioned recall, whereas proactive assistants typically use separate memory and control mechanisms. We introduce GROVE, a training-free framework that supports both behaviors with one memory grown causally from a continuous video stream. GROVE retains fine-grained perceptual evidence and incrementally consolidates it into time-stamped moments, coherent episodes, and recurring cross-day patterns. Each stratum is paired with a scale-native retrieval skill for locating an observation, replaying an activity, or traversing long-range regularities. Reactive QA and proactive assistance share this memory and access interface, differing in whether retrieval is initiated by a user query or the current situation. Across multiple benchmarks including the challenging MM-lifelong and EgoServe, GROVE achieves the best results among the compared methods. Controlled ablations show that the temporal strata and their access skills are complementary, with patterns providing the largest benefit when evidence spans multiple days. Code will be available at https://github.com/SitongGong/GROVE.

[224] Does Explainability Transfer? A Controlled Benchmark of Attribution Methods on Vision Transformers and CNNs cs.CVPDF

Sathiyamohan Nishankar, Nethmi Pathirana, Pubudu Sanjeewani, Asanka Perera, Selvarajah Thuseethan

TL;DR: 本文提出了一个受控基准测试，系统评估了13种可解释人工智能（XAI）归因方法在八种代表性视觉骨干网络（包括CNN、各向同性ViT、分层Transformer、混合架构和线性注意力Transformer）上的性能。研究发现，归因方法的有效性高度依赖于网络架构，在CNN上建立的性能排名不能可靠地迁移到基于Transformer的模型上，挑战了现有结论，并表明需要架构感知的多维度评估。

Details

Motivation: 现有关于XAI归因方法有效性的证据大多建立在卷积神经网络（CNN）上，缺乏对这些结论是否能推广到如今主导计算机视觉的多样化视觉Transformer（ViT）架构上的系统性研究。

Result: 在五个维度（忠实性、定位性、鲁棒性、复杂性、计算成本）的评估表明，基于CAM的方法在CNN和大多数ViT上使用边界框定位指标时得分最高，但在线性注意力架构上表现不佳；注意力滚动方法能提供稳定但定位性差的解释；忠实性相关性指标对区分不同归因方法的能力有限。

Insight: 主要创新点在于构建了一个标准化、多维度的评估框架，首次系统揭示了归因方法性能对骨干网络架构的强依赖性，并指出单一指标评估的局限性。客观来看，该研究强调了在评估XAI方法时考虑目标模型架构特性的重要性，为未来研究提供了更严谨的基准。

Abstract: Most evidence on the effectiveness of explainable artificial intelligence (XAI) attribution methods has been established on convolutional neural networks (CNNs), with limited investigation into whether these conclusions generalize to the diverse Vision Transformer (ViT) architectures that now dominate computer vision. This paper presents a controlled benchmark that evaluates attribution quality across five dimensions: faithfulness, localization, robustness, complexity, and computational cost. A standardized framework assesses 13 attribution methods from four algorithmic families on eight representative backbones spanning CNNs, isotropic ViTs, hierarchical transformers, hybrid architectures, and linear-attention transformers. The results show that attribution performance is strongly architecture-dependent and that rankings established on CNNs do not reliably transfer to transformer-based models. CAM-based methods achieve the highest scores under the conventional bounding-box localization metric on CNNs and most ViTs but perform poorly on linear-attention architectures. Pixel-level dense-mask evaluation further reveals that these gains largely reflect metric saturation rather than accurate localization. CAM-based methods also exhibit limited robustness on global-attention transformers, whereas attention rollout provides consistently stable explanations with poor localization. Furthermore, faithfulness correlation offers limited discrimination between attribution methods, highlighting the limitations of single-metric evaluation. These findings challenge prevailing conclusions on attribution performance and demonstrate the need for architecture-aware, multi-dimensional evaluation. The open-source code for the evaluation framework and benchmark results is available at https://github.com/Nishan-Charlie/VIT_XAI_Bench.

Jiaming Chen, Guoan Xu, Aoshen Huang, Haozhuo Zhang, Yang Li

TL;DR: 论文提出了一种名为DF^3（Decoder-Free Feature Forecasting）的新框架，用于自主导航中的世界建模。该方法通过在冻结的视觉基础模型的末端块中注入可学习的空间查询，直接在潜在空间中提取未来状态表示，并利用轻量级的运动感知上下文融合机制（MACF）整合粗粒度流扭曲与细粒度潜在互相关来预测下一帧特征，最终通过任务查询从预测特征中直接获取下游任务输出，完全消除了解码器的需求。

Details

Motivation: 解决自主机器人系统中从视频序列预测未来状态的关键挑战，即现有像素级生成方法过度关注任务无关细节导致计算开销巨大，而基于潜在特征的方法虽然直接预测特征，但仍依赖繁重的解码器进行状态到任务的映射，这成为计算瓶颈。

Result: 在公开基准测试和机器人模拟器的零样本部署中进行的广泛实验表明，DF^3在实现与最先进方法相当性能的同时，为集成感知与控制提供了更高的效率和灵活性。

Insight: 创新点在于完全在潜在空间内建模世界演化并直接推导任务输出，从而彻底摒弃解码器；具体通过可学习空间查询提取未来表示，以及轻量级MACF机制融合运动上下文进行特征对齐与预测，实现了高效且灵活的世界建模。

Abstract: Forecasting future states from video sequences is a critical challenge for autonomous robotic systems and a fundamental objective of world modeling. Prior generative methods operating at the pixel level inevitably overemphasize task-irrelevant details, leading to prohibitive computational overhead. While latent-based approaches attempt to mitigate this by predicting features directly, the persistent reliance on heavy decoders for state-to-task mapping remains a computational bottleneck. In this work, we propose Decoder-Free Feature Forecasting (DF$^3$), a novel framework that models world evolution entirely within the latent space and directly derives task outputs, completely eliminating the need for a decoder. Specifically, DF$^3$ injects learnable spatial queries into the terminal blocks of a frozen vision foundation model to extract future state representations directly. By employing a lightweight, unified Motion-Aware Context Fusion (MACF) mechanism that seamlessly integrates coarse flow warping with fine-grained latent cross-correlation, these queries interact with historical token representations to explicitly align and forecast the feature of the next frame. Subsequently, a specialized set of task queries probes these forecasted features for the downstream task. Extensive experiments on public benchmarks and zero-shot deployment in a robotic simulator demonstrate that DF$^3$ achieves performance comparable to state-of-the-art methods while offering superior efficiency and flexibility for integrated perception and control.

[226] Grounding Agentic VLMs with Dedicated Segmentation for Fine-Grained Vehicle Damage Assessment cs.CV | cs.AIPDF

Vishwajeet Shivaji Hogale, Anjali Pai, Nitya Ravi

TL;DR: 本文针对视觉语言模型（VLMs）在细粒度视觉评估任务中空间定位不可靠的问题，提出了一种名为TinyDamage的混合架构。该架构将空间定位任务委托给一个专用的多任务分割模型，而VLM则专注于语义推理和报告生成。通过在车辆损伤评估任务上的实验，该方法显著降低了VLM的幻觉率，并引入了新的评估指标DET_l。

Details

Motivation: 动机在于解决VLM在细粒度、视觉模糊目标（如车辆上的细小划痕和裂纹）上进行空间定位时不可靠的问题，这些目标像素少、梯度信号弱，容易被误判。

Result: 在车辆损伤评估任务上，所提方法将报告幻觉率从纯文本的92%和纯图像的78%降低至31%。在分割方面，监督对比目标函数显著改善了损伤/背景的可分离性。

Insight: 核心创新点在于将空间定位任务与语义推理任务解耦，使用专用分割模型处理细粒度目标定位，并发现损失函数的选择对微小物体定位有巨大影响。此外，构建了一个基于LangGraph的代理管道，将VLM的每一步生成都锚定在分割输出上，提高了可靠性。

Abstract: Vision-language models (VLMs) are increasingly deployed as reasoning agents in real-world visual assessment pipelines, yet their spatial grounding remains unreliable for fine-grained, visually ambiguous targets. We study this gap in the context of automated vehicle damage assessment, where fine-grained defects such as scratches and hairline cracks occupy few pixels, produce weak gradient signal, and are easily confused with reflections and surface texture. We show that a state-of-the-art VLM (Qwen-VL) achieves strong semantic classification accuracy (87.3%) on this task but is systematically ungrounded at the spatial level: it hallucinates damage in reflective regions, misses elongated scratches entirely, and produces spatially inconsistent outputs when prompted for localization. We propose TinyDamage, a hybrid architecture that delegates spatial grounding to a dedicated multi-task segmentation model while reserving the VLM for semantic reasoning and report generation. On the segmentation side, we find that the choice of loss function has an outsized and underexplored effect on tiny-object grounding: focal loss, widely used for class imbalance, collapses tiny-damage detection to zero, while a supervised contrastive objective measurably improves damage/background separability. We integrate the segmentation model into a 7-node LangGraph agent pipeline that grounds every VLM generation step in the segmentation output, and show that this grounding reduces the report hallucination rate from 92% (text-only) and 78% (image-only) to 31% in a controlled evaluation on 100 human-verified reports. We introduce DET_l, a permissive per-category detection metric for evaluating tiny-object grounding under class imbalance, and report latency and reliability characteristics of the deployed pipeline.

[227] MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Driving cs.CV | cs.ROPDF

Ambarish Govindarajulu Kaliamurthi, Kaikai Liu

TL;DR: 本文提出了MoRAL，一个用于自动驾驶的两阶段微调流程，旨在将紧凑型视觉语言模型（VLM）与基于物理编码的鸟瞰图（BEV）表示进行接地，以实现安全关键的空间推理。该方法首先训练视觉编码器理解BEV图像（该图像编码了LiDAR距离、物体类别和雷达速度），然后使用教师模型生成的思维链数据进行全模型微调，最终得到一个参数高效、可在边缘设备部署的模型。

Details

Motivation: 为了解决在资源受限的自动驾驶平台上部署视觉语言模型（VLMs）时，模型需要兼具紧凑尺寸和可靠的度量接地（metric grounding）能力的问题。

Result: 在nuScenes数据集上，使用Gemma 4（31B）评估，MoRAL在八类驾驶问题中的七类上超越了零样本的8B基线模型，尽管其参数量仅为后者的四分之一。具体而言，紧急制动召回率从10.8%提升至47.8%，输出退化率从94.1%降至20.8%。整个流程可在消费级8GB GPU上以42 tok/s的速度运行，无需量化。

Insight: 主要创新点在于：1）提出了一种将物理感知（LiDAR、雷达）外部化为BEV图像编码的输入表示方法，从而在推理时无需学习复杂的3D骨干网络；2）设计了一个两阶段的微调流程，先进行度量接地训练，再进行思维链推理训练，有效提升了紧凑模型的空间推理能力。这为在移动边缘平台上部署基于物理接地的紧凑VLM提供了一个可复现的基础。

Abstract: Deploying vision-language models (VLMs) for safety-critical spatial reasoning on resource-constrained autonomous driving platforms requires both compact model size and reliable metric grounding. We present MoRAL (Multimodal Reasoning for Autonomous Language Models), a two-stage fine-tuning pipeline that teaches Cosmos-Reason2-2B to first read a physics-encoded Bird’s Eye View (BEV) representation and then reason over it for driving decisions. The BEV image encodes LiDAR metric distance as color bands, object class as cluster morphology, and radar Doppler velocity as directional wedge overlays, externalizing spatial perception into the input image so that no learned 3D backbone is required at inference. Stage 1 fine-tunes the vision encoder on 60,000 grounding records; zero-shot baselines produce no parseable BEV outputs, confirming the vocabulary requires explicit training. Stage 2 fine-tunes the full model (52M parameters, 2.4% of total) on 57,696 chain-of-thought records generated by Cosmos-Reason2-8B as teacher, spanning eight driving question types. On 2,304 held-out nuScenes frames evaluated by Gemma 4 (31B) calibrated against human review, MoRAL wins seven of eight question types over a zero-shot 8B baseline despite using four times fewer parameters, with the largest margins on question types requiring structured multi-step physics reasoning. Emergency braking recall improves from 10.8% to 47.8%, output degeneration falls from 94.1% to 20.8%, and the full pipeline fits a consumer 8 GB GPU at 42 tok/s without quantization. These results establish a reproducible foundation for compact, physics-grounded VLM reasoning on mobile edge platforms.

[228] Action-grounded tissue affordance enables anticipatory auto-framing that lowers surgeon cognitive workload during laparoscopic surgery cs.CV | cs.AIPDF

Jiayu Gu, Yiwei Wang, Jie Zhang, Guojun Cao, Keshen Lyu

TL;DR: 本文提出了DiffeoAfford框架，一种基于动作的组织可供性建模方法，用于从已完成的腹腔镜手术视频中自动生成视觉注意力监督标签，无需逐帧人工标注。基于此训练出的实时预测模型能够预判相关手术区域，并实现名为AffordView的辅助自动取景系统。该系统与专家标注和术中外科医生注视点一致，并通过主观、生理和行为指标评估，在实际应用中降低了外科医生的认知负荷。

Details

Motivation: 解决腹腔镜手术中，由于手术意图高度专业和隐性，难以获取密集空间标注来训练计算注意力模型以辅助外科医生管理视觉需求的问题。

Result: 提出的框架与专家标注和术中外科医生注视点对齐。在真实世界评估中，使用主观、生理和行为测量方法，证明其降低了外科医生的认知负荷。

Insight: 核心创新在于通过结合微分同胚约束的组织追踪与器械轨迹分析，从已完成的手术视频中回顾性地、无监督地推导出视觉注意力监督（可供性热点标签），从而避免了昂贵的人工逐帧标注。这为手术中基于预测的实时辅助可视化系统提供了可行的数据驱动解决方案。

Abstract: Computational attention models could help surgeons manage the visual demands of laparoscopy, but they require dense spatial labels that are difficult to obtain because surgical intent is highly specialized and tacit. Here, we introduce DiffeoAfford, an action-grounded tissue affordance framework that retrospectively derives visual attention supervision from completed surgical procedures. By combining diffeomorphism-constrained tissue tracking with instrument trajectory analysis, DiffeoAfford generates affordance hotspot labels without manual per-frame annotation. A real-time prediction model trained on these labels anticipates relevant surgical regions and enables AffordView, an assistive auto-framing system for laparoscopic visualization. The proposed framework aligns with expert annotations and intraoperative surgeon gaze, and reduces surgeon cognitive workload during real-world evaluations using subjective, physiological, and behavioral measures.

Jiayu Chen, Xiaoyu Wu, Rongshan Gao, Maoliang Li, Zihao Zheng

TL;DR: 本文提出EchoCache，一种基于能量引导的跨模态缓存框架，用于高效音频驱动视频生成。该方法通过音频时频能量作为显著性锚点指导潜在特征缓存更新，并引入动态时间步-潜在缓存机制与量化缓存管理，以解决现有缓存方法中时间-语义和计算-存储不对齐的问题。

Details

Motivation: 音频驱动视频生成的推理过程因扩散模型的迭代去噪而计算昂贵，现有缓存方法主要利用视觉特征的时间冗余，但忽略了音频驱动视觉生成中高度非均匀的时间重要性，导致跨模态对齐不足。

Result: 在主流A2V模型上的广泛实验表明，EchoCache在保持生成质量和视听一致性的同时，持续改善了延迟与质量的权衡；在EMTD基准测试中，Wan2.2-S2V模型上实现了2.46倍加速，并达到最佳整体性能。

Insight: 创新点在于利用音频能量作为跨模态对齐的显著性指导，以及动态时间步-潜在缓存机制与量化管理的联合优化，这为多模态生成任务中的高效推理提供了可借鉴的缓存策略。

Abstract: Audio-driven video generation (A2V) has achieved promising progress in synthesizing temporally coherent and audio-visually aligned videos, yet its inference remains expensive due to the iterative denoising process of diffusion models. Existing caching methods mainly exploit temporal redundancy in visual features while overlooking the cross-modal alignment of A2V, where audio drives visual generation with highly non-uniform temporal importance. In this paper, we identify two levels of misalignment in existing A2V caching methods: temporal-semantic and computation-storage misalignment. To address them, we propose EchoCache, an energy-guided cross-modal caching framework for efficient A2V generation. EchoCache leverages audio time-frequency energy as a saliency anchor to guide latent-level cache updates and further introduces a dynamic timestep-latent caching mechanism with quantized cache management for joint efficiency and memory optimization. Extensive experiments on mainstream A2V models show that EchoCache consistently improves the latency-quality trade-off while preserving generation quality and audio-visual consistency. In particular, on Wan2.2-S2V over the EMTD benchmark, EchoCache achieves a 2.46x speedup with the best overall performance. Code is available at https://github.com/IF-LAB-PKU/EchoCache.

[230] Token Radius Attention for Efficient Video Generation cs.CVPDF

Jiayu Chen, Zhikun Jiang, Maoliang Li, Jiayi Luo, Jiawei Yang

TL;DR: 本文提出了一种名为Token Radius Attention (TRA) 的训练无关框架，用于高效视频生成。该方法基于注意力熵与保留密度之间的对数线性关系，以及注意力交互主要形成以查询为中心的、半径可变的邻域这一观察，将查询熵映射到分析性令牌预算并转换为时间衰减半径，从而显著减少注意力交互计算量。

Details

Motivation: 视频扩散变换器(VDiTs)虽然能生成高保真视频，但其密集的3D自注意力机制带来了二次方的计算成本。现有的稀疏方法在查询间共享计算预算，忽略了令牌特定的注意力需求。

Result: 在Wan2.1、Wan2.2和HunyuanVideo的七个文本到视频(T2V)和图像到视频(I2V)配置上，TRA仅保留了9-19%的注意力交互，实现了1.56倍至2.05倍的加速，同时保持了有竞争力的生成质量。

Insight: 核心创新点在于将查询的注意力熵与一个分析性的令牌预算相关联，并无需显式键排序即可将其转换为时间衰减半径，从而实现了查询自适应的稀疏注意力。此外，融合熵提取、预热重用和块稀疏掩码构建进一步降低了开销，这是一种高效且无需训练的计算优化方案。

Abstract: Video Diffusion Transformers (VDiTs) enable high-fidelity generation but incur quadratic cost from dense 3D self-attention. Existing head- and block-level sparse methods share computation budgets across queries, overlooking token-specific attention demand. We observe that retained density varies across queries yet correlates log-linearly with attention entropy, while dominant interactions form query-centered neighborhoods with token-dependent radii. Based on these findings, we propose Token Radius Attention (TRA), a training-free framework that maps query entropy to an analytic token budget and converts it into a temporally decayed radius without explicit key ranking. Fused entropy extraction, warm-up reuse, and block-sparse mask construction further reduce overhead. Across seven Wan2.1, Wan2.2, and HunyuanVideo T2V/I2V configurations, TRA retains only 9-19% of attention interactions and achieves 1.56x-2.05x speedup with competitive generation quality. Code is available at https://github.com/IF-LAB-PKU/Token-Radius-Attention.

Nan Bi, Taoyue Wang, Lijun Yin, Vandana Sharma

TL;DR: 本文提出ReMiX-MAE，一种自监督多模态掩码自编码器预训练框架，旨在从同步的RGB、热成像和深度视频中学习可迁移的面部表征，并显式训练对缺失模态的鲁棒性，以实现仅使用RGB视频的临床疼痛评估。

Details

Motivation: 解决临床自动疼痛评估中面临的挑战：临床面部视频数据稀缺且标签弱（序列级自报告），以及RGB视频中疼痛线索可能细微或接近中性，而热成像和深度信号虽信息丰富但难以常规部署。

Result: 在提出的SMP数据集上，ReMiX-MAE在仅RGB部署下，无论是直接特征提取还是从RGB解码的伪多模态特征，均持续优于仅RGB的掩码自编码器基线，在具有挑战性的五分类设置中伪多模态特征带来额外提升。在外部数据集上，ReMiX-MAE相比仅RGB基线展现出更鲁棒和标签高效的迁移能力。

Insight: 创新点在于通过自监督多模态预训练框架学习跨模态表征，并显式训练模型对缺失模态的鲁棒性，使得在仅RGB部署时能利用多模态信息（如通过解码伪多模态特征），这为数据有限的临床环境提供了优势。

Abstract: Automated pain assessment in real clinics is limited by scarce clinically grounded facial video data with weak labels (often sequence-level self-report) and by the fact that pain cues can be subtle or near-neutral in RGB, while thermal and depth signals are informative yet impractical to deploy routinely. To address these challenges, we propose ReMiX-MAE (Reconstructing Missing Channel Cross-Modal Masked Autoencoder), a self-supervised multimodal masked pretraining framework that learns transferable facial representations from synchronized RGB, thermal, and depth videos and explicitly trains robustness to missing modalities, enabling RGB-only deployment. To fill the gap of clinically grounded facial pain data with video-level self-report and longitudinal treatment trajectories, we collect the Sympathetic Mediated Pain (SMP) dataset with paired pre- and post-recordings across multiple visits. Under RGB-only deployment, we evaluate ReMiX-MAE using both direct feature extraction and pseudo-multimodal features decoded from RGB. ReMiX-MAE consistently outperforms an RGB-only masked autoencoder baseline on SMP, with pseudo-multimodal features providing additional gains in the challenging five-class setting. Across external datasets, ReMiX-MAE further shows more robust and label-efficient transfer than RGB-only baselines, highlighting its advantage in data-limited clinical settings.

[232] CAPEval: A Decoupled Caption Evaluation across Understanding and Generation cs.CVPDF

Zhipeng Liu, Haochen Wang, Zhaoxiang Zhang

TL;DR: 该论文提出了一个解耦的标题评估基准CAPEval，将标题质量分解为覆盖度（Coverage）和精确度（Precision）两个维度，并揭示了这两个维度分别与多模态理解和文本到图像生成任务性能的相关性。

Details

Motivation: 现有评估方法将标题质量视为单一标量目标，混淆了标题覆盖的视觉信息量（Coverage）和标题陈述在图像中的可靠性（Precision）这两个不同属性，因此需要更细粒度的评估基准。

Result: 在CAPEval基准上，对来自四个模型家族的10个标题生成器进行了实验，发现覆盖度是多模态理解性能的更强相关指标，而精确度是文本到图像生成性能的主要预测指标。

Insight: 创新点在于提出了解耦的评估范式，将标题质量分解为两个独立的可量化维度，这为针对不同下游任务选择和优化标题生成器提供了可操作的指导。

Abstract: Captions serve as a primary supervision signal for both multimodal understanding and text-to-image generation. However, previous evaluations treat the caption quality as a single scalar objective, which conflates two distinct properties: (1) how much visual information a caption covers and (2) how reliably the image supports its stated claims. To this end, we design a decoupled caption evaluation benchmark, CAPEval (Coverage And Precision Evaluation), with human-written ground-truth captions and human-verified atomic checklist items. Specifically, CAPEval decomposes caption quality into Coverage and Precision. The former quantifies how thoroughly a caption covers ground-truth factual content, while the latter reflects the factual correctness rate of all claims expressed in the caption. We select 10 captioners and further conduct controlled downstream end-to-end experiments with them from four model families, where the caption source is the only variable. Empirically, we find a consistent task-dependent dissociation: Coverage serves as the stronger correlate for understanding performance, whereas Precision acts as the dominant predictor for generation performance. This decoupled evaluation paradigm not only delivers a more fine-grained diagnosis of caption quality, but also offers actionable guidance for selecting and optimizing captioners tailored to different downstream tasks.

[233] WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity cs.CVPDF

Yuxue Yang, Shuyao Shang, Jiahe Wang, Zitong Zhou, Liang Tan

TL;DR: 该论文提出了WorldExam，一个用于评估可控视频生成模型作为世界模型的分层诊断基准，涵盖视觉质量、控制遵循、空间一致性和世界反应性四个层级，包含8个任务共1474个测试案例，支持相机驱动、动作驱动和语言驱动三种模型范式的统一评估。

Details

Motivation: 现有基准主要评估生成视频的视觉质量或显式指令遵循情况，而忽视了世界模型应具备的固有反应性，即根据场景状态推断世界应如何反应并生成输入中未明确描述的合理后果的能力。

Result: 对20个代表性模型的评估揭示了明显的性能分化：相机驱动模型擅长相机控制但接口不支持动态交互；动作驱动模型能更精确控制主体但常使世界无反应；语言驱动模型在交互上表现更好但对复杂控制的遵循度较低。没有模型能同时实现广泛的任务覆盖和持续强劲的性能，表明高视觉质量和显式指令遵循并不能保证固有反应性。

Insight: 论文的创新点在于提出了首个系统评估世界模型固有反应性的分层基准WorldExam，其核心是将评估维度从“外观”扩展到“反应性”，并揭示了当前各类可控视频生成模型在作为世界模型时存在的关键能力短板，即对未明确指定场景变化的推理和生成能力普遍不足。

Abstract: Controllable video generation models are increasingly being developed as world models. Accordingly, evaluating them in this role extends beyond the apparent appearance of generated videos to the inherent reactivity of the worlds they depict: the ability to infer from the scene state how the world should react and to generate plausible consequences not explicitly described in the input. Yet existing benchmarks mainly assess visual quality or explicit instruction fulfillment by checking whether requested actions and interaction outcomes are realized, leaving inherent reactivity underexamined. We introduce WorldExam, a hierarchical diagnostic benchmark spanning four levels: Visual Quality, Control Adherence, Spatial Consistency, and World Reactivity. It comprises 1,474 cases across eight dedicated tasks and supports unified evaluation of camera-, action-, and language-driven model paradigms. The World Reactivity level evaluates scene-conditioned reactions and goal-directed behaviors beyond what is explicitly specified in the input. Evaluation of 20 representative models reveals a clear capability split. Camera-driven models excel at camera control, but their interfaces do not support dynamic interaction; action-driven models control subjects more precisely but often leave the world unresponsive; and language-driven models perform better on interaction but follow complex controls less faithfully. No model combines broad task coverage with consistently strong performance, showing that high visual quality and explicit instruction fulfillment do not guarantee inherent reactivity.

cs.AI [Back]

[234] TRACE-TS: Attribution-Grounded and Traceable Sensor-Language Reasoning for Human Activity Understanding cs.AI | cs.CL | cs.ET | cs.LGPDF

Sparsh Rastogi, Tanmay Kumar, Baiyu Chen, Jatin Bedi, Zechen Li

TL;DR: 本文提出了TRACE-TS框架，用于对可穿戴传感器时间序列数据进行结构化、可追溯且基于信号证据的推理。该方法利用专家分类器的归因识别关键时空区域，构建带有明确证据来源的有向无环图（DAG）推理轨迹，并训练一个紧凑的语言模型通过门控交叉注意力生成这些轨迹。推理时，模型能联合输出活动预测及其推理过程，无需额外的归因计算或教师指导。

Details

Motivation: 现有基于语言模型的方法为传感器数据生成自然语言解释，但其推理过程与底层信号关联较弱，导致解释流畅但不可验证。本文旨在解决可穿戴传感器数据理解中推理缺乏可追溯性和证据基础的问题。

Result: 在七个可穿戴传感器基准测试上，TRACE-TS取得了所有评估方法中最高的平均准确率（84.43%）和F1分数（81.24%），比最佳基于LLM的基线在F1上高出17.96%。

Insight: 创新点包括：1）提出基于归因的、可追溯的传感器-语言推理框架，将信号证据显式融入推理链；2）引入Semantic Node Match（SNM）评估指标，利用LLM作为评判者，在观察、推理和综合层面诊断推理保真度，能定位标准NLG指标遗漏的幻觉观察和证据链断裂问题；3）采用门控交叉注意力机制，使紧凑语言模型能有效利用传感器记忆令牌进行推理。

Abstract: Wearable sensors capture fine-grained motion patterns that support rich behavioral understanding, yet most existing methods reduce these signals to activity labels. Recent LM-based approaches generate natural-language explanations for sensor data, but their reasoning is weakly grounded in the underlying signal, leading to fluent yet unverifiable explanations. We introduce TRACE-TS (Traceable Reasoning with Attribution-Grounded Evidence), a framework for structured and signal-grounded reasoning over wearable time series. TRACE-TS uses attribution from an expert classifier to identify salient spatio-temporal sensor regions, uses them to construct DAG reasoning traces with explicit evidence provenance, and trains a compact language model to generate these traces through gated cross-attention over sensor memory tokens. At inference, the adapted model jointly outputs the activity prediction and its reasoning trace, without requiring attribution computation or teacher guidance. We introduce Semantic Node Match(SNM), an LLM-as-judge metric that diagnoses reasoning fidelity at the observation, inference, and synthesis levels, localizing hallucinated observations and broken evidence chains missed by standard NLG metrics. Across seven wearable benchmarks, TRACE-TS achieves the best average accuracy and F1 among all evaluated methods (84.43%/81.24%), and outperforms the best LLM-based baseline by 17.96% in F1. Our code is available at https://github.com/SparshRastogi/TRACE-TS.

[235] RMSWeb: Reflection, Failure-Mode Mining, and Salvage-DS for Web Agent Reinforcement Learning cs.AI | cs.CL | cs.LGPDF

Chengbo Liu, Lifang Zhou, Ruijie Yan, Pei Tan, Ao Sun

TL;DR: 本文提出了RMSWeb，一个用于训练紧凑型网络智能体的三部分方法，旨在解决数据收集困难和强化学习效率低下的问题。该方法包括反思条件重试以提高数据收集效率，失败模式挖掘以集中离线强化学习于关键状态，以及Salvage-DS技术为被拒绝的更新组提供学习信号。

Details

Motivation: 训练紧凑型网络智能体面临数据收集成本高、成功轨迹效率低，以及监督微调后强化学习中常规状态主导、动作级奖励设计不当导致更新信号弱或误导的问题。

Result: 在WebVoyager、Online-Mind2Web和WebTailBench基准测试上，RMSWeb在8B和32B模型上分别比监督微调基线提升了2.4-7.0和1.2-7.7个点。其中8B模型在同类尺寸的开源模型中取得了最强的Online-Mind2Web结果，并在WebVoyager和WebTailBench上实现了领先的精度-成本权衡。

Insight: 创新点在于整合了反思驱动的数据收集优化、针对失败状态的强化学习聚焦，以及为强化学习中难以更新的动作组设计了一套包含语义极化奖励、动态采样和动作锚点的补救学习机制，有效提升了训练效率和智能体性能。

Abstract: Compact web agents can reduce deployment cost, but training them poses challenges in both data collection and post-SFT reinforcement learning (RL). Successful trajectories are expensive to collect and often contain inefficient detours. After supervised fine-tuning (SFT), full trajectory corpora are dominated by routine states; moreover, when group-relative RL is applied to web actions, inadequately designed action-level rewards can yield weak or misleading relative updates, while groups rejected as unsuitable for such updates receive no fallback learning signal. We present RMSWeb, a three-part recipe for Qwen3-VL-Instruct at 8B and 32B. Reflection-conditioned retries increase collection yield and shorten successful trajectories; failure-mode mining concentrates offline RL on critical states exposed by the SFT policy; and Salvage-DS combines an action-semantic polarized reward, contrast-and-competence-gated dynamic sampling, and an action-only anchor for rejected groups. Policies trained with reflection-collected data use up to 19.7% fewer action steps on solved tasks. On WebVoyager, Online-Mind2Web, and WebTailBench, RMSWeb improves over SFT by 2.4-7.0 points at 8B and 1.2-7.7 points at 32B. Our 8B model also achieves the strongest reported Online-Mind2Web result among similarly sized open-weight models in our comparison and a leading reported accuracy-cost trade-off on WebVoyager and WebTailBench, with the caveat that external evaluation protocols differ.

[236] Bayesian and Motivated Reasoning in AI Agents cs.AI | cs.CLPDF

Eddie Yang

TL;DR: 该论文研究了AI代理在开放任务中受先验信念和情境框架影响的问题，发现即使面对相同数据，AI代理的结论也会因情境框架的不同而改变。在医疗、选举取证和地缘政治预测等高风险领域，代理的结论受先验信念驱动，导致决策不一致。

Details

Motivation: 随着AI代理在关键决策中承担更多开放任务，其结论可能受未指定的先验信念影响，这带来了决策风险。论文旨在揭示AI代理在相同数据下因情境框架变化而产生不同结论的行为。

Result: 在12个代理-领域比较中，代理的结论受先验信念强烈影响，当框架与先验一致时更易得出肯定结论，反之则相反。框架还改变了代理的工作方式，如搜索范围和分析规范。

Insight: 论文创新地识别了AI代理决策中隐藏的先验信念风险，强调了情境框架对代理行为和结论的影响，这为AI系统的透明性和可靠性设计提供了重要见解。

Abstract: AI agents increasingly perform open-ended tasks in settings where their conclusions can guide consequential decisions. We provide evidence that AI agents draw different conclusions from identical numerical data when the substantive framing changes. We demonstrate this behavior in high-stakes domains in medicine, election forensics, and geopolitical forecasting by holding the evidence fixed while changing the scenario in which the evidence appears. Across twelve agent-domain comparisons, agents’ conclusions are strongly influenced by their prior beliefs. They are more likely to reach an affirmative conclusion when it is framed around a proposition they already regard as likely, while the reverse holds when the framing conflicts with their prior. The framing also changes how some agents work: they search more extensively, choose different analytical specifications, and evaluate the same evidence differently. These results identify a particular risk of delegating decision-making to AI agents, as their decisions may depend on prior beliefs that are neither specified in the task nor visible in the decision record.

[237] Where did the ambiguity go? Examining how multimodal models interpret polysemous words cs.AI | cs.CL | cs.CVPDF

Jasin Cekinmez, Addison J. Wu, Raja Marjieh, Thomas L. Griffiths

TL;DR: 本文研究了多模态模型如何处理多义词的歧义性，通过比较17个文生图模型和15个文本生成模型在无上下文条件下生成多义词内容的表现，发现图像生成模型产生的语义多样性远低于文本生成模型，两者均低于人类想象。

Details

Motivation: 人类语言具有高度多义性，但现有研究主要关注大语言模型对多义词的理解，而多模态模型（如图像生成）如何处理多义词的歧义性尚不清楚。

Result: 实验显示，所有模型家族中，生成图像的语义归一化熵（0.10）远低于生成文本（0.25），两者均显著低于人类想象（0.47）；模型预测的生成分布比实际输出更多样，揭示了多模态差距。

Insight: 揭示了基础模型在多模态表达中存在语义多样性差距，表明模型的理解可能无法忠实或平等地跨模态传递；方法上通过无上下文提示和归一化熵量化比较了多模态输出多样性。

Abstract: Human language is highly polysemous. Many common words (e.g., ‘bank’ or ‘palm’) carry several distinct meanings that shape what humans communicate and imagine. Large language models (LLMs) have been shown to understand this multiplicity of meaning, but much less is known about how polysemy surfaces in other modalities such as images. We study this across 17 text-to-image and 15 text-generation models by giving each a polysemous word with no context to fix its meaning and measuring which senses are produced over many samples. We find a clear multimodal gap, where within every model family, generated images settle on far fewer senses than generated sentences (normalized entropy 0.10 vs. 0.25), and both are far less varied than what people imagine for the same words (normalized entropy 0.47). However, when we instead ask a model to list how often it would generate outputs corresponding to each possible meaning of a word, it predicts distributions that are more diverse than the actual space of outputs. These results reveal a multimodal gap in how foundation models express meaning, and how their understanding may not transfer faithfully nor equally across modalities.

[238] Through the LENS: Local Geometric Decomposition of Vision-Language Model Representations cs.AI | cs.CL | cs.CVPDF

Shalom Kachko, Raz Lapid, Margarita Vald, Almog Dubin, Moshe Sipper

TL;DR: 本文提出LENS方法，通过混合因子分析器将视觉语言模型的激活分解为局部低秩高斯邻域，揭示了LLaVA和Qwen3-VL模型中跨模态交互的深度依赖融合轨迹，并展示了该方法在因果干预和检索任务中的有效性。

Details

Motivation: 现有可解释性方法主要识别全局线性方向，可能忽略全局高维但局部低维的表示，因此需要一种方法来理解视觉语言模型中两种模态交互的局部几何结构。

Result: 在LLaVA-1.5-7B和Qwen3-VL-8B上，LENS揭示了不同的融合轨迹；在因果干预任务中，其方法在多数评估条件下优于均值差和VL-SAE方法，在LLaVA视觉到视觉设置中MFA得分是VL-SAE的5.7倍；在检索任务中，MFA系数空间将Qwen3-VL最深层的图像到渲染文本检索R@1从14.9%提升至48.6%。

Insight: 创新点在于将局部几何邻域作为可解释和因果单元来分析跨模态表示，并开发了自动多模态标注流程为这些邻域分配语义描述，这为理解VLMs的内部工作机制提供了新视角。

Abstract: Vision-language models (VLMs) process image patches and text tokens in a shared residual stream, but the local geometry through which the two modalities interact remains poorly understood. Most interpretability methods identify global linear directions, which may miss representations that are globally high-dimensional but locally low-dimensional. We introduce LENS (Local Explanation of Neighborhood Subspaces), a method that decomposes VLM activations into local low-rank Gaussian neighborhoods using a Mixture of Factor Analyzers. Applied to LLaVA-1.5-7B and Qwen3-VL-8B, LENS reveals distinct depth-dependent fusion trajectories consistent with each model’s fusion mechanism: LLaVA progressively mixes modalities at later layers, whereas Qwen3-VL mixes them early, partially re-segregates them, and recombines them near the output. An automated multimodal labeling pipeline assigns concise semantic descriptions to these neighborhoods. Interpolating activations toward neighborhood centroids causally redirects generation within and across modalities and outperforms difference-in-means and VL-SAE in most evaluated conditions; in one LLaVA vision-to-vision setting, MFA achieves 5.7 times the VL-SAE score. Human evaluation finds MFA steering competitive with prompting and substantially stronger than the other intervention baselines. Finally, the MFA coefficient space improves Qwen3-VL image-to-rendered-text retrieval at the deepest evaluated layer from 14.9% to 48.6% R@1. Ablations show that the reported fusion trajectories are stable across component counts, local ranks, and modality-purity thresholds. These results support local geometric neighborhoods as useful interpretable and causal units for analyzing cross-modal representations in the evaluated VLMs.

[239] V-Mem: Modality-Routed Retrieval for Long-Term Multimodal Agentic Memory cs.AI | cs.CL | cs.CV | cs.IRPDF

Dingyi Kang, Dongming Jiang, Yi Li, Guanpeng Li, Bingzhe Li

TL;DR: 本文提出了V-Mem，一种用于长期多模态智能体记忆的系统，旨在解决多模态对话中基于相似性搜索的检索失败问题。该系统通过识别查询和目标证据的模态来路由检索，并利用LLM生成的锚点来缩小相似性与相关性之间的差距，从而在Mem-Gallery和LoCoMo基准测试上显著优于现有方法。

Details

Motivation: 当前LLM智能体的记忆系统大多围绕文本设计，在多模态对话（交织文本和图像）中，当后续查询针对图像时，现有系统经常失败。这源于相似性搜索的两个根本缺陷：模态鸿沟和相似性-相关性鸿沟。

Result: 在Mem-Gallery基准测试上，V-Mem的LLM-judge得分达到0.82，显著优于第二名（0.56），在包含图像的问题上优势最大（0.87 vs. 无基线超过0.47）。在LoCoMo基准上得分为0.69，对比基线为0.58。

Insight: 创新点在于通过模态路由检索来跨越模态鸿沟，以及使用LLM生成的搜索锚点（如假设的标题或增强的文本-关键词组合）来弥合相似性-相关性鸿沟，从而更准确地定位跨模态的相关证据。

Abstract: Interaction between users and LLM agents is increasingly multimodal: conversations interleave text with images, and a later question may target either. Yet most agent memories are designed around text, and even the few that support multimodal conversations still fail on vision-related questions. We trace this failure to an assumption behind the similarity search they rely on: in the index space, a query lies close to the relevant evidence that answers it. In multimodal settings, two gaps break it. By the modality gap, a query lies closer to memory content of its own modality than to evidence in another, even in a trained joint embedding space. By the similarity-relevance gap, the content most similar to a query is often not the evidence that answers it, most acutely when a query carries both text and image and its evidence resembles neither part alone. We present V-Mem, a multimodal agentic memory system that routes retrieval by the modality of the query and that of the target evidence, both recognized from the query alone. To cross the modality gap, V-Mem organizes the conversation into rounds and returns the target-modality content from the same round as the match, without comparing across modalities. To close the similarity-relevance gap, it searches with an LLM-generated anchor that sits closer to the relevant evidence than the query does: a hypothetical caption for a text-only query seeking an image, and an enriched search anchor, the query text plus relevant keywords extracted from the query image, when the evidence is reachable only by combining the two. On Mem-Gallery, V-Mem reaches an LLM-judge score of 0.82 versus 0.56 for the second best, with the largest margin on questions carrying an image (0.87, no baseline above 0.47); on LoCoMo it scores 0.69 versus 0.58.

[240] Does the Competitive Component of Adversarial Self-Play Improve Legal Reasoning? A Controlled Negative Result cs.AI | cs.CL | cs.LGPDF

Miseog Shawn Kim

TL;DR: 本文研究了对抗性自博弈在提升法律推理能力方面的作用，通过设计可验证的‘生存’奖励机制，对比了竞争性训练与非竞争性训练的效果。实验结果表明，竞争性成分并未带来可靠收益，多个独立测试均显示其与基线方法无显著差异。

Details

Motivation: 探讨对抗性自博弈中的竞争性成分是否能为法律推理训练带来额外增益，即通过学生模型生成论点、对手模型攻击论点、并奖励学生论点在攻击下存活的机制，是否优于仅使用相同训练信号的非竞争性训练。

Result: 在四个独立测试（包括引导比较、双种子复制、配对案例对抗鲁棒性比较、盲审生成论点对比）以及后续强化对手的试点实验中，竞争性成分均未产生可靠益处，盲审胜率约为49%（二项检验p≈1.000），强化对手试点胜率为50%（32:32，p≈1.000）。早期看似+29%的优势在更多数据下反转，证明是小样本假象。

Insight: 论文的创新点在于设计了可验证的‘生存’奖励机制，通过引用验证器确保论点存活基于已验证依据而非修辞，自动中和伪造引用。客观分析表明，研究揭示了对抗性自博弈在法律领域的价值可能源于构建可验证环境而非竞争本身，与编码域研究结论一致，并分享了具体陷阱（如早期指标反转、对抗鲁棒性指标悄然退化为普通召回）。

Abstract: Adversarial self-play is an appealing recipe for legal reasoning: have a student model draft an argument, have an adversary attack it, and reward the student when its argument survives the attack. We designed exactly such a training signal – a verifiable “survival” reward in which both the student’s cited authorities and the adversary’s counter-authorities are checked by a citation verifier, so that survival is decided on verified grounds rather than rhetoric, and fabricated citations are automatically neutralized. We then asked a narrow but important question: does the competitive component itself – the adversary and the survival reward – add anything on top of an otherwise identical non-competitive training run? Across four independent tests – a bootstrap comparison, a two-seed replication, a paired per-case adversarial-robustness comparison, and a blinded head-to-head judgment of generated arguments, plus a follow-up pilot with a deliberately strengthened self-play adversary – the competitive component produced no reliable benefit. The blinded judgment gave a 49% win rate (binomial p approx. 1.000); the strengthened-adversary pilot gave a 50% win rate (32:32, p approx. 1.000). An early apparent +29% advantage reversed and proved to be a small-sample artifact. We report this as an honest negative result. The value of the paper is reproducibility and the sharing of concrete pitfalls: an initially promising metric that inverted on more data, and an adversarial-robustness metric that silently collapsed to plain recall once the adversary stopped citing the same authorities as the gold answer. This null is consistent with, and reconfirms in the legal domain, the conclusion of the companion coding-domain study (Kim, 2026, arXiv:2607.08255) that the value of multi-teacher curricula arises from constructing a verifiable environment rather than from competition itself.

[241] Can You Trust the Confidence? ConfBench for Vision-Language Models on Document Extraction cs.AI | cs.CLPDF

Priyashree Roy, Sujitha Martin, Mohammad Rostami, Spencer Romo, Renhao Xue

TL;DR: 本文提出了ConfBench，这是首个针对关键信息提取（KIE）的校准专用基准，通过20种受控退化流程处理多样文档集，生成1,346个变体和70,000多个实体级评估，覆盖全精度范围。评估了四种专有和三种开源视觉语言模型（VLMs）在不同输入模态和置信度估计方法下的表现，发现OCR+图像模态能产生更准确的置信度估计，模型能力是主导因素，校准质量差异显著，且对数概率与首词聚合方法表现最佳。

Details

Motivation: 现有文档基准主要基于干净、高质量样本，导致低精度区域过于稀疏，无法有效评估置信度校准，而智能文档处理（IDP）依赖可信的置信度分数来自动化与人工审核之间的路由决策。

Result: 在ConfBench基准上评估了多种VLMs，发现校准质量从近乎完美到严重过度自信不等，且模型能力（如Claude家族中校准质量随能力单调提升）是主要影响因素，而参数数量预测性差；对数概率与首词聚合方法在置信度估计上持续优于其他聚合策略。

Insight: 创新点包括构建首个KIE校准专用基准ConfBench，引入ECARB指标将判别增益转化为运营节省，并系统分析了输入模态、模型能力和置信度聚合方法对校准的影响，为可信IDP部署提供了系统研究工具。

Abstract: Intelligent document processing (IDP) with vision-language models (VLMs) hinges on confidence scores trustworthy enough to route extractions between automation and human review. Existing document benchmarks are dominated by clean, high-quality samples, leaving low accuracy regions too sparse for calibration assessment. We introduce ConfBench, the first calibration-specific benchmark for key information extraction (KIE), built by applying 20 controlled degradation pipelines to a diverse document set, yielding 1,346 variants and 70K+ entity-level evaluations spanning the full accuracy spectrum. We evaluate four proprietary and three open-weight VLMs under verbalized and log-probability confidence estimation methods across three input modalities, and find: (i) OCR+Image modality results in more accurate confidence estimates; (ii) model capability is the dominant factor: within the Claude family confidence quality scales monotonically with capability, while across families parameter count is a poor predictor; (iii) calibration quality varies widely across models, from near-perfect to severely overconfident, and per-model post-hoc correction rescales these absolute confidence values for threshold-based routing without altering ranking-based operational metrics; and (iv) log-probability with first-token aggregation consistently outperforms mean-token and margin aggregations. We also introduce ECARB, a review-budget metric translating discriminative gains into operational savings. We release ConfBench publicly to enable systematic study of confidence estimators and calibration methods for trustworthy IDP application deployment.

[242] Instruction-Conditioned Exploration with Asymmetric Reinforcement Learning and Self-Distillation cs.AI | cs.CL | cs.LGPDF

Jim Dilkes, Vahid Yazdanpanah, Sebastian Stein

TL;DR: 本文提出了一种名为指令条件探索（ICE）的方法，结合非对称强化学习与自蒸馏（Asymmetric-RL/SD）的训练目标，用于提升大型语言模型（LLM）在强化学习训练中的探索能力。该方法通过在训练时向任务提示添加多样化的指令来增加行为覆盖，并将探索到的行为迁移到无条件的测试策略中，从而在数学推理任务上显著提升了模型性能。

Details

Motivation: 针对大型语言模型在强化学习后训练中因动作空间结构独特而导致的探索挑战，需要利用预训练LLM的广泛知识和灵活性，在训练时主动生成多样化的经验，以改善模型能力。

Result: 在数学推理任务上，使用ICE与Asymmetric-RL/SD目标训练Qwen3-1.7B模型，在4K响应长度下的held-out pass@1性能相比DAPO训练提升了5.0%，且在更长的8K上下文中改进依然持续。

Insight: 创新点在于引入指令条件探索（ICE）来增强行为多样性，并结合非对称强化学习与自蒸馏（Asymmetric-RL/SD）目标，有效将探索行为迁移到测试策略，这为LLM的强化学习训练提供了新的探索和知识转移机制。

Abstract: Post-training Large Language Models (LLMs) with Reinforcement Learning (RL) has become an important tool for improving model capabilities, but the LLM action-space structure introduces challenges distinct from classical RL, with implications for inducing exploration. New methods are required that leverage the broad knowledge and flexibility of pre-trained LLMs to deliberately generate diverse experience at training time. We propose Instruction-Conditioned Exploration (ICE), which supplements task prompts during training with one of several distinct instructions, increasing the coverage of behaviours attempted. To facilitate ICE, we propose Asymmetric-RL/SD, a combined Reinforcement Learning and Self-Distillation training objective, to transfer explored behaviours to the unconditioned test-time policy. ICE with the Asymmetric-RL/SD objective improves Qwen3-1.7B held-out pass@1 performance at $4$K response length on mathematical reasoning tasks by $5.0%$ relative to training with DAPO, with improvement persisting at a longer 8K context.

[243] Right Answer, Wrong Method: Shortcut Hacking Misleads the Evaluation of LLM Reasoning on Frontier Science Benchmarks cs.AI | cs.CLPDF

Xuan Ren, Weiqi Zhai, Tianle Pu, Yihua Zhu, Yihua Zhu

TL;DR: 这篇论文发现，在科学推理基准测试中，大语言模型（LLM）经常通过无效的捷径（如数值搜索、枚举、猜测或答案优先验证）来获得正确答案，这种现象被称为‘解决方案黑客’。研究表明，随着问题难度增加，这种‘黑客’现象显著增多，导致仅基于最终答案的评估会高估前沿LLM的科学推理能力。

Details

Motivation: 论文的动机是揭示当前科学推理基准测试中仅依赖最终答案准确率进行评估的局限性，因为正确答案可能并非来自模型真正的推理能力，而是通过无效的捷径获得的。

Result: 研究发现，在常见问题中‘解决方案黑客’发生率为2.2%，在奥林匹克级别问题中升至28.3%，在HLE中达到37.4%。此外，前沿模型中被判定为正确的答案中有8.2%到44.1%被识别为黑客解决方案。通过引入专家启发的反黑客策略（如自动评判和测试时指令），可以显著降低报告的准确率，但对正确和非黑客的准确率影响较小。

Insight: 论文的创新点在于系统性地识别和量化了LLM在科学推理任务中的‘解决方案黑客’现象，并提出了相应的反黑客评估策略。这揭示了仅靠答案准确性评估的缺陷，强调了需要更细致的评估方法来衡量模型的真实推理能力。

Abstract: Scientific reasoning benchmarks typically evaluate large language models (LLMs) using final-answer accuracy. However, a correct answer does not necessarily demonstrate the reasoning capability targeted by the problem. We identify Solution Hacking, a failure mode in which an LLM reaches the correct answer through invalid shortcuts, such as numerical search, enumeration, guessing, or answer-first verification, without providing a valid task-targeted derivation. We systematically analyze this phenomenon across difficulty levels, scientific domains, and frontier models. Solution hacking increases sharply with benchmark difficulty, from 2.2% on common problems to 28.3% on Olympiad-level problems and 37.4% on HLE. Moreover, 8.2%-44.1% of answers credited as correct across frontier models are identified as hacked solutions. We further develop expert-inspired anti-hacking strategies, including an automatic judge and a test-time instruction. The results show that suppressing shortcut behavior substantially reduces reported accuracy while having a smaller effect on correct and non-hacked accuracy. These findings reveal that answer-only evaluation can overestimate the scientific reasoning capabilities of frontier LLMs.

[244] Linguistic Context Recodes Visual Representations in Vision-Language Models cs.AI | cs.CVPDF

Brian Song, Michael A. Lepori, Ellie Pavlick

TL;DR: 该论文研究了视觉语言模型（VLMs）中语言上下文如何动态地重新编码视觉表征。通过两个具体实例——抽象参考表征的识别和语言诱导的属性调制，论文证明了视觉表征并非静态信息库，而是会根据语言提示进行动态调整以支持下游任务。

Details

Motivation: 研究动机在于探索VLMs在面对目标导向语言时，是否能够像人类视觉智能一样动态地重新编码视觉表征，以支持分类或搜索等任务，而此前研究大多将视觉表征视为由语言表征操纵的静态信息库。

Result: 论文通过提取对比引导向量和因果干预实验，证明了抽象参考表征在模型预测中的因果作用，以及属性调制对VLM响应分布的中介效应，这些现象在不同对象、任务上下文乃至从合成到自然图像中均得到验证。

Insight: 创新点在于揭示了VLMs中跨模态处理的动态本质，即视觉表征会根据语言查询进行动态调制，这挑战了视觉表征是静态的传统观点，为理解模型内部工作机制提供了新视角。

Abstract: Goal-directed visual processing is a hallmark of human visual intelligence, resulting in representations that support downstream tasks such as categorization or search. Though vision-language models (VLMs) are often faced with these same tasks, their ability to recode visual representations when presented with goal-directed language remains poorly characterized. Indeed, prior work largely treats visual representations in VLMs as static repositories of visual information that are manipulated by language representations. In the present work, we provide evidence for two concrete instances of language-induced recoding of visual representations. First, we identify an abstract reference representation that denotes which objects are goal-relevant under a natural language prompt. We extract contrastive steering vectors corresponding to this reference representation and demonstrate that they are causally implicated in model predictions. These reference representations are abstract in that they generalize to different objects, different task contexts, and even from synthetic to naturalistic images. Second, we demonstrate language-induced attribute modulation: later layers selectively amplify goal-relevant attributes in visual representations of objects. We demonstrate this phenomenon across a range of different prompts. Finally, we provide a causal intervention that demonstrates that attribute modulation mediates a VLM’s response distribution. Together, our results support a more dynamic account of cross-modality processing in VLMs – rather than vision tokens serving as static repositories of information, they are modulated to support queries articulated in language.

[245] Similarity Weighted Aggregation with Global Differential Privacy for Federated Brain Lesion Segmentation cs.AI | cs.CR | cs.CVPDF

Muhammad Irfan Khan, Eero Lehtonen, Joni Obradovic, Elina Kontio, Esa Alhoniemi

TL;DR: 本文提出了一种名为DP-SimAgg的隐私保护联邦学习框架，用于脑部病灶分割任务。该框架结合了相似性加权聚合与服务器端差分隐私机制，以应对联邦学习中数据分布异构和模型更新信息泄露的挑战。

Details

Motivation: 联邦学习在医学影像应用中面临两大挑战：跨机构的数据分布异构性（非独立同分布数据）以及通过模型更新可能造成的信息泄露风险。

Result: 在FeTS 2022数据集（包含1251个多模态MRI扫描）上进行评估。在严格的每轮隐私预算（epsilon=1，累计20轮epsilon_total=20）下，增强肿瘤（ET）、肿瘤核心（TC）和全肿瘤（WT）区域的Dice分数分别为0.6357、0.5305和0.5274。在更宽松的隐私预算（epsilon=10）下，性能接近非隐私基线。

Insight: 创新点在于将相似性加权聚合与中心服务器差分隐私（高斯噪声注入）相结合，以缓解非独立同分布数据的影响并提供每轮隐私保证。框架在保持竞争力的分割性能的同时实现了隐私保护，为医学影像的隐私协作学习提供了可行方案。

Abstract: Federated Learning (FL) enables collaborative training of machine learning models across multiple institutions without sharing sensitive data, making it particularly suitable for medical imaging applications. However, heterogeneous data distributions across institutions and potential information leakage through model updates remain important challenges. In this work, we propose DP-SimAgg, a privacy-preserving federated learning framework that integrates similarity-weighted aggregation with a server-side differential privacy mechanism. The proposed method applies L2 clipping to bound collaborator updates, computes similarity-based aggregation weights to mitigate the effects of non-IID data distributions, and injects calibrated Gaussian noise at the central server, providing per-round privacy guarantees under the assumed sensitivity bound. The framework is implemented using Intel’s OpenFL platform and evaluated on the FeTS 2022 dataset consisting of 1251 multi-modal MRI scans for brain tumor segmentation. Experimental results demonstrate that DP-SimAgg maintains competitive segmentation performance while providing privacy protection. Under a strict per-round privacy budget (epsilon = 1, cumulative epsilon_total = 20 over 20 rounds), the method achieves Dice scores of 0.6357, 0.5305, and 0.5274 for the enhancing tumor (ET), tumor core (TC), and whole tumor (WT) regions, respectively. With a more relaxed per-round budget (epsilon = 10, cumulative epsilon_total = 200), performance approaches that of the non-private baseline while incorporating a central Gaussian mechanism with per-round (epsilon, delta)-DP accounting under the assumed sensitivity bound. These results highlight the potential of DP-SimAgg for enabling privacy-preserving collaborative learning in medical imaging applications.

[246] FactorJEPA: Factorizing Monolithic Futures into Layout-Agent-Interaction Channels for Crowded and Chaotic Global South Urban Worlds cs.AI | cs.CV | cs.LGPDF

Kapil Wanaskar, Gaytri Jena, Aman Chadha, Vinija Jain, Vasu Sharma

TL;DR: 该论文针对全球南方拥挤混乱的城市环境（DENSEWORLD）提出了FactorJEPA模型，通过将未来预测分解为布局、智能体和交互三个通道来改进世界模型。作者还发布了首个大规模DENSEWORLD-115k数据集，包含22个城市的1000小时视频数据。实验表明，FactorJEPA在多个预测指标上优于现有JEPA方法。

Details

Motivation: 现有世界模型主要针对低密度、结构化车道场景，难以处理全球南方城市环境中存在的软空间边界、智能体高度异质性、持续遮挡和混合交通下的快速社会协商等挑战。

Result: 在2B和1B参数的V-JEPA 2.1骨干网络上，FactorJEPA在（i）未来帧L1精度、（ii）因果L1预测、（iii）掩码率斜率鲁棒性等指标上均有提升，同时揭示了（iv）可复现的运动-信息权衡关系（运动余弦），方法排名相关性达到rho=0.895-0.978。

Insight: 核心创新是将世界结构作为一等预测原语，通过分解式架构（布局-智能体-交互）配合可见性门控和分离子空间，有效处理部分可观测智能体并防止跨因子捷径学习，这为复杂动态场景建模提供了新范式。

Abstract: World models have attracted significant attention for their ability to capture and predict the structure and dynamics of the physical world. In this emerging landscape, Joint Embedding Predictive Architectures (JEPA) offer a particularly compelling direction. We study a largely unexplored regime: populous, crowded, and chaotic Global South urban environments, which we call DENSEWORLD. Unlike the lower-density, lane-structured settings that dominate existing evaluations, these scenes exhibit soft spatial boundaries, extreme agent heterogeneity, persistent occlusion, and rapid social negotiation under mixed traffic. We introduce the first large-scale dataset for this regime: 1,000 hours of drive-through, walk-through, and aerial video across 22 cities. Existing JEPA formulations struggle to preserve dense interaction dynamics under heterogeneity and partial observability. We introduce FactorJEPA, which makes world structure a first-class predictive primitive. Rather than encoding the future in a monolithic latent, it composes layout, entities, and interactions, using a visibility gate and separated subspaces to preserve partially observed agents and discourage cross-factor shortcuts. FactorJEPA improves (i) future-latent accuracy (Future-frame L1), (ii) intervention-sensitive prediction (Causal L1), and (iii) robustness to reduced visual evidence (Mask-ratio slope), while exposing (iv) a reproducible motion-information trade-off (Motion cosine). Method rankings replicate across 2B and 1B V-JEPA 2.1 backbones, with rho = 0.895 to 0.978. We publicly release the DENSEWORLD-115k dataset (https://huggingface.co/datasets/anonymousML123/denseworld-115k) and the surgery-trained FactorJEPA checkpoints (https://huggingface.co/datasets/anonymousML123/factorjepa-outputs/tree/main/outputs/full/vjepa_2_1_vitg_1B/train/m09c_surgery_3stage_DI_diheavy_encoder).

[247] Abduction Without a Body? Representational Grounding and the Abduction Loop for Scientific Hypothesis Generation cs.AI | cs.CV | cs.IRPDF

Michael Farmer

TL;DR: 这篇论文探讨了科学假说生成中的‘身份溯因’问题，即推断两个独立发展的结构是同一对象。作者提出，并非所有溯因行为都需要持续的具身感知，而是可以通过‘表征接地’和‘约定空间’来实现跨领域检索和假说生成。论文提出了‘溯因循环’架构，并通过一个多模态模型识别引力记忆传输模型与弱引力透镜宇宙学中质量映射复形等价性的案例进行了说明，最后介绍了可证伪的评估基准DAB-30。

Details

Motivation: 针对AI和科学哲学中认为真正的假说生成需要智能体持续与物理世界耦合的观点，论文主张在线具身并非所有科学溯因行为的必要条件，重点研究如何通过表征而非身体交互来实现‘身份溯因’。

Result: 论文提出了‘溯因循环’架构，并通过一个具体案例（多模态模型识别引力记忆模型与弱透镜质量映射复形的等价性）作为可能性见证，但未提供广泛的性能证据；同时引入了可证伪的评估基准DAB-30用于未来测试。

Insight: 创新点在于提出了‘表征接地’和‘约定空间’的概念，使得跨学科数学结构的检索和身份假说生成成为可能，而无需持续具身；‘溯因循环’架构提供了机制化框架，并以‘弃权’作为默认设计，强调了严谨的验证过程。

Abstract: Can scientific abduction occur without continuous sensorimotor embodiment? Recent arguments in AI and philosophy of science hold that genuine hypothesis generation requires an agent continuously coupled to the physical world. We defend a narrower claim: online embodiment is not necessary for every abductive scientific act. Our focus is identity abduction: the inference that two independently developed structures are one object under an explicit correspondence, reached through representational grounding rather than bodily interaction. An agent may acquire new inferential affordances not through physical interaction but through transformations into representations that expose latent invariants. Scientific diagrams are a practical substrate because they embody independently evolved conventions that partially canonicalize symmetry, topology, and operator structure across disciplines - a property we develop as convention space, which answers a hard retrieval problem: finding mathematically related work when two fields share no discriminating vocabulary. We operationalize the mechanism as an architecture, the Abduction Loop: representation generation, motif extraction, convention-space canonicalization, cross-domain retrieval, identity-hypothesis generation, and adversarial verification, with abstention as the designed default. A documented episode, in which a multimodal model given a figure of a gravitational-memory transport model generated and then verified the hypothesis that its central differential complex is equivalent to the spherical Kaiser-Squires mass-mapping complex of weak-lensing cosmology, serves as a motivating possibility witness from which the architecture is abstracted, not as evidence of general capability. We close with a falsifiable evaluation program, the DAB-30 benchmark. The contribution is a mechanistic proposal, an architecture, and a test program.

cs.IR [Back]

[248] Douyin Multimodal Embedding Model Technical Report cs.IR | cs.CL | cs.CVPDF

Haonan Chen, Chu Li, Zhicheng Wang, Yuanwei Liu, Yuanjiang Wang

TL;DR: 本文介绍了抖音多模态嵌入模型（DME），这是一个两阶段训练的多模态表示学习模型，旨在同时实现大规模索引下的高效服务和细粒度匹配的精准判别。第一阶段通过大规模对比预训练建立统一的多模态嵌入空间；第二阶段通过证据驱动的类型化潜在推理和跨条件重构机制增强语义充分性，在不增加在线推理开销的情况下提升细粒度性能。

Details

Motivation: 解决现有MLLM嵌入模型难以兼顾大规模工业场景的效率要求（如十亿级索引）与困难匹配任务所需的细粒度判别能力之间的矛盾。对比模型效率高但监督信号粗糙，而基于思维链的模型虽能提升判别力却无法在线部署。

Result: 在MMEB-v2基准测试中，DME的2B和9B变体分别达到74.8和78.4的分数，取得了可比规模下的最先进（SOTA）结果，尤其在视频和视觉文档任务上表现突出。在抖音内部离线评估集上获得2.92%的相对提升，并在在线A/B测试中为抖音搜索带来0.1%的LT增益。

Insight: 创新性地提出两阶段训练框架，将大规模对比预训练的效率优势与通过训练时机制（证据驱动的潜在推理和跨条件重构）增强的语义充分性相结合，实现了高效服务与细粒度判别能力的统一。其训练时增强、推理时无额外开销的设计具有工程借鉴价值。

Abstract: Multimodal representation learning is a cornerstone of modern AI. By encoding multimodal queries and targets into vectors, it powers industrial search and recommendation and underpins modern agents. Real-world platforms with complex modalities and massive-scale content, such as Douyin, Xiaohongshu, and YouTube, demand both efficiency under billion-scale indexing and fine-grained discrimination for hard matching. Existing MLLM embedding models rarely satisfy both. Contrastive models are efficient but rely on pair-level supervision too coarse for fine-grained distinctions, while CoT-based models improve discrimination through explicit generation impractical to serve online. We present Douyin Multimodal Embedding (DME), a model trained in two stages to combine both strengths. Stage 1 performs large-scale contrastive pre-training that establishes a unified multimodal embedding space with broad modality and task coverage. Stage 2 supplements semantic sufficiency, the property that an embedding is grounded in retrieval-relevant evidence and preserves fine-grained counterpart-side semantics, via two mechanisms. Evidence-Grounded Typed Latent Reasoning organizes retrieval evidence through hidden-space latent reasoning, and Cross-Conditional Reconstruction enforces counterpart-side semantics through cross-directional autoregressive reconstruction. Both act only during training and add only marginal query-side overhead, so DME serves as efficiently as a standard contrastive encoder. On MMEB-v2, DME reaches state-of-the-art results at comparable scales for its 2B and 9B variants (74.8 and 78.4), with especially strong video and visual-document tasks. In production, DME delivers a 2.92% relative gain on Douyin’s in-house offline evaluation set, is deployed across Douyin scenarios such as generative, image, and AI search, and yields a 0.1% Lifetime (LT) gain in online A/B testing on Douyin search.

[249] Disentangled Contrastive Learning for Zero-Shot Multilingual Dense Retrieval cs.IR | cs.CLPDF

Chao Huang, Yufeng Chen, Changhao Guan, Guang Yang, Dongze Chen

TL;DR: 本文提出了一种解耦对比学习方法（DCL），用于零样本多语言稠密检索。该方法通过将多语言表示分离为语义和语言子空间，设计层次化语义对齐和语言去偏对比学习目标，以减少语言因素对语义匹配的干扰，实现从英语监督到多语言检索的稳定零样本迁移。

Details

Motivation: 多语言稠密检索面临低资源语言标注数据稀缺的挑战，现有方法学习的共享表示往往纠缠了语义和语言特征，这可能干扰检索中语义相关性的优化。

Result: 在mMARCO和MIRACL基准上的大量实验表明，该方法持续优于多个强基线，证明了其有效性和泛化能力。

Insight: 创新点在于将多语言表示解耦为语义和语言子空间，并通过层次化语义对齐（句子和词元级别）与语言去偏对比学习联合优化，从而减少语言干扰，提升零样本跨语言检索性能。

Abstract: Multilingual dense retrieval aims to handle queries and documents across different languages based on a unified retriever model. The challenge lies in enabling robust retrieval transfer to low-resource languages where annotated retrieval data is often scarce. Although previous studies transfer high-resource supervision to low-resource languages in multilingual semantic representation learning, the shared representation often entangles semantic and linguistic features, which may interfere with optimizing semantic relevance for retrieval. Different from existing methods that focus on learning language-agnostic semantic features under such entanglement, we propose a disentangled contrastive learning~(DCL) method for multilingual dense retrieval by separating multilingual representations into semantic and linguistic subspaces. Specifically, we design disentangled optimization objectives based on hierarchical semantic alignment and language debiasing contrastive learning. By aligning retrieval-relevant semantics across languages at both sentence and token levels while capturing language-specific variations in the linguistic subspace, these objectives reduce language-induced interference in semantic matching. We jointly optimize them with the retrieval objective to facilitate stable zero-shot transfer from English supervision to multilingual dense retrieval. Extensive experiments on mMARCO and MIRACL show that our method consistently outperforms several strong baselines, demonstrating its effectiveness and generalization ability.

cs.MM [Back]

[250] Estimating SSIM from MSE for DCT-Based Compressed Images cs.MM | cs.CVPDF

Luc Trudeau, Maria G. Martini

TL;DR: 本文提出了一种针对基于DCT压缩图像的SSIM估计方法，通过仅利用参考图像的局部统计信息，将全局PSNR或MSE近似为SSIM。该方法通过基于方差或标准差的权重重新分配全局MSE来近似局部MSE，从而在JPEG压缩图像上实现准确且鲁棒的SSIM估计。

Details

Motivation: 解决在图像和视频处理、压缩及流媒体系统中，进行高效且符合感知意义的图像质量评估的需求。特别是在基于DCT的压缩图像中，如何仅从参考图像出发，利用全局PSNR或MSE来近似SSIM。

Result: 在Kodak和Xiph Subset1数据集上，针对一系列JPEG质量等级进行的实验表明，所提出的两种方法都能提供准确且鲁棒的SSIM近似，其性能显著优于全局MSE基线方法。

Insight: 创新点在于仅需参考图像的局部统计（方差或标准差）来重新分配全局MSE，从而近似局部MSE并估计SSIM，避免了传统方法需要访问局部MSE的假设。该框架设计上可自然扩展到视频质量评估，因为参考图像的统计信息可在同一内容的多次编码中分摊使用。

Abstract: Efficient and perceptually meaningful quality assessment is a fundamental requirement for image and video processing, compression, and streaming systems. This article shows that, in the context of Discrete Cosine Transform ( DCT)-based compressed images, Structural Similarity Index ( SSIM ) can be approximated from global Peak Signal to Noise Ratio (PSNR) or Mean Square Error ( MSE) using local statistics derived only from the reference image. While prior work assumes access to local MSE, we propose two approaches to approximate local MSE by redistributing the global MSE using variance or standard-deviation-based weighting. Experiments on the Kodak and Xiph Subset1 datasets across a range of JPEG quality levels demonstrate that both approaches provide accurate and robust SSIM approximations, substantially outperforming the global MSE baseline. The proposed framework is designed to extend naturally to video, where reference-derived statistics can be amortized across multiple encodes of the same content.

cs.GR [Back]

[251] Hi-TOPS: Hierarchical Topology-aware Scoring Prior for 3D Part Decomposition cs.GR | cs.CVPDF

Ruoyu Wu, Zhenhong Sun, Xiaoming Gong, Yuxin Xian, Zhi Wang

TL;DR: Hi-TOPS是一种用于3D部件分解的分层拓扑感知评分先验方法，它通过聚合多分辨率内在线索形成Flow-Freeze场，以解决结构尺度不匹配问题。该方法首先通过TSDF引导的超二次曲面拟合器捕捉主体核心和残余表面结构，然后进行曲面到网格的分配，最终生成稳定、可编辑且边界对齐的部件分解。

Details

Motivation: 现有3D部件分解方法存在结构尺度不匹配问题：几何分离证据在中观尺度最可靠，但许多流程要么过于全局而忽略关节，要么过于局部而对噪声敏感。

Result: 在多个基准测试中，Hi-TOPS无需语义监督或2D基础先验，即可生成稳定、可编辑的分解结果。

Insight: 创新点在于引入分层拓扑感知评分先验和Flow-Freeze场，将可扩展的Flow区域与限制增长的Freeze区域结合，有效处理关节和薄结构，并通过超二次曲面拟合与网格分配实现边界对齐的部件分解。

Abstract: Accurate 3D part decomposition requires separating shapes into structurally meaningful components with precise boundaries while preserving articulation seams and thin attachments. Existing approaches often suffer from a structural-scale mismatch: geometric evidence for separation is most reliable at the meso scale, yet many pipelines operate either too globally to respect joints or too locally to remain robust to noise. We propose Hi-TOPS, a Hierarchical Topology-aware Scoring Prior that aggregates complementary intrinsic cues into a multi-resolution Flow-Freeze field. Flow regions provide expandable support for primitive coverage, while Freeze regions restrict growth near articulations and thin structures. A TSDF-guided body-surface superquadric fitter then captures dominant cores and residual surface structures, followed by SQ-to-mesh assignment for connected, boundary-aligned parts. Across diverse benchmarks, Hi-TOPS delivers stable, editable decompositions without semantic supervision or 2D foundation priors.

cs.LG [Back]

[252] Abstention as an Action Can Kill Both the Reward Gradient and the KL Anchor: Collapse Law and Repair for Error-Penalized Reinforcement Learning cs.LG | cs.CLPDF

Xujun Che, Yuchen Yuan, Weida Zhao, Chenyang Yu

TL;DR: 该论文研究了在强化学习中采用错误惩罚评分规则（正确回答+1分，错误回答-λ分，弃权0分）时，当弃权被视为离散动作时，KL锚定的梯度学习者可能出现异常行为：模型会逐渐拒绝回答所有问题，导致覆盖率崩溃，而平均训练奖励却虚假上升。论文提出了结构修复方案：训练一个强制性的置信度报告，并在部署时通过阈值化报告来决定是否弃权。

Details

Motivation: 动机是解决错误惩罚评分规则在强化学习应用中，当弃权作为离散动作时，可能导致模型学习崩溃（即拒绝回答所有问题）的问题，尽管该规则本意是用于减少幻觉。

Result: 理论分析和模拟验证了崩溃机制：在特定条件下，模型会漂向拒绝一切，平均训练奖励随时间以1/t上升，而覆盖率崩溃。在语言模型上的实验证实了该机制的存在，并显示修复方案能同时提高覆盖率、准确性和校准度。

Insight: 创新点在于揭示了KL锚定梯度学习与错误惩罚规则结合时，因弃权动作的“门控饱和”因子导致奖励梯度和锚定恢复力同时消失的崩溃定律。关键的结构修复方案是分离训练与部署决策：训练时强制输出置信度报告（使用严格适当评分规则和正确性奖励），部署时再根据报告阈值决定是否弃权，从而避免梯度消失并吸引到校准最优解。

Abstract: Error-penalized scoring rules ($+1$ for a correct answer, $-λ$ for a wrong one, $0$ for abstaining) are increasingly prescribed against hallucination: a rational agent facing such a rule answers exactly when its correctness probability exceeds Chow’s threshold $t^\ast=λ/(1+λ)$. We prove that a KL-anchored gradient learner can do the opposite. When abstention is a discrete action, the reward gradient and the anchor’s restoring force are throttled by the same gate-saturation factor and die together: under explicit conditions (among them, blanket answering loses score in expectation and prompts share a bounded readout) the model drifts toward refusing everything, its mean training reward rising to zero like $1/t$ in training time $t$, so the curve reads as improvement while coverage collapses. The advantage estimator compounds the failure: in its sparse-answer regime, group normalization silently replaces every designed penalty with an effective penalty of one, moving the learned threshold from $t^\ast$ to $1/2$. The repair is structural: train a mandatory confidence report with a strictly proper score plus a correctness reward, and abstain only at deployment by thresholding the report. The always-emitted report has no gate to saturate, so no shared factor can kill its reward gradient and its anchor together, and its calibrated optimum is attracting. Simulations confirm every prediction, and experiments on language models at two scales confirm the mechanism live: the rule silences questions the models demonstrably still solve within ten optimizer steps, an ablation isolates the cause, and report-level training raises coverage, accuracy, and calibration together.

[253] Verifier-Induced Support Reshaping in On-Policy Optimization cs.LG | cs.CLPDF

Shaohang Wei, Zikun Su, Feifan Song, Wen Luo, Wei Li

TL;DR: 本文研究了在具有可验证奖励的在线策略强化学习（RLVR）中，验证器引发的支持集重塑现象。研究发现，RLVR在优化当前目标时，可能导致后续目标成功行为变得过于罕见而难以采样和强化，从而损害跨任务的联合能力。论文通过数学推理和约束指令跟随等任务上的实验，分析了这种效应及其对模型响应分布和未来可训练性的影响。

Details

Motivation: 动机在于揭示在线策略强化学习中使用可验证奖励时，可能出现的验证器引发的支持集重塑问题，即优化当前目标会损害模型对未来目标的采样和强化能力，从而影响跨任务的联合性能。

Result: 在数学推理任务（Math-RLVR）上，使用Qwen3-8B-Base模型在IFEval基准测试中，pass@1提高了6.5个百分点，但best@32下降了9.8个百分点；在约束指令跟随任务（IF-RLVR）上，数学响应从逐步推导转向直接答案，并降低了不同采样预算下的best@k性能。这种性能分化在多个模型和指令跟随基准测试中均出现。

Insight: 创新点在于识别并定义了验证器引发的支持集重塑现象，并通过实验证明RLVR主要对基础策略中已有的响应开头进行重排序，且所选开头会因果影响后续搜索能力。研究指出，端点性能的改进并不能保证未来的可训练性或联合能力，这对在线策略优化的设计具有重要启示。

Abstract: We show that on-policy reinforcement learning with verifiable rewards (RLVR) can improve the current objective while making successful behaviors for later objectives too rare to sample and reinforce. We call this verifier-induced support reshaping and define effective rewardable support as successful trajectories reachable within a fixed rollout budget. Across two model families, we study this effect through repeated verifier-scored sampling and bidirectional training on mathematical reasoning and constrained instruction following, including sequential training with the opposite verifier. Math-RLVR raises average instruction-following success but reduces the number of prompts with any successful response under repeated sampling. On IFEval with Qwen3-8B-Base, pass@1 rises by 6.5 percentage points while best@32 falls by 9.8 percentage points, and the same divergence appears across both models and IF benchmarks. Conversely, IF-RLVR shifts math responses from step-by-step openings toward direct answers, lowers best@k across sampling budgets, and reduces reward variation for later Math-RLVR. Token-distribution analyses and controlled opening interventions show that these changes concentrate in the first few response tokens. RLVR mainly reranks openings already available in the base policy, and the selected opening causally affects math searchability. The tested reference-policy constraints, routing priors, and on-policy distillation preserve cross-task support only partially; MathIF and ReasonIF show that marginal gains translate only partly into responses that are both correct and constraint-following. Therefore, endpoint improvements do not guarantee future trainability or joint capability under on-policy optimization. Code is available at https://github.com/sylvain-wei/verifier-induced-support-reshaping

[254] Question Begets Question: Self-Evolving Curriculum for Reinforcement Fine-Tuning on Competition Mathematics cs.LG | cs.AI | cs.CLPDF

Longtian Bao, Jianyou Wang, Yang Zhang, Youze Zheng, Ramamohan Paturi

TL;DR: 本文提出了一种名为Question-begets-Question（QbQ）的方法，用于解决大语言模型在竞争数学（如AIME）任务上微调时面临的数据稀缺、缺乏推理轨迹和性能瓶颈问题。核心创新是结合QbQ生成变体问题和自演化课程学习，通过强化学习仅使用问题和最终答案进行训练，显著提升了模型性能。

Details

Motivation: 动机是解决语言模型学习新技能时的三大常见障碍：训练数据稀缺、真实推理轨迹通常不可用，以及模型性能存在明显瓶颈，即使增加数据也难以提升。研究在竞争数学（AIME）任务上对Qwen2.5-Math-7B模型进行微调，该模型初始仅能解决5.6%的问题。

Result: 在AIME基准测试上，静态数据增强和非课程QbQ方法分别将pass@1提升至12.5%和14.5%后遇到瓶颈。而提出的自演化课程方法在相同数据预算下，将pass@1提升至16.5%，且在20轮训练后未出现饱和迹象，突破了性能天花板。

Insight: 创新点在于QbQ数据生成流程和自演化课程策略。QbQ通过教师模型将现有问题转化为探究相同底层技能的多样化变体，以缓解数据稀缺。自演化课程则动态评估模型能力，从模型基本能正确解决的问题出发生成变体进行训练，这种反直觉的策略（训练于已掌握问题的变体）能使模型解决训练中未见过的更难问题，有效打破了性能瓶颈。

Abstract: Teaching a language model a skill it has not mastered is obstructed by three recurring difficulties: training data is scarce, ground-truth reasoning traces are usually unavailable, and models often exhibit an apparent ceiling beyond which additional data yields no further improvement. We study these difficulties in a controlled setting, fine-tuning Qwen2.5-Math-7B on competition mathematics (AIME), a task on which it initially solves only 5.6% of problems (pass@1). To address data scarcity, we introduce Question-begets-Question (QbQ), a scalable procedure in which a teacher transforms existing problems into diverse variants that probe the same underlying skills; to model the absence of oracle reasoning, we train exclusively via reinforcement learning on problem statements and final answers, never on teacher reasoning traces. Static training on such data, however, plateaus well short of the task: real-plus-synthetic augmentation and non-curriculum QbQ generated synthetic data training cap pass@1 at 12.5% and 14.5% respectively, despite large increases in data. Our central finding is that this ceiling is not intrinsic to the model. We propose a self-evolving curriculum that, each round, evaluates the current checkpoint, seeds QbQ from the problems it can mostly get right, and trains on the resulting variants; under an identical data budget, this breaks the ceiling and lifts pass@1 to 16.5% with no sign of saturation after 20 rounds. Counterintuitively, we find that models improve when trained on variants of problems they can mostly get right, and that models trained this way go on to solve harder problems never seen during training.

[255] Progressive Agent Skill Generation via Reinforcement Learning cs.LG | cs.CLPDF

Junhao Shen, Zhanqiu Zhang, Yiwen Guo, Hong Cheng

TL;DR: 本文提出了一种名为Skill-α的强化学习方法，用于逐步生成高质量的智能体技能。该方法将技能生成建模为一个顺序编辑过程，通过分解为可单独评估的编辑步骤，并引入一种新颖的回滚奖励机制来评估每个编辑对下游任务执行的影响。实验表明，Skill-α在文档到技能和经验到技能两种设置下，均优于基于启发式或流水线的方法。

Details

Motivation: 现有技能生成方法主要依赖启发式规则或流水线式整合，需要针对不同证据源专门设计，缺乏统一性。基于学习的方法虽提供了更统一的建模方式，但技能本身缺乏基于相关性或正确性的自然监督信号，其价值主要取决于是否能改善智能体在下游任务中的表现，这构成了核心挑战。

Result: 在CL-Bench和tau2-bench基准测试上，使用GPT-4o作为主要工作器时，Skill-α相比最强的技能生成基线方法，平均下游任务成功率分别提升了3.3个百分点和6.7个百分点，达到了新的SOTA水平。消融实验验证了回滚奖励和渐进式生成的重要性。

Insight: 论文的核心创新点在于将技能生成形式化为一个顺序编辑过程，并设计了回滚奖励机制，该机制通过比较原始技能与编辑后技能在锚定查询下的下游执行情况来评估每个编辑步骤，从而为强化学习提供了有效的、基于下游任务表现的监督信号。这为缺乏直接监督的技能学习问题提供了一个新颖的解决方案框架。

Abstract: Existing skill generation methods largely rely on heuristics or pipeline-style consolidation, which must be specially designed for different evidence sources. In contrast, learning-based approaches offer a more unified way to model skill generation across heterogeneous sources. However, learning-based skill generation remains challenging because skills lack a natural supervision signal based on relevance or correctness; their value can largely be determined only by whether they improve the behavior of the agent on downstream tasks. To address this challenge, we propose Skill-$α$, a reinforcement learning method for progressively generating high-quality agent skills. Specifically, we formulate skill generation as a sequential editing process that decomposes skill construction into individually evaluable edits, and introduce a novel rollback reward that evaluates each edit by comparing downstream execution under the original and edited skills on an anchored query. Extensive experiments show that Skill-$α$ generates more effective skills than methods based on heuristics or pipelines in both document-to-skill and experience-to-skill settings. Under the main GPT-4o worker, Skill-$α$ improves average downstream success rates over the strongest skill-generation baseline by 3.3 points on CL-Bench and 6.7 points on tau2-bench. Further ablations validate the importance of rollback reward and progressive generation.

[256] Toward Plasticity-Preserving KL Regularization for Capability Retention in LLM Reinforcement Learning cs.LG | cs.CLPDF

Li Wang, Xiaodong Lu, Xiaohan Wang, Jiajun Chai, Wei Lin

TL;DR: 本文提出了一种名为CoKL的条件KL正则化框架，用于在LLM强化学习后训练中缓解能力遗忘问题。该方法通过将正则化约束从完整输出分布缩小到基于正确性条件的响应分布，从而在提升目标任务性能的同时更好地保留基础模型的已有能力。实验表明，CoKL在多种模型规模和多解决方案环境中比现有正则化方法取得了更优的平衡。

Details

Motivation: 针对LLM强化学习后训练中，优化新目标时可能导致基础模型已有能力退化的问题，标准全策略KL正则化会约束整个响应分布，可能不必要地限制探索和新任务学习。

Result: 在受控多解决方案环境和持续后训练设置中，CoKL在目标任务改进和先验能力保留之间达到了比现有正则化方法更有利的平衡。

Insight: 创新点在于提出了条件KL正则化框架，将约束聚焦于正确响应分布，解耦了正确响应的总概率与其条件分布，避免了参考策略不完美时全策略KL正则化引入的严格最优正确性差距问题。

Abstract: Reinforcement learning (RL) has become a central paradigm for large language model (LLM) post-training, but optimization toward new objectives can degrade capabilities already present in the base model. KL regularization is widely used to mitigate such forgetting by constraining policy drift toward a reference model. However, standard full-policy KL regularization constrains the entire response distribution and may unnecessarily restrict exploration and target-task learning. This raises a natural question: can a more precise constraint preserve existing capabilities while minimizing interference with learning new tasks? To this end, we propose \underline{Co}rrectness-Conditioned \underline{KL} Regularization (CoKL), a conditional regularization framework that narrows the preservation constraint from the full output distribution to correctness-conditioned response distributions. We instantiate CoKL with forward KL divergence and derive a practical finite-group training objective for RL-based LLM post-training. At the population level, CoKL decouples the total probability assigned to correct responses from their correctness-conditioned distribution, thereby regularizing the relative probability allocation among reference-supported correct responses without directly anchoring incorrect outputs or total correctness mass. We further show that full-policy forward and reverse KL regularization induce a strict optimal correctness gap when the reference policy is imperfect, whereas CoKL avoids this limitation. Experiments in controlled multi-solution environments and continual post-training settings across multiple model scales demonstrate that CoKL achieves a more favorable balance between target-task improvement and prior-capability retention than existing regularization methods. Our code is available at https://github.com/Lumina04/CoKL.

[257] Qwen-CUA: Native Computer Use for (almost) Everything cs.LG | cs.CLPDF

Dunjie Lu, Shuai Bai, Tianyi Bai, Sicheng Fan, Chang Gao

TL;DR: 本文提出了Qwen-CUA，一个基于3970亿参数Qwen混合专家模型的原生计算机使用智能体。该智能体仅通过观察屏幕截图并模拟键盘鼠标事件来操作各种软件，无需依赖DOM树或特定API。通过大规模云端训练环境构建了约4万个可验证任务，在八个基准测试中超越了Qwen3.7模型，并与领先的专有系统性能相当。

Details

Motivation: 解决原生计算机使用智能体面临的三大挑战：长时程状态跟踪、大规模交互经验学习以及稀疏但可验证结果的学习。旨在创建一个能够操作几乎所有软件的通用界面，而不依赖特定软件的结构化信息。

Result: 在八个基准测试中表现优异：OSWorld-Verified达到86.2分，OSWorld 2.0的二元/部分完成率分别为18.5/48.4。扩展至万亿参数的Qwen-CUA-Max进一步提升至87.6和21.2/53.3。在RedTeamCUA攻击测试中，将攻击成功率从36.6降至16.4。

Insight: 创新点包括：1）仅依赖视觉输入的原生交互架构；2）支持20个活动截图的视觉历史折叠机制；3）基于大规模云端环境的可验证任务训练方法；4）结合监督学习和强化学习的混合训练策略。核心贡献在于验证了原生计算机使用作为通用智能体基础的可能性。

Abstract: Native computer use offers a general interface for agents to operate almost any software available to people, but requires long-horizon state tracking, large-scale interactive experience, and learning from sparse yet verifiable outcomes. We introduce Qwen-CUA, a native computer-use agent with a 397B-A17B Qwen mixture-of-experts backbone. It observes only screenshots and acts through keyboard and mouse events, without DOM trees, accessibility metadata, or task-specific APIs. Its scaffold maintains up to 20 active screenshots and folds older visual history in fixed-size blocks to retain recent evidence while preserving reusable prompt prefixes. For training, we build a cloud rollout fleet with access to nearly 100,000 vCPUs and tens of thousands of concurrent environments, construct approximately 40,000 verifiable tasks, and collect personalized long-horizon workflows across everyday and professional software. We optimize complete trajectories with verifiable rewards and trajectory slicing, while iterative training runs refresh supervised data and recalibrate reinforcement-learning tasks. Across eight benchmarks, Qwen-CUA outperforms Qwen3.7 and remains competitive with leading proprietary systems, reaching 86.2 on OSWorld-Verified and 18.5/48.4 binary/partial completion on OSWorld 2.0. Scaling the same recipe to a model with over one trillion parameters yields Qwen-CUA-Max, improving these scores to 87.6 and 21.2/53.3. Qwen-CUA also reduces RedTeamCUA attack success from 36.6 to 16.4 relative to Qwen3.7. Efficiency analyses, a browser deployment, and Bash-augmented experiments further characterize practical behavior. These results establish native computer use as a broadly capable agent foundation and highlight scalable verifiable interaction and hybrid tool use as key directions.

[258] RoMeRL: Balancing Feedback Coverage and the Memory-Reward Trap in Self-Evolving Agent Memory via Reduced-Order Utility States cs.LG | cs.CLPDF

Yi Yang, Zhennan Chen, Yihong Zhuang, Tiehan Fan, Yinan Chen

TL;DR: 本文提出了一种名为RoMeRL（降阶记忆强化学习）的方法，用于解决自进化LLM智能体基于学习的记忆系统面临的两个紧密耦合的挑战：反馈在无限增长的状态空间中分散，以及无关经验因共同检索而获得误导性效用更新（即记忆-奖励陷阱）。RoMeRL通过使用固定维度的、按结果极性和记忆动态分解的每任务记忆状态来表示不断增长的轨迹索引效用空间，将新经验纳入一组固定的语义坐标中，从而将反馈集中在有限的效用支撑上。

Details

Motivation: 动机是解决自进化LLM智能体记忆系统中反馈覆盖范围与记忆-奖励陷阱之间的平衡问题。具体来说，轨迹索引的效用空间会随着交互历史增长而无限扩大，导致有限的反馈信息被稀释；同时，轨迹级奖励会共同分配给被共同检索的记忆，使得不相关的经验获得误导性的效用更新，陷入记忆-奖励陷阱。

Result: 在ALFWorld和LifelongAgentBench基准测试上的实验结果表明，RoMeRL提升了任务性能，将Cold-Q比率降低了80.0%，将反馈密度提高了约6.0倍，将维护的记忆大小减少了84.4%，并将LLM调用次数减少了21.1%。这些结果证明了降阶效用状态在支持高效自进化智能体记忆的同时，限制了持续的奖励污染。

Insight: 论文宣称的创新点在于引入了降阶的、固定维度的每任务记忆状态表示（按结果极性和记忆动态分解），将无限增长的轨迹索引效用空间映射到一组固定的语义坐标上，从而集中反馈并避免记忆-奖励陷阱。从客观角度看，这是一种新颖的、理论驱动的记忆系统参数化方法，旨在通过结构化的状态分解和坐标更新机制，在保证记忆效率的同时，提高反馈信息的密度和质量。

Abstract: Learning-based memory systems for self-evolving LLM agents face two tightly coupled challenges. First, trajectory-indexed utilities grow with the interaction history, thereby dispersing limited feedback over an ever-expanding state space. Second, because trajectory-level rewards are jointly assigned to co-retrieved memories, irrelevant experiences may receive misleading utility updates and consequently enter the memory-reward trap. To address these challenges, we introduce Reduced-Order Memory Reinforcement Learning (RoMeRL), which represents the growing trajectory-indexed utility space using a fixed-dimensional per-task memory state factorized by outcome polarity and memory dynamics. RoMeRL incorporates new experiences through a fixed set of semantic coordinates whose contents are updated or replaced over time, thereby concentrating feedback over a bounded utility support. Theoretically, we show that this reduced-order parameterization increases the average feedback received by each utility coordinate and characterize the steady-state occupancy of erroneous coordinates under a generic coordinate-transition model. Empirically, across ALFWorld and LifelongAgentBench, RoMeRL improves task performance, reduces the Cold-Q ratio by 80.0%, increases feedback density by approximately 6.0 times, reduces the maintained memory size by 84.4%, and cuts LLM calls by 21.1%. These results show that reduced-order utility states support efficient self-evolving agent memory while limiting persistent reward contamination. Code is available at: https://github.com/YOUNG-fnxm/RoMeRL

[259] GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoning cs.LG | cs.CLPDF

Zhaoxin Yu, Qi Shen, Hengli Li, Zhaowei Zhang, Song-Chun Zhu

TL;DR: 本文提出了GradCuit方法，通过在Transformer层中插入可优化的隐状态，实现基于测试时优化的隐式推理。该方法利用因果自注意力机制，为整个生成序列的奖励梯度提供了到隐状态的可微分路径，从而直接进行信用分配。

Details

Motivation: 现有基于优化的隐式推理方法通常通过解码的token连接隐状态与推理轨迹，导致序列级信用分配间接且不透明，难以理解隐状态更新如何影响后续推理。

Result: 在五个指令微调骨干模型、三个推理基准测试和两种答案格式上，GradCuit平均准确率达到64.5%，比思维链提示高出6.6个百分点，比最强竞争方法高出2.4个百分点。在七个学习率设置下，其准确率标准差从1.53降至0.82，表现出更强的鲁棒性。

Insight: 创新点在于将可优化隐状态插入选定Transformer层，利用因果自注意力实现从整个生成序列到隐状态的直接梯度传播。该方法通过token级梯度归因和层分析提供了可解释性，揭示了隐状态对推理连接词的影响以及最优优化层位置，实现了LLM在测试时调整推理过程而非仅生成或重排输出。

Abstract: Optimization-based latent reasoning improves large language model outputs by optimizing instance-specific continuous states at test time while keeping model parameters frozen. Existing methods, however, typically connect these states to the reasoning trajectory through decoded tokens, making sequence-level credit assignment indirect and obscuring how latent updates shape subsequent reasoning. We introduce GradCuit (gradient through circuit), which inserts optimizable latent states at a selected Transformer layer between the hidden representations of the prompt and the generated continuation. Causal self-attention provides every continuation-token log-probability with a differentiable path to every preceding latent state through the remaining Transformer blocks, enabling reward-weighted gradients from the entire continuation to be assigned directly to the latents. Across five instruction-tuned backbones, three reasoning benchmarks, and two answer formats, GradCuit achieves an average accuracy of 64.5%, outperforming chain-of-thought prompting by 6.6 percentage points and the strongest competing method by 2.4 points. GradCuit also demonstrates greater robustness: across seven learning-rate settings, it consistently outperforms LatentSeek while reducing the standard deviation of accuracy from 1.53 to 0.82, and even its random-walk variant remains competitive with LatentSeek. For interpretability, token-level gradient attribution reveals that latent influence concentrates on reasoning-connector tokens, while layer analysis identifies early-to-middle Transformer layers as the most effective optimization space. By directly optimizing internal reasoning from outcome feedback, GradCuit opens a new axis of robust and interpretable test-time scaling, where LLMs adapt how they reason rather than merely regenerate, sample, or rerank outputs.

[260] Rethinking Pretraining for Specialized Design Data: Evidence from the JONES-19 Cultural Design Dataset cs.LG | cs.CVPDF

Alexandros Haridis, Charles Zhou

TL;DR: 本文基于JONES-19文化设计数据集，评估了卷积神经网络（CNN）在两种训练策略下的判别性能：ImageNet预训练与从零开始学习。研究发现，尽管领域通用先验能提升性能，但通过多裁剪增强的从零开始学习也能达到类似效果，挑战了大规模通用预训练在高度结构化设计数据上的必要性。

Details

Motivation: 设计和建筑档案以图形格式编码了专家知识，为设计启发的机器学习挑战提供了关键测试平台，而典型计算机视觉基准缺乏此类数据。本文旨在探讨在专门设计领域中，预训练策略的有效性，特别是比较通用预训练与从零开始学习在小型高质量设计数据集上的表现。

Result: 在JONES-19数据集上的实验表明，ImageNet预训练能提升判别性能，但通过重复局部采样（多裁剪）增强的从零开始学习也能有效恢复这些增益。这挑战了依赖大规模通用预训练的传统做法，表明对于高度结构化设计数据，本地设计驱动的表示足以支持学习。

Insight: 论文的创新点在于提出在专门设计领域，精心策划的小型高质量数据集（捕捉经验和形式设计原则）可能比优先大规模数据收集更有效，并能更深入地揭示特定设计领域的本质。从客观角度看，这为资源有限的设计相关机器学习任务提供了替代方案，强调了领域特定数据表示的重要性。

Abstract: Design and architectural archives encode expert human knowledge in graphical formats, providing a critical testbed for design-inspired Machine Learning (ML) challenges absent with typical computer vision benchmarks. Building on JONES-19, a small-size image dataset based on The Grammar of Ornament (London, 1857), we evaluate the discriminative performance of Convolutional Neural Networks (CNNs) in two model training strategies: (a) ImageNet pretraining for domain-general “visual common sense,” and (b) learning from scratch on the design data in JONES-19. We find that while domain-general priors improve discriminative performance, learning from scratch augmented with repeated local sampling (multi-crop) effectively recovers these gains. For highly structured design data, local design-driven representations provide sufficient foundation for learning, challenging a reliance on massive general-purpose pretraining. These findings suggest that in specialized design domains, careful curation of smaller high-quality datasets that capture empirical and formal design principles may prove more effective and informative on the nature of a particular design domain than prioritizing large-scale data collection.

[261] Logit-Origin Centering for Singleton Test-Time Adaptation cs.LG | cs.CVPDF

Mayank Sharma, Rohit Kumar Mourya, Pratik Mazumder

TL;DR: 本文针对表格数据在严格流式（单样本）测试时适应（FTTA）场景下，现有批量依赖方法性能急剧下降的问题，提出了一种轻量级的Prequential Logit-Origin Centering（PLOC）方法。该方法保持源模型冻结，仅通过维护一个历史logit均值来动态调整logit空间，无需标签、先验估计或权重更新，有效解决了单样本流式场景下的分布偏移问题。

Details

Motivation: 现有主流的完全测试时适应（FTTA）方法继承自计算机视觉领域，依赖于批量统计信息，在严格的流式（单样本）测试场景下，由于无法获得可靠的批量级统计量，性能会急剧下降。本文旨在解决表格数据在这种单样本流式FTTA场景下的独特分布适应问题。

Result: 在五个表格数据基准测试集、三种架构（MLP、FT-Transformer和TabTransformer）以及五个独立的源模型检查点上进行评估，PLOC方法显著优于强大的表格数据基线和基于熵的基线方法。

Insight: 核心创新点在于识别并定义了单样本表格FTTA作为一个独特的可识别性问题，并提出了一种极其轻量级的解决方案（PLOC）。该方法通过仅维护一个运行中的logit均值来对logit空间进行中心化偏移，完全绕过了模型权重更新和复杂的统计估计，在保持AUROC不变（延迟变体）或显著提升性能的同时，实现了高效的单样本在线适应。

Abstract: Tabular data is used extensively in many real-world use cases. Deep learning models have been developed to deal with tabular data, but generally perform poorly when the test data distribution differs from that of the training data. Researchers have proposed test-time adaptation approaches to deal with this problem. The fully test-time adaptation (FTTA) setting involves adapting deployed classifiers to shifted target distributions using only unlabeled test data. Leading FTTA methods inherit a batch-dependent approach from computer vision literature. This paper demonstrates for the first time that such approaches degrade sharply in strict streaming regimes where examples arrive and must be classified one at a time. This occurs because at a batch size of one, batch-level statistics become unavailable or poorly estimated. We argue that singleton tabular FTTA is not merely a small-batch variant of ordinary FTTA, but a distinct identifiability problem where only the location of the model’s score stream remains directly observable. To address this, we propose Prequential Logit-Origin Centering (PLOC), a lightweight approach that keeps the source model frozen and shifts the logit space at each step. PLOC stores only a single running number (the mean of past logits), requires no labels, estimates no priors, and bypasses weight updates entirely. A deferred variant applies a static shift that preserves the source ranking, and thus the AUROC, exactly. Evaluated across five tabular benchmarks, three architectures (MLP, FT-Transformer, and TabTransformer), and five independent source checkpoints, PLOC significantly outperforms strong tabular and entropy-based baselines.

cs.SE [Back]

[262] TELLER: Non-intrusive Cross-Layer Root-Cause Analysis for LLM Inference cs.SE | cs.CL | cs.LG | cs.PFPDF

Ruilin Xu, Junyi Li, Pengfei Chen, Zongxuan Xie

TL;DR: TELLER是一个非侵入式的、基于追踪和日志的LLM推理根因分析框架。它通过收集NVTX/CUPTI追踪数据和服务日志，重建每个请求的调用链树，并将日志与执行步骤对齐，从而进行跨层的根因定位。

Details

Motivation: LLM推理已从离线工作负载演变为持续运行的软件服务，但由于单个请求横跨推理引擎、Python/C++后端、主机CUDA API、GPU内核和分布式通信等多个层次，根因分析变得非常困难。现有分析工具（如性能剖析器）仅提供原始时间线，而基于日志的诊断方法往往忽略了跨层执行语义和请求级别的结构。

Result: 在多节点GPU推理工作负载上的实验表明，TELLER在压缩与准确性之间存在权衡：适度的追踪对编码（TPE）词汇表能将每步追踪长度减少80%以上，同时在横向（跨节点通信）和纵向（节点内执行栈）视图上达到最佳整体诊断性能。

Insight: 论文的创新点在于提出了一个非侵入式的、结合追踪与日志的跨层根因分析框架。其核心是引入了依赖感知的因果上下文切片，以保留调用链的父子结构、时序顺序和通信关系，以及一个将此类切片压缩为紧凑结构化令牌序列的追踪对编码（TPE）分词器。在此基础上，TELLER结合了数值候选定位与一个多模态根因模型，能联合预测异常步骤、定位可疑算子并生成自然语言解释。

Abstract: Large language model (LLM) inference has evolved from an offline workload into a continuously operated software service, yet root-cause analysis remains difficult because a single request spans the inference engine, Python/C++ backend, host CUDA APIs, GPU kernels, and distributed communication. Existing profilers expose raw timelines, while log-based diagnosis often misses cross-layer execution semantics and request-level structure. We present TELLER, a non-intrusive Trace- and Log-aware LLM inference Root-cause analysis framework. TELLER first collects NVTX/CUPTI traces and service logs without modifying model binaries, then reconstructs per-request call-chain trees and aligns log lines with the corresponding execution steps. We introduce a dependency-aware causal-context slice that preserves parent-child structure, temporal order, and communication relations, and a Trace Pair Encoding (TPE) tokenizer that compresses such slices into compact structural token sequences with parent, depth, and duration attributes. On top of these representations, TELLER combines numeric candidate localization with a multimodal root-cause model that jointly predicts abnormal steps, localizes suspicious operators, and generates natural-language explanations. Experiments on multi-node GPU inference workloads show a clear compression-accuracy trade-off: a moderate TPE vocabulary reduces per-step trace length by more than 80% while achieving the best overall performance on both horizontal (cross-node communication) and vertical (within-node execution stack) views, whereas more aggressive compression substantially degrades diagnosis quality. Further analyses under low-fault priors, strengthened baselines, modality ablations, explanation-quality checks, and tracing overhead show that TELLER provides a practical triage and evidence-localization substrate for LLM inference RCA.

eess.IV [Back]

[263] Fast Trainable Multilinear Bases for Image Compression eess.IV | cs.CV | cs.LG | math.OC | quant-phPDF

Shiwen An, Zhongyi Ni, Huanhai Zhou, Jin-Guo Liu

TL;DR: 本文提出了一种可快速训练的多线性基函数用于图像压缩，将传统的离散傅里叶变换和离散余弦变换推广到等距多线性基，通过引入少量参数（与图像尺寸呈多对数关系）并保持近线性时间、精确可逆和无参数特性。作者开发了一个系统化框架，将基函数参数化为等距张量网络，并利用黎曼优化在酉矩阵流形上进行训练，以寻找对给定数据集最有效的压缩基。

Details

Motivation: 传统图像和视频编解码器依赖的离散傅里叶变换和离散余弦变换等固定基函数虽然高效，但缺乏适应性。本文旨在通过引入少量可训练参数，在保持传统基函数优点的同时，提升其对特定数据集的压缩效率。

Result: 在自然照片和线条画数据集上，训练后的基函数相比固定基函数持续提升压缩性能。在Quick Draw线条画压缩任务中，在相同重建质量下，所提方法比JPEG的8×8块余弦变换节省约20%的存储空间。

Insight: 创新点在于将等距张量网络（受量子多体理论启发）参数化用于图像压缩基函数，并通过黎曼优化进行训练，从而在保持计算效率的前提下实现数据自适应的压缩基学习。这为传统变换编码提供了可学习的、参数高效的扩展路径。

Abstract: The Discrete Fourier Transform, the Discrete Cosine Transform, and their block-wise variants underpin most deployed image and video codecs. Their effectiveness rests on three properties: they run in near-linear time (linear up to a polylogarithmic factor), they are exactly invertible, and they carry few to no parameters. In this work, we generalize these bases to isometric multilinear bases, allowing a small number of extra parameters, polylogarithmic in the image size, while preserving all three properties. Given an image dataset, we develop a systematic framework that searches this family for the basis compressing the dataset most effectively: the basis is parameterized as an isometric tensor network, inspired by quantum many-body theory, and trained with Riemannian optimization on the manifold of unitary matrices. Across natural photographs and line drawings, the trained bases consistently improve on their fixed, non-parametric counterparts. On Quick Draw line-drawing compression, they store images in roughly $20%$ fewer bytes than JPEG’s $8 \times 8$ block cosine transform at the same reconstruction quality.

[264] Learning to See Locally and Align Clinically with Pathology Semantics for Radiology Report Generation eess.IV | cs.CVPDF

Xuan Cuong Ngo

TL;DR: 本文提出了一种名为PALM的病理感知对齐框架，用于解决放射学报告生成任务中视觉与文本特征对齐不完善的问题。该方法通过共享的病理原型桥接影像证据与文本发现，并引入掩码证据建模来增强图像编码器对局部放射学证据的敏感性。在MIMIC-CXR、IU X-Ray和MIMIC-ABN数据集上的实验表明，PALM能持续提升报告生成质量及针对异常情况的鲁棒性。

Details

Motivation: 现有放射学报告生成方法（如自回归监督或对比学习）存在视觉-文本对齐不可靠或错误分离语义兼容报告的问题，导致模型可能生成缺乏影像证据支持的临床合理报告。

Result: 在MIMIC-CXR、IU X-Ray和MIMIC-ABN基准测试中，PALM在报告生成和异常聚焦鲁棒性方面均取得一致提升，验证了其有效性。

Insight: 创新点在于引入病理原型作为临床语义桥梁，避免兼容病例被错误分离；同时通过掩码证据建模增强局部证据感知，使模型更紧密地结合影像证据生成报告。

Abstract: Recent radiology-adapted vision-language models have achieved strong performance on standard report generation benchmarks, yet their robustness and generalization remain constrained by imperfect alignment and correlation between visual and textual features. Existing methods connect image and text either implicitly through autoregressive report supervision or explicitly through contrastive learning. However, autoregressive supervision alone is insufficient to establish reliable image-text alignment, while contrastive learning can push apart unpaired reports that describe related pathologies simply because they are not paired with the same image. This is problematic in radiology, where different reports may share compatible pathology semantics rather than being true negatives. As a result, the learned representation may fail to organize images and reports around shared pathology concepts, causing the decoder to rely on pretrained language priors and generate clinically plausible reports that are not fully supported by radiographic evidence. To address this issue, we propose PALM, a pathology-aware alignment framework for radiology report generation. Instead of directly matching each image-report pair while separating all others, PALM aligns visual and textual features through shared pathology prototypes. These prototypes provide a clinically meaningful bridge between radiographic evidence and textual findings, allowing cases with similar pathology semantics to move toward common concepts without separating compatible cases. In addition, we introduce Masked Evidence Modeling to strengthen the image encoder sensitivity to local radiographic evidence by learning semantic changes caused by masked image regions. Experiments on MIMIC-CXR, IU X-Ray, and MIMIC-ABN show that PALM consistently improves both report generation and abnormality-focused robustness.

cs.RO [Back]

[265] DexMani: Human-Derived Manipulability Guidance for Dexterous Rotation cs.RO | cs.AI | cs.CVPDF

Xiaoyang Chen, Shengcheng Luo, Haoran Guo, Jiaming Jiang, Wanlin Li

TL;DR: 论文提出了DexMani框架，用于解决灵巧手旋转物体这一序列接触问题。该框架通过将人类演示转化为接触条件化的可操作性演化先验，来指导下游强化学习，从而在不同机器人手形态上高效学习旋转技能。

Details

Motivation: 现有强化学习方法通过试错学习特定机器人手的旋转模式，未显式考虑每次接触转换如何影响后续步骤中手维持物体旋转的能力。论文旨在解决这一不足，通过引入人类先验知识来引导学习过程。

Result: 在Shadow Hand、Allegro Hand和XHand上，DexMani在所有评估场景（包括已知和未知物体）中都取得了最高的成功率。在LEAP Hand上达到了57.5%的平均成功率，优于其他基线方法并产生了更平滑的旋转运动。

Insight: 核心创新在于将人类演示抽象为接触条件化的可操作性演化先验，该先验捕获了成功接触转换如何重塑手可用的物体旋转方向。这使得学习到的技能能够泛化到具有不同运动学和主动接触配置的机器人手形态上。

Abstract: Dexterous object rotation is a sequential contact problem: each support, release, and re-contact decision must both produce the desired object motion, and prepare the hand configuration for continued rotation. Existing reinforcement learning methods discover such movement patterns through trial and error on specific robotic hand embodiments, without explicitly accounting for how each contact transition affects the hand’s ability to sustain object rotation in subsequent steps. We introduce DexMani, a framework that transfers human demonstrations as contact-conditioned manipulability evolution. This prior captures how successful human contact transitions reshape the object-rotation directions available to the hand. DexMani then learns this manipulability evolution and uses it to guide downstream reinforcement learning, enabling rotation skills to be acquired across robot embodiments with distinct kinematics and active-contact configurations. Across the Shadow Hand, Allegro Hand, and XHand, DexMani achieves the highest success rates in every evaluated setting for both seen and unseen objects. DexMani reaches an average success rate of 57.5% on LEAP Hand, outperforming other baselines and producing smoother rotatory motions. Project site: https://dexmani.github.io

[266] ORCESTRA: VLM-driven Visual Robot programming in Mixed Reality cs.RO | cs.CV | cs.HCPDF

Ivan Snegirev, Elizaveta Semenyakina, Mikhail Konenkov, Artem Lykov, Miguel Altamirano Cabrera

TL;DR: ORCESTRA是一个混合现实系统，用于通过无代码路径点示教和语言引导控制来编程机器人数字孪生体。用户在混合现实工作空间中放置机器人孪生体、示教轨迹、保存机器人相关操作序列，或发出语音/文本命令，由视觉语言模型将其转换为结构化的数字孪生计划。该系统支持异构机器人形态，并在物理部署前将混合现实验证作为语言引导机器人编程的安全层。

Details

Motivation: 旨在解决机器人编程的复杂性问题，通过混合现实和视觉语言模型，为异构机器人提供直观、无需编码的编程方式，并确保物理部署前的安全性。

Result: 系统演示了支持多种机器人形态（包括固定基座机械臂、移动基座和人形机器人），并通过混合现实验证作为安全层，但摘要未提及具体的定量基准测试结果或与现有方法的对比。

Insight: 创新点在于将混合现实交互、视觉语言模型驱动的命令理解和数字孪生执行后端紧密结合，实现了无代码、语言引导的机器人编程流程，并为异构机器人提供了统一的、具身感知的验证与预览安全机制。

Abstract: ORCESTRA is a mixed-reality system for programming robot digital twins through no-code waypoint teaching and language-guided control. In a passthrough mixed-reality workspace, users place robot twins on real surfaces, teach trajectories, save robot-relative episodes, or issue spoken/typed commands that a vision-language model converts into structured digital-twin plans. Both interaction modes share a backend for metric grounding, embodiment-aware validation, preview, confirmation, and digital-twin execution. The system supports heterogeneous robot embodiments, including fixed-base manipulators, a mobile base, and a humanoid robot, demonstrating MR validation as a safety layer for language-guided robot programming before physical deployment.

[267] WAM-Diff2: Hierarchical AR-to-Diffusion Distillation for Highly Efficient Autonomous Driving VLA cs.RO | cs.AI | cs.CVPDF

Zhihao Zhu, Hanlin Shang, Mingwang Xu, Feipeng Cai, Zhuolin He

TL;DR: 该论文提出了WAM-Diff2，一个用于高效自动驾驶视觉-语言-动作模型的多任务离散扩散框架。它通过一种三阶段分层蒸馏策略，将预训练的自回归通用模型转化为并行扩散模型，旨在结合多任务认知智能与执行效率。该方法有效缓解了曝光偏差，在保持性能的同时显著提升了推理速度。

Details

Motivation: 现有端到端自动驾驶VLA模型因自回归顺序解码导致计算延迟高和曝光偏差问题，而从头训练的专用扩散策略模型虽延迟低但缺乏全面的视觉-语言推理能力且多为单任务。因此，需要一种方法将预训练的自回归通用模型高效转化为并行扩散模型，以结合两者的优势。

Result: 在驾驶理解、感知和规划等多个基准测试上的广泛评估表明，WAM-Diff2有效缓解了曝光偏差，性能与自回归基线相当。通过自回归到扩散的转换实现了2.8倍的解码加速，结合FlashInfer和CUDA Graphs等系统级优化后，最终加速达到15.1倍。

Insight: 核心创新点是提出了一个三阶段分层蒸馏策略（渐进式块级适应、块级蒸馏和模型级跨尺度蒸馏），以结构化的方式解决自回归与扩散模型之间注意力模式（因果与双向）和优化目标不匹配的架构挑战，从而在保持基础模型语义基础的同时实现高效并行推理。

Abstract: Vision-Language-Action (VLA) models have emerged as a prominent paradigm for end-to-end autonomous driving; however, their efficient deployment is severely constrained by high computational latency and exposure bias arising from sequential autoregressive decoding. Conversely, while specialized diffusion policies enable low-latency, parallel execution, training them from scratch typically yields narrow, single-task architectures that lack holistic visual-linguistic reasoning. Successfully transforming pre-trained autoregressive generalists into parallel diffusion models could combine multi-task cognitive intelligence with execution efficiency, yet this transition presents a formidable architectural challenge due to mismatched attention patterns (causal versus bidirectional) and divergent optimization objectives. To bridge this divide, we introduce WAM-Diff2, a multi-task discrete diffusion VLA framework powered by a three-stage hierarchical distillation strategy. By structuring the architectural shift through progressive block-wise adaptation, block-wise distillation, and model-wise cross-scale distillation, WAM-Diff2 preserves the underlying semantic foundations of the base model while accelerating inference. Extensive evaluations across driving understanding, perception, and planning benchmarks demonstrate that WAM-Diff2 effectively mitigates exposure bias and achieves performance parity with autoregressive baselines. Crucially, the autoregressive-to-diffusion transition yields a 2.8x decoding speedup, which scales to an ultimate 15.1x acceleration when combined with system-level optimizations including FlashInfer and CUDA Graphs.

[268] FeDepth: Federated Learning for Depth Estimation under Robot Heterogeneity cs.RO | cs.CVPDF

Ganghyeon Lee, Inha Lee, Junhee Lee, Jeongeon Lee, Sung Whan Yoon

TL;DR: 本文提出FeDepth，一种基于描述符的聚类联邦学习框架，用于解决机器人深度估计中的异构性问题。该方法通过软聚类建模客户端关系，允许客户端参与多个聚类，以捕获机器人环境中常见的连续且模糊的域转移。实验表明，FeDepth在多种深度估计架构上均优于标准联邦学习和聚类联邦学习基线。

Details

Motivation: 现有机器人感知方法多依赖集中式学习，难以扩展到异构机器人平台；而联邦学习在客户端异构性导致的域偏移下性能严重下降。现实机器人部署中数据分布常重叠，难以清晰划分客户端域，这打破了聚类联邦学习中客户端域可清晰分离的假设。

Result: 大量实验表明，FeDepth在多个深度估计架构上，相比标准联邦学习和聚类联邦学习基线，持续提高了鲁棒性。

Insight: 创新点在于提出了两种反映平台、环境和深度分布异构性的现实非IID场景，并设计了基于描述符的软聚类联邦学习框架，以建模模糊的客户端关系，更贴合机器人环境的连续域过渡特性。

Abstract: Although recent robot perception research emphasizes training on data from diverse environments to improve generalization, most existing methods still rely on centralized learning, which is inefficient and difficult to scale across heterogeneous robot platforms. Federated learning (FL) offers an alternative by enabling distributed training without raw data transfer, but it suffers from severe performance degradation under domain shifts caused by heterogeneity across clients. In real robotic deployments, data distributions often overlap across platforms, environments, and sensing conditions, making it difficult to partition clients into clearly separated domains. However, this characteristic breaks the assumption of clearly separable client domains commonly used in clustered FL. To address this gap in robot perception, particularly in depth estimation, we introduce two realistic and unexplored non-IID scenarios that reflect heterogeneity in terms of platform, environment, and depth distribution. We then propose FeDepth, a descriptor-based clustered FL framework that models client relationships through soft clustering. Unlike hard clustering methods that assume clearly separated clusters, FeDepth allows clients to participate in multiple clusters, capturing continuous and ambiguous domain transitions commonly observed in robotic environments. Extensive experiments demonstrate that FeDepth consistently improves robustness over standard FL and clustered FL baselines across multiple depth estimation architectures, providing a practical and effective solution for federated robot perception. Our project page is available at https://vision3d-lab.github.io/fedepth/.

[269] PRISM: Privileged Probabilistic Latent Supervision for End-to-End Autonomous Driving Motion Planning cs.RO | cs.CVPDF

Volodymyr Havrylov, Faris Janjoš, Andreas Look, Jürgen Mathes, Andreas Geiger

TL;DR: 本文提出了一种名为PRISM的概率深度监督框架，用于端到端自动驾驶运动规划。该框架通过将模型隐变量视为可重参数化的分布，并利用未来真实路径直接正则化中间隐表示，从而优化架构。在nuScenes数据集上的评估表明，该方法在保持计算开销可忽略的同时，显著降低了规划误差和碰撞率。

Details

Motivation: 针对端到端自动驾驶系统标准训练中仅依赖输出监督导致复杂模型隐层梯度弱的问题，以及现有视觉语言模型监督方法理论机制不明确的情况，本文旨在探索更有效的隐层监督机制。

Result: 在nuScenes数据集上，使用相同的训练数据和端到端架构，该方法相比有竞争力的矢量化基线，规划L2误差降低了8%，碰撞率降低了3%。

Insight: 核心创新点在于揭示了性能提升源于隐层与真实数据间的连接，而非先前假设的VLM推理能力，并据此提出了一个基于证据下界的概率深度监督框架，直接利用真实轨迹信息进行正则化。

Abstract: End-to-end autonomous driving (E2E AD) systems integrate perception, prediction, and planning into a single differentiable architecture. While these models show great promise, their standard training often relies on output-only supervision, which can lead to weak gradients for the hidden layers of increasingly complex models. Recent works have integrated vision-language model (VLM) supervision for latent features to address this, yielding substantial empirical gains, yet leaving the underlying theoretical mechanisms poorly understood. Our investigation into this methodology reveals that the resulting performance gains stem not from VLM reasoning capabilities, as previously assumed, but rather from the latent connections forged between the E2E AD model and ground-truth (GT) data during training. Building on this insight, we propose a probabilistic deep supervision framework that regularizes intermediate latent representations directly from GT data. By treating model latents as reparameterizable distributions, we optimize the architecture via the Evidence Lower Bound (ELBO). Our evaluations conducted on the nuScenes dataset demonstrate that supervising trajectory-related latents with future GT paths consistently improves planning performance. Using identical training data and E2E architectures, our method achieves an 8% reduction in planning L2 error and a 3% decrease in collision rates compared to competitive vectorized baselines, all while incurring negligible computational overhead.

[270] Hermite Curves as Trajectory Priors for Vision-Language-Action Models cs.RO | cs.CVPDF

Qi Lv, Jianming Xing, Zhao Yang, Mingyuan Yao, Yinan Shi

TL;DR: 本文针对视觉-语言-动作（VLA）模型中动作块作为弱结构化接口导致运动不平滑和边界不连续的问题，引入了埃尔米特轨迹先验，将轨迹参数化为由端点位置和速度定义的分段三次埃尔米特曲线，以显式强制平滑性和连续性。论文提出了三种实现变体：Hermite Tokens、Hermite Scaffold和Hermite Regularization，并在仿真基准和真实机器人平台上进行了评估。

Details

Motivation: 现有VLA模型通常将动作块扁平化为每时间步的控制，依赖于隐式数据学习，导致物理执行时出现锯齿状运动和边界不连续，因此需要一种显式结构化的轨迹先验来解决这些问题。

Result: 在仿真基准LIBERO上，Hermite Regularization将基线成功率从95.9%提升至98.7%；在LIBERO-plus上从85.7%提升至90.9%；在四个真实机器人任务上从63.4%显著提升至90.0%，且没有增加额外推理开销。

Insight: 核心创新点是将轨迹先验参数化为分段三次埃尔米特曲线，显式强制平滑性和连续性。客观分析表明，将轨迹先验作为学习归纳偏置（如通过正则化）比作为运行时约束更有效，这为VLA模型的动作表示提供了新的结构化设计思路。

Abstract: Despite recent progress in Vision-Language-Action (VLA) models for robotic manipulation, the action chunk remains a weakly structured interface. Existing work typically flatten each chunk into per-timestep controls, relying on implicit data learning that manifests as jagged motion and boundary discontinuities during physical execution. To address these limitations, we introduce Hermite trajectory priors, parameterizing the chunk trajectory as a piecewise cubic Hermite curve defined by endpoint positions and velocities to explicitly enforce smoothness and continuity. We instantiate this fixed operator across discrete autoregressive and continuous generative paradigms via three variants: (1) Hermite Tokens, which predict quantized boundary variables autoregressively; (2) Hermite Scaffold, which decomposes clean actions into a base scaffold and residuals; and (3) Hermite Regularization, which applies the prior strictly as an auxiliary training objective. Across simulation benchmarks and real-robot platforms, Hermite Regularization achieves superior performance among these three variants, improving π0.5 baseline success rates from 95.9% to 98.7% on LIBERO, 85.7% to 90.9% on LIBERO-plus, and 63.4% to 90.0% across four real-robot tasks without additional inference overhead. Trajectory analyses reveal that explicitly structuring trajectory priors serves most effectively as a learning inductive bias rather than a runtime constraint.

[271] SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space cs.RO | cs.CVPDF

Ruiteng Zhao, Zhengshen Zhang, Yue Su, Wenshuo Wang, Jiahui Li

TL;DR: 本文提出了一种名为SG-WAM的自引导世界建模框架，该框架直接在策略派生的表示空间中学习几何感知的动作条件动力学。它通过引入可学习的动力学令牌和一个自引导世界预测器来预测未来潜在状态，并利用策略骨干的指数移动平均副本生成预测目标，同时结合几何监督来结构化表示。

Details

Motivation: 现有世界动作模型（WAMs）通常在预测未来动态时，要么依赖于感知负担重的观测空间目标，要么依赖于未联合结构化以同时满足动作相关性和几何感知的辅助潜在空间，无法同时满足动作生成对齐和几何感知的要求。

Result: 基于一个9亿参数模型且无需大规模具身预训练，SG-WAM在LIBERO基准上取得了98.5%的平均成功率，在LIBERO-Plus上达到73%，并在分布内和分布外的真实世界评估中均优于强基线。

Insight: 主要创新点在于提出了一种自引导框架，直接在策略表示空间中联合学习几何感知的动力学，通过动力学令牌、自引导预测器以及结合几何监督的端到端优化，实现了动作相关性与几何感知的统一，从而提升了世界模型的性能。

Abstract: World Action Models (WAMs) couple action generation with prediction of future states. Their effectiveness depends on whether future dynamics are modeled in a space that is both aligned with action generation and sufficiently geometry-aware to capture where and how actions change the scene. Existing WAMs typically satisfy only part of this requirement, relying on either perceptually heavy observation-space targets or auxiliary latent spaces that are not jointly structured for action relevance and geometry. We propose SG-WAM, a self-guided framework that learns geometry-aware action-conditioned dynamics directly in the policy-derived representation space. SG-WAM introduces learnable dynamics tokens and a Self-Guided World Predictor that forecasts their future latent states conditioned on intervening robot actions. Prediction targets are generated by an exponential moving average copy of the same policy backbone, providing stable supervision within the representation family used by the action expert. Geometric supervision further structures the policy image-token representations, providing spatially grounded context for the dynamics tokens and yielding a future-alignment space that is both action-relevant and geometry-aware. Latent future prediction, geometric grounding, and flow-matching action generation are jointly optimized end-to-end in a unified framework. Built on a 0.9B model without large-scale embodied pretraining, SG-WAM achieves 98.5% average success on LIBERO and 73% on LIBERO-Plus, while outperforming strong baselines in both in-distribution and out-of-distribution real-world evaluations.

[272] GenTrack: Physical Alignment for Robot-Native Motion Generation and Zero-Shot Humanoid Tracking cs.RO | cs.CVPDF

Zeyu Ling, Xinyao Yu, Renye Yan, Jikang Cheng, Zhanke Wang

TL;DR: GenTrack是一个在线生成器-跟踪器框架，通过交替执行基于执行的、组相对生成器对齐与在新生成参考上的跟踪器训练，旨在缩小重定向参考与机器人原生运动之间的可执行性差距。

Details

Motivation: 解决通用人形跟踪器在零样本覆盖上依赖大规模且成本高昂的具身语料库，以及文本到运动生成器在人类运动或重定向数据上训练时存在的运动学合理性与机器人可执行性之间的差距问题。

Result: 在Unitree G1上评估，使用ProtoMotions和SONIC骨干网络，在包括公开AMASS和LAFAN基准以及一个包含1,024个野外提示-运动对的私有分布外测试集上进行零样本跟踪测试。在线协同训练策略持续产生输出更可执行运动且语义对齐强的生成器，以及零样本覆盖更广、跟踪精度更高的跟踪器，尤其在分布外参考上表现突出。

Insight: 创新点在于提出在线联合后训练框架，通过生成器与跟踪器的交替对齐和训练，有效缩小可执行性差距，无需额外数据收集，超越了静态参考池的限制，提升了零样本人形控制能力。

Abstract: General-purpose humanoid trackers can execute diverse references, but their zero-shot coverage depends on large embodied corpora that are costly to extend. Text-to-motion generators offer scalable supervision, yet models trained on human motion or retargeted data inherit a gap between kinematic plausibility and robot executability. Existing one-way pipelines fix either the generated corpus or the reward tracker. We introduce GenTrack, an online generator–tracker framework that alternates execution-grounded, group-relative generator alignment with tracker training on newly generated references; anchoring and rehearsal constrain drift. On Unitree G1, we evaluate GenTrack with ProtoMotions and SONIC backbones across three zero-shot tracking splits including public AMASS and LAFAN benchmarks, and a private out-of-distribution test set of 1,024 prompt-motion pairs in the wild. The online co-training strategy consistently produces generators that output more robot-executable motions with strong semantic alignment, and trackers with markedly broader zero-shot coverage and improved tracking accuracy, especially on out-of-distribution references. These results demonstrate that joint online post-training effectively narrows the executability gap between retargeted references and robot-native motion, advancing zero-shot humanoid control without additional data collection and beyond the limitations of a static reference pool.

[273] Roomer: Reflective Object-Grounded Model Editing and Repair for 3D Indoor Layout Synthesis cs.RO | cs.CVPDF

Lingwei Dang, Ziyan Qiu, Jiajia Cheng, Shishuo Shang, Zhenhao Zhang

TL;DR: 本文提出了Roomer，一种用于修复3D室内布局合成中局部违规问题的反射性修复框架。该框架将布局编码为RoState，通过RoReview将违规问题与相关物体绑定，利用几何条件视觉语言模型规划器提出结构化局部编辑，并通过确定性求解器验证和生成候选编辑。实验表明，Roomer能有效修复残留违规，保持有效区域，并提升物理有效性和实用性。

Details

Motivation: 现有室内布局生成器可能产生全局合理但局部违规的布局，如碰撞、越界放置、开口阻塞和流通受阻，而先前工作多关注全场景合成或场景级优化，缺乏对识别责任物体和局部修复受影响区域的支持。

Result: 在Roomer-Eval基准测试中，Roomer修复了残留违规，保持了有效区域，提高了物理有效性和实用性，并能跨外部生成器迁移。

Insight: 创新点包括将违规问题建模为稀疏的、基于物体的修复问题，引入RoState和RoReview进行编码和绑定，以及使用几何条件视觉语言模型规划器进行结构化局部编辑。从客观角度看，该方法通过可控腐败数据集Roomer-CC训练规划器，并引入综合评估基准Roomer-Eval，增强了修复的精确性和实用性。

Abstract: Existing indoor layout generators produce globally plausible layouts yet may retain local violations such as collisions, out-of-bounds placements, obstructed openings, and blocked circulation. Most prior work focuses on full-scene synthesis or scene-level optimization, with limited support for identifying responsible objects and locally repairing affected regions. We present Roomer, a reflective repair framework that casts these violations as sparse, object-grounded repair problems. Roomer encodes layouts as RoState'' and uses RoReview’’ to bind measured violations to implicated objects. A geometry-conditioned vision-language model planner proposes a structured local edit, while a deterministic solver validates it and generates a finite set of candidate edits when needed. Each candidate is committed only if full-scene verification confirms that it resolves the target violation without new hard violations or broken protected constraints. We train the planner on Roomer-CC, a controlled-corruption dataset that pairs faulty layouts with object-grounded violation evidence and known-feasible inverse StatePatches. Since existing benchmarks rarely assess whether physically valid layouts are usable, we introduce Roomer-Eval to assess distributional quality, physical validity, and practical usability. Experiments show that Roomer repairs residual violations while preserving valid regions, improves physical validity and usability, and transfers across external generators.

cs.CR [Back]

[274] Auditable Release Control for Pedagogical Leakage in LLM Tutors cs.CR | cs.AI | cs.CLPDF

Nizam Kadir

TL;DR: 本文针对大型语言模型（LLM）辅导系统在未授权情况下过早泄露答案或关键推理（即“教学泄漏”）的问题，提出了一种可审计的发布控制框架。该框架通过一个包含选择器、可信策略门和渲染器的授权感知完全中介边界，并采用单一发布函数执行可检查的验证，从而在安全性和实用性之间取得平衡。

Details

Motivation: 解决LLM辅导系统在教学中过早或未授权地披露答案或决定性推理（即“教学泄漏”）的问题，确保教学内容的发布符合预定的授权策略。

Result: 在599个固定的Gemini 3.5提案上，严格中介将盲审三模型专家组多数泄漏标志从181个降至0个（配对问题簇差异-30.22点，95% CI [-35.00,-25.72]），但降低了帮助性。在40个未见问题簇和480个攻击序列的外部时间戳复制实验中，高保证发布将多数标志从42个降至8个（-7.08点，95% CI [-13.13,-2.29]）。全局A1支架在自动安全性和实用性上优于拟合Q。

Insight: 创新点在于将教学泄漏形式化为状态和动作依赖的故障，并引入了授权感知的完全中介边界，通过可审计的发布函数和可重放的追踪实现故障归因。该方法强调在声明合约下的可审计发布和故障归因，而非追求通用的语义安全或学习收益，为LLM辅导系统的可控内容发布提供了结构化框架。

Abstract: Large language model tutors can be correct and helpful yet disclose an answer or decisive reasoning before that disclosure is authorized. We formalize this state- and action-dependent failure as pedagogical leakage and introduce an authorization-aware complete-mediation boundary. A selector emits one of five disclosure contracts, trusted policy gates privileged modes, and a renderer proposes language. A single release function applies inspectable checks, optional cumulative verification, and action-specific fallback; replayable traces separate selection, generation, verification, and enforcement failures. Matched component attribution exposes a safety-utility frontier. On 599 fixed Gemini 3.5 proposals, strict mediation reduces blinded three-model panel-majority leakage flags from 181 to 0 (paired problem-cluster difference -30.22 points, 95% CI [-35.00,-25.72]), while replacing 581 responses and lowering helpfulness. Checker-triggered fallback alone yields 11 majority flags; adding the semantic verifier yields 14 and no reliable marginal gain. A global A1 scaffold yields 0 majority and 54 any-judge flags, outperforming fitted Q on automatic safety and utility. In an externally timestamped replication over 40 unseen problem clusters and 480 attack sequences, high-assurance release reduces majority flags from 42 to 8 (-7.08 points, 95% CI [-13.13,-2.29]); seven failures persist, one is introduced, and mean helpfulness falls by .192. These results establish an auditable release boundary and failure attribution under declared contracts, not universal semantic safety or learning gains.

[275] A False Average: Chain-of-Thought Monitors Collapse Where They Are the Only Defense cs.CR | cs.AI | cs.CL | cs.LGPDF

Shikhar Shiromani, Leo Richter

TL;DR: 本文揭示了思维链（CoT）监控在防御奖励攻击时的严重脆弱性。研究表明，攻击者仅需重写智能体的推理过程，使其看起来是善意的工程，同时完全复制命令和输出以保持攻击不变，就能使监控器在特定子集上的捕获率从约95%骤降至11%以下。监控器的整体准确率是一个虚假的平均值，它掩盖了在仅依赖CoT信号的场景下监控近乎完全失效的事实。

Details

Motivation: 论文旨在解决思维链监控的潜在安全漏洞，特别是当攻击者能够控制推理过程时，这种旨在通过推理捕捉隐蔽奖励攻击的防御机制可能被轻易绕过。

Result: 在梯度无关的单次攻击下，留出监控器对特定攻击子集的捕获率从约95%降至11%以下。攻击在不同监控器家族和智能体模型间具有可迁移性，且在真实智能体上可复现；面对经过校准的监控器时，规避攻击主要集中在最强的智能体上。仅基于轨迹的防御只能部分恢复性能。

Insight: 核心创新点在于揭示了CoT监控在对抗性重写攻击下的根本性脆弱性，并指出整体性能指标会掩盖其在关键子集上的彻底失败。客观分析认为，其重要见解是：仅依赖内部轨迹信息（即使包含攻击先验）的防御不足，需要外部信息才能有效检测这种意图欺骗；同时，对监控器激活的探测能分离其漏判的攻击，但这仅表明存在可检测的信号，而非监控器本身具备秘密知识。

Abstract: Chain-of-thought (CoT) monitoring is meant to catch the reward hacks that look clean in the actions and betray themselves only in the reasoning. We show that this is exactly where an adversary who controls the reasoning can defeat it. Rewriting only an agent’s reasoning to read as good-faith engineering, while copying every command and output verbatim so the exploit is unchanged, drops a held-out monitor’s catch rate on that subset from about 95% to under 11% in one gradient-free shot. A monitor’s aggregate accuracy is a false average: dominated by hacks the actions give away, it hides the near-total collapse this rewrite produces on the subset where CoT monitoring is the only signal. The attack transfers across monitor families and agent models, reproduces with live agents, though against a calibrated monitor evasion concentrates in the strongest agent. Trace-only defenses recover it only partially, even one primed on the attack, because the rewrite stays truthful about what happened and lies only about intent; only information from outside the trace helps substantially. A probe on an open-weight surrogate monitor’s activations separates the hacks its verdict misses, but a causal control shows this is a detector, not evidence the monitor secretly knows.

Table of Contents

cs.CL [Back]

[1] RubricReviewer: From Direct Critique to Objective and Comprehensive Rubric-Driven Peer Review cs.CL | cs.AIPDF

[2] Cost-Effective Automated Judging of Natural-Language Mathematical Proofs cs.CL | cs.AI | cs.LGPDF

[3] Obshazard-bench: Benchmarking Multimodal Foundation Models for Real-Time Disaster Intelligence from Raw Earth Observation Streams cs.CL | cs.AI | cs.CY | cs.LGPDF

[4] SLMs as Multi-Agent Routers: A Progressive SFT and Reinforcement Learning Approach cs.CL | cs.AIPDF

[5] What Transfers from Text to Vision? Capability Scaling Laws and Transfer Dynamics for VLMs cs.CL | cs.AI | cs.CVPDF

[6] Exploring More to Solve More: Boosting Diversity in Text Diffusion Models via Entropy-Based Guidance cs.CL | cs.AIPDF

[7] XL-DocBench: Benchmarking Evidence-Grounded Extra-Long Document Understanding cs.CL | cs.AIPDF

[8] DiffusionGemma Technical Report cs.CL | cs.AIPDF

[9] Cross-Task Dissociation in Frontier Vision-Language Model Theory of Mind cs.CL | cs.AI | cs.CV | cs.MA | q-bio.NCPDF

[10] SeDeM: Selective Decompression of Hidden-State Memories for Long-Context Question Answering cs.CLPDF

[11] CurveShift: Is Agent Progress Scalar? Separating Level from Shape cs.CL | cs.LGPDF

[12] Deep Research Pretraining via Predictive Navigation cs.CLPDF

[13] AdaMTP: An Adaptive Training Paradigm for Multi-Token Prediction cs.CL | cs.AIPDF

[14] SERL-SQL: Selective Hindsight Distillation for Text-to-SQL Reinforcement Agentic Learning cs.CLPDF

[15] Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages cs.CL | cs.AI | cs.LGPDF

[16] TreeProbe : A Tibetan Medicine Benchmark for Cultural Bias in LLMs cs.CLPDF

[17] Select-And-Extract: A Lightweight Plugin for Retrieval-Augmented Generation cs.CLPDF

[18] AttnLink: Turning Attention into Schema Links for Text-to-SQL cs.CLPDF

[19] Distill Where You Fail: Recovering Learning Signals of Negative RL-Groups from Adaptive Teacher Guidance cs.CLPDF

[20] Practical Online KV Cache Compaction for LLM Agents: An Empirical Study cs.CLPDF

[21] Gaokerena: A Small Persian Medical Language Model Family cs.CLPDF

[22] MedUPS: Towards Diagnostic Assistance in Uncommon Medical Cases with Large Language Models cs.CL | cs.AIPDF

[23] Why LLMs Give In: Conversational Factors and Reasoning Behind Medical Sycophancy cs.CL | cs.AIPDF

[24] Cloud-ScPO: Hidden-State Geometry for Semi-Supervised Preference Optimization in LLM Reasoning cs.CL | cs.AIPDF

[25] Evaluating VLMs on Multimodal Aristotelian Persuasion Tasks cs.CL | cs.MMPDF

[26] Attend to Your Own Thoughts: Breaking the Barrier for Post-Training Quantization of Reasoning LLMs through the Lens of 1.58-Bit Quantization cs.CL | cs.AIPDF

[27] CrossLex: A Source-Grounded Benchmark for Cross-Jurisdictional Legal Reasoning in Large Language Models cs.CLPDF

[28] RH-RAG: Trustworthy Long-Form Generation for Privacy-Constrained Settings cs.CLPDF

[29] BiCAA: Bidirectional Credit Assignment for Search-Augmented Agent cs.CLPDF

[30] LongChart VQA: A Comprehensive Benchmark for MLLMs with Complex Multi-Chart Reasoning cs.CL | cs.AI | cs.CVPDF

[31] Prompt-Induced Waste in Large Reasoning Models: A Preregistered Two-Harness Benchmark of Coding Agents cs.CLPDF

[32] EviSD: Evidence-Conditioned Self-Distillation for Search-Augmented Agents cs.CLPDF

[33] HopRefusalBench: Diagnosing Refusal Failures in Search-Augmented Agents for Multi-Hop Reasoning cs.CLPDF

[34] PALMs: Using Multi Construct-Grounded Rationales for Modeling Population Preferences in LLMs cs.CLPDF

[35] Semantic Alignment of AI Models: Concept Collapse, Checkpoint Dynamics, and Cross-Lingual Transfer cs.CL | cs.LGPDF

[36] PICTURE: Enhancing Theory-of-Mind in Large Language Models by Revealing, Not Hiding, Characters’ Lack of Knowledge cs.CL | cs.AIPDF

[37] Discriminative Axis, Not Data Volume: What a Contrastive Corpus Teaches an Audio Embedding cs.CL | cs.SDPDF

[38] RING: Retrieval-Internalized Generation for Continual Large-Scale Knowledge Injection cs.CL | cs.AIPDF

[39] Does Accuracy Equal Evidence? Reasoning Faithfulness under KV Cache Compression cs.CLPDF

[40] TRAM: Enhancing Multimodal Reasoning with Trajectory-Derived Auxiliary Memory cs.CLPDF

[41] Look Ahead Before You Distill: Future Trajectory Validation of Teacher Guidance for Agentic On-Policy Distillation cs.CL | cs.LGPDF

[42] CAVE: Competence-Aware Visual Boundary Evidence Alignment for Video Temporal Grounding cs.CL | cs.CVPDF

[43] IACM-RL: Intent-Aware Context Management and Reinforcement Learning for Complex Tool Invocation under Dynamic Intent Fluctuations cs.CL | cs.AIPDF

[44] Cross-Domain Hybrid OPD for Generalizable Search Agents cs.CLPDF

[45] Self-Improving Large Language Models via Progressive Experience Evolution cs.CL | cs.AI | cs.LGPDF

[46] Global Optimization and Inference-Time Region Grafting for Agentic Workflows cs.CLPDF

[47] ScrambleToolBench: Agents Search Exhaustively Even When Their Own Map Points to the Next Step cs.CLPDF

[48] AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling cs.CLPDF

cs.CV [Back]

[49] PhysAgent: A Multi-Agent Framework for Reliable Remote Heart Rate Estimation cs.CVPDF

[50] SafeBuild-Bench: A Temporal-Robust Construction Safety Benchmark with Graph-Enhanced Data Mining cs.CVPDF

[51] Explainable Multimodal AI for Adaptive Calibration of Archaeological Sensing Workflows cs.CVPDF

[52] Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs cs.CV | cs.AIPDF

[53] Beyond Accuracy: Auditing Spatial Provenance in Visual Token Pruning for OCR-Critical MLLM Inference cs.CVPDF

[54] LeapTalk: Breaking the Latency-Quality Trade-off in Talking Head Generation cs.CV | cs.SDPDF

[55] From Pixels to PCells: A Neurosymbolic Approach to Photonic Component Creation cs.CV | physics.opticsPDF

[56] DS@GT ARC at MEDIQA-CORE-Task-1 2026: Trimodal Model Fusion with Task-Specific Gates for Brain Tumor Subtype Classification cs.CVPDF

[57] Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh cs.CVPDF

[58] Logographic Character Visual Pretraining via Semantic-based Contrastive Learning cs.CV | cs.AIPDF

[59] SPARC-Rad: A Multimodal Benchmark Dataset and Evaluation Pipeline for Spatial and Anatomical Reasoning in Radiology Vision-Language Models cs.CV | cs.AIPDF

[60] Distill What RGB Can Recover: Privileged 3D Evidence for RGB-Only Vision-Language Models cs.CVPDF

[61] Counting the Cost of War Under Satellite Embargo: Zero-Shot Estimation of Impacted Infrastructure cs.CV | cs.AIPDF

[62] RadPRISM: Schema-stratified radiology-report supervision for concept-disentangled image representations and visual grounding cs.CV | cs.LGPDF

[63] Learning How Much, Not Just What: Cross-Patient Burden Order for CT Vision-Language Pretraining cs.CVPDF

[64] Real-Time Visual Obstruction Detection in Surgical Augmented Reality cs.CVPDF

[65] Attention-Steered Vision-Language Models for Sign Language Translation cs.CVPDF

[66] Latent-Centroid Steering: Single-Pass Classifier-Free Guidance for Command-Aligned Autonomous Driving cs.CV | cs.ROPDF

[67] MDWD: A Street-Level Dataset for Municipal Solid Waste Detection in Dense Urban Environments cs.CVPDF

[68] Semantically Calibrated Evidence Composition for CT Vision-Language Learning cs.CVPDF

[69] Interpretability-Guided Soft Pruning of Attention Heads in Vision Transformers cs.CV | cs.AIPDF

[70] The 1st AI Children Challenge cs.CVPDF

[71] ORCA: ORgan-Centroid Aggregation for Training-Free 3D CT Visual Token Compression cs.CV | cs.AIPDF

[72] Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy cs.CV | cs.AIPDF

[73] Decoding Children’s Gait Behavior cs.CVPDF

[74] Poplar: A Scalable Pipeline for Human-Centric Image Dataset Synthesis cs.CVPDF

[75] Beyond Static Anchors: Bounded Prototype Conditioning for Language-Free Medical Anomaly Detection cs.CV | cs.AIPDF

[76] Structured Proxy Features for Multimodal NSCLC Survival Prediction from Pretreatment CT cs.CV | cs.AIPDF

[77] DreamTraj: Generating 6-DoF Object Trajectories by Reading Unrendered Video Diffusion Latents cs.CVPDF