cs.CL [Total: 44]
cs.CV [Total: 120]
cs.AI [Total: 9]
cs.GR [Total: 1]
cs.HC [Total: 2]
cs.IR [Total: 2]
cs.LG [Total: 8]
cs.NE [Total: 1]
cs.RO [Total: 9]
cs.SD [Total: 1]
cs.SE [Total: 1]
eess.IV [Total: 3]
q-bio.QM [Total: 1]

cs.CL [Back]

[1] Artifact Distillation: Training-Free Transfer from Frontier to Small Language Models cs.CL | cs.AI | cs.LGPDF

Mustafa Safa Ozdayi, Somin Wadhwa

TL;DR: 论文提出 Artifact Distillation（工件蒸馏）：不微调小模型，而让教师模型将解题过程外化为可查询的工件库，学生在推理时查询使用，实现从前沿大模型到小模型的无训练迁移，并在多个 LiveBench 任务上验证有效性。

Details

Motivation: 传统蒸馏需用教师输出微调学生模型，迁移能力受训练算力约束且知识不透明；论文希望以无需梯度更新的方式低成本、可查询地转移前沿模型能力。

Result: Claude Opus 4.5 生成的工件库使 Claude Haiku 4.5 在空间推理上以 60% 成本达到 0.707，超过 Sonnet 4.5 的 0.647；在表格连接任务上以 89% 成本达到 Sonnet 4.5 水平；同一原始工件库将 Qwen3.5-27B 的 pooled score 从 0.730 提升到 0.800。

Insight: 创新点在于将教师解题过程外部化为推理时可查询的工件库，把能力迁移与训练计算解耦，并提供更可检查的迁移形式；结果还显示该方法可跨教师模型家族生效。

Abstract: Closing the gap between frontier and smaller language models is usually approached by distillation: fine-tuning the small model (student) on a frontier model’s (teacher) outputs, which binds transfer to training compute and leaves the transferred knowledge largely opaque. We propose Artifact Distillation: a teacher solves training instances and externalizes its problem-solving procedure into an artifact bank that a student queries at inference time, with no gradient updates. Across four LiveBench tasks, a bank written by Claude Opus 4.5 lets Claude Haiku 4.5 outperform unaided Claude Sonnet 4.5 on spatial reasoning (0.707 vs. 0.647) at 60% of its cost, and reach Sonnet 4.5’s level on table joining at 89% of its cost. The same raw bank raises Qwen3.5-27B’s pooled score from 0.730 to 0.800, showing that transfer is not confined to the teacher’s model family.

[2] Supervised Fine-Tuning for Reasoning Large Language Models: A Survey cs.CL | cs.AI | cs.LGPDF

Yongcan Yu, Kuangpu Guo, Jian Liang, Lingxiao He, Meng Wang

TL;DR: 该论文是一篇关于推理大语言模型监督微调（SFT）的综述，围绕长思维链数据的监督微调展开系统梳理。文章从方法设计与分析研究两个视角，总结数据中心和算法中心的改进，并从数据特性、优化动力学和机制解释三个维度归纳分析进展，最后展望未来方向。

Details

Motivation: 推理大语言模型在复杂任务上表现突出，而基于长思维链数据的SFT是激发和增强推理能力的关键基础；但该领域缺乏系统综述来整合快速增长的文献。

Result: 作为综述论文，本文不提出新方法且未报告定量实验结果或在benchmark上的性能；其主要成果是建立推理SFT的方法分类体系、分析框架，并总结研究焦点、瓶颈与未来方向。

Insight: 创新点在于以“方法设计+分析研究”双视角系统组织推理SFT文献：方法上分为数据中心与算法中心，分析上归纳为数据特性、优化动力学与机制洞察，为后续研究提供结构化参考。

Abstract: Large reasoning models have recently demonstrated remarkable capabilities in solving complex tasks, where supervised fine-tuning (SFT) on long chain-of-thought data serves as a crucial foundation for eliciting and enhancing their reasoning abilities. Despite rapid progress in both improving and analyzing reasoning-oriented SFT, the field still lacks a systematic survey that consolidates its fast-growing literature. To fill this gap, we present a comprehensive review of recent advancements in reasoning SFT, examining the literature through the dual lenses of methodological design and analytical investigation. First, we review methodological improvements across the SFT pipeline and categorize them into data-centric approaches and algorithm-centric innovations. Second, we reorganize analytical studies along three dimensions: data characteristics, optimization dynamics, and mechanistic insights. Finally, by synthesizing current research focuses and remaining bottlenecks, we outline promising future directions for reasoning SFT. We hope this survey deepens the understanding of reasoning SFT and paves the way for advanced reasoning models.

[3] Rank-Aware Differentially Private Release of Listwise Preferences for LLM Alignment cs.CL | cs.AIPDF

Junwei Chen, Manjiang Yu, Pengpeng Qiao, Yang Cao

TL;DR: 论文研究在本地差分隐私（LDP）下发布列表式偏好数据以用于大语言模型对齐的问题。针对完整排序空间敏感度过高、直接加噪会抵消列表式监督优势的挑战，提出一种秩感知指数机制，将列表式偏好私有化转换为低敏感度的固定大小二元划分数据。实验表明该方法在下游LLM对齐任务中优于现有LDP基线。

Details

Motivation: 列表式偏好比成对比较提供更丰富的监督信号，但完整排序会泄露更多敏感用户偏好；现有隐私保护对齐方法主要关注成对反馈，列表式反馈在LDP下的对齐尚未被探索。直接扩展LDP到列表式场景会因排序空间敏感度过高而需要过量噪声，从而削弱列表式监督的价值。

Result: 在下游LLM对齐任务上的实证评估显示，在相同隐私预算下，该机制持续优于现有LDP基线方法。

Insight: 论文的创新点在于分析监督粒度与隐私噪声在下游训练中的交互，并提出秩感知指数机制：利用排序信息采样固定大小的二元划分，将噪声集中在边界项附近而非像随机响应那样均匀扰动所有项。客观上，该设计通过降低发布数据的敏感度，在满足LDP的同时保留列表式偏好的监督优势。

Abstract: Listwise preference feedback offers richer supervision for large language model (LLMs) alignment than pairwise comparisons, but a full ranking also reveals more sensitive user preferences. Existing privacy-preserving alignment methods focus mainly on pairwise feedback, while listwise alignment under local differential privacy (LDP) remains unexplored. Extending LDP to this listwise domain raises a critical challenge: the high sensitivity of the full ranking space demands excessive noise, neutralizing the benefits of listwise supervision. To address this challenge, we analyze the interaction between supervision granularity and privacy noise in downstream training, and introduce a rank-aware exponential mechanism that privatizes listwise preference data into a low-sensitivity granularity suitable for downstream alignment. The mechanism leverages ranking information to sample a fixed-size binary partition, concentrating the noise near borderline items instead of perturbing all items uniformly as randomized response (RR) does. Empirical evaluations on downstream LLM alignment tasks show that our mechanism consistently outperforms existing LDP baselines at matched privacy budgets. The code is available at https://github.com/tdsai-lab/RAEM.

[4] Grounding Long Financial Text with Semantically-Enriched Tables via Multimodal Learning cs.CLPDF

Xiaoyu Hu

TL;DR: 论文提出一个多模态 Transformer 框架，用于建模结合结构化表格与噪声长文本披露的金融长文档。方法将金融表格表示为语义增强的 token 序列，并通过交叉注意力与长文本融合，使每个数值变量同时编码数值大小和经济含义。实验表明结构化数值特征是主要预测信号，而文本信息在通过交叉注意力而非简单拼接时能带来稳定增量收益。

Details

Motivation: 金融长文档中结构化表格数据与噪声非结构化文本披露并存，如何有效融合二者并利用文本中的增量信息是核心问题。论文关注在保持表格数值语义表达的同时，实现参数高效的长文本条件聚合。

Result: 在大规模财务报表与管理层讨论与分析（MD&A）披露数据上，结构化数值特征仍是主导预测信号；文本信息通过交叉注意力融合时带来一致增量增益，优于简单拼接。摘要未给出具体数值或 benchmark 分数。

Insight: 创新点在于用文本定义构造数值变量的语义嵌入，将表格表示为语义增强 token 序列，并以交叉注意力实现跨模态依赖建模。进一步地，使用冻结的变量级表格表示作为交叉注意力查询，使模型能针对每个金融变量和观测对 MD&A 片段进行差异化加权，提供了表格条件的长文本证据聚合机制。

Abstract: We propose a multimodal transformer framework for efficiently modeling long1 financial documents that combine structured tabular data with noisy, unstructured2 textual disclosures. The framework represents financial tables as semantically3 enriched token sequences and integrates them with long-form text through a cross-4 attention mechanism that explicitly captures cross-modal dependencies. In par-5 ticular, we augment each numerical variable with a semantic embedding derived6 from its textual definition, enabling the model to encode both numerical magnitude7 and economic meaning. This design yields a more expressive and parameter-8 efficient representation of tabular data compared to value-only embeddings. Using9 a large-scale dataset of financial statements and MD&A disclosures, we show that10 structured numerical features remain the dominant source of predictive signal;11 however, textual information provides consistent incremental gains when incor-12 porated via cross-attention rather than simple concatenation. Our results further13 demonstrate that noisy textual disclosures are most useful when conditioned on a14 stable, semantically structured tabular representation. In particular, using frozen15 variable-level tabular representations as cross-attention queries enables the model16 to weight MD&A chunks differently for each financial variable and observation.17 These findings suggest that cross-attention provides an efficient mechanism for18 table-conditioned aggregation of long-form narrative evidence.

[5] FAD-KV: Adaptive Dictionary KV Caching for Efficient Reasoning Decoding cs.CL | cs.LGPDF

Yuxuan Zhu, David H. Yang, Parisa Shiravani, Mohammad Mohammadi Amiri, Tejaswini Pedapati

TL;DR: 论文提出 FAD-KV，一种用于高效推理解码的快速自适应字典 KV 缓存压缩框架。它通过筛选式稀疏编码降低解码时稀疏编码开销，并用固定大小字典自适应机制复用不活跃原子，避免字典在生成过程中无限增长。实验表明其在推理和长上下文基准上取得较好的质量-效率权衡。

Details

Motivation: 随着生成长度增加，KV 缓存的内存和计算线性增长，长输出推理需要高效压缩。现有基于字典的稀疏 KV 压缩在解码时存在迭代稀疏编码开销大、静态字典与测试时演化 KV 分布不匹配，以及自适应更新导致字典增长等问题。

Result: 在推理和长上下文基准上的实验显示，FAD-KV 实现了较强的质量-效率权衡，并避免了解码过程中字典无界增长；摘要未给出具体定量指标或 SOTA 对比。

Insight: 创新点在于将一次性 Top-n 筛选候选池与轻量系数细化结合，降低稀疏编码成本；同时采用固定大小字典自适应机制，通过复用不活跃原子而非追加新原子来控制字典增长。客观看，其价值在于同时约束稀疏编码计算和自适应字典内存增长，面向长推理负载的 KV 压缩更实用。

Abstract: Key-value (KV) caching is a core mechanism in large language models, where intermediate key and value representations are stored to accelerate autoregressive decoding. As generation length increases, KV cache memory and computation grow linearly, making compression critical for efficient long-output reasoning. Dictionary-based sparse KV compression is appealing because it represents each token’s KV states as a sparse combination of learned basis elements (atoms) in a dictionary, preserving token-level structure without enforcing a global low-rank constraint. However, existing dictionary-based methods face two practical limitations during decoding: iterative sparse coding methods such as Orthogonal Matching Pursuit add decoding-time overhead, and static dictionaries may mismatch evolving KV distributions under test-time generation. While adaptive dictionary updates can reduce this mismatch, naive append-only strategies lead to dictionary growth during generation. We propose FAD-KV, a \textbf{F}ast \textbf{A}daptive \textbf{D}ictionary KV caching framework for efficient reasoning decoding. FAD-KV integrates (i) a screening-based sparse coding scheme, where a one-shot Top-(n) selection identifies a small candidate pool followed by lightweight coefficient refinement, and (ii) a fixed-size dictionary adaptation mechanism that reuses inactive atoms instead of expanding the dictionary. By controlling both sparse coding cost and adaptive dictionary growth, FAD-KV provides a memory-bounded and computation-efficient KV compression framework for long reasoning workloads. Experiments on reasoning and long-context benchmarks show that FAD-KV achieves a strong quality-efficiency trade-off while avoiding unbounded dictionary growth during decoding.

[6] QMUL_AK at AISA-ArabicFC: Schema-Constrained Function Calling with ALLaM cs.CLPDF

Ali Khairallah, Arkaitz Zubiaga

TL;DR: 论文介绍 AISA-ArabicFC 2026 的 QMUL_AK 参赛系统，基于 ALLaM-7B-Instruct 使用 LoRA 适配阿拉伯语函数调用。系统结合阿拉伯语 schema 感知提示、方言与 no-call 重采样、token 加权训练目标，并对生成调用进行候选工具 schema 的确定性校验；同一输出支持 Track A 函数调用和 Track B 推理增强调用。

Details

Motivation: 关注阿拉伯语函数调用任务，尤其是方言差异和参数抽取带来的鲁棒性问题，希望在仅使用官方任务数据的条件下提升工具选择和参数匹配能力。

Result: 开发集函数准确率 0.9982、参数完全匹配 0.8920，Track A/B 总分为 0.9345/0.9454；盲测集 Track A/B 总分为 0.9253/0.9380，两个赛道均排名第 3；Track C 方言鲁棒性诊断以 0.9075 宏平均分在 21 支队伍中排名第 1，并取得最小方言差距 0.077。

Insight: 创新点在于将 schema 约束、方言/no-call 重采样、token 加权目标与确定性 schema 校验结合，适配阿拉伯语函数调用并兼顾推理增强调用；结果也表明函数选择接近饱和，参数抽取仍是主要误差来源。

Abstract: We describe the QMUL_AK submission to AISA-ArabicFC 2026. The system adapts the Arabic-English ALLaM-7B-Instruct model to function calling with low-rank adaptation (LoRA). It combines an Arabic schema-aware prompt, dialect and no-call resampling, a token-weighted training objective, and deterministic validation of generated calls against the candidate tool schema. The same output supports Track A function calling and Track B reasoning-augmented calling. Training uses only the official task data. On the development set, the system achieves 0.9982 function accuracy and 0.8920 argument exact match, corresponding to overall A and B scores of 0.9345 and 0.9454. On the blind test set, the system reaches overall A and B scores of 0.9253 and 0.9380, ranking 3rd on both submission tracks and 1st of 21 teams on the Track C dialect-robustness diagnostic with a macro-averaged score of 0.9075 and the smallest dialect gap in the shared task (0.077). The results show that function selection is nearly saturated, while argument extraction remains the main source of error.

[7] CARF: Context-Aware Reasoning Supervision for Scientific Evidence Screening cs.CLPDF

Nishtha Agarwal, Adam Visokay, Astha Wahi, Kwabena Owusu Aninkora, Amy Gu

TL;DR: 论文研究语言模型如何辅助系统综述中的标题与摘要筛选瓶颈，提出上下文感知推理框架CARF，通过专家对模型生成推理的反馈进行人机回环适配，用于上下文依赖的科学证据筛选。实验在口头尸检与死因判定方法的系统综述上评估，显示有竞争力的筛选性能并保持高灵敏度。

Details

Motivation: 系统综述需要专家依据详细纳入标准手动筛选大量生物医学研究，成本高且耗时；论文希望利用专家反馈和模型推理监督，让语言模型适应上下文相关的证据筛选任务。

Result: 在口头尸检和死因判定方法的系统综述上，CARF相比所评估模型表现出有竞争力的筛选性能，同时保持较高灵敏度，并更倾向于将模糊、上下文依赖的研究保留给人工审查。

Insight: 创新点在于将专家纠正后的模型推理作为监督信号，并采用人机回环框架适配上下文依赖的筛选任务；客观来看，其可借鉴之处是把推理反馈用于领域筛选，并在不确定样本上保留人工监督。

Abstract: Systematic reviews synthesize biomedical evidence to inform clinical and public-health decision-making, but require domain experts to manually screen thousands of studies against detailed eligibility criteria. We investigate whether language models can assist with this bottleneck by learning from expert feedback on title and abstract screening decisions and model-generated reasoning. We introduce the Context-Aware Reasoning Framework (CARF), a human-in-the-loop framework that uses expert feedback on model-generated reasoning to adapt language models to context-dependent screening tasks. We evaluate CARF on systematic reviews of verbal autopsy and cause-of-death ascertainment methods used in global public health mortality surveillance. CARF shows competitive screening performance compared to evaluated models while retaining high sensitivity, and is more inclined to retain ambiguous, context-dependent studies for human review. Together, these findings suggest that expert-corrected reasoning is a promising supervision signal for context-dependent scientific screening, while retaining a role for human oversight.

[8] Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing cs.CL | cs.AIPDF

Ilija Subasic, Brett Levert, Andrew Rabinovich, Sajjad Pakdamansavoji, Zhao Chen

TL;DR: 论文研究LLM-as-a-Judge对语义等价但表层改写的提示词是否稳定，提出“Prompt Lottery”现象：同一评价任务下，仅对judge prompt进行复述改写也会导致判断变化。作者在多种任务、judge家族和模型骨干上验证该现象，并用人类标注者对比其脆弱性，最后提出多提示聚合来提升鲁棒性。

Details

Motivation: 现有LLM-as-a-Judge通常默认单一judge prompt是稳定评价工具，已有工作多关注评分规则、角色描述或CoT等刻意修改以优化准确率，而忽略了保持语义不变的复述改写是否会破坏评价一致性。

Result: 大规模实验发现复述改写可改变评价结果，甚至反转模型相对排名；10名人类标注者研究显示LLMaJ在提示复述下的一致性下降比人类大6-9倍，低于可用性研究常用阈值；多提示聚合可显著提升鲁棒性。

Insight: 创新点在于系统刻画语义保持的句法复述对LLM评审的“Prompt Lottery”敏感性，并指出单提示评价用于模型排名不够可靠；客观看，其可借鉴之处是用提示变体扰动测量评价稳定性，并通过强调跨变体一致判断的聚合策略缓解敏感性。

Abstract: LLM-as-a-Judge has become a standard for evaluating large language models, yet most approaches implicitly assume that a single judge prompt functions as a stable evaluation instrument. Prior work has primarily explored deliberate prompt modifications such as scoring rubrics, role descriptions, or chain-of-thought reasoning in order to optimize accuracy. In contrast, we investigate whether validated prompt variants intended to preserve evaluation semantics while differing in surface realization (\textit{paraphrastic rephrasings}) yield consistent judgments under a fixed evaluation task. We introduce \textit{Prompt Lottery}, a phenomenon in which paraphrastic rephrasings produce different LLMaJ judgments. Across a large-scale study spanning diverse evaluation tasks, judge families, and model backbones, we find that these variations can alter evaluation outcomes and, in some settings, reverse relative model rankings. A user study with 10 human annotators shows that LLMaJ judges exhibit 6-9$\times$ larger agreement degradation under prompt rephrasings than humans, falling below the generally accepted threshold in usability studies. This indicates that single-prompt evaluation is insufficiently robust for model ranking. Finally, we show that multi-prompt aggregation substantially improves robustness by emphasizing judgments that remain consistent across prompt variants.

[9] Nemotron 3.5 Super and Lightning: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Models for Agentic AI cs.CL | cs.AI | cs.LGPDF

NVIDIA, :, Aastha Jhunjhunwala, Aayushi Ashokkumar Srivastava, Abhibha Gupta

TL;DR: 论文提出 Nemotron 3.5 Super 与 Nemotron 3.5 Lightning 两个开放的 MoE（混合专家）Hybrid Mamba-Transformer 模型，面向推理、长上下文理解与智能体（agentic）工作负载。Super 为 120B 总参数、12B 激活参数的多模态模型，Lightning 为 30B 总参数、3B 激活参数的文本模型。两者结合大规模蒸馏、长上下文训练与原生投机解码；Super 还加入印度语种持续预训练和智能体软件工程中期训练。后训练流程覆盖 SFT 与 RLVR/RLHF，Super 还引入多教师 on-policy 蒸馏（MOPD），并探索并行 agent 执行与自我验证的测试时扩展。

Details

Motivation: 论文希望同时兼顾能力与效率，使模型能够高效地完成推理、长上下文和智能体任务，并降低部署成本。为此，论文采用 MoE 结合 Mamba-Transformer 的混合架构，通过大规模蒸馏、稀疏激活与量化、投机解码等手段来压缩成本。

Result: 在 SWE-bench Pro 上，Super 达到 51.78%，超过 Nemotron 3 Ultra，而激活参数约少 4.6 倍；印度语种基准提升最高 9.82 个百分点。MTP 后训练使投机解码接受长度在概率采样草稿下最高提升 21.8%，NVFP4 量化相对 BF16 的中位精度恢复达 99.62%；GB200 上输出吞吐最高 4,856 tokens/s/GPU，同时每用户维持 ≥50 tokens/s。

Insight: 创新之处在于将 MoE 与 Mamba-Transformer 混合架构用于智能体场景，并系统组合了多教师 on-policy 蒸馏、智能体软件工程中期训练、面向多模态的教师蒸馏管线以及自我验证式测试时扩展。同时在训练与部署全链路联合优化能力与效率，包括投机解码 MTP 增强与 NVFP4 量化，在工程实现层面具有较强借鉴价值。

Abstract: We introduce Nemotron 3.5 Super and Nemotron 3.5 Lightning, open and efficient Mixture-of-Experts Hybrid Mamba-Transformer models designed for reasoning, long-context understanding, and agentic workloads. Super is a 120B-parameter, 12B-active multimodal model, while Lightning is a smaller 30B-parameter, 3B-active text model; both designed for efficient deployment. Both models combine large-scale distillation, long-context training, and native speculative decoding, while Super further incorporates Indic continued pretraining and agentic software-engineering mid-training. We develop a comprehensive post-training pipeline spanning supervised fine-tuning and reinforcement learning (RLVR and RLHF), complemented in Super by specialized teacher training and multi- teacher on-policy distillation (MOPD). This transforms Super from a text-only base model into a multimodal agent capable of reasoning over text, images, video, and interactive tool environments. We further explore test-time scaling through parallel agent execution and self-verification. Across training and deployment, we jointly optimize capability and efficiency. Indic continued pretraining improves Indian-language benchmarks by up to 9.82 percentage points, while agentic mid-training strengthens software-engineering capabilities and robustness across agent harnesses. The post-trained Super model achieves 51.78% on SWE-bench Pro, surpassing Nemotron 3 Ultra despite using approximately 4.6x fewer active parameters. Post-training MTP boosting improves speculative- decoding acceptance length by up to 21.8% under probabilistic draft sampling, while NVFP4 quantization achieves 99.62% median accuracy recovery relative to BF16. Inference optimizations enable up to 4,856 output tokens/s/GPU on GB200 while sustaining at least 50 tokens/s/user.

[10] ATI-OPD: Adaptive Teacher Intervention for Stable Long-Sequence On-Policy Distillation cs.CLPDF

Jiannan Guan, Youxin Jiang, Yutai Hou, Qiguang Chen, Yirong Zeng

TL;DR: 论文提出 ATI-OPD，用于稳定长序列同策略蒸馏（On-Policy Distillation, OPD）。该方法在学生推理前缀与教师产生高分歧时，用一小段教师文本替换最早的高分歧片段，再让学生从修正后的文本继续自主推理；同时对持续分歧的后缀从蒸馏损失中排除，但保留学生有用的续写内容。实验表明该方法能减少师生分歧、梯度尖峰和极长响应，并在五个数学推理基准、两个师生对上提升学生单独推理的平均准确率。

Details

Motivation: 长序列 OPD 中，学生生成前缀会逐渐偏离教师推理，导致教师对后续 token 的反馈变弱；若仍基于该反馈更新，可能强化偏差并造成训练不稳定。已有长度控制和损失重加权只能限制问题响应的学习，不能修正前缀，固定截断还会丢弃后续推理。

Result: 训练诊断显示师生分歧更少、梯度尖峰更少、极长响应更少；在五个数学推理基准和两个师生对上，ATI-OPD 相比标准 OPD 提升了平均 student-only accuracy。

Insight: 创新点在于用“自适应教师干预”修正学生推理前缀，而非仅对损失加权或截断，并配合排除持续分歧后缀以保留有效续写。客观看，其价值在于将长序列蒸馏中的前缀漂移问题转化为可干预的轨迹修正问题，同时兼顾训练稳定性和后续推理学习。

Abstract: On-policy distillation (OPD) trains a student on its own responses using token-level feedback from a teacher. As responses grow longer, the student’s prefix can depart from the teacher’s own reasoning, weakening its feedback on later tokens. Updates based on this feedback can reinforce the same deviations in later responses and destabilize training. Prior approaches such as length control and loss reweighting limit learning from problematic responses but leave their prefixes unchanged. Fixed cutoffs can also discard later reasoning. We propose \textbf{Adaptive Teacher Intervention for On-Policy Distillation (ATI-OPD)} to improve subsequent teacher guidance by revising the student’s reasoning prefix. ATI-OPD replaces the earliest high-disagreement segment with a short teacher segment, then lets the student resume its own reasoning from the revised text. To handle renewed disagreement, it excludes persistently divergent suffixes from the distillation loss while retaining useful student continuation. Training diagnostics show less teacher-student disagreement, fewer gradient spikes, and fewer extremely long responses. Across five mathematical reasoning benchmarks and two teacher-student pairs, ATI-OPD improves average student-only accuracy over standard OPD.

[11] Scaling Lean Theorem Proving for Real-World Code Verification cs.CL | cs.AI | cs.LO | cs.SEPDF

Debargha Ganguly, Divya Raghunathan, Dejan Jovanović, Vikash Singh, Soonho Kong

TL;DR: 论文提出 EasyProver，一个面向 Lean 定理证明的递归智能体系统，结合隔离上下文、异步搜索、并行 tactic 探测和弹性 elaboration 服务，在不额外训练前沿模型的情况下解决多个形式化与程序验证基准。由于现有基准接近饱和，作者进一步构建 Aegis 流水线，将竞赛编程题转化为基于真实 Rust 实现的更难 Lean 验证任务，并生成带内核检查证明或反驳的规格数据集。

Details

Motivation: 现有 Lean 定理证明与程序验证基准逐渐饱和，难以反映真实代码验证中的实现级复杂性；论文希望提升真实世界代码形式化验证能力，并提供更困难、可扩展的验证基准。

Result: EasyProver 在 PutnamBench 上证明 669/672，解决 NTP4VC 的 597/600 个验证条件，并完成全部 189 个 VERINA 任务；在 Aegis 的 2,000 条分层抽样语句上，30 分钟内证明 1,054 条，成功率为 52.7%。Aegis 还产出 2,045 个经差分验证的 Rust-Lean 程序对和 11,533 个候选规格。

Insight: 创新点在于用递归智能体、隔离上下文、异步搜索、并行 tactic 探测和弹性 elaboration 构建无需额外训练的 Lean 证明系统；同时提出从竞赛编程题自动生成真实实现级 Lean 验证任务的 Aegis 流水线，可兼作其他证明器基准和强化学习奖励。

Abstract: We present EasyProver, a Lean proving system built from recursive agents with isolated contexts, asynchronous search, parallel tactic probing, and an elastic elaboration service. Using an off-the-shelf frontier model with no additional training, it proves 669/672 PutnamBench problems and all six IMO 2026 formalizations and resolves 597/600 NTP4VC verification conditions and all 189 VERINA tasks by proof or refutation. Because these benchmarks are close to saturation, we also introduce Aegis, which converts competitive programming problems into much harder verification tasks over real implementations. The pipeline writes safe Rust solutions, translates them into Lean with Aeneas, generates specifications, and labels each frozen statement with a kernel-checked proof or refutation. It produces 2,045 differentially validated Rust-Lean program pairs and 11,533 candidate specifications. Unlike hand-written benchmarks, these tasks carry implementation-level obligations from fixed-width arithmetic, explicit failure, generated loops, casts, and functionalized mutation. On a stratified sample of 2,000 statements, EasyProver proves 1,054 (52.7%) within a 30-minute budget per statement. The same tasks can also be used to benchmark other provers and as rewards for reinforcement learning.

[12] Two Birds with One Stone: Skill-Augmented Generation via Unified Retrieval and Utilization cs.CLPDF

Zihan Luo, Jiahui Kang, Wei Zhou, Qilin Fan, Mingyan Li

TL;DR: 论文提出 Skill-Uni，一个统一的强化学习框架，用于联合优化大语言模型的技能检索与技能利用。该方法采用生成式技能检索范式，让单一模型同时学习检索相关技能并利用其解决任务，并通过“预热指令微调 + GRPO”的两阶段训练策略逐步提升能力。实验在五个技能相关基准上验证了有效性，并显示出与多种技能检索引擎兼容的灵活性。

Details

Motivation: 现有技能增强生成方法通常依赖独立模型分别进行技能检索和技能利用，导致两个过程优化割裂，难以协同提升复杂任务求解能力。论文旨在用一个统一框架联合优化技能检索与利用。

Result: 在五个技能相关基准上，Skill-Uni 相比基础 Qwen3-4B 和 LLaMA3.1-8B 分别取得平均 66.59% 和 34.82% 的性能提升；同时兼容多种技能检索引擎，体现灵活性和泛化性。

Insight: 创新点在于将技能检索与技能利用统一到单一模型中，采用生成式技能检索范式，并通过两阶段训练（预热指令微调与 GRPO）实现渐进式联合优化，从而缓解检索与利用分离优化的问题。

Abstract: Skills, as reusable external knowledge, have demonstrated substantial potential to enhance the ability of Large Language Models (LLMs) to solve complex tasks. However, existing skill-augmented generation methods typically rely on separate models for skill retrieval and skill utilization, resulting in disconnected optimization of these two processes. To address this gap, we propose Skill-Uni, a unified reinforcement learning framework that jointly optimizes skill retrieval and utilization. Specifically, we adopt a generative skill retrieval paradigm that enables a single model to both learn how to retrieve relevant skills and leverage them for task solving. To effectively train this unified framework, we introduce a two-stage training strategy consisting of warm-up instruction tuning and GRPO, allowing the model to progressively improve its skill retrieval and utilization capabilities. Extensive experiments on five skill-related benchmarks demonstrate the effectiveness of Skill-Uni, yielding average performance gains of 66.59% and 34.82% over the base Qwen3-4B and LLaMA3.1-8B models, respectively. Besides, Skill-Uni is compatible with various skill retrieval engines, demonstrating its flexibility and generalizability. Additional in-depth analyses also provide insights into the effectiveness of Skill-Uni.

[13] 3DCodeEdit: Benchmarking Instruction-Guided 3D Program Editing cs.CL | cs.CV | cs.GRPDF

Binjie Wang, Xinran Zhao, Shoubin Yu, Xiang Li, Silong Yong

TL;DR: 论文提出 3DCodeEdit，一个面向指令引导 3D 程序编辑的基准，包含 108 个 Blender 程序上的 2,592 个编辑任务，覆盖参数、结构、风格和场景组合等编辑类型，并通过渲染结果与人工审核清单进行评估。实验显示 17 个模型平均成功率仅 37%，结构/风格编辑最强模型也不足 60%，且失败逐渐集中在几何预见不足。论文进一步发现，引入独立 reviewer 模型的多轮反馈能显著提升编辑成功率。

Details

Motivation: 现有基准多评估 3D 代码生成或简单参考式编辑，而实际工作流常需在已有程序上按指令编辑，要求模型理解程序构建的对象并预见修改后的几何变化。论文旨在系统衡量模型在指令引导 3D 程序编辑中的能力与失败模式。

Result: 在 3DCodeEdit 上，17 个模型平均成功率仅 37%，最强模型在结构和风格编辑上完成率低于 60%。多轮反馈中，由独立 reviewer 模型描述渲染与请求差异的反馈最有效，优于最大推理努力或 agent harness，甚至可使 27B 模型单轮成功率超过 2.8T 参数模型。

Insight: 论文创新在于构建面向已有 3D 程序编辑的基准，覆盖多层级编辑并用渲染结果和人工清单评判，同时揭示几何预见是核心瓶颈。客观看，其价值还在于证明外部 reviewer 的多轮视觉反馈可弥补模型对代码修改后果的预见不足，为 3D 代码编辑评测与交互式改进提供了新思路。

Abstract: Language models increasingly create 3D content through code, with practical workflows often relying on editing existing programs rather than regenerating them, for speed and precise control. Such edits require understanding what a program builds and foreseeing how a change reshapes it, yet prior benchmarks mostly evaluate generation or simple edits against a reference. In this paper, we introduce 3DCodeEdit, a benchmark of 2,592 instruction-guided editing tasks over 108 Blender programs that construct objects entirely in code. Its edits range from parameter to structural changes, style redesign, and scene composition, and are judged from renders against human-reviewed checklists. Across 17 models, the average success rate is only 37%, and even the strongest models complete fewer than 60% of structural and style edits. As models become more capable, their failures shift to geometric foresight, where the code runs but builds the wrong shape. We therefore study whether multi-turn feedback can compensate for this missing foresight. Feedback from a separate reviewer model that describes how the renders differ from the request helps most, more than maximum reasoning effort or an agent harness, and can let a 27B model surpass the single-shot rate of a 2.8T-parameter model.

[14] Robust LLM-Generated Text Detection through Matched Conditional-Response Probing cs.CLPDF

Junfeng Hao, Wenxian Wang, Tao Leng, Xingshu Chen, Hao Ren

TL;DR: 论文提出MCRP，一种基于冻结LLM的条件响应探测框架，用于鲁棒检测LLM生成文本，尤其抵抗改写、润色、扩写等语义保持修订。方法先为候选文本生成短语义条件，再比较匹配、空和控制条件下token级损失与prompt-target注意力，聚合双向条件对齐、反事实敏感性和内部注意力耦合，并训练轻量随机森林分类器。

Details

Motivation: 现有LLM生成文本检测器常依赖词汇、句法和局部话语线索，而这些线索在文本被改写、润色、扩写或轻度编辑后会被削弱，因此需要在语义保持修订下仍可靠的检测方法。

Result: 在改写、润色和扩写下达到93.97% F1和96.24% ROC-AUC，分别超过最强评估基线19.50和25.77个百分点；标准检测、鲁棒性、多语言和多领域评估中表现一致较强，消融和条件控制研究验证了各组特征及语义匹配的贡献。

Insight: 创新点在于用语义匹配的条件响应探测冻结LLM，将token损失、prompt-target注意力和反事实敏感性聚合为检测表征，并通过条件控制显式验证语义匹配收益；客观看，该思路把LLM内部响应动态转化为鲁棒检测信号，同时保持探针LLM冻结并仅训练轻量分类器，兼具有效性和可迁移性。

Abstract: Reliable detection of large language model (LLM)-generated text must remain effective under meaning-preserving text revisions, such as rewriting, polishing, and expansion. In practice, LLM outputs are often rewritten, polished, expanded, translated, or lightly edited before publication, weakening the lexical, syntactic, and local discourse cues used by many existing detectors. We introduce \textbf{M}atched \textbf{C}onditional-\textbf{R}esponse \textbf{P}robing (\textbf{MCRP}), a frozen-LLM probing framework that measures how a candidate text responds when a semantically matched condition is introduced, removed, or replaced. For each candidate, the frozen probe LLM first generates a short semantic condition and then compares token-level losses and prompt–target attention measurements under matched, null, and control conditions. It aggregates bidirectional conditioned alignment, counterfactual sensitivity, and internal attention coupling into a probe representation, on which it trains a lightweight supervised random-forest classifier while keeping the probe LLM frozen. Across standard detection, robustness to meaning-preserving text revisions, multilingual, and multidomain evaluations, MCRP achieves consistently strong performance. Under rewriting, polishing, and expansion, it reaches 93.97% F1 and 96.24% ROC-AUC, outperforming the strongest evaluated baseline by 19.50 and 25.77 percentage points, respectively. Component ablations show that the response feature groups make complementary contributions to predictive performance. In the condition-control study, matched conditions consistently outperform random, mismatched, and corrupted alternatives, demonstrating a measurable incremental benefit from semantic matching.

[15] Fu-TCM: a multimodal large language model that learns traditional Chinese medicine diagnostic reasoning cs.CLPDF

Jiahang Xie, Tong Jin, Lingfei Wu, Yaping You, Jie Huang

TL;DR: 论文提出 Fu-TCM，一个面向中医辨证的多模态大语言模型。该模型基于清洗过滤后的约 712 万条中医经典、教材、医学图像、临床病例和公开数据训练，并采用 BGPO 强化学习优化辨证推理过程。模型在六项中医推理、文本和视觉基准上取得领先，说明中医辨证可通过结构化推理监督进行计算学习。

Details

Motivation: 中医诊断需要综合“四诊”信息完成病位病性判断、辨证和治法指导，构成完整推理链；论文希望让多模态 LLM 学习这种中医诊断推理能力，并解决辨证过程难以结构化监督的问题。

Result: Fu-TCM-27B 在六项覆盖中医推理、文本和视觉的基准上全部领先，宏平均准确率达 81.01%，比在所有六项基准上均有完整结果的最强参考模型高 7.13 个百分点；在 Fu-bianzheng 上最大领先 11.90 个百分点。案例分析还显示，多数模型中中间字段准确率与最终辨证选择准确率呈正相关。

Insight: 创新点在于构建大规模多模态中医数据训练 Fu-TCM，并提出 BGPO，通过奖励响应格式、中间中医推理字段和最终证候预测来显式监督辨证推理链。客观来看，其可借鉴之处是将结构化中间推理作为强化学习奖励信号，验证了中医辨证推理可通过计算建模和推理监督提升。

Abstract: Large language models (LLMs) are advancing in multimodal understanding and reasoning, accelerating medical model development. Traditional Chinese medicine (TCM) uses evidence from the four examinations to determine disease location and nature, differentiate syndromes and guide treatment. This diagnostic process constitutes a complete chain of reasoning. We present Fu-TCM, a multimodal TCM LLM trained on data retained after cleaning and filtering an initial collection of approximately 7.12 million examples derived from classical texts, textbooks, medical images, clinical cases and publicly available datasets. The model was further optimized using Bianzheng-Grounded Policy Optimization (BGPO), which explicitly targets syndrome differentiation through rewards for response format, intermediate TCM reasoning fields and final syndrome predictions. Fu-TCM-27B led all six benchmarks spanning TCM reasoning, text and vision, achieving a macro-average accuracy of 81.01% and surpassing the strongest reference model with complete results across all six benchmarks by 7.13 percentage points. Its largest margin was 11.90 points on Fu-bianzheng. Case-level analyses further showed a positive association between intermediate-field accuracy and final syndrome-selection accuracy in most evaluated models. These findings suggest that TCM syndrome differentiation may be computationally learnable and that structured reasoning supervision can improve performance across TCM tasks.

[16] Statutory Article Retrieval from Arabic Judicial Narratives: Family Law and Law of Evidence in Saudi Arabia cs.CL | cs.AIPDF

Zarah Shibli, Areej Alhothali, Lulwah Alharigy

TL;DR: 论文研究阿拉伯语司法叙事到沙特阿拉伯成文法条的检索问题，构建了包含200个合成司法案例和家庭法、证据法共381条法条的基准，并比较BM25、零样本稠密编码器、按法律分别检索、稠密-稀疏RRF融合以及提出的Decompose-and-Refine（DaR）流程。DaR利用大语言模型将叙事拆分为争议法律问题，并为每个问题生成法条风格改写、法律关键词和候选分类章节三类检索通道，从而提升法条检索效果。

Details

Motivation: 阿拉伯语司法场景中，长事实叙事需要映射到表达抽象法律规则的简短法条，存在明显的“叙事到法律规则”的抽象鸿沟；论文旨在提升可靠的法律信息检索，使法律推理能够基于权威成文法源。

Result: 在整体语料上，经指令的Qwen3-Embedding-8B稠密编码器取得非分解系统中最好的MRR@10=0.849；但按法律分别评分时，证据法上仅0.087，与BM25融合后也只升至0.207。DaR显著改善，将证据法MRR@10提升至0.696，家庭法提升至0.864，并使同一检索器在两类法律上均达到最佳MRR@10。

Insight: 论文宣称的创新点是通过LLM将司法叙事分解为争议法律问题，并生成多通道查询表示以跨越叙事与法条之间的抽象差距。客观来看，其可取之处在于用问题级分解和法条风格/关键词/分类章节的多视角检索，缓解了不同法律类别偏好不同检索策略的问题，并让同一检索器在家庭法与证据法上同时取得最佳效果。

Abstract: Reliable legal information retrieval must ground legal reasoning in authoritative statutory sources. In Arabic judicial settings, long factual narratives must be mapped to concise articles that express abstract legal rules, creating a narrative-to-legal-rule abstraction gap. Using a benchmark of 200 synthetic Saudi Arabic judicial cases and 381 articles from the Family Law and the Law of Evidence, we compare word-level and char-4 BM25, zero-shot dense encoders, per-law retrieval, dense-sparse reciprocal rank fusion (RRF), and a proposed Decompose-and-Refine (DaR) pipeline. In DaR, a large language model splits each narrative into disputed legal issues and generates, for each issue, three retrieval channels: a statute-style paraphrase, legal keywords, and a candidate taxonomy chapter. On the whole corpus, the instructed Qwen3-Embedding-8B dense encoder reaches an MRR@10 of 0.849, the best result of any non-decomposed system. Under per-law scoring, this advantage reflects Family Law only: restricted to Evidence articles, the same encoder drops to an MRR@10 of 0.087, and fusion with BM25 raises it only to 0.207. DaR changes this picture, raising Evidence MRR@10 to 0.696 and Family MRR@10 to 0.864. Without decomposition, the two laws favor different strategies; under DaR, the same retriever achieves the best MRR@10 on both.

[17] TCC-RAG: Temporal Causal Chain-Guided RAG for Temporal Knowledge Graph Question Answering cs.CLPDF

Xinxun Zhang, Yuxiang Wang, Shanshan Feng, Jun Zhang, Tieyun Qian

TL;DR: 论文提出TCC-RAG，一种面向时序知识图谱问答（TKGQA）的时序因果链引导RAG方法。它将时序知识图谱重构为多视角因果线索图，构建查询特定的时序因果链来引导检索，并用因果证据过滤器筛选与查询时序逻辑因果一致的知识，从而支持复杂时序推理。

Details

Motivation: 现有TKGQA方法多依赖语义RAG，难以捕捉复杂时序推理所需的多跳因果知识，且会引入大量冗余知识，使LLM陷入虚假推理链并导致错误答案。

Result: 在两个TKGQA基准上分别取得10.72%和8.40%的性能提升，并在多步时序推理上实现62.97%的显著提升。

Insight: 创新点在于用多视角因果线索图显式编码时序演化与因果动态，以查询特定时序因果链指导精简检索，并通过因果证据过滤保证检索知识与查询时序逻辑的因果一致性。

Abstract: Recent advances in large language models (LLMs) have spurred growing interest in temporal knowledge graph question answering (TKGQA). Most existing methods rely on semantic retrieval augmented generation (RAG), which suffers from fundamental limitations in complex temporal reasoning. On the one hand, semantic-based RAG methods struggle to capture the multi-hop causal knowledge required for complex temporal reasoning. On the other hand, these methods introduce excessive redundant knowledge, trapping LLMs in spurious reasoning chains that potentially result in erroneous answers. To address these problems, we propose a Temporal Causal Chain-guided RAG (TCC-RAG) to retrieve a concise yet sufficient set of causal knowledge to support complex temporal reasoning. Specifically, we reformulate the temporal knowledge graph into a multi-view causal cue graph, with causal cues inducing connections that explicitly encode temporal evolution and causal dynamics. Based on the causal cue graph, we construct a query-specific temporal causal chain to guide the retrieval process, enabling the model to focus on a concise set of causally relevant knowledge. Finally, we introduce a causal evidence filter to refine the retrieved knowledge, ensuring its causal consistency with the underlying temporal logic of the query. Experiments show that TCC-RAG achieves substantial performance gains of 10.72% and 8.40% on two TKGQA benchmarks, and delivers a remarkable 62.97% improvement for multi-step temporal reasoning.

[18] Does Chain-of-Thought Reliance Follow a Scaling Law?Larger Models Follow Their Steps More, Independent of Post-Training cs.CL | cs.LGPDF

Esther Xin

TL;DR: 论文用合成 box-swap 任务构造精确 ground truth，通过把模型自身 CoT 中一步替换为错误但合法的状态，检测最终答案是否跟随该编辑，从而量化模型对 CoT 的依赖。作者评估了 Qwen3、Gemma 3、Llama 3 和 OLMo 2 等 25 个开源模型（每个 7200 题），发现 CoT reliance 随规模按对数 N 逻辑增长并饱和，能力是主要驱动因素，后训练基本不改变依赖程度，且 14B 以下模型无法在没有写出步骤时内部完成多步任务。

Details

Motivation: 监控 CoT 只有在最终答案真正依赖写出的推理步骤时才有安全价值；先前在自然任务上测量时缺乏真实推理的精确 ground truth，难以判断答案是否跟随步骤。论文希望用可控合成任务精确测量 CoT 依赖，并考察模型规模、能力和后训练对依赖程度的影响。

Result: Qwen3 的答案依赖率从 0.6B 的 16-18% 升至 14B 的 97-100%，log N 逻辑拟合 R^2=0.89，Gemma 3 和 Llama 3 呈类似趋势；跨模型 reliance 与 step accuracy 相关性 r=0.99，匹配正确率时规模仍有影响（rho=0.80, p=0.002）；4B 以上 base 与 post-trained 差异不超过 0.03；无写出步骤时，四步及以上问题中所有有能力模型接近随机，OLMo 2 始终未具备该能力。

Insight: 创新点在于用合成 box-swap 任务和单步反事实编辑精确量化答案对 CoT 的依赖，并系统比较模型族、规模与后训练，提出 reliance 随规模增长且主要由能力驱动的经验规律。客观看，这为“规模增大使 CoT 更承重、从而更利于 CoT 监控”提供了机制性证据，但结论受合成任务和最大 14B 模型范围限制，泛化性仍需验证。

Abstract: Monitoring a model’s chain of thought (CoT) is useful for safety only if the final answer depends on the written steps. Prior measurements use natural tasks where true reasoning is unknown. We measure it against an exact ground truth on a synthetic box-swap task where every intermediate state is known. We replace one step inside a model’s own chain with a wrong but valid state and check whether the answer follows the edit. We evaluate 25 open-weight models–Qwen3 (0.6B-14B, base and post-trained), Gemma 3 (1B-12B), Llama 3 (1B-8B), and 8 OLMo 2 checkpoints–on 7,200 items each. We find five results: (1) Reliance rises with size and saturates. In Qwen3, answer reliance rises from 16-18% at 0.6B to 97-100% at 14B; a logistic in log N fits well (R^2 = 0.89), and Gemma 3 and Llama 3 follow this trend. (2) Capability is the main driver. Across all models, reliance and step accuracy correlate at r = 0.99; equally capable models are equally reliant, regardless of family. (3) Size still matters at matched correctness. On problems solved correctly before the edit, reliance increases with size among capable models (rho = 0.80, p = 0.002). (4) Post-training does not change reliance. Base and post-trained Qwen3 differ by at most 0.03 from 4B upward; a large gap at 1.7B matches a large capability gap. (5) No model up to 14B solves the task internally. Without written steps, every capable model is at chance once a problem has four or more swaps. OLMo 2 checkpoints never become capable, making the training-token axis a limitation. On tasks requiring step-by-step computation, scale makes the chain of thought more load-bearing, supporting CoT monitoring in this regime.

[19] Benchmarking decision models against generative large language models on medical multiple-choice questions cs.CL | cs.AIPDF

Oscar Freyer, Daniel Glauert, Moritz Hofmann, Max Ostermann, Stephen Gilbert

TL;DR: 论文在纯文本MedQA四选项多选题上，系统比较了13个决策模型与15种生成式大语言模型配置（含不同推理设置），从准确率、成本、请求时延、概率区分能力、概率校准和重复性等维度评估医疗工作流中的模型选择。

Details

Motivation: 医疗工作流常需从预定义选项中选择答案，论文关注传统决策模型与生成式LLM在实际部署时应如何权衡准确率、资源开销和概率可靠性。

Result: 决策模型准确率为67.71%–89.08%，生成式配置为78.32%–96.86%；Mercury Decide平均最终尝试成本最低（每1000题0.0069美元），Clef Omni请求时延中位数最短（0.291秒）。决策模型概率可区分正误，但概率≥0.90的答案错误率为1.71%–12.77%，三次运行答案一致性为92.30%–100%。

Insight: 论文宣称的创新点是对决策模型与多种生成式LLM配置进行多维度基准比较，而非只看准确率；客观上其价值在于强调医疗场景选型需同时考虑概率质量、重复性、成本时延及纠错资源。

Abstract: Medical workflows often require selecting among predefined options. We compared 13 decision models with 15 generative large language model configurations, including different reasoning settings, using 1,273 four-option MedQA questions under text-only conditions. Accuracy ranged from 67.71% to 89.08% for decision models and from 78.32% to 96.86% for generative configurations. Among the tested configurations, Mercury Decide had the lowest mean final-attempt cost (USD 0.0069 per 1,000 questions), while Clef Omni had the shortest median request duration (0.291 seconds). Decision-model probabilities distinguished correct from incorrect answers, but error rates among answers assigned probabilities of at least 0.90 ranged from 1.71% to 12.77%. Answer agreement across three runs ranged from 92.30% to 100%, while probability repeatability varied. Decision models offered resource advantages alongside lower peak accuracy; selecting models for medical workflows requires considering probability quality and repeatability together with accuracy and the resources needed to detect and correct errors.

[20] CoSTA: Co-Evolving Self-Play Timeline Agents for Complex Temporal Knowledge Graph Question Answering cs.CLPDF

Haikun Liu, Zhichao Yan, Shaoru Guo, Jiawei Gu, Victor Gutierrez Basulto

TL;DR: 论文提出CoSTA，一种用于复杂时序知识图谱问答的多智能体框架。它将事实组织成可导航的时间线，由工作者智能体调查不同事件，协调者综合带时间戳的观察结果。通过角色条件蒸馏初始化共享策略，并利用共同进化的自博弈与最终答案奖励联合优化两个角色。在三个基准上达到最先进整体性能，尤其在复杂多事实问题上提升显著，紧凑变体超过评估的闭源LLM智能体。

Details

Motivation: 现有单智能体TKGQA方法在单一推理上下文中调查事实，不同事件历史的证据容易交织，干扰项会误导后续检索。多智能体可分离证据，但有效协作仍需学习，因为问题分解、子任务调查和证据综合相互依赖。

Result: 在三个基准上达到最先进整体性能，在复杂多事实问题上提升尤为显著；紧凑变体优于评估的闭源LLM智能体（摘要未给出具体数值）。

Insight: 创新点包括：将事实组织为可导航时间线；采用工作者-协调者多智能体架构分离证据上下文；通过角色条件蒸馏和共同进化自博弈（以最终答案奖励）联合优化两个角色，实现协作学习。

Abstract: Complex Temporal Knowledge Graph Question Answering (TKGQA) involves more than retrieving facts: the timestamp or validity interval of one fact can constrain the search for another, while multiple intervals may jointly determine the answer. Existing single-agent TKGQA methods typically investigate these facts within a single reasoning context, where evidence from different event histories can become interleaved and distractors can misdirect subsequent retrieval. Distributing investigations across agents can separate event-specific evidence into distinct contexts, but effective collaboration must still be learned because question decomposition, subtask investigation, and evidence synthesis are interdependent. To address these limitations, we propose \textbf{Co}-Evolving \textbf{S}elf-Play \textbf{T}imeline \textbf{A}gents (CoSTA), which organizes facts into navigable timelines, delegates investigations to workers, and uses a coordinator to synthesize their original timestamped observations. CoSTA initializes a shared policy through role-conditioned distillation and jointly optimizes both roles through co-evolving self-play with final-answer rewards. Across three benchmarks, CoSTA achieves state-of-the-art overall performance, with particularly strong gains on complex multi-fact questions, while its compact variants outperform the evaluated closed-source LLM agents.

[21] Implicit Minor Detection from Multi-Turn Dialogue in High-Risk AI Interactions: A Constrained Self-Evolving LLM Harness cs.CLPDF

Xiaohan Zhang, Ying Zhao, Ruilin Guo, Xuanyuan Yu, Kaibo Huang

TL;DR: 论文研究弱身份信息下、多轮高风险文本交互中的隐式未成年人检测，将其建模为高风险用户属性推断任务，提出由LLM、Harness与Maker-Checker协议组成的受约束自演化框架；该框架控制推断触发时机、要求结构化对话证据，并对Harness修订做版本级审核。在8,328条中文多轮对话基准上，较同LLM家族直接推断提升平均精度AP 7.60个百分点和未成年人类F1 6.37个百分点。

Details

Motivation: 高风险文本交互中需在应用年龄相关保护前判断说话者是否可能为未成年人，但许多文本对话系统缺少账号、实名、人脸或设备等强身份信号，只能依赖多轮对话中的弱线索。论文旨在解决弱身份信息下隐式未成年人检测的准确性与可靠性问题。

Result: 在包含8,328条多轮对话的中文受控基准上，方法相比同LLM家族直接推断，平均精度AP提升7.60个百分点，未成年人类别F1提升6.37个百分点。摘要未提及其他benchmark或SOTA比较。

Insight: 创新点在于将隐式未成年人检测形式化为高风险用户属性推断，并用受约束的LLM-Harness-Maker-Checker框架控制推断触发、强制结构化对话证据、对自演化修订进行版本级审核，以提升弱线索推断的可控性和可靠性。客观看，结合自演化Harness与检查协议来约束LLM推断流程是较有借鉴意义的工程化思路。

Abstract: In high-risk text interactions, a system may need to estimate whether the current speaker is likely to be a minor before applying age-conditioned safeguards. Many text-based dialogue systems lack strong identity signals such as account information, verified identity, facial data, or device data, and must rely on weak cues that emerge across multiple turns. We formulate implicit minor detection under weak identity information as a high-risk user-attribute inference task and propose a constrained framework comprising a large language model, a Harness, and a Maker-Checker protocol. The framework controls when inference is invoked, requires structured dialogue-linked evidence, and subjects validation-selected Harness revisions to version-level review. On a controlled Chinese benchmark comprising 8,328 multi-turn dialogues, our method improves average precision and minor-class F1 by 7.60 and 6.37 percentage points, respectively, over direct inference using the same LLM family.

[22] Do Audio LLMs HEAR Pain? Tracing Acoustic Evidence from Speech to Language Reasoning cs.CL | cs.AI | cs.SDPDF

Wenqi Li, Xiangjue Dong, Sulaiman Vesal

TL;DR: 论文提出HEAR四阶段诊断框架，系统追踪大型音频语言模型（LALMs）能否利用语音中的非词汇声学信息来推断疼痛。作者在TAME-Pain上评测七个闭源和开放权重LALMs，发现模型在只能依赖声音推断疼痛的哈佛句子上仅达随机水平，但在口语疼痛评分任务上准确率很高；逐层探测表明疼痛信息存在于早期音频表示中，却在深层和最终预测中大量丢失。最后，将恢复出的疼痛相关声学线索以结构化文本重新注入提示，可显著提升成对疼痛预测。

Details

Motivation: 论文关注现有大型音频语言模型虽可直接处理语音，但是否真正利用语音携带的副语言/非词汇声学信息仍不清楚；作者以疼痛推断为切入点，检验模型从声音信号到语言推理的利用能力。

Result: 在只能从声音推断疼痛的哈佛句子上，所有模型仅达随机水平，同说话人参考或少样本示例最多提升6个平衡准确率点；在口语评分上达到87.5%–99.7%平衡准确率。逐层探测显示早期音频表示可解码疼痛（二分类74.1%，三分类45.0%），但深层下降；将声学线索作为结构化文本注入提示可让成对疼痛预测最高提升32点。

Insight: 创新点在于提出HEAR诊断框架，将疼痛相关信息从语音信号逐层追踪到模型预测，并揭示当前LALMs在早期层编码副语言信息、但在生成答案时难以调用。客观看，其可借鉴之处是以可控诊断任务定位声学信息损失，并通过结构化文本重注入验证“感知到但未用于推理”的瓶颈。

Abstract: Large audio language models (LALMs) can process speech directly, but it remains unclear how well they use the non-lexical acoustic information that speech carries. We study this question through pain, using TAME-Pain, which contains pain-neutral Harvard sentences and spoken pain ratings recorded at different self-reported pain levels. We introduce HEAR, a four-stage diagnostic framework that traces pain-related information from the speech signal to the model’s prediction, and apply it to seven closed-source and open-weight LALMs. On the Harvard sentences, where pain can only be inferred from the voice, all models perform at chance level, and same-speaker references or few-shot examples improve balanced accuracy by no more than six points. On the spoken ratings, the same models reach 87.5-99.7% balanced accuracy. Layer-wise probing of open-weight LALMs shows that pain can be decoded from early audio representations (74.1% balanced accuracy for binary prediction and 45.0% for three-class severity), but that this information, along with most pain-associated acoustic cues, decreases in deeper layers. In an acoustic perception test, weaker models cannot distinguish even large changes in these cues, whereas stronger models can but still fail to infer pain. Finally, we recover pain-related acoustic cues and directly reinject them as structured text into the prompt, which improves pairwise pain prediction by up to 32 points. These results indicate that current LALMs encode paralinguistic information in early layers that is largely unavailable when the model produces its answer.

[23] CopyLoop: Fast Looped Transformer Decoding via Context Copying and Shallow Screening cs.CL | cs.AIPDF

Wenyu Du, Stephen Chung

TL;DR: 论文提出 CopyLoop，一种无需训练的 Looped Transformer 解码算法，通过从重复上下文中复制生成多 token 后缀候选，并结合浅层循环深度筛选与连续循环调度，加速全深度自回归解码。该方法在代码生成和多步数学推理任务上验证了显著解码加速，并能与现有推测解码基线竞争。

Details

Motivation: Looped Transformer 因重复应用共享块而具有较高循环深度，导致常规全深度解码开销大；现有推测流水线虽能加速，但仍受顺序解码开销限制。论文旨在降低循环深度解码成本并提升多 token 生成效率。

Result: 在 Ouro、Raven、Huginn 六个模型检查点上，CopyLoop 在 Base 模型上相对全深度自回归解码取得 2.98x–10.70x 加速，在 Thinking 模型上取得 2.74x–3.52x 加速，并在评估任务上持续优于或接近所有竞争基线。

Insight: 创新点在于无需训练地利用上下文复制提出多 token 后缀，并用浅层循环深度早期筛选错误分支，同时让新块与旧块的全深度验证并发推进。客观来看，其价值在于将低成本候选生成、浅层筛选和连续循环调度协同起来，特别适合具有可复用上下文的长序列生成场景。

Abstract: Looped Transformers increase computational capacity through the repeated application of shared blocks, but their recurrent depth makes conventional full-depth decoding expensive. While existing speculative pipelines accelerate generation by processing consecutive token positions at varying depths, they are typically limited by sequential decoding overheads. We introduce CopyLoop, a training-free decoding algorithm that combines low-cost context-copy proposals with shallow screening and continuous recurrent scheduling. Rather than step-by-step generation, CopyLoop proposes multi-token suffixes from repeated context. It then evaluates them early at a shallow recurrent depth to efficiently filter out incorrect branches, processing newer blocks concurrently while earlier blocks are still progressing toward full-depth verification. We evaluate CopyLoop across six model checkpoints from the Ouro, Raven, and Huginn families, covering code generation and multi-step mathematical reasoning. CopyLoop achieves decoding speedups of 2.98x–10.70x over full-depth autoregressive decoding on Base models and 2.74x–3.52x on Thinking models, consistently outperforming or closely matching all competing baselines across evaluation tasks. Furthermore, ablation studies confirm a strong synergy between shallow screening and continuous scheduling, while our analyses show that CopyLoop requires only lightweight model calibration and yields greater speedups on longer generations with reusable contexts.

[24] HEDGE: Gated Hypergraph Memory for Scalable Multi-Agent Debate cs.CLPDF

Amirhossein Abaskohi, Mahdi Mostajabdaveh, Zirui Zhou

TL;DR: 论文提出 HEDGE，一种面向多智能体辩论的选择性记忆框架，将辩论轨迹建模为语义超图，并用学习到的记忆选择模块决定信息存入、备份或丢弃。该方法旨在解决长轮次辩论中上下文有限、记忆冗余和高阶关系难以表示的问题，从而提升多智能体系统的可扩展性与推理表现。

Details

Motivation: 多智能体辩论需要跨轮次保留和回溯论点，但有限上下文窗口与非结构化记忆使相关信息难以恢复；现有扁平记忆和成对图记忆难以刻画多智能体一致、冲突证据和共识演化等高阶关系。

Result: 在七个多样化基准上，HEDGE 稳定优于强单智能体、多智能体和记忆基线；相对最强多智能体系统（GPT-4o-mini）平均准确率提升 5.0 点，冲突密集任务提升 8.2 点，同时内存使用降低 48%、辩论轮数减少 34%。

Insight: 创新点在于用语义超图表示跨智能体的高阶辩论关系，并在超边内保留细粒度论证结构；同时通过监督学习与强化学习训练记忆选择模块，对记忆候选进行 STORE/BACKUP/OMIT 路由，实现有用信息保留与冗余控制。客观来看，其可借鉴之处是将结构化高阶记忆与选择性记忆管理结合，以提升多智能体辩论的效率和可扩展性。

Abstract: Multi-agent debate systems require agents to retain and revisit arguments across multiple rounds, yet limited context windows and unstructured memories make relevant information increasingly difficult to recover. Existing flat and pairwise-graph memories also struggle to capture higher-order relations, including multi-agent agreement, conflicting evidence, and evolving consensus. We introduce HEDGE, a selective memory framework that represents debate trajectories as semantic hypergraphs. Hyperedges connect related claims across agents, while intra-hyperedge relational graphs preserve fine-grained argumentative structure. A learned memory selection module (MSM), trained through supervised learning and reinforcement learning, routes each memory candidate to STORE, BACKUP, or OMIT, retaining useful information while limiting redundancy. Across seven diverse benchmarks, HEDGE consistently outperforms strong single-agent, multi-agent, and memory baselines, improving accuracy by 5.0 points on average over the strongest multi-agent system with GPT-4o-mini. The gains reach 8.2 points on conflict-heavy tasks, while HEDGE reduces memory usage by 48% and the number of debate rounds by 34%.

[25] How Architecture, Typology, and Adaptation Strategies Shape ASR for Low-Resource African Languages: A Controlled Empirical Study cs.CL | cs.SD | eess.ASPDF

Mercy Muchai, Kevin Chege, Nick Mumero Mwangi, Samuel Chege Maina, Felermino Ali

TL;DR: 论文对五个低资源非洲语言及作为中资源对照的斯瓦希里语开展受控ASR实证研究，系统比较Phi-4-multimodal-instruct、Whisper-large-v3-turbo和MMS-1B-all三种架构，并分析数据充分性、单语/多语适应、领域微调和语言适配器迁移。研究发现Phi-4总体准确率最佳，MMS的CER可比，Whisper因幻觉和重复循环导致CER较高，且性能随数据规模饱和、类型学复杂度持续影响错误率。

Details

Motivation: 低资源语言ASR中，何种架构、微调方式和数据适应策略有效仍不明确；论文希望通过跨语言、跨架构的受控比较，为低资源非洲语言ASR提供实践性选择依据和数据效率目标。

Result: Phi-4取得最佳总体准确率，MMS的CER与之可比，Whisper的CER较高并与幻觉和重复循环相关；性能在不同数据规模下饱和，领域微调提升Phi-4和Whisper但损害MMS，代理语言适配器优于从头训练MMS适配器。

Insight: 创新点在于对多种ASR架构和低资源非洲语言进行系统受控实证，联合考察数据充分性、单/多语适应、领域微调与适配器迁移，并揭示类型学复杂度和适配器方法的局限；其可借鉴之处是提供数据效率目标和适配策略选择证据，而非单一模型改进。

Abstract: Despite recent advancements in ASR, identifying effective architectures, fine-tuning approaches, and data adaptation strategies for low-resource languages remains challenging. We present a systematic comparison across five low-resource African languages and Swahili as a mid-resource contrast, fine-tuning three models from distinct architectures: Phi-4-multimodal-instruct, Whisper-large-v3-turbo, and MMS-1B-all. We analyze data sufficiency, monolingual versus multilingual adaptation, domain fine-tuning, and language-adapter transfer. Phi-4 achieves the best overall accuracy, MMS shows comparable CER, while Whisper exhibits high CER, consistent with known hallucinations and repetition loops. Performance saturates at different data scales, offering practical data-efficiency targets, while typological complexity consistently shapes error rates. Domain fine-tuning benefits Phi-4 and Whisper but degrades MMS, revealing limitations of adapter-based adaptation. Proxy language adapters outperform training MMS adapters from scratch.

[26] Implicit Reasoning in Transformers: Bridging the Compositionality Gap in GPT-2-like Models cs.CL | cs.AIPDF

Davide Venuto, Leonardo Venuto

TL;DR: 论文研究GPT-2类Transformer在受控两跳推理中的组合泛化差距：模型能在分布内组合已知事实，却难以迁移到分布外原子知识。作者基于已发现的组合泛化电路，调整训练分布，使ID和OOD原子事实在位置上与第二跳检索步骤对齐，而不改模型架构或增加OOD组合监督。实验表明该干预能使模型将ID组合行为迁移到未见OOD事实，从而在受控设置中弥合组合性差距。

Details

Motivation: 论文关注Transformer语言模型的组合泛化限制，即分布内可正确组合事实，但面对分布外知识时组合机制失效。其出发点是探究该差距是否与训练时原子知识的呈现结构有关，而非根本架构缺陷。

Result: 在受控两跳推理设置中，采用位置对齐的训练分布干预后，GPT-2类模型成功将分布内学到的组合行为迁移到留出的分布外原子事实，闭合了观察到的组合性差距；摘要未提及具体benchmark数值或SOTA比较。

Insight: 论文宣称的创新点是通过机制可解释性发现的组合电路来指导训练分布设计，在不改架构、不增加OOD组合监督的情况下实现OOD组合迁移。客观来看，其价值在于将组合泛化失败归因于知识暴露格式与电路检索步骤不匹配，并提供了一种数据侧、机制启发的缓解思路。

Abstract: Compositional generalization remains a persistent limitation of transformer language models: even when a model learns to combine known facts correctly in-distribution (ID), the same compositional mechanism may fail when applied to out-of-distribution (OOD) knowledge. We investigate this compositionality gap in a controlled two-hop reasoning setting using a GPT-2-like transformer model trained from scratch. Building on prior work identifying a circuit associated with compositional generalization, we test whether the failure of OOD transfer is related to how atomic knowledge is structurally exposed during training. We modify the training distribution by presenting both ID and OOD atomic facts in a format positionally aligned with the second-hop retrieval step of the learned compositional circuit, without modifying the model architecture or adding OOD compositional supervision. Under this intervention, the model successfully transfers the learned ID compositional behaviour to held-out OOD atomic facts, closing the observed compositionality gap in the controlled setting. Our results provide evidence that the observed compositionality gap is not a fundamental architecture limitation and that it can be overcome through mechanistically informed training distribution design.

[27] Distilling the Shape of Uncertainty: What On-Policy Distillation Learns and How to Predict It cs.CL | cs.AIPDF

Shiping Yang, Chuanqi Tang, Hossein Hajimirsadeghi, Layla El Asri, Mohammad Amin Shabani

TL;DR: 论文研究在线蒸馏（OPD）中更强教师可能无法提升学生的问题，发现OPD不仅学习‘如何分支’（考虑哪些候选token），还学习‘在哪里分支’（保持推理路径开放的位置）。提出用熵形状（下一个token熵的序列）刻画后者，并设计熵形状相关性（ESC）度量学生-教师一致性。实验证明‘在哪里分支’因果性驱动OPD增益，且预OPD的ESC能有效选择最佳教师。

Details

Motivation: 解决OPD中更强教师不一定提升学生的现象，探究除新知识外影响蒸馏效果的关键因素，特别是推理路径结构信息的传递。

Result: 通过跟踪ESC和干预教师熵的实验，证明‘在哪里分支’独立于‘如何分支’因果性驱动OPD增益；在教师选择任务上，预OPD ESC优于现有预测器，能为学生选出最佳教师。

Insight: 创新点在于提出熵形状刻画推理路径开放位置，设计ESC度量学生-教师一致性，并揭示熵形状信息对OPD效果的关键因果作用；将OPD结果预测转化为教师选择任务并建立评估协议。

Abstract: On-policy distillation (OPD) is increasingly adopted in the post-training of large language models. However, a stronger teacher may fail to improve the student. Prior work attributes this to a lack of new knowledge, but what that knowledge is remains unclear. We show that OPD learns not only \textit{how to branch}, i.e., which candidate tokens to consider, but also \textit{where to branch}, i.e., where to keep reasoning paths open. The existing token-overlap metric captures only the former. We introduce the entropy shape, the sequence of next-token entropies, to characterize the latter, and propose the Entropy Shape Correlation (ESC) to measure student-teacher agreement in entropy shape. Tracking ESC throughout training and intervening on a teacher’s entropy while preserving its token preferences, we empirically show that \textit{where to branch} causally drives OPD gains, independently of \textit{how to branch}. Finally, we formulate OPD outcome prediction as a teacher selection task and establish an evaluation protocol for it, under which pre-OPD ESC selects the best teacher for both students and outperforms existing predictors. Code is available at https://github.com/maybenotime/opd-esc.

[28] HALO: Human-Grounded Granular Evaluation of Proactive Agents cs.CLPDF

Wenqi Pei, Xinyu Wang, Jinrui Liu, Cynthia Zhuge, Jie Sheng

TL;DR: 论文提出HALO，一个以人类标注为基础的主动式智能体细粒度评估框架，并构建HALO-Arena与HALO-8K数据集，覆盖4类主动需求、10个日常领域和50个个人环境。评估要求智能体先从结构化数据库或非结构化文档中检索证据，再判断是否应协助及协助范围。实验显示最佳闭源与开源模型可接受性分别为72.88%和56.63%，并发现过度主动是主要失败模式。

Details

Motivation: 主动式智能体需在无显式请求时决定是否、何时以及多大程度协助，但现有评估多依赖自动分数或二元判断，缺乏对人类诊断证据使用和干预质量的细粒度分析。

Result: HALO-8K包含10个模型在400个场景下的8000条回答，由20名专家标注；最佳闭源和开源模型可接受性为72.88%和56.63%。主要发现是过度主动为主导失败模式，时机过早或强度过度占被拒回答的61.20%。

Insight: 创新点在于构建人类接地的细粒度主动智能体评估框架，结合证据检索、行动级别、可接受性判断和失败诊断标注，并用推理token与检索轮次衡量响应投入。其客观价值是系统量化了过度主动及干预时机/强度校准问题。

Abstract: Proactive agents must decide whether, when, and how far to assist without an explicit request. Existing evaluations often rely on automated scores or binary verdicts, offering limited human diagnosis of evidence use and intervention quality. To address these gaps, we introduce HALO, Human-Grounded GrAnular EvaLuation of PrOactive Agents. HALO-Arena covers 4 proactive need types, Dependency, Blockage, Risk, and Opportunity, across 10 everyday domains and 50 personal environments. Scenarios require agents to retrieve evidence from structured databases or unstructured documents before judging whether assistance is warranted and choosing its scope. On HALO-Arena, we construct HALO-8K, a dataset of 8,000 responses from 10 models across 400 scenarios, annotated by 20 experts for action level, acceptability verdicts, and human diagnosis. For rejected responses, human diagnosis covers timing, intensity, and other issues. Recorded reasoning tokens and retrieval rounds measure the effort behind these responses. The best proprietary and open-source models achieve 72.88% and 56.63% acceptability, respectively. Our central finding is that over-proactivity is the dominant observed failure mode, with Premature timing or Excessive intensity accounting for 61.20% of rejected responses. Further analyses yield complementary findings on the balance between intervention and restraint, evidence acquisition, and the calibration of timing and intensity.

[29] Grounding Multimodal Reasoning with Evidence-Ablated Negatives cs.CLPDF

Chenxi Liu, Tianyi Xiong, Yanshuo Chen, Heng Huang

TL;DR: 论文提出EVAN，一个多模态强化学习框架，利用“证据消融负样本”训练大型多模态模型，抑制模型依赖语言先验或数据集捷径而非视觉证据的推理行为。方法先筛选高度依赖视觉信息的样本，再通过遮挡最具判别性的图像块构造合理但缺乏视觉依据的负响应，并将其作为有界辅助信号用于策略优化。

Details

Motivation: 标准RLVR结果监督存在信用分配模糊问题，模型可能通过语言先验或数据集捷径获得正奖励，而没有真正基于视觉证据推理；因此需要高质量负样本暴露并抑制这些捷径。

Result: 在多个 challenging 多模态推理基准上，EVAN缓解了模态失衡，并优于强RLVR基线；摘要未给出具体数值或SOTA声明。

Insight: 创新点在于用证据消融图像主动诱发当前策略下合理但视觉无根据的负响应，并将负样本作为干净图像下的有界辅助信号，既惩罚捷径学习又保持RL训练稳定；同时结合图像信息增益筛选视觉依赖样本与混合排序保持数据多样性。

Abstract: Reinforcement learning with verifiable rewards (RLVR) has become a powerful tool for improving multimodal reasoning. However, standard outcome supervision suffers from credit assignment ambiguity, as a model may receive positive rewards by exploiting language priors or dataset shortcuts rather than grounding its reasoning in the requisite visual evidence. This makes high-quality negative responses critical, since effective negatives should remain plausible under the current policy while exposing the shortcut that should be suppressed. In this paper, we propose EVAN, a multimodal reinforcement learning framework utilizing EVidence-Ablated Negatives to train LMMs against their own language-prior failures. EVAN first identifies highly visually dependent examples using a scaled image information gain metric and preserves data diversity with a mixed-ranking strategy. It then constructs evidence-ablated images by masking the most discriminative image patches, eliciting plausible but visually ungrounded responses from the current policy. During policy optimization, these negative responses are incorporated as bounded auxiliary signals under the clean image, penalizing shortcut learning while maintaining RL stability. Experiments across challenging multimodal reasoning benchmarks demonstrate that EVAN mitigates modality imbalance and improves over strong RLVR baselines. Our code is available at https://github.com/DawnLIU35/EVAN.git.

[30] Cord: Confidence-Anchored Order Residual Decoding for Masked Diffusion Language Models cs.CL | cs.AIPDF

Chengwei Zhou, Zhaoyan Jia, Massoud Pedram, Gourav Datta

TL;DR: 论文提出了一种名为Cord的轻量级提示条件策略，用于改进掩码扩散语言模型（dLLMs）的解码顺序。Cord保留置信度解码作为稳定参考，通过几何残差学习何时以及如何偏离，每次rollout采样一个低维系数矩阵以诱导整个揭示轨迹，并以序列级奖励直接训练。在三个dLLM和五个基准上，平均任务成功率从32.0%提升至48.2%，仅增加0.53M参数和5.39%推理延迟。

Details

Motivation: dLLMs的解码顺序显著影响生成质量，但常见解码器在整个生成过程中使用相同的揭示规则。置信度是强默认，但衡量的是当前位置预测的确定性，而非揭示该位置对后续解码的有用性。

Result: 在三个dLLM和五个推理、代码、约束满足基准上，平均任务成功率从置信度解码的32.0%提升到48.2%，并超过最佳每域固定残差。行为审计显示学习到的残差导致显著的任务依赖的揭示局部性和双向填充变化。

Insight: 创新点包括：保留置信度解码作为稳定参考，通过几何残差学习何时以及如何偏离；每次rollout采样一个低维系数矩阵而非每步动作，形成上下文赌博机框架，直接从序列级奖励训练；无需步骤级信用分配或骨干更新，仅增加0.53M参数和5.39%延迟，轻量高效。

Abstract: The decoding order of masked diffusion language models (dLLMs) can substantially affect generation quality, yet common decoders typically apply the same reveal rule throughout generation. Confidence provides a strong default, but it measures how decisively a position can be predicted now, not how useful revealing that position will be for subsequent decoding. We propose Cord, a lightweight prompt-conditioned policy that retains confidence decoding as a stable reference and learns when and how to depart from it through geometric residuals over generation direction, proximity to revealed context, and two-sided infilling. The residuals adapt to both the prompt and the evolving partial response. Rather than sampling a new policy action at every decoding step, Cord samples a single low-dimensional coefficient matrix per rollout, which induces an entire state-dependent reveal trajectory. This yields a contextual-bandit formulation trained directly from sequence-level rewards, without step-level credit assignment or backbone updates. Across three dLLMs and five reasoning, code, and constraint-satisfaction benchmarks, Cord improves average task success from 32.0% under confidence decoding to 48.2%, and further improves over the best per-domain fixed residual. Behavioral audits show that the learned residuals induce substantial, task-dependent changes in reveal locality and two-sided infilling. Cord adds only $0.53$M trainable parameters, requires no additional backbone forward passes, and incurs only 5.39% inference latency overhead.

[31] How Specific Do I Need to Be? Effects of User Query Underspecification on Deep Research Agents cs.CLPDF

Yi Wen, Xiangjue Dong, Bingxuan Li, Hangxiao Zhu, Leo Zhicheng Liu

TL;DR: 论文关注深度研究智能体（DRAs）在真实用户查询信息不充分（欠指定）时的表现，提出UNDERSPEC-DR框架系统评估欠指定查询对最终答案质量和中间搜索行为的影响。作者在三个DRA上发现，欠指定会显著降低答案满足用户信息需求的程度，尽管答案仍基于引用证据，并进一步分析了搜索行为变化。

Details

Motivation: 现有DRAs通常在完全指定的用户查询上训练和评估，但真实场景中的用户查询往往信息不足。论文旨在揭示当前DRAs对欠指定查询的脆弱性，并推动其主动识别何时需要用户补充信息。

Result: 在三个DRAs上的评估显示，查询欠指定会显著降低最终答案满足用户信息需求的程度，即使答案仍能基于引用证据。分析表明DRAs会更广泛搜索、更少依赖原始查询，而更多依赖训练中学到的先验，这可能与用户意图不一致。

Insight: 创新点在于提出UNDERSPEC-DR框架，系统评估欠指定查询对DRAs最终答案和中间搜索行为的双重影响。客观来看，论文将查询欠指定问题与搜索行为机制联系起来，并指出未来DRAs应主动澄清用户需求，这对深度研究智能体的可靠性研究具有启发意义。

Abstract: Deep research agents (DRAs) conduct long-horizon reasoning, search, and literature synthesis to provide long-form answers to complex, domain-specific questions. These agents are typically trained and evaluated on fully specified user queries. However, real-world user queries can often be underspecified. We introduce UNDERSPEC-DR, a framework for systematically evaluating how underspecified queries affect agents’ final answer quality and intermediate search behavior. Across three DRAs we evaluated, underspecification substantially reduces how well DRA’s answers fulfill users’ information needs, even though they remain grounded in cited evidence. Our analysis of intermediate search behavior suggests a possible explanation: DRAs conduct broader searches that draw less on the original user query but rely more on their learned prior during training, which can be misaligned with users’ intent. Our findings reveal the vulnerability of current DRAs to underspecified user queries and inform future efforts to build DRAs that proactively recognize when additional user input is needed to reliably complete deep research tasks.

[32] ARBITRA: Robust Document-Level ATT&CK Extraction via Multi-Expert Argumentation cs.CL | cs.CRPDF

Youngjin Jin, Seungwon Shin

TL;DR: 论文提出ARBITRA，用于鲁棒的文档级MITRE ATT&CK抽取。该方法让多个角色特化的LLM专家从完整报告中提出候选ATT&CK实体，再通过基于文档证据和理由的逐候选定量双极论证框架（QBAF）进行验证，并构建推理专用语料用于微调。

Details

Motivation: 现有方法常将CTI报告拆解到句子级抽取，损失文档上下文；而LLM直接处理完整报告虽可行，但性能明显下降。论文旨在解决文档级ATT&CK映射中上下文利用与抽取可靠性不足的问题。

Result: 在ATT&CK抽取基准上，ARBITRA取得比句子级流水线、近期LLM抽取系统和包括GPT-5.5在内的前沿模型更强的精度导向工作点；在模拟冲突TTP陈述、跨报告污染和语义投毒的对抗扰动下，其平均精度退化约为前沿模型基线的一半。

Insight: 创新点在于多角色LLM专家提出候选与逐候选QBAF论证验证相结合，并用推理专用语料微调专家。客观看，其价值在于将文档级证据和理由显式引入候选验证，从而提升抽取精度与对抗鲁棒性。

Abstract: Cyber threat intelligence (CTI) reports describe adversary behavior in natural language, but converting them into structured MITRE ATT&CK mappings remains difficult: existing methods decompose reports to sentence-level granularity for extraction, while modern LLMs can work with full reports in a single pass but with noticeable performance degradation. We present ARBITRA, which orchestrates multiple role-specialized LLM experts that propose candidate ATT&CK entities from the full report, which are then verified through a per-candidate quantitative bipolar argumentation framework (QBAF) grounded in document evidence and rationales. We additionally construct reasoning-specialized corpora for fine-tuning so experts can act as effective participants during this verification process. Across ATT&CK extraction benchmarks, ARBITRA reaches a stronger precision-oriented operating point than sentence-level pipelines, recent LLM-based extraction systems, and frontier models including GPT-5.5. Under adversarial perturbations simulating conflicting TTP statements, cross-report contamination, and semantic poisoning, ARBITRA limits mean precision degradation to roughly half that of frontier-model baselines for a more robust extraction.

[33] Raincheck: Deferred Multimodal Prefill for Efficient Multi-Turn MLLM Inference cs.CL | cs.AIPDF

Wenjie Huang, Jun Zhang, Hongyaoxing Gu, Haoyang Huang, Tianqi Xu

TL;DR: 论文提出Raincheck框架，针对多轮多模态大模型推理中长多模态输入导致首token延迟（TTFT）高的问题，将初始token选择与后续信息可用性解耦：先用现成的剪枝方法选出少量token做初始prefill，同时在解码阶段的空闲算力中按源顺序渐进式地prefill未选中的token，未完成的prefill在答案返回后的调度间隙继续。通过注意力可见性控制、仿射状态映射和prefill-decode融合，在full-attention与混合循环模型上实现生成开始后的上下文更新，从而在不永久丢失信息的前提下降低TTFT。

Details

Motivation: 多轮对话会复用输入上下文，但长多模态输入使prefill耗时和TTFT显著增加；现有的query-aware硬剪枝虽减少prefill token，却会永久丢弃后续问题可能需要的信息，造成质量损失。论文希望在不牺牲信息可用性的前提下加速首token生成。

Result: 在Qwen3-VL-8B和Qwen3.5-9B上以30%多模态token保留率、四种剪枝方法评测，Raincheck在MultiVerse和ConvBench上分别平均恢复硬剪枝所损失质量的77.7%和60.4%；MultiVerse上SGLang实现相对全量prefill将首轮平均TTFT最多降低24.1%，平均每输出token时间（TPOT）仅增加不到0.5%。

Insight: 创新点在于把剪枝后未选中的token延迟到解码阶段的空闲算力中渐进prefill，实现“先快后补”的信息保留策略；并通过注意力可见性控制与仿射状态映射支持生成开始后的上下文更新（含混合循环模型），以及prefill-decode融合减少重复权重读取，兼顾了效率与信息完整性。

Abstract: Multi-turn conversations with multimodal large language models (MLLMs) reuse input context, but long multimodal inputs increase time to first token (TTFT). Query-aware hard pruning reduces prefill tokens but permanently excludes information that later questions may require. We propose Raincheck, a framework for deferred multimodal prefill that decouples initial token selection from later information availability. An existing pruning method selects tokens for initial prefill; Raincheck preserves and progressively prefills unselected tokens in source order using unused compute capacity during decode. Unfinished prefill continues after answer return during available scheduling gaps. Attention visibility control and affine state mapping enable context updates after generation begins in full-attention and hybrid recurrent models. Prefill-decode fusion reduces repeated weight reads. We evaluate Qwen3-VL-8B and Qwen3.5-9B with 30% initial multimodal-token retention. Across both models and four pruning methods, Raincheck recovers on average 77.7% and 60.4% of the quality lost to matched hard pruning on MultiVerse and ConvBench, respectively. On MultiVerse, the SGLang implementation reduces mean first-turn TTFT by up to 24.1% relative to full prefill, with less than 0.5% increase in mean time per output token (TPOT).

[34] Incentivizing Self-Learning in Large Language Models via Reinforcement Learning cs.CLPDF

Lingkai Kong, Yuzhe Gu, Haiteng Zhao, Zijian Wu, Youqing Fang

TL;DR: 论文研究大语言模型从长文本参考材料中自主检索、学习并即时应用知识的“自学”能力；作者构建了基于教科书的数学解题任务和BookNavigator交互界面，并用细粒度奖励的强化学习激励模型导航教材、学习原理并构造证明；实验表明该方法在域内和域外教科书及科目上均提升证明准确率，并在复杂长上下文基准上优于基线和固定检索方法。

Details

Motivation: 现有参数知识和检索增强生成难以支撑不熟悉领域中的复杂问题求解，因为这类任务需要知识获取与推理紧密耦合，而非仅做事实检索聚合或依赖预先组装的上下文；论文希望让模型像人一样从长篇幅材料中即时自学。

Result: 在教科书数学证明任务上，该方法将Intern-S2-Preview-35B的整体证明准确率从51.5%提升到79.5%，并优于无教科书和固定检索的强化学习基线；在BrowseComp-Plus和CL-bench上分别比基座模型提升1.7和2.3个百分点。

Insight: 摘要宣称的创新点在于提出教科书式自学任务、BookNavigator交互界面以及带细粒度奖励的强化学习训练框架；从客观角度看，其创新在于把长文本自主导航、知识学习应用与强化学习奖励设计结合，验证了领域无关自学策略可迁移到复杂长上下文任务。

Abstract: Large language models (LLMs) draw on parametric knowledge and retrieval-augmented generation (RAG) to solve knowledge-intensive tasks. Yet problem solving in unfamiliar domains calls for tightly coupled knowledge acquisition and reasoning, beyond factual retrieval and aggregation or learning solely from a preassembled context. We study self-learning – autonomously retrieving, studying, and applying knowledge from long-form reference materials on the fly. To investigate this capability, we formulate a textbook-based mathematical problem-solving task. LLMs must navigate textbook exposition, learn and apply relevant principles, and construct proofs for exercises, with reference solutions withheld. We introduce a BookNavigator interface to support this human-inspired study process and incentivize self-learning through reinforcement learning (RL) with fine-grained rewards. Experiments show that our method improves performance across in-domain and out-of-domain textbooks and subjects, raising Intern-S2-Preview-35B’s overall proof accuracy from 51.5% to 79.5% and outperforming RL-trained textbook-free and fixed-retrieval baselines. These gains extend to complex long-context benchmarks involving different task types, with improvements over the base model of 1.7 and 2.3 percentage points on BrowseComp-Plus and CL-bench, respectively. Together, these findings suggest that RL can foster a domain-agnostic self-learning strategy, highlighting the potential of self-learning from long-form corpora to strengthen broader problem-solving capabilities on complex, long-context tasks.

[35] AI Cosmos: An Agentic Infra for Situated Learning cs.CLPDF

AI Cosmos Team, Jinfeng Zhou, Yuxuan Chen, Fangming Chang, Mingyu Su

TL;DR: 论文提出AI Cosmos，一个面向情境学习的智能体基础设施，围绕场景化参与和实践资产累积两项原则，将学习者与角色化智能体组织到集成任务知识和可执行工作台的学习场景中，并通过资产记忆循环把实践过程和结果保存为带来源与依赖的可复用资产。作者用两项预注册随机对照研究评估法律推理和编程能力学习，在相同底层LLM条件下取得优于基线的学习效果。

Details

Motivation: LLM虽能提升学习过程中的任务表现，但这种提升不一定转化为学习者之后独立应用知识与技能的能力；论文关注如何通过情境化、智能体化基础设施促进可迁移的独立能力。

Result: 在法律推理学习中，AI Cosmos相较常规LLM取得更高学习增益；在编程学习中，对未见问题的掌握度高于LLM-as-Teacher基线；结果来自两项预注册随机对照研究。

Insight: 创新点在于将角色化智能体、场景化参与、可执行工作台与资产记忆循环结合，把实践过程沉淀为具有显式来源和依赖关系的可复用资产，并以独立应用能力而非仅学习时任务表现作为评估重点。

Abstract: Large language models (LLMs) can improve task performance during learning, yet these gains do not necessarily reflect learners’ ability to thereafter apply the knowledge and skills independently. We present AI Cosmos, an agentic infrastructure for situated learning that organizes learning around two complementary principles: scenario-based participation and cumulative assets of practice. AI Cosmos organizes learners and role-specialized agents within learning scenarios that integrate task-relevant knowledge and, when needed, executable workbenches. An asset-memory loop preserves the processes and outcomes of practice as reusable assets with explicit provenance and dependencies. We evaluate scenario-based interaction through two preregistered randomized controlled studies examining the acquisition of legal reasoning and programming competence, holding the same underlying LLM across conditions. AI Cosmos achieves greater learning gains than a conventional LLM in legal reasoning and higher mastery of unseen programming problems than an LLM-as-Teacher baseline.

[36] Upcycling Language Models for Multiple Specialized Domains cs.CL | cs.AIPDF

Mingzi Cao, Xi Wang, Nikolaos Aletras

TL;DR: 论文提出面向多领域适应的Domain-Specialized Upcycling（DS-Upcycling）方法，将语言模型通过upcycling扩展为带专家和路由器的结构，并引入领域感知监督训练路由器以选择合适专家。微调新领域时仅更新对应专家和路由器，冻结其余参数，从而在提升多领域适配性能的同时保留通用能力。

Details

Motivation: 现有多领域适配方法多基于LoRA为每个领域训练独立适配器并组合，但存在对输入领域不敏感、仍激活无关适配器以及低秩结构容量受限等问题，难以在优先相关领域知识的同时抑制无关领域干扰。

Result: 实验表明DS-Upcycling在适配领域上的平均性能优于基线，并保持通用性能；每个领域仅用256个样本监督路由器时，适应后路由准确率达90-98%，而无该方法的router训练仅43-70%。

Insight: 创新点在于用upcycling扩展专家容量并以领域感知监督学习路由选择，同时采用仅更新对应专家和路由器的领域专门化微调策略；客观看，其结合了模型扩展、稀疏路由和领域隔离，缓解多领域干扰并提升路由判别性。

Abstract: Effective multi-domain adaptation of large language models requires prioritizing relevant domain knowledge while minimizing interference from irrelevant domains. Existing approaches commonly use Low-Rank Adaptation (LoRA) to train a separate adapter for each domain and combine these adapters within one model. However, they either weight adapters equally regardless of the input domain or dynamically weight adapters while still activating all of them including irrelevant ones. Additionally, while efficient, their low-rank structure limits performance. In contrast, upcycling is a model expansion method that adds experts and a router to a dense Transformer layer offering larger capacity than LoRA approaches. In this paper, we propose Domain-Specialized Upcycling (DS-Upcycling) for multi-domain adaptation. We introduce a new domain-aware supervision that allows the router to effectively learn to distinguish domains by selecting the appropriate experts. During fine-tuning on each new domain, we update only the corresponding expert and router while freezing all other parameters. Experiments show that our method achieves the highest average performance across the adapted domains compared to baselines while retaining general performance. With just 256 examples per domain for router supervision, DS-Upcycling achieves 90-98% routing accuracy after adaptation compared with 43-70% for routers trained without our approach.

[37] Mobilizing the Archive: Bitext Extraction at Scale from Archival Documents for Extremely Low-resource Languages cs.CLPDF

Chutong Meng, Alec J. Bateman, Antonios Anastasopoulos

TL;DR: 论文针对网上几乎没有存在感的极低资源语言，提出从语言学档案资源（语法书、词典等）中大规模抽取平行句对，构建结合OCR与视觉语言模型并利用版面视觉信息对齐的流水线。作者在20种语言上验证抽取双语文本可用于训练机器翻译模型和进行大语言模型上下文学习，从而快速启动翻译系统。

Details

Motivation: 许多低资源语言缺乏网页平行语料，但拥有大量由语言学家长期积累的档案文献；论文希望将这些非网络资源转化为可扩展的平行数据，以支持极低资源语言的机器翻译。

Result: 论文在20种语言上展示了抽取双语文本对翻译系统的引导作用，包括训练机器翻译模型和LLM上下文学习；在上下文学习设置下，相比零样本翻译，低资源目标语言和高资源目标语言分别取得+15.78和+6.94 chrF2++提升。

Insight: 创新点在于将档案语言文档作为极低资源语言平行语料的新来源，并提出融合OCR与VLM、结合视觉版面布局进行内容对齐的抽取流水线；客观来看，其价值在于扩展平行数据覆盖范围，并为无网络存在语言提供可规模化的数据构建路径。

Abstract: While mining parallel sentences from web pages has proven effective for low-resource machine translation, the majority of the world’s languages have little to no web presence. What they do have, though, are resources that are the result of centuries of efforts by linguists, such as grammars, dictionaries, and other documentation materials. We propose extracting translation examples from such linguistic resources, which offer parallel data for languages under-represented online and could potentially scale to thousands more languages. We develop a pipeline to achieve this, leveraging an Optical Character Recognition (OCR) model as well as a vision language model (VLM), to ensure identified content to be aligned with visual layout information. We demonstrate the utility of the extracted bitexts for bootstrapping translation systems across 20 languages, both by training machine translation models and by applying in-context learning for large language models. For in-context learning, we observe improvements of +15.78 and +6.94 chrF2++ over zero-shot translation for into low- and high-resource languages, respectively.

[38] ScienceJudge: Pattern Perturbation Augmentation for Sentence-Level Scientific Claim Verification cs.CLPDF

Chuhai Cai, Xin Chen, Min Yang, Feng Jiang

TL;DR: 论文研究句子级科学声明验证，即判断AI生成科学段落中的每个句子是否被给定的多模态证据包支持。作者提出模式扰动增强（PPA），将报告错误建模为标签特定的保真破坏变换，并从标注样本中归纳可复用的错误模式，用于构造受控难负例；进而提出ScienceJudge，通过类加权集成融合经PPA训练的视觉-语言预测器和指令引导的LLM预测器。

Details

Motivation: 细粒度报告错误往往保持语句流畅合理，却引入微妙的证据-声明偏差，加之监督稀疏且类别不平衡，导致这类错误难以检测；论文旨在提升此类句子级科学声明验证的鲁棒性和准确性。

Result: 在本地开发集上，ScienceJudge将平均分从0.8124提升至0.8692，Macro-F1达0.8466，段落精确匹配达0.8919；提交系统在NLPCC 2026 Task 10 Track 1官方榜单以最终分0.6890排名第一。

Insight: 创新点在于将报告错误显式建模为标签特定的保真破坏变换，从标注数据中归纳可复用错误模式，生成可控难负例并进行模式级、操作级和跨域增强；同时通过类加权集成结合视觉-语言模型与指令引导LLM，兼顾多模态证据理解与细粒度推理。

Abstract: Sentence-level scientific claim verification determines whether each sentence in an AI-generated scientific paragraph is supported by a given multimodal evidence bundle. Fine-grained reporting errors often preserve fluent and plausible statements while introducing subtle evidence-claim deviations, making them difficult to detect under sparse and imbalanced supervision. We propose Pattern Perturbation Augmentation (PPA), which models reporting errors as label-specific faithfulness breaking transformations and induces reusable error patterns from labeled examples. PPA applies these patterns to supported claims to construct controlled hard negatives and expands their coverage through pattern-level, operation-level, and cross-domain augmentation. Based on these augmented views, we develop ScienceJudge, which integrates PPA-trained vision-language predictors and instruction-guided LLM predictors through class-weighted ensemble inference. On the local development set, ScienceJudge improves the average score from 0.8124 to 0.8692, achieving a Macro-F1 of 0.8466 and a Paragraph Exact Match score of 0.8919. Our submitted system ranks first on the official NLPCC 2026 Task 10 Track 1 leaderboard with a final score of 0.6890.

[39] Latent Path Exploration via Potential-Guided Subtrajectory Balance cs.CL | cs.LGPDF

Xiaoling Zeng, Qi Zhang

TL;DR: 论文提出SubLAT，用于引导语言模型在连续潜空间中进行随机推理路径探索。方法将相对答案势能与Subtrajectory Balance结合，用终态正确性信号评估潜状态对答案的支持，并约束不同长度子轨迹上的前向/后向转移密度。模型联合使用答案监督、CoT监督和表示蒸馏训练，在算术与演绎推理任务上验证了更大采样预算下解覆盖率的提升。

Details

Motivation: 现有随机潜空间推理虽能采样多条连续推理路径，但随机性本身不能保证有效探索，关键问题是引导中间潜状态之间的随机转移走向更有用的推理路径。

Result: 在算术和演绎推理的域内、域外benchmark上，随着采样预算增加，解覆盖范围提升；在若干结构性OOD benchmark上也取得改进。轨迹分析显示采样潜路径逐渐分化，且算术benchmark中正确轨迹具有更高的平均相对势能。摘要未明确声称达到SOTA。

Insight: 创新点在于将相对答案势能与Subtrajectory Balance引入随机潜空间推理探索，用势能差关联子轨迹的前向/后向转移密度，并结合答案、CoT与表示蒸馏联合训练。客观来看，其可借鉴之处是把强化学习/能量引导式探索思想用于连续潜推理路径选择，而非仅依赖随机采样。

Abstract: Continuous latent reasoning enables language models to perform intermediate computation without generating explicit reasoning traces. Advances in stochastic latent reasoning allow multiple paths to be sampled in continuous space, but stochasticity alone does not ensure effective exploration. A key challenge is guiding stochastic transitions between intermediate latent states toward useful reasoning paths. We introduce SubLAT, which couples a relative answer potential with Subtrajectory Balance to learn stochastic latent exploration. The relative potential evaluates the answer support of sampled states against replacement states, with a correctness signal at the terminal state. Subtrajectory Balance relates potential differences to forward and backward transition densities across subtrajectories of different lengths. The model is jointly trained with answer supervision, CoT supervision, and representation distillation. Experiments on arithmetic and deductive reasoning show increasing solution coverage with larger sampling budgets across in-domain and out-of-domain benchmarks, as well as improvements on several structural OOD benchmarks. Trajectory analyses reveal progressive divergence among sampled latent paths and higher mean relative potentials for correct trajectories across arithmetic benchmarks.

[40] Don’t Lose the Thread: Empowering Long-Horizon LLM Agents with Cognitive Resource Self-Allocation cs.CLPDF

Zheng Zhu, Xiaozhuan Liang, Xi Chen, Bei Yu, Jiaya Jia

TL;DR: 论文提出 CORAL 推理范式，让 LLM 智能体通过可调用的工作内存管理工具主动优化上下文：在长程任务中记录任务进度和已验证事实，并在上下文混乱时重置上下文、从干净状态恢复推理。论文还用多回合智能体强化策略优化提升检查点能力。

Details

Motivation: LLM 智能体在长程任务中常因认知过载而失败：工作记忆被不断膨胀的无关信息干扰，注意力被稀释，影响规划和推理。论文旨在让智能体主动管理上下文资源以缓解该问题。

Result: 在 GAIA 基准上，CORAL 使用 8B 模型达到 42.8% 平均准确率，在更困难的 Level 2/3 长程任务上提升尤其明显；相比 ReAct 智能体减少 6-7 倍输入 token 消耗。方法还能泛化到多跳知识问答基准，并在 BrowseComp 上将强专有智能体提升 8.0 个点。

Insight: 创新点在于将工作内存管理工具化为智能体可调用的能力，通过检查点保存任务进度与已验证事实、重置杂乱上下文并从干净状态恢复推理，实现认知资源自分配；同时用多回合智能体强化策略优化增强检查点能力。客观看，其价值在于把长程上下文管理与强化学习训练结合，兼顾性能和推理成本。

Abstract: Agents powered by large language models (LLMs) have demonstrated remarkable progress in solving complex reasoning tasks. However, LLM agents often falter on long-horizon tasks due to cognitive overload, as their working memory becomes cluttered with expanding and irrelevant information, which dilutes their attention and hinders effective planning and reasoning. To mitigate this challenge, we introduce Cognitive Resource Self-Allocation (CORAL), a novel reasoning paradigm that empowers agents to proactively optimize their context. Implemented as an agent-callable working memory management toolset, CORAL allows an agent to checkpoint its task progress and verified facts, and adaptively initiate a new problem-solving episode by resetting cluttered context while preserving only the checkpointed information, enabling it to resume reasoning from a clean state. We further enhance the agent’s checkpointing capabilities using a Multi-episode Agentic Reinforced Policy Optimization algorithm. On the GAIA benchmark, CORAL with an 8B model achieves 42.8% average accuracy, with particularly strong gains on the most challenging long-horizon tasks (Level 2 and Level 3). Crucially, these gains come at a substantially lower inference cost: CORAL consumes 6-7$\times$ fewer input tokens than a ReAct agent. It also generalizes to multi-hop Knowledge QA benchmarks and to the considerably harder BrowseComp, where it improves a strong proprietary agent by 8.0 points.

[41] Scaling Mathematical Proof Supervision from Structured Textbooks cs.CL | cs.AIPDF

Youqing Fang, Zhouqi Hua, Yinhao Tang, Yuzhe Gu, Lingkai Kong

TL;DR: 论文构建了 TOME-Math 大规模数学证明监督语料库，将 2118 本大学数学教材转换为约 38 万条结构化证明监督记录，并保留章节顺序、命题-证明链接、依赖引用和来源信息。基于这些结构信号，论文研究了跨数学学科的课程学习以及监督数据量和来源广度的缩放规律，并通过微调验证结构化教材对数学推理能力的提升。

Details

Motivation: 现有语言模型的数学监督通常被扁平化为孤立的问题-答案对，丢失了教材中的课程组织与证据结构，因此论文希望利用结构化教材提供可扩展且更有组织性的数学证明监督。

Result: 在完整规模下，使用 TOME-Math 微调使模型在留出评估和公开基准上的未加权平均分相比基座模型提升 16.7 个百分点，并在总体指标上超过所评估的三个公开指令数据基线。

Insight: 创新点在于将教材中的章节顺序、命题-证明关系、依赖引用等结构信息保留下来构建监督语料，并系统分析数据组织方式、监督规模与来源广度对数学推理的影响，为结构化数学监督提供了数据和实证框架。

Abstract: Mathematical supervision for language models is typically flattened into isolated problem-solution pairs, discarding the curricular organization and evidential structure of the original sources. We introduce TOME-Math (Textbook-Oriented Mathematical Evidence), a large-scale corpus that converts 2,118 textbooks spanning the core areas of university-level mathematics subjects into approximately 380K structured proof-supervision records while preserving chapter order, proposition-proof links, dependency references, and source provenance. Leveraging these structural signals, we explore curriculum learning across multiple mathematical subjects and characterize scaling patterns with supervision volume and source breadth. At full scale, fine-tuning on TOME-Math raises the unweighted mean score across our held-out evaluations and established public benchmarks by 16.7 percentage points over the base model, while exceeding all three public instruction-data baselines evaluated in aggregate. Our findings highlight structured textbooks as both a scalable source of mathematical supervision and an empirical framework for studying the impact of data organization on mathematical reasoning. We will release the corpus to facilitate further research on structured mathematical supervision.

[42] Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation cs.CLPDF

Yifu Luo, Chuang Ma, Zeyu Chen, Enkelejda Kasneci, Qi Chen

TL;DR: 论文研究大语言模型后训练中的在线策略自蒸馏（OPSD），指出同一回复内不同token对教师监督的偏好不同，现有固定教师或回复级自适应方法不足。作者提出MTA-OPSD，构建多教师池，并让每个token在训练中自适应选择其偏好的教师。

Details

Motivation: 现有OPSD要么训练全程使用固定教师，要么仅在回复级调整部分参考暴露，无法刻画同一回复内token级教师偏好的差异。论文通过教师干预试点实验验证该差异，并希望为每个token提供更合适的教师监督。

Result: 在Qwen3模型的数学推理任务上，MTA-OPSD一致优于现有OPSD方法，相对基座模型平均增益最高达+5.9，说明token级自适应教师监督有效。

Insight: 创新点在于提出首个token级自适应OPSD方法：构建候选教师池，并基于多数投票和KL选择为每个token动态匹配偏好教师。客观看，其价值在于将自蒸馏的教师监督粒度从回复级细化到token级，但多教师池也会带来额外选择与计算开销。

Abstract: On-policy Self-distillation (OPSD) has proven effective for post-training large language models by constructing a teacher conditioned on privileged references. However, existing approaches keep the teacher fixed either throughout training by consistently exposing it to the full reference, or within each response by adaptively varying partial reference exposure only across responses. In this paper, we argue that neither of them is sufficient. Instead, every token needs its own teacher, as the teacher preference can vary token by token within the same response. Through a teacher-intervention pilot study, we validate that the teacher preference differs across tokens, and reveal that a preferred teacher can be identified for each token through majority voting and KL-based selection. Motivated by these findings, we propose Multi-teacher Adaptive On-policy Self-Distillation (MTA-OPSD), the first token-level adaptive OPSD method. Our method constructs a multi-teacher pool consisting of candidate teachers, and enables every token to adaptively select its preferred teacher during training. Experiments with Qwen3 models on mathematical reasoning tasks show that MTA-OPSD consistently outperforms existing OPSD approaches with an average gain of up to $+5.9$ over the base model, highlighting the importance of adapting teacher supervision at the token level. The code is available at https://github.com/xingzhejun/MTA-OPSD.

[43] PIVOT: Progressive Intervention via Online Teacher Correction cs.CLPDF

Zhihao Yang, Boyuan Zheng, Puhui Tan, Yukun Chen, Kuan Zhang

TL;DR: 论文针对RLVR在困难推理任务中因组内rollout全失败导致奖励稀疏、无学习信号的问题，提出PIVOT方法：将教师生成的修正片段插入学生rollout，并对这些片段施加token级KL监督，与RLVR目标联合训练。论文还系统分析了干预位置与监督方式，形成有效指导方案。

Details

Motivation: RLVR依赖可验证的结果级奖励，在困难任务中当一组rollout全部失败时无法提供学习信号；引入更强教师虽可补充指导，但关键是如何把这些信号融入RLVR，既提高成功rollout的可获得性，又保持对学生可学习。

Result: 在困难逻辑游戏和数学推理benchmark上，PIVOT持续优于现有方法；逻辑游戏mean avg@8从最佳基线19.5%提升到35.6%，接近翻倍。

Insight: 创新点在于区分并结合轨迹级干预与token级监督：用教师修正提高奖励轨迹访问，同时对修正片段做token级KL监督以提供密集目标；并通过系统分析干预位置和监督方式形成可复用的指导recipe。

Abstract: Reinforcement learning from verifiable rewards (RLVR) is limited by sparse outcome-level feedback on hard reasoning tasks: when all rollouts in a group fail, rewards provide no learning signal. Stronger teachers can provide additional guidance, but this raises a central question: how can such signals be incorporated into RLVR to support successful rollouts while remaining learnable for the student? We distinguish two complementary mechanisms: trajectory-level intervention, which improves access to reward-bearing trajectories, and token-level supervision, which provides dense targets to guide student learning. Our controlled experiments show that either mechanism alone can remain insufficient, motivating their combination. We therefore introduce PIVOT, which inserts teacher-generated corrections into student rollouts and applies token-level KL supervision to these segments alongside the RLVR objective. Beyond their combination, we systematically analyze where to intervene and how to supervise, yielding a recipe for effective guidance. Across hard logic games and mathematical reasoning benchmarks, PIVOT consistently outperforms existing methods, nearly doubling mean avg@8 on logic games from 19.5% for the best-performing baseline to 35.6%.

[44] ShallowDefend: Harnessing Shallow Safety Alignment for Multi-Turn Defender cs.CLPDF

Qiyao Ma, Xiaodong Liu, Weiwei Yang, Mingqian Feng, Chengquan Guo

TL;DR: 论文针对LLM安全对齐的浅层性导致多轮对话中分散有害请求仍常成功的问题，提出ShallowDefend框架，将防御者置于响应轨迹起始处：先评估用户意图，再提交显式可解析的安全决策，最后基于该决策生成回复，并用强化学习在攻击请求轮训练该决策承诺。方法在两个模型家族、十四个覆盖安全、效用和有用性的benchmark上进行受控比较。

Details

Motivation: 多轮对话中，将有害请求分散到多轮仍能绕过LLM安全对齐；其机制根源是安全行为集中在模型最初几个输出token，现有防御只监督回复表面形式，未让模型学习显式安全决策。

Result: 在两个模型家族、十四个覆盖安全、效用和有用性的benchmark上，受控比较中取得最强的多轮安全性，并保持效用，但有用性有适度代价；逐token KL分析和干预探针表明训练效果集中在决定回复轨迹的简短 deliberation 上，提交的决策是因果控制点。

Insight: 创新点在于反向利用浅层安全对齐：在响应起始的高杠杆token段强制模型先做出显式、可解析的安全决策，再条件生成回复；决策以token span形式存在，因此可用规则化自验证奖励训练而无需judge或标注，也兼容LLM-as-judge的分级决策奖励与安全重定向。客观看，其可借鉴之处是将浅层脆弱性转化为干预点，并把安全决策训练成可验证、可因果控制的中间承诺。

Abstract: Safety alignment has enabled large language models to reliably refuse harmful requests directly, yet the same request distributed across a multi-turn conversation still succeeds far too often. This brittleness has a mechanistic root: Alignment is shallow, with safety behavior concentrated in a model’s first few output tokens, and existing defenses inherit the weakness, supervising the surface form of the response without ever giving the model an explicit safety decision to learn. We take the opposite view of shallowness: if a short span determines the trajectory of an entire response, that span is the highest-leverage place to intervene, and the defender can occupy it first. We propose Assess $\to$ Decide $\to$ Respond, a framework in which the defender assesses the user’s intent, commits to an explicit, parseable safety decision, and only then generates a reply conditioned on it, with the commitment trained by reinforcement learning at the payload turn. Because the decision is a token span, the reward can be a rule: a self-verified reward checks the committed label against the conversation’s known nature, requiring no judge and no annotation, while the same format also supports an LLM-as-judge reward over a graded decision space with safe redirection. Across two model families and fourteen benchmarks spanning safety, utility, and helpfulness, our defenders achieve the strongest multi-turn safety in a controlled comparison, maintaining their lead in safety while preserving utility at a modest cost to helpfulness. A per-token KL analysis and interventional probes confirm why this works: training concentrates its effect on the brief deliberation that sets a response’s trajectory, and the decision committed there is a causal control point. The very shallowness attackers exploit becomes the mechanism of defense.

cs.CV [Back]

[45] Venus-DefakerOne2: A Vision-Forensics Foundation Model with Broader Coverage cs.CVPDF

Chenfan Qu, Yachao Liang, Mingqi Fang, Jiangwei Xie, Zhenming Wang

TL;DR: 论文提出视觉取证基础模型 Venus-DefakerOne2，旨在统一覆盖数字篡改与物理欺骗、图像与视频等多类伪造威胁。模型基于数千万开源与自建样本训练，采用 Tide-Style-Tuning 和基于熵的测试时自适应，在多个取证基准上取得领先表现。

Details

Motivation: 现实伪造形式异构，既包括数字操纵也包括物理欺骗，且媒介从图像扩展到视频；现有方法虽多，但缺少覆盖如此广泛威胁谱系的统一反伪造基础模型。

Result: 在 DeepFake 人脸、AI生成图像、篡改文档、自然图像操纵、物理欺骗和AI生成视频等基准上分别达到96.7%、93.3%、87.6%、89.6%、93.1%和96.0%，取得新的SOTA，并优于专用专家模型和前代 DefakerOne。

Insight: 论文宣称的创新在于沿伪造形式和媒体类型两个维度扩展取证能力，并用 Tide-Style-Tuning 交替 LoRA 与全参数微调以兼顾效率、泛化和难样本拟合、缓解灾难性遗忘；同时用预测熵做测试时自适应选择最佳预测模态。客观看，其价值主要在于统一多任务/多媒介取证框架与大规模训练下的工程化适配策略。

Abstract: Real-world forgery is inherently heterogeneous: it manifests not only as digital manipulation but also as physical spoofing, and is carried not only by images but also by videos. Despite substantial progress, a unified anti-forgery foundation model covering such a broad threat spectrum remains absent. In this paper, we present Venus-DefakerOne2, which substantially extends the forensic capability boundary along both the forgery-form and media-type dimensions. Trained on tens of millions of open-source and in-house samples, it incorporates two key designs. Tide-Style-Tuning alternates LoRA and full-parameter fine-tuning to balance computational efficiency, generalization, and hard-sample fitting while mitigating catastrophic forgetting. Entropy-based Test Adaptation determines the optimal prediction modality by analyzing prediction entropy. Venus-DefakerOne2 achieves new state-of-the-art performance across a comprehensive suite of benchmarks, including DeepFake faces (96.7%), AI-generated images (93.3%), tampered documents (87.6%), manipulated natural images (89.6%), physical spoofs (93.1%), and AI-generated videos (96.0%). It significantly outperforms both specialized expert models and its predecessor, DefakerOne, establishing itself as a powerful and versatile foundation model for binary-decision forensic tasks.

[46] You Don’t Need Aligned Representations: Knowledge Distillation via Random Prototype Spaces cs.CV | cs.LGPDF

Hamza Etcibasi, Ramazan Gokberk Cinbis

TL;DR: 论文提出RPKD（随机原型知识蒸馏），放弃教师与学生表示必须对齐到兼容特征空间的常见假设，转而将两者与共享的随机初始化且冻结的原型向量库比较，在外部参考空间中完成对齐。教师侧仅用无参数的固定随机映射投影，只有学生侧适配；方法包含对齐全局原型相似度分布的逻辑分支和匹配空间原型激活图的特征分支。该方法在多个图像分类蒸馏基准上取得显著提升。

Details

Motivation: 传统知识蒸馏通常假设教师和学生表示需要显式对齐或处于兼容特征空间，论文希望去除这一限制，并在标签空间受限的低类别场景中提供比单纯标签空间更丰富的监督信号。

Result: 在CIFAR-100上相对OFA最大提升+7.98%，ImageNet-100上提升+12.44%，ImageNet-1K上提升+1.28%，实验验证了RPKD的有效性。

Insight: 创新点在于用共享的随机冻结原型库构建外部参考空间，教师侧采用无训练参数的固定随机投影，使学生仅在外部空间中适配；该设计可跨教师-学生架构复用原型库和蒸馏目标，并在低类别设置下通过解耦原型词表与任务标签空间获得更丰富监督。

Abstract: A widely held assumption in knowledge distillation is that teacher and student representations must occupy a compatible or explicitly aligned feature space. We propose RPKD (Random Prototype Knowledge Distillation), which discards this assumption by comparing both networks against a shared bank of randomly initialized, frozen prototype vectors. Alignment is therefore carried out in an external reference space rather than in the teacher’s native feature coordinates: the teacher side is projected by fixed random maps that carry no trainable parameters, and only the student adapts. Two branches handle the transfer: a logit branch aligning global prototype similarity distributions and a feature branch matching spatially-resolved prototype activation maps. Both operate within the same fixed prototype space, which can be interpreted as a random feature embedding that approximately preserves inter-sample similarity structure, so the prototype bank and the distillation objective stay unchanged across teacher-student pairs while only the input projections are instantiated per architecture. In low-category settings, decoupling the prototype vocabulary from the task label space yields richer supervision than the label space alone, an advantage absent from logit-based methods, whose supervisory signal collapses as class count shrinks. This advantage is especially relevant in real-world scenarios where the label space is typically constrained. Extensive experiments demonstrate the effectiveness of RPKD, achieving a maximum gain of +7.98% over OFA on CIFAR-100, +12.44% on ImageNet-100, and +1.28% on ImageNet-1K. Source code is available at https://github.com/HamzaEtcibasi/RPKD

[47] Hierarchical Diffusion for Camera-controlled Autoregressive Video Generation cs.CVPDF

Kaihua Chen, Yiming Gong, Deva Ramanan, Tarasha Khurana

TL;DR: 论文面向单图像条件下的长视频相机控制生成，提出将自回归视频生成WanAR与分层长上下文去噪FixAR结合的轻量框架；通过warping-and-inpainting引入相机几何约束，并采用由近及远、由细到粗的分层去噪缓解自回归漂移。最终在RealEstate10k和DL3DV上实现时间稳定且符合输入相机轨迹的长视频生成。

Details

Motivation: 解决自回归长视频生成中的误差累积与时间漂移问题，以及相机控制难以有效融入生成过程的问题；现有self-forcing或显式6-DOF条件方法存在计算开销大或场景几何漂移的局限。

Result: 在RealEstate10k和DL3DV上，WanAR+FixAR优于先前相机控制长视频生成方法，生成结果时间稳定并与输入相机轨迹一致；摘要未给出具体定量指标。

Insight: 创新点在于将视频生成重构为warping-and-inpainting以施加相机几何一致性，并设计分层长上下文去噪：先基于短历史生成，再用时间下采样的长程历史精炼，以较低开销获得全局时间一致性。客观看，可取之处是分层条件机制在计算成本与长时一致性之间取得折中，并将前馈新视角合成思想与自回归视频生成结合。

Abstract: We address the task of long-video, camera-controlled generation from a single image. The dominant autoregressive paradigm suffers from two key limitations: (1) error accumulation over time, as distant frames are conditioned on previously generated outputs rather than ground truth, leading to drift; and (2) ambiguity in how to incorporate camera control. Standard solutions to both–such as self-forcing and conditioning on explicit 6-DOF poses–either incur significant computational overhead or produce drifting scene geometries over time. We propose a simple and lightweight framework that combines autoregressive generation (WanAR) with hierarchical long-context denoising (FixAR). To enforce scene geometry remains consistent with input cameras, we draw from feed-forward novel-view synthesis and reformulate video generation as a warping-and-inpainting problem. To mitigate drift, we introduce a hierarchical denoising strategy in which different stages condition on different temporal histories. Specifically, we first generate frames conditioned on the immediate past, and then refine them using a second denoiser conditioned on a temporally subsampled long-range history to enforce global consistency. This fine-to-coarse scheme enables each generated frame to effectively condition on the full temporal context without incurring a prohibitive cost. Experiments on RealEstate10k and DL3DV demonstrate that WanAR+FixAR outperforms prior methods for camera-controlled long-video generation, producing results that are both temporally stable and consistent with input camera trajectories.

[48] Where Can We Fool the Model’s Mind? Response-Guided Semantic Probing and Adaptive Routing for Transferable Attacks on Black-Box MLLMs cs.CVPDF

Ahmed Abdelnaby, Mohamed Elmahallawy

TL;DR: 论文提出VISTA黑盒框架，利用MLLM的响应构建不确定性多模态行为图，通过熵自适应Sinkhorn路由和替代集成聚焦语义脆弱区域，支持纯迁移（VISTA-Proxy）和查询辅助（VISTA-Victim）两种攻击设置，在多个商业MLLM上实现高攻击成功率且扰动隐蔽。

Details

Motivation: 现有黑盒攻击依赖替代模型显著性分配扰动，可能无法反映未知MLLM的语义解释或依赖区域，因此需要一种从模型响应中识别语义脆弱区域的可迁移攻击方法。

Result: 在GPT-5、Gemini-3.5-Flash和Claude Sonnet 4.6上，VISTA最高达到97%攻击成功率，同时PSNR保持在30dB以上；VISTA-Proxy无需查询最终受害者即可达到最高93%的ASR。

Insight: 创新点在于从响应漂移、冲突、误导和语义偏移中构建UBMB图，并结合熵自适应Sinkhorn路由与替代集成，在不访问梯度、logits、参数或内部表示的情况下实现有效的语义级迁移攻击。

Abstract: Multimodal Large Language Models (MLLMs) ground language in visual evidence, yet their semantic reasoning can be exploited through transferable black-box adversarial attacks. Existing attacks typically allocate perturbations using surrogate-model saliency, which may not reflect how an unseen MLLM semantically interprets or relies on different image regions. We introduce VISTA (Vulnerability-Informed Semantic Transfer Attacks), a black-box framework that identifies semantically vulnerable visual regions from an MLLM’s responses without access to gradients, logits, parameters, or internal representations. VISTA supports two attack settings: (i) VISTA-Proxy, a pure-transfer setting that probes an open-source MLLM and transfers the resulting adversarial examples to unseen commercial MLLMs without querying them; and (ii) VISTA-Victim, a query-assisted setting that probes the target MLLM to capture model-specific semantic vulnerabilities. VISTA builds an Uncertainty-Based Multimodal Behavior (UBMB) map from response drift, conflict, misleading, and semantic shifts, then uses entropy-adaptive Sinkhorn routing and a surrogate ensemble to focus perturbations on vulnerable regions. Across GPT-5, Gemini-3.5-Flash, and Claude Sonnet 4.6, VISTA achieves up to 97 % attack success rate (ASR) while maintaining a Peak Signal-to-Noise Ratio (PSNR) above 30 dB. Notably, VISTA-Proxy achieves up to 93 % ASR without querying the final victim, demonstrating that response-derived semantic vulnerability can enable effective transfer across heterogeneous MLLMs.

[49] Can Event Detectors Leave the Broadcast Camera? Evidence from Tennis cs.CV | cs.AIPDF

David Soeiro-Vuong, Andre-Louis Rochet

TL;DR: 论文面向网球单目视频中“球弹跳”和“击球”易混淆的事件检测问题，发布了一个包含8段混合视角视频、345个帧级标注的基准，并提供混淆感知匹配器、冻结划分和盲标注评测。作者在该基准上评测了监督式精确检测器、零样本视觉语言模型以及无需事件标签训练的RallyArb仲裁层。结果显示广播视角下监督检测器近乎完美，但在手机和场边低视角下性能骤降；RallyArb和微调策略能部分缓解跨视角退化，但击球时刻精度仍有不足。

Details

Motivation: 网球统计依赖弹跳和击球事件，而二者在单目视频中容易混淆。现有事件检测器多在广播视频上训练，论文关注其能否泛化到手机、固定高机和场边低视角等非广播相机。

Result: 监督检测器在广播片段上近乎完美，但在手机和场边低视角上几乎失效，E2E-Spot的汇总弹跳F1仅0.130；RallyArb在三个手机/场边片段上保持弹跳F1高于0.8，并在留出片段中找到11个弹跳中的8个，但击球时刻与人工标注偏差较大；视觉语言模型能在各视角检测事件，但接触帧约偏差0.1秒；从广播权重做留一片段微调后，两个手机/场边片段可达约0.8弹跳F1，但在掠射手机视角仍仅0.2。

Insight: 论文的创新点在于发布跨视角网球事件基准与评测协议，包括混淆感知匹配器、冻结预测和盲标注，并系统揭示广播相机检测器的跨视角失效。客观来看，RallyArb利用球轨迹和球员姿态进行无需事件标签参数的仲裁，以及留一片段微调分析，为跨视角事件检测提供了可复现的诊断思路。

Abstract: Ball bounces and racket hits are the events from which tennis statistics are derived, and on monocular video the two are easy to confuse. We release a benchmark of 345 bounce and hit annotations at frame level on eight clips that mix broadcast, fixed elevated, phone and court-level viewpoints, with a frozen development and test split, a confusion-aware matcher, clip-level bootstrap intervals and a blind second annotation of three clips. On it we score supervised precise spotters with published broadcast weights, two zero-shot vision-language models, and RallyArb, an arbitration layer over a ball track and player poses that fits no parameter on event labels. The supervised spotters score near-perfectly on broadcast footage and almost nothing on phone and court-level footage, where the pooled bounce F1 of E2E-Spot is 0.130. RallyArb keeps a bounce F1 above 0.8 on the three phone and court-level clips, two of which were used to tune it, and finds 8 of 11 bounces on the held-out one, but it places hits too far from the contact frame to match human timing. The vision-language models detect events on every viewpoint and miss the contact frame by about 0.1 s. Fine-tuned leave-one-clip-out from its broadcast weights, the spotter reaches about 0.8 bounce F1 on two phone and court-level clips and stays at 0.2 on a grazing phone angle. The annotations, the evaluator and the frozen predictions of every scored row are released.

[50] Vision Tomography: Towards Portable 3D Bidirectional Face-Skull Inference from Visual Data cs.CVPDF

Zidu Wang, Meng Xu, Miao Xu, Hengyuan Ma, Jiankuo Zhao

TL;DR: 论文提出 Vision Tomography（VT）框架，旨在从图像、素描等多种视觉模态中重建成对的 3D 人脸与颅骨几何，并支持人脸-颅骨联合编辑。为此构建了 200 多例包含 CT 颅骨、CT 人脸和高保真纹理人脸扫描的数据集，提出密集射线匹配配准方法，并建立 3D 双向人脸-颅骨可变形模型 BFSM。该方法通过共享系数空间实现人脸与颅骨间的双向形状推断，并建模组织厚度变化以支持同一颅骨对应多张人脸。

Details

Motivation: 传统 CT 虽能获取配对 3D 人脸和颅骨，但成本高、设备固定且存在辐射风险。远程诊断、数字医疗、法医鉴定、失踪人口调查和考古分析等应用需要便携、安全、易获取的 3D 颅骨与人脸捕获方案。

Result: 论文构建了 200 多例配对人脸-颅骨数据集，并在图像或素描重建配对 3D 人脸-颅骨、联合人脸-颅骨编辑预测手术结果等法医和医学应用中验证方法有效性。摘要称大量实验确认了方法的鲁棒性和准确性，但未给出具体定量指标或明确 benchmark 排名。

Insight: 创新点包括：提出密集射线匹配配准方法，保证人脸、颅骨及其组织对应关系的拓扑一致性；构建 3D 双向人脸-颅骨可变形模型 BFSM，通过共享系数空间实现人脸与颅骨双向推断；建模组织厚度变化，使同一颅骨可对应多种面部形态，从而反映年龄、体脂等个体差异。客观看，其亮点在于将可变形模型思想扩展到人脸-颅骨双向关联，并结合视觉模态实现便携式推断。

Abstract: Traditional computed tomography (CT) can capture paired 3D face and skull geometry, but it remains costly, fixed in location, and exposes patients to radiation. For applications such as remote diagnostics, digital healthcare, forensic identification, missing-person investigation, and archaeological analysis, there is an urgent need for a portable, safe, and accessible solution to capture 3D skull geometry. In this work, we introduce Vision Tomography (VT), a concept and framework capable of reconstructing paired 3D face-skull geometry from various visual modalities, and also enabling joint manipulation of 3D facial and skull geometry. To achieve this, we first construct a dataset of over 200 samples, where each case includes a CT-based skull, a CT-based face, and a high-fidelity textured face scan. Secondly, we propose a novel dense ray matching registration method that ensures topological consistency across face, skull, and their tissue correspondences. Building on this registration, we introduce the 3D Bidirectional Face-Skull Morphable Model (BFSM) as the foundation of Vision Tomography, which enables shape inference between the face and skull through a shared coefficient space, while also modeling tissue thickness variation to support one-to-many facial reconstructions from the same skull, reflecting individual facial changes such as age or body fat. Finally, we demonstrate the effectiveness of Vision Tomography across various forensic and medical applications, including paired 3D face-skull reconstruction from images or sketches and predicting surgical outcomes with joint face-skull editing. Extensive experiments confirm the robustness and accuracy of our method. Vision Tomography is available at https://github.com/wang-zidu/BFSM

[51] From Next Day Wildfire to Next Days Wildfire: A New Multi-Continent Dataset of Active-Fire Spread for Sequence-to-Sequence Forecasting cs.CVPDF

Jose Guillen, Renzo Zanca, Valentin Barriere

TL;DR: 论文提出了AFSeq，一个包含1194个近期火灾事件、来自8个国家三个区域的多模态野火蔓延数据集，重点覆盖现有基准中 underrepresented 的短小火灾；同时提出UTAE-AR模型，在U-Net和时间自编码器基础上加入循环模块，实现自回归的序列到序列逐日野火预测。

Details

Motivation: 现有基准如WSTS受限于规模，只能研究燃烧数周的大火，且来自相似环境；单步预测模型无法进行逐日预测，缺乏对短小火灾和多样环境的覆盖。

Result: UTAE-AR在WSTS、WSTS+和AFSeq上次日预测准确率超越SOTA，参数量仅为SOTA的21.5%，并能在更长预测视野下保持自信预测。

Insight: 创新点在于构建了迄今最大最多样的时间序列野火蔓延数据集AFSeq，以及通过循环模块和自回归反馈机制扩展U-Net实现序列到序列逐日预测，兼顾轻量化和长视野能力。

Abstract: Benchmarks such as WildfireSpreadTS (WSTS) have enabled data-driven forecasting of wildfire spread from multimodal satellite time series, but they suffer from limitations: size restricts them to large fires that burn for weeks, and they are from similar environments. We introduce AFSeq, a multimodal dataset of 1,194 recent fire events (2023 to 2026) from 8 different countries across three regions, dominated by the short, small fires that existing benchmarks underrepresent. Our dataset is the largest and most diverse to date for time-series-based wildfire spread prediction. We also introduce UTAE-AR, an extension of a classical U-Net with Temporal Auto Encoder, enhanced with recurrent modules before the decoder. This allows the model to not only predict the next day but the whole sequence in an autoregressive way. Moreover, our model can feed its own predicted fire mask back one day at a time, producing the day-by-day forecasts that single-step models cannot. Our results show that UTAE-AR surpasses state-of-the-art on both WSTS, WSTS+ and AFSeq for next-day accuracy while having 21.5% of their parameters, and being able to predict confidently at a longer horizon.

[52] The Prestige: Benchmarking Cognitive Visual Reasoning using Magic Tricks cs.CV | cs.AIPDF

Shuo Wen, Beixi Du, Edwin Meriaux, Junming Shi, Chloe Si

TL;DR: 论文提出 The Prestige，一个基于专业魔术表演的视频理解基准，通过故意误导来考察视觉语言模型的认知视觉推理能力，要求模型跟踪事件并解释意外结果。基准包含从时序与因果理解到对抗性问题鲁棒性的开放式问题，并系统评估了领先开源与专有 VLM，揭示其与人类表现差距、评分差异及失败模式。

Details

Motivation: 现有视频理解评测难以充分检验模型在误导性场景下的认知推理能力，论文希望解决模型能否在魔术误导中正确跟踪事件、理解因果并解释异常结果的问题。

Result: 在 The Prestige 基准上，最强 VLM 仍与人类表现存在显著差距；研究还发现人工与自动评分存在系统性差异，并识别出模型反复出现的失败模式。消融显示模型即使无法独立生成正确解释，也可能选对多项选择答案。

Insight: 创新点在于用专业魔术作为认知视觉推理测试场景，结合开放式解释与对抗性问题评估 VLM。客观来看，其价值还包括揭示开放式解释评估的可靠性问题，以及多项选择与自由解释之间的能力差异，为后续基准设计和问题格式研究提供启示。

Abstract: We introduce The Prestige, a video understanding benchmark that probes cognitive visual reasoning through professional magic performances, where deliberate misdirection challenges models to track events and explain unexpected outcomes. The benchmark comprises open-ended questions ranging from temporal and causal understanding to robustness against adversarial questions. Evaluation of leading open-source and proprietary VLMs reveals a substantial gap between even the strongest model and human performance. We also find systematic discrepancies between human and automated grading and identify recurring model failure modes. Ablations further show that models can select correct multiple-choice answers even when they fail to generate correct explanations independently, motivating further investigations into question formats. Together, these findings highlight limitations in both VLM reasoning and its evaluation, underscoring the need for more reliable video understanding models and more rigorous benchmarks.

[53] REEL: Same Frames, Different Answers and Different Costs cs.CVPDF

Xin Liang, Jiangpeng He

TL;DR: 论文提出REEL评估框架，用于评测「看一遍视频、建一个记忆、之后用记忆回答多个问题」的视频理解系统。REEL在完全相同的观测帧上构建三种记忆表示（Text文本记录、Visual编码器输出、Prefix State语言模型前缀），并与完整重处理（Frames）对比，通过配对正确性变化、累计GPU时间和存储大小来衡量差异。

Details

Motivation: 视频越来越长、可提的问题越来越多，逐题重处理不可扩展，因此系统倾向于预先建立记忆；但「记什么」在问题未知时就已决定，遗漏的信息无法找回。另外，用token数衡量效率会误导，因为token减少不代表模型复用已计算内容带来的节省。

Result: 在6个视觉语言模型和2个基准上，Text与Frames在20%~29%的问题上正确性不同，即便平均准确率几乎相同；Visual和Prefix State则更接近Frames。在存储不受限时，Prefix State在几乎保留Frames全部答对问题的记忆方案中总GPU时间最省，代价是每视频最多约21 GiB存储，而Text仅需KB级。

Insight: 创新点在于用同一观测帧做受控对比，把答案变化归因于记忆内容本身，并用配对正确性而非平均准确率来度量；同时指出「复用计算」与「丢弃信息」看似都是效率优化，实则本质不同，而平均准确率和token数都无法区分二者。

Abstract: Video understanding keeps moving toward longer recordings, and the longer a recording is, the more questions can be asked about it. But processing it again for every question does not scale, so many systems watch the video once, build a memory, and answer later questions from it. Yet what to remember is decided before anyone knows what will be asked, and whatever is left out cannot be recovered later. Moreover, whether the savings pay off is judged by token counts, which fall when the input gets shorter but not when the model reuses what it has already computed. We present REEL, an evaluation framework that compares three saved representations built from exactly the same observed frames, so that a change in answers can come only from what the system remembered. Text writes a short record of what happened, Visual keeps the encoder outputs, and Prefix State also keeps the language-model prefix. Each is compared with full reprocessing (Frames) by paired correctness changes, cumulative GPU time, and storage size. Across six vision-language models and two benchmarks, Text and Frames differ in correctness on 20% to 29% of questions, even when their mean accuracy is almost the same. By contrast, Visual and Prefix State stay much closer to Frames. With unlimited storage, Prefix State is the cheapest in total GPU time among memories that keep almost all of the answers Frames gets right, for every model on both benchmarks. The trade-off is storage: Prefix State keeps up to about 21 GiB per video, whereas Text needs only kilobytes. Reusing computation and discarding information both look like efficiency, but only the second removes evidence that later questions may need, and neither mean accuracy nor token count tells them apart. REEL makes that difference measurable for any system that answers many questions from one saved memory.

[54] Complementing Text Based Moderation with Multimodal Grounding: Detecting Fraudulent Inducement Behaviors on Short Video Platforms cs.CVPDF

Xiaoyong Yu

TL;DR: 论文面向短视频平台上的网络金融欺诈诱导行为检测，构建了包含2,419个短视频（66.49小时）、3,194个标注事件（四类）的数据集，并提出OCR+MLLM框架：保留OCR文本信号以保证召回，同时让多模态大模型联合执行基于OCR的判别和时间定位，从而同时捕捉文本与非文本诱导线索并精确定位违规片段。

Details

Motivation: 短视频已成为网络金融黑灰产的主要渠道，点赞、关注、加私聊群、点外链等诱导常通过转瞬即逝的视觉线索传达。现有OCR+LLM流水线只用屏幕文本分类，看不到OCR无法观测的视觉诱导，且基于关键帧的定位无法恢复精确时间边界。

Result: 在自建数据集上，OCR+MLLM的定位显著优于关键帧OCR+LLM基线（mIoU 26.52 vs. 14.49），能检出纯文本流水线遗漏的非文本诱导，同时保持67.0%的macro recall。

Insight: 创新点在于将OCR的召回保障与MLLM的视觉理解及时间定位能力结合，实现文本与非文本诱导的统一检测和片段级定位；论文还系统研究了类别不平衡下RL定位的奖励设计，发现辅助奖励项易被reward hacking利用、更强的定位奖励反而损害类平衡检测，据此提出recall-weighted F2定位奖励配合类平衡重采样。

Abstract: Short video platforms have become a primary channel for black and gray industry operations in internet finance, where inducements such as prompts to like, follow, join private chat groups, or click external links frequently steer users toward fraud. Because such videos are short, dynamic, and often convey intent through fleeting visual cues rather than stable text, a moderation system must guarantee detection recall and localize the offending segment so reviewers inspect only the relevant clip. Existing OCR+LLM pipelines transcribe on-screen text frame by frame and classify the transcript, but exploit only textual information. Many inducements are conveyed through visual cues OCR cannot observe, and keyframe-based localization cannot recover precise temporal boundaries. We explore OCR+MLLM, which augments the text pipeline with a Multimodal Large Language Model, and compare three routes: OCR+LLM, OCR+MLLM, and a large zero-shot MLLM, along detection, latency, token consumption, and deployment complexity. OCR preserves the text signal that guarantees recall, while the MLLM jointly performs OCR-grounded discrimination and temporal grounding, localizing both textual and non-textual inducements. We construct a dataset of 2,419 internet finance short videos (66.49 hours) with 3,194 annotated events across four categories, and study reward design for RL-based grounding under class imbalance. We report two findings: auxiliary reward terms are exploited through reward hacking, and stronger localization rewards degrade class-balanced detection. We therefore design a recall-weighted F2 localization reward with class-balanced resampling. Experiments show OCR+MLLM localizes better than the keyframe OCR+LLM baseline (mIoU 26.52 vs. 14.49) and detects non-textual inducements that text-only pipelines miss, while maintaining 67.0 percent macro recall.

[55] Silhouette-Based Gaitomics for Frailty Assessment in Older Adults cs.CVPDF

Laura McDaniel, Ryan Roemmich, Crystal Szczesny, Peter Abadir, Rama Chellappa

TL;DR: 论文提出基于轮廓的“步态组学”（gaitomics）方法，用于老年人衰弱评估。研究从标准化轮廓和步态能量图中提取90个形状、时序变化、运动与纹理描述符，结合mRMR特征选择和多种分类器进行三分类及两两分类，并用SHAP解释预测。结果显示模型可将预测与可测量的步态特征关联，但prefrail与nonfrail区分仍较有限。

Details

Motivation: 希望利用步行视频中的身体轮廓信息，实现可解释的衰弱评估，并将模型预测与具体的身体形态和运动模式联系起来，解决传统衰弱评估依赖量表、视频模型可解释性不足的问题。

Result: 在66名老年人中，CatBoost取得最高的三分类平均micro-AUC为0.647±0.085；两两分类中，frail vs nonfrail为0.833±0.249，frail vs prefrail为0.765±0.168，prefrail vs nonfrail仅0.554±0.129，表明prefrail与nonfrail分离有限。

Insight: 创新点在于提出轮廓驱动的“步态组学”描述体系，将mRMR特征选择、嵌套交叉验证与SHAP归因结合，把衰弱预测映射到可解释的步态特征上；分析发现双侧轮廓差异是关键特征，且不同分类任务的特征优先级不同。客观看，其价值主要在于可解释视频评估框架，但样本量小、部分分类性能有限，仍需更大独立研究验证可靠性和临床意义。

Abstract: Walking offers a window into physical function that may support interpretable video-based frailty assessment. We developed silhouette-based “gaitomics” to connect frailty predictions with measurable patterns of body configuration and movement. In 66 older adults assessed using the Fried Frailty Phenotype, standardized silhouettes and gait energy images yielded 90 descriptors of shape, temporal variation, motion, and texture. Minimum redundancy maximum relevance selection using the mutual information difference criterion prioritized informative features while limiting redundancy. Each classifier was evaluated using nested stratified cross-validation with five outer and three inner folds at the participant level, with feature ranking and feature-count selection confined to training partitions. Shapley additive explanations examined contributions to held-out predictions. Bilateral silhouette difference led the aggregate feature-selection rankings for three-class classification and both comparisons involving frail participants. Attribution profiles differed across tasks, with texture and consecutive-frame silhouette differences prominent in three-class classification. Among classifier-specific evaluations, CatBoost achieved the highest mean three-class micro-AUC of 0.647 \pm 0.085. Leading pairwise mean micro-AUCs were 0.833 \pm 0.249 for frail versus nonfrail, 0.765 \pm 0.168 for frail versus prefrail, and 0.554 \pm 0.129 for prefrail versus nonfrail classification. These findings connect model predictions to explicit gait characteristics while revealing task-dependent feature priorities and limited separation of prefrail and nonfrail participants. The framework provides an interpretable basis for further investigation, with larger independent studies needed to establish reliability and clinical relevance.

[56] MEV: A Multi-Event Video Dataset for Long-Take Generation cs.CV | cs.AIPDF

Peiyuan Zhu, Shaoan Xie, Yifan Shen, Wen Tian, Zijian Li

TL;DR: 论文提出MEV，一个面向长镜头视频生成的多事件视频数据集，包含主体执行一系列不重叠事件的高质量真实视频，具有精确时间边界和细粒度过程标注。论文还设计了将视频分割为时间接地事件并生成全局与事件级结构化字幕的标注流水线，并在事件中心评估协议下通过微调实验验证其能改善长镜头多事件生成的过渡与内容连贯性。

Details

Motivation: 现有文本到视频数据集多限于单事件短片段或粗粒度字幕，对长镜头时序依赖的监督不足，导致描述多个事件时生成结果时序不一致。

Result: 在事件中心评估协议下进行多事件生成微调实验，使用时间接地事件条件后，长镜头事件过渡和内容连贯性得到改善；摘要未给出具体量化指标或SOTA对比。

Insight: 核心创新是以事件为中心对长视频进行离散化，将长镜头分解为原子事件单元以减少混杂因素，并支持时间局部条件建模；同时提供精确时间边界、细粒度过程标注以及全局和事件级结构化字幕的完整标注流水线。

Abstract: Current datasets for text-to-video generation are largely limited to short clips depicting a single event or coarse-grained captions. As a result, they provide limited supervision for modeling long-take temporal dependencies, often leading to temporally inconsistent generations when describing multiple events. In this paper, we introduce MEV, a multi-event video dataset designed for long-take video generation. MEV provides high-quality real-world videos where subjects can perform a sequence of distinct, non-overlapping events, featuring precise temporal boundaries and fine-grained procedural annotations. This event-centric discretization reduces confounding factors and enables models to support temporally localized conditioning and build long-take videos from atomic event units. Furthermore, we introduce a comprehensive annotation pipeline that segments videos into temporally grounded events, and generates structured captions at both the global level and the event level. In addition, under an event-centric evaluation protocol, we conduct multi-event generation experiments by fine-tuning on MEV with temporally grounded event conditioning, leading to improved long-take event transitions and more coherent content. We believe this work provides a publicly available resource for multi-event fine-tuning and event-centric evaluation, together with practical insights into learning from temporally structured video-text data.

[57] TreemapMix: Dirichlet-Controlled Multi-Image Augmentation for Probability and Ordinal Supervision cs.CVPDF

Ejafa Bassam, Konstantin Garbers, Yingsheng Geng, Dalton Jens, Jiaxu Qian

TL;DR: 论文提出 TreemapMix，一种由 Dirichlet 分布控制的多图混合数据增强方法：从 Dirichlet 分布采样多张源图像的权重，并用 treemap 划分将其映射为面积成比例的区域。所得区域面积既可作为软类别概率目标配合 soft cross-entropy 使用，也可转化为序数监督配合 Plackett-Luce 目标使用。实验表明该方法在 ImageNet-1K 上分别提升校准性和 Top-1 准确率，并具有迁移到检测与分割任务的潜力。

Details

Motivation: 现有混合样本增强多局限于两图混合或固定小布局，难以灵活控制源图像数量、可见面积比例及由此诱导的监督信号。论文希望实现可控的多图组合增强，并系统利用区域面积信息构造概率或序数监督。

Result: 在 ImageNet-1K 且训练配方匹配的条件下，TreemapMix-SCE 的校准误差显著低于所评估的混合样本基线，TreemapMix-PL 取得最强的 Top-1 准确率；目标检测和实例分割迁移实验表明其预训练特征在分类之外仍有价值。

Insight: 创新点在于用 Dirichlet 分布控制多图源权重，并通过 treemap 分区生成面积比例明确的混合区域，使同一区域面积信息可同时支持软概率匹配和 Plackett-Luce 秩匹配两种监督形式。客观看，其价值主要在于将多图混合的布局、权重和监督目标统一到可控框架中，提升了混合增强的可解释性与任务适配性。

Abstract: Data augmentation improves visual recognition by exposing models to synthetic training examples that encourage generalization beyond the observed data. Mixed-sample methods extend this idea by combining multiple images. However, many common approaches either mix only pairs of images or rely on fixed small layouts, limiting control over source count, visible area proportions, and induced supervision. We propose TreemapMix, a distribution-controlled multi-image augmentation that samples source weights from a Dirichlet distribution and assigns them to area-proportional regions using a treemap partition. The resulting known region areas support two complementary objectives. TreemapMix with soft cross-entropy (SCE) treats areas as soft class-probability targets, while TreemapMix with a Plackett-Luce (PL) objective converts areas into ordinal supervision. On ImageNet-1K under matched training recipes, TreemapMix-SCE achieves substantially lower calibration error than evaluated mixed-sample baselines, while TreemapMix-PL achieves the strongest Top-1 accuracy. Transfer experiments on object detection and instance segmentation suggest that TreemapMix-pretrained features remain useful beyond classification. These results show that controlled multi-image composition can expose the same region-area information as either probability-matching or rank-matching supervision. Code is available at https://github.com/Ejafa/treemapmix.

[58] ConvRoute-ViT: Convolutional Token Routing for Efficient Vision Transformers cs.CVPDF

Manish Das, Shiv Ram Dubey, Satish Kumar Singh

TL;DR: 论文提出 ConvRoute-ViT，一种面向高效 Vision Transformer 的卷积式 token 路由机制。该方法在选定层根据 class-token 注意力保留重要 patch token，并将其余 token 空间重排并压缩为卷积 summary token，从而缩短序列长度且尽量保留上下文信息；层次化路由可为深层构建更紧凑、判别性更强的表示。

Details

Motivation: ViT 的自注意力计算随 token 数二次增长，且标准 ViT 在各层对所有 patch token 同等对待，带来冗余计算并可能削弱对判别性目标区域的关注。

Result: 在 CIFAR-100 和 TinyImageNet 上，ConvRoute-ViT 相比基础 ViT 在保持分类准确率的同时提升了计算效率。

Insight: 创新点在于用卷积路由进行 token 缩减：保留 class-token 注意力的关键 token，同时将次要 token 压缩为卷积 summary token 而非直接丢弃，并通过层次化路由构建深层紧凑表示。

Abstract: Vision Transformers (ViTs) achieve strong image recognition performance, but their self-attention increases quadratically with the number of input tokens and makes them computationally expensive. The standard implementation of ViT models treats all patch tokens with equal importance across every layer of the model. This uniform treatment introduces redundant computation and may reduce the model’s focus on the most discriminative object regions. In this paper, we propose ConvRoute-ViT, a convolutional token routing mechanism for efficient vision transformers that performs token reduction through convolutional routing. Our model preserves the most relevant patch tokens according to class-token attention at selected layers, while the remaining tokens are spatially reorganized and compressed into a compact set of convolutional summary tokens. This design reduces the sequence length without completely removing the contextual information of the less informative tokens. By applying the routing process hierarchically, the proposed framework constructs compact and discriminative representations for deeper layers. Experiments on CIFAR-100 and TinyImageNet show that ConvRoute-ViT improves computational efficiency while maintaining classification accuracy compared with the base ViT.

[59] PulmoWorld: An Asynchronous Multimodal Medical World Model for Longitudinal Pneumonia Dynamics cs.CVPDF

Cheng Tang, Xinyu Zhang, Jiawei Chen, Minghui Zhang, Shaocong Wei

TL;DR: 论文提出PulmoWorld，一个面向纵向肺炎动态的异步多模态医学世界模型，将异步状态估计、递归模拟和证据约束规划结合。模型用历史感知滤波在观测到达时更新共享信念，并基于该信念递归预测临床指标与模态表示及未来预后；Cap-MBRL在授权动作集内搜索想象轨迹，仅在满足风险预算和预测成本边际时替换冻结回退。

Details

Motivation: 肺炎涉及呼吸、炎症和器官功能的动态变化，但多模态测量异步到达且常不完整，现有方法难以统一建模纵向状态演化并支持安全规划。

Result: 在MASS肺炎队列上，递归预测与任务训练序列模型具有竞争力，模拟未来状态保留预后信息；在MIMIC-IV-CXR和临床轨迹上分别训练后，预后判别优于最新值融合，锁定肺炎面板长期误差具竞争力；在五个MASS-Syn环境中，Cap-MBRL相对直接回退执行降低选择遗憾。

Insight: 创新点在于历史感知滤波将状态传播与观测驱动校正分离，实现异步多模态共享信念更新；递归预测临床值与模态表示；并以风险预算和预测成本边际约束世界模型规划，兼顾纵向医学动态建模与安全决策。

Abstract: Pneumonia changes across respiration, inflammation, and organ function, while the measurements that describe it arrive at different times and are often incomplete. We introduce PULMOWORLD, a world model for longitudinal pneumonia dynamics that connects asynchronous state estimation, recursive simulation, and evidence-constrained planning. History-aware filtering separates state propagation from observation-driven correction, so a measurement updates the shared belief only when it is observed. That belief supports recursive forecasts of clinical values and modality representations, and summaries of future prognosis. Cap-MBRL searches imagined continuations inside an authorized action set and replaces a frozen fallback only when a candidate meets the risk budget and a predicted-cost margin. On the pneumonia cohort MASS, recursive forecasts are competitive with task-trained sequence models, and simulated future states retain prognostic information. Trained separately on public MIMIC-IV-CXR chest radiographs and clinical trajectories, this model improves prognostic discrimination over latest-value fusion in development and is competitive on long-horizon error on the locked pneumonia panel. In five known-mechanism MASS-Syn environments, Cap-MBRL lowers selection regret relative to direct fallback execution.

[60] Don’t Ask the LLM: Visual Token Pruning with Spectral Structure and Semantic Relevance cs.CVPDF

Intaek Shin, Geuntaek Lim, Sungjune Park, Yukyung Choi

TL;DR: 论文提出 ST-Pruner（Spectral-Textual Pruner），一种免训练的 LLM 前视觉 token 选择框架，用于降低大型视觉语言模型（LVLMs）的长视觉 token 序列推理成本。方法结合与注意力无关的谱显著性和倒置的 patch-文本相似度，通过无参数乘法融合完成视觉 token 剪枝。实验表明其能在激进压缩下保持性能并显著加速推理。

Details

Motivation: LVLMs 将图像和视频表示为长视觉 token 序列，导致推理成本高；视觉 token 剪枝的关键在于选择信号及其可用时机。现有视觉侧 [CLS] 注意力在激进压缩下选择分散且偏向背景，而更强的查询条件化信号需在 LLM 内部大量计算后才可得，因此论文希望在咨询 LLM 之前完成结构连贯且查询感知的 token 选择。

Result: 在多种 LVLMs 上，ST-Pruner 仅使用至多 11.1% 的视觉 token 即可保留超过 95% 的全 token 性能，并在 LLaVA-NeXT 上实现 3.2 倍端到端加速。

Insight: 创新点在于将视觉 token 选择前移到 LLM 之前，并以免训练方式融合注意力无关的谱显著性与语义相关性（倒置 patch-文本相似度），通过无参数乘法融合实现结构连贯且查询感知的剪枝。

Abstract: Large vision-language models (LVLMs) represent images and videos as long visual-token sequences, substantially increasing inference costs. These costs motivate visual-token pruning, whose effectiveness depends on both what signal is used for selection and when that signal becomes available. Our analysis reveals complementary limitations: visual-side [CLS] attention produces scattered, background-biased selections under aggressive compression, while stronger query-conditioned signals become available after substantial computation within the large language model (LLM). This raises a natural question: can structurally coherent, query-aware token selection be performed before consulting the LLM? We therefore propose ST-Pruner (Spectral-Textual Pruner), a training-free framework for pre-LLM visual-token selection. It combines attention-independent spectral saliency with inverted patch-text similarity through parameter-free multiplicative fusion. Across diverse LVLMs, ST-Pruner retains over 95% of full-token performance using at most 11.1% of visual tokens and achieves a 3.2x end-to-end speedup on LLaVA-NeXT. Code is available at https://github.com/sejong-rcv/ST-Pruner.

[61] Does 3D Pose Improve Action Valuation in Football? An Empirical Study of Pose Representations and Learning Objectives cs.CV | cs.LGPDF

Rikuhei Umemoto, Kenjiro Ide, Soham Majumder, Ulf Brefeld, Keisuke Fujii

TL;DR: 论文实证研究在足球动作价值评估中引入3D姿态是否能提升基于SARSA的多智能体深度强化学习模型对球员动作价值的估计。作者使用欧冠2022/23赛事、跟踪和3D姿态数据，比较多种姿态表示与训练目标设置，发现姿态仅少数情况下稳健改善回报预测，训练目标选择的影响更大；但姿态对预测即将发生的动作和传球成功仍有帮助。

Details

Motivation: 现有足球动作价值模型主要依赖2D位置和速度，忽略与即将发生动作相关的身体姿态信息。论文关注加入3D姿态能否更准确地估计球员对未来进球、失球或最终控球价值的贡献。

Result: 在50组有球/无球比较中，姿态仅3组稳健改善回报预测，且均采用躯干和头部朝向；12组变差，多为ST-GCN表示。移除动作预测损失后，仅位置价值的on-ball skill从0.003升至0.040，与xG相关性从0.23升至0.60；姿态还将0.2秒前有球动作预测macro AUC从0.914提升至0.934，并将传球成功预测AUC从0.844提升至0.856。

Insight: 论文的创新在于系统实证比较多种3D姿态表示和学习目标对足球动作价值评估的影响，并给出偏负面的结论：姿态能提供即时动作信息，但很少改善观测动作价值。可借鉴之处是训练目标设计可能比引入更丰富姿态表示更关键，且应区分姿态对即时动作预测与长期价值估计的不同作用。

Abstract: Football action valuation estimates players’ contributions to future scoring. Existing multi-agent deep reinforcement learning (MADRL) models use 2D positions and velocities, omitting posture information relevant to imminent actions. We investigate whether adding 3D pose to a SARSA-based model improves observed-action values relative to attack returns: goals, conceded goals or final expected possession value. Using UEFA Champions League 2022/23 event, tracking and 3D pose data, we compare six representations (no pose, raw joints, torso and head orientation, and spatial-temporal graph convolutional network (ST-GCN) embeddings) across five learning settings and three seeds. The settings vary temporal-difference targets and action-prediction loss, with Monte Carlo return regression as a reference. Across 50 on-ball and off-ball comparisons, pose robustly improved return prediction in only three, all using torso and head orientation, while worsening it in twelve, mostly with ST-GCN. Training choices had greater effects: removing the action-prediction loss raised on-ball skill of position-only values from 0.003 to 0.040 and their correlation with expected goals from 0.23 to 0.60; the improvement in return prediction persisted at matched training length. Separately, pose improved prediction of the on-ball action 0.2 s ahead (macro AUC 0.914 to 0.934 with raw joints), while the passer’s pose during execution improved pass-success prediction (AUC 0.844 to 0.856). Within this training protocol, pose informed imminent actions but rarely improved observed-action values.

[62] Extremely Sparse-View Computed Tomography from 2D Projections via Pose-Aware Diffusion Priors cs.CV | cs.AIPDF

Linrui Dai, Jinxiu Liang, Chu Zhou, Mae Yamaguchi, Ryuya Takahashi

TL;DR: 论文研究极端稀疏视图CT（xSV-CT）在训练和推理都仅有稀疏2D投影时的重建问题，提出从每个训练样本的一张2D投影学习姿态感知扩散先验，并在扩散采样中引入测量视图保真、共享体重投影和投影物理一致性约束。该方法无需密集扫描重建的3D体监督，即可从少量2D投影进行CT重建。

Details

Motivation: 在扫描时间、运动或辐射受限场景下，每次扫描只有极少投影，且同样限制导致难以获得密集扫描重建的3D训练数据。现有优化方法缺乏数据先验，学习方法通常依赖密集体积监督，因此需要解决train-sparse/infer-sparse设置下的稀疏视图CT重建。

Result: 在两个公开CT数据集及1、4、8视图设置上，所提方法取得最佳新视图合成分数，并相比使用密集体监督的基线达到最佳或具有竞争力的重建质量。

Insight: 创新点在于从单张2D投影学习姿态感知扩散先验，并将测量视图保真、共享体重投影和投影物理一致性用于引导扩散采样，从而在训练和推理均稀疏的条件下实现CT重建。

Abstract: Extremely sparse-view computed tomography (xSV-CT) is critical when scanning time, motion, or radiation tolerance limits each scan to only a few projections. In many such scenarios, the same acquisition limits also constrain dataset construction, making pre-reconstructed 3D volumes from dense scans unavailable. This exposes a gap in current sparse-view approaches: Optimization-based methods, which use the sparse measurements directly but lack data-driven priors to suppress artifacts, and learning-based methods, which use strong priors but usually require densely scanned training volumes acquired outside the xSV-CT regime. We study this train-sparse / infer-sparse setting by learning a pose-aware diffusion prior from one 2D projection per training sample, then guiding diffusion sampling with measured-view fidelity, shared-volume reprojection, and projection-physics consistency for tomographic reconstruction. On two public CT datasets across 1-, 4-, and 8-view settings, the proposed method achieves the best novel-view synthesis scores and best or competitive reconstruction quality compared with baselines that use dense-volume supervision.

[63] Knowledge-structured and evidence-aware semantic self-distillation for glomerular pathology foundation model cs.CVPDF

Qiming He, Jing Li, Zihan Wang, Tian Guan, Yifei Ma

TL;DR: 论文提出GloSAGE，一种知识结构化和证据感知的语义自蒸馏框架，用于肾小球病理基础模型。它利用预训练视觉教师模型预测的病变轮廓构建结构化病理描述，通过可靠性引导选择图像-文本锚点，并结合知识结构化文本合成与证据引导负对构建进行图像-文本对齐训练。在GloMillion上开发并在七个队列上评估，支持零样本病变识别、图像-文本检索等任务，在多数病变识别任务上优于源视觉模型。

Details

Motivation: 视觉基础模型能学习丰富的病理形态但缺乏显式的概念级监督，而视觉-语言预训练虽能提供这种监督却需要昂贵的图像-文本对。论文旨在利用教师模型衍生的病变轮廓提供注释高效的语义监督，以扩展肾小球视觉基础模型。

Result: 在GloMillion上开发并在七个肾小球和病例级队列上评估，GloSAGE在大多数病变识别任务上优于源视觉模型，改善了病变分级，并在病例级疾病分类、损伤分级和基线肾功能估计上具有竞争力。消融实验支持知识结构化文本和证据引导负样本的联合贡献，中间语义转移层相比完整投影输出提高了平均病变识别ROC-AUC。冻结语言模型可基于GloSAGE特征生成肾小球描述。

Insight: 论文的创新点在于利用预训练视觉教师预测的病变轮廓构建结构化病理描述，实现无需昂贵图像-文本对的语义自蒸馏；通过可靠性引导选择图像-文本锚点，结合知识结构化文本合成和证据引导负对构建来处理部分观察的病变；引入中间语义转移层为下游任务提供特征。客观分析，其创新在于将视觉教师知识结构化地转化为语义监督，并以证据感知方式增强对比学习，为病理基础模型提供了一种注释高效的语义扩展途径。

Abstract: Visual foundation models learn rich pathological morphology but lack explicit concept-level supervision. Vision–language pretraining can provide this supervision but requires costly image–text pairs. Here, we introduce GloSAGE, a semantic self-distillation framework that uses lesion profiles predicted by a pretrained visual teacher to construct structured pathology descriptions. Reliability-guided selection identifies image–text anchors, while Knowledge-Structured Pathology Text Synthesis and Evidence-Guided Negative-pair Construction account for partially observed lesions. Image–text alignment trains projection layers while retaining the frozen visual encoder; an intermediate Semantic Transfer Layer supplies features for downstream tasks. Developed on GloMillion and evaluated across seven glomerulus- and case-level cohorts, GloSAGE supported zero-shot lesion recognition, image–text retrieval, hard-negative discrimination and concept-intervention analyses. It outperformed its source visual model in most lesion-recognition tasks and improved lesion grading, while supporting competitive case-level disease classification, injury grading and baseline renal function estimation. Ablations supported the combined contributions of knowledge-structured text and evidence-guided negatives, and the intermediate transfer layer improved mean lesion-recognition ROC-AUC relative to the complete projection output. A frozen language model conditioned on GloSAGE features generated glomerular descriptions. These findings suggest that teacher-derived lesion profiles can provide annotation-efficient semantic supervision for extending a glomerular visual foundation model.

[64] Aligning Misaligned Benchmarks for Single-View Novel View Synthesis cs.CV | cs.AIPDF

Yang-Che Tseng, Erqun Dong, Jeong-gi Kwak, Gopal Sharma, Shakiba Kheradmand

TL;DR: 论文聚焦单视图新视角合成（NVS）评测未标准化问题，指出不同方法的参考系与真值姿态对齐方式会显著影响评估结论。作者提出用传统2D-to-2D和2D-to-3D图像匹配对齐3D重建，并仅在共视区域评估，从而更公平地比较NVS方法。实验发现正确坐标对齐后，显式3D Gaussian方法达到SOTA，且一个结合现成视频生成器与前馈几何估计器的简单基线无需任务特定训练也可与专门方法相当。

Details

Motivation: 现有单视图NVS基准中，方法自身参考系与ground-truth pose的对齐不统一；test-time姿态优化易陷入病态局部最优，而依赖全场景3D重建的对齐方式可能不可行。论文旨在建立更可靠、可操作的评测对齐与评估协议。

Result: 在正确坐标对齐并仅评估共视区域后，使用显式3D Gaussians的NVS方法达到SOTA，改变此前其被纯图像2D方法超越的结论；作者还提出一个直接利用现成视频生成器和前馈几何估计器的简单baseline，未做任务特定训练即可与SOTA专用NVS方法相当。

Insight: 创新点在于将评测中的坐标对齐问题显式化，并用成熟2D-2D/2D-3D匹配技术对齐3D重建，避免病态姿态优化和昂贵全场景重建；同时以共视区域定义可验证的正确真值，揭示评估协议对方法排名的影响。客观看，其价值更多在于基准与评测方法学，而非提出新的NVS网络。

Abstract: While single-view novel view synthesis methods have been dramatically enhanced recently, how to quantify their performance has yet to be standardized. In this work, we demonstrate that an important factor lies in how each method’s own reference frame is aligned with the so-called ground-truth pose. Existing methods often rely on test-time optimization of target poses for this alignment, which inherently is ill-posed due to the complexity of the optimization landscape of camera poses vs render accuracy, leading to methods being evaluated at an arbitrary local optimum. Some recognize this limitation and thus rely on 3D reconstructions of entire scenes using training and test views to align poses, which may be infeasible. In this work, instead, we propose to use traditional 2D-to-2D and 2D-to-3D image matching techniques to align 3D reconstructions. We also evaluate only within co-visible regions, between different views, which is the only place where a `correct’ ground truth can be defined. Our evaluations show that with proper coordinate alignment, novel-view synthesis methods that use explicit 3D Gaussians achieve the state of the art, despite being previously reported in the literature to be outperformed by pure image-based 2D methods. We further provide a simple baseline that directly utilizes an off-the-shelf video generator and a feed-forward geometry estimator. Our simple baseline is already comparable to state-of-the-art methods specifically trained for novel-view synthesis, without any task-specific training.

[65] WeVisCut: The Whole Editing Room in One Agent From Narration to Long-Form Video cs.CV | cs.AIPDF

Chenyu Mu, Wenming Weng, Qinrui Wang, Xingsong Ye, Hao Yu

TL;DR: 论文提出 WeVisCut，一个从旁白/脚本生成长视频的智能体系统，将工具执行与策略学习结合，通过共享制作状态让工具反馈参与后续决策与修复。作者构建四阶段数据管线，从 3750 个成片中恢复编辑意图并生成超 13 万训练样本，训练单个 9B 策略模型完成制作协调与失败恢复，并发布 100 任务基准和五项评价指标。

Details

Motivation: 现有长视频智能体编辑多采用通用模型驱动的多阶段流程，难以明确紧凑、任务适配策略在质量与成本之间的权衡；论文希望用统一智能体和可学习策略提升长视频脚本到视频制作的一致性与效率。

Result: 在共享工具环境下，WeVisCut 显著优于基座模型，并在所提基准上达到与 Claude Opus 5 相当的表现，同时每个成功输出分钟生成 token 数约少 33 倍；在编辑质量和交付可靠性指标上也优于任务匹配的原生编辑器。

Insight: 创新点在于用共享生产状态串联工具反馈与决策修复，并通过“编辑反演+验证回放”从成片恢复可执行监督，训练单一 9B 策略模型；客观看，其价值在于将长视频编辑流程统一为可学习、可恢复的智能体，并兼顾质量与 token 成本。

Abstract: Producing long-form videos from narration requires interdependent decisions that remain coherent across shots. Existing agentic editors often use multi-stage workflows driven by general models, leaving the quality-cost trade-off of compact, task-adapted policies unclear. We address this gap with WeVisCut, a long-form script-to-video system that connects tool execution with policy learning. Its agent harness maintains shared production state so that tool feedback informs subsequent decisions and repairs. Because finished videos do not expose these decisions, our four-stage data pipeline combines editing inversion with verified replay to turn recovered editing intent into executable supervision. Applied to 3,750 finished videos, this pipeline yields over 130K training examples. We use this supervision to train a single 9B policy that coordinates production and recovers from failures within the same harness. Moreover, we introduce a 100-task benchmark and five metrics assessing editing quality and delivery reliability. Under a shared tool environment, WeVisCut substantially outperforms its base model and achieves comparable performance to Claude Opus 5 while using nearly 33x fewer generated tokens per successful output minute. It also outperforms task-matched native editors on our proposed metrics.

[66] Volley3D: Unified 3D Full-Sequence Reconstruction from Monocular Broadcasts cs.CVPDF

Noâm Boussouf, Adrien Maglo, Mohamed Chaouch, Hideo Saito

TL;DR: 论文提出 Volley3D，一个无需 3D 训练监督、面向单目排球广播的物理驱动全序列 3D 重建流程，联合重建球员与球的 3D 轨迹。方法包括地平面投影透视漂移校正、结合跳跃检测与牛顿插值的球员 3D 定位，以及子轨迹分割和碰撞匹配的球轨迹估计，并通过 3D 手部顶点锚定物理方程提升噪声 2D 检测。

Details

Motivation: 单目体育广播 3D 重建受移动相机难标定和深度歧义困扰；排球等团队运动存在多接触序列和高空跳跃，使现有方法依赖的平面投影假设失效，且缺少 3D 训练监督。

Result: 在多相机基准上，该方法相比 2D 重投影基线显著降低 3D 空间漂移；摘要未给出具体数值或明确 SOTA 声明。

Insight: 创新点在于无 3D 监督的物理驱动全序列重建、透视漂移校正模块、球子轨迹分割与碰撞匹配，以及用 3D 手部顶点锚定物理方程获得时空一致 3D 场景；客观看，将物理约束与事件检测结合，适合复杂团队运动场景。

Abstract: 3D reconstruction from single-view sports broadcast is a pivotal capability for automated analytics and immersive AR/VR replays, yet notoriously ill-posed due to difficult-to-calibrate moving cameras and depth ambiguity. Unlike widely studied racket sports, team sports such as volleyball feature unpredictable multi-contact sequences and high altitude jumps. These dynamics categorically invalidate the standard planar projection assumptions relied upon by existing methods. To resolve these limitations without 3D training supervision, we propose a complete, physics-grounded pipeline tailored to monocular broadcast volleyball. First, we include a correction module to the perspective drift induced by ground-plane projection by coupling temporal jump spotting with Newtonian interpolation for 3D player placement. Second, for 3D ball trajectory estimation, we design a dedicated sub-trajectory segmentation architecture alongside a collision-matching algorithm. By anchoring physical equations to reconstructed 3D hand vertices, we lift noisy ball 2D detections into a spatiotemporally coherent 3D scene. Evaluations on multi-camera benchmarks demonstrate our approach significantly reduces 3D spatial drift compared to 2D-reprojection baselines.

[67] Visually Irrelevant Hallucinations in Medical Vision-Language Models cs.CVPDF

Ke Zou, Nan Zhou, Tao Yang, Meng Liu, Linchao He

TL;DR: 论文研究医学视觉语言模型（VLM）在放射报告生成和医学视觉问答中产生的“视觉无关幻觉”，即临床上有意义但缺乏视觉证据或与图像矛盾的短语级错误。作者提出CLEAR框架，基于短语级反事实局部评估对齐与响应，通过扰动候选视觉区域并联合建模响应线索与对齐线索来估计短语级幻觉风险。

Details

Motivation: 医学VLM能生成流畅的临床描述，但可能产生看似合理却无视觉依据或与图像矛盾的幻觉内容，这类错误在临床中风险很高，而现有方法缺乏对短语级视觉无关幻觉的系统检测与评估。

Result: 在覆盖放射报告生成和医学视觉问答的四个数据集上，CLEAR在多种医学及通用VLM上优于最先进的幻觉检测基线；在MIMIC-CXR上将AUPRC从85.10%提升至90.23%，并在基于真值构建的受控VIH基准上进一步验证了有效性。

Insight: 创新点在于将幻觉检测细化到短语级，提出与模型无关的事后审计框架CLEAR，通过短语条件定位与局部反事实扰动，结合响应语义变化和对齐兼容性变化两类线索联合估计幻觉风险，为多模态临床生成的可信度评估提供了细粒度视觉支撑审计思路。

Abstract: Medical vision-language models (VLMs) show strong performance in radiology report generation (RRG) and medical visual question answering (Med-VQA), producing free-form clinical descriptions and answers from medical images. However, they may generate clinically meaningful statements that lack visual evidence or contradict image content. We refer to these errors as visually irrelevant hallucinations and investigate them at the phrase level. We propose CLEAR (Counterfactual Localized Evaluation of Alignment and Response), a model-agnostic post-hoc framework for phrase-level hallucination risk estimation. CLEAR decomposes generated responses into visually assessable clinical phrases. For each phrase, phrase-conditioned grounding identifies a candidate visual region, which is selectively perturbed by a localized counterfactual intervention. CLEAR characterizes the intervention using two complementary auditing cues: response cues, capturing semantic and clinically meaningful changes in the generated response, and alignment cues, measuring changes in image-phrase compatibility. These cues are normalized and jointly modeled to estimate phrase-level hallucination risk. Across four datasets spanning RRG and Med-VQA, CLEAR outperforms state-of-the-art hallucination detection baselines across multiple medical and general-purpose VLMs. On MIMIC-CXR, CLEAR improves AUPRC from 85.10% to 90.23%. Its effectiveness is further validated on a GT-derived controlled VIH benchmark. These results establish visually irrelevant hallucination as an important fine-grained reliability failure mode in medical VLMs and demonstrate the value of model-agnostic visual-support auditing for more trustworthy multimodal clinical generation.

[68] Structure-retained low-rank adapters for weather synthesis cs.CVPDF

Shunxin Wang, Alexandros Stergiou, Luuk Spreeuwers, Estefania Talavera, Nicola Strisciuglio

TL;DR: 论文提出一种基于结构保留低秩适配器（LoRA）的天气合成框架，通过分析SDXL中负责结构信息的注意力块，学习对应块的LoRA矩阵来实现图像到图像的天气转换。该方法无需ControlNet等外部条件，在保留场景结构的同时合成天气效果，为户外视觉任务生成高保真训练和评估数据。

Details

Motivation: 户外视觉模型需要跨天气鲁棒性，但高质量且仅含天气变化的配对数据难以获取；现有数据中行人、车辆和视角等动态变化会干扰天气引起分布偏移的建模。

Result: 实验表明该方法优于现有天气合成方法，生成结果更真实且能更好保留场景结构；摘要未提及具体benchmark、定量指标或SOTA对比。

Insight: 创新点在于通过SDXL架构分析定位结构信息主要处理的注意力块，并学习结构保留LoRA矩阵用于天气合成，从而避免依赖ControlNet等外部条件；其可借鉴之处是将LoRA与模型架构分析结合，实现天气风格与场景结构的解耦。

Abstract: Real-world deployment of computer vision models, particularly in outdoor scenarios, is often limited by environmental interferences, such as adverse weather. Improving model robustness across weather conditions is thus critical for reliability. However, sourcing high-quality data relevant to isolated weather effects is a significant challenge. Most datasets include changes in dynamic elements across observations of the same scene: subjects such as pedestrians and vehicles change between shots, while camera viewpoints vary. These aspects make it difficult to decouple solely weather-induced distribution shifts from the scene. In this work, we address this with a novel weather synthesis framework that utilizes structure-retaining Low-Rank Adapters (LoRA). We analyze the attention blocks in Stable Diffusion XL (SDXL) and identify where relevant structural information is mostly processed during image-to-image translation. Through an architectural analysis of SDXL, we learn structural LoRA matrices for the corresponding blocks and then leverage them for weather synthesis, eliminating the need for external conditioning such as ControlNet. Experimental results demonstrate that our method improves upon existing synthesis approaches, achieving greater realism while preserving structure. This provides a robust pipeline for generating high-fidelity training and evaluation data for outdoor computer vision applications.

[69] IntReal: A Real-World Dataset and Benchmark for Multimodal Interleaved Generation cs.CVPDF

Shaohan Yu, Jie Qin, Wende Tan, Haiwen Diao, Limeng Qiao

TL;DR: 论文提出 IntReal，用于多模态交错生成，包含真实世界数据集 IntReal-100K 和细粒度评测套件 IntReal Evaluation Suite。该数据集覆盖四大类别，评测套件从七个互补维度诊断统一多模态模型的文本-图像交错生成能力。实验验证了评测指标的可靠性，并对四类 UMM 进行基准测试，同时证明该数据集可用于后训练并提升交错生成性能。

Details

Motivation: 多模态交错生成研究不足，主要受限于缺乏明确定义的交错生成任务与训练数据，以及缺乏可细粒度诊断模型不同能力维度的可靠评测协议。

Result: 评测套件具有较低指标冗余（最大两两绝对 Spearman ρ≤0.42）、与人类判断 83.3% 一致、不同专家评估器间 Spearman ρ>0.9；对四类 UMM 的基准测试揭示不同模型优劣，后训练实验证明 IntReal-100K 能提升交错生成，且单模态生成训练也有益。

Insight: 创新在于构建真实世界多模态交错数据集与七维度专家模型评测体系，实现由粗到细诊断；实验进一步指出交错生成可从模态特定优化中受益，而不必每个阶段都进行文本-图像联合训练。

Abstract: Humans routinely consume multimodal content, where textual and visual information is naturally interleaved. Although Unified Multimodal Models (UMMs) can jointly generate text and images, multimodal interleaved generation remains largely underexplored. Progress in this area is hindered by two key limitations: (1) the lack of well-defined interleaved generation tasks and corresponding training data, and (2) the absence of fine-grained evaluation protocols that can reliably diagnose model performance across different capability dimensions. To this end, we present IntReal, comprising two complementary components: IntReal-100K, a real-world dataset of multimodal interleaved samples spanning four major categories, and the IntReal Evaluation Suite, which evaluates model performance across seven complementary dimensions using specialized expert models, enabling coarse-to-fine diagnosis. Extensive experiments validate our evaluation suite through low inter-metric redundancy (max pairwise absolute Spearman’s $ρ\leq 0.42$ ), high agreement with human judgments (83.3% accuracy), and strong consistency across different expert evaluators (Spearman’s $ρ> 0.9$ ), supporting the complementarity and reliability of our metrics. By benchmarking four families of UMMs, we show that IntReal Evaluation Suite reveals distinct strengths and weaknesses across models. Post-training experiments demonstrate the utility of IntReal-100K for improving interleaved generation and further show that training unimodal generation can also benefit interleaved generation. These findings suggest that interleaved generation can benefit from modality-specific optimization, rather than requiring joint text-image training at every stage.

[70] Automatic Iconographic Annotation of Medieval Illuminations: Comparing Generative Vision-Language Models and Supervised Discriminative Classifiers cs.CVPDF

Vincent Jolivet, Lucas Terriel, Chahan Vidal-Gor{è}ne

TL;DR: 论文在中世纪手抄本插图的大规模图像志标注任务上，系统比较了生成式视觉语言模型（VLM）与监督判别分类器（SDC）两类范式，数据包含9,735张整页图像和2,333个TIMEL概念。作者分别评测了VLM的微调、结构化JSON解码、候选生成与重排序，以及基于冻结DINOv3编码器的多种判别式分类头。结论是SDC在封闭词表内精度和可靠性更强，VLM在语义泛化和分类学覆盖上更有优势，二者更适合作为未来混合索引系统的互补组件。

Details

Motivation: 中世纪手稿数字化产生了对自动化图像志索引的迫切需求，而现有任务概念数量多、语义层级复杂，需要评估生成式VLM与监督判别分类器在该专门领域中的适用性与互补性。

Result: 在9,735张图像、2,333个TIMEL概念上，ML-Decoder（SDC）取得最佳整体检索性能，precision@1为0.696、MRR为0.806，非对称损失是主要性能杠杆；VLM通过结构化JSON目标与verify-calibrate重排序取得层次F1 0.559，表现出较强语义泛化和分类学覆盖。定性上，SDC擅长感知 grounded 的描述性概念，VLM更适合复杂解释性场景的假设生成。

Insight: 论文的创新在于对生成式VLM与监督SDC进行系统性功能对比，并提出soft F1以基于最低公共祖先对语义接近预测给予分类学感知评价。客观来看，其可借鉴点是：封闭词表检索宜用校准良好的判别模型，开放/探索性标注可借助结构化VLM输出与重排序，而架构中显式层次约束不如空间特征聚合有效，未来可构建结构化检索与探索式标注结合的混合系统。

Abstract: The large-scale digitisation of medieval manuscripts creates a growing need for automated iconographic indexing. We evaluate two complementary paradigms for this task on 9,735 full-folio images annotated with 2,333 TIMEL concepts: generative Vision-Language Models (VLM) and supervised discriminative classifiers (SDC). The VLM experiments evaluate fine-tuning, structured JSON decoding, taxonomybased candidates generation, and deterministic reranking. The discriminative experiments evaluate flat, hierarchy-aware, and patch-attention heads over a frozen DINOv3 encoder. Our results highlight key functional differences: ML-Decoder (SDC) achieves the strongest overall retrieval performance (precision@1 of 0.696, MRR of 0.806), with loss calibration (Asymmetric Loss) serving as the primary performance lever. While SDCs provide superior precision and reliability within a closed vocabulary, VLMs offer strong semantic generalization and broad taxonomic coverage, particularly through structured JSON targets and verify-calibrate reranking (hierarchical F1 of 0.559). Furthermore, model behavior strongly depends on concept abstraction: SDCs excel at perceptually grounded descriptive concepts, whereas VLMs provide useful hypotheses for complex interpretative scenes. Finally, we find that enforcing explicit hierarchy within model architectures limits coverage compared to spatial feature aggregation. Overall, rather than competing approaches, SDCs and VLMs emerge as complementary components for future hybrid indexing systems combining structured retrieval with exploratory annotation assistance. As a methodological contribution, we define the soft F1 metric to provide a taxonomy-aware evaluation that credits semantically close predictions based on lowest common ancestors.

[71] Geometry-Aware Trajectory State Modeling for Few-Shot Action Recognition cs.CVPDF

Zhiqi Miao, Marko Haralović, Stanislav Levendeev, Sarvesh Angadi, Jannatul Ferdous

TL;DR: 论文提出 GeoTRAM，一个面向少样本动作识别（FSAR）的几何感知轨迹状态建模框架。它将动作视为 2.5D 轨迹状态的有序演化及其局部几何交互，通过 StateMotion 建模轨迹内状态演化，通过 RelMotion 建模状态条件下的局部相对几何与运动交互，并结合质量过滤谱采样、语义/运动/深度线索联合建模以及动作引导重加权与 top-ρ 轨迹选择进行帧级和轨迹级匹配。

Details

Motivation: 现有基于轨迹的 FSAR 方法多将轨迹视为采样视觉特征的载体，或用紧凑的 2D 位移描述运动，难以充分刻画少样本条件下的判别性运动动态和局部几何交互。论文希望显式建模轨迹状态的有序演化与几何关系，以提升少样本动作识别中的运动表征能力。

Result: 在五个 FSAR 基准上实验表明，GeoTRAM 在运动主导的 Something-Something 系列基准上取得显著提升，在更偏外观驱动的基准上保持有竞争力性能，并具有较好的精度-效率权衡。

Insight: 创新点在于将动作建模为 2.5D 轨迹状态的有序演化与局部几何交互，并分别用 StateMotion 和 RelMotion 建模轨迹内演化与状态条件下的相对几何/运动；同时引入质量过滤谱采样、多线索独立精炼保留、动作引导重加权和 top-ρ 轨迹选择，形成互补的帧级与轨迹级匹配。客观来看，其可借鉴之处是将显式几何与运动状态建模融入少样本轨迹匹配，而非仅依赖采样特征或简单位移描述。

Abstract: Few-shot action recognition (FSAR) requires representations that expose discriminative motion dynamics from only a few labeled videos. Recent trajectory-based methods leverage long-term point tracks for explicit temporal correspondence, but often treat trajectories as carriers of sampled visual features or summarize their motion with compact 2D displacement-based descriptors. We instead view an action as the ordered evolution of 2.5D trajectory states and their local geometric interactions. Based on this view, we introduce GeoTRAM, a geometry-aware trajectory state modeling framework for FSAR. GeoTRAM lifts sparse tracks into 2.5D trajectories, where StateMotion models ordered intra-trajectory state evolution and RelMotion captures state-conditioned local interactions through time-varying relative geometry and motion. Quality-filtered spectral sampling provides more reliable trajectory initialization; complementary semantic, motion, and depth cues are separately refined and preserved for joint spatio-temporal modeling; action-guided reweighting and top-$ρ$ trajectory selection support complementary frame- and trajectory-level matching. Experiments on five FSAR benchmarks demonstrate strong gains on the motion-centric Something-Something benchmarks while maintaining competitive performance on more appearance-driven benchmarks and a favorable accuracy–efficiency trade-off.

[72] Vision-Based Density Estimation for Adaptive Traffic Control cs.CVPDF

Mohammad Usaid, Deepak Silaych, Hrithik Mhatre, Archak Mittal

TL;DR: 论文面向高密度、异质且遮挡严重的城市交通场景，提出一个从摄像头视觉观测直接优化交通流的框架，包含车辆密度估计、时空动态预测和信号相位策略优化三个解耦模块。密度估计用CNN将摄像头图像映射为空间密度图，并采用自适应k-NN高斯核适应不同拥堵程度；预测使用ST3DNet，控制使用分层Graph-Transformer多智能体强化学习。目前仅对密度估计阶段进行了实验评估，预测与控制部分仍属未来工作。

Details

Motivation: 快速发展城市中交通拥堵严重，尤其发展中国家交通流异质混乱、车辆遮挡和重叠导致基于摄像头的交通状态估计受限。论文希望从随机视觉观测中估计交通密度并进一步用于自适应信号控制，以缓解拥堵。

Result: 密度估计在印度斋浦尔Rambagh 4的40张带标注交叉口图像上进行五折验证，MAE为3.32±0.95辆车，MAPE为14.5%。该结果仅针对感知模块，预测和控制阶段尚未进行实证训练与评估。

Insight: 创新点在于将密度估计、时空预测和信号相位优化解耦组合，并用自适应k-NN高斯核处理不同拥堵水平下的视觉密度建模。客观看，较有借鉴意义的是面向遮挡严重交通场景的密度图感知设计，以及CNN密度估计与ST3DNet、Graph-Transformer MARL的级联框架，但整体有效性仍需后续预测与控制实验验证。

Abstract: Traffic congestion is becoming a critical challenge in rapidly growing urban centers, particularly in developing nations where rapid urbanization and inadequate transport infrastructure place increasing strain on transport networks. In highly heterogeneous and chaotic traffic flows, camera-based traffic-state estimation is limited by severe vehicle occlusion and overlap. In this paper, we propose a framework to optimize traffic flow directly from stochastic visual observations. The architecture is structurally decoupled into three primary components: (a) vehicle density estimation, (b) predictive dynamics modeling, and (c) policy optimization. The proposed methodology introduces a convolutional neural network (CNN) that learns the mapping from camera feeds to spatial density maps, utilizing an adaptive k-nearest-neighbor (k-NN) Gaussian kernel to handle varying congestion levels. This feeds into an ST3DNet predictive module for spatiotemporal forecasting, followed by a hierarchical Graph-Transformer Multi-Agent Reinforcement Learning (MARL) algorithm to optimize signal phases. The density estimation stage was evaluated on 40 annotated intersection images from Rambagh 4, Jaipur, India, with a reported five-fold validation mean absolute error (MAE) of $3.32 \pm 0.95$ vehicles and a mean absolute percentage error (MAPE) of 14.5%. These results pertain to the perception component; empirical training and evaluation of the forecasting and control stages remain future work.

[73] Residual Motion Splatting for Continuous Space-Time Video Super-Resolution cs.CVPDF

Vincent Herfeld, Eva Coupet{é}, Julien Mairal, Jean Ponce

TL;DR: 论文研究连续时空视频超分辨率，即从低分辨率、低帧率视频生成任意空间尺度和时间瞬间的高分辨率、高帧率视频。作者提出残差运动溅射方法：预测逐像素连续轨迹，在潜空间中将连续低分辨率特征按亚像素位置和可见性权重直接溅射到高分辨率网格，再由解码器处理剩余歧义，从而将时间插值与多帧超分统一为单次操作。

Details

Motivation: 经典多帧超分表明，通过亚像素级对齐并累积互补观测可恢复单帧采样极限之外的细节；现有学习方法在融合前对每帧重采样，导致亚像素位置信息丢失。论文旨在恢复该原则，并解决未观测时刻的亚像素运动估计以及粗网格溅射到细网格时的空洞与遮挡问题。

Result: 论文称在多个标准基准上，重建保真度和感知质量均优于当前最先进方法，同时运行速度最高提升一个数量级；摘要未给出具体定量指标。

Insight: 创新点在于用全序列特征预测平滑残差运动以细化线性光流轨迹，并在学习潜空间中按预测亚像素位置和可见性权重直接溅射连续低分辨率特征，避免融合前重采样。客观来看，其价值在于将时间插值与多帧超分统一，保留亚像素信息并显式建模可见性以缓解遮挡和空洞。

Abstract: Continuous space-time video super-resolution produces a high-resolution, highframe-rate video from a low-resolution, low-frame-rate one at arbitrary spatial scales and temporal instants. Classical spatial multi-frame super-resolution has shown that detail beyond a single frame’s sampling limit can be recovered by aligning complementary observations with sub-pixel precision and accumulating them on a finer grid. Existing learning-based methods largely depart from this principle: some align and fuse frames only at low resolution before regressing a continuous high-resolution representation, while others interpolate each frame to the output resolution before splatting. In both cases, the per-frame samples are resampled before fusion, so their sub-pixel positions are lost before frames are combined. Restoring this principle in a learned continuous model raises two challenges: estimating sub-pixel motion at unobserved times, and handling holes and occlusions when splatting a coarse grid onto a finer one. We address the first by predicting per-pixel continuous trajectories that refine linear optical-flow paths with smooth residual motion, using features integrated over the full video sequence. We address the second by directly splatting consecutive low-resolution features in a learned latent space onto a high-resolution grid at their predicted sub-pixel positions with predicted visibility weights, before a decoder resolves remaining ambiguities. This makes temporal interpolation and multi-frame superresolution a single operation. Our method improves both reconstruction fidelity and perceptual quality on multiple standard benchmarks over the state of the art, while running up to an order of magnitude faster.

[74] Similar Scores, Opposite Failures: Human Correction as an Instrument for Video Caption Evaluation cs.CV | cs.CLPDF

Ankit Khedia, Astitva Jaiswal, Chaitanya Prasad, Anisha Raju, Aangeeras

TL;DR: 论文检验面向单句图像描述的传统指标能否用于密集、多窗口视频描述评估，发现参考重叠类指标无法区分人类接受与拒绝的视频 caption。作者让六个前沿模型为196个短视频生成描述，标注者依据预先固定的失败分类法进行整段和逐窗口修正，并经质量控制，得到1,144个整段判定和4,672个窗口判定；结果显示指标接近随机，审查粒度显著影响错误发现，且准确率相近的模型具有截然不同的失败画像。

Details

Motivation: 当前视频描述模型越来越多地使用为单句图像描述设计的指标来评估，但这类指标是否能在密集、多窗口视频描述中恢复人类判断尚不清楚。论文旨在揭示传统自动指标在视频 caption 评估中的失效，并主张评估应记录错误类型而不仅是错误频率。

Result: 参考重叠指标无法区分被接受和被拒绝的 caption：BLEU-4 的 AUC 为0.510，CIDEr 风格 tf-idf 余弦为0.528，仅用审查者修正作参考时 BLEU-4 为0.479且置信区间包含随机水平。逐窗口审查比整段审查发现更多镜头/拍摄错误（12.8% vs 2.7%，4.7倍差距）；整段正确率为54.1%–72.7%，但15组模型两两差距仅4组通过 Bonferroni 校正，且准确率与严重度排序不一致。

Insight: 论文的创新点在于将人类修正/后编辑作为视频描述评估工具，基于固定失败分类法进行整段与逐窗口双粒度标注，并用质量控制保证可靠性；同时发布分类法、各模型失败画像、语料难度属性和可复现代码。客观来看，其价值在于系统证明参考重叠指标在视频描述上接近随机、审查粒度会改变错误检测结果，以及单一标量会掩盖模型间不同的失败模式。

Abstract: Video captioning models are increasingly evaluated with metrics designed for single-sentence image captions. We test whether those metrics recover human judgement on dense, multi-window video description, and find that they do not. Six frontier models captioned 196 short clips. Trained annotators post-edited every caption against a failure taxonomy fixed before annotation, once as a whole-clip overview and once window by window, and a quality-control reviewer checked each annotation, yielding 1,144 overview verdicts and 4,672 window verdicts. Reference-overlap metrics do not separate the captions reviewers accepted from those they rejected: BLEU-4 reaches an AUC of 0.510 and a CIDEr-style tf-idf cosine 0.528, and restricting references to reviewer corrections leaves BLEU-4 at 0.479 (95% CI 0.431-0.529), indistinguishable from chance. Review granularity changes what is detected. The same annotators record camera and shot errors on 2.7% of captions when reading the overview and on 12.8% when reading window by window, a 4.7x gap that holds across every robustness check we ran, on the mode most likely to need a near-total rewrite. Correct-overview rates span 54.1-72.7%, but only 4 of 15 pairwise gaps survive Bonferroni correction (5 after adjusting for reviewer and clip effects), and accuracy and derived severity order the models differently. Models with statistically indistinguishable accuracy have sharply different failure profiles, which no single scalar shows. We argue that caption evaluation should record what was wrong rather than only how often, and we report the taxonomy, the per-model profiles, the corpus properties that predict difficulty, and the code that regenerates every number in the paper.

[75] Detecting Fine-Grained Differences between Image Datasets cs.CVPDF

Leander Girrbach, Alexander von Recum, Kirill Bykov, Zeynep Akata

TL;DR: 论文研究如何检测两个图像数据集在概念层面的细粒度分布差异。作者系统比较了用MLLM提议概念并用图像级嵌入选择，与用细粒度patch嵌入从广泛概念列表中选择再优化的流程，发现后者可低成本替代MLLM提议，并将MLLM推理用于概念优化以取得显著提升。论文还提出关注低出现率和多概念区分的新benchmark，强调选择非冗余概念的重要性，并展示该方法可用于检测虚假相关和偏见。

Details

Motivation: 检测两个数据分布是否以及如何不同是基础统计问题，尤其在大规模复杂图像数据集中，需要可解释地找出自然语言概念层面的细粒度差异。先前方法依赖MLLM提议概念和图像级嵌入选择，成本较高且未必适合细粒度、低出现率和多概念差异场景。

Result: 摘要未给出具体定量数值和标准benchmark名称；定性结果显示，从广泛列表选择概念可替代MLLM提议且成本明显更低，将MLLM推理用于优化已选概念可带来显著提升。在新设计的低出现率和多概念区分benchmark上，选择非冗余概念比仅选择最具区分性的概念更重要。

Insight: 创新点在于视角转变：用细粒度patch嵌入从广泛概念列表选择概念，替代昂贵的MLLM概念提议，并把MLLM用于概念优化；同时提出面向低出现率和多概念区分的新benchmark及非冗余概念选择技术。客观来看，该工作降低了概念级数据差异检测对MLLM提议的依赖和成本，强调可解释性、非冗余性和实际诊断价值，如检测虚假相关与偏见。

Abstract: Detecting whether and in particular how two data distributions differ is a fundamental statistical problem. For example, we might be interested in which concepts (expressed in natural language) differ between two classes, the outputs of different generative models, or the same model with different prompt specifications. When working with large and complex image datasets, we intuitively think that first selecting concepts from a broad list using fine-grained patch embeddings, and then optimizing the concepts to better fit the data is an effective workflow. However, prior work instead uses MLLMs to propose concepts and image-level embeddings to select them. Therefore, we systematically compare these techniques and find that selecting concepts from broad lists can replace MLLM-proposals at obviously lower cost. MLLM inference can then be spent on optimizing selected concepts instead to achieve substantial improvements. Additionally, by designing a new benchmark that focuses on low-prevalence and multi-concept distinctions, we find that selecting nonredundant concepts instead of only the most distinguishing concepts matters, and we introduce techniques for how to effectively do this. Finally, we show how our methods address important problems like detecting spurious correlations and biases. Overall, our work presents a fundamental perspective shift on how we analyze interpretable distributional differences between datasets.

[76] RoSAMDepth: Robust Self-supervised Depth Estimation Leveraging Segment Anything Model cs.CVPDF

Xuanang Gao, Zhiwei Ning, Gengming Zhang, Jiaxi Cao, Runze Yang

TL;DR: 论文提出 RoSAMDepth，一种利用 Segment Anything Model（SAM）丰富对象级先验的鲁棒自监督深度估计框架。方法从特征表示对比、区域异常值掩码与区域深度平滑损失、对象级可靠性估计三方面引入对象级信息。实验表明其在多数据集和多种天气条件下能生成更清晰、更准确的深度预测。

Details

Motivation: 现有鲁棒深度估计方法通常未利用对象级信息，导致预测深度在物体内部易发生偏差，并在恶劣条件下变得模糊；论文旨在借助 SAM 的对象级先验提升自监督深度估计的鲁棒性。

Result: 在多个数据集和多样天气条件下进行大量实验，所提方法产生更清晰、更准确的深度预测，并持续优于当前最先进方法。

Insight: 创新点在于将 SAM 的对象级先验系统性地融入自监督深度估计：通过分割引导表示对比增强特征对象感知，结合自适应区域异常值掩码与区域高斯似然损失促进区域平滑，并利用对象级可靠性估计降低不可靠监督影响。

Abstract: Robust depth estimation aims to maintain high-quality depths across diverse conditions. However, most existing methods estimate depth without taking into account the object-level information. As a result, the predicted depth may easily deviate within objects and become blurred under adverse conditions. To overcome this weakness, we propose RoSAMDepth, a novel framework that can assist robust self-supervised depth estimation in leveraging rich and diverse object-level priors from the Segment Anything Model (SAM). We focus on incorporating object-level information across three key aspects: a segment-guided representation contrasting method that injects object-level awareness into the feature representation space; an adaptive regional outlier masking strategy combined with a regional Gaussian likelihood loss that enforces regional depth smoothness; and an object-level reliability estimation strategy that mitigates the influence of unreliable supervision. Extensive experiments across multiple datasets and diverse weather conditions demonstrate that our method produces sharper, more accurate depth predictions, consistently outperforming state-of-the-art methods. Our code is available at https://github.com/xagao/RoSAMDepth.

[77] Data Scaling Laws in Stereo Matching: From In-domain Fitting to Cross-domain Generalization cs.CVPDF

Tong Zhao, Di Liang, Yiming Zeng, Bo Xu, Yingzhi Tang

TL;DR: 论文初步研究立体匹配中的数据缩放规律，构建了包含20万样本的真实感合成数据集XStereo，并系统分析域内拟合与跨域泛化随数据规模变化的规律。研究发现域内性能呈现从幂律到饱和的两阶段缩放行为，而跨域性能对源域数据规模依赖更弱，数据分布与覆盖多样性对缩小域差更关键。

Details

Motivation: 在大模型和基础模型趋势下，立体匹配正转向基于百万级合成图像训练可泛化模型，但合成数据规模如何影响模型性能仍缺乏系统研究，尤其域内拟合与跨域泛化的缩放规律尚不明确。

Result: 论文在五个大规模数据集上进行域内训练，观察到随数据量增加从标准幂律转为饱和的两阶段缩放行为，且固定模型下临界转变点约保持不变；跨域性能对源域数据规模的依赖明显更弱且更难预测，分布与覆盖多样性更有利于缩小域差。

Insight: 论文构建XStereo合成数据集作为数据缩放研究benchmark，并将缩放律分析从语言/视觉扩展到立体匹配，区分域内拟合与跨域泛化，揭示两阶段缩放及跨域多样性优先的现象，为高效数据构建和训练提供指导。

Abstract: In the era of large models, stereo matching is developing towards generalizable foundation models trained on million-scale synthetic images. However, how model performance scales up with synthetic data is still underexplored. In this work, we preliminarily investigate the in-domain and cross-domain data scaling laws in stereo matching. A realistic synthetic dataset, named XStereo, containing 200 thousand samples is first built to serve as a high-quality benchmark for data scaling research. In-domain training on five large-scale datasets demonstrate a two-regime scaling behavior with data, transitioning from the standard power law to saturation, where the critical transition point is approximately invariant under a fixed model. Cross-domain performance exhibits a substantially weaker and less predictable dependence on the source-domain data scale. The distribution and coverage diversity are more effective for diminishing domain gaps. More instructive suggestions are provided for high-efficiency data construction and training. The insightful findings are significant verification and extension of the existing scaling laws in both language and vision, paving the way to efficient and stronger stereo matching. The XStereo dataset is public at https://huggingface.co/datasets/Tong-Zhao/XStereo.

[78] V-CAPE: Visual Consistency Assessment for Product Image Editing cs.CVPDF

Iaroslav Melekhov, Roberto Alcover Couso, Francesco Taioli, Daniel Coelho, Artur Bekasov

TL;DR: 论文提出 V-CAPE，一个面向产品图像编辑的视觉一致性评估大规模数据集，包含 4 万对源-目标产品图像，并提供接受/拒绝二值标签及几何畸变、姿态错误、身份不匹配等细粒度失败模式标注。数据集混合真实编辑图像与基于 3D 资产的合成样本，用于规模化自动质量评估和受控分析，并系统评测视觉语言模型。

Details

Motivation: 生成式图像编辑可完成背景替换、物体操作和姿态调整等复杂变换，但验证编辑后物体固有视觉属性（几何、纹理、颜色和细节）是否保持一致仍很困难。规模化场景下人工检查不可行，因此需要自动化质量评估方法和基准。

Result: 在 V-CAPE 的 AutoQA 任务上，各规模类别的视觉语言模型准确率均低于 65%，说明现有模型在验证编辑变换下的视觉一致性方面仍有明显不足，该数据集对当前模型构成较大挑战。

Insight: 论文宣称的创新在于构建大规模产品图像编辑视觉一致性数据集，提供二值标签和结构化细粒度失败模式，并融合真实编辑图像与 3D 资产生成的合成子集。客观来看，其可借鉴之处是混合真实与可控合成数据进行基准构建，以及用结构化失败模式支持细粒度诊断和自动质量评估。

Abstract: Recent advances in generative image editing enable complex transformations such as background replacement, object manipulation, and pose adjustment from natural language instructions. However, verifying that these transformations preserve visual consistency, defined as the preservation of an object’s intrinsic visual attributes, including geometry, texture, color, and fine-grained details, remains a largely unsolved problem. This challenge is particularly pronounced at scale, where manual inspection is infeasible and automated quality assessment (AutoQA) could become essential. In this work, we introduce Visual Consistency Assessment for Product Image Editing (V-CAPE), a large-scale dataset for evaluating visual consistency in generative image editing. The dataset consists of 40K unique source-target product image pairs, each annotated with binary accept/reject labels and structured failure modes capturing fine-grained inconsistencies such as geometric distortions, pose errors, and identity mismatches. V-CAPE combines real-world edited images with a synthetic subset constructed from 3D assets, enabling both realistic evaluation and controlled analysis. Vision-language models (VLMs) across all evaluated size categories on AutoQA achieve accuracy below 65%, indicating that the dataset poses a substantial challenge regardless of model scale. Our results highlight fundamental limitations of current models in verifying visual consistency under transformation, positioning V-CAPE as a benchmark for advancing fine-grained image editing evaluation.

[79] AskStream: When and What to Ask Proactively under Uncertainty in Streaming Video Understanding cs.CV | cs.CLPDF

Lu Wang, Zhuoran Jin, Longxiang Wang, Junhong Chen, Yupu Hao

TL;DR: 论文针对流式视频理解中信息不完整的不确定性场景，提出主动交互应包含“询问”动作，即模型应能主动询问缺失信息。为此构建了首个多轮基准AskStream，包含视频和用户不确定性下的四个任务类别与八个子任务，并标注帧级时间窗口用于等待、询问和回答决策。实验显示最强模型在Ask-F1上仅52.18%，表明主动信息寻求能力仍很有限。

Details

Motivation: 现有主动交互范式假设回答所需信息完整，模型只能等待或回答，但现实中信息常因视频或用户不确定性而不完整，导致模型无限等待或产生幻觉，因此需要让模型主动询问缺失信息。

Result: 构建了AskStream基准，包含438个视频和2714个人工标注帧级时间窗口，覆盖多项选择和开放式设置；最强模型在提出的Ask-F1指标上仅达到52.18%，凸显主动信息寻求的显著局限。

Insight: 创新点在于将主动交互重新定义为等待、询问、回答三种动作，并首次构建涵盖视频与用户不确定性的多轮流式视频理解基准；客观来看，将主动询问机制引入流式视频理解是应对信息不完整问题的合理且必要的拓展。

Abstract: Recent advances in multimodal large language models have increased interest in interaction paradigms for video understanding. The evolution from offline to streaming and proactive interaction has gradually shifted models from passive responders toward more proactive agents that can decide when to answer. However, existing proactive paradigms typically assume that the information required to answer a query is complete, leaving models to only wait or answer. In the real world, however, information is often incomplete due to uncertainty from either the video or the user. In proactive paradigms, such uncertainty can cause the model to wait forever or generate highly hallucinatory responses. We therefore argue that proactive interaction should be redefined with a third action: ask, allowing models to actively ask for missing information. To study when and what models should ask before answering, we introduce AskStream, the first multi-turn benchmark spanning video and user uncertainty for streaming video understanding, with four task categories and eight subtasks. It contains 438 videos with 2,714 manually annotated frame-level time windows across three types: wait, ask, and answer. Across both multiple-choice and open-ended settings, even the strongest model attains only 52.18% on our proposed Ask-F1 metric, highlighting substantial limitations in proactive information seeking under uncertainty.

[80] inkGround: Benchmarking Fine-grained Visual Grounding Capabilities of Vision-Language Models for Cursive Handwriting in the Wild cs.CV | cs.AIPDF

Sidra Hanif

TL;DR: 论文提出 inkGround，一个面向真实场景全页拍照手写草写体的笔迹轨迹恢复基准，将任务建模为给定页面图像和目标词后定位该词并输出有序笔迹点序列的文本条件点定位问题，并系统评测通用视觉语言模型的细粒度视觉定位能力。基准包含537页图像、约1.87万词和16.3万笔画，参考轨迹由离线到在线模型生成并经OCR一致性和人工校验；同时在IAM-OnDB录制轨迹上补充评测。

Details

Motivation: 现有图像-轨迹配对数据多在受控条件下用数字化板采集，书写者和风格多样性有限，且缺乏衡量通用VLM在笔画轨迹恢复任务上视觉定位能力的基准。论文旨在构建真实拍照全页手写场景下的细粒度评测基准。

Result: 论文用统一上下文提示评测了4个开源和3个前沿闭源VLM，闭源模型尤其Gemini-3.1-Pro能生成接近参考轨迹且可读的轨迹，该排名在IAM-OnDB上也保持一致；摘要未给出具体数值。

Insight: 创新点在于构建真实场景全页手写轨迹恢复基准，将任务转化为文本条件点定位，并综合轨迹保真度（DTW、Chamfer距离）、渲染笔画可读性和风格相似度进行多维评测；同时用伪标签加OCR过滤和人工校验，并结合IAM-OnDB真实录制轨迹验证，兼顾规模与可靠性。

Abstract: Human handwriting is produced as an ordered sequence of pen movements, but an offline image keeps only the final ink. Handwriting trajectory recovery aims to restore the ordered stroke points and their pen-up/pen-down transitions. Existing image-trajectory pair datasets are recorded with digitizing tablets under controlled conditions, which limits writer coverage and stylistic diversity. Moreover, there is no benchmark that measures the visual grounding capabilities of general-purpose Vision-Language Models (VLMs) for the stroke trajectory recovery task. In this work, we introduce inkGround, a benchmark for stroke trajectory recovery from full-page, camera-captured handwriting. inkGround pairs 537 page images (~18.7k words, ~163k strokes) with reference trajectories produced by a pretrained offline-to-online model, filtered by OCR agreement, and verified by human raters. Because these references are pseudo-labels that represent one plausible pen trajectory, we also evaluate VLMs on the IAM-OnDB dataset, which provides recorded pen trajectories. We cast the task as text-conditioned point grounding: given a page image and a target word, the model must locate the word and output its ordered stroke points. Outputs are scored by trajectory fidelity (DTW, Chamfer distance), readability of the rendered strokes (Accurate Rate, Correct Rate), and style similarity. We benchmark four open-source and three frontier closed-source VLMs with a shared in-context prompt. Closed-source models, notably Gemini-3.1-Pro, produce legible trajectories close to the reference, and this ranking also holds on IAM-OnDB.

[81] RuleForge: Inferring and Instantiating Latent Visual Rules as Executable Programs cs.CVPDF

Weifeng Xu, Yaxiong Wang, Zhedong Zheng

TL;DR: 论文提出Bongard-Forge100k视觉规则推理基准和RuleForge框架，联合学习视觉规则理解与规则条件下的可执行程序生成。框架依次进行规则理解训练、理解与场景程序联合监督、基于执行的强化学习精炼，并用多随机种子执行反馈验证程序的可执行性、规则满足度、多样性和鲁棒性。在UniLIP等骨干模型上显著提升规则理解和场景级规则实例化能力。

Details

Motivation: 现有研究要么只从视觉示例推断规则但仅评估分类或语言化，要么在已给定规则下监督可执行程序生成，视觉规则理解与可靠规则实例化之间的关系研究不足。论文旨在建立受控基准并联合建模规则理解与可执行程序生成。

Result: 以UniLIP为主干时，RuleForge在熟悉规则上的多选题准确率比基模型提升20.93个百分点，在留出规则组合上提升28.42个百分点；熟悉规则场景级规则满足率从2.91%提升到70.99%。在InternVL3.5、Qwen3-VL和Show-o2上的实验也验证了训练数据和框架的有效性。

Insight: 创新点在于构建大规模受控视觉规则推理基准，并提出骨干无关的联合理解与程序生成框架。可借鉴之处包括用可执行程序作为规则实例化载体，以执行结果提供可验证反馈，并通过执行驱动的强化学习和Understanding Replay提升规则满足度与组合泛化能力。

Abstract: Visual rule reasoning asks whether multimodal models can recover an abstract concept from a few examples. Existing studies either infer rules from visual examples but evaluate only classification or verbalization, or supervise executable generation with rules provided as input. Consequently, the relationship between visual rule understanding and reliable rule instantiation remains insufficiently explored. We present Bongard-Forge100k, a controlled benchmark, together with RuleForge, a backbone-agnostic framework that jointly learns visual rule understanding and rule-conditioned executable generation. The benchmark contains 108,797 problems: 86,000 for training, 19,297 for testing familiar rules, and 3,500 for testing held-out rule compositions. The framework progresses through rule-understanding training, joint understanding and scene-program supervision, and refinement via execution-grounded reinforcement learning with Understanding Replay. Executing generated programs under multiple random seeds provides verifiable feedback on executability, rule satisfaction, diversity, and robustness. With UniLIP as the primary backbone, RuleForge improves multiple-choice accuracy over the base model by 20.93 percentage points on familiar rules and 28.42 percentage points on held-out rule compositions, while increasing scene-level rule satisfaction on familiar rules from 2.91% to 70.99%. Additional experiments on InternVL3.5, Qwen3-VL, and Show-o2 demonstrate the effectiveness of the proposed training data and framework across diverse multimodal architectures.

[82] Beyond Region Memory: Local Point Tracking for Vocal Cord Localization in Video Laryngoscopy cs.CVPDF

Huayu Wang, Gyungmin Ko, Jung Heon Kim, Jia-Xian Jian, Dae Kon Kim

TL;DR: 论文提出局部点跟踪（LPT）框架，用于视频喉镜中的声带定位。该方法采用“先定位、后吸附”流程：单帧语义检测器生成稀疏锚点并初始化局部查询点，点传播模块在检测器漏检帧中跟踪这些点并恢复时序边界框，随后通过box-snap细化边界。实验在两个数据集上验证了其整体性能和鲁棒性。

Details

Motivation: 视频喉镜中声带定位受组织快速形变、镜面高光和器械遮挡影响，现有基于区域或掩码记忆的方法易受时序误差累积和边界不紧问题困扰。论文旨在在检测器漏检和复杂视觉条件下实现稳定、边界准确的声带定位。

Result: 在两个不同数据集上，LPT在mAP_50、success AUC和missing rate三项指标上均取得最佳，整体优于现有基线。消融表明点跟踪主要提升时序跟踪鲁棒性，box-snap有效改善边界紧致度。

Insight: 创新点在于将时序状态保存在局部点坐标而非有状态掩码或全区域表示，并解耦时序跟踪与单帧边界细化，避免掩码误差反馈到时序记忆。客观来看，这种“点跟踪+边界吸附”的分解为遮挡、形变和漏检场景提供了更轻量鲁棒的定位思路。

Abstract: Reliable vocal-cord localization in emergency video laryngoscopy remains visually challenging due to rapid tissue deformation, specular highlights, and instrument occlusions. We propose Local Point Tracking (LPT), a robust framework that combines a single-frame detector, local point propagation, and stateless mask refinement. LPT follows a localize first, snap second pipeline. First, a single-frame semantic detector generates sparse anchors, within which LPT initializes local query points (SAM-supported by default, with a regular grid as fallback). A point-propagation module tracks these points through detector-missed frames and recovers temporal bounding boxes from their geometry. Second, because point-derived boxes can be loose around the visible boundary, a box-snap step refines the selected box to the target boundary. This decomposition keeps temporal state in local point coordinates rather than a stateful mask or whole-region representation, while the spatial refinement module handles single-frame boundary precision without feeding mask errors back into temporal memory. Extensive evaluations on two distinct datasets demonstrate that our proposed LPT method achieves strong overall performance against existing baselines, with the best mAP_50, success AUC, and missing rate on both datasets. Furthermore, ablation studies confirm that point tracking primarily enhances temporal tracking robustness, while box-snap refinement effectively improves boundary tightness.

[83] OneScene-Bench: Do Vision-Language Models Integrate Evidence Across Views? cs.CVPDF

Swathi Suhas, Anurag Das, Bernt Schiele, Jonas Fischer

TL;DR: 论文提出 OneScene-Bench，一个受控的多视图基准，用于检验视觉语言模型是否能将同一场景的多个视角观测整合为连贯的场景级表征。该基准围绕唯一物体计数、跨视图一致性和空间推理三类任务设计，并显式区分可由逐视图独立处理解决的案例与必须进行跨视图对应的案例。作者评估了12个先进的开源权重和专有VLM，发现模型在需要跨视图整合时存在明显能力缺口。

Details

Motivation: 现有面向多图像/VLM的评测没有隔离“跨视图证据整合”这一能力，许多任务即使不建立跨视角对应关系也能得到正确答案，因此无法判断模型是否真正理解同一场景的多视角信息。论文希望构建一个受控基准，明确测试何时必须整合跨视图证据。

Result: 在12个SOTA开源权重和专有VLM上，互补视图下的计数准确率仅为4.5%-50.0%，而完整重叠样例为45.5%-81.5%；跨视图一致性在各模型上约为50%，包括较新的专有VLM，尽管空间推理表现明显更强。结果表明当前模型在处理多图和跨视图整合证据之间存在显著差距。

Insight: 创新点在于通过控制物体跨视图重叠、在共享区域与视角特定区域引入局部编辑、构造需要跨视角组合证据的空间关系，系统地区分“逐视图处理”与“场景级跨视图整合”。客观看，其价值在于提供了可诊断VLM多视图理解短板的受控评测框架，并揭示了一致性判断和实例级对应仍是薄弱环节。

Abstract: Vision-language models (VLMs) increasingly process multiple views of the same scene, but it remains unclear whether they integrate these observations into a coherent scene-level representation. Existing multi-image evaluations do not isolate this capability, as tasks may admit correct solutions through independent per-view processing without requiring cross-view correspondence. We introduce OneScene-Bench, a controlled benchmark designed to explicitly distinguish when cross-view integration is necessary. Our benchmark evaluates three complementary capabilities on real-world multi-view scenes: unique object counting, cross-view consistency, and spatial reasoning. For counting, we control object overlap across views to separate cases solvable by simple per-view aggregation from those requiring instance-level correspondence. For consistency, we introduce localized edits in shared and view-specific regions, testing whether models distinguish genuine scene contradictions from differences caused by viewpoint and visibility. For spatial reasoning, we construct object relations that require combining spatial evidence across viewpoints to compare physical proximity. We evaluate twelve state-of-the-art open-weight and proprietary VLMs and find that counting accuracy drops substantially on complementary views, ranging from 4.5-50.0%, compared with 45.5-81.5% on complete-overlap examples. Moreover, cross-view consistency remains around 50% across models, including recent proprietary VLMs, despite substantially stronger performance on spatial reasoning. Our results reveal a substantial gap between processing multiple images and integrating evidence across them, highlighting the need for evaluations that explicitly test scene-level multi-view understanding. Code and data are available at https://github.com/swathisuhas/OneScene-Bench.

[84] What do MLLMs know about ‘Waldo’? Evaluating Visual Reasoning under Multi-Instance Multi-Object Challenges cs.CVPDF

Saumya Mundra, Ajoy Mondal, Vineeth N Balasubramanian, C. V. Jawahar

TL;DR: 论文提出 MIMO-Bench，一个面向多目标类别中多实例场景的多模态大模型视觉推理基准，包含 3802 个图像-问题对，覆盖属性绑定和数值计数任务。该基准通过引入相似实例干扰，要求模型组合多个视觉子任务来唯一定位目标，从而更严格地评估 MLLM 的视觉指代与推理能力。

Details

Motivation: 现有视觉推理基准通常每个物体类别实例很少，指代目标过于简单、视觉歧义有限，无法充分检验 MLLM 在真实多实例干扰下的视觉推理能力。

Result: 在 MIMO-Bench 上，SOTA 开源模型 InternVL、QwenVL 以及闭源模型 Gemini、GPT-5 的性能均显著下降，表明现有模型在多实例多目标场景下仍存在明显局限。

Insight: 创新点在于构建 Multi-Instance per Multi-Object 的评估设定，利用同类相似实例作为干扰项，并要求通过多视觉子任务组合的指代表达实现唯一目标识别，为更真实的视觉推理评测提供了新思路。

Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have led to significant progress in visual reasoning capabilities. However, existing benchmarks curate image-question pairs pertaining to object categories with few instances, enabling trivial object referencing and limited visual ambiguity. In this work, we introduce MIMO-Bench, a benchmark for evaluating MLLMs in a Multi-Instance per Multi-Object categories (MIMO) setting. Each image-question pair in our benchmark pertains to instances belonging to object categories with multiple instances. The presence of such similar feature distractors causes hindrance in basic visual reasoning tasks, necessitating the referring expression to be composed of multiple visual subtasks to uniquely and unambiguously identify the target object. MIMO-Bench comprises 3,802 image-question pairs across attribute binding and numerical counting tasks. Despite impressive performances on existing benchmarks, both SOTA open-source (InternVL, QwenVL) and proprietary (Gemini, GPT-5) models exhibit substantially lower performance on MIMO-Bench, highlighting their limitations in the MIMO setting. The benchmark will be made publicly available.

[85] AlbumVSR: Identity-Preserving Face Video Super-Resolution from a Personal Photo Album cs.CV | eess.IVPDF

Nianyao Du, Xijun Wang, Stanley H. Chan

TL;DR: 论文提出 AlbumVSR，利用同一人的个人相册作为外部身份先验，对人脸视频进行身份保持的超分辨率重建。方法在冻结的一步流式扩散 Transformer 上，通过 MagFace/CLIP set tokens 编码相册身份，并引入由融合 UV atlas 渲染的纹理 tokens，将其注入缓存的 cross-attention 上下文。

Details

Motivation: 严重模糊、下采样、噪声和压缩会抹除人脸身份线索，仅依赖退化视频难以忠实恢复身份，因此需要借助同一人的照片相册提供额外身份信息。

Result: 在身份不重叠且带重度合成退化的 VoxCeleb2 benchmark 上，ArcFace 身份相似度从 0.586 提升到 0.670，人脸 PSNR 从 24.98 dB 提升到 26.71 dB；在 91 个测试身份上平均身份相似度高于全部 14 个基线。

Insight: 创新点在于将个人相册作为外部身份源，结合 set tokens 与基于估计人脸姿态渲染的 UV 纹理 tokens，并通过缓存 cross-attention 注入冻结流式扩散 Transformer，从而在视频超分中增强身份保持能力。

Abstract: Severe blur, downsampling, noise, and compression can erase the identity cues needed to faithfully restore a person’s face. We therefore use photographs of the same person as an external source of identity. AlbumVSR conditions a frozen, one-step streaming diffusion transformer on a personal album. We use four MagFace/CLIP set tokens to encode the album, and 64 texture tokens which come from a fused UV atlas rendered at the current window’s estimated face pose. These tokens are appended to the transformer’s cached cross-attention context. On an identity-disjoint VoxCeleb2 benchmark with heavy synthetic degradation, AlbumVSR raises ArcFace similarity to the ground truth from 0.586 to 0.670 and face PSNR from 24.98 to 26.71 dB. On the 91 test identities, its mean identity similarity is higher than that of all 14 baselines.

[86] Kinematic Causal Attribution: Black-Box Explanations of Motion versus Geometry for 4D Point-Cloud Video Models cs.CVPDF

Zerui Wang

TL;DR: 论文提出运动学因果归因（KCA），一种仅依赖模型输出的黑盒干预式归因方法，用于审计4D点云视频模型在分类时依赖区域运动还是几何形状。KCA通过冻结运动保持形状、以及去除形状保持运动的代理操作，构建运动×几何立方体，并用Shapley分解量化各因素贡献。作者在MSR-Action3D上对PSTNet、P4Transformer和Mamba4D进行验证，表明该方法能区分运动与形状线索且不损失归因忠实性。

Details

Motivation: 4D点云视频模型正被用于机器人、辅助监控和AR，但部署前缺乏工具检查模型依赖的是身体部位如何运动还是其形状。现有3D归因局限单帧、视频归因限于RGB像素、梯度法需白盒访问，且点级扰动假设跨帧点对应，难以适用于真实深度和LiDAR数据。

Result: 在MSR-Action3D上对官方PSTNet、P4Transformer和Mamba4D验证：运动审计任务中手臂重要性的运动占比随定义线索变化，分别为P4Transformer 0.83 vs. 0.60、PSTNet 0.86 vs. 0.30、Mamba4D 0.92 vs. 0.61。必要性图在P4Transformer和PSTNet上取得最低删除AUC，在Mamba4D上与最佳基线持平，且权重随机化后与训练模型的相关性消失。

Insight: 创新点在于用黑盒干预操作解耦运动与几何形状，构建运动×几何立方体并进行顺序对称的Shapley分解，同时显式测量交互作用而非假设其不存在。操作符直接重写每帧点集，无需跨帧点对应，context-averaged估计器可处理跨多个区域的结构，为4D点云视频模型提供可审计的因果归因。

Abstract: 4D perception models, which classify 3D point-cloud videos, are being built into robots, assistive monitoring and AR, yet before deploying one a practitioner cannot check which cue it relies on: how a body part moves, or what shape it has. 3D attribution is single-frame, video attribution is confined to RGB pixels, gradient maps need white-box access, attention is absent from state-space backbones, and point-level perturbations assume a point correspondence across frames that real depth and LiDAR data lack. We present Kinematic Causal Attribution (KCA), a black-box, interventional attribution method that queries only the model’s outputs. Its freeze operator removes a region’s motion while keeping its shape, and a shape-free proxy removes the shape while keeping the motion. Together they span a motion$\times$geometry cube for every tracked region, whose order-symmetric Shapley decomposition is complete and whose interaction is measured rather than assumed away. The operators rewrite per-frame point sets, so they need no correspondences, and a context-averaged estimator handles structures that span several regions. We validate KCA on the official PSTNet, P4Transformer and Mamba4D trained on MSR-Action3D. The decisive test is an audit: two binary tasks are built from real clips whose classes differ only in the motion or only in the shape of the same arm, and the motion share of the arm’s importance follows the defining cue on all three backbones (0.83 vs. 0.60 on P4Transformer, 0.86 vs. 0.30 on PSTNet, 0.92 vs. 0.61 on Mamba4D), a distinction no single attribution map can make. The split costs no faithfulness: the necessity maps have the lowest deletion AUC on P4Transformer and PSTNet, tie with the best baseline on Mamba4D, and lose their correlation with the trained model’s once the weights are randomised. Skeleton ground truth, re-sampling stability and cost complete the validation.

[87] STRATA: Reinforcement-driven Active Sampling with Tri-paradigm Adaptation for Efficient 3D Spatial Transcriptomics cs.CVPDF

Junchao Zhu, Ruining Deng, Chongyu Qu, Zhengyi Lu, Yanfan Zhu

TL;DR: 论文提出STRATA，一个面向高效3D空间转录组的强化驱动主动采样与三范式自适应重建框架。它从稀疏体素级ST测量出发，构建融合H&E形态与单细胞先验的3D图，用强化学习智能体进行预算感知的信息位点选择，并通过检索、回归和跨层插补的动态融合重建密集3D转录组图。

Details

Motivation: 3D体积空间转录组获取成本高，现有AI替代方法精度有限，而2D切片式ST仍依赖密集网格采样，造成冗余测量和生物信息区域欠采样。论文旨在用稀疏采样和主动选择降低采集成本，同时提升3D转录组重建精度。

Result: 实验跨多个数据集显示，STRATA在采样效率和重建精度上均有提升，尤其在低预算设置下优势明显；摘要未给出具体定量指标、benchmark名称或SOTA对比结论。

Insight: 摘要宣称的创新点包括：强化学习驱动的预算感知主动采样、融合H&E形态与单细胞先验的3D图建模，以及检索/回归/跨层插补三范式轻量动态融合预测器。客观看，其创新在于将主动采样与多范式自适应重建结合到3D ST稀疏采集流程中，以低预算场景下的效率-精度权衡为核心。

Abstract: Spatial transcriptomics (ST) enables joint characterization of tissue morphology and gene expression. However, 3D volumetric ST acquisition remains expensive. AI-driven methods offer a low-cost alternative but remain limited in accuracy, while recent 2D section-wise ST acquisition still rely on dense grid sampling, resulting in redundant measurements and undersampling of biologically informative regions. To bridge the gap, we propose STRATA, a reinforcement-driven active sampling framework with tri-paradigm adaptation for reconstructing dense 3D transcriptomic maps from sparse voxel-wise ST acquisition. STRATA constructs a 3D graph integrating H&E morphology with single-cell priors and employs a reinforcement learning agent to estimate morphological sparsity and transcriptomic informativeness, enabling budget-aware selection of informative spots. Given these sparse measurements, an adaptive tri-paradigm predictor combines retrieval, regression, and cross-layer imputation through lightweight fusion, dynamically weighting their contributions. Experiments across datasets demonstrate improved sampling efficiency and accuracy, particularly under low-budget settings. Code is available at https://github.com/Junchao-Zhu/STRATA.

[88] VEvo-Harness: Causally-Guarded Self-Evolving Harness for Agentic Image Generation cs.CVPDF

Yuan Wang, Yuhang Yu, Mengting Chen, Tianrun Xu, Zihao Pan

TL;DR: 论文提出 VEvo-Harness，一个面向 agentic 图像生成与编辑的因果守护持续自演化 harness 系统，旨在将现有浅层“生成-验证-重写”循环升级为可记忆、可治理、可持续进化的修复框架。系统通过视觉回溯、因果有效技能治理、生命周期化技能库和异构沙箱策略，提升密集约束下的图像生成与编辑能力。

Details

Motivation: 现有 agentic 视觉生成流程多停留在反复试错的浅层循环，VLM 反馈较粗粒度，修复经验易丢失或无门控更新污染技能库，难以实现持续自演化。论文希望解决密集用户约束下视觉生成/编辑的可靠修复与经验积累问题。

Result: 摘要宣称 VEvo-Harness 超越当前 SOTA agentic 方法，并可媲美 GPT-Image、Nano-Pro 等专有生成器，同时保持持续演化与泛化能力；但未给出具体 benchmark 名称和定量指标。

Insight: 创新点在于将因果验证引入技能库更新，用层次验证树做根因归因，并通过反事实双臂回放筛选有效技能补丁；同时以生命周期分层管理经验，并用异构沙箱按根因路由成本感知修复策略，形成可治理的持续自演化闭环。

Abstract: The central bottleneck in visual generation and editing has migrated from achieving pixel-level fidelity to satisfying densely constrained user specifications through increasingly agentic workflows. Prevailing agentic generation pipelines remain shallow generate-verify-rewrite loops treating VLM judgments as coarse visual feedback, either discarding repair experience or admitting ungated updates that poison skill library. With memorize and govern periods left open, they degrade into ungoverned iterators of repeated trial-and-error rather than continual self-evolving harness. Towards this issue, we present \textbf{VEvo-Harness}, the first causally-guarded continual self-evolving harness system for agentic visual generation. VEvo-Harness introduces four coupled innovations: (1) \textit{a visual traceback} that densifies sparse judgments into root-cause attributions with a hierarchical verification tree; (2) \textit{a visual continual governance} that admits only causally valid skill patches through counterfactual dual-arm image generation replay; (3) \textit{a lifecycle-managed harness state} that hierarchically distills root-cause-anchored episodes across working, experience, and pattern tiers into a persistent skill library of routable and causally verified capabilities; (4) \textit{a heterogeneous sandbox policy} that orchestrates a diverse action space of repair primitives, dynamically routing cost-aware interventions based on root causes to select the most effective strategy. VEvo-Harness surpasses state-of-the-art agentic methods and rivals proprietary generators (\textit{e.g.}, GPT-Image, Nano-Pro) while maintaining the continual harness evolution and generalization.

[89] Edited Endpoints as Partial Goals for Image-to-Video Generation cs.CVPDF

Sihyun Kim, Sanghyun Jo, Kyungsu Kim

TL;DR: 论文研究以编辑后的端点图像作为图像到视频生成的目标时，全帧端点条件会把源图保留的布局上下文误当成视频最终状态约束，从而产生时序伪影。作者提出 Partial 选择性条件方案，仅约束由图像编辑器注意力估计出的编辑相关区域，其余末端内容交给视频模型生成，并在多种视频模型和 TC-Bench-I2V 上验证其能减少时序伪影且不明显降低过渡完成率。

Details

Motivation: 编辑端点图像能明确图像到视频过渡目标并提升过渡完成度，但也会保留源图上下文；全帧端点条件将这些保留上下文转化为对视频最终状态的要求，导致硬切、背景运动反转和运动抑制等时序伪影。论文旨在解决如何利用编辑端点作为目标而不对非编辑区域施加过度约束的问题。

Result: 在 TC-Bench-I2V 上，Partial 在三种骨干模型上相对全帧条件降低时序伪影，且 Transition Completion Ratio 无显著差异；在 Wan2.2-Turbo 上，均匀弱化条件不能复现这些收益。Donor-context 干预进一步显示，仅替换编辑相关区域外的上下文即可在 HunyuanVideo-1.5 和 Wan2.2-Turbo 上降低 HC/BMR，并在 Wan2.2-Turbo 上恢复 DD，同时 TCR 无显著差异。

Insight: 创新点在于将编辑端点视为“部分未来目标”，只对编辑相关区域做条件约束，并用图像编辑器注意力估计该区域；同时引入 HC、BMR、DD 等时序伪影度量和 donor-context 干预来区分约束范围与约束内容的影响。客观来看，其价值在于提出选择性端点条件和归因实验，但也指出编辑相关性并不保证未来有效性。

Abstract: Edited endpoint images make the target of an image-to-video transition explicit and can improve transition completion, but also preserve context in the source image’s layout. Full-frame endpoint conditioning turns this preserved context into requirements on the video’s final state, potentially inducing temporal artifacts. We measure discontinuity with Hard-Cut (HC), late background reversal with Background Motion Reversal (BMR), and motion suppression with Dynamic Degree (DD). These artifacts appear across five video models spanning training-free and learned endpoint conditioning, in model-specific forms. We study Partial, a selective conditioning scheme that constrains only an edit-relevant region estimated from image-editor attention and leaves the remaining terminal content to the video model. Across three backbones on TC-Bench-I2V, Partial reduces temporal artifacts relative to full-frame conditioning, with no significant difference in Transition Completion Ratio (TCR); on Wan2.2-Turbo, uniformly weakening conditioning does not reproduce these reductions. A donor-context intervention keeps full-frame conditioning and replaces only the context outside the edit-relevant region with the final frame of a Partial video. It lowers HC and BMR on HunyuanVideo-1.5 and lowers BMR while restoring DD on Wan2.2-Turbo, with no significant difference in TCR, so constraint extent alone does not account for these artifacts. Together, these findings suggest that edited endpoints should serve as partial future goals, although edit relevance does not guarantee future validity. Code and data will be released at https://github.com/wannagetacat/Edited-Endpoints-I2V.

[90] Multi-level Constrained Learning for Underwater Image Enhancement cs.CVPDF

Wangtao Bao, Liping Xie, Kanjian Zhang, Huimin Lu

TL;DR: 论文提出配对监督的水下图像增强框架MCL-UIE，通过单调色变换约束全局颜色映射、不确定性门控小波重建控制高频细节恢复，并在训练阶段引入参考锚定退化重放，使增强结果与配对参考均能重现退化输入。三个组件共享恢复网络，在多个全参考比较中多数排名第一，并在无参考基准上取得有竞争力的视觉效果。

Details

Motivation: 现有配对参考监督只约束输出与参考图像的相似性，未明确颜色映射方式、局部细节修正强度以及与退化观测的一致性，导致水下图像增强的恢复过程欠约束。

Result: 在16个全参考数据集-指标比较中，MCL-UIE有13项排名第一，并在无参考基准上产生有竞争力的视觉结果；消融表明置信校准与重放监督结合最有效，且RADR仅在训练时使用，不增加推理计算。

Insight: 创新点在于从恢复操作和训练目标两个层面施加多级约束：log-LMS空间中的单调色变换限制颜色映射，误差校准的不确定性门控小波重建调制高频残差，参考锚定退化重放利用共享退化代理增强与输入的一致性；客观而言，其可借鉴之处是将退化一致性作为训练期约束且不引入推理开销。

Abstract: Underwater image enhancement aims to correct color and recover detail degraded by wavelength-dependent attenuation, scattering, and noise. Paired-reference supervision constrains output similarity, but does not by itself specify the color mapping, the strength of local detail corrections, or consistency with the degraded observation. We propose MCL-UIE, a paired-supervised framework that addresses these requirements by constraining restoration operations and the training objective. Monotonic Chromatic Transform (MCT) restricts global color mapping in log-LMS space through positive diagonal entries and bounded cross-channel coefficients. Uncertainty-Gated Wavelet Reconstruction (UGWR) modulates high-frequency residuals with a learned confidence gate calibrated against normalized wavelet reconstruction errors. During training, Reference-Anchored Degradation Replay (RADR) renders the enhanced image and its paired reference using shared latent degradation proxies, encouraging both to reproduce the input. The three components share a restoration network that combines structured color correction, locally controlled detail recovery, and reference-anchored replay. MCL-UIE ranks first in thirteen of sixteen full-reference dataset-metric comparisons and produces competitive visual results on no-reference benchmarks. Objective ablations indicate that confidence calibration is most effective when combined with replay supervision. RADR is used only during training and adds no inference-time computation. Our code is available at https://github.com/Wangtao-Bao/MCL-UIE.

[91] Seeing and Imagining as One: Unified Video Generation and 4D Perception for Embodied World Modeling cs.CV | cs.ROPDF

Haitang Feng, Zhuoman Liu, Zhennan Wang, Sheng Wang, Juelin Li

TL;DR: 论文提出 GenSight，一个统一的具身世界模型，将未来视频生成与稠密 4D 感知统一到单个预训练视频扩散 Transformer 中。模型用统一时空表示建模视频、深度、具身分割和首帧相对 2D 光流，并通过共享 DiT 主干和轻量任务调制在同一架构内联合优化。推理时支持多步未来视频生成加对齐稠密预测，以及从观测视频进行单步稠密感知。

Details

Motivation: 现有具身世界模型往往只关注想象未来视频，或使用分离的模态专用流程处理几何、语义和运动感知，导致外观、几何、语义与运动之间缺乏一致耦合。论文希望用一个统一模型同时“看见”和“想象”，提升具身世界建模的跨模态一致性和感知能力。

Result: 论文在涵盖多种机器人本体和人类手部交互的具身操作数据上训练，宣称在视频生成和稠密 4D 感知两方面均取得强性能；摘要未给出具体定量指标、benchmark 名称或 SOTA 对比。

Insight: 主要创新在于统一模态表示、统一模型架构和统一预测空间：用共享 DiT 主干与轻量任务调制联合预测视频、深度、分割和光流，并让稠密感知受益于视频生成学到的时空先验，从而避免多套模态专用流水线。

Abstract: Embodied world models should not only imagine plausible futures, but also perceive the geometric, semantic, and motion structure of the evolving world. We present GenSight, a unified embodied world model that brings future video generation and dense perception into a single pretrained video diffusion transformer. GenSight uses a unified spatiotemporal representation for video, depth, embodiment segmentation, and first-frame-relative 2D flow. Built on a shared DiT backbone, GenSight uses lightweight task modulation to predict all modalities within the same architecture. All tasks are jointly optimized within a unified velocity prediction space. At inference, GenSight supports two complementary modes: multi-step future video generation with aligned dense predictions and single-step dense perception from an observed video. By unifying modality representation, model architecture, and prediction space, GenSight avoids separate modality-specific pipelines and couples appearance, geometry, semantics, and motion in a shared representation. It promotes cross-modal consistency and allows dense perception to benefit from the spatiotemporal priors learned through video generation. Trained on embodied manipulation data spanning multiple robot embodiments and human-hand interactions, GenSight demonstrates strong performance in both video generation and dense 4D perception, highlighting the effectiveness of unifying seeing and imagining for embodied world modeling.

[92] DeCoRL: Decomposed Consistency Reinforcement Learning for Multi-Image Composition cs.CV | cs.AIPDF

Zhiqiang Wu, Shuang Sun, Jiale Zhang, Jing Li, Yibo Chen

TL;DR: 论文提出DeCoRL，一个用于多图像组合（MICo）的强化学习后训练框架。它将整体多图组合一致性分解为对象级一致性：先建立参考图与生成图之间的对象对应，再用基于VLM的奖励模型提供细粒度对象级反馈，并聚合为多对象一致性奖励以指导RL训练。论文还构建了覆盖2至6张参考图的DeCo-Bench基准。

Details

Motivation: 多图像组合中，随着参考图像数量增加，生成图像的一致性会快速下降；监督微调只能提供隐式监督，难以学习跨多个参考图的可靠对象级对应关系。

Result: 在DeCo-Bench和公开的MICo-Bench上，DeCoRL均取得MICo一致性的一致提升；摘要未给出具体定量数值或与SOTA的详细比较。

Insight: 主要创新是将整体MICo一致性拆解为对象级一致性，并用单对象一致性标注训练的VLM奖励模型进行细粒度RL反馈；同时提出覆盖2至6张参考图的DeCo-Bench。客观看，这从隐式SFT监督转向显式对象级奖励，针对多参考图一致性退化问题较有针对性。

Abstract: Multi-image composition (MICo) is a critical yet challenging capability for large-scale image editing models, where consistency degrades rapidly as the number of reference images increases. While supervised fine-tuning (SFT) can equip models with basic MICo ability, it provides only implicit supervision on the composed image and often fails to learn reliable object-level correspondence across multiple references. We propose DeCoRL, a reinforcement-learning (RL) framework that improves MICo consistency by decomposing holistic MICo consistency into object-level consistency. DeCoRL first establishes instruction-relevant object correspondences across reference images and localizes the corresponding regions in the generated image. It then uses a VLM-based reward model trained on single-object consistency annotations to produce fine-grained, object-wise feedback, which is aggregated into a multi-object consistency reward to guide RL post-training. We further introduce DeCo-Bench, a benchmark covering compositions from 2 to 6 reference images. Experiments on DeCo-Bench and the public MICo-Bench demonstrate consistent improvements in MICo consistency.

[93] WorldFlow: Joint Video and 3D Motion Prediction via Large-Scale Pretraining cs.CV | cs.AI | cs.ROPDF

Yuhao Lu, Jiongxu Chen, Hexiang Wei, Jiajin Wu, Juelin Li

TL;DR: 论文提出 WorldFlow，一个联合预测未来视频和基于查询的 3D 轨迹的生成式世界模型。它将 3D 运动参数化为与视频网格对齐的连续位移 token，并用统一的 Mixture-of-Transformers 骨干在 rectified-flow 目标下联合去噪视频与 3D 运动两种模态。作者在 144 万对象级样本上预训练，并提出 WorldFlowBench 进行评估。

Details

Motivation: 现有视频世界模型未显式建模 3D 动态，基于动作的方法受限于特定机器人构型，而 3D 运动预测模型多仅用 flow 监督，物理动态学习信号有限。论文希望联合视频与 3D 运动预测，显式耦合几何动态与视觉演化。

Result: 在 WorldFlowBench 的三个评估集上，WorldFlow 在所学方法中取得最低平均位移误差 ADE 和最终位移误差 FDE。在 SpatialCog 集上 ADE 为 0.060 m，相比最强外部基线降低 54.2%；相比仅 flow 变体，ADE 和 FDE 分别降低 55.9% 和 68.5%。

Insight: 创新点在于用与视频网格对齐的连续位移 token 表示 3D 运动，并通过统一 MoT 骨干联合去噪视频和 3D 轨迹，从而将显式几何动态与视觉演化耦合，释放预训练视频模型中的物理常识。大规模异构数据预训练和 WorldFlowBench 也提供了可借鉴的规模化验证方式。

Abstract: Predicting future physical states stands as a central challenge in embodied intelligence. Existing video world models leave 3D dynamics implicit, action-based formulations remain tied to specific robot configurations, and 3D motion prediction models use flow-only supervision, providing a limited learning signal for physical dynamics. To circumvent these limitations, we introduce \method{}, a generative world model that jointly predicts future video and query-based 3D trajectories. By parameterizing 3D motion as continuous displacement tokens aligned with the video grid, a unified Mixture-of-Transformers (MoT) backbone jointly denoises both modalities under a rectified-flow objective. This formulation couples explicit geometric dynamics with visual evolution, effectively unlocking the physical commonsense embedded within pretrained video models. To empirically scale and validate this unified architecture, we train \method{} on a heterogeneous mixture of 1.44 million object-level samples spanning simulated and real-world domains. We further introduce WorldFlowBench, comprising 1,678 evaluation samples from 11 data sources across simulated and real-world interactions, including spatial reasoning tasks. Across all three evaluation sets, WorldFlow achieves the lowest average displacement error (ADE) and final displacement error (FDE) among the evaluated learning-based methods. Notably, on the challenging SpatialCog set, WorldFlow achieves an ADE of 0.060 m, a 54.2% reduction compared with the strongest external baseline. It also reduces ADE and FDE by 55.9% and 68.5%, respectively, compared with its flow-only variant. Project page: https://worldflow-rbs.github.io/.

[94] Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities cs.CVPDF

Yunhang Shen, Zhangquan Chen, Xiaotian Li, Zhongpeng Cai, Qing Zhou

TL;DR: 论文提出 Youtu-Parsing-Omni，一个全模态文档解析器，可将文档、图像、音频、视频统一转换为在时空上可定位的结构化记录，为智能体提供可读取、可定位、可引用证据的感知层。其核心设计是“一个编码器处理所有模态、一个 schema 统一所有任务”：Youtu-Omni-Encoder 由预训练语言模型初始化，以共享权重在统一时空坐标系中编码各模态，并通过少量融合层实现视频帧与同步音频的跨模态融合与时间对齐；OmniSchema 统一十种解析任务的输出，支持单一自演化后训练流程 OSAD。最终以单个 5B 参数模型在多个基准上取得领先结果。

Details

Motivation: 现有文档/多模态解析系统通常按模态和任务各自设计编码器与输出格式，难以统一处理跨模态证据，也缺乏时空定位与可引用能力。论文希望用一个编码器和一个 schema 打通十种解析任务，把跨模态融合与时间对齐前移到感知阶段，为智能体提供统一的可定位证据来源。

Result: 单个 5B 参数检查点在 OmniDocBench v1.6 上取得 96.96 Overall 的 SOTA；在 OmniParsingBench 上以 75.08 Avg. 领先所有开放权重模型，优势集中在音频与视频；图表解析取得最佳综合分 95.02，化学指纹精确匹配度在对比系统中最高，排版乐谱的字符级转写与专用光学音乐识别模型相当，并显著优于通用系统。

Insight: 创新点在于：用语言模型初始化的共享权重编码器统一处理多模态，并在统一时空坐标系中显式建模视频—音频的融合与对齐；用统一 schema 将十种任务纳入同一 token 角色目标，配合基于自身 rollout、参考条件化监督并迭代刷新的在线策略蒸馏（OSAD），实现解析器与监督信号的共同演化。客观看，其“感知即融合”与“schema 统一 + 自演化后训练”的组合是较有借鉴价值的设计。

Abstract: We present Youtu-Parsing-Omni, an omni-modal parser that converts documents, images, audio, and video into structured records grounded in space and time, providing a perception layer for agents that read, locate, and cite evidence across modalities. Its design rests on one encoder for every modality and one schema for every task. Youtu-Omni-Encoder, initialized from a pre-trained language model to strengthen text reading, encodes all modalities with shared weights in a unified space-time coordinate system, and a few fusion layers let video frames attend to concurrent audio, bringing cross-modal fusion and temporal alignment into perception itself. OmniSchema unifies the outputs of all ten parsing tasks, allowing a single self-evolving post-training procedure, OmniSchema-Aware On-Policy Distillation (OSAD), to provide a shared token-role-based objective across tasks. In each round, the model is trained on its own rollouts against token-level targets from a reference-conditioned copy of itself, which is then refreshed with the trained weights, so that the parser and its supervision co-evolve. With a single 5 B-parameter checkpoint, Youtu-Parsing-Omni achieves state-of-the-art performance on OmniDocBench v1.6 (96.96 Overall) and leads all open-weight models on OmniParsingBench (75.08 Avg.), with its advantage concentrated on audio and video. It also achieves the best overall chart-parsing score (95.02) and the highest exact chemical-fingerprint agreement among compared systems, and matches a dedicated optical-music model in character-level transcription of typeset sheet music while staying far ahead of general-purpose systems. Code and model weights are publicly available.

[95] CAD-WAM: Anticipating Geometry for Text-to-CAD Generation cs.CV | cs.GRPDF

Zhengyang Li, Weijie Zheng, Yuxin Cui, Sijie Wang, Wenjie Feng

TL;DR: 论文提出 CAD-WAM，用于从文本生成可编辑 CAD 模型。该方法将 CAD DSL 操作视为动作，利用预训练 VAE 将中间实体的表面点云编码为隐状态，并由 LLM 根据目标描述和当前几何状态生成下一步动作，同时用辅助头预测下一几何状态以提供监督。推理时通过 CAD 内核执行动作并重新编码实体，形成闭环多步生成。

Details

Motivation: 现有基于 LLM 的文本到 CAD 方法主要学习预测命令，缺乏对命令应产生何种几何状态的显式监督，单步错误会影响后续多步生成，导致可靠的多步 CAD 生成困难。

Result: 在 DeepCAD 测试集上，CAD-WAM 在几何精度和输出有效性上优于任务专用基线，在需要更多操作的模型上提升更明显，并优于使用相同 DSL 的通用 LLM；消融显示下一状态监督相比仅预测动作将平均 Chamfer 距离降低 13.2%。

Insight: 创新点在于将世界-动作模型思想引入文本到 CAD：用下一状态预测作为几何监督，并结合 CAD 内核执行与实体重编码形成闭环；从客观角度看，动作-状态联合建模和中间几何监督是提升多步 CAD 生成可靠性的关键。

Abstract: Generating editable computer-aided design (CAD) models from text requires selecting operations that produce the intended changes to the geometry constructed so far. An incorrect operation can compromise subsequent steps, making reliable multi-step generation challenging. Existing methods based on large language models (LLMs) primarily learn to predict commands, without explicit supervision of the geometric states those commands should produce. Inspired by world-action models, we introduce CAD-WAM, which couples geometry-conditioned action generation with next-state prediction. We define complete modeling operations as actions in a CAD domain-specific language (DSL) and encode surface point clouds of intermediate solids into compact latent states using a pretrained variational autoencoder. An LLM backbone generates the next action from the target description and current geometric state, while an auxiliary head on the same backbone predicts the next state to provide geometric supervision during training. We construct step-wise training trajectories from parametric CAD models in the DeepCAD dataset, pairing each trajectory with an expert-level textual description. At inference, each generated action is executed by a CAD kernel, and the resulting solid is re-encoded to inform the next decision. On the DeepCAD test set, CAD-WAM outperforms the task-specific baselines in geometric accuracy and output validity, with larger gains on models requiring more operations, and produces more accurate geometry than general-purpose LLMs prompted with the same DSL. Ablations further show that next-state supervision reduces mean Chamfer distance by 13.2% relative to an otherwise identical model trained only to predict actions. Code is available at https://github.com/Lzy-1037/CAD-WAM.

[96] MemoryFusion: Cross-Temporal Memory Learning for Multimodal Video Fusion cs.CVPDF

Meiqi Gong, Hao Zhang, Jiayi Ma

TL;DR: 论文提出 MemoryFusion，一个用于多模态视频融合的两阶段框架，通过跨时间记忆学习与渐进式时间细化来利用长时时间线索并提升时间一致性。第一阶段结合短时记忆库与长时记忆库获取局部和可靠历史信息，并用时间平滑模块稳定背景；第二阶段用轻量级 3D 残差时间细化模块修正残余时间不一致并增强结构细节。

Details

Motivation: 现有视频融合方法主要依赖短程时间交互，长时信息利用不足，且融合表示不一致会导致闪烁伪影并破坏时间一致性。论文旨在同时解决长时时间信息未被充分探索和时间一致性不足这两个耦合问题。

Result: 摘要称大量实验表明 MemoryFusion 在融合质量和时间一致性上优于现有基于帧和基于视频的融合方法，但未给出具体 benchmark 名称或定量指标。

Insight: 创新点在于将跨时间记忆学习引入多模态视频融合，通过短时/长时记忆库和面向融合的历史更新策略利用相邻与远距离帧信息，并以时间平滑与轻量级 3D 残差时间细化实现渐进式一致性校正。客观上，其可借鉴之处是把长时记忆机制与时序平滑、后处理细化结合，以兼顾长时依赖建模和闪烁伪影抑制。

Abstract: Multimodal videos contain rich temporal cues that can facilitate faithful fusion. However, existing video fusion methods mainly rely on short-range temporal interactions, leaving valuable long-term information underexplored. Moreover, inconsistent fusion representations can cause flickering artifacts, undermining temporal coherence. To address these coupled challenges, we propose MemoryFusion, a two-stage framework integrating cross-temporal memory learning with progressive temporal refinement. Considering the complementary roles of adjacent and distant frames, the first stage combines a Short-Term Memory Bank for local temporal guidance with a Long-Term Memory Bank that preserves reliable historical information through a fusion-oriented update strategy. To mitigate temporal fluctuations, a Temporal Smoothing Module leverages soft motion cues for coarse background stabilization. Building upon the resulting fusion prior, The second stage further employs a lightweight 3D residual Temporal Refinement Module to correct remaining temporal inconsistencies while enhancing structural details. Extensive experiments demonstrate that MemoryFusion achieves superior fusion quality and temporal consistency over existing frame-based and video-based fusion methods. The source code is publicly available at https://github.com/Meiqi-Gong/MemoryFusion.

[97] MRC-MMAgent: Reinforcement Learning for Multi-Role Collaboration in Multimodal Tool-Using Agents cs.CVPDF

Shengqin Wang, Jie Jin, Xiaofan Li, Wentao Yan, Yu Cheng

TL;DR: 论文提出 MRC-MMAgent，一个面向多模态工具使用智能体的多角色协同强化学习框架，将求解、检查与继续求解组成可执行协同循环，并通过全轨迹策略优化训练智能体在检索证据不足时自我纠正。方法无需额外构建数据集，在多个基准上优于对应基模型并达到领先或有竞争力的表现。

Details

Motivation: 现有强化学习管线多训练单一角色智能体，仅依赖终端奖励完成搜索与回答，忽略了人类在搜索中检查证据、改写查询和修正结论的自我纠正过程，因此难以在完整交互轨迹上优化该过程。

Result: 实验仅使用原始基线训练集、不构建额外数据集，方法在多个基准上稳定优于对应基模型，并取得领先或极具竞争力的性能；摘要未给出具体数值和单一SOTA结论。

Insight: 创新点在于将多角色协同循环（求解、检查、继续）嵌入智能体执行回路，并设计角色耦合学习目标，把任务成功、交互有效性和成功纠正与全轨迹策略优化结合，从而显式优化跨角色的自我纠正轨迹。

Abstract: Multimodal tool-using agents augment vision-language models with access to external information and capabilities, enabling them to solve knowledge-intensive and visually complex tasks that cannot be addressed using visual context alone. However, existing reinforcement learning pipelines largely train single-role agents to search and answer using terminal rewards, overlooking how humans inspect retrieved evidence, reformulate queries, and revise conclusions during search. Consequently, they fail to optimize this self-corrective process over complete interaction trajectories. We propose MRC-MMAgent, a multi-role collaborative reinforcement learning framework that incorporates trajectory assessment and continuation directly into the executable agent loop. First, the framework establishes a multi-role collaborative loop that integrates solving, inspection, and continuation, enabling the agent to acquire evidence through tools, evaluate the preceding trajectory, and resume problem solving when the current answer is insufficiently supported. Second, we introduce a role-coupled learning objective that combines task success, interaction validity, and successful correction with full-trajectory policy optimization across the decisions generated by all roles. Extensive experiments show that, using only the original baseline training set without constructing additional datasets, our method consistently outperforms the corresponding base models and achieves leading or highly competitive performance across benchmarks.

[98] Can Image Agents Complete Visual Commissions? A Benchmark and Modular Framework cs.CVPDF

Tong Li, Lishuai Gao, Qi Zeng, Yifan Li, Cong Wei

TL;DR: 论文提出 Visual Commission Bench（VCB）基准，用于评估图像智能体完成端到端“视觉委托”任务的能力，包含 600 个任务、12 个类别和三个层级，并用 5,039 项需求检查与独立视觉质量评分进行评估。作者还提出参考智能体 V-Protocol，可在推理时动态组合任务、认知和表达模块，并通过共享执行框架管理中间产物、依赖、工具执行与完成检查。

Details

Motivation: 现有评测多关注单一能力或特定执行设置，难以理解图像智能体在依赖多阶段、需保持约束并交付协调结果的完整视觉委托中的表现，因此需要端到端基准与更系统的智能体框架。

Result: 在与基线使用相同控制器和图像生成器的情况下，V-Protocol 在 VCB 上取得 69.0% 严格任务成功率，高于 SCOPE 的 42.0%；在 Mind-Bench 上严格准确率从 39.2% 提升到 45.4%。

Insight: 创新点在于构建面向端到端视觉委托的评测基准，并提出可动态组合的模块化智能体框架，通过结构化中间产物和共享执行框架跟踪修订与依赖、管理工具并检查完成度；其可借鉴之处是将任务规划、内容生成与视觉实现解耦并统一编排。

Abstract: Visual commissions require image agents to integrate heterogeneous source materials, preserve requirements across dependent stages, and produce coordinated deliverables. Existing evaluations examine specific capabilities and execution settings, leaving end-to-end commission completion less understood. We introduce Visual Commission Bench (VCB), comprising 600 tasks across 12 categories and three complementary tiers, from capability-focused tasks to complete commissions. VCB uses 5,039 requirement checks and separate visual quality ratings to assess content correctness, visual realization, constraint preservation, and delivery completeness without prescribing an internal workflow. We present V-Protocol, a reference agent that dynamically composes reusable task, cognitive, and expression modules at inference time. Task modules organize delivery, cognitive modules derive content, and expression modules guide visual realization. The modules exchange structured intermediate artifacts, while a shared execution harness tracks artifact revisions and dependencies, manages tool execution, and checks completion. With the same controller and image generator as the agent baselines, V-Protocol achieves 69.0% strict task success on VCB, compared with 42.0% for SCOPE. On Mind-Bench, strict accuracy increases from 39.2% to 45.4%.

[99] Telling Is Not Seeing: Textual Personas Rarely Make Vision-Language Models Answer Like the People They Describe cs.CV | cs.AIPDF

Jiawei Chen

TL;DR: 论文考察用文本人物设定（如“你有低视力”）提示视觉语言模型能否模拟所描述人群的感知。作者将persona回答与真实低视力、色盲或听障人群以及仅使用persona事实的简单规则比较，发现persona并不能带来相应视觉体验，反而抹平群体与个体差异。即使模型能估计模糊等对人的影响，文本描述也不会改变其图像信息或答案概率。

Details

Motivation: VLM正被越来越多地用persona提示来替代真实用户参与用户研究，论文质疑这种文本角色是否能让模型“看见”所描述者看到的内容。

Result: 在14个模型上，描述模糊不改变识别表现，而实际模糊图像会像对人一样降低表现；persona从不优于简单规则，并抹去真实群体和个体差异；开放模型内部图像信息与答案概率均不受描述影响。

Insight: 创新点在于用真实人群测量和简单规则作对照，区分“知道关于人的事实”与“模拟其感知”，并分析模型内部表征和答案概率；客观启示是文本persona难以替代感知级干预，用户研究模拟需谨慎。

Abstract: Vision-language models (VLMs) are increasingly prompted with personas, such as “You have low vision”, to stand in for people in user studies. We ask whether a persona makes a model see like the person it describes. We compare persona answers with measured people with low vision, color blindness or hearing loss, and with simple rules that use only the facts the persona states. The persona never beats these rules, and it erases the real differences between groups and individuals. Describing blur leaves recognition unchanged in all 14 models we test, while blurring the photo lowers it as it does for people. Inside open models, the description changes neither the image information nor the answer probabilities. Yet the models know the effects they fail to show: they can estimate how blur and illusions affect people. Telling is not seeing: a persona makes a model say what it knows about people, not see what they see.

[100] PicturePerfect: Diffusion-based Same-identity Facial Replacement cs.CVPDF

Manik Dhingra, Yashesh Savani, Mahesh Reddy, Antoine Mercier, Jiahe Liu

TL;DR: 论文提出一种基于扩散模型的同身份面部替换方法，利用预训练文本到图像模型，输入一个人的肖像图像和同一人的另一张参考图像，将输入面部无缝替换为参考面部并保持背景不变，并构建了包含同一人不同表情和姿势图像对的大型数据集，实验表明该方法优于现有面部重演模型。

Details

Motivation: 解决照片中同一个人面部替换这一具有明确现实应用价值的任务，而近期发表的工作尚未直接针对该特定设置进行研究。

Result: 实验结果表明，与现有面部重演模型相比，该方法产生更真实且身份一致性更好的结果（摘要未提供具体定量指标或基准）。

Insight: 创新点在于针对同身份面部替换的特定场景，基于预训练扩散模型设计方法，并构建了配套的大型图像对数据集；客观来看，利用参考图像实现身份一致的面部替换并保持背景完整是值得借鉴的思路。

Abstract: With the growing success of diffusion models in computer vision, we explore their potential for same-identity facial replacement in photographs. Specifically, we propose a diffusion-based method, built on top of a pre-trained text-to-image model, that takes as input a portrait image of a person and a second reference image of the same individual, potentially captured under different conditions. The goal is to seamlessly replace the input face with the reference face, while keeping the background intact. Surprisingly, despite the clear real-world utility of this task, no recently published work has directly addressed face replacement in this specific setting. To support this goal, we construct a large dataset of image pairs depicting the same person under varying facial expressions and poses. Experimental results demonstrate that our approach produces more realistic and identity-consistent results than existing face reenactment models.

[101] Semantic Mismapping in Generalized Category Discovery: Evaluation and Mitigation cs.CV | cs.AI | cs.LGPDF

Zitai Wang, Qianqian Xu, Cong Hua, Xi Chen, Zhiyong Yang

TL;DR: 论文研究广义类别发现（GCD）中部分可交换输出空间的评估偏差问题。作者发现，旧类索引已被监督语义锚定后仍使用全局匈牙利匹配，会把旧索引错误重分配给其他类别，从而隐藏预测错误，最高可使新类准确率高估25.63个点，称为语义错映射。为此提出保留语义的SPE评估协议，将匈牙利匹配限制在新类区域，并提出MMO优化，通过区域平衡损失和新类多样性损失缓解该问题，并从理论上给出虚假准确率增益上界。

Details

Motivation: 近期GCD方法使用可训练参数头，使旧类索引具有监督语义锚定、新类索引仍可交换，但评估仍采用全局匈牙利匹配，可能导致旧类语义被错误重映射并掩盖误差，因此需要揭示并修正这一评估与优化不一致问题。

Result: 摘要指出全局匹配可造成新类准确率最高25.63个点的高估；在GH和SPE两种评估下实验验证了所提方法有效，但未在摘要中报告具体benchmark数值或明确SOTA水平。

Insight: 创新点在于识别部分可交换输出空间中的语义错映射现象，给出置换环条件解释其如何提高全局匹配分数，并提出SPE评估协议与MMO优化相结合，同时从理论上分析虚假准确率增益上界，体现了评估协议与训练目标一致性的重要性。

Abstract: Generalized Category Discovery (GCD) aims to perform old-category recognition and novel-category discovery in the same unlabeled set. Early methods address both objectives through clustering and evaluate the exchangeable predicted indices with global Hungarian (GH) matching. Recent methods adopt trainable parametric heads, using supervision for old-category recognition and discovery-oriented objectives for new categories. In this way, the output space becomes partially exchangeable: old indices are semantically anchored, while new indices remain exchangeable. However, these methods still apply global matching, which can reassign anchored old indices to other categories and hide some prediction errors. Empirically, we are surprised to observe that this reassignment can induce an overestimation of new-category accuracy by up to 25.63 points. We term this phenomenon semantic mismapping and further derive a permutation-cycle condition that characterizes when semantic mismapping can increase the global matching score. To fix this issue, we propose Semantics-Preserving Evaluation (SPE), which preserves the supervised semantics of old indices and restricts Hungarian matching to the new region. Furthermore, we propose Mismapping-Mitigating Optimization (MMO) to alleviate the prediction errors that can give rise to semantic mismapping, combining a region-balance loss (RBL) for old/new routing with a novel-diversity loss (NDL) that encourages orthogonality among new prototypes. Theoretically, we show that minimizing the two losses can tighten an upper bound on spurious accuracy gains from semantic mismapping, with controllable residual terms. Empirical results under both GH and SPE demonstrate the effectiveness of our proposed method.

[102] Diagnosing the Reference Gap: What Visual Scaffolds Can and Cannot Fix in Multimodal Reasoning cs.CV | cs.CLPDF

Guizhen Chen, Weiwen Xu, Wotao Yin, Anh Tuan Luu, Hou Pong Chan

TL;DR: 论文指出多模态大模型在视觉推理中的失败不一定源于感知，而是语言难以绑定到相关视觉实体、区域或位置，即“参考鸿沟”。作者构建ReGap-Bench配对基准，在五个视觉推理任务中固定场景、问题和答案，仅改变参考方式，发现任务匹配的外部参考（如编号）最多提升25%准确率，而不匹配参考收益很小甚至有害。

Details

Motivation: 多模态大模型能识别视觉内容却在多步推理中不可靠，例如计数时看见所有物体却丢失已计数的对象；论文试图说明这类问题常被误归因于感知，实际瓶颈是语言与视觉指代之间的绑定失败。

Result: 在ReGap-Bench的五个视觉推理任务上，任务匹配的参考可使准确率最多提升25%，而不匹配的参考几乎没有帮助，甚至降低性能。

Insight: 论文的创新点在于将“参考鸿沟”作为独立于视觉感知的推理瓶颈，并通过配对基准控制场景、问题和答案来验证参考方式的作用；其可借鉴之处是构造任务适配的视觉参考可作为免训练的视觉技能提升多模态推理。

Abstract: Multimodal large language models can recognize visual content yet struggle to reason reliably over it across multiple steps. In counting, a model may see all objects but lose track of which ones it has counted. We argue that such failures, commonly attributed to perception, reveal a reference gap: the failure to bind language to the relevant visual entities, regions, or locations. Motivated by the theory of visual routines, we test whether external references such as numbering can narrow this gap. We introduce ReGap-Bench, a paired benchmark of five visual reasoning tasks in which the scene, question, and answer are fixed and only the reference varies. Results show that task-matched references improve accuracy by up to 25%, while mismatched references provide little benefit or even hurt performance. These findings identify the reference gap as a bottleneck distinct from visual perception and show that constructing task-appropriate visual references can serve as a training-free visual skill for improving multimodal reasoning.

[103] FDSML: Formula-Driven Supervised Metric Learning with Parameter-Aware Triplet Loss cs.CV | cs.AI | cs.LG | cs.NEPDF

Hina Otake, Shinei Arakawa, Keitaro Tanaka, Yoshihiro Fukuhara, Hirokatsu Kataoka

TL;DR: 论文提出公式驱动监督度量学习FDSML，将无真实图像的公式驱动预训练从离散类别分类转为基于图像生成参数的关系监督。方法结合改进分形数据集FineFractalDB与参数感知三元组损失PA-Triplet，使嵌入学习尊重迭代函数系统参数空间中的相对相似性。实验表明该方法提升图像检索迁移能力，并在下游分类与鲁棒性上保持竞争力。

Details

Motivation: 现有FDSL预训练把生成过程离散化为分类标签，丢弃了生成参数中的连续关系信息。论文希望利用生成参数导出的关系监督，为识别之外的迁移任务提供更强的合成预训练信号。

Result: 在ResNet-50上，相比FDSL预训练，Stanford Online Products的Recall@1从65.6%提升到74.0%，Stanford Cars从56.2%提升到78.4%；同时下游分类具有竞争力，并在多种损坏设置下提升鲁棒性。

Insight: 创新点在于将FDSL从标签分类重构为度量学习，用IFS参数空间距离构造正负样本，并提出PA-Triplet损失和类内变化更高的FineFractalDB。客观来看，其可借鉴之处是把生成过程的连续参数作为关系监督，突破离散类别标签对预训练嵌入结构的限制。

Abstract: Formula-Driven Supervised Learning (FDSL) enables vision pre-training without real images, but existing methods cast pre-training as classification on discretized labels, discarding continuity in the generative process. We propose Formula-Driven Supervised Metric Learning (FDSML), which derives relational supervision from image-generation parameters beyond discrete class labels. FDSML combines FineFractalDB, our refined fractal dataset with higher intra-class variation and more stable structures, with a Parameter-Aware Triplet (PA-Triplet) Loss that assigns positives and negatives according to distances in the underlying Iterated Function System parameter space. This objective trains embeddings to respect parameter-derived relative similarity orderings. Experiments show that FDSML improves transferability to image retrieval while remaining competitive on downstream classification and improving robustness under several corruption settings. On ResNet-50, Recall@1 improves from 65.6% to 74.0% on Stanford Online Products and from 56.2% to 78.4% on Stanford Cars over FDSL pre-training. These results suggest that parameter-derived relational supervision provides a stronger synthetic pre-training signal than label-based classification for transfer beyond recognition.

[104] PathCowork: Learning from real-world pathology practice to build AI copilots cs.CVPDF

Sheng Wang, Jialu Yao, Maria V. Rossi, Shunsuke Koga, Esther Baranov

TL;DR: 论文提出 PathCowork 框架，将病理医生在阅片过程中的注视、口述和导航等多模态行为同步记录，转化为视觉定位与诊断流程监督，用于训练病理诊断 AI copilot。作者基于 16 位病理医生的 48 次、共 1028 分钟阅片数据，训练了服务器端 PathCowork-1T 和本地端 PathCowork-27B，并在多器官评估中验证其诊断辅助能力。

Details

Motivation: 现有医学 AI 多从医生记录的答案中学习，却很少学习医生如何解读证据并得出答案的过程。论文希望直接从真实病理临床实践中的透明推理过程获取监督，提升病理 AI 的视觉定位和诊断流程能力。

Result: 在五个器官特异性评估中，结合视觉定位与记录诊断流程的 agent 主任务分数平均比 Claude Code 和 Codex 分别高 17.9 和 24.1 个百分点，且处理时间更短、推理成本更低；在前列腺分级上，其提出的区域在有限切片标签下优于 SOTA 多实例学习 AI。

Insight: 创新点在于把病理医生的注视、口述与导航同步数据转化为过程级监督，训练视觉定位和可执行诊断流程，而非仅学习最终答案；同时可用于构建病理 AI benchmark，暴露模型在识别观察上下文和拒绝不适用前提方面的困难。

Abstract: Medical AI learns from the answers doctors record, but rarely from how they interpret the evidence to reach them. Here we introduce PathCowork, a framework that turns pathologists’ narrated examinations into supervision for visual grounding and procedures that guide diagnostic AI agents. Synchronized gaze, narration and navigation link visual findings to the process of interpreting them. Across 48 sessions from 16 pathologists, the platform captured 1,028 minutes of slide review. Using these data, we trained PathCowork-1T for server deployment and PathCowork-27B for local deployment, with improved visual grounding. Across five organ-specific evaluations, agents combining this grounding with recorded diagnostic procedures achieved primary task scores averaging 17.9 and 24.1 percentage points higher than Claude Code and Codex, respectively, with shorter processing times and lower inference costs. Compared to the state-of-the-art multiple-instance learning AIs, the PathCowork agent-proposed regions achieved higher prostate-grading scores with limited slide labels. PathCowork can also help construct pathology AI benchmarks where questions derived from the recordings identified difficulties in recognizing viewing context and rejecting inapplicable premises. In summary, PathCowork proposes a new paradigm to scale up the data collection and train pathology AI through transparent reasoning from diagnostic sessions, opening a path towards systems that learn directly from routine clinical practice.

[105] Calibrating Attention-Based Token Pruning for Efficient Multi-Image Synthesis in UMMs cs.CVPDF

Zimeng Wu, Qijian Tian, Penghui Du, Changqian Yu, Jiaxin Chen

TL;DR: 论文提出CATP，一种面向统一多模态模型（UMM）多图像合成的免训练上下文压缩方法，用于加速长视觉上下文下的推理。CATP在去噪过程中进行逐层token剪枝，并通过引导一致性剪枝、Taylor校准注意力度量和快速评分算子缓解现有剪枝方法在生成任务中的参考图像探索不足、条件引导混乱和池化歧义问题。

Details

Motivation: UMM多图像合成因长视觉上下文带来显著计算开销，而现有token剪枝方法多从理解任务适配，直接用于生成会导致质量下降。论文旨在为UMM生成设计更合适的免训练token剪枝，实现更好的质量-效率权衡。

Result: 在代表性UMM和多个benchmark上，CATP一致优于现有最先进token缩减方法，最高实现2.09倍attention-core加速。

Insight: 主要创新是首个面向UMM生成的免训练上下文压缩方法：用GCP同步条件分支剪枝决策，用TCAM对池化偏差做理论驱动的二阶校正，并用FSO将校准融入分块在线Softmax以降低剪枝成本。客观看，其价值在于针对多图生成的条件引导和池化偏差校准剪枝，而非简单迁移理解任务剪枝。

Abstract: Unified Multimodal Models (UMMs) enable powerful multi-image synthesis but incur substantial computation from long visual contexts. While token pruning offers a direct route to accelerating inference, existing methods are primarily adapted from understanding tasks, suffering from insufficient reference image exploration, confused conditional guidance, and pooling-induced ambiguity that degrades generation quality. To address these issues, we propose CATP, the first training-free context-compression method tailored to UMM generation, which \textbf{C}alibrates the discrepancies of general \textbf{A}ttention-based \textbf{T}oken \textbf{P}runing for better quality-efficiency trade-off. Concretely, building on independent layer-wise pruning during denoising, we introduce Guidance-Consistent Pruning (GCP) to synchronize pruning decisions across conditioning branches, and a Taylor-Calibrated Attention Metric (TCAM) that derives a theoretically grounded second-order correction for pooling-induced bias. In addition, a Fast Scoring Operator (FSO) fuses the calibration into tiled online Softmax to reduce pruning cost. Extensive experiments across representative UMMs and benchmarks demonstrate that CATP consistently outperforms state-of-the-art token-reduction methods, achieving up to 2.09$\times$ attention-core speedup.

[106] Regional Anchor Routing for Multi-Object Motion Transfer cs.CVPDF

Yuze Li, Fuchen Long, Xinlong Sun, Cheng Yan, Xinyu Zhang

TL;DR: 论文提出RART框架，用于多对象运动迁移。它从多个参考视频中提取各自对象的运动，并可靠地应用到目标场景中指定的对象上，解决了现有方法中运动分配错位和逐视频优化效率低的问题。RART将对象级运动提取、目标区域锚定和帧对齐注入统一到冻结的视频扩散Transformer中，无需针对每个参考视频重新优化，实验验证了其在运动保持、推理效率和组合泛化方面的优势。

Details

Motivation: 现有组合运动迁移方法难以将不同参考视频中的运动可靠地分配给正确的目标对象，容易导致运动干扰；同时，基于运动特定调优的方法在参考视频变化时需要重新优化，推理效率低。

Result: 实验表明，RART能够实现准确的运动保持、高效的推理以及强组合泛化能力，但摘要未提供具体定量结果或基准对比。

Insight: 论文的创新点在于：统一了对象级运动提取、目标区域锚定和帧对齐注入；引入掩码锚定运动token和帧对齐运动交叉注意力，使每个生成帧仅读取对应时间槽的运动token；设计运动注意力路由损失，减少对象间干扰。客观来看，其核心创新在于通过区域锚定和注意力路由实现运动与目标对象的精准绑定，并避免逐视频优化，提升了多对象运动迁移的效率和可靠性。

Abstract: Compositional motion transfer requires a model to extract motions from multiple reference videos, and apply each motion to a user-specified object in one target scene. Existing methods normally struggle to reliably assign different reference motions to the correct target objects, thus a motion intended for one object may affect another. Meanwhile, some motion-specific tuning approaches are still facing another issue: they must run a new optimization whenever the reference video changes, making repeated transfers inefficient. To address these limitations, we propose RART, a framework that unifies object-wise motion extraction, target-region anchoring, and frame-aligned injection into a frozen video Diffusion Transformer for multi-object motion transfer. For each reference motion, RART extracts temporally ordered features from the masked reference video, and then conditions them on the target first-frame mask to form mask-anchored motion tokens. Frame-aligned motion cross-attention allows each generated frame to read only the motion tokens at the corresponding time slots, composing all object motions in one denoising process. During training, a motion-attention routing loss encourages each target region to attend to its corresponding motion tokens and reduces interference between objects. Therefore, RART can handle novel reference-target combinations without per-video optimization. Experiments show that RART achieves accurate motion preservation, efficient inference, and strong compositional generalization.

[107] Robust LIDAR Sensor-to-Sensor Domain Generalization via Accumulated-Point Scene Completion cs.CVPDF

Christoph B Rist, Larissa T Triess, Markus Enzweiler, Dariu M Gavrila

TL;DR: 论文研究LiDAR语义分割中的传感器到传感器域泛化问题，提出一种仅使用源域数据的训练方案：将源域多帧扫描累积为简单世界模型，并加入占用预测辅助目标，以增强监督信号。模型训练和测试仍只输入单帧LiDAR点云，不改变输入形式，也不依赖目标域数据或传感器先验。实验表明，在多个不同LiDAR数据集上，该方法可提升对未见传感器的泛化能力，同时保持有竞争力的源域分割性能且不增加推理开销。

Details

Motivation: 真实LiDAR数据存在传感器特定的采样模式，导致在3D点云上表现良好的深度网络难以迁移到未见过的新传感器。论文希望模型在无法获取新传感器数据或标签的情况下，也能直接部署并保持良好性能。

Result: 在多个不同LiDAR数据集上的实验表明，监督方式会显著影响模型对新域的泛化；在某些设置下，该方法无需目标域扫描、目标标签、传感器先验或预测后处理，即可提升未见域性能，同时保持有竞争力的源域分割表现，且不增加额外推理成本。

Insight: 创新点在于用累积点云构建源域世界模型，并以占用预测作为辅助监督，在不改变单帧输入的前提下丰富监督信号；辅助头可在部署时丢弃或保留以同时输出场景补全。客观来看，该方法把多帧累积几何作为免费监督，促使模型学习更传感器不变的几何/占用表征，是一种简单、无需目标数据且易部署的域泛化思路。

Abstract: We study domain generalization for LIDAR semantic segmentation. Deep neural networks achieve strong performance on 3D point clouds, yet real-world LIDAR exhibits sensor-specific sampling patterns that hinder transfer across datasets. In many applications, performance on completely unseen sensors is crucial. A model should preferably work on a new setup without prior access to its data or labels. To this end, we introduce a source-only training scheme that adds an occupancy prediction auxiliary objective. We aggregate source-domain scans into a simple world model and use it as the supervision signal, replacing single-scan standard segmentation training. A key property of our approach is that it does not alter the input scan. During training and testing the network consumes the same single-frame LIDAR input, only the supervision signal is enriched via the occupancy objective. At deployment, there is no runtime overhead as the auxiliary head can be dropped for pure segmentation, or kept to obtain scene completion alongside semantic segmentation. In an experimental evaluation across distinct LIDAR datasets, we demonstrate that a model’s generalization to new domains can be significantly affected by how it is supervised. In certain setups, performance on unseen domains improves without any explicit domain adaptation (no target scans, no target labels, no sensor priors) and without prediction refinement. At the same time, our method maintains competitive source-domain segmentation performance and incurs no additional inference cost.

[108] MorphSIG: Subject-Driven Image Generation via Decoupled Anchoring and Feature Transport cs.CVPDF

Hailong Yan, Yongrui Zhang, Xiangtao Zhang, Le Zhang

TL;DR: MorphSIG是一个无需训练的框架，将主题驱动图像生成（SIG）重新表述为伪视频特征传输。它包含两个核心模块：渐进解耦锚定（利用频域解耦和结构打乱打破结构锁定，实现从自由构图到身份对齐的渐进过渡）和伪光流引导特征传输（构建潜在空间伪光流场以模拟视频时间一致性，精确传输主题语义）。此外，论文还引入了一个包含多样风格化主题的新基准。实验表明，MorphSIG在无需额外训练的情况下显著提升了姿态多样性和主题保真度。

Details

Motivation: 现有主题驱动图像生成方法存在结构锁定导致姿态多样性不足，以及基准风格同质化和缺乏真实标签的问题。论文旨在无需训练的前提下，提高生成图像中主题的姿态多样性和身份保真度，并提供更全面的评估基准。

Result: 大量实验表明，MorphSIG在无需额外训练的情况下，相比基线显著提高了姿态多样性和主题保真度。论文还提出了一个包含多样风格化主题的新基准，以更全面地评估主题驱动图像生成。

Insight: 论文的创新点包括：将SIG重新表述为伪视频特征传输，借鉴视频生成中的时序一致性思想；提出渐进解耦锚定，通过频域解耦和结构打乱在早期去噪中打破结构锁定；设计伪光流引导特征传输，在潜在空间构建伪光流场以精确传输主题语义。客观分析，其创新在于无需训练地桥接静态生成与动态传播，以低成本实现高保真主题一致性，并引入多样风格化基准推动评估更全面。

Abstract: We propose MorphSIG, a training-free framework that reformulates subject-driven image generation (SIG) as pseudo-video feature transport. MorphSIG contains two core modules: Progressive Decoupled Anchoring, which uses frequency-domain decoupling and structural scrambling during early denoising to break structural locking and enable a gradual transition from free composition to identity alignment; and Pseudo-flow Guided Feature Transport, which constructs a latent-space pseudo-flow field to mimic Image-to-Video temporal coherence and transport subject semantics precisely. To address stylistic homogeneity and the lack of ground truth in existing benchmarks, we further introduce a benchmark with diverse stylized subjects. Extensive experiments show that MorphSIG significantly improves pose diversity and subject fidelity over baselines without additional training. Overall, MorphSIG bridges static generation and dynamic propagation, providing a cost-effective paradigm for high-fidelity subject consistency.

[109] Comprehensive empirical evaluation of feature extractors in computer vision cs.CV | cs.LGPDF

Murat Isik

TL;DR: 论文对SIFT、SURF、BRIEF、ORB、BRISK、KAZE、AKAZE、FREAK、DAISY、FAST、STAR等传统特征检测与描述子进行了大规模实证评估，分析其架构设计和复杂度对计算效率及多种图像变换下鲁棒性的影响。实验基于Image Matching Challenge Photo Tourism 2020数据集，包含超过150万张图像和超过200万次比较，给出了不同场景下的特征提取器与匹配器选型建议。

Details

Motivation: 传统特征检测与匹配是计算机视觉的基础组件，但不同方法在计算效率和多种图像变换条件下的鲁棒性缺乏系统、全面的实证比较，论文旨在为方法选择和实际应用提供依据。

Result: FAST检测器搭配ORB描述子和Brute-Force匹配器在特征提取与匹配速度上最快；ORB在仿射变换和增亮图像上表现较好，AKAZE在模糊、鱼眼畸变、图像旋转和透视畸变条件下更优；论文通过超过200万次比较识别了在旋转、缩放、模糊、增亮、仿射、透视、鱼眼和椒盐噪声等条件下更具鲁棒性的特征提取器。

Insight: 论文的主要创新在于大规模、多方法、多变换条件的系统性实证评测，而非提出新的特征提取算法；其价值在于基于超150万图像和超200万次比较给出传统特征提取器在不同场景下的效率与鲁棒性画像，可作为实际视觉系统的选型参考。

Abstract: Feature detection and matching are fundamental components in computer vision, underpinning a broad spectrum of applications. This study offers a comprehensive evaluation of traditional feature detections and descriptors, analyzing methods such as Scale Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), Binary Robust Independent Elementary Features (BRIEF), Oriented FAST and Rotated BRIEF (ORB), Binary Robust Invariant Scalable Keypoints (BRISK), KAZE, Accelerated KAZE (AKAZE), Fast Retina Keypoint (FREAK), Dense and Accurate Invariant Scalable descriptor for Yale (DAISY), Features from Accelerated Segment Test (FAST), and STAR. Each feature extractor was assessed based on its architectural design and complexity, focusing on how these factors influence computational efficiency and robustness under various transformations. Utilizing the Image Matching Challenge Photo Tourism 2020 dataset, which includes over 1.5 million images, the study identifies the FAST algorithm as the most efficient detector when paired with the ORB descriptor and Brute-Force (BF) matcher, offering the fastest feature extraction and matching process. ORB is notably effective on affine transformed and brightened images, while AKAZE excels in conditions involving blurring, fisheye distortion, image rotation, and perspective distortions. Through more than 2 million comparisons, the study highlights the feature extractors that demonstrate superior resilience across various conditions, including rotation, scaling, blurring, brightening, affine transformations, perspective distortions, fisheye distortion, and salt-and-pepper noise

[110] BEACON: Distilled Begin/End-Aware Structured Decoding for Continuous Sign Language Segmentation cs.CVPDF

Guohou Zhang, Kalin Stefanov

TL;DR: 论文提出 BEACON，用于连续手语分割的 begin/end 感知结构化解码器，结合四类 BIOE 标注、8 种合法转移约束的 Viterbi 解码，以及从二分类教师蒸馏边界知识到共享学生模型。论文在 PHOENIX-14 和 BSL Corpus 上验证其分割质量和下游识别效果，并分析不同分割指标与下游 WER 的相关性。

Details

Motivation: 现有连续手语分割通常以局部边界检测为评价标准，但分割本质上是为下游手语识别服务，局部边界准确率未必能反映词法片段质量和识别收益。论文希望提升分割对下游识别的实用性，并重新审视更合适的分割评价指标。

Result: 在严格 no-cut 评估和基于验证集的模型选择下，BEACON 相对 SOTA 在 PHOENIX-14/BSL Corpus 上分别提升 segment-F1 14.58/14.59 点、boundary-F1 2.17/1.22 点，并降低下游 WER 9.10/4.15 点；相关性分析显示 segment-F1 比 boundary-F1 与更低 WER 更一致。

Insight: 创新点在于将 BIOE 四类标注、受约束的 Viterbi 结构化解码和边界知识蒸馏结合，用于连续手语分割；同时通过多架构实验指出应更关注 segment 质量和下游识别效用，而非仅看局部边界准确率。

Abstract: In segmentation-based continuous sign language recognition, an untrimmed video is first partitioned into lexical units; segmentation is therefore a means to an end—downstream recognition. However, segmenters are usually judged by local boundary detection rather than by the quality of the lexical segments and the recognition they enable. We present BEACON, a begin/end-aware segmenter that combines four-class Outside/Begin/Inside/End (BIOE) labeling, constrained Viterbi decoding over eight legal transitions, and boundary knowledge distilled from a binary teacher into a shared student. Under strict no-cut evaluation with validation-based model selection, BEACON improves segment-F1 by 14.58/14.59 points and boundary-F1 by 2.17/1.22 points, and reduces the downstream word error rate (WER) by 9.10/4.15 points relative to the state-of-the-art in the PHOENIX-14/BSL Corpus. To examine which segmentation metric better reflects downstream recognition, we evaluated five distinct architecture families. Segment-F1 aligns more consistently with lower WER than boundary-F1 in both corpora (Spearman $ρ=-1.0/-0.9$ versus $-0.9/-0.8$). These results support evaluating sign language segmentation in terms of segment quality and downstream recognition utility rather than local boundary accuracy alone.

[111] TactoHand: Learning Geometry-Based Dense Hand-Surface Interaction Fields from Video cs.CVPDF

Ziheng Xi, Weibo Li, Jiayi Yu, Sipeng Zheng, Wanpeng Zhang

TL;DR: TactoHand 提出从单目视频中预测手表面的三种密集交互场：接触、接近和3D力，从而避免大规模采集触觉数据。方法构建约5000万源帧数据，利用几何信息生成接触/接近标签、由运动生成力标签，并用时序Transformer聚合视觉证据、三个可学习查询解码对应场，同时以可微物理层约束力预测。

Details

Motivation: 研究出发点是人类手-物交互需要手表面的密集物理交互表示，但真实触觉传感数据依赖专用硬件、难以规模化采集。论文希望仅从单目视频低成本、可扩展地学习手-表面交互场。

Result: 在域内和域外benchmark上，TactoHand 对手面接触和接近估计优于先前方法；物理监督降低了运动rollout的位置和旋转误差；预测的接触与接近场还能提升下游手-物重建。

Insight: 创新点在于将几何导出的接触/接近标签与运动导出的力标签结合，用视频监督学习密集手-表面交互场，并引入可微物理层约束力预测。客观看，其可扩展、低成本的数据与学习路径以及面向下游重建的验证具有借鉴价值。

Abstract: Understanding how humans interact with the world requires a representation of physical interactions at the hand surface. Tactile sensing captures these interactions, but collecting tactile data at scale requires specialized hardware. We introduce TactoHand, a model that predicts three dense hand-surface interaction fields—contact, proximity, and 3D force—from monocular video. We derive geometry-based contact and proximity labels and motion-derived force labels from eligible training data within a curated collection spanning approximately 50 million source frames. TactoHand uses a temporal transformer to aggregate visual evidence across frames, while three learned queries decode the corresponding hand-surface fields. A differentiable physics layer further constrains force predictions using observed object motion. Across in-domain and out-of-domain benchmarks, TactoHand improves contact and proximity estimation over prior methods. In addition, physics supervision reduces position and rotation errors in motion rollouts, and the predicted contact and proximity fields improve downstream hand-object reconstruction. Together, these results show a scalable, low-cost path to learning hand-surface interaction fields without collecting tactile measurements. Code will be released at https://github.com/zhenqis123/Tactohand.

[112] Evaluating Cultural Knowledge Editing in Vision-Language Models cs.CV | cs.CLPDF

Malvina Nikandrou, Georgios Pantazopoulos, Ioannis Konstas, Alessandro Suglia

TL;DR: 论文研究视觉语言模型中的文化知识编辑问题，提出 CulturalBind 基准（3.2K 图像、1K 概念、6 个领域），用于评估跨模态文化知识和概念级知识编辑。实验发现模型文本文化知识与视觉识别脱节，现有编辑方法虽能纠正单个视觉错误，但跨模态迁移性差，且在顺序编辑下性能快速下降。

Details

Motivation: 现有 VLM 常无法识别文化特定概念，尤其是欠代表地区，如何将这类长尾知识注入模型仍是挑战；论文探索知识编辑作为针对性替代方案。

Result: 在 CulturalBind 上，编辑前模型表现出文本与视觉知识解耦；单次编辑可修正个体视觉识别错误，但跨模态可迁移性低，难以融入模型整体参数知识；顺序编辑下性能迅速退化。

Insight: 创新点在于构建面向文化概念的多模态知识编辑基准，并系统评估单次/顺序编辑场景；客观看，其价值在于揭示文本-视觉知识解耦及编辑方法在多模态长尾知识整合上的局限。

Abstract: Current Vision-Language Models (VLMs) frequently fail to recognize culture-specific concepts, especially from underrepresented regions. Effectively injecting this long-tail knowledge into existing models remains a challenge. In this work, we investigate knowledge editing as a targeted alternative by introducing CulturalBind, a benchmark comprising 3.2K images of 1K concepts from 6 domains, designed to evaluate culture-aware cross-modal knowledge as well as concept-level knowledge editing in VLMs. Pre-edit evaluation reveals that textual and visual knowledge is decoupled: models often demonstrate text-based knowledge of cultural concepts but fail to identify them from images. We then evaluate editing methods in single and sequential scenarios. Although current methods successfully correct individual visual recognition errors, they exhibit low cross-modal portability, failing to integrate edits into the model’s broader parametric knowledge. Furthermore, performance degrades rapidly under sequential editing, highlighting the need for comprehensive adaptation approaches that better consolidate multimodal knowledge over time.

[113] DiFuse: Fusing Native Diffusion Representations for Spatial Reasoning in Unified Multimodal Models cs.CVPDF

Ruixin Fan, Weining Wang, Jiahui Sun, Tailai Chen, Jing Liu

TL;DR: 论文提出 DiFuse，将统一多模态模型中原生扩散分支的中间表示选择性注入理解通路，以增强空间推理。方法通过逐层分析确定最有信息量的扩散表示及最佳注入位置，将扩散特征与视觉 token 空间对齐后，以残差融合方式注入多模态解码器层。实验表明其在不显著损害通用多模态理解的情况下提升空间推理能力。

Details

Motivation: 现有统一多模态模型中，理解表示常用于条件生成，而生成/扩散表示很少被复用于多模态推理，信息流存在不对称。论文希望在不损害通用理解的前提下，利用扩散分支的中间表示补充空间推理所需线索。

Result: 在 UniWorld-V1 上，DiFuse 相比匹配的 SFT 基线持续提升空间推理，同时在通用多模态基准上保持大致相当的性能；消融分析表明增益关键依赖扩散表示选择、注入位置及扩散特征与视觉 token 的空间对应关系。OmniGen2 上的结果进一步证明其可迁移到其他统一多模态架构。

Insight: 创新点在于将 UMM 原生扩散分支的中间特征作为空间线索，并通过结构保持的选择性残差融合接入理解通路。客观看，其价值在于系统分析“用哪层扩散表示、注入到哪里、如何保持空间对齐”，为统一多模态模型中生成表示反哺推理提供了可迁移的融合范式。

Abstract: Unified multimodal models (UMMs) jointly support visual understanding and image generation, yet information flow between these two capabilities remains largely asymmetric: understanding representations routinely condition generation, whereas generative representations are rarely reused for multimodal reasoning. In this work, we investigate whether intermediate representations from a UMM’s native diffusion branch can enhance spatial reasoning without compromising general multimodal understanding. We propose DiFuse, which selectively incorporates intermediate diffusion representations into the understanding pathway of UMMs. Through systematic layer-wise analysis, we identify which diffusion representations are most informative and where they can be integrated with minimal interference to semantic processing. Guided by these findings, DiFuse spatially aligns diffusion features with visual tokens and injects them into selected multimodal decoder layers via residual fusion. Extensive experiments on UniWorld-V1 show that, DiFuse consistently improves spatial reasoning over a matched SFT baseline while maintaining broadly comparable performance on general multimodal benchmarks. Further analyses show that these gains depend critically on the choice of diffusion representations, injection positions, and the preservation of spatial correspondence between diffusion features and visual tokens. Results on OmniGen2 further demonstrate the transferability of DiFuse across unified multimodal architectures. Overall, our findings show that native diffusion representations can provide complementary spatial cues for multimodal reasoning when selectively integrated in a structure-preserving manner.

[114] FutureWorld: A Plug-and-Play Causal Next-State Predictor for Interactive Video World Exploration cs.CVPDF

Guangyuan Li, Kelu Yao, Shuolin Xu, Xinlei Yu, Wei Xing

TL;DR: 论文面向交互式视频世界模型，指出现有基于历史潜变量复用的方法会因模糊细节、几何畸变、语义漂移及错误反复进入历史而导致误差循环累积。为此提出可插拔的因果下一块预测器 C-NCP，在生成下一交互视频块前，根据当前生成潜变量和下一动作预测未来场景状态，并用该未来状态先验引导后续生成，以提升长时程一致性和减少误差累积。

Details

Motivation: 交互式视频世界模型需要跟随用户动作并保持长时场景一致性，但历史复用会把已有生成误差带入后续片段并反复强化，形成误差再循环。论文希望在未来视频块生成前引入未来状态预测，减少从历史继承的错误。

Result: 作者将 C-NCP 集成到四个基础生成器中，并在三个交互式长视频生成与动作条件世界建模基准上评估。实验表明方法可减少误差累积并提升长时程一致性，但摘要未给出具体数值或明确 SOTA 结论。

Insight: 创新点在于将历史复用范式转为未来状态先验引导：用当前潜变量和下一动作预测下一块场景状态，并通过跨模型适配和预测引导调制实现即插即用。客观看，其价值在于以轻量模块打断误差再循环，并可适配多种生成器，强调长时交互中的因果预测与生成引导。

Abstract: Interactive video world models aim to follow user actions while maintaining scene consistency over extended interactions. History-based methods reuse generated latents to preserve scene content, but three limitations of this reuse contribute to error recirculation. 1) The latent generated at each interaction is retained as history, potentially containing blurred details, geometric distortions, or semantic drift. 2) Although retrieved historical content matches the current scene, it can still contain errors that are carried into the next chunk. 3) New outputs then become history for later interactions, potentially reinforcing the same errors through repeated reuse. To limit this cycle, we aim to predict the future scene state from the current generated latent and the next action before generating the next interaction’s video chunk. This future-state prior provides guidance for the next chunk, with the aim of reducing the errors carried forward from history. To this end, we propose a plug-and-play Causal Next-Chunk Predictor (C-NCP) with cross-model adaptability and prediction-guided modulation. We integrate C-NCP into four base generators and evaluate the augmented models across three benchmarks for interactive long-video generation and action-conditioned world modeling. Extensive experiments demonstrate reduced error accumulation and improved long-horizon consistency across diverse generation settings. The project page is at https://GuangYuanKK.github.io/futureworld.

[115] Intrinsic Distribution Matching cs.CV | cs.AIPDF

Deyuan Liu, Yansen Han, Kaiwen Zheng, Jun Xie, Jiacheng Liu

TL;DR: 论文提出内在分布匹配（IDM），用于单步/少步文本到图像生成。它在DMD分数差监督基础上，将反向KL场分解为高斯矩分量和非高斯残差，并显式匹配生成器EMA特征的一阶均值与逐坐标标准差，以提升少步生成对提示词细节的还原。方法无需外部特征编码器，在Z-Image-Turbo 6B和Qwen-Image 20B上验证了全参数与LoRA微调效果。

Details

Motivation: 少步/单步T2I在细化机会有限时仍需准确呈现提示词细节；DMD依赖分数差将生成分布拉近参考分布，论文探究显式矩约束能否改进这种学习到的分数监督。

Result: 在2次网络评估下，IDM在中文和英文LongText-Bench分别达到94.25%和90.20%，为该预算下对比方法最高；消融显示矩损失带来增益，且生成器EMA特征在五项指标上与外部DINOv2编码器表现相当。

Insight: 创新在于将反向KL场显式分解为高斯矩项与非高斯残差，在保留完整DMD校正的同时加入均值/标准差匹配；并利用生成器EMA副本提供特征统计，避免额外外部编码器，降低依赖且具竞争力。

Abstract: One-step and few-step text-to-image generation must accurately render the details specified in the prompt despite limited opportunities for refinement. Distribution matching distillation (DMD) uses score differences to bring the generated distribution closer to a reference distribution. Following prior work, we estimate this difference with internal velocity branches, avoiding a separate fake-score network. We ask whether an explicit moment constraint improves this learned score supervision. A decomposition of the reverse-KL field into a Gaussian moment component and a non-Gaussian residual identifies statistics that can be constrained explicitly. We introduce Intrinsic Distribution Matching (IDM), which retains the full DMD correction and matches feature means and per-coordinate standard deviations using the generator’s exponential-moving-average (EMA) copy, requiring no external feature encoder. Experiments use full-parameter and low-rank adaptation (LoRA) tuning on Z-Image-Turbo 6B and Qwen-Image 20B. At two network evaluations, IDM reaches 94.25% and 90.20% on Chinese and English LongText-Bench, the highest scores among the compared methods at this budget. Controlled ablations show gains from the added moment loss, while generator EMA features perform competitively with an external DINOv2 encoder across the five reported metrics. Code is available at https://github.com/inclusionAI/IDM.

[116] Where Do Vision Language Models Fail at 3D Reasoning? cs.CV | cs.AIPDF

Khai Le-Duc, Nguyen Kim Hai Bui, An Ngo, Nam D. Hoang, Yueqi Song

TL;DR: 论文系统刻画视觉语言模型在3D推理中的失败模式，提出受控基准BedBench，包含13个程序生成任务，覆盖单项判断与复合精确答案。作者评测12个开源权重模型和4个前沿模型，发现模型在逐颜色计数等精确属性恢复与一致使用上存在巨大差距，并主张从精确正确性、答案一致性和图像依赖性三方面评估3D推理。

Details

Motivation: 视觉语言模型可能在某些单项判断上表现正确，却无法恢复并一致使用3D物体的精确属性；论文旨在刻画这一差距并定位失败发生在属性恢复还是属性使用阶段，而非仅看整体准确率。

Result: 在逐颜色计数任务上，人类准确率为93.3%，最佳模型仅7.2%；针对性微调可将某模型从3.0%提升至68.6%，但其对最常见颜色的回答仍与自身逐颜色计数不一致。探测Qwen3.5-27B显示逐颜色计数在语言模型输入处可恢复率达65.0%，但模型回答仅3.0%；推理、扩展和视觉提示能改善单项判断，却不能保证精确答案可靠，图像移除控制还表明部分表面成功不依赖视觉证据。

Insight: 创新点在于构建受控3D推理基准并区分单项判断与复合精确答案，揭示“能恢复属性”不等于“能一致使用属性”，并结合探针与图像移除控制分析失败来源。可借鉴之处是采用精确正确性、内部一致性和图像依赖性作为多维度评测标准，以更严格评估视觉语言模型的3D推理能力。

Abstract: Vision-language models can get individual judgments right while struggling to recover and consistently use the exact properties of a 3D object. To characterize this gap, we introduce BedBench, a controlled benchmark of thirteen procedurally generated tasks spanning individual judgments and composite answers. Across twelve open-weight and four frontier models, per-color counting exposes a pronounced weakness: humans achieve 93.3% accuracy, compared with 7.2% for the best model. Targeted fine-tuning raises one model’s accuracy from 3.0% to 68.6%, but reveals a further difficulty: its answers about the most common colors remain inconsistent with its own per-color counts. Supplying those counts as text improves its judgments, showing that recovering a property does not mean using it consistently. Reasoning, scaling, and added visual cues each improve individual judgments, but none makes exact answers reliable. To locate the difficulty, we probe Qwen3.5-27B: exact per-color counts remain recoverable at the language model’s input, yet the model’s answers rarely recover them (65.0% for the probe vs. 3.0% for the model). Image-removal controls further show that some apparent successes require no visual evidence. These findings motivate evaluating 3D reasoning by exact correctness, consistent use, and image dependence, rather than accuracy alone. Code and dataset are publicly available: https://github.com/leduckhai/BedBench

[117] Annotation-Free Representation Learning for Polyp Retrieval in Colonoscopy Videos cs.CVPDF

Luca Parolari, Lamberto Ballan, Carlo Biffi, Loic Le Folgoc

TL;DR: 论文提出一种无需人工标注的表示学习框架，直接从原始结肠镜视频构建息肉 tracklet 视图，并利用时间自监督学习获得用于息肉检索与重识别的表示。该方法无需边界框标注，且可在包含无息肉帧的全流程视频上训练；在 REAL-Colon 上取得 tracklet retrieval 和 re-identification 的 SOTA，并引入更贴近临床的 few-shot 息肉检索任务。

Details

Motivation: 结肠镜视觉评估常需比较不同视角和成像条件下的互补视图，因此需要可靠的息肉 tracklet 表示；现有对比学习方法虽利用时间线索，但仍依赖人工标注边界框，限制了数据规模和临床部署。论文旨在消除标注依赖并充分利用全流程视频。

Result: 在 REAL-Colon 上，方法的 tracklet retrieval 和 re-identification 达到 SOTA，优于自监督和监督基线；在 few-shot 息肉检索中，仅用 2 个示例即超过多数使用 10 个示例的竞争方法，且少量无标注 procedure 即可获得有竞争力的性能。

Insight: 创新点在于无需边界框即可从原始视频构造 tracklet 视图，并利用包含无息肉帧的全流程视频进行时间自监督学习；同时提出 few-shot 息肉检索任务，更贴近临床使用场景，并降低现场模型开发对标注数据的依赖。

Abstract: Colonoscopy is inherently comparative: reliable visual assessment of polyps often depends on complementary views acquired under different viewpoints and imaging conditions. Retrieving such views requires polyp tracklet representations, which recent contrastive methods learn from temporal cues but still build from manually annotated bounding boxes. We propose an annotation-free framework that constructs tracklet views directly from raw colonoscopy videos, enabling temporal self-supervised learning on full-procedure videos, including frames without visible polyps. On REAL-Colon, our method achieves state-of-the-art results on tracklet retrieval and re-identification, outperforming both self-supervised and supervised baselines. We then introduce few-shot polyp retrieval, a task closer to clinical use, where a few observations of a target polyp are used to retrieve its remaining tracklets: with only two examples, our method surpasses most competing methods given ten. Finally, we show that a modest number of unlabeled procedures suffices for competitive performance, making on-site model development more practical. Code is available at https://github.com/lparolari/freerep.

[118] Look at Where You Think: Localization-Head Alignment for Fine-Grained Perception in Thinking VLMs cs.CVPDF

Yuan Wang, Wei Wu, Hongning Wang

TL;DR: 论文研究思维视觉语言模型在推理数千token后仍漏掉高分辨率图像细节的问题，发现瓶颈在于少数“定位头”对视觉证据的选择而非视觉感知本身。提出定位头对齐（LHA），在SFT和RL训练中将推理提到的视觉事实与定位头的注意力区域对齐，作为辅助损失。在V*、HR-Bench 4K和TreeBench上，LHA将Qwen3.5-4B准确率从74.1%提升到76.6%，为最佳单次推理4B结果，并缩短20%推理长度。

Details

Motivation: 现有思维VLM推理很长但仍忽略高分辨率小细节；缩放方法需要额外推理开销，结果奖励也无法告诉模型应关注哪里。论文旨在解决视觉证据选择瓶颈，让模型在推理时看向正确区域。

Result: 在V*、HR-Bench 4K和TreeBench上，LHA使Qwen3.5-4B从74.1%提升至76.6%，超过多轮缩放方法和已发布7B模型，为最佳单次4B结果；仅对齐比相同训练加1.8点并缩短推理20%，且可迁移到Qwen2.5-VL-3B。消融4个定位头比消融4个随机头多损失13.2点。

Insight: 创新点在于识别出少量定位头负责从大量视觉token中选择证据，并将注意力作为训练信号，与推理中陈述的视觉事实对齐。客观看，其创新是将可解释性发现转化为轻量辅助损失，无需额外推理pass，同时提升细粒度感知与推理效率。

Abstract: Thinking vision-language models reason for thousands of tokens, yet still miss small details in high-resolution images. Zooming methods pay for extra inference passes, and outcome rewards never tell the model where to look at. In Qwen3.5-4B, we find that the bottleneck is selection, not seeing: a few attention heads, which we call localization heads, pick the evidence out of thousands of visual tokens; ablating four of them costs 13.2 points more than ablating four random heads, and their focus fades as the reasoning grows. We therefore propose Localization-Head Alignment (LHA), which makes attention a training signal: whenever the reasoning states a visual fact, these heads learn to look at the focal region rather than the background, as an auxiliary loss in both SFT and RL training. On benchmarks of V*, HR-Bench 4K and TreeBench, LHA lifts Qwen3.5-4B from 74.1% to 76.6% accuracy, the best single-pass 4B result we evaluate, ahead of multi-pass zooming and released 7B models. Alignment alone adds 1.8 points over otherwise identical training while shortening reasoning by 20%, and the gains carry over to Qwen2.5-VL-3B.

[119] AB-Attention: Accurate Block Attention for Accelerating Video Diffusion Transformers cs.CVPDF

Bin Xu, Mo Zhang, Zhengfeiyang Zhang, Xinfeng Yang, Yixing Ma

TL;DR: 论文提出免训练的 Accurate Block Attention（AB-Attention），用于加速视频扩散 Transformer 推理。该方法通过块内聚类选择器、包含概率加权采样和细粒度核聚合，在高稀疏度下更准确地近似稠密 3D 注意力，从而显著减少注意力计算并实现端到端加速。

Details

Motivation: 视频扩散 Transformer 的 3D 全注意力二次成本主导推理开销；现有动态块稀疏注意力在激进稀疏下保真度下降，存在粗粒度评分、昂贵全局聚类、剪枝块从 softmax 消失以及整 tile 保留/丢弃过于粗糙等问题。论文旨在高稀疏条件下仍能准确近似稠密注意力，且无需训练。

Result: 在 Wan2.1 和 HunyuanVideo 上，AB-Attention 跳过 89%–92% 的注意力计算，而基线计算量约为其 1.8–3.6 倍；相比最强基线 PSNR 最高提升 4.4 dB，并实现最高 2.23 倍端到端加速。

Insight: 创新点包括：IBCS 在查询块内部聚类以低成本可靠估计块重要性且不重排 token；SIP 按包含概率采样块并用逆概率重加权，以单次估计稠密注意力而非直接截断；核实现将小于 tile 的 K/V 块聚合成完整 tensor-core tile，在不增加 tensor-core 成本下细化选择。客观上看，其价值在于免训练、高稀疏下降低估计偏差并提升选择粒度，实现较好的精度-效率权衡。

Abstract: Video diffusion transformers generate high-quality videos, but the quadratic cost of 3D full attention dominates their inference. Dynamic block-sparse attention reduces this cost by computing exact attention only on key/value blocks selected from current activations. However, its fidelity degrades under aggressive sparsity: blocks are scored from coarse summaries or formed by costly global clustering, pruned blocks vanish from the softmax, and whole tiles are kept or dropped even when only a few of their keys matter. To address these limitations, we propose Accurate Block Attention (AB-Attention), a training-free method that accurately approximates dense attention at high sparsity. Its Intra-Block Clustering Selector (IBCS) estimates block importance faithfully yet cheaply by clustering queries only within each query block, without permuting tokens. Sampling with Inclusion-Probability Weighting (SIP) then samples blocks in proportion to these estimates and reweights them by inverse inclusion probability, so that one pass estimates dense attention rather than truncating it. Finally, its kernel gathers key/value blocks much smaller than a tile into full tensor-core tiles, refining selection at no extra tensor-core cost. On Wan2.1 and HunyuanVideo, AB-Attention skips 89–92% of attention, whereas the baselines compute 1.8–3.6$\times$ as much, yet it still improves PSNR by up to 4.4~dB over the strongest baseline and achieves up to 2.23$\times$ end-to-end speedup. Our code is available at https://github.com/InfRec-Cardinal/AB-Attention.

[120] EditAgent: Rethinking Agentic Image Editing cs.CVPDF

Haiyang Xu, Tianyu Wang, Jialu Li, Jiteng Mu, Yuanjun Xiong

TL;DR: 论文提出EditAgent，重新思考智能体式图像编辑。针对现有智能体在步骤失败后只能在有限工具内重试、且评判器仅凭肉眼打分的问题，EditAgent同时扩展动作空间和观测空间：将每步路由到通用编辑器与专用方法，并为候选结果附加验证记录，再通过并行生成候选和一次性列表式评判来选择结果。

Details

Motivation: 现有智能体式图像编辑受限于两个空间：智能体能执行的动作空间，以及评判器能看到的观测空间；导致复杂请求中通用编辑器常无可用的结果，且单一评判器难以可靠覆盖不同编辑类型。

Result: 在专家标注benchmark上，通用编辑器超过40%的案例无可使用结果；结合验证记录后，现成VLM评判器优于微调奖励模型。专家在78.5%的已决比较中更偏好该并行列表评判方案，且评判调用不超过顺序细化的一半；方法在三个benchmark上提升两个开源权重编辑器，并可作为训练更强编辑器的数据引擎。

Insight: 创新点在于同时扩展动作空间与观测空间：用路由整合通用与专用编辑方法，用验证记录增强评判依据，并以并行候选生成加列表式评判替代低效顺序重试；这为智能体图像编辑提供了可扩展的评判与数据生产范式。

Abstract: Agentic image editors decompose complex requests into steps, but when a step fails, they mostly retry with the same narrow set of tools and a judge that scores each output by eye directly. We argue that such agents are bounded by two spaces: the action space of what the agent can do, and the observation space of what its judge can see. On our expert-annotated benchmark, a general-purpose editor yields no usable result in over 40% of the cases, and no judge is reliable across edit types. We present EditAgent, which expands both spaces. It routes each step to general editors and specialized methods, and attaches to each candidate a verification record. With these records, off-the-shelf VLM judges outperform finetuned reward models. Candidates are generated in parallel and judged in one listwise call: experts prefer this to sequential refinement in 78.5% of decided comparisons, at no more than half the judge calls. EditAgent improves two open-weight editors on three benchmarks and serves as a data engine for training stronger editors.

[121] DEQ-Stereo: Deep Euilibrium Video Stereo Matching via Adaptive Convergence cs.CVPDF

Kiljoon Han, Kyumin Hwang, Wonheok Choi, Jeonghoon Kim, Sunghoom Im

TL;DR: 论文提出DEQ-Stereo，一种基于深度均衡（DEQ）的视频立体匹配框架。它将迭代细化建模为隐式不动点问题，自适应终止收敛，并引入ConvSGU和TST来确保快速稳定的帧内收敛和利用时序一致性，从而在精度与延迟之间取得优越权衡。

Details

Motivation: 现有迭代细化模型使用固定的更新计划，导致计算成本高且速度与精度难以兼顾，在视频流中尤为突出。论文旨在通过自适应收敛机制和时序状态转移，在保持高精度的同时显著降低计算延迟。

Result: 论文宣称DEQ-Stereo在广泛评估中达到了最先进性能，并在精度与延迟的权衡上表现出优越性。

Insight: 论文的创新点包括：将DEQ范式引入视频立体匹配，用隐式不动点替代固定迭代；设计ConvSGU简化非线性以加速收敛；提出TST实现无需显式先验的跨帧时序状态传播。这些设计有效平衡了精度与效率。

Abstract: Iterative refinement models have significantly improved stereo matching accuracy, but their rigid, fixed update schedules incur heavy computational costs and a strict trade-off between speed and accuracy. This challenge is magnified in video streams, where traditional online methods resort to reducing feature channels or relying on expensive temporal warping. To address this, we propose \textbf{DEQ-Stereo}, a novel video stereo matching framework based on the Deep Equilibrium (DEQ) paradigm. Instead of unrolling a fixed number of iterations, DEQ-Stereo reformulates the refinement as an implicit fixed-point problem, adaptively terminating once convergence is met. To ensure fast and stable intra-frame convergence, we introduce the \textbf{Convolutional Simplified Gated Unit (ConvSGU)}, which eliminates unnecessary non-linearities by modeling the latent state as a gated, element-wise sum of inputs. Furthermore, to exploit cross-frame temporal coherence, we propose \textbf{Temporal State Transfer (TST)}, a warm-start strategy that propagates the converged hidden state to the next frame without requiring explicit pose or warping priors. Extensive evaluations demonstrate that DEQ-Stereo delivers state-of-the-art performance with a superior accuracy-to-latency trade-off.

[122] Confidence Filtering in Video-Based Gait Assessment: Measurement Error versus Selection Shift cs.CV | q-bio.QM | stat.MEPDF

David Regev, Eran Beeri Bamani

TL;DR: 论文比较了视频步态评估中基于置信度过滤与预算匹配随机选择的影响，发现置信度过滤虽能降低测量误差，但会引入选择偏移，改变所评估的运动内容；在帕金森队列中运动汇总偏移+0.05 SD而临床误差无显著变化，NF2队列无偏移。通过分解和模拟，指出置信度过滤在误差依赖置信度时降低局部误差，但在置信度跟踪运动时产生偏差，且小队列中临床误差不变不能证明过滤保留了评估的运动。

Details

Motivation: 视频步态评估中常保留高置信度姿态观测以降低测量误差，但这可能改变所评估的运动内容，需要区分测量误差与选择偏移带来的影响。

Result: 在帕金森相关队列中，置信度过滤导致运动汇总偏移+0.05 SD（95% CI 0.03-0.07），但留出Mini-BESTest误差无显著变化（-0.04分）；NF2队列无偏移且预测器未超过常数基线。模拟显示过滤在误差依赖置信度时降低局部误差，但置信度跟踪运动时产生端点偏差，系统误差重分配可增加达0.58度。

Insight: 创新点在于分解并模拟测量误差与选择偏移，揭示置信度过滤的潜在偏差，并指出小队列中临床误差不变不能证明质量过滤保留了所评估的运动。

Abstract: Video-based gait assessment often keeps only high-confidence pose observations, which can lower measurement error but change the movement assessed. We compared confidence selection with budget-matched random selection in a Parkinson-related cohort (n = 96) and an NF2-related replication cohort (n = 18). In the Parkinson-related cohort, confidence selection produced a small but consistent shift in the observed movement summary (+0.05 SD, 95% CI 0.03 to 0.07), while held-out Mini-BESTest error stayed flat (-0.04 points, -0.13 to 0.05); a policy preserving motion-group proportions reduced the shift, while NF2 showed no shift and its predictor did not beat a constant baseline. Because this shift mixes measurement error with selection shift, we decompose and simulate both on the cohort’s window structure. Filtering lowers local error when error depends on confidence, but biases the endpoint once confidence tracks movement more than error. In the Parkinson-related data, confidence was only weakly tied to movement (rho = 0.14). There, filtering is harmless if well-tracked windows are unbiased. If instead systematic error only redistributes within participants, filtering can add up to 0.58 degrees. Unchanged clinical error from such small-cohort predictors therefore cannot show that quality filtering preserves the assessed movement.

[123] WorldProbe: When Video World Models Fall Apart under Long-Horizon Spatial Exploration cs.CVPDF

Minqi Wang, Jie Peng, Hejun Dong, Ruchang Yao, Puyi Wang

TL;DR: 论文提出了WorldProbe，一个用于诊断视频世界模型在长时程空间探索中性能的基准。它使用目标条件多模态代理在线调整相机动作，包含164个测试用例和四个探测家族。通过对10个SOTA模型生成超过1600次rollout（总计约800分钟，horizon达180秒）的评估，发现局部指标退化和远程不一致性问题，揭示了局部稳定生成与持久世界一致性之间的差距。

Details

Motivation: 现有基准通常只评估短交互或使用固定相机轨迹，无法充分探索视频世界模型在长时程、大范围相机运动下的性能。论文旨在填补这一空白，系统评估模型在持久世界一致性方面的表现。

Result: 在WorldProbe基准上评估10个SOTA模型，生成超过1600次rollout（总计约800分钟，horizon达180秒）。结果显示，近期模型能更长时间保持视觉和内容质量，但长程记忆和演化仍然薄弱，局部指标退化且出现远程不一致性，暴露了局部稳定生成与持久世界一致性之间的差距。

Insight: 论文创新点在于提出一个诊断基准，使用在线调整相机动作的目标条件多模态代理模拟长时程探索，并设计四个探测家族系统评估模型。客观来看，其创新在于首次系统揭示视频世界模型在长时程探索下的持久一致性缺陷，为未来研究提供了方向。

Abstract: Video world models generate future visual observations from camera or action inputs, with the goal of synthesizing persistent 3D worlds that can be explored across time and space. Existing benchmarks typically evaluate short interactions or rely on camera trajectories fixed before generation. The performance of video world models under long-horizon exploration with extensive camera motion remains under-explored. We introduce WorldProbe, a diagnostic benchmark that uses a goal-conditioned multimodal agent to adapt camera actions online during generation. WorldProbe comprises 164 test cases across four probing families. Across 10 state-of-the-art models, we generate more than 1,600 rollouts totaling approximately 800 minutes, with horizons up to 180 seconds. Our evaluation across four dimensions reveals both the degradation of local measures and the emergence of long-range inconsistencies. We find that recent models sustain visual and content quality for longer, while long-range memory and evolution remain weak. These results expose a gap between locally stable generation and persistent world consistency that is largely missed by existing benchmarks. Code and benchmark resources are available at https://github.com/Untitled-W/WorldProbe.

Kaisong Ji, Ziyang Xu, Chang Bian, Yu Zhou, Wenyu Liu

TL;DR: 论文提出跨编码器锚点细化方法 CEAR，用于零样本异常检测。该方法在构建正常/异常原型之前，将同一图像的 ViT 特征路径与独立卷积编码器路径在锚点阶段连接，通过跨注意力查询图像特定记忆并进行残差细化，再以图像条件查询门控锚点聚合来构建原型并完成异常评分。

Details

Motivation: 零样本异常检测需要从辅助训练域迁移异常判别能力到未见类别，并定位细微缺陷；核心挑战是构建同时结合上下文表示与局部证据的判别性参考。

Result: 在13个工业和医疗数据集的68项图像级检测与像素级定位评估中，CEAR在57项取得最佳；在44项像素级比较中41项超过所有SOTA。11个定位数据集上，像素级最大F1和平均精度平均提升4.45和3.79个百分点。

Insight: 创新点在于锚点阶段的跨编码器交互：用工业产品识别预训练的独立卷积编码器构建图像特定记忆，让ViT patch特征形成的空间锚点通过跨注意力查询并残差细化，再由图像条件正常/异常查询门控聚合。客观看，其价值是将ViT上下文表示与卷积局部表示在原型构建前融合，增强跨域细粒度异常定位。

Abstract: Zero-shot anomaly detection aims to transfer anomaly discrimination from auxiliary training domains to unseen categories while localizing subtle defects. A key challenge is to construct discriminative references that combine contextual representations with complementary local evidence. We present Cross-Encoder Anchor Refinement (CEAR), which connects two visual encoding paths for the same image at the anchor stage, before normal and anomalous prototypes are constructed. An independent convolutional encoder pretrained for industrial product recognition builds an image-specific memory shared across selected vision transformer (ViT) layers. Spatial anchors read from ViT patch features query this memory through cross-attention and undergo residual refinement. Image-conditioned normal and anomalous queries then gate anchor aggregation to construct prototypes for anomaly scoring. Across 13 industrial and medical datasets, CEAR achieves the best performance in 57 of 68 evaluations spanning image-level detection and pixel-level localization. Notably, CEAR surpasses all other state-of-the-art methods in 41 of 44 pixel-level comparisons. Across 11 localization datasets, mean gains in pixel-level maximum F1 score and average precision are 4.45 and 3.79 percentage points, respectively. This study shows how cross-encoder interaction at the anchor stage can integrate complementary visual representations for fine-grained anomaly localization across domains.

[125] SCOPE: Semantic COdec Pre-Editing for Object-Preserving Compression cs.CVPDF

Silvia Dani, Leonardo Galteri, Marco Bertini

TL;DR: 论文提出SCOPE，一种面向目标检测下游任务的语义编解码预编辑方法：在图像压缩前有条件地修改图像，以编解码器类型和压缩强度为条件，学习保护任务相关区域并简化背景，从而改善码率与检测精度的权衡。

Details

Motivation: 标准图像编解码器主要面向人眼感知优化，在机器视觉系统中压缩后可能导致下游任务精度下降；论文希望在压缩前提升机器任务相关信息的保留效率。

Result: 实验显示，SCOPE在不同编解码器族和目标检测器架构上均带来一致的率-精度曲线增益，并能较强迁移到未见过的学习型和小波压缩族。

Insight: 创新点在于用条件化单一预编辑网络适配多种压缩设置，并按任务相关性进行区域级保护与背景简化；可借鉴的是将压缩前处理与下游任务目标联合考虑，而非仅优化重建质量。

Abstract: Image compression is increasingly used before machine vision systems, yet standard codecs are mainly optimized for human perception rather than downstream task accuracy. We propose SCOPE (Semantic COdec Pre-Editing), a conditional image pre-editor that modifies images before compression to improve the bitrate and detection accuracy trade-off. The model is conditioned on the codec family and compression severity, allowing a single trained network to adapt to multiple compression settings without retraining or loading codec-specific weights. Instead of uniformly preserving the whole image, the pre-editor learns to protect task-relevant regions while simplifying less important background content to improve compressibility. The resulting rate-accuracy curves show consistent gains across different codec families and detector architectures, together with strong transferability to unseen learned and wavelet-based compression families.

[126] GROME: GROunding Factorized MEmory into Video World Models cs.CV | cs.LGPDF

Fang Yu, Xiaoxue Wu, Haiyu Zhang, Yangfu Li, Botong Zhao

TL;DR: 论文提出GROME，一种面向视频世界模型的长时一致性记忆框架。它将历史信息分解为静态场景几何和动态实体状态，通过局部记忆检索选取空间对齐的静态历史与最新动态状态，并以免训练方式注入冻结的视频世界模型。实验表明其在长时重访场景中显著提升场景持久性和动态实体保真度。

Details

Motivation: 视频世界模型在观测内容超出上下文窗口后难以保持长时一致性。现有隐式上下文记忆受容量限制且静态与动态信息纠缠，显式全局记忆则难以建模演化动态并会累积几何误差。

Result: 在长时重访场景实验中，GROME显著优于现有方法，提升场景持久性和动态实体保真度，同时保持冻结骨干的视觉质量与可控性且无需额外训练；还可作为即插即用记忆接入外部观测。

Insight: 创新点在于静态-动态分解记忆、空间对齐的局部记忆检索以减少几何漂移，以及利用模型原生条件路径实现免训练记忆注入，兼顾长时动态连续性与静态场景几何一致性。

Abstract: Long-horizon consistency is essential for video world models, yet it becomes difficult to maintain once observed content falls outside the context window. Existing memory mechanisms either retrieve history as implicit context, which remains constrained by context capacity and entangles static and dynamic information or consolidate history into explicit global representations, which struggle to model evolving dynamics and accumulate geometric errors. To overcome these limitations, we introduce \textbf{GROME}, a novel factorized memory framework that augments video world models for long-horizon coherence across both static scenes and dynamic entities. GROME operates via three synergistic components: 1)~~\emph{Static-Dynamic Factorization} decouples historical evidence into static and dynamic components, preserving static scene geometry and dynamic entity states separately; 2)~~\emph{Local Memory Retrieval} selects spatially aligned static history to eliminate geometric drift alongside the latest dynamic entity states to ensure temporal continuity; 3)~\emph{Training-Free Memory Injection} seamlessly grounds the factorized memory into video world models via their native conditioning pathways. Experiments on long-horizon revisit scenarios demonstrate that GROME substantially enhances scene persistence and dynamic entity fidelity over existing methods, all while preserving the visual quality and controllability of the frozen backbone without additional training. Beyond self-rollouts, GROME readily accommodates external observations as plug-and-play memory, unlocking flexible and controllable video continuation and scene exploration.

[127] Aligning Medical Vision Language Models at the Capability Boundary with Entropy Adaptive Rubric Grounding cs.CV | cs.AIPDF

Hongyu Bai, Jiaqi Zeng, Chunzheng Zhu

TL;DR: 论文提出 MedCBR 两阶段对齐框架，用于医疗视觉语言模型。第一阶段在模型能力边界构建反事实偏好对，并用难度加权边界偏好优化（DBPO）集中学习关键诊断分支；第二阶段从边界轨迹蒸馏临床评分标准，按预测熵门控激活，并用熵门控接地策略优化（EGPO）联合奖励答案正确性、解剖接地与推理保真。该方法旨在让医疗诊断推理更准确、更符合临床依据。

Details

Motivation: 现有医疗视觉语言模型的对齐目标可能奖励错误行为：均匀监督微调让简单样本主导更新，临床关键边界样本过早饱和；仅依赖最终答案正确性的稀疏奖励无法评估解剖 grounding 和临床逻辑，易导致答案捷径和 reward hacking。

Result: 在六个医疗基准上，MedCBR 相比强通用、专用和强化学习基线取得一致提升，平均准确率达 61.2%，在挑战性鉴别诊断任务上增益最大；消融显示两阶段结合具有超加性增益，超过各自改进之和。

Insight: 创新点在于将能力边界校准、反事实偏好学习和评分标准接地强化学习结合：用共享推理前缀但在关键诊断分支分叉的偏好对聚焦边界区域，并用预测熵自适应激活临床 rubric，同时抑制可靠样本上的 rubric 噪声。客观看，其可借鉴之处是把群体级边界先验与实例级不确定性耦合，以缓解医疗 VLM 对齐中的稀疏奖励和捷径学习问题。

Abstract: Medical diagnostic reasoning requires verifiable links between visual evidence and clinical knowledge, yet current medical vision language models are aligned with objectives that reward the wrong behavior. Uniform supervised fine tuning lets easy cases dominate updates while clinically critical boundary cases saturate prematurely. Sparse rewards based only on final-answer correctness cannot assess anatomical grounding or clinical logic, inviting reward hacking through answer shortcuts. We propose MedCBR, a two-stage alignment framework coupling boundary-aware preference optimization with rubric-grounded reinforcement learning. First, we construct counterfactual boundary preferences at the model’s capability frontier using empirical pass rates and preference pairs that share reasoning prefixes but diverge at decisive diagnostic branches. Difficulty Weighted Boundary Preference Optimization (DBPO) concentrates learning on this calibrated boundary region. Second, we distill reusable clinical rubrics from boundary trajectories and activate them according to prediction entropy. Entropy Gated Grounded Policy Optimization (EGPO) rewards answer correctness, anatomical grounding, and reasoning fidelity while suppressing rubric noise on reliable samples. A reference policy anchored to the boundary-aligned model couples population-level boundary priors with instance-level uncertainty, making diagnostic reasoning more accurate and clinically grounded. Experiments on six medical benchmarks show consistent improvements over strong general, specialized, and reinforcement learning baselines, reaching 61.2% average accuracy with the largest gains on challenging differential diagnosis tasks. Ablations show super-additive gains: combining the two stages exceeds the sum of their individual improvements.

[128] M-PFT: Angular Margin for Calibrated Prompt-Tuning of Fine-Tuned Vision-Language Models cs.CVPDF

Shihab Aaqil Ahamed, Mohamed Ansaff, Nang Khin Myat Lay Phyu, Udaya Sampath K. Perera Miriya Thanthrige, Chamira U. S. Edussooriya

TL;DR: 论文针对提示调优视觉语言模型在基类与新类上的双重校准失衡问题，提出M-PFT角度间隔方法。该方法通过最小化可调类嵌入间的最大余弦相似度以减少嵌入坍缩，并最小化可调嵌入与对应零样本嵌入的角度距离以保持语义几何。实验表明其能降低新类校准误差，同时保持基类竞争力和相近准确率。

Details

Motivation: 提示调优虽能参数高效适配视觉语言模型，但常导致基类欠自信、新类过自信的双重校准问题。现有校准方法缺乏对超球嵌入空间几何性质的理解，难以利用角度判别性调整扭曲的决策边界。

Result: 在15个数据集、多种骨干网络和9种提示调优方法上进行实验，M-PFT降低了新类平均校准误差，在基类上保持竞争力，并维持相近准确率；同时计算开销可忽略。

Insight: 创新点在于从超球嵌入空间的角度间隔出发，联合引入类间余弦相似度最小化和零样本语义锚定两个目标，以几何方式校准提示调优后的决策边界并保留预训练语义结构。

Abstract: Prompt-tuning has emerged as a parameter-efficient technique for adapting large-scale vision-language models (VLMs) to downstream tasks while keeping the pre-trained weights frozen. However, prompt-tuned VLMs often suffer from a base-to-novel dual miscalibration problem, where models typically show underconfidence on base classes and overconfidence on novel classes. Current VLM calibration approaches address this dual miscalibration either separately or jointly, but lack a geometric understanding of the hyperspherical embedding space and thus fail to exploit angular discriminative properties to adjust distorted decision boundaries. To address this, we propose M-PFT, a novel angular-margin approach for prompt tuning that introduces two complementary objectives to promote class discriminability and semantic anchoring. This enlarges the angular margin by 1) minimizing the maximum cosine similarity between tunable class embeddings to reduce embedding collapse and 2) minimizing the angular distance between each tunable embedding and its corresponding zero-shot embedding to preserve semantic geometry. Extensive experiments across 9 prompt-tuning methods with various backbones on 15 diverse datasets show that our approach reduces the average calibration error on novel classes, while remaining competitive on base classes and maintaining comparable accuracy. Further analyses reveal that M-PFT effectively adjusts distorted decision boundaries induced by prompt tuning while preserving the pre-trained embedding space, improving calibration with negligible computational overhead.

[129] PhysAg3D: Bridging 3D Generative and Agentic Models for High-Fidelity and Physically-Interactive Assets cs.CVPDF

Bi’an Du, Fanpeng Meng, Jiemin Fang, Chen Yang, Pufan Li

TL;DR: PhysAg3D 提出将 3D 生成模型与智能体推理和工具调用结合，从单张图像生成外观真实、几何保真且具备物理交互能力的 3D 资产。系统先用视觉语言智能体推断语义部件、交互方式和物理先验，再由 3D 生成器产生带纹理的整体网格，并通过分层交互表示组织部件、关节、可变形区域和表面绑定。该方法支持刚体铰接与柔顺变形，并利用渲染交互和执行测量在有限预算内迭代修正。

Details

Motivation: 从单张图像生成交互式 3D 资产不仅需要细节几何，还需要合理的运动/变形行为和物理交互结构；仅靠 3D 生成难以决定物体应如何运动和变形。论文旨在桥接 3D 生成与智能体推理，解决高保真且物理可交互资产生成的问题。

Result: 摘要在真实照片和外部基准上进行了定量与定性评估，表明方法能生成细节丰富、与输入图像对齐且交互合理的资产；消融实验支持有限预算修正和源表面保留的有效性。摘要未给出具体数值或明确 SOTA 结论。

Insight: 创新点在于将视觉语言智能体的语义推理与工具使用同 3D 生成模型耦合，并用分层交互表示连接可修正的物理先验、交互机制和生成表面；同时通过渲染与执行反馈进行闭环修正，兼顾刚体铰接和柔顺变形。

Abstract: Generating interactive 3D assets from a single image requires realistic appearance, fidelity to the depicted object, and plausible physical behavior. Yet detailed geometry alone does not determine how an object should move or deform. We introduce PhysAg3D, which couples 3D generative models with agentic reasoning and tool use. A vision-language agent first infers semantic parts, candidate interactions, and physical priors from the image; a 3D generator then produces a textured whole-object mesh from the same image. A hierarchical interaction representation links these revisable priors to mechanisms and the generated surfaces they control, organizing interaction construction and refinement. Guided by this representation and observations of the mesh, the agent uses geometric and physical tools to construct parts, joints, deformable regions, and surface bindings while retaining useful generated geometry and materials. Rendered interactions and execution measurements guide targeted revisions within a fixed budget. The framework accommodates both rigid articulation and compliant deformation. Quantitative and qualitative evaluations on real photographs and external benchmarks demonstrate detailed, image-aligned assets with plausible interactions. Ablations support bounded refinement and source-surface preservation. Project Page: supra-3d.github.io/PhysAg3D.

[130] MLLM-GS: Multimodal Large Language Model Prior-Guided Fast Novel View Synthesis in Extreme Environments cs.CVPDF

Zhiliang Wu, Xinye Zheng, Kun Li, Fei Wang, Hao Guo

TL;DR: 论文提出MLLM-GS，一个由多模态大语言模型先验引导的极端环境快速新视角合成框架。方法包含两个分支：利用冻结MLLM的视觉先验增强严重退化视图，并用轻量校正网络缓解像素偏移和颜色失真；同时通过优化光栅化、高斯内存布局和参数更新提升3DGS重建效率。实验表明该方法能处理多种严重退化并实现高质量NVS，同时显著降低重建时间和内存消耗。

Details

Motivation: 现有退化场景NVS方法往往依赖特定退化模型，难以泛化到多种极端环境；生成模型虽提供视觉先验，但输出存在像素错位和颜色偏差，且3D重建计算与内存成本高。论文旨在实现统一、泛化且高效的极端环境新视角合成。

Result: 在多个退化场景上的实验表明，MLLM-GS能有效处理多种严重退化，获得高质量新视角合成结果，并显著降低重建时间和内存消耗。摘要未给出具体benchmark数值或明确SOTA结论。

Insight: 创新点在于用冻结MLLM作为通用视觉先验进行退化视图增强，并通过轻量校正网络和少量配对干净视图监督提升伪GT可靠性；同时针对3DGS的光栅化、内存布局和参数更新进行效率优化，兼顾退化泛化性与重建速度。

Abstract: Novel view synthesis (NVS) in degraded scenes aims to reconstruct 3D scenes from multi-view observations affected by various degradations, and to generate clear and photorealistic images at unseen viewpoints. Despite recent advances, existing methods often rely on degradation-specific models, limiting their generalization across diverse extreme environments. Generative models provide rich visual priors, but their outputs often suffer from pixel misalignment and color deviations, which can propagate into the reconstructed 3D scene and compromise reconstruction quality. Furthermore, the high computational and memory costs of 3D reconstruction hinder the practical application of NVS in extreme environments. To this end, we propose MLLM-GS, a multimodal large language model (MLLM) prior-guided framework for fast NVS in extreme environments. MLLM-GS consists of two branches: MLLM prior-guided view enhancement and fast 3D scene reconstruction. The former leverages the rich visual priors of a frozen MLLM to enhance views under different severe degradations and introduces a lightweight correction network to reduce pixel shifts and color distortions in MLLM outputs. With supervision from only a few paired clean views, this branch produces reliable enhanced views for all degraded observations, providing pseudo-GT views for subsequent 3D reconstruction. The latter improves 3DGS efficiency by optimizing rasterization, Gaussian memory layout, and parameter updates, reducing redundant computation, memory-access overhead, and optimization costs. Extensive experiments on multiple degraded scenes demonstrate that MLLM-GS effectively handles various severe degradations and achieves high-quality NVS with significantly lower reconstruction time and memory consumption. Project Page: https://wzlwlm13.github.io/MLLM-GS

[131] ElasticFormer: Detecting Objects in HRW Shots via Elastic Computing Vision Transformer cs.CVPDF

Wenxi Li, Jingchen Huang, Chenyang Lyu, Moran Liu, Haozhe Lin

TL;DR: 论文针对十亿像素级高分辨率广角图像中的目标检测，提出ElasticFormer稀疏骨干网络。它通过ElasticSelector根据窗口方差评分并预测前景比例，动态选择包含目标的窗口并分配计算资源，从而适应不同目标数量。实验在PANDA基准上验证了显著降低FLOPs并提升AP50，同时通过PASCAL VOC 2007弱监督检测研究和ElasticNet验证了可扩展性与骨干无关性。

Details

Motivation: 高分辨率广角图像存在前景极度稀疏、分辨率达十亿像素、目标数量多样等挑战，传统近景检测器易被背景淹没而变慢变差；已有稀疏骨干的固定稀疏模式无法自适应不同目标数量。

Result: 在PANDA十亿像素基准上，相比固定比例稀疏方法，ElasticFormer将骨干FLOPs减少80%，同时AP50显著提升；并在PASCAL VOC 2007上开展WSOD研究评估可扩展性，构建ElasticNet验证骨干无关性。

Insight: 创新点在于基于窗口方差评分的前景比例预测与top-k选择，实现按前景分布动态分配计算资源；结合新损失函数和三阶段训练策略，使ElasticSelector在缺少边界框标注时仍能工作，并具备骨干无关的可插拔性。

Abstract: Recent advances in gigapixel-level imaging have brought High-Resolution Wide shots to the forefront of research. However, these images present significant challenges: extreme sparsity of foreground, gigapixel-level resolutions and diverse target counts. This makes traditional close-up detectors inaccurate and slow as they are overwhelmed by the background. Although previous research has explored sparse backbones, their fixed sparsity patterns lack the adaptability required to handle diverse target numbers. To address this, we introduce ElasticFormer, a sparse backbone that dynamically allocates computational resources based on foreground proportion. After scoring windows based on variance, proposed ElasticSelector module will predict the foreground proportion for top-k selection. The mechanism guides the model to select target-containing windows, scaling resources in areas where objects are clustered. We introduce a novel loss function combined with the 3-phase training strategy for ElasticSelector, allowing it to function properly when bounding box annotations are missing. A WSOD study is carried on PASCAL VOC 2007 to evaluate its extensibility. Further, ElasticNet is created to verify its backbone-agnostic nature. In experiments on the PANDA gigapixel benchmark, ElasticFormer reduces backbone FLOPs by 80% while achieving a significant improvement in AP50 when compared to fixed-ratio sparse methods.

[132] Mind The Gap (MTG-AD): Dataset and Fine-grained Evaluation for End-to-End Inline Audio Descriptions cs.CV | cs.AI | cs.HCPDF

Subhashini Venugopalan, Jenny Tan, Taylor Roper, Jimmy Tobin, Anton Kast

TL;DR: 论文面向盲人和低视力用户的视频内联音频描述（inline AD），构建了由盲人与视力正常AD专家共同标注的MTG-AD数据集（36小时视频、8000+条描述），并提出MTG-AD-Eval无参考细粒度评测框架，将生成脚本渲染为音轨以评估其嵌入视频自然静音段的效果。研究发现前沿多模态大模型能较准确描述视觉事件并显著减少语音重叠，但在叙事节奏和流畅性上仍有差距，且自动指标与人类评分显著相关。

Details

Motivation: 音频描述对视觉媒体无障碍访问至关重要，而多模态大模型有望按需生成AD；但现有研究对必须适配视频静音时长的内联AD、尤其是多样化用户生成内容（UGC）场景探索不足。

Result: 论文在MTG-AD上分析多个前沿MLLM，发现模型能准确描述视觉事件并大幅降低语音重叠，但在叙事节奏与流畅性上仍有不足；自动无参考指标与视力正常评分者及7名BLV参与者的人类质量评分显著相关，用户虽略偏好人工AD，但认为MLLM生成AD对理解视频高度有益。

Insight: 创新点在于构建高质量、专业标注的内联AD基准，并提出面向端到端任务的细粒度、无参考评测框架，将生成文本渲染为音频以评估其与自然静音的适配性，为模型改进和系统设计提供可操作指标。

Abstract: Audio descriptions (AD) are essential for making visual media accessible to blind and low-vision (BLV) users. While Multimodal Large Language Models (MLLMs) offer a scalable solution for generating audio descriptions on-demand, their performance on ``inline’’ audio descriptions – which must fit within existing silences in a video – remains under-explored, particularly for diverse user-generated content (UGC). We present a comprehensive investigation into MLLM-generated inline audio descriptions. First, we introduce MTG-AD, a professionally annotated dataset of 36 hours of videos, each averaging $\sim$5 mins. and 8k+ descriptions in total, co-created by paired blind and sighted AD professionals to provide a high-quality benchmark for this task. Second, we propose MTG-AD-Eval, an evaluation framework based on audio description expert guidelines that provides fine-grained, reference-free actionable metrics for model improvement. Crucially, our framework evaluates the end-to-end task: it renders the generated scripts into audio tracks to assess their fit within the original video’s natural silences, minimizing disruptive overlaps. Our analysis across frontier MLLMs reveals that while models accurately describe visual events and substantially reduce speech overlaps, gaps persist in narrative pacing and flow. Finally, we empirically validate that our automated and reference-free metrics correlate significantly with human quality ratings from sighted raters and 7 BLV participants, finding that while users narrowly prefer human-authored audio descriptions, they find MLLM-generated audio descriptions highly beneficial for comprehension. We provide actionable system design guidance and release MTG-AD at https://hf.co/datasets/google/mind-the-gap-inline-ad and MTG-AD-Eval at https://github.com/google/mtg-ad.

[133] DINOv2 for PET: A Pre-Training Domain Benchmark Across Classification, Segmentation, and Prognosis cs.CVPDF

Roxanne De Maeyer, Yannick Brackenier, Vicky De Ridder, Simon DeKeyser, Maarten Larmuseau

TL;DR: 论文提出首个在2D PET图像上预训练的DINOv2模型PET-DINOv2-2D，并与自然图像预训练的DINOv2及医学影像预训练的OmniRad进行统一基准比较。作者在正常/异常分类、病灶分割和无复发生存预后三个下游PET任务上使用相同轻量头评测，发现PET专用预训练在更少预训练数据下仍能匹配或超过对比模型。

Details

Motivation: DINO自监督特征在X-ray、CT、MRI等放射影像上迁移较好，但已有文献显示其向PET这类功能影像迁移较差；同时PET专用DINO模型很少，且缺乏跨多任务、多数据集的系统验证。

Result: 在三个下游PET任务上，PET-DINOv2-2D总体匹配或优于原始DINOv2和OmniRad；在标注数据较少时优势最明显，表明其特征更具可迁移性和标签效率。摘要未给出具体定量指标或SOTA声明。

Insight: 论文宣称的创新点是首次构建2D PET专用DINOv2预训练模型并开展跨分类、分割、预后任务的领域预训练基准。客观来看，其价值在于验证功能影像领域专用自监督预训练能带来标签高效迁移，并通过统一轻量头实现较公平的编码器比较。

Abstract: DINO (self-DIstillation with NO labels) has become a stan- dard for self-supervised pre-training, producing features that generalise across datasets and downstream tasks. In medical imaging it has been adopted mainly for radiology (X-ray, CT and MRI), where even natural- image DINO features transfer well. In the literature, these features have been reported to transfer worse to functional imaging such as PET. Yet PET-specific DINO models have barely been introduced, and even less validated across multiple tasks and datasets. We present PET-DINOv2-2D, the first DINOv2 model pre-trained on 2D PET, and benchmark it against open-source encoders: the origi- nal DINOv2 (pre-trained on the LVD-142M natural-image dataset) and OmniRad (pre-trained on CT, MRI and ultrasound). Using the same lightweight heads for every backbone, and despite far less pre-training data, PET-DINOv2-2D matches or outperforms both on three down- stream PET tasks: normal/abnormal classification, lesion segmentation and recurrence-free survival prognosis. Its advantage is largest when few labels are available, suggesting that PET pre-training gives more transferable, label-efficient features. Code is made available at https://github.com/nuclivision/pet-dinov2-2d/.

[134] EPC-RawDC: Equivariant Physics Constrained 3D Diffusion with Raw Data Consistency for CBCT to CT Image Synthesis cs.CV | cs.AI | physics.med-phPDF

Alzahra Altalib, Chunhui Li, Alessandro Perelli

TL;DR: 论文提出EPC-RawDC，一种用于CBCT到CT图像合成的条件3D潜在扩散框架，将体数据生成建模与扫描仪特定的CBCT前向物理模型约束结合，包括几何等变投影约束和原始数据一致性约束。方法在两个独立临床队列JUST和SynthRAD2025上验证，覆盖实测与模拟投影数据，并在图像质量和投影一致性指标上优于DDPM。

Details

Motivation: CBCT存在散射、噪声、重建伪影和HU不准确等问题，限制其定量应用；现有扩散方法多偏向图像驱动，较少利用CBCT采集物理和前向模型信息。论文旨在把扫描仪几何与个体采集投影测量引入3D扩散，提高CBCT到CT合成的定量准确性。

Result: 在JUST和SynthRAD2025两个队列上SSIM均达0.97；相比DDPM，PSNR分别提升2.10 dB和2.66 dB，MAE分别降低19.0%和20.3%。在SynthRAD2025上，投影一致性和等变误差相对DDPM分别降低55.0%和41.4%，验证了在模拟与实测投影域的有效性。

Insight: 创新点在于将同一扫描仪特定CBCT前向模型转化为两种互补监督：利用旋转等变性的几何等变投影约束，以及训练时使用个体采集噪声投影的原始数据一致性约束。客观来看，其价值在于把物理前向模型和扫描特定数据约束融入3D潜在扩散，使生成结果不仅图像相似，还更符合投影几何与采集一致性。

Abstract: Cone beam computed tomography (CBCT) is widely used for image guided and adaptive radiotherapy, but scatter, noise, reconstruction artifacts, and inaccurate Hounsfield units limit its quantitative use. Recent diffusion approaches for CBCT to CT synthesis remain largely image driven, with limited use of the underlying acquisition physics. We propose EPC-RawDC, a conditional 3D latent diffusion framework that combines volumetric generative modeling with two complementary constraints derived from the same scanner specific CBCT forward model. First, geometry equivariant projection constraint exploits the rotational equivariance of the CBCT forward operator by supervising the synthesized CT through correspondingly transformed reference projections. Second, raw data consistency uses noisy projection measurements of the individual acquisition as scan specific supervision during training. The framework was evaluated on two independent clinical cohorts with distinct scanner geometries and projection sources. For JUST, the physics constraints used measured clinical raw CBCT projections acquired with an Elekta system, whereas for SynthRAD2025 the projection data were simulated from the reference CT using a Varian geometry with Poisson photon statistics. EPC-RawDC achieved an SSIM of 0.97 in both cohorts and improved PSNR over DDPM by 2.66 dB on SynthRAD2025 and 2.10 dB on JUST, while reducing mean MAE by 20.3% and 19.0%, respectively. On SynthRAD2025, projection consistency and equivariant errors were reduced by 55.0% and 41.4% relative to DDPM. These results demonstrate that combining a volumetric diffusion prior with scanner geometry and scan specific projection measurements improves quantitative CBCT to CT synthesis across both simulated and measured projection domains. Code available after publication at https://github.com/ALZAHRAALTALIB/EPC-RawDC.

[135] Localizing Concepts in Visual Autoregressive Models cs.CV | cs.AIPDF

Nanxiang Jiang, Yang Liu, Yuanhao Wang, Min Xu

TL;DR: 论文提出 LoCo，首个面向 next-scale 视觉自回归模型的模型无关概念定位框架，利用由粗到细生成特性在 Layer、Scale、Position 三个维度定位特定概念出现的位置与时机。作者构建 LoCoBench（10 类）以无上下文偏差地评估概念路由，并在 Infinity、HunyuanImage-3.0、InfinityStar 等图像/视频自回归模型上验证定位结果可解释且与概念涌现存在因果联系。基于此，论文将方法用于概念擦除、模型个性化和对抗概念注入，取得 SOTA 并降低计算开销。

Details

Motivation: 扩散模型中的概念定位已有较多研究，但新兴的 next-scale 视觉自回归模型内部概念路由仍未被探索；为实现生成模型安全、可控和可解释的适配，需要知道概念在何时何地涌现。

Result: 在 LoCoBench 上对 Infinity、HunyuanImage-3.0、InfinityStar 等模型探测表明定位位置可解释且与概念涌现因果相关；在概念擦除、个性化、对抗概念注入应用中，定向干预达到 SOTA，同时显著降低计算开销并保持良性效用。

Insight: 创新在于首个模型无关的视觉自回归概念定位框架，将 coarse-to-fine 的 next-scale 生成过程拆解为 Layer、Scale、Position 三维定位，并用 LoCoBench 避免上下文偏差、通过因果验证支撑应用；客观看，其价值在于把概念路由分析转化为可操作的安全/高效适配手段。

Abstract: Understanding the internal routing of visual concepts is crucial for the safe and controllable adaptation of generative models. While concept localization has been widely studied in diffusion models, the emerging paradigm of next-scale visual autoregressive models remains largely unexplored. In this paper, we introduce LoCo, the first model-agnostic framework to localize where and when specific concepts emerge within autoregressive models. Driven by the native coarse-to-fine nature of next-scale generation, our method precisely maps conceptual knowledge across three distinct dimensions: Layer, Scale, and Position. To systematically localize and evaluate concept routing without context bias, we propose LoCoBench, a comprehensive dataset spanning 10 diverse categories. Extensive probing on image and video autoregressive models like Infinity, HunyuanImage-3.0, and InfinityStar shows that the localized positions are both interpretable and causally related to concept emergence. Building on these insights, we apply our localization method to three key applications: concept erasure, model personalization, and adversarial concept injection. Experiments demonstrate that our targeted intervention achieves state-of-the-art performance, substantially reducing computational overhead while preserving benign utility. Overall, our findings offer insights into how conceptual knowledge is routed during autoregressive generation, introducing a practical pathway for more interpretable, efficient, and secure adaptation.

[136] RepConTUR: A Report-Conditioned Volumetric Multimodal Model for Abdominal Tumor Segmentation cs.CVPDF

Seunghwan Lee, Sangjoon Park, Jongmin Lee, Yoon Jo Kim, Wonyoung Cho

TL;DR: 论文提出 RepConTUR，一个以放射报告叙述为条件的原生3D早期融合多模态模型，用于腹部肿瘤体积分割。作者扩展 AbdomenAtlas 3.0 构建子器官级可提示分割数据集与报告VQA对，并在同一标注上联合训练指代分割、报告 grounding 分割、报告生成和VQA四个任务。实验表明该方法在肝、肾、胰腺及多个域外队列上优于文本提示基线和视觉专家模型，消融验证了报告条件、联合训练和原生3D分割模块的有效性。

Details

Motivation: 自动肿瘤勾画存在较多错误尤其是假阳性，会扭曲放疗剂量并增加编辑时间。放射报告包含子器官级疾病定位信息，但现有文本提示模型多依赖短指代短语且以2D为主，未充分利用叙述报告和3D体数据。

Result: 在肝、肾、胰腺上，RepConTUR 在文本提示基线中取得最高DSC、实例精度和检测F1，加入报告后平均精度提升且召回相当；对 nnU-Net 和 R-Super，在肝、胰腺全部域内指标最高，并在四个域外公共队列上取得最高平均DSC、召回、精度和检测F1。消融显示报告条件使检测F1从0.499升至0.528，联合GSEG训练使RES F1从0.450升至0.482，原生3D分割模块使GSEG F1从0.139升至0.528。

Insight: 创新点在于原生3D早期融合多模态架构、以完整叙述报告条件化体积分割、统一四类报告相关任务的数据集与联合训练框架，以及原生3D分割模块相较2D的显著增益。客观看，将报告作为子器官级定位先验以抑制假阳性，并通过多任务联合提升定位与分割一致性，具有较高借鉴价值。

Abstract: Tumor delineation is required for radiotherapy planning, yet automatic segmentation is limited by errors, predominantly false positives, that distort dose and increase editing time. The radiology report accompanies the scan and localizes disease at the suborgan level, but existing text-promptable models condition on short referring phrases, and most operate in 2D. We present RepConTUR, a single native-3D early-fusion multimodal model that conditions volumetric abdominal tumor segmentation on the narrative report. We extend AbdomenAtlas 3.0 to a suborgan-level promptable segmentation dataset and generate report-based VQA pairs, yielding four report-derived tasks on the same annotations: referring segmentation (RES), report-grounded segmentation (GSEG), report generation (RRG), and visual question answering (VQA). We train RepConTUR, comprising a 3D CT encoder, an early-fusion language model, and a native-3D segmentation module, jointly on the four tasks. Across liver, kidney and pancreas, RepConTUR attains the highest Dice similarity coefficient (DSC), instance-wise precision, and detection F1 among the text-promptable baselines, and adding the report raises mean precision while leaving recall comparable. Against two vision-only specialists, nnU-Net and the report-supervised R-Super, RepConTUR attains the highest value on every in-domain metric for liver and pancreas and the highest mean DSC, recall, precision, and detection F1 over the four out-of-distribution public cohorts. Ablations indicate that conditioning on the narrative report raises detection F1 from 0.499 to 0.528 within the same model, that joint GSEG training raises RES F1 from 0.450 to 0.482, and that the native-3D segmentation module raises GSEG F1 from 0.139 to 0.528 over its 2D counterpart. Code is available at https://github.com/Oncosoft-Research/RepConTUR.

[137] SelfThinker: Self-Evolving Reasoning via Reliability-Verified Intrinsic Visual Thoughts cs.CVPDF

Zhangquan Chen, Ruqi Huang

TL;DR: 论文提出 SelfThinker，一个面向统一多模态模型的自进化框架：模型自行生成候选视觉辅助图像，并用冻结的理解通路通过条件逐点互信息评估其效用，从中筛选高价值视觉思维来训练生成器并做在线自蒸馏。训练后模型在推理时无需生成中间图像，可直接基于原图进行文本推理。

Details

Motivation: 现有视觉思维链方法依赖人工标注的辅助图像用于训练，且测试时需要较慢的图像生成，限制了可扩展性和推理效率。论文希望利用统一模型自生成的视觉思维作为监督信号，在无人工图像标注下提升视觉理解。

Result: 仅在小规模合成视觉搜索和导航数据上训练，即可迁移到自然图像与空间基准；将 ThinkMorph-7B 的七基准平均从 52.7 提升到 64.0（+11.3）。图像扰动探针中，相比 ThinkMorph-7B 最高提升 40.4 分，相比 BAGEL-7B 主干最高提升 23.2 分。

Insight: 创新点在于用冻结理解通路以条件逐点互信息筛选自生成视觉思维，并将高效用样本用于流匹配生成器优化和特权教师在线自蒸馏；同时实现推理阶段不生成中间图像，兼顾自监督训练与高效推理。

Abstract: Unified multimodal models can both generate and understand images within a single set of weights, offering an opportunity to use image synthesis as training supervision for visual comprehension. However, existing visual chain-of-thought methods rely on human-annotated helper images during training and require slow image generation at test time. We present SelfThinker, the first self-evolving framework that turns a unified model’s self-generated visual thoughts into stronger understanding without human image annotations. Given a visual problem, SelfThinker samples candidate helper images from its generation pathway and uses its frozen understanding pathway to score each candidate via conditional pointwise mutual information. High-utility visual thoughts then refine the generator via flow matching and serve as privileged teacher context for on-policy self-distillation. At inference, SelfThinker reasons directly from the original image in text without generating intermediate images. Although trained only on small synthetic visual-search and navigation datasets, SelfThinker transfers broadly to natural-image and spatial benchmarks, raising the seven-benchmark average of ThinkMorph-7B from 52.7 to 64.0 (+11.3 points). Controlled image-perturbation probes further show that SelfThinker surpasses ThinkMorph-7B by up to 40.4 points and its pretrained BAGEL-7B backbone by up to 23.2 points across fine-grained and spatial perception tasks. Our code is available at https://github.com/zhangquanchen/SelfThinker.

[138] Learning a Motion Manifold to Constrain Ambiguity in Unsupervised 4D Medical Image Interpolation cs.CVPDF

Haojin Li, Huazhu Fu, Heng Li, Jiang Liu

TL;DR: 论文面向无监督4D医学图像插值，提出学习一个运动流形来约束由端点监督不足导致的运动歧义。方法通过跨样本谱基学习提取共性运动结构，并用样本条件Cayley基重定向在共享表示中保留个体运动差异，从而定义受限制的完整速度场族；对预测速度场积分可重建任意中间时刻。

Details

Motivation: 无监督4D医学图像插值只能利用时间稀疏的端点观测，缺少中间帧监督；多个不同运动场可能具有相近端点一致性却产生不同中间解剖，形成运动歧义，且当需要从端点估计大量独立运动变量时难以约束。

Result: 在ACDC和4D-Lung数据集上，该方法在无中间体积训练的方法中达到state-of-the-art，并与使用中间监督的方法相比具有竞争力。

Insight: 创新点在于用跨样本谱基捕获可复用运动结构，再以样本条件Cayley基重定向在不增加独立坐标数量的情况下限制候选运动场，同时保留样本特异性；理论上给出了端点观测可区分学习流形内邻近运动的充分条件。

Abstract: Unsupervised 4D medical image interpolation reconstructs intermediate anatomical states from temporally sparse observations without intermediate supervision. Distinct motion fields may attain comparable endpoint agreement while producing different intermediate anatomy, giving rise to motion ambiguity. This ambiguity is difficult to constrain when many independently adjustable motion variables must be estimated from the observed endpoints. We develop a framework that learns a motion manifold to restrict candidate motion fields while retaining sample-specific variation. Cross-Sample Spectral Basis Learning extracts recurring motion structure from endpoint-derived dense estimates and encodes it in a shared spectral basis. Sample-Conditioned Cayley Basis Reorientation uses predicted motion coordinates to rotate the effective motion directions for each endpoint pair without increasing the number of independent coordinates. Their composition defines a nonlinear family of complete velocity fields across endpoint pairs, accommodating anatomical and motion-state differences within a restricted representation. Integrating each predicted field supports bidirectional reconstruction at arbitrary intermediate times. Theoretical analysis establishes sufficient conditions under which endpoint observations distinguish nearby motions within the learned family. Experiments on ACDC and 4D-Lung demonstrate state-of-the-art performance among the evaluated methods trained without intermediate volumes and competitive results against methods using intermediate supervision.

[139] It Takes Two to Probe, Thousands to Retrieve: Putting Vision–Language Probes to the Retrieval Test cs.CV | cs.CLPDF

Ivana Beňová, Michal Gregor, Marián Šimko

TL;DR: 论文比较视觉语言模型的图文匹配探针评测与真实检索评测之间的关系：在SVO和SugarCrepe两个探针基准上，对六个VLM的检索结果进行人工与LLM评判，并通过改变负样本来源来分析模型排序能力。研究发现探针准确率不能可靠预测检索表现，SVO上基准标签不完整会显著低估检索正确率，而SugarCrepe上手写负样本反而比检索负样本更难。

Details

Motivation: 现有VLM细粒度理解常以少量手写负样本的图文匹配探针来测试，但真实检索需要从成千上万个候选中选出正确项，二者评测条件差异很大且关系不清，论文旨在检验探针评测能否代表检索能力。

Result: 在SVO上，模型对正确项优于手写负样本的准确率为85%，高于检索负样本的77%；十个检索负样本即可达到200至430个随机负样本的效果。SugarCrepe上趋势相反，手写负样本更难。SVO上人工标注下top-1正确率为54%至90%，而基准标签下仅6%至21%，且通过探针与检索首位正确无关联；o3与标注者一致性κ为0.57至0.61，略低于标注者间0.64至0.68。

Insight: 论文的创新点在于将探针评测放到大规模检索场景中做系统压力测试，并通过替换负样本来源解耦“手写负样本难度”和“真实检索难度”，同时揭示基准相关性标签不完整对评测结论的影响。其可借鉴之处是提示VLM细粒度理解评测需要更完整的相关性标注和更接近真实检索的候选池，而不能仅依赖小规模匹配探针。

Abstract: Vision–language models (VLMs) are tested for fine-grained understanding with image–text matching probes, a model must prefer the correct image or caption over handcrafted negative. In retrieval, the correct item must beat thousands of alternatives. We measure how these two evaluation methods relate by using two probing benchmarks, \svo{} and SugarCrepe, for retrieval tasks. For 100 image and caption queries we judge the top-10 retrievals from full dataset of six VLMs, with human annotators and an LLM assessor. We than compare how well models rank pool of items on the same queries, while changing only where the negatives comes from: the benchmark, a random draw, or the judged-incorrect retrievals of other models. On \svo{} the accuracy of retrieving a positive over handcrafted negatives is significantly higher than for retrieved ones (the correct item is preferred in 85% against 77% of the time). Using pool of ten retrieved negatives leads to same accuracy as when one uses pool of 200 to 430 random negatives. On SugarCrepe the order is reversed: its handcrafted negatives are harder than the retrieved ones. Incomplete relevance labels explain most of the low retrieval scores on \svo{}, where the top-ranked item is correct for 54–90% of the queries under human labels against 6–21% under the benchmark’s labels. However, we detect no association between passing the probe for a query and retrieving a correct item first. The LLM assessor o3 agrees with individual annotators ($κ$ 0.57–0.61) slightly less than they agree with each other (0.64–0.68).

[140] VideoMemBench: How Well Do MLLMs Remember in Video Conversations? cs.CVPDF

Zhengdong Hu, Chao Wang, Kaituo Feng, Huanjin Yao, Mingfei Lu

TL;DR: 论文提出 VideoMemBench，用于评测多模态大语言模型在单个长视频的多轮对话中维持并复用上下文信息的能力（称为 in-context video memory，即上下文视频记忆）。该基准为每个样本配对一个视频和一段长多轮对话，相邻轮次通过两类跨轮依赖相连：一类要求模型记住先前轮次中描述过的视觉片段，另一类要求模型记住自己先前的回答。论文构建了 326 个视频、2,476 轮对话的数据集，并对 20 多个开源和闭源多模态大模型进行了评测。

Details

Motivation: 现有视频 QA 基准中的问题相互独立、从不互相引用，且仅凭视频本身即可回答，因此无法衡量模型在多轮对话中跨轮检索和复用信息的能力，而这是长视频多轮交互的核心能力。

Result: VideoMemBench 包含 326 个视频、2,476 轮对话，其中 1,387 轮依赖先前轮次（含多父依赖和长程回调）。在 20 多个开源和闭源多模态大模型中，表现最好的 Claude Opus 5 总体得分也仅 45.7%，说明该能力仍极具挑战性。

Insight: 论文提出并形式化了“上下文视频记忆”这一概念，区分“情景依赖”（记住看到的）与“答案依赖”（记住说过的）；用必要性（没有前轮上下文则无法作答）和非泄漏性（问题不复述前轮信息）两条属性约束数据构建，并设计 planner、generator、judger 三角色 LLM 流水线加人工专家审核来保证基准质量，可借鉴于其他多轮记忆评测的设计。

Abstract: Multimodal large language models (MLLMs) can now process hour-long videos, making extended multi-turn dialogue over a single video a natural mode of use. Sustaining such a dialogue requires more than answering each question in isolation: the model must retrieve and reuse information established earlier in the conversation, both what it has seen and what it has said, an ability we term in-context video memory. Existing video QA benchmarks leave this ability unmeasured: their questions are mutually independent, never reference one another, and each is answerable from the video alone, so nothing ever requires carrying information across turns. We introduce VideoMemBench, in which each sample pairs a single video with a long multi-turn dialogue, whose turns are connected by typed cross-turn dependencies: an Episodic Dependency refers back to a visual episode described in an earlier turn, probing memory of what the model has seen, while an Answer Dependency builds on the model’s own earlier answer, probing memory of what the model has said. Every dependency is verified considering two properties: 1) necessity, meaning the question cannot be answered without its earlier turns, and 2) non-leakage, meaning the question does not restate the information from its earlier turns. To enforce these properties, we design a construction pipeline with three LLM roles: a planner, a generator, and a judger, with each dialogue reviewed by human experts. VideoMemBench comprises 326 videos with 2,476 turns, of which 1,387 depend on earlier turns, including multi-parent dependencies and long-range call-back. Among over 20 evaluated open- and closed-source MLLMs, Claude Opus 5 performs the best with an overall score of only 45.7%, highlighting the challenge of in-context video memory. Our dataset and evaluation are released.

[141] Hierarchical Step Decomposition for Training-free Online Video Step Grounding cs.CVPDF

Long Zhou, Luca Zanella, Paolo Rota, Massimiliano Mancini, Elisa Ricci

TL;DR: 论文提出无需训练的分层步骤分解框架HSD，用于在线视频步骤定位：从流式视频中增量构建语义连贯事件，并利用多模态大模型进行零样本步骤分类与不确定预测的细粒度子步骤分解，从而识别视频中出现的程序步骤并定位其发生时间。

Details

Motivation: 现有方法要么离线需完整视频，要么在线依赖固定长度片段导致过分割和噪声；核心是解决在线场景下语义连贯时间片段构建及粗粒度步骤描述与视觉观测间语义鸿沟。

Result: 在HT-Step、Ego4D Goal-Step和CrossTask上，HSD显著优于现有SOTA，步骤识别更准、时间定位更精确且推理更快。

Insight: 创新在于无需训练、以语义一致事件为基本单元减少冗余计算，并用锚点描述持续校验及候选步骤到细粒度子步骤的按需分解来弥合语义差距；客观看，将分层分解与多模态大模型零样本能力结合以提升在线定位稳定性具有借鉴意义。

Abstract: Given a set of procedural steps, Video Step Grounding (VSG) aims to identify which steps occur in a video and localize when they are performed. Existing methods are either offline, requiring access to the full video before making predictions, or online, but relying on fixed-length video segments producing noisy, over-segmented outputs. In this work, we propose Hierarchical Step Decomposition (HSD), a training-free framework for online VSG that leverages the semantic understanding capabilities of Large Multimodal Models. HSD addresses two central challenges in online grounding: constructing semantically coherent temporal segments from a streaming video, and bridging the semantic gap between coarse procedural step descriptions and visual observations. To construct elementary temporal units, HSD incrementally groups incoming segments into semantically consistent events, using an anchor caption that is continuously validated against the visual stream. Based on these events, we perform zero-shot procedural step classification and selectively refine uncertain predictions by decomposing candidate steps into finegrained substeps that capture more nuanced visual evidence. By operating on semantically coherent events rather than every fixed-length segment, HSD reduces redundant computation and produces more stable predictions. Experiments on HT-Step, Ego4D Goal-Step, and CrossTask show that HSD substantially outperforms state-of-the-art methods, overall achieving better step recognition, more accurate temporal localization, and faster inference.

[142] EventSeeColor: Learning to Reconstruct Color from Monochrome Events cs.CV | cs.AIPDF

Chuanzhi Xu, Langyi Chen, Haoxian Zhou, Zelin Zhang, Haodong Chen

TL;DR: 论文提出 EventSeeColor，利用事件相机重建的灰度图与对齐事件共同引导扩散着色模型，从单色事件中恢复场景颜色。方法通过灰度语义上下文辅助颜色推断，并引入区域平衡色度监督与局部 RGB 细化来改善色彩分布、亮度和纹理。在两个真实事件数据集上，该方法在结构相似性、感知评分和色度区域色差指标上优于外部对比方法。

Details

Motivation: 传统事件图像重建多聚焦灰度强度，无法区分强度相近但颜色不同的表面；论文试图从单色事件中重建颜色，以揭示灰度图难以表达的外观差异。

Result: 在两个真实事件数据集的联合评估中，EventSeeColor 取得最佳结构相似性、学习感知评分和色度区域色差，优于外部对比方法。

Insight: 创新点在于利用事件触发模式隐含的表面反射率、光照和传感器光谱响应线索，将事件重建灰度与对齐事件共同作为扩散着色引导，并结合区域平衡色度监督和局部 RGB 细化提升颜色重建质量。

Abstract: Event cameras capture visual brightness changes under challenging lighting conditions. However, traditional event-based image reconstruction targets grayscale intensity and produces images without scene color. Color distinguishes surfaces with similar intensity. Reconstructing color from events can reveal appearance differences that reconstructed grayscale images cannot express. Although monochrome event cameras do not directly measure color, their event-triggering patterns depend on surface reflectance, illumination, and the sensor’s spectral response. These patterns may contain cues that support color reconstruction. In this paper, we present EventSeeColor, which uses event-reconstructed grayscale and aligned events to jointly guide a diffusion colorizer. Grayscale-derived semantic context supports color inference, while region-balanced chroma supervision and local RGB refinement improve color distribution, brightness, and texture. In the combined evaluation on two real event datasets, EventSeeColor achieves the best structural similarity, learned perceptual scores, and chromatic-region color difference among the external methods.

[143] AdMuse: Skill-Guided Creative Advertising Image Generation cs.CVPDF

Minyan Luo, Yuxin Zhang, Meng Zhao, Xincan Wang, Fuzhang Wu

TL;DR: 论文提出 AdMuse，一个技能引导的多智能体广告图像生成框架。它先将高质量广告抽象为可复用的创意技能库，用于跨域广告策略；生成时通过技能路由、多候选构思与选择、VLM 引导的视觉精炼，把广告创意从单次提示写作转化为结构化决策过程，从而生成既吸引注意又能传达产品定位的广告图像。

Details

Motivation: 创意广告图像需要兼顾吸引力和产品定位传达，而在渲染前选择有说服力的概念桥梁十分困难。现有方式多依赖检索孤立样例，难以跨域复用广告策略。

Result: 实验覆盖多样产品和品牌定位，显示 AdMuse 能生成视觉上更有吸引力且忠实传达产品定位的广告；摘要未提及具体定量指标、benchmark 或 SOTA 对比。

Insight: 创新点在于将高质量广告中的重复桥接模式抽象为可复用技能库，并结合技能路由、多候选构思选择与 VLM 反馈精炼，把广告创意建模为多智能体结构化决策流程，而非单步提示生成。

Abstract: An outstanding creative advertising image should both attract attention and communicate a product’s positioning. How to choose a persuasive conceptual bridge before rendering begins is challenging for advertising generation. We present AdMuse, a skill-guided multi-agent framework that distills high-quality advertisements into reusable creative skills for cross-domain advertising strategy. Rather than retrieving isolated exemplars, AdMuse abstracts recurring bridge patterns into a skill library that can guide new product briefs. At generation time, AdMuse coordinates skill routing, multi-candidate ideation and selection, and VLM-guided visual refinement: diverse skills propose alternative concepts, relative judgment selects the most promising direction, and vision-language feedback helps realize the selected intent in the final image. This design treats advertising creativity as a structured decision process rather than a single prompt-writing step. Experiments across diverse product and brand positionings show that AdMuse produces visually compelling advertisements that faithfully communicate product positioning.

[144] Video Generation Meets Agent Harness: Agentic Video Generation, Agentic World Modeling and Recursive Self-Improvement cs.CVPDF

Liaoyuan Fan, Yuhao Zheng, Dongxing Mao, Hangyu Ran, Siyuan Hu

TL;DR: 论文围绕智能体执行框架（agent harness）探讨视频生成与世界模型的交汇，梳理三条方向：智能体化视频生成、智能体化世界建模，以及视频模型开发中的递归自我改进；分析所需的多模态感知、长程规划、记忆、代码交互、反馈控制、技能复用与多智能体协作能力，并总结自主视频生产、终身记忆、混合控制、自主模型开发、溯源、成本核算和评估等挑战。

Details

Motivation: 视频生成正从端到端合成转向依赖规划、工具使用和反馈的智能体化生成，同时视频世界模型可作为智能体交互环境；论文旨在通过可执行运行时框架厘清二者结合的系统设计与评估问题。

Result: 摘要未报告具体定量实验或benchmark结果；作为报告/综述性工作，主要给出三方向的分析框架、能力清单与开放挑战。

Insight: 创新在于以agent harness为统一视角，将上下文构建、工具暴露、状态维护、反馈路由和预算管理贯穿视频生成与世界建模，并区分输出修订、框架状态更新、生成器参数、评估器及改进流程本身的递归自我改进层级。

Abstract: Video generation is shifting from end-to-end synthesis toward agentic generation, where planning, tool use, and feedback enable coherent, controllable multi-shot videos. In parallel, video world models provide action-conditioned observations and predicted futures, serving as interactive environments for agents. We study their intersection through the agent harness: an executable runtime that constructs context, exposes tools, maintains state, routes feedback, and manages budgets around video models. This report examines three directions. First, agentic video generation, where harnesses coordinate scripting, shot planning, asset management, production, and editing, alongside the evaluation challenges of these systems. Second, agentic world modeling, where harnesses mediate observation, control, execution, and state. We discuss hybrid designs in which game engines or agent-written programs maintain world state while video models render observations, and how agents and world models can mutually evaluate and improve one another. Third, recursive self-improvement (RSI) in video model development, distinguishing output revisions, updates to harness state, generator parameters, and evaluators, and changes to the improvement procedure itself. We identify how these improvements feed back into subsequent development. Across these directions, we analyze essential agent capabilities, including audiovisual perception, long-horizon planning, memory, code-based interaction, feedback-guided control, skill reuse, and multi-agent coordination. We conclude with challenges in autonomous video production, lifelong memory, programmable hybrid control, autonomous model development, provenance, cost accounting, and evaluation linking video quality and task performance to sustained improvements in models and harnesses.

[145] Benchmarking color judgment in multimodal LLMs with CIE-computable ground truth cs.CVPDF

Shuwei Yue, Kaida Xiao, Zhihua Wang, Qiao Chen

TL;DR: 论文构建了一个基于CIE色度学框架的五任务基准，用于评测多模态大语言模型（MLLM）的颜色判断能力，任务包括自动白平衡配对判断、肤色偏置方向、相关色温估计、CIE Delta E 2000色差配对排序和变化光照下的颜色命名。作者测试了八个MLLM端点，发现模型能处理粗略的二值判断，但在数值色温估计和精细色差判断上仍较弱。

Details

Motivation: 多模态大模型已被用于零样本图像质量判断，但其颜色判断很少用色度学真值进行检验。论文旨在建立可计算CIE真值的基准，系统评估MLLM颜色判断是否可靠。

Result: 模型通常能完成粗粒度的二值AWB判断，但在数值CCT估计和部分精细色差判断上表现较弱。在ColorChecker-24刺激上，三个闭源前沿模型的CCT平均绝对误差为715-1056 K，五个开源权重模型为1358-2133 K；非ColorChecker对照表明该优势部分依赖模板。

Insight: 论文的创新点在于提出覆盖多类颜色判断任务的CIE可计算真值基准，并揭示MLLM具备颜色词和粗视觉先验、但精细色差校准不可靠的问题。客观来看，其价值在于将多模态模型颜色能力评测与色度学指标及模板偏差控制结合，提供了更可量化的诊断方式。

Abstract: Multimodal large language models (MLLMs) are now used as zero-shot judges of image quality, but their color judgments are rarely tested with colorimetric ground truth. We present a five-task benchmark based on the CIE colorimetric framework: AWB pair judgment, skin-tone bias direction, CCT estimation, CIE Delta E 2000 pair ordering, and color naming under changing illuminants. We test eight MLLM endpoints, including four Qwen3-VL variants, GLM-4.5V, GPT-5.4, Claude-Opus-4.7, and Gemini-3.1-Pro. The models often solve coarse binary AWB judgments, but they remain weak on numeric CCT estimation and on some fine color-difference judgments. On ColorChecker-24 stimuli, the three closed-weight frontier models reach CCT MAE of 715-1056 K, compared with 1358-2133 K for the five open-weight models. A non-ColorChecker control shows that this advantage is partly template-dependent. The results suggest that current MLLMs have useful color words and coarse visual priors, but their color judgments are not reliably calibrated to CIE-computable color differences.

[146] TaskFrame: Connecting Task-Level Planning with Frame-Level Control for Game Agents cs.CV | cs.AIPDF

Guangzhi Wang, Junfu Pu, Yiran Wang, Xingyilang Yin, Honghao Chen

TL;DR: 论文提出 TaskFrame，一个连接任务级规划与帧级键鼠控制的层次化规划器-控制器框架，用于构建通用游戏智能体。视觉语言任务规划器将高层目标分解为原子指令序列，控制器基于目标嵌入和近期观测在每个游戏帧输出离散键鼠动作与连续相机运动。系统采用规划器训练、控制器预训练和联合对齐三阶段训练。

Details

Motivation: 通用游戏智能体既需要高层任务推理，又需要在快速变化的视觉环境中进行低延迟动作控制；这两类能力对应的模型计算特性差异很大，难以用单一模型同时实现。

Result: 在 Minecraft 实验中，TaskFrame 的指令分解能力与通用视觉语言模型相当；在闭环评估中，智能体的战斗成功率高于所评估的基线方法。

Insight: 创新点在于层次化规划器-控制器架构：用视觉语言规划器生成原子指令，并将终止指令的特殊目标 token 隐状态作为可缓存复用的连续目标嵌入；因果 Transformer 控制器结合目标嵌入与近期观测预测离散键鼠动作和连续相机运动，并通过三阶段训练实现规划与控制对齐。

Abstract: Building general game agents requires both high-level task reasoning and low-latency action control in rapidly changing visual environments. These capabilities favor models with substantially different computational profiles, making them difficult to realize within a single model. In this work, we present TaskFrame, a hierarchical planner-controller framework that connects task-level planning with frame-level keyboard-and-mouse control. A vision-language task planner decomposes a high-level goal into an ordered sequence of atomic instructions and is optimized through supervised learning and dependency-aware GRPO. The hidden states of special goal tokens that terminate each atomic instruction provide continuous goal embeddings that are cached and reused across control steps. A causal Transformer controller combines the embedding of the active goal with recent observations to predict discrete keyboard and mouse-button actions and continuous camera motion at every game step. We train the system in three stages: planner training, controller pretraining, and joint alignment. Experiments in Minecraft show that TaskFrame is competitive with general-purpose vision-language models on instruction decomposition, and that in closed-loop evaluation the agent achieves a higher combat success rate than the evaluated baselines.

[147] LoRe-MIM: Lost-or-Replaced Masked Image Modeling for Self-Supervised Representation Learning in Whole-Body PET/CT cs.CVPDF

Amartya Bhattacharya, Bashirul Azam Biswas, Biratal Raj Wagle, Michael S. Leapman, Matthew E. Maeder

TL;DR: 论文针对全身PET/CT标注稀缺问题，构建了包含6,531例多中心、多示踪剂全身PET/CT扫描的数据集，并提出LoRe-MIM自监督框架，通过掩码图像重建学习多模态表示。其核心是让掩码区域要么置零（Lost），要么替换为对应互补模态（Replaced），以同时捕获模态特有信息和跨模态关系。

Details

Motivation: 全身PET/CT深度学习模型依赖专家标注，时间和成本高；自监督学习虽可缓解标注稀缺，但在全身PET/CT上因大规模数据有限和跨模态互补表示学习困难而研究不足。

Result: 在多模态PET/CT图像重建、patch级癌症/非癌症分类、全身病灶分割、标签高效训练和鲁棒性评估等下游任务上，LoRe-MIM均一致优于相应的最先进基线。

Insight: 创新点在于提出Lost-or-Replaced掩码策略，将掩码区域置零或替换为互补模态图像，以自监督方式学习模态特异特征与跨模态关系；客观上其价值还体现在构建多中心、多示踪剂全身PET/CT数据集并系统验证表示学习效果。

Abstract: Deep learning models for whole-body positron emission tomography/computed tomography (PET/CT) hold significant clinical potential for disease detection, treatment planning, and response assessment. However, the time and cost associated with expert annotations remain major bottlenecks in developing robust and generalizable models. Although self-supervised learning (SSL) has emerged as a promising approach to mitigating annotation scarcity, its application to whole-body PET/CT remains relatively underexplored due to the limited availability of large-scale datasets and the challenges associated with learning complementary cross-modal representations. To address these limitations, we curate a heterogeneous, multi-tracer, multi-institutional cohort comprising 6,531 whole-body PET/CT scans and propose LoRe-MIM (Lost-Or-Replaced Masked Image Modelling), a novel self-supervised framework designed to learn multimodal representations through masked image reconstruction. Specifically, LoRe-MIM introduces a masking strategy in which image regions are either replaced with zeros (Lost) or substituted with corresponding complementary imaging modality (Replaced), encouraging the model to capture both modality-specific characteristics and cross-modal relationships. We evaluate the learned representations across multiple downstream tasks, including multimodal PET/CT image reconstruction, patch-based classification into cancer vs. non-cancer, whole-body lesion segmentation, label-efficient training, and robustness assessment. Experimental results demonstrate that LoRe-MIM consistently outperforms the corresponding state-of-the-art baselines across these tasks, highlighting its potential as a scalable and generalizable self-supervised learning framework for whole-body PET/CT analysis.

[148] Textual Response-Aware Guidance for Zero-Shot Adversarial Robustness of Vision-Language Models cs.CVPDF

Yubo Cui, Xianchao Guan, Zheng Zhang

TL;DR: 论文关注视觉语言模型（VLMs）在零样本场景下的对抗鲁棒性问题。作者分析发现，现有对抗微调中的预训练引导方式存在互补缺陷：匹配视觉特征覆盖广但缺乏语义重点，匹配预测分布有语义重点但受候选文本和预测概率限制。为此提出文本响应感知引导（TRAG），利用预训练文本编码器对输入嵌入局部变化的响应来约束视觉表示漂移，并通过图像-锚点相关性聚合锚级约束，形成图像自适应约束。实验表明该方法在多种架构和任务上取得SOTA的干净与鲁棒性能，并有助于保持预训练图文关系。

Details

Motivation: VLMs零样本泛化能力强但对对抗攻击脆弱；现有对抗微调虽用预训练模型引导保持图文对齐，但视觉特征匹配和预测分布匹配各有局限，可能损害预训练图文关系并降低零样本性能。

Result: 摘要在多种架构和任务上的广泛实验显示，TRAG取得SOTA的干净性能和鲁棒性能；进一步分析表明其有助于保持预训练的图像-文本关系。摘要未给出具体数值或具体benchmark分数。

Insight: 创新点在于用预训练文本编码器对输入嵌入局部变化的响应方向和幅度构造语义锚点级约束，并借助预训练图像-锚点相关性聚合为图像自适应约束，从而在保留语义重点的同时约束视觉表示漂移。客观看，该方法将文本编码器的响应信号引入对抗微调引导，兼顾全局特征约束的覆盖性与预测分布约束的语义性，并规避候选文本和预测概率的限制。

Abstract: Vision-language models (VLMs) exhibit strong zero-shot generalization but remain vulnerable to adversarial attacks. Existing adversarial fine-tuning methods often use pre-trained model guidance to preserve image–text alignment while improving robustness. Our analysis of visual representation drift reveals complementary limitations of two representative forms of guidance. Matching visual features provides broad coverage by constraining all directions equally, but lacks semantic emphasis. Matching prediction distributions prioritizes semantically relevant directions, but remains limited by the candidate texts and prediction probabilities. These limitations can hinder preservation of pre-trained image–text relationships and degrade zero-shot performance. To address these issues, we propose Textual Response-Aware Guidance (TRAG), which constrains visual representation drift using the pre-trained text encoder’s responses to local variations in input embeddings. Specifically, TRAG constructs anchor-level constraints from the response directions and magnitudes around semantic anchors, then aggregates them using pre-trained image–anchor relevance, yielding an image-adaptive constraint. Extensive experiments across architectures and tasks demonstrate state-of-the-art clean and robust performance. Further analysis shows that TRAG helps preserve pre-trained image–text relationships.

[149] RFW-A: Agentic Procedural Generation of 400K Articulated Assets over 500 Categories cs.CVPDF

Yuanbo Lyu, Changjian Pan, Saining Zhang, Yi Yang, Peishuo Li

TL;DR: 论文提出 RFW-A，将智能体程序合成与程序化生成结合，用于大规模生成铰接资产。方法从已有铰接程序出发，把可复用组件及依赖组织为类别级生成器，由智能体采样配置和运动状态进行测试与精炼；生成器验证后可通过程序执行批量产出资产，无需继续调用模型。作者构建了覆盖 500 多类、超过 40 万个仿真就绪铰接资产的 RFW-A-400K，并验证其结构/运动学有效性及下游训练和零样本迁移效果。

Details

Motivation: 高质量铰接资产对具身感知、仿真和操作很重要，但人工标注和程序建模成本高；现有智能体合成方法虽能自动构建资产，却需为每个新资产重复昂贵的推理与精炼。论文观察到同一类别资产可共享构造逻辑，因此希望将智能体合成与程序化生成结合，以降低规模化生成成本。

Result: RFW-A 构建的 RFW-A-400K 包含 40 万以上、500 多类仿真就绪铰接资产，实验显示较高结构和运动学有效性，并能在物理模拟器中稳定执行。成本上，生成器编写平均约 10.62 美元，按 200 个资产摊销约 0.05 美元/资产，低于逐资产智能体合成基线的 1.24 美元/资产；用该数据训练可提升可见和未见类别的部件级铰接估计，仿真策略结合检索和程序编辑资产可零样本迁移到真实铰接物体。

Insight: 核心创新是把类别内共享的构造逻辑抽象为可复用、可测试和可精炼的类别级生成器，使智能体只需构建并验证一次程序，后续通过程序化执行摊销模型调用成本。客观看，其价值在于将智能体程序合成从逐资产生成转为类别级程序复用，并以大规模数据集和下游任务验证了该范式的有效性。

Abstract: High-quality articulated assets are essential for embodied perception, simulation, and manipulation, yet constructing them at scale remains difficult. Manual annotation and procedural modeling require substantial human effort. Recent agentic systems automate asset construction through program synthesis, but repeat costly reasoning and refinement for every new asset. Our key observation is that assets within a category can share construction logic despite variations in structure and appearance. Agentic synthesis and procedural generation are therefore complementary: agents can construct reusable programs, while procedural execution reuses the resulting logic across many samples. We therefore present RFW-A, which combines the two in a new articulated-asset generation paradigm. Starting from existing articulated programs, RFW-A organizes reusable components and their dependencies into category-level generators. Agents test and refine these generators across sampled configurations and motion states. Once constructed and validated, the generators produce diverse assets through procedural execution with no further model calls or token charges. The estimated API cost of generator authoring averages $10.62, amortizing to $0.05 per asset over 200 assets, versus $1.24 for the sampled per-asset agentic synthesis baseline. Using RFW-A, we built RFW-A-400K, containing over 400K sim-ready articulated assets across more than 500 categories. Experiments show high structural and kinematic validity and stable execution across physics simulators. Beyond asset validity, training with RFW-A-400K improves part-level articulation estimation on seen and unseen categories, while policies trained in simulation with retrieved and program-edited assets transfer zero-shot to real articulated objects.

[150] Wizard: Manipulate Any World in Real Time via Agentic Control cs.CVPDF

Yuzhe Wu, Zijun Lin, Yeying Jin

TL;DR: 论文提出Wizard，一种agentic游戏世界模型，可实时、精确控制角色运动，并零样本泛化到新场景、角色和动作。方法构建覆盖750个场景和178个角色的数据集，以骨架和几何信息作为结构化中间代理条件视频生成模型，并结合自适应掩码机制和显式维护游戏状态的agentic框架，实现玩家可配置、细粒度可控且视觉与玩法一致的虚拟世界模拟。

Details

Motivation: 现有agentic视频世界模型仅支持简单游戏设置和预定义运动模式，对未见环境和角色泛化差，实时交互能力有限；论文旨在实现实时、精确、可泛化且机制一致的角色运动控制与玩家驱动世界创建。

Result: 摘要未给出具体定量指标或benchmark对比，仅定性宣称方法可实现实时精确控制、跨新场景/角色/动作的零样本泛化，并在保持视觉质量和游戏一致性的同时支持玩家自由配置虚拟世界。

Insight: 创新点在于构建多场景多角色数据集，利用骨架与几何结构化表示作为中间代理来条件化视频生成，并引入自适应掩码提升条件信号与生成视频的对齐；同时用agentic框架显式维护和更新游戏状态，将结构化代理生成与代理控制结合，增强可控性、泛化性和实时交互性。

Abstract: Recent advances in video world models have enabled the generation of increasingly realistic and interactive virtual environments, opening new possibilities for player-customizable gameplay. Agentic frameworks further advance this direction by decoupling explicit game logic and controllable world representations from visual generation. However, existing approaches support only simple game settings and predefined motion patterns, generalize poorly to unseen environments and characters, and offer limited real-time interactivity. In this paper, we introduce Wizard, an agentic game world model that enables real-time, precise control over character motions while generalizing zero-shot across novel scenes, characters, and actions. To achieve this, we construct a diverse dataset spanning 750 scenes and 178 characters, incorporating skeleton and geometry information as structured representations. We leverage these representations as intermediate proxies to condition a video generation model, together with an adaptive masking mechanism that improves alignment between the conditioning signals and generated video rollouts. Furthermore, we introduce an agentic framework that explicitly maintains and updates game states, allowing players to freely configure their virtual worlds and exercise fine-grained control over character motions while preserving visual quality and gameplay consistency. By combining agentic control with structured proxy-based generation, our framework unlocks new possibilities for player-driven game creation with real-time, generalizable, and mechanically consistent world simulation.

[151] HiFOR: Hierarchical Foresight with Action-Guided World Grounding for Vision-Language-Action Model cs.CV | cs.ROPDF

Rongxing Ding, Hongyu Qu, Kehong Wu, Xudong Wang, Fan Zhang

TL;DR: 论文提出 HiFOR，一种面向视觉-语言-动作模型的分层前瞻框架，通过联合预测短期状态演化、语义里程碑和最终目标，并构建结构化的未来潜在世界，再根据动作表示自适应检索相关未来信息来指导动作生成。该方法旨在让未来预测更贴合当前动作需求，从而提升机器人操作中的环境动态理解与任务执行能力。

Details

Motivation: 现有 VLA 方法往往将短期动态与长期任务目标分开建模，并且直接把预测未来引入动作策略，未充分考虑其与当前动作需求的相关性。论文希望解决未来预测与动作生成之间缺乏分层依赖和针对性检索的问题。

Result: 摘要称在两个仿真 benchmark 和六个真实世界机器人操作任务上进行了大量实验，验证了方法的有效性；但未给出具体定量指标或明确 SOTA 结论。

Insight: 创新点在于分层前瞻预测联合建模短期状态、语义里程碑和最终目标，并通过分层依赖掩码建立跨时间范围依赖；同时用结构感知潜在世界建模组织多维度未来表示，并在去噪过程中以动作引导的因子化检索自适应选取相关未来信息。客观上看，将未来预测从直接条件输入转变为按动作需求检索的结构化世界知识，是其较有借鉴价值的设计。

Abstract: Vision-Language-Action (VLA) models have demonstrated promising capabilities in robotic manipulation by integrating visual perception, language understanding, and action generation. Recent advances have further incorporated future prediction to enhance the understanding of environmental dynamics and task progression. However, existing methods often model short-term dynamics and long-term task objectives separately, while directly incorporating predicted futures into action policies without sufficiently considering their relevance to current action requirements. To address these limitations, we propose HiFOR, a hierarchical foresight framework with action-guided world retrieval. Specifically, Hierarchical Foresight Prediction jointly predicts short-term state evolution, semantic milestones, and final goal states through a Hierarchical Dependency Mask (HDM), establishing dependencies across temporal horizons. Building upon these predictions, Structure-Aware Latent World Modeling organizes future latent representations along the horizon, view, and spatial dimensions to facilitate fine-grained retrieval. Furthermore, Action-Guided Factorized World Retrieval adaptively retrieves relevant future information from the structured latent world based on evolving action representations during denoising, providing targeted guidance for action generation. Extensive experiments on two simulation benchmarks and six real-world robotic manipulation tasks demonstrate the effectiveness of our approach.

[152] Soil Moisture Estimation in Precision Agriculture: A Knowledge Distillation Approach cs.CV | cs.LGPDF

Mohammed Rakib, Vrinda Nagula, Arunkumar Bagavathi

TL;DR: 论文面向精准农业中的土壤湿度估计，提出基于知识蒸馏的多模态学习框架SMD，利用单模态教师模型增强融合气象数据与视觉数据（土壤斑块/作物图像）的多模态学生模型，从而在降低高分辨率图像分析成本的同时提升预测精度。

Details

Motivation: 传统方法依赖气象和土壤属性数据，引入航空或地理影像虽能提供视觉信息，但高分辨率图像成本高且计算负担大；论文希望更有效地利用气象与视觉多模态数据进行精准土壤湿度估计。

Result: SMD优于传统多模态融合方法MIS-ME及单模态模型；相比SOTA基线，在土壤斑块上MAPE提升2%，在作物图像上提升1.2%，并表明作物图像比土壤斑块提供更优视觉线索。

Insight: 创新点在于提出知识蒸馏驱动的多模态框架，用单模态教师指导多模态土壤湿度估计，并系统比较土壤斑块与作物图像的视觉提示效果；客观看，其价值在于以KD方式融合气象与视觉信息并验证作物图像对预测更有效。

Abstract: Accurate soil moisture estimation is critical for precision agriculture, influencing irrigation, fertilization, and harvesting strategies. Traditional methods primarily rely on meteorological and soil property data, while recent approaches incorporate visual modalities such as aerial and geospatial imagery. However, these high-resolution images are expensive and computationally demanding to analyze. In this work, we propose Soil Moisture Distillation (SMD), a Knowledge Distillation (KD)-based multimodal learning framework that leverages unimodal teachers to enhance multimodal soil moisture estimation. SMD surpasses not only traditional multimodal fusion techniques, including MIS-ME, but also outperforms unimodal models, demonstrating the benefits of guided unimodal knowledge transfer. Additionally, we conduct a comparative analysis of soil patches and crop images, showing that crop images provide superior visual cues, leading to improved prediction accuracy. SMD achieves a 2% improvement in MAPE for soil patches and 1.2% for crops over state-of-the-art baselines, highlighting the effectiveness of leveraging both meteorological and visual data through knowledge distillation for enhanced soil moisture forecasting.

[153] PhysInsert: Physically Plausible Object Insertion with Geometric Priors and Bidirectional Object-Scene Interactions cs.CVPDF

Yue Gong, Le Zhang, Rui Chen, Song Chang, Xiaochao Qu

TL;DR: 论文提出PhysInsert框架，用于基于参考图像进行物理合理的物体插入，并联合适配物体与周围场景。方法构建了严格对齐的Insert World数据集，结合VGGT几何先验、图像/文本流和2D物体-场景空间监督，实现跨视角与跨光照条件下的姿态和光照适配。论文还提出PhysInsert-Bench，并在该benchmark和DreamBooth上验证图像保真度及用户感知的放置、光照、透视和姿态合理性。

Details

Motivation: 现有参考物体插入方法依赖掩码输入、生成式配对或视角变化有限的训练数据，导致姿态与光照适配以及物体-场景双向交互约束不足，难以实现物理合理的插入效果。

Result: 论文构建Insert World数据集和PhysInsert-Bench，包含跨环境与跨视角案例；在PhysInsert-Bench和DreamBooth上实验表明图像保真度提升，用户研究显示物体放置更准确，光照整合、透视和姿态合理性更好。

Insight: 创新点在于用VGGT几何流与图像、文本流在目标场景特征监督下进行几何引导适配，并通过2D物体-场景空间监督联合约束物体占据与环境变化，同时以严格对齐的Blender反事实配对数据强化姿态、光照和双向交互建模。

Abstract: We present PhysInsert, a framework for physically plausible reference-based object insertion that jointly adapts objects and their surrounding scenes. Existing methods often rely on masked inputs, generation-based pairs, or training pairs with limited viewpoint variation, leaving pose and illumination adaptation and bidirectional object-scene interactions insufficiently constrained. We construct the Insert World dataset with strictly aligned Blender-rendered counterfactual pairs and object references across viewpoints and lighting conditions. Building on these data, Geometry-Guided Adaptation couples a VGGT geometry stream with image and text streams under target-scene feature supervision to guide spatially consistent insertion. Complementary 2D Object-Scene Spatial Supervision jointly supervises object occupancy and environmental changes while grounding spatial instructions in object regions through image-text attention. We introduce PhysInsert-Bench with dedicated cross-environment and cross-view cases requiring illumination and pose adaptation beyond appearance copying. Experiments on PhysInsert-Bench and DreamBooth demonstrate improved image fidelity; a user study further shows more accurate placement and improved lighting integration, perspective, and pose plausibility.

[154] A Unified Benchmark for Aerial-Enhanced Autonomous Driving: The KITScenes Aerial Dataset cs.CVPDF

Daniel Lengerer, Richard Schwarzkopf, Jonas Merkert, Fabian Immel, Rupert Polley

TL;DR: 论文提出 KITScenes Aerial，这是一个在 KITScenes 多模态数据基础上扩展得到的统一空中-地面自动驾驶基准数据集，将同步车载传感器数据、车辆位姿、Lanelet2 地图标注与空间关联的航空影像和高分辨率神经表示结合，用于统一研究航空影像辅助建图、在线 HD 建图和跨视角定位等任务。

Details

Motivation: 航空影像能提供超出车载传感器即时感知范围的道路空间结构，但现有航空建图、航空辅助在线 HD 建图和跨视角定位通常基于不同数据和基准分别研究，缺乏统一评估基础。

Result: 建图评估覆盖 53 类地图元素并兼容三类设置；实验显示航空上下文对细粒度、扩展范围建图尤其有益，在更大建图范围下 53 类 mAP 提升超过一倍，更高分辨率航空影像进一步带来 4.3 mAP（+24%）提升，并惠及红绿灯等困难元素；跨视角定位在地理不相交条件下取得 5.13 m 平均平移误差。

Insight: 创新点在于构建统一空中-地面基准，将车载同步数据、位姿、Lanelet2 标注、航空影像和高分辨率神经表示空间关联，并统一评估建图与跨视角定位任务；其价值在于为航空辅助自动驾驶提供可复现、跨任务、细粒度的标准化实验平台。

Abstract: Aerial imagery provides complementary spatial context for autonomous driving by exposing road structure beyond the immediate perception range of onboard sensors. Yet map construction from aerial imagery, aerial-assisted online HD mapping, and cross-view localization are typically studied on separate data and benchmarks. We introduce KITScenes Aerial, an extension of the KITScenes Multimodal dataset that augments synchronized onboard sensor data, vehicle poses, and rich Lanelet2 map annotations with spatially associated aerial imagery and higher-resolution neural representations, providing a common basis for a variety of research tasks. Our mapping evaluation focuses on all 53 KITScenes map classes across different model designs, spatial ranges, and aerial resolutions, while retaining compatibility with the widely used three-class setting. Representative baselines show that aerial context is particularly beneficial for fine-grained and extended-range mapping, more than doubling 53-class mAP at the larger mapping extent. Higher-resolution aerial imagery yields a further 4.3 mAP (+24 %) improvement, with gains extending to challenging map elements such as traffic lights. We additionally evaluate cross-view localization under geographically disjoint conditions, where an adapted fine-grained feature-matching baseline achieves a mean translation error of 5.13 m. KITScenes Aerial thus enables unified study of aerial and ground-level information across complementary mapping and localization tasks. Project page: https://kitscenes.com/aerial

[155] AVPS-360: A Spatial Audio-Visual Benchmark for Instance Segmentation and Tracking of Sound-Producing Persons cs.CVPDF

Yifu Sun, Parthasaarathy Sudarsanam, Tuomas Virtanen, Archontis Politis

TL;DR: 论文提出 AVPS-360，一个基于 STARSS23 构建的空间音频-视觉基准，用于发声人物的实例分割与跟踪。它将一阶 Ambisonics 空间音频与同步 360° 视频配对，包含 230 段、共 10.5 小时录像和 31,678 个人工审核实例掩码，并连接 AVIS 与 SELD 任务。论文还给出融合空间音频与视觉特征的基线方法，用于帧级分割和跨帧身份关联。

Details

Motivation: 现有音视频实例分割基准多使用单声道音频，缺乏通道间线索，难以在空间上区分同时发声的多个声源，也难处理真实长视频中间歇发声和身份关联问题。

Result: 实验表明现有 AVIS 方法在长录像、间歇发声场景下的检测和身份关联表现不佳，而论文基线在检测与身份关联两方面均显著提升；摘要未给出具体定量指标。

Insight: 创新点在于构建空间音频与 360° 视频同步的发声人物分割跟踪基准，桥接 AVIS 与 SELD，并提供与源身份和声音事件标签关联的大规模人工审核掩码；同时提出融合空间音频和视觉特征的基线，为跨帧身份关联提供可借鉴方案。

Abstract: Audio-visual instance segmentation (AVIS) segments and tracks individual sound-producing objects in videos. Existing benchmarks predominantly use monaural audio, which lacks inter-channel cues for spatially distinguishing concurrent sound sources. We introduce AVPS-360 (Audio-Visual Person Segmentation 360), a spatial audio-visual benchmark bridging AVIS and sound event localisation and detection (SELD). Built upon STARSS23, it pairs first-order Ambisonics audio with synchronised 360° video across 230 recordings totalling 10.5 hours. Recordings average 164.0 seconds. The dataset captures intermittent sound production in real-world interactions dominated by speech, alongside laughter, clapping, and footsteps. It provides 31,678 manually reviewed instance masks linked to source identities and sound-event labels. We also present a baseline that integrates spatial audio with visual features for frame-level segmentation and identity association across frames. Experiments on AVPS-360 show that existing AVIS methods struggle with detection and identity association in long recordings with intermittent sound production, while our baseline substantially improves performance in both aspects.

[156] LucidLyra: Feed-Forward Generative 3D Scene Reconstruction and Joint Understanding via Multi-Task Distillation cs.CVPDF

Oliver Hahn, Rodrigo Marcuzzi, Sangeetha Grama Srinivasan, Alessandro Burzio, Sherwin Bahmani

TL;DR: 论文提出 LucidLyra，一个前馈式框架，可从视频潜变量生成并理解 3D 场景：联合推断编码几何、外观、开放词汇语义和类无关实例线索的 3D Gaussians。生成后的 3D 场景可直接查询语义与实例，支持新视角渲染、开放词汇分割和对象分组，并可扩展到单目视频动态场景。

Details

Motivation: 生成式 3D 重建虽能合成虚拟环境，但机器人和物理 AI 等下游应用还需要场景语义和对象身份。现有 3D 理解方法依赖多视角捕获、泛化有限，或需要昂贵的逐场景优化，因此论文希望将生成式 3D 重建与可查询的 3D 理解统一起来。

Result: 论文方法在精心构建的合成和真实图像条件基准上，优于将 SOTA 3DGS 分割方法与生成式 3D 场景重建结合的基线，同时保持重建质量；且无需逐场景优化即可支持开放词汇分割和对象分组。

Insight: 创新点在于通过多任务蒸馏，将相机控制视频扩散模型和冻结 2D 视觉基础模型的知识统一到前馈 3D Gaussian 模型中，同时编码几何、外观、开放词汇语义和实例线索；训练不需要人工 3D 标注或捕获多视角数据，并可自然扩展到单目视频动态 3D 场景。

Abstract: We present LucidLyra, a framework that makes generatively reconstructed 3D scenes directly queryable for semantics and instances in a feed-forward manner from video latents. While generative 3D reconstruction can synthesize virtual environments from a single image, downstream applications in robotics and physical AI require not only visual realism but also access to scene semantics and object identities. Existing 3D understanding approaches, however, require captured multi-view scenes, have limited generalization capabilities, or rely on expensive per-scene processing and optimization. To bridge this gap, our method distills complementary knowledge from a camera-controlled video diffusion model and frozen 2D vision foundation models into a unified model to jointly infer 3D Gaussians encoding geometry, appearance, open-vocabulary semantics, and class-agnostic instance cues. The resulting scenes support novel-view rendering, open-vocabulary segmentation, and object grouping without per-scene optimization, while training requires neither manual 3D annotations nor captured multi-view data. Our method outperforms baselines combining state-of-the-art 3DGS segmentation approaches with generative 3D scene reconstruction on curated synthetic and real-image-conditioned benchmarks, while preserving reconstruction quality. Furthermore, our latent formulation naturally extends to monocular video, reconstructing structured dynamic 3D scenes across time. By turning renderable but unstructured outputs into queryable 3D worlds, LucidLyra enables downstream applications including 3D scene editing, 3D asset mining, and robotic simulation.

Aadith Warrier, Gnana Prakash Punnavajhala, Siddharth Tourani, Muhammad Haris Khan, Avinash Sharma

TL;DR: 论文研究跨模态场景与实例检索，即给定2D查询图像检索对应的3D环境或物体。现有方法仅在整个场景或物体级别学习2D-3D对齐，缺乏局部结构监督。作者提出CrossWeave，利用稀疏2D-3D patch-point对应监督训练单一模型，并结合基于最优传输的特征聚合器，同时完成场景级和实例级检索。

Details

Motivation: 现有跨模态检索方法只依赖场景级或实例级对比学习，无法为场景/物体内部的细粒度局部结构提供监督，且通常需要为场景和实例任务分别训练模型。论文希望用稀疏局部2D-3D对应作为更有效、更灵活的监督信号，统一两类检索任务。

Result: CrossWeave在ScanNet和3RScan上的场景级与实例级检索均达到SOTA，且仅需一个统一模型；现有方法通常需要为不同任务使用独立模型。实验还表明，仅使用稀疏patch-point对齐即可超过现有方法，加入最优传输聚合器后进一步提升。

Insight: 创新点在于用稀疏2D-3D局部对应替代整场景/整实例级对比目标，证明局部对应监督足以训练统一的跨模态检索模型；并通过最优传输聚合器聚类结构冗余区域，将描述子容量释放给语义不同的局部特征。客观看，其价值在于简化监督形式并统一场景与实例检索范式。

Abstract: Cross-modal scene and instance retrieval aims to retrieve a corresponding 3D environment or object given query 2D images, serving as a foundational mechanism for spatial reasoning in robotics and AR/VR. Existing methods achieve this by learning alignment only at the level of whole scenes or objects, which provides no supervision for the fine-grained local structure within them. In this work, we show that supervision on a set of sparse 2D-3D correspondences, without scene- or instance-level contrastive objectives, is sufficient to train a single model for both scene- and instance-level retrieval. Specifically, we propose $\textbf{CrossWeave}$, a novel framework for cross-modal retrieval that learns sparse patch-point alignment, which alone outperforms existing methods. An optimal transport-based aggregator over the aligned features gives further gains by clustering structurally redundant regions, freeing descriptor capacity for semantically distinct local features. CrossWeave achieves state-of-the-art performance on both scene- and instance-level retrieval on ScanNet and 3RScan with a $\textit{single model}$, whereas existing methods require separate models for each task. Our results suggest that whole-scene encoding is unnecessary for cross-modal retrieval and that sparse local correspondence supervision is a more effective and flexible alternative.

[158] PhysCount: Do MLLMs Count Visual Appearances or Physical Entities? cs.CVPDF

Lidong Lu, Jiaxin Lv, Liangrui Dong, Xinyi Mao, Lidong Zou

TL;DR: 论文提出 PhysCount 基准，用于评估多模态大模型是否能区分图像中“可见外观”与场景中“物理实体”。该基准包含 546 张真实图像、4595 个人工问题，组织为 651 个目标特定组，并通过四类互补问题测试外观枚举、物理实体枚举、成像方式相关计数和外观-实体对应关系。结果显示，当前 MLLM 更容易计数可见外观，但难以恢复这些外观背后的同一物理实体。

Details

Motivation: 现有视觉计数基准很少区分“看到多少外观”和“场景中有多少物理实体”，而反射、玻璃等会使同一实体产生多个可见外观，导致模型可能错误计数。论文旨在系统评估 MLLM 是否具备从视觉外观推断物理实体的能力。

Result: 在 40 个 MLLM 上，计数可见外观明显易于恢复实体身份；最强模型也仅能在 13.36% 的问题组中全部答对。当同一实体产生多个外观或外观跨越不同观察方式时性能下降；提高图像分辨率对完整组准确率提升有限，而联合回答相关问题有显著改善。

Insight: 创新点在于构建了区分外观计数与物理实体计数的真实图像基准，并设计四类问题覆盖成像方式、实体对应和联合推理。其可借鉴之处是强调视觉计数不应停留在可见实例检测，而应显式建模同一实体在不同观察条件下的对应关系，并通过联合问答促进推理。

Abstract: Images reveal appearances, but counting often asks about physical objects. A single entity may be visible directly, in several reflections, or through glass, so detecting every visible occurrence does not determine how many entities are present. Existing visual counting benchmarks rarely separate these two operations. We introduce PhysCount, a benchmark for evaluating whether multimodal large language models (MLLMs) can distinguish what appears in an image from what physically exists in the scene. PhysCount contains 546 real-world images and 4,595 human-written questions organized into 651 target-specific groups. For each group, annotators locate the relevant appearances, label how each is observed, and identify appearances of the same entity. Four complementary question families test the enumeration of appearances, the enumeration of physical entities, image-formation-specific counting, and appearance–entity correspondence. We measure both accuracy on each family and the proportion of groups answered entirely correctly. Across 40 MLLMs, counting visible appearances is substantially easier than recovering the identities that connect them. Even the strongest model answers every question correctly in only 13.36% of groups. Performance declines when one entity produces many appearances or when its appearances cross observation modes. Higher image resolution improves access to visual evidence but brings limited gains in complete-group accuracy, whereas answering related questions jointly produces a marked improvement. These results expose a gap between recognizing what is visible and correctly recovering the physical entities behind those observations.

[159] RADIOlogy: A Single-Pass Approach to Training-Free Zero-Shot Anomaly Detection cs.CVPDF

Joaquín Figueira, Giacomo D’Amicantonio, Egor Bondarau

TL;DR: 论文提出 RADIOlogy，一种无需训练、无需滑窗密集执行的单次零样本异常检测方法。作者发现视觉语言模型中的多头注意力池化天然具备较强的零样本异常定位与检测能力，并据此用视觉特征与正常/异常提示的平均相似度进行对比评分，同时利用 RADIO 模型的聚合特征进行像素级异常细化。

Details

Motivation: 现有零样本异常检测方法常依赖复杂提示学习或计算昂贵的滑窗策略来检测小尺度异常，因为标准 CLIP 架构的 [CLS] 注意力和空间 patch 池化难以捕捉细微局部异常；而提示学习方法又常需大量辅助数据的分割掩码，在专业领域难以获得。

Result: 摘要未给出具体数据集和数值，但宣称 RADIOlogy 无需密集窗口执行，并在训练无关基线中显著优于其他方法；同时可通过少量修改成功应用于医学领域的零样本异常检测。

Insight: 创新点在于揭示并利用视觉语言模型中多头注意力池化的开箱即用零样本异常定位能力，将异常检测转化为单次正常/异常提示对比评分，并借助 RADIO 聚合特征进行密集异常细化，从而避免提示学习和滑窗带来的额外训练与计算开销。

Abstract: Current zero-shot anomaly detection methods often rely on complex prompt-learning techniques or computationally expensive sliding-window strategies to achieve fine-grained visual alignment to detect small-scale anomalies. This reliance stems from the fundamental limitation of standard CLIP architectures, where [CLS] token attention and spatial patch pooling struggle to capture subtle, localized anomaly features. While prompt-learning approaches aim to bridge this gap, they typically require a large number of ground-truth segmentation masks from auxiliary datasets, which are often unavailable in specialized domains. In this work, we show an emerging property of multi-head attention pooling in vision-language models: remarkable zero-shot anomaly localization and detection right out of the box. We translate this property into a single-pass anomaly detection technique, RADIOlogy, that does not require dense, windowed execution and significantly outperforms other training-free baselines. Instead, the method relies on a simple contrastive scoring approach that compares the average similarity between vision features and a suite of normal and abnormal prompts. Furthermore, we leverage the agglomerative features of RADIO models to enhance pixel-level anomaly segmentation using a dense anomaly refinement pipeline. Finally, we show how the vision-language family of training-free zero-shot anomaly detection techniques can be applied successfully to the medical domain with minimal modifications. Code is available at https://github.com/jacomof/RADIOlogy.

[160] Fight World Model: Customizable Combat through Visual Interaction Proxies cs.CVPDF

Jiahua Li, Zixu John, Tom Zhong, Fuping Wu, Tianhao Xu

TL;DR: 论文提出Fight World Model（FWM），将受规则约束的战斗执行与视频渲染分离：由可执行引擎维护状态并结算交互，再由确定性编译器把结果和尝试动作编码为时空对齐的交互代理，用于条件化视频生成。模型在FightWorld Corpus上训练，支持伤害缩放、限伤免疫、吸血、多阶段技能等原生游戏外规则，并支持角色与竞技场定制。

Details

Motivation: 现有视频世界模型虽能生成看似合理的战斗画面，但难以保证受击反应、血量更新等与游戏规则一致，缺乏持久状态和可扩展玩法机制。

Result: 实验表明FWM在动作保真度、受击反应、血量状态一致性和角色外观保持方面优于现有游戏世界模型；训练数据涵盖52种技能效果、187种角色外观变体和15个竞技场，且无需重训练渲染器即可支持多种修改规则。

Insight: 创新点在于将规则执行与视频渲染解耦，并用确定性编译器生成时空对齐的交互代理来显式控制动作窗口、受击反应和持久血量；身份绑定参考还能在换边时保持角色外观，为可定制、可编程游戏世界建模提供了可借鉴方案。

Abstract: A playable, programmable game world must maintain persistent state, enforce executable rules, and support extensible gameplay mechanics. Existing video world models can generate plausible combat, yet struggle to keep hit reactions and health updates consistent with game rules. We introduce Fight World Model (FWM), which separates rule-governed combat execution from video rendering. An executable engine maintains state and resolves interactions. A deterministic compiler encodes these outcomes and attempted actions in a spatially and temporally aligned interaction proxy. The proxy aligns action and skill windows, brief hit reactions, and persistent health by fighter identity and timing. These cues can be controlled separately to render interactions under modified rules. Identity-bound references preserve character appearance across side switches. We train FWM on FightWorld Corpus, spanning 52 skill effects, 187 character-appearance variants, and 15 arenas. Without retraining the renderer, FWM supports damage scaling, limited-hit immunity, lifesteal, and multi-stage skill mechanisms beyond the native game. It also allows character and arena customization. Experiments demonstrate the effectiveness of FWM, which outperforms existing game world models in action fidelity, hit reactions, health-state consistency, and character appearance preservation. Our project is available at https://fight-world-model.github.io.

[161] L3G-World: Real-Time Infinite World Generation with Latent 3D Gaussian Memory cs.CVPDF

Jinhyeok Choi, JoungBin Lee, Jongmin Lee, Minkyeong Jeon, Jiyoung Kim

TL;DR: 论文提出潜空间3D高斯记忆（L3G）及L3G-World框架，通过记忆更新器与视频扩散Transformer（DiT）自回归交替，实现空间一致、实时、无限长的交互式世界生成。L3G将VAE潜特征存入3D高斯，使记忆可直接渲染到DiT潜空间，避免重复VAE编码。

Details

Motivation: 交互式世界模型需在长时程探索中保持空间一致性并实时生成，但现有方法依赖时序上下文或显式3D记忆，内存随生成流长度增长；显式3D记忆还需重编码RGB渲染，难以实时。

Result: 实验表明L3G-World达到SOTA生成质量和长程空间一致性；相比最高效的先验3D记忆基线，3D基元最多少38.6倍、记忆更新快3.2倍、记忆渲染快359倍，并实现9 FPS实时世界生成。

Insight: 创新在于用紧凑、可快速渲染的潜空间3D高斯作为记忆，并让记忆随场景范围而非流长度增长；每个高斯存储VAE潜特征，使记忆直接渲染进DiT潜空间，省去VAE重编码，兼顾前馈重建效率与实时生成。

Abstract: Interactive world models generate visual content conditioned on user actions, yet maintaining spatial consistency over long-horizon exploration in real time remains challenging. Existing approaches rely on either temporal context or explicit 3D memory, both of which scale poorly because memory grows with the length of the generated stream. Moreover, explicit 3D memories condition latent video generators by re-encoding RGB renderings, which precludes real-time generation. In this paper, we introduce a Latent 3D Gaussian Memory (L3G) that combines the efficiency of feed-forward reconstruction with a compact, rapidly renderable scene representation. Building on this memory, we propose L3G-World, in which a memory updater and a video diffusion transformer (DiT) alternate autoregressively to generate spatially consistent worlds. The memory updater spawns Gaussians in newly observed regions and refines existing ones, so that the memory grows with scene extent rather than stream length. Each Gaussian further stores a VAE latent feature, allowing the memory to be rendered directly into the DiT’s latent space without VAE re-encoding. Experiments show that L3G-World achieves state-of-the-art generation quality and long-horizon spatial consistency, with up to $38.6\times$ fewer 3D primitives, $3.2\times$ faster memory updates, and $359\times$ faster memory rendering relative to the most efficient prior 3D-memory baseline for each metric, enabling real-time world generation at 9 FPS.

[162] SonoWorld4D: From One Video to a 4D Audio-Visual Scene via Diffusion Synchronization cs.CV | cs.SDPDF

Derong Jin, Xiyi Chen, Ming C. Lin, Ruohan Gao

TL;DR: 论文提出从单目视频生成可探索、随时间变化的4D视听场景的新任务Video-to-4DAVScene，并给出SonoWorld4D框架。该方法生成360度静态背景、重建动态发声前景物体的显式运动轨迹，并通过双空间音频扩散同步合成多源物理合理声场，最终支持实时新视角视觉与空间音频渲染。

Details

Motivation: 已有视觉场景生成从静态3D扩展到动态4D，但声音与动态物体和事件紧密耦合却长期未被建模。论文旨在解决仅凭一段单目视频生成带一致空间音频的可探索4D视听场景这一问题。

Result: 在真实动态场景评测和用户研究中，SonoWorld4D生成的4D视听场景具有感知真实、物理合理的空间音频，并与场景几何和视觉内容保持一致，同时支持实时新视角视觉与空间音频渲染；摘要未提及具体benchmark数值或SOTA对比。

Insight: 创新点在于定义Video-to-4DAVScene新任务，并将单目视频分解为360背景、显式动态轨迹和多源声场生成。客观看，其可借鉴之处是双空间音频扩散同步机制，以及视觉4D重建与空间音频合成的一致化联合建模。

Abstract: Recent progress in visual scene generation has extended beyond static 3D scenes toward the more challenging problem of generating dynamic 4D scenes from minimal input. However, sound, despite being intrinsically coupled with dynamic objects and events, remains largely unmodeled in prior work. We introduce Video-to-4DAVScene, a new task that turns a video into an explorable, time-varying 4D audio-visual scene, and present the SonoWorld4D framework for this task. Given a monocular video, our method generates a 360 static background, reconstructs explicit motion trajectories of dynamic, sound-emitting foreground objects, and synthesizes a physically-grounded sound field consistent across multiple sources through dual-space audio diffusion synchronization. The resulting 4D scene supports real-time novel-view visual and spatial audio rendering. Evaluation on real-world dynamic scenes and a user study demonstrates SonoWorld4D generates 4D audio-visual scenes with perceptually realistic, physically grounded spatial audio consistent with scene geometry and visual content.

[163] Luggage re-identification: A study of strategies towards a real-world application cs.CV | cs.AIPDF

Quentin Dhôte, Romaric Audigier

TL;DR: 论文研究面向真实应用的行李重识别（Luggage ReID）端到端流程，从多路视频流中检测并重识别行李，并在真实环境基准数据集上评估不同策略变体，重点考察如何选择与融合同一行李的多视角、多镜头观测，以及利用不同环境数据集训练以提升实际应用中的整体ReID性能。

Details

Motivation: 现有行李ReID方法多聚焦于较干净条件下的裁剪图像外观匹配，而真实场景中频繁遮挡、背景杂乱和人群拥挤会显著降低性能；同时，多视频流中多镜头、多视角之间的互补性尚未被充分利用。

Result: 摘要未给出具体定量指标或SOTA对比，主要说明在真实环境采集的基准数据集上评估了多种流程变体，目标是在实际应用中提升整体ReID性能。

Insight: 创新点在于构建从多视频流到检测与重识别的端到端管线，并系统研究多视角/多镜头观测的选择与融合策略，以及跨不同环境数据集训练对实际部署性能的影响；其价值更多体现为面向真实应用的策略评估与流程设计。

Abstract: Luggage re-identification (ReID) is a critical task in video surveillance for forensics, security or border management (suspicious or abandoned luggage recognition), as well as luggage management (lost luggage recovery). It enables the association of observations of the same luggage across disjoint camera views in complex environments such as airports, train stations and border crossing. While existing approaches primarily focus on appearance-based cropped image matching under relatively clean conditions, real-world scenarios are characterized by frequent occlusions, cluttered background and crowded scenes which significantly degrade performance. Yet, strategies leveraging the complementarity of multiple shots and views from different video streams is overlooked. In this paper, we study strategies for an end-to-end pipeline that operates from multiple video streams to detect and re-identify luggage. We evaluate different variants on a benchmark dataset acquired in real-world environments to address the questions of selecting and merging different views and shots of the same luggage as well as training on different environment datasets for an overall ReID performance improvement in practical applications.

[164] Read, Allocate, Route: Role-Coupled Tokenization for Pixel-Space Generative Transformers cs.CV | cs.AI | cs.LG | cs.NEPDF

Jiongfan Yang, Weichen Fan, Haiwen Diao, Zhongang Cai, Ziwei Liu

TL;DR: 论文提出 SpecSlot，一种像素空间 rectified-flow Transformer，通过将每个空间锚点扩展为多个 DCT 频带 slot，把输出细节与全局注意力序列长度解耦。仅最低频 slot 参与全局注意力，所有 slot 进行局部交互，从而在不扩大全局序列的情况下提升频谱细节。方法在 ImageNet-256/512 和文本到图像生成上验证了更高效率与竞争力。

Details

Motivation: 像素空间生成 Transformer 通常每个图像 patch 一个 token，提升细节需要更多 token，导致全局注意力成本快速增加。作者观察到低频结构需要全局通信，而高频细节可局部建模，因此希望解耦细节建模与全局序列长度。

Result: ImageNet-256 上最终 FID 与 FLOPs 匹配的 JiT 控制组相当且收敛更快；ImageNet-512 上 FID 提升 2.84、FLOPs 少 3.9%，并以低 38.2% 成本接近 JiT-B/16（FID 差 0.69）；文本到图像 DPG-Bench 上以低 40.6% 前向成本超过 JiT-B/8 1.06。

Insight: 创新点在于角色耦合的 tokenization：按 DCT 频带拆分 slot，让低频 slot 负责全局注意力、高频 slot 局部交互，并用空间头做局部校正。客观看，其价值在于将频谱细分与锚点密度分离，使细节提升不再线性增加全局注意力开销。

Abstract: Pixel-space generative Transformers typically use one token per image patch, so capturing finer detail requires more tokens and makes global attention increasingly expensive. We observe that finer detail does not necessarily require more global communication: low-frequency structure benefits from global exchange, while high-frequency detail can be modeled locally. Based on this insight, we introduce SpecSlot, a pixel-space rectified-flow Transformer that decouples output detail from the length of the global attention sequence. SpecSlot expands each spatial anchor into multiple slots, each assigned a disjoint band of DCT coefficients; this separates anchor density from spectral subdivision. Only the lowest-frequency slot from each anchor participates in global attention, while all slots interact locally. This allows the model to increase spectral detail without enlarging the global sequence. A spatial head further adds a local correction to the spectral prediction, while the generative state, target, and loss remain in pixel space. On ImageNet-256, SpecSlot achieves a comparable final FID to a FLOPs-matched JiT control while converging faster. On ImageNet-512, it improves FID by 2.84 over the control with 3.9% fewer FLOPs, and comes within only 0.69 FID of JiT-B/16 at 38.2% lower cost. On text-to-image generation, SpecSlot surpasses JiT-B/8 on DPG-Bench by 1.06 at 40.6% lower forward cost.

cs.AI [Back]

[165] Wavelet Phase Diffusion for Structurally and Semantically Consistent Sim-to-Real Translation cs.AI | cs.CV | eess.IVPDF

Kaiwen Wang, Frank Bieder, Yinzhe Shen, Carlos Fernandez, Jan-Hendrik Pauls

TL;DR: 论文提出 Wavelet Phase Diffusion（ψ-PD），用于仿真到现实的图像/视频翻译，在保持结构与语义一致的同时缩小合成域与真实域的外观差距。方法在小波域进行相位扩散，并用低频随机化解耦合成光照先验，从而支持无配对开放域训练、低推理开销和实例级翻译。

Details

Motivation: 现有仿真到现实翻译方法难以同时保证真实感、结构/语义一致性和计算效率：条件控制方法模块昂贵，配对数据方法依赖复杂合成且易改变几何与语义，免训练编辑缺乏外观先验，Fourier 相位保留方法受全局频谱耦合影响而产生振铃、边界泄漏等伪影。

Result: 在 vKITTI→KITTI 图像翻译上，ψ-PD 在真实感和语义一致性上优于已有方法，并保持有竞争力的结构对齐；在 CARLA 视频翻译上接近配对数据方法的真实感，同时将 VLM 规划器的 ADE 和 FDE 分别降低 5.4% 和 5.1%。

Insight: 创新点在于使用 Dual-Tree Complex Wavelet Packet Transform 的局部化小波包实现空间自适应相位注入，避免全局频谱干扰；并用低频随机化替换低频包以解耦合成光照先验。其空间局部性还支持实例级、区域级独立翻译，且训练无需配对数据、推理开销几乎可忽略。

Abstract: Simulation-to-reality translation must bridge the appearance gap between synthetic and real domains while preserving structural and semantic consistency. Conditioning-based methods achieve spatial alignment but introduce computationally expensive control modules. Paired-data methods achieve realism but rely on complex synthesis pipelines, often altering scene geometry and semantics. Training-free editing methods avoid both constraints but lack a learned appearance prior, limiting their perceptual quality. Recently proposed phase-preserving diffusion presents a promising alternative, but Fourier-domain formulations are constrained by global spectral coupling. This coupling induces spatial artifacts such as ringing and boundary leakage, thereby degrading structural and semantic consistency. We introduce Wavelet Phase Diffusion, which addresses this through two components. First, we operate in the Dual-Tree Complex Wavelet Packet Transform domain, whose localized wavelet packets enable spatially adaptive phase injection without global spectral interference. Second, Low-Frequency Randomization (LFR) replaces the low-frequency packet, decoupling the model from the synthetic illumination prior and enabling in-distribution real-world appearance. Both components train on unpaired open-domain data, and introduce negligible inference overhead. The spatial locality further enables instance-level translation, where individual objects or regions are translated to photorealistic appearance independently while the surrounding scene remains untranslated. On vKITTI $\to$ KITTI image translation, $ψ$-PD outperforms prior methods in realism and semantic consistency while maintaining competitive structural alignment. For CARLA video translation, $ψ$-PD approaches the realism of paired-data methods while reducing VLM planner ADE and FDE by $5.4%$ and $5.1%$, respectively.

[166] SkillMem: Compact External Skill Memory for Latent Multi-Agent Reasoning cs.AI | cs.CL | cs.LGPDF

Yuxuan Zhu, Mohammad Mohammadi Amiri, Pin-Yu Chen, Keerthiram Murugesan

TL;DR: 论文提出SkillMem，将可重用技能表示为小型外部潜在记忆，用于潜在多智能体推理。通过角色条件交叉注意力读取器，同一记忆能根据智能体角色和当前隐藏状态指导不同智能体。训练采用行为蒸馏，保持主干冻结。在六个基准和Qwen3模型（4B-14B）上验证，小模型增益明显，存储减少38倍以上，推理加速最高4.23倍。

Details

Motivation: 潜在多智能体系统虽降低推理成本，但可重用技能常以文本、逐层KV状态或技能特定参数存储，导致重复处理或大量存储开销。需要一种紧凑、高效的外部技能记忆表示，避免重复处理并支持多智能体按角色使用。

Result: 在六个基准和Qwen3 4B-14B模型上，SkillMem对较小主干有显著提升；使用统一的8×256记忆配置，每技能仅需9.6KB存储（含检索嵌入）；100技能库下总存储减少超过38倍，端到端推理加速最高4.23倍。

Insight: 创新点在于将技能表示为小型外部潜在记忆，并设计角色条件交叉注意力读取器，使同一记忆能按智能体角色和状态自适应指导；通过行为蒸馏训练记忆和读取器且保持主干冻结，实现紧凑、可重用且高效的技能存储与推理。

Abstract: Latent multi-agent systems reduce inference cost by keeping intermediate reasoning and inter-agent communication in continuous representations.\ Reusable skills, however, are commonly supplied as text or stored as layer-wise Key-Value states or skill-specific model parameters, introducing repeated processing or substantial per-skill storage.\ We introduce \textbf{SkillMem}, which represents each reusable skill as a small external latent memory and makes it directly available during latent multi-agent reasoning.\ A role-conditioned cross-attention reader allows the same memory to guide different agents according to their roles and current hidden states.\ We train the skill memories and shared reader through behavioral distillation, matching the change in token predictions induced by a textual skill while keeping the backbone frozen.\ For our experiments, we obtain textual skills from paired successful and failed multi-agent trajectories, although existing skills can also be compiled directly.\ Across six benchmarks and Qwen3 models ranging from 4B to 14B parameters, SkillMem provides strong gains for smaller backbones while preserving efficient latent multi-agent inference across model scales.\ We use the same $8\times256$ memory configuration across all evaluated model scales, requiring 9.6,KB of skill-specific storage per skill, including its retrieval embedding.\ For a library of 100 skills, SkillMem reduces total storage by more than $38\times$ compared with alternative skill representations and achieves up to a $4.23\times$ end-to-end inference speedup.\ These results show that compact procedural memories can be reused without sacrificing the efficiency of latent multi-agent reasoning.

[167] Weaken to Strengthen: Weakening-Induced On-Policy Self-Distillation for Large Reasoning Models cs.AI | cs.CL | cs.LGPDF

Yecheng Wu, Song Han, Han Cai

TL;DR: 论文提出WISD（Weakening-Induced On-Policy Self-Distillation），一种面向大型推理模型的自蒸馏框架。该方法不依赖外部教师或特权信息，而是通过低比特量化或幅度剪枝构造原模型的“弱化版本”，利用原模型与弱化模型之间的对比作为on-policy训练信号，从而提升数学与代码推理能力。

Details

Motivation: 现有自蒸馏方法通常依赖特权信息来构造更强的自教师，当只有无标签提示可用时难以应用。论文希望在没有外部教师和特权信息的条件下，仍能通过自蒸馏提升推理模型。

Result: 在多种架构和规模的数学、代码推理基准上，量化与剪枝分别使平均准确率相比原模型提升4.0和5.5个百分点，并在无特权信息条件下达到SOTA水平。具体地，剪枝将Qwen3.5-4B在HMMT 2025上从57.7%提升至70.5%，在LiveCodeBench v6上从39.1%提升至56.7%；量化将Qwen3.6-35B-A3B在相同基准上分别从68.5%提升至74.6%、从61.8%提升至69.5%。

Insight: 论文的创新点在于反向利用“弱化”而非“强化”模型：通过低比特量化和幅度剪枝生成较弱副本，并将其与原模型的差异作为自蒸馏训练信号，避免了对特权信息的依赖。客观来看，该工作提供了一种无需外部教师、仅利用无标签提示即可进行on-policy自蒸馏的简洁框架，具有较强的实用性和可扩展性。

Abstract: Self-distillation offers a way to improve reasoning models when a suitable external teacher is unavailable. However, common approaches rely on privileged information to construct a stronger self-teacher, limiting their use when only unlabeled prompts are available. In this paper, we introduce Weakening-Induced On-Policy Self-Distillation (WISD), which instead constructs a weaker counterpart of the original model and uses the contrast between the two as a training signal without requiring privileged information. We explore two ways to construct the weaker model: low-bit quantization and magnitude pruning. We evaluate WISD across diverse architectures and scales on mathematical and coding reasoning tasks. Across these benchmarks, quantization and pruning improve average accuracy over the original models by 4.0 and 5.5 percentage points, respectively, achieving state-of-the-art performance even without privileged information. Notably, pruning raises Qwen3.5-4B’s accuracy from 57.7% to 70.5% on HMMT 2025 and from 39.1% to 56.7% on LiveCodeBench v6. Quantization raises Qwen3.6-35B-A3B’s accuracy from 68.5% to 74.6% and from 61.8% to 69.5% on the same benchmarks, respectively. These results establish WISD as a novel and effective self-distillation framework for large reasoning models.

[168] Reasoning or Pattern Exploitation? Mechanistic Insights from RL-Trained Language Models cs.AI | cs.CLPDF

Aishik Nagar, Cheston Tan

TL;DR: 论文研究经可验证奖励强化学习训练后的大语言模型是否真正获得推理能力，还是仅利用输入中的表层模式。作者在可穷尽分析的井字棋逻辑域中用GRPO训练小规模LLM，并结合稀疏自编码器（SAE）和因果干预追踪内部表征变化。结果显示模型虽在多种提示下表现高准确且鲁棒，但主要依赖提示中已显式给出的信息，而非棋盘对称性、策略叉等高层推理概念。

Details

Motivation: 当前LLM经RL后常在推理基准上提升，但这些提升可能被误读为真正推理能力；论文旨在区分任务特定的模式利用与真实推理，并揭示RL训练如何改变内部表征。

Result: 定量上，RL训练后的模型在井字棋任务及提示变体上取得高准确率和鲁棒性，表面上类似出现游戏推理；但SAE机制分析发现模型更依赖轮到谁、游戏进程和棋盘占用等显式信息，对称性和策略叉等概念表征较弱。摘要未给出具体数值或SOTA比较。

Insight: 论文宣称的创新包括：首次系统追踪小规模LLM在RL训练中的表征动态；将SAE特征发现扩展到有限逻辑域的假设驱动测试；并用因果干预证明RL后训练不增减概念信息，而是重组主导特征并将决策定位在后层状态。客观看，其价值在于用可控逻辑域和机制可解释性方法揭示“推理提升”可能混淆模式利用，为推理基准的效度提供警示。

Abstract: Large language models (LLMs) are increasingly described as acquiring “reasoning” skills after reinforcement learning with verifiable rewards. However, whether these gains reflect genuine reasoning or more superficial adaptations remains underexplored. In this work, we probe LLMs trained in a finite and exhaustively analyzable logical domain, namely Tic-Tac-Toe, and trace how internal representations evolve across reinforcement learning (RL) with Group Relative Policy Optimization (GRPO). Quantitatively, RL yields high accuracy and robustness across prompt variations, suggesting the emergence of game reasoning. Mechanistic interpretability, however, paints a different picture: features extracted with sparse autoencoders (SAEs) reveal that models primarily adapt to rely more heavily on information already explicit in the prompt, such as whose turn it is, game progression and board occupancy. In comparison, high-level concepts like board symmetries and strategic forks remain weakly represented, raising concerns that reasoning benchmarks overestimate model abilities. This suggests that RL-driven “reasoning” may conflate task-specific adaptations to input information with reasoning ability. We provide, for the first time: (i) a systematic interpretability pipeline tracing representation dynamics across RL training in small-scale LLMs; (ii) an extension of SAE-based feature discovery to hypothesis-driven testing in a finite logical domain; and (iii) an interpretability-based demonstration that RL post-training neither adds nor removes concept information but reorganizes which features dominate the representation, with causal interventions locating the decision downstream of it, in the late-layer state.

[169] Proving and Improving the Platonic Representation Hypothesis with JEPAs cs.AI | cs.CV | stat.MLPDF

Randall Balestriero, Yann LeCun

TL;DR: 论文将柏拉图表示假设（PRH）形式化为定理：分别在不同模态上训练的JEPA，只要正样本对是同一场景的两个好视图且错位有界，就能学到仅差一个旋转的相同表示。作者进一步说明下一词元预测相当于使用坏视图的JEPA，因此语言模型与视觉对齐依赖规模；并用大规模图文数据验证对齐缩放律，证明好视图可显著提升样本效率与跨模态对齐。

Details

Motivation: PRH猜测不同模态模型随规模增大会收敛到同一世界表示，但原假设缺少证明和可操作配方；论文希望给出理论保证，并找到比单纯扩大规模更有效的跨模态表示对齐方法。

Result: 提出柏拉图表示定理并验证对齐缩放律；好视图达到同等对齐所需样本比下一词元预测少42倍；109M参数文本JEPA与DINOv2、CLIP图像编码器对齐优于评估的所有语言模型（至72B）及CLIP文本编码器；一个旋转即可将独立训练编码器变为图像描述器，COCO CIDEr 0.838；在无配对基准ImageNet-100 top-5上达64%，超过至8B语言模型的最高56%。

Insight: 创新点在于把PRH从猜想推进为可证明的JEPA定理，区分好视图与坏视图并解释下一词元预测的低效性，提出“视图质量而非仅规模”是构建柏拉图表示的关键杠杆；客观看，其价值在于理论、缩放实证和下游无配对对齐展示形成闭环。

Abstract: Whether models trained on different modalities converge to the same representation of the world is central to AI. The Platonic Representation Hypothesis (PRH) conjectures that they do as they scale, but without a proof it offers neither a guarantee nor a recipe. We turn the hypothesis into a theorem. First, we prove a \emph{Platonic Representation Theorem}: Joint-Embedding Predictive Architectures (JEPAs) trained separately on any number of modalities learn the same representation up to one rotation whenever their positive pairs are two observations of one scene–\emph{good views}–and their misalignment is bounded otherwise. Second, we show that next-token prediction is a JEPA with \emph{bad views}, parts of a single document, which explains why language models align with vision only through scale. Third, we validate the theory from 145k captions to the texts of 940M web images, and uncover a scaling law of alignment that predicts unseen runs within seed noise. Good views need 42 times fewer training samples than next-token prediction on the same corpus to reach the same alignment, and a 109M-parameter text JEPA aligns with DINOv2 and CLIP’s image encoders better than every language model we evaluated, up to 72B parameters, and than CLIP’s text encoder: next-token prediction is a remarkably inefficient route to platonic representations. As a showcase, one rotation turns separately trained encoders into an image captioner (CIDEr .838 on COCO). Even that rotation needs no pair: on the latest pair-free benchmark, our text JEPA beats every zero-shot accuracy reported with language models up to 8B parameters, e.g., 64% against at most 56% top-5 on ImageNet-100. Positive views, and not scale alone, are thus the lever to build platonic representations.

[170] Training language models in simulation for psychiatric intake cs.AI | cs.CLPDF

Samuel Schmidgall, Tim Strother, Alex Bijamov, Min Woo Sun, Anil Palepu

TL;DR: 论文研究在模拟环境中用多轮强化学习训练语言模型，以提升其结构化文本精神科接诊能力，覆盖病史采集、鉴别诊断和初始管理计划。通过精神科医生角色扮演标准化病人和独立评分面板进行随机双盲交叉评估，训练后的智能体在多类临床与沟通指标上显著优于同提示的基座模型，并在一组对抗性安全场景中降低急性风险漏分诊。

Details

Motivation: 精神科接诊访谈是重要诊断工具，需要医生建立关系并处理复杂重叠表现；论文希望利用可控模拟环境训练和压力测试精神科对话智能体，解决其在真实临床接诊中能力与安全性不足的问题。

Result: 在60对匹配场景、120次接诊的随机双盲交叉研究中，训练智能体在76.7%配对场景中优于基座模型（p<0.0001）；临床评分效应量d_z=0.77，患者中心沟通82.0% vs. 65.2%，鉴别诊断适当性68.3% vs. 33.3%。在127个验证场景中临床量表分几乎翻倍（0.706 vs. 0.379），并在256个对抗场景中将急性安全风险漏分诊率从30.5%降至12.9%。

Insight: 创新点在于将多轮强化学习置于精神科接诊模拟环境中训练语言模型，并结合精神科医生角色扮演、双盲交叉评审和Delphi共识安全分类体系进行系统评估与对抗性压力测试；其模拟训练收益可迁移到医生扮演的真实式接诊场景，但仍需安全防护和临床监督。

Abstract: In psychiatric practice, the clinical intake interview remains a primary diagnostic instrument, requiring the clinician to establish rapport while disentangling complex, overlapping presentations. Here, we show that multi-turn reinforcement learning (RL) in simulation environments improves language model performance on structured text-based psychiatric intake, spanning history-taking, differential diagnosis, and initial management planning. In a randomized, double-blind crossover study ($N = 60$ matched scenario pairs, 120 encounters) comparing the RL-trained agent against its identically prompted base model, 32 board-certified psychiatrists role-played standardized patients while a separate panel of 15 independent, board-certified psychiatrists scored the de-identified transcripts. The trained agent outperformed the base model in 76.7% of matched scenario pairs ($p < 0.0001$), with gains on an adapted clinical-examination rubric ($d_z = 0.77$, $p < 0.0001$), patient-centered communication (82.0% vs. 65.2%, $p < 0.001$), and differential diagnosis appropriateness (68.3% vs. 33.3%, $p < 0.001$). Across 127 psychiatrist-validated simulated intake scenarios, the trained agent nearly doubled its base model’s clinical rubric score (0.706 vs. 0.379; composite reward 0.564 vs. 0.294, $p < 0.0001$). To systematically probe conversational safety, we established two Delphi-consensus taxonomies, of clinical safety risks and relational competencies, from which 256 challenging adversarial presentations were derived; we find that training in simulation environments more than halved under-triage of acute safety risks (12.9% vs. 30.5%, $p < 0.0001$). Simulation environments thus provide a controlled testbed for training and stress-testing psychiatric conversational agents, with gains that transferred to psychiatrist-enacted encounters, though residual gaps require safeguards and clinician oversight.

[171] FIRME: Registry-Anchored Memory Graphs for Evolving, Heterogeneous Investor Knowledge cs.AI | cs.CLPDF

Yunbai Zhang, Yunyi Gao, Han-Tai Shiao

TL;DR: 论文提出 FIRME，一种以注册表为锚点的记忆图，用于在金融 AI 工作流中持续整合异构、跨时期的投资者知识。它通过规范身份与持久别名将不同表述的观测归并到同一关系历史，并保留来源、时间和上下文；期内用规则融合关联投资者电话讨论与组合现金流信号，跨期用确定性更新刻画强化、失活与重激活。论文在专有投资者电话/现金流记录和 S&P 500 财报电话记录上评估，显示相较无别名记忆基线在匹配与重关联指标上明显提升。

Details

Motivation: 金融 AI 复用投资者知识需要持久记忆，跨来源、跨时期整合观测且不丢失身份与出处；知识图谱中同一关系反复出现时可能表面形式不同，导致关系历史碎片化、证据无法累积，因此需要解决身份消解与长期记忆演化问题。

Result: 相比保留规范身份和语义回退但缺少别名记忆的历史注册表，FIRME 在四种数据集-后端设置下将最终期正确匹配率提升 7.8–12.1 个百分点；200 条/设置的盲审人工评估显示正确匹配率提升 9.0–16.5 个百分点、重关联召回率提升 22.5–29.0 个百分点，且四个样本合并精确率均更高；另一审计中投资者电话场景的完整期内融合输出有 293/300 条证据路径有效。

Insight: 创新点在于用注册表锚定的规范关系与持久别名机制维护跨期身份连续性，并把来源、时间、上下文随关系历史保留；期内规则融合结合固定产品-主题本体，跨期用确定性更新总结强化、失活和重激活。客观上可借鉴的是将别名记忆作为长期知识图谱身份消解的关键组件，并用证据路径与抽取忠实度诊断保障可溯源性和图内容保真。

Abstract: Financial AI workflows that reuse investor knowledge need persistent memory that integrates observations across sources and periods without losing identity or provenance. In a knowledge graph, recurring observations may use different surface forms, fragmenting relationship histories and preventing evidence from accumulating. We introduce Fusion and Identity Registry for Memory Evolution (FIRME), a registry-anchored memory graph that reconciles incoming observations to persistent canonical relationships and retains their source, time, and context. Within periods, rule-based fusion links investor-call discussions to portfolio cash-flow signals, directly or through a fixed product-topic ontology. Across periods, canonical identities and persistent aliases direct recurring observations to the same relationship history; deterministic updates summarize reinforcement, inactivity, and reactivation. We evaluate FIRME on proprietary investor-call and cash-flow records and on S&P 500 earnings-call transcripts. Compared with a historical registry that retains canonical identities and semantic fallback but omits alias memory, FIRME increases final-period Correct Match Rate by 7.8-12.1 percentage points across four dataset-backend settings under a fixed-judge and fallback-review protocol. A blinded human audit of 200 incoming observations per setting finds Correct Match Rate gains of 9.0-16.5 points and reattachment-recall gains of 22.5-29.0 points, with higher observed merge precision in all four samples. A separate audit finds valid evidence paths for 293 of 300 outputs from full within-period fusion in the investor-call setting. Extraction-faithfulness and round-trip diagnostics assess source grounding and preservation of extractor-derived graph content.

[172] Agentic University: Collaborative Agents for Personalized Learning cs.AI | cs.CLPDF

Jingru Fan, Tianle Zhou, Yunjie Zhou, Zihao He, Yixuan Zhou

TL;DR: 论文提出 Human-Participatory Multi-Agent Organization，并实例化为 Agentic University（AU）。在 AU 中，学习者作为组织成员与专门化智能体协作，维护可修订的 Capability Program，将个人目标、跨模态学习活动和分层评估连接起来，并利用学习反馈与表现指导后续支持。实验表明该方法在项目组织、评估设计和修订质量上有优势。

Details

Motivation: 大语言模型可支持个性化辅导、内容生成和自适应学习路径，但能力发展需要这些资源和交互形成随学习者演化的连贯学习过程。核心挑战是协调目标、活动和评估，并利用学习证据决定下一步学习内容。

Result: 评估显示 AU 在项目组织、评估设计和修订质量方面具有优势；用户在 50 分制评估中平均提升 12.19 分，对比基线为 5.61 分，并报告了更强的认知支持。

Insight: 创新点在于提出人类参与的多智能体组织范式，让学习者作为组织成员参与多智能体协调，并通过可修订的 Capability Program 统一目标、跨模态学习活动、分层评估与反馈驱动支持。

Abstract: Large language models support personalized tutoring, content generation, and adaptive learning paths. However, capability development requires these resources and interactions to form a coherent learning process that evolves with the learner. A central challenge is to align goals, activities, and assessment while using learning evidence to decide what should follow. We introduce Human-Participatory Multi-Agent Organization and instantiate it in Agentic University (AU). In AU, learners participate as organization members and work with specialized agents to maintain a revisable Capability Program. The program connects personal goals, learning activities across modalities, and layered assessment, while learner feedback and performance guide subsequent support. Our evaluation shows advantages in program organization, assessment design, and revision quality. Users achieved larger mean assessment gains (12.19 versus 5.61 points on a 50-point scale) and reported stronger cognitive support. This work contributes an organizational approach to adaptive learning that makes learner participation a continuing basis for multi-agent coordination. The Agentic University project is available at \href{https://github.com/AgenticOrgLab/AgenticUniversity.git}.

[173] VeriCUA: Verification as Agentic Exploration for Computer-Using Agents cs.AI | cs.CL | cs.CVPDF

Qiushi Sun, Da Yu, Alexander Knop, Amer Sinha, Lingpeng Kong

TL;DR: 论文提出 VeriCUA，一个面向计算机使用智能体（CUA）的平台无关任务完成验证框架。它将验证视为智能体式探索过程：先检查可用上下文并构建任务评分标准，再针对未满足需求动态选择 GUI 检查或代码检查，并依据显式证据规则融合结果。该框架统一支持跨桌面、移动和 Web 平台，以及在线和离线、不同观察模态下的验证场景。

Details

Motivation: 构建和扩展 CUA 需要可靠的任务完成验证，以支持数据整理、评估和强化学习。现有 VLM 判断轨迹或生成程序检查状态的方法都只依赖复杂数字环境的部分视图，可能遗漏关键证据或无法支撑完成判断，且为不同平台和访问设置定制验证器会带来额外工程成本。

Result: 实验表明，在多种平台和在线/离线设置下，VeriCUA 与参考标签的一致性优于对比基线；离线场景中在困难案例上取得最大增益，在线场景中更能拒绝错误的完成声明。摘要未给出具体数值或 benchmark 名称。

Insight: 创新点在于将验证统一为平台无关的智能体式动态证据收集与评估过程，并在在线和离线设置中共享同一流程；通过任务评分标准驱动 GUI 与代码检查的选择，并用显式证据规则融合互补证据。客观来看，其可借鉴之处是避免依赖单一局部视图，将测试时探索和异构证据结合用于更稳健的完成验证。

Abstract: Building and scaling computer-using agents (CUAs) across desktop, mobile, and web environments requires reliable task-completion verification for data curation, evaluation, and reinforcement learning. Typical automated approaches prompt vision-language models (VLMs) to judge trajectories or generate programs to inspect application state. However, both rely on partial views of complex digital environments. VLM judges are restricted to supplied observations, while generated programs depend on accessible state. These views can omit decisive evidence or leave completion judgments unsupported. Tailoring separate verifiers to different platforms and access settings adds further engineering cost. We present VeriCUA, a platform-agnostic framework for verification through agentic exploration. It treats verification as dynamic evidence gathering and assessment within a shared procedure for online and offline settings across platforms and observation modalities. After inspecting the available context to construct a task rubric, the verifier selects GUI or code checks for unresolved requirements and combines their findings under explicit evidence rules. Experiments show improved agreement with reference labels over the compared baselines across these settings, with the largest offline gains on hard cases and stronger rejection of false completion claims online. Further analyses connect these gains to complementary evidence and test-time exploration.

cs.GR [Back]

[174] Greenscapes: Optimized Vegetation Configurations in Cities cs.GR | cs.CVPDF

Patryk Bartkowiak, Marcin Marlewski, Paweł Wójcik, Jae Joong Lee, Dominik L. Michels

TL;DR: 论文提出Greenscapes方法，面向城市3D场景中的植被配置：以地块为输入，利用条件VLM生成俯视植被布局，再检测植物并匹配3D资产转为3D场景；随后固定VLM生成位置，用CMA-ES优化植物尺度和资产替换，并以阴影、路径声学暴露代理模型及视图感知描述符为目标，生成兼顾功能与美学的植被布局。

Details

Motivation: 城市植被承担遮阴、微气候、碳封存和声学屏蔽等功能，同时景观风格美学影响居民福祉；论文旨在自动化地在3D城市地块中配置从灌木到大树的植被，并兼顾功能性与审美需求。

Result: 摘要未报告定量实验结果或基准对比，未声称达到SOTA；仅说明方法能够生成兼顾美学与功能的城市植被布局。

Insight: 创新点在于将条件VLM的俯视植被生成、植物检测与3D资产选择、确定性可行性修复后的CMA-ES尺度/资产优化，以及阴影和路径声学代理模型与视图感知描述符结合为闭环；客观看，其可借鉴之处是生成式模型与多目标3D场景优化结合的城市植被配置流程。

Abstract: Vegetation plays a central role in cities, serving functional roles such as balancing shade and sky exposure, shaping the microclimate, carbon sequestration, and providing acoustic screening. Furthermore, aesthetic choices in landscape styles (formal, modernist, picturesque) are important for citizens’ well-being and should be considered in the design of urban landscapes. In this paper, we present a novel method for placing vegetation, ranging from shrubs to large trees, in 3D urban scenes. Our method uses individual lots as input and employs a conditioned Vision-Language Model (VLM) to generate a top-down rendering of vegetation, placing large trees, small trees, and shrubs on lawn areas. This rendering is then converted into a 3D scene by detecting individual plants and selecting appropriate 3D assets. To refine the proposed configurations, we define an optimization loop that keeps the VLM-generated positions fixed after a deterministic feasibility repair and uses CMA-ES to optimize per-instance scale transformations along with discrete vegetation asset substitutions. To define the objective function for the optimization, we evaluate the generated 3D scenes with efficient surrogate models of shade and path-based acoustic exposure. Furthermore, we render in-scene views at each optimization step to compute view-dependent perceptual descriptors, enabling the generation of both aesthetic and functional vegetation layouts for urban scenes.

cs.HC [Back]

[175] Evaluating Visual Realism of AI-Generated Videos with Eye Tracking cs.HC | cs.AI | cs.CVPDF

Danqing Shi, Lan Jiang, Jake Lyons, Miri Zilka

TL;DR: 论文研究用眼动追踪作为AI生成视频视觉真实感评估的补充信号。作者开展了两轮视觉图灵测试，共90名参与者、438个视频，收集4286条有效眼动试次，发现注视模式与显式人工反馈一致，并提出首个从眼动数据预测感知视觉真实感的方法GazeEval，准确率达71.3%，同时发布研究数据。

Details

Motivation: 现有AI生成视频的人类评估主要依赖评分或判断等显式反馈，只能得到结论，难以揭示观看者形成判断的感知过程。论文希望引入眼动追踪这种隐式生理信号，补充理解人类如何评价AI生成视频的视觉真实感。

Result: 在最新生成模型视频上的两轮视觉图灵测试中，眼动模式与显式人工反馈具有一致性；提出的GazeEval在预测感知视觉真实感上达到71.3%准确率，表明眼动数据包含有效评估信息。

Insight: 创新点在于将眼动追踪引入AI生成视频的人类评估，系统验证隐式注视信号与显式主观评价的对齐关系，并提出首个基于眼动数据预测视觉真实感的计算模型GazeEval。客观来看，其价值还在于构建并发布多视频、多参与者的眼动评估数据集，为后续AI生成视频感知质量研究提供基础。

Abstract: Human evaluation of AI-generated videos has so far relied on explicit human feedback, such as judgments or ratings. While these signals capture the conclusions viewers reach, they fail to offer insights into the perception that leads to them. This paper investigates eye tracking as a complementary human evaluation signal for AI-generated videos. We conducted two Visual Turing Test (VTT) experiments with a total of 90 participants on videos generated by latest generative models, in which participants watched each video twice and then gave their feedback. Across the experiments, we collected 4,286 valid eye-tracking trials on 438 videos. Our analysis indicates that gaze patterns offer informative evaluation signals that align with explicit human feedback. Building on the findings, we propose the first computational method GazeEval to predict the perceived visual realism of AI-generated videos from eye-tracking data. It achieves 71.3% accuracy in prediction, providing evidence that eye tracking data carries informative signals about how people evaluate a video. We release the study data to support further research on eye tracking for evaluating AI-generated video.

[176] Micro-Edits: Computational Support for Fine-Scale Edits in Film cs.HC | cs.CVPDF

Nhan Tran, Hijung Valentina Shin, Abe Davis, Mackenzie Leake

TL;DR: 论文关注电影剪辑中的细粒度微编辑（micro-edits），即通过调整片段精确时间或选择特定反应镜头来控制节奏与视觉注意力。作者先通过专业编辑的形成性研究理解其结构，进而提出数学形式化，并开发基于AI与优化的工具，帮助用户更简单高效地探索微编辑，最后通过多项用户研究和大量视频示例验证。

Details

Motivation: 标准剪辑工具中，细粒度微编辑需要用户将高层叙事目标手动映射到逐帧低层调整，过程缓慢繁琐；同时微编辑本身微妙且表达性强，不同选择对应不同创意目标，亟需计算支持。

Result: 摘要未给出具体定量指标或基准对比，仅说明在多项用户研究和广泛视频示例中验证了工具的有效性，未宣称达到SOTA或与特定模型相当。

Insight: 创新点在于将电影微编辑结构进行形成性研究与数学形式化，并利用AI和优化辅助用户探索细粒度剪辑选择。客观来看，其贡献更偏向问题定义、交互工具设计和形式化建模，而非单一模型性能提升。

Abstract: In film editing, every frame matters. While macro, content-level edits shape the high-level narrative of a film, small local edits often control timing and direct visual attention. For example, editors can adjust the precise timing of clips to control the length of a meaningful silence, or cut to shots that highlight a specific character’s reactions to important moments. These small, detailed edits are slow and tedious to make in standard editing tools because users have to map high-level narrative goals to low-level frame-by-frame adjustments. At the same time, these fine-scale adjustments, which we call micro-edits, can be nuanced and expressive, with different choices serving different creative goals. In this work, we start by conducting a formative study with professional editors to understand the structure of micro-edits and how they are used. We then derive a mathematical formalization for this structure to develop tools that leverage AI and optimization to make exploring micro-edits simpler and more efficient for users. Finally, we validate our tools in multiple user studies and a wide range of video examples.

cs.IR [Back]

[177] DuQUAD: A Dual-View Framework with Quality-Aware Evidence Pruning for Multi-Document Question Answering cs.IR | cs.AI | cs.CLPDF

Yeonjun Choi, Seyeon Jeong, Jong Wook Kim, Beakcheol Jang

TL;DR: 论文提出 DuQUAD，一个面向多文档问答的双视角框架，通过局部智能体与全局智能体协同推理，并结合质量感知的证据剪枝来缓解 LLM 在长上下文中的 Lost in the Middle 问题。该方法利用结构融合分数引导局部证据恢复，同时用显式质量评分和句子级精炼过滤噪声证据。

Details

Motivation: 现有检索增强生成模型常忽略多文档上下文中部证据，文档重排序和注意力引导等方法在噪声场景下易受错误相关性估计和虚假文档影响，仍会掩盖有用证据。

Result: DuQUAD 在多个强 Lost-in-the-Middle 缓解基线（包括混合检索重排序、多智能体推理和上下文优化方法）上取得更优表现，平均准确率提升 3.0%，金标准证据召回率提升 9.4%，且计算成本显著低于现有多智能体框架。

Insight: 创新点在于将局部定向证据恢复与全局上下文理解结合，并通过结构融合分数、质量评分和句子级证据剪枝提升噪声鲁棒性；客观看，其可借鉴之处是双视角智能体协同与质量感知证据过滤的联合设计。

Abstract: Large language models with retrieval-augmented generation systematically underutilize evidence in the middle of multi-document contexts, a phenomenon known as Lost in the Middle. Existing mitigation strategies, such as document reordering and attention steering, can reduce boundary bias but remain brittle in noisy settings, where inaccurate relevance estimation and spurious documents still obscure useful evidence in central positions. We propose DuQUAD, a multi-document QA framework that mitigates positional bias through dual-view reasoning and quality-aware evidence pruning. DuQUAD combines a Local Agent guided by a Structural Fusion Score with a Global Agent that reasons over the full document set, providing both targeted evidence recovery and broad contextual understanding. The framework further filters candidate evidence using explicit quality scoring and refines it at the sentence level to reduce noise. DuQUAD consistently outperforms strong Lost-in-the-Middle mitigation baselines, including hybrid retrieval and reranking, multi-agent reasoning, and context optimization methods, improving accuracy by 3.0% on average over the strongest competing baseline and gold evidence recall by 9.4%, while substantially reducing computational cost compared to existing multi-agent frameworks.

[178] Relevance-Guided Residual Calibration for Spectral Compression of Dense Retrieval Embeddings cs.IR | cs.CLPDF

Yongkang Li, Panagiotis Eustratiadis, Evangelos Kanoulas

TL;DR: 论文针对稠密检索中谱压缩（spectral compression）的权重设定问题，提出了相关性引导残差校准（Relevance-Guided Residual Calibration, RRC）。该方法利用相关性标注，对每个保留的主方向按正负样本得分贡献的均值与方差估计基于间隔（margin）的权重，再把对数权重分解为幂律趋势项与残差项；随后将残差叠加到压缩器原有的对数权重上，既单独调整各方向，又保留整体频谱趋势。RRC 为闭式解，可直接用于 PCA、Whitening 和 SpecTemp，无需迭代训练或额外推理阶段。

Details

Motivation: 谱压缩把嵌入投影到较小的主子空间以降低存储与打分开销，但其由语料导出的加权规则把所有保留方向绑定到同一频谱趋势上，没有直接考虑各方向对相关性的个体贡献。因此，论文希望利用相关性判断来校正这些方向权重。

Result: 在 3 种编码器、9 个数据集（涵盖常规检索与推理密集型检索）上的实验显示：SpecTemp+RRC 在 BEIR 组和 BRIGHT 上，于每个目标维度都取得所测压缩器中最高的平均有效性；在 5 个 BRIGHT 数据集、768 维时，平均比 SpecTemp 提升 2.34 nDCG@10。该增益在标量量化与乘积量化下依然保持，改善了单个文档的存储与检索效果之间的权衡。

Insight: 创新点在于：用正负样本得分贡献的均值、方差构造基于间隔的方向权重；再通过“幂律趋势与残差”的分解，让相关性信号只调整各方向的偏差，而不破坏压缩器的整体频谱结构；同时以闭式解并入文档与查询共享的现有变换，无需训练或额外推理。可借鉴之处是这种“保留先验结构、只做残差校准”的轻量后处理思路。

Abstract: Spectral compression reduces the storage and scoring costs of dense retrieval by projecting embeddings onto a smaller principal subspace. However, its corpus-derived weighting rules tie all retained directions to a shared spectral trend, without directly accounting for their individual contributions to relevance. To address this, we propose Relevance-Guided Residual Calibration (RRC), a closed-form method for refining spectral weights using relevance judgments. RRC estimates margin-based weights from the means and variances of positive–negative score contributions along each retained direction. It retains directions with positive estimated weights, decomposes their log weights into a fitted power-law trend and a residual, and adds the residual to the compressor’s log weights on this support. This allows relevance judgments to adjust individual directions while preserving the compressor’s overall spectral trend. RRC applies to PCA, Whitening, and SpecTemp, and incorporates the corrections into the existing transformation shared by documents and queries, without iterative model training or an additional inference stage. Experiments with three encoders on nine datasets covering conventional and reasoning-intensive retrieval show that SpecTemp + RRC achieves the highest mean effectiveness among tested compressors on the BEIR group and BRIGHT at every target dimension. On the five evaluated BRIGHT datasets, it improves over SpecTemp by an average of 2.34 nDCG@10 points at 768 dimensions. The gains also persist under scalar and product quantization, improving the trade-off between per-document storage and retrieval effectiveness. Our code is available at: https://anonymous.4open.science/r/rrc-spectral-compression-B5CE/

cs.LG [Back]

[179] How Much Do Teacher Bridges Matter in Interleaved On-Policy Distillation? cs.LG | cs.CLPDF

Leran Chen, Zhiyuan Yao, Lingnan Kong

TL;DR: 论文在交错式on-policy蒸馏中系统考察教师撰写的bridge片段是否以及如何起作用。以Qwen3-1.7B为学生、Qwen3-4B-Instruct-2507为教师，在相同轨迹上比较对bridge token不计损失、前向KL和反向KL，并按token作者分离梯度。短训练和BF16推理下，未发现bridge作为上下文或训练目标带来准确率提升，三种损失统计等价；探索性收益未能复现，结论受BF16评估和停止生成问题限制。

Details

Motivation: On-policy蒸馏通常在学生生成回复上使用教师预测，一些方法插入教师撰写的bridge片段，但对这些token应否加损失及用前向还是反向KL存在分歧。论文旨在控制变量下量化teacher bridge的贡献并澄清训练策略。

Result: 在Qwen3-1.7B/4B设置和预注册测试中，bridge仅占约2.7% token且梯度小、近正交，三种损失方向相似且在±5个百分点内统计等价；探索性定位bridge的收益在复现中未确认，四倍加权也无显著增益。

Insight: 创新在于按token作者分离梯度并在相同轨迹上比较三种bridge损失处理，结合预注册与复现来检验假设；客观价值主要是提供负结果和实验边界（BF16舍入、停止生成失败），提醒后续工作不能简单假定教师token监督普遍有效。

Abstract: On-policy distillation (OPD) trains a student using teacher predictions on student-generated responses. Some methods insert teacher-written segments, or bridges, but disagree on how to train on those tokens. We compare no loss, forward KL and reverse KL on identical trajectories using Qwen3-1.7B as student and Qwen3-4B-Instruct-2507 as teacher. We separate gradients by which model wrote each token. Under our short training runs and BF16 inference, pre-specified tests detected no added accuracy benefit from teacher text as context or as a training target. A one-paragraph bridge after the student’s first paragraph is only 2.7% of the tokens and contributes a small gradient nearly orthogonal to the student-token gradient. In this main comparison, the three loss treatments gave similar gradient directions and were statistically equivalent in accuracy within a +/-5 percentage-point margin. An exploratory pilot placing the bridge where failed responses disagreed most with the teacher suggested a benefit from teacher-token loss. A pre-specified replication did not confirm this, and fourfold weighting showed no significant accuracy benefit. Two limitations bound these findings. Among the tested amounts of training on fixed responses, gains peaked after four updates before the student increasingly failed to stop generating. None of the tested online training variants met the criteria for stable stopping and improved accuracy. Our evaluations used BF16 inference, which rounds away most of the small weight changes. When evaluated in exact FP32, the tested replication models frequently reached the response-length limit. Our accuracy findings therefore concern BF16 inference; they do not establish that teacher-token supervision is generally unnecessary.

[180] Persona Learning from Feedback for Personalized AI Assistants cs.LG | cs.AI | cs.CLPDF

Yiran Shen, Yu Xia, Liuyi Yao, Prithviraj Ammanabrolu

TL;DR: 论文提出 Persona Learning from Feedback（PLF）框架，用于个性化 AI 助手。该方法将可复用、由偏好反馈驱动的人格建模为共享冻结主干上的独立 LoRA 适配器，训练时利用冻结 self-teacher 结合人格规格与响应反馈提供 token 级监督，并用反馈门聚焦需改进的响应；部署时通过监督路由器根据请求或对话选择单个适配器或固定组合，无需用户特定微调。

Details

Motivation: 现有人格提示或基于人格条件生成微调的方法仅提供人格描述，难以明确特定回复中应改变或保留什么，以及何种行为适合当前请求。论文旨在从反馈中学习可复用且可自适应选择的助手人格。

Result: 论文在单轮个性化（模型生成批评）和多轮辅导（模拟学生反应）两种设置上评估 PLF。结果显示，PLF 在模型判断的偏好匹配度上优于固定人格策略以及人格提示、人格蒸馏等强基线，同时不降低通用能力。

Insight: 创新点在于将人格学习为独立的 LoRA 适配器，并利用响应特定反馈进行 token 级自监督校正；反馈门和部署时路由器使助手能按请求自适应选择或组合人格，且无需用户特定微调，提升了反馈训练行为的可复用性与自适应个性化能力。

Abstract: Personalizing AI assistants requires adapting their behavior to users’ preferences and task contexts. Existing work elicits assistant personas through persona prompting or finetuning on persona-conditioned generations. However, persona descriptions alone do not identify what to change or preserve in a particular response, or which behaviors suit the current request. We introduce $\textit{Persona Learning from Feedback (PLF)}$, a framework that learns reusable, preference-grounded assistant personas as independent LoRA adapters on a shared frozen backbone. During training, a frozen self-teacher conditions on persona specifications and response-specific feedback to provide token-level supervision on each adapter’s own generated prefixes. A feedback gate focuses corrective updates on responses judged to need improvement. At deployment, a supervised router uses the request or dialogue to select a single adapter or a fixed composition, without user-specific finetuning. We evaluate PLF on single-turn personalization with model-generated critiques and multi-turn tutoring with simulated students’ reactions. Across both settings, PLF improves model-judged preference fit over fixed-persona policies and strong baselines including persona prompting and persona distillation, demonstrating how feedback-trained behaviors can be reused for adaptive assistant personalization without degrading general capabilities.

[181] Contextual Embeddings Beyond the Gold Chunk cs.LG | cs.CL | cs.IRPDF

Sedigheh Eslami, Markus Krimmel, William Barber, Antoine Chaffin, Maximilian Schall

TL;DR: 论文提出 contextual embedding 模型 pplx-embed-v2-context，用于检索分布在多个 chunk 中的答案及验证答案所需的证据。方法通过从 query-aware context compression 模型中蒸馏 chunk 级细粒度相关性，摆脱对 gold chunk 标签的依赖，并采用视觉-语言骨干训练。作者还构建了两个新基准 Context-bench 和 Q2D-Chunk，并发布 9B 与 0.6B 模型。

Details

Motivation: 现有 contextual embedding 通常假设文档中只有一个相关 chunk，但真实检索场景需要找到跨多个 chunk 的答案以及用于验证答案的证据，且依赖 gold chunk 标签会限制模型与分块方式解耦。

Result: 9B 模型在 Context-bench、Q2D-Chunk 和 ConTEB 上取得新的 SOTA；在视觉检索基准 ViDoRe-V3 上，该模型在 dense retriever 中达到 SOTA，并且更细粒度的图像分块能带来性能提升。

Insight: 创新点在于从 query-aware context compression 模型蒸馏 graded chunk-level relevance，实现无需 gold-chunk 标签且与 chunking 无关的训练；同时利用视觉-语言骨干将检索能力迁移到图像检索，并推出标注答案 chunk 与验证证据的新基准和公开榜单。

Abstract: Contextual embeddings represent chunks of a document with respect to the document’s global context. These models are typically trained and evaluated under the assumption that a relevant document contains only a single relevant chunk. In this work, we argue that in real-world use cases a retriever should not only find answers spread over several chunks but also surface the evidence needed to verify them. To address this, we introduce pplx-embed-v2-context, a family of contextual embedding models trained by distilling graded chunk-level relevance from a query-aware context compression model. This removes the need for gold-chunk labels and makes the training targets independent of the chunking. We utilize a vision-language backbone for training and release pplx-embed-v2-context in 9B and 0.6B sizes with compatible embedding spaces. On the evaluation side, we introduce two benchmarks that label both the chunks that answer a query and the evidence needed to verify the answer. Context-bench is a controlled diagnostic, and Q2D-Chunk is built from real-world search queries. To encourage further research, we also publish Q2D-Chunk as a public leaderboard. Our 9B model sets a new state of the art on both benchmarks and ConTEB. We find that the visual retrieval capabilities of our 9B model transfer from its vision-language base model and propose to extend chunking to image inputs. We demonstrate that our models achieve state-of-the-art performance among dense retrievers on visual ViDoRe-V3 and that performance improves with granular image chunking.

[182] A Novel Approach to Evaluating Evaluation Metrics for Multi-Output Structured Prediction cs.LG | cs.CL | cs.CVPDF

Akshay Vyas, Angelo Pimienta, Nicholas Ruozzi

TL;DR: 论文研究多输出结构化预测中单一真实标签难以可靠评价的问题，提出人类评估者会依赖任务特定不变量（如着色图像中的目标边界、翻译中的命名实体）判断输出是否可接受。作者用近似任务特定不变量作为诊断工具，系统评估视觉和语言任务中的现有指标，并通过增强损失在模型输出中鼓励这些不变量，以检验指标可靠性。

Details

Motivation: 多输出结构化预测可能存在多个同样有效的输出，而训练数据通常只提供一个真实标签，导致现有评价指标难以可靠判断模型输出质量。论文希望从任务特定不变量角度揭示标准指标何时失效。

Result: 实验表明，通过增强损失强制满足不变量后，常用分布型指标有显著提升，而传统指标仅轻微变化；该不变量驱动评估还暴露了标准指标无法检测有意义差异的情况，并刻画了分布型指标成功或仍不足的条件。

Insight: 创新点在于将任务特定不变量引入评价指标评估，用其作为诊断工具并通过增强损失系统性测试指标可靠性；客观上，这为多输出结构化预测的评价提供了可解释、可干预的分析视角。

Abstract: In multi-output structured prediction tasks, while only one ground truth label may be provided in the training data, multiple equally valid outputs may be possible, making reliable evaluation a persistent challenge. We postulate that human evaluators implicitly use task-specific invariants, e.g., object boundaries in colorized images or named entities in translations, to judge if an output is acceptable. Under this assumption, we introduce a notion of approximate task-specific invariants and use them as diagnostic tools to evaluate a variety of existing metrics for vision and language tasks. We use these task invariants as part of a framework to systematically test metric reliability by encouraging domain-relevant invariants in model outputs via an augmented loss function. In our experiments, we observe that enforcing invariants with an augmented loss yields substantial improvements in popular distributional metrics while more traditional metrics change only marginally. Through this invariants-driven evaluation, we expose where standard metrics fail to detect meaningful differences, and we highlight the conditions under which distributional metrics succeed or still fall short.

[183] Event-SAMA: Language-Grounded Video Object Segmentation on Neuromorphic Event Streams cs.LG | cs.AI | cs.CL | cs.CVPDF

Sergei Fedorchenko, Max Zehnder, Nikola Zubić, Rong Zou, Davide Scaramuzza

TL;DR: 论文提出了 Event-SAMA-239K，这是将 SAMA-239K 视频对话语料及全部 SAMA 训练数据（含 30,650 个视频片段和 392,162 张图像）通过光流、FILM 或扫视上采样加线性事件生成器转换为合成事件流的数据集，并完整保留掩码、指代表达和对话标注；同时提出 Event-SAMA，将 SAMA-4B 适配到事件域，采用由预训练 RGB 权重初始化的双通道极性 patch embedding 和零初始化的 event adapter，建立了首个事件原生指代视频目标分割（RVOS）基线。

Details

Motivation: 事件相机具有微秒级时间分辨率、高动态范围和无运动模糊等优势，但指代视频目标分割（RVOS）领域缺乏事件流数据和模型。论文旨在填补这一空白，构建事件域 RVOS 数据集并给出首个事件原生基线。

Result: Event-SAMA 端到端训练后在 MeViS valid_u 上取得 24.37 J&F，在转换的 ReVOS valid 子集上取得 22.33 J&F，成为首个事件原生 RVOS 基线（RGB SAMA-4B 在 MeViS 上为 55.4，说明仍存较大差距）。冻结的 RGB SAMA-4B 用伪 RGB 渲染或 E2VID 重建仅得 13.23/15.94 J&F；消融显示多源训练数据（+4.99）、RGB 均值 event-stem 初始化（+4.33）和可训练 SAM2 掩码头（+2.76）有效。

Insight: 创新点在于：通过光流/FILM 上采样加线性事件生成器的合成转换方式，低成本构建保留全部标注的事件流 RVOS 数据集；以及从预训练 RGB 权重初始化双通道极性 patch embedding、配合零初始化 event adapter 将 RGB 模型迁移到事件域，使模型无需重训即可在真实事件相机录制上工作。

Abstract: Event cameras offer microsecond temporal resolution, high dynamic range and no motion blur, but referring video object segmentation (RVOS) lacks event-stream datasets and models. We introduce Event-SAMA-239K, a synthetic-event conversion of the SAMA-239K grounded video-chat corpus and all additional SAMA training data: 30,650 video clips and 392,162 images. Optical-flow, FILM or saccade upsampling followed by a linear event generator preserves all mask, referring-expression and dialogue annotations. We also introduce Event-SAMA, adapting SAMA-4B with a two-channel polarity patch embedding initialised from pretrained RGB weights and a zero-initialised event adapter. End-to-end training yields 24.37 $\mathcal{J}&\mathcal{F}$ on MeViS valid_u and 22.33 $\mathcal{J}&\mathcal{F}$ on the converted ReVOS valid subset, establishing the first event-native RVOS baseline (RGB SAMA-4B: 55.4 on MeViS). Frozen RGB SAMA-4B with pseudo-RGB renderings or E2VID reconstructions of the same events scores 13.23 and 15.94 $\mathcal{J}&\mathcal{F}$. Without retraining, Event-SAMA works on real event-camera recordings when the accumulation window matches their event density. A seed-controlled ablation with a measured noise floor of 0.47 $\mathcal{J}&\mathcal{F}$ finds gains from diverse training sources over MeViS alone (+4.99), RGB-mean event-stem initialisation (+4.33), and a trainable SAM2 mask decoder (+2.76); the event adapter, partial ViT unfreezing and event polarity are within noise at this budget. An earlier, partially converted corpus snapshot trained with the identical recipe scores 1.38 $\mathcal{J}&\mathcal{F}$ higher on MeViS and 1.12 higher on ReVOS. Both are single runs that also differ in schedule length, so we draw no conclusion about corpus scale.

[184] Quantum-Inspired Convolutional Networks for High-Resolution Pseudo-Label Generation from Multimodal Earth Observation Data cs.LG | cs.CVPDF

Abhishek Singh, Giovanni Cuozzo, Alexander Jacob, Claudia Notarnicola

TL;DR: 论文提出一种量子启发的卷积编码器-解码器网络，利用Sentinel-1 SAR与Sentinel-2多光谱影像，在仅有粗分辨率MODIS土地覆盖图引导下生成高分辨率伪标签。框架先通过重建分支进行自监督多模态表示学习，再结合低分辨率标签监督，从异构遥感输入中推断细尺度语义结构。

Details

Motivation: 高分辨率土地覆盖标注稀缺且昂贵，而多模态对地观测数据丰富但难以直接用于精细制图，因此需要利用粗标签和自监督学习生成高质量高分辨率伪标签。

Result: 在DFC2020数据集上，所生成伪标签经测试数据分类指标评估，较经典基线表现出更好的空间连贯性和类别一致性，说明方法在低标注遥感场景中具有潜力。

Insight: 创新点在于将量子启发卷积块用于增强特征提取与跨传感器融合，并结合重建式自监督预训练来生成高分辨率伪标签；其可借鉴之处是借助自监督多模态表示学习和异构数据融合缓解精细标注不足问题。

Abstract: Accurate land-cover mapping from multimodal Earth observation (EO) data remains a challenge in regions where high-resolution annotations are scarce or costly to obtain. This work introduces a quantum convolutional encoder-decoder network for pseudo-label generation using Sentinel-1 SAR and Sentinel-2 multispectral imagery, guided only by coarse MODIS-derived land-cover maps. The proposed framework uses quantum-inspired convolutional blocks to enhance feature extraction and cross-sensor fusion, enabling the model to infer a fine-scale semantic structure from heterogeneous inputs. Experiments were conducted on the DFC2020 dataset, which provides a quadruple of Sentinel-1 SAR, Sentinel-2 multispectral, low-resolution MODIS labels and high-resolution reference land-cover maps. The proposed training framework first learns a robust representation of multimodal inputs through the reconstruction branch before any supervision from low-resolution labels is applied. This self-supervised stage enables the model to capture a fine-scale spectral-spatial structure, which is then used to generate high-resolution pseudo-labels. These pseudo-labels are subsequently evaluated through classification metrics on the test data, demonstrating that the proposed approach produces more spatially coherent and class-consistent compared to classical baselines. The results highlight the potential of quantum-inspired deep learning to improve label generation in low-annotation remote sensing scenarios, offering a scalable path towards high-quality land-cover products for EO applications.

[185] Uncertainty-aware Feedback Loop Diagnosis: integrating reinforcement learning and conformal prediction for reliable wafer defect classification cs.LG | cs.CVPDF

Aleksandr Dekhovich, Carlas Smith, Oleg Soloviev

TL;DR: 论文提出一种面向晶圆缺陷分类的不确定性感知反馈闭环诊断方法 UFLD，将强化学习用于自适应测量采集，并结合保形预测在每个步骤给出预测不确定性，在获得足够信息后提前停止检测。该方法旨在减少高吞吐晶圆检测中的全表面扫描开销，并在 MixedWM38 数据集上验证了有效性。

Details

Motivation: 半导体制造需要在高通量条件下实现高精度、低成本缺陷检测，但现有深度学习方大多依赖完整表面扫描，难以满足高吞吐检测需求；同时，如何在自适应采集过程中可靠判断何时停止仍需解决。

Result: 在 MixedWM38 数据集上，UFLD 将采集时间减少约 40%，达到 98.4% 的检测准确率，且无需额外的置信度估计网络；实验表明其优于现有自适应采集方法和标准卷积神经网络。

Insight: 创新点在于将强化学习驱动的自适应测量与保形预测结合，用参数更高效的不确定性估计决定最优停止时间，避免依赖集成模型或额外置信度估计网络，从而兼顾检测效率、可靠性和参数效率。

Abstract: Semiconductor manufacturing is a complex, multi-step process that requires both high precision and low operating costs. Therefore, detecting defects in a high-volume setting is an important component of wafer map analysis for reliable production. However, most state-of-the-art deep learning approaches require a full scan of the surface, which hinders the development of high-throughput inspection systems. To address this problem, we propose Uncertainty-aware Feedback Loop Diagnosis (UFLD), a novel algorithm that employs reinforcement learning for adaptive measurement acquisition and provides a prediction uncertainty level after each step, stopping the process once sufficient information is obtained. Unlike existing methods that rely on ensemble models or auxiliary confidence estimation deep learning models, UFLD utilizes a more parameter-efficient conformal prediction framework to determine the optimal stopping time. The proposed UFLD reduces acquisition time by about $40%$ and achieves $98.4%$ inspection accuracy, without requiring an additional learned confidence-estimation network. We validated our approach on the MixedWM38 dataset, demonstrating its advantages over existing adaptive acquisition procedures and standard convolutional neural networks.

[186] Rethinking Neural Thickets Without Weight Perturbations cs.LG | cs.AI | cs.CVPDF

Nicolas Dufour, Elouan Gardès, Amil Dravid, Patrick Pérez, Loic Landrieu

TL;DR: 论文重新审视了 Neural Thickets 假设，发现随机权重扰动的性能增益并非源于权重空间的几何特性，而是来自输出多样性、基于验证集的选择和投票。作者提出 Perturb-Select-Vote (PSV) 框架，并证明仅对输出 logits 添加随机偏置（完全冻结模型）即可匹配甚至超过全权重扰动集成。该结论在语言推理任务和视觉领域偏移任务（包括地球观测）上得到验证。

Details

Motivation: 论文质疑 Neural Thickets 假设：随机高斯权重扰动带来的提升是否真的因为模型处于权重空间中的密集专家邻域？出发点是寻找更简单、无需训练且更通用的解释。

Result: 论文复现了原始增益，但发现仅扰动单个解码块或仅对 logits 加随机偏置就能匹配或超过全权重扰动。在大多数推理任务上，Logit PSV 达到或超过全权重扰动的水平；在视觉领域偏移（包括地球观测）上显著提升性能，而全权重扰动额外收益甚微。

Insight: 创新点在于将 Neural Thickets 重新解释为输出多样性、选择和投票的推理时方法（PSV），并证明小权重扰动主要通过诱导 logit 偏移起作用。客观分析：论文揭示了简单随机 logit 偏置加验证选择与投票的强大效果，为集成方法提供了新视角，并降低了计算成本（无需扰动权重），具有实用价值。

Abstract: The Neural Thickets hypothesis posits that pretrained language models lie in dense neighborhoods of task-specific experts in weight space, which random Gaussian perturbations can uncover. We reproduce the reported gains, but show that they do not require this geometric explanation. Perturbing a single decoder block already recovers much of the improvement, while keeping the model entirely frozen and adding a random bias to its output logits matches or exceeds full-weight perturbations on most reasoning tasks. This suggests an alternative explanation based on output diversity, validation-based selection, and voting. We formalize this view as Perturb-Select-Vote (PSV), a general procedure that generates perturbed predictors, selects high-performing members on a small validation set, and aggregates their predictions. This interpretation connects Neural Thickets to established inference-time methods, including sampling, self-consistency, and verifier-guided selection. A first-order analysis further shows that small weight perturbations act primarily through their induced logit shifts. We extend this analysis to vision, where logit PSV substantially improves performance under domain shift, including on Earth observation, while full-weight perturbations provide little additional benefit. Together, these results suggest that the gains attributed to nearby weight-space experts can instead be obtained through output diversity, selection, and voting. Logit PSV realizes these benefits with a fully frozen model, providing a simple, training-free alternative to full-weight perturbation ensembles across language and vision.

cs.NE [Back]

[187] GC-LIF: Spiking Group-Equivariant Neural Network With Group-Coupled Membrane Dynamics cs.NE | cs.CVPDF

Nhan Trong Luu, Duong Trung Luu, Thang Cong Truong

TL;DR: 论文研究脉冲神经网络中的群等变性，指出LIF神经元的膜递归会破坏G等变卷积的等变性，并给出神经元参数在群作用联合轨道上保持恒定的充要条件。基于此提出逐通道参数化的Group-Coupled LIF（GC-LIF），与p4/p4m等变卷积和脉冲率群最大池化组成SGE-Net，实现无需旋转数据增强的旋转不变脉冲视觉模型。

Details

Motivation: SNN在视觉任务中通常只能通过数据增强获得旋转不变性，而现有群等变CNN难以直接移植到SNN，因为LIF的膜状态递归可能破坏等变性，论文旨在为脉冲网络建立忠实的群等变结构。

Result: 在MNIST、KMNIST、Fashion-MNIST、CIFAR-10和CIFAR-100上，SGE-Net未用旋转训练仍对C4/D4不变，并在10个数据集-群对中的9个优于带旋转训练的普通SNN；非等变基线最差下降72个百分点。算子级测试验证理论，分析估计其算术能耗为标准CNN的1.7倍、八时间步下比对应ANN低2.3倍。

Insight: 创新点在于给出LIF等变性的充要条件并闭式求解，提出GC-LIF以逐通道耦合参数保持等变，同时排除常见异质逐神经元参数；客观上看，将群等变架构与脉冲神经元状态动态结合，并用群最大池化构建端到端SGE-Net，是其可借鉴之处。

Abstract: Spiking neural networks (SNNs) promise event-driven, low-power inference, but on vision tasks they still acquire rotation invariance only through data augmentation. Group-equivariant CNNs build such symmetries into the architecture, yet a faithful spiking analogue is missing: a leaky integrate-and-fire (LIF) neuron placed after a $G$-equivariant convolution can break equivariance through its membrane recurrence. We give a necessary and sufficient condition for this not to happen. The layer is equivariant at every time step if and only if the neuron parameters $(β, v_{\mathrm{th}})$ are constant along the joint orbits of the group action on the (group, space) index. We solve it in closed form, and it covers any elementwise stateful neuron. Its sufficiency half specialises a known result for equivariant recurrent networks; its necessity half rules out the heterogeneous per-neuron parameters common in SNNs. The per-channel parameterisation that satisfies it, Group-Coupled LIF (GC-LIF), is combined with $p4$ and $p4m$-equivariant convolutions and a spike-rate group max-pool into SGE-Net. On MNIST, KMNIST, Fashion-MNIST, CIFAR-10 and CIFAR-100, evaluating each checkpoint on the clean test set and all its group-transformed copies, SGE-Net trained without rotations is invariant under $C_4$ and $D_4$ and outperforms a plain SNN trained with rotations in nine of ten dataset-group pairs, whereas non-equivariant baselines lose up to $72$ percentage points in the worst case. Operator-level tests confirm the theory before and after training, and an analytical estimate places SGE-Net at $1.7\times$ the arithmetic energy of a standard CNN and $2.3\times$ below its ANN counterpart at eight time steps.

cs.RO [Back]

[188] LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies cs.RO | cs.AI | cs.CVPDF

Jialei Chen, Kai Wang, Kang Chen, Shuaihang Chen, Feng Gao

TL;DR: 论文提出LaWAM（Latent World Action Model），通过紧凑的潜空间视觉子目标而非重建未来视频，将预测动态暴露给机器人策略，从而实现高效且具备动态感知能力的机器人控制。其核心是在预训练视觉基础模型的潜空间中训练潜动作模型，并复用其前向解码器预测未来观测特征，再以这些潜视觉子目标为条件生成动作。

Details

Motivation: 现有视觉-语言-动作模型（VLA）缺乏对机器人动作如何改变场景的显式预见；而世界-动作模型（WAM）虽能利用预测未来辅助策略，但通常依赖计算昂贵的视频生成，并存在大量像素级冗余。

Result: LaWAM在LIBERO上达到98.6%成功率，在RoboTwin上达到91.22%成功率，并在真实机器人操作任务中取得SOTA或具竞争力的表现；每次动作块预测耗时187 ms，相比像素空间WAM最高降低24倍实际延迟。

Insight: 创新点在于在预训练视觉基础模型的潜空间中构建潜动作条件的世界模型，并复用其前向解码器预测未来观测特征，以潜视觉子目标替代像素级未来视频重建，从而兼顾动态感知与低延迟推理。

Abstract: Vision-Language-Action models (VLAs) leverage large-scale vision-language pretraining for semantic robot control, but often lack explicit foresight into how robot actions change the scene. World-Action Models (WAMs) address this limitation by conditioning policies on predicted futures, yet existing approaches typically rely on computationally expensive video generation with substantial pixel-level redundancy. We present LaWAM, a Latent World Action Model that exposes predictive dynamics to robot policies through compact latent visual subgoals instead of reconstructed future video. At the core of LaWAM is a latent-action-conditioned Latent World Model (LaWM). We obtain LaWM by training a latent action model in the latent space of a pretrained vision foundation model and repurposing its forward decoder to predict future observation features for scene evolution. LaWAM then conditions action generation on these predicted latent visual subgoals to enable dynamics-aware robot control. LaWAM achieves state-of-the-art or competitive success rates (SRs) across LIBERO (98.6% SR), RoboTwin (91.22% SR), and real-world manipulation tasks while retaining low-latency inference. LaWAM runs in 187 ms per action-chunk prediction and achieves up to 24x lower wall-clock latency than pixel-space WAMs.

[189] TACOS: Terrain-Aware COntact Supervision for Visual Footstep Planning cs.RO | cs.CVPDF

Jean-Michel Fortin, William Larrivée-Hardy, Gabriel Jeanson, Olivier Gamache, Daniele De Martini

TL;DR: 论文提出TACOS，一种地形感知接触监督方法，利用腿式机器人状态估计中因子图残差构造足步不稳定性分数，并将其投影到前序图像上以监督稠密视觉预测器，用于视觉足步规划。方法包含利用后见之明的硬分数和可即时获得的因果软分数两种变体。

Details

Motivation: 现有腿式机器人自监督足步规划中，监督信号多凭直觉选择，缺乏对其学习效果的系统检验；论文希望让机器人像人类一样通过视觉预判地面响应和足步稳定性。

Result: 在1716个人工标注接触上，两种变体在检测不稳定性和排序严重程度上均优于所有对比方法，pooled severity ranking较最强基线提升28%；三组户外测试中训练出的视觉预测器排序相关性较最强替代方案提升58%，加入机载上下文后再提升25%；50米森林轨迹实机实验中能处理泥地、植被等非几何地形并绕开倒枝等几何障碍。

Insight: 创新点在于用因子图残差定义一致且可投影的足步不稳定性监督信号，并区分硬后见监督与因果软监督；客观看，其将机器人状态估计残差转化为稠密视觉监督，使自监督信号具有估计依据，并在多独立评测和实机实验中验证。

Abstract: Humans navigate their environment based on their vision system, anticipating how the ground will respond before committing to a step. Self-supervised learning could provide legged robots the same ability, but the supervisory signal is typically chosen on intuition, and its effect on what the model learns is rarely examined. We present Terrain-Aware COntact Supervision (TACOS), which proposes a meaningful and consistent footstep instability score, based on the residual of a factor graph in legged state estimation. It projects the continuous score into preceding images to supervise a dense visual predictor. We propose two variants, a hard score that exploits hindsight and a causal soft score available immediately. Both metrics are compared against state-of-the-art alternatives in two independent evaluations that share no data or labels. On 1716 manually annotated contacts, both variants outperform every evaluated alternative at detecting instability and ranking its severity, improving pooled severity ranking by 28 % over the strongest baseline. On three outdoor test runs, our metric also trains the most accurate visual predictor, improving rank correlation by 58 % over the strongest alternative, and by a further 25 % when supplemented with onboard context. In a real-world experiment over a 50 m forest trajectory, the trained predictor handles non-geometric terrain properties such as mud and vegetation, while stepping around geometric obstacles like fallen branches. Code is available for reproducibility at https://github.com/norlab-ulaval/TACOS.

[190] What Actually Matters? A Paired Evaluation of Inference Settings for $π_{0.5}$ on BEHAVIOR-1K cs.RO | cs.AI | cs.CV | cs.LGPDF

Ruben Hammele, Samira Huber, Mohammad Nazeri, Amirreza Payandeh, Alexandyr T. Card

TL;DR: 论文针对视觉-语言-动作（VLA）模型在通用家庭机器人中的应用，基于2025 BEHAVIOR Challenge冠军方案微调的π0.5模型，在BEHAVIOR-1K全部100个任务上系统配对评估已有推理与数据收集策略。研究发现这些策略并不能一致地迁移到新环境和任务中，强调大规模多样任务下需重新审视推理与数据收集设置。

Details

Motivation: 小规模场景中有效的推理和数据收集策略未必适用于大规模、多样化的家庭机器人任务套件，因此需要在BEHAVIOR-1K全任务上系统检验其可迁移性。

Result: 微调的π0.5模型在公共测试集上取得0.39的Q-score；评估表明已有策略在不同环境和任务间迁移效果不一致，不能统一泛化。

Insight: 主要创新在于对推理与数据收集策略进行全100任务的配对评估，揭示策略迁移的非一致性；客观看，其价值更偏向系统性实证分析和评测方法，而非提出新的VLA模型结构。

Abstract: Vision-Language-Action (VLA) models offer a promising paradigm for general-purpose household robotics. However, inference and data-collection strategies that have been deployed in smaller-scale settings do not necessarily generalize to large-scale, diverse task suites. To address this gap, we conduct a systematic, paired evaluation of previously proposed inference and data-collection strategies across all 100 tasks. Our evaluation uses a fine-tuned $π_{0.5}$ model based on the 2025 BEHAVIOR Challenge winner, which achieves a Q-score of 0.39 on the public test set. These results show that proposed strategies do not transfer uniformly to new environments and tasks. Project page, videos, and detailed analysis: https://rubenhammele.github.io/behavior2026

[191] AtomTree: A Hierarchical Framework for State-Aware Embodied Instruction Following with LLMs cs.RO | cs.AI | cs.CLPDF

Haotian Zhai, Tianming Sha, Junnan Li

TL;DR: 论文提出AtomTree，一种基于LLM的分层、状态感知具身指令跟随规划框架。它不再一次性生成完整计划，而是从当前符号状态出发增量构建子目标与动作树，由LLM逐步决定继续分解还是输出可执行的低层动作，并结合轻量记忆模块和层次回溯重规划来提升长程任务中的鲁棒性与状态感知能力。

Details

Motivation: 现有具身指令跟随规划器要么依赖大规模标注轨迹，要么使用少样本/零样本LLM提示一次性串行生成完整计划；这类方法依赖语言常识、过早承诺初始计划且通常只在失败后更新，导致鲁棒性和状态感知较弱。

Result: 在ALFRED基准的零样本评估中，AtomTree优于先前的基于LLM的规划器；摘要未给出具体数值，但宣称在同类LLM规划方法中表现更优。

Insight: 创新点在于增量式构建子目标/动作树、基于当前符号状态逐步决策、轻量记忆复用历史结果，以及低层动作停滞时触发层次回溯重规划并从最新状态重建子树；客观看，其核心贡献是将状态感知、分层规划和失败回溯结合到LLM具身任务规划中。

Abstract: Embodied instruction following in interactive environments requires agents to interpret natural language commands and complete long-horizon tasks. Existing planners either rely on large labeled trajectories, or use few-shot and zero-shot LLM prompting that produces a whole plan in a single serial reasoning process. These approaches depend on linguistic common sense, commit to a plan from the initial instruction, and only update after failures, which weakens robustness and state awareness. We present AtomTree, a hierarchical framework for state-aware task planning with LLMs. AtomTree incrementally builds a tree of subgoals and actions, where the LLM decides at each step, from the current symbolic state, whether to further decompose or to output a grounded low-level action. A lightweight memory module summarizes past outcomes for reuse in later decisions. When a low-level action stalls, AtomTree triggers hierarchical backtracking replanning to return to the parent node and regenerate the subtree plan from the latest state, preventing continued drift along an incorrect trajectory. In zero-shot evaluation on the ALFRED benchmark, AtomTree outperforms prior LLM-based planners. Project page: https://zhaihaotian.github.io/atomtree-website/.

[192] EgoContact: Evaluating Physical Intelligence with Egocentric Video cs.RO | cs.CVPDF

Adam Deryło, Alexey Gavryushin, Daniel Cremers, Marc Pollefeys, Xi Wang

TL;DR: 论文提出EgoContact，一个基于第一视角视频的大规模数据集，用于通过未来接触点预测评估机器人操作先验的泛化性与精确性。数据集包含2.25万个经人工验证的交互事件，每个事件提供接触前观察、语义意图和像素级接触位置；作者还展示了该数据可用于提升机器人抓取操作性能。

Details

Motivation: 第一视角视频是学习通用操作先验的可扩展数据源，但在预训练机器人策略之外，尚未被充分利用来验证物理智能，尤其是理解物体应在何处接触以实现目标交互。

Result: 现有方法在多样真实场景中往往难以预测精确接触点，甚至难以定位目标物体；将EgoContact作为现有affordance-transfer策略的记忆库后，仿真抓取成功率从14.2%提升到31.2%，真实机器人从16%提升到58%。

Insight: 创新点在于构建带语义意图和像素级接触标注的第一视角交互数据集，并将未来接触点预测作为评估操作先验泛化性与精确性的任务；同时证明该数据可直接作为记忆库增强现有affordance迁移策略。

Abstract: Egocentric video has emerged as one of the most scalable sources of data for learning generalizable manipulation priors. Yet, despite its growing use in pretraining robotic policies, it has been underutilized as a validation tool for physical intelligence, a key component of which is understanding where to make contact with an object to achieve an intended interaction. We present EgoContact, a large-scale egocentric dataset for evaluating the generalizability and precision of learned manipulation priors through future contact-point prediction. EgoContact contains 22.5K manually verified interaction events, each with a pre-contact observation, semantic intent, and pixel-precise contact locations. We find that current methods often struggle to predict precise interaction contacts and sometimes fail to localize the target object in diverse, in-the-wild scenes, even when allowed multiple predictions. Furthermore, we demonstrate the usefulness of EgoContact’s annotated interactions for robotic manipulation: simply using EgoContact as the memory bank of an existing affordance-transfer policy improves grasp success from 14.2% to 31.2% in simulation and from 16% to 58% on a real robot.

[193] Decoding Geometry, Not Tokens: Efficient VLMs for Robot Affordance and Trajectory Prediction cs.RO | cs.CVPDF

Akila Ayanthi, Darshana Priyasad, Tharindu Fernando, Dimity Miller, Sridha Sridharan

TL;DR: 论文指出机器人抓取可供性与轨迹预测本质上是连续几何预测问题，而现有视觉语言模型将其转化为坐标文本的token自回归生成，导致空间结构丢失、精度截断和误差累积。作者发现0.5-2B参数的紧凑VLM中间隐藏状态已包含丰富空间信息，因此提出在冻结骨干网络上附加轻量、几何兼容的预测头，通过指令条件化查询和视觉token交叉注意力直接回归可供性框与轨迹路点。

Details

Motivation: 现有VLM将空间坐标token化并自回归解码，忽略空间结构且截断连续精度，解码过程中坐标token错误会累积；论文旨在避免这种语言生成式几何预测，探索紧凑VLM隐藏状态中的空间信息并高效解码。

Result: 在ShareRobot-Bench和AGD20K上，2B变体相对自回归基线将轨迹误差降低60%以上，并将ShareRobot-Bench可供性mAP提升85%；轨迹预测接近RoboBrain（0.251 vs 0.191 DFD），同时吞吐量高3.8倍。

Insight: 创新点在于揭示自回归解码是轨迹预测的主要瓶颈，且可供性预测还依赖特征深度与解码器架构；方法上冻结骨干网络，从中间隐藏层读取空间特征，用轻量几何兼容预测头结合指令条件化查询与交叉注意力直接连续回归几何量，实现精度与效率的有利权衡。

Abstract: Predicting where to grasp and how to move is fundamentally a geometry problem. Vision-language models treat it as language generation instead. They tokenize spatial coordinates into text and decode them autoregressively. This mechanism ignores spatial structure and truncates continuous precision. Errors compound across coordinate tokens during decoding. In this paper, we show that compact off-the-shelf VLMs with 0.5-2B parameters already encode rich spatial information in their intermediate hidden states. Autoregressive decoding is the dominant bottleneck for trajectory prediction, while affordance prediction depends additionally on feature depth and decoder architecture. We expose the latent spatial information with a lightweight, geometry-compatible prediction head that attaches to a frozen backbone. It reads features from an intermediate hidden layer, conditions a learned query on the task instruction and refines it via cross-attention over the visual tokens to regress affordance boxes and trajectory waypoints directly as continuous values, without modifying the backbone. We evaluate on ShareRobot-Bench and AGD20K. Our 2B variant reduces trajectory error by over 60% and improves ShareRobot-Bench affordance mAP by 85% relative to the autoregressive baseline. It approaches RoboBrain on trajectory prediction (0.251 vs 0.191 DFD) at 3.8x higher throughput. These results demonstrate a favorable accuracy-efficiency trade-off for instruction-conditioned 2D geometric prediction.

[194] How Much Should a VLA Trust Its Reasoning? Step-Level Guidance as a Measured Action-Value Function cs.RO | cs.CV | cs.LGPDF

Dabin Seo, Eunhyek Joa

TL;DR: 论文研究推理型视觉-语言-动作（VLA）策略中推理轨迹应以多大强度引导动作生成的问题。作者提出CoC-CFG，在每步去噪/欧拉步上用一个权重调节推理跨度对策略的影响，并把权重选择建模为动作价值可精确测量的马尔可夫决策过程，进而用Q-adaptive guidance和小型critic自适应选择权重。在Alpasim驾驶仿真和Waymo端到端驾驶基准上，该方法优于固定权重、在线强化学习和多种自适应引导方法，并在隐藏测试集取得SOTA。

Details

Motivation: 推理型VLA先写推理轨迹再解码动作，错误推理会导致错误动作，甚至看似正确的推理也可能误导规划。现有工作主要判断推理是否正确，本文则关注推理应以多强程度影响动作，即如何避免过度信任推理。

Result: 在Alpasim仿真中，开环优于所有固定权重和SAC、GRPO，闭环通过300个场景中的262个，原策略为252个；在Waymo留出帧上，前三阶段优于所有固定权重、四种自适应引导方法、SAC和GRPO；隐藏测试集上取得8.135159的评分，超过已发表最佳方法的8.079，达到SOTA。

Insight: 创新点在于把“是否信任推理”转化为“每步信任多少”的连续引导强度控制问题，并将引导权重视为可精确测量的动作价值函数而非自举估计，再用小型critic保守地改进控制器。客观来看，该方法将推理引导强度自适应化，且一步价值测量明确，为推理型VLA的推理使用强度控制提供了可借鉴范式。

Abstract: Reasoning vision-language-action (VLA) policies write a reasoning trace and then decode the action from it. A wrong trace yields a wrong action, and even a correct-looking trace can mislead the plan. Existing remedies ask whether the reasoning is right. We ask how strongly it should steer. CoC-CFG applies classifier-free guidance between the policy’s context and the same context without the reasoning span. One weight per Euler step attenuates or amplifies the reasoning, and w=1 recovers the original policy. We treat the choice of this weight as a Markov decision process whose action values are measured, not bootstrapped. With the expert frozen and the noise fixed, applying a weight for one step and finishing the plan under the current controller returns that weight’s value exactly. Q-adaptive guidance fits these values with small critics and improves the controller conservatively. In the Alpasim driving simulator it outperforms every fixed weight and online RL (SAC, GRPO) in open loop, and in closed loop it passes 262 of 300 scenes, against 252 for the original policy. On held-out frames of the Waymo end-to-end driving benchmark, its first three stages outperform every fixed weight, four adaptive-guidance methods, SAC and GRPO. On the hidden test set, a frozen Alpamayo 1.5 with rule-based camera and vehicle conversions and Q-adaptive guidance sets a new state of the art among published methods: 8.135159 rater feedback score, against 8.079 for the best published method.

Abdulahi Taiwo, Chijioke Cyriacus Ekechi

TL;DR: 论文研究用于自主机器人导航的单目RGB人体跟踪中，感知误差如何影响“停止/前进”二元安全决策，并提出决策级错误归因与深度感知安全评估方法。作者证明仅横向距离规则是平面距离规则的下界，提出两因子Shapley归因区分安全规则与感知贡献，并进一步区分漏检与定位误差。实验在ETH/UCY行人视频的模拟静止机器人场景中进行，发现漏检是漏危险的主要来源，校准地平面定位可显著降低平面定位误差，配合安全边际可减少不必要停止。

Details

Motivation: 现有单目RGB人体跟踪多用几何精度指标评估，但这些指标不能直接反映机器人停止/前进决策中的安全错误。论文关注如何量化决策错误究竟来自安全规则还是感知误差，并评估深度感知与定位误差对机器人安全决策的影响。

Result: 在3个场景898名行人上，仅横向规则在标注位置上未漏危险，但停止精度仅5.6%–31.9%。RGB感知下，校准地平面定位的平面RMSE为0.59m和0.51m，优于几何基线的1.72m/1.39m及校准Depth Anything V2的0.81m/0.68m；检测召回0.43和0.26使漏检成为漏危险主要来源。带2倍标准差安全边际的地平面定位在全部8个场景-阈值设置中匹配或改善横向规则漏危险率，并在7个设置中减少不必要停止。

Insight: 创新点在于从决策级而非纯几何精度评估单目RGB人体跟踪安全风险，提出可分离安全规则与感知贡献的Shapley归因框架，并区分漏检和定位误差来源。客观看，其价值在于将横向距离规则的理论下界性质、深度感知定位误差与机器人停止决策安全指标联系起来，为感知系统安全评估提供了可解释的归因分析思路。

Abstract: Monocular RGB tracking is useful for robots operating near people, but perception errors affect binary stop/proceed decisions in ways that geometric accuracy metrics do not capture. We examine how much decision error arises from the safety rule versus perception. We prove that lateral-only distance is a lower bound on planar distance: with accurate positions, it cannot miss dangers identified by the planar rule, but it produces unnecessary stops. We introduce a two-factor Shapley attribution separating rule and perception contributions, and further distinguish missed detections from localization errors. Experiments use ETH and UCY pedestrian videos with simulated stationary robots, disjoint calibration and evaluation pedestrians, and time-block bootstrap intervals. Across 898 pedestrians in three scenes, the lateral rule missed no dangers on annotated positions but achieved only 5.6-31.9% stop precision. In two scenes with RGB perception, calibrated ground-plane localization achieved 0.59 m and 0.51 m planar RMSE, compared with 1.72 m and 1.39 m for a geometric baseline and 0.81 m and 0.68 m for calibrated Depth Anything V2. Detection recall of 0.43 and 0.26 made missed detections the leading source of missed danger. A two-standard-deviation safety margin with ground-plane localization matched or improved on the lateral rule’s missed-danger rate in all eight scene-threshold settings and reduced unnecessary stops in seven. All robot interactions are simulated, and outcomes are offline decision classifications, not demonstrations of collision avoidance.

[196] SymAnt: Grounding Long-Horizon Action Anticipation with Adaptable Symbolic Priors cs.RO | cs.CVPDF

Fnu Aryan, Yaqi Xie, Joseph Campbell, Woojun Kim, Kwonjoon Lee

TL;DR: 论文提出SymAnt，一种神经符号方法，用于从短观测窗口预测长时程未来动作序列。它联合搜索场景图与知识图构建符号上下文，并以此作为先验迭代细化未来动作序列。方法参数高效，且允许用户直接编辑知识来调整预测而无需再训练。

Details

Motivation: 纯神经模型通常需要大量观测才能预测未来动作，且难以解释和调整；论文希望利用结构化的符号先验，在短观测条件下实现可解释、可调整的长时程动作预测。

Result: 论文在Breakfast、50 Salads、EPIC-KITCHENS、EGTEA Gaze+和Assembly101五个数据集上验证了SymAnt的有效性，尤其在仅有短观测上下文时表现突出；摘要未给出具体定量指标或明确SOTA对比。

Insight: 创新点在于将场景图与知识图的联合搜索得到的符号上下文作为神经推理先验，并通过迭代细化生成动作序列；同时支持直接编辑底层知识来调整预测，兼顾神经网络的表达力与符号系统的可解释性和可调性。

Abstract: As robots and intelligent systems increasingly interact with humans, they must anticipate long sequences of future actions from only brief observations. While purely neural models typically require extensive observations to predict future actions and remain difficult to interpret and adjust, symbolic priors offer a structured alternative. To this end, we introduce SymAnt, a novel neuro-symbolic approach that unifies the expressiveness of neural networks with the structured reasoning of scene and knowledge graphs. Given a short video, SymAnt performs a joint-search over both graphs to construct a symbolic context, enabling unified reasoning over spatial relationships, object attributes, affordances, and associated actions. This symbolic context serves as a prior for an iterative refinement process that progressively generates and improves the sequence of future actions. By grounding predictions in symbolic context, SymAnt anticipates long-horizon actions from short observation windows in a parameter-efficient manner, while enabling users to directly edit the underlying knowledge to adjust predictions without further training. Through our experiments, we demonstrate the effectiveness of SymAnt, particularly when only short observation contexts are available, across five diverse datasets: Breakfast, 50 Salads, EPIC-KITCHENS, EGTEA Gaze+, and Assembly101.

cs.SD [Back]

[197] Who Called? V33DA: A Physically Verified Multimodal Benchmark for Vocal Attribution in Zebra Finch Groups cs.SD | cs.CV | cs.LG | q-bio.QMPDF

Maris Basha, Yuhang Wang, Xiaoran Chen, Longbiao Cheng, Luca Yapura

TL;DR: 论文提出 V33DA，一个面向斑胸草雀群体空间发声归属的多模态基准数据集，包含 33,625 个经物理验证的事件，耦合 5 通道音频、三路摄像头、标定 3D 姿态和个体无线电遥测。任务是在给定检测到的叫声和可见候选鸟时选择发声者，并在熟悉个体测试、跨实验迁移和留一个体验证三种设置下评估。作者同时发布固定协议、代码以及未评估的 V33DA++ 伴随集。

Details

Motivation: 判断动物群体中哪一只个体发出叫声以及叫声发生位置对社会交流研究很关键，但现有资源要么只做声音定位不识别发声者，要么仅从孤立叫声识别个体而缺乏 3D 候选几何信息，且很少使用物理验证的真值。

Result: 参考方法显示域内准确率与迁移到未见个体之间存在一致差距：可利用熟悉发声身份的方法在已知发声者上表现好但遇到未见个体明显退化，而保留显式空间推理的候选感知方法迁移更好；体载参考方法在各设置下接近完美，验证了加速度计标签的一致性。

Insight: 创新在于构建物理验证的多模态发声归属基准，将音频、多视角视觉、3D 候选姿态和遥测结合，并用体载加速度振动信号作为不提供给模型的验证上界；同时系统评估多种泛化设置并发布重叠叫声与上下文窗口的伴随集。

Abstract: Deciding which member of an animal group produced a vocalization and where that vocalization was produced are central to studying social communication but are rarely evaluated with physically verified ground truth. Existing resources either localize sounds without identifying the caller, or recognize individuals from isolated vocalizations without reliance on the 3D candidate geometry. We close this gap with V33DA, a dataset-centered multimodal benchmark for spatial vocal attribution in social zebra finches: it comprises 33,625 verified events coupling 5-channel audio with three camera views, calibrated 3D pose for every visible candidate, and per-bird radio telemetry across 10 individuals and three experiments. Caller identity is verified from an on-body accelerometer-derived vibration signal; this channel is withheld from benchmark models and used only by an on-body reference ceiling. Given a detected vocalization and the visible candidate birds, the task is to select the caller. We evaluate it under three regimes: session-disjoint testing on familiar birds from held-out recording dates, held-out-experiment transfer to a new cohort, and leave-one-individual-out evaluation on a bird whose vocalizations are held out from training. Reference methods expose a consistent gap between in-domain accuracy and transfer to unseen individuals: methods that can exploit familiar vocal identity perform well on known callers but degrade sharply on unseen ones, whereas candidate-aware methods preserving explicit spatial reasoning transfer substantially better. The on-body reference stays near-perfect across regimes, confirming the internal consistency of the accelerometer-verified labels. We release V33DA with fixed protocols and code for the evaluated methods, and V33DA++, an unevaluated companion set of verified overlapping-call events and +/-2 s context windows.

cs.SE [Back]

[198] When Requirements Interact: Scaling Long-Horizon Coding via Interdependent Specifications cs.SE | cs.CLPDF

Yishuo Cai, Minzheng Wang, Liang Zhao, Linghao Zhang, Lei Li

TL;DR: 论文提出 CodeSpecWeave 框架，用于合成具有丰富且相互依赖规格（specification）的长时程编程任务。以真实开发者种子为基础，合成智能体迭代生成耦合的任务需求与可执行测试，并由审查智能体基于多个模型的解题轨迹审计以保证测试可靠性。基于该流程构建了覆盖 2,865 个仓库的 4,670 个训练任务，在此上进行强化学习显著提升基座模型在 DeepSWE-v1.1 上的表现，并额外构建了含 100 个任务、1,044 条规格的 CodeSpecWeave-Bench 基准。

Details

Motivation: 真实长时程软件开发需同时满足接口兼容、错误处理等多维规格且不破坏既有依赖，而现有编程智能体任务在规格的数量与多样性上均不足，往往只强调主目标而忽略复杂约束。

Result: 在 4,670 个合成任务上做强化学习后，基座模型在 DeepSWE-v1.1 上显著提升并大幅超越现有基线；CodeSpecWeave-Bench 能清晰区分前沿模型，并揭示处理相互依赖工程约束仍有较大提升空间。

Insight: 创新点在于以“耦合需求+可执行测试”联合迭代合成任务，避免规格退化为琐碎清单，并用多模型轨迹审查保证测试可靠；客观上看，将规格交互性作为任务难度与推理深度的核心来源，并提供可区分前沿模型的严苛基准，是较有价值的贡献。

Abstract: To succeed in real-world long-horizon software development, coding agents must satisfy multi-dimensional task specifications, such as interface compatibility and error handling, and do so without breaking existing dependencies. However, current works lack specification in both quantity and diversity, often emphasizing primary goals while ignoring complex constraints. Synthesizing tasks to bridge this gap presents two challenges: naively adding specifications risks reducing tasks to trivial checklists rather than compelling joint reasoning, and verifying these subtle interactions risks overlooking hidden flaws or rejecting valid alternatives. To address these challenges, we introduce CodeSpecWeave, a framework for synthesizing tasks with rich, interdependent specifications. Grounded in real developer seeds, a synthesis agent iteratively develops both coupled task requirements and executable tests, while a review agent audits solution trajectories from multiple models to guarantee test reliability. Using this pipeline, we construct 4,670 training tasks across 2,865 repositories. Applying Reinforcement learning on these tasks significantly improves performance over the base model on DeepSWE-v1.1, largely outperforming existing baselines. Furthermore, we curate CodeSpecWeave-Bench, a rigorous benchmark comprising 100 tasks and 1,044 specifications, which clearly separates frontier models and reveals significant headroom in handling interdependent engineering constraints.

eess.IV [Back]

[199] Towards Myocardial Infarction Diagnosis: An Investigation into Machine Learning and Deep Learning Algorithms using ECG Data eess.IV | cs.CV | cs.LGPDF

Rafid Ahnaf, Husne Mubarak, Fahim Ahsan, G. M. Refatul Islam, Rafeed Rahman

TL;DR: 论文提出一种多步自适应滤波的ECG信号归一化方法 Visionary V2，并在PTB Diagnostic ECG Database上使用全部15导联系统研究机器学习和深度学习用于心肌梗死检测。方法包括基于统计特征的Bagging决策树集成，以及将滤波信号转换为图像后训练ResNet-50和自定义CNN，并结合LIME、Grad-CAM和Integrated Gradients进行可解释性验证。

Details

Motivation: 心肌梗死致死风险高，及时检测可降低死亡率；ECG是主要诊断手段，但人工判读易受人为误差影响，因此需要快速、准确的自动化MI筛查方法。

Result: 在PTB Diagnostic ECG Database上，基于R-R interval等统计特征的Bagging决策树达到96.6%准确率，高于BioSPPy处理后的87.7%；图像模型中自定义ResNet-50在7000张验证图像上仅误分类1张，自定义CNN的F1约98.7%。

Insight: 创新点在于提出Visionary V2自适应滤波归一化流程，并系统比较统计特征ML与ECG图像化DL方法；同时用多种可解释性方法验证模型关注ECG波形而非背景，为ECG自动筛查提供了信号预处理与可解释性结合的思路。

Abstract: Myocardial Infarction (MI) is a severe and potentially fatal cardiac condition caused by myocardial injury due to ischemia, and timely detection can substantially reduce its mortality. Electrocardiography (ECG) is the primary diagnostic modality for MI, but manual interpretation is susceptible to human error. In this work, we propose Visionary V2, a multi-step, adaptive filtration method for ECG signal normalization, and use it to study machine learning (ML) and deep learning (DL) approaches to MI detection on the PTB Diagnostic ECG Database using all 15 available leads. On statistical features extracted from the filtered signals, such as the R-R interval, a Bagging ensemble of decision trees reaches 96.6% accuracy, compared with 87.7% when the signals are processed with BioSPPy. We further generate an image dataset from the filtered signals, on which a custom ResNet-50 misclassifies only 1 of 7,000 validation images and a custom CNN reaches an F1 score of about 98.7%. Finally, we apply LIME, Grad-CAM and Integrated Gradients to verify that the image models attend to the ECG waveform rather than the background. These results indicate that careful signal normalization combined with ML and DL models can support fast and accurate automated MI screening.

[200] From the Superderivative to a Relative-Gradient Edge Operator eess.IV | cs.CVPDF

Alejandro Garnung Menéndez

TL;DR: 论文从乘法导数（superderivative）出发，重新审视对数梯度幅值这一相对梯度边缘算子，构造度量相对灰度变化、对全局灰度缩放不变的边缘强度图。方法可用经典梯度核加点除两步实现，并在合成图与BSDS500上同Sobel等一阶导数滤波及Canny比较。作者强调贡献在于算子构造及其不变性，而非新的SOTA。

Details

Motivation: Sobel、Prewitt、Roberts、Scharr等一阶导数边缘检测器度量绝对灰度差，缺乏对全局强度缩放的不变性；论文希望借助superderivative与对数梯度的类比，得到度量相对变化且尺度不变的边缘算子。

Result: 在合成真值边缘和BSDS500上，绝对梯度与对数梯度之间的参数族中，小中间指数表现最好：按单图指标略优于经典核且统计可检测；在与单σ Canny相同高斯平滑下，ODS持平、OIS和AP领先，但调参Canny在ODS仍更优。单阈值优势在留出测试集未复现，全相对端点从未最佳，整体并非SOTA。

Insight: 创新点是将乘法导数/superderivative与对数梯度幅值联系起来，提出局部、无原点、各向同性的相对梯度边缘算子，获得全局灰度缩放不变性；实现仅需经典梯度核加点除，并给出在绝对梯度与对数梯度间插值的参数族。客观看，主要价值是构造与不变性分析，而非性能突破。

Abstract: First-derivative edge detectors such as Sobel, Prewitt, Roberts and Scharr measure absolute grey-level differences. We revisit the log-gradient magnitude, a relative-gradient edge operator, and motivate it by analogy with the superderivative, a multiplicative derivative in which the independent variable is perturbed multiplicatively rather than additively. In one and two dimensions the logarithm of the superderivative is a radial logarithmic derivative; its local, origin-free, isotropic analogue is the magnitude of the logarithmic gradient. The resulting operator measures relative rather than absolute change, giving an edge-strength map that is invariant under global intensity rescaling. We present the theory, show how the operator can be implemented in two steps—a classical gradient kernel plus a pointwise division—and compare it with standard first-derivative filters on synthetic images with ground-truth edges and on the official BSDS500 benchmark. We also study a parametric family that interpolates between the absolute gradient and the log-gradient; empirically, the best members are small intermediate exponents, which edge the classical kernels by a small but statistically detectable margin in the per-image metric and, with the same Gaussian smoothing as the single-$σ$ Canny, match it in ODS and lead it in OIS and AP, while the tuned Canny remains ahead in ODS. The single-threshold margin over the kernels does not replicate on the held-out test split, and the fully relative endpoint is never the best member, its ranking depending on the edge-map normalisation. The contribution is the construction and the invariance it buys, not a new state of the art.

Julian Andres Hernandez-Potes, Tomás Arias-Vergara, Daiqi Liu, Andreas Maier, Paula Andrea Perez-Toro

TL;DR: 论文面向声道实时磁共振成像（rtMRI）视频，提出一种自监督集成去噪框架：将时空超分辨率学习与由方差稳定非局部均值滤波得到的伪监督结合，并用双模型融合平衡噪声抑制与高频声道结构保留。

Details

Motivation: rtMRI需要在时间分辨率与信号质量之间权衡，且运动声道无法获取干净参考，监督去噪不适用；目标是在无干净参考条件下抑制噪声并保留精细发音结构。

Result: 在USC-75多说话人自然噪声数据上，对未见受试者SNR提升11.9 dB且保留更多高频发音内容；在严重高斯、瑞利和莱斯噪声下PSNR提升7.6–11.8 dB，SSIM约提升三倍。与各向异性扩散、块匹配滤波、非局部均值等调优方法相比，同等去噪强度下所提方法更好保持高频与结构保真。

Insight: 创新点在于自监督集成去噪、方差稳定非局部均值伪监督及双模型融合；消融表明方差稳定伪监督（尤其硬阈值）对去噪至关重要，为无干净参考的动态医学影像去噪提供了可借鉴思路。

Abstract: Real-time magnetic resonance imaging of the vocal tract makes speech articulation directly observable, but the trade-off between temporal resolution and signal quality introduces substantial noise and obscures fine articulatory detail. Since clean references cannot be acquired for a moving vocal tract, supervised denoising approaches are not applicable in this setting. We propose a self-supervised denoising framework that combines spatiotemporal super-resolution learning with pseudo-supervision derived from a variance-stabilized non-local means filter. A dual-model fusion strategy balances noise suppression and preservation of high-frequency articulatory structure. Experiments on the USC-75 multi-speaker dataset under natural noise conditions show that the ensemble raises the signal-to-noise ratio by 11.9 dB on unseen subjects while attaining more high-frequency articulatory content in the frames. Among tuned implementations of anisotropic diffusion, block-matching filtering, non-local means and pre-smoothed non-local means, every configuration that achieves comparable noise suppression does so at the cost of high-frequency content or of structural fidelity. Under severe added Gaussian, Rayleigh and Rician noise, peak signal-to-noise ratio improves by 7.6 to 11.8 dB and structural similarity roughly triples. An ablation shows that the variance-stabilized pseudo-supervision is an essential element for denoising, and that the effect is attributable to the hard thresholding contained in the stabilization transform.

q-bio.QM [Back]

[202] Agentic LLM reasoning in pediatric diabetes outcome prediction from multimodal medical records q-bio.QM | cs.CLPDF

Daniel Palacios, Guantong Qi, Anna Kadi, Natali Borrego, Sukru Aras

TL;DR: 论文提出CEDAR，一种证据引用与自我审计的LLM智能体流程，利用多模态儿科糖尿病医疗记录（结构化数据、笔记衍生的社会决定因素及T1D的连续血糖监测数据）预测24个月后的结局。在2,489名T2D和4,018名T1D青少年队列中，CEDAR在多个结局预测上显著优于传统机器学习模型，并展现出高引证准确性和临床可解释性。

Details

Motivation: LLM智能体虽被用于临床预测，但尚未在儿科验证；儿科队列规模小、结局罕见，传统机器学习可能受限，需要可解释且可靠的预测方法。

Result: CEDAR在T2D中汇总AUC为0.815（对比ML的0.656-0.700），T1D中为0.756（对比0.603-0.631），在稀疏筛查结局上提升最明显；其引用的70,246个数值中仅4个与病历不符，两名儿科内分泌学家仅阅读其证据和推理后约90%病例预测一致，专家间一致率90.5%。

Insight: 创新点在于将LLM智能体设计为证据引用和自我审计的临床预测管道，融合多模态记录并输出可追溯推理；客观看，其价值在于提升小样本罕见结局的预测性能与临床可信度，通过专家一致性验证了可解释性。

Abstract: Large language model (LLM) agents are proposed for clinical prediction but are untested in pediatrics, where cohorts are small and outcomes are uncommon. Using records from 2,489 youth with type 2 diabetes (T2D) and 4,018 with type 1 diabetes (T1D), spanning structured data, note-derived social determinants and, in T1D, continuous glucose monitoring data, we predicted seven T2D outcomes, four also in T1D, at 24 months from 18 months of follow-up. CEDAR (Clinical Evidence-Driven Agent for Risk-prediction), an evidence-citing, self-auditing LLM pipeline, outperformed trained machine learning in both cohorts (pooled area under the receiver operating characteristic curve 0.815 versus 0.656 to 0.700 in T2D and 0.756 versus 0.603 to 0.631 in T1D), most on the sparsely screened outcomes. Only 4 of 70,246 values it cited did not match the chart. Reading only the evidence and reasoning cited by CEDAR, two pediatric endocrinologists reached the same prediction as CEDAR in about nine of ten cases, agreeing with each other on 90.5%.

Table of Contents

cs.CL [Back]

[1] Artifact Distillation: Training-Free Transfer from Frontier to Small Language Models cs.CL | cs.AI | cs.LGPDF

[2] Supervised Fine-Tuning for Reasoning Large Language Models: A Survey cs.CL | cs.AI | cs.LGPDF

[3] Rank-Aware Differentially Private Release of Listwise Preferences for LLM Alignment cs.CL | cs.AIPDF

[4] Grounding Long Financial Text with Semantically-Enriched Tables via Multimodal Learning cs.CLPDF

[5] FAD-KV: Adaptive Dictionary KV Caching for Efficient Reasoning Decoding cs.CL | cs.LGPDF

[6] QMUL_AK at AISA-ArabicFC: Schema-Constrained Function Calling with ALLaM cs.CLPDF

[7] CARF: Context-Aware Reasoning Supervision for Scientific Evidence Screening cs.CLPDF

[8] Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing cs.CL | cs.AIPDF

[9] Nemotron 3.5 Super and Lightning: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Models for Agentic AI cs.CL | cs.AI | cs.LGPDF

[10] ATI-OPD: Adaptive Teacher Intervention for Stable Long-Sequence On-Policy Distillation cs.CLPDF

[11] Scaling Lean Theorem Proving for Real-World Code Verification cs.CL | cs.AI | cs.LO | cs.SEPDF

[12] Two Birds with One Stone: Skill-Augmented Generation via Unified Retrieval and Utilization cs.CLPDF

[13] 3DCodeEdit: Benchmarking Instruction-Guided 3D Program Editing cs.CL | cs.CV | cs.GRPDF

[14] Robust LLM-Generated Text Detection through Matched Conditional-Response Probing cs.CLPDF

[15] Fu-TCM: a multimodal large language model that learns traditional Chinese medicine diagnostic reasoning cs.CLPDF

[16] Statutory Article Retrieval from Arabic Judicial Narratives: Family Law and Law of Evidence in Saudi Arabia cs.CL | cs.AIPDF

[17] TCC-RAG: Temporal Causal Chain-Guided RAG for Temporal Knowledge Graph Question Answering cs.CLPDF

[18] Does Chain-of-Thought Reliance Follow a Scaling Law?Larger Models Follow Their Steps More, Independent of Post-Training cs.CL | cs.LGPDF

[19] Benchmarking decision models against generative large language models on medical multiple-choice questions cs.CL | cs.AIPDF

[20] CoSTA: Co-Evolving Self-Play Timeline Agents for Complex Temporal Knowledge Graph Question Answering cs.CLPDF

[21] Implicit Minor Detection from Multi-Turn Dialogue in High-Risk AI Interactions: A Constrained Self-Evolving LLM Harness cs.CLPDF

[22] Do Audio LLMs HEAR Pain? Tracing Acoustic Evidence from Speech to Language Reasoning cs.CL | cs.AI | cs.SDPDF

[23] CopyLoop: Fast Looped Transformer Decoding via Context Copying and Shallow Screening cs.CL | cs.AIPDF

[24] HEDGE: Gated Hypergraph Memory for Scalable Multi-Agent Debate cs.CLPDF

[25] How Architecture, Typology, and Adaptation Strategies Shape ASR for Low-Resource African Languages: A Controlled Empirical Study cs.CL | cs.SD | eess.ASPDF

[26] Implicit Reasoning in Transformers: Bridging the Compositionality Gap in GPT-2-like Models cs.CL | cs.AIPDF

[27] Distilling the Shape of Uncertainty: What On-Policy Distillation Learns and How to Predict It cs.CL | cs.AIPDF

[28] HALO: Human-Grounded Granular Evaluation of Proactive Agents cs.CLPDF

[29] Grounding Multimodal Reasoning with Evidence-Ablated Negatives cs.CLPDF

[30] Cord: Confidence-Anchored Order Residual Decoding for Masked Diffusion Language Models cs.CL | cs.AIPDF

[31] How Specific Do I Need to Be? Effects of User Query Underspecification on Deep Research Agents cs.CLPDF

[32] ARBITRA: Robust Document-Level ATT&CK Extraction via Multi-Expert Argumentation cs.CL | cs.CRPDF

[33] Raincheck: Deferred Multimodal Prefill for Efficient Multi-Turn MLLM Inference cs.CL | cs.AIPDF

[34] Incentivizing Self-Learning in Large Language Models via Reinforcement Learning cs.CLPDF

[35] AI Cosmos: An Agentic Infra for Situated Learning cs.CLPDF

[36] Upcycling Language Models for Multiple Specialized Domains cs.CL | cs.AIPDF

[37] Mobilizing the Archive: Bitext Extraction at Scale from Archival Documents for Extremely Low-resource Languages cs.CLPDF

[38] ScienceJudge: Pattern Perturbation Augmentation for Sentence-Level Scientific Claim Verification cs.CLPDF

[39] Latent Path Exploration via Potential-Guided Subtrajectory Balance cs.CL | cs.LGPDF

[40] Don’t Lose the Thread: Empowering Long-Horizon LLM Agents with Cognitive Resource Self-Allocation cs.CLPDF

[41] Scaling Mathematical Proof Supervision from Structured Textbooks cs.CL | cs.AIPDF

[42] Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation cs.CLPDF

[43] PIVOT: Progressive Intervention via Online Teacher Correction cs.CLPDF

[44] ShallowDefend: Harnessing Shallow Safety Alignment for Multi-Turn Defender cs.CLPDF

cs.CV [Back]

[45] Venus-DefakerOne2: A Vision-Forensics Foundation Model with Broader Coverage cs.CVPDF

[46] You Don’t Need Aligned Representations: Knowledge Distillation via Random Prototype Spaces cs.CV | cs.LGPDF

[47] Hierarchical Diffusion for Camera-controlled Autoregressive Video Generation cs.CVPDF

[48] Where Can We Fool the Model’s Mind? Response-Guided Semantic Probing and Adaptive Routing for Transferable Attacks on Black-Box MLLMs cs.CVPDF

[49] Can Event Detectors Leave the Broadcast Camera? Evidence from Tennis cs.CV | cs.AIPDF

[50] Vision Tomography: Towards Portable 3D Bidirectional Face-Skull Inference from Visual Data cs.CVPDF

[51] From Next Day Wildfire to Next Days Wildfire: A New Multi-Continent Dataset of Active-Fire Spread for Sequence-to-Sequence Forecasting cs.CVPDF

[52] The Prestige: Benchmarking Cognitive Visual Reasoning using Magic Tricks cs.CV | cs.AIPDF

[53] REEL: Same Frames, Different Answers and Different Costs cs.CVPDF

[54] Complementing Text Based Moderation with Multimodal Grounding: Detecting Fraudulent Inducement Behaviors on Short Video Platforms cs.CVPDF

[55] Silhouette-Based Gaitomics for Frailty Assessment in Older Adults cs.CVPDF

[56] MEV: A Multi-Event Video Dataset for Long-Take Generation cs.CV | cs.AIPDF

[57] TreemapMix: Dirichlet-Controlled Multi-Image Augmentation for Probability and Ordinal Supervision cs.CVPDF

[58] ConvRoute-ViT: Convolutional Token Routing for Efficient Vision Transformers cs.CVPDF

[59] PulmoWorld: An Asynchronous Multimodal Medical World Model for Longitudinal Pneumonia Dynamics cs.CVPDF

[60] Don’t Ask the LLM: Visual Token Pruning with Spectral Structure and Semantic Relevance cs.CVPDF

[61] Does 3D Pose Improve Action Valuation in Football? An Empirical Study of Pose Representations and Learning Objectives cs.CV | cs.LGPDF

[62] Extremely Sparse-View Computed Tomography from 2D Projections via Pose-Aware Diffusion Priors cs.CV | cs.AIPDF

[63] Knowledge-structured and evidence-aware semantic self-distillation for glomerular pathology foundation model cs.CVPDF

[64] Aligning Misaligned Benchmarks for Single-View Novel View Synthesis cs.CV | cs.AIPDF

[65] WeVisCut: The Whole Editing Room in One Agent From Narration to Long-Form Video cs.CV | cs.AIPDF

[66] Volley3D: Unified 3D Full-Sequence Reconstruction from Monocular Broadcasts cs.CVPDF

[67] Visually Irrelevant Hallucinations in Medical Vision-Language Models cs.CVPDF

[68] Structure-retained low-rank adapters for weather synthesis cs.CVPDF

[69] IntReal: A Real-World Dataset and Benchmark for Multimodal Interleaved Generation cs.CVPDF

[70] Automatic Iconographic Annotation of Medieval Illuminations: Comparing Generative Vision-Language Models and Supervised Discriminative Classifiers cs.CVPDF

[71] Geometry-Aware Trajectory State Modeling for Few-Shot Action Recognition cs.CVPDF

[72] Vision-Based Density Estimation for Adaptive Traffic Control cs.CVPDF

[73] Residual Motion Splatting for Continuous Space-Time Video Super-Resolution cs.CVPDF

[74] Similar Scores, Opposite Failures: Human Correction as an Instrument for Video Caption Evaluation cs.CV | cs.CLPDF

[75] Detecting Fine-Grained Differences between Image Datasets cs.CVPDF

[76] RoSAMDepth: Robust Self-supervised Depth Estimation Leveraging Segment Anything Model cs.CVPDF

[77] Data Scaling Laws in Stereo Matching: From In-domain Fitting to Cross-domain Generalization cs.CVPDF