cs.CV [Total: 135]
cs.CL [Total: 50]
cs.AI [Total: 15]
cs.CR [Total: 1]
cs.DC [Total: 1]
cs.HC [Total: 2]
cs.LG [Total: 17]
cs.LO [Total: 1]
cs.RO [Total: 9]
cs.SD [Total: 1]
eess.IV [Total: 1]
physics.soc-ph [Total: 1]

cs.CV [Back]

Maham Tanveer, Jiyeon Han, Nanxuan Zhao, Hao Zhang

TL;DR: Modal kinetic typography以字形自身的有限元振动模式驱动循环动画，让文字表达语义概念时保持轮廓平滑和可读性。

Details

Motivation: 动态字体要让字形运动传达概念，同时保持字符可辨。自由优化每个轮廓点易受视频分数蒸馏的噪声梯度影响而撕裂或抖动；骨架动画则依赖类别特定先验。

Result: 方法从矢量轮廓建立有限元特征值问题，提取整个字形及其各部分的低频柔性模式，使字形可弯曲；零能量刚体平移和旋转则闭式作用于各个部分，让部件整体移动。冻结视频扩散模型只监督模态的幅度和相位，利用少量完整周期谐波生成平滑、无缝循环运动。字形形状和运动在构造上解耦：基础轮廓可塑形成概念，模态驱动不会改动轮廓，也可在固定形状下仅靠运动表达概念。与Dynamic Typography、AniClipart相比，结果运动更丰富平滑、概念对齐相当或更好且字形撕裂更少；人类评审也更偏好该方法，包括固定形状条件下，并优于Astra（GPT-6）。

Insight: 以字形自身的振动模式作为运动基底，能把视频模型的噪声优化限制在平滑、结构化的运动空间中。显式解耦形状与运动也让概念可以由动画单独表达而不破坏文字轮廓。

Abstract: We introduce modal kinetic typography, which animates a vector glyph to express a semantic concept while keeping it legible. Our key idea is to build motion from the glyph’s natural vibration modes. Specifically, a finite-element eigenproblem assembled from the vector outline yields the glyph’s softest modes, for the whole letter and for each of its parts, allowing it to bend. The problem’s zero-energy solutions, i.e., rigid translations and rotations, are applied in closed form to each part, allowing parts to also move as blocks. To animate the glyph, a frozen video diffusion model supervises only the modes’ amplitudes and phases. Our modal approach addresses two weaknesses of prior work. Free-form point optimization under video score distillation (SDS) moves each point and frame independently along noisy gradients, tearing the outline and causing jitter. In contrast, our modes are smooth along the outline and driven by a few whole-cycle harmonics, which restricts these gradients to smooth, seamlessly looping motion. On the other hand, structured alternatives rely on skeletons or keypoints from category-specific priors, whereas our modes come from the glyph itself; the only prior is a list naming each letter’s moving parts, generated once for the whole alphabet by a language model. In modal kinetic typography, shape and motion are disentangled by construction: a single base outline is sculpted toward the concept, and the modal drive cannot alter it, so a letter can also be animated without being reshaped. Our method produces more articulated and smoother motion than Dynamic Typography and AniClipart at comparable or better concept alignment, with less glyph tearing than Dynamic Typography, and is preferred by human raters, including in a frozen-shape setting where motion alone must carry the concept. Our results were also preferred over Astra (GPT-6) by human raters.

[2] GaugeVLM: Structuring Spatial Supervision with Measured Geometric Interventions cs.CV | cs.AIPDF

Hongbo Wang, Zihan Lin, Wenkui Yang, Shiran Ge, Yuang Ai

TL;DR: GaugeVLM用可控三维对象与相机干预生成带几何测量的跨视角监督，并以偏好边界和答案赔率约束训练VLM空间推理。

Details

Motivation: 视觉语言模型面对同一空间关系的不同视角时可能自相矛盾，也可能在关系变化后不作相应反应。单个答案或序数偏好监督未显式表示误差大小及跨观察几何依赖。

Result: GaugeVLM在显式3D场景中控制物体和相机干预，生成相互关联的观察，并测量空间关系变化及跨视角共享真值。GaugeDPO把测量误差转成偏好边界，直接监督跨视角正确的规范排序，并按视角尺度将干预导致的答案赔率变化与实测关系变化关联。理论分析界定规范预测误差，并证明跨视角与干预约束可同时满足。三个VLM骨干的实验中，10项已有空间指标全部优于监督微调；主7B模型在MSMU距离和QSpatial+分别提高15.0、18.9个百分点，且收益扩展到自动驾驶与具身推理。

Insight: 空间推理监督应量化视角变化与几何关系变化之间的联系，而非只告诉模型某次答案对错。以共享真值和可控干预联合训练，可改善跨视角一致性并迁移到相关具身场景。

Abstract: Vision-language models (VLMs) can contradict themselves across views of the same spatial relation and fail to respond when that relation changes. Addressing these failures requires supervision that captures error magnitude and geometric dependencies across observations, both of which remain implicit in training on individual answers or ordinal preferences. Therefore, we introduce GaugeVLM, which makes this structure explicit through controlled object and camera interventions in explicit 3D scenes, producing linked observations with measured differences between spatial relations and shared truths across views. To translate this structure into learning signals, its core objective, GaugeDPO, converts measured errors into preference margins, directly supervises correct canonical rankings across views, and links intervention-induced answer-odds contrasts to measured relation changes with view-specific scales. Our analysis bounds canonical prediction error and establishes that the cross-view and intervention constraints can be jointly satisfied. Empirically, GaugeVLM improves all 10 established spatial metrics over supervised fine-tuning across three VLM backbones, with the main 7B model gaining 15.0 and 18.9 percentage points on MSMU distance and QSpatial+, respectively. These gains also extend to autonomous driving and embodied reasoning, demonstrating the robust generalization across domains.

[3] It Takes Little to Rewrite Perception: Targeted Semantic Substitution in Vision-Language Models at $ε\leq 4/255$ cs.CV | cs.LGPDF

Binchi Zhang, Atrisha Sarkar, Apurva Narayan

TL;DR: 白盒语义替换攻击表明，极小幅度图像或视频扰动仍可让视觉语言模型把源内容完整改判为攻击者指定的目标语义。

Details

Motivation: 视觉语言模型逐渐用于安全关键场景，评估其能否被对抗扰动操纵是可信部署的前提。以往表示对齐攻击在ε≤4/255范围成功有限，容易让人误以为模型足够鲁棒。

Result: 作者在受害模型合并后的token空间中，将源图像各流与目标图像对应流对齐，在白盒威胁模型下实施定向语义替换。严格成功条件要求模型同时说出目标、确认其存在并否认源内容。图像攻击在ε=2/255时已出现目标语义，ε=4/255时完整替换率达38%；视频在ε=1/255时完整替换率为35.9%。作者还观察到语义融合现象：语言模型会把互相矛盾的视觉信号合理化为连贯叙述。

Insight: 传统表示对齐攻击的低成功率不等于语义层安全，严格考察模型是否完成目标语义替换可揭示低扰动风险。攻击结果还显示语言推理可能掩盖矛盾视觉证据，而非主动暴露冲突。

Abstract: Vision Language Models (VLMs) are widely deployed in safety-critical scenarios, and understanding to which extent they can be controlled by adversarial perturbation is a prerequisite for evaluating their trustworthiness. Existing representation-alignment attacks, which make a VLM perceive a target image, achieve limited success at $\varepsilon \leq 4/255$. Therefore, VLMs seems robust to perturbations in this range. We show that this robustness does not hold, as targeted semantic substitution succeeds within the same range. Specifically, we align each stream of the source image with its counterpart in the target image in the victim VLM’s post-merger token space, operating under a white-box threat model. We evaluate under a strict success criterion, requiring the model to simultaneously name the target, confirm its presence, and deny the source. In images, target semantics appear at $\varepsilon = 2/255$ and complete replacement reaches 38% at $\varepsilon = 4/255$. On video, complete replacement reaches 35.9% at $\varepsilon = 1/255$. We also observe a phenomenon of \textit{semantic fusion}, where Large Language Model (LLM) rationalizes contradictory visual signals into a coherent narrative.

[4] TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos cs.CVPDF

Patt Phurtivilai, Zhiyang Dou, Yifan Wu, Kinfung Chu, Yuan Liu

TL;DR: TrackFish3D用标定多视角几何自动生成跨相机关联监督，实现无需身份人工标注的鱼群密集3D跟踪。

Details

Motivation: 量化鱼群集体行为需要准确轨迹，但多视角3D跟踪受频繁遮挡、个体外观相似和身份标注稀缺限制。

Result: TrackFish3D以三角测量和重投影一致性生成伪关联，再由几何编码器与全局关联Transformer学习帧内全对全跨视角对应；自监督对比目标区分同帧共见个体，时间预测器保持身份并跨越短遮挡。模型只需在未标注视频上训练一次，测试可直接用于未见视频，不需要跨视角身份标注、时间标注、3D真值、外观特征或测试时优化。在自建基准上，3D多目标跟踪准确度从最强基线87.7%提高到95.8%；在3D-ZeF斑马鱼基准上达到81.1% MOTA，高于最佳几何基线77.4%，并能推广到真实鸟类跟踪。

Insight: 对可标定相机，多视角几何本身可提供跨视图关联线索，减少对外观重识别和人工身份标签的依赖。帧内几何配对与跨帧身份保持需分别由空间关联和时间预测机制处理。

Abstract: Quantifying collective fish behavior requires accurate trajectories, yet multi-view 3D tracking remains challenging due to frequent occlusions, visually similar individuals, and the long-standing scarcity of identity annotations. We present TrackFish3D, a geometry-driven self-supervised framework for dense multi-camera 3D tracking of schooling fish. Instead of relying on appearance-based re-identification or manually annotated identities, TrackFish3D turns calibrated multi-view geometry into supervision: triangulation and reprojection consistency provide pseudo-associations, while a geometric encoder and global association transformer learn all-to-all cross-view correspondence within each frame. To make these associations identity-aware, TrackFish3D introduces a self-supervised contrastive objective that separates co-visible individuals in the embedding space, together with a temporal predictor that preserves identities and bridges short occlusions across frames. The resulting model is trained once on unlabeled footage and applied directly to unseen test videos, requiring no cross-view identity labels, temporal annotations, 3D ground truth, appearance features, or test-time optimization. On our benchmark, TrackFish3D improves 3D Multi-Object Tracking Accuracy from 87.7% for the strongest baseline to 95.8%. On the 3D-ZeF zebrafish benchmark, it achieves 81.1% MOTA, compared with 77.4% for the best geometric baseline. TrackFish3D also generalizes beyond fish, achieving strong results on real-world bird tracking.

[5] Composition, Not Conversation: VLMs Lose the Scene, Not the Thread cs.CVPDF

L. D. M. S. Sai Teja, Ufaq Khan, N. Siva Gopala Krishna, Satyajit Tourani, Ashshak Sharifdeen

TL;DR: Layered-VQA把图像分解成可无损重组的有序透明层，并标注支持、最小充分和干扰层，发现VLM的主要困难是理解证据组合而非维持对话线索。

Details

Motivation: VLM日益需要对裁剪、分割、检索或逐步呈现的视觉证据推理，但大多数VQA基准一次性给完整图像和问题。作者研究同一信息被分层呈现时模型失去了什么。

Result: Layered-VQA包含93个场景、300个问题；每幅图被拆成按序RGBA层，可精确合成原始场景，问题标注支持层、最小充分层和干扰层。评估11个3B至32B开源模型及两个专有模型，共187,200次对话，并由开放模型进行174万次交叉判分。发现三类失败：拆分问题影响小但拆分场景显著降准确率，重组同样图层大体可恢复；即使Oracle选择的充分证据，表现也可能差于完整场景；随着所需证据增加，视觉定位退化速度快于答案准确率。

Insight: 拥有正确证据不代表模型能有效使用证据，证据如何组合和呈现也决定视觉定位。完整场景提供的整体关系可能比由局部最小证据拼接更有利于模型理解。

Abstract: Vision-language models (VLMs) increasingly reason over visual evidence that is cropped, segmented, retrieved, or revealed over time. Yet most VQA benchmarks present the complete image and question at once. We ask what models lose when the same information is fragmented. We introduce Layered-VQA, with 93 scenes and 300 questions. Each image is decomposed into ordered RGBA layers that exactly recompose the original scene, and each question is annotated with supporting, minimal-sufficient, and distractor layers. We evaluate eleven open-weight VLMs from 3B to 32B parameters and two proprietary models with a scale of 187,200 conversations, graded by 1.74M open-model cross-judgments. We find three consistent failures. Loss in Composition: fragmenting the question has a small effect, but fragmenting the scene substantially reduces accuracy; recomposing the same layers largely restores performance. Oracle Inversion: even oracle-selected sufficient evidence can perform worse than the complete scene. Loss in Grounding: as more evidence is required, grounding degrades much faster than answer accuracy. Together, these results show that having the right visual evidence is not enough. How that evidence is composed and presented determines whether models can use and ground it. The right evidence is not enough: VLMs need the scene it came from.

[6] Inductive Visual Logic for Few-Shot Out-Of-Distribution Adaptation in VLMs cs.CVPDF

Hung-Jen Chen, Yu-Heng Ho, Ting-Yao Huang, Po-Hsiang Hsu, Li-Yu Chen

TL;DR: IVL利用VLM残存的图像描述能力从少量支持样本构建类别特征词典，再按空间落地证据层级筛选，实现远分布外分类且无需训练。

Details

Motivation: VLM在与预训练数据相近的任务上零样本表现较好，但面对从未学过判别特征的专业远分布领域会失效。常规微调无法恢复编码器中缺失的表示；不过模型仍可能能描述医学图像的视觉特征，即使不能直接分类。

Result: Inductive Visual Logic（IVL）通过双模式提示从少样本支持图像提取语义描述和原始视觉观察，建立各类别特征词典；推理时采用层级过滤寻找具有空间依据的特征证据并完成分类。在多个远OOD基准和两个VLM骨干上，IVL取得最高汇总准确率，同时输出可追踪到具体特征的解释。摘要未报告具体分数。

Insight: 远域分类时，VLM的判别能力可能失效但描述能力仍在，可以把后者转成少样本类别特征库，再通过逐层空间证据过滤完成归纳分类。该方法绕开表示微调，仍保留解释线索。

Abstract: Generative vision-language models (VLMs) such as Qwen-VL and LLaVA achieve strong zero-shot performance on tasks overlapping with their pretraining distribution, yet fail on specialized domains where the required discriminative features were never learned, a regime we term distant out-of-distribution (OOD). Standard adaptation methods cannot overcome this representational absence because they operate within the encoder’s existing feature space. However, VLMs retain a robust descriptive capacity even when discrimination collapses: a model that cannot classify a medical scan can still articulate its visual patterns. Exploiting this asymmetry, we introduce Inductive Visual Logic (IVL), a training-free framework that constructs classification knowledge from the model’s surviving descriptive ability. IVL extracts visual traits from few-shot support images through dual-mode prompting, combining semantic descriptions with primitive visual observations, and organizes them into per-class trait dictionaries. At inference, hierarchical filtering identifies spatially grounded trait evidence for classification. Across multiple distant-OOD benchmarks, IVL achieves the highest aggregate accuracy under two VLM backbones while producing interpretable, trait-traceable predictions.

[7] PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos cs.CVPDF

Max Ku, Jiaojiao Fan, Zekun Hao, Francesco Ferroni, Heng Wang

TL;DR: PhyProbe用冻结时空编码器和轻量评分头评估生成视频的物理一致性，并结合排序、带噪分数回归和锚点校准统一异质监督。

Details

Motivation: 现有评估要么依赖可能忽视物理动态的通用视觉语言模型，要么用人类标注微调评估器，后者容易过拟合特定数据集线索。监督来源通常只能在不同设置中稳定提供相对排序或绝对分数之一。

Result: PhyProbe从冻结预训练时空编码器提取特征，通过轻量评分头输出物理一致性违反分数；训练目标联合使用成对排序、带噪绝对分数回归和基于异质监督锚点的校准。在真实—生成及生成—生成配对评测中，PhyProbe在多数基准超过既有方法；在无对应关系及生成—生成场景中收益最大，因微调评估器退化较明显。模型与人类判断相关性强，排序指标与线性指标接近，说明分数既排序合理又锚定在稳定的[0,1]尺度。尽管未用显式通用偏好标签，模型在人工偏好基准上也有竞争力，可能因为物理违规与整体质量退化相关。

Insight: 评估生成视频的物理性需要同时利用相对比较和绝对校准，而不能只依赖某一种监督。冻结的时空特征配轻量评分头有助于降低对特定标注集线索的过拟合。

Abstract: Evaluating the physical consistency of generated videos remains a fundamental challenge. Existing approaches rely on off-the-shelf vision-language models, which can often be myopic to physical dynamics, or fine-tuned evaluators trained on human annotations, which overfit to dataset-specific cues and fail to generalize. A key challenge is that existing supervision sources provide either relative ordering or absolute scores, but not both reliably and consistently across varied settings. To this end, we introduce PhyProbe, an evaluator that extracts features from a frozen pretrained spatio-temporal encoder and maps them to a scalar physical consistency violation score via a lightweight scoring head. PhyProbe is trained through a unified objective combining pairwise ranking, regression on noisy scalar annotations, and anchor-based calibration over a curated set of heterogeneous supervision sources. Experiments show that PhyProbe outperforms prior methods on most pairwise benchmarks spanning real-generated and generated-generated pairs under varying correspondence, with the largest gains in no-correspondence and generated-generated settings where existing fine-tuned evaluators degrade sharply. PhyProbe achieves strong correlation with human judgments, with close agreement between rank-based and linear metrics, indicating that scores are both well ordered and anchored to a stable [0, 1] scale. Further, despite being trained on supervision indicative of physical consistency, without explicit general-preference labels, PhyProbe also performs competitively on human preference benchmarks: consistent with the observation that physics violations are entangled with broader quality degradations.

[8] Team MSU GenText-Forensics Challenge 2026 Technical Report cs.CVPDF

Kirill Koltsov, Aleksandr Gushchin, Dmitriy Vatolin, Anastasia Antsiferova

TL;DR: 技术报告介绍GenText-Forensics挑战赛第三名方案，将文档篡改检测、区域过滤和语义异常分析串联，生成带定位与证据的多语言文本图像取证报告。

Details

Motivation: 文档文本伪造已不止像素修改，也会改变语义，并针对消费文档的OCR和LLM流水线。挑战要求系统判断多语言文本图像是否伪造、定位篡改、识别攻击类型并给出可读证据报告。

Result: 方案将文档篡改检测器（DTD）与两个分别LoRA适配的Qwen3-VL-32B视觉语言模型组合。DTD先生成篡改概率图并转换为编号候选区域；Filterer模型验证区域并初步分类伪造类型；Semantic Detective合并并重新定位保留区域，查找像素检测器不可见的纯语义异常，最后撰写取证报告。两个模型通过蒸馏具有特权信息的Qwen3-VL-235B教师思维链训练，教师可访问真值掩码和报告。该方案在ACM MM 2026 GenText-Forensics挑战中获第三名，报告还分析阈值、提示设计、测试时增强、区域渲染及流水线分解消融。

Insight: 文档伪造检测需把像素级定位与语义级异常分析分开后再组合，避免纯像素检测漏掉含义被篡改的内容。多阶段模型各自校验和重定位候选区域，可形成可审阅的证据链。

Abstract: Document text forgery has evolved beyond simple pixel-level manipulation: modern attacks alter not only the appearance of a document but also its meaning, and increasingly target the OCR & LLM pipelines that consume such documents. The ACM MM 2026 GenText-Forensics challenge therefore requires systems that not only decide whether a multilingual text image is forged, but also localize the point of manipulation, identify the attack type, and produce a human-readable forensic report with supporting evidence. We present our solution, a decomposed chain-of-thought (CoT) pipeline that combines a document tampering detector (DTD) with two Qwen3-VL-32B vision-language models, each LoRA-adapted to a distinct sub-task. DTD produces tampering probability maps that are converted into numbered candidate regions; a first model (the Filterer) validates these regions and assigns a preliminary forgery type, while a second model (the Semantic Detective) merges and re-grounds the surviving regions, searches for purely semantic anomalies that are invisible to pixel-level detectors, and writes the final report. Both models are trained by distilling chain-of-thought traces from a privileged Qwen3-VL-235B teacher that has access to ground-truth masks and reports. Our approach secured third place in the ACM MM 2026 GenText-Forensics challenge. We describe the data preparation, test-time augmentation, region rendering, distillation protocol, and training configuration in detail, and report ablations over detector thresholds, prompt designs, and pipeline decompositions.

[9] VidHarness: Evolving Agent Harnesses for Cost-Efficient Long Video Understanding cs.CVPDF

Susan Liang, Jianmin Wu, Daxiang Dong

TL;DR: VidHarness通过蒙特卡洛树搜索自动演化长视频理解harness，并用不确定性感知多保真验证控制设计成本。

Details

Motivation: VLM虽能回答数小时视频问题，但证据通常只在少数几秒中，逐帧处理成本过高。视频智能体可选择性观察，但现有harness主要由专家手工设计，构建和测试缓慢。

Result: VidHarness让harness提议器根据执行反馈迭代修改方案，以蒙特卡洛树搜索跳出贪心局部最优；再用不确定性感知多保真验证，先在少量问题上筛选新方案，只提升有潜力的候选。由于最佳harness会随帧预算变化，系统还用混合harness按问题分配给预算专长不同的方案。在LongVideoBench、Video-MME和Video-Holmes上达到新最佳结果，比最强手工视频智能体最高高11.2分；在Video-MMMU和MMVU知识密集基准上也能泛化，使用帧数不到均匀采样的一半。

Insight: 视频证据获取策略本身可以自动优化，但评估成本需要分层控制。按帧预算路由专用harness，可避免强行用单一观察策略处理不同成本条件的问题。

Abstract: Vision-language models (VLMs) can answer questions about hour-long videos, but processing every frame is prohibitively expensive, even though the evidence for a question usually spans only a few seconds. Video agents, i.e., harness programs wrapped around a frozen VLM, address this by observing the video selectively, yet existing harnesses are hand-crafted by experts through slow build-and-test cycles. We propose VidHarness, a framework that automates harness design for cost-efficient long video understanding, in which a harness proposer iteratively evolves harnesses based on execution feedback from an evolution environment. To escape the local optima of greedy refinement, we organize the evolution as Monte Carlo tree search (MCTS), and to reduce the evaluation cost, we integrate uncertainty-aware multi-fidelity validation, which screens new harnesses on a few questions and promotes only the promising ones. Since the best harness varies with the frame budget, we further introduce a mixture-of-harness that routes each question to a harness specialized for its budget. VidHarness sets new state-of-the-art results on LongVideoBench, Video-MME, and Video-Holmes, outperforms the strongest hand-crafted video agent by up to $11.2$ points, and generalizes to the knowledge-intensive benchmarks Video-MMMU and MMVU with fewer than half of the frames of uniform sampling.

[10] LoopVL: Recurrent Visual Intelligence cs.CV | cs.CLPDF

Zhe Qian, Ziyang Gong, Zhongxing Xu, Hehan Li, Zhonghua Wang

TL;DR: LoopVL将模块循环和模型循环结合，在共享参数下反复更新统一视觉—语言状态，探索循环Transformer向多模态推理的扩展。

Details

Motivation: 循环Transformer通过重复计算增加有效深度，但其能否有效扩展到需要整合视觉与文本的多模态模型尚不明确。

Result: LoopVL用Module-Loop和Model-Loop计算迭代更新共享视觉—语言状态，并从头经历语言预训练、多模态训练和后训练。相较一系列相近规模及更大的非循环模型，LoopVL在多模态理解与视觉推理基准上表现更好。作者还观察到视觉“Aha时刻”：模型在不同循环阶段的视觉注意力出现明显变化，为循环推理过程提供机制性观察。摘要未列具体分数。

Insight: 循环计算可用于对不断演化的视觉—语言联合状态进行更深处理，而不只增加静态模型规模。跨循环的注意力转变提示多模态迭代过程可能逐步重组视觉证据。

Abstract: We introduce LoopVL to study whether Loop Transformers can be effectively extended to vision- language models. LoopVL combines Module-Loop and Model-Loop computation to iteratively update a unified vision-language state through shared modules. We train LoopVL from scratch through language pre-training, multimodal training, and post-training. LoopVL outperforms a range of similarly sized and larger non-recurrent models on multimodal understanding and visual reasoning benchmarks. We also observe Visual Aha Moments in LoopVL, characterized by pronounced shifts in visual attention across loops. LoopVL provides practical evidence for recurrent vision-language modeling and offers an intuitive perspective on how shared parameters can support deeper multimodal computation over continuously evolving visual-language states.

[11] MOBA-VL: Event-Localized Multi-Turn Reinforcement Learning for Real-Time MOBA Commentary cs.CVPDF

Shengyun Zhong, Xinkang Zhao, Ziyuan Chu, Linchao Zhu

TL;DR: MOBA-VL利用游戏遥测记录的事件时间，为实时电竞解说进行事件定位的多轮强化学习，使模型更及时、准确地播报击杀和目标事件。

Details

Motivation: MOBA电竞实时解说要求VLM逐秒流畅且准确地叙述比赛，但现有流式VLM虽听起来自然，常漏掉击杀和地图目标等关键事件。

Result: 作者以精确记录事件发生时刻的游戏遥测作为监督，训练9B模型MOBA-VL，并用事件定位的多轮强化学习奖励描述各事件的对应轮次。新数据集MOBACast包含三款MOBA游戏的860场职业比赛、约460小时逐词时间戳解说；MOBACast-Bench来自留出赛事。在完整比赛评测中，MOBA-VL Overall为63.25，对比StreamingVLM的55.12；片段评测为63.45，对比DeepSeek-V4.1-Flash的56.22。事件定位信用分配将事件召回率从监督微调的34.5提升至42.1。

Insight: 逐词时间戳和结构化赛事遥测可把长解说拆解为与具体事件对齐的学习目标。奖励事件对应的输出轮次，比只对整段叙述打分更能减少关键事件漏报。

Abstract: Real-time commentary for Multiplayer Online Battle Arena (MOBA) esports requires a vision-language model (VLM) to narrate a live match second by second, both fluently and accurately. Existing streaming VLMs sound natural but often miss key events such as kills and objectives. To address this limitation, we use game telemetry, which records exactly when each event occurs, as a supervision signal. We introduce MOBA-VL, a 9B-parameter model trained on this signal with event-localized multi-turn reinforcement learning, which rewards the turns that describe each event. We also collect MOBACast, 860 professional matches (about 460 hours) across three MOBA games with word-level timestamped commentary, and MOBACast-Bench, a benchmark from held-out tournaments. On MOBACast-Bench, MOBA-VL achieves the highest Overall score on full matches (63.25 vs. 55.12 for StreamingVLM) and clips (63.45 vs. 56.22 for DeepSeek-V4.1-Flash). Event-localized credit also raises event recall from 34.5 to 42.1 over supervised fine-tuning. Code and data will be released, and demos are available on an anonymous project page at https://moba-vl.github.io.

[12] Audible World Models: Spatially Aware Sound Generation for 3D Worlds cs.CV | cs.SDPDF

Duowen Chen, Jinjin He, Gouthaman KV, Sandeep Bangalore Venkatesh, Bo Zhu

TL;DR: Audible World Models为文本生成的3D场景识别声源并锚定到几何位置，再依据听者移动和几何声学传播渲染持续空间音频。

Details

Motivation: 文本或图像条件的世界生成器可创建丰富3D环境，但常无声音，或仅根据文本和渲染视频生成背景音。此类音频没有显式声源位置，无法随听者移动调整感知声音。

Result: 该免训练框架从文本提示构建全景3D代理，分解语义层，识别前景发声物体和环境背景区域，并为各类声源合成干声。随后将声源锚定到重建几何，以几何声学传播渲染依赖听者位置的空间音频，使声源位置持续稳定且声音随视角和运动变化。在80个生成场景上，与文本、视频和全景条件基线相比，空间一致性显著提高，同时保持有竞争力的语义对齐；VLM评估及人工评审也更偏好其视听一致性、空间合理性和运动依赖表现。

Insight: 空间音频需要语义、声源几何位置及传播过程的显式关联，不能只从画面预测一段静态配乐。将干声绑定到3D场景后，听者移动即可触发一致的空间听觉变化。

Abstract: Text- and image-conditioned world generators can create visually rich 3D environments, yet these worlds often remain silent or rely on soundtracks synthesized solely from text or rendered video. Although such audio can convey what should be heard, it lacks an explicit representation of where sound sources are located and how their perceived sound should vary with listener movement. We introduce Audible World Models, a training-free framework that incorporates sound into the generated world state. Starting from a text prompt, our system constructs a panoramic 3D proxy, separates it into semantic layers, identifies sound-producing foreground objects and ambient background regions, and synthesizes dry audio for each sound label. It then anchors these sources to reconstructed geometry and renders listener-dependent spatial audio using geometric acoustic propagation. By explicitly linking semantics, geometry, and sound propagation, the framework maintains persistent source locations while adapting the rendered audio to changes in listener viewpoint and motion. Experiments across 80 generated scenes demonstrate substantial gains in spatial consistency over text-, video-, and panorama-conditioned baselines, while preserving competitive semantic alignment. VLM-based assessments and human evaluations further indicate that our soundtracks are preferred for their audio-visual consistency, spatial plausibility, and motion-dependent behavior.

[13] Curating Synthetic Data for Task-Specific Visual Perception cs.CVPDF

Saptarshi Neil Sinha, Paul Julius Kühn, Michael Weinmann

TL;DR: 论文主张面向任务策划合成视觉数据，核心问题应是生成哪些数据，并比较程序渲染、物理仿真和生成式外观建模三种互补路线。

Details

Motivation: 当通用数据无法提供专门任务所需领域先验，且人工标注昂贵、不精确或不可行时，合成数据很有价值。单纯增加合成数量不够，数据内容、外观变化、传感特性与标注都应围绕目标任务设计。

Result: 文章讨论三类策划范式：程序化渲染可显式控制场景参数并由构造过程获得标注；物理仿真编码观测效应机制，产生精确对齐的监督对；生成式AI可从少量真实样本学习传感器外观并取得逼真效果，但可能幻觉且标注不准。作者用工业表面缺陷检测、退化Autochrome底片修复、RGB与事件数据的6DoF姿态估计举例，分析不同数据条件下如何结合真实与合成训练。结论是策划合成数据应补充真实观察，兼顾可控监督和学习式外观的混合流水线最有希望支持可靠sim-to-real迁移。

Insight: 合成数据策划要按任务决定需要控制的机制和外观，而非追求生成更多样本。程序或物理方法提供可信标注，生成式方法补充逼真外观，两者混用可互补但需管理幻觉风险。

Abstract: Synthetic data are most valuable where general-purpose datasets cannot provide the domain-specific priors a task requires, and where manual annotation is expensive, imprecise, or infeasible. In this article we argue that the central question for specialized vision systems is not how to generate more data, but which data to generate. We therefore discuss curated synthetic data, whose scene content, appearance variations, sensing characteristics, and annotations are deliberately designed around a given task. We examine three complementary curation paradigms. Procedural rendering offers explicit control over scene parameters and the annotations follow by construction. Physically-based simulation encodes the mechanism behind an observed effect and yields exactly aligned supervision pairs. Generative AI learns sensor-specific appearance from small real seed sets and attains plausible realism, though it remains prone to hallucination and to inaccurate annotation. These paradigms are illustrated with examples from industrial surface defect detection, restoration of degraded digitized autochrome plates, and 6DoF pose estimation from RGB and event data. Using these examples, we analyze different data regimes and training strategies that combine synthetic and real data across these paradigms. We conclude that curated synthetic data are best understood as a complement to real observations, and that hybrid pipelines combining controllable supervision with learned appearance are the most promising direction for reliable sim-to-real transfer.

[14] Caption-Mediated Perceived-Safety Estimation for Pedestrian Routing cs.CV | cs.AIPDF

Simon Parkinson, Paloma Liu, Wei Zheng, Mohammadreza Sheikhfathollahi

TL;DR: 该可解释路线先将街景VLM描述保存为中间文本，再仅从结构化文本特征估计行人感知风险，使每段路线评分都可检查。

Details

Motivation: 步行路线规划需要估计街道的主观安全感，视觉模型直接输出分数难以审查。作者采用显式自然语言描述作为中间表示，让风险判断可追溯，同时检验这种表示是否逊于图像嵌入基线。

Result: 研究比较五个模型家族的九种图像描述条件，使用与CLIP图像嵌入基线完全相同的后续评分流程。文本中介表示达到与图像嵌入相当的性能。系统部署覆盖英格兰北部曼彻斯特和哈德斯菲尔德36个选区、654,115张图像。独立实地验证使用70场参与者会话对494张图像的3,669条本地评分，与模型评分相关显著但幅度较小（r=0.262），人际分歧噪声上限为0.737。单次确认实验中，监督基准强44%的流程在实地未产生可测改善（r=0.250，p=0.84）。路线变化依行程长度不同：1公里内几乎无变化；3至6公里行程中，低风险路线长度中位数增加12.78%，中位绕行2.73%。

Insight: 可检查的文本描述能够达到图像嵌入基线水平，但监督基准提升未必迁移到真实行人安全感。实地判断存在较大人际分歧，因此路线优化要同时呈现模型不确定性和绕行代价。

Abstract: This paper presents an explainable approach to pedestrian routing, in which perceived safety is estimated from street-level imagery through an explicit natural-language intermediate representation. A vision–language model caption is generated and stored before any scoring is undertaken, and the perceived-risk class is derived entirely from structured features of that stored text, so that every segment score remains inspectable by the user. Nine captioning conditions across five model families are benchmarked against a direct Contrastive Language–Image Pre-training (CLIP) image-embedding baseline under an identical downstream pipeline, and the caption-mediated representation is found to reach parity with the image embedding rather than to trail it. The approach was deployed over 654,115 images covering 36 electoral wards in two locations in Northern England (Manchester and Huddersfield). Independent field validation against 3,669 locally collected ratings of 494 images across 70 participant sessions established agreement that is statistically significant but modest, at $r=0.262$, against a measured noise ceiling of 0.737 imposed by disagreement between raters. A single-use confirmatory test then found that a pipeline 44% stronger on the supervised benchmark did not produce measurable improvement in the field ($r=0.250$, $p=0.84$), so the benchmark gains did not predict the deployment gains in this case. Routing behaviour varies systematically with journey length. There is negligible change below 1,km, reaching a median increase of 12.78% in low-risk route length for a median detour of 2.73% on journeys of 3 to 6 km.

[15] Beyond Layers: Position-Resolved Gradient Conflict and Position-Aware Modulation for Unified Multimodal Models cs.CV | cs.LGPDF

Shuyang Jiang, Fucheng Deng, Yuchuan Luo, Zhenyu Wu

TL;DR: 论文提出位置分辨的梯度冲突图，发现视觉生成梯度对理解能力的干扰随视觉token在光栅序列中的位置而变，并据此仅调制高冲突位置。

Details

Motivation: 统一多模态模型共享参数进行图像理解与自回归生成，两种目标会相互干扰。以往只按层或专家诊断冲突，忽视生成序列中不同位置的视觉token语义角色不同。

Result: 位置分辨干扰图在一次反向传播中量化各层每个视觉token位置的理解—生成梯度冲突，成本为标准反向传播的1.2倍。在Show-o和Janus-Pro中，控制深度后位置解释了很大比例冲突方差；Show-o的偏η²为0.31（层为0.35），Janus-Pro为0.15（层为0.30）。首四分之一序列平均梯度余弦为-0.18，末四分之一为-0.02；按位置归一化梯度范数后仍保留80%效应，冲突与语义内容相关（Spearman ρ=0.64）。位置感知调制PAM只移除高冲突位置生成梯度中与理解反向的部分，不改架构；同等可训练参数下，Show-o较按层分离在MME高21分、GenEval高2.4分，同时POPE和总体FID相当。随机位置控制可复现约31%收益。

Insight: 共享参数冲突不仅沿网络深度变化，也取决于自回归视觉序列的位置和语义内容。按位置选择性移除冲突梯度可补充层级分离，两种切分维度还可组合。

Abstract: Unified multimodal models (UMMs) train image understanding and autoregressive image generation on shared parameters, and the two objectives are known to interfere. Existing diagnoses and remedies operate at the resolution of layers or experts, measuring conflict per layer and resolving it by separating parameters. We argue that this resolution hides an orthogonal axis. Generation in a UMM is next-token prediction over a raster sequence of visual tokens whose roles vary systematically with position, so how strongly a generation gradient interferes with understanding should depend on where in the sequence it originates. We introduce a position-resolved interference map that attributes understanding-generation gradient conflict to visual-token positions within every layer, computed from a single backward pass at $1.2\times$ the cost of a standard backward pass. On Show-o and Janus-Pro, position explains a large share of conflict variance after controlling for depth (partial $η^2=0.31$ vs. $0.35$ for layer on Show-o; $0.15$ vs. $0.30$ on Janus-Pro): the first quarter of the sequence has a mean gradient cosine of $-0.18$ against understanding, the last quarter $-0.02$. The dependence survives per-position gradient-norm normalization, retaining $80%$ of its effect size, and conflict strength tracks semantic content (Spearman $ρ=0.64$). Building on the map, we propose position-aware modulation (PAM), which removes the anti-aligned component of generation gradients only at high-conflict positions without changing the architecture. Under a matched trainable-parameter budget, PAM improves over layer-wise separation by $+21$ MME and $+2.4$ GenEval points on Show-o while matching it on POPE and overall FID; a random-position control recovers about $31%$ of the gain. Position-based and layer-based separation are complementary degrees of freedom and can be combined.

[16] Multidimensional Observer Model and Perceptual Dimensions of Human Image Quality Assessment cs.CVPDF

Sheng Zhao, Weikai Lin, Yuhao Zhu

TL;DR: 研究提出多维观察者模型，把人类图像质量判断表述为潜在感知空间中对带噪样本的比较，并发现该空间远低于像素空间维度且随判断任务而异。

Details

Motivation: 人类图像质量判断既与日常视觉任务相关，也支撑图像生成等机器视觉应用。作者希望解释人类评分依赖的内在感知维度，并区分低级与高级质量判断的表征结构。

Result: 模型将图像表示为潜在感知空间中的分布，将人类判断表示为比较带噪样本；它受灵长类腹侧视觉通路神经表征约束，并拟合大规模行为数据，预测能力与现有指标相当。分析发现，即使考虑图像空间的稀疏性，人类判断图像质量所需的感知空间仍非常低维。低级与高级质量判断的空间结构（如维数和编码信息）有所不同，说明尽管早期共享视网膜编码，人类在视觉决策中会选择性构造任务相关的感知空间。

Insight: 人类质量评价并非在一个固定通用视觉空间中完成，而会依据判断目标形成低维、任务相关的感知表示。理解该结构可帮助构建更符合人类评价机制的图像质量指标。

Abstract: Judging image quality is not only ecologically relevant to everyday human tasks, but also underpins many machine vision tasks such as image generation. This paper proposes a framework to understand the inherent perceptual space underlying image quality judgment in humans. We propose a multi-dimensional observer model that represents images as distributions in a latent perceptual space and that models human judgment as comparing noisy samples. Being constrained by neural representations in the primate ventral stream and fit to large-scale behavioral data, the model enables analysis of perceptual structure while matching the predictive power of existing metrics. Using this model, we find that the perceptual spaces needed to account for image quality judgment in humans are extremely low-dimensional compared to the image space even when considering its sparsity. The exact structure of the space (e.g., dimensionalities, information encoded) varies between low-level and high-level quality judgments, suggesting that, despite a shared retinal encoding in the beginning, humans selectively construct task-dependent perceptual spaces in visual decision making.

[17] GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction cs.CV | cs.LGPDF

Sheng Zhao, Weikai Lin, Yuhao Zhu

TL;DR: GazeFlow用条件流匹配将第一视角注视建模为受任务和视觉显著性共同条件化的时间轨迹分布，显式表达人类注视的随机性及注视—扫视动态。

Details

Motivation: 第一视角注视预测可用于多种下游应用，但人类注视具有随机性，同时受注视与扫视交替的时间结构、任务目标和视觉显著性影响，单一确定性热图难以表达。

Result: GazeFlow直接建模联合条件分布：视频编码器提取自下而上的视觉特征，再通过全局查询获得自上而下的任务信息；条件流匹配学习速度场，将高斯噪声样本迭代输运为合理注视轨迹。在标准基准上，逐帧指标达到当前最佳，生成轨迹也更符合人类注视的时间动态。摘要未提供具体分数。

Insight: 注视预测既要对齐画面中的视觉显著区域，也要反映任务意图和跨时间的注视—扫视结构。生成轨迹分布比固定单点预测更适合表示人类观察行为的不确定性。

Abstract: Egocentric gaze prediction enables many downstream applications but remains challenging, as human gaze is inherently stochastic. This stochasticity is constrained by structured temporal dynamics alternating between fixations and saccades, top-down influences from tasks, and bottom-up visual saliency. Based on this observation, we introduce GazeFlow, a framework that directly models gaze as a joint distribution of temporal gaze positions conditioned upon both top-down and bottom-up information. In particular, GazeFlow uses conditional flow matching (CFM): a learned velocity field iteratively transports a Gaussian noise sample into a plausible gaze trajectory drawn from this joint distribution. The velocity field is conditioned on bottom-up visual features extracted by a video encoder and on top-down task information obtained by globally querying these features. On standard datasets, GazeFlow achieves state-of-the-art performance on per-frame metrics, and the generated trajectories align better with human gaze temporal dynamics.

[18] ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing cs.CVPDF

Donghao Zhou, Haoyang He, Fan Zhang, Hao Yang, Guisheng Liu

TL;DR: ThinkV2V在视频编辑前显式激活多模态模型推理，并用渐进课程训练和推理时提示筛选处理需要因果或语义理解的隐含编辑指令。

Details

Motivation: 现有指令视频编辑多把多模态大模型当作语义编码器，对隐含编辑意图的因果和语义推理不足，导致复杂编辑要求难以准确执行。

Result: ThinkV2V采用MLLM到DiT架构，使模型先对源视频和指令进行显式思考，再形成细化条件控制生成。渐进课程训练从基础编辑逐步过渡到推理密集场景；推理时思考扩展则迭代改写候选提示并选出较可靠者。作者还整理ThinkV2V-150K并提出ThinkV2V-Bench，覆盖隐含意图和因果推理视频编辑。实验中，ThinkV2V在复杂及标准编辑场景达到先进表现，5B DiT显著超过更大的10B基线；摘要未给具体分数。

Insight: 复杂视频编辑需要让模型在生成前推断指令隐含的变化意图，并将其转成可执行的生成条件。推理过程既可通过渐进训练学习，也可在测试时扩展并筛选候选编辑计划。

Abstract: Instruction-guided video editing has made significant progress, yet existing methods use multimodal large language models (MLLMs) primarily as semantic encoders, so they often fall short in working with implicit edits that require causal or semantic reasoning. To bridge this fundamental gap in video editing, we propose ThinkV2V, a reasoning-driven framework for complex instruction-guided video editing, explicitly activating MLLM thinking before visual generation. At its core, ThinkV2V builds on a practical MLLM-to-DiT architecture to turn explicit thinking over the source video and instruction into refined conditioning signals for video editing. Further, we equip it with a dedicated training and inference recipe, combining Progressive Curriculum Training, which gradually cultivates the model from basic editing to reasoning-intensive cases, with Inference-Time Thinking Scaling, which iteratively refines candidate prompts and selects the most reliable one, to better elicit reasoning in challenging editing scenarios. We also curate the ThinkV2V-150K dataset and introduce ThinkV2V-Bench to support training and evaluation of video editing with implicit intent and causal reasoning. Experimental results demonstrate the state-of-the-art performance of ThinkV2V on both complex and standard editing scenarios, in which our 5B-scale DiT model substantially outperforms larger 10B-scale baselines.

[19] Detail in Context: A Dual-Scale Machine Learning Framework for Mycosis Fungoides Detection cs.CVPDF

Mohamed Hazem, Tarek Waleed, Omar Khaled, Nada Omar, Mahmoud Raslan

TL;DR: 论文提出结合10倍和20倍组织病理图像及临床特征的蕈样肉芽肿检测框架，分别支持早期图像筛查和已确诊病例的分期。

Details

Motivation: 蕈样肉芽肿是罕见皮肤T细胞淋巴瘤，早期外观与良性炎症性皮肤病相似，容易误诊。早期准确识别有助于改善患者结局。

Result: 框架用10倍与20倍双倍率CNN进行迟融合，并结合基于16项临床特征的随机森林。扩展数据集包含463名患者的6,267张图像（4,306张蕈样肉芽肿，1,961张非蕈样肉芽肿）。结果显示，20倍高分辨率细胞细节与10倍整体组织结构上下文结合有价值；图像迟融合模型准确率83.58%、敏感度89.13%，临床随机森林分别为96.6%和93.8%。两个模型对应不同临床目标：图像双尺度流水线用于早期筛查蕈样肉芽肿与非肿瘤皮肤病，临床元数据模型则用于确诊病例斑块/斑片与肿瘤阶段分辨。

Insight: 病理影像中的细胞级细节和组织级结构互补，双倍率融合可支持早筛；临床指标提供另一类适合后续分期的证据。应区分筛查与分期任务，避免把两种模型性能直接混为一谈。

Abstract: Mycosis fungoides (MF) is a rare form of cutaneous T-cell lymphoma that is often misdiagnosed in early stages due to its visual similarity to benign inflammatory dermatoses. Early and accurate diagnosis is critical for improving patient outcomes. In this paper, we propose a comprehensive diagnostic framework for automated MF detection that combines dual- scale histopathological image analysis with deep learning. To distinguish MF from other lymphoproliferative skin conditions, the proposed approach leverages a late-fusion ensemble of dual- magnification (10x and 20x) convolutional neural networks (CNNs), complemented by a random forest classifier trained on 16 clinical features. Experimental results on an expanded dataset of 6,267 images (4,306 MF; 1,961 Non-MF) across 463 patients demonstrate that strong detection performance is obtained by prioritizing higher-resolution cytological details (20x) within broader architectural context (10x). The image-based late-fusion model achieves an accuracy of 83.58% and a sensitivity of 89.13%, while the clinical random forest model achieves an accuracy of 96.6% and sensitivity of 93.8%, highlighting the po- tential of this multimodal framework as a robust clinical decision support system in dermatology. This framework addresses two distinct clinical objectives: an image-based dual-scale pipeline optimized for the early diagnostic screening of MF versus non- MF dermatoses, and a complementary clinical metadata model designed for the subsequent staging of confirmed MF cases (patch/plaque versus tumor)

[20] LongTake: Learning to Sustain Dynamics in Long-Horizon Video Generation cs.CVPDF

Byoungwoo Park, Jaemoo Choi, Juho Lee, Yongxin Chen

TL;DR: LongTake通过真实长视频上的长时教师强制训练自回归视频模型，延长直接监督范围并改善超出训练时长后的动态保持能力。

Details

Motivation: 自回归视频扩散适合长时生成，但长rollout常逐渐静止或画质下降。作者认为短视频监督难以教会模型如何持续发展较长时间的场景动态。

Result: LongTake先用真实长视频前缀训练模型预测更晚帧，将直接教师强制监督延伸到原有短训练范围之外。该训练阶段增强了自回归分布匹配蒸馏（DMD）学生自rollout的初始化，且无需标准流程中的中间少步蒸馏。在相同5秒DMD设置下，LongTake初始化在30秒rollout中比短时教师强制初始化动态度更高，同时美学质量相近，并超过受测基线。Hybrid DMD进一步对自rollout后续帧提供教师监督，同时保留初始窗口的双向联合监督；长时自rollout上位于动态度—美学质量Pareto前沿，Hybrid DMD在30秒和60秒均取得最高动态度。

Insight: 长时生成的训练长度需要由长视频前缀直接监督覆盖，单靠短片段训练后递归扩展容易丢失动态。长时教师强制可提供更好的蒸馏起点，后续混合DMD再平衡动态与画质。

Abstract: World models, game simulators, and long-take video creation require coherent scene evolution and sustained dynamics over extended durations. Autoregressive (AR) video diffusion provides a natural framework for long-horizon generation, yet extended rollouts often become near-static or lose visual quality. We hypothesize that these failures reflect the limited guidance provided by short-video supervision on how ongoing scene dynamics develops over longer durations. This motivates us to introduce LongTake, a two-stage training pipeline built around Long-Horizon Teacher Forcing (TF) on curated real long videos. Long-Horizon TF trains the AR model to predict later frames conditioned on long ground-truth video prefixes, extending direct supervision beyond the short training horizon. This supervision is designed to help the model sustain dynamics and preserve visual quality during long-horizon generation. Our central finding is that this training stage strengthens direct initialization for distribution matching distillation (DMD) under student self-rollout, without the intermediate few-step distillation stage used in standard pipelines. Under the same five-second DMD training setup, our initialization yields substantially higher dynamic degree than short horizon TF initialization on 30-second rollouts at comparable aesthetic quality, and surpasses the evaluated baselines in both measures. Hybrid DMD further reuses this teacher to extend supervision to later frames of the self-rollout while retaining bidirectional joint supervision over the initial window. On long-horizon self-rollouts, LongTake lies on the Pareto front of dynamic degree and aesthetic quality, and Hybrid DMD attains the highest dynamic degree among evaluated methods at both 30s and 60s.

[21] PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation cs.CVPDF

Cong Wei, Xuanchi Ren, Bryan Chu, Weiming Ren, Huan Ling

TL;DR: PixelUMM直接在像素空间统一图像与视频理解和生成，使用空间patch与时空tubelet连接共享多模态骨干，免去独立视觉编码器。

Details

Motivation: 统一多模态模型常为理解和生成使用不同视觉表示，增加视觉上下文长度并使其难以接入既有视觉语言预训练流程。像素空间建模可免编码器，但图像和视频在时间表示上的差异使统一接口仍有挑战。

Result: PixelUMM将图像切成空间patch、视频切成时空tubelet，通过单层线性投影连接原始像素与共享多模态骨干。混合Transformer架构共享注意力并保留任务专属参数，同时统一自回归文本预测和像素空间流匹配视频生成。在图像/视频理解与生成任务上达到有竞争力表现；研究还分析解码器结构和时空patch尺寸等关键设计，为像素空间统一多模态模型提供经验。摘要未给具体数值。

Insight: 以原始像素作为统一接口可减少理解和生成各自维护视觉表示的复杂度，但图像patch与视频tubelet仍需妥善编码不同时间结构。任务共享注意力与专属参数提供折中。

Abstract: Unified Multimodal Models (UMMs) often rely on separate visual representations for understanding and generation, increasing visual context length and complicating integration with established vision-language pretraining pipelines. Recent advances in pixel-space modeling offer an encoder-free alternative, but extending this paradigm from images to videos is non-trivial: video understanding and generation adopt different temporal representations, leaving the design of a unified visual interface an open question. We present PixelUMM, an encoder-free model for unified image and video understanding and generation directly in pixel space. PixelUMM represents images as spatial patches and videos as spatiotemporal tubelets, connecting raw pixels to a shared multimodal backbone through single-layer linear projections. Its Mixture-of-Transformers architecture combines shared attention with task-specific parameters and extends clean-pixel prediction to video generation, jointly supporting autoregressive text prediction and pixel-space flow matching. Experiments show that PixelUMM achieves competitive performance across image and video understanding and generation tasks. We further conduct empirical studies of key design choices, including decoder design and spatial-temporal patch size, providing insights for future pixel-space unified multimodal models.

[22] Aperture: Training-Free Multiscale Concept Bottlenecks for Remote Sensing cs.CVPDF

Rishabh Mondal, Nipun Batra, Utkarsh Mall

TL;DR: APERTURE通过图像空间多尺度四叉树定位小型概念，并以预训练多模态大模型获取可靠概念分数，实现无需训练的遥感概念瓶颈分类。

Details

Motivation: 地球观测模型缺乏可解释性，概念瓶颈模型虽支持解释和专家交互，但在遥感领域训练成本高或无标注时表现差。作者认为无需训练方案需同时保留图像及概念空间的细粒度信息。

Result: APERTURE用贪心四叉树路由在多尺度图像空间定位小概念，并以预训练多模态大模型替代对比视觉语言模型来获得概念分数，再融合全图与原生概念尺度的得分。作者提出SiFC细粒度概念中心数据集，涵盖三个国家并配有人审类别级概念图。在SiFC上，APERTURE比最佳免训练基线macro-F1高10多个百分点，也超过监督概念瓶颈模型。针对性移除组件测试检查概念分数是否随视觉证据改变；时间实验显示只更新描述词即可适应技术变化，无需重训练。

Insight: 遥感小目标或细节概念需在图像空间和概念描述空间同时保留尺度信息。概念分数的干预敏感性测试可验证解释是否真正依赖图像证据，时间更新描述则提供低成本领域迁移。

Abstract: While earth observation models have advanced substantially, they still lack interpretability. While concept-bottleneck models provide interpretability and expert interaction, they are either too expensive to train for the remote sensing domain or perform poorly without annotation. We posit that in expert domains like remote sensing, such training-free models require both fine details in both image and concept space. In image space, we propose a multiscale concept bottleneck using greedy quadtree routing to locate small concepts. In concept space, we replace contrastive vision language models with pre-trained MLLMs and present a way to get reliable concept scores from them. We introduce APERTURE that blends concept scores at the global image and native concept-scale level to give state-ofthe-art training-free model performance. To test these models, introduce SiFC, a fine-grained concept-centric dataset across three countries, with human-reviewed class-level concept maps. On SiFC, APERTURE outperforms the best training-free baselines by more than 10 percentage points in macro F1-score, and notably also outperforms supervised concept bottleneck models. Targeted component-removal tests examine whether concept scores respond to changes in visual evidence, while temporal experiments show that descriptor updates improve recognition of technological changes without retraining.

[23] After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data cs.CV | cs.AIPDF

Shilin Hu, Jingyi Xu, Dimitris Samaras, Hieu Le

TL;DR: 作者用离线智能体流程将大规模真实阴影图像及掩码转化为配对去阴影数据，组合物理生成、失败检测、反馈重试和确定性修正。

Details

Motivation: 去阴影在常见基准上近似解决，但现实环境中仍脆弱；训练数据近十年变化很少。获取配对无阴影目标需要只移除遮挡物，同时保持场景、相机和光照不变，难以采集；现成阴影检测数据集虽有真实图像和掩码，却没有对应无阴影目标。

Result: AgenticShadow构建流程结合物理启发生成、失败检测、反馈驱动重试、候选筛选和确定性修正，利用不完整但丰富的真实图像掩码生成配对监督。数据集含17,138组三元组（图像、掩码、无阴影目标），覆盖一般场景、人脸和遥感。相较此前去阴影工作，构建流程将颜色分布差异降低50.5%；在AgenticShadow上训练现有模型后，跨域LAB RMSE降低19.7%至37.5%。

Insight: 大量已有检测掩码可通过自动化目标生成补成训练配对，而不必从头采集每张无阴影图像。反馈重试和确定性修正用于控制生成失败与颜色偏差，构成规模化配对数据构建的关键。

Abstract: Shadow removal looks nearly solved on established benchmarks, yet remains brittle in the real world. Models have advanced; the paired training data they rely on have barely changed in nearly a decade. The reason is simple: obtaining a shadow-free target requires removing the occluder while keeping the scene, camera, and illumination otherwise unchanged, making diverse paired data difficult to capture. Meanwhile, large shadow detection datasets already contain diverse real-world images and masks, but no shadow-free targets. To turn this abundant but incomplete data into paired supervision, we propose an offline agentic workflow combining physics-motivated generation, failure detection, feedback-driven retry, candidate selection, and deterministic correction. Using this workflow, we construct AgenticShadow, a dataset of 17,138 image-mask-target triplets spanning general scenes, faces, and remote sensing. Our construction workflow reduces Color Distribution Difference by 50.5% over previous shadow removal work, while training existing shadow removal models on AgenticShadow reduces cross-domain LAB RMSE by 19.7-37.5%.

[24] Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generation cs.CV | cs.AIPDF

Hongjia Zhai, Xiyu Zhang, Haoran Zhang, Zhichao Ye, Haomin Liu

TL;DR: Exo2EgoHOI利用统一4D手—物交互先验和对象中心锚定，将第三人称操作视频转为保留细粒度手物关系的第一人称训练视频。

Details

Motivation: 具身智能需要大量第一人称人类操作视频，但规模化采集成本高。把丰富的第三人称视频转换成第一人称观察是替代方案，然而大视角变化下现有方法难以保留精细手—物交互和物体身份。

Result: Exo2EgoHOI以场景几何、关节手部渲染和稠密手—物关系场构造统一4D交互先验，并用双分支残差适配器将结构与关系线索注入视频生成骨干。解耦门控交叉注意力分别编码对象和背景参考，自适应整合全局语义与局部外观，以对象为中心锚定一致性。在ARCTIC-HOI与Ego-Exo4D上的实验表明，物体一致性和交互保留均提高，同时视觉质量有竞争力；ARCTIC-HOI上，相较各自最佳基线，物体mIoU提高32.3%，MPJPE和PA-MPJPE分别降低34.7%和50.0%。

Insight: 视角转换需显式保留接触、手部姿态和物体锚点，单纯外观条件不足以确保交互动作一致。结构几何提示与对象/背景分离注意力互补，分别约束动作关系和物体身份。

Abstract: Egocentric videos of human manipulation provide valuable visual experience for embodied intelligence, yet collecting such data at scale is costly. Exocentric-to-egocentric video generation offers a scalable alternative by transforming abundant third-person manipulation videos into first-person observations. However, existing methods often struggle to faithfully preserve demonstrated hand-object interactions (HOI) across large viewpoint changes due to insufficient fine-grained interaction guidance and weak object-centric anchoring. We present Exo2EgoHOI, an HOI-aware video generative framework for interaction-preserving exocentric-to-egocentric translation. To preserve fine-grained HOI, we introduce a unified 4D HOI prior that combines scene geometry, articulated hand renderings, and dense hand-object relation fields, together with a dual-branch residual adapter for injecting structural and relational cues into the video generation backbone. To preserve object consistency, we introduce Decomposed Gated Cross-Attention, which separately encodes object and background references and adaptively integrates global semantic and local appearance features as object-centric anchors. Experiments on ARCTIC-HOI and Ego-Exo4D demonstrate substantial improvements in object consistency and HOI preservation while maintaining competitive visual fidelity. In particular, on ARCTIC-HOI, Exo2EgoHOI improves object mIoU by 32.3% and reduces MPJPE and PA-MPJPE by 34.7% and 50.0%, respectively, relative to the respective best baseline results. Project page: https://rcl-robotics.github.io/Exo2EgoHOI/.

[25] HIGS: Hierarchical Implicit Grids for Joint Geometric and Semantic Scene Understanding cs.CV | cs.ROPDF

Hanwen Cao, Wenqiang Wu, Kuang-Ting Tu, Mathias Otnes, Jeffrey Delmerico

TL;DR: HIGS用多分辨率重叠子地图构建分层神经隐式场，在同一表示中联合存储几何与视觉语言语义，并通过隐式特征空间优化提升大场景效率。

Details

Motivation: 神经隐式表示可构建连续、可微、高保真3D地图，但许多方法只重建几何，缺少支持高层空间理解和任务规划的语义；环境规模增大时，后端优化成本也难扩展。

Result: HIGS将场景分解为重叠子地图，在局部子地图中分层优化，并以统一查询解码机制支持几何和语义特征的训练及推理。特征编码器预测初始分层网格，减少从头优化子地图表示的时间。为校正子地图漂移，系统完全在隐式特征空间对齐融合，避免解码最终输出。地图同时嵌入几何和视觉语言潜在特征，并用于构建有符号距离场及开放词汇物体定位。大规模真实场景基准上，方法提高计算和内存效率，同时保持较高估计准确度并赋予机器人空间感知；摘要未列具体数值。

Insight: 几何与语义可以共享分层隐式地图和查询接口，而非分别构造独立地图。通过特征空间直接对齐子地图，可减少频繁解码开销，支持更大尺度的机器人建图。

Abstract: Neural implicit representations have had a significant impact on scene reconstruction by enabling robots to build continuous, differentiable, and high-fidelity 3D maps. Most existing works focus on geometric reconstruction and lack semantic information for high-level spatial understanding and task planning. Also, as the scale and complexity of the environment increase, neural representations face the challenge of maintaining computational efficiency in back-end optimization. To resolve these two challenges, we introduce a hierarchical neural field that leverages multiresolution submaps to achieve an efficient and scalable implicit representation, and a unified query and decoding mechanism to support both geometric and semantic features. More specifically, the learnable map features can be converted to the output with the query and decoding process for both training and inference. For large-scale representation, we decompose a scene into overlapping submaps and do hierarchical optimization within each local submap, thus enabling scalable computation. To further improve efficiency, we design feature encoders that predict initial hierarchical grid features to substantially reduce the time needed to optimize the submap features from scratch. To correct estimation drift among submaps, we align and fuse them entirely within the implicit feature space, leading to substantial acceleration by avoiding the need to decode the final output. Building upon this efficient hierarchical representation, we embed both geometric features and vision-language latent features into the map, and demonstrate it on both Signed Distance Field (SDF) construction and open-vocabulary object grounding. Our approach significantly improves computation and memory efficiency, maintains high estimation accuracy, and endows the robot with spatial awareness on large-scale real-world benchmarks.

[26] Eulerian Motion Reconstruction for Water Scenery cs.CVPDF

Chuhan Chen, Yen-Chi Cheng, Ayush Saraf, Rajvi Shah, Tuotuo Li

TL;DR: 该方法从单段非循环水景视频恢复可交互新视角的循环4D水体场景，以欧拉运动场驱动高斯泼溅并补充非周期残差。

Details

Motivation: 以往水景动画多将任务视为2D视频纹理循环，无法从新视角交互观察。作者转向3D重建，使单段普通视频能够生成循环4D动态水景并支持新视点渲染。

Result: 方法将水体运动表示为静态3D欧拉运动场，用它驱动规范高斯泼溅随时间平流，并按固定周期循环重生；训练以渲染损失监督。为表达真实场景中的非周期随机动态，还加入随时间变化的残差项，捕捉静态欧拉场未覆盖的变化。定量和定性实验表明，水景动画的照片级真实感优于既有方法；摘要未提供具体指标。

Insight: 水景循环动画可在3D空间建模为运动场而非重复播放平面纹理，因而能从未循环的单视角视频重建可交互新视角。周期主运动与非周期残差结合，以同时表达稳定循环和随机变化。

Abstract: Reconstructing and animating water scenery from nature produces compelling and immersive visual experiences. Previous work examined this task from the perspective of 2D video textures, with the goal of creating a looping video. In our work, we tackle the problem from a 3D perspective, creating a looping 4D dynamic reconstruction which can be interactively rendered from novel viewpoints from a single non-looping 2D source video. We represent motion as a 3D static \textit{Eulerian} motion field that advects canonical Gaussian splats that are cyclically reborn at fixed time periods, supervised using rendering losses. To model non-periodic and stochastic dynamics present in real-world scenes, we add a non-periodic, time-varying residual term to capture deviations from the static Eulerian motion field. We show quantitatively and qualitatively that our framework enables photorealistic animation of water scenes better than prior art.

Fereshteh Aghaee Meibodi, Amir Mehdi Soufi Enayati, Shadi Alijani, Homayoun Najjaran

TL;DR: TSDA-Track通过训练期多阶段特征对齐解决模板和搜索帧来自不同传感模态时的域差异，推理阶段仍使用统一跟踪流水线。

Details

Motivation: 传统视觉跟踪假设初始模板和后续搜索帧来自同一传感模态。实际应用中传感器可能切换；这不同于两种模态同时可用的多模态跟踪，要求模型在模板与搜索模态不同的情况下定位目标。

Result: TSDA-Track研究两种对齐：Pre-AFA在Transformer模板—搜索交互前做对抗对齐以抑制模态偏差；Enc-CFA在交互后的编码器表示上做对比对齐以增强目标级跨模态对应。两种方案推理时均无需模态专属分支。在LasHeR以及RGBT234、GTOT零样本跨模态协议上优于代表性跟踪器；RGBT234模态切换协议中，Pre-AFA的SR/PR为43.2/56.0，ToMP-101基线为36.8/50.0。Anti-UAV-024实验还验证其用于航空跟踪的适用性。

Insight: 模板与搜索域差异可通过训练期跨模态对齐缓解，部署时不必为每种模态组合单独维护分支。交互前对齐偏重消除模态偏置，交互后对比对齐则强化目标对应。

Abstract: Visual object tracking typically assumes that the initial template and subsequent search frames share the same sensing modality. In practice, sensor availability or operation may change over time, creating a substantial representation gap between template and search frames. Unlike conventional multi-modal tracking where paired modalities are simultaneously available, cross-modal tracking requires localization when template and search frames originate from different active modalities. Accordingly, we introduce TSDA-Track, a Template-Search Domain Adaptation framework to reduce modality discrepancy during training. We investigate two feature alignment strategies. Pre-AFA TSDA-Track applies adversarial alignment before transformer’s template-search interaction to suppress modality-specific bias. Enc-CFA TSDA-Track applies contrastive alignment to encoder representations after interaction to strengthen target-level cross-modal correspondence. Both variants retain a shared inference pipeline without modality-specific branches. Experiments on LasHeR, and zero-shot evaluations on RGBT234 and GTOT under multiple cross-modal protocols demonstrate improvements over representative state-of-the-art trackers. For instance, under the modality-switch protocol on RGBT234, Pre-AFA TSDA-Track achieves an SR/PR of 43.2/56.0, compared with 36.8/50.0 for ToMP-101 baseline. In addition, a study on Anti-UAV-024 further verifies the applicability of TSDA-Track to aerial tracking. Our study highlights the effectiveness of feature alignment domain adaptation for cross-modal tracking.

[28] Vision-Language-Action Autonomous Driving Agent with Language-based Memory cs.CV | cs.ROPDF

Kai Yan, Xiangyu Chen, Yulong Cao, Alex Naumann, Peter Karkus

TL;DR: AD-Memo将驾驶场景关键对象记录为思维链中的自然语言记忆，并以分工式优势训练视觉—语言—动作模型处理跨帧和长时程驾驶任务。

Details

Motivation: VLA受图像token成本限制，可输入帧数有限，不利于四向停车到达顺序判断及长时程场景理解。现有潜在向量记忆依赖交叉注意力，难以解释和迁移。

Result: AD-Memo是通用驾驶VLA，在思维链扩展中输出周围关键对象记忆，作为未来输入的一部分。作者整理记忆任务数据集，并用两阶段方案训练：先监督微调，再采用半闭环RL算法Da Capo；该算法用轨迹级优势更新记忆、用步骤级优势更新驾驶动作，以改善信用分配。在四向停车和一般驾驶等场景中，AD-Memo提高驾驶质量和场景问答能力；其语言记忆可即插即用迁移到其他模型。摘要未列具体分数。

Insight: 自然语言记忆比潜向量更容易检查和跨模型复用，可将有限视觉输入中的关键信息传到后续决策。记忆生成与即时驾驶动作具有不同时间尺度，训练时分开分配优势有助于更好信用分配。

Abstract: Vision-Language-Action (VLA) foundation models have recently emerged as one of the prevailing solutions for autonomous driving, as they can utilize knowledge acquired during vision-language pretraining for accurate and interpretable driving. However, VLAs can take only a limited number of frames as visual input due to the high token cost of an image, which is problematic for memory-dependent tasks such as determining the arrival order at all-way stops and long-horizon driving scene understanding. Existing solutions use latent vector memories accessed through cross-attention, which are neither interpretable nor portable. In this paper, we propose AD-Memo, a general-purpose VLA driving agent with language-based memory. The agent outputs memory as an extension of its Chain-of-Thought (CoT) to record surrounding objects critical to driving; this memory becomes part of the agent’s future input. We curate memory-based datasets and train VLAs with a two-stage recipe: Supervised Fine-Tuning (SFT) and \textit{Da Capo}, a novel semi-closed-loop Reinforcement Learning (RL) algorithm which uses trajectory-level advantage for memory and step-level advantage for driving, leading to better credit assignment. Across scenarios such as all-way stops and general driving, AD-Memo improves driving quality, enables better question answering on driving scenes, and produces plug-and-play memory for other models.

[29] EPIC: Epipolar-Consistent 360° Immersive Stereo Video Generation cs.CV | cs.HCPDF

Debabrata Mandal, Dongdong Fu, Jonathon Miller, William Villareal, Xi Peng

TL;DR: EPIC将现有视频扩散模型扩展到4K立体360度沉浸式生成，并用极线感知度量作为偏好信号优化跨视角和时间几何一致性。

Details

Motivation: 沉浸式显示器可提供丰富虚拟体验，但手工制作所有内容成本高且难扩展。现有生成模型针对普通显示设计，无法直接生成高分辨率立体360度视频；普通屏幕上可接受的视角或时间不一致，在头显中会明显破坏体验。

Result: 作者提出零样本生成流水线，将现有视频扩散模型扩展为4K立体360度视频。受双目视觉与深度感知启发，构造极线感知360度图像匹配度量，捕捉不同视角之间的时间和立体几何不一致，并在有限训练数据下将其作为直接偏好优化信号。该工作实现360度立体视频生成，为按需生成混合现实内容提供可扩展路径；摘要未报告具体画质指标。

Insight: 沉浸式立体全景生成需要比常规视频更严格地检查左右视图和时间维度的几何一致性。将极线关系写入偏好信号，可把视觉连续性要求明确纳入现有扩散模型优化。

Abstract: Immersive displays can enable rich and diverse virtual experiences. Manually authoring every possible experience to realize this potential, however, is prohibitively expensive, difficult to scale, and impractical. Generative AI models could remove this bottleneck, but today’s models are built for conventional displays and cannot generate the high-resolution, stereoscopic $360^\circ$ content required for immersive viewing. Further, temporal and stereo inconsistencies that may be tolerable on conventional displays can become highly disruptive when viewed through an immersive headset. Here, we address this gap with a zero-shot generative pipeline that extends existing video diffusion models into 4K stereoscopic $360^\circ$ videos. Inspired from binocular vision and depth perception, we develop an epipolar-aware $360^\circ$ image matching metric that captures the temporal and stereo geometric inconsistencies across views. We then use this metric as a preference signal for direct preference optimization with limited training data. Our work enables $360^\circ$ stereo video generation and provides a scalable path for bringing generative content to immersive displays, allowing diverse mixed reality experiences on demand.

[30] No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation cs.CVPDF

Zejing Rao, Ketong Ren, Xiaoqiang Liu, Yiping Meng, Guoxin Zhang

TL;DR: SEGUE在流式视频生成中把提示切换显式拆成带角色和时长的过渡子提示，并用时间跨度受限的DMD训练保证旧状态合理退出、新状态渐进建立。

Details

Motivation: 用户可在视频流生成中途切换提示，但现有模型可能提前实现新目标或走启发式捷径，跳过可信转场所需的中间状态变化。

Result: 每次切换时，无需训练的规划器解析最新帧与新旧提示，生成少量标明角色和持续时间的过渡提示，之后再交还用户提示。SPANDMD处理短时提示调度下因果模型训练难题：在完整rollout时间上下文中评估每个有效提示，但只在其指定跨度内保留DMD残差，避免破坏准备阶段监督。在含1,800次切换的OpenTrans-360上，SEGUE八项转场指标均第一，总分从最强基线0.866升至0.887；在StreamAV-Bench的六项指令响应指标中四项第一。规划器还可迁移到冻结自回归生成器，无需重训。

Insight: 提示切换需要规划旧场景如何消退、新场景如何建立，而非立刻切换条件。用明确的子提示时序约束训练，可让全rollout提供时间上下文，同时仅在对应跨度施加生成更新。

Abstract: Streaming video generators allow users to dynamically modulate video synthesis via mid-stream prompt switching. Existing streaming methods can respond to the updated instruction while still cutting corners, prematurely realizing goals or taking heuristic shortcuts that bypass necessary intermediate state changes needed for a plausible transition. In this study, we present SEGUE, a novel framework that makes this process explicit and trains the generator to execute these transitions faithfully. At each switch, a training-free planner parses the latest frame and prompts, writes a few segue prompts with roles and durations, and then hands control back to the user’s prompt. Furthermore, to address the inherent difficulty of training causal models on short-lived temporal schedules without corrupting preparatory supervision, we introduce SPANDMD, which evaluates each active prompt using the full rollout as temporal context while retaining its DMD residual only within the prompt’s assigned span. On OpenTrans-360, a benchmark of 1,800 switches that scores how the old state exits and the new one begins, SEGUE ranks first on all eight transition metrics and raises the overall score over the strongest baseline from 0.866 to 0.887. It also ranks first on four of six instruction-response metrics of StreamAV-Bench, while the planner transfers to frozen autoregressive generators without retraining.

[31] Hard-Region Supervision: #1 on the Waymo Open Dataset 2D Video Panoptic Segmentation Leaderboard cs.CVPDF

Jinghan Yang

TL;DR: 该Waymo 2D视频全景分割挑战获胜方案用基线错误定义困难区域并额外监督训练，测试时再融合模型、分割输出及跨相机身份。

Details

Motivation: 任务要求对每帧每像素分类，并让可计数物体身份在100帧、五个重叠相机之间持续一致，常规分割跟踪流水线仍存在困难区域错误和跨相机身份关联问题。

Result: 方案以分割器—跟踪器—细化器级联DVIS++为基线，提出困难区域监督HRS：用基线错误位置定义困难区域，增加专门损失和辅助预测头；辅助头只在训练使用，测试时移除，所以推理架构与基线相同。测试时另做两模型集成、将分割器输出合入最终全景图、跨相机身份链接三项改进。在挑战测试集上wSTQ为0.3547、wAQ为0.2071、mIoU为0.6075，三项均排名第一；wSTQ领先第二名3.6分，并比DVIS++基线高2.4分。

Insight: 对基线难点区域专门加监督能改善性能而无需增加部署时模型复杂度。视频全景分割还需在测试阶段结合分割结果、模型集成及跨相机身份链接，处理空间和时间一致性。

Abstract: We describe our winning entry to the Waymo Open Dataset 2D Video Panoptic Segmentation Challenge. The task asks for a semantic class at every pixel of every frame and, for countable objects, an identity that holds across 100 frames and across five overlapping cameras. We build on DVIS++, a cascade of a segmenter, a tracker, and a refiner, as our baseline. We propose hard region supervision (HRS) to improve the baseline. In particular, we use the baseline to define the hard region as where it makes mistakes, and design a loss and an auxiliary prediction head for this region. The auxiliary head is used only in training and removed at test time, so at inference the model trained with HRS has the same architecture as the baseline. In addition, we propose three test-time steps that further improve the results: a two-model ensemble, a merge of the segmenter’s output into the final panoptic map, and cross-camera identity linking. On the challenge test set, our entry reaches 0.3547 wSTQ, 0.2071 wAQ, and 0.6075 mIoU, ranking first on all three metrics. It is 3.6 wSTQ points ahead of the second entry and 2.4 points ahead of our DVIS++ baseline.

[32] SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision–Language Models cs.CV | cs.AIPDF

Rafi Ibn Sultan, Xiangyu Zhou, Md. Sajid Alam Chowdhury, Chengyin Li, Prashant Khanduri

TL;DR: SpatialCORE把模型生成空间定位框的置信度转化为后训练奖励，使视觉空间推理依赖准确且自信定位的相关对象。

Details

Motivation: 大型视觉语言模型在空间推理上仍薄弱。已有方法让模型在推理中生成框、掩码等定位结果，但通常只优化最终答案，模型即使没有可靠定位相关对象也可能因答案碰巧正确获得奖励。

Result: SpatialCORE是后训练框架，根据模型对生成框坐标token的置信度加权框匹配质量，形成自调节空间奖励，鼓励模型准确且自信地定位相关对象。答案门控进一步将定位优化与最终答案正确性关联。在多样空间推理基准上，SpatialCORE超过开源及专用空间推理模型，并能零样本迁移到未见数据分布；摘要未列具体指标。

Insight: 空间答案应与模型指出的对象证据相联系，最终答对本身不足以证明定位过程可靠。置信度加权定位奖励及答案门控把证据质量与任务成败结合起来。

Abstract: Large Vision-Language Models (LVLMs) have made remarkable progress across visual perception tasks, yet spatial reasoning remains a persistent weakness, especially for questions that require reasoning over visual space. Recent spatial-reasoning methods incorporate generated grounding, where models predict bounding boxes, masks, or other localization outputs for task-relevant objects as part of their reasoning trace. However, these approaches typically optimize final-answer correctness alone, allowing correct answers to be rewarded even when the model does not reason from confidently localized task-relevant objects. We introduce SpatialCORE (Spatially COnfident REasoning), a post-training framework that turns the model’s own confidence in generated grounding into a learning signal for spatial reasoning. Its central idea is to reinforce grounding that is both accurate and confident, encouraging the model to reason from confidently localized task-relevant objects. SpatialCORE realizes this through a self-regulating spatial reward that weights each predicted bounding box’s matching quality by its coordinate-token confidence. An answer gate further ties grounding optimization to final-answer correctness. SpatialCORE achieves state-of-the-art results among open-source and specialized spatial reasoning models across diverse benchmarks, and transfers effectively in zero-shot settings to unseen data distributions. The source code is available at https://github.com/rafiibnsultan/SpatialCORE.

[33] Soft Spatial Reasoning cs.CV | cs.AIPDF

Rafi Ibn Sultan, Md. Sajid Alam Chowdhury, Saleh Zare Zade, Chengyin Li, Prashant Khanduri

TL;DR: Soft Spatial Reasoning在中间步骤混合多个token嵌入形成连续软状态，并由AdaptSoft根据不确定度自适应控制软化程度，减少空间推理过早选定错误token。

Details

Motivation: 视觉语言模型通常用离散自回归思维链进行空间推理，每一步都要选定单一token，即使正确空间解释仍不确定。过早离散化可能使错误选项在后续推理中不断传播；但无差别混合互相冲突的空间关系也会干扰思考。

Result: 该后训练框架每步混合token嵌入形成软状态，使多个候选续写参与下一步。AdaptSoft控制器依据当前隐藏状态和预测不确定性，逐步调整软化程度；梯度对齐目标无需中间推理标注即可提供步骤级训练信号。在多个空间基准上，Soft Spatial Reasoning用同一骨干超过离散硬思维链、固定软度思维链及多种现有VLM；摘要未列具体分数。

Insight: 空间推理的候选保留程度应随步骤变化：不确定时保留多种解释可能有益，候选彼此冲突时则应收敛。用模型隐藏状态和不确定性控制软度可避免统一软化或过早离散。

Abstract: Large Vision-Language Models (LVLMs) commonly perform spatial reasoning through chain-of-thought (CoT), encoding intermediate reasoning as autoregressive sequences of discrete language tokens. Such hard thinking requires committing to a single token at each step, even when the correct spatial interpretation remains uncertain. This early commitment constitutes premature discretization: an incorrect token selection can propagate errors through subsequent reasoning. We propose Soft Spatial Reasoning, a post-training framework that introduces soft thinking for spatial tasks in LVLMs. At each intermediate reasoning step, the LVLM forms a continuous soft state by mixing token embeddings rather than selecting a single token, allowing multiple candidate continuations to influence the next step. The appropriate degree of softness, however, can vary across reasoning steps: retaining multiple candidates may preserve a useful spatial interpretation, but if those candidates imply conflicting spatial relations, mixing them may interfere with subsequent reasoning. At the core of Soft Spatial Reasoning is AdaptSoft, a controller that uses the current hidden state and predictive uncertainty to adapt the degree of softness at each reasoning step. To train AdaptSoft, we introduce a gradient-alignment learning objective that provides a step-specific learning signal for softness control without intermediate reasoning supervision. Across diverse spatial benchmarks, Soft Spatial Reasoning outperforms hard and fixed-soft CoT baselines using the same backbone, as well as a range of existing LVLMs. The source code is available at https://github.com/rafiibnsultan/Soft_Spatial_Reasoning

[34] Matisse: Evidence-Space Reasoning for Active 3D Reconstruction cs.CV | cs.ROPDF

Xihang Yu, Kaichen Zhou, Lorenzo Shaikewitz, Clément Jambon, Xiao Zhan

TL;DR: Matisse用预训练生成式3D模型的交叉注意力证据估计隐式几何不确定性，并统一指导主动视角采集和长时重建关键帧选择。

Details

Motivation: 部分视角下的3D重建需在有限计算预算中获取并保留有用几何信息。既有主动观察方法多估计已观测或已实例化几何的不确定性，难推理未见结构；长时重建则常保留冗余帧。

Result: Matisse是免训练框架，从3D潜在token的交叉注意力证据估计证据不确定性，再根据预期后验熵降低量计算证据信息增益，以此选择下一视角和关键帧。多物体场景采用遮挡感知、对象平衡聚合，并在中间潜变量中传播不确定性，规划时无需先完成完整重建。相对各数据集最佳基线，GSO30、YCB-V和Replica上的Chamfer距离分别降低12.7%、3.8%和9.2%；在GSO30上以相同重建后端比最佳主动重建基线端到端快1.50倍。长时重建关键帧实验中，仅用Stream3D输入视图数的14%即可达到相近Chamfer距离。

Insight: 主动重建的决策可利用生成式3D模型内部的证据不确定性，而不必先生成完整场景。统一的证据信息增益既能选择新的视点，也能筛掉长时重建中的冗余关键帧。

Abstract: How can a 3D reconstruction system acquire and retain useful information to understand the geometry of a scene from partial views under a limited computation budget? Existing active view acquisition methods typically estimate uncertainty over observed or instantiated geometry, limiting their ability to reason about unseen structure, while long-horizon reconstruction methods often retain redundant observations. We introduce Matisse, a training-free framework that unifies active reconstruction and keyframe selection by leveraging evidence provided by a pretrained generative 3D model. Matisse estimates Evidential Uncertainty from cross-attention evidence associated with 3D latent tokens and derives an Evidential Information Gain to guide both view acquisition and keyframe selection based on the expected reduction in posterior entropy. Matisse supports multi-object scenes through occlusion-aware, object-balanced aggregation and propagates uncertainty through intermediate latents to avoid full reconstruction during planning. Matisse reduces Chamfer distance by 12.7%, 3.8%, and 9.2% on GSO30, YCB-V, and Replica, respectively, relative to the best baseline on each dataset, and achieves a $1.50\times$ end-to-end speedup over the best active reconstruction baseline on GSO30 with the same reconstruction backend. In the GSO30 keyframe selection experiment for long-horizon reconstruction, Matisse achieves comparable Chamfer distance using 14% of the input views compared with Stream3D.

[35] Here the World in Stereo: Learning Dynamic Spatial Correspondence for Immersive Joint Video-Audio Generation cs.CVPDF

Hanmo Chen, Chengcheng Liu, Tianxiao Chen, Zheyu Zhang, Siming Zheng

TL;DR: StereoBind用运动轨迹约束立体音频声源与视觉运动对应，并提出StereoWorld-29K及StereoWorldBench评估沉浸式视听空间一致性。

Details

Motivation: 联合视频音频生成已能达到较好的语义对应和时间同步，但AR/VR及交互游戏还需要立体声音形成沉浸空间感，尤其声音位置应随对应视觉源运动而变化。

Result: StereoBind通过三种机制把视觉运动绑定到立体音频：视觉运动绑定建立声源感知的视听对应，Spatial Track Encoder编码声源绝对位置，Residual Track RoPE建模相对运动。作者构建配有运动轨迹的大规模立体声视频数据集StereoWorld-29K和评测空间一致性的StereoWorldBench。实验显示，该方法显著改善立体音频生成的空间对齐，同时保持整体视听质量；摘要未列具体数值。

Insight: 立体声沉浸感要求同步的不只是声音发生时间，还包括声源空间位置随视觉运动动态变化。显式运动轨迹、绝对位置与相对位移共同约束可补足现有联合生成模型的空间盲点。

Abstract: Recent joint video-audio generation models have achieved strong semantic correspondence and temporal synchronization. However, applications such as AR/VR and interactive gaming further require stereo audio to provide an immersive sense, which remains largely overlooked. Effective stereo audio requires the perceived sound location to evolve consistently with the motion of its corresponding visual source. We refer to this property as Dynamic Spatial Correspondence and propose StereoBind, a framework that binds visual source motion to stereo sound generation. StereoBind uses motion tracks to coordinate visual motion and stereo audio through three complementary mechanisms. Visual Motion Binding establishes source-aware audiovisual correspondence, the Spatial Track Encoder captures absolute source positions, and Residual Track RoPE models relative motion. For supervision and evaluation, we construct StereoWorld-29K, a large-scale stereo audio-video dataset with paired motion tracks, and StereoWorldBench for measuring audiovisual spatial consistency. Experiments show that StereoBind substantially improves spatial alignment in stereo audio generation over existing models while preserving overall audiovisual quality.

[36] Agentic Relative Camera Pose Estimation via Learned Ranking and Verification cs.CVPDF

Zhining Gu, Shangjie Du, Weimin Qiu, Carl Olsson, Ping Liu

TL;DR: PoseAgent根据图像对特征学习排序多个互补相机姿态估计器，并用误差验证器检查结果、失败时依次尝试次优模型。

Details

Motivation: 相对相机姿态估计有匹配、端到端回归及3D几何等方法，但宽基线、低纹理、外观变化和遮挡等条件下没有单一最优估计器。不同方法在基准及图像对上的优势互补。

Result: PoseAgent先提取场景类型等外观、语义和几何画像，排序器预测多个估计器对当前图像对的相对能力。执行排名最高的方法后，验证器估计姿态误差；若未通过，则按顺序调用低排名估计器，直到接受结果或预算耗尽。其姿态验证网络比既有模型更准确。在ARKitScenes、MegaDepth、ScanNet++和RealEstate10K上，相比各数据集最强单一估计器，AUC@5度最高提升4.2%；ARKitScenes上也超过使用相同验证与回退策略的VLM代理。

Insight: 相机估计器的能力随场景和图像对变化，固定单模型难覆盖多种挑战。学习式能力排序加误差验证可按需调用互补方法，在预算允许时提供逐级回退。

Abstract: A wide range of approaches have been developed for camera pose estimation, including correspondence-based methods, end-to-end pose regression, and recent 3D geometric foundation models. Our key observation is that no single estimator is optimal for diverse challenges, such as wide baselines, lack of texture, appearance changes, and occlusions. Further analysis reveals substantial performance variation across both benchmarks and individual image pairs, with different estimators exhibiting complementary strengths. We introduce PoseAgent, an agentic framework for relative camera pose estimation that dynamically orchestrates pose estimators through learnable ranking and verification. Given an image pair, a profiling agent first extracts appearance, semantic, and geometric features relevant to pose estimation, e.g., scene type. A learned ranking agent then predicts the relative competence of multiple pose estimators given the image-pair profile. The top-ranked estimator is executed, and its predicted pose is assessed by a learned verification agent that estimates the corresponding pose error. When verification fails, PoseAgent adaptively invokes lower-ranked estimators until a candidate is accepted or the execution budget is reached. For pose verification, our verification network predicts pose errors more accurately than prior models. For pose estimation, PoseAgent improves AUC@5 degree up to 4.2% over the strongest standalone estimator on each of ARKitScenes, MegaDepth, ScanNet++, and RealEstate10K. On ARKitScenes, PoseAgent also outperforms VLM-based agents, which include a VLM ranker with the same verifier and fallback policy. These results demonstrate the effectiveness of our learned ranking and verification.

[37] Event-Driven Refresh and Recurrence Memory to Reduce Stale Grounding in Referring Video Object Segmentation cs.CVPDF

Abu Hanif Muhammad Syarubany, Jaehyun Jang, Siwoo Lim, Seungyeon Ryu, Chang D. Yoo

TL;DR: EDRRM利用跟踪事件检测稳定场景变化后才刷新指代视频分割，并从CLIP匹配的历史锚点恢复目标重现时的身份记忆。

Details

Motivation: Sa2VA通常用少量初始关键帧定位查询目标，再依赖分割传播；在长或动态视频中，物体组成变化、干扰者进入及目标消失再出现会造成定位过时和持续误检。

Result: EDRRM组合事件驱动刷新与循环记忆，只在稳定变化点重新调用Sa2VA。刷新边界由跟踪得到的目标出生/消亡和粗粒度组成、布局变化计算EMA平滑事件分数，并施加时间约束；循环记忆则用CLIP相似度检索锚点帧，在目标重新出现时重新条件化模型。在Ref-DAVIS17、MeViS和ReVOS上，与固定窗口和FrameDiff-SSIM基线相比，方法在显著减少平均刷新调用预算时保持相当或更好J&F，并减少误检失败。跟踪、CLIP匹配及可辨识性门控的开销相对主要Sa2VA推理成本较小。

Insight: 长视频分割不必固定周期重新定位，而可依据目标组成及布局变化触发刷新。目标重现时从历史锚点恢复身份，能缓解单纯逐帧传播造成的陈旧定位。

Abstract: Referring Video Object Segmentation (RVOS) aims to produce a pixel-accurate mask sequence for an object specified by natural language. Sa2VA combines a multimodal large language model with SAM2 for grounded segmentation; however, its inference typically grounds the query from a small fixed set of initial keyframes and then relies on propagation. In long or dynamic videos, this can cause stale grounding and persistent false positives when the object composition changes (e.g., distractors enter or the target disappears/re-appears). We propose Event-Driven Refresh + Recurrence Memory (EDRRM), an enhancement that selectively re-invokes Sa2VA only at stable change points. EDRRM triggers refresh boundaries using an EMA-smoothed event score computed from tracking-derived cues (births/deaths and coarse composition/layout changes) with temporal constraints. A recurrence memory further retrieves anchor frames via CLIP similarity to re-condition the model on re-appearance events. Experiments on Ref-DAVIS17, MeViS, and ReVOS show that EDRRM achieves a competitive accuracy-efficiency trade-off relative to fixed-window and FrameDiff-SSIM baselines, maintaining comparable or superior J&F scores at substantially lower average refresh-call budgets and reducing false-positive failures. End-to-end runtime analysis further confirms that the overhead introduced by tracking, CLIP-based recurrence matching, and the identifiability gate remains modest relative to the dominant Sa2VA inference cost, thereby validating the efficiency of the proposed pipeline.

[38] Distill the Visual Evidence, Not Just the Answer: Cross-World On-Policy Distillation for Vision-Language Models cs.CVPDF

Yuanhao Sun, Huawei Ji, Jiaxin Ding, Luoyi Fu, Xinbing Wang

TL;DR: CW-OPD通过在同一场景中构造答案关键视觉证据不同的两个世界，蒸馏教师对证据改变的信念变化，而不只模仿单个最终答案。

Details

Motivation: VLM蒸馏通常只监督学生输出，视觉理解仍是隐式目标。学生即使没有依赖决定答案的视觉证据，也可能碰巧给出教师相同答案；因此需要检验模型是否会随关键证据变化而恰当地改变回答。

Result: Cross-World On-Policy Distillation（CW-OPD）为每例构造问题和场景相同、但答案关键证据不同且正确答案不同的两个视觉世界，在两种情况下分别进行在线蒸馏，并进一步蒸馏教师跨世界的信念转移。梯度分析表明该项对两个世界共有错误具有不变性，并提供单点答案匹配无法得到的纠正信号。作者提出CWBench，用跨世界配对准确率CWPA测量视觉落地一致性。Qwen3.5-4B上，CW-OPD平均比最强基线高1.2分；4B学生在CWBench上的CWPA比DeepSeek-V4.1（552B）高22.4分。

Insight: 视觉证据忠实性可通过反事实成对样例检验：只改变决定答案的证据时，输出应随之改变。蒸馏这种跨世界信念变化，比仅匹配单个答案更直接约束模型依据相关图像内容作答。

Abstract: A central goal of vision-language model (VLM) distillation is to transfer both the teacher’s language capabilities and its visual understanding. However, existing methods primarily supervise the student’s output, leaving visual understanding implicit. Our analysis reveals that a student can match the teacher’s answer without relying on the same visual evidence, raising the question: how can we ensure the student responds to the visual information that actually determines the answer? To this end, we propose \textbf{Cross-World On-Policy Distillation (CW-OPD)}, which explicitly supervises the student’s response to changes in visual evidence. For each example, CW-OPD constructs two visual worlds that share the question and scene context but differ in answer-critical evidence, yielding different answers. We perform on-policy distillation in both worlds and distill the teacher’s cross-world belief transition, encouraging the student to match not only \emph{what} the teacher predicts but also \emph{why} its prediction changes with the evidence. A gradient analysis shows that this term is invariant to errors shared by both worlds and supplies a corrective signal invisible to endpoint matching alone. In this way, CW-OPD makes reliance on the relevant visual evidence an explicit distillation target rather than an implicit consequence of output matching. To diagnose whether a model truly grounds its answers in visual evidence, we introduce CWBench, which measures cross-world consistency via Cross-World Pair Accuracy (CWPA). Experiments on Qwen3.5-4B show that CW-OPD outperforms the strongest baseline by \textbf{1.2} points on average, and the 4B student exceeds DeepSeek-V4.1 (552B) by \textbf{22.4} CWPA points on CWBench. Code is released in https://github.com/baokou-fw2/CWAD.

[39] CRAFT: Causal Responsibility and Failure Tracing in Medical Vision Language Models cs.CV | cs.AIPDF

Chunzheng Zhu, Jiaqi Zeng, Hongbo Zhao, Yihang Chen, Yijun Wang

TL;DR: CRAFT识别两组空间上分离的视觉语言注意力头，分别导致医疗VLM被误导文本覆盖视觉依据，以及证据不足时仍自信作答。

Details

Motivation: 医疗VLM日益用于临床诊断，需要理解模型如何仲裁冲突的图像与文本信号，以及为何在视觉证据不足时仍给出确定答案。现有机制分析多局限于纯文本，无法解释误导句子覆盖正确影像判断等风险。

Result: 研究将两类风险区分为仲裁失败（文本上下文覆盖视觉落地）和刹车失败（证据不足仍作答），发现它们由空间上不重叠的头群调节：仲裁头分布于中后层宽频段，刹车头集中于中后层较窄区间。CRAFT用双准则定位最小因果头集合，并以时间探针和Tuned Lens轨迹分析检验必要性与充分性。移除仲裁头显著减少冲突跟随，且对干净输入影响很小；移除刹车头则在视觉证据退化时恢复适当弃答。多医疗VQA基准和多种VLM架构实验显示，针对性调制无需重训练且可泛化。

Insight: 对医疗VLM而言，抵抗误导上下文和在证据不足时停答是两种不同因果机制，不能用单一可靠性指标概括。将对应注意力头分别定位和干预，可针对性修复且尽量保留干净场景能力。

Abstract: As vision language models are increasingly deployed in clinical diagnosis, understanding how they internally resolve competing visual and textual signals becomes a safety imperative. Existing mechanistic analyses remain confined to unimodal text and offer no explanation for why a single misleading sentence can override a correct image based diagnosis, or why a model commits to a confident answer despite insufficient visual evidence. We find that these two safety risks, arbitration failure where textual context overrides visual grounding and brake failure where the model commits without adequate evidence, are mediated by spatially disjoint attention head populations: arbitration heads form a mid-to-deep wideband reflecting cross-layer evidence competition, while brake heads concentrate in a narrow middle-to-late layer band that regulates evidence sufficiency and abstention behavior. To ground these observations in causal circuitry, we introduce CRAFT, which localizes each failure mode to a minimal causal head set via dual criteria and verifies necessity and sufficiency through temporal probes and Tuned Lens trajectory analysis. Excising arbitration heads sharply reduces conflict following with negligible degradation on clean inputs, while excising brake heads restores appropriate abstention under degraded visual evidence. The two interventions target spatially disjoint head sets and produce distinct corrective effects, underscoring the mechanistic separability of the failure modes. Experiments across multiple medical VQA benchmarks and VLM architectures validate both the localization and interventions, demonstrating that the identified heads causally drive each failure mode and that targeted modulation generalises without retraining. The code is available at GitHub repository.

[40] Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video cs.CV | cs.AI | q-bio.NCPDF

Chang-Bae Bang, Hyungjin Chung, Byung-Hoon Kim

TL;DR: 研究比较视频扩散模型内部表示与观看视频时人类视觉皮层fMRI响应的对齐，发现生成未来帧的表示比重建已观察视频更贴合高阶视觉皮层。

Details

Motivation: 以往模型—脑表征对齐研究多关注模型如何处理已经看到的视觉刺激，而人脑也会根据观察预测即将出现的内容。作者假设未来帧生成表征更符合人类视觉预测机制。

Result: 研究比较自回归视频扩散模型及其非自回归基础模型的内部表示。模型内分析显示，自回归模型用于未来视频生成的表示比重建已观察视频的表示更贴合视觉皮层；跨模型比较也发现未来生成表征优于基础模型的观察重建表征。观察视频重建的对齐集中于低阶视觉皮层，未来视频生成对齐则集中于高阶视觉皮层。人类行为实验中，参与者也更偏好放大与视觉皮层对齐更好的单层贡献后生成的视频。

Insight: 人类视觉加工不仅编码眼前画面，也预测未来刺激；生成模型的未来帧表示可能更接近这一预测性脑功能。模型—脑对齐信号还可作为选择生成层特征的依据，并与人类偏好相联系。

Abstract: Studying the alignment between the internal representations of vision models and the responses of the visual cortex to the same observed visual stimuli has enabled us to better understand human visual processing. However, studies so far have largely overlooked the fact that the human brain not only processes observed visual stimuli, but also predicts upcoming stimuli based on what has been observed. Accordingly, we hypothesize that internal representations for generating future video frames are better aligned with the predictive nature of human visual processing than representations of the observed video itself. To this end, we compare the alignment between human video-watching fMRI responses in the visual cortex and the internal representations from two types of video diffusion models, an autoregressive (AR) model and its non-AR base model. We first conduct a within-model analysis of the AR video diffusion model and show that the representations for future video generation align better with the visual cortex than the representations of the observed video. We then compare the internal representations of the AR model with those of its non-AR base model and again show that the representations for future video generation align better with the visual cortex than the representations for observed video reconstruction by the base model. Specifically, the alignment of observed video reconstruction is concentrated in lower-order visual cortex, whereas that of future video generation is concentrated in higher-order visual cortex. Finally, we show in a human behavioral experiment that humans prefer videos generated by amplifying the contributions of individual layers that align better with the visual cortex.

[41] DecoMoE: Decoupling Visual Propagation and Expert Computation for Efficient Multimodal MoE Inference cs.CVPDF

Xudong Tan, Peng Ye, Ming Xie, Chenyu Huang, Yaoxin Yang

TL;DR: DecoMoE同时压缩VLM推理中的视觉传播和专家计算：按输入自适应决定视觉token退出层，并按文本路由质量裁剪后续MoE专家。

Details

Motivation: 多模态MoE模型处理长视觉token序列时，每层重复付出注意力、路由、分发及专家MLP成本。既有方法通常只压缩token或专家一维，未利用视觉传播深度差异和文本专家路由重复性这两类互补冗余。

Result: 样本自适应视觉边界SAVB预测输入相关的视觉退出层，到该层后移除视觉token块。路由校准专家前缀RCEP离线按文本token路由质量重排专家，并从预测退出层起在每个MoE层仅保留覆盖目标路由质量的最短连续专家前缀。在Qwen3-VL-MoE和InternVL3.5-30B-A3B六个基准上评估；Qwen3-VL-MoE保留稠密基线97.91%表现，计算从27.06降到16.73 TFLOPs，延迟从0.44降到0.26秒，加速1.69倍。

Insight: 视觉token通常无需贯穿所有层，而不同层的专家也不必一律完整激活。根据样本传播需求和路由质量同时压缩两维，可在保留接近稠密性能时获得更大推理收益。

Abstract: Multimodal mixture-of-experts (MoE) models combine sparse expert activation with visual-language capabilities, yet their inference remains costly because long visual-token sequences repeatedly incur attention, routing, dispatch, and expert-MLP computation. Existing methods typically compress either the token or expert dimension, leaving redundancy along the other. Our analysis reveals two complementary regularities: the depth required for visual propagation varies across inputs, while text-token routing exhibits concentrated and recurrent expert-importance patterns. Based on these observations, we propose DecoMoE, a two-dimensional structured compression framework that decouples visual propagation from expert computation. The Sample-Adaptive Visual Boundary (SAVB) predicts an input-dependent visual-exit layer at which the visual-token block is removed. The Routing-Calibrated Expert Prefix (RCEP) reorders experts offline using text-token routed mass and, from this predicted exit layer onward, retains at each MoE layer the shortest contiguous prefix covering a target routed-mass fraction. We evaluate DecoMoE on Qwen3-VL-MoE and InternVL3.5-30B-A3B across six benchmarks. On Qwen3-VL-MoE, DecoMoE retains 97.91% of dense-baseline performance while reducing computation from 27.06 to 16.73 TFLOPs and latency from 0.44 to 0.26 seconds, yielding a 1.69x speedup. Code will be available at https://github.com/ShawnTan86/DecoMoE.

[42] FrameMorrow: Future-guided Frame Selection with Prospective Tokens for Long-Horizon Video Generation cs.CVPDF

Bo Yin, Xiaobin Hu, Jiaqi Zhao, Shuicheng Yan

TL;DR: FrameMorrow预测描述未来信息需求的少量前瞻token，再据此从长视频生成历史中选择显式帧，避免只按当前相关性保留内容。

Details

Motivation: 长时视频生成的历史不断变长，全部保留既昂贵又冗余。与当前内容相关的信息未必对未来生成有用，当前看似次要的历史之后也可能变得重要。

Result: FrameMorrow作为前瞻帧选择器，先预测未来会变得重要的少量前瞻token，再用它们在历史中检索相关帧；无需生成完整未来。选择结果是显式历史帧而非特定模型的内部状态，因此可低成本即插即用接入包括闭源模型在内的不同生成器。在五个基准、11个生成模型上评估，覆盖长视频生成、交互生成和动作条件世界模型；实验显示长程一致性、视觉质量及动作对齐均持续改善。

Insight: 历史选择应面向未来生成可能需要什么，而不是只复用当前片段的语义相似性。紧凑的未来需求表示足以指导检索，也让方法不依赖特定生成器内部状态。

Abstract: Long-horizon video generation requires models to effectively leverage an increasingly long generation history. As the generated history grows, retaining all previous content becomes increasingly expensive and redundant, making effective historical selection essential. Existing approaches often determine historical relevance based on the current content. However, information relevant to the present is not necessarily useful for future generation, while seemingly less relevant history may become important later. Our key insight is that historical information should be selected according to its relevance to future information needs. Capturing these needs does not require generating the full future; instead, a compact representation of what becomes important next is sufficient to guide historical selection. Building on this insight, we propose FrameMorrow, a prospective frame selector that predicts a small set of prospective tokens representing future information needs and uses them to identify relevant information from history. FrameMorrow selects explicit historical frames rather than model-specific internal states, enabling plug-and-play integration across diverse generators, including closed-source models, with little additional inference cost. We evaluate FrameMorrow across five benchmarks and 11 generative models spanning long-video generation, interactive generation, and action-conditioned world models. Extensive experiments demonstrate consistent improvements in long-range consistency, visual quality, and action alignment across diverse generation settings.

[43] Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation cs.CVPDF

Zhijie Shen, Chunyu Lin, Shuai Zheng, Feng Li, Runmin Cong

TL;DR: 方法先将等距柱状全景特征映射到近似均匀的Fibonacci球面图推理，再用球面上下文调制ERP像素特征进行稠密深度预测。

Details

Motivation: 等距柱状投影（ERP）常用于全景深度估计，但空间变形随位置变化，导致几何一致特征建模困难。直接在ERP平面做关系推理会过度表示高度拉伸区域，且全分辨率图结构计算昂贵。

Result: 作者提出Fibonacci球面图FSG，把ERP特征提升到球面上近似均匀分布的Fibonacci节点，并通过互补球面邻域捕获局部和长程依赖。节点近均匀覆盖球面，减少拉伸区域在关系建模中的过度权重；只在紧凑节点集处理也避免全ERP分辨率图计算。球面上下文条件模块SCC再用增强球面表示自适应调制稠密ERP特征，引导像素对齐深度预测。三个基准实验中，深度精度持续优于现有方法；摘要未给出具体指标。

Insight: 全景深度估计可把几何关系推理放在近均匀球面坐标中，再将结果回注到ERP像素空间预测，兼顾几何一致性与稠密输出。

Abstract: The equirectangular projection (ERP) is widely used for panoramic depth estimation, but its spatially varying distortion makes geometry-consistent feature modeling challenging. We revisit panoramic depth estimation by decoupling contextual modeling in native spherical space from dense ERP prediction. To this end, we propose a Fibonacci Spherical Graph (FSG) as an intermediate reasoning space to lift ERP features onto quasi-uniform Fibonacci nodes on the sphere and capture local and long-range dependencies through complementary spherical neighborhoods. The resulting spherical discretization distributes graph nodes approximately uniformly over the spherical surface, reducing the over-representation of highly stretched regions during relational modeling. Operating on a compact set of Fibonacci nodes also avoids the computational burden of constructing and processing a graph at full ERP resolution. To bridge spherical reasoning and dense prediction, we propose a Spherical Context Conditioning (SCC) module that adaptively modulates dense ERP features with the enhanced spherical representation, allowing spherical context to guide pixel-aligned depth prediction. Extensive experiments on three benchmarks demonstrate that the proposed method consistently achieves superior depth accuracy over existing approaches.

[44] MEMO: Multi-Level Entity-Aware Memory for Streaming Video Understanding cs.CVPDF

Yinying Li, Yuqian Fu, Yulin Dai, Jingyu Gong, Tianwen Qian

TL;DR: MEMO以多层实体级结构化记忆索引无界视频流，并按问题选择性回取保留的高分辨率视觉证据。

Details

Motivation: 流式视频理解需在无限增长的视觉历史中保留丰富语义。现有方法主要扩大容量，压缩为固定表示或扩展到GPU外存储，但常用全局或粗粒度表示，损失细节。

Result: MEMO进行多层感知，联合捕获全局语义、实体动态和空间结构，并把视频分成语义连贯片段。每段形成结构化记忆：轻量全局及实体表示用作检索索引，对应高分辨率视觉内容另行保留供按需访问。推理时按问题检索记忆并有选择地回忆相关视觉证据。方法无需训练，可即插即用适配现有多模态大模型。在StreamingBench和OVO-Bench上，MEMO持续改善多个基础模型并达到当前最佳表现；摘要未给具体分数。

Insight: 扩大记忆容量不能解决粗表示丢失细节的问题；将轻量实体索引与原始高分辨率内容分开保存，可兼顾长时检索效率与证据精度。

Abstract: Streaming video understanding requires models to process unbounded visual streams while preserving rich visual semantics across vast temporal horizons, posing a fundamental challenge for memory modeling. Existing approaches primarily focus on increasing memory capacity, either by compressing historical information into fixed-size representations or by extending storage beyond GPU memory. However, these methods largely rely on global or coarse-grained representations, inevitably losing fine-grained visual information. In this work, we argue that streaming video memory should explicitly encode structured and semantically meaningful representations, particularly at the entity level. To this end, we propose MEMO, a novel framework that models streaming video through multi-level, entity-aware structured memory. MEMO performs multi-level perception to jointly capture global semantics, entity dynamics, and spatial structures, partitioning streaming video into semantically coherent chunks. Each chunk is organized into a structured memory, where lightweight global and entity-level representations serve as retrieval indices, while the corresponding high-resolution visual content is retained separately for on-demand access. At inference time, MEMO performs query-specific retrieval over the structured memory and selectively recalls relevant visual evidence for downstream reasoning. Notably, MEMO is training-free and plug-and-play with existing multimodal large language models. Extensive experiments on StreamingBench and OVO-Bench demonstrate that MEMO consistently improves multiple base models and achieves state-of-the-art performance.

[45] From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning cs.CVPDF

Jialu Pi, Yanan Ma, Weijie Chen, Owen Crystal, Shubham Trivedi

TL;DR: 因果强化学习框架将胸片、临床病史及证据选择整合用于主要不良心血管事件风险预测，并把推理与风险判断解耦。

Details

Motivation: 主要不良心血管事件是全球重要死亡原因，常规临床数据提供机会性筛查路径。胸片含潜在心血管生物标志，病史可补充患者上下文，但现有医学VLM多优化放射学影像解释而非预后推理。

Result: 框架用于胸片与医生撰写病史的多模态MACE预测，包含职责分离的双LLM架构（推理与风险预测分开）、用于证据选择和推理优化的双动作因果RL策略，以及学习紧凑多模态表示的因果token剪枝。在内部队列、急诊队列和外部MIMIC数据集上，模型持续超过单模态基线及先进医学VLM，AUROC分别为0.720、0.760和0.845。推理质量也提升，GREEN分数及专家偏好更高，同时在不同患者群体上保持预测表现。

Insight: 临床预后建模需要将影像信号与病史证据联合起来，而不是把医学VLM只用于影像描述。职责解耦、因果证据选择和紧凑token表示共同支持可评估的风险推理。

Abstract: Major adverse cardiovascular events (MACE) remain the leading cause of mortality worldwide. Opportunistic screening using routinely acquired clinical data offers a scalable approach for identifying high-risk individuals before acute events occur. Although chest X-rays (CXRs) capture latent cardiovascular biomarkers and clinical histories provide complementary patient context, existing medical vision-language models are primarily optimized for radiology interpretation rather than prognostic reasoning. We propose a causal reinforcement learning framework for multimodal clinical reasoning that integrates CXRs and physician-authored clinical histories for opportunistic MACE prediction. The framework introduces (1) a role-decoupled dual-LLM architecture that separates reasoning from risk prediction, (2) a dual-action causal reinforcement learning policy for evidence selection and reasoning optimization, and (3) causal token pruning to learn compact multimodal representations. Evaluated on an internal cohort, an emergency department cohort, and the external MIMIC dataset, the proposed framework consistently outperformed unimodal baselines and state-of-the-art medical vision-language models, achieving AUROCs of 0.720, 0.760, and 0.845, respectively. It also substantially improved reasoning quality, achieving higher GREEN scores and higher expert preference while maintaining robust predictive performance across diverse patient populations.

Zeyu Wang, Mingyu Ge, Haiyu Song, Haoran Duan

TL;DR: 论文将多模态图像融合监督从空间像素域转移到学习得到的关系空间，并以共享性、主导性和协调范围明确编码融合目标。

Details

Motivation: 多模态融合需保留各模态互补信息、整合共享内容并协调模态冲突，但没有真实融合图像可作监督。既有方法常用源图或梯度变化作为替代真值，可能造成像素折中及模态偏置。

Result: 方法用冻结预训练表示模型作为信息提供者，并训练特征适配器把异质DINO和CLIP特征对齐到统一监督空间。适配器估计共享性、主导性和协调半径三类关系参数，分别定义符合融合目标的损失；再为适配器设计自监督对比排序目标，并与融合网络交替优化。在不同主流融合骨干上均取得显著提升，表明关系空间监督比仅直接逼近源图更符合融合目标；摘要未列具体指标。

Insight: 融合并非将两幅图逐像素折中，而需判定信息哪些共享、哪些模态占主导、冲突范围如何协调。把这些关系参数作为监督目标，可减少像素域代理损失与任务目的不一致。

Abstract: Multi-modal image fusion (MMIF) aims to form a single image by integrating shared information, preserving complementary cues, and coordinating cross-modal conflicts across modalities. However, due to the absence of ground-truth fused images, existing MMIF supervision commonly uses spatial-domain sources or gradient variants as surrogate ground truth, making the supervision mechanism inherently misaligned with the goal of MMIF and causing pixel-level compromise or modality bias. To address this, we propose a relation-constrained supervision paradigm that moves fusion supervision from the spatial domain to a learned relation space. Rather than relying solely on direct source approximation, we further leverage frozen pretrained representation models as information providers and design a learnable feature adapter to align heterogeneous DINO and CLIP features into a unified supervision space. The adapter infers three relation parameters, namely sharedness, dominance, and coordination radius, which define three losses corresponding to the MMIF’s goal. To make this space reliable, we devise a self-supervised contrastive ranking objective tailored to the adapter and couple it with the fusion network through alternating optimization. Extensive experiments show that the proposed supervision space yields significant gains regardless of which mainstream backbone the fusion network adopts, offering a supervision paradigm better aligned with the goal of MMIF. Code: github.com/GMY628/RCS-Fusion.

[47] Mitigating Object Hallucination in Large Vision-Language Models via False Discovery Controlled Visual Data Splitting cs.CVPDF

Chang Liu, Yu Tian, Rui Xie

TL;DR: CORAL通过对称扰动视觉输入构造镜像统计量，估计图像级伪目标发现率并设定数据驱动阈值，降低LVLM多物体幻觉。

Details

Motivation: LVLM会生成视觉输入不支持的多个物体，常由解码时视觉不确定性引发。现有对比信号方法多依赖启发式，缺少对整幅图误报比例的原则化控制。

Result: 训练免费的CORAL采用不确定性感知视觉数据切分，并从成对、对称扰动输入计算镜像统计量，以量化解码中的视觉对比；再估计伪物体预测并设定数据驱动阈值，控制每张图预期错误发现比例，同时尽量保留真实落地目标的检出能力。方法可适配多个LVLM，无需重训或额外标注。多个基准和指标实验显示，CORAL持续超过先进方法，实现更可靠的幻觉控制；摘要未列具体数值。

Insight: 图像级多重幻觉控制可转化为错误发现率控制问题，而非用单一对比启发式惩罚所有可疑物体。对称扰动提供镜像统计量，用于估计哪些预测更可能是由不确定性造成的假发现。

Abstract: Multiple object hallucination, where large vision-language models (LVLMs) generate objects not supported by the visual input, is a persistent challenge caused by visual uncertainty during decoding. Existing methods reduce hallucinations using contrastive signals, but they rely on heuristics and lack principled control of false positives at the image level. To address this, we propose False Discovery Rate-COntRol of HALlucination (CORAL), a training-free framework that models visual uncertainty using an uncertainty-aware visual data splitting strategy and leverages mirror statistics to quantify visual contrast during decoding. By computing mirror statistics from paired, symmetrically perturbed visual inputs, CORAL estimates spurious object predictions and sets a data-driven threshold to control the expected fraction of false discoveries per image, suppressing hallucinations while retaining high power for truly grounded objects. The framework is flexible, supports multiple LVLMs, and mitigates hallucinations without retraining or supervision. Extensive experiments on multiple benchmarks with several evaluation metrics demonstrate that CORAL consistently outperforms state-of-the-art methods, providing more reliable and robust hallucination control. Code is available at: https://changliu1993-cl.github.io/CORAL/

[48] PARK: Accurate Block Retrieval for Sparse Attention in Video Diffusion Transformers cs.CVPDF

Yun Dai, Jiarui Wen, Huiping Zhuang, Cen Chen, Ziqian Zeng

TL;DR: PARK通过保留单个查询的注意力偏好、按当前查询变换键后聚类，改进视频扩散Transformer稀疏注意力的块检索准确性。

Details

Motivation: 视频DiT全注意力成本随token数平方增长，稀疏注意力通过检索重要块降低计算，但错误检索会损害生成质量或带来无效计算。按块平均query和key的现有方法存在两种失配。

Result: 作者指出，先平均query再做softmax会丢失各query自身偏好；在原始key空间做欧氏聚类，也可能把对当前query的QK分数差异很大的key归到一组。训练免费的PARK保留每个原始query，独立归一化其对各key块的注意力，再在query块内平均分布；同时利用当前query变换key后聚类，使得分相近的key归组。融合GPU内核进一步降低检索开销。在HunyuanVideo和Wan实验中，PARK提高块检索准确率、保持生成质量并加速推理，在对比稀疏注意力方法中质量—效率权衡最佳。

Insight: 稀疏注意力块检索应保留query间异质性，并在当前query相关的QK几何中聚类key。两项修正能减少平均表示造成的排序失真，提升效率而不明显牺牲生成质量。

Abstract: Diffusion Transformers (DiTs) have become a dominant architecture for video generation, but their efficiency is limited by the quadratic complexity of full attention. Sparse attention reduces this cost by retrieving important blocks and computing attention only within them, but inaccurate retrieval can either degrade generation quality or yield unnecessary computation. We identify two retrieval mismatches in methods that retrieve blocks using the averaged representations of query and key blocks: (i) query-side aggregation mismatch, where averaging queries before Softmax fails to preserve their individual attention preferences, and (ii) key-side clustering metric mismatch, where standard Euclidean clustering in the original key space can group keys with dissimilar QK scores under the current query, so their average representation may not accurately represent how the current query scores individual keys. These mismatches can lead to inaccurate block retrieval. To address these mismatches, we propose PARK, a training-free sparse attention method for accurate block retrieval. PARK retains every original query, independently normalizes its attention over key blocks, and then averages these distributions within each query block. It also uses information from the current queries to transform keys before clustering, so that keys receiving similar QK scores are grouped together. A fused GPU kernel further reduces the overhead of block retrieval. Experiments on HunyuanVideo and Wan demonstrate that PARK improves block retrieval accuracy and preserves generation quality while accelerating inference, achieving the best quality-efficiency trade-off among the compared sparse attention methods.

[49] MeshOctave generates meshes via cascading resolution transitions cs.CVPDF

Junkai Lin, Tianhao Zhao, Hang Long, Huipeng Guo, Jielei Zhang

TL;DR: MeshOctave以二进制空间网格分辨率定义网格生成层级，用无序顶点子集和离散结构token完成并行的逐尺度细分与拓扑修复。

Details

Motivation: 显式拓扑、紧凑且具艺术风格的网格常由自回归模型逐token生成，顺序成本高；连续流模型又依赖启发式连接解码。已有下一尺度生成仍基于逐步简化网格，并须顺序逆转，步骤随面数线性增长。

Result: MeshOctave将尺度定义为二进制空间网格分辨率，粗化时合并落入同一体素的顶点并继承连接关系；反向split-and-rewire决定每个粗面实例化哪些八分体子顶点，并用离散结构token修复局部连接。每面操作无需序列化，各尺度作为无序集合，每次增加一比特坐标精度，支持动态长度网格与自适应分辨率。作者训练以尺度为条件的掩码均匀离散扩散模型学习细分与重连操作。实验中几何保真度和拓扑有效性显著超过强基线，并可自然扩展至网格细分任务；摘要未给具体分数。

Insight: 网格生成的层级可以由空间分辨率而不是顺序简化步骤定义，从而恢复尺度内并行性。将顶点细分与局部连接修复表示为无序离散操作，也支持按需控制网格复杂度。

Abstract: Generating compact, artist-style meshes with explicit topology typically relies on autoregressive models which incur prohibitive sequential per-token costs, or continuous flow models that depend on heuristic connectivity decoders. Next-scale generation paradigms offer a compelling alternative by enabling parallel intra-scale token prediction and coarse-to-fine refinement from global structure to local topology; yet, existing methods derive hierarchical scales via progressive mesh simplification and invert them sequentially. This eliminates intra-scale parallelism and scales generation steps linearly with face count. In this paper, we propose MeshOctave, which instead defines scale through dyadic spatial grid resolutions, framing coarsening as a deterministic collapse that merges vertices sharing a voxel cell and inherits connectivity. Its inverse operation, split-and-rewire, determines which octant sub-vertices are instantiated for each coarse face and resolves local connectivity using discrete structural tokens. These per-face operations require no serialization, each scale transition is modeled as an unordered set that adds one bit of coordinate precision, naturally supporting dynamic-length meshes and adaptive resolution refinement. We construct a scale-conditioned masked-uniform discrete diffusion model to learn split-and-rewire operation from resolution collapse hierarchies. MeshOctave outperforms strong baselines in geometric fidelity and topological validity by a non-trivial margin, while supporting adaptive resolution refinement and extending naturally to mesh subdivision tasks.

Zeyu Wang, Jiayu Wang, Haiyu Song, Haoran Duan

TL;DR: SIDFusion把多模态图像融合的特征分解从缺乏真值的二维图像监督改写为积分约束的一维信号级自监督优化。

Details

Motivation: 融合方法希望将源图分解为共享和模态独有特征，但没有真实分解特征图作为标签。常见方法拼合多个图像级指标作损失，这些指标对纹理、边缘和轮廓等耦合属性覆盖不全且可能彼此冲突。

Result: 作者提出由积分驱动的一维信号级自监督分解范式，用一维信号形式计算积分约束，以原始信号与共享信号之间的积分面积作为分解器优化目标，从而得到更清晰稳定的目标。模型分两阶段训练：第一阶段同时进行积分驱动的信号级分解和保结构的图像级重建预训练；第二阶段融合模态独有特征，并与共享特征共同重建融合图像。在代表性MMIF任务上达到先进表现；摘要未列具体数值。

Insight: 将不明确的多指标像素损失转成信号积分面积约束，可为“共享信息”提供更直接的自监督目标。分解预训练后再做模态特有信息融合，避免在单阶段中混淆分解与合成。

Abstract: Multimodal image fusion (MMIF) aims to integrate complementary information from different modalities into a high-quality fused image and support downstream tasks. Recently, feature decomposition has become an important paradigm by separating source images into common and modality-specific unique features. However, existing methods lack clear supervision because ground-truth (GT) decomposition feature maps are unavailable. They usually combine multiple image-level metrics as losses, which are inherently incomplete and may conflict since each pixel couples attributes such as texture, edge, and contour. To address this, we propose a 1D signal-level self-supervised feature decomposition paradigm. Our core insight is to reformulate feature decomposition from unclear 2D image-level supervision into an integral-driven 1D signal-level optimization problem. This objective-level reformulation uses the 1D signal form to compute the integral constraint. The decomposer is optimized by the integral area between common and original signals, enabling more stable optimization with a clear optimization objective. Our model follows a two-stage SSL framework. Stage I designs dual pretext tasks for integral-driven decomposition at the signal level and structure-preserving reconstruction at the image level. Stage II fuses unique features and combines them with common features to reconstruct the fused image. Experiments on representative MMIF tasks show state-of-the-art (SOTA) performance. Code: github.com/Wangjiayu0512/SIDFusion.

[51] Frame Differential On-Policy Self-Distillation for Video Reasoning cs.CVPDF

Haiying He, Xin Zheng, Shaoli Hu, Shijun Xiao, Xuanhe Liu

TL;DR: FD-OPSD在训练阶段通过比较同一回答在稀疏和密集帧观察下的token偏好，把密集视觉证据蒸馏给稀疏帧视频推理策略。

Details

Motivation: 视频推理的强化学习通常使用固定帧预算；增加帧数使自回归rollout昂贵，帧太少又可能漏掉短暂事件和细节。

Result: Frame Differential On-Policy Self-Distillation（FD-OPSD）比较同一采样回答在稀疏帧和密集帧视图下的token级偏好，并蒸馏由帧数差异产生的信号，无需外部教师或密集帧自回归rollout。训练仍使用稀疏帧rollout，推理流程不变。在Qwen2.5-VL-7B、Qwen3-VL-4B和六个视频推理基准上，对16、32、64帧评估设置，FD-OPSD总体平均表现高于各自最强GRPO、T-GRPO或Video-KTR基线；摘要未给具体增益数值。

Insight: 密集观察可作为训练时特权证据，把有用视觉信息迁移给稀疏帧策略，而部署时仍可保持低帧数。token级视图差异蒸馏避免了昂贵的密集自回归采样。

Abstract: Reinforcement learning (RL) has substantially improved the reasoning ability of multimodal language models through verifiable rewards and increasingly fine-grainedvisual or temporal credit assignment. In video reasoning, however, current RL methods typically train with a fixed sparse frame budget: increasing the number of frames makes autoregressive rollouts expensive, while too few frames may miss temporally localized events and fine-grained visual details. We present \textbf{Frame Differential On-Policy Self-Distillation (FD-OPSD)}, which transfers the useful evidence of dense frame observations to a sparse frame policy during RL training. FD-OPSD compares the policy’s token level preferences for the same sampled response under sparse and dense views, and distills the resulting frame differential signal without an external teacher or dense autoregressive rollout. The method preserves sparse-frame rollouts and leaves inference unchanged. Across Qwen2.5-VL-7B and Qwen3-VL-4B on six video reasoning benchmarks, FD-OPSD yields higher overall average performance than the strongest corresponding GRPO, T-GRPO, or Video-KTR baselines across the 16, 32, and 64 frame evaluation settings. These results show that dense visual evidence can be transferred selectively during training through token level self-distillation while retaining sparse frame rollouts and unchanged inference.

[52] BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggers cs.CV | cs.LGPDF

Zhihang Wu, Zhongqi Wang, Jie Zhang, Fengming Gu, Shiguang Shan

TL;DR: BadAction通过在交互式视频生成训练样本中植入预设动作模式触发器，令后门模型忽略后续用户动作并输出冻结未来帧。

Details

Motivation: 交互式视频生成模型可依据用户动作控制画面，但其安全风险尚少系统研究。攻击者若能操纵动作输入，可能破坏模型最核心的交互响应能力而不影响正常使用表现。

Result: BadAction在后门样本动作序列中加入特定运动模式，并将其关联到静态目标视频；触发后模型生成不再响应后续用户动作的冻结未来帧，同时正常动作序列下保持行为正常。作者还研究动作、文本和图像联合投毒的更隐蔽多模态触发方式。实验平均攻击成功率：纯动作触发91.0%，多模态触发80.4%。多种防御评估显示攻击可绕过现有后门检测，揭示交互式视频生成流水线的安全缺口。

Insight: 交互式生成的后门可以针对动作控制通路，而不只是操纵静态图像或文本输出。攻击在保持正常输入行为的同时冻结响应，说明需要专门测试动作条件与跨轮次响应是否仍有效。

Abstract: Interactive video generation (IVG) models have achieved remarkable progress in producing controllable visual content guided by user-defined actions, yet their security vulnerabilities remain largely unexplored. In this paper, we present the first systematic study of backdoor attacks against the interactivity of IVG models. Based on this attack surface, we propose BadAction, which leverages action-guided triggers to achieve the attack. Specifically, BadAction implants predefined motion patterns into the action sequences of backdoor samples and associates them with a static target video. Once triggered, the backdoored model generates frozen future frames that no longer respond to subsequent user actions, while preserving normal behavior on benign action sequences. In addition, we explore a stealthier attack in which multimodal triggers jointly poison action, text, and image inputs. Experiments show that BadAction achieves average attack success rates of 91.0% with action-only triggers and 80.4% with multimodal triggers. Moreover, extensive defense evaluations show that BadAction successfully bypasses existing backdoor detection methods, revealing a critical security gap in the interactive video generation pipeline. Project page: https://wsad55.github.io/badaction01/.

[53] TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localization cs.CV | cs.AIPDF

JinYoung Kim, Geonho Kim, GiJeong Park, Geonu Lee, YoungJoon Yoo

TL;DR: TED在适配CLIP异常检测器的异常提示分数中分解真实缺陷证据与被误判的困难正常区域证据，以提升域偏移下的像素级定位。

Details

Motivation: CLIP异常检测适配后灵敏度提升，并不代表局部证据更可靠；域变化时模型常同时给真实缺陷和复杂正常区域高异常分。问题在于局部分数规则没有区分缺陷支持与困难正常样本造成的假阳性。

Result: Text-Axis Evidence Decomposition（TED）后处理比较含糊响应分别受到源缺陷patch和被误认为异常的源正常patch支持的程度，比较依据是模型正常/异常文本响应。它不改骨干和提示，也无需目标域训练；可直接作为原始VLM的免训练分数，也可作为适配CLIP-AD的源域校准残差修正。跨冻结VLM骨干时，像素定位显著优于原始提示相似度；跨适配模型，在多数像素级设定上超过P-AUROC、P-PRO和P-AP。困难假阳性竞争越强，平均定位增益越大：低竞争约+5.0，中/高竞争约+10.9。

Insight: 异常灵敏度高并不保证定位证据可信，正常但视觉复杂的区域必须作为明确竞争解释。与困难正常patch比较文本轴证据，可从现有多模态表示中恢复缺陷线索。

Abstract: CLIP is a powerful vision-language model, but it was not designed for fine-grained defect localization; CLIP-based anomaly detectors therefore adapt it with prompts or lightweight modules to increase defect sensitivity. We show that stronger sensitivity does not necessarily make local evidence reliable: under domain shift, adapted CLIP-AD models often assign high anomaly scores to both true defects and visually complex normal regions. The issue is not simply missing defect information, but a local scoring rule that decodes defect and hard-normal evidence, having the same anomaly evidence. We propose TED (Text-Axis Evidence Decomposition), a post-hoc scoring method that asks whether each ambiguous response is better supported by source defect patches or by source normal patches mistaken as anomalous. TED compares these supports under the host’s normal-versus-anomaly text response, leaves the backbone and prompts unchanged, and requires no target-domain training. It works as a train-free score for raw VLM backbones or as a source-calibrated residual correction for adapted CLIP-AD hosts. Across frozen VLM backbones, TED substantially improves pixel-level localization over raw prompt similarity; across adapted hosts, it improves most pixel-level settings over P-AUROC, P-PRO, and P-AP. Gains are largest under stronger hard-FP competition, with mean localization gain increasing from +5.0 in low-competition regimes to about +10.9 in mid/high-competition regimes. These results suggest that recoverable defect evidence can already exist in pretrained multimodal representations, but reliable localization requires decoding it against hard-normal competitors. Code will be released at TED GitHub repository.

[54] TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection cs.CVPDF

Bo-Yuan Cheng, Kuan-Yu Chen, Po-Han Huang, Jeng-Lin Li, Jian-Jiun Ding

TL;DR: TSMD用时序缺失、整条模态缺失及混合dropout模拟高亮检测中的输入缺失，并以点误差、视频相关性和峰值排序联合训练。

Details

Motivation: 多模态视频高亮检测通常假设视觉、音频和文本流持续可用，但实际可能局部缺帧或整种模态完全中断。常用MSE与高亮片段的峰值特性及评测指标也不匹配。

Result: TSMD提出时序dropout、流级dropout及混合dropout三种训练变体，通过结构化缺失模拟提升鲁棒性，联合使用逐点MSE、逐视频Pearson相关和面向峰值的RankNet损失。在MoSu和Mr. HiSum上，50%独立时序删除条件下，TSMD-Temporal的mAP@15比TripleSumm分别高7.06和3.41分；整流缺失时TSMD-Stream最好。TSMD-Mix保留两种单独策略的多数互补收益，在评估的时序和整流缺失条件中排名第一或第二。

Insight: 缺帧与整模态故障是不同缺失机制，需要相应的数据增强和训练目标。高亮检测既要逐时刻贴近标签，也要保留视频级排序和突出峰值。

Abstract: Existing multimodal video highlight detectors typically assume that visual, audio, and textual streams are continuously available. In practice, however, inputs may suffer from localized frame missingness or complete-stream outage. We formulate this robustness challenge along two dimensions: temporal missingness, where frames are missing independently in each modality, and stream-level missingness, where one modality is unavailable throughout a video. Moreover, we find that the mean squared error (MSE) loss is misaligned with both the evaluation metrics and the peak-driven nature of highlights. Therefore, we propose Temporal-Stream Modality Dropout (TSMD), which combines structured missingness simulation with a joint objective comprising pointwise MSE, per-video Pearson correlation, and peak-oriented RankNet loss terms. TSMD has three variants: temporal, stream-level, and mixed dropout. On the MoSu and Mr. HiSum datasets, TSMD-Temporal improves mAP@15 by 7.06 and 3.41 points over TripleSumm under 50% independent temporal removal, whereas TSMD-Stream performs the best under complete-stream removal. TSMD-Mix retains most of these complementary benefits and ranks the best or the second-best across the evaluated temporal and stream-level conditions.

[55] Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection cs.CVPDF

Zhiya Tan, Jing Huang, Changtao Miao, Lin Tan, Xin Zhang

TL;DR: ATAR将22种取证工具编排进双流多轮推理，联合检查语义异常与低层伪造痕迹，并通过分阶段训练产生有依据的图像伪造解释。

Details

Motivation: 传统伪造检测常只输出二元分数或像素掩码；部分MLLM方法则在预定分类后补写解释，而非真正依据证据推理。作者借鉴司法取证流程，目标是自动检测、定位并解释伪造。

Result: ATAR整合七个互补领域的22种专业工具。双流取证推理分别进行高层语义异常分析（放大可疑区域细查）和低层伪造痕迹分析（调用工具获取客观证据）。训练包含通用经验SFT阶段的自动师生多轮工具轨迹生成，以及取证场景RL阶段的工具先验课程（逐步从引导探索转向自主控制）和结构化证据奖励。在IMDL六个零样本基准上，平均图像级F1为78.5%，超过最强MLLM基线11.8个百分点；在其他深伪、DMDL和AIGC检测任务上与专用检测器有竞争力，并生成更忠实、有证据支撑的解释。

Insight: 伪造检测应并行考察语义不一致和低层图像痕迹，且将工具证据纳入推理过程，而不是事后解释分类结果。分阶段的工具课程和过程级证据奖励有助于训练可审计取证链。

Abstract: Conventional image forgery detection methods produce binary scores or pixel-level masks without interpretable evidence, while recent multimodal large language model (MLLM)-based approaches generate post-hoc explanations of predetermined classification results rather than reasoning from evidence. Inspired by the forensic workflow of human judicial experts, we propose Agentic Tool-Augmented Reasoning (ATAR), a framework integrating 22 specialized forensic tools across seven complementary domains to autonomously detect, localize, and explain image forgeries through multi-turn reasoning. A Dual-Stream Forensic Reasoning paradigm combines a high-level semantic anomaly path, which magnifies suspicious regions for fine-grained inspection, with a low-level forgery artifact path, which invokes forensic tools to extract objective evidence. We further introduce Forensics Curriculum Learning: during General Experience SFT, an automated teacher-student mentoring pipeline synthesizes multi-turn tool-usage reasoning trajectories; during Forensic Scene RL, a Tool Prior Curriculum guides early tool exploration and progressively transfers control to the agent, while a Structured Evidence Reward provides fine-grained process-level supervision. Experiments across IMDL, Deepfake detection, DMDL, and AIGC detection show that ATAR achieves 78.5% average image-level F1 on six zero-shot IMDL benchmarks, surpassing the strongest MLLM baseline by 11.8 percentage points, and remains competitive with specialized detectors on other tasks while producing substantially more faithful and grounded explanations.

[56] DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency cs.CVPDF

Zeqi Xiao, Qingle Liu, Kaiwen Zhang, Yifan Zhou, Zihan Ding

TL;DR: DeCoPrune以去噪一致性评估历史KV token在保留上下文之外携带的信息，保留难以由当前上下文预测的token并裁掉冗余项。

Details

Motivation: 自回归视频扩散支持流式生成，但KV缓存随生成历史增长。固定窗口或局部注意力/相似度压缩未直接衡量某段历史是否为保留上下文提供额外信息。

Result: 训练免费的DeCoPrune利用中间干净预测与最终去噪值之间的差异度，观察到差异较大的token通常包含更难由保留上下文预测的视觉证据，因此优先保留在长期缓存，剪除差异较小的token。作者构建CMBench，包含58段约一分钟的生成或真实视频上下文及116个回现/重访续写任务，要求回忆较早事件或物体。LingBot World v2上，方法DINO分数0.6701，累计历史KV token数减少85.43%，续写生成比FullKV快4.14倍。头专用变体在剪枝86.19%时得分0.6783，接近FullKV的0.6803，并超过类似预算的压缩基线。

Insight: 缓存价值可用历史信息对当前模型去噪预测的不可替代程度衡量，而不是只依据时间新旧或注意力大小。高去噪差异token保留，能在大幅压缩历史的同时支持事件回忆。

Abstract: Autoregressive video diffusion supports streaming generation and interactive control, but its KV cache grows with the generated history. Existing compression strategies discard history using fixed windows or select tokens through local attention and similarity signals, without directly measuring whether a chunk contributes information beyond the retained context. We introduce DeCoPrune, a training-free method that treats cache compression as a denoising-consistency problem. We find that tokens with larger discrepancies between intermediate clean predictions and final denoised values tend to carry visual evidence less predictable from the retained context. DeCoPrune uses this model-intrinsic signal to retain high-discrepancy tokens in the long-term cache while pruning low-discrepancy tokens. To evaluate information retention, we introduce CMBench, comprising 58 approximately one-minute generated or real-world context episodes and 116 Reappear or Revisit continuation tasks requiring recall of earlier events or objects. Experiments with LingBot World v2 show that DeCoPrune achieves a DINO score of 0.6701 on a 0-1 scale, with an 85.43% reduction in cumulative historical KV token counts and a 4.14-fold continuation-generation speedup over FullKV. Its head-specialized variant reaches 0.6783 at an 86.19% pruning ratio, approaching FullKV’s 0.6803 score and exceeding the evaluated compression baselines at similar budgets. These results indicate that denoising consistency can support long-range information retention while reducing autoregressive inference cost. Our project homepage is https://decoprune.github.io. The code is available at https://github.com/DeCoPrune/CMBench, and the benchmark at https://huggingface.co/datasets/Aoraku/CMBench.

[57] CamAgent: An LLM-Agent Framework for Multi-Species Camera-Trap Workflows cs.CVPDF

Yutong Deng, Qi Song, Xi Guo, Tianming Wang, Lei Bao

TL;DR: CamAgent将相机陷阱生态分析工具整合为自然语言驱动的智能体工作流，自动串联物种识别、数据管理、占域、活动节律和共现分析。

Details

Motivation: 相机陷阱积累了大量多维野生动物数据，但将原始媒体转成生态洞见需要手工拼接不同工具和脚本，编程门槛高，端到端时空分析繁琐。

Result: CamAgent解析自然语言生态分析意图，安排计算路由并执行专用工具，包括SpeciesNet等计算机视觉识别、兼容CamtrapDP的数据管理、校正检测概率的占域模型、时间活动分析及物种共现网络。系统自动化多阶段流程，同时保留数据质量控制和分析规范。作者称其显著降低保护研究人员的手工编程负担，提供透明、可扩展的整合式相机陷阱生态分析范式；摘要未报告定量评估。

Insight: 生态分析智能体的价值在于把遵循规范的多个成熟工具组织成端到端流程，而非让语言模型替代领域统计工具。自然语言意图可作为接口，但数据质量和分析约定仍需显式保留。

Abstract: Camera traps accumulated vast, multidimensional data for wildlife monitoring, yet translating raw media archives into meaningful ecological insights remains highly fragmented. Current research workflows require laboriously stitching together disparate analysis tools and scripts, creating steep programming hurdles and complicating end-to-end spatiotemporal analyses. To overcome this fragmentation, we present CamAgent, an autonomous Large Language Model (LLM) agent framework that integrates camera-trap analytical workflows into a unified intelligent ecosystem. CamAgent interprets natural-language ecological intent, schedules computational routing, and executes specialized tools spanning computer-vision perception (e.g., SpeciesNet), CamtrapDP-compatible data management, detection-corrected occupancy modeling, temporal activity analysis, and species co-occurrence networks. The framework automates multi-stage analytical pipelines while maintaining essential data-quality controls and analytical conventions. Consequently, CamAgent significantly reduces manual programming overhead for conservationists, establishing a transparent, scalable, and fully integrated paradigm for camera-trap ecology. Our project is available at https://anonymous.4open.science/r/artifact72c6f4.

[58] GRC-Pose: Generation-Reconstruction Correspondence for Prior-Free 6D Object Pose Tracking cs.CVPDF

Shiyang Liu, Weiquan Lin, Luping Xiao, Jiadong Tang, Yi Yang

TL;DR: GRC-Pose结合生成式SAM3D CAD与视频重建几何中的对象—场景对应，在无CAD、参考姿态或标注条件下跟踪新物体6D姿态。

Details

Motivation: 无先验6D跟踪要求仅凭单段RGB视频恢复未见物体轨迹，不能使用对象专属CAD、带姿态参考图或姿态标注。生成式对象表面参数化与序列世界坐标的部分可见重建也不易直接对应。

Result: GRC-Pose将任务表述为生成—重建对应，并结合学习式匹配和稳健姿态估计。GeoCorr-Matcher为每个候选姿态估计对象—场景加权对应及其不确定性；FGH-Solver通过多种稳健几何估计器和序列级后验推断融合匹配，后验门控记忆只保留内点支持的观测，以跨越遮挡和视角变化。在HOT3D使用SAM3D CAD时，GRC-Pose的平均召回和运动保持达到先进水平，后者比既有方法提高58%；在YCBInEOAT和LINEMOD等传统基准上也有竞争力。

Insight: 生成式模型对象表面与视频重建证据处在不同坐标系，必须学习它们之间的带不确定性对应，而不能假设参数化直接一致。后验门控记忆可在遮挡期间保留可信观测并支持连续姿态跟踪。

Abstract: Prior-free 6D object pose tracking seeks to recover the trajectory of an unseen object from a single RGB video without object-specific CAD models, posed reference images, or pose annotations. Geometric foundation models provide complementary object-centric and scene-centric cues, yet SAM3D CAD is indexed by an arbitrary object-local surface parameterization, whereas reconstructed evidence is expressed in a sequence-specific world frame with partial surface coverage. To exploit this complementarity, we formulate tracking as generation-reconstruction correspondence and introduce GRC-Pose, a correspondence-based framework that combines learned correspondence prediction with robust pose estimation. Concretely, GeoCorr-Matcher estimates weighted object-scene correspondences and per-match uncertainty for each pose candidate. FGH-Solver integrates these matches through multiple robust geometric estimators and sequence-level posterior inference, while a posterior-gated memory retains only inlier-supported observations through occlusion and viewpoint change. Extensive evaluation shows that with SAM3D CAD, GRC-Pose achieves state-of-the-art Average Recall and motion retention on HOT3D, improving the latter by 58% over prior art. On classical benchmarks including YCBInEOAT and LINEMOD, it remains highly competitive.

[59] Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation cs.CVPDF

Siyuan Liu, Kanghui Tian, Yue Duan, Yutao He, Shangdong Yang

TL;DR: S-OPD通过对比原图与遮挡图下的学生策略，并对原图与噪声图保持策略一致，补足多模态在线蒸馏中的学生视觉感知短板。

Details

Motivation: 在线策略蒸馏让教师在学生自身轨迹上提供token级监督，但既有方法主要改进教师指导。作者发现学生感知本身也是瓶颈：即使教师强，给学生提供视觉事实预言也仍能显著提高表现。

Result: S-OPD有两个目标。教师校准策略对比在原图与遮挡图条件下比较学生策略，并用教师token信号门控，以鼓励推理时依赖视觉证据；策略一致性则对齐原图和噪声扰动图下学生策略，提升视觉噪声鲁棒性。方法可插入现有OPSD，不需额外数据标注、模型参数或推理操作。跨八个基准、多种学生规模和蒸馏范式的实验持续获益，LogicVista最高提升4.25分；与教师侧改进方法结合还可继续提高。

Insight: 教师反馈质量不是多模态蒸馏唯一瓶颈，学生是否看懂图像同样关键。通过遮挡对比强调证据依赖、通过扰动一致性提升稳健性，可在不增加部署开销下改善学生感知。

Abstract: On-policy distillation (OPD) improves reasoning by providing token-level supervision from a teacher on a student’s own trajectories. Existing methods primarily focus on enhancing this teacher-side guidance (e.g., by enriching teacher inputs and refining teacher feedback), yet we find that limited student perception is another critical bottleneck in multimodal OPD. By providing oracle visual facts, the performance of OPD-trained students can still be substantially improved for both weak and strong teachers. To address this bottleneck, we propose S-OPD, a simple multimodal on-policy distillation framework that explicitly strengthens student perceptual learning through two objectives. Specifically, Teacher-calibrated Policy Contrast separates student policies under original and masked images with teacher-based token-level gating, strengthening the student’s reliance on visual evidence during reasoning. Policy Agreement aligns student policies under original and noise-perturbed images, further improving perceptual robustness to visual noise. Notably, our method can be seamlessly plugged into existing OPD frameworks, requiring no additional data annotations, model parameters or inference operations. Extensive experiments on eight benchmarks across student scales and distillation paradigms demonstrate consistent performance improvements, with gains of up to 4.25 points on LogicVista. When combined with existing teacher-side supervision methods, our method can yield further gains. Code is available at https://github.com/Sirilaw/S-OPD.

[60] How to Reduce Localization Ambiguity? Geometry-Semantic Constrained BEV Representation Learning for Satellite-Ground Localization cs.CVPDF

Junming Feng, Panwang Xia, Qiong Wu, Xudong Lu, Zeyu Jiao

TL;DR: GeoSem-BEV用径向深度、高度和跨视角语义监督减少卫星—地面定位中BEV特征的几何放置及相似外观匹配歧义。

Details

Motivation: 卫星—地面定位需要在地理配准卫星图中估计地面相机平面位置和偏航角。BEV共享空间可建立空间对应，但深度约束不足会让特征沿视线被放到不同距离；外观相似地点也会造成描述子歧义。

Result: GeoSem-BEV在BEV表示学习中加入径向深度监督约束距离分配、垂直高度监督约束高度聚合，并用共享显式语义监督确保多视角语义预测一致、区分语义相似位置。上述约束改善特征放置和描述子辨别性，可提升多种先进BEV定位模型。在VIGOR未知朝向设置，跨区域和同区域平均朝向误差分别降低37.2%和38.1%；DReSS-D分别降低10.8%和15.6%；KITTI-CVL同区域且朝向噪声10度时误差降低26.8%。

Insight: BEV特征定位歧义同时来自几何投影和外观语义相似，单靠共享特征匹配难消除。显式监督深度、高度和语义关系可分别约束空间位置与跨视角可辨性。

Abstract: Satellite-ground localization estimates the planar position and yaw orientation of a ground camera within a geo-referenced satellite image. Most recent methods map ground and satellite features into a shared bird’s-eye-view (BEV) space and establish spatial correspondences. However, insufficient depth constraints can assign one ground feature to different distances along a viewing direction, creating geometric ambiguity in BEV feature placement. Similar appearances at different locations can also create descriptor matching ambiguity, while existing descriptor learning lacks explicit semantic supervision to distinguish them. We propose GeoSem-BEV, a geometry-semantic constrained BEV representation learning method. Radial depth supervision constrains distance assignment, and vertical height supervision constrains height aggregation. Shared explicit semantic supervision promotes consistent semantic predictions across views and helps distinguish locations with similar semantics. These constraints improve feature placement and descriptor discriminability, enhancing state-of-the-art BEV localization models. On VIGOR with unknown orientation, GeoSem-BEV reduces mean orientation error by 37.2% and 38.1% in the cross-area and same-area settings, respectively. The corresponding errors are reduced by 10.8% and 15.6% on DReSS-D. On KITTI-CVL, it reduces same-area mean orientation error by 26.8% under 10 degree orientation noise.

[61] GeoGAT: Bidirectional Temporal Sampling Meets Hierarchical Graph Attention for Global Video Geo-localization cs.CVPDF

Junchao Cui, Xuanzi Ma, Wenqi Shi, Hangyu Li, Biru Zhu

TL;DR: GeoGAT结合正向与偏移反向视频采样，并用地理层级图注意力协调城市至大陆四级预测，处理多镜头视频中的地点线索缺失和层级冲突。

Details

Motivation: 全球视频地理定位需预测城市、省州、国家和大陆。既有方法通常单向均匀采帧，并为每层单独训练分类器，容易丢失线索且不同层级预测冲突，尤其在复杂剪辑视频中。

Result: GeoGAT从正向及偏移反向帧序列提取互补时空特征，再送入预设地理层级图，通过图注意力进行结构化消息传递，双重约束机制剪除层级矛盾。作者构建GeoGAT10k，含来自全球166座城市的9,720个多镜头剪辑视频以测试复杂结构泛化。在CityGuessr68k和GeoGAT10k上，GeoGAT完全消除层级冲突，四个层级均达当前最佳。CityGuessr68k城市级表现比最强分类和检索协议基线高2.6个百分点；在更难的多镜头GeoGAT10k上准确率提升超过24个百分点。

Insight: 地理位置的四级标签有明确包含关系，分别分类容易产生不一致；图结构消息传递可利用该约束。双向时序采样则补充多镜头剪辑中被单向采样遗漏的地理线索。

Abstract: Global video geo-localization aims to infer the geographic location of a video worldwide, evaluating performance across four geographic hierarchies: city, state/province, country, and continent. Existing methods typically employ one-way uniform sampling to process video frames and train independent classifiers for each hierarchy, which leads to the loss of key geographic cues and prediction conflicts between hierarchies, especially for complex multi-shot edited videos. To address these limitations, we propose GeoGAT, which integrates bidirectional temporal sampling with graph attention networks (GATs). Specifically, GeoGAT extracts forward and offset-reversed frame sequences to construct complementary spatiotemporal features. These fused features are then fed into a predefined geographical hierarchy graph, where GATs perform structure-aware message passing, while a dual-constraint mechanism prunes predictions to eliminate cross-hierarchy conflicts. We construct GeoGAT10k, comprising 9,720 multi-shot edited videos from 166 cities worldwide, specifically to benchmark generalization ability on complex video structures. Experimental results on CityGuessr68k and GeoGAT10k demonstrate that GeoGAT eliminates hierarchical conflicts entirely and achieves state-of-the-art performance across all four geographic hierarchies. On CityGuessr68k, GeoGAT outperforms the strongest baseline, evaluated under both classification and retrieval protocols, by 2.6 percentage points at the city level. On the more challenging GeoGAT10k with multi-shot edited videos, the accuracy improvement exceeds 24 percentage points, validating strong generalization to complex real-world scenarios.

[62] Uncertainty-Aware Consistency Distillation for Few-Step Video Generation cs.CV | cs.MMPDF

Lingyu Liu, Yaxiong Wang, Li Zhu, Zhedong Zheng

TL;DR: UACD根据教师一致性在时空区域局部估计监督可靠性，对难以学习的高不确定区域减弱一致性惩罚，并用特征对抗及语义对齐维持少步视频质量。

Details

Motivation: 少步视频生成需把几十步教师蒸馏成少数步学生，但教师提供的一致性目标可靠度不同。快速变化区域（如树影或流水）更难学习，误差更大，不能与平稳区域一视同仁。

Result: UACD在两条独立扰动的教师引导一致性路径上获得学生终点预测共识，并以学生直接预测与该目标的差异作为无参数局部不确定性估计。对高不确定时空区域用指数权重放松一致性惩罚，其他位置保持完整惩罚；再加入特征空间对抗训练与语义对齐，以在大幅减步时维持感知质量。对50步Wan模型做参数高效LoRA适配后，四步生成在VBench 2.0达到0.556平均分，为当前最佳；用户研究中也比对比方法更受偏好。

Insight: 一致性目标的难度由局部时间变化而非语义复杂度主导。按时空位置估计可靠性并自适应加权，能避免学生被难以匹配的教师目标过度约束。

Abstract: We study few-step video generation, i.e., distilling a multi-step video generator, which typically requires tens of sampling steps, incurring substantial latency and compute, into a few-step student. Consistency distillation is a common recipe, in which a multi-step teacher provides the consistency targets for a few-step student. However, these teacher-guided targets are not equally trustworthy, and the content is harder to learn where it varies rapidly over time, e.g., moving foliage shadows or flowing water. We observe that supervision reliability follows the local difficulty of the content rather than semantic complexity: regions that change little yield consistent endpoint predictions, whereas regions with large temporal variation produce larger discrepancies that coincide with the largest perceptual errors. Motivated by this observation, we propose Uncertainty-Aware Consistency Distillation (UACD), which reweights consistency supervision at each spatiotemporal region using a local, parameter-free uncertainty estimate. Specifically, we construct two independently perturbed teacher-guided consistency paths, whose student endpoint predictions provide a consensus target; the discrepancy between the student’s direct prediction and this target is the uncertainty proxy. We then relax the consistency penalty on high-uncertainty regions through an exponential weight, while keeping the full penalty elsewhere, since the student cannot be expected to match targets that are hard to learn. To preserve perceptual quality under aggressive step reduction, we integrate feature-space adversarial training with semantic alignment. With parameter-efficient LoRA adaptation of the 50-step Wan model, our method achieves state-of-the-art 4-step generation on VBench 2.0 (0.556 mean score) and is preferred over competing methods in a user study.

[63] Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models cs.CVPDF

Shilinlu Yan, Bowen Chen, Yuechen Zhang, Zhenhong Zhou, Li Sun

TL;DR: FATA在固定显著视觉token上联合压制注意力并保持图像特征，专门构造只在token压缩路径失败、完整token路径仍正确的隐蔽对抗图像。

Details

Motivation: 视觉token压缩能提高VLM效率，但压缩路径可能暴露全token评估看不到的漏洞。攻击需让压缩推理出错，同时保持原始图像内容足以让完整token模型答对，这比普通对抗扰动更困难。

Result: Feature-Aware Token Attack（FATA）将注意力抑制与基于余弦相似度的特征保持结合，保护固定一组干净图像显著token。在主要LLaVA-1.5-7B设置中，攻击只使用视觉编码器梯度，不访问部署压缩器、token预算或下游任务。在四类视觉依赖任务子集和四种压缩器的受控重建协议下，完整token准确率保留率SR为96.3%，条件盲化率CBR为22.1%；CAA分别为89.8%和15.7%。消融支持两个目标共同平衡压缩失败和全token保真。三个检测器、5%误报率时，FATA在四种攻击中测得检测率最低。

Insight: 压缩鲁棒性不能只测干净样本或完整token路径，攻击者可专门利用两种推理路径之间的差异。联合报告完整输入保持与压缩条件盲化，可更真实地评估token压缩部署的安全性。

Abstract: Visual-token compression improves the efficiency of large vision-language models, but can expose failures that full-token evaluation misses. We study adversarial images that preserve full-token correctness yet induce errors after compression, even when both inference paths succeed on the clean image. Creating such failures is challenging because perturbing token importance can also damage the visual content needed for full-token inference. We propose Feature-Aware Token Attack (FATA), which couples attention suppression with cosine-based feature preservation on a fixed set of salient clean-image tokens. In the primary LLaVA-1.5-7B setting, FATA uses only vision-encoder gradients, without access to the deployed compressor, token budget, or downstream task. Across four visually dependent task subsets and four compressors under a controlled reconstruction protocol, FATA achieves SR = 96.3% full-token accuracy retention and CBR = 22.1% conditional blinding, compared with 89.8% and 15.7% for CAA. Ablations support the role of both objectives in balancing compressed-path failure against full-token preservation. FATA also has the lowest measured detection rate among four attacks across three evaluated detectors at a 5% false-positive rate. These findings motivate assessing adversarial robustness jointly across full-token and compressed inference.

[64] Asking the World: Generalist Physical Reasoning through Agentic World Modeling and Probing cs.CVPDF

Shenxiang Zeng, Chen Yang, Peiyao Chen, Guohui Zhang, Jiansheng Fan

TL;DR: ATW让智能体先从视频校准可执行物理世界，再通过查询、模拟和干预进行任务相关实验，用真实执行证据支撑通用物理推理。

Details

Motivation: 仅凭VLM直接解释复杂物理视频不可靠；预定义工具流程又依赖任务和领域先验，难迁移到不同材料、动力学和问题类型。作者探索按场景和问题自适应构造、探测可执行世界。

Result: Asking the World（ATW）包含两个自适应阶段：World Modeling从视频系统辨识任务相关动力学，World Probing在构建世界中查询、模拟并干预以获取问题需要的证据。轻量可编程PolyWorld Engine基于Warp模拟刚体、软体、布料、绳索、流体及耦合交互；CEM系统辨识恢复动力学。生成的世界是问题驱动的主动工作区，而非预先指定工具链。以Gemini-3-Flash为基础，CLEVRER逐题总体准确率80.82%，比直接Gemini高46.50分、比GPT-5.5高13.58分、比PhysMind高8.27分；ContPhy为70.56%，比Gemini高28.10分、比GPT-5.5高3.53分；三个真实场景为71.67%，比GPT-5.5高28.33分。

Insight: 复杂物理问答可转为在可执行模拟世界中设计实验，而非一次性从视频猜答案。让世界模型和探测步骤由当前场景与问题决定，有助于跨材料和动力学任务泛化。

Abstract: Physical reasoning from video requires inferring latent physical properties and dynamics beyond direct observation. Direct VLM inference remains unreliable on complex physical tasks without explicit modeling and validation, while predefined tool pipelines rely on task- and domain-specific priors that limit generalization across materials, dynamics, and reasoning tasks. We introduce Asking the World (ATW), a generalist agent that constructs and interrogates task-relevant executable worlds through two adaptive stages: World Modeling calibrates a world from video, while World Probing queries, simulates, and intervenes on it to obtain question-relevant evidence. Rather than prescribing the operations in either stage, ATW determines how to model and probe according to the scene and question. We develop PolyWorld Engine, a lightweight and highly programmable Warp-based multiphysics simulator for constructing and probing worlds with rigid bodies, soft bodies, cloth, ropes, fluids, and their coupled interactions. CEM-based system identification recovers task-relevant dynamics during World Modeling. The resulting world becomes an active workspace for question-directed physical experiments rather than a predetermined downstream tool. We evaluate ATW on CLEVRER, ContPhy, and three real-world scenarios. Using Gemini-3-Flash as its base VLM, ATW achieves 80.82% overall per-question accuracy on CLEVRER, improving direct Gemini-3-Flash by 46.50 points, GPT-5.5 by 13.58 points, and PhysMind by 8.27 points. On ContPhy, it reaches 70.56% overall accuracy, surpassing Gemini-3-Flash by 28.10 points and GPT-5.5 by 3.53 points. Across the three real-world scenarios, ATW achieves 71.67% accuracy, 28.33 points above GPT-5.5. These results establish agentic world modeling and probing as an effective, execution-grounded approach to generalist physical reasoning.

[65] When Can Text Replace Vision? Structural Bottlenecks in Diagram Reasoning cs.CVPDF

Yunbei Zhang, Janet Wang, Jihun Hamm, Chandan K Reddy

TL;DR: 论文用诊断协议区分图表问答失败来自文本化结构遗漏还是求解器不会利用已有结构，并发现与答案相关的拓扑比整图结构更关键。

Details

Motivation: 图表推理中先将图像转成文本结构，错误可能因为转换遗漏问题所需信息，也可能是求解器未利用正确结构。若不区分这两类原因，难以判断应该改进视觉抽取还是推理。

Result: 研究在相同求解模型和生成设置下比较原图、VLM提取的无问题提示结构及图表源文件生成的金标准结构，并设置无效输出恢复、问题相关保真度及匹配边干预。冻结协议的240个公开FlowGen留出图上，金结构准确率87%，直接视觉和学习文本均低于30%。但金结构使用源文件中可能未印在图上的关系标签，且学习与金标准图编码不同，不能仅归因于抽取错误。只重试无效抽取几乎使所有表示schema有效，却基本不改变准确率；学习文本相对金结构的差距随结构难度增大一倍以上。问题相关拓扑比全图拓扑更能预测正确性；改变一条答案相关边使主要求解器原答案准确率接近零，无关边改动则大多保留表现。结构输入需更少求解token，但学习式获取抵消了单次使用的优势。

Insight: 结构文本是否有用取决于是否保留问题所需的局部关系，并取决于求解器是否能正确利用它。提高格式有效率并不能替代检查问题相关信息保真度。

Abstract: Can structured text replace vision for diagram reasoning? A wrong answer after textualization can arise because the representation omits information the question needs, or because the solver fails to use information that is present. We introduce a diagnostic protocol to distinguish these explanations. Using the same solver model and generation settings, we compare three input conditions: the original image, question-blind structure extracted by a vision-language model, or gold structure derived from the diagram source. Validity-triggered recovery tests truncation and schema failure, question-relevant fidelity measures preservation of answer-critical structure, and matched edge interventions test the effect of error location. On a reserved holdout of 240 public FlowGen diagrams, evaluated under a frozen protocol, gold structure reaches 87% accuracy while direct vision and learned text both remain below 30%. The aggregate comparison includes source-derived relation labels that may not be printed in the image and uses different learned and gold graph encodings, so it does not isolate extraction error alone. Retrying only invalid extractions makes nearly every public representation schema-valid yet leaves accuracy essentially unchanged. The public learned-text deficit relative to gold more than doubles with structural difficulty. Question-relevant topology predicts correctness better than whole-graph topology. In an exposed intervention study, a single answer-relevant edge edit reduces the primary solver’s original-answer accuracy to near zero, while matched irrelevant edits largely preserve it. Supplied structure requires fewer solving tokens than vision, but learned acquisition removes this advantage at single use. These comparisons motivate evaluating acquired text by the answer-relevant evidence it preserves and by the solver’s ability to use that representation.

[66] MindWorldBench: Evaluating Mental-State-to-Behavior Reasoning in Image-to-Video Generation cs.CVPDF

Ruiqi Li, Xuanyi Liu, Sijia Li, Haofeng Wang, Yuxin Liu

TL;DR: MindWorldBench评测图像到视频模型能否根据信念、欲望和感知等潜在心理状态生成相符行为，而不依赖显式动作提示。

Details

Motivation: 当前I2V模型可生成逼真、物理合理视频，但对心理状态的推理几乎未被研究。人的行动由信念、欲望和感知驱动，需要超越可见指令进行推断。

Result: 基准将问题定义为从世界状态和潜变量推理行为，并通过零动作提示和反事实设计控制744个提示，以隔离心理状态的因果影响。自动流水线分别评估视频质量、常识合理性和心理状态一致性。对11个模型的结果显示，尽管视觉保真和物理推理能力较好，模型仍难使行为与潜在心理状态匹配。作者指出“全知偏差”：模型倾向按客观世界状态行动，而忽视人物主观信念。

Insight: 视频生成的视觉连贯和物理合理不等于具备心理推理；模型可能知道客观状态，却不能模拟角色基于错误信念采取的行为。反事实心理状态控制可针对性测量这一差距。

Abstract: Current image-to-video models achieve visual realism and physical plausibility, but reasoning about mental states remains unexplored. Actions are driven by belief, desire, and perception, requiring inference beyond explicit instructions. We introduce MindWorldBench to evaluate mental-state-conditioned video generation. We formalize this as mental-state-to-behavior reasoning, where models generate actions from a world state and latent variables without explicit action prompts. MindWorldBench utilizes Zero-Action Prompting and a counterfactual design with 744 prompts to isolate the causal effects of mental states. An automated pipeline evaluates video quality, commonsense plausibility, and mental-state consistency. Evaluations of 11 models show that despite visual fidelity and physical reasoning, models fail to align behaviors with latent mental states. We identify a failure mode, termed Omniscient Bias, where models default to the objective world state rather than human’s subjective belief. These results demonstrate a disconnect between visual generation and cognitive reasoning, suggesting a need for explicit mental-state modeling in video generation systems. Project website: https://richard2049-lee.github.io/MindWorldBench/

[67] OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning cs.CV | cs.SDPDF

Xingming Shui, Dapeng Chen, Bowei Liu, Jingqi Tian, Minfu Li

TL;DR: OP-CAD依据教师在干净音频、受扰音频和纯视觉上下文下的预测差异，为音频敏感token分配在线自蒸馏监督。

Details

Motivation: 现实全模态模型会受环境噪声和竞争语音干扰。音视频问答需抑制声学干扰同时保留有效音频证据；普通在线蒸馏对所有token均匀加权，未专门强化受干扰位置。

Result: OP-CAD采用渐进课程，从轻度到重度噪声及竞争语音训练。学生根据受扰音视频输入生成回答，冻结教师在干净音频及验证答案条件下监督相同前缀。为确定重点位置，方法比较教师在干净、受扰和纯视觉上下文中的预测，不向教师泄露答案；匹配比较分别衡量音频移除与污染敏感度，再用有界权重强调任一信号识别出的token，同时保留全回答监督。在全部评估噪声条件下，OP-CAD超过对比方法；配对分析还显示强干扰下更好保留原本正确的答案，未观察到总体干净准确率损失。

Insight: 干净教师信息应主要用于纠正受噪声影响的预测位置，而不是均匀作用于整个回答。通过对照干净、受扰和纯视觉条件可定位声学敏感token，且无需中间推理标签。

Abstract: Omni-modal large language models deployed in real-world environments encounter external noise that can interfere with their perception and understanding of multimodal inputs. We study their robustness in audio-visual understanding, focusing on question answering under environmental noise and competing speech. The challenge is to resist acoustic interference while preserving useful audio evidence. On-policy distillation provides dense teacher feedback on student-generated responses, but uniform token weighting does not explicitly prioritize positions affected by acoustic interference. We introduce OP-CAD (On-Policy Clean-Audio Distillation), a curriculum-based privileged self-distillation framework for robust audio-visual understanding. Training progresses from mild to severe environmental noise and competing speech, with selective token-level supervision at each stage. The student generates responses from corrupted audio-visual input, while a frozen teacher uses clean audio and the verified answer to supervise the same response prefixes. To allocate this supervision, OP-CAD compares teacher predictions under clean, corrupted, and visual-only contexts without revealing the answer. These matched comparisons measure sensitivity to audio removal and corruption; a bounded weighting rule emphasizes positions identified by either signal while retaining supervision throughout the response. OP-CAD outperforms the compared methods across all evaluated noise conditions. Paired analyses further show improved preservation of clean-correct answers under strong interference, with no observed aggregate clean-accuracy penalty. These results demonstrate the value of directing clean-teacher supervision toward acoustically sensitive predictions for robust audio-visual reasoning.

[68] TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation cs.CVPDF

Songhe Wang, Lifu Wei, Shuolin Xu, Charles A. Kamhoua, David Miller

TL;DR: TripleFlow在免训练视频目标移除中并行协调对象残差消除与遮挡背景合成，并在每个步骤将新背景反馈到编辑轨迹。

Details

Motivation: 移除对象的提示只说明删除什么，却要求模型根据周围上下文重建被遮挡的具体背景。现有免训练方法主要局部擦除，不能主动合成缺失细节，易留下鬼影。

Result: TripleFlow同时协调源流、残差流和合成流。复用单个目标预测后，残差流分离并抑制对象，合成流独立重建其遮挡背景；关键是每步将新合成背景注回编辑轨迹，使补全结构持续影响后续移除和生成。五个困难基准评估显示，TripleFlow达到新的最佳表现，在重建保真度和时间一致性上显著超过既有基线；摘要未列具体分数。

Insight: 对象擦除和背景补全不能完全分开顺序处理，否则生成背景无法反过来约束编辑过程。逐步反馈合成内容可让移除结果与未编辑场景在时空上连贯。

Abstract: Video object removal presents a uniquely difficult editing challenge. Because a removal prompt specifies only what to erase rather than what to generate, the model must infer and reconstruct a highly specific occluded background entirely from the surrounding context. Existing training-free methods struggle with this because their editing mechanisms act primarily as localized erasers. They fail to actively synthesize the missing background details and often leave behind ghosting artifacts. To solve this, we propose TripleFlow, a training-free framework that tightly couples erasure and generation. It coordinates a source flow, a residual flow, and a synthesis flow throughout the entire process. By reusing a single target prediction, the residual flow isolates and suppresses the object, while the synthesis flow independently reconstructs the occluded background. Crucially, TripleFlow injects this newly synthesized background back into the editing trajectory at every step. This continuous feedback loop ensures that the generated structures actively guide the removal process, achieving seamless completion that is spatiotemporally consistent with the unedited scene. Extensive evaluations across five challenging benchmarks demonstrate that TripleFlow establishes a new state-of-the-art, significantly outperforming existing baselines in both reconstruction fidelity and temporal consistency.

[69] MEND: Label-Free Detection, Localisation, and Correction of Latent Hallucination in World Models cs.CV | cs.AIPDF

Ali J Alrasheed, Aryan Yazdan Parast, Basim Azam, James Bailey, Naveed Akhtar

TL;DR: MEND用单个条件分数网络的强度、逐token场和推断方向分别检测、定位并尝试修正世界模型潜变量幻觉，无需错误标签。

Details

Motivation: 给定状态和动作，世界模型预测的下一潜变量可能解码成现实中不会发生的场景。这种预测看似统计正常且会被自回归继续使用，使错误隐蔽并逐步累积，而此类鲁棒性此前研究有限。

Result: 在冻结自监督世界模型上，作者提出Masked Empirical-Bayes Neural Denoising（MEND），仅用真实转移训练条件去噪分数匹配网络。分数幅值用于检测幻觉，逐token分数定位到具体图像patch，其方向用于推断时修正。在两个导航环境中，不使用动作也能检测幻觉，AUROC最高0.80，超过单高斯密度基线；同时定位错误，逐token AUPRC最高0.87，并可尝试纠正。修正稳定降低单步潜变量误差、改善预测。作者指出部分误差沿数据流形切向，因此强调检测与定位证据，并将修正作为潜力而非完全解决。

Insight: 同一数据分布分数场可提供检测、空间定位及修正方向三类信号。由于某些误差沿数据流形移动，修正潜变量不一定可靠，检测和定位能力比自动修复更稳健。

Abstract: World Models are appearing as the next major frontier in computer vision. However, their robustness is currently largely unexplored. We identify the phenomenon of hallucination in latent World Models: given a state and an action, the predicted next latent can decode to a scene that never occurs. Because the prediction is statistically ordinary and is fed back autoregressively by the model, the error is both silent and compounding. We study whether such latent hallucination can be detected, localised, and corrected at inference time, on a frozen self-supervised world model in the absence of ground-truth error labels. We introduce Masked Empirical-Bayes Neural Denoising (MEND), a single conditional score network trained by denoising score matching on real transitions, whose score field serves three roles: its magnitude detects hallucination, its per-token field localises it to specific image patches, and it defines an inference-time correction direction. On two navigation environments MEND detects hallucination with an AUROC of up to 0.80 without using actions, exceeding a single-Gaussian density baseline while also localising the error (per-token AUPRC up to 0.87) and correcting it, all from one score field. Our correction reliably reduces single-step latent error and improves predictions. We identify that a part of the error is tangent to the data manifold, hence, we focus on detection and localisation while highlighting promises of the correction.

[70] Aligning Thoughts with Answers: Probability Rewards to Tame Thinking Drift cs.CVPDF

Pengzhan Sun, Shiu-hong Kao, Shijie Li, Yongyi Su, Junbin Xiao

TL;DR: Rita用参考答案条件概率构造无需推理标签的思考奖励和一致性奖励，纠正视觉意图定位中答案框正确但理由指向错误对象的“思考漂移”。

Details

Motivation: 视觉意图定位要求根据人的意图查询推断目标并输出边界框。基于IoU的强化学习只奖励框位置，可能使模型即使推理指向另一个目标也获得高奖励。

Result: Rita（ReInforcing Thinking–Answer consistency）提出两种不需要推理过程标签的RL奖励，均从参考答案条件概率构造：思考奖励和思考—答案一致性奖励。方法还按rollout错误率和奖励方差进行难度感知数据筛选，选择有信息量的易到中等样本进行RL。在EgoIntention和新建RefEgo-Int基准上，Rita持续超过监督微调和普通RL微调框架；摘要未给具体增益数值。

Insight: 视觉定位答案正确并不能证明思考过程选中了正确对象。将参考答案条件概率用于思考与答案两类奖励，并筛掉信息不足样本，可在没有人工推理标注时改善一致性。

Abstract: This paper studies \textbf{thinking–answer consistency} in vision-language models. We focus on Visual Intention Grounding, where a model infers a target object based on a human intention query and predicts a bounding box. We reveal that previous IoU-based reinforcement learning (RL) frameworks suffer from ``thinking drift’’, where the model produces a correct bounding box, despite having an incorrect reasoning process pointing to a different target object. Thus, we propose \textbf{Rita} (\textit{ReInforcing Thinking–Answer consistency}) as a novel RL paradigm to tame the drift. Specifically, Rita introduces two reasoning-label-free RL rewards, constructed from the conditional probability of reference answers: a \textbf{thinking reward} and a \textbf{consistency reward}. It also adopts a difficulty-aware \textbf{data filtering} strategy that selects informative easy-to-medium samples for RL using rollout error rate and reward variance. Extensive experiments on EgoIntention and the new RefEgo-Int benchmarks show that Rita performs consistently superior to the supervised finetuning approaches and vanilla RL-finetuned frameworks.

[71] Uruqi: Learning Spatial Cognition from Visual Experience cs.CVPDF

Shichao Li, Meiqi Wang, Fei Su, Zhicheng Zhao

TL;DR: Uruqi用连续多轮空间问题监督模拟移动智能体边观察边更新世界理解，重点训练自运动追踪和持久对象地图能力。

Details

Motivation: 空间智能需要智能体移动时维持连贯世界认知，并利用自身运动解释观察变化、更新对象位置和空间关系。现有空间后训练仍难以掌握自运动跟踪和运动中的环境映射这两项基础能力。

Result: 作者为每个训练episode提供交错的原子空间能力密集多轮监督，并合成11,738条覆盖广泛3D场景的模式驱动相机轨迹，训练自运动跟踪、持久对象映射及空间操作。Uruqi基准含2,700多个episode、5.2万问题；URUQI Syn-8B准确率从15.84%提高到47.73%，加入混合数据的URUQI-SI-Mix-8B达50.41%，接近GPT-6 Astra的50.08%。仅用合成数据训练的Syn-8B在三个外部空间基准上，相比InternVL3-8B平均相对准确率提高17.13%。

Insight: 连续视觉经历比孤立空间问答更能监督智能体如何在运动中更新位置和关系。通过合成可控相机轨迹及多轮原子问题，可规模化构造这类时序空间经验。

Abstract: Spatial intelligence requires maintaining a coherent understanding of the world as the embodied agent moves. Like humans, the agent must use its own motion to interpret changes across observations and update object locations and spatial relations accordingly. Despite spatial post-training having substantially broadened the spatial intelligence of vision-language models (VLMs), they still struggle with two atomic spatial capabilities: tracking self-motion and mapping the surrounding world during motion. To address this gap, we provide dense multi-turn supervision over interleaved atomic capabilities within each training episode, mimicking the visual experience of a continuously moving agent that reasons as it observes. To scale this up, we synthesize 11,738 motif-driven camera trajectories over a broad range of 3D scenes, supporting self-motion tracking, persistent object mapping, and rich spatial operations within each visual experience. By training models to reason over these atomic questions, our URUQI${\mathrm{Syn}}$-8B improves accuracy from 15.84% to 47.73% on our Uruqi benchmark comprising 52k questions across 2.7k episodes. URUQI-SI-Mix-8B further reaches 50.41%, comparable to the 50.08% achieved by GPT-6 Astra. Trained solely on our synthesized data, URUQI${\mathrm{Syn}}$-8B achieves an average relative accuracy improvement of 17.13% over its InternVL3-8B backbone across three external spatial benchmarks. These results highlight continuous visual experience as a scalable source of supervision for developing spatial cognition in VLMs.

[72] Emergent Multi-View Geometry Through Self-Distillation cs.CV | cs.AIPDF

David Nordström, Thibaut Loiseau, Vincent Lepetit, Michael Felsberg, Guillaume Bourmaud

TL;DR: Poincar3通过教师额外观察多视角图像进行自蒸馏，在无需3D标签和从头训练的条件下学习蕴含相机运动与空间关系的视觉表示。

Details

Motivation: 单帧视觉表示学习难以获得稳定空间概念；已有多视角方法常依赖RGB重建，将几何信息与外观混在一起。作者提出通过观察变化本身学习空间，而非重建像素。

Result: Poincar3结合遮挡patch级和图像级自蒸馏，教师使用额外视角，支持无需显式3D监督、从头训练的多视图表示学习。在对应关系估计、相机姿态估计和3D重建上，Poincar3超过DINOv3、MuM、Muskie等单视图或多视图自监督方法。加入轻量Poincaré适配器后，学习特征编码相机运动也比既有自监督表示更准确；摘要未给出具体指标。

Insight: 多视角一致性本身可作为自监督信号，而不必通过像素重建把几何和外观耦合。教师看到额外视角后蒸馏给学生，能使表示捕获对应关系和相机运动。

Abstract: Over a century ago, Henri Poincaré argued that a motionless observer cannot acquire the notion of space. Yet, most visual representation learning methods operate on individual images, while those that leverage multiple views rely on RGB reconstruction, entangling geometry with appearance. We propose Poincar3, a self-supervised method that learns representations from multiple views through self-distillation instead of RGB reconstruction. We combine masked patch and image-level distillation with a teacher that observes additional views, enabling training from scratch without explicit 3D supervision. Poincar3 outperforms both previous single and multi-view self-supervised approaches such as DINOv3, MuM, and Muskie on correspondence estimation, camera pose estimation, and 3D reconstruction. Using a lightweight Poincaré adapter, we also find that our learned features encode camera motion more accurately than existing self-supervised representations.

[73] Universal Cross-Prompt Adversarial Attacks on Promptable Concept Segmentation cs.CVPDF

Ziqi Zhou, Yifan Hu, Yufei Song, Haowen Jiang, Xianlong Wang

TL;DR: AdvPCS通过min-max优化寻找最难攻击提示，联合误导全局和局部视觉感知及跨帧记忆，构造跨提示通用的SAM3概念分割攻击。

Details

Motivation: SAM3把提示式分割扩展到概念级预测，但其对抗鲁棒性尚未研究；SAM系列已有攻击在不同点、框、文本提示间迁移能力有限。

Result: AdvPCS包含提示min-max优化、全局—局部感知欺骗和时间转移偏差攻击。内层最大化扩大点、框和文本候选提示多样性；外层依据检测器置信响应选择最难攻击提示。随后在联合提示下压低全局和局部目标存在概率，并通过时间记忆失配攻击最大化帧间语义不一致、破坏记忆指针。四个基准上，单一通用对抗扰动能跨不同视频帧，并在点、框、文本提示下保持强攻击效果；SA-CO上文本提示下多种PCS模型平均mIoU降至5%以下。

Insight: 概念级分割的脆弱性不仅在单帧定位，还涉及提示变化和跨帧记忆。以最坏提示进行通用攻击并同时扰乱时序状态，可检验模型是否真正稳定地响应概念条件。

Abstract: The Segment Anything Model (SAM) achieves remarkable performance in visual segmentation. The latest SAM3 extends promptable segmentation to concept-level prediction, broadening the scope of segmentation foundation models. While recent works reveal that SAM and SAM2 are vulnerable to adversarial examples, the robustness of SAM3 under the concept segmentation paradigm remains unexplored. In addition, existing adversarial attacks on SAM-series models exhibit limited cross-prompt transferability. To this end, we propose AdvPCS, a universal cross-prompt adversarial attack for Promptable Concept Segmentation (PCS), including a min-max prompt optimization strategy, a global-local perception deception attack, and a temporal transition deviation attack. Specifically, we first identify the hardest-to-attack prompts via min-max bilevel optimization. In the inner maximization, we enhance diversity over candidate point, box, and text prompts. In the outer minimization, we select prompts with the highest responses based on the confidence scores output by the detector. Given the selected prompts, we apply the perception deception attack to minimize both global and local existence probabilities under joint prompting and employ the temporal memory misalignment attack to maximize inter-frame semantic inconsistency and corrupt memory pointers. Extensive experiments on four benchmark datasets show that a single universal adversarial perturbation (UAP) generated by our method generalizes across frames from different videos and achieves strong attack performance under point, box, and text prompts. In particular, it reduces the average mIoU of various PCS models on the SA-CO dataset to below 5% under text prompts, demonstrating strong attack ability.

[74] PLRS-IC: A Dual-Calibration Framework for Chest X-Ray Vision-Language Alignment cs.CVPDF

Qixing Zhao, Jinpeng Li

TL;DR: PLRS-IC对胸片视觉语言表示进行投影条件局部相似度和信息校准全局对比损失双重校准，缓解正侧位影像差异与跨患者语义假负样本。

Details

Motivation: 胸片细粒度视觉语言对齐可支持零样本分类、定位和分割，但两类歧义相互作用：正位与侧位对同一临床发现呈现不同外观；全局对比学习又把跨患者但共享相同正向临床概念的样本当作严格负例。

Result: PLRS-IC局部模块PLRS用有界参数高效低秩残差，根据投影动态适配patch—文本相似度流形；全局模块IC-SFNS利用从语料估计的信息论先验，对语义重叠的假负样本软化惩罚，同时不改动原始对比配对。在九种公开零样本基准设置中，分类、视觉定位和分割均持续改善，支持医学视觉语言预训练需要同时做双重校准；摘要未列具体分数。

Insight: 胸片对齐需要区分因投照角度导致的视觉差异与临床概念共享导致的语义重叠。局部投影条件匹配和全局假负样本校准针对不同层面，组合后可改善多类下游视觉任务。

Abstract: Fine-grained vision-language alignment in chest radiography enables zero-shot classification, grounding, and segmentation without task-specific annotations. However, this alignment is fundamentally hindered by two intertwined sources of ambiguity: projection-induced visual mismatch and patient-agnostic semantic overlap. First, at the local feature level, frontal and lateral radiographs exhibit distinct appearances for the same clinical finding, rendering a shared patch-text similarity geometry inherently suboptimal. Compounding this visual ambiguity is a semantic mismatch during global contrastive optimization, where instance-level objectives penalize cross-patient pairs as strict negatives even when they share identical positive clinical concepts. To address this dual ambiguity, we propose PLRS-IC, a unified dual-calibration framework for chest X-ray representation learning. At the local alignment stage, Projection-Conditioned Low-Rank Residual Similarity (PLRS) dynamically adapts patch-text matching to projection-specific manifolds using a bounded, parameter-efficient low-rank residual. At the global optimization stage, Information-Content-Calibrated Soft False-Negative Suppression (IC-SFNS) leverages a corpus-derived information-theoretic prior to soften the penalty of semantically overlapping negatives without altering original contrastive assignments. Extensive experiments across nine public zero-shot benchmark settings demonstrate that our framework yields consistent improvements in classification, grounding, and segmentation, validating the necessity of dual-calibration in medical vision-language pre-training.

[75] MegaAvatar: Controllable Talking Avatar Generation cs.CVPDF

Junyao Gao, Sibo Liu, Weidong Zhang, Cairong Zhao, Jun Zhang

TL;DR: MegaAvatar在Wan2.2视频生成模型中注入SMPL-X三维动作引导和音频/面部交叉注意力，实现身体头部动作、语音同步表情及身份可控的说话头像生成。

Details

Motivation: 既有说话头像主要依靠音频或参考图条件，难以全局控制身体姿态和头部运动，也需兼顾细粒度表情与输入身份保持。

Result: MegaAvatar基于Wan2.2-TI2V-5B，将驱动SMPL-X序列渲染为稠密网格帧，经轻量3D卷积编码器处理后注入潜token，控制整体运动；另加音频交叉注意力和面部交叉注意力模块，分别控制细粒度表情和保持身份。系统还实现音频到SMPL-X模型，根据参考图和输入音频预测身体姿态序列，使用户无需提供SMPL-X帧即可音频驱动生成。实验显示可生成高质量头像视频，控制身体/头部运动、同步语音表情并保持身份，还支持灵活分辨率和视频长度；摘要未列具体指标。

Insight: 通过显式SMPL-X结构信号控制全局姿态，再用音频和面部条件细化局部表达，可将运动控制、语音同步与身份保持分开处理。自动预测SMPL-X还降低了用户提供动作轨迹的门槛。

Abstract: This report presents \textbf{MegaAvatar}, a controllable talking avatar generation framework built on top of the Wan2.2-TI2V-5B model. Compared with previous talking-avatar methods that mainly rely on audio or reference-image conditioning, we introduce additional SMPL-X-derived 3D guidance, enabling global control over body pose and head motion. Specifically, we render the driving SMPL-X sequence into dense mesh frames and encode them with a lightweight 3D convolutional encoder, whose outputs are injected into the latent tokens to provide overall motion control. Furthermore, we extend Wan2.2-TI2V-5B with additional audio and face cross-attention modules to enable fine-grained expression control and preserve the input identity, respectively. In addition, we implement an audio-to-SMPL-X model to predict an SMPL-X sequence conditioned on the reference image and input audio, allowing MegaAvatar to support audio-driven inference without user-provided SMPL-X frames. Experiments show that MegaAvatar achieves high-quality talking avatar generation with controllable body and head motion, speech-synchronized facial expressions, and consistent identity preservation. MegaAvatar also supports inference with flexible resolutions and video lengths. Codes, dataset, models will be avaliable in https://github.com/Jeoyal/MegaAvatar

[76] BMASH: Ball-Motion-Aware Soccer Header Spotting cs.CVPDF

Ahmed Endris Hasen, Muhammad Shahzad Khan, Nikolaos Passalis, Jenni Raitoharju

TL;DR: BMASH将视频动作表征与逐帧足球检测得到的球存在和运动特征融合，提高广播足球头球事件检测能力。

Details

Motivation: 足球头球事件短暂且视觉细微，广播视频中容易与其他相似动作混淆。作者关注准确识别球与球员头部接触时刻。

Result: 作者先将Video Swin适配为头球动作识别强基线，再提出球运动感知融合框架BMASH，将动作表示与逐帧足球检测中的球存在及运动特征结合，以联合利用球员动作上下文和球体动态。采用比赛级划分、独立测试比赛及轮换验证，并评估居中片段分类和连续全视频检测。Video Swin本身是有力基线；BMASH在片段级AP和ROC-AUC高于对应基线，连续全视频事件级F1相近，但精确率—召回率权衡不同。摘要未给具体分数。

Insight: 球的位置及运动变化可为视觉相似动作提供关键事件线索，动作语义和球动力学互补。片段分类收益不必等同于全视频事件级F1提升，评测需区分两种任务。

Abstract: Recent advances in computer vision have made broadcast sports videos increasingly useful for event analysis, performance assessment, and player-safety applications. In soccer, however, header spotting remains a challenging problem due to the subtle and short-lived nature of header events. This paper focuses on soccer header spotting: identifying moments in broadcast videos where the ball contacts a player’s head. We first adapt and evaluate Video Swin as a strong action-recognition baseline for this task, and then introduce BMASH, a ball-motion-aware fusion framework that integrates detector-derived ball features. BMASH combines Video Swin action representations with ball-presence and motion features from frame-level soccer-ball detection, integrating player-action context with ball dynamics to distinguish headers from visually similar events. We evaluate BMASH using game-level splits with separate test matches and rotating validation folds, considering both centered-window classification and continuous full-video spotting. Results show that Video Swin provides a strong baseline for header spotting, while BMASH improves clip-level AP and ROC-AUC over the corresponding Video Swin baseline. In continuous full-video spotting, BMASH achieves a comparable event-level F1-performance with a different precision–recall trade-off.

[77] Rethinking Generative Image Compression at Extremely Low Bitrates cs.CVPDF

Tianyu Zhang, Zhaoyang Jia, Houqiang Li, Dong Liu

TL;DR: RAE-CoD在表示自编码器空间做压缩导向扩散，使极低码率图像仍保持可识别且结构自然，避免传统生成式压缩在接近零码率时发生语义崩塌。

Details

Motivation: 生成式图像压缩在低码率下可生成合理重建，但码率进一步下降时行为研究不足。代表性编解码器可能出现语义崩塌，突然生成畸形或无法识别内容，而不是平滑损失源图细节。

Result: 分析发现，码率降低时重建损失与语义目标在梯度和视觉结果上冲突加剧；像素空间及重建导向VAE扩散对语义保持效率也较低。RAE-CoD在表示自编码器空间构建压缩扩散，并直接对齐压缩与源图表示；256×256图像仅用16 bit仍能保持可识别、结构自然的内容。使用五种视觉基础模型及盲视觉语言评测，在MSCOCO-30K的0.001至0.008 bpp范围内，相比最佳竞争者，视觉基础模型特征MSE及Fréchet距离比至少分别降低25.7%和69.1%。语义可识别性和质量基本稳定，源图一致性则平滑下降，从突发语义崩塌转为渐进式趋向无条件生成。

Insight: 极低码率压缩需优先保留语义结构，而非仅优化像素重建；在表示空间直接对齐源图与编码内容可缓和目标冲突。评测应区分源图忠实度与重建可识别性。

Abstract: Generative image compression produces visually plausible reconstructions at low bitrates, yet their behavior as the rate approaches zero remains largely unexplored. When pushed below normal operating rates, representative codecs undergo semantic collapse: rather than gracefully losing source-specific detail, they produce malformed or unrecognizable content. Our analysis identifies two factors. As the bitrate decreases, reconstruction losses increasingly conflict with semantic objectives on gradients and visual results, while pixel-space and reconstruction-oriented VAE diffusion models become less efficient on semantic preservation. Guided by these findings, we introduce RAE-CoD, a compression-oriented diffusion (CoD) built in a representation autoencoder (RAE) space with direct alignment between compressed and source representations, preserving recognizable, naturally structured content for a $256\times256$ image with as few as 16 bits. We evaluate this framework using five vision foundation models (VFM) and a blinded vision-language model protocol. On MSCOCO-30K, RAE-CoD stands out from all evaluation. At 0.001-0.008 bpp, it reduces relative VFM feature MSE and Fréchet Distance ratio by at least 25.7% and 69.1% over the best competitors. Meanwhile, semantic recognizability and quality of the reconstructions remain nearly constant while source consistency falls smoothly, replacing abrupt semantic collapse with a graceful transition toward unconditional generation. Code will be released at https://github.com/LuizScarlet/RAE-CoD.

[78] TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioning cs.CVPDF

Zijing Qin, Jun Zhou, Ruicheng Zhang, Jiaqi Hou, Zunnan Xu

TL;DR: TexTailor利用去噪时步自适应服饰调制、帧对齐位置编码及多源条件注入，在高分辨率视频试穿中保持纹理细节与时序一致性。

Details

Motivation: 视频虚拟试穿在低分辨率上已有进展，但扩展到高分辨率仍困难，原因包括未充分利用服装参考信息，以及跨模态交互时缺乏服装与视频表征的显式位置对应。

Result: TexTailor基于预训练视频Diffusion Transformer，采用时步自适应调制在去噪过程中动态调整服装视觉表征；帧对齐位置编码加强服装与视频的局部对应，多源注入则减少异质条件互相干扰。在包括高分辨率Eevee数据集的多个虚拟试穿基准上，模型在服装细节保留、时间一致性和整体视频质量方面表现有竞争力；摘要未列具体数值。

Insight: 高分辨率试穿既需保留参考衣物的细纹理，也需跨帧保持局部映射。按去噪阶段调整条件强度，并显式建模帧级空间对应，可分别强化这两类要求。

Abstract: Video virtual try-on has attracted increasing attention due to its broad potential in digital fashion and intelligent e-commerce. However, existing methods primarily focus on low-resolution settings and still face substantial challenges when extended to high-resolution scenarios. These limitations can be attributed to two main factors: (1) the insufficient utilization of rich garment reference information, and (2) the lack of explicit positional modeling between garment and video representations during cross-modal interaction, which weakens fine-grained local correspondence. To address these issues, we propose TexTailor, a high-fidelity video virtual try-on framework built upon a pretrained video Diffusion Transformer. Specifically, we introduce a timestep-adaptive modulation mechanism to dynamically adjust garment visual representations throughout denoising. We further develop a frame-aligned positional encoding strategy to strengthen garment-to-video correspondence, together with a multi-source injection design that reduces interference among heterogeneous conditions. Extensive experiments on multiple video virtual try-on benchmarks, including the high-resolution Eevee dataset, demonstrate that TexTailor achieves competitive performance in garment detail preservation, temporal consistency, and overall video quality.

[79] Rethinking Multi-Image Re-Representation in Multi-Image Understanding cs.CV | cs.AIPDF

Gengyuan Zhang, Xiao Han, Xinyu Xie, Tong Liu, Volker Tresp

TL;DR: Mosaic让多图像模型主动执行十种可组合视觉操作构造中间表示，并训练智能体多步组合操作以解决需要精确跨图像证据的任务。

Details

Motivation: 多图理解不只是识别各张图，还需组织分散在图像间的证据。提示思维链和调用视觉工具可视为不同重表示方式，但各自适用任务尚不清楚。

Result: Mosaic是通用多图像视觉harness，支持多模态模型主动构造十种可组合图像操作中间结果。作者在既有多图基准和新建细粒度落地基准MosaicBench上比较五类重表示设置，发现文本与视觉重表示的相对收益依任务而定；假设检验、精确比较和方向敏感推理等需要精细视觉证据的任务更受益于视觉重表示，高层语义任务收益较小或不稳定。随后用RL训练MosaicAgent-8B，只用准确率和格式奖励，不提供演示轨迹或工具使用专属奖励；智能体仍学会多步组合视觉操作并产生多样解题策略。

Insight: 多图证据重表示应匹配任务需求：细粒度几何或比较依赖视觉中间结果，高层语义则未必需要。准确率与格式奖励可以驱动模型自发学会组合工具，而非依赖人工示范序列。

Abstract: Multi-image understanding requires MLLMs not only to recognise the content of individual images, but also to organise visual evidence distributed across them. We study this problem through multi-image re-representation, viewing prompted Chain-of-Thought reasoning and agentic visual tool use as different ways of re-organising visual evidence during reasoning. We introduce Mosaic, a general-purpose multi-image visual harness that enables an MLLM to actively construct visual intermediates with ten composable image operations. We compare five re-representation settings on existing multi-image benchmarks and on MosaicBench, a new grounding-focused benchmark for fine-grained multi-image understanding. Our experiments show that the relative benefits of textual and visual re-representation are strongly task-dependent. Visual re-representation is particularly effective for tasks requiring precise visual evidence, including hypothesis testing, precision comparison, and orientation-sensitive reasoning, while tasks dominated by higher-level semantic content show smaller or less consistent gains. Building on this finding, we train MosaicAgent-8B to use Mosaic with reinforcement learning using only accuracy and format rewards. Without demonstration trajectories or rewards for specific tool-use, the agent learns to compose visual operations over multiple steps and exhibits diverse problem-solving patterns unpromptedly. Code and data will be released at https://github.com/gengyuanmax/Mosaic.

[80] EgoTools: Towards Tool-Centric Reasoning in Real-World Egocentric Videos cs.CVPDF

Shulin Tian, Junsu Kim, Shuai Liu, Hao Li, Yujiao Shen

TL;DR: EgoTools提供100小时带音频、密集描述和3D信息的第一视角工具使用数据，并以四类诊断题测量模型从视觉感知到程序及因果推理的能力。

Details

Motivation: 日常和专业具身任务常通过工具完成，理解过程需推理可供性、手—工具—物体几何、操作进度及目标物体受到的因果影响。现有模型虽擅长视频描述和通用问答，但真实第一视角工具推理数据和诊断基准不足。

Result: EgoTools包含两个组成部分：100小时同步音频、密集字幕、推理型叙述及补充3D信息的EgoTools-Data；以及1,000条问答、覆盖感知、几何、程序和因果推理四轨的EgoTools-Bench。当前模型仍难将工具使用落地到视觉证据：Gemini-3.1-Pro总体准确率66.9%，感知与定位仅51.7%。在严格源视频隔离下，使用完整数据监督微调使Qwen3-VL-8B-Instruct在全部1,000题上从50.0%提升到60.9%。

Insight: 工具中心具身理解不能只识别工具或动作，还需把手物几何、步骤进展和动作后果绑定到视频证据。数据集同时用于诊断与训练，揭示通用视频能力和实际工具推理之间的差距。

Abstract: Real-world embodied tasks, from everyday activities to professional procedures, require agents to act under physical constraints while tracking evolving object and task states. Tool use sits at the heart of such tasks, as many everyday and professional activities are tool-mediated. Understanding them requires reasoning about affordances, hand-tool-object geometry, procedural progress, and causal effects on target objects. Yet despite strong performance on perception-oriented video tasks such as captioning and general video QA, current multimodal video models remain limited in this form of tool-centric embodied reasoning. Progress in this direction has been limited by the lack of real-world egocentric data and diagnostic benchmarks. To address this gap, we introduce EgoTools, the first comprehensive suite for egocentric tool-use understanding. It consists of two complementary components: EgoTools-Data, a large-scale corpus of 100 hours of tool-centric egocentric recordings with synchronized audio, dense captions, reasoning-heavy narrations, and supplementary 3D information; and EgoTools-Bench, a diagnostic benchmark of 1,000 QA pairs across four tracks that cover tool-use understanding from perception and geometry to procedure and causal reasoning. Experimental results show that current models still struggle to ground tool use in visual evidence: Gemini-3.1-Pro achieves 66.9% overall accuracy but only 51.7% on Perception & Grounding. Beyond evaluation, we validate EgoTools-Data as a training resource. On the full 1,000-question benchmark, full supervised fine-tuning improves Qwen3-VL-8B-Instruct from 50.0% to 60.9%, under strict source-video separation. Together, these results establish EgoTools as a unified resource for both training and diagnostic evaluation of real-world egocentric tool-use understanding.

[81] InfoAgent: Traceable Generation and Repair of Evidence-Grounded Infographics cs.CVPDF

Yifan Li, Tong Li, Qi Zeng, Lishuai Gao, Ruwei Pan

TL;DR: InfoAgent用带证据来源、执行路径和验证义务的类型化依赖图合成与修复信息图，并仅局部编辑受影响区域。

Details

Motivation: 可靠信息图生成要求事实、符号和视觉关系在渲染和修订过程中保持一致；改正一个元素还需追踪其证据来源及依赖影响。

Result: 训练免费的InfoAgent构建信息图视觉描述（IVD），以类型化依赖图记录事实载荷、证据来源、执行路径及验证义务。检索到的设计先验指导程序编译；分层执行结合栅格合成、可编辑符号对象和绑定对象，并保留过程轨迹。依赖感知修复定位局部更改、重查受影响依赖，要求保护义务仍由指定检查器满足；无法解决的义务显式保留。在IGenBench上Q-ACC 93.0、I-ACC 59.0。新基准InfoGraphicBench-Evidence的200个测试请求中，完整清单通过率由Same-IVD提示的21.5%升至分层初始输出23.5%、修复后28.5%，使用同样证据和初始IVD。120个审计修复案例平均只改12.4%画布，整图重生成平均改67.3%。

Insight: 信息图修订应追踪事实证据与视觉对象依赖，局部改错后重新验证相关约束，而非重生成全图。显式保留未解决义务能避免把未核实内容伪装为已完成。

Abstract: Reliable infographic generation requires facts, symbols, and visual relations to remain consistent through rendering and revision. Correcting one element also requires tracking its supporting evidence and the dependencies affected by the change. We present \textbf{InfoAgent}, a training-free framework for \emph{evidence-bound visual-symbolic program synthesis}. Its Infographic Visual Description (IVD) records factual payloads, evidence provenance, execution routes, and verification obligations in a typed dependency graph. Retrieved design priors guide compilation, and layered execution combines raster synthesis with editable symbolic and binding objects while retaining their traces. Dependency-aware repair localizes corrections, rechecks affected dependencies, and requires protected obligations to remain satisfied under the declared checkers. Unresolved obligations remain explicit. On IGenBench, InfoAgent achieves 93.0 Q-ACC and 59.0 I-ACC. We also introduce InfoGraphicBench-Evidence, where complete-checklist pass rates on 200 test requests increase from 21.5% for Same-IVD Prompt to 23.5% for the initial layered output and 28.5% after repair, using the same evidence and initial IVD. On 120 audited repair cases, localized repair edits 12.4% of the canvas on average, compared with 67.3% for global regeneration.

[82] CAST: Causal Advantage-Structured Training with Spatially Grounded Compositional Rewards for Diffusion Models cs.CV | cs.AI | cs.LGPDF

Shu Yu, Chaochao Lu

TL;DR: CAST依据模型去噪轨迹确定探索噪声窗口，将提示拆成可验证场景原子并按空间位置投影优势信号，以改善扩散模型在线强化学习。

Details

Motivation: 扩散模型流匹配RL存在三个问题：随机探索的SDE去噪窗口通常人工指定；人类评分模型对最新模型打分偏高且差异很小，导致优势估计饱和；单一标量奖励将不同失败模式压成相近分数，缺少定向梯度。

Result: CAST先从每个模型的去噪轨迹识别其确定物体及空间布局的时刻，据此设定SDE窗口；再将提示解析为因果场景图中的可验证原子（物体、数量、属性或空间关系），分别评分；最后通过教师强制注意力把带符号的原子级优势映射到像素空间，对SDE策略目标进行空间加权。作者微调FLUX.2-dev和Qwen-Image-2512，在GenEval 2组合基准及Qwen-Image-Bench质量评测中，近似相同训练预算下，最困难提示的提升最高达到Flow-GRPO相对增益的3.07倍，同时整体生成质量也改善。

Insight: 细粒度可验证的场景原子奖励可区分物体、数量和空间关系等不同失败，并将优势定位回图像区域。探索噪声窗口也应依据模型自身何时确定布局而定，而非手工固定。

Abstract: Online reinforcement learning has been extended to flow matching for diffusion model (DM) image generation. However, this paradigm faces three limitations: (1) Window selection. Existing methods manually set the stochastic differential equation (SDE) sampling window, i.e., the denoising steps where exploration noise is injected. We instead determine it from each model’s denoising trajectory. (2) Reward saturation. Current methods rely on scoring models trained on human annotations; we find that such scores are extremely high and nearly indistinguishable on the latest SOTA open-source DMs, making advantage estimation largely ineffective. (3) Sample inefficiency. A single scalar reward collapses different failure modes into almost identical scores, leaving minimal gradient guidance for targeted improvement. To address these issues, we propose CAST (Causal Advantage-Structured Training), an RL fine-tuning method for pretrained DMs, which (1) identifies the denoising step at which each model fixes the objects and their spatial arrangement in the image and uses that timing to set the SDE window, (2) decomposes each prompt via Causal Scene Graphs (CSG) into verifiable-atoms, i.e., minimal semantic units such as an object, count, attribute, or spatial relation that can each be checked independently, and rewards each atom separately, and (3) projects the signed atom-level advantages into pixel space through teacher-forced attention and uses them to spatially weight the SDE policy objective. We fine-tune two of the strongest open-source DMs, FLUX.2-dev and Qwen-Image-2512, with CAST, and evaluate them on GenEval 2, a compositional benchmark, and on Qwen-Image-Bench for overall quality. Within almost the same training budget, CAST’s improvement over the base model on the most challenging GenEval 2 prompts is up to 3.07x that of Flow-GRPO, while overall generation quality also improves.

[83] DensePed-Lite: Quality-Aware Adaptive Detection for Dense Pedestrians under Occlusion cs.CVPDF

ZiAn Wang, MingZhe Liu, Chaoyi Guo, ChangChun Li, Fangming Gu

TL;DR: DensePed-Lite以可观测质量为依据自适应处理遮挡行人检测，并在置信度、空间覆盖和多尺度融合三个环节协调设计。

Details

Motivation: 密集行人场景有严重遮挡、尺度变化和实时要求，轻量检测器难兼顾准确率与效率，且常忽略质量感知特征及分类和定位一致性，导致拥挤时性能不稳定。

Result: DensePed-Lite围绕一个原则设计：观察不完整时，网络应依据所见质量调整处理，而非假定输入完整。该原则落实于三个受遮挡影响的环节：不可靠置信评分（UQE）、碎片化空间覆盖（MPSC）及不协调的多尺度融合（CTDM）。三机制互相增强而非独立堆叠，复杂度未显著增加。在CityPersons和CrowdHuman上，相较近期先进轻量方法取得更优准确率—效率权衡，适用于密集行人实时检测；摘要未提供具体数值。

Insight: 遮挡会同时造成定位覆盖不全、置信度不准和尺度特征不匹配，单独改进一个模块不足以稳定检测。轻量方法可围绕观测质量原则在三个环节协同适应。

Abstract: Pedestrian detection plays a crucial role in computer vision with applications in autonomous driving, surveillance, and public safety. However, real-world dense scenes bring severe challenges, including heavy occlusion, drastic scale variations, and strict real-time requirements. Existing lightweight detectors struggle to balance accuracy and efficiency while often neglecting quality-aware feature modeling and consistency between classification and localization, leading to unstable performance under crowded conditions. To address these issues, we propose DensePed-Lite, a unified framework built on a single principle: under occlusion the network should adapt its behavior to the quality of what it observes rather than assume complete information. This principle is realized at three points where occlusion does the most damage: unreliable confidence scoring (UQE), fragmented spatial coverage (MPSC), and incoherent multi-scale fusion (CTDM). The three mechanisms reinforce one another instead of acting in isolation, all without significantly increasing complexity. Experiments on CityPersons and CrowdHuman validate that DensePed-Lite achieves a superior accuracy-efficiency trade-off compared with recent state-of-the-art lightweight methods, making it suitable for real-time deployment in dense pedestrian scenarios.

[84] From Wrecks to Wisdom: Recovering Crash Mechanics from Real-World Multi-View Photos cs.CVPDF

Ondřej Valach, Václav Diviš, Ivan Gruber

TL;DR: 作者研究仅凭事故后多视角车辆照片能恢复哪些碰撞力学描述，并建立基于照片集预测变形类别和速度变化的评测方案。

Details

Motivation: 碰撞构型、主要受力方向和ΔV等关键事故元数据可能缺失、延迟或损坏，但事故后照片常可获得且包含丰富车辆变形线索。

Result: 任务从每起事故的多视角照片集预测六类碰撞变形分类（CDC）描述及重建ΔV的纵向、横向分量。共享视觉骨干编码每张照片，再融合视角特征形成案件表示，由目标专属头预测各描述。数据来自Crash Investigation Sampling System：过滤前约150万张照片，构成1.52万训练案件、1,150验证和1,150测试案件。事故后图像能支持若干非平凡力学描述，但弱可观测和长尾目标仍困难。所比较训练设置中，选定联合训练方案将主要受力方向平均绝对角误差从20.1°降至14.05°，纵向ΔV MAE从8.04降至7.45 km/h。

Insight: 多视角事故照片包含可用碰撞力学信号，但不同目标从图像中可观测程度不同。该工作建立了缺少结构化元数据时的视觉基线，为后续融合事故记录等结构数据提供参照。

Abstract: Estimating accident mechanics from real-world crashes is important for vehicle-safety analysis, injury modeling, crash-severity prediction, and operational workflows such as insurance claim triage. In standard crash records, key metadata such as impact configuration, principal direction of force, and change in velocity ($ΔV$) may be missing, delayed, or corrupted, while post-crash photographs are widely available and contain rich visual evidence of deformation. We study how much crash-mechanics information can be recovered directly from vehicle photos when structured signals are absent. We formulate crash understanding as supervised prediction from per-case multi-view photo sets. Targets include six Collision Deformation Classification (CDC) descriptors and the longitudinal and lateral components of reconstructed $ΔV$. Each photo is encoded by a shared visual backbone, and the resulting view-level features are fused into a case-level representation from which target-specific heads predict crash descriptors. Using 15.2k training cases from the Crash Investigation Sampling System, drawn from about 1.5M photos before filtering, together with 1.15k validation and 1.15k test cases, we define an evaluation protocol for vision-based crash descriptor estimation from incomplete multi-view evidence. Post-crash imagery alone provides usable signal for several non-trivial crash-mechanics descriptors, while weakly observable and long-tailed targets remain challenging. Within the compared training regimes, the selected joint-training recipe reduces mean absolute angular error for principal direction of force from 20.1 to 14.05 degrees and longitudinal $ΔV$ MAE from 8.04 to 7.45 km/h. Our work provides a reference point for future multimodal fusion with structured crash metadata.

[85] OmniReasoning: Pushing the Limits of Audio-Visual Joint Reasoning cs.CV | cs.AIPDF

Junming Lin, Yuxuan Wang, Zhenxin Lei, Yuxin Liu, Ruixun Liu

TL;DR: OmniReasoningBench、OmniQA数据引擎和MFSD训练方法共同面向必须联合使用音频与视频证据的多模态推理任务。

Details

Motivation: 全模态模型已能处理音频、视觉和语言，但现有基准、训练数据和学习方法多将模态分开，音视频联合推理能力缺乏充分评估和训练。

Result: OmniReasoningBench包含1,150道选择题和开放题，覆盖视频内推理与超越视频推理，要求音视频证据都不可或缺。OmniQA自动构造带证据依据的问答及带时间戳线索链，并生成OmniReasoning-SFT-112K和RL-19K数据。模态因子化自蒸馏（MFSD）在模态专属线索上下文下评估每条采样回答，分解单条线索和跨模态交互的贡献以进行token级信用分配。训练后OmniReasoning-30B-A3B在OmniVideoBench和OmniReasoningBench分别达50.0%、42.5%，比Qwen3-Omni基座高12.8、9.3个百分点；Video-MME-v2等通用及长视频基准也有显著提升。

Insight: 音视频联合推理需要构造单模态无法回答的问题，并为各模态证据及其交互分配细粒度学习信号。基准、证据链数据和模态因子化蒸馏共同覆盖了评测与训练缺口。

Abstract: Recent advances have enabled unified omni-modal models in understanding audio, vision, and language. However, existing benchmarks, training data, and learning methods largely treat the modalities independently, leaving the capability of audio-visual joint reasoning poorly evaluated and insufficiently elicited. We address this gap with a benchmark, data engine, and learning method. First, we introduce OmniReasoningBench, a benchmark where both audio and visual evidence are indispensable. It comprises 1,150 multiple-choice and open-ended questions across two tasks, reasoning over video and reasoning beyond video. Second, we develop a data engine OmniQA. It automatically constructs evidence-grounded QA pairs that explicitly necessitate audio-visual joint reasoning, together with time-stamped clue chains that guide the annotation of thinking process. Besides our benchmark, this engine produces training data OmniReasoning-SFT-112K and OmniReasoning-RL-19K. Finally, we propose an on-policy self-distillation method Modality-Factored Self-Distillation (MFSD). It evaluates each sampled response under modality-specific clue contexts, disentangling the contributions of individual clues and their cross-modal interactions for token-level credit assignment. With our training data and learning method, our model OmniReasoning-30B-A3B achieves 50.0% on OmniVideoBench and 42.5% on OmniReasoningBench, improving the base model Qwen3-Omni-30B-A3B-Thinking by 12.8 and 9.3 percentage points, respectively. Moreover, it delivers substantial gains on general and long-video benchmarks, including Video-MME-v2. We hope our work offers a solid step for facilitating future research in omni-modal joint reasoning.

[86] Front-to-Back: Benchmarking Vision-Language Models for Asymmetric Cross-View Vehicle Re-Identification cs.CVPDF

Moseli Mots’oehli, Thulani Babeli

TL;DR: Front2Back-ReID评测视觉语言模型能否将前摄像头中的车辆与稍后后摄像头候选对应，发现目标裁剪优于全景输入且人类仍明显更可靠。

Details

Motivation: 在车头和车尾摄像头之间匹配同一车辆困难，因为两个视角完全不同且车辆外观变化大；该场景可检验VLM跨视角实体匹配能力。

Result: 基准包含南非20段录制序列中的500次人工验证车辆交接，每题要求从前摄像头图像定位车辆，并在稍后后摄图像至少三个候选中匹配。评估七个零样本VLM、四种图像检索基线和25名人类，分别测试完整前视图、目标裁剪和二值剪影。最强VLM在目标裁剪上Rank-1准确率76.6%，冻结SigLIP2为74.0%，差异统计上不明确；人类完整图像为94.0%，裁剪为92.2%。在所有能比较两种模式的模型中，启用推理均提高三种输入设置准确率；VLM通常在全场景图上差于目标裁剪。

Insight: 跨视角车辆身份匹配时，目标局部外观比完整场景更有用，但通用VLM仍未稳定超越视觉检索基线。人类准确率显著更高，说明该任务仍有较大语义对应能力差距。

Abstract: Matching the same vehicle across front and rear cameras is difficult because the cameras do not share a view and the vehicle’s appearance changes substantially. We introduce Front2Back-ReID, a benchmark of 500 manually verified vehicle handovers from 20 recording sequences in South Africa. Each example asks a model to match a vehicle highlighted in a front-camera image to the same vehicle among at least three candidates in a later rear-camera image. We evaluate seven zero-shot vision-language models, four image-retrieval baselines, and 25 human participants. Models are tested using full front RGB images, cropped target vehicles, and binary silhouettes. The strongest VLM achieved 76.6 percent Rank-1 accuracy on target crops, compared with 74.0 percent for the frozen SigLIP2 baseline; this difference was not statistically clear. Human participants achieved 94.0 percent accuracy with full images and 92.2 percent with target crops. Under our evaluation setup, enabling reasoning improved accuracy across all three input conditions for every model evaluated in both modes. We also found that VLMs generally performed worse on full scenes than on target crops. These results show that general-purpose VLMs do not yet consistently outperform strong visual retrieval for front-to-rear vehicle matching, while humans remain substantially more reliable.

[87] PartiCam: Camera Controlled Video Generation with Reward Guidance cs.CV | cs.AIPDF

Amine Ouasfi, Runjia Li, Junlin Han, Eric Marchand, Philip H. S. Torr

TL;DR: PartiCam用粒子滤波式序贯蒙特卡洛奖励引导，在测试时控制预训练视频生成器遵循指定相机轨迹，无需重新训练。

Details

Motivation: 大型视频扩散模型难以精确遵循相机轨迹。训练自由引导不需要大规模相机标注数据，也能产生后续可用于训练相机条件生成器的视频；现有采样引导却容易探索过散或过早坍缩。

Result: PartiCam提出全局—局部扩散奖励细化框架，基于序贯蒙特卡洛（SMC）引导，增加粒子滤波重采样的局部细化阶段，旨在平衡轨迹精度与视觉多样性。实验显示它大幅提升相机轨迹遵循、减少漂移并改善视觉质量，无需重新训练生成模型；摘要未列具体基准数值。

Insight: 相机控制要求在全局目标轨迹与局部生成质量间持续平衡，单纯采样引导可能过度发散或过早失去多样性。粒子重采样式局部细化为预训练模型提供无需微调的轨迹控制方式。

Abstract: We present PartiCam, a training-free Particle filtering rooted method for improved Camera controlled video generation. Generating videos that follow a precisely specified camera trajectory remains challenging for large video diffusion models. Training-free approaches are backbone-agnostic and avoid the need to construct large camera-annotated datasets by steering pretrained models toward the desired camera motion at test time. This enables the generation of camera-controlled video data that can subsequently be used to train camera-conditioned video diffusion models. Existing sampling-based guidance approaches often suffer from unstable trajectories: they either explore too broadly and fail to respect the target camera motion or collapse early and lose visual diversity over time. We introduce a global-local refinement framework for diffusion reward guidance, enabling accurate and consistent camera control during video generation. Our method builds on Sequential Monte-Carlo (SMC) guidance, but introduces a local refinement stage based on particle filtered resampling. Experiments show large improvements in camera trajectory adherence, reduced drift, and better visual quality, without requiring model retraining.

[88] Comparative study of adapting pre-trained models for driving behavior video captioning cs.CV | cs.LGPDF

Sayak Mallick, Philipp Geiger, Augustin Kelava

TL;DR: 报告比较SpaceTimeGPT上的视频全量微调与VideoLLaVA上的LoRA、提示工程等预训练模型适配方式，用于自动驾驶行为视频描述。

Details

Motivation: 作者希望比较多种微调和提示方法如何将视频语言模型适配到自动驾驶领域，并使模型对驾驶场景形成紧凑理解。

Result: 研究在BDD-X（Berkeley DeepDrive explanation）数据集上评估SpaceTimeGPT全量微调，部分自动指标表现良好且在个别指标超过基线；也尝试VideoLLaVA的LoRA和提示工程，并讨论其局限。摘要未报告样本规模和具体指标，也未说明显著性检验。

Insight: 报告关注适配策略在驾驶场景描述中的效果，但摘要只提供定性比较，尚不足以判断不同方法的稳定性或优势幅度。

Abstract: This report examines and compares some of the many fine tuning and prompting methods existing, applying them within the domain of autonomous driving. The idea is to compare these methods by adapting a Large Language Model (LLM) on a video dataset. LLM’s have become extremely good at achieving a good understanding of different forms of data and this study aims to induce a low dimensional understanding of driving situations into our primary test model SpaceTimeGPT. Experiments on BDD-X (Berkeley DeepDrive eXplanation) dataset demonstrate good performance of the full fine tuning framework on some automatic metrics, and in some metrics, it even surpasses the baseline. We also try Low-Rank Adaptation (LoRA) and prompt engineering on VideoLLaVA model and discuss its limitations.

[89] RESUME: Recurrent State Updates from Motion and Residual Signals for Efficient Video Language Modeling cs.CVPDF

Can Zhang, Xiaotian Han, Junyuan Shang, Yuchen Ding, Zhenyu Zhang

TL;DR: RESUME将视频编解码预测帧作为对紧凑潜状态的时序更新，而非独立token组，从而以相同帧级token预算保留运动顺序及长程状态。

Details

Motivation: 现有视频语言模型独立编码采样RGB帧，长视频要么耗尽token预算，要么丢失帧间变化。利用编解码运动向量和残差的方法仍把每个预测帧独立token化，没有显式携带参考状态；因此丢失变化顺序信息。

Result: RESUME以锚定I帧初始化紧凑潜状态，每个后续预测帧作为状态更新，之后共享读出将累积状态转换为VLM兼容token，使语言模型接收一条表示轨迹而非独立token组。每个预测帧token预算与既有编解码方法相同。十个基准上，收益集中在时间推理：三个时间基准上均超过RGB帧基线LLaVA-Video-7B，TempCompass、TOMATO、MVBench分别高2.8、5.1、3.9分，也超过基于编解码的CoPE-7B；通用和长视频问答表现有竞争力。冻结转移测试还显示状态依赖、顺序敏感及超训练范围的有效rollout。

Insight: 视频表示不仅要编码当前帧内容，还应累积前后变化形成状态；反转时间顺序保留帧集合却改变动态，独立帧池化无法表达这一差异。状态式编解码表示更适合时间推理。

Abstract: Existing video language models encode sampled RGB frames independently, so a long video must either exhaust the token budget or drop the changes between sampled frames. Codec-aware front-ends read the motion vectors and residuals that encoding produced, but in their deployed form each predictive frame is still tokenized on its own: the tokens are a function of the current primitives, not of a carried reference. We argue that a more natural function is of both—the current primitives and a carried reference. A clip and its time reversal share the same frames and differ only in the order of changes—an axis that symmetric pooling discards by construction, and that is non-empty in the frozen vision features VideoLMs use—and the codec recurrence already composes those changes in order against a reference state. We introduce RESUME, a stateful codec representation: an anchor I-frame initializes a compact latent state, each subsequent predictive frame is consumed as an update to that state, and a shared readout exposes VideoLM-compatible tokens from the accumulated state. Codec prediction is thereby kept at the representation level and handed to the language model as a trajectory, not as a set of independent token groups. At the same per-predictive-frame token budget as prior codec-aware methods, a predictive frame enters the language model as a readout of what the front-end already knows, not as an encoding of the current primitives alone. Across ten benchmarks, the gains concentrate on temporal reasoning: on all three temporal benchmarks RESUME improves over both the RGB-frame baseline LLaVA-Video-7B (by 2.8, 5.1, and 3.9 points on TempCompass, TOMATO, and MVBench) and the codec-based baseline CoPE-7B, while staying competitive on general and long-form QA. Frozen-transition tests further show anchor dependence, order sensitivity, and useful rollout behavior beyond the training horizon.

[90] From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning cs.CVPDF

Minye Shao, Chaohui Yu, Yixuan Wu, Fan Wang, Ling Shao

TL;DR: CASE让临床智能体主动在病历和纵向影像中搜集证据，再形成结论，而不是只在预先给定的证据上推理。

Details

Motivation: 常规医学基准评测的是模型利用预选证据的能力，很少考查它能否在临床记录和多次影像随访之间主动寻找证据。真实临床推理需决定查看何次就诊、哪个器官、影像模态、切片或专科工具。

Result: CASE由角色专属临床证据搜索智能体、工具harness和紧凑视觉语言策略后训练组成。UK Biobank基准含50,401个来自4,739名参与者真实ICD-10诊断的问题，每题连接临床背景和基线/随访多序列MRI环境。SFT用14,734条前沿模型交互轨迹教授搜索流程，随后用学习者自身交互进行智能体RL；特权在线自蒸馏及量表式LLM反馈细化证据到结论推理，不预先指定工具序列。匹配评测下，Qwen3-VL-8B方案回答准确率相对GPT-5.4和Claude Opus 4.8分别提高超过16%和10%。

Insight: 临床智能体应学会“调查”而非只模仿问答：依据患者状态主动选择证据和工具，再在证据基础上得出结论。工具选择保持灵活，可促进跨场景迁移。

Abstract: Foundation models can serve as clinical agents through tool-use harnesses. However, conventional medical benchmarks assess reasoning over preselected evidence rather than the ability to seek it across clinical records and longitudinal imaging. We propose CASE: a series of role-specific Clinical Agents for Seeking Evidence, together with a tool-use harness and an agentic post-training framework for compact vision-language policy models. We further introduce a longitudinal multimodal benchmark built on UK Biobank, comprising 50,401 clinical questions derived from real-world ICD-10-coded diagnoses of 4,739 participants. Each question links to a patient-specific environment containing clinical context and multi-sequence MRI from baseline and follow-up visits, where agents autonomously select which visits, organs, modalities, slices, and specialist tools to inspect and compare. Supervised fine-tuning transfers evidence-seeking workflows from 14,734 frontier-model interaction trajectories, followed by agentic reinforcement learning on the learner’s own environment interactions. Privileged on-policy self-distillation and rubric-based LLM feedback refine evidence-to-conclusion reasoning without prescribing tool sequences. Experiments show that CASE moves beyond question-answer imitation toward transferable investigation policies, strengthening evidence-grounded longitudinal reasoning. Under matched evaluation conditions, our Qwen3-VL-8B based agent achieves over 16% and 10% relative improvements in answer accuracy over GPT-5.4 and Claude Opus 4.8. Code will be available at https://github.com/VinyehShaw/CASE.

[91] A Generalizable and Explainable Framework for Synthetic Video Detection Using First-Digit Gradient Statistics cs.CVPDF

Sidharth Shanu, Gautam Kumar, Tej Singh

TL;DR: 该方法以Sobel梯度首位数字统计检测合成视频，结合线性判别分析解释信号并用MLP分类，测试其跨生成器和场景泛化。

Details

Motivation: 合成视频越来越逼真且题材多样。CNN检测器通常缺少可解释性；取证特征方法又可能只适用于预设场景或复杂到难以理解。

Result: 作者计算视频的Sobel梯度值并分析其首位数字分布，以线性判别分析可视化区分信号，再由多层感知机完成分类。方法不使用生成器或场景专属特征，也不利用容器格式、编码器、码率和压缩伪影。训练测试覆盖GenBuster-200K、GenBusterBench、GenVA、FaceForensics++ C23和CelebDF。研究还发现，即使所用特征含判别信息，零样本检测仍会失败；摘要未给具体检测分数。

Insight: 低层统计特征可提供较可解释的生成痕迹，但特征中存在信号并不意味着分类器能跨分布识别。应把基准内检测能力和真正的零样本泛化分开评价。

Abstract: AI video generators have not only become harder to detect but are used to generate a diverse set of scenarios from landscapes to street views to animal videos. This creates a problem where CNN-based detectors are effective but offer no insight into their inner workings, while forensics-based detectors are often pretrained for a set scenario or become too complex to derive meaningful insights. We present a novel approach to AI video detection using Sobel gradient values analysed with the first-digit law. Using linear discriminant analysis, we visualise the discriminatory signal, while a multi-layer perceptron is used for classification. The detection method has no generator- or scenespecific features, and the model has no knowledge of container formats, codec, bitrate, or compression artefacts. The model is trained and tested on GenBuster-200K, GenBusterBench, GenVA, FaceForensics++ C23, and CelebDF. We also show how zero-shot detection fails even though the feature set carries a discriminatory signal.

[92] KilometerVision: A New Frontier for Large-Scale Spatial Intelligence in VLMs cs.CV | cs.LGPDF

Aravindh Mahendran, Michael King, Matthew Koichi Grimes, Antoine Yang, Tyler Zhu

TL;DR: KilometerVision用最长达1公里的真实视频评测VLM是否能从地标、路径到全局地图逐层理解大尺度地理布局。

Details

Motivation: 现有视觉语言模型的空间评估多聚焦局部或短距离场景，尚不清楚它们能否从真实视频形成公里级环境布局认知。

Result: 基准评估人类空间认知的三个层级：借助地标锚定位置、通过路线连接地点、整合成全局心智地图。实验揭示当前AI处理空间信息与人类认知的根本差异：VLM几乎完全依赖二维视觉识别和文字匹配，没有表现出真正的路径积分或几何测绘知识。摘要未列各模型分数。

Insight: 识别地标并不等于理解它们之间的空间关系。大尺度视觉智能需要沿路径整合位置并形成几何一致的全局地图，而非依赖局部外观或文本标签。

Abstract: We push the frontier of large-scale spatial intelligence in Vision-Language Models (VLMs) and introduce the first benchmark that probes geographical layout understanding from real-world videos, spanning up to 1km distances. Inspired by the cognitive science literature, we evaluate models against the hierarchical stages of human spatial awareness: anchoring via landmarks, connecting them through routes, and integrating these into global mental maps. Extensive experiments reveal a fundamental divergence in how current AI models process spatial information. Instead of utilising true path integration or forming geometric survey knowledge, we find that VLMs rely almost entirely on 2D visual recognition and text-matching to bypass complex spatial reasoning. The benchmark is publicly available at https://perception-test-challenge.github.io/kilometervision.html.

[93] SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images cs.CVPDF

Guibiao Liao, Mochu Xiang, Heng Li, Ken Deng, Zijie Wang

TL;DR: SPOON用多视角重建几何统一协调物体与相机位姿，将组合式3D生成转化为全局场景级空间推理。

Details

Motivation: 图像条件3D生成器能够单独生成高质量物体，但把它们摆成全局一致场景并匹配多视角图像仍困难。逐视角分别估计物体位姿容易歧义，产生不连贯的对象—相机组合。

Result: SPOON提出Guide-Route-Reconcile流程，使用重建得到的多视角几何协调不同视角下物体位姿假设与相机配置，逐步建立一致场景布局。在ARSG-110K和MIDI-3D-Front上，对不同数量输入视图均持续提升物体放置与场景组合质量。ARSG-110K上，相较强基线，场景级Chamfer距离降低12.7%，物体级降低17.7%。

Insight: 高质量物体资产只是复杂3D场景生成的一部分，跨视角几何需要统一约束对象和相机。场景级位姿协调可减少各视角独立估计再拼接导致的不一致。

Abstract: Compositional 3D scene generation aims to recover complete 3D object shapes and their spatial arrangement from visual observations. Recent image-conditioned 3D generators provide strong priors for producing high-quality object geometry, making the generation of complex scenes increasingly practical. A central challenge is therefore to spatially organize these generated assets into a globally coherent scene while remaining consistent with multi-view observations. Existing approaches either entangle scene layout with object generation or separately estimate spatial placement from view-specific observations, where pose hypotheses may remain ambiguous and inconsistent across views, often resulting in an incoherent object-camera soup. We introduce SPOON, a framework that reformulates multi-view compositional 3D generation as scene-level, geometry-grounded pose reasoning. Rather than treating view-specific object pose hypotheses independently, SPOON coordinates them using reconstruction-derived multi-view geometry through a Guide-Route-Reconcile paradigm. This progressively organizes object poses and camera configurations into a coherent scene-level spatial arrangement. Extensive experiments on ARSG-110K and MIDI-3D-Front demonstrate consistent improvements in object placement and scene composition across varying numbers of input views. On ARSG-110K, SPOON reduces scene-level and object-level Chamfer distances by 12.7% and 17.7%, respectively, compared with a strong baseline.

[94] GroundAnything: Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed cs.CV | cs.AI | cs.LG | cs.ROPDF

Qize Yu, Lianrui Fan, Bowen Ping, Xini Ding, Zetian Song

TL;DR: GroundAnything用块状扩散并行生成和联合细化空间定位结果，兼顾视觉落地精度与低延迟。

Details

Motivation: 自回归落地模型串行生成空间预测，造成延迟并强加不必要的输出顺序；图像和查询对物体、位置及关系的约束是联合的，并无天然左到右顺序。

Result: GroundAnything是4B参数落地基础模型，块状去噪让空间假设并行出现并迭代联合优化。训练包括公开数据预训练、专用数据引擎、AR到扩散转换及联合目标、监督微调和GRPO后训练。30个基准上，其自回归变体GroundAnything-VLM在同尺寸模型中总体第一，72.42%，高于GPT-6 Astra的71.35%。熵引导解码平均61.75%，超过同规模此前快速MTP方法LocateAnything的53.32%。可选自推测解码相较AR版本快4.51倍，COCO F1mIoU仅下降0.74个百分点；渐进式推理优化也带来实际加速。

Insight: 空间定位可通过并行提出候选、联合迭代细化实现，不需遵循固定token顺序。块状解码结合熵引导和自推测模式，为精度和响应速度提供不同运行点。

Abstract: Autoregressive (AR) grounding models serialize spatial predictions, introducing sequential latency and imposing a causal order on output tokens. We view grounding as visual evidence extraction: objects, locations, and spatial relations are jointly constrained by the image and query, yet their dependencies do not imply an intrinsic left-to-right generation order. This distinction makes bidirectional diffusion a natural fit, allowing spatial hypotheses to emerge in parallel and be jointly refined through iterative denoising. We introduce GroundAnything, a 4B-parameter grounding foundation model that reconciles fast parallel decoding with precise localization through blockwise denoising. Training combines grounding pretraining from public datasets and dedicated data engines, direct AR-to-diffusion conversion with joint AR and diffusion objectives, supervised fine-tuning, and GRPO-based reinforcement post-training. Across 30 grounding benchmarks, our autoregressive variant, GroundAnything-VLM, establishes a new overall state of the art among similarly sized models at 72.42%, remaining competitive with GPT-6 Astra (71.35%). With entropy-guided decoding, GroundAnything also surpasses the prior state of the art at this scale, averaging 61.75% versus 53.32% for the fast MTP-based LocateAnything model. We further explore decoding strategies, showing that an optional self-speculative mode achieves a $4.51\times$ speedup over the AR counterpart with a 0.74 percentage-point drop in COCO F1mIoU. Infrastructure experiments show that progressive inference optimizations translate parallel decoding into practical speedups. These support efficient visual grounding in latency-sensitive real-world systems.

[95] GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives cs.CV | cs.AI | cs.LG | cs.ROPDF

Qize Yu, Lianrui Fan, Boyu Chen, Jiaqi Liang, Xini Ding

TL;DR: GroundingPI将点和框坐标统一量化为词表token，构建4B视觉定位基础模型，并验证其作为机器人操作和自动驾驶感知骨干的价值。

Details

Motivation: 精确定位需在杂乱背景和微小对象中找准目标，同时足够快以支持闭环控制；现有VLA和世界动作模型使用的通用VLM/视频生成骨干在这类场景仍易失败。

Result: GroundingPI把点和框以共享词表中的量化坐标生成。训练结合多模态与空间预训练、SFT、GRPO及公共数据和专用数据引擎。44个基线、34个基准和11类感知能力上，平均73.68%，超过更大的GPT-6 Astra（71.54%）。作为视觉骨干用于RoboTwin 2.0时，四个OOD设置均超过受测主流骨干，最高相对优势24.8%；RoboCasa-GR1上用50%演示数据训练的模型超过基线用75%数据训练的表现；nuScenes开环L2误差0.296米。预训练规模增加时驾驶和操作能力提升，密集定位监督有益于两类任务，OCR也可能促进感知学习。

Insight: 专门的点框定位训练可作为物理智能基础，而不只作为单项检测任务；准确空间表征能向下游控制提供更可用视觉接口。多能力数据设计和密集落地监督对操作及驾驶迁移均有帮助。

Abstract: Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fast enough for closed-loop control. Yet vision-language-action (VLA) and world-action models (WAMs) take perception from general-purpose vision-language and video-generation backbones, which still fail in these settings. We introduce GroundingPI, a 4B grounding foundation model that generates points and boxes as quantized coordinates in a shared vocabulary. Training combines multimodal and spatial pretraining, supervised fine-tuning, and reinforcement learning with GRPO, using supervision from public datasets and dedicated data engines. Against 44 baselines across 34 grounding benchmarks spanning 11 perceptual capabilities, GroundingPI establishes a new state of the art, averaging 73.68%, above the larger GPT-6 Astra (71.54%). As a downstream visual backbone, GroundingPI improves performance on robotic manipulation and autonomous driving. On RoboTwin 2.0, it outperforms every mainstream backbone we evaluate in all four out-of-distribution settings, by up to 24.8% relative to the strongest backbone. On RoboCasa-GR1, GroundingPI trained with 50% of the demonstrations outperforms those baselines trained with 75%. On nuScenes, used as the visual backbone, GroundingPI attains an average open-loop L2 error of 0.296 m. We systematically analyze GroundingPI’s pretraining in scale and data composition. Downstream autonomous driving and robotic manipulation improve as the pretraining is scaled. Analyzing the data recipe across these 11 perceptual capabilities shows dense grounding’s substantial benefits for both, and OCR’s potential as a catalyst for perceptual learning. These results support grounding as a perceptual foundation, and dedicated perceptual pretraining as a promising direction for foundation models of physical intelligence.

[96] FOMO: Forget the Concept, Don’t Miss Out on the Scene in Selective Video Unlearning cs.CVPDF

Łukasz Rudnik, Agnieszka Polowczyk, Alicja Polowczyk, Przemysław Spurek

TL;DR: FOMO在视频概念遗忘中同时优化目标概念删除和非目标场景保留，并将遗忘范围扩展到由时间行为定义的运动概念。

Details

Motivation: 生成视频模型可产生逼真连贯内容，但网络训练数据可能含不良概念。现有遗忘方法多针对静态对象、身份或不安全外观，较少考虑动作；移除目标概念也可能意外改变背景、构图和整体动态。

Result: FOMO是训练式选择性视频遗忘方法，将目标分成“改变什么”和“保留什么”两个目标：定位概念相关表示并修改，同时无需辅助数据地保持非目标场景信息；除删除不良概念外，还将生成导向指定安全替代。方法进一步处理以时间行为而非固定空间区域定义的运动遗忘。在不安全内容、对象和运动概念实验中，取得概念删除与场景保留之间最佳权衡；摘要未提供量化指标。

Insight: 视频遗忘不能只测目标概念是否消失，还要衡量背景、构图和非目标运动是否被保留。将删除与场景保真作为并列目标，避免通过大幅破坏整段视频来获得表面遗忘。

Abstract: The rapid advancement of generative video models has enabled the synthesis of increasingly realistic and temporally coherent videos, while also raising concerns about the generation of harmful content. The reliance on large-scale web datasets during training inevitably exposes these models to undesirable material, making concept unlearning an essential mitigation. Existing methods mainly target static visual concepts, such as objects, identities, or unsafe appearance, largely overlooking motion unlearning. Furthermore, these approaches often pay little attention to preserving the surrounding scene. As a result, successful concept removal may unintentionally alter the background, composition, or overall video dynamics. We argue that effective unlearning should ideally change only what is targeted, while minimizing unnecessary changes to the remaining scene. In this work, we introduce FOMO, to the best of our knowledge the first training-based selective video unlearning method that directly treats preservation of the original scene as a priority. We formulate unlearning around two complementary objectives: what to change and what to preserve. Our method localizes concept-related representations and modifies them, while the preservation mechanism maintains non-target scene information without requiring auxiliary data. Beyond simply erasing unwanted concepts, FOMO explicitly redirects the generation toward a specified safe alternative. We further extend this formulation to motion unlearning, where the concept is defined by temporal behavior rather than a fixed spatial region. Our solution achieves effective unlearning across unsafe content, object, and motion concepts, while achieving the best trade-off between concept removal and scene preservation. Code: https://github.com/gmum/FOMO Project Page https://gmum.github.io/FOMO

[97] Introduction to Computer Vision cs.CVPDF

Stan Birchfield

TL;DR: 该教材以代码优先方式系统讲授计算机视觉，从二维处理和三维几何到深度学习，并逐项用数值结果对照OpenCV/PyTorch实现。

Details

Motivation: 学生和实践者需要既理解视觉算法数学原理，也能看到算法在真实与合成数据上的具体行为及工程实现。

Result: 全书44个短章节分三部分，涵盖图像算术、形态学、卷积、金字塔、频域滤波、特征检测、光流、立体视觉、投影几何、标定、SfM，以及从神经元、CNN、反向传播、迁移学习到检测和语义/实例分割。每种技术都用Python和NumPy或PyTorch直接实现，并数值对照相应OpenCV或PyTorch函数；最后覆盖混合精度和并行训练等工程事项。内容由公开课程笔记辅助整理，保留经过验证、可复现的实现。

Insight: 代码与数值验证将视觉方法从公式连接到实际库行为，适合建立可复现的算法直觉。教材覆盖从经典几何到现代学习系统的一条完整学习路径。

Abstract: This book presents a code-first introduction to computer vision, spanning classical 2D image processing, classical 3D vision, and deep learning. Organized as 44 short chapters across three parts, the book builds each topic from first principles: image arithmetic and morphology; convolution, pyramids, and frequency-domain filtering; feature detection, optical flow, and stereo; projective geometry, camera calibration, and structure from motion; and the full arc of modern deep learning, from a single neuron through convolutional networks, backpropagation, classic architectures, transfer learning, object detection, and semantic and instance segmentation, concluding with engineering considerations like mixed-precision and parallel training. Every technique is implemented directly in Python and NumPy or PyTorch and checked numerically against the corresponding OpenCV or PyTorch library function, so readers see not just the mathematics but its concrete behavior on real and synthetic data. The material was distilled with AI assistance from freely available online course notes, condensing extensive working code into concise mathematical exposition while preserving verified, reproducible results throughout. It is intended as a self-contained reference for students and practitioners who want to understand computer vision algorithms and their Python implementations.

[98] FANVIDv2: Evaluating Video Super-Resolution by Face and Licence-Plate Recognition Under Compound Degradation cs.CVPDF

Kavitha Viswanathan, Vrinda Goel, Shlesh Gholap, Devayan Ghosh, Madhav Gupta

TL;DR: FANVIDv2用人脸身份识别和车牌转写表现评估视频超分，而不只依赖PSNR/SSIM，并模拟模糊、噪声、压缩等复合退化。

Details

Motivation: 监控场景的视频超分目标是让人脸和车牌可识别，但常见评测用双三次降采样及PSNR/SSIM，不能直接反映识别任务效用。

Result: FANVIDv2含320×180低分辨率片段及高分辨率参考：48名公众人物各有一张图库图，另含375段、覆盖360种车牌字符串的视频。低分辨率采用随机复合退化（模糊、缩放抖动、传感噪声、JPEG压缩和末级降采样）。FaceRecBox仅在检测到且身份识别正确时计分；TextRecBox按定位质量加权车牌字符归一编辑距离。2.3M参数RCDM基线上，FaceRecBox由0.6864升至0.7222，匹配人脸身份准确率84.35%升至86.93%，TextRecBox从0.3088升至0.3667；残差图门控变体车牌分数达0.3801。

Insight: 超分应以最终识别是否成功评价，而不只看像素相似度。复合真实退化和定位—识别联合分数更符合监控用途，并能揭示图像质量对下游任务的影响。

Abstract: Video super-resolution (VSR) is normally judged by PSNR and SSIM on clips that were downsampled bicubically, although in surveillance its purpose is to make faces and licence plates \emph{recognisable}. We present FANVIDv2, a benchmark that scores VSR by what a recognition pipeline can do with its output. FANVIDv2 provides $320\times180$ low-resolution (LR) clips with high-resolution (HR) references for 48 public figures (with one HR gallery image each) and 375 licence-plate clips covering 360 distinct plate strings. LR clips are generated with a randomised compound degradation (blur, resize jitter, sensor noise, JPEG compression, final downsampling) rather than bicubic downsampling alone. Two metrics score recognition \emph{inside} detections: FaceRecBox rewards a face only if it is localised and correctly identified, and TextRecBox scores plate transcriptions by normalised edit distance weighted by localisation quality. With a 2.3,M-parameter VSR baseline (RCDM), FaceRecBox rises from 0.6864 to 0.7222, identity accuracy on matched faces from 84.35% to 86.93%, and TextRecBox from 0.3088 to 0.3667; a residual-map gated variant (RCDM-RMGF) reaches 0.3801 on plates. We describe the degradation model, the baseline architectures and the scorers in detail, and release annotations, metadata, download and degradation scripts and evaluation code.

[99] Typographic Attack Against VLM-based AI-generated Image Detection cs.CVPDF

Eunmin Lee, Jungwoo Kim, Jong-Seok Lee

TL;DR: 研究系统评估图像内文字覆盖如何诱导VLM误判AI生成图像真实性，并比较攻击方向、推理模式、模型规模及纠错提示。

Details

Motivation: VLM常用自然语言解释图像真伪，但对图中文字的理解也可能让其判断受误导语义线索操纵。

Result: 作者在检测导向、开源和商用VLM上系统测试排版/文字攻击，覆盖真实图攻击为假与生成图攻击为真两个方向。推理模式通常比直接模式更脆弱，攻击效果存在明显方向不对称；模型越大，干净检测准确率往往更高，但攻击成功率也更高。研究还考察图像和文本变换后的攻击鲁棒性，并测试标注正确类别的文字覆盖是否能帮助模型纠错。摘要未提供具体成功率。

Insight: VLM的真实性判断可能被图像内文字语义影响，推理能力更强或参数更多不必然提升抗攻击性。测试应同时评估双向攻击、干净准确率和覆盖提示等纠错策略。

Abstract: Vision-language models (VLMs) are increasingly used for AI-generated image (AIGI) detection, providing natural-language explanations for authenticity judgments. However, their ability to interpret text within images may also expose these judgments to misleading semantic cues. We systematically evaluate typographic attack strategies across detection-oriented, open-weight, and commercial VLMs, considering both real-to-fake and fake-to-real attacks. Our results show that reasoning modes generally exhibit greater vulnerability than direct modes and that attack effectiveness exhibits pronounced directional asymmetry. Moreover, larger models tend to exhibit higher clean detection accuracy but also higher attack success rates. We further examine attack robustness under image and text transformations and investigate whether overlays indicating the correct class can aid error correction. Together, these analyses characterize how typographic attacks influence authenticity judgments and expose limitations of current VLM-based AIGI detection systems.

[100] MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation cs.CVPDF

Ivan Martinović, Josip Šarić, Yuki M. Asano, Siniša Šegvić

TL;DR: MC-PanDA++将自监督视觉初始化、按类自适应掩码损失缩放和单阶段训练结合，简化并增强全景分割的无监督域适配。

Details

Motivation: 全景分割UDA利用有标注源域和无标注目标域降低标注成本，但既有方法依赖像素预测较次优的教师—学生一致性。先进mask transformer又容易因错误教师掩码被反复强化而发生确认偏差；先前MC-PanDA可过滤不可靠掩码，却需复杂多阶段流程和仔细调参。

Result: MC-PanDA++采用自监督视觉编码器作更强、更鲁棒的初始化，进一步减少人工标注依赖；按类别自适应的掩码级损失缩放稳定训练，使跨域可共用一套超参数；同时改为单阶段训练，降低方法复杂度。作者报告其在全景分割域适配上更简单、性能更强且鲁棒性更好；摘要未列具体指标。

Insight: 全景分割域适配中的伪标签确认偏差可通过更稳健的初始化和细粒度置信损失处理。自适应损失尺度降低跨域手工调参，并允许训练流水线简化为单阶段。

Abstract: Unsupervised domain adaptation (UDA) reduces the annotation burden in panoptic segmentation by leveraging a cost-effectively labeled source domain (e.g., synthetic) and an unlabeled target domain to bridge the distribution gap. Existing panoptic UDA methods rely on teacher-student consistency learning built upon suboptimal per-pixel segmentation architectures. In contrast, state-of-the-art mask transformers are rarely adopted due to their pronounced vulnerability to confirmation bias in consistency learning, where erroneous teacher predictions are reinforced during training. Our earlier approach, MC-PanDA, mitigates this issue through fine-grained confidence estimation, which suppresses gradients from unreliable masks while sampling informative yet reliable locations for loss computation. However, this method entails a complex multi-stage training and requires careful hyperparameter tuning. This work presents MC-PanDA++, which addresses these limitations by introducing: (i) self-supervised vision encoders that provide a stronger and more robust initialization, further reducing the reliance on human annotations, (ii) per-class, self-adapting mask-wide loss scaling that stabilizes training and enables the usage of a single set of hyperparameters across domains, and (iii) a single-stage training pipeline that decreases overall conceptual complexity. Together, these improvements result in a conceptually simpler, better-performing, and more robust method for domain-adaptive panoptics. Source code: https://github.com/martinovicivan/MC-PanDA

[101] ShieldCLIP: Selective Safety Alignment for Harmful Content Mitigation in Multimodal Foundation Models cs.CV | cs.AI | cs.CL | cs.MMPDF

Tobia Poppi, Silvia Cappelletti, Samuele Poppi, Marcella Cornia, Lorenzo Baraldi

TL;DR: ShieldCLIP按图像和文本各自的安全状态选择性对齐多模态表征，避免安全对齐不必要地改动良性表示。

Details

Motivation: CLIP等多模态编码器依赖网络规模数据，包含有害关联。真实不安全内容难以规模采集，现有数据常将安全真实样本和生成样本配对，却把所有生成模态都标为不安全，即使某一模态本身安全。

Result: ShieldCLIP按观察到的各模态安全状态进行安全对齐，并构建ViSUv2：19.5万组四元组，覆盖578概念、28类别且每种模态独立标注。四路条件目标分别锚定安全内容、将不安全模态引导到安全对应项、在混合配对时只更新不安全分支、两侧均不安全时保持语义一致。在跨模态检索、Stable Diffusion v1.4/SDXL文生图和LLaVA图像描述中，ShieldCLIP持续减少有害输出，同时保留原嵌入空间效用；消融支持模态级监督和选择性对齐的作用。

Insight: 样本来源（真实或生成）不能代替逐模态安全判断，混合样本中安全的一侧应保持不动。分支级监督有助于减少有害内容，同时避免安全对齐破坏良性跨模态能力。

Abstract: Multimodal encoders such as CLIP underlie many downstream systems, but their web-scale training data embed harmful associations that safety alignment must suppress without unnecessarily changing benign representations. Because ethical and practical constraints prevent collecting real unsafe content at scale, existing datasets pair safe real samples with generated counterparts, but label every generated sample unsafe, even when one modality is individually safe. To address this, we introduce ShieldCLIP, the first framework to condition safety alignment on the observed safety state of each modality rather than the origin of a sample, preserving safe content while redirecting only what is unsafe. We also introduce ViSUv2, a 195k-quadruplet dataset with independent per-modality safety labels across 578 concepts and 28 categories. Using these labels, ShieldCLIP defines a four-way conditional objective beyond pair-level supervision: safe content is anchored, unsafe modalities are redirected to their safe counterparts, mixed pairs update only the unsafe branch, and coherence is enforced when both are unsafe. We evaluate ShieldCLIP on cross-modal retrieval, text-to-image generation with Stable Diffusion v1.4 and SDXL, and image-to-text generation with LLaVA. Across these settings, ShieldCLIP consistently reduces harmful outputs over prior safety-aligned encoders and strong mitigation baselines, while preserving the utility of the original embedding space. Extensive ablation studies further show that both modality-specific supervision and the selective alignment objective contribute to these gains. Source code, trained models, and ViSUv2 (under a controlled-access protocol) will be made publicly available at https://aimagelab.github.io/ShieldCLIP/.

[102] FAST: Flow Any Scene Transformer cs.CVPDF

Yongjian Zhang, Longguang Wang, Zhuo Song, Zhiheng Fu, Liang Lin

TL;DR: FAST将单视角视觉基础模型的查询—键投影重用于跨视角匹配，通过零参数注意力重接线和600万对数据训练可扩展稠密对应模型。

Details

Motivation: 视觉基础模型不断扩展，但其规模对精确图像对应匹配的影响尚未充分研究；传统ViT匹配器通常需要专门的成对预训练。

Result: FAST发现单视角基础模型内部查询—键投影编码粗略但可复用的跨视角匹配先验，将选定自注意力层以零参数重接线改成跨注意力，得到匹配器初始化。再构建600万对可共视图像训练语料，支持通用稠密二维位移估计。大量基准实验中，FAST达到先进表现，并随骨干规模及训练数据扩展而持续获益；摘要未列具体分数。

Insight: 单图预训练特征中的注意力投影可作为跨视图对应的可迁移先验，减少专门图像对预训练需求。零参数重接线让匹配能力可随通用视觉基础模型进步而扩展。

Abstract: Scaling has become a primary driver of progress in language and vision foundation models, yet its role in precise correspondence matching remains underexplored. In this work, we present Flow Any Scene Transformer (FAST), a scalable correspondence model driven by two key insights. First, we reveal that the query-key projections inside single-view vision foundation models encode a coarse yet reusable prior for cross-view matching. Second, reusing these pretrained projections in cross-attention form yields a highly effective initialization for a ViT-based matcher built from a single-view encoder. Guided by these insights, we build FAST upon a vanilla single-view foundation model, utilizing a zero-parameter rewiring strategy to convert selected self-attention layers into cross-attention for cross-view interaction. This design allows ViT-based matchers to scale with advances in single-view foundation models, bypassing the need for a dedicated pair-centric pretraining stage. To fully unlock the scaling potential of this formulation, we assemble a 6-million-pair training corpus for general-purpose dense 2D displacement estimation across diverse co-visible image pairs. Extensive experiments demonstrate that FAST achieves state-of-the-art performance across a wide range of benchmarks, while scaling favorably with both backbone size and training data.

[103] Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision cs.CVPDF

Weijian Jian, Xiaoyue Zhang, Bin Xiao, Chunyu Xie, Yixiao He

TL;DR: MoSA从未标注视频中的多粒度运动伪标签学习可迁移对象性，再把该先验迁移到提示式图像分割。

Details

Motivation: SAM依赖大量人工标注，成为进一步扩展的瓶颈。基于运动的无监督方法容易过拟合移动物体，缺乏多粒度对象理解，也难泛化到静止对象。

Result: Motion-Grounded Segment Anything（MoSA）分三阶段训练：从大规模未标注视频自动生成多粒度运动伪标签；通过对比学习训练感知分组模型，将运动经验内化为更一般、由外观表达的对象概念；再把先验迁移到提示式架构，在单幅图像上执行segment-anything式分割。COCO、ADE20K等七个困难基准的零样本评估中，MoSA显著超过既有无监督方法；没有使用人工标注，表现仍可与全监督SAM相比。

Insight: 运动线索可用于无监督发现对象，但要避免最终模型只分割正在移动的实体，需将运动伪标签转为可迁移的外观对象性先验。阶段式分组学习再迁移可支持静态图像分割。

Abstract: The Segment Anything Model (SAM) relies heavily on massive manual annotations, creating a fundamental bottleneck for model scaling. While unsupervised methods attempt to learn object concepts from motion, they typically overfit to moving entities, lacking both multi-granularity understanding and the ability to generalize to static objects. To overcome this, we introduce Motion-Grounded Segment Anything (MoSA), a highly scalable unsupervised framework that learns a transferable objectness prior from unlabeled videos. MoSA operates in three progressive stages: (1) automatically generating multi-granularity motion pseudo-labels from large-scale video data; (2) training a Perceptual Grouping Model (PGM) via contrastive learning to internalize a generalized, appearance-driven concept of objects; and (3) transferring this learned prior into a prompt-guided architecture for segment-anything-style inference on images. Extensive zero-shot evaluations across seven challenging benchmarks (e.g., COCO and ADE20K) demonstrate that MoSA significantly outperforms existing unsupervised methods. Notably, despite using zero manual annotations, MoSA achieves segmentation performance comparable to the fully supervised SAM. Our findings reveal that harnessing large-scale unlabeled motion is a feasible and highly scalable alternative to annotation-driven segment-anything pipelines.

[104] Inline Memory Meets Reusable Skills: Memory-centric Framework for Vision-Language-Action Model cs.CV | cs.ROPDF

Zaijing Li, Rui Shao, Bing Hu, Haoyu Zhang, Dongmei Jiang

TL;DR: Optimus-R将VLA机器人适配表示为查询—技能记忆调优，通过内嵌记忆token、外部技能库和轻量桥接更新实现跨任务复用。

Details

Motivation: VLA可用于通用操作，但适应新任务和领域效率低；常见方法依靠参数微调，成本高且可能遗忘旧任务。

Result: Optimus-R在VLA前缀流中插入可学习记忆token，使骨干在原生动作条件路径中提取控制感知的查询与技能表示；外部查询—技能记忆库用查询原型决定检索什么，以技能值表示如何行动，支持有限参数更新下复用和扩展技能；桥接与适配机制用轻量适配器对齐目标域查询和技能，并做残差记忆更新。域内适配、跨域适配和终身学习实验显示，方法支持数据高效技能学习并减轻灾难性遗忘；摘要未提供具体成功率。

Insight: 将技能显式存入外部记忆，可避免每项新任务都改写VLA骨干权重。查询原型和技能内容分开编码，再用轻量适配对齐新域，有助于复用技能及保留旧能力。

Abstract: Vision-Language-Action (VLA) models have shown strong promise for general-purpose robotic manipulation, yet adapting them to new tasks and domains remains inefficient: existing methods often rely on parameter tuning, incurring substantial costs and risking catastrophic forgetting of previously learned tasks. To address this, we propose \textbf{Optimus-R}, a memory-centric VLA framework that formulates robotic adaptation as explicit query-skill memory tuning. Optimus-R introduces: (i) An \textbf{Inline Memory Interface for skill extraction}. It inserts learnable memory tokens into the VLA prefix stream, allowing the backbone to derive control-aware query and skill representations within the native action-conditioning pathway. (ii) A \textbf{Query-Skill Memory Bank for skill learning}. It externalizes skills into query prototypes for deciding \emph{what} to retrieve and skill values for specifying \emph{how} to act, supporting skill reuse and expansion with limited parameter updates. (iii) A lightweight \textbf{Bridge-and-Adapt mechanism for skill updating}. It aligns target-domain queries and skills with the existing memory space through a lightweight adapter and residual memory updates. Experiments on in-domain adaptation, cross-domain adaptation, and lifelong learning show that Optimus-R enables data-efficient skill learning while mitigating catastrophic forgetting.

[105] Spherical Interpolation for Backward-Compatible Multimodal Representations cs.CV | cs.LGPDF

Simone Ricci, Niccolò Biondi, Federico Pernici

TL;DR: 论文研究通过球面插值修正跨版本视觉语言模型的查询向量，使新模型能够继续检索旧模型建立的图库，无需重新计算图库嵌入。

Details

Motivation: 视觉语言模型升级后，新旧模型的表示空间通常不兼容；正交对齐只能近似映射，留下查询方向的角度误差。大规模部署若因此重建整个图库，代价很高。

Result: 作者刻画了球面测地线上存在优于两端点的检索方向的条件，并通过局部间隔认证将其联系到Recall@K。在多个基准和模型家族的实验中，正交对齐后再插值通常比仅做正交对齐更好；逐查询oracle分析也发现有利的内部插值点在实践中较常见。

Insight: 模型更新的兼容性可以在查询表示侧做后处理，而不一定重建图库。球面插值利用了新旧查询之间的连续方向空间，但其收益取决于每个查询的几何关系，不能视为对所有查询的统一保证。

Abstract: Contrastive vision-language models map visual and textual representations into a shared normalized embedding space, making cosine similarity the natural metric for cross-modal retrieval. A practical challenge arises during model upgrades: independently trained models generally produce incompatible representation spaces, so replacing a deployed model typically requires recomputing embeddings for the entire gallery, which is prohibitively expensive at scale. Orthogonal post-hoc alignment can partially mitigate this problem by mapping new-model queries into the old-model gallery space. However, because independently trained models can differ in fine-grained representation structure, the orthogonal alignment remains approximate, leaving a residual angular discrepancy between the old-model query and the aligned new-model query. We study whether interpolation along the spherical geodesic between these two normalized query representations can improve retrieval without re-indexing the gallery. We characterize when this path contains an interior query direction closer to an idealized retrieval-optimal direction than either endpoint, and connect this characterization to Recall@$K$ through a local margin-based certification result. Experiments across multiple benchmarks and model families show that post-alignment spherical interpolation improves over orthogonal alignment alone, recovering backward-compatibility in most evaluated settings. Consistent with our geometric characterization, per-query oracle analysis shows that retrieval-favorable interior points occur frequently in practice. Code is available at https://github.com/miccunifi/SLERP_backward_compatibility .

[106] DyRAD: Radar Novel View Synthesis for Dynamic Driving Scenes cs.CVPDF

Merav Keidar, Tomer Borreda, Rajalakshmi Nandakumar, Or Litany

TL;DR: DyRAD用静态背景反射体、带运动轨迹的动态点反射体和解析雷达点扩散函数，重建并渲染动态驾驶场景的距离—方位—多普勒张量。

Details

Motivation: 现有动态雷达新视角合成通常只重建距离—方位信息，静态场景方法才渲染多普勒；同时，雷达信号处理造成的回波扩散容易被错误吸收到场景几何中，导致换视角渲染失真。

Result: DyRAD从目标轨迹推导反射体速度并投影到视线方向，同时以固定解析点扩散函数表达传感器扩散。方法在RADIal、Boreas和合成基准上评估；在RADIal中，它恢复了参考检测目标的90.7%，最强基线为26.9%。显式分离传感器模型还支持无需重新拟合的零样本雷达配置迁移。

Insight: 将场景运动与传感器成像过程分开建模，既能利用多普勒监督动态反射体，也能降低传感器配置变化对场景表示的影响。论文结果支持在训练视角之外合成观测，但所报90.7%数据来自RADIal，不能代替其他基准上的具体数值。

Abstract: Reconstructing dynamic driving scenes from recorded sensor data supports closed-loop evaluation of autonomous driving systems by synthesizing observations beyond the original trajectory. Unlike cameras and LiDAR, radar measures radial velocity directly through Doppler. Yet existing radar novel-view synthesis fails to exploit this capability: methods addressing dynamic scenes reconstruct only range-azimuth tensors, while methods that render Doppler assume static scenes. Moreover, because radar processing spreads each reflection across multiple bins, existing representations absorb this spread into scene geometry, causing it to render incorrectly when the viewpoint moves. We present DyRAD, which models dynamic driving scenes using static background reflectors and motion-tracked dynamic point reflectors to render complete range-azimuth-Doppler (RAD) tensors. Reflector velocities are derived from object tracks and projected onto the line of sight, making Doppler both a rendered output and supervision for those tracks. Crucially, we render reflectors through a fixed analytic point-spread function (PSF) derived from the radar’s signal-processing chain, preventing sensor-induced spread from being baked into the scene representation. Beyond improving scene reconstruction, this separation also enables zero-shot sensor-configuration transfer, allowing the same reconstructed scene to be rendered under different radar specifications without refitting. We evaluate DyRAD on RADIal, Boreas, and a synthetic benchmark across both on-path poses and displaced viewpoints untested by prior work. On RADIal, DyRAD recovers radar detections in 90.7% of reference-detected objects, compared with 26.9% for the strongest baseline.

[107] Hyperspectral Image Models: Technical Report cs.CVPDF

Tanishq Rachamalla, Aryan Das, Srishti Kaushik, Swalpa Kumar Roy

TL;DR: Hyperspectral Image Models提供统一接口和评测流程，整合55种高光谱模型与24个跨传感器场景，并系统比较模型范式和场景难度。

Details

Motivation: 高光谱遥感模型分散在不兼容的代码库中，张量约定和评测流程不统一；滑动窗口重叠还可能让训练与测试像素泄漏，夸大分类准确率。

Result: 框架覆盖六类方法，支持不同维度张量适配、缓存、波段选择、空间池化和补丁抽取，并提供带保护带的空间分区以避免像素重叠。实验共包含1,320次模型—场景评估和6,600次带种子的运行；场景难度对准确率的影响大于架构，均值从Botswana的96.40%到Houston 2018的56.70%，而范式均值之间相差15个百分点。没有一种范式始终占优，少于100万参数的模型也可达到大两个数量级模型的表现。

Insight: 统一、可复现且避免空间泄漏的评测能让场景难度和数据划分成为模型比较的重要组成部分。结果不支持单一架构普遍领先，也说明扩大模型规模未必带来相应收益。

Abstract: Hyperspectral remote sensing has advanced across diverse deep learning paradigms, including spectral spatial CNNs, Vision Transformers, Mamba, graph neural networks, Kolmogorov Arnold networks, and self supervised masked autoencoding. Yet progress remains hindered by fragmented repositories, incompatible tensor conventions, and non standardized evaluation. Hyperspectral Image Models addresses these challenges through a modular framework unifying 55 representative models across six paradigms with a common registry, automatic 4D/5D tensor adaptation, and standardized constructors. It integrates 24 benchmark scenes from Airborne, Spaceborne, UAV, and Mars CRISM sensors, with caching, label remapping, PCA, explicit band selection or raw spectra, optional spatial max pooling, and arbitrary PxP patch extraction. To prevent inflated accuracy from overlapping windows, it supports class balanced random partitioning and spatially disjoint regional blocking with Chebyshev guard bands that eliminate train test pixel overlap. Experiments use a single config.yaml with deterministic seeds and complete provenance, generating LaTeX benchmark tables and classification maps. Across 1,320 model scene evaluations and 6,600 seeded runs, scene difficulty dominates architecture, with mean accuracy ranging from 96.40% on Botswana to 56.70% on Houston 2018, versus a 15 point spread across paradigm means. No paradigm universally dominates, while sub 1 M parameter models can match architectures two orders of magnitude larger. Code is publicly available at https://github.com/Tanishq251/Hyperspectral-Image-Models.

[108] Grounding with Confidence: Controllable Generative Video Temporal Grounding cs.CVPDF

Jinhao Chen, Benlei Cui, Ruijian Jia, Ziheng Wang, Tianyu Wo

TL;DR: 论文为生成式视频时序定位增加区间级置信度头，使模型可在一次解码中给候选片段打分、排序或拒绝，而无需推理时调用外部验证器。

Details

Motivation: 生成式模型通常输出事件时间戳，却缺少每个时间区间的置信度，应用方难以按精度—召回需求筛选结果；额外调用验证器又会增加推理环节。

Result: 轻量置信度头读取解码器状态，并由离线验证分数及强化学习阶段的时序重叠标签训练。在固定OMTG-Bench候选池、按生成顺序排序的基线上，10%全局返回预算下query-macro Recall@0.5从9.95%升至14.42%；25%预算下从26.48%升至31.12%。

Insight: 把候选生成和接受决策分开，并在原解码过程中估计置信度，可以让下游系统调节返回预算或阈值，而不必重新生成片段。报告的增益是在固定候选池和指定预算设置下测得，不能据此推断所有数据集与阈值都会有相同提升。

Abstract: Video temporal grounding supports applications such as video search, content review, and automated editing by localizing events described in natural language. Yet existing generative models typically output timestamps without explicit interval-level confidence scores to guide candidate selection. We separate candidate generation from acceptance by scoring individual intervals within the original decoding pass. A lightweight confidence head reads pooled decoder states, providing an explicit score trained for interval selection. Offline verifier scores supervise the head on fixed candidate sequences, and temporal-overlap labels adapt it to current rollouts during reinforcement learning. GT-anchored candidate-pool supervision and set-level optimization train the generator. The resulting scores support ranking, threshold-based selection, and rejection without invoking an external verifier at inference. On a fixed OMTG-Bench candidate pool, confidence raises query-macro Recall@0.5 from 9.95% to 14.42% over generation order at a 10% global return budget, and from 26.48% to 31.12% at a 25% budget. The continuous scores let downstream applications adjust return budgets or acceptance thresholds to match their precision-recall preferences, without regenerating candidate intervals.

[109] Spatial-Temporal Multi-scale Network for Screen Content Video Quality Enhancement cs.CVPDF

Ziyin Huang, Sik-Ho Tsang, Xinyuan Qin, Yui-Lam Chan, Xueling Zhou

TL;DR: STM-Net面向屏幕内容视频压缩伪影，结合时空路由、双向时序特征提取和级联多尺度蒸馏，以适应突变场景并保留文字和图形细节。

Details

Motivation: 屏幕内容视频常有突然运动、场景切换及高频文字图形细节，依赖时间连续性的自然视频增强方法容易在这些变化处退化，也可能损伤细节。

Result: STM-Net由先验引导的时空分发器将输入路由到三个并行流，双向时序模块适应突变而无需显式检测，级联多尺度模块保留高频信息。论文报告其在客观指标和主观视觉质量上均优于现有先进方法，但摘要未给出具体指标数值。

Insight: 将输入分流、突变适应和细节保留分别交给互补模块，可以缓解自然视频方法对时间平滑性的依赖。现有摘要只给出总体优越性结论，未提供量化增益，解析不应补写具体数值。

Abstract: Different from natural videos, Screen Content Videos (SCVs) are characterized by abrupt motion, scene switches, and high-frequency details such as text and graphics. Conventional video enhancement methods, which rely heavily on temporal continuity, often suffer from performance degradation when processing SCVs due to the disruption of temporal correlations. To address these challenges, we propose the Spatial-Temporal Multi-scale Network (STM-Net), a novel framework specifically tailored for compressed SCV enhancement. Our approach integrates three complementary components: a Prior-Guided Spatio-Temporal Dispatcher (PG-STD) that routes input into three parallel streams to avoid feature contamination, a Bidirectional Temporal Feature Extraction (BTFE) module that adaptively handles abrupt transitions without explicit detection, and a Cascaded Multi-scale Feature Distillation (CMFD) module that preserves critical high-frequency details. Experimental results demonstrate that STM-Net outperforms state-of-the-art methods in both objective metrics and subjective visual quality, providing a robust solution for screen content artifacts. Code is available at https://github.com/HUANGZiyin1/STM-Net.

[110] Learning Where to Look: Anatomical Grounding and Guided Attention for Cardiac MRI Vision-Language Models cs.CVPDF

Bangwei Guo, Xiao Chen, Boris Mailhe, Jia Yao, Yiqing Wang

TL;DR: CARA-VL将心脏解剖定位与问题引导注意力结合，用于心脏MRI视觉问答和区域定位，并通过问题相关的解剖先验引导模型关注影像中的目标部位。

Details

Motivation: 心脏MRI临床判读依赖对解剖结构的识别和定位，但用于定位与问答的CMR监督数据有限，单靠图像级配对报告也难以教会模型应针对具体问题看哪里。

Result: 作者构建了128,915个解剖定位样本和42,799个临床问答样本，覆盖短轴电影、延迟钆增强和长轴电影。CARA按问题选择预测的解剖先验，并以可学习的任务强度调节解码器注意力；结合定位预训练后，CARA-VL在临床评估和区域定位上表现较强，并显示出对外部临床队列的初步泛化能力。

Insight: 该工作把可定位的解剖监督用于引导视觉语言模型的临床注意力，有望缓解模型依赖文本先验的问题。摘要报告了数据规模和定性表现，但没有给出具体性能数值，外部泛化也仍属初步证据。

Abstract: Cardiac magnetic resonance imaging (CMR) enables assessment of cardiac anatomy, ventricular function, and myocardial tissue characteristics. Clinicians interpret these images by identifying cardiac structures and focusing on the regions relevant to each clinical question, motivating anatomically guided vision-language models (VLMs). Yet CMR-specific supervision for anatomical localisation and clinical question answering remains limited. To address this gap, we investigate fine-grained CMR visual question answering through anatomical grounding and guided attention. We construct 128,915 anatomical-grounding and 42,799 clinical QA pairs across short-axis cine, late gadolinium enhancement, and long-axis cine. These datasets support anatomical recognition, localisation, and clinical assessment without requiring paired reports for individual training images. To help the model learn where to look, we introduce Cardiac Anatomy-Routed Attention (CARA), which selects predicted anatomical priors according to the question and guides decoder attention with learned task-specific strengths. Combining anatomical grounding pretraining with CARA yields our model, CARA-VL. Experiments demonstrate CARA-VL’s strengths in clinical assessment and regional localisation across CMR imaging settings, with promising generalization to an external clinical cohort. Together, our data and method provide a practical framework for studying and advancing cardiac visual understanding in VLMs. We will release the QA data derived from public datasets upon publication.

Haoxiang Shi, Zaijing Li, Muhe Ding, Xiang Deng, Yaowei Wang

TL;DR: NavHarness用目标、验证、记忆和视觉运动四类代理组织视觉语言导航，让具身智能体按自适应子目标行动、确认完成后压缩历史，再继续长程导航。

Details

Motivation: 视觉语言导航中，局部动作看似合理并不代表路线符合整体指令；长时交互历史还会持续增加后续决策的上下文和推理开销。

Result: 框架由Goal Agent生成自适应目标、Visuomotor Agent执行动作、Verify Agent依据目标相关问题检查完成情况、Memory Agent在验证完成后压缩对应多模态历史。在R2R-CE和RxR-CE及三种模型骨干上评估，并分析执行期间的上下文变化；真实环境中，8条具有挑战性的路线各评估3次，成功率为83.3%，导航误差为1.51米。

Insight: 将长程任务切分为可验证的目标边界，让记忆压缩与任务进度相连，有望同时提高路线一致性并控制历史长度。真实环境结果来自有限的8条路线，仍需更广泛的场景验证。

Abstract: Vision-Language Navigation (VLN) requires embodied agents to generate actions based on instructions and observations. General-purpose multimodal agents offer a promising basis for this task, but selecting plausible local actions does not ensure that execution remains consistent with the intended route, particularly in long-horizon tasks. Moreover, the accumulated interaction history increases the input required for subsequent decisions, resulting in a significant inference overhead. To this end, we introduce \method, an Agentic VLN framework that includes a Goal Agent that sets adaptive goals for local actions, a Verify Agent that dynamically verifies whether a goal has been completed, a Memory Agent for multimodal context compression, and a Visuomotor Agent to execute adaptive goals. Specifically, the Goal Agent formulates adaptive goals based on the instruction, current observation, and execution history. Then the Visuomotor Agent executes navigation actions to achieve each goal, while the Verify Agent uses a goal-specific verification question to dynamically assess whether the observed outcomes satisfy the intended completion condition. Verified goal completion then marks a boundary for the Memory Agent to compress the corresponding multimodal interaction history while preserving information needed for subsequent navigation. We evaluate navigation on R2R-CE and RxR-CE, examine framework variants across three model backbones, and study context evolution during execution. For Real-World evaluation, \method achieves 83.3% success and 1.51,m navigation error across eight challenging routes evaluated three times each.

[112] MCD: Causal Distillation of Multimodal In-Context Learning in Large Vision-Language Models cs.CV | cs.CLPDF

Yanshu Li, Jiaqian Li, Canran Xiao, Xi Xiao, Tianyang Wang

TL;DR: MCD通过保留结构的词元干预识别视觉语言模型上下文学习所依赖的因果视觉证据，再把教师在证据保留或移除时的反应蒸馏给学生。

Details

Motivation: 常规蒸馏直接对齐教师输出或隐藏表示，只教学生模仿预测，却没有说明复杂上下文中哪些证据因果性地支持答案；学生因此仍可能依赖语言先验、提示结构等伪线索。

Result: MCD在三个大型视觉语言模型家族和七个基准上评估，学生性能平均提升7.23分，比普通蒸馏高4.68分；进一步分析显示提升具有泛化性。

Insight: 蒸馏过程可以传递教师如何使用多模态证据，而不只传递最终答案分布。通过干预观察证据变化后的输出，学生有机会减少对伪线索的依赖；摘要未说明各基准的分数尺度，因此不应将提升解读为固定百分比。

Abstract: Large vision-language models (LVLMs) exhibit strong multimodal in-context learning (ICL) capabilities, yet this ability degrades substantially as model size decreases. Knowledge distillation offers a natural way to bridge this gap, but existing methods primarily align output distributions or hidden representations directly. Such alignment teaches the student what the teacher predicts without revealing which evidence in the complex context causally supports that prediction. Consequently, a student can imitate the teacher’s answer while continuing to rely on language priors, prompt structure, or other spurious cues. To address this limitation, we introduce Multimodal Causal Distillation (MCD), a distillation framework that transfers how a strong teacher uses multimodal evidence during ICL. MCD uses structure-preserving token interventions to identify and verify causal evidence, then transfers how the teacher responds when that evidence is retained or removed. This design connects distillation to the causal patterns by which the model uses contextual evidence during multimodal ICL. Experiments across three LVLM families and seven benchmarks show that MCD improves student performance by 7.23 points on average and outperforms vanilla distillation by 4.68 points, while further analyses confirm the generalizability of these gains.

[113] CoVisco: Codec-Native Vision Encoder with Native Token Compression for Unified Image-Video Understanding cs.CV | cs.AIPDF

Yulong Liu, Xiaotian Han, Junyuan Shang, Yuchen Ding, Zhenyu Zhang

TL;DR: CoVisco把视频压缩直接融入视觉编码器，以分段注意力和可学习抽象词元压缩长视频表示，并按需保留部分图像块细节供下游多模态模型使用。

Details

Motivation: 视频越长、分辨率越高，视觉词元越多，视觉编码器和语言模型的计算负担越重。若先密集编码再压缩，训练时表示与部署时紧凑接口不匹配，也可能丢失细粒度证据。

Result: CoVisco在编码器内交替进行片段内处理和抽象词元通信，并提供仅抽象词元或抽象词元加运行时选取图像块两种接口。模型在5.65亿图文对和640万视频上进行对比预训练；在4段、64帧设置中，仅用400个视觉词元即可达到接近、部分基准超过OneVision-Encoder的视频理解表现，额外选择图像块还能提升细粒度视频推理。

Insight: 在编码阶段原生形成紧凑接口，可以避免先产生庞大密集表示再压缩的开销，同时通过可选图像块保留任务需要的细节。摘要给出的400词元结论对应特定的四段64帧设置，不代表所有视频长度和任务都可用相同预算。

Abstract: Vision-language models face a fundamental scaling bottleneck: the number of visual tokens grows with both temporal duration and spatial resolution, making long-video understanding expensive for the vision encoder and the language model. Existing methods often compress visual tokens after dense encoding, creating a mismatch between the representation used during training and the compact interface required at deployment. We present CoVisco, a codec-native vision encoder with native token compression for unified image-video understanding. By combining codec-native input support with segmented attention, CoVisco can encode long visual inputs in a single forward pass without forming dense patch-to-patch interactions across all frames. Each temporal segment is equipped with learnable abstract tokens that learn a compact segment-level representation, while fine-grained patch tokens remain available throughout the encoder. Alternating intra-segment and abstract-communication layers preserve video-level context through the abstract-token channel. A lightweight selector further exposes either abstract tokens alone or abstract tokens augmented with a runtime-selected subset of patch tokens, yielding a compact visual interface that reduces the visual context and prefill burden of downstream MLLMs while retaining fine-grained evidence when needed. Pretrained with contrastive objectives on 565M image–text pairs and 6.4M videos, CoVisco shows competitive performance on video-oriented embedding and multimodal understanding benchmarks. In the evaluated four-segment, 64-frame setting, abstract-only inference uses only 400 visual tokens while achieving video-understanding performance close to, and on some benchmarks exceeding, OneVision-Encoder. Selected patch tokens further improve fine-grained video reasoning. Project URL: https://github.com/ernie-research/CoVisco.git

[114] Learning to Reason with Compressed Context: Ground-Truth-Free Adaptation of OmniLLMs via Self-Distillation cs.CVPDF

Jianghao Wang, Ke Meng, Jian Li, Chi Cheng, Longyu Qi

TL;DR: CAFD利用同一多模态样本的完整词元视图作为自教师，在学生的在线推理轨迹上适配压缩上下文，使全模态模型能以更少词元保持推理能力。

Details

Motivation: 全模态大模型的音视频序列很长，部署成本高；压缩词元虽能降低开销，却常损害准确率。已有工作主要改进压缩器，较少训练模型适应压缩后剩余的上下文。

Result: CAFD无需标准答案、推理过程标注或正确性奖励，而是用完整上下文自教师为压缩上下文学生提供软目标监督。在Qwen2.5-Omni-7B上，实验覆盖5个音视频基准、5种压缩管线和5档部署预算；125种设置中有120种提升，平均准确率增加1.44分，并平均恢复准确率差距的26.9%。

Insight: 压缩效果不仅由保留多少词元决定，模型是否适应压缩后的信息分布也很关键。使用同一样本的完整视图提供特权监督，可以在无外部标注下改善精度—效率权衡，但结果来自指定模型和压缩设置。

Abstract: Omni-modal large language models (OmniLLMs) enable unified audio-video understanding, but their long multimodal token sequences make deployment computationally expensive. Token compression reduces this cost, yet aggressive compression often lowers accuracy. Existing works predominantly focus on designing better compression mechanisms; however, adapting the underlying language model to reason effectively over the remaining compressed context remains under-explored. To address this, we propose CAFD (Compressed-Context Adaptation via Full-Context Distillation), a ground-truth-free self-distillation framework that adapts OmniLLMs to fixed compression pipelines without requiring reference answers, rationales, or correctness rewards. CAFD leverages the full-token view of the same multimodal sample as a source of privileged information: a full-context self-teacher provides soft target supervision to a compressed-context student along the student’s on-policy trajectory. Evaluated on Qwen2.5-Omni-7B across five audio-video benchmarks, five compression pipelines, and five deployment budgets, CAFD demonstrates consistent gains, improving 120 out of 125 conditions with an average accuracy boost of 1.44 points and recovering 26.9% of the accuracy gap on average. These results demonstrate that the proposed ground-truth-free adaptation offers an effective and practical route to improving the accuracy-efficiency trade-off in deployed OmniLLMs.

[115] Can We Anticipate Violence? Multimodal Learning from Pre-Incident Behavioral Cues cs.CVPDF

Sindhuja Penchala, Mohammed Yusuf Mujawar, Noorbakhsh Amiri Golilarz, Sudip Mittal, Shahram Rahimi

TL;DR: 论文在XD-Violence片段中识别暴力事件发生前的短时风险，联合建模面部外观、音频和人体运动线索。

Details

Motivation: 事后检测暴力不能提供提前干预机会，事件发生前的行为线索可能有价值，但短时风险识别需要处理可变长度片段并避免把事件本身泄漏进输入。

Result: 作者构建了443个Normal/Risky样本，并按来源划分训练、验证和测试集，输入只包含事件前片段。跨Swin-Tiny、ViT-Tiny和DeiT-Tiny的控制消融显示，多模态组合优于单独或较少模态；DeiT-Tiny融合音频、面部外观和运动后，在保留测试集上达到91.21%准确率、88.96%平衡准确率、93.65% F1和96.38% ROC-AUC。

Insight: 外观、声音和运动提供互补的事前风险证据，联合使用比单一模态更有效。结果来自规模有限的443样本设置，适合说明可行性，仍需在更丰富的真实部署数据上验证。

Abstract: Detecting violence after it begins is important from recognizing behavioral cues that appear immediately beforehand. This work studies short-horizon pre-incident risk recognition from multimodal video signals. We construct a binary Normal-versus-Risky setting from temporally annotated XD-Violence clips, using 443 samples with source-level separation across training, validation, and test sets. Each sample consists of a variable-length pre-incident clip, with its duration determined by the observable behavioral context preceding the incident. The inci- dent itself is excluded from all input clips. We evaluate three complementary information sources: facial-region appearance, temporally aligned audio, and body-motion features derived from tracked keypoints. Controlled ablations are performed with Swin-Tiny, ViT-Tiny, and DeiT-Tiny to measure the contribution of each modality under the same split. Results show that combining all modalities is more effective than using any other combination alone. The best configuration, Deit-Tiny with audio, facial appearance, and motion, achieves 91.21% accuracy, 88.96% balanced accuracy, 93.65% F1-score, and 96.38% ROC-AUC on the held-out test set. These results suggest that complementary appearance, acoustic, and kinematic cues provide useful evidence for recognizing elevated pre-incident risk.

[116] Enhancing Autoregressive Video Generation via Representation Adversarial Distillation cs.CVPDF

Fangyu Lin, Xingtong Ge, Lunjie Zhu, Yi Zhang, Zhening Liu

TL;DR: Radian在自回归视频生成训练中加入冻结视觉基础模型特征空间的对抗监督，补充分布匹配蒸馏以减少误差累积和感知质量退化。

Details

Motivation: 少步自回归生成会把早期时间块的错误反复作为后续上下文，造成细节退化、结构漂移和运动不稳定；传统分布匹配蒸馏主要对齐扩散潜空间，缺少对解码视频感知质量的直接监督。

Result: Radian在学生自回归轨迹上稀疏解码帧，通过冻结视觉基础模型提取多层表示并施加真实视频判别监督，同时由DMD约束教师分布。Wan2.1-1.3B的四步生成取得VBench Total 0.8444、VideoAlign Total 0.8033；在分钟级生成中，VBench-Long从Rolling Forcing的0.7805升至0.8041，且去噪步数更少。训练附加组件在训练后移除，生成器结构和推理预算不变。

Insight: 在外部视觉表示空间提供对抗信号，可与教师分布约束互补，并直接作用于生成视频的语义和感知特征。论文还发现对抗信号取决于表示空间选择，扩散内部特征不如外部视觉模型特征与DMD互补。

Abstract: Few-step autoregressive video generation enables efficient streaming synthesis, but errors introduced in early temporal blocks are reused as context and can propagate through subsequent rollouts, leading to detail degradation, structural drift, and unstable motion. Existing distribution matching distillation (DMD) primarily aligns student and teacher distributions in diffusion latent space, but provides no direct supervision over the perceptual quality of decoded videos. We introduce Radian, a representation-space adversarial distillation framework that complements on-policy DMD with real-data adversarial supervision in the feature space defined by a frozen visual foundation model (VFM). During training, Radian sparsely decodes frames from autoregressive student rollouts, extracts multi-level visual representations, and applies lightweight discriminator heads to distinguish generated outputs from real video frames. The DMD objective anchors the student to the pretrained teacher, while the representation-space adversarial objective supplies complementary perceptual and semantic gradients that promote high-quality modes. These additional components are discarded after training, leaving the generator architecture and inference-time denoising budget unchanged. Experiments on Wan2.1-1.3B cover four-step chunk-wise, one-step frame-wise, and minute-long autoregressive generation. Our method achieves a VBench Total of 0.8444 and a VideoAlign Total of 0.8033 under four-step generation, and improves VBench-Long from 0.7805 to 0.8041 over Rolling Forcing while using fewer denoising steps. Controlled comparisons across image, video, and diffusion representations further indicate that the choice of representation spaces induces distinct adversarial signals, and external VFM gradients complement DMD more effectively than adversarial supervision derived from diffusion-internal features.

[117] CoEvoWhen: Policy-Tool Coevolution for Ultra-Long Video Temporal Grounding cs.CVPDF

Yiduo Jia, Muzhi Zhu, Jinchuan Shi, Hao Zhong, Yuling Xi

TL;DR: CoEvoWhen让视觉语言模型的推理策略与视频分析工具共同进化，形成可复用技能，以更低视觉词元成本定位超长视频中的事件。

Details

Motivation: 超长视频时序定位既要搜索长程证据，也要理解细粒度事件，还受视觉预算限制；现有代理方法多固定策略和工具能力，难以针对证据获取过程持续改进。

Result: 框架从VLM的代理推理轨迹中提炼长期可迁移策略，并由外部技能更新器调整图像级长程搜索与视频级细粒度观察的编排，同时升级或创建媒体工具；推理时无需更强的独立规划模型，也不更新VLM参数。在五个基准和三个VLM上的实验中，策略—工具共同进化持续提高超长视频定位准确率并减少视觉词元开销；所学技能还提升一般长视频问答，无需额外任务进化。

Insight: 长视频代理的能力不仅由基础模型决定，也受证据获取工具和调用策略影响。将两者放入同一经验更新闭环可形成可迁移技能，但摘要未提供具体增益幅度和词元节省数值。

Abstract: Ultra-long video temporal grounding requires balancing long-range evidence search with fine-grained event understanding under a limited visual budget, yet existing agentic methods still rely largely on predefined policies and tool capabilities. Motivated by this, we propose a novel policy-tool coevolution framework that jointly evolves high-level policies and executable media tools from the agentic reasoning trajectories of a VLM, forming a reusable skill without updating model parameters. During evolution, an external skill updater distills transferable task experience in long-video temporal grounding, accordingly refining the orchestration of long-range image-based and fine-grained video-based observations. Alongside these policy updates, the updater employs its coding capabilities to upgrade existing tools or create new ones, adapting the tools to long-video evidence acquisition. Equipped with the evolved skill, the VLM autonomously orchestrates tools under the guidance of the evolved policy, coordinating image and video observations for agentic inference without relying on a separate, stronger planning model. Extensive experiments spanning five benchmarks and three VLMs show that policy-tool coevolution consistently improves temporal grounding accuracy in ultra-long videos while reducing visual token cost at inference, and that the evolved skill yields substantial performance gains on general long-video QA without additional task-specific evolution, demonstrating the effectiveness and generalizability of our framework for long-video understanding.

[118] Less Data, Better Timing: Student-Curriculum Coupling for VLM On-Policy Distillation in Temporal Video Grounding cs.CV | cs.AIPDF

Jiacheng Qiu, Yunsoo Kim, Ruichen Xu, Jian Luo, Petar M. Djurić

TL;DR: SCC让视频时序定位的蒸馏课程随学生能力变化，动态启用、暂停或重新启用教师监督，以更少样本和训练时间提高定位召回。

Details

Motivation: 现有在线策略蒸馏常按固定教师和初始学生状态构建课程，默认样本在整个优化期间都值得监督；但监督目标是否可信与学生当前是否需要该监督是相互关联却不同的问题。

Result: 学生—课程耦合框架使用紧凑的Anchor-Frontier候选课程，再由不断变化的学生能力选择当前有效样本。在三个时序视频定位基准上，SCC相较Video-OPD原始课程的平均召回相对提升5.1%，训练样本减少60.0%，训练时间减少50.4%；消融支持能力结构化课程和学生依赖监督各自的作用。

Insight: 监督应同时满足可信且对当前学生有必要，课程因此可以随能力变化闭环调整，而非静态筛选一次。实验显示了数据和计算效率收益，但比较基线为Video-OPD的原始课程设置。

Abstract: On-policy distillation (OPD) provides dense supervision directly on student-generated trajectories, making it an effective post-training strategy for vision-language models in temporal video grounding (TVG). However, existing pipelines typically construct the training curriculum from a fixed teacher and the initial student state, implicitly assuming that selected examples retain positive supervision value throughout optimization. We show that supervision trustworthiness and supervision necessity are distinct yet coupled: the former concerns target credibility, while the latter varies with the student’s current task competence; together, they shape supervision value. Building on this coupled view, we introduce Student-Curriculum Coupling (SCC), a closed-loop framework in which a compact Anchor-Frontier curriculum defines the candidate supervision space and the evolving student dynamically determines its active subset. Supervision can therefore be activated, suspended, or reactivated as competence changes, concentrating teacher computation and optimization on current task-level deficits. Across three TVG benchmarks, SCC achieves a 5.1% relative improvement in mean recall over Video-OPD on its original curriculum, while using 60.0% fewer training examples and reducing training time by 50.4%. Ablations support the complementary roles of capability-structured curriculum design and student-dependent supervision in achieving these gains. Together, these results establish SCC as a data- and compute-efficient framework for TVG post-training, delivering stronger temporal grounding by aligning trustworthy supervision with the student’s evolving learning needs.

[119] LongEmo: Towards Emotion Understanding and Reasoning in Long Videos cs.CV | cs.AIPDF

Shuo Zhang, Yifan Zhou, Han Wang, Jinsong Zhang, Jingyu Li

TL;DR: LongEmoBench评测长视频情绪理解与推理，LongEmo则把视频流组织为事件记忆图，按问题检索事件并综合其情绪变化。

Details

Motivation: 情绪是由过去经历和持续事件共同塑造的动态过程，短片上的情感识别难以覆盖数小时视频中的累积和跨事件发展；逐次重看原视频也难以支持长程推理。

Result: LongEmo以事件图显式记录长程依赖，针对问题检索相关事件流并迭代整合多模态记忆。对17种代表方法的评估显示，这些方法在长视频情绪理解和推理上仍有明显困难；LongEmo取得当前最佳表现，支持其事件中心记忆设计的有效性。

Insight: 按事件建模并围绕问题检索，能把情绪理解从单帧或短片分类扩展到跨事件推理。摘要未提供具体分数或基准细节，因此这里只记录定性领先结论。

Abstract: While recent Multimodal Large Language Models (MLLMs) have shown promise in affective computing, their reasoning capabilities are largely confined to short video clips with limited interactions. However, real-world emotions are not merely isolated instantaneous reactions but dynamic and cumulative processes deeply shaped by past experiences and ongoing events. To bridge this gap, we introduce LongEmoBench, a benchmark dedicated to emotion understanding and reasoning in long videos. It assesses progressive capabilities scaling from continuous scene interactions to complex episodic developments. Furthermore, we propose LongEmo, a novel memory-augmented agentic framework designed to tackle the immense challenges of long-range affective reasoning. LongEmo processes continuous video streams to construct an Event Memory Graph, explicitly modeling long-range dependencies and capturing emotional dynamics across discrete events. Given a question, the agent retrieves a query-relevant event stream from the graph, iteratively integrating multimodal memories and relational dependencies to deduce the final answer. Extensive evaluations of 17 representative methods reveal that they struggle significantly with emotion understanding and reasoning in long videos. In contrast, LongEmo achieves state-of-the-art performance, demonstrating the efficacy of its event-centric memory architecture.

[120] GateSPINE: Gated Cross-View Fusion for Lumbar Spine MRI Report Generation cs.CV | cs.AIPDF

Hoang Nguyen Van, Cuong Vuong Tuan, Trang Mai Xuan, Bien Tran Van, Nam Tran Van

TL;DR: GateSPINE以双路3D编码器和门控跨视图融合生成腰椎MRI报告，让每个空间位置和特征通道优先采用更有诊断信息的成像视图。

Details

Motivation: MRI检查包含互补的序列和成像平面，固定融合可能稀释只在单一视图可见的异常，降低临床上代价较高的异常召回。

Result: 方法将矢状位T1/T2体数据用无需训练的算子融合，与轴位体数据分别编码，再由门控模块逐特征、逐词元控制各视图权重。在三个腰椎MRI数据集上，GateSPINE的临床效能F1最高，提升主要来自召回，同时标准自然语言生成指标保持竞争力。SPIDER缺少轴位序列，其结果体现矢状位融合而非跨视图门控；门控机制由另外两个含双平面的队列验证。

Insight: 医学报告生成应按局部诊断证据而非固定比例融合多视图。数据集成像平面不同会改变机制能够发挥的作用，因此跨数据集比较需区分矢状融合收益与门控跨视图收益。

Abstract: Automated report generation can ease the burden radiolo gists face when interpreting multi-sequence MRI studies. Unlike CT, MRI examinations comprise multiple sequences and imaging planes, each con tributing complementary diagnostic information. Existing methods en code a study as a single volume and combine multiple acquisitions by fixed rules. Findings visible in only one plane are thus diluted and of ten missed, lowering recall on clinical efficacy metrics, where a missed abnormality is most costly. We propose GateSPINE, a vision-language framework that fuses sagittal T1 and T2 volumes with a training-free operator, encodes the fused sagittal and axial volumes with two parallel 3D encoders, and decodes their combined representation into a report. Its core mechanism is a gated cross view fusion module that predicts, per feature channel and token, how much of each view to admit, so the more informative view dominates at each spatial location. We evaluate GateSPINE on three lumbar MRI datasets, comprising two public bench marks and a private cohort collected from Phenikaa University Hospital, using both natural language generation (NLG) and clinical efficacy (CE) metrics. GateSPINE achieves the highest CE F1 through improved re call on all three datasets; on SPIDER, which lacks an axial sequence, this reflects the sagittal fusion component rather than the gated cross-view mechanism, which is validated on the two cohorts with both imaging planes. GateSPINE also remains competitive on standard NLG metrics.

[121] VR-JEPA: Learning Contrastive-State Latent Guidance for Generation-based Video Reasoning cs.CVPDF

Zehua Ma, Kun Xiang, Yunshuang Nie, Quanlin Chen, Haoyuan Li

TL;DR: VR-JEPA通过局部对比状态学习和任务专属专家，把视频JEPA的时空预测先验对齐到视觉推理逻辑，再用预测潜在轨迹引导视频生成。

Details

Motivation: 生成式视频推理依赖潜在视觉状态及其变化，但普通生成模型缺少对合理状态演化的明确约束，容易出现物理和结构错误；通用V-JEPA先验也未必适用于复杂逻辑任务。

Result: 方法对同一输入下的成功轨迹与生成替代轨迹进行比较，从V-JEPA表示差异中选取有信息的状态和词元作局部监督，并训练技能专属专家以适配不同认知任务。在大型VBVR-Pro-Bench上，相较先进生成式推理基线相对提升11.33%，并减少物理伪影、增强逻辑一致性。

Insight: 视频生成的时空先验可通过任务相关轨迹监督转化为推理引导，而不只用于外观生成。结果支持专门对齐潜在状态演化，但摘要未说明该提升在各子任务上的分布。

Abstract: Reasoning through video generation offers a promising path toward visual intelligence by modeling latent visual states and their dynamics. However, current video generation models often lack explicit guidance on how these states should evolve, leaving generated trajectories prone to physical and structural inconsistencies that undermine reasoning reliability. While the Video Joint-Embedding Predictive Architecture (V-JEPA) provides rich spatiotemporal priors learned through latent prediction, these general priors do not naturally adapt to the logical reasoning capabilities required for complex visual tasks. To bridge this gap, we propose VR-JEPA, a framework that aligns the V-JEPA predictor with task-specific reasoning logic through localized contrastive-state learning and uses its predicted latent trajectories to guide video generation for visual reasoning. Specifically, (i) we pair successful trajectories with generated alternatives under the same input conditions and use discrepancies in their V-JEPA representations to identify informative states and tokens for localized contrastive supervision. (ii) We further equip the V-JEPA predictor with skill-specific experts trained on anchor-task data, allowing the model to adaptively specialize its shared spatiotemporal priors across diverse cognitive domains. Together with skill-specific experts, this contrastive supervision enables VR-JEPA to predict latent trajectories that provide task-specific logical guidance for video generation. Comprehensive experiments on the large-scale VBVR-Pro-Bench dataset demonstrate that VR-JEPA achieves an $11.33%$ relative improvement over the cutting-edge generation-based reasoning baseline, significantly mitigating physical artifacts and enhancing logical consistency.

[122] MemLife: Curating and Reasoning over Long-Term Egocentric Video Memories cs.CV | cs.AI | cs.CLPDF

Guangzhi Xiong, Xinyuan Zhang, Xiao Yang, Hyokun Yun, Kai Zhang

TL;DR: MemLife把长时第一人称视频整理为实体关联的文本事件记忆，并用时间索引代理阅读器检索；MemOpt进一步以强化学习优化记忆写入质量。

Details

Motivation: 个人视频可能累积数百小时并跨越多年，每次查询重新处理原片成本过高。文本记忆虽可扩展，却常因未保存关键证据或记忆库增长后检索竞争加剧而失败。

Result: MemLife在无需训练、查询时不访问视频的条件下，在四个长时程基准上比最强免训练基线提升4.6%至12.0%。MemOpt训练记忆写入器，使记忆更忠实、信息充分且易检索，并在不同视频和问题分布上将MemLife再提高2.7%至5.0%；增益可迁移到不同写入器、阅读器骨干和记忆系统。

Insight: 长时视频问答的瓶颈同时在记忆写入与后续检索，单纯扩大检索器无法弥补记忆遗漏。面向可检索性的记忆优化可带来跨模块收益，且推理时无需重新访问原视频。

Abstract: Long-term egocentric video enables personalized AI assistants to reason about daily life. However, as video histories grow to hundreds of hours spanning months or years, reprocessing raw clips for every query becomes computationally prohibitive. Memory systems offer a scalable alternative by compacting videos into text representations, but often fail on practical benchmarks: either the memory does not preserve key evidence, or the retriever fails to locate relevant entries due to retrieval competition in growing search spaces. To address these challenges, we introduce MemLife, a multimodal memory system that constructs entity-grounded, first-person text episodes and retrieves them via a time-indexed agentic reader. Without training or query-time video access, MemLife improves over the strongest training-free baseline by 4.6–12.0% across four long-horizon benchmarks. To further improve memory quality, we propose MemOpt, a reinforcement learning framework that optimizes the memory writer to produce faithful, informative, and retrievable memories. MemOpt consistently improves MemLife by 2.7–5.0% across different video and question distributions, with gains that generalize across writer and reader backbones and memory systems.

[123] LOCI: Spatial Linear Memory for Streaming World Models cs.CVPDF

Ji Xia, Tingting Liao, Xuezhi Liang, Hao Li, Guangyi Liu

TL;DR: LOCI把可访问细节的历史键值缓存与紧凑循环线性记忆结合，并以相机投影几何控制记忆读写，用于流式世界模型中的场景重访。

Details

Motivation: 相机重访区域时，世界模型需要找回过去看到的内容。键值缓存保留细节但随视频增长，固定大小循环状态更紧凑却使单个旧观测不再可直接访问。

Result: LOCI在部分Transformer块保留历史缓存，在其余块结合当前片段注意力和受投影相机几何条件化的循环记忆。在公开MIND记忆基准及未见记录轨迹上，它比代表性世界模型和同配方全注意力模型更忠实地复现重访内容；相同历史长度下峰值内存比全注意力低约30%。用有限观测库可实现常数内存流处理，并在同预算下保持更高保真度。

Insight: 将显式历史细节与带几何索引的压缩状态并用，可以兼顾可寻址性、流式效率和场景上下文。常数内存结论依赖限制保留观测的设置，不能理解为保存了完整无限历史。

Abstract: When a camera revisits a previously observed region, a video world model should reproduce what was there before. This requires both remembering past observations and retrieving the right one for the current viewpoint. Key-value caches preserve visual detail but grow with video length; recurrent memory is compact but compresses history into a fixed-size state, so individual past observations are no longer directly accessible. We introduce LOCI, a hybrid spatial-memory architecture that keeps both representations. In half of the transformer blocks, main attention keeps a key-value cache of past observations; in the other half, it is restricted to the current chunk and complemented by a recurrent linear-attention memory whose reads and writes are conditioned on projective camera geometry, so viewpoint enters both memory addressing and stored content. Recurrent readouts flow into subsequent cache-backed blocks and supply their queries with accumulated scene context. On the public MIND memory benchmark and on held-out recorded trajectories, LOCI reproduces revisited content more faithfully than representative world models and a same-recipe full-softmax model; with full history, it lowers peak memory at equal length by about 30% relative to full softmax. With a bounded bank of retained observations, it streams long videos at constant memory and remains more faithful than full softmax under the same budget.

[124] EviRover: Reinforcing Agentic Perception Beyond a Glance cs.CV | cs.AIPDF

Kaixuan Fan, Kaituo Feng, Tianshuo Peng, Yilei Jiang, Manyuan Zhang

TL;DR: EviRover将视觉感知建模为可交互的取证过程，让代理在初始图像证据不足时主动获取额外信息，再回答细粒度或知识密集问题。

Details

Motivation: 传统视觉感知假设单次观察和模型参数知识足以回答问题，但细节辨认和时效知识场景常不满足这一条件；适用于“证据不足时感知”的训练数据和基准也较缺乏。

Result: 作者构建EviRover-SFT-5K、EviRover-RL-12K训练集及含688个样本、覆盖五类感知问题的人类验证EviLens基准。经过监督微调和代理强化学习的4B模型，在EviLens上比其骨干平均高30分，达到先进专有模型相当水平；收益还迁移到WebEyes、常规感知及一般多模态基准，在BrowseComp-VL上提高15分。

Insight: 感知模型可以像代理一样通过交互补充证据，而不是把一次前向预测当成完整过程。提升跨到多类基准，但结果依赖允许代理访问的工具与外部信息环境。

Abstract: Visual perception is conventionally formulated as a one-shot prediction from a single glance at the image, under the assumption that the image content and the model’s parametric knowledge suffice to resolve the query. This assumption often fails in real-world scenarios that hinge on fine-grained visual details or require knowledge-intensive and up-to-date information. We term such cases \textit{perception under insufficient evidence} and formulate perception as an agentic process that can obtain information beyond a single glance. To address the absence of data for this setting, we design two dedicated data generation pipelines, yielding EviRover-SFT-5K and EviRover-RL-12K for training. We further construct EviLens, a human-verified benchmark comprising 688 instances across five perception categories. Building on these data, we present EviRover, to our knowledge the first perception agent explicitly trained to resolve perceptual queries through interaction, using supervised fine-tuning followed by agentic reinforcement learning. Experiments show that the 4B EviRover outperforms its backbone by 30 points on average on EviLens, reaching performance comparable to advanced proprietary models. The gains transfer beyond EviLens to WebEyes, conventional perception benchmarks, and general multimodal benchmarks, including a 15-point improvement on BrowseComp-VL. All code, models, and data are released.

[125] StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry cs.CV | cs.ROPDF

Yufei Wei, Shuhao Ye, Qi Wang, Xin Zheng, Qing Huang

TL;DR: StreamRig在冻结的多视图3D基础模型上增加流式压缩、因果缓存和位姿头，利用相机架几何进行多摄像头里程计。

Details

Motivation: 移动机器人和车辆拥有同步多摄像头，但许多流式3D基础模型按单目设计，难以高效利用相机间几何；长序列位姿估计还需要控制推理成本和漂移。

Result: 方法用Rig-Resampler压缩多视图特征、CausalBridge维护因果键值缓存，并通过周期性重锚定稳定长序列。仅训练74.6M参数，以相对位姿监督；训练使用仿真数据，真实评估为零样本。在NCLT、TartanGround、KITTI-360及自采人形机器人数据集上，平移和旋转漂移均低于所比较的非oracle单目流式及相机架离线方法，同时保持低推理成本。

Insight: 冻结多视图模型可提供几何先验，轻量因果模块则把它适配到在线里程计。仿真训练后实景零样本测试展示了迁移潜力，但摘要未提供各数据集的具体漂移数值。

Abstract: Mobile robots and vehicles carry synchronized multi-camera rigs, yet many streaming 3D foundation models are designed for monocular input, leaving efficient use of rig geometry a challenge. We present StreamRig, a freeze-and-stream framework that builds causal streaming odometry for calibrated rigs on a frozen multi-view 3D foundation model. The frozen front-end jointly perceives the synchronized views using rig calibration. A Rig-Resampler compresses their features, a CausalBridge applies causal attention with a key-value cache, and a lightweight head regresses rig poses. A periodic re-anchoring protocol supports stable pose estimation over long sequences. Only these modules are trained, 74.6M parameters in total, with relative poses as the sole supervision. Our two-stage training strategy combines group relocalization pretraining with causal rig training to transfer the geometric priors of the frozen front-end and the alignment ability of the pretrained modules to streaming odometry. We evaluate on NCLT, TartanGround, KITTI-360, and our self-collected humanoid-robot dataset ZJH, where training uses only simulation and real-world evaluation is zero-shot. Across all four datasets, StreamRig achieves lower translation and rotation drift than the evaluated non-oracle monocular streaming and rig-aware offline models, while maintaining low inference cost. Ablations and controlled camera-count experiments identify the sources of these gains. We further examine how longer training windows affect inference over longer horizons. Code has been released at https://github.com/WeiYuFei0217/StreamRig.

[126] ComputerSD: Online Self-Distillation from Real-Time Feedback for Computer-Use Agents cs.CV | cs.AIPDF

Yong Du, Tongbo Chen, Zhengxi Lu, Yizhou Liu, Bofan Chen

TL;DR: ComputerSD用真实GUI执行转移生成逐步反馈，并联合在线自蒸馏和轨迹级强化学习，改善计算机操作代理的中间动作监督。

Details

Motivation: 计算机操作代理的在线训练常依赖稀疏结果奖励，无法监督中间动作；直接自蒸馏又可能因固定指导与学生当前状态不匹配，或与单步正确性冲突。

Result: 微调的GUI分析器在每步操作后提供指导上下文和步骤价值分数，后者调节自蒸馏信号；训练异步联合优化词元级OPSD与轨迹级GRPO。在OSWorld-Verified上，相较仅结果奖励GRPO，Qwen3-VL-8B-Thinking提高1.9个百分点，EvoCUA-8B提高4.1个百分点，分布外评估也支持其泛化性。

Insight: 执行环境反馈可把GUI状态转移转化为密集学习信号，步骤价值还能约束指导概率变化，降低错误监督风险。验证范围包括OSWorld-Verified和分布外设置，摘要未列出后者具体数值。

Abstract: Online training enables computer-use agents (CUAs) to improve through interaction with executable environments. However, existing methods primarily rely on sparse outcome rewards, which provide no supervision for intermediate actions. On-policy self-distillation (OPSD) offers token-level learning signals through privileged rescoring, but directly applying it to CUA online training presents two challenges: fixed guidance may become misaligned with the student’s current state, and guidance-induced probability shifts may conflict with step-level correctness. We introduce ComputerSD, an online self-distillation method for CUAs that converts real-time feedback from executed GUI transitions into guidance for policy learning. A fine-tuned GUI analyzer produces guidance and a step-level value score after each action; the guidance provides privileged context, while the score regulates the resulting OPSD signals. ComputerSD jointly optimizes token-level OPSD and trajectory-level GRPO in a fully asynchronous training framework. On OSWorld-Verified, ComputerSD outperforms outcome-only GRPO by 1.9 and 4.1 percentage points on the general-purpose Qwen3-VL-8B-Thinking and specialized EvoCUA-8B backbones, respectively. Evaluation in out-of-distribution settings further supports the generalizability of ComputerSD. These results demonstrate the effectiveness of learning from real-time feedback through online self-distillation for CUAs.

[127] Looped Diffusion Transformer cs.CV | cs.LGPDF

Yong Xien Chng, Tianyi Chen, Wenwen Tong, Haiwen Diao, Zhongang Cai

TL;DR: Looped-DiT在扩散去噪步骤中重复使用共享Transformer块，以固定参数增加计算深度，并用中间层监督和自调节注意力稳定迭代更新。

Details

Motivation: 文本生图通常通过扩大模型或增加去噪步数扩展计算，但直接循环复用模块未必提升质量，原因包括循环间监督不足以及注意力更新逐渐侵蚀局部信息。

Result: Looped-DiT结合循环中间层深监督与自调节注意力。在参数量和计算量匹配时，它持续优于非循环基线；260M参数模型在多个基准超过大6.5倍的模型，同时推理计算低4.9倍。固定预算下，增加循环深度比增加去噪步数带来更大收益，较深循环还可逐步纠正前序循环中的错误。

Insight: 重复计算共享模块可作为扩展迭代深度的路径，模型能够在循环中逐步改进内部表示，呈现潜在推理迹象。该证据来自扩散生图表现，不能直接等同于语言模型式显式推理。

Abstract: Improving text-to-image models has traditionally relied on increasing model size or the number of denoising steps. In this work, we explore an alternative way to scale computation by repeatedly running shared Transformer blocks within each denoising step, effectively increasing computational depth while keeping the parameter count fixed. This looped computation enables iterative refinement of internal representations without explicit reasoning tokens. However, naive looping fails to consistently improve image quality. We trace this problem to weak supervision across intermediate loops and unregulated attention updates that progressively erode local information. To overcome these challenges, we propose Looped Diffusion Transformer (Looped-DiT), which combines deep supervision across intermediate loops with self-modulating attention to stabilize looped feature updates. Under matched-parameter and matched-compute settings, Looped-DiT consistently outperforms non-looped baselines. Notably, a 260M-parameter looped model can surpass a model 6.5x larger across multiple text-to-image benchmarks while requiring 4.9x lower inference compute. Beyond this performance gain, we find that looped computation can offer a more effective form of iterative computation for diffusion models, with increasing loop depth yielding larger gains than adding more denoising steps under a fixed inference budget. Furthermore, deeper loops can progressively correct mistakes made in earlier loops, exhibiting behaviors suggestive of latent reasoning. Together, these results show that looped computation offers a promising way to scale visual generation models.

[128] GLARE: Generating Listening Heads with Appropriate Reactions cs.CVPDF

Zikai Liao, Yumin Suh, Yi Ouyang, Yi-Lun Lee, Yi-Hsuan Tsai

TL;DR: GLARE面向双人对话中的倾听者反应生成，结合音频韵律条件、逐帧反应监督和专门评估指标，关注何时及如何作出回应。

Details

Motivation: 现有对话视频数据缺少细粒度倾听反应标注，常用说话头像指标主要评估画面真实度，不能判断点头、微笑等反应是否恰当或及时。

Result: 作者整理约147小时配对说话者—倾听者视频，含64,557条六类事件级标注，并提出基于流匹配Transformer的音频驱动GLARE；模型用Qwen2-Audio韵律特征和时序反应损失训练。评估同时衡量反应发生(R-F1)、时序重叠、非对称时间偏差和反应区域画质。实验显示，相较既有倾听者生成方法，视觉保真度和反应级指标均稳定提升，但摘要未给出具体幅度。

Insight: 自然倾听者生成需要对行为时机和类型进行直接监督，不能只追求逼真的人脸动画。专门数据和行为指标让评估更贴近交互质量，定量增益仍需查看完整实验表。

Abstract: While talking head generation has advanced rapidly, generating natural listener behavior in dyadic conversations, which know when to react, how to react, and with what type of response, remains underexplored. Existing dyadic datasets lack fine-grained listener reaction annotations, and prevailing evaluation metrics inherited from talking-head and video generation measure visual realism rather than whether a listener reacted appropriately. We address these gaps along three aspects. First, we curate a listening-head-specific dataset built from RealTalk and Seamless Interaction, comprising approximately 147 hours of paired speaker-listener videos with 64,557 event-level reaction annotations across six categories: nodding, head shaking, smiling, laughing, frowning, and surprised. Second, we introduce an audio-driven baseline built on a flow-matching transformer, namely GLARE, with prosody conditioning derived from Qwen2-Audio and a temporal reaction loss that explicitly supervises frame-wise reactions. Third, we propose a reaction-oriented evaluation protocol that jointly measures reaction occurrence (R-F1), temporal alignment (R-tIoU), asymmetric temporal deviation (R-ATD), and reaction-region visual quality (R-FID), giving a more behaviorally grounded assessment than visual-quality-only metrics. Experiment results show consistent gains over prior listening-head methods in both visual fidelity and reaction-level metrics, suggesting that reaction-aware data, modeling, and evaluation are critical for natural listening behavior.

[129] Atomizer-IO: Beyond Pixels, Patches and Grids cs.CVPDF

Hugo Riffaud de Turckheim, Sylvain Lobry, Nicolas Houdré, Damien Robert, Roberto Interdonato

TL;DR: Atomizer-IO以观测及采集元数据为原子输入，通过局部跨注意力从物理关系构造结构，支持不规则遥感栅格、可变输出密度乃至无栅格点云。

Details

Motivation: 规则网格适合自然图像，但对通道、采样时间、分辨率和几何变化的传感数据形成限制；通用集合架构虽去掉网格，却也可能丢失有用的空间归纳偏置。

Result: 每个观测由测量值与采集元数据描述，局部跨注意力把观测映射到可任意布置的锚点。随着逐步放宽栅格假设，Atomizer-IO在多数任务上与灵活的地球观测架构有竞争力，并可在训练后控制推理成本；相同设计无需改造即可扩展到无序3D点云。

Insight: 传感架构接口可以围绕物理观测及其关系建立，而不必把像素、图像块或规则网格作为固定前提。摘要强调多数任务表现有竞争力，没有给出统一领先或具体数值，结论应保持定性。

Abstract: Most vision architectures assume that observations lie on a regular grid, an effective abstraction for natural images but a restrictive one for sensing data whose channels, temporal sampling, spatial resolution, and geometry can vary. Generic set-based architectures remove the grid, but also remove useful spatial inductive biases. We introduce Atomizer-IO, an architecture that places observations first and derives structure from their physical relationships. Building on top of an atomic representation of the data, each observation is described by its measurement and acquisition metadata, while local cross-attention maps observations to anchor points that can be arbitrarily placed. We evaluate this design by progressively relaxing the grid assumption, from varying input raster configurations and incomplete channel sets to flexible output density and, ultimately, inputs without a raster grid. Atomizer-IO is competitive with flexible EO-specific architectures on most tasks, while offering post-training control over inference cost and competitive compute–performance trade-offs. The same formulation extends without architectural redesign to unordered 3D point clouds, showing that the atomic interface generalizes beyond regular raster inputs. These results suggest that pixels, patches, and grids do not need to define the interface of a sensing architecture.

[130] I Have a Stream: Making Self-Supervised Learning Work on Continuous Video cs.CVPDF

Ivan Martinović, Lukas Knobel, Yuki M. Asano

TL;DR: StreamMAE把自监督预训练改为按时间顺序消费连续视频流，并通过流感知正则化和偏向运动的裁剪缓解批内近重复帧问题。

Details

Motivation: 常规自监督训练将图像打乱并反复采样，不符合连续视频的时间结构。严格滑窗、单遍流式预训练下，已有对比和蒸馏方法效果较差，MAE虽更稳健仍不及独立同分布训练。

Result: 作者构建95小时城市步行视频数据集WT++。分析发现主要困难不是相邻批次相似，而是同一批次内帧近重复；StreamMAE据此调整输入采样并保留MAE重建目标。它优于流式基线，达到同视频数据独立同分布训练MAE的表现，接近ImageNet预训练MAE，并随预训练流从12小时扩至95小时而持续受益。

Insight: 流式学习的关键难点可来自批内冗余，而非仅来自训练顺序。对连续视频调整采样与正则化，能在不依赖全局打乱和多轮回放的条件下缩小与常规预训练的差距。

Abstract: Self-supervised learning draws inspiration from infant visual development, yet standard training pipelines bear little resemblance to it: images are independently sampled and globally shuffled across epochs. We study self-supervised learning from continuous video streams, where frames are consumed in temporal order using strict sliding-window batches, without global reshuffling or multi-epoch replay. To this end, we construct WT++, a 95-hour urban walking-tour video dataset for streaming pretraining. Combined with a comprehensive evaluation suite we find that contrastive and distillation-based methods struggle in this setting, while MAE is more robust but still falls short of standard i.i.d. pretraining. We find that high inter-batch similarity, caused by sliding-window consumption across consecutive batches, does not explain this gap. The main challenge is high intra-batch similarity, where frames within each batch are near-duplicates. To mitigate this, we propose StreamMAE, which preserves the core MAE reconstruction objective while adapting the input pipeline with stream-aware regularization and motion-biased crop selection. StreamMAE outperforms streaming baselines, matches i.i.d. MAE trained on the same video data, remains competitive with ImageNet-pretrained MAE, and scales positively as the pretraining stream grows from 12 to 95 hours.

[131] Image Classifiers are Efficient Self-Supervised Video Representation Learners cs.CV | cs.LGPDF

Owais Iqbal, Sudipta Sarkar, Shyam Marjit, Omprakash Chakraborty, Anirban Chakraborty

TL;DR: VideoMSN把视频帧组成超级图像，通过空间和时间遮挡的孪生自监督目标复用图像ViT学习视频时空表示。

Details

Motivation: 无标签视频表征常依赖昂贵3D架构或重建式自编码器；若能利用成熟图像基础模型，就可能降低视频预训练的架构和数据开销。

Result: VideoMSN为同一超级图像构造空间块遮挡视图和时间帧遮挡视图，使用共享ViT及遮挡孪生损失对齐表示，无需解码器。以DINO-v3和DeiT-v3初始化后，在Kinetics-400、UCF101和HMDB51达到当前最佳表现；相比既有视频自监督方法，预训练轮数最多减少32倍和160倍，并在低样本分类中保持较强迁移性。

Insight: 图像Transformer可通过将多帧组织为统一输入并分别遮挡空间与时间信息，承担高效的视频自监督学习。该方法减少预训练轮数，但摘要未说明各基准上的具体性能差值。

Abstract: We introduce VideoMSN, a Masked Siamese Network framework for efficient self-supervised spatio-temporal representation learning in videos. Instead of relying on heavy 3D architectures or reconstruction-based autoencoders for learning with unlabeled data, we repurpose standard image Vision Transformers by representing videos as super images which are grids composed of frames sampled from videos. From each super image, we construct two views: one with spatial patch masking and the other with temporal frame masking, ensuring no information leakage across frames. A shared Vision Transformer (ViT) encoder aligns their embeddings using a masked Siamese loss, capturing both motion and appearance cues without reconstruction. Our decoder-free formulation leverages an image foundation model towards efficient video representation learning. Starting from pretrained DINO-v3 and DeiT-v3 image encoders, VideoMSN achieves state-of-the-art performance on Kinetics-400, UCF101, and HMDB51 while requiring up to $32\times$ fewer and $160\times$ fewer video pretraining epochs compared to prior video self-supervised learning methods. Our proposed approach also shows strong performance in low-shot classification, confirming the transferability of the learned representations in a label-scarce scenario. Project Page: https://cvir.github.io/projects/videomsn.

[132] ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing cs.CV | cs.AIPDF

Xinghao Chen, Xiangbo Gao, Jiongze Yu, Yuheng Wu, Zhengzhong Tu

TL;DR: ViTeX-Bench为真实视频场景文字编辑建立数据集和三维评估协议，衡量文字正确性、视觉与时间质量、编辑局部性之间的取舍。

Details

Motivation: 视频场景文字编辑需替换招牌、白板等表面文字，同时保持周围内容、运动和镜头变化；现有配对真实视频有限，通用视频编辑指标也无法判断文字是否随时间保持正确。

Result: ViTeX-Dataset含387段720p真实视频，其中230段提供审阅过的训练编辑，157段构成固定评估集；协议用13项指标覆盖三类目标。八种基线显示准确文字、时间稳定和场景保留难以同时实现。开源参考模型ViTeX-Edit-14B在视频原生编辑器中平均CharAcc最高，为0.688，并在可比原始编辑器输出中取得最低文字裁剪Warp。

Insight: 把文字语义、时间一致性和编辑范围分开评估，能显式呈现场景文字编辑中的多目标冲突。基准提供可复现比较，但现有方法仍未同时解决三类质量要求。

Abstract: Recent video generation is increasingly realistic and controllable, yet video editing remains less developed, particularly for precise local edits that must preserve the original scene dynamics. Video scene text editing replaces text on scene surfaces, such as storefront signs, whiteboards, and product labels, while preserving the surrounding content, motion, and camera dynamics. Although scene text editing is well studied for images, video scene text editing that achieves high visual quality, temporal consistency, and edit locality remains underexplored. Existing resources offer limited paired real-video data, and general video-editing metrics do not directly measure whether the requested text remains correct over time. We introduce ViTeX-Bench, a benchmark suite comprising ViTeX-Dataset and a three-axis evaluation protocol. The dataset contains 387 real-world 720p videos with text-region masks and editing instructions: 230 provide reviewed, pipeline-generated paired edits for training, and 157 form a frozen evaluation split. The protocol evaluates text correctness, visual and temporal quality, and edit locality through 13 metrics, with one primary metric per axis and a Pareto comparison of their trade-offs. OCR calibration, human evaluation, and annotation-sensitivity analyses support the interpretation of these scores. Across eight baselines from four editing families, accurate text, temporal stability, and scene preservation remain difficult to achieve together. We also release ViTeX-Edit-14B, an open-source reference editor fine-tuned on the paired training split with motion-aligned glyph-video conditioning. It achieves CharAcc 0.688, the highest mean among the evaluated video-native editors, and the lowest comparable text-crop Warp among raw editor outputs. ViTeX-Bench provides a reproducible foundation for studying these trade-offs in video scene text editing.

[133] Physis-Lang: Self-Evolving Language as a Physical Representation for Video World Model cs.CVPDF

Liming Lu, Xianzheng Ma, Wenkun He, Guanqi Zhan, Yilin Zhao

TL;DR: Physis-Lang把自然语言作为视频物理过程的可优化表示，贯穿数据整理、训练与生成，并用断言级评估和迭代检索弥补模型物理知识缺口。

Details

Motivation: 视频世界模型可能生成视觉逼真却违反物理规律的内容；以往常假设语言不足以表达物理知识，因而额外引入视觉、潜变量、数值或规划信号。

Result: PhysCapBench把物理过程拆成原子断言并按精确率和召回率评估描述，代理循环据错误迭代改写提示；模型还将缺陷转成文本并检索覆盖缺失物理过程的视频。在四个常用物理视频基准、Wan和Cosmos骨干上的实验均提升物理合理性；基于开源Cosmos3-Nano的模型超过领先专有模型Veo 3.1。

Insight: 物理过程的语言描述可以作为数据筛选、模型训练和生成指导之间的共享接口，而非必须依赖额外数值状态。报告结论覆盖四个基准，但摘要未提供各基准的具体分数。

Abstract: Video world models are expected to predict how the physical world evolves, yet they often produce visually plausible videos that violate basic physical principles. Existing approaches commonly assume that natural language is insufficient to represent the physical knowledge required for reliable generation, and therefore introduce additional visual, latent, numerical, or planning-based signals. We revisit this assumption and introduce Physis-Lang, a self-evolving framework that treats physical language as a shared and optimizable representation across data curation, model training, and video generation. Physis-Lang represents physical processes through language that describes their relevant entities, causes, interactions, governing principles, temporal evolution, and effects. To improve this representation, we construct PhysCapBench, which decomposes physical processes into atomic assertions and evaluates captions using recall and precision. An agentic loop iteratively analyzes assertion-level errors and refines the instruction used to produce physical captions. Physis-Lang further converts model deficiencies into textual descriptions and uses language-guided retrieval to identify visually diverse videos that cover missing physical processes. Experiments on four widely used physical video benchmarks with Wan and Cosmos backbones demonstrate consistent improvements in physical plausibility. Notably, starting from open-source Cosmos3-Nano backbones, our Physis-Lang-enhanced models surpass the leading proprietary Veo 3.1 model.

[134] Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces cs.CVPDF

Hongyuan Tao, Xinggang Wang, Lianghui Zhu, Yongkang Li, Yunchao Wei

TL;DR: Multimodal Flow用统一连续流模型联合生成文本与图像，把两者组织为保序、保空间结构的连续超块并以共享向量场建模。

Details

Motivation: 统一多模态模型常将语言和量化图像都离散化，带来视觉量化瓶颈；或混合离散文本与连续图像生成，导致目标函数和采样方式依赖模态。完全连续的多模态预训练尚未充分探索。

Result: 共享分块因果流骨干通过Flow Matching学习文本块和图像块组成的连续超块，训练时并行预测多个目标块、推理时顺序生成。MF-1在0.6B、1.2B和1.6B规模持续预训练均有改善；仅用150B预训练词元，图像生成基准平均82.8，视觉问答和多模态理解基准平均75.3，并在匹配数据、优化及参数预算时超过代表性混合和离散模型。

Insight: 连续嵌入空间有机会统一语言和视觉生成，同时避免图像离散化及模态特定采样流程。结果来自特定训练配方和基准集合，不能据此推断所有多模态任务都适合纯连续建模。

Abstract: We present Multimodal Flow, a fully continuous generative model of language and vision. Most unified multimodal models either model both language and quantized images as discrete tokens or combine discrete language prediction with continuous image generation. The former introduces a visual quantization bottleneck. The latter requires modality-dependent objectives and sampling procedures. Fully continuous modeling avoids these trade-offs and enables a shared generative process, but remains underexplored for multimodal pretraining. Multimodal Flow introduces a unified continuous architecture that integrates multimodal continuous representations with a shared chunk-causal flow backbone. It organizes text blocks and images as ordered continuous hyperchunks, preserving textual token order and visual spatial structure. The backbone learns a single vector field over these hyperchunks through Flow Matching. Joint attention enables cross-modal interaction, while modality-specific feed-forward networks process each modality. The model predicts multiple target chunks in parallel during training and generates hyperchunks sequentially at inference. We instantiate MF-1 and pretrain it on multimodal data. Across 0.6B, 1.2B, and 1.6B scales, continued pretraining consistently improves multimodal modeling. With only 150B pretraining tokens, MF-1 achieves an average score of 82.8 across GenEval and DPG-Bench and 75.3 across VQAv2, MMBench, and POPE, remaining competitive with unified models trained on substantially more data. Under matched data, optimization, and parameter budgets, Multimodal Flow further outperforms representative hybrid and discrete models. These results establish continuous chunk-based embedding flow modeling as a new fully continuous paradigm for unified multimodal modeling. The related code and model are publicly released at https://github.com/hustvl/Multimodal-Flow.

[135] Life-Bench: A Benchmark and Knowledge Graph Framework for Multimodal Personalization Beyond Concept Recognition cs.CV | cs.AI | cs.CL | cs.IRPDF

Xia Hu, Honglei Zhuang, Brian Potetz, Alireza Fathi, Bo Hu

TL;DR: Life-Bench评测模型能否从多模态个人生活历史中完成从人物概念识别、事件理解到跨经历聚合推理，并提出关联式个人知识图谱LifeGraph。

Details

Motivation: 个人助手需对生活历史进行多模态推理，从识别人到理解事件、汇总长期模式；现有基准主要测概念级识别，较少考察更长证据范围的任务。

Result: Life-Bench是超过11,800个问答对的合成且经人工核验多模态基准，覆盖10项任务，按证据范围分为概念识别、事件理解和聚合推理；照片式个人历史在嵌入统计上对齐真实用户账户分布。LifeGraph提供结构化检索，并按需访问原始视觉证据，在事件与聚合任务上尤其有潜力。对四种检索范式的评估显示，证据范围扩大时准确率急剧下降，聚合任务低于0.40，且没有一种范式在所有类别占优。

Insight: 个人化不仅需要识别图像中的概念，还需跨事件组织证据并总结长期模式。不同证据范围的性能落差表明，结构化记忆和按需视觉检索是超越概念识别的关键挑战。

Abstract: As large language models increasingly power personal assistants, users expect them to reason over multimodal life histories, from recognizing people to understanding events to aggregating patterns, yet existing benchmarks primarily target concept-level recognition. We introduce Life-Bench, a fully synthetic, human-verified multimodal benchmark of over 11,800 question-answer pairs across 10 tasks, organized by required evidence scope: concept identification, event understanding, and aggregated reasoning. The benchmark’s photo-centric personal histories are distributionally aligned with real user accounts under embedding statistic. The interconnected structure of personal data invites graph-based solutions; we propose LifeGraph, a personal knowledge graph framework providing structured retrieval with on-demand access to source visual evidence, showing particular promise on event and aggregated tasks. Systematic evaluation of four retrieval paradigms on Life-Bench demonstrates that accuracy degrades sharply with evidence scope, falling below 0.40 on aggregated tasks, and that no single paradigm dominates across categories. Performance beyond concept recognition remains modest for all evaluated methods, establishing personalization over multimodal histories as an open challenge and Life-Bench as a testbed for future progress.

cs.CL [Back]

[136] Conformal Factuality Control for Multi-Hop Retrieval-Augmented Generation cs.CL | cs.LG | stat.MLPDF

Muhammad Aimal Rehman, Chi-Kuang Yeh

TL;DR: 论文将基于分割共形预测的逐声明事实过滤扩展到多跳RAG，并量化更强事实可靠性要求带来的声明保留率和回答弃答权衡。

Details

Motivation: 检索增强生成即使取回外部证据，也不保证模型生成的声明都被证据支持；多跳RAG还需在多个相互依赖阶段检索和推理。作者检验此前用于RAG的共形事实控制能否扩展到多跳场景。

Result: 作者在HotpotQA、Natural Questions和TriviaQA上测试Llama 3.1 8B及GPT-4o-mini，共六种多跳模型—数据集配置，并设置单跳参考实验。所有配置中，共形目标越严格，保留声明完全受支持的回答比例越高；95%目标下该比例为95.80%至97.20%，未过滤时为55.60%至76.03%。但筛选具有强选择性：95%目标仅保留4.41%至31.09%的生成声明，且仅9.70%至51.40%的回答保持非空。

Insight: 名义上的高事实可靠性必须与保留率和弃答率一起报告。多跳共形过滤能提高保留声明的证据支持程度，但代价可能是大量删去声明或返回空答案。

Abstract: Retrieval-augmented generation (RAG) can ground large language models in external evidence, but retrieved context does not guarantee that generated claims are factually supported. This problem is especially relevant in multi-hop RAG, where retrieval and reasoning proceed through multiple dependent stages. We study whether claim-level conformal factuality control, previously developed for RAG, remains effective in this setting. We apply split-conformal claim filtering to multi-hop RAG and evaluate it on HotpotQA, Natural Questions, and TriviaQA using Llama 3.1 8B and GPT-4o-mini, together with a single-hop reference experiment. Across all six multi-hop model-dataset configurations, increasingly stringent conformal targets consistently increase the fraction of responses whose retained claims are fully supported. At the 95% target, this rate ranges from 95.80% to 97.20%, compared with 55.60%-76.03% without filtering. However, the improvement is strongly selective: only 4.41%-31.09% of generated claims are retained and 9.70%-51.40% of responses remain non-empty at the 95% target. These results show that conformal factuality extends to multi-hop RAG, while demonstrating that nominal reliability must be interpreted jointly with claim retention and abstention.

[137] Framing the Narrative: Ideological Mimicry in Large Language Models cs.CL | cs.CYPDF

Olivia Macmillan-Scott, Michael Jacobs, Nils Metternich, Mirco Musolesi

TL;DR: Poli-SHIFT对七个开源语言模型进行跨国家政治议题测试，发现措辞、前提及用户立场会系统性改变模型表达的政治观点。

Details

Motivation: 政治争议问题的模型评测常把立场视为稳定属性，但用户会通过术语选择、问题假设及个人背景表达政治信号。若模型随这些信号改变态度，可能让不同立场用户接收系统性不同的同一议题叙述。

Result: 作者构建Poli-SHIFT数据集与评测框架，在美国、英国和澳大利亚十个争议议题上系统操纵争议术语、带政治倾向的前提和用户信息，并收集选择题及开放文本回答。七个开源模型均显示提示框架会影响政治立场；只改变术语，在配对比较中就有16.9%反转模型支持的议题一方。用户明确声明的政治意识形态也会系统性地将回答推向用户立场。摘要未列模型间的详细差异。

Insight: 模型政治立场并非脱离交互的固定属性，问题框架和用户信号会改变输出。如果个性化模型信息源持续迎合用户已有观点，可能进一步强化分化的信息环境。

Abstract: Large language models (LLMs) are increasingly used to answer questions about politically contentious issues, yet evaluations typically treat a model’s stance as a relatively stable property. Real users, however, communicate political signals through their terminology, assumptions, and personal context. We investigate whether such signals produce ideological mimicry: systematic shifts in the political stance expressed by an LLM toward the position conveyed by the interaction. If LLMs adapt their responses to these signals, they risk creating personalised political information environments in which users with opposing views receive systematically different accounts of the same issue, potentially reinforcing existing divisions. We build the Poli-SHIFT dataset and evaluation framework and assess seven open-weight LLMs across ten contentious political topics in the United States, United Kingdom, and Australia, systematically manipulating contested terminology, politically valenced premises, and user information, and eliciting responses in both multiple-choice and open-text formats. Across models, we find robust evidence that prompt framing shapes the political stance of LLM outputs. Changing terminology alone reverses which side of an issue a model supports in 16.9% of matched comparisons. Stated political ideology also systematically shifts responses toward the user’s position. These findings show that political stance is not a fixed property of LLMs; the views expressed are conditional on the interaction with the user. As LLMs become increasingly personalised sources of information, such interaction-dependent adaptation could contribute to political information environments that reinforce users’ existing perspectives.

[138] EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making cs.CLPDF

Yuhan Guo, Jinming Liu, Liang Xu, Ziqiang Li, Jianguo Huang

TL;DR: EVOKE在固定环境状态和交互历史下改变目标，迫使智能体根据目标重新排序动作，从预训练模型中激发可迁移的世界知识。

Details

Motivation: 大语言模型智能体在未见环境中迁移较差。世界模型方法通过预测未来观察来改善迁移，但需要额外训练，而且预测误差可能在规划中累积；数字环境中的语言模型可能已经在预训练时内化大量世界知识，问题在于如何激发它。

Result: EVOKE在固定状态与历史上为同一组候选动作提供多个目标，训练模型在不同目标下改变动作偏好，而不是沿用单一目标形成的上下文习惯。理论动机指出，能胜任多样目标的策略，其动作偏好中可恢复世界模型信息。三种骨干、多种任务实验中，EVOKE提高任务表现、未见环境泛化和数据效率；受控分析进一步探查收益来源。摘要未给具体指标。

Insight: 后训练可以通过在同一状态下改变目标来迫使策略表达对环境动态及动作后果的理解，而不必显式训练未来状态预测器。直接的决策监督可能成为激活预训练世界知识的高效途径。

Abstract: Large language models (LLMs) are increasingly deployed as agents for multi-step decision-making, yet transfer poorly to unseen environments. World-model methods address this by training agents to predict future observations, at the cost of additional training and errors that compound when predictions are used for planning. However, for LLM agents operating in digital environments, much of this world knowledge is already internalized during pretraining, which shifts the problem from acquiring it to eliciting it. We argue that typical post-training provides little pressure for such elicitation, since supervision under a single goal at each visited state inadvertently drives policies to rely on superficial contextual habits. We introduce EVOKE, a post-training method that supplies this pressure through goal diversity at fixed states. Motivated by theory showing that an agent competent across diverse goals must encode a world model recoverable from its action preferences, EVOKE holds the environment state and interaction history fixed and ranks the same candidate actions under alternative goals, forcing action preferences to change, so that a policy relying on contextual habits or single-goal correlations cannot order them correctly. This implicitly elicits the policy’s pretrained world knowledge to inform decisions. We evaluate EVOKE across diverse tasks in three backbones, demonstrating improved task performance, unseen environment generalization, and data efficiency. We further conduct controlled analyses to better understand what drives these gains. These findings offer a new perspective on eliciting internalized world knowledge for transferable action through direct decision supervision.

[139] Evaluating Whether LLMs Can Reliably Connect the DOTs? cs.CLPDF

Eftekhar Hossain, John Salvador, Santu Karmaker

TL;DR: 论文构建约9,200例多领域叙事文本补全基准，发现当前指令微调LLM的补全文质与模型规模并无稳定对应关系。

Details

Motivation: 现实信息零散且噪声大，构建连贯叙事需要补出缺失文本并同时保持局部上下文和全局故事一致性。尽管许多LLM预训练使用文本填空目标，其真实叙事补全能力仍缺少系统评估。

Result: 基准在百科文本、常识故事、新闻和视觉叙事四类材料中遮盖1至3句，约有9,200个样本。作者评估20个1.5B至70B开源指令模型，并改变指令具体程度和推理引导，使用常见自动指标及覆盖五个叙事维度的定性框架评分。模型规模不能可靠预测补全质量：Gemma-2-2B定性评分最高，为4.02/5，超过十倍以上模型，包括DeepSeek-Qwen-32B的3.77/5和LLaMA-3.3-70B的3.71/5。显式思维链仅带来0.6%的边际提升；短叙事和领域属性比补全位置更能预测难度。

Insight: 叙事补全要求保持全局故事而非仅接续局部语言，参数规模和显式推理都不是充分条件。样本文体与长度对难度影响更强，基准应覆盖多领域并联合自动和人工维度评价。

Abstract: Access to real-world information is often noisy and fragmented. Constructing a coherent narrative from such fragments requires models to reconstruct missing spans within a broader storyline, commonly referred to as text infilling, while preserving consistency with both the local context and the global storyline. Despite using text infilling as a pre-training objective in many Large Language Models (LLMs), their actual performance on real-world narrative infilling remains underexplored. In this paper, we address this gap by introducing a multi-domain benchmark of ~9.2K instances for narrative infilling, constructed by masking one to three sentences across four narrative types: encyclopedic text, commonsense stories, news articles, and visual narratives. Using this benchmark, we evaluate 20 instruction-tuned open-source LLMs ranging from 1.5B to 70B parameters across varying levels of instruction specificity and reasoning guidance. Outputs are assessed using standard automatic metrics and a qualitative framework covering five narrative dimensions. Results show that model scale does not reliably predict infilling quality: Gemma-2-2B achieves the highest qualitative score (4.02/5), outperforming models over ten times larger, including DeepSeek-Qwen-32B (3.77/5, 6.6%) and LLaMA-3.3-70B (3.71/5, 8.3%). We further find that explicit reasoning offers limited benefits as chain-of-thought reasoning yields only a marginal improvement (+0.6%). Additionally, short narratives and domain characteristics emerge as stronger predictors of task difficulty than infill position alone for narrative infilling in current LLMs.

[140] MedKIT: Evaluating Knowledge Integration and Generalization in Large Language Models cs.CL | cs.LGPDF

Lukas Thede, Yash Kumar Atri, David Chen, Danielle Bitterman, Matthias Bethge

TL;DR: MedKIT评估模型在连续临床知识更新后能否跨词汇变化、关系变换、组合推理及实际操作使用新知识，而非只记住原始事实。

Details

Motivation: 现实知识持续变化，医学领域的临床证据更新尤为频繁，过时知识可能造成安全风险。既有知识编辑评估多关注更新事实的直接回忆，不能反映模型是否能将新知识用于新情境。

Result: MedKIT围绕临床证据派生事实更新构造样本，并提供不同探针，测试词汇变化、关系转换、组合推理、开放式操作化以及旧知识保留。作者在五种通用或医学模型上比较12种知识集成策略。多数方法在原更新任务和词汇变体上收益明显，但关系泛化有限，没有一种方法在组合或操作任务上带来有意义提升，显示直接回忆与可用知识之间存在稳定差距。摘要未给具体分数。

Insight: 知识写入成功不代表知识可迁移或可执行。评估应把直接记忆、关系泛化、组合推理、操作化及无关旧知识保留分别测试。

Abstract: Constantly evolving real-world knowledge necessitates models to be updated continuously. Especially in medicine, as clinical evidence changes over time, outdated knowledge can pose safety risks. Existing evaluations of knowledge integration focus on factual recall, offering limited insight into whether newly integrated knowledge is actually usable. Our benchmark MedKIT (Medical Knowledge Integration and Transfer) provides a granular evaluation of how models integrate and apply knowledge under realistic sequences of clinical updates. Each instance corresponds to a factual update derived from clinical evidence, paired with targeted probes that assess transfer across lexical variation, relational transformations, compositional reasoning, and open-ended operationalization, as well as locality tests for knowledge preservation. Using MedKIT, we conduct a large-scale empirical study of 12 knowledge integration strategies across 5 diverse models, including both general-purpose and medical LLMs. Our results reveal a consistent gap between recall and usable knowledge: while most methods achieve strong gains on the original update task and under lexical variation, relational generalization is limited, and no method yields meaningful improvements on compositional or operational tasks. These findings highlight a fundamental challenge in knowledge integration and position MedKIT as a testbed for developing methods that make newly integrated knowledge more consistently usable across tasks and contexts.

[141] StreamDecisionBench: Evaluating Decisions in Force on Evolving Language Streams cs.CLPDF

Jhen-Ke Lin, Chung Chun Wang

TL;DR: StreamDecisionBench评测语言模型决策在不断变化的输入流中何时生效，并把错误时段分解为判断失误、响应延迟或两者共同造成。

Details

Motivation: 语言模型越来越多地嵌入程序作为决策模块，程序会按当前状态询问模型并持续执行返回决策，直到有新决策到达。证据变化时，先前正确的决策可能在状态过期后仍生效；离线准确率会把这种时序错误误判为正确。

Result: SDB覆盖四类应用，输入流持续更新，参考决策由公开规则的可执行代码生成。基准逐时刻评估当前生效决策，并把每个错误时段归因为判断、延迟或二者。其汇总指标是在1至5秒更新间隔上的生效准确率，并在对数时间轴计算归一化曲线下面积，让相同倍数时间区间权重相同。四种托管模型的六种设置中，该分数与“离线准确率×oracle综合时序分数”相差不超过2.9分。推理可改善判断，但低推理力度对两款模型带来的时延成本相对离线准确率分别为38.8和42.8分；判断较弱但更快的组件综合得分可与Terra无推理相近。

Insight: 实时决策质量必须同时考虑判断正确性和决策到达时机，离线准确率会忽略旧决策继续生效的代价。不同模型和推理设置的速度—判断权衡随任务时间尺度变化。

Abstract: As natural language drives more applications, language models increasingly run inside programs as decision components: the program sends them the current state and acts on the returned decision until a newer one arrives. When evidence changes during inference, a decision correct for its own state can stay in force after that state has passed, as when a call recorder keeps running after a customer starts reading out a card number; untimed (offline) accuracy counts such an error as correct. We introduce StreamDecisionBench (SDB), which evaluates the decision in force at every instant and attributes every erroneous instant to judgment, latency or both. Its scenarios stream evidence in four application families, with reference decisions computed from public rules by executable code. We summarize in-force accuracy across update intervals of 1-5 s by its normalized area under the curve on a logarithmic time axis, giving equal weight to equal multiplicative ranges. Across six settings of four hosted models, this score stays within 2.9 points of the scenario-wise product of untimed accuracy and an oracle’s integrated timing score. Reasoning improves judgment, but at low effort latency costs Luna and Terra, two GPT models we also evaluate without reasoning, 38.8 and 42.8 points relative to untimed accuracy; a faster component with weaker judgment attains a similar integrated score to Terra without reasoning. The aggregate and family curves show where these tradeoffs change, making the evaluation’s time-scale dependence visible.

[142] Prompt2Skill: Unsupervised Skill Optimization From Natural Language Instructions cs.CL | cs.AIPDF

Bo Ni, Li Li, Ryan A. Rossi, Franck Dernoncourt, Tyler Derr

TL;DR: Prompt2Skill只需自然语言任务描述即可自动发现或合成数据、形成任务规范并闭环优化可复用技能，无需预先整理域内训练集。

Details

Motivation: 模型推理时使用的外部技能可加入专业领域的流程和知识，但专家撰写成本高，也未必适配具体模型；新任务出现时可能还没有策划好的训练数据。既有自动技能优化通常需要已有的域内数据集。

Result: Prompt2Skill从提示生成任务规范，自动发现或合成数据，再通过反思编辑闭环改进技能。在问答、阅读理解、电子表格操作和数学推理四个领域中，相较直接提示基线持续更好；跨开源与前沿模型平均提升10.8分。摘要未给出各任务分数或具体使用的数据量。

Insight: 技能优化可以从任务自然语言描述启动，并把数据发现/合成纳入自动化过程，降低对现成标注集和专家手写指南的依赖。模型特定失误通过闭环反思反馈到技能内容中。

Abstract: Skills are external artifacts that Large Language Models (LLMs) consume at inference time to improve their performance on specialized domains by incorporating relevant procedural and domain knowledge. Expert-authored skills are expensive to produce, and the resulting artifacts are not optimized for the specific model that consumes them, whose failure modes can vary with version, scale and training. In addition, emerging tasks may fall outside the scope of existing skill libraries, creating a need to develop new skills before curated training data become available. Recent works have explored automated skill optimization through reflection, but they require a curated, in-distribution training set, which users might not always have. To address these limitations, we present Prompt2Skill, a framework that builds skills from natural-language task description alone. From the prompt, the system derives a task specification, discovers or synthesizes datasets, and refines the skill in a closed loop of reflective editing. Across four domains spanning question answering, reading comprehension, spreadsheet manipulation, and mathematical reasoning, Prompt2Skill consistently outperforms the direct prompting baseline, achieving an average improvement of 10.8 across open-source and frontier models.

[143] Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translation cs.CL | cs.AI | cs.CV | cs.MAPDF

Haibo Jin, Xinjie Li, Najmeh Sadoughi, Yang Liu, Yibo Wang

TL;DR: SMART通过测试时自我演化多智能体工作流，为长篇字幕翻译建立系列级记忆，并按场景复杂度动态路由工具和翻译代理。

Details

Motivation: 长篇字幕翻译需跨剧集理解语境与文化信息，并保持术语和风格一致。单模型方法多按句处理，多智能体系统则常用静态工作流，无法适配场景复杂度和制作条件。

Result: SMART在测试时训练阶段建立持久系列记忆，利用动态路由和混合智能体翻译部分句子，并调用术语核验、字幕约束验证和上下文检索工具。评审—细化循环评分候选，通过文本批评更新代理提示和路由策略，无需重新训练底层LLM；演化后的配置再翻译剩余系列。作者提出Subtitle Arena，覆盖14种类型、每系列2至198集、1959至2023年作品和15种目标语种，并构建含7维、19类错误的字幕MQM框架SubMQM。SMART在15个翻译方向的整体MQM均最佳，较最强竞争智能体平均减少6.9%惩罚；公开MuSC基准四个语言对中模型结果均最佳，人工评估总体4.50/5。

Insight: 长篇翻译需要在测试时积累系列级记忆，并根据句子和场景动态选择支持工具及代理。利用局部测试数据反馈演化路由和提示，可以适配不同剧集而不微调基础模型。

Abstract: Long-form subtitle translation requires reasoning over discourse and cultural context spanning episodes or entire series, while maintaining consistent terminology and style. Existing single-LLM methods are largely sentence-level, and multi-agent systems often use static workflows that do not adapt to scene complexity or production context. We propose SMART, a Self-evolving Multi-Agent system for long-foRm subtitle Translation. During test-time training, SMART builds persistent series-level memory and translates a subset of sentences through a dynamic router and Mixture-of-Agents layer with tools for terminology verification, subtitle constraint validation, and contextual retrieval. A judge-refiner loop scores candidates and uses textual critiques to update agent prompts and routing policies without retraining the underlying LLMs. During test-time inference, the evolved configuration translates the remaining series. We also introduce Subtitle Arena, covering 14 genres, 2–198 episodes per series, production years 1959–2023, and 15 target locales, together with SubMQM, a subtitle-adapted MQM framework with seven dimensions and 19 error categories. SMART achieves the best overall MQM score in all 15 Subtitle Arena directions, reducing average penalty by 6.9% over the strongest competing agent system. On the public MuSC benchmark, SMART obtains the best model result across all four language pairs and also achieves the best human-evaluation result, with an overall score of 4.50/5.

[144] Training LLM Judges from Language Feedback via Position-Selective Self-Distillation cs.CL | cs.LGPDF

Ilgee Hong, Changlong Yu, Zhenghao Xu, Xin Liu, Yuwei Zhang

TL;DR: 研究依据教师与学生在各token处的熵变化选择蒸馏位置，让语言模型裁判学习有助于语义理解的评审标准，而非记忆特定措辞。

Details

Motivation: 主观任务的裁决取决于模型调用了哪些评价标准及如何加权。结果监督RL通常只按最终判决准确性给整条输出单一奖励，无法单独信用分配给标准选择位置，也没有充分利用偏好理由等自然语言反馈。

Result: 作者发现熵变化对应两类信号：上下文锐化使教师集中到某个与反馈一致的标准表达，可能促成措辞记忆；上下文扩散则在多个符合反馈的表达间分配概率，可能更利于语义理解。基于此提出位置掩码，保留熵变化分布低尾、屏蔽高变化位置。实验表明，相较朴素自蒸馏，屏蔽高熵变化位置改善域外泛化；所得裁判在评估的主观子类别上比结果监督RL高2至9个百分点，在客观类别上仍有竞争力。

Insight: 密集自蒸馏信号不应对每个位置一视同仁；教师把概率集中到某种表达可能导致表面记忆，而保留多个语义等价表达更有利于泛化。

Abstract: We study training LLM judges from natural language feedback, especially for subjective tasks where the verdict depends strongly on which evaluation criteria the judge invokes and how it weighs them. The dominant approach, outcome-supervised RL (e.g., GRPO), credits every token in the rollout with a single scalar determined only by the accuracy of the final verdict, providing no separate credit at the criterion-choice tokens and ignoring the rich language feedback (e.g., preference rationales) that naturally accompanies preference labels. Self-Distillation (SD) is one natural way to use this language feedback: the same model, conditioned on this feedback, acts as a teacher providing dense, position-level supervision. However, not all positions carry equally useful signal. Using the per-position entropy shift between teacher and student, we identify two regimes: context sharpening, where the teacher concentrates probability on a particular feedback-aligned criterion expression, and context spreading, where the teacher distributes probability across multiple feedback-aligned alternatives. We interpret these patterns as follows: sharpening encourages memorization of a particular criterion expression, whereas spreading promotes semantic understanding by preserving these alternatives. Motivated by this asymmetry, we introduce position masking based on the entropy shift that retains the lower tail of the entropy-shift distribution. Experiments show that masking higher-entropy-shift positions improves out-of-distribution generalization over naive SD. The resulting self-distilled judges outperform judges trained with outcome-supervised RL by 2-9 percentage points on the evaluated subjective subcategories, while remaining competitive on objective ones.

[145] Recovering Off-Policy Supervision for Speculative Decoding cs.CL | cs.CV | cs.LGPDF

Jungseob Lee, Chanjun Park, Sugyeong Eo, Hyeonseok Moon

TL;DR: ALR与IRA从固定外部文本语料中恢复推测解码草稿模型的有效监督，避免一次离策略token差异导致整个预测块后续槽位被丢弃。

Details

Motivation: 推测解码块草稿通常用其他模型生成的语料训练；块内一个token与目标策略偏离后，后续槽位监督便都无效。现有方法丢弃这些分歧位置，造成大量监督浪费。

Result: 框架通过两部分恢复监督且保留原语料：锚点标签重标记（ALR）用贪心目标模型rollout的分布替换语料标签，为所有预测槽位恢复有效监督；rollout内锚点（IRA）把草稿块直接嵌入目标rollout，让草稿模型接触目标生成上下文，并复用预计算rollout特征而不增加目标模型成本。在固定视觉语言和文本语料上，相比DFlash，贪心接受长度最高提高36.5%，持续优于删除偏离样本的基线。单轮训练已超过最佳擦除调度；三轮后接受长度匹配用目标模型重新生成响应训练的结果。

Insight: 离策略偏差会沿推测解码块传播，但可用目标模型rollout重标标签、并把草稿训练锚定到目标上下文来恢复后续槽位监督。这样无需改写原始语料也能接近目标生成数据训练效果。

Abstract: Block drafters for speculative decoding are commonly trained on corpora written by external models, where a single off-policy token invalidates supervision for all subsequent slots in a block. Existing approaches discard these divergent slots, resulting in severe supervision loss. To resolve this problem while preserving the training corpus, we propose a rollout-based training framework that recovers full supervision through two complementary components. The first component, Anchor-Label Relabelling (ALR), replaces corpus labels with distributions from greedy target rollouts, restoring valid supervision across all predicted slots. The second component, In-Rollout Anchors (IRA), places draft blocks directly inside these rollouts to expose the drafter to target-generated context, reusing precomputed rollout features at no additional target cost. Across fixed vision-language and text corpora, our framework increases greedy accepted length by up to 36.5% over DFlash and consistently outperforms erasing baselines. Notably, a single epoch of our method surpasses the best erase schedules. After three epochs, it matches the acceptance length of training on target-regenerated responses. These results show that our framework provides an effective and compute-efficient approach for training speculative drafters on fixed corpora without modifying the original text. Code is available at https://github.com/js-lee-AI/ALR-IRA.

[146] Overlap, Unique and Conflict: Can LLMs Extract What They Can Recognize? cs.CLPDF

Eftekhar Hossain, Santu Karmaker

TL;DR: OUC提出从两篇完整叙事中抽取重叠、冲突和独有子句的任务，显示模型识别关系的难点主要在长文本中对齐并提取对应子句。

Details

Motivation: 多视角叙事理解需要辨别来源间信息一致、冲突或独有之处。既有跨文本关系研究多只对预先给定的文本对分类，并未直接从完整叙事中抽取相关内容。

Result: 作者构建约2.2万对叙事、14万条标注实例，覆盖事实、论证和政治文本；评估14个0.6B至35B开源模型。独有信息明显比重叠和冲突更容易提取：最强Gemma-4-31B在重叠F1仅61.13%、冲突48.58%，独有信息则超过75%。诊断显示困难不只是关系识别，还在于从完整叙事配对并抽取对应子句，小模型尤为明显。任务特定监督显著缩小差距：微调Qwen-3-8B比自身基线提升15至28个百分点，在若干任务上超过约四倍大小的Qwen-3.6-35B；重叠和冲突仍低于理想水平。

Insight: 跨叙事抽取需要同时定位并配对完整故事中的对应语句，而不只是判断给定句子关系。监督可以大幅弥补模型规模差距，但信息重叠与矛盾仍是开放难题。

Abstract: Understanding multi-perspective alternative narratives requires identifying how their information agrees, conflicts, or differs across sources. Existing work on cross-text relations largely focuses on categorizing relations between predefined text pairs, such as entailment or contradiction, rather than directly extracting such information from full narratives. To address this gap, we introduce Overlap-Unique-Conflict (OUC) extraction, a cross-narrative task that extracts all overlapping, conflicting, and unique clauses from two narratives. To support this study, we construct a benchmark of approximately 22K narrative pairs and 140K OUC instances spanning factual, argumentative, and political discourse. Evaluating 14 open-source LLMs (0.6B-35B), we find that unique information is far easier to extract than overlap and conflict: the strongest model, Gemma-4-31B, reaches only 61.13% F1-score on overlap and 48.58% on conflict, against more than 75% on unique. Further diagnostic analysis reveals that this difficulty does not stem from relation recognition alone, but rather from a failure to pair and extract the corresponding clauses from full narratives, especially in smaller models. Nevertheless, learning these extractions with task-specific supervision narrows the gap considerably: a fine-tuned Qwen-3-8B gains 15-28% absolute over its baseline and surpasses models roughly four times its size (e.g., Qwen-3.6-35B) on several tasks. Even so, overlap and conflict remain well below satisfactory, leaving cross-narrative clause extraction an open challenge.

[147] Uncovering Uncontrolled Repetition through Residual Stream Dynamics cs.CL | cs.AIPDF

Yuanhe Zhang, Xinyao Zhou, Haoran Gao, Yuyao Zhang, Zhenhong Zhou

TL;DR: TRC比较生成token写入残差流的注意力与MLP变化，定位重复生成早期异常并选择性抑制相应残差维度。

Details

Motivation: 无控制重复会拉长自回归生成并可能被用于资源消耗攻击。既有研究多关注中后层已经显著激活的重复特征，重复活动如何在这些表征变强前形成仍不清楚。

Result: 作者主要在大型视觉语言模型中研究文本和视觉输入共同触发的多种重复模式，提出Tokenwise Residual Comparison（TRC），逐生成token比较注意力与多层感知机对残差流的写入，识别并定位与重复相关异常，再在对应层选择性抑制残差维度。实验显示TRC平均将循环率降低57%。分析发现重复语义在浅层形成并沿残差流传播，干扰正常表示。该方法也可推广到LLM和大型推理模型，并捕捉类似动态、有效缓解重复。

Insight: 重复生成的介入窗口早于中后层强特征显著出现。按token追踪注意力和MLP写入残差流，可找到重复模式形成及传播的早期信号，降低生成循环及潜在资源消耗。

Abstract: Uncontrolled repetition can prolong autoregressive generation in large language models (LLMs) and enable resource consumption attacks. Prior analyses of repetitive generation have identified strongly activated features in intermediate and late layers. However, how uncontrolled repetition activity emerges and develops before becoming prominent in these layers remains insufficiently understood. In this paper, we investigate this question primarily in large vision-language models (LVLMs), which support a richer set of uncontrolled repetitions through both visual and textual inputs. We propose Tokenwise Residual Comparison (TRC), a method that identifies and localizes anomalies associated with repetition from residual dynamics during generation. TRC compares attention and multilayer perceptron writes to the residual stream across generated tokens to identify patterns associated with repetition. It then selectively suppresses coordinates in the residual stream at the identified layer. Experiments show that TRC effectively mitigates uncontrolled repetition, reducing loop rates by 57% on average. Our analysis further shows that repetition semantics emerge in shallow layers and propagate through the residual stream, disrupting normal representations. TRC also generalizes to large language models (LLMs) and large reasoning models (LRMs), where it consistently captures analogous repetition dynamics and achieves effective mitigation. Our work broadens the study of repetitive generation from its prominent internal representations to earlier opportunities for intervention, providing insights for mitigating resource consumption attacks.

[148] StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning cs.CL | cs.AIPDF

Naen Xu, Wanqing Cui, Yibo Hu, Shixin Hong, Hengyu An

TL;DR: StateTree用可验证的树路径追踪辅助任务从少量长对话中构造强化学习监督，训练模型跨会话检索、比较时间并组合多跳线索。

Details

Motivation: 个性化助手需在持续变化的长对话历史中推理，证据分散、用户偏好会更新，而长上下文训练在数据不足和计算成本高时难以解决这些挑战。

Result: StateTree把多会话对话增强为树形路径追踪任务：跨会话嵌入键值记录形成二叉树，模型要从根到叶检索记录、比较时间决定分支，并在干扰叶中找回隐藏目标问题。课程式RL逐步提高树深度；组合变体在边上加入分步推理片段，训练模型组合局部线索。仅以10K token上下文训练，可泛化到128K而无需全长RL成本，并表现出跨会话检索、时间推理、知识更新和组合多跳推理。StateTree优于SFT及RL基线并保持短上下文通用推理；7B在LongMemEval 128K上最高提升23.60%，14B准确率59.00%，超过QwenLong-L1-32B的45.20%。

Insight: 用树结构与时间戳比较可从少量真实对话构造可验证、可渐进加难的长程记忆任务。短上下文训练得到的能力能够扩展到更长窗口，降低直接在极长对话上RL的成本。

Abstract: Large language models deployed as personalized assistants must reason over long, evolving interaction histories. However, in long-term dialogue reasoning, relevant evidence is scattered across sessions, preferences may be revised over time, and standard long-context training fails to address these challenges under data scarcity and prohibitive computational costs. We propose StateTree, a data-driven RL method that constructs a challenging auxiliary task from scarce dialogues with verifiable ground truth. StateTree augments multi-session dialogues with a tree-structured path-tracing task: key-value records are embedded across sessions to form a binary tree. Solving the task requires the model to traverse from root to leaf by retrieving records across sessions and comparing timestamps to resolve branches, then recover the hidden target question among distractor leaves. We apply curriculum RL training progressively increasing tree depth and introduce a compositional variant whose edges carry step-level reasoning fragments, training the model to compose partial cues into coherent queries. Trained on 10K-token contexts, StateTree generalizes to 128K tokens without full-length RL costs and exhibits capabilities including cross-session retrieval, temporal reasoning, knowledge update, and compositional multi-hop reasoning. StateTree outperforms both SFT and RL-based baselines while preserving short-context general reasoning. StateTree-7B achieves gains up to +23.60% on LongMemEval (128k), and StateTree-14B reaches 59.00% accuracy on LongMemEval, surpassing QwenLong-L1-32B (45.20%).

[149] You’re Hired: Strategic Model Selection for LLM Collaboration cs.CLPDF

Zongwan Cao, Ziyuan Yang, Shangbin Feng, Michael Duan, Skyler Hallinan

TL;DR: 论文系统比较多LLM协作中的模型团队选择算法，发现了解候选能力和训练特征的选择策略优于随机、浅层启发式或仅选单模型最强者。

Details

Motivation: 多智能体和多模型协作旨在组合不同LLM的优点，但现有系统通常依赖预定义或手工挑选的模型池，未解决如何为具体任务配置有效团队。

Result: 作者提出并评估九类选择算法，覆盖模型描述多样性、能力感知行为多样性及LLM招聘器。在10和32个候选模型的两种池中，将模型组合到四种协作算法，并测试数学、代码、问答和推理任务。成功的选择算法比随机或仅按个体性能选模型等启发式团队最高提升36.1%。能力和训练信息驱动的策略可降低选择方差并取得最好表现。候选池越大，浅层启发式越难；通过与候选模型交互了解能力的方法能更好筛除错配或不安全模型，并泛化到新域外任务。

Insight: 多模型系统的表现取决于如何组队，而不只是候选池里是否有强模型。基于真实行为能力和训练信息的选择，比模型卡描述或单体排行榜更适合构建安全且互补的协作团队。

Abstract: While multi-agent and model collaboration algorithms gain traction to combine the strengths of diverse Large Language Models (LLMs), existing systems remain bottlenecked on pre-defined and hand-crafted model pools. In this work, we investigate the problem of model selection in multi-LLM systems. We propose and systematically evaluate a taxonomy of 9 selection algorithms ranging from diversity of model descriptions, capability-aware behavioral diversity, and LLM-based recruiters. We conduct extensive experiments across two candidate pools of 10 and 32 models, deployed in four model collaboration algorithms, and evaluated across tasks spanning math, coding, QA, and reasoning. Results demonstrate that successful selection algorithms greatly outperform random or heuristics-based teams such as merely selecting the models with top individual performance, by up to 36.1% across settings. Specifically, capability- and training-based selection strategies alleviate selection variance and achieve the best performance, which we recommend to employ before deploying real-world multi-LLM systems. Further analysis reveals that larger candidate pools pose greater challenges to shallow selection heuristics, while algorithms grounded in interacting with candidate models and understanding model capability robustly filter out misaligned, unsafe models, as well as generalizing to novel, out-of-distribution tasks. Together, we establish that principled and informed team selection is critical and present strong model selection algorithms for assembling effective multi-LLM systems.

[150] Where MLLMs Fail and Why: Causal Task Decomposition for Capability Failure Diagnosis cs.CL | cs.AI | cs.CV | cs.LGPDF

Xia Hu, Brian Potetz, Chun-Ta Lu, Huanfen Yao, Leonidas Guibas

TL;DR: CADET通过对任务前置能力进行正确或错误干预，将多模态模型组合任务失败分解为能力本身不足与上游错误级联。

Details

Motivation: 组合任务的端到端准确率只能显示失败发生多少，无法判断是目标能力本身不足，还是更早的前置环节错误导致后续级联失败。

Result: 框架用未辅助、提供正确前置条件、提供错误前置条件三种情形定义NC、IC、RC能力指标，诊断能力缺陷；再用借鉴因果概率的N-Score和S-Score衡量前置条件的必要性与充分性。CADET基准含10项组合任务、拆为46项单元任务，超过33,000个人工标注问题，覆盖感知、空间、时间和认知类别。诊断前沿MLLM发现，认知任务中提供正确前置条件可消除54%错误，使认知从最弱能力提升到超过空间和时间类别。因果贡献集中在少数关键前置条件，单独提供最重要前置条件可获得提供全部前置条件收益的84%。

Insight: 错误来源需要通过受控干预前置能力来识别，而不能从最终答案错误直接归因。结果显示少数关键前置条件可能决定大部分组合任务成败，为能力修复提供更精准目标。

Abstract: End-to-end accuracy on compositional tasks records how often MLLMs fail, but cannot distinguish whether a failure reflects an intrinsic deficit in the targeted capability or a cascading error from an upstream prerequisite. We propose a causal decomposition framework that isolates these two failure modes through controlled interventions on the prerequisite dependencies of each task. Our capability metrics (NC, IC, RC) score each task under unassisted, correct, or incorrect prerequisites to diagnose where failures arise; contribution metrics (N-Score, S-Score), adapted from probabilities of causation, quantify each prerequisite’s necessity and sufficiency to determine why. We instantiate the framework in CADET, a diagnostic benchmark of 10 composite tasks decomposed into 46 unit tasks with over 33,000 human-annotated questions spanning perception, spatial, temporal, and cognitive categories. Diagnosing frontier MLLMs with our framework uncovers systematic patterns that end-to-end accuracy obscures. Capability-wise, supplying correct prerequisites eliminates 54% of errors on cognitive tasks, lifting them from weakest to above spatial and temporal. Prerequisite-wise, causal contributions are concentrated in a few critical prerequisites, and supplying the single most important one alone captures 84% of the gain from supplying all prerequisites.

[151] TRACE: Target-Aware Retrieval, Attributed Evidence, and Contract-Constrained Extraction for LitTraceQA cs.CL | cs.DL | cs.IRPDF

Sachin Gupta, Divya Godara

TL;DR: TRACE将目标感知检索、独立类型化证据定位、多模态表格抽取和契约约束校验组合成科研文献问答系统，确保答案符合可核验格式。

Details

Motivation: 找到相关论文不等于能从论文给出可验证答案。LitTraceQA要求标准论文标识、精确到页面或对象的证据以及匹配评测器类型的答案，因此系统需同时满足来源访问与评分契约。

Result: TRACE通过按目标分组检索、独立类型证据定位、多模态表格抽取、模式驱动表格构建及失败即拒绝校验，索引27,487篇论文的段落、对象、别名、引用和稠密表示，并保留每个检索信号对应的问题目标。表格流程先判断观测单位，再抽取数值并按评测器要求归一行键。经审计的selected clean-track artifact在官方71题测试集总分0.760613，论文F1 0.9728、证据F1 0.6847、选择题准确率0.9800、表格行F1 0.5423、宏平均单元格准确率0.3508。11条公开开发集表格记录上，干净基线与坐标感知视觉填充行F1分别为0.291和0.411；该诊断含回退输出，不是官方测试集结论。剩余错误主要在定位信息、观测单位、行键和来源数值身份。

Insight: 文献问答需要把检索、证据位置、表格结构和答案类型分别校验，避免“找到论文”被误当成“答案可核验”。失败即拒绝及契约验证能让格式或证据不满足要求的输出不冒充正确。

Abstract: Finding a relevant paper is not the same as producing a verifiable answer from it. LitTraceQA requires canonical paper identifiers, exact evidence at the page or object level, and typed answers that match the evaluator. We call the separation between source access and scorer-visible correctness the grounding contract gap. TRACE - Target-Aware Retrieval, Attributed Evidence, and Contract-Constrained Extraction - addresses this gap with target-grouped retrieval, independent typed evidence localization, multimodal table extraction, schema-driven table construction, and fail-closed validation. It indexes 27,487 papers through passage, object, alias, citation, and dense representations while retaining the question target behind each signal. For tables, TRACE predicts the observation unit before extracting values and assembles rows with evaluator-compatible key normalization. Our audited selected clean-track artifact scores 0.760613 on the official 71-question test set, including 0.9728 paper F1, 0.6847 evidence F1, 0.9800 multiple-choice accuracy, 0.5423 table-row F1, and 0.3508 macro cell accuracy. On 11 public-development table records, a clean baseline and coordinate-aware visual fill obtain row F1 of 0.291 and 0.411, respectively; this diagnostic comparison includes fallback outputs and is not an official-test claim. Remaining errors chiefly concern locator, observation-unit, row-key, and source-value identity.

[152] GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis cs.CLPDF

Qisheng Su, Hanchen Wang, Guanru Zhu, Huicheng Jiang, Qiuyinzhe Zhang

TL;DR: GraphForge以真实文件及其关系证据图为基础同时生成工作任务和可验证评分标准，训练能操作多文件、协调工具并交付成果的工作智能体。

Details

Motivation: 工作型智能体需要读多种文件、协调工具并产出交付物，训练需要大量真实文件和可验证任务结果。现有合成流水线要么生成文件缺乏真实多样性，要么基于真实文件出题却没有任务专用验证器，无法确保结果质量。

Result: GraphForge从职业场景种子出发构建真实文件工作区，并在文件关系上建立证据图；任务描述和评分规则均从该图派生，使每项要求由工作区文件支持、每个评分点锚定可验证文件。初次rollout检查任务能否执行，修订智能体再依据原始文件修复任务和规则。用2,169条轨迹微调Qwen3.6-27B后，OpenHands上的GDPVal为1445.7（+65.7），Claude Code上的Workspace-Bench-Lite为63.7（+7.7），SpreadsheetBench II为24.0（+13.7）。再按证据锚定规则筛选SFT模型自身rollout做拒绝微调，三项基准均进一步提升。

Insight: 任务和验证标准若共同锚定真实文件关系，既能保证要求有证据来源，也能检查最终产物。此类可验证规则还可作为模型自生成轨迹筛选信号，进一步改善训练。

Abstract: Working agents need to read diverse files, coordinate tools, and produce deliverables. Training such agents requires tasks built on many real files with verifiable results, but few pipelines exist to synthesize this kind of data. Existing pipelines either generate files with models, which lack realism and diversity, or build tasks on real files without task-specific verifiers, leaving result quality unchecked. We introduce GraphForge, an evidence-graph based framework that grounds both the task and its verification in real files. Starting from occupation-grounded seeds for controlled diversity, GraphForge assembles a workspace of real files for each seed and builds an evidence graph over their relations. Since the task statement and rubrics are both derived from this graph, task requirements are backed by the workspace files and each criterion is anchored to the files needed to verify it. An initial rollout further tests executability, and a revision agent repairs the task and rubrics against the original files before trajectories are collected. Fine-tuning Qwen3.6-27B on 2,169 GraphForge trajectories brings GDPVal to 1445.7 (+65.7) under OpenHands, and Workspace-Bench-Lite and SpreadsheetBench II to 63.7 (+7.7) and 24.0 (+13.7) under Claude Code. Rejection fine-tuning on the SFT model’s own rollouts, with candidates selected by the evidence-anchored rubrics, yields further improvements on all three benchmarks, suggesting that the rubrics provide a useful selection signal. The data and models are available.

[153] Making LLMs Say What They Think: Measuring and Improving CoT-Interpretability Alignment cs.CL | cs.AIPDF

Yihuai Hong, Shauli Ravfogel, Chen Zhao, Eunsol Choi

TL;DR: CIA指标比较大语言模型思维链所述推理与可解释性工具检测到的内部策略，并通过同时奖励任务准确率和参数忠实度改善二者一致性。

Details

Motivation: 思维链常被当作模型得到答案的过程记录，但越来越多证据表明它可能不反映内部计算，且即使改写思维链也不影响最终答案。作者量化并尝试提升显式解释与内部策略的对应关系。

Result: CoT-Interpretability Alignment（CIA）衡量模型思维链与可解释工具检测到的内部推理策略之间的一致性。作者在两跳问答、提示干预和整数乘法三个任务及三个LLM上评估，现有模型一致性有限，为44.8%至75.9%。后训练以任务准确率和参数忠实度为双重奖励，可显著改善思维链的参数忠实性，同时保持或提高准确率；论文还分析其泛化模式。

Insight: 让解释听起来连贯不等于它反映了实际计算，需要用内部机制探针独立审计。将参数忠实度直接纳入后训练目标，为提升思维链可信度提供了可量化优化路径。

Abstract: Chain-of-thought (CoT) traces often serve as a proxy for how Large Language Models (LLMs) arrive at their answers. However, growing evidence shows that models’ CoT often fails to reflect their internal computations and can be changed without affecting their final answers. In this work, we measure and improve the alignment between the reasoning described in an LLM’s CoT and what it computes internally. We propose CoT-Interpretability Alignment (CIA), a metric that measures the agreement between a model’s CoT traces and its internal reasoning strategies as detected by interpretability tools. We evaluate CIA on three tasks (two-hop question answering, hint intervention, and integer multiplication) across three LLMs, finding that LLMs exhibit limited alignment across all tasks (44.8-75.9%). We then experiment with improving CIA via post-training, setting both the task accuracy and parametric faithfulness signals as a reward. Experiments show that we can substantially improve CoT parametric faithfulness while maintaining or improving the task accuracy. We provide rich analysis, such as their generalization patterns. Our work provides both a framework for auditing CoT parametric faithfulness and a pathway toward making models’ explicit reasoning more trustworthy. Code and data are available at https://github.com/yihuaihong/CIA-minimal-repro.

[154] When Clipping Reverses Correction: Failure Dynamics of Pointwise Forward-KL On-Policy Self-Distillation cs.CLPDF

Di Huang, Hao Li, Yixin Chen, Fuhai Li

TL;DR: 分析表明按词表项裁剪前向KL的在线自蒸馏可能反向推动学生偏离教师，并诱发持续重复；不裁剪训练则在重复行为上更贴近教师。

Details

Motivation: 在线策略自蒸馏让学生在自身生成响应上学习同一模型提供的特权信息。原始研究发现风格token可能压过数学token，并采用逐点裁剪前向KL稳定训练，但后续工作虽沿用裁剪，其实际作用尚未直接检验。

Result: 在仅是否裁剪不同的匹配训练中，裁剪组比未裁剪组产生更多一直持续到回答结尾的重复。作者证明逐词表项裁剪再求和的目标可能无法让学生朝教师修正，反而会将裁剪和未裁剪token概率都推离教师。实验与分析一致：重复片段内，裁剪学生给“结束重复”分配的概率低于教师，给“继续重复”分配的概率更高；未裁剪组则更接近教师。

Insight: 用于稳定优化的逐项裁剪会改变KL目标梯度方向，不能假设其只是安全限制更新幅度。对生成行为的训练动力学进行匹配控制，有助于发现重复等副作用背后的目标函数机制。

Abstract: On-policy self-distillation (OPSD) trains a student on its own generated responses using feedback from the same model conditioned on privileged information. On mathematical reasoning, the original OPSD study finds that stylistic tokens can dominate the training signal over math-related tokens, and that pointwise clipping of the forward KL objective stabilizes training. Pointwise clipping caps each vocabulary-wise forward KL term at a fixed threshold before summing over the vocabulary. Follow-up studies have adopted this clipping, but its effect on training has not been directly examined. In matched training runs differing only in whether clipping is applied, we observe that clipped runs produce substantially more repetitions that persist to the end of the response than their unclipped counterparts. We trace this failure to the clipped objective. We prove that the clipped objective can fail to correct the student toward the teacher and can instead push clipped and unclipped token probabilities away from its teacher. Our training runs agree with this analysis: inside repetitions, the clipped student places less probability than its teacher on leaving the repetition, and more on continuing it, whereas the unclipped runs stay close to their teachers.

[155] Settle: Learning When to Stop Reasoning cs.CLPDF

Ryan Brown, Zihao Fu, Chris Russell

TL;DR: Settle根据已完成轨迹中答案稳定性学习何时结束推理，只训练现有结束token并限制其他输出偏离基础模型，在准确率轻微变化下减少生成长度。

Details

Motivation: 推理模型在答案已稳定后仍常继续生成，浪费token，也可能引入后续错误。作者希望学习可部署的停止策略，同时避免推理时额外模型或解码流程。

Result: Settle从已完成推理轨迹的答案稳定性中学习停止时机，训练既有end-of-reasoning token，并让其他预测保持接近基础模型，推理阶段只需普通解码。在Qwen3-4B的MATH-500上，token数减少40%，准确率下降0.5个百分点。与在相同轨迹上把文本截到第一个稳定答案的监督微调相比，准确率高6.16个百分点，token数几乎相同。停止分数能预测正确答案是否会继续保持正确，并扩展受测方法的准确率—token数Pareto前沿。

Insight: 停止信号可从正确答案何时首次稳定来监督，不必重训整个生成行为。只修改结束决策并约束其余分布，能保留模型原有解题能力并显著缩短输出。

Abstract: Reasoning models often continue generating after their answers have settled. Settle learns when to stop from answer stability in completed traces. It trains the existing end-of-reasoning token while keeping other predictions close to the base model, and requires only ordinary decoding at inference. On MATH-500 with Qwen3-4B, Settle reduces token count by 40% with a 0.5-percentage-point decrease in accuracy. It gains 6.16 percentage points over supervised fine-tuning on the same traces shortened at their first stable answer, at nearly identical token counts. Its stopping score predicts whether a correct answer will remain correct. Settle extends the accuracy-token-count Pareto frontier of the evaluated stopping methods.

[156] RSIGame: Autonomous Agentic Game Development with Recursive Self-improvement cs.CL | cs.GT | cs.LG | cs.MAPDF

Wenyi Wu, Minghao Fu, Jieyu You, Kun Zhou, Siqi Liu

TL;DR: RSIGame以局部探索—诊断—改进循环和全局质量监控构建自改进游戏开发智能体，并将成功开发经验进一步内化到生成模型。

Details

Motivation: 大语言模型已能生成可玩游戏，但要稳定迭代到高质量仍困难。简单重复改进容易过拟合少量测试用例，留下脆弱错误、缺失行为及对玩家交互的泛化问题。

Result: RSIGame设有局部和全局互补循环。局部循环探索可执行游戏、诊断并排序问题、基于证据修订，同时维护持续更新的测试与改进清单；全局循环跟踪整体质量、保存最佳检查点并检测长期开发中的饱和或退化。框架还通过训练把成功开发经验内化到生成器。在GameCraft-Bench的140项任务、两种引擎和五个生成器上，同等开发预算下游戏质量持续提高。内化经验后，Qwen3.8-27B在Godot和Phaser分别达到61.38和58.53，超过GPT-5.5单次生成分数，同时Qwen生成token减少11倍。

Insight: 游戏生成的可靠改进需要广泛运行探索和全局回归管理，避免仅优化少数测试样例。把验证过的开发经验再训练回生成器，可降低未来开发迭代成本并提升一次性产出。

Abstract: Recent advances in large language models have made automatic game generation increasingly feasible, yet reliably improving generated games beyond a playable version remains challenging. Naive iterative refinement can easily overfit a small set of test cases, producing fragile games with unresolved bugs, missing behaviors, and poor generalization to broader player interactions. We introduce RSIGame, an autonomous agentic game development framework with recursive self-improvement. RSIGame organizes development into complementary local and global loops. Concretely, a local explore-diagnose-improve loop broadly explores the executable game, diagnoses and prioritizes discovered issues, and performs evidence-grounded revision, where an evolving checklist continually accumulates new testing and improvement guidance. A global loop tracks overall quality, preserves the best checkpoint, and detects saturation or regression over long-horizon development. Beyond test-time improvement, RSIGame further internalizes successful development experience into the generator through training. Across 140 GameCraft-Bench tasks, two game engines, and five generators, RSIGame consistently improves game quality under matched development budgets. Notably, experience internalization enables Qwen3.8-27B to reach 61.38 on Godot and 58.53 on Phaser, exceeding GPT-5.5 one-shot scores while reducing Qwen’s generation tokens by 11 times.

[157] CORE: Conflict-Oriented Reasoning Elimination for Verifiable Language-Model Search cs.CLPDF

Siyu Song, Rui Xu, Jia Lin, Kai Liu, Weifang Wang

TL;DR: CORE用验证器给出的可认证冲突核心指导搜索回跳到最近相关决策，并缓存冲突避免重复探索。

Details

Motivation: 测试时推理系统失败后常从头重启或修正最近步骤，即使错误由更早决策造成，导致重复搜索和验证成本。

Result: CORE向验证器请求经认证的冲突核心，回跳至核心中最近的决策并缓存冲突以避免重犯。在验证器可靠、分支和深度有限且提案穷尽的条件下，未设上限搜索是完备的，不会剪掉有效解。在2,000个植入解的图着色实例上，和按时间顺序修复相比，30变量及36变量时验证调用中位数分别减少39.8%和35.0%；缓存还能在单纯回跳之上继续改善。五项推理任务上，Qwen2.5-7B成功率75.9%、Qwen3-8B为84.2%，高于Tree of Thoughts的72.5%和81.8%，且验证调用及生成token更少。

Insight: 失败解释若能精确指出冲突决策，就可把搜索从无关近期步骤回退到真正造成失败的位置。认证冲突核心与缓存共同提升效率，同时在给定假设下保证不剪掉正确解。

Abstract: Test-time reasoning systems often respond to failure by restarting or revising the latest step, even when an earlier decision caused the error. We introduce CORE, a search controller that requests a certified conflict core from a verifier, backjumps to the latest decision in that core, and caches the conflict to avoid repeating it. Under sound verification, finite branching and depth, and exhaustive proposals, the uncapped search is complete and never prunes a valid solution. On 2,000 planted graph-coloring instances with matched proposals and an exact verifier, CORE reduces median verifier calls by 39.8% at 30 variables and 35.0% at 36 variables relative to chronological repair; caching further improves on backjumping alone. Across five reasoning tasks, CORE achieves 75.9% mean success with Qwen2.5-7B-Instruct and 84.2% with Qwen3-8B, compared with 72.5% and 81.8% for Tree of Thoughts. It also uses fewer verifier calls and generated tokens on both backbones. These results show the value of using certified failure explanations to direct language-model search.

[158] LexReward: A Taxonomy-Driven Reward Framework for Legal Language Models cs.CLPDF

Yida Cai, Xin Dai, Bingxiang He, Huiyuan Xie, Yuxiao Ye

TL;DR: LexReward用风格、法律要素和论证链三维量表构造法律回答偏好与奖励模型，使法律质量判断更细粒度、可解释。

Details

Motivation: 法律回答质量除正确性外还有多个维度，常见整体式奖励判断领域针对性和可解释性不足。

Result: LexReward将回答质量分为Style（词汇和句法）、Element（法律主体、事实、法条和判决）及Chain（推理顺序、完整性、正确性和冗余）三维，为每维编制评价标准和等级。由此构造成对偏好数据用于DPO及奖励模型训练。实验表明量表能可靠区分不同质量法律回答，基于偏好数据的DPO改善全部三维表现。学习得到的LexRM可分别作为对应维度的强化学习奖励，在奖励阶段无需参考答案也能提升该维度策略表现；分维分析支持所提分类及奖励构建有效。

Insight: 法律回答的风格、法律要素覆盖与推理链条需要分开评价，单一正确性或整体印象会掩盖质量维度差异。维度专属奖励可在无参考答案时继续优化目标属性。

Abstract: Legal language models require reward signals that capture not only answer correctness but also the multidimensional quality of legal responses. Existing reward methods, however, often rely on coarse-grained holistic judgments, providing limited domain specificity and interpretability. We introduce LexReward, a taxonomy-driven framework for legal reward modeling. LexReward characterizes legal response quality along three complementary dimensions: Style, covering lexical and syntactic quality; Element, assessing legal subjects, facts, statutes, and decisions; and Chain, evaluating the order, completeness, correctness, and non-redundancy of legal reasoning. For each dimension, we develop rubrics that specify evaluation criteria and quality levels. The resulting rewards are used to construct pairwise preference data for Direct Preference Optimization (DPO) and reward-model training. Experiments show that the rubric-based rewards reliably distinguish legal responses of different quality and that DPO training on the preference data improves performance across all three dimensions. The learned reward models, LexRM, also support effective downstream optimization: each dimension-specific reward model improves policy performance in its corresponding dimension through reinforcement learning, without requiring reference answers at reward time. Dimension-wise analyses further support the effectiveness of the proposed taxonomy and reward construction.

[159] Beyond Text: LLM-Based Dimensional Emotion Evaluation in Multimodal Dialogue cs.CL | cs.AI | cs.LG | cs.MMPDF

Yutong Hu, Jinho Choi

TL;DR: 研究把音频线索转成自然语言描述并用于IEMOCAP对话的离散情绪与VAD连续维度评估，发现领域适配对中小模型比单纯增大模型更关键。

Details

Motivation: 对话情绪识别已有大量研究，但在多模态对话中用LLM进行连续效价—唤醒—支配（VAD）维度评估仍少有探索。

Result: 框架按SpeechCueLLM思路将声学线索转为自然语言描述，评估LLaMA、GPT和Qwen六个模型的零样本、少样本提示及LoRA微调。LoRA微调的LLaMA在离散情绪和VAD任务上显著超过提示工程GPT，即便GPT规模更大，作者认为主要差异来自领域适配而非容量。最佳模型在IEMOCAP上Valence CCC达0.7822，为新最佳。消融显示，文本音频描述可使较小模型加权F1提升3.5至3.6分，但对最大模型帮助有限；各VAD维度性能差异与数据集标注者一致性排序相似。

Insight: 将声学信号转成可理解文本可补充较小模型的语言能力，但对大模型增益有限。情绪维度评估上限也受标注一致性约束，模型表现应与人类标注噪声共同解读。

Abstract: Emotion recognition in conversation has been widely studied, but applying Large Language Models (LLMs) to continuous dimensional emotion evaluation in multimodal dialogue remains largely unexplored. We propose an LLM-based framework that performs discrete emotion recognition and Valence-Arousal-Dominance (VAD) dimensional evaluation on IEMOCAP, incorporating acoustic cues as natural language descriptions following the SpeechCueLLM approach. We evaluate six models spanning the LLaMA, GPT, and Qwen families under zero-shot prompting, few-shot prompting, and LoRA fine-tuning. LoRA fine-tuned LLaMA models substantially outperform prompt-engineered GPT models on both tasks despite GPT’s larger scale, a gap we attribute to domain adaptation rather than model capacity. Our best model achieves a Valence CCC of 0.7822, a new state-of-the-art on IEMOCAP. Ablation studies confirm that textual audio descriptions meaningfully improve smaller models (+3.5 to 3.6 weighted F1) while contributing little for the largest model, suggesting audio cues are most valuable when linguistic capacity is limited. The performance asymmetry across VAD dimensions closely mirrors the annotator agreement hierarchy in IEMOCAP’s own annotations.

[160] Diagnosing On-Policy Self-Distillation for Reasoning Language Models cs.CLPDF

Yang Li, Gongle Xue, Yuheng Yuan, Yijia Guo, Shizhe Zhang

TL;DR: 受控实验发现在线策略自蒸馏只在狭窄的推理模式和前缀兼容条件下改善数学推理，否则可能无效增长输出长度、稳定退化或行为崩塌。

Details

Motivation: OPSD不需要外部奖励或独立强教师，可利用带特权信息的自教师为学生轨迹提供稠密信号，但在语言推理中的行为仍不清楚，既有报告从小幅收益到崩塌不等。

Result: 作者对0.6B至8B模型进行数学推理受控实验和token级分析，发现教师信号不仅由特权语义决定，还受推理模式对齐和完整教师前缀影响。OPSD只在狭窄兼容条件下改善推理；其他条件可能导致无效长度增长、稳定性能下降或行为崩塌。token级信号本身不稳定，无法预测下游表现。作者因此认为OPSD是敏感算法，不应视为普遍可靠的推理后训练方法。

Insight: 自教师提供密集反馈并不保证有益，学生与教师的生成模式和前缀条件必须相容。token级训练信号看似丰富，也可能和最终能力无关，因此需要对蒸馏兼容性进行诊断而非默认采用。

Abstract: On-policy self-distillation (OPSD) has attracted growing interest as a promising approach to improve the reasoning ability of language models. Without external rewards nor a separate stronger teacher, the self-teacher with privileged information could provide dense signals on student’s trajectories. However, its behavior in language reasoning remains unclear, with reported outcomes ranging from modest gains to behavioral collapse. In this work, we diagnose OPSD for mathematical reasoning across models spanning 0.6B–8B parameters. We conduct controlled experiments and token-level analyses to fully delve into OPSD. We point out that teacher’s signal is shaped by reasoning-mode alignment and the complete teacher prefix, rather than by privileged semantics alone. OPSD improves reasoning only in narrow compatibility regimes. Otherwise, it produces ineffective length growth, stable degradation, or behavioral collapse. Token-level analysis shows that teacher’s signal is not stable and does not predict downstream performance. Based on these results, we argue that OPSD is a sensitive algorithm rather than a generally reliable reasoning-improvement post-training method.

[161] DAGent: Evaluate-then-Grow Planning for Deep Research Agents cs.CL | cs.AIPDF

Hanwen Liu, Yuanfu Sun, Qiaoyu Tan

TL;DR: DAGent采用“先评估、再扩展”逐批构建深度研究任务图，让后续计划依赖已完成节点的置信度和不确定性，而非预先一次性制定完整计划。

Details

Motivation: 深度研究要探索庞大知识空间、综合多来源证据，并随发现调整计划。DAG多智能体支持并行和局部依赖上下文，但既有系统常先定完整任务图、遇到失败或缺证据后才修补，容易在证据最弱时过早承诺并浪费无效分支计算。

Result: DAGent由编排器根据已完成节点的置信度和不确定信号逐批扩展任务图；分层上下文默认传递紧凑QueryDocs，完整执行轨迹可按需回忆。图拓扑还提供结果奖励之外的结构性RL信号，DAGRPO对执行器rollout加入拓扑信用，并对编排器计划施加结构合规正则。在BrowseComp-Plus、GAIA和xbench-DeepSearch上，Qwen3-235B-A22B分别比最强开源基线高5.3、5.8和2.0分；优势在四个开源骨干上复现并延伸至327K上下文GPT-5。Qwen3-8B上DAGRPO比同预算只用结果奖励的GRPO平均Pass@1高3.0分。相同架构对照显示，证据条件化规划以更低token、工具调用及步骤开销获得更高准确率。

Insight: 研究计划的扩展应跟随证据和不确定性逐步发生，避免在尚无依据时固定整张图。任务图拓扑可作为额外学习信号，提升规划结构与执行结果的一致性。

Abstract: Deep research tasks require agents to navigate large knowledge spaces, synthesize evidence across many sources, and adapt their plans as findings emerge. Directed acyclic graph (DAG)-based multi-agent systems suit this setting because they support parallel execution and isolate each sub-task within a focused dependency context. Yet existing DAG-based agents instantiate a task-level plan before execution and repair the graph only after failures or missing evidence are observed. This Plan-then-Patch strategy is brittle for deep research: the system commits most strongly when its evidence is weakest, and later revisions waste computation on branches that should not have been planned. We propose DAGent, a DAG-based multi-agent framework with Evaluate-then-Grow incremental planning: an Orchestrator grows the task graph one batch at a time, conditioning each expansion on confidence and uncertainty signals from completed nodes. A hierarchical context layer propagates compact QueryDocs by default while preserving full execution traces for on-demand recall. The recorded DAG topology admits structural RL signals that outcome-only recipes cannot define; DAGRPO, a GRPO adaptation, injects topology-conditioned credit on Executor rollouts and a structural compliance regularization on Orchestrator plans. Across BrowseComp-Plus, GAIA, and xbench-DeepSearch, DAGent surpasses the strongest open-source baseline by 5.3 / 5.8 / 2.0 points at the Qwen3-235B-A22B scale, and the lead replicates across four open-source backbones and extends to GPT-5 at 327K context. At the Qwen3-8B scale, DAGRPO improves over a same-budget outcome-only GRPO baseline by 3.0 average Pass@1 points. A same-architecture comparison shows that evidence-conditioned planning reaches higher accuracy at lower per-task token, tool-call, and step footprints than its Plan-then-Patch counterpart. Code: https://github.com/hanwenliu6825/DAGent

[162] ViLegalExpert: A Large-Scale Benchmark for Vietnamese Legal Retrieval and Question Answering from Real-World Consultations cs.CLPDF

Dat Tien Nguyen, Nghia Hieu Nguyen, Anh Thi-Hoang Nguyen, Dung Ha Nguyen, Kiet Van Nguyen

TL;DR: ViLegalExpert构建真实越南公民—律师咨询法律检索与问答基准，包含超过17.2万问题及专家核验法律依据。

Details

Motivation: 可信法律AI需要回答法律问题并引用权威来源，但现有越南语法律基准对真实咨询覆盖有限，难反映用户自然提问与实际法律条文映射的挑战。

Result: 基准由真实公民与律师咨询构成，包含超过172,000个问题、34个法律领域、专业回答和专家核验依据，支持法律信息检索、抽取式问答及抽象式问答。对代表性检索方法和语言模型的实验显示，证据检索及有依据答案生成仍具挑战；预训练模型在问答任务表现较强，混合检索则取得最佳检索性能。摘要未报告具体分数。

Insight: 真实法律咨询语料能暴露从自然表达问题定位权威法规的困难，单独问答能力不能替代检索证据质量。基准同时覆盖检索、抽取和生成，有助于分解法律AI的可靠性问题。

Abstract: Trustworthy Legal AI requires systems that can answer legal questions while grounding their responses in authoritative sources. However, existing Vietnamese legal benchmarks provide limited coverage of real-world legal consultations. We introduce \textbf{ViLegalExpert}, a large-scale benchmark constructed from authentic citizen–lawyer consultations, containing over \textbf{172K} questions across \textbf{34 legal domains}, together with professional answers and expert-verified legal evidence. ViLegalExpert supports legal information retrieval, extractive QA, and abstractive QA. Experiments with representative retrieval methods and language models reveal substantial challenges in evidence retrieval and grounded answer generation. While pretrained models perform strongly on QA, hybrid retrieval achieves the best retrieval performance. These results demonstrate the difficulty of mapping naturally expressed legal questions to authoritative provisions and establish ViLegalExpert as a challenging benchmark for reliable Vietnamese Legal AI.

[163] 4MT-VLM: How Coarse Is a VLMs Cognitive Map? cs.CLPDF

Markus Frey

TL;DR: 4MT-VLM用同一程序化景观构造不同外观线索和视角条件，评测视觉语言模型能否形成稳定的空间认知地图并跨视角识别地点。

Details

Motivation: 能移动的智能体需要从从未见过的视角认出地点，但VLM空间认知地图的精细度尚不清楚。基准需隔离外观线索并检验视角变化后是否还能保持场景布局理解。

Result: 数据集由程序化景观构成，每个场景有五种刺激条件：形状与颜色、仅形状、仅颜色、无物体裸地形峰、以及山谷视角使山峰位于地平线。最后一种条件常用于临床探测人类海马功能。作者在16个开源和闭源模型上用人类测试也采用的4AFC指标评测。模型能识别学习视角中的地点，但摄像机转动后表现大幅下降；135°时低于25%随机水平，而人类为85%。Gemini 3.8 Flash和GPT-5.6在旋转条件下分别仅39%和31%，只有干扰地点相距超过30米时才恢复到85%和55%。

Insight: 当前VLM有初步认知地图，但空间分辨率不足以在视角变化时保持稳定的三维场景理解。外观线索消融和旋转视角测评可揭示模型是记住图像还是掌握环境布局。

Abstract: An agent that moves must recognise a place from a viewpoint it has never seen. We introduce 4MT-VLM, a dataset of procedurally generated landscapes, each rendered across five stimulus modes that remove appearance cues while holding layout fixed: shape and colour, shape only, colour only, bare terrain peaks with no objects, and a valley viewpoint that puts the peaks on the horizon. The last condition is commonly used in clinics to probe hippocampal function in human patients. We test this benchmark across sixteen different open and closed-source models and report 4AFC performance, a measure which is also used to grade human participants. We observe that models identify a place from the studied viewpoint but lose it once the camera moves, dropping below the 25% chance level at 135° where a human observer scores 85%. Frontier models (Gemini 3.8 Flash, GPT-5.6) answer only 39% and 31% of rotated trials correctly, recovering to 85% and 55% only when distractors are moved more than 30 meters apart. Our benchmark demonstrates that while current VLMs possess rudimentary cognitive maps, their spatial resolution remains fundamentally too coarse to maintain a stable, 3D understanding of the world once the viewpoint changes.

[164] Concept Subspaces Compute Beyond the Logit Lens: A Weights-Only Test for Locating Representations Upstream of Readout cs.CL | cs.LGPDF

Aojie Yuan, Zhiyuan Julian Su, Haiyue Zhang, Zijian Su

TL;DR: 论文提出只需模型权重即可计算的双侧几何诊断，检查概念子空间是否真正位于主导输出读出方向之前，并用多模型估计器和干预限制因果解释。

Details

Motivation: 概念子空间能影响模型行为，不代表它与输出读出机制的关系已明确。作者希望区分概念结构与决定logit的主导方向，测试概念子空间是在读出上游还是仅与输出方向重叠。

Result: 诊断测量提取子空间与unembedding矩阵主导右奇异方向的重合，并用输出导向正控制校准；给定基底后原始指标只需权重。以FARS十维子空间为测试床，该基底来自18个推理概念的6种表层表达。跨9种秩匹配估计器及26个模型，四种激活提取概念估计器在top-10读出空间平均能量仅0.38%至0.80%；末层PCA为3.56%，在26个模型中25个高于FARS。深度匹配线性转换后的同层下一token控制能量约为FARS的13倍，25个模型均分离。十个不相交概念重提取FARS后，在24个生成模型跨格式检索率62%至100%，表明可迁移的是提取程序而非固定基底。四模型三种子干预发现效应依模型而异，且远低于完整向量替换。

Insight: 概念可检索和行为影响不等于它是输出读出的充分因果基础。权重几何、输出正控制和定向干预需要结合，才能区分概念结构、主导读出方向及有限因果作用。

Abstract: A concept subspace’s effect on model behavior does not establish how it relates to the output readout. We introduce a two-sided geometric diagnostic that measures an extracted subspace’s overlap with the dominant right-singular directions of the unembedding matrix, evaluated against output-oriented positive controls. Given an extracted basis, the raw diagnostic requires only model weights. Our testbed is the Format-Agnostic Reasoning Subspace (FARS), a ten-dimensional basis extracted from eighteen reasoning concepts expressed in six surface forms. Across nine rank-matched estimators and twenty-six models, four activation-derived concept estimators carry only 0.38–0.80% mean energy in the top-ten readout span. Final-layer PCA carries 3.56%, exceeding FARS in 25 of 26 models. A same-layer next-token control, evaluated using a fitted linear translator for depth matching, carries approximately thirteen times more energy than FARS, with separation in all 25 tested models. Re-extracting FARS on ten disjoint concepts yields 62–100% cross-format retrieval across twenty-four generative models, demonstrating transfer of the extraction procedure rather than a fixed basis. A complementary four-model, three-seed intervention study finds model-dependent source-directed effects that remain well below full-vector replacement. Together, the geometry and intervention controls distinguish concept structure from dominant readout directions while limiting claims of causal sufficiency.

[165] Offline Guidance, Online Reasoning: Reusing LLM Feedback for Small Language Models cs.CLPDF

Bohan Zhang, Linan Yue, Weibo Gao, Pengyu Chen, Hong Guo

TL;DR: RLC将离线LLM提供的一次性自然语言纠正转换为小模型隐藏空间中的持久经验库，使冻结小语言模型推理时按当前状态复用纠正。

Details

Motivation: 大语言模型推理能力强但API昂贵，小模型易本地部署却较弱。知识蒸馏需要更新参数和额外训练；在线协作虽有效，却反复调用LLM，而且针对单题的指导常在推理结束后被丢弃。

Result: Reusable Latent Correction（RLC）假设LLM只离线可用且小模型参数冻结，在线推理完全由小模型完成。它将黑盒LLM产生的一次性自然语言指导转成小模型隐藏空间中的持久纠正经验，存放在外部经验库；之后按小模型当前推理状态检索相关经验，在没有在线LLM调用的情况下复用此前纠正。多个推理基准和不同小模型规模实验显示，RLC在不更新参数、不在线访问LLM的条件下持续提升小模型推理表现；摘要未列具体分值。

Insight: 外部大模型反馈可作为可检索经验长期保存，而不必蒸馏进小模型权重或每次实时咨询。按隐藏推理状态检索有望让一次指导迁移到相似推理情形。

Abstract: Large language models (LLMs) offer strong reasoning capabilities but are often costly to access through commercial APIs, while small language models (SLMs) are easier to deploy locally yet remain weaker in reasoning. This capability-deployment gap has motivated LLM-SLM collaboration, which aims to improve SLM reasoning using LLM capabilities while preserving the deployment advantages of SLMs. Existing approaches mainly follow two paradigms. Knowledge distillation uses LLM-generated answers and reasoning trajectories to train SLMs offline, but requires parameter updates and additional training. Alternatively, online collaboration routes difficult problems to an LLM or leverages LLM-generated guidance and corrections when an SLM encounters difficulties. Although effective, online collaboration requires repeated LLM access. Moreover, the guidance produced for a particular problem is discarded after inference and cannot benefit subsequent problems involving similar reasoning states. In the paper, we focus on a more constrained setting in which the LLM is accessed only offline, the SLM parameters remain fixed, and online inference is performed solely by the SLM. To this end, we propose Reusable Latent Correction (RLC), which converts one-off natural-language guidance from a black-box LLM into persistent corrective experiences in the hidden space of an SLM. RLC stores these experiences in an external bank and retrieves them according to the SLM’s current reasoning state, enabling the SLM to reuse LLM-derived corrections during inference without any online LLM calls. Experiments across multiple reasoning benchmarks and SLM scales show that RLC consistently improves SLM reasoning without parameter updates or online LLM calls. Code is available at https://github.com/ZBH031/reusable-latent-correction.

[166] Spike-driven Vision-Language-Action Model cs.CLPDF

Shuai Wang, Malu Zhang, Mingquan Liu, Weihui Dai, Dehao Zhang

TL;DR: 该工作提出端到端直接训练的脉冲视觉—语言—动作框架，用稀疏脉冲表示、多赢家融合和动作分块降低机器人操作推理资源需求。

Details

Motivation: VLA模型连接多模态理解与机器人控制，但主流大Transformer在资源有限平台上延迟和能耗较高。脉冲神经网络的事件驱动稀疏计算可能支持更高效部署。

Result: 框架首先用脉冲视觉与指令编码器把图像观察和语言指令编码为稀疏可靠表征；多赢家脉冲融合采用双向top-k赢家通吃路由抑制背景干扰并生成融合记忆；脉冲动作分块Transformer通过融合记忆和当前机器人状态生成连续动作块。LIBERO和Meta-World实验显示，该脉冲VLA在参数更少、估算推理能耗更低时，表现可与常规VLA竞争。摘要未给具体任务成功率或能耗数值。

Insight: 脉冲计算可从感知编码、跨模态融合到动作生成贯穿整个VLA，而不是只替换单个模块。稀疏赢家路由与动作分块分别控制视觉干扰和连续控制输出成本。

Abstract: Vision-language-action (VLA) models bridge multimodal understanding and robotic control, advancing the dominant paradigm for embodied intelligence. However, most existing models rely on large Transformers, whose latency and energy costs hinder deployment on resource-constrained platforms. Through sparse event-driven computation, spiking neural networks offer a promising paradigm for high-performance and energy-efficient computing. Here, we propose the first Spike-driven VLA framework enabling end-to-end direct training for robotic manipulation, which mainly comprises three core components. First, we develop spiking visual and instruction encoders for multimodal perception, encoding visual observations and language instructions into sparse, reliable spike representations for subsequent cross-modal fusion. Then, we introduce Multi-Winner Spike Fusion for instruction-guided scene understanding, using bidirectional top-$k$ winner-take-all spike routing to suppress background interference and yield fused memory. Finally, we propose a Spike Action Chunking Transformer that incorporates spiking cross-attention over the fused memory and the current robot state, enabling efficient end-to-end generation of continuous action chunks for robotic control. Extensive experiments on LIBERO and Meta-World demonstrate that Spike-driven VLA achieves competitive performance with fewer parameters and lower estimated inference energy than conventional VLA models. This work establishes a foundational framework for neuromorphic VLA modeling, paving the way for future advances in resource-efficient embodied intelligence.

[167] CATCH: A Controllable Analysis Testbed for Reward Hacking in Coding RL cs.CL | cs.LGPDF

Shouli Wang, Yanfeng Jia, Zhihao Ou, Zitao Su, Ruize He

TL;DR: CATCH提供可控的代码强化学习奖励黑客测试环境，能调节漏洞、模型初始倾向和奖励难度，并用独立审计为奖励利用生成可靠标签。

Details

Motivation: RLVR中语言模型可能利用环境漏洞获取高奖励，却没有提升预期能力，即奖励黑客。训练中监测和缓解困难，部分原因是缺少能重现攻击并可靠识别其发生的测试平台。

Result: CATCH刻意暴露代码环境漏洞，并比较脆弱评估器下的成功与独立审计确认的任务正确性，提供基于执行的金标签。它可通过SFT数据混合控制模型初始黑客倾向，也能通过奖励设计调节获得奖励的难度，从而系统比较形成动力学和干预。实验能产生多样RL轨迹并观察到明确奖励黑客行为，显示初始模型和奖励难度都会影响其出现。研究还比较检测与缓解方法：思维链监控早期可压制黑客行为，但策略模型学会用代码注释误导监控后，该保护会逐渐消退。

Insight: 检测奖励黑客不能只在训练前或单个检查点评估，策略会适应监控器并学会规避。通过独立正确性审计和可控环境难度，CATCH支持持续检验缓解措施是否仍然有效。

Abstract: During reinforcement learning with verifiable rewards (RLVR), large language models (LLMs) can exploit loopholes in their environments to obtain high rewards without improving the intended capabilities, i.e., reward hacking. Despite its risks to training efficiency and safety, monitoring and mitigating reward hacking during training remain challenging, which is limited by a lack of testbeds that reproduce hacking and reliably identify it. We introduce CATCH, a controllable testbed for studying reward hacking in coding RL. CATCH deliberately exposes environmental loopholes and provides execution-based gold labels by comparing success under a vulnerable evaluator with task correctness under an independent audit. It also can control the model’s initial hacking tendency through supervised fine-tuning data mixtures and the difficulty of earning rewards through reward designing, enabling systematic comparisons of hacking dynamics and interventions. Experiments show that CATCH can produce diverse RL training trajectories with clear reward hacking, and analyses demonstrate that both initial models and reward difficulties shape the emergence of reward hacking. We further evaluate the effectiveness of different reward hacking detection and mitigation methods. A key finding is that a chain-of-thought monitor initially suppresses hacking, but this protection erodes as the policy model learn to mislead the monitor with code comments. This highlights the need to evaluate hacking mitigations throughout training with CATCH. The source code and resources are publicly released at https://github.com/THUAIS-Lab/CATCH.

[168] Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively? cs.CLPDF

Minghan Wang, Boyuan Wang, Jinhang Zuo, Yuxin Tao, Fang kong

TL;DR: Box²-Bench固定模型和任务、改变工作流可靠性，以测量智能体能否接受有用外部指导并抵制误导指导。

Details

Motivation: 智能体harness常用人工工作流提升语言模型，但模型变强后，不可靠指导反而可能限制执行。可靠性不仅要求跟随帮助，还要求在指导错误或过时的时候能独立判断。

Result: 基准在保持模型和任务不变时操纵工作流可靠性，从而隔离模型对指导的依赖调节能力。前沿模型通常能从可靠指导获益，但面对误导或失效流程仍易受影响。作者用不良工作流训练两个开源模型，并将良好工作流保留用于评估；反事实监督微调提升抗误导能力，基于结果的强化学习则可将行为平衡推向更充分利用有益工作流。选择性依赖能力还迁移到同伴纠正及受污染记忆等其他外部信息形式。

Insight: 智能体面对外部信息既不能盲目服从，也不能一概拒绝，应按来源可靠性调整依赖程度。任务成功率本身无法揭示是否过度依赖错误指导，因此需单独测量这种选择性。

Abstract: Agent harnesses often improve language models with human-designed workflows, but as models grow more capable, unreliable guidance can increasingly constrain their execution. We call the ability to benefit from useful guidance while overriding unreliable guidance thinking outside the box. We introduce Box$^2$-Bench, which holds the model and task fixed while varying workflow reliability to isolate how models regulate their reliance on guidance. On Box$^2$-Bench, frontier models often benefit from reliable guidance but remain vulnerable when it is misleading or becomes unreliable. To test whether this capability can be learned, we train two open-weight models using bad workflows, reserving good workflows for evaluation. We explore two complementary training strategies: counterfactual supervised fine-tuning improves robustness, while outcome-based reinforcement learning can shift the balance toward greater use of helpful workflows. We further find that this behavior extends beyond workflows to other forms of external information, improving peer correction and robustness to corrupted memory. Together, our results identify selective reliance on fallible external information as a dimension of agent reliability not captured by task performance alone.

[169] Is This Evidence Decision-Critical? Learning to Verify Rule-Governed Decisions cs.CLPDF

Haoyang Zhang, Jianpeng Zhao, Qi Hao, Pengyang Wang

TL;DR: InterPact通过反事实修改案件证据训练验证器，学习某条证据会否改变规则判断及最终决策，从而优先检查决策关键证据。

Details

Motivation: 资格审查、合同复核等规则推理需逐项判断证据是否满足条件，再按显式规则合成决定。有些证据评估错误不会改变结果，但忽略或误解决策关键证据可能使结果反转。

Result: InterPact用冻结语言模型编辑案例事实、固定规则和非目标条件，生成用于训练传播验证器的证据干预对；人工审核标注条件和最终决策的变化，完整状态—决策映射则监督已观察编辑以外的后果。训练中，验证器将学习到的条件决策概率与证据条件概率按固定组合传播，使决策变化监督回传到基础模型。推理时，基础模型直接根据原始案例及目标证据判断关键性，不需要人工或更强模型监督。在适配的规则案例单条证据关键性验证任务上，准确率68.28%，超过全部六个基线。

Insight: 证据重要性取决于它能否改变某个规则条件及最终决策，而非文本是否显眼。通过反事实编辑观察条件和决策变化，可学习决策敏感度并优先安排核查资源。

Abstract: Rule-based reasoning, as in eligibility checks and contract reviews, requires language models to assess evidence against individual conditions and combine their judgments under explicit rules. Errors in evidence assessment can leave a decision unchanged, but misinterpreting or overlooking decision-critical evidence can reverse it. Identifying such evidence allows more capable models to focus on checking the corresponding condition judgments, supporting accurate and safe decisions. Recognizing the evidence’s criticality requires understanding how evidence affects a condition judgment and how that judgment affects the decision. To achieve the goal, we propose a INTERvention-based imPACT learning framework (InterPact), which enables counterfactual verification of evidence criticality in rule-governed decisions. Specifically, its evidence intervention constructor generates training pairs for a propagation verifier by editing case facts with a frozen language model while holding rules and non-target conditions fixed. Human-reviewed labels record the resulting condition and decision changes, while complete state-to-decision mappings supervise consequences beyond the observed edit. During training, the verifier weights learned conditional decision predictions by evidence-based condition probabilities through a fixed composition operation, propagating decision-change supervision into the base model. At inference, the trained base model directly judges criticality from the original case and target evidence, without human or stronger-model supervision. On single-case evidence criticality verification over adapted rule-governed decision cases, InterPact achieves 68.28% accuracy, outperforming all six baselines. These results support learned decision sensitivity as a basis for prioritizing evidence checks.

[170] SEPAL: Separated Expert Pairs with Answer-Level Fusion for Reliable LLM Collaboration cs.CL | cs.AI | cs.LGPDF

Weijie Ren, Yanwen Zhang, Hao Li, Zhuolin Qi, Hengyi Zhang

TL;DR: SEPAL将三个私有Actor-Critic团队分别用于直接推理、证据落地和验证，各团队内部迭代后只对最终答案投票以避免讨论污染多样性。

Details

Motivation: 多智能体讨论和反馈可改善问答，但共享讨论会让纠错过程暴露并传播同样错误，削弱投票所需的独立性。自一致性有采样多样性但无反馈，单对Actor-Critic又只优化一个候选。

Result: SEPAL配置三组彼此独立的Actor-Critic团队，分别承担直接推理、证据 grounding 和结果核验，并通过角色专属训练让目标不同于单纯采样差异。每个Critic只指导本团队修订，避免候选间互相污染；修订结束后仅对最终答案做多数表决，推理轨迹在决定前保持隔离。五个开源骨干和五个问答基准上，SEPAL相较匹配规模的单个Actor-Critic对平均准确率提升1.81个百分点，五个骨干均提高。

Insight: 协作系统可以在专家组内部利用反馈，同时在最终裁决前保持候选推理独立。这样把“组内纠错”和“组间投票多样性”分开保留。

Abstract: Multi-agent collaboration lets large language models (LLMs) improve question answering through deliberation and feedback. Yet shared discussion couples correction with exposure to the same mistakes, which can erode the diversity needed for voting. Self-consistency offers sampling diversity without feedback, while single-pair Actor-Critic collaboration refines only one candidate. We introduce SEPAL, which assigns three private Actor-Critic teams to direct reasoning, evidence grounding, and verification. Role-specific training gives the teams different reasoning objectives beyond sampling variation. Each Critic guides revisions within its own team, preventing feedback from carrying errors across candidates. Once revision ends, majority voting combines only the final answers, keeping the reasoning histories separate until the decision. Across five open-weight backbones and five question-answering benchmarks, SEPAL improves mean accuracy by 1.81 percentage points over a matched single Actor-Critic pair, with improvements across all five backbones. Code is available at https://github.com/zhansan114514/SEPAL.

[171] Better Supervision Is Nearby: Neighborhood On-Policy Self-Distillation cs.CL | cs.LGPDF

Xincheng Wei, Yifan Ding, Yoshua Li, Yuquan Lu, Ziheng Li

TL;DR: Neighborhood OPSD从局部参数扰动中构建紧凑教师专家池，在学生采样前缀上按状态挑选互补教师分布进行在线蒸馏。

Details

Motivation: 标准OPSD在所有状态使用同一组参数的特权教师。作者发现，附近参数设置可在相同参考上下文下提供互补、与答案对齐的纠正，且不同专家在参考轨迹不同位置各有优势。

Result: 离线阶段用贪心选择构建冻结专家池：奖励经过过滤的参考token收益超过当前最佳池覆盖的位置；最高峰值专家不一定提供最佳学生训练目标。在线路由分开确定锚定方向与支持强度：MaxPeak选锚token，分位数规则在top token与锚点相同的专家中选择分布。学生通过继承自OPSD的裁剪前向KL学习所选专家的完整下一token分布。在AIME 2024、AIME 2025和HMMT 2025三基准上，每种方法独立运行三次；相较OPSD，Qwen3-1.7B、4B和8B的Average@12分别提高2.75、1.67和1.94分。学生前缀续写实验支持专家池超出选择时参考轨迹的适用性；重叠校正和状态路由进一步提高准确率，推理时只需蒸馏后的学生。

Insight: 单一教师在不同参考位置上的纠错能力不均，附近参数专家可形成互补监督池。将专家选择拆为方向锚定和支持强度，能让学生按自身当前状态获取更合适的教师分布。

Abstract: On-policy self-distillation (OPSD) trains mathematical reasoning models using a privileged teacher that sees a reference solution and supervises student-sampled prefixes. Standard OPSD uses one fixed parameter setting at every state, but nearby settings may offer additional supervision. We find that local parameter perturbations reveal complementary reference-aligned corrections under the same reference context. Different experts supply these corrections at different reference positions. Their pool covers more such positions than the unperturbed privileged teacher. We introduce Neighborhood OPSD (N-OPSD) to turn these corrections into supervision at student-visited states. Offline, greedy selection builds a compact pool of frozen experts by rewarding filtered reference-token gains beyond the pool’s current best at each position. The highest-peak expert need not provide the best training target. Online routing therefore separates the anchor direction from its level of support. MaxPeak selects the anchor token, and quantile selection chooses among experts whose top token matches it. The student learns from the chosen expert’s full next-token distribution through the clipped forward-KL objective inherited from OPSD. We evaluate on AIME 2024, AIME 2025, and HMMT February 2025. Across three independent runs per method, Neighborhood OPSD improves the three-benchmark Average@12 over OPSD by 2.75, 1.67, and 1.94 points on Qwen3-1.7B, 4B, and 8B, respectively. Student-prefix continuations support using the pool beyond the reference trajectories used for selection. Matched ablations support filtered reference-token gains as a selection criterion. Accounting for overlap within the pool and routing by state further improve student accuracy. Inference uses only the distilled student.

[172] Drift Inspector: Exploring and Measuring Scientific Drift with Atomic Contribution Claims cs.CL | cs.DLPDF

Vsevolod Karimov, Stepan Ostarkov, Anastasia Poroshina, Anatoly Frolov, Alexander Panchenko

TL;DR: Drift Inspector将论文摘要拆为原子贡献主张，再按年份聚类成可追溯研究地图，以观察领域的长期研究方向漂移。

Details

Motivation: 摘要同时包含贡献、背景、动机和元话语，直接分析全文或关键词难以区分领域实际产出与讨论内容。

Result: 开源系统从每篇摘要提取去除上下文、承载贡献的原子贡献主张（ACC），再跨年份聚类为交互式地图，每个趋势都可追溯到对应主张和论文。应用于EMNLP六年数据后，显示研究从经典NLP任务转向推理、多模态等LLM时代能力，而关键词或整篇摘要统计会模糊这一变化。发布数据还扩展到完整ACL Anthology，流水线处理34.6万条主张、8万篇摘要和423个venue；抽取经过人工验证，聚类与外部人工分类体系对照检查。

Insight: 以贡献命题为分析单位，可以将领域方向变化与背景措辞或关键词频率区分开来。主张和来源论文之间的可追溯链接也支持人工审阅趋势图。

Abstract: Scientific abstracts mix contributions with background, motivation, and meta-language, so tools that read them as-is cannot separate what a field produces from what it discusses. We present Drift Inspector, an open-source system for measuring and exploring how a research field changes over time at the level of Atomic Contribution Claims (ACCs): decontextualized, contribution-bearing propositions an LLM extracts from each abstract before analysis. The system clusters these claims across years into an interactive map where every trend traces back to the claims and papers behind it. Applied to six years of EMNLP, it shows the field shifting away from classic NLP tasks toward LLM-era capabilities such as reasoning and multimodality – a movement that keyword or whole-abstract counts blur. The released data extend beyond EMNLP: the same pipeline has processed the full ACL Anthology (346k claims, 80k abstracts, 423 venues). Extraction is human-validated and clustering checked against an external manually constructed taxonomy.

[173] LatentHarness: Learning Latent Actions for Memory and Reasoning via Counterfactual Policy Distillation cs.CLPDF

Xiaoqiang Wang, Suyuchen Wang, Bang Liu

TL;DR: LatentHarness将长上下文记忆检索与潜在推理统一为序贯动作选择，让模型在继续思考、回忆输入/中间状态和退出之间自主调度。

Details

Motivation: 长上下文推理有两个瓶颈：跨长输入保留证据，以及长时间维持计算。外部记忆和潜在推理通常分开处理，未统一决定何时继续算、何时调用记忆。

Result: 每个内部步骤，模型在THINK（继续计算）、RECALL（从快速权重记忆检索输入证据及中间推理）和EXIT（输出下一token）中选择。训练使用反事实策略蒸馏，对每种动作分支一步并评估对最终token的影响；奖励教模型何时记忆比继续推理更有用，经过RECALL的梯度也教模型保留哪些中间状态。在六个通用及长上下文基准上，1.4B LatentHarness相对最强基线分别提高2.8%和10.0%（相对增益），运行速度是最强长上下文基线的5.9倍。

Insight: 记忆管理本身可视为推理过程中的潜在动作，而非外部预设模块。反事实评估THINK、RECALL和EXIT能同时学习计算调度与哪些中间状态值得保留。

Abstract: Long-context reasoning faces two complementary bottlenecks: retaining evidence across long inputs and sustaining computation across many reasoning steps. Existing approaches largely address them separately, with external memory extending access to distant evidence and latent reasoning compressing multi-step computation. We introduce LatentHarness, which unifies memory access and latent reasoning as sequential latent action selection. At each internal step, the model chooses THINK for further computation, RECALL from a fast-weight memory of input evidence and intermediate reasoning states, or EXIT to emit the next token. We train this policy with counterfactual policy distillation, which branches every action for one step and scores its effect on the emitted token. These gains teach the policy when memory is more useful than further reasoning, while gradients through counterfactual recall teach which intermediate states should be retained in memory for future use. Across six general and long-context reasoning benchmarks, LatentHarness at 1.4B improves on the strongest baselines by 2.8% and 10.0% relative, respectively, and runs 5.9x faster than the strongest long-context baseline.

[174] Explore-on-Graph: Hybrid Embedding-LLM Reasoning for Knowledge Graph Question Answering under Incompleteness cs.CLPDF

Ola El Khatib, Djellel Difallah

TL;DR: XoG通过知识图谱类型统计和嵌入恢复缺失路径，再让LLM筛选候选关系并推理，减少图谱不完整时直接生成虚构事实的风险。

Details

Motivation: LLM与知识图谱结合可用结构证据增强推理，但多数图谱问答方法依赖现有边；缺失事实会切断推理路径。让LLM直接生成缺失知识又可能引入幻觉证据。

Result: Explore-on-Graph（XoG）面向不完整知识图谱多跳问答，从学习到的图结构而非LLM参数记忆恢复缺失路径。它用类型级实体—关系统计筛选候选关系，以图嵌入检索可能缺失实体，LLM充当语义选择器和推理器，并交替进行规划、探索、推理。在WebQSP、CWQ和基于Wikidata的BRINK上，XoG在完整图谱上有竞争力，在图谱不完整时持续超过没有任务专属KGQA训练的可比方法；收益跨多个LLM骨干保持。相较密切相关规划方法，LLM token消耗最多减少33%。

Insight: 缺失图边不必依赖LLM自由补全，可利用嵌入及类型统计从图结构提出候选，再由LLM做语义过滤。迭代规划与探索能恢复路径，同时降低无依据证据引入风险。

Abstract: Large language models (LLMs) are increasingly combined with knowledge graphs (KGs) to ground reasoning in structured evidence. However, most LLM-based KGQA methods rely on traversing existing graph edges and become unreliable when reasoning paths are broken by missing facts. Alternatives that ask LLMs to generate missing knowledge risk introducing hallucinated evidence. We introduce XoG (eXplore-on-Graph), a framework for multi-hop question answering over incomplete KGs that recovers missing reasoning paths from learned graph structure rather than LLM parametric knowledge. XoG combines type-level entity-relation statistics to identify candidate relations with KG embeddings to retrieve plausible missing entities, using the LLM as a semantic selector and reasoner. These mechanisms are integrated into an iterative planning-exploration-reasoning process. Experiments on WebQSP, CWQ, and the Wikidata-based BRINK benchmark show that XoG remains competitive on complete KGs and consistently outperforms comparable methods without task-specific KGQA training under KG incompleteness. These gains persist across multiple LLM backbones, indicating that stronger LLMs alone do not resolve missing graph evidence. XoG also reduces LLM token consumption by up to 33% compared with a closely related planning-based approach.

[175] When a Kindergartener Solves Calculus: Measuring Capability Leakage in Role-Prompted Reasoning Models cs.CL | cs.AI | cs.HCPDF

Pakhapoom Sarapat, Saksorn Ruangtanusak, Kunat Pipatanakul, Pittawat Taveekitworachai

TL;DR: RoleCapBench测量模型被要求扮演特定教育角色时是否仍表现出超出角色能力的知识，并提出推理时注入缓解角色—能力不匹配。

Details

Motivation: 角色提示模型可能能生成符合角色风格的文字，但仍使用远超角色设定的能力，例如扮演幼儿园儿童却正确解微积分题。仅检查语气无法确定模型是否真正遵守角色能力限制。

Result: RoleCapBench按课程设计六种教育角色和从小学到A-level的四种评估难度，测量三个开源推理模型的角色能力泄漏。模型虽有较强角色语气分数1.218至1.389，但仍保留0.811至0.898的超角色准确率；即便明确要求匹配角色能力水平，泄漏仍持续。推理时Injection干预结合角色专属能力指南和预填响应前缀，将超角色准确率最多降低0.562，而多数模型角色内准确率仅小幅下降，不超过0.058。

Insight: 角色风格模仿不等于能力校准，角色提示本身无法保证模型限制解题能力。需要独立评测角色内和角色外准确率，并在推理时明确施加角色特定能力边界。

Abstract: We investigate the problem of role-capability leakage (RCL), in which a role-prompted reasoning model generates convincing in-role text while continuing to exhibit capabilities on benchmarks that exceed those implied by the assigned role. For example, when a model is prompted to assume the role of a kindergarten student, one might expect its performance on a mathematics benchmark to reflect kindergarten-level ability rather than expert-level proficiency in solving calculus problems. We introduce RoleCapBench, a curriculum-grounded benchmark for evaluating RCL across six educational roles and four assessment levels spanning elementary school through A-level, and use it to evaluate three open-weight reasoning models. We find that although the models can generate stylistically convincing in-role responses, they consistently fail to align their underlying capabilities with their assigned roles. Naive role prompting yields strong role-voice scores of 1.218–1.389 while retaining above-role accuracy of 0.811–0.898. RCL persists across a range of prompting conditions, including prompts that explicitly instruct the model to match the role’s capability level. To mitigate this problem, we propose Injection, an inference-time intervention that combines explicit, role-specific capability guidelines with a guiding prefilled response prefix. Injection improves role-capability alignment across models, reducing above-role accuracy by up to 0.562 while preserving in-role accuracy with a marginal drop of less than 0.058 across most models. All artifacts, including scripts and evaluation data, will be released upon acceptance.

[176] Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models cs.CLPDF

Xingjie Zhuang, Jialong Tang, Chulun Zhou, Buchao Zhan, Zhirui Li

TL;DR: 研究在多模型、多领域和多语言设置中检验角色提示的认知增强效果，并提出混合语言提示拼接来减轻角色理解偏差。

Details

Motivation: 角色扮演提示是提升LLM推理与输出质量的简单常用方法，但其是否跨领域稳定有效缺乏系统验证。

Result: 作者在MMLU和MMLU-Redux上开展跨模型、跨领域、多语言实验，发现收益强烈依赖模型容量、知识领域和提示语言。基于元认知理论提出角色认知对齐假说：只有模型正确理解角色及其知识领域，角色提示才会发挥作用；并通过角色信息丰富度消融、分层熵差异分析及潜在思维空间偏移观察进行检验。为减轻角色认知偏差并稳定效果，作者提出免训练、轻量的MLCP策略，将语义等价的多语言角色提示拼接以聚合互补表示线索。大量实验显示，MLCP在所有测试LLM上均优于普通单一角色提示。

Insight: 提示角色的效果不仅取决于模型规模，还取决于模型是否理解该角色能做什么及其领域知识。多语言语义等价提示可提供互补线索，缓解角色表示偏差。

Abstract: Role-playing prompting has become a popular yet simple technique for improving LLM reasoning and output quality. However, whether it consistently boosts performance across diverse domains remains unclear, as systematic validation is lacking. To fill this gap, we run multi-model, cross-domain, and multilingual experiments on MMLU and MMLU-Redux. We find that gains from role-play prompting depend heavily on model capacity, knowledge domain, and prompt language. Drawing on metacognition theory, we propose the persona-related cognitive alignment hypothesis: role-play works only when the LLM correctly grasps the designated persona and its associated knowledge domain. We test this hypothesis through persona information richness ablation, layer-wise entropy divergence analysis, and latent thought-space deflection observation. To reduce persona cognitive bias and stabilize role-play performance, we propose \textbf{M}ixed-\textbf{L}anguage \textbf{C}oncatenate \textbf{P}rediction \textbf{(MLCP}), a simple, training-free, and efficient multilingual prompt concatenation strategy. It aggregates semantically equivalent role prompts to enrich complementary representational cues. Extensive experiments show that MLCP consistently outperforms vanilla role-play prompting across all tested LLMs.

[177] OPSRD: On-Policy Self-Role Distillation cs.CL | cs.AI | cs.LGPDF

Weijie Ren, Yanwen Zhang, Hao Li, Zhuolin Qi, Hengyi Zhang

TL;DR: OPSRD让无角色学生沿自身轨迹训练，并用同一基础模型在专家角色上下文下提供特权token分布，从而学习未采样到的替代推理续写。

Details

Motivation: 评估或蒸馏完整角色提示回答会遗漏有价值的下一token偏好，尤其当采样答案错误时仍有可学习信息；迁移这些偏好还需目标函数覆盖学生本来很少预测的备选。

Result: 固定专家角色作为特权教师上下文，无需参考解。无角色学生生成轨迹后，冻结的同一基础模型在完全相同前缀上给出角色条件分布，揭示采样续写之外的备选。教师加权前向KL集中于学生低估的候选，并裁剪单个词表贡献；监督只用于学生熵最高的一半位置。Qwen3 1.7B、4B、8B在三个竞赛数学基准上均较无推理角色提示的基础模型提升；三种发散度中，前向KL在每个规模取得最高宏平均准确率。摘要未列各模型具体提升。

Insight: 自蒸馏不仅可让学生模仿已生成的完整答案，还可利用特权角色上下文揭示被学生低估的token替代项。将学习集中于高不确定位置，有助于把有限更新用于最需要探索的状态。

Abstract: Role prompting elicits specialized behavior from large language models through an expert identity, offering a lightweight way to guide reasoning on demanding tasks. However, evaluating or distilling complete role-prompted answers can miss useful next-token preferences when the sampled solution remains incorrect. Transferring these preferences also requires an objective that reaches alternatives the student rarely predicts. We introduce OPSRD, which uses a fixed expert role as privileged teaching context for on-policy self-distillation without reference solutions. A role-free student generates a trajectory, and a frozen instance of the same base model supplies role-conditioned distributions on its exact prefixes, exposing alternatives beyond the sampled continuation. Teacher-weighted forward KL targets alternatives the student underestimates, with clipping to limit individual vocabulary contributions. Supervision is restricted to the highest-entropy half of student positions, concentrating learning where predictions are uncertain. Experiments on three competition-math benchmarks with Qwen3-1.7B, 4B, and 8B show improvements over the base models without role prompts at inference. Forward KL achieves the highest macro-averaged accuracy among the three evaluated divergences at every scale. Code is available at https://github.com/zhansan114514/OPSRD.

[178] The Concrete-Arbitrary Gap: Kinship Reasoning in LLMs Is Not Indifferent to Presentation cs.CLPDF

Thomas Pashby

TL;DR: 研究比较形式等价的亲属关系推理以具体熟悉词汇或任意新谓词呈现时的表现，发现LLM推理能力明显依赖表述形式。

Details

Motivation: 作者检验LLM是否能对熟悉关系词和显式定义的无意义谓词同等处理同一形式结构的亲属关系问题。

Result: 在500组配对图结构任务中，具体关系词准确率明显高于任意谓词：本地Qwen3.8-27B高35.6个百分点、Gemma 4 26B-A4B高26.6、Gemma 4 31B高12.0、Qwen3.8-Max高5.4，四个配对差异均有统计显著性。增加推理预算或更换提示语言能显著缩小差距，说明差异可改变，并非固定能力缺陷。作者的最小结论是行为层面：这些任务中模型表现出的关系能力并不对呈现形式无差别；显式定义也不能让新谓词像融入语言联想的熟悉词一样易用。

Insight: 形式规则相同并不意味着语言模型处理难度相同，熟悉词汇的训练关联为关系推理提供额外线索。推理预算和提示语言可缓解差距，但模型的抽象组合能力仍受表面表达影响。

Abstract: We test whether large language models solve formally matched kinship problems equally well when relations are expressed in familiar vocabulary or by explicitly defined nonce predicates. Across 500 paired graphs, concrete accuracy exceeds arbitrary accuracy by 35.6 percentage points in local Qwen3.8-27B, 26.6 in Gemma 4 26B-A4B, 12.0 in Gemma 4 31B, and 5.4 in Qwen3.8-Max. All four paired gaps are statistically resolved. Reasoning budgets and prompt-language interventions can substantially reduce the difference, showing that it is modifiable rather than a fixed incapacity. The minimal conclusion is behavioral: on these tasks, the models’ manifested relational competence is not indifferent to presentation. Explicit definitions provide the formal relations but do not make nonce predicates as usable as familiar vocabulary embedded in learned linguistic associations.

[179] AdaGEPA: Adaptive Feedback Allocation for Reflective Prompt Optimization cs.CLPDF

Junyang Chen, Zecheng Wang, Jingbang Chen

TL;DR: AdaGEPA依据提示当前弱项，自适应替换每个反馈小批次中至多一个样例来指导反思式提示优化，兼顾反馈针对性和上下文保留。

Details

Motivation: 传统提示优化根据任务样本反馈反思修改提示，但若样例选择不考虑当前提示弱点，改进可能只覆盖被选案例，难以泛化到整体任务。

Result: AdaGEPA利用提示表现和任务结构挑选下一轮修订样本；每个反馈小批次最多替换一个例子，以针对已识别弱项，同时保留其余反馈上下文。在六个下游基准及匹配rollout预算下，平均验证分高于非自适应选择，并在多个任务上更早找到高分提示。初始Schema-Guided Dialogue实验中，使用半数预算所得提示，在新旧服务对话的联合目标准确率超过非自适应基线用完整预算所得提示。

Insight: 反思质量取决于反馈是否覆盖当前提示的薄弱点，而非一味增加样例数量。只替换少量针对性样例可在保留既有上下文的同时提高rollout预算效率。

Abstract: Prompt optimization improves the performance of language-model systems on downstream tasks by refining their prompts. Classical methods evaluate prompts on task examples and use the resulting feedback to guide prompt revisions through reflection. However, when feedback selection does not account for the prompt’s weaknesses, these revisions may improve performance on selected examples without yielding broader task improvements. To address this issue, we propose AdaGEPA, an adaptive feedback-allocation method that uses the prompt’s performance and task structure to select examples for the next prompt revision. Our method replaces at most one example in each feedback minibatch to target an identified weakness while preserving the remaining feedback context. Across our main experiments on six downstream benchmarks, AdaGEPA achieves higher mean validation scores than non-adaptive feedback selection under matched rollout budgets. AdaGEPA also finds high-performing prompts earlier across several tasks. In the initial Schema-Guided Dialogue (SGD) study, its half-budget prompts outperform the non-adaptive baseline’s full-budget prompts in joint goal accuracy on new dialogues from services seen and unseen during search. Overall, our findings highlight the potential of adaptive feedback allocation to improve both the effectiveness and rollout-budget efficiency of reflective prompt optimization.

[180] LEAP: Learned Block-wise Evidence Retrieval for Long Audio-Video Perception cs.CL | cs.AI | cs.CVPDF

Juyi Lin, Zhiqiang Lao, Jiali Cui, Lin Zhao, Pu Zhao

TL;DR: LEAP将小时级音视频分块检索与单次有界回答分开：先轻量定位候选时间窗，再对高分窗口重新编码，以保持细粒度证据并控制上下文长度。

Details

Motivation: 小时级音视频问答存在上下文两难：密集编码整段录制很快耗尽窗口，均匀时间压缩又稀释细粒度声学和视觉证据。

Result: LEAP把录制分成固定时长块，先对每块做轻量定位并给短候选窗打分，汇集排名最高的窗口后，在单次有界回答阶段重新编码。因此回答输入和峰值上下文长度不随录制总时长增长。证据定位与推理解耦后，可在预计算转录上定位候选时间窗而无需解码视频帧；最终回答则对原始音视频流重新处理，以保留细粒度视觉和非语音信息。定位LoRA和回答LoRA分别优化两个阶段；块网格天然支持因果查询，可直接流式推理，无需专门流式训练。在多个AVQA基准上，LEAP比Qwen3-Omni-30B-A3B高4.5%至16.8%；迁移到MiniCPM-o 4.5后，超过其已发表结果3.1%至13.0%。

Insight: 长录制不必整体放入模型上下文，可将候选定位和精细回答解码分工，让上下文预算与总时长解耦。转录索引可低成本搜索，而最终原始音视频复核确保不丢失细粒度证据。

Abstract: Hour-scale audio-visual question answering is constrained by a context dilemma: dense whole-recording encoding rapidly exhausts context limits, whereas uniform temporal compression severely dilutes fine-grained acoustic and visual evidence. We introduce LEAP, a framework where the model retrieves its own evidence without placing the whole recording in one context. LEAP divides a recording into fixed-duration blocks, applying a lightweight localization pass to each block to score short candidate windows. The highest-ranked windows are pooled and re-encoded in a single bounded answer pass. Consequently, the answer input and peak context remain independent of the recording duration. By decoupling evidence localization from reasoning, our framework can localize candidate temporal windows over pre-computed transcripts without decoding media frames, while preserving fine-grained visual and non-speech evidence by routing the final answering pass over raw audio-visual streams. LEAP trains both stages: a localization LoRA improves the selected windows, and an answer LoRA improves the answers read from the same windows. The block grid natively supports causal queries, enabling LEAP to support streaming inference without streaming-specific training. Across several AVQA benchmarks, LEAP improves over the Qwen3-Omni-30B-A3B baseline by 4.5-16.8%, and transfers to a second omni-modal backbone, MiniCPM-o 4.5, surpassing its published results by 3.1-13.0%.

[181] UBTree: Parallel Tree Drafting via Unigram and Bigram Models for Speculative Decoding cs.CLPDF

Chumeng Liang, Linxuan Wang, Xinyu Peng, Huabin Liu, Yuxin Chen

TL;DR: UBTree用单token提议器和相邻token二元选择器构造并行草稿树，通过高温分布训练增加分支多样性以提升推测解码接受率。

Details

Motivation: 推测解码在一次目标模型前向中验证多个草稿token，可加速生成；并行草稿器在目标分布熵较高时因候选多样性不足而效果下降。

Result: UBTree由单元模型为每个位置独立提出候选token，再由轻量二元模型预测相邻候选token对的转移分数以构建草稿树。单元提议器用标准交叉熵训练；选择器用高温数据及重归一化KL训练，扩展到贪心路径之外的合理分支，提高树验证时接受更多token的机会。在七个标准基准及Qwen3-4B、8B上，相对自回归解码平均加速5.84至6.94倍，28组比较全部超过DARTree；生产规模评估也超过DSpark等前沿基线。

Insight: 目标分布熵高时，草稿树需要丰富合理替代分支，而不是只优化贪心续写路径。单元提议和二元转移选择分开训练，可在保持并行性的同时增加接受机会。

Abstract: Speculative decoding accelerates language model inference by verifying multiple draft tokens in a single target-model pass. Recent parallel drafters have achieved breakthrough performance in frontier production models, but their effectiveness deteriorates as the entropy of target distributions increases due to insufficient draft diversity. To overcome this bottleneck without sacrificing parallelism, we introduce UBTree, a parallel drafter that couples a Unigram proposer with a Bigram selector to construct drafting Trees. The unigram proposer is trained with the standard cross-entropy objective to generate candidate tokens independently for each position, while a lightweight bigram selector predicts transition scores between adjacent candidate pairs. Unlike the proposer, the selector is trained with a renormalized KL objective on high-temperature data. This tree-native training broadens the supervision beyond the greedy path, encouraging plausible alternative branches that improve the chance of accepting additional tokens during tree verification. Across seven standardized benchmarks with Qwen3-4B and Qwen3-8B, UBTree achieves an average speedup of $5.84$–$6.94\times$ over autoregressive decoding and outperforms DARTree in all 28 comparisons. Production-scale evaluation further demonstrates UBTree’s advantage over frontier baselines such as DSpark.

[182] AutoDataBench: A Data-centric Testbed for Accelerating Auto Research cs.CLPDF

Ruifeng Yuan, Yizhi Li, Yaxin Du, Fengyu Cai, Yiqi Liu

TL;DR: AutoDataBench固定非数据因素，以数据诊断、组织和构建三类任务系统评测智能体的Data Intelligence，并分析其是否理解数据干预的实际影响。

Details

Motivation: 现有自动研究基准通常同时改变训练框架、超参数、计算预算和数据，难判断前沿智能体进步来自哪项研究能力。作者将数据理解、改造和提升能力单独隔离。

Result: AutoDataBench围绕数据智能提出诊断、组织、构建三类能力，以三个精心策划的优化任务实例化，并固定非数据因素。基准评测前沿LLM在工具使用、检索和知识注入条件下如何按任务资源预算迭代改进训练数据。除优化结果外，还比较训练前预测与实际训练效果，检查模型是否具有超越试错的数据效应推理，并研究反馈是否提升这种理解。作者进一步显示，将AutoDataBench轨迹复用于中训练可改善下游代码能力，因此基准也能生成高质量训练数据；摘要未列具体分值。

Insight: 自动研究评估需隔离数据干预，才能判断智能体是否理解数据改变如何影响模型表现。迭代轨迹既可用于测量数据智能，也可能反过来成为中训练监督。

Abstract: Existing auto-research benchmarks often entangle multiple sources of improvement, including training frameworks, hyperparameters, compute budgets, and data, making it difficult to attribute why one frontier agent outperforms another to specific research capabilities. In this work, we isolate and systematically evaluate Data Intelligence: an agent’s ability to understand, manipulate, and improve the data that shapes model capabilities. We introduce AutoDataBench, a controlled testbed built on a conceptual framework of data intelligence spanning data diagnosis, data organization, and data construction, instantiated through three highly curated optimization tasks while holding non-data factors fixed. Across tool use, retrieval, and knowledge injection, we evaluate frontier LLMs’ ability to improve training data through iterative experimentation under task-specific resource budgets. Beyond optimization performance, we ask: do LLMs understand what their data interventions do? We compare predictions made before training with observed outcomes to seek evidence of data-effect reasoning beyond trial and error, and explore whether iterative feedback helps LLMs better understand how changes to training data affect model performance. Finally, we show that reusing AutoDataBench trajectories for mid-training improves downstream coding performance, highlighting its value in both evaluating data intelligence and generating high-quality training data. Code and resources are available at https://github.com/AutoDataBench/AutoDataBench.

[183] Debias It Yourself: Teaching LLMs Cognitive Bias Mitigation Interventions cs.CLPDF

Chahat Raj, Sina Mansouri, Aylin Caliskan, Antonios Anastasopoulos, Ziwei Zhu

TL;DR: DIY将社会心理学和认知科学中经验证的五类偏见干预转为LLM去偏程序，并比较上下文示例、指令微调和引导自我修订三种应用方式。

Details

Motivation: 社会心理学已有数十年经验证的干预可减少刻板思维和偏见回答，但如何将这些干预转化为有效的大模型去偏方法仍需研究。

Result: Debias It Yourself（DIY）把五种干预分别应用于Show（上下文示例）、Train（指令微调）和Revise（引导自我修订）范式。在三种模型、五个偏见基准、11种去偏基线及三个推理基准上的实验显示，Train+Revise和单独Revise平均排名最高，在偏见—推理权衡上表现最好：偏见均值最低2%时推理准确率为90%；未见偏见维度的偏见最多降低14.8%。

Insight: 成熟的认知偏见干预可被转译到模型训练和自我修订环节，而无需只依赖提示层面的规避。评估需同时观察偏见下降和推理能力保留，并检查未见偏见维度上的迁移。

Abstract: Bias has long been studied in social psychology and cognitive science, where decades of research have produced a body of validated interventions that reduce stereotypical thinking and prejudiced responses in humans. We propose Debias It Yourself (DIY), a cognitively grounded framework that translates five such interventions into debiasing procedures for large language models and delivers them through three established paradigms: Show (in-context examples), Train (instruction tuning), and Revise (guided self-revision). Across three models, five bias benchmarks, eleven debiasing baselines, and three reasoning benchmarks, Train+Revise and Revise alone attain the top two average ranks, lead the bias-reasoning tradeoff (mean bias as low as 2% at 90% reasoning accuracy), and reduce bias on unseen dimensions by up to 14.8%. Our code and data are publicly available.

[184] SCB: SpeechConversationBench for Evaluating Multi-Turn Reasoning in Speech-to-Speech Models cs.CL | cs.AI | cs.SDPDF

Kanpat Vesessook, Saksorn Ruangtanusak

TL;DR: SpeechConversationBench比较语音数学题一次给出、拼接后一次给出和逐轮披露三种方式，量化语音对话模型处理跨轮信息的能力。

Details

Motivation: 语音到语音系统常需处理要求分散在多轮对话中的任务，但单轮问答评测无法区分对题目改写敏感和逐步语音交互困难。

Result: SCB选取103道分片GSM8K问题，设置原题单轮输入full、信息碎片拼接后单轮输入concat、以及跨轮逐步口头披露sharded三种条件。比较四种商用语音系统及内部开发、显式管理对话上下文的LEGO语音流水线。四种商用系统从concat转为sharded后准确率下降5.0至25.3个百分点；LEGO三种条件均为77.5%，GPT-4o Realtime在sharded条件为76.6%。两个单轮基线有助于区分题目重述敏感性与增量语音交互本身带来的额外挑战。

Insight: 同一数学题分批口头给出会显著影响多数语音系统表现，显示跨轮信息整合仍是独立能力。设置拼接单轮对照有助于将输入拆分影响与实时对话管理分开。

Abstract: Speech-to-speech systems must solve tasks whose requirements emerge across conversational turns. We introduce SpeechConversationBench (SCB), a focused evaluation of spoken mathematical reasoning using 103 sharded GSM8K problems. The framework compares the original problem delivered in one turn (full), its concatenated information shards delivered together (concat), and incremental spoken disclosure across turns (sharded). We report final-answer accuracy for four commercial speech systems and LEGO, a proprietary speech pipeline developed internally by the SCBX Innovation Lab team with explicit conversational context management. Relative to concat, sharded accuracy decreases by 5.0-25.3 percentage points across the four commercial systems. LEGO achieves 77.5 percent accuracy in all three conditions, compared with 76.6 percent sharded accuracy for GPT-4o Realtime. The two single-turn baselines distinguish sensitivity to problem reformulation from the additional challenges introduced by incremental spoken interaction.

[185] Linguistic Loopholes in LLM Unlearning: From a 174-Language Benchmark to Coverage-Aware Unlearning cs.CL | cs.AIPDF

Tyler Skow, Shravan Chaudhari, Rama Chellappa, Abhay Yadav

TL;DR: COVER在语言预算约束下选择少量遗忘监督语言，以最大化未监督语言中的跨语言遗忘覆盖。

Details

Motivation: 在一种语言中遗忘事实不保证其他语言也无法恢复，改变查询或答案语言可能打开跨语言漏洞；对全部语言都做遗忘既不可扩展，也可能损害无关能力。

Result: 作者提出语言预算多语遗忘任务及Cross-Lingual Unlearning Tensor基准，涵盖174种语言—文字组合和25类原子释义，评估同一知识跨语言表达时遗忘是否泛化。COVER选择能最大化对未监督语言预测覆盖的源语言。朴素地挑选单项最强源语言并不能保证组合后源集合仍强，因此需要联合覆盖选择。部署时只需良性校准数据和冻结模型访问。三类模型、两个不相交遗忘集上，相较均匀源语言选择，COVER将留出语言平均残余访问降低7.8%至27.3%；收益也迁移至LORELEI语料的低资源语言真实新闻文档及人工翻译设置。

Insight: 有限预算下的遗忘监督应按语言之间知识传播关系选源，而非逐个选择最强单语言。覆盖未监督语言的效果还需在真实低资源文本上检查，以避免只在合成释义上有效。

Abstract: Unlearning a fact in one language does not guarantee its removal in others as changing the query or even the requested answer language can reopen seemingly forgotten knowledge – a cross-lingual loophole. The most straightforward solution to this challenge – unlearning in all languages – is neither scalable nor desirable as it amplifies damage to unrelated model capabilities. We introduce the task of language budgeted multilingual unlearning where the goal is to select a subset of languages that maximizes cross-lingual erasure. To study this task we introduce the Cross-Lingual Unlearning Tensor, an unlearning benchmark that spans 174 language–script pairs and 25 atomic paraphrase types to examine when forgetting generalizes across linguistic expressions of the same knowledge. We further propose COVER, which selects source languages to maximize predicted COVERage of languages receiving no forget supervision, enabling unlearning on a language budget. Surprisingly, we find naively selecting strong individual sources does not reliably compose into strong source sets motivating our development of COVER. At deployment COVER only requires benign calibration data and access to the frozen model. Across three model families and two disjoint forget sets, COVER reduces mean held-out residual access by 7.8–27.3% relative to uniform source selection. We find these gains extend beyond synthetic benchmarks to real news documents in low-resource language settings using human translated data from the Low Resource Languages for Emergent Incidents (LORELEI) corpus.

cs.AI [Back]

[186] Jev in Medicine: A Benchmark Evaluation. Preliminary Results cs.AI | cs.CL | cs.LGPDF

Alfredo Madrid-García, Beatriz Merino-Barbancho

TL;DR: 该研究比较非生成式选项概率模型Jev 1.13与GPT-6 Sol在四个医学基准上的准确率、概率校准、选择性预测及不可回答识别。

Details

Motivation: Jev只对固定答案选项分配概率，不能生成选项外回答；它在医学问答和病例诊断中的准确性及不确定性质量此前未知。

Result: 在MetaMedQA、PubMedQA、DiagnosisArena-MCQ和NEJM病例上共完成8,469次有效请求。Jev在PubMedQA准确率78.4%，接近GPT-6 Sol中等推理的78.2%；MetaMedQA为74.8%对82.7%，DiagnosisArena为59.8%对82.4%，NEJM病例为61.8%对82.4%。MetaMedQA上Jev校准最佳，ECE 0.063对0.146；高于0.9置信度的回答占52.9%，准确率93.4%，但GPT在相近接受率下准确率也相当。DiagnosisArena上Jev区分力较弱（AUROC 0.645对0.768）。162道不可回答题中，Jev选该项的比例10.5%，GPT为8.6%。延迟0.27–0.31秒，2,823题成本0.08美元。

Insight: 速度和成本优势并不保证适用于复杂临床诊断；Jev在研究摘要问答接近前沿模型，但病例推理差距明显。置信度校准和不可回答识别也随任务而变化，部署前需针对目标场景评估。

Abstract: Jev is a non-generative “System One” model that assigns probabilities to predefined answer options and cannot answer outside them. Its accuracy and calibration on medical question-answering and case-based diagnostic-reasoning tasks are unknown. We evaluated Jev 1.13 on four medical benchmarks: MetaMedQA, PubMedQA, DiagnosisArena-MCQ and the NEJM Case Challenges. GPT-6 Sol, with (medium) and without reasoning, was the reference. The primary outcome was top-1 accuracy; key secondary outcomes were calibration, selective prediction and recognition of unanswerable questions. All 8,469 requests returned a valid answer. Jev’s accuracy was similar to that of GPT-6 Sol with medium reasoning on PubMedQA (78.4% vs 78.2%;), lower on MetaMedQA (74.8% vs 82.7%) and much lower on DiagnosisArena-MCQ (59.8% vs 82.4%;) and the NEJM cases (61.8% vs 82.4%). On MetaMedQA, Jev’s probabilities were the best calibrated (expected calibration error 0.063 vs 0.146), and its answers with a probability of at least 0.9 (52.9% of questions) were 93.4% accurate, but GPT-6 Sol was as accurate when it accepted a similar proportion of questions. On DiagnosisArena-MCQ, Jev’s probabilities discriminated poorly (AUROC 0.645 vs 0.768). Of the 162 questions whose correct answer was “I don’t know or cannot answer”, Jev chose that option for 10.5% (GPT-6 Sol, 8.6%). Median latency was 0.27-0.31 s; all 2,823 items cost USD 0.08. Jev was fast and inexpensive, and its accuracy was similar to that of a frontier LLM on research abstracts but lower on examination questions and much lower on complex diagnostic cases. Task-specific validation is required before clinical use.

[187] Beyond Mode Collapse: Generating Diverse Synthetic Expert Conversations via Generative Flow Networks cs.AI | cs.CL | cs.LGPDF

Sumit Asthana, Michael Ion, Kevyn Collins Thompson

TL;DR: 作者以生成流网络生成潜在互动结构，在保持训练分布真实性的同时覆盖多种专家对话策略，减少直接提示合成数据的模式坍缩。

Details

Motivation: LLM后训练依赖高质量合成对话，但直接提示或按终端场景条件生成常得到低多样性数据，集中在少数主导互动模式。

Result: 方法训练GFlowNet生成潜在对话结构，并用关键互动特征的高斯混合分布建模，例如困惑过程和支架指导比例，使专家策略按训练数据中出现频率采样。在辅导和情感支持两个结构差异显著的领域中，该方法较强化学习及端到端LLM基线更好平衡忠实度、模式覆盖和真实性，且不复制训练样本。三个下游结果预测任务上，使用GFlowNet合成对话训练的分类器获得更强监督信号；摘要未列具体指标。

Insight: 合成对话的多样性应反映真实专家策略分布，而不是只追求随机变化或复制最常见模式。生成流网络可在潜在结构层面采样多样互动，用于后续预测任务训练。

Abstract: High quality synthetic data is central to post training LLMs for adaptive AI applications that represent the diverse expert strategies and decisions in conversations. Prompting LLMs directly or conditioning them on end use scenarios yields low diversity data that collapses onto dominant modes. We propose a method to generate diverse high quality synthetic data using Generative Flow Networks (GFlowNets). We show that training GFlowNets to generate latent conversation structure using a Gaussian mixture density over key interaction features (e.g., confusion episode dynamics, scaffolding directive balance) enables sampling expert strategies in proportion to their prevalence in the training data. Across two structurally distinct domains, tutoring and emotional support dialogues, our GFlow based synthetic data generation approach offers a better balance of fidelity, mode coverage and authenticity than reinforcement-learning and end to end LLM baselines, without copying training data. Evaluated on three downstream outcome prediction tasks, classifiers trained on synthetic GFlowNet generated conversations provide a stronger training signal than competitive synthesis baselines.

[188] Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting cs.AI | cs.CLPDF

Loay Mualem, Lluís Pastor-Pérez, Vinh Tong, Andrei Manolache, Tanja Bien

TL;DR: GoldiMask联合选择扩散语言模型微调时可见的上下文token并加权剩余预测目标，按模型信号平衡上下文价值和学习潜力。

Details

Motivation: 离散扩散语言模型SFT通过遮蔽响应token并从可见上下文恢复原文；遮蔽模式同时决定模型可用上下文和需预测的token。均匀随机遮蔽没有显式协调这两者。

Result: GoldiMask用近似最大化子模目标的方法选择透露为上下文的token，目标函数根据模型信号平衡上下文收益和token作为预测目标的价值。随后按剩余目标从已选上下文中获益多少及其剩余学习潜力加权。在三种骨干、三份训练数据上，多数测试设置平均准确率最高，推理和代码任务均有提升；组件消融显示上下文选择和目标加权均有贡献。在GSM8K和MATH-500上，置信度阈值并行解码时还减少迭代次数，并在更高置信阈值下保持相近准确率。

Insight: 扩散语言模型训练的数据遮蔽不仅制造预测目标，也决定条件信息，二者应联合优化。根据模型对上下文和目标的潜在收益自适应选取，可提升学习效率并缩短并行解码。

Abstract: Supervised fine-tuning of discrete diffusion language models masks some response tokens and trains the model to recover their original values from the visible context. The masking pattern therefore determines both the context available to the model and the tokens it learns to predict. Uniform random masking does not explicitly account for the interaction between these choices. We introduce GoldiMask, which selects tokens to reveal as context by approximately maximizing a submodular objective. This objective uses model signals to balance the benefit of revealing tokens against their value as prediction targets. GoldiMask then weights the remaining targets according to how they benefit from the selected context and their remaining learning potential. Across three backbones and three training datasets, GoldiMask achieves the highest average accuracy in most evaluated settings, demonstrating gains on both reasoning and code generation. Component ablations show that both context selection and target weighting contribute to the gains. GoldiMask also reduces decoding iterations on GSM8K and MATH-500 under confidence-threshold parallel decoding, while maintaining comparable accuracy at higher confidence thresholds.

[189] ArgGYM: A Procedural, Engine-Verified Benchmark for Structured Defeasible Reasoning cs.AI | cs.CLPDF

İbrahim Ethem Deveci, Funda Tan Çalık, Barış Deniz Sağlam, Duygu Ataman

TL;DR: ArgGYM提供由符号论证引擎验证的可反驳推理基准和RLVR训练环境，覆盖结论会被反证推翻、恢复或修订的结构化任务。

Details

Motivation: 数学、代码和形式逻辑中的固定规格及稳定标准让自动奖励易验证，但现实推理常在不完整、可更新信息下暂时支持结论，并随反证或更强理由而撤销、恢复或修改。

Result: ArgGYM将可反驳推理分解为12类任务，以符号论证引擎计算形式状态并评估输出。冻结基准含1,440个验证实例、15种课程配置、两种论证偏好顺序（weakest-link、last-link）及两种集合顺序（elitist、democratic）；相同生成器和验证器还可生成新实例用于测试和可验证奖励训练。模型能答出结构化答案的多个部分却常未完成整体任务；课程后段依赖更长、结构交互更多，前沿和开源模型表现均下降。

Insight: 现实推理需处理可撤销结论和证据更新，不能只在固定答案任务上衡量。程序生成与符号验证允许对不同论证规则和结构复杂度进行可复现评测及RL训练。

Abstract: Recent progress in large language model reasoning has been driven by benchmarks and reinforcement learning environments with automatically verifiable rewards, particularly in mathematics, code, and formal logic. These settings make model accuracy easier to evaluate and optimize, but it remains unclear how far success under fixed problem specifications and stable evaluation criteria transfers to reasoning outside such domains. Real-world reasoning often proceeds under incomplete and revisable information: conclusions may be supported provisionally, defeated by counter-evidence, reinstated by further arguments, or revised when stronger reasons become available. Reasoning of this kind is generally referred to as defeasible reasoning. We introduce ArgGYM, a procedural benchmark and RLVR-compatible training environment for structured defeasible reasoning. ArgGYM decomposes this reasoning into twelve tasks and grounds task-specific scoring in a symbolic argumentation engine that computes the formal states used to evaluate model outputs. It includes a frozen benchmark of 1,440 verified instances across fifteen curriculum configurations, two argument preference orderings (weakest-link and last-link), and two set orderings (elitist and democratic), while the same generators and verifiers can produce fresh instances for evaluation that reduces dependence on static test sets and for verifiable-reward training. On the frozen benchmark, frontier and open-weight models show sharply different reasoning profiles: they can recover substantial parts of structured answers without solving the complete task, and performance declines in later curriculum configurations with longer dependencies and more interacting structures. We release the benchmark, generators, and verifiers for reproducible evaluation and RLVR training.

[190] When Scientific Contradictions Are Lost in Translation cs.AI | cs.CLPDF

Tal Zeevi, Trey W. Jensen, Maxwell Strome

TL;DR: 研究考察科学文本如何影响模型判断两项结果是否矛盾，发现模型需先判断测量是否可比，才能可靠进行形式推理。

Details

Motivation: 两个科学发现可以不一致却并不互相矛盾，因为它们可能测量的对象不同。模型在科学叙述中的冲突判断，既涉及形式约束求解，也涉及理解实验设计及比较关系。

Result: 作者构造不可满足的XOR约束系统，并把约束翻译成不同实验室的科学报告。一个赋值满足更多约束，另一个虽满足较少但更符合预期生物学。直接给形式约束时，GPT-5.6 Sol和Claude Opus 5分别在90%和96%案例选出证据支持更好的赋值；改为科学散文后，Claude常偏向生物学预期。移除该预期偏好后，正确恢复率从27%升至79%（p<.001）；加入形式化请求及配对设计提示后达92%（p<.001）。GPT-5.6 Sol敏感度较低，两项对应变化不显著。

Insight: 科学核验失败未必源自逻辑推理，而可能在于模型误判哪些研究可比、它们之间是什么关系。明确实验设计和形式化比较能改善模型对证据约束的遵循。

Abstract: Two scientific findings can disagree without contradicting each other. Determining whether they conflict requires knowing whether they describe comparable measurements. We study how language models behave at this decision point. In a controlled task, we generate an unsatisfiable XOR constraint system and translate its constraints into scientific reports from different laboratories. One assignment satisfies more constraints, while another satisfies fewer but better matches expected biology. This creates a simple dilemma: does the model choose the assignment that best fits the constraints, or the one that better matches biological expectations? When the constraints are stated directly, GPT-5.6 Sol and Claude Opus 5 recover the best-supported assignment in 90% and 96% of cases, respectively. In scientific prose, however, the models behave differently. Claude Opus 5 often prefers the biologically expected assignment. Removing that biological preference increases recovery of the better-supported assignment from 27% to 79% (p<.001); recovery reaches 92% when the same Biology-favored record is accompanied by a formalization request and an explicit paired-design cue (p<.001). GPT-5.6 Sol is less sensitive, with neither corresponding change reaching statistical significance. These results suggest that reliable scientific verification depends not only on formal reasoning, but also on how models decide which findings should be compared and what relations they imply.

[191] When Reasoning Goes Astray: Attention Dynamics of Uncontrolled Reasoning cs.AI | cs.CLPDF

Yuanhe Zhang, Ziwei Wang, Jie Ren, Haoran Gao, Zhenhong Zhou

TL;DR: RADAR用注意力动态实时识别推理模型的正常反思、过度验证和持续循环，并在重复开始前检测异常后进行注意力重校准。

Details

Motivation: 大型推理模型通过长推理解决复杂任务，但过程可能退化为冗余验证和持续生成循环，增加推理成本并带来资源耗尽风险。截断长输出或检测表面重复难区分正常思考与失控推理。

Result: 作者将生成划分为四种状态，提出RADAR分析动态注意力响应，实时判别当前状态并刻画有效反思如何演化成失控输出。基于分析，将异常注意力分布重新对齐到正常请求模式。时间分析显示，失控推理的注意力在重复出现前已偏离正常模式；纠正这种偏差可持续减少循环，同时大体保留良性性能。摘要未报告具体循环率或准确率。

Insight: 失控生成可在表面重复之前从注意力动态中检测，提供比单纯长度截断更早的干预时机。将注意力拉回正常请求模式可控制过度反思，而减少对正常推理的伤害。

Abstract: Large reasoning models (LRMs) improve performance on complex tasks through extended reasoning, yet the same process can degenerate into redundant verification and persistent generation loops. Such uncontrolled reasoning increases inference cost and creates risks of resource exhaustion and service degradation. However, existing mitigations largely truncate long outputs or react to surface repetition, and thus fail to distinguish normal thinking from uncontrolled reasoning or explain how benign reasoning degenerates into harmful behavior. In this paper, we operationalize LRM generation as four states and further introduce Reasoning-state Analysis via Dynamic Attention Responses (RADAR), which identifies the current reasoning state in real time and characterizes how effective reflection can develop into uncontrolled generation. Guided by RADAR’s analysis, we further realign abnormal attention distributions toward patterns observed in normal requests and examine how this correction affects excessive reflection and persistent looping. Temporal analyses show that uncontrolled reasoning is characterized by attention distributions that deviate from normal generation, with abnormal trends becoming detectable before repetition begins. Correcting these deviations through Attention Realignment consistently reduces looping while largely preserving benign performance. Together, RADAR provide a mechanistic account of how reasoning becomes uncontrolled, offering actionable guidance for identifying critical failure stages and designing targeted runtime interventions.

[192] OpenJev-RLCD: A Working RLCD Implementation cs.AI | cs.CLPDF

Zhimin Gao, Pichao Wang

TL;DR: OpenJev-RLCD提供可运行的校准决策强化学习实现，以严格适当评分规则奖励模型在推理后给出的选项概率分布。

Details

Motivation: Jev这类决策模型只输出选项概率，准确率之外还要求置信度校准。SFT加温度缩放常见于开源复现，而RLVR可能让推理模型变得过度自信。

Result: RLCD让模型先采样推理，再用严格适当评分规则评价其最终承诺的答案分布。方差恒等式显示，对多个样本答案分布取混合会奖励相互不一致的推理路径，而RLVR等于没有该多样性项的混合目标。直接优化单路径目标会关闭推理或被策略梯度噪声淹没，因此采用先校准、后强化的两阶段方案。Qwen3-1.7B在两个推理任务、三个随机种子上，准确率匹配或超过SFT、RFT/STaR和GRPO（均做温度缩放），选择性预测则超过全部对比。GSM8K答案验证中，单次查询在错误率≤5%时覆盖一定比例条目；摘要中具体覆盖占位符未解析。若不确定性来自标注者分歧，RLCD理论上不可能胜过交叉熵。

Insight: 决策校准与答案正确性应分别训练，适当评分规则直接针对概率质量。多条推理路径的分歧也包含信息；当不确定性源于人类标签噪声时，优化不可能突破数据本身上限。

Abstract: Decision models such as Jev answer questions with probabilities, which are only useful if they are calibrated. Open-source reproductions rely on supervised fine-tuning plus temperature scaling, while reinforcement learning from verifiable rewards (RLVR) makes reasoning models overconfident. We present a working implementation of reinforcement learning for calibrated decisions (RLCD) for reasoning models: the model samples a rationale, and we score the answer distribution it commits to afterwards with a strictly proper scoring rule. A variance identity shows that scoring the mixture of several samples rewards disagreeing rationales, and that RLVR is exactly this mixture objective without its diversity term. Optimized naively, the per-rationale objective either switches reasoning off or is drowned out by policy-gradient noise, which leads to a two-stage recipe: calibrate, then reinforce. With Qwen3-1.7B on two reasoning tasks (3 seeds, paired tests), RLCD matches or beats SFT, RFT/STaR and GRPO (each temperature-scaled) in accuracy and beats all of them in selective prediction; on GSM8K answer verification a single query decides \gvTwoCovFive% of the items at $\le$5% error, versus \gvGrpoCovFive% for GRPO. When uncertainty comes from annotator disagreement, RLCD provably cannot beat cross-entropy. Code and results: https://github.com/ZimmyGao/openjev-rlcd.

[193] Targeted Retrieval, Compact Representations: How CoT Reasoning Improves Long-Context Counting cs.AI | cs.CL | cs.LG | stat.APPDF

Liang Twist Shan, Tianyu Hu, Hao Yan, Yiqiao Zhong

TL;DR: 论文通过长文本针堆计数任务分析CoT推理如何帮助语言模型检索分散信息，发现思考模型倾向逐项定向检索并维护内部计数状态。

Details

Motivation: 语言模型在长上下文任务上的进步与CoT推理有关，但推理究竟如何改变内部检索和计数机制尚不清楚；总体准确率无法解释这种能力来自何种信息处理过程。

Result: 在12组模型比较中，思考模式相较非思考模式提高了计数准确率，且数量较大时优势更明显。机制分析显示，非思考模型广泛关注多个目标，思考模型则沿CoT逐个检索；因果干预表明，模型可借助CoT痕迹维护和更新内部计数器，即使没有显式编号。小规模受控实验中，这两类检索机制和计数状态也能在标准自回归训练下出现。

Insight: CoT可能通过逐步检索和状态更新改善长文本计数，而不只是生成更长的解释。该研究支持一种状态跟踪机制解释，但证据来自特定的针堆计数设置，不能直接推广为所有长上下文任务的通用机制。

Abstract: Large language models (LLMs) have been rapidly improving in long-context tasks, powered by Chain-of-Thought (CoT) reasoning. However, the internal mechanisms underlying this improvement remain unclear. We investigate these mechanisms through a needle-in-a-haystack (NIAH) counting task, where an LLM is asked to count the number of records dispersed in a long text. Across twelve model comparison groups, Thinking (or reasoning) improves counting accuracy over Non-thinking, with pronounced gains at larger counts. This motivates our mechanistic analysis, which identifies two contrasting mechanisms: (i) broad retrieval, where Non-thinking models broadly attend to multiple needles; (ii) targeted retrieval, where Thinking models use enumeration in CoT traces to successively retrieve needles. Targeted retrieval concentrates attention on individual needles and is accompanied by more compact internal representations. Moreover, causal intervention analysis suggests that Thinking models use the CoT trace to maintain and update an internal counter as needles are successively retrieved, even without explicit numbering. In small controlled experiments, both retrieval mechanisms and counter states emerge under standard autoregressive training. Together, our results connect long-context retrieval with representation geometry of counting, supporting a state-tracking account of CoT reasoning.

[194] Understanding as No-Arbitrage: Bounded Dutch Books as a Definition and Training Objective for Language Models cs.AI | cs.CL | cs.LGPDF

Daniel Dragonevskiy

TL;DR: Arbitr把语言模型的“理解”定义为受计算约束的交易者无法利用逻辑相关陈述构造必然获利的Dutch book，并通过对抗训练降低模型概率判断中的逻辑不一致。

Details

Motivation: 仅凭语言流畅或预测准确很难判断模型是否理解其陈述；标准下一词预测可能使同一命题在不同问法下概率不一致，推理链中的不确定性累积还会造成无依据的过度自信。

Result: 论文证明理解程度应是分级的、标准下一词目标的最优解在不同提问形式间仍可能不一致，并分析推理链中的不确定性累积。Arbitr用对抗交易者惩罚逻辑矛盾、用校准锚点避免无信息塌缩；在Qwen2.5和Phi-3.5的五项预注册实验中，它将可利用性降低多个数量级且不损害任务准确率，并迁移到未见逻辑模式和新模型家族。7B模型的近零测量不一致有时伴随极端自信，显示存在评测假象。

Insight: 无套利式一致性提供了一种可计算的理解必要条件，并可转化为训练信号；但逻辑一致并不足以证明模型掌握了知识。衡量不一致时还必须检查校准，避免把过度自信误当成理解。

Abstract: Does a language model merely predict tokens, or does it understand what it says? We make this question measurable by defining “understanding” through the lens of no-arbitrage. A model understands a vocabulary to a certain degree if a computationally bounded trader cannot extract guaranteed profit by betting against the model’s probabilities on logically related claims (a “Dutch book”). We establish three theoretical results: first, because full logical coherence is computationally intractable, understanding is inherently graded, not absolute. Second, we prove that the exact optimum of standard next-token prediction is inherently incoherent across different question formats; the flaw lies in the training objective, not the architecture. Third, we show that uncertainty accumulates predictably along reasoning chains, making unjustified overconfidence an arbitrage opportunity in itself. To address this, we introduce Arbitr, a training framework where an adversarial trader penalizes the model for logical inconsistencies, paired with a calibration anchor to prevent uninformative collapse. Across five pre-registered experiments on Qwen2.5 and Phi-3.5 models, we demonstrate that standard models are highly exploitable across different phrasings. Arbitr reduces this exploitability by orders of magnitude without sacrificing task accuracy, and the effect successfully transfers to unseen logical patterns and new model families. Crucially, we uncover a scaling illusion: at 7B parameters, near-zero measured incoherence often coincides with extreme, unjustified confidence. We conclude that while Arbitr enforces rigorous logical consistency, coherence is a necessary condition for knowledge, but not a sufficient one

[195] Can Computation from Earlier Problems Help LLMs Solve New Ones? cs.AI | cs.CL | cs.LGPDF

Jipei He, Wenhui Tan, Xiaoyi Yu, Enver Sangineto, Fiorenzo Parascandolo

TL;DR: STAIR为历史上下文中的后续问题复用此前生成的键值状态，通过少量可训练参数重定向当前查询，改善多轮对话中独立问题的推理表现。

Details

Motivation: LLM在同一对话里连续解决独立问题时，保留历史有时提高、也有时降低后续准确率。直接丢弃历史会丧失可复用计算，而现有机制尚未充分控制历史对当前问题的影响。

Result: 受控重放分析发现，不同问题—历史配对引起的内部状态变化仍保留当前问题之间相似的关系。STAIR将先前回复生成阶段的键和值缓存到固定记忆库，并训练查询在读取这些状态时进行重定向；基础模型保持冻结，只训练12,288个参数。在三个Qwen模型和四个基准上，相较原模型保留历史时，后续问题平均准确率最高提升11.67个百分点。

Insight: 历史可作为计算记忆复用，但必须控制它如何影响新问题，而不是默认把完整对话一并交给模型。STAIR只训练少量参数展示了轻量适配的可能性，摘要报告的是最高增益，不能当作所有设置的平均提升。

Abstract: Large language models often solve independent problems in the same conversation. Can computation from earlier problems help them solve new ones? To answer this question, we first conduct preliminary experiments showing that retained history can raise or lower later-turn accuracy, even within the same domain. To understand these effects, we use controlled replay to isolate internal state changes specific to each problem-history pairing. Across different histories, these changes preserve similar relationships among current problems. To improve reasoning under retained history, we introduce STAIR (Stale-Token Attention for Inter-query Reuse). STAIR captures keys and values from earlier response generation in a fixed bank. It learns to redirect current queries when they read this bank during prompt processing. The base model remains frozen; only 12,288 parameters are trained. Across three Qwen models and four benchmarks, STAIR improves average later-turn accuracy by up to 11.67 percentage points over the unmodified model with history.

[196] A helps B while B hurts A: directed transfer in instruction-tuning mixture cs.AI | cs.CL | cs.LGPDF

Nima H. Siboni, Vahid Rostami

TL;DR: 论文提出有方向的任务迁移图，估计每个指令微调来源任务对目标任务的正负影响，再据此为目标选择训练混合。

Details

Motivation: 固定预算下选择哪些指令任务进行微调通常依赖试错。常见启发式假设增加来源任务总有益，或认为任务相似度导致的迁移是对称的，但一个任务可能帮助另一个任务、反过来却造成负迁移。

Result: 作者用Qwen3和Mistral的数百次微调运行拟合迁移图，模型规模覆盖0.6B至32B，训练来源均来自同一语料且不使用目标训练样本。预先记录的目标准确率预测误差不到不区分混合的基线一半；在不同模型规模间预先选出的任务混合优于使用全部来源任务。对因果解释、多跳问题和方法论批评等推理目标，准确率最高提高14个百分点。

Insight: 迁移应表示为带方向和正负号的来源—目标关系，而不是任务之间固定的相似度。迁移图依赖具体目标和语料，但在测试的模型规模间可复用；摘要并未声称它可无条件迁移到其他语料。

Abstract: Adapting a language model to a specialized corpus means choosing which instruction-tuning tasks to train on under a fixed budget, and testing one choice costs a fine-tuning run. Common heuristics add more source tasks or pick sources similar to the target. The first assumes transfer is never negative; the second, that it is symmetric. We show that both assumptions fail: task $A$ can help task $B$ while $B$ hurts $A$, so helpfulness is a signed property of ordered source–target pairs. We introduce the transfer map, a signed estimate of how much each source helps or hurts each held-out target. We fit the map in hundreds of fine-tuning runs on Qwen3 and Mistral models from 0.6B to 32B parameters, with all sources drawn from one corpus and no training examples from the target. The map predicts a held-out target’s accuracy on unseen mixtures: recorded before those runs, its predictions have less than half the error of a mixture-agnostic baseline. The map is specific to its target and corpus but transfers across model scale: a mixture selected in advance at one size beats training on all source tasks at every other size we tested. Transfer is thus a property of the data. The map selects the tasks that help and drops the one that interferes: accuracy on the reasoning targets (causal explanation, multi-hop questions and methodological critique) rises by up to 14 percentage points over training on all source tasks.

[197] OverForge: Reasoning Through Strategies and Tactics Helps Cooperative Lifelong Adaptation cs.AI | cs.CL | cs.MAPDF

Oana Madalina Fron, Ojas Shirekar, Chirag Raman

TL;DR: OverForge把协作语言模型代理的长期策略与局部战术分开推理，并通过前瞻模拟和信心判断协调角色分工与动作执行。

Details

Motivation: 长期协作要求代理适应变化环境和陌生伙伴的约定，但把观察直接映射到动作的扁平代理难以区分持续的协作策略与当前战术执行，也容易丢失已经形成的分工。

Result: OverForge无需训练，通过高层角色与分工策略、各代理私有且依赖伙伴的世界模型，以及模拟策略—动作分支的元认知模块实现协调。在OvercookedV2的连通厨房中，它完成7份汤，而扁平LLM基线各完成3份；系统能保持已达成的角色，也能接受陌生伙伴提出的角色。消融、固定策略探测和跨回合记忆重启实验支持策略层与战术层及伙伴记忆对适应的作用。

Insight: 将“如何分工”与“此刻怎么做”分层，有助于在局部动作变化时维持长期协作约定。当前结果基于OvercookedV2环境，尚不足以证明该层级结构可直接泛化到真实多智能体任务。

Abstract: Cooperative language-model agents must coordinate over long horizons and adapt to changing environments and to partners with unfamiliar conventions, yet existing agents map observations to actions without separating persistent coordination strategies from their tactical execution. We introduce OverForge, a training-free hierarchical architecture that separates strategic reasoning over roles and divisions of labour from tactical reasoning over actions within each agent’s private, partner-conditioned world model. A metacognitive Prefrontal Cortex Module couples the two levels by forming strategy-action branches, imagining their consequences with a forward model, and committing when confident. In OvercookedV2, OverForge delivers 7 soups in a connected kitchen versus 3 for each flat LLM baseline, retains agreed roles, and adopts roles proposed by unfamiliar partners. Ablations and a fixed-strategy probe show that persistent strategies guide tactical adaptation while each reasoning level contributes to coordination. Memory restarts show that cross-episode partner knowledge supports task performance and partner prediction, linking the hierarchy to continual adaptation.

[198] Learning Steganography Is Easy, Learning Steganographic Reasoning Is Hard cs.AI | cs.CL | cs.LGPDF

Julian Schulz, Lukas Fülle, Rieke Fruengel

TL;DR: 论文比较隐写消息传递、编码推理与隐写推理的可学习难度，发现隐写推理通常比另外两种能力更难诱导，但特定掩护任务下仍可学会。

Details

Motivation: 通过监控CoT进行AI监督可能被模型的隐写推理绕过。隐写消息和不可读编码推理已能在常见训练压力下出现，因此需要判断隐写推理是否也会随训练意外产生。

Result: 研究比较强化学习、上下文学习和监督微调三种诱导方式。多数任务中，隐写推理只在监督微调下学会，而隐写消息和编码推理在三种方式下都能学会；即使使用监督微调，隐写推理所需训练量至少是消息传递的两倍，部分模型—任务组合仍未学会。但当掩护任务特别便于藏信息时，三种诱导方式都能成功得到较简单版本的隐写推理。

Insight: 模型学会传递隐蔽消息或使用不可读编码，并不意味着它也具备隐写推理；这三种能力需要分别评估。隐写推理虽更难，但在合适的任务条件下仍可能出现，因此监控能力不能只根据较简单隐写能力推断。

Abstract: Chain-of-thought monitoring as an approach for AI oversight and control is threatened by the possibility of steganographic reasoning, where LLMs conceal their reasoning inside innocuous-looking text. Two neighbouring capabilities, steganographic messaging (passing a concealed message) and encoded reasoning (reasoning in an illegible but unconcealed format), have already been shown to emerge under training pressures that occur in real pipelines, such as reinforcement learning against monitors. This suggests that steganographic reasoning too might arise as an unintended side effect of training. Here, we compare how easily models learn steganographic reasoning and these two neighbouring capabilities across three elicitation methods: reinforcement learning, in-context learning, and supervised fine-tuning (SFT). For most tasks, models learn steganographic reasoning only under SFT, while they learn steganographic messaging and encoded reasoning under all three elicitation methods. Even under SFT, steganographic reasoning requires at least twice as much training as messaging, and for several model-task combinations it is not learned at all. However, on a cover task that makes hiding information especially convenient, steganographic reasoning can be successfully learned under all three elicitation methods. Steganographic reasoning is thus much harder than steganographic messaging and encoded reasoning, and learning the latter two does not imply learning the former. Yet it lies within reach: an easy version is learned under every elicitation method, when the cover task is convenient for hiding information.

[199] GrammarRL: Effective Grammar-Constrained Decoding via Reinforcement Learning cs.AI | cs.CL | cs.LGPDF

Gabriele Tuccio, Antonino Furnari, Aldo Gangemi, Misael Mongiovì

TL;DR: GrammarRL用模型自身的正向似然和反向重构似然构造无标签奖励，通过强化学习提升语法约束解码的语义质量。

Details

Motivation: 语法约束能保证输出格式合法，却可能让模型偏好的语义内容与约束冲突，尤其在提示不充分或指令能力较弱时；束搜索可部分缓解，但成本随宽度增加，序列概率也不等同于语义质量。

Result: GrammarRL在语法约束生成轨迹上以RLOO优化两种互补奖励，并把最高束搜索候选纳入训练，同时向冻结基础模型正则化。在1B至8B的Llama模型上，手语手势词翻译、层次文本分类和命名实体识别任务平均提升9.8分、最高提升22.8 BLEU；三项任务中两项达到或超过束搜索，同时保持贪心解码成本。单独使用任一奖励可能低于未训练基线，组合奖励则稳定改善。

Insight: 格式正确性与语义质量需要同时优化；输入重构能力可补充受约束输出的条件似然，组合后比单一自监督信号更稳健。结果覆盖三类任务，摘要没有给出每项任务的具体指标分布。

Abstract: Grammar-constrained generation guarantees syntactic validity, but can substantially degrade semantic quality when the model’s preferred outputs are poorly aligned with the imposed grammar. This trade-off is particularly severe when the prompt is underspecified or the model has limited instruction-following ability. Beam search can partially mitigate these failures by exploring multiple valid sequences, but its computational cost grows with beam width, while sequence-level probability is only an imperfect proxy for semantic quality. We introduce GrammarRL, a label-free reinforcement learning method that adapts language models to grammar constraints without requiring annotated data. GrammarRL optimizes the model using two complementary self-supervised rewards derived from its own likelihoods: a direct reward, measuring how likely the constrained output is given the input, and a reverse reward, measuring how well the input can be reconstructed from the generated output. We optimize these rewards with a Reinforce Leave-One-Out (RLOO) objective over groups of grammar-constrained rollouts, augmented with the top-1 beam-search hypothesis and regularized towards a frozen base model. We evaluate GrammarRL on sign language gloss translation, hierarchical text classification, and named entity recognition using Llama models ranging from 1B to 8B parameters. GrammarRL consistently outperforms constrained greedy decoding, with an average improvement of 9.8 points and gains of up to 22.8 BLEU. It matches or outperforms beam search on two of the three tasks while preserving greedy-decoding inference cost. Ablations further show that the two rewards are complementary: either reward alone can underperform the untrained baseline, whereas their combination consistently improves upon it.

[200] UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement cs.AI | cs.CVPDF

Fang Wu, Da Xing, Yanjie Huang, Junxi Wang, Ji Wang

TL;DR: UniEvo-VL让单个多模态模型在测试时分别扮演教师和学生，用自我批评作为特权上下文进行在线策略蒸馏，提升图像生成能力。

Details

Motivation: 统一多模态模型能够生成内容并理解自己的结果，可从自我反馈改进；常规蒸馏需要额外且可能更大的教师，而模型自我批评是否可作为有效监督仍待验证。

Result: 学生只看原始问题，教师上下文还包含自我批评；训练在学生采样轨迹上最小化两者扩散分布的逐状态差异。基于Qwen-Image-2512，GenEval从0.747升至0.808，GenEval2 Soft-TIFA从32.97升至35.53。更强外部评审提示潜在自我进化上限更高，但不同文本渲染任务表现并不一致。

Insight: 让同一模型通过上下文分工提供自监督，可避免始终依赖外部教师，并利用测试时计算开展递归改进。收益并非在所有生成能力上均匀发生，特别是文本渲染存在差异。

Abstract: Modern multimodal models bring generation and understanding into a single unified system, which enables them to provide and learn from their own feedback. Motivated by this unified capacity, we introduce UniEvo-VL, a self-evolving framework for multimodal models to learn from this constructive self-correction feedback during test-time compute. Instead of relying on a separate, often larger, teacher, we leverage their self-critiques as privileged information and ask a single multimodal model to act as both teacher and student with different contexts. The student only sees the vanilla question, while the teacher conditions on the privileged critique. Then training minimizes the per-state divergence between their denoising diffusion distributions over the student’s own sampling trajectories. Experiments demonstrate that UniEvo-VL improves the image generation capabilities of multimodal models, while maintaining their sensitivity to additional reflection information. Specifically, we build on top of the open-source Qwen-image-2512 and observe a significant performance gain from 0.747 to 0.808 on GenEval and from 32.97 to 35.53 on GenEval2 Soft-TIFA. Moreover, attempts with more powerful external critics (e.g., GPT5.6-Luna) show that multimodal models with strong judge capabilities can anticipate a higher self-evolving ceiling. Last but not least, mixed text-rendering outcomes show that our self-improvements may not be uniform across different tasks. Our study aims to shed light on the current hot recursive self-improvement research line to enhance the user experience when using multimodal models without external supervision or guidance.

cs.CR [Back]

[201] SecureVibe: Making Vibe Coding More Secure cs.CR | cs.CLPDF

Danqing Wang, Baolin Peng, Zhepei Wei, Isadora White, Wenlin Yao

TL;DR: SECUREVIBE通过安全计划、编码和测试监督训练代码智能体，并用执行反馈和提示自监督强化其发现隐藏安全风险的能力。

Details

Motivation: Vibe coding生成的程序即使功能正确也可能含安全漏洞。作者发现，不安全智能体在隐藏安全风险方面进行有效规划和测试的概率不到安全行为所需水平的一半。

Result: SECUREVIBE包括四类安全任务的监督微调，以及基于可验证执行反馈的强化学习SECUREVIBE-RL和基于提示的自监督SECUREVIBE-HG。在四个基准、两类安全编码任务上超过基线：BaxBench安全pass@1提高6.9分；未见CWE类别的SusVibes提高11.5分。安全任务SusVibes功能pass@1同时提高13.6分，通用SWE-bench Verified提高4.1分。分析显示，覆盖安全规划、编码和测试的多样监督比单加编码轨迹更有效；当智能体安全能力不足以从结果反馈学习时，提示引导监督尤其有价值。

Insight: 代码安全需要计划与测试行为的直接训练，单纯增加编码演示不足以培养风险审查。提示引导自监督可在能力较弱时提供额外学习支架，同时保持功能性表现。

Abstract: As vibe coding becomes increasingly capable and widespread, security vulnerabilities in even functionally correct solutions are a growing concern. When investigating functionally correct but insecure solutions, we find that the insecure agent is less than half as likely to conduct effective planning and testing for the hidden security risks behind the functional requirements. Motivated by this, we develop SECUREVIBE, a training recipe that explicitly targets planning and testing for code security. SECUREVIBE constructs training signals around these security behaviors. It includes supervised fine-tuning on the security suite with 4 security tasks, and post-training methods, SECUREVIBE_rl and SECUREVIBE_hg, to enhance security capabilities from verifiable execution feedback and hint-based self-supervision. Our SECUREVIBE outperforms the baseline on two types of security coding tasks across 4 benchmarks. Specifically, SECUREVIBE improves the security pass@1 by 6.9 points on BaxBench. The gains extend to unseen CWE categories, with improvements of 11.5 points on SusVibes. Meanwhile, it also improves functionality pass@1 by 13.6 points on the security coding task SusVibes and 4.1 points on the generic coding task SWE-bench Verified. Further analysis offers two practical insights: (i) diversifying supervision across security planning, coding, and testing strengthens security behaviors more effectively than adding coding trajectories alone, and (ii) hint-guided supervision is particularly valuable when the agent’s existing security capabilities are insufficient to learn effectively from outcome feedback.

cs.DC [Back]

[202] Taming Speculative Search for Test-Time Scaling in LLM Serving cs.DC | cs.CL | cs.OSPDF

Jinwoo Jeong, Woohyung Choi, Myeongjae Jeon, Jeongseob Ahn

TL;DR: SpecScale通过早剪枝、候选路径计算去重和延迟细粒度验证，降低LLM测试时推理的推测式搜索开销，同时提升服务吞吐并降低延迟。

Details

Motivation: 测试时扩展通过额外推理计算提升数学和编程等难题准确率，推测执行可加快路径探索，但服务系统会遭遇候选路径爆炸以及频繁、细粒度的候选验证任务。

Result: SpecScale在推理服务中引入低质量路径提前剪枝、冗余候选间的计算去重，以及推迟细粒度验证三项技术，以平衡延迟与计算开销。在MATH和奥赛等推理基准上，系统优于非推测方法和近期推测方法，提升吞吐、降低延迟，同时保持答案质量；摘要未给出具体数值。

Insight: 测试时搜索的效率不仅取决于更快地产生候选，也取决于何时验证、如何共享重叠计算。系统级剪枝与调度可改善服务成本，但摘要没有披露具体硬件、工作负载和增益幅度。

Abstract: Test-time scaling has recently emerged as a powerful approach for improving LLM reasoning by allocating additional computation during inference, substantially enhancing accuracy on challenging tasks such as mathematics and coding. To accelerate the exploration of reasoning paths, recent studies proposed speculative execution. However, we show that supporting speculative execution poses two unique challenges for LLM serving systems: (1) an explosion in the search space of candidate paths and (2) frequent, fine-grained verification tasks for candidates. To address these challenges, this paper proposes SpecScale, a serving system for efficient speculative execution. We introduce three techniques to reconcile the trade-off between latency and computational overhead: (1) early pruning of low-quality candidate paths, (2) deduplicating computation across redundant candidate paths, and (3) deferring fine-grained verification tasks. We evaluate SpecScale on challenging reasoning benchmarks, including MATH and Olympiad. Our results show that SpecScale significantly outperforms both non-speculative and recent speculative approaches, delivering substantial improvements in throughput and latency while preserving answer quality.

cs.HC [Back]

[203] NarrativeSteward: Coordinating Delegation, Guidance, and Verification in Agent-Assisted Interactive Narrative Authoring cs.HC | cs.AI | cs.CLPDF

Wenjin Wang, Jiazhen Lei, Yuxin Sha, Nuwa Xi, Meng Zhao

TL;DR: NarrativeSteward将大纲、世界设定和叙事图作为关联工件组织起来，帮助作者协调AI代理的委派、指导与结果核验。

Details

Motivation: 代理可自主生成和修改大量互动叙事内容，但作者难以同时掌握全局结构、局部细节及其关系，因而难以持续提出有效指导或确认修改是否符合意图。

Result: 系统结合代理对话、跨项目结构审阅、变更记录、恢复机制和执行诊断。技术测试验证了变更记录、恢复和诊断功能；12名参与者的被试内研究显示，相较通用代理，NarrativeSteward更利于提出修改请求、检查变更，并提升参与者对变更和故事结构的主观理解。

Insight: 作者指导代理的关键不仅是生成能力，也包括能否审阅跨层级成果并核验执行变化。研究表明关联工件和变更可见性有助于协作，但用户研究规模为12人，结论主要反映该系统和研究设置下的体验。

Abstract: Autonomous AI agents can turn authors’ goals into interactive narratives by independently organizing and carrying out generation and revision. As agents generate and revise extensive content, authors struggle to grasp its overall structure, local details, and relationships, complicating continued guidance. We present NarrativeSteward, an authoring environment that organizes outlines, worldbuilding, and narrative graphs as linked artifacts for agent implementation and author guidance. Agent dialogue and project-wide structural review help authors understand the evolving work and guide local and cross-layer revisions, while change records and execution verification help authors assess the resulting work. Technical tests validated the system’s change records, recovery mechanisms, and execution diagnostics. In a 12-participant within-subject study, NarrativeSteward supported easier formulation of revision requests and inspection of changes, and greater perceived understanding of changes and story structure, than general-purpose agents. Qualitative findings show how reviewing the work and feedback helps authors develop requirements and guide subsequent delegation. We open-source NarrativeSteward at https://github.com/Tencent/NarrativeSteward.

[204] EmAvatar: Multimodal Empathetic Response Generation via Conflict Resolution and Expressive Guidance cs.HC | cs.CV | cs.MMPDF

Xiaolin Chen, Xuemeng Song, Jinlan Fu, Weili Guan, Mong-Li Lee

TL;DR: EmAvatar先识别并消解语音、文字和面部之间的情绪冲突，再生成带表达指令的文本脚本，指导同步合成语音与说话头像视频。

Details

Motivation: 多模态共情回应生成可能忽略不同模态间的情绪矛盾，缺少明确的合成指导，且早期错误会沿文本、音频和视频生成链传播。

Result: 系统通过冲突检查器和证据收集器进行多轮问答以形成有证据支持的情绪判断，再生成文本与表达指令组合脚本，并迭代检查修订后再合成音视频。在四类任务上，实验显示其优于现有先进方法；摘要没有提供具体指标数值。

Insight: 先显式核对模态间证据，再生成可供下游使用的表达脚本，有助于减少情绪误判及错误传播。当前摘要支持整体效果优于基线，但未揭示各任务的增益大小。

Abstract: Avatar-based multimodal empathetic response generation has emerged as a pivotal capability in human-centric systems, aiming to recognize user emotions and synthesize responses with synchronized text, audio, and talking-face video. Despite recent progress, existing methods still suffer from three critical limitations: (1) overlooking conflicting emotions across modalities, (2) lacking explicit multimodal synthesis guidance, and (3) neglecting inherent error propagation of multimodal response generation. To address these limitations, we propose EmAvatar, a novel framework for precise emotion perception and expressive response generation. It first performs deliberative multimodal emotion recognition by exposing inter-modal prediction conflicts and then initiates a multi-round QA process between a Conflict Inspector and an Evidence Collector to gather evidence for conflict resolution, leading to a robust, evidence-aware prediction. Regarding response generation, EmAvatar first synthesizes a composite script that couples the textual response with an expressive instruction. Moreover, to ensure high-quality synthesis, an iterative refinement mechanism evaluates and revises the script until it aligns with predefined criteria, serving as reliable guidance for subsequent audio and video synthesis. Extensive experiments across four tasks demonstrate that EmAvatar outperforms state-of-the-art methods. Our code will be publicly released.

cs.LG [Back]

[205] Hermes: Learning Contextual Reasoning Unlocks Test-Time Scaling cs.LG | cs.AI | cs.CLPDF

Xinyu Li, Mononito Goswami, Hao Liu, Nikos Kanakaris, Langlin Huang

TL;DR: Hermes把跨上下文窗口的计算分配和信息复用交给模型学习，并用Hermes-Learn训练能依据问题与推理进度自适应调度上下文的策略。

Details

Motivation: 测试时计算扩展需跨多个上下文窗口安排计算和传递信息，但现有方法通常由外部harness规定何时开新窗口、保留哪些内容。

Result: Hermes提供一组可配置harness，逐步增加模型对上下文分配和复用的控制；Hermes-Learn通过两阶段训练学习上下文推理。强模型可利用灵活性随额外推理预算提升表现，小型开源模型初始难以掌握。训练后模型获得随问题特征和推理进展改变的上下文策略；收益跨基准、模型泛化，外推到训练时未见的推理预算，并迁移到其他测试时扩展方法。摘要未列出具体得分。

Insight: 测试时扩展的核心不只是增加推理预算，还要学会在哪个窗口继续推理以及传递何种状态。可学习的上下文控制能够超越固定的外围调度，并适配其他扩展框架。

Abstract: Test-time scaling improves model performance by allocating additional compute during inference. Using this compute effectively across multiple context windows requires deciding how to allocate fresh contexts and what information to carry between them. We call a model’s ability to make these decisions contextual reasoning. Existing approaches largely prescribe these decisions through their harness; we instead shift them to the model. We introduce 1) Hermes, a family of simple, configurable harnesses that progressively varies model control over context allocation and reuse, and 2) Hermes-Learn, a two-stage framework for learning these capabilities. We find that capable models can exploit this flexibility to scale with additional inference-time compute, while smaller open-source models initially struggle to do so. Training with Hermes-Learn closes this gap, inducing adaptive contextual reasoning strategies that vary with both the problem and the progress of reasoning. These gains generalize across benchmarks and models, extrapolate beyond the inference-time compute seen during training, and transfer to complementary test-time scaling methods beyond Hermes.

[206] On the Off-Policy Teacher in On-Policy Distillation cs.LG | cs.AI | cs.CLPDF

Langlin Huang, Hao Liu, Mononito Goswami, Xinyu Li, Prithwith Jana

TL;DR: SCOUT通过强化学习适配教师，使教师能从学生生成的前缀继续推理，修复在线策略蒸馏中学生轨迹对教师而言属于离策略的问题。

Details

Motivation: 在线策略蒸馏里轨迹由学生生成，因此对学生是on-policy，但对通常只训练过自身前缀的教师却是off-policy。学生前缀越长，教师继续生成表现越差，可能削弱蒸馏监督质量。

Result: SCOUT在常规OPD更新之外，周期性用可验证奖励RL优化教师对学生前缀的条件续写能力：教师从学生生成前缀续写，并按结果奖励学习。受控实验显示该更新确实提升教师从学生前缀继续的能力；多个教师—学生组合、模型规模和推理领域中，SCOUT持续提高OPD效果。摘要未列具体增益数值。

Insight: 教师在自身前缀上表现良好，不代表能可靠评价学生产生的状态。通过条件化适配教师到学生前缀，可减少教师—学生分布失配，使稠密监督更贴合实际学生轨迹。

Abstract: On-policy distillation (OPD) has recently emerged as a promising post-training paradigm in which the student learns from trajectories generated by its own policy under dense teacher supervision. However, OPD introduces a fundamental asymmetry: although the sampled trajectories are on-policy for the student, they are off-policy for the teacher. The teacher is typically optimized to continue from prefixes generated by its own policy, but during OPD it must instead supervise prefixes generated by the student. Empirically, we find that its continuation performance degrades as these prefixes grow longer. To address this issue, we propose Student-COnditioned Updates of the Teacher (SCOUT), a co-training framework that adapts the teacher to student-generated prefixes. Alongside standard OPD updates, SCOUT periodically optimizes the teacher’s conditional ability using reinforcement learning with verifiable rewards, where the teacher generates continuations from student prefixes and learns from outcome rewards. Controlled experiments show that SCOUT improves the teacher’s ability to continue from student-generated prefixes, supporting the intended mechanism of student-conditioned teacher adaptation. Across multiple teacher–student configurations, model scales, and reasoning domains, SCOUT also consistently improves the effectiveness of on-policy distillation.

[207] What Pretraining and Midtraining Make Learnable from Rewards? cs.LG | cs.AI | cs.CLPDF

Chiwun Yang, Xiaoyu Li

TL;DR: 研究分析预训练和中训练如何提供奖励适应所需的信息与可执行计算，并区分获取信息、执行操作和学会任务奖励使用。

Details

Motivation: 奖励可以标出答案是否正确，却未必说明新输入所需计算方式。作者研究预训练、中训练和奖励反馈分别如何补足任务信息及执行能力。

Result: 在序贯状态计算和上下文记忆任务中，作者刻画出能在所有训练奖励上表现一致、却对留出输入给出不同答案的机制歧义；与任务无关的源观察可消除该歧义。研究从指定随机初始化构造有限采样Adam路径，分析同一参数如何先通过源预测获得执行或检索，再经奖励适应学会任务化使用。Qwen2.5预训练检查点实验中，八个world任务里，正确源信息及首个操作监督的序贯模型成功率82.61%，私有随机源控制为44.15%。记忆回放保留奖励适应中的检索能力；独立八任务验证为75.32%，匹配的替代检索训练为49.86%。GSM8K和HotpotQA分析分别考察奖励介入时准确率、后续提升和最终表现。

Insight: 奖励信号本身不足以决定正确计算过程，预训练或中训练需先提供源信息与可执行机制，奖励再学习如何调用。将三种作用分开分析有助解释何种能力能被奖励适应获得。

Abstract: A reward can identify a correct answer while leaving the computation needed for new inputs undetermined. We study how pretraining and midtraining supply the information and computation that make reward adaptation effective. In sequential state computation and contextual memory, we characterize mechanisms that agree on every training reward yet demand different held-out answers. Task-independent source observations resolve this ambiguity. We construct finite sampled Adam paths from specified random initializations through source prediction and reward adaptation in the same parameters, proving how prediction acquires execution or retrieval and rewards learn their task-specific use. Experiments with pretrained Qwen2.5 checkpoints test this division of labor. Across eight worlds, Sequential models trained with correct source and first-operation supervision reach 82.61% success, versus 44.15% for a private-random source control. Memory replay preserves retrieval during reward adaptation, and an independent eight-world confirmation achieves 75.32% task success versus 49.86% after matched alternative-retrieval training. GSM8K and HotpotQA separate accuracy at reward entry, subsequent gain and final performance. Together, these results connect information acquisition, executable computation and reward-guided task learning.

[208] Evaluating Persistent Calibration under Evolving Model Knowledge cs.LG | cs.AI | cs.CLPDF

Victor Wang, Thomas Hofweber, Mohit Bansal, Elias Stengel-Eskin

TL;DR: 研究定义持续校准：不依赖重复监督，使置信度估计器在模型知识随检查点变化时仍忠实反映其能力。

Details

Motivation: 能够持续适应和学习的AI系统，其置信度也需随知识变化更新；只在单个检查点上校准的估计器可能在模型学会或忘记事实后失效。

Result: 作者比较在较早检查点训练的置信估计器能否推广到后续模型，并定义知识对照集：挑选某个检查点回答正确、另一个回答错误的问题，直接测量知识改变时的校准。推理时和微调校准方法在该指标上都不及用未来检查点训练的oracle，即使它们在全数据集上校准良好。分析提出，一个检查点上存在大量不同但都校准良好的置信函数，只有依赖元知识特征的一部分能跨检查点泛化。多检查点训练可改善知识对照集校准。

Insight: 总体ECE良好不保证置信度跟随模型知识变化。通过跨检查点对照样本测量校准，并在多检查点上训练，可能筛选出对知识动态更稳健的置信特征。

Abstract: As AI systems move from static repositories to agents that are capable of continual adaptation and learning, maintaining their trustworthiness means equipping the models backing them with the ability to produce confidence estimates that dynamically reflect their changing skills and knowledge. We introduce the problem of persistent calibration, which requires a confidence estimator to faithfully reflect the knowledge contained in a model as that knowledge changes, without recurring supervision. We operationalize this by examining persistent calibration across checkpoints of open models, asking whether confidence estimators trained on earlier checkpoints can generalize to later ones. Specifically, we aim to shed light on whether confidence is dependent on knowledge, a question with implications for the reliability of confidence estimates. To measure this relationship, we define and evaluate calibration on knowledge contrast sets: subsets containing questions that one checkpoint answers correctly and another checkpoint answers incorrectly, reflecting a change in knowledge. We show that both inference-time and fine-tuning methods fall short on contrast-set calibration compared to oracle methods trained on future checkpoints, even for methods that are well-calibrated on the full dataset. We provide evidence for the hypothesis that persistent calibration is challenging because there is a vast space of possible confidence functions that are well-calibrated on a given checkpoint, out of which only some rely on meta-knowledge features that would generalize to other checkpoints. Towards improving contrast-set calibration, we show that multi-checkpoint training helps, suggesting an avenue for identifying confidence features that remain robust across changing knowledge.

[209] Blackboard Intelligence Can Surpass Autoregressive on Globally Constrained Problems cs.LG | cs.CLPDF

Woosang Jeon, Jaeyeon Kim, Sham Kakade, Yilun Du, Amrit Singh Bedi

TL;DR: Blackboard以固定、可修订工作画布和扩散语言模型进行任意顺序候选搜索，在全局约束问题上超过同规模自回归推理。

Details

Motivation: 下一token自回归推动了LLM发展，但复杂全局约束任务中可能难以维持整体一致。作者考察局限是否部分来自必须按左到右顺序逐token提交的推理接口。

Result: Blackboard将推理视为在固定可修订画布上搜索候选解状态，而非沿因果序列提交答案；扩散语言模型天然可对部分填充状态进行任意顺序预测。模型内部平均置信度用于估计整体连贯性并指导推理搜索和修订。在ZebraLogic、Nurse Rostering、Job-Shop Scheduling上，固定微调LLaDA-8B-Instruct检查点即可提升推理，并超过同规模自回归基线：ZebraLogic-Hard准确率90.4%，护士排班精确可行率76.4%，JSSP最优率80.2%。更强自回归搜索和细化仍未弥补ZebraLogic-Hard差距；Blackboard在该任务及JSSP还超过规模大得多的前沿LLM。

Insight: 全局约束问题可能更适合保留和反复修订多个部分状态，而不是早早固定逐token路径。扩散模型的任意顺序预测与置信引导搜索提供了不同于增加自回归推理长度的测试时扩展方式。

Abstract: Next-token prediction has driven remarkable progress in large language models, yet a growing body of evidence suggests that they can struggle on problems governed by complex global constraints. In this work, we focus on this regime and ask whether some of these limitations arise from the inference interface induced by next-token prediction itself. We study this question through blackboard intelligence: an inference-time perspective in which a model works on a fixed, revisable canvas and searches over candidate solution states rather than committing to a causal, left-to-right trajectory. We instantiate this idea with diffusion language models, whose any-order prediction interface naturally exposes predictions over partially filled solution states. Our key observation is that mean confidence, a simple model-internal quantity available from the standard masked diffusion objective, provides a useful proxy for global coherence and can guide inference-time search and revision. Empirically, across ZebraLogic, Nurse Rostering, and Job-Shop Scheduling, Blackboard consistently improves inference while holding the fine-tuned LLaDA-8B-Instruct checkpoint fixed and substantially outperforms same-scale autoregressive baselines, reaching 90.4% accuracy on ZebraLogic-Hard, 76.4% exact feasibility on Nurse Rostering, and 80.2% optimality on JSSP. Stronger autoregressive search and refinement also fail to close the gap on ZebraLogic-Hard, while Blackboard surpasses tested frontier LLMs there and on JSSP despite their substantially greater scale and strong test-time reasoning. We open-source our codebase at https://github.com/jwoosang1/blackboard-intelligence.

[210] K2P: Label-Free Knowledge to Prompt Distillation cs.LG | cs.CLPDF

Yingchuan Zhang, Haoran Lu, Wenxuan Zhong, Ping Ma

TL;DR: K2P通过教师解答生成并迭代优化可复用提示，再用师生答案一致性筛选提示，使冻结学生模型在无标注条件下获得推理能力提升。

Details

Motivation: 无标签蒸馏虽可避免更新学生权重，却仍依赖未经验证的教师解答；若师生共享错误，仅按教师答案对齐也可能强化错误。现有提示优化还可能低估自适应搜索发现的候选。

Result: 在多种推理任务和学生模型上，K2P总体优于其他无标签方法，并接近有监督提示优化。论文将提示生成与筛选误差分开分析，并给出在教师参考不完美时、一致性引导仍能提供准确率保证的条件；消融和归档诊断还揭示了教师解答与迭代优化的作用及一致性筛选的局限。

Insight: 方法把教师知识蒸馏到部署时可直接使用的提示中，学生无需再访问教师或更新参数。答案一致性可以作为低成本筛选信号，但它不是教师答案正确性的证明，因此需要保留候选并在独立问题上选择。

Abstract: Knowledge distillation can transfer reasoning from stronger teachers to frozen students through reusable prompts, but avoiding weight updates does not eliminate supervision. Without ground-truth answers, teacher solutions are unverified, and agreement with the teacher can reward shared mistakes. We introduce Knowledge-to-Prompt (K2P) for label-free knowledge distillation to prompts. K2P synthesizes reusable instructions from teacher solutions, refines them using paired teacher and student responses, and guides search and selection with answer agreement. It retains candidates that adaptive search may undervalue and selects on reserved questions. Deployment uses only the frozen student and selected prompt. Our theory separates generation and selection gaps and gives conditions under which agreement-guided construction yields accuracy guarantees despite imperfect teacher references. Across reasoning tasks and students, K2P outperforms label-free alternatives overall and remains competitive with supervised prompt optimization. Ablations and archive diagnostics assess the contributions of teacher solutions and refinement, while revealing the limits of agreement-guided selection.

[211] RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures cs.LG | cs.CLPDF

Yuyang Wu, Yufeng Du, Hao Peng

TL;DR: 论文扩展RoPE长上下文理论并提出RoPE Profiler，用缓存的查询和键激活诊断语义逆转与位置不敏感，再据此调整高频分量。

Details

Motivation: RoPE可能在保持语义偏好稳定与区分相近位置之间产生内在权衡，导致长上下文失败；仅看任务总分难以判断具体模型头和输入应修复哪类缺陷。

Result: 新理论允许不同RoPE频率具有不同查询/键尺度，并给出特定条件下固定注意力分数比较无法同时避免语义逆转和位置不敏感的上下文长度界。Profiler复用评测时缓存激活，无需额外前向计算；49个设置显示推理任务更易发生语义逆转、检索任务更易位置不敏感。定向高频重缩放无需训练，在Qwen3-8B和Llama-3.1-8B-Instruct上最高分别提升20和25个百分点。

Insight: 长上下文问题需要分类型诊断：语义稳定和位置区分不是同一故障。复用激活可低成本定位后再做定向调整，但报告的最高提升来自特定模型与任务设置。

Abstract: Long-context failures of RoPE-based language models can arise from RoPE’s intrinsic tradeoff between maintaining stable token preferences and distinguishing nearby positions. Determining which weakness to address, and how, requires a more precise characterization of RoPE’s behavior in trained models across context lengths. We address a key limitation of prior theory by allowing unequal query-key scales across RoPE frequencies, which aligns well with practical empirical observations. Our theory makes both vulnerabilities measurable for individual heads and inputs, and quantifies how high-frequency components support positional sensitivity while potentially disrupting semantic stability. We also derive a theoretical context-length bound beyond which, under specified conditions, a fixed attention-score comparison cannot jointly avoid semantic reversal and positional insensitivity. Guided by our fresh theoretical insights, we introduce RoPE Profiler, a lightweight, plug-and-play diagnostic toolkit that augments existing evaluations with zero additional forward passes by reusing cached query and key activations. Reusing activations collected during evaluation, the toolkit incurs little overhead. It supplements standard benchmark scores with two diagnostic scores that reveal semantic and positional weaknesses and help users prioritize which aspect to address. Crucially, our evaluations across 49 long-context task settings reveal a distinct pattern where reasoning tasks predominantly suffer from semantic reversal, whereas retrieval tasks are primarily vulnerable to positional insensitivity. Guided by our theory and diagnostic profiles, targeted high-frequency rescaling achieves immediate gains without additional training, improving task accuracy by up to 20 percentage points on Qwen3-8B and 25 percentage points on Llama-3.1-8B-Instruct.

[212] PhantomEnvironments: Training LLM Agents in Fictional Worlds cs.LG | cs.AI | cs.CLPDF

Anmol Kabra, Swathi Saravana Selvam, Albert Gong, Chao Wan, Christian Belardi

TL;DR: PhantomEnvironments用纯规则生成的虚构世界训练多轮搜索代理，无需LLM生成环境或真实世界知识，仍能迁移到真实多跳检索任务。

Details

Motivation: 强化学习训练代理需要可验证奖励、长程交互和低成本环境；人工构建环境昂贵，而LLM生成环境可能引入幻觉或基准污染。

Result: 代理在虚构世界的模板文章库中搜索以回答多跳问题，环境由规则生成且边际生成成本为零。尽管虚构语料不含真实世界事实，训练所得代理仍可迁移到真实多跳搜索基准，在较新的基准上常优于使用真实世界训练数据；还可泛化到未见虚构宇宙。Qwen模型会随问题难度近似线性调整搜索预算。消融显示，跳数比约束或比较结构更能驱动迁移。

Insight: 训练搜索策略所需的可验证结构可能比真实知识内容更关键，规则环境因此可成为低成本训练资源。迁移结论针对多跳搜索任务，不能推断虚构环境能替代所有真实数据训练。

Abstract: Training LLM agents with reinforcement learning (RL) is bottlenecked by environments, which must provide verifiable rewards, support long-horizon interaction, and scale cheaply. Existing approaches rely on costly human-curated data or on LLM-generated environments that risk hallucinations and benchmark contamination. We show that LLMs can instead be trained into capable search agents using synthetic environments generated entirely by rules, whose generation requires no LLM and has zero marginal cost. We build PhantomEnvironments, multi-turn RL environments from fictional worlds, where agents must search a corpus of templated articles to answer multi-hop questions. Despite sharing no facts with the real world, these strikingly simple environments yield agents that transfer to real-world multi-hop search benchmarks, often outperforming real-world training data on newer benchmarks. Trained agents generalize to unseen fictional universes, and Qwen models learn to scale their search budget roughly linearly with question difficulty, suggesting emergent search scaling from environment interaction alone. Ablating environment complexity reveals that hop count drives transfer more than constraints or comparisons: even the simplest rule-generated environments are a surprisingly effective, free resource for training generalizable LLM agents.

[213] Distribution Matching Distillation for Continuous Diffusion Language Models cs.LG | cs.CL | stat.MLPDF

Paul Le Van Kiem, Dario Shariatian, Umut Simsekli, Alain Durmus

TL;DR: Simplex-DMD和Reinforce-DMD利用连续扩散语言模型的概率词元输出做反向KL分布蒸馏，以更少网络评估次数保持生成质量。

Details

Motivation: 连续扩散语言模型可并行生成全部词元，但高质量结果仍需数百次网络评估；降低采样计算需要结合学生概率输出设计有效的梯度估计。

Result: 统一框架导出连续词元松弛的路径梯度方法Simplex-DMD，以及类别采样、结合学习到的密度比和REINFORCE的方法Reinforce-DMD。在OpenWebText的1,024词元生成中，Simplex-DMD用4次评估达到生成困惑度45.6、词元熵5.44 nat，相同熵和预算比较下比最强扩散基线少49%困惑度；Reinforce-DMD在256次评估时达到困惑度14.9、熵5.00 nat，较同协议基线少20%。

Insight: 学生输出参数化方式决定蒸馏梯度估计和计算—质量前沿，两种策略分别适合较小与较大评估预算。报告是在固定语料、序列长度和熵匹配协议下的比较。

Abstract: Continuous diffusion language models generate all tokens in parallel, yet high-quality generation can still require hundreds of network evaluations (NFEs). We study how distributional distillation can reduce this cost by exploiting the student’s probabilistic token outputs. Our unified formulation connects the student’s output parameterization to the resulting gradient estimators and yields two methods with the same student architecture and reverse-KL matching objective: Simplex-DMD uses continuous token relaxations and pathwise gradients, while Reinforce-DMD uses categorical sampling and REINFORCE with a learned density ratio. We develop both methods for multi-step generation and investigate the training and sampling choices associated with each parameterization. On OpenWebText, for sequences of 1,024 tokens, Simplex-DMD achieves a generative perplexity of 45.6 at a unigram entropy of 5.44 nats in just 4 NFEs, a 49% reduction relative to the strongest evaluated diffusion baseline at matched entropy and sampling budget. Reinforce-DMD improves the frontier at larger budgets, reaching a generative perplexity of 14.9 at an entropy of 5.00 nats with 256 NFEs, a 20% reduction under the same comparison protocol.

[214] cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents cs.LG | cs.AI | cs.CLPDF

Pranjal Aggarwal, Lawrence Keunho Jang, Sean Welleck, Daniel Fried, Ruslan Salakhutdinov

TL;DR: cua-speedrun提供统一虚拟机、执行流程和代理接口，对计算机操作代理的速度、成本及其受推理强度和环境延迟的影响进行可复现评测。

Details

Motivation: CUA在多个长程基准上能力突出，但速度和成本仍限制部署；现有基准的机器和容器配置各异，使执行速度比较难复现且容易被环境因素混淆。

Result: 研究在四个CUA基准上比较推理强度、代理框架和环境延迟。没有一个模型家族同时占据能力、速度和成本三项前沿，开源模型均未进入综合前沿；提高推理强度有时反而加速任务，而更快的环境I/O有时会延长总完成时间。多数基准可缩减任务集而不损失整体统计效力。

Insight: 代理速度不只由模型计算决定，工具框架和环境时延也会改变总时长；因此需要统一基础设施，并区分模型推理与交互开销。任务集缩减可提高评测效率，但需保持统计检验能力。

Abstract: Computer use agents (CUAs), which use graphical user interfaces (GUIs) to complete tasks on a computer, have recently surpassed human performance on many standard benchmarks, including difficult long-horizon tasks. Their capabilities are undoubtedly impressive, however, a key barrier to the widespread adoption and deployment of CUAs remains their speed and cost. Progress towards faster yet capable CUAs requires reliable evaluation of their speed, but many CUA benchmarks currently face a reproducibility crisis. Benchmarks are based on complex infrastructure with varying machine and container configurations that confound the evaluation of the execution speed of CUAs. Towards addressing this gap, we propose cua-speedrun, which introduces standardized infrastructure and task sets, with a focus on evaluating the speed and efficiency of CUAs. cua-speedrun uses a uniform virtual machine setup and execution pipeline, along with a common agent interface that enables single-agent implementations to operate seamlessly across different benchmarks. Across four different CUA benchmarks, we evaluate how reasoning effort, agent harnesses, and environment latency affect performance, speed, and cost. We find no single model family is optimal for all three; none of the open-weight models are on the frontier, and also, unintuitively, for some models increasing the reasoning effort can speed up task completion, while faster environment input-output can slow down overall task completion time. We also demonstrate that we can effectively reduce the evaluation task set of most CUA benchmarks without degrading overall statistical power, allowing for more efficient benchmarking and comparison. We believe cua-speedrun will enable structured progress towards fast, efficient CUAs, unlocking new real-world use cases and applications. All code, infrastructure, and analysis are available at https://cuaspeedrun.com.

[215] Scaling Laws for Looped Mixture of Experts cs.LG | cs.AI | cs.CLPDF

Yanbei Chen, Anirudh Goyal, Raghuraman Krishnamoorthi

TL;DR: Loop Scaling Laws联合刻画循环深度、MoE稀疏度、模型规模和数据规模，预测循环MoE的损失并辅助在算力与内存约束下设计模型。

Details

Motivation: 循环Transformer以固定参数增加计算深度，MoE以固定激活计算扩大总容量，两者具有互补性，但既有缩放定律分别研究循环或稀疏度，不能指导联合设计。

Result: 提出有界且依赖稀疏度的循环映射，预测循环模型留出损失优于先前方法，并将稠密和标准MoE缩放律纳为特例。下游评估中，稀疏性带来约3倍激活参数效率，循环在推理任务带来约2倍总参数效率；联合缩放继续推进性能前沿。万亿词元规模、等训练计算下，按定律选择循环次数的MoE可在推理基准匹配参数约大2倍的非循环MoE，并支持测试时循环扩展。

Insight: 循环与稀疏度可以共同分配训练容量和推理计算，而非只能单独扩展。缩放律提供了系统设计依据，但报告的效率倍数依赖对应模型、基准和算力匹配设置。

Abstract: Looped transformers and Mixture-of-Experts (MoE) offer complementary routes to efficient scaling: recurrence increases computational depth at fixed parameters, while MoE sparsity expands total capacity at fixed active compute. Yet existing scaling laws model recurrence or sparsity in isolation. In this work, we introduce Loop Scaling Laws, the first scaling law to jointly model recurrence and sparsity alongside model size and data. At its core is a bounded, sparsity-conditional recurrence mapping that characterizes the effective-parameter gain from looping and how sparsity raises this gain. The laws predict the held-out loss of looped models more accurately than prior alternatives, and recover the standard dense and MoE scaling laws as special cases. Beyond prediction, the fitted laws provide a principled foundation for designing looped MoE models under compute and memory constraints. Downstream evaluations further demonstrate the complementary benefits of the two axes: sparsity delivers ~3x active-parameter efficiency, recurrence yields ~2x total-parameter efficiency on reasoning, and joint scaling further advances the performance frontier. As a practical extension, we show these gains hold at trillion-token scale: at matched training compute, a looped MoE with law-derived recurrence matches a ~2x larger non-looped MoE on the reasoning benchmarks, while enabling test-time scaling through recurrence.

[216] Semifactual Credit-Augmented Policy Optimization cs.LG | cs.AI | cs.CLPDF

Junshu Pan, Zhizhang Fu, Shulin Huang, Yiran Ding, Zifan Cheng

TL;DR: SCAPO用保持问题与答案不变的反事实提示干预测量词元稳定性，并据此细化强化学习信用分配，减少模型对无关提示特征的依赖。

Details

Motivation: 可验证奖励强化学习虽改善推理，但模型输出仍可能受任务无关的提示表面特征影响。GRPO把同一结果优势赋给回复中的所有词元，可能同时奖励有用推理和不稳定的伪相关依赖。

Result: SCAPO对固定回复在半事实干预下的词元概率漂移打分，早期训练降低较不稳定词元的优势，但不会仅因稳定性额外奖励。在Qwen3-4B-Base和1.7B-Base上，AIME 2024—2026准确率较GRPO分别提高5.63和4.17个百分点；多数数学基准及全部评估的分布外基准上也取得比较方法中的最佳结果。

Insight: 保持语义不变的提示变化可作为因果启发的稳定性信号，辅助定位哪些生成步骤更值得信用。该方法目标是降低脆弱依赖，而非把表面稳定本身当作正确推理。

Abstract: Reinforcement learning with verifiable rewards (RLVR) has improved the reasoning capabilities of large language models (LLMs), yet their predictions remain sensitive to task-irrelevant prompt features. We investigate this sensitivity through semifactual prompt interventions that preserve the underlying problem and its answer. Our analysis reveals substantial variation in token-level sensitivity and shows that suppressing high-drift token candidates during decoding improves reasoning accuracy without updating model weights. These findings highlight a limitation of Group Relative Policy Optimization (GRPO), which assigns the same outcome-derived advantage to every response token and may reinforce potential spurious dependence alongside useful reasoning. Motivated by this observation, we introduce Semifactual Credit-Augmented Policy Optimization (SCAPO), a causally inspired variant of GRPO that incorporates semifactual stability into token-level credit assignment. SCAPO measures token probability drift for fixed responses under semifactual interventions and uses normalized stability scores to reduce advantages for relatively unstable tokens during early training, while granting no additional credit for stability alone. On Qwen3-4B-Base and Qwen3-1.7B-Base, SCAPO improves AIME 2024-2026 accuracy over GRPO by 5.63 and 4.17 percentage points, respectively. At both model scales, SCAPO achieves the best results on most evaluated mathematics benchmarks and all evaluated out-of-distribution benchmarks among the compared methods. These results suggest that semifactual stability provides an effective training signal for improving reasoning and generalization through finer-grained credit assignment in RLVR. The code is available at https://github.com/DtYXs/SCAPO.

[217] Ranking-Aware Prompt Optimization for Multimodal Clinical Diagnosis cs.LG | cs.CL | cs.CVPDF

Tian Xia, Minghao Liu, Yiqing Liang, Laixi Shi, Jiayun Wang

TL;DR: Ranking-PE以正负样本成对排序替代逐例准确率来优化多模态临床提示，使候选提示直接按AUROC排序能力选择。

Details

Motivation: 临床数据类别不平衡时，恒预测多数类即可获得很高准确率，却没有临床区分能力。现有反思式提示进化依据逐例正确率打分，优化方向与不受阈值和类别比例影响的AUROC不一致。

Result: Ranking-PE在提示搜索的Pareto比较、逐例反馈和最终候选选择三处都使用正负病例成对排序分数，使平均值等于经验AUROC，无需额外模型调用或代理损失。在MIMIC三个疾病任务上，较准确率驱动方法，微调Qwen3-VL-8B提升5.8 AUROC百分点，MedGemma-4B提升16.2个百分点；消融还表明医疗级视觉骨干是必要基础，提示搜索无法替代。

Insight: 提示优化目标应与临床评价指标一致，成对排序能把AUROC直接嵌入搜索流程。性能提升依赖具备足够医学能力的视觉骨干，单靠搜索策略无法弥补基础表征不足。

Abstract: Multimodal large language models (MLLMs) are rapidly advancing clinical diagnosis, yet their adaptation pipelines remain anchored to accuracy-based objectives. Clinical data are heavily class-imbalanced: a constant-majority predictor can score above 90% accuracy while being clinically useless. We therefore evaluate and optimize for AUROC, a threshold-free score that ranks positives above negatives and is invariant to class balance. We focus on prompt optimization in MLLMs. Reflective methods such as GEPA use a binary scores matrix with one row per evaluation instance and one column per candidate prompt; cells record per-instance correctness, so the column average is accuracy and drives candidate selection. We introduce pair-level Pareto prompt evolution (Ranking-PE), which replaces each correctness row with a pairwise-ordering row over (positive, negative) instance pairs: the cell is 1 if the candidate scores the positive higher than the paired negative. The column average then equals empirical AUROC (by the Wilcoxon-Mann-Whitney identity). We apply this swap at all three layers the prompt evolution search reads from - the scores matrix that decides Pareto dominance, the per-example feedback to the reflection LM, and final candidate selection - at no extra model calls and with no surrogate loss. Across three diseases on MIMIC, accuracy-based prompt evolution can degrade ranking; Ranking-PE reverses this, beating the accuracy-based recipe by +5.8 AUROC pp on fine-tuned Qwen3-VL-8B and +16.2 pp on MedGemma-4B. Ablations examine each design component and show that a medical-grade visual backbone - via vision-encoder-tuned SFT or medical pretraining - is a prerequisite that prompt search cannot replace - our recipe extends reflective prompt evolution from text-only data to multimodal clinical decision-making.

[218] Does Gradient Conflict Predict the Understanding–Generation Trade-off? A Controlled Audit of Conflict-Metric Validity in Unified Multimodal Models cs.LG | cs.AI | cs.CVPDF

Shuyang Jiang, Fucheng Deng, Yuchuan Luo, Zhenyu Wu

TL;DR: 论文在可精确计算理解—生成权衡的受控测试床上审计梯度冲突指标，发现方向性冲突不能可靠预测最终权衡，功能干扰和训练损失更有信息。

Details

Motivation: 统一多模态模型常以降低理解与生成目标间的梯度冲突作为优化目标，但这类指标是否能预测最终下游权衡此前缺乏直接检验。

Result: 在GRIDUMM的63种配置和372个检查点中，没有方向性冲突指标与最终权衡达到绝对Spearman相关0.3且置信区间排除零。逐步压低冲突的干预也未改变权衡，区分了相关性与因果性；生成能力成熟后，范数比指标失去作用。功能干扰指标优于方向性指标，训练损失则与最终权衡更紧密相关。

Insight: 冲突值下降不能自动证明模型权衡改善，作为诊断目标前必须验证其预测效度。研究并未断言冲突指标毫无价值，而是指出需要区分真正功能干扰与梯度方向统计量。

Abstract: Unified multimodal models (UMMs) are increasingly designed around gradient conflict between understanding and generation objectives. The premise that reducing these metrics improves the downstream understanding-generation trade-off has never been tested directly. We audit it in a controlled testbed, GRIDUMM, which mirrors key structural ingredients of UMM training while making the ground-truth trade-off exactly computable. Across 63 configurations and 372 measured checkpoints, no directional conflict metric reaches an absolute Spearman correlation of 0.3 with a confidence interval excluding zero for conflict measured during training against the eventual trade-off. A dose-response intervention that monotonically suppresses conflict leaves the trade-off flat, separating correlation from causation. The norm ratio is a generation-failure detector and becomes null among configurations that master generation. Functional interference measures outperform directional conflict metrics, while training loss tracks the trade-off strongly. Our results do not show that conflict is useless; they show that its validity as a diagnostic target must be established, not assumed, and we release the audit protocol as a reusable standard.

[219] World-as-Graph: Relational World Modeling Through Latent Space Graphs cs.LG | cs.CVPDF

Yaqi Yang, Shuo Huang, Yujin Huang, Fucai Ke, Jiatong Han

TL;DR: World-as-Graph为对象中心世界模型加入随时间变化的潜在关系图，并将邻居关系与历史记忆结合以预测未来场景。

Details

Motivation: 对象中心世界模型已能表示场景中的对象状态，但对象间关系常被隐式编码，限制了关系结构、时间动态和对象级记忆的显式建模。

Result: WAG从对象槽位构造时变潜在图，并用关系感知的对象遮挡学习关系表示；对象中心记忆转移模块融合邻居关系和历史状态，进行自回归未来预测。作者在视觉推理和机器人操作任务上进行了实验，报告方法表现优于对比方案，但摘要没有给出具体任务指标和增益。

Insight: 世界状态不只由对象组成，也由对象间关系及其随时间的变化组成；显式图结构可为预测学习提供关系归纳偏置。当前结果是跨任务的定性优势，量化效果仍需查看完整实验。

Abstract: World models aim to learn representations of real-world environments and predict their future evolution. Recent object-centric world models have made expressive progress by representing visual scenes as sets of object-level latent states, but object-object relations are often captured only implicitly, which limits explicit relational and temporal structure modeling and object-centric dynamic memory modeling. To address such challenges, we propose World-As-Graph (WAG), a graph-based object-centric world model that introduces relational inductive bias into JEPA-style predictive representation learning. The proposed WAG contains two main modules: (1) Relation-aware structure induction, which constructs time-varying latent graphs from object-centric slots and designs relation-aware object masking policies to guide relational object representation learning in latent space; (2) Object-centric memory transition, which maintains and updates object-level dynamic states by combining relational information from neighboring objects with historical memory, enabling effective autoregressive future prediction. Extensive experiments on both visual reasoning and robotic manipulation tasks could demonstrate the superior performance of our proposed WAG.

[220] Mutual Equilibrium: Multimodal Representation Learning through Reciprocal Feedback cs.LG | cs.CVPDF

Ho-min Park, Byungkon Kang

TL;DR: MEQ通过两种模态间持续互相反馈来更新耦合嵌入，并把交互达到的固定点作为最终表示，用于多模态分类和视觉定位。

Details

Motivation: 简单拼接不同模态表示不能显式刻画彼此补充的信息如何逐步影响对方；多模态理解需要表示能随跨模态反馈共同细化。

Result: MEQ包含相互接收对方输出的两个组件，并提供理论分析解释模型及避免失败的设计选择。在多个数据集的分类与视觉定位任务上，分类表现优于或接近基于拼接的多模态方法；定性结果显示，互补模态可推动视觉定位逐步细化。摘要未给出具体数值。

Insight: 跨模态融合可建模为反复交互直至平衡，而非一次性拼接。现有结果包括定量分类比较和定性定位表现，尚不能据摘要判断在所有任务上的稳定优势。

Abstract: This work proposes a mutual feedback architecture, MEQ, that refines the two inputs, of possibly different modalities, into a pair of coupled embeddings such that each embedding reflects the information of the other. The core idea is to incorporate continuous interchange of information between the two inputs. This idea leads to a mutual feedback architecture consisting of two components whose outputs are fed back into the other. The final output of this model is defined as the fixed point of this interaction. We provide theoretical analysis that offers interpretation of this model as well as design choices to prevent failure cases. We show the benefits of MEQ through classification and visual grounding tasks spanning various datasets. Quantitatively, our model outperforms or shows competitive performance on concatenation-based multimodal classification problems. Qualitatively, the proposed interactive mechanism allows the model to progressively refine the visual grounding when paired with complementary modality, thus demonstrating the power of mutual feedback under such settings.

[221] Prototype-Rule Neurosymbolic Regularization for Rank-Constrained Tensor Neural Networks under Label Scarcity cs.LG | cs.CVPDF

Eftychios Protopapadakis, Konstantinos Makantasis, Konstantinos M. Giannoutakis

TL;DR: 论文将可微原型规则加入低秩张量网络，在标签稀缺的高光谱分类中约束类别几何，并可在推理时融合原型证据与神经网络输出。

Details

Motivation: 低秩张量网络能减少高阶输入的参数量，却不直接约束学习表示中的类别结构；在标注稀缺且空间泄漏风险高时，额外的可解释归纳偏置可能有帮助。

Result: 框架以原型正则增强Rank-R训练目标，并可选地融合推理证据。四个高光谱基准在七折分层和空间隔离划分下评估，另测试每类2至20个样本的支持预算。空间评估中，完整神经符号推理使Macro-F1在Botswana、Indian Pines、Pavia University分别提升8.82、5.49、1.59个百分点，在Salinas下降0.62个百分点；收益主要来自训练正则，推理融合较小且依赖数据集。

Insight: 原型规则作为训练期归纳偏置比单纯在推理期加权原型证据更有贡献，且不同场景收益并不一致。空间分隔评估能减少相邻像素泄漏造成的虚高结果。

Abstract: Rank-constrained tensor neural networks reduce the parameterization of high-order inputs, but they do not explicitly constrain class geometry in the learned representation. This study investigates whether a differentiable prototype-rule can provide a complementary inductive bias for Rank-R tensor learning under limited supervision. The proposed framework augments the Rank-R objective with prototype-based regularization and optionally fuses prototype evidence with neural logits at inference. Four hyperspectral benchmarks are evaluated with four Rank-R configurations under both seven-fold stratification and spatially separated folds that mitigate leakage; a separate spatial study varies the class support budget from 2 to 20 samples. Under spatial evaluation, full neurosymbolic inference changes Macro-F1 score by +8.82 percentage points on Botswana, +5.49 on Indian Pines, +1.59 on Pavia University, and -0.62 on Salinas. Most of the benefit arises from training-time regularization, whereas inference fusion is small and dataset dependent.

cs.LO [Back]

[222] What Was Said, Not What Was ‘Thought’: Type-6 Logic for CoT Verification cs.LO | cs.AI | cs.CLPDF

Adrian de Wynter

TL;DR: Type-6逻辑将LLM思维链建成带不确定性和重复算子的推理图，检验无根据修订、隐含前提、循环和错误主张等结构问题。

Details

Motivation: 表面启发式难识别思维链内部推理是否有效，也不能区分陈述内容与模型真实“想法”。作者需要能表达当代CoT动态并可形式校验的逻辑框架。

Result: Type-6是扩展动态认知逻辑，加入不确定性和重复两个算子；验证器将CoT转为图并按公理、推理规则检查，支持可视化。四类形式和非形式推理划分中，派生矛盾是语料里最常见的硬失败，且仅约3%的命题会影响最终推导。不同验证器不可互换：LLM评审与LINC一致性κ约0.034，换底层模型后仍如此；Type-6在受测方法中得到最高一致认可。作者证明验证器平均情况线性时间。

Insight: 推理轨迹中很多陈述并不参与最终推导，逐步形式校验可定位真正影响结论的结构错误。不同CoT评估方法捕捉的对象不同，低一致性说明不能用单一评审器替代形式结构检查。

Abstract: We introduce Type-6 logic, a variant of dynamic epistemic logic augmented with two operators (uncertainty and recurrence), designed to model the inferential dynamics of contemporary large language model (LLM) chain-of-thought (CoT) reasoning. Type-6 accounts for common LLM reasoning pathologies such as unlicensed revision, enthymemes, loopbacks, and unverifiable/incorrect claims. We propose a verifier based on Type-6 logic that builds a graph out the trace, and checks it against Type-6’s axioms and inference rules. We evaluate our framework on LLM-generated CoTs four splits spanning formal and informal reasoning. Our verifier detects structurally unsound reasoning steps that surface-level heuristics miss, and allows for easy visualisation of the model’s reasoning process. In our corpus, our verifier shows that derived contradiction is the most common hard-fail category in CoT, and that only about 3% of the propositions of a trace have impact on the final derivation. Ablation studies show that other verification methods (LLMs-as-judges, other neurosymbolic approaches, etc.) cannot be considered interchangeable: for example, agreement between LLMs-as-judges and LINC is $κ\approx 0.034$, and this persists within a method across underlying models. Type-6, however, is the most agreed-with method amongst the ones we tested. We prove our verifier runs on average-case linear time; and release our logic specification and artefacts.

cs.RO [Back]

[223] BIND: Binding 3D Robot Actions to 2D Image Features cs.RO | cs.CVPDF

Cameron Smith, Arsh Tangri, Vitor Guizilini, Yue Wang, Zubair Irshad

TL;DR: BIND把候选三维末端执行器位置投影到各摄像头图像，并将其绑定的二维视觉特征一同评分，以改善机器人动作的数据效率与视角鲁棒性。

Details

Motivation: 常见机器人策略把全局视觉特征直接回归为三维动作，需要仅凭示范学会动作与图像空间位置的对应关系，因而对相机视角和物体位置细微变化脆弱且数据效率低。

Result: BIND离散化候选末端位置，并依据相机几何关联各视图中的预训练图像特征，策略再选择位置—特征组合。真实机器人实验覆盖示范效率、未见物体位置和视角、长程任务及灵巧操作；仅用5次示范时多个任务仍接近完美成功率，而坐标回归基线在剧烈视角变化和留出物体位置下完全失败，BIND则平稳退化。

Insight: 预训练视觉特征的空间鲁棒性只有与动作几何显式绑定后，才更容易转化成稳健控制。结果强调几何关系可由相机模型提供，无需完全依赖策略从有限示范中学习。

Abstract: We introduce BIND, a new action representation for visuomotor robot policies that binds 3D robot actions to their corresponding 2D image features, yielding strong data efficiency gains and robustness to out-of-distribution object positions and camera viewpoints. The action heads of current robot policies are typically formulated as an MLP regression from a single global feature vector produced by a pre-trained vision encoder. This global formulation requires the policy network to discover, from demonstrations alone, the relationship between target robot actions and the image features they project onto. The consequence is that although modern image features are semantically descriptive, spatially robust, and even multiview-consistent, the policies built on them are brittle to subtle changes in camera viewpoint and object placement–and surprisingly data-inefficient. BIND closes this gap by supplying the action-feature relationship through camera geometry rather than learning: it discretizes a volume of candidate end effector positions, attaches each candidate to the pre-trained features at its projection in each camera view, and selects actions by scoring each candidate’s position and image-bound feature combination. On a real robot, we study data efficiency and out-of-distribution robustness to unseen object positions and camera viewpoints, as well as general long-horizon task execution and dexterity. We find BIND to be highly data-efficient and robust: it achieves near-perfect success on tasks with as few as 5 demonstrations, and degrades gracefully under steep camera-viewpoint shifts and held-out object positions where coordinate-regression baselines completely fail.

[224] What to Attend, What to Keep: Skill-Conditioned Visuotactile Representation with Progress-Guided Event Memory cs.RO | cs.CVPDF

Amir-Hossein Shahidzadeh, Seungjae Lee, Eadom Dessalene, Shanthosh Raaj Mohanram Mageswari, Soroush Etemad

TL;DR: 该方法按机器人原语技能调节视觉—触觉融合，并查询保留最近技能终态的稀疏事件记忆，以便依据任务进度决定关注什么、记住什么。

Details

Motivation: 操作过程中视觉适合引导接近，触觉随时间变化则决定抓取、对齐和接触；现有多模态策略常固定融合方式和时间上下文，忽略不同技能阶段的信息需求变化。

Result: 技能条件表示融合各模态短时观察词元，并关注最近K个已执行技能的终止观测形成的事件记忆。在三个接触丰富任务的进度估计中，滑移检测延迟相对微调SOTA降低87%，扭转完成延迟相对纯视觉消融降低67.5%，盲搜任务进度误差通过稀疏记忆降低92%；收益集中于接触或历史决定完成条件的情形。

Insight: 多模态表征如何形成与融合，本身就是策略设计的核心问题；传感器贡献会随技能进度变化。保留少量事件终态可补足当前观测不足，但结果来自三类特定操作任务。

Abstract: Robotic manipulation integrates vision, touch, and language, whose importance shifts across stages: vision guides reaching, while touch, through its evolution over time, decides grasping, alignment, and contact. Yet existing multi-modal manipulation policies typically use fixed temporal contexts and fusion strategies, despite shifts in what each modality contributes across different skills. We study how vision and touch should be combined at the level of primitive skills, asking what each skill needs from each sensor, and propose a skill-conditioned representation in which the queried skill conditions fusion over modality-specific short-term observation tokens while attending to a sparse event memory that retains terminal observations from the last $K$ executed skills. Evaluated by skill progress estimation on three contact-rich tasks, it reduces slip-detection delay by 87% against fine-tuned SOTA progress models, twist-completion delay by 67.5% against a vision-only ablation, and progress error on a blind search task by 92% through sparse event memory. Gains concentrate exactly where completion is defined by contact or task history. More broadly, our results suggest that observation formation not only policy architecture is a central challenge in multi-modal representation. Project Website: http://what-to-attend-what-to-keep.github.io/

[225] Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidance cs.RO | cs.CV | cs.LGPDF

Yanyan Zhang, Disheng Liu, Xinpeng Li, Chaoda Song, Mohsen Hariri

TL;DR: ReGuide以无需训练的包装器结合物体语义和几何重绑定，在组合变化下把VLA动作引向示范支持的目标配置，并让冻结策略继续执行。

Details

Motivation: 机器人示范数据缺乏对物体、目标位置和背景组合的多样覆盖，端到端VLA可能利用无关视觉捷径，难以把已学局部技能组合到未见配置。模型常保留接近目标的局部操作能力，却缺少正确的全局指代落地。

Result: 给定定位模块提供的物体位姿，ReGuide重新绑定语义与几何，引导末端执行器到指令对象的示范支持配置，无需修改骨干或重新训练。在多种VLA骨干的模拟实验和真实机器人实验中，组合分布变化下成功率最高分别提升56.8和75.0个百分点，同时保持标准任务表现。

Insight: 组合泛化失败可能来自全局指代落地，而不是所有局部控制技能都需要重学；外部几何引导可让冻结策略在熟悉局部状态恢复执行。摘要报告最高增益，实际收益会随组合变化和骨干而异。

Abstract: While Vision-Language-Action (VLA) models enable flexible action generation, their generalization across diverse environmental elements, including manipulated objects, destinations, and backgrounds, is limited by the lack of diversity in robotic training data. Trained end-to-end on such data, VLAs tend to exploit visual shortcuts, associating actions with task-irrelevant visual features rather than the intended task semantics. These shortcuts block recomposition of elements already seen by the policy, that is, compositional generalization. Existing approaches mitigate such entanglement through task-relevant perception or targeted data diversification, but offer no explicit mechanism for unseen recomposition and require backbone-specific modifications with retraining. We observe that under such recomposition, VLAs often fail at global grounding while retaining local manipulation skills that recover near the correct target in familiar configurations. Therefore, we propose Referential Guidance (ReGuide), a training-free wrapper that, given object poses from a grounding module, combines semantic and geometric rebinding to guide the end-effector into demonstration-supported configurations of the instructed referent, where the frozen policy can resume execution. Experiments in simulation across multiple VLA backbones as well as on a real robot show that ReGuide improves success rates under compositional shifts by up to 56.8 and 75.0 percentage points, respectively, while preserving standard-task performance.

[226] Exploiting Vulnerabilities: Universal Adversarial Attacks on Vision-Language-Action Models in Robotics cs.RO | cs.CR | cs.CVPDF

Songhua Yang, Ziyu Liu, Yuanwei Liu, Xuetao Li, Xuanye Fei

TL;DR: 论文提出带优化纹理的通用对抗物体，通过机器人视野内的单个球体干扰VLA模型的规划、执行和动作控制。

Details

Motivation: 视觉语言动作模型直接与物理环境交互，小幅视觉脆弱性也可能导致严重失败；现有安全评估需要考察攻击能否跨任务影响端到端操作。

Result: 多层攻击同时针对轨迹规划、任务执行和动作控制，并在仿真及真实机器人中验证。对Pi0和RDT两种代表模型，通用对抗物体使平均任务成功率下降31.2%至39.9%；复杂场景中成功率接近零。

Insight: 优化后的实体视觉干扰可跨多个决策环节影响机器人策略，说明VLA安全风险会从感知传播到控制。结果覆盖两种模型和仿真、实机设置，不能据此断言所有VLA同样脆弱。

Abstract: Recently, Vision-Language-Action (VLA) models have revolutionized robotic manipulation by seamlessly integrating visual perception, language understanding, and action generation in an end-to-end learning framework. However, since these models are designed to interact directly with the physical world and humans, their security is critical, and even small vulnerabilities can lead to catastrophic failures. In this work, we propose the Universal Adversarial Object, a sphere with optimized surface texture that significantly degrades task success rates when placed within the robot’s field of view. Specifically, our approach introduces a multi-level attack framework that jointly disrupts trajectory planning, task execution, and action control. We validate our method in both simulated and real-world robotic settings. Experimental results demonstrate that the adversarial object reduces the average task success rates by 31.2%-39.9% for two representative VLA models (Pi0 and RDT), with success rates dropping to near zero in complex scenarios. Index Terms–Vision-Language-Action models, adversarial attack, robotic security, universal adversarial object

[227] The Planning Limits of Latent World Models cs.RO | cs.CVPDF

Ali Alrasheed, Basim Azam, Naveed Akhtar

TL;DR: 论文实测冻结视觉世界模型用于机器人规划的有效距离，发现短预测轨迹只支持近目标规划，远目标需更长想象或反馈式子目标。

Details

Motivation: 世界模型可在想象中预测环境变化并辅助机器人规划，但模型能做什么的演示并未说明预测何时足以指导动作、距离多远时会失效。

Result: 作者评估五种冻结自监督视觉骨干的动作条件预测器。在五步训练长度下，模型仅能可靠排序5至10个控制步外的动作，而真实目标常在16至53步外；将预测器放大81倍或训练更长轨迹都未扩大范围。即使使用真实模拟器完美预测，目标从5步变20步时成功率也从92%降至41%。远目标成功率依次为纯想象23%、MPC反馈30%、想象至目标47%、近距离专家子目标76%。在规划距离适当时，模型还可把VLA成功率从65%提高到77%。

Insight: 规划瓶颈不只是预测误差，即便预测完美，有限视野也限制远期动作排序。系统应按可规划范围设置近子目标或闭环反馈，不能假设扩大模型就能解决长程规划。

Abstract: World models offer a promising way to help robots understand how the physical world evolves and plan complex behaviours through imagination. Yet existing studies mainly demonstrate what these models can accomplish, leaving unclear when their predictions remain useful for planning and where they fail. We study this question using action-conditioned predictors built on five frozen self-supervised visual backbones: V-JEPA 2, V-JEPA 2.1, VideoMAEv2, VideoPrism, and DINOv2. We use frozen backbones to test representations intended to transfer across environments. We evaluate these models on diverse Meta-World manipulation tasks and real-robot interactions from BridgeData V2. We find that a world model guides action selection reliably only when the goal lies within, or slightly beyond, the trajectory it imagines during planning. With five-step rollouts, the length the predictor was trained on, the world model ranks actions reliably only for targets five to ten control steps ahead, whereas task goals lie 16 to 53 steps away. Neither an 81-fold larger predictor nor longer-rollout training extends this range; the encoder affects both range and closed-loop success, with V-JEPA 2.1 performing most consistently. More fundamentally, the limit persists under perfect prediction: using the real simulator, success falls from 92% to 41% as the target moves from five to twenty steps ahead of a five-step rollout. Planning therefore requires either longer imagined trajectories or closer subgoals. For distant goals, pure imagination succeeds in 23% of episodes, planning with feedback (MPC) raises success to 30%, imagining as far as the goal to 47%, and nearby expert subgoals to 76%. Used within its plannable range, a world model can also improve a vision-language-action (VLA) policy: choosing among eight actions the VLA proposes raises its success from 65% to 77% across 16 different tasks.

[228] MotionWeave: Learning Motion-Centered Future Dynamics for Vision-Language-Action Policies cs.RO | cs.CV | cs.LGPDF

Jingqiu Wang, Yan Wang

TL;DR: MotionWeave用动作条件查询在当前视觉特征中定位各未来时刻的交互区域，再将相邻时域差分形成的运动线索注入动作块预测。

Details

Motivation: VLA世界模型若预测未来图像，可能引入与控制无关的外观细节；整体视觉表征或共享动作特征又难以建立每个时间步动作与局部视觉变化的对应关系。

Result: AIMG依据动作和本体感觉为不同预测时域构造查询，HRC提取交互表示随时域的差异并门控注入动作词元。训练时用未来帧渲染的机械臂掩码提供运动定位监督，推理只需当前观测。在六个MetaWorld任务上，平均成功率75.3%，比π0的66.7%高8.6个百分点，持续交互任务收益尤其明显。

Insight: 未来运动监督可以聚焦与控制相关的局部变化，而不必预测完整未来画面。该设计在推理时不依赖未来观测，但当前实验集中于六个模拟操作任务。

Abstract: Vision-Language-Action (VLA) models have recently incorporated world models to provide richer dynamic supervision beyond sparse action labels. However, explicitly predicting future images or videos may include control-irrelevant appearance, while guidance derived from holistic future visual representations and shared global action features may fail to establish timestep-specific correspondence between actions and local visual changes. To address this issue, we propose MotionWeave, a motion-centric future-dynamics framework for action-chunk prediction with two modules: the Action-Induced Motion Grounder (AIMG) and the Horizon Residual Composer (HRC). Specifically, AIMG conditions on action and proprioceptive representations to construct horizon-specific queries that localize interaction regions associated with each future action timestep from current visual tokens. HRC extracts differences between interaction representations at adjacent horizons, encodes them as temporal motion cues, and injects them into action tokens through a gated residual. During training, robot-arm masks rendered from future frames are used to construct KL-based motion-grounding supervision, while inference uses only the current observation. On six MetaWorld tasks, MotionWeave achieves a 75.3% average success rate, an absolute gain of 8.6% over π0 (66.7%), especially on sustained-interaction tasks. Our code is available at https://github.com/autu-mn/MotionWeave.

[229] UniWAM Technical Report: Unified Mobile Manipulation via Mixed-Stream World-Action Modeling and Manipulation Anchor Pose Supervision cs.RO | cs.CVPDF

Wei Xue, Keliang Liu, Mingzhang Cui, Jinhua Xie, Jinjie Wei

TL;DR: UniWAM用共享主干和独立导航、操作动作流统一移动操作策略，并通过自动生成的大规模操作锚点位姿数据监督导航停靠位置。

Details

Motivation: 移动操作先要导航至可操作姿态，再与物体交互，两阶段动作空间和视觉需求不同；同时，采集带明确操作就绪位姿标注的真实导航数据成本高且难扩展。

Result: UniWAM共享表示主干但为导航与操作设置不同编码器和输出头，可分别或并行推理。MAP-Data从大型3D场景自动构造超过150万回合、7,500小时数据，并提供目标框和图像平面锚点位姿监督。在MAP-Bench上，位置误差和朝向误差较最强外部基线分别改善30.1%和44.0%；24项真实机器人任务中，导航和移动操作表现领先，操作性能也具竞争力。

Insight: 统一策略不必强迫导航和操作共用同一动作表示，任务专属的图像平面监督可共享底层感知。合成规模化锚点数据补足了真实导航数据难以标注的问题。

Abstract: Mobile manipulation requires precise navigation to a manipulation-ready pose followed by reliable object interaction. These two stages differ in action spaces and visual requirements, which complicates unified policy learning. In addition, collecting diverse real-world navigation data with explicit manipulation-ready pose supervision remains costly and difficult to scale. We introduce UniWAM, a unified mixed-stream world-action model with separate action encoders and output heads for navigation and manipulation, sharing a common backbone. This design supports joint representation learning on independently sampled navigation and manipulation data. UniWAM supports independent inference for either stream and batch-parallel inference for both. We further introduce Manipulation Anchor Pose (MAP) supervision for where to stop and how to orient for manipulation. An automated pipeline constructs MAP-Data from large-scale 3D scenes, yielding over 1.5 million episodes and 7,500 hours. MAP-Data provides per-frame target-object bounding boxes and image-plane MAP coordinates as auxiliary navigation supervision. Together with projected end-effector trajectories for manipulation, these prediction targets provide stream-specific image-plane supervision for action learning from egocentric observations. With large-scale MAP-Data, UniWAM outperforms the strongest external baselines on our MAP-Bench by 30.1% in position error and 44.0% in heading error. Across 24 real-robot tasks, UniWAM achieves leading results in MAP navigation and mobile manipulation, with competitive manipulation performance. We have released code, data, and benchmark.

[230] Multi-Link Safety Filtering for VLA Policies Around Moving Hazards cs.RO | cs.CVPDF

Yatharth Agarwal, Vijay Raghunathan

TL;DR: 训练免费的多连杆安全过滤器用RGB-D感知和光流追踪移动障碍，并在每条VLA动作执行前检查夹爪、腕部和前臂的碰撞风险。

Details

Motivation: VLA可能完成目标任务却撞倒周边物体，单看任务成功不足以证明部署安全；安全层还需覆盖整条机械臂、追踪移动障碍，并控制边缘设备上的计算开销。

Result: 安全盾以五个椭球近似机械臂连杆，用一个障碍禁入椭球和屏障程序过滤动作，光流持续追踪其位置。在六种仿真移动障碍条件下，碰撞率从65.62%降至27.27%，无碰撞任务成功率从29.35%升至50.43%。CPU屏障运行P99为2.2毫秒；整合GPU上的π0.5策略调用从343毫秒降至177.3毫秒。真实SO-101机械臂中，16次加盾试验有3次触碰障碍，未加盾为11次。

Insight: 运行时安全过滤可在不重训VLA的情况下约束动作，连杆级保护和障碍运动跟踪都很重要。实机测试规模为四项任务共16回合，结果支持可行性但样本仍有限。

Abstract: A vision-language-action (VLA) policy can finish a manipulation task while knocking over objects unrelated to it, so task success alone does not show that the policy is safe to deploy in clutter. We study how to keep a pretrained VLA policy clear of such hazards at run time without retraining it, which requires guarding more of the arm than the end effector, following the hazard as it moves, and sharing onboard compute with the policy. Our training-free shield covers the gripper, wrist, and forearm with five ellipsoids and filters every commanded motion through one barrier program against a keep-out ellipsoid fitted from RGB-D perception at reset. Sparse optical flow then carries that ellipsoid’s center along with the hazard, with no repeated detection or refitting. Over six simulated hazard-motion conditions, the shield lowers collision from $65.62%$ to $27.27%$ and raises safe-success, task completion without collision, from $29.35%$ to $50.43%$. Ablations show that guarding the arm links protects beyond end-effector shielding, and that tracking recovers most of the protection lost when the hazard estimate is frozen at reset. On heterogeneous edge hardware, the five-ellipsoid barrier runs on the CPU in $2.2$~~ms at the 99th percentile, and trimming the vision–language prefix and taking fewer flow-matching steps shortens each $π_{0.5}$ policy call on the integrated GPU from $343$ to $177.3$~~ms. On a physical SO-101 arm across four tasks, the arm touched the hazard in 3 of 16 shielded episodes versus 11 of 16 unshielded ones. Project page: https://yathag.github.io/multilink-safety-filter/

[231] Ego4WAM: What Matters When Scaling Egocentric Human Data for Robot Learning? cs.RO | cs.CVPDF

Zhihao Sun, Liu Liu, Xinjiang Wang, Haoyi Jiang, Wei Feng

TL;DR: Ego4WAM在统一世界—动作模型中系统分析第一人称人类视频的对齐度、时长、多样性和监督方式如何影响机器人学习。

Details

Motivation: 第一人称人类视频能规模化提供经验，但人与机器人动作和视角的对齐程度、行为覆盖及监督信息各异；仅观察数据量增加后的趋势，无法判断哪些属性真正带来机器人收益。

Result: 固定模型主干后，研究分离对齐、时长、任务多样性、动作监督和数据使用策略的影响，并在真实机器人闭环与RoboDojo验证。对齐的人类示范显著改善分布外泛化并减少目标任务机器人数据需求；时长和任务多样性影响不同能力的方式不同；仅视频监督即使无动作标签仍有效，可作为后续视频—动作训练基础。摘要未提供具体数值。

Insight: 人类视频数据的价值不能仅以时长衡量，对齐程度、任务覆盖、监督及训练用法需共同考虑。实验强调了无动作标注视频的潜力，但主要结论是因素层面的定性规律。

Abstract: Egocentric human data provides a scalable source of experience for robot learning, but varies substantially in human-robot alignment, behavioral coverage, and available supervision. Existing work shows favorable scaling with increasing human data, but it remains unclear which data properties drive downstream robot gains and how to use such data throughout the training pipeline. We present a systematic study of egocentric human data with different alignment and supervision under a unified world-action model framework. With the model backbone fixed, we disentangle the effects of human-robot alignment, data duration and task diversity, action supervision, and data usage strategies. We find that aligned human demonstrations substantially improve out-of-distribution generalization and reduce target-task robot data requirements; data duration and task diversity affect downstream capabilities differently; and video-only supervision remains effective without action labels, providing a strong foundation for subsequent video-action training. We validate these findings through closed-loop policy evaluation on both real robots and RoboDojo. Rather than treating data duration as the sole scaling axis, Ego4WAM shows how alignment, task diversity, available supervision, and usage strategy jointly shape the value of egocentric human data for robot learning.

cs.SD [Back]

[232] When Does a Spoken Agent Have Enough Evidence to Act? The PACT-SLM Contract Test cs.SD | cs.CL | eess.ASPDF

Mengzhe Geng

TL;DR: PACT-SLM逐前缀评估流式语音模型何时拥有足够证据行动，并分别衡量动作身份判断与行动时机。

Details

Motivation: 流式语音智能体可能在声音尚未提供足够证据前触发外部动作，最终轮次得分却看不出各个时间前缀是否已经支持行动。

Result: PACT-SLM为每题设定首个有效行动时间，并分开评估动作内容和触发时机。诊断包含四个留出语义族的80组配对对照、1,600个前缀预测及干净/15dB噪声条件。修正随机分支编码和语义标签不一致后，重训WavLM Base Plus探针在起始后语义标签准确率为26.03%（组bootstrap 95%区间22.14%–29.68%），18.99%的起始前缀已预测动作，完整轨迹精确预测率5.94%。它优于匹配文本、标量声学和打乱表示探针，但只达到100次前缀标签置换的第96百分位，低于97.5百分位参考26.73%。时间信号比WavLM更准确定位起始（36.25%对23.13%），动作身份则更差（9.92%对26.03%）。

Insight: 何时行动和做什么是不同的流式决策能力。评测应同时报告时机与内容，并对照时间基线和置换检验，防止把简单时长线索误认为语音理解。

Abstract: Streaming spoken agents may take an external action before the available speech supports it, yet final-turn scores do not reveal whether each observed prefix supports that action. We introduce the Partial Speech Action Contract for Turn Taking in Speech Language Models (PACT-SLM), a controlled evaluation that assigns a first valid action time and measures action identity and timing separately. The primary diagnostic contains 80 paired contrast groups from four held-out semantic families and 1,600 prefix predictions across clean and 15 dB noise renderings. After correcting a mismatch between randomized branch codes and semantic labels, a refitted WavLM Base Plus probe reaches 26.03% pooled post-onset semantic-label accuracy (95% group-bootstrap interval: 22.14%-29.68%), exposes an action on 18.99% of pre-onset prefixes, and predicts 5.94% of complete trajectories exactly. It exceeds matched text, scalar-acoustic, and shuffled-representation probes in post-onset label accuracy, but its score is at the 96th percentile of 100 within-prefix label permutations and below the 97.5th-percentile reference (26.73%). Elapsed time is more onset-exact than WavLM Base Plus (36.25% vs. 23.13%) but less accurate about action identity (9.92% vs. 26.03%). These results show that action identity and timing measure distinct aspects of partial-speech decision behavior.

eess.IV [Back]

[233] Joint Supervised and Self-Supervised Training with Acquisition-Robust Techniques for Accelerated 4D Flow MRI Reconstruction eess.IV | cs.CVPDF

Mengyuan Xue, Bochun Mei

TL;DR: 论文联合监督与自监督训练并使用加速因子相关的采集鲁棒策略，改善4D流MRI重建中的速度和角度误差，并提升分布外泛化。

Details

Motivation: 4D流MRI采集耗时较长，诊断信息依赖不同速度编码之间的相位差，而不只是图像幅度；高加速采集还会加剧重建误差并考验跨采集条件的鲁棒性。

Result: 模型在CMRx4DFlow 2026主动脉数据集的1.5T和3T数据上联合使用幅度与速度信息监督，并结合监督、自监督训练及按加速因子调节的条件策略。相较训练匹配基线，在R=10至50下RelErr降低38%—50%，AngErr降低7.0—8.7度，且每个加速率的每个留出受试者均改善。分布外迁移中SSIM提高7.2%，AngErr和RelErr分别降低38%和31%。

Insight: 利用速度编码间的互补信息并让训练适应采集加速条件，可同时改善定量流速重建与跨域稳健性。结果来自主动脉数据集及给定加速范围，具体推广范围需看其他解剖部位和采集协议。

Abstract: 4D flow MRI measures time-resolved, three-directional blood velocity but requires long acquisition times, and its diagnostic signal is carried by the phase difference \emph{between} velocity encodings, not by image magnitude. Recent work has developed a per-encoding variational network to address image reconstruction in this field. In this work, we incorporate a joint supervised and self-supervised training regime and utilize both magnitude and velocity data during supervision. At the same time, we add multiple acquisition-robust and conditioning strategies based on the acceleration factors. On the CMRx4DFlow~2026 aortic dataset (1.5 and 3T), our model lowers RelErr by $38$–$50%$ and AngErr by $7.0$–$8.7^\circ$ against a training-matched baseline across $R{=}10$–$50$, improving on every held-out subject at every acceleration. Our model also shows strong generalization ability to transfer on out-of-distribution data by employing the joint training scheme, with an increase of $7.2%$ in SSIM and decrease of $38%$ and $31%$ in AngErr and RelErr respectively.

physics.soc-ph [Back]

[234] Multi-agent discussion gains less when dissent is withheld physics.soc-ph | cs.CL | cs.MAPDF

Chand Sahil Mansuri, Xin Wang, Mengying Li, Bryan Acton, Rory Eckardt

TL;DR: 论文给出多智能体讨论模型，指出讨论只有在异议隐瞒率低于由纠错和答案内化速率确定的阈值时，才可能推翻错误多数。

Details

Motivation: 多智能体讨论被认为能增强多数投票，但已有结果不一致：有时准确率提升，有时代理反而形成错误共识。

Result: 简约模型包含四种常见行为：隐瞒异议、内化他人陈述答案、看到异议后重新考虑、向正确答案纠错。讨论能推翻错误初始多数的条件是隐瞒率c低于临界值c*=γ/(γ+a)，其中γ为净纠错率、a为内化率。作者用贝叶斯方法从对话日志估计参数，并在HiddenBench、MedEInst等基准验证。与预测一致，异议隐瞒越多，讨论收益越小；明确要求不隐瞒异议可提升收益。关闭推理也能提升讨论收益，因为推理提高答案内化率，降低重新考虑少数意见的概率。

Insight: 有效讨论依赖异议可见和成员能够重新审视答案，而非单纯增加推理文本。更长推理若使代理过度内化他人意见，可能反而削弱群体纠错。

Abstract: Multi-agent systems of LLMs add discussion to majority voting and are therefore expected to be more capable. However, empirical reports conflict on whether discussion improves accuracy or leads to an incorrect consensus. Here, we introduce a parsimonious model that explains when discussion improves accuracy and when it ends in an incorrect consensus, built from four behaviors repeatedly observed in LLM agents: (1) withholding dissent, (2) internalizing a stated answer, (3) reconsidering after seeing dissent, and (4) correcting toward the correct answer. The model shows that discussion can overturn an incorrect initial majority only when the withholding rate $c$ is below a critical rate $c^* = γ/(γ+ a)$, set by the net correction rate $γ$ and the internalization rate $a$. We estimate these rates from conversation logs with a Bayesian method and place LLM teams relative to $c^*$. As the model predicts, the gain from discussion shrinks as withholding rises, across LLMs and on a hidden profile benchmark, HiddenBench, and MedEInst. Instructing agents not to withhold dissent increases this gain. Turning reasoning off also increases the gain, because reasoning raises the internalization rate $a$ and keeps agents from reconsidering a minority answer. These findings reconcile the conflicting reports and identify when discussion outperforms majority voting.

Table of Contents

cs.CV [Back]

[1] Strike a Chord! Modal Kinetic Typography cs.CV | cs.GRPDF

[2] GaugeVLM: Structuring Spatial Supervision with Measured Geometric Interventions cs.CV | cs.AIPDF

[3] It Takes Little to Rewrite Perception: Targeted Semantic Substitution in Vision-Language Models at $ε\leq 4/255$ cs.CV | cs.LGPDF

[4] TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos cs.CVPDF

[5] Composition, Not Conversation: VLMs Lose the Scene, Not the Thread cs.CVPDF

[6] Inductive Visual Logic for Few-Shot Out-Of-Distribution Adaptation in VLMs cs.CVPDF

[7] PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos cs.CVPDF

[8] Team MSU GenText-Forensics Challenge 2026 Technical Report cs.CVPDF

[9] VidHarness: Evolving Agent Harnesses for Cost-Efficient Long Video Understanding cs.CVPDF

[10] LoopVL: Recurrent Visual Intelligence cs.CV | cs.CLPDF

[11] MOBA-VL: Event-Localized Multi-Turn Reinforcement Learning for Real-Time MOBA Commentary cs.CVPDF

[12] Audible World Models: Spatially Aware Sound Generation for 3D Worlds cs.CV | cs.SDPDF

[13] Curating Synthetic Data for Task-Specific Visual Perception cs.CVPDF

[14] Caption-Mediated Perceived-Safety Estimation for Pedestrian Routing cs.CV | cs.AIPDF

[15] Beyond Layers: Position-Resolved Gradient Conflict and Position-Aware Modulation for Unified Multimodal Models cs.CV | cs.LGPDF

[16] Multidimensional Observer Model and Perceptual Dimensions of Human Image Quality Assessment cs.CVPDF

[17] GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction cs.CV | cs.LGPDF

[18] ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing cs.CVPDF

[19] Detail in Context: A Dual-Scale Machine Learning Framework for Mycosis Fungoides Detection cs.CVPDF

[20] LongTake: Learning to Sustain Dynamics in Long-Horizon Video Generation cs.CVPDF

[21] PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation cs.CVPDF

[22] Aperture: Training-Free Multiscale Concept Bottlenecks for Remote Sensing cs.CVPDF

[23] After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data cs.CV | cs.AIPDF

[24] Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generation cs.CV | cs.AIPDF

[25] HIGS: Hierarchical Implicit Grids for Joint Geometric and Semantic Scene Understanding cs.CV | cs.ROPDF

[26] Eulerian Motion Reconstruction for Water Scenery cs.CVPDF

[27] Template-Search Domain Adaptation via Multi-Stage Feature Alignment for Cross-Modal Object Tracking cs.CV | cs.AIPDF

[28] Vision-Language-Action Autonomous Driving Agent with Language-based Memory cs.CV | cs.ROPDF

[29] EPIC: Epipolar-Consistent 360° Immersive Stereo Video Generation cs.CV | cs.HCPDF

[30] No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation cs.CVPDF

[31] Hard-Region Supervision: #1 on the Waymo Open Dataset 2D Video Panoptic Segmentation Leaderboard cs.CVPDF

[32] SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision–Language Models cs.CV | cs.AIPDF

[33] Soft Spatial Reasoning cs.CV | cs.AIPDF

[34] Matisse: Evidence-Space Reasoning for Active 3D Reconstruction cs.CV | cs.ROPDF

[35] Here the World in Stereo: Learning Dynamic Spatial Correspondence for Immersive Joint Video-Audio Generation cs.CVPDF

[36] Agentic Relative Camera Pose Estimation via Learned Ranking and Verification cs.CVPDF

[37] Event-Driven Refresh and Recurrence Memory to Reduce Stale Grounding in Referring Video Object Segmentation cs.CVPDF

[38] Distill the Visual Evidence, Not Just the Answer: Cross-World On-Policy Distillation for Vision-Language Models cs.CVPDF

[39] CRAFT: Causal Responsibility and Failure Tracing in Medical Vision Language Models cs.CV | cs.AIPDF

[40] Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video cs.CV | cs.AI | q-bio.NCPDF

[41] DecoMoE: Decoupling Visual Propagation and Expert Computation for Efficient Multimodal MoE Inference cs.CVPDF

[42] FrameMorrow: Future-guided Frame Selection with Prospective Tokens for Long-Horizon Video Generation cs.CVPDF

[43] Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation cs.CVPDF

[44] MEMO: Multi-Level Entity-Aware Memory for Streaming Video Understanding cs.CVPDF

[45] From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning cs.CVPDF

[46] Beyond Spatial-Domain Supervision: A Relation Constrained Space for Multi-Modal Image Fusion cs.CVPDF

[47] Mitigating Object Hallucination in Large Vision-Language Models via False Discovery Controlled Visual Data Splitting cs.CVPDF

[48] PARK: Accurate Block Retrieval for Sparse Attention in Video Diffusion Transformers cs.CVPDF

[49] MeshOctave generates meshes via cascading resolution transitions cs.CVPDF

[50] When Integral Meets Decomposition: A Signal-Level Self-Supervised Feature Decompose Paradigm for Multi-Modal Image Fusion cs.CVPDF

[51] Frame Differential On-Policy Self-Distillation for Video Reasoning cs.CVPDF

[52] BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggers cs.CV | cs.LGPDF

[53] TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localization cs.CV | cs.AIPDF

[54] TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection cs.CVPDF

[55] Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection cs.CVPDF

[56] DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency cs.CVPDF

[57] CamAgent: An LLM-Agent Framework for Multi-Species Camera-Trap Workflows cs.CVPDF

[58] GRC-Pose: Generation-Reconstruction Correspondence for Prior-Free 6D Object Pose Tracking cs.CVPDF

[59] Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillation cs.CVPDF

[60] How to Reduce Localization Ambiguity? Geometry-Semantic Constrained BEV Representation Learning for Satellite-Ground Localization cs.CVPDF

[61] GeoGAT: Bidirectional Temporal Sampling Meets Hierarchical Graph Attention for Global Video Geo-localization cs.CVPDF

[62] Uncertainty-Aware Consistency Distillation for Few-Step Video Generation cs.CV | cs.MMPDF

[63] Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models cs.CVPDF

[64] Asking the World: Generalist Physical Reasoning through Agentic World Modeling and Probing cs.CVPDF

[65] When Can Text Replace Vision? Structural Bottlenecks in Diagram Reasoning cs.CVPDF

[66] MindWorldBench: Evaluating Mental-State-to-Behavior Reasoning in Image-to-Video Generation cs.CVPDF

[67] OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning cs.CV | cs.SDPDF

[68] TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation cs.CVPDF

[69] MEND: Label-Free Detection, Localisation, and Correction of Latent Hallucination in World Models cs.CV | cs.AIPDF

[70] Aligning Thoughts with Answers: Probability Rewards to Tame Thinking Drift cs.CVPDF

[71] Uruqi: Learning Spatial Cognition from Visual Experience cs.CVPDF

[72] Emergent Multi-View Geometry Through Self-Distillation cs.CV | cs.AIPDF

[73] Universal Cross-Prompt Adversarial Attacks on Promptable Concept Segmentation cs.CVPDF

[74] PLRS-IC: A Dual-Calibration Framework for Chest X-Ray Vision-Language Alignment cs.CVPDF

[75] MegaAvatar: Controllable Talking Avatar Generation cs.CVPDF

[76] BMASH: Ball-Motion-Aware Soccer Header Spotting cs.CVPDF

[77] Rethinking Generative Image Compression at Extremely Low Bitrates cs.CVPDF

[78] TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioning cs.CVPDF