cs.CV [Total: 117]
cs.CL [Total: 42]
cs.AI [Total: 11]
cs.CR [Total: 3]
cs.GR [Total: 2]
cs.HC [Total: 1]
cs.IR [Total: 2]
cs.LG [Total: 13]
cs.RO [Total: 6]
cs.SD [Total: 1]
cs.SE [Total: 1]
eess.IV [Total: 1]

cs.CV [Back]

[1] STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets cs.CV | cs.AI | cs.LG | cs.ROPDF

Animesh Varma

TL;DR: STATERA用冻结为主的视频骨干和轻量时间管道混合器，从遮挡下的不透明物体短视频估计其隐藏质心运动。

Details

Motivation: 基于单帧外观预训练的视觉模型难以从运动推断隐藏物理属性；非对称刚体的质心被遮挡时，表面线索和点跟踪都不可靠。

Result: 作者提供含5万条MuJoCo轨迹及63段真实校准质心序列的HiddenMass基准。仿真中STATERA-50K-Sigma把归一化质心误差从DINOv2的41.7%降至25.2%。零样本迁移显示相位感知标签可能产生双峰预测，相位无关标签则易收缩到安全质心；只有相位感知STATERA-50K-Crescent稳定朝真实隐藏偏移移动，虽有单目向量过冲并略增欧氏误差，物理捕捉率仍从2.6%升至41.0%。

Insight: 冻结的时间表征可将惯性运动信息与外观几何区分开来，但训练目标选择会影响真实迁移行为。物理捕捉率和绝对定位误差并非总同步，摘要明确报告了这种取舍。

Abstract: Vision models pretrained for frame-level appearance often struggle to infer hidden physical properties from motion. We study center-of-mass (CoM) localization for opaque, asymmetric rigid bodies from short monocular videos, where surface cues and point tracking are unreliable under self-occlusion. We propose STATERA, which adapts a pretrained video backbone (V-JEPA) with mostly frozen weights and a lightweight temporal tubelet mixer to predict per-frame CoM heatmaps and trajectories. To support this task, we introduce the HiddenMass Benchmark, comprising 50K MuJoCo trajectories and a 63-sequence real-world test set with physically calibrated CoM ground truth. In simulation, STATERA-50K-Sigma improves normalized CoM error from 41.7% (DINOv2) to 25.2%. In zero-shot sim-to-real transfer, we observe a fundamental trade-off in supervision: phase-aware targets can induce bimodal predictions, while phase-agnostic targets can collapse toward statistically safe centroids. Nevertheless, our phase-aware STATERA-50K-Crescent is the only evaluated method that demonstrates consistent movement toward the true hidden offset. While this leads to a monocular vector overshoot artifact that marginally increases absolute Euclidean error compared to a static geometric centroid, it improves physics capture from 2.6% to 41.0%. These results suggest that frozen temporal representations can better separate inertial dynamics from visual geometry for hidden-parameter estimation.

[2] Emergent Object Binding Has a Finite Spatial Horizon cs.CV | cs.LGPDF

Mayank Singal

TL;DR: 论文发现自监督预训练ViT中的同物体绑定信号具有有限空间范围，其可解码概率随图像块距离增加而下降并趋于非零底值。

Details

Motivation: 冻结ViT嵌入可高准确度判断两图像块是否来自同一物体，常被视为自监督学习涌现对象绑定的证据；单一总体准确率却掩盖了该信号的空间结构。

Result: 绑定概率随同一物体图像块距离单调下降并趋于非零下限，且指数衰减具有有限长度尺度。规律在不同物体尺寸、三类探针、ADE20K与COCO，以及DINO和CLIP骨干上均成立。局部有限范围可解释大物体绑定较弱、同类不同物体更难分离、部件与整体常被绑定，而控制尺寸后遮挡影响不明显。DINOv2与v3不同层级的范围和底值组织差异仅作为初步观察。

Insight: 对象绑定更像有限范围的局部空间连贯性，而非全图恒定关系；总体准确率因此不足以描述表示能力。层间比较证据有限，作者也将相关观察限定为初步发现。

Abstract: Pretrained Vision Transformers encode whether two image patches belong to the same object. This IsSameObject signal is decodable from frozen patch embeddings at high accuracy, which suggests that object binding emerges from self-supervised pretraining alone. We show that this single accuracy number hides the structure of the signal. Binding is local: the probability that two patches of the same object are decoded as bound falls off monotonically with the distance between them and levels off at a nonzero floor, a falloff well described by an exponential with a finite length scale. This decay holds across object sizes, across three families of probe, on both ADE20K and COCO, and across DINO and CLIP backbones, which indicates that it is a property of the representation rather than of the decoder. Reading binding as local spatial coherence with a finite range accounts for a set of behaviors that the aggregate score leaves unexplained: binding weakens on large objects, separates distinct objects of the same class less reliably than objects of different classes, and groups object parts with their wholes. It is, by contrast, unaffected by occlusion once object size is controlled. We map each behavior with confounds controlled. As a preliminary observation, the horizon and its floor are organized at different depths in DINOv2 and DINOv3, which we report as suggestive given the small number of layers probed and the confound between the two models.

[3] Spatial Lifting for Dense Prediction cs.CV | cs.AI | cs.LGPDF

Mingzhi Xu, Tao Zhou, Yong Li, Yizhe Zhang

TL;DR: Spatial Lifting先把二维图像等输入提升到更高维，再用该维度网络进行密集预测，从而产生结构化输出并支持单次前向的不确定性估计。

Details

Motivation: 视觉密集预测通常直接在输入维度处理，可能限制输出结构与效率；作者探索将输入升维后借助高维网络，是否能以更少参数和推理成本维持性能。

Result: 该方法可将2D图像提升后交给3D U-Net等高维架构，输出沿提升维度形成内在结构，便于密集监督；测试时还可单次前向使用自一致性估计质量与不确定性。摘要报告其在基准上相较常规方法表现良好，同时降低推理成本并大幅减少参数，但未提供具体任务、参数量或性能数值。

Insight: 改变输入表示的维度可能成为提高密集预测效率的通用建模路径，而不必单纯缩小原网络。当前摘要未给定量细节，因此不能比较其收益大小或适用任务边界。

Abstract: We present Spatial Lifting (SL), a novel methodology for dense prediction tasks. SL operates by lifting standard inputs, such as 2D images, into a higher-dimensional space and subsequently processing them using networks designed for that higher dimension, such as a 3D U-Net. Counterintuitively, this dimensionality lifting allows us to achieve good performance on benchmark tasks compared to conventional approaches, while reducing inference costs and \textbf{drastically lowering the number of model parameters}. The SL framework produces intrinsically structured outputs along the lifted dimension. This emergent structure facilitates dense supervision during training and enables single-forward-pass self-consistency-based quality and uncertainty estimation at test time. Spatial Lifting introduces a simple and general modeling strategy that offers a promising path toward more efficient, accurate, and reliable deep networks for dense prediction tasks in vision.

[4] Encoded but Disconnected: Decomposing Vision-Language Model Failures under a Patching Null cs.CV | cs.CL | cs.LGPDF

Genpei Zhang

TL;DR: 研究用残差流和注意力头干预检验视觉语言模型中层虽可解码出正确答案，是否真正因果性地影响最终回答，并将错误分为三类。

Details

Motivation: 中层可读出正确答案常被当作模型已具备相关视觉理解的证据，但可解码信息未必参与最终预测；需要区分表示存在与因果使用。

Result: 在LLaVA-1.5-7B、Qwen2.5-VL-7B和InternVL3-8B的POPE评测中，68%至91%的错误案例中层含有正确答案信号，但残差流层级干预在三种架构上都没有产生非平凡翻转；两个模型的逐头干预也为零，Qwen完成12,600次干预仍无翻转。例外仅为InternVL3一个特定头。错误可操作性地分为感知失败、已编码未连接和先验覆盖三类，三种模型分类学习准确率均超过60%。

Insight: 中层可解码正确答案并不证明模型用它作出最终预测，因果干预可揭示表示和决策之间的断连。论文用oracle标签报告干预效应，明确不把它包装为可直接部署的修复方案。

Abstract: Across three vision-language model architectures (LLaVA-1.5-7B, Qwen2.5-VL-7B, InternVL3-8B), we report a universal negative finding for mid-layer interpretability. On POPE – the benchmark common to all three – the mid layers encode the ground-truth answer in 68-91% of errors, yet this signal is not causally active for the final prediction: residual-stream patching yields 0% non-trivial flip at the layer level on all three architectures, and on two of three at the per-head level (Qwen: 0/12,600 patched forwards). The lone exception, InternVL3 layer-20 head-2, is a non-vocab, self-attending head whose effect is localized to that specific head (p < 1e-4). Despite the null, the errors separate operationally into three failure modes – Perception Failure, Encoded-but-Disconnected, Prior-Override – learnable above 60% on all three architectures, and the architecture’s prior direction predicts which of two interventions elicits a category-specific response. We report these mitigation effects under oracle labels as evidence the categories are mechanistically real, not as a deployable method.

[5] Seeing the City or Recognizing the Place? What Street-View Imagery Adds Beyond Existing Urban Data in VLM Urban Sensing cs.CVPDF

Kaizhen Tan

TL;DR: 研究比较街景图像与已有城市数据对七类城市属性预测的增量价值，指出图像是否有用取决于视觉可读性和附近数据覆盖。

Details

Motivation: 街景常用于推断城市属性，但预测准确率并不能说明照片提供了多少超出同一地点已有数据的信息，也无法揭示模型在冲突数据下信任哪个来源。

Result: 作者比较五个公共资源中的七类属性、三种VLM，并评估图像、任务上下文、邻近观测与公共记录，另测试图像替换和记录冲突。道路损坏、坡道和房价上，已有数据达到或超过仅图像模型；人口预测中，邻近官方统计接近最佳图像结果。图像对建筑类型、功能和低层层数更有信息；层数任务中，图像优势随最近标注建筑距离每翻倍增加5.7个百分点，但对高层建筑下降，因屋顶常不在画面中。模型常跟随冲突记录。

Insight: 街景图像的边际价值因属性和现有数据覆盖而异，盲目增加图像未必改善城市地图。把来源冲突纳入评测还能揭示模型依赖及派生数据的来源问题。

Abstract: Street-view imagery is increasingly used to infer urban attributes, but predictive accuracy alone does not reveal how much a photograph contributes beyond data already available for the same place. We compare image-based predictions with existing urban data across seven attributes from five public resources and three VLMs. The same urban units are evaluated using images, task context, nearby observations, and public records, while image replacements and conflicting records test source reliance. Existing urban data matched or exceeded image-only models for road damage, curb ramps, and house price, while neighbouring official statistics nearly matched the best image result for population. Images were more informative for building type, building function, and low-rise floor count. For floor count, image advantage increased by 5.7 percentage points per doubling of distance to the nearest labelled building and declined for tall buildings whose rooflines often fell outside the frame. Models frequently followed conflicting records. OpenFACADES floor annotations were generated with OpenStreetMap floor values and showed the opposite height-dependent error pattern from image-only reruns. Street-view image value therefore depends on visual legibility and local data coverage. Comparing images with existing urban data can guide image collection and clarify the provenance of derived urban maps.

[6] DSSR-3D: Decoupled Reasoning for View-Dependent Referring in 3D Gaussians cs.CVPDF

Thanh-Khoi Nguyen, Thien-Phuc Tran, Minh-Triet Tran

TL;DR: DSSR-3D将3D高斯场景中的指代表达拆成位姿无关的语义定位和位姿条件化的空间推理，免训练地处理依赖视角的左右关系。

Details

Motivation: 现有3D指代场把语言特征嵌入全局视角不变空间，无法表达“观察者左侧”等随相机位姿改变的空间关系。

Result: 框架定义语义定位与视角空间推理两个接口，用温度锐化softmax定位和投影方向评分组合成轻量免训练步骤，不重训语义场，也不依赖边界框等离散几何代理。它可零样本迁移到结构不同的语义场，并提出ViewRef-GS基准、扩展Ref-LERF评估视角相关分割；实验在3DGS指代方法上持续取得提升，摘要未给出具体数值。

Insight: 语义类别定位与相机相关空间关系可由不同模块处理，再在推理阶段结合，避免把视角信息压进不变语义表示。跨语义场迁移显示接口具有灵活性，但当前仅报告定性提升。

Abstract: Recent advances in 3D Gaussian Splatting have enabled open-vocabulary and referring segmentation by distilling semantic knowledge from 2D foundation models into 3D representations. However, existing referring fields embed language features in a globally view-invariant space, making them fundamentally unable to resolve observer-centric spatial relations (e.g., “to the left of”) that depend on camera pose. We propose DSSR-3D, an inference-time framework for view-dependent referring segmentation on continuous 3D Gaussian fields, formalized as two interfaces - pose-invariant semantic localization and pose-conditioned spatial reasoning - such that any pair of functions satisfying these constraints yields a valid instantiation, requiring no retraining of the underlying semantic field and no reliance on discrete geometric proxies such as bounding boxes. We instantiate the two interfaces with a temperature-sharpened softmax localization mechanism and a projection-based directional scoring function, fused via a lightweight, training-free step, and show they transfer zero-shot to structurally distinct semantic fields without adaptation. We further propose ViewRef-GS, a benchmark isolating view-dependent segmentation on 3D Gaussian fields, evaluated jointly with an augmented Ref-LERF to provide a comprehensive testbed for viewpoint-dependent spatial grounding. Experiments show consistent gains over existing 3DGS-based referring methods, with no additional training beyond the base semantic field

[7] A Framework for Egocentric and Exocentric Procedural Understanding via Temporal Segmentation and Semantic Abstraction cs.CV | cs.AIPDF

Vivek Chavan, Jörg Krüger

TL;DR: 该框架将连续多模态工作视频切分为事件卡并更新程序状态记忆，综合场景、位置、动作、叙述及注视变化来支持长程程序理解。

Details

Motivation: 长时间第一人称和外部视角视频包含丰富程序信息，却存在冗余、噪声和存储处理成本；固定时间窗口或单一视觉新颖度不足以识别有意义的步骤边界。

Result: 框架以视觉上下文、地点、运动、叙述、视线—物体交互及可选工作区证据检测事件边界，再生成带来源的事件卡，记录执行者、时间区间、位置、动作、工具、前后状态和置信度，并逐步更新工作环境模型。设计使用冻结DINOv2、V-JEPA-2与本地语言模型，提出分段质量、压缩、检索保真度和长程问答评测方向；摘要尚未报告实测结果。

Insight: 带证据来源的事件化记忆可将连续视频压缩成可审计的程序状态，同时保留查询所需的步骤关系。该文主要提出框架及评测方案，当前摘要不能支持效果优于基线的结论。

Abstract: Long-horizon ego/exo data contains rich procedural evidence, but are redundant, noisy, and costly to process or retain. We propose a compact framework that converts continuous multimodal workplace video into a structured Procedural State Memory, implemented as a Work Environment Model (WEM). Inspired by event segmentation theory, we detect boundaries using changes in visual context, location, motion, narration, gaze/object interaction, and optional exocentric workspace evidence, rather than fixed windows or visual novelty alone. Each segment is abstracted into an evidence-linked event card containing actor, interval, location, action, objects/tools, pre/post state, confidence, and provenance. These event cards incrementally update the WEM, enabling compact, auditable documentation and retrieval under on-premise privacy constraints. We instantiate the design with frozen DINOv2 and VJEPA-2 encoders and a local language model, and outline evaluation criteria for segmentation quality, memory compression, retrieval fidelity, and long-horizon QA.

[8] DramaAgent: Agentic Storytelling Video Generation cs.CV | cs.CLPDF

Ting Huang, Biao Wu, Ronghao Chen, Zeyu Zhang, Tengfei Cheng

TL;DR: DramaAgent在视频生成模型上增加分层代理控制层，将长篇故事生成拆为规划、角色状态保持、分场生成和反思式局部修复。

Details

Motivation: 扩散和自回归模型提升了文本生成视频能力，但长篇作品仍常出现剧情漂移、人物身份不稳、场景衔接弱以及音画不匹配。

Result: DramaAgent在不修改底层视频骨干的情况下维护故事与角色状态，逐场合成并诊断角色漂移、语义缺失、时间断裂和跨模态不匹配，再按阶段修复问题片段。多种视频生成骨干上的实验表明，相比直接生成和强基线，框架改善长程连贯性、人物一致性、叙事忠实度及场景级音画一致性；摘要未提供具体指标。

Insight: 控制层可通过持续维护状态和针对性返修提高长篇生成质量，无需重训每个底层生成器。当前结论是跨骨干定性的提升，具体收益和人工评估设置需查看全文。

Abstract: Recent diffusion and autoregressive models have substantially improved text-to-video generation, yet producing coherent long-form story videos with consistent characters and aligned audio remains challenging. Existing methods often suffer from narrative drift, unstable character identity, weak cross-scene continuity, and audio-visual mismatch over extended sequences. We propose DramaAgent, a hierarchical, agentic, and model-agnostic framework for long-form text-to-video-and-audio generation. Rather than improving the underlying video backbone itself, DramaAgent introduces an upper-level control layer that decomposes generation into story planning, persistent character conditioning, scene-wise synthesis, and reflection-guided targeted repair. The framework maintains reusable story and character states across scenes, diagnoses failures such as identity drift, missing scene semantics, temporal discontinuity, and cross-modal mismatch, and repairs problematic clips in a stage-specific manner. Experiments across multiple video generation backbones show that DramaAgent improves long-horizon coherence, character consistency, narrative fidelity, and scene-level audio-visual consistency over direct generation and strong baselines. These results suggest that hierarchical agentic control is a practical direction for controllable long-form audiovisual generation. Code: https://github.com/AIGeeksGroup/DramaAgent. Website: https://aigeeksgroup.github.io/DramaAgent.

[9] Evaluating the Robustness of Anti-UAV Detection under Controlled Fog Degradation: Fog-Aware Training and Clear-Sky Tradeoff cs.CVPDF

Gur Levy Birkental, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansoor Alsahag

TL;DR: 论文构建十级可控雾霾反无人机检测基准，量化能见度退化并评估混合晴天与雾天训练对检测鲁棒性和晴空精度的影响。

Details

Motivation: 视觉反无人机系统需在低能见度条件下工作，但多数基准仅含晴空画面，已有恶劣天气评测也常把天气简化为有或无，难以了解雾霾严重程度如何影响检测。

Result: 研究在Anti-UAV300 RGB视频上合成十级雾霾，比较晴天训练YOLOv5m与晴雾混合训练模型。mAP@0.5:0.95随雾霾非线性骤降，主要损失召回和置信度，最浓雾时较晴天下降96%。雾感知训练在各级雾霾下最多提升0.320 mAP@0.5:0.95，晴天准确率代价为9.1%，但仍无法阻止极端雾下崩溃。

Insight: 检测风险可能集中在较窄能见度区间，简单晴天/恶劣天气二分会低估运行风险。雾感知训练提高可靠检测阈值，却不能取代极端天气下的风险控制。

Abstract: Vision-based anti-UAV systems must function in poor visibility, yet most benchmarks use only clear-sky footage, and previous robustness studies treat adverse weather as a simple present/absent condition. As a result, the impact of fog severity on ground-to-air UAV detection remains poorly understood. This work presents the first severity-controlled fog benchmark for this task: synthetic fog at ten severity levels is applied to the RGB modality of the Anti-UAV300 dataset, comparing a clear-trained YOLOv5m baseline to a fog-aware model trained on both clear and foggy images. Detection performance drops sharply and non-linearly: degradation is front-loaded across light-to-moderate fog (beta approximately 0.05-0.10), with a 96% reduction in mAP@0.5:0.95 from clear to thickest fog, mainly due to lost recall and confidence. On the comparable metric (mAP@0.5), this collapse exceeds the most extreme rain degradation reported in the closest prior benchmark. Fog-aware training boosts detection across all severities (up to +0.320 mAP@0.5:0.95) with only a 9.1% drop in clear-sky accuracy, raising the threshold for reliable detection while not preventing collapse under extreme fog. Since reliability is lost within a narrow visibility range, simple clear vs adverse tests underestimate operational risk.

[10] A Low Grounding Score Is Not an Ungrounded Judge: Identifying the Perceptibility Confound in Multimodal Oversight cs.CVPDF

Rasul Khanbayov, Hasan Kurban

TL;DR: 论文指出视觉监督者的反事实接地分数受图像编辑可感知性限制，并提出结合未编辑图像检测探针来识别误报、评估监督者是否使用图像证据。

Details

Motivation: 多模态系统常用模型评审过滤数据、选择输出或提供奖励，因此需审计评审是否依据图像证据；但把图像改到真值翻转后观察判决的探针，也可能因编辑不易察觉而低估接地能力。

Result: 作者形式化Verdict Grounding Score，证明分数上限受编辑是否进入评审的决策相关感知范围限制，且在给定假设下可用同一协议采集的三个量识别缺失部分。九个评审的主要样本中，观测排序严格符合预测，典型评审仅对约一半其本来能识别的编辑作出反应；保守阈值可确认多个误报，包括一个几乎总能检测注入错误却被原分数判为未看图的评审。

Insight: 图像反事实接地分数不能脱离编辑可感知性单独报告，否则会误弃可用评审。未编辑图像上的检测探针可给出上界、识别误报且无需额外计算。

Abstract: Model judges now supervise multimodal systems at scale, filtering training data, selecting outputs, and supplying the reward that shapes multimodal reasoning models. Trusting one means first checking that it uses its evidence, and that check is itself worth scrutinizing, so we ask whether a counterfactual probe of visual grounding measures what it claims to. The probe edits the image so the ground truth flips, holds the reasoning trace fixed, and asks whether the verdict follows. We formalize it as the Verdict Grounding Score and show it cannot be read the way such scores are read. A verdict responds only to an edit that reaches the judge’s decision-relevant reading, so the score is capped by how perceptible the edit is, and unless editing makes the attribute easier to read, the error is one-sided: the score can only make a judge look less grounded than it is. The practical failure is therefore a false alarm, an auditor discarding a usable overseer. Under assumptions we state, we show this missing quantity is not merely bounded but identified from three quantities the same audit protocol already collects, which makes the false-alarm rate directly measurable rather than merely a concern. Auditing nine judges, we find the predicted ordering holds strictly across our entire primary pool, and the typical judge there acts on only about half of the edits whose attribute it can otherwise resolve. Applying a conservative rejection threshold certifies several cells as false alarms outright, the clearest being a judge that detects the injected error essentially every time while still scoring as if it had not used the image at all. The rule that follows is that an image-side counterfactual score should never be reported alone: a detection probe on the unedited image upper-bounds it, certifies its false alarms, and costs nothing extra to run.

[11] GPEC: Efficient Pre-LLM Gaussian Process Embedding Correction for Cardiac Video Caption Generation cs.CVPDF

Arefeh Rezaei

TL;DR: GPEC在VideoChat2视觉投影与语言模型之间用稀疏高斯过程校正表示，改善心脏超声视频字幕内容对齐而无需端到端微调。

Details

Motivation: 多模态大模型具备视频字幕能力，但在超声等专科医学影像上表现可能下降；全模型微调成本较高，也可能不必要地改变预训练骨干。

Result: GPEC将结构化标注转为定性属性和固定格式参考字幕，再映射到语言模型嵌入作为校正目标；用稀疏变分高斯过程学习残差，VideoChat2其余组件保持冻结。在相同输入与参考条件下，对比原模型后，表示级、字幕级、内容对齐等指标均改善；每段视频推理额外耗时低于0.05秒。

Insight: 把校正放在视觉表示进入语言模型之前，可低成本修补特定医学视频域的表征偏差。摘要支持轻量计算开销和字幕改善，但未列具体相似度或内容指标数值。

Abstract: Multimodal large language models (MLLMs) have shown strong potential for video understanding and caption generation, but their performance may decline in specialized medical imaging domains such as echocardiography. This work introduces Gaussian Process Embedding Correction (GPEC), a modular and computationally efficient pre-LLM error-correction method that improves the visual representations used by VideoChat2 for cardiac ultrasound caption generation. GPEC is inserted between the visual projection layer and the language model and learns a residual correction that moves the projected visual representation toward an annotation-guided target. The target is constructed by converting structured video annotations into qualitative attributes, generating a fixed-format reference caption, and mapping it into the language-model embedding space. The correction is modeled using a sparse variational Gaussian Process with inducing points, natural-parameter variational updates, and a block-wise linear kernel, while the original VideoChat2 components remain frozen.The method is evaluated using representation-level, caption-level, content-oriented, and execution-time metrics by comparing the original VideoChat2 with VideoChat2 + GPEC under identical input and reference conditions. Results show improved caption similarity and content alignment after applying the proposed correction. Furthermore, GPEC adds less than 0.05 s of inference-time overhead per video in the evaluated setting. These findings indicate that GPEC can improve caption generation in specialized medical video domains with minimal computational cost, without requiring end-to-end fine-tuning of the pretrained multimodal backbone.

[12] Query Independent Variable Rate Visual Token Coding cs.CVPDF

Hongbo Zhang, Zihao Yang, Liuyang Song, Daqian Yang, Haoyang Yao

TL;DR: 方法保留全部视觉词元而为每个词元分配不同编码比特率，通过精确整数率失真优化实现与查询无关的视觉压缩。

Details

Motivation: 视觉词元压缩大多按相关性筛除词元，常用注意力排名依赖当前问题；当同一压缩表示需跨多轮查询缓存或传输时，问题相关的选择可能丢失后续问题所需信息。

Result: 作者采用变换编码，为每个词元估计失真—码率曲线，并在固定比特预算下优化比特分配，全程不使用文本查询。在两个数据集和两种容量下，等比特预算时比统一码率、闭式水位分配及按失真剪枝更好地保留模型输出分布和答案；对原本剪枝所针对的问题可匹配注意力剪枝，而同一图像换问题时表现更好。

Insight: 压缩不必二选一地保留或丢弃词元，也可以按信息损失分配表示精度。查询无关编码适合多轮复用，但其优势需在给定比特预算和视觉任务上衡量。

Abstract: Visual-token compression for vision–language models is posed almost entirely as a selection problem: decide which tokens to keep and discard the rest. The criteria that work best rank tokens by the attention the language model pays them, which makes the ranking a function of the question being asked. That is invisible in a single-turn benchmark and decisive whenever a compressed representation is written once and read many times, as when it is cached across the turns of a conversation or transmitted between a device and a server. We take the other half of the classical transform-coding toolkit instead: keep every token and vary its rate. A transform code exposes each token’s measured distortion–rate curve, and a fixed bit budget is distributed across tokens by exact integer rate–distortion optimisation on those curves. No text enters the pipeline, so one compressed representation serves any query. At equal bit budgets, on two datasets and two capacities, it preserves the model’s output distribution and its answers better than uniform-rate coding, the closed-form water-fill and distortion-ranked pruning. It matches attention-ranked pruning on the question pruning was tuned for, and overtakes it once the compressed image must answer a different question about the same image.

[13] LENS-GRF: Permutation-Invariant Lesion Evidence Network with Gated Residual Fusion for Acne Severity Grading and Multi-Rater Clinical Oracle Analysis cs.CV | cs.AIPDF

Muhammad Muhtasim Shahriar, M. F. Mridha

TL;DR: LENS-GRF结合全脸视觉先验和置换不变病灶集合Transformer，用门控残差融合局部病灶证据进行四分类痤疮严重度评估。

Details

Motivation: 痤疮分级既需要全脸上下文，也依赖细粒度病灶；自动检测误差、数据重复以及医生评分分歧都会影响模型表现和临床效度。

Result: 在ACNE04上，YOLOv11s全自动LENS-GRF准确率80.82%；使用真实病灶标注时为95.89%±0.59%，QWK为0.9753。数据审计发现15对跨集合重复图像，其中5对严重度标签冲突。PLSBRACNE01的锁定零样本评估中，全自动模型准确率35.00%，低于全局基线42.50%；三位皮肤科医生oracle分析中，真实病灶输入的最佳准确率47.97%，最高QWK 0.5799，医生两两一致率为49.32%至66.22%。

Insight: 真实病灶输入的高分显示局部证据有用，但自动检测域偏移、标注差异和评价标准错配会显著限制外部表现。报告的ACNE04标注辅助成绩不能代表全自动跨队列性能。

Abstract: Automated acne severity grading requires both whole-face context and fine-grained lesion evidence. We propose LENS-GRF (Lesion Evidence Network with Set-Transformer and Gated Residual Fusion), an interpretable multi-stage framework for four-class acne severity grading. The method combines Adaptive Facial Skin Segmentation and a global Vision Transformer prior with a permutation-invariant Lesion Set Transformer that encodes localized lesion patches and spatial geometry. Gated Residual Fusion adaptively controls the local residual contribution and reduces to the global prediction when the gate is zero. On ACNE04, fully automated LENS-GRF with YOLOv11s achieved 80.82% accuracy; with ground-truth lesion annotations, it achieved 95.89% +/- 0.59% accuracy and a Quadratic Weighted Kappa of 0.9753. A data-integrity audit identified 15 cross-split duplicate image pairs, including five with conflicting severity labels. In locked zero-shot evaluation on the full PLSBRACNE01 cohort (200 subjects, 600 views), automated LENS-GRF achieved 35.00% accuracy versus 42.50% for the global baseline. On the 148-subject common cohort used for three-dermatologist oracle analysis, ground-truth lesion inputs increased the best oracle accuracy to 47.97%, while the highest oracle QWK was 0.5799. Pairwise oracle agreement ranged from 49.32% to 66.22%, highlighting detector domain shift, annotation variability, and cross-criterion mismatch.

[14] Decoding the Disaster: Multi-Task Geospatial Reasoning with Vision-Language Models and Crowdsourced Imagery for Disaster Mapping cs.CV | cs.AIPDF

Wenping Yin, Fabian Desuer, Ziqi Liu, Naixia Mou, Weijia Li

TL;DR: GRDisaster把众包灾害图像与街景、遥感视图关联，利用多模态模型执行跨视角定位验证、空间推理和损害严重度评估。

Details

Motivation: 众包照片可提供及时、精细的街道灾情信息，但图像通常无结构、地理位置模糊且缺少可靠坐标，人工定位和解释难以扩展。

Result: 作者整理26,340张图像组成PhotoMappers基准，含人工验证地理信息、街景和遥感跨视角三元组，覆盖2018至2024年多个灾害事件。框架结合确定性与概率式跨视角定位及多视图融合，并设计结构、环境和全局场景线索验证配对及损害证据的空间指标，以专家标注评估灾情严重度。摘要将其定位为系统化评测框架，未报告数值性能。

Insight: 多视角对应验证与可解释空间指标可把散乱街拍转成可用的地理信息和损害证据。当前工作主要建立数据与评测流程，摘要尚不能支持具体定位精度或灾情判断准确率。

Abstract: Crowdsourced imagery provides timely, fine-grained, street-level observations for disaster mapping, complementing conventional remote sensing imagery (RSI) during emergency response. However, such imagery is often unstructured, spatially ambiguous, and lacks reliable geographic metadata, making manual geolocalization and interpretation labor-intensive and difficult to scale. This work proposes a multi-task Geospatial Reasoning Disaster mapping framework, namely GRDisaster, to examine the potential of vision-language models (VLMs) in understanding, geolocalizing, and reasoning over crowdsourced disaster imagery. GRDisaster is built on a newly curated benchmark dataset derived from PhotoMappers, comprising 26,340 images organized into human-validated volunteered geographic information (VGI), street-view imagery (SVI), RSI cross-view triplets covering multiple disaster events from 2018 to 2024. The framework combines deterministic and probabilistic cross-view geolocalization with multi-view fusion to associate VGI images with georeferenced SVI and RSI. It introduces two sets of spatial reasoning indicators for cross-view geolocalization validation and disaster damage assessment. These indicators use structural, environmental, and global-scene cues to validate cross-view correspondences and visually observable damage evidence with expert-verified annotations to assess disaster severity, improving the interpretability of VLM outputs. To our knowledge, this study provides the first systematic investigation and unified evaluation framework for examining how VLM-based spatial reasoning can transform crowdsourced disaster imagery into actionable geospatial artificial intelligence (GeoAI) through cross-view geolocalization validation, interpretable spatial reasoning, and damage-aware severity assessment.

[15] LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation cs.CV | cs.AI | cs.CL | cs.LGPDF

Jaeyun Shin, Hangeol Chang, Jong Chul Ye

TL;DR: LEGO-OPD把语言专家作为候选词元先验、视觉接地专家作为似然，再按解码前缀自适应校准视觉证据强度进行多模态在线蒸馏。

Details

Motivation: 多教师蒸馏直接使用VLM完整分布会把视觉接地和语言先验混在一起；增加视觉监督又可能压过语言推理，造成感知改善、文本推理退化的权衡。

Result: 在广义贝叶斯组合中，视觉专家通过图像引起的预测变化更新语言先验，并根据每个前缀校准更新强度，避免监督不足或过量。Qwen3实验显示，LEGO-OPD在多模态与纯文本推理任务上持续优于所评单教师和多教师基线，同时提升初始学生视觉感知并保留文本推理能力；摘要未提供具体分数。

Insight: 教师组合可因子化为语言先验和视觉似然，从而独立控制推理与视觉证据贡献。前缀级校准是平衡两类能力的关键，但当前摘要只报告定性一致优势。

Abstract: Multimodal on-policy distillation (OPD) aims to improve visual grounding while preserving the strong reasoning capabilities of language models. Recent multi-teacher approaches combine LLM and VLM teachers to provide complementary supervision. However, directly using a VLM’s full predictive distribution entangles its visual grounding signal with its own language prior, preventing the grounding information from being transferred independently. Conversely, increasing the strength of visual supervision can improve perception but may overemphasize visual evidence and degrade language reasoning. To address this trade-off, we introduce LEGO-OPD, which selectively composes factors from a Language Expert and a Grounding expert into One teacher distribution for multimodal OPD. Under a generalized Bayesian formulation, the language expert provides a prior over candidate tokens, while the grounding expert contributes a visual likelihood that updates this prior, rather than transferring its complete predictive distribution. This factorized composition allows language reasoning and visual grounding to be controlled independently. We further introduce adaptive calibration to determine how strongly the visual likelihood should update the language prior at each decoding prefix. Specifically, LEGO-OPD uses the grounding expert’s image-induced prediction shift as a prefix-dependent reference, preventing both insufficient and excessive visual supervision. Experiments with Qwen3 models show that LEGO-OPD consistently outperforms the evaluated single- and multi-teacher OPD baselines on both multimodal and text-only reasoning tasks. Moreover, it improves the initial student’s visual perception while preserving text-only reasoning.

[16] Memorizon: Training World Models Beyond Their Context Window cs.CVPDF

Tingting Liao, Xuezhi Liang, Hao Li, Guangyi Liu

TL;DR: Memorizon让跨越任意长历史的视频重访样本共享一个有界视觉记忆库，仅对近期片段计算注意力，从而以可控开销训练世界模型保持场景一致。

Details

Motivation: 监督模型在数分钟后重访同一地点需覆盖完整长跨度，但对全部帧做稠密注意力会产生二次计算成本，导致长程重访训练昂贵。

Result: 每个被评分片段按相机共视性检索Top-K潜在表示，多个请求合并成容量至多kK的共享库，历史长度增加时序列仍有界。跨度从100秒增至400秒仅使单步时间增加12%。相较滑窗基线，检索在所有划分提升重访一致性；跨度覆盖首次访问时再提高24%—30%，但画质有一定代价，继续延长无额外收益。用其他片段填库使重访相关性下降83%，表明模型确实利用检索内容。

Insight: 监督跨度可以很长而注意力上下文保持短，关键是按视角相关性取回历史而非处理所有中间帧。过长跨度收益饱和且可能损害画质，训练记忆应以重访证据覆盖为目标。

Abstract: Streaming world models should render a place consistently across repeated visits. Directly supervising such revisits requires training samples that capture both visits, often spanning minutes. Yet dense attention over the full span incurs quadratic costs, making long-span supervision expensive. Memorizon breaks this coupling: long spans are needed for supervision, but not for attention, since the two visits can share a forward pass without including every intervening frame. A training sample covers a span of any length but is scored only on its last $k$ chunks. Instead of tokenizing the history before them, each scored chunk retrieves its own top-$K$ latents by camera co-visibility, and the union of these requests forms a shared bank. The bank is bounded by $kK$, so the sequence stays bounded however long the span; at the shortest span the recipe is exactly conventional training. Adding the bank raises the cost of a step once; beyond that, a longer span costs little, and going from 100 to 400 s adds 12% to the step time. Against a sliding-window baseline, retrieval raises revisit consistency on every split, and a span long enough to reach the first visit of each return adds a further 24% to 30%, at some cost in image quality; beyond that span, more length no longer helps. Filling the bank from another episode lowers revisit correlation by 83%, so the model uses what it retrieves. Project page: https://tingtingliao.github.io/memorizon

[17] PACT: End-to-End Learning of Human Pose, Contacts, and Forces from Video cs.CV | cs.AI | cs.LGPDF

Rikhat Akizhanov, Yangsong Zhang, Nikolai Kaliazin, Peter Wolf, Yoshihiko Nakamura

TL;DR: PACT从单目视频端到端联合恢复人体姿态、接触点和接触力，并用物理约束监督动作与力的一致性。

Details

Motivation: 人体运动、环境接触和交互力受共同物理规律支配，但既有方法通常分阶段估计姿态、接触和力，阶段误差会传递且难以联合推理；真实力标注又稀缺。

Result: PACT在人体重建基础模型中增加接触—力词元和时序Transformer，联合预测姿态、接触与力。作者提出利用接触标注及物理运动、力优化的合成与真实视频标注流程，并建立带传感器力真值的攀爬ForceWall基准。实验显示接触力估计优于分阶段重建方法，并泛化到训练分布外的交互；摘要未给出数值。

Insight: 把姿态与物理交互作为一个联合问题可减少阶段间误差，物理监督还能利用无力传感器视频补充训练数据。当前结论包含新攀爬基准和分布外泛化，量化差异需查看全文。

Abstract: Human motion, environmental contacts, and interaction forces are governed by common physical laws, yet existing approaches typically separate visual pose reconstruction from contact and force estimation. This separation limits joint reasoning and can propagate errors between stages. We introduce PACT, an end-to-end model that jointly learns to estimate human pose, contacts and contact forces from monocular video. Our approach augments a human reconstruction foundation model with learnable contact-force tokens and a temporal transformer that integrates visual features with world-space motion. Joint prediction heads refine human poses and estimate contacts and forces, while physics-based supervision encourages consistency between the reconstructed motion and interaction forces. To address the scarcity of force annotations, we develop a data annotation pipeline that combines contact labeling with physics-based motion and force optimization, producing training supervision from synthetic and real-world videos. We also introduce a real-world climbing benchmark ForceWall with climbing videos and corresponding ground-truth contact forces obtained from the force sensors. Experiments demonstrate state-of-the-art contact and force estimation, outperforming staged reconstruction approaches and generalizing to interactions beyond the training distribution. These results support end-to-end joint learning as an effective approach to recovering human motion and physical interactions from video.

[18] FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering cs.CVPDF

Haifeng Huang, Biyin Xu, Chunsheng Xin, Yang Li

TL;DR: FORTE自适应分配长视频关键帧相关性评分预算，并用精确优化共同考虑已测相关性和时间覆盖，避免在固定候选池中错过证据。

Details

Motivation: 查询感知关键帧选择能让MLLM用少量相关帧处理长视频，但固定均匀候选池之外的证据永远无法被选中；有限评分预算需要在探索视频新时段和精查高价值区域间平衡。

Result: FORTE从稀疏均匀观测出发，用高斯过程估计未评分帧相关性，利用带状核结构把固定带宽下核心计算从三次降到线性。选帧时兼顾预测相关性与时间覆盖，最终用线性时间精确算法选取预算内最优子集。四个长视频问答基准中，在每个测试评分预算下，它都取得比较选择器中最高观察平均准确率，并适用于不同评分器和下游MLLM。

Insight: 关键帧选择需要兼顾局部相关性估计和视频时间覆盖，不能只在预先固定候选中排序。方法在其评分候选池内精确优化，但预算外帧仍依赖自适应探索发现。

Abstract: Query-aware keyframe selection enables multimodal large language models (MLLMs) to process long videos using only a small set of question-relevant frames. Existing score-based methods, however, typically search within a fixed, uniformly sampled candidate pool, preventing evidence outside this pool from ever being selected. Given a limited relevance-scoring budget, the key challenge is to allocate evaluations adaptively to promising frames while continuing to explore underrepresented temporal regions. We introduce FORTE, a training-free framework that addresses this challenge through two stages: adaptive relevance scoring and global keyframe optimization. Starting from sparse, uniformly distributed observations, our efficient Gaussian-process relevance predictor estimates relevance for unscored frames, exploiting temporal locality and the approximately banded kernel structure to reduce the core computation from cubic to linear time in the number of frames for fixed bandwidth. The scoring stage then selects which frames to score next by balancing predicted relevance with temporal coverage, prioritizing promising regions while also exploring less-represented parts of the video. The optimization stage selects the final keyframes by maximizing an objective that jointly captures measured relevance and temporal coverage. We derive an exact algorithm that leverages the logarithmic coverage structure to identify the optimal subset of the scored candidate pool in time linear in the pool size, for a fixed final-frame budget. Experiments on four long-video question-answering benchmarks show that FORTE achieves the highest observed mean accuracy among the compared selectors under every tested scoring budget. Further evaluations demonstrate its consistent effectiveness across different relevance scorers and downstream MLLMs.

[19] PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop cs.CVPDF

Xinge Peng, Yiting Lu, Tianwu Zhi, Wen Wen, Jianzhao Liu

TL;DR: PhysVista用感知、动力学推理和物理合理性判断闭环评估VLM的物理智能，并同时覆盖真实视频与AI生成视频。

Details

Motivation: 现有物理理解基准常把认知拆成孤立阶段，无法判断模型是否能把视觉状态、动态推理和真实性评价结合起来，也难诊断其评估生成视频物理真实性的能力。

Result: PhysVista区分事件级与尺度级推理，联合评估物理状态感知、动力学推理和物理合理性判断，并包含真实及生成视频。多种VLM实验显示，现有模型的物理推理和合理性判断仍有明显限制，视觉识别与真正物理理解之间存在持续差距；摘要未给出具体分数。

Insight: 物理智能评测应覆盖从看到状态、推断变化到判断真实性的闭环，而非只测识别或单步问答。基准揭示了当前VLM局限，但摘要没有提供模型排名与量化差距。

Abstract: Vision-Language Models (VLMs) have shown strong multimodal reasoning capabilities, yet whether they truly capture the physical consistency underlying real-world dynamics remains unclear. Existing benchmark paradigms often suffer from fragmented evaluation, focusing on isolated cognitive stages while overlooking the inherent synergy between perception, reasoning, and physical judgment. The lack of a holistic perspective limits the ability to diagnose whether VLMs can reliably evaluate the physical authenticity of emerging generative models. To address these issues, we introduce PhysVista, a benchmark designed to evaluate physical intelligence in VLMs through a closed cognitive loop framework inspired by the human seeing-reasoning-assessment process. PhysVista restores this loop by jointly evaluating physical state perception, physical dynamics reasoning, and physical plausibility assessment. It further distinguishes event-level reasoning and scale-level reasoning to enable fine-grained analysis of physical understanding. In addition, PhysVista incorporates both real-world and AI-generated videos, allowing evaluation across diverse domains and emerging generative scenarios. Extensive experiments across a diverse set of VLMs reveal substantial limitations in physical reasoning and plausibility assessment, highlighting a persistent gap between visual recognition and genuine physical understanding, and pointing toward more principled designs for physically grounded multimodal intelligence.

[20] Just Align $\bm{x}$: Aligning Predictions, Not Representations cs.CVPDF

Yuyao Zhang, Yuwei Hu, Ziyang Mai, Yu-Wing Tai

TL;DR: JAx不对齐辅助表示，而是对不同噪声水平下的干净图像预测施加一致性监督，为像素空间扩散训练提供低方差目标。

Details

Motivation: 扩散训练的表征对齐在某些设置有效，但迁移到干净像素预测时可能让模型更易读取语义特征，却削弱预测像素变化所需的信息，造成辅助目标与去噪任务不匹配。

Result: JAx用马尔可夫退化耦合较噪学生输入与较干净状态，并以可靠性门控选择EMA教师状态，同时保留真值监督。理论上干净状态的oracle预测具有相同条件均值且目标协方差不更大。ImageNet 256×256上的JiT-B/L/H实验均改善FID并加快收敛，不需外部编码器、改架构或采样流程；梯度分析显示小批量梯度方差降低。

Insight: 辅助监督应直接改善目标预测，而不是引入可能冲突的独立表示目标。JAx通过条件均值保持和风险门控把预测一致性变成较低方差训练信号，且收益不能仅由时间重加权解释。

Abstract: Representation alignment has become an effective way to accelerate diffusion training, but its benefits do not transfer reliably to pixel-space clean-image prediction. In JiT, we find that auxiliary feature alignment can improve access to semantic features while reducing access to image variation needed for clean-image prediction, creating a mismatch between the auxiliary objective and the denoising task. This suggests a different principle: auxiliary supervision should improve the prediction target itself rather than impose a separate representation target. We introduce JAx (Just Align x), a prediction-supervision method that aligns clean-image predictions across noise levels. JAx couples a noisier student observation with a cleaner observation through a Markov degradation that preserves the original JiT input distribution. Under this coupling, the oracle prediction from the cleaner state has the same conditional mean as the optimal JiT target, while its conditional target covariance is no greater. Thus, oracle prediction alignment preserves the population JiT objective up to a constant while providing a lower-variance training target. To make this construction practical with an imperfect EMA teacher, JAx combines ground-truth supervision with a reliability-gated coupling band that selects nearby teacher states based on prediction risk. On ImageNet 256x256, JAx consistently improves FID and accelerates convergence across JiT-B/16, L/16, and H/16, without an external encoder or changes to the architecture or sampling procedure. Gradient diagnostics further show reduced minibatch gradient variance, while ablations demonstrate that the gains cannot be explained by time reweighting alone. These results show that prediction-space supervision provides a simple and principled alternative to representation alignment for pixel-space generative models.

[21] Discrete Annotation, Continuous Preference: Rethinking Supervision for Accurate and Generalizable Aesthetic Image Cropping cs.CVPDF

Ziqing Zhang, Xiao Liu, Kai Liu, Jianze Li, Weihang Zhang

TL;DR: CPF把离散裁剪标注还原为连续多峰偏好场，并据此训练VLM裁剪模型CPIC及重校准基准CPICD，以缓解网格采样和主观标注问题。

Details

Motivation: 美学裁剪数据受人类主观差异影响，且真值局限在固定采样网格，限制模型精度与泛化，也使基准评估失真。

Result: CPF通过峰值聚类、格点外细化、负样本塑形和场组合恢复连续偏好；CPIC用GRPO优化CPF奖励，降低模板坍塌并取得先进表现与较强域外泛化。CPICD利用CPF校正主流基准框的网格伪影。论文报告实验与用户研究支持三者优势，但摘要未给出具体分数。

Insight: 裁剪偏好可能是连续、多峰分布，不能由单个离散最佳框完整表达。重构偏好场既可改进训练奖励，也可重新校准基准，但实际结论仍依赖偏好场估计是否忠实反映人类选择。

Abstract: Aesthetic image cropping aims to identify the optimal crop of an image in terms of aesthetics and composition. While supervision based on annotated data is fundamental, the field has been hindered by a long-standing problem: existing datasets suffer from (1) human subjectivity and (2) rigid discreteness confined to fixed sampling grids. These flawed annotations not only limit the accuracy and generalization of trained models but also severely distort fair evaluation. To overcome this, we propose to model human cropping preference as a multi-peaked, continuous, and sharp field over the crop space. We introduce the Continuous Preference Field (CPF), which recovers a dense preference landscape from discrete annotations through (1) peak clustering, (2) off-lattice refinement, (3) negative shaping, and (4) field assembly. Based on this, we train CPIC, a VLM-based cropping model optimized via GRPO with the CPF reward, which overcomes template collapse, achieving state-of-the-art performance and exceptional out-of-domain generalization. Finally, to resolve the long-standing benchmark evaluation crisis, we introduce CPICD, a comprehensive recalibration of existing ground-truth boxes. By leveraging the CPF to correct grid-bound artifacts across mainstream benchmarks, CPICD establishes a rigorous and reliable foundation for future cropping research. Extensive experiments and user studies demonstrate the superiority of our CPF, CPIC, and CPICD. Code, model, and data are available at https://github.com/zzqingz/CPIC.

[22] Gestalt: Large Multimodal Interplay Model cs.CVPDF

Zequn Yang, Yu Miao, Haotian Ni, Ziheng Chen, Chengxiang Huang

TL;DR: Gestalt以多模态交互金字塔组织单模态处理、跨模态对齐和深度融合，并通过离散扩散架构及交互词元实现统一建模。

Details

Motivation: 现有大型多模态模型多聚焦增加模态数量，却较少利用模态各自特点及其关系；单阶段融合可能难以兼顾模态专属信息与深层交互。

Result: Gestalt采用可学习交互词元和分区架构，并用交互金字塔组织数据与训练。模型在图像生成、多模态理解和纯文本评测上表现强劲，作者报告跨模态融合改善且模态特定信息得以保留；摘要未列出具体基准分数。

Insight: 多模态融合可按由单模态到跨模态交互再到统一整合的层级组织，避免一开始就混合所有信息。当前摘要支持总体有效性结论，但不足以判断与具体基线的量化差距。

Abstract: In this paper, we propose Gestalt, a new paradigm of large multimodal model built around multimodal interplay. Despite rapid advances, large multimodal models are reaching a bottleneck: existing approaches focus primarily on accommodating additional modalities while overlooking the distinct characteristics of each modality and the relations among them. Motivated by the multistage property of human multisensory perception, we propose a multimodal interplay pyramid that organizes multimodal modeling as a progression from modality-specific processing, through cross-modal alignment, to deeper multimodal integration. Guided by this pyramid, Gestalt adopts a unified discrete diffusion framework and an interplay-partitioned architecture, with learnable interplay tokens mediating cross-modal exchange and integration. The pyramid also structures its data organization and training strategy. Strong performance across image generation, multimodal understanding, and text-only evaluation shows that Gestalt significantly improves cross-modal integration while preserving modality-specific information, effectively harnessing the strengths of diffusion-based multimodal models and offering a promising path toward unified multimodal intelligence.

[23] VisionQ: VLM-as-a-Judge Taxonomy, Dataset and Benchmark for Qualitative Analysis in Computer Vision cs.CV | cs.AIPDF

Vu Dinh Xuan, Duc-Hai Nguyen, Minh-Dung Dao, Vu Quynh Giao, Quang Hong Nguyen

TL;DR: VisionQ用论文同行评审图表构建按明确视觉标准评分的VLM评审基准，要求模型不仅选对结果，还必须符合作者声明的视觉理由。

Details

Motivation: 计算机视觉论文常用定性对比图支撑结论，但现有评测只看总体偏好或质量分，可能奖励因错误视觉理由选中偏好图像的评审模型。

Result: VisionQ含1,409篇CVPR和ICCV论文、1,800余张经验证对比图及3,911条人工标注数据，建立六轴51叶视觉标准体系。评测隐藏方法名、图注和论文身份并逐标准报告准确率。DPO训练的Gemma-4-E4B减少7.0个百分点末选偏差、测试准确率提高2.5点；20种开闭源VLM中最强仅63.1%准确率，随机为32.2%，且不同标准可靠性差异明显。

Insight: 视觉评审必须检查理由是否对应指定属性，单一总体偏好可能掩盖评审依据错误。不同视觉标准的能力差异显著，因此评测和使用都应细分标准。

Abstract: Qualitative comparison figures are central evidence in computer vision papers, and vision-language models (VLMs) are increasingly used to judge them. Yet existing benchmarks score only scalar quality or overall preference, so a judge can be rewarded for picking the preferred image for the wrong visual reason. We introduce VisionQ, the first benchmark built from peer-reviewed CV comparison figures that grounds every judgment in a named visual criterion: each question states the criterion, and a judge is credited only when it selects the output the authors identify as best on that criterion. We call this task criterion-conditioned visual discrimination. VisionQ comprises (1) a corpus of 1,409 CVPR and ICCV papers with 1,800+ validated comparison figures and 3,911 hand-annotated data points linking method crops to author-stated visual claims; (2) a six-axis, 51-leaf taxonomy of the visual criteria behind qualitative judgment; (3) a criterion-conditioned evaluation protocol that hides method names, captions, and paper identity and reports accuracy per criterion; and (4) VisionQ-Judge, a DPO-tuned Gemma-4-E4B judge trained on symmetric evidence pairs, which reduces last-option predictions by 7.0pp and improves accuracy by 2.5pp on a held-out test set. Evaluating 20 open- and closed-source VLM judges, we find that the strongest reach only 63.1% accuracy (chance 32.2%) and that reliability varies sharply across criteria. Code: https://github.com/ReML-AI/visionq. Data: https://huggingface.co/datasets/visionq-anon-2026/VisionQ-1k.

[24] HAWK: Rethinking Multimodal Drafting for Speculative Decoding cs.CVPDF

Wenhan Yang, Anirudh Rao, Ashwin Chandra

TL;DR: HAWK为多模态推测解码选择并组合目标模型隐藏层表示，向轻量草稿器提供压缩视觉特征，并训练其预测自身提议后目标分布的变化。

Details

Motivation: 大型视觉语言模型中的轻量草稿器难以利用丰富视觉信息；标准蒸馏只在原始轨迹监督，草稿器偏离轨迹后无法跟踪目标模型分布变化，导致后续令牌接受率下降。

Result: HAWK用表征相似度选择目标层并学习组合，同时直接传递目标模型压缩视觉隐藏状态而非原始视觉词元。SmolVLM-256M在十个多模态基准上，贪心解码平均接受长度从EAGLE-3的3.32升至4.08、加速从2.19倍升至2.60倍；采样下接受长度从2.89升至3.41、加速从1.92倍升至2.19倍。

Insight: 草稿器既要获得易用的视觉信息，也要学习自己的提议会如何改变目标预测。联合解决多模态表征与多步分布漂移可提高接受长度，但摘要结果针对SmolVLM-256M和给定基准。

Abstract: Speculative decoding has achieved substantial lossless speedups for LLMs, but remains less effective for large vision-language models (LVLMs), where lightweight drafters struggle to use rich multimodal information. A second limitation is that standard distillation supervises the drafter only along the original training trajectory, without modeling how target predictions shift after the drafter’s own proposals. As drafting moves away from this trajectory, the drafter can increasingly disagree with the target, reducing acceptance in later steps. We propose HAWK to address both limitations. HAWK uses representation similarity to select informative target layers and learns how to combine their hidden states. For visual information, it directly provides the drafter with compressed visual hidden states from the target model instead of raw visual tokens, making the visual information easier for a shallow drafter to use. HAWK also trains the drafter to capture how target predictions change after its own proposals, improving its agreement with the target during multi-step drafting. On SmolVLM-256M across ten multimodal benchmarks, HAWK raises average acceptance length from 3.32 to 4.08 and speedup from 2.19x to 2.60x over EAGLE-3 under greedy decoding, and from 2.89 to 3.41 and 1.92x to 2.19x under sampling.

[25] Harnessing Vision-Language Models for Perceptual Quality Assessment and Autonomous Content Adjustment in Augmented Reality cs.CVPDF

Elias Rotondo, Lin Duan, Yanming Xiu, Sangjun Eom, Conrad Li

TL;DR: 研究用RateAR基准评估VLM对增强现实场景舒适度和视觉质量的判断，并构建根据模型评估自动调整AR内容的位置与尺寸的系统。

Details

Motivation: AR头显的空间几何、抖动和时间不稳定影响沉浸感与舒适度；传统用户研究成本高、难扩展且不适合快速迭代设计。

Result: RateAR包含多场景和环境下的AR图像、视频，位置、尺寸和阴影一致性等感知指标的ICC(2,5)至少0.90。11种商业VLM的质量预测与人类判断Spearman相关最高0.8695；上下文提示改善人类对齐。基于此构建自动调整系统，21人用户研究中超过90%参与者认为虚拟内容的位置和大小一致性改善。

Insight: 经人类感知验证的VLM评分可辅助AR设计迭代，并可进一步闭环调整内容。评测结果显示相关性较高，但高相关不代表模型判断完全替代用户研究。

Abstract: Advancements in augmented reality (AR) continue to foster innovative solutions, facilitating novel methodologies within educational systems, healthcare delivery, and risk-mitigation protocols. However, optimizing for end-user immersion and comfort remains challenging, as AR head-mounted displays contend with constrained scene geometry, spatial jitter, and temporal instability. User studies are the standard AR evaluation method for visual quality, but their cost, diminishing scalability, and inflexibility pose bottlenecks during iterative application design. To address this problem, we present an automated framework for AR content evaluation and refinement, built on vision-language models (VLMs), to evaluate and predict the visual fidelity of AR scenes as perceived by users. First, we introduce RateAR, a benchmark of AR images and videos collected across diverse scenes and environmental conditions, with good-to-excellent reliability (ICC(2,5) >= .90) across perceptual factors, including object placement, scale, and shadow consistency. Subsequently, we evaluate eleven commercial VLMs on the crafted benchmark. Results support that VLM-based quality predictions strongly correlate with human subjective judgments, achieving Spearman’s rank-order correlations of up to 0.8695. An ablation study further suggests that, compared to other prompting strategies, our contextual prompting yields better alignment with human ratings while balancing introduced complexity cues. Building on these findings, we construct an automated AR content adjustment system and conduct a 21-participant user study. More than 90% of participants found that the system improved placement and size coherence of virtual content.

[26] SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation cs.CV | cs.LGPDF

Mikhail Dereviannykh, Vikram Voleti, Simon Donne, Mallikarjun Byrasandra Ramalinga Reddy, Shimon Vainer

TL;DR: SemanTok让视频分词器的每个保留词元前缀直接重建冻结DINO语义特征，得到兼顾语义和画质的粗到细自回归视频表示。

Details

Motivation: 自回归视频世界模型需要兼顾场景语义与视觉细节；现有灵活长度分词器的早期隐藏层表征对齐可能被噪声输入本身部分满足，未能确保每个词元前缀真正携带语义。

Result: SemanTok把冻结DINO特征输入编码器，并用轻量头从各保留词元前缀重建特征。201M参数自回归模型在视频保真度上达到或超过大3.4倍的VideoFlexTok模型；更大模型继续提高保真度。语义对齐可迁移到分布外类别，且在不同噪声水平、包括纯噪声下仍更高；短前缀预测成本低且生成质量更好，像素细节由后续词元补充。

Insight: 直接监督保留前缀中的语义内容，比只约束解码器隐藏层更能确保紧凑表示携带可用语义。粗到细词元安排让早期高层含义与后续像素细节分工。

Abstract: Recent video-based world models pair the scalability of autoregressive (AR) prediction with the visual quality of diffusion models. The choice of scene tokenizer is paramount for the optimal performance of each of these, both in terms of fidelity and semantics. Flexible-length, coarse-to-fine tokenizers yield exactly that: the first coarse tokens carry the clip’s global semantics while later tokens further specify details. Existing flexible tokenizers only apply a representation-alignment (REPA) loss on early decoder hidden states, a target the decoder can partly meet from its noised input instead. We introduce SemanTok, a flexible video tokenizer that feeds frozen DINO features into its encoder and adds lightweight heads that reconstruct them from each retained token prefix alone. SemanTok achieves high semantic alignment and video fidelity at every AR model size: a 201M SemanTok AR model matches or beats a VideoFlexTok AR model $3.4\times$ its size, and larger SemanTok AR models further improve fidelity. It keeps semantic alignment on out-of-distribution classes and gives the decoder higher semantic alignment at every noise level, including pure noise. It performs well in both reconstruction and generation, and its short token prefixes are cheaper to predict and give better generation fidelity, with pixel detail deferred to later tokens.

[27] Soundwich: Video Generation with Layered and Controllable Audio cs.CV | cs.MM | cs.SDPDF

Zhuo Ning, AmirHossein Naghi Razlighi, Sagi Polaczek, Daniel Cohen-Or, Ali Mahdavi-Amiri

TL;DR: Soundwich把冻结的联合音视频流模型改造成多音轨生成器，为每类声音提供独立时间控制和编辑能力，同时共享场景信息保持音画协调。

Details

Motivation: 现有联合音视频模型通常输出混合音轨，难以分别编辑语音、音乐、音效和环境声，也不符合常见视听制作流程。

Result: 无需训练即可生成多个同步音轨，并用共享场景表示传递全局视听上下文、用对应视觉来源引导各音轨交互。实验和人工评估显示，Soundwich改善时间控制、声源分离和自然度，同时允许单独调整、静音、替换或混音各音轨。

Insight: 将全局场景协调与音源级独立表示结合，可兼顾整体连贯和后期可控性。摘要报告了定性提升，未提供各项指标的具体数值。

Abstract: Recent joint audio-video generative models can synthesize realistic videos with synchronized sound, but typically generate audio as a single mixed track. This limits source-level control and differs from practical audiovisual workflows, where speech, music, sound effects, and ambient sounds are represented as separate editable tracks. We introduce Soundwich, a training-free framework that transforms a frozen joint audio-video flow-matching model into a generator of multiple synchronized, independently editable audio stems coupled to a shared video. Soundwich generates separate audio stems with explicit control over their temporal activity. To keep separately generated sounds coherent, we introduce a shared scene representation that communicates global audiovisual context across stems while preserving their source-level separation. We further route cross-modal interactions between each audio stem and its corresponding visual source, improving audiovisual consistency. The resulting stems remain synchronized with the video and can be independently retimed, muted, replaced, or remixed. Experiments and human evaluations show improved temporal control, source separation, and naturalness, while enabling flexible source-level editing within coherent audiovisual generation. Code is available at https://github.com/CodyNing/Soundwich.

[28] Personalized Image Generation with Reasoning and Reflection cs.CV | cs.AIPDF

Bo Ni, Ngoc N. Tran, Qinwen Ge, Franck Dernoncourt, Seunghyun Yoon

TL;DR: PEARL把多模态推理器与冻结图像生成器组成交错推理—反思循环，根据用户长期历史生成贴合其生活方式和审美偏好的图像。

Details

Motivation: 个性化生图常仅依据少数精选示例，难利用用户长期累积的评论、帖子、图片和元数据，也缺少涵盖个人区分度、历史语义和具体用途的统一评测。

Result: 作者建立包含个性化场景生成和创意生成两类任务的基准，并从目标一致性、画质、用户可区分度、历史语义匹配及任务效用等维度评估。PEARL在两类任务上优于强基线，个性化指标平均提升15%。

Insight: 个性化可通过推理器从复杂用户历史中规划目标，再让冻结生成器执行并反思，而非只记住一组视觉示例。结果以多个个性化指标平均，摘要未给出各维度的差异。

Abstract: Personalized image generation has remained narrowly focused on conditional synthesis from curated visual exemplars, rather than capturing who a user is. In practice, however, a user’s personal context is much richer, comprising reviews, posts, images, captions, and metadata accumulated over time. A truly personalized generator should leverage this history to produce images aligned with the user’s lifestyle and aesthetic preferences. To this end, we introduce the first unified benchmark for personalized image generation from user histories. The benchmark comprises two complementary tasks and a multi-axis evaluation protocol that assesses target fidelity, visual quality, user distinguishability, semantic alignment with the user’s history, and task-specific utility. Grounded in real-world e-commerce and social media settings, the benchmark includes: (1) Personalized Scene Generation, which places a given object in a scene that reflects a user’s preferences and lifestyle, motivated by personalized product presentation; and (2) Personalized Creative Generation, which generates a novel image on a specified topic that is faithful to a user’s aesthetic and visual identity, motivated by social media content creation. We further propose PEARL, which couples a multimodal reasoner with a frozen image generator in an interleaved reason-reflect loop optimized with differential data reward. Across both tasks, PEARL outperforms strong baselines, achieving an average improvement of 15% across personalization metrics.

[29] What Builds the Scene? Luminance Dominates Geometry Formation in 3D Gaussian Splatting cs.CV | cs.GRPDF

Rezvan Joshaghani, Steven Cutchin

TL;DR: 研究通过分离外观重拟合和几何学习，发现3D Gaussian Splatting形成几何时主要依赖亮度，但色度仍影响特定视角外观。

Details

Motivation: 标准3DGS同时用RGB监督几何与外观，难以区分亮度和色度分别如何塑造场景表示与新视角重建。

Result: 在11个基准场景、每个四次独立运行中，亮度监督形成的几何仅比RGB几何的留出重建低0.085 dB；冻结空间参数后，表达力足够的求解器可重新拟合色度达到原质量或略好。高阶球谐对亮度和色度的PSNR贡献分别为1.44和0.19 dB。色度单独监督形成的几何比亮度监督差3.9—5.5 dB，稠密化解释部分差距；镜面表面色调仍会随视角变化。

Insight: 3DGS几何形成主要由亮度结构驱动，色彩外观在空间支撑形成后很大程度可补回，但并非完全不影响视角相关外观。区分几何与颜色参数是分析表示形成机制的关键。

Abstract: Standard 3D Gaussian Splatting (3DGS) learns geometry and appearance jointly from RGB supervision, making it difficult to isolate how luminance and chroma contribute to the learned representation. We study this by training models under different channel supervision, freezing their non-appearance parameters (position, scale, rotation, and opacity), and re-estimating appearance with the same solver before comparing held-out reconstruction. Across eleven benchmark scenes with four independent runs each, geometry learned from luminance alone supports held-out reconstruction 0.085 dB below RGB-trained geometry on average. If chroma is deleted from a trained model, a sufficiently expressive solver can re-fit it on the frozen geometry to the original quality or slightly better. Higher-order spherical harmonics contribute much more reconstruction quality to luminance than to chroma, improving PSNR by 1.44 dB versus 0.19 dB on average, although on mirror-like surfaces hue does still change with viewpoint. The luminance advantage is even larger when geometry is being formed. Chroma-only supervision produces geometry 3.9-5.5 dB worse than luminance-only supervision after the same appearance solve; densification explains part of this gap. Overall, geometry formation in standard 3DGS is strongly luminance-dominated but not luminance-exclusive, and much of the chromatic appearance can be recovered after spatial support has formed.

[30] Video Evidence Indexing: Learning Where to Look from Video Previews for Token-Budgeted Long-Video Question Answering cs.CVPDF

Haowen Guan, Shengzhi Li, Shichao Pei

TL;DR: VEI用低分辨率视频预览获得全局覆盖，再主动定位值得高分辨率查看的证据帧，并在有限视觉词元预算下完成长视频问答。

Details

Motivation: 长视频问答受视觉词元预算和模型上下文长度限制，尽管答案通常只依赖少数片段，固定采样可能漏掉未采样时段的关键证据。

Result: VEI把证据定位与预算规划联合建模，通过预览、证据集构造和答案生成三阶段处理视频，并以答案感知教师对学生生成的索引轨迹做特权自蒸馏。单一策略支持每帧1、6、12和24视觉词元的四种预览分辨率。四个长视频问答基准上，VEI在受限视觉预算下提高准确率，自蒸馏进一步改善问答和时间证据定位；摘要未给出具体数值。

Insight: 廉价全局预览可以帮助将有限高分辨率帧预算集中到问题相关时刻，且预算规划与相关性定位需协同。自蒸馏为缺少帧级标签的证据检索提供监督，但具体收益幅度未披露。

Abstract: Long-video question answering is limited by the high cost of visual tokens and by the fixed context width of current VLMs. A long-video question may require broad temporal coverage, but the answer is often supported by only a compact set of moments. To locate these moments efficiently, we propose token-budgeted Video Evidence Indexing (VEI): given a dense low-resolution Video Preview, the model constructs a compact high-resolution Evidence Set for final reasoning. We treat VEI as a policy that must jointly solve \textit{evidence localization}, which finds question-relevant moments, and \textit{budget planning}, which decides where to spend the limited high-resolution frame budget. We implement this idea with an inference pipeline: the Video Preview provides cheap global coverage, Video Evidence Indexing constructs the Evidence Set, and Answer Generation combines both inputs for final VQA. To address missing frame-level supervision, we adopt privileged self-distillation, where an answer-aware teacher guides the normal test-time policy on student-generated indexing traces. We explore previews at 1, 6, 12, and 24 visual tokens per frame, training a single policy that supports all four resolutions. Experiments show that Video Evidence Indexing improves accuracy under limited visual budgets, and self-distillation further improves both QA accuracy and temporal evidence localization.

[31] Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing cs.CVPDF

Rui Liu, Bhavin Jawade, Haoqi Li, Shivam Mehta, Karan Saxena

TL;DR: ATR先将静音视频的逐帧唇部表示与候选文本音素单调对齐，再让多语言推理器结合局部证据和全局校准分数判断配音内容与时序是否匹配。

Details

Motivation: 配音质检需要在音轨尚不存在时，仅凭静音视频和候选台词验证口型内容与时间同步；传统视觉语音识别和VLM即使识别出内容，也常对时间错误不敏感。

Result: 在七种语言基准上，相比Qwen3.5 SFT基线，2B、4B和9B推理模型平均AUC分别提升59.4%、50.2%和50.8%；迁移到LLaMA-3.1-8B和Mistral-7B时比最佳基线分别提升45.9%和46.6%。在真实配音下游任务中，ATR-9B在台词重排和脚本—片段匹配上比最佳唇读基线分别高52.0%和17.7%。

Insight: 先显式对齐再推理，为模型提供逐音素和整体时序证据，可补足纯视觉语义识别对时间错位不敏感的问题。跨模型、语言及数据集迁移显示方法具备一定泛化性。

Abstract: Dubbing quality control requires a reference-free judge that can determine whether a candidate text line matches a speaker’s visible articulation in both content and timing, using only silent video and text because dubbed audio may not yet exist. Existing visual speech recognizers and video-language models are poorly suited to this setting: even when fine-tuned to recover spoken content from lip motion, they remain largely insensitive to temporal errors. We introduce $\textit{Align Then Reason}$ (ATR), a multilingual lip-sync judge that first establishes a monotonic alignment between frame-level lip representations and the phonetic units of the candidate line, then reasons over this alignment to make the final judgment. An alignment scorer provides the LLM with both local evidence for each phonetic unit and a calibrated global alignment score, enabling it to reason jointly about content and timing. On a seven-language benchmark, our method improves mean AUC over the corresponding Qwen3.5 SFT baselines by 59.4%, 50.2%, and 50.8% with 2B, 4B, and 9B reasoners, respectively. The gains generalize across LLM families, reaching mean AUC improvements of 45.9% and 46.6% over the best baseline for LLaMA-3.1-8B and Mistral-7B, respectively. They also transfer across datasets to three unseen MuAViC languages. Furthermore, we evaluate on two downstream tasks built from real dubbing lines. On dub-line reranking, ATR-9B outperforms the best lip-reading baseline by 52.0%, while on script-to-clip assignment, ATR-9B improves over the best lip-reading baseline by 17.7%.

[32] Paying for Too Many Tokens? Valid and Cost-Efficient Multimodal LLM Annotation with Simple Heuristics cs.CV | cs.CL | cs.SIPDF

Zhixi Zhu, Kristina Gligoric

TL;DR: 研究系统比较视频帧采样、图像网格和单模态策略对VLM标注准确性、下游推断有效性及成本的影响，并发现简单镜头网格能以低成本接近全视频理解。

Details

Motivation: VLM视频标注成本高，研究者常抽帧、拼网格或只用一种模态，但省下的成本是否保留了下游结论尚不明确，且分类准确率可能与推断有效性不一致。

Result: 在短视频情感和主题分类任务上，最高准确率配置有时仍导出错误结论；只用文本也能取得较好表现，增加模态未必增加有效信号。用镜头切换检测构建单张2×8图像网格，其一致性κ与全视频理解相差不超过约0.05，词元成本约为15%。

Insight: 视频标注应同时评估分类结果、下游推断和单位视频成本，而非只选准确率最高的输入配置。镜头网格在该短视频社科任务中提供了显著成本折中，不能自动推广到所有时序任务。

Abstract: Vision-Language Models (VLMs) enable video annotation at scale, but costs accumulate quickly: processing a typical 60-second short-form video at one frame per second requires millions of tokens. To reduce costs, researchers rely on heuristics such as sampling a subset of frames, compressing videos into image grids, or using only a single modality. However, it remains unclear which heuristics save cost, and whether they preserve the downstream conclusions these annotations enable. To address this gap, we conduct a systematic evaluation of these heuristics using short-form videos, on two computational social science (CSS) tasks: sentiment and topic classification. We evaluate each configuration along three axes the literature typically treats separately: classification accuracy, validity of downstream inference, and per-video token cost. First, we find that accuracy and validity diverge: the highest-accuracy configuration can produce wrong conclusions. Second, modality value is not guaranteed: text alone can yield strong performance, indicating that adding modalities can add cost without adding signal. Finally, we find that cost can be decoupled from video length when annotating short-form videos: a single $2\times8$ image grid built via simple shot-transition detection approaches full-video understanding ($κ$ within~.05), at $\sim 15%$ of the token cost. Based on these findings, we derive guidelines that can enable cost-aware VLM annotation in CSS.

[33] Video Generation Models: A Survey of Post-Training and Alignment cs.CV | cs.AI | cs.LGPDF

Chaoyu Li, Xiaoyi Gu, Yogesh Kulkarni, Eun Woo Im, Mohammadmahdi Honarmand

TL;DR: 该综述把视频生成后训练统一划分为隐式与显式对齐，并整理监督微调、自训练蒸馏、偏好奖励和推理时控制方法及其开放问题。

Details

Motivation: 预训练视频模型虽有强生成先验，却未必遵循人类意图、维持长时一致性或满足物理与安全约束；视频对齐还受误差累积、运动—外观耦合、多目标冲突和时序监督稀缺影响。

Result: 综述将后训练按信号施加方式区分为隐式和显式对齐，并按监督微调、自训练与蒸馏、偏好与奖励、推理时方法归纳研究，同时整理常用数据集、基准和评测实践。重点开放挑战包括可扩展奖励设计、长程时序一致性、稳定性—表现力权衡和安全生成。

Insight: 视频生成后训练可在不从头重训的情况下改变模型行为，但评测必须考虑时间维度和安全约束。该文是领域综述，不是单一方法实验，摘要未报告新的性能结果。

Abstract: Video generation has rapidly progressed from short, low-quality clips to high-resolution, long-duration sequences with complex spatiotemporal dynamics. Despite strong generative priors learned through large-scale pretraining, pretrained video models often fail to reliably follow human intent, maintain temporal coherence, or satisfy physical and safety constraints. Compared with image and text generation, alignment in video generation presents unique challenges, including error accumulation over time, motion-appearance coupling, multi-objective trade-offs, and limited supervision for temporal properties. These challenges motivate systematic post-training strategies that adapt pretrained models without retraining them from scratch. In this survey, we present the first comprehensive review of post-training and alignment in video generation models. We frame post-training as a unifying framework and distinguish between implicit alignment and explicit alignment based on how alignment signals are enforced. From this perspective, we organize existing approaches into four broad categories: supervised fine-tuning methods, self-training and distillation methods, preference- and reward-based methods, and inference-time methods. This taxonomy provides a coherent view of how alignment signals shape model behavior across both training and deployment. Beyond methodological advances, we review commonly used datasets, benchmarks, and evaluation practices, and discuss open challenges such as scalable reward design, long-horizon temporal consistency, stability-expressiveness trade-offs, and safety-aware generation. This survey aims to provide a structured conceptual foundation and practical guidance for advancing controllable and reliable video generation models.

[34] Geometric Similarity in VLM Low-Level Vision Representations cs.CV | cs.AIPDF

Shao-Jun Xia, Huixin Zhang, Zhen Lei, Anlan Sun, Yuner Zhang

TL;DR: GeoSim从全局相似度、局部几何、稀疏特征分解和拓扑验证四个层面比较自回归VLM与扩散Transformer的低层视觉表示。

Details

Motivation: VLM有望成为通用视觉骨干，但用于低层图像复原仍需高效适配；不同架构的隐表示是否具有可迁移的共同几何结构尚不清楚。

Result: GeoSim覆盖五类中的24个低层视觉任务，可分析自回归模型隐藏状态及DiT特征图，并支持同任务和跨任务、跨模型比较。实验揭示低层视觉表示的组织规律，同时发现跨任务和跨模型一致性存在局限；摘要未报告具体相似度数值或单一统一恢复模型。

Insight: 表示可迁移性应从多个尺度和结构角度审计，单一相似度分数不足以判断不同模型是否能共享复原能力。GeoSim提供分析工具，当前工作主要揭示规律和限制。

Abstract: Vision-language models (VLMs) have emerged as powerful candidates for universal vision backbones, with representative architectures including autoregressive (AR) models and diffusion transformers (DiTs). Yet, adapting them efficiently for all-in-one low-level image restoration remains a challenge. Crucially, the field lacks an understanding of how VLMs organize hidden-layer representations and whether these structurally distinct paradigms share a common geometric organization for pixel-level perception. Such shared organization is a prerequisite for building highly transferable, unified restoration VLMs and adapters. In this paper, we systematically investigate representational similarity across 24 low-level tasks spanning 5 categories. We propose GeoSim, a unified four-level framework that analyzes task-conditioned representations from global similarity, local geometry, sparse feature decomposition, and topological verification perspectives. Our formulation applies to the analysis of hidden states in AR models and feature maps in DiTs across same- and cross-task/model settings. Our results reveal the organizing principles of low-level visual representations while exposing their limits in cross-task and cross-model agreement. Ultimately, GeoSim provides an interpretability lens for probing latent transferability in low-level vision and diagnosing model limitations in task- or model-specific scenarios.

[35] Machine Translation for Sign Languages cs.CVPDF

Ozge Mercanoglu Sincan, Anton Pelykh, Edward Fish, Harry Walsh, JianHe Low

TL;DR: 该综述梳理手语机器翻译从孤立识别到端到端翻译与生成的发展，并讨论数据、评测、时空结构及聋人社区参与等挑战。

Details

Motivation: 手语具有同步、多层次和三维结构，不能简单套用口语文本处理；当前数据规模、语言质量评估和恰当使用方式仍存在限制。

Result: 综述回顾姿态估计、Transformer和大规模数据集推动的识别、翻译与生成进展，并分析数据稀缺、评估指标难以反映语言质量等技术问题。文章同时讨论数据治理、社区参与和适当应用，强调计算机视觉、手语语言学、聋人研究及聋人社区间需持续协作。

Insight: 手语翻译的进步不仅依赖模型架构，还依赖语言学适配、社区治理和符合语言质量的评测。该文为综述，未报告新的模型或基准性能。

Abstract: Sign language machine translation has progressed substantially over the past decade, evolving from isolated sign recognition to end-to-end translation systems. Advances in pose estimation, transformer architectures, and large-scale dataset collection have driven progress, yet challenges remain. Datasets are limited compared to spoken-language resources; evaluation metrics inadequately capture the linguistic quality of output; and models must capture the simultaneous, multi-layered, and three-dimensional structure of sign languages. This manuscript provides a comprehensive review that seeks to balance technical challenges with stakeholder considerations. We examine the linguistic properties that make sign languages computationally unique, trace the evolution of recognition, translation, and production systems, and analyze ongoing technical challenges. Crucially, we address ethical considerations around data governance, community involvement, and appropriate use. Drawing on interdisciplinary perspectives spanning computer vision, sign language linguistics, and deaf studies, our analysis emphasizes that continued progress requires sustained collaboration across these fields and with deaf communities.

[36] Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers cs.CV | cs.ROPDF

Cigdem Kokenoz, Amir Salarpour, Alkim Domeke, Christopher Salas, Pedram MohajerAnsari

TL;DR: Lang3DSeg从头训练点Transformer处理户外LiDAR开放词汇分割，并通过类别优先掩码和深度间隙截断修正二维视觉标签投影歧义。

Details

Motivation: 监督LiDAR分割依赖封闭类别体系和昂贵逐点标注；开放词汇方法可借助2D视觉语言模型生成标签，但户外点Transformer受稀疏几何影响，二维到三维投影还会把遮挡后点错误标给前景物体。

Result: Lang3DSeg无需几何预训练，在点Transformer上实现户外开放词汇训练。显式类别优先合成掩码，并在投影实例深度分布首次出现空隙处截断，直接修正深度歧义。在nuScenes验证集和SemanticKITTI上分别达到52.8%和41.4% mIoU，为已发表免标注方法最高；仅处理单帧LiDAR且实时推理，无需运行VLM。

Insight: 直接修正投影边界和遮挡噪声可让点Transformer扩展到户外稀疏点云，而非依赖跨序列标签平均。单帧实时且免VLM推理降低了部署需求。

Abstract: Accurate 3D semantic perception is critical for safe autonomous navigation. However, supervised LiDAR segmentation remains tied to closed taxonomies and to the cost of point-wise manual annotation. Open-vocabulary methods avoid that cost by projecting the output of 2D vision-language models onto LiDAR and distilling it into a 3D network. These methods rely almost exclusively on voxel-based sparse convolutions, and point transformers have so far been limited to indoor environments, where 3D data is dense and bounded. We present Lang3DSeg, which establishes a point transformer as the backbone for annotation-free open-vocabulary segmentation of outdoor 3D LiDAR, and is trained from scratch without geometric pre-training. This training paradigm necessitates addressing the inherent noise in 2D-to-3D label projections; specifically, naive projection often suffers from depth ambiguity, where points behind an object are erroneously assigned its semantic label. We therefore composite masks using an explicit class-priority rule and truncate each projected instance at the first gap in its depth distribution, correcting the projection error directly rather than averaging it over registered sequences. Lang3DSeg achieves 52.8% mIoU on nuScenes validation and 41.4% on SemanticKITTI, the highest among published annotation-free methods on both benchmarks. Every 3D semantic segmentation is on a single LiDAR sweep, and inference operates in real-time without running vision-language models.

[37] CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight cs.CVPDF

Chensheng Peng, Wenhao Ding, Ran Tian, Zewei Zhou, Jef Packer

TL;DR: CtrlWAM在模拟器执行受扰动作并配对其对应视觉结果训练世界动作模型，使预测动作意图与未来视频展望保持一致。

Details

Motivation: 常规训练同时扰动记录动作和视频，但受扰动作对应反事实未来，而加噪视频仍来自真实记录，两者监督不匹配；低噪声视频甚至保留原动作的场景和动态线索。

Result: CtrlWAM通过模拟器生成受扰动作及其视觉后果，并设计适配动作与视频不同去噪需求的噪声调度；动作接口也扩展到可变数量的多智能体流。驾驶实验显示动作预测更准确、生成视频与动作更一致且更能服从命令；机器人实验提升运动保真与可控性。匹配控制支持离轨渲染对命令跟随和操作保真度的作用，摘要未提供数值。

Insight: 动作和未来视觉必须由同一条因果轨迹产生，才能避免训练时意图与观察相互矛盾。通过模拟执行提供反事实配对数据，有助于提高世界动作模型的可控性。

Abstract: World action models (WAMs) jointly predict actions (intent) and visual future (foresight). Standard training adds noise to recorded actions and video simultaneously, but such training paradigms introduce a mismatch: perturbed actions imply counterfactual future visual, while the noised video remains tied to the GT recording. In low-noise regime, the scene geometry and even the dynamic behavior remain clearly visible from the noisy future frames despite the added noise. We present CtrlWAM, which executes perturbed actions in a simulator and pairs them with their noised visual consequences for joint WAM learning. To accommodate the different denoising requirements of video and actions, we introduce warped video–action noise schedules that aim to keep visual layout responsive as action predictions evolve. We further extend the action interface from ego-only control to a variable number of agent streams, allowing a unified model to represent predicted or commanded futures for multiple agents. Driving experiments show more accurate action forecasts, closer agreement between generated video and actions, and better following of supplied commands; robotics experiments show stronger motion fidelity and controllability. Matched controls support the benefit of off-path renders for command following and manipulation fidelity. Together, these findings contribute to a more controllable world action model. Project page: https://ctrl-wam.github.io/

[38] A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions cs.CV | cs.AIPDF

Giyeong Oh, Junghun Park, Yuhan Bae, Youngjae Yu

TL;DR: 论文提出固定文本预算的配对审计框架，按覆盖、图像条件忠实度和文本表面质量评估图文语料重描述所诱导的监督分布。

Details

Motivation: VLM生成的密集图像描述已广泛用于文生图训练，但长度等代理指标会遗漏描述风格偏差，下游基准又混入训练配方因素，难以在语料层面公平审计。

Result: 框架在64词预算下从五个维度评估可控基本单元，并应用于五个公开来源语料的七组配对比较。四组跨语料比较中，发布描述相较原始版本每条支持的可控基本单元增加3.39至6.36，在Qwen和Gemma评审下均成立；CC12M上还观察到长描述与密集描述的预算前沿。作者发布约4.9亿规模的多源重描述语料及审计产物。

Insight: 重描述语料应以相同文本预算评估其提供的可支持控制信息，而不能仅按长度或生成模型质量判断。统一审计也能揭示长文本和信息密度之间的取舍。

Abstract: Recaptioned image-text corpora are now standard for text-to-image (T2I) training, with vision–language model (VLM) captioners replacing sparse alt-text by dense descriptions. A recaptioned corpus is a supervision distribution induced by a documented captioning policy ($π$), captioner ($V_c$), and source corpus ($C$). Length-correlated proxies miss caption-register artifacts and downstream T2I benchmarks entangle the corpus with training choices, so this distribution is hard to audit at corpus scale. We introduce a reusable matched-budget audit framework for recaptioned supervision distributions $D_{π,V_c,C}$: at a fixed text budget of $B = 64$ it reports a five-axis profile spanning prompt-side coverage, image-conditioned faithfulness, and caption-surface health, with claimed controllable basic units (CBU) as the common claim unit. We instantiate the framework on seven paired comparisons over five public source corpora. Across the four cross-corpus pairs, the released surface raises supported CBU per caption by $+3.39$ to $+6.36$ under both Qwen and Gemma Judges, and on CC12M the same framework exposes a long-vs-dense frontier that is consistent across both judges and four budgets. We release the audited multi-source recap corpus ($\approx$ 490M) together with the audit-artifact bundle.

[39] Two Clocks in Diffusion MLLMs: When Answers Stabilize Before Rationales Unfold cs.CV | cs.AIPDF

Keuntae Kim, Yong Suk Choi

TL;DR: 研究区分扩散式多模态模型的答案稳定与理由生成时钟，发现提示带来的准确率变化更主要来自答案覆盖，而非覆盖答案后的条件准确率。

Details

Motivation: 掩码扩散MLLM可能在理由尚未生成时答案候选已稳定；若把日志候选稳定、词元提交和理由生成混为一谈，就难以解释提示或解码设置如何影响回答。

Result: 在三个视觉问答基准上，单块且抑制EOS的LaViDa运行中，答案稳定时理由画布仍有89.4%—98.1%未写；VBench将块长从128降至8后该比例从89.4%降到1.7%。允许EOS时，直接指令使Nemotron在M3CoT和ScienceQA分别提高15.0和19.5个百分点，却使LaViDa/VBench下降11.0点。对称分解将各变化中较大部分归于覆盖率，而非条件准确率。

Insight: 评估扩散式回答时需分别测量答案稳定、理由展开和视觉敏感性；停止或提示策略改变的可能是回答覆盖而非推理质量。结果依赖模型、块长及EOS设置。

Abstract: An answer candidate in a masked diffusion MLLM can stabilize while its rationale is still unfolding. We distinguish retrospective stabilization of the logged candidate from token commitment, and examine these two clocks relative to rationale generation. Analyzing our results across three visual question-answering benchmarks, we find that 89.4-98.1% of the rationale-side canvas remains unwritten at stabilization in single-block, EOS-suppressed LaViDa runs. On VBench, reducing block length from 128 to 8 changes this fraction from 89.4% to 1.7%, together with answer coverage and the eligible observation window. Under EOS-enabled prompting, direct instructions improve Nemotron’s overall accuracy by 15.0 and 19.5 percentage points on M3CoT and ScienceQA, but reduce LaViDa/VBench accuracy by 11.0 points. A symmetric decomposition associates the larger absolute component of each change with coverage rather than conditional accuracy. Matched-canvas image ablations measure visual sensitivity alongside answer stabilization, separating the two temporal readouts. Together, these measurements distinguish answer stabilization, rationale unfolding, and visual sensitivity, and identify coverage as the larger component of the prompting differences.

[40] RelationVGGT: Visual Geometry Transformers for 3D Spatial Relation Segmentation cs.CV | cs.AIPDF

Minsu Kim, Jaesung Choe, Jiwoo Lee, Yu-Chiang Frank Wang, Seon Joo Kim

TL;DR: RelationVGGT在无需相机位姿或逐场景优化的多视图设置中，融合视觉语义与3D几何表征，按主体和空间关系分割目标。

Details

Motivation: 前馈3D重建和语义理解持续进步，但多数方法仍以对象为中心，忽略对象之间的空间关系；现有关系理解常依赖相机位姿或逐场景处理。

Result: 给定视觉指定主体和关系文本，RelationVGGT通过关系Transformer预测跨视图目标分割，无需提供目标类别名或已知相机姿态。作者还基于ScanNet++和VLM/LLM构建全自动标注管线，为该任务生成可扩展训练数据；摘要未报告具体基准结果。

Insight: 将主体条件、跨视图几何和语言关系联合建模，可把3D理解从对象识别扩展到关系指代。工作提出任务和标注框架，当前摘要不足以判断分割性能。

Abstract: Recent advances in 3D reconstruction have progressed from per-scene optimization to feed-forward inference, and semantic scene understanding has followed suit – yet existing methods remain confined to object-centric perception, neglecting spatial relations between objects. We formulate 3D spatial relation segmentation in a feed-forward, pose-free multi-view setting: given a visually specified subject and a relational text query, the model segments the target across views without receiving its category name. To this end, we propose RelationVGGT, a novel feed-forward framework that integrates semantic features from a visual foundation model with geometry-aware representations from a 3D geometry foundation model and leverages a relation transformer for subject-conditioned, cross-view relation prediction – requiring neither per-scene optimization nor known camera poses. We additionally provide a fully automated annotation pipeline built on ScanNet++ with VLMs and LLMs, enabling scalable training data generation for this new task.

[41] Video-Index: A Curated Meta-Benchmark for Video Understanding cs.CVPDF

Enxin Song, Yinuo Xu, Shusheng Yang, Wenhao Chai, Jiatao Gu

TL;DR: Video-Index以逐级攻击审计115个视频基准中的捷径，再从大规模问答对中筛出难以被捷径解决的可复现视频理解测试集。

Details

Motivation: 视频基准应奖励真正的视频理解，但模型可能只凭选项、问题文字或局部线索答题；帧打乱和近重复题还可能使测得能力偏离基准声称目标。

Result: 五级攻击审计发现，35个基准中无需看帧的攻击者接近完整视频准确率；51个带时间探针的基准，打乱帧后仍保留完整视频准确率中位数96%；63个基准至少半数题目近重复。作者筛查112个基准的505,518对问答，发布来自76个来源、分属四能力组的840个最难验证题。固定输入下Claude Opus 5比所有开源模型高37个百分点以上，代理工具再提升约20点。

Insight: 基准需通过攻击审计确认分数依赖视频证据而非题面捷径，且时序扰动可检验是否真的利用帧顺序。Video-Index聚焦高难度、经验证样本，但仍需结合效率评估。

Abstract: A video benchmark should reward the capability it claims to measure, yet models can exploit answer options, question text, or partial visual evidence. We introduce the attack pyramid, five levels of shortcut attacks with increasing access to each item, and audit 115 video benchmarks with it. On 35 benchmarks, attackers that never see a frame approach full-video accuracy. On 51 benchmarks with temporal probes, shuffled frames keep a median 96% of full-video accuracy. Near-duplicate questions make up at least half the items in 63 benchmarks. We screen 505,518 question-answer pairs from 112 of them into an audited pool. Agents turn evaluation requests into specifications, and a deterministic selector with a red-team gate composes reproducible benchmarks. We release Video-Index, the 210 hardest verified items under these attacks in each of four capability groups, 840 items from 76 sources. With the same fixed input, Claude Opus 5 outscores every open-source model by over 37 percentage points, and agent tools add about 20 more, yet all systems leave room to improve efficiency and accuracy. Blog: https://www.enxinsong.com/blog/video-index/ GitHub: https://github.com/Espere-1119-Song/Video-Index Hugging Face: https://huggingface.co/datasets/Video-Index/Video-Index

[42] Concept Driven Domain Adaptation: Finding an Abstract Needle in a Haystack cs.CV | physics.ed-phPDF

Haiming Zhao, Tai Wang, Kun Zhang, Xicheng Peng, Zhiyang Li

TL;DR: CDDA把教材中的科学概念先与具体实例对齐，再将概念感知的语义结构迁移到纪录片视频，执行抽象概念到稀疏视觉证据的检索。

Details

Motivation: 教师寻找教学视频时常按抽象科学原理检索，而现有视频片段检索通常假设查询描述可直接观察事件，难以把概念落地到纪录片中的具体现象。

Result: 三阶段框架先用教材和教师手册例子—概念对构建文本空间，再在冻结视觉编码器下转移概念几何，最后用稀疏视觉概念监督联合适配编码器。在自建中学物理检索基准上，CDDA的教学概念检索优于包括Qwen3-VL-Embedding-2B在内的多模态基线，同时保持具体图文匹配能力。

Insight: 抽象概念可作为文本与纪录片视觉之间的中间语义锚点，降低跨模态语义鸿沟而不抹掉具体图像描述对齐。评估集中于中学物理和自建基准。

Abstract: Science teachers frequently search for documentary excerpts not by describing what appears on screen, but by querying the abstract concepts they intend to teach. This use case exposes a limitation of existing language-based video moment retrieval methods, which typically assume that queries describe observable events, whereas instructional search requires retrieving concrete visual phenomena that instantiate an underlying scientific principle. We study this setting as concept-to-example video retrieval, an abstract-needle-in-a-haystack problem where compact curriculum concepts must be grounded in temporally sparse documentary evidence. To bridge this abstraction gap, we propose Concept-Driven Domain Adaptation (CDDA), a three-stage framework for adapting two-tower vision-language models to concept-level retrieval. CDDA treats concepts as intermediate semantic anchors: it first structures the textual embedding space with textbook and teacher-handbook example-concept pairs, then transfers this concept-aware geometry to documentary visuals under a frozen visual encoder, and finally jointly adapts both encoders with sparse visual concept supervision. From a geometric perspective, this staged alignment reduces text-concept and vision-concept angular gaps, thereby encouraging concept-level adaptation while preserving the pretrained model’s concrete image description alignment. On a curated middle-school physics retrieval benchmark, CDDA achieves stronger pedagogically oriented concept retrieval than several competitive multimodal baselines, including Qwen3-VL-Embedding-2B, while maintaining concrete image-text matching after adaptation.

[43] VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations cs.CVPDF

Xianda Du, Max Ku, Weiming Ren, Zhi Rui Tam, Chunlin Ren

TL;DR: VIEScore2在单次模型前向中同时预测图像质量分数和缺陷位置，用网格文本表示统一图像生成与编辑评估。

Details

Motivation: 现有合成图像评估器通常只输出整体质量分数，无法指出哪些图像区域支撑判断，也难统一利用不同空间监督数据。

Result: 模型将图像表示为N×N网格，在生成和编辑的38K样本上用仅评分、仅定位及联合监督训练，并以GRPO优化缺陷定位。主基准总体分数SRCC为0.601，高于匹配输入下最强零样本通用VLM Gemini-3-Flash的0.491；定位任务在六个基准中三个超过通用和专用评估器，五个进入前三，包括训练源之外的数据集。

Insight: 把分数和位置解释作为联合结构化输出，可让图像评价更可核验，也便于对定位使用直接奖励。模型在跨域定位上并非所有基准都领先，仍应按任务报告结果。

Abstract: Existing synthetic image evaluators typically provide only a scalar quality score and do not identify the image regions that support it. We introduce VIEScore2, a unified evaluator for image generation and editing tasks with optional conditioning images. VIEScore2 represents an image as an N x N grid and jointly predicts quality scores and defect locations in a single model pass. Its text-native grid representation provides a common interface for heterogeneous spatial supervision and enables directly verifiable post-training objectives. We train on 38K examples spanning score-only, localization-only, and joint supervision across generation and editing tasks. Starting from supervised fine-tuning, we further apply GRPO to improve defect localization using rewards that combine cell-level Dice overlap, score accuracy, and output-format validity. A parameter-free parser converts the structured predictions into readable explanations. On the primary suite, VIEScore2 achieves an overall-score SRCC of 0.601, compared with 0.491 for Gemini-3-Flash, the strongest zero-shot general-purpose VLM baseline under matched inputs. For defect localization, VIEScore2 outperforms both general-purpose VLMs and specialized spatial evaluators on three of six benchmarks in per-image grid IoU and ranks among the top three on five, including datasets beyond its training sources.

[44] VASC: Value-Aware Sparse Attention with Cross-Layer Memory for Efficient 3D Reconstruction cs.CVPDF

Junyi Wu, Fanqing Kong, Leyang Chen, Shaoqiu Zhang, Yulun Zhang

TL;DR: VASC以查询相关性和邻近值对比度选取稀疏注意力块，并用执行感知跨层记忆补偿此前计算预算不足的区域。

Details

Motivation: 前馈3D视觉模型对长图像序列做全局注意力成本高；仅按注意力选择块可能保留高权重但内容冗余的区域，并反复忽视其他有价值信息。

Result: 无需训练的VASC把查询—键相关度与邻近值差异结合，并按实际执行情况跨层更新未服务需求。在7Scenes和NeuralRGB-D上对VGGT、π³评测，姿态估计和重建质量优于FasterVGGT；相较稠密VGGT推理最高快2.29倍。

Insight: 稀疏注意力不仅应估计当前相关性，也应记录计算预算历史，给先前未覆盖区域保留竞争机会。结果显示效率和质量可同时改善，但最高加速来自特定数据和模型组合。

Abstract: Feed-forward 3D vision models such as VGGT have achieved remarkable progress, unifying camera estimation and dense scene reconstruction in a single pass. However, their quadratic global attention makes long image sequences expensive, while existing sparse methods may favor highly attended yet value-redundant regions. To address these limitations, we introduce VASC, a training-free sparse attention method combining value-aware block selection and execution-aware cross-layer memory. Our value-aware block selection integrates pooled query–key relevance with neighboring value contrast, reducing redundancy while preserving query-relevant and distinctive content. Cross-layer memory tracks unserved demand across layers and updates this state according to actual execution, enabling previously underserved blocks to compete under a fixed computation budget. Experiments on 7Scenes and NeuralRGB-D with VGGT and $π^3$ demonstrate improved pose estimation and reconstruction quality compared with FasterVGGT, together with up to $2.29\times$ faster inference than dense VGGT. Code is available at https://github.com/kosakayamahoo-design/VASC.

[45] Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning cs.CV | cs.SD | eess.ASPDF

Gunwoo Lee, Yoori Oh, Yoseob Han

TL;DR: WYS在静音说话视频语音合成中加入候选文本作为明确语言条件，缓解口型到话语的一对多歧义并生成文本可控语音。

Details

Motivation: 仅凭视觉动作常无法唯一确定说话内容，视频到语音合成因此面临一对多映射；输出既需自然，又要保证音素内容准确和音画同步。

Result: WYS用注意力嵌入融合模块结合文本和视频序列，并以条件流匹配生成高保真语音。在LRS2和LRS3上，模型在音视频同步指标LSE-C/D达到新的最佳结果，同时WER保持竞争力；主观评价显示语音接近人类自然度。

Insight: 显式文本条件补足口型中缺失的语言信息，使模型能控制语音内容而非仅从模糊视觉信号猜测。同步改善不代表所有语言和真实配音场景均已验证。

Abstract: Video-to-speech synthesis aims to generate natural-sounding speech from silent talking-face videos while ensuring phonetic accuracy. A fundamental challenge in this task is the inherent one-to-many mapping problem, where visual dynamics often lack sufficient information to uniquely determine the corresponding utterance. To address this, we propose Watch Your Speech (WYS), a video-to-speech synthesis framework that incorporates textual conditioning as an explicit linguistic cue to mitigate visual ambiguity. Our framework features an attention-based embedding fusion module that synergistically integrates textual context with video sequences, coupled with a conditional flow matching objective for high-fidelity speech generation. Extensive experiments on the LRS2 and LRS3 datasets demonstrate that WYS achieves superior performance, establishing new state-of-the-art results in audio-visual synchronization (LSE-C/D) while maintaining highly competitive textual accuracy (WER). Subjective evaluations further confirm that our model generates speech with near-human naturalness, validating the effectiveness of textual conditioning in content-controlled video-to-speech synthesis. Project page: https://github.com/gunwoo5034/Watch-your-Speech

[46] FutureWorlds: Learning Robotic World Models from Alternative Futures cs.CV | cs.ROPDF

Hao Wu, Shengju Qian, Weiyan Wang, Fan Xu, Fan Zhang

TL;DR: FutureWorlds通过多样束搜索构造机器人动作条件的替代未来，用候选专属有界记忆保持轨迹一致，再以视频轨迹奖励优化世界模型。

Details

Motivation: 替代未来可为机器人世界模型提供比较式训练信号，但候选太相似时难以排序，轨迹分叉后又需分别维护历史，生成和策略打分也必须使用相同上下文。

Result: MemSPO把视频轨迹奖励转换成组相对优势训练多模态离散自回归模型。在RT-1、BridgeV2和RoboCasa上，32帧预测LPIPS相较各数据集最强基线分别降低14.78%、20.84%和9.12%；仅200次更新还能继续改善并支持超训练时域预测。记忆消融和光流评估显示，收益不仅体现在画面质量，也提升运动预测和物体状态一致性。

Insight: 多样候选、独立轨迹记忆和相对质量奖励构成有效闭环，记忆保证生成与策略评分基于匹配历史。LPIPS改善并非唯一证据，运动和状态评估也支持动态预测质量提升。

Abstract: Robotic world models predict action-conditioned future scenes, providing a foundation for understanding action outcomes. However, turning alternative predictions into useful learning signals remains challenging: similar candidates limit informative quality comparisons, while diverging trajectories require persistent maintenance of their individual histories. We introduce FutureWorlds, a framework that unifies candidate construction, history maintenance, and learning from relative quality. Built on a multimodal discrete autoregressive model, FutureWorlds uses diverse beam search during reinforcement learning to construct candidate futures that balance confidence and diversity. Candidate-specific bounded memory preserves scene states and ensures that generation and policy scoring use matching histories. We further propose MemSPO (Memory-Conditioned Search-Guided Policy Optimization), which converts video trajectory rewards into group-relative advantages to optimize the world model. On RT-1, BridgeV2, and RoboCasa, FutureWorlds reduces LPIPS for 32-frame predictions by 14.78%, 20.84%, and 9.12%, respectively, relative to the strongest baseline on each dataset. Under fixed evaluation configurations, only 200 MemSPO updates further improve generation quality and support continued prediction beyond the training horizon. Memory ablations, decoding sensitivity analysis, and optical-flow evaluation show that these gains extend beyond visual quality to more accurate motion prediction and more consistent object states. Project page and code: https://github.com/Alexander-wu/FutureWorlds.

[47] Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation cs.CVPDF

Arash Rocky, Q. M. Jonathan Wu

TL;DR: ASH用重叠时间分块和跨块身份匹配扩展任意长度视频追踪，GPT虚拟提示批处理则让SAM3同时处理多个文本类别而避免重复图像编码。

Details

Motivation: 记忆注意力视频分割虽有零样本能力，但显存限制长视频，单提示推理又使多类别开放词汇追踪随类别数增长而成本过高。

Result: GPT把N个文本提示通过虚拟批处理同时送入SAM3，将图像编码成本从O(N)降至O(1)，不改学习参数；ASH用重叠时间块及IoU身份匹配处理任意长序列，无需数据集专训。SAM3-ASH在MOTS20零样本HOTA达到当前最佳，并在另七个基准上接近训练专用方法，峰值GPU显存低于25GB。

Insight: 多提示可共享图像编码，长视频可通过身份一致的分块扩展，二者共同降低自动标注成本。系统在零样本设置下具实用性，但摘要未列其他七个基准的具体差距。

Abstract: Memory-attention-based Video Instance Segmentation (VIS) methods have demonstrated strong zero-shot tracking capability, yet their substantial memory requirements confine them to short video clips and their single-prompt inference design makes multi-category open-vocabulary tracking computationally prohibitive. This work introduces two contributions toward fully automated tracking annotation of arbitrary video. The Generalized Presence Token (GPT) reformulates SAM3’s inference pipeline to process N text prompts simultaneously via virtual prompt batching, reducing image encoding cost from O(N) to O(1) with no modifications to any learned component. The Annotation and Segmentation Handler (ASH) extends any memory-attention VIS tracker to sequences of arbitrary length through overlapping temporal chunks with IoU-based inter-chunk identity matching, requiring no dataset-specific training. Instantiated on SAM3, the resulting pipeline – SAM3-ASH – achieves state-of-the-art HOTA on MOTS20 under fully zero-shot conditions and remains competitive with trained specialists across seven additional benchmarks, while peak GPU memory consumption stays below 25 GB, establishing a practical baseline for scalable, training-free automated video annotation.

[48] Bootstrapping Video Interaction Generation with Synthetic State Transitions cs.CVPDF

Jiho Jang, Jinyoung Kim, Nojun Kwak, Kyungjune Kim

TL;DR: 该框架用图像编辑模型为可控物理交互生成起始与结束状态图像，再以状态引导采样合成过渡视频并自动评估数据质量。

Details

Motivation: 高保真视频生成仍难表现合理物理交互及其状态变化，这限制了机器人和VR/AR应用；大规模可控交互训练数据难以获取。

Result: 数据管线按结构化交互分类生成明确起止状态作为视觉锚点，State-Guided Sampling据此减少普通条件生成的伪影，并设计与人类判断对齐的自动质量评估。用合成数据微调基础模型后，其生成合理物理交互视频的能力明显增强；摘要未提供具体增益数值。

Insight: 明确标注交互前后状态可为模型提供比自然视频弱监督更直接的物理变化约束，采样器负责连贯连接状态。当前报告证明了微调可改善交互合理性，但量化规模和泛化范围未披露。

Abstract: While recent video generative models can synthesize high-fidelity videos, they struggle to portray plausible physical interactions and the resulting state transitions, a critical bottleneck for applications in robotics and VR/AR. To address this, we introduce a framework to generate a scalable synthetic dataset of controllable interactions. Our pipeline leverages a structured taxonomy and state-of-the-art image editing models to create explicit start' and end’ state images, which serve as visual anchors for the interaction. To generate a seamless video utilizing these anchors, we propose State-Guided Sampling (SGS), a novel sampling technique that mitigates artifacts common in naive conditional generation. Furthermore, we develop and validate a new automated evaluation system that aligns with human judgments to ensure data quality. Experiments show that fine-tuning a base model on our dataset significantly enhances its ability to generate plausible interactions.

[49] Towards Subject Consistency over Dynamic Subject Sets in Video Generation cs.CVPDF

Tongcheng Zhang, Jun Zhu, Jianfei Chen

TL;DR: DynSC-Eval追踪视频中随时间出现的动态主体集合，用六项对象级指标分别评估局部连续性和全局身份一致性，并可将指标转为后训练奖励。

Details

Motivation: 长视频生成中的主体会进入或离开画面，固定主体集合和传统指标难以反映其可见期间的局部连续及跨片段身份保持，也难定位具体不一致事件。

Result: 合成注入不一致事件验证了指标敏感性，并显示传统指标存在盲点；对5、15、60秒生成的比较也揭示传统测量掩盖的模型差异。将DynSC奖励用于自动驾驶测试床DiffusionNFT后，5秒视频六项不一致指标平均降低：Wan-2.1-1.3B为13.82%，SANA-2B为5.66%，ReSim图生视频也有提升。课程学习扩展到10、30秒时仍能优化一致性并基本保留其他能力。

Insight: 主体一致性应按每个对象实际可见生命周期动态评估，并同时关注局部连续与全局身份。指标还能形成训练奖励，但摘要报告的平均值对应特定模型和5秒生成设置。

Abstract: We argue that as video generation extends to longer durations, subject consistency should be evaluated over \textit{dynamic subject sets}. We therefore introduce \textbf{DynSC-Eval}, an evaluation framework that dynamically tracks eligible subjects throughout their visible lifespans and measures local continuity and global identity preservation using six complementary object-level metrics, with explicit detection of inconsistency events. To validate its effectiveness, we design synthetic experiments that actively inject inconsistency events, demonstrating both the sensitivity of DynSC-Eval and the limitations of existing metrics. Evaluations of diverse models on 5s, 15s, and 60s video generation further reveal substantial subject consistency differences that are obscured by conventional metrics. Beyond evaluation, we construct rewards from DynSC-Eval and apply DiffusionNFT post-training in an autonomous-driving testbed. On 5s generation, our approach reduces the six inconsistency metrics by an average of 13.82% for Wan-2.1-1.3B and 5.66% for SANA-2B, with improvements also observed on the I2V model ReSim. Qualitative comparisons further demonstrate the effectiveness of our method. We then extend generation to 10s and 30s through curriculum learning and show that consistency optimization remains effective while largely preserving other capabilities.

[50] HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstruction cs.CV | eess.IVPDF

Bi’an Du, Zhimin Zhang, Daizong Liu, Baoquan Chen, Wei Hu

TL;DR: HierGF通过几何—感知消息传递，把稀疏视角的粗3D几何和生成先验转成伪监督，并以置信度和几何一致稠密化补足未采样区域。

Details

Motivation: 随机稀疏视角只有有限3D信息，导致多视角一致性难建立、未覆盖区域缺结构；仅依赖重投影误差和启发式稠密化易过拟合单视图并产生模糊或空洞。

Result: 方法采用两阶段几何感知骨干，将粗3D几何和2D生成先验转成结构化伪监督，用可学习置信度网络引导梯度关注跨视图一致内容，再以几何一致模块改善稀疏区域重建。摘要介绍了方法设计，尚未提供实验指标或与基线比较结果。

Insight: 稀疏视角重建可从固定先验转向由当前几何和生成模型共同产生伪监督，并利用置信度筛选信息。摘要缺少量化实验，暂不能判断其性能和适用条件。

Abstract: Sparse view 3D reconstruction is an important and common scenario in multimedia applications, such as augmented reality/virtual reality (AR/VR) content creation, cultural heritage digitization, and certain robotic applications, where only a limited number of randomly captured views may be available. However, sparse views contain only limited 3D information, posing two major challenges:1) too few images are available for matching, making it difficult to build multi-view consistency; 2) insufficient view coverage leads to a lack of information in under-sampled regions, resulting in missing parts of object structure. Existing methods mostly still rely on limited reprojection errors and regularization terms, which are prone to overfitting to a single view and inconsistent appearances across views. In geometrically under-sampled regions, they often rely on heuristic density control, lacking reliable guidance and often resulting in blurring and structural holes.To address these issues, this paper proposes Hierarchical Gaussian Fields (HierGF), which revisits sparse-view reconstruction from a hierarchical geometry-perception perspective and converts limited observations into reliable self-generated supervision beyond fixed priors and heuristic density control. In particular, we transform coarse 3D geometric information and additional 2D generative priors into structured pseudo-supervision through a two-stage geometry-perception backbone network, thereby enhancing multi-view consistency with very few input views. In addition, we introduce a learnable confidence network to guide gradients toward cross-view consistent content, and a geometrically consistent densification module to improve the reconstruction of multi-view alignment and under-sampled regions.

[51] Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation cs.CVPDF

Patrick Amadeus Irawan, Iskandar Muda Rizky Parlambang, Rava Maulana, Qinrong Cui, Erland Hilman Fuadi

TL;DR: Ego2Act评估视频生成模型能否从第一人称视角规划并模拟多步物体操作完成高层目标，而非只生成逼真的短时动作。

Details

Motivation: 视频模型作为具身世界模拟器需预测目标动作如何改变环境，但既有基准集中于单个短动作或逐步指令，较少检验多步物理推理和最终目标完成。

Result: Ego2Act含110项日常任务的2,640段视频，给定初始场景和高层目标，要求生成手部操作物体的第一人称视频；无参考评估器Ego2ActJudge与人类对任务完成及物理合理性的共识更一致。评测发现模型常跳过或只部分执行步骤，导致后续依赖状态缺失，并在精细物理动态、复杂操作和持续世界建模上持续失败。

Insight: 目标导向生成需要评估动作序列是否完整执行并维持依赖状态，不应只测单帧逼真度。该基准突出当前视频模型的规划与物理能力差距。

Abstract: Video generation models are increasingly being explored as world simulators for embodied planning and learning. To do so effectively, these models must not only generate visually appealing frames, but also predict how environments dynamically evolve when executing goal-directed actions. While evaluating these capabilities is crucial, existing benchmarks focus mainly on single short actions or step-by-step instructions. This leaves multi-step physical reasoning underexplored, especially in egocentric video generation that requires planning to simulate proper execution to accomplish high-level goals by carrying out multiple real-world manipulations. We introduce Ego2Act, a goal-directed benchmark featuring 2,640 videos from 110 real-world tasks across day-to-day settings, varying object clutter and multi-step complexity. Given an initial scene image and a high-level goal, Ego2Act evaluates whether video generation models can produce realistic egocentric videos of a hand manipulating objects to carry out the task. To support scalable evaluation, we also introduce Ego2ActJudge, a reference-free evaluation pipeline that achieves better task completion and physics plausibility evaluation alignment with human consensus compared to relevant baselines. Our findings reveal that models’ generated simulations often skip or partially execute steps, leaving later steps missing dependent states, which leads to unfulfilled goal. Furthermore, models consistently fail at fine-grained physical dynamics, particularly during complex object manipulation and persistent world modeling. We hope Ego2Act provides a rigorous testbed for advancing video models toward physically plausible, goal-directed simulation.

[52] MVDG: Efficient Multi-view 3D Disambiguation on Unconstrained Real-World Images cs.CVPDF

Hanyuan Xiao, Gonglin Chen, Haolin Xiong, Wenbin Teng, Haiwei Chen

TL;DR: MVDG利用VGGT的多视图3D特征一次联合消歧相似外观的不同表面，降低逐图像对比较的二次推理成本。

Details

Motivation: 大规模野外3D重建和视觉定位常将外观相似但实体不同的表面误匹配；成对分类器缺少多视图上下文，且结构运动中推理复杂度为O(n²)。

Result: MVDG以单次前馈编码任意数量视图，并用从AerialMegaDepth构造的伪成对训练数据缓解标签歧义和噪声，使VGGT微调更稳定、泛化到留出场景。为降低完整SfM验证成本，作者在伪成对集验证并建立常规SfM指标与分类准确率关系。实验显示其成对准确率相当，同时SfM准确性和推理速度优于基线，但摘要未给出具体数值。

Insight: 跨视图联合几何上下文可缓解相似表面歧义，并避免对所有图像对独立计算。伪成对验证为昂贵SfM评估提供代理，但量化提升尚未在摘要中披露。

Abstract: Illusory matches between distinct yet visually similar 3D surfaces–doppelgangers–remain a fundamental obstacle for large-scale, in-the-wild 3D reconstruction and visual localization. Prior work mitigates this issue with pairwise classifiers, but this design limits multi-view contextual reasoning and incurs O(n^2) inference complexity for downstream structure-from-motion (SfM). We present MVDG, a scalable multi-view disambiguation framework built on the 3D foundation model VGGT, which jointly reasons over an arbitrary number of multiview images. By incorporating 3D-aware multi-view features, our method reduces dependence on pairwise comparisons by encoding and decoding views in a single pass. We further observe that direct multi-view fine-tuning of VGGT can be unstable under noisy supervision; motivated by label ambiguity in Doppelgangers, we construct a pseudo-pairwise training set from AerialMegaDepth and show that fine-tuning on sampled subsets yields stable optimization and strong generalization to held-out scenes. Finally, because full SfM evaluation (even with faster pipelines such as GLOMAP) remains expensive, we process a pseudo-pairwise dataset for efficient validation; we derive a predictive relationship between regular SfM metrics and the classification accuracy on this pseudo-pairwise test. Experiments show that our method achieves comparable pairwise accuracy while improving both SfM accuracy and inference speed over baselines.

[53] Affine-Aligned Atlas for Canonical Gaussian Construction in Video Representation cs.CVPDF

Masaya Takabe, Hiroshi Watanabe, Sujun Hong, Tomohiro Ikai

TL;DR: Affine-Aligned Atlas在构造规范高斯前用逐帧仿射变换吸收全局运动，减少规范表示与大幅相机运动帧之间的错位。

Details

Motivation: 基于规范高斯的视频表示通常把视频分成静态规范高斯和时序变形；遇到明显相机运动时规范空间与帧不对齐，迫使变形模型承担过大运动。

Result: 方法在更大的仿射对齐图集空间构造规范高斯，使每帧仿射变换先吸收全局运动。它仅改动规范表示构建阶段，可集成到现有规范高斯方法且几乎不增加参数。实验显示在相机运动较大的序列上重建质量改善；摘要未给出具体数值。

Insight: 将全局运动从局部时序变形中分离，可降低表示与目标帧的差距，也便于复用既有规范高斯模型。收益在大幅相机运动序列更明显。

Abstract: Gaussian splatting has recently emerged as an efficient representation for images and videos due to its explicit structure and fast rendering capability. Existing Gaussian-based video representations often decompose a video into canonical Gaussians and temporal deformation. However, when a video contains large global motion such as camera movement, the canonical representation may become misaligned with individual frames, increasing the burden on the temporal deformation model. In this paper, we propose an affine-atlas canonical Gaussian representation, which constructs canonical Gaussians in a larger affine-aligned atlas space. Frame-wise affine transforms absorb global motion before canonical Gaussian construction, reducing the gap between the canonical representation and target frames. Since the proposed method only modifies the canonical construction stage, it can be integrated into existing canonical-Gaussian-based methods with negligible additional parameter cost. Experiments show that our method improves reconstruction quality especially for sequences with large camera motion.

[54] PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models cs.CV | cs.ROPDF

Isaiah Milkey, Som Sagar, Aditya Taparia, Xinyuan Liu, Jiqing Wen

TL;DR: PhysicsLENS通过保持视频条件帧和任务不变、只改变隐藏物理属性的配对场景，评测视频生成模型是否真正遵守机器人相关物理条件。

Details

Motivation: 视频模型可能生成看似合理却违反重量、黏度或摩擦等不可直接从图像观察的属性；既有基准主要评价画面像不像物理，而非视频是否遵循明确物理设定。

Result: PhysicsLENS涵盖碰撞、重力、动量、摩擦、形变、流体和因果七个领域，评估四种生成模型并收集400余条人工标注。结果显示，47个场景中有34个视频虽然看起来合理，却忽略了给定物理属性；显式说明属性只轻微且不显著地降低表面合理性。

Insight: 视觉观感合理并不代表生成遵循指定物理，评测需使用外观条件匹配但隐藏物性不同的对照。当前实验表明模型常忽视不可见属性，外观指标难以发现此类错误。

Abstract: Reliable video world models could provide scalable predictive environments for robot learning, planning, and evaluation. However, generated robot videos can violate physical principles and complete tasks through physically implausible behavior, limiting their reliability for robot learning and planning. Current video-generation benchmarks exclude physics that are inherently hidden by visuals (e.g., weight, viscosity, friction). Due to this, video models are evaluated on the fidelity of physics, not the underlying accuracy of physics. We introduce PhysicsLENS, a dataset and benchmark for evaluating plausibility of physical properties grounded in robotics. PhysicsLENS uses matched scenario pairs that hold the same conditioning frame and task, while varying underlying physics in the scene description. Scenarios are curated from public robot video sources and annotated across seven physical domains: collision, gravity, momentum, friction, deformation, fluid, and causality. We evaluate across four video generation models, producing over 400 human-annotated labels. Results show that plausible-looking videos often ignore the stated property (34 of 47), and that stating the property lowers plausibility only slightly and not significantly.

[55] CineMR: Tool-Integrated Vision-Language Reasoning for Quantitative Cardiac MRI Assessment cs.CV | cs.AIPDF

Kunyang Li, Hai Nguyen, Joshua Lowe, Chenguang Zhao, Peace C. Madueme

TL;DR: CineMR通过心脏图像分析工具和交错推理完成电影MRI定量评估，并用工具交互监督和条件奖励强化学习提升工具调用可靠性。

Details

Motivation: CMR判读既要视觉评估，也要计算心室容积、射血分数、心肌质量和局部运动；当前医学VLM难以仅凭多维电影图像可靠推导这些量。

Result: 作者构建涵盖定量指标、分类和鉴别诊断的多队列VQA基准及分割、相位选择、容积测量等工具。CineMR在基准上pass@1为35.9%、pass@4为58.9%，Qwen3-VL-8B骨干pass@1为1.5%；GRPO后正确调用工具率从SFT的78.9%升至99.8%。实时工具输出使心室测量准确性较直接模型预测提高20.4%—23.7%，移除工具后pass@1降至27.9%。

Insight: 定量医学图像推理需要可靠工具调用，将计算结果与语言推理交错整合，比要求VLM直接从多维影像估数更有效。移除工具的消融验证了工具对总体表现的贡献。

Abstract: Cardiovascular magnetic resonance (CMR), including cine imaging, is a reference standard for the noninvasive assessment of cardiac morphology and ventricular function. Cine CMR interpretation integrates qualitative visual assessment with quantitative measurements of ventricular volumes, ejection fraction, myocardial mass, wall thickness, and regional wall motion. Current medical vision-language models (VLMs) cannot reliably derive quantitative measurements from multidimensional cine images without analysis tools. We present CineMR, a tool-augmented VLM that invokes cardiac image-analysis tools and integrates their outputs into interleaved reasoning for quantitative CMR assessment. We also construct a multi-cohort visual question answering benchmark covering quantitative metric extraction, multiclass diagnosis, and differential diagnosis, together with tools for segmentation, phase selection, volumetry, morphometry, and regional wall motion analysis. CineMR is trained with supervised fine-tuning (SFT) on tool-interaction traces followed by Group Relative Policy Optimization (GRPO) with conditional tool-use rewards. On the multi-cohort cine CMR benchmark, CineMR achieves 35.9% pass@1 and 58.9% pass@4, compared with 1.5% pass@1 for the Qwen3-VL-8B backbone and 0.0% and 7.0% pass@1 for LLaVA-Med v1.5 and MedGemma-4B, respectively. Correct tool invocation reaches 99.8% after GRPO, up from 78.9% after SFT. Live tool outputs improve ventricular measurement accuracy by 20.4–23.7% over direct model predictions, and removing all tools reduces pass@1 from 35.9% to 27.9%. These results highlight the importance of reliable tool use for quantitative cine CMR reasoning and support CineMR as a promising approach for assistive cardiac image assessment. Code, benchmark resources, and model weights are available at https://github.com/AI-MIND-Lab/CineMR.

[56] FlashBack: Knowing When to Remember in Streaming Vision-Language Models cs.CVPDF

Yi Chen, MingMing Yu, Rui-Qi Wang, Boran Wang, Xiaohang Cao

TL;DR: FlashBack先判断流式视频查询是否需要历史证据，仅在需要时启用隔离的回忆路径，并通过查询局部KV结合近期上下文和长期记忆。

Details

Motivation: 流式VLM要在实时感知和长期记忆之间分配有限计算；历史召回并非总有帮助，不必要上下文可能干扰当前感知，因此系统还需判断何时检索。

Result: 无需训练的FlashBack利用冻结VLM语义判断，在原生实时路径和独立回忆路径间选择；回忆路径通过Side-KV合并近期片段与长期记忆，不修改持久原生状态。在StreamingVLM和Mage-VL-4B上对OVO-Bench、StreamingBench评估，多个长程及记忆依赖任务改善，同时基本保留实时感知，且无需训练即可接近强训练式方法。

Insight: 选择性调用历史可避免把所有记忆无差别注入当前推理；隔离回忆路径让实时状态免受历史干扰。摘要报告部分任务提升和实时能力保留，未给出具体分数。

Abstract: Streaming vision-language models must process continuously growing video streams under a bounded compute budget, creating a persistent tension between real-time perception and long-term memory. Retrieving historical information provides a natural remedy, yet historical recall is not uniformly beneficial: unnecessary history may introduce irrelevant context into current reasoning and interfere with native real-time perception. Effective streaming memory should therefore address not only what to remember, but also when and how to access it. To this end, we introduce FlashBack, a training-free framework for selective, multi-level memory in streaming vision-language models. Before retrieving history, FlashBack draws on the semantic understanding of the frozen streaming VLM to infer whether a query calls for historical evidence. This assessment determines whether inference remains on the Native trajectory or invokes an isolated Recall trajectory. The Recall trajectory combines recent context with retrieved long-term memory through a query-local Side-KV pathway, preserving local temporal continuity without modifying the persistent Native state. We instantiate FlashBack on StreamingVLM and Mage-VL-4B and evaluate it on OVO-Bench and StreamingBench. The results show improvements on several long-horizon and memory-dependent tasks while largely preserving real-time perception, with performance competitive with strong training-based streaming methods despite requiring no additional training. Our code will be announced later.

[57] Skeleton-and-Strategy Prompting: Training-Free Negation Understanding for Vision-Language Models cs.CVPDF

Yuliang Cai, Mohammad Rostami, Jesse Thomason

TL;DR: SSP从否定问句提取结构骨架，检索少量同骨架问题并归纳否定策略，再把策略作为上下文提示给VLM。

Details

Motivation: VLM在视觉问答中常难处理否定子句，容易忽略“不、没有”等逻辑操作而答错；直接增加参数训练会带来成本。

Result: 无需更新参数的SSP通过轻量问题池执行同构示例检索和策略归纳，在多个否定VQA基准上达到该类任务的当前最佳表现，同时保持计算效率；摘要未提供各基准具体分数。

Insight: 否定理解可通过识别问题结构并复用相同逻辑模式的解题策略来改善，而不必重训模型。该方法有效性依赖问题骨架检索质量和提示归纳能力。

Abstract: Despite the strong performance of Vision-Language Models (VLMs) on a wide range of visual question answering (VQA) tasks, these models consistently struggle to understand negation and produce incorrect answers when questions involve negated clauses. To address this limitation, we propose Skeleton-and-Strategy Prompting (\textbf{SSP}), a training-free, in-context learning method that improves VLM negation understanding capabilities without any parameter updates. Given a negation question, our method first abstracts the underlying question structure into a skeleton, retrieves a small set of same-skeleton questions from a lightweight question pool, then prompts the VLM to analyze their shared negation pattern and synthesize a single-sentence answering strategy. The skeleton and strategy are prepended to the test sample to guide the model correctly tackle the negation problems. Experiments on multiple negation VQA benchmarks show that SSP achieves state-of-the-art performance on negation-focused VQA tasks while remaining computationally efficient.

[58] iSEE: Object Permanence Through Self-Supervision cs.CVPDF

Pramish Paudel, Ajad Chhatkuli, Luc Van Gool, Danda Pani Paudel

TL;DR: iSEE用无标签自监督学习维持遮挡对象的身份和隐藏位置，分离外观与位置状态，并以对象重现位置作为唯一训练线索。

Details

Motivation: 对象中心视频模型的槽位在物体遮挡时容易丢失，难以检测遮挡、重识别重现对象并连续追踪其隐藏位置；这些能力通常依赖框、身份和可见性标注。

Result: iSEE利用槽位注意力相对自身历史变化检测遮挡，用双槽流分别保持外观和更新位置，并依据对象重现位置训练隐藏轨迹。在LA-CATER静态数据上，遮挡后将重现物体放回自身槽位的比例为86%，高于SlotContrast的32%；隐藏期间定位仅比有标签训练SOTA RAM低4.1 mAP。位置流还可作为世界模型动作用于下游规划。

Insight: 外观身份和连续位置需要在遮挡期间分开维护，重新出现可提供无标签监督来连接两者。结果显示自监督方法接近有监督定位性能，并支持规划使用位置状态。

Abstract: Object permanence, keeping track of an object’s identity and position while it is occluded, is central to video representations that track, predict and plan. Trackers that achieve it learn from boxes, track identities and visibility labels. On the other hand, self-supervised object-centric methods discover objects without labels: through slot attention, it represents a video as slots that bind to objects and follow them across frames. However, these slots are lost under occlusion, making the desired permanence impossible. Reasoning permanence is a hard problem because it requires to detect when an object becomes occluded, re-identify when object reappears, and keep the object’s hidden position continuous, using reapperance as the only learning cue. To address this, we propose iSEE, a novel framework that offers all three aforementioned requirements, without any labels whatsoever. We built iSEE using the following three proposed components: (i) Object evidence modelling: a slot’s attention, compared with its own past, reveals when its object is hidden. (ii) Appearance-position separation: two slot streams let the appearance be held for re-identification while the position keeps changing. (iii) Permanence from reappearance: a walker follows the hidden object’s position, trained only on where the object reappears. On LA-CATER static, iSEE returns a reappearing object to its own slot after 86% of occlusions, against 32% for SlotContrast, and localises it while hidden within 4.1 mAP of the label-trained SoTA RAM. The two streams also allow downstream planning, with the position stream as the action of a world model. Project page: https://insait-institute.github.io/iSEE/

[59] EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes cs.CVPDF

Hongming Fu, Jingcheng Shi, Wenjia Wang, Binhua Zuo, Bo Zhao

TL;DR: EgoFound3R用单次端到端前向同时估计第一人称视频中的世界坐标手部几何、可见性、接触和距离属性。

Details

Motivation: 第一人称相机移动和手部遮挡使世界坐标手重建困难；现有流程分开估计手与场景、交互属性依赖额外模型，多模型逐视频处理也难扩展到大规模标注。

Result: 模型利用结构化手部提示迁移几何先验、显式手表示解码交互属性，并以共享参数多速率结构降低成本。在OakInk-v2、TACO和HOI4D上，MPJPE较先前方法分别下降43.2%、22.4%和11.6%；同一前向还能预测逐点接触和距离，吞吐约提高6倍。

Insight: 手部几何和接触关系可在统一表示中联合恢复，降低大规模具身数据处理对多模型串接的依赖。多个数据集均改善，但绝对误差和吞吐基线细节未见于摘要。

Abstract: Egocentric video has become a primary source of supervision for embodied models, and its value rests on recovering hand motion in world coordinates, which camera motion and hand occlusion make difficult. Existing reconstruction pipelines typically separate hand and scene estimation, leave interaction attributes to separate task-specific models, and invoke several models per video, so no prior reconstruction model estimates these attributes and throughput becomes a practical constraint on large-scale annotation. We therefore introduce EgoFound3R, a unified end-to-end model that estimates world-space hand geometry in a metric scale shared with the scene, and predicts point-wise interaction attributes, including visibility, contact, and distance. The model integrates three designs: (i) structured hand prompts that transfer pretrained geometric priors to world-space hand reconstruction; (ii) an explicit hand representation that decodes hand geometry and interaction attributes; and (iii) a shared-parameter multi-rate design that lowers inference cost. Together, these designs predict hand geometry and point-wise attributes in one pass. On OakInk-v2, TACO, and HOI4D, EgoFound3R reduces the mean per-joint position error (MPJPE) by 43.2%, 22.4%, and 11.6% over previous methods and predicts point-wise contact and distance alongside the geometry in the same pass, while attaining approximately 6x higher throughput.

[60] Resolving Mixed Single-Photon LiDAR Returns for Foreground-View and Hidden Scene Reconstruction cs.CVPDF

Ziting Wen, Runrong Deng, Zili Zhang, Haitao Zheng, Yuecong Xu

TL;DR: 该方法从单光子LiDAR时间直方图识别单回波或双回波状态，并据此用双头神经场分开重建半透明遮挡物和后方场景。

Details

Motivation: 半透明屏幕和保护罩会同时产生前景与隐藏物体回波；弱回波可能并入宽峰或细小肩峰，单一表面或厚密度场也能拟合波形，因此波形拟合准确不等于几何正确。

Result: 框架先估计每条射线的回波证据，再将可靠锚点用于几何定位、所有射线用于波形重建，并提供固定机位下遮挡/无遮挡真实配对单光子数据集。真实数据实验显示，相比基线，隐藏场景深度和点云精度均改善。

Insight: 显式判断每条射线的回波结构，可避免把前景和隐藏表面混为单一几何解释。方法将波形拟合与几何锚定分开，摘要未给出精度提升数值。

Abstract: Partially transmissive screens and protective covers are common in robotic inspection, but they create mixed LiDAR returns from both the foreground material and the scene behind it. Conventional peak-based LiDAR usually discards weak hidden returns, while single-photon LiDAR records time-resolved histograms that preserve attenuated and overlapping echoes. However, existing transient reconstruction methods typically fit a single scene representation to the measured waveform. Under occlusion, weak or nearby foreground–hidden echoes can form a broad peak or subtle shoulder. Because such waveforms can also be explained by a displaced single surface or a thick density distribution, accurate transient fitting does not necessarily imply correct geometry. We propose a state-aware framework for foreground-view and hidden scene reconstruction from occluded single-photon histograms. For each ray, we estimate local echo evidence, identifying no reliable surface evidence, single-return evidence, or two returns. The inferred echo state routes supervision for a two-head neural field: all rays constrain waveform reconstruction, while reliable anchors provide geometry localization. We also introduce a real paired single-photon LiDAR occlusion dataset with occluded and clean captures at fixed poses. Experiments on a real dataset show improved hidden scene depth and point-cloud accuracy over baselines. Our results demonstrate single-photon layered reconstruction as a practical route for 3D perception through partially transmissive occluders.

[61] Semantic RGB–Depth Based Surgical Skill Assessment in Microscopic Stereo Videos cs.CVPDF

Jecia Z. Y. Mao, Sue M. Cho, Francis X. Creighton, Deepa Galaiya, Russell H. Taylor

TL;DR: 语义RGB-D框架将稀疏立体深度与稠密单目深度融合，再分离编码器械和解剖区域，评估显微外科医生的操作技能。

Details

Motivation: 仅使用RGB图像的技能评估忽略器械与解剖结构的三维关系，而高倍显微成像下立体匹配深度稀疏且不稳定，限制了其自动评估价值。

Result: 模型以回归融合生成稠密几何表示，并用层级注意力联合分析RGB语义流和深度流。在33例离体经口显微喉部手术、六名主刀医生的留一医生交叉验证中，语义RGB-D技能分类F1为0.938，高于语义RGB的0.696，也略高于语义深度的0.929；注意力还可显示模型关注的区域、视频片段和语义流。

Insight: 深度单独已提供较强技能线索，结合器械和解剖语义可进一步改善分类，并保留一定可解释性。评估样本来自33例离体手术，外部临床泛化仍需验证。

Abstract: Objective assessment of microsurgical technical skill is essential for competency-based training and quality assurance, yet existing video-based approaches predominantly rely on RGB images and therefore overlook the 3D spatial relationships that characterize instrument-anatomy interactions. Although stereo operating microscopes provide complementary depth information, conventional stereo matching algorithms can produce sparse and unreliable depth estimates under high-magnification imaging conditions, limiting their use for automated skill assessment. This work presents a semantic RGB-Depth framework for surgical skill assessment from microscopic stereo videos. A regression-based depth fusion method combines sparse metric stereo depth with dense monocular depth estimates to generate a dense geometric representation of the surgical scene. This representation is integrated with semantically decomposed RGB streams corresponding to individual surgical instruments and surrounding anatomy. A hierarchical attention architecture jointly encodes these streams to capture discriminative patterns of instrument use and instrument-anatomy interaction across surgeons at different training levels. The framework was evaluated on 33 ex vivo transoral microlaryngeal procedures performed by six surgeons, comprising attending surgeons and surgical residents, using leave-one-surgeon-out cross-validation. The proposed semantic RGB-Depth model achieved an F1 score of 0.938 for skill-level classification, compared with 0.696 for semantic RGB and 0.929 for semantic depth. These results suggest that geometric information can improve automated surgical skill assessment from microscopic stereo videos. The learned spatial, temporal, and semantic attention patterns also support qualitative examination of the scene regions, video segments, and semantic streams emphasized by the model.

[62] A Compact Explicit 4D Representation for Dynamic Scenes cs.CVPDF

Di Yang, Zhihao Li, Yanhai Xiong, Yufei Wang

TL;DR: Sparc4D用共享静态特征、时间槽和稀疏高斯表面表示动态场景，并存储稀疏源像素以在新视角保留细节纹理。

Details

Motivation: 紧凑动态场景表示必须同时保留跨时间表面和新视角外观；单靠学习特征压缩可能牺牲细纹理，逐帧存储完整信息又不经济。

Result: 32帧MultiCamVideo随机窗口平均状态约0.95M个32位等价值，首32帧协议约0.92M；首32帧PSNR为21.70 dB，高于MoVieS的20.40 dB，随机窗口则相近。关闭存储纹理后，时间槽将动态特征状态中位压缩4倍、均值由1.04M降至0.42M，目标视角重建质量基本不变。无需真实数据微调即可迁移DyCheck和Neu3D，纹理存储改善LPIPS但略降PSNR。

Insight: 少量真实源像素可补足稀疏潜变量不易压缩的细节，而时间槽负责紧凑动态状态。压缩和重建质量之间存在权衡，外部数据上纹理改善感知指标但可能牺牲PSNR。

Abstract: A compact dynamic-scene representation must retain both the surfaces seen over time and the appearance needed to render them from new viewpoints. We present Sparc4D, a feed-forward autoencoder that encodes a monocular video with known cameras into a sparse 4D scene state. Static features are shared across the clip, while spatially anchored temporal slots compress time-varying features. A sparse decoder produces 2D Gaussian surfels, while stored source pixels preserve fine texture through geometric re-projection. The state includes one full source frame and dynamic-region pixels sampled every fourth frame, alongside learned features and sparse occupancy. For a 32-frame MultiCamVideo clip, it averages 0.95M 32-bit-equivalent values on random windows and 0.92M on the first-32 protocol. On first-32, Sparc4D reaches 21.70,dB, compared with 20.40,dB for MoVieS. On randomly placed windows, their PSNR scores are comparable. With stored texture disabled, temporal slots compress the time-varying feature state by a median $4.0\times$ and reduce the mean state from 1.04M to 0.42M values, with essentially unchanged target-view reconstruction quality. Without fine-tuning on real data, Sparc4D transfers to DyCheck and Neu3D, where stored texture improves LPIPS while slightly reducing PSNR.

[63] Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimization cs.CVPDF

Zhen Zhou, Zhiwei Ning, Puhua Jiang, Sheng Zhang, Yifei Tang

TL;DR: DHO把3D生成中的负轨迹优化改为向匹配正样本动态靠拢，并在此基础上构建图像到3D几何生成框架Flow3D-Pro。

Details

Motivation: 直接将DPO、GRPO和NFT等2D视觉强化学习目标用于3D生成，主要让负轨迹远离原速度方向，却未明确指向偏好样本的目标速度场；在受限模型能力和奖励分布下收益有限。

Result: 最小成本吸引匹配为每个负样本分配不同正目标，时间感知动态校正再按剩余时间引导轨迹靠近目标。在线DHO优于代表性DPO、GRPO和NFT目标；Flow3D-Pro生成的3D几何质量超过现有网格生成方法，摘要未提供具体指标。

Insight: 负样本训练可转成带明确正样本目标的动态纠偏，而非单纯施加排斥信号。方法针对3D流匹配能力和轨迹分布的限制设计，结论仍以定性比较为主。

Abstract: Flow matching is central to 3D generation, yet in practice its reinforcement learning (RL) methods are largely adapted from 2D visual generation. Representative DPO-, GRPO-, and NFT-style objectives, when applied to negative trajectories, mainly steer predicted velocities away from the corresponding directions without explicitly specifying a target velocity field toward preferred samples. In 3D generation, constrained by pretrained model capabilities, rollout diversity, and reward-distribution complexity, directly applying these RL methods yields limited gains in geometric quality. We introduce a forward-process RL method \textbf{Dynamic Homing Optimization (DHO)}, which reformulates negative-trajectory optimization as positive-sample attraction-guided dynamic homing. Specifically, Minimum-Cost Attractive Matching (MAM) assigns each negative sample a distinct positive target, and Time-Aware Dynamic Correction (TDC) then redirects its trajectory toward the target using a remaining-time-aware corrective velocity. Building on asynchronous online DHO, we develop \textbf{Flow3D-Pro}, an image-to-3D geometry generation framework. Experiments show that DHO outperforms representative DPO-, GRPO-, and NFT-style objectives in 3D generation, while Flow3D-Pro produces higher-quality 3D geometry than existing mesh generation methods.

[64] When the Judge Acts: Auditing VLM-Guided Image Selection on Culturally Situated Prompts cs.CV | cs.AI | cs.CYPDF

Huichan Seo

TL;DR: 研究把VLM生成图像评审当作实际决策审计，比较被选图与人类评分、随机选择，并测试候选顺序是否改变选择。

Details

Motivation: VLM评审选择哪张生成图会直接决定用户看到的内容，但通常只按评分与人类偏好的一致性验证，忽略位置偏差和候选重排时决策是否稳定。

Result: 在300个文化语境提示上，4B评审仅略高于随机且低于CLIP基线；它在49%调用中选第一张（随机为28%），重排候选会使60%提示的选择改变。对该模型，跨顺序一致性筛选有效；但8B模型几乎无位置偏差且优于CLIP，同一筛选却会误删好选择。不同评审的刻板印象评分差异在跨顺序聚合或更大模型上不再可检测。

Insight: 候选一致性只有在针对特定评审故障时才有价值，不能把一种过滤器无条件用于新模型。评审上线前应按其位置偏差和错误类型重新审计。

Abstract: Vision-language models (VLMs) increasingly act as judges that pick the best of several generated images, so their choices decide what users see. Such judges are usually validated by score agreement with human ratings, not by the images they return. We audit VLM judges as decision-makers: on 300 culturally situated prompts, we compare the returned image with human ratings the judge never sees and with random choice from the same candidates, and repeat every decision with the candidates reordered. A 4B-parameter judge barely beats random and falls short of a CLIP similarity baseline. It picks the first image shown in 49% of calls (chance: 28%), and reordering changes its choice on 60% of prompts. For this judge, agreement across orders is informative: decisions that survive reordering are much better than random, whereas agreement with a weaker second judge keeps the wrong ones. An 8B judge shows almost no position bias and outperforms CLIP, yet for it the same filter mostly discards good decisions. Agreement helps only when it targets the judge’s failure mode, so filters must be re-audited whenever the judge changes. The 4B judge’s slight rise in stereotype ratings is no longer detectable after aggregating across orders or with the larger judge.

[65] PickMoment: Continuous-Time Single-Image-to-Video via Learning Deblurring and Blur-to-Video cs.CV | cs.AIPDF

Junseong Shin, Hyeonsu Jo, Daehyun Kim, Tae Hyun Kim

TL;DR: PickMoment把单图去模糊和视频生成统一为连续时间区间积分预测，让同一模型回答曝光窗口内任意子区间的平均清晰图像。

Details

Motivation: 运动模糊源于连续清晰信号在曝光窗口内积分，但现有方法多只预测曝光中心帧或固定帧集合，未直接建模任意时间区间的成像物理。

Result: PickMoment用子帧重建、区间可加性和零区间清晰帧三种监督学习统一连续时间模型，无需针对去模糊、模糊转视频或任意时刻恢复分别训练。GoPro和HIDE上优于生成式去模糊方法，在RealBlur上与恢复式方法竞争；GoPro-7模糊转视频逐帧保真度最高，单次前向完成而无需迭代采样。

Insight: 把模糊解释为时间积分，可让一个模型支持不同曝光子区间查询，并将去模糊与视频恢复联系起来。结果覆盖三类数据集，但摘要未列各任务的量化指标。

Abstract: Motion blur arises from the temporal integration of a continuous sharp signal over a finite exposure window, yet existing learning-based methods sidestep this physical model and predict only the sharp signal itself: most single-image deblurring methods recover a single frame at the exposure center, while blur-to-video methods predict a fixed set of frames. We introduce PickMoment, a continuous-time reformulation that directly learns the interval-mean blur over arbitrary sub-intervals of the exposure with a single deterministic model. Drawing an analogy to MeanFlow’s average-velocity formulation, we train the model with three supervisions derived from the blur integral: an empirical reconstruction loss from available subframes, an additivity loss that enforces self-consistency across overlapping sub-intervals, and a sharp-frame loss anchored at the zero-interval limit. A single trained model unifies single-image deblurring, blur-to-video generation, and continuous-time pick-a-moment recovery as different queries to the same network, with no separate training for each task. Our PickMoment achieves state-of-the-art performance among generative-based deblurring methods on GoPro and HIDE while competitive against restoration-based methods on RealBlur, and the highest per-frame fidelity on GoPro-7 blur-to-video, all in a single forward pass without iterative sampling.

[66] Dyna3: VLM-Guided Training-Free 4D Reconstruction via Depth Foundation Models cs.CVPDF

Xinhao Xiang, Weiyang Li, Zhijie Zheng, Abhijeet Rastogi, Jiawei Zhang

TL;DR: Dyna3无需微调地扩展Depth Anything 3到动态4D重建，用跨帧最佳特征匹配区分静态背景和运动物体，并由VLM生成语义提示指导分割。

Details

Motivation: 深度基础模型的多视图能力通常假设场景静态；现有免训练4D方法依赖具跨帧匹配注意力的骨干，而纯深度模型缺少该特性。

Result: Dyna3发现深度一致性训练的跨视图特征结合最佳匹配搜索后隐含运动判别信息，再以VLM生成场景提示驱动SAM3做实例分割，重建时分离对齐静态背景和逐帧动态点云。四个数据集上，动态目标分割J-Mean比VGGT4D高5.5个百分点；位姿估计最高快13倍，4D重建快3倍且显存低4至8倍。

Insight: 深度模型中的匹配线索不必显式为对应关系训练，也可用于区分动态对象；语义分割进一步区分“哪些对象在动”和“场景里有哪些对象”。更低成本支持更密集时序采样。

Abstract: Recent depth foundation models like Depth Anything 3 (DA3) achieve remarkable multi-view depth estimation but assume static 3D scenes, limiting their applicability to real-world dynamic environments. Existing training-free 4D methods like Easi3R and VGGT4D rely on correspondence-trained backbones whose attention encodes cross-frame matching, a property absent in depth-only models like DA3. We present Dyna3, a training-free framework that extends DA3 for 4D dynamic scene reconstruction without any fine-tuning. Our key insight is that DA3’s cross-view features, though trained only for depth consistency, implicitly encode motion-discriminative signals when combined with best-match feature search across frames. Its static surfaces find consistent matches globally, while dynamic objects cannot. We further adopt vision-language models (VLM) to automatically generate scene-specific semantic prompts for SAM 3, enabling precise instance-level segmentation that distinguishes which objects move from what objects exist. For reconstruction, we decouple the scene into a cross-frame aligned static background and per-frame dynamic point clouds. Experiments on four datasets demonstrate that Dyna3 surpasses correspondence-trained methods with +5.5pp J-Mean over state-of-the-art VGGT4D on dynamic object segmentation, while achieving up to 13x faster pose estimation and 3x faster 4D reconstruction with 4 to 8x lower memory. Dyna3 could therefore enable much denser temporal sampling that prior methods cannot support.

[67] ODDR: One-Step Deshadow Diffusion via Reward Guidance cs.CVPDF

Junseong Shin, Kijun Kim, Minseong Kim, Dongjin Kim, Tae Hyun Kim

TL;DR: ODDR用合成阴影训练单步扩散去阴影模型，再以无人工标注的ShadowReward偏好模型微调，缩小合成到真实图像的域差距。

Details

Motivation: 阴影去除配对真实数据采集昂贵且场景有限，限制泛化；现有依赖人工标注的偏好或奖励监督也增加数据成本。

Result: 基础ODD仅用合成阴影即可实现强去阴影效果，ODDR进一步用控制纹理失真和边界伪影的合成图像排序训练ShadowReward。奖励引导微调提升结果并缩小与真实配对监督方法的差距，同时保持单步推理计算效率；摘要未给出具体指标。

Insight: 合成退化可以构造无人工标注的感知偏好信号，用于弥合真实域差距。单步生成兼顾效率，但与完全监督方法的差距只在摘要中定性描述。

Abstract: Recent advances in deep learning for shadow removal have significantly enhanced image quality and realism. However, most approaches rely on real-world paired datasets, which are costly to collect and often limited in scene diversity, leading to limited generalization. To address these limitations, we propose One-step Deshadow Diffusion via Reward guidance (ODDR), a new framework that achieves efficient and high-fidelity shadow removal without relying on real-world paired supervision. Our method begins with One-step Deshadow Diffusion (ODD), a baseline model trained on synthetic shadow data for efficient one-step shadow-free reconstruction. We further adapt ODD into ODDR using ShadowReward. In contrast to traditional, annotation-heavy approaches, ShadowReward is the first reward model for shadow removal trained entirely without human annotation. It learns to mimic human perceptual judgments by ranking synthetically generated images with controlled degradations, such as texture distortion and boundary artifacts. This reward-guided fine-tuning enables ODDR to close the synthetic-to-real domain gap. Extensive experiments show that ODD achieves strong performance without relying on real-world paired supervision, and ODDR further improves the results, narrowing the gap to fully supervised methods trained on real-world paired data while maintaining higher computational efficiency as a single-step model.

[68] ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild cs.CVPDF

Ilya Fradlin, Christian Schmidt, Jens Piekenbrinck, Karim Knaebel, Gonzalo Martin Garcia

TL;DR: ARROW用顺序不变查询统一任意图像集合的3D重建和3D点追踪，并通过训练时增加输入集合多样性提升跨视角、跨时间泛化。

Details

Motivation: 动态场景可能来自移动相机、多段视频和不同时间拍摄的图像，融合这些观测需跨视角、时刻和可见性变化建立对应关系。

Result: 前馈模型以顺序不变方式关联任意输入中的查询和观测，更多样训练输入改善任务表现并扩展到多视图追踪。ARROW在WorldTrack和TAPVid-3D的3D追踪达到当前最佳，在调整后的RGB-only MVTracker基准上超过专用多视图追踪器，同时保持3D重建竞争力。

Insight: 统一输入集合顺序与来源形式，可让一个前馈模型利用不同拍摄条件中的互补信息。结果覆盖追踪与重建，但摘要未提供各数据集数值。

Abstract: Dynamic scenes may be captured by a moving camera, multiple video streams, or images taken at different times. These observations reveal complementary aspects of scene geometry and motion, yet bringing them together requires establishing correspondence across viewpoints, capture times, and visibility changes. We introduce ARROW, a feed-forward model that unifies 3D reconstruction and 3D point tracking from arbitrary image sets. At its core is a novel order-invariant querying approach, which allows the association of queries with observations across arbitrary inputs. We show that exposing the model to more diverse sets of inputs during training results in improved task performance. Moreover, the resulting model is capable of generalization to a wider range of tasks including multi-view tracking. Trained with this strategy, ARROW establishes a new state of the art in 3D tracking on WorldTrack and TAPVid-3D and outperforms dedicated multi-view trackers on an adapted RGB-only MVTracker benchmark, while remaining competitive across 3D reconstruction tasks. Code and weights are publicly available.

[69] Supervising Sound Localization by In-the-wild Egomotion cs.CV | cs.AI | cs.MM | cs.SDPDF

Anna Min, Ziyang Chen, Hang Zhao, Andrew Owens

TL;DR: 该方法用真实视频中相机自运动变化监督双耳音频模型定位声源，并把运动学视觉线索与传统双耳信号结合。

Details

Motivation: 真实声源定位标注昂贵，双耳线索单独使用可能不足；视频中的相机移动会改变声源相对方向，可提供丰富但弱的监督信号。

Result: 作者用传统多视图几何估计相机运动方向，训练音频模型预测与视觉运动一致的声源方向，并构建带自运动信息的真实视听视频数据集。实验显示模型能从真实数据学习且在声源定位任务上表现良好；摘要未给出数据集规模和量化指标。

Insight: 相机运动可充当音频方位监督，弱标签可与双耳线索互补。该方法降低对人工方向标注的依赖，效果仍需具体误差指标进一步判断。

Abstract: We present a method for learning binaural sound localization using egomotion as a supervisory signal. Over the course of a video, the cameras direction to a sound source will change as the camera moves. We train an audio model to predict sound directions that are consistent with visual estimates of camera motion, which we obtain using traditional methods from multi-view geometry. This provides a weak but plentiful form of supervision that we combine with traditional binaural cues. To evaluate this method, we propose a dataset of real-world audio-visual videos with egomotion. We show that our model can successfully learn from real-world data and that it performs well on sound localization tasks

[70] MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning cs.CVPDF

Juekai Lin, Honglin Lin, Yuqian Yuan, Xiaolong Wu, Jie Cao

TL;DR: MMVistaReason构建开放数据多模态推理后训练配方，通过能力分组、难度感知数据清洗、专家强化学习和多教师蒸馏整合能力。

Details

Motivation: 开放多模态推理后训练受数据质量不均、监督构造低效、难度失衡和跨域干扰影响，混合训练可能产生基准级负迁移。

Result: 配方构建MVR-SFT-528K与MVR-RL-63K，并采用专训后整合的多教师在线蒸馏。分析显示小模型更受益于精选轨迹，大模型对轨迹变化更稳健；混合域RL会引入负迁移，蒸馏则持续整合能力。在15个基准上，MVR-4B平均72.8，超过Qwen3.5-9B-Instruct和MMFineReason-8B，样本量约少70%；MVR-9B平均74.4，超过Qwen3.5-35B-A3B-Instruct。

Insight: 数据质量、难度与容量共同决定监督价值，混合更多领域不必然改善模型；先训练互补专家再整合可降低负迁移。蒸馏方向还需随模型规模选择。

Abstract: Open multimodal reasoning models have benefited from large-scale reasoning supervision, yet reliable post-training remains challenging due to uneven data quality, inefficient supervision construction, imbalanced difficulty, and cross-domain interference. We introduce MMVistaReason (MVR), an open-data post-training recipe with three components: (1) broader capability coverage across complementary Analytical and Real-World reasoning groups, emphasizing structured reasoning versus visual perception and spatial grounding; (2) efficient SFT and RL data construction, standardizing heterogeneous open data through staged cleaning and annotation, combining difficulty-aware cascaded teacher distillation with answer-likelihood-based trajectory selection to construct MVR-SFT-528K, and applying scale-specific frontier filtering for MVR-RL-63K; and (3) specialize-then-integrate training, which trains complementary RL experts and consolidates their capabilities through multi-teacher on-policy distillation (MOPD). Our analyses reveal a capacity-dependent interaction between supervision difficulty, trajectory quality, and model capacity: smaller students benefit more from selected supervision, while larger students are robust to trajectory variation and mixed-domain interference. Mixed-domain RL introduces benchmark-level negative transfer, whereas MOPD provides consistent capability integration, with the preferred KL direction varying across model scales. Across 15 multimodal benchmarks, MVR-4B achieves an average score of 72.8, outperforming Qwen3.5-9B (Instruct) and MMFineReason-8B while using about 70% fewer samples than MMFineReason. Scaling to 9B improves the average to 74.4, surpassing Qwen3.5-35B-A3B (Instruct). Overall, MMVistaReason demonstrates that systematic open-data construction and capacity-aware post-training provide a practical and scalable path toward reliable multimodal reasoning.

[71] MWOP: Modality-aware Width-wise Operation Pruning for Efficient MLLMs cs.CV | cs.AI | cs.CLPDF

Xudong Wang, Hao Wu, Haozhe Hu, Peiran Yin, Xinghao Chen

TL;DR: MWOP按模态交互路径和输入类型分别剪枝注意力连接与FFN通道，在不减少词元序列的情况下压缩多模态模型计算。

Details

Motivation: 长视觉—文本序列使MLLM推理成本高；现有压缩多把注意力头和共享FFN通道作为整体，忽略同一头内不同模态路径和视觉、文本执行间的细粒度冗余。

Result: MWOP独立剪枝V2V、T2V、T2T路径，并分别为视觉与文本输入选择FFN通道；重要性在注意力剪枝后重估并通过LoRA恢复，配套稀疏Triton核实现加速。在LLaVA-OneVision-7B上，prefill加速1.6倍，12个基准平均保留99.7%性能；与两种词元压缩方法结合后，加速从2.0/1.9倍升至2.9/2.7倍，Qwen2.5-VL-7B也验证可适用。

Insight: 计算图中的冗余具有模态路径和输入类型差异，细粒度剪枝可与词元压缩互补，同时减少序列长度与单词元成本。实用加速依赖专门内核实现，而非稀疏度本身。

Abstract: Multimodal large language models (MLLMs) incur substantial inference costs when processing long visual-textual sequences. While existing operation compression methods exploit modality-level redundancy, they largely treat computation within attention heads and shared feed-forward network (FFN) channels as unified units, leaving finer-grained redundancy underexplored. We find that redundancy varies both across modality-interaction paths within the same attention head and across visual and textual executions of the same FFN channel. Based on these findings, we propose Modality-aware Width-wise Operation Pruning (MWOP), which independently prunes visual-to-visual (V2V), text-to-visual (T2V), and text-to-text (T2T) attention paths within each layer, and separately selects FFN channels for visual and textual inputs. A first-order Taylor criterion guides the pruning process, with FFN importance re-evaluated after attention pruning and LoRA-based recovery training. To translate the resulting fine-grained sparsity into practical acceleration, we further develop path-sparse Triton attention kernels and compact visual-side FFN execution. MWOP preserves the token sequence while reducing attention and FFN computation, making it complementary to token compression and enabling simultaneous reduction of sequence length and per-token computation. On LLaVA-OneVision-7B, MWOP alone achieves a $1.6\times$ prefill speedup with 99.7% average performance retention across 12 benchmarks. Combined with two representative token compression methods, it further increases their prefill speedups from $2.0\times$ and $1.9\times$ to $2.9\times$ and $2.7\times$, respectively. Results on Qwen2.5-VL-7B further demonstrate its applicability across architectures. The code is available at https://github.com/EIT-NLP/MWOP.

[72] FiVOS: A Fish Segmentation Algorithm Based on Interactive Video Object Segmentation and Filter Enhancement cs.CVPDF

Yuqing Duan, Song Zhang, Shili Zhao, Daoliang Li, Ran Zhao

TL;DR: FiVOS改进水产养殖视频中的交互式鱼体分割，利用掩码块过滤器提前发现传播错误，并串联噪声过滤器减少长序列漂移。

Details

Motivation: 养殖场景视频分割可支持鱼行为追踪，但帧间动态相关常被忽略；交互式分割虽能减少标注工作，长序列传播仍会累积误差并在同类鱼相似时丢失掩码。

Result: FiVOS构建两个鱼类专用数据集，采用规则阈值检测和纠正传播掩码块中的错误，再串行应用噪声滤波以提升鲁棒性。实验显示其在鱼类视频分割任务达到当前最佳表现，但摘要未给出具体指标。

Insight: 长时交互式视频分割需要显式监测传播掩码是否偏离，而不能只依赖上一帧结果。专用数据和早期纠错面向鱼类场景，其他对象类别的泛化尚未说明。

Abstract: With the continuous expansion of aquaculture, precise and efficient monitoring of fish behavior has become increasingly critical for improving farming efficiency and reducing economic losses. In particular, with the ongoing enhancement of computational capabilities in deep learning models, vision-based fish segmentation methods are garnering growing attention. By analyzing video segmentation results, fish behavior can be effectively tracked, thereby providing reliable data support for the precise regulation of aquaculture environments. However, existing deep learning-based video segmentation methods for aquaculture scenarios often overlook the dynamic correlations between video frames. In contrast, Interactive Video Object Segmentation (IVOS) employs an interaction-propagation scheme to achieve high-precision segmentation while minimizing user effort, thereby enhancing monitoring efficiency. Yet, IVOS applications in aquaculture remain limited due to data scarcity, and are susceptible to error accumulation and mask loss over long sequence propagation due to high intra-class similarity. In response, this paper proposes an improved interactive video object segmentation method (FiVOS) and constructs two fish-specific datasets. FiVOS utilizes a mask block filter to enable early detection and correction of erroneous propagated mask blocks, enhancing filtering accuracy through a rule-based thresholding approach. Additionally, it serializes noise filters to further eliminate erroneous mask noise, thereby improving model robustness. Experimental results demonstrate that FiVOS achieves state-of-the-art (SOTA) performance in fish video segmentation tasks, providing robust technical support for fish behavior research.

[73] VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation cs.CVPDF

Yu Huang, Jungang Li, Zhiyuan Wang, Yonghua Hei, Song Dai

TL;DR: VTR-Bench评测视频生成中的场景文字是否正确、画面与运动要求是否满足，并展示导演代理通过视觉反馈迭代改进生成结果。

Details

Motivation: 视频生成评测多关注画质、美学和物理合理性，却较少衡量场景中招牌、广告等文字是否准确，导致视频可能看起来逼真但传递错误信息。

Result: 基准包含五类应用场景的300条提示，自动流程分别用载体特定转录评估文字保真度、用提示相关查询评估场景与运动要求，并与人类判断对齐。11种先进模型普遍难以正确渲染场景文字，最佳模型整体WER为0.250。另提出导演代理协调图像和视频生成、视觉评估与候选迭代选择。

Insight: 场景文字是视频生成的重要语义内容，需要独立于画质评价；自动评估和视觉反馈也可形成生成—评估迭代流程。当前最佳WER仍显示该能力存在明显缺口。

Abstract: Recent video generation models can produce highly realistic videos from natural language instructions, with visual quality approaching cinematic standards. Existing evaluation benchmarks, however, predominantly assess visual quality, aesthetic appeal and physical plausibility, while paying limited attention to text, an essential medium for conveying information in everyday scenes. A generated video may appear visually compelling and feature lifelike subjects, yet still render the text within the scene incorrectly. To address this overlooked dimension, we introduce \textbf{VTR-Bench}, a systematic benchmark for evaluating the \textbf{V}isual \textbf{T}ext \textbf{R}endering capabilities of video generation models. VTR-Bench situates text within concrete application scenarios, such as advertisements and scientific videos, with 300 carefully constructed prompts spanning five scenario categories. We develop an automated evaluation pipeline with human alignments that separately assesses text fidelity through carrier-specific transcription and scene and motion requirements through a prompt-specific chain of query. Beyond evaluation, we introduce a \textbf{Keyframe-Guided Agentic Framework} in which a Director agent coordinates image and video generation with visual evaluation, guiding iterative refinement and candidate selection through visual feedback. Experiments on 11 state-of-the-art models reveal widespread difficulties in accurately rendering scene text, with the best-performing model recording an overall word error rate (WER) of 0.250. We further analyze text rendering failures to characterize the challenges faced by current video generation models. These findings highlight visual text rendering as a key challenge for video generation and demonstrate a practical path toward improvement. Code is available at https://github.com/hardenyu21/VTR-Bench.

Akira-Miranda Adeyomi Adeniran-Lowe, Binod Singh, Lars Arnold Dethlefsen, Lazaros Nalpantidis, Theodora Kontogianni

TL;DR: PAGER用配对局部—全局几何和关系蒸馏适配3D语义特征，使全局坐标预训练编码器能处理具身场景中的局部相机视角观测。

Details

Motivation: 3D编码器多在统一世界坐标的完整场景上训练，但具身系统面对的是部分视角、相机坐标输入，形成严重表示错配，单靠坐标规范化也难彻底消除。

Result: 冻结Sonata在完整ScanNet上全局线性探针mIoU为72.47，单帧相机坐标输入仅2.57；免训练重力对齐恢复到41.64。PAGER仅用局部—全局配对几何训练轻量适配模块，推理不需全局几何或局部标签。在Sonata和Concerto上超过有标签PEFT；零样本ScanNet→ScanNet++迁移中达53.93 mIoU，高于完全微调Sonata的48.09。

Insight: 坐标失配是性能骤降的重要原因，但保持全局表示结构的关系蒸馏还能改善跨数据集迁移。训练可借助全局几何，部署则只需局部观测。

Abstract: Pretrained 3D encoders are typically developed on globally reconstructed scenes expressed in a consistent world coordinate frame, whereas embodied systems must reason from partial, viewpoint-dependent observations in camera coordinates. We show that this shift from globally learned 3D feature spaces to realistic partial observations exposes a severe representation mismatch, which we find consistently across representative state-of-the-art encoders, including Sonata and Concerto. A frozen Sonata encoder with a global linear probe achieves 72.47 mIoU on full ScanNet scenes, but 2.57 mIoU on single-frame camera-coordinate inputs. Training-free gravity alignment recovers performance to 41.64 mIoU, showing that coordinate-frame mismatch is a dominant source of degradation but cannot be fully resolved through canonicalization alone. We introduce PAGER, a label-free adaptation method that aligns partial-view features with a frozen global 3D semantic space using only paired partial/global geometry. It learns lightweight adaptation modules while keeping the pretrained encoder and global segmentation probe frozen. Matched-point feature alignment anchors partial features to their global counterparts, while relational supervision preserves their similarity structure with respect to the global representation. Global geometry provides supervision only during training. Inference operates directly on the partial observation. Without partial-view labels, PAGER outperforms label-supervised PEFT on both Sonata and Concerto, and in zero-shot ScanNet$\rightarrow$ScanNet++ transfer surpasses fully fine-tuned Sonata ($53.93$ vs.\ $48.09$ mIoU), suggesting that preserving the frozen global representation can improve cross-dataset transfer.

[75] Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs cs.CV | cs.AIPDF

Youngwoo Shin, Yusung Ro, Minseo Kim, Junmo Kim

TL;DR: TAI从VideoLLM中层提取随帧序反转而变化的时间分歧向量，再按其逐层衰减趋势注入后续层以保留时间信息。

Details

Motivation: 视频帧顺序反转理应反转时间答案，但VideoLLM常给出不变预测，表明模型虽获得时间信息，却可能在输出前逐渐丢失。

Result: 逐层追踪时间分歧发现其中层峰值随后向输出递减，且该峰值特异于时间推理并对预测有因果作用。无训练TAI在每个输入的峰值层提取分歧并按测得衰减注入后续层，在三个VideoLLM、四个基准上稳定改善时间推理，对非时间任务影响很小；摘要未给出具体提升幅度。

Insight: 失败可能源于中层已编码的时序证据未能传递到最终输出，而非模型完全没有时间表征。推理时激活注入可修复该层级的信息衰减。

Abstract: Video Large Language Models (VideoLLMs) receive frames in sequential order and interpret how visual content evolves along the temporal axis, yet temporal reasoning remains a persistent weakness across architectures. Reversing the frame order of a video, a transformation that should invert temporal answers, often leaves the final prediction unchanged. We investigate where this failure originates by defining the temporal divergence vector $τ_l$, the layer-wise representational difference induced by reversing temporal order. Tracking its magnitude across layers reveals a consistent temporal divergence profile where the divergence peaks at intermediate layers and progressively diminishes toward the output. We confirm this peak is specific to temporal reasoning and functionally critical for predictions, establishing that VideoLLMs acquire temporal information at intermediate layers but fail to maintain it to the output. This progressive fading motivates our method, Temporal Activation Injection (TAI), which extracts $τ_l$ at the peak of the profile for each input and reinjects it into subsequent layers following the measured decay. TAI requires no training and consistently improves temporal reasoning across three VideoLLMs and four benchmarks with negligible impact on non-temporal tasks. Code is available at https://github.com/Youngwoo-git/Before-It-Fades.

[76] Hob-VL: A Benchmark for Visually Grounded Boolean Reasoning cs.CV | cs.AI | cs.LG | cs.LOPDF

Yuzhou Wang, Emile Anand, Ijay Narang

TL;DR: Hob-VL评测VLM能否基于图像事实执行组合布尔规则并保持等价问题答案一致，包含规则真假判断和唯一对象识别两类任务。

Details

Motivation: 可靠视觉推理需要组合多条观察并对逻辑等价问法保持一致，但现有VQA难区分真实布尔推理与被误导性局部线索影响的猜测。

Result: 基准包含6,000个人工验证平衡是/否问题，每题组合十条视觉陈述，来自1,000个生成场景和46张多样标注照片；另有1,000个对象识别题。八种关闭或弱化思考的配置中，布尔准确率仅48.52%—50.57%，对象识别最高43.0%；启用思考的GLM仅有不均衡改善，仍存在明显错误和不一致。

Insight: 当前VLM对组合视觉逻辑的能力接近随机，简单识别分数不足以代表稳定推理。可执行参考答案和匹配评估让局部线索捷径与逻辑组合失败更易暴露。

Abstract: Reliable visual reasoning requires composing multiple visual observations and returning consistent answers to logically equivalent questions. We introduce Hob-VL, a benchmark for visually grounded Boolean reasoning. Hob-VL comprises two tasks: (1) evaluating whether a Boolean rule holds in an image, and (2) identifying the (unique) object satisfying a Boolean description. Hob-VL contains 6,000 human-verified balanced Yes/No questions, each defined by a Boolean combination of ten visual statements, across 1,000 generated scenes and 46 diverse labeled photographs, along with 1,000 object-identification questions over the same photographs. Our question families are deliberately constructed to challenge reasoning through misleading local cues and nested logical operations, and include symbolic and structured natural-language presentations. Across eight model configurations with thinking disabled or minimized, Boolean accuracy ranges from 48.52% to 50.57%, while the identification accuracy reaches at most 43.0%. A thinking-enabled GLM configuration achieves uneven gains while retaining substantial errors and inconsistencies. Hob-VL exposes these failures through executable reference answers and matched evaluations.

[77] Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models cs.CVPDF

Xindi Yang, Baolu Li, Liam Lee, Zhenfei Yin, Songxin Zhang

TL;DR: Oneira用编码代理维护可扩展显式世界状态，将新生成对象纳入可交互环境，并把交互结果写回状态以跨视频片段保持持久性。

Details

Motivation: 开放式视频世界模型可生成可探索环境，却不代表新出现内容可行动，用户改变世界后效果也常只停留在瞬时画面，不能影响后续观察与交互。

Result: 给定当前观测和动作或高层目标，代理读取状态、定位相关实体、规划交互并更新世界状态表；探索发现的新对象也会进入可操作状态。更新状态沿相机轨迹渲染为粗条件视频，再由视频生成器补充外观、运动和交互细节。实验显示模型可直接且一致地与新生成对象交互，并在长时程中保留此前交互效果。

Insight: 显式状态表把开放生成、对象可操作性和交互持久性连成闭环，避免仅凭视频像素隐式记住变化。生成模型负责视觉细节，编码代理负责可追踪的世界状态。

Abstract: Generative video world models can now synthesize open-ended environments that agents can navigate and interact with in simple ways. Yet open-ended generation does not imply full interaction: as a generated world expands, newly created content through navigation should expand what the agent can act upon, and as the agent changes the world, those changes should become persistent parts of the environment rather than transient visual effects. We characterize these two requirements as Open-World Interactivity, where newly generated or encountered entities are incorporated into the actionable world, and Persistent State, where interaction outcomes are committed to the world state and continue to influence subsequent observations and interactions. We present Oneira, an interactive video world model that closes the loop between generation and interaction through an explicit, extensible world state managed by a coding agent. Given the current observation and an action or high-level goal, the agent reads the world state, grounds the relevant entities, plans the interaction, and writes its outcome back into a world state table. When exploration reveals new objects, the agent incorporates them from generated observations, allowing the interaction space to expand with the generated world. Meanwhile, previously induced state changes are carried across video segments, making the consequences of interaction persistent parts of subsequent world evolution. The updated world state is rendered along the camera action trajectory into a coarse conditioning video, from which a video generator fills in the appearance, motion, and interaction details not represented in the state. Experiments show that Oneira enables direct and consistent interaction with newly generated objects, while preserving the effects of prior interactions over long horizons. Project page: https://madaoer.github.io/projects/oneira

[78] Beyond Domain-Level Adaptation: Margin-Oriented Semantic-Appearance Interaction Correction for Personalized Federated Vision-Language Models cs.CVPDF

Wentao Yue, Qingyu Mao, Tianyou Lai, Ahmed M. Abdelmoniem, Qilei Li

TL;DR: MOSAIC以决策边界损害程度选择性修正联邦VLM中语义类别与客户端外观域的交互残差，并由客户端私有域因子实现个性化。

Details

Motivation: 联邦参数高效微调需适应客户端域异质性；将每个域视为不依赖类别的统一变换不足，因为同一域位移随语义类别而异，只有部分类别—域残差会损害分类间隔。

Result: 方法先估计类别—域残差是否偏向竞争文本原型，再用低秩残差适配器建模交互，结合图像条件门控和有害配对重加权。在Office31、OfficeHome和DomainNet100的所有域偏移及联合域—标签偏移设置中，MOSAIC均提高宏客户端top-1准确率。

Insight: 联邦个性化应聚焦会改变决策边界的类别—外观交互，而非统一校正所有域差异。低秩共享语义因子与客户端私有域因子兼顾全局知识和本地适配，摘要未披露具体增益。

Abstract: Federated parameter-efficient fine-tuning enables distributed clients to adapt pretrained vision-language models without sharing raw data or updating the full backbone. Its effectiveness, however, is limited by domain heterogeneity across clients. Existing personalized methods separate globally shared knowledge from client-specific style, but they largely treat each domain as a class-agnostic transformation. We show that this abstraction is insufficient: the cross-domain displacement associated with a fixed domain varies across semantic classes, and only a subset of these class-domain residuals damages the image-text decision margin. We therefore propose Margin-Oriented Semantic-Appearance Interaction Correction (MOSAIC), which first constructs a decision-aware harmfulness score that measures whether a training-derived class-domain residual favors a competing text prototype over the true class. It then models fine-grained class-domain interactions with a low-rank residual adapter whose class factors and residual basis are globally shared while domain factors remain client-private. An image-conditioned gate further controls candidate-wise correction, and harmful-pair-aware reweighting prioritizes decision-relevant residuals during local optimization. Extensive experiments on Office31, OfficeHome, and DomainNet100 demonstrate that MOSAIC consistently improves macro-client top-1 accuracy across all evaluated domain-shift and joint domain-label-shift settings.

[79] Fusing Visual and Textual Representations via Multi-layer Fusing Transformers for Vietnamese Visual Question Answering cs.CVPDF

Cong Phu Nguyen, Huy Tien Nguyen, Tung Le

TL;DR: 模型用跨注意力多层融合图像和越南语文本表示，面向越南语视觉问答构建从低层到高层聚合的多模态表征。

Details

Motivation: 视觉问答英文研究丰富，但越南语等低资源语言的系统和数据较少，限制了教育、医疗等场景中的本地化应用。

Result: Multi-layer Fusing Transformer通过交叉注意力融合图像与文本不同层级特征，并在ViVQA越南语数据集上进行实验和消融。论文报告结果优于有竞争力的基线，摘要未给出具体指标。

Insight: 多层融合可为越南语VQA提供本地语言的图文联合表征，补足英语中心研究的覆盖不足。现有摘要只报告总体竞争力，无法判断相对提升幅度。

Abstract: In recent decades, artificial intelligence has made significant progress in understanding and interacting with images. One of the important applications of this technology is Visual Question Answering (VQA), a research field that requires computers to understand and answer questions about images in a natural manner. Despite extensive research and development in VQA for English, there have been very few similar efforts made for other languages, especially Vietnamese. This gap presents a significant challenge and opportunity for the advancement of VQA technology in the Vietnamese language context. By bridging this gap, the field of Vietnamese VQA not only enriches the diversity of research in artificial intelligence but also enables practical applications in various domains, such as education, healthcare, and entertainment, catering to Vietnamese-speaking populations worldwide. Thus, the exploration and development of Vietnamese VQA systems hold immense potential for advancing both research and practical applications in the intersection of computer vision and natural language processing. In this paper, we propose a Multi-layer Fusing Transformer model utilizing a cross attention module to combine multiple modality features of images and texts from different layers in an aggregated representation. Our architecture allows us extract information from low level to high level. Through detailed experiments and ablation studies, our model achieves promising results against the competitive baselines in ViVQA dataset for Vietnamese language.

[80] Not All Error Yields to Scale: Where Scaling Stops in Vision-Language Inference cs.CV | cs.AIPDF

Xinye Zhao, Yunkai Dang, Yunchen Wu, Wenbin Li

TL;DR: Separable Law分别建模语言骨干规模和视觉词元数对VLM高分辨率性能的贡献，再结合成本定律按预算选择模型与输入分辨率。

Details

Motivation: 固定推理预算下，部署者需在更大的语言模型和更多视觉信息间取舍；既有研究难回答不同分辨率任务应采用哪种组合，以及哪些错误能从扩展中受益。

Result: 作者用26个InternVL与QwenVL模型、1B至72B规模和四个224像素至8K基准拟合定律。可扩展问题表现可由所需技能预测，但相当部分问题对规模增加不响应；两家族从扩大语言骨干获得类似收益，增加视觉词元的收益则差异明显。成本定律给出预算下闭式分配规则，并在可用配置中选出接近最优的组合。

Insight: 扩展语言推理能力与增加视觉输入不是可互换的资源，收益由任务技能和模型家族共同决定。定律适用于所拟合模型和高分辨率基准范围。

Abstract: Vision-language models (VLMs) face a fixed-budget trade-off between processing more visual information for fine-grained perception and using a larger language backbone for complex reasoning. Existing studies do not tell us which combination of backbone size and input resolution to deploy, especially in high-resolution deployments. To address this gap, we propose the Separable Law that describes how VLM performance changes with language backbone size and visual token count. We fit the law to measurements from 26 InternVL and QwenVL models, with language backbone sizes from 1B to 72B, on four high-resolution benchmarks with image sizes from 224 pixels to 8K. We find that the questions responding to scaling can be predicted from the skill they require, while a substantial fraction never responds at all. We also find that the two model families gain similarly from a larger backbone, while their gains from more visual tokens differ sharply. Combined with a cost law, the Separable Law gives a closed-form rule for allocating compute between backbone size and visual tokens. When deployment is limited to available configurations, the law identifies model and image sizes that perform close to the best feasible choice under the same budget. We hope our work offers a principled way to decide how much a model should be allowed to see at high resolution, given what it must reason about.

[81] DiVid: Diagnosing Dimension-Specific Diversity Collapse in Video Generation Models cs.CVPDF

Huanran Hu, Zihui Ren, Dingyi Yang, Zhinan Song, Guozheng Wu

TL;DR: DiVid把视频生成多样性分解为语义、风格、主体、场景、运动和镜头六个维度，以定位整体分数掩盖的具体坍塌因素。

Details

Motivation: 同一提示多次采样常产生相似视频，限制创作探索；全局多样性分数无法显示究竟是运动、镜头还是主体等时空维度缺乏变化。

Result: 可复现视觉管线对六个维度分别评估，并结合质量和指令忠实度分析。多种模型即使整体多样性较高，也常在运动和镜头维度坍塌；过滤不忠实生成后排序仍成立。提示干预揭示开放提示下回归主导模式，以及模型无法实现明确要求的多样替代两种瓶颈。

Insight: 多样性不是单一属性，尤其运动和镜头变化难以仅靠文本控制。逐维诊断可把目标从“是否多样”转为“哪些因素坍塌、为何无法实现”。

Abstract: Despite remarkable progress, video generation models often produce highly similar outputs when repeatedly sampled from the same prompt, limiting their usefulness for creative exploration. Existing diversity evaluations primarily rely on global scalar metrics, which obscure where diversity collapses in the spatiotemporal space of videos. We introduce DiVid, a dimension-level diagnostic framework that decomposes video generation diversity into six interpretable dimensions: Semantic, Style, Subject, Scene, Motion, and Camera. Each dimension is measured through a reproducible computer-vision pipeline and analyzed alongside quality and instruction faithfulness to examine potential trade-offs. Systematic evaluation of representative video generation models reveals that diversity is highly dimension-specific: models with strong global diversity scores still collapse on specific factors, particularly Motion and Camera. These rankings persist after filtering unfaithful generations, indicating genuine capability differences rather than off-prompt outputs. Beyond measurement, controlled prompt interventions identify two fundamental bottlenecks: default mode convergence, where models fall back to dominant patterns under open-ended prompts; and realization gaps, where models fail to faithfully realize diverse, explicitly requested alternatives, particularly for temporal factors. The larger faithfulness losses for temporal factors highlight the difficulty of controlling motion and camera variation through text alone. DiVid thus shifts the study of diversity from measuring whether it exists to diagnosing where and why it collapses, and provides actionable directions for dimension-aware training objectives and control signals. The framework will be released to facilitate future research on diverse and controllable video generation.

[82] Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservation cs.CV | cs.LGPDF

Yuan Huang, Zirui Song, Xiuying Chen

TL;DR: EditJudgeBias用已验证编辑质量不变的反事实线索审计MLLM图像编辑评审，测量其对无关线索、人工判断和候选排序的敏感性。

Details

Motivation: 评审模型可能受与编辑质量无关的视觉线索影响，但干预图像本身也可能改变编辑质量，若未验证保持质量就无法把评分变化归因于偏差。

Result: 基准含1,196个真实编辑样本和分布于四个评估位置的13种线索，并用校准验证器、控制和人工检查确认编辑质量保持。五个评审的评分变化均超过各自噪声底线；虚构多数意见抬高评分，无关视觉元素比整图操控影响更大，交换候选顺序最多反转60.9%成对选择，编辑区域线索还常降低与人工一致性。

Insight: 图像评审的偏差审计需将反事实质量保持验证与模型自身重查询噪声分开，不能用零变化作为默认噪声基线。不同稳健性指标描述不同失效模式，单指标不足以概括评审可靠性。

Abstract: Multimodal large language models (MLLMs) are increasingly used as automated judges for instruction-based image editing and as reward signals for model training. However, systematically auditing whether these judges are influenced by cues irrelevant to editing quality is challenging because visual interventions may themselves alter the quality being evaluated. A judgment shift can therefore be attributed to bias only when the intervention is verified to preserve the underlying editing quality. To address this challenge, we introduce EditJudgeBias, a counterfactual benchmark with verified quality preservation, comprising 1,196 real editing samples and 13 cues injected across four evaluation sites. We verify quality preservation for the requested edit using calibrated multimodal validators, controls, and human inspection. We then audit five MLLM judges along three complementary dimensions: invariance to quality-preserving cues, agreement with human judgments, and stability of pairwise preferences. Importantly, observed shifts are evaluated against each judge’s own zero-dose and re-query noise floors rather than against zero. Experiments show that quality-preserving cues move every judge beyond its own noise. Fabricated majority opinions increase ratings, irrelevant visual elements cause larger shifts than whole-image manipulations, and swapping candidate order reverses up to 60.9% of pairwise decisions. Edit-region cues also tend to reduce human agreement. The three measures characterize judges differently, showing that robustness cannot be captured by a single metric.

[83] Architectural Sampling: Test-Time Scaling via Computational Diversity in Frozen Vision-Language Models cs.CV | cs.AIPDF

Akshit Singh, Shyam Marjit, Wei Lin, Leonid Karlinsky, M. Jehanzeb Mirza

TL;DR: 架构采样通过重复执行解码器中选定层块产生不同计算路径，为冻结VLM增加候选多样性而无需调参或新增参数。

Details

Motivation: 传统测试时温度采样让所有候选沿同一固定前向路径生成，难以充分探索冻结模型已有的不同计算过程。

Result: 在五个Qwen检查点和12个多模态基准上，同九候选预算下，架构采样相较标准路径温度采样使pass@9平均提高6.58个百分点；复用早期层收益最大，贪心解码下候选覆盖也提升。候选词汇重叠更低，并用于无标签测试时强化学习rollout时改善准确率。

Insight: 测试时扩展可改变候选的计算路径，而不只是对同一分布重复采样。早期层重用带来的覆盖收益还能转为更有效的自生成训练信号。

Abstract: Test-time scaling often seeks better answers by sampling multiple responses from a frozen model, yet conventional temperature sampling generates every candidate along the same fixed computation path. We introduce architectural sampling, a training-free method that generates candidates through distinct forward computations by reusing selected blocks of decoder layers. Varying the block location and repetition count introduces computational diversity without updating model weights or adding auxiliary parameters. Across five Qwen checkpoints and twelve multimodal benchmarks, architectural sampling improves pass@9 over standard-path temperature sampling by 6.58 percentage points on average at the same nine-candidate budget. Reusing early layers yields the strongest gains, and the improvement in candidate coverage persists even under greedy decoding. The resulting candidates show lower lexical overlap and improve accuracy when used as rollouts for label-free test-time reinforcement learning. These findings extend the benefits of our architectural sampling beyond candidate coverage, demonstrating more effective learning from a model’s own outputs.

[84] MEGA: Object-Level Mesh Extraction from 3D Gaussian Splatting via Spatial Visual Distillation cs.CVPDF

Liwei Liao, Yingkui Zhang, Qianqian Tong, Ronggang Wang

TL;DR: MEGA先分割3D Gaussian场景中的对象，再通过空间视觉蒸馏和掩码引导表面重建提取对象级封闭网格。

Details

Motivation: 现有3DGS网格提取主要针对完整场景，难表达对象级占据，复杂对象表面也常不封闭，不利于精确几何交互。

Result: MEGA把3DGS作为教师，从多样相机姿态渲染每个分割对象，再用光度监督训练网格重建模型。多个常用基准实验表明，其对象级3D占据恢复达到当前最佳；结合高质量网格的几何占据和3DGS真实感渲染，还可支持复杂物理交互。

Insight: 将场景对象分割与多视角渲染监督连接起来，可从以外观为主的高斯表示得到可交互封闭网格。摘要未提供具体几何指标。

Abstract: Mesh extraction from 3D Gaussian Splatting (3DGS) aims to endow 3D Gaussians with accurate geometric structures, enabling explicit and precise 3D occupancy. However, existing methods primarily focus on scene-level mesh extraction, making them unable to represent object-level occupancy and often resulting in non-watertight surfaces. To overcome these limitations, we propose \textbf{MEGA} (\underline{M}esh \underline{E}xtraction from \underline{GA}ussians), a ``segment-then-mesh’’ framework for extracting object-level, watertight meshes from complex 3DGS scenes. At the core of MEGA are \textbf{Spatial Visual Distillation (SVD)} and a mask-guided neural surface reconstruction module. SVD treats the 3DGS model as a teacher, sampling diverse camera poses and rendering the corresponding views of each segmented object. These observations are then used to train a mesh reconstruction model through photometric supervision. Extensive experiments on several widely used benchmarks demonstrate that MEGA achieves state-of-the-art performance in recovering accurate object-level 3D occupancy. Moreover, MEGA enables complex physical interactions by combining high-quality object-level meshes for geometric occupancy with 3DGS representations for photorealistic rendering.

[85] Rethinking Memorization Mitigation in Diffusion Models: Reinforcing Text Conditioning cs.CVPDF

Hyungjun Joo, Sehwan Kim, Hyeonggeun Han, Sangwoo Hong, Jungwoo Lee

TL;DR: 训练免费干预通过平滑并重分配交叉注意力、增强内容词元贡献来减轻扩散模型复现训练图像的记忆化，同时保留提示引导能力。

Details

Motivation: 文生图模型可能紧密复现单个训练样本，缓解记忆化时又必须保留提示中有用信息，以生成语义一致但不同的图像。

Result: 方法在无需额外去噪器评估的条件下，对交叉注意力做高斯平滑、强化内容词元并减弱填充词元。在Stable Diffusion v1.4和v2.0上，所有测试平滑宽度均落在训练图像相似度与提示对齐、图像偏好的经验Pareto前沿；在DeepFloyd IF上选定配置无需额外调参也降低模板复现。

Insight: 控制注意力质量分配和内容条件强度可共同影响记忆化与提示一致性，而不必在两者间简单二选一。所得前沿是经验结果，具体折中随模型和配置变化。

Abstract: Text-to-image diffusion models have achieved remarkable progress in image synthesis, yet can exhibit memorization by closely reproducing individual training examples. Effective mitigation must preserve useful prompt information to guide alternative depictions. We introduce a training-free method that redistributes cross-attention with Gaussian smoothing before reinforcing content-token contributions and attenuating padding contributions, without additional denoiser evaluations. With this intervention, stronger content conditioning can improve prompt alignment at comparable training-image similarity. A local analysis identifies when reinforcement preserves shared value information while redistribution reduces localized attention mass. On Stable Diffusion v1.4 and v2.0, all evaluated smoothing widths lie on the empirical Pareto frontiers for training-image similarity versus both prompt alignment and image preference. A configuration selected on Stable Diffusion reduces template reproduction in DeepFloyd IF without further tuning. These findings support jointly controlling conditioning allocation and strength to generate prompt-consistent alternatives.

[86] ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection cs.CVPDF

Yijie Zhu, Rui Shao, Jie He, Wei Li, Bo Zhao

TL;DR: ATI-VLA先用共享码本对齐预测观测和动作表示，再通过轻量自适应旁路把预测潜变量注入动作解码，维持以动作学习为中心的优化。

Details

Motivation: 预测式VLA希望用未来观测改善操作，但模态错位和联合优化冲突可能让学习偏离动作目标，导致表现不及直接动作预测模型。

Result: 共享离散码本让预测观测潜变量更适于生成动作，随后按需注入动作解码作为预测先验。在模拟和真实机器人任务上的实验显示，ATI-VLA达到当前最佳性能并加快收敛；摘要未提供具体成功率。

Insight: 预测模型的收益取决于未来表征是否能被动作头直接使用，统一潜空间和动作中心训练可减轻模态错位。结果覆盖仿真与实机，但没有数值细节。

Abstract: Predictive Vision-Language-Action (VLA) models aim to improve robotic manipulation via future observation or world dynamics forecasting. However, existing approaches often fail to realize this potential and underperform direct action prediction models. We argue that these limitations stem from modality misalignment between observations and actions, together with joint optimization conflicts that drive learning away from an action-centric objective. To this end, we introduce ATI-VLA, an Action-Centric Predictive Vision-Language-Action framework via Actionable Alignment Then Adaptive Injection. Specifically, it follows a two-step design: 1) Actionable Representation Alignment via a Shared Codebook. It aligns predictive observation and action representations by mapping both modalities into a shared discrete latent space via a unified codebook, making predictive observation latents readily usable for action generation and mitigating modality misalignment. 2) Action-Centric Adaptive Injection of Predictive Latents. Building upon this, it then injects predictive observation latents into action decoding as explicit predictive priors via a lightweight adaptive side-path, enabling adaptive predictive guidance under a single action-centric objective. Extensive experiments on both simulation and real-world robotic tasks demonstrate that ATI-VLA achieves state-of-the-art performance with faster convergence.

[87] 3DROID: A Renderable 3D Gaussian Dataset with Measured Per-Scene Reliability cs.CV | cs.ROPDF

Wonguen Cho, Junhoo Lee, Nojun Kwak

TL;DR: 3DROID研究相机外参可信度如何影响机器人场景3D Gaussian重建，并发布带度量尺度锚定和逐场景可靠性信息的可渲染数据集。

Details

Motivation: 机器人策略常从二维观察行动，但需理解三维物理世界；3DGS可提供可渲染几何监督，却主要为光度保真设计，当相机外参不可靠时未必保持真实度量尺度。

Result: 作者分析位姿条件化对新视角质量和几何精度的影响，并提出以机器人度量工作空间校准场景的流程。位姿条件可改善新视角保真度，但几何收益取决于输入外参的可靠性。由此构建可渲染、度量位姿锚定且含场景级可靠性标注的数据集，供机器人操作研究使用。

Insight: 位姿监督的价值受外参质量制约，不能把更强位姿条件化直接等同于更准确几何。逐场景可靠性标注有助于后续方法区分重建失败与输入位姿噪声。

Abstract: Robot manipulation models primarily reason from 2D observations while acting in the 3D physical world. To bridge this gap, recent work has augmented robot data with geometric priors such as depth, point clouds, and 3D trajectories, while renderable 3D Gaussian representations provide another promising form of 3D supervision. However, 3DGS representation is designed mainly for photometric fidelity and may not preserve real-world metric scale, particularly when the supplied camera extrinsics are unreliable. We study the effect of extrinsic reliability and pose conditioning on feed-forward 3DGS, and propose a calibration-aware pipeline that anchors reconstructed scenes to the robot’s metric workspace. Our experiments show that pose conditioning improves novel-view fidelity, while its geometric benefit depends on the reliability of the injected extrinsics. Using this pipeline, we present a renderable, metric-pose-anchored dataset with scene-level reliability information for robot manipulation research. Our dataset is available at https://huggingface.co/datasets/wonguen/3DROID

[88] Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding cs.CV | cs.AIPDF

Mohd Ubaid Wani, Sara Atito, Josef Kittler, Muhammad Awais

TL;DR: Cog-VADU把异常检测改写为视频片段间连续推理，并用跨模态重排序将文本理由与视觉嵌入对齐。

Details

Motivation: 传统视频异常检测依赖特定数据和人工标注，开放集泛化受限；零样本LVLM方法减少训练依赖，却常缺乏时间连续性和结构化推理。

Result: 免训练的CoADTP在视频片段间展开递归思维链，将结构化理由作为隐式时间记忆，区分复杂异常与高运动正常活动；跨模态重排序再以语义一致和时间连贯性细化定位。多个公开异常检测基准上达到有竞争力的零样本表现，跨模型评估显示CoADTP可稳定增强不同模型的推理式检测；摘要未给出具体数值。

Insight: 视频异常检测需要跨片段持续更新理由，而非逐片独立打分；语义和时间证据再对齐可提升预测稳定性。免训练设计展示零样本可解释分析潜力。

Abstract: Video Anomaly Detection (VAD) aims to temporally localize abnormal events in videos. Most existing approaches rely on dataset-specific training and curated annotations, limiting generalization in open-set scenarios. Recent zero-shot methods based on Large Vision- Language Models (LVLMs) alleviate this dependency but often lack temporal continuity and structured reasoning. We propose Cog-VADU, a fully training-free framework that reformulates VAD as a sequential cognitive reasoning task. Cog-VADU introduces Chain-of- Anomaly Detection Thought Prompting (CoADTP), which unrolls an LVLM into a recurrent reasoning chain across video segments. By propagating structured rationales over time, the model maintains implicit temporal memory, enabling robust discrimination between com- plex anomalies and high-motion normal activities. To improve reliability, we further design a cross-modal re-ranking stage that aligns textual rationales with visual embeddings, enforcing semantic consistency and temporal coherence for refined and stable predictions. Extensive experiments on multiple public VAD benchmarks demonstrate that Cog-VADU achieves competitive zero-shot performance. Moreover, cross-model evaluations show that CoADTP consistently enhances reasoning-based anomaly detection in a model-agnostic manner, pro- viding interpretable and generalizable anomaly understanding for real-world applications.

[89] OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interaction cs.CVPDF

Xiangyu Zeng, Yuandong Yang, Zhiqiu Zhang, Yuhan Zhu, Xinhao Li

TL;DR: OneStreamer用主动生成的局部细节字幕和事件摘要形成可复用历史记忆，在实时视觉窗口之外提供事实证据并及时回答问题。

Details

Motivation: 流式视频LLM在未来相关性未知时需保留证据，并在证据足够时响应；构造可复用事实记忆不能牺牲实时感知。

Result: PHCM生成时间锚定字幕和完成事件摘要，推理时与近期画面结合，无需重看历史视觉特征；PSTL保留所有输出锚点监督，并采样代表状态变化和持续的词元。作者构建超过百万条记录的OneStreamer-1M。4B模型在全部八个评估的流式视频理解基准上优于比较方法；字幕记忆提升历史问答且不损实时感知，PSTL仅监督27.5%标注状态词元仍优于密集监督。

Insight: 主动生成可以同时充当感知、记忆形成和响应时机的共同接口。模型摘要作为事实上下文提高历史问答，而状态变化采样减少监督成本。

Abstract: Streaming video LLMs must retain evidence before its relevance to future tasks is known and respond when sufficient evidence becomes available. The challenge is to form reusable factual memory without compromising real-time perception. We introduce OneStreamer, which jointly learns query-independent evidence recording and task response through a shared proactive generation process. Its Proactive Hierarchical Caption Memory (PHCM) produces time-grounded local-detail captions and summaries of completed events. Streaming caption targets supervise the interpretation of observed video prefixes during training. At inference, model-generated records complement a recent visual window, providing reusable factual context without revisiting historical visual features. Proactive State Transition Learning (PSTL) reduces the dominance of repeated waiting states by preserving supervision at all output anchors and selecting representative state-change and state-persistence tokens. We further develop a streaming data synthesis pipeline that aligns output content and timing with available evidence. Combining the resulting streaming captions and QA with cleaned open-source data yields OneStreamer-1M, a broad-coverage streaming video interaction dataset with over one million records spanning diverse tasks. Our 4B model achieves the best results among the compared methods across all eight evaluated streaming video understanding benchmarks. Ablations show that retaining generated captions improves historical QA without degrading real-time perception. PSTL also outperforms dense state supervision while supervising only 27.5% of annotated state tokens. Together, these results support proactive generation as a shared learning interface connecting perception, memory formation, and timely response in streaming video interaction.

[90] VETO: Video Efficient Token Optimization for Vision Language Models cs.CV | cs.AI | cs.CLPDF

Gueter Josmy Faure, Hao Ping Wang, Min-Hung Chen, Winston H. Hsu

TL;DR: VETO先合并帧内语义相似视觉词元，再合并帧间冗余帧，以双轴压缩降低长视频VLM推理成本。

Details

Motivation: 长视频视觉词元造成二次注意力成本；只压空间或时间一轴会触及效率下限，因为两类冗余相互独立且可同时压缩。

Result: 插件式VETO用最优传输启发匹配做帧内压缩，再全局筛并合并冗余帧，且可选训练。在LLaVA-OneVision-7B等模型上推理最高快45%，同时保持或改善准确率；10%词元预算下准确率55.7%，高于VFlowOpt的54.9%、VisionZip的52.6%和FastV的47.9%。在LLaVA-OneVision、InternVL-2.5和LongVA上零样本准确率均保持或提升。

Insight: 先缩减空间表示能降低后续跨帧匹配成本，分层顺序使双轴压缩突破单轴方法的效率瓶颈。极低词元预算下仍保留竞争准确率，且跨多个VLM骨干适用。

Abstract: Processing long videos with Vision-Language Models (VLMs) is bottlenecked by the quadratic cost of visual tokens, making long-form inference prohibitively expensive. While single-axis compression methods mitigate this, they hit a hard efficiency floor because they treat spatial and temporal redundancy independently. We present VETO (Video Efficient Token Optimization for Vision-Language Models), a training-optional plug-in that eliminates this bottleneck through dual-axis compression: (i) an intra-frame compressor that merges semantically similar tokens within each frame via optimal-transport inspired matching, and (ii) an inter-frame compressor that identifies and merges temporally redundant frames. The key design insight is hierarchical ordering: by first compressing spatial dimensions, VETO drastically reduces the cost of subsequent global temporal matching, bypassing the efficiency wall of single-axis approaches, with an advantage that grows with modern fully-fused attention infrastructure. Empirically, VETO achieves up to 45% faster inference (e.g., on LLaVA-OneVision-7B) while preserving or improving accuracy. Under extreme token starvation (10% budget), VETO outperforms VFlowOpt (54.9%), VisionZip (52.6%), and FastV (47.9%) with 55.7% accuracy. We demonstrate universal applicability across LLaVA-OneVision, InternVL-2.5, and LongVA, with zero-shot accuracy preserved or improved in all cases.

[91] Continuous Conditioning of VLAs with Augmenting EMG and Visual Task Descriptors cs.CV | cs.ROPDF

Edward W. Staley, Connor O. Pyles, Rahul Hingorani, Frank Camargo, Griffin Milsap

TL;DR: 研究比较用连续8通道肌电和视觉分割标注补充语言指令的VLA模型，检验额外任务条件在场景拥挤、分布外时是否有帮助。

Details

Motivation: VLA虽接收多模态输入，却主要依赖语言描述任务；在物体杂乱或含糊场景中，肌肉活动和视觉分割可能提供更直接的意图线索。

Result: EC-VLA把肌电包络拼接到本体感觉向量，VA-VLA将视觉分割标注加入图像输入。在三名参与者的方块选择任务中，两者在干净分布内场景与语言提示基线相当或略有改善，而杂乱分布外场景中表现显著更好。

Insight: 额外模态的任务条件可在视觉场景歧义增加时补足语言指令。结果来自三人方块任务，尚需更多参与者和任务验证。

Abstract: Vision-Language-Action (VLA) models rely strongly on language for describing task information, despite having multimodal inputs. We hypothesize that other modalities in the state space may present opportunities for supplemental task conditioning, which may be particularly relevant in cluttered or otherwise ambiguous scenes. We introduce two tuned models to test this hypothesis: (1) an electrophysiology-conditioned VLA (EC-VLA) that incorporates 8-channel electromyography envelopes as continuous conditioning input concatenated to the proprioceptive vector, and (2) a visually-annotated VLA (VA-VLA) that incorporates visual segmentation annotations to the image inputs. On a cube-selection task evaluated across three participants, EC-VLA matches a language-prompted baseline in uncluttered, in-distribution conditions and substantially outperforms it in cluttered, out-of-distribution scenes. Similarly, VA-VLA shows modest improvements over a language-prompted baseline in in-distribution scenes with substantial improvement in cluttered, out-of-distribution trials. Together, these results provide strong evidence for the potential benefit of task-conditioning beyond language.

[92] From Pixels to Policy: A Multi-Agent System for Intervention and Geo-Spatial Decision Support cs.CVPDF

Hosam Elgendy, Utkarsh Mall

TL;DR: VIDA-Geo用多代理协调图像分割、扩散修补和指标评分，探索能改善城市安全、绿化等目标的视觉干预方案。

Details

Motivation: 评估城市设计干预的长期健康、安全和生活质量影响成本高、耗时且不易实际测试；现有地理视觉多监测指标，而不是提出干预并估计效果。

Result: 系统将城市指标模型与生成编辑模型结合，自动产生视觉上可信、符合现实政策的干预候选。在航拍和街景的八项指标上，许多情况下优于既有基线，感知质量和政策对齐评分最高提升2倍，并可供规划专家挑选方案。

Insight: 生成编辑可充当隐式数字孪生，用于低成本探索干预假设，但结果是模型评分驱动的视觉候选，不等于已验证的现实政策效果。

Abstract: Urban environments are shaped by design choices with long-term implications for health, safety, and quality of life, yet evaluating proposed interventions remains costly, time-consuming, and often impractical. Existing geospatial vision methods largely focus on monitoring urban indicators from aerial and street-view imagery, rather than proposing interventions and estimating their effects on such indicators. Moving beyond recognition, we introduce the problem of discovering interventions that improve target indicators for a given aerial or street-view image. We argue that a black-box indicator model, combined with a generative editing model, can serve as an implicit digital twin for testing intervention hypotheses. We present VIDA-Geo , a multi-agent system that explores this intervention space by coordinating segmentation, diffusion-based inpainting, and indicator scoring models to produce interventions that are both perceptually realistic and aligned with real-world policies. We evaluate our system on 8 indicators across aerial and street-view imagery, measuring changes in factors such as perceived safety and greenery. Our approach outperforms existing baselines in many cases, achieving up to 2X higher perceptual quality and policy alignment scores. Finally, our model provides users with multiple candidate interventions, supporting an expert city-planner-in-the-loop workflow.

[93] Memory-Guided B-Roll Generation from User Video Collections cs.CVPDF

Cusuh Ham, Fabian Caba Heilbron, Josef Sivic, Bryan Russell

TL;DR: MemComposer把用户数小时视频整理为角色、场景、物体和风格记忆，再按文字要求检索参考帧、规划并生成连贯的补充镜头。

Details

Motivation: 为主视频生成B-roll需要从长视频库中找出每个镜头可用的证据，同时保持人物、场景、物体和视觉风格一致。

Result: 系统先离线构建实体中心记忆，再规划并检索每镜头条件帧，最后迭代生成和批评序列。在用户偏好评估中，相较无 grounding 的文生视频规划器，提示遵循赢得60.0%、视觉对齐赢得92.8%；相较仅检索片段，生成式序列提示遵循赢得94.5%，但纯检索片段在视觉对齐上仍有58.2%的偏好。

Insight: 个人视频记忆和参考帧检索能显著提高生成内容与素材库的视觉一致性，也能补足原片没有的镜头。纯检索仍可能更忠实原始影像，反映生成多样性与保真之间的取舍。

Abstract: We introduce an approach for collection-grounded B-roll sequence generation. Given a user’s video collection, a directive given in natural language, and a target duration, the goal is to produce a multi-shot sequence that complements the user’s primary footage (A-roll) while preserving the collection’s characters, settings, objects, and style. This task is challenging as one must choose the visual evidence from hours of captured footage that should guide the generation of each shot in the sequence. We address this challenge with MemComposer, a three-stage system that turns raw footage into a structured memory with visual references (characters, settings, objects, and style) and uses it to plan, retrieve, and generate grounded B-roll sequences. First, in a one-time offline stage, MemComposer constructs an entity-centric memory from raw video. Second, it uses the memory and user directive to plan a grounded sequence and retrieve conditioning frames for each shot. Third, it iteratively generates and critiques the sequence to enforce identity, setting, and sequence-level consistency. We evaluate MemComposer in a user preference study along two dimensions: prompt adherence and visual alignment to the user’s collection. Against an ungrounded text-to-video planner, MemComposer wins 60.0% of prompt-adherence and 92.8% of visual-alignment comparisons, showing the grounding benefit of collection memory and reference retrieval. Against retrieval-only sequences assembled from captured footage, MemComposer wins 94.5% of prompt-adherence comparisons, showing the value of generating missing shots, while retrieval-only sequences are preferred for visual alignment in 58.2% of comparisons.

[94] Unsupervised Domain Adaptation for Enhanced Radiometer Image Precipitation Estimation using Conditional Flow Matching cs.CV | cs.AIPDF

Victor Enescu, Assaad Zeghina, Matthieu Meignin, Nicolas Viltard, Cécile Mallet

TL;DR: 研究用条件流匹配对不同卫星辐射计图像做无监督域适配，通过条件化常微分方程实现域对齐并尽量保留场景信息。

Details

Motivation: 卫星仪器标注稀缺且不同仪器间存在域差异，使监督图像方法难以获得大规模数据并跨设备迁移。

Result: 方法利用流匹配确定性ODE的一部分，根据不同卫星仪器进行条件域变换；作者强调扰动理论上可逆，因此有望保留关键信息。在GPM-Core星座实验中，无监督域适配改善辐射计图像的降水估计，摘要未报告具体提升幅度。

Insight: 利用条件流的可逆变换可在缺乏跨仪器配对标签时对齐域分布，同时降低信息损失风险。摘要只给出总体实验结论，无法判断各卫星和降雨条件下效果。

Abstract: Deep generative networks have recently achieved unprecedented performance in precise image and video editing using sophisticated textual prompts. However, the effectiveness of such models heavily depends on access to very large supervised and annotated image datasets, which can be very difficult to obtain. This is particularly true for satellite instruments, which very rarely overlap with labelled data, and suffer from domain shifts in the rare occasions they do. In this paper, we investigate the potential of flow matching models for unsupervised domain adaptation of satellite radiometer images. Our main contribution is a novel unsupervised method that achieves precise domain alignment by leveraging parts of the deterministic ordinary differential equations in flow matching models, conditioned on different satellite instruments. A key strength of our approach is its ability to preserve essential information while adapting across any domains since the perturbations are in theory bijective. Extensive experiments conducted on the GPM-Core constellation show the benefit of our conditional domain adaptation, particularly in improving rain precipitation estimation from radiometer imagery.

[95] MoLE: Mixture of Latent Experts for Complementary Visual Reasoning cs.CV | cs.AI | cs.CLPDF

Yingcheng Liu, Tianyi Jiang, Yujuan Ding, jiangbo Ai, Xun Jiang

TL;DR: MoLE为不同潜视觉词元配置专门证据提取和摘要专家，使潜在推理获取互补视觉信息，而不是重复访问相同图像证据。

Details

Motivation: 潜视觉推理无需显式文本推理即可处理图像，但共享值投影使多个潜词元可能提取同一证据，单纯增加潜词元预算会产生冗余。

Result: MoLE先强制视觉证据通过潜路径，再恢复直接视觉访问，不需预定义专家角色或中间视觉目标。在五个视觉推理基准上平均78.6分，比同数据监督微调高4.9分，比同潜预算最强潜推理基线高3.6分；遮蔽潜路径后平均性能下降9.2分。表征分析显示潜状态相似度更低、视觉注意力更多样。

Insight: 提升潜推理能力的关键是分工和互补性，而非只增加潜表示数量。消融显示潜路径实际承担了重要视觉信息处理功能。

Abstract: Latent visual reasoning equips vision–language models with continuous intermediate states that can process visual evidence without explicit textual reasoning traces or repeated image operations. However, existing methods often allow multiple latent tokens to access the same visual evidence through shared value projections, providing no mechanism for them to extract complementary visual information; simply increasing the latent budget can therefore yield redundant latent representations. We argue that effective latent reasoning should encourage different latent tokens to extract complementary visual information, and thereby act as specialized visual experts. Based on this insight, we propose MoLE, a Mixture of Latent Experts framework that controls both what visual evidence each latent visual expert observes and how it transforms that evidence. MoLE isolates latent visual experts during evidence extraction and uses dedicated latent summary experts to aggregate the complementary representations of latent visual experts. A two-stage training pipeline first forces visual evidence through this latent pathway and then restores direct visual access, requiring neither predefined expert roles nor intermediate visual targets. Across five visual reasoning benchmarks, MoLE achieves an average score of 78.6, outperforming data-matched supervised fine-tuning by 4.9 and the strongest evaluated latent visual reasoning baseline at the same latent budget by 3.6. Representation analyses show lower latent-state similarity and more diverse visual attention, while masking the latent pathway reduces average performance by 9.2. These results demonstrate that specializing latent computation is more effective than merely increasing the number of latent tokens.

[96] Fewer Tokens, Better Action: GPT-6 Astra Robot Agents with 14% Higher Success Rate but 65% Fewer Tokens cs.CVPDF

Ruiyang Si, Jianxin Bi, Shunyu Yang, Rui Ni, Wenbo Huang

TL;DR: PyRUA-Lean让代理把传统机器人原语和VLA策略组合成条件执行代码，仅在需要时返回图像或状态信息供后续规划。

Details

Motivation: VLM机器人代理反复调用模型并传入冗余观测，造成大量词元开销；局部条件检查和重试可能减少不必要的全局重规划。

Result: 在LIBERO-PRO、RoboTwin 2.0和RoboCasa365共700个模拟任务中，以相同GPT-6 Astra规划器和机器人原语作公平比较，PyRUA-Lean在相同LLM调用预算下将总体成功率从63.1%提高到71.7%。双方都解决的任务中，它少用49%调用和65%输入词元。

Insight: 把低层条件判断与局部重试放进可执行单元，可用更少模型交互完成任务。收益同时体现在成功率和输入成本，但评估为模拟任务。

Abstract: Vision language model (VLM) agents can control robots through visual feedback and action primitives, but repeated model invocations and redundant observations incur substantial token overhead. We introduce PyRUA-Lean, an interactive code-execution framework that couples feedback-driven primitive composition with selective observation: the agent composes classical robot primitives and learned vision-language-action (VLA) policies into Python cells that perform conditional checks and local retries, returning only explicitly requested images and state feedback for replanning. Across 700 simulated task instances from LIBERO-PRO, RoboTwin 2.0, and RoboCasa365, we compare PyRUA-Lean with a tool-calling baseline using the same GPT-6 Astra planner and underlying robot primitives. Under equal LLM-call budgets, PyRUA-Lean increases overall success from 63.1% to 71.7%. On instances solved by both agents, it uses 49% fewer LLM calls and 65% fewer input tokens.

[97] Latent-Foresight: End-to-End Learning Predictable Representations for Latent World Models cs.CVPDF

Efstathios Karypidis, Spyros Gidaris, Nikos Komodakis

TL;DR: Latent-Foresight联合训练潜变量分词器和基于流的场景动力学模型，让视觉表示本身适合预测未来变化。

Details

Motivation: 既有世界模型先用PCA或独立自编码器压缩视觉基础模型特征，再单独训练预测器，表示学习与时间预测脱节，潜空间不保证具有可预测结构。

Result: 端到端框架共同优化重建与生成动态目标，并设计防止潜变量坍塌和目标失配的稳定机制。实验显示其潜表示时间连贯性更好，在多种未来场景理解任务和预测时距上持续优于两阶段基线，并省去独立训练阶段，包括高分辨率适配；摘要未列具体指标。

Insight: 未来可预测性应在表征学习阶段直接塑造，而非仅靠后续预测器补救。端到端优化能联合考虑观测重建和动态建模。

Abstract: Predicting the future evolution of a scene is a fundamental capability for world modeling. Recent work has shown that operating in the feature space of Vision Foundation Models (VFMs) yields semantically rich representations that support diverse future scene understanding tasks. However, existing approaches rely on two-stage pipelines, where VFM features are first compressed using fixed dimensionality reduction (e.g., PCA) or independently trained autoencoders, and a separate predictor is trained on top of the resulting frozen latent space. This decoupling between representation learning and temporal prediction, as well as approaches that apply predictors directly on raw VFM features, provides no guarantee that the latent space is structured for predictable dynamics. In this work, we propose Latent-Foresight, an end-to-end framework that jointly learns a latent tokenizer and a flow-based generative dynamics model, explicitly shaping the representation to support temporal predictability. To enable stable joint optimization, we introduce several key design choices that prevent latent collapse and align reconstruction with generative objectives. Extensive experiments show that our approach learns more temporally coherent latent representations and consistently outperforms two-stage baselines across multiple future scene understanding tasks and prediction horizons, while eliminating separate training stages, including during high-resolution adaptation. We provide the implementation code and model weights at https://github.com/Sta8is/Latent-Foresight

[98] Anti-Persona: Disrupting Unauthorized Identity Binding and Recognition in Personalized Vision–Language Models cs.CVPDF

Abhishek Basu, Fahad Shamshad, Karthik Nandakumar

TL;DR: Anti-Persona通过在图像中加入视觉细微、抗压缩扰动，破坏个性化VLM根据多张参考图建立身份原型的过程。

Details

Motivation: 少样本个性化让模型记住用户视觉概念，但攻击者也可凭少数照片绑定身份并在新图像中通过自然语言查询识别，造成隐私风险。

Result: 方法聚合多张参考图共享视觉特征为身份原型，并优化扰动使其在视觉编码器空间偏离原型，同时用平滑和低频保留保持外观质量。在两种个性化VLM上，保护率最高95.0%，同时保持视觉保真；对提示变化稳定，并在编码器不匹配时提升黑盒迁移。

Insight: 身份绑定依赖跨参考图共享的视觉特征，因此可在图像层面主动破坏这一稳定原型，而不针对单一查询提示。报告保护率最高值依赖两种测试模型和身份任务。

Abstract: Few-shot personalization enables large vision–language models (LVLMs) to learn user-specific visual concepts for applications such as personalized retrieval and subject-aware querying. However, it also creates a privacy risk: an adversary can bind a target identity from a few reference images and subsequently detect that identity in new images through natural-language queries. We introduce Anti-Persona, an image-level defense against unauthorized identity binding and recognition in personalized LVLMs. Our key insight is that identity personalization relies on visual features shared across multiple reference images. We aggregate these features into an identity prototype and optimize visually subtle perturbations that disrupt prototype alignment in the vision-encoder space. Spatial smoothing and low-frequency preservation further promote visual fidelity and practical resilience to image compression. The resulting protection does not depend on a specific prompt and supports both proactive anti-personalization and reactive image protection. Experiments on two representative personalized LVLMs demonstrate protection rates of up to $95.0%$ while preserving visual fidelity. The method remains stable across prompt variations and evaluated identity-query tasks, and improves black-box transfer under encoder mismatch.

[99] EndoLive: Real-Time Style Transfer for Endoscopic Endonasal Skull Base Surgical Video cs.CVPDF

Griffin Hurt, Calvin Brinkman

TL;DR: EndoLive把尸体内镜视频实时转换为活体外观，帮助外科医生在接近真实颜色和出血表现的视觉条件下练习颅底手术。

Details

Motivation: 尸体标本包含关键解剖结构但组织颜色与活体不同，且无昂贵灌流系统时不会真实出血，使尸体训练与真实手术视觉差异显著。

Result: 系统结合ConStructS GAN的手术风格迁移和HyPER-GAN的复杂实时图像转换，在非配对尸体与活体内镜图像上训练，并在多种设备上的尸体视频测试。实验显示尸体到活体风格转换速度高于实时需求，同时保持关键解剖结构语义一致；摘要未报告具体帧率。

Insight: 实时风格迁移可弥补尸体训练场景与活体视觉外观的差异，且关键解剖语义保持是医学应用的重要约束。该工作验证视频转换可行性，不等同于已证明提升手术训练效果。

Abstract: Complex surgical procedures around critical anatomy, such as the endoscopic endonasal skull base surgery, requires significant practice and training on the part of the surgeon before they are allowed to perform the operation on a live patient. This training in typically done in cadaveric specimens, due to them containing the same critical structures as a living human. However, cadavers are not a perfect 1-to-1 substitute for a living patient. The dead and preserved tissues of a cadaver are colored completely differently than a living human, and – without complex and expensive pumping systems – do not bleed in the same way. As a result, identifying the critical pieces of anatomy that make this procedure so complex can be quite different in a live case than in a surgeon’s cadaveric practice. This paper presents EndoLive, a framework for real-time style transfer between cadaveric endoscopic video and living human endoscopic video. Our method combines the ConStructS GAN model for realistic style transfer for surgical applications, with the HyPER-GAN model that can learn complex translations and perform them in real-time. We train EndoLive on unpaired cadaveric and live images taken from an endoscope, and test the trained model with cadaveric video, on a variety of devices. Experimental results demonstrate that EndoLive can perform cadaveric-to-live translation at speeds well above the minimum necessary for real-time, while maintaining semantic consistency of critical anatomical structures. Our source code is available at https://github.com/griffhurt/endolive.

[100] Token-Level Video Reinforcement Learning cs.CVPDF

Yifan Wang, Gordon Guocheng Qian, Yanyu Li, Anil Kag, Yun Fu

TL;DR: TVRL用冻结VLM答案似然及其对视频输入的梯度构造词元级信用图，将整体奖励定向分配给真正影响目标得分的视频内容。

Details

Motivation: 视频生成RL通常给整段视频一个标量奖励，无法定位哪些视觉词元已满足提示、哪些需要修正，可能扰动优质内容却忽视关键错误。

Result: TVRL把问题级奖励平均为组相对优势，并用停止梯度的、问题条件化词元信用图重加权密集去噪转移概率。在VBench-2.0上总体得分57.69，比基础模型高3.60分；相对匹配GRPO基线，在三种SDE采样器上高2.68—3.15分，在四种奖励模型上高1.33—3.15分。

Insight: 标量目标可通过冻结VLM对各视频词元的敏感度展开为局部信用，不必均匀修改所有内容。跨采样器和奖励模型收益表明信用定位具有一定稳健性。

Abstract: Reinforcement learning (RL) for video generation usually assigns one scalar reward to an entire sampled video. Yet a video is not uniformly flawed: some visual tokens may already satisfy the prompt, whereas others require correction. A scalar reward cannot localize errors, causing optimization to perturb satisfactory tokens while under-targeting the tokens that actually need to change. We introduce Token-Level Video Reinforcement Learning, TVRL, a framework that derives token-level credit from the reward being optimized. Our key insight is that the answer likelihood of a frozen vision-language model provides both signals: its outputs contribute to the video-level reward, while magnitudes of its video-input gradients reveal which generated video tokens most affect that score. We instantiate TVRL in Group Relative Policy Optimization by averaging prompt-derived question rewards into one group-relative advantage and using detached, question-conditioned token-credit maps to reweight dense denoising-transition log-probabilities inside the clipped policy ratio. On VBench-2.0, TVRL achieves an Overall score of 57.69, outperforming the base model by 3.60 points. TVRL also improves matched GRPO baselines across three SDE samplers (SAGE, Flow, and Dance) by 2.68–3.15 points and across four reward models (VideoAlign, VideoScore2, UnifiedReward2, and Qwen3.5-9B) by 1.33–3.15 points.

[101] From Reasoning Failures to Composable Video Spatial Intelligence cs.CVPDF

Pengzhan Sun, Junbin Xiao, Ramanathan Rajaraman, Shiu-hong Kao, Angela Yao

TL;DR: CROSS用类型化几何算子和空间技能显式处理坐标系、位置姿态和测量选择，免训练地修复视频空间推理的系统性错误。

Details

Motivation: 空间基准只报告任务分数，难指出失败来自视觉证据、几何表示还是推理过程；空间任务还容易因缺失信息、测量选错和参考系混淆而出错。

Result: 对比预测与真值空间上下文后，作者归纳出感知不准、信息缺失、测量选择错误及参考坐标或姿态跟踪错误四类问题，并构建适用于现有证据的几何工具库。五个基准上，CROSS使ReVSI平均分从55.9%升至60.2%，SpatialClaw在DSI-Bench从62.8%升至66.3%，无需额外训练。

Insight: 显式约定坐标和测量规范，可在不训练模型的情况下修复一部分结构化推理错误。算子库为普通VLM提供验证上下文，也能作为代理可调用技能。

Abstract: Spatial reasoning benchmarks evaluate vision-language models across diverse tasks, but task-level scores do not reveal which underlying capabilities account for success or failure. Each task requires recovering spatial evidence, representing geometry, and reasoning over it. We disentangle these capabilities by comparing predicted and ground-truth spatial context under a shared schema and coordinate contract. This comparison reveals four recurring sources of error: inaccurate perception, missing information in the spatial context, selection of the wrong measurement, and errors in reference frames or in tracking position and orientation. Guided by this diagnosis, we develop CROSS, a training-free library of typed geometric operators and spatial skills that function over available evidence to support reliable video spatial reasoning. The resulting library supplies verified context to non-coding VLMs or callable skills to a SpatialClaw agent. We evaluate \methodname{} on five benchmarks. \methodname{} raises the average score from 55.9% to 60.2% on ReVSI and improves the SpatialClaw result from 62.8% to 66.3% on DSI-Bench. These gains demonstrate that explicit handling of spatial conventions can repair systematic reasoning failures without additional training.

[102] Task-Adaptive Grounded 3D-Programmers Using 2D VLMs cs.CV | cs.AIPDF

Arman Raayatsanati, Sombit Dey, Anna-Maria Halacheva, Jan-Nico Zaech, Luc Van Gool

TL;DR: 3D-Prog让2D视觉语言模型通过统一坐标框架和任务自适应反馈完成开放词汇3D理解、操作和生成，无需重新训练。

Details

Motivation: 现有VLM的3D能力受数据规模、训练多样性和推理能力限制；直接把2D模型扩展到3D也会遇到坐标轴歧义、尺度不一致和空间参照不明确。

Result: Canonical Coordinate Framing将输入输出锚定到同一欧氏坐标系，Task-Adaptive Feedback根据任务迭代提供反馈。二者结合后，2D VLM可在物体和场景级任务中进行开放词汇3D理解、操作和生成。实验报告结果稳定、可解释且质量较高，但摘要未给出具体数值。

Insight: 通过显式几何约定和闭环反馈，强2D模型可在原生视觉上下文中充当3D程序员，而非另训专用3D模型。当前结论主要是定性覆盖多种任务。

Abstract: Recent vision-language models (VLMs) exhibit remarkable generalization and reasoning abilities, yet 3D understanding in these models is limited by data scale, training diversity, and reasoning capacity. Instead of naively extending these models into 3D, we take a different approach: we enable powerful 2D VLMs to operate reliably in 3D by introducing 3D grounding and iterative feedback loops with two novel concepts: Canonical Coordinate Framing (CCF) and Task-Adaptive Feedback (TAF). CCF serves as a unified visual representation that anchors both inputs and outputs to a shared Euclidean coordinate system, solving common challenges in 3D grounding such as axis ambiguity, inconsistent metric scale, and floating references. Complementary to this structured framing of the 3D inputs, TAF closes the reasoning loop with task-adaptive dynamic feedback that enables 2D VLMs to perform varied open-vocabulary tasks within their native visual context. Building on this foundation, we introduce 3D-Prog, a 3D understanding, reasoning, and generation framework that jointly employs the capabilities of CCF and TAF together with powerful VLMs. Without requiring any retraining, 3D-Prog performs open-vocabulary 3D understanding, manipulation, and generation across both object-level and scene-level tasks. Our experiments show that the joint use of CCF and TAF transforms 2D VLMs into geometry-aware 3D programmers, achieving consistent, interpretable, and high-quality results across diverse 3D tasks.

[103] Form and Void: Entangled Composition through an Autonomous AI Agent cs.CV | cs.MAPDF

Shiwen Wang, Jian Yang, Xu Wang, Xincan Wang, Weiming Dong

TL;DR: FaV-A将正负空间构图拆成先生成基础对象、分析其形状并寻找负空间语义、再生成最终构图指令的多模态代理流程。

Details

Motivation: 正负空间构图需协调共享边界的两个语义概念，单次提示难以同时控制前景对象和背景形状；现有文生图与MLLM在该类组合创作上仍不稳定。

Result: FaV-A分阶段分析形状和空间关系，再指导最终图像合成。实验及消融显示，相比直接零样本MLLM基线，它更有效地产生视觉连贯、语义对齐的正负空间构图；摘要未提供量化分数。

Insight: 把构图中的相互依赖语义拆成可检查阶段，能为最终生成提供更明确的空间规划。结果是定性比较，尚不能量化人工偏好提升幅度。

Abstract: Positive and negative space is a fundamental principle in visual composition, supporting visually coherent forms and layered semantic relationships. Generating such compositions is challenging because it requires coordinated control over two semantic concepts that share a common boundary. Although recent text-to-image models and multimodal large language models (MLLMs) have achieved strong performance in image generation and visual understanding, positive-negative space generation remains difficult, particularly under direct single-pass prompting. In this work, we present the \textbf{F}orm \textbf{a}nd \textbf{V}oid \textbf{A}gent (\textbf{FaV-A}), a multimodal agent designed for staged positive-negative space generation. FaV-A follows a progressive workflow: it first generates a base object, then analyzes its shape and spatial structure to identify candidate negative-space semantics, and finally produces compositional instructions for the final image generation stage. Experimental results and ablation analyses suggest that FaV-A provides a more effective framework than direct zero-shot MLLM baselines for producing visually coherent and semantically aligned positive-negative space compositions.

[104] Learning from Failure: Leveraging Unreliable Predictions in Semi-Supervised Real-World Adverse Weather Removal cs.CVPDF

Cap Dang Xuan Kiet, Tat-Jen Cham

TL;DR: 该半监督恶劣天气复原框架将教师失败预测保留为对比学习负样本，并把高质量伪标签作为正样本，以减少现实场景中的复原失败。

Details

Motivation: 统一天气复原模型依赖合成监督且语义约束不足，难泛化到真实雨、雾、雪场景；传统半监督方法通常丢弃不可靠伪标签，失去关于模型如何失败的信息。

Result: 框架分开存储可靠和不可靠教师预测，联合学习增强期望复原特征并避开常见错误；同时以相位谱语义约束替代昂贵文本监督，并按退化强度自适应平衡输入与伪标签。多个真实世界基准上，方法持续优于现有先进方法，提升复原质量、感知保真和现实泛化，摘要未报告具体数字。

Insight: 教师错误不仅是噪声，也可作为负样本揭示需要避免的复原模式。频谱先验提供与图像结构自然对齐的语义约束，减少对文本标注依赖。

Abstract: Adverse weather image restoration aims to recover images degraded by rain, haze, snow, and other weather-induced artifacts, thereby improving the robustness of outdoor vision systems. Existing unified restoration models exhibit limited generalization to real-world scenes due to their reliance on synthetic supervision and insufficient semantic constraints. In this paper, we propose a novel student–teacher semi-supervised framework that addresses both challenges. Specifically, we introduce an unreliable database that preserves failed teacher predictions as informative negative samples for contrastive learning, while a reliable database stores high-quality teacher predictions as positive samples. By jointly exploiting reliable pseudo-ground truths and unreliable teacher outputs, the proposed framework learns to enhance desirable restoration characteristics while avoiding common failures. We further propose a phase spectrum-based semantic constraint that replaces computationally expensive text-based supervision with an efficient and naturally aligned semantic prior. An adaptive phase consistency loss is also designed to dynamically balance supervision between the degraded input and teacher pseudo-ground truths according to degradation severity. Extensive experiments on real-world benchmarks demonstrate that the proposed method consistently outperforms existing state-of-the-art approaches in restoration quality and perceptual fidelity while exhibiting stronger generalization to real-world adverse weather conditions.

[105] GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoning cs.CV | cs.AIPDF

Yakun Zhu, Yi Bin, Yujuan Ding, Zheng Wang, Pengpeng Zeng

TL;DR: GeoLatent用共享—残差几何对齐组织连续空间潜变量，并通过路由优化暂时强制视觉答案学习经过潜路径，增强3D推理中的方向和位置表征。

Details

Motivation: 文本中间步骤难以精确表达连续空间关系，单类连续潜变量又未区分位置、方向和整体几何；分解潜变量还可能坍塌到单一方向或在答案学习时未被实际使用。

Result: CR-GEO把共享与残差教师几何分开，路由优化联合训练几何与语言，先经潜变量传递视觉答案学习，再恢复完整注意力。受控比较中，几何有效秩从1.00升至3.87；128题上阻断潜读出使方向准确率从89.1%降至25.8%。最终SPAR-Bench和SPBench分别达73.0%和72.1%，超过此前报告方法。

Insight: 结构化连续几何需要同时避免表示坍塌并确保推理真正使用潜变量；路由训练和几何监督可协同做到。阻断实验显示潜路径并非仅作辅助装饰。

Abstract: Despite progress in vision-language models, 3D spatial reasoning from 2D images remains challenging. Text-based methods describe intermediate geometry with discrete tokens, limiting fidelity for continuous spatial relations. Continuous latents offer richer representations, but a single latent type does not explicitly separate the cues needed across spatial tasks. Decomposed spatial latents address this by representing position, direction, and global geometry separately under geometric supervision. Yet the geometry representation can still collapse toward one dominant direction, and unrestricted attention can leave the latents underused during answer learning. We introduce GeoLatent, combining Common–Residual Geometry Alignment (CR-GEO) with routed optimization to structure the geometry states while promoting latent-mediated answer learning. CR-GEO separates shared from residual teacher geometry; routed optimization jointly trains geometry and language, temporarily directs visual answer learning through the latents, and restores full attention with geometry supervision. In controlled comparisons, CR-GEO raises geometry effective rank from 1.00 to 3.87, while blocking latent readout at the bottleneck lowers direction accuracy from 89.1% to 25.8% on 128 fixed questions. After recovery, the differentiated geometry representation and latent-mediated visual route remain available alongside direct image access. GeoLatent achieves 73.0% on SPAR-Bench and 72.1% on SPBench, outperforming previously reported methods on both.

[106] Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenes cs.CV | cs.AI | cs.CL | cs.LGPDF

Sophia Sirko-Galouchenko, Monika Wysoczanska, Andrei Bursuc, Nicolas Thome, Spyros Gidaris

TL;DR: Where-OPD用程序生成场景中的对象身份和空间坐标为教师提供文本化定位指导，再蒸馏给仅看图像和问题的多模态学生。

Details

Motivation: MLLM在线自蒸馏可用特权信息提升感知，但现有视觉裁剪指导只适用于需要放大的任务，且依赖人工定位标注或外部教师。

Result: 程序生成场景自动提供对象和坐标，教师据空间指导整合多个相关图像区域，学生学习复现其行为。多模型实验显示，在计数、文档和图表理解基准上持续提升；虽然只用合成场景后训练，六个真实感知基准CVBench、V*、ZoomBench、BLINK、HR-Bench和MME-RealWorld平均仍提高3.23分。

Insight: 空间标注可作为可扩展的特权文本监督，使合成数据学习迁移到真实视觉感知，而不需要人工标注每个训练图像。收益超过原始任务和数据分布。

Abstract: On-policy self-distillation has recently emerged as an effective approach for improving language-model reasoning by supervising students with a frozen or EMA version of themselves that receives privileged information. Its application to multimodal large language models (MLLMs), however, remains largely unexplored. Recent approaches use privileged visual information, such as image crops corresponding to a question, to improve fine-grained perception, but their gains are confined to tasks that benefit from such visual zooming and require either human-annotated grounding data or external teacher models. We introduce a different form of on-policy self-distillation for MLLMs that provides the teacher with textual, spatially grounded guidance identifying the visual elements relevant to a query. We use procedurally generated scenes with automatically available object identities and spatial coordinates, enabling scalable and annotation-free post-training. The teacher uses this spatial guidance to locate and integrate evidence from multiple relevant image regions, while the student learns to reproduce the resulting behavior from the image and question alone. Our approach consistently improves performance on counting, document and chart understanding benchmarks across multiple models. Importantly, although post-training uses only synthetic scenes, the resulting improvements transfer to real-world perception benchmarks, yielding a 3.23-point gain in average performance across CVBench, V*, ZoomBench, BLINK, HR-Bench, and MME-RealWorld. These results show that spatially grounded privileged information can induce broader perceptual capabilities through on-policy self-distillation, enabling substantial synthetic-to-real transfer beyond the task and data distribution used for post-training. Project page: https://github.com/sirkosophia/Where-OPD

[107] Harnessing Domain Specialists in Multimodal Mixture-of-Experts for Efficient Adaptation cs.CVPDF

Damiano Marsili, Raphi Kang, Aditya Mehta, Pietro Perona, Georgia Gkioxari

TL;DR: ExpertLens从预训练多模态MoE路由权重中识别领域专家，并仅微调与目标任务相关的专家以降低适配成本。

Details

Motivation: MoE以稀疏激活扩展容量，专家是否会自然形成跨模态、跨领域语义分工，以及这种结构能否用于高效领域适配尚不明确。

Result: 分析发现专家在未显式模块化训练时已出现语义专门化。ExpertLens将路由权重解码为有意义词元、无需数据即可定位领域专家。在数学、医疗和遥感任务上，仅更新21.7%—47.0%参数即可匹配或超过全量微调，平均训练加速4倍，并同时优于LoRA的适配表现和效率。

Insight: 为计算效率设计的MoE稀疏性可能产生可直接利用的语义模块化，不必对所有专家统一微调。权重级识别使适配可减少参数更新和训练时间。

Abstract: Mixture-of-Experts (MoE) architectures scale model capacity through sparse computation, routing each token through only a small subset of experts. In this work, we explore whether this sparsity gives rise to emergent intrinsic organization in multimodal MoEs. We find that experts develop strong semantic specialization across modalities and domains despite not being explicitly trained for modularity. Building on this structure, we introduce ExpertLens, a data-free method that identifies domain-specialized experts directly from pretrained model weights by decoding router weights into semantically meaningful vocabulary tokens. We leverage this specialization for efficient multimodal adaptation by selectively fine-tuning experts relevant to a target domain. Across math, medical, and remote sensing tasks, ExpertLens matches or surpasses full fine-tuning while updating only 21.7 - 47.0% of model parameters and achieving a 4.0x average training speedup, and outperforms LoRA in both adaptation performance and training efficiency. These results show that sparsity introduced for efficiency can give rise to semantic modularity that is directly useful for efficient adaptation.

[108] Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation cs.CVPDF

Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly, Ivan Laptev, Hisham Cholakkal

TL;DR: Omni-Embed-Mini冻结文本侧权重，将文本、语音、音频、图像、视频和富视觉文档对齐到共享余弦空间，避免扩展模态时损害文本检索。

Details

Motivation: 文本嵌入扩展到新模态常导致文本检索退化，现有全模态嵌入模型又常需数十亿级参数；需要在保留文本能力的前提下以较小模型绑定多种媒体。

Result: 0.9B模型用冻结骨干对级联描述生成教师目标，再用轻量投影器和分阶段LoRA对齐额外五种模态，文本权重逐比特不变。MTEB-v2 BEIR-8文本检索nDCG@10为49.57；模型比所有对比开源全模态嵌入器小约2.7至9.5倍。2.3B版本换用原生VLM骨干后总体模态平均略高于闭源Gemini embedding 2。

Insight: 教师监督可直接来自冻结骨干对配对描述的嵌入，无需另训独立教师；冻结文本侧参数保证训练不回退文本检索。两种规模分别展示效率和多模态竞争力。

Abstract: Extending a text embedding model to new modalities typically degrades text retrieval quality, and existing omni-modal embedders compensate with multi-billion parameters. We present Omni-Embed-Mini, a 0.9B-parameter model that maps text, speech, audio, images, video, and visually-rich documents into a single shared cosine space without updating any text-side parameter. Our key insight is that the teacher signal requires no separate embedding model: each media sample is paired with a dense cascaded caption, and the teacher target is simply the frozen backbone’s own embedding of that caption. Because teacher and student share the same backbone weights, they inhabit byte-identical geometry, and lightweight projectors plus phased LoRA adapters on the modality encoders suffice for alignment. Training combines a Matryoshka SigLIP contrastive loss with an online hybrid hard-negative miner whose negatives sharpen as the encoder improves. The recipe carries over to a 2.3B variant by swapping in a native vision-language backbone. Omni-Embed-Mini-0.9B keeps its text weights bit-identical to the backbone, so training cannot regress text retrieval (49.57 nDCG@10 on MTEB-v2 BEIR-8), while extending it to five additional modalities, and is ~2.7x to 9.5x smaller than every open omni embedder we compare against. The 2.3B variant is competitive with the closed gemini-embedding-2, edging ahead of it on the overall-modality average. Models, code, data and evaluation harness are on our project page: https://omniembed.cvmbzuai.com

[109] MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation cs.CV | cs.GRPDF

Yiwen Zhang, Haocheng Xi, Michael Tian-Yue Liu, Alexei A. Efros, Hadar Averbuch-Elor

TL;DR: MosaiChunk在有限活动记忆预算下，从历史时空位置挑选并拼接非连续KV条目，使自回归视频生成器在对象重现时找回细节。

Details

Motivation: 长程视频生成受上下文窗口限制，对象或场景退出上下文后，其精细视觉特征难以恢复；整块历史检索可能包含大量无关内容。

Result: 冻结视频生成器直接消费跨空间和时间的非连续历史KV，只训练轻量路由器选择预算内片段。作者构建涵盖文本到视频和图像到视频的长时程重访基准RememBench。匹配记忆预算时，MosaiChunk在两类设置中都比滑动窗口推理和整块检索更能保持重访一致性；摘要未给出数值。

Insight: 历史视觉信息可用KV记忆按需拼接，无需改动生成器或保存完整连续上下文。轻量路由器需在有限预算中选择真正影响重访内容的片段。

Abstract: Long-horizon autoregressive video generation is limited by a finite context window. When an object or scene falls out of context, its fine-grained visual details may be lost and difficult to recover upon reappearance. To retain access to such visual details, we introduce MosaiChunk, a spatio-temporal memory mechanism that composes a mosaic of selected historical key-value (KV) entries across space and time. Our approach is motivated by the observation that a frozen video generator can directly consume such non-contiguous historical KV and recover the corresponding visual content. We therefore keep the generator fixed and learn only a lightweight router that determines which historical sections to include in the mosaic under a fixed active-memory budget. We further introduce RememBench, a benchmark of long-horizon revisits with prompt-driven text-to-video (T2V) and camera-driven image-to-video (I2V) splits. Our experiments show that MosaiChunk consistently improves revisit consistency over both sliding-window inference and whole-chunk retrieval under matched memory budgets, across both T2V and I2V settings.

[110] 4Director: Controlling Video World Models with Rigid 3D Geometry cs.CVPDF

Wei Cao, Hao Zhang, Vikram Voleti, Yuqun Wu, Mallikarjun B R

TL;DR: 4Director以规范网格表示对象并逐帧施加刚体变换控制4D场景，再由运动适配器把几何控制转成外观、光照和非刚性细节。

Details

Motivation: 现有可控视频生成多用2D轨迹或稀疏拖动信号控制对象，深度和旋转含糊；3D轨迹或点云又缺完整几何，视角变化时一致性差。

Result: 方法为输入对象重建规范网格，使用指定刚体运动，并渲染深度视频作为运动适配器条件；训练数据RealCOD-Rigid含自动标注的20,774段片段，评价指标IG-IoU同时衡量物体运动遵循和身份保持。实验显示，4Director在视觉质量、相机控制和对象控制上均持续优于先前方法。

Insight: 显式刚体几何提供直观的3D控制界面，避免每帧独立生成未观测几何。运动遵循和身份保持需联合评估，单看轨迹误差不足。

Abstract: Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through image-plane cues that are ambiguous in depth and rotation or through 3D tracks and blobs that lack complete geometry and lose consistency across viewpoint changes. We introduce 4Director, a video world model conditioned on an explicit 4D scene representation: each object is reconstructed once from the input image as a canonical mesh and moved by one prescribed rigid transformation per frame. This representation provides an intuitive 3D control interface and prevents unobserved geometry from being regenerated independently in every frame. We render the controlled scene as a depth video and introduce a Motion Adapter that transforms this geometric scaffold into video while synthesizing view-consistent appearance, illumination, and non-rigid dynamics. For training, we construct RealCOD-Rigid, a new dataset of 20,774 clips annotated with rigid 3D scenes by our automatic pipeline. We further introduce Identity-Gated IoU (IG-IoU), which jointly evaluates adherence to prescribed object motion and preservation of object identity. Experiments demonstrate that 4Director consistently outperforms prior methods in visual quality and in camera and object control.

[111] World Observer: Joint Actor-Observer Generation for Persistent World Modeling cs.CVPDF

Hyunwook Choi, Dahyun Chung, Hyunsung Kim, Siyoon Jin, Jinhyeok Choi

TL;DR: World Observer为智能体视角外的场景布置一个或多个全景观察者，并与当前行动者视角共同生成，使离开画面的对象继续演化。

Details

Motivation: 视频世界模型以行动者当前视野为中心，对象离开画面后失去直接证据，常无法保持其状态与动态，导致再次出现时不连续。

Result: 行动者和观察者从共享全景源变形生成以建立几何对应，观察者持续更新画外对象；高分辨率透视参考观察器在对象返回时恢复细节。观察者可布置在多个位置并由控制信号引导，作者还构建现实与合成场景基准及世界坐标指标。实验显示画外动态显著改善，同时视觉保真、相机控制和3D一致性保持竞争力。

Insight: 把观察与行动分离，可在生成时为不可见区域维护状态，而不要求行动者始终转头查看。共享全景源和重返参考负责几何与细节连续性。

Abstract: How can a world model continuously observe regions beyond the actor’s current view? Video world models simulate how an environment evolves from an agent’s actions, yet remain actor-centric. Once an object leaves the actor’s view, they lose direct evidence of its evolution, often failing to preserve its state and dynamics upon re-entry. To address this, we introduce World Observer, which decouples observing from acting by jointly generating a perspective actor for the agent-centric view with one or more panoramic observers that watch selected world regions. This allows objects that leave the actor’s view to remain visually evolving in an observer, so their updated states are reflected when they re-enter. We ground the actor and observers by warping from a shared panoramic source for explicit geometric correspondence, and introduce an Observer Sink of high-resolution perspective references to restore fine appearance upon re-entry. Since the observers are decoupled from the actor, they can be placed freely across the scene, extended to multiple locations for broader coverage, and driven by control signals to steer out-of-view evolution. To evaluate out-of-view evolution, we further introduce world-space metrics and a benchmark spanning real and synthetic scenes. World Observer substantially improves out-of-view dynamics while remaining competitive in visual fidelity, camera control, and 3D adherence.

[112] Generative Cinematographer: Composing Camera and Object Motion in 3D cs.CV | cs.AIPDF

Jiahan Zhang, Chaohao Yang, Namitha Guruprasad, Vivekjyoti Banerjee, Trong-Tung Nguyen

TL;DR: GenCine把单张图像提升为可编辑3D场景，让创作者联合指定相机路径和对象局部3D运动，再转换为指导图控制预训练视频生成器。

Details

Motivation: 二维轨迹可能对应多种不同三维运动，尤其当相机和对象同时移动时，难以表达对象相对于场景的运动关系。

Result: 用户可用多个局部3D控制手柄分别移动主体不同部分，以分段刚体近似非刚性运动，无需物理模拟器或类别先验；指导图在各帧记录受控区域、固定手柄颜色和世界坐标位置。系统用真实视频恢复控制、合成视频提供几何和轨迹，并训练轻量指导分支及LoRA。实验显示相机相对运动更一致、视角变化下几何一致性提高，且可控性覆盖多种真实场景。

Insight: 以世界坐标表达局部运动能解除相机运动与对象运动之间的混淆，比单纯二维拖动更可解释。分段控制在没有物理引擎时近似复杂变形。

Abstract: Current controllable video generation systems often rely on 2D motion trajectories or sparse drag signals for object motion. These controls are ambiguous because the same 2D trajectory can correspond to different 3D motions, especially when the camera and objects move simultaneously. We present Generative Cinematographer (GenCine), a system that lifts a single image into an editable 3D scene scaffold where artists jointly author camera and foreground motion. Artists specify a camera path and move selected foreground regions using local 3D motion handles. Several handles can move different parts of a subject independently, providing a piecewise-rigid approximation to non-rigid motion without a physics simulator or category-specific prior. To communicate these controls to a pretrained video model, we project them into guidance maps. These maps record where the controlled regions appear in each frame, assign each handle a fixed color across frames and encode the current 3D positions of its controlled points in the same world coordinate system as the background. This lets us describe object motion relative to the scene even as the camera moves. For training, we recover controls from the motion observed in real videos and use ground-truth geometry and trajectories from synthetic videos. We train a lightweight guidance branch and LoRA adapters on a pretrained Wan model to follow these controls. Our experiments show consistent camera-relative motion, improved geometric consistency under viewpoint changes, and strong controllability across diverse real-world scenes.

[113] OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning cs.CVPDF

Haibo Wang, Jiteng Mu, Jialu Li, Jingru Yi, Yuanjun Xiong

TL;DR: OmniSeek把全模态LLM变成主动证据搜索代理，按需选择看或听及时间片段，并把检索到的音视频证据加入多轮推理。

Details

Motivation: 一次处理完整长音视频既昂贵，也会稀释稀疏关键证据；模型需要自主决定从哪种模态、哪个时间区间取证，再据此继续推理。

Result: 作者构建OmniTraj-170K多跳音视频CoT轨迹，先监督学习多轮工具使用，再通过两阶段可验证奖励RL优化，并加入音视频必要性目标以抑制单模态捷径。多个基准实验显示，OmniSeek学会自适应跨模态取证并持续改善音视频推理；摘要未给出具体提升数值。

Insight: 证据获取本身应成为推理策略的一部分，模型可按问题动态选择模态和时间窗口，而非被动消费整段输入。明确鼓励两模态都必要可减少依赖单一模态的捷径。

Abstract: We present OmniSeek, an agentic framework that transforms an Omni Large Language Model (Omni-LLM) into an active, multi-turn reasoning agent with native tool use. Rather than passively processing an entire audio-visual sequence in a single forward pass, OmniSeek makes evidence acquisition part of the reasoning process: it dynamically decides whether to look or listen, and over which temporal window, to retrieve sparse but critical evidence across different modalities within long contexts. Through an iterative multi-turn protocol, the retrieved raw audio or visual segments are appended back into the context to support subsequent reasoning. To cold-start this capability, we build a data engine that synthesizes OmniTraj-170K, a corpus of multi-hop Chain-of-Thought trajectories with interleaved audio and visual evidence. We first supervise the model on these trajectories to instill multi-turn tool-use behavior, and then further optimize the policy via a two-stage reinforcement learning with verifiable rewards. Moreover, we introduce an Audio-Visual Necessity objective that explicitly rewards successful trajectories whose reasoning depends on both modalities, discouraging single-modality shortcuts. Extensive experiments across a wide range of benchmarks demonstrate that OmniSeek learns adaptive cross-modal evidence seeking and consistently improves audio-visual reasoning performance.

[114] DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation cs.CV | cs.AIPDF

Zhengming Yu, Junkun Yuan, Haotian Yang, Gordon Guocheng Qian, Yizhi Wang

TL;DR: DMAD把分布匹配蒸馏转化为分类器直接估计密度比，用共享判别器训练少步生成学生，无需额外拟合辅助扩散分数模型。

Details

Motivation: DMD需维护一个持续跟随学生分布变化的辅助扩散模型，增加内存与计算；判别器logit与对数密度比的关系可用于更直接地实现分布匹配。

Result: 两个共享骨干判别头区分真实数据和教师样本与学生样本，线性logit损失在判别器最优时恢复DMD梯度；另用真实—教师logit差按噪声水平重加权。DMAD在ImageNet-64单步FID为1.04，COCO-10K四步SDXL为14.47，四步Wan2.1-T2V-14B的VBench总分85.15，均为比较少步方法和多步教师中的最佳。MiniMax-H3-33B四步音视频模型人类偏好率较DMD2和rCM分别79.1%和84.6%。

Insight: 分类式密度比估计可替代昂贵辅助分数拟合，并在图像、视频和联合音视频少步生成中保持高质量。理论对应关系给出与DMD梯度的一致性基础。

Abstract: Distribution Matching Distillation (DMD) trains a few-step student from the difference between separately estimated target and student scores, so it must keep an auxiliary diffusion model fitted to the student’s evolving distribution at extra memory and computation cost. We introduce DMAD, Distribution Matching as Adversarial Distillation, which recasts distribution matching as classification and learns the required log-density ratios directly. Two discriminator heads on a shared backbone distinguish real data and teacher samples from the student’s, and linear losses on their logits train the student without auxiliary score fitting. We prove that at the discriminator optimum these losses recover the distribution-matching gradient underlying DMD, through the classical identity linking discriminator logits to log-density ratios. We further introduce gap-based reweighting, which adapts teacher supervision across noise levels from the real-data head’s empirical logit gap between real and teacher samples. DMAD reaches a Fréchet Inception Distance (FID) of 1.04 with one-step generation on ImageNet-64x64, 14.47 with four-step SDXL on COCO-10K, and a VBench total score of 85.15 with four-step Wan2.1-T2V-14B, the best values among the compared few-step methods and the multi-step teachers. On MiniMax-H3-33B, our four-step student achieves overall human preference rates of 79.1% over DMD2 and 84.6% over rCM for joint audio-video generation, excluding ties. Our code, models and demos are available at https://yzmblog.github.io/projects/DMAD.

[115] HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation cs.CVPDF

Tahira Kazimi, Shubhankar Borse, Munawar Hayat, Fatih Porikli, Pinar Yanardag

TL;DR: HiPhy用局部物理规律损失和全局场景语义一致性奖励，训练视频生成模型同时呈现多个相互作用的物理过程。

Details

Motivation: 视频生成虽逼真，却常违反物理规律；当一个场景同时涉及浮力、流体等多项物理过程时，现有方法多只对单一规律建模，难以保证同步一致。

Result: HiPhy构建含5万提示的数据集及MultiPhyBench，将物理过程的局部时序动力学与全局物理、语义连贯性共同优化。实验显示其在多个基准上优于先前方法，提升物理常识和语义对齐；涉及并发物理规律的场景收益最大，而其他方法在此类场景退化。

Insight: 物理生成需要同时约束局部规律和它们在同一场景中的协调关系，单项物理奖励不足以支撑组合事件。数据集与基准面向多物理过程评估。

Abstract: Video generation models have achieved remarkable visual fidelity and have strong potential to become general-purpose world simulators. Despite this progress, they still fail to generate videos which adhere to laws of physics. The problem becomes even more apparent in realistic settings where multiple physical principles must work together within the same video; for example, “a balloon floating upward while steam rises from a pot” requires buoyancy and fluid dynamics to unfold coherently and simultaneously. Yet existing methods largely ignore multi-principle interactions, focusing on a single principle per video. We propose HiPhy (Hierarchical Physical Alignment), a reinforcement learning framework that grounds video generation in physical laws through a dual-level objective: locally enforcing the temporal dynamics of individual physical principles, and globally ensuring the physical and semantic coherence of the entire scene. To support multi-principle generation, we construct a 50K-prompt dataset and introduce a prompt benchmark MultiPhyBench, spanning a diverse range of co-occurring physical events. Our experiments show that HiPhy significantly outperforms prior methods and baselines, improving physical commonsense and semantic alignment significantly across various benchmarks, with the largest gains on scenes involving multiple concurrent physical principles where competing methods degrade most sharply.

[116] SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation cs.CV | cs.AI | cs.LGPDF

Tianjiao Yu, Xinzhuo Li, Yifan Shen, Ying Shen, Kiet A. Nguyen

TL;DR: SILSA用三轴重叠滑窗切片潜变量表示高分辨率3D形状，并通过邻切片拓扑监督保持薄结构和长距离连通性。

Details

Motivation: 体素潜变量和多阶段生成会把连续表面切成大量局部词元、增加成本，并可能破坏薄或高度连通形状的拓扑结构。

Result: SILSA以切片VAE编码多轴表面，稀疏体积解码器重建，体积锚点格协调方向切片；切片级拓扑损失匹配持久图并对齐Betti变化。相较最强基线，PSNR提高8.7%、coverage提高5.96点、Betti误差降低9.2%；词元数比次紧凑基线少70%，比稀疏或层级分词少98%以上，训练内存降40.4%，推理时间降58.5%。

Insight: 切片连续性和拓扑监督能在紧凑表示下保留细长结构与远程连接，降低高分辨率3D生成的词元成本。效率和结构保真度均有量化收益。

Abstract: High-resolution 3D generation increasingly relies on voxel latents and multi-stage pipelines that first predict active structure and then synthesize local geometry. While effective, this design fragments continuous surfaces into many local tokens, inflates generation cost, and often weakens topological consistency for thin or highly connected shapes. We introduce SILSA, a topology-aware 3D generation framework that represents shapes with compact sliding-window slice latents. Instead of generating expensive voxel tokens, SILSA uses a fixed set of overlapping slices along the three canonical axes, where each token summarizes a local depth window to preserve cross-sectional continuity and support single-stage rectified-flow generation. A Slice VAE encodes oriented surface samples into multi-axis slice latents and reconstructs them with a sparse volumetric decoder, while a Volumetric Anchor Lattice coordinates directional slice streams through a shared 3D workspace. To preserve structural correctness, we introduce slice-level topology supervision that matches persistence diagrams and aligns Betti transitions across neighboring slices. Experiments show that SILSA improves structural fidelity while substantially reducing generation cost. SILSA improves PSNR by $8.7%$, coverage by $5.96$ absolute points, and Betti error by $9.2%$ over the strongest baseline, while using $70.0%$ fewer tokens than the next-most compact baseline and over $98%$ fewer tokens than sparse or hierarchical tokenizers, effectively reducing training memory by $40.4%$ and inference time by $58.5%$. Qualitative results further show improved preservation of thin structures, repeated components, and long-range connectivity.

[117] ROWBench: Do Video Models Render What the Program Specifies? cs.CVPDF

Zheng-Hui Huang, Guixu Lin, Yu-Ju Tsai, Jian-Kai Zhu, Fengbo Lan

TL;DR: 该基准用程序化世界事件记录验证视频模型是否按明确游戏逻辑呈现对象控制、长程记忆和时间线事件。

Details

Motivation: 可编程世界模型需忠实渲染显式规则和交互，但现有基准多测画质、控制或一般物理一致性，较少检验细粒度程序事件是否真的出现在视频中。

Result: 基准包含170个程序化场景、600段代理视频，并保存实体状态、含镜头外事件的时间戳记录及可重放视图。评估实体控制、长程记忆、逻辑—渲染对齐和交互成功率，也可从多视角和不同表示渲染场景。摘要描述了基准设计，未给出模型实验结果。

Insight: 程序执行记录可作为视频渲染的客观参照，检验生成画面是否体现世界状态变化，而不只看视觉质量。显式记录镜头外事件支持长程状态评估。

Abstract: Programmable world models separate executable dynamics from visual generation, offering a promising foundation for next-generation game engines. However, their visual adherence to explicit rules and interactions remains insufficiently evaluated. Existing benchmarks assess visual quality, controllability, and instruction or physical adherence, but rarely test fidelity to fine-grained, program-specified world events. We introduce PROWBench, comprising 170 programmatically constructed episodes and 600 proxy videos covering diverse scenes and interactions. PROWBench logs entity states and timestamped events, including those outside the camera’s field of view, as replayable world records, from which it renders synchronized views and proxy representations. This enables generated videos to be checked against the observable consequences of program execution. An extensible framework constructs scenes, controls behaviors, and can render each camera view in different representations, such as coarse 3D, and bounding boxes. The benchmark covers first- and third-person perspectives, with synchronized multi-view observations available for a subset of episodes. Grounded in these records, PROWBench evaluates entity control, long-horizon memory, and, with two VLM-based metrics, Logic-Render Alignment and Interaction Success Rate, adherence to the prescribed timeline and the visual realization of timestamped engine-recorded events.

cs.CL [Back]

[118] SCM-based Fairness and Faithful Explainability for Legal Document Classification cs.CLPDF

Yasmina El Kacemi, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansoor Alsahag

TL;DR: 研究用结构因果模型式公平正则审查法律文本分类中的群体差异与SHAP解释忠实度，发现公平性变化和解释变化并不等价。

Details

Motivation: 法律辅助模型的公平性和解释透明度通常分开评估，因此难以判断去偏干预是否同时改变群体差异及解释对模型实际决策的忠实程度。

Result: 在LexGLUE的ECtHR案件语料上，研究比较LegalBERT基线和抑制刻板温暖度、能力感表示的公平正则模型，跨五个随机种子评估性能、公平性与SHAP充分性。在性能最优正则强度下，干预并未降低人口群体差异；分类性能基本不变，但五个种子和三个阈值下解释充分性均下降。打乱词对的控制也产生相同解释退化，说明原因是对比表征正则，而非特定温暖度/能力感结构。

Insight: 解释行为变化不能作为公平改善的替代指标，公平性必须直接度量。对比表征正则可能损害解释充分性，即便预测表现和群体差异均未变化。

Abstract: Transformer models such as LegalBERT are increasingly used in legal decision support, raising concerns about both fairness and the transparency of model explanations. These properties are usually evaluated separately, leaving open whether a debiasing intervention that changes fairness also changes how faithfully explanations reflect model reasoning. This study investigates that relationship on the ECtHR alleged-violations corpus from LexGLUE. It compares a LegalBERT baseline with a fairness-regularized variant that penalizes stereotypical warmth and competence representations during fine-tuning. The evaluation covers predictive performance, demographic fairness, and SHAP explanation faithfulness across five random seeds. At the performance-optimal regularization strength, the intervention does not reduce demographic disparity. This null result holds across two fairness definitions and a conventional word-pair control on the gender axis. Classification performance is largely unchanged. However, the intervention consistently degrades explanation sufficiency across all five seeds and three thresholds. A shuffled-pair control reproduces this degradation while leaving performance and fairness unchanged, indicating that the effect arises from contrastive representational regularization rather than specifically from the warmth and competence structure. The results demonstrate a dissociation between fairness and explanation faithfulness: changes in explanation behavior do not necessarily indicate changes in fairness, and fairness must therefore be evaluated directly.

[119] BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQL cs.CL | cs.AI | cs.DBPDF

Chen Shen

TL;DR: BudgetSchemaBench以真实SQL执行为基础，按预算诊断Text-to-SQL代理能看到多少数据库模式信息以及检索覆盖对准确率的影响。

Details

Motivation: 结构化数据代理需要把数据库模式放入有限上下文；大型目录含多个数据库和数千列，预算约束会迫使系统在表覆盖范围与序列化细节之间取舍。

Result: 基准从金标准SQL机械生成相关性标签，使用80个数据库、四档预算和三种表示，并固定检索排名；还通过命名空间检查拒绝从错误数据库得到偶然正确结果。对1,279个留出问题，原始序列化下预算从目录的2.5%增至50%时，词法检索执行准确率提高18个百分点，稠密检索仅提高3点；冻结金标准表时三种表示差距不超过2点。移除必需表后，94.6%的正确预测会准确提及缺失表名，符合模型依靠参数知识重建模式的情形。

Insight: 检索受覆盖限制时，扩大模式预算比微调序列化格式更重要；稠密检索已在低预算找到大多数所需表。执行式诊断还能区分检索缺失与模型格式化能力问题。

Abstract: Data agents over structured sources must fit database schema into the model’s context window. Large catalogs can span many databases and thousands of columns, so cost constraints may require choosing between table coverage and serialization detail well before the context window is full. We introduce BudgetSchemaBench, an execution-grounded diagnostic for this setting. Its construction derives relevance labels mechanically from gold SQL, without human- or LLM-authored ground truth. Using a pooled 80-database catalog, we sweep four schema-context budgets and compare three representations while keeping each retriever’s table ranking fixed. A source-namespace check rejects queries that obtain the correct result from the wrong database. The evaluation covers three conditions: end-to-end retrieval; frozen-gold, in which the required tables are guaranteed; and a probe that removes those tables. For the primary solver with raw serialization, raising the budget from 2.5% to 50% of the catalog improves execution accuracy on 1,279 held-out questions by 18 percentage points under lexical retrieval but only 3 under dense retrieval; the dense retriever already finds most required tables at the smallest budget. When the required tables are removed, 94.6% of correct predictions name one of them exactly, consistent with reconstruction of absent schema from parametric knowledge. For the two main solvers in the frozen-gold condition, the three representations differ by at most 2 percentage points, and the widest paired 95% confidence interval bounds the difference within +/-4 points. We observe the same qualitative patterns with one reasoning model from a different family. When retrieval is coverage-limited, execution accuracy is more sensitive to the schema budget than to the tested serializations. The diagnostic and the code used to construct and evaluate it are publicly available.

[120] Metric-Construction Coupling Inflates Measured Synthetic Dialect Recovery cs.CLPDF

Hyojung Han

TL;DR: 研究提出KoDialectBench并审计合成韩语方言数据的恢复率，发现评估词典与生成规则共享构造词表会显著夸大合成数据效果。

Details

Motivation: 受授权限制，韩语方言语料可能只能发布模型权重，无法共享原始训练和评测数据；需要衡量合成数据恢复真实监督的程度，并确认测量是否独立于合成管线。

Result: KoDialectBench含五个地区、三个维度的1,000项测试，通过哈希和评分代码让使用者从自有授权数据重建。最佳合成方案在地区识别恢复真实数据收益的91.2%，理解为63.7%；生成评估则随指标而异。将20%标记类型从规则中排除、同为8,600训练样本后，留出标记上的方言性恢复从91.8%降至8.1%，地区匹配从101.9%降至25.6%，而三种独立测量不降；指标构造覆盖率越高，测得恢复率越高。

Insight: 若合成规则能直接生成评测词典中的标记，评分可能测到管线复现而非真实方言能力。构造和评估库存应分离，合成数据效果需用独立指标验证。

Abstract: Korean dialect corpora are available but not redistributable: weights may be released, while reproducing training and evaluation from the underlying data cannot be. We ask how much of that supervision synthetic data recovers, and whether that recovery can be measured independently of the synthesis pipeline. We contribute KoDialectBench, 1,000 items across five regions on three axes, released as identifier hashes and scoring code so users reconstruct the items from their own licensed copy. Recovery is strongly axis-dependent: our best synthetic arm reaches 91.2% of the real-data gain on region identification but 63.7% on comprehension. On generation the answer depends on the metric: the deployed marker lexicon reports 92.3% on dialectness and 119.3% on region match, the latter exceeding the real-data reference, whereas reference-based generation reaches 72.4%. We find the marker metrics’ scoring inventory is entirely contained in the inventory our transformation rules can emit. We test the effect of construction access directly with an exact-form construction-disjoint arm that withholds 20% of marker types from the rules. At exactly matched training size (8,600 examples) it reduces dialectness recovery from 91.8% to 8.1% and region-match recovery from 101.9% to 25.6% on the held-out marker inventory, while the three pipeline-independent measurements do not fall at all. A complementary evaluator sweep defines metric-construction coverage (MCC) and finds measured dialectness recovery increasing monotonically as overlap rises from MCC=0 to MCC=1. Shared construction and evaluation inventories can therefore substantially inflate estimates of synthetic-data recovery.

[121] CAVE-Mem: Boundary-Aware Experience Validation for Memory Search cs.CL | cs.AIPDF

Xinyu Li

TL;DR: CAVE-Mem把可复用经验表示为带适用条件的干预算子，仅在记忆载体、问题意图、答案要求、证据边界及效用均匹配时修改基线答案。

Details

Motivation: 长期记忆代理会迭代检索经验并复用旧搜索策略，但相关经验若遇到不同记忆载体、问题粒度或证据边界也可能有害；仅按相似度选经验缺乏适用性验证。

Result: 无需训练的CAVE-Mem先生成基线记忆搜索答案，再检查经验算子的适用条件和交叉拟合效用，不匹配时选择弃用。在长期对话记忆、多跳问答和长文叙事推理实验中，它持续优于只按相关性复用经验的基线。

Insight: 记忆经验应被视为有边界的操作建议，而非可直接注入的通用知识；明确适用条件并允许弃答能降低错误经验带来的负迁移。摘要未报告各任务具体分数。

Abstract: Long-term memory agents increasingly rely on it- erative search and reusable experience to answer questions over large personal, factual, or narrative histories. However, current experience-memory systems largely optimize relevance: they re- trieve past search lessons that appear similar to the current state and inject them into the prompt. A relevant experience can still be harmful when the memory substrate, question intent, answer granularity, or evidence boundary changes. We propose CAVE- Mem, a training-free framework that represents experience as a typed intervention operator with applicability, boundary, and utility conditions. CAVE-Mem first obtains a base memory-search answer, then allows an operator to change it only if the oper- ator matches the current substrate, answer contract, evidence boundary, and cross-fitted utility; otherwise the system abstains. Experiments across long-term conversational memory, multi-hop question answering, and long-document narrative reasoning show consistent gains over relevance-only experience reuse.

[122] Certainty Is Not Just Correctness: Rethinking Token-Level Certainty in LLM Reasoning cs.CL | cs.AIPDF

Yunfan Zhou, Ye Zhu, Zhihai Wang, Jianguo Yao, Haibing Guan

TL;DR: 论文区分词元置信度识别易答问题与区分同题正误答案的能力，并据此把早期置信度用于分配采样、末尾置信度用于加权投票。

Details

Motivation: 词元置信度常被当作正确性的代理，但效果取决于要预测的目标、置信度计算方式以及聚合哪些词元位置；问题难度判断和答案正确性判别可能不是同一种信号。

Result: 受控实验发现，置信度通常更擅长预测模型较可能答对哪些问题，而不擅长区分同一问题的正确与错误回答。难度信息较早出现，较弱的答案正确性信号更多集中于回复末尾。测试时策略用生成早期置信度分配回复数、用末尾置信度加权投票，相较固定采样多数投票，将准确率从78.71%提高到79.54%，生成词元成本降低82.4%。

Insight: 置信度应按决策用途和词元位置分别使用，而非聚合成单一正确性分数。早期信号可节约采样预算，末尾信号可调整答案票重，组合后在该实验中以较小准确率提升大幅降低成本。

Abstract: Token-level certainty is widely used as a proxy for correctness in LLM training and inference. However, the performance of certainty-based methods depends both on the information in certainty scores and on how those scores are used. We therefore directly assess certainty’s predictive ability through controlled empirical evaluations across models and tasks. We distinguish two prediction targets: identifying questions a model is more likely to answer correctly and distinguishing correct from incorrect responses to the same question. In our experiments, certainty is generally better at identifying questions a model is likely to answer correctly than at distinguishing correct from incorrect responses to the same question. Certainty also varies systematically across token types and positions within words, reflecting local properties of words and text form. Information about question difficulty appears early in generation, while the weaker information about answer correctness is more concentrated near the end. These findings show that the information certainty provides for decisions depends on the prediction target, the model, the certainty metric, and which token positions in the response are included in aggregation. We further demonstrate the practical value of these findings for test-time compute. We allocate the number of responses using certainty early in generation and weight answer votes using certainty near the end of each response. Compared with a fixed-sampling majority-voting baseline, this approach increases overall accuracy from 78.71% to 79.54% while reducing generated-token cost by 82.4%.

Anca Dinu, Andra-Maria Florescu, Marius Micluta-Campeanu, Stefana-Arina Tabusca, Claudiu Creanga

TL;DR: 论文以CRIB数据集比较意大利与罗马尼亚TikTok“brain rot”迷因的文字、声音和视频特征，分析流行度关联及跨语言差异。

Details

Motivation: 此类迷因的吸引力可能来自文本荒诞、音频表现或视频节奏，但其跨语言文化差异和不同模态对传播表现的作用尚不清楚。

Result: CRIB包含按语言和流行度分层的240段TikTok视频，研究提取文字、声音和视觉特征。流行度与文字情绪、荒诞、押韵或声音情绪等指标无显著相关；罗马尼亚视频的剪辑速度和整体节奏则是强预测因素。意大利样本文字更负面、困惑度更高且押韵更多，声音旋律范围和响度更高；罗马尼亚音频频谱更明亮、音高变化更不规则。

Insight: 在该语料中，传播表现的线索更集中于罗马尼亚视频节奏，而非单纯文本或音频属性；跨语言形式也呈现不同组合。240段样本支持比较分析，不代表所有网络迷因文化。

Abstract: This paper presents a comparative multi-modal analysis of Italian and Romanian brain rot memes, investigating the factors that contribute to its appeal and the linguistic and cultural distinctions between the two versions. To conduct this analysis, we introduce a multi-modal brain rot dataset named CRIB (Collection of Romanian and Italian Brain rot), a manually curated collection of 240 TikTok videos stratified by language (Italian, Romanian) and popularity, on which we examine textual, acoustic, and visual features. Our findings indicate that popularity is not significantly correlated with textual elements like sentiment, absurdity, or rhyme, or acoustic elements such as vocal features or sentiment of the sound. Instead, in Romanian language, video-level dynamics, specifically faster cutting speeds and a more rapid overall pace, are strong predictors of a video’s success. The cross-linguistic analysis reveals significant differences. Italian brain rot is textually more negative, exhibits higher perplexity, and uses more rhyme, while its sound is characterized by higher melodic range and loudness. Romanian audio is spectrally brighter with more erratic pitch variations.

[124] LLM-as-a-Judge for Low-Resource Languages: Adapting Ragas and Comparative Ranking for Romanian cs.CLPDF

Claudiu Creanga, Liviu P. Dinu

TL;DR: 研究把Ragas式LLM评审适配到低资源罗马尼亚语RAG，并比较直接打分、成对排序和细粒度分解对不同质量维度的人工一致性。

Details

Motivation: 低资源语言缺少充足参考答案，传统RAG自动评估指标效果有限；LLM-as-a-Judge能否可靠评估罗马尼亚语，以及评审方法是否应按指标区分仍待检验。

Result: 作者构建由母语者标注的行政文档集AdminRo-Eval，并用Gemini 2.5和Gemini 3评估忠实度、答案相关性和上下文相关性。最佳策略因指标而异：Gemini 2.5 Pro的细粒度分解在忠实度上与人工一致率最高为96%，成对比较在答案相关性上达到90%。轻量模型处理复杂低资源语言推理较弱，Gemini 2.5 Pro构成稳健且可迁移的评审基线。

Insight: LLM评审应按目标维度选择方法，不能假设单一打分或比较策略适用于所有RAG指标。该结论基于罗马尼亚语行政文档评测，迁移性仍受语言与文档领域影响。

Abstract: Evaluating Retrieval-Augmented Generation (RAG) systems remains a challenge for Low-Resource Languages (LRLs), where standard reference-based metrics fall short. This paper investigates the viability of the “LLM-as-a-Judge” paradigm for Romanian by adapting the Ragas framework using next-generation models (Gemini 2.5 and Gemini 3). We introduce AdminRo-Eval, a curated dataset of Romanian administrative documents annotated by native speakers, to serve as a ground truth for benchmarking automated evaluators. We compare three evaluation methodologies - direct scoring, comparative ranking, and granular decomposition - across metrics for Faithfulness, Answer Relevance, and Context Relevance. Our findings reveal that evaluation strategies must be metric-specific: granular decomposition achieves the highest human alignment for Faithfulness (96% with Gemini 2.5 Pro), while comparative ranking outperforms in Answer Relevance (90%). Furthermore, we demonstrate that while lightweight models struggle with complex reasoning in LRLs, the Gemini 2.5 Pro architecture establishes a robust, transferable baseline for automated Romanian RAG evaluation.

[125] Can LLMs Reason Over Long Horizons? An Empirical Evaluation of Context Strategies for Longitudinal Clinical Reasoning cs.CL | cs.AI | cs.LGPDF

Taye Akinrele, Noorbakhsh Amiri Golilarz, Subash Neupane, Sudip Mittal, Shahram Rahimi

TL;DR: 研究比较五种患者历史上下文组织策略，发现按事件组织或混合检索通常更利于跨长时间间隔的临床推理，但无依据问题上的弃答仍然困难。

Details

Motivation: 纵向临床推理需从很长病史中找到并整合相关证据；更大的上下文窗口不一定让关键证据更易访问，也不保证推理改善。

Result: 在MedLoCoMo上，研究用四种开源LLM比较完整、近期、事件、语义和混合上下文，衡量正确性、证据距离鲁棒性及对无支持前提的弃答。事件和混合策略总体准确率较强，证据距离变远时近期上下文退化最大，事件和混合策略保持较高准确率。对抗问题显示，答对可回答问题不意味着能对病史不支持的结论正确弃答。

Insight: 长时临床推理的核心不仅是模型可读多少历史，更在于如何筛选和呈现证据。上下文组织提升远距离证据利用，但拒答能力需要独立评估。

Abstract: Longitudinal clinical reasoning requires large language models (LLMs) to identify and integrate relevant evidence distributed across extended patient histories. Although long-context models can process increasingly large amounts of information, providing more history does not necessarily make relevant evidence more accessible or improve reasoning. We compare five context strategies (Full, Recent, Episodic, Semantic, and Hybrid) on MedLoCoMo across four open-weight LLMs, examining answer correctness, robustness to query-evidence distance, and abstention on questions with unsupported premises. Episodic and Hybrid generally achieve the strongest overall accuracy, while Recent Context degrades most as supporting evidence becomes more distant; Episodic and Hybrid maintain the highest accuracy at long distances. Analysis of adversarial questions further shows that strong performance on answerable questions does not necessarily translate to successful abstention when the available history does not support the requested conclusion. These findings show that reliable longitudinal reasoning depends not only on how much history an LLM can access, but critically on how relevant evidence is selected and presented for reasoning.

[126] Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness cs.CL | cs.AIPDF

Pardis Sadat Zahraei, Janvijay Singh, Gokhan Tur, Dilek Hakkani-Tur

TL;DR: 论文识别对齐后训练导致的任务忠实度静默偏离，指出模型可能在不说明的情况下改写涉及不安全或敏感内容的输入。

Details

Motivation: 既有研究常分析能力与对齐、能力与忠实度之间的权衡，而对齐机制本身可能与忠实执行用户输入冲突，且偏离内容未必能从最终回答中显现。

Result: 作者构建FaithConflict及行为和CoT两套分类，区分对齐诱发的不忠实与知识、推理不足造成的偏离。跨模型发现，AIU随规模增加且增长快于能力驱动的不忠实；中间检查点显示后训练会放大问题，DPO阶段差距增长最大且最不易被察觉。仅靠提示缓解无效，揭示能力、对齐和忠实度之间的三难关系。

Insight: 输出更安全或更符合对齐目标，不一定意味着模型忠实执行了任务；静默覆盖输入会造成单独的行为风险。评估应将对齐效果与任务忠实度分开测量。

Abstract: Large language models are characterized by three key properties: capability, alignment, and faithfulness. Prior work studies the tradeoffs between capability and alignment, and between capability and faithfulness, but a third tension remains underexplored: the alignment-faithfulness conflict. We show that aligned models systematically deviate from their inputs on unsafe or sensitive content without disclosing the modification, a failure mode we call alignment-induced unfaithfulness (AIU). Unlike capability-driven unfaithfulness, which comes from errors in knowledge or reasoning, this is induced by post-training mechanisms that override adherence to the input. We introduce FaithConflict, a controlled dataset isolating both conflicts, and two complementary taxonomies: behavioral (B1-B8) and chain-of-thought reasoning (C0-C6). Across models, AIU increases with scale and more sharply than capability-driven unfaithfulness, a reverse scaling law; intermediate checkpoints show it is amplified during post-training, with DPO the stage at which the gap both grows most and becomes least visible. Prompting-based mitigation does not resolve it, revealing a capability-alignment-faithfulness trilemma in the design and evaluation of LLMs.

[127] Mixture of Decoders for Diverse Dialog Response Generation cs.CLPDF

Wenchao Du

TL;DR: 该方法在序列到序列对话模型中加入多个专门化解码器，试图打破回复分布单一化并增加开放域对话回复多样性。

Details

Motivation: 传统序列到序列生成器容易输出低多样性的常见回复，作者假设这是因为模型把条件回复分布学成近似单峰，难以覆盖不同话题或表达方式。

Result: 模型采用条件变分自编码器框架，让混合解码器分别学习专门话题。在开放域聊天语料的量化指标和人工评估中，方法优于强基线；摘要未说明具体指标或增益幅度。

Insight: 将回复生成分解为多个专门化分布，有望缓解单一解码器的模式集中问题。现有摘要提供了基线比较结论，但缺少详细实验信息，无法判断多样性与相关性的具体权衡。

Abstract: Mixture modeling is a long established machine learning technique for learning large sets of multi-modal data. While it is known that sequence-to-sequence models for dialog response generation suffer from the problem of low diversity, we hypothesize that it is because sequence-to-sequence models tend to learn a degenerate uni-modal distribution of responses. We then propose to incorporate a mixture of decoders into sequence-to-sequence models and try to make each decoder learn specialized topics in order to improve the diversity of generated responses. Our model is developed under the framework of conditional variational autoencoder (CVAE). We evaluate our approach on an open domain chat corpus and show improvement over strong baselines in quantitative measures and human evaluation.

[128] Lingtai: What Concept Geometry Reveals–and Does Not Reveal–About LLM Inference cs.CLPDF

Jiangang Chen

TL;DR: Lingtai在生成过程中把残差状态投影到无需标注样本构造的概念锚点，形成免训练逐步遥测，用来观察不确定性及执行轨迹结构。

Details

Motivation: 自回归推理中的在线计算过程难以观察，既有概念探针常依赖标签或拟合。还需避免把概念活动信号误解为正确性坐标或稳定的内部机制。

Result: 在代码生成和小学数学推理中，概念活动与预测不确定性稳健相关，并通过问题、词元位置控制；随机锚点未复现该关联，K-means和PCA信号更弱或方向不一致。轨迹具有局部惯性但跨执行重现性弱：约四分之一完成内容被扰动后仍有62.0%检索到归档轨迹，而新执行仅11.7%—16.0%。研究未发现该概念活动能稳定表示正确性；161锚点代码每词元增加0.7%—1.6%解码开销。

Insight: 无需监督即可观测的概念坐标与不确定性相关，但不等于正确性或可复现的推理步骤。作者明确将正确性视为外部提供，并对遥测信号的解释范围作出限制。

Abstract: Observing what a large language model computes during autoregressive inference–online and without training probes–remains difficult. We introduce Lingtai, a training-free concept telemetry layer: at each generation step, residual states are projected onto a domain-specific bank of named concept anchors, constructed without labeled concept examples, outcome labels, gradient fitting, or activation-space optimization, producing a structured per-step concept-coordinate signal. Across code generation and grade-school mathematical reasoning, this signal exhibits a robust association with predictive uncertainty: the association survives problem-identity and token-position controls and is not attributable to a single token type, is not explained by a simple correct/incorrect mixture on GSM8K, and is not reproduced by matched random anchors; it is markedly weaker or direction-inconsistent in K-means and PCA projections. Two structures emerge: a recurring uncertainty-linked activity signal whose functional geometry is task-conditioned (distinct activity-entropy shapes on HumanEval, MBPP, and GSM8K), and an execution-specific trajectory identity with strong local inertia but weak re-instantiation invariance–under completion-only elastic alignment, corruption at k=32 (approximately a median quarter of the completion) on the matched re-execution subset still retrieves the archived episode at 62.0%, while a fresh execution retrieves it only 11.7-16.0% of the time. Finally, a matched audit finds no evidence that the scalar concept-activity signal used here supplies a stable correctness coordinate under the tested protocol; we therefore treat correctness as externally supplied. Telemetry adds 0.7-1.6% per-token decode overhead for the 161-anchor code implementation, with unchanged generated tokens.

[129] Closing the Loop: Practical Training Recipes for Looped Language Models cs.CL | cs.AIPDF

Andrei Marchenko, Viacheslav Bezrukov, Oleg Kashurin, Inessa Fedorova, Dmitry Bocharov

TL;DR: 论文建立低成本循环语言模型训练配方，使共享层重复计算能在可控预算下提升推理性能，并提供从头训练及将稠密检查点转换为循环模型的方法。

Details

Motivation: 循环模型以复用共享层增加有效深度，但既有大规模配方需万亿级、多阶段训练，且数据和训练设置不同使循环本身的收益难以隔离。

Result: 从头训练预算从Ouro的7.7T降至310B词元。相同参数、数据和词元预算下，1.4B LoopLM在12项基准均优于稠密模型，GSM8K、MATH和DROP分别高14、10和22分；匹配推理计算时，其数学与阅读理解接近3.9B稠密模型，参数仅36%。只用单个输入混合标量和出口损失即可把稠密模型转循环；Looped Qwen在两种数据配方的所有基准上胜过继续训练的稠密基线。

Insight: 控制数据和计算条件后，循环计算本身能带来性能收益，且训练成本不必达到数万亿词元。简单转换配方也降低了在现有预训练模型上试用循环结构的门槛。

Abstract: Looped language models increase effective depth by repeatedly applying a shared block of layers, but existing large-scale recipes require multi-stage training over trillions of tokens, while the benefits of recurrence remain difficult to separate from differences in data and training. In this work, we establish practical training recipes for looped language models, with three main results. (1) We develop a compute-efficient from-scratch pipeline that reduces the training budget from 7.7T tokens in Ouro to 310B tokens while retaining strong reasoning performance. Pretraining followed by high-quality mid-training, together with learning-rate warmup and stronger exit-gate regularization, enables stable recurrent training without prior multi-stage schedules. (2) Under controlled comparisons, our 1.4B LoopLM outperforms a parameter-matched dense model trained on the same data and token budget on all 12 evaluated benchmarks, including +14 points on GSM8K, +10 on MATH, and +22 on DROP. At matched inference compute, it approaches a 3.9B dense model on mathematical reasoning and reading comprehension while using only 36% as many parameters. (3) We introduce a minimal recipe for converting pretrained dense models into looped ones: a single learned input-mixing scalar and a smoothed exit loss, with no step-specific parameters. Applied to Qwen3-1.7B-Base, Looped Qwen improves over an identically continued dense baseline on every evaluated benchmark across two data regimes, with statistically clear gains on GSM8K, MATH, and MMLU-Pro on the curated mixture. Together, these results make looped language models substantially cheaper to train from scratch and practical to introduce into existing pretrained checkpoints, while isolating the gains due to recurrence itself.

[130] Bayesian Fine-tuning Yields Language Models that are as Bayesian as their Beliefs Allow cs.CLPDF

Polina Tsvilodub, Andreas Waldis, Linlu Qiu, Tal Linzen, Michael Franke

TL;DR: 研究比较贝叶斯答案监督与真实答案监督对语言模型隐变量推断的影响，发现贝叶斯微调能安装可用的概率信念并影响后续决策。

Details

Motivation: 标准监督微调在需要从少量观测推断隐藏变量的任务中，通常达不到贝叶斯最优行为；仅比较答案表现无法解释差异来自模型所持信念、信念读取还是决策规则。

Result: 在航班推荐任务上，贝叶斯教师输出微调的模型表现出贝叶斯式选择，中间层编码贝叶斯规则相关量，并在一定程度上用这些信念作推荐。真实答案监督模型在信念内容和将信念转为推荐方面都不同；交换两类模型的信念可转移部分贝叶斯优势。

Insight: 提供推理过程层面的贝叶斯监督，比只提供正确选择更能让模型形成并使用校准信念。结论来自航班推荐任务，信念交换只转移了部分优势。

Abstract: Language models (LMs) are increasingly used for tasks that require reasoning about hidden variables from a few observations, for which Bayesian inference is the normatively correct solution. While supervised fine-tuning of an LM on the outputs of an optimal $\textit{Bayesian}$ model leads to near-Bayesian behavior, standard supervised fine-tuning (SFT) on the true answers for the task falls short of it. But behavior alone does not tell us $\textit{why}$ tuning on a $\textit{Bayesian}$ or an $\textit{oracle}$ (true answers) signal differs: whether the resulting LM represents Bayesian beliefs, acts on them, or turns them into a choice the way Bayes’ rule does. To compare them, we formulate increasingly demanding requirements for an LM to count as a Bayesian decision maker, spanning its behavior, representations, and computations, and test them on a flight recommendation task. The Bayes-trained LM acts Bayesian, encodes quantities of Bayes’ rule in its middle layers, and uses the encoded belief for the recommendation to a certain extent. The oracle-trained LM differs from it both in the beliefs it holds and whether it reads beliefs out into recommendations. Exchanging beliefs between the LMs transfers a part of the Bayesian advantage. Bayes fine-tuning thus installs usable Bayesian beliefs in an LM for reasoning under uncertainty in a way standard SFT on oracle answers cannot, highlighting the advantage of nuanced supervision.

[131] Towards Robust Numerical Claim Verification cs.CLPDF

Peter Røysland Aarnes, Vinay Setty

TL;DR: 研究用数值扰动对抗微调提高LLM声明验证鲁棒性，并发现其决策边界改善可迁移到未见扰动、跨语言及证据侧扰动。

Details

Motivation: LLM可用于核查声明，却对数值微小变化敏感，数值推理的轻微扰动就可能使判定准确率明显下降，前沿模型也存在此脆弱性。

Result: 参数高效微调的小型Qwen3（0.6B至8B）在翻转标签的数值扰动上达到98.7%准确率，超过更大的零样本模型及GPT-5.4 Pro（74.0%）和Gemini 2.5 Flash（73.9%）。收益泛化到未见扰动类型和无目标域数据的西班牙语任务，并迁移至VitaminC数据集的证据侧扰动。

Insight: 对抗训练可教模型形成对数值变化更稳健的验证边界，而不是记住已见修改样式。小模型在特定扰动测试集上超过前沿零样本模型，不能等同于整体声明核验能力全面更强。

Abstract: Large language models (LLMs) are widely used for claim verification, yet remain brittle for numerical reasoning: even small changes in value can sharply degrade accuracy. We show that this brittleness persists in frontier LLMs, but can be mitigated through adversarial fine-tuning on numerically perturbed examples. Using parameter-efficient fine-tuning, small Qwen3 models (0.6B$\unicode{x2013}$8B) reach 98.7% accuracy on label-flipping perturbations, outperforming larger zero-shot models and frontier systems (GPT-5.4 Pro (74.0%) and Gemini 2.5 Flash (73.9%)). The gains generalise to unseen perturbation types, indicating robust numerical decision boundaries rather than memorised edits. Robustness also transfers without target-domain data, significantly improving cross-lingual performance in Spanish. We further show that the same fine-tuning recipe confers robustness to evidence-side perturbations, using the VitaminC dataset.

[132] Reason in Style: Discovering and Controlling Style in Language Models cs.CL | cs.LGPDF

Ioana Marinescu, Eric Karl Oermann, Kyunghyun Cho

TL;DR: 研究从大规模验证推理轨迹中无监督分离内容与风格，发现六种常见回答风格，并训练小模型按指定风格生成以提升数学推理表现。

Details

Motivation: 语言模型同时学习内容和表达风格，使风格难以识别与控制；不同题目可能适合不同推理表达方式，训练数据中风格分布不均还会掩盖其作用。

Result: 方法在受控数学问答上验证内容—风格表示分离，并分析九个教师模型超过10万条验证轨迹，发现六种分布不均的风格。用重要性加权微调学生后，在六个数学推理基准上的Pass@k超过同数据标准微调；指定风格与实际输出对应良好。风格条件会影响正确率，不同题目受益于不同风格。

Insight: 生成风格不仅是表面表达，也可能影响问题求解表现；显式分离和控制风格可增加训练数据的可用多样性。实验集中于数学推理，不能推断相同风格划分适用于其他任务。

Abstract: Language models learn content and style jointly, making stylistic variation in their outputs difficult to identify and control. We study whether recurring styles in model responses can be discovered without supervision and explicitly controlled. We design an algorithm that learns to separate representations of content and style from language models’ outputs and validate its effectiveness on math questions in a controlled setting. By applying this method to over 100K verified traces from nine distinct teacher models, we discover six recurring yet imbalanced styles. We then fine-tune smaller student models to follow these styles when explicitly conditioned on them, using importance weighting to balance the contribution of the styles represented in the corpus. This approach improves Pass@$k$ over standard fine-tuning on the same data across six math reasoning benchmarks, demonstrating that we can diversify the style of answers effectively. We confirm that this also results in strong correspondence between requested and realized styles. We find that style affects correctness: the probability of solving a problem depends on the style we condition on, and different problems benefit from different styles. In summary, our results show that stylistic variation in model-generated data can be discovered in an unsupervised way, and made explicit, providing a source of both control and improved reasoning performance.

[133] Child-Adapted Structured Phonological Representations for Interpretable Speech Sound Analysis cs.CL | eess.ASPDF

Abner Hernandez, Tomás Arias Vergara, Andreas Maier, Paula Andrea Pérez-Toro

TL;DR: 研究将PhonoQ-2.0适配到儿童语音，比较成人与儿童对齐监督对发音特征识别和纵向变化分析的影响。

Details

Motivation: 结构化音系表示比通用语音嵌入更可解释，但现有模型主要用成人语音训练，迁移到儿童发音时的监督方式与临床变化捕捉能力尚不明确。

Result: 在58名典型发育儿童的1,352个辅音目标上，儿童语音适配使清浊识别macro-F1从成人PhonoQ的0.922提高到0.972—0.987。发音方式对对齐监督更敏感：成人加儿童MFA达到0.804和0.796，成人MFA约0.70；发音部位保持0.871—0.902。软腭前移对比在七种模型中均保留，纵向分析也显示个体化变化与临床进展大体一致。

Insight: 儿童语音适配普遍改善清浊识别，但不同音系特征对儿童数据监督的需求不同。模型能保留纵向个体变化，为可解释发音分析提供支持，但结果来自特定语料和典型发育儿童。

Abstract: Structured phonological representations provide an interpretable alternative to generic speech embeddings, but existing models are largely trained on adult speech. We adapt PhonoQ-2.0 to child speech using CHILDES-Aligned data and compare three alignment-supervision conditions (Adult, Adult+Child, and Child-only) across two initialization strategies (Adult PhonoQ and scratch). Generalization is evaluated against manual child-speech annotations. On 1,352 consonant targets from 58 typically developing children, child-speech adaptation improves voicing recognition across all supervision conditions, from 0.922 macro-F1 for Adult PhonoQ to 0.972–0.987 after adaptation. Manner is more sensitive to alignment supervision: Adult+Child MFA reaches 0.804 and 0.796, compared to approximately 0.70 under Adult MFA supervision. Place remains comparatively strong across systems (0.871–0.902), although per-class performance varies substantially. The velar-fronting contrast is preserved across all seven model variants. Longitudinal UltraPhonix analysis further reveals speaker-specific velar and post-alveolar changes that are largely preserved across models and broadly consistent with reported clinical progress.

[134] DeBERTa-ConPara: Attack-Aware and Deployment-Realistic Detection of AI-Generated Text cs.CL | cs.CRPDF

Mohamed Mady, Yupei Li, Johannes Reschke, Björn W. Schuller

TL;DR: DeBERTa-ConPara通过推理时Unicode规范化防御字符级对抗攻击，并发现把相同规范化放到训练端反而会删除重要攻击监督。

Details

Motivation: AI文本检测在跨领域、跨生成器和对抗扰动下会退化，部署时又缺乏目标域标签来校准阈值；简单文本清洗对训练和推理的作用可能不同。

Result: 研究在HC3 Plus、M4、MAGE和RAID训练评估。规范化训练数据会使RAID中35.4%样本与干净副本重复，删除对抗监督；最佳配置是原始训练、推理规范化，在RAID隐藏测试达到99.61% AUROC、5% FPR下TPR 99.01%、1% FPR下TPR 96.57%，另在HC3 Plus与MAGE固定阈值平均平衡准确率93.14%。收益集中于同形字和零宽空格攻击；语义不变增强无改善，手工特征融合分布外有害。

Insight: 预处理位置决定它是去除攻击还是抹掉训练信号，训练清洗与推理防御不能互换。高总体性能主要来自两类字符攻击的显著修复，其他十类攻击并未同样受益。

Abstract: Robust detection of AI-generated text under deployment conditions is challenging: distribution shifts across domains and generators, adversarial perturbations of the input surface, and the absence of target-domain labels for threshold calibration all degrade detectors that perform well in-domain. We present DeBERTa-ConPara, a deployment-oriented detector combining attack-aware Unicode preprocessing with a contextual transformer encoder trained over HC3 Plus, M4, MAGE and RAID. Our central finding is that preprocessing acts in opposite directions depending on where it is applied: normalising the training corpus deduplicates it, collapsing 35.4% of RAID rows into copies of their clean siblings and deleting the adversarial supervision, whereas normalising at inference is an effective defence. A factorial varying the two placements independently identifies raw training with normalised inference as the best configuration, reaching 99.61% AUROC, 99.01% TPR@5% FPR and 96.57% TPR@1% FPR on the official RAID hidden test, alongside 93.14% average balanced accuracy across HC3 Plus and MAGE under a fixed threshold. The gain is confined to two of twelve attack classes: homoglyph and zero-width-space insertion rise from 11.05% and 1.12% to 96.98%. The same signature reproduces in a zero-shot detector of different architecture, showing the effect belongs to the attacks rather than to our model. We additionally report two negative results: semantic-invariance augmentation through paraphrasing and supervised contrastive learning (ConPara) does not improve the best configuration, and the handcrafted feature-fusion branch is inert in distribution and harmful outside it.

[135] The Geometry of Contextual Relations: Language Models Address Facts by Order of Mention cs.CL | cs.AIPDF

Yufa Zhou

TL;DR: 论文提出序位寻址假说，认为语言模型回答上下文事实时主要按事实被提及的顺序定位，而非直接按问题中的实体名称寻址。

Details

Motivation: 人类推理依赖命题内关系，但语言模型如何在上下文中组织事实并将问题映射到相关内容仍不清楚。

Result: 研究测量模型在问题从询问一个事实切换到另一个事实时隐藏状态的变化，并发现序位向量对应事实提及顺序。跨Qwen、Gemma和Llama，事实地址按提及序列组织且可被向量干预：将向量加到关于首条事实的问题会令模型回答第二条事实。地址落在低秩子空间，在1.5B至32B模型间共享，并在预训练早期形成。

Insight: 模型状态可能先编码上下文事实的序位地址，再由上下文内容填充具体事实，而非直接根据实体名定位。向量干预和跨模型一致性支持该机制假说，但其适用范围主要是本文的事实列表任务。

Abstract: Human reasoning depends on how objects are related within propositions. \textit{How do relations organize the language representations of contextual contents?} We give an LLM a list of facts in its context (e.g., \emph{Alice eats an apple. Bob eats a pear.}) and measure how its hidden state changes when the question switches from what Alice eats to what Bob eats. Averaged over many lists, this change is a steering vector, which we call the \emph{ordinal vector}. It points to a fact by its \emph{order of mention}, the order in which the facts were stated in the context. We find that LLMs represent the fact a question asks about by its order of mention, not by the name the question contains. We state this as the \textit{ordinal addressing hypothesis}: each order of mention has a \emph{fact address} in the model’s state, shared by all contexts, and a question moves the state to the fact address of the fact it asks about, while the context supplies what that fact says. Across Qwen, Gemma, and Llama, fact addresses are (1) \emph{ordered by mention}: query states are organized by the order of facts, not of names, even when one fact has multiple subjects; (2) \emph{steerable}: added to a question about the first fact of a new list, the ordinal vector makes the model answer with the second fact of that list; (3) \emph{low-rank}: they span a low-rank subspace in which the first-mentioned fact is the easiest to reach, surprisingly similar to human recall; and (4) \emph{emergent}: they are shared in late-middle layers, hold from 1.5B to 32B parameters, and form early in pretraining. Language models reach a stated fact by where it was mentioned, deepening our understanding of LLM reasoning.

[136] ReHoPER: Receding-Horizon Planning for Enhanced Reasoning cs.CL | cs.AI | cs.LGPDF

Saeed Ahmadnia, Cornelia Caragea

TL;DR: ReHoPER在不训练模型的条件下反复规划并回答多个中间问题，逐步更新推理历史后再给出最终答案。

Details

Motivation: 复杂组合推理可能超出一次直接回答能力，现有方法常依赖标注数据或特定任务提示，难以跨任务复用。

Result: 方法在多条路径上生成候选中间问题、选择并作答，再根据更新后的历史重规划，所有数据集和模型使用同一通用指令。在多个数据集及新构建的受控组合推理iLLC基准上，ReHoPER优于强基线，组合程度最高的设置收益最大。

Insight: 把难题转换为逐步提出和回答子问题，可在推理时扩展计算而无需修改模型参数或训练专用策略。收益集中在更强组合性的设置，摘要未提供各基准的具体分数。

Abstract: We propose ReHoPER, an inference-only, zero-shot method that improves large language models’ reasoning by generating and answering intermediate questions along multiple paths before the final answer. It iteratively plans a horizon of candidate intermediate questions, selects one to answer, and replans from the updated history. ReHoPER is task-agnostic, using the same generic instructions across datasets and models without labeled data or task-specific prompt design. Across multiple datasets, including iLLC, a new controlled benchmark for compositional reasoning, ReHoPER outperforms strong baselines, with the largest gains in the most compositional settings. Our implementation and the iLLC generator are publicly available to support future work.

[137] LawCompass: Navigating from Legal QA to Multi-Agent Deep Research with Grounded Evidence cs.CLPDF

Xiaoxia Cheng, Linnan Wang, Jiahao Ma, Zhichuan Ye, Xuemei Zhou

TL;DR: LawCompass把法律助手从多轮问答扩展到证据驱动的多代理深度研究，提供法律问答、法规案例检索和综合研究报告三类功能。

Details

Motivation: 现有法律助手多局限于对话式问答，难以系统检索证据、处理多步骤推理并综合成报告，用户也需要能够回到原始法律来源核验回答。

Result: 系统通过查询改写探索法规和判例，支持证据引用问答，并由多代理工作流分解复杂法律研究任务、生成综合报告；各模块保留明确引用链接。评估显示其能作为实用、可扩展且有证据依据的法律研究辅助范式，但摘要未给出具体指标。

Insight: 将结构化检索和多步研究加入法律问答流程，可扩展任务范围；贯穿模块的引用链接有助于人工核验。当前摘要只有总体评估结论，无法量化准确率或法律专家认可度。

Abstract: Recent advances in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) have significantly democratized access to legal information. Nevertheless, most existing legal assistants remain confined to multi-turn conversational QA, failing to support complex legal tasks that require systematic evidence retrieval, multi-step reasoning, and report-level synthesis. In this paper, we present LawCompass, an evidence-grounded legal assistant that navigates the transition from standard Legal QA to multi-agent deep research. LawCompass provides three task-oriented functions: Legal QA, which delivers precise, evidence-backed answers to legal questions; Professional Retrieval, which enables structured exploration of statutes and judicial cases via query rewriting; and Deep Research, which employs a multi-agent workflow to decompose complex legal tasks and synthesize comprehensive research reports. Crucially, LawCompass maintains explicit citation links across all modules, empowering users to directly verify system outputs against original legal sources. Evaluation results demonstrate that LawCompass provides a practical and scalable paradigm for transforming conversational AI into trustworthy and evidence-grounded legal research assistance.

[138] Sentence Specificity Scores for Collaborative Technical Documentation: A Domain-Transfer Study cs.CL | cs.LGPDF

Rocker D’Antonio, Thomas Benton Townsend, Dimitrios Michael Manias

TL;DR: 研究审计技术文档句子具体性评分器的跨域稳定性，并测试评分能否从固定LLM改写候选中选出信息更具体的版本。

Details

Motivation: 技术文档需要准确记录协作上下文，但通用具体性评分器与目标领域适配评分器可能排序不同；分数相关性也不代表在真实候选选择中有用。

Result: 在维基百科和三个技术文档语料上，两种评分器产生不同语料排序，同句排序相关范围为-0.066至0.510，严格过滤和长度校正仍未消除差异。Gemma候选集上SpeciTeller使方向有效选择率从71.7%升至83.3%，提升区间为+1.7至+21.7点；GPT-OSS-120B从51.7%升至56.7%，区间-6.7至+16.7点且包含零。

Insight: 具体性分数的解释和实际决策价值依赖评分器与候选集合，跨域排序相关不足以保证有用。GPT-OSS结果的不确定区间也表明不能把小幅点估计提升当成稳定收益。

Abstract: Collaboration depends on shared context, and technical documentation is one way that context persists across people and AI teammates. Specificity, the amount and exactness of detail expressed in language, shapes what information documentation captures and how precisely that information is communicated. This work audits sentence-specificity scoring artifacts on technical documentation and tests whether scores applied only after generation help choose among fixed LLM-generated revisions. Across Wikipedia and three technical-documentation corpora, the fixed general-domain predictor SpeciTeller and the pinned post-publication author-repository implementation of Ko et al.’s target-adapted predictor produce different corpus orders and same-sentence rank agreement from -0.066 to 0.510. Strict filtering and token-length adjustment change these patterns without reconciling them. In the Gemma set, SpeciTeller ranking raises direction-valid selection from 71.7% to 83.3% (+11.7 points; 95% source-case bootstrap interval +1.7 to +21.7); in the GPT-OSS-120B set, SpeciTeller ranking raises direction-valid selection from 51.7% to 56.7% (+5.0 points; 95% source-case bootstrap interval -6.7 to +16.7), and every primary single-score GPT-OSS-120B interval includes zero. These findings tie score interpretation and decision value to the predictor and candidate set.

[139] Capturing In-Context Learning Dynamics with Task Operators cs.CL | cs.AI | cs.LGPDF

Guangzhi Xiong, Zhenghao He, Bohan Liu, Sanchit Sinha, Wenqian Ye

TL;DR: Task Operator从任务示例引起的注意力变换中提取稳定算子，并通过解析更新注意力输出投影来复用上下文学习效果。

Details

Motivation: 上下文学习无需更新权重，却每次都要重新处理全部示例；固定激活向量压缩方法与输入无关，难以应对依赖输入细节的复杂任务。

Result: 作者发现给定任务的各注意力头，其上下文屏蔽输出到原输出的仿射变换参数在样本间经验稳定。Task Operator据此将变换转成注意力输出投影的解析更新，在词汇、算法和推理任务上总体优于既有方法并缩小零样本与ICL差距。任务知识集中在跨层和位置的稀疏回路；分批演示提取的算子可平均后扩展many-shot而不增加上下文长度。

Insight: ICL影响可表现为任务特定、可复用的注意力变换，而非只能存成固定位置激活。算子平均支持压缩示例信息，但其稳定性和收益依赖任务及演示分布。

Abstract: In-context learning (ICL) enables language models to perform new tasks from demonstrations without weight updates. However, every ICL inference requires processing the full set of examples, resulting in inefficient deployments, and how ICL works mechanistically is not fully understood. Prior work compresses ICL into fixed activation vectors extracted from specific layers or positions, but these input-independent interventions fail on complex tasks where the output depends on fine-grained interactions with the input. By analyzing the ICL forward pass, we show that each attention head’s output is an affine transformation of its context-masked counterpart, and that the parameters of this transformation are empirically stable across samples for a given task. Building on this, we introduce Task Operator (TO), which replays this transformation as an analytically derived update to the attention output projection. Across lexical, algorithmic, and reasoning tasks, TO achieves the best overall performance among prior methods and substantially narrows the gap between zero-shot inference and ICL. We further show that the extracted knowledge concentrates in a task-specific sparse circuit across layers and positions, and that averaging operators from disjoint demonstration batches enables effective many-shot scaling without expanding the context window. Our code is available at https://github.com/gzxiong/task_operator.

[140] Probe with Participation Trophies: Random-Reward RL as a Probe of LLM Capability cs.CLPDF

Yu Mao, Lei Yu, Zining Zhu, Yusheng Zheng, Haohang Li

TL;DR: 论文把随机奖励强化学习视为探测LLM在给定训练约束下可达能力的工具，而非只把它看作伪奖励带来的性能改善或数据污染。

Details

Motivation: 随机奖励有时也能提高LLM表现，引发收益来自RL机制还是训练数据污染的长期争论；探针表现是否反映模型原有能力，也受到标签泄漏质疑。

Result: 两个合成算术准确率同为3.5%的OLMo检查点，在相同正确性奖励RL下最佳表现分别达到8.5%和55%。跨预训练与中训练检查点呈现三种响应阶段：早期即使正确奖励也难提升，后期正确奖励有效而随机奖励弱，中训练阶段随机奖励也能带来较大增益；数字遮挡SFT呈现相近顺序。

Insight: 随机奖励不提供答案正确性信息，却能揭示模型状态在给定约束下可通过训练达到什么表现，有助于区分当前性能与可达能力。观察到的阶段规律不局限于单一RL机制，但依赖所测OLMo检查点。

Abstract: We connect the spurious-reward paradox to a model’s reachability and propose random-reward reinforcement learning (RL) as a useful tool for the probing enterprise, addressing a decade-long debate over what probing performance actually reveals about a model. There are two prevailing explanations for the surprising finding that even random rewards can improve the performance of large language models (LLMs): one attributes the gains to particular mechanisms within RL training; the other to data contamination. Our results motivate a different view: spurious-reward RL can probe a model’s reachability, or what further training can attain from its current state under specified constraints, beyond what is reflected in its current performance. Two OLMo checkpoints with the same accuracy on synthetic arithmetic (3.5%), for example, reach 8.5% and 55% in their best runs under the same correctness-rewarded RL. Examining OLMo checkpoints across pre-training and mid-training reveals three distinct regimes of training response: early on, RL produces little improvement even when correct answers are rewarded; later in pre-training, rewarding correct answers becomes effective while random rewards remain weak; and, upon entering mid-training, even random rewards can produce large gains. A similar ordering appears in a number-masked supervised fine-tuning (SFT) analysis of these checkpoints, suggesting that the pattern is not specific to a particular RL mechanism. Moreover, RL with random rewards offers a distinctive perspective on what training can make an LLM do, since its reward signal supplies no information about which answers are correct. By asking what training can attain without correctness feedback, it addresses the label-leakage side of a central problem in decodability-based probing: whether a successful probe reveals the model’s capabilities or learns the task itself.

[141] My FAULT: Self-Diagnosis as Credit Assignment in Self-Evolving Agentic Reinforcement Learning cs.CLPDF

Yihua Zhu, Qianying Liu, Weixu Qiao, Xuan Ren, Weiwei Xu

TL;DR: FAULT把代理自诊断发现的错误转成与终局奖励锚定的逐步信用，并在线学习各类错误代价以改善长程强化学习。

Details

Motivation: 只用终局奖励时，同结果轨迹组没有学习信号，且整条轨迹反馈难定位失败决策；自然语言自我反思虽细粒度，却可能诊断错误且无法量化各错误的重要性。

Result: FAULT检查诊断证据并从任务结果学习相对错误成本，训练中策略与诊断器共同进化。在ALFWorld中，同结果轨迹组的信号覆盖率达95%，高于GRPO的41%和GiGPO的72%，并能更准确定位具体错误步骤；在两种模型规模的长程ALFWorld和WebShop任务上表现提升，同时短程搜索问答保持竞争力。

Insight: 反思只有在错误证据可核验、影响大小能由结果校准时，才能转成可靠信用分配。FAULT保留终局结果作为锚点，避免把未经验证的诊断文本直接当奖励。

Abstract: Agentic reinforcement learning (RL) has emerged as a powerful approach for training large language model agents on multi-step tasks, yet reliance on terminal outcome rewards creates two credit-assignment problems, particularly in long-horizon tasks. First, same-outcome rollout groups provide no learning signal from terminal rewards. Second, terminal rewards provide only trajectory-wide feedback, making it difficult to identify which decisions caused a failure. Recent work supplements terminal rewards with finer-grained information from trajectory analysis, such as natural-language reflections on intermediate decisions and errors. However, natural-language diagnoses are difficult to use directly for credit assignment: their error claims may be unreliable, and they do not quantify how much each error should affect learning. We propose Self-Diagnosis-guided Terminal Credit Redistribution (FAULT), which turns diagnosed errors into explicit step-level credit anchored by terminal outcomes. FAULT checks diagnostic evidence and learns relative error costs from task outcomes. During training, the policy and self-diagnoser co-evolve, while error costs are updated online from recent outcomes. On ALFWorld, FAULT recovers learning signals from same-outcome groups, reaching 95% signal coverage versus 41% for GRPO and 72% for GiGPO, while better localizing credit to specific error steps. Across two model scales, FAULT delivers strong. improvements on the long-horizon ALFWorld and WebShop tasks while remaining competitive on short-horizon Search-based QA.

[142] Temporally-Resolved Token Attribution Reveals the Generation Dynamics of Diffusion Language Models cs.CL | cs.AI | cs.LGPDF

Darpan Aswal, Céline Hudelot

TL;DR: DLIG把积分梯度扩展到扩散语言模型任意层和去噪步骤，归因模型沿整个生成轨迹逐步确定固定或自生成文本的过程。

Details

Motivation: 扩散语言模型在多次去噪中逐步承诺词元，传统归因方法难同时追踪不同网络层和生成阶段的输入贡献，也需要轻量工具先检验机制假设。

Result: DLIG建立了与积分梯度完备性、实现不变性、线性和对称性保持等公理的直接对应，作为干预分析的低成本补充。在词义消歧、多跳图推理和句子补全任务中，它展示模型如何跨输入位置、层和去噪步骤利用信息；摘要未给出量化归因准确率。

Insight: 沿扩散轨迹而非只看最终文本做归因，可分析输入证据何时、在哪一层影响词元承诺。DLIG适合作为机制假设的初步检查，不能替代因果干预。

Abstract: This work presents Diffusion Layer Integrated Gradients (DLIG), a token attribution method for diffusion language models (DLMs) that extends Integrated Gradients (IG~\cite{sundararajan2017axiomatic}) to arbitrary layers and denoising steps. DLIG attributes a DLM’s progressive commitment to a self-generated or fixed completion for an input prompt. We establish direct correspondences between DLIG and the IG axioms of completeness, implementation invariance, linearity, and symmetry preservation. As a lightweight complement to interventional analysis, DLIG provides an inexpensive first check of mechanistic hypotheses across the denoising trajectory. We demonstrate this on word-sense disambiguation, multi-hop graph reasoning, and sentence infilling, revealing how DLMs draw on inputs across positions, layers, and denoising steps.

[143] ASCRIBE: Atomic and Significance-Based Reasoning for Thai Clinical SOAP Note Generation cs.CLPDF

Tarm Kalavantavanich, Teerawut Ponarchar, Pattaramanee Arsomngern, Jenta Wonglertsakul, Watcharakorn Chuthong

TL;DR: ASCRIBE在临床对话摘要前为原子事实标注临床重要性，再筛选并生成泰语SOAP病历，以减少关键遗漏和无依据内容。

Details

Motivation: 自动SOAP记录可减轻医生文书负担，但常见推理容易漏掉重要事实或生成无支持内容；泰语研究还缺乏公开临床总结数据集。

Result: 作者发布去标识的真实就诊基准ThaiClinicBench及由真实病历派生的合成训练语料。作为提示时，ASCRIBE在GPT-5.4和Gemini 3.1 Pro上优于CoT，在医生对齐评审指标上表现更好，完整性最高提升10.3分。作为GRPO奖励时，仅用合成数据训练的Gemma-4-E4B在事实精确度上匹配Gemini 3.1 Pro，完整性更高。

Insight: 先判断事实临床重要性再摘要，可把医生记录习惯显式编码进推理过程。合成数据配合结构化奖励表现突出，但真实部署仍需验证临床安全性和医生审核流程。

Abstract: Automatic SOAP note generation can ease the documentation burden on physicians, but existing reasoning methods often omit clinically important information and generate unsupported content. Progress in Thai is further hindered by the lack of publicly available datasets. We propose ASCRIBE, a physician-inspired reasoning framework that ascribes a clinical-significance level to each extracted atomic fact in the conversation before summarization, making a general-purpose LLM a more reliable scribe. We also release ThaiClinicBench, the first de-identified Thai clinical summarization benchmark of real encounters, together with a synthetic training corpus derived from real clinical notes. As a prompt, ASCRIBE outperforms chain-of-thought prompting on GPT-5.4 and Gemini 3.1 Pro across the physician-aligned LLM-judge metrics and improves on standard prompting by up to 10.3 points on the completeness LLM-judge metric. As a GRPO reward, it enables a Gemma-4-E4B model trained solely on synthetic data to match Gemini 3.1 Pro in factual precision and surpass it in completeness. Code and data can be found at https://github.com/loolootech/ascribe.

[144] Harness Annealing: Learning to Act with Less External Control cs.CLPDF

Yingxuan Yang, Huacan Chai, Ying Wen

TL;DR: HAT通过显式控制决策监督和逐渐减弱外部代理框架的教师轨迹，训练语言代理逐步接管调查、修订和停止等控制职责。

Details

Motivation: 代理训练常依赖外部框架管理状态、组织流程并决定何时调查或停止；即使模型学会完成任务，成功轨迹训练也可能让这些控制能力继续依赖运行时干预。

Result: 在SWE-QA和SWE-QA-Pro上用9B与35B模型、四种部署框架评估各训练检查点。经过选择的退火检查点只使用工具时，得分接近各自初始检查点配备完整框架的表现；收益随模型规模和部署配置变化，继续退火也不总有益。

Insight: 逐步撤除脚手架可将外部控制决策内化到模型，但应按部署场景选停止点，不能假设训练越久、外部支持越少越好。结果表明部分框架职责可移交，同时性能受规模和配置影响。

Abstract: Language agents rely on external harnesses to track state, organize workflows, and verify answers. Beyond providing tools and information, these harnesses supply control decisions about what to investigate, whether to revise, and when to stop. Training on successful harness-supported trajectories can improve task performance while leaving these decisions dependent on runtime intervention. We ask whether harness-supported experience can also teach the model to make these decisions, allowing the division of control to change as the model learns. We call this objective harness internalization: learning to assume specified control responsibilities while retaining task performance after the corresponding support is withdrawn. We introduce HARNESS ANNEALING TRAINING (HAT), which combines explicit control supervision with a curriculum over teacher trajectories collected under progressively weaker harnesses. Experiments with 9B and 35B models on SWE-QA and SWE-QA-Pro evaluate every checkpoint under four deployment harnesses. Selected annealed checkpoints operating with tools alone achieve scores close to those of their respective starting checkpoints deployed with the full harness. The benefits vary with model scale and deployment configuration, and further annealing does not uniformly improve performance. These findings suggest that harness-supported experience can help reduce the runtime control required by a trained agent.

[145] Right Answers, Wrong States: Hidden Information Failures in Multi-Agent Collaboration cs.CLPDF

Herun Wan, Jiaying Wu, Minnan Luo, Zihan Ma, Fanxiao Li

TL;DR: OffQuery把多智能体协作中的证据核验、共享状态重建和任务解决分开评测，并提出ReGround先修复共享事实状态再进行推理。

Details

Motivation: 协作系统即使即时答案正确，也可能留下被污染的共享信息，影响后续任务；只看答案正确率会忽视这种“离查询”失败。

Result: 在医疗和灾害响应两个高风险场景、21组模型—设置组合中，任务解决率为64.7%，证据核验仅14.3%，共享状态重建为43.1%。ReGround融合冲突证据、核验事实并重建可信状态，在三类能力和所有评估设置上均改善；七个模型的平均相对增益依次为309.0%、82.9%和17.6%。

Insight: 可靠协作既要得出正确当前答案，也要维护供未来使用的可信共享状态。当前查询可能绕开错误事实，使问题延迟暴露，因此状态核验应成为独立评测环节。

Abstract: Multi-agent systems are often judged by whether they reach the correct answer. This can miss a distinct failure: collaboration may leave behind a corrupted information state even when the immediate decision is correct. We call this an off-query failure. To study this failure in collaborative decision support, we introduce OffQuery, which separately evaluates evidence verification (T1), shared-state reconstruction (T2), and task resolution (T3) in two representative high-stakes settings: healthcare and disaster response. Across GPT, Gemini, and Qwen models, standard collaboration shows much stronger task performance than state reliability. Averaged over 21 model–setting combinations, task resolution reaches 64.7%, while evidence verification and state reconstruction reach only 14.3% and 43.1%. We trace this gap to selective information use: current queries often bypass corrupted facts, which become consequential when later tasks require them. We further introduce ReGround, which resolves conflicting evidence, verifies shared facts, reconstructs a trusted state, and reasons over that state. Across seven models from three families, ReGround improves all three capabilities in every evaluated setting, with average relative gains of 309.0%, 82.9%, and 17.6% on T1, T2, and T3. Reliable collaboration therefore requires both a correct decision and a reliable shared state for future reasoning.

[146] Know When to Hold ‘em: Correct-Token Retention in Uniform-State Diffusion Language Models cs.CLPDF

Mojtaba Nafez, James Henderson

TL;DR: CTR-Reg在均匀状态扩散语言模型训练中加入正确词元保留损失，使模型修正错误词元时避免无必要地改写已正确位置。

Details

Motivation: 均匀状态扩散允许每步修改任意词元，既能纠错也需保留正确内容；现有模型会在每步改写大量位置，训练目标几乎不奖励对未扰动词元的保留。

Result: 三个最先进模型在贪心尾部解码中每步仍修改512位置中的173至270处，导致无协调编辑和多样性坍塌。CTR-Reg无需改采样器，使六基准干净词元准确率平均提升26.5个百分点，受扰词元准确率基本不变，每步修改收敛到3至11处。仅五步贪心解码时，三种模型的生成困惑度均减少一半以上且保持多样性。

Insight: 自我纠错不只是识别并修改错误，还要学会保持未受扰且正确的状态。原训练目标对保留监督不足，轻量辅助损失即可改变编辑行为并改善少步生成。

Abstract: Uniform-state diffusion models (USDMs) can revise any token at any denoising step, which lets them correct their own mistakes, a key advantage over masked diffusion. Self-correction, however, requires both revising incorrect tokens and retaining correct ones, and we show that current USDMs lack the latter. Even under greedy-tail decoding, state-of-the-art USDMs (DUO, UDLM, and uniform-noise SEDD) keep revising 173–270 of 512 positions at every step, and these large, uncoordinated edits collapse sample diversity. A random-token corruption experiment traces this deficit to the models themselves: they reconstruct clean and corrupted tokens with nearly identical accuracy, even though clean tokens are easier targets. A decomposition of the validation NELBO shows that training barely rewards retention: incorrect predictions are heavily penalized at corrupted positions but almost free at clean ones. We propose Correct-Token Retention Regularization (CTR-Reg), a simple but effective auxiliary loss that trains the model to retain tokens left unperturbed by the forward process and requires no change to the sampler. CTR-Reg improves clean-token accuracy by 26.5 percentage points on average across six benchmarks, while leaving corrupted-token accuracy virtually unchanged, and its per-step revisions converge to only 3–11 positions. With just five greedy-tail steps, generative perplexity more than halves under CTR-Reg for all three models while diversity is preserved, and these gains hold across sampling budgets. Our results identify correct-token retention as a key missing ingredient for self-correcting diffusion language models, and demonstrate an effective fix.

[147] ARCCS: An Automated Regulatory Compliance Checking System cs.CLPDF

Giorgos Filandrianos, José Menezes, Chrysoula Zerva, Alessandro Gianola

TL;DR: ARCCS把法规拆解为可追溯的原子义务，再检索目标文件中的证据并逐条判定合规，生成置信度和可解释理由。

Details

Motivation: 法规合规检查需理解复杂法律文本、确定适用条款并以明确证据支持判断；人工审查难扩展，固定模板也难适应不同法规结构。

Result: 系统解耦法规模板和预设规则，支持不同规模与结构。在GDPR政策文档评估中，LLM评审认为判定和理由最高96.67%符合法律及证据要求；在超过1,200项欧盟公共采购规则核查中，违规检测准确率98.8%。作者称其为首个完全开源的端到端合规检查和可审计报告系统。

Insight: 把法规义务拆成可追溯原子项并与检索证据绑定，可提高审查透明度和法规无关性。两项场景结果表现较高，但GDPR数字来自LLM评审判断，公共采购则是另一独立基准。

Abstract: Regulatory compliance checking - deciding whether a target document satisfies the obligations of a regulation - requires interpreting dense legal text, identifying which provisions apply, and grounding each decision in explicit evidence. We present ARCCS, an end-to-end, automated, agentic, and regulation-agnostic Legal NLP system for compliance checking. ARCCS decomposes raw regulatory text into atomic, traceable requirements and evaluates a target document against them using retrieved evidence, confidence scores, and human-interpretable justifications. This design decouples compliance assessment from any fixed regulatory template or predefined rule set, enabling the pipeline to operate over regulations of varying size and structure. We evaluate ARCCS in two complementary settings. First, in a GDPR policy-document evaluation, LLM-based judges find its decisions and justifications legally and evidentially consistent in up to 96.67% of the assessed cases. Second, on an EU public-procurement benchmark comprising more than 1,200 individual rule checks, the system attains 98.8% accuracy in violation detection. ARCCS is, to our knowledge, the first fully open-source system for end-to-end regulatory compliance checking and auditable report generation.

[148] LLM-Assisted Discovery of Typed Semantic Links for Ontology Network Construction cs.CL | cs.AIPDF

Nouha Hayouni, Sheeba Samuel, Alsayed Algergawy

TL;DR: 该框架先用嵌入和聚类筛选本体概念候选，再让LLM生成有类型、有理由的关系，以构建领域内和跨领域本体网络。

Details

Motivation: 异构学科知识互操作依赖带类型且有依据的本体语义链接，人工标注难扩展，而单纯嵌入相似度可能无法辨别概念间关系是否有效。

Result: 在包含33个本体的ReproduceMeON上，流程将约80万概念对筛至9.5万候选。两名独立标注者验证429条关系，总精确率80.19%，高置信样本91.49%，F1为0.890；高于五种相似度基线中最佳的0.581。消融显示，在过滤后候选上相似度方法单独使用AUC约0.5，难以区分有效与无效关系。

Insight: 相似度适合缩小检索空间，但关系生成还需理解概念角色和领域语义，LLM推理承担了关键判别。高置信关系精度更高，但专家验证规模为429条。

Abstract: Constructing typed, justified semantic links between ontologies is essential for enabling interoperability across heterogeneous and interdisciplinary knowledge domains. However, manually curating such links is difficult to scale. To address this challenge, we propose an end-to-end framework for ontology network construction that automates the discovery and generation of both intra-domain and inter-domain relationships. Our approach combines domain-adapted DistilBERT embeddings for dense contextual representation, clustering-based pre-filtering to reduce the candidate search space, and GPT-4o-driven relationship generation via iterative prompt engineering to produce semantically rich, interpretable links. Applied to ReproduceMeON - a network of 33 ontologies spanning machine learning, microscopy, computational science, and experimental workflow - the pipeline reduces approximately 800k raw concept pairs to 95k high-quality candidates. Human expert validation of 429 generated relationships by two independent annotators yields an overall precision of 80.19% (91.49% on high-certainty annotations) and an F1 of 0.890, with substantial inter-annotator agreement. Comparative experiments against five similarity-based baselines, including Sentence-BERT, show a substantial performance gap (best baseline F1 = 0.581), while an ablation study demonstrates that similarity-based methods alone fail to discriminate valid from invalid relationships (AUC approx 0.5) on the filtered candidate set. These findings highlight the necessity of LLM-based reasoning over concept roles and domain semantics for accurate relationship construction.

[149] GAW-PO: Preference Optimization with Gradient-Aligned Token Weights cs.CLPDF

Andreea Dutulescu, Stefan Ruseti, Mihai Masala, Traian Rebedea, Mihai Dascalu

TL;DR: GAW-PO按拒绝回复词元梯度与偏好更新方向的对齐程度调整DPO负向权重，减轻惩罚那些也有助于偏好行为的词元。

Details

Motivation: 偏好优化通常对整条拒绝回复提供负向信号，但自回归模型逐词元训练，其中一些词元可能同样表达偏好回复所需行为，统一惩罚会产生信用分配冲突。

Result: GAW-PO估计每个拒绝词元对偏好更新方向的影响，强对齐词元减弱惩罚、冲突词元保留较强惩罚。在涵盖数学、推理、代码和问答的11个基准上，平均表现比DPO高0.97分，比最强竞争方法高0.65分；降低DPO正则系数β时，标准DPO性能明显下降，GAW-PO仍继续改善。

Insight: 拒绝样本不应被整体视为有害，词元级更新可能与偏好方向一致或冲突。梯度对齐加权改善了强偏好优化下的稳健性，但收益依赖偏好数据和训练设定。

Abstract: Most preference optimization methods, such as Direct Preference Optimization (DPO), apply preference supervision at the response level, although autoregressive language models are optimized token by token. As a result, all tokens in a rejected response contribute to the negative training signal, including tokens that may encode behavior that is useful for the preferred response. We introduce GAW-PO, a gradient-aligned token reweighting method for DPO that estimates, for each rejected token, whether penalizing it would interfere with the preferred update directions. Tokens whose gradients are strongly aligned with the preferred behavior receive a weaker negative contribution, while conflicting tokens retain a stronger penalty. Our method achieves the highest average performance among the evaluated preference-optimization methods, improving by 0.97 points over standard DPO and 0.65 points over the strongest competing baseline across 11 benchmarks spanning mathematics, reasoning, coding, and question answering. We further show that gradient-aligned weighting is substantially more robust to aggressive preference optimization: as the DPO regularization parameter $β$ decreases, standard DPO degrades sharply, whereas GAW-PO continues to improve. These results suggest that accounting for the interaction between rejected-token updates and preferred behavior provides an effective form of token-level credit assignment for preference optimization.

[150] AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models cs.CL | cs.LG | cs.SDPDF

Yuxiang Wang, Kunyu Feng, Yuancheng Wang, Zihang Liu, Shengbo Cai

TL;DR: AURAL在潜空间建模多种可能的语音推理续接，并联合预测未来状态块以减少串行计算，同时按问题难度自适应安排推理长度。

Details

Motivation: 显式CoT可改善语音理解却增加首响应延迟，细粒度声学描述会让理由更长；潜在推理可降低开销，但现有方法常受单路径监督和固定预算限制。

Result: 作者构建AuralReason-683K，含约1,000小时、68.3万条双语语音及情绪识别、共情对话和一般推理简明CoT。AURAL-RL在两种骨干上达到接近CoT-RL的表现，并在多数指标上超过各自监督检查点，难题会诱发更多潜在推理步。Qwen2.5-Omni首词延迟从1.22秒降至0.10秒，提速11.8倍；直接回答为0.05秒。

Insight: 潜空间多路径推理和块预测可在保留大部分显式CoT效果时降低语音交互延迟。它仍慢于直接回答，但让模型根据任务难度分配潜在计算。

Abstract: Model intelligence and fast response jointly shape the quality of interaction with speech language models, yet remain difficult to achieve together. Explicit chain-of-thought (CoT) improves reasoning and audio understanding, but generating intermediate reasoning tokens delays responses. Describing fine-grained acoustic cues further lengthens CoT and increases latency. Latent reasoning can reduce this overhead, yet existing methods often trail CoT and remain limited by single-path supervision and reasoning budgets that do not adapt to problem difficulty. We introduce AURAL, which models a distribution over multiple plausible reasoning continuations in latent space and jointly predicts chunks of future states to reduce sequential forward passes and reasoning latency. To provide initial supervision for latent reasoning, we construct AuralReason-683K: 683K bilingual speech utterances (about 1,000 hours) with concise CoT for emotion recognition, empathetic dialogue, and general reasoning. AURAL-RL then explores beyond these traces, rewarding concise reasoning that yields high-quality answers and adapting reasoning effort to each problem. Across two backbones, AURAL-RL achieves performance comparable to CoT-RL, with larger gains over the respective supervised checkpoints on most metrics. Analysis further shows that harder questions elicit more latent reasoning steps. On Qwen2.5-Omni, it reduces time to the first answer token by 11.8x, from 1.22 to 0.10 s, versus 0.05 s for direct answering.

[151] What Makes Something Hard(er)? Explaining Question Difficulty in Natural Language cs.CL | cs.AIPDF

Peng Cui, Qiaoyuan Zheng, Rudolf Debelak, Mrinmaya Sachan

TL;DR: 该方法先用多模型回答数据估计问题难度，再自动生成并在留出问题上验证自然语言难度解释，使难度评分变为可操作的因素假设。

Details

Motivation: 难度决定问题能否区分模型能力，但现有自动方法多只输出一个分数，不解释究竟哪些问题特征使其变难。

Result: 研究用项目反应理论估计题目难度，提示LLM比较难易题生成假设，再用留出题验证选择。数学、逻辑和常识三个数据集上，生成解释可解释且有预测力，单独预测未见题难度时与先进黑箱回归器竞争或更好，作为额外特征还可提升回归器。按假设编辑题目会使实测难度朝预期方向改变，支持其因果有效性。

Insight: 难度因素可从预测性描述进一步检验为可干预变量，便于构造更有区分度的数据集和评测。其解释质量依赖所选题目对比与留出验证。

Abstract: Difficulty is one of the most fundamental properties of a question: it determines whether the question can meaningfully discriminate between models of differing ability. Although a variety of methods can now estimate or predict difficulty automatically, they yield only a single descriptive number, with no account of the underlying factors that make a question difficult in the first place. In this work, we propose a data-driven approach that automatically generates and validates natural-language hypotheses explaining what makes one question harder than another. We first estimate each item’s difficulty from the responses of a large pool of LLMs using Item Response Theory. We then sample contrasting sets of easy and hard questions and prompt an LLM to propose candidate explanations of the difference, which are subsequently validated and selected on held-out questions. Experimental results across three datasets spanning mathematical, logical, and commonsense reasoning show that our method produces interpretable and predictive hypotheses. On their own, they predict the difficulty of unseen questions competitively with, or better than, advanced black-box difficulty regressors; used as additional features, they further improve those regressors, implying that they discover difficulty signals that existing models fail to capture. Moreover, we demonstrate that editing questions according to a hypothesis can shift their measured difficulty in the expected direction, indicating that the discovered hypotheses are causally valid difficulty factors rather than post-hoc descriptions. Our approach thus turns a purely descriptive difficulty score into actionable statements.

[152] A rubric landscape for evaluating clinical reasoning in large language models: what exists, what is missing, and what needs to be combined cs.CL | cs.AIPDF

Zhangshu Joshua Jiang, Zina Ibrahim, James T. Teo

TL;DR: 该综述按六个维度盘点临床LLM推理评估量表和基准，并提出组合覆盖、完整性与正确性分离、时序一致性检查等设计建议。

Details

Motivation: 考试准确率无法证明模型能在临床记录中跨时间和来源整合证据、修订问题表示并形成有依据的计划；现有工具也未覆盖临床推理的全部维度。

Result: 综述梳理医学教育量表、2023年以来临床LLM基准及通用长文本评估方法。问题表示、鉴别和管理推理覆盖较多；时间综合有TIMER-Eval、序贯信念更新有ER-Reason，但不确定性、反事实推理和纵向自由文本适用性仍有限，忠实度最薄弱。作者建议组合二元评分项、分开报告完整性与正确性、加入安全上限、时序检查和机会校正信度。

Insight: 临床推理评估需要多维工具组合，不能用单项正确率或统一总分替代；遗漏与错误也应分别计量。作者明确这是一份设计依据综述，而非已验证的新量表。

Abstract: Exam-style accuracy does not establish whether large language models (LLMs) reason well over clinical records. We define clinical reasoning as integrating and updating evidence across time and sources to form, revise and justify a patient’s problem representation and a defensible plan. This structured narrative review maps three literatures: medical education assessment instruments, clinical LLM benchmarks published from 2023 onwards, and general-domain methods for evaluating long-form generation. We examine six dimensions: problem representation, temporal synthesis, differential and management reasoning, counterfactual reasoning, calibrated uncertainty, and reasoning faithfulness. Preprints are included and flagged. No single instrument covers all six dimensions. Problem representation and differential or management reasoning are reasonably covered, although reliability varies by instrument and setting. TIMER-Eval targets temporal synthesis, and ER-Reason assesses sequential diagnostic belief updating. Dedicated uncertainty and counterfactual evaluations are emerging, but their applicability to longitudinal free-text reasoning remains limited. Factual completeness is well theorised in general-domain evaluation, with early clinical evidence of important omissions. Faithfulness remains the weakest dimension, with one identified clinical causal-ablation study on multiple-choice questions. Existing tools should be combined through binary rubric items, separate completeness and correctness scores, case-specific importance weighting with non-compensable safety caps, temporal order-consistency checks, and chance-corrected reliability reporting. Further design work is needed for calibrated uncertainty, counterfactual reasoning and faithfulness over longitudinal free-text records. This review provides a design rationale, not a validated instrument.

[153] Controllable Multi-label Video Safety Detection via Adaptive Tversky Policy Optimization cs.CL | cs.CVPDF

Guangyu Yang, Jingbiao Mei, Mingsheng Sun, Jinghong Chen, Yingtong Bu

TL;DR: ATPO以自适应Tversky奖励动态调整多标签视频安全检测中的误报与漏报惩罚，使强化学习能按审核需求控制精确率—召回率取舍。

Details

Motivation: 不安全视频通常同时涉及多个类别，二分类会丢失标签结构；不同审核流程和类别对误报、漏报的容忍度也不同，静态训练目标无法调整工作点。

Result: ATPO在SafeWatch-Bench和XD-Violence上评估多标签视频安全检测。在SafeWatch-Bench-Real上，Jaccard指数从40.66提高到75.44；自适应奖励还可可靠地引导精确率—召回率工作点，以适配不同部署政策。

Insight: 安全检测不应只有单一默认工作点，奖励函数可显式体现审核应用对误报和漏报的不同代价。大幅Jaccard提升来自特定基准，其他场景仍需按政策调节权衡。

Abstract: The rapid growth of video-based social media has increased users’ exposure to harmful content, creating a need for reliable automated video safety detection. Although recent Vision-Language Models (VLMs) show strong video understanding capabilities, existing harmful video detection systems face two key limitations: they typically reduce safety detection to binary classification, overlooking the inherently multi-label nature of unsafe videos, and they rely on static training objectives that do not support controllable precision-recall trade-offs, though the desired operating point may vary across moderation pipelines and unsafe categories. To address these gaps, we propose Adaptive Tversky Policy Optimization (ATPO), a reinforcement learning framework for Multi-label Video Safety Detection (Multi-VSD). ATPO introduces the Adaptive Tversky Reward (ATR), which dynamically adjusts false-positive and false-negative penalties during training to enable controllable precision-recall trade-offs. Experiments on SafeWatch-Bench and XD-Violence show that ATPO substantially improves multi-label performance, increasing the Jaccard Index from 40.66 to 75.44 on SafeWatch-Bench-Real. Moreover, ATR enables reliable steering of the precision-recall operating point, supporting deployment scenarios with heterogeneous policy requirements. Code and checkpoints are provided at https://bruceyg.github.io/ATPO-project-page/ .

[154] Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation cs.CLPDF

Noy Sternlicht, Simra Shahid, Peter Jansen, Daniel S. Weld, Pao Siangliulue

TL;DR: 研究控制变量审计LLM新颖性评审，发现提示小改动就能大幅改变对相同创意对的判断，检索和增加推理预算帮助有限。

Details

Motivation: 自动创意系统越来越依赖LLM判断新颖性，但评审器常临时构造，验证对象却是人工论文而非实际生成创意，可能导致报告的创新收益不可靠。

Result: 作者从OpenReview筛选评审明确肯定或质疑原创性的论文片段，保留领域内意见一致的极端案例，并配对普通LLM生成创意。六种评审中，只告诉模型评审者认为哪项更新颖，就能改变超过半数相同创意对的判断，成对准确率变化超过50点，有时跌到随机以下；同一修改有利一个评审却损害另一个。检索和更大推理预算帮助不大，两个专门评审器还不及最低成本提示基线。

Insight: 新颖性判断高度依赖评审设计，微小提示变化即可造成系统性不稳定，不能仅凭一组人工论文验证就推广到机器生成想法。不同评审器需要各自稳健性审计。

Abstract: Automated ideation systems are often evaluated on the novelty of the ideas they produce, and that judgment is increasingly delegated to large language models. Such judges are typically built ad hoc and validated, if at all, on human-authored papers rather than on the generated ideas they are meant to score. So, how do novelty judges perform? Not well. We present a systematic controlled study of novelty evaluation design choices. We first build an evaluation set automatically, mining OpenReview for passages where reviewers explicitly affirm or dispute a paper’s originality and keeping only submissions with unanimous agreement at the extremes of their research area; we pair these with ideas from a vanilla LLM generator. Across six judges, we find that small prompt design choices have large consequences; e.g., simply telling the judge that reviewers found one idea novel and the other not can change its verdict on more than half of the identical idea pairs it is shown, shifting pairwise accuracy by over 50 points and occasionally pushing it below chance. The same change helps one judge and hurts another. Retrieval and larger reasoning budgets help little, and two purpose-built novelty evaluators are outperformed by our cheapest prompted baseline. These results raise questions about reported novelty gains of automated ideation systems, and call for robust novelty evaluation methods.

[155] LLM2Jev: LLMs Are Already Jev-Style Decision Models – When and How to Fine-Tune Them cs.CLPDF

Yinheng Li, Justin Wagle

TL;DR: LLM2Jev直接读取LLM下一词元对括号数字选项的概率作为校准决策分布，并提供无需训练和面向弱模型的列表式微调方案。

Details

Motivation: 软件系统可直接消费类别概率，而无需自由文本，但何时必须为通用LLM额外微调才能成为可靠决策模型仍不明确。

Result: 在Qwen3.5-4B和Qwen3-0.6B上，现代LLM无需训练即可有效决策：4B模型匹配同骨干社区Jev模型，优于字母词元读数，支持任意选项数量及图像多模态决策。微调对较弱模型和多选项意图路由等任务有针对性收益，强骨干收益递减；KL锚定避免对话生成退化，LoRA在强模型上表现最好。

Insight: 下一词元概率已包含可直接利用的结构化决策能力，微调应针对确有短板的模型或任务，而非一律追加。保留基础模型行为是训练决策头的重要约束。

Abstract: Jev-style decision models return categorical probability distributions over predefined options without generating free-form text, enabling software systems to act on their outputs directly. In this work, we investigate the extent to which general-purpose LLMs already possess this capability out of the box, and when fine-tuning is actually necessary. We present LLM2Jev, an architecture-preserving framework that extracts calibrated decisions directly from next-token probabilities over bracketed numeric identifiers. LLM2Jev provides both a training-free inference recipe and a fine-tuning objective that optimizes candidate selection via a tree-factorized listwise loss while anchoring auxiliary predictions to the base model using KL divergence penalties. Evaluating on Qwen3.5-4B and Qwen3-0.6B, we find that modern LLMs are inherently effective decision models: without training, the 4B model matches community Jev-style models built on the same backbone, outperforms letter-logit readouts, supports arbitrary option counts, and natively handles multimodal decisions over images. Fine-tuning provides targeted rather than universal benefits – substantially improving weaker models and specific tasks (such as many-option intent routing), but offering diminishing returns for strong backbones. Crucially, our KL anchors prevent behavioral degradation in conversational text generation, with LoRA delivering the strongest performance on capable models.

[156] Argo-Bench: Evaluating Data Agents on Enterprise-Scale Workflows cs.CL | cs.AI | cs.DBPDF

Gabriel Tomitsuka, Arman Raayatsanati, Emma Xing, Duke Gand, Joseph J Ma

TL;DR: Argo-Bench在企业级ERP数据仓库模拟中评测代理从多表检索、统计分析到实际行动的完整数据科学工作流。

Details

Motivation: 传统Text-to-SQL只评查询生成且答案键常有错误，公开数据又通常让一个业务事件落在单表中，难反映真实企业中跨表推理与行动的复杂度。

Result: 基准含210个分析任务，以纽约外卖平台为背景，模拟2024年8,100万订单、235张表和75亿行ERP仓库；代理需从被隐藏真实状态的数据中重建事实并执行封禁账户、分配补贴或补发工资等行动，评分看模拟后果。14个前沿及开源模型中，最强模型仅在34.8%任务得分95以上，平均59.5分。

Insight: 数据代理必须理解并导航真实规模环境，再对行动后果负责，单测SQL准确率不足以衡量能力。基准用可执行参考解保证任务仅凭仓库可解。

Abstract: Real-world enterprise data science and analytics workflows require reasoning across dozens of tables, performing statistical analyses, and acting on the results. Established text-to-SQL benchmarks evaluate query generation alone, and audits have found their answer keys frequently wrong. Because real enterprise warehouses are too sensitive to release, these benchmarks are built on public datasets where a business event fits in a single table. We introduce Argo-Bench, an evaluation framework comprising 210 data science and analytics tasks. Drawing on public data, peer-reviewed industry literature, and regulatory filings, we simulate a food delivery platform in New York City at true scale, with 81 million orders in 2024, grounded economics, fraud patterns, and marketplace incentives. We export this world to an ERP warehouse of 235 tables and 7.5 billion rows, modeled on the Oracle E-Business Suite schema. The simulator’s ground-truth state is withheld from the warehouse the agent sees, so tasks require reconstructing facts by navigating the warehouse before acting on them. Argo-Bench goes beyond text-to-SQL: the agent files actions such as banning fraudulent accounts, allocating courier incentive budgets, or issuing back pay, and the grader scores each by its consequences in the simulator. Every task has an executable reference solution that demonstrates solvability using only the warehouse. The strongest of 14 frontier and open-weight models scores 95 or higher on only 34.8% of tasks and averages 59.5 points. We hope Argo-Bench drives progress toward agents that understand, navigate, and act within real data environments.

[157] AutoCompact: Learning When to Compact Context in Long-Horizon Coding Agents cs.CLPDF

Xuan Zhang, Longtao Zheng, Cunxiao Du, Bo An, Xin Dong

TL;DR: AutoCompact把何时压缩上下文、保留哪些工作状态及如何续接纳入编码代理策略，通过监督微调和强化学习学会长程上下文管理。

Details

Motivation: 代码代理执行长轨迹时早期探索会过时，管理上下文不只是避免溢出，还需判断何时压缩、留下什么信息及如何从摘要继续工作。

Result: 训练数据由基础代理轨迹经评审器检查压缩决策、摘要及压缩后行动，并在执行前替换缺陷输出；随后先监督微调，再用任务成功奖励联合优化编码与压缩。在SWE-bench Verified和SWE-PolyBench Verified上，pass率较基础模型分别绝对提高9.2和5.0个百分点。不同推理预算均有收益，256K上下文从不溢出，16K窗口溢出时可触发回退压缩。

Insight: 上下文压缩是代理决策能力的一部分，摘要质量必须通过压缩后的实际任务执行验证。训练时纠正压缩轨迹可让模型学习在长程编码中维护有效工作状态。

Abstract: Coding agents solve repository-level software engineering tasks through long trajectories of code inspection, search, editing, and testing. As a task progresses, earlier exploration becomes stale, so managing context is more than avoiding overflow: an agent must decide when to compact, what working state to preserve, and how to continue from it. We introduce AutoCompact, which trains a coding agent to make these decisions as part of its policy. To collect training data, we run the base agent on coding tasks and use a judge to review its compaction decisions, summaries, and actions after compaction. Flawed outputs are replaced with corrected ones before being executed in the environment, so each trajectory continues from the corrected decisions. We use these trajectories for supervised fine-tuning, then jointly optimize coding and compaction through reinforcement learning with task-success rewards. Experiments on SWE-bench Verified and SWE-PolyBench Verified show that AutoCompact improves pass rates over the base model by an absolute 9.2% and 5.0%, respectively. The improvements hold across all evaluated inference budgets, with a 256K context window that never overflows and with a 16K window whose overflow triggers fallback compaction.

[158] Hierarchical Continuous Diffusion Language Models cs.CL | cs.AI | cs.LGPDF

Hui Ren, Zihan Li, Chang Liu, Huidong Liu, Alexander Schwing

TL;DR: HC-DLM把离散词元生成和连续潜轨迹耦合为一个分层扩散过程，让潜变量作为持久生成状态、词元读出后反馈为下一步支架。

Details

Motivation: 离散扩散并行采样词元时会切断同一步词元间统计依赖；连续扩散虽共享连续状态，却直到最终解码前都不保证其对应有效词元配置。

Result: HC-DLM以词元似然变分界推导训练目标，区别于把连续上下文附加到独立离散链的方法，潜变量是唯一持续状态。在数独结构推理、Countdown数学规划和LM1B语言建模上，同模型规模下优于离散与连续扩散基线，改善谜题准确率和生成困惑度；摘要未给出具体数值。

Insight: 让离散读出参与持续潜状态更新，可同时保留连续去噪依赖和合法词元结构支架。结果横跨结构化任务与语言建模，表明层级耦合具有一般性潜力。

Abstract: Discrete diffusion language models offer a compelling alternative to autoregressive generation for tasks demanding bidirectional reasoning and global constraint satisfaction. Yet they share a structural bottleneck: when decoding in parallel, each token is sampled independently from its marginal, severing the statistical dependencies among the tokens decoded together. Continuous diffusion language models avoid this by denoising a shared continuous state, but their denoiser sees only that state, so nothing ties it to a valid token configuration until it is finally decoded. To address this, we propose Hierarchical Continuous Diffusion Language Models (HC-DLM), which couple discrete token generation with a continuous latent trajectory in a single, principled denoising process, whose training objective is derived from a variational bound on the token likelihood. In contrast to recent methods that attach continuous context to a self-contained discrete chain, HC-DLM makes the latent the only persistent generative state: tokens are read out from it at every step and feed back as a scaffold for the next latent update. On structured reasoning (Sudoku), mathematical planning (Countdown) and language modeling (LM1B), HC-DLM improves over discrete and continuous diffusion baselines at matched model size, in puzzle accuracy on Sudoku and Countdown and in generative perplexity on LM1B. Project page: https://hc-dlm.github.io/.

[159] KaliBench: A Fine-Grained Benchmark for Cybersecurity Tool Use on Kali Linux with Runtime-Free Verifiable Rewards cs.CL | cs.AI | cs.CRPDF

Pengfei Li, Naufal Suryanto, Sicheng Zhang, Muzammal Naseer

TL;DR: KaliBench评测LLM把自然语言意图转换为可执行Kali Linux命令的能力，并提供确定性验证奖励以训练工具使用。

Details

Motivation: 网络安全操作依赖严格命令行语法，轻微语法错误、参数绑定或顺序错误都能使执行失败；现有评测多看安全知识或端到端代理，未直接衡量命令生成。

Result: KaliBench含8,504组查询—命令，覆盖1,642种工具、23类能力和5个安全阶段，并结合LLM验证、沙箱执行和人工修订。三种评估模式、24种通用和安全开源模型配置中，开放设置下没有模型的精确命令准确率超过42%。由基准构造的可验证奖励经SFT和RL显著提升8B模型，使其表现可比685B MoE模型。

Insight: 工具选择和参数构造需要精确执行级评测，而非只判断答案是否“懂安全”。可确定性验证的命令奖励能训练实用技能，但开放无工具提示仍是难点。

Abstract: LLMs are increasingly applied to cybersecurity workflows, where they are expected to translate analysts’ intent into tool invocations. However, existing evaluations focus on knowledge-based assessments or end-to-end agentic tasks, and do not directly measure LLMs’ ability to generate executable commands for real-world cybersecurity tools. This gap is critical because cybersecurity operations rely on strict command-line interfaces (CLIs), where minor syntax errors, incorrect flag–value bindings, or argument misordering can invalidate execution. We introduce KaliBench, a fine-grained benchmark and dataset for natural-language–to–CLI translation on Kali Linux, comprising 8,504 query–command pairs spanning 1,642 tools across 23 capability dimensions and 5 security phases. KaliBench is constructed via a manuscript-grounded pipeline with deterministic canonicalization and alias-aware evaluation, enabling precise and reproducible assessment of tool selection and argument construction. To ensure both semantic correctness and practical executability, we develop a multi-stage verification pipeline that combines LLM-based validation, sandboxed terminal execution, and human-in-the-loop refinement. Building on these fine-grained, deterministic signals, KaliBench further enables runtime-free verifiable rewards for training. Across three evaluation modes and 24 configurations of general-purpose and security-focused open-weight models, no open-weight model exceeds 42% exact-command accuracy in the unrestricted setting, highlighting the difficulty of accurate CLI-based cybersecurity tool use without explicit tool hints. We further show that supervised fine-tuning and reinforcement learning with verifiable rewards derived from KaliBench significantly improve an 8B model and achieve performance comparable to a 685B MoE model.

cs.AI [Back]

[160] Characterizing a Configuration Where Inference-Time PRM-Pruned Fragment Grafting Is Inert: Evidence from Three Reasoning LMs cs.AI | cs.CLPDF

Khawaja Murad ul Hassan, Mehran Ebrahimi

TL;DR: 研究在受控运行点检验PRM剪枝片段移植是否能改善并行CoT，发现所测配置与独立并行推理等效，难以精准触发需要救援的轨迹。

Details

Motivation: 并行CoT可能多样性坍塌，过程奖励模型剪枝后把高分前缀移植给仍在解码的同伴，似乎是低成本跨轨迹步骤迁移，但增益可能依赖额外机制。

Result: 在Qwen2.5-7B-Instruct、MATH500三种随机种子上，停滞目标和随机目标PPFG在所有指标均与独立并行CoT无统计差异。322次注入中仅14%命中真正困难轨迹，其余链已成功、接近完成或处于平坦PRM区间；跨三种底座、六个基准、第二PRM及门控扫描复现，12个Qwen/LLaMA单元通过等效性检验。事后oracle界定逐题收益最多仅0.13个百分点。

Insight: 片段移植的关键不是来源前缀质量，而是能否识别确实需要救援的目标链；粗糙触发会把计算浪费在已成功或即将结束的样本上。结论严格限定于所测运行点。

Abstract: Diversity collapse in parallel chain-of-thought has motivated inference-time interventions built on a natural design: when a process reward model (PRM) prunes a chain, its high-PRM prefix is extracted and grafted verbatim as an in-context demonstration into a still-decoding sibling. We isolate this mechanism, PRM-Pruned Fragment Grafting (PPFG), as the most cost-minimal operationalization of cross-trajectory step-level transfer, and test it at the operating point where prior fragment-grafting work reports gains only under additional compensating ingredients. On Qwen2.5-7B-Instruct with Math-Shepherd on full MATH500 (n=500, three seeds), PPFG in both stagnation- and random-targeting variants is statistically indistinguishable from an independent parallel-CoT baseline on every measured axis. We characterize why: a four-bucket classification of 322 stagnation-rule injection events shows only 14% targeted a genuinely struggling chain; the rest landed on chains that had already succeeded, were near completion, or sat on a flat PRM plateau, states a rescue graft cannot change. No compound-gate refinement jointly achieves well-targeted firing and adequate density, and a random control matches the same parity at 2.4x the firing rate, so the inertness is not heuristic-specific. The finding replicates across three base LMs, six benchmarks, a second PRM, and a compatibility-gate sweep; two-one-sided-tests analysis promotes the parity to positive equivalence on all twelve Qwen/LLaMA cells. A per-event spot-check finds injected chains prune at 2.75x the matched-step rate, but a surviving-sibling counterfactual finds no population-level compensation. A hindsight oracle bounds any per-problem gain from choosing PPFG over independent at +0.13 pp. We contribute an equivalence-testing template for establishing inference-time mechanism nulls, with every claim scoped to its tested operating point.

[161] Comedic Fool’s Gold: Reward Exploits and Countermeasures in Conversational Humor cs.AI | cs.CL | cs.LGPDF

Sam Larson

TL;DR: 研究审计对话幽默强化学习奖励的捷径利用，并以逐步奖励修订减少词序打乱和“笑声提示”造成的伪高分。

Details

Motivation: 自动幽默奖励需同时捕捉可理解的意外感和观众反应，但奖励模型可能把表面线索当作幽默，修复捷径时又误伤真正幽默回复。

Result: 嵌入式意外奖励同样接受乱序词语和机智回答；流畅度过滤器可检测乱序，却也拒绝部分机智内容且未通过后续验证。观众模型会被任一说话者消息中的笑声线索欺骗，跨说话者归一化可阻断已覆盖攻击但仍有未匹配表达可利用。最终三次RL运行将综合评估分提升0.0903、零分会话降低40%，但幽默专属提升未达预注册目标。

Insight: 奖励防护需同时阻断捷径并保留目标行为，某一攻击被消除不保证奖励有效。作者报告最终整体改善，但明确幽默核心提升未达到预设标准。

Abstract: We investigate automated rewards for training language models in conversational humor, focusing on reward exploits and countermeasures. Two approaches aim to capture understandable surprise and predicted audience amusement. Controlled tests show that an embedding-based surprise reward accepts word-shuffled replies as readily as witty ones. A fluency filter detects the shuffles, but the combined reward also rejects some witty replies and fails further validation. An audience model’s predicted laughter is instead vulnerable to laughter cues in either speaker’s messages. Normalizing these cues across speakers blocks the covered attacks, although unmatched expressions remain exploitable. Three reinforcement-learning runs evaluate training with successive reward revisions. The final run improves the combined evaluation score by 0.0903 and reduces zero-score sessions by 40%, but its humor-specific improvement remains below our preregistered target. These findings illustrate a broader challenge for automated reward design: countermeasures must block exploitable shortcuts while preserving the behavior the reward was intended to encourage.

[162] Beyond Final Accuracy: Auditing Communication in LLM Multi-Agent Systems cs.AI | cs.CLPDF

Shixuan Li, Wei Yang, Peiyu Zhang, Anzhe Cheng, Heng Ping

TL;DR: ICR把多智能体通信效果定义为独立推理后的答案修订，并用无消息控制区分真正沟通收益与额外推理收益。

Details

Motivation: 多智能体系统准确率提高可能来自有效交流、架构优势或更多计算；最终准确率也把纠正错误与传播错误混在一起，难以审计通信影响。

Result: ICR固定初始推理轨迹，按双方初始正误分别衡量纠错和保留，并以无消息修订控制估计额外推理收益。在四个推理基准上，文本和潜变量通信的总体准确率相似，却产生不同修订行为；完整推理较只传答案提高纠错、但在所有基准降低正确答案保留。MedQA和GPQA的结构化验证接收策略使所有通道保留提升、纠错降低，而选择性变化依任务而异。

Insight: 通信好坏并非通道固有属性，而取决于消息内容和接收者如何更新判断。纠错与保留必须同时评估，否则最终准确率会掩盖有益和有害影响。

Abstract: Multi-agent communication aims to help agents benefit from one another’s information. Yet improvements in system performance leave a fundamental ambiguity: do they reflect effective communication, a favorable agent architecture, or simply additional reasoning? Because communication methods are commonly evaluated within the systems they were designed for, these factors are difficult to disentangle. Final accuracy further merges corrected errors and corrupted answers into a single outcome, obscuring how communication changes decisions. We introduce Independent–Communicate–Revise (ICR), a controlled framework that evaluates communication as answer revision following independent reasoning. ICR fixes initial reasoning trajectories, measures correction and preservation conditional on both agents’ initial correctness, and uses a no-message revision control to quantify gains beyond additional reasoning. Across four reasoning benchmarks, our audit of textual and latent communication reveals that similar aggregate accuracy can conceal substantially different revision behaviors. Compared with transmitting answers alone, full reasoning increases correction while reducing preservation on all four benchmarks, so richer messages amplify beneficial and harmful influence alike. Receiver-policy comparisons on MedQA and GPQA-D further show that a structured verification policy shifts every channel toward greater preservation and lower correction, while its effect on selectivity varies across channels and tasks. These findings challenge treating communication quality as an intrinsic property of a channel. ICR therefore recenters evaluation on selective revision, providing a unified framework for examining how message content and receiver policies jointly produce benefits and harms.

[163] Revision-Aware Independent Agent Graphs for Dynamic Reasoning cs.AI | cs.CLPDF

Yan Luo, Selim-Antoine Lali, Jeremy Moebel, Iliass Khoutaibi, Ahmadou Aidara

TL;DR: RIAG将动态任务版本解析与内容推理解耦，用不可变文档身份缓存答案，并按需调用审计修复以避免过度重算或复用过时结论。

Details

Motivation: 固定任务协议无法测试代理是否能在事件更新后传播相关变化、保留无关成果或重建历史任务版本；无条件缓存会返回陈旧答案，事件后全部重算又浪费资源。

Result: 作者把六个常用基准改造成31,119段动态事件序列、373,428个时序查询。RIAG每个新任务先做两次未暴露尝试，再按需审计与修复，每文档版本最多四次调用。统一代理准确率54.24%、每查询0.62次调用，相比最强对照32.22%、18次；异构代理达到49.78%、0.63次调用。

Insight: 正确回答动态任务需要先按查询时间确定有效文档版本，之后再推理。确定性版本解析、版本级缓存和条件审计共同降低调用成本。

Abstract: Conventional reasoning protocols present a fixed, preselected task, so they cannot test whether an agent propagates relevant updates, preserves unaffected work, or reconstructs a historical task binding. We therefore study \emph{dynamic task routing}, in which an event stream revises task bindings and a system must select the document version valid at each query time before solving it. To study this problem, we repurpose six widely used benchmarks: MMLU, MMLU-Pro, MedMCQA, MATH, GPQA, and HumanEval into 31{,}119 dynamic episodes comprising 373{,}428 temporally categorized queries. This setting exposes a central trade-off: recomputing after every event wastes work, whereas unguarded reuse returns stale conclusions. We introduce the Revision-Aware Independent Agent Graph (RIAG), a bounded multi-agent policy that separates deterministic temporal resolution from task reasoning. RIAG caches solutions by immutable document identity, starts each fresh task with two unexposed attempts, and conditionally invokes audit and repair, using at most four calls per document version. On this collection, homogeneous RIAG achieves 54.24% joint routing-and-answer accuracy at 0.62 calls/query, compared with 32.22% at 18.00 calls/query for the strongest comparison method; heterogeneous RIAG reaches 49.78% at 0.63 calls/query.

[164] A2Z GameSpec-Bench: How Faithfully Can Coding Agents Generate Games from Game Design Specifications? cs.AI | cs.CVPDF

Seonho Lee, Wonryeol Jeong, Alberto Cereser, Inha Kang, Hyeonjong Kim

TL;DR: A2Z GameSpec-Bench用长篇游戏设计文档和依赖感知契约，评估编码代理是否能在代码与实际玩法中共同实现相互依赖的要求。

Details

Motivation: 完整应用开发代理需忠实保留复杂设计意图，游戏GDD中的逻辑、画面和交互要求相互依赖，短规范基准难测端到端实现忠实度。

Result: 基准含100份长篇GDD，将规则、约束和前置关系转为固定契约，并结合源码检查、代理生成测试和自适应试玩。评估发现当前代理难以同时满足代码实现和实际玩法中的相互依赖要求；两轮针对性反馈使GDD Fidelity较自我修订相对提高10.9%。

Insight: 规格遵循不能只检查代码是否存在某功能，还要测试跨要求关系在真实互动中是否成立。固定契约及逐项证据支持跨代理和修订轮次比较。

Abstract: Delegating complete application development to coding agents requires preserving the intended design rather than simply producing plausible outputs through naive prompting. Game development provides a demanding testbed, as long-form Game Design Documents (GDDs) describe requirements that must work together across game logic, visual rendering, and player interactions. However, existing game-development benchmarks typically use compact specifications and provide limited support for evaluating interdependent requirements across these aspects in long-form GDDs. We introduce A2Z GameSpec-Bench, a benchmark of 100 long-form GDDs for evaluating end-to-end game development by agents. We measure faithfulness by checking whether the game satisfies the GDD requirements and preserves the relationships among them. Each GDD is turned into a dependency-aware contract that contains rules, constraints, and prerequisite relations. Following game-development practices, we combine source-code inspection with agent-generated test policies for scenario-based replay and adaptive playtesting. The contract remains fixed across agents and revision rounds, while judgments and evidence linked to the same requirements support consistent comparison and failure detection. Our evaluations show that current agents struggle to jointly satisfy interdependent requirements across code implementation and actual play. Requirement-specific feedback improves GDD Fidelity by 10.9% relative to self-revision after two rounds. A2Z GameSpec-Bench assesses end-to-end specification-following ability beyond implementation judgments and provides targeted feedback to support more faithful game development. Code and datasets are available at https://a2z-gamespec-bench.github.io.

[165] ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research cs.AI | cs.CL | cs.IRPDF

Sohyeon Kim, Yoonho Lee, Bo Liu, Dayoon Ko, Rulin Shao

TL;DR: ScholarCatalyst让论文第一作者标记哪些先前工作实际或可能推动了项目，构建基于研究者判断的科学论文启发检索基准。

Details

Motivation: 科学家能从不断增长的文献中感知新问题需要哪些旧想法，现有检索基准难衡量这种专家直觉和半成形研究问题到关键先例的连接能力。

Result: 184位作者为207篇近期计算机科学论文标注候选文献并提供理由，检索时仅允许使用项目开始时已有的文献。代理搜索Recall@20为0.42，低于直接嵌入检索的0.48；可能在训练中见过最终论文的Claude Fable 5.1也仅0.51。

Insight: 调用检索器的代理流程并未自动获得专家选题直觉，现有模型从宽泛研究问题定位启发论文仍有很大差距。作者标注和历史时点约束提供了更真实的研究发现评估。

Abstract: What makes great scientists great? Even as AI systems start to make progress on open problems, scientists remain far ahead of them at sensing which prior idea, buried in an ever-growing archive of research, a new problem needs. To study this skill, we draw on researchers who know firsthand which earlier work advanced their completed projects, with papers serving as pointers to the ideas within. Using our automated pipeline that makes author annotation scalable, we build ScholarCatalyst by having 184 lead authors of 207 recent computer science papers label which candidates did or could have advanced their project, each with a detailed rationale. We introduce a retrieval task with author-provided judgments: given an initial research question, retrieve these papers from only the literature available when the project began. Agentic search does no better than embedding retrieval (0.42 vs. 0.48 Recall@20) despite calling that same retriever as a tool. Even an agent built on Claude Fable 5.1, which may have seen the completed papers during training, reaches only 0.51 R@20. These results highlight the need for new training recipes that equip models with expert intuition for searching broad corpora. We envision ScholarCatalyst as a step toward scientific agents that can take a half-formed idea and point to the prior research it needs.

Ali Koksal, Mei Chee Leong, Vicky Sintunata, Ching Ling Chin, Wee Teck Fong

TL;DR: AiSearch用VLM零样本能力支持对图像和视频的自然语言检索，并允许用户通过反馈实时修订搜索结果。

Details

Motivation: 现代检索系统既要自动化，也要交互式，使用户能快速细化查询；不同VLM对图像和视频检索的适用性也需比较。

Result: AiSearch提供灵活的多模态检索框架，支持自然语言搜索、用户反馈驱动的结果 refinement 和跨VLM可视化基准测试，帮助用户选择适合任务的模型。摘要介绍系统能力，未报告检索性能指标。

Insight: 把用户反馈嵌入检索循环可将一次性查询变成逐步澄清意图的过程；跨模型可视化比较便于实际选型。

Abstract: Modern retrieval systems must both be automated and interactive, allowing users to search and refine results in real time. We present AiSearch, a flexible multimodal retrieval framework that leverages the zero shot capabilities of Vision Language Models (VLMs) for natural language search over images and videos. AiSearch supports interactive search refinement through user feedback to tailor results to the user’s intent, and allows visual benchmarking across multiple VLMs, enabling users to select the most suitable model for their task.

[167] Towards Reliable Vision-Language Models for Autonomous Driving cs.AI | cs.CVPDF

Manasa Mariam Mammen, Priyanka Mary Mammen, Zafer Kayatas, Stefan Wagner

TL;DR: 研究评估五种VLM在四类驾驶问答数据和多种视觉输入设置下的可靠性，并测试视觉证据增强在受损图像上的效果。

Details

Motivation: 自动驾驶VLM需在传感器缺陷和恶劣环境造成视觉退化时既保持正确，也识别自身置信度是否可靠；安全关键决策不能只看平均准确率。

Result: 研究比较Qwen3.5、Gemma4、LLaVA-OneVision、DriveFusion和Alpamayo等模型，覆盖单帧、多视图、多帧和单目输入。视觉扰动对准确率和置信度可靠性的影响因模型、数据集与输入设置而异。推理时视觉证据增强对部分模型和数据有帮助，但收益不一致。

Insight: 鲁棒性和置信度需按输入形式及场景分别评估，单一模型级结论可能掩盖条件差异。证据增强并非对所有模型和任务都有效。

Abstract: Vision-Language models (VLMs) are increasingly being explored in autonomous driving for tasks such as scene understanding, driving reasoning, decision-making, and end-to-end driving. As their role becomes more prominent, ensuring their robustness and reliability is increasingly important. In real-world conditions, visual inputs may be degraded by sensor imperfections and environmental conditions, potentially affecting both model predictions and their associated confidence. Such degradation is especially concerning in autonomous driving, where safety-critical decisions require models to make accurate predictions and recognize when their predictions may be unreliable. In this work, we evaluate five VLMs (Qwen3.5-9B, Gemma4-E4B, LLaVA-OneVision-7B, DriveFusion/DriveFusionQA-4B, and NVIDIA Alpamayo-1.5-10B) across four driving-related QA datasets with different visual input settings, including single-frame, multi-view, multi-frame, and monocular inputs. Our results show that the effects of visual corruption vary across models, datasets, and input settings, with changes in accuracy and confidence reliability and also differing across conditions. We then apply Visual Evidence Augmentation ($\mathrm{V}{\scriptstyle \mathrm{EA}}$), a recent inference-time method to examine whether it can improve model reliability under degraded visual conditions. We find that $\mathrm{V}{\scriptstyle \mathrm{EA}}$ improves performance for some models and datasets, although the gains are not consistent across all settings.

Dongwei Sun, Yujie Zhang, Bowen Yao, Pei Liu, Jing Yao

TL;DR: CoEvolve将视觉定位拆成显式候选区域构造与双向坐标编辑，让模型能诊断、保留或修正中间定位状态。

Details

Motivation: 多数视觉定位模型将目标识别、空间推理和边界估计压成最终框；自由文本理由又不提供可测量、可编辑的空间状态，错误区域选择和边界偏差难修复。

Result: RER将分析组织为逐步语义—空间候选轨迹，BDR在固定语义上下文下双向重建坐标，并通过几何及行为目标监督可靠保留或校正候选。在自然图像和遥感定位任务中，9B骨干准确度可媲美最高241B模型；严重定位扰动时，一次BDR迭代将平均框重叠提高超过27个百分点。

Insight: 把中间位置显式化后，定位失败可被局部修订，而不必重新生成完整推理。受控扰动恢复能力展示了状态匹配编辑的价值。

Abstract: Visual grounding localizes an object described by language with a bounding box. Most multimodal grounding models compress target identification, spatial reasoning, and boundary estimation into one terminal prediction. Free-form rationales make reasoning linguistically explicit but do not necessarily expose measurable, editable spatial states. Intermediate localization errors are therefore difficult to diagnose and correct, allowing incorrect region choices and imprecise boundaries to persist in the final box. We introduce CoEvolve, a construct-to-edit framework that separates grounding into explicit state construction and state editing. Region-Evolution Reinforcement (RER) organizes grounding analysis into a progressive semantic–spatial trajectory, with each reasoning step committing to an explicit candidate region. Bidirectional Denoising Refiner (BDR) treats the reasoning text as fixed semantic context and refines the trajectory’s coordinate fields through bidirectional same-position reconstruction. Geometry- and behavior-level objectives provide target geometry and edit-preference signals for consolidating reliable candidates, preserving accurate inputs, or correcting toward annotations. Evaluations cover natural-image and remote-sensing grounding. With a 9B backbone, CoEvolve rivals models up to 241B parameters in grounding accuracy. Under controlled corruption, a single BDR pass improves mean box overlap by over 27 percentage points, demonstrating strong recovery from substantial localization errors. State-source comparisons further support the complementarity of explicit state construction and source-matched editing. The project is at https://sundongwei.github.io/CoEvolve_Project/.

[169] VideoEvolve: Evolving Agent Harnesses for Video Temporal Grounding cs.AI | cs.CVPDF

Bingjun Luo, Yuhuan Fan, Jialin Guo, Siqi Li

TL;DR: VideoEvolve自动修改冻结VLM的视频时序定位代理流程和指令，通过结构化工作流、分支保留及执行反馈迭代优化。

Details

Motivation: 对冻结VLM代理而言，工具脚手架决定查询如何影响时间预测及后续修正；人工调试需要定位失败并协调修改流程与提示。

Result: 框架用保留阶段接口、允许流程和指令演化的结构化表示，分支引导搜索保留有潜力的代码改动，再以执行反馈和验证决定保留哪些修改。多基准实验显示定位性能提升；组件分析发现指令优化持续贡献收益，而代码进化收益因评测设置变化。

Insight: 代理能力可通过自动演化外部脚手架提升，而不一定重训底层模型；提示改进较稳定，代码修改则更依赖任务环境。

Abstract: Video temporal grounding aims to localize events in videos from natural-language queries. For agents built around frozen video-language models, the harness determines how queries guide temporal predictions and how those predictions are refined. Manually refining these harnesses requires diagnosing grounding failures and coordinating changes to both agent workflows and instructions. We introduce VideoEvolve, a framework that automatically evolves agent harnesses for video temporal grounding. VideoEvolve uses a Cloze-Structured Harness Representation that preserves stage interfaces while leaving agent workflows and instructions open to evolution. Branch-Guided Harness Evolution preserves promising code branches for continued refinement, using execution feedback to guide local edits and validation to determine which improvements are carried forward. Experiments demonstrate improved grounding performance across multiple benchmarks. Component analyses identify instruction refinement as a consistent source of gains, while the benefits of evolved code vary across evaluation settings. Together, these results support automated harness evolution as an effective approach to improving video temporal grounding. Code is available at https://github.com/bingjunluo/VideoEvolve .

[170] VISTA: A Visual Harness for Reasoning in an Interactive World cs.AI | cs.CVPDF

Qiushi Han, Keya Hu, Linlu Qiu, Cathy Wu, Kaiming He

TL;DR: VISTA为通用多模态模型提供无损视觉记忆和主动观察检索，使其在长时程交互游戏中保留原始观察并重组视觉输入。

Details

Motivation: 多模态模型可能具备较强推理能力，但缺少长程视觉上下文的代理脚手架；有损摘要或短窗口会丢掉过去对解题重要的像素证据。

Result: 在ARC-AGI-3上，VISTA将Claude Opus 5.0相对人类动作效率从40.68提升到100，完成全部25个公开游戏且比首次参与的人类少用57.4%动作。三个额外游戏和谜题基准中，使用相同底层模型的VISTA也显著优于最小化脚手架基线。

Insight: 保持原始观察的无损存储并允许主动检索，可为多模态代理提供长时程视觉记忆，而不必将信息压缩成文本。该框架还能扩展到多种视觉交互环境。

Abstract: We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diverse interactive environments. We introduce VISTA, a visual harness that gives a general-purpose multimodal model long-horizon vision. VISTA allows the model to directly perceive the environment through visual observations and maintains a lossless visual memory that preserves past observations in their original form. The model can actively retrieve these observations and reorganize its visual input as it reasons. On ARC-AGI-3, VISTA improves Claude Opus 5.0’s Relative Human Action Efficiency score from 40.68 to a perfect 100.00, with the model completing all 25 public games using 57.4% fewer actions than first-time human participants. VISTA’s simple design also allows it to extend naturally to diverse visual environments with minimal adaptation. Across three additional benchmarks covering a diverse range of visual games and puzzles, it substantially outperforms baselines using the same underlying model with minimal harnesses. Our results highlight VISTA’s potential as a general-purpose visual harness for advancing multimodal agents in complex visual environments.

cs.CR [Back]

[171] AuraForge: Scaling Security Supervision for Training Coding Agents cs.CR | cs.CL | cs.CYPDF

Danqing Wang, Songwen Zhao, Harsh Sharma, Jierui Wang, Andre Vicente Duarte

TL;DR: AuraForge合成并验证可执行安全测试，用于训练编码代理实现功能正确且安全的代码，缓解真实仓库安全监督难以规模化的问题。

Details

Motivation: 编码代理已能生成完整应用，但功能正确不代表实现安全；真实代码库中的可靠安全标签难大规模获取，安全训练仍受监督数据不足限制。

Result: AuraGym含679个来自344个真实仓库的可执行功能任务，覆盖Python、JavaScript、TypeScript及177类CWE。对于具人工安全测试的子集，AuraForge平均生成约3倍测试用例并将误报率降低83.23%。用合成测试训练Qwen3.5-4B，在三种语言上平均FuncPass/SecPass提升19.7/6.2，高于人工测试的14.9/4.4。

Insight: 可执行测试能为安全编码提供更丰富监督，且测试多样性与低误报有助于允许不同安全实现。训练结果显示合成测试优于人工测试，但仍限于已构建任务与模型。

Abstract: Coding agents are now proficient enough to generate complex software applications from a single prompt. As their capabilities have grown, human oversight has increasingly shifted from line-by-line code review toward hands-off evaluation of outcomes. However, recent studies have shown that such a transition exposes a critical risk: functional correctness alone does not guarantee a secure implementation. Despite growing attention to code security, training safer coding agents remains challenging because reliable security supervision is difficult to obtain at scale from real-world repositories. We introduce AuraForge to synthesize and validate executable security tests for training secure coding agents. Our approach combines attack-oriented test synthesis, language-extensible task construction, and safeguards against reward hacking. Using AuraForge, we construct AuraGym, a multi-language and multi-CWE executable training gym: 679 executable feature-implementation tasks from 344 real-world repositories across Python, JavaScript, and TypeScript, covering 177 CWE categories. On the subset with human-written security tests, AuraForge produces about 3 times as many test cases on average and reduces the false-positive rate by 83.23%, allowing alternative secure implementations to receive correct supervision. Training Qwen3.5-4B with synthesized security tests gains larger improvements than human-written security tests (average 19.7 FuncPass and 6.2 SecPass vs. 14.9 FuncPass and 4.4 SecPass) on three languages. These results demonstrate that AuraForge provides more diverse and reliable security supervision to train secure coding agents.

[172] ReCast: Contract-Preserving Protection for Fixed-Interface Multimodal Reasoning cs.CR | cs.AI | cs.CLPDF

Bingchen Pei, Lichong Chen, Bingxi Zhao, Ziang Wu, Sirui Wang

TL;DR: ReCast在本地将私有图表和语音转成保留任务关系的受保护输入，交给远程多模态模型推理后再恢复数值并执行结果。

Details

Motivation: 远程多模态模型擅长图表和语音数值推理，但上传原始媒体会泄露敏感内容；文本清洗不适用于固定媒体接口，身份匿名化也未隐藏任务本身。

Result: ReCast用蒸馏4B模型联合改写实体和主题，以本地可逆、角色感知数值映射替换数值，并由代理重建和验证媒体。4,000个ChartQA与NMSQA留出样本上准确率75.10%，保留未保护远程准确率的92.43%；基于模型的审计发现7.95%发送请求仍有源内容泄漏。它优于所比较本地基线。

Insight: 隐私保护可围绕任务关系重建媒体，而非仅删去文本身份；本地恢复使远程模型无需看到原值即可完成计算。仍有可审计的泄漏比例，需要按部署风险评估。

Abstract: Remote multimodal models offer strong numerical reasoning capabilities over charts and speech, but sending private inputs risks exposing sensitive content. Text-only sanitization cannot directly satisfy fixed media interfaces, while identity anonymization leaves the underlying task content exposed. We introduce ReCast, an agentic plug-in framework that replaces source-specific content while preserving task-relevant relations and the required input modality. ReCast locally converts inputs into a shared textual evidence-query record, jointly rewrites entities and topics with a distilled 4B model, and substitutes values through a locally invertible, role-aware numerical map. A reconstruction agent generates and validates the required media from the protected record. The remote solver returns a program whose protected operands are restored locally before execution. On 4,000 held-out ChartQA and NMSQA examples, ReCast achieves 75.10% accuracy, retaining 92.43% of unprotected remote accuracy, while a model-based audit flags source-content leakage in 7.95% of solver-bound requests. It outperforms all evaluated local baselines, preserving the benefit of remote reasoning while reducing source-content exposure under existing media interfaces.

[173] UnifiedAttack: Evaluating the Safety of Large Multimodal Models in Synergistic Harmful Image-Text Generation cs.CR | cs.CVPDF

Bingjun Luo, Jialin Guo, Tony Wang, Siqi Li

TL;DR: UnifiedAttack基准审计统一多模态模型在图像与文本协同生成时的安全性，关注跨模态组合风险是否超过各单模态风险。

Details

Motivation: 统一多模态模型能够联合生成文本和图像，协同后可能产生单模态无法表达的更大危害，因此仅分别测试文本或图像安全不足。

Result: 基准筛选多模态潜在风险样本并加入合成虚假信息查询，随后在多种先进架构上评估协同生成攻击。实验显示现有统一模型的对齐保护可被系统性绕过，暴露出结构性服从和逻辑连贯性可能被利用的风险；摘要未提供成功率。

Insight: 安全评估应覆盖跨模态协同效果，而不能只把各模态风险相加。研究强调需要能识别联合推理路径风险的防护方法。

Abstract: As Large Multimodal Models (LMMs) transition toward natively unified architectures, evaluating their safety in synergistic harmful image-text generation tasks becomes a critical challenge. Unlike unimodal threats, synergistic risks emerge when text and image modalities are coordinated to produce harm that significantly exceeds their individual components. We introduce UnifiedAttack, a novel benchmark designed to evaluate LMM safety in collaborative scenarios by focusing on the harmfulness gain achieved through cross-modal synergy. The benchmark incorporates samples filtered for their multimodal potential alongside a novel subset of synthesized disinformation queries. To verify identified vulnerabilities, we propose a synergistic hijacking framework featuring In-Context Reskinning (ICR) and Cognitive Planning Injection (CPI). ICR utilizes few-shot learning to wrap adversarial intent in benign virtual shells to desensitize safety filters, while CPI hijacks the reasoning path by enforcing a plan-then-execute paradigm. By compelling the system to commit to a neutral logical plan, we exploit its internal drive for consistency to induce the synchronized generation of harmful multimodal content. Extensive evaluations on state-of-the-art architectures demonstrate that UnifiedAttack consistently bypasses modern alignment. Our findings reveal that the structural helpfulness and logical coherence of unified models can be systematically weaponized, highlighting the urgent need for logic-aware defenses in synergistic generation tasks. Code is available at https://github.com/bingjunluo/UnifiedAttack .

cs.GR [Back]

[174] GS-PQM: A Parameter-Domain Quality Metric for Compressed Gaussian Splatting cs.GR | cs.CV | cs.MMPDF

Pedro Martin, António Rodrigues, João Ascenso, Maria Paula Queluz

TL;DR: GS-PQM直接在3D Gaussian参数空间计算压缩质量分数，无需渲染预定视点，降低评估对视图选择的依赖。

Details

Motivation: 高斯溅射压缩大幅减小模型体积后需要客观质量评价，但传统图像或视频指标必须渲染指定视点，评分会随选取视角改变且增加计算成本。

Result: GS-PQM从参数域失真特征估计感知质量，并用支持向量回归建模。在压缩高斯内容实验中，它评估能力超过25种现有图像、视频和点云质量指标，被报告为精确且计算高效的渲染式评估替代方案；摘要未给具体数值。

Insight: 压缩失真可从高斯参数变化直接估计，而不必为质量评分生成多视角图像。该指标面向后训练压缩评估，推广到其他表示需另行验证。

Abstract: Recent advances in Gaussian Splatting (GS) compression have enabled substantial reductions in GS model size. Reliable objective quality assessment is therefore essential for comparing compression methods and guiding the development of more efficient GS codecs. Existing GS quality assessment typically relies on image and video quality metrics, requiring rendering of predefined viewpoints and making the quality estimate dependent on the selected views. This paper introduces GS-PQM, a novel full-reference quality metric for post-training GS compression that operates directly in the GS parameter domain. GS-PQM estimates perceptual quality from a set of parameter-domain distortion errors using a Support Vector Regression model. Experimental results show that GS-PQM outperforms 25 existing image, video, and point-cloud quality metrics in assessing compressed GS content, providing an accurate and computationally efficient alternative to rendering-based quality assessment.

[175] Diffusion Editing with Soft Mask: Pixel Level Redo of Image and Video with Adjustable Strength cs.GR | cs.AI | cs.CV | cs.MMPDF

Candi Zheng, Yuan Lan

TL;DR: SoftPaint用梯度免费的朗之万采样器按像素软掩码控制图像或视频扩散编辑强度，从局部保留原内容到完全重绘连续可调。

Details

Motivation: 提示和参考图像引导编辑通常难以像素级控制；学习精细软掩码需要昂贵逐像素标注，现有零样本方法也常难得到满意结果。

Result: 采样器尊重每个像素的软掩码强度，适用于不同图像和视频扩散骨干，可用于视频编辑。作者报告方法梯度免费、内存高效，并在多个骨干上实现平滑像素级编辑；摘要未提供量化比较。

Insight: 软掩码把编辑控制从二值“改或不改”扩展为连续强度，且零样本采样可避免精细标注训练成本。

Abstract: Diffusion models with prompt and reference image-guided editing have seen rapid progress, yet they remain too coarse for pixel-level control. One promising direction is to incorporate a soft mask that specifies spatially varying edit strengths but training such fine-grained control demands expensive pixel-wise annotations, while existing zero-shot methods often yield unsatisfactory results. We introduce SoftPaint, a new zero-shot sampling method that leverages soft masks to enable a continuous spectrum of edits, from fully preserving the original content to completely re-synthesizing the masked region. Going beyond zero-shot inpainting methods, we design a Langevin-iteration-based sampler that respects per-pixel soft mask strengths, which applies universally to image and video diffusion models, enabling tasks such as video editing. The method is gradient-free, memory-efficient, and achieves smooth, pixel-level edits across multiple image and video backbones.

cs.HC [Back]

[176] Faithful Chart Generation for Multimodal Deep Research: Frame-Evidence Co-Adaptation cs.HC | cs.AI | cs.CL | cs.GRPDF

Yuxin Yue, Yingchen Zhang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke

TL;DR: FECA把图表视觉规划与网络证据检索交替耦合，使每个图表框架根据实际可检索证据接受、修改或放弃。

Details

Motivation: 多模态深度研究图表中的每个数值都须忠实于来源证据，但固定规划往往先决定实体、时间段和比较维度，之后才发现网页证据无法完整支撑。

Result: 借鉴数据框架理论，FECA让视觉框架指导证据获取，同时由检索证据决定是否保留框架，而非只在固定图表完成后做核验。100个真实研究主题实验显示，方法明显提高数值忠实度，同时保持报告质量和图表效用。

Insight: 证据可用性应参与图表规划，而不是只作为成品审查条件；循环修改有助于避免为满足预设图表而填入无根据数字。

Abstract: Analytical charts in multimodal deep research encode quantitative claims, requiring every visualized value to be faithfully grounded in supporting evidence. Unlike retrieved images that mainly provide contextual information, charts require numerical fidelity: visualized values should not only match retrieved evidence quantitatively but also preserve its original meaning and scope. However, achieving such fidelity remains challenging because current systems usually construct visualization plans before knowing what quantitative evidence can actually be retrieved from the web. As a result, predefined plans may require entities, temporal ranges, or comparison dimensions that the retrieved evidence only partially supports. Existing approaches mainly address this issue through post-hoc verification after chart plans are fixed, enabling unsupported values to be identified but leaving the underlying visual frames unchanged. To address this challenge, we propose Frame-Evidence Co-Adaptation (FECA), an evidence-adaptive visual planning framework for multimodal deep research. Inspired by the bidirectional sensemaking process in Data-Frame Theory, FECA models chart generation as an iterative interaction between visual frames and retrieved evidence. Each visual frame is adaptive: the frame guides evidence acquisition, while retrieved evidence determines whether the frame should be accepted, revised, or dropped before rendering. By coupling visualization planning with evidence availability, FECA shifts chart generation from fixed-plan verification to adaptive evidence-grounded visual reasoning. Experiments on 100 real-world research topics show that FECA substantially improves numerical fidelity while preserving report quality and chart utility.

cs.IR [Back]

[177] On-Device Commercial Intent Retrieval Under Size, Latency, and Privacy Constraints: A 3 MiB Retrieval System with Typed Egress Boundaries cs.IR | cs.CLPDF

Hyojung Han

TL;DR: 研究实现完全端侧的商业意图检索系统，在小于3MiB、P95低于20毫秒和不外传原文等约束下覆盖6,020类商业意图。

Details

Motivation: 个性化商业意图识别可能涉及敏感文本，需在隐私保护、低延迟和小下载包约束下运行，同时保留细粒度分类能力。

Result: 系统将韩语句向量模型蒸馏为4位静态嵌入表，不需推理运行时。22,900条他人标注真实韩语评论上，含叶类名称子串的查询mid-category top-5为83.5%，不含者为45.2%，总体75.0%，置换基线18.4%。最终载荷2,942,652字节；两部iPhone P95为4.431和3.670毫秒，低端安卓平板5.080毫秒。设备端拒答最低置信五分之一后，其余准确率升至0.8296。

Insight: 约束代价并不均匀，是否含类别词面锚点显著影响检索难度；设备端置信度可识别高风险查询。大部分监督为合成韩语，结果不证明真实用户覆盖或医疗类隐私系统效能。

Abstract: We study commercial intent inference that runs entirely on the user’s device, under three constraints frozen before the work began: the downloaded payload under 3 MiB, Tier-0 inference under 20 ms at p95, and no raw text, content embedding, or stable identifier leaving the device. Under them we build a retrieval path over a 6,020-leaf commercial taxonomy: a static embedding table distilled from a Korean sentence transformer, quantized to 4 bits, no inference runtime. Our main result is where that constraint costs accuracy. On real Korean commerce text labelled by others (22,900 AI-Hub shopping reviews), mid-category top-5 on real product names is 75.0% against an 18.4% permutation baseline, but splits on one observable: a query containing some leaf name as a substring scores 83.5%, one containing none 45.2%. A generic 196.6x larger teacher seemed to localize the gap (+20.1 pp without an anchor, +0.1 with). That null was two effects cancelling: the same teacher fine-tuned on the student’s own contrastive pairs reaches 0.8586 and beats the pure-encoder student by +10.6 pp with an anchor and +20.9 pp without. The cost is not uniform, but it is not free anywhere; where the anchor is absent, task adaptation buys the teacher nothing, so what the constrained encoder lacks there is capacity. The expensive regime is detectable on-device from the ranker’s own score margin: declining the least confident fifth lifts the rest to 0.8296. A second axis we first reported, a manufacturer model code, does not survive source-category fixed effects (-4.0 pp, p=0.51); the anchor does (+13.0 pp). Payload is 2,942,652 bytes, all three library links measured. Tier-0 p95 is 4.431 and 3.670 ms on two iPhones (A14, A16) and 5.080 ms on a budget Android tablet (Snapdragon 695), all slower than three server CPUs on the same code. Taxonomy supervision is mostly synthetic Korean utterances.

[178] RPTune: Learned Context Curation for LLM Catalog Search cs.IR | cs.CL | cs.LGPDF

Chuxuan Hu, Hejie Cui, Norman Huang, Shubham Kumar Bharti, Wang-Chiew Tan

TL;DR: RPTune联合学习商品目录排序与剪枝及LLM产品选择后训练，面向可放入长上下文的小商户目录检索。

Details

Motivation: 小商户完整目录可直接放入LLM上下文，无需为大型市场设计多阶段检索；但模型不能均匀利用长上下文，目录组织方式和产品选择能力都需要适配。

Result: 编码器重排器根据下游LLM反馈整理和裁剪商品，整理后的目录再通过上下文相对奖励改进后训练。在七家不同零售领域商户、每家100个复杂对话查询上，RPTune对专有和开源模型均持续提升搜索准确率；上下文整理最高增加31.4个百分点，后训练再平均增加10.3点。

Insight: 目录检索质量不只取决于LLM能力，也取决于上下文中商品的组织和暴露方式；两者联合优化可相互增强。实验覆盖七家商户，具体增益随商户和模型变化。

Abstract: For small merchant businesses (SMBs) whose catalogs fit within a long-context LLM, full-catalog prompting offers a compelling alternative to multi-stage retrieval designed primarily for large marketplaces with millions of items. However, fitting the full catalog into the context window does not ensure that the model can use it effectively, since LLMs do not exploit long contexts uniformly. We therefore study in-context catalog search through two complementary questions: (1) how to curate and present catalogs to the LLM, and (2) how to adapt the LLM for product selection on curated contexts. We propose RPTune, an end-to-end framework that couples learned catalog curation with LLM post-training using automatically generated, catalog-grounded supervision. An encoder-reorganizer curator orders and prunes products guided by downstream LLM feedback, while the resulting curated catalogs in turn improve the effectiveness of LLM post-training with a context-relative reward. We evaluate RPTune on 7 real merchants spanning distinct retail verticals, using 100 complex conversational queries per merchant. RPTune consistently improves search accuracy across both proprietary and open-weight LLMs, with context curation yielding gains of up to 31.4 percentage points and post-training adding a further 10.3 points on average.

cs.LG [Back]

[179] Integrating Fairness and Explainability in a Multiple Instance Reinforcement Learning System cs.LG | cs.CLPDF

Bente Hinkenhuis, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansoor Alsahag

TL;DR: 研究将强化学习多实例学习、对抗去偏和偏好条件超网络结合，用于学生风险预测，并检验用户偏好能否连续控制公平—性能取舍。

Details

Motivation: 教育交互数据可用于提前识别有辍学或低表现风险的学生，但人口属性可能导致不公平预测，模型还需足够透明以支持干预。

Result: 强化学习代理从每名学生的弱标注交互集合中选取信息性实例；两种超网络尝试用偏好标量控制准确率与Equalized Odds。基础RL-MIL分类效果较强，但超网络出现模式坍塌，改变偏好权重无法系统移动公平—性能前沿，原因包括目标支配、梯度传递弱及动态参数交互。

Insight: 在模型中加入公平目标并不自动让用户可控地调节权衡；偏好条件机制必须验证是否真正产生连续可预测的前沿移动。研究强调公平控制需要梯度平衡、目标分离和稳定性分析。

Abstract: Predicting student performance from educational interaction data requires models that are both accurate and sufficiently transparent to support meaningful intervention, while demographic information introduces an additional risk of unfair predictions. This study investigates a multi-objective framework that combines reinforcement learning-based multiple instance learning (RL-MIL), adversarial debiasing, and preference-conditioned hypernetworks for student-at-risk prediction. MIL represents each student as a bag of weakly labeled interactions, while an RL agent selects informative instances for downstream classification. Two hypernetwork variants are evaluated to determine whether a user-defined preference scalar can continuously control the trade-off between predictive performance and Equalized Odds. The underlying RL-MIL baseline achieves strong classification performance, but both hypernetwork extensions exhibit mode collapse: changing the preference weight produces little systematic movement along the intended fairness-performance frontier. The failure is associated with objective dominance, weak gradient propagation through the conditioning mechanism, and interactions between dynamically generated parameters. The results show that fairness objectives can be incorporated into an interpretable RL-MIL pipeline, but preference conditioning alone does not guarantee controllable multi-objective behavior. Robust fair RL-MIL therefore requires explicit mechanisms for gradient balancing, objective separation, and stability analysis.

[180] Make Sparse Rewards Count: Density-Aware Reward Aggregation for Multi-Reward RL cs.LG | cs.CLPDF

Tong Zheng, Skylar Zhai, Zhan Cheng, TianMing Sha, Youling Huang

TL;DR: DARA按每种奖励在当前批次中产生有效相对优势的密度进行逆平方根校准，平衡多目标强化学习中的信号贡献。

Details

Motivation: 多奖励RL通过奖励归一化保留各目标组内相对信息，但不同奖励的学习进度仍不均衡，稀疏激活目标可能被批次层面的信号失衡压低。

Result: 理论分析表明，在理想GDPO归一化下，优势能量与活跃组密度成正比。DARA据此按批次动态调整奖励权重，不改变底层策略目标。在工具调用和数学推理任务中，格式合规可比GDPO快最多26%训练步达到，数学长度合规快最多65%，最终表现仍具竞争力。

Insight: 奖励是否提供有效差异化信号的频率，会影响其在批次更新中的实际权重。动态密度校正让训练适配不同目标的活跃程度，而无需修改策略优化算法。

Abstract: Multi-reward reinforcement learning trains large language models to satisfy multiple behavioral objectives simultaneously. Reward-wise normalization, as used in GDPO, preserves reward-specific relative information within rollout groups, but different objectives can still exhibit uneven learning progress. We study this behavior through advantage energy, the sum of a reward’s squared advantages over a batch. Under idealized GDPO normalization, we show that this energy is proportional to active-group density: the fraction of rollout groups in which the reward provides nonzero relative advantages. This reveals a residual batch-level signal imbalance and provides a basis for calibrating reward contributions. Based on this relation, we propose Density-Aware Reward Aggregation (DARA). We derive an inverse-square-root density correction that gives greater weight to signals from less frequently active rewards. DARA computes its weights from each rollout batch, adapting to changes in reward activity throughout training without modifying the underlying policy optimization objective. Experiments on tool calling and mathematical reasoning show that DARA learns the targeted behaviors faster than GDPO, reaching high format compliance in up to 26% fewer training steps on tool calling and near-saturated length compliance in up to 65% fewer steps on mathematical reasoning, while remaining competitive in final performance. Our code is available at https://github.com/zhaihaotian/DARA.

[181] Beyond Linear Concepts: Discovering and Aligning Non-Linear Concept Manifolds in Large Language Models cs.LG | cs.CLPDF

Tido Specht, Elias Benedict Krey, Nils Neukirch, Nils Strodthoff

TL;DR: 研究把LLM词元激活中的概念表示为低维非线性流形，并以概念几何对齐指标比较层间、模型间和训练阶段变化。

Details

Motivation: 机制可解释性方法通常假设概念沿线性方向编码，但内部特征可能位于非线性流形，线性投影因而难揭示模型真实组织结构。

Result: 方法把非线性多维概念发现迁移到LLM激活，并提出概念对齐CBA广义Rand指标。分析发现中后层存在跨模型的块结构，概念组合从语法主导转为语义—语法混合；英汉共享依赖训练（Qwen最强、Llama较弱、GPT-2未见），同家族不同规模对齐较强、跨家族较弱。SFT阶段概念变化最大，后续偏好对齐对早层影响小，RLVR多保留DPO晚层概念。

Insight: 非线性几何可揭示线性方法遮蔽的层间概念组织和跨语言差异；训练阶段对概念流形的影响并不均匀。CBA强调几何接近，不要求显式特征一一匹配。

Abstract: Understanding information processing in large language models (LLMs) requires dissecting the geometric organization of their internal token representations. While existing mechanistic interpretability (MI) methods seek to extract concepts, they are constrained by a strong linearity assumption challenged by evidence of non-linear feature manifolds. We move beyond linear concepts by adapting Non-Linear Multi-Dimensional Concept Discovery (NLMCD) from computer vision to token-level LLM activations, modeling concepts as low-dimensional manifolds. To compare concept manifolds across layers and models, we introduce a concept-based alignment (CBA) score, a generalized Rand index that measures geometric proximity without explicit feature matching. Our analysis yields six key findings: (i) a neighboring-layer sanity check shows CBA is more sensitive than PCA- or CKA-based linear baselines; (ii) layer-by-layer alignment matrices reveal two block structures in intermediate and late layers, consistent across models and obscured by linear metrics; (iii) concept composition remains syntax-dominated through most of the network before giving way to increasingly mixed syntactic-semantic concepts in later layers, with increasing output-orientation toward the final layers; (iv) multilingual concept sharing between English and Mandarin is training-dependent rather than universal, strongest in Qwen, weaker in Llama, and absent in GPT-2; (v) inter-model alignment mirrors this structure, with strong correspondence between same-family Qwen models of different scale but weak alignment across model families; and (vi) across Tulu-3 training stages, alignment is highest between adjacent stages, with the largest shift between the base model and SFT, while subsequent preference-alignment stages (DPO, RLVR) leave early layers largely unchanged and RLVR mostly preserves DPO’s concepts in late layers.

[182] Latent JEPA: Abstract Future Prediction for Latent Reasoning in Chemistry cs.LG | cs.CLPDF

Xinjian Zhao, Yaoyao Xu, Xuemin Chen, Xiaozhuang Song, Tianshu Yu

TL;DR: Latent JEPA让语言模型在潜空间预测未来推理视图和分子结果，将连续潜在思考与化学结构及后续解题过程关联。

Details

Motivation: 化学直觉可在完整推导前形成对合理结果的预期，显式CoT却需逐步说出中间过程；需要研究连续潜在推理能否预见有用的科学结果信息。

Result: 框架结合自回归学习和联合嵌入未来预测，为化学推理设计文本与分子两类预测目标。在ChemCoTBench上，方法改善分子优化以及多个编辑和反应指标；表征分析显示未来预测让潜在思考更能表示分子结果，并增强与化学结构的对应。摘要未给出数值。

Insight: 潜在状态可以通过预测科学输出和后续推理来学习，而不必把所有中间思考语言化。化学结构目标使潜变量与领域结果建立可分析联系。

Abstract: Large language models offer a promising foundation for chemical reasoning, bringing together chemical knowledge and multistep problem solving. Chemical intuition can provide an initial sense of plausible outcomes before the details of a solution are fully worked out. Inspired by how such expectations complement explicit analysis, we study how continuous latent thoughts can be trained to anticipate informative aspects of future solutions without verbalizing every intermediate step. We introduce Latent JEPA, a framework that combines autoregressive learning with joint-embedding prediction of one or more future views. For chemical reasoning, we develop textual and molecular prediction objectives that connect latent thoughts to both subsequent reasoning and molecular outcomes. Experiments on ChemCoTBench show gains in molecular optimization and on several editing and reaction metrics. Representation analyses show that future prediction makes latent thoughts more informative about molecular outcomes and strengthens their correspondence with chemical structure. These findings support abstract future prediction as a learning principle for connecting continuous latent reasoning with scientific outcomes.

[183] CARM: Cancellation-Aware Response Masking for LLM Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Yafei Zhang, Songshuo Lu, Sicong Liao, Zhi Chen, Yaohua Tang

TL;DR: CARM对每个词元的采样—训练对数概率比取绝对值后再聚合，避免正负策略漂移互相抵消而误接收离策略回复。

Details

Motivation: 实际RL训练中策略更新及采样、训练引擎差异会使回复离策略；常用几何平均掩码将带符号对数比平均，可能隐藏同时存在的大幅正向和反向漂移。

Result: CARM使用逐词元绝对对数比构造回复级掩码，并证明被接收回复满足策略外偏差比例及平均越界距离的联合界。数学推理中，AIME 2024/25/26与BeyondAIME平均mean@16最高比几何平均掩码高3.13个百分点；四个代码基准平均pass@1比最强对照高2.88点。

Insight: 策略漂移方向相反不代表样本接近当前策略，取绝对值可防止抵消掩盖偏差。理论保证和数学、代码实验共同支持其用于回复级离策略控制。

Abstract: Recent years have witnessed the rapid adoption of reinforcement learning (RL) in large language model (LLM) post-training, with substantial gains in mathematical reasoning and code generation. In practical systems, however, policy updates and differences between rollout and training engines can make sampled responses off-policy. Sequence-level masking addresses this mismatch by deciding whether an entire response should contribute to optimization. A common masking rule uses the length-normalized geometric mean of sampled token probability ratios. Its signed log-ratios can cancel across positions, concealing substantial bidirectional policy drift. We propose \emph{Cancellation-Aware Response Masking} (CARM), a sequence-level mask that takes the absolute value of each token log-ratio before averaging, preventing opposing probability changes from canceling. We prove that accepted responses satisfy a joint bound on the fraction of sampled-token ratios outside a prescribed band and their mean log-distance beyond its boundaries. Experiments on mathematical reasoning and code generation show that CARM improves mean@16 averaged over AIME 2024/2025/2026 and BeyondAIME by up to $3.13$ percentage points over geometric-mean masking, and increases average pass@1 across four code benchmarks by $2.88$ points over the strongest evaluated baseline. These findings support CARM as a theoretically grounded and effective method for response-level off-policy control in LLM reinforcement learning.

[184] Uncertainty-Aware RL-Controlled Adaptive 3D Mapping cs.LG | cs.CV | cs.GR | eess.IVPDF

Alpay Ozkan, Tunc Ozan Aydin, Marc Pollefeys, Jelena Trisovic, Daniel Barath

TL;DR: 该框架按标签不确定性、几何曲率和纹理复杂度细分体素，并用强化学习在用户指定内存预算下学习分辨率分配策略。

Details

Motivation: 固定分辨率体素网格在均匀区域浪费内存、在复杂区域丢失细节；依赖几何和手工语义阈值的自适应方法需要专家调参，难泛化到未见对象，也缺少显式内存控制。

Result: 方法将语义熵、曲率和纹理丰富度作为细化线索，以强化学习代理在目标内存预算下学习体素细分策略。多分辨率TSDF在合成和真实数据上较MAP-ADAPT及固定网格取得更高几何精度、更好语义一致性和更优内存—准确率折中；摘要未给出具体数值。

Insight: 自适应地图可把语义不确定性与几何、纹理复杂度共同转成资源分配信号，预算由一个用户目标直接控制，而非手工规则列表。

Abstract: Voxel-based volumetric mapping is fundamental to 3D reconstruction, yet fixed-resolution grids remain inherently inefficient - wasting memory in uniform regions and losing detail in complex ones. Existing adaptive methods, such as MAP-ADAPT, partially address this by varying resolution based on geometry and user-defined semantic class lists, but these heuristics require expert tuning, lack generalization to unseen objects, and provide no explicit mechanism to control memory usage. We propose an adaptive framework that refines voxels based on semantic entropy, which captures label uncertainty, together with geometric curvature and texture richness as scene complexity cues, yielding principled resolution allocation without reliance on semantic taxonomies. To make the accuracy-memory trade-off explicit and user-controlled, we further introduce a reinforcement learning agent that learns voxel subdivision policies under a user-specified target memory budget, replacing hand-tuned thresholds with a single intuitive control parameter. The resulting multi-resolution TSDF achieves higher geometric accuracy, better semantic consistency, and improved memory-accuracy trade-offs compared to MAP-ADAPT and fixed-resolution baselines on both synthetic and real-world datasets. Our code and models are available at https://github.com/alpayozkan/UnRL.

[185] Finetuning with Sampling: SFT Learns Better Than You Think cs.LG | cs.AI | cs.CLPDF

Aayush Karan, Sitan Chen, Yilun Du

TL;DR: 该工作用MCMC逐步把离线专家轨迹变换成更符合待微调模型分布的样本，使监督微调兼具专家信息和在线学习数据分布优势。

Details

Motivation: 后训练常认为RL更能泛化且不易遗忘，而SFT虽可使用离线专家数据，却可能泛化弱、灾难性遗忘；RL又必须靠反复采样找到成功轨迹。

Result: 作者不修改训练目标，而设计相对参考模型的MCMC采样算法，逐步将离策略轨迹转换为更接近模型当前分布的样本。在科学技能、数学推理和开放领域专长任务上，采样式SFT可匹配主流后训练方法，常比强在线基线泛化更好、遗忘更少，并能超越单纯锐化基础模型分布。

Insight: 数据分布可作为学习算法的一部分调整，让SFT获得更贴近自身模型轨迹的监督，而无需更换损失函数。采样因此可成为通用后训练原语。

Abstract: Introducing new capabilities to frontier models has long been the goal of posttraining, which predominantly employs supervised finetuning (SFT) and reinforcement learning (RL) to this end. Conventional wisdom dictates that RL enables strong generalization on new tasks without losing existing capabilities, while SFT is prone to weak generalization and catastrophic forgetting. At the same time, SFT can learn from off-policy expert data, whereas RL must rely on a model’s ability to find successful trajectories with repeated sampling. In our work, we seek to leverage the strength of on-policy learning while utilizing the privileged information contained in off-policy data. However, rather than modifying the learning objective to accommodate this data, we instead tailor the data distribution to better suit the learner. We introduce a Markov chain Monte Carlo (MCMC) sampling algorithm that progressively transforms off-policy traces to be more on-policy given a reference model for finetuning. Across tasks like scientific skill acquisition, mathematical reasoning, and open-ended expertise, our sampling algorithm enables SFT to rival prevailing posttraining techniques, often generalizing better and forgetting less than strong on-policy baselines. In addition, the resulting finetuned models exhibit strong distributional performance and are capable of learning beyond sharpening the base model distribution. At a higher level, our approach presents sampling as a model-native operator that shapes data for learnability, offering broader utility as a general-purpose primitive throughout the posttraining stack.

[186] Every Ablation Is a Dose: Counterweights and the Semblance of Self-Repair cs.LG | cs.CLPDF

Areeb Ahmad, Pratinav Seth, Vinay Kumar Sankarapu

TL;DR: 论文将组件消融视为强度可校准的反事实干预，提出模型中看似自修复的响应可能来自原有反向权重而非干预后新机制。

Details

Motivation: 消融后其他组件有时会补偿被移除信号，但自修复机制一直不明确；传统消融强度未经校准，难区分干预诱发反应与组件原本就执行的作用。

Result: 作者将干预写为对比强度λ，并发现细粒度单元的响应满足仿射关系E_r(λ)=own_r+γ_rλ，γ的符号决定单元抵消还是强化被移信号。四个家族模型的事实判断任务中，81个下游方向有68个符合关系，涵盖MLP神经元、OV神经元和奇异方向；GPT-2 Small的IOI回路中可达10个头有7个符合且均为反向权重。γ大小还能由固定权重预测。

Insight: 所谓自修复可能是原有反向权重在干预后显露，而非模型新产生补偿机制。把干预幅度当作连续剂量扫描有助于区分两种解释。

Abstract: Ablate a component of a language model, and other components often appear to adjust and compensate. This phenomenon, termed self-repair, has been observed repeatedly, but its mechanism remains unclear. The most systematic study to date concluded that self-repair is noisy and unlikely to have a single explanation. We argue that it has one: a gain already present before any ablation. Any intervention on a causally important component can be viewed as a point on a coordinate axis $λ$, the signed strength of a counterfactual contrast. Hence, conventional ablation methods are uncalibrated points on this axis. We show that the causal repair response for a fine-grained unit $r$ is governed by an affine law, $E_r(λ)=\mathrm{own}_r+γ_rλ$. The slope $γ_r$ is a fixed coefficient that consistently influences the model, with or without ablation, and its sign determines whether the unit counteracts or reinforces the removed signal. On a factual-verdict task across four models from distinct families (Gemma, Qwen, LLaMA, and Mistral), we identify components including MLP neurons, OV neurons, and singular directions that follow this affine law, 68 of 81 downstream directions in all. Moreover, we can anticipate the magnitude of $γ_r$ from the fixed weights. On the IOI circuit of GPT-2 Small, seven of the ten heads the intervention can reach follow the law, and all seven are counterweights. From this perspective, what may appear as self-repair is a counterweight performing its usual operation when the contrastive signal emerges at the core.

[187] Manifold-Constrained Initial Noise Optimization for Efficient Generative Model Alignment cs.LG | cs.AI | cs.CVPDF

Jinho Chang, Jong Chul Ye

TL;DR: ZeNOVA用退火软价值、受流形约束的超球面Langevin动力学和Metropolis-Hastings跳转，无梯度地优化生成模型初始噪声。

Details

Motivation: 单步或少步生成让直接优化高斯初始噪声成为奖励对齐手段，但现有方法多依赖梯度，在黑盒奖励下不可用或不稳定低效。

Result: ZeNOVA在图像与视频生成模型上将初始噪声稳定引向更高奖励，较评估的零阶优化基线表现更好，并利用高斯先验的几何结构提升稳定性。摘要未提供具体奖励或生成质量指标。

Insight: 初始噪声并非普通欧氏参数，尊重其概率流形几何有助于黑盒搜索。退火价值指导配合接受率跳转，缓解零阶优化易不稳定的问题。

Abstract: Recent advances in distillation and flow-map models have enabled deterministic one- or few-step generation for high-quality data, facilitating a new branch of reward alignment approaches that directly optimize the initial noise from a Gaussian distribution. However, most existing initial-noise optimization methods rely on first-order gradient information, which is either inapplicable or suffers from instability and inefficiency in black-box reward scenarios. Here, we introduce ZeNOVA, a stable and efficient initial noise alignment method in a gradient-free manner. Specifically, we address existing algorithms’ major challenge in black-box scenarios through annealed soft-value guidance, manifold-constrained hyperspherical Langevin dynamics, and Metropolis-Hastings jumping. Extensive experiments on image and video generative models show that ZeNOVA outperforms all evaluated zeroth-order baselines by optimizing the initial noise toward higher rewards substantially more stably while exploiting the geometry of the Gaussian prior, demonstrating its practical applicability to various black-box reward alignment.

[188] Curvature Under Attack in hZACH-ViT: Gauge Symmetry, Boundary Saturation, and Adversarial Failure cs.LG | cs.CVPDF

Athanasios Angelakis, Marta Gomez-Barrero

TL;DR: 研究分析超曲率表示的对抗鲁棒性如何受尺度、logit温度和边界裁剪共同影响，警示不能把固定曲率结果称为内在鲁棒性。

Details

Motivation: 曲率常被当作表示的内在属性，但实际效果也取决于坐标尺度、学习到的logit温度和数值保护机制；不同配置下准确率与攻击表现可能冲突。

Result: 在三个MedMNIST数据集、五个随机种子中，固定曲率1时Poincare头在12种数据—预算组合及更强攻击下攻击成功率最低，但干净MacroF1也最低。将曲率降至0.1后，15组种子—数据配对干净MacroF1全部提高，却使OrganAMNIST强攻击成功率由89.7%升至99.3%。曲率1时40%—47%干净特征硬裁剪，径向Jacobian近零；球面头曲率变化则近似精确尺度规范变换。

Insight: 表面鲁棒性可能来自实现尺度和边界饱和，而非几何本身。比较不同曲率时需控制坐标、裁剪和攻击效率，不能只报告一个固定参数设置。

Abstract: Curvature is often treated as an intrinsic property of a representation, although its empirical effect also depends on coordinate scale, learned logit temperature, and numerical safeguards. We study this interaction in hZACH-ViT, a compact Vision Transformer with Euclidean, Poincare, and spherical prototype heads. The backbone architecture, seed-specific initialization, 50-per-class training subset, and optimization protocol are matched across three MedMNIST datasets and five seeds. At the fixed comparison curvature $c=1$, Poincare has the lowest class-macro PGD attack-success rate in all 12 dataset-budget cells and under a stronger CE+DLR multi-restart attack on all three datasets, but it also has the lowest clean MacroF1. An end-to-end curvature intervention changes the interpretation. Reducing Poincare curvature to $c=0.1$ improves clean MacroF1 in every one of the 15 paired seed-dataset comparisons and removes hard boundary clipping, yet on OrganAMNIST it increases strong attack success from $89.7%$ to $99.3%$ (paired difference $+9.57$ points; 95% hierarchical bootstrap CI $[+5.52,+14.03]$). At $c=1$, $40$-$47%$ of clean Poincare features are hard-clipped, the radial Jacobian of the inherited map is nearly zero, and dimensionless attack trajectories are unusually long and inefficient. The spherical head provides a control: its curvature change is an exact scale gauge to floating-point precision and produces much smaller attack differences. These results do not establish intrinsic hyperbolic robustness. They identify an implementation-sensitive regime in which curvature, scale, and proximity to the Poincare boundary jointly organize clean recognition and adversarial representation motion.

[189] Signal-Noise Factorization Isolates Nuisance Variation into Removable Subspaces cs.LG | cs.CV | stat.MLPDF

Sakin Kirti, Joel Zylberberg

TL;DR: 研究通过训练正则强化信号—噪声因子分解，发现将干扰变化隔离到独立表示子空间可改善视觉分类，并支持测试时投影移除噪声。

Details

Motivation: 表示几何影响网络推理能力，信号—噪声分离和任务相关—无关信号分离可能改善鲁棒性，但这两种结构化目标的实际作用需比较。

Result: 在CIFAR-100上，增强信号—噪声分解的正则提高表现，而增强信号—信号分解未改善。BloodMNIST叠加MedMNIST-C五种严重度后，信号—噪声正则带来更大收益；其模型将噪声编码到与类别信号分离的子空间，利用留出数据估计主导扰动方向并投影移除后准确率明显提高。

Insight: 对分布外图像扰动，隔离无关噪声比进一步分解类别信号更关键。显式表示子空间结构还能支持训练后诊断并投影消除主要干扰方向。

Abstract: Recent theoretical work identified fundamental properties of representation geometry that shape inference ability of deep neural networks. These include signal-noise factorization (SNF), the ability to segregate signal from noise, and signal-signal factorization (SSF), the ability to segregate task-specific and task-irrelevant signals. Here, we built regularizers that reinforce these two properties during training. We compared networks trained with these regularizers to $L_2$-regularized baseline networks on the CIFAR-100 classification task to understand how our regularizers shape representation geometry and impact performance on a well-known computer vision baseline. Enhancing SNF via regularization improved model performance but enhancing SSF did not. Motivated by biomedical applications, we investigated how our regularizers affected performance on the BloodMNIST dataset treated with MedMNIST-C corruptions at five severity levels, and found even larger performance gains using the SNF regularizer. To understand the mechanism by which SNF-regularization produces improved performance, we analyzed the nuisance subspaces across regularization regimes, finding that the SNF-regularized models represent noise in distinct subspaces, separate from class-relevant signal. Because this geometry is explicit, the dominant corruption-induced directions can be estimated on held-out data and projected out of the representations. This manipulation led to a substantial gain in accuracy. These results show that regularizers that enforce signal-noise factorization can produce substantial improvements on computer vision tasks that contain out-of-distribution image distortions at inference time. They also highlight how shaping representations affects model performance: isolating nuisance variables from categorical ones is more important than maintaining factorized representations of categorical variables.

[190] Two Routes to the Middle: Placement Search and Brain Readouts Converge on Where Continual Learners Should Specialize cs.LG | cs.CVPDF

Yuan Huang, Zihan Chen, Runbin Zhang, Hongwei Ding, Changzeng Fu

TL;DR: LS-B用冻结人类视觉皮层fMRI编码器读出不同任务的视觉表征变化，并据此选择持续学习适配器放置层，而无需标签或反向传播。

Details

Motivation: 每个Transformer块都放任务适配器会使存储随任务数线性增长，只选少数块可减小开销，但最合适深度难以从廉价权重或激活指标判断。

Result: 连续四层适配器搜索呈倒U曲线，中间层准确率最高且位置间最多相差3.5个百分点，而常用指标偏向最深层。LS-B用12个视觉皮层区域的冻结fMRI读出一次性选择块；在AugReg和iBOT上选择位置与搜索所得中间层重合。Split ImageNet-R上仅用完整BiLoRA存储的60%，准确率距其最终值不超过1.5点；无标签、无反传，运行开销低于0.6%。

Insight: 外部脑读出可以在不训练搜索器的情况下指导模型的层专门化，且与算法搜索结果在深度上趋同。最佳分配具骨干特异性，不能假设所有ViT选同一层。

Abstract: Continual learners that keep a task-specific adapter in every block of a pre-trained vision transformer accumulate storage linearly with the number of tasks; keeping task-specific adapters in only a few blocks curbs this growth but raises the question of where to place them. We investigate this question from two perspectives. Algorithmically, training all contiguous four-block placements yields an inverted U: final accuracy peaks at intermediate depth and varies by up to 3.5 percentage points (pp), while inexpensive criteria based on weight spectra or activation statistics favor the deepest blocks. From neuroscience, the hierarchical organization and intermediate-stage plasticity of the visual cortex motivate us to ask whether a measurement taken outside the learner can guide layer specialization without placement search. LS-B observes the first tasks through a frozen fMRI encoding model of twelve human visual areas and commits task-specific capacity once to the blocks whose readouts vary most across tasks relative to their stable structure. Across three ViT-B/16 backbones, LS-B yields stable, backbone-specific allocations. On the two backbones with placement search, AugReg and iBOT, the selected blocks overlap the intermediate-depth region identified by search. Under matched storage and observation budgets, the selected blocks outperform the shallowest and deepest four-block configurations. On Split ImageNet-R, LS-B uses 60% of full-BiLoRA adapter storage while remaining within 1.5 pp of its final accuracy. The allocation requires no labels or backpropagation, adds under 0.6% runtime, and exhibits backbone-specific cortical signatures.

[191] SIEVE: Selective attention-value Suppression for Vision-Language Models Unlearning cs.LG | cs.CVPDF

Si Qi Goh, Cap Dang Xuan Kiet, Tat-Jen Cham, Kwok-Yan Lam

TL;DR: SIEVE在注意力值表示层选择性压制需遗忘样本，同时将保留样本表示匹配冻结参考模型，实现多模态模型的个人信息定向遗忘。

Details

Motivation: VLM可能将人物视觉身份与传记信息关联，用户需删除敏感信息但保留关于同一人的允许知识；两类信息共享视觉输入和中间表征，难以只忘特定内容。

Result: 对遗忘样本将注意力值压向零，对保留样本以冻结参考模型表示为目标，并结合序列级遗忘和保留监督。多种模型和模态设置实验中，SIEVE在遗忘性能上达到当前最佳且保留效用具竞争力；消融显示值抑制和负交叉熵提供互补遗忘信号，参考值匹配减少效用退化。

Insight: 注意力值表示提供可操作干预点，可在共享视觉线索下区分需忘与需留内容。选择性遗忘需同时测量目标删除和保留效用。

Abstract: The ability of vision-language models (VLMs) to associate visual identities with biographical information creates a need for selective unlearning of personally identifiable information (PII) while preserving permitted knowledge about the same individual. This setting is challenging because both sensitive and retained information can share the same visual inputs and intermediate representations. We introduce SIEVE, a simple and effective framework for selective VLM unlearning. SIEVE directly regularizes attention-value representations while also controlling model outputs. SIEVE suppresses attention values for forget examples toward a constant zero, while preserving retain-example representations by matching them to a frozen reference model. These objectives are combined with sequence-level forget and retain supervision, enabling targeted forgetting without largely affecting retained knowledge. Extensive experiments show that SIEVE achieves state-of-the-art performance on unlearning with multiple model-modality settings, while maintaining competitive retained utility. Ablation studies further show that value suppression and negative cross-entropy contribute complementary forgetting signals, while reference-based value matching substantially reduces utility degradation. These results demonstrate that attention values provide an effective intervention point for selective multimodal unlearning when sensitive and retained knowledge are closely related.

cs.RO [Back]

[192] DriftOPD: Sequence-Level Reverse-KL Distillation for One-Step VLA Policies cs.RO | cs.AI | cs.CV | cs.LGPDF

Youngjun Jun, Kyumin Choi, Youngmin Kim, Seonghyun Jin, Sunwoo Park

TL;DR: DriftOPD将连续动作专家的序列级反向KL拆成块级匹配和未来潜势两项，用离线Q函数在单步动作下蒸馏长程行为。

Details

Motivation: VLA动作专家常按短动作块训练，缺少长程任务成功目标；序列级RL可补足，但需真实机器人闭环rollout，成本高。

Result: DriftOPD无需单独教师或在线交互，用一步漂移目标优化块级反向KL，用离线演示学习Q评论家估计当前动作的长期影响。在多种架构的仿真和真实操作中，它通常优于已有单步蒸馏基线，任务成功表现可比多步教师策略。

Insight: 序列级目标可通过分解为局部动作匹配与未来价值项，蒸馏进单步策略。离线数据和单步生成降低了长程优化对实机交互的依赖。

Abstract: Vision-Language-Action (VLA) models increasingly rely on action experts that generate short action chunks under receding-horizon control. While chunk-level training is convenient across robot embodiments, it optimizes local action likelihood without explicitly accounting for long-horizon task success. Sequence-level reinforcement learning can address this limitation, but typically requires policy rollouts and closed-loop interaction, which are costly for real-robot manipulation. We introduce DriftOPD, a teacher-free, rollout-free framework for sequence-level on-policy distillation of continuous VLA action experts. We show that the sequence-level reverse Kullback-Leibler (KL) divergence decomposes into a chunk-level reverse-KL term and a future-potential term that captures the long-horizon effect of the current action. DriftOPD optimizes these two terms using a one-step drifting objective and a Q-function critic learned from offline demonstrations, respectively, enabling sequence-level optimization with only offline data and one-step action generation. Across multiple VLA architectures in simulation and real-world manipulation, DriftOPD generally outperforms existing one-step distillation baselines while achieving task success performance comparable to multi-step teacher policies. These results demonstrate that long-horizon behavior can be effectively distilled into one-step VLA action experts without online interaction or a separate teacher.

[193] DexPolicy: Scheduled Exploration for Trajectory-Guided Dexterous Manipulation cs.RO | cs.CVPDF

Haoyu Wang, Siyuan Qian, Yanjun Li, Zeyu Zhang, Yandong Guo

TL;DR: DexPolicy把灵巧操作强化学习的动作探索噪声显式设为随训练逐步退火的计划，先广泛寻找手指接触，再收敛到精细控制。

Details

Motivation: 灵巧操作RL需先探索手指—物体接触，再精确控制物体；服务早期探索的动作噪声可能干扰后期精细操作，轨迹引导训练中基线PPO跑500万步后仍接近初始噪声。

Result: 在保持损失、架构、奖励和优化器不变的情况下，噪声由宽到窄退火。五个YCB物体、三种随机种子下，FPO、GRPO、PPO的确定性目标成功率分别由49.4%升至68.1%、14.1%升至45.4%、32.0%升至35.7%。真实机械臂360次试验中，对应成功率从25.0%升至85.0%、10.0%升至63.3%、8.3%升至43.3%。

Insight: 探索尺度的控制可显著影响最终目标成功，且训练回报与实机确定性成功并不总一致；噪声计划应按预期执行条件和优化器单独评估。

Abstract: Reinforcement learning (RL) for dexterous manipulation must discover finger-object contacts and then control the object precisely; the action noise that serves the first goal can interfere with the second. In trajectory-guided settings such as ViViDex, where RL refine hand-object trajectories from human video, our baseline PPO runs end near their initial action noise after 5M steps, motivating explicit control of exploration scale. DexPolicy makes that scale an explicit function of training steps, annealing from broad to narrow exploration while holding loss, architecture, reward, and optimizer settings fixed. We study three policy-optimization settings: PPO, critic-free GRPO continuation, and a flow-parameterized PPO variant (FPO). Across five YCB objects and three training seeds, mean deterministic Target success rises from 49.4% to 68.1% (FPO), 14.1% to 45.4% (GRPO), and 32.0% to 35.7% (PPO). On a RealMan RM75 arm with an Inspire/RH56 hand, 360 trials over three objects raise mean Target success from 25.0% to 85.0% (FPO), 10.0% to 63.3% (GRPO), and 8.3% to 43.3% (PPO), with one trained model per object-method condition. PPO component screening favors noise control over the tested optimizer contraction; the selected PPO schedule yields higher mean Target success than linear decay with the same endpoints on three tested objects. Training return, deterministic Target success, and tolerance to execution noise dissociate; schedules should therefore be judged by terminal task success under the intended execution conditions, per task and policy-optimization setting. Code: https://github.com/AIGeeksGroup/DexPolicy. Website: https://aigeeksgroup.github.io/DexPolicy.

Pengfei Qi, Haoran Lin, Sizhuang Chen, Kai Luo, Sirui Zhang

TL;DR: UniTrackPLA用环视观测、共享VLA骨干和动作条件未来验证，统一语言目标导航与任意方位动态人物跟踪。

Details

Motivation: 通用具身机器人既要导航到语言指定位置，也要追踪不同初始方位的人；现有方法多用前视输入和独立策略，限制全向感知及闭环统一控制。

Result: PAE保留全景投影视角的时间和方位结构，模型预测连续机器人坐标航点块；WAC预测动作条件未来状态并在线验证航点，不一致时重规划。新基准含5,000条模拟追踪、10,000条VLN路线、96条实地路线及919,978条航点监督。总体追踪成功率由23.50%升至35.00%，Omni-VLN SR/SPL由13.00%/12.77%升至19.75%/19.29%；加入76条真实路线后，留出EP@0.2m由42.92%升至92.08%。

Insight: 全景空间编码与未来状态校验使追踪和导航可共享策略骨干，在线验证负责发现何时需重规划。真实路线数据显著改善实地泛化。

Abstract: General-purpose embodied robots should support both navigation toward language-specified destinations and dynamic person tracking under arbitrary initial target azimuths. However, existing methods typically rely on forward-facing observations and address these tasks with separate policies, limiting omnidirectional perception and unified closed-loop control. We present UniTrackPLA, a unified panorama-language-action model for instruction-guided navigation and dynamic person tracking. Its Panoramic-Aware Encoding (PAE) preserves the temporal and azimuthal structure of perspective views projected from each panorama, enabling perspective-pretrained visual encoders to process omnidirectional observations. A shared vision-language backbone grounds instructions in the panoramic context and predicts continuous robot-centric waypoint chunks for both tasks. World-Action Consistency (WAC) further predicts action-conditioned future visual states and verifies waypoint prefixes online, allowing reliable actions to be reused while triggering replanning upon inconsistency. We also introduce OmniTrackNav-Bench, comprising 5,000 simulated tracking trajectories, 10,000 simulated VLN routes, and 96 verified real-world routes, providing 919,978 waypoint-supervision instances. UniTrackPLA improves overall tracking SR from 23.50% to 35.00% and Omni-VLN SR/SPL from 13.00%/12.77% to 19.75%/19.29%. Incorporating 76 real-world routes further improves held-out EP@0.2m from 42.92% to 92.08%. Closed-loop experiments on a Go2-W robot demonstrate unified panoramic tracking and navigation across indoor and outdoor environments. The project page is at https://tw5775.github.io/UniTrackPLA.

[195] A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform cs.RO | cs.CV | cs.LGPDF

Chengkai Xu, Yiming Cui, Jiaqi Liu, Yicheng Guo, Cheng Qin

TL;DR: 该综述从数据、训练策略和平台三层组织端到端自动驾驶训练生态，并分析它们如何共同影响模型性能、鲁棒性和部署。

Details

Motivation: 端到端自动驾驶可将多模态传感直接映射为动作，但最终效果取决于数据、目标对齐方式和可扩展训练基础设施组成的整体训练体系。

Result: 综述提出Data-Strategy-Platform分类，分别梳理数据管线、学习范式和训练平台，并分析三者相互作用。作者总结未来方向包括从数据数量转向数据价值、从孤立优化转向基础模型泛化，以及从静态训练转向训练—测试闭环。

Insight: E2E自动驾驶的能力不由模型架构单独决定，训练生态三层需协同设计。该文是综述和研究路线总结，不报告新模型实验结果。

Abstract: Autonomous driving is a cornerstone technology for the future of intelligent transportation, where end-to-end learning has emerged as a transformative paradigm that directly maps multimodal sensory inputs to driving actions through unified differentiable models. While offering advantages, the effectiveness of end-to-end autonomous driving (E2E-AD) is ultimately determined by the quality of its training ecosystem. This paper provides a comprehensive review of training methods and ecosystem for E2E-AD. We introduce a Data-Strategy-Platform taxonomy that conceptualizes training as an interdependent system. The data layer defines what can be learned, the strategy layer governs how learning aligns with driving objectives, and the platform layer supports scalability and continuous evolution. Within this framework, we survey recent advances across data-centric pipelines, learning paradigms, and training infrastructures, and analyze their interplay in shaping model performance, robustness, and deployability. Finally, we reflect on current limitations and articulate a forward-looking vision that emphasizes a shift from data quantity to data value, from isolated optimization to foundation-driven generalization, and from static training to integrated training-testing loops, aiming toward robust, scalable, and trustworthy autonomous driving systems. We maintain a continuously updated repository tracking cutting-edge literature and works at \href{https://github.com/Jiaaqiliu/Awesome-Training-Ecosystem-for-E2E-AD}{Our Project Page}.

[196] NarrativeFlow: Flow-Based Vision-Language-Action Model Using Robot Velocity Fields cs.RO | cs.CVPDF

Shota Kobayashi, Koki Seno, Daichi Yashima, Komei Sugiura

TL;DR: NarrativeFlow把机器人控制表示为由语言条件化的连续速度场，以流匹配生成跨不同机器人平台共享的运动轨迹。

Details

Motivation: 语言条件操作需跨具身复用机器人数据，但专用动作示范收集昂贵；稀疏关键点位移对速度场过于粗糙，其他方法又难支持语言控制。

Result: NarrativeFlow学习连续机器人速度场，使运动表示不依赖特定机器人形式，并用于标准语言条件操作数据集评估。实验中该方法在标准指标上优于代表性基线，真实机器人多项操作任务成功率也更高；摘要未提供具体数值。

Insight: 连续运动场比稀疏关键点更完整地刻画动作过程，可能促进跨机器人数据共享。结果包含标准数据集和实机验证，但量化收益未披露。

Abstract: We focus on language-conditioned flow-based manipulation, where robot flows (robot velocity fields) serve as embodiment-agnostic, motion-centric representations for leveraging data collected from multiple robot platforms. This task is crucial because language-conditioned manipulation is essential for practical robotic systems, yet scaling robot foundation models remains limited by the labor-intensive collection of embodiment-specific data. Existing methods either coarsely approximate robot flows with sparse keypoint displacements, or cannot handle language-conditioned manipulation. To address this limitation, we propose NarrativeFlow, which models robot flows as continuous velocity fields using a flow-matching formulation conditioned on language. Accordingly, NarrativeFlow generates robot flows that are physically consistent with real-world manipulation. To validate NarrativeFlow, we have conducted experiments on standard datasets for language-conditioned manipulation. The experimental results show that NarrativeFlow outperforms representative baseline methods on standard evaluation metrics. Furthermore, through real-world experiments, we show that NarrativeFlow achieves higher success rates than baseline methods across multiple manipulation tasks. The project page is available at https://shota0520.github.io/NarrativeFlow-project-page/

[197] World Motion Models: Flexible Sequence Modeling of SE(3) Trajectories cs.RO | cs.CVPDF

Jiahui Lei, Qianqian Wang, Trevor Darrell, Angjoo Kanazawa

TL;DR: World Motion Models用稀疏SE(3)轨迹表示动态物体、相机与机器人状态，并以一个流匹配序列模型支持多种具身和3D任务。

Details

Motivation: 空间智能需要关于三维世界随时间变化的生成先验，统一对象运动、人体、交互、相机及机器人动作的表示较困难。

Result: WMM将动态场景近似为刚体SE(3)轨迹，并用每词元噪声级流匹配建模任意数量实体和时刻的联合分布。通过掩码控制可将同一网络用于未来预测、运动补全、模型预测控制、逆运动学、跨具身重定向和策略学习。六类3D视觉及机器人应用显示模型性能强且适用灵活；摘要未给具体数字。

Insight: 多种动态实体共享统一位姿轨迹空间后，任务差异可由条件掩码而非独立架构表达。该表示连接感知、规划和控制，但需要刚体近似覆盖目标动态。

Abstract: Equipping artificial agents with spatial intelligence requires a comprehensive generative prior over the dynamic 3D world. We propose World Motion Models (WMMs) that capture “what was, is, and will be where across time” via sparse SE(3) pose trajectories. WMMs are built on the observation that elements of dynamic scenes can be well approximated by a set of rigid SE(3) trajectories, a minimal yet expressive primitive for 4D modeling. This representation unifies articulated objects, human bodies, hand-object interactions, piecewise-rigid scene dynamics, camera motion, and even robot states and actions into a single shared space. Given this representation, we cast the joint distribution of these entities as a flexible sequence modeling problem, utilizing flow-matching with per-token noise levels. Coupled with a context token mechanism for non-sequential conditioning, this formulation supports any-to-any marginal conditioning across an arbitrary number of entities and time steps. Tasks such as future prediction, motion infilling, model-predictive control, inverse kinematics, cross-embodiment retargeting, and policy learning all reduce to the application of different masks over the same network. Experiments on 6 diverse applications of 3D vision and robotics demonstrate the versatility and flexibility of WMMs with strong performance.

cs.SD [Back]

[198] High-Value Synthetic Supervision for Parameter-Efficient Adaptation of a Compact Japanese Speech Model cs.SD | cs.CL | cs.LGPDF

Sidi Chang, Peiying Zhu

TL;DR: 研究用可审计合成语音样本进行日语护理交接语音到六字段结构化记录适配，比较全量微调与LoRA的事实召回和参数成本。

Details

Motivation: 私有领域语音难以收集和再分发，小模型又需要任务监督；护理交接记录还要求将口语准确转换成结构化字段。

Result: 使用182段合成训练与开发音频，适配1.47B音频模型；在39段按场景和种子隔离的合成测试中，基础模型评审事实召回0.0500，全量微调0.8664，LoRA为0.8461。LoRA描述性总体比率达全量微调的97.7%，可训练参数1,240万、约骨干的0.85%；两种适配均显著改善，二者差异区间跨零，且优化设置不同，不能宣称等效。未测延迟、内存、能耗或实时因子。

Insight: 少量可追溯合成样本可让紧凑音频模型学会特定语音到结构化记录映射，LoRA以较少参数取得接近表现。证据仅限合成语音和未校准模型评审，不支持临床有效性或真实语音迁移结论。

Abstract: Private domain speech is difficult to collect and redistribute, while compact models need task-specific supervision. We study an auditable synthetic pipeline that maps Japanese care handoffs directly to six-field structured notes. Using 182 synthetic training and development clips, we adapt a 1.47B audio model by full fine-tuning and rank-16 LoRA. On a 39-clip scenario-seed-disjoint synthetic test, an unadapted model obtains a model-judged factuality-recall score of 0.0500, full tuning 0.8664, and LoRA 0.8461. LoRA reaches 97.7% of the full-tuning aggregate as a descriptive ratio while project telemetry reports 12.4M trainable parameters, about 0.85% of the backbone. Both adaptations show large paired gains over the same base; the full-versus-LoRA interval crosses zero, and differing optimization settings preclude an equivalence claim. This is a parameter-efficient capability-acquisition result, not a device-performance result: latency, memory, energy, and real-time factor were not measured. All evaluation speech and targets are synthetic, references are model-proposed, and the judge is uncalibrated. The evidence shows that a compact model can acquire a narrow audio-to-structure transformation from a few hundred provenance-linked synthetic examples; it does not establish clinical validity, real-speech transfer, or superiority to a clean cloud system.

cs.SE [Back]

[199] Detecting Inconsistencies in Model Specifications with LLM-as-Verifier Reasoning cs.SE | cs.AI | cs.CLPDF

Zichen Xie, Mrigank Pawagi, Lize Shao, Yang Hu, Wenxi Wang

TL;DR: VeriSpec直接审计模型规范文本，抽取有上下文的规则并用同级主题图聚类，再让LLM验证规则间是否存在冲突。

Details

Motivation: 两条单独合理的模型行为原则在同一情境下可能要求互不相容的行为；形式化自然语言可能丢失细微差异，行为测试又难区分规范缺陷与模型实现差异。

Result: VeriSpec从OpenAI Model Spec抽取405条规则并人工验证五个不一致案例，均已报告规范开发者并获积极回应、进入内部讨论。与五个基线相比，它发现经验证不一致最多，精确率38.5%最高，平均每个验证案例成本11.12美元最低。

Insight: 直接检查规范文本可在原则影响模型训练或推理前发现源头冲突，补充单纯行为评估。验证精确率仍有限，人工复核在该流程中不可省略。

Abstract: Model specifications define how large language models (LLMs) should behave, guiding alignment training, inference-time behavior, and evaluation. Yet these specifications may themselves contain defects: two individually reasonable principles may prescribe incompatible behavior when applied to the same situation, leaving no response that satisfies both. Detecting such inconsistencies is challenging. Formalizing natural-language specifications risks losing subtle distinctions, while behavior-based testing cannot reliably distinguish specification defects from differences in model behavior. We introduce VeriSpec, the first approach to directly detect inconsistencies in model specifications by auditing the specification text itself. Our key insight is to preserve the specification in natural language while using an LLM as a verifier. VeriSpec extracts structured, context-aware rules, constructs a topic-guided graph to cluster behaviorally related rules at the same authority level, and applies LLM-as-verifier reasoning to detect inconsistencies. Applying VeriSpec to the OpenAI Model Spec, we extract 405 rules and manually validate five inconsistencies, all reported to its developers, who responded positively and have initiated internal discussions. Compared with five baselines, VeriSpec identifies the most validated inconsistencies, achieves the highest precision (38.5%), and incurs the lowest cost per validated inconsistency ($11.12). These results establish direct specification auditing as a practical complement to behavioral alignment evaluation, catching defects at the source before they shape any model. The code is available at https://github.com/HIPREL-Group/VeriSpec.

eess.IV [Back]

[200] LensBridge: Frequency-Guided Compound Degradation Adaptation for Lens Aberration Correction and Veiling Glare Removal eess.IV | cs.CV | physics.opticsPDF

Xiaolong Qian, Zhonghua Yi, Qi Jiang, Kailun Yang, Shuhang Xie

TL;DR: LensBridge先用LensLib建立可复用点扩散函数感知的像差校正基础，再以频域指导从少量未配对目标观测适配像差与炫光复合退化。

Details

Motivation: 简化光学系统存在空间变化模糊和炫光，LensLib覆盖多种像差却不包含目标设备炫光；现实目标系统配对复合退化数据难收集，限制基础模型迁移。

Result: 第一阶段从LensLib点扩散函数构建一步扩散先验，无需推理时显式提供PSF；第二阶段用频率引导退化补全合成复合训练对，再通过伪分解生成像差主导与炫光主导观测，分别适配分支。多个光学系统实验显示，LensBridge无需目标系统配对监督即可联合校正像差和去除炫光；摘要未报告数值。

Insight: 低频目标外观可转移，同时保留高频像差结构，帮助复用已有基础模型适配新设备。分层数据与模型频域引导减少对真实配对样本依赖。

Abstract: Simplified optical systems often exhibit residual lens aberrations and Veiling Glare (VG), resulting in spatially varying blur and contrast reduction. Large-scale Lens Libraries (LensLib) enable reusable aberration correction models by covering diverse Point Spread Functions (PSFs), but their aberration-only training distribution does not include target-specific veiling glare. Extending such foundations to compound degradation is challenging because realistic target-system compound pairs are difficult to obtain. To address this challenge, we propose LensBridge, a two-stage framework that first establishes a reusable aberration correction foundation and then adapts it to compound optical degradation using only a few unpaired target observations. In Stage I, we build a PSF-aware one-step diffusion foundation by constructing discrete degradation priors from LensLib PSFs and learning to retrieve them directly from aberrated images, enabling PSF-aware correction without requiring explicit PSF at inference. In Stage II, we adapt this foundation to compound degradation through frequency-domain guidance. At the data level, Frequency-guided Degradation Completion (FDC) transfers target low-frequency characteristics to LensLib aberrated images while preserving aberration structures to synthesize compound training pairs; at the model level, Frequency-guided Pseudo Decomposition (FPD) forms aberration- and VG-dominant pseudo observations to condition separate adaptation branches. Extensive experiments across multiple optical systems demonstrate that LensBridge effectively extends reusable aberration correction foundations to joint aberration correction and veiling glare removal without target-system paired supervision. All code will be available at https://github.com/XiaolongQian/LensBridge.

Table of Contents

cs.CV [Back]

[1] STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets cs.CV | cs.AI | cs.LG | cs.ROPDF

[2] Emergent Object Binding Has a Finite Spatial Horizon cs.CV | cs.LGPDF

[3] Spatial Lifting for Dense Prediction cs.CV | cs.AI | cs.LGPDF

[4] Encoded but Disconnected: Decomposing Vision-Language Model Failures under a Patching Null cs.CV | cs.CL | cs.LGPDF

[5] Seeing the City or Recognizing the Place? What Street-View Imagery Adds Beyond Existing Urban Data in VLM Urban Sensing cs.CVPDF

[6] DSSR-3D: Decoupled Reasoning for View-Dependent Referring in 3D Gaussians cs.CVPDF

[7] A Framework for Egocentric and Exocentric Procedural Understanding via Temporal Segmentation and Semantic Abstraction cs.CV | cs.AIPDF

[8] DramaAgent: Agentic Storytelling Video Generation cs.CV | cs.CLPDF

[9] Evaluating the Robustness of Anti-UAV Detection under Controlled Fog Degradation: Fog-Aware Training and Clear-Sky Tradeoff cs.CVPDF

[10] A Low Grounding Score Is Not an Ungrounded Judge: Identifying the Perceptibility Confound in Multimodal Oversight cs.CVPDF

[11] GPEC: Efficient Pre-LLM Gaussian Process Embedding Correction for Cardiac Video Caption Generation cs.CVPDF

[12] Query Independent Variable Rate Visual Token Coding cs.CVPDF

[13] LENS-GRF: Permutation-Invariant Lesion Evidence Network with Gated Residual Fusion for Acne Severity Grading and Multi-Rater Clinical Oracle Analysis cs.CV | cs.AIPDF

[14] Decoding the Disaster: Multi-Task Geospatial Reasoning with Vision-Language Models and Crowdsourced Imagery for Disaster Mapping cs.CV | cs.AIPDF

[15] LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation cs.CV | cs.AI | cs.CL | cs.LGPDF

[16] Memorizon: Training World Models Beyond Their Context Window cs.CVPDF

[17] PACT: End-to-End Learning of Human Pose, Contacts, and Forces from Video cs.CV | cs.AI | cs.LGPDF

[18] FORTE: Adaptive Scoring and Exact Keyframe Selection for Long-Video Question Answering cs.CVPDF

[19] PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop cs.CVPDF

[20] Just Align $\bm{x}$: Aligning Predictions, Not Representations cs.CVPDF

[21] Discrete Annotation, Continuous Preference: Rethinking Supervision for Accurate and Generalizable Aesthetic Image Cropping cs.CVPDF

[22] Gestalt: Large Multimodal Interplay Model cs.CVPDF

[23] VisionQ: VLM-as-a-Judge Taxonomy, Dataset and Benchmark for Qualitative Analysis in Computer Vision cs.CV | cs.AIPDF

[24] HAWK: Rethinking Multimodal Drafting for Speculative Decoding cs.CVPDF

[25] Harnessing Vision-Language Models for Perceptual Quality Assessment and Autonomous Content Adjustment in Augmented Reality cs.CVPDF

[26] SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation cs.CV | cs.LGPDF

[27] Soundwich: Video Generation with Layered and Controllable Audio cs.CV | cs.MM | cs.SDPDF

[28] Personalized Image Generation with Reasoning and Reflection cs.CV | cs.AIPDF

[29] What Builds the Scene? Luminance Dominates Geometry Formation in 3D Gaussian Splatting cs.CV | cs.GRPDF

[30] Video Evidence Indexing: Learning Where to Look from Video Previews for Token-Budgeted Long-Video Question Answering cs.CVPDF

[31] Align Then Reason: A Multimodal Lip-Sync Judge for Dubbing cs.CVPDF

[32] Paying for Too Many Tokens? Valid and Cost-Efficient Multimodal LLM Annotation with Simple Heuristics cs.CV | cs.CL | cs.SIPDF

[33] Video Generation Models: A Survey of Post-Training and Alignment cs.CV | cs.AI | cs.LGPDF

[34] Geometric Similarity in VLM Low-Level Vision Representations cs.CV | cs.AIPDF

[35] Machine Translation for Sign Languages cs.CVPDF

[36] Lang3DSeg: Annotation-Free Open-Vocabulary 3D Segmentation with Point Transformers cs.CV | cs.ROPDF

[37] CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight cs.CVPDF

[38] A Matched-Budget Audit Framework for Recaptioned Image-Text Supervision Distributions cs.CV | cs.AIPDF

[39] Two Clocks in Diffusion MLLMs: When Answers Stabilize Before Rationales Unfold cs.CV | cs.AIPDF

[40] RelationVGGT: Visual Geometry Transformers for 3D Spatial Relation Segmentation cs.CV | cs.AIPDF

[41] Video-Index: A Curated Meta-Benchmark for Video Understanding cs.CVPDF

[42] Concept Driven Domain Adaptation: Finding an Abstract Needle in a Haystack cs.CV | physics.ed-phPDF

[43] VIEScore2: Unified Image Evaluation with Spatially Grounded Explanations cs.CVPDF

[44] VASC: Value-Aware Sparse Attention with Cross-Layer Memory for Efficient 3D Reconstruction cs.CVPDF

[45] Watch Your Speech: Text-aware Video-to-Speech Synthesis with Textual Conditioning cs.CV | cs.SD | eess.ASPDF

[46] FutureWorlds: Learning Robotic World Models from Alternative Futures cs.CV | cs.ROPDF

[47] Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation cs.CVPDF

[48] Bootstrapping Video Interaction Generation with Synthetic State Transitions cs.CVPDF

[49] Towards Subject Consistency over Dynamic Subject Sets in Video Generation cs.CVPDF

[50] HierGF: Hierarchical Gaussian Fields via Geometry-perception Message Passing for Sparse-view 3D Reconstruction cs.CV | eess.IVPDF

[51] Ego2Act: Evaluating Goal-Directed Manipulation in Egocentric Video Generation cs.CVPDF

[52] MVDG: Efficient Multi-view 3D Disambiguation on Unconstrained Real-World Images cs.CVPDF

[53] Affine-Aligned Atlas for Canonical Gaussian Construction in Video Representation cs.CVPDF

[54] PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models cs.CV | cs.ROPDF

[55] CineMR: Tool-Integrated Vision-Language Reasoning for Quantitative Cardiac MRI Assessment cs.CV | cs.AIPDF

[56] FlashBack: Knowing When to Remember in Streaming Vision-Language Models cs.CVPDF

[57] Skeleton-and-Strategy Prompting: Training-Free Negation Understanding for Vision-Language Models cs.CVPDF

[58] iSEE: Object Permanence Through Self-Supervision cs.CVPDF

[59] EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes cs.CVPDF

[60] Resolving Mixed Single-Photon LiDAR Returns for Foreground-View and Hidden Scene Reconstruction cs.CVPDF

[61] Semantic RGB–Depth Based Surgical Skill Assessment in Microscopic Stereo Videos cs.CVPDF

[62] A Compact Explicit 4D Representation for Dynamic Scenes cs.CVPDF

[63] Flow Matching Reinforcement for 3D Mesh Generation via Dynamic Homing Optimization cs.CVPDF

[64] When the Judge Acts: Auditing VLM-Guided Image Selection on Culturally Situated Prompts cs.CV | cs.AI | cs.CYPDF

[65] PickMoment: Continuous-Time Single-Image-to-Video via Learning Deblurring and Blur-to-Video cs.CV | cs.AIPDF

[66] Dyna3: VLM-Guided Training-Free 4D Reconstruction via Depth Foundation Models cs.CVPDF

[67] ODDR: One-Step Deshadow Diffusion via Reward Guidance cs.CVPDF

[68] ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild cs.CVPDF

[69] Supervising Sound Localization by In-the-wild Egomotion cs.CV | cs.AI | cs.MM | cs.SDPDF

[70] MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning cs.CVPDF

[71] MWOP: Modality-aware Width-wise Operation Pruning for Efficient MLLMs cs.CV | cs.AI | cs.CLPDF

[72] FiVOS: A Fish Segmentation Algorithm Based on Interactive Video Object Segmentation and Filter Enhancement cs.CVPDF

[73] VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation cs.CVPDF

[74] PAGER: Partial-to-global Alignment via Geometric and Relational Distillation cs.CVPDF

[75] Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs cs.CV | cs.AIPDF

[76] Hob-VL: A Benchmark for Visually Grounded Boolean Reasoning cs.CV | cs.AI | cs.LG | cs.LOPDF

[77] Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models cs.CVPDF

[78] Beyond Domain-Level Adaptation: Margin-Oriented Semantic-Appearance Interaction Correction for Personalized Federated Vision-Language Models cs.CVPDF