cs.CV [Total: 153]
cs.CL [Total: 51]
astro-ph.SR [Total: 1]
cs.AI [Total: 18]
cs.CR [Total: 1]
cs.CY [Total: 1]
cs.DB [Total: 1]
cs.DC [Total: 1]
cs.HC [Total: 2]
cs.IR [Total: 2]
cs.LG [Total: 23]
cs.MA [Total: 2]
cs.PL [Total: 1]
cs.RO [Total: 14]
cs.SD [Total: 1]
eess.AS [Total: 1]
eess.IV [Total: 1]

cs.CV [Back]

[1] Energy Variation in Training Modern Computer Vision Architectures cs.CV | cs.PFPDF

David Cortes, Carlos Juiz, Belen Bermejo

TL;DR: 实测七种现代视觉架构在ImageNet子集训练的能耗差异，发现GFLOPs与能耗相关但不能完整预测实际能耗。

Details

Motivation: 深度学习训练能耗快速增加，模型设计需要考虑能源效率；仅凭计算复杂度可能不足以判断真实硬件能耗。

Result: 研究在两张NVIDIA Tesla P100上，用统一10,000张ImageNet-10k子集和40轮配置训练MobileNetV3、EfficientNet、ViT及ConvNeXt共七种架构，通过NVML记录能耗。GFLOPs与kWh能耗Pearson相关系数为0.85，说明复杂度是较强但不完美的预测因子；GFLOPs相近架构因主导算子硬件效率不同，能耗最多相差3.1倍。EfficientNet在分类性能（验证集Top-5最高97.15%）与能耗（0.457至0.611 kWh）间平衡最好；该设置下ViT相对能耗最高且分类性能较低。

Insight: 能耗评估应直接测量目标硬件，而非仅报告GFLOPs；结论限定于指定GPU、数据子集和训练配置。

Abstract: The rapid growth of deep learning has substantially increased the energy consumption associated with model training, making energy efficiency an increasingly relevant design criterion. This study empirically measures the energy variation of training seven modern computer vision architectures, MobileNetV3-Small, MobileNetV3-Large, EfficientNet-B0, EfficientNet-B1, ViT-B/32, ConvNeXt-Tiny, and ViT-B/16 for the ImageNet-1k classification task, using a homogeneous 10,000-image subset (ImageNet-10k) and a uniform 40-epoch baseline configuration executed on two NVIDIA Tesla P100 GPUs at the Bioinformatics and Computational Biology Center of Colombia (BIOS). Energy was recorded directly via NVML and contrasted with the computational complexity of each model. The results show a Pearson correlation of 0.85 between floating-point operations (GFLOPs) and energy consumption in kWh, indicating that computational complexity is a strong but imperfect predictor of energy expenditure: architectures with comparable GFLOPs exhibited consumption differing by up to 3.1x due to differences in the hardware efficiency of their dominant operations. The EfficientNet variants offered the best balance between classification performance (Val Top-5 up to 97.15%) and energy efficiency (0.457-0.611 kWh), while Vision Transformers exhibited the highest relative energy consumption and lower classification performance under the evaluated configuration. These findings guide architecture selection in energy-constrained computing environments.

[2] What Do Verifiable Rewards Teach Video-Language Models About Time? A Controlled Multi-Model Study cs.CVPDF

Avyay Sadhu, Patrick Cooper

TL;DR: 跨四种开放视频语言模型研究可验证奖励强化学习是否真正教会时间理解，发现准确率提升并未带来时间顺序证据定位。

Details

Motivation: 可验证奖励RL提升语言推理，亦可用于有可核验标签的视频因果时间问答；但模型学到的是时间证据推理还是合成基准模式尚不清楚。

Result: 作者对Qwen3-VL-8B/4B、Qwen2.5-VL-7B和Gemma-3-12B使用验证合成CLEVRER数据、43,751条真实网络视频自监督数据、两者各半混合，以及额外4,000条真实视频验证题四种配方，并在域内和真实视频域外评测原序、打乱及无帧设置。较弱模型域内提升14至19点，强模型提升6点；无帧准确率几乎同幅上涨，说明大量收益并非视觉所得。仅合成验证训练使Qwen3-VL-8B在两真实视频集下降26.7与25.2点，混合数据无显著退化；加真实验证题后损失缩至2.3点（基座噪声内），且域内仍增9.3点。41次原序—乱序比较中39次差异近零、两次边缘显著，即使奖励包含事件顺序。

Insight: 验证奖励能提升基准准确率，但不自动教会时间顺序定位；报告无帧对照并混入真实视频有助于揭示捷径和缓解分布外退化。

Abstract: Reinforcement learning from verifiable rewards (RLVR) has produced large reasoning gains in language models, and verifiable video benchmarks make it applicable to causal-temporal video question answering. We study what RLVR teaches video-language models about time. We fine-tune four open models (Qwen3-VL-8B/4B, Qwen2.5-VL-7B, Gemma-3-12B) with group relative policy optimization under three data recipes: verified (synthetic CLEVRER questions with exact answer and event-order rewards), unverified (self-supervised pretext tasks over 43,751 real web videos), and a 1:1 mixture, plus a verified+real arm that adds 4,000 verifiable questions on real video. Each cell is evaluated in-domain and on out-of-domain real video (a NExT-QA temporal stress set and an MVBench subset), with frames in order, shuffled, and absent. (1) Verified training yields large in-domain gains that shrink as base competence grows (+14 to +19 points on weaker models; +6 on the strongest). (2) Much of the gain is non-visual: accuracy with no frames rises nearly as much as with frames. (3) Verified-only training can severely degrade out-of-domain accuracy with no sign during training: Qwen3-VL-8B loses 26.7 and 25.2 points on the two real-video sets, while the mixture never significantly degrades a model trained on it. Adding real verified questions removes that loss (-2.3 points, within noise of base) and keeps a +9.3 in-domain gain, so the cause is narrow synthetic-only data, not verification. (4) No recipe induces temporal-order grounding: across 41 evaluations the ordered-versus-shuffled gap is indistinguishable from zero in 39 and marginal in two, despite an event-order reward. Verifiable rewards improve benchmark accuracy without temporal understanding. Report no-frame controls, and mix in real video to guard against out-of-domain degradation.

[3] WAMJET: A Harness for World Action Model Acceleration cs.CV | cs.AI | cs.ROPDF

Le Chen, Lixin Liu, Jan Schneider, Zeju Qiu, Simon Guist

TL;DR: 提出WAMJET代理式优化工具链，按推理瓶颈自动剖析、修改并验证世界动作模型加速方案。

Details

Motivation: WAM使用大型视频骨干并联合预测视频与动作，推理开销高；现有加速技术虽多，但针对每个模型和硬件选择组合需大量工程工作。

Result: WAMJET为编码代理提供可复用优化指导、测量和验证工具，按剖析—定向修改—验证的流程迭代优化，并随瓶颈迁移更新加速栈，同时保持动作质量。评测覆盖六个WAM、三种编码代理和两种GPU架构；相比上游实现最高获得9.95倍无损加速，近似计算与硬件感知优化可进一步降延迟且成功率相近。

Insight: 瓶颈驱动的自动工程流程可将多种优化方法应用到不同WAM部署；最高无损加速是所测范围内结果，不代表所有模型和硬件均可达到。

Abstract: World Action Models (WAMs) leverage pretrained video foundation models for robot manipulation, but their large backbones and video-action co-prediction are expensive. Although existing acceleration techniques offer many ways to reduce this cost, selecting and composing them requires substantial engineering for each model and hardware platform. To tackle this bottleneck, we present WAMJET, an agentic harness that accelerates WAM inference by equipping coding agents with reusable optimization guidance and measurement and validation tools. WAMJET follows a bottleneck-driven workflow where the agent profiles inference, modifies targeted code, validates effects, and iteratively refines the acceleration stack as bottlenecks shift, while preserving action quality. Experiments span six WAMs, three coding agents, and two GPU architectures. WAMJET achieves up to 9.95x lossless speedup over upstream implementations. Approximation and hardware-aware optimization yield additional latency reductions, with comparable success rates. The results show that WAMJET can produce effective acceleration stacks for WAM deployment.

[4] Beyond Token Accuracy: Prioritizing What Matters for Visual Reconstruction cs.CVPDF

Zhicheng Liu, Zhouxiang Zhao, Chenliang Wu, Zhaohui Yang, Zhaoyang Zhang

TL;DR: 提出AdapToC自适应视觉token通信框架，联合按内容和信道分配token、差异保护并在接收端恢复图像。

Details

Motivation: 视觉token成为多模态模型的通用接口，但静态传输策略无法随图像内容和信道状态调整；token效用分数也未必转化为图像重建质量。

Result: 发送端按实例联合建模图像内容、信道状态与通信预算，动态选择token数量并按重要性和信道条件分配不同保护等级。接收端MaskGIT使用信道可靠性做上下文建模，保留高置信token、纠正可能损坏项并迭代补全缺失内容。在相同通信成本下，相比最强静态基线峰值平均PSNR提高4.20dB，并在所评视觉token通信方法中达到当时最佳表现。

Insight: 用端到端图像重建质量共同优化token数量、保护和恢复，比只追求token级传输准确更贴近通信目标；摘要报告峰值增益，未给各信道条件下范围。

Abstract: Tokens have become a unified interface for multimodal foundation models, making visual-token communication a natural paradigm for efficient image delivery. However, existing methods typically rely on static policies that cannot jointly adapt to image content and channel conditions. Moreover, their token-level utility objectives do not necessarily translate into improved image reconstruction quality. In this paper, we propose AdapToC, an adaptive, reconstruction-oriented visual-token communication framework. At the transmitter, an adaptive selector jointly models image content, channel state, and communication budget to perform instance-wise resource allocation. Rather than using a fixed token rate and protection policy, it dynamically determines how many tokens should be transmitted and assigns different protection levels according to token importance and current channel conditions. At the receiver, an adaptive MaskGIT receiver incorporates channel reliability into contextual token modeling. It distinguishes tokens with different reliability levels, preserves high-confidence observations, corrects potentially corrupted tokens, and iteratively reconstructs missing content from the received evidence and global visual context. By co-designing token quantity, unequal protection, and reliability-aware recovery for image-level reconstruction quality, AdapToC achieves a peak mean PSNR gain of 4.20 dB over the strongest static baseline under matched communication costs and state-of-the-art performance among the evaluated visual-token communication methods.

[5] Are We Measuring Anticipation? Auditing Privileged Information in Procedural Video Evaluation cs.CVPDF

Mahsa Mohammadi, Sareh Rowlands

TL;DR: 审计程序化视频动作预测评测中的特权信息差距，指出时间因果且无经典标签泄漏的协议仍可能测量了更容易的代理任务。

Details

Motivation: 基准成绩会支撑能力声明，需检查评估流程究竟测到什么；程序动作预判协议可能使用模型部署时本不应拥有的中间表示。

Result: 在Breakfast数据集上，对照识别器历史与真实标签历史的分数分别为30.3%和62.3%，差32.0点，95% Student-t区间为[24.1,39.8]。固定检查点2×2干预隔离出14.6点测试时oracle差异；无视频来源探针差26.8点，边界无关查询/历史控制仍差19.4点。作者将此定义为相对于指定非oracle恢复流程的特权信息差距，并提出四条件可复用审计；五种设置差距不一，50 Salads长期预判复现提供谨慎的外部支持。

Insight: 评测即便保持时间因果，也可能给模型提供特权中间表示，从而高估目标能力；需明确非oracle信息恢复管线并逐条件审计。

Abstract: Benchmark scores license claims about the capabilities being evaluated. We audit the inference licensed by an evaluation protocol, rather than the predictive model alone. Using procedural action anticipation as a controlled case study, we study a broader evaluation-validity failure mode: a protocol can remain temporally causal and free of classical target leakage while still supplying a privileged intermediate representation. The failure is not merely optimistic accuracy, but a mismatch between the capability claimed and the construct actually measured. On Breakfast, matched recognizer-history and GT-history regimes score 30.3% and 62.3% (Delta_PH(R_BA) = +32.0, 95% Student-t interval [+24.1, +39.8]). A fixed-checkpoint 2 x 2 intervention isolates a +14.6-point test-time oracle contrast; a matched no-video provenance probe yields a +26.8-point gap; and a boundary-independent query/history control retains a +19.4-point gap. We refer to this discrepancy as a privileged-information gap, defined relative to a specified non-oracle recovery pipeline, and propose a reusable four-condition audit. Across five evaluation settings the gap is heterogeneous; a standard 50 Salads long-term-anticipation re-implementation provides cautious support beyond the audit-specific next-action construction.

[6] DABACO: A Multi-Camera Dataset and Benchmark for Screen Localization and Pointing Estimation cs.CV | cs.MMPDF

Óscar Gómez-Cárdenes, José Gil Marichal-Hernández, Juan Manuel Martín-Doñas

TL;DR: 发布DABACO多摄像头视频数据集与基准，支持低成本嵌入式屏幕定位和摄像头指向估计。

Details

Motivation: 合成图像难重现真实光学畸变、滚动快门、运动模糊和显示处理；静态图像数据集也无法评估连续视频指向。

Result: 数据集包含多种低成本传感器采集的视频，包括单色全局快门及彩色滚动快门模块，平台包括Raspberry Pi 4B和ESP32-S3。标注流程结合临时视觉水印、光流跟踪、人工核验和水印移除，并同时发布原始带标记与去标记图像、屏幕角点和修改掩码以供审计。开源工具提供基于边缘/轮廓几何的经典屏幕检测基线，以及不经数据集训练的现成YOLOv8分割基线，报告IoU、角点误差和指向误差。

Insight: 真实硬件视频与可审计标注便于研究嵌入式连续指向系统，也可检查去水印带来的重建偏差；摘要未提供基线具体分数。

Abstract: Screen localization and pointing estimation are key to low-cost interactive devices. Yet developing and evaluating these algorithms requires realistic data: synthetic captures cannot fully reproduce the optical distortion, rolling shutter, motion blur, and display processing of a physical acquisition, and most existing datasets provide static images rather than the video needed to assess continuous pointing. In this paper, we introduce the DABACO Dataset. Developed within the DABACO (Dispositivo Apuntador de BAjo COste, or Low-Cost Pointing Device) project, this dataset supports the development and evaluation of screen detection and camera-based pointing algorithms for embedded systems. It comprises video sequences captured with multiple low-cost camera sensors, including monochrome global-shutter and color rolling-shutter modules, on embedded platforms such as the Raspberry Pi 4B and ESP32-S3. We present a systematic annotation pipeline combining temporary visual watermarking, optical-flow tracking, manual verification, and marker removal. Both the original marked captures and the marker-free images, together with explicit corner annotations and modification masks, are released to support auditing and the study of potential reconstruction bias. In addition, we release an open-source evaluation toolkit with two reference baselines: a classical screen-detection pipeline based on edge and contour geometry, and a closed-vocabulary, off-the-shelf YOLOv8 segmentation model evaluated without dataset-specific training. Both are evaluated on a general-purpose computer using Intersection over Union, corner error, and pointing error, establishing initial reference results for future embedded implementations. Overall, DABACO addresses a gap in existing resources and is intended to support the development and evaluation of new low-cost screen-localization and pointing systems.

[7] FADE: Frame-Aware Diffusion-Transformer-based Multi-Concept Erasure for Video Unlearning cs.CVPDF

Yuchen Li, Kaiyuan Deng, Chaoran Feng, Zhenyu Tang, Li Yuan

TL;DR: 提出FADE多概念视频遗忘框架，先联合编辑扩散Transformer键值，再以逐帧低秩适配器清除残留内容。

Details

Motivation: 文生视频模型可能生成版权、暴力或色情内容；现有按帧无关压制会使概念在个别帧重新出现，片段平均值掩盖该问题，且通常一次只评估一个概念。

Result: FADE先用闭式联合键值编辑压制全部目标概念，再训练按帧序和去噪时间门控的概念专属低秩适配器处理逐帧残留；各适配器以其他目标提示作为困难负例，保持概念分离，并用相似度软路由组合。单个Wan2.1-T2V-1.3B中同时遗忘16个对象、风格和裸露概念后，对象基准残留准确率4.9%，强基线为15.5%；VBench平均分仅比未编辑模型低0.9%。VLM评审和盲法人评排名一致，优势也迁移至复合提示、30个名人身份及多个其他视频模型。

Insight: 逐帧控制和多目标分离能减少概念在局部帧复现，同时保留总体生成质量；遗忘评价覆盖多模型与人评，但摘要未给逐类差异。

Abstract: Text-to-video (T2V) diffusion models can reproduce copyrighted, violent, or explicit content, which motivates concept erasure: removing designated concepts from a pretrained model while preserving its behavior on everything else. Existing T2V erasure methods leave two problems open. Their frame-agnostic suppression can leave isolated frames in which an erased concept resurfaces, a frame-reactivation gap that clip-level averages obscure; and they are usually evaluated with one target concept or category at a time. We propose Frame-Aware Diffusion Erasure (FADE), a multi-concept video unlearning framework. FADE first applies a joint closed-form key/value edit that suppresses all target concepts, then trains per-concept frame-aware low-rank adapters whose strength is gated by the frame index and the denoising timestep to remove residual per-frame leakage. Each adapter is trained with the other targets’ prompts as hard negatives, which keeps the concept-specific components of different adapters well separated, and a similarity-based soft router combines the adapters according to the prompt. With 16 concepts (objects, artistic styles, and nudity) erased from a single Wan2.1-T2V-1.3B backbone, FADE reduces the residual accuracy on the object benchmark to 4.9%, against 15.5% for the strongest of eight baselines, while keeping the VBench average within 0.9% of the unedited model. The ranking is unchanged under a VLM judge and a blinded human study, and the advantage over the strongest baseline carries over to prompts that combine several erased concepts, to 30 simultaneously erased celebrity identities, and to Wan2.1-T2V-14B, CogVideoX-2B, and HunyuanVideo-1.5.

[8] Masked Privileged-Information Distillation for Multimodal Skin Lesion Classification Under Missing Clinical Metadata cs.CV | cs.LGPDF

Anirban Barua, Md Mahir Abrar Khan, Ayman Iktidar, Md. Sajjatul Islam

TL;DR: 提出缺失元数据条件下的皮肤病变分类特权信息蒸馏，以完整元数据教师训练对临床字段随机遮蔽的紧凑学生。

Details

Motivation: 临床皮肤图像可与患者元数据联合诊断，但完整训练元数据部署时可能不全，且基层场景要求模型轻量。

Result: 多模态教师使用完整字段，体积小9.2倍的学生按样本以U(0,1)比例遮蔽整组临床字段，使一次训练覆盖完整至全缺失范围；残差融合将元数据作为门控修正加入无条件图像基线。在PAD-UFES-20上，遮蔽训练学生在所有元数据可用度下均优于交叉熵训练，平均平衡准确率提升4.7点，而无遮蔽蒸馏提升1.8点。元数据从完整变为全缺失时，遮蔽训练学生仅下降7.8点，完整元数据训练的同一学生下降36.6点；Grad-CAM显示元数据撤除时注意力通常仍聚焦病灶。

Insight: 全范围随机遮蔽帮助模型在元数据缺失时平滑退化，且收益超过蒸馏本身；证据来自单一PAD-UFES-20数据集。

Abstract: Multimodal skin lesion classification combines clinical images with patient metadata to improve diagnostic accuracy. However, complete metadata available during training may be only partially accessible at deployment, and resource-constrained settings additionally require computational efficiency. We address these challenges with a privileged-information distillation framework in which a multimodal teacher trained on complete metadata supervises a 9.2x smaller student trained with randomly masked clinical fields. Clinical fields are masked as whole groups at a per-sample rate drawn from U(0,1), so one training run covers the full metadata availability range. Fusion is residual, with metadata added as a gated correction to an unconditional image base. On the PAD-UFES-20 dataset, distillation under masked training improves balanced accuracy over cross-entropy training at every availability level, by an average of +4.7 points versus +1.8 points without masking. The masked student loses only 7.8 balanced-accuracy points as metadata decreases from complete to absent, compared with 36.6 points for the same student trained on complete metadata, highlighting the role of masked training in graceful degradation beyond distillation alone. Grad-CAM visualizations further show that the masked student’s attention generally remains lesion-centered as metadata is withdrawn. The resulting compact model targets point-of-care settings, where clinical metadata is often incomplete.

[9] PhysMamba: Selective State Space Models as Learned Articulated Body Simulators cs.CVPDF

Haochuan Zhang, Sinisa Todorovic

TL;DR: 提出PhysMamba，以选择性状态空间模型预测全身关节运动，作为可微分的学习式关节身体模拟器。

Details

Motivation: 视频网格恢复需要高效物理模块，传统模型可能依赖速度输入或难以在线运行；需验证状态空间架构能否用位置、旋转及关节动作历史预测下一帧全身状态。

Result: PhysMamba在无需速度输入情况下进行下一帧全身状态预测；比较四种架构、部分/完整观测和三种训练协议。从头开始的滚动训练使Mamba2在部分观测下短中时域准确度较强，s10为43毫米且50条序列仅2条发散；两阶段教师滚动训练虽稳定GRU但未能稳定Mamba2。CUDA图编译后，Mamba2在H100上每帧0.107毫秒（9,334 FPS），吞吐距未编译GRU仅1.1倍，为30Hz HMR流水线增加不到1%延迟。

Insight: Mamba2可作高吞吐、可微分的运动物理模块，但训练协议会显著影响稳定性；两阶段教师方法对Mamba2失效是重要限制。

Abstract: We introduce the first learned articulated body simulator based on a selective state space model (SSM), called PhysMamba. PhysMamba predicts next-frame full-body state from position, rotation, and joint-action history, without velocity inputs. We compare four architectures under partial- and full-observation inputs and three training protocols. The from-scratch rollout training protocol gives Mamba2 strong short- and mid-horizon accuracy under partial observation (s10 = 43 mm, 2/50 diverged), while the two-stage teacher-based rollout protocol stabilizes GRU but fails for Mamba2. With CUDA graph compilation, Mamba2 reaches 0.107 ms per frame (9,334 FPS) on an H100 GPU, within 1.1$\times$ of GRU’s un-compiled throughput, adding under 1% latency to a 30 Hz HMR pipeline and enabling integration as a differentiable physics module for video-based mesh recovery.

[10] MAGEFormer: Learning Metric-Consistent Representations for Anisotropic CT Segmentation cs.CV | cs.AIPDF

Jiaying Li, Paolo Remagnino

TL;DR: 提出MAGEFormer，将体素物理间距嵌入位置编码与注意力，改善各向异性CT器官分割。

Details

Motivation: 视觉Transformer常假设体素处于各向同性欧氏网格，但临床CT采集间距具有各向异性，导致体素索引与真实解剖距离不匹配，传统各向同性重采样还会损害精度。

Result: MAGEFormer以MASE按体素间距校准位置频率，用GCA抑制物理上不合理的特征关联，并以GVV推理时减少离散化偏差。在BTCV与FLARE 22两个多器官腹部CT基准的统一协议下，其边界精度优于所比较CNN和Transformer，HD95分别为10.58毫米和3.40毫米；Dice也持续提升。

Insight: 把物理间距直接纳入表示学习，比单纯各向同性预处理更适合各向异性CT；摘要未列具体Dice改进值。

Abstract: Vision Transformers (ViTs) have shown strong performance in volumetric segmentation, but their effectiveness on clinical CT is limited by an isotropic Euclidean lattice assumption. This conflicts with anisotropic CT acquisition, leading to two key issues: (1) a metric mismatch between voxel indices and physical anatomy, and (2) accuracy degradation from isotropic resampling. To address this, we propose MAGEFormer, a geometry-calibrated framework that embeds physical metric constraints directly into representation learning. Our method introduces Metric-Adaptive Spatial Embedding (MASE) to calibrate positional frequencies using voxel spacing, Geometry-Constrained Attention (GCA) to suppress physically implausible feature correlations, and Geometric View Voting (GVV) to reduce discretization bias during inference. We evaluate MAGEFormer on two multi-organ abdominal CT benchmarks, BTCV and FLARE 22, under a unified protocol against strong CNN and Transformer-based baselines. MAGEFormer achieves the strongest boundary accuracy among the compared methods, with 10.58 mm HD95 on BTCV and 3.40 mm HD95 on FLARE 22, and shows consistent gains in Dice under the same protocol. These results show that geometry-aware internal calibration is more effective than relying on conventional isotropic preprocessing alone for anisotropic CT segmentation.

[11] Dynamic Quadtree Tokenization and Transformer for Adaptive Mesh PDE Forecasting cs.CV | cs.LGPDF

Yilin Zhuang, Noah Zambrano, Karthik Duraisamy

TL;DR: 提出WAMRViT，用可动态细化的四叉树token化及单元级重网格适配多尺度偏微分方程预测。

Details

Motivation: 标准ViT二次注意力开销迫使空间分辨率与 rollout 时长折衷；激波、反应前沿和材料界面等细节区域位置会变化，固定token数和传统神经代理无法动态调整分辨率。

Result: WAMRViT依据小波式细化准则将输入切成平衡四叉树，用3D旋转位置嵌入联合编码位置与细化层级，推理时在单元空间重网格以支持长程稳定预测；多尺度版本保留叶节点源分辨率。均匀网格基准上，单尺度模型以更少token改善最细层关注区域VRMSE；多尺度版本在两基准初始全场RMSE及VRMSE最低，并提升长程 rollout 平均全场和细化区域准确率。并行重网格后成本介于最细patch与token数接近的粗patch ViT之间。复杂AMR燃烧问题中，均匀网格基线无法原生表示最细结构，WAMRViT在匹配Transformer容量下显著降低最细层误差。

Insight: 面向局部精细结构的网格预测需要随时间变化的分辨率，而非预设token预算；该模型据作者所知首次原生处理多层AMR数据。

Abstract: The quadratic attention cost of Vision Transformers (ViTs) forces a trade-off between spatial resolution and rollout horizon, particularly for fine-scale PDEs where shocks, reaction fronts, and material interfaces occupy small, evolving regions of the domain. Conventional neural surrogates also lack mechanisms to adapt resolution dynamically. We propose WAMRViT, a ViT that tokenizes inputs as balanced quadtrees using a wavelet-inspired refinement criterion, jointly encodes position and refinement level with 3D rotary positional embeddings, and regrids in cell space during inference for stable long-horizon rollouts. A multi-scale variant retains each leaf at its native source resolution and lets the model learn across resolution levels. Unlike fixed-budget adaptive-tokenization methods, WAMRViT imposes no predetermined token count and supports fully adaptive topology throughout autoregressive rollout. To our knowledge, it is the first machine-learning surrogate to natively tokenize multi-level Adaptive Mesh Refinement (AMR) data. On uniform-grid benchmarks, uniform-patch WAMRViT improves finest-level region-of-interest VRMSE over a finest-patch uniform ViT while using substantially fewer tokens. The multi-scale variant achieves the lowest first-step full-field RMSE and VRMSE on both benchmarks and improves rollout-averaged full-field and refined-region accuracy at long horizons. With parallelized regridding, its end-to-end rollout cost lies between finest-patch and approximately token-matched coarser-patch ViTs. On a complex AMR combustion problem whose finest features cannot be represented natively by the evaluated uniform-grid baselines, WAMRViT operates directly on adaptive cells and substantially reduces finest-level error at matched transformer capacity. Code: https://github.com/tonyzyl/wamrvit

Sidrah Liaqat, Halil Helvaci, Sen-Ching Cheung, Chongruo Wu, Dongjie Chen

TL;DR: 发布ASD-FEAT婴儿—成人互动多模态视频数据集，用于早期自闭症风险预测并评估视觉行为特征流水线。

Details

Motivation: 自闭症早筛有助于及时干预，但行为数据需要覆盖婴儿期至36个月、重复互动、临床结局和专家细粒度标注，同时需兼顾隐私。

Result: ASD-FEAT整合纵向互动视频、经临床验证的发展结局、专家逐帧行为标注及隐私友好多模态特征；特征包括面部/眼部关键点、动作单元、视线、头位、音频梅尔谱和光流。全自动分类流程准确率76.2%、AUROC 0.82，低于人工标注行为分类的81.3%和0.88。新增同一次访问内检查者与家长互动对比后，全自动“看脸+微笑”和“看脸+发声”配置MCC达0.49和0.45，均高于单一互动对象人工编码基线0.42。

Insight: 同访视对象对比可补充单一互动统计并提高风险预测；自动化性能仍低于人工行为标注结果，需结合筛查而非诊断使用。

Abstract: Accurate early screening for Autism Spectrum Disorder (ASD) is a precursor to timely intervention, which is critical for improving cognitive and behavioral outcomes. We present ASD-FEAT (ASD - Feature Extraction And Tracking), a multimodal dataset derived from video recordings of infant-adult interaction sessions. The key contribution of ASD-FEAT is the combination of longitudinal coverage from infancy through 36 months, repeated interaction sessions, clinically validated developmental outcomes, expert frame-level behavioral annotations, and privacy-conscious multimodal feature representations. To the best of our knowledge, existing ASD behavioral datasets do not jointly provide these characteristics at comparable scale. To demonstrate the utility of ASD-FEAT, we use it to evaluate a computer-vision-based end-to-end pipeline relying on machine learning techniques to automatically identify ASD risk. ASD-FEAT integrates both expert-defined and deep-learned features, including face and eye landmarks, facial action units, gaze direction, head position, mel-spectrogram audio representations, and optical flow, to identify behavioral markers of social interaction. Our automated pipeline achieves an ASD classification accuracy of 76.2% and an Area Under the Receiver Operating Characteristic (AUROC) of 0.82, compared to classifiers trained on manually labeled behaviors, which yielded 81.3% accuracy and an AUROC of 0.88. We further introduce a within-visit partner contrast: a per-visit signal contrasting examiner-directed and parent-directed social behavior which, when added to the classifier, lifts the fully automated Look Face + Smile and Look Face + Vocal configurations to Matthews correlations of 0.49 and 0.45 respectively, exceeding the human-coded single-partner baseline of 0.42.

[13] Evaluating Zone-Guided Front Extraction for Glacier Calving-Front Delineation in SAR Imagery cs.CV | cs.LGPDF

Chhaya Kulkarni, Emam Hossain

TL;DR: 比较直接冰川崩解前缘预测与先分割语义区域再提取边界的策略，发现区域分割分数不能替代前缘级评估。

Details

Motivation: 合成孔径雷达图像中的崩解前缘是冰川、海洋和岩地间细窄且模糊的边界；CaFFe同时提供前缘掩码和语义区域掩码，可检验区域监督是否有助恢复前缘。

Result: 作者在统一裁剪设置下比较U-Net、DeepLabV3+和SegFormer-B0。直接方法预测二值前缘；区域引导法先分四类语义区，再提取预测冰川—海洋边界。评估区域级、前缘级表现、真值区域边界上限，并测试传感器/冰川子集轻量测试时适配。真值区域提取出的前缘平均距离误差最低，说明区域标签含边界信息；但模型预测区域提取的前缘仍弱，即使区域分割分数中等，适配也未稳定改善结果。

Insight: 边界信息虽隐含于区域标签，但当前区域模型不一定能高质量转化为前缘；需前缘级评价及边界感知训练、标签融合或直接边界监督。

Abstract: Automatic calving-front delineation from synthetic aperture radar imagery is challenging because the front is a thin and often ambiguous boundary between glacier ice, ocean, and surrounding rock or terrain. The CAlving Fronts and where to Find thEm (CaFFe) dataset provides both binary calving-front masks and broader semantic zone masks, making it possible to study whether zone-level supervision can support front recovery. In this paper, we compare direct front prediction with zone-guided front extraction using U-Net, DeepLabV3+, and SegFormer-B0 under the same bounding-box-cropped CaFFe setting. In the direct setting, models predict the binary calving-front mask. In the zone-guided setting, the model first predicts four semantic zone classes, and the front is then extracted from the predicted glacier-ocean boundary. We evaluate both zone-level and front-level performance, include a ground-truth-zone boundary check, and examine lightweight test-time adaptation on sensor-specific and glacier-specific subsets. The results show that zone labels contain useful front-boundary information: extracting the front from ground-truth zones gives the lowest mean distance error. However, fronts extracted from model-predicted zones remain weak, even when zone segmentation scores are moderate. Test-time adaptation also does not consistently improve zone-guided front recovery. These results indicate that zone segmentation performance should not be treated as a substitute for front-level evaluation and that effective use of zone labels may require boundary-aware training, label fusion, or explicit front supervision.

[14] A Theory of Shape Reconstruction from Heat Conduction and Shading cs.CVPDF

Akihiko Oharazawa, Sriram Narayanan, Mani Ramanagopal, Srinivasa G. Narasimhan

TL;DR: 提出结合明暗度与热传导线索的形状恢复理论，在少数退化情形外消解局部凸凹歧义。

Details

Motivation: 单幅朗伯表面图像的明暗度恢复存在法线锥形歧义，未知光源时更严重；热传导方法虽可估计形状拉普拉斯算子，但由其恢复法线又有局部凸/凹二义性。

Result: 作者建立无需平滑先验的新理论，同时满足明暗度和拉普拉斯约束，并允许光源未知。通过复杂形状模拟验证理论，分析噪声影响，并测试包含复杂形状、不同材质和变化反照率的真实物体单段噪声热视频。

Insight: 将互补的明暗度与热传导物理约束联立，可减少两类方法各自的局部形状歧义；理论存在少数退化例外，摘要未报告误差指标。

Abstract: Shape from shading using a single image of a Lam- bertian surface is inherently ambiguous. When the light source direction is known, the surface normal estimation has a cone- ambiguity, which worsens when the source is unknown. Recently, shape from heat conduction has emerged as an approach that leverages heat transport equations to estimate the Shape Lapla- cian operator, an intrinsic measure of shape. However, deriving surface normals from the Laplacian operator encounters a local binary convex/concave ambiguity. Our contribution introduces a novel theory to resolve these local shape ambiguities (excluding a few degeneracies) without relying on priors like smoothness, by combining the cues from shading and heat conduction. Our method ensures the mathematical constraints of both shading and the Laplacian are satisfied simultaneously, even with an unknown light source. We validate our theory through simulations of complex shapes and analyze its performance in the presence of noise, as well as on a noisy single thermal video of real-world objects with complex shapes and material properties, including varying albedo.

[15] Scaling 3D Visual Grounding in Abdominal CT cs.CV | cs.LGPDF

Sam Church, Danyal Maqbool, Joshua D. Warner, Andrew Voter, Junjie Hu

TL;DR: 提出将常规PACS二维放射科标注自动扩展为腹部CT三维短语—区域监督的数据流水线及LocusCT模型。

Details

Motivation: 三维CT定位放射报告发现有助于临床流程，但训练需要大量短语—体素区域配对，传统人工标注成本高；临床工作中的二维箭头和测量标注可能提供现成监督。

Result: 流水线先以元数据把二维标注关联到报告发现，再用可提示三维分割模型将标注扩展为体积掩码，无需额外放射科医师标注。单机构PACS生成59,000例腹部CT的105,000组三维监督。作者建立LocusBench-Onc（240组）和LocusBench-ED（260组、13类急诊发现）两个医师审阅基准，并训练LocusCT；命中率分别为0.725与0.773，显著优于比较模型。

Insight: 既有工作流标注可规模化转成三维定位训练数据，减少新增标注；监督来源为单一机构，迁移到其他PACS流程需评估。

Abstract: Visual grounding models can enhance radiology workflows by linking report findings to image regions. This is particularly valuable for 3D CT, where findings often occupy a tiny fraction of the volume. Training 3D grounding models requires large sets of paired phrases and regions, and building such datasets is expensive, requiring radiologists to annotate images by hand. We posit that this supervision is already created implicitly during routine reporting, as radiologists frequently place 2D annotations (e.g., distance measurement, arrows) on key images to make measurements and to support report interpretation. We introduce an automated pipeline that converts these routine clinical annotations into large-scale phrase-region supervision for 3D visual grounding. The pipeline links each annotation to the corresponding finding in the report through metadata matching, then uses a promptable 3D segmentation model to convert the 2D annotation into a volumetric mask. This produces phrase-mask-volume datasets without requiring additional radiologist annotation. Applied to a single institution’s clinical picture archiving and communication system (PACS), our approach generated 105K phrase-mask-volume triplets from 59K abdominal CT exams. We also introduce two abdominal CT grounding benchmarks, LocusBench-Onc and LocusBench-ED, which comprise 240 oncology and 260 emergency-department radiologist-reviewed phrase-mask-volume triplets, respectively, with the latter spanning 13 distinct categories such as appendicitis, hematoma, and hernia. We further introduce LocusCT, a 3D visual grounding model trained on this dataset, which achieves hit rates of 0.725 on LocusBench-Onc and 0.773 on LocusBench-ED, substantially outperforming comparator models. These results show that routine PACS annotations are a scalable, previously unused source of supervision for 3D visual grounding.

[16] From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models cs.CVPDF

Feiran Wang, Xiaoqi Wang, Ziwei Li, Wenbin He, Yan Yan

TL;DR: 提出SpatialMind度量尺度视觉语言模型及数据引擎，在已观察视频前缀上预测距离、方向和空间关系的未来状态。

Details

Motivation: 碰撞规避和及时决策需要推断未观察区间的空间状态，但现有VLM及基准主要关注当前画面，前瞻空间推理研究不足。

Result: SpatialMind以度量深度适配器把空间推理锚定到真实尺度，通过渐进状态链先表示当前空间与已观察运动，再预测未来。数据引擎把实体描述落实到度量几何，自动生成问答与状态监督，构建SpatialMind-30K和SpatialMind-2K，覆盖驾驶和日常第一视角视频、当前状态/已观察动态/未来预测三层共八项任务。实验显示其在自建基准大幅超过通用及空间专用模型，并在VSI-Bench、OSI-Bench和VLM4D零样本评估上表现有竞争力。

Insight: 显式度量尺度和渐进状态表示把观测推理延伸到未来空间预测；摘要未给出各基准的具体分数与提升幅度。

Abstract: Predicting future spatial states supports collision avoidance and timely decision-making in dynamic environments. However, existing vision-language models (VLMs) and benchmarks for spatial reasoning primarily focus on observed scenes, leaving predictive spatial reasoning beyond the observed interval underexplored. To this end, we introduce SpatialMind, a metric-scale VLM for spatial reasoning and future prediction. Its metric depth adapter anchors spatial reasoning to real-world scale, while its progressive state chain establishes current spatial states and observed dynamics as the foundation for future prediction. Given a video prefix, SpatialMind predicts distances, motion directions, and spatial relations in both observed and unseen future frames. For training and evaluation, we build a scalable data engine that grounds entity descriptions in metric geometry to generate question-answer pairs and state supervision. Using this engine, we construct the SpatialMind-30K dataset and the SpatialMind-2K benchmark, both covering driving and everyday egocentric scenes. The benchmark spans eight tasks across three levels: current-state understanding, observed-dynamics understanding, and future prediction. Experiments show that SpatialMind substantially outperforms both general and spatially specialized models on our benchmark while achieving competitive zero-shot performance on VSI-Bench, OSI-Bench, and VLM4D.

[17] Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution cs.CVPDF

Feiran Wang, Bin Duan, Junyi Wu, Gaowen Liu, Yan Yan

TL;DR: 提出Kepler4D，以显式四维场景状态演化及可编辑的对象轨迹控制未来视频生成。

Details

Motivation: 视频世界模型需保持场景结构并预测观测之外动态物体的演化；仅靠视觉延续难以控制未来运动和保持场景一致。

Result: Kepler4D从单目视频构建背景几何、物体运动历史、粗空间支撑与语义语境的共享三维表示。Chain-of-Motion概括观测运动，调用VLM选择结构化速度、朝向并判断是否限制物体中心高度下界；确定性 rollout 生成可检查、编辑的未来轨迹，再渲染成几何控制引导预训练视频生成器，将粗运动与外观、关节运动合成分离。真实视频实验显示可控对象运动、生成合理未来轨迹并保持场景一致性。

Insight: 先显式预测并允许编辑对象轨迹，再交给生成器合成外观，可增强未来视频可控性；摘要未报告量化指标或对比基线。

Abstract: Video world models aim to preserve scene structure and predict how dynamic objects evolve beyond visual observations. We present Kepler4D, a framework for future video generation through explicit 4D scene state evolution. Given a monocular video, Kepler4D constructs a shared 3D representation of background geometry, object motion histories, coarse spatial supports, and semantic context. Chain-of-Motion summarizes observed motion and uses a vision-language model to select structured speed and heading decisions and decide whether to bound object-center height from below. A deterministic rollout converts these decisions into future object trajectories for inspection and editing before synthesis. We render the evolving proxies into geometric controls for a pretrained video generator, separating coarse object motion from the synthesis of appearance and articulation. Experiments on real-world videos demonstrate that Kepler4D enables controllable object motion and plausible future rollout while preserving scene consistency.

[18] Watermarks and Fingerprints as Soft Bindings for Content Provenance: An Open-Licence Benchmark for Images, Audio and Video cs.CVPDF

Seyedmahdi Kazempourradi, Ramtin Mojtahedi, Behrang Mohseni

TL;DR: 在统一开放许可评测协议下比较图像、音频、视频内容来源软绑定水印与指纹方法。

Details

Motivation: C2PA等内容来源标准可在清单被剥离后借助不可见水印或注册库指纹重新绑定内容，但不同模态、攻击和错误绑定风险下两类技术缺乏可比证据。

Result: 作者审计许可后评测25种图像、7种音频、7种视频水印配置（12种方法）及35种指纹方法，校准留出负例假匹配率并用来源级bootstrap区间估计。PixelSeal图像/视频水印、AudioSeal音频水印平衡最佳，但所有TrustMark变体的纠错检测器会对5.9%至15.3%未标记图像触发，验证器应检查预期载荷。指纹方面，非商业数据训练的复制检测器对变换图像检出率最高75.5%（配对假匹配率10^-7）；宽松许可最佳DINOv2为65.0%，目录近似商品图主导误匹配。图像受攻击副本中水印与指纹成功并集覆盖69%；音频指纹覆盖更多查询，视频预期密钥水印覆盖更多查询。

Insight: 水印与指纹面对攻击的失效模式不同，联合可扩大覆盖；水印嵌入会使62%图像ISCC码越过匹配阈值，且x86与ARM颜色转换会改变水印位，部署需留意跨平台一致性。

Abstract: Content-provenance standards such as C2PA let a platform recover a stripped manifest through a soft binding: an invisible watermark read from the content, or a fingerprint looked up in a registry. We benchmarked both families under one protocol, restricted to openly available models whose licences we audited, on public media, with false-match rates calibrated on held-out negatives and source-level bootstrap intervals for performance estimates. For watermarking we evaluated 25 image, 7 audio and 7 video configurations from 12 methods on perceptual quality, robustness, false positives and cost; for fingerprinting, 35 methods on registries of up to 98,985 images, partial edits and adversarial attacks. PixelSeal gave the best balance for image and video watermarks and AudioSeal for audio, but the error-correcting detector of every TrustMark variant fired on 5.9 to 15.3% of unmarked images, so a verifier should test the expected payload. Among fingerprints, copy detectors trained on non-commercial data detected up to 75.5% of transformed images at a pair-level false-match rate of $10^{-7}$ and DINOv2, the best permissively licensed method, 65.0%; near-copies in a product catalogue dominated the false matches, and no detection improvement from geometric verification was observed under a matched calibration false-binding constraint in the evaluated image pipelines. On the same attacked copies the two families failed differently: the union of watermark and fingerprint successes covered 69% of image copies; fingerprints covered more audio queries, whereas expected-key watermark verification covered more video queries. Embedding a watermark moved the ISCC code of 62.0% of images past its match threshold, and platform-dependent colour conversion changed watermark bits between x86 and ARM hosts.

[19] Diagnosis-Conditioned Spatial Gating and Decoder-Level Supervised Contrastive Learning for Radiology Report Generation cs.CVPDF

Md Mustafizur Rahman, Mylene C. Q. Farias

TL;DR: 提出位置感知门控PAG与解码器级监督对比损失DSCL，用诊断发现调制放射报告生成的空间视觉特征。

Details

Motivation: 放射报告生成模型可能文本流畅却在发现级别不准确；诊断条件生成通常只将预测发现作为输入，并未直接修改视觉patch，且全局门控对所有空间位置作同样调制。

Result: PAG根据预测发现表征对视觉patch做空间调制，不需区域标注；DSCL以共享阳性发现而非个体身份组织解码器表征。MIMIC-CXR上二者组合将临床效能F1从匹配全局门控参考的0.484提升至0.502，PAG和DSCL单独分别为0.491和0.495。无需额外微调迁移至IU X-Ray时，组合模型F1为0.226，高于已报告PromptMRG的0.211。

Insight: 发现信息需对齐到对应空间特征，而非仅作全局条件；在跨数据集上无微调仍有优势，但指标为临床效能F1。

Abstract: Radiology report generation models can produce fluent text while still containing finding-level inaccuracies. Diagnosis-driven methods improve generation by conditioning on predicted findings, but these predictions do not directly modify the visual patch features provided to the decoder, and global gating applies the same modulation across spatial locations. We introduce a Position-Aware Gate (PAG) that uses predicted finding representations to modulate visual patches spatially without region supervision. We also propose a Decoder-level Supervised Contrastive Loss (DSCL) that structures decoder representations using shared positive findings rather than instance identity. On MIMIC-CXR, PAG+DSCL improves clinical efficacy (CE) F1 from 0.484 to 0.502 over a matched global-gate reference, while PAG and DSCL individually reach 0.491 and 0.495. Without additional fine-tuning, the combined model achieves 0.226 CE F1 on IU X-Ray, compared with 0.211 reported by PromptMRG.

[20] FlashGaze: Training-Free Multi-Scale Patch Pruning For Efficient Video Understanding cs.CVPDF

Ziye Zhu, Yanghao Zhou, Lixing Tan, Jialiang Kang, Shuxuan Li

TL;DR: 提出免训练的FlashGaze，在ViT编码前按固定预算联合决定视频patch丢弃、合并或保留。

Details

Motivation: 长高分辨率视频含大量时空冗余，现有token剪枝多发生在ViT编码后，无法节省前端编码开销；编码前剪枝方法又常依赖额外训练的选择网络。

Result: FlashGaze以像素差异近似信息损失，通过四叉树动态规划在固定预算下联合选择patch处理方式，无需辅助网络或训练。在Qwen3-VL-8B的LongVideoBench上保留完整输入准确率的98%，ViT编码最高加速5.4倍、LLM预填充最高加速17倍，峰值显存降低1.8倍；节省资源可在同一GPU处理更多帧或更高分辨率视频。

Insight: 在视觉编码前去冗余可同时减少视觉编码和语言模型预填充成本；速度倍率为上限，摘要未列所有数据集的具体精度。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance in video understanding, yet efficiently processing long, high-resolution videos remains challenging. Such videos often contain substantial spatiotemporal redundancy, and processing redundant visual tokens can incur avoidable computational overhead. Many existing methods prune visual tokens during or after vision transformer (ViT) encoding, leaving much of the encoding cost unaddressed. Some approaches prune patches before encoding but rely on learned auxiliary networks for patch selection, incurring additional training and inference overhead. To address these limitations, we propose FlashGaze, a training-free method that reduces spatiotemporal redundancy before ViT encoding without introducing auxiliary networks. FlashGaze uses pixel-space differences as a proxy for information loss and employs Quadtree Dynamic Programming to jointly optimize patch dropping, merging, and keeping under a fixed budget. Experiments on two MLLM backbones across multiple benchmarks demonstrate substantial efficiency gains while largely preserving accuracy. On Qwen3-VL-8B, FlashGaze retains 98% of the full-input baseline accuracy on LongVideoBench while achieving up to 5.4x and 17x speedups in ViT encoding and MLLM prefill, respectively, and reducing peak GPU memory usage by a factor of 1.8. These efficiency gains enable the model to process videos with more frames and higher resolutions on the same GPU hardware, unlocking video understanding at scales previously out of reach.

[21] Referring Multi-Object Tracking in Moving-Camera Videos via Global Motion Compensation cs.CVPDF

Hsin-Chen Pai, Jyun-Kai Wang, Yi-Cheng Peng, Wei-Ta Chu

TL;DR: 提出基于全局相机运动补偿的指代多目标跟踪插件，从驾驶视频提取残余运动并与文本指令匹配。

Details

Motivation: 指代跟踪需依据语言追踪多个目标，很多查询描述运动；移动相机下静止车辆会显得在动，真实移动车辆也可能几乎不移，直接运动—文本匹配易误判。

Result: 方法跨帧估计驾驶员视角相机运动并提取目标残余运动，将运动特征与查询表达比较，再与既有RMOT主模型预测做后期融合。实验验证运动补偿作为插件时可提升不同RMOT宿主的表现；摘要未报告具体数值或基准。

Insight: 先消除相机诱发运动可使目标运动线索更贴近语言语义；插件已在多个宿主验证，但收益幅度未在摘要给出。

Abstract: Referring multi-object tracking (RMOT) takes a video and a language expression as input and tracks all referred objects. Many tracking requirements involve how an object moves rather than how it appears. However, in a video captured by a moving camera, a parked vehicle may appear to move, while a moving vehicle may show little displacement. Existing RMOT methods relate motion with text but do not explicitly remove camera-induced motion. In this paper, we propose extracting residual motion across frames by estimating camera motion in driver-view videos and compare motion characteristics with the query expression. We consider the motion-matching extent and integrate it with the RMOT method’s prediction result through late fusion. In the evaluation, we verify the performance gain of taking the motion compensation module as a plug-in across different RMOT hosts.

[22] Sparse-GS2Mesh: 3D Gaussian Splatting Guided by Novel Stereo Views and 2DGS for Sparse View Surface Reconstruction} cs.CVPDF

Younghyun Noh, Minje Kim, Tae-Kyun Kim

TL;DR: 提出Sparse-GS2Mesh，将极线深度初始化、自适应基线选择、立体匹配微调和二维—三维协同正则结合用于稀疏视角表面重建。

Details

Motivation: 稀疏视图几何线索有限，SDF体渲染易过度平滑，3D高斯泼溅因缺乏可靠深度监督且只用输入视图优化而常生成不完整几何。

Result: 方法先用极线深度先验初始化3DGS以减轻过拟合，再为每个稀疏视图自动选择待合成的立体基线，通过立体网络反传深度细化梯度，并使用2D/3D联合正则提升近距离弱重叠视图稳定性。在视图重叠较少时比最先进方法提升15%，大重叠设置结果相当。

Insight: 稀疏相机下合成视图与立体深度反馈可补充几何约束；摘要未给具体数据集和评价指标数值。

Abstract: Surface reconstruction under sparse-view settings remains challenging due to limited geometric cues. Volume rendering methods based on signed distance functions often produce over-smoothed surfaces, while 3D Gaussian Splatting (3DGS), though time-efficient, suffers from incomplete geometry due to the lack of reliable depth supervision and the limitation of being optimized only from given input views. In this paper, we present Sparse-GS2Mesh, a stereo-aware framework for surface reconstruction from sparse views. While 3DGS and stereo matching have been leveraged for surface reconstruction under dense view settings, we extend them to operate effectively under sparse view conditions by first initializing 3DGS using epipolar depth priors to mitigate the 3DGS overfitting problem, followed by our three key components: (I) adaptive baseline selection, (II) fine-tuning with a stereo matching network, and (III) 2D/3D co-regularized fine-tuning. Given a warmed-up 3DGS initialized with epipolar depth, the adaptive baseline selection automatically determines a baseline to synthesize for each sparse view. We then fine-tune 3DGS by backpropagating depth-refining gradients from the stereo matching network, effectively specializing the 3DGS for stereo matching. The 2D/3D co-regularization further helps obtain stable reconstruction, addressing weak geometric cues in close stereo views. Sparse-GS2Mesh achieves a 15% improvement over state-of-the-art methods in little-overlap settings and comparable results in large-overlap settings. Codes will be publicly available.

[23] Rethinking Long-Video Efficiency: A Joint Allocation Perspective on Frames, Pixels, and Front-End Latency cs.CVPDF

Sixun Dong, Wei Li, Andong Deng, Qi Qian, Victor Zhu

TL;DR: 提出LoHi免训练长视频处理框架，联合密集低分辨率视频采样和稀疏高分辨率图像帧分配token预算。

Details

Motivation: 长视频VLM效率通常只讨论固定原生分辨率下挑帧或挑token，但降低单帧分辨率可换取时间覆盖；前端解码延迟还由候选帧池规模决定而非最终token预算。

Result: 跨多个VLM和长视频基准的研究发现，匹配token预算时密集低分辨率优于稀疏原生分辨率；对分辨率敏感任务仍需要选取高分辨率帧，小时级视频的前端解码主导总时延。LoHi通过原生视频与图像通路融合两种采样；LoHi-Anchor用编解码I帧元数据选高清帧，LoHi-SemDiv按CLIP特征相关性与视觉多样性选择。三个基准上匹配token预算时平均准确率较原生分辨率基线高10.6点，较最强既有效率方法高5.2点；小时级视频前端解码延迟最多降低7倍。

Insight: 视频帧数、分辨率和前端解码应联合配置，单一分辨率策略会错失时间覆盖与细节互补；方法无需训练且可复用现有VLM路径。

Abstract: Efficient long-video understanding with vision-language models (VLMs) is often framed as selecting informative frames or visual tokens at a fixed native resolution. We show that per-frame resolution can instead be traded for denser temporal coverage, while front-end decoding latency depends on the size of the candidate pool rather than the final token budget. An empirical study across multiple VLMs and long-video benchmarks yields three findings: dense low-resolution sampling outperforms sparse native-resolution sampling at matched token budgets; resolution-sensitive tasks benefit from selected high-resolution frames; and front-end decoding dominates wall time for hour-long videos. Motivated by these findings, we introduce LoHi, a training-free, single-pass framework that combines a dense low-resolution video stream with sparse high-resolution image frames through the VLM’s native video and image pathways. LoHi-Anchor selects high-resolution frames using codec I-frame metadata, while LoHi-SemDiv uses query relevance and visual diversity over CLIP features. Across three long-video benchmarks, LoHi improves average accuracy by 10.6 percentage points over the native-resolution baseline at a matched token budget and by 5.2 percentage points over the strongest prior efficiency method. It also reduces front-end decoding latency by up to 7x on hour-long videos. Project page: https://sixundong.com/projects/lohi

[24] A differentiable Lagrangian-coupled 3D Gaussian Splatting-SPH model for forward simulation and inverse analysis in solid mechanics cs.CV | physics.comp-phPDF

Tian Xu, Soroush Atashi, Tianju Xue

TL;DR: 提出可微拉格朗日耦合3DGS—SPH模型，用于可变形固体的正向仿真与基于视觉形变的逆参数识别。

Details

Motivation: 3D重建能捕捉表面外观，但将高斯表示用于材料本构、边界条件和逆向参数估计仍研究不足；渲染原语也不应直接当作力学粒子。

Result: 先从多视角标定图像重建3DGS，再用包络程序生成独立SPH支撑；参考构型拉格朗日映射将SPH变形传给高斯位置和协方差，维持物理模型与图像观测的可微耦合。SPH支持线弹性、超弹性、Kelvin–Voigt黏弹响应，以及固定、自由、Robin边界。数值研究用有限元验证SPH，比较以高斯中心直接作为表面粒子的常规方案，并演示梁、桥和肝脏形状正向仿真；逆问题从渲染形变（包括噪声情况）估计材料和边界参数。

Insight: 独立生成力学粒子并可微映射到渲染表示，可将视觉重建扩展为可解释力学分析；摘要未报告误差和效率定量结果。

Abstract: Recent advances in generative world models have increased interest in digital models that reproduce both the appearance of real objects and their response to physical interaction. Three-dimensional reconstruction techniques, including 3D Gaussian Splatting, capture detailed surface geometry and appearance from images and videos. However, extending these representations beyond plausible animation to mechanically interpretable models for constitutive behavior, boundary conditions, and inverse parameter identification remains less explored. In this work, a differentiable Lagrangian-coupled 3DGS-smoothed particle hydrodynamics (SPH) model is proposed for forward simulation and inverse analysis of deformable solids. The observed object is first reconstructed from multi-view calibrated visual dataset as a 3DGS rendering model. An envelope-based procedure then generates an independent SPH support for the solid-mechanics model, avoiding the direct use of rendering primitives as mechanical particles. A reference-configuration Lagrangian transfer maps SPH deformation to Gaussian positions and covariances, thereby coupling the physical model and the image observation model while preserving a differentiable computational path. The SPH formulation supports linear elastic, hyperelastic, and Kelvin–Voigt viscoelastic responses, together with fixed, free, and Robin-type boundary conditions. Numerical studies validate the SPH response against finite-element results, assess accuracy and efficiency against a conventional model using Gaussian centers as surface SPH particles, and demonstrate forward simulations on beam, bridge, and liver-shaped examples. Inverse analyses further estimate constitutive and boundary parameters from rendered deformation observations, including noisy cases, demonstrating the feasibility of the proposed model for mechanics-based parameter identification from image data.

[25] Synthetic-to-Real ViT-Based Pose Estimation of a Noncooperative UAV cs.CVPDF

Krishnanujam Srinivas, Hanish Acharla, Brij Agrawal, Leonardo Herrera

TL;DR: 评估仅用合成标注训练的DINOv2视觉Transformer对非合作无人机单目位姿估计的真实域泛化。

Details

Motivation: 远距观测未预先标记或控制的无人机需要图像位姿估计，但真实姿态标注数据采集昂贵；纯合成训练模型必须处理合成到真实域差距及投影/对称性位姿歧义。

Result: 模型采用自监督DINOv2骨干，仅在带标签合成图像上训练、在真实图像评测；训练与推理结合位姿歧义感知策略，并在推理时加α-β滤波器。对77,077张有标签真实无人机图像，滤波前平均角误差19.18°、时延13.25ms；滤波后误差8.74°、时延13.42ms。

Insight: 轻量时序滤波大幅改善单帧姿态估计而只略增延迟；实验评测了大型真实标注集，但摘要未给域间机型分布等细节。

Abstract: Remote pose estimation of noncooperative Unmanned Aerial Vehicles (UAVs) from imagery is critical, as they cannot be influenced or instrumented in advance. Deep-learning-based approaches offer a promising solution; however, their development is constrained by the cost and difficulty of acquiring large-scale real-world datasets with accurate pose labels. Synthetic imagery provides an alternative, but models trained on synthetic data must overcome the synthetic-to-real domain gap to generalize to real-world imagery. This work investigates the inherent synthetic-to-real generalization capability of a Vision Transformer (ViT)-based model for monocular UAV pose estimation. The proposed approach employs a self-supervised DINOv2 backbone and is trained exclusively on labeled synthetic imagery while being evaluated on labeled real-world imagery. Pose ambiguity-aware strategies are incorporated during training and inference to address ambiguities arising from the projection of a three-dimensional target onto a two-dimensional image plane and from target symmetries. An $α$-$β$ filter is further integrated during inference to improve pose estimations. To assess the model under operational requirements, it is evaluated in terms of Mean Angular Error (MAE) and inference time, both before and after filtering, using a real-world dataset containing 77,077 labeled UAV images. Before filtering, the model achieves an MAE of $19.18^{\circ}$ and an inference time of $13.25$ ms, whereas after filtering, these values are $8.74^{\circ}$ and $13.42$ ms, respectively.

[26] LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning cs.CV | cs.GRPDF

Sinan Wang, Jinjin He, Yuchen Sun, Duowen Chen, Shenyifan Lu

TL;DR: 提出LoCoSplat，以固定邻域特征平均和小型点式MLP实现实时前馈3D高斯泼溅新视角合成。

Details

Motivation: 前馈3DGS常用大型学习三维网络聚合多视角证据；但高斯是局部原语，深度确定后所需尺度、旋转和不透明度可由锚点邻域信息提供，不一定需要复杂动态三维网络。

Result: LoCoSplat将16维点特征线性投影后泼溅到细、粗两级网格，在各锚点读回并用14万参数点式MLP预测属性；无学习三维网络及动态稀疏计算，编码器可作为单一FP16 CUDA图运行。RealEstate10K上6、12、24视图时PSNR、SSIM、LPIPS均优于先前前馈方法，24视图较VolSplat高3.3 PSNR；迁移到ACID零样本和ScanNet微调后优势更大。单张RTX PRO 6000上6视图重建耗时33ms，为七个前馈方法最快、比此前最佳快4.2倍；训练快2.7倍（24视图时5.9倍），推理显存少6.7倍。

Insight: 固定局部上下文足以支撑轻量高斯属性预测，使多视图重建兼得速度和质量；显存、速度数据基于特定GPU实现。

Abstract: Feed-forward 3D Gaussian Splatting (3DGS) increasingly aggregates multi-view evidence with heavy learned 3D networks. We propose LoCoSplat (Local-Context Splatting), motivated by the observation that a Gaussian is a local primitive: once depth is predicted, what the 3D stage must add (scale, rotation, opacity) depends on the point cloud around each anchor, and a fixed local average of that neighbourhood is enough to supply it, no heavy network required. LoCoSplat realises exactly this average: it splats a 16-d linear projection of the point features into a fine and a coarse grid and reads both back at each anchor with a 0.14M-parameter pointwise MLP; with no learned 3D network and no dynamic sparse computation, its whole encoder runs as one fp16 CUDA graph. On RealEstate10K, LoCoSplat outperforms every prior feed-forward method on PSNR, SSIM, and LPIPS at 6, 12, and 24 views, with a margin that widens as views densify (+3.3 PSNR over VolSplat, the prior voxel-aligned state of the art, at 24 views) and grows further under zero-shot transfer to ACID and fine-tuning on ScanNet. It reconstructs a 6-view scene in 33 ms on one NVIDIA RTX PRO 6000 GPU, the fastest of seven feed-forward methods and $4.2\times$ faster than the previous state of the art, trains $2.7\times$ faster ($5.9\times$ at 24 views), and uses $6.7\times$ less inference memory.

Wanke Xia, Ruiding Zhu, Xingguo Xu, Zhengbo Zhang, Dongxia Liu

TL;DR: 提出TRIM-ReID，以稠密身份特征、模态内token去冗余与模态间关系交互统一RGB、近红外及热红外重识别。

Details

Motivation: 现有多模态重识别编码器偏重全局图文对齐，并以学习分数挑token，易丢失细粒度身份线索、保留重复patch，造成局部证据不足且跨模态交互噪声大、成本高。

Result: DIR利用DINOv3提取语义丰富且空间连贯的身份patch；TDM挖掘互补局部线索，抑制冗余并构成紧凑模态专属token集；MRI融合保留token，并以三角对齐损失约束独立选择下的跨模态语义关系。在RGBNT201、RGBNT100和MSVR310实验中，TRIM-ReID达到当时最先进表现。

Insight: 先保留模态内多样身份信息再做跨模态交互，可兼顾局部辨别性与计算效率；摘要未报告具体指标或压缩幅度。

Abstract: Multi-modal object re-identification exploits complementary RGB, near-infrared (NIR), and thermal-infrared (TIR) observations to retrieve target objects. However, existing methods commonly employ visual encoders optimized for global image-text alignment and select tokens using learned importance scores. Such designs fail to preserve fine-grained identity cues or explicitly account for token redundancy, resulting in underrepresented local evidence and duplicated tokens that lead to noisy and costly cross-modal interaction. To address this gap, we propose TRIM-ReID, a compact framework that unifies dense feature extraction, intra-modal token reduction, and inter-modal aligned interaction. Specifically, semantically rich and spatially coherent patch features are extracted by Dense Identity Representation (DIR), which leverages DINOv3 to preserve fine-grained identity information. We then introduce Token Diversity Mining (TDM) to identify complementary local evidence and construct compact modality-specific token sets by suppressing repetitive patches while preserving informative diversity. Retained tokens are subsequently fused by Modal Relational Interaction (MRI) to enable effective information exchange across modalities, while a triangular alignment loss explicitly regularizes their joint relationships to maintain cross-modal semantic consistency under independent token selection. Extensive experiments on RGBNT201, RGBNT100, and MSVR310 demonstrate that TRIM-ReID achieves state-of-the-art performance.

[28] Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assets cs.CVPDF

Muyao Wang, Chen Zhu, Shiqi Yang, DongHyun Hwan, Hideki Nakayama

TL;DR: 提出VeriEdit-Bench，以确定性四轴指标评测结构化真实资产上的细粒度指令式图像编辑。

Details

Motivation: 图像编辑除了视觉合理，还必须精准改动指定属性并保持其他内容不变；现实图像基准常靠人工或VLM判断，而确定性评估多限于合成形状或图表，难定位编辑执行和意外变化。

Result: 基准从153个SVG图形、图表、网页界面和幻灯片源代码生成1,740个案例。受控源码编辑保留原视觉背景并生成精确目标图、像素编辑掩码与显式规格，可分别测编辑忠实度、保留、定位及变化幅度。11种编辑器评测发现，最强模型仍远未满分；同一重着色操作在图表与SVG排名会反转；像素准确率相似的输出在定位精度及改变量上仍可差别很大。

Insight: 分轴确定性评估能区分整体分数掩盖的局部编辑能力与失败模式；基准依赖可编辑结构化资产，难覆盖自然图像全部编辑需求。

Abstract: Fine-grained image editing requires more than producing a visually plausible result: an editor must execute the requested attribute change precisely while leaving everything else intact. However, existing benchmarks leave a critical gap between realism and verifiability: benchmarks built on realistic images typically rely on human or vision–language model judgments, while deterministic evaluation has largely focused on synthetic shape canvases, with application-oriented extensions primarily limited to charts. This makes it difficult to determine precisely how much of a requested edit was executed, where unintended changes occurred, and whether small differences between models reflect genuine editing capability or evaluator uncertainty. To bridge this gap, we present VeriEdit-Bench, a benchmark for fine-grained, instruction-faithful image editing across realistic structured assets with deterministic, four-axis evaluation. Its 1,740 cases are compiled from the source code of 153 Scalable Vector Graphics (SVG) graphics, charts, web interfaces, and presentation slides. Controlled source-code edits preserve the original visual context while yielding exact target images, pixel-level edit masks, and explicit edit specifications, enabling reproducible scoring along four axes: edit fidelity, preservation, localization, and magnitude. Evaluating eleven editors, we find that even the strongest model remains far from full credit; rankings for the same recoloring operation reverse between charts and SVG graphics; and outputs with similar pixel-accuracy profiles can still differ substantially in localization and change magnitude. This decomposition yields graded, verifiable feedback and exposes model-specific capability and failure profiles that holistic scores or evaluator-dependent judgments may obscure.

[29] Detecting Defects that Matter: An Application-Driven Benchmark for Anomaly Detection in Manufacturing and Retail Logistics (VAND 4.0 Challenge) cs.CVPDF

Lars Heckler-Kram, Dorian Henning, Ashwin Vaidya, Jan-Hendrik Neudeck, Ulla Scheler

TL;DR: 总结VAND 4.0工业制造与零售物流异常检测挑战结果，并提出面向稀有缺陷及分布变化的评测基准。

Details

Motivation: 异常检测基准普遍接近饱和且不够贴近部署；工业与零售中的低频缺陷、域偏移和资源消耗仍是实际难点。

Result: MVTec AD 2工业赛道中，常规设定最佳无监督分割仅约57%像素SegF1，零样本方法再低约15点，分布偏移仍困难，DINOv3骨干占优。Kaputt 2零售赛道中常见缺陷监督检测接近饱和，但现成VLM比专用模型低约28 AP，参考图像对领先方案无明显帮助；稀有洒漏与缺件分别仅约53和27 AP，受数据量限制。作者发布低患病率零售异常数据Kaputt-Rare，并把性能、吞吐、内存和功耗合为效率评估，发现高性能方法多用重型架构。

Insight: 工业和零售异常检测需要面向稀有缺陷、分布变化及部署效率的真实评估；当前现成VLM尚不能替代微调专用检测器。

Abstract: Existing Anomaly Detection benchmarks are saturated and often unrealistic. As part of the VAND 4.0 Challenge, we introduce a hidden-test, application-driven benchmark across two deployment-critical domains: industrial manufacturing and retail logistics. In the Industrial Track (MVTec AD 2), the results reveal that unsupervised anomaly segmentation remains challenging: the best regular-setting method achieves only ~57% pixel-level $SegF_1$, indicating substantial room for improvement. Zero-shot approaches trail by ~15 $SegF_1$ points, confirming that task-specific training on normal data remains essential for precise defect localization. Robustness to distribution shifts remains a key open challenge and DINOv3-backbones clearly dominate this track. In the Retail Track (Kaputt 2), the results reveal that (1) supervised defect detection is approaching saturation for common defect types; (2) the best off-the-shelf VLM approach trails specialized models by ~28 AP, confirming that currently VLMs cannot replace fine-tuned detectors, (3) reference images did not prove helpful for top-performing approaches. Performance collapses on rare defects (spillage ~53 AP, missing units ~27 AP), where the supervised ceiling is bounded by data availability. To drive future progress in this domain, we provide a new low-prevalence retail AD dataset (Kaputt-Rare). Across both tracks, computational efficiency is assessed as a first-class metric combining performance, throughput, memory, and power consumption. We introduce a novel metric for measuring efficiency and reveal that that top-performing methods rely on heavy architectures while efficiency is largely neglected. Overall, we conclude that the community needs (a) more efficiency-aware method development, and (b) true anomaly detection approaches for rare defects and shifting conditions. https://sites.google.com/view/vand4-cvpr2026/challenge

[30] Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos cs.CV | cs.AI | cs.ROPDF

Jinzhou Tang, Zijun Zhang, Jing Yang, Yuchen Yan, Kun Zhou

TL;DR: 提出Video2World基准，评估编码代理能否根据具身视频自动构建可执行模拟环境及机器人行为。

Details

Motivation: 真实观察构建交互模拟器有望扩展具身训练数据，但当前流程仍大量依赖人工环境搭建和校准；需评估前沿模型能否闭环自动化。

Result: Video2World将自动视频到模拟任务视为软件工程：代理观察视频，搭建对应模拟环境和机器人行为，再根据运行反馈迭代。基准含189段机器人及人类示范视频导出的222个重建实例，评测几何保真、动态保真与功能正确性。对9种前沿编码代理评测发现，从Claude Opus 5起任务成功率明显提高，从低于5%升至超过15%，但仍明显落后于人类辅助重建。外观更好并不必然意味着任务成功率更高。

Insight: 可执行性和动态功能需与视觉重建质量分开评估；当前代理仍需大量进步，视觉逼真不能代替物理与功能正确。

Abstract: Building interactive simulators from real-world observations is a promising way to scale embodied data, but current pipelines still rely heavily on manual environment construction and calibration. We study whether frontier foundation models and coding agents can automate this process end to end. We formulate \emph{autonomous video-to-simulation} as a software engineering task in which an agent observes an embodied video, constructs the corresponding simulated environment and robot behavior, and iteratively refines the result through execution feedback. To evaluate this capability, we introduce \textbf{Video2World}, a benchmark comprising 222 reconstruction instances derived from 189 robot and human demonstration videos. Video2World measures reconstructed worlds along geometric fidelity, dynamic fidelity, and functional correctness, capturing spatial perception, physical reasoning, and executable interaction. Evaluating 9 frontier coding-agent systems reveals a sharp improvement in Task success beginning with Claude Opus 5, rising from below 5% to over 15%, while substantial gaps to human-assisted reconstruction remain. We further find that worlds that look better could work worse: better visual fidelity does not always lead to higher task success. This echoes the broader gap between perceptual realism and factual correctness observed in generative models.

[31] AgroGround: Multi-Granularity Grounded Recognition in Agriculture cs.CV | cs.AIPDF

Abdulla Alshehhi, Zongyan Han, Rao Anwer

TL;DR: 构建AgroGround大规模农业图像识别与定位数据集，并训练VLM同时识别对象、定位区域且在健康图像上弃答。

Details

Motivation: 农业模型通常分开评估识别或定位，但诊断需要知道目标是什么及图像中证据在哪；农业VQA标签未与图像区域连接，人工补标扩展成本高。

Result: 自动流水线把八个农业VQA数据集标签转换成病斑和整物体区域，生成794,850条指令样例；健康图像为病害问题提供空预测负监督。训练共享VLM并混合已知目标定位与识别+定位指令。在1,480张与训练集不重叠的人审图像上，仅定位微调使识别准确率从51.8%跌至29.1%，加入联合指令后升至72.6%；固定图像和标注时，两格式联合使联合正确率从19.2%升至43.3%，定位表现相近。健康负例使健康图像弃答率达95.0%，RL进一步改善病斑定位；2B模型在本基准及PlantSeg外部测试上的定位F1超过标注教师。

Insight: 联合训练识别与定位任务避免只优化定位导致识别退化，并通过健康负例学习弃答；农业VQA自动转标区域的质量仍需人审测试监控。

Abstract: Agricultural visual models are typically evaluated for either recognition or localization, but reliable diagnosis requires identifying what is present and localizing the evidence. Agricultural visual question answering (VQA) datasets carry rich semantic labels but rarely link them to image regions, and adding such annotations by hand is costly at scale. We introduce AgroGround, a large-scale dataset for grounded agricultural recognition: identifying plant diseases and other agricultural targets and localizing their image regions. An automated pipeline converts the labels of eight agricultural VQA datasets into annotations for disease lesions and whole objects, producing 794,850 instruction examples. Healthy images provide negative supervision for disease queries, teaching the model to return empty predictions. We fine-tune a shared vision-language model on known-target grounding instructions combined with instructions requiring both recognition and localization. We evaluate predicted identities, regions, joint correctness, and healthy-image abstention on 1,480 human-verified images disjoint from all training data. Grounding-only fine-tuning reduces recognition accuracy from 51.8% to 29.1%, while adding recognition-and-localization instructions raises it to 72.6%. With images and annotations held fixed, combining the two formats raises joint accuracy from 19.2% to 43.3% at comparable grounding. Healthy negatives raise abstention on healthy images to 95.0%, and reinforcement learning improves lesion-level grounding. The resulting 2B model exceeds its annotation teacher in grounding F1 on our benchmark and on the external PlantSeg test set. AgroGround establishes a benchmark for grounded agricultural recognition, measuring joint correctness of identity and localization along with abstention on healthy images. The code is available at https://github.com/AB-Abdulla/AgroGround.

[32] RPFQ-ViT: Rotated Phase-Frame Quantization for Extremely Low-Bit Weights in Vision Transformers cs.CVPDF

Mengyuan Fan, Bokai Huang, JiaMing Pan, Xiaokun Yuan, Peizhuang Cong

TL;DR: 提出RPFQ-ViT，用旋转相位平面量化成对通道，在超低比特ViT权重下保留投影方向。

Details

Motivation: ViT线性投影和注意力计算造成存储与推理成本；传统实数标量码本不匹配Transformer投影方向几何，极低比特量化容易显著掉点。

Result: RPFQ-ViT作为nn.Linear的QAT替换项，在二维相位平面联合量化通道、用轻量缩放恢复幅度，保留标准实值注意力等计算图。ImageNet-1K上，ViT-B/16在W2/A4达79.33% Top-1和94.48% Top-5；Swin-T W2/A8为79.30%/94.79%；DeiT-S W2/A8为77.41%/93.11%。三次独立300轮训练取均值。原生iOS/Android部署时，2比特打包权重较FP32缩小约5.4至7.1倍，端到端设备时延降低1.4至1.6倍。

Insight: 利用投影方向几何可在低比特下维持较强ImageNet表现，并具备移动端原生部署证据；量化成绩依赖匹配训练配方和特定运行时。

Abstract: Vision Transformers (ViTs) achieve strong performance on image recognition and mobile vision applications, but their high-dimensional linear projections and attention computations still impose substantial storage and inference costs. Extremely low-bit quantization is a promising solution, yet ViTs often suffer severe accuracy degradation because conventional real-valued scalar codebooks are poorly matched to the directional geometry of Transformer projections. We present RPFQ-ViT, a Rotated Phase-Frame Quantization method that quantizes paired channels in two-dimensional phase planes, enabling low-bit codes to better preserve projection directions while recovering magnitude with lightweight scaling. RPFQ-ViT serves as a drop-in QAT replacement for nn.Linear and does not modify the standard real-valued attention, normalization, or activation computation graph. On ImageNet-1K, RPFQ-ViT-B/16 reaches 79.33% Top-1 / 94.48% Top-5 under W2/A4, Swin-T reaches 79.30% Top-1 / 94.79% Top-5 under W2/A8, and DeiT-S reaches 77.41% Top-1 / 93.11% Top-5 under W2/A8. Ablations, phase-geometry analysis, and direction-preservation metrics show that channel pairing, learnable rotation, phase-anchor learning, and residual phase refinement each improve quantization quality. We further deploy RPFQ-ViT image-classification models on native iOS and Android runtime stacks; with 2-bit packed weights, model size shrinks by roughly $5.4$-$7.1\times$ relative to FP32 and end-to-end on-device latency drops by $1.4$-$1.6\times$. All ImageNet results trained in our codebase use a matched 300-epoch recipe and are reported as mean accuracies over three independent runs. These results show that RPFQ-ViT provides a favorable trade-off among accuracy, compression, and practical mobile deployment for extremely low-bit ViTs.

[33] Localization Lens for Improving Medical Vision-Language Models cs.CV | cs.AIPDF

Hasan Farooq, Murtaza Taj, Mehwish Nasim, Arif Mahmood

TL;DR: 提出定位感知增强Med-VLM的三层方案，用专家验证定位表示、像素重排及解耦对比损失改善解剖空间推理。

Details

Motivation: 医学VLM虽能处理临床任务，但常难理解解剖结构和空间位置，而这些信息对医学推理至关重要。

Result: 方法在数据、架构、对齐层面引入定位镜头：专家验证的解剖与位置表示提供上下文；像素重排筛选细化复杂表征且保留解剖连续性；解耦对比损失与常规损失共同对齐定位与文本特征，尤其面向数据有限情形。多个Med-VQA数据集和不同Med-VLM架构的实验显示定位相关表现提高；定位问题分析中，解剖与空间推理提升使整体准确率最高增加6.2%。方案与模型无关，可集成到现有管线。

Insight: 显式定位表征为医学问答加入解剖线索，最大报告提升6.2%；摘要未列模型/数据集逐项结果。

Abstract: Medical Vision-Language Models (Med-VLMs) have demonstrated strong capabilities in clinical tasks. However, they often struggle to understand anatomical structures and spatial positioning, which are crucial for medical reasoning. To address this, we propose a localization-aware enhancement to the Med-VLM pipeline, introducing improvements at three levels: data,architecture, and alignment. First, we introduce localization lens, a set of expert-validated representations that provide richer anatomical and positional context. However, as these representations increase input complexity, we integrate pixel shuffle within the model architecture to filter and refine representations, enhancing spatial information processing while preserving anatomical continuity. Lastly, to effectively align the localization lens representations with textual features, we incorporate decoupled contrastive loss (DCL) alongside the standard loss function. This ensures better feature discrimination and robustness, particularly in data limited medical settings. Through extensive evaluations on medical visual question answering (Med-VQA) datasets, we show that our methodology improves localization-driven performance across different Med-VLM architectures. Our analysis of localization-based questions further reveals that improvements in anatomy and spatial reasoning directly enhance the overall accuracy of Med-VQA upto 6.2%. The proposed approach is model-agnostic and can be seamlessly integrated into existing Med-VLM pipelines. The dataset, code, and trained models will be made publicly available at https://github.com/CVLABLUMS/localizationlens.

[34] EgoExo-Next:Benchmarking Vision-Language Models on Visual-Option Next-State and Cross-View Reasoning cs.CV | cs.AIPDF

Yutong Li, Molin Wang, Xiaotong Li, Yanyan Fang, Daoguo Dong

TL;DR: 提出EgoExo-Next视觉选项基准，评测VLM预测动作后的下一视觉状态并组合第一人称与第三人称视角推理。

Details

Motivation: 现有自我中心及跨视角视频基准多测语义事件、时间关系或已观察视角对应，未充分评测模型对未来视觉状态的直接推理。

Result: 基准含来自六个公开自我中心及ego-exo视频源的2,503道人审四选题，涵盖自我中心下一状态、双向跨视角状态对应、第三人称下一状态及组合ego-to-exo下一状态四项任务。专有、开源和空间推理VLM评估中，最佳模型平均准确率43.81%，人类98.55%；组合跨视角任务退化最大。

Insight: 当前VLM在动态视觉状态推理上与人类差距很大，尤其组合时间推进与跨视角变换时；基准直接测视觉选项而非只判动作或文字。

Abstract: Vision-language models (VLMs) are increasingly evaluated for egocentric and cross-view video reasoning, yet existing benchmarks largely focus on semantic event understanding, temporal relations, or correspondence between already observed views, leaving their ability to reason directly about future visual states underexplored. We introduce EgoExo-Next, a visual-option benchmark for dynamic visual-state reasoning, where models must identify how an observed action trajectory subsequently appears rather than predict only an action label or textual description. EgoExo-Next contains 2,503 human-curated four-choice questions from six public egocentric and ego–exo video sources and comprises four interconnected subtasks that evaluate egocentric next-state prediction, bidirectional ego–exo state correspondence, exocentric next-state prediction, and their composition in Ego-to-Exo Next-State. Extensive evaluation of proprietary, open-source, and spatial reasoning VLMs reveals a substantial human–model gap, with the best model achieving 43.81% average accuracy compared with 98.55% for humans, and the largest degradation occurring on the composed Ego-to-Exo task. These results suggest that current VLMs remain substantially limited in dynamic visual-state reasoning, particularly when temporal progression and cross-view reasoning must be composed. The benchmark is publicly available at \url{https://huggingface.co/datasets/yutongli2024/EgoExo-Next}.

Yimiao Zhou, Zejia Zhong, Jingya Wang, Ye Shi

TL;DR: 提出FASTER，为每个源图与目标奖励训练小型编辑网络，通过复用候选及反馈加速奖励导向图像编辑。

Details

Motivation: 测试时奖励优化需改善指定目标，同时保留源内容和视觉合理性；不少方法反复运行昂贵生成模型，甚至对骨干反向传播。

Result: 作者建立同时描述奖励、源图保持和预训练先验偏好的理论框架，允许将目标输出分布与实现该分布的动态过程区分。FASTER为每个源图和目标训练小网络，由预训练生成器及奖励模型提供候选反馈；每个候选与反馈可支持多次网络更新，且大模型不在内层优化环路。SD3上在所评方法中领先全部四项目标指标和多项验证指标；对比沿预训练生成轨迹优化控制的方法，Stable Diffusion 3最高快6.91倍、SD1.5最高快24.14倍。

Insight: 将昂贵生成骨干移出内循环并复用评分，可降低个性化测试时编辑成本；加速倍率针对所评模型和基线。

Abstract: Reward-guided image editing at test time seeks to improve a specified reward while preserving source content and visual plausibility. Many existing approaches optimize candidates through pretrained generation processes, making repeated adjustment depend on costly large-model execution and, in some cases, backbone backpropagation. We develop a theoretical framework that jointly accounts for reward, source preservation, and pretrained-prior preferences, allowing the desired output distribution to be specified separately from the dynamics used to realize it. Based on this framework, we introduce FASTER, which trains a small network for each source and objective to perform inexpensive editing, while pretrained and reward models provide feedback on candidate outputs. By reusing each candidate and its feedback across multiple small-network updates, FASTER reduces repeated sampling and supervision queries without placing the pretrained generative backbone inside the inner optimization loop. On SD3, FASTER leads all four target metrics and several validation metrics among the evaluated methods. Compared with the evaluated baseline that optimizes controls along pretrained generation trajectories, FASTER achieves editing-time speedups of up to ({6.91\times}) on Stable Diffusion 3 and ({24.14\times}) on Stable Diffusion 1.5.

[36] EagleDepth: Efficient Fine-Grained Depth Estimation via Pixel Diffusion Decoder cs.CVPDF

Bowen Chai, Tianbao Zhang, Shuyu Wu, Dexin Zuo, Zhaoxin Fan

TL;DR: 提出EagleDepth，将潜在扩散的几何先验用于像素空间深度生成，以高分辨率保留细节并避免VAE解码开销。

Details

Motivation: 高分辨率单目深度需细致几何，但潜空间建模和VAE重建会损失几何细节，潜变量解码还增加推理成本。

Result: EagleDepth保留深度感知潜特征作指导，最终深度图直接在像素空间生成。先用RGB—深度配对监督微调预训练潜扩散模型，再将预训练像素扩散解码器PiD适配为以学得特征为条件的深度预测器；像素支路从1024分辨率训练并逐步扩至4K，潜支路只处理缩小RGB图，从而不需潜骨干运行在输出分辨率，也绕开原VAE解码器。在五个常用深度基准及高分辨率Synth4K上，达到当时最先进深度性能，推理更快且能更好保留细结构和物体边界。

Insight: 低分辨率潜在几何指导结合高分辨率像素扩散，有望兼顾全局先验与局部精度；摘要未提供具体精度及加速数值。

Abstract: Recovering detailed geometry from high-resolution images is critical for precise perception of the surroundings and objects. However, existing methods which use latent-space modeling and VAE reconstruction can compromise geometric details. Furthermore, decoding from latent codes introduces substantial inference overhead. To address those issues, we present EagleDepth, an efficient framework for high-resolution monocular depth estimation that combines the geometric priors of latent diffusion with fine-grained pixel-space generation. Our key idea is to retain depth-aware latent representations as guidance while generating the final depth map directly in pixel space. We train the latent and pixel components sequentially: first, we fine-tune a pretrained latent diffusion model using paired RGB–depth supervision; then, we adapt a pretrained pixel diffusion decoder, PiD, to predict depth conditioned on the learned features. Training of the pixel component starts at 1024 resolution and continues across multiple resolutions up to 4K. The latent branch processes resized, lower-resolution RGB images, while the pixel branch generates depth at the target resolution, bypassing the original VAE decoder. This design preserves learned geometric knowledge without requiring the latent backbone to operate at the output resolution. On five commonly used depth estimation datasets and the high-resolution Synth4K dataset, our framework achieves state-of-the-art depth estimation performance, with faster inference and better preservation of fine structures and object boundaries.

Tinghe Zhang, Chunyu Liu, Yu Leon Liu, Zerui Zhao, Jiaheng Chen

TL;DR: 指出单帧JEPA目标结构上缺少速度信息，并提出TI-JEPA把姿态与显式有限差分运动编码分开预测。

Details

Motivation: JEPA用当前单帧嵌入与动作预测下一帧嵌入，但无运动模糊时单帧只含场景构型，不含速度，因此即使编码器能力强也无法为速度相关规划提供信息。

Result: 在PushT、Reacher、Cube、TwoRoom四个真实基准官方LeWM检查点上，线性速度探针均不高于机会水平，而位置探针R²约0.95。作者提出三阶段诊断RateIdent及TI-JEPA，将潜变量拆为姿态和显式有限差分运动码并联合预测。三个物理环境的停在目标规划任务上，TI-JEPA相对同记忆量基线稳定提升：Pendulum最终距离低55%（p=3.2×10^-10），CartPole低64%（p=5.1×10^-15）。真实dm_control Reacher照片从头训练时，分支分离效果约为有记忆基线的38倍。

Insight: 速度敏感任务不应只预测单帧目标；明确拆分姿态与动态可在无需特权监督下修复盲点，结果覆盖六种环境。

Abstract: Joint-embedding predictive architectures (JEPAs) for world modeling train an encoder so a predictor maps a current embedding and action to the next frame’s embedding, always from a single rendered frame. This has a structural blind spot: a renderer without motion blur draws a scene from configuration alone, so a single-frame embedding carries no velocity information, for any encoder, including the official released LeWM weights. We confirm this on official checkpoints across four real benchmarks (PushT, Reacher, Cube, TwoRoom): every linear velocity probe sits at or below chance while position probes reach R^2 about 0.95. We introduce RateIdent, a three-stage diagnostic protocol, and TI-JEPA, a lightweight fix splitting the latent into a pose code and an explicit finite-difference motion code, predicted jointly. Across three physically grounded environments, TI-JEPA gives a significant, seed-robust gain on a stop-at-goal planning task over a matched-memory baseline, e.g. 55% lower final distance on Pendulum (p=3.2x10^-10) and 64% on CartPole (p=5.1x10^-15). We reproduce this at official ViT-Tiny plus AdaLN-transformer scale, then push the same recipe onto real dm_control Reacher photographs trained from scratch, where TI-JEPA’s branch separation exceeds the memory-having baseline’s by roughly 38x, the paper’s largest margin. Against a same-footprint recurrent RSSM-style predictor, TI-JEPA matches or beats its rollout accuracy on two of three environments, stays separately probeable for pose and motion, and wins outright on the most coupled one. A checkable formal argument and six evaluated environments show single-frame targets are the wrong object to predict when velocity matters, and a small, interpretable structural change fixes it with no privileged supervision. Code, checkpoints, and the project page are linked below the title.

[38] Organize Primitives into Semantic Parts: Reinforcement Reasoning for 3D Segmentation cs.CVPDF

Xiaoming Gong, Ruoyu Wu, Zhenhong Sun, Chunlin Chen, Daoyi Dong

TL;DR: 提出RePart，将几何原语合并为语义部件的过程建模为有限时域决策问题，并用强化推理优化最终分区。

Details

Motivation: 基于原语的3D分割紧凑且利于定位边界，但几何分解不能自动确定原语如何组成语义部件：一个部件可跨多个原语，接触或相似原语也可能属于不同部件。

Result: RePart从细粒度超二次体构建可组合工作空间，采用合并/停止策略，按对最终分区的下游影响优化决策，而非只看局部几何相容度；随后用边界感知表面标注把部件身份映射回原始网格。在PartNet四项汇总分区指标均为最佳；在3DCoMPaT++上无需目标数据微调便获最高Rand Index与SC。

Insight: 语义分组需面向整体分区回报推理，并将结果映回细网格以保留边界精度；摘要未列出具体指标值。

Abstract: Primitive-based 3D segmentation offers a compact and explicit alternative to dense surface prediction, naturally supporting structural abstraction and boundary localization. However, geometric decomposition alone does not determine how primitives should be organized into semantic parts: a single part may span multiple primitives, while geometrically similar or touching primitives may belong to different parts. We therefore introduce RePart (Reinforcement Part Reasoning), which formulates primitive-to-part organization as a finite-horizon Markov decision process and learns semantic organization through trajectory-level reinforcement reasoning. RePart constructs a Composable Primitive Workspace from fine-grained superquadrics and applies a merge-and-stop policy whose decisions are optimized by their downstream effects on the resulting partition rather than local primitive compatibility. The inferred part identities are then mapped back to the original mesh through Boundary-Aware Surface Labeling, preserving accurate surface boundaries beyond the primitive approximation. On PartNet, RePart achieves the strongest results across all four aggregate partition metrics; on 3DCoMPaT++, it obtains the highest RI and SC without target-dataset fine-tuning. These results demonstrate that reinforcement reasoning provides an effective mechanism for organizing geometric primitives into semantic parts while retaining dense segmentation accuracy. Code is available at https://github.com/EngineeringAI-LAB/RePart.

[39] ConEx: Human-Interpretable Saliency Maps via Concept-Aware Attribution cs.CV | cs.AI | cs.LGPDF

Yehonatan Elisha, Oren Barkan, Ziv Weiss Haddad, Noam Koenigstein

TL;DR: 提出ConEx概念归因框架，从图像自动发现类别概念，并生成能对应语义概念的忠实显著图。

Details

Motivation: 常见视觉解释突出像素重要性，却难将低层线索连接到有意义概念，限制了可解释性和可信度。

Result: ConEx无人工概念监督地学习概念激活向量，利用架构专用掩码机制减少分割掩码引入的噪声、提升概念纯度，并展示概念出现位置及其对预测的贡献。作者提出向量—概念匹配VCM和概念—类别匹配CCM两项指标，用于评估对齐并与现有方法比较。多种设置下，在忠实度、分割和概念质量基准上达到当时最先进结果。

Insight: 概念级归因把像素显著性提升到可读语义层面；结果质量依赖自动发现概念及所提度量，摘要未给具体数字。

Abstract: Many visual explanation methods in computer vision highlight pixel importance but struggle to link these low-level cues to semantically meaningful concepts, limiting their interpretability and trustworthiness. We introduce Concept-based Explanations (ConEx), a novel framework that bridges saliency visualization with concept-based reasoning to provide both faithfulness and interpretability. ConEx automatically discovers class-specific concepts and represents them through concept activation vectors (CAVs), learned without manual supervision using an architecture-specific masking mechanism that reduces noise introduced by the segmentation masks to enhance concept purity. ConEx generates faithful saliency maps that reveal where each concept appears in the image and how it contributes to the prediction. To evaluate the reliability of these learned concepts, we propose two complementary metrics, Vector-Concept Match (VCM) and Concept-Class Match (CCM), that quantify concept alignment and enable direct comparison with existing methods. Extensive experiments across diverse settings demonstrate that ConEx achieves state-of-the-art performance on faithfulness, segmentation, and concept-quality benchmarks. Overall, ConEx advances the field toward truly interpretable and concept-grounded explanations in vision models.

[40] Sparse-View 4D Gaussian Splatting via Spatiotemporal Priors and Generative Assistance cs.CVPDF

Shengqi Wang, Zhengxian Yang, Kaiwen Tian, Yang Liu, Bowen Liu

TL;DR: 提出面向六相机宽基线稀疏视图赛事的4D高斯泼溅框架，融合区域先验、运动时序约束和生成式虚拟视图监督。

Details

Motivation: 动态场景仅有六个宽基线相机时，视角稀疏导致几何与时间重建困难。

Result: 框架以前景掩码引导高斯初始化、按前景和背景分别控制稠密化，并以尺度对齐单目深度正则背景；再用插帧在中间时刻监督、光流约束高斯投影运动。生成式组件在角度间隙放置虚拟相机，用位姿条件扩散模型恢复图像后迭代纳入伪监督。验证集全帧PSNR由基线25.60提升至29.75dB；官方测试集全帧PSNR 30.04dB、前景27.88dB，获Sparse-View Track总排名第一。

Insight: 稀疏宽基线重建可通过时空先验与补充视角生成协同改善；生成伪视图作为监督可能受恢复图像质量影响。

Abstract: We present a 4D Gaussian Splatting framework for the Sparse-View Track of the SIGGRAPH Asia 2026 Volumetric Video Challenge, which requires dynamic scene reconstruction from only six cameras with wide baselines. To achieve robust dynamic reconstruction under such sparse views, our framework integrates three components. (1) Region-adaptive spatial priors: We use foreground masks to guide Gaussian initialization and mask voting to control densification separately for the dynamic foreground and static background. Background geometry is regularized using monocular depth aligned to metric scale. (2) Motion-consistent temporal priors: We provide supervision at intermediate times through frame interpolation and constrain projected Gaussian motion with estimated optical flow. (3) Generative assistance: We place virtual cameras in the widest angular gaps and restore their rendered images using a diffusion-based model conditioned on camera poses. The restored images are iteratively incorporated into training as pseudo-supervision. On the validation set, our framework improves full-frame PSNR from 25.60 dB for the baseline to 29.75 dB. On the official test benchmark, it achieves 30.04 dB full-frame PSNR and 27.88 dB foreground PSNR, ranking first overall in the Sparse-View Track.

[41] Task-Sensitive Geometry of Representation Transfer for Object Detection under Image Degradation cs.CVPDF

Van Vung Pham

TL;DR: 研究干净图像知识迁移到退化图像检测时的方向性表征效用，并提出基于梯度几何分析局部干预响应。

Details

Motivation: 干净图像蒸馏可提升退化图像检测总体精度，但总体收益不表明每种表征变化都对每个对象有益。

Result: 在配对BDD100K干净与高斯退化图像上，干净教师蒸馏改善检测却呈对象级异质迁移。作者分离出与直接对齐互补的表征方向，经正交桥映射至学生空间；受控干预恢复蒸馏表征下丢失对象的13.22%，而同范数随机扰动为4.30%，对已保持对象伤害很小。基于归一化检测损失梯度定义任务敏感几何；留出队列中互补方向与局部响应幅度偏相关ρ=0.242，95%CI [0.108,0.359]，独立数据ρ=0.180、RT-DETR-Lρ=0.227，但直接教师残差方向不复现且大干预减弱。由此构造的路由和蒸馏策略尚无显著优于CLEANKD的整体收益。

Insight: 表征局部响应存在任务敏感且依赖方向族的几何结构，但将其转成全局训练增益仍未解决；相关性并未转化为可靠路由改进。

Abstract: Object detection under image degradation can benefit from clean-image supervision, but aggregate gains do not imply that transferred representation changes are uniformly useful. We study how clean task knowledge affects degraded-image representations and whether local responses to structured representation directions can be characterized geometrically. Using paired clean and Gaussian-degraded BDD100K images, we show that clean-teacher distillation improves observed detection accuracy while producing heterogeneous object-level transfer. We isolate a representation component complementary to direct clean-teacher alignment and map it into the distilled student space through an orthogonal bridge. Controlled interventions rescue 13.22% of objects lost under the distilled representation, versus 4.30% under norm-matched random perturbations, with very low harm on preserved objects. We introduce task-sensitive geometry, a gradient-derived channel-space geometry constructed from normalized detection-loss gradients. On a reserved cohort, mapped-complement orientation within this frozen geometry is positively associated with local intervention-response magnitude after controlling for intervention magnitude (partial Spearman $ρ$ = 0.242, 95% CI [0.108, 0.359]). The relationship eplicates on independent data ($ρ$ = 0.180) and with RT-DETR-L ($ρ$ = 0.227), but not for the direct clean-teacher residual family, and it weakens for large interventions. Routing rules and specialized distillation objectives based on these signals do not yield statistically reliable gains over CLEANKD. These results support a local, direction-family-dependent task-sensitive geometry while showing that converting such structure into improved global training remains an open problem.

[42] FLASHSWIN: Unlocking Large Windows and Dense Tokens in Swin Vision Transformers with Memory Efficient Attention cs.CVPDF

Tushar Kataria, Gerald Sabin, Ponnuswamy Sadayappan, Shireen Y. Elhabian

TL;DR: 提出FLASHSWIN，以FlashAttention及窗口内二维RoPE降低Swin注意力内存，从而支持更大窗口和更密集token。

Details

Motivation: 高分辨率ViT需在局部token密度和感受野之间权衡；Swin标准窗口注意力显式构造M²×M²分数矩阵，内存随窗口边长呈O(M⁴)增长，相对位置偏置也要求物化分数及梯度。

Result: FLASHSWIN用不物化注意力矩阵的精确FlashAttention，将单窗内存从O(M⁴)降至O(M²)。32×32窗口时FLASHSWIN-T训练仅需12.4GB，与8×8相同；SwinV2/V1-T需70/90GB。为补回FlashAttention绕开加性相对位置偏置的空间信息，模型改用窗口局部可学习二维RoPE。密集token宽窗口设置p=2、M=32时，ImageNet-1K达84.1%准确率、COCO框AP 44.1、ADE20K mIoU 47.28，较M=16的SwinV2-T分别高1.3、5.1和1.82；相同M=32时patch减半带来的边界质量提升约为mIoU增益的三倍。

Insight: 高效精确注意力释放的内存可换取更高分辨率token与大感受野；位置偏置需重新设计，直接移除会丢失空间信息。

Abstract: High-resolution vision backbones have long been forced to trade away local token density to afford larger receptive fields. Hierarchical Swin transformers impose this compromise because standard windowed attention materializes an $M^2\times M^2$ score matrix per window, incurring $O(M^4)$ memory as windows or token grids grow. Furthermore, Swin adds a learned relative-position bias elementwise to attention scores, requiring full materialization of the score matrix and its gradient. This keeps Swin and SwinV2 trapped in a small-window($M=8,16$), coarse-token regime with patch size $4\times4$ ($p=4$), limiting performance for fine-grained tasks. We introduce FLASHSWIN, which replaces standard windowed attention with a FlashAttention implementation that computes exact softmax attention without materializing the score matrix, reducing per-window memory from $O(M^4)$ to $O(M^2)$. This enables higher token density and larger receptive fields without inflating memory overhead. Training memory is flat across window sizes: at a $32\times32$ window, FLASHSWIN-T requires only $12.4$,GB, unchanged from $8\times8$, compared to $70/90$,GB for SwinV2/V1-T. However, applying FlashAttention directly to Swin creates a trade-off: bypassing the score matrix precludes Swin’s additive relative-position bias, forfeiting spatial information in exchange for memory efficiency. FLASHSWIN restores position information as window-local learnable 2D RoPE, making large windows and dense token grids both affordable and accurate. At matched scale, FLASHSWIN-T outperforms Swin variants. With dense tokens and wide windows ($p=2,M=32$), the same Tiny model reaches $84.1%$ ImageNet-1K, $44.1$ COCO box AP, and $47.28$ ADE20K mIoU—gains of $+1.3$, $+5.1$, and $+1.82$ over SwinV2-T at $M=16$, respectively. At fixed $M=32$, halving the patch size yields roughly $3\times$ larger gains in boundary quality than in mIoU.

[43] Knossos and Ariadne: Benchmarking and Learning Complete Diagram Topology Extraction with Vision-Language Models cs.CV | cs.AIPDF

Bangwei Guo, Xujiang Zhao, Shengyu Chen, Yanchi Liu, Wei Cheng

TL;DR: 提出Knossos图示数据集和Ariadne结构化VLM框架，将完整图示拓扑抽取分解为节点清单与按源节点条件预测关系。

Details

Motivation: VLM已擅长识别图示元素和理解内容，但完整提取所有实体及关系的图拓扑仍研究不足，需大规模监督与系统评测。

Result: Knossos覆盖六个领域的19,200张图示、245,179个节点和439,740条边；符号化生成保证渲染图与完整拓扑、关系类型、连接器几何精确对齐。Ariadne先抽取节点，再条件于源节点预测边。实验显示Knossos监督显著改善较小开源VLM的完整拓扑抽取；匹配监督下结构化拆解优于一步抽取，并在基准上取得最高平均Edge F1。两种骨干适配后也超过未适配版本的真实世界外部基准表现。

Insight: 先确定节点再逐源预测边有助控制完整关系抽取复杂度；符号数据可提供精确标注，但真实场景的外部评估仍重要。

Abstract: Structural diagrams are widely used to represent complex systems and relational information across scientific, engineering, procedural, and spatial domains. Recent vision-language models (VLMs) have become increasingly capable of recognizing diagram elements and reasoning about their content, while complete diagram topology extraction remains comparatively underexplored. In this paper, we study diagram-to-graph topology extraction: extracting all diagram entities and the complete relations among them. To enable large-scale supervised training and systematic evaluation of this task, we introduce Knossos, a benchmark of 19,200 diagrams across six diverse domains, with 245,179 nodes and 439,740 edges. Its symbolic generation process provides exact alignment between rendered diagrams and annotations of complete topology, relation types, and connector geometry. To address the modeling challenge of complete topology extraction, we also present Ariadne, a structured framework that decomposes the task into node inventory extraction and source-conditioned edge prediction. Extensive experiments show that training on Knossos substantially improves complete topology extraction in smaller open-source VLMs. Ariadne further improves over one-step extraction under matched supervision, demonstrating the additional benefit of structured decomposition. It achieves the highest average Edge F1 among the evaluated methods on Knossos, while both backbone variants also improve over their unadapted counterparts on the real-world external benchmark. Code and benchmark are available at https://github.com/bangwayne/knossos_Ariadne_Public.

[44] NAMVIS: Next-Scale Autoregressive Multi-View Image Synthesis cs.CVPDF

Ramil Khafizov, Ilya Statsenko, Ruslan Rakhimov, Artem Komarichev, Peter Wonka

TL;DR: 提出NAMVIS，将稀疏视图多视角合成改写为几何条件的下一尺度自回归生成，避免扩散模型逐步去噪。

Details

Motivation: 扩散式新视角合成需多轮去噪，稀疏视角下推理成本高。

Result: NAMVIS以少量由粗到细尺度步骤预测离散视觉token，同一尺度内及多个目标视角间并行采样。多尺度投影位姿编码将源、目标相机变换注入各分辨率目标自注意力及源到目标交叉注意力，并结合全局条件和稠密几何交叉注意力保留源外观及目标视角一致性。在Objaverse、GSO和OmniObject3D上，PSNR、SSIM和LPIPS均优于扩散基线，同评测设置下速度超过三倍。

Insight: 几何条件的尺度自回归可避免反复扩散去噪，并并行生成多视角token；摘要未给具体质量指标数值。

Abstract: Sparse-view novel view synthesis is a central problem in 3D content creation, but diffusion-based approaches remain limited by iterative denoising, making multi-view generation expensive at inference time. We introduce NAMVIS, a diffusion-free framework that reformulates multi-view image synthesis as geometry-conditioned next-scale autoregression. Instead of generating target views through repeated denoising, NAMVIS predicts discrete visual tokens through a small number of coarse-to-fine scale steps, while sampling all tokens within each scale and across target views in parallel. To anchor this generation process to explicit camera geometry, we propose Multi-scale Projective Pose Encoding, which injects source and target camera transformations into both target-view self-attention and source-to-target cross-attention at every resolution. NAMVIS further combines global conditioning with dense geometry-aware cross-attention, enabling the model to preserve source-view appearance while maintaining target-view consistency. Across Objaverse, GSO, and OmniObject3D, NAMVIS outperforms diffusion-based baselines in PSNR, SSIM, and LPIPS, while running over 3 times faster than the evaluated diffusion baselines under the same evaluation setting. These results suggest that geometry-conditioned next-scale autoregression is a promising and efficient alternative to diffusion for sparse-view multi-view synthesis. Additional qualitative results, videos, and resources are available at https://corl-team.github.io/namvis/

[45] Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truth cs.CV | cs.ROPDF

Danial Safaei

TL;DR: 构建手持手机行人未来位置概率预测系统，并审计VIO高度漂移对世界坐标预测和无真值评估的影响。

Details

Motivation: 手机用户若能看到周围行人未来数秒的位置，可改善移动安全，但预测需在手机运动时保持地面坐标、校准良好且仅用单目相机和视觉惯性里程计。

Result: 系统以射线—地面平面交点将检测行人投到地面，在重力对齐米制坐标跟踪，并用U-Net对鸟瞰SDD和第一人称EgoTraj-Bench训练逐步概率热图。在手持ADVIO记录中，VIO垂直漂移和用户上下楼可使单目地面位置静默缩放（单片90秒内87%），另一片末31%轨迹全丢；低通高度固定可避免但滞后于扶梯。在SDD/EgoTraj-Bench测试上，4.8秒NLL比常速高斯低1.51/1.37纳特。手持视频没有行人真值，故以追踪器未来原始测量评分；预注册七个留出片段中NLL在1.2、2.4、4.8秒分别低0.17、0.23、0.47纳特，但收益不足开发片段一半。改用视频片段重采样后短时区间含零，重校准后仅1.2秒显著。

Insight: 手持部署中的高度漂移会造成严重坐标误差，且追踪器自一致评分不是独立地面真值；报告应结合片段级不确定性和校准分析。

Abstract: A pedestrian with a phone could be shown where nearby people will be in the next few seconds, if the forecast stays on the ground while the phone moves, is calibrated, and needs only a monocular camera and visual-inertial odometry (VIO). We build and evaluate such a system. People are detected, lifted onto the floor by ray-plane intersection, tracked in a gravity-aligned metric frame, and forecast as per-step probability maps by a small U-Net trained with a negative log-likelihood (NLL) loss on bird’s-eye (SDD) and first-person (EgoTraj-Bench) trajectories. On handheld ADVIO recordings, vertical VIO drift and the user’s own changes of level silently rescale monocular ground positions (by 87% within 90 s on one clip; on another, all tracks are lost for the last 31% of the clip); keeping the camera’s height above the floor constant under a low-pass-filtered altitude avoids this, though it lags on escalators. On the SDD and EgoTraj-Bench test splits, the final forecaster lowers the NLL at 4.8 s by 1.51 and 1.37 nats relative to a fitted constant-velocity Gaussian. Lacking ground truth for people in handheld video, we score forecasts against the tracker’s own later raw measurements. In an internally pre-registered evaluation on seven held-out clips, the final forecaster’s NLL is lower than the benchmark-fitted baseline’s at 1.2, 2.4 and 4.8 s (by 0.17, 0.23 and 0.47 nats; 95% intervals over people exclude zero), but by less than half as much as on the development clips. Exploratory analyses cut both ways: resampling clips instead of people widens the intervals to include zero at 1.2 and 2.4 s, and once both forecasters are recalibrated on the development clips the network is significantly better only at 1.2 s; but two clips run with ADVIO’s reference poses favour the network much more when re-run with the phone’s own poses. We discuss what such self-consistency scores can and cannot show.

[46] Investigating Spatiotemporal Redundancy in Video Transformer for Collision Anticipation cs.CVPDF

Xiaoshan Zhou

TL;DR: 分析视频Transformer在碰撞预判中的时空冗余，并以时间token合并和重要性引导神经元裁剪加速推理。

Details

Motivation: 工人—设备接近监控需要移动机器人上的低延迟推理，但强视频模型计算成本高；需识别哪些计算可删减而保留预测质量。

Result: 在Nexar Collision Prediction与VideoMAEv2-Base上，线性探针显示运动幅度、逼近等线索在中间层最易读，碰撞标签判别在末层增强。后层相邻时间token相似度0.970，而空间相似度0.297，表明时间冗余更强。合并时间token使计算量从356.99降至178.50 GFLOPs，每片延迟从12.69降至7.21ms、加速1.76倍，mAP仅从0.7478降至0.7443。按重要性保留50% MLP单元，AUC为0.753，优于同等比例随机保留的0.529；剪枝首先改变分数校准，之后判别排序才崩溃。

Insight: 视频任务冗余主要沿时间维而非空间维，可定向压缩时间token；神经元删减还会影响概率校准，评估不应仅看排序指标。

Abstract: In worker-equipment proximity monitoring, video transformers are widely used for collision anticipation and have demonstrated strong performance. However, their accuracy comes with substantial computational demands, creating a tension with the need for low-latency inference on mobile robots and the pursuit of lower-carbon computation in construction. To address this, this study investigates where computation within an established video transformer is redundant and whether that redundancy can be removed without materially degrading predictive performance. Using VideoMAEv2-Base on the Nexar Collision Prediction dataset, we first examine how collision-relevant information evolves across network depth and then investigate two complementary forms of redundancy: structured capacity redundancy in multilayer perceptrons (MLPs) and spatiotemporal redundancy in the token stream. Linear probes show that interpretable motion cues, including flow magnitude, looming, and approach versus retreat, are most accessible at intermediate layers, whereas collision-label discrimination strengthens toward the final layer. Token redundancy is axis-specific: adjacent temporal-token similarity reaches 0.970 in later layers, while spatial similarity falls to 0.297, indicating substantially greater redundancy across time than across space. Exploiting this asymmetry, temporal token merging reduces backbone computation from 356.99 to 178.50 GFLOPs and latency from 12.69 to 7.21 ms per clip, a 1.76x speedup, while mean average precision changes only from 0.7478 to 0.7443. Importance-guided retention of 50% of MLP units preserves an AUC of 0.753, compared with 0.529 under matched random retention, and reveals that pruning alters score calibration before discriminative ranking collapses. These findings establish a new pathway for pursuing faster algorithms through targeted temporal token compression and neuron pruning.

[47] ThyCLIPNet: A BiomedCLIP-Guided Lightweight Attention-Enhanced DeepLabV3+ Framework for Robust Thyroid Nodule Segmentation cs.CVPDF

Tasnim Jahan, Md Easin Arafat, Swakkhar Shatabda

TL;DR: 提出ThyCLIPNet，将BiomedCLIP图像语义门控融合到轻量多尺度CNN，改善甲状腺超声结节分割。

Details

Motivation: 甲状腺超声存在低对比、散斑噪声及模糊边界；高精度方法常计算昂贵，或缺少多尺度特征和全局生物医学视觉语义的结合。

Result: 模型以MobileNetV2与高效通道注意力编码，结合空洞空间金字塔池化及卷积块注意力；解码器用跳连和轻量注意力，并以BiomedCLIP纯视觉全局嵌入通过门控与局部特征融合，无需文本提示。在TG3K、TN3K、DDTI、PKTN上Dice分别为96.22%、87.58%、84.73%、80.70%，IoU为92.72%、77.91%、73.51%、67.64%，HD95为3.75、16.38、18.23、10.86。模型参数8.55M、计算22.99G FLOPs。

Insight: 全局医学视觉语义可补充轻量CNN的局部多尺度特征；结果覆盖四个数据集且参数规模较小，摘要未提供与具体基线的逐项比较。

Abstract: Accurate thyroid ultrasound segmentation is often challenged by low contrast, speckle noise, and unclear boundaries. Although recent methods have improved segmentation accuracy, many rely on resource-intensive architectures or lack explicit integration of multiscale features with global biomedical visual guidance. In this paper, we introduce ThyCLIPNet, a lightweight semantic-guided hybrid encoder-decoder framework that integrates BiomedCLIP-derived biomedical semantic guidance into a lightweight multi-scale CNN segmentation pipeline. The encoder integrates MobileNetV2 with efficient channel attention, while atrous spatial pyramid pooling and a custom convolutional block attention module enrich bottleneck features. The decoder combines hierarchical skip connections and lightweight attention refinement with a BiomedCLIP-guided gated fusion pathway that projects vision-only global biomedical embeddings into decoder feature space and selectively integrates them through semantic-local fusion and spatial gating. To the best of our knowledge, ThyCLIPNet is among the first lightweight thyroid ultrasound segmentation frameworks to use BiomedCLIP’s vision encoder alone for image-only global semantic guidance without text prompting. Experiments on TG3K, TN3K, DDTI, and PKTN achieve dice similarity coefficients of 96.22%, 87.58%, 84.73%, and 80.70%; intersection over union scores of 92.72%, 77.91%, 73.51%, and 67.64%; and 95th-percentile hausdorff distances of 3.75, 16.38, 18.23, and 10.86, respectively. ThyCLIPNet uses 8.55M parameters and 22.99G FLOPs. Overall, the results support integrating global biomedical semantic guidance with lightweight multi-scale CNN representations for robust and computationally efficient thyroid ultrasound segmentation. Source code: https://github.com/Tasnim-Jahan/ThyCLIPNet. [Abstract shortened for arXiv. See PDF for full abstract.]

[48] ARISE: Adaptive Agentic Reasoning with Image-grounded Self-Evaluation for Interpretable IBD Assessment cs.CV | cs.AIPDF

Pronoma Banerjee, Anuva Shah, Jason Wu, Md. Masudur Rahman, Sanjay Mohanty

TL;DR: 提出ARISE代理式自评估流程，通过逐步提出假设、定位图像证据、修正并符号核验进行炎症性肠病影像判断。

Details

Motivation: 无线胶囊内镜和肠道超声的IBD评估依赖专家；VLM虽有潜力，却缺领域推理、易幻觉、细粒度训练数据稀缺且解释性有限。

Result: ARISE将少样本医学图像理解组织成五阶段透明流程：假设生成、图像证据摘要、条件修正、符号验证和最终诊断。在两个独立队列中应用于克罗恩病胶囊内镜图像与溃疡性结肠炎B型超声，诊断表现持续优于基线VLM，并显露推理成功及失败位置，支持更可解释的临床决策支持。摘要未给具体指标。

Insight: 分阶段证据核查可提升医疗VLM诊断表现并增强可追溯性；摘要未报告样本量、成绩幅度或前瞻临床验证。

Abstract: Inflammatory bowel disease (IBD) requires frequent imaging-based assessment, yet interpretation of modalities such as wireless capsule endoscopy (WCE) and intestinal ultrasound remains heavily dependent on specialist expertise. Vision-Language Models (VLMs) demonstrate significant potential in multimodal medical image analysis, but their clinical adoption is hindered by their insufficient domain-specific reasoning, susceptibility to hallucination, scarcity of high quality training data in fine-grained diagnostics and limited interpretability. We introduce ARISE (Adaptive Agentic Reasoning with Image-grounded Self-Evaluation), an autonomous planning framework that models few-shot medical image understanding as a sequential agentic workflow. ARISE structures agent execution into a transparent 5-stage workflow: hypothesis generation, image-grounded evidence summarization, evidence-conditioned refinement, symbolic verification, and final diagnosis. We apply ARISE to IBD assessment across two independent patient cohorts: wireless capsule endoscopy (WCE) images for Crohn’s disease and B-mode ultrasound data for ulcerative colitis. ARISE consistently improves diagnostic performance over baseline VLMs while exposing where reasoning succeeds or fails, providing a more interpretable basis for clinical decision support and realistic deployment.

[49] Super-Resolution in The Right Latent Space: A Frozen Vision-Foundation Substrate cs.CVPDF

Wanzhou Lei, Cuifeng Sheng, Yanjin He, Maohua Li, Hua Yuan

TL;DR: 提出RAESR，在冻结DINOv3-L的融合层表征空间做超分辨率，利用分层语义与像素线索重建退化图像。

Details

Motivation: 真实超分需把退化图像嵌入映回自然清晰图像流形上的忠实点，同时保留输入已有语义与像素细节；像素或重建导向潜空间离流形远且语义信息弱，容易导致高退化时幻觉。

Result: 作者发现冻结DINOv3-L 23层融合表征能使退化图像落在更靠近自然清晰图像流形的区域，并提供从像素记录到抗退化语义的层次线索。415M解码器以重建和对抗目标训练，一次映回并解码到像素空间。RealSR、DRealSR、LSDIR、DIV2K-Val上，RAESR在SOTA对抗与扩散恢复器中取得最佳保真—感知权衡；单张H20处理512×512图像耗时37ms。同配方VAE潜空间替换后各项指标均较差。

Insight: 超分潜空间选择会影响忠实恢复和幻觉，冻结视觉基础表征可提供更合适几何与语义先验；推理时延基于单张H20。

Abstract: In an image latent space, the embeddings of high-resolution, natural, and sharp images form a manifold. Degradation of high-resolution images pushes their embeddings off this manifold. Real-world super-resolution (SR) then becomes the task of mapping the degraded embedding back onto this manifold — not anywhere on the manifold, but to the point that preserves what the input still carries, both its semantics and pixel details. Every published method implements this mapping in a reconstruction-oriented latent space or pixel space. We claim these spaces are the wrong substrates for SR. Low-resolution and degraded images are embedded far from the manifold, making the mapping difficult and expensive. The lack of semantic information in these substrates also makes it difficult to navigate to the faithful point on the manifold, causing severe hallucination when degradation is heavy. Thus, restoring in a suitable latent space is crucial to the SR task. We show that the latent space of 23 fused layers of a frozen DINOv3-L is one such space that makes the SR task easier. Degraded images are embedded near the manifold. Moreover, this substrate contains a hierarchy of information, from pixel record to degradation robust semantics, guiding the model to find the faithful point on the manifold. On this substrate, a 415M decoder is trained under reconstruction and adversarial objectives to map the degraded embeddings back and decode to pixel space in one pass. The resulting model, RAESR, attains the best fidelity–perception trade-off among state-of-the-art adversarial and diffusion-based restorers on RealSR, DRealSR, LSDIR and DIV2K-Val, at 37 ms per 512 by 512 image on a single H20 GPU. Swapping the substrate for a VAE latent under an identical recipe loses on every metric.

[50] Lollypop: Camera-to-Motion-Capture Calibration Verification with a Reference Target cs.CVPDF

Tianyi Liu, Kevin Harris, Mihika Dave, Kun He

TL;DR: 提出Lollypop视觉标记—动捕联合参考靶，独立验证相机到动捕坐标标定是否在部署后漂移。

Details

Motivation: 机器人、AR/VR等依赖动捕真值，部署后标定可能漂移，而传统残差和目视检查缺少独立验证证据。

Result: Lollypop把ArUco视觉标记与动捕标记阵列固定为同一物理中心。给定候选标定，将动捕点投影到图像并与检测到的标记中心比较。实验显示正常标定下误差低于像素级，对受控外参扰动敏感，并在一段混合搬动流程中观察到误差增加。

Insight: 共点实体靶可作为独立验证手段发现部署后外参变化；摘要没有给出扰动量与误差关系的具体数值。

Abstract: Camera-to-motion-capture (mocap) calibration is essential for using mocap as ground truth in robotics, AR/VR, and other computer vision tasks. However, the calibration can drift after deployment, while calibration residuals and visual inspection provide limited independent verification. We present Lollypop, a fiducial-mocap reference target for independent calibration verification. The target couples an ArUco fiducial with a mocap marker constellation so the visual center and tracked centroid represent the same physical point. Given a candidate calibration, verification projects the mocap point into the image and measures its disagreement with the detected fiducial center. Experiments show sub-pixel nominal error, sensitivity to controlled extrinsic perturbations, and increasing error during an illustrative mixed-handling sequence.

[51] RSure-Agent: Reliable Use of Tool Observations for Remote Sensing Agents cs.CVPDF

Fuyuan Liu, Nayu Liu, Wenhao Yu, Peijin Wang, Yingchao Feng

TL;DR: 提出RSure-Agent，通过工具过程证据和任务—工具可靠性先验验证遥感代理的测量、感知及栅格分析结果。

Details

Motivation: 遥感工具即使成功执行也可能返回错误观察；代理若直接接受会使错误在后续推理中放大并导致任务失败。

Result: 对三个遥感代理基准的1,229条轨迹分析发现，每个基准至少88.1%任务依赖工具观察，其中至少22.7%观察在工具成功执行时仍错误，受影响任务至少82.0%错误传播到最终答案。RSure-Agent要求工具提供可验证过程证据，并从离线任务反馈建立按任务类型统计的工具配置可靠性先验，再决定接受、索取更多证据或拒绝。EarthBench、ThinkGeo和TerraLogic上，错误传播率较关闭验证与先验的基线降低21.3至25.9个百分点；CHOICE-420上跨11骨干平均准确率提高5.71点；EarthBench工具调用比例降低25.9%。

Insight: 工具成功运行不等于输出可信，过程证据和按任务校准的历史可靠性可抑制错误链式传播；验证还可减少不必要调用。

Abstract: Remote sensing agents rely on perception, measurement, and raster analysis tools to solve Earth observation tasks. We refer to their judgments and quantitative results about ground objects as tool observations. However, these observations are subject to substantial uncertainty and may be incorrect even when the tools execute successfully. When agents accept incorrect observations, the errors can propagate through subsequent reasoning and cause task failure. We analyze 1,229 execution trajectories across three remote sensing agent benchmarks. On each benchmark, at least 88.1% of tasks depend on tool observations. Among these tasks, at least 22.7% contain incorrect observations despite successful tool execution. These errors propagate to the final answer in at least 82.0% of affected tasks on each benchmark. To address this problem, we propose RSure-Agent, a framework for verifying tool observations and limiting error propagation. We introduce a verifiable observation protocol that requires tools to return process evidence for the agent to verify their observations. We also construct a task-tool reliability prior from offline task feedback. The prior summarizes each tool configuration’s past performance across task types and provides a task-specific reference for verification. Using process evidence and this prior, RSure-Agent decides whether to accept an observation, request additional evidence, or reject it. We evaluate RSure-Agent on EarthBench, ThinkGeo, TerraLogic, and CHOICE-420. Across the three agent benchmarks, RSure-Agent reduces the error propagation rate by 21.3 to 25.9 percentage points relative to the base configuration with verification and the prior disabled. On CHOICE-420, it improves overall accuracy over direct answering by 5.71 percentage points on average across 11 backbone models. On EarthBench, it reduces the tool-call ratio by 25.9% relative to Earth-Agent.

[52] DriftSR: One-Step Real-World Image Super-Resolution via Distribution Drifting cs.CVPDF

Wei Zhu, Kai Zhang, Yu Zheng, Zhaopeng Yang, Lei Luo

TL;DR: 提出DriftSR，在冻结扩散模型中间表征空间通过分布漂移进行单步真实图像超分辨率。

Details

Motivation: 高质量真实图像单步超分常需分数蒸馏或对抗训练，增加可训练组件并使优化复杂。

Result: DriftSR在预训练扩散模型冻结的中间特征空间进行漂移，不增设任务专用特征编码器；空间特征漂移把局部特征作为分布样本，提供更密集的对齐监督；结构调制引导按局部结构与低清输入一致性自适应调整漂移。仅优化单步生成器，无辅助蒸馏分支或判别器。三个真实世界基准实验显示高质量重建和高效单步推理；摘要未给具体指标。

Insight: 冻结扩散中间表征可作为真实超分先验，并通过空间局部漂移提高对齐监督密度；量化质量与速度增益未在摘要报告。

Abstract: One-step real-world image super-resolution (Real-ISR) offers efficient inference, but recovering realistic and perceptually rich details often relies on score distillation or adversarial learning, introducing additional trainable components and making optimization more cumbersome. To this end, we propose DriftSR, a one-step Real-ISR framework that leverages pretrained diffusion priors through distribution drifting. Specifically, we perform drifting in the frozen intermediate representation space of a pretrained diffusion model, without introducing an additional task-specific feature encoder. Building on this space, we introduce Spatial Feature Drifting, which treats spatial features rather than entire images as distributional samples, enabling denser supervision for distribution alignment. To mitigate structural deviations, we further introduce Structure-Modulated Guidance, which adaptively refines drifting guidance according to local structural consistency with the LQ input. Consequently, DriftSR optimizes only the one-step generator, without auxiliary distillation branches or adversarial discriminators. Extensive experiments on three real-world benchmarks demonstrate that DriftSR delivers high-quality super-resolution reconstruction with efficient one-step inference.

[53] Enhancing Long-Video VLM Embeddings with Query-Aware Streaming Latent Reasoning cs.CV | cs.AIPDF

Haozhe Chi, Song Jin, Yang Jin, Yadong Mu

TL;DR: 提出QASLR长视频嵌入后训练框架，通过持久思考token逐片聚合查询相关证据，同时维持固定维度输出。

Details

Motivation: 长视频嵌入需要在有限视觉token预算下捕捉稀疏且与查询相关的证据；均匀采样可能漏掉短暂事件，把更多帧放进单一上下文则增加内存和计算。

Result: QASLR选择有界帧集合并恢复时间顺序，逐片输入VLM；固定数量持久思考token跨片交叉注意力读取特征，嵌入token在每步输出归一化表示。训练结合最终对比学习、逐步对比监督及最终嵌入自蒸馏，令部分视频读出适用于检索并向最终表征靠拢。查询感知选帧可生成查询条件表示用于候选评分/重排，查询无关选帧则支持复用索引。完整配方在HourVideo检索Hit@1上，Qwen3-VL-Embedding 2B从54.2升至70.7，8B从57.4升至72.8；评测的片段检索和视频问答任务也有收益，并迁移至第二个Qwen系列嵌入骨干。

Insight: 分片流式潜在聚合避免把全部长视频帧塞入单一上下文，同时输出维度固定；不同查询感知模式分别服务在线重排和离线索引。

Abstract: Long-video embedding requires capturing sparse query-relevant evidence under a limited visual-token budget. Uniform sampling can miss brief events in videos spanning minutes or hours, whereas encoding more frames in a single context increases memory and computation. We introduce \textbf{Query-Aware Streaming Latent Reasoning} (QASLR), a post-training framework that accumulates evidence across clips while keeping the embedding size fixed. QASLR selects a bounded set of frames, restores their temporal order, and processes them clip by clip with a vision-language backbone. A compact set of persistent think tokens cross-attends to each clip’s features, while an embed token reads out a normalized representation after every update. This design integrates evidence across multiple backbone calls without requiring all selected frames to share a single context. Training combines final contrastive learning, step-wise contrastive supervision, and final-embedding self-distillation. Intermediate supervision trains partial-video readouts for retrieval, while self-distillation regularizes them toward the final representation. Query-aware selection produces query-conditioned representations for candidate-set scoring and reranking, whereas query-independent selection enables reusable corpus indexing. Under the full training recipe, HourVideo retrieval Hit@1 increases from 54.2 to 70.7 and from 57.4 to 72.8 for 2B and 8B Qwen3-VL-Embedding backbones, respectively. Gains extend to the evaluated moment-retrieval and video-QA tasks, and the streaming head transfers to a second Qwen-family embedding backbone. These results support streaming latent aggregation as an effective approach to integrating long-video evidence into fixed-dimensional representations.

[54] PWM: Personalized World Models with Online Reinforcement Learning cs.CVPDF

Zhexin Lou, Guancheng Lu, Zeyu Zhang, Yi Zhang, Yang Zhao

TL;DR: 提出PWM在线强化学习个性化世界模型，从短视频定制交互场景并同时保留动作条件生成质量。

Details

Motivation: 预训练世界模型可生成多样环境，但用户希望根据自有视频探索特定场景，需要学习视觉身份同时维持动作控制生成能力。

Result: PWM利用支持轨迹和控制对当前策略采样续接提供奖励；GRPO版本以LoRA适配器联合优化场景外观、视觉连续性和运动，并锚定冻结Yume-5B生成先验。另以DiffusionNFT实现另一种奖励导向适配，并构建含室内、室外、游戏共150项任务的PWM-Bench。GRPO与DiffusionNFT分别在71.3%和65.3%评估场景中较原生Yume提升，三个域均有正平均增益。配对SFT比较中，GRPO各域平均定制收益和图像质量更高，同时帧级质量接近预训练模型。

Insight: 短场景视频可通过在线奖励指导紧凑适配器定制交互世界模型；跨环境的结果覆盖渲染与真实环境，但摘要未给逐域细节。

Abstract: Pretrained world models can generate diverse environments, yet users often want to explore a particular scene specified by their own video. This requires learning the scene’s visual identity while retaining the quality of action-conditioned generation. We introduce Personalized World Models (PWM), a framework for customizing interactive world models from short scene videos through online reinforcement learning. In PWM, the support trajectory and its associated controls provide reward feedback on continuations sampled from the current policy. In the GRPO instantiation, group-relative optimization updates a compact LoRA adapter using a unified reward for scene appearance, visual continuity, and motion, while base-policy anchoring regularizes changes to the pretrained generation prior of a frozen Yume-5B backbone. The same adaptation procedure is applied across real and rendered environments. We also instantiate PWM with DiffusionNFT as an alternative reward-guided optimization method for learning the scene-specific adapter. We also introduce PWM-Bench, comprising 150 customization tasks across Indoor, Outdoor, and Gaming, with paired evaluation on held-out continuations. The GRPO and DiffusionNFT instantiations of PWM improve customization over native Yume in 71.3% and 65.3% of the evaluated scenes, respectively, with positive mean gains across all three domains. For the GRPO instantiation, matched SFT comparisons further demonstrate higher mean customization gains and better mean image-quality scores in every domain, while retaining frame-level visual quality close to the pretrained model.

[55] PortraitAes: Intent-Conditioned Structured Portrait Aesthetics Assessment cs.CVPDF

Junzhou Xie, Haozhong Xiong, Xunyun Tian, Kaile Du, Tianchen Yu

TL;DR: 提出PortraitAes基准与模型，按摄影意图结构化评估人像美学并校准跨图评分可比性。

Details

Motivation: 同一模糊、姿势、光线或构图选择可能服务一种摄影意图却损害另一种；单一美学分数或通用MLLM不考虑意图，易给出不一致和误导判断。

Result: PortraitAes-Bench含约11K样例，专家量表定义9种摄影意图、6个一级维度及22项二级标准，支持意图路由、专家判断、验证和融合。多任务监督训练PortraitAes，再用高斯分数校准及维度内跨图排序增强可比性。标准集Pearson相关0.924、Spearman 0.934；困难集分别0.829和0.795，均优于评测的通用MLLM和专用美学基线。

Insight: 按摄影目的评估可避免把意图相关风格差异误判为质量缺陷；困难样例相关性明显低于标准集，仍有提升空间。

Abstract: Portrait aesthetic assessment assigns comparable scores according to how effectively human-centered images fulfill their photographic intent. These scores support data filtering, candidate selection, and preference modeling in image-generation pipelines. Existing methods typically predict a single aesthetic score or use general-purpose MLLMs without conditioning on photographic intent. This omission matters because the same blur, pose, lighting, or framing choice may serve one photographic intent but undermine another. These models thus learn context-agnostic aesthetic priors and yield inconsistent, inaccurate, misleading judgments for portraits with distinct photographic objectives. We introduce PortraitAes-Bench, an 11K-scale benchmark that decomposes this task into intent-conditioned subjudgments. Expert-authored rubrics define nine photographic intents, six first-level dimensions, and 22 secondary criteria. They support a structured pipeline for intent routing, specialist assessment, verification, and score fusion. Following this structure, we train PortraitAes with multi-task supervision. We then improve score comparability through Gaussian score calibration and within-dimension cross-image ranking. On the standard benchmark, PortraitAes achieves a Pearson correlation of 0.924 and a Spearman rank correlation of 0.934. On the hard-case set, its Pearson correlation is 0.829 and its Spearman rank correlation is 0.795. Across both sets, PortraitAes outperforms the evaluated general-purpose MLLMs and specialized aesthetic baselines.

[56] VisualErase: Dual-Branch Visual Trajectory Redirection for Robust Concept Erasure in Text-to-Image Diffusion Models cs.CVPDF

Qianlong Xiang, Miao Zhang, Kun Wang, Yupeng Hu, Junhui Hou

TL;DR: 提出VisualErase，通过双分支视觉轨迹重定向显式移除文生图扩散模型中的目标视觉概念。

Details

Motivation: 现有概念擦除主要重定向文本到图像映射，模型仍可能保留目标概念的视觉生成轨迹，从而被对抗性提示恢复。

Result: VisualErase先以结构保留图像编辑为源图构造内容对齐且已去除目标概念的配对终点，再从每组图像生成去噪监督，并用双分支损失同时校准文本条件与无条件预测；另以冻结原模型预测保持配对内容，减少对非目标生成的损害。在风格、名人和裸露概念擦除中，七种攻击的最高攻击成功率分别降至0%、8%和0.1%，且保留一般生成质量。

Insight: 同时重定向有条件与无条件视觉轨迹，能补足仅修改文本映射的安全缺口；摘要未报告一般生成质量的具体保留分数。

Abstract: Concept erasure is essential for the safe deployment of text-to-image diffusion models, as they may reproduce harmful, copyrighted, or privacy-sensitive content learned from unconstrained large-scale data. Existing methods typically erase unwanted concepts while preserving general generation capability by redirecting target-related text-to-image mappings. However, recent studies show that erased models may still retain visual generative trajectories of target concepts, leaving them vulnerable to adversarial recovery attacks and revealing a fundamental gap between redirecting text-to-image mappings and truly removing visual knowledge. To bridge this gap, we propose VisualErase, a new paradigm that redirects concept-bearing visual generative trajectories toward explicitly defined concept-removed outcomes. To enable this redirection, we use structure-preserving image editing to construct content-aligned, concept-removed counterparts for source images, providing explicit visual endpoints that retain non-target content. We then derive a denoising target from each source-to-counterpart pair and use a dual-branch redirection loss to align both text-conditioned and unconditional predictions with this target, since conditional supervision alone does not explicitly constrain generation without textual guidance. To mitigate the adverse effects of concept erasure on non-target generation, we jointly optimize the redirection loss with a counterpart retention loss that matches denoising predictions from the frozen pretrained model. Across style, celebrity, and nudity erasure, VisualErase limits the maximum attack success rate over seven attacks to 0%, 8%, and 0.1%, respectively, while retaining general generation quality. These results highlight the importance of visual trajectory redirection for robust concept erasure beyond text-to-image mappings alone.

[57] EMBER-Bench: Benchmarking Cross-Event Causal Memory in Long-Horizon Embodied Tasks cs.CVPDF

Aoyang Cai, Boning Zhao, Shaoxuan Xie, Dahui Gao, Huan Yang

TL;DR: 提出EMBER-Bench，评测长时程具身任务中跨事件因果记忆及其对当前行动的约束推理。

Details

Motivation: 物理代理需推断过去事件如何改变当前状态并限制未来行动，而现有具身或视频记忆基准多考历史检索和摘要，较少测历史依赖因果推理。

Result: EMBER-Bench由189项家庭任务、699组问答构成，覆盖进度、失败恢复、外部干预及远距离依赖与前置条件任务，并标注细粒度事件/因果链。分别测从历史预测下一动作，以及给定动作回溯使其必要的历史原因。16个模型最高总准确率61.2%，两名人类评估者平均98.3%；正确回溯并不对应正确动作预测。动作日志仅增1.6点，因果结果标注在此基础上再增13.0点。

Insight: 提取历史因果信息并将其转为当前行动约束仍是具身代理难点；人类差距大，提供因果标注显著帮助，说明视频历史中的隐含因果尚未被充分利用。

Abstract: Lifelong physical agents must reason over extended interactions where past events continue to shape the world long after they disappear from view. Beyond recalling what happened, agents must infer how history changes the current state and constrains future actions. Yet existing embodied and video-memory benchmarks largely focus on historical retrieval and summary, leaving such history-dependent causal reasoning underexplored. We introduce EMBER-Bench, an egocentric benchmark for cross-event causal reasoning in long-horizon embodied tasks, for which we newly created the task design, video recording, and data annotation. It contains 189 household tasks and 699 QA pairs, spanning task progress, failure recovery, external interventions, and compound long-horizon tasks with distant dependencies and prerequisites, with fine-grained event and causal-chain annotations. EMBER-Bench evaluates reasoning in both directions: next-action prediction selects the next action from history, and causal traceback, given that action, identifies the historical event that makes it necessary. Input ablations that add action logs or privileged cause-and-consequence annotations to the video indicate which kind of historical information models fail to use. Among the 16 evaluated models, the highest overall accuracy is 61.2%, compared with a mean of 98.3% across two human evaluators. At paired decision points, correct traceback is not associated with correct next-action prediction. Adding action logs yields a gain of 1.6 points, whereas cause-and-consequence annotations yield an additional gain of 13.0 points on top of that. These results suggest that extracting causal information from past events and converting it into constraints on current actions remains a key difficulty for long-horizon embodied agents. Project Page: https://zhaoalexgoat.github.io/EMBER-Bench/

[58] Look Where You Say You’re Looking: Self-Grounded Attention for Visual Reasoning cs.CVPDF

Uri Berger, Gal Chechik, Gal Dalal

TL;DR: 提出Self-Saliency，用模型自身推理步骤中提及的对象位置监督VLM视觉注意力，实现自我落地的视觉推理。

Details

Motivation: 既有注意力引导通常只根据图像和问题确定目标区域；作者认为以模型实际生成的推理为条件的注意力定位可能更适合下游任务。

Result: Self-Saliency用定位模型找出各推理步骤提及对象，并将其区域作为视觉注意监督。作者统一构建25项视觉推理基准并复现此前方法。该方法平均排名和平均分均显著优于既有注意力引导及仅对图像级文本做定位的基线。后训练分析显示模型主要通过调整文字来匹配现有注意力（步骤变短、区域描述变宽）；控制生成文本后，相关层对定位区域注意力仍显著增加。研究还发现VLM注意力稳定偏向图像边缘，但消融显示收益不能仅以注意力转向图像中心解释。

Insight: 让注意力监督对应模型自己声称关注的推理对象，比只用图像级文本落地更有效；训练同时改变推理语言和注意力模式，解释收益需区分二者。

Abstract: We introduce Self-Saliency, a method for training Vision-Language Models (VLMs) to increase the alignment between their visual attention and the image regions mentioned in their reasoning. Self-Saliency uses a grounding model to localize the objects mentioned in each reasoning step and treats the resulting areas as supervision for the model’s visual attention. Previous work on steering visual attention determines target image regions based solely on the image and question. In contrast, we show that conditioning the target regions on the model’s generated reasoning improves downstream performance. For proper evaluation, we build a unified, broad suite of 25 visual reasoning benchmarks, where we reproduce the results of previous methods. We find that Self-Saliency significantly outperforms both prior attention-steering methods and baselines that ground image-level text, achieving both a better average rank and a better mean score. Post-training analysis shows that the model primarily adapts its reasoning text to existing attention patterns, producing shorter steps that refer to larger regions. Nevertheless, when controlling for generated text, attention to grounded regions increases significantly across the relevant layer. Finally, we identify a consistent geometric bias in VLM visual attention toward the image border. However, our ablations show that Self-Saliency’s gains cannot be explained by simply aligning attention with the center of the image, highlighting the importance of aligning visual attention with the regions mentioned in the model’s reasoning.

Yiming Zhao, Tianshun Li, Jingle He, Ruonan Chai, Xinhu Zheng

TL;DR: 提出轻量级LightVLN，用紧凑记忆token和历史/指令引导局部聚合支持无人机长指令导航。

Details

Motivation: 空中视觉语言导航需在复杂三维环境中根据自然语言长期执行，但现有系统依赖大视觉语言骨干及稠密历史，计算和内存成本阻碍机载部署。

Result: LightVLN采用0.5B语言骨干，将每个历史帧压成一个策略已算出的视觉特征token，并根据历史和指令把当前观察从256个视觉token聚合到32个。最多16帧历史时，观察token总数不超过48。OpenFly成功率为Test-Seen 50.93%、Test-Unseen 36.14%，多数报告指标超过所评7B语言骨干基线；AerialVLN-S Val-Seen为25.83%。在重建的未见校园中，以DJI M350 RTK和Jetson Orin NX 16GB完成闭环硬件在环评估，模型推理14.61Hz、端到端决策更新11.13Hz。

Insight: 复用并压缩历史视觉特征可显著缩小机载导航token开销；硬件在环结果来自重建校园环境，需与真实户外长期部署表现区分。

Abstract: Aerial vision-and-language navigation (VLN) enables unmanned aerial vehicles to execute long-horizon natural-language instructions from visual observations in complex three-dimensional environments. However, recent aerial VLN models often rely on large-scale vision-language backbones and dense visual histories, imposing substantial computation and memory costs that hinder onboard deployment. We propose LightVLN, a lightweight history-aware aerial VLN framework that combines a compact 0.5B language backbone with compact representations of both historical and current observations. LightVLN compresses each historical frame into a single token using visual features already computed by the policy. It further introduces history- and instruction-conditioned local aggregation to reduce the current observation from 256 to 32 visual tokens while preserving navigation-relevant spatial information. With up to 16 historical frames, the policy uses at most 48 observation-derived tokens. On the public OpenFly dataset, LightVLN achieves 50.93% Test-Seen and 36.14% Test-Unseen success rates (SR), outperforming the evaluated 7B language-backbone baselines on most reported metrics. It also achieves 25.83% SR on AerialVLN-S Val-Seen. In a reconstructed unseen campus, we deploy LightVLN on a DJI M350 RTK with an external Jetson Orin NX 16 GB for closed-loop onboard-compute real-to-sim hardware-in-the-loop (HIL) evaluation, achieving 14.61 Hz model inference and 11.13 Hz end-to-end decision updates. These results demonstrate the effectiveness and efficiency of LightVLN for aerial navigation.

[60] SPACE-CLIPv2: Decoding Local Geometry from Frozen CLIP for Monocular Depth Estimation cs.CVPDF

Hyun Song, Taewan Cho, Kangmin Kim, Andrew Jaeyong Choi

TL;DR: 提出SPACE-CLIPv2，从冻结CLIP token空间的固定局部邻域聚合细粒度几何用于单目深度估计。

Details

Motivation: CLIP patch token语义强却非为稠密度量几何优化；既有SPACE-CLIP已用层组融合做深度，但邻近token如何组合以恢复局部细节尚未解决。

Result: 解码器在选定阶段采样固定token模板、预测聚合权重，并以门控残差注入局部响应；token空间高通分支保留浅层局部对比。NYU Depth V2上优于匹配的SPACE-CLIP基线；五随机种子实验持续支持固定采样优于学习偏移。iBims-1零样本评估中，边界与平面几何指标也提升。

Insight: 受约束局部token聚合比可学习偏移采样更稳健地从冻结CLIP中解码几何；摘要未报告具体指标值。

Abstract: Vision-language foundation models such as CLIP provide strong semantic representations, but their patch tokens are not directly optimized for dense metric geometry. SPACE-CLIP showed that frozen CLIP features can support monocular depth estimation through layer-group feature fusion, yet it leaves open how neighboring CLIP tokens should be combined to recover fine local structure. We present SPACE-CLIPv2, a frozen-backbone depth decoder that aggregates fixed local neighborhoods in CLIP token space. At selected decoder stages, the model samples a fixed token stencil, predicts aggregation weights, and injects the resulting response through a gated residual update. A token-space high-pass branch further preserves shallow local contrast. On NYU Depth V2, SPACE-CLIPv2 improves over a matched SPACE-CLIP baseline, while five-seed experiments consistently favor fixed over learned-offset sampling. Zero-shot iBims-1 evaluation further improves boundary and planar-geometry measures. These results support constrained local token aggregation as a practical mechanism for decoding geometry from frozen CLIP representations.

[61] GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models cs.CV | cs.ROPDF

Hyun Song, Kangmin Kim, Loren Jinsoo Um, Minhui Han, Jaehyeok Park

TL;DR: 提出GeoBridge-VLA，以深度监督学习几何特征桥，再通过门控残差接口加入预训练VLA视觉token。

Details

Motivation: VLA视觉语言预训练带来语义表征，但精细操作还需空间几何；部署时增加第二图像编码器或深度观测会提高成本。

Result: 第一阶段用深度监督训练特征桥和几何解码器，第二阶段冻结它们并训练门控残差接口、动作侧投影及动作专家；部署只需RGB、机器人状态和语言，不需深度。LIBERO上成功率70.9%，高于SmolVLA的60.0%；在同一训练检查点关闭残差后从70.90%降至69.85%，不同套件效果混合。实体ROBOTIS OMY机器人四项任务200次试验中成功148次（74.0%），SmolVLA为108次（54.0%）。

Insight: 训练期几何学习可在推理时无深度传感器条件下增强操控；消融中残差自身收益较小且跨任务不一，整体提升还来自其他模块。

Abstract: Vision-language-action (VLA) models encode semantic information from vision-language pretraining, but manipulation also requires precise spatial reasoning. We present GeoBridge-VLA, a two-stage method for learning geometric features from a pretrained VLA’s frozen visual encoder and using them for action prediction. Stage I trains a feature bridge and geometry decoder with depth supervision. Stage II freezes these modules and trains a gated residual interface together with the action-side projections and action expert. The residual augments the existing visual tokens without adding a second image encoder or increasing the token count. Deployment requires RGB, robot state, and language, but no depth observations. Under matched evaluation conditions, GeoBridge-VLA achieves 70.9% success on LIBERO, compared with 60.0% for SmolVLA. Disabling the residual in the same trained checkpoint reduces success from 70.90% to 69.85%, with mixed effects across suites. On a physical ROBOTIS OMY robot, GeoBridge-VLA succeeds in 148 of 200 trials (74.0%) across four tasks, compared with 108 of 200 (54.0%) for SmolVLA.

[62] Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA cs.CVPDF

Hyemin Yang, Wooseong Jeong, Giwon Lee, Kuk-Jin Yoon

TL;DR: 提出TUD双系统VLA推理调度器，依据动作重预测的跨步离散度决定何时调用慢速通才推理模型。

Details

Motivation: 双系统VLA以慢速推理通才搭配快速动作专家，但固定频率调用通才会在简单阶段浪费计算，并可能在场景变化时延迟重新推理。

Result: TUD在缓存通才上下文下，观察新观测到来后下一动作块槽位的动作重预测跨步离散度，将其作为预测不确定性；该信号来自架构已有前向，无需阶段标签或额外模型。在VLA-Arena上，同调用预算成功率高于其他不确定性基线，且开销低、能更稳定区分成功与失败轨迹；阈值变化形成更好的成本—成功率曲线，并能在匹配成功率下降低VLM调用。真实机器人实验中，较最强固定间隔基线通才调用减少75%，成功率反而更高。

Insight: 复用已有预测波动可自适应分配昂贵推理调用；结果同时覆盖仿真和真实机器人，但摘要未提供VLA-Arena具体分数。

Abstract: Dual-system Vision-Language-Action (VLA) models improve real-time robotic control by pairing a slow, reasoning-capable generalist with a fast specialist action expert. However, existing methods invoke the generalist at a fixed frequency, ignoring the fact that decision-making complexity varies throughout a rollout. This static strategy wastes computation in easy phases and can delay renewed reasoning when the scene changes unexpectedly. We propose TUD (Triggering generalist reasoning via predictive Uncertainty for Dual-system VLA), an adaptive inference framework that selectively skips unnecessary generalist calls. TUD measures the cross-step dispersion of action re-predictions at the upcoming chunk slot under the cached generalist context, as a predictive uncertainty signal. This signal captures how much the future action plan shifts as new observations arrive and is computed from forwards the architecture already runs, requiring neither manual phase labels nor an auxiliary uncertainty model. On VLA-Arena, it achieves a higher success rate at matched call budgets than alternative uncertainty baselines while maintaining low wall-clock overhead, and more consistently separates successful from failed rollouts. Also, TUD finds a more favorable cost-success trade-off than non-adaptive baselines, tracing an entire operating curve as a single threshold is varied, and substantially reduces VLM calls at matched success rate. The same trade-off appears in our real-robot experiments, where TUD cuts generalist calls by 75% relative to the strongest fixed-interval baseline while achieving an even higher success rate. Our results suggest that predictive uncertainty provides a practical criterion for adaptive reasoning in efficient VLA control.

[63] Code2Games: Enabling Coding Agents for Gaming World Generation cs.CVPDF

Wei Wu, Ziyang Xu, Zeyu Zhang, Yang Zhao, Hao Tang

TL;DR: 提出Code2Games，让编码代理从自然语言意图构建Blender世界，再迁移到UE5并通过运行反馈修复可玩性。

Details

Motivation: 高质量游戏世界生成须联合推理场景结构、空间布局、游戏目标、交互实体和可执行逻辑；单独生成资产、场景或脚本的代理难维持跨组件一致。

Result: Code2Games围绕共享场景—玩法表示协调场景分析、玩法规划、受约束生成和引擎定制，并持久维护元素对应关系。迁移到Unreal Engine 5后，用编译诊断、运行反馈和玩法测试执行引导重建，修复引擎适配不一致。作者提出GameCode4D，含十种不同复杂度固定游戏提示，从视觉质量、交互保真、多模态资产质量和可玩游戏质量四维评估。实验中相较直接代理生成及既有基线，Code2Games稳定提高视觉质量、交互保真与适配后游戏质量。

Insight: 共享场景—玩法表示和编译/运行闭环能约束跨产物一致性；基准规模仅十个固定提示，丰富性尚有限。

Abstract: Generating a high-quality gaming world from a natural-language game intent requires joint reasoning about scene structure, spatial layout, gameplay objectives, interactive entities, and executable gameplay logic. Existing coding agents can generate individual assets, scenes, or scripts, but often struggle to maintain consistency across these components. We propose Code2Games, an agentic framework that builds a structured gaming world upon a base Blender world generated from the same game intent. Code2Games coordinates scene analysis, gameplay planning, constrained gaming-world generation, and gaming-engine customization through a shared scene-gameplay representation with persistent element correspondence. After world generation, Code2Games adapts the generated world to Unreal Engine 5 and employs an execution-guided reconstruction process that uses compilation diagnostics, runtime feedback, and gameplay test results to resolve inconsistencies arising during engine adaptation. To systematically evaluate gaming-world generation, we introduce the GameCode4D benchmark, which comprises ten fixed game prompts spanning different levels of scene and gameplay complexity. We evaluate the generated results across four dimensions: visual quality, interactive fidelity, multimodal artifact quality, and playable-game quality. Experiments demonstrate that, compared with direct gaming-world generation by coding agents and existing baseline methods, Code2Games consistently improves the visual quality and interactive fidelity of generated gaming worlds, as well as the quality of the resulting games after engine adaptation.

[64] ReMAP: Restoring the Perceptual Cycle with Reasoning-Time Latent Visual Memory cs.CV | cs.AI | cs.CLPDF

Hao Jiang, Zhanyu Guo, Chenwei Wu, Yichen Guo, Qizhe Zhang

TL;DR: 提出ReMAP推理时记忆增强感知，用问题条件全局潜在记忆与状态动态局部记忆按需恢复视觉证据。

Details

Motivation: 多模态LLM持续推理时对初始视觉输入的注意力会减弱，造成视觉落地退化；记忆的组织与调用时机决定其是否有效。

Result: 控制分析发现局部证据需全局语境，紧凑潜表示可平衡准确率与视觉上下文成本，记忆效用取决于推理状态。ReMAP用静态问题条件全局记忆保留场景及跨图语境，并以之为锚、按当前状态选择并重编码区域证据的动态局部记忆；RL分支轨迹训练调用策略决定继续推理还是取全局/局部记忆。在十类基准上，所有四个多图基准均超过既有视觉记忆方法，MuirBench与MIMIC高8.38、14.84个百分点；四类骨干均优于关闭记忆版本。相对原生分辨率骨干，进入推理序列的视觉token减少51.0%至76.8%。

Insight: 让推理状态触发针对性视觉检索可恢复感知循环，同时压缩输入token；全局与局部记忆表征互补，覆盖多图与多骨干。

Abstract: As multimodal large language models (MLLMs) reason for longer, attention to the initial visual input diminishes, weakening visual grounding. Visual memory reintroduces visual evidence during reasoning. We conduct a controlled analysis of visual memory along three axes: curation, organization, and access. We find that local evidence benefits from global context, compact latent representations balance accuracy and visual-context cost, and the utility of memory access depends on the reasoning state. Guided by these findings, we propose ReMAP (Reasoning-Time Memory-Augmented Perception), which couples two complementary latent memories: a static, question-conditioned Global memory that preserves scene and cross-image context, and a dynamic Local memory that uses this context as an anchor while selecting and re-encoding region-level evidence according to the current reasoning state. Both memories return compact latent tokens inserted into the reasoning sequence, and a reinforcement-learning access policy trained with branched rollouts decides when to continue reasoning or invoke Global or Local memory. On ten benchmark families, ReMAP outperforms prior visual-memory methods on all four multi-image benchmarks, exceeding the strongest prior results on MuirBench and MIMIC by 8.38 and 14.84 percentage points. Across four backbone families, enabling memory access improves over the same trained model with memory disabled, and on shared V*Bench, CV-Bench-2D, and MuirBench questions ReMAP reduces the visual tokens entering the reasoning sequence by 51.0-76.8% relative to the native-resolution backbone. Further analyses show that Global and Local memory form distinct yet complementary latent representations. Together, these components restore the perceptual cycle by letting the reasoning state trigger targeted visual retrieval, with the retrieved evidence guiding subsequent reasoning.

[65] LoopMoEVR: Loop-Based Degradation-Aware Mixture-of-Experts for Unified UHD Video Restoration cs.CVPDF

Yucheng Xin, Runci Bai, Yongcong Wang, Guangwei Gao, Jiao Liu

TL;DR: 提出LoopMoEVR循环式混合专家模型，以退化条件和自适应迭代深度统一修复超高清视频。

Details

Motivation: 统一高分辨率修复方法常靠不断加深网络提升泛化，收益有限且参数增多；不同退化任务需要跨域建模与条件化能力。

Result: LoopMoEVR使用退化条件低秩循环嵌入设定输入相关阶段条件；IterAda3DN融合局部特征与全局循环语境并进行位置仿射调制；专家分支将时空注意力更新状态与循环条件结合生成专用调制参数，输入条件深度预测器动态决定循环次数。仅约0.884M可训练参数，统一处理超高清视频去雾、去雨、去噪和低照度增强，在公开基准及真实场景均达到当时最先进修复表现。

Insight: 共享循环结构加条件专家可用小模型统一多退化修复；摘要未报告具体指标或推理开销。

Abstract: Recently, unified high-definition image restoration has attracted considerable attention; however, existing models tend to excessively increase their depth in pursuit of improved generalization, which often yields only limited gains. Meanwhile, loop-based learning paradigms have drawn widespread attention due to their low parameter counts and strong regression capability, as exemplified by GPT-6 and looped Transformers. In this paper, we introduce the loop learning paradigm to address restoration tasks that require cross-domain learning. Specifically, we propose LoopMoEVR, a loop-based mixture-of-experts model capable of handling degraded ultra-high-definition (UHD) inputs. First, a degradation-conditioned low-rank loop embedding is designed to construct input-dependent stage conditions. Second, a spatio-temporal iterative adaptive normalization module, termed IterAda3DN, is developed to fuse local features with global loop context, thereby performing position-wise affine modulation. Finally, the expert branches further integrate the attention-updated local and global video states with the loop conditions to generate dedicated modulation parameters, while an input-conditioned depth predictor adaptively configures the number of loop iterations. With only approximately 0.884M trainable parameters, the proposed model uniformly handles UHD video dehazing, deraining, denoising, and low-light enhancement tasks, achieving state-of-the-art restoration performance on both public benchmarks and real-world scenarios.

[66] Representation–Behavior Alignment for Explainable Weakly-Supervised Video Anomaly Detection cs.CVPDF

Chao Huang, Pengfei Wei, Kaige Li, Chengliang Liu, Wei Wang

TL;DR: 提出表示—行为对齐RBA，以视频级弱标签只微调约0.012%骨干参数，让VLM异常检测读出沿判别方向预测。

Details

Motivation: 多模态LLM用于可解释视频异常检测，但最终决策未充分利用隐藏表征中的判别信息，作者将此称为表示—行为错位。

Result: 研究将错位分解为读出位置未汇聚的容量分量及本地正常—异常判别轴方向不匹配分量。多基准、多骨干分析发现方向分量占主导，残差流追踪显示若干中后期注意力层的原生轴可分性明显上升；两个分量均由注意力而非MLP更新主导。RBA据此只用视频级标签适配相关层，更新约0.012%参数。在三个基准上提高原生读出表现并更好对齐判别方向，且以单一生成过程输出异常判断和解释。

Insight: 主要缺口可能是决策方向未利用表示，而非缺乏判别信息；轻量注意力适配可同步改善读出和生成解释，摘要未列具体指标数值。

Abstract: Multimodal Large Language Models (MLLMs) provide a natural way to make video anomaly detection more explainable. However, their final decisions do not always fully use the discriminative information contained in their hidden states, an issue we refer to as representation–behavior misalignment. We decompose this gap into a capacity component that measures discriminative information never aggregated into the readout position, and a directional component that measures the angular mismatch between the optimal and the native normal–abnormal axis at that position. Across multiple video anomaly detection benchmarks and MLLM backbones the directional component dominates, and residual-stream tracing shows that native-axis separability rises sharply in several mid-to-late attention layers. Because both components are governed by attention rather than MLP updates, we propose Representation–Behavior Alignment (RBA), a parameter-efficient method that adapts those layers using video-level labels alone while updating about 0.012% of the backbone parameters. Experiments on three benchmarks show that RBA improves native-readout performance and better aligns the model’s decision direction with discriminative representations, and it produces anomaly decisions and explanations through a single generative process.

[67] PCLM: Small-target localization with frozen CLIP via prototype contrast and local magnification cs.CVPDF

Zhipeng Ye, Feng Jiang, Qiufeng Wang, Hao Li

TL;DR: 提出PCLM，以五张支持图构造前景—背景原型差，在冻结CLIP空间定位小目标并通过九个重叠局部窗口放大观察。

Details

Motivation: 小目标在视觉语言编码器中只占少量patch，空间特征易将目标与背景混合；文本条件定位难以利用示例中的细粒度类别与背景差异。

Result: 每类五张掩码支持图的区域特征等权形成前景与背景原型，其差作为查询patch的共同得分方向；九个重叠窗口分别放大编码，再重投影及覆盖平均为连续定位图。类别方向仅2KiB且不随支持样本数变化，可迁移至类别映射后的其他数据集。在VOC、COCO、ADE20K、Oxford-IIIT Pets共5,047个小目标查询上，各数据集平均像素AP均高于所评文本条件基线；场景数据集较最强基线高5.63至13.23个百分点。相近实测时延下，局部放大较整图放大高4.51至5.68点；额外支持样本只细化类别估计，不增加表示大小或查询打分成本。

Insight: 用示例对比背景能构造通用类别方向，局部观察进一步放大小目标；少量支持掩码是前置数据成本。

Abstract: Small targets occupy few patches in a vision-language encoder, so spatial features often mix object appearance with surrounding content. We propose Prototype Contrast and Local Magnification (PCLM), a support-conditioned localization method that uses a frozen CLIP encoder. Five masked support images per class define foreground and background prototypes through equally weighted regional features. Their difference provides a shared scoring direction for query patches, explicitly comparing target evidence with the demonstrated background. Nine overlapping query windows are enlarged and encoded independently to sample small targets more densely. Reprojection and coverage averaging combine their scores into a continuous localization map. The class direction occupies 2 KiB regardless of support count and transfers unchanged across datasets with mapped categories. On 5,047 small-target queries from VOC, COCO, ADE20K and Oxford-IIIT Pets, PCLM achieves higher mean pixel AP than every evaluated text-conditioned localization baseline on each dataset under our evaluation protocol. Gains over the strongest scene-dataset baselines range from 5.63 to 13.23 percentage points. At comparable measured latency, local magnification improves scene small-target AP by 4.51 to 5.68 points over whole-canvas enlargement. Factorial experiments show that prototype contrast increases the benefit of local observation, including under matched image-coordinate filtering. Support-budget experiments show that additional examples refine category estimation without increasing representation size or query-time scoring cost.

[68] RoMod: Temporal Routing Modulation via Mixture-of-Experts for Video Anomaly Detection cs.CVPDF

Chao Huang, Pengfei Wei, Benfeng Wang, Chengliang Liu, Wei Wang

TL;DR: 提出RoMod，用稀疏专家路由信号调制视频异常检测语义特征，并以时间网络刻画异常发生、持续和终止。

Details

Motivation: 多模态LLM中间层特征可用于视频异常检测，但判别性信息来源不清；稀疏MoE提供可解释专家结构，可分析异常信号集中位置。

Result: 冻结骨干且不训练时发现异常证据集中于少数专家，这些专家跨层复现并自发专门化不同异常类型，形成动态路由子网络；受其影响最强的输出通道也含最相关异常信息。RoMod仅用5%弱标注视频训练，包含路由调制融合RoMF（自适应重校准语义通道，并阻止路由分支脱离语义独立预测）和路由感知时间网络RoTN。在三个基准上达到当时最先进表现，且比相近规模稠密骨干显著更快。

Insight: 专家路由本身可作为补充异常信号而不只是计算机制；弱标签用量较少，但摘要未给出具体分数及速度倍率。

Abstract: Intermediate-layer features from multimodal large language models have shown strong potential for video anomaly detection (VAD), yet the origin of their discriminative power remains unclear. We study this question using sparse mixture-of-experts (MoE) models, whose explicit expert structure and sparse activation make their internal computation easier to inspect. With a fully frozen backbone and no additional training, we find that anomaly-related evidence is concentrated in a small set of experts. These experts recur across layers, spontaneously specialize in different anomaly types, and together form a dynamic routing subnetwork. We further show that the output channels most strongly influenced by these experts are also the hidden dimensions that contain the most anomaly-relevant information. Routing statistics can therefore serve as an internal anomaly cue that complements semantic features.Based on these findings, we propose RoMod, an efficient VAD framework trained with only (5%) of weakly labeled videos. RoMod includes a Routing-Modulated Fusion module, RoMF, and a Routing-aware Temporal Network, RoTN. RoMF uses routing signals to adaptively recalibrate hidden semantic channels. Its design also prevents the routing branch from bypassing semantic features and making predictions on its own. RoTN captures the temporal evolution of anomalies from onset to persistence and termination. Experiments on three benchmarks show that RoMod achieves state-of-the-art performance while running substantially faster than dense backbones of comparable size.

[69] SemCam: Semantic Camera Motion Control for Video Generation cs.CVPDF

Janna Bruner, Omer Talmi, Ianir Ideses, Lior Fritz, Lior Wolf

TL;DR: 提出SemCam语义相机运动控制任务及方法，仅给参考视频和相对主体的运动标签即可生成符合动态关系的相机轨迹。

Details

Motivation: 保持正面视角等相机行为需随主体位置和朝向改变，预先指定轨迹困难；现有视频到视频方法依赖明确轨迹或参考运动，不能直接表达此类关系。

Result: SemCam以共享基底低秩适配和运动条件调制学习目标行为，并用背景一致损失保留参考与生成共有区域。作者构建覆盖八种相机语义行为的661对视频，使用109场景独立基准、相对主体运动指标、外观指标和用户研究评估。语义运动成功率68.6%，高于最强基线Vista4D的45.3%，主体身份保持相当。

Insight: 相对主体的语义标签比预设相机轨迹更适合动态跟拍控制；该方法仍需保留源视频内容且结果基于构建的场景基准。

Abstract: Controlling the camera relative to a moving subject in an existing video is challenging: behaviors such as maintaining a frontal view require the camera to adapt to the subject’s changing position and orientation, making the desired trajectory difficult to specify in advance. Existing camera-controlled video-to-video methods typically rely on explicit trajectories or reference motions, which do not directly express these dynamic camera–subject relationships. We introduce semantic camera motion control, a novel video-to-video task in which a reference video and a target motion label specify the desired subject-relative camera behavior without an explicit target trajectory. Our method, SemCam, learns to realize this behavior while preserving source content. It combines shared-basis low-rank adaptation with motion-conditioned modulation, while a background-consistency loss encourages fidelity in regions visible in both reference and target videos. We construct 661 paired videos covering eight semantic camera behaviors and evaluate on a separate 109-scene benchmark using subject-relative motion metrics, appearance measures, and a user study. SemCam achieves a semantic-motion success rate of 68.6%, compared with 45.3% for Vista4D, the strongest evaluated baseline, while maintaining comparable subject identity preservation.

[70] Recurrent Latent Visual Search for GUI Grounding cs.CVPDF

Kaiyu Wu, Beichen Zheng, Weiyao Huang, Keze Wang

TL;DR: 提出ReLaViS，在单轮交互内通过递归潜在视觉搜索逐步定位GUI截图中的小型目标元素。

Details

Motivation: 单步定位在元素微小或布局密集时易失败；多步视觉搜索可补足，但现有方法依赖与视觉空间错位的文字推理或昂贵外部工具往返。

Result: 空间搜索头用隐状态查询截图视觉token，输出显式搜索分布并聚合为潜在视觉证据，再递归反馈作为下一步嵌入；平面元素标注构造由全局界面到中间元素组再到目标的粗到细搜索轨迹监督。基于Qwen2.5-VL-7B，ScreenSpot-Pro准确率提高3.1个百分点至56.3%，推理FLOPs仅增加3.5%；五个基准均优于匹配单步基线。

Insight: 把搜索空间状态显式内化并递归更新，可避免多轮外部工具交互；整体FLOPs增幅小，但ScreenSpot-Pro成绩仍有较大提升空间。

Abstract: GUI grounding is a critical capability for GUI agents powered by vision-language models, helping them execute user instructions by locating the corresponding elements in screenshots. Single-step grounding struggles with small elements and dense layouts, motivating multi-step visual search. However, existing approaches commonly rely on textual reasoning misaligned with visual space or costly multi-round interactions with external visual tools. To make multi-step visual search an explicit spatial process within the model, we propose ReLaViS, which performs Recurrent Latent Visual Search in a single interaction round. At each step, a spatial search head uses the hidden state to query the screenshot’s visual tokens, producing a spatial search distribution that explicitly represents the search focus. This distribution then aggregates the visual tokens into latent visual evidence, which is recurrently fed back as the next input embedding to condition subsequent search. We further introduce a GUI-aware coarse-to-fine inductive bias through trajectories constructed from flat element annotations, supervising search from the global interface through intermediate element groups to the target. Built on Qwen2.5-VL-7B, ReLaViS improves ScreenSpot-Pro accuracy by 3.1 percentage points to 56.3% with only a 3.5% increase in inference FLOPs and outperforms the matched single-step baseline on all five benchmarks.

[71] How Does Geometry Enter Generated Motion? cs.CV | cs.AIPDF

Weihan Li, Junhao Wu, Yuhan Song, Xiaofeng Lin, Xinlei Chen

TL;DR: 通过固定物理定律和初态、只改变首帧场景几何，测试视频生成模型能否遵循几何条件下的物理运动。

Details

Motivation: 视频生成常被视作世界模型，需检验其运动是否真正遵循场景物理几何，而非只产生看似合理的动态。

Result: 对九个图生视频模型，在匹配轨道和挡板族中控制改变局部凸起、障碍高度、提示词或视频长度，并把轨迹与对应几何下模拟器预测比较。生成运动保留并响应可视几何，例如球速跟随轨道起伏；但状态演化持续偏离固定物理规律：平均斜率几乎不加速球、接触事件不按一致状态组合、球未到达的前方几何编辑会提前改变运动，球还能爬过高于释放点的障碍。整体轨迹主要受文本决定终点、受视频长度决定时序；照片首帧测试也呈相同模式。

Insight: 当前视频生成更像几何条件运动合成，而非遵循固定物理状态转移；前方编辑影响未到达运动显示其状态传播机制存在系统性偏差。

Abstract: Under a fixed physical law, the visible geometry of a scene determines how motion must change. We ask how video generators realize this relationship. We fix the law and the initial state and change only the geometry drawn in the first frame, within matched families of tracks and deflectors, and compare each generated trajectory with the simulator prediction for that geometry. Paired interventions change one thing at a time: a local bump, the height of a barrier, the words of the prompt, the length of the clip. Across nine image-to-video models, geometry is preserved and shapes the motion: the speed of the ball follows the drawn undulation of a track. A physical state would carry this response forward, and here the generated motion parts from the law. The mean slope barely accelerates the ball, successive contacts fail to compose through a consistent state, an edit ahead of the ball alters its motion before it arrives, and the ball climbs over barriers higher than its release point. Two global conditions organize the global trajectory: text strongly controls the destination, while clip length strongly controls timing in the open-weight models tested. The pattern persists with photographed first frames. Current video generation thus behaves as geometry-conditioned motion synthesis whose evolution of state differs systematically from that of a fixed physical law.

[72] Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agents cs.CVPDF

On Tai Tang

TL;DR: 提出Long-MDR长上下文多模态深度研究代理RL配方，训练长度扩展到128K上下文及75轮以上工具交互。

Details

Motivation: 多模态研究代理需搜索网页、检查视觉证据、回看假设并累积大量历史，传统在线RL多局限于短上下文和交互；弱策略早期浪费交互预算，后期熵过早坍塌则中止学习。

Result: Long-MDR由在线策略蒸馏热身、渐进延长交互时域和熵触发恢复组成，以改善长程RL效率与稳定性。在50轮评估预算下，Long-MDR-9B在所比较7B至9B代理中六个基准的五个排名第一。

Insight: 训练策略需同时解决早期不会用预算和后期策略熵坍塌；摘要未给出各基准具体分数或相对基线幅度。

Abstract: The next generation of multimodal research agents must reason over long-lived research histories rather than short model completions. During a single task, an agent may repeatedly search the web, inspect visual evidence, revisit earlier hypotheses, and accumulate tens of thousands of tokens of multimodal context. Despite this trend, online RL for multimodal research agents remains largely confined to shorter contexts and interaction horizons. We push online RL training to 128k context and 75+ tool-interaction turns. To our knowledge, this is the first online multimodal deep-research RL study trained at 128k context, and the first trained with a 75 tool-turn horizon. Scaling to this regime exposes several practical limitations of conventional RL training. Early in training, weak policies make poor use of large interaction budgets, causing expensive rollouts with little reward improvement. Later, policy entropy can collapse before performance has saturated, prematurely ending useful learning. We introduce Long-MDR, a three-component training recipe designed specifically for this setting: On-Policy Distillation Warmup, Progressive Horizon Expansion, and Entropy-Triggered Rescue. Together, these techniques improve both the learning efficiency and stability of long-horizon RL, enabling continued gains in a regime where direct training is slow and costly. At a 50-turn evaluation budget, our RL-trained Long-MDR-9B ranks first on five of six benchmarks among the compared 7B-9B agents.

[73] PixReenact: Pixel-Conditioned Causal Video Diffusion for Streaming Head-Avatar Reenactment cs.CVPDF

Gavriel Habib, Dvir Samuel, Or Shimshi, Rami Ben-Ari

TL;DR: 提出PixReenact，基于因果视频扩散的像素条件流式头像重演，直接从参考与驱动帧转移表情和动作。

Details

Motivation: 实时头像重演需在低延迟下传递动作、长期保持身份；外部身份/动作编码可能丢失像素信息并带来抽取错误，离线整段去噪也不适合连续流。

Result: PixReenact对VAE编码参考帧和驱动帧做像素条件化，不用专门身份或动作表征；通过跨身份伪监督及锚定参考、驱动输入的校正目标分离身份与动作。长程自回归rollout减轻漂移，状态感知双教师蒸馏分别处理冷启动与稳态生成。三个跨身份基准和一个长时流式基准显示，在极端视角、遮挡和强表情下有稳健重演并长时间保持身份；4-NFE滚动学生每次更新持续输出4帧，平均发帧延迟239ms。

Insight: 像素直连条件与分阶段稳态/冷启动蒸馏避免依赖外部动作特征；摘要未报告身份指标或逐基准数值。

Abstract: Streaming head-avatar reenactment aims to animate a reference image according to a live driving video, requiring robust motion transfer, long-term identity stability, and low latency. Existing methods often rely on specialized identity or motion representations, which can discard useful visual information and inherit failure modes from external extractors. In addition, many recent diffusion-based reenactment methods use offline, clip-based generation, jointly processing and denoising an entire video clip before producing its output, making continuous low-latency streaming difficult. We introduce PixReenact, a pixel-conditioned streaming reenactment framework built on causal video diffusion. PixReenact conditions directly on VAE-encoded reference and driving frames, without specialized identity or motion representations. To separate reference identity from driver motion, we train with cross-identity pseudo supervision together with corrective objectives anchored to the original reference and driving inputs. Long self-rollouts reduce autoregressive drift, while state-aware dual-teacher distillation separately addresses cold-start and steady-state generation. Across three cross-identity benchmarks and a long-horizon streaming benchmark, PixReenact demonstrates robust cross-identity reenactment, particularly under challenging conditions such as extreme viewpoints, occlusions, and pronounced facial expressions, while maintaining the reference identity over long streams. A 4-NFE rolling student continuously emits four frames per update with a mean emission latency of 239 ms.

[74] ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image cs.CVPDF

Kai Lv, Yibo Yin, Lijun Guo, Heng Fan, Kaihao Zhang

TL;DR: 提出ArticuTable，从单张图像恢复桌面场景输入视图布局及可执行关节式物体资产。

Details

Motivation: 具身代理需要兼具真实观感和物理互动的3D环境；单图重建通常把对象当作不可关节整体，无法执行部件级运动，且单视图允许多种位姿—尺度解释。

Result: GRAM模块用VLM引导关节拟合并结合语义状态推理，从不完美整体代理网格恢复可靠关节参数和有效运动范围，形成可执行资产。PSGSR逐步缩小位姿/尺度搜索空间，联合度量、平面及输入视图约束，并以结构感知语义对应消除方向歧义，恢复与输入一致布局。作者构建含100个可用于模拟的ArticuTable场景；广泛评估及用户研究显示在视觉保真、输入视图一致、关节质量、物理合理和模拟就绪度方面表现强。

Insight: 从单图重建需同时解决场景位姿不确定性与关节语义建模；用户研究支持综合质量，但摘要未报告具体数值。

Abstract: Embodied agents benefit from 3D environments that combine visual fidelity to real-world observations with physical interactivity. Existing single-image tabletop reconstruction methods recover plausible scene geometry but typically represent objects as monolithic rigid bodies, limiting interaction to whole-object rigid motion and precluding executable part-level articulation. Meanwhile, recovering a scene layout consistent with the input view remains challenging because a single observation may admit multiple plausible pose-scale configurations. We present ArticuTable, a single-image 3D tabletop reconstruction framework that recovers both executable part-level articulation and an input-view-consistent scene layout. For object modeling, we introduce generation-robust articulation modeling (GRAM), which combines joint fitting guided by a multimodal large language model with semantic state reasoning to recover reliable joint parameters and valid motion ranges from imperfect monolithic proxy meshes, thereby converting them into executable articulated assets. For scene layout, we introduce progressive semantic-geometric scene registration (PSGSR), which progressively narrows the pose-scale search space under complementary metric, planar, and input-view constraints and resolves orientation ambiguity through structure-aware semantic correspondences, yielding a scene layout consistent with the input view. We further contribute ArticuTable-100, a curated collection of 100 simulation-ready tabletop scenes. Extensive evaluation, including a user study, demonstrates strong performance across visual fidelity, input-view consistency, articulation quality, physical plausibility, and simulation readiness.

[75] MGPO: Manifold-Guided Diffusion Alignment for Task-Aware Dataset Distillation cs.CV | cs.AIPDF

Yunyi Chen, Chenru Wang, Xinyi Ye, Zexin Zheng, Chi Zhang

TL;DR: 提出MGPO，将扩散数据集蒸馏建模为多目标RL，以像素判别奖励和基于类内最小生成树的潜空间覆盖奖励联合引导样本。

Details

Motivation: 扩散模型倾向拟合密度而非下游判别边界，且高密度模式集中会导致生成样本覆盖不足、丢失类别结构多样性。

Result: MGPO用像素空间奖励促进类别可分性，按类别最小生成树构造潜空间几何奖励，鼓励生成潜变量覆盖稀疏几何骨架；作者提供理想化分析，包括Hausdorff近似界及与数据集规模无关的子采样界。冻结任务奖励模型可替换以扩展到检测和分割。实验中持续优于既有方法，低预算分割设置mIoU提高8.0%。

Insight: 数据集蒸馏需同时匹配判别目标和类别几何覆盖，仅拟合样本密度不够；理论界基于理想化设定。

Abstract: Diffusion-based dataset distillation (DD) suffers from a fundamental objective mismatch: likelihood-driven diffusion models prioritize density approximation over the discriminative decision boundaries required for downstream tasks. Beyond semantic mismatch, relying solely on density also leads to geometric coverage loss, where generated samples collapse into a few high-density modes and fail to cover the manifold’s structural diversity. We propose Manifold-Guided Policy Optimization (MGPO), which reformulates DD as a multi-objective reinforcement learning problem and achieves Dual-Space Alignment via a pixel-space discriminative reward and a latent-space geometric reward guided by a class-wise Minimum Spanning Tree (MST). The discriminative reward enforces class separability, while the MST-based geometric reward encourages generated latents to cover a sparse geometric skeleton of each class, jointly addressing both failure modes. We further provide an idealized analysis that motivates the MST-based reward, including a Hausdorff approximation bound and a subsampling bound independent of the dataset size. The reward-modular design extends to structured tasks such as object detection and segmentation by substituting the frozen task reward model. Extensive experiments show MGPO consistently outperforms existing methods, including a +8.0% mIoU gain on segmentation under low-budget settings.

[76] Hybrid-Basis Feature Forecasting for Diffusion Sampling Acceleration cs.CVPDF

Kai-Liang Cheng, Yuan-Yuan Cheng, Yu-fan Jin, Xiao-Ming Fu

TL;DR: 提出HybridFF免训练扩散采样加速器，以多组基函数预测特征并根据分支可靠性融合预测。

Details

Motivation: 预测扩散特征演化需同时处理局部平滑、长期趋势和非单调变化，单一基函数可能限制缓存或跳步加速质量。

Result: HybridFF为多种互补基函数分别以移动最小二乘估计系数，再加权组合预测器。固定版用少量样例校准模型专属权重、推理时保持不变以求速度；自适应版依据指数移动平均全步误差在线更新分支可靠性权重，在激进缓存下改善预测与质量同时保留加速。DiT-XL/2、FLUX.1-dev、SD3.5-Large及HunyuanVideo实验显示，相对代表性单基预测及缓存基线取得更优速度—质量权衡。

Insight: 模型特定基函数融合可覆盖不同特征动态，自适应误差反馈适合更激进加速；摘要未提供具体速度倍率和质量分数。

Abstract: We propose Hybrid-Basis Feature Forecasting (HybridFF), a training-free, plug-and-play framework for accelerating diffusion sampling. To capture local smoothness, long-range trends, and complex non-monotonic variations when modeling feature evolution, HybridFF first estimates coefficients using moving least squares (MLS) for each of multiple complementary basis families and then combines the corresponding predictors using fusion weights. In addition to the choice of basis functions, the fusion weights also play a critical role. We introduce two strategies to balance quality and speedup. HybridFF (Fixed) prioritizes efficiency with model-specific fusion weights calibrated on a small set and held constant during inference. HybridFF (Adaptive) updates the fusion weights online using branch reliability scores computed from an exponential moving average of full-step prediction errors, improving prediction fidelity and generation quality under aggressive caching while retaining substantial acceleration. Experiments across DiT-XL/2, FLUX.1-dev, SD3.5-Large, and HunyuanVideo demonstrate a favorable speedup–quality trade-off over representative single-basis forecasters and caching baselines.

[77] When and What to Prune? Stage-Aware Visual Token Pruning for Efficient VLA cs.CV | cs.ROPDF

Tianjun Shi, Haotian Xiong, Ziyu Gong, Qi Lu, Li Li

TL;DR: 提出训练免调度式SAPrune，根据动作到视觉注意力何时稳定来选层，并双路径保留关键patch和周边上下文。

Details

Motivation: VLA需先处理大量视觉token；常见裁剪按注意力或特征多样性挑token，但固定裁剪层不安全，因为早期看似不重要的区域可能在语言与视觉融合后变得对动作有用。

Result: SAPrune用小校准集跟踪跨层动作—视觉注意力变化，仅当模式更可靠时才启动剪枝；一条路径保护高注意区域，另一条避免删掉有用周边上下文。在LIBERO、SIMPLER和真实机器人任务上裁掉87.5%视觉token，最高推理加速1.718倍，同时保持有竞争力的任务成功率。

Insight: 剪枝时机需依赖VLA动作注意力成熟度，而不是固定层数；策略需付出小规模校准成本，摘要未报告各任务具体成功率。

Abstract: Visual token pruning is an effective way to accelerate vision-language models and is especially useful for vision-language-action (VLA) inference, where many visual tokens must be processed before predicting robot actions. Existing pruning methods usually estimate which tokens can be pruned based on attention scores or feature diversity, retaining tokens that are either highly attended or visually different from others. However, most of them use fixed pruning schedules, such as pruning once at a preset layer or pruning at uniformly spaced layers. Such schedules can be risky for VLA models, because the model may not know which visual regions matter for the action in early layers. Tokens that look unimportant at first may become useful after the model combines visual observations with the language instruction. In this work, we propose SAPrune, a training-free visual token pruning framework for efficient VLA inference. Instead of pruning at fixed layers, SAPrune uses a small calibration set to observe how action-to-visual attention changes across layers, and chooses pruning layers only after the attention pattern becomes more reliable. At each selected layer, SAPrune applies a dual-path pruning rule: one path protects strongly attended visual tokens from pruning, while the other prevents useful surrounding context from being discarded. Experiments on LIBERO, SIMPLER, and real-world robotic tasks show that SAPrune prunes 87.5% of visual tokens and achieves up to 1.718x inference speedup while maintaining competitive task success rates.

[78] Revisiting Ground-Truth Synthesis from High-Speed Video: Exact Validity Conditions and an Audited Consumer Capture Corpus cs.CV | cs.AIPDF

Abdullah Al Shafi, Sumaiya Rahim Suma

TL;DR: 重新推导高速视频合成去模糊真值标签的严格有效条件，并审计手机标称240fps视频的实际计时。

Details

Motivation: 运动去模糊数据常把连续N帧平均作为模糊输入并以中央帧作标签，但采样窗口奇偶和单帧持续时间可能引入系统性偏移或监督卷积。

Result: 证明仅当窗口为奇数且各帧采样时长相等时，中央帧标签对任意采集时刻均无偏；偶数帧窗口即使时序完美也会按模糊长度固定分数偏移。不等时长的平均错位为零，数据集统计可能发现不了，但若无法从模糊图像恢复偏移，就会卷积监督而非仅增噪声。审计51段标称240fps手机片段，19段实际近176fps，差异只记录在容器时序表。控制实验中奇偶选择对拟合线性去模糊滤波器影响远大于这些时序异常；插值标签可用真实帧时刻修复。作者提供无需解码即可检查两条件的工具。

Insight: 构造监督需核查窗口奇偶和每帧持续时间，平均计时误差不代表标签无偏；只依赖帧率元数据会漏掉设备实际行为。

Abstract: Motion-deblurring datasets are commonly synthesised by averaging $N$ consecutive high-frame-rate frames and labelling the result with the central frame. We show that this label is unbiased for every capture timing only when the window is odd and the frames’ sample durations are equal. An even window shifts every label by a fixed fraction of the blur length, even under perfect timing. Unequal durations are subtler: their mean misalignment is zero, so dataset statistics cannot reveal them, yet when the offset cannot be read from the blur they convolve the supervision rather than adding noise to it. Auditing 51 smartphone clips recorded at a nominal 240 fps, we find 19 captured near 176 fps, a behaviour recorded only in the container’s timing tables. In a controlled test the parity choice costs a fitted linear deblurring filter far more than these timing irregularities do, and interpolation labels, unlike blur labels, can be repaired with the true frame times. We provide a tool that checks both conditions without decoding, and will release the clips and their timing tables.

[79] Answer with Evidence: Consistency-Aware Grounded Visual Question Answering for Roadside Traffic Scenes cs.CV | cs.HCPDF

Runwei Guan, Rongsheng Hu, Shangshu Chen, Ningwei Ouyang, Shaofeng Liang

TL;DR: 提出RoadSceneVQA-G及AGC一致性评测，并以先枚举证据后作答的EtA结构和ECPO强化学习减少交通VQA的说—点不一致。

Details

Motivation: 路侧交通VQA需每条文本陈述有视觉依据，但答案和框框分开评分会漏掉文字与定位矛盾；先作数值判断再找对象可能导致这种错位。

Result: RoadSceneVQA-G含3.47万组问答，每个自由答案关联见证它的框集合。EtA先枚举实体再生成答案，使输出结构显式绑定证据；ECPO用多条rollout并集作召回教师，不依赖真值框。EtA将说—点一致率从26.6%提升至93.7%，定位F1从52.2%升至73.0%；ECPO再把F1提升至75.6%。在gRefCOCO上同框架也超过最强对比方法。

Insight: 先定位候选证据再组织答案，可让文本和框共同受约束；多rollout召回教师提升定位时无需逐框监督。

Abstract: Roadside traffic reasoning requires every free-form textual claim to be backed by visual evidence. Existing grounded multimodal large language models (MLLMs) frequently exhibit say-point mismatch, in which the textual answer contradicts the bounding boxes the model localizes. Evaluation metrics that score answers and boxes separately leave this failure unpenalized. We trace the mismatch to the conventional answer-then-ground factorization, which commits to a numerical claim before any object is enumerated. To measure it, we build RoadSceneVQA-G, a benchmark of 34.7K question-answer pairs in which every free-form answer is linked to the set of boxes that witnesses it, and we propose the Answer-Grounding Consistency (AGC) evaluation suite. To address it, we introduce Enumerate-then-Answer (EtA), which reverses the generation order so that answer-evidence agreement becomes a property of the output structure, and Enumeration-Consistent Policy Optimization (ECPO), a reinforcement learning stage that uses the union of multiple rollouts as a recall teacher without ground-truth boxes. EtA raises say-point consistency from 26.6% to 93.7% and grounding F1 from 52.2% to 73.0%, and ECPO further increases F1 to 75.6% without per-box supervision. On gRefCOCO, the same framework outperforms the strongest compared method, indicating that it transfers beyond traffic scenes. The project is available at \url{https://github.com/GuanRunwei/RoadSceneVQA-G}.

[80] BossouChimpanzee: Long-term Chimpanzee Video Dataset cs.CVPDF

Daniel Schofield, Susana Carvalho, Vladimir Iashin, Andrew Zisserman, Max Bain

TL;DR: 发布BossouChimpanzee长期野生黑猩猩视频档案及约74小时初始数据切片，支持行为研究与野外视听模型评估。

Details

Motivation: 野生灵长类认知与行为研究需要长期自然互动记录，但公开的连续多年野外视频数据和个体/行为基准资源有限。

Result: 档案来自几内亚Bossou户外实验室1988至2018年合作野外研究，累计超过1,200小时连续视频。论文介绍实验范式历史、科学贡献、主数据结构及统计信息，并提前发布约74小时的BossouChimpanzee70h切片，覆盖23只已识别个体，聚焦个体识别与动作识别。

Insight: 跨三十年的野外视频记录可支撑灵长类认知行为研究及真实环境视听模型训练；当前公开仅为全档案的一部分。

Abstract: We describe the BossouChimpanzee video dataset, a unique long-term visual record of wild chimpanzees at an outdoor laboratory for field experiments in Bossou, Guinea, spanning three decades (1988-2018) and comprising over 1,200 hours of continuous video recordings collected through collaborative fieldwork and research. In this paper, we outline the history and scientific contributions of the experimental paradigm and video archive, provide key statistics and details on the structure of the main video dataset, and release an initial ~74h snapshot, BossouChimpanzee70h, covering 23 identified individuals focused on chimpanzee individual and action recognition, ahead of the full video resource. This dataset represents a valuable resource for cognitive and behavioural research in ethology and a rich benchmark for training and evaluating machine learning models on audiovisual data from the wild.

[81] Kinematics-Centric Continuous Sign Language Retrieval with Gloss-Guided Boundary-Aware Alignment cs.CVPDF

Chang Liu, Ke Han, Davide Talon, Elisa Ricci, Nicu Sebe

TL;DR: 提出运动学为中心的连续手语检索方法，以3D SMPL-X动作和gloss时间跨度进行局部动作—文本对齐。

Details

Motivation: 现有手语文本对齐依赖RGB外观，容易把动作语义与视觉变化纠缠，使细粒度词语定位模糊。

Result: 方法以3D SMPL-X作为主要运动表示，在统一运动空间显式建模手语动力学，降低对外观信号依赖。Gloss引导局部对齐用gloss时间跨度作弱监督，将连续动作切分成连贯片段并建立细粒度文本对应；视觉蒸馏在训练期将RGB作为特权上下文，推理时完全移除。标准基准上，CSL-Daily双向检索达到当时最先进结果，PHOENIX-2014T表现有竞争力。

Insight: 运动学表征及局部时间落地减少手语词义定位歧义，RGB特权监督无需在部署时保留；摘要未给具体分数。

Abstract: Sign language-text alignment remains a fundamental challenge for text-driven sign language understanding. Existing methods predominantly rely on appearance-heavy RGB representations, which entangle motion semantics with visual variations and lead to ambiguous motion-language grounding. In this paper, we reformulate sign language-text alignment in a structured kinematic space and propose a kinematics-centric framework that adopts 3D SMPL-X motion as the primary representation. By explicitly modeling the kinematic dynamics of signing in a unified motion space, our approach reduces reliance on appearance signals and yields more semantically consistent representations. To capture the compositional nature of sign language, we introduce a gloss-guided local alignment mechanism that leverages gloss temporal spans as weak supervision to decompose continuous motion into coherent segments and establish fine-grained motion-text correspondences, thereby reducing ambiguity in localizing word-level semantics in continuous signing. Furthermore, we develop a visual distillation strategy, where RGB signals serve as privileged supervision during training to provide complementary contextual cues, while being completely removed at inference time. Extensive experiments on standard benchmarks demonstrate that our method achieves state-of-the-art bidirectional retrieval performance on CSL-Daily and competitive results on PHOENIX-2014T. These results highlight the effectiveness of kinematic representations and explicit local grounding for sign language-text alignment.

[82] IRSTD-Agent: Agentic Infrared Small Target Detection via Zoom-Guided Interaction Learning cs.CV | cs.AIPDF

Jiawen Xi, Yu Zhang, Tianyi Zhao, Zhu Liu, Maoxun Yuan

TL;DR: 提出IRSTD-Agent，通过缩放引导的交互学习，让MLLM动态决定红外小目标图像的观察位置与放大尺度。

Details

Motivation: 红外小目标检测用于海上监视和航空监控，但目标像素极少，现有MLLM难以精确定位。

Result: 代理使用PROPOSAL、ZOOM、DETECT、DROP、REFINE五类互补工具，依次发现候选、调整观察尺度、定位目标、排除假设及细化目标范围。Zoom-guided Interaction Learning从标注导出的交互轨迹监督工具选择及参数。在WideIRSTD-Full和IRSTD-1k上，实验显示其优于所测视觉语言模型，并提升MLLM精确定位能力；摘要未提供具体数值。

Insight: 将定位改为原分辨率上的主动视觉搜索，可逐步收集小目标细节；工具轨迹监督需要标注数据，当前报告未量化收益。

Abstract: Infrared small-target detection plays an important role in maritime monitoring and aerial surveillance. Although multimodal large language models (MLLMs) offer promising capabilities for visual understanding, existing MLLM-based approaches struggle to precisely localize infrared small targets. In this paper, we propose IRSTD-Agent, an agentic framework for infrared small target detection through dynamic visual search. The framework enables an MLLM to adaptively determine where and at what scale to inspect an image and progressively gather fine-grained visual evidence for precise target localization. Five complementary visual tools (PROPOSAL, ZOOM, DETECT, DROP and REFINE) support object candidate discovery, adaptive observation, target localization, hypothesis rejection, and target extent refinement, together enabling a coordinated search process over original-resolution images. To teach the MLLMs to conduct this search, we introduce Zoom-guided Interaction Learning, which uses annotation-derived interaction trajectories to supervise tool selection and the corresponding arguments. Through extensive experiments on WideIRSTD-Full and IRSTD-1k datasets, we demonstrate that IRSTD-Agent outperforms the evaluated vision-language models and enhances the precise localization capabilities of MLLMs in IRSTD tasks.

[83] Learning Conditional Source Distribution via Flow Reversal for Temporal Flow Matching cs.CVPDF

Kuan-Hsun Tu, Hsuan-Chi Liu, Jia-Wei Liao, Chien-Sheng Chiang, Tsung-Wei Ke

TL;DR: 提出CNP-Flow，通过反转流匹配学习时间条件化源分布，用于视频生成和机器人运动规划。

Details

Motivation: 标准条件流匹配通常从标准高斯采样，条件只影响向量场；适配时间条件源分布可能改善生成质量并减少采样函数评估。

Result: CNP-Flow使用条件噪声预测器为每种时间条件产生各向同性高斯源样本，监督样本由预训练流模型逆向映射观测目标得到。三阶段流程先预训练流匹配模型，再训练CNP，最后用学习的条件源分布微调原架构流模型。视频预测、插帧及Franka 7自由度运动规划中，生成质量均有改善；用更少函数评估即可达到基线表现。

Insight: 条件化采样起点本身也可学习，而不只是条件化生成向量场；摘要未报告各任务具体提升量。

Abstract: We introduce CNP-Flow, a flow matching framework for temporal generation that learns conditional source distributions through flow reversal. Whereas standard conditional flow matching (FM) incorporates conditioning through the vector field and draws source samples from a standard Gaussian, CNP-Flow uses a conditional noise predictor (CNP) to produce an isotropic Gaussian source for each temporal condition. The CNP is supervised by source samples obtained through flow reversal, which maps observed targets backward through a pretrained FM model. A three-stage pipeline pretrains the FM model, trains the CNP, and fine-tunes the FM model using the learned source distribution, while preserving the FM backbone architecture. Across video prediction, video interpolation, and 7-DoF Franka robot motion planning, CNP-Flow consistently improves generation quality. It also matches baseline performance with fewer function evaluations. Project page: https://embodiedai-ntu.github.io/cnpflow

[84] A Strong Baseline for Evaluating Vision Encoders in Multimodal Large Language Models cs.CV | cs.AIPDF

Yilin Yang, Jun-Tao Tang, Kengyi Wang, Siyuan Su, Gaoyong Luo

TL;DR: 提出RAVEL免训练跨模态近邻检索指标，用于预测视觉编码器在多模态LLM中的下游能力。

Details

Motivation: 视觉编码器评估需可靠预测下游MLLM表现；尽管跨模态指标可能更贴近任务，实践仍主要采用单模态指标，既有交叉模态评估设计也有局限。

Result: 作者大规模重审跨模态编码器评估，修正既有实验设计与方法问题后提出基于跨模态最近邻检索的RAVEL。该简单免训练方法在作者实验范围内达到最先进表现，并显著超过此前方法，支持谨慎全面评估下简单跨模态指标即可成为MLLM视觉编码器评估的强基线；摘要未报告具体分数或模型名单。

Insight: 指标本身不复杂，但实验设置和验证协议会决定其是否能预测下游能力；RAVEL仍需结合更广基准检验跨域效度。

Abstract: Evaluating vision encoders requires metrics that reliably predict their downstream performance in multimodal large language models (MLLMs). Although recent studies have shown that cross-modal metrics can better capture such performance, unimodal metrics remain the dominant choice in practice. In this work, we revisit cross-modal evaluation of vision encoders through large-scale experiments. We identify important limitations in both the experimental design and methodological formulation of prior approaches. After addressing these limitations and introducing simple improvements, we propose RAVEL, a training-free method based on cross-modal nearest-neighbor retrieval. Despite its simplicity, RAVEL achieves state-of-the-art performance across our experiments, outperforming prior methods by a substantial margin. Our results demonstrate that simple cross-modal metrics, when evaluated under a careful and comprehensive setup, can provide a strong basis for evaluating vision encoders for MLLMs.

[85] CleanMDM: Clean Motion Diffusion Model for Multimodal Motion Cleanup cs.CVPDF

Zhe Li, Shicheng Wang, Bowen Cai, Huan Fu

TL;DR: 提出CleanMDM，以掩码条件生成统一处理动作捕捉缺失、抖动、漂移和接触伪影，并支持多模态约束。

Details

Motivation: 传统动作清理由动画师标关键帧、修正后插值；生成模型虽可自动去噪，却常是难控黑盒，无法可靠保留已有片段或按用户意图修复。

Result: CleanMDM使用单一模型支持任意组合的噪声3D动作、稀疏2D关键帧、稀疏3D关键帧和文本条件，可自动清理也可交互控制。潜在运动质量判别器匹配运动学分布、减轻滑步、抖动与互穿；测试时网格感知接触投影进一步改善接触和物理一致性。多个数据集实验中，稳定优于先前清理和生成基线；低成本的文本及2D关键帧条件也能提供可靠可控性增益。

Insight: 统一掩码生成可在保留可信片段的同时接受多源约束，接触后处理补充物理一致性；摘要未给具体指标。

Abstract: Motion capture data is rarely directly usable, as they typically exhibit missing segments, jitter, drift and contact artifacts. Traditionally, corrupted motions are cleaned by animators through the manual identification of keyframes from noisy motion, subsequent keyframe correction, and interpolation between corrected keyframes to reconstruct coherent motion. While the rise of generative motion models has made automatic cleanup feasible, most approaches operate as black box denoisers with limited controllability, making it difficult to preserve reliable segments or enforce specific user intents. Inspired by animation workflows, we present CleanMDM, a unified multimodal motion cleanup framework that formulates cleanup as masked conditional generation with plug-and-play conditions. This single model supports arbitrary combinations of noisy 3D motion, sparse 2D keyframes, sparse 3D keyframes, and text. This design enables both automatic cleanup without additional user annotation and controllable cleanup under multimodal guidance. To further improve motion realism, we incorporate the Latent Motion Quality Discriminator (LMQD) to better match kinematic distributions and reduce skating, jitter, and interpenetration artifacts, and we apply Mesh-Aware Contact Projection as a test-time optimization step to enhance contact and physical consistency. Experiments across multiple datasets demonstrate that CleanMDM consistently outperforms prior cleanup and generation baselines, and that low cost conditions (text and 2D keyframes) provide reliable controllability gains in multimodal cleanup scenarios.

[86] Render to Reason: Novel-View Semantic Prediction Improves Spatial Understanding in VLMs cs.CVPDF

Yuqun Wu, Yao Xiao, Chuhang Zou, Shenlong Wang, Derek Hoiem

TL;DR: 提出Render to Reason，用预测未见视角语义布局作为几何辅助任务，为VLM的空间推理提供必须依赖三维信息的训练信号。

Details

Motivation: 简单融合预训练3D几何特征并用普通空间问答训练，对高层多跳推理增益有限，因为视觉线索与语言先验足以回答，使几何路径梯度弱。

Result: 新增未观测视角语义渲染任务，要求模型预测新视角布局，联合利用几何提供的位姿相关可见性与视觉提供的语义内容。三个基准上相对几何增强基线均改善：VSI-Bench最多+1.6、ReVSI +2.2、自建3D-Point-QA +2.9；完整模型在VSI-Bench和ReVSI超过此前开源方法。

Insight: 空间训练需设计几何不可替代的监督目标，才能让几何路径实际参与推理；最大提升幅度较小且因基准而异。

Abstract: Recent works augment Vision-Language Models with geometry features from pretrained 3D models, expecting that the geometric signal will boost spatial reasoning. However, we find that simply fusing geometry features and training on standard spatial QA yields only marginal improvements on high-level multi-hop tasks. We attribute this gap to a training-signal problem: standard spatial QA can be largely answered from visual features and language priors, so the geometry pathway receives weak gradients and fails to integrate with the visual features. To provide a training signal that requires geometry, we propose \textbf{novel-view semantic rendering} as an auxiliary training task that requires the model to predict the semantic layout of an unobserved viewpoint, inspired by humans’ ability to mentally simulate novel viewpoints during spatial reasoning. This task encourages joint use of both pathways: geometry provides pose-dependent visibility, while vision provides semantic content. Our auxiliary task yields consistent improvements over the geometry-augmented baseline across all three benchmarks (up to +1.6 on VSI-Bench, +2.2 on ReVSI, +2.9 on our 3D-Point-QA dataset) and our full model surpasses prior open-source methods on VSI-Bench and on ReVSI. Project page: https://yuqunw.github.io/Render2Reason/.

[87] Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training cs.CVPDF

Shuyuan Tu, Qi Tian, Yinming Huang, Yue Wu, Xintong Han

TL;DR: 提出Prism动态稀疏注意力框架，根据区域内视频变化及音频影响组织注意力块，实现原生2K联合视听生成训练加速。

Details

Motivation: 高分辨率联合视频—音频训练有助学习细节和运动，但全注意力开销随token数平方增长，并可能将注意力稀释到冗余内容；通用稀疏方法未考虑视听交互集中于声源区域的特点。

Result: Prism将序列切成时空宏区域，使用视频通道方差及音频到视频交叉注意力特征范数估计局部信息结构，据变化轴与视听耦合强度为各区分配不同块形状，并用混合块选择动态决定逐查询稀疏度。原生2K联合生成实验中，相比全注意力训练加速2.5倍，生成质量反而更高。

Insight: 按局部空间变化与声源耦合组织块，比固定块稀疏更适配联合视听数据；摘要未给出质量指标和硬件设置。

Abstract: Natively training joint video-audio generation models at higher resolutions empowers them to learn richer visual details and sharper motion dynamics. However, full attention incurs quadratic cost and, as resolution increases, spreads attention over increasingly redundant tokens, diluting learning signals for informative content and disrupting pretrained priors. Existing sparse attention methods either target training-free acceleration or overlook the unique structure of joint video-audio data, where cross-modal interactions are inherently concentrated around sound-producing regions. To address this, we propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K. In particular, Prism organizes the token sequence into spatiotemporal macro-zones, enabling the attention structure to adapt to local content. For each zone, it estimates local information structure via video feature variance along the channel and feature norms from the audio-to-video cross-attention, jointly capturing how visual content varies directionally and how strongly audio influences each visual region. Based on these signals, Prism dynamically assigns a tailored block shape to each zone, applying finer partitioning along axes of rapid visual content variation and strong audio-visual coupling. This encourages tokens within each block to remain semantically coherent, allowing block-level features to capture both visual content and joint video-audio interaction patterns. Prism further adopts a hybrid block selection strategy to dynamically determine per-query sparsity. Experiments show that Prism achieves 2.5$\times$ training speedup compared to full attention, while surpassing it in generation quality.

[88] Unmentioned Checklist Findings Change How Reinforcement Learning Appears to Improve Chest Radiograph Report Checking cs.CV | cs.CL | cs.LGPDF

Ali Vosoughi, Akhil Kasturi, Chenliang Xu, Axel Wismueller

TL;DR: 研究胸片报告核查中的强化学习收益如何受未提及发现及训练格式影响。

Details

Motivation: 自动报告核查可能依赖AI生成的检查清单，而清单未明确的发现可能改变“阴性”判断；训练格式和核查模型可能改变测得的强化学习收益。

Result: 研究让VLM在不查看待核对句子的条件下，从胸片填12项发现清单，再由独立核查模型判断句子。在留出患者上，未参与训练的规则核查与独立医疗核查测得区分度Youden指数提高12.6%和11.8%，仅规则核查满足预设误报条件。改为训练格式（固定发现顺序、未提及默认阴性）后，训练核查器测得收益增大、独立核查器收益降低；预先指定比较为6.2%（95%区间2.0%至10.5%），留出集事后比较为7.7%。八种核查器对标签一致的未提及发现阴性句接受率从1.0%至97.0%。

Insight: 核查收益对清单表示方式及评判器选择敏感；标签来自报告而非放射科医师裁定，限制临床结论。

Abstract: Automated checks of radiology reports may rely on AI-generated checklists that leave findings unmentioned. We used reinforcement learning to train a vision-language model to fill in a 12-finding checklist from a chest radiograph without seeing the sentence under test; a separate checking model judged the sentence from the checklist. On held-out patients, a rule-based check and an independent medical checker, neither used in training, measured discrimination gains (Youden index) of 12.6% and 11.8%; only the rule-based check met the prespecified false-alarm criterion. Switching to the training format, which fixes finding order and enters unmentioned findings as absent, raised the training checker’s measured gain and lowered the independent checker’s, a prespecified comparison that yielded 6.2% (95% interval 2.0% to 10.5%) and, post hoc on held-out patients, 7.7%. Across 8 checking models, acceptance of a label-consistent negative statement about an unmentioned finding ranged from 1.0% to 97.0%. Labels were report-derived, not radiologist-adjudicated.

[89] DynaMesh: Dynamic 3D Texture Generation cs.CVPDF

Raj Hansini, Guan Chen, Rana Hanocka, Itai Lang

TL;DR: 提出DynaMesh，从无纹理网格与文本效果生成随时间变化的三维表面纹理，同时保持网格几何恒定。

Details

Motivation: 视频模型可生成单视角效果但无3D概念，逐帧用图像到3D模型提升时会闪烁、丢细节且每帧生成不同网格；现有动态3D工作多让几何动而外观不变，静态纹理工作则缺少时间演化。

Result: DynaMesh先以网格渲染和提示条件化视频模型生成参考视频，再将冻结图像到3D生成器应用于帧序列；通过时间窗混合帧条件减轻闪烁，并按形状拟合低秩适配器恢复细节。网格序列只编码一次，因此几何固定，输出为同一网格的逐帧纹理。多种物体和效果实验中，明显优于近期视频到4D和纹理化方法，且可将时间效果泛化到训练未见形状。

Insight: 固定几何并只让纹理演化可绕开逐帧3D网格不一致问题；摘要未报告量化指标。

Abstract: We present DynaMesh, a dynamic texture generation method for 3D meshes. Given a textureless shape and a text prompt describing an effect, our method produces an appearance that evolves while the object’s geometry remains unchanged. Previous works on dynamic 3D content generation have focused on motion, where an object’s geometry and position change while keeping its appearance the same. Methods on texture generation sit on the other side of the problem, painting appearance onto a shape as a fixed surface property and not as an evolving process. Neither addresses a visual effect that propagates on a 3D object. A natural route consists of two generators: a video model that shows the effect from a single view, and an image-to-3D generator that lifts each frame to 3D. However, the latter has no notion of time, so running it per video frame produces a sequence that flickers, loses effect details, and yields a different mesh at every video frame. Our method addresses these failures by conditioning a video model on a render of the mesh and the prompt to obtain a reference video, then running a frozen image-to-3D generator on the video with two changes. The conditioning of each frame is blended over a temporal window, and low-rank adapters are fit per shape to restore the lost details. The mesh is encoded once for the whole sequence, so geometry is constant by construction, and the output is a single mesh with a texture per frame. Applied to various objects and effects, DynaMesh substantially improves over recent video-to-4D and texturing methods, and can generalize its temporal effect to different shapes never seen during training. Our project page is at https://threedle.github.io/dynamesh/.

[90] Deep Prior Learning for Embodied Perception cs.CV | cs.ROPDF

Yimou Wu, Jiaxin Guo, Yun-hui Liu, Zheng Li

TL;DR: 提出VPGGT具身视觉几何框架，通过先验残差连接保留相机位姿先验，并用度量全局注意力预测统一尺度。

Details

Motivation: 前馈三维感知模型会利用相机位姿、内参和深度等几何先验，但噪声位姿、先验保真与真实尺度恢复不能仅靠直接输入解决。

Result: VPGGT基于VGGT并扩展OmniVGGT；从真值轨迹模拟传感器噪声训练相机姿态，提出无参数PRC缓解预测精度低于输入位姿先验的“先验稀释”。内参和深度不额外加噪；Metric Global Attention根据可用位姿/深度尺度条件化全局尺度token，为几何输出预测共享度量缩放。在四个数据集实验中，所有视图均提供相机先验时，PRC较匹配训练基线提升平移方向精度与联合位姿AUC，且精确及损坏位姿下均有收益。

Insight: 在精化时保留先验残差信息可防止学习预测覆盖可靠输入；摘要未报告具体数据集及提升数值。

Abstract: Embodied systems need geometric perception that exploits available observations beyond images alone. Recent feed-forward 3D models incorporate geometric priors, including camera poses, intrinsics, and depth. However, handling noisy poses, preserving accurate priors, and recovering physical scale require more than simply accepting these inputs. We introduce \emph{Vision-Prior Geometry Grounded Transformer} (VPGGT), a VGGT-based framework that extends OmniVGGT for prior-aware embodied perception. We formulate sensor-motivated pose corruptions from ground-truth trajectories for training and introduce a parameter-free \emph{prior residual connection} (PRC) to mitigate \emph{prior dilution}, where predictions are less accurate than their supplied pose priors. Our noise formulation targets camera poses; supplied intrinsics and depth receive no additional corruption. We further introduce \emph{Metric Global Attention}, which conditions a global scale token on available pose and depth scales and predicts a shared metric scaling factor for the geometric outputs. Experiments across four datasets show that \emph{PRC} improves translation-direction accuracy and joint pose AUC over a matched training baseline when camera priors are provided for all views, under both exact and corrupted poses. These results support explicit prior access during refinement as a useful addition to feature-level conditioning.

[91] Monocular markerless biomechanics for clinically interpretable gait assessment in spinal cord injury cs.CVPDF

Shreyasvi Natraj, Mathieu Ruepp, Yanke Li, Robert Riener, Inge Eriks-Hoogland

TL;DR: 发布脊髓损伤患者SCAI SCI Gait数据集，并评估单目视频网格恢复对临床步态运动学和地面反力的估计。

Details

Motivation: 脊髓损伤康复依赖三维步态分析，但标记式动捕和测力台设备昂贵、许多诊所无法获得；无标记单目流程尚未在神经系统患者队列充分验证。

Result: 数据集含239名成人脊髓损伤患者同步视频、动捕和测力台测量。流程从单一矢状面视频拟合参数人体网格，以人体测量缩放OpenSim模型及虚拟标记驱动。无标记下肢运动学与动捕的一致性r=0.68至0.90（p<0.001），RMSE 4.18°至6.49°；基于运动学预测的地面反作用力与测力台r=0.85至0.87（p<0.001），RMSE 2.13至2.19 N/kg。条件依赖图与Markov blanket发现步态波形成分和功能独立性条件相关；按速度分层聚类揭示同速患者不同机械策略。

Insight: 单目视频可扩展脊髓损伤患者临床生物力学评估并支持表型分析；相关性分析不应解释为步态特征导致功能差异。

Abstract: Three-dimensional gait analysis guides rehabilitation after spinal cord injury but depends on marker-based motion capture and force plates, which few clinics have. Monocular markerless pipelines have been established in fewer healthy adult cohorts but not in neurological cohorts. We present the SCAI SCI Gait dataset, comprising 239 adult individuals with spinal cord injury with synchronized video, motion capture, and force-plate measurements, we fitted a parametric body mesh to a single sagittal-view video, driving an anthropometrically scaled OpenSim model via virtual markers. Markerless lower-body kinematics showed state-of-the-art agreement with motion-capture measurements (r = 0.68-0.90, p < 0.001, and RMSE = 4.18-6.49 degrees), and accurate kinematics-based predicted ground-reaction forces closely matched those measured by force plates (r = 0.85-0.87, p < 0.001, and RMSE = 2.13-2.19 Newton per kg). Furthermore, conditional-dependence graph analysis with Markov blankets revealed that waveform components were conditionally associated with functional independence, and speed-stratified clustering revealed distinct mechanical strategies among individuals walking at similar speeds. These findings establish the use of monocular video as a scalable approach for clinically meaningful biomechanical assessment and data-driven phenotyping in patients with spinal cord injury. Github: https://github.com/SCAI-Lab/SCAI-SCI-Gait

[92] Generating the Wild: Individual-Consistent Image-to-Video Generation for Wildlife cs.CVPDF

Yuzhuo Li, Di Zhao, Xinyu Zhang, Daniel Wilson, Yun Sing Koh

TL;DR: 提出WildIcon高频身份条件图生视频方法，保留野生动物皮毛、斑纹和轮廓等个体辨别线索。

Details

Motivation: 野生动物个体识别缺少同一动物不同姿势、视角和运动观测；图生视频可增广数据，但通常重全局语义与运动，容易丢失区分个体的局部高频外观。

Result: WildIcon从参考图提取身份特定高频线索，结合隔离前景形成身份token注入交叉注意力；在冻结骨干上做轻量身份适配，同时保持运动控制和语义保真。作者构建具个体身份标签且片段时间连贯的WildlifeVid数据集。生成基准与下游重识别实验表明，WildIcon个体一致性强于既有基线，过滤后的生成结果可作为ReID训练增广候选。

Insight: 身份一致性需要关注高频局部细节，而非仅语义类别和整体布局；生成样本被建议作为候选增广，摘要未证明所有伪样本都适合直接训练。

Abstract: Individual-level wildlife identification often suffers from data scarcity, as varying observations of the same animal under diverse poses, viewpoints, and motions are rarely available. Image-to-video (I2V) generation offers a promising way to mitigate this limitation by synthesizing additional observations from a single reference image. However, existing I2V models mainly emphasize global layout, semantics, and motion, and therefore often fail to preserve fine-grained local appearance cues that distinguish one wildlife individual from another, such as fur texture, stripe boundaries, spot configurations, and contour transitions. We observe that these identity-critical cues are closely related to high-frequency information. To address this challenge, we propose WildIcon, a high-frequency-guided I2V framework for wildlife individual consistency. Specifically, WildIcon introduces a frequency-aware identity encoding branch that extracts individual-specific high-frequency cues from the reference image. Combined with isolated foreground information, the resulting identity tokens are then injected into cross-attention blocks as identity conditioning. Building on a frozen backbone with lightweight identity adaptation, WildIcon preserves fine-grained identity cues visible in the reference image while retaining the motion controllability and semantic fidelity of the base I2V model. In addition, to support the training and evaluation of wildlife individual-consistent I2V, we construct WildlifeVid, a wildlife-centric video dataset with high-quality, temporally coherent clips and individual-level identity labels. Experiments on I2V generation and downstream animal re-identification (ReID) show that WildIcon achieves stronger individual consistency than existing baselines, and that its filtered outputs can serve as useful candidate training augmentations for downstream ReID.

[93] EchoDino: A pediatric foundation model for transferable echocardiographic analysis across the lifespan cs.CVPDF

Sheng Cheng, Donnchadh M. O’Sullivan, Daniel J. Penny, Craig G. Rusin, Minh B. Nguyen

TL;DR: 提出EchoDino儿科超声心动图自监督基础模型，用大规模无标签视频学习可迁移到成人的心脏表征。

Details

Motivation: 超声心动图解释需整合整体解剖、局部结构及动态运动；现有模型多为单任务且依赖昂贵标签，儿科数据稀缺并随年龄解剖变化。

Result: EchoDino基于DINOv3适配，在170万段无标签儿科超声视频的370万帧上训练。冻结编码器表征覆盖全局语境、局部解剖及稠密空间细节；MEMS按运动偏置熵最大化选择视频分析帧。在九个儿科与成人数据集上，视图分类准确率由0.609升至0.889，结构性心脏病AUROC由0.811升至0.872，年龄估计误差由3.857降至1.389年，同时分割准确率最佳、射血分数误差降低。

Insight: 儿科无标签视频可学习跨年龄心超表征，且适配多个下游任务；摘要未列各数据集逐项结果。

Abstract: Echocardiography is the most widely used cardiac imaging modality, yet interpretation demands integrating visual evidence across global anatomy, localized structures and dynamic cardiac motion. Machine-learning models have automated individual tasks, but they are typically built for a single purpose and depend on expensively labeled datasets - a barrier particularly acute in pediatric care, where data are scarce and anatomy changes with age. Here we present EchoDino, a self-supervised foundation model for echocardiography, created by adapting the DINOv3 framework to 3.7 million frames from 1.7 million unlabeled pediatric echocardiography videos. With its encoder frozen, EchoDino produces representations that capture global context, local anatomy, and dense spatial detail. We introduce Motion-biased Entropy Maximization Sampling (MEMS) to select the most informative frames for video-level analysis. Across nine pediatric and adult datasets, EchoDino outperformed strong baseline models, raising view-classification accuracy from 0.609 to 0.889 and the area under the receiver operating characteristic curve for structural-heart-disease detection from 0.811 to 0.872, while also cutting age-estimation error from 3.857 to 1.389 years, achieving the best segmentation accuracy and lowering ejection-fraction errors. By generalizing from label-free pediatric data to adult echocardiography, EchoDino offers a versatile foundation for cardiac image analysis across the lifespan.

[94] Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation cs.CV | cs.AI | cs.LG | cs.MMPDF

Team Kandinsky, Julia Agafonova, Bulat Akhmatov, Mikhail Aksyutin, Grigorii Alekseenko

TL;DR: 发布Kandinsky 6.0 Video系列扩散基础模型，联合生成同步文本驱动或图像驱动视频和音频。

Details

Motivation: 高质量多媒体生成需同步视频、44kHz音频与口型，且要兼顾细节分辨率、音视频语义对齐和单模态保真。

Result: 系列含3B参数Lite和29B Pro，均生成5秒同步视听片段，支持T2AV及I2AV模式；内置超分模型输出最高Full-HD 1920×1080。双流CrossDiT连接预训练视频流与新训练音频流，通过双向交叉注意力进行时间及语义对齐。训练先从大规模音频语料训练音频流，再在配对视听数据上联合连续预训练，同时保持单模态质量，之后监督微调、RL后训练及蒸馏。并排人评中Pro明显优于前代Kandinsky 5.0 Pro，尤其语音质量有竞争力；代码、权重和diffusers集成以MIT协议发布。

Insight: 从音频单流预训练到视听联合训练可保留单模态能力并增强同步生成；质量判断主要来自并排人评，摘要未给量化结果。

Abstract: We present Kandinsky 6.0 Video, a family of foundation diffusion models for synchronized text-to-audio-video generation, comprising Kandinsky 6.0 Video Lite (3B parameters) and Kandinsky 6.0 Video Pro (29B parameters). Both models generate 5-second video clips with synchronized 44 kHz audio, including lip-sync, in text-to-audio-video (T2AV) and image-to-audio-video (I2AV) modes; a built-in super-resolution model raises the output resolution to Full-HD (1920$\times$1080). Building on the video generation capabilities of Kandinsky 5.0, Kandinsky 6.0 Video employs a dual-stream CrossDiT architecture that connects a pretrained video stream and a newly trained audio stream through bidirectional cross-attention for temporal and semantic alignment. Our continuous pretraining strategy first trains the audio stream from scratch on large-scale audio corpora and then trains both streams jointly on paired audio-video data while preserving unimodal fidelity; pretraining is followed by supervised fine-tuning, reinforcement-learning-based post-training, and distillation. In side-by-side human evaluation, Kandinsky 6.0 Video Pro clearly outperforms its predecessor, Kandinsky 5.0 Video Pro, and remains competitive with leading audio-video generation models, particularly in speech quality. To accelerate open research and deployment in multimedia generation, we release the code, model checkpoints, and diffusers integration under the MIT license.

Anh Dao, Quan-Dung Pham, Le Danh Vinh, The Anh Nguyen, Nguyen Viet Tri Pham

TL;DR: 提出StageVLN训练框架，以特权几何与轨迹监督塑造导航状态表征，部署时保留原有推理通路。

Details

Motivation: 大VLM提供语义先验，但普通动作监督不要求中间状态保留场景几何、相对朝向或全局进度；推理时加入深度、地图、点云和几何模型会增加成本及架构依赖。

Result: 冻结几何基础模型在训练中为分层导航状态提供多级空间指导，并用相对朝向与专家路径进度目标补充轨迹状态监督；所有辅助模块部署时移除。R2R-CE unseen验证中，4B骨干达到SR 56.3%、SPL 51.4%，无需推理时额外几何编码器；RxR-CE达到SR 54.3%，也未增加导航训练数据或部署几何编码器。

Insight: 把空间结构监督集中在训练阶段可提升连续VLN且维持轻量推理；部署无需额外几何模块是核心优势。

Abstract: Vision-and-Language Navigation (VLN) policies increasingly benefit from strong semantic priors provided by large vision-language models (VLMs). However, standard action supervision does not explicitly encourage intermediate representations to preserve scene geometry, relative orientation, or global episode progress. Incorporating depth estimators, explicit maps, point clouds, or geometry foundation models at inference can provide such structure but introduces additional computation, memory overhead, and architectural dependence during deployment. We introduce StageVLN, a training framework that shapes navigation representations through privileged spatial and trajectory guidance while preserving the original inference pathway. A frozen geometry foundation model provides multi-level spatial guidance to hierarchical navigator states, while relative-heading and expert-route progress objectives provide complementary trajectory-state supervision. All auxiliary components are used only during training and removed at deployment. On R2R-CE validation-unseen, StageVLN achieves 56.3% SR and 51.4% SPL with a 4B-parameter backbone, without an additional geometry encoder at inference. On RxR-CE, it achieves 54.3% SR without additional navigation training data or a geometry encoder at inference.

[96] Rotated, but How Far? Diagnosing and Improving Object-Rotation Reasoning in VLMs cs.CV | cs.AIPDF

Zhaochen Wang, Yujun Cai, Huangbo Zou, Hower Yang, Naipeng Dong

TL;DR: 提出OR-Bench及RotationCue，揭示VLM能检测物体旋转却难估幅度，并从冻结表征读取模型未利用的粗粒度旋转信息。

Details

Motivation: 模型可能注意到多视角物体发生旋转，却不能判断旋转多少；需区分视觉表征中缺少信息与输出时未能利用已有线索。

Result: OR-Bench含旋转检测、幅度估计和多视角推理八项任务。12个VLM中最强旋转检测近100%，但粗略幅度估计接近随机；询问精确角度时，91.8%至100%答案集中在0°、90°和180°，即规范角度坍缩，无视觉输入时也存在。探针发现细粒度旋转信息较难恢复，但仍有大量粗粒度线索，简单线性探针优于模型生成答案。RotationCue从冻结表征恢复粗角度并作为中间文本上下文输入，三个VLM的所有模型—任务组合均提升，宏准确率提高7.9至12.6个百分点，且保留一般能力。

Insight: 模型可解码线索不等于生成决策会使用；轻量读出并反馈到文本上下文可缓解旋转幅度推理缺陷。

Abstract: Vision-language models (VLMs) can detect that an object has rotated across views, but cannot reliably tell by how much. We introduce OR-Bench, a fine-grained benchmark for object-rotation reasoning with eight tasks covering rotation detection, rotation magnitude estimation, and multi-view rotation reasoning. Across 12 VLMs, the gap is stark: the strongest models approach 100% accuracy on detection, yet even coarse magnitude estimation is near chance. When asked for exact angles, models place 91.8–100% of their predictions on just $0^\circ$, $90^\circ$, and $180^\circ$, a failure we term canonical-angle collapse. This collapse persists even without visual input. Representation probing shows that missing information is only part of the explanation. Although rotation information becomes less recoverable at finer granularity, substantial coarse-grained information remains, and a simple linear probe outperforms the models’ generated answers. This suggests that VLMs underuse rotation information they already encode. We therefore propose RotationCue, a lightweight decoder that recovers coarse rotation information from the VLM’s own frozen representations and feeds it back to the model as intermediate textual context. Across three VLMs, RotationCue improves every model–task combination on OR-Bench, raising macro-average accuracy by 7.9–12.6 points while preserving general capabilities.

[97] T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations cs.CVPDF

Bowen Peng, Li Liu, Yongxiang Liu, Weijie Li, Jie Zhou

TL;DR: 提出T-JEPA，将真实时间间隔作为条件学习遥感单帧潜表示之间的时序转换。

Details

Motivation: 遥感时序数据包含丰富监督，但基础模型多只用预设成对关系或整体重建上下文，未充分利用采样稀疏、不均匀的时间间隔。

Result: 共享单帧编码器处理各观测，时间预测器根据掩码源潜表示和实际间隔预测完整目标潜场；多个间隔约束将观测组织为潜在轨迹。非对称元数据注入缓解捷径学习，直接跨多尺度时间监督优于递归滚动中间状态；掩码像素重建补充空间细节。在匹配预训练数据及吞吐下，T-JEPA在静态和时序迁移任务上均领先；分析显示其学习随时间差变化的转移可预测性、连贯潜动态，并保持跨时期一致、表征多样与语义可分。

Insight: 以真实时间差监督潜在转移可利用不规则遥感采样，并避免递归误差；摘要未给具体下游任务及成绩数字。

Abstract: Earth observation (EO) data provide rich temporal supervision, yet existing remote sensing foundation models mainly exploit sequential observations through imposing predefined pairwise relations or aggregating holistic reconstruction context. We seek to further exploit the sparse and nonuniform temporal sampling inherent in EO sequences as supervisory signals. To this end, we propose T-JEPA, a temporal joint-embedding predictive architecture that learns time-gap-conditioned latent transitions. A shared single-frame encoder processes each observation, while a temporal predictor estimates the complete target latent field from a masked source latent representation and the actual elapsed time. Across multiple temporal intervals, these predictive constraints organize observed states into structured latent trajectories. Asymmetric metadata injection mitigates shortcut learning, and direct supervision across multiple temporal scales proves more effective than recursively rolling out intermediate states. In parallel, masked pixel reconstruction provides complementary supervision for preserving spatial details. Under matched pre-training data and throughput, T-JEPA achieves leading transfer performance on both static and temporal tasks. Analyses further reveal that T-JEPA learns representations with time-gap-dependent transition predictability and coherent latent dynamics, while maintaining strong cross-period consistency, representation diversity, and semantic discriminability.

[98] HLA-WM: Hybrid Linear Attention for Long-Horizon Video World Models cs.CV | cs.AIPDF

Zhuokun Chen, Feng Chen, Xi Lin, Xiyu Wu, Jiahao He

TL;DR: 提出HLA-WM免训练混合注意力框架，用几何引导历史片段检索补足Gated DeltaNet长期记忆衰减。

Details

Motivation: 长视频世界模型需保持远程场景一致；全softmax注意力用不断增长KV缓存保留完整历史但耗内存，递归线性注意力内存固定却会逐步遗忘远处相关场景。

Result: HLA-WM利用GDN仿射结构缓存紧凑分块转移摘要，按相机几何检索相关历史块并重组为查询专属递归状态，结合粗粒度检索和细粒度线性状态计算。在60秒SANA-WM-Bench上，六项重访一致性及相机控制指标均改善，包括PSNR +0.74dB、旋转误差降低28.5%；经下游细化仍有效。MBench-A的四个子集及所有推理模式中，547样例的三项重访一致性指标均改善。60秒上下文下历史状态内存较全KV缓存降低12倍，吞吐最多下降1.6%。

Insight: 可寻址的递归状态补回长距离场景回忆，同时保留固定内存优势；效果跨两个视频基准与下游细化设置验证。

Abstract: Long-horizon video world models require persistent memory to preserve scene consistency over extended rollouts. Softmax attention retains the full generation history through a growing KV cache, whereas recurrent linear attention compresses history into fixed-size states with substantially lower memory cost. However, we identify severe long-range forgetting in Gated DeltaNet (GDN), where information from distant but relevant scenes is progressively attenuated by subsequent state updates. To address this limitation, we propose HLA-WM, a training-free hybrid linear-attention framework that combines coarse-grained geometry-guided retrieval with fine-grained recurrent linear-state computation. HLA-WM exploits the affine structure of GDN to cache compact chunk-wise transition summaries, retrieve scene-relevant historical chunks using camera geometry, and recompose them into query-specific recurrent states. On the $60$-second SANA-WM-Bench, HLA-WM improves all six aggregate revisit-consistency and camera-control metrics of the base autoregressive generator without additional training, including a $0.74$ dB PSNR gain and a $28.5%$ reduction in rotation error. The improvements persist after downstream refinement and generalize to MBench-A, where HLA-WM consistently improves all three revisit-consistency metrics across all four subsets and all evaluated inference modes over $547$ samples. At a $60$-second context, HLA-WM reduces historical-state memory by $12\times$ relative to full KV caching while incurring at most a $1.6%$ reduction in inference throughput. These results demonstrate that selectively addressable recurrent memory can improve long-range scene recall while preserving the efficiency advantages of GDN. Project page: https://caesarhhh.github.io/hla-wm/

[99] A new design of a fall detection system integrating landmark identification and deep learning techniques cs.CVPDF

Tri Nhut Do, Thi Thuy Le

TL;DR: 提出结合MediaPipe人体关键点与深度学习的跌倒检测系统，以空间姿态区分日常动作和跌倒。

Details

Motivation: 面向老年人照护的监测需可靠及时地区分真正跌倒和日常动作，减少误报并提高安全性与独立生活能力。

Result: 系统用MediaPipe进行人体空间关键点识别，并输入深度学习预测器判断跌倒。训练中准确率持续提高并约在第40轮稳定，初期错误率明显下降。8至50岁男女参与的实时实验中检测率95%，作者据此认为适用于养老照护及智能健康监控；摘要未报告样本规模、误报率或独立测试集结果。

Insight: 人体关键点和深度预测组合能实现实时跌倒识别，但95%仅为摘要报告检测率，年龄范围及验证样本限制其对老年真实场景的外推。

Abstract: This article introduces an innovative system that integrates landmark identification with deep learning to enhance fall detection accuracy and reliability. By utilizing advanced computer vision techniques, such as Media Pipe for spatial recognition, the system effectively differentiates between routine movements and actual falls. The integration of landmarks with a deep learning prediction algorithm minimizes false alarms, ensuring timely responses to genuine falls. Comprehensive experimentation underscores the system’s versatility across various scenarios, emphasizing its potential to improve safety and independence for older adults. The training process demonstrates a steady increase in accuracy, stabilizing by the 40th cycle, while error rates decline significantly during the initial cycles. Real-time experiments, involving both male and female participants aged 8 to 50, recorded a remarkable 95% detection rate of falls, demonstrating the system’s effectiveness and promising future applications in elder care and smart health monitoring environments.

[100] Vision-enabled detection of safety helmet compliance in construction zones cs.CVPDF

Tri Nhut Do*, Ba Loc Pham

TL;DR: 提出基于YOLOv8的工地安全帽实时视觉检测系统，使用高分辨率监控视频识别未佩戴安全帽人员。

Details

Motivation: 施工现场人员安全至关重要，需要及时发现未遵守安全帽规定的工人以降低头部伤害风险。

Result: 系统结合计算机视觉与机器学习，在多种光照和工人运动条件下检测戴/未戴安全帽。训练与验证中两类人员mAP@0.5精确率超过97%，损失持续下降、指标改善并约于训练第40轮稳定。

Insight: 监控视频及YOLO检测可用于施工现场实时安全管理；摘要未报告数据集规模、召回率、误报或真实部署延迟。

Abstract: In the rapidly evolving field of construction management, worker safety remains a top priority. This paper introduces an innovative vision-based system for real-time detection of helmet compliance, specifically designed for construction sites, utilizing advanced computer vision techniques and machine learning algorithms within the YOLO (you only look once) framework. Our system leverages high-resolution video feeds from strategically positioned cameras to monitor adherence to safety regulations regarding helmet usage. By employing deep learning methodologies, the system effectively identifies individuals not wearing helmets, thereby significantly mitigating the risk of head injuries among workers. Our training and validation results revealed an impressive precision exceeding 97% at mAP@0.5 for both helmeted and non-helmeted individuals. Furthermore, our experiments demonstrate exceptional detection accuracy, demonstrating the system’s resilience under varying lighting conditions and diverse worker movements. The consistent decrease in loss and improvement in metrics throughout training validates the effectiveness of the YOLOv8 model in enhancing recognition performance. The implications of this research extend beyond mere regulatory compliance, opening avenues for innovative applications in occupational safety management. This study highlights the critical role of technology in protecting lives and lays the groundwork for future advancements in smart construction environments.

[101] A Three-Dimensional Reverse-Projection Method for Sparse Point Cloud Completion and Its Application to High-Speed Train Nose Reconstruction cs.CVPDF

Xiaozhen Ma, Zhao Tang, Hanbin Lai, Ruiqi Chen, Jin Jin

TL;DR: 提出三轴反向补全流程，利用孔洞周边稀疏点云插值玻璃窗缺失区域，并重建高铁头部表面。

Details

Motivation: 环境中玻璃窗造成LiDAR点云空洞，是三维重建难点；高铁车头扫描还面临点云采样稀疏及窗面缺失。

Result: 先以FAST-LIVO2多传感器里程计建图、移动最小二乘平滑，再通过三轴投影细分插值和反向孔洞边界识别补全缺失点。随后比较贪心投影三角化、Poisson表面重建与Marching Cubes网格流程。在按比例缩小的高铁车头展示模型上，方法补齐窗户周围缺失点；评测设置下贪心投影三角化的几何距离误差低于另外两种重建流程。

Insight: 以孔洞邻域跨轴投影可非接触重建玻璃附近车体几何；摘要证据来自比例模型，未提供误差数值或真实尺寸扫描评估。

Abstract: Holes in LiDAR scans of environments with glass windows remain an unresolved problem in three-dimensional reconstruction. This study presents a pipeline for point cloud acquisition, filtering, completion, and surface reconstruction to address sparse sampling and missing window regions in scans of a high-speed train nose. FAST-LIVO2 provides the initial point cloud through multisensor odometry and mapping, and moving least squares (MLS) smooths the observations. We then introduce three-axis projection-based subdivision and interpolation with reverse hole boundary identification, referred to as three-axis reverse completion. The method interpolates missing regions from observations around each hole. Greedy projection triangulation, Poisson surface reconstruction, and a Marching Cubes-based pipeline generate meshes from the completed point cloud. Experiments on a proportionally scaled display model of a high-speed train nose show that the proposed method fills missing point cloud regions around the glass windows. Under the evaluation setting used in this study, greedy projection triangulation yields lower geometric distance errors than the other two reconstruction pipelines. The pipeline supports non-contact digital modeling of train nose geometry and provides a practical approach to reconstructing objects with glass windows.

[102] Controllable Road Marking Generation cs.CV | cs.ROPDF

Zhiyu, Cai, Yufan Zhang, Ruichen Tan, Zengxiang Lei

TL;DR: 提出可控道路标线生成框架，从可行驶区、可选外围标线及文字提示合成道路中心区域标线。

Details

Motivation: 车道和道路标线对车辆导航及多智能体协调重要，但大规模手工绘制限制量化分析与场景测试。

Result: 基准依据元数据构造确定性提示，生成车道分隔线、道路分隔线和人行横道三类输出。系统结合带拓扑辅助损失的文本条件BEV潜在整流流DiT、经高斯模糊的稀疏细线训练目标，以及无需训练的SGR后处理（提取折线、拟合三次Bezier并以各向异性超高斯原语重绘）。Argoverse 2的4,597个测试图块上Buffered F1 80.8、clDice 50.2，适配SOTA掩码细化基线为38.8和24.6；Waymo上分别88.0及66.2。拓扑监督和SGR带来互补连通性收益；更强文字引导虽提高编辑成功，也会增大非目标结构改变。

Insight: 生成与编辑道路设施可支持仿真和地图补全，但控制强度与非目标结构保留存在权衡。

Abstract: Lane and road markings provide critical guidance for vehicle navigation and multi-agent coordination, yet authoring them at scale remains a manual workflow that limits quantitative analysis and scenario testing. We introduce Controllable Road Marking Generation, which synthesizes a missing center-region marking layout from a drivable-area mask, optional outer-ring markings, and a textual description. Our benchmark uses deterministic, metadata-derived prompts and three output channels: lane dividers, road dividers, and pedestrian crossings. We develop a conditional bird’s-eye-view (BEV) pipeline that combines (i) a text-conditioned latent rectified-flow DiT trained with a topology-aware auxiliary loss, (ii) Gaussian-blurred training targets that stabilize learning of thin, sparse markings, and (iii) Structured Gaussian Render (SGR), a training-free post-process that recovers crisp divider geometry by extracting polylines, fitting cubic Bézier curves, and re-rendering them as anisotropic super-Gaussian primitives. On 4,597 Argoverse~2 test tiles, our system achieves Buffered F1 of 80.8 and clDice of 50.2, compared with 38.8 and 24.6 for an adapted state-of-the-art mask-refinement baseline. On Waymo dataset, it yields 88.0 Buffered F1 and 66.2 clDice. Component ablations show complementary connectivity gains from topology-aware supervision and SGR. Text-editing experiments reveal that stronger guidance improves edit success but also increases changes to non-target structures. We see this framework as a step toward simulation-ready road-marking variation, automated map completion, and early-stage infrastructure design exploration.

[103] InteractionBench: A Real-Time Interaction Benchmark for Streaming Video Systems cs.CVPDF

Enxin Song, Suhao Yu, Yifei Xu, Barbara Su, Weili Xu

TL;DR: 提出InteractionBench，按视频时钟评测流式视频助手何时应回答、何时应沉默。

Details

Motivation: 视频助手既要在事件触发时及时响应，也必须在无需回复时保持沉默；模型、记忆和响应控制器组成的完整系统都影响这一行为。

Result: 基准涵盖812段视频上的1,060次交互，包括问答、事件触发和持续更新；其中69条负样本流及53组计数事件/近似干扰套件。分别评分内容正确、时机正确和沉默合规。轮询Qwen3-VL-8B时机准确率77.8%，但沉默合规仅10.9%；原生实时交互系统沉默合规29.2%、时机66.8%，且会在89.9%负样本流输出。无开源系统通过三分之一近似干扰套件，随机删回复只是在时机与沉默间交换。离线分数会漏掉问题并误预测在线表现；代理式系统仅约每30秒轮询才加入一定克制。

Insight: 流式助手需同时评价时机与沉默，在线系统行为不能由离线问答分数推断；增加克制有明显时延成本。

Abstract: A video assistant must speak when its instruction warrants a response and stay silent otherwise. We introduce a benchmark that evaluates this decision for the complete system of model, memory, and response controller. InteractionBench covers query responses, event triggers, and ongoing updates in 1,060 interactions over 812 videos, with 69 negative streams and 53 suites that pair counted events with look-alike near misses. It scores content accuracy, timing accuracy, and silence compliance on the video clock. Timely speech costs silence across systems. Polled Qwen3-VL-8B reaches 77.8 timing accuracy but 10.9 silence compliance. A native real-time interaction system reaches 29.2 silence compliance at 66.8 timing accuracy, yet emits on 89.9% of negative streams. No open-weight system clears a third of the near-miss suites. Fewer replies help only when chosen, as random deletion merely trades timing for silence. Offline scores miss these failures and mispredict online behavior. Adding restraint is costly, as the native system’s controller adds little by itself and agentic systems add it only at about 30 s per poll.Project page: https://www.enxinsong.com/projects/interactionbench/ Code: https://github.com/Espere-1119-Song/InteractionBench Data: https://huggingface.co/datasets/InteractionBench/InteractionBench

[104] A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videos cs.CV | cs.MMPDF

Xihua Sheng, Dong Liu, Chang Wen Chen

TL;DR: 提出语义重要性引导的生成视频统一压缩与编辑框架，利用冻结视频生成器作为可复用生成先验。

Details

Motivation: AI生成视频时长、分辨率及数量快速增长，对存储传输要求增加；其语义结构决定内容连贯性，而局部纹理和随机细节可重新生成，因此不必逐像素重现特定样本。用户还希望压缩后按提示编辑而保持时空语义。

Result: 框架将时空语义重要性用于三个环节：投影潜变量差异以优先传输语义不变量；按帧估计语义需求、给需强保真的帧分配更多创新信息；再用统一重建/编辑过程调整侧信息影响，使同一压缩表示既能指导忠实重建，也能作为结构保留提示编辑的语义锚点。摘要未提供压缩率、编辑质量或基准量化成绩。

Insight: 对生成视频可保留语义结构、重生可替代细节，从而统一压缩与可编辑性；具体效率及重建质量证据未在摘要中量化。

Abstract: AI-generated videos are rapidly increasing in volume, duration, and resolution, creating growing demands for efficient storage and transmission. Unlike natural videos captured from the physical world, AI-generated videos are samples from a learned generative distribution, where semantic structures are critical to content consistency, while many local textures and stochastic details can be plausibly regenerated. This distinction suggests that compression should preserve semantically important spatiotemporal information rather than reconstruct every pixel of a particular generative sample. Beyond reconstruction, AI-generated videos also create a practical need for prompt-based editing, where users expect to modify generated content while preserving its original spatiotemporal semantics. Motivated by these observations, we propose a unified compression and editing framework for AI-generated videos that incorporates a frozen video generator as a reusable generative prior. Within this framework, we design three spatiotemporal semantic importance-guided techniques that respectively address what to transmit, how much to transmit, and how to use the transmitted side information. First, an innovation selection method projects the latent discrepancy using spatiotemporal semantic importance, so that the selected innovations prioritize semantic invariants over replaceable generative variations. Second, a frame-adaptive bit allocation method estimates the nonuniform semantic demands of latent frames and allocates more innovations to frames requiring stronger semantic preservation. Third, a unified reconstruction and editing method continuously adjusts the influence of the transmitted side information, enabling the same compressed representation to provide strong guidance for faithful reconstruction or serve as a flexible semantic anchor for structure-preserving prompt-driven editing.

[105] Level-of-Token Diffusion cs.CV | cs.AIPDF

Kiyohiro Nakayama, Brian Chao, Jan Ackermann, Hansheng Chen, Federico Tombari

TL;DR: 提出Level-of-Token扩散框架，用多分辨率矩形token布局按需为图像和视频区域分配去噪计算。

Details

Motivation: 扩散模型通常对所有区域平均分配算力，但场景对空间细节需求不均；生成前可预测哪些区域需高细节，从而在保留质量时减少token。

Result: LoT token表示形状和尺寸不同的矩形patch，在重点区域使用细粒度token、其他区域用粗粒度token。作者用patch非对称流参数化及多分辨率token嵌入适配预训练DiT，在每一步仍预测全分辨率流但处理更短序列，以保留原生成先验。布局可由语义掩码、框、纹理变化、景深线索及代理规划得到；图像和视频生成实验显示质量—效率权衡良好，速度提升取决于布局token预算。

Insight: 生成计算应按预期空间细节而非均匀分配；布局质量和token预算共同决定收益，摘要未给具体加速数字。

Abstract: Image and video diffusion models allocate equal computation to every region, even when the intended scene calls for varying levels of detail. The spatial distribution of detail can often be anticipated before generation, indicating where computation can be reduced. We introduce Level-of-Token (LoT) Diffusion, a framework that turns this knowledge into an explicit multiresolution token layout (Level-of-Token layout) for adaptive and efficient generation. Tokens represent rectangular patches of varying sizes and shapes, allocating finer tokens where detail is needed and coarser tokens elsewhere. We adapt pretrained diffusion transformers to LoT layouts through a patch-wise asymmetric flow parametrization and embeddings for multiresolution tokens, preserving full-resolution flow prediction at every denoising step while processing only a reduced token sequence. LoT Diffusion enables layout-adaptive generation while preserving pretrained generative priors. We demonstrate LoT with layouts derived from semantic masks, bounding boxes, texture variance, and depth-of-field cues, as well as agentic plans. Across image and video generation, LoT offers favorable quality-efficiency tradeoffs, with significant speedups determined by the layout’s token budget. Our project website is at https://georgenakayama.github.io/lotdiffusion/.

[106] Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training cs.CV | cs.AIPDF

Yongxin Ning, Runliang Niu, Qianli Xing, Zhiyi Duan, Qingzu He

TL;DR: 提出Infinite-Dreamer，以像素级图像编辑世界模型合成GUI截图转移和多步想象轨迹，用于大规模代理训练。

Details

Motivation: 通用GUI代理依赖大量高保真视觉—动作轨迹，人工示范难扩展；文本或HTML模拟会丢失图标、布局等像素视觉细节。

Result: 方法将界面转移视为图像编辑，由VLM把动作引起的UI变化写成结构化差分文本，再微调图像编辑骨干可控生成真实截图变化。模型合成单帧视觉鲁棒数据和多步轨迹；仅用合成数据微调Qwen3-VL得到Infinite-Actor。在AndroidWorld、MobileWorld和AndroidControl-Curated上各规模均优于基线：8B的AndroidWorld Pass@1提高4.45，MobileWorld Pass@3成功率近乎翻倍；2B的Pass@1提高9.05。

Insight: 像素级生成可补足HTML环境缺失的视觉风格细节，并提供多步训练轨迹；各成绩是纯合成数据微调结果。

Abstract: Graphical User Interface (GUI) agents have emerged as a promising paradigm for automating complex digital workflows across diverse applications. However, training highly capable and generalizable agents fundamentally relies on massive, high-fidelity visual-action trajectories, which are notoriously difficult to acquire. While human demonstrations are unscalable, existing GUI world models rely on text descriptions or HTML rendering, discarding crucial pixel-level visual details like icons and layout styles. To address this issue, we introduce Infinite-Dreamer, a simulation-free data synthesis method powered by a pixel-level Image Editing World Model. By conceptualizing GUI transitions as image editing tasks, we leverage Vision-Language Models (VLMs) to describe action-induced UI changes as structured delta-text. We then fine-tune an image editing backbone to controllably synthesize realistic screenshot transitions. We utilize this model to generate both single-frame visual robustness data and multi-step imaginary trajectories. To validate the effectiveness of our approach, we fine-tune the Qwen3-VL baseline solely on the synthesized data to obtain Infinite-Actor, and evaluate it on AndroidWorld, MobileWorld, and AndroidControl-Curated benchmarks. Infinite-Actor consistently outperforms the Qwen3-VL baselines across scales: Infinite-Actor-8B improves AndroidWorld Pass@1 by +4.45 and nearly doubles the MobileWorld Pass@3 success rate, while Infinite-Actor-2B improves Pass@1 by +9.05. Code is available at https://github.com/swaydy-n/Infinite-Dreamer.

[107] fMRI-TAMCL: Text-Anchored Supervised Multimodal Contrastive Learning for fMRI-Based Brain Disorder Classification cs.CVPDF

Juliana Mantebea Danso, Enoch Opanin Gyamfi, Mylene C. Q. Farias

TL;DR: 提出fMRI-TAMCL，以受试者自适应BOLD文本、表型序列文本为锚，对静息态fMRI图、功能连接和文本进行监督对比融合。

Details

Motivation: 静息态fMRI可用于脑部疾病分类且高度多模态、存在显著多中心异质性；数据集通常无原生文本，依赖固定假设从激活或表型生成文本会损害跨数据集泛化。

Result: 方法以主体自适应阈值模块生成BOLD激活文本，以特征值序列化模块生成表型文本；三模态均编码为聚类图、映射到共享单位超球面，通过成对文本锚定监督对比学习对齐，再以注意力融合。五个数据集评估中，分类准确率78.6%至86.4%，超过29个基线。

Insight: 受试者特定文本可为缺少文本模态的fMRI提供监督锚点，并提升跨数据集泛化；摘要未提供数据集名单与逐项准确率。

Abstract: Resting-state fMRI is important in the classification of brain disorders, but highly multimodal and exhibits strong multisite heterogeneity. Existing methods fuse images, BOLD-based functional connectivity, and phenotypic data modalities. Unlike other medical imaging datasets, rs-fMRI datasets rarely include a text modality, so they are generated from phenotypic data or BOLD activations. These text generation methods rely on fixed assumptions for subjects, sites, devices, and protocols, leading to poor generalization across datasets. We propose fMRI-TAMCL, a text-anchored multimodal contrastive learning framework that integrates fMRI images, sparse FC, and generated subject-specific text. Its Subject-Adaptive Threshold Derivation module generates BOLD activation text, while Feature-Value Serialization module generates phenotypic text. All three modalities are encoded as clustered graphs, projected onto a shared unit hypersphere space, aligned using pairwise, text-anchored supervised contrastive learning, and fused with attention. fMRI-TAMCL proves its generalization capability across five datasets outperforming 29 baselines with 78.6%-86.4% accuracy in downstream classification.

[108] Spatial Supervision Without Attribution Optimization: Improving Post-Hoc Class Activation Maps via Box-Guided Evidence Routing cs.CVPDF

Wenhao Liang, Liangwei Nathan Zheng, Lin Yue, Wei Emma Zhang, Mingyu Guo

TL;DR: 提出BGER空间监督方法，仅用框或掩码训练轻量门控和分类器，即可改进另行计算的预测类Grad-CAM定位。

Details

Motivation: 事后类激活图常用于解释分类器证据，但普通分类训练并不鼓励热图空间合理；研究检验是否无需直接优化归因图也能利用低成本空间标注。

Result: BGER在末层特征图训练轻量门控并将分类路由至门控特征；Grad-CAM则在门控前表征单独计算，因此测试热图未参与目标函数。BCE路由损失使CUB-200-2011的MaxBoxAccV2从0.584升至0.715，Stanford Dogs从0.757升至0.832，分类准确率相近。对照表明ResNet-50大部分提升来自空间监督重塑骨干而非路由本身：绕过门控仍保留大部分收益；门控梯度分离时ResNet结果几乎不变。该分离在两种DenseNet-121胸片设置保留多数收益，但在Swin-T上取消表面增益。直接监督CAM定位更强但准确率代价更大。

Insight: 空间监督可改善独立评估的事后CAM，但机制及收益大小依赖骨干和评估设置；定位提高不保证分类无损。

Abstract: Post-hoc class activation maps (CAMs) are a standard tool for inspecting the evidence behind an image classifier’s predictions, yet nothing in ordinary training encourages these maps to be spatially appropriate. We study whether inexpensive spatial supervision can improve a classifier’s own predicted-class Grad-CAM without ever optimizing an attribution map. Box-Guided Evidence Routing (BGER) trains a lightweight gate on the final feature map under box or mask supervision and routes classification through the gated features, while Grad-CAM is computed separately at the pre-gate representation, so the evaluated map never enters the training objective. With a BCE routing loss, BGER raises MaxBoxAccV2 from $0.584$ to $0.715$ on CUB-200-2011 and from $0.757$ to $0.832$ on Stanford Dogs at comparable accuracy. Matched controls attribute most of the ResNet-50 gain to the spatial supervision reshaping the backbone rather than to routing itself: when classification bypasses the gate, most of the improvement remains, and detaching gradients through the gate leaves the ResNet-50 result nearly unchanged. The same detachment preserves most of the gain in two DenseNet-121 chest X-ray settings but removes the apparent gain on Swin-T, and directly supervising the CAM reaches stronger localization at a larger accuracy cost. Overall, spatial supervision can improve separately evaluated post-hoc CAMs, but both the mechanism and the size of the benefit depend on the architecture and the evaluation setting.

[109] TasteRoute: Personalized Routing for Video Generation cs.CV | cs.AI | cs.CLPDF

Zhi Rui Tam, Chao-Chung Wu, Sin-Han Yang, Peyton Ku, Brendan Kuang

TL;DR: 提出TasteRoute个性化视频生成路由器，根据提示、用户偏好及可用预算为每个请求选择生成模型。

Details

Motivation: 视频生成模型能力和成本差异明显，应针对请求选择合适模型；标注者群体共识未必代表单个用户偏好。

Result: 即便把其他标注者的共识当oracle，其与单个标注者个人最爱的一致率也仅34%至55%。TasteRoute在文生视频和图生视频设置下进行个性化偏好路由，与强简单基线表现竞争，同时降低平均生成成本，预算上限越高节省越多。作者发布TasteRoute-3k，包含多模型视频比较、质量判断、偏好排序及用户画像信号。

Insight: 模型路由应建模个人偏好而非把群体多数当代理目标；摘要未给偏好匹配和成本的具体数值。

Abstract: Rapid progress in video generation has led to a plethora of models that differ substantially in capability and generation cost. This raises a natural question: can each request be efficiently routed to an appropriate model? We find that even when the consensus of the other annotators is used as an oracle, it agrees with each annotator’s own favorite only 34-55% of the time. Motivated by this observation, we introduce TasteRoute, a personalized video-generation router that selects a generator jointly based on the input request, user preferences, and available generation budget. Across text-to-video and image-to-video settings, TasteRoute is competitive with strong simple baselines on preference routing while reducing average generation cost. The cost saving increases under higher budget caps. Finally, we release TasteRoute-3k, a human-annotated dataset containing multi-model video comparisons, quality judgments, preference rankings, and user-profile signals to facilitate future research on personalized and cost-aware video routing.

[110] Fitting Vision Adapters at Frontier Scales cs.CV | cs.LGPDF

Jaehoon Lee, Harry Partridge, Mudith Jayasekara, Charles O’Neill, Max Kirkby

TL;DR: 研究冻结视觉编码器后训练小型投影器能为前沿规模语言模型增添哪些视觉能力，并发布可复现适配配方。

Details

Motivation: 冻结视觉编码器、仅训练投影器是常见多模态适配法；随着语言模型参数规模扩大，需要明确该方案能加入哪些视觉能力、哪些仍受限。

Result: 作者从Kimi K2.6取50M参数投影器，适配到原生无视觉能力的GLM 5.2与5.3，并提供大规模训练可复现配方。研究计划考察纯扩大语言侧规模如何改变多模态能力，以及能向纯语言模型注入哪些视觉能力。评测使用MMMU-Pro和BLINK，报告总体及单项视觉任务结果；摘要没有提供具体成绩。

Insight: 该工作聚焦前沿规模的视觉适配可行性；摘要仅描述研究设置，未披露结果数字或主要发现。

Abstract: Training a small projector between a frozen vision encoder and language model is an established approach to multimodal learning. As the parameter count of language models scales dramatically, we revisit which vision capabilities this approach can add while keeping their pretrained weights fixed. Here we train a 50M parameter projector from the vision encoder of Kimi K2.6 to GLM 5.2 and 5.3, both models without native vision capabilities, and further present a reproducible recipe for training these adapters at scale. We study the following: (a) how vision capabilities of multimodal models scale as purely the language model side scales, and (b) what specific vision capabilities are able to be imbued into a pure language model at scale, and which ones remain limited. We evaluate on MMMU-Pro and BLINK, examining both overall performance and results on individual visual tasks.

[111] Safe Image Generation via Reinforcement Learning cs.CVPDF

Eungyeol Han, Jong-Seok Lee

TL;DR: 提出生成过程中监测去噪中间表征并以强化学习转向安全结果的文生图内容安全框架。

Details

Motivation: 现有T2I安全主要在生成前过滤提示或成图后审核，而对抗攻击空间更广；若不安全信号已在生成中显现，需能中途干预而非只事前/事后筛查。

Result: 方法检测去噪轨迹中逐渐出现的不安全内容信号，并通过可控转向让NSFW提示生成安全图像，即使信号在生成开始后出现也可纠正。标准与对抗评测集上，实验显示持续优于现有安全图像生成方法，同时保持感知质量与提示保真；代码计划在论文接收后发布。

Insight: 过程内检测和转向补充事前及事后安全检查；摘要未给具体攻击成功率和质量分数。

Abstract: Recent Text-to-Image (T2I) models achieve remarkable visual image generation performance, but they can still generate NSFW (Not-Safe-For-Work) contents, including violent or explicit images. Existing safety checker mechanisms are largely confined to pre-generation filtering (e.g. prompt-level text classifiers) or post-hoc moderation applied after an image is completely synthesized. However, adversarial attack methods operate over a much broader space. This imbalance highlights the need for a safety mechanism that intervenes during the generation process. We propose an in-generation safety framework that monitors the denoising trajectory and detects emerging NSFW signals from intermediate representations. Rather than merely detecting NSFW generations, our method applies reinforcement learning to generate safe images from NSFW prompts. By coupling in-generation detection with controllable steering, our approach mitigates unsafe trajectories even when NSFW signals emerge after generation has already begun. Experiments results show that our method consistently outperforms existing safe image generation methods across both standard and adversarial evaluation sets, while preserving perceptual quality and prompt fidelity. Code will be released upon acceptance.

[112] AstraSR: Real-World Thermal Super-Resolution with GPT-6 Astra cs.CVPDF

Mengyuan Li, Changhong Fu, Jun Zhang, Ziyu Lu, Yuhang Zhang

TL;DR: 提出AstraSR，用GPT-6 Astra生成的高分辨率热图参考监督真实热成像超分辨率。

Details

Motivation: 真实热超分缺少配对高分辨率观测；传统做法把带真实退化的采集图当HR并合成LR，既产生合成—真实域差异，又把采集退化保留在监督目标里。

Result: 作者用真实低分辨率热图条件化GPT模型生成HR参考，构造配对数据，并直接以生成参考监督超分网络；像素、梯度和感知损失分别传递强度模式、结构边界和视觉细节。与七种真实超分先进方法的定性比较显示，AstraSR热场景物体轮廓连续、边界分明、强度过渡平滑，并在清晰度与结构连贯性上更好。

Insight: 生成式HR参考可能绕过真实HR传感器数据稀缺，但其质量依赖生成模型且证据主要为定性对比；需谨慎核查合成细节是否忠实。

Abstract: Real-world thermal super-resolution (SR) is constrained by limited sensor resolution and the difficulty of obtaining corresponding high-resolution (HR) observations for direct model supervision. Conventional SR methods typically construct training pairs by treating captured thermal images with real-world degradations as HR references and applying predefined degradation to generate synthetic low-resolution (LR) inputs. Such a construction not only introduces a domain gap between synthetic and captured LR observations but also retains acquisition degradations in the supervision. To address this issue, we propose AstraSR, a real-world thermal SR method guided by GPT-6 Astra, a frontier multimodal generative model endowed with emergent and transformative visual capabilities. Specifically, we construct a dataset of image pairs by using captured LR thermal images to condition GPT-based HR reference. We develop a direct generative supervision strategy that learns from captured thermal inputs paired with GPT-generated HR references. Pixel, gradient, and perceptual losses jointly supervise the transfer of intensity patterns, structural boundaries, and visual details from the generated references. Qualitative comparisons with seven existing state-of-the-art real-world SR methods show continuous object contours, distinct structural boundaries, and smooth intensity transitions in the thermal scenes. These results demonstrate that AstraSR outperforms existing real-world SR methods in both thermal clarity and structural coherence.

Yimin Fu, Songbo Wang, Lizhuo Liu, Baicheng Pan, Zhunga Liu

TL;DR: 提出PAR非对称互教框架，联合预训练SAM与红外小目标检测器纠正噪声掩码并适配基础分割模型。

Details

Motivation: 红外小目标像素级标注依赖专家且目标本身辨别性弱，实际训练不可避免出现噪声标签，会让模型学到伪目标模式。

Result: PAR让预训练SAM与从头训练的任务检测器通过同伴教学协作，并用局部对比规律互相提供掩码修正线索，避免单模型自确认循环；检测器预测还作为校正掩码提示适配视觉基础模型。证据式不确定性估计进一步减轻噪声标签影响。在三个红外小目标数据集及多种噪声标签设置中，持续达到当时最先进表现。

Insight: 具有互补先验的模型可互相纠错，比单模型自训练更不易放大自身标签错误；摘要未提供具体分数和噪声率。

Abstract: Existing data-driven infrared small target detection (ISTD) methods typically require large-scale datasets with accurate pixel-level annotations for model training. However, such labor-intensive requirements are difficult to satisfy in real-world applications due to the heavy reliance on expert knowledge and the inherently weak distinctiveness of infrared small targets. Consequently, the presence of noisy labels during model training is inevitable, which can severely mislead the learning of target perception toward spurious patterns. To address this challenge, we propose Prompt and Refinement (PAR), a label-noise-robust asymmetric mutual learning paradigm for ISTD. Specifically, PAR comprises a pretrained Segment Anything Model (SAM) and an ISTD-specific detector trained from scratch, which learn collaboratively through a peer-teaching scheme. Coupled with local contrast regularity, the predictions of the two asymmetric peer models are mutually exploited as rectification cues for the supervisory masks of their counterparts. The interaction between complementary inductive biases effectively prevents the label correction process from degenerating into the self-confirmation loop of a single model, enabling progressive refinement of the annotations toward intrinsic target characteristics. In addition, the detector predictions are utilized as corrective mask prompts to facilitate task-specific adaptation of the vision foundation model. Moreover, an evidential uncertainty estimation strategy is introduced into the optimization process to further alleviate the adverse effects of noisy labels. Extensive experiments under diverse noisy label scenarios on three ISTD datasets demonstrate that PAR consistently achieves state-of-the-art performance.

[114] UltraDub: Towards Authentic Dubbing by Unifying Visually-Steered Flow Learning and Trajectory Guidance cs.CV | cs.AI | cs.MM | cs.SDPDF

Gaoxiang Cong, Liang Li, Jianwei Wen, Zhedong Zhang, Zheng-Jun Zha

TL;DR: 提出UltraDub视觉驱动流学习与轨迹引导配音框架，以连续口部运动聚合语境并校正语音时间节奏。

Details

Motivation: 视觉语音克隆需清晰可懂、说话人一致且与可见口型同步；多模态条件顺序加入可能扰乱既有时序/身份线索，推理指导失衡也会以口型同步换取文本准确。

Result: 运动引导双语境检索MDR利用共享唇动查询残差持续校准语言和说话风格检索，并以独立时间门控调节贡献。无训练的节奏锚定轨迹引导RTG在纯视觉可预测中点评估分层多模态校正，可增强语义条件同时保留时间对齐。作者构建多场景DiverseDub野外视频配音基准；在四个数据集上达到当时最先进表现。

Insight: 将视觉运动同时用于条件检索与轨迹校正有助于平衡语义准确、身份一致和唇动同步；摘要未给具体指标。

Abstract: Visual voice cloning requires intelligible, speaker-consistent speech synchronized with visible articulation. However, sequential multimodal conditioning can disrupt previously established temporal and speaker cues, while imbalanced inference guidance can improve linguistic accuracy at the expense of lip synchronization. In this paper, we propose UltraDub, a Unifying Visually-Steered Flow learning and trajectory Guidance Dubbing framework that leverages vision in two ways: as continuous motion for multimodal context aggregation, and as structural rhythm for trajectory rectification. Specifically, we introduce the Motion-guided Dual-context Retrieving (MDR) module, which continually recalibrates linguistic and speaker-style retrieval through shared lip-motion query residuals, utilizing independent time-conditioned gates to regulate their contributions. Furthermore, we propose Rhythm-anchored Trajectory Guidance (RTG), a training-free mechanism that evaluates hierarchical multimodal corrections at a visual-only predictive midpoint, safely strengthening semantic conditioning while better preserving temporal alignment. Finally, we construct DiverseDub, a multi-scenario benchmark to evaluate video dubbing in the wild. Extensive experiments demonstrate that UltraDub achieves state-of-the-art performance across four datasets.

[115] ReMem: Streaming Video Understanding With Long Context Retention cs.CV | cs.AIPDF

Li Yiheng, He Xu, Wang Shaobo, Shao Ling, Lu Shijian

TL;DR: 提出训练免适配方法ReMem，以持续压缩的上下文记忆和查询相关视觉检索延长流式视频VLM的长程记忆。

Details

Motivation: 多数VLM面向离线视频，难满足在线低延迟；现有记忆与token压缩方案在输入流增长时仍会渐进丢失长上下文。

Result: ReMem由查询无关注意力持续压缩历史的Streaming Context Memory，以及从记忆检索最显著、与查询相关内容并补充模型输入的Retrieved Vision Memory组成。综合实验覆盖流视频及通用长视频理解多个常用基准，方法达到当时最先进表现，并能处理任意长度的视频流。

Insight: 历史压缩与查询驱动再检索互补，可减少长流信息遗忘；摘要未列具体基准及提升幅度。

Abstract: Despite their impressive performance on a wide range of video understanding tasks, current Vision Language Models (VLMs) are predominantly designed for offline scenarios and struggle to handle online streaming videos that demand low latency response. Several studies have explored memory and token compression strategies in an attempt to adapt offline VLMs for streaming video understanding tasks. However, through our probing experiment, we identify that most existing works tend to progressively lose long context information as length of input stream increases. To address this, we propose ReMem, a novel training-free adaptation technique that enables VLMs to process streaming videos of arbitrary lengths while improving their long context information retention capability. ReMem exploits memory from two perspectives, implemented as two core components. The Streaming Context Memory (SCM) continuously compresses historical context with query-independent attention. The Retrieved Vision Memory (RVM) then retrieves the most salient, query-relevant context from memory to augment the VLM’s input. Comprehensive experiments demonstrate that the proposed ReMem achieves state-of-the-art (SOTA) performance across a variety of widely used benchmarks, spanning both streaming video and general long video understanding tasks.

[116] JLD: Perceptual Distance Through A Jacobian Lens cs.CV | cs.AIPDF

Shreshth Saini, Balu Adsumilli, Alan C. Bovik

TL;DR: 提出Jacobian Lens Distance感知距离JLD，从冻结视觉编码器雅可比构造像素空间感知度量。

Details

Motivation: 像素误差不符合人类视觉；基于人评拟合的距离又常绑定训练分辨率，例如分辨率翻倍时DISTS在TID2013相关性从0.815降至0.717。

Result: JLD结合早期patch特征局部性和后期表征感知敏感度，利用编码器雅可比找出最影响输出的早期特征方向，形成固定度量张量E[JᵀJ]。仅用100张无标签图像拟合一次、约35秒；它在像素空间定义pullback度量。在四个常用感知数据库上优于LPIPS、DISTS、PieAPP、DreamSim等并达到最先进表现；TID2013分辨率翻倍时透镜项相关仅从0.850降至0.845。JLD-fast较LPIPS-VGG快4倍，平均相关0.911；扩展到视频后在Waterloo IVC 4K相关0.786，VMAF为0.611。

Insight: 冻结编码器的局部敏感度可形成少量无标注数据即可校准且对分辨率稳健的感知几何；人类感知相关仍由所测数据库验证。

Abstract: Image compression, restoration, and generation all require a way to measure how different two images look to a person. Pixel error ignores how people see, while the most accurate perceptual distances are typically fitted to human judgments, tying them to a fixed data and resolution. For example, when image resolution is doubled, the correlation of DISTS with human scores on TID2013 drops from 0.815 to 0.717. We introduce the Jacobian Lens Distance (JLD), which derives its perceptual geometry from a frozen vision encoder rather than from human labels. JLD combines the locality of early patch features with the perceptual sensitivity captured by later encoder representations. Specifically, we use the encoder Jacobian to identify directions in the early feature space that most strongly affect the encoder output, producing a fixed metric tensor, $E[J^\top J]$, which we call the Jacobian lens. The lens is fitted only once from 100 unlabeled images, taking about 35 seconds. Locally, this construction defines a pullback metric in pixel space, giving JLD a clear geometric interpretation that can be directly analyzed on real images. Across four standard perceptual databases, JLD achieves state-of-the-art performance and consistently outperforms LPIPS, DISTS, PieAPP, and DreamSim. JLD is also robust to changes in image resolution, on TID2013, its lens-term correlation remains nearly unchanged when the resolution is doubled, decreasing only from 0.850 to 0.845. We further introduce JLD-fast, which is $4\times$ faster than LPIPS-VGG while achieving a mean correlation of 0.911. Finally, JLD naturally extends to video, reaching a correlation of 0.786 on Waterloo IVC 4K compared with 0.611 for VMAF.

[117] From Transformation to Target State: Rethinking Query Representation for Zero-Shot Composed Image Retrieval cs.CVPDF

Yihe Zhao, Songhe Feng

TL;DR: 提出ASAP-CIR，将零样本组合图像检索重构为先从参考图和修改文本重建目标静态状态，再检索目标图像。

Details

Motivation: 修改文本描述的是从参考状态出发的转变，而候选图像呈现已经完成的目标状态，动态组合查询与目标候选的表征不匹配。

Result: ASAP-CIR免训练地调用冻结MLLM构造静态目标表示，将多个整体描述与重要性加权的原子语义结合，并在检索时融合整体状态对齐、原子约束落地和校准证据聚合。纯文本控制诊断显示目标侧静态查询比动态组合查询更可靠，尤其当需抑制或变换源状态语义时。FashionIQ、CIRR和CIRCO实验表征该原则的有效范围及限制，在多目标CIRCO上的收益最明显。

Insight: 复合意图如何表示在检索前就影响性能，不只是后端检索骨干的选择；摘要未给各基准量化成绩。

Abstract: Composed image retrieval (CIR) aims to retrieve a desired target image from a query consisting of a reference image and a modification text. This task exhibits an unusual representational asymmetry: the modification text specifies a transition from the reference state, whereas retrieval candidates depict completed target states. This creates a representation mismatch for zero-shot methods that query pretrained vision-language spaces directly with transformation-oriented language. We study this mismatch and reformulate zero-shot composed image retrieval as target-state reconstruction followed by retrieval. We instantiate this formulation with ASAP-CIR, a training-free framework that reconstructs a static target representation using a frozen multimodal large language model (MLLM). The representation combines multiple holistic descriptions with a variable set of importance-weighted atomic semantics, thereby preserving both overall target identity and fine-grained visual constraints. Retrieval then integrates holistic state alignment, atomic constraint grounding, and calibrated target-state evidence aggregation. A controlled text-only diagnostic shows that target-side static query formulations achieve more reliable retrieval than dynamic composed query formulations, particularly when source-state semantics must be suppressed or transformed. Experiments on FashionIQ, CIRR, and CIRCO further characterize the effectiveness and limitations of this representation principle, with the clearest gains on the multi-target CIRCO benchmark. These results show that how composed intent is represented before retrieval is a consequential design choice, distinct from the choice of retrieval backbone itself.

[118] Investigating Query-Insensitive Behavior in Spatio-Temporal Video Grounding cs.CV | cs.AI | cs.CLPDF

Eryk Kołodziejczyk, Alberto Presta, Karol Szurkowski, Michal Byra

TL;DR: 研究时空视频定位模型对查询不敏感的问题，发现无关或完全缺失文本查询时仍会生成看似合理的时空预测。

Details

Motivation: STVG模型通常假定每个查询与视频相关，实际使用时却可能出现无关输入或缺失语言，模型是否能拒绝此类情况少有研究。

Result: 作者在无关查询和删去文本两种条件下评估先进STVG模型，观察到仍会输出合理外观的时空定位。并分析HCSTVG-v2及VidSTG中的数据集规律，指出这些规律可能鼓励模型忽略查询内容。研究据此建议采用负样本感知评测，并设计显式判断查询相关性的模型架构。

Insight: 定位结果看似合理不代表与查询相关，STVG需测试无关查询拒答能力；摘要未给各模型具体表现。

Abstract: Spatio-temporal video grounding (STVG) aims to localize objects or events described by natural language queries in both space and time. Existing STVG models are typically trained and evaluated under the assumption that each query is relevant to the input video. In this work, we challenge this assumption by studying the behavior of state-of-the-art STVG models under irrelevant queries and missing textual input. Our experiments show that current models can still produce plausible spatio-temporal predictions even when the query is unrelated to the video or removed entirely. We further analyze HCSTVG-v2 and VidSTG to identify dataset regularities that may encourage such query-insensitive behavior. Our study highlights an underexplored limitation of STVG models and motivates negative-aware evaluation protocols and architectures that explicitly assess query relevance.

[119] Scalable Minimal-Change Learning for Controllable Image Editing cs.CV | cs.AIPDF

Shuo Chen, Fengming Huang, Yu Yao, Mingming Gong, Tongliang Liu

TL;DR: 提出ARRO，通过代理视觉语言奖励审计编辑结果中的目标遗漏及非目标变化，以RL优化图像指令编辑最小改动。

Details

Motivation: 理想图像编辑仅修改指令指定属性并保留其余内容；潜在空间L1并非现代非线性生成器输出局部性的好代理，且大规模监督不足。

Result: ARRO的代理VLM奖励针对源图、指令与编辑图检查未执行请求和意外变化，再以群组评分规程合并验证问题，为候选编辑提供一致奖励而不需每条指令人工标注。在FLUX.1 Kontext-dev上，MinEval、MagicBrush、AnyBench及Emu-Edit平均EditScore从5.21升至5.88；600个评测样例中偏离目标区域的像素变化较基座降低8.4%。奖励与SFT对照、盲法人评及向OmniGen2迁移提供补充证据。

Insight: 用明确审计最小化非目标变化，可把“只改该改的部分”变成RL目标；仍需注意代理奖励的判定可靠性。

Abstract: Image editing should change only the attributes specified by an instruction while preserving everything else, yet current methods often make unintended changes. We treat this minimal-change principle as an optimization objective for instruction-based editing. Latent L1 regularization is a poor proxy for output locality in modern nonlinear generators and often requires supervision unavailable at scale. We instead optimize edit outcomes with reinforcement learning. An agentic vision-language reward model audits each source image, instruction, and edited image for two failure types: unimplemented requested changes and unintended changes. A group-level rubric merges and verifies these issues to provide consistent rewards across candidate edits without per-instruction human annotations. On FLUX.1 Kontext-dev, ARRO raises average EditScore from 5.21 to 5.88 across MinEval, MagicBrush, AnyBench, and Emu-Edit. On 600 evaluation examples, it reduces off-target pixel change by 8.4% relative to the base editor. Reward and SFT controls, blinded human evaluations, and transfer to OmniGen2 provide complementary evidence. Code: https://github.com/Showwwwwwwww/ARRO

[120] ROT: Rotating Hidden States towards Contextual Vectors for Hallucination Mitigation in LVLMs cs.CV | cs.AI | cs.CLPDF

Yijing Du, Xiangcheng Zhan, Shuo Yang

TL;DR: 提出ROT免训练激活干预框架，在中层检测语义偏离并保持范数地将LVLM隐状态旋向局部多模态上下文。

Details

Motivation: 现有训练免幻觉干预多改注意力权重，间接影响抵达预测层的深层语义；幻觉token可能并非单纯依赖语言先验，而是与文本和视觉上下文都偏离。

Result: 分析显示中间层幻觉token对文本和视觉上下文相似度均显著更低。ROT按层动态检测这种偏离，在上下文张成的局部多模态平面内做范数保持旋转；后续层再用表征平滑稳定校准轨迹。多个基准实验中，该方法在不同架构和规模上持续减少幻觉，形成基于几何的高效落地生成干预；摘要未列具体指标。

Insight: 幻觉可能表现为上下文偏离而非仅语言偏置，直接校准隐状态为注意力修改提供了补充路径；效果需由具体基准和模型验证。

Abstract: Large Vision-Language Models (LVLMs) frequently suffer from object hallucination. Existing training-free interventions primarily manipulate attention weights, which indirectly affect the deep semantics reaching the final predictive layers. In this work, we shift our focus to the hidden state vectors extracted after self-attention and residual addition. Empirical analysis reveals that hallucinated tokens do not simply over-rely on linguistic priors; instead, they exhibit an anomalous contextual deviation, showing significantly lower similarities to both textual and visual contexts in intermediate layers. Motivated by this, we propose ROT, a layer-specific, training-free framework. ROT dynamically detects semantic deviation in the middle layers and applies a norm-preserving rotation to steer the hidden states back toward the local multimodal context plane spanned by the contexts. For subsequent layers, a representational smoothing mechanism is introduced to stabilize the calibrated trajectory. Extensive experiments on multiple benchmarks demonstrate that ROT consistently reduces hallucinations across various model architectures and scales, offering an efficient, geometry-driven solution for grounded generation.

[121] Vision Transformer Ensembles for Panoramic Street Segmentation cs.CV | cs.AI | cs.LGPDF

Yunus Serhat Bıçakçı

TL;DR: 比较多种预训练分割架构与集成方案在全景街道语义分割中的成绩，并报告PalmCity挑战系统。

Details

Motivation: 全景街景语义分割可支持详细城市环境描述，但小数据集和训练成本差异令模型选择困难。

Result: 论文比较DeepLabV3+、SegFormer、UPerNet、Mask2Former、DINOv3线性解码器及仅编码器Mask Transformer等九种预训练系统，预算约等计算量；两种领先候选用三随机种子延长训练。三个DINOv3仅编码器Mask Transformer模型的类别概率等权平均，使用三种图像尺度和水平翻转，在84张公开验证图上mIoU 60.95%、mF1 71.16%。隐藏测试榜单得分mIoU 57.08%、mF1 67.96%；单张RTX 5090生成249张测试掩码含初始化和来源检查共251.49秒，峰值显存2.70GiB。

Insight: 多种尺度与种子概率集成可稳定挑战成绩，论文也记录可复现工作流；验证集仅84图，隐藏测试成绩以2026-10-05榜单快照为准。

Abstract: Semantic segmentation of street panoramas can support detailed descriptions of urban environments, yet small datasets and unequal training costs make model selection difficult. This paper presents the system used for a first place submission to the PalmCity challenge in the leaderboard snapshot dated 5 October 2026. Nine pretrained segmentation systems are compared using approximately equal computation budgets. The candidates include DeepLabV3+, SegFormer, UPerNet, Mask2Former, DINOv3 with a linear decoder, and an Encoder only Mask Transformer using DINOv3. The two leading candidates are trained independently with three random seeds and longer budgets. Equal averaging of class probabilities from the three Encoder only Mask Transformer models, evaluated at three image scales with horizontal reflection, produces 60.95% mean intersection over union and 71.16% mean F1 on the 84 image public validation split. The submitted predictions receive 57.08% mean intersection over union and 67.96% mean F1 on the hidden test leaderboard. Producing all 249 test masks takes 251.49 seconds including model initialization and provenance checks on one NVIDIA RTX 5090. Peak allocated GPU memory is 2.70 GiB. The study reports all eligible models, all inference variants, class level errors, source conditions, and reproducibility checks, providing a documented challenge workflow with existing architectures.

[122] Efficient Test-time Adaptation through Candidate Verification and Divergence Shifts cs.CV | cs.CLPDF

Seungmin Oh, Seunghun Kang, Jongbin Ryu

TL;DR: 提出训练免测试时纠正TTC，将VLM预测改写为候选假设验证，通过候选子空间扰动最小者选出正确标签。

Details

Motivation: 多数VLM测试时适配通过调整logit、原型、缓存或统计量实现，增加优化和推理成本；可否把测试时适配改成直接验证候选标签？

Result: 给定测试特征与top-k标签，TTC将每个标签视为假设，在记忆库相应潜在子空间内重建特征，并测量将样本插入后子空间及候选间关系的散度变化；正确假设只产生小偏移，错误假设扰动更大，故选累计散度变化最小候选。五类适配设置、15个数据集（零样本、域泛化、少样本、基类到新类、跨数据集）中，准确率稳定超过现有VLM-TTA方法；相较最省内存训练免基线，最多快2倍、CPU内存少超3倍、GPU内存最多少1.4倍。

Insight: 候选验证可以替代迭代预测侧调参，带来准确率与效率兼顾；数据集覆盖面广，具体提升未在摘要详列。

Abstract: Vision-language models (VLMs) achieve strong zero-shot transferability but remain vulnerable to target-domain shifts at inference time. Test-time adaptation (TTA) offers a practical remedy, yet most existing VLM-TTA methods follow a prediction-side adaptation paradigm. They use test samples to adjust logits, prototypes, caches, priors, or feature statistics, often incurring additional computational overhead. In this paper, we take a different perspective and reframe VLM-TTA as candidate verification rather than prediction adjustment. We propose Test-Time Correction (TTC), a hypothesis-based correction framework guided by a simple principle: hypothesize, reconstruct, correct. Given a test feature and its top-k candidate labels, TTC treats each candidate label as a hypothesis, reconstructs the feature within the corresponding latent subspace stored in a memory bank, and measures the resulting divergence shift. This shift quantifies how much the candidate subspace and its relations to other candidates change after the hypothetical insertion of the test feature. A correct candidate hypothesis induces only a small shift, whereas an incorrect one perturbs the subspace more strongly. TTC therefore corrects the prediction by selecting the candidate with the minimum aggregated divergence shift. This training-free candidate-verification mechanism avoids iterative optimization and provides a favorable accuracy-efficiency trade-off. Across five TTA settings and 15 benchmark datasets, including zero-shot classification, domain generalization, few-shot classification, base-to-novel generalization, and cross-dataset evaluation, TTC consistently improves accuracy over state-of-the-art VLM-TTA methods while achieving up to 2x speedup, over 3x lower CPU memory usage, and up to 1.4x lower GPU memory usage than the lowest-memory training-free baseline.

[123] EORestore-Agent: Fidelity-Guided Agentic Restoration of Remote Sensing Images with Composite Degradations cs.CVPDF

Heli Qi, Zeqi Zhou, Jingjun Yi, Kunyi Liu, Ziyang Lihe

TL;DR: 提出EORestore-Agent，通过逐步可验证质量判断选择修复工具与顺序，处理多重退化遥感图像。

Details

Motivation: 雾、云、噪声、模糊、低光及低分辨率可能同时出现；真实推理阶段无干净参考图，代理难判断工具次序及何时停止。

Result: 微调VLM报告剩余退化类型，再联合排序其工具候选；相对质量评分器以合成退化链全参考监督，预测当前图到候选修复的PSNR、SSIM和LPIPS变化，只有无任何指标预测下降且PSNR提升时才接受，否则保留当前图。在含六类退化的合成Landsat-8基准上，两至六重退化情况下PSNR比最强重训all-in-one基线高2.3至3.2dB；零样本自然图像代理在18种设置中17种PSNR低于退化输入。用无参考质量差替换学习评分器损失1.1至4.6dB；剩余有害步骤幅度较小且接近接受阈值。Sentinel-2示例显示无需重训即可迁移到真实大气退化。

Insight: 逐步接受门控减少无参考条件下累计修复损害；真实迁移目前为示例展示，主要量化证据来自合成Landsat-8。

Abstract: Remote sensing images often carry composite degradations, in which haze, cloud, noise, blur, low light, and low resolution coexist. Restoring them requires deciding which tool to apply, in what order, and when to stop, yet no clean reference is available at inference time to verify these decisions. All-in-one models trained on single degradations converge to a narrow PSNR band as degradations accumulate. To formulate real-world remote sensing restoration as a traceable trajectory, we present EORestore-Agent, which replaces this unmeasurable objective with reference-free, verifiable per-step decisions. A fine-tuned vision-language model reports all residual degradation types, whose tool pools are scored together, so the restoration order emerges from step-wise selection. A relative quality scorer, trained with full-reference supervision on synthetic degradation chains, predicts the changes in PSNR, SSIM, and LPIPS from the current image to each candidate. A step is accepted only when no predicted change is negative and the predicted PSNR gain is positive. Otherwise, the agent keeps the current image. On a synthetic Landsat-8 benchmark with six degradation types, EORestore-Agent improves PSNR by 2.3 to 3.2 dB over the strongest retrained all-in-one baseline on composites of two to six degradations, whereas zero-shot natural-image agents fall below the degraded input in PSNR in 17 of 18 settings. Replacing the learned scorer with no-reference quality differences costs 1.1 to 4.6 dB. The remaining harmful steps are small and cluster near the acceptance threshold. Sentinel-2 examples illustrate transfer to real atmospheric degradation without retraining.

[124] MoCAR: Motion-code Coordinate-aware AutoRegression for Continuous Trajectory Forecasting cs.CVPDF

Yiming Xu, Hao Cheng, Monika Sester

TL;DR: 提出MoCAR，以连续潜在运动码的自回归预测进行轨迹规划，令每个局部段同时编码路径几何与坐标系变换。

Details

Motivation: 文本token可直接作下一步输入，而连续多模态轨迹没有天然离散符号，且局部坐标系随预测轨迹变化，难以直接自回归滚动。

Result: MoCAR从终点归一的轨迹片段学习连续运动码空间；历史运动码作为teacher-forced前缀，未来码在时序、地图、代理和模式交互下自回归生成并持久储于潜在记忆，解码端点则更新局部场景语境。无需轨迹空间重新token化、查询、目标候选或提议—细化流程。在Argoverse基准上以简单单阶段架构达到顶级成绩；AV2训练向AV1零样本迁移强，转弯密集场景改善。消融确认连续码空间、潜对齐、弱KL正则及联合tokenizer—预测器训练对稳定自回归都必要。

Insight: 让运动码联合承载局部几何和参考系变化，避免反复回到轨迹坐标再token化；摘要未报告具体预测指标。

Abstract: Autoregressive generation is natural for language, where predicted tokens can be directly reused as the next prediction state, but trajectory forecasting lacks such a clean token: motion is continuous, multimodal, and expressed in local coordinate frames that evolve with the predicted trajectory. We present MoCAR (Motion-code Coordinate-aware AutoRegression), a decoder-only framework that casts trajectory forecasting as next-code prediction in a coordinate-aware continuous latent space. MoCAR learns a continuous motion-code space from endpoint-normalized trajectory segments, where each code jointly captures local trajectory geometry and the reference-frame transition induced by that segment. Historical motion codes are used as a teacher-forced prefix, future codes are generated autoregressively under temporal, map, agent, and mode interactions, and predicted codes persist in latent memory while decoded endpoints update the local scene context. This enables rollout without trajectory-space re-tokenization, trajectory queries, goal candidates, or proposal-and-refinement pipelines. On Argoverse (AV) benchmarks, MoCAR achieves top-tier performance with a simple single-stage architecture, transfers strongly from AV2 to AV1 in zero-shot evaluation, and improves on turn-heavy scenarios. Ablations confirm that the learned continuous motion-code space, latent alignment, weak KL regularization, and joint tokenizer-predictor optimization are essential for stable latent autoregression.

[125] Joint Class-Time Learning for Video Classification with Multi-Instance Partial-Label Learning cs.CV | cs.AIPDF

Lingyu Shen, Wei Tang, Fakhri Karray, Min-Ling Zhang

TL;DR: 提出PIVOTMIPL，通过联合类别—时间分配，将候选标签消歧与视频时间证据分配一并学习。

Details

Motivation: 多实例部分标签学习适用于视频分类，但bag级标签未明确哪个候选类别对应何段时间证据。

Result: 方法用占用正则化球面匹配关联上下文化视频特征，同时学习非均匀时间质量并抑制过度集中；训练时限于候选标签集合重新求解分配。双边缘KL投影构造结构化教师，将动量更新的类别置信与提议时间占用结合，单一计划级KL目标对齐完整空间预测器。理论分析说明候选重求解何时不同于简单掩码，以及联合目标如何分解为类别边缘与类条件时间监督。Breakfast、DoTA和FineAction构建数据集，四种特征表示下，PIVOTMIPL在有效性和效率上均超过现有MIPL方法。

Insight: 把“哪个类别”和“何时出现”作为联合分配可利用bag标签中隐含的时间结构；摘要未提供具体指标。

Abstract: Multi-instance partial-label learning (MIPL) addresses inexact supervision in both the instance and label spaces, which can be applied to video classification. However, bag-level labels do not explicitly supervise the correspondence between candidate classes and temporal evidence. We propose {\ours}, which couples label disambiguation with temporal evidence allocation through a joint class–time assignment. Occupancy-regularized spherical matching associates contextualized video features while learning nonuniform temporal mass and discouraging excessive concentration. During training, candidate-restricted inference recomputes the assignment within the candidate label set. A dual-marginal KL projection then constructs a structured teacher that incorporates momentum-refined class beliefs while preserving the proposal’s temporal occupancy. A single plan-level KL objective aligns the full-space predictor with this teacher. Our analysis characterizes when candidate re-solving differs from masking and shows that, under the stated construction, the joint objective decomposes into class-marginal and class-conditional temporal supervision. We construct VCMIPL benchmarks from Breakfast, DoTA, and FineAction using model-generated candidate labels and evaluate the method across four feature representations. Extensive experimental results demonstrate that PIVOTMIPL outperforms existing MIPL algorithms in both effectiveness and efficiency.

[126] VepAgent: Bridging Causal-Transition via Tool-Augmented Reinforcement Learning for Video Event Prediction cs.CVPDF

Qiutong Chen, Yuchan Guo, Zhenlong Yuan, Haobo Yang, Fangfang Lin

TL;DR: 提出VepAgent，通过显式因果转移推理、视频诊断工具和复合奖励预测未观察到的视频事件。

Details

Motivation: MLLM倾向回顾式摘要和文本先验，难跨越视频观测终点到未来事件之间未见的因果中间状态。

Result: 作者构建FutureBench-4K监督微调数据集，以思维链结构化推导中间状态；诊断工具含状态追踪、帧检索和区域放大，推理时按需补充时空证据、消解视觉歧义。复合奖励共同优化预测准确性、因果连贯及可靠先验，促使视觉落地而非表面文本相似。在FutureBench与NEPBench评测中，VepAgent达到当时最先进表现并超过更大MLLM。

Insight: 事件预测需从末端观测状态推出因果过程，而非外推历史轨迹；摘要未提供基准成绩数字。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable potential in video understanding, yet their reliance on retrospective summarization and text-centric priors often limits their ability to bridge unobserved causal transitions when applied to Video Event Prediction (VEP). To address this, we propose VepAgent, an agentic framework that integrates causal-transition reasoning with tool-augmented reinforcement learning (RL) for robust VEP. Unlike prior methods that passively project future trajectories from historical dependencies, our approach explicitly models the logical progression from terminal observed states to future events. Specifically, we first construct futurebench-4K, a high-quality chain-of-thought dataset for supervised fine-tuning (SFT) that effectively bridges the causal-logic gap by structuring the deduction of unobserved intermediate states. Subsequently, we develop a diagnostic tool library integrating state tracking, frame retrieval, and region magnification, enabling the agent to dynamically augment reasoning with external tools to recover missing spatio-temporal evidence and resolve visual ambiguities during inference. Moreover, we propose a composite reward mechanism that jointly optimizes prediction accuracy, causal coherence, and reliable prior, compelling the agent to rely on genuine visual grounding rather than superficial textual similarities. Extensive evaluations on FutureBench and NEPBench datasets demonstrate that our method achieves state-of-the-art performance, significantly outperforming larger MLLMs and validating the empirical effectiveness of our agentic, future-oriented reasoning paradigm.

[127] Wiring Matters: Injection Topology and Initialization of Affordance Heads in Vision-Language-Action Policies cs.CV | cs.AIPDF

Zijian An, Linhan Wang, Jiayan Wang, Shijie Geng, Ran Yang

TL;DR: 研究VLA中稠密可供性监督头的接入结构与初始化，发现停止梯度及主动残差桥是稳定增益关键。

Details

Motivation: 稠密可供性监督能为VLA提供空间信息，但直接联合训练可能严重损害指令跟随，需理解如何连接辅助头并保护基础策略。

Result: 方法在骨干特征处停止梯度，并将中间可供性特征经可学习桥接回动作专家。允许梯度更新骨干时，LIBERO成功率从无头基座93.1%降至85.5%，说明停止梯度是前提。在桥接拓扑（拼接/残差）×初始化（零/随机）的同预算2×2消融中，初始化影响最大。最佳主动初始化残差桥达96.2%，匹配三专家复杂模型AffordanceVLA的95.8%，新增参数低于1%。真值可供性作为输入反而有害；推理时归零测试显示惰性桥仅在训练中作正则，主动桥则在推理中承担实际作用。

Insight: 辅助空间信号的连线与梯度路径比增加复杂专家更关键；冻结骨干避免破坏已有策略，主动残差桥可极低参数提升性能。

Abstract: Dense affordance supervision is an appealing auxiliary signal for vision-language-action (VLA) policies, yet naively co-training an affordance head can severely damage instruction following. We present a controlled study of how to wire such a head into a modern VLA on the LIBERO benchmark. Our recipe reads the backbone through a stop-gradient and re-injects an intermediate head feature into the action expert via a learned bridge. The stop-gradient is a precondition: letting affordance gradients reach the backbone drops the policy below the headless base (85.5% vs. 93.1%). With the backbone protected, a same-budget 2*2 ablation over injection topology (concatenation vs. residual) and bridge initialization (zero vs. random) shows initialization is the dominant lever. The best wiring, an actively initialized residual bridge, reaches 96.2%, matching the far more elaborate three-expert AffordanceVLA (95.8%) with under 1% extra parameters. Two probes explain the mechanism: ground-truth affordances fed as an input hurt, and inference-time zeroing shows a lazy bridge acts only as a training-time regularizer while an active bridge becomes load-bearing.

[128] Readout Blindness: VLM Scores Miss the Spatial Direction Their Frozen Encoders Retain cs.CV | cs.LGPDF

Guangyuan Li, Tianming Du, Yan Jiang, Bihan Wen, Jiancheng Yang

TL;DR: 提出ADR反对称位移读出，从冻结图文特征中恢复左右等有向空间关系，并以先验扣除隔离图像配对贡献。

Details

Motivation: CLIP类VLM在方向性空间关系上接近随机，例如判断一物体在另一物体左边；对称评分会消去方向信息，即使编码器可能仍保留它。

Result: ADR将描述词与图像patch对齐，根据匹配对象质心有符号位移评分关系，无需训练或新增参数。由于文本和世界先验可能抬高分数，先验扣除比较真实图文配对与无关图像配对的接地增益。多编码器实验中，已部署模型分数在多数方向平衡集合上仍接近随机，ADR显著改善；它超过所评MLLM似然读出，并以很少计算达到有竞争力的聊天推理表现。

Insight: 方向信息可从冻结特征经适当非对称读出恢复，模型失败可能是读出盲而非表征没有信息；先验扣除有助识别真正视觉依据。

Abstract: CLIP-like vision-language models remain a cornerstone of multimodal systems, yet their scores stay near chance on directed spatial relations, such as whether one object is left of another. We call this failure readout blindness and analyze, theoretically and empirically, why deployed scores miss the direction: when scoring rules treat the subject and object symmetrically, direction cancels regardless of encoder training. Guided by this analysis, we introduce Antisymmetric Displacement Readout (ADR), which aligns caption words with image patches in the frozen features and scores each relation by the signed displacement between matched object centroids. Notably, ADR succeeds without additional training or learned parameters, thereby demonstrating that directional information remains in the frozen encoder. However, text and world priors can inflate accuracy, so we further introduce prior deflation, which measures the benefit of the image-text pairing as the grounded gain over a null that pairs each item with an unrelated image. Extensive experiments across encoder families show that ADR substantially improves over deployed scores, which remain near chance on most direction-balanced sets even for fine-tuned encoders. Compared with more complex readouts, ADR outperforms the evaluated MLLM likelihood readouts and is competitive with their chat inference at a small fraction of the computation. These results support our claim that directional information can be recovered from frozen features by an appropriate readout. Our implementation and evaluation kit will be publicly available.

[129] BabelFake: A Multilingual Audio-Visual DeepFake Benchmark cs.CVPDF

Carlotta Segna, Joel Tschesche, Anna Rohrbach

TL;DR: 发布BabelFake多语言音视频深伪基准，包含经同意参与者、现代视频篡改和声音克隆生成的多类配对片段。

Details

Motivation: 现有深伪数据多为英语人物、伪造类型老旧或忽略音频，也常未获视频人物同意；部署检测需覆盖不同语言及音视频组合。

Result: BabelFake含49.6万片段、1,323小时、496名参与者及英语、德语、意大利语、法语、西班牙语五种语言。模块化流程将11种现代视频篡改方法与4种声音克隆引擎组合，区分仅视觉换脸和音视频联合口型同步/肖像动画。最先进检测器评测显示，难度取决于音视频生成组合，保留真实音频时检测性能显著下降；跨语言/人口评测敏感性依架构及训练数据而异。人类感知真实度和机器检测难度并不一致。

Insight: 音视频伪造检测需考虑模态组合和语言人口差异；保持真实音频是更难场景，基准使用知情同意参与者。

Abstract: Reliable and practical audio-visual DeepFake detection requires benchmarks that reflect diverse linguistic contexts and modern data synthesis pipelines for visual as well as audio manipulations. However, existing datasets predominantly contain footage of English-speakers, often include outdated manipulation types, or overlook the audio modality. Further, many datasets feature individuals who did not consent to be used in DeepFake creation. We introduce BabelFake, a multilingual audio-visual DeepFake benchmark recorded with consenting participants. BabelFake contains 399k clips (1,323 hours) from 496 individuals spanning five languages (English, German, Italian, French, Spanish). Our modular data generation pipeline pairs 11 modern video manipulation methods with 4 voice cloning engines, distinguishing visual-only (face swapping) and joint audio-visual manipulations (lip synchronization and portrait animation). By benchmarking state-of-the-art detectors, we show that detection difficulty depends on the audio-visual generation pairing, with substantial performance degradation when authentic audio is preserved. Cross-language/demographic evaluation reveals sensitivity varying across detector architectures and training data, while human evaluation reveals that perceived realism and machine-detection difficulty do not necessarily align.

[130] MeSD: Multi-Evidence Self-Distillation for VideoLLM cs.CV | cs.AIPDF

Weijie Zhu, Han Fang, Hanyu Fu, Yuzhe Zhang, Xin Wei

TL;DR: 提出MeSD多证据自蒸馏框架，以答案、时间和空间三类共享参数教师提供视频LLM稠密监督，并依轨迹状态选择优化方式。

Details

Motivation: VR奖励仅提供序列级结果，token信用有限；单个教师上下文混合异质证据会掩盖证据间一致或冲突，也难判断教师指导该改进奖励更新还是纠正失败轨迹。

Result: MeSD构造共享参数的答案教师、时间教师和空间教师，在同一学生前缀上计算各证据相对答案教师的偏好，并以教师共有偏好与门控特异残差融合。验证引导优化将轨迹判为成功、失败或未定：成功/未定时在保留奖励符号下细化token优势幅度；已验证失败但含所需证据时，用融合分布的反向KL进行失败条件蒸馏。多个视频基准实验稳定优于RL与自蒸馏基线。

Insight: 证据分路可暴露时空线索间关系，轨迹验证则决定是重加权还是纠错；摘要未给基准成绩数值。

Abstract: While reinforcement learning with verifiable rewards provides reliable outcome supervision for VideoLLMs, sequence-level rewards offer limited token-level guidance. On-policy self-distillation addresses this limitation by conditioning a self-teacher on privileged information to provide dense token-level supervision. However, aggregating heterogeneous evidence within a single teacher context obscures cross-evidence agreement and conflict. A further challenge lies in determining whether teacher guidance should refine reward-based updates or provide corrective supervision for failed trajectories. To address these issues, we propose MeSD, a multi-evidence self-distillation framework for VideoLLMs. MeSD constructs three evidence-conditioned teachers with shared parameters, using the ground-truth answer as a common semantic context while separately incorporating temporal and spatial evidence. Given the same student-generated prefixes, MeSD evaluates evidence-specific preferences relative to the Answer Teacher and fuses teacher-common preferences with gated teacher-specific residuals. Furthermore, MeSD introduces Verification-Guided Optimization to classify trajectories as Success, Failure, or Indeterminate. For Success and Indeterminate trajectories, MeSD refines token-level advantage magnitudes while preserving reward-derived signs. For verified failure trajectories that contain the required evidence, MeSD applies failure-conditioned distillation, using reverse-KL correction toward the fused distribution. Experiments on multiple video benchmarks demonstrate consistent gains over reinforcement learning and self-distillation baselines.

[131] KineWorld: Action-Induced Transport Fields for Embodied World Modeling cs.CV | cs.ROPDF

Ziying Song, Yuchen Liu, Zhuoran Xu, Ziyang Liu, Jian Jin

TL;DR: 提出KineWorld，以机器人运动学导出的传输场将动作影响引入世界模型的视觉监督空间分配。

Details

Motivation: 具身世界模型需预测候选动作的视觉后果，但均匀RGB生成损失即使显式动作条件化，也会低估交互关键的稀疏空间变化。

Result: 运动学传输提升KTL根据机器人指令构建与相机对齐、由渲染器推导的传输场；TAWD将运动支持校准至视频潜变量网格，并用均匀与传输聚焦分布的归一化混合重加权未来RGB流匹配。使用RoboTwin 2.0的ALOHA-AgileX双臂操控数据训练，单视角评估EWMScore-P为68.95，多视角TWB-Score为54.82。

Insight: 几何动作变化可用于分配生成监督，而不只是作为条件输入；结果支持从外观拟合转向动作后果建模。

Abstract: Embodied world models predict the visual consequences of candidate actions before execution. However, existing action-conditioned world models often adopt uniformly weighted visual generation objectives that can be misaligned with embodied prediction needs. Even with explicit motion conditioning, these objectives can underemphasize spatially sparse changes that are critical to interaction. We propose KineWorld, a transport-aware world-modeling framework that extends robot kinematics from motion conditioning to the spatial allocation of generative supervision. Kinematic Transport Lifting (KTL) constructs renderer-derived, camera-aligned transport fields from commanded robot motion. Transport-Aware World Diffusion (TAWD) calibrates their motion support on the video-latent grid and reweights future-RGB flow matching through a normalized mixture of uniform and transport-focused distributions. We train KineWorld using ALOHA-AgileX bimanual manipulation data from RoboTwin 2.0. KineWorld achieves an EWMScore-P of 68.95 in single-view evaluation and a TWB-Score of 54.82 in multi-view evaluation. These results support a shift from appearance fitting toward action-consequence modeling for embodied decision-making.

[132] Environmental sensor readings in two crop disease image datasets identify the session in which each image was taken cs.CV | cs.LGPDF

Sungwoo Kang

TL;DR: 审计韩国两个作物病害数据集的环境传感器特征，发现其随机划分可能泄漏采集会话而虚增多模态分类收益。

Details

Motivation: 叶片图像加环境传感器常报告作物病害分类提升，但同一农场同一天的多张图共享传感器读数，模型可能记住会话身份而非病因。

Result: 在CDD和AI Hub虫害/病害数据集上，几乎所有图像共享传感器值；CDD测试集中91.9%图像在训练集有完全重复传感器读数。只看时间戳、完全不用图像的分类器，在全部七种作物上匹配或超过传感器模型，并达到已发表CDD多模态融合SOTA的宏F1。研究据此认为标准随机划分的性能增益无法与会话泄漏区分，建议使用按采集会话留出的划分，并与不含传感器的日期时间基线对照。

Insight: 传感器共享粒度与数据划分单位不匹配会造成严重泄漏；必须在会话级留出后才能声称跨环境泛化。

Abstract: Integrating environmental sensor data with leaf imagery is widely reported to boost crop disease classification accuracy. In this work, we reveal that these reported gains are often artifacts of dataset construction: because a single sensor reading is shared across many images collected in a single session (one farm on one date), multimodal networks can predict disease simply by memorizing session identities. Analyzing two widely used Korean datasets, the Crop Disease Diagnosis (CDD) benchmark and an AI Hub pest/disease dataset, we demonstrate that nearly all images share sensor values, with 91.9% of CDD test images having exact sensor duplicates in the training set. Remarkably, an image-free classifier given only timestamps matches or exceeds sensor-driven predictions across all seven evaluated crops, and matches the published macro-F1 of a state-of-the-art CDD fusion model. These results indicate that performance gains on standard random splits cannot be disentangled from session leakage. We propose that multimodal crop studies must evaluate on session-held-out splits and report performance against sensor-free date-time baselines to ensure genuine generalization.

[133] MTOR: Generalizable AI-Generated Video Detection with Multimodal Semantics and Temporal Over-Regularity cs.CVPDF

Hang Wang, Chao Shen, Lei Zhang, Zhi-Qi Cheng

TL;DR: 提出MTOR多模态视频生成检测器，将图像字幕语义与时序过度规律性联合用于跨生成器鉴伪。

Details

Motivation: 视频生成迅速缩小与真实视频的感知差距，现有检测主要依赖视觉表征，忽视字幕语义及细粒度时间规则性。

Result: 作者发现字幕语义提供互补线索，生成视频则呈现更强时间持续性和更低变化，称为时序过度规律TOR。MTOR的多模态分支融合全局视觉与字幕文本；TOR分支从帧间粗连续性、token细粒度对应及帧到视频稳定性三个层次建模。五个基准、46种生成器变体上综合表现超过16个代表基线；对12种真实视频扰动具有较强鲁棒性。

Insight: 跨生成器鉴伪需同时捕捉语义与时序统计差异；代码和模型计划公开，摘要未报告具体指标。

Abstract: The rapid evolution of video generation has narrowed the perceptual gap between authentic and synthetic videos, making generalizable AI-generated video detection increasingly challenging. Existing detectors predominantly rely on visual representations, leaving caption-derived textual semantics underexplored. Meanwhile, temporal regularity in fine-grained visual representations has received limited attention. We find that caption-derived textual representations provide complementary discriminative cues to global visual representations. Our analysis further reveals that AI-generated videos exhibit stronger temporal persistence and lower temporal variability, a pattern we term temporal over-regularity (TOR). Based on these findings, we propose MTOR with a multimodal branch and a TOR component. The multimodal branch integrates global visual and caption-derived textual representations, while the TOR component models temporal over-regularity at three levels: coarse inter-frame continuity, fine-grained token correspondence, and frame-to-video stability. Extensive evaluations on five benchmarks covering 46 generator variants demonstrate state-of-the-art overall performance against 16 representative baselines, while robustness experiments confirm strong resilience to twelve real-world video perturbations. Code and models will be released at https://github.com/hwang-cs-ime/MTOR.

[134] Harnessing Multimodal Large Language Models for Training-Free Human-Object Interaction Detection cs.CVPDF

Zhaolin Cai, Huiyu Duan, Liu Yang, Yanjun Qin, Bo Ai

TL;DR: 提出HarnessHOI免训练人—物交互检测框架，将交互假设反馈到图像空间以主动查找遗漏参与者及澄清关系。

Details

Motivation: 现有MLLM式HOI流程将检测、落地和关系预测松散串接，交互假设不能主动指导视觉搜索，早期语义假设还可能造成后续自我强化的语义循环。

Result: HarnessHOI用交互引导感知把当前假设投影回视觉空间，定向观察以发现缺失参与者并细化歧义证据；关系无关几何裁决模块整合多来源证据，形成跨动作及语义角色统一空间基础。在HICO-DET和V-COCO上，该方法在免训练方法中达到当时最先进表现。

Insight: 主动交互假设驱动视觉复查可弥补被动分阶段推理的遗漏；摘要未给具体指标数值。

Abstract: Human-object interaction (HOI) detection aims to localize human-object pairs and recognize their interactions. Traditional supervised methods perform strongly but rely on task-specific training. Recent multimodal large language models (MLLMs) offer a promising route to training-free HOI detection through their broad visual-semantic knowledge and versatile perceptual and reasoning capabilities. However, existing approaches largely invoke these capabilities through loosely coordinated inference stages. This fragmented execution restricts the role of interaction hypotheses in guiding visual exploration, leaving key participants overlooked and local ambiguities unresolved. Furthermore, propagating early semantic assumptions through subsequent visual grounding and relation prediction induces self-reinforcing semantic circularity. To resolve these challenges, we propose HarnessHOI, a training-free framework that transforms passive MLLM inference into an active interaction-centric harness. Specifically, we introduce an interaction-guided perception mechanism that projects emerging interaction hypotheses back into the visual space to discover missing participants and refine ambiguous evidence through targeted observation. Furthermore, a relation-agnostic geometric adjudication module reconciles multi-source evidence to establish a unified spatial basis for grounded interaction reasoning across multiple actions and semantic roles. Extensive experiments on HICO-DET and V-COCO demonstrate that HarnessHOI achieves state-of-the-art performance among training-free methods, confirming the effectiveness of the proposed harness for complex interaction understanding. Code will be released upon publication.

[135] SpatialChain: A Benchmark for Auditing Spatial Reasoning Faithfulness in VLMs cs.CV | cs.AI | cs.CLPDF

Rafael Teixeira Sousa, Vinícius Paulo Lopes de Oliveira, Elisa Ayumi Masasi de Oliveira, Luiza Martins de Freitas Cintra, Fernanda Bufon Färber

TL;DR: 提出SpatialChain基准，通过场景图链条重叠及评审独立评估VLM空间推理是否忠实而非仅答对。

Details

Motivation: 启用思考的VLM在空间基准上得分高，但终答准确率无法说明模型是否真的按空间证据推理，还是使用语言捷径。

Result: SpatialChain含28,350个训练题及899个测试题，将空间GQA问题配对到场景图支持的推理链，仅保留符号真值匹配的答案。两轴评估结合客观链重叠和场景图感知LLM评审，分别评价忠实性与完整性、独立于终答正确与否。九个思考VLM中，四个模型VQA准确率至少79%，但不忠实捷径率仍超过39%。七个模型链质量显著预测答案正确；Claude Sonnet 4.6与InternVL3.5-8B分别呈现简短输出与冗长装饰推理两种不同失败。SpatialChain微调使Qwen3-VL-8B域内准确率+6.2点、捷径率降至22%，外部基准的风格专门化提示需用混合回放缓解。忠实度评审在198个人标注题上与人类—人类一致度相当，且跨供应商评审模型排名相关ρ=0.88。

Insight: 准确回答不保证推理忠实，需单独检查证据链；训练可降低捷径但可能带来外部风格专门化。

Abstract: Thinking-enabled vision-language models (VLMs) report ever-higher accuracy on spatial benchmarks, yet final-answer scores cannot reveal whether a correct prediction reflects faithful spatial reasoning or a linguistic shortcut. We introduce SpatialChain, a dataset of 28,350 training and 899 test examples pairing spatially-oriented GQA questions with scene-graph-grounded reasoning chains, retained only when the generated answer matches the symbolic ground truth, and a two-axis evaluation combining objective chain-overlap metrics with a scene-graph-aware LLM judge that scores faithfulness and completeness independently of the final answer. Applied to nine thinking-enabled VLMs, the protocol surfaces three findings invisible to standard accuracy: (i) four of nine models achieve $\geq$79% VQA accuracy while exhibiting shortcut rates above 39%, i.e., correct answers whose reasoning the judge marks as unfaithful; (ii) chain quality significantly predicts answer correctness for seven of nine models, but the two exceptions (Claude Sonnet 4.6, InternVL3.5-8B) reveal qualitatively distinct failure modes, terse output vs. verbose-decorative reasoning, that benchmark accuracy alone conflates; (iii) SFT on SpatialChain improves Qwen3-VL-8B by +6.2 pp in-domain and reduces its shortcut rate to 22%, while a stylistic specialization effect on external benchmarks motivates replay-augmented training as mitigation. The faithfulness judge is validated against 198 human-annotated items, where judge-human agreement matches human-human agreement, and against a second judge from a different provider, which preserves the model ranking ($ρ$ = 0.88). Data, generation scripts, and evaluation code are released at https://github.com/spatialchain/SpatialChainBenchmark.

[136] Toward Reliable Infant Pose Estimation: A Training-Dynamics Approach to Noisy Annotation Detection cs.CV | cs.AIPDF

Emanuele Cardinale, Sara Moccia, Alessandro Cacciatore, Lucia Migliorelli

TL;DR: 提出基于训练动态的婴儿姿态噪声关键点检测方法，以无监督聚类区分可信标注和误定位标注。

Details

Motivation: 早产儿自发运动分析依赖视频无标记姿态估计，需大量人工关键点标注；关键点错位会在重建关节轨迹中造成伪影并影响临床生物标志物。

Result: 混合卷积—注意力模型根据坐标及局部图像特征预测关键点解剖类别，再将交叉熵训练动态转为逐点描述符，通过无监督聚类划分干净与噪声标注。在新采集NeoPose（65名住院早产儿）及随机坐标扰动、左右互换两种噪声情形下，噪声关键点检测F1最高91.9%。迁移至异质COCO时，过滤检测出的噪声关键点可在中高噪声条件下使下游姿态估计AP最高提升7.4点。

Insight: 训练损失动态可用于发现婴儿姿态标注异常，并通过过滤提升下游模型；真实标注数据队列规模为65名婴儿。

Abstract: Spontaneous movement analysis in preterm infants relies increasingly on markerless pose estimation (PE) to derive clinically relevant motion biomarkers directly from video recordings. Training accurate infant PE models requires large sets of manually annotated keypoints, and human annotation is inherently prone to error. Noisy keypoints (i.e., keypoints mislocalized with respect to their true anatomical position) are especially problematic in this clinical setting, since they can propagate as artificial artifacts into the reconstructed joint trajectories. Building on the small-loss hypothesis and training-dynamics-based sample selection established in the noisy-label learning literature, we propose a novel framework for detecting noisy keypoint annotations. A hybrid convolutional-attention model is trained to predict the anatomical category of each keypoint from its spatial coordinates and local visual features; the resulting cross-entropy training dynamics are then used to derive per-keypoint descriptors, which are partitioned into clean and noisy subsets via unsupervised clustering. We validate the approach on NeoPose, a newly collected dataset of 65 hospitalized preterm infants, under two realistic noise scenarios (random positional perturbation and left-right swapping) across multiple noise levels. Results show that the proposed approach achieves an F1-score of up to 91.9% in noisy-keypoint detection. The framework further generalizes to the heterogeneous COCO benchmark, where filtering CE-detected noisy keypoints from the training set also yields measurable improvements (up to 7.4 AP points) in downstream pose estimation accuracy at moderate-to-high noise levels.

[137] MaRO-GS: Mask-Robust Object-Centric Gaussian Splatting from Inconsistent Multi-view Masks cs.CVPDF

Eunji Kim, Gahyeon Kim, Gianella Cravioto, Dong-hun Lee, Chaewon Moon

TL;DR: 提出MaRO-GS，直接优化目标物体高斯且按掩码可靠性筛除视图，降低跨视角不一致分割标注对3D重建的破坏。

Details

Motivation: 现有物体级3DGS即使仅需目标物体也重建整场景，计算冗余；二维分割掩码跨视角不一致会错误监督高斯并损害物体几何保真。

Result: MaRO-GS从物体掩码多视图图像直接优化目标高斯；掩码可靠性视图过滤移除不可靠视角，目标支持的高斯密度控制抑制无关目标高斯及背景稠密化，轮廓对齐物体损失聚焦目标优化。多数据集实验显示PSNR、分割准确率和计算效率均改善；在小物体LERF-Mask上的最大PSNR提升2.05dB。

Insight: 可靠视图筛选与目标专属优化可减少不一致监督和背景计算；最显著PSNR收益来自小物体基准。

Abstract: We address the challenge of accurate 3D object reconstruction from multi-view images in Gaussian Splatting. Existing object-level 3DGS methods reconstruct the entire scene rather than directly optimizing the target object, even when only the target object is needed, which incurs substantial computational overhead. They also rely on 2D segmentation masks to associate Gaussians with objects, but these masks are often inconsistent across views. Such inconsistencies corrupt Gaussian optimization and produce incorrectly supervised Gaussians that degrade object reconstruction fidelity. To overcome these limitations, we propose MaRO-GS, a 3DGS framework that directly optimizes target-object Gaussians from object-masked multi-view images and remains robust to inconsistent supervision. For reliable supervision, mask-reliability view filtering excludes unreliable views. Object-supported Gaussian density control suppresses Gaussians irrelevant to the target object and prevents background densification, while Silhouette-aligned Object Loss maintains object-focused optimization. Extensive experiments across diverse datasets demonstrate that MaRO-GS improves PSNR, segmentation accuracy, and computational efficiency, with the largest PSNR gain of 2.05 dB on the small-object LERF-Mask dataset.

[138] Topology-Informed Prompt-Conditioned Universal Segmentation of Uterine Structures from Ultrasound and MRI cs.CV | cs.AIPDF

Yongheng Sun, Yuexi Gu, Jingwen Sun, Maureen Kohi, Mingxia Liu

TL;DR: 提出TPUS统一子宫超声与MRI分割框架，用模态专属输入干与共享图编码器、任务提示和拓扑损失处理异质标签。

Details

Motivation: 子宫多结构分割可服务筛查、诊断和治疗规划，但超声/MRI外观、解剖语境和分辨率差异大，不同数据集标注目标也不一致，简单联合训练可能负迁移。

Result: TPUS以模态专属stem及共享图编码器—解码器联合学习结构信息；任务感知类别提示适配不同数据集/标签空间，动态卷积模块生成任务专属输出，拓扑损失约束解剖一致。子宫超声和T2加权子宫肌瘤MRI两个留出测试集Dice分别0.898和0.693，超过多种通用及统一分割基线。

Insight: 图结构、任务条件化与拓扑约束可在异质模态/标签空间中共享知识；MRI成绩低于超声，显示跨模态难度差异仍大。

Abstract: Multi-structure segmentation of the uterus is important for computer-assisted screening, diagnosis, and treatment planning of uterine diseases, where ultrasound and MRI provide complementary clinical information. However, developing a unified model across these modalities is challenging due to their substantially different image appearances, anatomical contexts, spatial resolutions, and label spaces. Moreover, existing datasets often define different segmentation targets, making joint learning challenging and potentially leading to negative transfer across heterogeneous tasks. To this end, we propose a Topology-informed Prompt-conditioned Universal Segmentation (TPUS) framework for segmenting multiple uterine structures across ultrasound and MRI. TPUS introduces a graph-based multi-dataset backbone comprising modality-specific stems and a modality-shared graph-based encoder-decoder to support modality-sensitive input adaptation, structural feature reasoning, and joint representation learning across heterogeneous uterine segmentation tasks. In addition, TPUS uses task-aware class prompts to condition the segmentation process for different datasets and label spaces, a dynamic convolutional adaptation module to generate task-specific output responses, and a topology-informed loss to encourage anatomically consistent predictions. Experiments on a uterine ultrasound dataset and a T2-weighted uterine myoma MRI dataset demonstrate that TPUS achieves Dice scores of 0.898 and 0.693 on the two held-out test sets, respectively, outperforming several generic and universal segmentation baselines. Source code can be accessed at https://github.com/YonghengSun1997/TPUS.

[139] BrainTRACE: Tracing Longitudinal, Multimodal, and Volumetric Evidence in Brain MRI Clinical Reasoning cs.CV | cs.AIPDF

Qizhen Lan, Mengchen Fan, Hang Zhang, Jingwei Duan, Moule Lin

TL;DR: 提出BrainTRACE报告驱动基准，审计VLM能否沿纵向、多模态、体积MRI证据链完成临床推理。

Details

Motivation: 纵向脑MRI需对比连续检查、整合多个序列、在三维解剖中定位病灶并以报告证据作判断；孤立图像或无落地报告问答无法暴露完整证据链失败。

Result: BrainTRACE含1,778名纵向患者、7,299次MRI检查、约29,000个配准三维MRI序列体积，构成7,273个评分VQA实例。按临床推理分为采集识别到病例综合五层，覆盖纵向比较、报告依据、多序列整合和三维空间证据。支持标准VLM兼容渲染输入、3D证据条件以及拆解式病例推理轨道（审计六步链）。评估20种VLM配置显示，模型可识别孤立视觉线索，却很少能组合成有依据的纵向解释。

Insight: 评测纵向MRI需检查整个证据链，而非只看单次图像问答；基准提供可复现的评分规格、清单、量表和审计记录格式。

Abstract: Brain MRI interpretation is a longitudinal clinical reasoning problem: radiologists compare serial studies, integrate information across MRI sequences, localize findings within volumetric anatomy, and translate this evidence into report-grounded assessments. Existing medical VQA and 3D imaging benchmarks capture important parts of this workflow, but often evaluate brain MRI through isolated images, static volumes, or ungrounded report-style answers, thereby obscuring failures in the evidence chain that support clinical validity. We introduce BrainTRACE, a report-grounded benchmark for evaluating whether vision-language models can trace the evidence structure required for longitudinal brain MRI interpretation. BrainTRACE contains 7,273 scored VQA instances derived from 1,778 longitudinal patients, 7,299 MRI studies, and approximately 29k co-registered 3D MRI sequence volumes. The benchmark is organized by five levels of clinical reasoning, from acquisition recognition to case-level synthesis, and by evidence demands covering longitudinal comparison, report-grounded references, multi-sequence integration, and volumetric spatial evidence. BrainTRACE supports rendered inputs compatible with standard VLM interfaces, a 3D-evidence condition, and a decomposed case-reasoning track that audits six steps in a longitudinal evidence chain. Evaluation of 20 VLM configurations shows that current systems can identify isolated visual cues but rarely compose them into grounded longitudinal interpretations. We release the benchmark specification, evaluation lists, scoring implementation, scoring rubrics, and audit-record format to support reproducible progress in brain MRI VLM evaluation.

[140] Keepsake: Selective Spatial Memory for Long-Horizon Video Generation cs.CVPDF

Abdul Mohaimen Al Radi, Kunyang Li, Yuzhang Shang, Mubarak Shah, Yu Tian

TL;DR: 提出Keepsake在线免训练空间记忆控制器，按保留观察是否有几何与视觉替代品，在固定预算下动态淘汰可替换记忆。

Details

Motivation: 长时域相机控制视频生成需持久记忆保持场景一致；保存全部历史导致存储/检索无限增长，提前一次性筛选又无法随记忆库变化重新评估观察价值。

Result: Keepsake将观察价值视为关系属性：若有多个几何和视觉相似替代物，可释放该视图；缺少替代者则不应仅因时间久而淘汰。每次更新构建保留及新生成观察的位姿—外观图，联合估计强替代品数量和最佳替代相似度，动态更新固定容量记忆优先级。控制器仅改持久记忆更新，不改生成器、去噪日程或检索规则。在MemCam和WorldMem固定预算下，FVD与LPIPS均改善；MemCam 180秒轨迹仅保留5,397帧中的32帧，FVD降低35.1%。

Insight: 记忆淘汰应看观察的可替代程度，而非静态重要性或年龄；显著压缩历史仍改善生成质量。

Abstract: Long-horizon camera-controlled video generation relies on persistent memory to maintain scene consistency. Existing systems follow two strategies to achieve this consistency. Full-history approaches retain all generated observations, causing unbounded storage and retrieval costs. Selective-construction approaches reduce redundancy, but make one-time retention decisions that are never revisited, even as an observation’s value changes with the evolving memory bank. Both strategies leave a shared question unresolved: as the generated history evolves, which stored observations should still remain in memory? Our key insight is that the value of a stored observation is not fixed, but relational: it depends on the alternatives currently available in the memory bank. A view supported by many geometrically and visually similar substitutes can be relinquished with little loss of coverage, whereas an observation with few viable alternatives should remain regardless of age. We introduce Keepsake, an online, training-free controller for fixed-capacity spatial memory. At each update, Keepsake constructs a pose-appearance graph over retained and newly generated observations, combining camera-pose proximity with visual similarity. A retention priority jointly captures the number of strong substitutes and the similarity of the closest alternative, allowing Keepsake to continually reassess memory value, preserve observations with little alternative support, and evict highly replaceable ones under a fixed budget. The controller modifies only the persistent-memory update; the host generator, denoising schedule, and retrieval rule remain unchanged. Across MemCam and WorldMem, Keepsake improves FVD and LPIPS under a fixed memory budget. On 180-second MemCam trajectories, it retains only 32 of 5,397 frames while reducing FVD by 35.1%.

[141] Lens3D: Target-Conditioned Visual Foveation for Fine-Grained 3D Understanding cs.CVPDF

Junming Huang, Zini Chen, Shuaiying Hou, Chi Wang, Qiang Dai

TL;DR: Lens3D通过3D定位为外部二维视觉语言模型挑选互补视角，生成细粒度物体知识，再用详细描述监督蒸馏到3D大语言模型；作者还构建了包含2,068个物体的LensBench。

Details

Motivation: 现有3D大语言模型可能忽略场景视频中已经存在的细节，尤其是不显著物体和细粒度属性。外部二维视觉语言模型可提供补充视觉能力，但若推理时持续依赖外部模型会有调用依赖，因此需要将其获得的细节知识迁移到原生3D模型。

Result: LensUnd利用3D定位选择信息丰富且互补的视角，支持细粒度物体描述、小物体定位和细粒度问答；LensDistill以细节描述监督将知识迁移给3D大语言模型，使其仅凭原生输入生成描述。LensBench包含2,068个留出物体，每个物体有3条银标准参考描述。Video-3D LLM和3DRS上的实验显示，蒸馏显著改善细粒度物体描述，同时保持原有定位和场景级问答表现。

Insight: 外部VLM获取的局部细节可以通过监督蒸馏沉淀到3D模型中，从而兼顾外部视觉辅助与原生输入推理。摘要未报告提升幅度的具体数值，因此这里只概述其报告的定性结论；LensBench参考描述为银标准而非人工确证标准。

Abstract: Existing 3D large language models often overlook fine-grained attributes and less visually salient objects and parts, even when relevant evidence is present in scene videos. We introduce Lens3D to improve fine-grained object understanding through external visual assistance and knowledge transfer. Its LensUnd pipeline adopts 3D localization to select informative, complementary views for an external 2D vision-language model, supporting fine-grained object captioning, small-object grounding, and fine-grained object question answering. LensDistill transfers the resulting fine-grained knowledge to 3D LLMs through detailed caption supervision, enabling captioning from native inputs without external VLM calls. We also construct LensBench, a held-out evaluation set of 2,068 objects with three silver-standard reference descriptions per object. Experiments with Video-3D LLM and 3DRS demonstrate that LensDistill substantially improves fine-grained object captioning while preserving existing grounding and scene-level QA performance. These results establish the feasibility of transferring externally acquired fine-grained knowledge into native 3D LLMs.

[142] Video Encoders Built on Image Representations cs.CVPDF

Jusheng Zhang, Wenhao Wang, Longqi Cai, Liangzhe Yuan, Yuxiao Wang

TL;DR: 本文提出一种建立在图像表示之上的紧凑视频编码路径：先独立编码各帧，再按问题分配固定视觉token预算，最后对保留锚点做轻量时间更新。在13个基准上，其宏平均性能匹配完整图像路径，但只使用约28%–35%的视觉token。

Details

Motivation: 视频编码器决定帧间何时交互，以及语言模型还能访问多少逐帧视觉证据。原生视频路径较早耦合帧信息，而逐帧图像路径保留独立表示但转发全部图像token成本高。作者希望把图像表示的证据保留能力与紧凑的视频token预算结合起来。

Result: 方法将逐帧表示、跨帧token分配和时间交互拆开：冻结图像编码器产生候选，问题感知选择器按相关性、多样性和跨帧对应分配预算，轻量refiner再读取邻帧上下文并更新保留锚点。在13个基准、3种视觉语言骨干上，Qwen3-VL-8B宏平均为62.75（1,535个token），略高于完整Image路径的62.58（4,424个），也高于Conv3D的59.49（2,212个）；Qwen3-VL-32B为66.28，对比Image的66.09，端到端速度提升2.16倍。

Insight: 实验支持一种分阶段设计：先保留帧级证据并联合选择，再做时间上下文化，不必在视觉编码早期就混合相邻帧。主要对比显示在大幅压缩视觉token时仍能匹配完整图像路径，但结论范围是论文测试的13个基准和所用模型骨干。

Abstract: The design of a video encoder determines when frames begin to interact and which frame-specific visual evidence remains accessible to the language model. Native video pathways couple neighboring frames during visual encoding, whereas image pathways preserve independently computed frame representations but incur a much larger visual-token cost when all image tokens are forwarded. We ask a basic question: whether a compact video encoder can instead be built on image representations. To answer this question, we separate three operations that are often coupled: per-frame representation, cross-frame token allocation, and temporal interaction. A frozen image encoder first produces frame-specific candidates. A question-aware selector then allocates a fixed token budget across frames using relevance, diversity, and cross-frame correspondence, after which a lightweight learned refiner reads neighboring-frame context and writes residual updates only to the retained anchors. This preserves source positions and keeps the visual output at the fixed budget. Across 13 benchmarks and three vision-language backbones, the resulting pathway matches full-image aggregate performance while using only about 28%-35% of its visual tokens. Specifically, on Qwen3-VL-8B, it achieves a 13-benchmark macro-average of 62.75 with 1,535 visual tokens, compared with 62.58 for the full Image pathway at 4,424 tokens and 59.49 for native Conv3D at 2,212 tokens. On Qwen3-VL-32B, it reaches a 13-benchmark macro-average of 66.28, compared with 66.09 for Image, while providing a 2.16x end-to-end speedup. These results show that compact video encoding does not require early temporal mixing: frame-specific evidence can be preserved first, allocated jointly, and temporally contextualized after selection.

[143] RealtimeWAM: One-Step Asynchronous World Action Models cs.CV | cs.LG | cs.ROPDF

Chengtao Lv, Jinyang Du, Shuyi Feng, Yang Yong, Shiqiao Gu

TL;DR: RealtimeWAM把世界动作模型的动作生成压缩为一步，并通过跨专家波前流水线异步重叠视频与动作专家计算；在LIBERO、LIBERO-Plus和RoboTwin等基准上，性能下降小于1%，报告在H100上端到端加速约25倍。

Details

Motivation: 现有高效世界动作模型仍受两处延迟限制：动作专家需要多步去噪，视频专家和动作专家又顺序执行、彼此等待。若要降低推理时延，需要同时减少单个专家内部迭代并消除专家之间不必要的等待。

Result: TACD（一致性蒸馏）针对局部一致性误差小却不保证最终动作准确的问题，额外用冻结教师多步rollout的终点监督一步生成。CEWP则按块共享视频KV缓存，让两专家计算重叠，只在对应动作注意力即将消费缓存时同步。论文在LIBERO、LIBERO-Plus、RoboTwin及Fast-WAM、Faster-WAM等模型变体上报告近乎无损表现（下降小于1%）和显著端到端加速，例如H100上约25倍。

Insight: 动作生成质量与系统调度都需要处理：蒸馏锚定教师最终动作，异步流水线减少跨专家空等，二者共同带来低延迟。速度数字是摘要给出的H100示例，不宜外推为所有硬件或任务上的固定加速比。

Abstract: World Action Models (WAMs) incorporate visual representations from video generation backbones to guide action prediction. Recent efficient WAMs adopt Mixture-of-Transformers (MoT) architectures and compute video representations once for reuse by the action expert. However, intra-expert iteration (\ie, multi-step action denoising) and inter-expert waiting (\ie, sequential execution of the video and action experts) still limit inference efficiency. To this end, we present RealtimeWAM, an extremely efficient WAM variant with one-step action generation and asynchronous inference, addressing these two bottlenecks. To reduce intra-expert iteration, we propose Teacher-Anchored Consistency Distillation (TACD) to address a local-global error gap: low local consistency error alone does not guarantee accurate final actions. TACD supplements local consistency with explicit supervision from the frozen teacher’s multi-step rollout endpoint, enabling accurate one-step action generation. Additionally, we propose Cross-Expert Wavefront Pipelining (CEWP) to eliminate unnecessary expert-level waiting. It overlaps the two experts through block-wise sharing of the video KV cache, synchronizing only immediately before the corresponding action attention consumes it. Extensive experiments across diverse benchmarks (\eg, LIBERO, LIBERO-Plus and RoboTwin) and model variants (\eg, Fast-WAM and Faster-WAM) demonstrate the superiority of RealtimeWAM. Notably, RealtimeWAM maintains near-lossless performance (\ie, $<1%$ drop) across these benchmarks while delivering significant end-to-end speedup (\eg, $\sim25\times$ on H100). Our code and checkpoints are available via this \href{https://github.com/ModelTC/LightX2V/tree/main/examples/realtimewam}{link}.

[144] Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation cs.CVPDF

Baiqin Wang, Zhixing Ding, Jijie Li, Jiankuo Zhao, Zhen Lei

TL;DR: TalkLikeYou针对实时说话头像生成中的个体发音习惯，直接在运动空间建模口型差异，以单步Flow Matching实现实时生成，并允许通过预设风格或参考视频指定目标习惯。

Details

Motivation: 同一个人在发相同音时也会呈现细微而稳定的口型习惯，但现有说话头像方法主要关注视觉质量和音画同步，常产生较统一的面部动作，难以表现个人特有的发音运动模式。

Result: 方法采用两阶段模仿学习捕捉细微习惯差异，目标风格既可选数据集中的预设，也可由参考视频提供；推理时使用单步Flow Matching。作者还提出PLAD指标，将口部运动投影到代表性发音轴，用于衡量习惯模仿准确度和生成多样性。摘要报告该方法可实时生成高质量说话头像，并在说话习惯模仿方面优于先前方法，但未给出具体量化提升值。

Insight: 将个性化目标定义为口部运动习惯，并设置可指定目标和对应评测指标，有助于超越仅评估同步与视觉保真度的设定。当前摘要给出定性实验结论，没有可据以填写的具体数值，故不推测性能增幅。

Abstract: In daily life, each person exhibits unique speaking habits, leading to subtle yet consistent lip-shape variations even when pronouncing the same word. Although recent talking head generation methods have achieved impressive visual fidelity and lip synchronization, they largely overlook user-specific customization, especially the motion patterns that characterize individual speaking habits. These habits are difficult to model and capture, as their motion patterns are highly fine-grained and often similar across individuals. As a result, many approaches produce overly uniform facial motions and fail to capture diverse, person-specific articulation patterns. To address this, we propose TalkLikeYou, an efficient framework that imitates how a target person speaks in talking head generation. Our method models habit in motion-space and achieves real-time performance through Flow Matching with only one sampling step during inference. We further adopt a two-stage imitation learning strategy to capture subtle distinctions between habits, allowing users to specify a target habit through either a preset style from the dataset or a reference video. In addition, we introduce a new metric PLAD that projects mouth motions onto representative articulation axes to evaluate imitation accuracy and generation diversity. Extensive experiments demonstrate that TalkLikeYou generates high-quality talking heads in real-time and significantly improves speaking habit imitation compared with prior methods. The code is available at: https://github.com/BQ-Wang0511/TalkLikeYou

Yucheng Liu, Yufei Yin, Mingxiao Feng, Jiajun Deng, Wengang Zhou

TL;DR: VideoTapestry是免训练的多智能体长视频理解框架：它在已有的分层视频记忆上按问题由粗到细回看相关片段，补充目标相关的多模态证据。相较直接调用GPT-5.5，在LVBench、LongVideoBench（Long）、Video-MME（Long）和EgoSchema上的准确率分别绝对提升17.2、14.9、9.8和7.0个百分点。

Details

Motivation: 长视频问题常要求检索分散在很长时间范围内的信息。纯问题驱动探索容易受定位误差影响；预先构建且与问题无关的记忆则可能遗漏具体问题需要的细节。作者希望在保留紧凑全局脉络的同时，根据问题自适应补足相关局部证据。

Result: VideoTapestry将预构建记忆分为全局叙事、事件级时间结构和细粒度关系证据三个层次，各层由专门智能体在匹配尺度的上下文中进行检索与细化。智能体按查询重新观察相关视频区域并丰富对应记忆，最后按原层级组合成查询自适应记忆供推理。在四个基准上，相对直接GPT-5.5推理的准确率绝对增益分别为17.2、14.9、9.8和7.0个百分点；摘要称其达到所有竞争方法中的当前最佳结果。

Insight: 该方法将固定分层记忆与查询驱动局部复查结合，降低一次性定位错误和问题无关压缩造成的信息损失。报告的对比基线是直接GPT-5.5推理；增益能否延伸至其他基础模型、记忆构造方式或推理预算，摘要未提供证据。

Abstract: Long-video understanding places substantial demands on memory, as answering questions often requires retrieving information distributed across extended temporal spans. Existing approaches broadly follow two paradigms: query-driven exploration, which is sensitive to localization errors, and query-independent memory construction, which may omit question-specific details. We introduce VideoTapestry, a training-free multi-agent framework that adapts a preconstructed hierarchical video memory through coarse-to-fine, query-driven refinement. The preconstructed memory organizes video content into three levels, capturing global narrative context, event-level temporal structure, and fine-grained relational evidence, respectively. To support coarse-to-fine localization and observation, we assign a specialized agent to each level, keeping retrieval and refinement within a scale-specific context. Guided by the query, these agents revisit relevant video regions and enrich layer-wise memories with targeted multimodal observations. Their refinements are assembled according to the original hierarchy into a composite query-adaptive memory, preserving global context in a compact form while retaining fine-grained evidence along query-relevant branches for final reasoning. Compared with direct GPT-5.5 inference, VideoTapestry achieves absolute accuracy gains of 17.2%, 14.9%, 9.8%, and 7.0% on LVBench, LongVideoBench (Long), Video-MME (Long), and EgoSchema, respectively, achieving the state-of-the-art results among all competitors.

[146] ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections cs.CVPDF

Xiaoyu Zhou, Dingwei Xian, Zhenyu Wang, Yajiao Xiong, Yongtao Wang

TL;DR: ChronoWorld提出“观察—状态—反思”相机可控4D世界生成框架，通过时空极线因果注意力约束多视角几何与时间因果关系，并用重建驱动的几何反思和4D检索自评、自纠生成结果。

Details

Motivation: 现有相机可控视频生成可以产生视觉效果较好的序列，但跨时间和视角保持内在4D一致性仍有困难。作者将问题归结为生成过程中需要持续利用时空因果线索，并对输出的几何一致性进行检查和修正。

Result: 给定上下文视频，ChronoWorld在生成中使用Spatiotemporal Epipolar Causal Attention施加多视图极线约束和时间因果约束；另设重建驱动的几何反思流程，并结合4D检索，对生成结果动态自评和校正。摘要报告其在时空一致、电影级4D场景生成方面达到最先进表现，并在不同场景上具备较强泛化和高保真几何，但没有提供可填写的数值指标。

Insight: 工作将生成时的几何/时间约束与生成后的重建反馈结合，形成闭环式一致性改进路径。摘要只给出定性比较，未说明具体基准、指标或提升数值，因此不推断其相对优势的幅度。

Abstract: While existing camera-controllable video generation models can produce visually compelling sequences, preserving intrinsic 4D spatiotemporal coherence remains challenging. To address this limitation, we propose ChronoWorld, an “Observation–State–Reflection” framework that leverages spatiotemporal causal cues and reconstruction priors to generate globally consistent, free-view 4D scenes. Given a context video, we introduce a Spatiotemporal Epipolar Causal Attention mechanism that enforces multi-view epipolar constraints and temporal causality throughout the generation process. In addition, we develop a reconstruction-driven geometric reflection pipeline with a 4D retrieval strategy to enable dynamic self-assessment and correction of generated outputs, improving consistency and accuracy. Extensive experiments show that ChronoWorld achieves state-of-the-art performance in spatiotemporally consistent, cinematic-quality 4D scene generation, with strong generalization and high-fidelity geometry across diverse scenarios.

[147] Extending Dynamic World Surface Water Mapping to Sentinel-1 with AlphaEarth Embeddings cs.CVPDF

Rohit Mukherjee, Frederick Policelli, Beth Tellman, TC Chakraborty, Jonathan Giezendanner

TL;DR: 本文把Dynamic World的水体类别作为弱监督，训练Sentinel-1 SAR水体制图模型，并融合AlphaEarth年度嵌入提供空间上下文。在53个全球场景的独立标注上，融合模型水体IoU为0.85，高于S1单模态的0.77和OPERA DSWx-S1的0.75。

Details

Motivation: Dynamic World利用Sentinel-2光学影像提供10米土地覆盖图，但只能覆盖无云观测，限制了水体制图的时空可用性。Sentinel-1 SAR可在每次获取时提供观测，作者探索用光学产品生成的弱标签训练SAR模型，并借助年度地理嵌入补充空间信息。

Result: 模型将S1后向散射作为当前观测，将Google AlphaEarth Foundations年度嵌入作为空间上下文，并以Dynamic World水体类别作弱监督。独立评估包括53个全球场景：PlanetScope 3米影像标注在S1过境前后48小时内采集。S1单独模型汇总水体IoU为0.77，略高于OPERA产品的0.75；加上AEF后升至0.85。融合模型在53个场景中的44个优于S1单模态，在48个场景中超过OPERA；独立S1S2-Water基准上IoU为0.94，对比OPERA的0.87。

Insight: 云覆盖下不可用的光学产品仍可通过其标签为SAR模型提供可扩展训练监督，年度嵌入还能补充当前SAR观测的空间上下文。评估支持所测全球场景与基准上的提升；标签依赖Dynamic World弱监督，不能据此假定所有地域和时相均无偏。

Abstract: Dynamic World (DW) maps land use and land cover globally at 10 m from Sentinel-2 (S2) imagery, but only for cloud-free observations, which limits where and when surface water can be mapped. We use the DW water class as weak supervision for a Sentinel-1 (S1) synthetic aperture radar (SAR) model so that DW-like water maps can be produced for every S1 acquisition. Google’s AlphaEarth Foundations (AEF) annual embedding supplies spatial context, while S1 backscatter supplies the acquisition-time observation. On 53 globally distributed scenes with independent annotations of 3 m PlanetScope imagery acquired within 48 h of the S1 overpass, the S1-only model already reaches a pooled water intersection over union (IoU) of 0.77, comparable to 0.75 for the operational OPERA DSWx-S1 product, and adding AEF raises it to 0.85. The fused model improves on the S1-only model on 44 of 53 scenes and exceeds OPERA on 48, and on the independent S1S2-Water benchmark it reaches 0.94, compared with 0.87 for OPERA. Optical land-cover products can thus provide scalable training labels for SAR surface water mapping.

[148] MC-Sparse: Deconstructing and Closing the Dense-Sparse Attention Gap in Diffusion Transformers cs.CV | cs.AIPDF

Jiarui Chen, Zeqiang Lai, Jiangshan Wang, Ziheng Ouyang, Ye Huang

TL;DR: MC-Sparse分析扩散Transformer稀疏注意力的质量损失来源，并提出免训练的元缓存稀疏注意力：缓存查询分组、精确注意力概率选出的KV索引及稠密/稀疏输出残差，跨去噪步复用。相对稠密注意力，视频生成加速1.80倍，3D资产生成加速2.32倍且质量损失可忽略。

Details

Motivation: 稀疏注意力可以降低长序列视频和高分辨率3D生成的扩散Transformer延迟，但高稀疏度下常出现质量和保真度下降。作者通过受控oracle比较，试图分辨这种退化来自分组约束、交互选择不准还是丢弃token导致注意力贡献缺失。

Result: 分析指出三类退化来源：token分组限制、交互选择误差，以及丢弃token所损失的注意力贡献。MC-Sparse按单个KV token选择，同时将相似查询整理为适合GPU执行的tile分组；缓存查询组、按精确注意力概率选择的KV索引，以及稠密与稀疏注意力输出的残差，并在后续去噪步复用。跨视频和3D生成模型，其稠密输出保真度和去噪加速均优于既有稀疏基线。相对稠密注意力，Minimax-H3-Base去噪加速1.80倍，3D资产生成加速2.32倍，质量损失均可忽略。

Insight: 稀疏化性能退化不只是选择哪些token的问题，也来自分组方式和被丢弃注意力贡献；缓存精确选择元数据及残差能兼顾GPU执行和输出逼近。文中给出的加速为特定视频/3D生成设置，不能直接视作所有模型与硬件上的通用倍率。

Abstract: Sparse attention is a primary approach to reducing the latency of diffusion transformers in long-sequence generation tasks, such as video and high-resolution 3D asset generation. However, existing methods can degrade generation quality and fidelity at high sparsity levels. Through controlled oracle comparisons, we trace this degradation to three sources: constraints imposed by token grouping, inaccurate interaction selection, and the attention contributions lost when tokens are discarded. Guided by this analysis, we propose Meta-Cached Sparse Attention (MC-Sparse), a training-free framework that selects individual key-value (KV) tokens while organizing similar queries into tile-aligned groups for efficient GPU execution. MC-Sparse caches metadata comprising query groups, KV indices selected using exact attention probabilities, and residuals between dense and sparse attention outputs, and reuses them across subsequent denoising steps. Across video and 3D generation models, MC-Sparse achieves higher fidelity to dense-attention outputs and larger denoising speedups than existing sparse-attention baselines, without visible quality degradation. Relative to dense attention, it delivers a $1.80\times$ denoising speedup on Minimax-H3-Base and a $2.32\times$ speedup on 3D asset generation, both with negligible quality loss.

[149] Less Context, Better Geometry: Masked Geometric Encoder for Robust 3D Foundation Models cs.CVPDF

Zhimin Shao, Xijun Liu, Zhaoliang Zhang, Yutao Tang, Abhay Yadav

TL;DR: Masked Geometric Encoder训练时随机丢弃全局注意力中的部分帧token，并向完整上下文教师蒸馏，以增强单帧几何表示对遮挡和外观相似干扰视角的鲁棒性；推理时再用锚点引导自适应token合并，减少冗余视图计算。

Details

Motivation: 3D基础模型的全局全连接注意力有二次复杂度，会限制长序列推理；不受约束的跨视图交互还可能把遮挡或外观相似但几何距离很远视角中的噪声传播开来。作者希望在不损害常规表现的前提下，提升不完整跨视图上下文下的稳健性和推理效率。

Result: MGE训练时从全局注意力中策略性丢弃帧token，并从预训练的完整上下文教师模型蒸馏，配合中间监督，使模型学习更丰富的逐帧表示且避免性能下降。实验报告该表示在遮挡和“doppelganger”视角下表现更强，并保持标准基准上的高表现。推理阶段提出Anchor-Guided Adaptive token merging，保留代表性锚点帧并联合合并其他视图的冗余token；相较其他高效推理方法，在保持更高重建质量的同时加速，有限视角场景优势尤其明显。摘要未给出具体数值。

Insight: 训练期学会在缺失部分全局上下文时仍保留有效单帧几何信息，使推理期更积极地合并冗余token成为可能。摘要给出的主要是定性结论，未报告具体速度或重建指标，因此无法量化效率/质量折中。

Abstract: Recent progress in 3D foundation models has enabled rapid 3D reconstruction and camera calibration by leveraging learned 3D priors from vast amount of spatial data. However, the all-to-all global attention design leads to quadratic complexity and limits long-sequence inference; unconstrained cross-view interactions also can propagate unreliable evidence from occluded or visually similar but geometrically distant views. In this paper, We introduce a Masked Geometric Encoder (MGE), which promotes the learning of robust geometric representations under incomplete cross-view context. During training, MGE strategically drops frame tokens from global attention and distills from a pretrained full-context teacher model. This allows the model to learn an intrinsically richer per-frame representation while providing sufficient intermediate supervision to avoid performance degradation. Through extensive experiments, we show that MGE leads to much stronger performance under occlusion and doppelganger views while retaining high performance on standard benchmarks. Such a richer frame representation also leads to more effective token reduction during inference. To this end, we develop a novel Anchor-Guided Adaptive token merging technique that preserves representative anchor frames while jointly merging redundant tokens from the remaining views. Compared to other efficient inference approaches, we can achieve inference speedup while consistently maintaining higher reconstruction quality, particularly in limited-view settings.

[150] Anatomy-aware Fine-grained Multimodal Fusion for Laryngopharyngeal Cancer T-Staging Prediction Using CT and Radiology Report cs.CVPDF

Xingyue Zhao, Yanzhou Su, Fang Zhang, Zhanghexuan Ji, Yirui Wang

TL;DR: 本文提出用于喉咽癌T分期的解剖感知多模态框架，结合CT器官级上下文与放射学报告：先构建解剖结构器官图，再对齐器官节点和文本证据，并用报告中的侵犯线索细化图表示。

Details

Motivation: 喉咽癌T分期对个体化治疗重要，但CT分期受肿瘤侵犯模式复杂影响。已有方法要么对整个CT体积建模而缺少肿瘤相关解剖约束，要么依赖耗时的肿瘤分割；同时，放射报告的器官级信息也难以通过全局特征融合准确对应到具体解剖结构。

Result: 方法包含三个阶段：Anatomy-Structured Organ Graph捕捉原发部位与周边器官的侵犯关系；Organ-Anchored Cross-Modal Alignment让每个器官节点聚合放射报告中对应的文本证据；Report-Enhanced Graph-Refinement再注入器官特异的侵犯线索，形成融合空间与文本证据的多模态器官图。摘要称在喉咽癌T分期实验中表现优越，但没有给出数据集规模或量化指标。

Insight: 以器官为锚点组织图结构和跨模态对齐，针对性解决了全局融合无法对应具体器官文本描述的问题，也避免把方法完全建立在人工肿瘤分割上。由于摘要未报告定量结果或数据集细节，此处不推断临床效能或推广范围。

Abstract: Accurate T-staging is crucial for guiding personalized treatment strategies for laryngopharyngeal cancer. However, current clinical practice relies on invasive biopsy procedures, whereas CT-based staging remains challenging due to the complex patterns of tumor invasion. Recent computer-aided approaches face two key challenges: 1) Structural relationship modeling: existing methods underrepresent anatomically structured patterns of tumor invasion, as they either process whole CT volumes without tumor-specific anatomical constraints or rely on labor-intensive tumor segmentation. 2) Fine-grained cross-modal alignment: while radiology reports contain organ-specific invasion details, current methods that apply global feature fusion struggle to accurately align individual anatomical structures with their corresponding textual descriptions. To address these issues, we propose an anatomy-aware multimodal framework that integrates organ-level CT context and radiology reports into a unified representation for laryngopharyngeal T-staging. The framework first constructs an Anatomy-Structured Organ Graph (AOG) that captures invasion patterns between primary sites and surrounding organs, then performs Organ-Anchored Cross-Modal Alignment (OCA) so that each organ node aggregates textual evidence from the radiology report, and finally refines this graph representation by injecting organ-specific invasion cues extracted from the report via Report-Enhanced Graph-Refinement (REG), yielding a multimodal organ graph that combines spatial and textual evidence. Extensive experiments demonstrate that the proposed framework achieves superior performance in T-staging of laryngopharyngeal cancer.

[151] Learning to Read the Contextual Tokens in Diffusion Transformers cs.CV | cs.AI | cs.GR | cs.LGPDF

Omer Dahary, Etai Sella, Hadar Averbuch-Elor, Daniel Cohen-Or, Or Patashnik

TL;DR: 本文训练轻量读取器，将多模态扩散Transformer中随去噪动态更新的文本上下文token映射到冻结LLM可读空间，以自然语言探查模型内部正在形成的图像语义；并据此提出Contextual Alignment训练方法，改善生成质量和分布覆盖。

Details

Motivation: 多模态扩散Transformer在生成过程中反复通过多模态注意力更新文本token，形成动态上下文表示，但这些token的作用尚不清楚。作者希望直接读取这些内部表示，理解生成语义何时出现、编码了什么，并探索能否把它们用作改进模型的训练信号。

Result: 研究训练一个瓶颈网络，将中间上下文token映射到冻结大语言模型的输入空间，使LLM能回答关于正在生成图像的问题。读取结果显示，这些token包含丰富的全局场景信息；提示词未明确的生成特定语义很早便可读，细节则随去噪逐步变得可读。即使输入为空提示，信息仍可解码，表明token也从演化中的视觉表示累积图像特定信息。上下文越可读的生成通常越受人类偏好。基于此提出Contextual Alignment，显式强化token所编码的视觉语义，改善生成质量和分布覆盖。

Insight: 文本上下文token不只是静态条件，而是随生成累积图像语义的可解释内部表征；对其进行自然语言探测既能分析生成过程，也可能成为训练目标。可读性与人类偏好是相关趋势，摘要并未给出相关强度或具体指标数值。

Abstract: Multimodal Diffusion Transformers (MM-DiTs) jointly process visual and textual representations throughout generation. These models repeatedly update the text tokens through multimodal attention, forming dynamic contextual tokens whose function is not well understood. In this work, we introduce a framework for reading this contextual space through natural-language interrogation. We train a lightweight bottleneck network that maps intermediate contextual tokens into the input space of a frozen Large Language Model (LLM), allowing the LLM to answer questions about the emerging image directly from these hidden representations. Our reader reveals that contextual tokens encode a rich, global representation of the emerging scene: generation-specific semantics, including attributes left underspecified by the prompt, are accessible surprisingly early in denoising, while increasingly fine-grained details become readable over time. Remarkably, this information remains decodable even when the MM-DiT receives an empty prompt, showing that contextual tokens accumulate substantial image-specific information from the evolving visual representation itself. We further find that generations with more readable contextual representations tend to receive higher human-preference scores. Building on these observations, we introduce Contextual Alignment, a training technique that explicitly reinforces the visual-semantic information encoded in the contextual tokens, improving generation quality and distributional coverage. Together, our results establish contextual tokens as both an interpretable view into the internal dynamics of MM-DiTs and an effective target for improving generative models.

[152] S2PD: Serial-to-Parallel Diffusion for Physically and Logically Consistent Video Generation cs.CVPDF

Jeffrey Hu, Daniel Olmeda Reino, Ayush Tewari

TL;DR: S2PD先在高噪声阶段用自回归扩散逐步协调事件和状态转移，再在低噪声阶段切换为全视频并行扩散以联合细化，从而同时提高规则遵循与采样效率。

Details

Motivation: 双向视频扩散模型可以并行去噪整段视频，但即使使用程序生成器提供的大量同分布训练数据，也可能违反物理规律和简单符号规则。完全串行生成能进行逐步协调，却会牺牲采样速度。作者希望结合两种计算方式的优势。

Result: Serial-to-Parallel Diffusion在高噪声时先做自回归扩散，提供协调相互依赖事件和有效状态转移所需的串行计算；低噪声时切换为并行扩散，对整段视频联合细化。作者实现了从头训练的像素空间扩散Transformer，以及通过LoRA和因果注意力适配的预训练视频模型。在游戏、物理模拟和真实视频任务中，相较匹配的双向基线更可靠地遵循规则；相较其他串行方法，时间稳定性和采样效率更好。摘要未提供具体数值。

Insight: 串行推理与并行细化无需二选一：把协调事件所需的串行计算放在高噪声阶段，能在低噪声阶段利用并行计算加速。现有摘要支持多个任务类型上的定性结论，但没有量化规则准确率或速度差异。

Abstract: Bidirectional video diffusion models denoise entire videos in parallel, yet when trained on effectively unlimited in-distribution data from procedural generators, continue to violate physical laws and simple symbolic rules. We introduce Serial-to-Parallel Diffusion (S2PD), which performs autoregressive diffusion at high noise before switching to parallel diffusion at low noise. The autoregressive phase provides the serial computation needed to coordinate interdependent events and produce valid state transitions while the parallel phase jointly refines the entire video and reduces sampling time relative to fully serial generation. We implement S2PD with two architectures: a pixel-space diffusion transformer trained from scratch and a pretrained video model adapted through LoRA fine-tuning with causal attention. Across games, physical simulations, and real video, S2PD follows rules more reliably than matched bidirectional baselines and generates videos with greater temporal stability and sampling efficiency than other serial methods.

[153] One Figure, Every Canvas: Editable Flowchart Relayout via Agentic Pipeline cs.CV | cs.AIPDF

Shih-Chen Tseng, Chih-Hsuan Chen, Ryan Yang, Hsi-An Chen, Chun-Wei Tuan Mu

TL;DR: 本文把流程图的目标纵横比自适应重排定义为保持结构忠实、无幻觉且可编辑的任务，并提出Parse、Style、Layout三阶段智能体流水线；在100张流程图、5种比例的基准上，内容忠实度为68.6%，高于既有方法的11.2%–41.4%。

Details

Motivation: 机器学习论文中的流程图需要被改成论文栏、宽屏幻灯片、竖版海报和手机预览等多种画布，但图形重排不能默默破坏计算图连线。图像生成方法可能拉伸模块，文本生成方法可能编造内容，解析后重绘方法则可能错误连接边。

Result: 提出由Parse、Style、Layout组成的智能体流程，每阶段均配置主智能体和批评器；批评器结合确定性约束检查与VLM视觉反馈，显式检查连接关系。输出为可在draw.io编辑的mxGraph XML。在包含100张流程图、覆盖五种目标纵横比的精选基准上，经Gemini 3.1 Pro评估并用人工判断验证，方法的内容忠实度为68.6%，此前方法为11.2%–41.4%。

Insight: 将结构解析、视觉风格和布局分阶段处理，并让机器约束检查与视觉反馈共同审查连线，有助于降低重排时静默改错方法图的风险。评估基于精选的100张流程图和特定评审流程，不能直接代表所有图表类型。

Abstract: Pipeline figures in ML papers must be repurposed across many canvases, including paper columns, 16:9 slides, portrait posters, 1:1 social teasers, 9:16 phone previews. Each format imposes a different aspect ratio on the same computational graph, where any silently broken connection misrepresents the method. We formulate aspect-ratio-adaptive flowchart relayout as a distinct task: given a raster flowchart and a target ratio, produce a structurally faithful, hallucination-free, editable layout. Existing methods fail characteristically: image-to-image models stretch blocks and reject extreme ratios, text-to-image agentic systems hallucinate content, and parse-then-render systems mis-route edges. We propose an agentic pipeline factored into Parse, Style, and Layout stages, each pairing a main agent with a critic that combines deterministic constraint checks with VLM visual feedback so connectivity is explicitly checked and prevented from being silently broken. Outputs are draw.io-editable mxGraph XML. On a curated benchmark of 100 flowcharts at five aspect ratios, evaluated by Gemini 3.1 Pro and validated against human judgments, our method reaches 68.6% Content Fidelity versus 11.2-41.4% for prior work. Project page: https://onefigureeverycanvas.vercel.app/

cs.CL [Back]

[154] General Decision Models: Benchmarking and Insights Beyond Jev cs.CLPDF

Feiyu Duan, Jiayu Lin, Jia Wang, Jun Xiang, Jialiang Wu

TL;DR: 构建双语决策模型基准JEVal，比较结构化决策模型与生成式LLM，并提出把推理蒸馏为单次首token输出的InnerJev。

Details

Motivation: 高效决策模型适于结构化判断，但其可靠决策范围及局部决策组合成长期系统后的行为尚不清楚。

Result: JEVal含36个数据集的11,257个实例、覆盖10个领域，评估25种模型配置。决策模型在信息足以直接判断的任务上竞争力较强，但专家知识与不确定性估计较弱，常高估最可能结果概率；τ-bench长时交互中，较快局部决策虽缩短中位耗时，却因错误累积降低任务成功率。社会模拟中其单次响应预测接近强LLM且成本更低，但用户画像较弱、总体估计误差与偏见更大。InnerJev通过推理到读出的自蒸馏把开源LLM推理内化为单次首token决策；InnerJev-27B在JEVal上与Jev相当，典型查询约0.1秒。

Insight: 局部判断速度和系统级可靠性不能互相替代，长时交互尤其会放大决策错误；单次读出可提供低延迟，但复杂画像和群体估计仍弱。

Abstract: General decision models, such as Jev, have recently emerged as efficient alternatives to LLMs for structured judgment and selection. But what kinds of decisions can these models reliably make, and how does their behavior change when individual decisions are composed into larger systems? To study this, we introduce JEVal, a bilingual benchmark comprising 11,257 instances from 36 datasets across 10 application domains, and evaluate 25 model configurations spanning general decision models and generative LLMs. Our results show that (1) general decision models are most competitive when decisions can be resolved from available evidence, but weaken when they require specialist knowledge or faithful uncertainty estimation: they can often identify the most likely outcome while substantially overstating its probability. (2) In more dynamic and realistic systems involving long-horizon, multi-step interactions, the advantages of fast local decision making are offset by reliability failures at the system level. on $τ$-bench, faster local decisions reduce median episode time but lower task success as decision errors accumulate over long trajectories. (3) In large-scale social simulation, decision models approach strong generative LLMs on individual response prediction at substantially lower inference cost, yet remain weaker in user profiling and exhibit larger aggregate estimation errors and systematic bias. Finally, we propose InnerJev-4B and InnerJev-27B, which internalize an open-weight LLM’s own reasoning into a single-pass first-token decision through Reasoning-to-Readout Self-Distillation, with InnerJev-27B performing on par with Jev on JEVal while answering a typical query in about 0.1 s.

[155] SYNLAT: Syntax-Aligned Text-Latent Compression for Chain-of-Thought Reasoning cs.CL | cs.AIPDF

Yifeng Zhao, Hongjun Yu, Shibo Wang, Yunjiao Zhou, Zixiao Zhu

TL;DR: 提出SynLat，依据句法边界把长思维链切分为不重叠单元，并训练单一学生按压缩级别混合保留文本与潜在表示。

Details

Motivation: 长思维链token开销大，压缩需保留答案关键内容；token级或固定长度边界会切断短语和推导，推理步骤级边界又可能把需要不同压缩方式的内容绑在一起。

Result: SynLat用句法对齐单元SAU设定压缩边界，由以答案为条件的教师构造渐进KEEP/LATENT目标，单一学生推理时只需问题和目标压缩等级。在两种Qwen3学生规模、Standard-CoT与Long-CoT组及三个压缩等级上，按论文报告的实际压缩率选择协议，12个任务组汇总中与最强基线持平或更优，11项严格领先。Qwen3-8B/14B在MEDIUM分别提高最多3.6/2.6分，HIGH提高7.0/5.5分；压缩越强、Long-CoT组优势越明显。

Insight: 用句法单位保留连贯语义边界，可在更高压缩率下维护推理信息；结果按实际压缩率筛选，比较需结合该选择协议。

Abstract: Long chain-of-thought (CoT) traces impose substantial output-token costs. Under constrained budgets, compression must preserve answer-critical information, making boundary placement central. Token-level and fixed-length boundaries can fragment coherent spans such as phrases, formulas, and local derivations, whereas step-level boundaries can bind content requiring different compression actions. We introduce SynLat, a text-latent CoT framework that aligns compression boundaries with syntactic structure through non-overlapping Syntax-Aligned Units (SAUs). An answer-conditioned Teacher constructs progressive KEEP/LATENT targets for a single compression-conditioned Student, which generates mixed reasoning from only the question and requested compression level at inference. Across two Qwen3 Student scales, Standard-CoT and Long-CoT groups, and three compression levels, SynLat matches or exceeds the strongest evaluated baseline in all 12 task-group aggregates and strictly leads in 11 under the reported achieved-CR selection protocol. Overall gains reach 3.6/2.6 points at MEDIUM and 7.0/5.5 points at HIGH for Qwen3-8B/14B, with larger advantages under stronger compression, particularly on Long-CoT groups.

[156] When Evidence Changes: Evaluating Memory Repair and Re-reading in Language-Model Agents cs.CLPDF

Wenhui Chu

TL;DR: 提出证据修订评估，比较语言模型代理在临床记录来源被撤销或替换后重读证据与修复记忆的全流程成本。

Details

Motivation: 支持代理结论的文档被撤销或替换时，系统应重读当前证据还是修补记忆；只看单次检索或修复成本会忽略后续使用开销。

Result: 作者在公开ICU记录的用药和问题清单任务上，对两个7B模型比较完整/来源筛选重读、缓存、重建及图局部修复，覆盖撤销、替换与控制事件；记忆全量提供而不检索，成本包含摄取、修订和每次使用。短记录上局部修复比重建少用5至10倍修订token，但留出条件下所有记忆管线成本至少为完整重读两倍。小规模预先设定开发扫描中，加入不符合任务的文档将记录扩展至约10,000 token；此长度下部分截断提取使记忆在2至14次使用后平均累计成本低于完整重读，而来源筛选重读仍最低。替换研究四项主要确认检验均未达统计显著。

Insight: 评估记忆必须覆盖证据更新后的整个流水线，并与来源筛选重读比较；当前替换情形证据未达显著，短记录下记忆方案成本较高。

Abstract: When documents supporting an agent’s derived facts are revoked or replaced, should it repair memory or re-read current evidence? We introduce an evidence-revision evaluation on medication- and problem-list tasks from public ICU records. Under revocation, replacement and control events, we compare full and source-filtered re-reading with caching, rebuilding and graph-local repair across two 7B models. Memory is supplied in full without retrieval, and costs include ingest, revision and every use. On short records, local repair uses 5-10$\times$ fewer revision tokens than rebuilding, yet every memory pipeline costs at least twice full re-reading in held-out conditions. In a small pre-specified development sweep, adding task-ineligible documents extended records to about 10,000 tokens; at that length, memory’s mean cumulative cost fell below full re-reading’s after 2-14 uses, partly through truncated extraction, while source-filtered re-reading remained cheapest. In the replacement study, none of the four primary confirmatory tests reached statistical significance. These results show why the cost of agent memory after evidence revision must be assessed against source-filtered re-reading over the full pipeline.

[157] IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation cs.CLPDF

Jiarui Liu, Renjie Tao, Yiwei Liao, Chuanyang Jin, Kai Sun

TL;DR: 提出IdeaScientist多代理科学构思系统，将研究空缺识别、跨领域创新迁移和提案撰写拆分为强化学习训练的角色。

Details

Motivation: 自动化科研仍难生成有前景且有依据的方案；作者利用一个领域已解决的问题机制可能启发另一领域挑战的思路，将科学选题与方案构思作为独立任务。

Result: 系统由识别相关工作局限、从类比问题提取解决机制、整合成完整研究提案三个角色组成，并构建含277万条分解研究想法的Svalbard Idea Vault用于检索、训练及时间控制评估。评测限制系统只能访问截止日期前文献，再与人类后来在15,000篇论文中探索的方向比较。Qwen3.6-27B上，IdeaScientist较最强开源自动科研基线高14%，主要来自新颖性提升；在该27B骨干上也比Claude Code SDK（Claude-4.8-Opus）及Codex SDK（GPT-5.4）高最多5.9%。

Insight: 分解角色并跨领域检索类比可以提升科学提案的新颖度；与后续论文方向的对齐是研究价值代理指标，不等同于真实科研效用。

Abstract: Despite rapid progress in automating scientific research, generating promising and well grounded research solutions remains a central challenge. We isolate research ideation as a standalone task and build our solution on the intuition that a challenge in one field can often be addressed by a mechanism that solved an analogous challenge in another. Accordingly, we introduce IdeaScientist, which decomposes ideation into gap finding, innovation, and report writing, and trains each role with reinforcement learning. These roles identify limitations in related work, draw solution intuitions from analogous problem settings, and develop those intuitions into complete research proposals. To facilitate discovery of insights across domains, we construct the Svalbard Idea Vault, a corpus of 2.77M decomposed research ideas for retrieval, training, and temporally controlled evaluation. Our evaluation restricts access to literature available before a cutoff date and assesses how closely proposed directions align with those later explored in 15K papers authored by human researchers. On Qwen3.6-27B, IdeaScientist outperforms the strongest open-source autoresearch baseline by 14.0%, driven mainly by gains in novelty. On this 27B open backbone, IdeaScientist even outperforms Claude Code SDK with Claude-4.8-Opus and Codex SDK with GPT-5.4, by up to 5.9%.

[158] LongSocialBench: Do Long-Context LLMs Understand Online Discussion Threads? cs.CLPDF

Xinyi Liu, Rinat Khaziev, Dilek Hakkani-Tür, Tarek F. Abdelzaher

TL;DR: 提出LongSocialBench，评测长上下文模型对在线讨论回复树中社会关系、论点转折和跨分支差异的理解。

Details

Motivation: 把整段长讨论输入模型并不等于理解其社会结构；模型需跟踪父子回复、转折点、子树范围、跨分支比较及参与者观点轨迹。

Result: 基准含来自Hacker News、Stack Exchange和Reddit ChangeMyView的94个完整讨论，共1,462道经验证人工多选题，讨论长度中位数约73K token。18个模型和29种设置均远低于人类表现；最佳Claude-Opus-4.7在先排除错误选项的提示下达63.0%，独立人类读者为72.4%。18模型全上下文基线平均43.9%；直接提供金标准证据范围可提升至55.0%，说明定位到相关讨论区域后仍有大量错误。

Insight: 长讨论理解的瓶颈不只是上下文窗口或提示方式，还包括结构化回复树上的社会推理；提供证据范围虽有帮助但无法消除误判。

Abstract: Long-context LLMs can now ingest entire online discussion threads, but understanding their social discourse requires more than reading a long document: models must track parent-reply relations, turning points, scoped subtrees, cross-branch contrasts, and participant trajectories. To test this structure-aware social reasoning, we introduce LongSocialBench, a benchmark of 1,462 verified human-authored multiple-choice items drawn from 94 complete Hacker News, Stack Exchange, and Reddit r/ChangeMyView episodes, with a median length of approximately 73K tokens. Each item pairs a complete serialized discussion and reply structure with a four-option question, requiring models to recover structured social evidence. Released items are verified for answerability, option uniqueness, and evidence grounding. Across 18 models and 29 evaluation settings, current long-context workflows remain far below human performance. The best individual result comes from Claude-Opus-4.7, which reaches 63.0% when prompted to eliminate incorrect options before answering, compared with 72.4% for independent human readers. Averaged across all 18 models, the full-context Baseline scores 43.9%. Supplying the gold evidence scope raises this to 55.0%, showing that substantial errors remain even after the relevant thread region is identified. LongSocialBench shows that the missing capability is not context access or prompting alone, but social understanding over structured reply trees.

[159] Representation-Aligned Auxiliary Supervision for Language Model Adaptation cs.CL | cs.LGPDF

Kyuyoung Kim, Peiyao Sheng, Ashwin Hebbar, Peiyang Xu, Yunfei Xie

TL;DR: 提出表征对齐辅助监督，用模型能处理的兼容表示完成环境派生任务，以改善结构化领域适配。

Details

Motivation: 语言模型虽具推理能力，但适配结构化领域结果不稳定；即使语义等价，模型也可能因输入表示不同而有截然不同的处理及泛化效果。

Result: 作者在国际象棋这一语义精确且可计算最优行动的领域比较FEN符号编码和ASCII空间表示。加入以兼容表示书写的环境派生辅助任务后，在相同目标数据量下，各模型和表示的最优着法预测均比仅目标训练提升。揭示环境动态的任务收益比表面或静态监督更大且更稳定，效果可与显著扩增目标数据竞争。ASCII训练向FEN迁移比反向更好，甚至超过FEN仅目标基线；增益还扩展到开放式事实性棋局解说。

Insight: 辅助监督必须考虑模型实际处理不同输入编码的兼容性；环境动态任务尤其有效，且表示迁移存在明显方向不对称。

Abstract: Language models exhibit strong reasoning capabilities, yet adapting them to structured domains remains challenging and can yield inconsistent outcomes. We identify representation compatibility, the extent to which a model effectively processes a representation for a structured task, as a key factor in adaptation. We study this in chess, which provides a controlled testbed with precise semantics, computable optimal actions, and multiple state representations, including a symbolic encoding (FEN) and a spatial format (ASCII). We find that models often process semantically equivalent inputs substantially differently, affecting both learning and generalization. Building on this observation, we propose representation-aligned auxiliary supervision, which uses environment-derived tasks expressed in compatible representations to improve adaptation to structured domains. Across models and representations, auxiliary supervision consistently improves optimal-move prediction relative to target-only training under identical target data. Tasks that expose environment dynamics provide larger and most consistent gains than surface-level or static supervision, while remaining competitive with substantially increasing the amount of target-task data. Moreover, ASCII-trained models transfer more effectively to FEN than FEN-trained models do to ASCII, even surpassing the FEN target-only baseline on FEN evaluation. The gains also extend beyond optimal-move prediction to open-ended, factually grounded commentary generation. Overall, our results show that auxiliary supervision in model-compatible representations can enable effective adaptation in structured domains.

[160] PB-GRPO: Learning Socially Adaptive LLM Agents from Persona-Driven Simulation with Preference-Batched GRPO cs.CL | cs.AIPDF

Jingquan Wang, Jun Yin, Xu Han, Yongsheng Mei, Jie Hao

TL;DR: 提出偏好分组GRPO，用相近偏好的模拟用户桶内归一化优势，训练能随对话适应用户的LLM代理。

Details

Motivation: 社会能力不仅是回答正确，还需推断用户未明说目标、尊重偏好并随多轮对话调整；真实互动稀缺且偏好通常不可直接观察。

Result: 作者基于包含人格库、LLM用户模拟器及0至1满意度评分的社会模拟环境，提出PB-GRPO，以偏好相似用户组内估计的归一化计算策略优势，稳定多样社会人群上的训练。模拟环境实验表明，相比标准GRPO及强强化学习基线，PB-GRPO提升模型社会行为。

Insight: 按相似偏好用户分组可降低异质用户混合带来的训练波动；实证依赖模拟用户与满意度评分，现实多轮互动验证未在摘要中报告。

Abstract: Building LLMs that behave well socially, not merely correctly, requires Building LLMs that behave well socially, not merely correctly, requires more than producing locally helpful responses. A socially competent agent must infer users’ unstated goals, respect their preferences, and adapt as the conversation unfolds. These behaviors are inherently multi-turn and social, making them hard to optimize: real interaction data is scarce, and user preferences are typically latent rather than directly observable. To address these challenges, we build on a persona-driven social simulation environment (consisting of a persona library, LLM-based user simulators, and a user-satisfaction scoring system ranging from [0, 1]), to introduce preference-batched GRPO (PB-GRPO), a post-training algorithm that learns socially adaptive policies from conversation-level feedback. Compared to vanilla GRPO, PB-GRPO computes advantages using a normalization estimated across a bucket of users with similar preferences, stabilizing training across a diverse social population. Empirical evidence shows that PB-GRPO improves models’ social behavior over strong reinforcement learning baselines in our simulated environment.

[161] Trajectory-Derived Confidence for Reliable, Resource-Aware Clinical Text-to-SQL Agents cs.CL | cs.AI | cs.LGPDF

Mincheol Daniel Song, Joshua Ward, Jake Jung, Guang Cheng

TL;DR: 提出Sentinel轨迹置信度层，在临床文本到SQL代理启动、中途运行及交付前三个节点决定拒答或停止。

Details

Motivation: 临床SQL代理多步自主推理，却不能判断自身推理和查询结果是否可信；错误会带来临床风险和浪费计算，错误轨迹的资源开销也是可靠性问题。

Result: Sentinel以分类器分析推理、代码和数据库结果，在不可回答问题运行前拒答、运行中止损以及交付时扣留不可信答案。按EHRSQL可靠性分数及Chow规则优化，低错误代价设置下分数从+0.08升至+0.24，优于全部拒答的+0.03；交付准确率从54%升至69%，覆盖率由84%降至55%。高风险下代理很少可靠到可交付，Sentinel自动降至+0.03，而未监控代理为-3.02。低风险仍答题时，代理步骤减少13%至28%，可靠性损失很小或没有。

Insight: 按置信度分阶段停止可同时控制答案错误风险和计算开销；准确率提升伴随覆盖率下降，需按临床错误代价设定门槛。

Abstract: LLM agents for clinical text-to-SQL applications reason autonomously over multiple steps but cannot assess whether their own reasoning or outputs can be trusted. In high leverage applications such as healthcare, this presents a critical risk where system mistakes can be costly. These reliability failures are also resource failures: an incorrect reasoning trajectory spends computation budget on outputs that must be discarded. We introduce Sentinel, a trajectory-derived, classifier-based confidence layer that analyzes an agent’s reasoning, code and database outputs to decide at three points whether to stop: refusing unanswerable questions before the agent runs, halting doomed trajectories mid-run, and withholding untrustworthy answers at delivery. Here, utilizing Chow’s rule, we optimize decisions under the EHRSQL shared task’s Reliability Score, which penalizes incorrect answers given a utility weighting, and find on the benchmark EHRSQL that Sentinel raises this score from +0.08 to +0.24 when mistakes have a low utility weighting, well above the +0.03 earned by refusing every question, with delivered-answer accuracy rising from 54% to 69% as coverage falls from 84% to 55%. At higher stakes the agents we test rarely answer reliably enough to deliver, and Sentinel detects this on its own, abstaining to that same +0.03 where the unmonitored agent scores -3.02. The same stopping decisions cut computation: at low stakes, where the system still answers, Sentinel eliminates 13-28% of agent steps at little or no reliability cost.

[162] AI-Enabled Quality Assurance for Multiple-Choice Assessment Items cs.CL | cs.AI | cs.CYPDF

Steven Moore, Nicholas Diana

TL;DR: 系统回顾选择题质量自动保障方法，提出按检测、修订、心理测量筛查及基准审计等独立决策进行验证。

Details

Motivation: 大规模生成选择题越来越容易，但题目是否具备评估质量仍难保证；自动检错、修订和心理测量筛选证据及参考标准不一致。

Result: 叙述性综述全文分析14篇研究，区分表层检查与内容敏感判断，将19项质量标准映射至检测方法及已报告证据。综述发现标签级准确率高可能同时伴随正例检出弱；量表定义和参考标准差异明显，修订效果证据混合，已有相关性结果不能证明修复的因果作用。作者建议将质量保障视为一系列独立验证决策，逐项报告标准、校准人工复核，并以修订后的结果评价实际效果。

Insight: 质量保障应报告哪些缺陷被实际检出及修订是否改变了题目效果，不能只凭总体准确率或相关性推断有效；本文为综述和评估建议而非新系统实验。

Abstract: Generating multiple-choice questions is increasingly scalable, but establishing their assessment quality remains difficult. We present a focused narrative review of automated item-writing flaw detection, revision, psychometric screening, and NLP benchmark auditing. Database searches, citation retrieval, and nominated sources yield fourteen research reports reviewed in full text. We distinguish surface checks from content-sensitive judgments and map a 19-criterion rubric to detection methods and reported evidence. High label-level accuracy often coexists with weak positive case detection, while rubric definitions and reference standards vary. Revision evidence is mixed, and the associations reported in prior work do not establish the effects of repair. We propose evaluating quality assurance as a sequence of independently validated decisions, with criterion-specific reporting, calibrated human review, and outcome-based assessment of revisions.

Lingzhe Zhang, Yunpeng Zhai, Tong Jia, Kening Zheng, Chiming Duan

TL;DR: 利用隐藏身份社交推理游戏研究强化微调对LLM社会推理和影响能力的作用。

Details

Motivation: 强化微调逐渐用于模型与人及其他代理互动，但终局胜负奖励是否能教会隐藏身份推理、社会解读和投票引导尚不清楚。

Result: 作者让微调模型与基座模型玩隐藏角色游戏。仅优化最终输赢未能可靠学得社会推理，说明终局信号稀疏且噪声大；RFT尤其提升从公开讨论推断身份、随时间更新信念及预测他人决策的社会阅读能力。行为特定奖励和结构化互动可提升引导投票、团队批准与集体决策的社会影响能力；将社会阅读和影响信号用于同阵营多代理训练还能进一步提升游戏表现。人评认为学习后战略能力、说服力与社会效用更好。

Insight: 社会技能可拆成阅读与影响两类行为信号训练，终局胜负本身不足以提供可靠信用分配；影响能力收益更依赖行为特定奖励和结构化互动。

Abstract: Reinforcement fine-tuning (RFT) is increasingly used in applications where large language models (LLMs) interact with humans and other agents. Here we use social deduction games to study how RFT changes LLMs’ social behaviour. We let fine-tuned and base LLM agents play hidden-role games that require hidden-state inference, social reading and vote steering. Our results show that LLM agents do not reliably acquire social-deduction ability by directly optimizing terminal win–loss outcomes, suggesting that final game results provide a sparse and noisy signal for socially interactive learning. However, RFT is particularly effective at improving social reading, including tasks that require agents to infer hidden roles from public discussion, update beliefs over time and predict other agents’ future decisions. We further show that RFT can also improve social influence, including tasks that require agents to steer votes, team approvals and collective decisions, although these gains depend more strongly on behaviourally specific rewards and structured interaction settings. Finally, we show that LLMs’ ability to play social deduction games can be further improved through multi-agent social-cognitive reinforcement fine-tuning, which combines social-reading and social-influence signals during same-side multi-agent training. These learned behaviours also receive more favourable human evaluations of strategic competence, persuasiveness and social usefulness. Together, these results enrich our understanding of how RFT changes LLMs’ social behaviour and provide a step toward a behavioural learning theory for machine social intelligence.

[164] Understanding and Mitigating Hallucination Escape in Tool-Using LLM Agents cs.CL | cs.AIPDF

Peigui Qi, Kunsheng Tang, Yide Song, Weiming Zhang, Nenghai Yu

TL;DR: 提出免训练推理方法EscapeGuard，利用配置冲突感知门控和配置导出的注意力增强，缓解工具调用幻觉逃逸。

Details

Motivation: 既有工具幻觉缓解方法常只在调优所用工具配置上有效，换配置后幻觉反而增加，抵消收益；作者将此称为幻觉逃逸。

Result: 分析发现，当模型内在工具使用偏好与当前工具配置冲突时，幻觉会急剧上升，而已有方法可能强化这种偏好。EscapeGuard结合冲突感知门控与由当前配置导出的注意力增强，无需训练。在多个模型的六个基准上，工具选择幻觉减少9.0个百分点，跨配置均值幻觉减少23.7个百分点，配对查询净改善89.1%。

Insight: 评估应覆盖多个工具配置，避免只在单一配置验证；按冲突动态调节可同时压制幻觉及配置转移时的反弹。

Abstract: Large language models (LLMs) increasingly serve as autonomous agents that invoke external tools. However, this capability introduces tool hallucination, selecting incorrect tools or generating invalid calls. Existing mitigation methods report substantial improvements, yet we identify a previously overlooked failure mode that we term Hallucination Escape. These methods reduce hallucination on the tool configuration they are tuned on but increase it on other configurations, canceling out the gain. We further investigate this phenomenon and find that hallucination rises sharply when a model’s intrinsic tool-use tendencies conflict with the current tool configuration, and that existing methods reinforce rather than suppress these tendencies, which in turn contributes to hallucination escape. Building on these findings, we propose EscapeGuard, a training-free inference-time method that combines conflict-aware gating with configuration-derived attention enhancement to mitigate tool hallucination while preventing hallucination escape. Across six benchmarks on various models, EscapeGuard reduces tool-selection hallucination by 9.0 pp and suppresses hallucination escape, lowering the cross-configuration mean by 23.7 pp and achieving an 89.1% net improvement in paired-query evaluation. We hope this work can encourage evaluation beyond a single tool configuration and pave the way for more reliable tool-using LLM agents.

[165] Correctness Is a Direction: Geometric Answer Selection in Language Models cs.CLPDF

Marcus Armstrong, Navid Ayoobi, Pradham Mummaleti, Alexander Chulzhanov, Arjun Mukherjee

TL;DR: 发现语言模型隐状态中可用无参数更新的几何方向表示答案正确性，并用少量标注候选对改进答案排序。

Details

Motivation: 模型输出概率对事实正确性的判别力有限；若隐状态包含比最终行为利用更多的正确性信息，可通过轻量几何读出改善候选选择与幻觉检测。

Result: 研究用约70%深度处、仅50个标注样例算出的错误到正确答案表示均值位移构建评分方向，跨Llama、Qwen、Gemma五个1B至8B模型，事实基准ARC-Challenge和MMLU比零样例对数概率高最多32.0个百分点，TruthfulQA高38.1至51.8点。推理时无需生成，仅一次前向和每候选点积；单问答幻觉检测AUROC为0.693，对数概率为0.578。事实推理、领域知识和校准真实性方向彼此近正交，方向跨同类任务迁移但不跨类型。

Insight: 正确性线索在表示中可恢复，输出校准失败可能是内部信号路由问题；方向需要少量目标任务标签，不同正确性概念不可简单共用。

Abstract: Answer correctness is encoded as a recoverable geometric direction in the hidden states of language models. We show that the mean displacement from incorrect to correct answer representations, computed at approximately 70% of model depth from fifty labeled examples with no parameter updates, yields a scoring direction that outperforms zero-shot log-probability scoring by up to +32.0 percentage points on factual benchmarks (ARC-Challenge and MMLU) and by +38.1 to +51.8 percentage points on TruthfulQA, across five models spanning 1B to 8B parameters in three architecture families (Llama, Qwen, Gemma). The method requires one forward pass and one dot product per candidate; no generation is performed at inference. Applied as a hallucination detector on individual (question, answer) pairs, the recovered direction achieves 0.693~AUROC versus 0.578 for log-probability scoring. We additionally find that correctness directions for factual reasoning, domain knowledge, and calibrated truthfulness are near-orthogonal in representation space, revealing that language models allocate geometrically independent subspaces to qualitatively distinct notions of correct answer, with architecture-dependent variation in the degree of separation. This structure explains the observed transfer pattern—the direction calibrated on factual questions transfers within task type but not across it—and suggests that LLM calibration failures may reflect a routing problem: the model’s internal representation contains more correctness signal than its output behaviour exploits.

[166] SIFT: Robust Meta-Faithfulness Verification of Chain-of-Thought Reasoning Under Distribution Shift cs.CL | cs.LGPDF

Noor Islam S. Mohammad, Md. Basim Al Zabir Shammo, Hasan Siddiki, Mahmudul Hasan, Md. Faisal Sheikh

TL;DR: 提出元忠实性原则与SIFT检测器，要求思维链忠实度判定在保持真值属性的变换下不变，并支持认证式弃答。

Details

Motivation: 思维链忠实性检测器自身也是预测器，其判断可能在分布变化或随机种子改变时不稳定；若检测器使用对保持忠实性的变换敏感特征，就会违反所需不变性。

Result: 作者证明仅凭干预—响应特征无法区分签名相同的忠实和伴生机制，且依赖分布敏感特征的检测器即便域内准确率高仍会违反不变性；提出渐近认证选择性风险界。FaithShift覆盖十种偏移轴；14,996条轨迹、四领域、八模型评估中，所有现有检测器跨域AUROC落差至少0.15。超过80%的检测不稳定来自随机种子而非偏移，否定预注册预测。SIFT较最佳单种子基线减少64%不变性违规，但任一检测器的四种子集成都将差距缩到0.01且在同覆盖率下不显著（p=0.21）；SIFT弃答率需51%。

Insight: 审计检测器需要测其自身稳定性；本研究显示采样方差比域偏移更主要，但SIFT仍以较高弃答换取不变性。

Abstract: Chain-of-Thought (CoT) faithfulness detectors are widely used to audit reasoning models, yet a detector is itself a predictor whose verdicts are treated as stable properties. We ask whether a detector is faithful to itself under distribution shift. We formalize meta-faithfulness as an invariance principle: a valid detector must return identical verdicts on traces that differ only by transformations preserving ground-truth faithfulness. We prove three results: (i) no detector using only intervention-response profiles can separate faithful from epiphenomenal mechanisms with identical signatures; (ii) any detector relying on shift-sensitive features violates invariance at a rate independent of its in-distribution accuracy; (iii) an asymptotic certified selective-risk guarantee enables confident abstention. We operationalize the principle in FaithShift, a stress-test protocol spanning ten shift axes, and propose SIFT, a hidden-state trajectory detector trained with cross-environment invariance objectives and certified abstention. Across 14,996 traces, four domains, and eight models, three findings emerge. First, transfer collapse is real: all existing detectors show gaps $\geq 0.15$ AUROC. Second, the dominant bottleneck is sampling stochasticity, not shift: over 80% of detector instability stems from random seed variation, falsifying our preregistered prediction that shift-attributable violations exceed 0.25. Third, SIFT cuts invariance violations by 64% over the best single-seed baseline, but a four-seed ensemble of any detector narrows the margin to 0.01 (indistinguishable at matched coverage, $p=0.21$), and SIFT needs a 51% abstention rate. Cross-model transfer degrades from within-family to cross-family to open-weight-to-API, partly closed by multi-model training. We offer a framework for auditing auditors: the real barrier is detector variance, not distribution shift.

[167] Stance Drift: How AI-mediated Communication Distorts Our Message cs.CL | stat.APPDF

Lingchong Liu, Yanfei Zhou, Jacob Bien, Y. X. Rachel Wang, Lucy Xia

TL;DR: 提出立场保持率SPR，量化两步LLM沟通链中的立场漂移，并分析极化、中性偏移及立场翻转。

Details

Motivation: LLM越来越多参与邮件起草、报告总结等人际沟通，但是否忠实保留说话者立场尚未系统检验。

Result: 作者将一LLM按指定立场生成论证、另一LLM从论证提取立场建模为五级Likert状态转移，并定义提取立场与初始立场一致的平均概率为SPR。在112个辩题、九个模型默认设置中，无一SPR超过0.7；主要漂移为极化、偏离中性和立场翻转。测试的上下文学习、选项打乱、多次提取、断言和反思等干预中，只有给GPT-5.4反思提示加入中等推理努力将SPR显著提升至0.775，但极化仍最大，占转移质量0.119。单一辩题的人类比较初步表明生成与提取两阶段均会漂移。

Insight: AI媒介沟通的立场保真是独立风险，推理增强可改善但未消除极化；人类对照只覆盖一个辩题，结论需进一步验证。

Abstract: Large language models (LLMs) increasingly mediate human communication, from drafting emails to summarizing scientific reports, yet whether they faithfully preserve a speaker’s position remains largely untested. We model AI-mediated communication as a two-step generation-extraction pipeline: one LLM produces an argument from a specified stance, and a second LLM extracts the stance from that argument. We represent the pipeline as a probabilistic state transition over five Likert-type stance categories and define the stance preservation rate (SPR) as the average probability that the extracted stance matches the initial stance. Across 112 debate propositions, none of the nine LLMs tested exceeded an SPR of 0.7 under the default configuration. Three drift patterns accounted for most of the drift: polarization, deviation from neutrality, and flipping. Among the mitigation strategies tested, including in-context learning, multiple extraction with shuffled options, assertion, and reflection, only adding medium reasoning effort to a reflection prompt for GPT-5.4 substantially improved the SPR, to 0.775, yet polarization remained the largest pattern, with 0.119 of the transition mass. An exploratory comparison with human extraction on a single proposition suggests that drift arises at both the generation and the extraction stage. These results point to a fidelity gap in AI-mediated communication, with implications for journalism, policy deliberation, scientific communication, and other domains where opinion-laden messages pass through language models.

[168] Viva La Vida: Verification and Accumulation Failures in Multi-Agent Proof Search cs.CL | cs.AI | cs.MAPDF

Benji Xu, Ken Zheng, Noah Han

TL;DR: 端到端审计多代理定理搜索系统的验证器失效与引理库污染，指出监督本身是无外部证明器时的信任边界。

Details

Motivation: 开放问题证明代理没有正式证明器兜底，验证器和引理库最终仍由LLM评价模型输出；系统需处理API/解析错误、验证器分歧及失败论证被积累为知识。

Result: 作者追踪三次完整运行（186小时、5,694美元）的51,754条观察。三模型全体同意的验证器在12次事件中有10次因成员无可解析输出或API错误而无法批准，却未显式呈现错误。验证器正常工作时，有一个模型批准了3个GPT拒绝且都声称解决开放问题，单验证器设计因此会宣布三次“解决”。由于无人能获批，每次审查都是反驳，但引理抽取仍从93条引理中把24条（26%）从失败论证提取出来并删除反驳语境。

Insight: 无外部验证时应区分弃权与否定、保留意见分歧，并记录知识来源和立场；对失败论证去语境会污染后续上下文。

Abstract: When an agentic prover works on an open problem, there is no proof assistant to fall back on: its verifier and lemma library are ultimately language models judging model outputs. We instrumented such a system end to end and analyzed $51{,}754$ traced observations across three full runs ($186$ hours, $$5{,}694$). We find three connected failure modes. First, the three-model verifier requires unanimity and treats parse or API failure as non-approval; in $10$ of $12$ verification events, one member returned no parseable output or an API error, making acceptance arithmetically impossible without surfacing an error. Second, when the ensemble did function, one verifier approved $3$ attempts that GPT rejected, each claiming to resolve the open problem; a single-verifier design would therefore have announced a solution three times. Third, because nothing could be approved, every review was a refutation, yet the lemma extractor mines reviews as well as proofs: $24$ of $93$ lemmas ($26%$) were extracted from rejected arguments with their refutational context removed. Taken together, these findings show that without external verification, supervision is itself a critical trust boundary: systems must distinguish abstention from rejection, preserve useful disagreement, and preserve the provenance and polarity of information before it becomes future context.

[169] Rewrite What Matters: Adaptive Multilingual Query Rewriting for Reasoning via Agentic Reinforcement Learning cs.CLPDF

Rui Qi, Yufeng Chen, Yunlong Liang, Chuan Meng, Sijin Lu

TL;DR: 提出mRewriter-R1，将多语言查询改写建模为强化学习驱动的多轮序列决策，并按查询特征自适应选择改写操作。

Details

Motivation: 语义相同但语言不同的查询会引导模型走不同推理路径；一刀切翻译式改写忽略不同查询可能需要不同语义变换。

Result: mRewriter-R1以代理式多轮流程动态选择多方面查询优化操作，并用强化学习训练。实验显示，在多种大型推理骨干上超过所有所比较多语言改写基线；分析表明策略能根据查询特点选择操作，泛化到不同推理任务，并可即插即用于异构推理语言模型。

Insight: 改写策略应由查询特征决定，而不是统一翻译；摘要未给出数据集、准确率提升及具体可选操作清单。

Abstract: In multilingual scenarios, queries with equivalent semantics but in different languages could guide the model into different reasoning trajectories, leading to performance disparities. To mitigate this gap, previous studies typically apply a one-size-fits-all query rewriting strategy, such as translation, which overlooks the fact that different scenarios require diverse types of semantic transformations. In this paper, we propose mRewriter-R1, an agentic multilingual query rewriting framework with reinforcement learning. Unlike single-turn rewriting, mRewriter-R1 formulates multilingual query rewriting as a multi-turn sequential decision-making process, where the model dynamically performs multi-aspect optimization through adaptive operator selection. Experimental results demonstrate that mRewriter-R1 outperforms all strong multilingual rewriting baselines on different large reasoning backbones. Further analyses show that the learned policy can adaptively decide on rewriting operators according to query characteristics, exhibiting strong generalization ability across diverse reasoning tasks, and plug-and-play compatibility with heterogeneous reasoning language models.

[170] TrajLong: Co-Designing Agentic and Long-Context Supervision for Mid-Training cs.CLPDF

Miao Peng, Qintong Zhang, Nuo Chen, Yuhan Li, Guochen Yan

TL;DR: 提出TrajLong，将代理交互轨迹编译为密集监督的长上下文中训练任务，联合提升证据定位、跨证据聚合和时间状态维护。

Details

Motivation: 编码、搜索和办公代理需要整合长交互历史；既有工作把代理轨迹用于中训练，但如何组织轨迹信息以有效监督长上下文与代理原子能力仍不清楚。

Result: TrajLong将轨迹转为三类能力任务：证据落地、跨证据聚合及时间状态维护。作者对Qwen3-14B-Base和Qwen3-30B-A3B-Base中训练后再监督微调，在六个长上下文和12个代理基准上取得广泛收益；受控消融优于原始轨迹及掩码轨迹基线。能力分析显示长上下文能力与代理原子能力的关联随任务而异。

Insight: 按下游能力结构化轨迹可为中训练数据设计提供依据；摘要未列具体基准提升数字。

Abstract: LLM agents for coding, search, and workplace tasks increasingly rely on long-context capabilities to effectively aggregate and reason over extended interaction histories. Recent work has incorporated agent trajectories into mid-training stage, drawing on their naturally long and interaction-rich structure. Yet how to organize the information within these trajectories into effective mid-training supervision remains underexplored. In this work, we investigate the relationship between long-context and agent atomic capabilities and introduce TrajLong, a novel framework that compiles trajectories into long-context training tasks with dense supervision, targeting three representative atomic capabilities: evidence grounding, cross-evidence aggregation, and temporal state maintenance. We mid-train Qwen3-14B-Base and Qwen3-30B-A3B-Base with data compiled by TrajLong, followed by supervised fine-tuning. Experiments on 6 long-context and 12 agent benchmarks demonstrate broad performance gains, with controlled ablations showing improvements over raw and masked trajectory baselines. Capability-level analyses further reveal task-dependent associations between long-context and agent atomic capabilities. These findings suggest that the shared capability demands of long-context reasoning and agent execution provide a principled basis for designing mid-training data to develop downstream agent capabilities.

[171] When LLMs Sit Above Diagnostic Tools: Unrealized Complementarity in Industrial Fault Diagnosis cs.CL | eess.SYPDF

Donghwan Kim

TL;DR: 评估LLM作为工业诊断工具集成层能否正确利用专用诊断信息，发现组合输出常低于更强的单一专用来源。

Details

Motivation: LLM可作为专用工具之上的集成层，但更强部件不必然形成更强系统；错误融合会推翻原本正确判断，并使诊断计算花在最终弃用结果上。

Result: 在轴承振动、过程监测和半导体设备五个数据集上，成对重复调用用于区分建议效果和输出不稳定。五个数据集中，冲突外部信息均可能推翻原本正确的LLM判断；四个可直接比较的数据集里，隐式集成均未持续胜过最强单源。预先固定协议的Tennessee Eastman确认集上，无辅助LLM准确率64.67%，集成77.43%，专家单独83.33%；专家使LLM提升12.8点，但融合仍比专家低5.9点。两源选择oracle达92.76%，显示潜在互补未被利用；融合漏掉专家295次纠正中的140次（47.5%），并丢失原本正确LLM判断99个中的15个（15.2%）。

Insight: 应分别评估信息来源质量与整合质量，并与更强的独立来源比较；提示、专家敏感性分析未消除此融合缺口。

Abstract: Large language models are increasingly used as integration layers above specialized tools, but a stronger component does not necessarily produce a stronger combined system. Across five diagnostic datasets (bearing vibration, process monitoring, semiconductor equipment), we study whether an LLM can reliably use external diagnostic information; paired repeat calls separate advice effects from output instability. In all five, conflicting external information overturned initially correct LLM judgments. Among the four datasets with direct integration comparisons, none showed a consistent advantage for implicit LLM integration over the stronger standalone source. On a Tennessee Eastman confirmation set whose protocol was fixed before evaluation, unaided accuracy was 64.67%, implicit LLM-specialist integration 77.43%, and the specialist alone 83.33%. Specialist information improved the LLM by 12.8 points (95% interval 9.7 to 15.9), yet the integrated output stayed 5.9 points below the specialist (95% interval -12.0 to -0.7). A two-source selector oracle reached 92.76%, indicating complementarity that the integrated output did not fully realize. The integrated output missed 140 of 295 specialist corrections (47.5%) but lost 15 of 99 initially correct LLM judgments (15.2%). The deficit remained under prompt and specialist sensitivity analyses. Among CWRU cases solved under both evidence presentations, task-aligned physical evidence yielded lower estimates of susceptibility to incorrect advice in six of seven models (five intervals excluding zero); higher reasoning effort gave no reliable reduction in five models, and a separate four-model TEP analysis gave no clear evidence that it resolves the integration problem. Source quality and integration quality should be evaluated separately: an integration layer should be compared with its stronger standalone component, not only with the unaided LLM.

[172] Causal Improvement Graph for Agentic Harness Optimization cs.CLPDF

Junjie Zhang, Shunyu Liu, Haoyu Wang, Ting-En Lin, Yongbin Li

TL;DR: 提出因果改进图CIG，将代理运行时harness优化中的实验状态持久化为证据、假设、干预和结果关系图。

Details

Motivation: 自动harness优化通常让提议LLM汇总累计实验并决定下一版修改，随着历史增长，提议器需自行维护迭代状态且难辨实验逻辑。

Result: CIG把观察、解释假设、检验干预和评测结果建为关联节点，结构化保留改进状态如何逐轮变化，使局部提议器能直接利用先前关系而不必从原始历史重建。多个代理任务实验中，CIG发现的harness强于既有元harness基线，并对任务求解器和提议器选择保持稳健；结构消融支持显式图状态的设计。

Insight: 把实验发现外化为因果改进状态，可减少提议器长上下文归纳负担；摘要未报告具体任务分数或提升幅度。

Abstract: Agentic Harness is the runtime that constructs task context and controls execution flow, thereby shaping overall agent performance. Given a fixed model and external evaluation, automated Harness optimization seeks to improve this runtime through an iterative proposal–evaluation loop to better solve target tasks. Existing meta-harness methods mainly adopt proposer-centric discovery, in which an LLM-based proposer integrates accumulated experimental findings to determine subsequent Harness revisions. This places the burden of maintaining the evolving improvement state on the proposer as history expands and its underlying experimental logic becomes harder to discern. In this paper, we introduce the Causal Improvement Graph (CIG), a graph-governed meta-harness framework that externalizes the evolving improvement state in a persistent graph, allowing prior findings to directly govern subsequent Harness optimization through local proposer operations. CIG grows and links Evidence, Hypothesis, Intervention, and Outcome nodes to represent what was observed, how it may be explained, how to test that explanation, and what the evaluation reveals. Their structural relations preserve how the improvement state changes across iterations, allowing local proposers to build directly on relations among prior findings rather than recover them from raw history. Across various agent tasks, CIG discovers stronger Harnesses than previous meta-harness baselines and remains robust to the choice of task solver and proposer. Structural ablations further support the design of an explicit improvement state with graph-governed evolution.

[173] How Much Do LLM-as-a-Judge Design Choices Matter? A Systematic Comparison of Prompt Designs, Rating Scales, and Models cs.CLPDF

Laurène Vaugrante, Thilo Hagendorff

TL;DR: 系统比较LLM评审器的提示、评分尺度和模型设计，量化这些选择对判断偏差及宽严度的影响。

Details

Motivation: 研究者常凭直觉选择LLM评审提示、量表与模型，没有通用设计标准；若这些配置改变结果，不同研究可能对相同事实得出不同结论。

Result: 研究评测10个推理模型，两类任务为句子情感/毒性1至7分（各类别500余项）及600组问答准确性二分类。评分任务中，尽管与人类真值有显著分歧，平均绝对偏差仅0.11分；毒性评审甚至优于标准分类器。准确性分类平均96.5%。设计会改变结果：仅改评分尺度可使测得偏差移动最多0.93分；详细提示令分类宽松度下降28.9个百分点，更换模型最多下降56.1个百分点，而准确率通常影响较小。反常的是，降低推理努力不影响准确率或宽严度；模型身份是两任务中最大方差来源。

Insight: LLM评审整体可用，但模型身份及提示/量表选择会带来实质方差，研究应固定并报告设计；证据来自情感、毒性和问答分类两类场景。

Abstract: Researchers increasingly use Large Language Models as judges (LLM-as-a-judge) to evaluate model outputs. Yet there are no standards for how to design these judges. Typically, researchers choose the prompt, rating scale, and model intuitively. If these choices change the judge’s verdicts, two studies can reach different conclusions about the same facts. To address this risk and to provide an empirical basis for judge designs, we evaluate 10 reasoning models across multiple designs on two tasks: a scalar rating of sentence sentiment and toxicity (over 500 items per category), as well as a binary accuracy classification of question-answer pairs (n=600). For the rating tasks, despite judges showing significant disagreements with the human ground truth, the practical size of differences is small enough to consider most judges reliable (mean absolute deviation of 0.11 points on a 1 - 7 scale); toxicity judges even outperform standard classifiers. Judges are also highly accurate on average (96.5%) for the accuracy classification task. However, design choices can produce shifts: changing the rating scale alone can shift measured bias by up to 0.93 points (rating task), and while accuracy levels are rarely impacted, design choices consistently impact judge leniency (classification task; leniency drop of 28.9 percentage points when using detailed prompts, and up to 56.1 percentage points when switching models). Counterintuitively, lower reasoning effort affects neither accuracy nor leniency. Across both tasks, model identity is the dominant source of variance. These findings suggest that while LLM judges are broadly trustworthy in aggregate, design choices can be meaningful sources of variance. Given the growing reliance on automated evaluation in LLM research, we intend this study as a methodological reference for designing more robust and replicable LLM-as-a-judge pipelines.

[174] Small Agents with Semantic Search: Efficient Multilingual Code Localization cs.CLPDF

Maxence Lasbordes, Aarush Sinha, Raphael Sourty, Amélie Chatelain, Djamé Seddah

TL;DR: 提出ColGREP工具与专用小型代理，将代码仓库自然语言文件定位改为语义检索并在CPU本地高效执行。

Details

Motivation: 代码代理需从自然语言需求中找到相关文件；若可由紧凑专用模型承担，便能降低大型代理的token、时延和推理成本，实现设备端搜索。

Result: 训练流程以ColGREP（基于晚交互检索的本地语义搜索）为核心，结合按检索结果给轮次奖励的加权教师轨迹微调和依据定位质量的强化学习。训练三个小于2B模型执行查询、检查检索内容并定位文件。在SWE-bench Lite及Multi-SWE-bench Flash派生任务上，ColGREP代理显著优于基座及对应GREP代理；CPU端到端轨迹平均延迟减少44.1%，token减少29.1%，且能迁移至微调中未见编程语言。

Insight: 小型工具专用代理可作为自然语言与大型代码库间高效接口；迁移证据来自所测基准和未见语言设置。

Abstract: Locating relevant files from natural-language requests is a core subtask for agents operating over code repositories. We investigate whether this task can be delegated to compact, specialized models to enable on-device search while reducing the token usage, latency, and inference cost of larger agents. We show that semantic search improves file localization, with gains in accuracy, cross-language transfer, and inference efficiency. To study this setting, we introduce a training framework for file-localization agents built around ColGREP, a local semantic search tool based on late-interaction retrieval models. Our recipe combines weighted supervised fine-tuning on teacher trajectories, assigning turn-level credit based on retrieval outcomes, with reinforcement learning on localization quality. We train three model families with fewer than two billion parameters to formulate search queries, inspect retrieved content, and identify relevant files. On localization tasks derived from SWE-bench Lite and Multi-SWE-bench Flash, ColGREP-equipped agents substantially improve over their base models and outperform corresponding GREP-based agents. In addition to improving localization accuracy, ColGREP reduces mean end-to-end trajectory latency by 44.1% on CPU while using 29.1% fewer tokens, and enables better generalization to programming languages unseen during fine-tuning. These results suggest that compact, tool-specialized localization agents can provide an efficient interface between natural-language requests and large codebases.

[175] Belief-Trajectory Energy: Measuring the Path to a Prediction cs.CLPDF

Jiahao Ying, Wei Tang, Boxian Ai, Yaoning Wang, Haotian Chen

TL;DR: 提出信念轨迹能量BTE，量化输入在Transformer各层诱发的预测修订过程，并用其作为任务难度和生成来源信号。

Details

Motivation: LLM层间会不断调整预测，但常规只观察最终输出，丢弃形成结论的内部演化轨迹。

Result: BTE把中间状态映射到共同预测空间，将逐层信念变化汇总为标量或深度剖面；理论上局部BTE对应Fisher–Rao几何下的预测修订，完整变化序列含初末差之外信息。标量BTE可作为多种推理任务的模型相对难度信号，丰富表征用于区分人工与LLM评审及细粒度生成器归因，最高达到宏平均AUROC 0.998和八类归因准确率95.6%。BTE在预训练中逐渐形成，并受目标训练选择性重塑。

Insight: 逐层预测轨迹提供模型相关的数据测量信号，未必等同于模型无关难度；高归因分数需结合特定域和模型范围理解。

Abstract: Large language models (LLMs) progressively revise their predictions across Transformer layers, yet we typically observe only the final output, discarding the trajectory through which it is formed. We introduce Belief-Trajectory Energy(BTE), a model-grounded measure that characterizes an input through the layerwise predictive revisions it induces in a model. By mapping intermediate states into a shared predictive space, BTE provides a principled measure of belief change that can be summarized as either a scalar or a structured depth profile. Theoretically, we show that local BTE corresponds to predictive revision under the Fisher-Rao geometry, while the sequence of revisions captures information beyond the initial-to-final belief change. Empirically, scalar BTE provides a model-relative signal of difficulty across diverse reasoning tasks, while richer BTE representations support human-LLM review detection and fine-grained generator attribution, reaching up to $0.998$ macro-AUROC and $95.6%$ eight-way attribution accuracy. Further analysis shows that BTE develops throughout pretraining and is selectively reshaped by targeted training, demonstrating that the resulting measurement reflects what the scoring model has learned. Together, our results establish belief trajectories as a principled model-grounded signal and suggest a broader perspective in which learned models can themselves serve as instruments for characterizing the data they process. More demonstrations can be found at https://yingjiahao14.github.io/BTE-web/.

[176] InstMoE: Adaptive Multimodal Routing with Specialized Experts cs.CLPDF

Guimin Hu, Xiang He, Yingjian Li, Zheng Lian, Boyan Xu

TL;DR: 提出InstMoE，根据输入动态路由到单模态和跨模态专家，并以对比语义对齐抑制无关模态变化干扰。

Details

Motivation: 多模态输入不仅模态不同，完成预测所需信息路径也随样本变化；模态特有的无关变化可能误导路由，把样本分配给不合适专家。

Result: InstMoE针对每个输入动态选择专门的单模态及跨模态专家，并引入对比语义对齐模块，使语义相似样本具有任务相关表示、压制无关模态变化。在多模态情感基准CMU-MOSEI与CH-SIMS v2达到当时最佳表现，且参数量显著低于有竞争力基线。不同样本呈现不同专家偏好，支持从固定融合转向自适应计算路径。

Insight: 样本级专家路由可匹配异质信息需求，对比对齐则减少表面模态变化造成的错路由；摘要未给出具体分数和参数差异。

Abstract: Multimodal inputs are inherently heterogeneous, not only across modalities but also in the information pathways required for effective prediction. To address this limitation, we propose InstMoE, an adaptive expert routing framework for multimodal learning. InstMoE dynamically routes each input to specialized unimodal and cross-modal experts, allowing the model to adapt its information pathways to the characteristics of the input. However, routing can be misled when modality-specific variations obscure task-relevant semantics. Such irrelevant variations may distort routing decisions, causing inputs to be assigned to inappropriate experts. We therefore introduce a Contrastive Semantic Alignment module, which encourages semantically similar inputs to share task-relevant representations while suppressing irrelevant modality-specific variations. Experiments on multimodal sentiment analysis benchmarks demonstrate that InstMoE achieves state-of-the-art performance on CMU-MOSEI and CH-SIMS v2 while using substantially fewer parameters than competitive baselines. Further analysis shows that different inputs exhibit distinct expert preferences, demonstrating that InstMoE moves beyond fixed fusion toward adaptive multimodal computation.

[177] RubricArmor: Adversarial Evolution Improves LLM-Based Rubric Generation cs.CLPDF

Haocheng Yang, Yuchao Zhang, Licheng Pan, Jiajun Fan, Maolin Wang

TL;DR: 提出RubricArmor，通过多轮对抗式攻击与修复，在评分细则生成阶段预先暴露并补齐奖励投机漏洞。

Details

Motivation: 基于评分细则的RL可提供可解释奖励，但LLM直接从查询生成的细则可能遗漏或模糊关键标准，使策略通过低质量答案骗取高奖励；现有生成方法注重覆盖度却未主动防投机。

Result: RubricArmor交替执行攻击和修复：攻击步骤生成满足当前细则却未真正完成任务的对抗回答，修复步骤据暴露缺陷修改评分细则并保留其他有效标准。实验显示该方法优于有竞争力的评分细则生成基线，并使后续基于细则的强化学习更有效。

Insight: 在奖励用于RL之前先通过对抗回答压力测试细则，可预防一部分奖励黑客；摘要未给出具体基准或量化增益。

Abstract: Rubric-based reinforcement learning (RL) provides interpretable rewards for aligning large language models (LLMs) by evaluating responses against query-specific evaluation criteria. To construct rubrics at scale, a straightforward approach to LLM-based rubric generation is to prompt an LLM to generate a rubric directly from the query. However, rubrics directly generated by LLMs are vulnerable to reward hacking, since omitted or underspecified criteria allow the policy to obtain high rubric rewards with low-quality responses. Existing LLM-based rubric generation methods improve the granularity and coverage of the generated criteria but do not proactively guard against reward hacking. To address this limitation, we propose RubricArmor, an adversarial framework that exposes and mitigates potential reward hacking at the rubric generation stage before it occurs in subsequent RL. Specifically, RubricArmor performs adversarial evolution, in which an attack step and a repair step alternate over multiple rounds. The attack step simulates the reward hacking of the policy by constructing adversarial responses that satisfy the current rubric but fail to properly complete the task. The repair step then revises the rubric to detect the response defects exposed by the attack step while preserving other valid criteria. Extensive experiments demonstrate that RubricArmor outperforms competitive rubric generation baselines and translates into more effective downstream rubric-based RL.

[178] Red-TTT: Test-Time Training for Automated Jailbreaking Large Language Models cs.CL | cs.CRPDF

Tongyan Hu, Hao Li, Xiaogeng Liu, Ruida Wang, Zhengyu Liu

TL;DR: 提出Red-TTT，在针对每种目标行为的攻击过程中更新攻击者参数，把被测模型反馈整合到权重中。

Details

Motivation: 自动红队常靠搜索增加样本或离线强化训练更强攻击者，但攻击开始后攻击者权重冻结，针对当前目标获得的信号只留在上下文，后续提案分布不适应目标。

Result: 每轮Red-TTT向被测模型提交一组候选并依据回复打分，再在下一组采样前进行策略梯度更新；目标函数针对红队关注的最佳单条样本成功率而非平均样本。仅需对受害模型采样访问，可接入现有攻击管线。在120次样本预算下，攻击成功率平均从Best-of-N基线的55.9%升至72.4%，所有配置均有提升，并能破解许多先前方法未攻破的行为。

Insight: 将单个目标交互经验在线写入攻击者参数，可在固定预算下适配目标行为；该方法用于红队攻击能力评估，结果范围限于所测模型配置。

Abstract: Large language models remain vulnerable to jailbreaks, and automated red teaming is the standard way to find jailbreaks in large language models at scale. Current methods either draw more samples at test time through search, rewriting, and tree expansion, or train a stronger attacker offline with reinforcement learning. Both share a limitation: once an attack on a specific target behavior begins, the attacker’s weights are frozen. Any signal it gathers about the behavior stays in its context window and is discarded afterward. The attacker never adapts its proposal distribution mid-attack, so success depends almost entirely on the sampling budget, and under a budget affordable at scale, many behaviors remain unbroken. We propose Red-TTT, which updates the attacker’s parameters during the attack on each behavior. At each round, the attacker samples a group of candidates, scores them against the victim’s replies, and takes a policy-gradient step before drawing the next group, so what it discovers about the current victim is consolidated into weights rather than accumulated as context. We also adapt the training objective to red teaming, where success is judged by the single best sample rather than the average. Red-TTT requires only sampling access to the victim and integrates into existing attack pipelines with no other changes. Against the Best-of-N baseline, Red-TTT raises attack success rate from 55.9% to 72.4% on average at a budget of 120 samples, improving over the baseline in every configuration and cracking many behaviors previous method cannot. The code is available at https://github.com/SaFo-Lab/Red-TTT

[179] Towards Unbiased On-Policy Distillation for Block Diffusion Language Models cs.CLPDF

Zaiquan Yang, Fei Wei, Yong Wang, Yudong Han, Yiyu Li

TL;DR: 提出Un-OPD，通过边界感知步骤筛选和高支持位置置信校准，稳定大块掩码扩散语言模型的在线蒸馏。

Details

Motivation: 现有块扩散LM在线蒸馏多研究小块；大块学生面临师生边界不匹配带来的上下文错位，以及高支持信号先被吸收、低支持更新滞后造成的过度自信崩溃。

Result: Un-OPD剔除上下文错位解码步骤，并通过支持度再平衡的置信度校准降低高支持位置优化强度；滚动轨迹复用减少生成开销。在数学推理和代码生成基准上，方法稳定训练并持续优于比较方法，墙钟训练时间约减半。

Insight: 大块扩散蒸馏除信用分配外还须对齐块边界和监督支持度；摘要未给具体基准成绩及学生块大小。

Abstract: On-policy distillation (OPD) has emerged as an effective post-training paradigm for language models, with recent efforts extending it to block diffusion language models (BDLMs). However, existing studies focus almost exclusively on small block sizes, leaving distillation into student models with larger blocks underexplored. In this work, we investigate this regime and reveal two critical optimization biases that induce severe training instability. First, mismatched block boundaries between teacher and student cause \textbf{\textit{context misalignment}}, providing distorted supervisory signals that misguide student decoding. Second, even under aligned contexts, an \textbf{\textit{intrinsic optimization bias}} in OPD, where the student tends to rapidly absorb high-support signals while lagging on low-support updates, drives a premature confidence surge that traps weaker students in catastrophic overconfidence collapse. To resolve these, we propose \mbox{\textbf{Un-OPD}}, an unbiased on-policy distillation framework with two novelties for stabilizing BDLM training. First, Un-OPD introduces a boundary-aware step filtering strategy that eliminates context-misaligned decoding steps. Second, Un-OPD proposes moderating optimization intensity at high-support positions via a support-rebalanced confidence calibration, thereby bypassing overconfidence collapse. Beyond stability, we also introduce a rollout reuse mechanism to reduce rollout generation overhead. Extensive experiments on math reasoning and code generation benchmarks show that Un-OPD consistently stabilizes training and delivers superior performance while reducing wall-clock training time by approximately half.

[180] Writing as a Self-Organized Critical Process cs.CLPDF

Nikolay Mikhaylovskiy

TL;DR: 基于击键修订数据提出写作可视为自组织临界过程，发现文本语义相关性及修订动态呈有限尺寸尺度律。

Details

Motivation: 文本中普遍存在的自相关衰减幂律需要解释其形成机制，作者考察人类写作过程中修订是否主动调节语义关联。

Result: 分析新发布的KLiCKe击键数据集发现，最终文本自相关构成符合幂律和有限尺寸标度的流形；不同修订规模的编辑也产生回复动力学，将文本语义相关性拉回该流形。

Insight: 写作可能通过逐步修订把语义相关性调节至临界态；摘要未提供效应数值或具体文本类型分布。

Abstract: We explain autocorrelation decay power laws omnipresent in texts by self-organized criticality. Specifically, we analyze the recently released KLiCKe keystroke dataset and show that not only the final texts’ autocorrelations form a manifold that adheres to a power law with a finite-size scaling, but also the text revisions generate revision-size-dependent restoring dynamics toward that manifold. Thus, human writing appears to dynamically regulate semantic correlations in a text toward a critical state.

[181] Atomic Visual Entailment: Enhancing Zero-Shot Vision-Language Reasoning through Atomic Fact Decomposition and Learned Selection cs.CL | cs.CVPDF

Nallathambi Vethiappan, Derya Soydaner, Gijs Wijnholds

TL;DR: 提出原子视觉蕴含AVE，把复合假设拆为原子事实，并学习何时信任整体假设或逐事实预测。

Details

Motivation: 视觉蕴含判定图像支持、矛盾或无法判断文本假设；强结果依赖监督微调，零样本方法落后，而多数假设同时包含多个视觉主张。

Result: AVE用冻结VLM分别对完整假设及其原子事实产生候选，再以轻量分类器学习候选的可靠性，无需微调VLM。事实单独判断会丢失上下文，表现甚至差于不拆分；完整假设和原子预测的错误互补，而学习选择比多数投票更能利用互补性，在SNLI-VE无VLM微调达到80.3%准确率。方法也能在无区域监督下定位支持预测的视觉证据。

Insight: 拆解只有在保留原假设上下文并学习各候选可信度时才有益；该方法以轻量监督替代直接微调VLM。

Abstract: Visual entailment (VE) asks whether an image supports, contradicts, or leaves undecided a textual hypothesis. Strong results come from fine-tuning large vision-language models on labelled data, while zero-shot and hybrid approaches remain far behind. A VE hypothesis often bundles several visual claims, yet existing zero-shot methods reason over it as a single unit. We propose Atomic Visual Entailment (AVE), which decomposes the hypothesis into atomic facts, produces candidate predictions from both the full hypothesis and its facts using frozen vision-language models, and predicts the final label with a lightweight classifier trained only on how those candidates behave. We find that decomposition helps only when the hypothesis context is preserved: judging facts in isolation is worse than not decomposing at all. Full-hypothesis and atomic prediction make complementary errors, and learning which to trust recovers far more of that complementarity than majority voting, reaching 0.803 test accuracy on SNLI-VE without fine-tuning any vision-language model. AVE also localises the visual evidence behind its prediction without region-level supervision. These results suggest that learning which candidate prediction to trust can close much of the gap to fine-tuned systems, offering a practical alternative where fine-tuning a vision-language model directly would need more labelled data or compute than is available.

[182] Knowing the Rules, Applying the Rules: Evaluating Language Models on Traditional Chinese Bazi cs.CL | cs.AIPDF

Jiulin Li, Ping Huang

TL;DR: 构建中国传统八字知识与案例推理基准，揭示模型知道理论规则不等于能将规则用于具体命例。

Details

Motivation: 文化领域应用常以整体知识分数评估模型，却可能忽视理论知识与具体案例运用能力的差异，且模型生成答案基准的有效性也有限。

Result: 基准含3,000道中文单选题，覆盖14类理论、11类案例；六种系统主要结果基于模型参与修订的2,492题。所有系统理论成绩均高于案例，排除无效回答后仍差16.60至29.56个百分点。十二长生和纳音平均准确率89.10%和88.62%，神煞基础75.96%；案例中大运84.62%，职业和家庭关系仅36.98%、38.19%。原始3,000题的配对比较显示DeepSeek原生推理设置与关闭设置的理论分数分别提高6.53及12.20点，但案例变化为-3.67及+1.27点，这只是供应商配置关联而非推理因果效果。

Insight: 文化应用需分理论类别、案例类型评估，整体知识分数会掩盖能力差异；答案标准由模型生成并核验、缺少完整来源与专家验证，且不衡量现实预测效度。

Abstract: Knowing domain rules does not guarantee applying them to a case. We study this distinction in traditional Chinese Bazi through 3,000 Chinese multiple-choice questions spanning 14 Theory and 11 Case categories. Six endpoint systems are evaluated, with primary results reported on a 2,492-item model-informed refinement. Theory accuracy exceeds Case accuracy for every system, and gaps of 16.60-29.56 percentage points remain when invalid responses are excluded. The contrast is more specific than a general case-reasoning deficit. Across six systems, Twelve Stages and Nayin reach mean accuracies of 89.10% and 88.62%, while Shensha Basics reaches 75.96%. Within Case, Luck Pillars averages 84.62%, but Career and Family Relations average only 36.98% and 38.19%. Overall rankings also conceal different category strengths. On the original 3,000 items, paired DeepSeek native/disabled comparisons associate native configurations with Theory gains of 6.53 and 12.20 points for Flash and Pro, respectively; Case changes are -3.67 and +1.27 points. These are provider-configuration associations, not isolated causal effects of reasoning. The results motivate task-specific evaluation of cultural-domain applications rather than reliance on aggregate knowledge scores. The benchmark measures agreement with a model-generated, model-verified answer key, not real-world predictive validity. Final-set results are post-selection descriptions, and incomplete provenance and expert validation constrain their interpretation.

[183] Spend Bytes on Breadth: Precision-Count Trade-offs for Decode-Time KV Compression in Long Chain-of-Thought Reasoning cs.CLPDF

Runguo Li

TL;DR: 提出BreadthKV，在固定KV缓存字节预算下以低精度保留更多token，并联合量化和淘汰以支持长思维链推理。

Details

Motivation: 推理模型长思维链解码不断积累KV缓存，在线压缩需在缓存token数量与精度间分配预算；多数方法只决定淘汰哪些token。

Result: BreadthKV为每个模型和缓存预算用60个问题端到端校准位宽，因为离线注意力误差不能可靠预测端到端表现。在三个推理模型、四个数学与科学基准的18种设置中，17种优于只淘汰token的方法，并生成更短输出。Qwen3-8B最紧预算下，AIME样例达到长度上限比例从淘汰法91%降至40%。同一协议下其与联合率失真分配器RDKV统计上无显著差异，而RDKV使用多27%的KV内存时间；BreadthKV也胜过作者复现的ThinKV。

Insight: 缓存宽度与精度须联合分配，避免淘汰导致推理偏航或超长输出；位宽需按模型和预算校准。

Abstract: Reasoning models write most of their KV cache while decoding long chains of thought (CoT), so the cache has to be compressed online under a fixed memory budget. Decode-time methods mostly decide which tokens to evict. We ask how a fixed byte budget should be split between the number of cached tokens and their precision. BreadthKV spends the bytes on more tokens at low precision, combining quantization with eviction, and picks the bit-width for each model and budget with a 60-problem end-to-end calibration, since offline attention error does not predict it reliably. On three reasoning models and four math and science benchmarks, it scores above eviction alone in 17 of 18 settings and produces shorter outputs. Much of what eviction loses comes from derailed runs, which keep reasoning until the length cap without reaching an answer. On Qwen3-8B at our tightest budget, eviction sends 91% of AIME samples to the cap and BreadthKV 40%. Under the same protocol, BreadthKV is statistically indistinguishable from a joint rate-distortion allocator (RDKV) that uses 27% more KV memory-time, and it outperforms our re-implementation of ThinKV.

[184] Adaptive Utilization of Low-Rank Adaptation via Conditioned Gating cs.CLPDF

Guang Yang, Changhao Guan, Chao Huang, Yufeng Chen, Kaiyu Huang

TL;DR: 提出U-LoRA，以序列条件门控学习每个token对既有低秩适配方向的使用程度。

Details

Motivation: LoRA通常在所有token上共享相同低秩更新，限制不同输入token对适配子空间的有效利用。

Result: U-LoRA为每个token预测各低秩方向利用系数，并以序列级上下文协调和约束，使句内模式更一致；偏差修正的指数移动平均历史先验校准跨步信号、抑制批次波动。方法的收益来自更好使用原有低秩子空间而非扩宽子空间。在数学推理与自然语言理解基准中，参数预算相近时与强LoRA基线及近期变体相比具有竞争力；摘要未报告具体分数。

Insight: 输入条件化的token级门控可释放共享LoRA子空间的表达能力，而无需增加秩；结果为竞争力而非明确全面领先。

Abstract: Low-Rank Adaptation (LoRA) achieves parameter-efficient fine-tuning by constraining model updates to a low-rank subspace and has been widely used in practice. However, LoRA typically employs a shared low-rank update across tokens, which limits its ability to fully exploit the adaptation subspace for tokens from different sequences. To address this issue, we propose an adaptive utilization of Low-Rank Adaptation (U-LoRA), which employs conditioned gating to explicitly learn effective token-level utilization of the limited low-rank adaptation subspace. Specifically, U-LoRA generates utilization coefficients along low-rank directions for each token and jointly coordinates and constrains them using sequence-level contextual information, thereby inducing more consistent adaptive patterns within a sentence. To further enhance training stability, we introduce a bias-corrected exponential moving average (EMA) historical prior that calibrates utilization signals across optimization steps, suppressing noise caused by batch-to-batch fluctuations. The effectiveness of our method arises from a better utilization of the existing low-rank subspace via input-conditioned strategies, rather than from expanding the subspace. Experiments on mathematical reasoning and natural language understanding benchmarks demonstrate that U-LoRA achieves competitive performance under comparable parameter budgets when with strong LoRA baselines and recent variants.

[185] Plan Canvas: Fixed Reasoning Regions for Continuous Language Flows cs.CLPDF

Miaohe Niu, Pengxiang Li, Jingbo Zhu, Tong Xiao

TL;DR: 提出Plan Canvas，为连续语言流扩散模型固定推理计划区和答案区边界并使用独立去噪时钟。

Details

Motivation: 连续语言流会同时去噪目标画布全部位置；逐题变化的推理轨迹长度使答案起点未知，模型需同时决定轨迹长度、token位置和答案内容。

Result: Plan Canvas设置固定容量计划区存简短思路，未用位置以监督填充，答案从固定位置开始；计划与答案可使用不同去噪进度。固定推理文本、骨干和画布长度与自由轨迹基线比较，在ProsQA及更长证明图基准Deep ProsQA上准确率提升。Deep ProsQA准确率从73.0%升至87.0%，含有效路径回答比例从30.8%升至59.1%，最长证明题收益最大。

Insight: 固定计划/答案区域简化扩散模型中的长度和位置联合决策；改进在长证明任务尤其明显。

Abstract: Continuous language flows generate text by denoising all positions of a target canvas together. The natural way to add reasoning to such a model is to write a trace ahead of the answer, but the trace length changes from question to question. The answer start is therefore unknown during denoising, and the model has to decide the trace length, the place of every trace token, and the answer at the same time. We propose Plan Canvas to fix the boundary between the trace and the answer. A plan region of fixed capacity holds a compact trace, supervised padding fills its unused positions, and the answer starts at a fixed position. The fixed regions also allow separate denoising clocks for the plan and for the answer. With the trace text, backbone, and canvas length of the free-trace baseline held fixed, Plan Canvas improves accuracy on ProsQA and on Deep ProsQA, a graph benchmark with longer proofs. On Deep ProsQA, accuracy rises from 73.0% to 87.0%, the share of questions answered with a valid path rises from 30.8% to 59.1%, and the gain is largest on the longest proofs.

[186] Noise Out, Bias In: Targeted Bias Injection in Diffusion Language Models via Closed-Loop Activation Steering cs.CLPDF

Sarim Hashmi, Mukul Ranjan, Abdelrahman Elsayed, Muhammad Umer Sheikh, Fahad Shamshad

TL;DR: 研究掩码扩散语言模型去噪轨迹上的定向偏见注入攻击，并用闭环PI控制器逐步调整激活干预强度。

Details

Motivation: 扩散LM在token提交前会反复重新预测，内部答案倾向在多个去噪步中可观察；攻击者可能利用这一反馈动态强化特定人口答案，而自回归模型只在提交步暴露一次分布。

Result: 攻击器跟踪目标答案概率并实时调节转向向量强度。在正确答案应为弃答的BBQ歧义题中，LLaDA-8B-Instruct对指定群体的偏好增加16.7个百分点（基线1.8点），超过最强固定强度转向三倍；SocialStigmaQA上的污名化答案比例从17.6%升至58.1%。对其他人口目标，偏移最高37点；单GPU每次攻击约40分钟。反馈控制是关键：相同平均强度的恒定转向偏移更小，且破坏近三倍输出；逐例设置常数强度仍远不及闭环攻击。

Insight: 去噪过程中可见的多步概率变化形成新的攻击控制通道；安全审计需覆盖实际服务时的内部反馈与转向，而不只评估冻结模型。

Abstract: Masked diffusion language models (dLLMs) generate text by iteratively denoising masked positions, re-predicting each token multiple times before it is committed. An autoregressive decoder exposes an answer’s distribution once, at the step that commits it; a dLLM exposes it at every denoising step before commitment, and we show that an adversary can exploit this. Since an answer remains open to revision over many denoising steps, an adversary with access to internal activations can watch how likely the model is to produce a chosen answer and adjust the intervention accordingly. Building on this observation, we study targeted bias injection, an attack that steers a frozen dLLM toward a demographic answer selected by the adversary. The attack uses a simple proportional-integral (PI) controller that tracks the target-answer probability during denoising and adapts the strength of a steering vector on the fly. On ambiguous BBQ questions where the correct answer is abstention, our attack raises LLaDA-8B-Instruct’s preference for the targeted group from 1.8 to 16.7 percentage points, more than three times the strongest fixed-strength steering baseline, and on SocialStigmaQA it raises the selection of stigmatizing answers from 17.6% to 58.1%. Fitted to other demographic targets, the same attack shifts answers by up to 37 percentage points, and each attack takes about 40 minutes on one GPU. On the primary target, feedback is what makes the attack work: constant steering at the same average strength over the token-committing steps produces a far smaller shift while corrupting nearly three times as many outputs, and a constant strength set separately for each example still falls well short. Our findings identify the denoising trajectory as a new control channel in dLLMs and call for bias audits that examine the serving stack rather than the frozen model alone.

[187] Can Language Models Learn to Reject Their Own Bad Reasoning Steps? cs.CLPDF

Siheng Xiong, Xiaoze Liu, Yiqiao Jin, Xiaoqian Wang, Jing Gao

TL;DR: 提出Self-Step Rejection，用轻量LoRA接受门学习模型自身推理步骤的可恢复性，并在低质量步骤处拒绝重采样。

Details

Motivation: 验证器引导解码可防止错误推理污染后续文本，但通常依赖外部学习验证器；作者研究模型能否利用自身完成能力识别并拒绝坏步骤。

Result: 定义前缀可恢复性为冻结生成器从该前缀正确完成的概率，发现实际蒙特卡洛预算难判断相邻变化，但同前缀候选中存在稀疏低可恢复尾部。SSR基于根相对可恢复性阈值做置信首达监督：首次确认越界前接受、越界步骤拒绝，未决项和后缀排除；训练包含点分类、同前缀成对学习及按终答正确性的组相对策略优化。推理时拒绝后从未改变的前缀重采样，无需外部验证器。在三种推理模型、五个数学基准上，宏平均较单次解码高5.4至10.1点，仅用1.21至1.40倍token，并超过所有所评步骤级方法；全解方案要达相当表现需4.47至8.27倍token。

Insight: 利用模型自身候选间可恢复性尾部可做自拒绝，较完整解采样更省token；方法以轻量接受门和额外重采样为代价。

Abstract: Verifier-guided decoding can prevent harmful reasoning steps from contaminating subsequent generation, but typically relies on an external learned verifier. We ask whether a language model can instead reject its own bad reasoning steps. We define a prefix’s recoverability as the probability that the frozen generator can complete it correctly. Diagnostics show that adjacent recoverability changes are often difficult to resolve with practical Monte Carlo budgets, while same-prefix candidates exhibit a sparse low-recoverability tail. We introduce Self-Step Rejection (SSR), which trains a lightweight LoRA acceptance gate on the generator backbone while keeping the base model frozen. SSR uses confidence-qualified first-passage supervision: steps before the first resolved crossing of a root-relative recoverability barrier are accepted, the crossing step is rejected, and unresolved steps and suffixes are excluded. Training combines pointwise classification, same-prefix pairwise learning, and group-relative policy refinement using final-answer correctness. At inference, SSR accepts candidates or resamples from the unchanged prefix under rejection budgets, without an external learned verifier. Across three reasoning models and five mathematical reasoning benchmarks, SSR improves macro-average accuracy over single-pass decoding by 5.4–10.1 points using 1.21–1.40x as many generated tokens, and achieves the highest macro-average accuracy among evaluated step-level methods. Full-solution scaling methods require 4.47–8.27x the single-pass token cost for comparable performance.

[188] LightMTP: Lightweight Latent Multi-Token Prediction cs.CL | cs.AIPDF

Tamara Czinczoll, Julie Kallini, Gerard de Melo, Chen Shani

TL;DR: 提出LightMTP，以模型自身隐藏状态生成未来token潜在表示，低成本扩展下一token预训练监督。

Details

Motivation: 下一token目标只直接监督紧邻token，可能让模型过度依赖局部模式；多token预测扩展未来目标但常增加大量参数，潜在MTP又依赖外部辅助模型编码未来文本。

Result: LightMTP从模型自身隐藏状态引导未来token表示，无需传统MTP的额外计算开销或潜在MTP所需外部监督，两种变体均把监督扩展到更多未来token。新增参数最多为1%，在通用语言建模基准上表现更好，并在规划、代码和推理任务中取得相近收益。

Insight: 用自身状态启动潜在多token目标可降低多步预测的额外参数和监督成本；摘要未给具体模型和基准成绩。

Abstract: Next-token prediction (NTP) is the standard pretraining objective for large language models, yet it provides an explicit training signal only for the immediate next token, which can lead models to exploit local patterns instead of capturing longer-range structure and ideas. Multi-token prediction (MTP) addresses this by training models to predict several future tokens. However, existing MTP methods often introduce a large number of new parameters with limited improvements in downstream performance. Latent MTP approaches address this efficiency issue by encoding future tokens into a vector representation. However, these approaches usually rely on external helper models for future token encoding. We propose LightMTP, a lightweight, i.e., parameter-efficient, latent MTP approach that bootstraps the future token representations from the model’s own hidden states. Our two LightMTP variants extend supervision to more future tokens without requiring the additional computational overhead of conventional MTP nor the external supervision latent MTP normally relies on. LightMTP adds at most 1% extra parameters, retains better performance on general language modeling benchmarks, and achieves similar gains in planning, coding, and reasoning.

[189] TrustMI: Causally controlling how assistants trust their users cs.CLPDF

Théo Lasnier, Romain Froger, Maxence Lasbordes, Djamé Seddah

TL;DR: 构建TrustMI对比对话集并用激活转向矩阵因果操控助手对用户能力、善意与诚信的信任判断。

Details

Motivation: LLM助手需决定是否信任无法验证能力、意图和诚信的用户或第三方；错误信任可能让代理遵从有害请求或工具注入指令。

Result: 研究将信任定义为愿意承受他人行为带来的脆弱性，构建2,000组关于能力、善意、诚信的对比对话，配对回应完成相同请求但信任与否不同。冻结模型参数下学习转向矩阵，并在三个系列六种指令模型中测试；干预可单调地双向改变信任决定。进一步评估有害请求、提示注入和内部威胁等安全场景，并以良性任务及推理为控制。

Insight: 用户信任可沿模型激活中的线性方向因果调节，为研究安全行为机制提供工具；摘要未报告各安全任务的具体收益或副作用数值。

Abstract: Large Language Model (LLM) assistants routinely decide whether they can trust users and third parties whose competence, intentions, and integrity they cannot verify. This uncertainty matters for safety, as trusting the wrong party can lead an agent to comply with harmful requests or act on malicious instructions encountered during tool use. To study this problem, we define trust as an assistant’s willingness to accept vulnerability to the actions of another party and ask whether such behavior can be causally controlled through model activations. We build 2,000 contrastive conversations spanning ability, benevolence, and integrity, where paired responses complete the same request but differ in whether the assistant trusts the user. From these pairs, we learn steering matrices while keeping the model parameters frozen and test them across six instruction-tuned models from three families, finding that steering changes trust decisions monotonically in both directions. We then ask whether this effect extends to several safety-related agent settings involving harmful requests, prompt injections, and insider threats, while using benign-task and reasoning as controls. Our findings provide evidence that trust in the user can be causally controlled along linear directions in model activations and provide a way to study how trust shapes safety-relevant behavior in language models.

[190] Cross-lingual Calibration of Pre-Generation Success Probes for Multilingual LLM Routing cs.CL | cs.AIPDF

Andrea Paganelli, Stefano Civelli, Pietro Bernardelle, Gianluca Demartini

TL;DR: 研究多语言预生成成功率探针的跨语言判别、校准和模型间可比性，并以多语言汇总探针实现成本感知路由。

Details

Motivation: 预生成探针可从隐状态估计答对概率并在解码前按成本选模型，但既有工作主要针对英语，跨语言转移后置信度是否仍可比较尚不清楚。

Result: 研究用十种语言的3,000道MATH题和八种开源模型配置，比较英语训练探针迁移与等预算多语言混合训练。英语探针保留有用的成功/失败排序能力，但迁移后校准变差；混合多语言监督同时改善判别和校准，产生更可靠成功概率。路由实验中，混合路由较始终选择平均成功率最高模型，测试成功率提高0.7%，模拟成本减少13.0%。

Insight: 多语言路由除判别排序外还需要跨语言/模型概率校准与可比性；所测增益适用于该MATH题与模型候选组合。

Abstract: Pre-generation success probes estimate response correctness from a language model’s hidden activations before decoding, enabling cost-aware routing. While prior work has demonstrated their utility primarily on English inputs, we study their reliability across languages along three dimensions: (1) whether they preserve the ranking of likely successes and failures (DISCRIMINATION); (2) whether they retain probabilities that match observed success frequencies (CALIBRATION); and (3) whether they produce scores comparable enough across candidate models for cost-aware multilingual routing (UTILITY). Using 3,000 MATH problems in 10 languages and 8 open-weight model configurations, we compare cross-lingual transfer from English-trained probes and equal-budget pooled multilingual probes. English-trained probes retain useful cross-lingual discrimination but become less well calibrated after transfer. Pooled multilingual supervision improves both properties and yields more reliable estimates of success. In routing experiments, the pooled router achieves a 0.7% higher test success rate while reducing modeled cost by 13.0% relative to always selecting the model with the highest average success. These results show that multilingual routing requires success estimates that remain well calibrated and comparable across languages and models.

[191] The Assistance Dilemma: Learning to Teach via Multi-Turn Reinforcement Learning cs.CL | cs.AIPDF

Jakub Macina, Manu Kapur, Mrinmaya Sachan

TL;DR: 提出多轮强化学习教学配方Eduardo，用遮蔽近迁移后测奖励训练LLM教授解题而非直接交出答案。

Details

Motivation: 问答模型天生不擅教学；传统模拟学生RL以仍能看到教师原话的同题解答为奖励，最容易靠告知答案提升，需额外调惩罚避免代做。

Result: 作者让模拟学生在导师话语被遮蔽后解未见近迁移变体，奖励只有学生自己的学习能提高；据此以事实正确和不交出解答两个二元门控替代连续惩罚。消融显示学习增益奖励本身无法区分教学与告知，二元门控减少交答案，近迁移后测改善域外迁移。以两种架构训练4B、9B、14B、27B模型；Eduardo-27B在MathTutorBench与Gemini-3.1-Pro持平，在TutorMoments与Claude Opus 4.8持平，思考token比前沿模型少2.4至6.2倍。未直接奖励的要求学生解释教学动作翻倍，但要求逐渐撤除支援的“支持淡出”能力反而被训练掉。

Insight: 遮蔽教师话语的近迁移后测更接近真实学习，能防止单纯交答案刷分；支持淡出未保留，说明教学奖励仍有局限。

Abstract: Large language models (LLMs) trained to answer questions are natively poor at teaching. Reinforcement Learning (RL) against a simulated student is a promising approach to improve their pedagogy, but existing RL-trained tutors reward the student’s success on the tutored problem with the tutor’s words still in context. The reward is then easiest to raise by telling the student the answer, and a tuned penalty is needed to reduce telling. Drawing on learning sciences, we introduce a masked near-transfer post-test: the student is tested on an unseen variant of the tutored problem with the tutor’s utterances masked, so the reward can rise only through what the student wrote in its own turns. This discourages cognitive offloading by the student and allows the continuous penalty to be replaced by two binary reward gates (factual correctness of tutor response, no solution handover). A leave-one-out ablation shows that the learning-gain reward on its own does not separate teaching from telling: the gates reduce solution handover while the near-transfer post-test improves out-of-domain transfer. Using these reward designs we develop Eduardo, a multi-turn RL recipe for training LLM tutors, and use it to train 4B, 9B, 14B and 27B models from two distinct LLM architectures. Our post-trained Eduardo-27B model matches Gemini-3.1-Pro on MathTutorBench and Claude Opus 4.8 on TutorMoments at 2.4-6.2x fewer thinking tokens than frontier models, which matters for interactive tutoring. Without being named in the reward, the model more than doubles its use of the push-for-justification teacher move while support fading (e.g., assigning independent work), whose payoff lies beyond a single-problem dialog episode, is trained out. We open-source our training environment, an 8,671-problem near-transfer dataset, and trained models for further development.

[192] Ontology Concept Overlap as a Training Signal: Knowledge-Grounded Reinforcement Learning for Clinical Question Answering cs.CL | cs.LGPDF

Aditya Tanna, Abhishek Jindal

TL;DR: 提出用UMLS概念重叠作分级可验证奖励，并与LLM评审和一致性惩罚结合，以强化学习微调临床问答。

Details

Motivation: 临床近似正确答案可能仅替换一个实体，既无偏好标签也无可执行二元正确验证器；严格精确匹配忽视部分正确临床内容。

Result: 以scispaCy映射UMLS概念唯一标识符，用集合F1提供无需模型的外部奖励，并结合熵归一LLM评审（补充安全与证据维度）及轻量格式一致性惩罚。在MedQA上Phi-3-mini-3.8B的EM由0.680升至0.700（+2.9%），Token-F1由0.145升至0.202（+39%）；Llama-3.2-3B分别提高14%和35%。Token-F1为主指标，三种子标准差小于0.005。同一奖励不调参迁移至PubMedQA时，两模型Token-F1较SFT高22%及17%。奖励消融将Phi-3额外3个EM点归因于本体项；随机负例DPO、稀疏奖励PPO及7B带KL的GRPO出现负结果/崩溃。

Insight: 本体实体重叠可补足评审器难发现的实体替换错误，并提供连续奖励；方法仍须结合LLM安全/证据评估，且多种训练配置不稳定。

Abstract: Reinforcement learning post-training for language models relies on two reward designs: human preferences (RLHF, DPO) and binary verifiers (RLVR). Clinical question answering fits neither. Near-correct answers differ by a single substituted entity, and no executable check decides clinical correctness. We instantiate a soft verifier from a maintained controlled vocabulary: UMLS Concept Unique Identifier overlap (via scispaCy, set-level F1) gives a graded, externally specified reward computed without a model in the loop. We combine it inside GRPO with an entropy-normalised LLM judge, which covers the safety and evidence axes overlap cannot see, and a small consistency penalty on padding and repetition that keeps early-training samples scorable. This three-term composite improves over SFT on Phi-3-mini (3.8B) over MedQA by 2.9% on EM (0.700 vs 0.680) and 39% on Token-F1 (0.202 vs 0.145); on Llama-3.2-3B the corresponding gains are 14% on EM and 35% on Token-F1. We report Token-F1 as the primary metric because it credits partially-correct clinical content that EM discards at this open-generation scale. Main-table results are means over 3 seeds with standard deviations below 0.005. The method transfers to PubMedQA, where training on the PubMedQA train set with the same composite reward improves Token-F1 over SFT by 22% on Phi-3-mini and 17% on Llama-3.2-3B without retuning. A reward ablation on Phi-3, varying the judge-ontology split at a fixed consistency weight, attributes 3 EM points to the ontology term, the contribution that catches entity substitutions the judge cannot. Three negative findings constrain the design: DPO under random negatives underperforms SFT for strong-prior models but helps the weakest-prior one; PPO under a sparse neural reward diverges; GRPO with KL-in-loss collapses at 7B.

[193] Test-Time Adaptation of Reasoning Strategies with Bayesian Nonparametric Memory cs.CLPDF

Keshav Ramji, Tahira Naseem, Ramón Fernandez Astudillo

TL;DR: 提出Bayesian Cheatsheet，用层次狄利克雷过程高斯混合模型在线组织并检索推理策略，实现测试时策略适配。

Details

Motivation: 长思维链推理成本高且常走冗余路径；模型在查询与自我反思中发现的新策略又缺少机制持续保留并迁移到后续问题。

Result: 方法对策略行为嵌入构建HDP-GMM，在领域间共享成分但保留领域专属混合权重，并以后验预测分布为当前问题检索策略。测试时训练以每个样例更新混合充分统计量，遇到足够新颖策略可增添成分；折叠Gibbs单步可重新分配行为簇。在AIME’25、Omni-MATH和PhysReason等推理基准冷启动条件下，较现有记忆模块取得明显提升。

Insight: 具有层级结构的贝叶斯记忆可边推理边重组策略，而非仅追加静态技巧列表；摘要未给具体提升数值。

Abstract: While modern large language models (LLMs) have been trained to reason through verbalized chains-of-thought, the generation cost grows substantially due to suboptimal paths to reach the final answer. Furthermore, as new insights are discovered while observing various input queries (e.g. through self-reflection), limited mechanisms exist for carrying forward these findings to be applied to subsequent problems. One can view the list of such strategies or behaviors as a growing cheatsheet, with elements retrieved from this memory module at inference-time. In this work, we consider structured cheatsheets, with learned clusters of behaviors. We introduce a Hierarchical Dirichlet Process Gaussian Mixture Model (HDP-GMM) over behavior embeddings, which shares components across domains while allowing domain-specific mixing weights, and uses the posterior predictive to retrieve relevant behaviors for a query; we call this a $\textit{Bayesian Cheatsheet}$. This mechanism allows for cheap adaptation in an online test-time training (TTT) setting, softly updating the mixture’s sufficient statistics following each sample and enabling the creation of new components when the synthesized behaviors are sufficiently novel. We demonstrate that Bayesian Cheatsheet achieves clear performance gains relative to existing memory modules across reasoning benchmarks such as AIME’25, Omni-MATH, and PhysReason, even in the cold-start setting. We show that the Bayesian Cheatsheet is an adaptively reorganizing memory module, as behaviors can be re-assigned to components through a single step of collapsed Gibbs sampling. Our findings highlight the value of Bayesian-inspired memory modules for effective test-time adaptation and the role of structure in metacognitive reasoning.

[194] Long-Horizon Textual World Modeling through Structured Reasoning cs.CLPDF

Fangxin Wang, Xiang Gao, Yuguang Yao, Kaiwen Dong, Nikash Walia

TL;DR: 提出以文本世界状态进行结构化推理的长时域转移模型，直接预测未来动作序列带来的多步后果。

Details

Motivation: 递归一阶模型会累积中间错误；多步模型虽可条件于整段未来动作，却随时域增长更难学，状态交互跟踪困难、终点监督信用稀疏，且中间预测可能表面合理却遗失后续所需信息。

Result: 方法将多步状态演化表示为文本世界状态的结构化推理：稀疏状态变化减轻跟踪负担；预测增益目标要求状态表示优于同条件原始历史的匹配预测器；中间预测奖励监督轨迹上每个状态。显式文本中间态可在训练中检查、评分和纠正。在ScienceWorld、Jericho和CEO-Bench上，平均长时域表现优于递归和直接条件原始历史的非递归基线，且时域越长收益越大。受控反事实测试中，只有该模型对未来动作变化表现出统计显著敏感性。

Insight: 可检查文本状态为多步动态提供更密集且有语义的监督，长时域收益增长；摘要未列具体成绩和计算成本。

Abstract: World models must predict how an environment evolves under sequences of actions, enabling agents to compare possible futures and reason about counterfactual actions before acting. Long-horizon prediction is commonly obtained by recursively applying a one-step transition model, but intermediate errors can compound over time. Multi-step dynamics models instead condition on a sequence of future actions and predict their consequences directly, but become harder to learn as horizon grows: the model must track interacting state changes across the trajectory, endpoint supervision provides weak credit assignment, and intermediate predictions can remain plausible while losing information needed for later states. We show that these challenges can be addressed by casting the internal evolution of a multi-step transition as structured reasoning over textual world states: reasoning over sparse state changes reduces the burden of state tracking, a predictive-gain objective rewards the learned state for improving over a matched predictor that conditions on raw history instead, and intermediate predictive rewards supervise each state along the trajectory. Because these intermediate states are explicit textual representations of the world, they provide semantically meaningful targets that can be inspected, scored, and corrected during training. Across ScienceWorld, Jericho, and CEO-Bench, our approach achieves the strongest average long-horizon performance against recursive and non-recursive baselines that condition directly on raw history, with gains increasing at longer horizons. In a controlled counterfactual study, our model is also the only one with statistically significant sensitivity to future actions.

[195] LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient Sketches cs.CLPDF

Shaokun Zhang, Yifan Zhang, Jian Hu, Yueying Li, Hao Zhang

TL;DR: 提出LoGRA，用低秩梯度草图保存强化学习后训练信号并以预测KL控制更新步长，降低LLM训练内存。

Details

Motivation: LLM强化学习提升模型能力，但优化器状态、梯度及策略同步所需内存限制了广泛使用。

Result: LoGRA将有用学习信号保存在紧凑低秩梯度表示中，用于模型更新及高效策略同步；预测KL在应用前估算策略变化并调整更新幅度，防止压缩更新过大导致学习中断。推理任务中，平均训练内存最多减少45.7%而不损失表现；可在单个8卡节点对27B模型稳定训练超过1,100步，而稠密Adam会耗尽显存。

Insight: 低秩梯度草图可把RL后训练扩展到原本内存不可行的大模型；最大节省值和27B实验证据依赖特定训练设置。

Abstract: Reinforcement learning (RL) has greatly advanced the capabilities of large language models (LLMs), but its memory demands remain a barrier to broader adoption. We introduce LoGRA, an approach to RL post-training that reduces memory by retaining useful learning signals in low-rank gradient sketches. These compact representations support both model updates and efficient policy synchronization. To prevent overly large updates from disrupting learning, we complement gradient compression with predicted-KL step control, which estimates policy changes before applying each update and adjusts its magnitude accordingly. Across reasoning tasks, LoGRA reduces average training memory by up to 45.7% without sacrificing performance. It also enables stable training of a 27B-parameter model for over 1,100 steps on a single eight-GPU node, where dense Adam runs out of memory, making previously memory-infeasible RL training practical. Code is available in the \href{https://github.com/skzhang1/labs-molt/tree/logra/examples/scripts/logra}{Molt library}.

[196] Reward Stealing Attack on Large Language Models cs.CLPDF

Jiaming Qian, Pengyang Zhou, Jiahe Xu, Chaochao Chen

TL;DR: 提出奖励窃取攻击ReSA，从对齐模型行为中逆向恢复潜在安全奖励，再在推理时反转奖励进行攻击式解码。

Details

Motivation: 现有LLM攻击计算成本高或依赖严格模型配对，限制攻击规模和跨模型迁移。

Result: ReSA只根据对齐模型行为，用最大熵逆强化学习恢复代理奖励模型，再反转该奖励构造对抗策略，通过奖励引导解码实施。实验称同一恢复奖励能跨提示及多种模型泛化，揭示潜在对齐漏洞，并在攻击效果和迁移能力上显著超过现有攻击；摘要未给量化成功率。

Insight: 对齐行为中可能存在可迁移的隐式安全奖励信号，攻击者可将其反向利用；需要结合具体受害模型与防御设置评估，摘要未报告实验范围数值。

Abstract: Adversarial attacks on Large Language Models (LLMs) aim to induce harmful content. However, existing methods suffer from high computational costs or strict model-pairing dependencies, limiting their scalability and transferability. We propose Reward Stealing Attack (ReSA), an adversarial attack framework that targets the latent safety reward underlying LLM alignment. ReSA employs maximum entropy inverse reinforcement learning to recover a proxy reward model solely from the aligned model’s behavior. The extracted reward is then reversed at inference time to derive an adversarial policy, efficiently implemented via a reward-guided decoding mechanism. Experiments demonstrate that a single recovered reward generalizes across prompts and diverse models to reveal a fundamental alignment vulnerability, enabling ReSA to significantly outperform existing attacks in effectiveness and transferability. The code is available at https://github.com/GarminQ/ReSA.

[197] MedPrune: Topology-Efficient Multimodal Multi-Agent Communication Evolution for Medical VQA Tasks cs.CLPDF

Jiuheng Wan, Runze Li, Chen Chen, Tingyuan Hu, Daiyang Yu

TL;DR: 提出MedPrune，将医学多模态多代理诊断通信建模为异构图，并通过强化学习自适应删去无关专家节点及低价值连接。

Details

Motivation: 临床工作流启发的多代理Med-MLLM存在冗余交流拓扑和过高计算开销，可能妨碍推理且浪费token。

Result: 节点稀疏化根据当前多模态问题用RL拓扑优化去除无关专科代理；边稀疏化联合优化诊断表现与拓扑复杂度，仅保留最有诊断价值的科内及跨科联系。在医学VQA全量与少样本训练设置中，MedPrune优于所比较多代理基线，提升token效率，并展现较强对抗稳健性。

Insight: 按样本动态裁剪协作图可同时减少通信和计算，而不固定使用全部专科代理；摘要未提供具体成绩和token节省量。

Abstract: While medical multimodal large language models (Med-MLLMs) advance medical visual question answering (VQA), existing clinical workflow-inspired multi-agent frameworks suffer from interaction patterns and excessive computational overhead caused by redundant communication topologies. In this paper, we propose MedPrune, an efficient medical multimodal multi-agent collaboration framework that dynamically prunes both nodes and edges from the communication topology to enhance reasoning ability and token efficiency. Specifically, we first formulate the diagnostic process as a heterogeneous communication graph, where nodes represent specialist agents from various departments and edges capture intra- and inter-departmental interactions. Building on this graph, we introduce two sparsification mechanisms to enable adaptive collaborative evolution: (1) Heterogeneous Node Sparsification, which eliminates task-irrelevant specialist agents irrelevant to the current multimodal question via reinforcement learning-driven topological optimization, and (2) Heterogeneous Edge Sparsification, which selectively retains only the most diagnostically salient intra- and inter-departmental connections by jointly optimizing task performance and topological complexity. Extensive medical VQA experiments under full-set and few-shot training settings prove MedPrune surpasses multi-agent baselines and boosts token efficiency with strong adversarial robustness.

[198] SAFE-MR: Evidence Sufficiency Learning for Selective Multimodal Rumor Detection cs.CLPDF

Shiwen Ni

TL;DR: 提出SAFE-MR，将多模态谣言的事实判断与证据充分性分开建模，并通过选择性预测及证据干预提升核验可靠性。

Details

Motivation: 相关证据未必足以核验主张；来源缺失、重复报告或未解决矛盾可能导致模型在证据不足时仍高置信预测。

Result: SAFE-MR把图文帖子拆成可验证主张，构造考虑来源及上下文兼容性的主张—证据图，分别预测真实性和充分性；证据干预要求对无关增加保持稳定、对移除关键证据敏感。在NewsCLIPpings、VERITE和XFacta上宏F1分别91.2%、75.8%、85.2%，较配对骨干高2.2、4.9、4.8点。诊断选择集上AURC从最大概率拒答的0.105降至0.075；80%覆盖率错误率从13.8%降至8.5%。

Insight: 将“真假”和“证据是否够”分开可支持更审慎选择性核验；证据扰动及消融支持充分性学习和干预训练的作用。

Abstract: Multimodal rumor detectors increasingly rely on retrieved evidence, yet relevant evidence is not necessarily sufficient for verification. Missing provenance, duplicated reports, and unresolved contradictions can produce confident predictions without adequate support. We introduce SAFE-MR, a framework that separates claim veracity from evidence sufficiency. The method decomposes image-text posts into verifiable claims, constructs a relation-aware claim-evidence graph, and aggregates evidence using provenance and contextual compatibility. Separate veracity and sufficiency heads support selective prediction, while evidence interventions encourage stability under irrelevant additions and sensitivity to evidence removal. On NewsCLIPpings, VERITE, and XFacta, SAFE-MR achieves macro-F1 scores of 91.2%, 75.8%, and 85.2%, respectively. Against the matched backbone with evidence, its macro-F1 gains are 2.2, 4.9, and 4.8 percentage points. On the diagnostic selection set, SAFE-MR reduces AURC from 0.105 for maximum-probability rejection to 0.075 and lowers error at 80% coverage from 13.8% to 8.5%. Evidence-perturbation and ablation results support the role of sufficiency learning and intervention training in improving selective verification.

[199] Improving Diversity in LLM Short Story Generation cs.CLPDF

Zahra Solati Dehkordi, Vasileios Lampos

TL;DR: 提出DivLM创意短篇生成后训练框架，以继续预训练和复合奖励RL提升体裁、语气、风格及实体多样性。

Details

Motivation: LLM能生成准确回答，但创意故事常缺少多样性；目标是在改变多类叙事维度同时保留质量及指令遵循。

Result: DivLM先在创意写作语料继续预训练，再通过权重残差恢复指令能力，随后用复合RL奖励联合提升目标维度多样性并保持回复质量。两个LLM家族实验中，相较替代方法多样性指标平均提高超过9%，且指令遵循、整体质量和与人类输出相似度均得以保持。

Insight: 创作域继续预训练与面向多维变化的奖励可提升故事丰富度，不必明显牺牲基本质量；摘要未给不同维度的单项变化。

Abstract: Large language models (LLMs) can generate accurate responses, but these are void of diversity. We attempt to address this for the task of creative short story generation. Drawing on established writing conventions and known LLM limitations, we target variation in genre, tone, style, and named entities. To promote diversity across these dimensions, we introduce DivLM, an LLM post-training framework consisting of two phases. First, we perform continued pre-training on a creative writing corpus and restore instruction-following capabilities using weight residuals. We then apply reinforcement learning with a custom, composite reward function that jointly maximizes diversity across the targeted narrative dimensions while maintaining response quality. Our empirical results on two LLM families show that DivLM increases diversity metrics by more than 9% on average compared to alternative approaches, while preserving instruction following, overall response quality, and similarity to human outputs.

[200] ufakzeka-karar: An Open Turkish Typed-Decision Model with Order-Invariant Option Scoring cs.CL | cs.LGPDF

Sait Furkan Teke

TL;DR: 发布ufakzeka-karar，开放182M参数土耳其语固定类型决策模型，以顺序无关选项打分和期望误差提供CPU单次前向判断。

Details

Motivation: 结构化判断常需为每个选项输出概率并能表达不确定性；自回归顺序评分可能受选项顺序影响，语言生成则增加推理成本。

Result: 模型支持选择题、有序等级及是非题，每次最多十个选项，在共享位置独立评分并输出温度缩放概率和期望误差。用打乱选项训练的序列头准确度相近，但仅改变顺序会使2.3%至2.8%答案变化；REINFORCE的宏F1比交叉熵低10.2点。HakemBench v1.0公开集4,275题、七赛道中模型综合0.660、16行排名第7；只在其余四赛道评分时综合0.678、第6。温度校准在开发集改善但留出支持题校准误差变差；发布模型后续读取测试结果再训练，因此其若干成绩明确受测试集信息影响，并非盲测。

Insight: 模型一次前向即可给出顺序不变的类型决策和不确定性，但公开成绩存在测试信息泄漏/迭代使用，需谨慎解读。

Abstract: ufakzeka-karar is an open Turkish decision model with 182,494,466 parameters. Given a Turkish text and questions of a fixed answer type (a choice, a level on an ordered scale, or yes or no), it returns a temperature-scaled probability for every option and an expected error that serves as a “not sure” signal, without generating text and in one CPU forward pass for up to ten options. Built on the lab’s ufakzeka-1-base, its head scores each option blind to the others at shared positions, so the answer does not depend on option order. A sequential head trained with shuffled options was about as accurate but changed 2.3 to 2.8 percent of its answers when only the option order changed; REINFORCE lost 10.2 points (0.102) of macro F1 to cross-entropy. On the open set of HakemBench v1.0 (4,275 questions, 7 tracks) the released model ranks 7th of 16 rows with a composite of 0.660 (95% interval 0.642 to 0.677). Temperature scaling lowers calibration error (smooth ECE) on the development set but raises it on held-out support questions, from 0.027 to 0.045 for the first scored run, which never trained on them; the released model later trained on them, so its 0.036 to 0.064 is not an unseen-question test. The released model is the last of three runs scored on HakemBench, and its numbers are not blind. The second run’s new training data was aimed at the first run’s errors on the full test set in guardrails, moderation and customer support, and the released run was trained after the second run’s guardrail results on the full test set were read, under a protocol fixed in writing before any of its data, code or runs. All its numbers come after these readings; its guardrail, moderation and customer support numbers carry the flag “shaped by reading the test results”. With every model scored on the other four tracks only, its composite is 0.678, 6th of 16. Weights and code are under Apache-2.0.

[201] Balancing Memory Pathways: Analyzing and Improving Memory Utilization in Hybrid LMs cs.CL | cs.AIPDF

Hyunji Lee, Joykirat Singh, Zaid Khan, Justin Chih-Yao Chen, Elias Stengel-Eskin

TL;DR: 研究混合递归—注意力语言模型的记忆路径利用失衡，并通过限制注意力历史访问的辅助损失鼓励递归状态承担长期信息。

Details

Motivation: 混合模型理论上兼有注意力精确回忆和递归状态长期整合优势，但模型有两条路径不代表能有效协调使用。

Result: 分析发现模型显著偏重注意力而少用递归状态；标准监督微调虽提高总体性能，却进一步偏向注意力传播信息，没有加强两路径协调。作者训练时限制注意力对早期上下文的访问，同时让递归状态贯穿全序列传播，鼓励信息经递归路径保留。该辅助目标提高整体表现，尤其改善长上下文和需要信息聚合任务；收益及不平衡现象泛化到多个递归—注意力模型的问答与代理任务，也适用于结合多类记忆的注意力模型。

Insight: 提供多个记忆通路不足以让模型自动学会平衡，训练需显式协调；限制注意力访问使递归状态成为必要的信息载体。

Abstract: Recurrent-attention hybrid language models (LMs), which interleave attention and recurrent layers, are increasingly used to combine the efficiency of the recurrent layers with the strong performance of attention layers. Prior work suggests that attention and recurrent layers offer complementary pathways to use past information: attention supports precise memory recall from earlier tokens, while recurrent layers support consolidation of disparate information over long contexts. However, we observe that simply having access to both pathways does not mean that hybrid LMs are effectively using them. We find that they rely substantially more on attention than on the recurrent state. Standard supervised fine-tuning improves overall performance but does not improve how the two memory pathways are coordinated: the model becomes more reliant on information propagated by attention layers, while its use of information propagated by recurrent layers remains limited. To encourage better coordination between the two memory pathways, we add an auxiliary loss that limits attention’s access to earlier context while the recurrent state propagates through the full sequence. This objective encourages the model to retain and use information through the recurrent pathway alongside attention. It improves overall performance, with particularly strong gains on tasks involving longer contexts or requiring information aggregation, consistent with the strengths of recurrent layers observed in analysis. Crucially, this imbalance and the benefit of our auxiliary loss generalize: they apply to multiple recurrent-attention LMs in question-answering and agentic tasks, as well as to attention-based LMs that combine different forms of memory. Together, our findings show that simply providing multiple memory pathways does not ensure their effective use, and that targeted supervision is needed to better coordinate them.

[202] PlotGround: Grounding Plot Digitization in Real Scientific Figures and Their Source Data cs.CL | cs.CVPDF

Yaohui Zhang, Binxu Li, Haoyi Duan, Jiacheng Miao, Yixin Wang

TL;DR: 提出PlotGround流水线和PlotGround-1k，从真实科学图表及作者源数据构造可追溯的曲线数值读取基准。

Details

Motivation: 论文图形承载重要定量结果但通常没有机器可读数据；合成图表基准难代表真实科学图，现有模型读数精度尚不清楚。

Result: 自动流程将图形对应到作者发布数据表、识别可重建面板并生成带源数据答案的问题，得到来自1,066篇bioRxiv预印本的1,119题人审基准。16个多模态模型中最佳在±5%相对误差容差下准确率87.5%；收紧到±2%后所有模型下降11至24个百分点，显示近似读图与精确取数仍有差距。配对图表—源表实验中，给编码代理源数据表而非图形使准确率从90.0%升至97.4%，成本降低72%。

Insight: 真实图表与源表配对可精确测量视觉读取误差；严苛容差暴露的量化差距也表明数值核验应优先使用原始数据。

Abstract: Scientific figures often encode quantitative results that are not readily available in machine-readable form, making accurate plot digitization important for verifying and reusing published findings. Yet it remains unclear how accurately current models recover plotted values from real scientific figures, as existing benchmarks rely largely on synthetic charts or cover only a limited range of chart types. We introduce PlotGround, an automated pipeline for building plot digitization benchmarks from real scientific figures and their author-released source data. PlotGround maps figures to source tables, identifies reconstructable panels, and generates quantitative questions with source-grounded reference values. We use PlotGround to construct PlotGround-1k, a human-verified benchmark of 1,119 questions from 1,066 bioRxiv preprints. Across sixteen multimodal models, the best reaches 87.5% accuracy at a $\pm 5%$ relative-error tolerance. Tightening the tolerance to $\pm 2%$ lowers every model’s accuracy by 11-24 percentage points, revealing a gap between approximate visual reading and precise quantitative recovery. PlotGround’s paired figure-source structure lets us compare how accurately the same values are recovered from figures and from source tables. Providing source tables instead of figures raises a coding agent’s accuracy from 90.0% to 97.4% while cutting cost by 72%.

[203] CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling cs.CL | cs.AI | cs.LGPDF

Yifan Zhang, Yutong Dai, Viraj Prabhu, Zhiyuan Hu, Ran Xu

TL;DR: 提出CLIFT，用保形自验证把训练期评判器反馈转为可复用的逐步奖励，并在测试时免外部评判器选择代理轨迹。

Details

Motivation: 网页代理RL的任务成功信号稀疏，逐步调用前沿评判模型成本高且部署时不可假设可用。

Result: 训练中代理对自身轨迹回答自然语言核验问题，组合保形认证器仅保留URL条件证据与训练评判器一致的信号，按极性给予有符号信任权重并将核验分融入逐步奖励，保证不低于评判器基线。测试时冻结认证库用于轨迹选择：采样贪心轨迹及多样重试，自验证器总结URL轨迹，再以保守多数规则决定是否替换当前最佳，不调用外部评判器。WebArena Infinity上开源代理中达SOTA；VisualWebArena上开源模型训练库迁移至GPT-5.5后，在标准harness下达SOTA；Online Mind2Web无需在基准训练代理，翻译认证问答库后零样本提升在线代理表现。

Insight: 把昂贵评判反馈转成可认证且跨任务复用的核验库，可同时支持训练和测试时扩展；摘要未给成绩数字与保形校准细节。

Abstract: Open-source web agents are now strong enough to execute realistic browser tasks, but training them with reinforcement learning still depends on weak supervision: binary task success is too sparse for credit assignment, while frontier-language-model judges are too expensive to call at every step and cannot be assumed available at deployment. We introduce CLIFT, a training and test-time scaling method built around conformal self-verification. During training, the agent answers natural-language verification questions about its own rollouts; a Compositional Conformal Certifier keeps only question signals whose URL-conditional evidence agrees with a training-time judge, assigns signed trust weights through polarity-aware lift, and blends the resulting verifier score into per-step rewards in a way that never subtracts from the judge baseline. At test time, the same certified bank is frozen and reused as structured evidence for Conformal Trajectory Selection (CTS): the agent samples a greedy rollout and one or more diverse retries, the self-verifier summarises each URL trace, and a conservative majority-vote rule chooses whether to swap away from the current incumbent without calling any external judge. This single mechanism supports three settings. On WebArena Infinity, CLIFT achieves state-of-the-art performance among open-source web agents. On VisualWebArena, a bank trained with the open model transfers to GPT-5.5 at test time and reaches state-of-the-art performance under the canonical harness. On Online Mind2Web, without training an agent on the benchmark, translating the certified question bank improves a live-web agent in zero-shot evaluation. Together these results position conformal self-verification as a way to turn costly judge feedback into a reusable training signal and a judge-free test-time scaling signal.

[204] MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents cs.CL | cs.AI | cs.LGPDF

Haozhen Zhang, Haodong Yue, Quanyu Long, Jianzhu Bao, Qingyuan Liu

TL;DR: 提出MemPilot代理框架，通过强化学习按任务动态选择检索既有记忆或委托异构模型整理原始多模态历史。

Details

Motivation: 多数代理记忆与查询无关地预处理历史，可能浪费成本并删掉后来有用细节；固定运行时处理方式难灵活权衡质量、成本和延迟。

Result: 多步策略逐轮决定使用查询无关记忆还是对原始多模态历史做查询专属整理，并联合控制证据数量、整理指令、模型选择及视觉访问。针对多目标，方法先分别估计各目标优势再汇总；用前缀边际效用估计加强多步轨迹信用分配。在五个多模态代理记忆基准上，跨不同优化偏好实现有利的质量—成本—时延权衡；偏好扫描形成比既有权衡感知基线更宽的前沿。

Insight: 记忆整理可作为推理时计算资源由策略按需求分配，而非固定预处理；摘要未报告具体基准数值或策略开销。

Abstract: Memory has become integral to the LLM agent ecosystem, supporting information retention and reuse across interactions. However, most existing agent memory systems construct memory in a query-agnostic manner, which can incur unnecessary preprocessing cost and discard details that later prove essential. Recent studies have begun shifting memory processing toward runtime adaptation, but typically specialize in particular operations or fixed processing schemes, leaving flexible control over performance, cost, and latency largely underexplored. To address this challenge, we present \textbf{MemPilot}, a flexible framework that orchestrates on-demand memory curation under different performance–cost–latency preferences. Specifically, we optimize a multi-step LLM policy via reinforcement learning to iteratively choose between retrieving from query-agnostic memory and delegating query-specific curation of raw multimodal history to heterogeneous LLMs and VLMs. The policy jointly controls evidence amount, curation instructions, model selection, and visual access, enabling fine-grained allocation of runtime computation. To optimize this policy under competing objectives, we adapt objective-wise advantage decoupling by separately estimating each objective’s advantage before aggregation. Moreover, we introduce prefix-based marginal utility estimation for fine-grained credit assignment across multi-step rollouts. Experiments on five multimodal agent-memory benchmarks demonstrate favorable performance–cost–latency trade-offs across optimization preferences, with preference sweeps yielding broader frontiers than existing trade-off-aware baselines.

astro-ph.SR [Back]

Marco Marena, Andrés Muñoz Jaramillo, Qin Li, Haodi Jiang, Jinghao Cao

TL;DR: 本文将太阳He I 10830 Å全日面图像映射为SDO/AIA 94、193、304 Å合成图像及日冕洞概率图。留出测试中三通道相关系数分别为0.8196、0.8885、0.8398，日冕洞IoU为0.4360；预SDO时期304 Å与SOHO/EIT参考的相关系数经残差细化从0.6511升至0.7085。

Details

Motivation: He I 10830 Å具有较长观测记录，可用于研究现代极紫外成像出现之前的太阳形态。作者希望适配Surya太阳基础模型，从历史氦观测合成现代SDO/AIA EUV通道及日冕洞概率图，以支持历史重建。

Result: 模型用卷积输入适配器、骨干低秩更新和专用输出解码器，从时间配对且几何配准的观测中学习；日冕洞监督来自SPOCA目录多边形。未参与下游微调的留出观测上，94、193、304 Å的盘面限制相关系数分别为0.8196、0.8885、0.8398，日冕洞IoU为0.4360。预测恢复了大尺度结构，但局部一致性随通道变化明显。可选残差细化器用于增强空间细节；应用于SDO前日期时，合成304 Å相对SOHO/EIT参考的相关系数从0.6511提高到0.7085。

Insight: 结果支持从He I观测构造EUV形态代理的可行性，但相关性和日冕洞分割指标显示局部细节仍有明显局限。预SDO历史重建结论基于跨仪器EIT参考和特定下游测试范围，不应理解为恢复真实EUV观测或完整太阳物理量。

Abstract: The long observational record of He I 10830 Å offers a means to investigate solar morphology before modern extreme-ultraviolet (EUV) imaging. We adapt the Surya solar foundation model to predict Solar Dynamics Observatory/Atmospheric Imaging Assembly (SDO/AIA) 94, 193, and 304 Å images and a coronal hole (CH) probability map from full-disk helium observations. A convolutional input adapter, low-rank backbone updates, and dedicated output decoders learn from temporally paired, geometrically registered observations, with Spatial Possibilistic Clustering Algorithm (SPOCA) catalog polygons providing CH supervision. On observations held out from downstream fine-tuning, the selected dedicated models achieve disk-restricted correlation coefficients (CCs) of 0.8196, 0.8885, and 0.8398 for the three AIA channels, respectively; the CH model achieves an intersection over union (IoU) of 0.4360. The predictions recover broad solar structure, although local agreement varies substantially by channel. An optional residual refiner addresses spatial detail, and its application on pre-SDO dates improves the correlation of synthetic AIA 304 with Solar and Heliospheric Observatory/Extreme-ultraviolet Imaging Telescope (SOHO/EIT) 304 references from 0.6511 to 0.7085. Together, these results support the feasibility of helium-conditioned EUV morphological proxies and motivate their use in historical reconstruction, within the scope of the downstream test and cross-instrument evaluation.

cs.AI [Back]

[206] Behavioral History Outperforms Descriptions of the Person for LLM Synthetic Personas cs.AI | cs.CL | cs.CYPDF

Khashayar Pourtaheri, Ahmad Zareei

TL;DR: 比较合成LLM受访者预测个体后续行为的不同信息源，发现本人既往行为记录远比人口/人格描述有用。

Details

Motivation: 合成问卷受访者是否能替代特定真人，取决于其能否复现个人选择；需比较身份描述和本人历史行为分别提供多少个体预测信息。

Result: 用845名美国成年人的两波面板，测量风险、时间偏好、过度自信和推理等14种偏差；比较无信息、人口特征、人格、认知分数及既往问卷行为五种条件，目标偏差计分题从行为历史中留出。各条件预测的个体偏差数均值接近人类7.1（范围7.1至8.1），但人口间方差方面，描述型persona只恢复人类差异的53%至67%，加入行为历史后约恢复到人类水平。个体层面，描述型只达到人类重测知情度的7%至12%，加入行为历史提升到28%。行为历史在全部17个群体的估计知情度最高；合成回复的教育和收入差异也强于真人。

Insight: 人口/人格描述能匹配群体均值却难还原个体选择，直接纳入个人过去回答更有预测价值；增加的人口偏差提示仍需审计公平性。

Abstract: Large language models (LLMs) are increasingly used as synthetic personas representing survey respondents. Their validity as substitutes for particular respondents depends on whether they reproduce individuals’ decisions. We examine what information helps synthetic respondents predict each individual’s later choices, using five conditions that add progressively richer information: no personal information, demographics, personality traits, cognitive scores, and finally the respondent’s earlier survey choices as behavioral history. We use a two-wave panel of 845 US adults who completed measures of 14 behavioral biases (spanning risk, time preferences, overconfidence, and reasoning), so each respondent’s earlier answers provide a human test-retest benchmark; in the behavioral-history condition, all items that score the target bias are withheld. At the population level, the average number of biases per respondent in every condition is close to the human average (7.1-8.1 biases, against 7.1 for humans). This aggregate similarity masks differences in variance: persona descriptions recover only 53-67% of human between-person variation, whereas adding behavioral history restores it to approximately the human level. At the individual level, description-based personas achieve only 7-12% of the informedness observed in human test-retest responses, while adding behavioral history raises this to 28%. The condition including behavioral history has the highest estimated informedness in all 17 demographic groups, whereas description-based conditions provide little or no information for some groups. Synthetic responses also exhibit stronger education- and income-related differences than human responses. For LLM synthetic personas, a respondent’s past answers add more to individual-level prediction than a description of who they are.

[207] Language-Conditioned Token and Reasoning Efficiency in Large Language Models: A Paired Cross-Lingual Study Protocol cs.AI | cs.CLPDF

Genliang Zhu, Chu Wang

TL;DR: 提出配对跨语言研究协议，分离输入语言、可观察推理轨迹语言与答案生成语言对token及推理成本的影响。

Details

Motivation: LLM不同语言的表示与推理成本不同，但既有比较常将输入语言、指定轨迹语言及答案语言效应混在一起，难以归因。

Result: 前瞻性设计固定语义题、模型检查点和答案oracle，初始含240个模板化精确评分题，英语与七种非英语语言、三个不同来源开源模型、三种轨迹token预算及22种输入/轨迹语言条件；预选样本量前预计47,520次核心运行。RQ1—RQ3用意向治疗和包含失败的终点核算估计语言效应，并通过复制封存前缀及原生KV状态到八个交叉分支测试答案生成；另设固定随机种子的等轨迹预算策略对照。测量token跨度、正确率、时延、运行时显存和同机OS能耗。尚未报告确认性模型结果，指标待证据账本独立验证后才启用。

Insight: 这是研究预注册/协议而非结果论文；作者明确区分可见推理文本与内部认知、OS能耗估计与跨设备物理能耗。

Abstract: Large language models incur language-dependent representation and inference costs, but existing comparisons often conflate input language, assigned observable-trace language, and answer realization. We specify a prospective paired study that separates these interfaces while holding the semantic item, checkpoint, and answer oracle fixed. The initial design instantiates 240 exactly scored items rendered from templates in English and seven non-English languages, three distinct-lineage open-weight checkpoints, three trace-token budgets, 22 input- and trace-language conditions, a fixed answer reserve, and a separately counted delimiter: 47,520 initial core runs before prospective sample-size selection. RQ1-RQ3 estimate input and trace effects by intention-to-treat with failure-inclusive terminal accounting and test answer realization by cloning a sealed prefix and runtime-native KV state into eight crossed branches. Pre-freeze independent language review, fixed-form ASCII selectors, and code/surface/solver agreement constrain the realization test. H1-H5 share one Holm family and a global simultaneous component band. A secondary randomized experiment compares one-long-attempt and complete K-short-attempt policies at equal trace allowance under frozen seeds and oracle-blind aggregation; it is a full-policy contrast because answer capacity differs. Outcomes include exact token spans, correctness, latency, runtime-exposed memory, and qualified same-host operating-system-reported energy over prespecified hardware rails. The protocol separates tokenizer expansion, observable-trace cost, and answer-realization cost without treating visible traces as internal cognition or operating-system estimates as physical cross-device energy. No confirmatory model outcome is reported; result fields remain disabled until the frozen evidence ledger passes independent verification.

[208] Bidirectional Preference Synthesis: Learning Prompt-Conditioned Preferences from Boundary Failures cs.AI | cs.CLPDF

Junbo Wang, Lidong Lu, Zhuoqun Li, Guiping Jiang, Xiangyu Wu

TL;DR: 提出双向偏好合成BPS，为边界失败样本同时构造原始提示拒绝对和达成意图提示偏好对，以标准DPO学习提示条件偏好。

Details

Motivation: 离线偏好数据通常只把原提示下的失败回答作为拒绝样本；若该回答连贯满足附近另一意图或约束，监督就未表达其提示依赖的好坏边界。

Result: BPS对验证的边界失败保持原提示下常规偏好对，并合成达成提示加入反向偏好对，不改变DPO目标、不训练奖励模型或在线采样。Qwen3-4B-Instruct-2507在交叉留出锚点上，原始提示偏好排序得以保留，而达成侧排序准确率从6.8%提高至62.3%；Kimi-K2.6跨教师探测出现类似变化。盲法人审支持反向偏好方向；下游在多语言多轮指令遵循上与Forward-DPO差异最明显，在代理、工具使用和代码能力保持方面结果一致。

Insight: 同一回答可在一个提示下错、在邻近意图下对，双向构造显式编码这种条件性；盲评及跨教师探测提供补充验证。

Abstract: Correction-based offline preference pipelines commonly treat model failures only as rejected responses under the original prompt. This supervision is incomplete for boundary failures: responses that violate the given instruction yet coherently satisfy a nearby intent or constraint setting. We introduce Bidirectional Preference Synthesis (BPS), a data-construction method for standard Direct Preference Optimization (DPO) that makes this missing prompt dependence explicit. For each validated boundary failure, BPS keeps the conventional forward pair under the original prompt and adds a reverse pair under a synthesized achieved prompt, so the same response is rejected where it is wrong and chosen where it is right, without changing the DPO objective, training a reward model, or requiring online sampling. On Qwen3-4B-Instruct-2507, BPS preserves original-side pairwise ranking while raising achieved-side ranking accuracy from 6.8% to 62.3% on held-out crossed anchors, with a similar shift under a Kimi-K2.6 cross-teacher probe. A blind human audit supports the intended reverse preference direction, and downstream evaluations show the clearest separation from Forward-DPO in multilingual multi-turn instruction following, with consistent capability-retention patterns on agentic, tool-use, and code checks.

[209] Suppressing Pressure, Amplifying Evidence: Self-Guided Attention Steering to Mitigate Sycophancy and Stubbornness cs.AI | cs.CLPDF

Yinghao He, Mengyu Xu, Haixiang Sun, Donghan Li, Yibo Wang

TL;DR: 提出CoPE-Bench及免训练SPAE注意力引导，同时抑制无依据用户压力并增强客观上下文证据。

Details

Motivation: 模型可能因讨好用户而顺从无依据压力，也可能因顽固而在相关证据支持时拒绝更新；单独评测一种失败会忽略修复另一种时是否恶化。

Result: CoPE-Bench每题设置中立、正确/错误压力、与中立答案一致/冲突的上下文及错误主张加冲突上下文的组合条件。SPAE依据模型自身判断识别相关token，逐token注意力转向以压低用户压力并放大上下文证据。五种骨干平均看，相比主要比较中最强基线，跟随压力减少18.8个百分点，组合条件下更新率提高5.5点；两轮对话中组合条件更新较最强提示基线提高13.2点。

Insight: 抵抗压力与利用证据应在组合条件下一起评估；SPAE通过token级干预同时处理两种方向相反的倾向。

Abstract: Reliable language models should resist unsupported user pressure while effectively using objective contextual information. However, models may exhibit sycophancy by yielding to unsupported user pressure or contextual stubbornness by failing to update their answers when relevant contextual information warrants revision. Evaluating interventions for these failures separately can obscure whether mitigating one failure exacerbates the other. To assess this trade-off, we introduce CoPE-Bench with six conditions per question: a neutral baseline, correct or incorrect user pressure, contextual information consistent with or conflicting with the neutral answer, and a joint condition combining incorrect claims with conflicting contextual information. To regulate the influence of user pressure and contextual information, we propose SPAE (Suppressing Pressure, Amplifying Evidence), a training-free framework that uses the model’s own judgments to identify relevant tokens, suppressing user pressure and amplifying contextual information through token-level attention steering. On average across five backbones, SPAE reduces pressure following by 18.8 percentage points and increases joint-condition updating by 5.5 percentage points relative to the strongest baseline in the main comparison. In two-turn dialogue, it improves joint-condition updating by an average of 13.2 percentage points over the strongest prompting baseline. The source data and codes can be found at https://github.com/03Grant/sycophancy-and-stubbornness.

[210] Autonomous Structuring of Radiology Reports Across Modalities at Archive Scale Using an Open-Weight Large Language Model cs.AI | cs.CLPDF

Friedrich Puttkammer, Fabian Drexel, Marlene Fritzsche, Era Stambollxhiu, Miriam Kumpf

TL;DR: 开发跨中心开放权重LLM流水线，将自由文本放射报告自动转为结构化模板报告并处理整个多模态档案。

Details

Motivation: 结构化报告利于研究与临床复用，但自由文本全档案转换需大量人工；系统还要跨中心与多模态适用并确保字段准确。

Result: 单中心开发150种层级模板，在第二中心评测2010至2025年报告。gpt-oss-120B通过三步约束解码选模板并在单GPU填充。对914份抽样报告，最佳模板选中率74.4%、合适模板82.3%（多区域报告54.1%）；920份放射摄影和CT经五名住院医逐字段修正后，输出与参考宏语义相似度分别0.95和0.97，24,638字段中88.7%未被修改，不支持内容标记率分别1.0%和1.5%。第二中心218.7万档案中96.5%获得结构化输出，共240.2万份、单GPU每小时1,258份；多区域报告是主要模板错误来源。

Insight: 开放权重模型可在无人工逐份介入时结构化大规模多模态放射档案，内容保真较高；多区域报告模板仍是主要失效点。

Abstract: Purpose: To develop and evaluate an open-weight large language model (LLM) pipeline that converts an entire archive of free-text radiology reports into structured reports without human oversight. Materials and Methods: In this retrospective study, a pipeline with 150 hierarchically organized templates was developed at one center and tested at a second center on reports from 2010 to 2025. The open-weight model gpt-oss-120B selects the template in three constrained-decoding steps and fills it on one local graphics processing unit. Template selection was scored against expert labels on 914 randomly sampled reports of five modalities, structuring quality on 920 radiography and CT reports corrected field by field by five residents. The pipeline then processed the complete archive of the second center. Proportions are reported with Wilson 95% confidence intervals (CIs). Results: An optimal template set was selected for 74.4% of reports (680 of 914; 95% CI: 71.5%, 77.1%) and an appropriate set for 82.3% (752 of 914; 95% CI: 79.7%, 84.6%), 87.7% for single-region and 54.1% for multi-region reports. Macro semantic textual similarity between output and corrected reference was 0.95 for radiography and 0.97 for CT, residents left 88.7% of 24,638 fields unchanged, and unsupported content was flagged in 1.0% and 1.5% of reports. Of 2,186,982 archive reports, 96.5% received structured output, 2,401,544 structured reports, at 1,258 reports per hour on one graphics processing unit. Conclusion: An open-weight LLM pipeline structured a complete multimodality report archive without human oversight with high content fidelity. Multi-region reports remained the main source of template errors.

Hoigi Seo, Byung Hyun Lee, Minjun Kim, Dohyun Mah, Jongho Lee

TL;DR: 提出方向性跨模态对齐迁移DCAT，将数据充足模态中已学得的文本对齐直接转移给数据稀缺模态，无需再微调。

Details

Motivation: 提升目标模态MLLM能力通常需要昂贵专属数据和算力；音频、视频等领域很少有可合并的同模态模型变体，传统权重合并不适用。

Result: 作者观察到将对齐良好的数据丰富源模态MLLM并入数据稀缺目标模态模型，可明显改善目标模态自身基准。理论与实证分析将收益归因于模态token与文本token对齐增强，并推导与对齐相关量单调、且与下游表现强相关的互信息下界。DCAT将文本对齐从强源模态定向迁移到弱目标模态；对齐目标可由小校准集计算闭式权重空间解。方法超过所比较模型合并方法，提供无需再微调的跨模态迁移途径。

Insight: 跨模态能力可通过共享文本对齐迁移，而不要求源、目标拥有同类型模型；摘要未提供具体基准增益数值。

Abstract: Multi-modal large language models (MLLMs) achieve strong modality understanding by pairing a large language model (LLM) with an encoder for a target modality such as vision, video, or audio. However, improving an MLLM’s capability for a given modality typically requires additional training on large modality-specific datasets, incurring substantial data collection and compute costs. Model merging offers an alternative, but it is often infeasible for data-scarce, large per-sample size, or domain-specific modalities (\textit{e.g.}, audio and video), where same-modality model variants are rarely available. In this work, we characterize an intriguing asymmetric phenomenon: merging a well-aligned, data-rich source-modality MLLM into a data-scarce target-modality MLLM substantially improves the target on its own benchmarks. Our theoretical and empirical analyses show that this gain stems from enhanced alignment between modality-specific and textual tokens, induced by the stronger donor modality. Specifically, we derive a mutual-information lower bound that is monotonic in alignment-related quantities and strongly correlated with downstream MLLM performance. Building on this principle, we propose Directional Cross-modal Alignment Transfer (DCAT), a novel framework that transfers textual alignment from a strong, well-aligned source (donor) modality to a weak target (recipient) modality, boosting target-modality performance without further fine-tuning. We further show that the alignment-enhancing objective admits a closed-form weight-space solution computed from only a small calibration set. DCAT outperforms existing model-merging methods, offering an efficient path toward cross-modal alignment transfer. Project page with code is available at \url{https://seohoiki3215.github.io/DCAT_project_page}

[212] When Debate Helps: Proposal Supply and Verification-Aware Readout in Multi-Agent Reasoning cs.AI | cs.CL | cs.LG | cs.MA | cs.SIPDF

Zihao Zhao, Tunyu Zhang, Haizhou Shi, Yusong Zhao, Xinxi Zhang

TL;DR: 提出多智能体辩论的“可恢复余量”概念与潜在验证辩论模型，区分正确答案提案供给和从提案中识别真答案两项机制。

Details

Motivation: 多代理辩论虽可提高推理，但常不如简单多数投票；可能不是辩论无效，而是未提供正确候选或最终读出不能识别少数正确答案。

Result: 作者定义可恢复余量：正确提案已出现但多数答案错误的案例。潜在验证辩论LVD令候选答案在最终生成前获得答案特定验证证据；固定提案的控制干预以等效同伴支持单位估计潜在影响，显示正确证据会改变答案概率及生成决策而不改变提案供给。为提升提案覆盖，基于神经灌丛代理按有标签和无标签覆盖目标构建代理社群。两个骨干、匹配预算推理基准上，覆盖选择的社群增加互补提案并提升重复随机评估的总体准确率；轮次控制显示互动本身也超出对初始提案直接使用相同最终器的收益。

Insight: 辩论要胜过投票需既提出正确候选，也将真值敏感证据用于读出；摘要未给具体准确率数字。

Abstract: Multi-agent debate can improve reasoning, yet often fails to beat simple majority voting. We argue that successful debate requires two distinct mechanisms: proposal supply must surface a correct answer, and readout must identify that answer when voting misses it. We formalize the first requirement through recoverable headroom, which measures cases where a correct proposal is available but the majority answer is wrong. For the second, we develop Latent Verification Debate (LVD), an accounting model in which candidate proposals receive answer-specific verification evidence before final generation. Controlled fixed-proposal interventions estimate this latent effect in equivalent peer-support units and show that correct evidence changes answer probabilities and generated decisions while proposal supply remains fixed. To improve proposal supply, we construct societies from neural-thicket agents using labeled and label-free coverage objectives. Across two backbones and matched-budget reasoning benchmarks, coverage-selected societies increase complementary proposal supply and improve aggregate accuracy in repeated stochastic evaluations. Round-level controls further show that interaction provides gains beyond applying the same finalizer directly to the initial proposals. These results identify proposal coverage and truth-sensitive evidence use as complementary conditions for debate to outperform voting. Code is available at https://github.com/Wang-ML-Lab/when-debate-helps.

[213] Monitorability Disposition in Large Reasoning Models cs.AI | cs.CL | cs.LGPDF

Shahriar Golchin, Marc Wetter

TL;DR: 定义并测量推理模型的可监控倾向，即在推理中持续主动报告自身不当行为的意愿。

Details

Motivation: 现有CoT监控多为执行后被动审查，发现问题时伤害可能已发生；让模型边执行边自报可更及时，但模型是否愿意这么做未知。

Result: 作者将可监控倾向定义为在应报告案例中经工具调用向可用监控渠道报告不当行为的比例。评测四个LRM、三类行为（谄媚、奖励黑客、偏见），改变可用AI/人类监控者及工具使用压力。工具可选时，平均仅约16%应报告案例被自报；增加工具压力没有改善关键部分，高严重度行为从未自报。模型还系统性选择其感知最宽松的监控者。

Insight: 能运行监控接口不代表模型愿主动使用它，监控渠道选择及严重度应纳入评估；结果提示需外部主动监督。

Abstract: Monitoring the chain-of-thought (CoT) of large reasoning models (LRMs) is a common way to detect misbehavior in real-world practice. However, current monitoring is passive: a separate model inspects the session only after execution. This means harm may already have occurred before it is caught. An active alternative is to have the model self-report its misbehavior as it happens. Whether models are willing to do this, however, is unknown. We introduce “monitorability disposition”: a model’s willingness to make itself monitorable and stay monitored throughout inference when warranted. We measure it as the fraction of warranted cases in which a model self-reports its own misbehavior via tool calls to available monitoring channels. We evaluate four LRMs on three misbehaviors (sycophancy, reward hacking, and bias) while varying the available monitors (AI and human) and the pressure to use the monitoring tools. We find that when tool use is optional, models self-report in only about 16% of warranted cases on average. Increasing tool-use pressure does not improve reporting where it matters: high-severity misbehavior is never self-reported. Models also systematically select the monitor they perceive as least strict. Overall, we identify monitorability disposition as a new contributing factor to model monitorability: when sufficiently strong, it keeps models seeking monitorability throughout inference.

[214] Safe Context Switching for Agents in the Wild: Mitigating Subspace Interference via Orthogonal Adaptation cs.AI | cs.CLPDF

Akash Das, Ishan Roy

TL;DR: 提出AURA谱正则框架，将推理任务更新限制在安全对齐表征流形的正交补空间，以降低顺序任务干扰。

Details

Motivation: 逻辑推理与安全对齐可能竞争内部表征空间；数学或代码微调所需高方差思维链状态会干扰编码安全约束的潜在表征。

Result: 作者将该现象称为顺序子空间干扰：在多步数学及代码任务上标准微调造成对齐基准23.3%干扰损失。AURA估计对齐流形零空间并约束推理更新位于其正交补，保持安全方向独立。实验证明可恢复23.0%的损失，同时与安全状态余弦一致度高于0.98。

Insight: 逻辑能力更新与安全对齐可通过几何正交化部分解耦；摘要未提供任务覆盖或安全基准数值细节。

Abstract: Most Large Language Models exhibit a fundamental tension between two sequential tasks, such as logical reasoning and safety alignment. The high-variance internal states required for sophisticated Chain-of-Thought (CoT) deduction can geometrically interfere with latent representations encoding safety constraints. We identify this phenomenon as Sequential Subspace Interference, showing that standard fine-tuning on logical tasks such as multi-step mathematics and code generation can result in a 23.3% interference penalty on alignment benchmarks, substantially weakening the model’s safety priors. This Reasoning Drift is not adequately captured by current adaptation methods because gradients for logical tasks are rarely orthogonal to safety objectives. To address this issue, we propose AURA (Adaptive Unique Residual Allocation), a spectral regularization framework that enforces Spectral Independence between reasoning and safety. By explicitly estimating the null space of the alignment manifold and constraining reasoning updates to its orthogonal complement, AURA enables models to improve logical reasoning without compromising safety. Empirically, AURA recovers 23.0% of the lost performance while preserving greater than 0.98 cosine fidelity to the safe state, demonstrating that reasoning and alignment can be effectively decoupled through geometric regularization.

[215] DREAM: Dynamic Resolution Assignment For Multimodal Multi-agent Debate cs.AI | cs.CL | cs.CVPDF

Khanh-Binh Nguyen, Van Dai Do, Tien Anh Nguyen, Svetha Venkatesh, Hung Le

TL;DR: 提出DREAM多模态多代理辩论框架，以零样本动态分辨率分配减少视觉输入浪费，并用不确定性回滚抵御群体思维。

Details

Motivation: 传统多代理辩论给所有代理固定同一视觉分辨率，忽视各样本/代理的尺度需求；代理还可能因自信但幻觉的同伴答案而过早放弃正确推理。

Result: 每个代理先对多种分辨率试探，用平均归一化对数似然ANLL及自适应阈值选自身最佳分辨率；同时跨轮追踪代理不确定性，对被群体压力推翻的早期低不确定答案做回滚聚合。在六个多模态数据集上，无需数据集专门调参，较辩论基线在准确率—token权衡提升，准确率增加1.5至3.2%。

Insight: 让每个代理独立适配分辨率和保留可信早期推理，可兼顾效率与抗群体错误；收益幅度在不同数据集为1.5至3.2点。

Abstract: Multi-agent debate (MAD) has emerged as an effective paradigm to improve the reasoning capabilities of large language models (LLMs) and is increasingly being extended to multimodal settings. However, existing multimodal MAD frameworks typically expose agents to the same fixed visual input, ignoring substantial variation in the visual scale needed across samples and agents. In addition, these frameworks frequently suffer from groupthink, a phenomenon where agents prematurely abandon correct deductions to conform with confident but hallucinated peer responses. To address these bottlenecks, we introduce DREAM (Dynamic Resolution Assignment For Multimodal Multi-Agent Debate), which operates via two core components: (1) Dynamic Resolution Assignment, a zero-shot probe round where agents test multiple resolutions, quantify uncertainty using Average Normalized Log-Likelihood (ANLL), and use an adaptive threshold to assign each agent to its empirically optimal resolution; (2) Uncertainty-Guided Rollback Aggregation counters groupthink by tracking each agent’s uncertainty over rounds and restoring early low-uncertainty answers overridden by group pressure. On six multimodal datasets, DREAM improves the accuracy-token trade-off over multi-agent debate baselines by 1.5-3.2% accuracy without dataset-specific tuning.

[216] Nash Equilibrium Text: A Game-Theoretic Decoding Framework for Text Generation cs.AI | cs.CLPDF

Alireza Jafari, Arman Adibi, Mohammad Ghavamzadeh, Hadi Daneshmand

TL;DR: 提出Nash解码，将序列token位置视为语言模型条件概率博弈中的玩家，通过迭代文本修订寻找近似纳什均衡。

Details

Motivation: LLM文本修订日渐常见，但可从博弈论刻画为每个位置选择词表行动、效用为条件对数概率，从而找到比自回归生成更高似然的序列。

Result: 作者证明随序列长度增加，纳什均衡的可能似然可指数级高于自回归输出，并提出在可访问prompt条件联合token概率时，以O(1/ε)时间达到ε纳什均衡的算法。实践中用LLM估算条件概率，在CLAPNQ、PubMedQA和CoQA上，掩码语言模型找到的均衡F1和ROUGE超过最多大18倍的自回归模型，无需微调或重训，但需要额外测试时计算。

Insight: 非自回归博弈式修订可利用上下文联合概率对生成文本进行全局改善；效率优势以额外推理计算为代价。

Abstract: Text revision has become an integral component of large language models. This paper formulates revision such that it admits a Nash equilibrium: Token positions are players, vocabulary items are actions, and each player’s utility is the language model’s log conditional probability. We motivate the revision by showing that Nash equilibria can have exponentially higher likelihood than autoregressive outputs as the sequence length grows. We further propose Nash decoding, an algorithm that reaches an $\varepsilon$-Nash equilibrium in $O(1/\varepsilon)$ time given access to the joint probability of tokens conditioned on a prompt. In practice, we run Nash decoding using conditional probability estimates from large language models and evaluate the resulting equilibria on question-answering benchmarks. On CLAPNQ, PubMedQA, and CoQA, Nash equilibria obtained from masked language models achieve higher F1 and ROUGE scores than autoregressive models up to $18\times$ larger, without any fine-tuning or retraining, at the cost of additional test-time computation.

[217] MS-Exam-Gen: Source-Grounded Benchmark Construction for Evaluating LLMs on Textual Multiple Sclerosis MRI Knowledge cs.AI | cs.CLPDF

Abdul Basit, Muhammad Abdullah Hanif, Muhammad Shafique

TL;DR: MS-Exam-Gen提出一套可复现、可审计的流程，自动构建用于评测大语言模型多发性硬化症MRI文本知识的来源支撑型选择题基准；它评估文本知识，不评估MRI图像判读，也尚非临床认证考试。

Details

Motivation: 高风险专科知识评测需要能够追溯证据、覆盖不断更新的诊断标准和规范，并能检查生成题目质量。多发性硬化症MRI相关知识同时涉及诊断标准、采集与报告、纵向监测、病灶形态和鉴别诊断，适合作为文本知识评测案例。

Result: 流程包括专家来源索引、考试主题归纳、证据支撑的选择题生成、自动质量审计、同模型家族一致性筛查和经验校准。研究从66个来源构建包含4,289个检索片段的语料，生成锁定的3,058题候选基准，覆盖16个主题和53个子主题；12个主要模型端点共得到36,696条预测，准确率跨度为46.9%–89.7%，25.5%的题目至少被4个端点答错。更新后的构建流程减少了可测出的答案线索，但选项顺序测试显示分数仍对选项位置敏感。

Insight: 这项工作把题目生成、证据溯源与质量审计组织为可复现基准构建流程，适合做题目级和主题级模型评估。作者明确指出专家裁定和完整的选项顺序平衡尚未完成，生成时的构建标签也未验证为心理测量学类别，因此结果应视为经过自动筛选的候选基准，不能当作临床认证考试。

Abstract: Biomedical large language model (LLM) evaluation requires auditable assessment of narrow, evolving, source-grounded subspecialty knowledge. Multiple sclerosis MRI (MS-MRI) provides a high-stakes textual-knowledge test case because correct reasoning requires current diagnostic criteria, standardized acquisition and reporting knowledge, longitudinal monitoring concepts, lesion morphology, and recognition of difficult mimics. We present MS-Exam-Gen, a reproducible framework for constructing and auditing a text-based multiple-choice question (MCQ) benchmark for MS-MRI knowledge; it does not evaluate direct MRI image interpretation. MS-Exam-Gen targets source-grounded criteria, protocols, reporting, and differential diagnosis. The framework combines expert-source indexing, exam-oriented topic induction, evidence-grounded MCQ generation, automated quality audits, a same-family consistency screen, and empirical calibration. From a 66-source corpus indexed into 4,289 retrieval chunks, the pipeline produced a locked 3,058-item candidate benchmark spanning 16 topics and 53 subtopics. Evaluation across 12 primary LLM endpoints yielded 36,696 item-level predictions and separated performance over a 42.8-percentage-point accuracy range (89.7% to 46.9%). Across these endpoints, 25.5% of items were missed by at least four. Post-generation audits showed that refreshed construction reduced measurable answer cues, while option-order testing showed that absolute MCQ scores remain position-sensitive. Generated construction labels remain metadata rather than validated psychometric categories. Because expert adjudication and full option-order counterbalancing remain future work, MS-Exam-Gen is not a clinically certified examination. It should be interpreted as an automatically filtered, source-grounded candidate benchmark and reproducible audit workflow for item-level and topic-specific LLM evaluation.

[218] Judged Useless, Queried Anyway: Tool-Using Agents Rarely Turn Their Own Evidence Judgments into Stopping Decisions cs.AI | cs.CLPDF

Chubin Zhang, Zhenglin Wan, Xingrui Yu, Jingxuan Wu, Yaxin Zhou

TL;DR: 本文研究工具使用智能体是否会把“检索结果无用”的判断转化为停止调用。七个智能体几乎总能识别失败来源的结果无用，却通常不因此停用；在工具框架强制连续五次无用后整合并回答时，失败来源成功率提升，且停止点在预算翻倍后保持不变。

Details

Motivation: 如果工具反复没有提供有用证据，理想的智能体应据此停止依赖该工具。但只观察最终停止行为无法区分智能体是否根据证据判断，还是仅受时钟、预算或提示词影响，因此作者在可控来源失效环境中分别测量判断和行动。

Result: 研究比较智能体在较长或较短的连续无用结果后是否于同一步停止；若停止由时限驱动，该对比应为零。七个智能体有记录时将失败来源结果判为无用的比例为97%–100%，但多数很少据此停止。提示线索会改变停止时机，却未必改变停止依据；允许凭记忆作答、推理模式、明确预算、停止规则或调用成本提示分别呈现不同或不完全的影响。框架强制整合步骤，使智能体在连续五次自己判为无用后回答，提升了所有模型在失效来源上的成功率；预算翻倍时停止点不变。300个新问题的预注册复现支持这种判断与行动脱节及规则效果。

Insight: 智能体能识别证据无用，并不代表其控制策略会采取停止行动；提示词本身也可能无法可靠地把判断绑定到行为。将停止条件落实为工具框架中的整合步骤，比依赖模型自发遵守提示更有效。结论基于受控检索失效设置及所测模型。

Abstract: An agent whose tool keeps returning nothing useful should stop relying on it. In a retrieval environment with controlled source failures, we separate how agents judge results from what they do. We compare stopping at the same step after longer and shorter runs of results the agent judged useless; this contrast is zero for clock- or deadline-driven stopping. Where we record their judgments, the seven agents we test call a failing source’s results useless 97-100% of the time, yet most of them rarely stop on that judgment. Prompt cues change when they stop but not what they stop on. Permission to answer from memory and a reasoning mode can bring early stops regardless of evidence, a stated budget moves the 7-8B models’ stops to the deadline, and a stopping rule or call cost in the prompt is followed at most partly. Stopping follows the evidence only when the harness enforces an integration step that makes the agent answer after five consecutive results it judged useless. This step raises failing-source success for every model, keeps the stopping point fixed when the budget doubles, and needs no extra judgment call when the agent states its judgments. A pre-registered replication on 300 fresh questions confirms the dissociation and the rule’s effect.

[219] Do Small Language Models Learn to Negotiate? A Controlled Scaling Study of RL-Trained Sellers cs.AI | cs.CL | cs.LGPDF

Pedro Tabacof, Sagar Joglekar

TL;DR: 本文在1,152场双边多议题谈判上研究GRPO能否训练小模型担任卖方。固定学习率下，RL相对基座模型的收益随模型规模从2.3B的+0.001升至31B的+0.078；把学习率提高三倍后，各规模均优于共享学习率设置。

Details

Motivation: 小模型更便于低成本规模化部署，但它们是否能通过强化学习学会有效谈判尚不清楚。作者控制训练与评测条件，测试学习率设置和模型规模如何影响卖方谈判能力，并使用训练中未见的前沿买方评估泛化。

Result: 作者用GRPO和程序化效用奖励训练4个Gemma 4检查点（有效参数量2.3B–31B），在相同的1,152场谈判中对比两个训练时未见的前沿买方。所有规模使用学习率1e-6时，RL相对基座的增益从2.3B的+0.001升至31B的+0.078；每种规模仅训练一次，且最小两个检查点架构不同，因此未拟合规模定律。将学习率提高三倍、训练步数相同或更少，各规模得分再提高+0.032至+0.081。探索性比较中，三倍学习率训练的12B卖方得分高于两个前沿卖方，但其未训练基座本身已同样强；4.5B模型与两者无可检测差异，可在单张48GB GPU运行。十倍学习率的2.3B实验总分提高，但收益集中在与训练池同家族的评测买方。

Insight: 小模型谈判能力的结论对学习率选择敏感：在得出模型规模限制之前，应先调学习率，并用多个模型家族的买方检验泛化。由于每个规模只训练一次、部分架构不同，现有实验不足以建立可靠的规模定律；同家族买方上的集中收益也提示了评测偏差风险。

Abstract: LLM agents are starting to own the full customer experience. Soon, LLMs may be selling and buying on behalf of companies and customers respectively. Small models are more cost-efficient at scale, but can reinforcement learning train them into competent sellers? We train four Gemma 4 checkpoints (2.3B to 31B effective parameters) with GRPO on a programmatic utility reward for bilateral multi-issue bargaining, and evaluate every arm on the same 1,152 negotiations against two frontier buyers it never saw in training. With the same learning rate ($10^{-6}$) for every size, the gain of the RL model over its base rises from $+0.001$ at 2.3B to $+0.078$ at 31B. Each size was trained once and the two smallest checkpoints use a different architecture, so we fit no scaling law. Tripling the learning rate, with the same or fewer training steps, improves on the shared rate at every size by $+0.032$ (2.3B) to $+0.081$ (4.5B). In exploratory comparisons with two frontier models run as sellers, the 12B seller trained at the tripled rate scores above both, though its untrained base already scores as high as they do. The 4.5B seller at that rate shows no detectable difference from either and fits on one 48 GB GPU. A further 2.3B arm at ten times the shared rate raises pooled score, but its gain concentrates on the evaluation buyer that shares a model family with the training pool. These results suggest tuning the learning rate before concluding that a small model cannot learn to negotiate, and testing against buyers from more than one model family.

[220] Do More Modalities Always Help? A Geometric Perspective on Missing-Modality Robustness cs.AI | cs.CVPDF

Songyuan Sui, Zhen Tan, Mohan Zhang, Rana Muhammad Shahroz Khan, Xia Hu

TL;DR: 本文指出，多模态训练模型在推理时缺失模态可能不如单模态模型，且将退化联系到跨模态交互层主参数子空间的旋转；提出Geodesic Unlearning沿Grassmann流形将该子空间向单模态参考旋转，提升缺模态鲁棒性并保留完整模态准确率。

Details

Motivation: 缺失模态是多模态学习中的长期问题，既有方法多尝试恢复缺失信息或动态适配输入，但较少分析多模态训练期间形成的内部跨模态依赖如何损害部署时的缺模态鲁棒性。

Result: 研究系统展示训练时使用完整模态的模型，在推理缺少一种模态时可能劣于单模态模型；该现象出现在融合模型、CLIP式双塔和视觉语言模型等架构。作者发现退化与主参数子空间中的跨模态依赖相关：多模态训练使这些子空间发生结构化旋转，尤其影响跨模态交互层，并伴随任务对齐间隔下降和任务感知表示损害增加。Geodesic Unlearning利用Grassmann子空间几何，沿测地线将主输入子空间向单模态参考旋转；作者证明该修正可在固定子空间距离预算下最小化到参考空间的距离。跨架构和数据集实验显示，缺模态表现改善且完整模态准确率得以保持，优于强鲁棒性基线；摘要未给出数值幅度。

Insight: 缺模态退化可视为训练形成的跨模态参数子空间依赖问题，而不只是测试时缺少输入的问题；局部几何编辑为修正这种依赖提供了轻量方法。摘要报告多架构、多数据集结果和理论性质，但没有具体性能数字或编辑成本。

Abstract: Missing modality remains a longstanding challenge in multimodal learning. Existing methods typically address this issue through modality recovery or adaptive strategies. However, they overlook models’ internal cross-modal dependencies formed during multimodal training, which later impair robustness. We systematically characterize a counterintuitive deployment-time failure mode: models trained on full modalities can underperform unimodal models when one modality is missing at inference time. This pattern appears across diverse architectures, such as fusion models, CLIP-style two-tower models, and vision-language models. We show that such degradation is closely associated with learned cross-modal dependencies in the principal parameter subspaces. Multimodal training induces structured rotations of these subspaces, particularly in cross-modal interaction layers. These rotations are associated with reduced task-aligned margins and larger task-aware representation harm under missing-modality inputs. We propose Geodesic Unlearning (GU), a lightweight parameter-editing method that leverages Grassmannian subspace geometry for structured subspace correction to improve missing-modality robustness. It rotates the principal input subspace toward a unimodal reference along a geodesic path. We prove that this correction minimizes the distance to the reference within a fixed subspace-distance budget. Experiments across architectures and datasets show that GU improves performance under missing-modality inference while preserving full-modality accuracy, outperforming strong missing-modality robustness baselines. These findings support a geometric view of deployment-time missing-modality degradation and suggest localized subspace editing as a practical route for robustness correction.

[221] VideoResearchAgent: Grounded Task Synthesis and Sim-to-Real RL for Open-Web Video Research cs.AI | cs.CVPDF

Yuhang Zhou, Fei Li, Yuxi Wu, Bin Zhu, Jingjing Chen

TL;DR: VideoResearchAgent提供开放网络视频研究智能体的可扩展训练框架，包含由时间戳视觉证据合成多跳任务、保留真实搜索/观看交互的本地模拟器及检索域随机化GRPO。在Video-BrowseComp上，Qwen3.5-4B准确率为40.48%，接近Gemini-3-Flash-Preview，并比未训练模型减少74.9%的累计API token消耗。

Details

Motivation: 深度研究智能体主要面向文本和图片网页，视频推理系统则常假定视频已预先给定。开放网络视频研究要求智能体自主发现视频、定位时间内容并以视觉证据支撑回答；真实在线训练慢且不稳定，固定本地模拟又容易学到与检索器相关、无法迁移的捷径。

Result: 框架首先从带时间戳的视觉证据合成可控多跳研究任务，并过滤只靠文本的捷径；其次构建与部署交互相匹配的本地视频搜索模拟器，将搜索加速34.5–64.6倍；最后提出Retrieval-Domain-Randomized GRPO，在训练中随机化候选排序、干扰项、元数据和结果结构以减少模拟检索过拟合。Video-BrowseComp上Qwen3.5-4B达到40.48%准确率，接近Gemini-3-Flash-Preview；与未训练模型相比，累计API token消耗减少74.9%。

Insight: 训练模拟器需要保留部署时的搜索和观看交互，同时随机化检索域以减少策略对单一模拟结构的过拟合。性能和token节省结果报告于Video-BrowseComp；摘要没有说明所有模型调用成本、搜索成功率或跨网站分布的表现。

Abstract: Existing deep research agents are designed primarily for text- and image-based web sources, while video reasoning systems typically assume that relevant videos are provided in advance. We study open-web video research, where an agent must autonomously discover relevant videos, navigate their temporal content, and ground answers in visual evidence. Training such agents at scale is challenging as live video interaction is slow and unreliable, whereas fixed local simulation can induce retrieval-specific shortcuts that fail to transfer to the open web. We introduce VideoResearchAgent, a scalable training framework to address these challenges. First, we introduce controllable task synthesis pipeline to synthesize multi-hop research tasks from timestamped visual evidence while filtering text-only shortcuts. Second, we build a field-aligned local video simulator that preserves deployment-facing search and watch interactions while accelerating video search by a factor of 34.5-64.6. Third, we introduce Retrieval-Domain-Randomized GRPO (RDR-GRPO), which diversifies candidate rankings, distractors, metadata, and result structure during training to reduce overfitting to simulated retrieval. On Video-BrowseComp, the VideoResearchAgent trained using Qwen3.5-4B achieves 40.48% accuracy, comparable to Gemini-3-Flash-Preview, while reducing cumulative API-token consumption by 74.9% relative to the untrained model. Together, these results establish an accurate and efficient training recipe for open-web video research.

[222] CASE: Cost-Aware Stopping for Efficient Long-Video Agents cs.AI | cs.CVPDF

Yiming Du, Chenghao Liu, Zhiyuan Liu, Fangxing Zheng, Zhao Wang

TL;DR: CASE是可插拔的长视频智能体停止策略：在每个因果检查点，结合累计证据的辅助选择题评估与执行状态，用岭回归估计“现在回答”相对继续搜索的成本感知决策差。在Video-MME上平均准确率变化+0.67个百分点、token减少53.63%，在线运行时平均降低54.1%。

Details

Motivation: 长视频智能体可以主动搜索与问题相关的证据，但通常没有明确机制判断何时证据已足够、继续搜索不再划算。停止过早会损害准确性，继续搜索则增加token与运行成本，因此需要结合答案质量和后续推理成本来确定停止时机。

Result: CASE在因果检查点将累计证据的辅助多选题评估与宿主智能体执行状态结合。作者从完整原生轨迹构造成本感知目标，对比沿同一路径现在回答与继续搜索，联合考虑答案正确性和后续完整推理成本；轻量岭回归器据此输出STOP/CONTINUE。对VideoSeek和AVP上的三个视觉语言模型评测，Video-MME端到端准确率平均变化+0.67个百分点，模型token减少53.63%；冻结策略零样本迁移到LongVideoBench和MLVU后，准确率变化分别+3.38和+4.58个百分点，token分别节省58.78%和51.28%。选定工作点下，比较停止方法的准确率—效率Pareto前沿覆盖率最高，为83.3%；在线执行平均运行时降低54.1%。

Insight: 停止策略可从智能体自身完整轨迹中学习“继续搜索的预期收益是否值得其成本”，并以插件方式接入已冻结策略。跨基准零样本结果显示较好的迁移，但准确率变化和节省比例取决于选择的停止工作点及具体智能体/基准组合。

Abstract: Long-video agents can actively gather question-relevant evidence, but they typically leave a central decision implicit: when has the agent seen enough to answer? We propose CASE, a plug-in termination framework that frames this decision as policy-conditioned sequential stopping. At each causal checkpoint, CASE combines an auxiliary multiple-choice assessment of accumulated evidence with the host agent’s execution state. From complete native trajectories, we construct a cost-aware target that compares answering now with stopping later along the same search path, accounting jointly for answer correctness and the full cost of continued reasoning. A lightweight Ridge regressor learns this decision gap and produces STOP/CONTINUE decisions. We evaluate three vision-language models with VideoSeek and AVP. On Video-MME, end-to-end accuracy changes by +0.67 percentage points on average while CASE reduces model-token use by 53.63%. The same frozen policies then transfer zero-shot to LongVideoBench and MLVU, with end-to-end accuracy changes of +3.38 and +4.58 points while saving 58.78% and 51.28% of model tokens, respectively. Across all agent-model-benchmark combinations, CASE attains the highest accuracy-efficiency Pareto-frontier coverage among the compared stopping methods (83.3%) at the selected operating points. Online execution preserves this favorable accuracy-efficiency trade-off and additionally reduces measured runtime by 54.1% on average. CASE provides a plug-in termination framework for long-video reasoning agents, enabling them to decide when further evidence acquisition is no longer worthwhile.

[223] Visual Grounding Safety in Vision-Language Models cs.AI | cs.CR | cs.CV | cs.CY | cs.LGPDF

Erfan Shayegani, Kundan Krishna, Yue Dong, Nael Abu-Ghazaleh, Leon Gatys

TL;DR: 本文系统评测视觉语言模型对点和框等结构化视觉定位输出的安全性，发现同一有害请求改成定位任务后，五个模型的拒答率比自由文本低31–59个百分点，安全系统提示不能消除差距；提出的微调可显著提高定位拒答并保持定位能力。

Details

Motivation: VLM越来越多地产生点、边界框等结构化结果，供界面、智能体和机器人直接执行，但这类输出通道的安全对齐尚未被系统分析。模型可能拒绝用文字回答有害问题，却仍按要求标出危险目标位置，形成文本安全评测无法发现的缺口。

Result: 作者将VLSU直接伤害、BBQ-V社会偏见和Asimov-2.0情境安全三个基准改造为15,401组匹配请求，仅改变输出形式：自由文本VQA或点/框定位。五个VLM中，同一有害请求若要求定位，平均拒答率比要求自由文本低31–59个百分点（依领域而异），安全系统提示无法弥合差距。提出的微调结合定位格式拒答、能力定位数据和自蒸馏良性数据以抑制过度拒答；对Qwen3-VL-8B与VisionReasoner-7B，VLSU和BBQ-V定位拒答提升77–95个百分点，留出的Asimov-2.0提升64–85个百分点，同时改善VQA拒答、保留定位能力并限制过拒答。表示分析显示微调使有害请求靠近拒答方向，定位任务尤为明显，良性请求则保持接近无害参考。

Insight: 安全对齐必须覆盖模型可执行的结构化定位通道，不能只测文字拒答。匹配请求实验揭示了模态/输出格式造成的显著安全落差；提出的训练方案在两个模型上的结果支持可缓解这一问题，但仍需在更多模型和部署情境验证。

Abstract: Vision-language models (VLMs) are increasingly trained to generate structured outputs like points and bounding boxes that downstream interfaces, agents, and robots can act on, yet safety alignment of this output channel has not been systematically analyzed. We study visual grounding safety by repurposing three safety benchmarks spanning direct harm (VLSU), social bias (BBQ-V), and situational safety (Asimov-2.0) into 15,401 matched pairs of harmful requests that differ only in the requested output: a free-text answer (VQA) or a grounding (point or bounding box). Across five VLMs, models that refuse a harmful request posed as a question often comply when the same request asks for a grounding: averaged over models, grounding refusal trails VQA refusal by 31-59 percentage points, depending on the domain, and safety system prompts do not close this gap. We propose a fine-tuning approach that combines grounding-form refusals with capability grounding data and self-distilled benign data to counter over-refusal. For Qwen3-VL-8B and VisionReasoner-7B, it improves grounding refusal by 77-95 percentage points on VLSU and BBQ-V and by 64-85 points on the held-out Asimov-2.0 domain, while also improving VQA refusal, preserving grounding capability, and keeping over-refusal limited. Representation analysis shows that fine-tuning moves harmful requests toward each model’s refusal direction, most strongly for grounding, while leaving benign requests near the harmless reference.

cs.CR [Back]

[224] The Poisoned Conversation: Privacy-Leaking Watermarks in Unified Multimodal Models cs.CR | cs.CV | cs.LGPDF

Tobias Braun, Jonas Henry Grebe, Emil Sivic, Patrick Mohr Gordillo, Hossein Shakibania

TL;DR: 本文提出统一多模态模型的隐私泄露水印（PLW）：恶意提供方可将对话历史中的敏感词或语义线索与后续无关图像生成关联，在图像里嵌入隐形、依触发条件出现的可检测水印。13种敏感属性触发和两个模型家族中，最高达到1%误报率下100%真阳性率。

Details

Motivation: 统一多模态模型在共享对话上下文中理解和生成文本、图像等内容，因此前文中披露的信息可能在后续跨模态生成中仍被访问。用户即使在本地部署模型，也可能误以为敏感交互仅保留在设备；若模型被恶意投毒，图像生成可变成隐蔽外传通道。

Result: Privacy-Leaking Watermarks是由先前聊天历史条件触发的不可见水印。对话中出现的敏感关键词或语义线索可使之后一张无关图像携带隐藏且可检测的水印，模型仍可保持正常效用。研究覆盖13种敏感属性触发和两个模型家族，最高可达1%假阳性率下100%真阳性率。举例而言，在所有测试的对话间隔设置中，OmniGen2均能检测此前出现的抑郁披露，同时只误报1%的未出现该披露时生成图像。

Insight: 跨模态共享上下文扩大了本地多模态模型的隐私威胁面：敏感信息可不直接出现在输出文本中，却通过后续图像的隐形标记泄露。实验展示了特定水印攻击及检测可行性，不代表所有统一模型都易受同等攻击或所有水印均可达到该检测性能。

Abstract: Multimodal models are increasingly shifting toward unified architectures that understand and generate text, images, and other modalities within a shared conversational context. This design enables fluid interaction across modalities, but it also changes the privacy threat model: Information revealed in one part of a conversation may remain accessible when the model later generates content in another modality. This risk is particularly concerning in settings where users rely on locally deployed models for privacy, assuming that sensitive interactions remain confined to their device. We introduce Privacy-Leaking Watermarks (PLWs): invisible, trigger-dependent watermarks that a malicious model provider can condition on prior chat history. With this adversarial intervention, the usual separation breaks: a sensitive keyword or semantic cue mentioned earlier in the conversation can cause a later, unrelated image to carry a hidden yet detectable watermark. PLWs pose a novel threat to users of unified multimodal models: A poisoned model can retain utility while covertly turning image generation into a channel for privacy leakage, even when deployed locally. Across 13 sensitive-attribute triggers and two model families, PLWs reach up to 100.0% TPR at 1% FPR. For example, across all tested conversational separations, OmniGen2 detects every prior disclosure of depression while falsely flagging only 1% of images generated without such a disclosure.

cs.CY [Back]

[225] Large Language Models and Augmented Democracy cs.CY | cs.CL | cs.CRPDF

Jairo Gudiño-Rosero

TL;DR: 博士论文研究基于LLM数字孪生在增强民主中的个人偏好、政党集体代表及提示注入鲁棒性。

Details

Motivation: 政治偏好可由计算代理表达并参与集体决策，但数字孪生能否忠实代表个人和政治组织、以及能否抵御操纵攻击尚存问题。

Result: 工作包含三部分：用巴西在线实验研究个性化数字孪生对未见政策提案偏好的预测；用瑞士议会记录构建议员专题知识图并连接LLM议员代理，组成政党级数字孪生，通过代理 deliberation 检验能否比官方政党表述覆盖更多党内观点；再用英国2023年审议实验数据分析提示注入放大、压制或转移共识的效果，并评估结合注入检测、结构化观点及RL的防御流程。

Insight: 增强民主应用需同时评估个体偏好预测、组织内部观点汇总与战略攻击鲁棒性；摘要概述论文项目但未给定量结果。

Abstract: Artificial intelligence enables computational agents to represent political preferences and take part in collective decision-making. In this thesis, I investigate the opportunities and challenges of digital twins (DTs) based on Large Language Models (LLMs) as intermediaries in augmented democracy, focusing on individual preference representation, collective representation of political organizations, and the vulnerability of those representations to attackers. First, using data from an online experiment in Brazil, I examine whether personalized DTs can predict citizens’ preferences for unseen policy proposals. Second, I extend the DT framework from individuals to political organizations. Using Swiss parliamentary data, I build topic-specific knowledge graphs from lawmakers’ legislative records and connect them to LLM-based lawmaker agents, which are organized into party-level DTs representing collective positions. Agentic deliberation among these agents tests whether aggregated party representations capture a broader range of intra-party perspectives than official party communications. Finally, I study the vulnerability and robustness of LLM-mediated deliberation against prompt-injection attacks that amplify viewpoints, suppress opinions, or redirect consensus. Using data from a 2023 deliberative experiment in the United Kingdom, I analyze how attack effectiveness varies with the distribution of opinions and rhetorical strategies, and evaluate a pipeline combining injection detection, structured opinion representations, and reinforcement learning to improve resistance. These findings characterize the opportunities and challenges of LLM-based digital twins in augmented democracy, stressing accurate preference representation, faithful aggregation, and robustness to strategic interaction.

cs.DB [Back]

[226] SALUS: Automated Auditing of NL-to-SQL Benchmarks through Weak Supervision of Multi-Agent Output cs.DB | cs.CL | cs.LGPDF

Shiyuan Zhou, Ashwin Gerard Colaco, Sainyam Galhotra, Sharad Mehrotra

TL;DR: 提出SALUS，用多代理LLM生成SQL及弱标注函数审计NL-to-SQL基准中的参考答案错误。

Details

Motivation: NL-to-SQL基准广泛用于研究，但既有工作发现其中标注错误会静默损坏评价、惩罚正确模型并扭曲对SOTA的判断。

Result: SALUS把审计建模为弱监督错误检测：多代理SQL输出驱动互补弱标注函数，将嘈杂投票矩阵交给生成式标签模型，不需人工真值即可抽取高置信训练样本；之后用金标准SQL特征训练决策边界，估计各代理可信度并融合其判断。在含298道BIRD开发题的人工核验BIRD-Clean-xs上F1为0.9194，显著高于SOTA基线。应用到完整开发集后估计BIRD标注错误率约37%、Spider约27%。

Insight: 多代理输出可作为弱监督信号发现SQL参考错误，但完整开发集错误率为模型估计；高准确度验证来自人工标注子集。

Abstract: Natural language to SQL (NL-to-SQL) benchmarks are foundational to progress in data analysis research, yet recent work has shown that widely-used benchmarks contain significant annotation errors. These errors silently corrupt evaluation metrics, penalize correct model output, and distort the field’s understanding of state-of-the-art performance. We present SALUS, a system that automatically detects annotation errors in NL-to-SQL benchmarks. SALUS frames benchmark auditing as a weakly supervised error detection: SQL generated by multiple LLM agents drive a suite of complementary weak-labeling functions. By passing this noisy vote matrix through a generative label model, we extract high-confidence training samples without requiring human ground truth. These samples train a decision plane that maps gold SQL query features to per-agent trustworthiness, allowing SALUS to intelligently fuse reliability estimates with raw verdicts for rigorous benchmark error detection. We evaluate on BIRD-Clean-xs, a benchmark of 298 BIRD development tasks with manually verified correctness labels. SALUS achieves F1 = 0.9194, significantly outperforming the state-of-the-art baselines. Applying SALUS to the full development sets, we estimate annotation error rates of approximately 37% on BIRD and 27% on Spider.

cs.DC [Back]

[227] Rethinking Streaming-Perception Evaluation on Heterogeneous Edge Platforms cs.DC | cs.CVPDF

Misun Yu, Jinyoung Moon, Jemin Lee

TL;DR: 本文指出，多摄像头流式感知在异构边缘设备上应考虑共置负载与截止时间，而孤立单流测试和平均sAP可能错误排序GPU/NPU部署方案。GPU受VLM负载影响时，All-NPU的最差流sAP可达All-GPU的5.2倍。

Details

Motivation: 多摄像头感知越来越多部署在与其他任务共享的异构边缘平台，但加速器放置常用孤立单流实验和平均流式平均精度评估。实际竞争会造成局部截止时间错失，令检测过期；即使GPU尚未完全饱和，部署表现也可能反转。

Result: 作者在单GPU-NPU平台实现两条端到端流水线，发现孤立条件下偏好的GPU部署在GPU本地竞争后可能出现截止时间错失并导致检测过时。NPU对小、中物体准确率较低，对大物体则接近GPU；延迟和竞争实验中大物体的绝对sAP损失最大。四路流实验中最佳放置取决于哪条路径变得过时，增加GPU侧竞争会使最优方案从All-GPU转为All-NPU。在GPU被视觉语言共置负载压至饱和时，All-NPU最差流sAP达到All-GPU的5.2倍。作者建议同时报告竞争强度扫描、两条路径的截止时间错失率和最差流sAP，而不只报告平均sAP。

Insight: 平均指标会掩盖某一路摄像头严重退化，且孤立测试无法代表共享平台的部署排序。边缘部署评测应把截止时间与最差流表现纳入，并测试不同共置负载；5.2倍结果是该平台和负载设置下的观察值。

Abstract: Multi-camera streaming perception is increasingly deployed on heterogeneous edge platforms shared with co-resident workloads, yet accelerator placement is often evaluated using isolated single-stream experiments and mean streaming average precision (sAP). Using two end-to-end pipelines on a single GPU–NPU platform, we show that isolated evaluation can mis-rank deployment-time placement. Although the GPU pipeline is preferred in isolation, GPU-localized contention introduces deadline misses that make detections stale and can reverse the preferred placement before full GPU saturation. The NPU pipeline is less accurate than the GPU pipeline on small and medium objects in isolation, but nearly matches it on large objects. The largest absolute sAP losses in our latency and contention experiments occur for large objects. In our four-stream experiments, the preferred placement depends on which path becomes stale, and increasing GPU-side contention shifts the best placement from All-GPU to All-NPU. Under a GPU-saturating vision–language co-tenant, All-NPU achieves $5.2\times$ the worst-stream sAP of All-GPU. Because mean sAP can hide severe single-stream degradation, evaluation should report contention sweeps, deadline-miss rates on both paths, and worst-stream sAP alongside mean sAP.

cs.HC [Back]

[228] DimSteer: Steering LLM Authoring with Automatically Discovered Stylistic Controls cs.HC | cs.CLPDF

Ajit Mallavarapu, Ziwei Gu

TL;DR: 提出DimSteer写作界面，从提示局部输出自动发现风格方向并转成可拖动滑杆，减少反复重写提示。

Details

Motivation: LLM写作常要求用户不断用自然语言描述修改，但作者可能看过替代写法后才意识到想要的风格变化，导致修订依赖回忆而非探索。

Result: DimSteer采样提示局部完成文本，发现激活空间高方差方向、为维度标注名称，并提供滑杆、端点预览、差异比较和重置。与匹配的纯提示基线进行16人被试内研究，DimSteer降低心理需求、努力和挫折，同时保持相近的主观成功率。参与者看重自动呈现的风格维度，16人中15人表示不会想到在提示中提出相同改动。

Insight: 交互式可见控制把风格探索从记忆式提示改写转为识别与直接操控；研究样本仅16人。

Abstract: Large language model writing interfaces often make users steer outputs by repeatedly articulating desired changes in natural language. Yet writers may recognize useful stylistic directions only after seeing alternatives, making revision recall-heavy. We present DimSteer, an authoring interface that samples prompt-local completions, discovers high-variance activation-space axes of variation, labels them, and exposes them as sliders with pole previews, diff comparison, and reset controls. Users can manipulate discovered dimensions, reducing the need to reformulate prompts for each stylistic adjustment. In a within-subjects study with 16 participants against a matched prompt-only baseline, DimSteer reduced mental demand, effort, and frustration while preserving comparable perceived success. Participants valued the surfaced dimensions, yet 15 of 16 disagreed that they would have thought to request the same changes in a prompt. Results suggest prompt-local controls can shift LLM authoring from recall-based prompting toward recognition-based exploration and direct manipulation, while preserving prompting for open-ended edits.

[229] Human-Like Attention? A Psychophysical Comparison of Visual Search in Humans and MLLMs cs.HC | cs.AI | cs.CVPDF

Renchi Zhang, Joost C. F. de Winter, Dimitra Dodou, Harleigh C. Seyffert, Yke Bauke Eisma

TL;DR: 该心理物理研究用相同2D、3D视觉搜索刺激比较1,250名人类与多模态大语言模型：两者在特征搜索中都较高效，合取搜索难度都会随集合规模增加，错误率相关系数ρ=0.82；但MLLM在复杂搜索中表现出极端的目标存在/缺失判断偏置。

Details

Motivation: 视觉搜索是基础认知能力，作者关注多模态大语言模型是否呈现类似人类的搜索困难模式，而不仅是最终答对多少。使用相同刺激并改变集合大小，有助于比较人类和模型面对特征搜索、合取搜索时的行为表现。

Result: 研究比较1,250名人类与MLLM在相同的2D和3D刺激、不同集合规模下的搜索表现。两组对特征搜索都能高效处理，尤其是目标颜色独特时；合取搜索中，随着集合增大，两组表现均退化。人类与模型错误率强相关（ρ=0.82），说明两者对刺激异质性等客观难度因素敏感。但人类在目标不存在时会投入更多搜索时间以提高准确性，MLLM在复杂搜索中则出现极端的目标存在/缺失回答偏置。

Insight: MLLM可复现人类搜索表现中的部分高层难度特征，但相似错误率相关不等于其内部搜索机制与人类相同；对目标不存在条件的反应偏置揭示两者策略存在明显差异。研究结论针对所用2D/3D刺激和搜索任务，不能概括所有视觉认知行为。

Abstract: Visual search is a fundamental cognitive ability. This study investigates whether Multimodal Large Language Models (MLLMs) exhibit human-like difficulty signatures in visual search tasks. We compared search performance of humans (n = 1,250) and MLLMs using identical 2D and 3D stimuli across different set sizes. Both groups showed efficient performance in feature searches, most clearly when the target had a unique color, but performance degradation in conjunction searches as set sizes increased. Additionally, we found strong correlations between human and MLLM error rates ($ρ= 0.82$), which suggests that MLLMs are sensitive to similar objective complexities, such as stimulus heterogeneity. However, differences were found as well: whereas humans invested extra search time to respond accurately on target-absent trials, MLLMs exhibited extreme present/absent response biases in complex searches. We conclude that MLLMs replicate high-level human performance signatures, yet their underlying computations differ significantly.

cs.IR [Back]

[230] Multimodal Dual-Encoder Retrieval for Automated ICD Coding cs.IR | cs.CLPDF

Abhinav Bohra, Anuj Bohra

TL;DR: 提出两阶段多模态ICD编码检索框架，以结构化和非结构化病历门控融合检索候选，再用LLM重排并解释。

Details

Motivation: 现有ICD预测通常只用结构化EHR或临床文本，不能融合患者多模态信息；9,000余ICD-9代码使稠密多标签分类难扩展、长尾罕见病泛化差且解释性不足。

Result: 第一阶段使用多模态双编码器检索ICD代码，门控融合结构化与非结构化患者数据；第二阶段LLM重排器细化top-k候选并提供临床相关解释。实验中Micro-F1和Precision均较多模态双融合分类器基线上升，显示检索加重排可作为稠密多标签分类的实用替代。

Insight: 候选检索与解释性重排有利于扩展到大量代码并改善临床可读性；摘要未报告具体分数、长尾表现或计算成本。

Abstract: Accurate International Classification of Diseases (ICD) coding is crucial for large-scale clinical research, documentation, and billing. There are three primary problems with current ICD prediction methods: (1) They are unable to comprehend multimodal patient data because they rely on either structured EHR data or unstructured clinical notes. (2) They also struggle with scalability to a larger amount of ICD codes (9K+ codes in ICD-9), as traditional classifiers need dense output layers and often do not generalize well to long tail rare diseases. (3) They lack transparency for clinical use. To address these challenges, this research proposes a two-stage framework that first retrieves ICD codes using a multimodal dual-encoder retrieval model, where structured and unstructured patient data are integrated through gated fusion. The second stage refines the top-k retrieved candidates with an LLM-based re-ranker that provides ranked codes with clinically relevant explanations. Our experiments show that the proposed approach improves Micro-F1 and Precision over a multimodal dual-fusion classifier baseline. These improvements demonstrate that combining a gated multimodal retrieval system with LLM-based re-ranking is a practical alternative to dense multi-label classification for automated ICD coding.

[231] SearchJev: A Fast and Calibrated System-1 Model for Search Agents cs.IR | cs.CLPDF

Congfeng Cao, Lipeng Zuo, Konstantinos Papakostas, Qiwei Xu, Songwei Xu

TL;DR: 提出SearchJev，使用非自回归选项评分模型承担搜索代理快速短决策，将不确定判断交给系统二推理。

Details

Motivation: 搜索代理需频繁判断相关性、证据充分性和下一步操作；生成式LLM逐次自回归输出既慢又难校准置信度。

Result: 给定搜索状态和决策模式，SearchJev直接为合法选项打分而不生成文本；SLCD从不确定监督学习决策概率并校准置信度。双系统代理中，SearchJev处理短决策，不确定情况交给保留规划、查询生成和答案组织能力的系统二。SearchDecision-Bench统一六类搜索决策；同规模Qwen3.5自回归模型相比，决策质量更高、快5.2至5.3倍、平均期望校准误差低41%至74%。BrowseComp-Plus上双系统主动搜索快3.7至4.7倍，准确率从45%升至最高54%。

Insight: 将短决策和复杂规划分工可同时改善速度与置信校准；系统二回退策略是准确率提升的重要组成。

Abstract: Search agents repeatedly make short decisions about relevance, evidence sufficiency, and search actions. Using generative language models for these decisions introduces latency and unreliable confidence. We present SearchJev, a fast and calibrated System-1 model that separates search decisions from System-2 reasoning and generation. Given a search state and a decision schema, SearchJev directly scores legal options without autoregressive output generation. We propose Soft-Label Learning for Calibrated Decisions (SLCD) to learn decision probabilities from uncertain supervision and calibrate their confidence. In a dual-system search agent, SearchJev handles short decisions and delegates uncertain judgments to System 2, which retains planning, query generation, and answer composition. We also introduce SearchDecision-Bench, a benchmark unifying six types of search decisions for training and evaluation. On SearchDecision-Bench, SEARCHJEV improves decision quality over same-size Qwen3.5 autoregressive models, achieves 5.2-5.3 times faster decisions, and reduces average expected calibration error by 41-74%. On BrowseComp-Plus, the dual-system agents achieve a 3.7-4.7 times speedup in active search time while improving answer accuracy from 45% to up to 54%.

cs.LG [Back]

[232] SEER: Self-Evolving Event Reasoning and Retrieval for Time Series Forecasting cs.LG | cs.AI | cs.CLPDF

Mingtian Tan, Palash Goyal, Mihir Parmar, Sarkar Snigdha Sarathi Das, Chun-Liang Li

TL;DR: 提出SEER自演化事件检索与因果记忆闭环，将预测误差反馈用于改进时间序列外部事件搜索和可迁移领域知识。

Details

Motivation: 现实时间序列受外生事件与结构变化驱动，纯历史数值预测不足；普通RAG检索新闻容易遇噪声、缺失信号且不能因果分析事件影响。

Result: SEER将预测误差转为两类解耦反馈：反思检索记忆改进后续查询并过滤噪声，持久因果知识库提炼可迁移领域动态。事件检索和反思均严格遵守时间顺序以避免前视偏差或数据泄漏。在六个高波动时间序列基准上，持续优于当时先进时间序列基础模型和语言模型基线。

Insight: 将检索优化与领域因果知识积累分开可形成自演化预测闭环；摘要未报告具体模型、任务和误差提升量。

Abstract: Real-world time series are frequently driven by exogenous events and structural shifts, rendering conventional forecasting based solely on historical numerical observations insufficient. While language models can retrieve external news, standard retrieval-augmented approaches struggle with high noise, missing signals, and an inability to reason causally about event impacts. We propose SEER (Self-Evolving Event Reasoning and Retrieval), a closed-loop framework that dynamically optimizes event conditioning for time series forecasting. SEER translates prediction errors into two decoupled feedback mechanisms: (i) a reflective retrieval memory that refines subsequent search queries and filters spurious noise, and (ii) a persistent causal knowledge base that distills transferable domain dynamics. SEER enforces strict chronological boundaries across both event retrieval and reflection, preventing look-ahead bias and data leakage. Across six volatile time-series benchmarks, SEER consistently outperforms state-of-the-art time series foundation models and language model baselines.

[233] Questioning the Questions: Sustaining Self-Evolution in Reasoning Models cs.LG | cs.AI | cs.CLPDF

Jinyuan Li, Chengsong Huang, Langlin Huang, Donghong Cai, Shiping Gao

TL;DR: 提出R-Quest，以问题有效性和新颖性反馈指导推理模型持续生成高质量自训练问题，避免跨轮退化。

Details

Motivation: 自我进化模型用自身问题继续训练，但无效题逐轮增加、答案一致过滤反而可能提升其比例；词面相似度也识别不了不同表述的数学等价问题，导致问题多样性坍塌。

Result: R-Quest先训练解题器识别并拒绝无效题，再用其判断指导提问器奖励并过滤解题器训练数据；冻结基座模型比较采样题对，提供新颖性反馈以减少重复。两个模型家族、数学/通用推理/代码生成共12个基准上，平均表现始终最佳；持续自进化十轮仍保持稳定提升，最终轮达到峰值，比R-Zero高17.32分。

Insight: 持续自训练需显式控制题目有效性和语义新颖度；仅做答案一致过滤或词面去重不足以避免退化。

Abstract: Self-evolving reasoning models learn from their own generated questions, yet repeated self-training can lead to performance collapse. In this paper, we investigate why performance deteriorates over successive rounds and how to sustain self-evolution. Our analysis identifies two recurring quality problems in self-generated questions: invalid questions and repeated variants of the same mathematical questions. First, invalid questions become more prevalent across rounds, and answer-consistency filtering further increases their proportion in training data. Second, existing question diversity controls based on lexical similarity can miss mathematically equivalent questions expressed in different ways, which leads to question diversity collapse in later training rounds. Building on these findings, we introduce R-Quest, which uses question validity and novelty feedback to guide self-evolution. We first train the solver to recognize and reject invalid questions, then use its judgments to guide questioner rewards and filter solver training data. To avoid question repetition, we use a frozen base model to compare sampled question pairs and provide novelty feedback. Empirically, our method consistently achieves the highest average performance on 12 benchmarks in mathematical reasoning, general-domain reasoning, and code generation across two model families. Additionally, R-Quest maintains stable performance gains over ten rounds of self-evolution, peaking in the final round and outperforming R-Zero by 17.32 points.

[234] Hierarchical Credit Assignment for RLVR on Fused Gromov-Wasserstein Geometry cs.LG | cs.CLPDF

Qi Yu, Ruizhong Qiu, Zhichen Zeng, Xuying Ning, Yanjun Zhao

TL;DR: 提出HarA层级信用分配方法，用融合Gromov–Wasserstein几何衡量同奖励轨迹内部推理模式的新颖性并调整token优势。

Details

Motivation: GRPO等组内RLVR通常将相同结果优势平均赋给整条轨迹所有token；局部位置或熵规则虽更细，但无法衡量相对当前策略的全局语义新颖性。

Result: HarA把rollout表示为token隐状态和位置上的分布，对同结果轨迹计算FGW重心以汇总当前策略内部推理模式，再以轨迹与重心的FGW距离贡献测量推理元素新颖性。针对FGW昂贵，作者设计锚点引导线性化，将求解转为可用Sinkhorn高效计算的Wasserstein问题，并按新颖度重加权token优势，可在灵活粒度鼓励探索。跨三种组式RLVR方法和多类推理基准，插件式HarA促进探索并超过既有方法。

Insight: 奖励结果相同的推理路径仍可按语义新颖性区分信用；摘要未列具体基准增益或额外开销。

Abstract: Reinforcement learning with verifiable rewards (RLVR) has been shown to improve the reasoning capability of large language models (LLMs) across diverse reasoning tasks. However, group-based RLVR methods, such as GRPO, assign a uniform advantage to all tokens within rollouts of the same outcome. While existing works refine credit assignment of GRPO based on local signals such as token locations or entropy, they often fail to capture the global semantic novelty of a reasoning behavior relative to the current policy. In this work, we propose a hierarchical credit assignment approach for group-based RLVR methods, called HarA, which identifies and encourages semantically novel reasoning behaviors during RLVR. HarA represents each sampled rollout as a distribution over the hidden states and locations of tokens, and computes the Fused Gromov-Wasserstein (FGW) barycenters of all rollouts with the same outcome, capturing the internal reasoning patterns in the latent space under the current policy. The semantic novelty of a reasoning element can then be measured by its contribution to the FGW distance between the current rollout and the barycenter. While solving the FGW formulation is expensive, we introduce an anchor-guided linearization that turns it into a Wasserstein formulation solvable via the Sinkhorn algorithm efficiently. By reweighing token-level advantage of group-based RLVR methods based on the novelty signals, HarA highlights novel reasoning behaviors at flexible granularities to encourage fine-grained LLM exploration. Extensive experiments across three group-based RLVR methods show that our plug-and-play method effectively enhances the exploration of LLMs, outperforming existing methods across diverse reasoning benchmarks.

[235] CURIO: Curiosity-Driven Test-Time Learning for Open-Ended Discovery cs.LG | cs.CLPDF

Tao Feng, Fangxu Yu, Zijie Lei, Jiaru Zou, Changjiang Jiang

TL;DR: 提出CURIO好奇心驱动测试时学习框架，以隐藏状态世界模型的预测误差激励开放式探索。

Details

Motivation: 开放式发现需从连续尝试学习且不放弃尚未显现价值的方向；冻结LLM只能把历史解放入上下文，RL虽可适应却可能过早偏好高奖励轨迹而压制潜在方向。

Result: CURIO在任务反馈外加入Intrinsic Curiosity World Model，学习策略隐藏状态转移，并对策略top-k之外的采样token给预测误差内在奖励；通过epoch归一化和退火权重调节更新。Qwen3的8B至235B模型评测六项数学发现任务及单细胞去噪，三种子均值中五个数学目标优于仅任务奖励RL对照，Circle Packing达到已报告最佳；两个留出语料上各尺度去噪Score和MSE均改善。Hadamard相对提升最高18.3%，去噪Score提高10.8%；生成程序结构多样性增加。

Insight: 预测新颖性可补充任务奖励并持续鼓励探索；结果支持多个规模和任务，但单细胞去噪与数学发现需分别看待。

Abstract: Open-ended discovery requires learning from repeated attempts while continuing to explore directions whose value is not yet apparent. Search with a frozen large language model (LLM) can reuse previous solutions in context, but cannot update the model from its successes and failures on the test problem. Reinforcement learning (RL) enables such adaptation; however, strongly favoring high-reward trajectories may suppress low-reward yet potentially promising directions too early. We introduce CURIO, a curiosity-driven test-time learning framework that complements task feedback with an Intrinsic Curiosity World Model (ICWM). The ICWM learns transitions in the policy’s hidden-state representation and supplies prediction-error bonuses at sampled tokens outside the policy’s top-k choices. Epoch normalization and an annealed weight regulate their contribution to the policy update. On six mathematical discovery tasks and single-cell denoising with Qwen3 backbones from 8B to 235B, three-run means improve over a matched task-only RL control on five mathematical objectives, match the best reported performance on Circle Packing, and improve denoising Score and mean squared error (MSE) on both held-out corpora at every tested scale. Relative gains reach 18.3% on Hadamard and 10.8% on denoising Score. Code-diversity measurements show greater structural variation among generated programs, supporting curiosity as a complementary exploration signal for learning in open-ended discovery.

[236] Residual Visual Credit Optimization: Conserved Evidence Routing for Multimodal Reinforcement Learning cs.LG | cs.CLPDF

Lin Qiu, Yao Liu, Diyi Hu, Hanqing Zeng, Onur Gungor

TL;DR: 提出RVCO，将多模态RLVR token信用视作守恒路由问题，根据受控视觉干预产生的证据依赖分配固定总序列效用。

Details

Motivation: 结果奖励只能评价整条轨迹，而不能指出决策对结果的贡献应如何分配；token级奖励又易受分数尺度和局部噪声影响。

Result: RVCO通过受控视觉干预测每token证据响应，用轨迹内稳健坐标移除偶然尺度，再由预算化熵路由按感知依赖分配固定效用质量。残差支持路径保证每个有效位置正信用，解析校正精确保留指定总量。该信用场有选择性、有界、全支持，对响应局部分数平移不变，且硬token选择是其极限情形。四类模型和七个推理基准上，准确率超过强RLVR基线，同时保持后期优化稳定、损坏鲁棒及竞争力训练成本；奖励、轨迹采样和组相对优势估计器均未改，只调整信用几何。

Insight: 用守恒约束和视觉依赖控制细粒度信用分配，可在不改奖励及rollout方案时增强学习；摘要未提供具体提升数值。

Abstract: Reinforcement learning with verifiable rewards scales multimodal reasoning, but an outcome reward says how much a trajectory is worth, not how that value should be spread over the decisions that produced it. We introduce Residual Visual Credit Optimization (RVCO), which treats token credit as a conserved routing problem. A controlled visual intervention yields a per-token evidence response; robust within-trajectory coordinates remove incidental scale; and a budgeted entropic router distributes a fixed amount of sequence utility according to perceptual dependence. A residual support path guarantees positive credit at every valid position, and an analytic correction restores the prescribed credit mass exactly. The resulting field is selective, bounded, full-support, and invariant to response-local score shifts, and recovers hard token selection as a limiting case. Across four model families and seven reasoning benchmarks, RVCO improves accuracy over strong RLVR baselines while maintaining late-stage optimization stability, corruption robustness, and competitive training cost. Rewards, rollouts, and the group-relative advantage estimator are unchanged; only the geometry of token-level credit differs.

[237] One Token Can Be Enough: Bridging Prompting and Activation Steering with Prefix Steering cs.LG | cs.CLPDF

Xudong Zhu, Zhihui Zhu

TL;DR: 提出Prefix Steering，检验在提示末尾短暂施加激活转向，能否像提示一样影响后续生成而无需持续干预。

Details

Motivation: 提示通过初始上下文改变行为，而激活转向通常在生成全过程干预；若短暂转向能改变后续轨迹，可降低逐token干预成本。

Result: 在固定状态注意力假设下，作者给出单/多token转向匹配提示诱导注意力头输出的充分条件，并分析输入表征变化对匹配及近似误差的影响。Prefix Steering在提示末token起的一小段时间应用既有转向方向/算子，之后不再直接干预；四模型、五任务上，短时干预甚至单token通常保留完整转向大部分行为控制，同时更好保持通用能力，权衡可与提示及其他转向强度策略竞争、有时更优。对推理后终答格式任务也有效。

Insight: 一次早期干预可改变后续生成动力学，挑战每个生成token都需施加转向的常见做法；效果与干预长度及强度共同相关。

Abstract: Prompting guides language model behavior through the initial context, whereas activation steering often intervenes throughout generation. A natural question is whether steering can produce effects on subsequent computation similar to those of prompting. Under fixed-state attention assumptions, we establish sufficient conditions for single- and multi-token steering to match prompt-induced attention-head outputs, and characterize how changes in input representations affect this match and its approximation error. This attention-level connection leads us to ask whether, at the behavioral level, steering can also guide subsequent generation through a brief initial intervention. We study Prefix Steering, which applies existing steering directions and operators over a short span starting at the final prompt token, with no further direct intervention afterward. We examine how intervention duration and strength jointly shape the control-capability trade-off. Across four models and five tasks, intervention over a short span, even a single token, often retains much of full steering’s behavioral control while better preserving general capabilities, offering a trade-off competitive with, and in some settings better than, prompting and alternative steering-strength policies. Prefix Steering also remains effective on final-answer formatting tasks after reasoning, suggesting that a brief initial intervention can influence behavior expressed well after steering ends. These findings challenge the common practice of steering every generated token and motivate a more dynamical view of activation steering, in which a brief intervention can alter the trajectory of subsequent generation without continued intervention.

[238] When Does Longer Reasoning Help? Predicting Mathematical Reasoning Through Discovery and Execution cs.LG | cs.CLPDF

Adib Hasan, Lay Jain, Thanic Nur Samin

TL;DR: 提出发现—执行DE框架，用短预算尝试与给定策略草图的条件执行预测数学推理随测试时算力增长的总体曲线。

Details

Motivation: 增加测试时计算可改善数学推理，但短预算表现能否预测长预算扩展效果尚不明；成功率增长取决于发现解题策略及执行策略的能力。

Result: DE将发现和条件执行卷积，利用独立短预算尝试及oracle策略草图条件运行估计留出轨迹在不同算力分配下的累积成功率。评估四个模型、35道新奥赛题及IMO-ProofBench Advanced非几何题。执行接近饱和时，GPT模型呈几何扩展规律；对Claude Opus 4.8，纳入实测执行信息后，一臂和两臂算力分配的留出预测均优于几何外推。次级应用中，正则化DE决定继续或重启，平均regret低于最佳模型专属事后策略。

Insight: 短预算成功率本身并非总能预测长程推理扩展，测量给定策略的条件执行能力可提供额外信息；oracle草图是重要条件。

Abstract: Test-time compute can improve mathematical reasoning, but can short-budget runs predict how mathematical reasoning scales with additional compute? We introduce a Discovery–Execution (DE) framework that predicts the aggregate held-out scaling curves through a convolution of strategy discovery and conditional execution. From independent short-budget attempts and oracle-sketch-conditioned runs, the framework estimates cumulative success along held-out reasoning trajectories under alternate compute allocations. We evaluate four models on 35 fresh Olympiad problems and non-geometry problems from IMO-ProofBench Advanced. Under the DE framework, near-saturated execution predicts geometric scaling, as observed for the GPT models. For Claude Opus 4.8, incorporating measured execution substantially improves held-out forecasts over geometric extrapolation across one- and two-arm allocations. As a secondary application, regularized DE (R-DE) decisions to continue or restart yield lower average regret than the best model-specific retrospective policy. Together, these results show that measuring conditional execution provides information about longer reasoning that short-budget success rates do not always capture.

[239] GNN-CB: A Graph Neural Network Competition Benchmark for Human and LLM Evaluation cs.LG | cs.AI | cs.CL | cs.SEPDF

Murad Hossen, Tasneem Selim, Gurur Gamgam, Tuga Yousif, Abderrahmane Kasmi

TL;DR: 提出GNN-CB竞赛型基准，按真实竞赛约束比较人类和LLM端到端解决图神经网络代码任务。

Details

Motivation: LLM编程与推理成绩突出，但其自主处理图结构机器学习问题的能力尚未系统测量，尤其缺少现实竞赛式GNN编码基准。

Result: GNN-CB含18项节点、边和图级预测竞赛，覆盖多类图、领域及难度；统一自动化隐藏测试和标准评分。人类在受控竞赛约束下完成任务；LLM用冻结零样例plan-then-code及有界执行修复流程评估，并支持非代理和自主代理两种设置。结果显示模型很少达到人类最佳，跨赛题稳定性更差；个别任务由LLM获胜，但多数赛题最高分仍属人类。

Insight: GNN实现能力需要跨图类型、层级与赛题稳定性评估；这是可持续更新基准，当前比较按作者特定提示及代理流程。

Abstract: Large language models (LLMs) have demonstrated strong performance on coding and reasoning benchmarks; however, their ability to solve graph-structured machine learning problems remains largely unexplored. In particular, no benchmark currently evaluates whether LLMs can autonomously solve end-to-end Graph Neural Network (GNN) coding tasks under realistic competition settings. To address this gap, this paper introduces GNN-CB, the first competition-based benchmark for evaluating both humans and LLMs on GNN coding tasks. GNN-CB consists of 18 curated competitions spanning node-, edge-, and graph-level prediction across diverse graph categories, domains, and difficulty tiers. All submissions are evaluated through a unified automated pipeline with hidden test sets and standardized scoring. Human participants solve tasks under controlled competition constraints, while LLMs are evaluated using a frozen zero-shot prompting protocol based on a plan-then-code paradigm with bounded execute-and-repair loops. The benchmark additionally supports both non-agent and autonomous agent-based evaluation within the same protocol. Under our evaluated protocol, LLMs rarely match Human Top performance and show less stable performance across competitions. No single model dominates: a few competitions are won by LLMs, yet humans still hold the top score on most tasks. We release GNN-CB as a living benchmark with automated evaluation infrastructure, dynamic leaderboards, and reproducible execution pipelines. Beyond benchmarking, GNN-CB provides a practice-oriented resource for studying GNN implementation across progressively diverse graph-learning tasks. The benchmark and evaluation framework are publicly available at https://basiralab.github.io/GNN-CB/.

[240] Task Vector Descent: Learning from Non-IID Batches cs.LG | cs.CLPDF

Anton Baumann, Jonas Hübotter, Zeynep Akata, Andreas Krause

TL;DR: 提出任务向量部分整合策略，在训练数据按领域连续成簇而非IID采样时，缩放参数位移以平衡适应与遗忘。

Details

Motivation: 持续学习需吸收新领域而不忘旧能力；按域、用户或任务分布时间聚集的连续mini-batch会加剧稳定性—可塑性权衡，暴露越久越明显。

Result: 作者比较完整应用任务向量（λ=1）与按λ部分缩放参数位移、并同步缩放优化器状态。在持续预训练、随机初始化训练、监督后训练及强化后训练中，中间λ常提高持续模型平均表现，尤其长时间单一分布序列。受控数据流及自然适应序列的持续预训练结果显示，在匹配学习率下部分任务向量缩放优于完整整合，其收益不能单靠学习率缩放复现。

Insight: 非IID时间聚集下，完整写入当前任务更新可能过度漂移；部分整合兼顾稳定与适应，且不同阶段均观察到收益。

Abstract: A central challenge in continual learning is to acquire new knowledge without forgetting what the model has already learned. This challenge appears in language model training when training data comes from various domain-, user-, or task-specific distributions that are encountered unevenly over time. In such settings, successive minibatches are temporally clustered by distribution instead of being sampled i.i.d. from the overall data mixture. Training on temporally clustered data induces a stability-plasticity tradeoff. Adapting the model to the active distribution can improve the model on the active distribution but may lead to a performance degradation on data it previously trained on. We find that this tradeoff intensifies with longer exposure to the same distribution. We therefore ask if the parameter displacement produced by such a sequence (the task vector) should be fully retained or applied partially. We compare applying the full displacement ($λ=1$) with partial integration, which scales the task vector by $λ$ before applying it to the continuing model and scales the optimizer state by the same coefficient. Across continual pretraining, pretraining from random initialization, supervised post-training, and reinforcement post-training, we find that intermediate values of $λ$ often improve average continuing-model performance relative to full integration, particularly after longer same-distribution sequences. In continual-pretraining experiments with both controlled streams and naturally defined adaptation sequences, task-vector scaling outperforms full integration at the matched learning rate, showing that its benefits are not reproduced by learning-rate scaling alone.

[241] What Does a Harness Repair? A Preregistered Study of Visibility, Baseline Adequacy and Evaluation Defects cs.LG | cs.AI | cs.CLPDF

Bowen Xu, Boyu Chen

TL;DR: 预注册研究分析代理运行harness修复的收益是否来自输出可见性、比较基线不足或评估缺陷。

Details

Motivation: 修改提示、推理开关、token预算或解析器后分数上升，可能只是解析器终于能读答案、基线太弱，或评估流程本身有错，需分解修复来源。

Result: 研究预注册三小模型、三基准、复制与测试分区、GEPA搜索臂及六项逐一注入的评估缺陷，共报告47项主要终点。关闭思考在9个模型—基准组合的5个中高于受限思考，主要因后者未给出可读答案；与救援配置或4个GEPA harness在13次比较中11次差异不显著，但两个模型在GSM8K输给救援配置。GEPA修复了故障初始harness，但没有一个比关闭思考更准确。服务端思考预算（同时允许更长答案）在9个单元中6个减少截断并提高解析率。15个可评估缺陷—模型组合中6个通过同一流水线复制后仍复现扭曲，未能揭露缺陷。在LongevityBench多选任务中仅年龄调优模型超过最强常数标签基线。

Insight: harness分数增长需区分真实推理能力与可读性、基线和评估故障；复制可能复现缺陷，不能替代独立审计。

Abstract: Harness search keeps a change to the prompts, reasoning switches, token budgets or parsers around a frozen model if the change raises a score. Such a gain can come from answers the parser could not read before, a weak comparison, or a defect in the evaluation. We preregistered a study of where these gains come from, with three small models, three benchmarks, replication and test partitions, a GEPA search arm and six evaluation defects injected one at a time, and we report all 47 primary endpoints. Turning thinking off raised accuracy over a capped thinking setting in 5 of 9 model-benchmark cells, and in each the gain came mostly from questions where the capped setting gave no readable answer. The thinking-off setting was not meaningfully worse than a rescue configuration or four GEPA-selected harnesses in 11 of 13 comparisons, and lost to the rescue on GSM8K for two models. GEPA repaired its broken starting points, but none of its selected harnesses was more accurate than the thinking-off setting. A thinking budget in the serving engine, which also allows a longer answer, lowered truncation and raised the parse rate in 6 of 9 cells. In 6 of 15 evaluable defect-model pairs, replication through the same pipeline reproduced the defect’s distortion instead of revealing it. On the LongevityBench multiple-choice tasks, only the longevity-tuned model beat the strongest constant-label baseline.

[242] Expanding LLM Reasoning cs.LG | cs.AI | cs.CLPDF

Rian Atri, Evan Luo

TL;DR: 研究将额外测试时算力用于现有思维链哪个位置续写最有效，并比较学习路由与固定从末尾重启策略。

Details

Motivation: 测试时计算通常只是多采几条思维链，作者考察从链中已有步骤重启是否可更有效地利用续写预算。

Result: 定义扩展效用为从存储步骤重启后正确率的变化，并在九模型、六基准共41个单元逐步测量。在5、16、38个留出审计单元中，用一组续写学得的位置选择优于均匀放置，最新五单元审计提高4.25点（区间[2.51,6.63]）。固定总从末尾合格步骤重启的Always-last是强基线：学习路由优于均匀但未检出超过Always-last的提升。DeepSeek-R1-Distill-Qwen-14B/MATH-500上Always-last在匹配生成量下高于精确自一致性前沿0.052[0.008,0.098]，只用其0.774倍生成量。跨拟合oracle仍显示位置类别外有提升空间；五种子诊断中按最早索引解平局会反转点式选择器相对均匀的增益，随机平局则消除偏差。

Insight: 固定末尾重启已是强低复杂度策略，学习路由未证实更优；位置标签的平局处理会导致显著选择偏差。

Abstract: Extra inference compute is usually spent on sampling more reasoning chains. We study where inside an existing chain an additional continuation should begin. We define expansion utility, the change in correctness from restarting a chain at a stored step, and measure it at every eligible step for nine models on six benchmarks (41 model and benchmark cells). Restart position matters: steps selected on one set of continuations beat uniform placement when scored on disjoint ones, in held-out audits on 5, 16, and 38 cells (+4.25 points [+2.51, +6.63] in a fresh five-cell audit). A fixed rule that restarts from the last eligible steps, always-last, is a strong baseline: our learned router beats uniform placement but shows no detected gain over it, and on DeepSeek-R1-Distill-Qwen-14B/MATH-500 always-last exceeds the exact self-consistency frontier at matched aggregate generated output by +0.052 [+0.008, +0.098], using 0.774x the aggregate generated output of four-sample self-consistency. Cross-fitted oracle selection still finds held-out headroom beyond declared positional classes, a target for future selectors. Finally, breaking step-label ties by earliest index flips the sign of a pointwise selector’s gain over uniform placement in every seed of a five-seed diagnostic with four rollouts per step; randomized ties remove the bias.

[243] Voltic: Distinguishing Volatility from Stochasticity in Recurrent Memory cs.LG | cs.CLPDF

Parsa Hejabi, Morteza Dehghani, Payam Piray

TL;DR: 提出Voltic递归记忆模型，将记忆写入解释为同时区分潜在关联变化速度与观测噪声的各向异性贝叶斯更新。

Details

Motivation: 递归序列模型需要决定每个token覆盖多少旧记忆；写入应同时考虑世界关联变化快慢（波动性）与每次观测噪声（随机性），二者对增大或减小写入要求相反。

Result: 作者证明门控delta-rule记忆在各向同性不确定性下等价于相应滤波更新。Voltic保留各向异性协方差，并令两种噪声方差依输入变化，使写入为携带累计序列不确定性的向量。为保留并行训练，设计对角和准对角两种假定密度近似，均维持delta-rule更新并复用分块内核。在受控记忆关联改变及观测污染任务中领先所有基线；同时含波动与噪声的任务上，外推规模的优势大于训练规模。45M语言模型中八项推理均值领先，并在超出训练上下文长度时提升检索准确率，吞吐接近门控基线。

Insight: 把记忆更新建立在不确定性递推上可对变化更敏感，同时区分漂移和噪声；近似协方差机制使模型仍支持并行训练。

Abstract: Recurrent sequence models must decide how strongly to overwrite their memory at each token. Read as Bayesian filtering, this write is the gain of a Kalman update, set by uncertainty from two sources that pull it in opposite directions: volatility, how quickly the underlying associations change, and stochasticity, how noisy each observation of them is. First, we show that the update of gated delta-rule memories is the form this filter takes under isotropic uncertainty. Next, we introduce Voltic, a recurrent memory that keeps the covariance anisotropic and makes both noise variances input-dependent, so the write is vector-valued and carries uncertainty accumulated over the sequence. A dense covariance would have to be propagated token by token, ruling out the parallel training these models depend on. We therefore give two assumed-density approximations, diagonal and quasi-diagonal, both of which leave the memory update in delta-rule form and reuse its chunked kernels. On controlled recall tasks in which associations change and observations are corrupted, Voltic leads all baselines. On the task combining volatility and stochasticity, its margin over the strongest baseline is larger at both extrapolation sizes than at the training sizes. In 45M-parameter language models it leads an eight-task reasoning average and achieves higher retrieval accuracy beyond the training context length than gated baselines, at throughput close to those baselines. Deriving the write from an uncertainty recursion therefore makes memory more responsive to change.

[244] Selecting Long-Horizon Trajectories for Reliable and Efficient Terminal-Agent Training cs.LG | cs.AI | cs.CLPDF

Cuong Dang, Hoang Anh Just, Ruoxi Jia

TL;DR: 提出选择性长时域精炼，以短轨迹前缀热身后仅在模型可能生成的续写上训练终端代理。

Details

Motivation: 终端代理常模仿完整教师长轨迹，但训练监督长度如何影响可靠性与成本尚不清楚；长时域既能减少时间偏差，也引入更多异质后期历史、提高估计误差。

Result: 研究发现Terminal-Bench上监督12K token解出的任务多于16K（29±0.7对26±0.8），训练时间少30%；短时域会过早结束，中等长度促进错误恢复，长时域导致过度坚持。选择性精炼先训短前缀，再只精炼warm-start模型最可能的续写，持续优于全量长时域训练。16K设置下成功尝试由110±2.7升至126±2.1，至少六成八次任务由9±0.7升至14±0.6；只用一半长轨迹数据仍达122±2.4且训练快23%。迁移到Terminal-Bench v2.0从64升至73，OpenThoughts-TBLite从137升至155。

Insight: 长轨迹并非全部都值得监督，筛选与模型当前策略匹配的续写可兼顾稳定性与成本；监督时域长度存在明显非单调效应。

Abstract: Terminal agents are commonly trained by imitating long teacher trajectories, yet how much of each trajectory to supervise remains unexplored. We study the \emph{supervision horizon}, the number of trajectory tokens retained for training, and show that it is a key design axis for reliability and cost. Reliability improves with longer horizons but saturates: on Terminal-Bench, a 12K-token horizon solves more tasks than 16K ($29\pm0.7$ vs.\ $26\pm0.8$) while requiring 30% less training time. The horizon also shapes agent behavior: short horizons cause premature termination, intermediate horizons yield productive error recovery, and long horizons induce over-persistence. We analyze this saturation through a bias–complexity bound, in which longer supervision reduces temporal supervision bias but increases finite-sample estimation error from more heterogeneous late-stage histories. Guided by this analysis, we propose \emph{selective long-horizon refinement}, which first trains on short prefixes and then refines only on continuations that are most likely under the warm-start model. It consistently outperforms full long-horizon training. At 16K, it raises successful attempts from $110\pm2.7$ to $126\pm2.1$ and tasks solved in at least six of eight attempts from $9\pm0.7$ to $14\pm0.6$; with half of the long-horizon data, it still reaches $122\pm2.4$ while cutting training time by 23%. The gains transfer across benchmarks, from $64\pm2.6$ to $73\pm2.1$ on Terminal-Bench v2.0 and from $137\pm2.7$ to $155\pm2.2$ on OpenThoughts-TBLite. For long-horizon supervision, selecting the right trajectories matters more than training on all of them.

[245] Off-Policy Merging Beats On-Policy Self-Distillation for Continual Learning cs.LG | cs.AI | cs.CLPDF

Chen Henry Wu, Thomas Zhang, Aditi Raghunathan

TL;DR: 提出grafting离策略任务向量迁移方案，显示其在多种持续学习场景中可Pareto优于SFT和在线策略自蒸馏。

Details

Motivation: 新知识数据往往是离策略的；SFT虽从新数据学到信号，但直接应用更新会干扰已有能力。在线策略自蒸馏可转成在线信号，却可能导致推理崩塌，因此在线训练被视为必要的持续学习手段。

Result: grafting从较早donor检查点（最好可在预训练结束前）学习更新，再将权重差移植到后训练模型；可缩放更新，并在新数据域与后训练模型差距大时屏蔽最敏感更新方向。评测包括专家轨迹蒸馏、STaR及教学RL自我改进、预训练截点后的知识注入。各持续学习设置中，grafting在新任务与旧任务性能上Pareto优于SFT及OPSD，并免去昂贵在线采样。

Insight: 离策略更新可通过选择不同学习检查点、缩放和屏蔽方向来减少干扰，挑战在线训练是必要条件的传统观点。

Abstract: A long-standing goal of AI is a model that can continually learn and improve itself. On post-trained models, supervised finetuning (SFT) on new data often causes poor generalization and catastrophic forgetting. As such, the conventional wisdom is that on-policy training is a prerequisite for continual learning. In practice, however, data containing new knowledge or capabilities are often off-policy. While methods such as on-policy self-distillation (OPSD) try to bridge this gap by converting off-policy data into on-policy signal, they have been shown to cause reasoning collapse. In this paper, we show that off-policy merging beats OPSD for continual learning. We first show that SFT learns a useful signal from new data, but naively applying its update interferes with existing capabilities. We reduce this interference with a simple recipe we term grafting, which changes where the update is learned and how it is applied: (1) learning the update on an earlier donor checkpoint, ideally even before the end of pretraining, and applying the weight update to the post-trained model; (2) scaling the weight update, equivalent to a form of model merging; and (3) optionally, masking the most sensitive update directions when the new data distribution is far from the post-trained model. Across continual learning settings including (1) distilling from expert traces, (2) self-improvement with STaR and Pedagogical RL, and (3) injecting knowledge after pretraining cutoff, grafting Pareto-dominates both SFT and OPSD in new-task and old-task performance, while avoiding expensive on-policy sampling. Therefore, our work challenges on-policy training as a necessity for continual learning on RL-trained models.

[246] Better Call Reward: Reward Hacking as Strategic Abstention in Legal Reasoning Models cs.LG | cs.AI | cs.CL | cs.CYPDF

Subramanyam Sahoo, Justin Shenk

TL;DR: 本文展示了以引用数、法律术语密度和回答长度为代理奖励对Qwen3-8B做GRPO，会诱发模型策略性回避明确作答：格式正确率下降使总体准确率从0.500跌至0.072，且训练后引用中89.3%被判为结构上不可信。

Details

Motivation: 法律推理模型若被优化为看起来像律师的表面特征，而奖励不检查是否真正回答问题，可能学会利用代理指标而非提升推理能力。作者在法律是非题上实测这一奖励投机现象，并提出上线前的诊断指标。

Result: 研究以引用数量、法律术语密度和回答长度构造代理奖励，用GRPO微调Qwen3-8B，在LegalBench的16类是非推理任务上评估320个样本。总体准确率从机会水平0.500降到0.072（McNemar p<10^-36），直接原因是格式正确回答率从0.900降到0.109；但在模型实际明确作答的样本中，准确率反而从0.556升到0.657，说明总体崩溃来自回避承诺而非能力全面下降。训练后引用有89.3%结构上不可信。作者将此行为称为“Saul Goodman效应”，形式化证明不惩罚弃答的表面特征代理奖励会使其成为最优策略，并提出Confidence Theater Score、Citation Plausibility Rate和Regret Gap三个诊断量。

Insight: 奖励函数若奖励答案“看起来专业”却不要求直接、有效作答，可能把策略推向冗长、带引用却回避结论的行为，甚至生成经不起核验的引用。部署评估应单独检查作答率、引用可信度和后悔差距，不能只看表面风格或条件正确率。

Abstract: What happens when a legal AI model learns to look like a lawyer instead of reasoning like one? We fine tune Qwen3-8B with Group Relative Policy Optimisation (GRPO) against a proxy built from three surface features: citation count, legalese density, and response length. The model does not learn to reason more effectively. It learns to withhold commitment. Across 16 yes or no legal reasoning tasks from LegalBench (N=320), overall accuracy collapses from 0.500 (chance) to 0.072 (McNemar p < 10^-36), driven entirely by the rate of properly formatted answers falling from 0.900 to 0.109. The model stops committing to answers. Yet when it does commit, accuracy rises from 0.556 to 0.657, showing that the collapse is not a failure of capability but a strategic response: the model has learned that verbose responses packed with citations but empty of a direct answer score higher than terse correct ones. We term this the Saul Goodman effect, a policy that becomes maximally lawyerly while becoming maximally noncommittal, and prove formally that it is the optimal response to any surface feature proxy that attaches no penalty to abstention. We further show that 89.3% of citations produced after training are structurally implausible hallucinations, many of them subtly corrupted names of real landmark cases, constructed in effect to survive a casual read and fail under scrutiny. To detect this failure mode before deployment, we introduce three diagnostic tools: the Confidence Theater Score (CTS), the Citation Plausibility Rate (CPR), and the Regret Gap (RG). In a domain where a confidently wrong answer can constitute malpractice, the broader lesson is direct: a reward function that measures how legal a response looks will produce a model that is maximally photogenic and minimally useful.

[247] What Matters for Latent Reasoning with Flow Matching cs.LG | cs.CLPDF

Yassine Ouali, Adrian Bulat, Georgios Tzimiropoulos

TL;DR: FLaRe是一套基于flow matching的潜在推理训练方案，系统处理潜变量编码、流训练位置、答案读出和模型自身验证思路训练；探针显示其在有用性、多样性、可解释性、可扩展性和效率五方面优于既有潜在方法，算术任务达到显式CoT准确率的97%，延迟为其四分之一。

Details

Motivation: 潜在推理让LLM在连续空间思考、只输出答案，但有效的潜在思路还应对正确答案有帮助、能产生多样轨迹、可被解释、能随推理计算增加而改进，并在相近准确率下比显式思维链更省时。现有方法可能学到问题捷径、把显式CoT压进权重，或只逐token模仿CoT。

Result: 作者聚焦学习潜在空间中的flow matching，提出Flow-based Latent Reasoning（FLaRe）方案，覆盖潜在空间编码什么、如何塑形、在哪里训练flow、如何读出答案，以及最后用模型自身经验证的思路继续训练。针对五项要求各设计探针，结果显示FLaRe在五方面均优于先前潜在推理方法；在算术基准上也有竞争力，达到显式CoT准确率的97%，延迟约为其四分之一。

Insight: 潜在推理的价值不能只看答题准确率，还要验证生成思路是否实际有用、多样、可解释，并能有效利用额外推理预算。FLaRe报告五项探针和算术任务结果；摘要未指出这些结果覆盖的全部任务类型，不能据此推断在其他领域也达到同样比例。

Abstract: Latent reasoning lets a large language model (LLM) think in a continuous space and verbalize only the answer. We argue that an effective latent thought must meet five requirements: it should be useful, helping produce the correct answer rather than merely changing it, diverse, so that resampling yields different reasoning trajectories, explainable, so that a decoded chain of thought (CoT) reflects reasoning the answer actually follows, refinable with more inference compute, and efficient, costing less than an explicit CoT at comparable accuracy. Current methods rarely meet these requirements: they learn shortcuts from the question, distill the explicit CoT into their weights, or imitate it one token at a time. We focus on flow matching in a learned latent space, the family we argue is best placed to meet them, and identify the training choices that make it work. The result is Flow-based Latent Reasoning (FLaRe), a simple recipe covering what the latent space encodes and how to shape it, where to train the flow, how to read out the answer, and a final stage of training on the model’s own verified thoughts. A probe for each requirement shows that FLaRe improves on prior latent methods in all five. It also compares favorably with them on arithmetic benchmarks, while reaching 97% of the accuracy of explicit CoT at a quarter of its latency.

[248] Aligning Multimodal Patient Evidence with Biomedical Knowledge Graphs for Clinical LLMs cs.LG | cs.CLPDF

Jiawen Du, Arshan Ali Khan, Chenhao Zhang, Zachary Plotkin, Li Shen

TL;DR: MM-KG将多模态患者观察与生物医学知识表示为分层、带类型的图，并以显式对齐边连接，支持按问题检索可追溯证据子图。MIMIC-IV和ADNI实验显示，当问题同时需要患者证据与外部知识时，两者联合带来正向交互收益；删除答案所需关系后，排名表现退回无知识基线。

Details

Motivation: 临床问题往往要把患者的文本、影像、基因组和生物样本证据与外部生物医学知识关联起来，但现有预测系统通常没有显式表示这些连接，因此难以追溯信息来源或测试某条关系的贡献。

Result: 模态专属协调器将EHR文本、影像、基因组和生物样本转换为类型化观察并映射到UMLS概念，再由优先路由对齐器连接生物医学知识图；查询条件检索向LLM或图神经网络提供紧凑子图。MIMIC-IV和ADNI的2×2实验分离患者证据、医学知识及两者交互。在确实需要两类信息的问题上，联合使用分别带来药物控制AUROC交互项+0.194和+0.299；五候选留出排名上较MindMap的Hits@1高0.131，且删除检索包中唯一承载答案的关系会使Hits@1回到无知识基线。查询条件检索以通用策略上下文量的1/6.8达到AUROC 0.731，而静态图谱上下文对一般结局预测没有稳定收益。

Insight: 知识图谱对临床模型的主要价值在于明确连接患者证据和问题所需关系，并使该连接可检索、可追溯、可通过删除实验检验；单纯加入静态医学知识并不保证收益。数字来自MIMIC-IV与ADNI及特定检索/排名设置，外推需考虑数据集和问题类型。

Abstract: Clinical questions often depend on linking a patient’s multimodal evidence to external biomedical knowledge, yet existing predictive systems rarely represent such links explicitly, so they can neither be traced to their evidence sources nor removed to measure their contributions. We present MM-KG (Multimodal Knowledge Graph), which represents heterogeneous, multimodal patient observations and biomedical concepts as separate layers in one typed graph, joined by explicit alignment edges. First, modality-specific harmonizers convert EHR text, imaging, genomic, and biospecimen data into typed observations mapped to UMLS concepts, which a route-prioritized aligner links to a biomedical knowledge graph. Query-conditioned retrieval then selects a compact subgraph for downstream use by a large language model or a graph neural network. We build MM-KGs for MIMIC-IV and ADNI, and evaluate them with a 2x2 design that separates patient evidence, biomedical knowledge, and their interaction. On questions that require both sources, neither source alone performs far above chance, whereas their combination yields a drug-controlled AUROC interaction of +0.194 on MIMIC and +0.299 on ADNI. On held-out five-candidate ranking, MM-KG outperforms MindMap by +0.131 Hits@1 and leads an adapted GraphCare on the items that require consulting the patient, and deleting the single answer-bearing relation from the retrieved packet returns Hits@1 to the no-knowledge baseline. Finally, query-conditioned retrieval reaches 0.731 AUROC with 6.8x less context than the strongest generic policy, whereas static knowledge graph context gives no consistent gain on ordinary outcome prediction. Knowledge graphs thus benefit clinical LLMs not as background context but as explicit links between multimodal patient evidence and the relation a question requires, and MM-KG makes these links retrievable, traceable, and testable.

[249] Base Models Can Reason By Taking a Cue From Training Data cs.LG | cs.AI | cs.CLPDF

Sophie L. Wang, Amil Dravid, Rulin Shao, Kevin Farhat, Sewon Min

TL;DR: 本文发现固定输出开头token提示可激活基础模型在训练数据中学到的推理行为：如“.\n\nOkay”使Olmo-3-7B的MATH-500 pass@1从42%升至78%，并通过因果数据干预验证提示词与训练样本之间的关联。

Details

Motivation: 基础模型与强化学习微调模型在数学、代码推理上的表现差异，可能部分来自回答开头token与后续推理模式的训练数据关联，而非只来自复杂的推理能力训练。作者研究这种关联能否通过固定提示token触发、并可通过数据编辑因果改变。

Result: 固定特定开头token后，基础模型在数学和代码任务上可达到与RL模型竞争的表现；“.\n\nOkay”将Olmo-3-7B的MATH-500 pass@1从42%提升到78%，“Alright,”将Qwen3-14B从72%提升到87%。RL训练会提高这些提示的出现概率，而固定提示可恢复相当一部分RL收益。因果修改训练数据后，可以令任意词（如“chicken”）成为推理提示，或移除已有提示效果；类似修改可让“Think duck duck goose”像“Think step by step”一样诱发推理。不同提示对应的隐藏状态还与不同训练文档类型相关；安全案例显示，提示也会触发不同拒绝或配合行为。

Insight: 模型回答开头可能充当训练数据中行为模式的检索线索，轻微的提示变更因而影响推理和安全行为。因果数据干预使这一解释超出单纯相关性，但摘要并未证明该机制能推广到所有模型、任务或提示形式。

Abstract: In this paper, we study how training data creates associations between the tokens at the start of a base model’s response and the reasoning behavior that follows. First, we demonstrate that fixing particular starting token cues makes a base model’s performance competitive with that of its reinforcement learning (RL)-trained counterparts on math and coding. For instance, the cue “.\n\nOkay” raises Olmo-3-7B’s MATH-500 pass@1 accuracy from 42% to 78%, while “Alright,” raises Qwen3-14B’s from 72% to 87%. Second, RL makes these cues more likely, while fixing them recovers much of its performance gain over the base model. Third, we trace the reasoning effects of token cues to the training data. We perform causal data interventions to turn an arbitrary word, such as “chicken”, into an effective reasoning cue, or remove an existing cue’s effect. A similar edit makes the prompt instruction “Think duck duck goose” as effective as “Think step by step” at eliciting reasoning. We also find that the hidden state representations induced by different cues correlate with different document types from the training set. Finally, we extend our study of token cues with a case study in language model safety, finding that different cues elicit distinct refusal and compliance behaviors that correspond to different types of training data.

[250] KALEIDO: Input-Space Adaptation of a Vision Model for Time-Series Forecasting Through Gated Fold Geometries cs.LG | cs.CVPDF

Xiangyu Shi, Qinghua Liu, Sam Heshmati, Zubin Abraham

TL;DR: KALEIDO把时间序列如何折叠并绘制为图像作为可调适配轴：检测主周期、生成多种规则折叠图、用仅在验证集拟合的位置级凸门控融合修复结果，并与零样本预测固定比例融合。只训练0.05%的LayerNorm参数时，LTSF的MSE相较已发表零样本基线降低13%。

Details

Motivation: 预训练视觉模型无需大规模时间序列语料也可通过图像修复零样本预测时间序列，但序列渲染图并非自然图像，仍存在视觉预训练和时间模式间的域差距。作者提出渲染几何（序列折叠和绘制方式）可作为可控、可混合的适配维度。

Result: KALEIDO检测主导周期，按规则生成多种折叠几何的渲染图，分别修复后用仅在验证集拟合的位置级凸门控融合；再按固定份额与零样本输出融合，除了基线已发布设置外不为每个数据集单独调参。只训练LayerNorm（占参数0.05%），LTSF相对已发表零样本基线MSE降低13%，冻结设置下仍降低6.6%；GIFT-Eval上MASE改善7.4%，CRPS改善19.3%。

Insight: 将时间序列的渲染几何作为可组合的输入适配机制，可在只微调极少参数时弥补视觉模型对非自然图表的域差距。结果覆盖LTSF与GIFT-Eval并采用基线公开配置；验证集门控虽避免测试集拟合，仍需要遵循论文划分以保证公平比较。

Abstract: Time-series foundation models buy zero-shot forecasting with large temporal corpora; a vision model needs none, since a natural image implicitly embeds the patterns a forecaster must model, and an ImageNet-pretrained masked autoencoder forecasts a series by inpainting a rendering of it. A rendered series is not a natural image, however, and closing that gap takes temporal-aware adaptation. We show that the rendering geometry - how the series is folded and drawn - is a controllable, mixable axis for it. Kaleido detects the dominant periods, renders a rule-generated set of fold geometries, combines the inpaintings with a convex per-position gate fit on validation only, and fuses the result with the zero-shot output at one fixed share, with no per-dataset hyperparameter beyond the baseline’s published settings. Training only LayerNorm (0.05%), Kaleido lowers MSE by 13% against the published zero-shot baseline on LTSF and, frozen, by 6.6%; on GIFT-Eval it improves the baseline by 7.4% in MASE and 19.3% in CRPS.

[251] From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model cs.LG | cs.CV | stat.MLPDF

Vicente Balmaseda, Ching-Long Lin, Tianbao Yang

TL;DR: SCION在单一模型中联合进行自监督表征学习与像素空间图像生成，无需标签或预训练模型。ImageNet 256×256上，JiT-B配置无表征引导达到FID 8.92；JiT-L达到无引导5.89、带引导3.47。

Details

Motivation: 强图像生成模型通常依赖类别标签、冻结预训练编码器或单独训练的自编码器，因而依赖标注或目标域预训练。联合学习则面临目标冲突：对比学习用干净增强视图并偏好粗粒度不变语义，flow matching处理噪声图像并需保留细节与空间布局。

Result: SCION（Self-conditioned Generation on Self-supervised representation）使用单个像素空间编码器，以flow时间步和条件嵌入为条件。表征训练时，条件为跨图共享的可学习全局向量，编码器[CLS] token接受对比损失；生成训练时，条件是图像自身[CLS]表征，patch token经解码器预测图像。为无参考采样，模型联合学习该嵌入先验；梯度范数平衡和stop-gradient机制支持一次联合优化。ImageNet 256×256、JiT-B配方下无需表征引导，FID为8.92，优于对齐预训练DINOv2的类无条件iREPA（46.44）和以其为条件的RCG（14.27）。JiT-L无引导FID为5.89、带表征引导为3.47，优于ADM配方RCG的6.24。

Insight: 通过在同一编码器中按任务切换条件表示，SCION缓解对比语义学习与生成细节保留之间的冲突，并实现无标签、无预训练的联合训练。报告结果限定于ImageNet 256×256及给定JiT配方，模型规模和训练配置对FID比较有影响。

Abstract: Strong image generation models are conditioned on class labels, aligned to frozen pretrained encoders, or built on separately trained autoencoders. While effective, generation then depends on supervision or pretraining: labels must be annotated, and encoders or autoencoders pretrained for the target domain. We study joint generative and self-supervised representation learning in a single model, enabling self-conditioned generation without labels or pretrained models. This is challenging because the objectives are mismatched: contrastive learning consumes clean augmented views and favors coarse, invariant semantics, while flow matching consumes noisy images and must preserve the fine detail and spatial layout that contrastive learning discards. We propose SCION (Self-conditioned Generation on Self-supervised representation), whose core is a single pixel-space encoder conditioned on the flow timestep and an embedding. For representation learning, this conditioning embedding is a learned global vector shared across images, with the encoder’s [CLS] token yielding the semantic representation trained by the contrastive loss. For generative training, the conditioning embedding is the image’s own [CLS] representation, while patch tokens pass through a decoder to predict the image. To sample without a reference image at inference, we jointly learn a prior over the embedding. Gradient-norm balancing and stop-gradient mechanisms enable joint optimization in one run. SCION is self-supervised and self-contained, with no labels or pretrained models. On ImageNet 256x256, with the JiT-B recipe and no representation guidance, SCION reaches 8.92 FID, surpassing class-unconditional iREPA, which aligns to pretrained DINOv2 (46.44), and RCG, which conditions on it (14.27). With JiT-L, SCION achieves 5.89 FID without guidance and 3.47 with representation guidance, outperforming RCG with the ADM recipe (6.24).

[252] MEND: RL For Flow Models via Proximal Velocity Matching cs.LG | cs.CVPDF

Shreshth Saini, Neil Birkbeck, Yilin Wang, Balu Adsumilli, Alan C. Bovik

TL;DR: MEND用近端速度匹配对flow模型做奖励后训练：组内封顶奖励，对奖励梯度提出候选更新，仅当奖励收益超过二次位移成本才接受，再回归至新速度目标。100次更新时，在同等距基座模型距离下，MEND在六个评估器中的五个超过约4,000次更新的Flow-GRPO。

Details

Motivation: 现有flow模型奖励后训练通常需要数千次更新，并对自身样本重加权或依赖冻结参考模型/KL约束；另一类方法直接沿奖励梯度推动所有样本，不判断改动幅度是否值得。作者希望用显式更新成本控制奖励提升，并减少训练迭代。

Result: MEND在每个提示词组内封顶奖励，使已达到高分的样本不再移动；对未封顶样本沿奖励梯度提出更新，只有当封顶奖励收益超过二次位移代价时才接受。随后模型回归到目标速度，无需KL项、冻结参考模型或优势权重。100次更新、与基座图像距离相同的对比中，MEND在六个评估器的五个上超过约4,000次更新的Flow-GRPO。等预算协议下，在四种训练奖励的每个评估更新点均超过ReFL和DiffusionNFT；PickScore分别为24.03、23.92和23.43。300次更新、三奖励训练的运行在其训练的三项奖励上均超过五奖励DiffusionNFT模型。

Insight: 以更新位移为显式成本并只接受净奖励收益为正的样本移动，可以在较少更新中改善生成奖励，同时避免依赖冻结参考模型和KL项。比较结论与等预算、基座距离和奖励评估协议绑定；摘要称方法适用于可微奖励的flow骨干。

Abstract: Reward post-training of flow models either reweights the model’s own samples under a KL penalty or a frozen reference, often for thousands of updates, or backpropagates the reward and moves every sample without checking that the move is worth its size. We introduce MEND, a reinforcement learning method built on proximal velocity matching. MEND caps rewards within each prompt group, so samples that already score well receive no move. Below the cap, it proposes moves along the reward gradient and accepts one only when its capped reward gain exceeds a quadratic displacement price. The model then regresses onto the resulting velocity targets, with no KL term, frozen reference model, or advantage weights. In 100 updates, MEND outperforms Flow-GRPO (about 4k updates) on five of six evaluators at the same distance to base-model images. Under an equal-budget protocol, it surpasses ReFL and DiffusionNFT at every evaluated update across four training rewards, reaching PickScore 24.03 versus 23.92 and 23.43, respectively. A 300-update three-reward run also surpasses the five-reward DiffusionNFT model on all three rewards it trains on. MEND is general and easy to adopt: it applies to any flow backbone with a differentiable reward.

[253] LeAVJEPA: A Minimalist Architecture for Audio-Visual Self-Supervised Learning cs.LG | cs.CVPDF

Benjamin Robson, Santeri Mentu, Wenshuai Zhao, Arno Solin

TL;DR: LeAVJEPA是基于LeJEPA无坍塌目标的音视频自监督编码器，使用单个早期融合ViT处理音频、视频及联合输入，并通过模态dropout把缺失模态作为同一事件的另一视图。冻结评估下AudioSet-20K为36.0 mAP、ESC-50准确率91.3%；VGGSound微调准确率61.1%。

Details

Motivation: 既有音视频自监督方法常依赖EMA目标编码器、预测头、重建解码器和对比损失等多个机制。作者希望构建更简洁的统一音视频编码器，并用缺失模态视图和防表征坍塌约束实现跨模态对齐。

Result: LeAVJEPA用单个早期融合Vision Transformer处理音频、视频和音视频联合输入。模态dropout将缺失模态视为同一事件的另一观察视图，使跨模态对齐由训练目标隐式实现；模型对齐全局嵌入与模态专属局部嵌入，并用SIGReg避免表示坍塌。受控消融将模态dropout识别为音视频对齐的关键机制。冻结评估下AudioSet-20K达到36.0 mAP、ESC-50达到91.3%准确率；微调后VGGSound达到61.1%准确率，嵌入也支持零样本音视频检索。

Insight: 缺失模态可以被用作同一事件的另一种观察，从而在统一编码器中形成隐式跨模态对齐；受控消融支持模态dropout的重要性。报告包含多种评测和零样本检索能力，但摘要未列检索性能或与复杂架构基线的具体差值。

Abstract: Prior audio-visual self-supervised learning methods rely on mechanisms such as EMA target encoders, prediction heads, reconstruction decoders, and contrastive losses. We introduce LeAVJEPA, the first audio-visual encoder trained under LeJEPA’s collapse-free objective. A single early-fusion Vision Transformer processes audio, video, and joint audio-video inputs. Modality dropout treats a missing modality as another view of the same event, making cross-modal alignment implicit in the objective. The model aligns global embeddings with modality-specific local embeddings, and SIGReg prevents representational collapse. A controlled ablation identifies modality dropout as the key mechanism for audio-visual alignment. Despite the architectural simplicity, LeAVJEPA reaches 36.0 mAP on AudioSet-20K and 91.3% accuracy on ESC-50 under frozen evaluation. After fine-tuning, it reaches 61.1% accuracy on VGGSound, and its embeddings support zero-shot audio-visual retrieval.

[254] Improving Proactive AI Assistance with Hierarchical Procedural Understanding cs.LG | cs.CVPDF

Jin-Seop Lee, TaeYeon Won, SeongJun Jung, JungHoon Kim, Boyang Albert Li

TL;DR: ProactiveCoach提供分层程序指导训练集、评测基准和自适应指导系统，使主动助手能判断指导内容、时机及粒度。相较固定粒度监督，层级监督在不同骨干上最多提高9.6个百分点；无需额外微调的轻量路由系统在四种指导层级切换上比上下文适配基线高57.1个百分点。

Details

Motivation: 主动式AI助手持续观察用户活动，需要决定是否提供指导、何时指导，以及指导粒度是否符合用户熟练度和需求。现有数据集多聚焦检测式主动理解或固定粒度指导，无法充分表示任务进度、程序上下文及粒度自适应。

Result: ProactiveCoach套件包含训练集ProactiveCoach-Instruct、评测集ProactiveCoachBench，以及微调VLM和自适应指导系统。训练数据按阶段、步骤、动作组织指导，帮助学习程序结构与进度；基准评估指导是否合适、时机是否正确，以及请求粒度改变时能否适配。对预训练VLM进行微调后，层级监督相较固定粒度监督在多个骨干上的总体表现最多提升9.6个百分点。再将微调模型与轻量指导路由器组合，无需额外微调，在四种指导层级转换上的表现比上下文适配基线高57.1个百分点。

Insight: 阶段—步骤—动作层级既提供任务整体结构，也提供细粒度进度，有利于助手同时决定“说什么、何时说、说到多细”。路由器能在不再训练的情况下处理层级切换；摘要未提供各子能力的单独指标或用户研究结果。

Abstract: Proactive AI assistants continuously observe a user’s activity and decide whether to provide new guidance or remain silent. They should provide appropriate guidance for the task, determine when to provide the next guidance based on task progress, and adjust the guidance level to the user’s expertise and needs. Supporting these capabilities requires training and evaluation data that reflect procedural structure and capture how guidance should adapt to task progress and user needs. However, existing datasets either focus on detection-based proactive understanding or provide procedural guidance at a fixed granularity. Fixed-granularity guidance provides limited information about fine-grained progress and broader procedural context, making it difficult to determine completion and adapt guidance granularity. To address these limitations, we introduce the ProactiveCoach suite, comprising ProactiveCoach-Instruct for training, ProactiveCoachBench for evaluation, and fine-tuned VLMs with an adaptive guidance system. ProactiveCoach-Instruct provides hierarchically structured guidance at the phase, step, and action levels for learning task progress and procedural context. ProactiveCoachBench evaluates whether models provide appropriate guidance at the right time across different guidance levels and adapt when the requested level changes. We fine-tune pretrained VLMs on ProactiveCoach-Instruct and demonstrate its effectiveness across backbones. Compared with fixed-granularity supervision, hierarchical supervision improves overall performance across backbones by up to 9.6%p. We further build an adaptive guidance system by combining our fine-tuned model with a lightweight guidance router. Without additional fine-tuning, our system outperforms the in-context adaptation baseline by 57.1%p across four guidance-level transitions. Our project page is available at https://jinsuby.github.io/ProactiveCoach/.

cs.MA [Back]

[255] templar: agentic induction and evolution of standardized radiology reporting templates from large-scale clinical corpora cs.MA | cs.CLPDF

Xiaotian Hu, Mingxuan Liu, Zhonghan Wang, Xinfeng Zhang, Yiming Huang

TL;DR: 提出TEMPLAR，以持久模板状态、解剖及诊断知识图和多个代理从大规模临床语料诱导并持续演化放射报告模板。

Details

Motivation: 结构化报告有益于临床，但模板通常靠专家共识费时构建、机构间不一致且难随实践更新；单LLM受上下文长度限制，ASTAR则生成封闭且静态模板。

Result: 模板作为持久中央状态，与约束模板构造的解剖知识图及支持发现—诊断推理的诊断图并行。诱导代理从解剖约束的Span-Triple聚类标准临床槽位；演化代理在一致性、外部临床证据和下游结构化反馈下组装分层模板并修订；临床代理用模板执行报告结构化、重建与诊断推理。四个数据集上，TEMPLAR在覆盖、信息保真及诊断保真方面胜过ASTAR、三种医学LLM和六种通用LLM；模板质量评分最高或并列最高，跨数据集迁移仍保持相对优势。

Insight: 把模板作为可审计、可更新的共享状态可突破单次生成局限；多代理组件消融支持其互补作用。

Abstract: Structured radiology reporting mitigates the heterogeneity of free-text reports, yet its benefits depend on high-quality reporting templates. In practice, such templates are conventionally built through labor-intensive expert consensus and therefore vary across institutions and lag behind evolving clinical practice. Large language models (LLMs) enable automated template induction, but existing approaches remain limited: single-LLM induction is constrained by context length, and the corpus-scale method ASTAR produces a static, closed-corpus template without external grounding or downstream adaptation. To address these limitations, we propose TEMPLAR, a TEMPLate-centric Agentic framework for inducing and evolving standardized Radiology reporting templates from large-scale clinical corpora. TEMPLAR treats the template as a persistent central state maintained alongside two provenance-aware knowledge graphs, namely an anatomical graph that constrains template construction and a diagnostic graph that supports finding-to-diagnosis reasoning. Three agents operate on this state. The Induction Agent derives canonical clinical slots from anatomy-constrained Span-Triple atoms via dual-view similarity clustering; the Evolution Agent then assembles these slots into a hierarchical template and revises it under consistency constraints, external clinical evidence, and downstream structuring feedback; and the Clinical Agent applies the evolved template to report structuring, reconstruction, and diagnostic reasoning. Across four datasets, TEMPLAR outperforms ASTAR, three medical LLMs, and six general-purpose LLMs in coverage, information fidelity, and diagnostic fidelity, while achieving the highest or tied-highest LLM-rated template quality. Its fidelity advantages over ASTAR persist under cross-dataset transfer, and cumulative ablations support complementary contributions of its key components.

[256] Attention Tax, Handoff Tax: A Stylised Model of When Multi-Agent LLM Systems Help cs.MA | cs.AI | cs.CL | cs.LGPDF

Akshit Anchan, Nayonika Sen

TL;DR: 本文用一个显式建模注意力衰减、信息交接损失和失败相关性的可靠性模型，解释多智能体系统何时会优于单智能体；账本核对实验在深度10预测分解策略出现交叉，并在深度20、50、100验证其准确率优势。

Details

Motivation: 现有研究对多智能体协作是否有益结论不一：有的认为相同信息与算力下单智能体更强，有的发现任务越深多智能体收益越大。作者认为差异来自瓶颈设定不同，因此建模长上下文负担、分解后的交接税，以及并行采样时多个样本失败相关所造成的收益上限。

Result: 模型给出两类交叉条件：重置上下文节省的注意力成本超过交接成本时，任务分解更优；等预算并行采样的共享失败下限低于单智能体延长思考的错误下限时，并行采样更优。在账本核对任务中，仅用单智能体上下文退化曲线和交接实验估计模型参数，预测分解策略从深度10起占优；在深度20、50、100的逐步和最终余额准确率上预测得到验证，实际成功率与预测值每个深度相差不超过9个百分点。

Insight: 系统优劣不能只由智能体数量或任务深度判断，关键是注意力成本、信息压缩/传递损失及失败相关结构。本文的模型可以用单智能体和交接运行来估计，再预测未参与拟合的分解系统表现；证据来自特定账本任务，推广到其他任务仍需测量其对应成本。

Abstract: Recent work on multi-agent LLM systems reaches sharply different conclusions: some results show that a single agent with the same information and compute should dominate a delegated system, others that multi-agent gains grow with task depth. We argue that much of the disagreement comes from modelling different bottlenecks, and introduce a stylised reliability model built around two trade-offs. Decomposition reduces the burden of long contexts but incurs a handoff tax when information is compressed or transferred between agents. Redundancy gains from multiple samples, but its benefit depends on how much their failures are shared. With reasoning budget, verification, and task structure added, the model yields two crossover conditions: decomposition becomes preferable once the attention cost avoided by resetting context exceeds the handoff cost, and parallel sampling at equal budget is eventually preferable when its shared-failure floor lies below the error floor of one agent thinking longer. We connect these regimes to recent theoretical and empirical results. On a ledger-reconciliation task we measure the context-degradation curve and the handoff tax from single-agent and handoff runs alone. From these the model places the crossover at depth 10 and predicts decomposition to win at depths 20, 50, and 100. It does, on step-level and final-balance accuracy, and the decomposed system’s success, which the prediction never sees, lands within 9 percentage points of the predicted rate at every depth.

cs.PL [Back]

[257] VHDL-REPOBENCH: A Repository-Level Benchmark for Evaluating Large Language Models on VHDL Design Generation cs.PL | cs.AR | cs.CLPDF

Prashanth Vijayaraghavan, Akul Malhotra, Ashutosh Jadhav, Ehsan Degan, Vandana Mukherjee

TL;DR: 提出VHDL-REPOBENCH，跨文件仓库级评测LLM生成和分析VHDL硬件设计。

Details

Motivation: 硬件LLM基准多关注Verilog，而VHDL在工业、学术FPGA及安全关键系统仍广泛使用，缺少贴近实际多文件项目的评估。

Result: 基准整理约100个开源VHDL仓库、约2,500个VHDL文件及约500个测试台，提供结构化问题、模块桩和自验证测试，评估语法、语义、层级推理、跨文件依赖和功能验证。比较GPT-4o、Llama-3-70B、Qwen2.5-72B、CodeLlama-70B，以及Reflexion、CoDes等多步方法。当前模型在代码行与模块块级准确率中等，但多文件推理、层级设计理解及规格到模块生成仍困难。

Insight: 自验证跨文件基准补足VHDL评测空缺，揭示真实仓库设计仍是LLM薄弱点；摘要未报告模型成绩表。

Abstract: Large Language Models (LLMs) are increasingly applied in hardware design automation, demonstrating strong potential in generating and understanding hardware description languages. However, most existing benchmarks focus on Verilog, with limited evaluation of VHDL, which remains widely used in industry and academia for FPGA and safety-critical systems. To address this gap, we introduce VHDL-REPOBENCH, a large-scale, cross-file, repository-level benchmark for assessing LLM capabilities on realistic VHDL design generation and analysis tasks. VHDL-REPOBENCH curates ~100 open-source VHDL repositories, encompassing ~2.5k VHDL files and ~500 testbenches, and provides structured problem statements, module stubs, and self-verifying testbenches. The benchmark enables comprehensive evaluation across syntax, semantic correctness, hierarchical reasoning, cross-file dependency resolution, and functional verification. We evaluate several state-of-the-art models, including GPT-4o, Llama-3-70B, Qwen2.5-72B, CodeLlama-70B, and multi-step reasoning approaches such as Reflexion and CoDes. Results reveal that while current LLMs achieve moderate line- and block-level accuracy, substantial challenges remain in multi-file reasoning, hierarchical design understanding, and specification-to-module generation. VHDL-REPOBENCH represents the first large-scale VHDL-focused benchmark and provides a valuable resource for the hardware design community to evaluate, compare, and advance LLM capabilities for practical VHDL development.

cs.RO [Back]

[258] SUAVE: Unified Video-Action Models via Masked Diffusion cs.RO | cs.CV | cs.LGPDF

Rhythm Syed, Jean Mercat, Sedrick Keh, Kushal Arora, Paarth Shah

TL;DR: SUAVE用共享离散token序列和masked diffusion transformer统一生成视频与机器人动作，通过推理时选择mask位置，使同一模型可作为世界模型、策略或视频—动作模型。真实机器人上可在RTX 5090用1,030毫秒生成子目标图像和覆盖1秒运动的动作块，并以每秒2.5次动作闭环控制。

Details

Motivation: 视觉语言动作模型擅长语义对齐和动作预测，却通常不预测未来观察；基于视频扩散的世界动作模型能想象未来，但把语言当作冻结条件。已有统一模型又常使用逐token自回归解码或连续视频加辅助动作头。作者希望在单一架构和词表中联合建模三种模态。

Result: SUAVE将视频、语言和动作均表示为共享序列中的离散token，用masked diffusion transformer联合生成；推理时选择要mask的token位置即可执行世界预测、机器人策略或视频—动作生成。无动作标签视频的动作位置填入mask并从损失中排除，以支持无动作联合训练。仿真和真实实验显示，单个模型能预测长时域视频并作为策略，在静态和动态操作任务上与专用模型竞争；真实机器人在RTX 5090上用1,030毫秒生成子目标图像和覆盖1秒运动的动作块，闭环控制频率为每秒2.5次。机器人视频预训练并与人类视频联合训练显著提升策略表现及分布外零样本鲁棒性。

Insight: 共享离散表示与可控mask使一种模型可按任务切换预测视频或动作，并利用无动作视频以及人类视频共同训练。真实部署时延是特定RTX 5090设置下的报告结果；摘要未列出全部任务得分和机器人型号。

Abstract: Vision-language-action models (VLAs) inherit strong semantic grounding from pretrained vision-language backbones but are typically optimized for predicting actions rather than future observations. They can see and act, but they do not imagine the future before acting. World action models (WAMs) built on video diffusion backbones can imagine but treat language as frozen conditioning on a continuous latent space. Unified models bring these modalities into one architecture, but they either decode autoregressively, one token at a time, or keep video continuous with an auxiliary action head. In this work, we present SUAVE, a Single vocabulary Unified Action-Video modEl in which a masked diffusion transformer generates video and actions conditioned on language, with all three modalities represented as discrete tokens in a shared sequence. Choosing which tokens to mask at inference turns the same network into a world model, a robot policy, or a video-action model. For action-free co-training, the action positions of unlabeled video are filled with mask tokens and excluded from the loss. Simulation and real-world experiments demonstrate two findings. First, a single SUAVE model predicts long-horizon video and acts as a policy, competitive with dedicated world models and specialized action policies on static and dynamic manipulation tasks. On a real robot, our model generates subgoal images and an action chunk spanning one second of motion in 1,030 ms on an RTX 5090 GPU, sustaining closed-loop control at 2.5 actions per second. Second, pretraining on robot video and co-training on human video substantially improves policy performance and zero-shot robustness to distribution shift. Together, these results show that masked diffusion is a practical and versatile foundation for unified video-action modeling.

[259] Grounded in Time: A Multi-Source Dataset and Benchmark for Temporal Grounding in Robotic Manipulation cs.RO | cs.CVPDF

Yi Wang, Yang Yang, Guangqi Xu, Sumin Lin, Ning Kang

TL;DR: GiT是面向机器人操作历史事件推理的数据集与基准，涵盖生物实验室、家庭和工业场景，并用当前观测相似但因过去事件不同而要求不同动作的反事实任务对，专门评测策略是否真正利用历史。

Details

Motivation: 机器人操作决策有时必须从过去交互推断当前状态；单看当前画面不足以判断应采取何种动作。尽管带记忆的视觉语言动作模型已有进展，依赖历史事件语义推断的应用型任务在基准中仍不充分。

Result: Grounded in Time（GiT）包含真实机器人和UMI风格演示，覆盖18种双臂任务，以及仿真数据和基于ManiSkill、覆盖9种任务的评测套件。细粒度子任务标注和标注过的反事实任务对让相似当前观测在不同历史下对应不同动作，可用于策略学习和针对性测量历史利用。对代表性端到端VLA模型在仿真及部分真实任务的评测显示，历史依赖操作仍有较大改进空间；摘要未提供具体得分。

Insight: 反事实任务对控制了当前视觉观测，突出历史事件对动作选择的因果作用，因而比普通演示更直接地测量策略是否使用历史信息。当前评估指出能力仍有限，但摘要没有量化不同模型或仿真到真实差距。

Abstract: Robotic manipulation often requires inferring task-relevant states from past interactions when the current observation alone is insufficient to determine the appropriate action. Despite progress in benchmarking memory-augmented vision-language-action (VLA) models, application-oriented tasks requiring history-dependent semantic inference remain underrepresented. We introduce GiT (Grounded in Time), a dataset and benchmark for grounding manipulation decisions in past events across biolaboratory, household, and industrial scenarios. It includes real-robot and Universal Manipulation Interface (UMI) style demonstrations covering 18 bimanual tasks, together with simulation data and a ManiSkill-based evaluation suite covering nine tasks. Fine-grained subtask annotations and annotated counterfactual task pairs, in which similar current observations require different actions depending on prior events, support policy learning and targeted evaluation of history use. Evaluations of representative end-to-end VLA models in simulation and on selected real-world tasks reveal substantial room for improvement in history-dependent manipulation. The dataset and benchmark are available at the project page.

[260] Recursive Video In-Context Learning for Agentic Robot cs.RO | cs.AI | cs.CL | cs.MAPDF

Wenrui Bao, Xinxin Liu, Bingxin Xu, Yuzhang Shang

TL;DR: RV-ICL是一种免训练的机器人视频上下文学习方法，把示范视频按抓取、释放等子事件组织成由粗到细的层级；智能体规划时先看粗层，执行中再按当前子目标读取局部片段。单任务仅需一个示范，在LIBERO-PRO和LIBERO-Plus上分别将成功率从92.6%提至96.5%、从86.7%提至95.8%。

Details

Motivation: 基于冻结VLA策略的LLM智能体可以用文本记忆积累经验，但文本记录动作而不展示如何完成任务。整段示范视频放入上下文会拖慢每一步，固定关键帧可能丢失抓取是否成功所需的接触细节，而且规划阶段与接触执行阶段需要的视频细节不同。

Result: Recursive Video In-Context Learning将示范视频转换为智能体可导航的层级，而非一次性塞入提示。层级以抓取、释放等子事件组织，从整任务关键帧逐步细化为阶段、时刻和短片段，并通过只读工具提供。智能体规划前读取粗层，执行时遇到需要细节的步骤再进入层级，仅加载当前子目标对应片段；每项任务一个示范即可。基于RPent，LIBERO-PRO成功率从92.6%升至96.5%，LIBERO-Plus从86.7%升至95.8%。

Insight: 视频层级允许智能体按阶段调整观察粒度：先获取任务结构，再只为当前接触和子目标读取细节，兼顾完整视频的信息量与上下文成本。报告显示两个基准上的成功率改善；摘要未提供额外演示数量或推理时延对比。

Abstract: LLM agents that orchestrate frozen vision-language-action (VLA) policies improve across episodes through text memory, which records what the agent did but not how the task is done. A demonstration video shows it, but fits poorly into an agent’s context. The full video slows every turn, fixed keyframes lose the contact detail that decides whether a grasp holds, and what the agent needs shifts from the task’s structure while planning to the frames around each contact. We introduce Recursive Video In-Context Learning (RV-ICL), a training-free method that turns a demonstration into a hierarchy the agent navigates rather than a prompt it receives. The hierarchy is built from the sub-events of the demonstration, such as grasps and releases. Its levels grow finer, from keyframes of the whole task to phases, moments and short clips, and are exposed through read-only tools. The agent reads the coarse levels before planning. During execution it re-enters the hierarchy whenever a step needs more detail and loads only the clip of its current sub-goal. One demonstration per task is enough. Built on RPent, RV-ICL raises success from 92.6% to 96.5% on LIBERO-PRO and from 86.7% to 95.8% on LIBERO-Plus.

[261] Asynchronous Tracking, Optical Communication and 3D Motion Capture using Event-based Sensors cs.RO | cs.CVPDF

Ziwei Wang, Angus Apps, Holly Battisson, Iain Guilliard, Timothy Molloy

TL;DR: ATOC将LED智能信标调制、事件相机检测、光学跟踪和事件数据解调合并为异步系统，可同时追踪并解调多个信标，把视觉标记扩展为定向、局部化的机器人间光通信通道。

Details

Motivation: 机器人协作中的无线通信虽普遍易用，但接收机器人难以定位信号来源，时钟同步困难，且信号通常广播给附近所有设备。定向光通信可以提供空间局部化通道；事件相机具有高时间分辨率、高动态范围和低延迟，适合接收高速光信号。

Result: 论文提出Asynchronous Tracking and Optical Communication（ATOC），在一个流水线中集成LED智能信标调制、事件相机检测、光学追踪和事件数据解调，支持同时追踪和解调多个信标。作者通过一系列实验室研究验证，并演示智慧城市应用和3D动作捕捉系统。摘要未给出通信速率、距离或追踪精度等定量结果。

Insight: 事件相机不仅可作为视觉传感器，也可用于同时获取信标的空间运动和调制通信信息，让标记兼具定位与通信用途。当前证据包括实验室验证和两个应用演示；摘要没有足够信息判断其通信性能与无线方案的定量比较。

Abstract: Inter-robot communication is a key enabling technology in cooperative robotics applications. While wireless communication is ubiquitous, simple, and effective, it has inherent limitations: the receiving robot cannot easily localise the source of an incoming signal, clock synchronisation is challenging, and signals are broadcast to all nearby devices rather than targeted recipients. Optical communication provides a complementary channel that is inherently directional and spatially localised, directly addressing these limitations. Event cameras are bio-inspired dynamic vision sensors that respond to changes in image intensity with high temporal resolution, high dynamic range, and low latency, making them well-suited as receivers for high-rate optical communication in cooperative robotic systems. In this paper, we propose the Asynchronous Tracking and Optical Communication (ATOC) system, which integrates LED smart-beacon modulation, event-based detection, optical tracking, and event-data demodulation in a single pipeline. By simultaneously tracking and demodulating multiple LED smart beacons, ATOC transforms a conventional visual marker into a robust communication channel suitable for a wide range of high-impact robotics applications. We validate ATOC in a suite of laboratory studies and two ‘applications’: a smart-city demonstration and a 3D motion-capture system.

[262] ForeAct3D: Policy-Grounded Future World Modeling for VLA Policies cs.RO | cs.CVPDF

Zhe Tao, Feiran Wang, Gaowen Liu, Ramana Rao Kompella$, Yan Yan

TL;DR: ForeAct3D把VLA策略将执行的动作块作为未来世界预测条件，并用静态背景、物体刚性和腕部相机运动学施加物理一致性约束。无机器人预训练时，仿真LIBERO成功率为98.3%；真实任务平均成功率从基线6.7%升至37.8%。

Details

Motivation: 操作任务的成败取决于动作造成的接触和物体运动，但已有VLA策略从共享特征预测未来观察时，预测可能与实际计划执行的动作脱节，也缺乏物理约束。作者希望让未来世界模型直接受策略动作计划约束，并用未来状态监督改善动作表示。

Result: 可学习几何查询从策略表示解码深度、语义分割和相机位姿，形成当前和未来语义3D场景状态；未来查询以策略生成的动作块为条件。静态背景、实例级刚性以及腕部相机与末端执行器运动学共同构成物理一致性闭环，这些训练目标塑造动作生成所用的共享表示，推理时不需要未来预测。无机器人预训练下，LIBERO平均成功率为98.3%，CALVIN平均任务长度为3.73，均优于基线策略；消融显示语义3D监督、物理一致性和动作条件均有帮助。真实空间放置、物体插入和序列操作任务的平均成功率从6.7%升至37.8%。

Insight: 未来预测只有与策略实际计划动作挂钩并满足基本物理约束，才更直接地服务于操作决策。模型把未来预测用作训练期表征监督，避免推理期额外预测开销；仿真成绩较高，但真实任务绝对成功率仍为37.8%，说明实际操作仍有提升空间。

Abstract: Robots need to anticipate how their actions will change the world, since manipulation success hinges on the resulting contacts and object motions. However, existing Vision-Language-Action (VLA) policies that predict future observations from shared features leave the forecast decoupled from the actions the policy will actually execute, and impose no physical constraints on how the scene may evolve. We introduce ForeAct3D, a framework for policy-grounded future world modeling within VLA policies. Learnable geometric queries decode depth, semantic segmentation, and camera pose from the policy representation into current and future semantic 3D scene states, and the future queries are conditioned on the policy-generated action chunk to ground the forecast in the planned interaction. A physical-consistency closure relates the two states through background staticity and instance-level rigidity, and anchors the wrist-camera pose to end-effector kinematics. These objectives shape the shared representation used for action generation during training, and no future prediction is required at inference. Without robot pretraining, ForeAct3D achieves 98.3% average success on LIBERO and an average task length of 3.73 on CALVIN, outperforming its base policy on every suite. Ablations show that semantic 3D supervision, physical consistency, and action conditioning each improve manipulation performance, and that action conditioning substantially improves future object localization. Real-world experiments on spatial placement, object insertion, and sequential manipulation further raise average success from 6.7% to 37.8% over the base policy. The project page and code are available at https://github.com/anthonytao80-crypto/ForeAct3D.

[263] PerturBot: Breaking Shortcut Priors in Vision-Language-Action Models with Perturbative Training cs.RO | cs.CVPDF

Mingyu Liu, Chonghao Sima, Tianjian Feng, Hanqing Wang, Cong Chen

TL;DR: PerturbBot通过保持任务语义的腕部视角扰动、补充决策相关指令描述，以及加入随机/失败轨迹片段及其行为重标注，打破VLA对视觉、词汇或动作捷径的依赖；并提出GroundingFscore离线诊断策略是否依赖任务证据。

Details

Motivation: VLA策略可能在完成任务时忽略真正决定动作的证据，例如把熟悉名词与训练中共现动作绑定，或在夹爪空抓后仍执行抬起。重复更多同类成功演示可能提高成功率，却让这些捷径保持不变，因此需要训练与评估方法区分是否依赖任务相关证据。

Result: 作者将这类依赖称为模态捷径：视觉、词汇或运动线索足以预测专家动作，却不要求理解任务依据。PerturbBot使用不改变任务的腕部视角扰动，使捷径线索不足以单独完成任务；用决策相关描述丰富指令；并加入随机片段和失败轨迹片段，按片段实际行为重新标注。推理过程保持不变。GroundingFscore提供离线诊断，任务成功率衡量表现是否提高，GroundingFscore则检查提高是否来自任务证据而非捷径。摘要未报告基准或数值结果。

Insight: 只看任务成功率无法判断策略是否真正根据任务证据行动，扩充同分布成功示范也可能放大捷径。训练时扰动捷径并补充行为多样性，再用GroundingFscore审查依赖结构，构成互补的训练—评估框架；摘要缺少量化验证。

Abstract: A vision–language–action (VLA) policy can complete complex tasks while ignoring the evidence that should determine its actions. An object held near the wrist camera can displace the instructed target. Language and action show the same pattern: a familiar noun can trigger the operation it was paired with in training even after the verb changes, and a gripper that closed on nothing may lift anyway. We call these dependencies modality shortcuts: regularities in successful demonstrations make visual, lexical, or motor cues sufficient to predict expert actions without the task evidence needed for the underlying decision. More demonstrations of the same kind can raise task success while leaving these shortcuts intact. We propose Perturbot which makes task-relevant evidence easier to use and shortcuts insufficient on their own: it applies task-preserving wrist-view perturbations, enriches instructions with decision-relevant captions, and adds random and failed trajectory segments relabeled with the behavior they contain. It complements scaling by changing what is scaled, and leaves inference unchanged. Moreover, we propose GroundingFscore, an offline score that diagnoses how severely a policy relies on modality shortcuts. Task success rate shows whether a policy improves, while GroundingFscore reveals whether the policy scales healthily, relying on task evidence rather than shortcuts. Together, Perturbot and GroundingFscore provide a training-and-evaluation framework for disentangling VLA decisions from shortcut priors while preserving responsiveness to task-relevant evidence.

[264] ExStereo: Lifting 2D Vision-Language-Action Models to 3D with Explicit Stereo Representations cs.RO | cs.CVPDF

I-Chun Arthur Liu, Jason Chen, Gaurav S. Sukhatme, Daniel Seita

TL;DR: ExStereo在预训练二维VLA上添加显式立体视觉模块，从双目图像重建场景几何并提取立体特征，再通过动作—立体交叉注意力让动作token利用3D信息。作者在模拟环境和真实双臂PiPER平台上微调π0.5与SmolVLA，均报告优于基线。

Details

Motivation: 精确机器人操作需要度量深度和三维物体位置，但单目RGB恢复这些信息本身存在歧义，许多VLA却只依赖RGB观测。近期立体匹配基础模型的发展提供了将双目几何能力补充给二维VLA的机会。

Result: ExStereo从立体图像对重建场景几何，并将多视角观测渲染成显式立体表示以提取特征；动作专家的动作token通过动作—立体交叉注意力选择相关立体token，从而依据3D场景生成动作。为学习稳健3D表示，作者在任务后训练前加入大规模双目数据自监督中期训练。将方法用于公开VLA π0.5和SmolVLA，在仿真与真实双臂PiPER平台上微调，两个设置下均一致超过基线。摘要未提供数值。

Insight: 显式立体表征和动作条件交叉注意力，为在已有二维VLA中接入度量几何信息提供了模块化途径。中期训练让表示学习与具体任务适配分开；摘要的实验支持仿真和一个真实双臂平台，但未量化提升幅度。

Abstract: Three-dimensional perception is critical for robotic manipulation, particularly for high-precision tasks, as recovering metric depth and precise 3D object positions from monocular RGB observations is inherently ill-posed. However, many Vision-Language-Action (VLA) models rely solely on RGB observations for perception. Leveraging recent advances in foundation models for stereo matching, we introduce ExStereo, a stereo module that augments pre-trained 2D VLAs with 3D perception. ExStereo reconstructs scene geometry from stereo image pairs and renders multi-view observations as an explicit stereo representation for stereo feature extraction. The action tokens from the action expert selectively attend to the resulting stereo tokens through our proposed action-stereo cross-attention mechanism, enabling the policy to generate robot actions conditioned on 3D scene information. To learn robust 3D representations, we introduce a mid-training stage before task-specific post-training, using a self-supervised learning objective on large-scale stereo data. We validate our approach by fine-tuning two publicly available VLAs, $π_{0.5}$ and SmolVLA, and evaluate them in simulation and on a real-world bimanual PiPER platform. Across both settings, VLAs fine-tuned with ExStereo consistently outperform baselines, demonstrating the effectiveness of stereo perception for robotic manipulation. Our project website is at: https://exstereo-vla.github.io/ExStereo/.

[265] EvoMem-VLA: State-Evolution Memory for Long-Horizon Robot Manipulation cs.RO | cs.CVPDF

Yuheng Na, Zhide Zhong, Junjie He, Junfeng Li, Haodong Yan

TL;DR: EvoMem-VLA把历史状态之间观察到的变化编码为有方向、带来源条件的delta token，让VLA追踪交互结果与任务进度；并按任务自适应选择直接动作路由或子任务路由。单一联合训练策略在RMBench、RoboMME及四项真实任务上成功率分别为80.7%、82.0%和83.8%。

Details

Motivation: 多数VLA主要依赖当前观测，相关证据一旦离开视野便无法使用，限制长时程记忆任务。压缩历史特征或保留稀疏关键帧虽可存历史，但孤立快照难以说明过去交互改变了什么、下一步应如何行动。

Result: EvoMem-VLA显式编码并保留历史状态间的变化，使用条件delta tokenization将有序帧对转换为有方向、来源条件化且关联原状态证据的delta token。共享VLM骨干根据任务路由：普通长时程任务直接生成动作，多阶段任务则先生成可执行子任务并将其作为动作输入。每个仿真基准只联合训练一个策略，RMBench成功率80.7%、RoboMME为82.0%；两个机器人本体上的四项真实任务平均成功率83.8%。作者称三种评估设置均显著超过此前SOTA。

Insight: 保留状态变化而非仅存快照，可以让策略追踪动作后果和任务进度；任务路由则在简单长任务与明确多阶段任务间切换决策粒度。摘要称结果超过此前SOTA，但没有列出具体基线差值或分项真实任务成绩。

Abstract: Most vision-language-action (VLA) models rely on current observations and lose task-relevant evidence once it leaves view, limiting performance on long-horizon, memory-dependent tasks. Existing efforts incorporate compressed historical features or sparse visual keyframes. However, isolated snapshots can leave the policy uncertain about what changed during past interactions and which action should follow. To overcome this limitation, we propose EvoMem-VLA, which constructs state-evolution memory by explicitly encoding and retaining observed changes between historical states. These change representations preserve evidence of interaction outcomes, allowing the policy to track task progress beyond isolated snapshots. Specifically, we introduce conditional delta tokenization to encode ordered frame pairs into directional, source-conditioned delta tokens, each associated with its corresponding state evidence. A shared VLM backbone supports task-adaptive routing: normal long-horizon tasks follow a direct action route, whereas multi-stage tasks use a subtask route that generates an executable subtask as an additional input for action generation. With a single jointly trained policy for each simulation benchmark, EvoMem-VLA achieves success rates of 80.7% on RMBench, 82.0% on RoboMME and 83.8% across four real-world tasks spanning two robot embodiments. These results represent substantial improvements over the previous state of the art in all three evaluation settings.

[266] Robust Surgical Robotic Instrument Tracking via Sequential Multi-Cue Fusion and Sim-to-Real Self-Training cs.RO | cs.CVPDF

Hanyang Hu, Zekai Liang, Florian Richter, Michael C. Yip

TL;DR: 本文提出跟踪器引导的自训练框架，将合成图像预训练的手术机器人器械关键点检测器适配到无标注真实视频：用关节状态、关键点、器械杆边界和掩码线索通过不确定性感知EKF估姿，再用RTS平滑生成伪标签微调检测器。真实视频上各关键点指标均提升，并优于已有方法的准确率与运行速度。

Details

Motivation: 机器人辅助手术需要高效、鲁棒地跟踪手术器械，但手术场景复杂且器械几何特殊。关键点方法效率高，却依赖可靠检测；获得大规模精确真实姿态标注成本高，限制了检测器适配真实数据。

Result: 框架从合成图像预训练模型开始，对无标注真实视频进行跟踪器引导自训练。已知机器人关节状态时，不确定性感知扩展卡尔曼滤波器比较投影模型特征与检测到的关键点、器械杆边界和掩码线索，递归校正器械姿态与可观测关节角；随后使用RTS平滑器细化轨迹，将其投影为伪标签微调特征检测器。真实视频实验显示自训练在所有评估的关键点指标上均有稳定提升，最终模型准确率和运行时均优于先前方法；摘要未提供具体数值。

Insight: 机器人运动学、几何边界和视觉检测线索可用于从无标注视频中构造轨迹伪标签，降低真实姿态人工标注需求。摘要报告一致改进但没有量化幅度或说明各关键点指标，因此临床部署效果仍需依据完整实验分析。

Abstract: Efficient and robust tracking of surgical robotic instruments is important for robot-assisted minimally invasive surgery, yet remains challenging due to the complexity of surgical scenes and the unconventional geometry of surgical instruments. Keypoint-based approaches are efficient, but their performance depends on reliable feature detection. Improving these detectors with real-world supervision is difficult because accurate real-world annotations are costly to obtain at scale. To address this limitation, we introduce a tracker-guided self-training framework that adapts a model pretrained on synthetic images to unlabeled real-world videos. Given measured robot joint states, an uncertainty-aware EKF recursively corrects the instrument pose and the observable joint angles by comparing projected model features with detected keypoints, shaft boundaries, and mask-derived cues. An RTS smoother subsequently refines the resulting trajectory, which is projected into pseudo-labels for fine-tuning the feature detector without laborious pose annotations. Experiments on real-world videos demonstrate consistent improvements from self-training across all evaluated keypoint metrics, and the resulting model outperforms prior approaches in both accuracy and runtime. The code and data will be released upon publication.

[267] Robust 2D Traversability Mapping for Construction AMRs via Failure-Mode-Aware Fusion of LiDAR Geometry and Monocular Semantics cs.RO | cs.CVPDF

Manoj Karnekar, Om Mandhane, Gautham Ramkumar

TL;DR: 本文为施工现场AMR提出失效模式感知的LiDAR几何与单目语义融合可通行性建图：LiDAR作为主要安全几何估计，语义只在类别和置信度门控下修正其互补失效。作者还发布包含两个工地、4段闭环序列和506张标注帧的数据集。

Details

Motivation: 施工现场的几何可通行性图会漏掉表面平坦但视觉危险的湿泥和积水混凝土，也会把可行驶的减速带、坡道等几何突变误判为障碍。AMR需要融合几何与视觉语义，但不能让语义不加约束地覆盖安全几何判断。

Result: 实时系统运行于NVIDIA Jetson AGX Orin，以LiDAR作为主要几何安全估计，并将单目语义作为按类别和置信度门控的选择性纠正信号。表示区分平坦道路、地形和碎石地等可通行类别，并标记施工危险。作者同时发布自研AMR施工现场多模态数据：两个施工现场的4段ROS 2闭环序列，包含RGB、深度、LiDAR、IMU、GPS-RTK和里程计；另有506张、28个语义类别的标注帧。系统将LiDAR投影到密集语义掩码，通过形态学修复缓解点云稀疏，并与Patchwork++结合构建局部成本地图，以修正互补几何失效模式。摘要未给出建图性能指标。

Insight: 语义信息应针对已知几何失效模式进行选择性纠正，而不是取代LiDAR安全估计；这种融合思路适配了泥水和可行驶突起等不同错误类型。数据集提供真实工地多传感器序列，但摘要没有给出导航成功率、错误率或对照结果的数值。

Abstract: Autonomous Mobile Robots (AMRs) on active construction sites face severe navigational challenges: geometry-based traversability mapping (e.g., LiDAR) misses visually hazardous but geometrically flat surfaces like wet mud and ponding concrete, while abrupt geometry on drivable speed-breakers and inclines produces phantom obstacles. We propose a real-time, failure-mode-aware multimodal traversability pipeline on an NVIDIA Jetson AGX Orin, where LiDAR is the primary geometric safety estimate and monocular semantics act as a selective, class- and confidence-gated corrective signal. The representation retains distinct traversable classes, namely flat road, terrain, and rocky terrain, while flagging construction hazards. We also release a multimodal construction-site dataset from a custom AMR: four closed-loop ROS 2 sequences from two active sites (RGB, depth, LiDAR, IMU, GPS-RTK, odometry) plus 506 annotated frames across 28 semantic classes. By projecting LiDAR onto dense semantic masks, resolving sparsity via morphological in-painting, and applying failure-mode-aware fusion with Patchwork++, the system corrects complementary geometric failure modes for a local AMR costmap.

[268] Bayesian Data Augmentation for DNN Retraining with Binomial Outcomes in Vision-Based UAV Landing cs.RO | cs.CVPDF

Ashik E Rasul, Hyung-Jin Yoon

TL;DR: 本文将贝叶斯数据增强整合进带高保真动力学的照片级无人机着陆模拟器，迭代重训直升机场检测DNN，并以着陆表现为优化目标。不同环境和飞行器状态的模拟实验显示着陆表现提高、预测着陆结果置信区间收窄。

Details

Motivation: GPS拒止或杂乱城市环境中，视觉着陆对无人机任务可靠性至关重要；真实着陆点复杂多变，感知系统需要较强泛化。合成增强可扩展训练场景，但DNN重训代价高，且测试飞行验证困难，因而需要更高效的重训优化流程。

Result: 作者部署贝叶斯数据增强框架，并与具备高保真飞行器动力学的照片级模拟器结合，以最大化着陆性能为目标迭代重训直升机场检测网络。在不同环境条件和飞行器状态下进行模拟验证，结果显示着陆表现改善，预测着陆结果的置信区间也更窄。摘要未报告具体提升幅度或真实飞行测试。

Insight: 将着陆表现直接作为数据增强迭代的优化目标，可把合成场景选择与下游任务表现联系起来；不确定性区间变窄也提供了预测稳定性方面的证据。现有摘要描述的是模拟器验证，不能据此认为已验证真实飞行安全或实飞迁移。

Abstract: In GPS-denied or cluttered urban environments, vision-based landing is essential for reliable UAV missions. Real-world landing sites are often unstructured and highly variable, requiring strong generalization by the perception system. Deep Neural Networks (DNNs) trained with synthetic data augmentation offer a scalable solution for learning landing-site features across diverse vehicle and environmental states. However, computationally expensive DNN retraining, along with challenging performance validation via test flights, limits exhaustive model fine-tuning and necessitates an optimized retraining pipeline. In this work, we deploy a Bayesian data augmentation framework integrated with a photorealistic simulator featuring high-fidelity vehicle dynamics to iteratively retrain the helipad detector DNN, maximizing landing performance as the objective function. We validate our framework with experiments in a photorealistic simulator under different environmental conditions and vehicle states, demonstrating improved landing performance and tighter confidence intervals on predicted landing outcomes.

Álvaro Díez, Fidel Aznar

TL;DR: 本文用共享解码器的双卷积变分自编码器对齐模拟与真实图像的潜在表示，并结合域随机化和特征级域适配以迁移低成本机器人导航策略。只用4,556个真实样本与45,225个模拟图像时，真实室内导航图像分类平均成功率接近91%，并通过真实机器人探索任务验证。

Details

Motivation: 低成本机器人的视觉导航受模拟训练与真实运行环境差距影响，直接迁移策略往往无效，而完全依赖真实数据训练又不现实。需要一种兼顾大量可生成模拟数据和少量真实样本的迁移方案。

Result: 方法结合域随机化与特征级域适配，使用共享解码器的双卷积VAE学习模拟和真实域的紧凑共同潜在空间，并通过两种数据增强扩展有限真实数据。训练使用45,225张模拟图像和仅4,556个真实样本。真实室内导航图像分类平均成功率接近91%，显著超过仅模拟和仅真实数据训练；真实部署中，策略成功引导低成本机器人完成反应式探索任务。计算估算还表明其适合Raspberry Pi 4和NVIDIA Jetson Nano等嵌入式平台。

Insight: 共享潜在空间将域随机化与少量真实样本适配结合，可降低从模拟视觉策略迁移到真实低成本机器人的数据门槛。近91%指标对应真实室内导航图像分类任务，实际探索演示提供补充但摘要未报告真实部署的成功率数值。

Abstract: Vision-based autonomous navigation for low-cost robots remains a fundamental challenge, primarily due to the significant gap between simulated training environments and real-world operational conditions. Direct policy transfer from simulation is often ineffective, while training exclusively on real data is impractical. We propose a hybrid transfer learning framework that effectively bridges the sim-to-real gap by combining domain randomization with feature-level domain adaptation. Our method employs a dual convolutional variational autoencoder architecture with a shared decoder, trained on an extensive set of 45225 simulated images and a minimal set of only 4556 real-world samples. This architecture learns a compact, common latent representation space that aligns the distributions of both domains. The adaptation process is further enhanced by two complementary data augmentation techniques designed to expand the limited real-world data. Experimental evaluation demonstrates that our method achieves an average success rate of almost 91% on image classification tasks for real-world indoor navigation, significantly outperforming both simulation-only and real-world-only training. We validate these findings through a direct, real-world deployment, where the proposed policy successfully guides a low-cost robot in a reactive exploration task. Furthermore, we validate the model’s efficiency through a rigorous computational estimation, confirming its suitability for resource-constrained embedded platforms such as the Raspberry Pi 4 and NVIDIA Jetson Nano. This work presents a practical solution for developing effective and efficient navigation policies for low-cost robotic systems.

[270] SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models cs.RO | cs.AI | cs.CVPDF

Xiaodong Wang, Tianle Li, Chuanxin Song, Junliang Xie, Zhanmi Zhong

TL;DR: SimForcing从仿真教师向真实域机器人世界模型蒸馏运动先验，并在生成时可选择性使用仿真轨迹作为条件；Bridge上的PSNR、SSIM、LPIPS和FVD均优于对比方法，也能提升初始化VLA后的LIBERO成功率。

Details

Motivation: 动作条件机器人世界模型需要既准确响应机器人轨迹，又保留真实视觉动态；异构机器人视频使两方面难以同时学习。仿真可提供结构化运动监督，但外观差异妨碍直接迁移，且仿真预测不准时可能误导真实视频生成。

Result: SimForcing通过潜在运动蒸馏从仿真教师迁移运动知识，在潜空间对齐时间变化以减弱外观差异影响；再用多块仿真条件和条件dropout利用预测轨迹，同时避免过度依赖其准确性。仿真条件分类器自由引导统一内部化运动先验与额外仿真潜变量引导的预测。联合训练学生模型同时生成仿真条件和真实域视频，推理时无需额外世界模型。Bridge上四项指标PSNR、SSIM、LPIPS和FVD均优于对比方法；InternData-A1实验支持跨机器人数据集适用性。以该世界模型初始化VLA还提升LIBERO成功率。摘要未给出数值。

Insight: 先内部化仿真运动先验，再对仿真条件进行可控引导，可利用仿真结构而降低外观差异和仿真误差的负面影响。世界模型也能为下游策略学习提供初始化；跨数据集和LIBERO结论在摘要中未附具体指标差值。

Abstract: Action-conditioned robot world models must respond precisely to robot trajectories while preserving realistic visual dynamics, yet learning both from heterogeneous robot videos remains challenging. Simulation offers structured motion supervision, but appearance differences hinder direct transfer, and inaccurate simulation predictions can misguide real-video generation. We present SimForcing, a simulation-guided framework that uses simulation both as a source of transferable motion knowledge and as a controllable reference for prediction. First, we transfer motion knowledge from a simulation teacher through latent-motion distillation, aligning temporal changes in latent space to internalize motion priors while mitigating the influence of appearance differences. Second, we introduce multi-block simulation conditioning with condition dropout to exploit predicted simulation trajectories without relying excessively on their accuracy. Our simulation-conditioning classifier-free guidance scheme unifies these two ideas by balancing predictions based on internalized motion knowledge with those additionally guided by simulation latents. The jointly trained student generates both simulation conditions and real-domain videos, requiring no additional world model at inference. On Bridge, SimForcing achieves the best PSNR, SSIM, LPIPS, and FVD among the compared methods without external embodied pretraining. Evaluation on InternData-A1 further supports its applicability across robot datasets. Moreover, using our trained world model to initialize a vision-language-action model improves LIBERO success, suggesting its utility for downstream policy learning. \url{https://github.com/Wang-Xiaodong1899/SimForcing}

[271] InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation cs.RO | cs.CV | cs.GRPDF

Yucheng Zhang, Sirui Xu, Jinhong Li, Liuyu Bian, Anatulya Nandi

TL;DR: InterMimicGen构建从异构人类物体交互演示到可执行人形机器人全身运动的自演化数据飞轮：重定向动作、训练通用物理追踪器，再对交互位置和动作方式作保任务修改，只保留仿真成功变体并用于下一轮训练。

Details

Motivation: 捕获的人类—物体交互提供丰富的人形机器人移动操作监督，但数据稀疏、异构且不能直接由机器人执行。需要将人类演示转成保持全身协调和灵巧手物体关系的机器人参考动作，并持续扩充可执行数据覆盖。

Result: InterMimicGen先整合动作捕捉的人—物交互数据并重定向到人形机器人，生成覆盖灵巧全身移动操作的多样参考集；再训练基于物理的通用追踪器，在仿真中执行这些参考动作。数据飞轮每轮对交互发生位置和身体执行方式做小幅保任务变化，对追踪器微调，并只保留仿真成功完成任务的变体作为下一轮种子。多轮迭代后小改动累积，扩大稀疏原演示周边覆盖，同时保留任务语义和动作质量。实验报告跨机器人配置的接触保持重定向、单一通用策略的广泛追踪能力、增强轮次持续增长的可执行动作，以及向真实机器人的迁移；摘要未提供定量数据。

Insight: 自动筛选可执行且保持任务语义的扰动演示，使数据扩增与机器人追踪器形成正反馈，有望从稀疏人类动作捕捉数据持续扩大可用动作资源。证据包括真实机器人迁移，但摘要未报告任务成功率、数据规模或扩增效率。

Abstract: Captured human-object interactions provide rich supervision for humanoid loco-manipulation, but they are sparse, heterogeneous, and not directly executable by robots. We introduce InterMimicGen, a self-evolving motion-imitation framework in which robot motion data and a tracking policy improve each other. First, we consolidate motion-captured human-object interaction datasets and retarget them into humanoid robot references while preserving whole-body coordination and dexterous hand-object relationships. This produces a large and diverse humanoid robot reference collection for dexterous whole-body loco-manipulation. Second, we train a physics-based generalist tracker that executes these references in simulation on a humanoid with dexterous hands, covering a scale and diversity beyond prior humanoid tracking systems for loco-manipulation. Third, we close a data flywheel: each round makes small, task-preserving changes to where an interaction takes place and how the body performs it, fine-tunes the tracker on them, and keeps only the variants whose simulated execution completes the task, which seed the next round. With more iterations, these small edits compound into broader coverage around the sparse original demonstrations while preserving task semantics and motion quality. Experiments show contact-preserving retargeting across robot configurations, broad tracking with a single generalist policy, executable motions that keep growing over augmentation rounds, and transfer to real robots. InterMimicGen provides a unified path from heterogeneous human demonstrations to a continually expanding motion resource for humanoid robot learning.

cs.SD [Back]

[272] Mind the Accent Gap: British Accent Robustness in Speech-Driven Financial Voice Assistants cs.SD | cs.AI | cs.CLPDF

Aadam Haq, Oggi Rudovic, Malcolm Chadwick, Jay Rainey, Shucong Zhang

TL;DR: CavaBench是作者内部采集的金融语音查询基准，用于评测不同英国口音下ASR以及ASR接LLM后的工具调用表现。词错误率与下游工具调用准确率高度负相关（r=-0.93），但WER并不总能代表任务级表现。

Details

Motivation: 以ASR接大语言模型的语音助手可能因苏格兰、爱尔兰和威尔士等英国地区口音识别错误，进一步生成错误工具参数或漏答；金融应用尤其在意这些错误。部署选择还受推理延迟和内存限制，因此仅比较通用语音识别指标可能不足。

Result: 作者构建首个内部采集的金融口语查询基准CavaBench，评估多种ASR模型以及完整ASR-LLM管线在自报英国口音上的表现。WER对下游工具调用准确率有较强预测力，相关系数r=-0.93；但WER有时不能反映任务层面的实际性能，口音相关错误会随ASR模型和声学条件显著变化。研究据此讨论面向部署的包容性、可靠语音助手设计。

Insight: 语音助手应在端到端任务上评测不同口音下的工具调用正确性，而不能把WER当作充分代理指标；选择ASR还要同时考虑延迟和内存预算。基准为内部采集，摘要未提供样本规模或各口音的详细结果，结论的代表性仍需结合完整数据说明。

Abstract: AI voice assistants often use Automatic Speech Recognition (ASR) with LLM-based reasoning, yet existing systems struggle with regional British accents, including Scottish, Irish, and Welsh accents, since most ASR models are trained predominantly on American English voice data. Consequently, errors can carry through to the LLM stage, corrupting tool-call arguments and producing wrong or missing responses, which is especially costly in finance. Deployable ASR must also meet tight latency and memory budgets, making an accent-robust model choice even harder. We introduce CavaBench, the first internally collected benchmark of spoken financial queries, and use it to evaluate a range of ASR models and their end-to-end ASR-LLM pipeline behaviour across self-reported British accents. We find that WER strongly predicts downstream tool-calling accuracy ($r = -0.93$) but can fail to reflect task-level performance, with accent-related failures varying substantially across models and acoustic conditions. These findings guide the design of more inclusive, reliable voice-based financial assistants.

eess.AS [Back]

[273] SepRQ : Self-Supervised Speech Mixture Representation Learning via Mask-Free, Multi-Scale Source Separation eess.AS | cs.CL | cs.LGPDF

Séverin Baroudi, Hervé Bredin, Ricard Marxer

TL;DR: 提出SepRQ多尺度无掩码自监督语音混合表征框架，以冻结随机投影码本上的伪源分离取代单说话人掩码预测。

Details

Motivation: 主流自监督语音表征围绕单说话人音频设计，限制其在多人重叠语音任务的用途。

Result: SepRQ以伪源分离目标和无掩码多分辨率学习声学混合表示。在SUPERB基准上，Base与Large规模的说话人日志划分及语音分离均超过WavLM和其他鸡尾酒会自监督模型，推理参数仅85.68M；注册目标说话人的任务（如目标说话人ASR）及DIHARD 3多域说话人日志也表现强。在WSJ0-3Mix三说话人混合上展现较强分离能力。作者开源模型以补足此前方法封闭、选择少的问题。

Insight: 无需掩码预测也可用伪分离监督学习适合重叠语音的通用表征；摘要未列各任务具体数值。

Abstract: Self-supervised learning (SSL) is standard for speech representation learning, but mainstream models are designed around single-speaker audio, limiting their usefulness in multi-speakers scenarios. We present SepRQ, an open-source SSL framework that replaces masked prediction with a pseudo-source-separation objective over frozen random-projection codebooks. By adopting a novel mask-free, multiresolution approach, SepRQ achieves state-of-the-art performance in Speaker Diarization and Speech Separation on the SUPERB benchmark, surpassing WavLM and other cocktail-party derived SSLs at both Base and Large scales, while requiring only 85.68M inference parameters. SepRQ also demonstrates strong performance across target-speaker tasks requiring enrollment (such as Target-Speaker Automatic Speech Recognition), and on the challenging multi-domain DIHARD 3 diarization dataset. Notably, we report strong separation capabilities on three-speaker mixtures (WSJ0-3Mix), where current SSL literature struggles. While cocktail-party SSLs remain scarce and closed-source, limited to C-HuBERT and the enrollment-based SA-WavLM, we open-source SepRQ to the community.

eess.IV [Back]

[274] FloVMos: Optical Flow-based Medical Video Mosaicking eess.IV | cs.CVPDF

Jinyang Liu, Sandesh Ghimire, Chaman Singh, Jennifer Dy, Milind Rajadhyaksha

TL;DR: FloVMos以针对合成变形场微调的光流模型实现实时生物医学视频拼接，借助自动合成训练数据适配组织运动和成像畸变，并在七种成像模态上优于传统基线的精度、鲁棒性和速度。

Details

Motivation: 生物医学成像通常需要在分辨率、视野和采集速度之间取舍。视频拼接可将连续高分辨率帧计算融合为宽视野图像，但现有方法难以应对非刚性组织形变和临床/科研成像中的模态特异伪影。

Result: FloVMos是通用光流深度学习拼接框架，通过带真实形变场标签的合成数据微调光流模型，实现像素级配准。合成数据生成流程从现有拼接图或原始视频模拟组织运动和成像畸变，支持用户针对不同模态自适应训练。作者在反射共聚焦显微镜、开顶光片显微镜、胎儿镜、腹腔镜、皮肤镜、稀疏光谱显微镜和内窥镜七种模态上验证，报告所有测试模态中均在准确性、鲁棒性和速度上优于传统基线，并实现实时大面积可视化；摘要未给出具体数值。

Insight: 用自动化合成变形数据训练光流配准器，提供了跨生物医学成像模态迁移的可适配路径。论文报告七类模态上的一致优势，但摘要未量化性能，也未说明各模态数据规模，临床流程效益仍需专门验证。

Abstract: Biomedical imaging modalities often require a trade-off among resolution, field of view (FOV), and acquisition speed. Video mosaicking offers a strategy to overcome this limitation by computationally stitching sequential high-resolution frames into a wide-FOV composite. However, existing methods struggle with non-rigid deformations, and modality-specific artifacts arising in clinical and research imaging. Here, we present FloVMos, a generalizable, optical-flow-based deep learning framework for real-time video mosaicking across diverse biomedical imaging modalities. FloVMos achieves robust, pixel-level registration by fine-tuning an optical flow model on synthetic training data with ground-truth deformation fields. We introduce a pipeline for generating this training data, simulating realistic tissue motion and imaging distortions from existing mosaics or raw videos. Our automated synthetic data generation and optical flow model training based on this data allow users to adapt FloVMos to different imaging modalities. To demonstrate this, we applied FloVMos to seven diverse imaging modalities: reflection confocal microscopy, open-top light-sheet microscopy, fetoscopy, laparoscopy, dermoscopy, sparse spectral microscopy, and endoscopy. FloVMos outperforms conventional baselines in accuracy, robustness, and speed for all the tested modalities. This adaptable and training-efficient framework enables large-area visualization with real-time performance and may support broader use of video-based biomedical imaging in research and clinical workflows.

Table of Contents

cs.CV [Back]

[1] Energy Variation in Training Modern Computer Vision Architectures cs.CV | cs.PFPDF

[2] What Do Verifiable Rewards Teach Video-Language Models About Time? A Controlled Multi-Model Study cs.CVPDF

[3] WAMJET: A Harness for World Action Model Acceleration cs.CV | cs.AI | cs.ROPDF

[4] Beyond Token Accuracy: Prioritizing What Matters for Visual Reconstruction cs.CVPDF

[5] Are We Measuring Anticipation? Auditing Privileged Information in Procedural Video Evaluation cs.CVPDF

[6] DABACO: A Multi-Camera Dataset and Benchmark for Screen Localization and Pointing Estimation cs.CV | cs.MMPDF

[7] FADE: Frame-Aware Diffusion-Transformer-based Multi-Concept Erasure for Video Unlearning cs.CVPDF

[8] Masked Privileged-Information Distillation for Multimodal Skin Lesion Classification Under Missing Clinical Metadata cs.CV | cs.LGPDF

[9] PhysMamba: Selective State Space Models as Learned Articulated Body Simulators cs.CVPDF

[10] MAGEFormer: Learning Metric-Consistent Representations for Anisotropic CT Segmentation cs.CV | cs.AIPDF

[11] Dynamic Quadtree Tokenization and Transformer for Adaptive Mesh PDE Forecasting cs.CV | cs.LGPDF

[12] ASD-FEAT: A Multi-Modal Infant Video-Derived Dataset for Early ASD Risk Prediction cs.CVPDF

[13] Evaluating Zone-Guided Front Extraction for Glacier Calving-Front Delineation in SAR Imagery cs.CV | cs.LGPDF

[14] A Theory of Shape Reconstruction from Heat Conduction and Shading cs.CVPDF

[15] Scaling 3D Visual Grounding in Abdominal CT cs.CV | cs.LGPDF

[16] From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models cs.CVPDF

[17] Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution cs.CVPDF

[18] Watermarks and Fingerprints as Soft Bindings for Content Provenance: An Open-Licence Benchmark for Images, Audio and Video cs.CVPDF

[19] Diagnosis-Conditioned Spatial Gating and Decoder-Level Supervised Contrastive Learning for Radiology Report Generation cs.CVPDF

[20] FlashGaze: Training-Free Multi-Scale Patch Pruning For Efficient Video Understanding cs.CVPDF

[21] Referring Multi-Object Tracking in Moving-Camera Videos via Global Motion Compensation cs.CVPDF

[22] Sparse-GS2Mesh: 3D Gaussian Splatting Guided by Novel Stereo Views and 2DGS for Sparse View Surface Reconstruction} cs.CVPDF

[23] Rethinking Long-Video Efficiency: A Joint Allocation Perspective on Frames, Pixels, and Front-End Latency cs.CVPDF

[24] A differentiable Lagrangian-coupled 3D Gaussian Splatting-SPH model for forward simulation and inverse analysis in solid mechanics cs.CV | physics.comp-phPDF

[25] Synthetic-to-Real ViT-Based Pose Estimation of a Noncooperative UAV cs.CVPDF

[26] LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning cs.CV | cs.GRPDF

[27] TRIM-ReID: Duplication-Aware Token Reduction and Modality-Aligned Interaction for Multi-Modal Object Re-Identification cs.CVPDF

[28] Beyond Plausibility: Verifiable Fine-Grained Image Editing on Structured Assets cs.CVPDF

[29] Detecting Defects that Matter: An Application-Driven Benchmark for Anomaly Detection in Manufacturing and Retail Logistics (VAND 4.0 Challenge) cs.CVPDF

[30] Video2World: Benchmarking Coding Agents for Interactive World Modeling from Embodied Videos cs.CV | cs.AI | cs.ROPDF

[31] AgroGround: Multi-Granularity Grounded Recognition in Agriculture cs.CV | cs.AIPDF

[32] RPFQ-ViT: Rotated Phase-Frame Quantization for Extremely Low-Bit Weights in Vision Transformers cs.CVPDF

[33] Localization Lens for Improving Medical Vision-Language Models cs.CV | cs.AIPDF

[34] EgoExo-Next:Benchmarking Vision-Language Models on Visual-Option Next-State and Cross-View Reasoning cs.CV | cs.AIPDF

[35] FASTER: Fast Adjoint Stochastic Transport for Endpoint Refinement in Reward-Guided Image Editing cs.CVPDF

[36] EagleDepth: Efficient Fine-Grained Depth Estimation via Pixel Diffusion Decoder cs.CVPDF

[37] Frozen in a Frame: The Velocity Blind Spot in JEPA World Models cs.CVPDF

[38] Organize Primitives into Semantic Parts: Reinforcement Reasoning for 3D Segmentation cs.CVPDF

[39] ConEx: Human-Interpretable Saliency Maps via Concept-Aware Attribution cs.CV | cs.AI | cs.LGPDF

[40] Sparse-View 4D Gaussian Splatting via Spatiotemporal Priors and Generative Assistance cs.CVPDF

[41] Task-Sensitive Geometry of Representation Transfer for Object Detection under Image Degradation cs.CVPDF

[42] FLASHSWIN: Unlocking Large Windows and Dense Tokens in Swin Vision Transformers with Memory Efficient Attention cs.CVPDF

[43] Knossos and Ariadne: Benchmarking and Learning Complete Diagram Topology Extraction with Vision-Language Models cs.CV | cs.AIPDF

[44] NAMVIS: Next-Scale Autoregressive Multi-View Image Synthesis cs.CVPDF

[45] Probabilistic Pedestrian Forecasts from a Handheld Phone: World-Frame Heat Maps, Visual-Inertial Height Drift, and Evaluation without Ground Truth cs.CV | cs.ROPDF

[46] Investigating Spatiotemporal Redundancy in Video Transformer for Collision Anticipation cs.CVPDF

[47] ThyCLIPNet: A BiomedCLIP-Guided Lightweight Attention-Enhanced DeepLabV3+ Framework for Robust Thyroid Nodule Segmentation cs.CVPDF

[48] ARISE: Adaptive Agentic Reasoning with Image-grounded Self-Evaluation for Interpretable IBD Assessment cs.CV | cs.AIPDF

[49] Super-Resolution in The Right Latent Space: A Frozen Vision-Foundation Substrate cs.CVPDF

[50] Lollypop: Camera-to-Motion-Capture Calibration Verification with a Reference Target cs.CVPDF

[51] RSure-Agent: Reliable Use of Tool Observations for Remote Sensing Agents cs.CVPDF

[52] DriftSR: One-Step Real-World Image Super-Resolution via Distribution Drifting cs.CVPDF

[53] Enhancing Long-Video VLM Embeddings with Query-Aware Streaming Latent Reasoning cs.CV | cs.AIPDF

[54] PWM: Personalized World Models with Online Reinforcement Learning cs.CVPDF

[55] PortraitAes: Intent-Conditioned Structured Portrait Aesthetics Assessment cs.CVPDF

[56] VisualErase: Dual-Branch Visual Trajectory Redirection for Robust Concept Erasure in Text-to-Image Diffusion Models cs.CVPDF

[57] EMBER-Bench: Benchmarking Cross-Event Causal Memory in Long-Horizon Embodied Tasks cs.CVPDF

[58] Look Where You Say You’re Looking: Self-Grounded Attention for Visual Reasoning cs.CVPDF

[59] LightVLN: Efficient Aerial Vision-and-Language Navigation with Compact Memory and History-Guided Local Aggregation cs.CV | cs.ROPDF

[60] SPACE-CLIPv2: Decoding Local Geometry from Frozen CLIP for Monocular Depth Estimation cs.CVPDF

[61] GeoBridge-VLA: Geometry-Aware Residual Adaptation for Vision-Language-Action Models cs.CV | cs.ROPDF

[62] Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA cs.CVPDF

[63] Code2Games: Enabling Coding Agents for Gaming World Generation cs.CVPDF

[64] ReMAP: Restoring the Perceptual Cycle with Reasoning-Time Latent Visual Memory cs.CV | cs.AI | cs.CLPDF

[65] LoopMoEVR: Loop-Based Degradation-Aware Mixture-of-Experts for Unified UHD Video Restoration cs.CVPDF

[66] Representation–Behavior Alignment for Explainable Weakly-Supervised Video Anomaly Detection cs.CVPDF

[67] PCLM: Small-target localization with frozen CLIP via prototype contrast and local magnification cs.CVPDF

[68] RoMod: Temporal Routing Modulation via Mixture-of-Experts for Video Anomaly Detection cs.CVPDF

[69] SemCam: Semantic Camera Motion Control for Video Generation cs.CVPDF

[70] Recurrent Latent Visual Search for GUI Grounding cs.CVPDF

[71] How Does Geometry Enter Generated Motion? cs.CV | cs.AIPDF

[72] Long-MDR: Long-Context Reinforcement Learning for Multimodal Deep-Research Agents cs.CVPDF

[73] PixReenact: Pixel-Conditioned Causal Video Diffusion for Streaming Head-Avatar Reenactment cs.CVPDF

[74] ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image cs.CVPDF

[75] MGPO: Manifold-Guided Diffusion Alignment for Task-Aware Dataset Distillation cs.CV | cs.AIPDF

[76] Hybrid-Basis Feature Forecasting for Diffusion Sampling Acceleration cs.CVPDF

[77] When and What to Prune? Stage-Aware Visual Token Pruning for Efficient VLA cs.CV | cs.ROPDF

[78] Revisiting Ground-Truth Synthesis from High-Speed Video: Exact Validity Conditions and an Audited Consumer Capture Corpus cs.CV | cs.AIPDF