cs.CV [Total: 78]
cs.CL [Total: 51]
cs.AI [Total: 10]
cs.CR [Total: 1]
cs.LG [Total: 15]
cs.RO [Total: 3]
cs.SD [Total: 2]
cs.SE [Total: 1]
eess.IV [Total: 1]

cs.CV [Back]

[1] Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment cs.CVPDF

Xiao Yang, Zekun Zhang, Yuxuan Fan, Duoxun Tang, Ziyang Liu

TL;DR: VITAL 为 VLM 增加独立生理视觉通路，并进行结构化数值对齐，针对通用语义特征丢失细粒度生理线索和离散 token 不适于连续数值估计的问题。

Details

Motivation: 远程生理测量可服务视频健康监测，但现有方法多为专用模型，不易融入 VLM 的多模态交互；通用视觉语义表示可能弱化细微生理变化，自回归离散 token 预测也与连续心率数值不匹配。

Result: VITAL 保留原视觉通路作语义理解，并独立建立生理通路联合建模两类信息；结构化数值对齐进一步强化生成心率估计中的数值关系。作者在多个 rPPG 数据集上报告跨域估计提升，同时保留 VLM 通用视觉理解能力。摘要未给出数据集名称、指标或准确率增益。

Insight: 语义理解和生理信号提取可以共享整体模型但使用独立表示通路；数值关系建模也需不同于普通 token 生成。摘要定性报告跨域增益，无法判断对真实环境光照、运动干扰及硬件变化的适应程度。

Abstract: Video-based remote physiological measurement (RPM) has broad applications, while Vision-Language Models (VLMs) provide a promising opportunity to enable end-to-end physiological monitoring for future human-aware intelligent systems. However, existing RPM methods rely on task-specific models and cannot be seamlessly integrated with the multimodal understanding and interaction capabilities of VLMs. We revisit RPM with VLMs and provide empirical evidence for two major bottlenecks: generic visual semantic representations fail to preserve fine-grained physiological cues; while discrete token prediction in autoregressive generation is inherently misaligned with continuous numerical measurement. To address these challenges, we propose VITAL (Visual-physiological Token Alignment for Language Models), a visual-physiological token alignment framework for RPM and preserving general vision tasks. VITAL retains the original visual pathway for semantic understanding and introduces an independent physiological pathway to jointly model semantic and physiological information. Moreover, we propose a structured numerical alignment approach to improve the reliability of generative heart rate estimation by enhancing numerical relationship modeling. Extensive experiments show that VITAL improves cross-domain estimation performance on multiple rPPG datasets while preserving the general visual understanding capability of VLMs, demonstrating its effectiveness as a unified visual-physiological model. Code will be released.

[2] Action Jets: Learning the Local Shape of the Action-conditioned Data Manifold cs.CVPDF

Anton Arapin, Chahyon Ku, Bernadette Bucher

TL;DR: Action Jets 学习固定状态下动作条件图像流形的局部泰勒形状，让规划器一次提取后即可快速评估任意数量的短时域候选动作。

Details

Motivation: 动作条件世界模型能用于规划，但高维预测代价大，限制可评估动作数量；短时规划其实只需知道当前状态附近动作变化对未来图像的局部影响。

Result: 网络根据生成器采样监督，估计图像各区域沿每个动作轴单位变化的运动；校正头再用轨迹数据拟合至三阶泰勒多项式，并闭式计算有效半径。动作 Jet 的切线来自源生成器，其余高阶项从数据学习。一次状态推理后可遍历流形近似评估多个候选；单次提取评分 16 个候选比任一源生成器快 300 倍以上，候选数越多优势越大。在 BridgeData V2 的 7-DoF 操作、DL3DV 场景等评测中，短时预测比提供切线的 IRASim 更准，计算量低 100 倍以上；还比较了 WorldGym、FrameCrafter、DepthSplat、LagerNVS 等方法。

Insight: 若规划仅需局部动作响应，可学习局部流形近似避免每个候选都完整运行昂贵生成器。收益依赖动作范围仍处于多项式近似有效半径内；摘要未量化较长时域、强非线性动作下的误差增长。

Abstract: World models are a powerful means of reasoning and planning, but many of these action-conditioned predictive models are high dimensional and computationally expensive. These challenges limit the number of action candidates that can be evaluated by a planner. We show that this cost is avoidable for planners over short horizons, which only require local information with respect to the current state. For a fixed state, the frames reachable by varying a low-dimensional action (a camera movement or an end-effector command) lie on a low-dimensional manifold. We estimate the local shape of that manifold directly via a network trained to estimate how each image region moves per unit of each action axis supervised by data collected from samples by the generator. A correction head fit to trajectory data estimates the shape of this manifold region up to a third-order Taylor polynomial. We call this network estimating the Taylor polynomial describing the manifold shape an Action Jet and compute its radius of validity in closed form. By traversing this approximation of the local manifold shape, we only have to perform inference once per state for any number of candidate actions. Scoring sixteen candidates from a single extraction is over 300x faster than with either source generator, and this gap widens with the number of candidates a planner evaluates. We measure against state-of-the-art action-conditioned generators, IRASim and WorldGym on BridgeData V2, a real 7-DoF manipulation benchmark, and FrameCrafter on DL3DV scenes, where we chart from the novel-view generators DepthSplat and LagerNVS. Because only the tangent comes from the generator and every other term from the data, the Action Jet also predicts held-out frames more accurately than IRASim, the generator that supplied its tangent, at short horizons and at over 100x less compute.

[3] WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models cs.CVPDF

Nan Zhou, Jianxiong Gao, Qiuyu Wang, Wen Wang, Jiahao Wang

TL;DR: WorldMemBench 评测视频世界模型的静态内容保持和动态事件演化记忆，并通过离开—重访轨迹检查重复返回后记忆是否衰减。

Details

Motivation: 交互视频模型需要既保留之前观察到的身份、物体及环境，又保证世界状态随时间合理演化；视觉保真和生成时长无法充分衡量历史记忆能力。

Result: 基准含 260 个测试案例，静态记忆检查人物身份/外观、物体外观/几何和环境内容/几何，动态记忆检查事件进展和状态持续性。通过受控相机离开与多次重访，静态内容与初始参考比对，动态事件与预期状态转移评估；外观、几何和事件指标组合，并补充视频质量与相机跟随诊断。九个代表模型的评测显示，静态保持强并不代表动态状态演化可靠；多次重访后记忆会进一步退化。人工研究支持自动评估与人类判断的一致性。

Insight: “记得场景外观”和“记得事件如何发展”是不同能力，多次返回会暴露首轮重访测不到的衰减。样本量为 260，摘要未列模型分数、人评规模或重访次数效应曲线。

Abstract: As video models enable longer and more realistic interactive experiences, maintaining a world consistent with its history becomes essential. This requires both preserving previously observed content and ensuring coherent world evolution over time. World memory is a critical capability to evaluate alongside visual fidelity and video duration. We introduce WorldMemBench, a benchmark for systematically evaluating world memory in video world models. Across 260 test cases, it assesses static memory through the retention of human identity and appearance, object appearance and geometry, and environmental content and geometry, and dynamic memory through event progression and state persistence. Using controlled camera departures and multi-revisit trajectories, the benchmark evaluates static content against fixed initial references and dynamic events against expected state transitions. It combines appearance and geometry metrics with event-specific assessments, and reports video quality and camera-following accuracy as complementary diagnostics. Evaluation of nine representative models shows that strong static retention does not imply reliable dynamic state evolution, while repeated revisits reveal memory degradation beyond the first return. Human studies support the alignment between our automatic evaluations and human judgments. WorldMemBench provides a systematic testbed for diagnosing memory failures and guiding the development of persistent, temporally coherent video worlds.

[4] MonoMIP: Multi-Height Inverse Perspective Mapping for Monocular 3D Object Detection cs.CVPDF

Emir Ulurak, Furkan Kıraç

TL;DR: MonoMIP 将多高度逆透视映射构造的度量鸟瞰特征与深度引导透视解码器结合，减轻单目 3D 检测中透视压缩造成的空间几何偏差。

Details

Motivation: 许多单目 3D 检测器依赖深度引导 Transformer，但仍完全在透视图像平面处理特征，受透视缩短影响而难表达空间关系。

Result: 方法将地面到屋顶之间 K 个高度平面做 IPM，形成有序高度条件度量 BEV 特征，减少离地物体误投影并暴露不同高度的外观变化。BEV 解码器用多尺度可变形注意力聚合每个查询的多高度信息，另有深度引导 3D 解码器从透视空间补充预测。在无额外训练数据条件下，KITTI val 的 Car Moderate AP3D|R40 为 25.84%，官方 test 为 21.66%，作者报告均超过近期单目方法；Waymo 上也报告优于比较方法，但摘要未给分数。

Insight: 单一地面平面 IPM 不足以表达离地物体，多高度特征可补足高度相关几何；双解码器保留透视与 BEV 互补。结果限于 KITTI/Waymo 协议，摘要未提供运行成本或各高度平面的消融。

Abstract: Monocular 3D object detection methods increasingly rely on depth-guided transformers, but they operate entirely in the perspective image plane where spatial relationships are distorted by foreshortening. We propose MonoMIP, a dual-decoder framework that adds complementary 3D geometric reasoning through Bird’s-Eye View (BEV) features constructed via Multi-Height Inverse Perspective Mapping. We perform IPM at K elevation planes spanning ground to rooftop, producing an ordered stack of height-conditioned metric BEV features that reduces above-ground misprojection and exposes depth-dependent appearance variation across planes. A BEV decoder with multi-scale deformable attention aggregates this multi-height evidence per query, while a depth-guided 3D decoder provides complementary perspective-space predictions. Without extra training data, MonoMIP attains 25.84% Moderate AP3D|R40 on KITTI val and 21.66% on the official test set for Car, outperforming recent published monocular methods on both the KITTI and Waymo benchmarks.

Georgios Angelidis, Aggelos Psiris, Maria Vakalopoulou, Georgios Th. Papadopoulos, Giorgos Sfikas

TL;DR: 该元分析认为航拍/遥感视频评测应关注几何条件变化、跨视角关系和闭环行动，而不只是抽帧多选题准确率，并提出 AVU-Card 报告卡。

Details

Motivation: 航拍视频研究常像网页视频一样用抽帧多选题测 MLLM 并报告准确率，但该协议可能测错能力，且难以反映高度、视角、物体尺寸和时间跨度等采集条件。

Result: 作者汇总已发表结果并分成四级证据，只有证据一致才形成结论。航拍基准上模型规模每增加十倍，准确率中位数仅提高 3.4 点，低于至少 19 点的人类差距；19 个论文内对照的 318 次评估中，315 次在采集条件变难时准确率下降。语料里没有航拍基准同时提供视频输入及逐任务人类/随机基线；闭环导航中能力从答题到行动明显坍塌。同一 MLLM 在航拍基准得分高于地面空间基准，但在跨视角几何研究中表现更低。摘要据此提出五条可证伪原则和 AVU-Card；末尾内容在当前摘要中截断。

Insight: 航拍感知高度依赖采集几何条件，单纯扩大模型或报告总体选择题分数可能掩盖几何推理与实际行动短板。结论为文献元分析，318 次对照和跨基准比较受已发表研究及任务协议限制；摘要末尾未完整提供建议细节。

Abstract: Aerial and remote sensing video is increasingly evaluated like web video, by posing multiple-choice questions to multimodal large language models (MLLMs) over sampled frames and reporting accuracy. This paper argues that this recipe measures the wrong aspect, and supports the claim with a convergent meta-analysis of a broad set of published results, organized in four evidence tiers, in which a claim becomes a position only when collected evidence agrees. Parameter scale exhibits a median of +3.4 accuracy points per tenfold increase on aerial benchmarks, far below a human gap of at least 19 points, whereas acquisition conditions control perception, as 315 of 318 evaluations in 19 within-paper contrasts lose accuracy when conditions such as altitude, view, object size or time horizon become harder. No aerial benchmark in the corpus combines video input with per-task human and random baselines, competence collapses from answering to acting in closed-loop navigation, and the same MLLMs score higher on the aerial benchmark than on ground spatial ones, but lower on studies that test cross-view geometry. From these findings the current study derives five falsifiable principles and proposes the AVU-Card, a reporting card for aerial video benchmarks

[6] Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models cs.CV | cs.AI | cs.CLPDF

Mahdieh Mallahnezhad, Masoud Jafaripour, Mohamadali Tofigh, Sheila Schoepp, Osmar R. Zaiane

TL;DR: 该综述从数据角度梳理 MLLM 空间推理微调，比较空间标注构造、模态/注释形式与评测，并归纳规则模板、LLM 提示、程序生成及人工参与四种数据构建路线。

Details

Motivation: MLLM 已用于具身智能和机器人视觉，但空间感知/推理仍有限；后训练被认为能改善能力，而相关数据如何构造、标注和评估缺少系统综述。

Result: 作者综述从监督微调到强化学习的预训练 MLLM 微调方法，重点分析数据集设计、构建及模型评估。总结四类固定空间标注构造方式：规则与模板、LLM 提示、程序化生成、人类在环；同时指出不同研究采用的评分、容差指标和基准差异很大。未来方向包括统一动态标注、更高效空间推理、标准化评测、扩大空间范围和以人为中心的空间交互。摘要未报告新算法或量化基准结果。

Insight: 空间推理能力评测和训练结果高度依赖数据定义及容差协议，数据构造范式需要与动态任务相匹配；统一评测标准可改善横向比较。本文为综述，归纳范围受纳入文献和空间任务分类方式限制。

Abstract: Multimodal Large Language Models (MLLMs) have been widely applied in embodied agents and robotics for vision tasks. However, MLLMs suffer from limitations in spatial reasoning and perception. Post-training techniques have shown promise for improving these capabilities; yet, there are limited data-driven surveys of such approaches. In this survey, we consider approaches to fine-tuning pretrained MLLMs for spatial reasoning tasks, ranging from supervised to reinforcement learning, with an emphasis on the datasets used. We investigate themes of dataset construction, data modality and annotation, and evaluation of the resulting models. Based on these themes, we categorize research into three groups: dataset design, dataset construction and evaluation. We find four main methods for constructing fixed spatial annotations: rules and templates, LLM prompting, procedural generation, and human-in-the-loop. We also observe substantial variation in evaluation approaches, including different scoring methods, tolerance metrics, and benchmark types. Finally, we identify opportunities for future research in unified dynamic annotation, efficient spatial reasoning, standardization of evaluation, expanded spatial range, and human-centered spatial interactions.

[7] A Gradient-Regularized Deep Learning Method for Restoring Image in Myopic Vision cs.CVPDF

Kebin Contreras, Luis Toscano-Palomino, Rafael Torres, Jorge Bacca

TL;DR: 该研究用带空间梯度正则的 U-Net 生成适配屈光模糊的变换图像，旨在让固定距离的近视者更清晰感知场景细节。

Details

Motivation: 近视的球面离焦会削弱人眼对细空间细节的感知，研究目标是对输入图像做计算变换以补偿指定近视条件下的视觉退化。

Result: 方法用二阶 Zernike 多项式 Z₂⁰ 建模离焦，在 KITTI 数据上训练 U-Net，并用重建误差与空间差分结构保持的 L1 正则联合优化；测试在 DIV2K 和 ImageNet 上进行。基线 PSNR 随数据集及严重程度为 19.47–27.42 dB，梯度正则方法提升 1.48–7.34 dB，并报告感知质量优于经典基线。摘要未说明受试者视觉实验或主观清晰度评估。

Insight: 训练中强调梯度/边缘结构有助于补偿离焦导致的高频细节模糊，并表现出跨图像分布泛化。该结果基于仿真 Zernike 模糊和图像指标，不等于临床视力改善或对真实个体眼球像差的验证。

Abstract: Myopic vision degrades the quality of human vision due to spherical eye defocus aberrations that impair the perception of fine spatial details. To address this limitation, this work proposes a deep learning-based approach to computationally design transformed images that allow individuals with myopia in fixed distance to perceive scenes with enhanced clarity. The method trains a neural network to counteract defocus aberrations modeled using the second-order Zernike polynomial $Z_2^0$. The approach employs a U-Net architecture trained with a loss function combining reconstruction error minimization with spatial difference structural preservation through $\ell_1$ regularization. Training is carried out exclusively on the KITTI dataset, while testing is performed on DIV2K and ImageNet datasets, demonstrating generalization across diverse image distributions. Under myopic conditions modeled by $Z_2^0$, baseline performance shows visual degradation with PSNR values ranging from 19.47 to 27.42 dB across datasets and severity levels. The proposed gradient-regularized method achieves consistent improvements, delivering PSNR gains ranging from 1.48 to 7.34 dB and significantly lower perceptual compared to classical baselines.

[8] Long-horizon Video Generation with Slot Memory Addressed By Region Tokens cs.CVPDF

Eren Cetin, Julius Erbach, Vukasin Bozic, Hyojun Go, Zixiang Zhao

TL;DR: SMART 以固定容量、由相机区域 token 寻址的 slot 记忆存储视频内容，并根据当前渲染视角读取历史，使重访召回取决于视角几何而非记忆新旧。

Details

Motivation: 长视频生成记忆需要容量有界以支持无限续写，同时能在相机返回某位置时恢复很久以前观察的内容。显式几何缓存存储会增长，循环记忆则可能随时间淡忘旧观察。

Result: SMART 将内容写入固定大小的 slot 循环记忆，写入由观察相机寻址，读取由渲染相机查询，不构建显式 3D 表示也不扩展缓存；读取还给出置信度，供分块因果扩散 Transformer 判断信任召回内容或依赖生成先验。在 Memory Maze 和 Minecraft 长轨迹上，作者报告模型在远超训练时域的条件下仍能高保真召回，并维持常量记忆和每步成本。摘要未给具体记忆指标或模型对比数值。

Insight: 以区域/视角寻址而非时间近邻寻址，旨在同时获得固定容量和空间重访记忆；置信度也可控制历史证据的使用。摘要未说明长期 slot 冲突、场景规模上限或不同重访间隔的具体退化曲线。

Abstract: Memory for long-horizon video generation must satisfy two competing requirements: it must remain bounded so generation can continue indefinitely, while still recovering what was observed at a place when the camera returns, regardless of how long ago it was seen. Reconstruction-based memories provide spatial recall by caching and reprojecting explicit geometry, but require growing storage and depend on estimated 3D structure. Recurrent memories keep a constant-size state, but retention is governed by temporal recurrence, causing old observations to fade with time. We introduce SMART, a slot memory addressed by region tokens, which combines bounded storage with spatially addressed recall. SMART stores content in a constant-size slot recurrence whose writes are addressed by the observing camera and whose reads are queried by the rendering camera, without constructing an explicit 3D representation or maintaining a growing cache. Consequently, recall is conditioned on inter-view geometry rather than on recency. Each read additionally provides a confidence estimate that conditions a chunk-causal diffusion transformer, allowing it to selectively trust retrieved content while relying on its generative prior elsewhere. On long trajectories in Memory Maze and Minecraft, SMART maintains high-fidelity recall far beyond its training horizon while using constant memory and per-step cost.

[9] LAMP: 3D Source-Aware Lighting Estimation at Multiple Points cs.CVPDF

Yanqiao Wang, Jin Sun

TL;DR: LAMP 从单张 RGB 图像和标记的查询点估计各光源对局部照明的贡献及其 3D 方向，并用轻量辐照度网络辅助重建稠密光照。

Details

Motivation: 传统光照估计恢复整体照明分布，却通常不显式说明某个场景位置的光照来自哪些物理光源。

Result: LAMP 构建共享有效光源清单，为每个查询点排序贡献光源并预测查询点到光源的三维方向。监督来自程序化控制室内场景，复用独立渲染的光源响应作为不同照明配置下贡献标签，且由光源/查询点位置获得精确方向。在 Infinigen 测试集上，微调 Qwen3-VL-8B 后，主导光源 3D PCK@0.5m 从 0% 提升至 70.6%；在正确定位的来源中，94.5% 方向与真值夹角小于 12.5°。结合轻量 RGB 辐照度网络后，探针渲染质量与既有光照估计方法相当，同时还能定位并归因单个物理光源。

Insight: 从整体辐照度恢复推进到来源级解释，需要将语义光源识别与几何方向联合监督；程序化独立光源渲染提供了来源贡献真值。精度在 Infinigen 测试集报告，真实复杂场景的光源遮挡和材质误差影响尚不清楚。

Abstract: Existing illumination estimation methods primarily recover lighting distributions for rendering, but typically leave the contributions of individual physical light sources at specific scene locations implicit. We address this gap by leveraging the scene understanding capabilities of vision-language models (VLMs) to connect local illumination with its physical sources. We introduce LAMP, a framework for point-conditioned, source-aware illumination reasoning from a single RGB image with marked query points. LAMP constructs a shared inventory of active light sources, ranks contributing sources for each query, and predicts their 3D query-to-source directions. We supervise these relationships using procedurally controlled indoor scenes, reusing independently rendered source responses to derive contribution targets across lighting configurations and obtaining exact directions from source and query positions. On the Infinigen test set, fine-tuning Qwen3-VL-8B increases dominant-source 3D PCK@0.5m from 0% to 70.6%, with 94.5% of directions within 12.5 degrees of ground truth among correctly localized sources. Combined with a lightweight network predicting dense RGB irradiance, LAMP achieves probe-rendering quality comparable to prior lighting-estimation methods while additionally localizing individual physical sources in 3D and explicitly attributing local illumination to them.

[10] Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation cs.CVPDF

Nikolay Semenov, Artem Riabinin, Sergey Bassenko, Anna Averchenkova, Julia Agafonova

TL;DR: Kandinsky S2V 提供 2B Lite 和 21B Pro 语音驱动人像视频模型，从单张参考图、语音和文本生成长视频并同步嘴型、表情、姿态和手势。

Details

Motivation: 语音到视频头像生成需在长时生成中协调唇动、表情、姿势与手势，并支持多样化语音条件和人物参考。

Result: 模型使用 Qwen2.5-Omni 提供文本和音频条件，采用参考感知三级视觉记忆；训练从 Kandinsky 5.0 Video 开始，结合混合参考记忆布局和区域自适应人脸损失。数据集含 117 万段通过主动说话人检测筛选的单说话人视频，英语和俄语描述直接生成。并排人工评估中 Pro 平均与最强开源及两种商业模型相当或更好，唇同步也更受偏好；Lite/Pro 在五项通用语音到视频指标平均排名靠前。π-Flow 蒸馏 Pro 以 16 步、无需 classifier-free guidance 生成，端到端比基础模型快 5.4 倍，且几乎所有报告基准指标持平或更高。

Insight: 大规模单说话人语料、参考视觉记忆和区域自适应损失支撑长时人像一致性；蒸馏进一步显著缩短采样。摘要未提供人工评估人数、各项同步/视觉绝对分数和不同语种差异。

Abstract: We present Kandinsky S2V 1.0, an open family of speech-to-video models for controllable audio-driven human animation, comprising Kandinsky S2V 1.0 Lite (2B parameters) and Kandinsky S2V 1.0 Pro (21B parameters). From a single reference image, a speech waveform, and a text prompt, the models generate long-form 25 FPS video in which lip motion, expression, pose, and gesture follow the speech. The architecture draws text and audio conditioning from one Qwen2.5-Omni model and adds a reference-aware three-scale visual memory. Training starts from the Kandinsky 5.0 Video foundation models [1] and combines mixed reference-memory layouts with an area-adaptive face loss. The training corpus contains 1.17M single-speaker clips selected by active-speaker detection, with captions generated directly in English and Russian. A side-by-side human evaluation against the strongest open-source baseline and two proprietary commercial models shows that Kandinsky S2V 1.0 Pro performs comparably to or better than these models on average and is also preferred for lip synchronization. On common speech to video benchmarks, Kandinsky S2V 1.0 Lite and Kandinsky S2V 1.0 Pro rank among the top performing models according to mean rank over five reported metrics. Beyond the base models, we provide π-Flow distilled variants of both Kandinsky S2V 1.0 Lite and Kandinsky S2V 1.0 Pro. The distilled Kandinsky S2V 1.0 Pro model generates video in 16 sampling steps without classifier-free guidance, achieving a 5.4 times end-to-end speedup over the base model, while matching or exceeding it on nearly all reported benchmark metrics. To accelerate open research and deployment in speech-to-video generation, we release the code, model checkpoints, and diffusers integration under the MIT license.

[11] SonoWorld: Towards Interactive Pose-Controllable Ultrasound World Models cs.CVPDF

Zefan Yang, Zheyuan Zhang, Boris Maihe, Yikang Liu, Hang Yu

TL;DR: SonoWorld 从未标注临床超声视频学习因果生成，再用少量电磁追踪自由手扫描将生成动态映射到公制 6-DoF 探头动作。

Details

Motivation: 机器人超声可标准化采集并降低操作负担，但缺少真实且可控的仿真环境；超声帧只是未观测 3D 解剖的截面，探头微小移动也可能造成画面大变，使自然图像世界模型难以适用。

Result: 三阶段训练先在约 690 万张多器官未标注超声帧上预训练潜动作条件视频扩散模型，再用少量电磁追踪甲状腺扫描将动态对齐公制探头姿态，最后用分布匹配蒸馏实现因果长程自回归生成，并选择性缓存/淘汰 token。作者以姿态跟随保真度、往返一致性、合成动作轴向控制及用户研究评测。在基于模型的动作判别中，SonoWorld 在最多 74.8% 试次中能正确判断目标方向探头动作优于等幅反方向动作。摘要称其主要由自由手临床视频学习，是首个因果、姿态可控超声世界模型。

Insight: 大量临床视频提供外观动态，少量有姿态标注扫描提供动作 grounding，二者分阶段结合缓解真实监督稀缺。74.8% 为模型评判动作排序的比例，摘要未列用户研究结果和长时生成指标，不能直接等同于机器人扫描成功率。

Abstract: Robotic ultrasound can standardize image acquisition and reduce operator workload and variability, but policy learning remains limited by the lack of realistic, controllable simulation environments. While controllable world models have advanced rapidly in natural-image domains, ultrasound world modeling remains challenging because each frame captures only a cross-section of unobserved 3D anatomy, causing small probe motions to induce large appearance changes. Existing approaches rely on robot-tracked poses and latent-space prediction, but do not directly generate the observations required for interactive control. We propose SonoWorld, a causal ultrasound world model that learns video dynamics from unlabeled clinical videos and grounds them to 6-DoF control using a small set of freehand clinical scans tracked with an EM sensor. SonoWorld is trained in three stages: pretraining a latent-action-conditioned video diffusion model on around 6.9 million unlabeled multi-organ ultrasound frames; grounding the learned video dynamics to metric probe poses with a small EM-tracked thyroid dataset; and applying distribution matching distillation to enable causal, long-horizon autoregressive generation with selectively caching eviction tokens at inference time. We evaluate controllability through pose-following fidelity, round-trip consistency, and axis-specific control under synthetic actions on held-out tracked scans, and further validate it with a user study. In model-based action discrimination, SonoWorld correctly ranks the target-directed probe motion over an equal-magnitude opposite motion in up to 74.8% of trials. To our knowledge, SonoWorld is the first causal, pose-controllable ultrasound world model learned primarily from freehand clinical videos, providing a data-driven interactive environment for robotic ultrasound data acquisition and policy evaluation.

Hochul Hwang, Jahir Sadik Monon, Soowan Yang, Shiven Umeshbhai Patel, Anh Nhat Hong Nguyen

TL;DR: NavAble 提供面向盲人/低视力导航的可及性关键物体数据，并结合真实图像和可控 3D 合成数据扩大类别、环境和视角覆盖。

Details

Motivation: 识别可听行人信号、门按钮、扶手等物体对无障碍导航重要，但现有大规模视觉数据对此类类别覆盖少、标注不一且多样性不足。

Result: NavAble 含 11 类，结合 4.1 万张筛选开放图像与 8,000 张新采集且密集标注的真实图像；合成流程从 565 个资产在 37 种环境、不同风格视角生成 452,000 帧及真值标注。自动流程结合网络图像收集、VLM 筛选、SAM 3D 资产生成和相机轨迹配置。现有分割模型在该数据微调后，留出集 mIoU 超过 80%；加入合成数据后，较仅真实数据训练最高提升 3.5 mIoU。两种移动辅助机器人第一人称数据验证也显示真实导航感知可靠性提升。

Insight: 数据集将真实分布与可控合成几何结合，针对长尾无障碍对象和具身视觉覆盖不足；合成数据确有最高 3.5 mIoU 增益。摘要未给两个机器人具体导航任务成功率或类别级误差，80% mIoU 也限于作者留出集。

Abstract: Reliable recognition of accessibility-critical objects (e.g., audible pedestrian signals, door-activation buttons, and handrails) is essential for assistive navigation technologies that support safe, independent mobility for blind and low-vision (BLV) users. Yet these categories are underrepresented in existing large-scale vision datasets, and the few datasets that include them suffer from limited class coverage, inconsistent annotations, and poor diversity. We introduce NavAble, a large-scale dataset spanning 11 accessibility-critical object classes, combining 41K curated open-source images with 8K newly collected, densely annotated real-world images. To extend scale and diversity, we develop a synthetic data generation pipeline that renders high-fidelity 3D assets across 37 environments under diverse styles and viewpoints, yielding 452K frames with rich ground-truth annotations from 565 assets. The pipeline minimizes manual effort by combining automated web image crawling, VLM-based filtering, SAM 3D-based asset generation, and convenient camera trajectory configuration, enabling large-scale data generation at a diversity unattainable through manual collection. Experiments show that fine-tuning existing segmentation models on the NavAble Dataset achieves reliable accessibility-object segmentation (>80% mIoU on our held-out test set). We also demonstrate the effectiveness of synthetic data augmentation, which yields up to +3.5 mIoU over real-world-only fine-tuning. Beyond benchmark evaluation, validation on egocentric data from two mobility-assistive robots demonstrates improved perception reliability in real-world navigation scenarios. Together, NavAble establishes a scalable foundation for BLV navigation perception, directly addressing the data scarcity and embodiment gaps. The dataset and pipeline are publicly available at https://huggingface.co/datasets/NavAble/NeurIPS_2026_BLV.

[13] MMKG-R1: Constructing Multimodal Knowledge Graphs via Reinforcement Learning cs.CVPDF

Zongyu Wu, Yilong Wang, Xiaochen Wang, Minhua Lin, Yuan Zhong

TL;DR: MMKG-R1 以图谱质量为直接奖励训练多模态知识构建器，评价单个信息源抽取和最终组装图谱，而不只依赖下游问答正确性作为间接信号。

Details

Motivation: 多模态图 RAG 的效果取决于构建的知识图谱质量，但现有方法常缺少显式质量指导；只按最终答案正确性做 RL 难提供针对图谱本身的直接反馈。

Result: 作者提出多个质量感知奖励，分别评估从单个知识源抽取的信息质量和组装后的多模态知识图谱质量，并用这些奖励强化学习训练 MLLM 作为图谱构建器。在多个数据集上，作者报告生成的图谱改善下游问答准确率。摘要未列数据集名称、具体图谱质量指标或 QA 增益。

Insight: 将奖励作用于图谱抽取与结构组装本身，能提供比终局 QA 对错更直接的构造信号。摘要未说明奖励定义、人工图谱质量评估和对下游问答提升的量化幅度。

Abstract: Multimodal knowledge graphs (MMKGs) organize information across different modalities to support multimodal Graph Retrieval-Augmented Generation (RAG), which aims to improve the performance of multimodal large language models (MLLMs). The effectiveness of these multimodal Graph RAG methods largely depends on the quality of the constructed MMKGs. However, most existing methods construct MMKGs without explicit guidance on graph quality, while reinforcement learning (RL)-based methods that rely on final-answer correctness may provide only indirect feedback on MMKG quality. To address these limitations, we propose MMKG-R1, a novel MMKG-quality-driven RL framework for training an MLLM as a multimodal knowledge constructor. To be specific, MMKG-R1 introduces multiple quality-aware rewards to directly evaluate both the quality of information extracted from individual knowledge sources and the quality of the assembled MMKG. These rewards are then used to guide the RL training. Experiments across multiple datasets show that MMKG-R1 constructs MMKGs that improve downstream question-answering accuracy.

Kyusong Lee, Heting Ying, Tiancheng Zhao

TL;DR: VLX-Go 以分阶段多模态训练学习机器人中心路点跟随策略，并通过策略访问状态的 oracle 标签进行在线精炼，重点改善有干扰对象时的目标跟踪。

Details

Motivation: 跟随单一人物相对简单，但在多人或干扰对象中持续跟随指定目标困难；现有方法从单目标转向干扰跟踪时成功率明显下降。

Result: 策略结合冻结视觉编码器、多尺度时间上下文、Transformer 和机器人中心路点预测头。训练依次进行视觉—语言对齐、多模态推理中训练和跟踪专门化，使用 19,532 条 oracle episode。完整多阶段配方使干扰跟踪成功率从此前 OmTrackVLA 的 41.54% 提至 55.80%；再用策略访问状态的筛选 oracle 标签进行 on-policy 精炼，额外提高 2.42 个百分点至 58.22%，碰撞率下降 1.99 点。最终方法在比较系统中干扰及歧义跟踪成功率最高。

Insight: 先对齐表征、再学多模态推理和跟踪动作，再从策略自身访问状态获取监督，能逐步减少干扰跟踪失败。on-policy 结果属初步研究，摘要未提供环境规模或不同跟踪距离下的表现。

Abstract: Embodied visual tracking requires a robot to identify a designated target from visual observations and control its own motion to follow that target through an environment. Following an isolated person is a comparatively simple demonstration of embodied visual tracking, but following the intended person among distractors remains challenging. Existing methods exhibit a substantial drop in success from single-target to distractor tracking, motivating a focus on the shared spaces that person-following robots must navigate. We present \method{}, a vision–language waypoint policy built around the hypothesis that visual and language representations should be aligned before tracking-specific motion is learned. The policy combines complementary frozen visual encoders, multiscale temporal context, a transformer backbone, and a lightweight head for robot-centric waypoint prediction. Its training progresses through vision–language alignment, multimodal reasoning mid-training, and tracking specialization on 19,532 oracle episodes. Compared with 41.54% distractor-tracking success for our earlier OmTrackVLA model, the complete multi-stage recipe achieves 55.80%. We then explore on-policy refinement using filtered oracle labels for states visited by the policy. This preliminary study adds 2.42 percentage points of distractor-tracking success, reaching 58.22%, while reducing collision rate by 1.99 pts. The final policy records the highest distractor- and ambiguous-tracking success rates among the compared methods. These results support staged multimodal learning as a promising direction for tracking among distractors and motivate further study of on-policy refinement for person following in shared spaces.

[15] The Impact of Detector Architecture, Model Scale, and Scene Density on Multi-Pedestrian Tracking cs.CV | cs.LGPDF

Pedro Manoel Herminio Alves, Dalton Cézane Gomes Valadares, Cláudio de Souza Baptista

TL;DR: 该研究在 MOT17、MOT20、SOMPT22 上比较 YOLO11、RT-DETR、YOLO26 检测器与 ByteTrack、BoT-SORT 的组合，并分析模型规模、场景密度和推理方式对多行人跟踪的影响。

Details

Motivation: 拥挤场景中的遮挡和快速运动使行人跟踪更困难，检测器架构、规模、场景密度及 NMS/端到端推理选择都会影响最终轨迹质量和速度。

Result: RT-DETR 系列在三个基准及两种跟踪器下平均 HOTA 最高，在拥挤的 MOT20 上优势更明显，但计算成本较高。MOT17 和 SOMPT22 上，YOLO26 变体（尤其带 NMS 的 YOLO26-L）提供较好的质量—速度折中。YOLO26 对比中，端到端推理未能稳定优于 NMS 方案。摘要未提供具体 HOTA、时延或硬件数据。

Insight: 检测器选择应结合场景密度和速度约束：最高跟踪质量与最佳效率未必来自同一模型；去除 NMS 也不保证持续改善。具体推荐需根据部署算力和任务优先级，而非只看单一基准平均成绩。

Abstract: Pedestrian tracking in video is important for applications such as surveillance and scene analysis, but it becomes more challenging in crowded scenarios with frequent occlusions and rapid motion. This paper analyzes how detector architecture, model scale, scene density, and inference regime affect the tracking of multiple pedestrians. We compare the YOLO11, RT-DETR, and YOLO26 detector families with the ByteTrack and BoT-SORT trackers on sequences from the MOT17, MOT20, and SOMPT22 benchmarks. For YOLO26, we also compare traditional overlap filtering via Non-Maximum Suppression (NMS) with end-to-end inference. The RT-DETR family achieved the highest mean scores on the HOTA tracking quality metric across all three benchmarks with both trackers, with a more pronounced advantage on MOT20, albeit at a higher computational cost. On MOT17 and SOMPT22, YOLO26 variants, especially YOLO26-L with NMS, offered favorable combinations of quality and speed compared with RT-DETR. In the YOLO26 inference comparison, the end-to-end mode did not yield consistent tracking gains over the NMS-based regime. Taken together, these results provide a practical guide for selecting detectors and trackers for this task based on application priorities.

[16] WinARDet: Compressed Window Auto-Regression for Long-Horizon Vision-Language Grounding cs.CVPDF

Chenxu Wang, Hangyi Kuang, Bo-Wen Yin, Yuxuan Li, Quan-Sheng Zeng

TL;DR: WinAR 将长坐标生成拆成连续窗口，并用固定数量潜 token 压缩历史窗口，减少坐标历史注意力对新视觉证据的压制。

Details

Motivation: 密集场景 MLLM 检测器自回归生成坐标时可能陷入重复框循环；作者将其归因于历史答案注意力接管，使重复坐标 token 挤占原本关注新图像证据的注意力。

Result: Compressed Window Auto-Regression 在当前窗口内保留完整 token 自回归，把此前各窗口压缩成固定潜 token 条件后续生成，兼顾减少原始坐标重复暴露与跨窗口多目标依赖。在每图含 200–2,000 个对象的 RSDense 上，WinARDet 将 RexOmni IoU=0.5 的 F1 从 32.16 提至 39.36，冗余率从 35.48% 降至 13.00%。作者还报告其可泛化至并行框解码和多边形输出格式。

Insight: 窗口级压缩缓解历史坐标累积造成的注意力偏置，同时保留一定跨窗条件信息，针对的是长答案密集检测的特有解码故障。摘要未给推理延迟和潜在 token 对定位精度的其他影响。

Abstract: MLLM-based detectors formulate vision-language grounding as autoregressive coordinate generation, yet in dense scenes, they often collapse into a box repetition loop, repeatedly emitting identical boxes until the decoding budget is exhausted. We trace this failure to historical-answer attention takeover: Under full-history autoregression, repeated coordinate tokens in the growing answer history attract disproportionate attention, crowding out the attention sinks needed to attend to new visual evidence. % To break this loop, in this paper, we propose \textbf{Compressed Window Auto-Regression} (WinAR). This new mechanism partitions a long answer sequence into consecutive generation windows and restricts full token-level autoregression to the current window only while compressing each previous window into a fixed set of latent tokens that condition subsequent decoding. This design reduces the repeated exposure to raw historical coordinates that triggers the attention takeover, yet preserves cross-window dependencies essential for coherent multi-object generation. On RSDense, which contains 200-2,000 objects per image, our model WinARDet improves RexOmni F1-score (IoU=0.5) from 32.16 to 39.36 over the baseline, while reducing the redundancy rate from 35.48% to 13.00%. WinARDet also generalizes across decoding strategies and output formats, including parallel box decoding and polygon generation, providing a practical paradigm for long-horizon vision-language grounding across scene densities.

[17] VideoHarness-SRSI: Structured Recursive Self-Improvement for Video Understanding Harness cs.CV | cs.AIPDF

Zihao Lin, Haoyu Dong, Haobo Xu, Chi-Chih Chang, Xuying Ning

TL;DR: VideoHarness-SRSI 在冻结 VLM 外部优化视频理解 harness，通过独立探测分支、内容无关反馈和证据准入，缓解递归优化中的验证集过拟合与早期经验陷阱。

Details

Motivation: 系统能力不仅取决于模型权重，也取决于工具、信息获取、推理及记忆的可执行 harness；递归改进若反复复用有限且噪声大的反馈，可能只学会过拟合验证数据。

Result: 初始框架 VideoHarness-BRSI 演化 4,000 多个候选，虽可与手工系统竞争，却出现验证过拟合、搜索预算稀释和早期经验陷阱；作者将其归因于同一不完美验证证据同时指导 harness 修改和搜索策略。SRSI 将每个搜索决定限定在可迁移、充分且搜索承诺前收集的证据上：提议器只接收无内容反馈，探索由带仪器的预热实验指导，机制先在隔离 probe-race 分支发展，再做因子组合和联合细化。四个视频理解基准上，等权平均留出分比 BRSI 高 6.2%，验证—测试差距平均降低 37.9%。

Insight: harness 优化需要把“搜索如何选方向”与“候选如何按验证分数采纳”分开，避免单一验证集信号同时驱动两者形成闭环过拟合。提升来自四基准留出成绩；摘要未列单基准结果及 4,000 候选的具体计算预算。

Abstract: LLM system capabilities depend not only on model parameters but also on the executable harnesses that organize information acquisition, tool use, reasoning, and memory. Recursive harness evolution can automate their design, but how it can reliably discover generalizable systems from limited, noisy, and repeatedly reused feedback remains unclear. We study this question in agentic video understanding, where rich multimodal evidence and coupled mechanisms make harness optimization challenging. We first introduce VideoHarness-BRSI, a recursive self-improvement framework that evolves video harnesses around a frozen vision-language model. Analyzing over 4,000 evolved candidates, we find it competitive with hand-engineered systems but identify three interconnected failure modes: validation overfitting, search-budget dilution, and the early-experience trap. We trace all three to a common root: the same imperfect validation evidence drives both harness revisions and the proposer’s search strategy. We therefore propose VideoHarness-SRSI, an evidence-governed framework in which every search decision rests on evidence that is transferable, sufficient, and gathered before the search commits. It restricts the proposer to content-free feedback, informs exploration with instrumented warm-up experiments, and develops mechanisms in isolated probe-race branches before factorial composition and joint refinement. Across four video understanding benchmarks, VideoHarness-SRSI improves the equally weighted mean held-out score by 6.2% relative to VideoHarness-BRSI and reduces the mean validation-test gap by 37.9%. Reliable harness evolution thus depends on how search is organized and informed, not only on how well it optimizes validation performance.

[18] DeBoneDiT: Depth-Driven Conditional Bridge Diffusion Transformers for Bone Suppression in Chest X-Ray Images cs.CVPDF

Yifei Sun, Fenglei Fan, Junhao Jia, Wenming Deng, Hongxia Xu

TL;DR: DeBoneDiT 用结构感知深度自编码器保留胸片细节，再以源条件 Brownian bridge 扩散完成骨抑制，并发布 741 对胸片—软组织图像数据集。

Details

Motivation: 胸片中的骨骼重叠会遮挡肺部发现；临床双能减影虽是基准方法，但受专用硬件和额外辐射限制。扩散方案还面临潜变量重建偏差、源—目标域差异及配对数据稀缺。

Result: DeBoneDiT 用预训练 Depth Anything V2 特征构造多层深度损失训练 Depth Auto-Encoder，以保留视觉保真和结构一致性；再将骨抑制建模为源条件 Brownian bridge 扩散，把原胸片同时作为扩散先验和结构条件。作者构建公开 SZCH-X-Rays，含 741 对胸片和 DES 软组织图。实验及下游评估称方法骨抑制效果优越且计算开销较低。摘要未报告数值指标或基线差距。

Insight: 深度特征监督可减轻潜空间压缩损失结构，Brownian bridge 条件则缩小胸片源图与软组织目标域的差异。数据规模为 741 对，摘要未给临床验证和辐射/硬件比较，不能量化实际诊断收益。

Abstract: Chest X-Ray (CXR) is a primary modality for diagnosing pulmonary diseases, yet the overlap of bony structures often obscures critical radiographic findings, increasing the risk of diagnostic uncertainty. While Dual-Energy Subtraction (DES) is the clinical benchmark for bone suppression, its widespread adoption is primarily hindered by specialized hardware requirements and increased radiation exposure. Recently, diffusion-based generative models have shown promise for this task, yet they are still constrained by reconstruction-biased latent compression, prior-induced domain gap, and a scarcity of high-quality paired datasets. To address these challenges, we propose DeBoneDiT, a depth-driven conditional bridge diffusion Transformer architecture for efficient high-resolution bone suppression. We first introduce Depth Auto-Encoder (DAE), a structure-aware vision tokenizer for latent compression. By incorporating a multi-level depth feature loss derived from the pretrained Depth Anything V2 encoder, DAE preserves both visual fidelity and structural consistency. Second, we formulate bone suppression as a source-conditioned Brownian bridge diffusion process, leveraging CXRs as both the diffusion prior and structural guidance to narrow the source-to-target domain gap and maintain anatomical plausibility. Furthermore, we have constructed and released SZCH-X-Rays, the largest publicly available high-quality paired dataset for bone suppression to date, comprising 741 pairs of CXR and DES soft tissue images. Extensive experiments and downstream evaluation demonstrate that DeBoneDiT achieves superior bone suppression performance with reduced computational overhead.

[19] ActICL: Post-Training for Agentic Multimodal In-Context Learning cs.CV | cs.CLPDF

Yanshu Li, Ruixiang Tang, Junyi Jessy Li, Elias Stengel-Eskin

TL;DR: ActICL 训练 MLLM 智能体在推理中识别示例信息缺口、主动检索并迭代筛选上下文，直到证据充分或资源预算耗尽。

Details

Motivation: 多模态 ICL 效果依赖示范选择；固定相似度一次性检索容易引入冗余和噪声，已有上下文感知检索虽可渐进获取，却未让 MLLM 学会自主判断还需要哪些示例。

Result: ActICL 智能体先分析自身信息缺口并定向检索候选，再利用已获取上下文筛选、细化或启动新一轮检索；判断上下文足够或预算用完且任务可答时，将示例交给自身或另一 MLLM 回答。两阶段后训练联合优化获取和回答。七个基准、三个 MLLM 上，使用自适应数量示例比标准相似度检索平均高 11.6 个百分点，比最强既有基线高 4.4 点；GPT-5.6-Sol 使用 4-shot 时，ActICL 检索上下文在三个基准平均比标准检索高 3.5 点。

Insight: 检索示例本身可视为智能体决策过程，模型可按回答中的具体缺口决定何时继续取证或停止。性能提升伴随自适应检索预算，摘要未报告相较固定检索的平均调用成本。

Abstract: Multimodal in-context learning (ICL) is an important capability of multimodal large language models (MLLMs). Its performance is closely tied to the demonstrations it uses, making demonstration retrieval a core problem for ICL. Common methods use fixed scoring methods to retrieve all the demonstrations at once, which may introduce redundancy and noise. Context-aware retrieval methods have emerged to address this problem by allowing incremental retrieval from a growing context. However, none of them lets the MLLM learn how to judge what new demonstrations it needs and then carry out progressive retrieval on its own. To this end, we introduce ActICL, which trains an MLLM agent to acquire and use an ICL context via tool-augmented reasoning. An ActICL agent analyzes its own information gaps during iterative reasoning and tool-use actions. Based on these gaps, it performs targeted retrieval to acquire a set of initial candidates. It can then use the existing context to further filter the candidates and refine the context, or it can iteratively perform a new retrieval. When the agent judges that the context is sufficient for the task, or when the resource limit is reached with the user request met, it sends the acquired context to an answering model, either the agent itself or another MLLM. We use a two-stage post-training procedure that jointly optimizes the agent’s acquisition and answering. With an adaptive number of demonstrations, ActICL improves average performance by 11.6 percentage points over standard similarity-based retrieval across seven benchmarks and three MLLMs, and by 4.4 points compared to the strongest prior baseline. The contexts acquired by ActICL agents can also be used effectively by frontier models. When GPT-5.6-Sol performs 4-shot ICL, ActICL’s contexts improve its performance by 3.5 points over standard retrieval, averaged over three benchmarks.

[20] Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence cs.CVPDF

Yuanyuan Gao, Zhirui Liu, Yuning Gong, Yifei Liu, Yifan Zhan

TL;DR: Holi-Spatial 360 将稀疏房地产全景重建为带标注的多房间 3D 场景，并通过几何对应约束、外观补全和自动筛选构建大规模空间推理数据。

Details

Motivation: 空间智能需逼真且语义丰富的 3D 环境，但现有室内数据集多为单房间且依赖昂贵 LiDAR；房地产全景数量丰富，却因视点稀疏和纹理缺失使重建欠约束。

Result: 对应引导几何优化把前馈重建先验变成跨视图约束，并构建连贯 3D Gaussian Splatting 场景记忆；适配的单图和视频生成先验恢复外观并补齐连续轨迹，同时保留已观测内容。场景支持任意 RGB-D 渲染，自动数据筛选结合端到端 3D grounding 和 VLM 核验。Holi360 含 1,000 多个多房间 3DGS 场景、10 万余实例标注及 200 万空间问答，并推出多房间空间理解基准。作者报告稀疏全景下重建和筛选质量领先，微调 VLM 后空间推理明显提升；摘要未提供具体指标。

Insight: 利用在线房地产全景可大幅扩展多房间空间数据，几何约束先提升重建可靠性，再生成和筛选监督。摘要未披露场景实际数量的统计标准、重建指标或模型微调的量化增益。

Abstract: Spatial intelligence requires scalable 3D environments that are both photorealistic and semantically grounded, yet existing indoor datasets are dominated by room-scale captures and costly LiDAR acquisition. Online real-estate platforms offer abundant panoramas of diverse multi-room homes, but sparse viewpoints and texture-poor regions make reconstruction severely under-constrained. We introduce Holi-Spatial 360, a generative reconstruction and data curation framework for converting these panoramas into annotated multi-room 3D environments. Because reconstruction quality bounds subsequent generation, our Correspondence-Guided Geometric Optimization converts feed-forward reconstruction priors into reliable cross-view constraints and builds a coherent 3D Gaussian Splatting representation as 3D spatial memory. Adapted single-image and video priors then restore appearance and complete continuous trajectories while preserving observed content. The reconstructed scenes support arbitrary RGB-D rendering and an automated curation pipeline that combines end-to-end 3D grounding with VLM-based verification. Holi360 contains over 1K multi-room 3DGS scenes, more than 100K instance annotations, and 2M spatial question-answer pairs. We also introduce the Holi360 benchmark to evaluate the spatial understanding of VLMs in real-world, multi-room indoor environments. Experiments demonstrate superior reconstruction and curation quality under sparse panoramic inputs, while fine-tuning VLMs on Holi360 substantially improves spatial reasoning capabilities.

[21] Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion cs.CV | cs.AIPDF

Liang Yu, Tao Zhu, Xiangqing Lu, Wenjian Luo, Liming Chen

TL;DR: 该工作将智能鞋垫足底压力和加速度与单目视觉融合，补偿遮挡或短暂出画时的下肢证据缺失，并保持全身姿态时序一致。

Details

Motivation: 实时单目姿态系统在下肢遮挡或短暂离开画面时难以恢复物理合理运动和可靠足地接触；智能鞋垫可提供轻便的互补足部信息。

Result: 作者采集同步多模态数据，并提出部位解耦的时序融合框架：将足部传感特征并入下肢分支补偿不完整视觉，再用轻量协调模块在上下身时序表示间交换信息以保持全身一致。评估覆盖基于 2D 关键点、3D 地标及 SMPL 网格恢复的三种实时视觉骨干。定量实验报告，相比纯视觉基线，足部传感持续改善姿态精度、运动平滑度和步态测量，遮挡和短视觉中断时收益最大。摘要未给数据集规模、具体误差值或传感器配置。

Insight: 非视觉足部线索可补充相机暂时不可观测的接触和运动信息；不同姿态骨干均改善说明融合具有一定通用性。摘要未报告真实日常穿戴环境、不同鞋垫位置适配和额外系统延迟。

Abstract: Real-time monocular human pose estimation is an important sensing component for human-centered intelligent systems. While recent camera-based methods have achieved impressive accuracy, fundamental challenges persist, particularly when visual observations are incomplete, such as during lower-body occlusion or short out-of-frame intervals. In these challenging but common scenarios, vision-only systems often struggle to reconstruct physically plausible lower-limb motion and reliable foot-ground contact. Due to the highly unobtrusive and wearable nature of smart insoles, this paper investigates whether simple plantar pressure and acceleration sensors can effectively resolve these visually induced limitations. To systematically investigate this, we first collect a synchronized multimodal dataset and then propose a part-decoupled temporal fusion framework. The proposed model fuses foot-sensing features into the lower-body branch to compensate for incomplete visual evidence, while a lightweight coordinator exchanges information between the upper- and lower-body temporal representations to maintain whole-body consistency. The framework is evaluated with three representative real-time visual backbones based on 2D keypoints, 3D landmarks, and SMPL-based human mesh recovery. We evaluate our framework on three representative real-time visual backbones. Quantitative experiments demonstrate that incorporating simple foot sensors consistently improves pose accuracy, motion smoothness, and gait-related measurements over vision-only baselines, with the most significant gains observed under occlusion and short visual-dropout conditions. Ultimately, our results demonstrate that unobtrusive foot sensing provides vital and complementary physical observability when camera observations are temporarily unavailable.

[22] HyrCap: Hybrid Rank-Calibration of Action Proposals for Temporal Event Understanding cs.CVPDF

Rui Chen, Xingyu Chen, Pengxin Xu, Kai Chen, Junzhi Yu

TL;DR: HyrCap 面向查询式时序动作检测校准候选片段的定位质量、跨表征一致性和相互竞争关系，并将高质量候选用于后续 LLM 事件理解。

Details

Motivation: 长视频时序动作检测易产生定位不准和低质量 proposal，稀疏标注与模糊边界会加剧问题；传统管线未显式建模候选定位可靠性、跨表示支持及候选间关系。

Result: HyrCap 融合定位线索不同的视频特征，通过 Rank-Calibration 使候选置信度反映定位可靠性和候选竞争。跨表征共识校准、定位质量估计和冗余抑制分别改善排序、定位和区分能力。作者将校准候选用于标准 TAD，也输入 LLM 做事件语义理解；分阶段协议分别评估事件定位、片段级语义理解及整体事件理解。在公开基准上，作者报告多个指标达到当时最佳。摘要未给出基准名称、数值或提升幅度。

Insight: 对候选片段按定位可信度和相互冗余校准，比单独优化动作分类分数更适合为后续事件推理提供输入。摘要仅定性报告领先，无法判断各组件贡献和 LLM 语义阶段的增益。

Abstract: Temporal action detection in long untrimmed videos suffers from inaccurate localization and low-quality proposals, especially with sparse annotations and ambiguous boundaries. For open-ended video understanding and LLM-driven event analysis, reliable proposals connect temporal localization, event annotation, and semantic understanding. However, conventional temporal action detection (TAD) pipelines lack explicit modeling of proposal localization quality, cross-representation support, and inter-proposal relations. We propose Hybrid Rank-Calibration of Action Proposals (HyrCap), a proposal-centric query-based TAD framework for temporal event understanding. Hybrid combines complementary video features with different localization cues, while Rank-Calibration adjusts proposal ranking confidence to reflect localization reliability and candidate competition. HyrCap treats dense query-based predictions as an over-complete temporal event hypothesis space. Cross-Representation Consensus Calibration, Localization Quality Estimation, and Proposal Redundancy Suppression improve proposal ranking reliability, localization quality, and candidate discrimination. Inspired by LLMs’ capabilities in fine-grained semantic recognition, event description, and reasoning, we introduce HyrCap for Semantic Action Understanding, using calibrated proposals for standard TAD and as inputs to LLM-based semantic understanding. We define a staged evaluation protocol to separately measure event localization, segment-level semantic understanding, and combined event understanding performance. Experiments on public benchmarks show that HyrCap achieves state-of-the-art performance across multiple metrics and provides a finer-grained paradigm and evaluation protocol for query-based event segmentation and annotation.

[23] TextVerifier: Seeing Beyond Recognition to Verify Chinese Text Rendering cs.CVPDF

Yiyang Chen, Guo-Hua Wang, Yaoli Liu, Qing-Guo Chen, Zhao Xu

TL;DR: TEXTVERIFIER 将汉字的 IDS 结构描述作为文本侧输入，逐字符核验生成图像中的字形是否符合目标，以检测 OCR 和通用 VLM 容易忽略的局部笔画错误。

Details

Motivation: 文生图模型可能生成多一笔、少一笔或部件畸形的汉字；OCR 和通用 VLM 以识别字符为目标，往往对定义渲染错误的细节变化不敏感。

Result: 验证任务给定目标字符和图像裁剪，判断字符是否正确渲染。TEXTVERIFIER 文本塔输入表意描述序列（IDS），使用 1,270 万 crop-IDS 配对训练，并加入从文本区域修复模型训练轨迹抽取的无标签“同字不同质量”困难对。作者构建 TEXTRENDERBENCH-ZH，对 7,358 个字符标注位置、身份和正确性。F1 为 0.844，高于 OCR 置信度 0.526、通用 VLM 0.329、TextPecker 0.590。作为 Flow-GRPO 的逐字符奖励后，还能减少渲染错误。

Insight: 字符身份识别与字符形态核验是不同任务，IDS 结构描述和同字不同质量困难样本让模型关注局部笔画/部件。基准按字符标注，摘要未报告多字排版、字体变化及真实人工阅读影响。

Abstract: Text-to-image models increasingly generate readable Chinese text that still contains local rendering defects, such as a character with an extra or missing stroke or a malformed component. Such errors are invisible to OCR and vision-language models, which are trained for recognition and are therefore invariant to the very structural deviations that define a rendering error. We formalize text rendering verification as a target-conditioned problem: given a target character and an image crop, decide whether the crop is a correct rendering of that character. Our verifier TEXTVERIFIER feeds the text tower a character’s Ideographic Description Sequence (IDS) rather than a single-character symbol, and is trained on 12.7M crop-IDS pairs plus label-free “same-character, different-quality” hard pairs sampled from the training trajectory of a text-region inpainting model. To evaluate this ability we build TEXTRENDERBENCH-ZH, the first per-character benchmark for generated Chinese text, annotating position, identity, and correctness for 7,358 characters. TEXTVERIFIER reaches an F1 of 0.844, far above OCR confidence (0.526), a general VLM (0.329), and TextPecker (0.590). Used as a per-character reward for Flow-GRPO post-training, it further reduces rendering errors, showing that its score can both detect and correct errors.

Jing-Xuan Zhang, Genshun Wan, Jianqing Gao, Jia Pan, Yumei Zhang

TL;DR: FLARE通过Whisper声学教师的跨模态蒸馏及人脸—唇部双流建模，学习更稳健的视觉语音表征，在多个唇读基准上取得较强结果。

Details

Motivation: 视觉唇读受到口型线索歧义、头部姿态变化和视频分辨率下降的影响；单独依赖唇部区域也可能遗漏面部动态所含的互补信息。

Result: 方法将Whisper表征经随机投影量化为离散蒸馏目标，并以掩码预测预训练；视觉编码器联合处理唇部ROI与整脸，预训练时加入辅助音频对齐并使用模态丢弃，推理时可接轻量Transformer或LLM解码器。LRS2、LRS3和域外WildVSR上的词错误率分别为11.7%、13.2%和34.3%。渐进式消融支持各主要组件的贡献；分析还显示联合建模有助于低分辨率和大姿态变化下的稳健性，并产生更具音素区分性的表征。

Insight: 结果表明，声学教师提供的语义监督与唇部、整脸信息互补，有助于训练仅凭视觉输入工作的唇读编码器。摘要未给出各组件消融的具体数值，且当前结论限于所报告的三个基准及实验条件。

Abstract: Lipreading remains challenging due to the inherent ambiguity of visual speech cues and their sensitivity to head pose and video resolution. In this work, we propose FLARE, a framework for robust visual speech representation learning via cross-modal distillation and joint face-lip modeling. FLARE leverages semantically rich Whisper representations as the acoustic teacher signal, converting them into discrete distillation targets through a random-projection quantizer and pretraining the model with a masked prediction objective. To capture complementary visual information, FLARE employs a dual-stream architecture that jointly processes lip region-of-interest (ROI) and full-face inputs, where the lip stream captures finegrained articulatory motion and the face stream encodes broader facial dynamics. During pretraining, auxiliary audio input is incorporated to facilitate cross-modal alignment, and modality dropout is applied to encourage robust visual-only representations. For downstream lipreading, FLARE serves as a visual encoder coupled with either a lightweight Transformer decoder or an LLM-based decoder. Evaluated on LRS2, LRS3, and the out-of-domain WildVSR benchmark, FLARE achieves strong lipreading performance, with word error rates of 11.7%, 13.2%, and 34.3%, respectively. A progressive design study confirms the contribution of each major component. Further analyses demonstrate that joint face-lip modeling improves robustness under degraded video resolution and large head pose variation, while yielding more phoneme-discriminative visual representations. Code and pretrained models are available at https://github.com/jxzhanggg/FLARE.

[25] SaTPO: Text-to-Image Safety Alignment via Transition Preference Optimization cs.CVPDF

Ziyi Fang, Jingzhi Li, Xiaojun Jia, Xingxing Wei, Wenqi Ren

TL;DR: SaTPO在扩散去噪的逐步转移中对齐安全偏好，以共享父状态和噪声约束安全修改，并结合多尺度漂移约束、良性样本回放来维持正常生成能力。

Details

Motivation: 仅对完整生成图像进行偏好优化，会把多种生成因素压缩为粗粒度信号，可能引发超出安全修正所需的行为变化并损害有用生成能力。

Result: SaTPO将不安全提示及其安全改写组成偏好对，并在相同父状态和噪声下优化，以减少历史轨迹分歧；方法另用多尺度漂移约束和良性样本回放限制行为偏移，并构建经视觉核验的CoProPV数据集。在Stable Diffusion v1.5和SDXL上，相较AlignGuard，PerspectiveVision在Inappropriate Image Prompts上的不安全检测率分别从12.70%降至6.00%、从15.04%降至9.30%；FID分别从32.28改善至25.95、从36.50改善至27.51。

Insight: 逐步且共享状态的偏好对齐，旨在把安全调整限制在局部转移变化中；所报实验同时显示安全检测指标和FID改善。结论基于摘要所列模型、数据集与比较对象，摘要没有提供更多基准或统计显著性细节。

Abstract: Safety alignment of text-to-image diffusion models aims to suppress harmful content without compromising useful generation capabilities. However, preferences over completed images compress multidimensional generation factors into a coarse signal, potentially driving changes beyond those required for safety. To address this, we propose Safety Transition Preference Optimization (SaTPO), which enforces step-wise alignment during denoising. SaTPO leverages the insight that an unsafe prompt and its safe rewrite naturally form a tightly coupled preference pair when conditioned on a shared parent state and noise realization. By anchoring optimization on identical parent states, SaTPO eliminates historical trajectory divergence, confining safety adaptation to an incremental alignment while preserving task-relevant semantics. Multi-scale drift constraints and benign replay further limit behavioral deviation and preserve ordinary generation. We additionally construct CoProPV, a refined dataset ensuring visually verified contrasts. Experiments on Stable Diffusion v1.5 and SDXL demonstrate improved safety-quality trade-offs. Compared with AlignGuard, PerspectiveVision unsafe-detection rates on Inappropriate Image Prompts decrease from 12.70% to 6.00% and from 15.04% to 9.30%, respectively, while FID improves from 32.28 to 25.95 and from 36.50 to 27.51. Warning: this paper includes potentially offensive content.

[26] Frame Evidence:A Benchmark for Reference Frames and Visual Evidence in Multi-Image Spatial Reasoning cs.CV | cs.AIPDF

Chunxi Luo, Qishuai Ding, Xingchen Peng, Hengwei Ye, Ke Zhang

TL;DR: Frame Evidence用匹配的参照坐标系与视觉证据变化构造空间推理基准，揭示仅看单题准确率会掩盖模型跨条件保持正确的能力不足。

Details

Motivation: 空间题的答案依赖语言指定的参照系及图像证据；只统计单题准确率，无法判断模型在更换参照系或增删证据后是否仍能正确回答。

Result: 基准包含320组三元匹配题和960道中文选择题，来自实拍及渲染场景：一类固定图像而比较三种有依据的参照系，另一类评估删除图像后应判断证据不足，以及增加图像后答案是否保持不变。在288道留出题上的20种配置中，GPT三样例提示的单题准确率为50.00%；三参照系联合组准确率最高为5/48（10.42%），由GPT二样例提示取得。少样例提示和任务适配提高单题准确率，但未稳定提高联合正确率；输入控制揭示图像何时支持匹配条件下的成功，重复运行则显示相近得分下仍有答案不稳定性。

Insight: 该基准强调空间推理应同时考察参照系变化、证据充分性和跨条件一致性；较高的逐题得分不等同于稳健的联合推理。摘要限定在所建的中文选择题基准及报告的模型配置，不能外推为所有视觉空间任务的总体表现。

Abstract: A spatial answer depends on the reference frame specified in language and its supporting visual evidence. Item accuracy alone obscures whether correctness persists when either changes. We introduce Frame Evidence, a benchmark of 320 matched triplets and 960 Chinese multiple-choice questions from captured and rendered scenes. One family compares three grounded reference frames over fixed images. The other pairs image deletion annotated as insufficient with answer-preserving addition. Joint metrics require correct answers across all three frames and paired evidence variants. Across 20 configurations on 288 held-out questions, GPT three-shot reaches 50.00% item accuracy, but the best three-frame group accuracy is 5/48 (10.42%), reached by GPT two-shot. Few-shot prompting and task-specific adaptation improve item accuracy without consistently improving joint correctness. Input controls show where images support matched success, while repeated executions reveal answer instability beneath similar scores.

[27] LED-BENCH: A Benchmark for Large-format Engineering Drawing Understanding cs.CVPDF

Ke Li, Tianyi Wang, Enning You, Chaoqun Wan, Zhen Huang

TL;DR: LED-BENCH评测模型对机械、建筑和交通领域大幅面工程图的细粒度理解与跨区域证据推理，结果显示现有多模态模型仍有明显困难。

Details

Motivation: 现实工程图幅面大、信息密集，工程问答需要识别细节并整合分散于不同区域或视图的对象、关系和证据；已有基准多聚焦局部区域、单一视图或受限设置，对真实大幅面图纸的系统评估不足。

Result: 作者构建覆盖机械、建筑和交通领域的LED-BENCH，并评测11种多模态大语言模型，其中包括8种专有模型和3种开源模型。模型整体仍面临较大挑战；GPT-5.6 Sol平均准确率为52.65%，不同工程领域的表现存在差异，且所有受测模型在需要整合更广泛证据的问题上表现更差。

Insight: 大幅面工程图任务的瓶颈不仅是局部视觉识别，还包括跨区域证据整合和复杂推理。摘要未交代题目规模、各领域准确率及具体模型列表，因此目前不能进一步比较各领域差距或开闭源模型表现。

Abstract: Real-world engineering drawings are often large-format and information-dense. Answering practical engineering questions therefore requires both fine-grained understanding of engineering information and complex reasoning over objects, relations, and evidence distributed across different regions or views. Existing benchmarks cover a range of engineering-drawing understanding tasks involving local regions, individual views, specific elements, or more constrained visual settings. However, systematic evaluation of understanding over realistic, large-format engineering drawings remains limited. To address this gap, we introduce LED-BENCH, a multidisciplinary benchmark designed to evaluate fine-grained understanding and complex reasoning over large-format engineering drawings, spanning the mechanical, architectural, and transportation domains. Extensive evaluation of 11 representative multimodal large language models, including 8 proprietary models and 3 open-source models, reveals substantial remaining difficulty: GPT-5.6 Sol achieves 52.65% average accuracy, performance varies across engineering domains, and all evaluated models perform worse on questions requiring broader evidence integration. These results highlight fine-grained understanding, evidence integration, and complex reasoning over large-format engineering drawings as persistent challenges for current multimodal models.

[28] CORE: Contrast-and-Reflect for Self-Supervised Prompt Optimization in Anomaly Synthesis cs.CVPDF

Haoxiang Rao, Fang Zhao, Zhao Wang, Weijia Li, Chenyang Si

TL;DR: CORE通过多模态大模型将稀疏上下文转为结构化缺陷提示，再用自监督的对比—反思循环优化提示，在无需训练的零样本和单样本设置下合成工业异常。

Details

Motivation: 工业异常检测受异常样本稀缺限制；现有合成方法通常依赖有限的真实异常参考或辅助数据，在开放集场景下也缺少复杂推理和迭代提示优化能力。

Result: CORE是免训练、低成本的提示优化框架。异常上下文 grounding 模块先将少量用户上下文转为感知缺陷的生成条件，再构造结构化提示，将正常区域保持与异常特有变化解耦；随后通过自监督对比—反思机制自动优化提示。MVTec-AD和VisA实验显示，该方法在零样本和单样本设置下能生成逼真且多样的异常，并提升下游异常检测表现；其模型无关、即插即用的设计可接入不同多模态大模型，适配未见开放集场景。

Insight: 该方法把合成质量改进集中在上下文 grounding、正常区域保护和循环提示改写上，无需针对任务训练生成模型。摘要未给出具体检测指标、提升幅度及生成模型名单，因此不宜据此量化收益或判断不同模型的效果差异。

Abstract: Industrial anomaly detection (AD) is bottlenecked by the scarcity of anomalous samples, making high-fidelity anomaly synthesis crucial for improving downstream performance. However, existing methods either rely on scarce real anomaly references or auxiliary data, while lacking complex reasoning and iterative optimization capabilities for generating realistic defects in open-set scenarios. To address these challenges, we propose CORE, a cost-efficient and training-free prompt optimization framework based on Large Multimodal Models (LMMs), which unifies zero-shot and one-shot anomaly synthesis. CORE first introduces an Anomaly Context Grounding module to transform sparse user context into defect-aware generation context, which is subsequently instantiated as structured anomaly prompts that disentangle normal-region preservation from anomaly-specific variation, enabling controllable and faithful defect generation. Furthermore, CORE autonomously refines prompts through a self-supervised contrast-and-reflect mechanism. This design empowers general-purpose LMMs to synthesize realistic anomalies under both zero-shot and one-shot settings without task-specific training. Extensive experiments on MVTec-AD and VisA demonstrate that CORE synthesizes realistic and diverse anomalies, yielding superior improvements in downstream AD performance. Furthermore, its model-agnostic and plug-and-play paradigm enables effortless integration with diverse LMMs, facilitating adaptation to unseen open-set scenarios.

[29] What Breaks in Multi-Image Schema Application? Factorial Oracle Interventions Reveal an Instance-Information Bottleneck cs.CVPDF

Yiliu Xu, Xinjin Li, Yu Ma

TL;DR: 通过在同一题目上分别提供已核验的话语模式或有序目标外观表示的因子式干预，研究发现多图像模式应用的主要可恢复瓶颈是前端实例定位与顺序外观识别。

Details

Motivation: 多图像视觉语言模型的总体准确率难以揭示推理流水线中的失败环节；多图像任务既要求在序列中找出目标实例、识别外观，也要求应用专属视觉码本并按序组合名称。

Result: 研究构造受控模式应用任务：模型需在16张图像序列中定位两个目标字符、识别属性、查询对应视觉码本并组合两个有序虚构名称。作者对72个新题和1,188条模型回答实施题内2×2 Oracle 因子设计，Oracle-A提供经核验的文本模式，Oracle-B提供经核验的有序目标外观表示，同时保留原图和最终问题。Oracle-B使严格精确准确率提高54.6个百分点（95%置信区间46.3至63.0），比Oracle-A高60.6个百分点（Holm校正p≤0.0002）。即使移除名称生成，辅助检索诊断的有序外观准确率也只有49.1%；同时提供两种Oracle信息后，所有模型准确率均为100%。

Insight: 在该受控任务中，补足上游目标实例恢复的收益远大于只补足下游文本模式；主要可恢复缺陷因而位于有序实例信息获取环节，而非主要位于模式使用与组合。结论限于这项合成式模式应用任务及所测模型，不应直接泛化到所有多图像推理问题。

Abstract: Modern vision-language models can accept multi-image contexts, but aggregate accuracy rarely reveals where a multi-image reasoning pipeline fails. We study a controlled schema-application task in which a model must locate two target characters in a 16-image sequence, identify their visual attributes, consult an item-specific visual codebook, and compose two ordered nonce code names. We introduce a within-item 2-by-2 factorial Oracle design: Oracle-A supplies a verified textual schema, Oracle-B supplies a verified ordered target-appearance representation, and both interventions retain the original images and final question. Across 72 new items and 1,188 analyzed model responses, Oracle-B increased strict exact accuracy by 54.6 percentage points (95% confidence interval: 46.3 to 63.0) and outperformed Oracle-A by 60.6 points (Holm-adjusted p-value no greater than .0002). An auxiliary retrieval diagnostic reached only 49.1% ordered-appearance accuracy even after removing code-name generation. Providing both Oracle sources yielded 100% accuracy across all models. These results localize the dominant recoverable deficit to upstream ordered instance recovery rather than primarily to downstream schema use and composition.

[30] MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction cs.CVPDF

Jia Chen, Ruyang Zhao, Jun Bai, Chao Huang, Saishang Zhong

TL;DR: MagicGarment建立单张图像独立服装三维重建基准，提供1,518个专业构建资产和统一评测协议，并给出结合服装语义条件与LoRA适配的参考基线。

Details

Motivation: 单图三维重建已有进展，但独立服装因薄壳几何、开放边界和多层结构而仍具挑战；现有数据集和评测方案不足以支持对这一任务进行系统比较。

Result: MagicGarment包含1,518个专业构建的资产，覆盖17类组合服装，并提供对齐的多模态标注及统一评测协议。作者还将预训练图像到三维骨干适配为服装感知基线：Grounded Semantic Refinement（GSR）提供面向服装的视觉条件；Flow-Time-Route LoRA（FTR-LoRA）利用流时间步、令牌路由和专家负载信息适配冻结的三维生成骨干。实验支持该基准的评测用途及服装感知适配的有效性。

Insight: 该工作主要贡献是为单图独立服装重建提供专门基准、统一评测和可复现参考方案。摘要未报告具体评测指标或提升数值，也没有列出基线细节，因此不能据此判断不同服装类别上的相对效果。

Abstract: Single-image 3D reconstruction has advanced rapidly, yet standalone garments remain challenging due to thin-shell geometry, open boundaries, and layered structures. Existing datasets and evaluation protocols provide limited support for systematic evaluation in this setting. We introduce MagicGarment, a benchmark for single-image standalone 3D garment reconstruction with 1,518 professionally constructed assets across 17 composite garment types, aligned multimodal annotations, and a unified evaluation protocol. We further establish a garment-aware reference baseline by adapting a pretrained image-to-3D backbone at two levels: Grounded Semantic Refinement (GSR) provides garment-focused visual conditioning, while Flow-Time-Route LoRA (FTR-LoRA) adapts the frozen 3D generative backbone using flow-timestep, token-routing, and expert-load information. Experiments demonstrate MagicGarment’s benchmark utility and the effectiveness of garment-aware adaptation. Project page: https://1019538157.github.io/MagicGarment/.

[31] Adaptive Observation Control for Active Visual Recognition cs.CVPDF

Dikai Li, Weijia Wang, Yuan-Gen Wang

TL;DR: 该工作为主动视觉识别加入可控视野尺度和输入自适应停止机制，使模型按样本调整观察范围及注视次数，并在ImageNet-1K上以较少注视保持较高准确率。

Details

Motivation: 常规视觉识别使用固定视图和固定计算预算；已有主动视觉方法虽能选择注视位置，但所扩展的AdaptiveNN-DeiT-S仍固定视野范围和观察次数，无法按图像难度共同分配这两种资源。

Result: 方法预测每次注视的尺度以控制视野，可结合尺度门控注视细化和残差高分辨率细节令牌分支，并通过以标签为依据的停止头进行输入自适应提前终止。在细粒度基准、完整ImageNet-1K及由ImageNet-A/R构建的分类划分上，该接口与固定步数参考方法保持竞争力，并支持使用同一检查点通过阈值控制准确率—计算量权衡。顺序式ImageNet-1K实验中，学习到的停止规则以四次注视中的平均2.45次达到81.9% top-1，且计算成本低于固定三步截断。每个基准上，尺度控制与细节令牌融合的组合变体在所测的、未采用提前退出的组件增强变体中准确率最高。

Insight: 自适应调整观察尺度并决定何时停止，可将计算集中到需要更多视觉证据的输入；同一检查点也能按阈值调节准确率与成本。81.9%结果针对顺序式ImageNet-1K和所述设置，摘要未给出其余基准的完整数值。

Abstract: Visual recognition models usually process a fixed view under a fixed computation budget, although images often benefit from different scales and amounts of spatial evidence. Active vision can adapt by observing a coarse scene and then selecting informative fixations, but the public AdaptiveNN-DeiT-S pipeline still fixes both field of view and observation count. We extend this fixed-step recognizer with a controllable observation interface that adapts both the field of view and the number of fixations to the input. Specifically, the model predicts a per-fixation scale that sets its field of view, refines each selected crop with optional scale-gated foveation and a residual high-resolution detail-token branch, and uses label-grounded stop heads for input-dependent early termination. Experiments across fine-grained benchmarks, full ImageNet-1K, and ImageNet-A/R-derived classification splits show that the interface remains competitive with fixed-step references while exposing a controllable observation budget. The same checkpoint enables threshold-controlled accuracy-compute trade-offs without per-threshold retraining. On sequential ImageNet-1K, the learned stop rule outperforms fixed-step truncation of the same checkpoint, sustaining 81.9% top-1 using 2.45 of the four focus steps and exceeding three-step truncation at lower cost. On each benchmark, a variant combining scale control and detail-token fusion achieves the highest accuracy among the tested component-added non-exit variants. Our code is available at https://github.com/GZHU-DVL/LI-Dikai.

[32] Self-Conditioning Enables Deep Sequential Reasoning in Flow Matching cs.CV | cs.LGPDF

Zeyang Zhang, Linxiang Gao, Meiqi Gu, Xingyan Chen, Minrui Luo

TL;DR: 该研究从电路复杂度角度指出，普通流匹配采样的多步迭代在温和正则条件下无法为常数深度骨干带来任意更深的序贯推理；自条件通过跨步传递前一步估计打破这一瓶颈。

Details

Motivation: 逐步生成的每个采样步直觉上似乎可对应一个视觉推理步骤，但作者指出，仅增加普通流匹配采样步数未必增加模型的序贯表达能力，因此需要解释迭代生成如何真正支持更深推理。

Result: 理论上，在模型输出满足若干温和正则条件时，普通流匹配采样轨迹可由常数轮并行模型评估模拟；在标准Transformer复杂度模型下，增加采样步数因而不能提升常数深度骨干的表达能力。作者进一步指出，自条件将前一步对最终图像的估计作为后续条件，能够移除此瓶颈。多种视觉推理任务上的受控实验显示，自条件流匹配比普通流匹配准确率更高、推理深度更大，且性能随采样步数增加；理论结果还表明，采用自条件时常数深度骨干可达到与空间有界图灵机等价的表达能力。

Insight: 关键设计启示是让后续采样步骤继承此前计算形成的信息；单纯增加迭代次数不足以保证深度推理。该结论依赖论文陈述的正则条件和复杂度设定，摘要未给出各任务的定量增益。

Abstract: Recent work has explored visual reasoning through image generation, where models solve visual-reasoning problems by directly generating solution images. Intuitively, iterative samplers such as flow matching are well suited to this task, since each sampling step may resemble one reasoning step. However, in this work, from a circuit complexity perspective, we show that this intuition is misleading. We prove that as long as the model outputs satisfy certain mild regularity conditions, the trajectory of the vanilla flow-matching sampler can be simulated by a constant number of sequential rounds of parallel model evaluations. Consequently, additional sampling steps cannot increase the expressive power of a constant-depth backbone model under the standard complexity-theoretic model of transformers. We then reveal that self-conditioning, which conditions the model on the previous step’s estimate of the final image, plays a previously unrecognized role in removing this bottleneck. Controlled experiments on diverse visual-reasoning tasks show that flow matching with self-conditioning achieves higher accuracy and greater reasoning depth than vanilla flow matching, and its performance improves with more sampling steps. Theoretically, we prove that with self-conditioning, a constant-depth backbone can achieve expressive power equivalent to that of space-bounded Turing machines. Our study suggests a design principle for future visual reasoning research: carry more information between sampling steps, so that additional steps translate into deeper reasoning.

[33] SPECTRA-VLA: Base-Fine Hyperspectral Token Transfer at Frozen Vision-Language-Action Interfaces cs.CVPDF

Chih-Chung Hsu

TL;DR: SPECTRA-VLA在冻结视觉编码器和动作解码器的预训练视觉—语言—动作接口处注入连续高光谱残差，并通过目标令牌自身的参考与校准控制增强，在86次留出采集中提升类别平衡准确率。

Details

Motivation: 高光谱成像能区分RGB外观相似的物体，但预训练VLA模型的冻结解码器需要可直接利用的表示；如何增加光谱信息而不重训视觉编码器或动作解码器，并保留目标令牌的语义信息，是关键问题。

Result: SPECTRA-VLA以每个目标令牌自身归一化的伪彩参考学习连续残差，并用投影、范数控制及经验证集校准的注入幅度调节变化。86次留出采集上的类别平衡准确率从0.812升至0.883。在残差与尺度相同的情况下，将残差加到自身令牌比用池化结果替换更有利于冻结解码器logits上的外部类别探针复用，准确率为0.701对0.590，而图像隔离识别表现相近。对同一批采集的五种分组测试中，连续状态和后验码状态恢复类内光谱形状的R²分别为0.802和0.337；类别匹配的光谱交换还显示，自身令牌组合在冻结解码后带来约两倍的目标特异恢复增量。

Insight: 光谱信息增强与保留接收令牌自身内容共同作用：单纯注入残差不足以解释效果，令牌级融合对冻结接口中的目标特异信息恢复尤为重要。结果基于86次留出采集和所述探针、分组测试；摘要未给出下游真实操作任务评测。

Abstract: Hyperspectral imaging distinguishes RGB-similar objects, but a pretrained vision-language-action model needs a state its frozen decoder can use. SPECTRA-VLA provides a native-width spectral upgrade without retraining the visual encoder or action decoder. A learned continuous residual enriches each target token through its own normalized false-color reference; projection, norm control and validation-calibrated injection regulate the change. Across 86 held-out acquisitions, category balanced accuracy rises from 0.812 to 0.883. With identical residuals and scale, own-token addition improves reuse of an external category-derived probe on frozen decoder logits: 0.701 versus 0.590 with pooled replacement, at similar image-disjoint recognition. Five grouped tests covering the same 86 acquisitions recover within-category spectral shape with $R^2=0.802/0.337$ from continuous and posterior-code states. Category-matched spectral swaps further show that own-token composition approximately doubles the target-specific recovery increment after frozen decoding. Spectral enrichment and receiving-token preservation thus work together at the pretrained interface.

[34] Remember, Revisit, Revise: Scaffold Memory for Long-Horizon 3D Geometry cs.CVPDF

Soumick Sarker, Mengmi Zhang

TL;DR: SMORE为冻结几何基础模型配备可修订外部记忆，使历史相机位姿和观测能够在新证据到来后被检索、核验及修正，从而改善长时域几何推断。

Details

Motivation: 前馈几何模型把长序列分割为固定长度窗口后对齐预测，误差会跨窗口积累；流式模型虽保留历史信息供后续使用，却不能在新观测揭示旧估计错误时回头修正。

Result: SMORE为冻结的几何基础模型加入可修订记忆，把观察者所在空间位置与其感官观测关联，并支持存储、检索、用新证据核验以及在发现不一致时修订。研究在8种几何模型和5个数据集上评估，覆盖相机位姿、多视角深度、点云重建、SLAM和新视角合成。SMORE在所有受测模型上均改善长序列位姿估计；多视角深度误差最高降低58%，点云重建Chamfer距离最高降低43%，长时域SLAM平均轨迹误差最低达2.9厘米。保留修正后的位姿和观测还提升了大规模场景重建的保真度与空间一致性。

Insight: 可修订记忆将模型扩展为能够迭代纠错的长上下文推断系统，兼顾历史信息保留与事后修正。摘要报告的58%和43%是最高降幅、2.9厘米是最佳值，并非所有模型或数据集的统一表现。

Abstract: Geometry foundation models estimate camera poses and 3D scene structure from video sequences, but maintaining consistent reconstructions over long horizons remains challenging. Feed-forward models process long sequences as independent, fixed-length frame windows and align their predictions, causing pose and reconstruction errors to accumulate across windows. Streaming models retain information from past frames to inform future predictions, but cannot revise earlier estimates when later observations reveal errors. To address this, we introduce Scaffold MemOry for Revision (SMORE), a framework equipping frozen geometry foundation models with a revisable external memory for long-horizon inference. Inspired by hippocampal associative memory in biological brains, which links spatial context with sensory experience, SMORE associates where an observer is with what it observes, enabling past observations to be stored, retrieved, verified against new evidence, and revised when inconsistencies are detected. We evaluate SMORE with eight competitive geometry models on five datasets spanning camera pose estimation, multi-view depth estimation, 3D point-cloud reconstruction, simultaneous localization and mapping (SLAM), and novel view synthesis. Across all evaluated models, SMORE consistently improves long-sequence pose estimation, reduces multi-view depth error by up to 58%, reduces Chamfer distance for 3D point-cloud reconstruction by up to 43%, and achieves average trajectory error as low as 2.9 cm in long-horizon SLAM. By retaining corrected poses and observations, SMORE further improves the fidelity and spatial consistency of large-scale 3D scene reconstruction. These results establish revisable external memory as a flexible interface for extending pretrained geometry models beyond fixed-context prediction toward iterative, error-correcting inference over long visual sequences.

[35] SceneAE: Scene Generation and Reconstruction in Queryable 3D-Anchored Latent Space cs.CV | cs.AIPDF

Shuofeng Sun, Wenzhao Zheng, Yunpeng Zhang, Yi Wu, Linqing Zhao

TL;DR: SceneAE将场景表示为由显式三维位置和隐式内容特征构成的稀疏潜在点云，尝试用同一三维锚定空间支持场景重建与生成，并改善相机可控性。

Details

Motivation: 视频世界模型逐渐用三维记忆整合历史观测，但现有视频VAE潜变量通常描述特定视角下的场景外观。作者由此探问：既然三维表征可记忆观测场景，能否也直接作为场景重建和生成的潜在空间？

Result: SceneAE用显式三维坐标及隐式内容特征表示局部场景区域，形成稀疏、无结构的潜在点云。用于重建时，生成后的持久三维表示可投影到不同目标相机并解码成RGB-D观测，无需针对新的相机轨迹重新生成视频。用于生成时，先利用几何与内容分离生成受相机控制的三维几何，再以几何为条件合成内容，以减轻相机与外观的纠缠。摘要报告实验在生成质量、计算成本和相机可控性方面均取得更优结果。

Insight: 把潜变量锚定到场景本身而非某个视点，能统一支持跨相机重建和分阶段生成，并减少相机—外观耦合。所给摘要正文在方法描述中途截断，且未给出数据集、指标、基线或数值，因而只能报告其定性结论。

Abstract: Recent video world models have increasingly adopted 3D memory mechanisms to integrate historical observations into a lightweight and persistent scene representation. This naturally raises a complementary question: if 3D representations can serve as an effective mechanism for memorizing observed scenes, can they also be directly used as the latent space for reconstructing and generating scenes? Motivated by this idea, we represent a scene as a compact and unstructured 3D-anchored latent space (\textbf{SceneAE}). Each latent combines an explicit 3D position with an implicit content feature and is spatially grounded to describe its local scene region, forming a sparse latent point cloud. Unlike conventional video-VAE latents that describe how a scene appears from particular viewpoints, our representation directly describes the scene itself, making it naturally applicable to both reconstruction and generation. For reconstruction, once the scene has been generated, our persistent 3D representation can be projected and decoded into RGB-D observations by different target cameras, without the need to regenerate a video for each new camera trajectory. For generation, we leverage the geometry-content separation to first generate camera-controlled 3D geometry and then synthesize content conditioned on it, reducing camera-appearance entanglement and improving camera controllability. Experiments show that this 3D latent achieves superior generation quality, computational cost, and camera controllability.

[36] A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics cs.CVPDF

Hao-Jen Chien, Wei-Lun Chao, Yu-Lun Liu

TL;DR: 针对快速运动镜头下世界坐标人体轨迹漂移，研究诊断出相机与人体各自恢复尺度不匹配是关键原因，并提出无需重训练的闭式尺度校正。

Details

Motivation: 单目世界坐标人体恢复方法在常用基准上效果较好，但这些基准很少包含快速相机运动；在广播舞蹈视频中，逐帧网格看似合理，恢复出的舞台世界坐标轨迹却会严重偏离表演者位置。

Result: 作者引入由快速、大幅相机运动和多人密集编舞组成的K-Pop压力测试。系统诊断发现相机估计与人体估计分别保持内部一致，但二者以各自尺度恢复，组合时出现尺度不匹配；相机运动因此会转化为人体轨迹漂移，漂移随相机位移增大。作者推导闭式校正来估计尺度失配，并对所有表演者应用统一尺度，从而消除漂移并保留同一世界坐标系中的相对位置。该校正无需重新训练，可与现有后端结合；再配合物理约束，可实现稳定的世界坐标重建。

Insight: 在快速相机运动场景里，单独看相机或人体估计的内部一致性不足以保证组合后的世界坐标正确，尺度一致性是关键。校正面向所诊断的尺度失配，摘要未提供压力测试规模、具体误差数值或跨场景定量结果。

Abstract: Monocular world-space human recovery methods excel on current benchmarks, but these rarely include fast camera motion. We introduce the K-Pop stress test, broadcast dance videos that combine fast, large camera motion with dense multi-person choreography. Leading methods produce plausible per-frame meshes on these videos, yet their world-space trajectories drift far from the performers’ stage positions. Through a systematic diagnosis, we show that the camera and human estimates each remain self-consistent, and that the drift appears when they are combined at mismatched scales. Each is recovered at its own scale, so a mismatch between the two can turn camera motion into human drift that grows with camera displacement and becomes severe in broadcast dance videos. We derive a closed-form correction that estimates this mismatch and applies one scale to all performers, removing the drift while keeping their relative positions in one shared world frame. It requires no retraining and works with existing backends. Combined with physical constraints, the correction yields stable world-space reconstruction for choreography modeling, scene editing, data generation, and virtual reshooting.

[37] Mitigating Video Hallucinations via Attention-Guided Representation Perturbation cs.CV | cs.AI | cs.CLPDF

Zhixin Cai, Ruoqi Yuan, Xinchen Yang, Zhuofan Chen, Jun Bai

TL;DR: ARP-CD依据答案预测位置对视觉令牌的注意力，在输入表征空间定向扰动视频隐藏状态以构造对比解码负分支，从而在多数受测设置中降低视频幻觉并改善理解。

Details

Motivation: 视频大语言模型会生成缺乏视频证据支持的回答；对比解码可缓解幻觉，但效果依赖负分支如何削弱视觉证据。现有方法采用预定义扰动或由问题重建引导的遮罩，对生成答案时模型依赖视觉信息的程度控制有限。

Result: 无需训练的ARP-CD在答案预测位置测量分配给视觉令牌的注意力，并据此对语言模型输入中的视觉隐藏状态执行有界梯度更新，降低视觉注意力以形成负输入；生成全过程中将负分支预测与原分支预测进行对比。在四个视频大语言模型和四个基准上的实验中，ARP-CD在多数模型—基准组合上优于有代表性的免训练基线，降低幻觉并改善一般视频理解。进一步分析显示，注意力引导的扰动方向提高了负分支质量，构造的负样本可作为有效参照来修正原分支预测。

Insight: 依据回答时的视觉注意力直接构造负分支，使对比信号更贴近模型当下依赖的视觉证据；方法无需训练即可用于多个模型。摘要未给出各基准的数值、具体幻觉定义和推理开销，效果范围应以“多数受测设置”为限。

Abstract: Video large language models (Video LLMs) often generate responses unsupported by the input video. Contrastive decoding (CD) can mitigate these hallucinations, but its effectiveness depends on how the negative branch weakens visual evidence. Existing methods rely on predefined perturbations or masking guided by question reconstruction, offering limited control over the model’s visual reliance during answer generation. We introduce Attention-guided Representation Perturbation for Contrastive Decoding (ARP-CD), a training-free framework for constructing contrastive negatives directly in representation space. ARP-CD uses the attention mass assigned to visual tokens at the answer-prediction position to guide bounded gradient updates of the language model’s input visual hidden states. These updates reduce visual attention and produce a negative input, whose predictions are contrasted with those of the original branch throughout generation. Experiments across four Video LLMs and four benchmarks show that ARP-CD outperforms representative training-free baselines in most model–benchmark settings, reducing hallucinations while improving general video understanding. Further analyses show that attention-guided perturbation directions improve negative quality and that the resulting negatives provide effective contrastive references for correcting the original predictions.

[38] FPV-CRASH: A Dataset for Offline Crash Moment Localization in Drone First-Person-View Videos cs.CVPDF

Jifan Zhang, Tingyu Wang, Qian Liu, Zhedong Zheng

TL;DR: FPV-CRASH提供无人机第一视角视频中的离线碰撞时刻定位基准；固定协议下，热图参考模型将平均绝对误差从1.12秒降至0.56秒。

Details

Motivation: 已有碰撞视频数据集主要来自监控或行车记录仪，其标注和任务设置并不适用于无人机机载FPV视频中主要物理撞击时刻的时间定位。

Result: 数据集包含1,052段无人机FPV视频，其中碰撞和正常视频各526段；每段碰撞视频标注一个帧级碰撞时刻，所有视频另配有根据抽帧和已知类别自动生成的四条英文描述。正常视频不设时间戳目标，仅用于训练背景监督；描述还支持辅助文本—视频检索，但定位推理只使用视频。作者提供基于热图、从稀疏采样帧估计连续碰撞时间的参考模型。在非源视频隔离的固定片段级协议下，该模型MAE为0.56秒，相较最强固定时间先验基线的1.12秒降低50%；MedAE为0.33秒，误差在0.5秒内的片段比例从37.14%升至65.71%。

Insight: 该数据集及固定评测协议针对无人机机载视角的碰撞时刻定位，并支持利用公开来源标识重建可报告的数据部分。作者明确说明该协议不是源视频隔离划分，因此结果不应解释为跨来源泛化性能；摘要还注明提交时源视频链接均可访问。

Abstract: Crash Moment Localization aims to localize the major physical impact that interrupts controlled flight in an onboard first-person-view (FPV) video recorded by a drone, thereby providing a temporal reference for retrospective crash analysis in aerial robotics. However, existing crash-video datasets predominantly target surveillance or dash-camera footage, and their annotation schemes and task formulations are not designed for temporal localization of the major physical impact in UAV onboard FPV videos. To address this gap, we present FPV-CRASH, a dataset and fixed-protocol reference evaluation for offline Crash Moment Localization in drone FPV videos. FPV-CRASH contains 1,052 drone FPV clips (526 Crash and 526 Normal); each Crash clip has a single-frame reference annotation for the Crash Moment, and every clip is paired with four English captions automatically generated from sampled frames and the known Crash/Normal label. Normal clips carry no timestamp target and provide training-time background supervision. The captions support an auxiliary Text-to-Video Retrieval task, whereas localization inference remains video-only. We further provide a heatmap-based reference model that estimates a continuous Crash Moment timestamp from sparsely sampled frames. Under the fixed, non-source-disjoint clip-level protocol, the reference model reduces MAE from 1.12 s for the strongest fixed timing-prior baseline to 0.56 s (a 50% relative reduction) and achieves a median absolute error (MedAE) of 0.33 s; the fraction of clips localized within 0.5 s rises from 37.14% to 65.71%. The release includes annotations, available source video identifiers and URLs, clipping metadata, fixed split lists, and preprocessing code so that the reportable portion can be reconstructed without redistributing source footage. At submission time, all source-compilation URLs remained accessible.

[39] StateCraft: Augmenting Video World Models with Abstract-State Reasoning cs.CV | cs.AI | cs.LGPDF

Lorenzo Venturoli, Nedko Savov, Xi Wang, Marc Pollefeys, Luc Van Gool

TL;DR: StateCraft将持久、可更新的抽象状态与当前视觉状态分离，结合语言模型和视频扩散模型来演化世界，在生成式界面等长时交互任务上改善生成、记忆和可控性。

Details

Motivation: 视频世界模型需要在长时间交互中保持一致并跟踪动作对环境的影响，但每次只能生成部分可见观测；当连续动作改变未被观察到的区域时，仅记住过去观测可能无法反映当前世界状态。

Result: StateCraft让显式、可更新的抽象状态记录实体变化，并以此条件化表示当前视图的视觉状态；架构将语言模型与视频扩散模型结合。作者构建无需人工或智能体监督、可规模化生成信息丰富且密集标注轨迹的数据流程，并提出同时测量生成质量、记忆和可控性的基准。在生成式界面上，摘要称该方法优于现有最先进基线，并能在长轨迹中保持较高自洽性和生成质量；直接编辑抽象状态后，模型还可生成训练数据中未见过的状态。概念验证的三维实验中，动作改变了当前不可见房间的照明，显示该范式可扩展到空间环境。

Insight: 把世界状态和视角观测分开维护，允许模型在动作影响不可见区域时持续更新世界，并通过直接编辑状态实现组合式控制。摘要存在语法缺损且未提供基准规模、指标及具体提升值，因此只能保留其定性实验结论。

Abstract: Video world models aim to simulate complex environments with realistic appearance and dynamics. Maintaining consistency over long interactions requires tracking past actions and understanding how those actions affect the environment. Video world models can only generate partial observations of the entire world at a time. Remembering past observations alone may not be sufficient in every scenario, as they may no longer reflect the world after a sequence of actions. We introduce a paradigm that decouples a persistent, updatable abstract state from the visual state. The abstract state keeps track of the entities’ changes as the world evolves, and is used to condition the visual state, which represents the current view. We propose StateCraft, a novel architecture that pairs a language model with a video diffusion model to evolve the dynamic world. We evaluate our approach on generative interfaces, which pose a substantial challenge because a single action may change parts of the state that are not currently visible. To support training and evaluation, we develop a data collection pipeline that produces informative, densely annotated trajectories at scale without human or agent supervision, together with a benchmark measuring generation quality, memory, and controllability. On this benchmark, our approach improves surpasses the state-of-the-art baselines. We demonstrate that StateCraft maintains high self-consistency and strong generation quality over long trajectories. Because the abstract state is explicit, it can be edited directly, and generation follows edits to states never observed in the data. Finally, a proof-of-concept 3D experiment, in which actions change the illumination of an unobserved room, shows that the paradigm can also be applied to spatial environments. Project page: https://insait-institute.github.io/StateCraft/.

[40] PhyMetric: Diagnosing Physical Plausibility in Text-to-Video Generation via Scene-Level QA cs.CVPDF

Siwei Meng, Xuerou Cai, Rui Hu, Ping Liu

TL;DR: PhyMetric把文本到视频生成的物理合理性评估转为场景级、可核验的问答基准，结合针对性二元问题和结构化物理先验定位模型错误。

Details

Motivation: 文本到视频模型可能生成外观逼真但违反提示或场景物理后果的视频；整体合理性分数或宽泛质量维度难以说明具体测试了哪种物理行为以及模型为何失败。

Result: PhyMetric包含1,115个场景，覆盖六个领域的50类物理现象，并配有8,920个答案均衡的二元问题，涉及12个评估维度。每个场景有8道针对性是非题及结构化物理先验，描述控制规律、预期时间顺序、可观测特征和常见失败模式。评测时，视觉语言模型裁判根据先验及问题相关抽帧回答，再按场景、维度、物理类别和模型层级聚合。四种开源文本到视频模型和三种视觉语言裁判的实验显示，若将针对性问题替换为单个通用合理性问题，评估器准确率会降至随机水平；结构化先验提供互补信号，可改善分数与人工判断的一致性，但效果随裁判模型能力而异。

Insight: 针对场景的问题和明确物理先验是可解释评估的关键组成，整体单问打分可能失去有效诊断能力。人工对齐收益依赖视觉语言裁判的能力；摘要未报告各生成模型的详细分数及先验对齐增益数值。

Abstract: Text-to-video (T2V) generation models can produce visually realistic videos that nevertheless violate the physical consequences implied by the prompt and scene. Existing benchmarks largely rely on holistic plausibility scores or broad quality dimensions, leaving it unclear which physical behavior is being tested and why a model fails. We introduce PhyMetric, a scene-level diagnostic benchmark that recasts physical plausibility evaluation as verifiable, scene-grounded question answering. PhyMetric contains 1{,}115 scenes spanning 50 physical categories across six domains, paired with 8{,}920 answer-balanced binary questions over 12 evaluation dimensions. Each scene is associated with eight targeted yes/no questions and a structured physical prior specifying the governing law, expected temporal sequence, observable signatures, and common failure modes. At evaluation time, a vision-language model (VLM) judge answers each question from question-aware sampled frames conditioned on the prior, and correctness is hierarchically aggregated into scene, dimension, physical category, and model scores. Experiments on four open-source T2V models and three VLM judges show that scene-specific binary QA is a critical component of the protocol: when each targeted question is replaced by a single generic plausibility query, evaluator accuracy drops to the chance level. Structured physical priors offer a complementary signal that improves human alignment of the resulting scores, with effects that vary across VLM judges of different capacity. These findings establish PhyMetric as a benchmark that turns physical plausibility evaluation from opaque holistic scoring into interpretable, scene-level inspection. Our project page is available at: https://mengsiwei.github.io/PhyMetric/.

[41] VisibilitySplat: Ray-Traced Occlusion for Relighting with 3D Gaussian Splatting cs.CV | cs.GRPDF

Sven Kluge, Oliver Staadt

TL;DR: VisibilitySplat为3D高斯泼溅逆渲染加入稀疏、点基光线追踪可见性查询，以支持重光照及材质—光照分解，同时保留原有高效光栅化训练流程。

Details

Motivation: 基于3D高斯泼溅的逆渲染需要显式建模遮挡和可见性，才能更好地进行重光照并分离材质与光照；同时希望保留标准泼溅流程的训练效率、交互可视化和工具兼容性。

Result: 方法以稀疏可见性预言机估计采样光照方向下高斯基元的透射率加权遮挡，通过BVH加速的点基光线追踪实现，并仅在逆渲染目标中稀疏查询；原始3DGS训练循环保持不变。着色采用基于物理的微表面BRDF及低分辨率HDR环境光。在TensoIR合成数据集上，作者将方法与NeRF、张量表征及3DGS基线比较，结果显示其整体具有竞争力，并在新视角合成、反照率重建和重光照方面超过若干较早基线。消融显示，显式可见性建模有助于重光照及材质—光照解耦；仅用PBR监督则可能偏向新视角合成中的外观拟合。

Insight: 稀疏点基遮挡查询可补充光栅化泼溅表示的可见性信息，兼顾逆渲染能力与既有3DGS生态的实用特性。实验为TensoIR合成数据集，摘要未给出具体指标或所有基线的对比数值；PBR监督还可能产生任务间取舍。

Abstract: We address inverse rendering with 3D Gaussian Splatting (3DGS) by introducing explicit visibility modeling for relighting as well as material and light decomposition. Our approach augments the standard rasterized 3DGS pipeline with a sparse visibility oracle that estimates transmittance-weighted occlusion for Gaussian primitives from sampled lighting directions. This oracle is implemented using a point-based ray tracer accelerated by a bounding volume hierarchy (BVH) and queried sparsely within the inverse-rendering objectives, while the original 3DGS loop is retained for training efficiency, interactive visualization, and tooling compatibility. Shading follows a physically based rendering (PBR) formulation with a principled microfacet bidirectional reflectance distribution function (BRDF) and low-resolution high-dynamic-range (HDR) environment maps. We evaluate our method on the TensoIR synthetic dataset against baselines based on neural radiance fields (NeRFs), tensor representations, and 3DGS. The results show competitive performance and improvements over several earlier baselines for novel-view synthesis (NVS), albedo reconstruction, and relighting. Ablations indicate that explicit visibility modeling is an important contributor to relighting and material-illumination disentanglement, while pure PBR supervision can favor appearance fitting in NVS. Overall, the findings suggest that sparse, point-based visibility queries effectively complement rasterized splatting for inverse rendering while preserving the practical advantages of the 3DGS ecosystem.

[42] DeltaStreamer: Towards Human-Like Agentic Streaming Video Understanding cs.CV | cs.AI | cs.HCPDF

Boyuan Sun, Deshui Miao, Wenzhao Gao, Shaoyong Jia, Shaohui Jiao

TL;DR: DeltaStreamer为流式视频智能体结合变化感知记忆、查询驱动规划与历史片段回放，使系统可在收到问题后补取观察阶段遗漏的视觉证据。

Details

Motivation: 流式理解系统需在不知道未来问题细节时先保留证据。现有方法压缩视频历史时可能模糊事件转变或遗漏细节，且难以在之后恢复已丢失的视觉证据。

Result: DeltaStreamer持续观察视频流并把画面变化显式记录到结构化记忆，保留事件演进而非仅存当前状态描述。收到问题后，查询驱动规划器确定所需证据并引导记忆检索和定向回放；通过重新查看历史帧，智能体可恢复观察阶段没有保留的细节，并用证据支撑回答。在OVO-Bench和StreamingBench上，整体得分分别为66.07%和59.53%，优于代表性的流式视频理解方法。

Insight: 把持续观察与收到问题后的主动调查结合，可缓解在线压缩造成的不可逆信息丢失。摘要未给出具体基线分数、方差或回放计算成本，所报得分只代表两个指定基准。

Abstract: We propose DeltaStreamer, a novel agentic framework for streaming video understanding inspired by how humans observe, remember, and investigate. Streaming video understanding requires a system to retain evidence before knowing which details future queries will need. Existing approaches often obscure event transitions and omit relevant details when compressing video history, and cannot recover missing visual evidence. DeltaStreamer addresses these limitations by combining change-aware memory with query-driven planning and targeted evidence gathering with replay. Before a query arrives, it continuously observes the stream and explicitly records visual changes in structured memory, preserving how events unfold rather than only what is present. When a query arrives, a query-driven planner identifies the required evidence and guides memory retrieval and targeted replay. By revisiting historical frames, the agent can recover visual details omitted during observation and ground its answer in evidence beyond the retained descriptions. This connects continuous observation with active investigation tailored to each question. Experiments on OVO-Bench and StreamingBench demonstrate improvements over representative streaming video understanding methods, with overall scores of 66.07% and 59.53%, respectively. Project page: https://bbbbchan.github.io/DeltaStreamer/

[43] CoDy: Codec Dynamics as Complementary Priors for Unsupervised Temporal Action Localization cs.CVPDF

Tianyu Yan, Qingyi Yang, Qin Yang, Xufei Guo, Yuan Tang

TL;DR: CoDy将视频编码器中的GOP量化模式、运动矢量及残差变化作为无标注时序动作定位的补充先验，分别辅助类别聚类与边界学习，且推理阶段不增加编解码侧计算。

Details

Motivation: 无监督时序动作定位需同时发现动作类别并定位边界；既有方法通常只依赖RGB和光流表征，容易产生噪声类别分配和不准确的时间边界。

Result: 作者发现，视频编解码器的组图像量化模式保留类别区分性动态，运动矢量和残差变化则在动作转变附近呈现明显响应。CoDy将编码器信号构成的视图与RGB、光流融合，以置信度感知共识聚类生成软伪标签；再将编解码动态转为类别无关的边界先验，监督视觉边界学习并指导候选初始化和迭代细化。编解码器分支只用于训练，推理时无额外编解码侧计算。在THUMOS14和ActivityNet v1.3上，作者报告CoDy持续优于现有无监督方法并达到最先进定位表现。

Insight: 视频压缩过程中的编码信号包含可供动作发现和边界定位使用的无标注动态信息，可补充视觉特征。摘要未列出各指标的具体数值或提升幅度，且编码器分支只在训练阶段参与。

Abstract: Unsupervised temporal action localization (UTAL) aims to identify action categories and localize their temporal boundaries without annotation supervision. Existing methods typically derive supervision for both tasks solely from RGB and optical-flow representations, often resulting in noisy category assignments and inaccurate temporal boundaries. In this work, we reveal an overlooked property of video codecs: group-of-pictures quantization patterns preserve category-discriminative dynamics, while motion-vector and residual variations exhibit pronounced responses around action transitions. Based on this insight, we propose CoDy, a codec dynamics-guided framework that exploits the codec as complementary information to the visual view for UTAL. CoDy integrates a codec-enhanced view with RGB and flow through confidence-aware consensus clustering, producing reliable soft pseudo-labels. It further converts codec dynamics into a class-agnostic boundary prior, which supervises visual boundary learning and guides proposal initialization and iterative refinement. The codec branches are only used during the training stage and introduce no extra codec-side computation at inference. Extensive experiments on THUMOS14 and ActivityNet v1.3 demonstrate that CoDy consistently outperforms existing UTAL methods and achieves state-of-the-art localization performance. These results establish codec signals as effective annotation-free priors for jointly inferring which actions occur and when they occur.

[44] BluePixel: Toward Native 4K Agentic Image Editing cs.CVPDF

Shanyan Guan, Shiyu Li, Xin Li, Zhizhou Chen, Yunzhe Xu

TL;DR: BluePixel将原生4K图像编辑模型与智能体流程结合，通过渐进式VAE适配、持续学习、强化学习和蒸馏提升编辑能力，并由智能体拆解操作、验证结果及有限重试。

Details

Motivation: 原生4K指令编辑模型的训练细节尚不透明，从头预训练成本高；单一端到端编辑器也难以兼顾精确参数修改、专用专家能力和用户模糊指令理解，因此作者把4K编辑视为系统问题。

Result: BluePixel把1K预训练编辑器转为原生4K模型，采用渐进式VAE适配以使4K训练成本接近1K，持续学习吸收长尾纵向编辑技能，并以强化学习调整美学与保真度的权衡。源图锚定目标投影（SATP）蒸馏把50步去噪压缩到4步，在单张Kunlunxin P800 XPU上8.7秒完成4K编辑，同时保持任务成功率和背景一致性。BluePixel Agent将用户指令拆成专用及通用操作，用训练时同一奖励模型验证每次结果，并在有限次数内重试。在含3,305个原生4K案例的VINS-4KEval++上，BluePixel在7个模型中排名第二，仅在未编辑区域一致性上落后于GPT Image 2。

Insight: 系统同时处理模型能力、推理速度和交互控制；SATP显著减少去噪步数，智能体则承担复杂指令拆解与结果检查。排名结论来自VINS-4KEval++，且摘要只明确说明未编辑区域一致性排名第二，没有给出其它维度的全面排名或训练成本明细。

Abstract: Instruction-driven image editing has reached native 4K, yet how such editors are trained remains undisclosed, and pretraining one from scratch is beyond most teams. The task itself compounds the difficulty: a single end-to-end editor cannot make precise parametric adjustments, match specialized experts, or interpret the vague instructions users actually write. We argue that 4K editing is a system problem rather than a single-model problem, and present BluePixel, which couples a native-4K editing model with an agent harness; the complete training recipe is disclosed in this paper. The model makes 4K training practical: it turns a 1K-pretrained editor into a native-4K one through progressive VAE adaptation that keeps 4K training as affordable as 1K, absorbs a long tail of vertical editing skills through continual learning, and refines the aesthetic-fidelity trade-off with reinforcement learning. Distillation via source-anchored target projection (SATP) then compresses 50 denoising steps to 4, completing a 4K edit in 8.7 s on a single Kunlunxin P800 XPU while preserving task success rate and background consistency. The harness, BluePixel Agent, makes editing controllable: it decomposes user instructions into specialist and general operations, verifies every result with the same reward model that guided training, and retries within bounded attempts. On VINS-4KEval++ (3,305 native-4K cases), BluePixel ranks second among seven models, behind only GPT Image 2 in non-edited-region consistency.

[45] Multimodal Medical Image Parsing with Task-Specific Low-Rank Adapters cs.CV | cs.AI | cs.LGPDF

Taha Sabir, Alberto Montero Molina, Thinh Quang Ly, Veronika Dmitrenko, Mohammad Yaqub

TL;DR: 该FLARE 2026医学图像解析方案在冻结4比特Qwen3.5-9B骨干上按问题选择任务专属LoRA适配器，并根据分类、计数、检测、回归和报告生成分别调整训练配置。

Details

Motivation: 单个视觉语言模型要适配多种医学图像解析任务，训练选择需要反映各任务差异；该工作研究如何在共享骨干下为不同任务配置专属适配器、提示和图像预算。

Result: 系统覆盖6类任务和7种影像模态，使用共享冻结的4比特骨干，并根据输入问题选择LoRA适配器；不同任务使用定制秩和提示，稀有分类目标进行重平衡，回归训练另加入皮肤科分类样本。在固定内部留出集上，分类数据集宏平均平衡准确率为0.7791，多标签分类数据集宏平均micro-F1为0.6286，计数MAE为11.73，检测数据集宏平均F1为0.8914，回归数据集宏平均MAE为9.78，报告生成CRIMSON分数为0.8204。在组织方1,703例隐藏验证集上，提交系统分类平衡准确率0.8496、多标签样本平均F1为0.5338、回归MAE为14.5950。最终容器30.1 GB，含模型加载的单例平均耗时3.1秒；重复验证输出一致。

Insight: 任务专属适配器配置与图像预算在共享医学视觉语言骨干上有助于覆盖异质任务，但各任务收益不同；内部留出与隐藏验证的指标口径也不完全相同，不能直接把它们视为同一评测上的可比数值。

Abstract: Adapting a single vision-language model to medical image parsing requires training choices that reflect the demands of each task. We study task-specific adaptation with Qwen3.5-9B for FLARE 2026 Task 3, covering six task families and seven imaging modalities. Our system couples a shared, frozen 4-bit backbone with LoRA adapters selected from the input question. We customize adapter ranks and prompts, rebalance rare classification targets, and supplement regression training with dermatology classification examples. On the fixed internal holdout, the task-specific adapters achieve a dataset-macro balanced accuracy of 0.7791 for classification, a dataset-macro micro-F1 of 0.6286 for multi-label classification, a counting mean absolute error (MAE) of 11.73, a dataset-macro detection F1 of 0.8914, a dataset-macro regression MAE of 9.78, and a report-generation CRIMSON score of 0.8204. On the organizer’s 1,703-example hidden-validation set, the submitted system achieves 0.8496 classification balanced accuracy, 0.5338 sample-averaged multi-label F1, and 14.5950 regression MAE. The final 30.1 GB container averages 3.1 seconds per case, including model loading, and produces identical outputs across repeated verification runs. The benefits vary across tasks, supporting the use of task-specific adapter configurations and image budgets within a shared medical vision-language model. Code is available at https://github.com/TahaSabir0/FLARE26-Hexapus.

[46] SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking cs.CV | cs.LGPDF

Tomáš Čížek, Matej Straka, Illia Volkov, Matěj Kripner, Ervin Macić

TL;DR: SAM3RL把SAM 3跟踪器的记忆帧选择建模为强化学习序贯决策，由轻量控制器选择写入记忆库的帧，在12个跟踪与视频目标分割基准中的10个达到新最佳结果且无额外运行时开销。

Details

Motivation: SAM 3继承SAM 2的FIFO记忆管理，但近期为SAM 2手工设计的记忆更新规则往往只针对干扰物、遮挡或运动等特定失败类型，迁移到更强的SAM 3骨干时收益有限。

Result: SAM3RL在SAM 3跟踪器上增加轻量记忆控制器，并通过强化学习训练其决定哪些帧进入记忆库，以最大化跟踪表现。该方法在12个跟踪和视频目标分割基准中的10个取得新的最先进结果，超过所有比较的手工规则，且不增加运行时开销。将相同思路应用于SAM 2得到SAM2RL，在12个基准中的9个超过手工规则，显示该记忆控制策略可跨模型代际应用。

Insight: 将记忆更新从固定FIFO或针对单一故障的人工规则转成数据驱动的序贯决策，可在不增加推理开销的情况下提升多个基准表现。摘要未给出各基准的具体分数、训练成本或未提升的基准名称。

Abstract: Segment Anything Model 3 (SAM 3) is a foundation model for image and video segmentation that sets the state of the art in visual object tracking. Its tracker, inherited from SAM 2, stores information from past frames in a memory bank, managed by a simple First-In-First-Out rule, allowing temporal consistency in complex videos. Several recent methods improve SAM 2 with hand-crafted memory update rules, each targeting a specific failure mode, such as distractors, occlusions, or object motion. However, their gains transfer only partially to the stronger SAM 3 backbone. We instead present a more general, data-driven approach that frames memory control as a sequential decision-making task. SAM3RL is an extension of the SAM 3 tracker with a lightweight memory controller, trained by reinforcement learning, that decides which frames enter the memory bank in order to maximize tracking performance. SAM3RL sets a new state of the art on 10 of 12 tracking and video object segmentation benchmarks, outperforming all hand-crafted rules without any runtime overhead. The same approach applied to SAM 2 gives SAM2RL, which outperforms hand-crafted rules on 9 of the 12 benchmarks, showing the generality of our method across model generations.

[47] Instruction Mining From Images: Constructing a Synthetic Dataset for Multimodal Learning ILSP DCVLR Competition Submission cs.CVPDF

Eleni E. Kasoura, Dimitrios Damianos, Georgios Paraskevopoulos, Vassilios Katsouros

TL;DR: 该DCVLR竞赛提交构建从图像生成并筛选指令—回答对的紧凑流程，使用奖励模型过滤合成样本，形成覆盖数学、空间和社会推理的图像指令数据集。

Details

Motivation: 多模态学习需要大量图像条件指令数据；该工作关注如何用可复现流程从已有图像集合合成并整理简洁指令—回答样本。

Result: 流程以Cauldron图像集合为来源，使用Qwen2.5-VL-7B-Instruct按图像及系统提示合成指令和回答，再执行清理、标签整理，并按DeBERTa-v3奖励模型得分过滤，仅保留正分样本以提升指令质量。作者报告奖励分数的中位数约1.53、均值约1.75，称多数生成指令质量较好；最终数据集覆盖数学、空间及社会推理等多种指令。

Insight: 图像条件合成配合奖励模型筛选，构成相对紧凑、可复现的数据整理管线。正奖励分数及其均值、中位数并不能单独证明指令事实正确或任务有效；摘要未给出数据集规模、过滤比例或人工质量评估。

Abstract: This work presents a compact and reproducible pipeline for synthesizing and curating image-based instruction-response pairs for DCVLR. We draw from the Cauldron collection and use Magpie-style instruction and response synthesis with Qwen2.5-VL-7B Instruct to create concise, image-conditioned instruction pairs. The pipeline consists of instruction synthesis, conditioned on input images and controlled via a system prompt, sanitization, tagging, and filtering of the instructions based on the score obtained by a reward model (DeBERTa-v3). We retain samples with positive scores to maximize the quality of the generated instructions. We observe that score distributions have a median and mean reward score of ~ 1.53 and ~ 1.75 respectively, indicating that most generated instructions are of good quality. The resulting dataset contains diverse instructions in the math, spatial, and social reasoning domains.

[48] Why 3D Reconstruction Breaks Down on Under-Ice AUV Video, and How to Predict It cs.CV | cs.ROPDF

Ana-Ştefania Kogălniceanu, Klára Orbán, Ashwin Nedungadi, Stefan Lüdtke, Kuderna-Iulian Benţa

TL;DR: 研究在同一段南极冰下AUV视频上比较四类三维重建方法，发现它们以不同方式失败，而共同原因与相机基线相对场景深度过小的采集条件一致。

Details

Motivation: 冰下AUV视频的三维重建精度不佳，但此前不清楚问题主要来自重建算法，还是采集系统本身的局限。

Result: 作者在同一段Icefin于南极Kamb冰流拍摄的冰下视频上，测试经典特征匹配SfM、可微光度泼溅、体积深度融合和无位姿前馈基础模型。四种方法均失败，但表现各异：几乎无法配准、虽光度指标看似正常但几何破损、持续的覆盖伪影，以及跨片段尺度不稳定。分析发现，这些现象都与相机基线相对于场景深度过小的采集条件相符。基于此，作者提出可在数分钟内标记此类重建失败的检测系统，以避免耗费数小时计算。

Insight: 在严重基线—深度比限制下，算法间的表面差异可能掩盖共同的采集可观测性问题；在大规模重建前先快速诊断数据条件可以节省计算。研究只报告一段特定冰下视频及四种方法，摘要没有给出检测器指标或跨场景验证结果。

Abstract: Reconstruction of 3D structures using under-ice AUV video footage has been inaccurate, although it is not certain whether this is due to shortcomings in the methods or an inherent deficiency of the capture system. We test four different models for reconstruction on the same Antarctic under-ice AUV video (Icefin, Kamb Ice Stream): classical feature matching SfM, differentiable photometric splatting, volumetric depth fusion, and a pose-free feed-forward foundation model. All four fail, each in a distinct way: near-total registration yielding almost no structure, geometrically broken output despite healthy photometric metrics, a persistent coverage artifact, and unstable cross-chunk scale. We show that all four are consistent with the same capture regime, a small camera-baseline-to-scene-depth ratio. Following our analysis, we propose a detection system that flags this type of failure in minutes, rather than hours of wasted compute.

[49] GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation cs.CV | cs.AI | cs.CRPDF

Yixin Wu, Mingjie Li, Yun Shen, Michael Backes, Yang Zhang

TL;DR: GeoCloak利用地理定位线索常位于图像外围但对地点推断影响大的不对称性，结合定向语义编辑、对抗扰动和效用反馈，降低视觉语言模型从照片推断城市的准确率。

Details

Motivation: 大型视觉语言模型可仅凭无元数据的单张照片推断位置，带来隐私风险；现有防护主要依靠对抗扰动，可能产生肉眼可见伪影并损害图像用途。

Result: GeoCloak先分析图像以识别与地理位置相关的线索，再规划定向语义编辑以抑制外围线索，并自主配置对抗扰动削弱剩余地理特征；整个过程由迭代的效用反馈约束。作者在覆盖108个国家和576座城市的四个数据集上，针对五种大型视觉语言模型和三种推断方法评估。城市级总体准确率从41.2%降至9.9%，约为最强基线残余准确率的一半，同时在定性和定量图像效用保持方面显著优于基线。

Insight: 隐私防护可优先针对决定地理位置、但视觉上处于外围的语义线索，再处理剩余表征，以减少对整体图像语义的破坏。结果限于摘要所列数据集、模型及推断方法；摘要未给出各类效用指标明细及真实用户场景验证。

Abstract: The rapid advancement of large vision language models (LVLMs) has made geolocation inference from images highly accurate and accessible. This poses serious privacy risks: a passive adversary with black-box LVLM access can infer a user’s location from a single photo with no metadata. Existing protection methods rely almost exclusively on adversarial perturbation, which introduces perceptible visual artifacts and utility degradation. We identify the visual-geolocation asymmetry: geolocation-decisive clues, such as street signs, tend to be visually peripheral but dominate location inference. Exploiting this asymmetry, we propose GeoCloak, an agentic framework for semantics-preserving geolocation privacy protection. It acts as a clue-aware planner that analyzes each image to identify geolocation-relevant clues, dispatches targeted semantic edits to directly suppress peripheral clues, and autonomously configures adversarial perturbation to further suppress residual geolocation features, all under iterative utility-aware feedback. We evaluate GeoCloak on four diverse datasets spanning 108 countries and 576 cities against five LVLMs and three inference methods. GeoCloak reduces overall city-level accuracy from 41.2% to 9.9%, approximately half of the best-performing baseline, while achieving substantially superior utility preservation both qualitatively and quantitatively. We hope this work takes a meaningful step toward practical, semantics-preserving geolocation privacy protection, giving users greater control over the location information inadvertently embedded in their shared images.

[50] Feasibility of a Patient-Specific Digital Twin for Ventriculoperitoneal Shunt Trajectory Planning cs.CV | q-bio.QMPDF

Kritsanavis Chongsrid, Vich Yindeedej, Supaporn Konmun, Xulei Yang, Si Yong Yeo

TL;DR: 该患者特异性数字孪生从术前CT重建颅骨、头皮、耳部和脑室，自动搜索安全约束下从Keen点周边进入的最长脑室内路径；在11例连续成人病例中，10例达到Hayhurst 1级。

Details

Motivation: 脑室腹腔分流导管堵塞是分流失败最常见原因；在Keen点徒手置入时，导管尖端仅约十分之一病例能自由位于脑脊液中，提示固定入口和深度难以适配个体解剖。

Result: 数字孪生根据术前CT以确定性几何重建颅骨、头皮、耳部和脑室，在Keen点周边搜索满足安全约束且脑室内长度最长的垂直轨迹，并把计划转为相对耳部的两项尺量及两项深度。该方法在11名连续成人患者中按徒手方式实施（IDEAL 2a阶段），10/11达到Hayhurst 1级；历史对照为213例中的22例，摘要报告p=9×10⁻⁹。入口位置和角度中位偏差分别为2.5毫米和5.9度，脑室内导管比Keen点方案多1.4厘米，未发生术中并发症。操作技术未变，改进来自按患者选择入口与深度。

Insight: 小样本连续病例结果支持个体化入口及深度规划的可行性，但与历史病例比较不能单独确立因果或长期获益。作者明确将是否降低翻修率列为下一阶段待检验假设，当前摘要没有提供长期随访结局。

Abstract: Catheter obstruction is the commonest cause of shunt failure; freehand insertion at Keen’s point leaves the tip free in cerebrospinal fluid in only one case in ten. We built a digital twin that reconstructs skull, scalp, ear and ventricles from preoperative CT by deterministic geometry, searches every entry around Keen’s point for the perpendicular trajectory with the longest intraventricular length under safety constraints, and returns the plan as two ruler measurements from the ear and two depths. Executed freehand in 11 consecutive adults (IDEAL Stage 2a), it achieved Hayhurst Grade 1 placement in 10 of 11 against 22 of 213 historically (p = 9 x 10^-9), median entry and angular deviations 2.5 mm and 5.9 degrees, 1.4 cm more intraventricular catheter than Keen’s point, and no intraoperative complication. The technique was unchanged; the gain came from choosing entry and depth per patient. Whether it lowers revision is the next stage’s hypothesis.

[51] VisualWorldBench: A Fine-Grained Multi-Task Benchmark for Evaluating Visual World Knowledge in MLLMs cs.CVPDF

Chen Chen, Zheming Liang, Jiaqi Wang

TL;DR: VisualWorldBench以覆盖八个视觉领域的分类体系构建细粒度、多任务视觉世界知识基准，并发现最强闭源模型平均准确率为80.4%；使用50K+类别训练资源微调后，基准表现提升超过21个百分点。

Details

Motivation: 现有多模态大模型视觉世界知识基准覆盖类别和领域有限，且题目常可凭粗粒度线索、模糊关联或排除法作答，难以判断模型是否真正掌握细粒度实体概念。

Result: VisualWorldBench基于覆盖8个视觉领域、含21,291个叶节点类别的层级分类体系构建，包含32,541个实例，标注覆盖15,479类，涵盖闭集识别、对比选择、精确定位和开放世界命名四种任务。多数题目从分类学上相近的类别构造，要求细粒度区分。实验中最强闭源模型平均准确率仅80.4%。作者另构建覆盖50,000多个类别的VisualWorldBench-50K训练资源；在其上微调后，VisualWorldBench准确率提升超过21个百分点，并迁移到公开细粒度识别和视觉知识基准。

Insight: 宽泛的实体覆盖和近邻类别判别能暴露传统基准未显现的知识缺口，多种答案开放度也考察了不同知识提取方式。摘要未报告各任务分项成绩、训练成本及公开基准上的迁移提升幅度；超过21个百分点针对主基准。

Abstract: Visual world knowledge is a core capability of multimodal large language models (MLLMs), underpinning knowledge-intensive visual question answering and fine-grained visual reasoning. However, existing benchmarks remain limited in two key respects. First, their category coverage is narrow: most benchmarks span only a small number of categories across a few domains, falling far short of the open-ended scale of real-world visual entities. Second, their task construction is often insufficiently rigorous: models can answer correctly using coarse-grained cues, vague associations, or elimination strategies without truly mastering precise concepts, making it difficult to accurately assess their knowledge of fine-grained entities. We introduce VisualWorldBench, a taxonomy-grounded multi-task benchmark built on a hierarchical taxonomy of 21,291 leaf-node classes across 8 visual domains, with 32,541 evaluation instances whose ground-truth labels cover 15,479 categories across four complementary tasks: closed-set recognition, contrastive selection, precise localization, and open-world naming, covering different directions of knowledge retrieval and varying degrees of answer openness to comprehensively evaluate visual world knowledge. Most questions are constructed from taxonomically proximate categories, forcing precise discrimination among fine-grained entities. Experiments reveal that the strongest closed-source model achieves only 80.4% average accuracy, exposing capability gaps hidden under conventional benchmarks. We further construct VisualWorldBench-50K, a training resource covering 50K+ categories. Fine-tuning on VisualWorldBench-50K yields over 21 percentage points improvement on VisualWorldBench, with consistent transfer to public fine-grained recognition and visual knowledge benchmarks.

[52] When Pairwise Preferences Cycle: A Reliability-Anchored Preference Walk for Video GRPO cs.CVPDF

Xinrui Lin, Fan Li, Shumin Wang, Dehong Kong, Yanyong Zhang

TL;DR: 该研究审计视频生成GRPO组内的成对偏好图，发现循环偏好普遍存在且持续至训练中，并提出可靠性锚定偏好游走以结合胜率与图关系证据来计算优势。

Details

Motivation: 成对比较通常比单点标量评分更适合评价生成视频，但若只按平均胜率聚合，偏好图中的关系结构会被丢弃，可能使个别rollout的优势估计不可靠并影响强化学习优化。

Result: 作者把每个GRPO组的样本构造成偏好图，节点对应采样rollout、边记录评估器的成对偏好；审计6,976个在线比较图后发现循环偏好十分常见，且贯穿训练过程。针对仅平均胜率的聚合方法，作者提出Reliability-Anchored Preference Walk，以可靠性引导的图游走将全局胜率信号与循环偏好图中的可靠关系证据结合起来计算优势。在评估器、比较协议、组规模、提示调度和查询预算匹配的条件下，该方法无需在每组已观察比较之外额外查询评估器，并在受控比较、迁移设置和盲道人评中优于Pairwise-GRPO。

Insight: 循环成对偏好包含可利用的关系信息，不应在优势估计时简单压成彼此独立的平均胜率；该方法在固定查询预算下重新利用已采集比较。摘要没有给出具体提升幅度、循环偏好率或人评设置细节。

Abstract: Pairwise preference feedback has become a widely adopted supervision signal for reinforcement learning in video generation models, as pairwise comparisons provide a more reliable alternative than pointwise scalar ratings for evaluating the quality of generated videos. Specifically, we define a preference graph for each GRPO group under a pairwise evaluator, where nodes represent sampled rollouts and edges encode pairwise preferences. Auditing 6,976 on-policy comparison graphs, we find that cyclic preferences are prevalent and persist throughout training. Naive pairwise reward aggregation based on average win rates discards the underlying comparison structures and treats each rollout independently, which may introduce unreliable advantage estimates for certain rollouts and consequently affect reinforcement learning optimization. Therefore, we propose the \emph{Reliability-Anchored Preference Walk} (\ours{}), a graph-aware advantage aggregation method that strengthens the global preference signal from win rates with reliable relational evidence from cyclic preference graphs through a reliability-guided preference walk. Under matched evaluator, comparison protocol, group size, prompt schedule, and query budget, \ours{} requires no additional evaluator queries beyond the observed comparisons within each rollout group and improves over Pairwise-GRPO across controlled comparisons, transfer settings, and blind human evaluations.

[53] RTAformer: Relation-Transition-Aware Transformer for Video Scene Graph Generation cs.CVPDF

Jaeyeon Heo, Geuntaek Lim, Yukyung Choi

TL;DR: RTAformer将视频场景图中的实体持续性与关系变化分开建模，以相邻帧关系查询差异引导谓词更新，缓解模型在真实关系已改变后仍沿用旧预测的语义惯性。

Details

Motivation: 视频场景图生成要同时利用对象身份持续性和关系突变。已有跨帧聚合方法侧重一致性，可能掩盖关系转变，使模型在关系已经变化后仍保留上一帧预测。

Result: 作者提出单阶段关系转变感知Transformer（RTAformer），分别建模实体持续性和关系变化；通过注入相邻帧关系查询之间经校准的差异来引导谓词更新，并在训练中进行跨帧实例对齐以减少表征漂移。在Action Genome上的实验显示，相较既有方法，召回率和平均召回率均有所提高。消融支持各组成模块的贡献；使用匹配骨干的比较还显示，在关系转变帧上的增益大于非转变帧。

Insight: 对实体身份保持稳定与对关系变化快速响应需要采用不同机制；把两者分开建模更有利于避免关系语义惯性。摘要未给出具体指标值、关系转变帧占比或多数据集验证结果。

Abstract: Video scene graph generation (VidSGG) aims to capture objects and their evolving relationships in videos. This requires accounting for both the persistence of object identities and abrupt changes in relationships. Existing methods aggregate information across frames to exploit temporal context, but an emphasis on consistency can obscure these changes. As a result, a model may retain its previous prediction even after the underlying relation has changed. We refer to this failure mode as relational semantic inertia. To address this issue, we propose Relation-Transition-Aware Transformer (RTAformer), a one-stage framework that separately models entity persistence and relation changes. It injects calibrated differences between adjacent-frame relation queries to guide predicate updates, while cross-frame instance alignment during training helps reduce cross-frame representational drift. Experiments on Action Genome show improvements in recall and mean recall over existing methods, with ablation studies supporting the contributions of the proposed components and comparisons using matched backbones showing larger gains on relation-transition frames than on non-transition frames.

[54] RepForcing: Representation-Space Initialization for Autoregressive Video Distillation cs.CVPDF

Siming Fu, Zheming Fu, Lianrui Mu, Haoyang Huang, Chaojie Gu

TL;DR: RepForcing以冻结视频扩散模型的归一化特征监督替代中间教师轨迹回归，学习少步自回归视频生成初始化；在四步块式生成中，相较因果ODE初始化基线提升VBench和VisionReward。

Details

Motivation: 将预训练视频扩散模型蒸馏为少步自回归生成器时，因果兼容的中间教师可提供ODE初始化目标，但这种目标并不保证短采样流程保留高质量细节；直接潜变量回归倾向的后验均值也可能导致模糊。

Result: Representation Forcing通过表示空间监督学习少步因果初始化：训练时比较学生的干净预测与目标在冻结视频扩散Transformer上的归一化特征，而不是回归中间教师的轨迹。该阶段复用双向模型生成、用于自回归教师训练的合成视频，替代教师训练和因果ODE蒸馏，无需额外生成因果ODE轨迹；后续非对称DMD保持不变。实验显示，在应用DMD前，四步RepForcing比中间教师初始化更好地保持生成质量。DMD后，四步块式模型相较报告的因果ODE基线，VBench Total从84.04升至84.66（+0.62分），VisionReward从6.326升至10.074（+59.25%）。

Insight: 少步生成初始化可直接在冻结教师表征空间中匹配，从而减少对因果ODE轨迹的依赖并改善细节保留；该初始化收益也传递到后续DMD模型。结果针对所述四步块式配置和基线，摘要未提供更多视频生成指标及人评结果。

Abstract: Distilling pretrained video diffusion models into few-step autoregressive (AR) generators typically combines student initialization with distribution matching distillation (DMD). An intermediate AR teacher can provide causally compatible targets for ODE initialization. However, causally compatible targets alone do not ensure high-quality generation under a short sampling schedule. We analyze the posterior-mean predictions favored by direct latent regression and empirically find that causal ODE initialization alleviates blur but still leaves fine detail unresolved. To address this limitation, we propose Representation Forcing, which learns few-step causal initialization through representation-space supervision rather than intermediate-teacher trajectory regression. The student is trained with teacher forcing by comparing clean predictions and training targets through normalized features of a frozen video diffusion transformer. This phase reuses the synthetic videos generated by a bidirectional model for AR teacher training and replaces both teacher training and causal ODE distillation, without generating additional causal ODE trajectories. The subsequent asymmetric DMD procedure remains unchanged. Empirical results show that, at four sampling steps, RepForcing better preserves generation quality than intermediate-teacher-based initialization before DMD. After DMD, our four-step chunk-wise model improves VBench Total from 84.04 to 84.66 (+0.62 points) and VisionReward from 6.326 to 10.074 (+59.25%) over the reported causal-ODE-based baseline.

[55] DreamHMR: From Video Generation to Human Motion Modeling via Structural Focusing cs.CV | cs.AIPDF

Zhengjie Xu, Ruihao Gong, Xianglong Liu

TL;DR: DreamHMR把视频生成预训练表征适配到人体几何，通过全局身体表征迁移与局部关节特征增强恢复完整身体和手部网格，在多个数据集的遮挡及非遮挡评测中降低关键点误差。

Details

Motivation: 人体网格恢复为理解动作提供几何基础，但从真实视频同时准确恢复身体运动和精细手部姿态仍很困难，尤其受遮挡及局部不可见影响；视频生成预训练虽含丰富时空先验，其表征与显式人体几何之间存在差距。

Result: DreamHMR采用全局到局部策略，先将视频表征锚定到人体几何，再利用可靠局部证据细化身体和手部。全局身体表征迁移训练视频骨干预测完整人体渲染，以学习表面对应及姿态几何；局部关节特征增强结合上下文估计和可靠局部线索恢复细节，并抑制遮挡物和背景干扰。在五个数据集、四种视频骨干上评测，统一协议下最佳模型在3DPW、EMDB-1和RICH报告的所有指标上超过最佳已有方法，身体MPJPE分别降低4.2%、4.7%和6.1%。在留出的BEDLAM和EgoBody遮挡序列上，身体和手部总体MPJPE分别降低7.0%和10.0%。

Insight: 视频生成先验可通过显式人体几何迁移和局部证据筛选，服务于完整身体及手部重建；局部模块还需限制遮挡物与背景干扰。报告的百分比是相对既有方法的MPJPE降低，具体协议、各骨干排名和不同遮挡类型细项未在摘要中列出。

Abstract: Human mesh recovery (HMR) provides a geometric foundation for understanding human motion, but accurately reconstructing both body motion and fine hand articulation from videos remains challenging, especially in real-world scenes where occlusion and partial visibility are common. Video generation pretraining offers rich spatial and temporal priors for this task, but its focus on visual synthesis leaves a gap between these representations and explicit human geometry. We present DreamHMR, a general framework that adapts video generation priors for complete body-and-hand reconstruction. It follows a global-to-local strategy, first grounding video representations in human geometry and then refining body and hand detail with reliable local evidence. Global Body Representation Transfer trains the video backbone to predict complete human renderings, turning its native prediction task into a means of learning surface correspondence and posed geometry. Local Joint Feature Enhancement combines contextual estimates with reliable local evidence to recover fine body and hand detail, while limiting interference from occluders and background. Experiments on five datasets with four video backbones demonstrate strong reconstruction performance across backbone families. Under a unified evaluation protocol, our best model outperforms the best existing methods on all reported metrics of 3DPW, EMDB-1, and RICH, reducing body MPJPE by 4.2%, 4.7%, and 6.1%, respectively. In more challenging occlusion settings on held-out BEDLAM and EgoBody sequences, DreamHMR reduces overall body and hand MPJPE by 7.0% and 10.0%, respectively. Our code will be made publicly available.

[56] StreamErase: Towards Ultra-Fast Streaming Video Erasing cs.CVPDF

Zhuobai Dong, Xiaobing Tu, Xiantao Zhang, Jinkui Ren, Yinggui Wang

TL;DR: StreamErase先将双向文本到视频模型的擦除能力迁移到单向流式擦除器，再用带注意力汇的滑动窗口因果注意力和KV缓存滚动维持恒定计算，实现最高26 FPS的长视频流式物体擦除。

Details

Motivation: 现有视频物体移除方法每段视频常需数分钟，延迟过高且采用非因果处理，无法实时交互；流式处理还必须在长乃至无限时域中避免域差、误差累积和随上下文增长的计算成本。

Result: 方法先给文本到视频模型加入掩码输入，使其生成擦除目标并补全背景，但该模型自身不能在线推理；随后将其能力逐步迁移到高效单向流式擦除器。为处理长时域，作者使用带注意力汇的滑动窗口因果注意力，并在训练中加入带注意力汇的自回归滚动和KV缓存滚动，模拟固定上下文窗口下的推理外推，从而支持恒速生成任意长视频。作者建立LongErase专用基准；StreamErase达到亚秒级延迟、单GPU最高26 FPS，报告性能较强并可泛化到真实视频场景，支持无限长度流式擦除。

Insight: 固定窗口加训练时自回归外推，使流式生成在上下文长度增长时维持恒定速度；能力迁移解决高质量双向教师与因果在线推理之间的差距。最高26 FPS取决于摘要未说明的硬件及配置；摘要未提供LongErase具体指标或模型间量化比较。

Abstract: Current video object removal methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction. We present StreamErase, enabling sub-second latency with up to 26 FPS streaming generation on a single GPU. Our approach first augments a text-to-video model with mask input to generate high-quality videos that erase target objects and synthesize coherent backgrounds, but does not perform inference on the fly. As such, we progressively transfer the erasing capability from a powerful bidirectional foundation model to an efficient unidirectional streaming eraser, enabling long-horizon erasing without sacrificing visual fidelity. Several key challenges arise when generating videos over long, potentially infinite horizons: (1) bridging the domain gap from training on finite length and extrapolating to long horizons, (2) sustaining high quality by preventing error accumulation, and (3) maintaining fast inference, without increasing computational cost as the context grows. To address these challenges, we carefully designed sliding-window causal attention with attention sinks. By incorporating self-rollout with attention sinks and KV cache rolling during training, we simulate inference-time extrapolations with a fixed context window, enabling constant-speed generation of arbitrarily long videos. Finally, we establish a dedicated benchmark, LongErase, for streaming long-video object removal. Our model achieves strong performance compared to existing video object erasing models and generalizes well to real-world video scenarios, uniquely enabling infinite-length streaming. With StreamErase, users can input a mask and see the erasing results unfold in real-time, delivering a truly interactive experience.

[57] Attention-Based Spatio-Temporal Approach for Fire and Smoke Detection cs.CVPDF

Alireza Mirrashid, Mohammad Khoshbin, Ali Atghaei, Hassan Shahbazi

TL;DR: 该方法用空间特征和时间特征结合Transformer模块进行烟雾与火灾视觉检测，旨在应对室外难以部署红外和烟雾传感器的场景。

Details

Motivation: 工作场所的烟雾与火灾威胁重大，常用红外热传感器和烟雾传感器不适用于室外环境，因此需要视觉检测；烟火检测具有时空特性，单纯静态图像特征不足以描述其发展。

Result: 论文提出结合空间特征与时间特征的烟火检测方法，由三个主要部分组成，作者称各部分用于降低前一部分的误差，并加入Transformer模块提高检测准确率。摘要仅定性报告模型在烟雾和火灾检测任务上表现适当，认为可用于提升工作场所安全。

Insight: 该工作强调同时利用空间外观和时间变化来处理烟火检测。摘要未说明三个部分的具体结构、数据集、指标、与基线的比较结果或实际部署验证，因此不能据此量化鲁棒性或安全效益。

Abstract: In various industries, smoke and fire are two of the most important threats in the workplace. One of the common methods for detecting smoke and fire is the use of infrared thermal and smoke sensors, which cannot be used in outdoor applications. Therefore, the use of vision-based methods seems necessary. The problem of smoke and fire detection is spatiotemporal and requires spatiotemporal solutions. This paper presents a method that uses spatial features along with temporal-based features to detect smoke and fire in the scene. It consists of three main parts; the task of each part is to reduce the error of the previous part so that the final model has a robust performance. This method also uses transformer modules to increase the accuracy of the model. The results of our model show the proper performance of the proposed approach in solving the problem of smoke and fire detection and can be used to increase workplace safety.

[58] OneLA: Learning Many Worlds from Latent Actions cs.CVPDF

Ziyu Zhu, Zhaoxu Sun, Fan Jiang, Chiyu Wang, Junfeng Ni

TL;DR: OneLA通过共享正交字典和统一预测目标，从多领域视频学习连续潜在动作，为跨域世界模型提供共同控制接口，而无需在潜在动作预训练中使用任务专属设计或跨域对齐损失。

Details

Motivation: 跨多样领域学习世界模型需要统一控制空间，但不同领域的动作接口各异且动作标注稀缺。直接从视频学习潜在动作有望摆脱显式动作监督，却会受到外观、具身形态和动力学差异造成的领域线索纠缠影响。

Result: OneLA用共享正交字典和共同预测目标学习连续潜在动作；之后通过轻量适配器把各域原生控制命令映射到该空间。世界模型根据潜在动作和当前视觉状态预测依赖上下文的状态转移，以支持可控展开。实验中，OneLA改善跨领域动作读出，并相较最强受测基线将动作循环迁移旋转误差降低24.8%。联合训练比较还显示，真实场景生成的人类偏好分数HPSv3提高20.5%。

Insight: 共享潜在动作可作为异构原生控制接口之间的中间表示，为多领域视频世界模型提供统一控制方式。摘要未给出所涉领域、数据规模、动作误差的绝对数值及HPSv3评测细节，不能据此判断不同具身或动力学间的泛化边界。

Abstract: Learning world models across diverse domains calls for a unified control space, yet ac- tion interfaces vary across domains and action annotations are often scarce. Latent ac- tions learned directly from videos offer a promising way to establish such a space without explicit action supervision. However, learning shared latent actions across domains re- mains challenging, as variations in appearance, embodiment, and dynamics can entangle domain-specific visual cues with transferable transition structure. To this end, we intro- duce OneLA, a simple framework that learns continuous latent actions through a shared orthogonal dictionary and a common predictive objective, without task-specific designs or cross-domain alignment losses during latent action pretraining. These latent actions pro- vide a shared conditioning interface for world models, with lightweight adapters mapping native control commands into the same space. Conditioned on latent actions and the cur- rent visual state, the world model predicts context-dependent transitions for controllable rollout. OneLA improves action readout across domains and reduces action cycle-transfer rotation error by 24.8% over the strongest evaluated baseline. A joint-training comparison further shows a 20.5% improvement in Human Preference Score v3 (HPSv3) for real- scene generation. These results suggest a path toward general-purpose world models that learn from diverse videos and support flexible control through latent action space.

[59] Continual pretraining Prostate MRI ViT Encoder for task alignment cs.CV | cs.LGPDF

Bilal A. Sidiqi, Yipei Wang, Shaheer U. Saeed, Shiqi Huang, Daniel C. Alexander

TL;DR: 该研究以LoRA对预训练ViT编码器进行前列腺分割持续预训练，考察预训练目标与下游任务对齐，并通过CKA分析表征变化。

Details

Motivation: MRI基础模型研究多聚焦有效预训练策略及多项下游任务表现，但视觉领域中预训练目标与下游目标是否对齐并不显然，针对这种任务对齐的分析相对不足。

Result: 作者在前列腺分割任务上使用低秩适配（LoRA）持续预训练已有ViT编码器，以改善下游任务对齐和表现，并用中心化核对齐（CKA）进行逐层表征分析。在六项下游任务中，持续预训练后有三项性能提高，其余任务结果相当。分割任务的特征分析显示，持续预训练编码器表征比原始预训练编码器更接近微调后编码器表征，这与观察到的性能提升相关。

Insight: 在与目标任务更接近的前列腺分割数据上持续预训练，可能使特征表征向下游所需方向移动，但收益并非对所有任务都出现。摘要没有列出六项任务名称、数据集、指标或提升幅度，且表征相似性与效果是相关观察。

Abstract: Building foundation models for MRI has emerged as a promising direction for advancing medical image analysis and improving accessibility of task specific models. Existing approaches primarily focus on effective pretraining strategies and evaluating their performance across diverse downstream tasks. While these methods show performance gains, limited attention has been given to understanding task alignment between pretraining and downstream objectives. Unlike language models, where the two stages are naturally aligned, such alignment is less evident in vision based applications. Motivated by this gap, we explore continual pretraining. Specifically, continually pretraining a pretrained ViT encoder using Low-Rank Adaptation (LoRA) on a prostate segmentation task to enhance task alignment and downstream performance. We further perform layer-wise representational analysis using Centered Kernel Alignment (CKA) to assess representational shifts and their correlation with task outcomes. Our experiments show improved performance in 3 of 6 downstream tasks and comparable results in the others. Our Feature analysis reveals that, for segmentation tasks, continually pretrained encoder features exhibit greater similarity to those of the finetuned encoder than the original pretrained encoder, correlating with observed performance gains.

[60] Glance Forcing: Making Bidirectional Diffusion Autoregressive at a Glance cs.CVPDF

Zhuobai Dong, Junchao Yi, Hu Jian Guo, Linjie Li, Rui Zhao

TL;DR: Glance Forcing把少步因果视频蒸馏拆分为慢、快两个专家并分别监督，只需一条PF-ODE轨迹就超过充分训练的最先进基线，同时把轨迹采集成本降至约一张A100 GPU运行一小时。

Details

Motivation: 把双向扩散模型转换成因果少步学生通常需要数万GPU小时和TB级存储的离线PF-ODE轨迹。进一步把监督压缩到单条轨迹虽最省成本，却会严重损害质量；作者将其归因于高噪声语义/运动阶段与低噪声纹理阶段的轨迹曲率和优化行为不同，单一学生难以兼顾。

Result: Glance Forcing冻结预训练教师，将去噪轨迹解耦为互补的慢、快专家，并为不同阶段配置目标。作者还指出，PF-ODE蒸馏主要使少步轨迹几何变直，而后续分布匹配阶段单独负责分布质量。只用一条PF-ODE轨迹时，该方法VBench Total从充分训练的SOTA基线84.04升至84.22，同时把轨迹采集成本从数千GPU小时降到约一张A100 GPU小时；动态程度、VisionReward及指令跟随的增益更大，人类评审也持续偏好该方法。

Insight: 只减少轨迹数量会造成质量崩塌，但按噪声阶段分解优化可显著降低监督采集成本；轨迹几何匹配与生成分布匹配承担不同作用。约一A100 GPU小时是摘要所报轨迹采集成本，不等同于全部训练和推理成本；具体增幅及人评规模未给出。

Abstract: Autoregressive generation underlies real-time, causal video synthesis and is the backbone of video world models. Today’s dominant approach distills a bidirectional diffusion model into a causal few-step student, but existing pipelines make this conversion prohibitively expensive, requiring offline Probability Flow ODE} (PF-ODE) trajectories that cost tens of thousands of GPU-hours and terabytes of storage. We show it can be made dramatically more efficient. Pushing this efficiency to its extreme, we reduce trajectory supervision to a single sample, the strictest setting possible, and find that it causes severe quality collapse. We trace this to the teacher’s trajectory geometry: the high-noise regime, governing semantic layout and motion, and the low-noise regime, governing fine texture exhibit fundamentally different curvature and optimization behavior, so a single monolithic student cannot jointly fit both, causing severe representation interference. Motivated by this, we propose Glance Forcing, a lightweight distillation framework that decouples the denoising trajectory into two complementary slow and fast experts, each guided by a tailored, stage-specific objective, while keeping the pretrained teacher entirely frozen. This decoupling further reveals a general mechanism underlying few-step distillation: PF-ODE distillation mainly straightens the few-step trajectory geometry, while the subsequent distribution-matching stage independently governs distributional quality. Using only one PF-ODE trajectory, Glance Forcing already surpasses the fully-trained state-of-the-art baseline, raising the VBench Total score from 84.04 to 84.22 while cutting trajectory-collection cost from thousands of GPU-hours to about one A100-GPU-hour, with markedly larger gains in dynamic degree, VisionReward, and instruction-following, and consistent preference from human raters over strong baselines.

[61] PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents cs.CV | cs.AIPDF

Siqi Yang, Yimu Wang, Ziqi Cai, Chengxuan Zhu, Shuchen Weng

TL;DR: PAWA提供Minecraft多人动作条件全景世界建模数据集和模型，将玩家第一视角视频、稳定世界坐标下的全景视频及同步动作配对，用于预测多个独立行动者对共享环境的影响。

Details

Motivation: 多人世界模型需预测多名玩家各自动作如何改变共同环境，包括玩家当前视野之外的状态。第一视角视频只记录环境进入视野后的变化，而全景视频能覆盖各方向；但Minecraft此前缺少同步多人第一视角/全景视频及动作数据集。

Result: PAWA数据集为每名玩家配对第一视角视频、世界坐标稳定的全景视频和对齐动作。分布式采集流程将CPU游戏捕获与GPU渲染解耦，可扩展到64名以上同时参与者；同一记录会话还能在不重放游戏的情况下按新的观察配置重新渲染。作者进一步提出双塔模型联合预测第一视角和全景视频，并以跨注意力对齐共享世界坐标系中观察相同方向的令牌；二次相位玩家编码在相同嵌入维度下提供比已有旋转编码更多的玩家编码。实验显示，PAWA模型的第一视角预测优于最先进多人世界模型，同时生成高保真全景预测。

Insight: 同步全景、第一视角与动作标注为研究局部观察与共享世界状态变化之间的关系提供数据基础；双流联合预测利用共同世界坐标对齐多玩家视角。摘要未给数据集规模及各项预测指标，64人以上指采集管线可扩展能力。

Abstract: A multiplayer world model must predict how the independent actions of several players change a shared environment, including changes outside a player’s current field of view. A point-of-view (POV) video captures such changes only after they enter its field of view, whereas panoramic video records the surroundings in every viewing direction and has served as an intermediate representation of the world state in recent world models. Learning this task therefore requires synchronized POV and panoramic videos of interacting players together with their actions, yet no existing dataset provides this combination in Minecraft, an established testbed in which players act independently in a shared, modifiable 3D world. We present PAWA, a dataset and framework for action-conditioned panoramic multiplayer world modeling. The dataset pairs each player’s POV video with world-stabilized panoramic video and aligned actions. Its distributed pipeline decouples CPU gameplay capture from GPU rendering, scales beyond 64 simultaneous players, and re-renders each recorded session under new observation configurations without replaying the gameplay. On this dataset, we develop a dual-tower model that jointly predicts POV and panoramic video and couples the two streams through cross-attention that aligns tokens observing the same direction in a shared world frame. We further introduce a quadratic-phase player encoding that provides many more player codes than existing rotary codes at the same embedding dimension. Experiments show that PAWA outperforms state-of-the-art multiplayer world models in POV prediction quality while also producing high-fidelity panoramic predictions. The dataset and collection pipeline are open source to support further research on multiplayer world models.

[62] GLoD-LVSM: Learning Geometry-Grounded Continuous-LoD Scene Representations for Large View Synthesis Models cs.CV | cs.GRPDF

Weikai Lin, Nicholas Milef, Carl S Marshall, Grant Kaijuin Yang, Todd Keeler

TL;DR: GLoD-LVSM学习连续可调的几何锚定场景表示，通过几何引导压缩和视锥剔除减少大规模视图合成模型的场景令牌及渲染开销，同时保留渲染质量。

Details

Motivation: 大规模视图合成模型能从稀疏视图重建场景并快速渲染新视角，但场景令牌冗余会带来不必要的存储与渲染成本。

Result: GLoD-LVSM不学习固定数量的锚点初始化，而学习连续场，以按目标预算初始化可变数量锚点；压缩器将场景信息聚合到锚点中，场与压缩器端到端训练。压缩器推断参考令牌和锚点几何，通过几何引导注意力完成压缩，并在解码时支持视锥剔除。相较已有LVSM场景压缩基线，该方法实现最优渲染质量—令牌数量权衡。与未压缩基座相比，在无质量损失时令牌数减少33.4%、渲染加速1.23倍；放宽质量损失预算后，令牌减少85.5%、加速3倍。进一步分析发现，视图合成监督会涌现出场景深度和自组织锚点，使其贴合表面并按局部纹理复杂度调整密度；该表示还支持场景语义理解。

Insight: 连续可调的几何锚点使场景表示能按资源预算压缩，并以几何信息改善渲染和解码剔除。33.4%/1.23倍对应无质量损失设定，85.5%/3倍则允许一定质量损失；摘要未给出下游场景语义任务的具体分数。

Abstract: Large view synthesis models (LVSMs) reconstruct scenes from sparse views and render novel views quickly, but they incur unnecessary storage and rendering costs due to token redundancy. We present GLoD-LVSM, a compact, geometry-grounded scene representation for LVSMs with continuous levels of detail. First, instead of learning a fixed set of scene anchor initializations, GLoD-LVSM learns a continuous field that initializes a flexible number of anchors to match the desired budget. A condenser then aggregates scene information into these anchors, with both the field and condenser trained end-to-end. Second, the condenser infers reference-token and anchor geometry to guide compression through geometry-grounded attention, improving rendering quality and enabling frustum culling during decoding. Compared with existing LVSM scene-compression baselines, GLoD-LVSM achieves the best trade-off between rendering quality and scene token count. Compared with the uncompressed base model, GLoD-LVSM reduces the scene-token count by 33.4% and accelerates rendering by $1.23\times$ with no quality loss. Under a relaxed quality-loss budget, the reduction increases to 85.5%, with $3.00\times$ rendering speedup. Further analysis reveals that view-synthesis supervision yields emergent scene depth and self-organized anchors that align with surfaces and adapt their density to local texture complexity. Beyond rendering, we further show that our scene representation also supports scene-semantic understanding, highlighting its potential for broader downstream tasks.

[63] Beyond Static Cues: Unified Dynamic Detection of MLLM Backdoors via Dual-Flow Trajectory Analysis cs.CV | cs.AIPDF

Yinzhen Huang, Jiahe Xie, Yitong Sun, Ruochen Zhang, Xingxing Wei

TL;DR: EVO-Detect把多模态后门检测从静态输入或内部统计快照转向早期解码动态，联合追踪注意力流和logits流，并用负控制特征减少自然扰动的误报。

Details

Motivation: 视觉语言模型后门可能由文本注入、亚感知噪声或跨模态触发器引起，静态线索和针对特定攻击的启发式难以覆盖未知威胁；攻击可能改变生成时的模态贡献，同时对输入扰动表现出异常输出不变性。

Result: EVO-Detect监测早期解码阶段内部信号的变化：注意力流衡量图文注意力分配如何演化，logits流通过模态干预消融测量输出分布对模态扰动的敏感性。方法将两类轨迹转成样本级指标，并以负控制特征归一化，降低把自然扰动误判为后门证据的概率。多种攻击家族实验显示，该方法在总体表现上显著优于BYE和TCAP等先进基线。

Insight: 对生成轨迹的动态分析可捕捉静态快照遗漏的跨模态贡献变化和异常稳定性，双流信号也增强检测的统一性。摘要没有给出攻击数据集、检测指标、误报率或各攻击家族的具体结果。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed in safety-critical domains, yet their susceptibility to backdoor attacks remains a formidable challenge. While existing defenses have evolved from visual-centric patch cues to unsupervised internal attention statistics, they are fundamentally constrained by a reliance on static snapshots and attack-specific heuristics. Given the intricate interplay between dual modalities, the vast design space for multimodal triggers allows diverse threats, such as textual injections, sub-perceptual noises, and coordinated cross-modal triggers, to easily circumvent such rigid priors, particularly when attack types are unknown in real-world applications. In this paper, we rethink backdoor detection by shifting the diagnostic paradigm from static observations to dynamic output evolution. We observe that a successful attack inevitably hijacks the model’s decoding trajectory, skewing internal modal contributions during generation while maintaining an abnormal output invariance despite input perturbations. To capture this behavior, we propose EVO-Detect, a unified detection framework that monitors the dynamic evolution of internal signals during early decoding steps through two complementary channels: Attention Flow and Logits Flow. The attention branch measures how image-text attention allocation evolves during early generation, whereas the logits branch quantifies the sensitivity of the output distribution to modal perturbations through interventional ablations. We then convert these trajectories into compact sample-level metrics and normalize them against negative-control signatures so that natural perturbations are less likely to be mistaken for backdoor evidence. Extensive evaluations show that our approach substantially outperforms state-of-the-art baselines such as BYE and TCAP across diverse attack families.

[64] Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation cs.CV | cs.AIPDF

Yuheng Chen, Yufan Chen, Zhuojun Cai, Ruiping Liu, Junwei Zheng

TL;DR: Read-Parse-Describe统一评测文档页面的结构解析和视觉元素描述，要求同时输出布局、阅读顺序、识别文本及视觉替代文本，并提供可插拔的空间感知增强器。

Details

Motivation: 文档理解通常把版面分析、OCR、阅读顺序和图像描述分开评估，使科学图表、说明文字和视觉语义关联薄弱，也无法衡量模型能否生成结构准确且语义可访问的整页解析。

Result: RPD数据集包含2,402份文档、18,163页、125,218个版面元素和11,338个视觉实例。给定页面图像，系统需输出有序元素列表，包括边界框、语义标签、阅读顺序索引、识别文本及视觉元素替代描述。作者还提出可插拔空间感知增强器，复用多层视觉特征，并向视觉语言令牌注入网格感知空间指导，以生成版面感知解析。端到端视觉语言模型及流水线解析器实验显示，现有系统仍难以同时恢复阅读顺序和视觉语义；增强模型取得较强联合表现。

Insight: 将结构解析与视觉语义描述合并评估，更贴近复杂页面的整体理解，也暴露各独立组件之间的衔接缺口。摘要未给出具体分数、模型名单或增强前后的量化差异。

Abstract: Document understanding systems are typically evaluated as separate components via layout analysis, optical text recognition, reading-order prediction, and image captioning. This separation leaves scientific figures, captions, and visual semantics weakly connected, and fails to measure whether a model can produce a single page-level parse that is both structurally faithful and semantically accessible. We introduce Read-Parse-Describe, a unified dataset for document parsing with visual element description generation. Given a page image, models are required to output an ordered list of layout elements containing bounding boxes, semantic labels, reading-order indices, recognized textual content, and alternative text descriptions for visual elements. The benchmark is built from 2,402 documents, comprising 18,163 continuous pages, 125,218 layout elements, and 11,338 visual instances. Besides, we further propose a plug-and-play space-awareness enhancer that reuses multi-layer visual features and injects grid-aware spatial guidance into vision-language tokens for layout-aware generation. Experiments across end-to-end VLMs and pipeline parsers show that existing systems still struggle to jointly recover reading order and visual semantics, while our enhanced model achieves strong joint performance. These results highlight the need to move beyond isolated document parsing modules toward unified models that jointly read, parse, and describe complex documents. The new dataset and code will be made publicly available at https://github.com/yufanchen96/RPD

[65] InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views cs.CVPDF

Yongzhen Hu, Hao Yu, Jiawei Wang, Xianming Zeng, Jianyun Xu

TL;DR: InfiniSplat v2通过冻结几何分支、训练时真实相机位姿对齐和大视角差目标监督改进前馈3D高斯重建，在六个数据集及有位姿、无位姿设置下取得较低LPIPS和DISTS。

Details

Motivation: 前馈高斯重建可直接由输入图像生成场景供新视角渲染，但在视角变化较大时，如何根据预测几何学习高质量高斯属性仍具挑战。

Result: InfiniSplat v2将几何预测与属性预测解耦，冻结几何分支，训练期间利用真实相机位姿对齐预测高斯，并加入大角度目标视图监督。在六个数据集上，同一训练模型的前馈输出在有位姿和无位姿设置中均取得受测方法里最佳的平均LPIPS和DISTS。有位姿设置下，相较最强受测基线，平均LPIPS降低25.8%，DISTS降低32.9%。作者还发现，仅用图像重建监督学习到的不透明度会抑制几何不一致的点。

Insight: 将几何和外观属性分开学习，并以大视角监督约束渲染，可改善新视角合成；不透明度还可能隐式充当几何一致性过滤信号。报告的指标改进是在有位姿设定，摘要未给出无位姿设置的具体降幅及其它质量指标。

Abstract: Feed-forward Gaussian reconstruction builds 3D scenes directly from input images for novel view rendering, but learning Gaussian attributes from predicted geometry for high-quality rendering under large viewpoint changes remains challenging. We analyze limitations in Gaussian attribute learning and introduce InfiniSplat v2, which improves rendering quality through architectural and training changes. Our method decouples geometry and attribute prediction with a frozen geometry branch, aligns predicted Gaussians using ground-truth camera poses during training, and adopts large-angle target view supervision. Across six datasets, the feed-forward outputs of the same trained model achieve state-of-the-art mean LPIPS and DISTS among the evaluated methods in both pose-conditioned and pose-free settings. In the pose-conditioned setting, mean LPIPS and DISTS decrease by 25.8% and 32.9%, respectively, compared with the strongest evaluated baselines. We further find that opacity learned with only image reconstruction supervision suppresses geometrically inconsistent points. Project page: https://zju3dv.github.io/InfiniSplat2/

[66] ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions cs.CVPDF

Tianyi Gao, Han Fang, Xin Wei, Yaoyao Zhong, Zhaoyan Pan

TL;DR: ReferFlow把复杂指代表达理解扩展为逐步跟踪中间视觉指代的轨迹级任务，并以状态化区域潜变量、并行坐标解码和GRPO训练促进多步定位一致性。

Details

Motivation: 现有指代表达理解基准多只评测最终目标定位，忽略复杂查询中的中间视觉参照及其对先前定位的依赖，因此无法衡量模型是否能在连续步骤中保持稳定指代。

Result: ReferFlow-Bench按Refinement、Shift、Reset和Mixture四类结构化区域转移构造轨迹级任务，要求模型逐步定位单个复杂查询各步骤所指区域。作者提出ReferFlow：状态化区域潜在推理将每个目标区域表示为带对象索引的连续潜在状态，并以显式视觉和空间监督保留供后续定位使用的信息；轨迹感知并行解码根据各自轨迹前缀，通过四轮几何约束细化并行恢复坐标块，减少框内顺序依赖并去除框间自回归。Grounding-Aware GRPO则鼓励跨步骤定位一致，并学习根据复杂指代表达生成轨迹。摘要报告ReferFlow在通用指代理解基准和ReferFlow-Bench上均达到领先表现。

Insight: 中间指代的状态需跨步骤保留，坐标解码可并行化以减少不同区域之间的自回归依赖；评估过程也应覆盖区域转移而非只看最终框。摘要未提供基准规模、定量结果和具体比较模型，领先表现无法进一步量化。

Abstract: Multimodal Large Language Models have made significant progress in referring expression comprehension (REC), yet most REC benchmarks still focus on final-target localization. Complex queries often involve intermediate visual references with different dependencies on prior grounding, but final-only evaluation leaves this process unexamined. To address this gap, we formulate trajectory-level REC, in which models receive an ordered sequence of grounding steps constructed from a single complex query and localize the target regions associated with each step. We instantiate this setting in ReferFlow-Bench, which characterizes structured region transitions through four trajectory types, namely Refinement, Shift, Reset, and Mixture. Experiments show that current models struggle to consistently ground intermediate visual references across successive steps. We further propose ReferFlow, which decouples interleaved text-latent trajectory generation from coordinate decoding. Specifically, Stateful Region Latent Reasoning represents each target region as an object-indexed state composed of continuous latents, with explicit visual and spatial supervision to preserve region information for subsequent grounding. Trajectory-Aware Parallel Decoding then recovers all coordinate blocks in parallel through four geometry-constrained refinement rounds, with each block conditioned on its corresponding trajectory prefix, thereby reducing within-box sequential dependencies and eliminating cross-box autoregression. We further apply Grounding-Aware GRPO to promote consistent grounding across steps and learn adaptive trajectory generation from complex REC queries. ReferFlow achieves leading performance on general REC benchmarks and ReferFlow-Bench.

[67] STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents cs.CVPDF

Shuo Wang, Sifan Zhou, Xiaobo Wang, Tianyu Fu, Chenxu Zhao

TL;DR: STP-GUI在冻结视觉语言骨干上训练轻量选择器，以指令引导的重要性分数配合空间连贯窗口选择，避免激进裁剪时破坏小型GUI控件所需的局部结构。

Details

Motivation: 网页GUI智能体处理高分辨率截图和多轮历史会产生大量视觉令牌，推理开销较高；面向自然图像设计的独立令牌重要性裁剪，可能破坏按钮、图标和超链接等小控件的局部空间结构。

Result: STP-GUI以查询引导令牌评分保留细粒度指令相关性，同时采用空间连贯的窗口级选择；轻量选择器通过策略学习优化，视觉语言骨干保持冻结。在Online-Mind2Web上，保留21%令牌时达到全令牌性能的77.7%，推理延迟降低31%、FLOPs降低57%。Android in the Wild结果还显示该方法可迁移到移动GUI环境。

Insight: GUI令牌压缩需同时保留与指令相关的信息和局部空间结构，窗口级选择可减少零散裁剪对小控件的损害。摘要未给出完整任务成功率、移动端量化结果和选择器训练成本。

Abstract: With the rapid development of vision-language models (VLMs), Web-GUI agents have achieved promising performance in interacting with real-world interfaces through screenshot-based grounding. However, high-resolution screenshots and multi-turn histories introduce excessive visual tokens, causing substantial inference overhead. Existing token pruning methods, mainly designed for natural images, often select tokens independently based on importance scores, which can fragment the local visual structures required for recognizing small GUI elements such as buttons, icons, and hyperlinks. In this work, we propose STP-GUI (Spatially-aware Token Pruning for GUI agents), a query-guided token pruning framework that preserves fine-grained instruction-conditioned token scoring while performing spatially coherent window-level selection under aggressive token reduction. A lightweight selector is optimized through policy learning while the VLM backbone remains frozen. Experiments on Online-Mind2Web show that \papername achieves a favorable efficiency-performance tradeoff under low token budgets. At 21% token retention, it preserves 77.7% of full-token performance while reducing inference latency by 31% and FLOPs by 57%. Results on Android in the Wild further suggest that the method transfers to mobile GUI environments.

[68] OLiVES: An Outdoor Low-Light Video Benchmark for Enhancement and Segmentation cs.CVPDF

Yini Li, Joanne Lin, David Blackham, David Bull, Nantheera Anantrasirichai

TL;DR: OLiVES提供面向动态户外场景的低光照视频增强与视频目标分割联合基准，含超过2.5万对对齐明暗帧和4.6万余条分割标注。

Details

Motivation: 低光照视频研究受高质量真值数据稀缺限制；现有数据集常缺少运动和场景多样性、退化强度不足、依赖事件等辅助模态，或输入与真值未对齐，且往往只支持增强或场景理解其中一项。

Result: OLiVES针对动态户外场景，覆盖自然纹理、动物、遮挡、动态活动及近景等内容。作者称其据所知是首个使用专业电影级相机采集的户外低光照视频数据集。数据集包含超过25,000对明亮与低光照对齐帧，以及超过46,000条视频目标分割标注，同时支持低光照视频增强和VOS评测。对先进方法的基准实验显示，在该数据集上训练可提升这两项任务的表现。

Insight: 将对齐的增强真值与分割标注放在同一动态户外视频基准中，支持联合研究图像恢复与场景理解。摘要未给数据集视频数量、场景划分、方法具体得分及提升幅度；“首个”是作者基于其所知的声明。

Abstract: Low-light video processing remains an underexplored problem in computer vision, primarily due to the scarcity of high-quality ground-truth data. Existing public datasets exhibit several limitations, including restricted motion diversity, limited scene coverage, weak degradations, reliance on auxiliary modalities such as event data, and misalignment between low-light inputs and ground truth. Furthermore, current datasets typically address either low-light enhancement or scene understanding, whereas these tasks should be considered jointly. We introduce \textbf{OLiVES}, a benchmark dataset for outdoor low-light videos with dynamic scenes, designed to support both low-light video enhancement (LLVE) and video object segmentation (VOS). The dataset addresses key content gaps by incorporating a diverse range of natural textures, animals, occlusions, dynamic activities, and close-up scenes. To the best of our knowledge, OLiVES is the first outdoor low-light video dataset captured using professional cinema-grade cameras. It provides over 25,000 aligned normal- and low-light frame pairs, along with over 46,000 VOS annotations. We benchmark state-of-the-art LLVE and VOS methods on OLiVES and show that training on it improves performance on both tasks. The OLiVES project page is available at: https://anonymous-OLiVES.github.io/.

[69] Reliability-Aware Multimodal Sentiment Prediction Under Local Modality Missingness cs.CVPDF

Minghao Kong, Deng Yao, Xi Zhang, Ying Gao, Jiurun Chen

TL;DR: RM-Net针对文本、音频或视频中连续片段局部缺失的多模态情感预测，保留原始时间位置并按观测质量门控模态贡献；融合模型在40%混合缺失下宏平均F1为0.634。

Details

Motivation: 多模态情感模型通常在完整话语上评估，但实际流中可能连续丢失一段文本、音频或视频，因此需要研究局部缺失时的可靠性，而非仅测试整种模态完全有无。

Result: 作者在对齐的CMU-MOSEI特征上评估局部缺失。RM-Net保留原始时间位置，用学习得到的令牌表示未观测位置，输出有界的模态强度贡献并按观测质量门控，训练时对连续片段施加双视图遮罩。最终融合五个RM-Net种子与LoRA适配的BERT文本专家，融合权重只依赖可见内容令牌比例；架构、检查点和融合方案均在验证集选择。留出划分上，融合模型干净输入宏F1为0.655，40%混合缺失时为0.634；双视图平均较辅助头基线高0.024，视频聚类bootstrap 95%区间为[0.003, 0.045]。作者指出该划分在开发阶段已被查看，因此不是盲测。解释性分析中，验证集八种模态子集的精确Shapley归因和位置遮挡表明，排名靠前位置比随机位置更快降低预测类别概率，AUC差为0.113。原始片段的词级对齐流程用于审计，不输入预测模型。

Insight: 局部连续缺失需要保留时间位置并显式表达未知片段，融合模块也应依赖实际可见内容；论文明确披露所谓留出划分已参与开发，数字不能视作盲测结果。词级对齐只支持审计而非预测，避免把解释流程误认为模型输入。

Abstract: Multimodal sentiment models are usually evaluated on complete utterances, yet streams often lose a contiguous span of text, audio, or video. We study local missingness on aligned CMU-MOSEI features. Our reliability-aware network (RM-Net) keeps the original temporal positions, represents unobserved positions with a learned token, outputs bounded per-modality intensity contributions gated by observation quality, and is trained with dual-view masking of contiguous segments. We fuse five RM-Net seeds with a LoRA-adapted BERT text expert, using a fusion weight that depends only on the visible fraction of content tokens. Architecture, checkpoint, and fusion choices were made on the validation split. On the held-out split, the fused model reaches a macro-F1 of 0.655 on clean inputs and 0.634 under 40% mixed missingness; its two-view average exceeds the auxiliary-head baseline by 0.024 (95% video-cluster bootstrap interval [0.003, 0.045]). Because this split was inspected during development, these numbers are not a blind test. For explanations, exact Shapley attributions over the eight modality subsets and position-level occlusion show that top-ranked positions reduce the predicted-class probability faster than random positions (AUC gap 0.113 on validation). We also describe an auditable word-level alignment pipeline for raw clips; its outputs do not feed the predictive models.

[70] Speculative Sampling in Interactive Video Generation cs.CV | cs.HCPDF

Yubo Huang, Yuxuan Zhang, Jiaming Liu, Sirui Zhao, Enhong Chen

TL;DR: 该交互式视频生成策略用噪声潜变量扩展双向建模窗口、缓存条件未变时的预测并增量交付已确定部分，从而兼顾大窗口质量和小块交互的低延迟。

Details

Motivation: 交互式视频生成常用较小双向块降低响应延迟，但初步实验显示较大块能提升质量并更好利用GPU并行性，只会适度增加采样时间；块边界还会造成必须等待当前块生成完的延迟下限。

Result: Speculative Sampling在建模窗口末尾追加噪声潜变量作为填充，扩大双向模型的窗口，并缓存预测以便条件保持不变时复用。结果逐步交付，而尚未提交的未来内容仍可替换。作者的延迟分析表明，该策略移除了由块边界强加的等待时间下限，使优化重点从缩小块尺寸转向加速单块采样。因此，双向窗口大小成为可联合优化画面质量与采样时间的变量，而不再是低延迟交互的固定约束。

Insight: 通过先行计算并缓存可复用预测，可以让大双向模型服务于流式交互，同时维持未提交未来内容的可修改性。摘要只报告机制和延迟分析，没有提供生成质量指标、延迟数值或实测端到端吞吐。

Abstract: Interactive video generation commonly relies on small bidirectional chunks to reduce response latency. Yet our preliminary experiments show that larger chunks improve video quality and better utilize GPU parallelism, allowing more latents to be sampled with only a modest increase in sampling time. Motivated by these observations, we propose Speculative Sampling, a strategy that combines the modeling power of large bidirectional windows with the low-latency interaction of small ones. It expands the modeling window by appending noise latents as padding and caches the resulting predictions for reuse when the condition remains unchanged. Predictions are delivered incrementally, while the uncommitted future remains replaceable. Our latency analysis shows that this removes the waiting-time lower bound imposed by chunk boundaries, shifting the optimization focus from reducing chunk size to accelerating per-chunk sampling. Bidirectional window size thus becomes a decision variable for jointly optimizing visual quality and sampling time, rather than a necessary constraint on low-latency interaction. This opens a path to serving large bidirectional models in interactive streaming systems without complex streaming post-training.

[71] Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation cs.CVPDF

Weijie Wang, Haomin Zhang, Ye Li, Akide Liu, Zeyu Zhang

TL;DR: ATAS将剧本编译为带地点、相机和事件时间引用的镜头请求，在生成前检索静态场景记忆与动态事件记忆，生成后审核并注册片段，以维持非连续镜头间的时空一致性。

Details

Motivation: 长篇智能体视频生成需把剧本拆成不连续镜头并保持空间、时间连续；仅在镜头间传递提示词或近期帧，缺乏可复用的共同空间坐标系，也无法按时间重现早先事件。

Result: ATAS在生成前从场景记忆检索已登记的静态几何，从事件记忆检索按场景、事件和时间索引的动态观察证据；生成后重建并注册片段，只有经审核和状态检查接受的观察才写入记忆，而影片交付独立于记忆准入。四种视频生成器上的实验中，ATAS提升所有报告的跨镜头一致性指标，并在每种骨干上取得最高的基准总分；在目标图像空间重访上优于比较智能体和3D引导方法，在三个事件重现指标上领先，且六项人评标准全部最高。

Insight: 静态几何和动态事件需要分别按地点及时间索引，且生成结果需通过核验后才进入记忆，才能支撑跨镜头重访和事件重现。摘要未给出一致性指标、人评人数或分数差异，所有最优结论仅覆盖四种生成器和指定比较方法。

Abstract: Long-form agentic video generation must turn a screenplay into shots that remain spatially and temporally consistent across nonconsecutive requests. Passing prompts or recent frames between shots does not provide a shared spatial frame for revisiting a scene or a time-indexed record for replaying an earlier event. We present Any Time, Any Space (ATAS), which compiles a screenplay into shot requests with explicit location, camera, and event-time references. Before generation, it retrieves relevant evidence from a scene memory of registered static geometry and an event memory of dynamic observations indexed by scene, event, and time. After generation, ATAS reconstructs and registers the clip. It updates memory only when review and state checks accept the observation, while film delivery remains independent of memory admission. Across four video generators, ATAS improves all reported cross-shot consistency measures and achieves the highest aggregate benchmark score for each backbone. It also outperforms the compared agents and 3D-guided methods on target-image spatial revisit, leads three event-recapture criteria, and receives the highest human ratings on all six criteria. The video results and code are available on our project page: https://lhmd.top/atas/.

[72] GeoThinker-$F$: Endogenous Predictive World Representations for Fast Spatial Intelligence cs.CVPDF

Haoyuan Li, Qihang Cao, Huanyuan Zhou, Xin Hu, Sijia Chen

TL;DR: GeoThinker-F将因果视觉语言模型隐藏状态转为预测式潜在世界表征，训练后移除外部3D编码器，在保留空间推理表现的同时将推理延迟从1.45秒降至0.40秒，最高加速3.6倍。

Details

Motivation: 几何增强多模态模型常需在推理时调用额外3D编码器提供结构先验，导致延迟和计算开销增加；作者认为中间语义表征可预测当前几何和未来语义，而不必精确复现专用编码器特征。

Result: GeoThinker-F采用两阶段训练。第一阶段冻结多模态骨干，使用离线3D几何专家和下一帧语义目标训练轻量潜在帧预测头；第二阶段移除外部专家，联合优化模型生成并选择性整合自身预测先验的空间落地时序融合模块。多种空间智能基准实验显示，推理阶段不再依赖外部3D几何编码器，同时保持有竞争力的性能；延迟由1.45秒降至0.40秒，最高加速3.6倍。

Insight: 蒸馏预测式几何和时序语义先验可把外部编码器知识内化到因果模型，避免部署时重复计算。摘要未列出具体空间基准和各项准确率，也未说明时延测量硬件及批量设置。

Abstract: Existing geometry-aware Multimodal Large Language Models (MLLMs) increasingly rely on external 3D encoders to provide structural priors, but executing these additional encoder paths at inference introduces substantial latency and computational overhead. We propose GeoThinker-$F$, an efficient framework that internalizes spatiotemporal perception by transforming causal MLLM hidden states into predictive latent world representations. Our key insight is that intermediate semantic representations contain sufficient information to predict useful representations of current geometry and future semantics, without requiring an exact reproduction of features from a dedicated 3D encoder. To realize this idea, GeoThinker-$F$ adopts a decoupled two-stage training strategy. In the first stage, the MLLM backbone is frozen while lightweight Latent Frame Prediction (LFP) heads learn from an offline 3D geometry expert and next-frame semantic targets. In the second stage, the external expert is removed, and the model is jointly optimized to generate and selectively integrate its self-predicted priors through a specialized Spatial-Grounded Temporal (SGT) Fusion module. Extensive evaluations show that GeoThinker-$F$ eliminates runtime dependence on external 3D geometry encoders while maintaining competitive performance across diverse spatial intelligence benchmarks. It achieves up to a $3.6\times$ inference speedup, reducing latency from $1.45,\mathrm{s}$ to $0.40,\mathrm{s}$ while retaining strong spatial reasoning performance.

[73] Player-1: Learning to Play from Synthetic Experience cs.CV | cs.AI | cs.HCPDF

Mingyu Ouyang, Yiran Wang, Siyuan Hu, Xingyilang Yin, Huiqiang Sun

TL;DR: Player-1以合成交互经验扩展电脑操作模型的游戏控制能力，结合6,044条示范轨迹、16个合成环境和PPO训练，在MineDojo等游戏基准上超过监督微调策略。

Details

Motivation: 电脑使用智能体已能理解屏幕并执行鼠标键盘操作，但游戏包含丰富视觉世界和多样机制，仍是通用数字控制的难题；现有训练依赖大规模但动态状态覆盖有限的演示数据，可扩展交互环境也难获得。

Result: Player-1扩展动作空间，支持相对指针移动、持续输入和复合动作；监督初始化使用6,044条带任务指令和视觉推理的精选游戏轨迹。作者构建Player-1-Gym，包含16个围绕跨游戏控制需求设计的合成2D/3D环境，并用可程序验证奖励、随机观测及随机控制动力学支持多环境PPO训练。Player-1-9B和Player-1-35B-A3B在MineDojo-300上的成功率分别较各自SFT策略提高27.8和17.7个百分点；Player-1-9B成功率为38.33%，而最强受测基线为12.63%。在ViZDoom-10和GameWorld上也较SFT有进一步提升。更广的合成环境覆盖改善迁移，RL期间复合动作使用增加。

Insight: 合成环境中可验证奖励和多样化控制动力学可提供示范之外的交互学习信号，并能迁移到RL训练集之外的游戏。成功率提升是相对对应SFT或受测基线，摘要未给所有游戏上的绝对成绩和训练计算成本。

Abstract: Computer-use agents have demonstrated strong capabilities in interpreting screens and executing keyboard and mouse actions. However, games, with their visually rich worlds and diverse mechanics, remain challenging and offer a demanding next step toward general digital control. Current game-agent learning pipelines often rely on large-scale demonstrations with limited coverage of dynamic game states, while scalable environments for interactive training remain difficult to obtain. We introduce Player-1, a post-training framework for learning game control beyond demonstrations through synthetic experience. We extend the computer-use action space with relative pointer motion, sustained inputs, and composite actions. For supervised initialization, we fine-tune computer-use models on 6,044 curated gameplay trajectories that pair recorded actions with task instructions and visual reasoning. We construct Player-1-Gym, sixteen synthetic 2D and 3D environments designed around control demands shared across games. Programmatically verifiable rewards and randomized observations and control dynamics support multi-environment reinforcement learning with PPO. The resulting Player-1-9B and Player-1-35B-A3B improve MineDojo-300 success over their SFT policies by 27.8 and 17.7 percentage points, respectively. Player-1-9B reaches 38.33% success compared with 12.63% for the strongest evaluated baseline, with further gains over SFT on ViZDoom-10 and GameWorld. Further analyses show that broader synthetic environment coverage improves transfer, while the use of composite actions that combine multiple keyboard and mouse inputs increases during RL. We demonstrate that learning from synthetic experience substantially improves game control beyond supervised initialization, with gains that generalize beyond the RL training suite.

[74] DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning cs.CVPDF

Qihang Cao, Haoyuan Li, Zihan Guo, Sensen Gao, Zihui Gao

TL;DR: DynThinker通过分组指数移动平均约束敏感参数漂移，并以语义引导融合动态几何先验，联合增强静态3D和动态4D空间推理。

Details

Motivation: 现有模型难以同时做好静态三维和动态四维推理：3D后训练可能削弱动态理解，而专攻4D的模型常缺少强静态推理能力。分析发现这种干扰在参数组间不均匀，尤其晚层MLP对静态—动态能力平衡敏感。

Result: DynThinker以解耦指数移动平均（D-EMA）对干扰敏感的预训练参数实施可配置分组平均，限制漂移同时保留能力增强空间；空间—动态融合（SDF）则在语义引导下，将动态几何编码器的空间和时间先验选择性注入视觉语言中间表征。覆盖九个静态3D和动态4D基准的十项指标上，该方法在所有受测模型中平均分最高。开源模型比较中，ReVSI得分56.0、DSR-Bench为67.2，DSI-Bench在样本级和组级协议下分别为51.2和40.1，四项均达所比较开源模型中的新最佳。

Insight: 静态与动态空间能力的干扰可能集中于部分参数组，采用组别敏感的权重平均并选择性融合动态先验，有望避免一种能力提升以牺牲另一种为代价。摘要未给出各基准基线分数、指标汇总方式和闭源模型比较细节。

Abstract: Achieving general spatial intelligence requires a unified understanding of both static 3D and dynamic 4D. However, we find that existing models struggle to excel at both: 3D post-training can weaken dynamic understanding, while 4D-specialized models often lack strong static 3D reasoning. Our analysis reveals that this spatial–dynamic interference is highly non-uniform across parameter groups, with the balance between static and dynamic capabilities particularly sensitive to changes in late-layer MLPs. To address this interference, we propose DynThinker, a unified framework for jointly strengthening static and dynamic spatial reasoning. Decoupled Exponential Moving Average (D-EMA) applies configurable group-wise averaging to constrain drift in interference-sensitive pretrained parameters while preserving flexibility for capability enhancement. Spatial-Dynamic Fusion (SDF) complements D-EMA by selectively integrating spatial and temporal priors from a dynamic geometry encoder into intermediate VLM representations under semantic guidance. Across ten metrics spanning nine static 3D and dynamic 4D benchmarks, DynThinker achieves the highest average score among all evaluated models. Notably, DynThinker achieves 56.0 on ReVSI, 67.2 on DSR-Bench, and 51.2 and 40.1 under the sample-wise and group-wise evaluation protocols of DSI-Bench, respectively, setting new state-of-the-art results among the compared open-source models across all four evaluations within a unified model.

[75] CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image Generation cs.CVPDF

Xiaoli Xu, Zhengtao Wu, Zhengze Xu, Tao Liu, Yongchao Du

TL;DR: CommerceGen-Studio把商品元数据提炼、语义改写和多条件生成组成电商主图生产流程，报告已在日均数百万张、单图数秒的规模运行，并在自建基准上改善发布相关属性。

Details

Motivation: 电商SKU主图要求在编辑或合成时同时保持商品主体、商标及文字准确，并理解商品元数据和用户指令；工作旨在构建面向商业规模的端到端生成系统。

Result: 系统分三阶段：PERL-Agent通过视觉语言模型与语言模型的闭环协作，将异构SKU元数据提炼成简洁卖点列表；Layout Thinker Optimization以交替领域策略优化对齐说明文本和渲染图质量；SKU-DiT在RDR渐进训练下联合条件于白底商品图、商标裁剪图和结构化布局，以维持主体保真、商标完整及字符级文字准确。作者报告系统投入生产，每天生成数百万张主图，单图延迟数秒；并发布来自真实流量、覆盖所有商品类目的难例基准CommerceGen-Bench。该基准上，系统在有无提示增强的两个编辑赛道都超过所测开源基线，整体上匹配更大型闭源模型，并在指令跟随和商品整合两项可发布性关键指标上超过若干闭源模型。

Insight: 商业级主图生成需要把元数据理解、布局规划、主体/品牌条件生成和质量检查作为整套流程处理。摘要没有提供基准规模、逐项分数、线上质量审核方法或生产系统对比，作者关于同类首批系统的表述是其自述。

Abstract: We present CommerceGen-Studio, an end-to-end framework for generating commercial-grade main images for e-commerce Stock Keeping Units (SKUs). Our framework is organized along a three-stage pipeline of information extraction, semantic rewriting, and multi-condition generation: Prompt-Eval-Refine-Loop Agent (PERL-Agent) distills heterogeneous SKU metadata into concise selling-point text lists through an iterative closed loop of VLM and LLM roles scored by a reference-free rubric. Layout Thinker Optimization (LTO) aligns the rewriter with both caption and rendered-image quality via alternating domain-specific policy optimization. SKU-DiT, trained under Reinforce-Distill-Reinforce (RDR) progressive training, conditions jointly on the white-background product image, the trademark crop, and the structured layout to hold subject fidelity, trademark integrity, and character-level text accuracy together. The framework runs in production at a scale of millions of main images per day with a latency of a few seconds per image, which we believe makes it among the first systems of this kind to operate at commercial scale. We also release CommerceGen-Bench, a benchmark of hard cases collected from live traffic across all product categories. On it, our framework achieves the highest overall scores among the evaluated open-source baselines on both editing tracks, with and without prompt enhancement. It also matches much larger closed-source models, and beats several of them at Instruction Following and Product Integration - the two properties that determine whether an image can be published.

[76] VITAL: From Visual Motion to Precise Action cs.CVPDF

Ao Liang, Youquan Liu, Mingxiao Li, Wei Chow, Lingdong Kong

TL;DR: VITAL将视觉运动骨架与轨迹残差联合编码为动作令牌，使驾驶动作专家以当前图像、车辆状态和导航指令预测视觉运动及细粒度度量修正，并用单步去噪获得接近十步的NAVSIM得分。

Details

Motivation: 世界—动作模型通常用独立于视觉动力学定义的轨迹表征训练动作专家；直接从未来图像重建轨迹虽捕获主要驾驶动作，仍留下厘米级误差，因此需要让动作目标直接来源于视觉运动并保留精细修正。

Result: VITAL的动作分词器将视觉派生运动骨架与紧凑残差结合，残差编码骨架尚未解释的轨迹误差，并采用单独归一化尺度。基于流匹配的动作专家从当前图像、自车状态和导航命令联合预测两部分，推理时无需生成未来图像。相同残差坐标还支持有界强化学习后训练，在保持预测视觉骨架固定时细化执行。仅用一步动作去噪，在NAVSIM v1 navtest达到90.8 PDMS，与十步得分仅差0.13点，端到端推理速度提高3.29倍；无需重训练，在NAVSIM v2 navtest达到91.1 EPDMS、navhard达到38.6。

Insight: 把视觉运动作为主要动作预测目标、把度量修正单独编码，可兼顾语义级轨迹结构和厘米级细节，并适配单步执行。结果限定于指定NAVSIM版本和指标，摘要未报告完整轨迹重建误差或真实道路部署验证。

Abstract: World-action models aim to turn visual anticipation into driving decisions, yet typically train action experts on trajectory representations defined independently of visual dynamics. This motivates deriving action targets directly from visual motion. We first examine a simpler setting in which trajectories are reconstructed from recorded future images. Even without the need for future prediction, reconstruction captures the dominant maneuver but leaves centimeter-scale errors. We therefore introduce VITAL (Vision-Induced Tokens for Action Learning), an action tokenizer that couples a visually derived motion scaffold with a compact residual encoding the trajectory error left by that scaffold. This representation makes visual motion the principal prediction target and gives small metric corrections a separate, normalized learning scale. Using flow matching, the action expert jointly predicts both components from the current image, ego state, and navigation command, without generating future images at inference. The same residual coordinates support bounded reinforcement post-training that refines execution while keeping the predicted visual scaffold fixed. With only one action denoising step, VITAL achieves 90.8 PDMS on NAVSIM v1 navtest, within 0.13 points of its ten-step score at 3.29x the end-to-end inference speed. Without retraining, it achieves 91.1 EPDMS on NAVSIM v2 navtest and 38.6 on navhard. Project page: https://worldbench.github.io/vital

[77] Representation Conditioning for Generation cs.CVPDF

Saeed Razavi, Xingjian Leng, Liang Zheng

TL;DR: RECON在扩散Transformer训练时向后层输入预训练视觉编码器令牌，推理时用训练后保留的MLP投影头提供替代条件，无需增加参数并加快收敛。

Details

Motivation: REPA等表征对齐方法用预训练视觉编码器监督扩散模型中间层并在训练后丢弃投影头，虽可在早层导入语义，但仅由速度预测损失监督的后层未必能充分访问这些语义。

Result: 表征条件化（RECON）训练时将预训练视觉编码器令牌馈入扩散模型后层；推理时因没有干净目标图像，则复用MLP头作为视觉编码器代理，将其投影令牌送入后层。作者报告该方法不增加参数，并显著加快收敛：相较SiT快63倍，相较REPA快25倍。

Insight: 若只在早期层进行表征对齐，语义监督可能难以传到后续层；在训练和推理中都对后层提供表征条件，意在使语义信息持续可用。摘要未提供任务、数据集、训练预算、质量指标及倍速测量细节，不能判断不同设置下收益是否一致。

Abstract: Representation-alignment methods effectively accelerate the diffusion transformer training. REPA, for example, uses a pretrained vision encoder to supervise an intermediate layer through an MLP projection head which is discarded after training. It aims to import semantics from the vision encoder to the diffusion backbone. While this objective is achieved at early layers by back-propagating the alignment loss, there is no guarantee that later layers, supervised by the velocity prediction loss alone, can well access such semantics. We propose a simple solution, representation conditioning (RECON), to improve semantics in later layers. During training, we feed the pretrained vision encoder tokens into later layers; during inference, because we no longer have the clean image, we reuse the MLP head (as a proxy to the vision encoder) and project its output tokens to the later layers. Our method adds no parameters and leads to much faster convergence: RECON is $63\times$ faster than SiT and $25\times$ faster than REPA. Code is available at https://github.com/saeidrazavi/RECON

[78] Can Learning to Answer Spatial Questions Improve Novel-View Generation? cs.CVPDF

Jahyeok Koo, Hyeonseo Yu, Seungho Jang, Jaewoo Jung, Jiwon Kang

TL;DR: Ask4NV研究3D语言理解能否为新视角生成提供互补监督，通过在统一多模态模型中注入相机几何并联合生成和理解表征，提升视角一致性。

Details

Motivation: 从稀疏观测生成新视角需同时保持外观与空间结构；现有方法虽利用细粒度几何线索，却较少显式建模物体身份、属性及物体间关系等高层语义和空间属性。

Result: Ask4NV基于预训练统一多模态混合Transformer模型，同时将相机几何纳入VAE和ViT表征，并以带模态感知注意力掩码的联合自注意力在生成过程中利用理解特征。实验显示模型在新视角生成中具有较强图像质量和几何一致性，同时3D语言理解表现有竞争力。进一步分析发现，联合训练改善VAE表征的跨视角对应关系，并提高3D感知特征空间中的相似性。

Insight: 显式相机几何和3D语义理解可作为互补监督，可能使生成表征在跨视角间更一致。摘要未给出具体数据集、指标、模型大小及相对基线分数，结论为定性描述。

Abstract: Generating novel views from limited observations requires preserving both the appearance and spatial structure of a scene. Although recent approaches exploit fine-grained geometric cues, they do not explicitly model high-level semantic and spatial properties such as object identity, attributes, and inter-object relationships. In this work, we investigate whether 3D language understanding can provide complementary supervision for novel-view generation. We introduce Ask4NV, built on a pretrained unified multimodal model with a Mixture-of-Transformers (MoT) architecture. Our model incorporates camera geometry into both VAE and ViT representations and leverages understanding features during generation through joint self-attention with a modality-aware attention masking strategy. Experiments demonstrate strong image quality and geometric consistency in novel-view generation, alongside competitive 3D language understanding. Further analysis shows that joint training improves cross-view correspondence in VAE representations and similarity in a 3D-aware feature space.

cs.CL [Back]

[79] Following the Flow the Law Requires: Training Voice Agents to Transfer to Unseen Regulated Procedures in Debt Collection cs.CL | cs.AI | cs.LGPDF

Petmongkon Pornpichitsuwan, Krittin Pachtrachai, Touchapon Kraisingkorn

TL;DR: 该研究用 FlowSpec 将受监管债务催收程序编译成语音代理指令、工具门控、监督和测试，训练一次后评估对未见流程的遵循能力。

Details

Motivation: 受监管语音代理不仅要完成通话，还必须按法律要求遵循对话顺序，例如先确认债务人身份再提债务、说明自身和债权人、金额并避开禁语；不同债权人流程各异且会更新。

Result: 研究用 2,506 段对话覆盖 297 个随机流程训练 9B 模型，并测试泰语外呼代理对 4 个未见部署流程的迁移，其中三个为催收流程，一个非催收流程，且一个来自完全留出的流程谱系。由流程固定的文档检查通过率从 67%–71% 提至 93%–100%；由具体对话固定的 grounding 检查训练前已为 97%–100%。场景通过率从 15/43 提至 40/43。对共享 FlowSpec 的审计发现 11 个缺陷，其中 3 个未被其自身指标揭示。

Insight: 机器可读程序规范将流程要求同时传递到提示、工具权限和评测中，有助于跨未见程序迁移；但自身规范审计仍发现指标无法捕捉的缺陷。结果来自泰语代理及少量四个部署流程，摘要不应被解读为普遍法律合规保证。

Abstract: Voice agents built on large language models (LLMs) now handle customer calls, but in regulated applications completing the task is not enough: the agent must follow a conversational flow set by law. In debt collection, it must confirm it is speaking to the debtor before mentioning the debt, identify itself and the creditor, state the amount, and avoid prohibited language. Every creditor turns these rules into its own procedure and revises it. We ask whether a small, self-hosted policy can be trained once and then follow regulated procedures it has never seen. One machine-readable specification per deployment, FlowSpec, generates the policy instruction, gates the tools, supplies the supervision and defines the tests; the agent speaks only approved catalogue sentences. We fine-tune a 9-billion-parameter model on 2,506 conversations from 297 randomized procedures and evaluate a Thai outbound-call agent on four unseen deployment procedures (three debt collection, one non-debt), one from a wholly withheld lineage. Documented checks, fixed by the procedure, rise from 67–71 percents to 93–100 percents, while grounded checks, fixed by the conversation, already pass at 97–100 percents before training; scenario pass rate rises from 15/43 to 40/43. An audit of the shared specification finds 11 defects, 3 of which its own metric did not expose.

[80] Joint Subspace Sparse Attention for Efficient Long-Context Decoding cs.CLPDF

Jiwon Song, Yoongon Kim, Jae-Joon Kim

TL;DR: JSSA 学习共享低维 query-key 子空间保持 token 排序，再用免 gather 的 indexed-attention 内核执行每个 KV 头独立选择，实现长上下文细粒度稀疏解码。

Details

Motivation: 稀疏注意力可减少长上下文解码中 KV-cache 流量，但粗粒度方法控制有限；token 级选择既可能因低维打分丢失 query-key 结构，也可能因 gather 分散访问抵消延迟收益。

Result: JSSA 以 token 分数保持误差学习共享低维 Q-K 子空间，并将非凸目标上界为可闭式谱解的边际目标；在测试设置中直接优化精确目标没有可测增益。免 gather 内核适配标准 GQA KV-cache 布局，支持每个 KV 头不同 token 选择。在标准 GQA、混合滑窗/全局注意力及 MLA 模型上，解码准确率接近 full-KV，避免基线的生成长度膨胀和架构相关失败。NVIDIA B200 上，128K 上下文解码吞吐最高为 full-KV 的 6.43 倍；推理准确率与模型原生 DSA 相当、不需训练，并在 700B 规模达到其吞吐的 96%–99%。

Insight: 压缩选择质量和内存访问效率需联合设计；即使选对 token，散乱 gather 也会抵消稀疏收益。6.43 倍为 B200、128K 的最高吞吐比，结果对不同注意力架构进行了覆盖，但摘要未给各架构具体精度/吞吐折衷。

Abstract: Sparse attention reduces the KV-cache traffic that dominates long-context LLM decoding, but practical methods largely operate at coarse granularity. Token-level selection offers finer control, yet presents two challenges: low-dimensional scoring may lose query–key structure needed for accurate ranking, while gathering scattered selected tokens can offset the resulting latency benefit. We introduce Joint Subspace Sparse Attention (JSSA) to address both challenges. For selection quality, JSSA learns a shared low-dimensional query–key subspace by minimizing token-score preservation error. We upper-bound the resulting non-convex objective with a tractable marginal objective that admits a closed-form spectral solution; direct refinement of the exact objective provides no measurable improvement in the tested settings. For execution efficiency, we develop a gather-free token-level indexed-attention kernel that supports distinct per-KV-head selections under the standard grouped-query attention (GQA) KV-cache layout. Across standard GQA, hybrid sliding-window/global attention, and Multi-head Latent Attention (MLA) models, JSSA consistently remains close to full-KV accuracy while avoiding the substantial generation-length inflation and architecture-dependent failures observed with competing methods. On an NVIDIA B200 GPU, JSSA achieves up to $6.43\times$ the decoding throughput of full-KV attention at 128K context. JSSA achieves reasoning accuracy comparable to model-native DSA without model training and reaches 96–99% of its decoding throughput even at 700B scale large models.

[81] DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision cs.CLPDF

Yifan Lan, Zhongye Liu, Yurui Chang, Hanyu Wang, Yongkang Du

TL;DR: DecisionRobust 系统评测 JEV 类决策模型对文本/图像扰动和提示注入的鲁棒性，并用标签一致性检查区分真实攻击成功与评测误判。

Details

Motivation: 带类型接口的决策模型逐渐用于自动化选择、判断和打分，其面对保持语义的输入扰动及跨模态提示注入的可靠性需要评估。

Result: 基准覆盖实际决策情境，攻击包括语义保持文本扰动、图像扰动及文本/图像提示注入。通过外部效度检查和跨模型候选选择构建评测集；评估文本端 30 个模型配置、视觉端 17 个，其中分别有 24 和 12 个留出模型未参与候选选择。实验发现攻击能迁移到构造/选择之外的模型，但优化图像扰动对许多目标迁移较弱；模型相对鲁棒性随任务和攻击变化，抵抗输入扰动不代表抵抗提示注入；标签一致性检查可显著降低文本和图像攻击的测得成功率。

Insight: 鲁棒性不能用单一攻击或模型排名概括，提示注入与输入扰动是不同威胁；标签一致性核验也会改变攻击成功结论。摘要未提供各模型 ASR 数值和具体任务分布，图像扰动跨模型迁移弱是重要限制。

Abstract: Emerging decision models such as JEV provide typed interfaces that map task instructions and observations directly to choices, judgments, and scores. As these models are increasingly used for automated decision-making, understanding their reliability under adversarial manipulation becomes critical. We introduce DecisionRobust, a benchmark for systematically evaluating the robustness of decision models across textual and visual inputs. Our benchmark covers practical decision-making scenarios and a diverse suite of attacks, including semantics-preserving text perturbations, image perturbations, and prompt injection in both modalities. We curate evaluation sets through external validity checks and cross-model candidate selection. We evaluate 30 model configurations on text tasks and 17 on vision tasks, including 24 and 12 held-out models, respectively, that are excluded from candidate selection. Our experiments reveal several key findings. First, attacks expose vulnerabilities beyond the models used for construction and selection, although optimized image perturbations transfer weakly to many targets even with multiple surrogates. Second, relative model robustness varies across tasks and attack types, and resistance to input perturbations does not necessarily imply resistance to prompt injection. Third, label-consistency checks substantially reduce measured attack success across text and image settings, highlighting the importance of validating apparent failures. The benchmark is available at https://yifan-lan.github.io/DecisionRobust/.

Mingyu Lu, Timothy Ossowski, Tristan Naumann, Hoifung Poon, Peniel Argaw

TL;DR: HERO 将执行验证过的成功/失败用于离线提示改进，并在测试时把生成代码本身作为实例级 harness，根据执行反馈进一步修订。

Details

Motivation: 通用 harness 优化会改进可复用提示和脚手架，但反思器提出的更新虽能修复已见失败，也可能破坏原先正确行为；代码生成提供可执行验证反馈，可在采纳前直接检查修订效果。

Result: 离线阶段从执行验证的成功与失败学习提示更新，对候选变更进行验证后再采纳；测试时针对当前生成代码利用执行反馈做实例特定改进。在 SQL、Cypher、Python 四个基准上，HERO 的离线表现最佳，pass@1 比初始提示高 7.6 点；测试时修订再提高 2.0 点并改善执行效率。摘要未给基准名称及效率指标数值。

Insight: 程序可执行性使 harness 更新能经过实际运行验证，而非只依赖 LLM 对失败的解释；离线可复用提示与在线实例修复形成互补。增益为多基准报告，摘要未说明测试时修订的运行次数和额外延迟。

Abstract: Harness optimization improves LLMs by refining reusable prompts and scaffolding, yet requires further adaptation for program generation tasks such as text-to-SQL and text-to-Python. Existing methods often rely on LLM reflectors to propose harness updates, which can fix observed failures but also disrupt previously correct behavior. Text-to-code tasks offer a natural way to mitigate this issue: we can execute generated outputs, allowing us to evaluate and verify the effects of proposed updates directly. Building on this signal, we introduce \textsc{HERO} (\textbf{H}arnessing \textbf{E}vidence for \textbf{R}efinement and \textbf{O}ptimization), which combines offline and test-time harness optimization. At the first stage, \method{} learns reusable prompt updates from execution-verified successes and failures and validates candidate revisions before adoption. At test time, we treat the generated code as an instance-specific harness and refine it using execution feedback. Across four SQL, Cypher, and Python benchmarks, \method{} achieves the best offline performance, improving pass@1 by (7.6) points over the initial prompt, while test-time refinement adds another (2.0) points and improves execution efficiency.

[83] Can LLM Agents Efficiently Identify Appliance Faults? Insights From Diagnosing a Simulated Appliance cs.CLPDF

Lucas H. McCabe, Sarah Lukens, H. Howie Huang

TL;DR: CoffeeBench 用模拟家电故障诊断任务评估 LLM 智能体从传感器信息识别故障及逐步缩小候选空间的能力。

Details

Motivation: PHM 与 NLP 研究逐渐将 LLM 用于工业资产管理，但偏考试式基准难以反映智能体能否在实际操作流程中使用传感器、工具和多轮诊断。

Result: CoffeeBench 基于模拟家电。作者发现模型仅凭传感器信息难以稳定诊断，但较强模型可迭代收缩故障选项并最终完成诊断。分析关注诊断效率、表现最差模型及选择性预测启发式；初始诊断不确定度和 LLM 评估的推理合理性是诊断成功的高信号预测因子。作者还观察到显式替模型追踪 episode 状态可减少超时，加入 deliberation loop 可改善假设修订。摘要未列基准规模和模型准确率。

Insight: 诊断能力既包括最终选对故障，也包括缩小候选的效率；初始不确定性可能用于决定是否继续调用工具或让出判断。结果来自模拟家电任务，向真实工业设备迁移仍待验证。

Abstract: In so-called “Industry 4.0,” integrated sensors, analytics tools, and other digital technologies supplement industrial workflows, potentiating enhanced visibility and automation. Prognostics and health management (PHM) and natural language processing (NLP) practitioners alike have explored the application of large language models (LLMs) to industrial asset management, but many prior works’ focus on exam-like benchmarks has limited their assessment of LLMs’ ability to automate practical operations. Herein, we introduce CoffeeBench, a fault diagnostics task for LLM agents, using a simulated appliance. The LLMs we evaluate struggle to consistently identify faults from the sensor information alone, but the best-performing ones can iteratively refine the fault-option space to eventually obtain a successful diagnosis. Our subsequent analyses, therefore, focus on: differentiating models by diagnostic efficiency (RQ1); examining the lagging performance of the three worst models (RQ2); and identifying viable heuristics for selective prediction (RQ3), including that initial diagnostic uncertainty and LLM-judged soundness of reasoning are high-signal predictors of diagnostic success. In addition to our benchmark results (Section 3.1), we provide practical insights for improving the performance of the open-weight models on CoffeeBench, such as by explicitly tracking episode state on their behalf to reduce timeouts (Section 3.2) or applying a deliberation loop to refine diagnostic hypotheses (Section 3.3).

[84] Beyond Corrected Actions: Training LLM Agents on Textual Critiques cs.CL | cs.AIPDF

Thomas Zeng, Zelei Cheng, Mingyang Zhou, Sambit Sahu, William Campbell

TL;DR: CAFT 在学生生成的错误轨迹中同时提供专家修正动作和文字批评，用批评解释错误原因来丰富多轮智能体监督。

Details

Motivation: 多轮智能体常通过模仿专家轨迹或让专家修正学生动作训练，但专家还可解释为何某个动作不对；仅动作标签可能丢失可迁移的纠错信息。

Result: 对每个错误动作，专家提供修正动作及解释学生错误的文字批评，再将两者共同作为微调目标。四种 Nemotron 3、Gemma 4 学生模型在 τ²-Bench Airline+Retail 和 WebShop 上测试，加入批评后相较仅动作级蒸馏平均提升 8%；CAFT 检查点也可作为强化学习更好的初始化，优于专家轨迹蒸馏的 warm start。

Insight: 解释性反馈可能让智能体学到错误模式和纠正原则，而不只是下一步应执行什么；在错误轨迹上监督也更贴近恢复场景。摘要未提供不同任务单项增益、专家标注成本或批评质量错误的影响。

Abstract: Large language models (LLMs) are increasingly used for multi-turn agentic tasks that require interactions with users and environments over extended sequences of actions. A common approach to improving LLM agents is to use more capable expert models to provide training supervision, either by behavior cloning the expert’s trajectories or by using the expert to correct the actions in trajectories generated by the weaker student model. However, expert LLMs can provide richer supervision than actions alone: they can directly generate textual critique that explain why specific actions are incorrect. We study whether training on such feedback benefits LLM agents and propose Critique-Augmented Agentic Fine-Tuning (CAFT), a framework that elicits textual expert feedback on student-generated trajectories. For each incorrect action, the expert yields both a corrected action and a textual critique explaining the student’s mistake–which we then use as the training target for fine-tuning. Across four student models from the Nemotron 3 and Gemma 4 families on the agentic domains $τ^2$-Bench Airline+Retail and WebShop, adding critiques to action-level supervision improves performance by 8% on average over action-only distillation. Additionally, CAFT checkpoints can also provide a better warm start for reinforcement learning than expert-trajectory distillation. Our results demonstrate that textual critiques can strengthen supervision for multi-turn LLM agents.

[85] Learning What to Keep: Transfer-Aware Personal Skill Learning from User Feedback cs.CLPDF

Li Wang, Chen Zhang, Yirong Yang, Xingyu Chen, Jinkun Zhao

TL;DR: SkillGrain 将用户反馈拆成原子规则，预测每条偏好的跨请求迁移价值，仅保留有助于未来任务的规则，从而减少个性化技能的负迁移。

Details

Motivation: 用户反馈常混合持久偏好和当前请求专属修正；若不加区分地把两者写进可复用技能，后续请求可能受到错误偏好影响。

Result: 框架将反馈分解为独立可执行规则并预测迁移性，结合量规引导技能奖励和细粒度信用分配分别评价规则内容及保留决策；强化学习联合优化技能归纳与条件生成。作者构建五项个性化写作任务基准；三个基础模型、域内和域外设置中，SkillGrain 整体平均表现优于比较方法。摘要未列具体成绩和提升幅度。

Insight: 个性化记忆的关键不只是提取偏好，也要判断它对哪些未来请求适用；原子规则粒度便于单独筛选。当前评估集中在五种写作任务，尚未说明长期用户反馈、偏好变化或规则冲突时的表现。

Abstract: User feedback enables LLMs to refine reusable personalized skills, but often mixes persistent preferences with request-specific corrections. Indiscriminately retaining both risks negative transfer, motivating selective retention at the level of individual requirements. We frame this challenge as selective transfer over atomic rules and propose SkillGrain, a framework for learning reusable personalized skills from user feedback. SkillGrain decomposes feedback into independently actionable rules, predicts their transferability, and retains only those suitable for future requests. To learn these decisions, we combine rubric-guided skill rewards with fine-grained credit assignment that separately evaluates rule content and retention decisions. We further jointly optimize skill induction and skill-conditioned generation through reinforcement learning, ensuring that learned skills support downstream personalization. We construct a benchmark spanning five personalized writing tasks to evaluate cross-request generalization. Experiments across three base models in both in-domain and out-of-domain settings show that SkillGrain achieves the best overall average performance among competing methods.

[86] Vision-Language Models Integrate Conflicting Evidence Like Biased Bayesian Observers cs.CL | cs.AI | cs.CVPDF

Josh Barua, Kyle Mahowald, William Rudman

TL;DR: 该研究用两参数贝叶斯线索组合模型解释 VLM 在文本和图像冲突时的偏好，区分证据强度与模态整合偏差。

Details

Motivation: VLM 需要融合冲突图文证据，但不同模型、领域和输入退化条件下模态主导程度变化；“偏信文本”或“偏信视觉”等单一结论无法解释这些差异。

Result: 作者假设 VLM 按条件独立证据与先验组合两种模态，且存在模态特异偏差，构建两参数模型预测模型在不同组合下的偏好。模型可准确预测未见过的输入退化组合，并无需重新拟合即可迁移到其他不可靠性形式。将证据强度与整合偏差分开后，可解释为何同一模型可能总体更重视视觉证据，却在特定条件下跟随文本。摘要未提供样本规模、预测误差或具体模型列表。

Insight: 模态优势并非固定属性，实际选择取决于输入质量和整合偏差；简单“视觉/文本优先”标签难以描述其行为。两参数模型的假设是证据条件独立，摘要未说明该假设在复杂跨模态依赖场景下的适用边界。

Abstract: Vision-language models must reconcile conflicting text and images. Prior work has characterized the resulting behavior in terms of modality biases–e.g., a “blind faith in text”–but why preferences vary across models, domains, and input conditions remains unclear. We develop a predictive account from a Bayesian perspective, positing that VLMs combine conditionally independent evidence from each modality with prior beliefs, subject to modality-specific biases. The resulting two-parameter cue combination model accurately predicts VLM preferences under unseen combinations of input degradation and transfers to new forms of unreliability without refitting. Separating evidence strength from integration bias explains how VLMs can follow text even while weighting visual evidence more heavily, reconciling reports of text and vision dominance under a single combination rule.

[87] ForkGRPO: Efficient Exploration and Fine-Grained Credit Assignment for Diffusion Language Models cs.CLPDF

Zhaoyan Jia, Chengwei Zhou, Gourav Datta, Massoud Pedram

TL;DR: ForkGRPO 从参考推理轨迹的高熵中间状态分叉采样多个续写，并结合组内相对优势与蒙特卡洛状态价值差进行片段级信用分配。

Details

Motivation: 扩散语言模型任意顺序生成可能发生熵退化、探索路径变窄；从提示独立采样 rollout 未充分探索已有中间状态的替代续写，整条轨迹统一优势也无法区分不同推理段贡献。

Result: ForkGRPO 在参考轨迹高熵状态处采样续写，优先选文本边界并复用共享前缀以提高效率。组内优势决定同一状态下应强化哪些续写，蒙特卡洛状态价值差则衡量某段推理对预期结果的改善。在保持架构的 RL 方法中，该方法在四个基准的三项表现最好；相较直接可比 JustGRPO，单项最高提高 1.2 个百分点，生成 token 最多减少 27.8%。ForkGRPO-Fast 的训练墙钟加速为 2.49 倍，准确率损失很小。

Insight: 共享前缀分叉把额外采样集中在已有推理的不确定点，并通过状态价值分配更细粒度信用。性能优势在摘要中属于最高增益，ForkGRPO-Fast 的精度代价为定性描述；未提供具体任务分数。

Abstract: Diffusion large language models (dLLMs) have advanced rapidly, yet strengthening their reasoning through reinforcement learning (RL) remains an open challenge. Any-order generation can suffer from entropy degradation, which narrows the reasoning paths available for exploration. Recent work mitigates this issue by applying standard GRPO with left-to-right generation. However, independently generating every rollout from the input prompt can leave alternative continuations from intermediate states underexplored, while trajectory-level advantages assign uniform credit to all tokens without distinguishing the contributions of individual reasoning segments. We propose ForkGRPO, an RL framework that couples efficient exploration with fine-grained segment-level credit assignment. It samples multiple continuations from high-entropy intermediate states along a reference trajectory, prioritizing textual boundaries and reusing shared prefixes. The continuations provide complementary learning signals: within-state group-relative advantages guide which continuations to reinforce, while Monte Carlo state-value differences indicate which reasoning segments improve expected outcomes. Among the evaluated architecture-preserving RL methods, ForkGRPO achieves the best performance on three of four benchmarks, while improving over the directly comparable JustGRPO by up to 1.2 percentage points and using up to 27.8% fewer generated tokens. ForkGRPO-Fast further achieves a $2.49\times$ training wall-clock speedup with negligible accuracy loss.

[88] How Do LLMs Understand Legal Philosophy? Diagnosing Legal-Philosophical Reasoning in LLMs cs.CL | cs.AIPDF

Shuyuan Zheng, Yun-seo Lee, Xing Gao, Jialu Wu, Jiabao Hu

TL;DR: LePhilBench 评测 LLM 是否理解法律哲学观点并能将其应用于法律推理，数据集依据 220 份美国最高法院意见书人工构建。

Details

Motivation: 法律判断受法官对法律本质和法源的哲学立场影响；相同法条与判例可能因法律哲学理解和适用方式不同而得出不同判断，但现有研究很少评估 LLM 的法律哲学推理能力。

Result: 基准包含两项任务：理解法律哲学，以及在法律推理中应用哲学立场。测试集包括 220 份美国最高法院意见书；法学教授设计 14 个法律哲学标注问题，由三位受过法理学正式训练的标注者为每份意见书回答全部问题，形成 9,240 个标签。摘要称该工作迈出探索 LLM 法律哲学推理的第一步，未报告模型评测成绩。

Insight: 法律材料的解释依赖关于法律来源和性质的深层理论立场，法律问答基准未必能测到这类差异。当前摘要重点是基准构建而非模型表现；标注依据和意见书来自美国最高法院，跨司法体系适用性有限。

Abstract: Legal reasoning is a fundamental capability for large language models (LLMs) to complete legal AI tasks such as legal judgment prediction. In legal practice, this reasoning is shaped by legal philosophy: a judge’s view of the nature and sources of law guides how legal materials are interpreted and applied, so judges working from the same statutes and precedents can reach different judgments. Existing research has largely overlooked whether LLMs can understand legal philosophy and apply it in legal reasoning, an ability we call \textit{legal-philosophical reasoning}. To fill this gap, we introduce LePhilBench, a benchmark for evaluating the legal-philosophical reasoning of LLMs that comprises two benchmarking tasks and a dataset. The two tasks evaluate how well LLMs understand legal philosophy and how well they apply it in legal reasoning, respectively. The dataset is manually and meticulously constructed. Its test set contains 220 U.S. Supreme Court opinions. A law professor designed fourteen annotation questions on legal philosophy, and three law-trained annotators with formal training in jurisprudence answered all fourteen questions for every opinion, yielding 9,240 legal-philosophical labels. LePhilBench takes the first step toward exploring legal-philosophical reasoning in LLMs.

[89] More Than Seeing: Vision as Scalable Anchors in Native Multimodal Pre-Training cs.CLPDF

Haoyuan Wu, Aoqi Wu, Jiani Hu, Bei Yu

TL;DR: 通过跨模型规模和训练预算的受控消融，研究发现原生多模态预训练中的视觉内容可随计算量扩展带来文本预测及部分空间推理收益，同时未明显损害整体语言表现。

Details

Motivation: 原生多模态预训练中，视觉信号如何影响模型的缩放规律，以及能否支持图像理解以外的能力，尚未被清楚刻画。

Result: 研究在不同模型规模和训练预算下，将图像嵌入替换为无内容的填充标记嵌入作为对照。保留图像内容能改善图文样本上的文本预测，但在给定计算预算下，未实质改变最低纯文本损失、模型规模与训练数据的最优平衡或整体语言得分；多模态损失收益随计算量近似按幂律增长。仅依据文本描述评估空间推理时，两种条件均随模型和数据扩展而提升；最大模型训练期间，视觉收益在定位、导航和符号规划上更持续，而空间关系、几何及物理常识上的收益较不一致。

Insight: 视觉内容可能充当可扩展的多模态学习锚点，其效益并不局限于视觉输入任务，并可在整体语言表现基本保持的情况下出现。摘要报告的是受控替换实验及所列任务，不能据此推断所有空间能力均稳定受益。

Abstract: Native multimodal pre-training trains a single model from scratch on text and multimodal data, enabling it to understand both language and visual inputs. However, how visual signals shape scaling behavior and support capabilities beyond visual understanding remains unclear. We investigate this question through controlled visual-content ablations across model sizes and training budgets. Specifically, we replace image embeddings with content-free padding token embeddings. Retaining visual content improves text prediction on image-text examples without materially changing the lowest text-only loss at a given compute budget, the optimal balance of model size and training data, or aggregate language scores. The relative multimodal loss benefit grows approximately as a power law of compute. To test benefits beyond understanding images, we evaluate spatial reasoning from text descriptions alone. Both conditions improve with model and data scaling. During training of the largest model, visual gains are most sustained in localization, navigation, and symbolic planning, which involve maintaining object configurations or composing spatial updates; gains in spatial relations, geometry, and physical commonsense are less consistent. These findings identify visual content as a scalable anchor for multimodal learning, with benefits that extend beyond visual inputs while preserving aggregate language performance.

[90] Structure-Preserving Document-Level Data Augmentation via Discourse Parsing cs.CL | cs.AIPDF

Ruilin Shang, Shilong Hou, Zi Long, Xianghua Fu

TL;DR: 该框架利用文档级话语结构解析生成保留修辞关系的增强文本，在摘要和问答任务的实验中为联合训练提供互补监督并改善表现。

Details

Motivation: 同义词替换、回译等常见数据增强主要在词语或句子层面操作，可能忽视依赖跨句关系的任务所需的话语连贯性和逻辑流。

Result: 方法结合大语言模型与文档级话语结构解析，识别句子对之间的修辞关系并提取关键短语，再以语义连贯但主题有所偏移的内容替换关键短语，同时保留原有话语结构。在文本摘要和问答实验中，增强数据提供了互补监督，并在所评估任务的增强数据联合训练中带来提升；与标准RST解析器的比较及受控消融进一步支持所用话语表示。

Insight: 数据增强若显式保留篇章关系，可补足词句级扰动对跨句任务的不足。摘要没有提供数据集、具体指标或提升数值，结论仅能限定于所报告的摘要和问答实验。

Abstract: Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Processing (NLP). Existing DA methods, such as synonym replacement and back-translation, have demonstrated effectiveness on the word or sentence level; however, they frequently neglect discourse-level coherence and logical flow, which are essential for complex tasks dependent on inter-sentential relationships. In this paper, we propose a structure-preserving document-level data augmentation framework based on large language models (LLMs) and document-level discourse structure parsing. Our approach identifies rhetorical relations between sentence pairs and extracts key phrases, which are then replaced with semantically coherent but topically shifted content while preserving the original discourse structure. Experimental results on text summarization and question answering show that the proposed augmented data provides complementary supervision and improves combined-data training across the evaluated tasks. Comparisons with a standard RST parser and controlled ablations further support the proposed discourse representation.

[91] Retrieve What Helps, Only When It Helps: Agentic Reinforcement Learning for Selective Retrieval-Augmented Machine Translation cs.CL | cs.AI | cs.IRPDF

Shijun Li, Yang Liu, Najmeh Sadoughi, Dongmei Wang, Xinjie Li

TL;DR: SRAT将检索视为机器翻译中的可学习动作，由强化学习决定是否检索、检索什么及如何整合证据，以最终译文质量作为优化目标。

Details

Motivation: 现有检索增强机器翻译常对所有输入使用预设且统一的检索策略，但模型参数知识已能覆盖许多句子；外部证据只在部分输入上有益，且通常用于辅助而非直接给出译文，因此需要同时决定何时检索及获取何种证据。

Result: SRAT通过智能体强化学习联合学习直接翻译或检索、检索内容以及证据整合方式，并以最终翻译质量为优化目标。为使检索器与下游译文质量对齐，而非仅追求语义相似度，作者还提出联合Plackett–Luce优化和翻译质量对比训练。在习语、知识密集型及文档级翻译任务中，离线和在线检索实验均显示SRAT持续优于始终不检索与始终检索基线；当相似度检索不足时，质量对齐的检索器训练还能进一步提升表现。

Insight: 检索有条件地作为翻译决策，优于把它固定为所有输入共有的预处理步骤；检索器也应按译文实际质量而非单纯语义相似度训练。摘要没有提供具体数据集、模型和分数，因而无法量化增益幅度。

Abstract: Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology. However, existing retrieval-augmented machine translation systems typically apply predefined retrieval strategies uniformly across all inputs. We argue that translation operates in a partial-evidence regime: LLM’s parametric knowledge suffices for many inputs, while external evidence benefits a subset and usually supports rather than directly provides the desired translation. This creates two challenges: deciding when to retrieve and what evidence to acquire. We introduce Selective Retrieval-Augmented Translation (SRAT), an agentic reinforcement learning framework that learns when to translate directly or retrieve, what to retrieve, and how to integrate these decisions by optimizing final translation quality. To align evidence retrieval with downstream translation quality rather than simple semantic similarity, we further develop joint Plackett–Luce optimization and translation-quality contrastive training for retriever-training. Experiments on idiom, knowledge-intensive, and document-level translation with offline or online retrieval show that SRAT consistently outperforms never- and always-retrieve baselines, and quality-aligned retriever training provides further gains when similarity-based retrieval is insufficient. The results demonstrate the benefit of treating retrieval as a learnable translation action rather than fixed preprocessing.

[92] REWIND: Uncertainty-Guided Trajectory Repair for Test-Time Reasoning cs.CL | cs.AIPDF

Yi Ding, Mengyu Wang, Min Zhou, Menglin Yang

TL;DR: REWIND用生成过程中的熵变化定位可能出错的推理后缀，并进行定向重生成；该免训练控制器在三类模型和五个基准上优于所比较基线。

Details

Motivation: 推理链早期错误可能限制后续推导。多次采样或MCMC式重生成虽试图提高输出质量，但随机选择重生成位置会限制其效果；作者观察到错误回答的令牌熵明显更高，提示不确定性可用于定位问题。

Result: 在Qwen2.5-Math-7B的MATH500实验中，错误回答的平均令牌熵显著高于正确回答，同题内相对增幅约112%。据此，REWIND作为免训练控制器利用熵动态提出有针对性的后缀重生成。在三类模型和五个基准上的实验中，它优于全部比较基线，相对最强基线提升0.51至10.00个百分点。

Insight: 不确定性信号可用于选择需修复的推理片段，避免仅随机重采样；跨模型和任务的实验支持该策略的适用性。熵相关发现来自摘要点名的MATH500与Qwen2.5-Math-7B，摘要没有列出其余基准名称、计算开销或各项具体增益。

Abstract: An early mistake in the generated reasoning can constrain all subsequent reasoning. Repeated-generation methods, like MCMC-based approaches, attempt to improve output quality by sampling multiple generations, but their effectiveness can be limited by randomly selecting where to regenerate. On MATH500 with Qwen2.5-Math-7B, we find that incorrect responses have substantially higher mean token entropy than correct responses, with an average within-question relative increase of approximately 112%, suggesting that entropy can signal reasoning errors. Motivated by this finding, we introduce REWIND, a training-free controller that uses entropy dynamics to propose targeted suffix regenerations. Across three model families and five benchmarks, REWIND outperforms all baselines, with gains of 0.51-10.00 percentage points over the strongest baseline. These results demonstrate the effectiveness of targeted, uncertainty-guided trajectory repair across models and tasks. Our code is available at https://anonymous.4open.science/r/rewind-D310.

[93] INTACT: Inducing Latent Reasoning on a Frozen Backbone cs.CL | cs.LGPDF

Kutay Tire, Atula Tejaswi, Haris Vikalo, Sujay Sanghavi

TL;DR: INTACT训练一个小型外部编码器，将冻结骨干模型的隐藏状态转化为连续潜在推理前缀，再由原模型续写文本推理与答案，在多个规模和领域上改善准确率并降低延迟。

Details

Motivation: 自然语言思维链需要逐个自回归解码中间令牌；连续软令牌式潜在推理可压缩中间过程，但希望在不更新骨干模型的条件下诱导这种能力，同时尽量维持其原有行为。

Result: INTACT让外部编码器迭代映射冻结骨干的隐藏状态，生成潜在推理块并组成前缀，之后冻结模型以文本输出其余推理和答案。编码器先通过蒸馏学习复现显式推理步骤的效果并约束模型行为接近冻结骨干，再根据答案正确性强化。在四个1B至8B的冻结骨干上，方法提升GSM8K及域外平均准确率：Llama-3.2-3B从75.8%升至79.3%，Qwen2.5-3B从77.6%升至79.7%；Llama-3.2-3B每题端到端延迟降低19%，并在3B及8B规模超过所评估的潜在推理基线。用多领域语料训练的同一方案还在数学、科学和常识共12个评测基准上提升冻结骨干，无需针对单项任务适配。

Insight: 一个小型可训练编码器有望在冻结主模型的同时压缩推理中间表示，并带来准确率和时延收益。摘要仅给出部分准确率、单个模型的时延改善及所述基准总体结论，未提供各基准的完整数值与潜在前缀长度比较。

Abstract: Latent reasoning replaces natural-language chains of thought with compact continuous “soft-token” representations, reducing the number of intermediate tokens that must be decoded autoregressively. We use a small external encoder to induce latent reasoning in a frozen backbone model. The encoder iteratively maps the backbone’s hidden states to new latent blocks, constructing a latent reasoning prefix, after which the frozen model writes its remaining reasoning and its answer as text. Our method, INTACT, trains this encoder through distillation to reproduce the effect of written reasoning steps while keeping the model’s behavior close to that of the frozen backbone, and then reinforces it on answer correctness. Across four frozen backbones from 1B to 8B, INTACT improves both GSM8K and average out-of-domain accuracy, including GSM8K gains from 75.8% to 79.3% on Llama-3.2-3B and from 77.6% to 79.7% on Qwen2.5-3B. It also reduces end-to-end latency per problem by 19% on Llama-3.2-3B and outperforms the evaluated latent-reasoning baselines at the 3B and 8B scales. Beyond the mathematics setting, the same recipe trained on a multi-domain corpus improves the frozen backbone on twelve evaluation benchmarks spanning mathematics, science, and commonsense, without task-specific adaptation.

[94] Moral Combat: Exploiting Moral Foundations Theory to Jailbreak LLMs cs.CL | cs.CYPDF

Adel Khorramrouz, Yi-Chia Wang, Sharon Levy

TL;DR: Moral Combat用多智能体框架依据道德基础理论改写被拒绝的有害请求，并在多个数据集和模型上发现，以道德化重述诱导越过安全防护具有较高成功率。

Details

Motivation: 有害行为可能被重新解释成道德上正当的行为，而大语言模型也会呈现类似人类的偏见与从众倾向；这引出一个安全问题：能否借助道德框架重述请求来绕过模型的安全防护？

Result: 框架针对最初被拒绝的有害请求，先诊断其违反了哪种道德基础，再寻找能使同一请求显得正当的道德基础，随后据此改写提示，并加入类似道德重述先例作强化。作者在三个常用越狱数据集及五种开源和专有模型上评估，发现模型容易受到道德化提示影响，单次尝试就有较高越狱率，重复尝试后成功率进一步上升。分析还发现，安全基准对不同道德基础的违规类型分布不均，集中在模型本来已有偏见的基础上。

Insight: 安全评测若未覆盖不同道德框架，可能低估针对模型既有偏见的道德化越狱风险。摘要未给出具体越狱率和数据集、模型明细，故不能量化各类基础或模型之间的差异。

Abstract: Social psychology has long described how people can be persuaded to interpret a harmful act as moral. Recent research suggests that Large Language Models (LLMs) echo aspects of human psychology, from cognitive biases to social conformity. This raises a question with direct safety implications: can LLMs be moralized to bypass safety guardrails? We answer this question with a multi-agent framework grounded in Moral Foundations Theory (MFT). Given a harmful request that is initially refused, our agents diagnose which moral foundation (MF) the prompt is violating, identify a justifiable foundation under which the same request appears virtuous, rewrite the prompt accordingly, and reinforce it with generated precedents of comparable moral reframing. We evaluate our framework on harmful prompts from three well-known jailbreak datasets across five open-source and proprietary models. Our analysis reveals that models are highly susceptible to moralization, exhibiting high single-trial jailbreak rates with success increasing further under repeated attempts. We also find that safety benchmarks are imbalanced in the MFs they violate, concentrating on foundations toward which models already exhibit biases.

[95] PA1-OPD: One-Step Prefix-Augmented On-Policy Distillation for Language Model Pretraining cs.CLPDF

Zhenhe Wu, Jian Yang, Yaping Jin, Xinlai Kang, Jie Hu

TL;DR: PA1-OPD在语料路径知识蒸馏之外，加入学生模型采样一步后教师提供的反馈，以覆盖由学生自身预测诱导的上下文并改善继续预训练的验证交叉熵。

Details

Motivation: 在语料前缀上匹配教师分布的知识蒸馏，未直接监督学生模型预测后会遇到的上下文；因此学生自身生成路径上的行为可能没有得到教师反馈。

Result: PA1-OPD为选定语料前缀添加学生采样一步后教师反馈，同时保留下一令牌预测和语料路径蒸馏。方法以语料锚定根节点支持并行采样，并用可微树注意力共享前缀计算，推理方式不变。在两个继续预训练设置中，完整覆盖方案在C4、PG-19和Pile上的每个评估检查点均比知识蒸馏降低留出交叉熵。Stage2中，选择学生惊异度最高的10%根节点，使PA1-OPD相对下一令牌训练的宏平均交叉熵收益比KD增加48.85%。即使排除已位于语料路径上的后继状态，分支监督仍有收益；增加分支深度或广度也能改善总体结果，但收益随语料而异。

Insight: 学生诱导上下文上的局部教师监督，可作为语料路径蒸馏的补充；即使不重复监督语料中已出现的后继状态，反馈仍有价值。48.85%是Stage2所述宏平均交叉熵收益的增幅，摘要未给出绝对交叉熵数值或具体模型规模。

Abstract: Knowledge distillation (KD) improves language-model pretraining by matching teacher distributions at corpus prefixes, but provides no direct supervision at contexts induced by student predictions. We introduce PA1-OPD, which augments corpus-path distillation with teacher feedback after one student-sampled transition per selected prefix. This expands the supervised states while retaining next-token prediction and corpus-path KD. Data-anchored roots support parallel sampling, and differentiable tree attention shares prefix computation without changing inference. In two continued-pretraining settings, full coverage improves held-out cross-entropy over KD across C4, PG-19, and Pile at every evaluated checkpoint. In Stage2, selecting the 10% of roots with highest student surprisal adds 48.85% to KD’s Macro cross-entropy gain over next-token training. Gains remain when branch supervision excludes successor states already on the corpus path, supporting the value of feedback beyond observed contexts. Additional depth or breadth improves aggregate results at unchanged per-term supervision weight, with benefits varying by corpus. These findings support local student-induced supervision as a complement to pretraining distillation.

[96] Are We Really Measuring Forgetting? Pitfalls in Evaluating Machine Unlearning for Multimodal LLMs cs.CLPDF

Oscar Chew, Po-Yi Lu, Yi-Jie Cheng, Kunal Jain, Hsuan-Tien Lin

TL;DR: GEMMU针对多模态大模型遗忘评测中的留出泛化、知识真实性和方法比较公平性问题，基于真实世界知识重新评测后发现显著泛化差距。

Details

Motivation: 现有多模态大模型机器遗忘基准大多沿用纯文本协议，可能忽视多模态遗忘的特殊挑战，导致关于是否真正遗忘的结论失真。

Result: 作者指出三个主要评测陷阱：缺少留出集，无法区分概念层面的真实遗忘与实例过拟合；依赖合成微调知识，而非预训练期间学到的真实世界知识；对不同遗忘方法采用相同训练设置，导致比较不公平。为解决这些问题，作者提出GEMMU（多模态机器遗忘泛化评测），以真实世界知识和原则化协议构建基准。使用GEMMU重新评估代表性遗忘方法后，发现显著的泛化差距，并对既有基准所得结论提出质疑。

Insight: 多模态遗忘评估需要测试未见实例上的概念泛化、使用更贴近预训练的知识，并按方法特点公平设定训练条件。摘要未给出基准规模、模型列表或泛化差距的定量值。

Abstract: As machine unlearning for multimodal large language models (MLLMs) rapidly advances, rigorous evaluation of its effectiveness becomes increasingly important. However, existing benchmarks largely inherit evaluation protocols from text-only unlearning and overlook the unique challenges of unlearning in multimodal settings. In this work, we identify three major pitfalls that may lead to misleading conclusions: the lack of heldout evaluation to distinguish genuine concept-wise forgetting from instance-wise overfitting, the reliance on synthetic, fine-tuned knowledge rather than real-world knowledge acquired during pre-training, and unfair method comparisons caused by applying the same training settings to different unlearning methods. To address these challenges, we introduce GEMMU (Generalizable Evaluation for Multimodal Machine Unlearning), a benchmark built on real-world knowledge and a principled evaluation protocol. Re-evaluating representative unlearning methods under GEMMU reveals substantial generalization gaps and challenges conclusions drawn from previous benchmarks. Our findings highlight the importance of rigorous evaluation for advancing multimodal machine unlearning and provide guidelines for future benchmark design.

[97] Selective Reasoning for Typed Decision Models: When to Start, Read, and Stop cs.CLPDF

Bin Zheng, Zheng Chen

TL;DR: 该方法在冻结Qwen3.5-4B骨干上训练共享候选答案读取器，按收益门控启动推理、按需读取部分推理前缀并在不确定度规则满足时停止，以控制答案准确率、生成量和耗时。

Details

Motivation: 类型化决策模型需要在保留候选答案接口的同时利用额外推理；始终直接作答或固定生成长推理链，都难以针对题目决定何时开始推理、何时读取以及何时停止。

Result: 方法在冻结的Qwen3.5-4B骨干上训练共享候选答案读取器，使其能根据空推理前缀或部分推理前缀返回答案分布。收益门控决定是否启动推理，自然状态触发显式读取，熵规则在接受答案时取消后续生成。作者分别测量答案查询工作量、生成输出量和流水线时间。在ProofWriter、LogiQA 2.0和ARC-Challenge共768道题上，准确率由直接读取的70.96%提高到84.38%。相较512令牌终止读取，准确率提高7.29个百分点，平均输出工作量仅增加2.25%；相较1,024令牌终止读取，流水线时间减少46.30%，准确率差为−1.17个百分点。精确前缀控制和读取调度控制分别用于区分中断带来的节省及观察工作量减少与响应时间缩短。

Insight: 把启动、读取和停止作为分开的选择，有望在维持较高准确率时避免无必要的推理生成；实验也显式区分输出量和端到端时间。结论限于三项基准、冻结骨干和相应对照设置，摘要未报告模型之外的推理成本或更广任务结果。

Abstract: Typed decision models need an interface that can use additional reasoning while retaining candidate outputs. We train a shared candidate-answer reader on a frozen Qwen3.5-4B backbone to unify direct decisions with on-demand, interruptible reasoning. The reader returns distributions from empty and partial reasoning prefixes. A benefit gate starts reasoning, a natural-state trigger requests explicit reads, and an entropy rule accepts acquired answers and cancels generation. Measurements distinguish answer-query work, generated output, and pipeline time. Across 768 questions from ProofWriter, LogiQA 2.0, and ARC-Challenge, accuracy rises from 70.96% for direct reading to 84.38%. Relative to 512-token terminal reading, accuracy improves by 7.29 percentage points with 2.25% more mean output work. Relative to 1,024-token terminal reading, pipeline time falls by 46.30% with an accuracy difference of -1.17 points. Exact-prefix controls isolate the saving from interruption, while read-scheduling controls distinguish reduced observation work from shorter response time.

[98] BANGLAPLAN: A Benchmark for Constraint-Based Planning and Decision-Making in Bangla cs.CLPDF

Md Rayhanul Masud, S M Maksudul Alam, Mohammad Jaminur Islam

TL;DR: BANGLAPLAN提供1,000道孟加拉语显式约束规划题，覆盖多种日常任务、可行与不可行情形及四类语域；模型评测显示规划表现差异显著，许多配置不及总判不可行的基线。

Details

Motivation: 大语言模型常被用于预约、旅行和资源分配，这些决策任务要求满足时间、成本、容量和顺序等约束，或识别无可行解。尽管孟加拉语任务基准丰富，针对显式约束下规划与决策的评测基准仍缺乏。

Result: BANGLAPLAN包含1,000道题、10类任务，基于孟加拉国日常生活和机构场景，涵盖可行与不可行实例，以及日常、正式、口语和孟加拉语—英语混合四种语域。答案覆盖日程、路线、分配和有序步骤等8种结构化类型，并采用统一JSON格式；题目经语言模型辅助起草后由独立人员验证。作者用精确匹配评估11种开源权重或专有模型配置，并分别报告可行题准确率、不可行性识别和格式错误。GPT-6.1 Sol准确率为98.7%，启用思考的Qwen3.5-27B为80.3%，直接回答配置最高为30.9%；11种配置中有7种低于“总判不可行”基线。较难题目主要降低方案构造准确率，而不可行性识别相对稳健。

Insight: 该基准说明孟加拉语约束规划既受方案构造能力限制，也需要单独衡量可行性判断和输出格式；只看总体准确率会掩盖这些差异。报告的极高模型分数和失败基线依赖题目及评测协议，摘要未提供任务族分项结果。

Abstract: Large language models (LLMs) increasingly help users arrange appointments, plan journeys, and allocate limited resources. These tasks require models to satisfy constraints on time, cost, capacity, and order, or determine that no feasible solution exists. Bangla is the world’s seventh most widely spoken language, and existing benchmarks cover many language and reasoning tasks. However, benchmarks for evaluating planning and decision-making in Bangla under explicit constraints remain lacking. We introduce BANGLAPLAN, a benchmark of 1,000 problems across ten task families grounded in everyday life and institutions in Bangladesh. It includes feasible and infeasible problems in four language registers: everyday, formal, colloquial, and Bangla–English mixed. Answers cover eight structured types, including schedules, routes, allocations, and ordered steps, in a common JSON format. We construct the benchmark through language-model-assisted drafting and independent human validation. We evaluate 11 open-weight and proprietary model configurations using exact match, separately reporting feasible-case accuracy, infeasibility detection, and format errors. We find a large performance gap: GPT-6.1 Sol achieves 98.7% accuracy and Qwen3.5-27B with thinking reaches 80.3%, while direct-answer configurations score at most 30.9%. Seven of eleven configurations perform below the always-``infeasible’’ baseline. Our findings also suggest that harder problems primarily reduce plan-construction accuracy, while infeasibility detection remains more robust. BANGLAPLAN provides a reproducible basis for evaluating planning and decision-making in Bangla. BANGLAPLAN is available at: https://github.com/mrayhanulmasud/banglaplan.

[99] RouteWeaver: Weaving Mode Selection and Execution into Unified LLM Routing cs.CLPDF

Xiaohan Wang, Haozhen Zhang, Qingyuan Liu, Tao Feng, Wenya Wang

TL;DR: RouteWeaver在统一路由策略中联合选择执行模式与模式内模型，并用分层信用分配和渐进式探索训练，在五类任务上超过比较基线。

Details

Motivation: 现有大语言模型路由通常预先固定为单轮、多轮或智能体式执行范式，导致调用组织方式无法按具体问题需求调整。

Result: RouteWeaver用单一策略联合决定使用哪种路由模式及在该模式内选择哪些模型。配套COMET-GRPO将轨迹级优势信号拆成模式选择与模式内执行两部分，分别分配训练信用；渐进式探索先从外部指定模式逐步过渡到自主选择，使路由器先学会各模式的执行，再学会何时选用。数学、编程、知识、逻辑推理和事实回忆五个领域的平均准确率为61.4%，相对最强基线提升11.03%，且每个领域均超过所有比较基线。消融显示两种训练设计都很重要；去掉渐进式探索时，策略完全坍缩为单轮执行。

Insight: 路由策略需要同时学会调用流程怎么执行及何时选择该流程，渐进探索与分层信用分配有助于避免模式塌缩。摘要未提供各领域的具体分数、调用成本或模型名单，不能判断准确率收益是否伴随额外开销。

Abstract: LLM routing dynamically selects and coordinates heterogeneous language models across diverse tasks. However, existing approaches are largely built around a predefined execution paradigm, such as single-round, multi-round, or agentic routing, which fixes how model calls are organized and limits adaptation to different query needs. We propose RouteWeaver, a unified routing framework that integrates these routing modes within a single LLM policy, jointly learning which mode to use and how to select models within that mode. To jointly optimize mode selection and within-mode execution, we develop COMET-GRPO (COordinated Mode-Execution Training), which decouples the trajectory-level advantage into separate signals for mode selection and within-mode execution, enabling more targeted credit assignment to each decision level. We further introduce progressive exploration, which gradually shifts training from externally assigned modes to autonomous selection, so that the router first learns how to execute each mode before deciding when to use it. We evaluate RouteWeaver across mathematics, coding, knowledge, logical reasoning, and factual recall. RouteWeaver achieves an average accuracy of 61.4%, an 11.03% relative improvement over the strongest baseline, and outperforms all compared baselines in each of the five domains. Ablations show that both COMET-GRPO and progressive exploration are important for adaptive routing; without progressive exploration, the routing policy collapses entirely to single-round execution.

[100] Recognizing Dialogue Ambiguity via Candidate Set Visual Grounding cs.CL | cs.AI | cs.CVPDF

Shun Inadumi, Lee Sangmyeong, Koichiro Yoshino

TL;DR: CSVG将交互视觉指代定义为根据累积对话估计所有仍合理的候选物体集合；评测发现，较强的单目标视觉定位能力并不必然带来更好的候选集合预测。

Details

Motivation: 现实交互中的模糊表达需要结合多轮上下文；当语言指向场景物体时，模型应随着上下文累积更新合理指代集合，而不应假设现有信息总能唯一确定一个物体。既有交互式视觉定位研究多聚焦于上下文足够后找出唯一目标。

Result: 作者提出候选集合视觉定位任务CSVG，并构建CandVG基准来评估候选集合如何随对话轮次变化。视觉语言模型评测显示，更强的视觉指代能力并不必然带来更好的CSVG表现。模型难以完整预测候选集合，困难来自候选生成不足及早期过早收敛到少数候选；针对CSVG设计的指令可在所测大规模模型中部分缓解该问题。

Insight: 多轮指代评估应允许答案暂时保持多解，并考察候选集合能否随证据合理更新；强迫模型过早输出唯一目标会掩盖不确定性处理问题。摘要未给出基准规模、模型列表或定量指标，也未说明指令缓解幅度。

Abstract: Interpreting an ambiguous utterance in real-world interactions often requires context beyond a single utterance. When the utterance refers to objects in a visual scene, it is necessary to maintain and update the set of plausible referents as context accumulates, without assuming that the available information identifies a unique object. However, prior work on interactive visual grounding, which localizes objects referred to by linguistic expressions, has focused on identifying a unique object once sufficient dialogue context becomes available. To address this gap, we propose Candidate Set Visual Grounding (CSVG), a task for estimating the set of objects consistent with the given dialogue context. We further introduce CandVG, a benchmark that evaluates how the candidate set changes across dialogue turns. Our evaluation of vision-language models shows that stronger visual grounding capability does not necessarily yield better CSVG performance. In particular, models have difficulty predicting the complete candidate set, owing to challenges in candidate generation and premature commitment to a small set of candidates in early turns. Nevertheless, we find that this limitation can be partially mitigated in the evaluated large-scale models using instructions designed for CSVG.

[101] MakSafe: A Spatiotemporal Semantic Framework for Formal Specification and Compliance Checking of Road Vehicle Safety Rules cs.CL | cs.SCPDF

Maksym Labzhaniia, Julien Deantoni, Marie-Agn{è}s Peraldi-Frati, Fr{é}d{é}ric Mallet

TL;DR: MakSafe以语义区域、动作预测和轨迹树推理形式化道路车辆安全规则，支持对不同未来分支给出安全判定，并在报告的测试范围内将单条规则检查控制在毫秒以下。

Details

Motivation: 基于场景的自动驾驶验证难以覆盖开放道路交通的全部变化，因此需要能够形式化表达并检查车辆安全规则的时空框架。

Result: MakSafe通过语义区域、基于动作的预测和轨迹树推理进行形式化验证，避免均匀离散时间。框架形式化表示道路网络、车辆状态和占用区域，并实现前车识别及碰撞时间（TTC）验证规则。评测结合依赖轨迹的案例研究和针对交通密度N、预测时域H、分支因子B的可扩展性测试。同一初始场景的不同轨迹分支可分别判为安全或不安全；控制更新后也能重新评估场景。报告的参数扫描中，单条规则检查耗时始终远低于1毫秒，TTC检查则会随预测时域延长而变慢。

Insight: 显式按语义区域和分支轨迹推理，可避免把不同未来行为压成单一结论，并能响应控制更新。摘要未给出扫描参数的具体范围、硬件条件或精确延迟分布，因此不能据此推断所有部署负载下的实时性能。

Abstract: Scenario-based validation is essential for automated road vehicles but cannot cover the full variability of openworld traffic. We present MakSafe, a formal spatiotemporal framework for specifying and checking road vehicle safety rules through semantic zones, action-based forecasting, and trace-tree reasoning, avoiding uniform time discretization. We formalize the road network, vehicle states, and occupancy zones, then build executable rules for front-vehicle identification and timeto-collision (TTC) verification. The evaluation combines a tracedependent case study with a scalability benchmark over traffic density (N ), horizon (H), and branch factor (B). MakSafe yields branch-specific verdicts, deriving safe and unsafe outcomes from the same initial scene, and re-evaluates a scenario after a control update. A single rule check stays well below a millisecond across the reported sweep, and longer horizons slow the TTC check.

[102] Does the Linguistic Register of Thinking Matter? Wenyan as a Compact Reasoning Register for Chinese LLMs cs.CL | cs.AIPDF

Minghan Li, Guodong Zhou

TL;DR: Wenyan Thinking仅将中文推理轨迹改写为文言文并保持简短直接答案，通过与同源紧凑白话对照，研究文体是否有助于预算受限的可见推理。

Details

Motivation: 中文推理模型通常以现代白话输出较长的显式推理，在解码预算有限时可能效率不高；作者探讨推理所用语言文体能否成为提升效率的设计维度。

Result: 方法从现代中文推理轨迹出发，只将推理字段改写为文言文，直接答案仍保持简短，并用改写后的监督微调Qwen3-4B-Thinking-2507。为区分文体变化与一般压缩效应，作者使用相同源数据、教师模型族、基座模型和监督微调流程构造紧凑白话对照。在MMLU-ProX-Lite-ZH、CEVAL和AGIEval-CN的预算敏感评测中，文言推理显著缩短推理长度并降低受限解码下缺失答案的比例；紧凑改写解释了大部分效率收益，而文言版本在主要基准上稳定优于紧凑白话对照，并在其余基准保持竞争力。

Insight: 文体可能在通用压缩之外影响预算受限推理表现，但多数效率收益来自压缩本身；文言相对白话的优势需结合对照实验理解。摘要未给出长度、缺答率和准确率的具体数值，结论限于所列中文基准和训练配置。

Abstract: Visible reasoning traces of Chinese reasoning-oriented LLMs are typically written in modern vernacular Chinese, which may be verbose under limited decoding budgets. We ask whether the linguistic register of reasoning can be used to improve efficiency. We propose Wenyan Thinking, which emits intermediate reasoning in Classical Chinese (wenyanwen) while retaining a short direct-answer output. Starting from modern-Chinese reasoning traces, we rewrite only the reasoning field into wenyan and fine-tune Qwen3-4B-Thinking-2507 on the rewritten supervision. To distinguish register shift from generic compression, we construct a compact modern-Chinese control using the same source data, teacher family, base model, and SFT recipe. Across budget-sensitive evaluations on MMLU-ProX-Lite-ZH, CEVAL, and AGIEval-CN, Wenyan Thinking substantially reduces reasoning length and missing-answer rates under constrained decoding. Compact rewriting explains much of the efficiency gain, while wenyan consistently outperforms the compact modern-Chinese control on the primary benchmark and remains competitive across the additional benchmarks. These results identify linguistic register as a practical design axis for efficient visible reasoning in Chinese LLMs.

[103] Beyond Reachability: A Relation-Semantic Reasoning Framework for Biomedical Multi-hop QA cs.CLPDF

Ziyang Ling, Ziyi Chen, Ronald X. Xu, Mingzhai Sun

TL;DR: ReSemReason通过共享的类型化有向关系模式，把生物医学知识图谱问答中的候选答案发现与证据路径选择对齐，以缓解答案可达但证据路径无效的问题。

Details

Motivation: 生物医学多跳图谱推理不仅要检索到正确答案，还要找到语义上有效、能支持问题所需关系组合的路径。已有方法可能找到了答案，却在大量相似候选中排序不佳，或返回不能支撑推理的证据。

Result: 作者将“答案可达但证据无效”定义为reachable-but-invalid问题，并提出ReSemReason。方法根据问题生成类型化、有向关系模式分布，共同用于候选发现和证据选择；模式兼容性指导图搜索，ReSemAttn再通过关系条件化的键值投影及不确定性加权路径先验关注候选特定证据。当所有检索路径都较弱时，另以绝对支持度分数补充归一化注意力。BioHopR、PrimeKGQA和MedReason实验报告答案排序与答案集合质量有所改善；路径区分分析进一步考察答案端点正确性与证据支持的差别。

Insight: 图谱问答需要同时验证终点答案与支撑它的关系链，单有可达路径不等于证据有效。摘要未提供具体指标和提升值，也没有说明各基准上的差异；文中提到搜索、注意力及模式不确定性的匹配控制。

Abstract: Biomedical multi-hop reasoning over knowledge graphs requires identifying a semantically valid relation sequence that supports the answer. Existing methods can retrieve correct answers, yet often rank them poorly within a large pool of seemingly relevant candidates. Even when a correct answer is retrieved, its associated evidence and reasoning path may fail to support the relation composition required by the question. We term this disconnect between answer reachability and evidential validity the reachable-but-invalid problem. We present ReSemReason, which shares a question-induced distribution over typed, directed relation schemas between candidate discovery and evidence selection. Schema compatibility guides graph search; ReSemAttn then uses relation-conditioned key/value projections and an uncertainty-weighted path prior to attend to candidate-specific evidence. A separate absolute-support score complements normalized attention when all retrieved paths are weak. The reported experiments on BioHopR, PrimeKGQA, and MedReason show improvements in answer ranking and answer-set quality. Path-discrimination analyses examine the distinction between endpoint correctness and evidential support. We also specify matched controls for search, attention, and schema uncertainty.

[104] More Methods, Better Agents? A Reality Check on Self-Distillation in Agentic Reinforcement Learning cs.CL | cs.LGPDF

Linhao Zhong, Bozhen Fang, Xuehao Wang, Duochao Shi, Zekai Luo

TL;DR: 该研究在统一实验条件下比较十种智能体强化学习自蒸馏方法与GRPO，发现方法收益有限且依赖设置、强最终表现可能掩盖训练不稳定，额外算力也不保证更好效果。

Details

Motivation: 现有自蒸馏智能体强化学习评测常引用不同实验条件下已发表的基线分数，直接横向比较不足，并较少分析训练稳定性和计算成本，因而难以判断增益来源及实际代价。

Result: 作者在ALFWorld、ScienceWorld、Search-QA和WebShop上，用三种模型规模将十种代表性方法与GRPO比较，共进行132次训练，记录H800 GPU时12,124.4小时；对预训练骨干和全部11种训练方法，以8个rollout种子重复评估。除最终任务表现外，还比较训练进程、稳定性和实测计算成本。结果有三点：相对GRPO的收益范围有限，没有一种方法能在所有设置中稳定胜出；最终成绩较高可能掩盖训练不稳定；更多训练成本并不持续转化为更好表现。

Insight: 报告强调在统一基线上同时比较最终性能、训练过程和实测成本；仅引用单一最终分数不足以评估智能体训练方法。该结论覆盖所测四个任务、三种规模和十一种训练方法，摘要未提供各方法逐项性能与成本排名。

Abstract: Self-distillation in agentic reinforcement learning has produced a growing number of methods. However, existing evaluations often reuse published baseline scores under differing experimental conditions, provide few direct comparisons among contemporaneous methods, and give limited attention to training stability and computational cost. These limitations obscure the source of reported gains and the practical strengths and weaknesses of competing methods. Costly agent training further motivates a common basis for comparison. To address these gaps, we compare ten representative methods against GRPO on ALFWorld, ScienceWorld, Search-QA, and WebShop across three model sizes. Our study comprises 132 training runs totaling 12,124.4 recorded H800 GPU-hours, with repeated evaluations over eight rollout seeds for the pretrained backbones and all eleven trained methods. Beyond final task performance, we examine training progress, stability, and measured computational cost. Our evaluation yields three key findings. First, gains over GRPO remain limited in scope, with no method consistently outperforming it across settings. Second, strong final performance can mask unstable training. Third, additional training cost does not consistently translate into better performance. We establish this benchmark to support fair, comprehensive comparison and guide future research toward reliable and cost-effective improvements in agent training. Project page: https://aim-uofa.github.io/Self-Distillation-AgentRL/

[105] Rationale Distribution Distillation via Flow Matching for Distributional Continuous Latent Reasoning cs.CL | cs.AIPDF

Mingyeong Kim, Gyusang Cho, Juho Lee, Giung Nam

TL;DR: RDD通过条件流匹配蒸馏同一问题的多条文本推理路径，生成分布式连续潜在推理序列，并在评测中提高答案覆盖率，尤其是在高阶数学任务上。

Details

Motivation: 从语言模型采样多条思维链能找到单次推理遗漏的正确解，但反复自回归生成长推理成本高；基于单一潜在推理点的连续方法又会让多次答案采样共享同一路径，可能限制推理多样性和答案覆盖率。

Result: 理由分布蒸馏（RDD）以多条文本推理路径为目标，训练固定长度潜在序列上的条件流，并通过同一问题下完整潜在理由之间的mixup扩展蒸馏目标。流模型以非自回归方式一次生成整段潜在序列，随后冻结语言模型以自回归方式基于采样的理由上下文生成答案。实验显示，该分布式推理器的答案覆盖率高于所评估的点值潜在推理基线，提升在高阶数学任务上尤为明显。

Insight: 对潜在理由建模为分布而非单个向量，可为同一问题的多次答案生成保留不同推理路径。摘要未给出任务列表、覆盖率数值、额外生成成本或推理路径质量指标。

Abstract: Sampling multiple chain-of-thought rationales from a language model can uncover correct solutions missed by a single attempt. However, these rationales are typically lengthy, making repeated autoregressive generation costly. Continuous latent reasoning offers a compact alternative, but point-valued methods condition repeated answer sampling on a single rationale, which can limit exploration of diverse paths and answer coverage. We thus propose rationale distribution distillation (RDD), training a conditional flow over fixed-length latent sequences by distilling from multiple textual reasoning paths. Furthermore, we expand the distillation targets through within-query mixup, interpolating between complete latent rationales for the same query. The flow nonautoregressively generates the entire latent sequence, and a frozen language model autoregressively decodes answers from sampled rationale contexts. Empirically, the resulting distributional reasoner achieves higher answer coverage than the evaluated point-valued latent reasoning baselines, particularly on advanced mathematical tasks.

[106] RCCM: Diagnosing Gains and Harms in Reasoning-Prompt Transfer cs.CLPDF

Yuqi Zhang, Di Zhang

TL;DR: RCCM通过同题配对答案与生成终止记录，评估推理提示迁移带来的收益、损害及执行成本，显示聚合准确率可能掩盖问题级差异和模型间相反效果。

Details

Motivation: 推理提示可能改善某一部署表现，却损害另一部署；只报告总体准确率或套用单一预算，可能无法判断收益来源，并混淆参考答案匹配与实际输出质量。

Result: RCCM（推理控制能力失配）在五种开权重模型部署、九种策略中，将相同题目的答案与生成如何结束的记录配对分析，并以同等预算的MATH500独立样本检验迁移。在额外60道题上，限额2,048令牌时，简洁推理使Phi在三个集合的自动答案匹配率提高，却显著降低Qwen的匹配率；作者审核的最终答案承诺带来较小且统计上未能确定的Phi收益。预留独立答案阶段也提高匹配率，但增加输入和调用成本。研究据此指出，压缩带来的表面收益可能有其他解释，而且答案匹配参考答案并不必然意味着最终确实交付了答案。

Insight: 提示迁移评估应同时报告模型部署、问题级得失、生成终止方式及输入/调用成本；自动参考匹配不能代替是否实际回答的核查。摘要中60题结果有模型间反向变化，且部分收益统计上未确定，不能概括为统一有效的提示策略。

Abstract: A reasoning prompt can improve one deployment and degrade another. RCCM (Reasoning-Control Capability Mismatch) examines these reversals by pairing answers to the same questions with records of how generation ends. Across five open-weight deployments and nine strategies, aggregate accuracy hides substantial question-level gains and harms; a common-budget MATH500 evaluation examines transfer on a separate sample. On 60 additional questions, concise reasoning improves Phi’s automatic answer matching at a 2,048-token cap across three collections, but sharply reduces Qwen’s. Author-reviewed final-answer commitments give a smaller, statistically unresolved Phi gain. Reserving an answer stage also improves matching, with additional input and call costs. These results show why a prompt benefit must be interpreted alongside its execution and evaluation: matching a reference answer need not mean delivering it, and an apparent compression benefit may admit another explanation. RCCM records this evidence for reproducible transfer comparisons.

[107] Frustratingly Easy Majority Voting Using Length Conditioning cs.CL | cs.AIPDF

Fiorenzo Parascandolo, Enver Sangineto, Xiaoyi Yu, Wenhui Tan, Jipei He

TL;DR: LCMV将思维链长度与正确概率的经验关系建模为逻辑函数先验，再仅用无标签测试数据自适应调整该先验以加权多数投票，在多个模型和推理基准上优于标准及其他长度、置信度聚合方法。

Details

Motivation: 多数投票通过独立采样多条思维链并选择最常见答案，提高推理准确率，但研究观察到更长思维链往往对应更低正确概率，因此不加区分地计票可能浪费额外推理计算。

Result: 长度条件多数投票（LCMV）把思维链长度与正确概率的经验偏置表示为由简单逻辑函数建模的先验，并在测试时只使用无标签测试数据调整该先验，无需微调语言模型。随后用调整后的先验对每个采样答案的投票加权。在多个大语言模型和推理基准上的实验中，LCMV持续优于标准多数投票，以及已有的长度和置信度聚合策略，同时保留多数投票简单、模型无关的特点。

Insight: 投票时利用思维链长度作为正确率先验，可在不更新模型参数的情况下重新分配推理时计算所得样本的权重。摘要未给出模型、基准及准确率增幅，也未说明先验估计在不同测试分布上的敏感性。

Abstract: Majority Voting (MV) is a simple and widely used strategy which improves the reasoning accuracy of Large Language Models (LLMs) by allocating additional inference-time computation. Specifically, in MV multiple Chain-of-Thoughts (CoTs) are independently sampled and the most frequent final answer is selected. In this work, we propose Length-Conditioned Majority Voting (LCMV), a Test-Time Training approach which improves MV leveraging an empirical observation that has recently been established in several studies: longer CoTs tend to be associated with a lower probability of correctness. We formulate this inductive bias as a length-conditioned prior probability, which is modeled by a simple logistic function. Moreover, we adapt this prior at test time using only unlabeled testing data and without fine-tuning the LLM. Finally, the adapted prior is used to weight the vote of each sampled answer. Extensive experiments across multiple LLMs and reasoning benchmarks show that LCMV consistently improves over both standard MV and existing length-based and confidence-based aggregation strategies, while retaining the simplicity and model-agnostic nature of MV. Our code is available at: https://github.com/aimagelab/LCMV.

[108] Beyond Benchmark Accuracy: A Diagnostic Test for LLM Chemical Prediction cs.CLPDF

Yanyi Su, Yu Zeng, Hongshuai Wang, Chenyan Wang, Zhifeng Gao

TL;DR: 该研究提出隐藏目标实体身份、改以已知源实体和显式结构编辑定义预测目标的化学推理诊断框架，以区分可迁移的结构—性质推理与目标线索或记忆依赖。

Details

Motivation: 现有化学预测基准通常直接提供目标实体身份，难以判断模型是否真正依据结构变化推理，还是利用目标相关上下文或记忆检索得到答案。

Result: 身份盲化推理诊断框架不直接给出目标实体身份，而是提供已知源实体及明确结构编辑操作；这样保留确定目标所需的信息，同时减少目标身份线索。在气味预测、分子性质预测、逆合成和反应产率预测等六项任务中，源实体与目标实体性质一致时，模型通常预测更好；提供明确源实体标签会进一步强化这种依赖。保持目标实体、结构变化和真实标签不变，只替换源实体标签时，部分模型的预测会系统性偏向被替换后的源标签。

Insight: 常规基准高分未必意味着模型具备可靠的结构—性质推理能力，可能部分依赖实体身份线索；控制源、目标和结构变换有助于诊断模型是否按实体变化更新预测。摘要未给出六项任务的具体指标或模型名称。

Abstract: LLMs have achieved strong performance on chemical prediction benchmarks. However, existing evaluation methods typically provide target entity identity information directly, making it difficult to determine whether model predictions arise from transferable structure-property reasoning capabilities or rely on target-related contextual information or memory retrieval. We propose the Identity-Blinded Reasoning Diagnostic framework to evaluate chemical prediction models when target entity identity information is hidden. In this framework, the target is no longer directly defined by its entity identity, but instead by a known source entity and an explicit structural edit operation. This setting preserves the information required to determine the target while reducing the opportunity for models to access target identity cues. We evaluate this framework across six tasks spanning odor prediction, molecular property prediction, retrosynthesis, and reaction yield prediction. The results show that models generally achieve better prediction performance when source and target entity properties are consistent. Providing explicit source entity labels further strengthens this dependence. Moreover, while keeping the target entity, structural change, and ground-truth label unchanged, replacing only the source entity label causes some model predictions to systematically shift toward the substituted source labels. These results indicate that high benchmark accuracy in chemical prediction tasks does not necessarily imply that LLMs possess reliable structure-property reasoning capabilities. Our diagnostic framework provides a controlled evaluation approach for testing whether models can genuinely update predictions according to entity changes. The framework can be extended to other AI for Science tasks, particularly those where targets can be defined through transformations of known entities.

[109] Not All Criteria Matter: Importance-Aware Criteria Weighting for Rubric-Based LLM Evaluation cs.CLPDF

Haocheng Yang, Licheng Pan, Yiming Dong, Xiaoxi Li, Yuan Lu

TL;DR: ICW通过大语言模型进行成对标准重要性比较，并检查、修正比较中的不一致，再由比较矩阵主特征向量推导评分权重，用于改进基于量规的模型评价。

Details

Motivation: 量规式评估通常把各项标准等权汇总，使次要或重叠标准与关键标准同等影响最终分数；直接要求模型一次性为全部标准赋权，又需要其做难以稳定完成的整体判断。

Result: 重要性感知标准加权（ICW）把整体权重判断分解为一系列成对重要性比较，检测并修正不一致比较，再从比较矩阵的主特征向量得到各标准权重。实验显示，ICW持续优于等权方案和有竞争力的加权方法；用于后续强化学习时，也得到表现更好的策略模型。

Insight: 分解式两两判断并显式处理比较不一致，可以缓解整体权重估计不可靠的问题；按重要性加权还可能改善下游策略训练。摘要未报告基准、提升幅度、比较模型及一致性修正的具体规则。

Abstract: Rubric-based evaluation assesses the responses of large language models (LLMs) by aggregating the verification results of explicit criteria, yet not all criteria matter equally. However, existing methods commonly aggregate the verification results with uniform weighting, which assigns minor and overlapping criteria the same weight as essential ones and thus produces misleading evaluation scores. Although some methods prompt an LLM to directly assign weights, direct weighting requires a holistic judgment over all criteria that LLMs struggle to make reliably. To address these limitations, we propose Importance-Aware Criteria Weighting (ICW), which derives the weights of criteria from pairwise importance comparisons made by an LLM. Specifically, ICW transforms the holistic judgment over all criteria into a series of pairwise importance comparisons, checks and revises inconsistent comparisons, and derives the weights from the principal eigenvector of the comparison matrix. Extensive experiments demonstrate that ICW consistently outperforms uniform weighting and competitive weighting methods, and translates into better policy models in downstream reinforcement learning.

[110] MemDuet: Learning Dual-Process Memory for Long-Context Reasoning cs.CLPDF

Jiangcheng Song, Haodong Jing, Yulin Mu, Lesong Tao, Jixin Wang

TL;DR: MemDuet用双过程记忆协调小模型并行筛选上下文证据与大模型按文档顺序验证、改写记忆，在三个长上下文基准上相较RL-MemAgent实现较高推理效率。

Details

Motivation: 循环记忆智能体使超长文档推理成为可能，但上下文越长，推理效果与推理效率之间的权衡越突出。

Result: MemDuet借鉴快慢思考，协调两个过程：小型语言模型（System 1）从原始上下文块中并行快速筛选证据；大型语言模型（System 2）按文档顺序验证并更新记忆。训练分三阶段：监督微调System 1进行证据选择，以GRPO训练System 2验证和重写记忆，再联合优化两种策略的协作。在RULER-HQA、LongBench v2和2WikiMultiHopQA上，结果显示随上下文变长仍具有较好的准确率—效率权衡。跨三个数据集的评估设置平均后，相较RL-MemAgent，端到端推理加速9.74倍，输出令牌减少73.91%。

Insight: 并行筛选与顺序验证分工，可减少长上下文处理产生的输出量，同时保持推理性能。9.74倍和73.91%是相对指定RL-MemAgent基线的平均值；摘要未给出准确率细项、硬件、记忆质量或各任务差异。

Abstract: Reasoning over infinitely long documents is becoming a reality with recurrent memory agents. However, increasing context length exacerbates the trade-off between reasoning performance and inference efficiency. Inspired by Kahneman’s account of fast and slow thinking, we propose MemDuet, a dual-process memory framework that learns to coordinate a small language model for fast, parallel evidence selection from raw context chunks (System 1) with a large language model for memory-update verification and memory updates in document order (System 2). We train MemDuet in three stages: supervised fine-tuning of System 1 for evidence selection, Group Relative Policy Optimization (GRPO) of System 2 for verification and memory rewriting, and joint optimization of both policies to coordinate selection and updating for long-context reasoning. Experiments on diverse long-context reasoning benchmarks (RULER-HQA, LongBench v2, and 2WikiMultiHopQA) demonstrate a favorable accuracy-efficiency trade-off as context length grows. Averaged across evaluation settings on the three datasets, MemDuet achieves an end-to-end inference speedup of 9.74x and an output-token reduction of 73.91% relative to RL-MemAgent.

[111] To Reason but Not to Stop: Understanding and Recovering Pruned Large Reasoning Models cs.CLPDF

Minh-Anh Nguyen, Nguyen T. Ha Lan, Xiyan Fu, Dung D. Le, Wei Lu

TL;DR: 该研究发现大模型剪枝后准确率下降往往与无法及时停止而非完全失去推理能力有关，并用终止方向引导的免训练激活操控改善停止行为和总体准确率。

Details

Motivation: 权重剪枝会降低大型推理模型准确率，但这种退化是否源于推理本身受损仍不明确；模型可能已经在推理中得出正确答案，却因重复循环而无法在令牌预算内终止。

Result: 随着稀疏度增加，被剪枝模型更容易超过令牌预算，常在推理中已出现正确答案后陷入重复循环；与此同时，模型仍能识别稠密模型本应停止的位置。作者发现，不同剪枝检查点中终止续写与循环续写的隐藏状态差异方向较一致，并据此提出免训练的终止引导激活操控（TGAS），在推理时将该方向加入残差流。在六个大型推理模型、三条剪枝流程及数学和代码基准上，TGAS改善终止能力和整体准确率，并减少重复推理及生成长度。

Insight: 剪枝造成的部分表面推理退化可能来自答案承诺和停止控制失灵，而非答案推导能力完全丧失；推理时注入一致的终止方向可作为无需训练的修复。摘要没有报告各模型的定量收益、剪枝率及激活操控的副作用分析。

Abstract: Weight pruning can degrade the accuracy of large reasoning models (LRMs), yet it remains unclear whether it damages reasoning itself. We find that much of this degradation stems from a failure to stop rather than to reason. As sparsity increases, pruned LRMs increasingly fail to terminate within the token budget, often after the correct answer has appeared in their reasoning, instead falling into repetitive loops, even though they still recognize where the dense model would stop. We further find that the hidden-state difference between terminating and looping continuations is consistent across pruned checkpoints, suggesting a shared direction associated with committing to an answer. Building on this, we propose Termination-Guided Activation Steering (TGAS), a training-free method that adds this direction to the residual stream at inference time. Across six LRMs, three pruning pipelines, and math and code benchmarks, TGAS improves termination and overall accuracy while reducing repetitive reasoning and generation length, showing that this failure is actionable.

[112] AtomSearch: Evidence-Grounded Tree Search for Agent Skill Optimization cs.CL | cs.AI | cs.LGPDF

Jia Tong, Senyou Deng, Min Peng, Jianfeng Pan

TL;DR: AtomSearch用局部原子规则编辑和技能状态树搜索优化智能体外部指令，并利用后续状态及结果记忆保留可能有价值的中间修订路径。

Details

Motivation: 智能体技能通常是可编辑的外部指令；一次修改多条规则不便检查，而只按局部编辑的即时分数筛选，又可能过早丢弃能通向更好技能的中间状态。

Result: AtomSearch将每条原子规则编辑与失败和成功执行、行为假设及适用范围关联；技能状态树搜索评估短编辑组合，并选择性保留可重新访问和扩展的可执行状态，结果记忆则用已观察到的修复和回归统计指导后续提议。在四项任务和五个目标模型上，使用deepseek-v4-flash时，AtomSearch在四项任务中的三项超过SkillOpt，包括LiveMathematicianBench提升9.68个百分点；SkillOpt最终技能文本长度是AtomSearch的2.3至19.7倍。67%的已完成搜索中，最佳验证状态经过一个在同深度下并非最高分的祖先节点。

Insight: 局部编辑配合树搜索可探索非贪心修订路径，并产生更精简的技能；最佳终态可能来自先前分数不占优的中间状态。摘要未给出所有模型和任务的详细分数，且结论包括额外离线评估所探索的替代状态。

Abstract: Agent skills adapt frozen models through editable external instructions. Revising several rules at once makes changes difficult to inspect, while judging each local edit only by its immediate score can discard useful intermediate states. We introduce AtomSearch, which keeps revision actions local while using subsequent skill states to guide search. Contrastive atomic editing links each primitive rule edit to failed and successful executions, a behavioral hypothesis, and an intended scope. Skill-State Tree Search (STS) evaluates short edit compositions and selectively retains them as executable states that can be revisited and extended. Outcome memory supplies later proposals with observed repair and regression statistics. We evaluate AtomSearch across four tasks and five target models. With deepseek-v4-flash, it exceeds SkillOpt on three of four tasks, including a 9.68-percentage-point gain on LiveMathematicianBench, and SkillOpt’s final skills contain 2.3-19.7 times as many characters. In 67% of completed searches, the best validation state passes through an ancestor that was not highest-scoring at its depth. These results show how local rule edits can support the exploration of useful revision paths and yield compact skills, with additional offline evaluations used to explore alternative states.

[113] FACES: Fine-grained Gated Semantic Alignment for Multimodal Emotional Support Conversation cs.CLPDF

Hang Ren, Peidong Wang, Yichen Gao, Wen Zhang, Jiayang Yu

TL;DR: FACES针对多模态情感支持对话提出细粒度门控语义对齐框架，通过非补偿式多维奖励融合和结构化思维链锚点进行令牌级信用分配。

Details

Motivation: 现有多模态情感支持系统仍容易给出浅层回答或不恰当支持策略，作者将问题归因于语义反馈薄弱、不同奖励维度间相互补偿，以及推理监督过于粗略。

Result: FACES整合多源奖励，构造多维语义与功能对齐信号；采用非补偿式门控融合减少不同奖励维度之间的抵消，并利用结构化思维链锚点进行令牌级信用分配。在控制回答长度的协议下，平均多模态大模型评价得分从3.61升至4.04，相对SOTA的成对偏好胜率为80.22%；相同协议下的人评偏好率为75.3%。三个外部数据集结果也支持其迁移性。

Insight: 奖励维度不能简单相互抵消，且较细粒度的推理锚点可改善训练中的责任分配；控制回答长度使比较更聚焦于质量。摘要未说明评分量表、参与人评人数和外部数据集具体结果，自动评价与人评的偏好率也应分开解读。

Abstract: In recent years, with advances in multimodal interaction technologies and the growing demand for intelligent emotional support, Multimodal Emotional Support Conversation (MESC) has emerged as an important task. However, existing systems still suffer from shallow responses and inappropriate support strategies due to weak semantic feedback, cross-dimension reward compensation, and coarse reasoning supervision. To address these challenges, we propose FACES, a fine-grained gated semantic alignment framework for MESC. Specifically, FACES integrates multi-source rewards to construct multidimensional semantic and functional alignment signals, employs a non-compensatory gated fusion mechanism to reduce cross-dimension reward offset, and leverages structured Chain-of-Thought (CoT) anchors to perform token-level credit assignment. Under a controlled response-length protocol, FACES improves the average MLLM-based evaluation score from 3.61 to 4.04 and achieves an 80.22% pairwise win rate over SOTA. Human evaluation under the same protocol yields a 75.3% preference rate. Results on three external datasets further support transferability. The code and dataset are available at https://github.com/OCT-ARR/arr.

[114] Why Generate a Click? Plug-in Decision Heads for Web Agents cs.CLPDF

Chengguang Gan, Yunhao Liang, Hanjun Wei, Qinghao Zhang, Zhixi Cai

TL;DR: 该方法从冻结视觉语言生成器隐藏状态中读取网页智能体动作，并用置信度级联在直接决策与原生成器续写之间切换，减少生成令牌而保持有竞争力的操作成功率。

Details

Motivation: 网页智能体通常将少数动作类型和有限候选控件也序列化为文本逐令牌生成，造成不必要的生成开销；但完全替换生成器决策又可能损害其灵活性。

Result: 可插拔决策头读取生成器处理目标和截图时产生的隐藏状态，预测动作类型、池化编号框内视觉令牌以选择目标，并指向已有文本选项或由生成器填写的WRITE槽位。高置信度时直接执行决策头动作，否则复用同一次前向传播的KV缓存让生成器继续解码。Qwen3-VL 4B和8B生成器在213K网页操作步骤上训练后，严格阈值下级联在七个离线测试集上相对生成器表现介于低0.3至高1.4个百分点，决策头覆盖12%至64%的步骤。宽松阈值下，未见Mind2Web网站步骤成功率分别提高3.1和1.8个百分点，但GUIAct和MiniWoB++最多损失2个百分点；WebArena任务成功率从12.5%升至13.8%（4B）、从13.6%升至14.6%（8B），生成令牌不到一半。与生成器联合训练决策头会使生成器自身步骤成功率最多下降4.9个百分点，冻结生成器上的插件头避免了这项代价。

Insight: 置信度级联允许常见、确定的动作走判别式快速路径，复杂动作则回退到原生成器；冻结主模型训练插件头可避免联合训练造成的能力退化。不同阈值在泛化测试集上的效益并不一致，某些GUI基准会受损，因此实际取舍取决于任务和置信度设置。

Abstract: Web agents built on vision language models decide every action by generating text such as click(12), although most of that text encodes a choice among a few action types and a few dozen marked elements. We read these choices directly from the hidden states that the generator computes while it reads the goal and the screenshot. Plug-in decision heads on a frozen generator predict the action type, pool the visual tokens inside each numbered box to pick the target, and point at a listed text option or at a WRITE slot that leaves the writing of new text to the generator. A confidence cascade executes the heads’ action when they are sure and otherwise lets the generator decode from the KV cache of the same forward pass. With Qwen3-VL 4B and 8B generators trained on 213k web steps, a strict threshold keeps the cascade between 0.3 points below and 1.4 points above the generator on seven offline test sets while the heads decide 12 to 64% of the steps. A looser threshold raises step success on unseen Mind2Web websites by 3.1 and 1.8 points, costs up to 2 points on GUIAct and MiniWoB++, and lifts WebArena task success from 12.5 to 13.8% (4B) and from 13.6 to 14.6% (8B) with less than half of the generated tokens. Training the heads jointly with the generator lowers the generator’s own step success by up to 4.9 points; heads on a frozen generator avoid this cost.

[115] Sparse Autoencoders for Mechanistic Interpretability in NLP: A Critical Survey of Recoverability, Interpretability, and Utility cs.CLPDF

Salima Lamsiyah, Adelaide Danilov, Oleksandr Marchenko Breneur, Aria Nourbakhsh

TL;DR: 这篇综述分析138项自然语言处理稀疏自编码器研究，按任务整理设计与特征操作，并综合特征可恢复性、可解释性、机制忠实度和行为效用的证据。

Details

Motivation: 稀疏自编码器被用于分解语言模型激活并发现潜在可解释特征，但不同研究的设计假设、评估目标和实验设置差异较大，导致其有效性的结论难以直接比较。

Result: 综述提出以任务为基础的分类体系，连接字典设计、特征操作和NLP功能；考察稀疏度分配、几何、数据覆盖和推理方式如何影响特征可恢复性；评估语义可解释性、机制忠实度及行为效用的证据；并综合多语言处理、检索、推理、分类和行为调控中的发现，突出目标函数、基线、监督和干预流程的作用。作者通过比较已发表结果调和看似矛盾的结论，指出未解决问题并提出更严谨评估方向。

Insight: SAE评价不能只看特征是否可命名，还需区分是否可恢复、解释是否忠实于模型机制，以及干预是否改变目标行为；实验目标和基线会显著影响结论。摘要没有展开各维度的具体结论及文献筛选标准，需结合完整综述判断证据强弱。

Abstract: Sparse autoencoders (SAEs) have emerged as a promising approach to mechanistic interpretability by decomposing language-model activations into sparse, potentially interpretable features. However, differences in design assumptions, evaluation objectives, and experimental settings complicate conclusions about their effectiveness. We present a critical survey of 138 studies on SAEs in natural language processing. Our contributions are fourfold: (1) we propose a task-grounded taxonomy connecting dictionary design, feature operations, and NLP functions; (2) we examine how sparsity allocation, geometry, data coverage, and inference affect feature recoverability; (3) we assess evidence for semantic interpretability, mechanistic faithfulness, and behavioral utility; and (4) we synthesize findings across multilingual processing, retrieval, reasoning, classification, and behavioral regulation, highlighting the roles of objectives, baselines, supervision, and intervention pipelines. Through comparative analyses of published results, we reconcile apparent disagreements, identify unresolved questions, and propose directions for more rigorous evaluation. An anonymous research register https://anonymous.4open.science/r/sae-research-register-C331/register.html accompanies the survey.

[116] TreeSpark: Learning to Draft the Trees You Verify for Speculative Decoding cs.CLPDF

Jihao Zhao, Qianyu Jiang, Shuaishuai Zu, Pengfei Li, Guanghuan Fang

TL;DR: TreeSpark为半自回归投机解码训练父状态条件化候选树，并在训练中重放扩展、剪枝和预算打包流程；相较DSpark改善平均接受长度和吞吐量。

Details

Motivation: 并行草稿模型能减少投机解码提案延迟，但早期不匹配限制每个候选块可接受长度；保留替代候选需要建模父状态与候选选择，而仅用参考序列训练并未直接监督这些行为。

Result: TreeSpark扩展半自回归DSpark，在一次骨干前向中构造父状态条件化候选树，并在训练时重放其扩展、剪枝和预算打包。存活边负对数似然按参考路径质量加权，受上限约束的覆盖hinge则鼓励在局部选择边界附近保留目标重要替代项；两类目标复用参考链目标分布，不增加目标模型前向。使用Qwen3-4B和8B，在九个通用基准及六个写作领域进行贪心解码评测。相较DSpark，平均接受长度提高23.4%至31.6%，单请求吞吐提高15.1%至25.0%；Qwen3-4B批处理吞吐提高12.6%至17.2%。固定注意力容量和推理策略时，所提监督还使Qwen3-4B平均接受长度约提高6.4%、系统吞吐提高4.2%至5.0%。

Insight: 投机候选树的父状态和替代路径应在训练时显式监督，且可复用参考链分布避免额外目标模型调用。报告收益覆盖不同模型、任务套件和批处理设置，增幅范围不能视为每个场景都达到的单一数值。

Abstract: Parallel drafters such as DFlash and DSpark reduce proposal latency, but early mismatches limit how much of each block can be accepted. Retaining alternatives introduces parent states and candidate choices that reference-conditioned training does not directly supervise. We introduce TreeSpark, a unified training and inference framework extending the semi-autoregressive DSpark architecture. It constructs parent-conditioned candidate trees from one backbone pass and replays their expansion, pruning, and budgeted packing during training. Survival negative log-likelihood weights retained edges by reference-derived path mass, while a capped coverage hinge promotes target-important alternatives near local selection boundaries. Both objectives reuse reference-chain target distributions without additional target forward passes. We evaluate greedy decoding with Qwen3-4B and Qwen3-8B on nine general benchmarks and six writing domains. Across targets and suites, TreeSpark improves mean acceptance length over DSpark by 23.4% to 31.6% and mean single-request throughput by 15.1% to 25.0%. Batched Qwen3-4B throughput improves by 12.6% to 17.2%. At fixed attention capacity and inference policy, the proposed supervision further improves mean acceptance length by approximately 6.4% and mean system throughput by 4.2% to 5.0% on Qwen3-4B.

[117] Scaling Multilingual Safety and Reasoning Evaluation through Reasoning-Guided Translation cs.CL | cs.AIPDF

Zahraa Al Sahili, Ioannis Patras, Matthew Purver

TL;DR: 该研究提出推理引导的多语种基准翻译框架，将策略选择与大规模生成分离，并用任务感知验证、定向修复和独立筛查构建七套资源、覆盖11种语言的评测集合。

Details

Motivation: 大语言模型正用于多种语言，但安全性和推理能力评测仍主要集中在英语。直接翻译基准虽可扩展评测，却难以在有害请求、数学推理和对话任务中保留任务结构及原意。

Result: 框架先用推理引导选择翻译策略，再进行大规模生成，并结合任务感知验证、针对性修复和独立质量筛查。作者据此构建与源基准对齐的评测集合，涵盖七项安全、对话和数学推理资源及11种语言；在需要修复的两个子集中，目标条目—语言组合覆盖率达到99.94%。开源模型评测发现，不同语言存在不同脆弱性，包括拒绝行为不一致，以及低资源语言中的显著推理退化。

Insight: 大规模多语种评测不仅需要覆盖率，也需按任务验证语义和结构，并记录修复质量；英语表现不能代表其他语言的安全和推理能力。99.94%仅指需修复的两个子集，摘要未列出具体语言、基准及模型成绩。

Abstract: Large language models (LLMs) are increasingly deployed across languages, yet their safety and reasoning capabilities remain predominantly evaluated in English. Translating existing benchmarks offers a scalable approach to multilingual evaluation, but preserving task-specific meaning across languages presents significant challenges, particularly for harmful requests, mathematical reasoning, and conversational interactions. We introduce a reasoning-guided translation framework for constructing multilingual evaluations designed to preserve the structure and intended meaning of diverse benchmark tasks. Our approach separates translation strategy selection from large-scale generation, combining reasoning-guided configuration selection with task-aware validation, targeted repair, and independent quality screening. Using this framework, we develop a source-aligned evaluation collection spanning seven safety, conversational, and mathematical reasoning resources across 11 languages. The resulting collection achieves 99.94% coverage of intended item–language pairs in the two subsets requiring repair. Evaluations of open-source LLMs reveal distinct language-dependent vulnerabilities, including inconsistent refusal behaviour and substantial reasoning degradation in lower-resource languages. These findings highlight the importance of task-sensitive benchmark construction and systematic quality assessment for understanding multilingual model behaviour beyond English.

[118] Taking the PULSE of Medical Reasoning: Step-Level Retrieval Timing for Knowledge-Grounded Inference cs.CLPDF

Danyang Zhao, Sendong Zhao, Yanrui Du, Haochun Wang, Ming Ma

TL;DR: PUlSE从模型跨层激活几何变化中训练轻量探针，在每个推理步骤结束时检测事实错误，并按需触发外部检索及步骤重生成；四个医学基准上准确率匹配逐步穷尽检索而调用次数减少72%。

Details

Motivation: 可靠的医学推理需要动态获取外部生物医学证据，但无差别检索会引入噪声和延迟；系统需在每一步判断内部知识是否可信或是否需要外部支持。

Result: 对后验轨迹的分析发现，错误推理步骤的跨层波动明显高于正确步骤。PUlSE据此使用内部表征中的跨层几何特征训练紧凑探针，在步骤完成时检测事实错误，并将其作为自适应触发器进行检索和步骤重生成。在四个医学基准上，PUlSE定时检索的准确率与每步穷尽检索相当，同时减少72%的检索调用；该方法还可迁移到未见法律领域。

Insight: 内部激活动态可作为检索时机的补充信号，不必仅依赖表面置信度；适时检索有望在维持准确率时降低调用量。摘要没有列出各基准绝对分数、探针误报情况或法律迁移的量化结果，“领域通用”仍是初步迹象。

Abstract: Reliable medical reasoning requires LLMs to dynamically access external biomedical evidence to improve factual trustworthiness and reasoning accuracy. However, indiscriminate retrieval can introduce noise and latency, raising a critical retrieval-timing problem: at each reasoning step, the system must decide whether the model’s internal knowledge is reliable or external evidence is needed. We propose PUlSE, a lightweight probing method that uses the model’s internal representations as intrinsic signals for step-level retrieval control. Our posterior trajectory analysis reveals that erroneous steps exhibit substantially higher inter-layer volatility than correct ones, suggesting unstable internal knowledge. Based on this finding, PUlSE trains a compact probe on inter-layer geometric features to detect factual errors upon step completion, and uses it as an adaptive trigger for retrieval and step regeneration. Across four medical benchmarks, PUlSE-timed retrieval matches exhaustive per-step retrieval in accuracy while reducing retrieval calls by 72%, and can transfer to an unseen legal domain, indicating potential domain-agnostic generality. Overall, our study provides an initial step toward shifting retrieval-trigger design from surface-level confidence estimates to internal activation dynamics for adaptive access.

[119] MMLA-RSI: Recursive Self-Improvement through RTT and RTMA cs.CL | cs.LGPDF

Junyi Zou, Avrova Donz

TL;DR: MMLA-RSI提出在问题未解决时递归改进智能体策略或权威记忆的两条路径，并给出受限可执行规则语言、提交器和独立评估机制；现有组件实验尚未证明递归链能带来额外在线收益。

Details

Motivation: 智能体可通过改变行动方式及保留经验内容，在未解决问题中改进自身；研究希望把策略更新和记忆适配本身也作为可改进对象，同时限定可执行改动、因果执行和资源消耗。

Result: MMLA-RSI包含两种记忆中介学习架构：推理时训练RTT更新策略状态Φ，推理时记忆适配RTMA更新权威记忆M；两条路径也让当前适配方法成为下一轮改进对象。当前数值更新器训练提出后继更新器的策略，当前记忆管理器选择后继提案过程可用的记录，独立获准的后继在下一代接替其角色。论文给出有界可执行规则语言、共享任务/提案接口及统一算法，并用固定解释器、可信提交器和独立评估器限制变更；状态版本、读取闭包和条件性质描述因果执行、已接受转移及有限工作量。已有组件研究显示，在四候选程序选择中保留LARC反馈，使两种训练初始化的期望错误率分别降低24.65和36.65个百分点；按时间顺序回放持续集成时，反馈绑定有效，但保留反馈反而增加损失；SQL研究相较未适配底座有明显进步，却未证明额外在线收益。

Insight: 论文重点是形式化规定策略与记忆递归更新机制及其安全边界；已报告数字来自各声明组件实验，作者明确表示有益的递归改进链及发现效率仍待评估，不能将组件效果当作完整递归方案已验证。

Abstract: An agent can improve its behavior within an unresolved problem by changing how it acts and which experience it retains. We propose MMLA-RSI, a recursive self-improvement scheme with two implementations in Memory-Mediated Learning Architecture: Reasoning-Time Training (RTT) changes the policy state $Φ$, while Reasoning-Time Memory Adaptation (RTMA) changes authoritative memory $M$. Each route also makes its adaptation method an object of improvement. A current numerical updater trains the policy proposing its successor; a current memory manager chooses the records available to the process proposing its successor. An independently admitted successor takes over the same role in the next generation. We give bounded executable rule languages, shared task/proposal interfaces, and one algorithm for either route or their composition. The RTT instance changes scalar schedules in a clipped-momentum update. The RTMA instance chooses NULL or a complete-row write with possible eviction. A fixed interpreter, trusted committer, and independent evaluator bound what can change. State versions, read closures, and conditional properties describe causal execution, accepted transitions, and finite work. Existing numerical-component studies motivate the construction. In four-candidate program selection, retaining LARC feedback updates reduces expected error by 24.65 and 36.65 percentage points for two trained initializations. In chronological continuous-integration replay, feedback binding is positive while retention increases loss. Completed SQL studies improve substantially over an unadapted substrate but do not establish the required additional online benefit. These results characterize their declared components. The two recursive routes and their joint realization are specified here; their beneficial recursive chains and discovery efficiency remain to be evaluated.

[120] Anuvani-Diarization: Zero Shot Speaker Diarization and Annotation Conventions Across 22 Languages cs.CLPDF

Stephen Fernandes, Narayan Choudhary

TL;DR: Anuvani-Diarization针对印度22种法定语言的说话人分离进行零样本系统评测，并以不确定性感知的银标注适配端到端分割模型，在IndicDiarBench上达到16.78%的时长加权DER。

Details

Motivation: 印度多语言对话常在一个话轮内切换语言、自由重叠，并发生于电话、会议和媒体环境；现有说话人分离工作缺乏覆盖全部22种法定语言的系统研究，而谁在何时说话是转写、语音助手和媒体分析的重要基础。

Result: 作者在IndicDiarBench上系统研究22种语言，并提出Anuvani-Diarization，以不确定性感知银监督适配自监督端到端分割模型。零样本评测将其与九种近期系统比较：在全部1,164段录音上，时长加权DER为16.78%，是作者实际运行的系统中最低，但仍次于最佳已发表结果16.0%；在22种语言中有14种领先三个最强对手。模型在六个国际基准上与其母模型表现相当。研究还发现，基准的句子级标注约定会令不同系统的DER相差1.9至4.1个百分点；从其它印度语转写中学习的约定无法迁移。

Insight: 多语言说话人分离成绩不仅取决于模型，标注粒度和约定本身也会显著改变DER；跨基准比较需明确标注规则。16.78%是本研究实际运行系统中的最佳结果，不是已发表结果中的绝对最佳；不同语言的具体DER未在摘要中列出。

Abstract: India’s 22 scheduled languages are spoken by over a billion people in conversations that mix languages, often within one turn, overlap freely, and take place over telephones, in meetings, and in media. Knowing who spoke when, the task of speaker diarization, is essential to speech applications for such conversation: voice agents conversing with several people at once, speaker attributed transcription of meetings and calls, contact center analytics, and media monitoring. We present a systematic study of speaker diarization across all 22 languages on IndicDiarBench and introduce Anuvani-Diarization, which adapts a self-supervised end-to-end segmentation model to Indian conversation with uncertainty aware silver supervision. Evaluated zero shot alongside nine recent diarization systems, it reaches a duration weighted diarization error rate (DER) of 16.78% on all 1,164 recordings, the lowest of all systems we ran and second only to the best published result (16.0%), and leads the three strongest rivals in 14 of 22 languages. It matches its parent on six international benchmarks. We also show that the benchmark’s utterance level annotation convention is a hidden variable worth 1.9 to 4.1 DER points, depending on the system, and that a convention learned from other Indian transcriptions does not transfer.

Diana Turmakhan, Aseem Srivastava, Vivek Gupta, Iryna Gurevych, Thamar Solorio

TL;DR: SCOUT采用视觉候选筛选加多向量重排、并行的页面/文档摘要检索及跨模态查询修正，在四个视觉文档检索基准上降低查询延迟并提升NDCG。

Details

Motivation: 视觉文档中的表格、图形和布局结构承载复杂证据，检索需将查询与页面匹配；现有视觉语言检索器查询成本随语料规模增长，难以扩展。

Result: SCOUT将检索分为两条路径：视觉路径先用轻量父级检索器筛选小候选池，再由更强多向量重排器处理候选；语义路径并行搜索离线生成的页面和文档层级摘要，以提供互补信号。跨模态查询修正使用语义分数调整视觉查询表征后进行最终排序。在四个主要基准、与六个基线比较时，相较最佳基线查询延迟最高降低80.7倍、平均降低28.8倍；所有基准上的NDCG最高提升7.8%。

Insight: 级联候选检索与摘要语义信号让昂贵视觉重排只作用于少量页面，跨模态修正再融合两路证据。最高80.7倍和平均28.8倍是相对最佳基线的查询时延改善，摘要未给出索引/预处理成本和具体基准分项结果。

Abstract: Retrieving information from visually rich documents requires matching queries against pages that contain complex evidence in tables, figures, and layout-dependent structures. Current vision-language retrievers address this but incur query-time costs that grow with corpus size and are impractical to scale. We propose SCOUT, a cascaded two-track retrieval framework that separates retrieval performance from exhaustive search. The visual track first uses a lightweight parent retriever to filter the corpus to a compact candidate pool, then applies a stronger multi-vector reranker only to those candidates. In parallel, a semantic track retrieves over hierarchical page and document summaries generated offline to provide a signal complementary to visual matching. The outputs are fused through cross-modal query refinement, which uses semantic scores to adjust the visual query representation before final ranking. We evaluate SCOUT on 4 major benchmarks against 6 baselines and observe a significant query-time latency improvement up to 80.7x (28.8x on average) relative to the best baseline, while exceeding state-of-the-art retrieval performance by up to 7.8% NDCG across all benchmarks.

[122] From Triage to Impact: A Multi-Hop Reasoning Benchmark for Explainable Persian Hate Speech cs.CLPDF

Ghazal Kalhor, Sima Kamandloo, Mehrsa Shamsian, Behnam Bahrak

TL;DR: 该研究提出波斯语仇恨言论多跳可解释分析基准，涵盖内容分流、目标、仇恨策略、道德基础、证据、叙事和严重度，并发现细粒度推理任务表现更差。

Details

Motivation: 波斯语属于相对低资源语言，细粒度仇恨言论分析缺乏充足标注数据和计算资源；内容检测之外，还需识别对象、策略、证据、潜在叙事及危害等级。

Result: 基准覆盖内容分流、目标识别、仇恨策略与道德基础分析、文本证据抽取、伤害性叙事推断和严重程度评估。对先进大语言模型的评测显示，任务越需要细粒度语义和推断，表现通常越差；专有模型通常优于开放权重模型，而推理型模型没有表现出稳定优势。加入中间推理步骤显著改善严重程度预测，相较一次性评估。分析还发现，煽动暴力或伤害与更高严重等级联系最强；政治立场目标尤其与颠覆型道德框架相关。

Insight: 对仇恨言论的可解释审核需把目标、策略、证据和严重度拆开评估，单一标签不足以刻画推理难度；显式中间步骤对严重度判断有帮助。摘要未给基准规模、模型清单及具体分数，关联分析不表示因果关系。

Abstract: Hate speech has become increasingly prevalent on social media, raising concerns about its detection, interpretation, and moderation. Persian, a relatively low-resource language, lacks sufficient annotated data and computational resources for fine-grained hate speech analysis. In this study, we introduce a fine-grained, multi-hop benchmark for explainable Persian hate speech analysis, covering content triage, target identification, hate tactic and moral foundation analysis, textual evidence extraction, harmful narrative inference, and severity assessment. By evaluating state-of-the-art large language models (LLMs), we find that performance generally declines as tasks require more fine-grained semantic and inferential reasoning. Proprietary models generally outperform open-weight models, while reasoning-oriented models show no consistent advantage. Incorporating intermediate reasoning steps substantially improves severity prediction compared with one-shot assessment. Our analysis further reveals that Incitement to Violence or Harm is most strongly associated with higher severity, while political-affiliation targets are particularly associated with subversion-based moral framing. Overall, this work provides insights into LLM-based hate speech analysis and supports more accountable moderation of Persian-language social media. The benchmark is publicly available at https://github.com/kalhorghazal/From-Triage-to-Impact.

[123] Cortex: Consolidating Context into Parametric Memory cs.CL | cs.AI | cs.CV | cs.LG | cs.MAPDF

Jintian Zhang, Feng He, Xinnian Liang, Ziwen Xu, Haoming Xu

TL;DR: Cortex将上下文带来的性能增益压缩进可合并的低秩或结构化前馈参数更新，并以预生成查询预测上下文未来用途；在50次顺序事实编辑后，结构化版本恢复88.9%的上下文增益并保留99.8%的非目标能力。

Details

Motivation: 上下文可提升大语言模型表现，但移除上下文后增益可能消失。记忆巩固旨在把上下文带来的收益内化进参数，同时保持非目标能力，并统一考察上下文编辑、技能学习和行为引导。

Result: 作者构建包含五类任务的测试平台，评估单次、批量及顺序更新下的巩固与保留，并提出Cortex：生成前瞻查询以预测上下文的可能用途，再将上下文条件输出蒸馏为可合并的低秩或结构化前馈网络更新。在4B至120B稠密及混合专家骨干、纯文本和多模态模型的大多数测试设置中，Cortex位于经验巩固—保留Pareto前沿。对14B模型进行50次顺序事实编辑后，Cortex-Structural恢复88.9%的上下文诱导增益，同时保留原有非目标性能的99.8%。

Insight: 上下文知识可通过预期未来使用的查询蒸馏进参数，同时显式衡量目标增益与非目标遗忘，且更新可合并。88.9%/99.8%对应特定14B模型、50次顺序事实编辑；大多数设置处于Pareto前沿并不意味着所有情形均最优。

Abstract: Context can improve large language model performance, but these gains may be lost after context removal. Inspired by biological systems consolidation, we formulate Memory Consolidation (MC) as internalizing these gains while preserving non-target capabilities, connecting context-specified editing, skill learning, and behavioral steering under a common objective. We introduce a five-task-family testbed measuring consolidation and retention under single, batch, and sequential updates. We propose Cortex, which generates prospective queries to anticipate uses of context and distills context-conditioned outputs into mergeable low-rank or structural feed-forward network updates. Across 4B–120B dense and mixture-of-experts backbones, including both text-only and multimodal models, Cortex lies on the empirical consolidation–retention Pareto frontier in most evaluated settings. After 50 sequential factual edits on a 14B model, Cortex-Structural recovers 88.9% of the context-induced gain while retaining 99.8% of original non-target performance.

[124] Same Claim, Different Interpretations: How LLM Agents Resolve Ambiguity in Scientific Claims cs.CLPDF

Delip Rao, Ahmed Muharram, Chris Callison-Burch

TL;DR: Claim Cards要求科学主张验证智能体在取证前显式记录九项解释及其来源状态，实验显示解释字段的主动变更会改变约三分之一主张的判定及部分工具调用。

Details

Motivation: 自然语言科学主张常有多个合理解释，验证智能体往往默默选定一种；基准将其判断与专家标签比较，却不记录双方采用的解释，导致分歧难以归因于证据还是理解，也可能浪费计算去核查不一致的主张。

Result: Claim Card在取证前用九个字段记录验证器的主张解释，并把每项标为明确陈述、推断或默认。作者让GPT-5.4智能体针对60条材料科学和生物医学专家标注主张，在有卡片、无卡片及五次运行间固定同一卡片三种条件下共运行900次。超过40%的卡片字段未被原文明确陈述；增加卡片约使每次运行令牌量和耗时上升十分之一，但未可测地改变与专家标签的一致性。模型自身解释会跨运行变化，但同一主张内这种变化未可测地对应判定变化。相反，主动改变固定卡片中的一个字段（如量词改为全称或提高支持阈值）会改变约三分之一主张判定，约为偶然预期的七分之一频率之差，两个编辑均p<0.001；24条材料科学主张的计算工具实验中，提高阈值也改变了智能体要求工具计算的内容。

Insight: 判定对刻意设定的解释条件敏感，因此应连同解释一起报告主张验证结论；基准也可公开专家标签背后的解释。显式记录卡片本身未提升专家标签一致性，还增加约10%令牌和时间；样本规模、领域及工具实验范围有限。

Abstract: Co-scientists and agentic scientific claim verifiers are increasingly used to assess claims across the sciences. Natural-language scientific claims, written for human experts, are often underspecified and so admit several defensible interpretations. Such verifiers usually pick one, often tacitly, and benchmarks score their verdicts against expert labels without recording the expert’s interpretation or the verifier’s in a comparable form. This leads to disagreements with expert labels that cannot be traced to the evidence or the interpretation, and to compute spent on unchecked interpretations. We introduce Claim Cards to make such interpretations explicit in the reasoning itself. A Claim Card records a verifier’s interpretation as nine fields before evidence gathering, each marked stated, inferred, or default. To test whether an agent’s interpretation can change its verdict, we ran a GPT-5.4 agent five times on each of 60 expert-labeled materials-science and biomedical claims with a card, without one, and with one card frozen across runs (900 runs). Over 40% of card fields were not marked stated, and a card added about a tenth to a run’s GPT-5.4 tokens and time without measurably changing agreement with expert labels. The agent’s own interpretations varied between runs, although within a claim this variation did not measurably track the verdict. A deliberate change to one field of the frozen card, however, making the quantifier universal or the threshold for support stricter, changed the verdict on about a third of the claims, against about one in seven expected by chance (p < 0.001 for each edit). On 24 materials-science claims run with computational tools, the stricter threshold also changed what the agent asked those tools to compute. We therefore argue that verdicts should be reported with their interpretations and that benchmarks could publish the interpretation behind each label.

[125] MolLean: A Process-Verifiable Language for Chemical Reasoning cs.CL | cs.CE | cs.PLPDF

Jiatong Li, Yatao Bian

TL;DR: MolLean将化学推理表示为显式分子状态上的可执行变换，以Lean式分层内核检查结构编辑和断言，并通过工具接口在生成时拒绝无效操作。

Details

Motivation: 化学思维链可能包含虚构的分子结构和性质判断；仅靠自由文本解释不容易逐步验证其化学承诺是否成立。

Result: MolLean以分层Lean式内核验证分子读数上的状态转移和断言，覆盖基础图编辑至复合转化；类型化见证协议将原生结构检查与外部测量分开。MolLean-MCP提供有状态工具接口，在生成过程中暴露转移、检查及读数，模型据反馈决定下一步，拒绝的操作不改变状态。系统支持单次轨迹执行、整轨迹修订和交互式推理三种模式；作者在12个分子生成、编辑、优化和反应任务的8,800个匹配样例上比较这些模式与直接思维链。Qwen3.6-27B使用整轨迹修订在全部12项任务上超过直接思维链；MolLean-MCP提供逐步验证反馈，在反应任务上效果更好。

Insight: 把结构和性质承诺转为可执行状态断言，能在化学推理过程中及时发现并修订无效步骤；整轨迹修订和逐步交互工具反馈在不同任务上互有优势。摘要未给各任务具体分数及验证器覆盖的化学规则范围，外部测量仍需另行提供见证。

Abstract: Chemical chain-of-thought can contain hallucinated structural and property claims. We thereby introduce MolLean, a process-verifiable language that grounds chemical reasoning in an explicit molecular state. A layered Lean-based kernel checks state transitions and assertions over molecular readouts, from primitive graph edits to compound transformations. Meanwhile, a typed witness protocol separates native structural checks from externally supplied measurements. We further introduce MolLean-MCP, a stateful tool interface that exposes these transitions, checks, and readouts during generation: the model receives feedback to decide its next action, and rejected actions leave the state unchanged. MolLean supports one-pass trace execution, whole-trace refinement, and interactive reasoning through MolLean-MCP. We evaluate these three modes with direct chain-of-thought on 8,800 matched examples across 12 tasks spanning molecular generation, editing, optimization, and reactions. With Qwen3.6-27B, whole-trace refinement outperforms direct chain-of-thought on all 12 tasks. MolLean-MCP complements whole-trace refinement with stepwise verification feedback, reaching better performance in reaction tasks. Together, these results highlight an executable foundation for chemical reasoning, in which explicit chemical commitments can be checked and revised rather than remaining solely in free-form explanations.

[126] Equal CER, Unequal Damage: Severity-Weighted Character Error Rate for OCR cs.CL | cs.AI | cs.CVPDF

Nguyen Nguyen, Yongyi Zang

TL;DR: semCER保留字符错误率的对齐和分母，但用大语言模型评估的字素级严重度加权编辑错误，使OCR分数能区分轻微拼写差错与损害更大的字符错误。

Details

Motivation: 字符错误率是OCR和视觉语言模型常用指标，却把一个小拼写错误与错误人名同等计罚，未反映错误对读者的实际影响。

Result: semCER不做词语分段，保留CER的编辑对齐和分母，为每个字素编辑错误赋予由大语言模型裁判给出的严重度。整段转写的规范化CER保持汇总评分，在整体读者表现方面与semCER相当或更好；semCER则可将评分拆解到具名编辑。英语、越南语和中文的逐编辑读者评分与严重度权重相关，按读者严重性排序时高危错误靠前。在CER与semCER分歧的样本中，英语和中文读者更常支持semCER，越南语中两者相当。16种语言比较显示，重音符号或声调符号错误在西班牙语中的惩罚近乎为零，在泰卢固语中则接近错字母的严重程度。可计数真实词的设置中，通用视觉语言模型的错字母错误显著高于随机水平，传统流程接近随机水平。作者发布6,100万条裁判编辑、汇总读者评分及蒸馏评分器。

Insight: 严重度加权可使OCR评估更贴近不同字符错误的语言特定影响，同时保留可解释的编辑级分解；但整体转写排名未必优于规范化CER。权重来自大语言模型裁判并依语言而变，需注意裁判偏差；摘要未给各语言完整数值。

Abstract: Character Error Rate (CER), the standard metric for OCR and vision-language models (VLMs), charges a typo as much as a wrong name. We introduce semCER, which keeps CER’s alignment and denominator and charges each grapheme edit a severity from an LLM judge, with no word segmentation. Normalized CER keeps the score of a whole transcription, where it tracks readers as well as semCER or better, and semCER breaks that score down into named edits. The charges track readers’ ratings edit by edit in English, Vietnamese, and Chinese and put the edits readers rate most severe near the top of a sorted list. On pairs drawn where CER and semCER disagreed, readers side with semCER more often than with normalized CER in English and Chinese, and equally often in Vietnamese. Across 16 languages, the judge charges a wrong diacritic or tone mark almost nothing in Spanish but nearly a wrong letter’s severity in Telugu. Where we can count real words, a general VLM’s wrong letter forms one far above chance while a classical pipeline’s stays near it. We release the 61 million judged edits, the aggregated reader ratings, and the distilled scorer at https://github.com/nguyenx2t/semcer.

[127] AdaRSI: On-Demand Recursive Self-Improvement for Embodied Agents cs.CL | cs.ROPDF

Peidong Wang, Ying Chang, Zhiming Ma, Xiaocui Yang, Shi Feng

TL;DR: AdaRSI让具身智能体先改进技能与调用框架，再针对持久失败判断问题在调用方式还是执行器能力，并仅对仍不可靠步骤按需微调。

Details

Motivation: 预训练视觉—语言—动作模型常在未见长时程任务中途失败；只改被冻结执行器外部的harness不能补足缺失动作，而不区分失败源地微调整个执行器又可能浪费资源。

Result: AdaRSI先由编码智能体改进技能和harness，再从保存状态重试失败子步骤以归因持续失误，只对仍不可靠的子步骤微调；示范由系统自行收集，并复用先前任务经验。在RoboCasa365全部50个目标任务上，以GR00T N1.5为执行器且不使用人工示范，VLA在三个套件均有提升，未见组合任务成功率从4.6%升至13.8%。与微调全部子步骤相比，按需微调成功率略高，但仅耗用28%的GPU时间和22%的自采示范；没有harness的微调训练更多而收益更小。

Insight: 先修复技能和调用流程，再把参数更新限于被验证仍失败的动作，可减少具身自我改进的训练开销。结果来自50个RoboCasa365任务和指定执行器；摘要未给各套件分项提升及真实机器人验证。

Abstract: Pretrained vision-language-action models (VLAs) often fail midway through unseen long-horizon tasks. Recursive self-improvement (RSI) offers a remedy, but embodied RSI methods either refine the harness around a frozen executor and so cannot add a missing motion, or train the executor on persistent failures without asking whether a failure lies in how the executor is called or in what it can do. We ask when a self-improving embodied system should change the weights of its executor, and propose AdaRSI, an on-demand RSI framework for embodied agents. A coding agent first improves its skills and harness, then attributes persistent failures by retrying failing sub-steps from saved states, and fine-tunes only the sub-steps that remain unreliable, with demonstrations it collects itself and experience carried over from earlier tasks. On all 50 target tasks of RoboCasa365, with GR00T N1.5 as the executor and no human demonstrations, AdaRSI improves the VLA on all three suites and raises its success on unseen composite tasks from 4.6% to 13.8%. Compared with fine-tuning every sub-step, it reaches slightly higher success while using only 28% of the GPU time and 22% of the self-collected demonstrations, and fine-tuning without a harness trains more yet gains far less.

[128] VASPO: Self-Distillation with Privileged Value Estimation cs.CL | cs.AI | cs.LGPDF

Fei Wu, Zhenrong Zhang, Jianshu Zhang, Jun Du

TL;DR: VASPO在PPO中同时使用特权自教师和评论家：评论家按预测续写回报计算令牌级优势，自教师用有界概率比调节选定的正优势，从而改善数学推理准确率。

Details

Motivation: 在线策略自蒸馏提供密集的特权教师监督，但教师信号反映局部令牌偏好，而非无引导学生续写的期望回报。已有方法常把GRPO用于更新方向、自教师用于缩放；作者寻求在PPO中更有效地整合二者。

Result: 作者观察到互补的位置动态：特权信息提升评论家在回答末尾的价值预测精度；自教师引导则在生成初期较强、中段减弱、末尾再次增强。VASPO让自教师与评论家在学生生成前缀处评估相同特权信息，评论家根据预测续写回报计算令牌级PPO优势，自教师通过有界概率比调节选定的正优势。在六个数学推理基准上，Qwen3-4B和OLMo3-7B变体的平均准确率分别比PPO高2.59和1.81个百分点；在Knights and Knaves上，VASPO在受测方法中平均准确率最高。

Insight: 价值估计与特权自教师偏好在推理轨迹不同位置具有互补作用，联合建模有望比单纯将教师分数当作缩放信号更有效。摘要未提供各基准具体分数、方差和额外训练成本。

Abstract: On-policy self-distillation provides dense supervision for reasoning models via a privileged self-teacher. However, this supervision reflects local token preferences rather than the expected return of an unguided student continuation. Recent methods combine this signal with GRPO. They use GRPO for update directions and the teacher for signal scaling. However, we demonstrate a more effective integration within PPO. Specifically, we identify complementary positional dynamics: privileged information enhances a critic’s value-prediction accuracy toward the response’s end, whereas self-teacher guidance is strong initially, drops mid-generation, and rebounds finally. These insights motivate Value-Augmented Self-Distillation Policy Optimization (VASPO), wherein a self-teacher and critic evaluate identical privileged information at student-generated prefixes. The critic computes token-level PPO advantages from predicted continuation returns, while the self-teacher modulates selected positive advantages via bounded probability ratios. Across six mathematical reasoning benchmarks, VASPO improves mean accuracy over PPO by 2.59 and 1.81 percentage points on Qwen3-4B and OLMo3-7B variants, respectively, and achieves the highest mean accuracy among evaluated methods on Knights and Knaves. Our code is available at https://github.com/cii030/VASPO.

[129] PrismaCoder: Pushing the Boundaries of Open Multimodal Code Intelligence through Decomposed Rubric Synthesis cs.CL | cs.AI | cs.CV | cs.LG | cs.SEPDF

Qiushi Sun, Jingyang Gong, Yang Liu, Qiaosheng Chen, Zhangyue Yin

TL;DR: PrismaCoder以分解式可核验量规同时评估程序正确性、构建质量和渲染视觉效果，将同一量规用于数据筛选和强化学习奖励，并据此构建多模态代码数据集和模型。

Details

Motivation: 多模态代码智能需要模型生成图表、网页、动画和半结构文档，但开源数据的数量、质量和制作流程受限；单纯执行成功/失败、代码相似度或任务专属验证器均不能全面衡量代码是否正确、构建良好且视觉呈现合适。

Result: 数据管线PrismaForge用合成层级量规把上述因素拆成可检查标准，并同时用于监督语料筛选和视觉编码任务强化学习。作者据此构建PrismaCoder-2M，称其为迄今最多样、规模最大的开放多模态代码智能数据集；使用该数据训练并发布9B和35B模型。论文报告PrismaCoder在开放模型中大幅领先，并可与领先专有系统竞争；分析还显示量规管线能提升不同骨干的多模态编程表现。

Insight: 同一套覆盖代码和渲染结果的量规可贯穿数据筛选与策略训练，缓解单一执行信号、代码相似度或专用验证器各自的盲区。数据规模及开放SOTA、与专有模型竞争等为作者报告，摘要未提供基准、分数、模型比较细项和量规人工验证结果。

Abstract: Multimodal code intelligence connects the symbolic world of programs with the visual world their execution creates. Interest in this capability is burgeoning, as models are increasingly asked to produce charts, webpages, animations, and semi-structured documents. Recently, proprietary models have pushed far ahead, producing interactive artifacts even from a text description or a screenshot alone. Yet their data and training remain closed, and open progress is held back by the quantity and quality of available data and by the pipelines and methods for producing it. Quality is the harder of the two, since a sample must be correct as a program, well built, and above all visually right once rendered. No existing signal covers all three. Execution often returns just a pass or fail, code similarity does not map to the visual output, and task-specific verifiers do not generalize. To push open progress further, we start from the data side with PrismaForge, a hierarchical data pipeline centered on a synthesized rubric that decomposes these factors into checkable criteria. The same rubric serves as both filter and reward: it curates the supervised corpus, then drives reinforcement learning on visual-coding tasks. Leveraging PrismaForge for data synthesis and filtering, we build PrismaCoder-2M, the most diverse open dataset for multimodal code intelligence and the largest to date. On the model side, we train PrismaCoder-9B and PrismaCoder-35B on this data and release both. They lead the open state of the art by a wide margin and rival leading proprietary systems. Our analyses further show that the proposed rubric-based pipeline improves multimodal coding performance across model backbones. We release our code and data at https://qiushisun.github.io/PrismaCoder-Home/.

cs.AI [Back]

[130] GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning cs.AI | cs.CL | cs.CVPDF

Qingsong Xie, Jiahao Tian, Jiacheng Tang, Zhifeng Li, Madalina Ciobanu

TL;DR: GroundGUI构建覆盖桌面、网页和移动端的ScreenRef指代定位数据集，并以监督微调接强化学习训练GUI grounding模型，在多项屏幕定位基准上取得较高成绩。

Details

Motivation: GUI智能体需将自然语言意图精确映射到屏幕可操作控件，但尽管桌面、网页和移动端基准数量不少，高保真且覆盖多环境的定位数据仍然不足；单纯监督微调的泛化有限，强化学习还面临奖励稀疏。

Result: ScreenRef包含586,000张GUI截图和超过633,000条带框或点标注的自然语言指代实例，覆盖桌面、网页和移动端，包括文本识别、视觉匹配、空间理解和拒绝场景。作者提出蒸馏到强化学习（D2RL）流程，依次用ScreenRef对Qwen3-VL-8B-Instruct进行监督微调和D2RL训练，得到GroundGUI-8B。该模型在ScreenSpot-V2、ScreenSpot-Pro、OSWorld-G、MMBench-GUI L2和UI-Vision上分别达到95.2%、63.9%、65.4%、86.8%和38.3%。在8B规模模型中，相较基于开源数据训练的模型提升明显，表现可与基于闭源数据的模型相比，部分情况下更优。

Insight: 大规模多环境指代数据与监督蒸馏、强化学习结合，可提升GUI元素定位能力并处理稀疏奖励。不同基准上的数值不可直接比较；摘要未给训练成本、各数据子集的性能或闭源数据模型的逐项分数。

Abstract: Constructing robust GUI agents relies on multimodal visual grounding: the ability to precisely map natural language intents to actionable on-screen components. Despite abundant desktop, web, and mobile benchmarks, high-fidelity resources tailored for diverse environments are surprisingly scarce. To bridge this gap, we introduce the Screen Referring Grounding Dataset (ScreenRef), a comprehensive GUI grounding dataset consisting of GUI screenshots paired with natural language referring expressions and box or point annotations. Spanning desktop, web, and mobile domains, ScreenRef comprises 586K screenshots and over 633K referring expression instances, covering tasks such as text recognition, visual matching, spatial understanding, and refusal scenarios. To boost the model’s grounding performance, we propose the Distillation-to-Reinforcement Learning (D2RL) method to address the limited generalization of supervised fine-tuning and the sparse reward problem in reinforcement learning. Utilizing ScreenRef, we train Qwen3-VL-8B-Instruct via sequential SFT and D2RL training, yielding GroundGUI-8B. GroundGUI-8B achieves 95.2% on ScreenSpot-V2, 63.9% on ScreenSpot-Pro, 65.4% on OSWorld-G, 86.8% on MMBench-GUI L2, and 38.3% on UI-Vision. Among 8B-scale models, it produces substantial gains over models trained on open-source datasets, with performance comparable or even superior to models trained on closed-source data. Code, models, and datasets are available at https://github.com/PrentisAI/GroundGUI.

[131] ActiveEvidence: Decision-Focused Evidence Graphs with Verifiable Acquisition Gaps cs.AI | cs.CV | cs.LGPDF

Miaobo Hu, Shuhao Hu, Xiaobo Guo, Xin Wang, Bokun Wang

TL;DR: ActiveEvidence将多模态主动取证建模为可认证决策问题，用证据交互图和决策加权边界聚焦可能改变动作的交互项，并在达到ε决策证书时停止继续查询。

Details

Motivation: 多模态智能体需判断是否值得获取视觉证据、查询哪个候选或分辨率，以及何时继续交互已不能改变决定；问题还涉及免费的元数据与付费观察边界、随机向量成本和冻结执行轨迹。

Result: 反事实证据交互图（CEIG）表示单项证据价值、带符号二阶交互及有向条件伤害，并对未解决交互维护显式分数区间；决策加权边界目标优先收紧可能改变动作身份的范围。间隙导向细化只评估可能取代当前最佳证据获取选择的交互项，当ε决策证书表明剩余不确定项在声明容差内不能改变选定动作时停止。证书只保证相对于固定学习得分的策略一致最优性，语义质量另以冻结后标签测量。配对续跑学习付费预览的下游价值，在线操作成本过滤器与独立有限策略族轨迹认证分开；采集监视器和独立实现验证器将证书绑定冻结轨迹。640例按384/128/128划分训练、验证和测试，控制器得分0.842、grounding F1为0.816、证据召回率0.873，平均接受1.74次调用、视觉令牌286.5K、p95延迟742毫秒。证书密集重放中动作一致率0.992、证书率0.988，每决策评估19.6项昂贵交互，低于密集评估的191.4项。

Insight: 该证书保证的是相对冻结模型评分的决策稳定，不等价于语义正确性；通过仅细化会改变决策的交互项，能显著减少昂贵证据评估。结果基于640例和声明的容差及策略族，证书密集重放指标不代表外部场景上的无条件最优。

Abstract: A multimodal agent must decide whether visual evidence is worth acquiring, which candidate or resolution to query, and when further interaction can no longer change its decision. We study this problem under a strict free-metadata/paid-observation boundary, stochastic vector costs, and a frozen execution trace, and treat it as decision-certifiable active evidence acquisition. A Counterfactual Evidence Interaction Graph (CEIG) represents unary evidence value, signed second-order interaction, and directed conditional harm while maintaining explicit score enclosures for unresolved interactions; a decision-weighted enclosure objective tightens the bounds that can change action identity. Gap-directed refinement evaluates only interactions that can displace the incumbent acquisition and stops once an $ε$-decision certificate shows that unresolved terms cannot change the selected action beyond a declared tolerance. The certificate is model-relative: it verifies policy-consistent optimality under the pinned learned score, and semantic quality is measured separately through post-freeze labels. Paired continuation rollouts learn the downstream value of paid previews, an online operational cost filter is separated from independent finite-policy-family trajectory certification, and an acquisition monitor with an independently implemented verifier binds every certificate to the frozen trace. On 640 cases split into 384/128/128 training, validation, and test cases, the controller reaches task score 0.842, grounding F1 0.816, evidence recall 0.873, 1.74 accepted calls, 286.5K visual tokens, and 742ms p95 latency. Dense replay of issued certificates shows 0.992 action agreement and a 0.988 certificate rate while evaluating 19.6 instead of 191.4 expensive interaction terms per decision.

[132] PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition cs.AI | cs.CVPDF

Weichen Lyu, Chong Xia, Mingyu Dong, Long Xu, Shengjun Zhang

TL;DR: PhySGA把3D物体组合建模为智能体在物理仿真中的交互构造，由装配智能体负责全局几何/运动规划、批评智能体依据接触动力学做闭环修正，并以可复用技能记忆减少探索。

Details

Motivation: 仅靠语言模型预测物体坐标或扩散先验合成组合图像，依赖静态数字空间先验，难以处理精确悬挂、重力沉降和隐藏容纳等复杂组合；这些任务需要全局规划、局部精确对齐和物理模拟的交互过程。

Result: PhySGA支持刚体、关节体和可变形物体的交互式组装。协作前馈—反馈架构中，装配智能体进行几何和运动学推理、全局步骤规划及粗调；批评智能体依据接触动力学诊断仿真状态并进行细粒度闭环修正。动作路由器把语义规划和分析映射为仿真器可执行的物理原语；任务专属自进化技能库则将历史试错反馈蒸馏为可复用经验，以提高成功率并减少探索次数。Isaac Sim实验显示，PhySGA在关系保真度、物理合理性和视觉质量方面显著优于既有方法。

Insight: 将全局计划、仿真诊断、物理动作执行和试错记忆结合，弥补纯语言/视觉模型缺乏具身物理经验的问题。摘要未给出具体场景数量、成功率、探索次数下降幅度或真实机器人验证，结论限于Isaac Sim实验。

Abstract: 3D object composition is pivotal to digital content creation and robot simulation, while also serving as a critical testbed for physical intelligence in foundation models. Previous methods either leverage large language models to directly predict object coordinates, or utilize generative diffusion priors to synthesize composite images for visual alignment, both of which rely on static priors in digital spaces. However, these methods consistently struggle with complex compositions such as precise hanging, gravity-driven settling and hidden containment, as these tasks require interactive construction processes involving global planning, fine-grained alignment, and physical simulation. To address these challenges, we propose PhySGA, a Physics-Space Grounded Agentic Framework for 3D composition via agent exploration and physical simulation, enabling the universal interactive assembly of rigid, articulated, and deformable objects. Directly applying vanilla LLMs or VLMs to this task proves insufficient, as current models inherently lack grounded physical understanding and interactive construction experience. To overcome this limitation, we design a collaborative feedforward-feedback architecture: an Assembly Agent focuses on geometric and kinematic reasoning for global step planning and coarse adjustment, while a Critic Agent reasons over contact dynamics for simulator state diagnosis and fine-grained closed-loop correction. Furthermore, Action Routers map semantic planning and analysis onto executable physical primitives within the simulator, while a task-specific Self-Evolving Skill Library distills historical trial-and-error feedback into reusable experiences, boosting success rates and minimizing exploration attempts. Extensive experiments within Isaac Sim demonstrate that PhySGA significantly surpasses existing methods in relation fidelity, physical plausibility, and visual quality.

[133] MemeTrace: A Multimodal LLM-Based Agent for Safety-Aware Meme Provenance Analysis cs.AI | cs.CL | cs.CYPDF

Bo Shao, Yihan Ma, Yiting Qu, Michael Backes, Yang Zhang

TL;DR: MemeTrace是多模态大模型智能体，用于追踪网络迷因的来源、传播、文化象征及潜在风险；在Meme100评测中优于视觉语言模型基线，特别提升对虚假信息和敏感内容的识别。

Details

Motivation: 网络迷因常承载虚假信息和宣传内容，且随新闻事件快速演化、强依赖语境，增加平台审核难度。既有研究往往只根据单张图像判定安全与否，无法分析来源、传播路径、文化含义及社会风险。

Result: 作者提出MemeTrace，用多模态智能体自动追踪新兴迷因的来源与潜在风险，并在包含100个真实迷因的Meme100上结合人工标注和自动指标评估。结果显示，MemeTrace整体显著超过视觉语言模型基线，对不安全迷因尤其是涉及虚假信息和敏感内容的检测准确率更高；面对视觉扰动也保持稳健。

Insight: 迷因审核需要超越单图安全分类，将图像内容与传播背景、文化符号及潜在危害联系起来。摘要未给出各项准确率、具体扰动类型或迷因溯源证据质量，样本规模也仅为100个真实迷因。

Abstract: Online memes are often carriers of unsafe content such as disinformation and propaganda. Their rapid evolution in response to news events and strong dependence on contextual information make it difficult for platforms and moderators to detect and moderate them effectively. Moreover, existing moderation studies typically classify memes as safe or unsafe based on individual images, lacking the ability to perform broader provenance analysis, i.e., where a meme originates, how it spreads, what cultural symbolism it represents, whether it poses potential risks to society, etc. To bridge this gap, we introduce MemeTrace, a multimodal LLM-based agent that automatically traces the provenance and potential risks of emerging memes. We evaluate MemeTrace on Meme100, a dataset of 100 real-world memes, using both human annotation and automatic metrics. The results demonstrate that MemeTrace substantially outperforms the VLM baseline. More importantly, MemeTrace achieves higher accuracy in detecting unsafe memes, especially those involving disinformation and sensitive content, and remains robust under visual perturbations.

[134] Seeing, Maintaining, and Learning: The Evolution of Multimodal Agent Memory cs.AI | cs.CL | cs.ROPDF

Minghao Guo, Qingyue Jiao, Xiujin Liu, Jianhong Pang, Ruimeng Yang

TL;DR: 这篇综述提出多模态智能体记忆的双轴分析框架：一轴描述信息如何形成与表示，另一轴按固定策略、稳定更新和自我演进区分记忆管理层级。

Details

Motivation: 多模态智能体需从异质复杂数据中持续积累有用信息，以支持长时程任务和终身交互；系统还需跨会话保持连续性、适应用户与环境变化，并基于经验改进记忆管理策略。

Result: 框架的形成与表示轴考察保留哪些信息及如何编码，包括模态专属嵌入、文本/结构记录、潜在和参数化表示；记忆管理轴划分三级：T1静态记忆复用固定内容，T2动态记忆按稳定策略更新，T3自我演进记忆则允许更新策略本身。作者据此归纳设计模式，并讨论如何平衡来源忠实度与抽象、维持时间有效性和来源可追溯性、让记忆调用有可恢复证据支撑，以及随时间演化管理策略；同时总结挑战和未来方向。

Insight: 智能体记忆不只涉及存储格式，还包括管理策略是否随经验演进；两轴视角有助于比较多模态记忆设计并梳理真实性、时效性和可追溯性要求。摘要未说明系统性综述的检索方法、纳入文献规模或各类设计的证据强度。

Abstract: Multimodal models and agents have emerged to enable AI systems to learn from and interact with the real world more like humans by integrating information across multiple modalities. However, enabling multimodal agents to continually acquire useful information from complex, heterogeneous multimodal data remains a significant challenge as they move toward long-horizon tasks and lifelong settings. Addressing this challenge requires effective memory mechanisms that can maintain continuity across sessions, adapt to changing users and environments, and refine memory-management policies through accumulated experience. We introduce a two-axis analytical framework for multimodal agent memory structured around two key questions: how multimodal information is formed and represented (Axis I, Formation and Representation), and how its management adapts with accumulated experience (Axis II, Memory Management). Axis I, Formation and Representation, characterizes what information is retained and how it is encoded (e.g., modality-specific embeddings, textual and structured records, latent and parametric representations) to support subsequent reasoning and action. Axis II, Memory Management, distinguishes three tiers: T1 Static Memory reuses fixed memory; T2 Dynamic Memory updates memory through a stable policy; and T3 Self-Evolving Memory updates memory through an evolving policy. Based on this framework, we synthesize recurring design patterns and derive principles for balancing source fidelity with abstraction, maintaining temporal validity and provenance, grounding memory use in recoverable evidence, and evolving memory policies over time. Furthermore, we discuss the challenges and potential future directions for the memory mechanism of multimodal agents.

[135] $τ$-Emotion-Bench: Exposing the Interaction Fragility of LLM Agents through Real-World User Emotions cs.AI | cs.CLPDF

Rishitosh Kumar Singh, Amir Saeidi, Shamanthak Hegde, Shrinidhi Kumbhar, Chitta Baral

TL;DR: τ-Emotion-Bench在十个领域中以受控情绪变化评估工具调用智能体，并提出Tracer生成任务和交互轨迹；实验显示平均任务成功率未必意味着能稳定完成不同用户交互。

Details

Motivation: 长时程工具任务中，智能体失败不只来自工具调用错误，也可能因为无法有效与用户互动；现有基准多假设用户合作且行为稳定，情绪变化对可靠性的影响尚未充分评估。

Result: τ-Emotion-Bench通过情绪条件化用户交互评估智能体，同时保持底层任务目标不变，覆盖十个领域。Tracer是可扩展的智能体数据生成流程，可构造有依据且符合策略约束的任务，并通过智能体—用户—环境交互收集轨迹；不满用户可终止低效互动，以过滤过度依赖用户的轨迹并鼓励有效工具使用。两种用户模拟器实验显示，前沿智能体仍不可靠，平均任务成功与稳定完成任务之间有显著差距。Tracer监督持续改善不同规模Qwen3，能迁移到未见领域及τ-Bench、τ-Trait。行为分析显示，较高成功率与工具执行和必要用户追问之间更好的平衡有关。

Insight: 评估工具智能体时应同时考察用户情绪变化下的稳定完成率，而不只看平均成功率；交互效率需要平衡工具调用与必要澄清。摘要未给十个领域清单、成功率差距数值或用户模拟器与真实用户的一致性证据。

Abstract: In long-horizon tool-calling tasks, LLM agents can fail not only because of tool-use errors, but also because of ineffective interaction with users. Yet existing benchmarks largely assume cooperative and behaviorally stable users, leaving the effect of emotional variation on agent reliability underexplored. We introduce $τ$-Emotion-Bench, a ten-domain benchmark for evaluating tool-calling agents under controlled emotion-conditioned user interactions while preserving the underlying task objective. To scale both benchmark construction and agent training, we introduce Tracer, a scalable agentic data-generation pipeline that constructs grounded, policy-valid tasks and collects trajectories through an interactive agent–user–environment harness. By allowing dissatisfied users to terminate inefficient interactions, the harness provides an interaction-aware signal that filters trajectories with excessive user dependence and favors effective tool use. Experiments with two user simulators show that frontier agents remain unreliable, with substantial gaps between average task success and consistent task completion. Tracer-generated supervision consistently improves Qwen3 models across scales, generalizes to unseen domains, and transfers to $τ$-Bench and $τ$-Trait. Behavioral analyses further show that higher task success is associated with a better balance between tool execution and necessary user follow-up. Overall, $τ$-Emotion-Bench and Tracer provide a scalable framework for evaluating agent reliability under diverse user behaviors and improving tool-calling agents through interaction-aware supervision.

[136] Model What Matters: Decision-Guided Selective World Modeling for Language Agents cs.AI | cs.CL | cs.LGPDF

Maolin Ran, Minda Chen, Di Huang, Wei Xiong, Fei Huang

TL;DR: DGS-WM在语言智能体强化学习中只选择与后续决策相关的观测单元作为世界模型监督目标，并根据预测置信度调整其权重，以减少对无关完整观测的均匀建模。

Details

Motivation: 强化学习通常提供稀疏轨迹级任务奖励，却不直接监督动作对环境状态转移的影响；已有策略与世界模型联合训练常把所有环境观测都作为目标，忽略不同内容对后续决策的重要性差异。

Result: 决策引导选择模块根据观测单元对后续策略回答的支持程度筛选世界模型训练目标；置信度自适应加权模块再根据模型对所选目标的预测置信度调整监督强度。两者组成决策感知辅助世界建模损失，并与同一策略模型上的RL损失联合优化。在覆盖单跳/多跳问答和交互式网页任务的多个基准上，DGS-WM在不同模型规模及RL算法下均有稳定提升，相较完整观测世界建模方法表现更稳健有效。

Insight: 辅助世界模型应优先预测可能改变未来行动或回答的信息，并按置信度分配监督，而非平均建模所有观察。摘要没有给出基准名称、具体提升值或观测选择误差分析，结论限于所测问答和网页任务。

Abstract: Reinforcement learning provides a direct mechanism for optimizing task objectives in large language model-driven agents, but task rewards are typically sparse trajectory-level signals that only evaluate task success, without directly supervising action-conditioned environment transitions, leaving the model with limited explicit understanding of action consequences and environment dynamics. Recent work introduces auxiliary supervision through policy and world modeling co-training, yet typically treats complete environmental observations uniformly as world modeling targets, overlooking the varying decision relevance of observation content. We propose DGS-WM (Decision-Guided Selective World Modeling), a decision-guided policy-world modeling co-training approach for language agents. DGS-WM employs a Decision-Guided Observation Selection component that filters observation units with decision value as world modeling targets based on their support for subsequent policy responses, and a Confidence-Adaptive Weighting component that adaptively adjusts supervision strength according to the model’s prediction confidence on selected targets. Together, these components form a decision-aware auxiliary world modeling loss, jointly optimized with the RL loss on the same policy model. Across multiple benchmarks covering single-hop/multi-hop question answering and interactive web tasks, DGS-WM achieves consistent improvements under different model scales and RL algorithms, demonstrating more stable and effective performance compared to full-observation world modeling methods.

[137] Learning Perception to Action Rules through Reinforcement Learning for Theory-of-Mind Reasoning cs.AI | cs.CLPDF

Soyoung Oh, Nursulu Sagimbayeva, Nicholas Jennings, Paulina Hussein, Mehwish Alam

TL;DR: 该研究用强化学习训练模型显式生成感知—信念—行动之间的简洁if–then规则，以弥补模型虽能推断他人心理状态却未将其用于行为预测的Theory-of-Mind断层。

Details

Motivation: 大语言模型可能正确推断行动者的心理状态，却在预测或判断其后续行为时未使用该推断；研究考察显式连接感知、信念与行动的规则能否改进心智理论推理。

Result: 作者生成简洁if–then规则来表达感知到行动的关系，并以GRPO训练Qwen2.5和Llama3模型，在四个Theory-of-Mind基准上评估。带规则生成的GRPO优于提示方法、监督微调和思维链推理。由至少3B规模的大模型生成的规则还可迁移，为GPT-4o-mini提供知识并改善其下游表现。

Insight: 显式的感知—行动规则有望把心理状态识别转化为可用于行为预测的条件知识，并可跨模型迁移。摘要未列四个基准名称、各模型规模及具体提升值，也未说明规则正确性和复杂度如何验证。

Abstract: In Theory-of-Mind (ToM) reasoning, large language models may correctly infer the agent’s mental state but fail to use that inference when predicting or judging the agent’s subsequent actions. In this work, we investigate whether explicitly connecting perception, belief, and action with rules improves ToM reasoning. We generate concise \textit{if–then} rules that express relations between perception to action and use Group Relative Policy Optimization (GRPO) to train Qwen2.5 and Llama3 models across four ToM benchmarks. GRPO with rule generation outperforms prompting, supervised fine-tuning, and think reasoning. Moreover, rules generated by larger models ($\geq$3B) provide transferable knowledge that improves downstream performance of GPT-4o-mini. These findings suggest that explicit rules help models bridge the reasoning gap in ToM and support knowledge transfer across models.

[138] Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering cs.AI | cs.CL | eess.ASPDF

Yi Wang, Tianzi Wang, Tong Lei, Dahan Wang, Peter Bell

TL;DR: 该研究比较直接全模态模型、描述生成后推理和多智能体三种文本接口，考察它们如何影响文本提示优化器改进音视频问答的能力。

Details

Motivation: 自动提示优化在文本大模型上较有效，但音视频理解系统需要合适的文本接口，才能把多模态推理暴露给文本优化器；不同接口可能改变优化难度和可解释性。

Result: 作者在音视频问答任务中比较三种架构：单个全模态大语言模型直接推理、先生成描述再推理的系统，以及由主智能体协调子全模态模型的智能体架构；实验使用Qwen3-Omni和Gemini。直接提示优化的收益依赖模型；描述—推理和智能体系统提供更可解释的优化接口，但更难优化。作者还分析了提示优化影响的案例。

Insight: 多模态系统的提示优化效果不只取决于优化算法，也受系统如何将视觉/音频证据转成可操作文本接口影响；接口越可解释不代表越易优化。摘要未给出基准规模、具体得分、错误分析细节或各架构调用成本。

Abstract: Automatic prompt optimization (APO) has shown strong effectiveness for text-based LLMs and LLM systems, but its application to audio-visual understanding systems requires suitable textual interfaces through which multimodal reasoning can be exposed to text-based optimizers. We investigate how the design of textual interfaces affects prompt optimization for multimodal reasoning, on the audio-visual question answering task. We compare three interface designs, including a direct inference system consisting of a single omni-modal large language model (OmniLLM), a captioner-reasoner system, and an agentic architecture in which a primary agent orchestrates subagent OmniLLMs. Experiments with Qwen3-Omni and Gemini show that direct prompt optimization provides model-dependent gains; the captioner-reasoner system and the agentic system expose more interpretable optimization interfaces but are harder to optimize, where error analysis of cases affected by optimization is conducted. Our study highlights textual interface design as an important factor in making prompt optimization effective for omni-modal reasoning systems. Our implementation details are specified in GitHub repo.

[139] TreeFlex: Agents Navigating Their Own Search Trees cs.AI | cs.CLPDF

Dongzhuo Li, Fangzhou Cheng, Weiwei Li, Kevin Han, Haixu Ma

TL;DR: TreeFlex让语言模型智能体自主选择搜索树中要恢复、分支、验证或停止的状态，并联合训练导航、任务执行和提案审查，以缓解平坦ReAct上下文累积的陈旧信息干扰。

Details

Motivation: ReAct智能体把观测、中间结果和失败尝试不断堆进单一上下文；上下文增长后，过时或偏离当前路径的信息占用有限容量并遮蔽有用证据。

Result: TreeFlex由harness把中间状态及简短摘要保存为搜索树节点；同一语言模型在反思角色中查看摘要、选择要恢复的节点及指令，在执行角色中恢复到达该节点的路径并使用任务工具，之后保存新节点或提出解答，再由反思角色批准或退回其它节点。策略可自行加深、分支、回访、验证或停止，不依赖固定遍历顺序或节点分数。作者用树感知GRPO联合训练导航、任务动作、检查点保存及提案审查，并以任务级结果奖励加过程奖励。在相同活动上下文限制下，4B模型经小规模RL后，深度研究基准准确率为48.8%，高于平坦ReAct的41.5%和FoldAgent的42.8%，Pass@8约高10个百分点；SWE-bench Verified中，三套系统均从同一9B模型经RL训练，TreeFlex解决54.9%任务，高于FoldAgent的43.3%和其逐步变体的45.2%。

Insight: 把轨迹状态外化为可导航搜索树，使智能体可以回访有用分支并丢弃平坦上下文中的无关历史；执行与提案审批共同学习。深度研究结果来自4B小规模RL，SWE-bench使用9B同源RL设置，两个基准的成功率不可直接横向比较。

Abstract: A ReAct-style agent accumulates observations, intermediate results, and failed attempts in a single context. As this context grows, stale and off-path information consumes its limited capacity and obscures relevant evidence, making focused reasoning increasingly difficult. We introduce TreeFlex, a framework in which the agent’s own policy decides where to search. The agent records each intermediate state, with a short summary, as a node in a search tree maintained by the harness. The policy is a single language model that acts in two roles. In the Reflection role, it has a global view of the tree through these summaries and picks a node to resume, together with an instruction. In the Execution role, the harness restores the path that led to that node, and the model carries out the instruction with the usual task tools until it saves a new node or proposes a solution, which Reflection then approves or sends back to another node. Through these choices, the policy decides whether to deepen the current line, branch from or revisit an earlier state, verify a proposal, or stop, without a fixed traversal order or a score for each node. We train navigation, task actions, checkpointing, and proposal review jointly with a tree-aware adaptation of GRPO, using task-level outcome rewards augmented by process rewards. After small-scale RL of a 4B model, with the same active-context limit for all methods, TreeFlex reaches 48.8% accuracy on a challenging deep-research benchmark, versus 41.5% for flat ReAct and 42.8% for FoldAgent, and its Pass@8 is about ten points higher than either. On SWE-bench Verified, with all three systems trained with RL from the same 9B model, TreeFlex resolves 54.9% of tasks, versus 43.3% for FoldAgent and 45.2% for its step-wise variant.

cs.CR [Back]

[140] DarKnight: Retrieval-Guided Agentic Framework for Breaking Dark Web CAPTCHA Gates cs.CR | cs.CVPDF

Binghui Wu, Yeo Zi Yi, Darren Tan, Manit Baser, Levente Csikor

TL;DR: DarKnight在本地GPU上以双信号检索、图像专属预处理和站点通行反馈协同处理暗网市场验证码，减少对第三方视觉语言模型服务和逐站微调的依赖。

Details

Motivation: 网络威胁情报人员抓取暗网市场时需应对多种验证码。逐站微调难扩展，商业视觉语言模型API则受服务商政策、Tor出口封禁、监管或模型更新影响，并产生反复调用成本。

Result: DarKnight设计为运行在单工作站GPU和研究者Tor爬虫中，使用本地开放权重小型视觉语言模型，不依赖第三方服务或逐市场训练。每次处理验证码时，它用相似图像中过去成功与失败案例的双信号检索构造图像专属预处理流程，并从网站通过/拒绝结果学习。四个真实暗网市场的案例研究显示，智能体工具选择比单纯增加模型规模更有效。一个可部署开放权重模型结合DarKnight后，在防护最强市场达到83.2%，比基础模型高37.2个百分点，并超过Claude Opus 5的44%。它挽回基线失败案例的48.2%，退化成本为7.6%，表明选择性工具调用可避免统一预处理造成的大部分性能损失。

Insight: 局部检索经验和按图像选择工具可在本地小模型上提高验证码处理能力，避免对第三方服务可用性的依赖。结果来自四个暗网市场案例，摘要未给样本量、伦理/授权评估或不同验证码类型的误判率；这里仅按论文摘要作研究结果概述。

Abstract: Cyber Threat Intelligence (CTI) investigators who monitor dark web marketplaces for leaked credentials and breach listings must pass the diverse CAPTCHAs that operators deploy to block automated collection. Existing solvers either need unscalable per-site fine-tuning or rely on commercial Vision-Language Model (VLM) APIs, which surrender operational sovereignty: provider policies, Tor-exit blocking, government regulation, or model updates outside the investigator’s control can halt or alter the solver overnight, and per-call costs recur with every session and retry. We present DarKnight, a self-improving agentic framework designed to run on a single workstation GPU inside an investigator’s Tor crawler and solve CAPTCHAs with small, locally hosted open-weight VLMs that no provider decision can withdraw, without per-market training or third-party services. For each CAPTCHA, DarKnight retrieves successful and failed past attempts on similar images (dual-signal RAG), composes an image-specific preprocessing pipeline, and learns from the site’s pass/fail verdict. In a case study on four real-world dark web marketplaces, agentic tool selection outperformed parameter scaling. A deployable open-weight VLM with DarKnight reached 83.2% on the most heavily defended market, 37.2 percentage points above its base model, outperforming even the frontier Claude Opus~5 (44%). DarKnight recovered 48.2% of baseline failures at a 7.6% degeneration cost, indicating that selective tool use can avoid much of the degradation caused by uniform preprocessing.

cs.LG [Back]

[141] Integrated Novelty Detection Systems: From Sensor Networks to Multi-Novelty Computer Vision cs.LG | cs.CVPDF

Irené Tematelewo

TL;DR: 该工作分别研究雨量站堵塞异常检测和计算机视觉多类型新颖性识别：评估既有天气传感器质控方法、提出三种融合概率故障检测与一致性诊断的技术，并发布NOVEL-SS数据集和DCA基线。

Details

Motivation: 雨量计堵塞会损害降雨观测可靠性并影响粮食安全和灾害管理，既有质控方法对成簇故障传感器检测不足；计算机视觉系统又常只处理单一新颖类型，难以适应多种未知情况。

Result: 在天气传感器部分，作者比较CMM、PSWQ（Fz-filter）、核回归和高斯方法，指出它们尤其难以检测成簇故障，并提出三种结合概率故障检测与一致性诊断的质控技术，以期更及时发现堵塞并减少误报。在视觉部分，作者基于Snapshot Serengeti相机陷阱数据构建包含多种新颖情况的Novel Snapshot Serengeti（NOVEL-SS）数据集，并提出DCA（检测、刻画、适应）多新颖性基线系统。

Insight: 该工作把新颖性检测从单点异常扩展到故障群体以及多类型视觉新颖性，并强调检测后还需刻画和适应。摘要未给天气方法的数据集、误报/检出指标、新数据集规模或DCA具体性能，因此结果主要是问题诊断、方法和资源介绍。

Abstract: Novelty detection is crucial in various technological and scientific domains. Its importance spans from ensuring the reliability of sensor networks to enhancing the adaptability of computer vision systems. As AI systems become increasingly sophisticated and complex, effective anomaly detection is essential for maintaining reliability and accuracy. This work addresses novelty detection in weather sensor networks and computer vision. In weather sensor networks, particularly for monitoring rainfall, detecting blocked rain gauges can significantly impact data reliability, food security, and disaster management. This work evaluates four existing quality control methods for detecting blocked rain gauges and demonstrates their limitations, particularly in detecting clusters of faulty sensors. By comparing methods such as the Conditional Mixture Model (CMM), PSWQ (Fz-filter), Kernel Regression, and Gaussian Method, we identify their shortcomings and propose three novel quality control techniques that integrate probabilistic fault detection and consistency-based diagnosis framework to improve timely detection of blocked sensors, while reducing false alarms. In the realm of computer vision, current systems often fail to handle multiple types of novelty due to their focus on single-novelty scenarios. We highlight the need for integrated systems capable of handling multiple types of novelty. To support this, we introduce the Novel Snapshot Serengeti (NOVEL-SS) dataset, derived from the Snapshot Serengeti camera trap data, which includes various forms of novelty. We also present the DCA (Detect, Characterize, and Accommodate) baseline system, designed to handle multiple novelty by detecting, characterizing, and accommodating them. This work aims to advance the robustness and adaptability of novelty detection systems across both weather sensor networks and computer vision applications.

[142] Knowledge Distillation from Large Reasoning Models to Compact Student Models: A Case Study on the John O Bryan Mathematics Competition cs.LG | cs.AI | cs.CLPDF

Gaurab Baral, Aaditya Khanal, Yangyang Tao, Junxiu Zhou

TL;DR: 该案例研究用DeepSeek-R1生成John O’Bryan数学竞赛思维链，再以LoRA在Apple Silicon上蒸馏到Qwen2.5-7B；将训练限制为200次迭代后，学生准确率比基础模型提高4.76个百分点。

Details

Motivation: 大型推理模型能力较强但资源需求高，研究考察能否用历史大学数学竞赛题和教师思维链，将其推理能力蒸馏到紧凑学生模型，同时分析短训练和回答长度对数学表现的影响。

Result: 作者以2011—2025年John O’Bryan数学竞赛题构造双智能体思维链语料，用MLX和LoRA微调Qwen2.5-7B。基础模型准确率64.67%，DeepSeek-R1教师为91.40%。首次1,000迭代训练严重过拟合，验证损失在第200步最低后持续上升，因此后续运行五个不同随机种子的200步实验。学生竞赛准确率均值69.43%、标准差0.17%，较基座提高4.76个百分点；MATH-500准确率73.1%、标准差0.18%。按六个推理长度级别分析时，准确率从R1的69.43%（平均220词）降至R6的41.9%（平均31.2词），双人限时环节对令牌削减最敏感。

Insight: 在该小规模竞赛数据和硬件设置下，适度CoT蒸馏能提升7B模型并迁移到MATH-500，但训练轮数过多会过拟合；回答长度与准确率的关联也需考虑任务时限和题型。长度级别同时体现推理内容变化，摘要不能据此单独断言缩短文本导致准确率下降。

Abstract: This paper investigates knowledge distillation from a large reasoning model (DeepSeek-R1) to a compact student model (Qwen2.5-7B). Using historical problems from the John O’Bryan Mathematics Competition at Northern Kentucky University (2011-2025), we build a Chain-of-Thought (CoT) training corpus through a dual-agent framework. The dataset is used to fine-tune the student model with Low-Rank Adaptation (LoRA) on Apple Silicon hardware using the MLX framework. The base Qwen2.5-7B model achieves 64.67% accuracy on competition problems, while the DeepSeek-R1 teacher achieves 91.40%. An initial 1,000-iteration training run revealed severe overfitting, with validation loss reaching a minimum at iteration 200 before rising steadily. Based on this finding, we ran five independent training runs each limited to 200 iterations with varied random seeds to assess result stability. Across these five runs, the fine-tuned student model achieves a mean accuracy of 69.43% (std dev 0.17%) on the competition dataset, a 4.76 percentage-point improvement over the base model, and generalizes to 73.1% (std dev 0.18%) on the MATH-500 benchmark. We further study how response length affects answer quality across six reasoning levels (R1-R6): accuracy declines consistently from 69.43% at R1 (mean 220 words) to 41.9% at R6 (mean 31.2 words), with the two-person speed section most sensitive to token reduction. These results demonstrate that CoT distillation improves compact student models and that response length is a critical factor in mathematical reasoning quality.

[143] Lotus: Learning to Understand Time-series by Learning to Forecast cs.LG | cs.AI | cs.CLPDF

Van Dai Do, Huu Hiep Nguyen, Minh Hoang Nguyen, Manh Nguyen, Hung Le

TL;DR: LOTUS提出预测锚定预训练，使语言对齐的时间序列表征在下游适配前仍保留未来动态信息，并以原始片段和频谱联合表示捕获时序变化与周期模式。

Details

Motivation: 现有时间序列语言模型常用标签、描述或问答把数值信号对齐到语言，但这类监督没有显式要求表征保留底层序列如何演化的信息。

Result: LOTUS将各通道切成不重叠片段并映射至语言模型嵌入空间，再根据时间序列令牌的隐藏状态预测下一片段，迫使表征保留时间信息。其时域—频谱片段表示把原始片段与频谱表示结合，以覆盖时间变化和周期结构。在三种语言模型骨干、六个下游评测集上，LOTUS以较少可训练参数取得最高平均表现，准确率为59.91%，比最强匹配基线高3.36个百分点。表征分析显示模型确实利用数值输入并保留时序结构；作者还报告其在TSRBench上超过大其25至50倍的模型。

Insight: 对未来片段的预测目标可防止语言对齐过程抹去时间序列动态；融合时域与频域信息有助于表示变化和周期性。摘要未列六个数据集及准确率汇总口径，TSRBench上的具体模型对比和分数也未给出。

Abstract: Time-series language models typically align numerical signals with language using labels, captions, or question-answer pairs. Although such supervision encourages linguistic representations, it does not explicitly require them to preserve information about how the underlying time-series signal evolves. We introduce forecast grounding, a pretraining principle that requires language-aligned time-series representations to remain predictive of the future evolution before they are adapted to downstream tasks. We instantiate this principle in LOTUS, which divides each time-series channel into non-overlapping patches and maps them into the LLM embedding space. It then predicts the next patch from the LLM hidden states of the time-series tokens, encouraging the learned representation to retain temporal information. To capture both temporal changes and periodic patterns, we also propose a temporal-spectral patch representation that combines each raw time-series patch with its spectral representation before mapping it into the LLM embedding space. Across three language model backbones and six downstream evaluation datasets, LOTUS achieves the best average performance with minimal trainable parameters, reaching 59.91% accuracy and outperforming the strongest matched baseline by 3.36%. Our representation analyses further show that LOTUS uses the numerical input and preserves temporal structure in its learned patch representations. These results establish forecast grounding as a promising pretraining principle, enabling compact time-series language models to outperform models 25 to 50 times their size on TSRBench.

[144] Who Should We Listen to More? Welfare-Aware Preference Acquisition for Pluralistic Alignment cs.LG | cs.AI | cs.CLPDF

Ruomeng Ding, Tianwei Gao, Lianrui Geng, Mohit Bansal, Zhun Deng

TL;DR: WAPA将多元偏好数据采集形式化为福利最大化问题，根据标签质量增益、接收者当前效用和指定优先级分配有限人工标注，并在估计福利目标下证明固定预算算法最优。

Details

Motivation: 多元对齐需在有限人工反馈下容纳不同人的偏好；用AI模拟器生成比较标签可省成本，但各人群上的模拟准确率不同，可能使部分人的偏好在训练数据中代表不足。

Result: 作者定义个体监督效用及其社会福利目标；每条偏好查询的边际福利收益取决于预期监督改进、接收者当前效用及应用指定优先级。WAPA用辅助参考模型估计查询收益和个体效用，再按估计边际福利收益选取标注并更新接收者效用；在固定查询预算和模型预测条件下，作者证明该算法对估计福利目标达到精确最优。在六组Roleplay数据和四个OpinionQA地区的实验中，该方法改进监督质量并支持可控的分配权衡；在四组Roleplay数据上的策略训练改善了已见及未见个体的偏好预测。优先照顾指定群体及代表不足人群时，标注20%的比较可弥补全部AI标签策略与全部真实标签策略之间平均预测效用差距的75%至86%。

Insight: 有限标注预算应按福利影响分配，而非一律选择最容易或最不确定的样本；该方法显式提供优先级控制。最优性针对估计的福利目标、固定预算及模型预测成立，20%标注收益也依赖所评估数据和优先级设置，不能视为普适比例。

Abstract: Pluralistic alignment needs to accommodate diverse preferences under limited human feedback. Using AI simulators to label preference comparisons reduces annotation costs, but variation in simulation accuracy across individuals can leave some people’s preferences poorly represented in training. We study how to allocate human feedback across people to construct training data for pluralistic alignment, and how this allocation affects the trained policy. To make this allocation explicit and controllable, we define a social welfare objective over individual supervision utilities that measure label quality. Each query’s marginal welfare gain depends on its expected supervision improvement, the recipient’s current utility, and application-designated priority. Welfare-Aware Preference Acquisition (WAPA) uses auxiliary reference models to estimate query gains and individual utilities, then selects queries by estimated marginal welfare gain while updating recipient utilities. We prove exact optimality of the acquisition algorithm for the estimated welfare objective under a fixed query budget and model predictions. Experiments on six Roleplay collections and four OpinionQA regions demonstrate improved supervision and controllable allocation tradeoffs. Policy training on four Roleplay collections improves preference prediction for both seen and unseen individuals. When prioritizing a designated group and poorly represented individuals, acquiring human labels for 20% of comparisons recovers 75-86% of the average predictive utility gap between policies trained entirely on AI-generated labels and entirely on ground-truth labels.

[145] On the Limits of Representation-Based Test-Time Adaptation for Multimodal LLMs cs.LG | cs.CVPDF

Mikołaj Piórczyński, Wojciech Masarczyk, Damian Sójka, Sebastian Cygert, Bartłomiej Twardowski

TL;DR: 该研究发现表征对齐式测试时适应难以修复生成式多模态大模型在常见图像腐蚀下的性能，指出单一位置、对样本无关的共享特征校正受到视觉令牌漂移方向分散的限制。

Details

Motivation: 视觉语言模型在常见图像腐蚀下准确率下降；测试时适应已用于CLIP类对比模型，但在逐令牌生成的多模态大模型上仍较少研究且机制不同。

Result: 作者实验显示，基于表征的测试时适应不能有效恢复生成式多模态大模型表现。即使违反标准测试时适应假设，离线使用目标数据进行适配，盲于样本的特征对齐也只能带来微小准确率恢复。作者将失败归因于腐蚀导致的表征分布差异：CLIP类模型可受益于单一池化分类嵌入中的共享域偏移方向，但多模态大模型视觉令牌序列的偏移方向近乎正交并覆盖完整嵌入空间。

Insight: 结果对任意单一编码器位置、对样本无关且跨位置共享的表征校正可达到的效果构成边界；仅在表征空间介入可能不足以获得腐蚀鲁棒性。摘要没有给出具体模型、腐蚀类型和性能下降/恢复数值，结论不应外推到基于样本的或多层校正策略。

Abstract: Vision-language models suffer significant accuracy drops under common corruptions. While test-time adaptation (TTA) successfully mitigates these shifts in CLIP-like contrastive models, its application to generative multimodal large language models (MLLMs) remains underexplored and uniquely challenging due to their sequential token generation. In this work, we demonstrate that representation-based TTA fails to recover performance in MLLMs. Our experiments reveal that even when violating standard TTA assumptions by leveraging target data offline, sample-blind feature alignment recovers only marginal accuracy. We attribute this failure to the nature of corruption shifts: unlike CLIP-like architectures, which benefit from a shared domain-shift direction within a single pooled classification embedding, MLLM visual token sequence shifts are nearly orthogonal and span the full embedding space.These findings bound what any sample-blind, position-shared correction at a single encoder site can achieve, establishing that representation-space interventions alone might be insufficient to ensure corruption robustness in MLLMs.

[146] Beyond Aggregate Accuracy: Item-Level Transitions in Prompt Optimization cs.LG | cs.AI | cs.CLPDF

Chinmoy Mitra, Tarek Mahmud

TL;DR: RFDPO在自动提示优化中跟踪逐题恢复、退步和结果变动总量，用这些反馈指导改写并记录提示变化，揭示总体准确率可能掩盖大量题目级变化。

Details

Motivation: 自动提示优化通常只报告总体得分，无法看出哪些题由错变对、哪些原本正确题变错，以及收益能否迁移到未见题目。

Result: RFDPO显式跟踪恢复（错转对）、退步（对转错）和churn（所有结果变化），用该反馈指导后续提示修订并记录优化过程。作者以GPT-5为优化器、GPT-4o-mini及GPT-4.1 Mini为求解器，在法律、知识、指令遵循、数学和隐私五个基准评估。在九种配置中的五种，churn至少是净准确率变化绝对值的五倍，单题净变化最多掩盖17道发生改变的题目。平均验证集提升为7.9个百分点，留出测试集为5.2个百分点。在LegalBench-Hearsay受控消融中，逐题反馈使churn降低40%（p=0.024），同时维持相近净收益。

Insight: 总体准确率无法区分恢复和退步，也无法表示提示是否改变了大量答案；提示优化报告应同时呈现这些逐题转移及未见数据表现。验证集收益高于留出集，说明只报告优化过程中的分数会高估迁移表现；churn定义和最优提示选择也需按基准协议解释。

Abstract: Automatic prompt optimization (APO) uses feedback from model responses to improve prompts automatically. However, its effectiveness is usually measured through overall scores, which do not reveal which questions become correct, which previously correct answers become wrong, or whether improvements extend to unseen questions. We introduce Reflective Feedback-Driven Prompt Optimization (RFDPO), a tool that tracks recoveries (incorrect to correct), regressions (correct to incorrect), and churn (all changed outcomes). RFDPO uses this feedback to guide subsequent revisions and records prompt changes throughout optimization. We evaluate RFDPO across five benchmarks covering law, knowledge, instruction following, mathematics, and privacy, using GPT-5 as the optimizer and GPT-4o-mini and GPT-4.1 Mini as solvers. Our results show that overall accuracy can hide substantial changes: in five of nine configurations, churn was at least five times the absolute net change, and a single-item net change concealed up to 17 changed outcomes. Average validation gains were 7.9 percentage points, compared with 5.2 points on held-out tests. In a controlled ablation on LegalBench-Hearsay, item-level feedback reduced churn by 40% ($p=0.024$) while maintaining similar net gains. These findings motivate reporting recovery, regression, churn, and performance on unseen data alongside overall accuracy.

[147] Unlocking Structured Pruning for Reasoning Language Models via Attention-Preserving MLP Trimming cs.LG | cs.AI | cs.CLPDF

Woosang Lim, Haneul Yoo, Vincent-Daniel Yun, Sungjoo Yoo

TL;DR: LayerTrim通过识别冗余解码层并选择性裁剪MLP特征、保留注意力和网络深度，在无需训练的条件下压缩推理模型，同时更好维持长链推理能力。

Details

Motivation: 结构化剪枝能移除模型组件以获得更小的稠密模型，但现有方法可能使AIME等长推理任务能力崩塌。

Result: LayerTrim是免训练结构化剪枝方法，识别冗余解码层并选择性裁剪其MLP特征，同时保留注意力模块和解码深度；作者称其为首个无需梯度或恢复训练、以保留长形式推理为目标的此类方法。在三种推理模型和五个基准上，大多数设置优于既有结构化剪枝方法，较RESP的平均准确率最高提高21.4个百分点。Qwen3-14B上，prefill速度为稠密模型的1.24倍、峰值GPU内存降低19.7%，且更好保留推理能力；在受测剪枝模型中，它平均生成长度最短，同时平均准确率最高。

Insight: 保留注意力和网络深度、集中裁剪MLP冗余，可能避免剪枝破坏长程推理所需的序列建模。21.4个百分点是相对RESP的最高增幅，并非所有模型和基准的统一结果；摘要未给剪枝率及硬件、任务分项数值。

Abstract: Structured pruning reduces LLM inference costs by removing model components to produce smaller dense models. However, existing methods can cause reasoning performance to collapse on long-form reasoning tasks such as AIME. We propose \textit{LayerTrim}, a training-free structured pruning method that identifies redundant decoder layers and selectively trims their MLP features while preserving attention and decoder depth. LayerTrim is the first training-free structured pruning method designed to preserve long-form reasoning without gradients or recovery training. Across three reasoning language models and five benchmarks, LayerTrim outperforms existing structured pruning methods in most evaluated settings, improving average accuracy by up to 21.4 percentage points over RESP. On \texttt{Qwen3-14B}, LayerTrim achieves 1.24$\times$ faster prefill and 19.7% lower peak GPU memory than the dense model, while better preserving reasoning ability. It also achieves the shortest average generation length among evaluated pruned models, while retaining the highest average accuracy. These results demonstrate that LayerTrim improves reasoning efficiency through both structural compression and reduced token generation.

[148] MA-Bench: Measuring Operational Planning in Language Models cs.LG | cs.AI | cs.CLPDF

Rodney Lafuente-Mercado, Robert Sincero, Phil Sage, Yuan Xue

TL;DR: MA-Bench以10个专家构建的任务分析情景评测模型能否从大量不完整且部分矛盾的文件中形成作战计划问题陈述，并发现最佳模型仅答对62%的评分项，遗漏是主要失败形式。

Details

Motivation: 真实规划需从大量文档中归纳情势并界定问题，而往往不存在唯一标准答案；现有评测需要判断模型是否覆盖关键事实与推断，而非只比较最终文案相似度。

Result: MA-Bench基于军事行动规划的任务分析阶段，包含10个专家构建情景，每个情景配有10至12份合成文件及1,257条专家编写的通过/失败要求；每项要求都记录来源、问题类型和重要度。推理模型裁判在不查看文档的条件下对简报评分，其表现类似第五位合格规划人员，四人专家组的一致性从Fleiss κ=0.42变为0.41；另一供应商裁判复现模型排名，Spearman相关0.94。20个前沿及开放权重模型中最佳者答对62%评分项。模型对文件直接陈述的事实较强（58%），对需推断的判断最弱（33%）；十项失败中约六项是遗漏而非错误。

Insight: 基于逐项要求的评分可检验规划覆盖度，遗漏比事实错误更常见；裁判可靠性通过与专家小组及独立供应商排序比较。该基准评估的是判断项而非文笔，且仅包含10个合成专家情景，不能直接视为真实军事决策能力验证。

Abstract: How well can a language model turn a large, incomplete and partly contradictory body of documents into a plan when no single correct answer exists? We introduce Mission Analysis (MA)-Bench, built on mission analysis, the first step of military operational planning, in which a staff reads the full situation and states the problem before anyone proposes a solution. Its 10 expert-built scenarios pair synthetic packets of ten to twelve documents with 1,257 expert-written pass/fail requirements, each containing information on their source, question type, and importance level. A reasoning-model judge grades each brief against the requirements without seeing the documents; it grades like a fifth credentialed planner, leaving a four-planner panel’s agreement unchanged (Fleiss $κ$ 0.42 to 0.41), and a judge from a second provider reproduces the model ranking (Spearman 0.94). Across twenty frontier and open-weights models the best gets 62% of the rubric items right. Models are strongest on facts stated in the documents (58%) and weakest on judgments that must be inferred (33%), and six failures in ten are omissions rather than errors. MA-Bench grades the determinations, not the prose. We release the packets, rubrics, prompts, scorer and every graded brief with item-level verdicts.

[149] Diagnosing and Correcting Reward Hacking in Verifiable Instruction Following cs.LG | cs.CLPDF

Sangyeon Yoon, Wooseok Seo, Hamish Ivison, Hyesoo Hong, Donghoon Kim

TL;DR: CALIF针对可验证指令遵循中只奖励格式约束而忽视实质回答的问题，在冻结参考策略上计算请求条件似然奖励作为校准奖励，以缓解强化学习奖励劫持。

Details

Motivation: 可验证指令遵循基准着重检查输出约束，却可能忽略回答是否实质回应请求，导致内容很少的答案也拿满分；直接用相同验证器作训练奖励还会诱发模型只满足约束而牺牲回答质量。

Result: 作者观察到前沿模型可用缺乏实质内容的回复获得满分，并发现公开检查点经过可验证奖励强化学习后可能约束满足率升高、回答质量下降。CALIF在验证器奖励上加入基于似然的校准奖励：使用现有冻结参考策略仅评估给定用户请求时的回复似然，不需额外裁判或训练奖励模型。在1.7B至8B、推理和非推理模型的实验中，CALIF提高IFBench约束满足，同时使回答质量保持在RL前水平附近或更高；在三个量规式指令遵循基准的45组模型—指标比较中，40组优于对应基础策略。

Insight: 约束合规与是否真正回答请求应共同进入训练反馈；利用冻结参考策略可在不增加裁判模型的情况下抑制空洞但格式正确的奖励劫持。45组比较中仍有5组未胜过基础策略，摘要未给出各指标增幅和似然校准超参数。

Abstract: Verifiable instruction-following benchmarks emphasize output-constraint satisfaction but can overlook whether responses meaningfully answer the underlying request, creating an evaluation blind spot. We show that frontier models can receive full credit for responses with little substantive answer content. Using the same verifier-based criterion as a training reward can induce reward hacking, as publicly released checkpoints exhibit higher constraint satisfaction but lower response quality after reinforcement learning with verifiable rewards. To address this reward hacking, we introduce CALIF, a lightweight method that augments verifier rewards with a calibrated likelihood-based bonus to preserve response quality. CALIF evaluates response likelihood under the request alone using the existing frozen reference policy, requiring no additional judge or learned reward model. Across models ranging from 1.7B to 8B in reasoning and non-reasoning modes, CALIF improves constraint satisfaction on IFBench while maintaining response quality near or above pre-RL levels. It also outperforms corresponding base policies in 40 of 45 model-metric comparisons across three rubric-based instruction-following benchmarks, demonstrating gains beyond training verifiers.

[150] Sparse Autoencoders Are a Shared Coordinate System for Symbolic Matching cs.LG | cs.AI | cs.CL | cs.SCPDF

Xiaocong Yang, Xuanyu Meng, Yuji Zhang, Jiawei Han, ChengXiang Zhai

TL;DR: SAE-IDF将符号系统中的符号按原生上下文编码为稀疏自编码器特征，并用特征稀有度重加权后跨系统匹配，试图为神经符号系统构建共享概念坐标。

Details

Motivation: 神经符号模型可提供可解释架构和系统二推理，但符号组件通常依靠人工构建，限制其规模且常局限于特定领域；要组合已有异构符号系统，首先需可靠匹配其中的基本单元。

Result: SAE-IDF把符号置于原生上下文中编码为稀疏码，再按各维特征稀有度重加权并跨系统匹配。作者在六类符号系统的12项任务上评估：使用Gemma-2-9B时，所有任务均超过同一模型稠密基线；Llama-3.1-8B上除一项外均超过基线，最高提升45个百分点，且不同SAE层和配置下表现一致。方法的每个稀疏码维度都可赋予人类可读含义，因此匹配可拆解为命名概念特征。

Insight: 稀疏特征可作为异构符号体系间的共享坐标，让跨系统匹配同时具有可解释分解；这可能为扩大符号知识骨干提供基础。摘要未列六类符号系统和各任务分数，也未证明所得匹配在更大规模符号库或下游高风险推理中可靠。

Abstract: Large language models (LLMs) hold broad knowledge in one set of weights, but lack interpretability and trustworthy reasoning, especially in high-stakes use cases. A neuro-symbolic model, with its interpretable architecture and System 2 reasoning capacity, is a promising alternative if built at the scale of LLMs; however, its symbolic backbone is usually constructed with human effort, so existing neuro-symbolic models are bottlenecked by the scope of the symbol component and usually domain-specific. A data-driven method could instead build a larger symbolic system by aligning and merging existing ones. We target its first, foundational step: matching units across these heterogeneous systems. Our method, SAE-IDF, encodes a symbol in its native context into a sparse code with a sparse autoencoder (SAE), re-weights each dimension by its rarity and matches across systems. On 12 tasks across 6 kinds of symbolic system, SAE-IDF outperforms the same LLM’s dense baseline on all tasks with Gemma-2-9B and all but one with Llama-3.1-8B, by up to 45 points, consistently across SAE layers and configurations. SAE-IDF is also interpretable: every dimension of the sparse code has a human-readable meaning, so each match decomposes into named concepts (features). Our work paves the way to a universal symbolic backbone.

[151] PN-Mix: Pair-Norm Guided Mixed-Precision Key Cache Quantization for Efficient Long-Output LLM Inference cs.LG | cs.CLPDF

Gil Jae Song, Sungjoo Yoo

TL;DR: PN-Mix根据RoPE通道对上查询—键范数乘积估计对注意力logit的扰动敏感性，在预填充阶段选择重要键缓存通道对并于解码中重复使用，实现混合精度量化。

Details

Motivation: 长输出推理受KV缓存内存和带宽限制，低比特缓存量化又会损害准确率。既有混合精度键缓存方法仅依据键统计估计通道重要性，可能未反映量化误差如何实际扰动注意力logits。

Result: 作者在RoPE通道对层面分析注意力logit扰动，发现查询—键通道对范数乘积较大的通道对量化误差会显著影响logit。PN-Mix在预填充阶段识别显著通道对并分配更高精度，后续解码复用该分配。在推理、代码生成和AIME基准中，平均精度2.26比特的PN-Mix取得与2.32至2.39比特既有混合精度方法相当或更好的平均准确率。Pareto扫描中，PN-Mix降低到1.5比特时性能逐步退化，而比较基线在低于2.25比特后下降更快。

Insight: 键通道重要性应结合查询—键配对及RoPE结构评估，单看键自身统计可能忽略对logit的实际影响；预填充时识别后复用也避免逐步重估。摘要未报告具体显存/吞吐收益和各基准准确率，结论限于RoPE解码器模型。

Abstract: Long-output inference in large language models suffers from severe KV cache memory and bandwidth bottlenecks. While KV cache quantization alleviates this issue, low-bit quantization (e.g., 2-bit) severely degrades model accuracy. Recent mixed-precision key-cache quantization methods mitigate this degradation by allocating higher precision to important key channels, but estimate channel saliency using only key statistics. Through attention logit perturbation analysis at the RoPE channel-pair level, we show that quantization errors in channel pairs with large query–key pair-norm products contribute significantly to logit variation. Based on this insight, we propose PN-Mix, a mixed-precision key-cache quantization method for RoPE-based decoder-only LLMs, which allocates higher precision to salient channel pairs identified once during the prefill stage and reused throughout decoding. Across standard reasoning, code-generation, and AIME benchmarks, PN-Mix with 2.26-bit average precision achieves comparable or better average accuracy than prior mixed-precision methods using 2.32–2.39 bits. Furthermore, in our Pareto sweep, PN-Mix degrades gracefully down to 1.5 bits, whereas the compared baselines exhibit sharper performance drops below 2.25 bits.

[152] Function-Space Temporal Self-Distillation for Policy Optimization cs.LG | cs.AI | cs.CL | stat.MLPDF

Aryan Das, Arnab Bhattacharya, Vinay Kumar Verma

TL;DR: FSPO将强化学习自蒸馏与函数空间时间巩固结合，用稀疏历史下一令牌分布作为固定时间目标，并通过分歧校正、可靠性接地和质量覆盖记忆改善推理及工具使用。

Details

Motivation: 可验证奖励强化学习仅提供粗粒度结果监督；在线自蒸馏虽能比较无辅助策略与特权自教师来提供令牌级反馈，但教师随学生演变会使监督目标不稳定，需要额外正则化。

Result: FSPO是单策略框架，将当前特权适配与函数空间时间巩固结合：保存稀疏历史下一令牌分布作为固定时间目标，不需持久教师模型；加入特权分歧校正以抑制局部高估动作；当自生成证据反复失败时，以可靠性自适应方式加强参考监督；并使用兼顾质量和覆盖的时间记忆保留已验证行为、改进特权示范。在推理和工具使用基准上，5小时训练预算内FSPO取得最高平均准确率，较最强基线平均提高约4个百分点；Olmo3-7B-Instruct峰值内存从约70GB降至56GB。

Insight: 冻结的历史分布可为动态自教师提供时间参照，另以证据可靠性和记忆质量控制监督强度。约4个百分点是跨基准平均增益，摘要未列各基准结果、具体记忆容量或与其他训练预算的公平性细节。

Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in language models, but scalar outcomes provide coarse supervision over response trajectories. Self-distillation offers denser token-level guidance by comparing an unassisted policy with a feedback-informed self-teacher, yet the teacher evolves with the student, creating unstable targets and motivating additional regularization. We introduce Function-Space Policy Optimization (FSPO), a single-policy framework that combines current privileged adaptation with function-space temporal consolidation. FSPO stores sparse historical next-token distributions as fixed temporal targets, providing temporal separation without maintaining a persistent teacher model. It further introduces privileged disagreement correction to explicitly suppress locally overvalued actions, reliability-adaptive grounding that strengthens reference supervision when self-generated evidence repeatedly fails, and quality and coverage-aware temporal memory that retains verified behaviors and improves privileged demonstrations. Across reasoning and tool-use benchmarks, FSPO achieves the highest average accuracy under a 5-hour training budget, improving over the strongest baseline by approximately 4% points on average while reducing peak memory from about 70 GB to 56 GB on Olmo3-7B-Instruct.

[153] MolHop: Scaffold-Hopping Molecular Design with Agentic Reinforcement Learning cs.LG | cs.CLPDF

Yanyi Su, Chenyan Wang, Yulei Gong, Yeyun Chen, Xiaohui Yang

TL;DR: MolHop把约160万个商业分子骨架组织成由粗到细的层级动作空间，让智能体通过骨架导航和分子编辑寻找功能保留、结构明显不同的替代分子。

Details

Motivation: 优化已有分子与发现骨架差异很大的替代分子是不同搜索问题；现有基于大语言模型的分子设计智能体多在已有结构邻域内局部改造，而骨架跳跃要求探索更广化学空间并保留参考分子的功能特征。

Result: MolHop从商业分子中整理约160万个骨架，建立由粗到细的化学动作空间；智能体可选择骨架导航动作转入新的探索区域，再通过分子编辑调整候选属性，并用历史轨迹记忆支持长程搜索。在药物分子和商业化合物任务上，接入MolHop框架显著提高Grok-4.6和DeepSeek-Flash-V4.1的跨骨架联合成功率。作者还通过智能体强化学习训练MolHop-9B；其表现超过GPT-5.6-sol、Claude-5-Opus和Gemini-3.1-Pro等生成基线，同时生成与参考分子骨架差异更大的候选分子。

Insight: 显式层级骨架导航使搜索从局部性质优化扩展到结构空间迁移，并将导航与局部化学编辑结合。摘要未给出联合成功率具体值、分子有效性/合成性结果及不同生成模型的比较细节。

Abstract: Molecular design is often formulated as an optimization problem over existing molecular spaces. However, molecular optimization and the discovery of structurally distinct replacement molecules represent two fundamentally different search problems. LLM-based molecular design agents typically perform the former, conducting local refinement within the neighborhood of existing structures to improve target properties through structural modifications. In contrast, the latter requires exploration of a broader chemical space to discover molecules with entirely different scaffolds while preserving the functional characteristics of reference molecules. We propose MolHop, an agentic framework for cross-scaffold molecular discovery that enables models to navigate and edit within a pre-organized chemical space. MolHop organizes approximately 1.6 million molecular scaffolds from commercial molecules into a coarse-to-fine hierarchical action space. The agent selects new exploration regions through scaffold navigation actions and adjusts candidate properties through molecular editing. The framework maintains historical trajectory memory to support long-horizon search processes. On drug molecule and commercial compound tasks, connecting Grok-4.6 and DeepSeek-Flash-V4.1 to the MolHop framework substantially improves their cross-scaffold joint success rates. We develop MolHop-9B through agentic reinforcement learning, and MolHop-9B outperforms generative baselines including GPT-5.6-sol, Claude-5-Opus, and Gemini-3.1-Pro, while generating candidate molecules with larger scaffold differences from the reference molecules. These results demonstrate that effective molecular discovery beyond the traditional optimization paradigm requires structured chemical and action spaces, enabling agents to explore new structural regions rather than merely refine existing molecules.

[154] RM-OPD: On-Policy Distillation for Generative Reward Models cs.LG | cs.CLPDF

Qinglin Su, Licheng Pan, Zhen Fang, Jiakang Wang, Qingnan Ren

TL;DR: RM-OPD通过先训练领域专家奖励模型、再用路由在线蒸馏整合能力，试图缓解混合偏好数据强化学习中的稀疏奖励、跨域干扰及奖励劫持。

Details

Motivation: 混合领域偏好强化学习是训练通用生成式奖励模型的常见路线，但结果奖励稀疏，异质能力联合优化又会互相干扰，造成能力获取不均衡及普遍奖励劫持。

Result: RM-OPD分两阶段：先对各领域单独进行GRPO微调，培养达到各自表现上限的专家教师；再通过路由在线蒸馏，将其知识整合到一个学生模型。蒸馏为学生生成的批评文本提供有符号、令牌级密集监督；领域贡献重加权按目标领域份额调整指导，避免特定领域主导优化；可选的标准上下文蒸馏则让教师依据领域特定评价标准提供更精细监督。在多个奖励模型基准和两个基座模型上，RM-OPD持续优于常规Mix-RL及其他强基线，整体表现更佳，并报告出现超越教师的效果。

Insight: 先形成单领域能力，再显式控制多领域监督份额，可降低直接混合优化的干扰；令牌级在线蒸馏则补足结果奖励稀疏。摘要未给各基准成绩、教师/学生规模、训练成本及“超越教师”具体定义和幅度。

Abstract: Reinforcement Learning on Mixed-domain preference data (Mix-RL) has become the mainstream approach for training general-purpose Generative Reward Models (GRMs). However, Mix-RL suffers from two critical bottlenecks: the reward sparsity induced by outcome rewards, and the cross-domain interference arising from jointly optimizing heterogeneous capabilities, which together give rise to imbalanced capability acquisition and pervasive reward hacking. Inspired by the success of On-Policy Distillation (OPD) in multi-domain capability integration, we introduce RM-OPD (Reward Modeling via On-Policy Distillation), a two-stage framework that separates specialist acquisition from capability integration. First, we cultivate domain-specialized teacher models via single-domain GRPO fine-tuning, allowing each expert to reach its performance ceiling in isolation; then we consolidate these teachers into one student model through (i) routed on-policy distillation, which provides dense signed token-level supervision on student-generated critiques; (ii) domain contribution reweighting, which reweights token guidance toward target domain shares, preventing specific domains from dominating optimization; and (iii) optional criteria context distillation, which conditions teachers on domain-specific evaluation criteria to sharpen token-level supervision. Across multiple RM benchmarks and two base models, RM-OPD consistently outperforms vanilla Mix-RL and other strong baselines, achieving overall superior performance and exhibiting an emergent “teacher-surpassing” effect. These results establish RM-OPD as a promising paradigm for building generalist GRMs.

[155] One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness cs.LG | cs.AI | cs.CLPDF

Artin Tajdini, Manpreet Kaur, Peng Qi

TL;DR: CIPR通过在同一训练样本上构造动作语义等价、标识符不同的两种接口，并约束其策略分布接近，提升智能体对接口变化的鲁棒性。

Details

Motivation: 智能体后训练会把能力绑定到训练时的工具接口；即使动作语义不变，仅重命名动作或改变表示也会降低性能。单纯随机化训练接口只能覆盖训练分布，分布外接口扰动仍可能造成退化。

Result: 跨接口策略正则化（CIPR）把动作名替换为无信息标识符，并通过构造明确对应的两种等价接口呈现每个样本；训练时惩罚两种接口诱导的动作分布之间的KL散度。在监督和强化学习后训练设置中，CIPR均改善接口鲁棒性。函数调用智能体在未见接口扰动下准确率下降近25%，加入CIPR可恢复10.5%，且不改变原接口准确率。

Insight: 让模型在结构化训练中直接对等价接口施加一致性约束，比只扩展训练时接口分布更有针对性；其收益可在保留原接口性能的同时缓解未见命名或格式变化。摘要未说明10.5%的口径是百分点还是相对值及其具体任务规模，报告时应保留作者原文表述。

Abstract: Post-training binds the competence of an LLM agent to the interface it was trained on. Semantics-preserving perturbations of that interface, such as renaming an action or changing the notation, leave the underlying task unchanged yet make the agent worse at it. Scoring each sample independently means interface randomization only broadens this dependence from a single interface to the training interface distribution, so out-of-distribution perturbations still degrade the agent. We propose Cross-Interface Policy Regularization (CIPR), a self-supervised objective that replaces action names with uninformative identifiers and presents each training sample under two interfaces in which equivalent actions are identified by construction. CIPR penalizes the KL divergence between the action distributions induced under the two interfaces, so the policy behaves consistently across them. We evaluate CIPR in both supervised and reinforcement-learning post-training, where it improves robustness. On agentic function calling, held-out interface perturbations reduce the accuracy of a post-trained agent by nearly 25%, and CIPR recovers 10.5% while leaving accuracy on the unchanged interface intact.

cs.RO [Back]

[156] $λ_0$: Scaling Open-World Egocentric Human Data for Humanoid Loco-Manipulation cs.RO | cs.CVPDF

Lambda-humanoid Team

TL;DR: HumanVerse提供500小时开放世界人类第一视角视频及同步身体、手部运动数据，并以离线视角和控制修正将其转为人形机器人可用监督；由此训练的λ₀在仿真与真实移动操作任务上取得较高成功率。

Details

Motivation: 人形机器人全身移动操作需要协调身体与物理环境，但大规模机器人示范采集昂贵；人类演示可扩展，却常缺少移动和姿态信息，而且人机具身差异及控制器动力学会造成末端执行误差。

Result: HumanVerse包含500小时开放世界人类移动操作数据，配对第一视角视频与同步身体、手部运动。人类到人形机器人的转换流程对齐相机视角和手臂外观，并离线修正动作参考与控制器输入，以减少末端误差并保留全身协调。作者在Unitree G1上通过代表性的全身操作和长距离移动操作任务验证零样本迁移，未使用目标任务机器人示范。随后构建人形基础模型λ₀，在中期训练中使用机器人对齐的人类示范；增加全身人类数据持续改善下游任务进展。λ₀在SIMPLE成功率为90.0%，真实移动操作任务总体成功率为62.5%。

Insight: 经对齐和控制器修正的人类全身数据可作为规模化机器人监督，数据增量与任务进展相关，并可支持无需目标任务示范的迁移。摘要未给出数据规模以外的采集多样性、真实任务数、成功率置信区间或机器人部署安全评估。

Abstract: Humanoid loco-manipulation requires coordinated whole-body interaction with the physical world, yet collecting robot demonstrations at scale remains costly. Human demonstrations offer a scalable alternative, but existing egocentric human supervision often omits locomotion and posture, while embodiment differences and controller dynamics hinder accurate end-effector execution. We introduce HumanVerse, a 500-hour dataset of open-world human loco-manipulation pairing egocentric video with synchronized body and hand motion. Our human-to-humanoid pipeline aligns camera viewpoints and arm appearance, and refines motion references and controller inputs offline to reduce end-effector errors while preserving whole-body coordination. We validate the pipeline through zero-shot transfer to Unitree G1 on representative whole-body manipulation and long-range loco-manipulation tasks, without target-task robot demonstrations. Building on this pipeline, we develop $λ_0$, a humanoid foundation model for whole-body loco-manipulation, with robot-aligned human demonstrations providing supervision for mid-training. Increasing whole-body human data consistently improves downstream task progress. $λ_0$ achieves 90.0% success on SIMPLE and 62.5% across real-world loco-manipulation tasks. We expect this study to guide scalable whole-body human data collection toward humanoid foundation models for richer interaction with the physical world. Homepage: https://lambdahumanoid.github.io/

[157] Robota-Embed: Unified VLA Embeddings for Robot In-Context Learning and Evolution cs.RO | cs.CVPDF

Yunze Liu, Jing Wang, Shenrui Wu, Wenkun He, Guanqi Zhan

TL;DR: Robota-Embed训练统一的视觉—语言—动作检索嵌入，将当前状态任务查询与记录的未来动作续接对齐，支持机器人少样本上下文学习和冻结策略上的任务局部记忆演化。

Details

Motivation: 为机器人检索可用经验，需要同时匹配当前任务、执行阶段及适合继续的未来动作；仅用视觉或语言匹配难以判断检索到的片段是否能作为当前策略的行动上下文。

Result: Robota-Embed将视觉、语言和动作共同编码进当前状态查询及记录的未来续接，通过预测式检索训练对齐两端。训练语料有1,695,684个清理后的锚点；Robota-Embed-Bench含4,000个查询和共享的8,000条图库。模型片段级和episode级R@1分别为47.33%和81.77%，比不含动作的Gemini Embedding 2高22.09和33.47个百分点；消融显示移除原生动作对检索伤害大于移除视觉。Embed2ICL使DROID-Sim成功率从47.0%升至56.3%，LIBERO困难子集从86.4%升至92.8%，并改善真实机器人任务进度。Embed2Evolve在冻结GPT-6 Astra策略周围按执行反馈扩展任务局部记忆并调整上下文使用；五项ManiSkill任务成功率为68%，相比GPT-6 Astra直接执行的24%和同协议下以Omni-Embed-Nemotron-3B演化的harness的33%更高。相对后者，每次测试rollout策略令牌约减少79.5%，成功和失败均计入。

Insight: 动作感知的统一检索空间可为机器人提供真正可执行的历史续接，并支持冻结策略的上下文适配；动作信息对检索质量尤其重要。检索、ICL和harness演化分别使用不同基准与对照，不能把单一成功率差异归因于嵌入检索本身。

Abstract: Retrieving useful context for a robot requires matching its task, execution stage, and the continuation that should follow. We introduce Robota-Embed, to our knowledge the first vision-language-action (VLA) embedding model to jointly encode all three modalities in both current-state queries and recorded future continuations. Predictive retrieval training aligns these endpoints, enabling historical continuations to serve as context at inference time. We construct a multi-source corpus of 1,695,684 cleaned training anchors and introduce Robota-Embed-Bench, with 4,000 queries and a shared 8,000-entry gallery. Robota-Embed achieves 47.33% clip-level and 81.77% episode-level R@1, exceeding action-free Gemini Embedding 2 by 22.09 and 33.47 percentage points. Controlled retrieval studies show that removing native action degrades retrieval more than removing vision. We study two complementary applications. Embed2ICL uses retrieved experience for training-free and training-based policy conditioning, increasing success from 47.0% to 56.3% in DROID-Sim and from 86.4% to 92.8% on the LIBERO difficult subset, while improving task progress on real robots. Embed2Evolve uses execution feedback to grow task-local memory and refine context use around a frozen GPT-6 Astra policy. Across five ManiSkill tasks, it achieves 68% success, compared with 24% for GPT-6 Astra Direct and 33% for a harness independently evolved with Omni-Embed-Nemotron-3B under the same protocol. Relative to the latter, it uses approximately 79.5% fewer policy tokens per test rollout, counting both successes and failures. These results show that a unified, action-aware retrieval space can support robot in-context learning and task-local context evolution.

[158] What Matters for World Modeling in Vision-Language-Action Models? cs.RO | cs.CVPDF

Qisen Ma, Yixiang Chen, Yuan Xu, Peiyan Li, Jiabing Yang

TL;DR: 该研究在统一设置下系统比较视觉—语言—动作模型中四种世界模型集成范式，发现表征效果依赖范式、2D语义表征较稳健，且世界建模通常有助于多种任务设置。

Details

Motivation: 视觉—语言—动作模型加入世界模型有望使策略预测未来动力学，但现有方法同时在世界表征、集成方式和策略骨干上各异，难以识别哪些设计真正重要。

Result: 作者将方法归为隐式未来对齐、显式未来查询、混合Transformer未来专家和外部世界预测器四种范式，并在统一框架中搭配不同表征与策略骨干，在域内、域外、长时程、动态、少样本和真实世界设置评估。研究发现：表征有效性依赖集成范式，但2D语义表征在多种范式下均带来稳健收益；没有一种范式处处最优，解耦的MoT未来专家总体有竞争力，特别是域外鲁棒性较强；世界建模稳定改善基于标准视觉语言模型的策略，而解耦设计与预训练VLA兼容性更好；相较仅动作基线，多个设置下均获益，长时程和动态任务收益明显。

Insight: 世界模型的作用不能脱离表示形式、集成范式与策略骨干分别判断；统一对照显示不存在单一最佳设计，但2D语义表征和解耦未来专家展现较广泛优势。摘要未给各范式的数值和真实任务规模，结论应限于所测组合及设置。

Abstract: Integrating world models into Vision-Language-Action models (VLAs) has emerged as a promising direction, enabling policies to anticipate future dynamics beyond reactive observation-to-action mapping. However, existing approaches vary simultaneously in their world representations, integration paradigms, and policy backbones, making it difficult to determine what truly matters for effective world model integration. To disentangle these factors, we categorize existing efforts into four representative paradigms, namely Implicit Future Alignment, Explicit Future Query, MoT Future Expert, and External World Predictor. We instantiate each within a unified framework and systematically evaluate these paradigms with diverse world representations and policy backbones across in-domain, out-of-domain, long-horizon, dynamic, few-shot, and real-world settings. Our study yields four main findings: 1) world representation effectiveness is paradigm-dependent, whereas 2D semantic representations offer robust, cross-paradigm gains; 2) no single paradigm is universally optimal, yet the decoupled MoT Future Expert offers competitive overall performance, particularly in OOD robustness; 3) world modeling consistently benefits policies built on standard VLMs, while decoupled designs exhibit greater compatibility with pretrained VLAs; and 4) world modeling improves performance over action-only baselines across multiple settings, with notable gains on long-horizon and dynamic tasks. Project page and video demonstrations are available at https://dylanmqs.github.io/WM-in-VLAs/.

cs.SD [Back]

[159] What Does LALM Post-training Learn? Rethinking Audio Understanding and Reasoning Capabilities cs.SD | cs.CL | cs.MM | eess.ASPDF

Hua-Hsuan Chen, Xuanjun Chen, Wei-Chung Lu, Chih-Kai Yang, Yu-Xiang Lin

TL;DR: 该研究以受控实验区分大型音频语言模型后训练带来的真实音频理解能力与题型适应，发现许多基准收益在缺少有效音频时仍存在、换题型后则大幅消失。

Details

Motivation: 后训练常能提高大型音频语言模型在音频理解和推理基准上的成绩，但这种提升可能只是适应选择题等具体问法，而非音频理解与推理能力本身的进步。

Result: 作者设计受控实验，将音频理解能力改善与特定问题格式适配分开考察，并比较不同模型和后训练方法。实验发现，许多报告中的收益即使没有提供有信息量的音频仍能保留；当改变问题格式时，这些收益则大部分消失。

Insight: 仅在相同题型上比较后训练前后的分数，可能把文本线索或答题模式学习误认为通用音频理解进步；评估应控制音频信息量并测试题型迁移。摘要未列模型、基准或具体提升数值，也未提供更细的错误类型分析。

Abstract: Post-training often improves the performance of large audio-language models on audio understanding and reasoning benchmarks. However, these improvements may reflect adaptation to specific question formats, such as multiple-choice questions, rather than genuine advances in audio understanding and reasoning capabilities. To investigate what LALMs actually learn from post-training, we conduct controlled experiments that disentangle improvements in audio understanding from adaptation to specific question formats. Across different models and post-training methods, we find that much of the reported improvement persists even without informative audio, but largely disappears when the question format changes. These findings suggest that post-training often teaches models to exploit task-specific textual cues and answer patterns rather than developing generalizable audio understanding and reasoning capabilities.

[160] SEA-HELM Audio: Evaluating Multilingual ASR-LLM Pipeline Performance Across SEA-HELM Subsets cs.SD | cs.CLPDF

Yixian Tan, Aulia Adila, Jonathan Heng, Kunat Pipatanakul, Donghang Wu

TL;DR: SEA-HELM Audio在五种东南亚语言上评估合成语音输入与文本输入的ASR—LLM级联系统，发现语音链路在推理和指令遵循中造成显著性能下降，泰米尔语差距最大。

Details

Motivation: 基于文本的SEA-HELM基准无法衡量语音识别与语言模型串联后产生的性能损失，因此可能高估多语种语音智能体的实际可靠性。

Result: SEA-HELM Audio把文本SEA-HELM扩展到合成语音输入，覆盖中文、英语、马来语、印尼语和泰米尔语，并在多项选择推理和指令遵循任务中比较语音与文本输入。开源权重和商业ASR—LLM系统使用相同验证器评估，语音差距定义为文本准确率与语音准确率之差。多项选择推理准确率下降9.00至18.50个百分点，指令遵循下降20.00至42.86个百分点；泰米尔语退化最大，超过40个百分点。

Insight: 文本基准上的能力不能直接代表语音端到端表现，需单独测量ASR错误及后续推理对多语种语音的影响。评测使用合成语音，摘要未给各语言、模型及子任务的完整分数，也未覆盖真实录音条件。

Abstract: We introduce SEA-HELM Audio, a Southeast Asian (SEA) multilingual evaluation framework that extends the text-based SEA-HELM benchmark to assess performance degradation in cascaded automatic speech recognition and large language model (ASR-LLM) pipelines. Using synthesized speech, we compare speech-input and text-input performance across five languages (Chinese, English, Malay, Indonesian, and Tamil) on multiple-choice reasoning and instruction-following tasks. We evaluate open-weight and commercial ASR-LLM systems using identical verifiers and quantify the speech gap as the difference between text and speech accuracy. Results show substantial degradation, with accuracy drops of 9.00 to 18.50 percentage points for multiple-choice reasoning and 20.00 to 42.86 points for instruction following. Tamil exhibits the largest degradation, exceeding 40 percentage points. Our findings highlight the limitations of text-only benchmarks in predicting voice-agent reliability and demonstrate the value of SEA-HELM Audio for evaluating multilingual voice-agent systems.

cs.SE [Back]

[161] LintEval: Benchmarking LLMs on Linter-Guided File Refactoring cs.SE | cs.CLPDF

Tongwei Deng, Jinyu Zhu, Yue Cao, Chenxu Wang, Yanzhen Zou

TL;DR: LintEval是针对C++、Python和Java的lint引导文件级重构基准，联合检查功能保持、告警减少、新告警避免和编辑最小性，揭示静态告警改进与功能正确之间存在权衡。

Details

Motivation: 现有代码基准很少明确评估按linter告警重构整个文件的能力；模型既需减少告警，又必须保持原本正确的功能。

Result: LintEval覆盖13,061个初始功能正确的程序和171,662条语言专属linter告警，同时评估功能保持、告警减少、新告警避免及编辑最小性。实验显示商业闭源模型的Reduction@P最高可达90.4%，但Pass@1仅67.1%至68.3%；若干小型开源模型的Reduction@P较低或为负值。受控微调表明监督格式重要：面向重构的SFT使Qwen2.5-Coder-7B的Reduction@P从24.7%升至76.0%。

Insight: 只看告警减少率可能奖励破坏功能或引入新问题的修改，基准因此联合评测多种约束；重构专属监督能大幅提高告警改进指标。摘要未给各语言分项结果和所有指标的完整定义，Reduction@P与Pass@1不能互相替代。

Abstract: Linters are widely used in code maintenance and real-time IDE editing to surface lint alerts related to performance, style, error-prone, and other patterns in source files. However, existing code benchmarks do not explicitly evaluate linter-guided file refactoring, where models must reduce lint alerts in source files with correct initial functionality while satisfying functionality preservation. We introduce LintEval, a multilingual benchmark for linter-guided file refactoring across C++, Python, and Java, comprising 13,061 programs with correct initial functionality and 171,662 lint alerts extracted using language-specific linters. LintEval jointly evaluates functionality preservation, lint alert reduction, new alert avoidance, and edit minimality. Experiments reveal a persistent trade-off: closed-source commercial models reach up to 90.4% Reduction@P but achieve only 67.1%-68.3% Pass@1, while several open-source small models show low or negative Reduction@P. A controlled fine-tuning study further shows that supervision format matters: refactoring-oriented SFT raises Qwen2.5-Coder-7B Reduction@P from 24.7% to 76.0%. LintEval enables controlled evaluation of models that improve source files under functionality preservation.

eess.IV [Back]

[162] Focus, Align, and Diffuse: Time-Series-Aware Keyframe Diffusion for Cardiac Dynamic Synthesis from Sparse Observations eess.IV | cs.CVPDF

Junkai Liu, Haofan Wu, Nay Aung, Joao A. C. Lima, Steffen E. Petersen

TL;DR: CardioFAD把稀疏心脏动态合成视为可恢复且可与ECG对齐的关键帧锚点发现问题，先生成关键帧再插值其余时刻，在心脏MRI和超声视频上改善视觉、时间及功能一致性。

Details

Motivation: 评估心脏功能需要稠密动态，但临床观测往往极稀疏，缺少时间线索使完整动态恢复成为病态问题；ECG可提供生理信息，却存在跨模态表征差距和相位错位，难以有效利用。

Result: CardioFAD采用Focus、Align、Diffuse三阶段范式，学习既足以恢复视觉轨迹又可可靠与ECG对齐的一组紧凑锚点状态。Focus模块按轨迹充分性选择保留关键帧内模态运动信息的帧；Align模块促使这些锚点上的跨模态对应稳定。随后Diffuse分两阶段先合成关键帧，再插值生成其余帧。心脏MRI和超声视频的实验表明，在极端单次观测设置下，该方法改善视觉质量、时间连贯性和功能一致性。

Insight: 先寻找少量可恢复轨迹且能与生理信号对齐的锚点，再补全中间帧，可缓解极稀疏观测下的时间歧义。摘要未提供数据集名称、具体指标、比较方法或“单次观测”的精确采样条件。

Abstract: Dense cardiac dynamics are essential for assessing cardiac function, yet in practice clinicians often observe only extremely sparse measurements. However, recovering full dynamics from such sparsity is a highly ill-posed problem due to the lack of temporal cues. While auxiliary time-series signals like ECG provide physiological guidance, effectively exploiting them is challenging due to the cross-modal representation gap and phase misalignment. In this work, we present CardioFAD, a Focus–Align–Diffuse paradigm that reformulates sparse cardiac dynamic synthesis as a recoverability–alignability anchor discovery problem. Our core insight is that resolving extreme temporal ambiguity requires a compact set of anchor states that are both sufficient to recover the visual trajectory and reliable for ECG–visual alignment. We therefore learn motion-salient keyframes under two complementary principles: trajectory sufficiency, which preserves trajectory-critical intra-modal motion content, and anchor alignment, which promotes consistent inter-modal correspondence at these anchors. We implement the Focus and Align modules optimized by the two aspects. Diffuse then performs two-stage generation by first synthesizing keyframes and subsequently interpolating the remaining frames. Extensive experiments on cardiac MRI and echocardiography videos demonstrate superior visual quality, temporal coherence, and improved functional consistency under the extreme one-shot regime.

Table of Contents

cs.CV [Back]

[1] Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment cs.CVPDF

[2] Action Jets: Learning the Local Shape of the Action-conditioned Data Manifold cs.CVPDF

[3] WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models cs.CVPDF

[4] MonoMIP: Multi-Height Inverse Perspective Mapping for Monocular 3D Object Detection cs.CVPDF

[5] The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video Understanding cs.CVPDF

[6] Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models cs.CV | cs.AI | cs.CLPDF

[7] A Gradient-Regularized Deep Learning Method for Restoring Image in Myopic Vision cs.CVPDF

[8] Long-horizon Video Generation with Slot Memory Addressed By Region Tokens cs.CVPDF

[9] LAMP: 3D Source-Aware Lighting Estimation at Multiple Points cs.CVPDF

[10] Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation cs.CVPDF

[11] SonoWorld: Towards Interactive Pose-Controllable Ultrasound World Models cs.CVPDF

[12] NavAble: A Large-Scale Dataset and Synthetic Data Generation Pipeline for Blind Navigation cs.CV | cs.ROPDF

[13] MMKG-R1: Constructing Multimodal Knowledge Graphs via Reinforcement Learning cs.CVPDF

[14] VLX-Go: Robust Embodied Tracking through Multi-Stage Learning and On-Policy Refinement cs.CV | cs.CL | cs.ROPDF

[15] The Impact of Detector Architecture, Model Scale, and Scene Density on Multi-Pedestrian Tracking cs.CV | cs.LGPDF

[16] WinARDet: Compressed Window Auto-Regression for Long-Horizon Vision-Language Grounding cs.CVPDF

[17] VideoHarness-SRSI: Structured Recursive Self-Improvement for Video Understanding Harness cs.CV | cs.AIPDF

[18] DeBoneDiT: Depth-Driven Conditional Bridge Diffusion Transformers for Bone Suppression in Chest X-Ray Images cs.CVPDF

[19] ActICL: Post-Training for Agentic Multimodal In-Context Learning cs.CV | cs.CLPDF

[20] Holi-Spatial 360: Generative Reconstruction from Sparse Panoramas for Spatial Rendering and Intelligence cs.CVPDF

[21] Robust Real-Time Monocular Human Pose Estimation with Insole-Based Sensor Fusion cs.CV | cs.AIPDF

[22] HyrCap: Hybrid Rank-Calibration of Action Proposals for Temporal Event Understanding cs.CVPDF

[23] TextVerifier: Seeing Beyond Recognition to Verify Chinese Text Rendering cs.CVPDF

[24] Learning Visual Speech Representations via Cross-Modal Distillation and Joint Face-Lip Modeling cs.CV | eess.ASPDF

[25] SaTPO: Text-to-Image Safety Alignment via Transition Preference Optimization cs.CVPDF

[26] Frame Evidence:A Benchmark for Reference Frames and Visual Evidence in Multi-Image Spatial Reasoning cs.CV | cs.AIPDF

[27] LED-BENCH: A Benchmark for Large-format Engineering Drawing Understanding cs.CVPDF

[28] CORE: Contrast-and-Reflect for Self-Supervised Prompt Optimization in Anomaly Synthesis cs.CVPDF

[29] What Breaks in Multi-Image Schema Application? Factorial Oracle Interventions Reveal an Instance-Information Bottleneck cs.CVPDF

[30] MagicGarment: Benchmarking Single-Image Standalone 3D Garment Reconstruction cs.CVPDF

[31] Adaptive Observation Control for Active Visual Recognition cs.CVPDF

[32] Self-Conditioning Enables Deep Sequential Reasoning in Flow Matching cs.CV | cs.LGPDF

[33] SPECTRA-VLA: Base-Fine Hyperspectral Token Transfer at Frozen Vision-Language-Action Interfaces cs.CVPDF

[34] Remember, Revisit, Revise: Scaffold Memory for Long-Horizon 3D Geometry cs.CVPDF

[35] SceneAE: Scene Generation and Reconstruction in Queryable 3D-Anchored Latent Space cs.CV | cs.AIPDF

[36] A Diagnostic Study of World-Space Human Recovery Under High Camera Dynamics cs.CVPDF

[37] Mitigating Video Hallucinations via Attention-Guided Representation Perturbation cs.CV | cs.AI | cs.CLPDF

[38] FPV-CRASH: A Dataset for Offline Crash Moment Localization in Drone First-Person-View Videos cs.CVPDF

[39] StateCraft: Augmenting Video World Models with Abstract-State Reasoning cs.CV | cs.AI | cs.LGPDF

[40] PhyMetric: Diagnosing Physical Plausibility in Text-to-Video Generation via Scene-Level QA cs.CVPDF

[41] VisibilitySplat: Ray-Traced Occlusion for Relighting with 3D Gaussian Splatting cs.CV | cs.GRPDF

[42] DeltaStreamer: Towards Human-Like Agentic Streaming Video Understanding cs.CV | cs.AI | cs.HCPDF

[43] CoDy: Codec Dynamics as Complementary Priors for Unsupervised Temporal Action Localization cs.CVPDF

[44] BluePixel: Toward Native 4K Agentic Image Editing cs.CVPDF

[45] Multimodal Medical Image Parsing with Task-Specific Low-Rank Adapters cs.CV | cs.AI | cs.LGPDF

[46] SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking cs.CV | cs.LGPDF

[47] Instruction Mining From Images: Constructing a Synthetic Dataset for Multimodal Learning ILSP DCVLR Competition Submission cs.CVPDF

[48] Why 3D Reconstruction Breaks Down on Under-Ice AUV Video, and How to Predict It cs.CV | cs.ROPDF

[49] GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation cs.CV | cs.AI | cs.CRPDF

[50] Feasibility of a Patient-Specific Digital Twin for Ventriculoperitoneal Shunt Trajectory Planning cs.CV | q-bio.QMPDF

[51] VisualWorldBench: A Fine-Grained Multi-Task Benchmark for Evaluating Visual World Knowledge in MLLMs cs.CVPDF

[52] When Pairwise Preferences Cycle: A Reliability-Anchored Preference Walk for Video GRPO cs.CVPDF

[53] RTAformer: Relation-Transition-Aware Transformer for Video Scene Graph Generation cs.CVPDF

[54] RepForcing: Representation-Space Initialization for Autoregressive Video Distillation cs.CVPDF

[55] DreamHMR: From Video Generation to Human Motion Modeling via Structural Focusing cs.CV | cs.AIPDF

[56] StreamErase: Towards Ultra-Fast Streaming Video Erasing cs.CVPDF

[57] Attention-Based Spatio-Temporal Approach for Fire and Smoke Detection cs.CVPDF

[58] OneLA: Learning Many Worlds from Latent Actions cs.CVPDF

[59] Continual pretraining Prostate MRI ViT Encoder for task alignment cs.CV | cs.LGPDF

[60] Glance Forcing: Making Bidirectional Diffusion Autoregressive at a Glance cs.CVPDF

[61] PAWA: Panoramic Action-conditioned World Modeling for Multiple Agents cs.CV | cs.AIPDF

[62] GLoD-LVSM: Learning Geometry-Grounded Continuous-LoD Scene Representations for Large View Synthesis Models cs.CV | cs.GRPDF

[63] Beyond Static Cues: Unified Dynamic Detection of MLLM Backdoors via Dual-Flow Trajectory Analysis cs.CV | cs.AIPDF

[64] Read, Parse, Describe: Unified Document Parsing with Visual Element Description Generation cs.CV | cs.AIPDF

[65] InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views cs.CVPDF

[66] ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions cs.CVPDF

[67] STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents cs.CVPDF

[68] OLiVES: An Outdoor Low-Light Video Benchmark for Enhancement and Segmentation cs.CVPDF

[69] Reliability-Aware Multimodal Sentiment Prediction Under Local Modality Missingness cs.CVPDF

[70] Speculative Sampling in Interactive Video Generation cs.CV | cs.HCPDF

[71] Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation cs.CVPDF

[72] GeoThinker-$F$: Endogenous Predictive World Representations for Fast Spatial Intelligence cs.CVPDF

[73] Player-1: Learning to Play from Synthetic Experience cs.CV | cs.AI | cs.HCPDF

[74] DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning cs.CVPDF

[75] CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image Generation cs.CVPDF

[76] VITAL: From Visual Motion to Precise Action cs.CVPDF

[77] Representation Conditioning for Generation cs.CVPDF

[78] Can Learning to Answer Spatial Questions Improve Novel-View Generation? cs.CVPDF