cs.CV [Total: 87]
cs.CL [Total: 28]
cs.AI [Total: 6]
cs.CR [Total: 3]
cs.GR [Total: 2]
cs.IR [Total: 1]
cs.LG [Total: 13]
cs.MM [Total: 1]
cs.RO [Total: 10]
eess.AS [Total: 1]
eess.IV [Total: 1]

cs.CV [Back]

[1] PanoPed: Beyond Bounding Boxes for Sim-to-Real Panoramic Pedestrian Tracking cs.CVPDF

Qinfeng Zhu, Weiguang Zhao, Yunxi Jiang, Anh Nguyen, Lei Fan

TL;DR: PanoPed是全球面行人跟踪sim-to-real基准：合成集108,000帧，含固定、四足和无人机相机及同步掩码/深度/位姿/3D状态；真实集28,002帧，其中16,247帧密集标注。Sextant仅约0.035M参数、复用冻结检测器，以角度头改进球面定位；PanoPed-S上MOTIP HOTA从47.30升至49.49，合成训练头零样本迁移到真实视频仍提高0.96–1.14。

Details

Motivation: 全景摄像机能让固定监控和移动机器人向各方向跟踪行人，但平面ERP边界框无法完整描述球面上的位置。特别是ERP框不能唯一确定人的球面中心和可见角度范围，可能限制跟踪定位。

Result: PanoPed-S含108,000帧，来自固定、四足机器人和无人机相机，附同步掩码、深度、相机位姿及行人3D状态；PanoPed-R含28,002真实帧，16,247帧稠密标注。作者发现ERP矩形框不能唯一确定球面中心和可见角度范围，但检测器视觉query仍含相关信息。Sextant是约0.035M参数的可插拔角度定位头，复用冻结检测器，不改跟踪身份且无需额外图像编码器。PanoPed-S测试中表现最佳，将最强MOTIP基线HOTA从47.30提升到49.49，八个测试序列全部改善。无真实微调时，同一合成训练头在真实视频上让MOTIP和HAT提高0.96–1.14 HOTA，两种初始化均改善每个真实序列；不加定位图像编码器的系统中HAT+Sextant最佳。

Insight: 球面行人定位应直接建模角度位置，而非仅依赖投影平面框；轻量角度头可在不改检测器和身份轨迹的情况下改善定位。合成到真实迁移有稳定增益，但摘要未提供真实集绝对HOTA值。

Abstract: Full-sphere panoramic cameras let fixed monitoring systems and mobile robots track people in every direction, but a planar bounding box does not fully describe where a person is on the sphere. We introduce PanoPed, a sim-to-real benchmark for pedestrian tracking on the full sphere. PanoPed-S contains 108,000 frames from fixed, quadruped-mounted, and drone-mounted cameras, with synchronized masks, depth, camera poses, and 3D pedestrian states. PanoPed-R adds 28,002 real frames from fixed cameras, 16,247 of them densely annotated. We find that an ERP rectangle cannot uniquely determine the spherical center and angular extent of the visible person, while the detector’s visual query still carries information about them. Inspired by the sextant’s use of angular measurements to locate objects, we propose Sextant, a plug-and-play angular localization head with only about 0.035M parameters. It reuses a frozen detector, keeps track identities unchanged, and needs no extra image encoder. Sextant gives the best result in our PanoPed-S test comparison, raising the strongest baseline, MOTIP, from 47.30 to 49.49 HOTA, with gains on all eight test sequences. Without fine-tuning on real data, the same synthetic-trained heads improve MOTIP and HAT by 0.96-1.14 HOTA on real video, and both seeds improve every real sequence. HAT+Sextant scores best among the compared systems that add no localization image encoder.

[2] Pre-training, Reasoning, Benchmarking: X-ray Report Generation on CheXpert Plus Dataset cs.CV | cs.AIPDF

Xiao Wang, Yuxiang Zhang, Dan Xu, Yuehang Li, Shiao Wang

TL;DR: 本文为CheXpert Plus建立X线报告生成基准，覆盖主流RRG模型和LLM，并提出MambaXray-PRB：依次进行自监督自回归建模、X线—报告对比学习和面向推理/报告生成的后训练。IU X-ray、MIMIC-CXR和CheXpert Plus实验报告有效性和可解释性提升，但摘要未提供数值。

Details

Motivation: X线报告生成有望减轻临床医生工作量，但领域仍缺统一基准、可靠比较和通用大模型的领域适配。新发布的CheXpert Plus缺少基线实现和评估结果，阻碍后续公平比较。

Result: 作者先建立包含常见X线报告生成模型和LLM的CheXpert Plus综合基准，为后续研究提供对照。再提出MambaXray-PRB多阶段框架，先做自监督自回归建模，再做X线图像—报告对比学习，最后针对推理和报告生成进行后训练优化。IU X-ray、MIMIC-CXR和CheXpert Plus实验验证其报告生成有效性，并称模型可解释性增强；摘要没有具体指标或比较幅度。

Insight: 统一基准可补足CheXpert Plus缺乏基线的问题，而多阶段预训练和多模态CoT提供大模型报告生成的领域适配路径。现有摘要未呈现具体评分、基线或解释性测量，因此只记录论文报告的定性结论。

Abstract: X-ray image-based Radiology Report Generation (RRG) constitutes a critical research direction within medical artificial intelligence, with great potential to alleviate clinicians’ diagnostic workload and shorten patient waiting periods. Despite substantial advances over recent years, the field faces evident bottlenecks stemming from insufficient standardized benchmarks and inadequate domain adaptation of generic large models. Notably, the newly released CheXpert Plus dataset is provided without accompanying baseline implementations and evaluation results, which impedes standardized training, quantitative evaluation and fair comparison among follow-up algorithms. To mitigate this limitation, we establish a comprehensive benchmark encompassing prevailing X-ray report generation models and Large Language Models on CheXpert Plus. This benchmark delivers a reliable comparative foundation for upcoming methods and enables researchers to rapidly identify state-of-the-art approaches within this domain. Beyond benchmark construction, we rethink X-ray RRG under the paradigm of large models and propose a novel framework termed MambaXray-PRB. Our framework improves report generation performance and enhances model interpretability via multi-stage large-model pre-training and multi-modal Chain-of-Thought reasoning. The pipeline consists of three successive phases: self-supervised auto-regressive modeling, X-ray-report contrastive learning, and post-training optimization for reasoning and report generation. Extensive experiments on IU X-ray, MIMIC-CXR, and CheXpert Plus datasets validate the effectiveness of MambaXray-PRB for radiology report generation. The source code of this paper is available on https://github.com/Event-AHU/Medical_Image_Analysis

[3] VCR-Bench: A Modular Open-Source Benchmark for Video Classification Robustness cs.CVPDF

Maksim Plinskiy, Aleksandr Gushchin, Sergey Lavrushkin, Dmitriy S. Vatolin, Anastasia Antsiferova

TL;DR: VCR-Bench是模块化开源视频分类鲁棒性评测框架，统一视频加载、分类器封装、攻击、防御、感知指标、配置和日志；当前集成30种模型、14种攻击和10种防御。在Kinetics-400子集上报告干净准确率、攻击成功率、感知质量、运行时间和内存，支持复现实验。

Details

Motivation: 图像分类鲁棒性已有多个基准，视频对应评测仍缺失。视频时间维度带来额外攻击自由度，时间采样、扰动预算和指标聚合还会相互作用；现有实现分散不兼容，导致数字难复现和分析。

Result: VCR-Bench提供模块化开源框架，标准化视频加载、分类器包装、对抗攻击与防御、感知指标、配置预设和结果日志。当前整合30个视频分类模型、14种攻击、10个防御包装，并在共同协议下评估代表性组合。Kinetics-400子集实验报告干净准确率、攻击成功率、感知质量、运行时间和内存等。框架提供文档化安装、可复现实验预设、组件扩展接口和复现脚本；摘要未列具体基准数值。

Insight: 视频鲁棒性结果需要标准化时序采样和攻击预算等设置，避免不同实现的数字不可比。该框架侧重基准与工具基础设施，并不声称提出特定新攻击/防御方法；需看完整结果才能比较模型鲁棒性。

Abstract: Robustness of image classification has several benchmarks, but their video counterparts are absent. In video classification temporal dimension introduces additional degrees of freedom for adversarial attacks, defenses, and preprocessing. Temporal sampling, perturbation budgets, and metric aggregation also interact in ways with no direct analogue in the image setting. Therefore, robustness for video classifiers is studied across scattered, incompatible implementations, making reported numbers hard to reproduce and analyze. We introduce VCR-Bench, a modular open-source benchmark framework that standardizes video loading, wrappers for classifiers, adversarial attacks and defenses, perceptual metrics, configuration presets, and result logging. VCR-Bench currently integrates 30 video classification models, 14 adversarial attacks, and 10 defense wrappers under a common evaluation protocol. We evaluate representative video classifiers, attacks, and defenses on Kinetics-400 subset, reporting clean accuracy, attack success rate, perceptual quality, runtime, and memory usage. VCR-Bench is released with documented installation, reproducible run presets, component-extension interfaces, and scripts for reproducing the reported results at https://github.com/msu-video-group/vcr-bench.

Yunheng Liu, Ziqi Cai, Siqi Yang, Yimu Wang, Minggui Teng

TL;DR: SPW-Nav是语言指令驱动的流式全景世界模型，从单张全景图实时生成一分钟2K 360°视频，并把每条指令解释为相对前一生成全景的相机运动。其球面旋转解耦、姿态对齐平移条件及多项记忆支持长时程指令切换；在相机跟随准确率和视频质量上超过既有全景生成器。

Details

Motivation: 语言驱动全景视频可用于交互式3D探索、VR和具身训练，但既有全景生成器通常沿预定轨迹生成，交互式世界模型则在透视视图中依据低层动作控制，难以按语言连续导航。

Result: SPW-Nav从单张全景图流式生成一分钟2K 360度视频，将每条运动指令解释为相对于当前生成全景的相机运动。球面旋转解耦在球面上精确施加旋转；姿态对齐条件使长流中的平移输入保持有界；多项记忆和少步生成器支持随指令变化继续场景。作者还构建含相机轨迹及验证指令的SPW-NavSet。实验中SPW-Nav的相机跟随准确率和视频质量超过先前全景生成方法，并支持运行时切换指令；摘要未给具体分数。

Insight: 长程360度生成需让姿态和记忆表示随球面几何稳定演化，否则累积运动会导致偏移；该系统把语言直接映射为相机轨迹而非低层动作。摘要报告实时生成分钟级视频，但未给帧率、显存或相机跟随数值。

Abstract: Language-guided panoramic video generation benefits various downstream applications, such as interactive 3D scene exploration, virtual reality experiences, and embodied agent training. Existing panoramic generators follow predefined trajectories, and interactive world models act through low-level actions in perspective views. We propose SPW-Nav, a streaming panoramic world model that understands movement instructions and streams one minute of 2K 360-degree video in real time from a single panorama. SPW-Nav interprets each instruction in the previously generated panorama as camera motion. Spherical rotation decoupling applies rotation exactly on the sphere, pose-aligned conditioning keeps translation inputs bounded over long streams, and a multi-term memory with a few-step generator continues the scene as instructions change. We also build SPW-NavSet, panoramic videos with camera trajectories and verified instructions. Driven by language, SPW-Nav outperforms prior panoramic generators in camera-following accuracy and video quality, and supports on-the-fly instruction switching.

[5] MoR-MLLM: Mixture of Recursions for Efficient Multimodal Large Language Models cs.CVPDF

Pengcheng Zheng, Chaoning Zhang, Jiaxin Yan, Sihan Cao, Jianwei Zhang

TL;DR: MoR-MLLM将Mixture-of-Recursions用于MLLM，使每个token按语义复杂度动态决定递归深度：视觉/语言难token获得更多计算，简单token跳过冗余操作。三阶段MoR-Tuning和熵正则用于稳定多模态递归稀疏训练；实验报告相较轻量MLLM降低训练内存和计算，同时保持多种视觉语言任务的高表现。

Details

Motivation: MLLM在视觉和语言任务中推理能力强，但计算与内存需求很大。轻量语言骨干虽降低规模，固定稀疏和固定深度分配仍不能按token语义复杂度适配计算预算。

Result: MoR-MLLM基于Mixture-of-Recursions框架，对每个token自适应分配递归深度，对视觉或语言上困难token增加计算、对简单token跳过冗余操作。为稳定多模态递归稀疏训练，作者设计三阶段MoR-Tuning和熵正则损失，鼓励路由分布多样。多个视觉语言任务实验显示，相较近期先进tiny MLLM，训练内存和计算复杂度显著降低，同时保留较高性能；摘要未给具体资源或任务分数。

Insight: 按token语义难度分配递归计算，比固定每层/每token预算更灵活；路由多样性正则和分阶段微调支持稳定训练。摘要只报告定性效率—性能优势，缺少具体模型规模、加速比和基准指标。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities across vision and language tasks. However, their massive computational and memory demands hinder real-world deployment. While recent efforts reduce costs by employing lightweight language backbones, existing paradigms remain computation-dense due to their static sparsity and depth allocation, which cannot adapt to the semantic complexity of each token. To this end, we propose MoR-MLLM, a computation-sparse MLLM based on the recent Mixture-of-Recursions (MoR) framework. MoR-MLLM introduces adaptive per-token recursion, allowing the model to dynamically adjust its recursive depth and allocate more computation to visually or linguistically challenging tokens while skipping redundant operations for simpler ones. To stabilize the training of recursive sparsity in multimodal settings, we further design a three-stage MoR-Tuning strategy and an entropy-regularized loss to encourage diverse routing distributions. Extensive experiments show that compared with recent advanced tiny MLLMs, our proposed MoR-MLLM can greatly reduce the training memory and computation complexity while retaining high performance on various vision-language tasks.

[6] Personalize at Test Time: Learning User Preferences for Image Generation cs.CV | cs.AIPDF

Jiamu Bai, Jiaming Hu, Yanhong Wu, Zellux Wang

TL;DR: 本文从用户历史图像偏好对学习个性化奖励模型：自编码器将数百视觉属性压缩到50个属性锚定偏好维度，用户偏好表示为共享维度分数的线性组合，并用Bradley–Terry似然估计权重。真实用户数据上留出偏好对预测准确率约77%，冻结扩散模型生成结果与个人偏好更一致。

Details

Motivation: 扩散模型能生成高质量图像，但不同用户偏好多样且可用反馈有限，难以个性化对齐。传统方法需要人工偏好标注或用VLM解析用户历史，标注和计算成本较高。

Result: 方法先用自编码器将数百视觉属性压缩为50个属性锚定偏好维度，并训练评估器按这些维度给图像打分；每位用户偏好表示为共享维度分数的线性加权组合。基于用户历史图像偏好对，在Bradley–Terry模型下最大化似然估计用户权重，把个性化适配缩减为低维向量学习。得到的个性化奖励在推理时引导图像生成，扩散模型参数保持冻结。真实用户偏好数据实验中，留出偏好对预测准确率约77%，生成图像与个人偏好对齐改善。

Insight: 利用共享属性维度可将每用户适配变为少量权重学习，从而从稀疏偏好反馈中个性化生成，而无需反复微调扩散模型。约77%是留出偏好对预测准确率，摘要未报告生成质量提升幅度和不同用户数据需求。

Abstract: Diffusion models can generate high-quality images, yet aligning their outputs with individual user preferences remains challenging. A key bottleneck is accurately modeling diverse user preferences from limited feedback. Existing approaches often rely on labor-intensive manual preference annotations or vision-language models (VLM) to extract preference information from user interaction histories, introducing substantial annotation or computational costs that limit scalability. We propose an approach that learns personalized reward models directly from users’ historical image preference pairs. First, we use an autoencoder to compress hundreds of visual attributes into 50 attribute-anchored preference dimensions and train an evaluator to score images along these dimensions. We then represent each user’s preferences as a linear combination of the shared dimension scores, estimating the user-specific weights by maximizing the likelihood of their observed pairwise preferences under the Bradley-Terry model. This formulation reduces per-user adaptation to optimizing a low-dimensional weight vector, simplifying optimization and enabling data-efficient personalization from sparse feedback. The learned personalized rewards guide image generation at inference time while keeping the diffusion model frozen. Experiments on real-user preference data show that our approach achieves approximately 77% held-out pairwise preference prediction accuracy and improves the alignment of generated images with individual user preferences.

[7] RACER: Reflective Agent Coupling Query Interpretation and Tool-Based Retrieval for Frame Selection in Long Video Understanding cs.CV | cs.AIPDF

Yiyang Huang, Yitian Zhang, Yizhou Wang, Jianglin Lu, Qihua Dong

TL;DR: RACER将长视频帧选择拆为轻量Vid-LLM的查询解释和嵌入检索器的证据定位，再把检索帧反馈给LLM迭代修订子查询。它针对相似度法难理解复杂查询及LLM直接选帧不稳两类问题，免训练并在多个基准上持续改善长视频理解。

Details

Motivation: Vid-LLM依靠选帧进行视频推理，但复杂查询需要从大量候选中跨片段找到相关证据。直接相似度检索可能未理解查询隐含信息需求；让LLM直接判断帧又会混淆查询解释和证据选择。

Result: RACER是免训练反思式智能体框架。轻量Vid-LLM仅负责把复杂问题改写为显式子查询，以弥补Query Comprehension Gap；嵌入模型作为检索工具，依据子查询定位证据，避免LLM直接做帧级选择，缓解Interpretation–Selection Gap。检索帧再反馈给LLM细化子查询，形成迭代反思循环。多个基准实验显示其持续提升长视频理解；即使组件能力有限，智能体式组合也能提升更强Vid-LLM表现。摘要未列具体数值。

Insight: 把复杂查询语义解析与大规模证据检索分工，可让LLM专注表达隐含信息需求，让检索器专注定位；反馈循环再共同修正两者。组件较弱仍可受益说明系统编排重要，但摘要未报告各基准提升幅度和额外时延。

Abstract: Video large language models (Vid-LLMs) excel at diverse video-language tasks by reasoning over selected frames. However, frame selection for long videos remains challenging, as it requires retrieving relevant frames distributed across segments from a large candidate pool given complex queries. This paper investigates dominant approaches to long-video frame selection from a task-decomposition perspective, identifying two key challenges: the Query Comprehension Gap in similarity-based methods and the Interpretation–Selection Gap in judgment-based methods. To address them, we propose RACER, a training-free reflective agentic framework that decomposes long-video frame selection into query interpretation driven by a lightweight Vid-LLM and evidence localization supported by an embedding model serving as a retrieval tool. Specifically, the Vid-LLM is responsible solely for reformulating the complex query into sub-queries that make implicit information requirements explicit, mitigating the Query Comprehension Gap. Meanwhile, the retrieval tool leverages these sub-queries to localize relevant evidence, relieving the Vid-LLM of direct frame selection and thus addressing the Interpretation–Selection Gap. Finally, the retrieved frames are fed back to the Vid-LLM for sub-query refinement, forming a reflection loop that iteratively improves query interpretation and frame selection. Experiments across multiple benchmarks show that RACER consistently improves long video understanding. Notably, RACER achieves effective frame selection even with limited-capability components, demonstrating that agentic integration enables these components to enhance more capable Vid-LLMs.

[8] Shape-Bayes: Bayesian Inference of Structured Shapes under Visual Ambiguity cs.CVPDF

Mani Kumar Tellamekala, Tosh Brown, Michel Valstar

TL;DR: Shape-Bayes将面部关键点回归从确定性点估计改为概率贝叶斯形状推断：基础模型输出带异方差不确定性的landmark，Transformer形成PCA形状流形自适应先验，可微求解器融合视觉证据和几何约束。重遮挡下较SOTA确定模型IDR绝对提升最高约34%，相对误差降最多12.5%。

Details

Motivation: 真实场景中的结构化形状感知本质上有歧义，但多数方法仍回归固定坐标。视觉证据缺失或严重遮挡时，确定性回归容易结构坍塌，产生不连贯形状或退回平均模板。

Result: Shape-Bayes结合不确定性感知视觉感知与贝叶斯形状推理，动态权衡视觉证据和几何先验，估计结构有效的形状后验。系统先预测噪声关键点和蒸馏的偶然不确定度；轻量Transformer据此在PCA形状流形上编码自适应先验；可微贝叶斯求解器以闭式后验融合预测与先验。人脸形状回归测试覆盖非刚性形变和严格解剖约束。相较SOTA确定性模型，IDR绝对提升最高约34%；同时提供校准良好的不确定区间，相对误差最多降低12.5%，报告在严重遮挡2D人脸回归上达到SOTA。

Insight: 遮挡越重，模型越应根据预测不确定性降低视觉证据权重并依赖结构先验，而非输出一个脆弱点估计；概率后验同时保持结构完整并量化可信度。摘要未说明IDR指标定义，34%为绝对提升，需结合论文指标解释。

Abstract: Perceiving structured shapes, such as human faces, from pixels is an inherently ambiguous task in real-world conditions. Yet, shape inference is largely posed as a deterministic regression task predicting fixed spatial coordinates. We find that deterministic regression is brittle when visual evidence is ambiguous or incomplete; under severe occlusions deterministic models exhibit structural collapse, predicting incoherent shapes or reverting to generic averages. To address this, we introduce Shape-Bayes, a probabilistic framework that couples uncertainty-aware visual perception with Bayesian shape reasoning. Rather than forcing point estimates, Shape-Bayes dynamically weights visual evidence against geometric priors to infer a structurally valid shape posterior. Demonstrated on human face shape regression, a rigorous testbed featuring complex non-rigid deformations and strict anatomical constraints, Shape-Bayes comprises: (1) a base model predicting noisy landmarks alongside distilled aleatoric uncertainties; (2) a lightweight Transformer encoding these observations into an adaptive prior over a PCA shape manifold; and (3) a differentiable Bayesian solver computing closed-form posteriors by balancing the noisy predictions against this prior. By guaranteeing complete structural integrity, Shape-Bayes achieves an absolute improvement of up to ~34% IDR over state-of-the-art deterministic models. Simultaneously, it yields highly calibrated uncertainty bounds and reduces relative error by up to 12.5%, establishing a new state-of-the-art for robust 2D face shape regression under severe occlusion. The project page is at https://shape-bayes.github.io.

[9] OverLay++: Dense-Overlap Layout-to-Image Generation Dataset cs.CVPDF

Shivansh Aggarwal, Shresth Grover, Divyansh Srivastava, Haiyang Xu, Bingnan Li

TL;DR: OverLay++是面向密集重叠场景布局到图像生成的数据集，约50万张图、平均每图6.6个对象，标注密度比现有数据集高1.67倍，单对象caption长度超过六倍。多个基准上用该数据训练的SOTA布局生成器表现提高且收敛更快。

Details

Motivation: 布局到图像生成在空间和对象控制上进展明显，但复杂场景中大量对象相互重叠和交互仍困难。作者认为训练数据缺少密集、复杂对象交互样本是重要瓶颈。

Result: OverLay++提供约500,000张结构复杂图像，平均每图6.6个对象，标注密度是既有数据集的1.67倍；除了数量密集，每个对象还有丰富语义信息，caption平均长度超过现有数据集六倍。数据生成流程旨在产出密集重叠对象标注和丰富逐对象描述。多个基准中，使用OverLay++训练的SOTA布局到图像方法持续提升并更快收敛，支持密集、重叠感知、caption丰富监督的价值；摘要未给具体指标。

Insight: 复杂布局生成需要数据表达对象间重叠和细粒度语义，而不只增加图像总量；更密集标注和更长对象描述与更好性能及收敛相关。摘要未列每个基准的具体提升和生成数据验证细节。

Abstract: Layout-to-Image generation has made substantial progress in spatial and object-level control. However, existing methods still struggle with complex scenes containing many overlapping and interacting objects. We argue that training data is a particular bottleneck: existing datasets lack examples with dense, complex object interactions. To address this gap, we introduce OverLay++, a large-scale Layout-to-Image dataset with structurally complex scenes. OverLay++ contains approximately 500K images with an average of 6.6 objects per image, exceeding existing datasets by 1.67 times in annotation density. Beyond annotation density, OverLay++ provides rich semantic detail with object captions over six times longer than in current datasets. Our dataset generation pipeline is simple and produces dense, overlapping object annotations with rich per-object captions. Across multiple benchmarks, state-of-the-art Layout-to-Image methods trained on the OverLay++ dataset show consistent improvement and faster convergence, demonstrating the importance of dense, overlap-aware, and caption-rich supervision for controllable image generation.

[10] Anaximander: Interactively Running Geospatial Deep Learning Models on Any Compute Backend cs.CVPDF

Satej S. Soman, Akram Zaytar, Girmaw A. Tadesse, Gilles Q. Hacheme, Muhammad S. Danish

TL;DR: Anaximander将卫星影像模型来源与算力后端选择统一到一个交互式GIS界面：推理服务加载多来源模型、缓存会话并按瓦片流式返回结果，QGIS插件负责切片、拼接、地理配准和进度展示。作者用农业地块划分演示云端GPT Image、远端GPU SAM3和本地CPU模型的无代码并排比较。

Details

Motivation: 遥感从GIS应用深度学习时，模型格式和算力环境各异；分析师在得到第一张预测前往往需写部署、瓦片处理和地理配准代码，增加模型比较摩擦并影响农田划分、作物监测和灾害响应等实际选择。

Result: 系统以推理服务器统一处理多个常用模型源并可部署到任意可用计算后端，支持会话管理、模型缓存和逐瓦片结果流式返回；配套QGIS插件负责影像切片、结果重组、地理配准和逐瓦片实时状态。另可将图层图例注入VLM提示。在农业地块划分任务中，作者演示无代码并排比较云API的gpt-image-1、远端GPU上的SAM3和本地CPU上的DelineateAnything。后端及协议开源；摘要未报告准确率或效率基准。

Insight: 把瓦片/坐标处理和模型部署统一封装到GIS工作流，可降低遥感人员公平比较异构模型的工程门槛。论文主要展示系统设计和演示，尚无量化比较质量、时延或算力成本的实验。

Abstract: Applying deep learning models to satellite imagery from within geographic information systems (GIS) remains high-friction for remote sensing practitioners. Models arrive in incompatible formats and target different compute environments, from local workstations to serverless cloud services. As a result, every evaluation demands custom deployment, tiling, and georeferencing code before a single prediction reaches the analyst’s map. This friction discourages systematic comparison in a domain where model choice directly affects operational outcomes such as field delineation, crop monitoring, and disaster response. We present Anaximander, an open-source system that unifies model source and compute location choice behind one interactive interface. The system’s backend is an inference server that loads models from multiple commonly-used sources and serves them on any accessible compute backend. The server provides session management and model caching, and streams results back per tile. The backend is paired with a QGIS plugin that drives tiling, result reassembly, georeferencing, and real-time per-tile status visualization. An additional user-interface path injects layer legends as prompts into vision-language models. We demonstrate the system in a code-free side-by-side comparison of three heterogeneous models on an agricultural field delineation task: gpt-image-1 via a cloud API, Segment Anything Model 3 (SAM3) on a remote GPU, and DelineateAnything on a local CPU. The inference backend and protocol are open-source and available at https://github.com/microsoft/nxmndr.

[11] TopoCurve: Geometry-Aware Topology Reasoning via Bézier Curves in Autonomous Driving cs.CVPDF

Mihai Bogdan Deaconu, Laura Dioşan

TL;DR: TopoCurve以端点固定的三次Bézier曲线表示3D车道，获得连续几何、解析切向和全局空间支持，并在拓扑头中编码端点距离/切向对齐、用曲线采样点指导可变形注意力，还提供多分支拓扑监督。OpenLane-V2上无后处理达50.6 OLS，端点检测DET_p为56.8，高于先前52.6。

Details

Motivation: 自动驾驶拓扑推理需从多视图图像检测3D车道及交通元素并推断连接关系。现有离散折线缺少平滑性、解析方向和全局空间支持，且拓扑监督稀疏。

Result: TopoCurve使用端点固定三次Bézier曲线参数化车道，确保端点精确且可解析求方向。全流程共享曲线几何：多尺度Fourier特征编码端点距离和切向对齐，注入拓扑头；采样曲线点作为对齐几何的跨注意力参考，覆盖整条车道；并行曲线锚定注意力分支为一对多拓扑监督提供多样预测，形成表示—推理—特征聚合—密集监督的级联。OpenLane-V2上不需后处理达到50.6 OLS，在端到端纯相机方法中为SOTA；端点检测DET_p为56.8，优于此前52.6。

Insight: 连续参数化不仅改善车道几何平滑，还可向拓扑推理提供解析方向和沿曲线密集参考点，缓解离散折线的稀疏监督问题。报告在OpenLane-V2的OLS与端点指标，摘要未给计算开销。

Abstract: Topology reasoning jointly detects 3D lanes and traffic elements from multi-view images and infers their structural connectivity. Current methods model lanes as discrete polylines, lacking smoothness, analytical tangent directions, and global spatial support for attention, while providing sparse topology supervision. We propose TopoCurve, a geometry-driven architecture for 3D topology reasoning grounded in a structured parametric lane representation. Lanes are modeled as endpoint-fixed cubic Bézier curves, enabling continuous geometry with exact endpoints and analytically defined directionality. We exploit this shared curve geometry across the entire pipeline. Endpoint distance and tangent alignment are encoded with multi-scale Fourier features and injected into the topology head. Sampled curve points serve as geometry-aligned references for deformable cross-attention spanning the full lane. Parallel curve-anchored attention branches provide diverse predictions for one-to-many topology supervision. These components form a tightly coupled cascade where representation enables geometric reasoning, guides feature aggregation, and supports denser supervision. TopoCurve achieves 50.6 OLS on the OpenLane-V2 benchmark without any post-processing, establishing a new state-of-the-art among end-to-end camera-only methods, and outperforms all existing approaches on endpoint detection (56.8 vs. 52.6 on DET_p).

[12] Depth-to-RGB: Repurposing a Frozen Depth Estimator for Geometry-Guided Compositing cs.CVPDF

Sanghyun Jo, Chae Yeon Lim, Donghwan Lee, Sihyun Kim, Soo Ye Kim

TL;DR: D2R使用冻结深度估计器和参考条件编码器特征学习未观测合成场景的深度，再由固定渲染器指导RGB生成。在匹配架构训练下，特征监督使OOD第一阶段AbsRel比解码深度监督低31.4%；类别不相交AnyInsertion++上比匹配RGB基线AbsRel低43.7%、PSNR高2.4 dB。

Details

Motivation: 参考图像物体合成依赖背景图、物体参考图和2D蒙版，但完成场景的几何仍隐式，可能扭曲物体结构或改变环境。作者希望预测输入RGB中未出现的合成后场景深度，并用其指导图像合成。

Result: D2R对冻结深度估计器做参考条件修正，以已完成场景成对样本编码器特征为监督；保持解码器不变，将修正后的表示映射为目标场景深度，再用独立训练且固定的渲染器指导RGB合成。在架构和训练匹配时，编码器特征监督使OOD第一阶段AbsRel较解码深度监督下降31.4%。作者构建AnyInsertion++，含同分布配对和类别不相交拆分。完整系统在两个配对拆分的几何估计及图像质量上领先12个开源和3个闭源基线；类别不相交数据上相较匹配RGB基线AbsRel低43.7%、PSNR高2.4 dB。三个无配对基准上领先身份指标，并将平均CLIP参考余弦距离较最强基线降低55%。

Insight: 仅根据合成后RGB监督可能忽略几何结构，训练冻结深度估计器的中间特征可改善类别外泛化；再固定解码器和渲染器让几何明确影响生成。摘要报告多个配对/无配对结果，需区分各自指标含义。

Abstract: Reference-based object compositing inserts or replaces an object using a background image, a reference image, and a 2D compositing mask. These inputs guide appearance and placement but leave the completed scene’s geometry implicit, which can distort object structure or alter the surroundings. Our Depth-to-RGB (D2R) framework predicts composite depth for a scene not yet observed in the RGB inputs. It learns reference-conditioned corrections to a frozen depth estimator using encoder features of paired completed scenes as targets. The unchanged decoder maps the corrected representation to the intended scene’s depth, which a separately trained renderer holds fixed during RGB synthesis. Under matched architecture and training, encoder-feature supervision reduces OOD Stage-1 AbsRel by 31.4% relative to decoded-depth supervision. We also introduce AnyInsertion++ with paired in-distribution and category-disjoint splits to evaluate generalization beyond compositing training categories. The complete D2R system leads 12 open-source and 3 closed-source baselines in estimator-derived geometry and photometric quality on both paired splits. On category-disjoint data, D2R reduces AbsRel by 43.7% and improves PSNR by 2.4 dB over the matched RGB baseline. Across three unpaired benchmarks, D2R leads both identity metrics and reduces mean CLIP reference cosine distance by 55% relative to the strongest baseline. Project page: https://shjo-april.github.io/Depth2RGB/

[13] SPLATIFY: Reproduce, Discover, Innovate! From Papers and Ideas to Trainable 3DGS Code cs.CVPDF

Seemandhar Jain, Keshav Gupta, Manmohan Chandraker

TL;DR: SPLATIFY是多智能体框架，可把3D Gaussian Splatting论文转成可训练的gsplat实现，并通过模块化模板、依赖顺序Graph-of-Thought、函数级引用检索和视觉反馈验证代码；SPLATIFY-Bench覆盖30篇论文。对无公开代码论文可匹配专家实现，将开发从数周缩至数分钟，并通过组合发现提升PSNR最高2.4 dB。

Details

Motivation: 3DGS研究快速增长，复现论文往往需要大量工程工作；通用论文到代码生成和前沿模型难处理渲染、稠密化、损失等方法细节，也难保证生成实现满足底层架构约束。

Result: SPLATIFY提出五项机制：为gsplat模块模板建立上下文无关文法，限制生成代码满足架构不变量；用分支感知引用恢复在函数粒度检索代码、按拓扑依赖顺序Graph-of-Thought合成、从20多个验证实现中RAG选例，并以PSNR再生成、高斯结构检查和VLM补丁提供视觉反馈；还自动组合正则项/损失/稠密化策略改进原方法，或从3DGS外检索物理先验用于新场景类型。SPLATIFY-Bench覆盖30篇多样论文。对无公开代码论文，系统匹配专家实现并把开发时间由数周降到数分钟；组合发现使PSNR最高提升2.4 dB。还演示完全由SPLATIFY合成的体积星云渲染等科学方法。

Insight: 论文复现代码需要约束生成结构、检索组件级实现并通过几何/渲染反馈循环校正，而非一次性从全文生成程序。组合式方法发现可超越复现，但摘要未提供30篇论文上的逐篇成功率。

Abstract: The rapid growth of 3D Gaussian Splatting (3DGS) research demands significant effort to reimplement papers before building on them. We introduce SPLATIFY, a multi-agent framework that converts 3DGS papers into trainable gsplat-based implementations, where generic paper-to-code methods and frontier models fail. SPLATIFY achieves this through five innovations: (1) A context-free grammar for gsplat over a modular method template with extension points for losses, densification, rendering, and optimization, constraining synthesis so generated code satisfies gsplat’s architectural invariants by construction. (2) Architectural elements for faithful reproduction: fork-aware citation recovery retrieving component-level code at function-level granularity, Graph-of-Thought synthesis in topological dependency order, RAG-guided in-context example selection from over 20 verified implementations, and visual feedback combining PSNR-guided regeneration, Gaussian-level structural checks, and VLM-driven patching. (3) Knowledge-driven compositional improvement that autonomously finds weaknesses and composes complementary regularizers, losses, and densification strategies to improve upon original results. (4) Interdisciplinary method discovery where agents retrieve physical priors from outside the 3DGS literature and compose them with rendering knowledge to produce methods for previously unaddressed scene types. (5) SPLATIFY-Bench, an evaluation framework across 30 diverse 3DGS papers. On papers without public code, SPLATIFY matches expert implementations while reducing development time from weeks to minutes, and through compositional discovery further improves PSNR by up to 2.4 dB. We additionally demonstrate novel methods for volumetric nebula rendering and other scientific domains, synthesized entirely by SPLATIFY.

[14] StyleFields: Multi-Scale AdaIN-Modulated Implicit SDFs for Coarse-to-Fine 3D Shape Reconstruction and Editing cs.CV | cs.GRPDF

Ehsan Garaaghaji, Nicolas Talabot, Pascal Fua, Doruk Oner

TL;DR: StyleFields以多层AdaIN在隐式DeepSDF不同解码深度注入潜变量，实现对象全局结构与细尺度细节的可控混合；粗到细辅助监督与逐层扩深让早层对应整体形状、后层对应高频细节，无需部件标签或对抗训练。作者还用可微气动阻力代理优化汽车形状。

Details

Motivation: 3D形状重建和编辑常希望将一个对象的粗结构与另一个对象的细节组合，但单一全局潜码难以控制不同尺度的几何样式，也可能纠缠内容和风格。

Result: StyleFields在DeepSDF解码器多个深度使用多级Adaptive Instance Normalization调制潜变量，并以粗到细的辅助头监督和逐渐增加网络深度，使不同层学习不同尺度属性。无需部件标签或对抗训练即可解耦内容与风格。实验展示高保真重建、跨实例混合效果，并在注入深度和监督粒度消融中持续获益。汽车空气动力学应用中，将可学习的阻力预测器作为可微目标优化重建汽车，通过冻结互补潜变量流针对性修改整体形状或表面细节。摘要未给具体重建指标。

Insight: 潜变量按解码深度分层注入和监督，可将整体结构控制与局部细节控制分开，为隐式3D形状编辑提供简单接口。气动代理优化演示了性能驱动设计潜力，但摘要未报告阻力改善数值。

Abstract: We introduce StyleFields, a DeepSDF-based architecture for high-fidelity 3D reconstruction that enables controllable geometric style mixing: the coarse structure of one object can be combined with the fine-scale details of another. The core idea is depth-aware modulation: instead of a single global code, we inject latents via multi-level Adaptive Instance Normalization at several decoder depths, and supervise matching auxiliary heads with a coarse-to-fine schedule while gradually growing network depth. This aligns early layers with global shape and later layers with high-frequency detail, achieving content-style decoupling without part labels or adversarial training. StyleFields delivers faithful reconstructions, convincing cross-instance hybrids, and consistent gains in ablations over injection depth and supervision granularity. We further demonstrate a practical application in automotive aerodynamics: a learned surrogate drag predictor serves as a differentiable objective to optimize reconstructed cars, allowing targeted edits of global form or surface details by freezing the complementary latent stream. StyleFields offers a simple, effective recipe for controllable implicit reconstruction and downstream performance-driven design.

[15] RDGSplat: Render-Dedicated Geometry for Novel View Synthesis cs.CVPDF

Zhijie Zheng, Xinhao Xiang, Jiawei Zhang

TL;DR: RDGSplat冻结3D基础模型的原度量几何预测，复制解码器并仅用光度监督学习专用于渲染的第二套几何，再用目标相机位姿条件适配器重塑解码器读取的表示。四个基准、三个骨干均改善新视角合成；RE10K的WM2.0由20.918升至24.266 dB，深度和位姿输出保持不变。

Details

Motivation: 3D基础模型的前馈Gaussian头可快速做新视角合成，但渲染质量低于模型恢复的几何，因为原几何按度量目标估计、未按渲染效果优化。近期方法更新骨干会破坏其度量预测，还需对每个新骨干重复训练。

Result: RDGSplat从冻结3D基础模型解码第二种专用于渲染的几何，不改原度量预测。Render-Dedicated Geometry Decoding复制预训练解码器，仅用光度监督优化副本；Target-Pose Conditioned Adapter使解码器读取的表示条件于目标相机位姿而非目标图像。三个前馈骨干、四个基准的实验均改善新视角合成，所有预训练权重保持冻结。RE10K上WM2.0由20.918提升至24.266 dB；新增训练参数205.5M，对比冻结的1.4B骨干。相同模型预测的深度和位姿不变。

Insight: 度量重建与外观渲染需要的几何可能不同，分离并训练渲染专用解码分支可提升视图合成，同时保留基础模型原始测量能力。参数增量仍达205.5M，虽然冻结骨干，模型总成本并非零。

Abstract: 3D foundation models enable efficient novel view synthesis by carrying a Gaussian head on the representation they already use for reconstruction. However, the views they render fall short of the geometry they recover, because that geometry is estimated under a metric objective and never scored on how it renders. Recent methods alleviate this by updating the backbone weights, but they thereby discard the metric predictions the model was built for and must be repeated for every new backbone. To this end, we propose RDGSplat, a framework that decodes a second geometry dedicated to rendering from a frozen 3D foundation model, leaving its metric predictions intact. In particular, we devise Render-Dedicated Geometry Decoding, which duplicates the pretrained decoders and optimizes the duplicates under photometric supervision alone. Then, a Target-Pose Conditioned Adapter is introduced to reformulate the representation those decoders read, conditioned on the target camera pose rather than the target image. Extensive experiments show that RDGSplat improves novel view synthesis across three feed-forward backbones on four benchmarks, with every pretrained weight frozen. On RE10K, it raises WM2.0 from 20.918 to 24.266,dB while training 205.5,M added parameters against a frozen 1.4,B backbone, and the depth and pose the same model predicts are unchanged.

[16] PVSync: A Unified Lip-Sync Expert for Timing and Articulation cs.CVPDF

Kevin Stephen, Varun Menon, Timo Mertens, Nikita Drobyshev

TL;DR: PVSync统一评估唇同步时间偏移和音素级发音匹配：窗口对比学习估计同步，额外目标按可见发音类别对齐不同视频中的音视频嵌入，viseme标签由强制对齐文本自动生成。对13种说话头像模型，人工排序相关性Spearman 0.83，高于LSE-C的0.34；留出语音viseme匹配判别AUC为0.91。

Details

Motivation: 视频中唇部动作可能与语音时间同步，却没有匹配真实发音内容；只评估同步时序不足以衡量唇形是否符合音素。需要同时度量音视频偏移和发音层级一致性。

Result: PVSync联合学习窗口级同步对比目标和音素级发音目标，将同一viseme类别的音视频嵌入跨片段对齐；viseme把可见发音相似的音素归组，标签由强制对齐转录自动生成，无需人工标注。在13种说话头生成模型的偏移校正视频上，PVSync的唇同步质量排序更接近人类，Spearman相关0.83，LSE-C为0.34。由留出语音自动构建基准上，模型区分viseme匹配与不匹配音视频对，ROC AUC为0.91；真实野外片段的时间偏移恢复优于SyncNet和MTD-VocaLiST。

Insight: 同步时间和音素/viseme内容是两个不同维度，PVSync联合评测可识别“时序对上但发音不对”的情况。人类排序和留出语音结果支持方法有效，摘要未报告偏移恢复具体误差。

Abstract: Lip movements can match the timing of speech without matching the spoken sounds. We introduce PVSync, a unified model for audio-visual offset estimation and phoneme-level articulation scoring. PVSync combines window-level contrastive learning for synchronisation with a phoneme-level articulation objective that aligns audio and video embeddings of the same viseme class across clips. Visemes group phonemes with similar visible articulation. Viseme labels are derived automatically from forced-aligned transcripts, without manual annotations. On offset-corrected videos from 13 talking-head video generation models, PVSync matches human rankings of lip-sync quality more closely than LSE-C, achieving a Spearman correlation of 0.83 versus 0.34. On an automatically constructed benchmark from held-out speech, PVSync distinguishes viseme-matched from mismatched audio-visual pairs with an ROC AUC of 0.91. PVSync also outperforms SyncNet and MTD-VocaLiST in temporal offset recovery on held-out in-the-wild clips. Code and benchmark data will be released upon acceptance.

[17] A Deterministic Evidence Layer for Vision-Language Autism Screening from Naturalistic Home Video cs.CV | cs.AIPDF

Wenqi Li, Mindi Ruan, Chuanbo Hu, Shuo Wang, Xin Li

TL;DR: 该研究提出从自然家庭视频筛查ASD的确定性证据层：冻结VLM输出带时间戳的事件表并记录诱发情境/反证，再用文本阶段校准单行置信度、确定性证据权重汇总风险。43段照护者录制自由玩耍视频上AUC为0.851±0.012、准确率86.0%、F1 71.8；跨重复运行标签稳定率74.4%，零样本基线60.5%。

Details

Motivation: ASD早期识别依赖专家观察儿童社交行为，但专家资源受限。VLM能够描述视频行为，但直接从描述生成诊断标签不稳定：即使温度近零，不同服务配置/重复运行也会产生明显预测变化。

Result: 研究保持VLM冻结，将决策移出模型。VLM受接地感知约束，生成带时间戳和术语表标签的行为事件表，注明诱发要求并记录反证；纯文本阶段按年龄校准各行置信度；确定性证据权重评分器将其汇总成风险类别，使决策可分解为具名特征贡献并能从保存的表格重新计分。43段学龄前儿童照护者录制、无协议限制的家庭自由玩耍视频上，三次运行AUC 0.851±0.012、准确率86.0%、F1 71.8。74.4%视频三次均分类正确，零样本基线为60.5%；每次均未把典型发育儿童标为阳性，零样本基线则有31段中的9段。消融将增益归因于接地感知约束配合确定性评分。

Insight: 将模型职责限制在可核查事件抽取，再由确定性层透明汇总证据，可改善重复运行稳定性并支持重新审计。样本仅43段家庭视频，且任务为筛查/风险分层，摘要不足以支持替代临床诊断。

Abstract: Autism spectrum disorder (ASD) is diagnosed through specialist observation of a child’s social behavior, and access to that expertise is the bottleneck for early identification. Vision-language models (VLMs) describe a child’s behavior from video well; the verdict drawn from the description is unstable: at temperature~0, across eight pipeline configurations on one backbone, 16–37% of clips change their predicted label between repeated runs, and the cause lies in the serving stack. We keep the VLM frozen and move the decision out of the model. Under our grounded perception constraints the VLM writes an event table of timestamped, glossary-labeled events that names the eliciting press and logs counter-evidence; a text-only stage age-calibrates the confidence of each row; a deterministic weight-of-evidence scorer sums it into an evidence total and stratifies it into a risk category, so every decision decomposes into named per-feature contributions and can be re-scored from the saved table. On 43 caregiver-recorded, protocol-free home free-play clips of preschool children, the pipeline reaches AUC $0.851 \pm 0.012$, 86.0% accuracy, and F$_1$ 71.8 over three runs. It labels 74.4% of clips correctly in every run (60.5% for the zero-shot baseline) and flags no typically developing clip in every run (9 of 31 at zero-shot). An ablation on the same backbone attributes the gain to the grounded perception constraints read through the deterministic scorer.

[18] Do Vision Models Learn Physical Constraints or Rendering Shortcuts? A Counterfactual Benchmark for Grounded Physical Consistency cs.CV | cs.AIPDF

M. Moein Esfahani, Sepehr Salem, Mohammed Alser, Vince Calhoun

TL;DR: 本文构建视觉物理一致性反事实基准，评估模型能否检测编辑图像违反物理规律、分类违规、定位区域并用语言解释。Mitsuba 3生成5,500张图，来自500个场景族，每族含1张干净图和10类配对违规；模型在标准划分macro-F1为64.0%–67.8%，LLaVA跨干预划分由64.0%降至40.8%。

Details

Motivation: 图像编辑模型可能满足文字要求却破坏场景物理，例如缺失阴影、镜面反射不对应几何或物体悬浮。作者研究视觉模型是否学会物理约束，还是只依赖与渲染和反事实构造相关的捷径。

Result: 基准将物理合理性诊断拆为检测是否违规、命名类型、定位区域和语言解释。Mitsuba 3合成部分包含5,500张、500个场景族，每族有一张干净图和10种匹配违规，覆盖阴影、反射、支撑、表面响应及遮挡；渲染流程提供类别标签、区域mask/框、场景元数据和解释目标。LLaVA-1.5-7B、Qwen2.5-VL-7B和InternVL3.5-8B作为诊断基线。1,650张合成测试图标准留出场景上macro-F1为64.0%–67.8%；LLaVA跨干预偏移划分从64.0%降至40.8%，表明部分高分依赖渲染或反事实构造线索。

Insight: 物理一致性评测需使用成对控制场景和干预分布偏移，避免模型通过固定渲染线索取巧；标准划分精度不能证明学会物理规律。跨干预表现骤降显示泛化缺口仍明显。

Abstract: Modern image editing models can satisfy a text instruction while breaking the physics of the edited scene. A new object may cast no shadow, a mirror may fail to reflect visible geometry, or an object may float above a surface that should support it. We study physical plausibility diagnosis, detecting whether an edited image violates scene physics, naming the violation type, localizing the affected region, and explaining the failure in language. We introduce a counterfactual benchmark whose controlled synthetic component uses Mitsuba~3 to generate 5,500 images from 500 scene families. Each family contains one clean image and ten matched violations involving shadows, reflection, support, surface response, and occlusion. The renderer pipeline provides category labels, affected-region masks and boxes, scene metadata, and explanation targets. We use LLaVA-1.5-7B, Qwen2.5-VL-7B, and InternVL3.5-8B as diagnostic baselines rather than proposed methods. On a 1,650-image synthetic test set, the adapted baselines reach 64.0–67.8% category macro-F1 on standard held-out scenes. For LLaVA-1.5-7B, category macro-F1 falls from 64.0% on the standard split to 40.8% under intervention shift. This gap shows that high in-distribution accuracy partly reflects cues tied to rendering and counterfactual construction.

[19] Adaptive Visual Token Reduction for Accelerated Image Understanding cs.CVPDF

Seyoung Jeong, Jong Pil Yun, Sang Jun Lee

TL;DR: ReFIT是指令引导视觉token压缩框架，先按相关区域空间形状调整窗口以保留水平/垂直细长结构，再细化删除冗余token。四个VQA基准实验报告在降低计算量的同时提升答题准确率，并通过可视化展示相关区域定位和冗余信息去除；摘要未给具体数值。

Details

Motivation: 高分辨率、信息丰富图像需要大量视觉token，增加大型VLM计算成本。现有方法常剪单个token或固定尺寸裁剪，难保留水平/垂直细长文字等空间结构信息。

Result: ReFIT由Relevance-Guided Window Reshaping和Instruction-Guided Token Refinement组成：前者根据指令相关区域的空间特性调整窗口以捕获重点，后者进一步移除不必要视觉token。四个VQA基准上，作者报告准确率提高且计算成本降低；定性结果显示能定位相关区域并压缩无关视觉信息。摘要没有基准名称、具体准确率或节省比例。

Insight: 指令相关区域可能呈现细长、不规则空间形状，固定裁剪和逐点剪枝都难以完整保留；先重塑窗口再做token细化可利用结构信息。摘要只报告定性优势，无法量化准确率—成本折中。

Abstract: Large Vision-Language Models achieve strong VQA performance, but processing high-resolution, information-rich images requires substantial computation, motivating visual token reduction. However, existing methods often prune individual tokens or rely on fixed-size cropping, limiting their ability to preserve spatially structured information such as horizontally or vertically elongated text. To address this limitation, we propose ReFIT, an instruction-guided visual token reduction framework for efficient LVLM inference. ReFIT consists of Relevance-Guided Window Reshaping (RWR) and Instruction-Guided Token Refinement (ITR), where RWR captures instruction-relevant regions by adapting to their spatial characteristics, while ITR further removes unnecessary visual tokens. Experiments on four VQA benchmarks demonstrate that ReFIT improves answer accuracy while reducing computational cost, and qualitative results demonstrate its effectiveness in localizing relevant regions and removing unnecessary visual information.

[20] Why VLMs Miss Small Objects, and When Zooming In Is Safe cs.CVPDF

Junzhe Shi, Yuan Gan, Shida Jiang

TL;DR: 本文分析高分辨率图像中小物体识别的token成本边界，并测试分解/放大策略。全图在N个token下物体边长最多约为m√(N/WH)，token翻倍最多令可见边长增加41%；约177,000次请求、797张图实验显示理论预测排序在受控图像上40项均未违例，建筑图纸上分解最多将召回提高0.28。

Details

Motivation: VLM常在大图中漏掉小物体，关键是视觉token分辨率、单次调用需覆盖内容量以及更强模型能否突破界限。放大/智能体搜索可能有帮助，但也有召回—成本前沿，且分解是否安全需有理论保证。

Result: 理论用S表示对象每边视觉token数、L表示一次调用覆盖内容量。整图W×H在N token内输入时，边长m对象最多获得约m√(N/WH) token/边；预算N翻倍，整图可见边长最多增加约41%，任何模型要达到边长S需至少O(S²) token。若识别随S渐进改善，任何搜索方式（含放大智能体）都受召回—成本前沿约束。只要每对象token更多、每次调用内容更少平均不损害性能，且分块视图不比整图更缩小并至少按对象重叠，则分解不能降低召回；两条件缺一不可。约177,000次请求、797图实验中，受控图像上8个VLM的40项预测排序无违例；事后检查绘图、平面图、自然和合成图像，89项中61项显著符合、4项失败，均为OpenAI模型获得超过默认路径的像素输入。建筑图纸上分解从未显著降低召回，最多提升0.28。

Insight: 小物体可见性受图像接口token几何限制，不是只靠更大模型就可消除；局部化在满足不缩小目标且视图有适当重叠时可保证召回不降，但成本仍须计入。理论适用条件明确，少数违例集中在特定模型与高于默认输入像素的设置。

Abstract: Vision-language models (VLMs) often miss small objects in large images. We ask three questions: what limits them, which of these limits better models can remove, and whether the classical way of handling large images, local decomposition, still has a future. We answer them with a theory built on two quantities of the image interface: S, the number of visual tokens across an object’s side, and L, the content a call must cover. The limits: a W x H image sent whole within N tokens gives an object of side m at most m*sqrt(N/(WH)) tokens per side. Doubling the token budget N therefore raises the largest S a whole image can reach by only 41%, and seeing an image at the S an object needs costs at least order S^2 tokens whatever the model. If recognition improves gradually with S, any search strategy, zoom agents included, obeys a recall-cost frontier. What better models can change: the S an object needs and how much one call can carry, measured in bits per object found; the coverage cost remains. Decomposition: yes. Assuming only that more tokens per object and less content per call do not hurt on average, splitting an image cannot lower recall if no view zooms out relative to the whole image and views overlap by one object. Neither part of this condition can be dropped; we bound the cost of every such decomposition, and a simple rule approaches the bound as the image grows. We test the theory in about 177,000 requests on 797 images. On controlled images, none of 40 orderings predicted for 8 VLMs is violated. Checked after the fact on drawings, floor plans, natural and synthetic images, 61 of 89 implied orderings hold significantly and 4 fail, all for OpenAI models given more pixels than their default path. On construction drawings the rule never significantly lowered recall relative to the whole image and raised it by up to 0.28. Code and data: https://github.com/shijunzhe/vlm-small-objects

[21] SAREO-FM: Decoupled Semantic Supervision for SAR-EO Foundation Models cs.CVPDF

Jeonghyeok Do, Munchurl Kim

TL;DR: SAREO-FM通过分离模态重建token与语义查询，联合预训练SAR与EO基础模型：前者用掩码重建保留传感器如何观测场景，后者在预训练VFM指导下抽取场景内容语义。基于百万规模SAR-1M预训练，SAR-only和EO-only转移均强，融合在互补观测有益任务上进一步提升。

Details

Motivation: SAR全天候、昼夜可用且耐天气，EO则具有丰富外观和细粒度语义，二者互补。若强迫单一token流同时承担传感器特征重建与高层语义，可能难兼顾模态特性和共享语义。

Result: SAREO-FM让模态token通过掩码重建学习传感器观察方式，让可学习语义查询在预训练视觉基础模型指导下捕获场景内容；语义查询与SAR、EO token联合编码以获得模态扎根上下文，而模态token输出仍作为重建目标，实现监督分离但保留交互。基于百万级SAR-1M预训练后，SAR单模态和EO单模态转移均表现强；联合SAR—EO观测在受益于互补传感的任务上带来显著提升。摘要未给基准和分数。

Insight: 将“传感器如何看”与“场景包含什么”分配给不同token流，可避免重建与语义目标相互干扰，同时允许联合上下文交互。现有摘要定性报告单/多模态迁移，尚不能量化融合增益或任务覆盖。

Abstract: Synthetic aperture radar (SAR) and electro-optical (EO) imagery provide complementary observations: SAR enables day-and-night, weather-resilient sensing, whereas EO provides rich appearance and fine-grained semantic cues. We introduce SAREO-FM, which avoids forcing a single token stream to serve two distinct roles: modality tokens preserve how each sensor observes the scene through masked reconstruction, while learnable semantic queries capture what the scene contains under guidance from a pretrained vision foundation model (VFM). By jointly encoding these queries with SAR and EO tokens, the queries acquire modality-grounded semantic context, while the modality-token outputs remain the explicit targets of masked reconstruction. This design assigns semantic and reconstruction supervision to separate token streams while preserving their interaction within the shared encoder. Pretrained on the million-scale SAR-1M corpus, SAREO-FM achieves strong unimodal transfer for both SAR-only and EO-only inputs, while delivering substantial gains from joint SAR–EO observations on tasks that benefit from complementary sensing.

[22] VIS-Ground: Video Interactive Storytelling with Contextual Grounding cs.CVPDF

Bingxuan Li, Yiwen Song, Xueqing Wu, Yanzhou Pan, Yang Li

TL;DR: VIS-Ground把交互视频生成的上下文接地定义为将异构输入变成可执行约束：先抽取已接地状态和跨上下文依赖，再生成候选特定约束，最后经规划、验证、修订与渲染执行。三个视频骨干上平均总分较各自最强基线绝对提高10.3分，叙事和知识接地均改善。

Details

Motivation: 交互式视频生成中，用户请求可能依赖外部来源和当前已渲染视频状态的隐含组合；这些依赖不会单独出现在任一输入中。现有系统强调跟随指令或对齐外部叙事，但未明确续写应接地到哪些上下文。

Result: VIS-Ground将上下文接地形式化为把异构输入转换成视频生成可执行约束的过程。它通过Structured Context Abstraction恢复已接地状态和跨上下文依赖；Generation Constraints Induction把相关依赖投影成候选特定约束；Constrained Video Generation再通过规划、验证、修订和渲染强制执行。三个视频生成骨干实验中，VIS-Ground均取得最高综合总分，相较每骨干最强基线平均绝对提高10.3分；详细分析显示叙事及知识接地均有增益，同时仍存在依赖提取和渲染忠实度问题。

Insight: 交互续写需联合源材料、已生成历史和新指令建立候选特定约束，仅跟随最后一条文字请求可能破坏整体上下文一致性。多阶段规划/验证能提升接地，但依赖抽取与最终渲染仍是主要剩余挑战。

Abstract: Video interactive storytelling enables viewers to actively steer how a video unfolds. However, once we allow viewers to intervene during generation, a new challenge arises: The viewer’s request can have latent dependencies on both the grounding source and the current rendered video state. These dependencies may not be explicitly stated in any individual input, but emerge only when the source, rendered history, and new viewer intent are considered jointly. Existing interactive video generation systems primarily emphasize following viewer instructions, while source-grounded video generation methods focus on aligning generated content with an external narrative or knowledge source. This leaves a fundamental question underexplored: What context should a generation model ground on during interactive continuation, and how can heterogeneous, unstructured inputs be transformed into such grounding context? In this work, we formulate contextual grounding as the process of transforming heterogeneous input context into an executable constraint model for video generation. To address this challenge, we introduce VIS-Ground, which performs Structured Context Abstraction to recover grounded states and cross-context dependencies, Generation Constraints Induction to project relevant dependencies into candidate-specific constraints, and Constrained Video Generation to enforce these constraints through planning, verification, revision, and rendering. Across three video generation backbones, VIS-Ground consistently achieves the highest overall composite score, reaching an average absolute improvement of 10.3 points over the strongest per-backbone baselines. Detailed analysis further shows gains across both narrative and knowledge grounding, and reveals remaining challenges in dependency extraction, and faithful realization during video rendering.

[23] Visual Jev Rewards: Reference-Bound Verification for Multi-Subject Image Generation cs.CV | cs.AI | cs.LGPDF

Baoteng Li, Wenzhuo Wu, Kongming Liang, Zhanyu Ma

TL;DR: 本文提出参考身份绑定的Visual Jev奖励，用于多主体图像生成：只有目标属性/动作/关系成立且参与对象与指定参考身份一致时，相关问题才标为正。200个MICo-150K任务训练30步后，GPT-5.4在897任务子集复合分由41.78升至52.50；直接27B奖励为51.84，但人评未证明统计显著优于直接评分。

Details

Motivation: 多主体图像生成奖励需要验证指定参考主体是否具备要求属性、执行动作并参与关系；仅检测主体是否出现，不能证明发生交互的是正确对象。

Result: Visual Jev把视觉判断转成生成器训练奖励。对每个主体问题，只有目标条件和相关参考身份同时成立才给正标签。作者离线构建固定问题，用二元监督训练Qwen3.5-4B验证器，从语言模型头直接读取“Yes”概率，取均值作为GRPO奖励并保留单项判断供检查。用200个MICo-150K训练任务、30次更新后，在人工挑选的897任务MICo-Bench子集上，GPT-5.4复合分从41.78提升到52.50；直接使用27B奖励得到51.84。每种奖励仅运行一次GRPO，离线人评不能证明相较直接评分有统计显著优势。

Insight: 多主体奖励需联合验证“谁在做什么”，不能把主体出现与身份正确的互动混为一谈；逐问题概率还提供可检查反馈。但训练规模有限、GRPO仅单次运行，现有结果是初步实现与评估，不能断言奖励有显著优越性。

Abstract: Multi-subject image generation requires rewards that verify whether requested attributes, actions, and relations hold for the specified reference subjects. Subject presence alone does not establish that the correct subjects participate in a requested interaction. We present reference-bound Visual Jev rewards that turn these visual decisions into generator training signals. Each subject-related question receives a positive label only when the requested condition and the relevant reference identities hold jointly. We construct fixed questions offline, train a Qwen3.5-4B verifier with binary supervision, and directly read Yes probabilities from its language-model head. Their mean supplies a GRPO reward while retaining individual judgments for inspection. Using 200 MICo-150K training tasks and 30 updates, the framework raises a GPT-5.4 composite score from 41.78 to 52.50 on a manually selected 897-task MICo-Bench subset; direct 27B rewards yield 51.84. Each reward is tested in one GRPO run, and offline human evaluation does not establish a statistically significant advantage over direct scoring. The study provides an initial implementation and evaluation of Visual Jev as a reference-bound reward for multi-subject image generation.

[24] CRT-HMAR: Causal Requirement Tracing-Guided Hierarchical Multi-Agent Regulation for Open-Task-Aware Infrared-Visible Image Fusion cs.CVPDF

Zengyi Yang, Shuai Yuan, Zhong-Cheng Wu, Juan Cheng, Huafeng Li

TL;DR: CRT-HMAR为开放任务红外—可见光融合提出因果需求追踪和层级多智能体调节：通过干预图像信息、观察下游任务网络响应形成因果需求图，再由需求分析、任务平衡和冲突缓解代理驱动融合。在五类开放任务实验中提升未见任务泛化，同时保持已见任务表现与平衡。

Details

Motivation: 现有IR-VIS融合通常针对固定已见任务优化，难推广到现实开放任务。系统需要从未知下游任务中推断所需语义，并在多任务需求间平衡而不牺牲已有能力。

Result: CRT-HMAR先通过Causal Requirement Tracing主动干预关键图像信息、观察任务网络响应变化，将任务语义偏好映射为图像级因果需求图；需求分析代理聚合任务特定需求知识以定制融合。另以History-Analysis Multi-Objective Balancing和Task-Level-Correction Conflict Mitigation构成“需求解释—任务平衡—冲突缓解”层级调节链，通过多个协作代理动态处理开放任务建模、多任务平衡优化及梯度冲突。五类下游任务的开放任务场景实验显示，未见任务泛化显著改善，同时保持已见任务表现和平衡；摘要未提供量化数据。

Insight: 从下游响应反推任务真正依赖的图像内容，可将IR-VIS融合从固定任务优化改成需求驱动；多任务历史平衡和梯度冲突缓解用于稳定开放任务迁移。摘要未列任务、指标和相对提升幅度。

Abstract: Infrared and visible (IR-VIS) image fusion integrates complementary multimodal information into a single fused image to support downstream vision tasks. However, existing methods are typically tailored to seen tasks within a fixed task set and struggle to generalize to unseen tasks, which restricts their applicability in real-world open-task scenarios. To address this issue, this paper proposes CRT-HMAR, a Causal Requirement Tracing-Guided Hierarchical Multi-Agent Regulation Framework for open-task-aware IR-VIS image fusion. CRT-HMAR introduces a Causal Requirement Tracing Task Localization mechanism, which actively intervenes in key image information and observes task-network response variations to map task-specific semantic preferences into image-level causal requirement maps. Based on these maps, a requirement analysis agent aggregates task-specific requirement knowledge to adaptively guide requirement-customized image fusion. Moreover, CRT-HMAR incorporates History-Analysis Multi-Objective Balancing and Task-Level-Correction Conflict Mitigation mechanisms, jointly constructing a hierarchical regulation chain of “requirement interpretation - task balancing - conflict mitigation”. Through multiple collaborative agents, CRT-HMAR dynamically regulates key processes including open-task requirement modeling, multi-task balanced optimization, and gradient conflict mitigation. Extensive experiments on open-task scenarios involving five downstream tasks demonstrate that CRT-HMAR significantly improves generalization to unseen tasks while maintaining the performance and balance of seen tasks. Overall, CRT-HMAR shifts IR-VIS image fusion from task-oriented modeling toward requirement-oriented modeling, promoting its extension from closed-task settings to real-world open-task scenarios.

[25] GRC-Net: Global Representation Consistency Network for Unsupervised Multimodal Anomaly Detection cs.CVPDF

Seyoung Jeong, Jong Pil Yun, Sang Jun Lee

TL;DR: GRC-Net为无监督多模态异常检测加入全局注意力MLP，在patch嵌入间强制全局表征一致，并以稳定重建模块抑制正常区域重建噪声。MVTec 3D-AD和Eyecandies实验报告图像及像素级均优于已有方法，正常区误差更低、异常区重建差异更明显。

Details

Motivation: 制造业质量检测中，单纯图像方法能发现外观缺陷，却难检测结构和几何异常，因此需要3D等多模态信息。现有方法主要用局部patch表示，正常区域也可能产生不稳定重建误差。

Result: GRC-Net使用全局注意力MLP在patch嵌入间施加全局表示一致性，结合稳定重建模块提升重建稳定性；全局token汇聚整体上下文，通过最小化原始与预测嵌入差异抑制重建噪声。MVTec 3D-AD和Eyecandies实验显示，图像级和像素级检测均持续超过已有方法。定性结果显示正常区域重建误差降低，正常与异常区域之间的重建差异更清楚；摘要未提供具体数值。

Insight: 全局上下文一致性可弥补局部patch表示造成的正常区域误差波动，提升多模态异常定位的判别性。摘要报告两个基准的定性SOTA表现，但未列指标和消融结果。

Abstract: Automated quality inspection is essential for ensuring product reliability in manufacturing.While image-based methods effectively capture appearance-related defects, these methods are limited in detecting structural and geometric anomalies, motivating multimodal approaches incorporating 3D information. However, existing methods mainly rely on local patch-level representations, which often lead to unstable reconstruction errors even in normal regions. To address this limitation, we propose GRC-Net, which integrates a global-attention MLP to enforce global representation consistency across patch embeddings with a stable reconstruction module to improve reconstruction stability. The proposed method captures holistic contextual information through a global token and suppresses reconstruction noise by minimizing discrepancies between original and predicted embeddings. Experiments on MVTec 3D-AD and Eyecandies demonstrate that GRC-Net consistently outperforms existing methods at both image and pixel levels. Qualitative results further demonstrate reduced reconstruction errors in normal regions and more distinct reconstruction differences between normal and anomalous regions.

[26] PPCAR-Net: Projection-Refined Parametric 3D Coronary Artery Reconstruction from Sparse X-ray Angiographic Views cs.CVPDF

Yu Ren, Hwee Kuan Lee, Tat-Jen Cham, Jonathan Yap, Khung Keong Yeo

TL;DR: PPCAR-Net直接从可变数量分割造影视角预测按分支组织的冠脉中心线与半径，无需显式匹配/三角化或中间体数据。粗预测融合冻结VGGT特征与分支查询，后续投影引导细化器从视图采样局部证据并以3D监督修正；合成CT冠脉掩码上重建连通性更好、中心线准确，粗到细推理121毫秒。

Details

Motivation: 稀疏视角3D冠脉重建通常依赖跨视图对应和三角化，易受血管重叠、缩短影响；体素预测再抽取血管图则不直接提供中心线和半径。

Result: PPCAR-Net参数化输出分支结构中心线和半径表示，不用点匹配、三角化或中间体积。粗预测器融合冻结VGGT特征与学习分支查询，估计分支存在性、B样条中心线和稠密半径曲线；投影引导几何/半径细化器从输入视图取局部证据，并用3D监督学习残差修正。模拟血管造影mask由CT冠脉解剖生成，定量/定性结果显示重建连通性更好、中心线准确，尤其RCA表现强，同时体积重叠有竞争力。粗到细推理耗时121毫秒，可实时运行。

Insight: 直接预测参数化中心线—半径结构，避免体素后处理难以恢复中心线/半径和稀疏对应易错问题；投影局部证据再细化几何。当前评估主要基于CT派生模拟造影mask，真实临床造影验证摘要未提及。

Abstract: Sparse-view 3D coronary reconstruction commonly relies on cross-view correspondence and triangulation, which are vulnerable to vessel overlap and foreshortening, or on volumetric prediction followed by vascular-graph extraction, which does not directly provide centrelines and radii. We introduce PPCAR-Net, a projection-refined parametric coronary artery reconstruction network that directly predicts a branch-structured centreline-and-radius representation without explicit point matching, triangulation, or an intermediate volume. Given a variable number of segmented views, a coarse predictor combines frozen VGGT features with learned branch queries to estimate branch presence, B-spline centreline trajectories, and dense radius profiles. Projection-guided geometry and radius refiners then sample local evidence from the input views and apply residual corrections learned with 3D supervision. We evaluate representation fidelity and sparse-view reconstruction quantitatively and qualitatively. On simulated angiographic masks generated from CT-derived coronary anatomy, PPCAR-Net produces better connected artery reconstructions and achieves strong centreline accuracy, particularly for RCA, while maintaining competitive volumetric overlap. Coarse-to-fine inference takes 121 ms, enabling real-time reconstruction.

[27] Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Audit cs.CVPDF

Zhihan Chen, Yuhuan Zhao, Yijie Zhu, Xinyu Yao, Mengcong Ren

TL;DR: 该先导审计用Blender Cycles薄透镜渲染真值，检查Gemini 3.1 Flash Image和GPT-image-2.5是否遵循景深随物距和光圈变化规律。24个纹理场景中编辑器f/1.4与f/2.8模糊比仅0.99–1.18，渲染真值1.98–2.13；文字措辞可改变模糊强度约2–10倍，数值像素要求只改变1.1–1.3倍。

Details

Motivation: 图像编辑器常被要求把照片处理成f/1.4效果，但很少检查生成模糊是否符合薄透镜光学。已有评测关注模糊单调性、锐度趋势、等效光圈或VLM判断，却未在已知深度上分别测量景深关系与光圈响应。

Result: 先导研究用Blender Cycles生成真实薄透镜景深渲染，统一模糊宽度估计器比较Gemini 3.1 Flash Image和GPT-image-2.5，使用预注册深度与光圈指标。在24个纹理场景中，可测面板的f/1.4到f/2.8模糊宽度比为0.99–1.18，而真值为1.98–2.13；合并近/远景中位高斯模糊比，Gemini约1.18–1.25、GPT约0.97–1.05，真值1.69–1.82。黑盒干预显示定性措辞可让模糊强度变化约2–10倍，而要求2或6像素只改变1.1–1.3倍；没有测试的f数措辞达到预注册的“遵循”标准。近焦布局中可用面板深度指标达到门槛，但光圈响应在所有测试布局中仍被压缩。按已发表指标改造的标量分数还会给模糊比例被压缩的合成编辑器类似真值的高分。

Insight: 当前编辑器能按文字改变模糊，但在测试场景中未按薄透镜的深度比例和光圈响应控制；单一模糊趋势分数可能误判物理合理性。结果限于两个编辑器、24个纹理场景的先导审计。

Abstract: General image editors are asked to make a photo look as if it were taken at f/1.4, yet it is rarely checked whether the blur they add follows thin-lens optics. A physical aperture edit spreads blur across depth in thin-lens proportions and changes the blur when the aperture changes; prior evaluations check blur monotonicity, sharpness-trend correlation, effective-aperture error, or vision-language judgments, and none we found reports the two properties separately at known depths. In this pilot audit of two editors (Gemini~3.1 Flash Image and GPT-image-2.5) we compare against a rendered oracle: Blender Cycles scenes with true thin-lens depth of field, one blur-width estimator applied identically to oracle and editor outputs, and preregistered depth and aperture indices. In 24 texture scenes rendered in one three-panel geometry, accepted and measurable panels show f/1.4-to-f/2.8 width ratios, $\barσ_{1.4}/\barσ_{2.8}$, of 0.99–1.18 against 1.98–2.13 for the oracle, and ratios of pooled median Gaussian-equivalent near/far blur widths of about 1.18–1.25 (Gemini) and 0.97–1.05 (GPT-image) against 1.69–1.82. Preregistered black-box interventions show that qualitative wording changes blur strength by roughly 2–10 times, whereas a request for 2 versus 6 px changes it 1.1–1.3 times and no tested wording of the f-number meets the registered ``followed’’ criterion. The depth compression appears in the original and reversed centre-focus layouts; with the focus on the near panel, the available-panel depth index reaches the registered threshold, and the aperture response stays attenuated in every layout tested. Scalar metrics adapted from published ones give oracle-like scores to synthetic editors whose proportions are compressed.

[28] Quantifying Volumetric Risk: Class-Aware Asymmetric Weighted Conformal Prediction for 3D Medical Image Segmentation cs.CVPDF

Shadi Alijani, Fereshteh Aghaee Meibodi, Homayoun Najjaran

TL;DR: CA-WCP为3D多类别医学分割体积提供类别感知不对称加权共形区间：潜空间密度比校正协变量偏移，方向分位数给上下界，并按类别假阳性/假阴性率调整不对称性。BraTS 2020和合成多器官CT协变量偏移基准上，各类别观测覆盖的95% Clopper–Pearson区间均包含名义90%，区间宽比对称加权共形预测窄8%–14%。

Details

Motivation: 临床体积测量需可靠不确定性，但MedSAM等基础模型通常给确定性分割，在分布偏移下缺乏校准。既有共形预测常用于2D并假设对称误差，不能刻画3D多类分割中类别特异偏差。

Result: CA-WCP结合潜空间密度比加权处理协变量偏移，用上下界方向分位数估计体积区间，并依据验证集各类假阳性/假阴性率设定类别特异不对称因子。作者证明其保留加权可交换性下的逐类边际覆盖保证，并在BraTS 2020脑肿瘤分割及协变量偏移的合成多器官CT上评估。两基准所有语义类别的覆盖率95% Clopper–Pearson区间均包含名义90%；相较对称加权共形方法，区间宽度减少8%–14%。校准区间还编码进多模态LLM结构化提示，生成条件化不确定性的放射报告。

Insight: 3D类别偏差可能上下方向不对称，按类校准的上下分位区间可在保持覆盖保证时减少保守区间宽度；不确定性也可传递到报告中。覆盖保证基于加权可交换性假设，临床报告生成是接入示范。

Abstract: Reliable volumetric segmentation is critical for clinical diagnostics, yet foundation models such as MedSAM remain deterministic and lack calibrated uncertainty under distribution shift. Existing conformal prediction methods offer statistical guarantees but are frequently applied in 2D and assume symmetric error distributions, so they do not capture the class-specific biases that arise in 3D multi-class segmentation. We propose Class-Aware Asymmetric Weighted Conformal Prediction (CA-WCP), which combines latent-space density-ratio weighting for covariate shift with directional quantiles for the lower and upper volume bounds, and scales each bound by a class-specific asymmetry factor derived from validation-set false-positive and false-negative rates. We prove that CA-WCP retains the weighted-exchangeability marginal coverage guarantee for every class, and we evaluate it on 3D brain tumor segmentation (BraTS 2020) and on a synthetic multi-organ CT benchmark constructed under covariate shift. On both benchmarks the 95% Clopper–Pearson interval for the observed coverage of CA-WCP contains the nominal 90% level for every semantic class, while interval width is reduced by 8–14% relative to symmetric weighted conformal prediction. We further encode the calibrated intervals into structured prompts for a multimodal large language model to produce uncertainty-conditioned radiology reports, linking distribution-shift-aware uncertainty quantification to interpretable clinical communication.

[29] TiTok: Audio-Visual LLM for Multi-Segment Temporal Grounding cs.CVPDF

Eunji Shin, Dahyun Choi, Seungyeon Jo, Yejin Hong, Jiyoung Lee

TL;DR: TiTok是音视频LLM，用Time Token Interleaving将特殊时间token插入音视频流以对齐感知与多段边界预测，并以含全局、局部、数量、精度和格式奖励的GDPO强化学习适配任意段数定位。UnAV-100协议下mIoU为65.7、CountF1为0.58，达到SOTA；CountF1专门衡量重叠指标看不到的事件数量失准。

Details

Motivation: 未剪辑视频的音视频多段定位需综合音频和视觉证据并预测任意数量事件。视觉模型会漏掉声音线索，音视频模型又常不能校准事件段数，导致分段数量错误。

Result: TiTok在每个查询下定位任意数量时间事件段。Time Token Interleaving（TTI）将特殊时间token显式插入音视频流，令输入时间感知与输出时间预测对齐；强化学习采用面向多段任务的解耦奖励，包括全局、局部、计数、精度和格式奖励，并用GDPO优化。作者建立基于UnAV-100的新评测协议，提出CountF1衡量传统重叠指标无法捕捉的数量误差。TiTok达到65.7 mIoU和0.58 CountF1，报告为SOTA。

Insight: 多段定位除边界重叠外，还需显式衡量事件段数量是否准确；时间token和独立计数奖励针对这一失败模式。摘要未提供与各基线的分项数值或运行成本。

Abstract: Audio-visual multi-segment grounding (AV-MSG) in untrimmed videos, reasoning over audio-visual evidence and predicting multiple segments for a query, is a fundamental problem but remains challenging. Visual-only models overlook complementary acoustic cues, while audio-visual models often fail to calibrate the number of events - a phenomenon we refer to as count miscalibration. We present TiTok, an audio-visual large language model (AV-LLM) that localizes an arbitrary number of temporal event segments for each query. For precise boundary prediction, we introduce the Time Token Interleaving (TTI) method, which explicitly injects special time tokens into the audio-visual stream to align input-side temporal perception with output-side temporal prediction. We further propose decoupled, multi-segment-oriented rewards for reinforcement learning, consisting of global, local, count, precision, and format rewards, optimized with Group reward-Decoupled Normalization Policy Optimization (GDPO). To assess the performance on AV-MSG, we establish a new UnAV-100-based evaluation protocol, and propose the CountF1 metric for quantifying count miscalibration that overlap metrics fail to capture. TiTok reaches 65.7 mIoU and 0.58 CountF1, achieving state-of-the-art performance. Our code is available at this link.

[30] trACT: temporal revelation Airborne Camera Trap cs.CVPDF

Oliver Bimber, Rakesh John Amala Arokia Nathan, Mohamed Youssef, Vinayak Lal Bhatnagar, Ralf Berger

TL;DR: trACT是面向消费级无人机的实时空中相机陷阱框架，用滚动时间最大池化将难察觉运动编码为稳健幅度与时序信号，再以自监督运动异常检测区分目标与风吹植被/无人机漂移；并结合运动预测、云台稳定光学变焦验证和多目标公平调度。

Details

Motivation: 无人机远程监测常受环境/热杂波、动态植被、目标伪装及系统时延阻碍。作者受猛禽悬停稳定视觉以检测地面细微运动启发，探索轻量自主无人机如何持续监测并准确验证目标。

Result: Temporal Max Pooling在滚动积分窗内聚合微弱运动，产生稳健幅度和时间编码；自监督运动异常检测从风和无人机漂移造成的背景运动中提取目标移动。为克服机械和处理延迟，trACT结合运动预测、自动云台稳定的光学变焦验证，以及公平多目标验证调度。密林野生动物栖息地和监控情境中的真实外场实验表明系统能在复杂环境下实现大范围空中监测到精确自主目标验证的衔接；摘要未报告检测准确率或时延数值。

Insight: 时间积分与自监督运动异常可利用持续细微运动区别伪装目标和动态背景，云台验证再提升局部确认能力。当前摘要给出真实场地定性验证，但缺少量化召回、误报和续航/时延指标。

Abstract: Effective remote monitoring and surveillance using drones are frequently impeded by severe environmental and thermal clutter, dynamic vegetation, target camouflage, and system latency. Drawing inspiration from the hunting strategies of birds of prey that hover and stabilize their vision to isolate subtle ground motion, we introduce trACT (temporal revelation Airborne Camera Trap), a lightweight, real-time aerial robotics framework designed for autonomous consumer drones. The system integrates Temporal Max Pooling (TMP), a low-level signal processing method that transforms imperceptible movement across a rolling integration window into robust value and time encodings, with self-supervised motion anomaly detection to isolate target motion from background environmental motion caused by wind gusts and drone drift. To overcome mechanical and processing delays, trACT combines motion prediction with automated gimbal-stabilized optical zoom verification and equitable multi-target verification balancing. Extensive real-world field experiments in densely forested wildlife habitats and surveillance scenarios demonstrate that trACT successfully bridges the gap between wide-area aerial monitoring and precise, autonomous target verification under challenging operational conditions.

[31] SkillCycle: Co-Evolving Agent Policies and Skill Banks cs.CVPDF

Ling Li, Qiuyu Shen, Zheng Jiang, Qinwei Ma, Yuxuan Liu

TL;DR: SkillCycle让智能体策略与外部技能库协同演化：先固定技能库训练策略，再冻结策略依据token级蒸馏反馈定位待检规则、结合交互结果改写规则，并经规则级和整库环境比较后进入下一轮。3B模型在WebShop无推理时技能输入成功率74.74%、得分88.37；循环消融相较静态技能库在ALFWorld/WebShop提升10.18%/18.11%。

Details

Motivation: 智能体内化外部技能后，已有规则价值会变化：有些变冗余、有些误导，也可能不足以处理新决策。既需要从技能学习，也需要随能力变化更新用于后续学习的技能库。

Result: SkillCycle让技能内化反馈同时用于定位和修改指导规则：token级上下文差异定位待审规则，交互结果指导规则内容与适用范围。框架交替执行两个阶段：固定技能库和路由器训练策略；冻结策略后修订规则。候选编辑需通过单条规则及整库环境比较后才用于下轮学习。3B模型在WebShop无推理时达到74.74%成功率、88.37得分，分别相对SOTA提升0.73%和3.96%。Cycle 3的ALFWorld/WebShop消融中，无技能输入成功率相对静态技能库提高10.18%/18.11%，相对仅更新一次提升2.41%/2.50%。

Insight: 外部技能若不随策略能力更新，可能变冗余或产生误导；交替冻结策略和技能库可评估修订对行为的因果影响。关键价值是把外部技能逐步转为推理时无需显式输入的策略能力。

Abstract: Internalizing external skills changes a language agent’s capabilities and, with them, the value of its remaining guidance: rules can become redundant, misleading, or insufficient for newly encountered decisions. This creates a coupled problem of learning from skills and adapting the skills that supervise further learning. We introduce SkillCycle, a framework for co-evolving agent policies and skill banks through a feedback loop between skill internalization and rule revision. Our central contribution is to give distillation feedback a second role: token-level contextual differences help locate rules for inspection, while interaction outcomes guide edits to their content and applicability. SkillCycle alternates between two phases: policy learning with a fixed skill bank and router, and rule revision with a frozen policy. Candidate edits undergo rule-level and whole-bank environment comparisons before they guide the next learning cycle. On WebShop, SkillCycle with a 3B model achieves a success rate of 74.74% and a score of 88.37 without inference-time skill inputs, representing relative improvements of 0.73% and 3.96% over the state-of-the-art (SOTA) model, respectively. In Cycle 3 ablations on ALFWorld and WebShop, SkillCycle’s no-skill success rates improve by 10.18% and 18.11% relative to a static skill bank, and by 2.41% and 2.50% relative to a single bank update, respectively. These results show that continually revising skill guidance as the agent’s capabilities change helps transform external skills into policy capabilities that require no skill inputs at inference. We will release code, configurations, skill banks, and evaluation protocols.

[32] Spatial Latent Reasoning for Embodied Reference Understanding cs.CVPDF

Ling Li, Jianhui Zhong, Wei Liu, Zheng Jiang aand Yuxuan Liu, Jingyu Li

TL;DR: Spatial Latent Reasoning将指向手势定位监督组织为有序空间潜状态：先以指尖和方向监督空间射线，再以四个目标区域视觉特征状态进行监督，并用奇偶分组池化构造视觉目标。EgoPoint-Ground上较同骨干SFT分别提高2.8、17.5、21.1个百分点；YouRefIt的IoU 0.5精度77.6%，比报道SOTA数值高5.2点但评估协议不同。

Details

Motivation: 指向手势grounding需关联手部几何、目标视觉身份与范围。连续潜在推理如何把互补几何/视觉线索组织为有效中间监督，是核心难点。

Result: SLR按几何和视觉状态的顺序构造监督：空间射线状态用指尖位置与指向方向监督，随后四个状态与目标区域特征对齐。Parity pooling以四个交错空间支撑上的多相分组平均目标区域token，构造视觉监督。所有状态在训练和推理时递归生成，辅助标注仅训练需要。EgoPoint-Ground上相对同骨干监督微调，Qwen3.5-4B、Qwen2.5-VL-7B和Qwen3-VL-8B的mIoU分别提高2.8、17.5、21.1个百分点，困难子集也提高。YouRefIt上IoU 0.5 precision为77.6%，比报道SOTA数值高5.2个百分点，但评估协议不同。消融支持几何和视觉联合监督，也支持标准集合上奇偶池化优于三种替代池化。

Insight: 将“指向方向”与“目标区域外观”按步骤组成连续潜在状态，可提供比单一终点框更结构化的学习信号。YouRefIt对SOTA的比较协议不同，数值差距不应视作严格同协议优势。

Abstract: Pointing-gesture visual grounding requires connecting hand geometry with the visual identity and extent of a referred object. A central challenge for continuous latent reasoning is how to organize these complementary cues into useful intermediate supervision. We propose Spatial Latent Reasoning (SLR), a framework that structures this supervision around an ordered sequence of geometric and visual states. A spatial ray state is supervised by fingertip position and pointing direction, followed by four states aligned with target-region features. To construct the visual targets, we introduce parity pooling, which applies polyphase grouping to average region tokens on four interleaved spatial supports. All states are generated recurrently during training and inference; auxiliary annotations are required only during training. On EgoPoint-Ground, the framework improves mIoU over same-backbone supervised fine-tuning by 2.8, 17.5, and 21.1 percentage points on Qwen3.5-4B, Qwen2.5-VL-7B, and Qwen3-VL-8B, respectively, with improvements on both hard subsets. On YouRefIt, it achieves 77.6% precision at IoU 0.5, a numerical margin of 5.2 percentage points over the reported state of the art under differing evaluation protocols. Ablations support joint geometric and visual supervision on the standard and similar-object sets, and favor parity over three alternative pooling operators on the standard set. These results support task-structured supervision for continuous pointing grounding. We will release the code and supporting materials.

[33] Event-Aligned Visual Action Reasoning for World Action Models cs.CV | cs.ROPDF

Xiaomeng Yang, Yushu Wu, Yi Gao, Yuhao Lei, Xuan Zhang

TL;DR: 该世界动作模型框架把视觉想象按任务交互事件而非固定时间间隔组织，让关键状态变化获得细粒度推理、连接过渡更粗略；执行有效性头筛除动作块中冗余动作。DOMINO成功率较基线提高10.26个百分点，并可从Level 1迁移到Level 2/3而无需目标级适配。

Details

Motivation: WAM用未来视觉预测辅助动作生成，但常按预设时间片组织视觉想象，没有区分任务关键交互与连接过渡的不同推理需求。有效前瞻应围绕影响动作决策的交互事件安排粒度。

Result: 事件对齐视觉动作推理框架用事件对齐监督训练WAM，使每次想象rollout生成事件级上下文，更关注指导动作的关键状态变化；视觉推理粒度随交互动态调整，关键事件附近细致推理、过渡阶段粗略推进。另加入执行有效性头识别预测动作序列中的有效部分，减少分块推理的冗余动作。DOMINO实验成功率比基线高10.26个百分点，在RoboTwin 2.0表现有竞争力；从DOMINO Level 1迁移至Level 2和3无需目标级适配。

Insight: 固定时间窗口不一定与任务状态变化对齐，按关键交互事件分配视觉预测粒度可让想象更贴合控制决策；有效性头还可减少无用动作。迁移结果覆盖DOMINO三个难度层级，摘要未给RoboTwin具体分数。

Abstract: World-Action Models (WAMs) utilize future visual prediction as an intermediate reasoning process to guide action generation. However, existing WAMs typically structure visual imagination according to predefined temporal intervals, without explicitly accounting for the different roles of task-critical interactions and connecting transitions. We argue that effective visual foresight should align directly with task-relevant interactions and their corresponding reasoning demands. To this end, we introduce an event-aligned visual action reasoning framework that organizes visual-action prediction around interaction events. Through event-aligned visual-action supervision, WAM learns to generate event-aligned visual context in each imagined rollout, placing greater emphasis on critical state changes that inform action generation. This shapes the visual reasoning granularity according to the underlying interaction dynamics, with detailed reasoning around task-critical events and coarser progression through connecting transitions. Furthermore, we introduce an execution validity head that identifies the valid portion of each predicted action sequence, avoiding redundant actions during chunked inference. Experiments demonstrate a 10.26 percentage point improvement in DOMINO success rate over baseline and competitive performance on RoboTwin 2.0. It also transfers from DOMINO Level 1 to Levels 2 and 3 without target-level adaptation.

[34] Controllable Crowd Generation through World-Model Planning cs.CVPDF

JunGyu Lee, Jisu Shin, Seunghyun Shin, Hae-Gon Jeon

TL;DR: Ctrl-CWM将世界模型规划用于可控人群模拟：编码器从真实行人视频学习并冻结运动表征，actor想象行人轨迹，critic评分，planner结合用户成本选动作；运行时增加目标无需重训。多种到达条件、避让和吸引场景下，模拟逼真度与碰撞指标大多超过SOTA，并能按用户新目标调整人群。

Details

Motivation: 人群模拟对机器人导航、自动驾驶和城市规划重要，真实模拟需随环境变化和用户目标调整。依赖预设控制设置的方法难灵活适配新的用户目标。

Result: Ctrl-CWM把人群生成与运行时控制合并为多智能体可控世界模型。编码器通过真实行人视频轨迹预测学习人类运动动态后冻结；actor提出行人位移并反复更新状态以生成想象轨迹，critic评估轨迹，planner结合critic得分和用户成本选择动作。重复规划推进人群，新增用户成本可引入控制目标而不重新训练。多种智能体到达条件及避让/吸引控制实验显示，Ctrl-CWM在人群逼真度和碰撞多数指标上超过SOTA，并能适配模拟中临时提出的目标；摘要未给具体指标。

Insight: 将预训练的人群动态表征冻结，再以用户成本在想象轨迹中规划，可把新目标控制与运动模型学习分离，支持运行时定制而不重训。具体逼真度和碰撞收益摘要未列量化值。

Abstract: Crowd simulation plays a central role in robot navigation, autonomous driving, and urban planning. For these applications, realistic simulation requires crowds to adapt their behavior to environmental changes and user objectives. However, existing methods that rely on predefined control settings have limited flexibility in accommodating new user-specified objectives. To address this limitation, we propose Ctrl-CWM, a multi-agent Controllable Crowd World Model that integrates crowd generation and run-time control. Our key idea is to adapt the world-model principle of planning using imagined futures to crowd simulation. To this end, Ctrl-CWM consists of an encoder that learns a representation of human motion dynamics, an actor that proposes pedestrian displacements, a critic that evaluates imagined crowd trajectories, and a planner that selects actions. We first learn human motion dynamics through trajectory prediction on real-world pedestrian videos and then freeze the encoder to preserve them. Using this representation, the actor generates imagined crowd trajectories through repeated state updates, and the planner combines the critic’s scores with user costs to select actions. Repeated planning advances the simulated crowd, while additional user costs introduce new control objectives without retraining. We extensively evaluate crowd generation under varied agent arrival conditions and run-time control across avoidance and attraction scenarios. Ctrl-CWM outperforms the state-of-the-art method on most crowd realism and collision metrics, and adapts crowd behaviors to user-specified objectives introduced during simulation. The project page is available at https://jungyu0413.github.io/Ctrl-CWM

[35] InscriptionOCR: A Dataset and Method for Understanding Inscriptions cs.CVPDF

Jaidev Sanjay Khalane, Akbar Ali, V. N. Prabhakar, Shanmuganathan Raman

TL;DR: InscriptionOCR提出从低质量石刻图像到文本理解的端到端流水线，包括图像增强、阿育王时代Brahmi字符识别、罗马转写和俗语到英语翻译。作者发布超过20万字符图像、约600类的Brahmi OCR数据集，以及超过2,000句对的俗语—英语平行语料。

Details

Motivation: 阿育王时期Brahmi铭文是公元前3世纪重要历史资料，但石刻图像退化且缺少标准化数字资源，阻碍自动分析、历史解释和低资源古文字OCR研究。

Result: 系统输入直接从石碑拍摄的低质量图像，执行图像恢复、Brahmi字符OCR、转为罗马字母，最后将俗语文本翻译成英语。作者构建两个数据集：据称目前最大可公开使用的Brahmi OCR数据，含超过200,000张字符图像、约600个类别；以及超过2,000句对的俗语—英语神经机器翻译平行语料。摘要将框架和数据集作为促进古文字分析、低资源OCR和数字铭文学的基础，未报告识别/翻译指标。

Insight: 古代铭文自动分析不仅需识别字符，还要串联图像修复、罗马转写和低资源翻译；标准数据资源有助于推进每个环节。摘要没有评估结果数值，不能判断端到端准确率。

Abstract: Ancient script image restoration is a fundamental problem in computer vision, as it directly affects the reliable analysis and interpretation of historical documents and inscriptions. Ashokan Brahmi is an ancient script extensively used during the reign of Emperor Ashoka in the 3rd century BC, primarily for inscriptions in Prakrit. These inscriptions, including major and minor rock and pillar edicts, constitute a valuable yet largely unexplored source of data for computational analysis. The degraded nature of inscription imagery and the lack of standardized digital resources pose significant challenges for automated processing. We present an end-to-end AI-based framework for understanding ancient inscriptions that encompasses image enhancement, optical character recognition (OCR), transliteration, and neural machine translation (NMT). The proposed pipeline processes low-quality images captured directly from stone inscriptions, performs image restoration and Brahmi script character recognition, maps the recognized characters to the Roman script, and finally translates the resulting Prakrit text into English. We also introduce two new datasets: (i) InscriptionOCR Dataset: the largest publicly usable digital OCR dataset for Brahmi script to date, consisting of over 200,000 character images across about 600 classes, and (ii) a bilingual Prakrit-English parallel corpus comprising over 2,000 sentence pairs for NMT. We believe that the proposed framework and datasets will facilitate future research in ancient script analysis, low-resource OCR, and digital epigraphy.

[36] Mixture of Layers: Dynamic Layer Routing for Visual Reasoning cs.CV | cs.AIPDF

Jeonghwan Kim, Sofia Stoica, Jiwan Chung, Ansel Blume, Hyeonjeong Ha

TL;DR: MoL按指令在视觉编码器中间层动态路由patch表征，以获取任务相关的空间/语义粒度，而非固定用最后一层。七项细粒度视觉推理任务上，V*准确率提升18.9%、HRBench4K提升4.5%、CharXiv提升16.3%，无需多分辨率输入、多个编码器或增加patch数。

Details

Motivation: 预训练视觉编码器各层表示在空间粒度、语义抽象和局部细节敏感性上不同，但多数MLLM只使用末层/倒数第二层或固定聚合，无法按查询访问细粒度小物体、空间细节、文字和属性线索。

Result: Mixture of Layers（MoL）以指令条件路由视觉patch级中间层表示。给定文本查询，模型预测视觉编码器各层路由概率，并在图像级、patch级或混合方式对选定隐藏状态做top-k稀疏聚合。七项细粒度视觉推理任务显示显著提升：相较基线MLLM，V*总体准确率提高18.9%，HRBench4K提高4.5%，CharXiv提高16.3%。无需多分辨率输入、简单拼接多个视觉编码器或增加patch token数。作者还分析各层感受野和采样行为，支持条件化视觉表示有助于感知与推理。

Insight: 不同视觉层保存不同抽象与空间细节，按问题动态读取中间层可在固定patch预算下提升细粒度理解。报告的提升因基准而异，V*的18.9%为最大示例，不代表所有任务都同幅受益。

Abstract: Pre-trained vision encoders contain layer-wise visual representations that differ in spatial granularity, semantic abstraction, and sensitivity to local details. However, most Multimodal Large Language Models (MLLMs) rely on only the final or penultimate vision encoder representations or fixed aggregation rules, making visual abstraction largely query-agnostic and limiting access to fine-grained cues such as small objects, spatial details, text, and subtle visual attributes. In this work, we propose Mixture of Layers (MoL), an instruction-conditioned layer routing approach at the visual patch level that dynamically aggregates query-relevant latent representations from intermediate vision encoder layers. Given a text query, MoL predicts routing probabilities over vision encoder layers and performs a top-k sparse aggregation over selected hidden states at either the image level, patch level, or through a hybrid routing mechanism. In doing so, MoL enables query-adaptive access to layer-specific visual features for fine-grained visual reasoning. Our experiments across 7 fine-grained visual reasoning tasks demonstrate substantial performance improvements, especially across fine-grained visual grounding and understanding tasks such as +18.9% improvement on V* in overall accuracy, +4.5% on HRBench4K, and +16.3% on CharXiv compared to the baseline MLLMs, without resorting to multi-resolution inputs, simple interleaving of multiple vision encoders, or increasing the number of patch tokens. We study vision encoders’ receptive field scales across different layers and their sampling behaviors to provide an in-depth analysis of why layer-wise sampling is helpful, demonstrating that conditional visual representations are a key step towards better visual perception and reasoning in MLLMs. Our project page is available at https://wjdghks950.github.io/mol.github.io/.

[37] RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning cs.CV | cs.ROPDF

Seungjun Moon, Subin Jeon, Sangwoo Kim, Hanbyul Joo, Jinwoo Shin

TL;DR: RLHND把预训练Cosmos视频扩散骨干变为单目第一人称视频手部跟踪特征提取器，同时估计符合解剖约束的手姿和密集触觉接触/力。干净潜变量条件实现确定性片段特征；手姿流可选形状条件保持视频内及同一演员跨视频手型一致，冻结手姿流训练独立触觉专家。基准上姿态、接触和力估计均达SOTA，并展示机器人重定向及实机学习应用。

Details

Motivation: 从人类视频训练机器人策略日益普遍，但现有手跟踪器多从裁剪帧回归姿态，缺乏手运动和手—物交互先验，结果不准确且不符合物理；同时缺少接触和力等物理线索限制视频用于策略训练。

Result: RLHND利用预训练Cosmos 3视频扩散骨干的手运动与手—物交互先验，通过干净潜变量条件将其改为确定性片段级特征提取器。姿态估计预测解剖合理关节角，并可选条件化形状参数以保持同一视频及同一演员多视频的手形一致。触觉估计采用独立专家流，在姿态流冻结时训练，预测手表面密集接触和力；LBS特征传播实现逐顶点提取而无需昂贵逐顶点注意力。多个基准上姿态、接触和力估计均达SOTA，并通过动作重定向和真实机器人实验展示机器人学习效用。

Insight: 视频基础模型的手—物先验可转化为更物理一致的姿态与触觉信号，扩展人类第一人称视频对机器人学习的监督形式。摘要未给具体基准数值或机器人任务收益。

Abstract: Recently, approaches that leverage human video datasets for robot policy training have become increasingly prevalent. However, most existing hand trackers regress pose from cropped frames with limited priors on hand motion and object interaction, resulting in inaccurate and physically inconsistent estimates. Moreover, the lack of physical cues, e.g., contact and force, limits the use of human videos for robot policy training. To this end, we propose RLHND, a video foundation model-based hand tracking model that jointly estimates hand pose and realistic tactile information from monocular egocentric videos. RLHND turns the pre-trained Cosmos 3 video diffusion backbone into a deterministic clip-level feature extractor via clean-latent conditioning, carrying its learned priors on hand motion and hand-object interaction into tracking. For pose estimation, RLHND (i) predicts hand poses with anatomically plausible joint angles and (ii) enables optional conditioning on the shape parameter to maintain consistent hand shape within the same video and even across videos recorded by the same actor. For tactile estimation, a separate tactile expert stream, trained with the pose stream frozen, predicts dense contact and force over the hand surface. We further adopt LBS-based feature spreading to enable vertex-wise feature extraction without costly per-vertex attention. RLHND achieves state-of-the-art performance across various benchmark datasets for pose estimation, while also achieving state-of-the-art performance in contact and force estimation. Moreover, we demonstrate the utility of RLHND for robot learning through retargeting results and real-world robot experiments. The code will be publicly available at https://seungjun-moon.github.io/rlhnd/.

[38] InstanceBench: Diagnosing Referential Reasoning and Target Identity in Referring Expression Segmentation cs.CVPDF

Yuchen Li, Shaoyang Zhou, Yiran Wang, Ruiyi Deng, Haoyu Wang

TL;DR: InstanceBench针对指代表达分割评测目标身份保持和参照逻辑，含6,194图、9,264目标实例和25,077条人工核验表达；同一图/掩码配对不同有效指称路径，并把目标选择错误与掩码生成错误分开。22个checkpoint中最佳mIoU 67.1%，但All@0.7仅59.6%，主要瓶颈为目标选择。

Details

Motivation: 标准RES评测不能系统区分参照逻辑、检查不同有效grounding路径下是否保持同一目标，也不能把目标选择和掩码生成错误拆开分析。

Result: InstanceBench是以实例为中心的诊断基准，包含6,194张图、9,264个目标实例、25,077条人工核验表达。每个目标中心表达集固定图像和目标掩码，配对最小表达与使用其他有效线索/指称路径的同目标变体。参照逻辑分类覆盖直接目标证据、同类选择、关系/组合定位和排除，并用逻辑关键构造抑制简单捷径。身份感知指标测目标保持和集合级成功，同时区分选择与掩码生成错误。22个原生mask checkpoint、18个模型家族中，最佳mIoU 67.1%，但All@0.7仅59.6%。干预证实模型对语言敏感，错误分解显示瓶颈主要在目标选择而非mask解码；受控训练子集上匹配监督可提升身份感知表现。

Insight: 高mIoU不等于不同合理表达下都指向同一实例；身份一致性和整组表达成功率揭示标准分割指标隐藏的指称推理错误。目标选择是主要瓶颈，且可通过针对性监督改善。

Abstract: Referring Expression Segmentation (RES) links natural-language descriptions to pixel-level object masks. Yet standard evaluation provides limited insight into instance-level referential reasoning: it does not systematically distinguish referential logics, test target preservation across valid grounding paths, or separate target-selection from mask-generation errors. We introduce InstanceBench, an instance-centered diagnostic benchmark comprising 6,194 images, 9,264 target instances, and 25,077 human-verified expressions. Each target-centric expression set (TCES) fixes the image and target mask while pairing a minimal expression with a same-target variant that uses another valid cue or grounding path. A compact referential-logic taxonomy spans direct target evidence, same-class selection, relational and compositional grounding, and exclusion, while logic-critical construction suppresses simpler shortcuts. Identity-aware metrics measure target retention and set-level success while separating selection from mask-generation errors. Across 22 native-mask RES checkpoints from 18 model families, the strongest checkpoint reaches 67.1% mIoU but only 59.6% All@0.7. Controlled interventions confirm language sensitivity, while failure decomposition identifies target selection rather than mask decoding as the main bottleneck. On a controlled training subset, matched supervision improves identity-aware performance, showing that the diagnosed capability responds to targeted supervision. Collectively, InstanceBench supports a measure-diagnose-improve cycle: measuring target consistency across grounding paths, localizing failure sources, and evaluating targeted interventions.

[39] SpatialUQ: Post-Hoc Uncertainty Quantification from Spatial Consistency in Black-Box Vision Models cs.CV | cs.AI | cs.LGPDF

Md Kawsher Mahbub, Milon Biswas, Mirza Niaz Morshed, Wei Yu

TL;DR: SpatialUQ是无需模型内部访问/重训的视觉不确定性估计方法，以整图预测与五个固定空间裁剪均值间的Jensen–Shannon散度衡量一致性。NIH ChestX-ray14（25,596例）上MUS故障检测AUC为0.784，高于MC-Dropout的0.664且计算量为其五分之一；严重分布偏移下与模型质量的相关性失效。

Details

Motivation: 临床视觉模型常以冻结黑盒部署，推理时无法访问内部、重训或获取真值。需要只基于输出概率、低成本量化不确定性的后处理方案。

Result: SpatialUQ通过六次确定性前向计算整图预测与五个固定空间裁剪预测均值的Jensen–Shannon散度，构造Multicrop Uncertainty Score。作者假设可信预测在空间视图间应保持一致。NIH ChestX-ray14的DenseNet-121、25,596样本上，MUS故障检测AUC 0.784，对比MC-Dropout 0.664（p<10⁻⁶），计算量仅五分之一；原生校准SCE为0.049，优于L1校准的0.127，并是在AUC高于0.78方法中校准最佳。MUS与熵、置信度和L1监督融合达到0.832，超过五成员集成0.813。BiomedCLIP上AUC升至0.899，与模型质量相关ρ=.846；分布内仍相关ρ=.523，但VinBigData严重偏移下相关ρ=.027。方法适合弥漫性发现，对小局灶结节较不可靠。

Insight: 空间裁剪一致性可在不访问模型内部和不重训时作为故障信号，且成本较低；但严重域偏移会破坏其与模型质量关系，且小病灶上可靠性较弱，不能作为通用不确定性保证。

Abstract: Clinical vision models are often deployed as frozen black boxes with no access to internals, retraining, or ground truth at inference time. We introduce \textbf{SpatialUQ}, a post-hoc uncertainty method using only output probabilities. It measures the Jensen-Shannon divergence between the global prediction and the mean of five fixed spatial crops in six deterministic forward passes. The premise is simple, trustworthy predictions are spatially consistent. On NIH ChestX-ray14 (DenseNet-121, $N{=}25{,}596$), our Multicrop Uncertainty Score (MUS) reaches $0.784$ failure-detection AUC versus $0.664$ for MC-Dropout ($p{<}10^{-6}$) at one-fifth the compute, with native calibration ($\text{SCE}{=}0.049$ vs.\ $0.127$ for $\ell_1$), the best-calibrated among methods above 0.78 AUC. A supervised fusion of MUS with entropy, confidence, and $\ell_1$ reaches $0.832$, outperforming a five-member ensemble ($0.813$). MUS scales with model quality, reaching $0.899$ with BiomedCLIP ($ρ= 0.846$), while this relationship remains meaningful in-distribution ($ρ= 0.523$) but breaks down under severe distribution shift (VinBigData, $ρ= 0.027$). MUS is well-suited to diffuse findings but is less dependable for small focal lesions such as nodules. Code and experimental materials are publicly available at https://huggingface.co/datasets/kawsher11/SpatialUQ.

[40] RT-DETR-World: Transferring Rich LLM Semantics to Real-Time Open-Vocabulary Detection cs.CVPDF

Yupeng Zhang, Ziyi Zhao, Juntao Cheng, Sheng Wang, Ningnan Guo

TL;DR: RT-DETR-World在训练期用GroundingCapv2提供类别名、实例描述和图像关系描述，再通过双路径描述对齐把丰富LLM语义迁移给紧凑DETR检测器：MiniLM路径与部署一致，冻结LLM教师离线特征只用于训练，推理时移除。实验报告零样本精度有竞争力且效率—准确率权衡良好。

Details

Motivation: 开放词汇检测需用文本查询识别未见类别，兼顾泛化和实时效率仍具挑战。真实泛化不仅依赖词表规模，也可利用已见数据学到的属性、动作、状态和场景关系语义；紧凑实时检测器难吸收这些丰富实例上下文。

Result: RT-DETR-World使用GroundingCapv2三级监督：类别名用于标准开放词汇检测、物体描述提供实例语义、图像描述提供对象关系和场景上下文；描述仅在训练时使用。Dual-Path Description Alignment包含与部署一致的MiniLM路径和仅训练用LLM教师：MiniLM提供查询—类别监督与物体描述对齐，预计算教师特征则在目标和图像层级分别监督匹配查询及全局视觉表示。教师特征预计算完毕，训练后删除教师模块。Relation-Aware Negative Relaxation使用教师语义相似度放宽相关负样本、保留精确正样本。实验显示零样本精度有竞争力、准确率—效率折中良好；摘要未给具体数值。

Insight: 训练期对象/场景描述可把丰富语义蒸馏进轻量检测器，而推理仍保持类别查询匹配的低成本接口；关系感知负样本避免把语义相关类别误当负例。当前摘要缺具体模型大小、准确率和时延。

Abstract: Open-vocabulary detection (OVD) recognizes categories unseen during training through textual category queries, yet achieving strong generalization with real-time efficiency remains challenging. Beyond vocabulary scaling, zero-shot generalization may benefit from reusable visual–semantic cues learned from seen data, including attributes, actions, states, and contextual relations. Existing real-time OVD methods primarily emphasize vocabulary coverage and efficient region/query–text matching; under strict efficiency constraints, compact detectors may struggle to absorb rich instance semantics and scene context. We propose RT-DETR-World, a compact DETR-style detector that transfers the rich semantics conveyed by descriptions during training while retaining lightweight query–text matching at inference. We construct GroundingCapv2 with three levels of supervision: category names for standard OVD, object descriptions conveying instance-level semantics, and image descriptions conveying object relations and scene context. These descriptions serve only as training-time semantic supervision. To help the compact detector absorb these semantics, we propose Dual-Path Description Alignment (DDA), combining a deployment-consistent MiniLM pathway with a training-only LLM teacher. MiniLM provides query–category supervision and object-description alignment, while offline teacher features supervise matched queries and global visual representations at the object and image levels, respectively. All teacher features are precomputed, and the teacher-side modules are removed after training. We further propose Relation-Aware Negative Relaxation (RNR), which uses teacher-derived semantic similarities to relax related negatives while preserving exact positives. Experiments demonstrate competitive zero-shot accuracy and a favorable accuracy–efficiency trade-off. The code will be released.

[41] OmniCam: Omni-Camera Trajectory Generation via Geometry-Grounded Pose Token Learning cs.CV | cs.AIPDF

Zhenyang Liu, Chenjie Cao, Yisu Zhang, Xuhui Zuo, Xiangyang Xue

TL;DR: OmniCam从单张全景图和文字轨迹描述自回归生成相机位姿序列，结合全景点云编码、绝对旋转/相对平移token化及显式3D目标锚点；作者构建含267,700条轨迹的OmniCaT。相较在该数据集重训的GenDoP，轨迹误差降28%–47%、碰撞率降65.8%；相较各指标最佳基线，ATE和碰撞分别降43.0%与62.3%。

Details

Motivation: 相机轨迹控制视频生成、场景重建和机器人感知；从语言生成轨迹需同时理解场景几何与目标构图。既有轨迹生成方法难保证全景几何一致性和目标引导。

Result: OmniCam以单张全景图和文字轨迹描述为条件，自回归生成相机位姿序列。几何扎根pose token学习包含全向点云编码器、绝对旋转和相对平移的混合token化（并保持四元数符号时序一致），以及分别建模几何和语义、含显式3D目标锚点的条件流。作者构建OmniCaT，含四类相机行为共267,700条轨迹。在所报OmniCaT评估中，相较用OmniCaT重训的GenDoP，轨迹误差降低28%–47%、碰撞率降低65.8%；相较每指标最佳基线，ATE降低43.0%、碰撞降低62.3%。消融支持几何与目标条件；下游探索相机控制视频生成和机器人主动感知。

Insight: 全景几何和目标锚点共同约束轨迹生成，可降低碰撞并改善相机路径精度；旋转/平移采用不同参数化有助于表达姿态运动。结果依OmniCaT与对比协议，摘要未列每种行为的具体误差。

Abstract: Camera trajectories control viewpoint changes in video generation, scene reconstruction, and robotic perception. Generating them from language requires both scene geometry and target-aware framing. We introduce OmniCam, an autoregressive model that generates camera pose sequences from a single panorama and textual trajectory descriptions. Its geometry-grounded pose token learning combines three components: a panoramic point-cloud encoder for omnidirectional geometric context; hybrid absolute-rotation and relative-translation tokenization with temporally consistent quaternion signs; and separate geometric and semantic conditioning streams with an explicit 3D target anchor. We also construct OmniCaT, containing 267,700 trajectories across four camera behaviors. On the reported OmniCaT evaluation, OmniCam reduces trajectory errors by 28–47% and collision rate by 65.8% relative to GenDoP retrained on OmniCaT. Against the best baseline for each metric, the ATE and collision reductions are 43.0% and 62.3%, respectively. Component ablations support the use of geometric and target-aware conditioning, while downstream experiments examine camera-controlled video generation and robotic active perception.

[42] It Is Not Seeing the Hazard: A Frozen Vision-Language Safety Score Measures Its Caption Bank cs.CV | cs.LGPDF

Samuel Tetteh, Cody Fleming

TL;DR: 本文对冻结CLIP安全分数进行受控审计，发现其所谓危险信号更多衡量场景与危险描述caption库的相似度，而未证明在识别危险本身。三种策略、180个episode、130次孤立碰撞起始中，分数在碰撞前约20步下降；但改变caption分离度或相机视角会改变分数，常数置信度控制仍保留更低灾难率点估计。

Details

Motivation: 冻结VLM常被用作强化学习中的安全奖励、代价或置信权重，隐含前提是与危险语言的相似度真正表示危险。策略回报和碰撞率本身无法说明模型在检测危险，还是响应与危险相关的场景特征、提示结构或视角。

Result: 研究对冻结CLIP提示边际安全分数进行控制评估：输入从未获得该分数的策略轨迹，将碰撞前观测与危险几何相近但无接触观测匹配，并改变caption、编码器和相机视角。三种策略、180个episode、130个孤立碰撞起始中，分数约在接触前20步下降。机制控制显示分数主要跟踪caption共享场景的相似性，并随caption间距及视角变化。常数置信度控制仍保留更低灾难率点估计，因此此前策略收益不能证明模型真正感知危险。

Insight: 一个分数能与碰撞相关，不等于它编码了安全语义；需要通过匹配危险几何、改提示和改视角等干预识别其机制。现有CLIP分数对caption/视角敏感，不能据此声称模型具有可靠危险感知。

Abstract: Frozen vision-language models increasingly provide safety signals for reinforcement learning. Their use assumes that similarity to language describing danger indicates the hazard itself. Yet policy return and collision rate cannot reveal whether a score detects hazards or responds to correlated features of the scene. VLM-based methods have reported gains in driving and safe-RL benchmarks by converting image-text similarity into rewards, costs, or confidence weights. Such signals promise to reduce reliance on manually designed feedback. They may also reflect prompt structure, embedding geometry, or camera viewpoint, leaving their safety meaning unverified. To address this gap, we present a controlled evaluation of a frozen CLIP prompt-margin safety score. We apply the score to trajectories generated by policies that never receive it, match pre-contact observations to contact-free observations with comparable hazard geometry, and vary the captions, encoder, and camera view. Across three policies, 180 episodes, and 130 isolated contact onsets, the score decreases for about twenty steps before contact. Mechanism controls indicate that the score mainly tracks resemblance to the scene shared by its captions and changes with caption separation and camera view. A constant-confidence control retains the lower catastrophe-rate point estimate, so policy gains do not establish hazard perception.

[43] STRIKE: Learning Visual State Transitions for Physical World Modeling cs.CVPDF

Wenbin Teng, Tianshuo Xu, Depu Meng, Yuelei Li, Quentin Herau

TL;DR: STRIKE将物理世界建模拆为状态转移学习与稠密视频生成：从训练视频提取事件对齐状态，用当前图像、局部转移说明和时间间隔预测下一状态；推理时由预训练VLM规划转移，再递归预测状态，最后由独立动态模型生成完整rollout。Physics-IQ Verified、PhyGenBench、Pisa-Experiments和RoboTwin2.0上优于相应视频骨干基线。

Details

Motivation: 物理世界模型不仅要生成连贯运动，还需预测交互如何改变场景。直接做稠密视频生成可能难以显式学习可组合的物理状态变化。

Result: STRIKE将训练视频抽取的观测状态与转移说明、时间偏移配对作为事件对齐监督。基于图像的状态转移模型输入当前图像、局部转移描述和经过时间，预测下一场景配置。推理时，预训练VLM规划器预测时间转移说明，反复调用状态模型生成未来状态序列；另训练动态模型，基于这些状态及其时间位置生成完整视频rollout。Physics-IQ Verified、PhyGenBench、Pisa-Experiments和RoboTwin2.0实验显示，STRIKE在物理一致性和操作视频保真度指标上超过对应视频骨干基线；摘要未给具体幅度。

Insight: 把状态变化与视频纹理/动态生成分开，可让模型先显式推理物理状态，再由生成器补全细节，为物理建模提供中间表示。当前证据覆盖模拟物理和机器人任务，但摘要未给各项数值或推理成本。

Abstract: Physical world modeling requires predicting how interactions change a scene, not merely generating coherent motion. We propose STRIKE, a framework that separates visual state transition learning from dense video generation. We construct event-aligned supervision by extracting observed states from training videos and pairing them with transition descriptions and temporal offsets. An image-based transition model learns to predict the next scene configuration from the current image, a local transition specification, and elapsed time. At inference, a pretrained vision-language planner predicts time transition specifications, and recursive application of the learned transition model produces a sequence of future visual states. A separately trained dynamic model then generates the complete rollout conditioned on these states and their temporal locations. Experiments on Physics-IQ Verified, PhyGenBench, Pisa-Experiments, and RoboTwin2.0 show improvements of STRIKE over the corresponding video-backbone baselines in benchmark measures of physical consistency and manipulation-video fidelity. These results support learned visual state transitions as an effective intermediate representation for physical world modeling.

[44] STORK: Spatio-Temporal Observation of uterine contRactions via neural networKs cs.CVPDF

Melissa Schween, Tristan Gottwald, Jordina Aviles Verdera, Lisa Story, Mary Rutherford

TL;DR: STORK将胎儿MRI子宫收缩检测形式化为弱监督多实例学习，只用序列级标签。模型以平行时间超平面分支分解3D时空卷积，用强度和Demons位移嵌入经均值池化后，可事后恢复逐帧收缩分数。约700例多厂商MRI上序列级AUROC 95.0%、AUPRC 94.6%，优于3D ResNet和ConvNeXt。

Details

Motivation: 胎儿MRI中的子宫收缩通常人工识别后被丢弃，限制对收缩动力学的研究。逐帧标注成本高，需要仅依赖粗粒度序列级标签识别时空活动。

Result: STORK把子宫收缩活动检测定义为弱监督任务，用动态MRI序列的粗序列标签训练多实例学习模型。为避免完整4D卷积成本，3D时空卷积被拆为沿不同时间超平面的并行分支，以捕捉连贯组织运动。每帧嵌入结合图像强度和Demons估计位移场，再通过线性均值池化头聚合；因此无需帧级训练标注，也能事后恢复帧级收缩分数。约700个多厂商胎儿MRI序列上，序列级AUROC为95.0%、AUPRC为94.6%，明显优于3D ResNet和ConvNeXt。Grad-CAM显示模型可能利用胎盘以外的子宫组织预测特征。

Insight: 粗序列标签可训练模型识别收缩并由池化结构回溯帧级贡献，降低标注成本；结果跨多厂商数据表现强。模型利用胎盘外组织线索的解释来自Grad-CAM，尚不能证明其因果生理机制。

Abstract: Uterine contractions in fetal MRI are typically identified manually and discarded, limiting insights into contraction dynamics. We formalize Uterine Contractile Activity Detection (UCAD) as a weakly-supervised learning problem and introduce STORK, a multi-instance learning model trained on dynamic MRI series using only coarse, series-level labels. STORK factorizes 3D spatio-temporal convolutions into parallel branches across temporal hyperplanes to capture coherent tissue motion without the cost of full 4D convolutions. Per-frame embeddings, combining intensity and Demons-estimated displacement fields, are aggregated by a linear mean-pooling head. This ensures that frame-level contraction scores can be recovered post-hoc without frame-level training supervision. Evaluated on around 700 multi-vendor dynamic fetal MRI series, STORK achieves a series-level AUROC of 95.0% and AUPRC of 94.6%, substantially outperforming 3D ResNet and ConvNeXt baselines. Grad-CAM analysis suggests that the model draws on predictive features extending beyond the placenta into the uterine tissue, offering an automated tool for richer phenotyping of uterine behavior.

[45] Visual Evidence Under Cross-Examination: Evaluating and Controlling Decision-Level Evidence Use in Vision-Language Models cs.CVPDF

Huiyao Zhang, Jin Bai, Zilong Su, Rui Guo, Chaofan Qin

TL;DR: CROSS-Bench评估VLM视觉证据是否确实支持特定候选：有效证据应帮助被支持候选，关系被破坏时额外影响应消失，重新绑定后影响应转向新候选。RIVET接口保留证据身份/不确定性并控制候选条件强度；匹配训练中正向证据条件下效应转移率从0.512升至0.651，四个冻结骨干原始输入上准确率平均提高5.70个百分点。

Details

Motivation: VLM会使用裁剪、区域和工具观察进行推理，但某条视觉观察影响最终答案，不代表它帮助了它本应支持的候选。需要区分证据有效性与影响归属。

Result: CROSS-Bench含28,000个决策问题，专门子集包含证据关系破坏和重新绑定测试。作者提出候选绑定视觉贡献标准：有效证据应帮助其支持候选；若关系失效，额外影响应移除；若重新绑定，影响应转到新支持候选。RIVET保留证据身份和不确定性，组合候选条件响应并单独控制证据强度。共享证据实验表明，任务准确率与证据归属可能分离。在训练容量匹配情况下，当干净证据有正效应时，RIVET将归一化效应转移从0.512提高到0.651；跨共同评估样本和重复决策层拟合仍保持优势。原始输入预测证据时，相较无辅助证据模型，四个冻结骨干CROSS-Bench准确率平均提高5.70个百分点。

Insight: 评估视觉证据不能只看答案正确率，还要通过破坏/重绑定干预检查其作用是否落到正确候选；RIVET把证据身份和强度分开控制。结果显示效用与证据归属是不同维度，需联合测量。

Abstract: Vision-language models increasingly reason through crops, regions, and tool-produced observations. Yet an observation can influence the answer without benefiting the candidate it supports. We study candidate-bound visual contribution: valid evidence should help, invalidating its supporting relation should remove its additional effect, and valid rebinding should redirect that effect to the newly supported candidate. We introduce CROSS-Bench, a benchmark of 28,000 decision problems, with matched invalidation and rebinding tests on a dedicated evaluation subset. Our RIVET interface preserves evidence identity and uncertainty, composes a candidate-conditioned response, and separately controls its strength. Shared-evidence experiments show that task accuracy and evidence ownership can diverge. Under matched capacity and training, RIVET increases normalized effect transfer from 0.512 to 0.651 where clean evidence has a positive effect. The advantage persists on common evaluation examples and across repeated decision-layer fits. With evidence predicted from raw inputs, RIVET improves CROSS-Bench accuracy by an average of 5.70 pp across four frozen backbones, relative to the same models without auxiliary evidence. These results separate the utility of visual evidence from the candidate-specific destination of its effect.

[46] What Makes Synthetic Hard Negatives Work in Vision-Language Pretraining? cs.CV | cs.AIPDF

Nikos Giakoumoglou, Paschalis Giakoumoglou, Andreas Floros, Kleanthis Marios Papadopoulos, Tania Stathaki

TL;DR: 提出 SNAP，在视觉语言预训练中用不包含正样本信息的表征空间合成负例，避免已有合成困难负例的几何失效并提升多项下游评测。

Details

Motivation: 表征空间合成困难负例已用于单模态自监督学习，但迁移到视觉语言预训练时，跨模态合成可能产生过易负例或把负例拉向查询，单模态合成则可能混入匹配正例；可学习温度还会出现 logit 尺度饱和。

Result: 作者分析六类表征空间合成策略并归纳上述两种失败模式，发现固定温度可改善下游表现。据此提出 SNAP：只在单一模态内生成困难负例，且不使用任一模态的匹配正样本。该方法无需外部生成模型、与模型无关，训练时间额外开销低于 10%。在 CLIP、FLIP、多种架构和数据集上，零样本检索、零样本分类及线性探测均取得一致提升；摘要未列出具体提升幅度。

Insight: 关键设计不是更复杂地生成负例，而是通过构造约束排除正样本泄漏与跨模态几何偏差。温度固定也说明负例质量需要与 logit 尺度联合考虑。

Abstract: Synthetic hard negatives generated in the representation space have proven effective for unimodal self-supervised learning, but transferring this idea to vision-language pretraining is not straightforward. We analyze six representation-space synthesis strategies and identify two failure modes in their transfer to vision-language pretraining: cross-modal constructions that produce overly easy negatives or pull them toward the query, and intra-modal constructions that incorporate the matched positive. We also observe logit-scale saturation when training with synthetic hard negatives and a learnable temperature, and find that fixing the temperature improves downstream performance. Using this geometric analysis we propose SNAP, which generates intra-modal hard negatives that never involve the positive from either modality, avoiding both failure modes entirely. SNAP is model-agnostic, requires no external generative models, and adds less than 10% training time overhead. Evaluated on top of CLIP and FLIP across multiple architectures and datasets, SNAP delivers consistent improvements on zero-shot retrieval, zero-shot classification, and linear probe evaluation.

[47] DynStream: Online Streaming 4D Gaussian Reconstruction of Dynamic Worlds from Unposed Video cs.CVPDF

Dingwei Xian, Xiaoyu Zhou, Yajiao Xiong, Yongtao Wang, Ming-Hsuan Yang

TL;DR: 提出 DynStream，从无位姿长视频流在线重建动态 4D 高斯场景，通过局部时间窗重建与跨窗对齐融合维持全局一致性和高保真渲染。

Details

Motivation: 无位姿长视频的动态场景重建既需要持续在线处理，也需要稠密几何和逼真渲染。已有前馈高斯方法多限于离线处理，在线点云方法则难以同时维持稠密几何和高质量渲染。

Result: DynStream 对连续输入视频按局部时间窗重建，再增量对齐、融合各窗口，形成全局一致场景；它联合约束跨窗几何一致性并建模随时间变化的内容，无需针对单场景优化。摘要称其可在长视频流上高效完成在线动态重建与逼真渲染，并在多种动态室内外场景取得 SOTA，但没有提供数据集名称或定量指标。

Insight: 方法将长时序在线重建拆成局部可处理单元，再用增量融合连接局部坐标与几何，兼顾流式处理和全局场景一致性。当前摘要不足以判断具体速度、内存开销及与各基线的数值差距。

Abstract: Online reconstruction of dynamic 4D scenes from long, unposed streaming videos requires both continuous processing and photorealistic rendering, which existing methods struggle to achieve simultaneously. Existing feed-forward Gaussian methods are restricted to offline processing, whereas online point-cloud approaches struggle to maintain dense geometry and high-fidelity rendering. We present DynStream, a framework for streaming 4D Gaussian reconstruction from long, unposed videos. Given a continuous video stream, DynStream reconstructs the scene within local temporal windows and incrementally aligns and fuses these local reconstructions into a globally consistent scene, enabling online 4D reconstruction without per-scene optimization. By jointly enforcing cross-window geometric consistency and modeling time-varying scene content, DynStream supports efficient reconstruction and photorealistic rendering over extended video streams. Experiments demonstrate that DynStream enables high-fidelity online dynamic reconstruction and rendering from long video streams, achieving state-of-the-art performance across diverse dynamic indoor and outdoor scenes.

[48] Flow-of-Thought: A Framework for Visual Reasoning cs.CVPDF

Mariia Baidachna, Nicolas Pugeault

TL;DR: 提出 Flow-of-Thought（FoT），把生成视觉草图作为中间推理步骤，以连续视觉轨迹表征部分空间推理过程。

Details

Motivation: LLM 与 ViT 在空间理解任务上仍有不足；人类会借助心像进行推理。FoT 探索将这种“脑中可视化”外化为可解释的中间草图，辅助比较不同生成假设。

Result: FoT 在 SO(2) 群轨道上训练坐标感知轨迹流场，并结合累积最短路径学习后冻结动力学；same/different 判断通过前景加权重建能量比较竞争假设。锁定测试集上，Tetris 准确率 100%，彩色形状准确率 99%。冻结迁移到 BLINK Multi-view 的 133 个公开验证样例时，轨道训练的二维流达到 72.2%，高于仅使用终点的对照 63.9%。

Insight: 该结果支持连续视觉轨迹可作为部分分布外空间推理任务中有效且可解释的表示，但证据仅覆盖摘要所述任务与验证集，不能据此推断一般视觉推理能力。

Abstract: Mental imagery, ``seeing with the mind’s eye’’ is an essential aspect of human cognition. Despite rapid progress Large Language Models (LLMs) and Vision Transformers (ViTs) still underperform on tasks requiring spatial understanding. To address this, we introduce Flow-of-Thought (FoT), a framework that integrates the generation of visual sketches as intermediate reasoning steps, mimicking mental imagery in humans. We train coordinate-aware trajectory flow fields on $SO(2)$ group orbits and cumulative shortest paths, then freeze the learned dynamics; same vs. different decisions compare competing generative hypotheses using foreground-weighted reconstruction energy. On locked tests FoT reaches 100.0% accuracy on Tetris and 99.0% on colored shapes. Under frozen transfer, the orbit-trained 2D flow improves over its endpoint-only control on BLINK Multi-view (72.2% vs. 63.9% on 133 public validation pairs), supporting continuous visual traces as an effective and interpretable representation for spatial reasoning in some out-of-distribution settings.

[49] Beyond Group Splits: Specimen-Level Cross-Validation and Visual Attribution for Remaining-Shelf-Life Regression in Climacteric Fruit cs.CVPDF

Rovhona Mudau, Jean Frederic Isingizwe Nturambirwe, Clement Nthambazale Nyirenda

TL;DR: 研究牛油果图像剩余货架期回归的评估偏差：同一果实的图像必须按样本主体划分；随机按图像切分会高估模型效果。

Details

Motivation: 同一生物样本可能有多张纵向图像，若训练集和测试集共享果实，观测级随机划分会造成信息泄漏，使货架期预测性能看起来过于乐观。

Result: 作者在包含 426 个果实、三种储存条件的 Hass Avocado Ripening 数据集上评估冻结的 ImageNet 视觉骨干加轻量回归头，共 8,834 对图像与剩余货架期标签。10 次观测级随机划分的平均 RMSE 为 2.37 天（标准差 0.03）；主体隔离的 5 折交叉验证平均 RMSE 为 3.12 天（标准差 0.11），平均 R² 为 0.553。按果实匹配比较显示主体隔离评估误差更高，426 个果实上的检验 p<0.001。主体隔离设置下，0.93M 参数的 MobileNetV3-Small 准确度与 ResNet-18 相当且吞吐更高；Grad-CAM 还揭示轻量骨干的空间归因差异。

Insight: 对纵向图像任务，划分单位应对应独立生物主体，而非单张观测；否则同一果实跨训练/测试会显著乐观化误差。结论是在该数据集和模型配置下得到的，论文建议结合主体隔离评估与归因分析。

Abstract: Estimating remaining shelf life (RSL) from images could provide affordable decision support for perishable produce, but evaluation protocols can substantially affect reported performance when repeated images are available from the same biological specimen. We use the Hass Avocado Ripening dataset, comprising 8,834 image-RSL pairs from 426 fruits across three storage regimes, to evaluate a frozen ImageNet-pretrained visual backbone with a lightweight regression head. Our contributions are threefold: we quantify the effect of observation-level versus specimen-disjoint evaluation, compare lightweight and heavier visual backbones under specimen-disjoint cross-validation, and examine their spatial attributions using Grad-CAM. Across ten observation-level random splits, the model achieves a mean RMSE of 2.37 days with a standard deviation of 0.03 days, whereas specimen-disjoint 5-fold cross-validation yields a mean RMSE of 3.12 days with a standard deviation of 0.11 days. The corresponding mean coefficient of determination is 0.553. A matched per-specimen comparison confirms higher error under specimen-disjoint evaluation, with a probability value below 0.001 across 426 specimens, showing that observation-level partitioning gives a substantially more optimistic estimate for this dataset and model configuration. Under specimen-disjoint evaluation, MobileNetV3-Small (0.93 million parameters) achieves accuracy comparable to ResNet-18 while providing substantially higher throughput, and Grad-CAM reveals differences in spatial attribution between the lightweight backbones. These results support specimen-disjoint evaluation and attribution analysis when assessing lightweight vision models for longitudinal shelf-life prediction.

[50] SoccerNet-FoulRet: Retrieving Semantically Similar Soccer Foul Videos cs.CV | cs.IRPDF

Jacobus Arthur, Ahmad Sait, Batool Hani, Merey Ramazanova, Jan Held

TL;DR: 提出 SoccerNet-FoulRet 足球犯规语义检索基准：按裁判判罚相关性检索历史案例，而非按画面相似度或同类事件检索。

Details

Motivation: 职业足球裁判判罚可能不一致，裁判也难以快速比较当前争议犯规与过去的相似判例。传统视频检索偏向视觉相似或共享事件类别，无法表达裁判解释层面的相关性。

Result: 作者基于 SoccerNet-MVFoul 构建基准，提供 693 个经人工验证的查询及类别相关性标签，评估零样本视频/VLM 嵌入模型和任务微调基线。语义犯规检索仍很困难：最强零样本模型在人类验证判例上的 HitRate@10 不足 5%；类别监督微调能改善类别相关性，但向判例检索的迁移有限。

Insight: 视觉或事件类别相似并不等同于裁判意义上的判例相关；基准将检索目标转向判罚解释，暴露了现有视频嵌入与司法式语义比较之间的差距。

Abstract: Refereeing decisions in professional soccer remain inconsistent because referees cannot easily compare a contentious foul against similar past cases. We cast this as a retrieval problem and introduce SoccerNet-FoulRet, the first benchmark for semantic foul retrieval. Given a query foul, the task is to retrieve past fouls judged to be relevant precedents, regardless of camera angle, teams, or appearance. This differs from prior video-to-video retrieval, which matches clips by visual similarity or a shared event. Here, relevance is defined by refereeing interpretation. We build the benchmark from the SoccerNet-MVFoul dataset and evaluate retrieval ability of zero-shot video and vision-language embedders together with a task-specific fine-tuned baseline on 693 human-verified queries and category-relevance labels. Semantic foul retrieval remains challenging. The strongest zero-shot model achieves under 5% HitRate@10 on human-verified precedents, while category-supervised fine-tuning improves category relevance but transfers only modestly to precedent retrieval. We release SoccerNet-FoulRet to establish semantic foul retrieval as an open problem: https://github.com/SoccerNet/sn-foulret.

[51] Diffusion-Generated Image Watermarking: A Two-Axis Taxonomy and Three Protocol-Bounded Case Studies cs.CVPDF

Sung Ju Lee, Nam Ik Cho

TL;DR: 提出扩散生成图像水印的双轴分类法与三项受限协议案例研究，梳理插入机制、承载表征、验证流程和攻击评测方式。

Details

Motivation: 扩散图像水印需要权衡来源追踪、图像质量、编辑鲁棒性和计算开销；不同方法的实验协议不一，直接横向排名容易混淆机制与评测设置。

Result: 论文按水印插入机制和主要信号承载表征建立分类，并形式化一个代表性的 z_T-Fourier 验证与识别流程。三项案例分别考察频率完整性、检测、图像质量与裁剪的关联；种子相关/无关编辑下的持久性并提出范围受限的语义印记假设；以及单次 VAE 潜变量相位调制的效率、再生成鲁棒性和鲁棒性—质量工作点。作者还区分四类内容层攻击与模型/流程适配，提出对应评测协议、关于参数调优威胁的可检验猜想，并讨论视频时间维扩展。

Insight: 文章目标是建立协议匹配、可比较的分析框架，并未证明某种水印普遍最优，也未声称定位了语义承载信号或建立因果机制。

Abstract: Watermarking diffusion-generated images requires balancing provenance signals with image quality, robustness, and computational cost. This work organizes methods along two axes: insertion mechanism and primary signal-bearing representation, and formalizes a representative $z_T$-Fourier pipeline for verification and identification. We then use the taxonomy to structure three protocol-bounded case studies. The first examines associations among frequency integrity, detection, quality, and cropping behavior. The second revisits persistence under seed-linked and seed-independent editing and formulates a scoped Semantic Imprinting Hypothesis without claiming a localized carrier or causal mechanism. The third studies single-shot VAE-latent phase modulation, including its efficiency, regeneration robustness, and robustness–quality operating points. Finally, we separate four content-level attack families from model/pipeline adaptation, propose corresponding evaluation protocols and testable conjectures for parameter-tuning threats, and identify additional temporal extensions for video. These analyses do not establish a universal ranking; instead, they provide a framework for matched, protocol-aware comparisons of watermarking systems for diffusion-generated images.

[52] Relational Abstractions for Spatial Reasoning with Diffusion Models cs.CVPDF

Ana Ezquerro, Ozan Özdenizci

TL;DR: 提出以无监督对象发现和对象关系抽象增强扩散模型空间推理，并构建四个源自人类可解谜题的数据集组成的大规模生成式空间推理基准。

Details

Motivation: 扩散模型擅长图像生成，但在满足结构化空间约束方面仍不可靠；在具有隐式逻辑规则的条件生成任务中，模型可能只拟合像素分布而未学会用于推理的底层规则。

Result: 框架从对象中心表示中提取关系知识，将关系抽象作为结构基元，在训练和推理阶段指导生成表示，并生成满足推理约束的图像。作者报告该方法在多种复杂推理任务中显著提升扩散模型推理表现，并支持分布外稳健泛化；基准包含四个以人类可解谜题为灵感的数据集。摘要没有列出数据集规模、具体任务名称或定量分数。

Insight: 论文将可组合对象关系引入生成模型，试图让模型利用显式结构而不只是近似像素级条件分布。量化效果和泛化范围需要查看完整实验结果，摘要不足以核实具体幅度。

Abstract: Diffusion models excel at image synthesis, but they remain limited in their ability to reliably satisfy structured spatial reasoning constraints. In conditional data distribution modeling tasks with implicit logical structure, such as puzzles defined by visible clues paired with consistent solutions, state-of-the-art generative models tend to approximate pixel-space distributions without learning the underlying logical rules required for inference. To address this limitation, we present a novel framework for spatial reasoning with diffusion models that leverages unsupervised object discovery and abstractions of object relations. We show that the relational knowledge derived from object-centric representations enriches diffusion models with structural primitives, allowing them to effectively guide the generative representation space during both training and inference, and enabling conditional image generation that satisfies reasoning constraints. Additionally, we introduce a large-scale generative spatial reasoning benchmark with four datasets inspired by human-solvable puzzles. Our results show that relational abstractions significantly improve reasoning capabilities of diffusion models on a variety of complex reasoning tasks, while enabling robust generalization in out-of-distribution settings.

[53] UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map cs.CV | cs.ROPDF

Keke Yang, Erqi Wang, Sainan Guan, Hongliang Ren

TL;DR: 提出 UltraWorld，从未跟踪的临床超声视频自蒸馏交互式世界模型，并用声学采样图把探头动作和超声成像几何联系起来。

Details

Motivation: 自主超声扫描需要预测探头运动带来的观测变化，但常规临床数据缺少大规模同步视频—位姿标注；模型还必须刻画超声的截面采样几何，才能可靠跟随动作。

Result: 方法先将视频基础模型适配为以参考图像和解剖掩码为条件的超声生成器，再从可编程 3D 解剖轨迹采样掩码合成动作—视频对，借此自蒸馏出根据局部观测与动作预测未来观测的世界模型。推理阶段不需要解剖掩码或其他 3D 资产。AsMap 将探头位姿和成像设置表示为逐像素 3D 采样位置、波束方向和深度。在 9 个模拟闭环局部规划回合中，相较视觉伺服，最终目标距离平均降低 29%，方向误差降低 38%；摘要还称预测保真度与动作跟随有所提升。

Insight: 核心是以合成动作—观测数据绕过真实动作标注，再将超声成像采样几何显式注入动作条件。所报闭环结果来自模拟规划回合，不等同于真实临床扫描验证。

Abstract: World models can enable autonomous ultrasound scanning by predicting the outcomes of probe motions from local observations. Learning this action–observation relationship typically relies on synchronized video–pose pairs, which are costly to collect at scale and largely unavailable in routine clinical recordings. Reliable action following further requires modeling ultrasound’s cross-sectional sampling geometry. We present UltraWorld, a self-distillation recipe that transfers priors from clinical ultrasound videos into interactive world models without real action annotations. Starting from clinical videos, we adapt a video foundation model into an ultrasound generator conditioned on reference images and anatomical masks. Anatomical masks sampled along programmable trajectories through 3D anatomy provide spatial guidance for synthesizing action–video pairs. We then use these synthetic pairs to self-distill the generator into a world model that predicts future observations from local observations and actions, without requiring anatomical masks or other 3D assets at inference time. To further improve action following, we introduce the Acoustic Sampling Map (AsMap), which represents probe poses and imaging settings as pixel-wise 3D sampling positions, beam directions, and depths. Experiments demonstrate improved prediction fidelity and action following. Across nine simulated closed-loop local planning episodes, UltraWorld reduces the mean final distance to the goal and orientation error by 29% and 38%, respectively, compared with visual servoing. Project Page: https://ultraworld-project.github.io/.

[54] Beyond Masks and Trajectories: Flow-Guided Latent Action Injection for Stable Surgical Video Generation cs.CVPDF

Tsz-Yui Qin, Siyu Zhou, Chi-Keung Tang, Yuxiang Nie, Shu Yang

TL;DR: 提出 FLAIR，以真实手术视频光流学习动作先验，并注入冻结生成模型潜变量，实现无需辅助视觉条件的文本驱动手术视频生成；同时发布动作数据集与领域指标。

Details

Motivation: 高质量且动作可信的手术视频生成有助于教育、模拟和数据增强，但现有方法通常依赖掩码、轨迹、深度或参考视频等条件，需额外标注或专门采集，不易扩展到大规模数据。

Result: FLAIR 从真实手术视频光流学习动作先验，根据输入提示动态预测潜在动作表示，并注入冻结的基础模型以改善动作一致性。作者构建 SurgActionClip-30K，包含动作中心切分片段和结构化字幕；另提出 SurgMetrics 评估手术视频生成质量。实验摘要称可仅凭文本生成高质量手术视频，SurgMetrics 验证其与人类感知的一致性优于传统指标，但没有提供具体生成质量分数或人评数值。

Insight: 工作将动作控制先验、数据资源和领域评估指标一起补齐，强调领域专用指标可能比通用视频指标更贴近临床感知。摘要没有给出临床有效性或真实使用验证。

Abstract: Surgical video generation holds substantial potential for surgical education, simulation, and data augmentation, yet generating surgical videos with realistic and clinically plausible motion remains challenging. Most existing methods rely on auxiliary conditions, such as masks, trajectories, depth, or reference videos, to achieve visually plausible synthesis. Yet, these auxiliary conditions typically require additional manual annotation or specialized acquisition, making it difficult to scale such methods beyond small, curated datasets. This motivates the need for a reference-free architecture capable of generating high-quality surgical video without requiring auxiliary visual conditions at inference time. We propose FLAIR, a Flow-guided LatentAction Injection framework for Reference-free surgical video generation. FLAIR learns action priors from optical flow of real surgical videos, dynamically predicts corresponding latent action representation from an input prompt, and injects it into a frozen base model to generate surgical videos with improved action consistency. We further construct SurgActionClip-30K, the first large-scale surgical vision dataset comprising action-centric segmented clips and structured caption labels, addressing the persistent lack of fine-grained, action-centric surgical datasets. Lastly, we introduce SurgMetrics, the first surgical domain-specific evaluation metrics for quantifying the quality of generated surgical videos, addressing the persistent absence of clinically grounded evaluation standards in this domain. Extensive experiments demonstrate that FLAIR enables generating high-quality surgical videos using text-only inference without auxiliary conditions, and validation in SurgMetrics demonstrates its strength in alignment with human perception compared to traditional metrics.

[55] DisParQ: Self-Supervised Part Concepts for Interpretable Vision Foundation Models cs.CV | cs.AI | cs.LGPDF

Adam Pardyl, Siddhartha Gairola, Sukrut Rao, Adam Wróbel, Bartosz Zieliński

TL;DR: 提出 DisParQ，从冻结的自监督视觉骨干中无监督学习空间对齐的离散部件概念和量化属性，用于可解释表示与跨类别部件检索。

Details

Motivation: 概念型视觉模型便于追溯预测依据，但常依赖预定义类别，或以语言监督定义概念。作者希望仅凭冻结的视觉自监督表征学习可检查、带空间定位的离散部件概念。

Result: DisParQ 将每个图像块分配给可学习原型字典中的一个概念，并限制每张图像激活的概念数量；再以连续残差表达概念的图像间变化并将其量化为离散属性。空间解码器仅从概念和属性重建骨干表征。七个通用与细粒度数据集的评估显示，其 ImageNet 线性探测 top-1 为 83.2%，接近冻结 DINOv2 教师；概念一致性高于语言对齐模型，细粒度识别仍有竞争力，并可进行跨类别部件检索。

Insight: 离散概念和属性被训练为保留强视觉骨干的信息，同时减少对标签和语言定义的依赖。重建能力提供了表征保真约束，但摘要未给出概念数量、各数据集完整分数或解释性用户研究。

Abstract: Concept-based vision models represent images through an intermediate layer of human-inspectable concepts, so what a model relies on can be traced to those concepts. However, those models are often limited to fixed categories or depend on language to define their concepts. We introduce DisParQ (Discrete Parts with Quantized attributes), a method that learns spatially grounded, discrete concept representations from a powerful frozen vision-only self-supervised backbone. It requires no class labels and no language supervision. Each image patch is assigned to exactly one concept from a learnable prototype dictionary, and only a sparse subset of concepts may activate per image. To capture how each concept varies across images (e.g., the type of a “wheel”), we learn continuous residuals alongside the concepts and then quantize them into discrete attributes. A spatial decoder reconstructs the backbone’s representation from the concepts and attributes alone, so successful reconstruction means that the discrete representation preserves the backbone’s information. We evaluate DisParQ across seven datasets, from general recognition (ImageNet, PartImageNet, Places) to fine-grained benchmarks (CUB, Cars, Dogs, Flowers). We show that DisParQ closely matches its frozen DINOv2 teacher on ImageNet linear probing (83.2% top-1), achieves higher concept consistency than language-aligned models, remains competitive on fine-grained recognition, and enables cross-category part-based retrieval.

[56] UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation cs.CV | cs.AIPDF

Deyuan Liu, Yihao Hu, Jingxuan Zhang, Xingying Li, Jun Xie

TL;DR: 构建 UltraText Bench，评测图像生成模型在多区域、长文本、中英文场景中的文字准确性、清晰度、布局和场景质量。

Details

Motivation: 短文本渲染进步后，生成模型还需要在复杂场景中持续呈现大量文字。现有评测难以同时覆盖长字符串、多区域布局和中英文，无法充分衡量密集文字生成能力。

Result: 基准含 432 条提示，覆盖 24 类真实场景和三个难度级别，中英文各半；每条经人工审阅的提示指定 4–12 个文字区域，并提供文本内容、位置及视觉属性结构化参考。Q-Judger VLM 对照完整参考评估文字保真度、清晰度、空间质量和场景质量，共测 24 个模型配置。不同维度呈现不同优劣：报告设置下 Z-Image-Turbo 比 Z-Image-Base 清晰度高 3.81 分，但保真度低 14.76 分；Qwen-Image-2512 的英文综合分从 L1 的 86.50 降至 L3 的 42.86。自动评分还由 10 名参与者的人评进行评估。

Insight: 密集文字生成不能用单一综合指标概括，文字准确性、清晰度、布局与场景质量之间存在权衡，难度升高也会显著降低表现。自动评估的人类验证规模为 10 人，解读分数时应考虑这一范围。

Abstract: Dense visual text requires image generators to reproduce long strings across multiple regions with correct placement and legibility. As short-string rendering improves, evaluation must test sustained performance across more demanding scenes. We introduce UltraText Bench, a bilingual benchmark for prompt-only generation of dense visual text. It contains 432 prompts spanning 24 real-world scene categories and three difficulty levels, split equally between English and Chinese. Each human-reviewed prompt supplies exact strings for four to twelve text regions, paired with structured references for their content, placement, and visual attributes. We use the Q-Judger vision-language model to assess each image against the complete reference, reporting text fidelity, text clarity, spatial quality, and scene quality. Across 24 model configurations, these dimensions reveal different strengths: Z-Image-Turbo gains 3.81 clarity points over Z-Image-Base while losing 14.76 fidelity points under the reported settings. Performance also varies with workload; Qwen-Image-2512’s English composite falls from 86.50 at L1 to 42.86 at L3. Ten participants took part in human evaluation of the automatic scores. Repository: https://github.com/LINs-lab/UltraText_Bench.

[57] MOTIF: Person-of-Interest Deepfake Detection Beyond 3DMM Coefficients cs.CVPDF

Giovanni Affatato, Sara Mandelli, Paolo Bestagini, Stefano Tubaro

TL;DR: 提出 MOTIF，针对特定人物视频深伪检测，系统拆解 3DMM 参数及稠密表面身份线索的作用，并仅用真实视频训练。

Details

Motivation: 针对特定人物（POI）的深伪危害更大；公开人物往往有大量真实视频可用于建立专属检测器。常见方法将 3D 可变形模型（3DMM）的全部系数作为特征，但哪些部分真正有效此前未被单独量化。

Result: 作者固定编码器、训练语料和登记协议，仅改变编码器观察的信息。实验发现不同系数组大多冗余，单独形状系数几乎恢复完整向量的检测精度，系数随时间变化提供额外但有限的帮助。3DMM 拟合还产生被既有检测器丢弃的稠密表面，其中含有系数未覆盖的身份信息，且能改善系数方法最弱的场景。整合后的 MOTIF 是纯视觉检测器，仅用真实视频训练，不需要伪造视频或 POI 专属数据；在其基准的每个数据集、每种操纵方式和两个质量级别上均优于两种 SOTA POI 检测器。

Insight: 身份线索不只存在于紧凑的 3DMM 系数中，拟合得到的稠密表面可补足弱项。摘要没有提供各子集具体检测分数，代码计划发布。

Abstract: Video deepfakes targeting a specific individual, the Person-of-Interest (POI), are the most harmful ones, and, since a public figure is abundantly recorded, a detector can be built from genuine footage of that individual. Such detectors commonly describe a subject through a 3D Morphable Model (3DMM) and adopt its coefficients as a whole, so which part of that description carries the signal has never been measured. We dissect it, holding the encoder, the training corpus and the enrollment protocol fixed and varying only what the encoder observes. The groups of coefficients prove largely redundant, since the shape block alone recovers almost all the accuracy of the full vector, and their temporal evolution contributes a real but bounded amount. We further show that the dense surface the same fit returns, which these detectors discard, carries identity information that the coefficients do not, and that it helps precisely where they are weakest. We assemble the best configuration into MOTIF, a visual-only detector trained on real videos only, with no manipulated video and no POI-specific data. It improves on both state-of-the-art POI detectors in every dataset and manipulation of our benchmark and at two quality levels. Our experimental code will be released at https://github.com/polimi-ispl/MOTIF.

[58] ORCA: Hunting Compositional Failures in Text-to-Image Diffusion cs.CV | cs.LGPDF

Arshia Hemmat, Amirhossein Vahidi, Amitis Shidani, Mohammad Vali Sanian, Hesam Asadollahzadeh

TL;DR: 提出 ORCA，在扩散训练中加入低秩跨模态组合对齐损失，针对属性绑定、空间关系和多对象提示改善文生图组合生成。

Details

Motivation: 文生图模型常把属性绑定到错误对象、颠倒空间关系或生成错误数量。已有模型加入 T5 以保留组合结构，但问题仍在；作者认为瓶颈是文本与视觉表示空间错位、去噪目标又没有直接鼓励二者对齐。

Result: ORCA 将扩散 Transformer 潜变量对齐到冻结视觉编码器导出的低秩目标；预测器的正交基由 T5 与 CLIP 嵌入间学习到的残差参数化，提供依赖提示的视觉子空间选择信号。论文证明给定秩能恢复的跨模态信息受视觉编码器协方差头部谱质量限制。在 DiT-B/2、DiT-L/2、U-ViT-L 三种骨干上，ORCA 无推理时开销地改善 FID 与 GenEval，优于原始模型和 REPA 基线。DiT-L/2 训练 200K 步达到 FID 16.65、GenEval 0.291，超过最强 400K 步基线且训练成本减半；提升主要集中在属性绑定、空间关系和多对象提示。

Insight: 论文将组合生成失败解释为跨模态信息未对齐，而非文本编码器缺少组合信息，并用低秩视觉子空间和提示相关映射构造辅助信号。所报告的减半训练成本对比针对 DiT-L/2 的最强基线。

Abstract: Text-to-image diffusion models fail predictably on compositional prompts: attributes bind to the wrong objects, spatial relations invert, and multi-object scenes lose count. Recent architectures already augment CLIP with a T5 encoder precisely because CLIP’s contrastive embedding loses compositional structure, yet these failures persist. We argue the binding problem is therefore not one of missing information but of misaligned information: a text encoder preserves compositional structure, but in a representation space shaped by language modelling rather than vision, and the denoising objective does not directly reward aligning the two. We show this correspondence can be supplied as an explicit training signal, that the relevant cross-modal information is concentrated in a low-rank subspace of self-supervised visual features, and that supplying it can be folded into diffusion training as a single auxiliary loss. Our method, ORCA (Orthogonal Residual Compositional Alignment), aligns the latent of a diffusion transformer with a low-rank target derived from a frozen visual encoder, through a predictor whose orthogonal basis is parameterised by a learned residual between T5 and CLIP embeddings, which provides a prompt-dependent signal for selecting the visual readout subspace. We prove that the cross-modal information recoverable at a given rank is bounded by the spectral mass of the visual encoder’s covariance in the top components. Across three diffusion-transformer backbones (DiT-B/2, DiT-L/2, U-ViT-L), ORCA improves FID and GenEval over both vanilla and REPA baselines at zero inference-time cost; on DiT-L/2 it reaches FID 16.65 and GenEval 0.291 at 200K steps, exceeding the strongest 400K baseline at half the training cost, with the largest gains concentrated on attribute binding, spatial relations, and multi-object prompts.

[59] Global Average Precision for Representation Learning cs.CV | cs.LGPDF

Bill Psomas, Mohammad Mahdi, Michalis Thomas, Danda Pani Paudel, Giorgos Tolias

TL;DR: 提出可微全局平均精度替代损失 gSAP，联合排序整个批次的查询—候选对，优化跨查询相似度可比性与单阈值检索表现。

Details

Motivation: mAP、InfoNCE 及逐查询 AP 代理通常逐查询比较正负样本，没有约束不同查询之间的相似度能否共用单一决策阈值；而全局阈值系统依赖跨查询分数可比。

Result: gSAP 是全局平均精度 gAP 的可微代理，只需相似度矩阵和正例二值矩阵，可替换现有损失且与编码器、模态及监督来源无关。它联合处理批次中所有成对比较，在低温度下仍可训练，而逐查询代理会失去梯度。将其加入既有方案后，监督度量学习、跨模态对齐和自监督预训练均有提升；作者称其是后两类任务中首个取代常用 InfoNCE 的排序损失。相同精度下，gSAP 检索到的正例对最多是最强 AP 代理的 4 倍；加入数据库中没有正例的查询时，它退化最少。模型还获得更好的迁移、kNN 和零样本分类表现。

Insight: 优化整个批次的全局排序使不同查询的相似度尺度更可比，从而改善统一阈值下的检索；收益不仅限于阈值选择，还反映为更好的表示质量。摘要没有列出各任务数据集或全部指标数值。

Abstract: Standard information retrieval metrics, such as mean Average Precision (mAP), assess performance one query at a time, based on how the similarities between a query and its positives compare against those with its negatives. The same holds for common representation learning losses, such as InfoNCE and per-query AP surrogates. None of them considers whether similarities are comparable across queries, which any system with a single decision threshold relies on. Global Average Precision (gAP) does, by ranking all query-candidate pairs in one list and computing a single AP. We introduce gSAP, a differentiable surrogate of gAP. It needs only a similarity matrix and a binary matrix marking the positive pairs, the same input as existing losses, so it is a drop-in replacement for them and agnostic to the encoder, the modality, and the source of supervision. Since it considers all possible pairwise comparisons in the batch jointly, it also remains trainable at low temperatures, a regime where per-query surrogates run out of gradient. Swapping it into established recipes improves supervised metric learning, cross-modal alignment, and self-supervised pretraining, where, to our knowledge, it is the first ranking loss to replace the community standard InfoNCE in the latter two. Its similarities are more consistent across queries, which drives the gains under a universal threshold. gSAP retrieves up to four times as many positive pairs as the strongest AP surrogate at the same precision, and it degrades the least when queries with no positives in the database are added. Beyond thresholding, models trained with gSAP also learn better representations, with higher transfer, $k$NN and zero-shot classification accuracy.

[60] Bringing BNNs to Fast Event Processing cs.CVPDF

Paul Longour, Julien Moreau, Franck Davoine

TL;DR: 提出 Polar-wise Binary Event Volume（PBEV），将事件相机数据转成二值表示以供二值神经网络直接处理，并评估 RGB 跨模态预训练对事件分类的帮助。

Details

Motivation: 二值神经网络用一位权重和激活降低模型体积与推理成本，事件相机则具备低延迟、高动态范围和低功耗；二者虽目标相近，但结合研究仍少。

Result: 论文将现代二值网络迁移到事件数据，并发现 RGB 数据上的跨模态预训练可提升神经形态数据集分类准确率。提出 PBEV 表示以使事件相机数据可由二值网络直接处理。在 N-Caltech101 分类基准上，所评估的最佳二值网络准确率为 90.58%，相较全精度对应模型操作量减少 7.5 倍。

Insight: PBEV 是构建完全二值化事件视觉系统的一步，同时表明利用 RGB 预训练知识可改善事件域二值模型表现。摘要未给出各模型的参数量、能耗和具体跨模态预训练提升幅度。

Abstract: Binary Neural Networks (BNNs) enable efficient deep learning deployment on resource constrained devices with weights and activations compressed to one bit, substantially reducing model size and inference cost. Event cameras offer complementary advantages, including low latency, high dynamic range, and low power consumption, by capturing asynchronous streams of events rather than dense image frames. Despite their shared emphasis on efficiency, the combination of these technologies remains largely unexplored. This work aims at adapting and evaluating modern deep BNN architectures on event data. We also show that cross-modal pretraining from RGB data can improve the classification accuracy of BNNs on neuromorphic datasets. We introduce the Polar-wise Binary Event Volume (PBEV), a binary representation that enables event-camera data to be processed directly by BNNs and represents a step toward fully binarized event-based vision systems. Best evaluated BNN on N-Caltech101 classification benchmarks shows 90.58% accuracy with 7.5x less operations than their full-precision counterparts.

[61] FedSSMCoOp: SSM Encoders for light-weight Federated Prompt Learning for Few-shot Classification cs.CVPDF

Ankita Das, Ambarish Parthasarathy, Sumohana S. Channappayya, C. Krishna Mohan

TL;DR: 提出 FedSSMCoOp，以 Vision Mamba 与 Cross Mamba 进行联邦少样本视觉语言提示学习，只通信软提示更新以兼顾隐私、轻量性和跨机构异质性。

Details

Motivation: 常见视觉语言分类用余弦相似度对齐图文，未能充分建模分类前的 token 结构和跨模态交互。生物医学联邦场景还受限于数据不能共享、各站点标签稀缺且分布差异大。

Result: FedSSMCoOp 使用基于状态空间模型的 Vision Mamba 和 Cross Mamba 模块，在联邦训练中仅优化软提示及通信提示更新，不需外部 LLM 做特征对齐。作者在多种生物医学图像数据集上训练评估，报告其相对基线表现稳定，平均模型轻量 1.96 倍；摘要未列出具体数据集、精度分数或通信量。

Insight: 该方法将跨模态交互建模与联邦通信约束结合，重点是用提示更新替代共享原始数据，并避免依赖额外 LLM。具体性能范围和统计显著性需由完整实验补充；代码计划发布。

Abstract: Vision-Language Models (VLMs) have shown strong performance across a wide range of downstream vision tasks, thanks to the complementary information contained in the respective domains. Despite the performance gains, most of these approaches rely on aligning these domains using the cosine similarity metric, which fails to capture token-level structure and cross-modal interactions prior to the classification stage. This is especially critical in biomedical applications under federated constraints, where data sharing is restricted, labeled data is scarce at each site, and it differs widely across institutions, leading to substantial statistical heterogeneity. To overcome this issue, we propose FedSSMCoOp, a federated few-shot image classification framework that enables multimodal learning while preserving data privacy. With the help of the SSM-based Vision Mamba and Cross Mamba blocks, and by optimizing only the soft-prompt and communication-prompt updates in the federated setting, the framework prioritizes both computation and performance. Importantly, this eliminates the need to use an external Large Language Model (LLM) for feature alignment. The framework is further trained and evaluated on various biomedical image datasets, and its performance is assessed. The proposed framework delivers stable performance relative to the baselines and is, on average, 1.96 times lighter. The corresponding script will be made available soon.

[62] Purifying Backdoored Large Vision-Language Models by Removing Hijacked Directions cs.CVPDF

Bojun Yang, Haochen Zhou, Zhifang Zhang, Haobo Wang, Songze Li

TL;DR: 提出 OrthoPurify，通过伪良性参考模型估计后门劫持的权重更新方向，并以一次正交投影清除视觉语言模型后门。

Details

Motivation: 大型视觉语言模型有后门风险，既有防御常需大量干净数据重训或在每次推理时干预，代价较高。作者假设后门通过少数权重更新方向从正常任务适配中“劫持”而形成捷径。

Result: OrthoPurify 对后门权重更新作结构分析，发现少量方向可编码后门捷径。防御者通常拿不到良性参考模型，因此作者仅用少量干净样本微调预训练权重得到伪良性模型；主导更新方向在最初几步已稳定，可据此识别被劫持方向，并对权重更新做一次投影移除。多项基准实验显示，攻击成功率降至接近零，同时保持原有性能；无需重训后门模型，也无推理开销。摘要未报告具体数据集、干净样本数或防御前后逐项指标。

Insight: 一次权重空间投影提供离线、低开销净化路径，关键前提是少量干净样本足以估计正常适配方向。该前提和跨攻击泛化程度应结合论文完整实验核查。

Abstract: Large vision-language models (LVLMs) are increasingly deployed in safety-critical applications, yet they remain vulnerable to backdoor attacks. Defending against such attacks remains costly, as existing methods require either extensive retraining on clean data or per-query intervention at inference time. To address this limitation, we propose OrthoPurify, a more efficient method to purify backdoored model weights via one-step orthogonal projection. Specifically, through structural analysis of backdoor weight updates, we find that the backdoor is encoded by diverting a small number of weight update directions from task adaptation to backdoor shortcut encoding, a phenomenon we term direction hijacking. However, identifying these hijacked directions requires a benign reference model, which is typically inaccessible to the defender. We show that a pseudo-benign model, obtained by fine-tuning the pretrained weights on only a small set of clean samples, provides a sufficient approximation, as the dominant update directions stabilize within the first few gradient steps. OrthoPurify uses this pseudo-benign reference to isolate the hijacked directions and removes them through a single projection on the weight update. Extensive experiments show that OrthoPurify reduces the attack success rate to near zero while preserving the original performance across diverse benchmarks, without retraining the backdoored model or introducing inference-time overhead. Our code is publicly available at https://github.com/womeimingzi/OrthoPurify.

[63] Do Generative Priors Align with Human Naturalness Perception? cs.CV | q-bio.NCPDF

Taiki Fukiage

TL;DR: 通过 25 个图像和视频生成模型的原生预测误差，研究生成模型的自然图像先验是否体现人类对图像自然度的敏感性。

Details

Motivation: 生成模型拟合自然图像分布，但模型自身的视觉先验是否反映人类判断自然度的规律仍不明确；单张图像的原始损失会受场景内容和视觉复杂度影响，难以隔离目标规律。

Result: 作者采用内容保持的成对关系干预，分别改变人脸配置或光照物理一致性，同时尽量保持低层图像统计，并分析方向性损失差。两类数据上，模型损失差复现了类似人类的选择性敏感度与容忍度，包括人脸 Thatcher 效应和依赖形状的光照不一致反应。损失差可追踪单对刺激的人类自然度连续判断，在人脸上的相关峰值 r=.84、物理场景上 r=.64；控制冻结视觉编码器特征距离及标准图像质量指标后，仍保留独特的人类对齐信号。不同模型的总体违规敏感度与人类对齐大体协变，但去噪进程中二者系统性分离：对齐峰值早于敏感度。

Insight: 生成损失景观捕捉到人类自然度感知的不同方面，但类人自然度判断不等于对任何视觉违规都更敏感。成对干预旨在控制内容混杂，结论覆盖摘要所述面部与物理光照操纵。

Abstract: Visual generative models are trained to capture the probability distributions of natural images, yet whether their native priors reflect the regularities governing human perception of image naturalness remains an open question. Here, we probe these priors through native prediction errors across 25 open image and video generators. Because raw single-image losses are dominated by scene content and visual complexity, we evaluate directional loss differences using content-preserving, paired relational interventions that selectively disrupt facial configurations or physical illumination consistency while limiting changes in low-level image statistics. Across both domains, these loss differences reproduce human-like selective sensitivities and tolerances, capturing the classic Thatcher effect on faces and shape-dependent responses to illumination inconsistencies. Notably, these loss differences reliably track continuous gradations of human naturalness judgments across individual stimulus pairs (peaking at $r = .84$ on faces and $.64$ on physical scenes) and retain unique human-aligned signals even after controlling for feature distances from frozen vision encoders and standard image quality metrics. We also find that while overall sensitivity to these violations broadly covaries with human alignment across models, the two systematically decouple along denoising schedules, with alignment peaking earlier than sensitivity, revealing that human-like naturalness judgments dissociate from generic violation detection. Together, these findings demonstrate that learning visual distributions yields generative loss landscapes that capture distinct aspects of human naturalness perception.

[64] MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection cs.CVPDF

Artem Filippov, Aleksandr Gushchin, Kirill Koltsov, Dmitriy Vatolin, Anastasia Antsiferova

TL;DR: 介绍 MSU 团队在 2026 可解释深伪检测挑战赛的系统，将多骨干图像检测、伪造痕迹证据定位和条件化自然语言解释组合起来。

Details

Motivation: 生成图像日趋逼真，检测系统不仅需要判断真假，还应依据可见取证线索解释判定。挑战要求在 XPlainVerse 上同时输出真伪分类及复杂、简明两种解释。

Result: 检测模块融合多个 DINOv3 骨干和 Mesorch 操纵定位特征，结合预训练视觉表示、DCT 线索与多尺度取证信息。解释中的局部痕迹描述经 Grounding-DINO 伪掩码转为弱 patch 监督，形成 Artifact Evidence Map；另以局部 patch 级对比目标分离痕迹证据与真实性证据，无需成对图像或像素级伪造掩码。语言模块由类别条件 Qwen3-VL 生成真假解释，再用 GRPO 优化的模型简化文本。在 XPlainVerse 挑战子集训练和评估，完整测试集提交得检测准确率 0.9349、解释分 0.5571、最终挑战分 0.7456。

Insight: 系统把解释证据以弱定位和局部对比监督接入检测特征，同时将复杂解释生成与文本简化分开处理。摘要只报告挑战总体分数，未提供各模块消融或不同伪造类型的表现。

Abstract: Recent advances in generative image models have made many manipulated images highly realistic, raising the need for detectors that are not only accurate but also able to provide visual evidence for their decisions. In this paper, we present our solution to the Explainable Deepfake Detection Challenge [2] on the XPlainVerse dataset [1], where systems are required to predict whether an image is real or fake and generate both complex and simple explanations grounded in visible forensic cues. Our method follows a modular detection-and-explanation design. For the real/fake decision, we build a multi-backbone detector that combines several DINOv3 models with Mesorch manipulation-localization features, bringing together pretrained visual representations, DCT-aware cues, and multi-scale forensic information. To inject explanation evidence into the detector, we use a Grounding-DINO-based pseudo-mask generation pipeline that converts local artifact descriptions from training explanations into weak patch- level supervision for an Artifact Evidence Map. We further introduce a local patch-level contrastive objective that separates artifact and authenticity evidence in the detector feature space without requiring paired images or pixel-level manipulation masks. For language output, we use class-conditional Qwen3-VL models to generate complex explanations for fake and real predictions, followed by a GRPO-optimized text simplification model. The proposed methods were trained and evaluated on the challenge subset of XPlainVerse. On the full test split, our submission achieves 0.9349 detection accuracy, 0.5571 explanation score, and a 0.7456 final challenge score.

[65] From Pixel to Coding: Evaluating the Figure Reproduction Capabilities of MLLMs cs.CV | cs.AIPDF

Zijian Chen, Zhengyu Chen, Bohan Liang, Lirong Deng, Yushuo Zheng

TL;DR: 提出 FigCodeBench，评测多模态大模型从复杂图形理解到可执行代码复现的联合能力，包含 6,194 个实例及多层次难度和多维指标。

Details

Motivation: 现有基准通常把视觉理解与代码生成分开评测，现有视觉代码生成评估又常局限于单一编程环境和简单布局，无法测量复杂图形到精确可执行代码的联合多模态推理。

Result: FigCodeBench 的构建流程产生 6,194 个实例，覆盖 7 种功能类别和 4 类编程语言；难度分为三个层次，建模视觉与代码复杂度、复杂结构推理、长宽比变化和密集几何约束。评估同时衡量视觉保真度与语法同构性，并报告其与 MMOS 及人类偏好高度一致。对 24 个常用闭源和开源 MLLM 的实验显示，不同编程语言与难度下普遍出现非线性性能断崖；声明式、约束更严格的语言上指标下降明显。

Insight: 复现能力必须联合检查生成图像是否匹配和代码结构是否对应，单看视觉相似或能否运行都不完整。摘要称观察到跨模型的普遍非线性性能断崖，但未给出具体数值、模型逐项排行或每种语言的下跌幅度。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in both visual understanding and code generation. However, existing benchmarks typically evaluate these two modalities in isolation, lacking a dedicated assessment of their unification, i.e., how a model can perceive complex visual structures and synthesize them into precise, executable code. Moreover, current visual code generation benchmarks often rely on simplified layouts within single programming environments, falling short of evaluating true unified multimodal reasoning. To bridge this gap, we propose FigCodeBench, a comprehensive framework for rigorously evaluating MLLMs on figure reproduction, integrating multimodal comprehension and generation. We first design a systematic dataset construction pipeline, resulting in a total of 6,194 instances that cover 7 functional categories and 4 types of programming languages. We further categorize figure reproduction into three tiers with visual and code complexity modeling, specifically targeting complex structural reasoning, varying aspect ratios, and dense geometric constraints. We introduce a multi-dimensional evaluation protocol, encompassing visual fidelity and syntactic isomorphism, that aligns highly with the Mean Machine Opinion Score (MMOS) and human preferences. Based on our framework, we conducted extensive experiments on 24 widely used proprietary and open-source MLLMs (e.g., Gemini 3.1 Pro, GPT-5.4, and Kimi-K2.5), where we observed a universal, non-linear performance cliff across different programming languages and difficulty scenarios for all models, and gained several insights, such as the significant metric decline in rigid declarative languages.

[66] AdSpark: A Large-Scale Dataset and Benchmark for Product-Centric Advertisement Video Generation cs.CVPDF

Zhifei Yang, Zhao Jiang, Keyang Lu, Honghe Zhu, Zheng Zhang

TL;DR: 提出 AdSpark-300K 广告视频生成数据集和 AdSpark-Bench，从产品保真、多镜头叙事、卖点表达、音频对齐等维度评估产品中心广告生成。

Details

Motivation: 产品广告生成需维持细粒度产品身份，同时把卖点编排成连贯的多镜头故事；该任务研究不足，缺少大规模广告专用数据和全面评估框架。

Result: AdSpark 基于大型电商平台数据，约含 30 万组参考图像—提示—视频三元组，包括真实与合成子集。每例提供产品身份、卖点、创意方案及对齐音频脚本等结构化标注。AdSpark-Bench 从视觉质量、产品保真、指令遵循、时间连贯性、音频对齐和广告效果六方面诊断评估生成结果。对代表性模型的评估揭示产品保持、多镜头故事和卖点可视化等挑战；用 AdSpark-300K 微调的模型实验也验证数据集有效性。摘要未给出各模型基准分数；数据计划在论文接收后发布。

Insight: 数据同时提供产品身份、创意计划和音频脚本标注，面向的是广告成片质量而非一般视频逼真度。基准六个维度覆盖生成与营销表达，但摘要没有给出广告效果指标的具体定义或分数。

Abstract: Product-centric advertisement video generation aims to create promotional videos that preserve fine-grained product identity while presenting selling points through coherent multi-shot narratives. However, this emerging task remains underexplored due to the lack of large-scale advertisement-specific datasets and comprehensive evaluation frameworks. To address this gap, we introduce \textbf{AdSpark}, a large-scale dataset and benchmark for product-centric advertisement video generation, based on data from a major e-commerce platform. \textit{AdSpark-300K} contains approximately 300K reference image–prompt–video triplets, comprising a real-world subset and a synthetic subset. Each sample provides structured advertisement annotations, including product identity annotations, selling-point descriptions, creative plans, and aligned audio scripts, enabling models to learn product preservation and advertisement-oriented visual storytelling. We further propose \textit{AdSpark-Bench}, a diagnostic benchmark that evaluates generated advertisements across six dimensions, including visual quality, product fidelity, instruction adherence, temporal coherence, audio alignment, and advertisement effectiveness. Based on AdSpark-Bench, we evaluate representative models, revealing key challenges in product preservation, multi-shot storytelling, and selling-point visualization. Experiments with AdSpark-300K-finetuned models further validate the effectiveness of our dataset. AdSpark provides a unified dataset and benchmark for future research, and we will release the dataset upon acceptance.

[67] HeiCo-FOCUS: A Clinically Grounded Dataset for Long-Context Video Understanding cs.CVPDF

Leon Mayer, Lucas Luttner, Patrick Godau, Kai Fritzsche, Annika Reinke

TL;DR: 提出 HeiCo-FOCUS 临床长上下文视频理解数据集，以长达数小时的结直肠手术中异物持续跟踪评测时间一致性，并发现当前 VLM 对时间定位仍很弱。

Details

Motivation: 现有视频基准多侧重短时推理，缺少对长时程中持续累计时间信息能力的评测。手术视频中器械等物体会插入、操作、遮挡和移除，要求模型跨数小时跟踪上下文。

Result: 基准基于海德堡结直肠手术数据，含 30,000 对 VQA，覆盖物体识别、时间定位、聚合、事件与流程理解、复杂推理五项能力。多阶段标注结合大规模众包与 39 位手术领域专家。多轨评测逐步从单帧扩展到完整手术过程。对 10 个前沿 VLM 的实验发现，约只有一半模型明确超过纯文本基线；所有模型在视频轨道的事件/流程理解平均准确率最高，为 56.5%，时间定位最困难，平均准确率仅 19.7%。

Insight: 长视频理解的核心短板包括跨时间累积与定位，而不是单纯识别视频主题；同一模型在流程概括上好于精确时间定位。临床专家参与提高了任务相关性，但摘要未提供各模型逐项结果或患者结局关联。

Abstract: Recent advances in Vision-Language Models (VLMs) have led to rapid progress in video understanding across a wide range of benchmark tasks. However, existing evaluations largely focus on short-term reasoning, failing to assess a critical capability: maintaining cumulative temporal consistency over extended time horizons. To close this evaluation gap, we introduce HeiCo-FOCUS, a clinically grounded dataset for evaluating long-context video understanding through the task of Foreign Object Contextual Understanding in Surgery. Built on a dataset of Heidelberg Colorectal surgeries, this task requires models to continuously track multiple objects as they are inserted, manipulated, occluded, and removed over procedures lasting up to hours. HeiCo-FOCUS comprises 30,000 visual question answering (VQA) pairs covering five core capabilities: object recognition, temporal grounding, aggregation, event and procedural understanding, and complex reasoning. The dataset was constructed through a rigorous multi-stage annotation pipeline involving large-scale crowd annotation and 39 surgical domain experts to ensure high quality and clinical relevance. To systematically probe model behavior, we introduce a multi-track evaluation framework that progressively increases temporal and contextual demands from single frames to full procedures. Experiments with ten frontier VLMs show that HeiCo-FOCUS tasks are far from solved: only around half of the models clearly outperform a text-only baseline. Across the video tracks, models perform best on event and procedural understanding (mean Accuracy: 56.5% across all models), while temporal grounding remains particularly challenging for all evaluated models (mean Accuracy: 19.7%). We therefore expect HeiCo-FOCUS to serve as a catalyst for the development of models capable of reliable, temporally consistent reasoning over hours-long videos.

[68] Beyond Anonymous Captions: Grounding Character Identity in Video Captioning and Question Answering cs.CVPDF

Anas Filali Razzouki, Killian Steunou, Khalil Guetari, Thomas Kling, Mounîm El-Yacoubi

TL;DR: 提出身份感知视频字幕与人物中心问答方法 BAC，将人物身份、空间框和字幕结合，并用约 32K 条数据进行 LoRA 适配。

Details

Motivation: 理解视频叙事需要把人物外貌、位置和动作对应到具体角色身份；仅生成匿名描述无法回答人物中心问题，也容易将已知身份错误分配给未定位人物。

Result: 方法从 LSMDC v2 电影片段出发，把检测到的人脸匹配演员参考图、跨帧跟踪人物，并构建包含身份关联框的输入。强 VLM 生成身份字幕和问题，经人工审核过滤，形成 750 个带字幕片段与 3,000 个人物中心问题。评测五种结合文本坐标、视觉人脸框或估计人物框的 grounding 策略，覆盖约 2B/4B/8B 视频 MLLM 和大型模型；视觉人脸框加文本坐标跨尺度最稳定，显著优于仅坐标。较小模型在人物未被定位时易过度分配已知身份，大模型更善于判为未识别。基于约 32K 条身份字幕对 Qwen 2B/4B/8B 做 LoRA 得到 BAC，各规模均优于同规模其他模型系列；BAC-8B QA 准确率 93.20%，在所测前沿模型中仅次于 GPT-5.6 Sol。

Insight: 明确告诉模型“谁在哪里”的视觉定位和轻量任务适配能提升身份推理，无需改变架构。小模型过度认人是仍需关注的错误类型；成绩仅针对作者的基准和比较模型。

Abstract: Linking people’s appearance and actions to character identities is essential for understanding video narratives. We present a framework for identity-aware video captioning and person-centric question answering that combines automatic character identification, explicit spatial grounding, and task-specific adaptation. Starting from LSMDC v2 movie clips, our pipeline matches detected faces to actor reference images, tracks characters across frames, and builds inputs with identity-linked bounding boxes. A strong vision-language model generates identity-aware captions and questions, which are manually verified and filtered to create a benchmark of 750 captioned clips and 3,000 person-centric questions. We study five grounding strategies combining textual coordinates with visual face or estimated person boxes across Video-MLLM families at roughly 2B, 4B, and 8B parameters and larger frontier models. Combining visual face boxes with textual coordinates yields the most consistent performance across scales and significantly improves overall performance over coordinates alone. Smaller models tend to over-assign known identities when the queried person is not grounded, while larger models better recognize such UNIDENTIFIED cases. We introduce BAC by LoRA fine-tuning Qwen models at 2B, 4B, and 8B scales on about 32K identity-aware captioned clips. Across all scales, BAC outperforms every other evaluated model family of comparable size. BAC-8B reaches 93.20% overall QA accuracy, ranking behind only GPT-5.6 Sol among the frontier models evaluated in our study. Overall, explicitly communicating who is where, together with lightweight task-specific adaptation, substantially improves identity-aware video understanding without changing the underlying architecture. We release the benchmark, training data, code, and BAC checkpoints at https://github.com/momentslab/beyond-anonymous-captions.

[69] HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration cs.CVPDF

Xiangtao Kong, Shuaizheng Liu, Rongyuan Wu, Lingchen Sun, Zhengqiang Zhang

TL;DR: 提出 HarnessIR，把多模态基础模型作为真实图像修复执行器，按诊断、工具调用、提示组合、执行和验证迭代处理混合退化。

Details

Motivation: 真实低质图像常含噪声、模糊、大气影响等混合退化，逐个调用单退化修复模型的工具链难以干净地分解这些问题，且系统能力受工具集限制。

Result: HarnessIR 分为感知诊断、按需工具调用、提示组合、执行和验证驱动的细化五阶段。与依赖专用模型串联的代理方法不同，它将修复需求、诊断和证据输入多模态基础模型，一次执行修复，再通过验证判断是否需进一步处理。作者称现成 MFM 在常用 MiO100 合成基准上取得 SOTA；在困难真实场景也达到有竞争力的修复质量，而既有代理系统往往表现不佳。摘要未列出具体分数、调用次数或真实场景用户评估数据。

Insight: 该框架让通用多模态模型直接承担修复，再通过验证环控制是否追加处理，减少单退化工具链带来的能力上限。合成基准的 SOTA 与真实场景的定性效果是两类证据，摘要没有给出后者量化结果。

Abstract: Real-world low-quality images suffer from complex mixed degradations, including but not limited to noise, blur, atmospheric effects, etc. Recent agentic methods usually model real-world image restoration (Real-IR) as a sequential tool calling problem over task-specific single-degradation restoration models. This paradigm, however, is fundamentally limited because complex real-world degradations cannot be cleanly undone degradation by degradation, and the tool used for task-specific models caps the capability of the agent system. In this work, we present HarnessIR, an agentic framework for Real-IR by harnessing a multimodal foundation model (MFM) as the executor. HarnessIR consists of five stages: perception and diagnosis, on-demand tool invocation, prompt composition, execution, and verification-driven refinement. Unlike prior agentic Real-IR methods that rely on tool chains assembled from task-specific models, HarnessIR feeds the restoration requirements, the perceptual diagnosis, and the evidence into an MFM that performs restoration in a single pass, followed by verification stages to determine whether the result warrants further processing. Under our harness, off-the-shelf MFMs handle restoration tasks remarkably well, achieving state-of-the-art results on the widely used MiO100 synthetic benchmark. More importantly, by exploiting the strong generalization ability of MFMs, HarnessIR delivers compelling restoration quality on challenging real-world scenes where previous agentic IR systems often struggle. Codes is available at https://github.com/PolyU-VCLab/HarnessIR.

[70] VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding cs.CV | cs.AIPDF

Yongchao Xu, Bowen Ye, Jiefeng Gan, Junkai Ma, Wenzhao Li

TL;DR: 提出 VideoEvolve，在长视频理解中用交替智能体强化学习共同优化记忆构建和问题检索，并按瓶颈与能力反馈引导更新。

Details

Motivation: 长视频方法常用外部记忆压缩海量帧，但多数只针对不同问题自适应检索，基本固定记住哪些内容；遗漏细节难以补回，而存下的信息只有能稳定检索时才有价值。

Result: VideoEvolve 从低帧率粗略概览出发，配备选择性补充记忆的 Memory Evolver 和在不断演化记忆上自适应检索的 Retrieval Evolver。二者通过交替智能体 RL 联合进化，每轮更新一个并冻结另一个。瓶颈感知进化反馈 BEF 判断限制来自记忆还是检索，并把优化导向较弱环节；能力感知进化反馈 CEF 则减少记忆对固定训练问题过拟合，将训练转向尚弱但可学习的视频能力。作者报告在多个长视频理解基准上实验有效，但摘要未给出基准名称、指标数值或增益幅度。

Insight: 长视频系统的记忆写入与读取需要协同进化，单独增强检索无法恢复从未保留的信息。BEF 处理系统瓶颈，CEF 处理能力覆盖与训练问题过拟合；量化效果仍需查看完整实验。

Abstract: Long video understanding increasingly relies on external memory to organize massive visual streams into compact representations. However, most memory-based methods dynamically adapt how information is retrieved for different questions, while largely fixing what is remembered. This mismatch makes missing details costly to recover, whereas stored information is valuable only when it can be reliably retrieved. To address this issue, we propose VideoEvolve, a novel self-evolving framework that jointly evolves memory and retrieval for long video understanding. Specifically, starting from a coarse low-frame-rate overview, VideoEvolve couples a Memory Evolver for selective memory augmentation with a Retrieval Evolver for adaptive retrieval over the evolving memory. We then co-evolve the two Evolvers through alternating agentic reinforcement learning (Agentic RL), updating one while freezing the other. To steer this alternating evolution, Bottleneck-Aware Evolution Feedback (BEF) identifies whether the current bottleneck lies in memory or retrieval and directs optimization toward the more limiting side. Furthermore, VideoEvolve introduces Capability-Aware Evolution Feedback (CEF) to alleviate downstream feedback from over-specializing memory to a fixed set of training questions, shifting training toward underdeveloped yet learnable video capabilities. By integrating Agentic RL with BEF and CEF, VideoEvolve transforms downstream reasoning experience into transferable capability updates, providing a concrete path from static long-video systems toward experience-driven, self-improving multimodal intelligence. Extensive experiments on multiple long video understanding benchmarks demonstrate the effectiveness of VideoEvolve.

[71] $Δ$Representation: Geometry Supervised Representation Learning of Phenotypes via Counterfactual Reasoning for Medical VLMs cs.CVPDF

Hao Wang, Qiwei Zeng, Jinghao Lin, Shuchang Ye, Yuezhe Yang

TL;DR: 提出 ΔRepresentation，通过正常解剖表示与病灶表示的反事实差分来学习表型增量，并以几何监督组织医学 VLM 表征。

Details

Motivation: 病理表型是叠加在正常解剖基础上的病灶特异变化。以语义对齐改善表型表示的既有方法未显式建模病灶相对对应正常解剖的增量，难以分离背景结构与病理变化。

Result: 框架由 BaseAnatomy 和 ΔPhenotype 组成。BaseAnatomy 利用解剖结构内部与彼此之间的空间关系提供细粒度几何监督；ΔPhenotype 计算病灶表示与相应正常解剖表示的增量，并监督同类表型增量在表示空间聚集。在 ReXGroundingCT 和 LIDC-IDRI 上，作者报告该方法能有效组织病理表型表示，并提升医学 VLM 的病灶定位与表型描述准确率；摘要未提供量化增益。

Insight: 反事实差分有助于把病理变化从正常解剖背景中剥离出来，几何结构则提供关系先验。验证仅报告两个数据集和定位/表型任务，摘要未提供临床读片评估。

Abstract: Medical vision-language models (VLMs) have shown increasing potential for radiological image interpretation. Medical VLMs encode radiological images into visual representations that capture both anatomical and phenotypic information for diagnosis. Existing approaches improve pathological phenotype representations through semantic-guided representation alignment. However, pathological phenotypes arise as lesion-specific visual changes superimposed on underlying normal anatomy. Such semantic alignment approaches fail to model the phenotype-specific increment relative to the corresponding normal anatomical representation. To address this gap, we propose \textbf{$Δ$Representation}, a visual phenotype representation learning framework based on counterfactual reasoning for medical VLMs. It comprises \textbf{BaseAnatomy}, a geometry-supervised representation learning module, and \textbf{$Δ$Phenotype}, a counterfactual incremental representation learning module. BaseAnatomy provides fine-grained geometric supervision through spatial relationships across and within anatomical structures. $Δ$Phenotype computes the representation increment between lesion representations and their corresponding normal anatomical representations, and supervises increments associated with the same phenotype to cluster in the representation space. Experiments on \textit{ReXGroundingCT} and \textit{LIDC-IDRI} demonstrate that $Δ$Representation effectively structures pathological phenotype representations and improves lesion grounding and phenotype characterization accuracy in medical VLMs. Code is available at https://anonymous.4open.science/r/deltarep-CF6D.

[72] TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learning cs.CVPDF

Dayou Li, Hao Wang, Qianqian Yang, Zihao Zhu, Haoquan Fang

TL;DR: 发布 TouchScale，包含约 500 小时、统一可穿戴设备采集的人类视觉—触觉交互数据，并验证其规模化预训练可提升触觉感知与机器人操作。

Details

Motivation: 第一人称视频提供具身学习所需的日常交互，但缺少接触与压力信息；现有同步触觉数据远少于人类视频，且常混合不同传感器和标注流程，难以单独评估数据规模的作用。

Result: TouchScale 以单一可穿戴配置记录约 500 小时接触丰富的人类交互，约 2,000 条预定义任务描述覆盖日常活动与结构化操作，每条记录同步第一人称 RGB-D、腕部 RGB 视频和密集双手触觉测量。训练全量数据后，在未见触觉传感器数据上的零样本接触 IoU 从 0.134 提至 0.383；视觉编码器预训练在三个基准上取得比较数据集中最高动作识别准确率；用于机器人视觉—触觉中期训练后，四项真实接触操作平均成功率由 22.5% 提至 57.5%。固定传感器与采集协议时，零样本触觉预测和机器人成功率随数据量总体上升。

Insight: 统一传感器和采集流程使数据规模效应更容易归因，且数据同时支持感知预训练和策略训练。报告的机器人收益覆盖四项接触任务，数据集将公开同步记录和重建物体模型。

Abstract: Large-scale egocentric human interaction data is becoming an important source of physical supervision for embodied learning, yet video alone leaves the contact and pressure that characterize physical interaction unrecorded. Recent visual-tactile datasets provide this missing supervision, but their synchronized tactile data remain far smaller in volume than human video. Moreover, the largest resources often merge recordings from different sensors or annotation procedures, which makes the effect of data scale difficult to isolate. We therefore introduce TouchScale, a 500-hour dataset of contact-rich human interaction recorded with a single unified wearable setup. Its approximately 2K predefined task descriptions span everyday activities and structured manipulation, and each recording temporally aligns egocentric RGB-D video with wrist RGB video and dense full-hand bimanual tactile measurements. Compared with prior tactile data, training on the full TouchScale raises zero-shot contact IoU on data from an unseen tactile sensor from 0.134 to 0.383. Pretraining a visual encoder on TouchScale also yields the highest action recognition accuracy on three benchmarks among the compared visual-tactile datasets. Used for visual-tactile mid-training of a robot policy, TouchScale improves the average real-world success rate across four contact-rich manipulation tasks from 22.5% to 57.5%. With the sensor and collection protocol held fixed, both zero-shot tactile prediction and robot success show an overall upward trend as more TouchScale data is used. These results suggest that human visual-tactile data collected at scale with consistent sensing benefits both perception and robot manipulation. We will publicly release TouchScale, including all synchronized visual-tactile recordings and reconstructed object models, to support future research on scalable visual-tactile learning.

[73] Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs cs.CVPDF

Hao Wang, Qiwei Zeng, Shuchang Ye, Jinghao Lin, Yuezhe Yang

TL;DR: 提出 PureVision，用几何监督编码解剖层级与病灶表型关系，再按解剖线索聚合证据，改善医学 VLM 的多表型病灶 grounding 与表征。

Details

Motivation: 多表型病灶诊断需联合评估多个病理表型。语义驱动的图文对齐缺少保持解剖层级和表型子类关系的几何约束，且病灶相关解剖与表型表示稀疏，导致诊断证据提取不足。

Result: PureVision 含几何监督表示模块 PureEyes 和解剖引导证据聚合模块 PureNeurons。PureEyes 使用编码解剖层级与表型子类关系的理想空间分布提供几何监督；PureNeurons 将视觉表示投到学习出的潜在空间，并根据位置选择性聚合病灶相关解剖和表型证据。在 LIDC-IDRI、CBIS-DDSM 和 3DReasonKnee 上，作者报告其提升视觉问答和放射报告生成中的病灶定位与表型描述能力，但摘要未列数值。

Insight: 工作把医学表型之间的几何结构作为视觉表示学习信号，并将该空间结构进一步用于定位和证据聚合。效果报告覆盖三个数据集与两类生成/问答任务，摘要未说明临床验证或具体改善幅度。

Abstract: Medical vision-language models (VLMs) have shown increasing potential for clinical image interpretation. However, these models still struggle to interpret multi-phenotype lesions whose diagnosis requires the joint assessment of multiple pathological phenotypes. Existing vision-language alignment methods produce visual representations that fail to preserve anatomical hierarchies and relationships among phenotypic subclasses. This stems from their reliance on semantic supervision, which lacks geometric constraints to preserve these relationships in the visual embedding space. Moreover, the sparsity of lesion-related anatomical and phenotypic representations makes it difficult for medical VLMs to capture important diagnostic evidence. To address these limitations, we propose \textbf{PureVision}, a geometry-supervised visual representation learning framework for multi-phenotype lesion interpretation in medical VLMs. It combines a geometry-supervised representation learning module, \textbf{PureEyes}, and an anatomy-guided evidence aggregation module, \textbf{PureNeurons}. PureEyes provides geometric supervision through ideal spatial distributions that encode anatomical hierarchies and phenotypic subclass relationships. PureNeurons projects visual representations into the learned latent space, using their positions to selectively aggregate lesion-specific anatomical and phenotypic evidence. Experiments on \textit{LIDC-IDRI}, \textit{CBIS-DDSM}, and \textit{3DReasonKnee} demonstrate that PureVision improves lesion grounding and phenotype characterization in visual question answering and radiology report generation. Code is available at: https://anonymous.4open.science/r/purevision-06C2.

[74] Video Prediction Policy 2: Predict Better, Act Better cs.CV | cs.ROPDF

Yanjiang Guo, Haodong Yan, Zhide Zhong, Zhongru Zhang, Qingyuan Yang

TL;DR: 提出 VPP2，把操作视频预训练、固定预测时域的单步视觉规划器与 MoT 动作模块结合，提升开放环境视频预测及机器人操作的零样本泛化。

Details

Motivation: 世界动作模型希望将视频预测先验迁移到通用机器人策略，但现有模型在开放环境中常预测错误运动，导致动作失误；问题来自基础视频模型未针对操作优化，以及直接注入动作组件可能损害视频模型泛化。

Result: VPP2 先用多样化大规模操作视频继续预训练基础视频模型，配合细粒度字幕及事件级预训练，再将视频模型后训练和蒸馏为固定预测时域的单步视觉规划器，最后用 Mixture-of-Transformers 动作模块学习隐式逆动力学。VPP2-14B 在开放任务的视频预测指令遵循成功率上比 Cosmos3-64B 高 11.0 个百分点；真实零样本 ALOHA 操作成功率比最强基线高 18.5 个百分点。经各基准专用后训练后，VPP2 在 LIBERO-Pro、LIBERO-OOD、RoboDojo 的所测方法中成功率最高。

Insight: 设计将视频预测基础能力与动作生成模块拆开适配，借助事件级操作视频数据减轻“视频模型不懂操作”问题。基准专用后训练结果与零样本 ALOHA 结果应区分解读，后者才直接支持零样本操作表现。

Abstract: World action models (WAMs) have emerged as an important class of generalist robot policies, aiming to transfer video prediction priors to action learning. However, we find that existing WAMs frequently produce incorrect motion predictions in open-ended environment, leading to erroneous actions. We attribute this limitation to two factors: (1) base video models are not optimized for manipulation, and (2) naively incorporating action components into video models can substantially degrade their generalization capabilities. We introduce Video Prediction Policy 2 (VPP2), a WAM that enables strong zero-shot generalization in both video prediction and action generation. First, we curate a large-scale, diverse dataset of manipulation videos to continue pretraining the base video foundation model. We annotate video clips with detailed captions and perform \textit{event-level} video pretraining to promote generalization across open-ended manipulation tasks. Second, we post-train and distill the video model into a single-step visual planner with fixed prediction horizon. Finally, we introduce action module via a mixture-of-transformers (MoT) architecture to learn implicit inverse dynamics model. Experiments demonstrate three key results: (1) VPP2-14B outperforms Cosmos3-64B by 11.0% points in video prediction instruction-following success rate on open-ended tasks; (2) VPP2 surpasses the strongest baseline by 18.5% points in success rate on real-world zero-shot ALOHA manipulation tasks; and (3) following benchmark-specific post-training, VPP2 achieves the highest success rates among evaluated methods on the challenging LIBERO-Pro, LIBERO-OOD, and RoboDojo benchmarks.

[75] On the Necessity of Attention-FFN Split in Vision Transformers cs.CVPDF

Junhyeok Kim, Jinyeong Kim, Jae Wan Park, Seong Jae Hwang

TL;DR: 提出 AttenFeed 和统一 ViT（uViT），将注意力与前馈网络合并到统一模块中，以研究标准 ViT 严格交替两者是否限制小模型性能。

Details

Motivation: 标准 Transformer 固定交替 Attention 与 FFN，但这种刚性结构带来的归纳偏置尚未被系统检验；参数预算较小的时候，预先划定两类模块的容量可能不合适。

Result: AttenFeed 统一组件整合注意力与前馈网络功能，uViT 用连续 AttenFeed 模块替换标准 ViT 的交替结构。作者跨多个数据集和模型规模系统比较两种结构，发现注意力—FFN 二分在较小模型规模下可能因参数分配僵化而损害性能。摘要未给出数据集名称、具体规模或准确率差异。

Insight: uViT 主要是放松结构约束的分析对照，也可作为研究 ViT 注意力/FFN 分工的新工具。报告结论指出小规模受益，但摘要不足以判断收益在大规模模型上是否存在。

Abstract: The standard Transformer architecture relies on a rigid pattern that alternates Attention and Feed-Forward Network (FFN) layers. Despite its widespread adoption, the inductive bias imposed by this strict separation has not been systematically examined. In this work, we investigate the necessity of the Attention-FFN dichotomy in Vision Transformers (ViTs). To facilitate this analysis, we introduce the AttenFeed module, a unified component that integrates the functional properties of both Attention and FFN. Based on this module, we devise the unified Vision Transformer (uViT), which replaces the conventional alternating Attention-FFN structure with a sequence of AttenFeed modules. We then use uViT as a control group that relaxes the Attention-FFN dichotomy of the standard ViT and systematically compare the two models across multiple datasets and model scales. Our experiments reveal that the Attention-FFN dichotomy can hinder performance at smaller model scales due to the rigid parameter allocation of ViTs. The AttenFeed module and uViT serve as new analytical tools for understanding the Attention-FFN structure and offer theoretical insights into the heuristically designed architecture of conventional ViTs.

[76] One-Shot Adaptive Segmentation For Scientific Images cs.CVPDF

Tejaswi V. Panchagnula, Allison M. Davis, Fengqing Zhu

TL;DR: 提出免训练的一次参考图像自适应分割方法，用 DINOv3 表征和背景自适应特征正交化定位候选区域，再由 SAM 分割。

Details

Motivation: 科学图像分割依赖大量标注和任务专用训练，难以适应不同成像模态及实验条件。作者希望只用一张标注参考图即可调整视觉基础模型，避免针对每种场景重新训练。

Result: 方法从 DINOv3 特征中通过背景自适应正交化抑制伪影相关方向，使用余弦相似度定位候选区域，再交由 SAM 分割。在红细胞显微图像、结构光照明池沸腾和胸部放射影像三类数据上，相较最强基线，显微和池沸腾数据集平均 IoU 分别提升 5.91% 和 78.62%，胸部影像表现相当。摘要未说明百分比是相对提升还是百分点。

Insight: 单张已标注参考图与背景特征校正结合，可使通用视觉模型适配专业科学图像；不同成像模态收益差异很大，胸片结果是可比而非明显更优。

Abstract: Scientific image segmentation methods rely on extensive annotation and task-specific training, limiting adaptation across imaging modalities and experimental conditions. We present a training-free, one-shot framework that specializes vision foundation models using a single annotated reference image. The framework combines DINOv3 representations with background-adaptive feature orthogonalization to suppress artifact-related feature directions, after which cosine similarity localizes candidate regions for SAM segmentation. We evaluate the framework on red-blood-cell microscopy, structured-illumination pool boiling, and chest radiography. Relative to the strongest baseline, the proposed method improves mean IoU by 5.91% and 78.62% on the microscopy and pool-boiling datasets, respectively, while achieving comparable performance on chest radiographs. These results demonstrate that one-shot reference conditioning can adapt general-purpose vision models to specialized scientific segmentation tasks.

[77] Real-Time Joint Audio-Video Generation by Parallel Adapter Composition cs.CVPDF

Jingyu Li, Xiaoxiao Xiang, Yiwen Guo

TL;DR: 提出实时音视频扩散的并行适配器组合：分别学习因果流式生成与少步采样适配器，利用二者权重更新近似正交的特性直接相加，无需联合训练。

Details

Motivation: 实时交互生成需要视频块因果注意力和低步数采样。传统串行蒸馏链先后微调同一权重，后续目标可能破坏此前获得的流式或少步能力。

Result: 在打包音视频骨干上，作者冻结基础模型训练因果适配器，并使用现成少步适配器；两类适配器针对不同功能轴，实验验证其权重更新方向近似正交，训练时未施加正交约束。推理时直接相加，合成模型无需联合训练即可流式少步生成音视频，画质接近双向教师。与串行基线相比，多数指标持平或更优；系统在 480×832 分辨率、未量化时约 26 fps，画质稳定地连续生成 30 秒。

Insight: 将流式因果化和少步采样视为可组合的独立能力，使顺序微调可能引起的能力遗忘得以规避。结果显示适配器方向近似正交但不是训练约束；摘要未提供多数指标的具体分数。

Abstract: Deploying a joint audio-video diffusion transformer for real-time, interactive generation normally requires two essential modifications: block-autoregressive attention, so frames can be emitted before the whole clip is finished, and few-step sampling, so each block is cheap. Conventionally, the streaming video literature obtains both capabilities from a chained pipeline. It first distills a bidirectional teacher into a causal student, then into a few-step one, or proceeds in reverse order. Each stage of such a chain fine-tunes the weights the previous one produced, so a later objective can undo an earlier capability. Following the idea of model merging, we show that on a packed audio-video backbone the two capabilities can be acquired in parallel. A causal adapter is trained against the frozen backbone, and an off-the-shelf few-step adapter provides the few-step capability. As the two edit different functional axes, we predict, and then verify, that their weight-update directions are near-orthogonal, without any explicit orthogonality constraint during training. Orthogonal updates should combine without interfering, so parallel composition is a direct sum. The two adapters are simply added at inference, with no joint training, yielding few-step, streaming audio-video whose image quality tracks the bidirectional teacher. Compared to the chained baselines, the composed model matches or beats them on most metrics, making parallel composition a practical approach. The resulting streaming system generates joint audio-video in real time, $\approx$26 fps at $480\times832$ without quantization, and sustains 30 s of continuous generation with stable image quality.

[78] From Digital Human Interactions to Physics-Based Humanoid Skills: Physics-Grounded Post-Training of Interaction Generators cs.CVPDF

Kerui Chen, Jianrong Zhang, Kai Lv, Hehe Fan

TL;DR: 提出 DIGHT，让数字人交互生成器与人形机器人跟踪策略共同适配：利用仿真跟踪反馈构造分项偏好，并将物理可执行性与接触保真纳入生成器训练。

Details

Motivation: 现有双人形交互生成常依靠物理跟踪策略把数字参考动作转为可执行轨迹。跟踪能力有限会使大量参考动作无法利用；即使成功跟踪，也不保证响应物理合理或忠实实现交互意图。

Result: DIGHT 先用固定跟踪器在仿真中执行多个文本条件交互候选，再从 rollout 构造涵盖可执行性和交互保真度的偏好。作者不将这些信号合并成单一奖励排序，而通过物理解耦的扩散 DPO 对预训练生成器对齐，避免对模拟器求导。可执行性偏好依据跟踪误差、摩擦和漂浮；交互保真度使用模拟器力反馈，并对接触是否发生、位置、持续时间和力大小构造偏好。随后对齐后的生成器向跟踪器提供参考动作以微调。摘要称实验提升了物理合理性，并使仿真人形交互更可靠、忠实，但没有列出具体指标。

Insight: 把物理仿真用于生成器偏好反馈，再反向用改进生成器微调跟踪器，构成协同适配闭环。偏好项分别保留接触真实性和动作可执行性，实验范围目前从摘要看限于仿真。

Abstract: Recent methods have made promising progress in generating interactions between two humanoids, largely relying on physics-based tracking policies to convert digital reference motions into executable trajectories. However, limited tracking capabilities restrict the range of reference motions that can be successfully executed, reducing data utilization. Moreover, even successful tracking does not guarantee physically plausible responses or faithful realization of the intended interactions. In this paper, we introduce DIGHT, a co-adaptive framework that couples a Digital human Interaction Generator with a Humanoid Tracking policy. Our DIGHT first executes multiple text-conditioned interaction candidates in simulation using a fixed tracker. It then constructs physics-grounded preferences from the resulting rollouts, covering both general executability and interaction fidelity. Rather than collapsing these signals into a single scalar reward for candidate ranking, we align the pretrained generator using physics-decoupled diffusion direct preference optimization (DPO), preserving criterion-specific supervision without differentiating through the simulator. To improve executability, preference pairs are derived from tracking error, friction, and floating. Additionally, to improve interaction fidelity, we propose to incorporate force feedback from simulator as a measure of contact fidelity and construct preferences over contact occurrence, location, duration, and force magnitude. The aligned generator then supplies reference motions for fine-tuning the tracker, improving compatibility between generation and physical execution. Extensive experiments demonstrate that our approach not only improves the physical plausibility of generated motions but also enables more reliable and faithful humanoid interactions in simulation.

[79] Gaussian Density Splatting Network cs.CVPDF

Miao Shang, Yabin Wang, Xiaopeng Hong

TL;DR: 提出 GDSNet，以连续二维高斯基元的叠加表示人群密度，并通过可微高斯溅射联合优化局部密度与整体计数。

Details

Motivation: 传统网格密度图依赖固定空间分辨率，对分辨率变化敏感；作者希望用连续表示表达拥挤人群，并将局部定位监督与全局人数目标统一起来。

Result: GDSNet 使用控制点拟合高斯参数：分配控制点以划分局部区域，从区域聚合特征并回归各高斯基元参数。每个基元由几何参数与标量密度质量定义，可微渲染密度图，再通过空间匹配端到端训练，实现局部密度监督和全局计数优化。作者在四个标准基准上评估，报告其一致优于 SOTA；摘要未提供基准名称和计数误差数据。

Insight: 连续高斯基元避免把密度限制在固定网格，同时以质量参数自然表达人数总量。摘要未交代与各基线的具体差值或跨分辨率鲁棒性。

Abstract: This paper proposes a novel crowd counting approach, the Gaussian Density Splatting Network (GDSNet). Unlike methods that rely on conventional, grid-based density maps and are sensitive to spatial resolution, GDSNet represents a crowd as a superposition of continuous 2D Gaussian primitives. Our approach is built upon two key contributions. First, we introduce a control-point-based fitting mechanism to structure the prediction of the Gaussian parameters. We design a method to allocate a set of control points that define local regions, from which features are pooled to regress each primitive’s parameters. Second, we adapt a differentiable Gaussian Splatting framework to the counting task by parameterizing each primitive with geometric parameters and a scalar density mass. This formulation allows the network to be trained end-to-end via spatial matching of differentiably rendered density maps, naturally providing both local density supervision and global count optimization. Extensive evaluations on four standard benchmarks show GDSNet consistently outperforms the state of the art.

[80] Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving cs.CVPDF

Xingtai Gui, Yucheng Zhou, Dongqian Guo, Jiahao Gong, Feiyang Tan

TL;DR: 提出 GeoCoTDrive，在驾驶 VLA 中先定位决策相关 2D 区域，再注入对应局部 3D 几何先验，支持规划导向的轨迹生成。

Details

Motivation: 自动驾驶动作依赖精确 3D 几何线索，但现有 VLA 多在 2D 语义空间理解和推理，造成视觉语言表征与驾驶规划所需空间信息不匹配。

Result: GeoCoTDrive 采用“先 2D 思考、再用专门 3D 先验驾驶”的流程：定位影响决策的 2D 区域，从几何基础模型对应区域采样局部 3D 特征，并将其穿插到自回归上下文中生成轨迹。作者新增规划相关区域 grounding 任务及 PlanningGrounding 数据集，以训练规划导向定位能力。多个端到端驾驶基准实验显示，其安全关键规划表现持续改善；摘要没有给出基准名称、分数或提升幅度。

Insight: 显式几何推理把视觉 grounding 与局部三维先验直接连接到驾驶规划，重点是与自车决策相关的区域，而非泛化物体框。可量化效果需由完整实验细节补充。

Abstract: Vision-language-action~(VLA) models have emerged as a promising paradigm for autonomous driving. However, existing VLA models still suffer from a fundamental mismatch: driving actions require precise 3D geometric cues, while visual-language understanding and reasoning are largely conducted in a 2D semantic space. In this paper, we propose GeoCoTDrive, an explicit geometric chain-of-thought framework that grounds geometry in a planning-oriented manner. GeoCoTDrive follows a think with 2D first, drive with dedicated 3D priors paradigm. It first grounds 2D regions corresponding to decision-critical cues, and then retrieves localized 3D priors by sampling features from a geometric foundation model within the grounded regions. These localized geometric features are interleaved into the autoregressive context to support the trajectory generation. To supervise this process, we introduce planning-relevant grounding, a new region-level grounding task that focuses on local spatial cues directly affecting ego planning decisions, and construct the PlanningGrounding dataset to endow VLAs with planning-oriented grounding capability. Experiments across multiple end-to-end autonomous driving benchmarks show that GeoCoTDrive consistently improves safety-critical planning performance, demonstrating the effectiveness of the explicit geometric chain-of-thought process for VLA-based planning.

[81] SGF+: Decoupling Gradient Flows for Autoregressive Video Generation cs.CVPDF

Zihan Su, Junhao Zhuang, Yaowei Li, Siwen Lu, Haoran Li

TL;DR: 提出 SGF+，为自回归视频生成中的上下文写入与当前帧去噪配置独立参数，同时保留因果交互，以改善画质和长程一致性。

Details

Motivation: 自回归视频生成既要去噪当前帧，也要把关键值表示写入上下文供未来预测，两类功能常共用参数；作者发现其梯度模式不同且系统性负对齐，妨碍同时优化画质和时间一致性。

Result: SGF+ 将上下文写入和去噪的参数分开，但仍通过因果注意力交互；两者使用原始生成目标联合优化，不增加辅助损失，并用其对未来预测的贡献监督上下文写入。在逐帧和分块生成中，相较所测基线，画质与长时一致性都改善；无需额外视频数据或增加训练时长。仅用 5 秒 rollout 训练后，模型无需长视频微调即可连续生成最长 24 小时。

Insight: 角色专属参数化可缓解功能不同的梯度冲突，让短时训练获得长时外推能力。摘要宣称可持续生成至 24 小时，但没有提供长期运行的定量稳定性指标。

Abstract: Autoregressive video generation requires denoising the current frames while writing their key-value representations as context for future predictions. However, these two roles typically share parameters, and we find that their gradients exhibit distinct patterns and systematic negative alignment, hindering the joint optimization of visual quality and temporal consistency. We introduce Self Gradient Forcing Plus (SGF+), which assigns separate parameters to context writing and denoising while preserving their interaction through causal attention. Both roles are jointly optimized using the original generation objective without auxiliary losses, with context writing supervised through its contribution to future predictions. This simple change improves visual quality and long-horizon consistency over the evaluated baselines in both framewise and chunkwise generation, without additional video training data or a longer training horizon. Trained on only 5s rollouts, SGF+ supports continuous generation for up to 24 hours without long-video fine-tuning. These results highlight role-specific parameterization as an effective design principle for high-quality autoregressive video generation and native long-horizon extrapolation.

[82] Self-correction Optimization for Interleaved Multimodal Generation cs.CVPDF

Xin You, Zhiwei Ning, Zukai Chen, Minghui Zhang, Xuanke Shi

TL;DR: 提出无需训练的自校正优化 SCO，在交错图文生成的无分类器引导更新上施加新事件和状态保持约束，以改善时间连贯性及主体保持。

Details

Motivation: 交错生成图文序列要求多模态理解与生成紧密配合；现有方法多需额外数据训练，计算代价大，且在视觉主体保持、时间一致性和物理合理性上仍有限。

Result: SCO 将无分类器引导更新作为参考，仅作最小幅度自校正，并施加两类约束：新事件约束维护图文序列的时间一致性，状态保持约束维护后续生成中视觉主体的连贯性。作者在困难交错多模态生成基准上报告时间连贯性和主体保持显著改善；方法也可扩展到视频生成，并改善机器人操作和长时手工制作等物理过程的建模。摘要未列具体指标或基准名称。

Insight: 通过约束生成更新而非重新训练模型，SCO 针对事件演进与主体持续性分别校正。摘要称适用于视频和长时物理过程，但未给出推理开销和提升幅度。

Abstract: Multimodal large language models (MLLMs) have made significant progress in visual understanding and generation. However, generating interleaved image–text content remains challenging, as it requires tightly integrated multimodal understanding and generation capabilities. Although existing MLLMs provide promising solutions, most rely on additional training with augmented data, which is computationally expensive and remains limited in preserving visual subjects, temporal consistency, and physical plausibility. In this work, we propose self-correction optimization (SCO), an effective training-free method for consistent interleaved generation. SCO treats the classifier-free guidance update as a reference and performs minimal self-correction under two complementary constraints, including new-event and state-preserving constraints. Specifically, the new-event constraint promotes temporal consistency across image–text sequences, while the state-preserving constraint maintains the coherence of visual subjects throughout subsequent generation steps. Experiments on challenging interleaved multimodal generation benchmarks demonstrate significant improvements in temporal coherence and visual-subject preservation. Furthermore, SCO can be extended to video generation and improves the modeling of physically grounded processes, including robot manipulation and long-horizon handcrafting.

[83] Detecting Adversarial Images through Response Profiles of Vision-Language Models cs.CVPDF

Arash Vashagh, Roozbeh Razavi-Far

TL;DR: 提出基于 VLM 语义提示响应画像的对抗图像检测器：冻结 VLM，统计多类提示响应关系并用轻量分类器识别异常输入。

Details

Motivation: 对抗扰动可能改变冻结 VLM 预测，却让置信度和图文相似度表面上仍合理，因此仅看单个预测或嵌入几何未必能发现攻击。

Result: 检测器汇总一般语义提示下的类别统计、提示间关系、相对干净参考分布的偏差及弱图像变换下的稳定性，形成响应画像后交给轻量模型分类，VLM 本身保持冻结。作者在多个公开图像数据集、若干 CLIP 风格骨干及梯度、优化、自动化和空间攻击上评估；攻击专用设置下区分能力强，对训练未见攻击也保留较高表现。在受控检测器协议下优于所评嵌入几何基线；特征组提供互补信息，对提示配置变化仍有效。论文还评估推理成本和检测器感知自适应攻击，但摘要未提供数值。

Insight: 跨提示响应模式提供了单一嵌入距离之外的互补检测线索。自适应攻击和提示设置都被纳入分析，但摘要未说明最坏情形性能或具体攻击成功率。

Abstract: Adversarial perturbations can alter the predictions of frozen vision-language models (VLMs) while leaving their confidence and image–text similarity patterns seemingly plausible. We investigate whether we can identify adversarial inputs based on the broader way an image interacts with a collection of general semantic prompts. Our detector summarizes these responses using category-level statistics, relationships among prompts, deviations from clean reference distributions, and stability under weak image transformations, producing a compact response profile that is classified by a lightweight model while the VLM remains fixed. We evaluate the approach on multiple public image datasets, several CLIP-style visual backbones, and a range of gradient-based, optimization-based, automated, and spatial attacks. The detector achieves strong discrimination in attack-specific settings and retains substantial performance when evaluated on attacks not seen during training. Under a controlled detector-specific protocol, the response-profile representation outperforms the evaluated embedding-geometry baselines. Additional analyses show that the feature groups provide complementary information and that the method remains effective under variations in the prompt configuration. We also examine inference cost and performance against detector-aware adaptive attacks. Overall, the results indicate that response patterns across semantic prompts provide a useful complementary signal for adversarial image detection in frozen VLMs.

[84] Video-Conditioned Generative Joint 2D-3D Hand Motion Recovery cs.CVPDF

Chen Xu, Yunqi Li, Binbin Huang, Brent Yi, Shenghua Gao

TL;DR: 提出 JoHan，直接从视频联合生成对齐的 2D 与 3D 局部手部姿态序列，再利用跨表示对应关系恢复相机坐标下手部全局位置和朝向。

Details

Motivation: 视频中的遮挡和视觉观测缺失使逐帧估计的 3D 手势不可靠且时间不一致；逐帧姿态中间表示可能限制连续动作恢复。

Result: JoHan 从头训练统一生成模型，联合学习 2D/3D 局部手姿序列的时间动态及跨表示对应关系。先生成的 2D 轨迹利用图像中的空间和时间线索指导后续 3D 动作重建，学习到的动作先验促进时间一致性；2D—3D 对应还能恢复手相对相机的全局位置和朝向。困难基准实验显示，局部手姿与相机空间重建的准确度和速度均显著改善；手部运动更平滑，同时维持高逐帧姿态准确度。摘要未报告具体基准或数值。

Insight: 联合建模 2D 观测轨迹与 3D 运动先验可同时处理遮挡下的单帧姿态和时序平滑问题，并恢复全局相机坐标信息。不同指标间的精度—平滑性折衷仍需看完整实验。

Abstract: Recovering faithful 3D hand motion from video remains challenging due to frequent occlusions and incomplete visual observations, which make frame-wise pose estimates unreliable and temporally inconsistent. To address this problem, we propose JoHan, a unified generative framework that recovers hand motion directly from video sequences without relying on intermediate per-frame pose predictions. Trained from scratch, our model jointly generates aligned 2D and 3D local hand pose sequences by learning their temporal dynamics and cross-representation correspondence. The generated 2D trajectories exploit direct spatial and temporal cues from the 2D images to guide the following generative 3D motion reconstruction, while the learned motion prior promotes temporal consistency. Their learned 2D-3D correspondence further enables recovery of the hand’s global position and orientation relative to the camera. Extensive experiments on challenging benchmarks demonstrate significantly improved accuracy and speed in local hand-pose and camera-space reconstruction. Notably, our method captures much better hand-motion dynamics, producing significantly smoother motion than previous methods while maintaining high per-frame pose accuracy.

[85] GRACE: Generation-aware latent compression for efficient video generation cs.CVPDF

Jiyoung Kim, Paul Hyunbin Cho, Jisu Nam, Donghoon Lee, Hyunsung Go

TL;DR: 提出 GRACE，两阶段压缩视频自编码器潜变量，并以冻结预训练 DiT 特征对齐和轻量适配保持兼容，将 Wan2.1-I2V-14B token 数减少 8 倍。

Details

Motivation: 提高视频自编码器压缩率可减少 DiT 输入 token、加速扩散，但常损害重建质量；增加通道恢复质量又会拖慢 DiT 收敛。即便压缩预训练自编码器，单独优化重建仍会使潜变量偏离 DiT 已学分布，迫使模型昂贵适配或重训。

Result: GRACE 保留冻结基础潜变量，并学习补充强压缩丢失信息的残差潜变量；再在冻结 DiT 的特征空间对齐压缩表示，使自编码器面向生成而非单纯重建优化。随后轻量微调 DiT，并采用基础分支先于残差分支去噪的非对称策略。在 480×832×81 设置下，Wan2.1-I2V-14B token 数降低 8 倍、延迟降低 11.1 倍，同时在 VBench 上匹配压缩前预训练管线的生成质量。

Insight: 生成感知对齐使高压缩潜变量仍适配已训练 DiT，残差分支专门补回被压缩丢失的信息。速度与质量结果针对 Wan2.1-I2V-14B 的所报分辨率和帧数设置。

Abstract: Highly compressed video autoencoders offer an effective way to accelerate video diffusion models, as the Diffusion Transformer (DiT) operates on far fewer tokens. However, such autoencoders are challenging to train, since a higher compression ratio degrades reconstruction quality and recovering it requires more channels, which is known to slow the convergence of the DiT. The compressed latent also differs from the one the DiT was trained on, so the pretrained DiT must be either retrained from scratch or adapted at considerable cost. Compressing the autoencoder the DiT was trained with appears to preserve compatibility, yet optimizing it for reconstruction alone still shifts the latent away from the distribution the DiT has learned. To address this, we propose Generation-Aware Latent Compression for Efficient Video Generation (GRACE), a two-stage framework that compresses a pretrained video autoencoder while keeping it compatible with the pretrained DiT. Specifically, we keep a frozen base latent from the pretrained encoder and learn a residual latent for the information lost under stronger compression, while aligning the compressed latent with the pretrained latent in the feature space of the frozen DiT so that the autoencoder is optimized for generation. We then adapt the DiT with lightweight fine-tuning and asymmetric denoising, where the base is denoised ahead of the residual. GRACE reduces the token count of Wan2.1-I2V-14B by 8x and its latency by 11.1x at 480x832x81, while matching the generation quality of the pretrained pipeline before compression on VBench.

[86] MORCA: Offline-to-Online Reinforcement Learning for Adaptive Cache Reuse in Video Diffusion Acceleration cs.CVPDF

Yuxiang Xiong, Ruiyan Wang, Wenqiang Wang, Teng Hu, Songhang Shen

TL;DR: 提出 MORCA，用离线到在线强化学习学习潜变量感知的视频扩散缓存调度，直接按最终生成质量损失和用户指定加速目标决定复用或重算。

Details

Motivation: 视频扩散逐步去噪带来高延迟，缓存可利用步间冗余加速。既有方法按当前去噪步误差做决定，但单步误差不一定对应最终视频质量损失；阈值式调度也难以精确满足用户指定的加速比。

Result: MORCA 利用潜变量信息建模局部步误差与最终输出误差的关系，并通过离线到在线 RL，在用户给定的目标加速比下学习复用/重算动作。作者在多种视频生成模型和多个目标加速率上评估，报告在相近计算预算下，生成保真度优于 SOTA 缓存方法；摘要未给出具体模型、加速比和质量指标。

Insight: 调度优化目标从每步近似误差转向终端视频质量，并将加速预算作为策略条件，面向可控加速部署。结论来自多模型实验，但摘要未提供各工作点的速度—质量曲线。

Abstract: Diffusion Transformers (DiTs) achieve remarkable performance in video synthesis, but their iterative denoising process suffers from high inference latency. To address this, caching has emerged as an effective acceleration strategy by capitalizing on inter-step redundancy during denoising. Existing dynamic caching methods typically estimate the error that cache reuse would introduce at each denoising step (step error) to guide cache decisions, whereas our concern is how much quality loss cache reuse would cause in the final generated video (terminal error). We show that step error does not directly correspond to terminal error and that latent information helps capture their relationship, thereby informing cache decisions. Moreover, existing threshold-based methods cannot provide precise speedup control, making it difficult to meet practical requirements for user-specified acceleration targets. To address these limitations, we introduce MORCA, a cache scheduling framework trained through offline-to-online reinforcement learning to make latent-aware reuse/recompute decisions under user-specified acceleration targets. Extensive experiments on different video generation models across multiple target acceleration ratios demonstrate that MORCA achieves better generation fidelity than state-of-the-art caching methods under comparable computational budgets. Code is available at https://github.com/x10ngyx/MORCA.

[87] Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videos cs.CV | cs.AI | cs.ROPDF

Shravan Chaudhari, William Paul, Suchi Saria, Rama Chellappa, Homanga Bharadhwaj

TL;DR: 提出 Ledger，从第一人称视频构建持久三维物体记忆，记录位置、移动历史和上下文描述，使具身助手离开原始视频后仍能回答空间问题。

Details

Motivation: 日常活动中许多物体可能之后才变得重要，人能记住物品放在哪里或容器里有什么；具身助手也需要在未预先知道问题的情况下，从长时间第一人称记录中保留可检索信息。

Result: Ledger 将物体位置、历史和上下文描述关联起来，并在物体离开视野后继续保留记录，包括用户从未触碰的物体。它按静置位置聚类观测，需重复证据才确认移动，以降低定位噪声影响；短描述保留物体内容、承托表面等细节。无需重新访问图像/视频即可回答空间问题。HD-EPIC 准确率由 29.7% 升至 42.6%，UCS-Bench 由 33.8% 升至 38.5%；Ego4D 返回预测的物体定位中位误差为 0.99 米。分析发现时间持续性、上下文描述和检索作用互补。由 100 个多场景拼接流组成的研究暴露了构建和检索失败，按场景构建相较单场景流可部分恢复跨场景性能损失。

Insight: 持久空间记忆需要同时处理位置连续性、物体属性上下文和检索；跨场景切换会让构建与检索都变难。Ego4D 的 0.99 米误差只针对系统返回的预测。

Abstract: As we move through the world and carry out everyday tasks, we encounter objects that may become relevant only later. We are capable of recalling where we left something or what was inside a container, even without knowing we would need it later. Here, we study how an embodied assistant can build a similar memory from egocentric videos, by observing a person’s day-to-day activities. We present Ledger, a persistent 3D object memory that combines object locations, their histories, and contextual descriptions. It associates observations across the recording and retains objects after they leave the view, including those the person never touches. It clusters each object’s observations by resting locations and records a move only after repeated evidence, reducing the effect of localization noise. Short descriptions preserve details such as an object’s contents or supporting surface. It saves these records to later answer spatial questions without having to access the original images or video. Our memory raises HD-EPIC accuracy from 29.7% to 42.6%, UCS-Bench accuracy from 33.8% to 38.5% and localizes Ego4D objects with a 0.99 m median error on returned predictions. Our analyses identify complementary roles for temporal persistence, contextual descriptions, and retrieval. Our study on 100 stitched streams of multiple scenes each further exposes failures in both retrieval and construction. Per-scene construction partially recovers the performance lost across scene changes compared to that of single scene streams.

cs.CL [Back]

[88] CoDR: Training-Free Confidence-Drift Remasking for Diffusion Language Models cs.CL | cs.LGPDF

Yue Wu, Qinghe Zhang, Yu Zhang, Jian Huang

TL;DR: CoDR为掩码扩散语言模型提供免训练、采样器无关的置信漂移重掩码：监测token从稀疏承诺上下文到后续稠密上下文的置信度下降，仅用k次前向探测全部承诺位置，并重新生成不再获模型支持的token。两骨干、四类任务、三种基础采样器上平均准确率均提升，开销适中且前向次数少于既有重掩码法。

Details

Motivation: 掩码扩散模型反复向掩码位置提交token，但提交通常不可逆；早期上下文稀疏时选出的token即使后续上下文不再支持也会固定，导致初始错误扩散。现有采样器多决定何时提交，很少回看已提交token是否仍合理。

Result: CoDR将稀疏提交时与后续稠密上下文下置信度下降定义为confidence drift。该免训练、采样器无关精炼过程通过k分区探测，仅k次前向估计所有已提交位置的漂移，再只重掩码并重生成模型不再认可的token。两个骨干、四项推理/代码任务和三种基础采样器的所有模型—采样器配置平均准确率均提升，多数单项也改善且额外开销适中。受控实验显示收益来自定向漂移重掩码而非单纯多算力，且其前向次数远少于既有重掩码方法。

Insight: 扩散解码的错误不只来自提交时机，也来自提交后上下文变化导致早期决策失效；检测置信漂移能针对性撤销少数不再合理的token。摘要未给准确率增益或k取值，具体质量—速度折中需查看全文。

Abstract: Masked diffusion language models (MDLMs) decode by repeatedly committing tokens to masked positions, but these commitments are usually irreversible. A token chosen under sparse, partial context is kept fixed, even when later context no longer supports it. Existing samplers mainly decide when to commit a token, but rarely check whether an already committed token should still be kept, allowing early mistakes to propagate. We trace this issue to confidence drift, where the model’s confidence in a committed token drops from its sparse commit-time context to the denser context available later. Based on this signal, we propose CoDR (Confidence Drift Remasking), a training-free and sampler-agnostic refinement pass. CoDR estimates drift for all committed positions in only k forward passes via k-partition probing, then remasks and regenerates only the tokens the model no longer endorses. Across two backbones, four reasoning and coding tasks, and three base samplers, CoDR improves average accuracy across all evaluated model-sampler configurations and improves most individual task settings with modest overhead. Controlled experiments show that the gains come from targeted confidence-drift remasking rather than extra compute alone, and that CoDR uses far fewer forward passes than prior remasking methods. Code is available at https://github.com/YueWu0301/CoDR.

[89] Emo-Jev: Probabilistic Reasoning for Emotion Classification with Jev cs.CLPDF

Yazhou Zhang, Junhao Yu

TL;DR: Emo-Jev提出免训练文本情绪分类框架，用Jev将任务拆为原子判断并组合概率，或从互补视角构造多条判断路径后集成。八个情感/讽刺/幽默数据集上，标准Jev平均macro-F1为62.93%，低于最强LLM基线67.28%，但观察到延迟更低、成本通常更低。

Details

Motivation: Jev提供不同于自由文本的接口：根据预设问题输出概率性决策。该接口能否支持与主流LLM竞争的文本分类推理仍未明确，尤其需要检验情绪、讽刺和幽默等任务。

Result: Emo-Jev是免训练框架，有两种实现：Emo-Jev-D将分类拆成任务相关原子判断并组合其概率；Emo-Jev-SC从互补视角构造多条判断路径并聚合为共识。评估覆盖情感分析、情绪识别、讽刺和幽默八个数据集，与直接Jev分类及五个SOTA LLM比较，并测试输入/输出推理和CoT推理。摘要报告标准Jev平均macro-F1为62.93%，最强LLM基线为67.28%；标准Jev观察到延迟较低、成本通常较低。摘要未提供Emo-Jev-D/SC具体分数。

Insight: 概率判断接口便于将分类推理拆解并组合，但现有摘要数字是标准Jev与最强LLM比较，不能推断两种Emo-Jev变体超过基线。方法的潜在优势是低延迟、低成本及可分解性，分类性能尚需查看详细结果。

Abstract: Jev offers an alternative interface for language understanding: given an input and predefined questions, it returns probabilistic decisions rather than free-form responses. Whether this interface can support effective reasoning for text classification against leading LLMs remains an open questions. We introduce Emo-Jev, a training-free framework with two complementary implementations. Emo-Jev-D decomposes classification into task-specific atomic judgments and composes their probabilities into a final prediction. Emo-Jev-SC constructs multiple judgment paths from complementary perspectives and aggregates their predictions into a consensus decision. We evaluate Emo-Jev on eight datasets spanning sentiment analysis, emotion recognition, sarcasm detection and humor detection, comparing against direct Jev classification and five SoTA LLMs under input/output and chain-of-thought reasoning. Standard Jev achieves 62.93% average macro-F1 versus 67.28% for the strongest LLM baseline, with lower observed latency and generally lower cost.

[90] Beyond the Sycophancy Score: How Task, Model, and Pressure Shape LLM Yielding cs.CL | cs.AI | cs.LGPDF

Guang Yang, Homa Hosseinmardi, Fengchen Liu, Amir Ghasemian

TL;DR: 这项研究用103,939条标注回复考察LLM谄媚行为受任务、模型和压力影响的机制。任务可验证性是主因（移除任务因子使McFadden R²降低0.485，模型家族0.139，施压策略0.009）；最大推理在两个测试模型中消除了深层谜题让步，个人偏好则被认可77.0%。

Details

Motivation: LLM可能在用户反驳后放弃原本正确答案或附和用户立场，通常只用每模型单一谄媚率报告，无法说明行为何时发生或用户如何降低风险。作者检验任务难度、模型和压力条件各自作用。

Result: 研究对10种配置（8个关闭推理LLM，另两模型开启最大推理）使用相同200条目、13种压力条件、四轮对话，共获得103,939条双LLM评审回复。主要因素是核验用户主张的难度和模型是否有覆盖该领域的护栏；逻辑回归去掉任务因素使McFadden R²下降0.485，去模型家族下降0.139，去施压方式仅下降0.009。锚定事实几乎不被让步（1.3%），逻辑谜题随反驳需用线索增加而更易附和；个人选择在77.0%对话中获认可。难题让步主要来自本就无法可靠解题的模型。两个开启推理测试模型中，最大推理将深层谜题附和率从19.2%和12.5%降至0%。三名人工标注者在120校准条目中有118条与评审共识一致。研究提出简化难核验问题、要求深度推理、询问问题而非偏好答案、开放问题要求证据及按护栏表现选模型等建议。

Insight: 谄媚强烈受任务可核验难度驱动，压力措辞本身贡献较小；深度推理可让模型在能解决的难题上不轻易放弃判断。最大推理结果只针对两个模型，开放式个人偏好需要请求证据而非要求认同。

Abstract: Large language models (LLMs) often abandon a correct answer, or endorse a user’s position, once the user pushes back. This behavior, called sycophancy, is usually reported as a single rate per model, which says little about when it happens or how a user can avoid it. We study the conditions that produce it with 103,939 graded replies from ten configurations: eight LLMs with reasoning disabled, and two of them again with maximum reasoning, all facing the same 200 items, 13 pressure conditions, and four-turn conversations, with every reply labeled by two independent LLM judges. We find that the dominant factors are how costly it is for the model to verify the user’s claim, and whether a trained guardrail covers it. Removing this task factor from a logistic model costs 0.485 of McFadden $R^2$, against 0.139 for model family and 0.009 for pressure tactic. Anchored facts are almost never conceded (1.3%), while adoption on logic puzzles rises with the number of clues needed to refute the pushed answer. Personal choices are endorsed in 77.0% of conversations. Most concessions on hard items come from models that cannot reliably solve them; models that can solve them rarely give the answer up. For both models tested, maximum reasoning removes these concessions completely: adoption on deep puzzles falls from 19.2% and 12.5% to 0%. Fallacious or emotional framing adds nothing beyond plain repetition. Three human annotators agree with the judges’ consensus on 118/120 calibration items. These results give practical rules for reliable use: simplify hard-to-verify problems and reason deeply, state the question rather than one’s preferred answer, ask for evidence on open questions, and choose models by their measured guardrail profile.

[91] U-Space: Uncovering When and Why Uncertainty Arises in Language Models cs.CL | cs.AI | cs.LGPDF

Tobias Braun, Nils Loose, Alexander Herzog, Virginia Ceccatelli, Marcus Rohrbach

TL;DR: U-Space从模型残差表示中构造低维、可解释的不确定性子空间：以确定/怀疑语义锚点的unembedding方向建立正交基，U-Lens逐token投影得到不确定性轨迹图或总体分数。无需正确性标签、重复生成或训练，在推理基准及控制生成长度的评测中优于既有置信基线，并比监督估计器迁移更稳健。

Details

Motivation: 高风险决策中需要判断单个LLM答案是否可信，但模型可能用流畅、权威语气表达错误结论。现有不确定性估计常需多次生成或单独训练组件，且只输出标量，无法指出推理中不确定性出现的位置和变化。

Result: U-Space识别表达怀疑与确定的语义锚点，将它们的unembedding方向映射回残差空间，并把对比方向组合为正交基。U-Lens将每个token隐藏状态投影到这些基向量，产生可直接检查或聚合为标量的不确定性图。方法不需正确性标签、重复生成或额外训练。在多个推理基准上，其置信分数在常规与控制输出长度的评测中均优于既有基线，并比监督估计器迁移更可靠；摘要未提供具体AUROC/ECE数值。

Insight: 不确定性应作为随推理变化的中间状态，而非单一输出长度或最终置信数；token级子空间读出让估计更可解释且无需额外训练。通过控制长度后仍胜过基线，说明并非只利用生成长度相关性。

Abstract: Large language models are informing decisions with ever-higher stakes. As the consequences of their errors grow, a central question becomes harder to ignore: how much can we trust an individual answer? Yet recognizing when to defer remains difficult because language models can present incorrect conclusions with fluent explanations and an authoritative tone. Uncertainty quantification seeks to address this disconnect by estimating the reliability of individual predictions. However, many existing methods require repeated generations or separately trained components, and their scalar estimates do not reveal where uncertainty arises or how it evolves during reasoning. Recent work has also shown that generation length can be strongly associated with uncertainty estimates and correctness, raising the question of how much of an estimator’s predictive power comes from uncertainty-specific information rather than output length alone. Mechanistic interpretability offers a way to address these limitations by connecting human-interpretable concepts to intermediate model states. Building on this capability, we introduce the U-Space, a low-dimensional subspace that makes a model’s evolving uncertainty measurable and interpretable. We identify semantic anchors for doubt and certainty, map their unembedding directions back into the residual space, and combine their contrasts into an orthogonal basis. The U-Lens projects each token state onto these basis vectors, yielding an interpretable token-level uncertainty map that can be inspected directly or aggregated into a scalar uncertainty score. Our approach requires no correctness labels, repeated generations, or training. Across reasoning benchmarks, its confidence score outperforms established baselines under both standard and length-controlled evaluation and transfers more reliably than supervised estimators. Code: https://github.com/s2labres/U-Space.

[92] CARE: Certifying Acceleration for Vision-Language-Action Inference cs.CL | cs.LGPDF

Rui Liu, Tong Zheng, Jindong Gu, Zhipeng Wang

TL;DR: CARE用有限样本配对rollout为VLA加速方案做风险认证：在相同初态下比较参考策略成功而加速策略失败的事件，用校准集保证失败风险不超过用户预算，再选最快合格方案，若无合格项则退回参考策略。OpenVLA-OFT四个LIBERO套件上认证9.0–10.8倍加速，同时以95%置信保留至少85.8%参考策略成功episode。

Details

Motivation: 动作分块、视觉token剪枝等方法可加速VLA，但可能丢失关键信息使原本能成功的闭环任务失败，平均成功率会掩盖此风险。失败只能在完整episode中观察，因为动作偏差会随闭环执行累积。

Result: CARE将加速诱发失败定义为同一初态配对rollout中参考策略成功而加速策略失败。它在校准集进行配对rollout，对该风险给出有限样本保证，并在满足用户风险预算的候选中部署最快者；无合格候选则回退参考策略。方法只依赖最终结果和实测计算量，适用于多种加速机制；顺序检验与失败触发参考rollout控制认证成本。OpenVLA-OFT四个LIBERO套件上认证9.0–10.8倍加速，以95%置信保证至少保留85.8%的参考策略成功episode。无保证选择器在严格预算下最多75%试验超预算，CARE始终符合，顺序版比穷举少用78.9% rollout。还迁移到π0.5 flow步数减少以及Crafter上的Qwen3.5-9B、Llama-3.1-8B。

Insight: 部署加速应控制“原策略能成功但加速后失败”的条件风险，而不只比较平均准确率和速度；配对rollout允许有限样本认证且可跨加速方式使用。保证值依赖校准集和用户预算，若无方案过关系统会安全回退。

Abstract: While vision-language-action (VLA) models have advanced rapidly, running them at every control step remains expensive. Prior work accelerates VLA inference using techniques like action chunking and visual-token pruning, typically evaluating based on latency and average task success. However, acceleration may discard information and break tasks the original policy would solve, a risk hidden by average metrics. Measuring these failures is challenging because action deviations compound over closed-loop trajectories, meaning task failure is only observable across full episodes. We therefore define an acceleration-induced failure via paired rollouts from identical initial conditions, tracking when the reference succeeds but the accelerated policy fails. To manage this, we introduce CARE, an approach for certified accelerator selection. CARE uses paired rollouts on a calibration set to provide finite-sample guarantees that acceleration-induced failure risk stays below a user-specified budget. It deploys the fastest certified candidate, falling back to the reference if none qualify. By relying only on terminal outcomes and measured compute, CARE applies unchanged across diverse acceleration mechanisms, while sequential testing and failure-triggered reference rollouts keep certification affordable. On four LIBERO suites with OpenVLA-OFT, CARE certifies $9.0$–$10.8\times$ speedups while guaranteeing (at $95%$ confidence) that at least $85.8%$ of reference-solved episodes are preserved. Under tight budgets, selectors without guarantees exceed the budget in up to $75%$ of trials, whereas CARE stays within budget and its sequential form uses $78.9%$ fewer rollouts than exhaustive evaluation. CARE further generalizes to flow-step reduction for $π_{0.5}$, and to Qwen3.5-9B and Llama-3.1-8B agents in Crafter.

[93] sk-bench: A Native-First Benchmark for Evaluating Large Language Models in Slovak cs.CL | cs.AIPDF

Marek Šuppa, Ivan Vykopal, Andrej Ridzik, Kristián Sopkovič, Natália Kňažeková

TL;DR: sk-bench是面向斯洛伐克语的原生优先LLM基准，含30个数据集、33个计分任务、10类技能；评估55个开放/闭源模型。最佳开放模型比专有API低12.6点，思维推理为9B及以上模型带来8.5–12.5点提升；继续斯洛伐克语预训练却使Qwen3-14B总分下降13.9点，小型指令集可恢复损失的四分之三。

Details

Motivation: 多语言LLM基准经常遗漏斯洛伐克语，或只用机器翻译覆盖；斯洛伐克语是形态丰富的西斯拉夫语，约有500万使用者，需要原生数据才能评估语言能力和翻译效应。

Result: sk-bench含30个数据集、33种计分任务、覆盖十类能力；11种资源为新引入或首次整理用于生成式LLM评测，包括斯洛伐克语适配的IFEval-SK和本土语法/形态资源Chiby、SKJ1。统一harness评估55个开放/闭源模型。最佳开放模型比专有API落后12.6分；原生与翻译封闭式数据的模型排序高度相似（ρ≥0.98），但翻译较难区分顶尖模型；人工编写与LLM生成QA的排序相关性仅ρ=.72。Qwen3-14B继续斯洛伐克语预训练使总分降13.9分，小型指令集恢复其中四分之三。9B及以上模型测试时推理提高8.5–12.5分。

Insight: 低资源语言适配可能因继续预训练遗忘原有能力，需规划指令修复；翻译数据能保持粗略排名，却可能压缩顶尖模型差异，本土数据在形态和QA能力上仍重要。基准提出原生数据、修复、测试时推理和谨慎使用目标语言提示四点设计经验。

Abstract: Multilingual LLM benchmarks omit Slovak, a morphologically rich West Slavic language of five million speakers, or cover it only by machine translation. We present sk-bench, a native-first Slovak benchmark with 30 datasets (33 scored task variants) across ten skill categories. Eleven resources are introduced or first packaged for generative-LLM evaluation, including IFEval-SK with Slovak-adapted instruction checkers and native Chiby/SKJ1 resources for Slovak grammar and morphology. We evaluate 55 open- and closed-weights models under one harness. The best open model trails proprietary APIs by 12.6 points. Model rankings are similar for native and translated closed-form data ($ρ\geq0.98$), though translation separates the strongest models less well. By contrast, human-authored and LLM-generated QA questions rank models differently ($ρ=0.72$). For Qwen3-14B, continued Slovak pretraining lowers the overall score by 13.9 points. A small instruction set restores three quarters of that loss. Test-time reasoning improves scores by 8.5 to 12.5 points for models of 9B and above. Together, these findings suggest four design lessons for other under-resourced languages: use native data where translation fails, plan instruction repair after language adaptation, enable test-time reasoning before scaling up, and avoid overinvesting in target-language prompts. We release the data and code at https://github.com/slovak-nlp/sk-bench

[94] OnlineQAT: On-Policy Distillation for Ultra-Low-Bit Large Language Models cs.CL | cs.AI | cs.LGPDF

Wenjun Wang, Heng Li, Yanggan Gu, Hongxia Yang

TL;DR: OnlineQAT先以分块量化感知训练获得可用低比特初始化，再对学生自身生成响应做on-policy蒸馏，让冻结全精度教师在学生访问的前缀上提供反向KL信号。Qwen3-1.7B上W3A16平均分57.28、W2A16为32.52，分别比ReasoningQAT高2.90和0.44分。

Details

Motivation: QAT能恢复LLM压缩到4 bit以下损失的准确率，但常用恢复训练基于固定补全或教师回答，而部署量化模型会条件化于自身生成的前缀。量化误差可能把模型带到离线恢复数据未覆盖的状态。

Result: OnlineQAT分两阶段：先做分块QAT得到可用低比特初始化，再在学生自己生成的响应上进行on-policy distillation；每个访问前缀处由冻结全精度教师提供采样式反向KL信号。Qwen3-1.7B上，与比较的量化方法相比平均成绩最好：W3A16为57.28，W2A16为32.52，较ReasoningQAT分别高2.90和0.44分。结果提示学生实际访问状态能提供固定补全训练以外的恢复监督，尤其在3-bit量化时有用。

Insight: 低比特误差会改变后续状态分布，因此在学生自身轨迹上蒸馏比只匹配固定教师补全更贴近部署；3-bit设置收益更明显。摘要未列各任务精度和蒸馏成本。

Abstract: Quantization-aware training (QAT) can recover much of the accuracy lost when large language models are compressed below four bits. Existing re- covery stages, however, are commonly optimized on fixed completions or teacher-generated answers, whereas the deployed quantized model condi- tions on prefixes generated by itself. Quantization errors can therefore move the model into states that are absent from offline recovery data. We introduce OnlineQAT, a two-stage framework that first obtains a usable low-bit initialization through block-wise QAT and then performs on-policy distillation (OPD) on student-generated responses. At each visited pre- fix, a frozen full-precision teacher provides a sampled reverse-KL training signal. On Qwen3-1.7B, OnlineQAT obtains the best average among the compared quantized methods: 57.28 at W3A16 and 32.52 at W2A16, im- proving over ReasoningQAT by 2.90 and 0.44 points, respectively. The results suggest that student-visited states provide a useful recovery signal beyond fixed-completion training, particularly at three bits.

[95] Arctic Questions, Missing Answers: A Dataset and Benchmark for LLM Abstention in Arctic Science cs.CL | cs.AIPDF

Benjamin Wilcox, Dawei Gao, Pradeeban Kathiravelu, Douglas Causey, Kewei Sha

TL;DR: ArcticQA从北极科学原始研究构建194道问题，并自动核对答案支持与干扰项矛盾；ArcticAbstain配对比较正确答案存在和被干扰项替换后的缺答条件。8个模型、三次重复共9,312条响应中，有答案时弃答率为0–63%，移除正确选项只让平均弃答率增加5.05个百分点。

Details

Motivation: 科学多选题若选项均无效，LLM应弃答；但单看弃答频率高不能证明模型会根据答案是否存在来调整行为。需要成对评测回答可用和不可用条件。

Result: ArcticQA包含194道源自北极科学原始研究的问题，自动检查答案是否受来源证据支持及干扰项是否与来源矛盾。ArcticAbstain设置配对基准：一项含正确答案，另一项将其替换成干扰项，两种条件都提供显式弃答选项。8个Gemini、Claude和ChatGPT系列模型在高推理强度下每条件测试三次，总计9,312条记录。有答案时弃答率从0%到63%不等；移除正确答案后，弃答率平均只增加5.05个百分点，显示各模型基线差异大且对答案可用性响应有限。

Insight: 科学评测需要同时考察有答案时是否作答、无答案时是否敏感地弃答，而不是只奖励较高弃答率。平均增加5.05点相较模型间0–63%基线差异不大，说明弃答识别仍需改进。

Abstract: Large language models (LLMs) should abstain from scientific multiple-choice questions when no option is valid, but frequent abstention alone does not demonstrate sensitivity to answer availability. We introduce ArcticQA, a dataset of 194 questions derived from primary Arctic research, with automated checks of answer support and distractor contradiction against source evidence. We further develop ArcticAbstain, a paired benchmark comparing answer-present and answer-absent conditions, with the correct answer replaced by a distractor in the latter and an explicit abstention option in both. We evaluate eight models from the Gemini, Claude, and ChatGPT families at high reasoning effort, with three trials per condition, yielding 9,312 recorded responses. Answer-present abstention rates range from 0.0% to 63.0%, whereas replacing the correct answer increases abstention by 5.05 percentage points on average. These findings highlight substantial baseline differences and the need to evaluate abstention frequency and responsiveness jointly. The dataset and benchmark are available at https://github.com/BenWilcox8/arctic-qa.

[96] Goldsmith: Gold-Loss-Guided Definition Optimization with an Agentic Annotation Harness cs.CLPDF

Yihan Li, Hanyi Zhang, Xiaoxi Jiang, Man Guo

TL;DR: Goldsmith将小型专家金标集转成可复用的结构化标注定义，并将定义本身作为可优化文本对象：在同一金标集上执行并计算结构化损失，LLM编辑器把高损失错误转成文本梯度修订，仅接受损失下降的版本。与直接重写、OPRO、APE、PromptBreeder比较更好，且支持多类后续标注。

Details

Motivation: 许多标注项目启动时专家指南尚未稳定、标注数量不足以训练专用模型。需要从少量代表任务边界的专家标注中学习可复用规则，并让后续标注流程保留检索、路由和人工复核。

Result: Goldsmith用少量专家校准样例生成结构化标注定义，并把定义当作可训练文本对象。对候选定义在同一金标集上运行并计算可执行结构化损失；输出schema、格式、检索、修复、评审和人工复核留在外部harness。LLM编辑器将高损失错误变为文本梯度式修订，仅当测量损失下降时才接受。在匹配协议的prompt优化比较中，Goldsmith优于直接重写、OPRO、APE和PromptBreeder。结合检索、分数路由及人工复核后，改进也迁移到类型化跨度、成对关系和固定触发事件论元任务；摘要未给具体分数。

Insight: 先用结构化金标损失优化标注定义，再在外部流水线执行，有利于规则版本可测、可控且可复用；仅接受实测损失下降可避免主观提示改写。跨三类标注任务验证其下游价值，但摘要缺少标注成本和错误率数字。

Abstract: Many annotation projects begin before experts have a stable guideline or enough labels to train a task-specific model. We present Goldsmith, an agentic pipeline that turns a small gold set—expert-annotated calibration examples representing the intended task boundaries—into a reusable structured annotation definition. Goldsmith treats this definition as a trainable textual object. Candidate definitions are run on the same gold examples and scored with an executable structured loss, while the output schema, formatting, retrieval, repair, judging, and human review remain in an external harness. A large language model (LLM) editor converts the highest-loss failures into textual-gradient revisions, which are accepted only when the measured loss decreases. In prompt-optimization comparisons, Goldsmith improves over direct rewriting, OPRO, APE, and PromptBreeder under matched evaluation protocols. The resulting definition also improves downstream annotation when combined with retrieval, score-based routing, and human review across typed span, pair-level relation, and fixed-trigger event-argument tasks. These results show that scarce expert supervision can support both task-definition learning and scalable annotation.

[97] Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning cs.CL | cs.AIPDF

HyeonSeok Lim, SeungWoo Song, Inho Won, Hoyun Song, Jihyo Kim

TL;DR: LASEF研究数学推理中思维骨架语言的选择，跨模型规模、语言与基准发现英语骨架平均略有正效应，尤其小模型和低资源语言，但经多重校正后显著收益很少，英语并非总最优。效应可分为方向一致、依评测/基准变化和非对称负面三类。

Details

Motivation: 思维骨架提示是一种免训练的推理结构化方法，但既有研究大多默认英语提示。多语数学推理需要判断骨架应使用英语、目标语言还是其他语言，以及收益能否跨模型和基准迁移。

Result: Language-Aware Skeleton Exploration Framework（LASEF）系统评估不同骨架语言。跨数学基准、模型规模和语言，英语骨架平均呈小幅正向倾向，在较小模型和低资源语言上最明显；但多重校正后只有少数语言层面的增益仍显著，且英语并非普遍最好。结合贪心解码、多次rollout、翻译消融和跨基准验证，研究发现骨架语言效应有三类：方向一致、依评估/基准而定，以及非对称负效应。差异不能完全由生成质量解释。

Insight: 骨架语言是与模型规模、目标语言、基准及解码设置交互的设计变量，而非固定用英语即可。多层评测和多重校正很重要；平均小幅增益不意味着每个语言都受益。

Abstract: Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math benchmarks, model scales, and languages, we show that English skeletons yield a small positive tendency on average, most visible for smaller models and low-resource languages. However, few language-level gains remain significant after correction, and English is not universally optimal. Combining greedy decoding, multi-rollout evaluation, translation ablation, and cross-benchmark validation, we further find three patterns of skeleton-language effects: directionally consistent, evaluation- and benchmark-dependent, and asymmetric negative. These effects cannot be fully explained by generation quality alone. Overall, skeleton language is a context-dependent design variable that requires multi-level exploration. All resources are released at https://github.com/lhsstn/LASEF.

[98] On-Policy Distillation Teaches New Skills but Not New Knowledge cs.CLPDF

Yixuan Tang, Yi Yang

TL;DR: 该受控研究区分on-policy蒸馏对多步组合技能和事实知识的迁移：四个模型、三个家族中，reverse-KL OPD能稳定迁移到未见推理结构的组合技能，却几乎不增加事实知识。改用forward KL恢复事实迁移，学生自身rollout则主要改善多步推理执行；真实事实QA和竞赛数学上也观察到类似不对称。

Details

Motivation: OPD可增强LLM推理，但学生究竟获得新事实知识，还是学会组合已有知识完成多步推理，尚不清楚。需要控制教师提供额外事实、组合技能或两者，并单独测量学生初始能力。

Result: 作者构造可控合成框架，独立测量学生起始能力，并分别控制教师额外事实知识、组合推理技能或二者。四个模型、三个家族中，reverse-KL OPD可靠地把组合技能迁移至未见推理结构，却仅传递极少事实知识。拆解蒸馏配方发现，将reverse KL换为forward KL可恢复事实迁移；学生生成rollout则专门改善多步推理执行。近期事实QA和竞赛数学实验也观察到类似差异：reverse-KL OPD带来显著推理提升，却没有扩展事实记忆。

Insight: on-policy蒸馏主要教模型如何组织和组合现有参数知识，而不自动增加新的事实知识；事实和组合技能的迁移对KL方向及学生rollout信号敏感。评估应将知识回忆与结构泛化分开测量。

Abstract: On-policy distillation (OPD) strengthens language-model reasoning, yet whether students acquire new factual knowledge or compositional skill for multi-step reasoning remains unknown. We separate these capabilities using a controlled synthetic framework that measures the student’s initial capabilities and independently controls the teacher’s additional facts, compositional skill, or both. Across four models from three families, reverse-KL OPD reliably transfers compositional skill across unseen reasoning structures, but transfers minimal factual knowledge. Decoupling the distillation recipe reveals the source of this asymmetry: replacing reverse KL with forward KL restores factual transfer, whereas student rollouts specifically improve the execution of multi-step reasoning. Experiments on recent factual QA and competition mathematics show a similar asymmetry under reverse-KL OPD, yielding notable reasoning gains without factual memory expansion. Together, these results demonstrate that on-policy distillation does not expand a model’s parametric knowledge, but instead teaches it to organize and compose the knowledge it already possesses.

[99] SAPD: Step-Aligned Privileged Distillation cs.CLPDF

Tianle Wang, Jiayu Liu, Ruizhi Zhao, Ning Miao

TL;DR: SAPD是一种无需rollout的自蒸馏后训练方法，把固定示范转为逐推理步骤对齐的分布监督，利用参考解的已知进程为当前推理转移提供特权指导。数学基准上平均优于SFT和标签平滑、接近on-policy RL/自蒸馏，代码域外表现基本保留，训练循环约快2倍。

Details

Motivation: On-policy后训练可从模型自身轨迹学习，但rollout生成成本高。固定示范是否能支持竞争力强的off-policy训练，取决于监督能否提供续写偏好，并把指导与当前正在学习的推理决策对齐。

Result: Step-Aligned Privileged Distillation将固定示范构造成步骤对齐的分布监督；核心是根据参考解的进度，把每个推理转移关联到有针对性的特权信息，而非把完整解当作未区分上下文。数学推理基准上，SAPD平均超过监督微调和标签平滑，并与on-policy强化学习、自蒸馏保持竞争力。分析支持上下文相关分布指导及逐步对齐均有贡献。它还大体保持域外代码表现，并相较on-policy基线实现约2倍训练循环加速。

Insight: 固定示范若结合当前推理步骤提供结构化概率监督，可弥补不生成昂贵rollout的缺点；特权指导要按推理进度对齐，而不应作为整段上下文一视同仁。摘要未给具体数学分数或模型规模。

Abstract: On-policy post-training can improve large language models by learning from their own trajectories, but requires costly rollout generation. We ask whether fixed demonstrations can support competitive off-policy learning through better supervision. Our premise is that their usefulness depends not only on the training trajectories, but also on whether supervision provides informative preferences among continuations and connects this guidance to the reasoning decision being learned. We introduce Step-Aligned Privileged Distillation (SAPD), a rollout-free self-distillation method that turns demonstrations into step-aligned distributional supervision. Its key insight is to use the known progression of a reference solution to associate each reasoning transition with targeted privileged guidance, rather than treating the solution as undifferentiated context. On mathematical reasoning benchmarks, SAPD outperforms supervised fine-tuning and label smoothing on average while remaining competitive with on-policy reinforcement learning and self-distillation. Analyses support both the value of context-dependent distributional guidance and the benefit of aligning privileged information with the current step. SAPD also largely preserves out-of-domain coding performance and achieves approximately 2x training-loop speedups over the on-policy baselines. These findings suggest that carefully constructed supervision can make fully off-policy post-training a competitive and computationally efficient alternative. Our code is available at https://github.com/Miaow-Lab/SAPD.

[100] Alice: A Large-Scale German Benchmark for Rubric-Based Multi-Dimensional Automatic Short Answer Scoring cs.CLPDF

Zhifan Sun, Sebastian Gombert, Jannik Lossjew, Tobias Wyrwich, Berrit Katharina Czinczel

TL;DR: Alice是基于教学量表的德语短答自动评分数据集，涵盖学习表现（LP）、知识元素（KE）和技能（SK）三个子任务。基准比较从编码器到轻量LLM的模型、零样本提示和分类器；LLM零样本尤其难以评估知识与技能，量表文本对KE/SK通常有帮助，对LP则提升较小且因设置而变。

Details

Motivation: 短答自动评分是教育NLP的重要任务，但公开基准稀缺，既有数据多评估学生是否直接答对，而较少评估其掌握的知识元素（如热能）或能力（如推理、论证）。

Result: Alice是大型、基于量表且教学对齐的德语短答评分数据集，包含学习表现Alice-LP、知识元素Alice-KE和技能Alice-SK三个子任务。作者将量表评分表述为量表检索任务，比较从仅编码器模型到轻量LLM，并评估LLM零样本提示和标准分类基线。实验显示LLM零样本尤其难以评分知识元素与技能；提供量表文本通常有帮助，特别是KE和SK，而LP相较只提供样例答案的提升更有限，并依模型和输入格式而变化。摘要未提供数据集样本数或具体分数。

Insight: 教育评分不应只判断答案整体对错，还需区分知识掌握和技能表现；量表文本能为细粒度评分提供标准，但不同子任务收益不同。摘要未给Alice规模和评测数字，因此不补写数量。

Abstract: Automatic Short Answer Scoring (ASAS) is central to NLP for Education. However, openly available benchmarks remain scarce, and existing datasets largely address how well students answer a question directly rather than how well they master underlying concepts (knowledge elements) such as thermal energy or epistemic activities (skills) such as reasoning or claim. To address this gap, we introduce Alice, a large-scale, rubric-based German ASAS dataset that is pedagogically aligned and comprises three subtasks: (i) learning performance (Alice-LP), (ii) knowledge elements (Alice-KE), and (iii) skills (Alice-SK). We further formulate rubric-based ASAS as a rubric-retrieval task and benchmark the dataset with a range of language models, from encoder-only models to lightweight LLMs. We also benchmark the dataset with zero-shot prompting via LLMs and a standard classification baseline. The experiments show that LLMs, in particular, struggle to score knowledge elements and skills in the zero-shot setting. They also indicate that rubric text is often useful, especially for Alice-KE and Alice-SK, while on Alice-LP gains over sample-solution-focused inputs are more modest and vary by model and input format.

[101] InsClaimBench: Benchmarking Insurance Claim Adjudication Across the Decision Chain cs.CLPDF

Linqi Zhang, Chong Qi, Yan Cheng, Wanqing Cao, Yu Liu

TL;DR: InsClaimBench是覆盖车险、财产险和健康险决策链的端到端理赔判定基准，含3,780个案件、375个案例族和86,656条原子规则判断。六个LLM的赔付决定准确率74.23%–80.19%，但决定与金额联合准确率降至47.54%–73.15%；原子规则高准确也不保证规则向量或最终结果正确。

Details

Motivation: 保险理赔需在结构化流程中连接案件证据、保险规则、中间判断和赔款计算。只看最终单项或局部规则准确率，可能掩盖错误在决策链中的传播及案件级不一致。

Result: InsClaimBench基于真实理赔材料和结构化保险规则，涵盖车险、财产险、健康险共3,780案、375个案例族、86,656条原子规则判断；从原子规则到模块判定、赔付结论和金额逐层评估，并加入受控事实变化检查是否跨层正确传播。六个LLM的赔付决定准确率74.23%–80.19%，联合决定—金额准确率47.54%–73.15%。原子规则准确率最高95.48%，但规则向量完全匹配最高仅36.90%；最常见的模块错误也不一定最能导致最终失败。事实变化下模块更新不如规则更新可靠，局部判断正确仍可能产生错误赔付，而最终金额正确也可能掩盖中间错误。

Insight: 理赔可信度取决于规则判断、模块组合与结果金额之间的一致传播，不能只看单层准确率；逐层错误分析和事实变化测试可发现局部正确、整体错误及结果碰巧正确等问题。

Abstract: Recent advances in reasoning-oriented large language models (LLMs) have motivated increasing evaluation of their ability to perform professional decision tasks. Insurance claim adjudication is one such task, requiring models to connect case evidence, insurance rules, intermediate judgments, and payout calculations across a structured decision process. We introduce InsClaimBench, an end-to-end benchmark for evaluating insurance claim adjudication across the decision chain. Grounded in real claim materials and structured insurance rules, InsClaimBench contains 3,780 cases in 375 case families across auto, property, and health insurance, comprising 86,656 atomic rule judgments. It evaluates each claim from atomic rules through adjudication modules to payout decisions and amounts, with controlled factual variants testing whether required changes are correctly propagated across levels. Evaluation of six LLMs reveals a progressive loss of reliability along the decision chain. Payout-decision accuracy ranges from 74.23–80.19%, while joint decision–amount accuracy drops to 47.54–73.15%. Strong local performance also fails to ensure case-level correctness: atomic-rule accuracy reaches 95.48%, whereas rule-vector exact match peaks at only 36.90%, and the most frequent module errors are not necessarily those most associated with final-decision failure. Under factual changes, these inconsistencies further become propagation failures: module updates are less reliable than rule updates, correct local judgments can still yield incorrect payouts, and correct payouts can conceal intermediate errors. These results show that reliable claim adjudication requires consistent composition and propagation across the decision chain.

[102] From Pareto to Preference: Personalized Test-Time Scaling via Amortized Agentic Policy Discovery cs.CL | cs.AIPDF

Xinglin Wang, Zishen Liu, Tong Zheng, Shaoxiong Feng, Peiwen Yuan

TL;DR: PersonTTS把个性化测试时扩展定义为同时满足用户准确率、时延和推理成本要求，并用摊销智能体策略发现重用相近用户配置的搜索经验，仍对每个候选进行目标画像评估。AIME和HMMT实验显示对未见用户画像的联合约束满足率优于强基线，跨用户复用减少策略发现时间和成本。

Details

Motivation: 测试时扩展可通过增加推理计算提升准确率，但既有方法多只优化准确率—成本或准确率—时延之一。真实用户可能同时指定多种资源要求，不同要求可能偏好不同控制策略；为每个画像重新搜索又开销高。

Result: PersonTTS将个性化测试时扩展建模为发现可执行控制器，使用户指定的准确率、时延和推理成本等多维约束的联合满足率最大。框架从既有搜索经验中摊销重用：用要求匹配的控制器初始化和从来源中蒸馏的程序性指导，但每个候选仍针对目标画像评估。AIME和HMMT上，对未见用户画像的联合约束满足显著优于强TTS基线；同等候选评估预算下，跨用户经验复用提升策略质量，同时显著降低发现智能体时间和成本。摘要未给具体数字。

Insight: 个性化TTS应直接优化多个用户约束的联合满足，而非只选择某一资源维度上的Pareto点；跨画像经验复用可降低重复搜索，同时保留目标画像验证。具体满足率和搜索成本降幅未在摘要列出。

Abstract: Test-time scaling (TTS) improves the reasoning capabilities of large language models by allocating additional inference computation. Existing approaches to improving TTS efficiency largely optimize accuracy against one resource dimension at a time, advancing either the accuracy–cost or accuracy–latency Pareto frontier. Yet user requirements are multidimensional: users may specify accuracy, latency, and inference-cost requirements jointly, and different requirements can favor different controllers. We formulate Personalized Test-Time Scaling as discovering executable controllers that maximize the joint satisfaction rate of user-specific requirements. To reduce the overhead of repeated policy discovery for new user profiles, we propose PersonTTS, an amortized agentic policy-discovery framework that reuses prior search experience through requirement-matched controller initialization and source-distilled procedural guidance, while retaining target-profile evaluation for every candidate. Experiments on AIME and HMMT show that PersonTTS substantially outperforms strong TTS baselines in joint requirement satisfaction on unseen user profiles and held-out problems. Under the same candidate-evaluation budget, cross-user experience reuse further improves policy quality while substantially reducing discovery-agent time and cost.

[103] Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMs cs.CLPDF

Seunghan Kim, Minyeong Choe, Hyunil Kim, Haehyun Cho

TL;DR: 本文在Llama 3.1 70B和Qwen 2.5 72B中识别跨语言多跳推理的Bridge Routing Heads（BRH）：五种语言的语言专属头集合几乎互斥，平均Jaccard仅0.017和0.057。消融通用BRH使两跳NLL恶化为随机头基线的39–89倍；放大这些头可无训练修复最多51.7%的跨语失败。

Details

Motivation: 多语LLM能跨语言回答相同多跳问题，但其内部是否共享推理电路缺少机制解释。理解跨语失败是否由语言特定路由头造成，可支持针对性诊断与推理修复。

Result: 作者通过三阶段流程在两个大型多语模型中识别Bridge Routing Heads。五种语言的语言专属BRH集合几乎完全互斥：Llama 3.1 70B平均Jaccard 0.017，Qwen 2.5 72B为0.057，说明电路具有语言特异性。消融通用BRH使两跳负对数似然增加到随机头基线的39–89倍，提供因果作用证据。对失败目标语言前向过程放大BRH，无需训练即可恢复最多51.7%的跨语失败。两模型均呈双电路模式但分配不同：Llama主要将链式推理集中在较大通用池，Qwen更依赖较大的语言专属头池。

Insight: 跨语多跳推理可能由通用与语言特定头共同支持，不同架构的头分配方式不同；激活层干预可修复部分失败而无需重新训练。51.7%为最多恢复比例，摘要未给所有语言/任务的平均恢复率。

Abstract: Multilingual LLMs answer the same multi-hop reasoning question across languages, but we lack a mechanistic account of whether they share an internal circuit. We identify Bridge Routing Heads (BRH) in two large multilingual LLMs through a three-stage pipeline. The resulting language-specific head sets exhibit near-complete mutual exclusivity across the five languages, with a mean Jaccard similarity of only 0.017 for Llama 3.1 70B and 0.057 for Qwen 2.5 72B, revealing language-idiosyncratic circuits. Ablating general BRH increases two-hop Negative Log-Likelihood (NLL) by 39-89x the random-head baseline, providing direct causal evidence of their role. Amplifying these heads in a failing target-language pass rescues up to 51.7% of cross-lingual failures, with no training. The two models share this dual-circuit pattern but allocate heads differently: Llama concentrates chaining in a large general pool, while Qwen leans on larger language-specific pools. Together these results show that activation-level intervention alone can recover correct answers from cross-lingual reasoning failures.

[104] SpikingVLA: Asynchronous Spiking Vision-Language-Action Models cs.CLPDF

Jingya Wang, Dehao Zhang, Shuai Wang, Malu Zhang, Yang Yang

TL;DR: SpikingVLA将预训练VLA通过ANN-to-SNN转换为低延迟脉冲模型，提出树突混合与自适应胞体发放的DIF神经元缓解通道激活离群值，并以异步执行重叠组件时间计算。导航任务中成功率和SPL较现有脉冲VLA分别提升11.9%和12.6%，首动作延迟降低11.2倍。

Details

Motivation: ANN转SNN可避免从零训练大规模脉冲网络的成本，适合作为节能VLA路径；但现有转换方法往往需很多时间步才能保持性能，导致实时部署延迟过高。

Result: SpikingVLA提出Dendritic Integrate-and-Fire（DIF）神经元，通过树突混合和自适应胞体发放缓解逐通道激活离群值，使ANN-to-SNN转换能在更少时间步下保持准确性。再设计异步执行机制，让VLA各组件的时间计算重叠，减少同步等待。实验显示其导航性能有竞争力且推理效率明显改善；相较现有脉冲VLA，成功率SR提高11.9%、路径加权成功SPL提高12.6%，首动作延迟降低11.2倍。

Insight: 低时延SNN转换既需在神经元层处理激活分布离群，也需在系统层异步重叠多组件计算。摘要支持导航任务结果，但未给能耗数字或硬件/时间步配置。

Abstract: ANN-to-SNN conversion offers a practical route toward energy-efficient spiking Vision-Language-Action (VLA) models by bypassing the substantial cost of training large-scale SNNs from scratch. However, existing methods often require many timesteps to maintain competitive performance, resulting in substantial inference latency for real-time VLA deployment. To address this challenge, we introduce SpikingVLA, an ANN-to-SNN conversion framework that enables accurate and low-latency spiking VLA inference. Specifically, we propose a Dendritic Integrate-and-Fire (DIF) neuron that alleviates channel-wise activation outliers through dendritic mixing and adaptive somatic firing, enabling accurate ANN-to-SNN conversion with fewer timesteps. Building on DIF neurons, we further introduce an asynchronous execution mechanism that overlaps temporal computation across VLA components, reducing synchronization overhead and latency. Extensive experiments demonstrate that SpikingVLA achieves competitive navigation performance with substantially improved inference efficiency. Compared with existing spiking VLA methods, SpikingVLA improves SR and SPL by 11.9% and 12.6%, respectively, while reducing first-action latency by 11.2$\times$. These results establish SpikingVLA as a practical framework for deploying pretrained VLA models with high-performance and low-latency spiking inference.

[105] Judging in Latent Space: Efficient Generative Reward Modeling via Semantics-Preserving Compression cs.CLPDF

Mingqing Yuan, Xiaobo Liang, Junwei Yang, Ziwei Chen, Zeren Zhang

TL;DR: LatentGRM将量表评审过程拆为语义片段、连续轨迹压缩与解释重建，以潜空间完成成对偏好判断而不生成评语。4B/8B尺度上聚合偏好准确率与显式SFT评审器竞争；四个领域的8.9–9.2倍轨迹压缩使vote@5评审总时延降低6.1–7.0倍。

Details

Motivation: 奖励建模要同时表示多个评估标准并进行推理，逐token语言化评语成本高。潜在推理有望用更紧凑连续状态承载评审计算，但需确保压缩后仍保留标准相关偏好信息。

Result: LatentGRM利用评分量表结构引导语义分块、压缩和重建，学习紧凑连续轨迹，以支持不生成文字评语的自主成对判断；单独解释器可从轨迹恢复评审文本，便于离线检查压缩保留内容。在训练数据和骨干匹配时，4B及8B模型的总体偏好准确率与显式监督微调评审器有竞争力。四个基准领域中，8B模型将评审轨迹压缩8.9–9.2倍，vote@5总评审推理时间降低6.1–7.0倍。受控量表干预显示，依赖具体标准的偏好信息由潜序列承载。

Insight: 量表结构可为潜表示提供语义压缩锚点，使评审模型减少解释文本生成而保留标准相关判断；独立解释器提供压缩内容审计入口。准确率为竞争力水平而非明确超过SFT，速度收益在vote@5设置下测得。

Abstract: Reward modeling often requires jointly representing and reasoning over multiple evaluation criteria, yet verbalizing this process token by token can incur substantial inference cost. Recent work on latent reasoning suggests that continuous states may support this computation more compactly. We introduce LatentGRM, a latent evaluation framework built on semantic chunking, compression, and reconstruction. By using the structure of rubric-guided evaluations to guide compression, LatentGRM learns compact continuous trajectories that support autonomous pairwise judgments without generating textual assessments. A separate interpreter reconstructs evaluation text from these trajectories, providing an offline view of the information retained under compression. Under matched training data and backbones, LatentGRM achieves competitive aggregate preference accuracy relative to explicit Supervised Fine-Tuning (SFT) judges at both 4B and 8B scales. Across four benchmark domains, LatentGRM-8B compresses evaluation trajectories by 8.9–9.2x and reduces total judge inference time by 6.1–7.0x at vote@5. Controlled rubric interventions show that criterion-dependent preference information is carried through the latent sequence. Together, these results demonstrate that continuous latent evaluation can substantially reduce inference cost while preserving competitive judgment quality.

[106] MIRROR: From Imitation to Internalization in LLM Personalization cs.CL | cs.AIPDF

Huayi Lai, Jicheng Yang, Min Yi, Chong Meng

TL;DR: MIRROR把个性化从模仿参考文字转向内化用户偏好：沿模型自身生成轨迹，将其下一token分布与参考条件下的自身分布对齐；MIRROR-F再选择性监督信息量高的参考token。三个个性化生成基准、两种模型规模上总体表现领先，文本质量更好，并比SFT基线更少遗忘未见个性化任务。

Details

Motivation: LLM个性化需求正从风格模仿转向内容质量。现有微调常直接模仿参考文本，可能只复现措辞，不能将用户偏好内化为模型自身生成决策。

Result: MIRROR（Meta-personalization by Internalizing Reference-Revealed On-policy Reflections）以参考条件下模型自身生成分布为教师，在模型自身轨迹上进行on-policy自蒸馏，学习用户偏好而不模仿参考措辞。MIRROR-F插件加入对信息量较高参考token的选择性监督，加强内容生成同时保留用户表达风格。三个个性化生成基准、两种模型规模以及参考/LLM评估显示，MIRROR和MIRROR-F总体个性化表现领先、文本质量更高；在三个未见个性化生成任务上，比SFT基线更少灾难性遗忘。收益跨模型规模和应用场景一致，但摘要没有给出具体分数。

Insight: 个性化应沿模型实际生成轨迹吸收参考揭示的偏好，而非逐token复刻参考表述；选择性强调信息性token可兼顾内容与个性表达。摘要报告多基准优势，但没有量化基线差值。

Abstract: The demand for personalized LLMs is shifting from style imitation toward content quality. We investigate whether self-distillation can bridge this gap in existing fine-tuning paradigm. To address this limitation, we introduce MIRROR(Meta- personalization by Internalizing Reference-Revealed On-policy Reflections), a novel self-distillation framework that shifts LLM personalization from imitation toward preference internalization. First, we replace reference-token imitation with reference-revealed on-policy self-distillation, aligning the model’s next-token distributions along its own generation trajectories with those of its reference-conditioned self, thereby internalizing user preferences rather than reproducing reference wording.Second, we introduce MIRROR-F, a focal plug-in that augments on-policy distributional alignment with selective supervision over informative reference tokens, thereby strengthening content generation while preserving user-specific expression. Across three personalized generation benchmarks, two model scales, and complementary reference-based and LLM-based evaluations, MIRROR and MIRROR-F achieve leading overall personalization performance and superior text quality, while exhibiting less catastrophic forgetting than SFT-based baselines on three unseen personalized generation tasks. The gains are consistent across model scales and application scenarios, translating to improved performance in LLM personalization tasks.

[107] Training Advisors for LLM Agents from Task Outcomes cs.CL | cs.AI | cs.LGPDF

Sergei Polezhaev, Barys Liskavets, Ori Press, Alexander Golubev

TL;DR: Caddie用最终任务成败而非步骤标签训练LLM评论器，在智能体执行中提供自然语言分析和建议；冻结基础模型，仅以强化学习优化评论器。Qwen3-4B评论器可迁移到四个不同规模/架构基础模型，在MuSiQue上使Qwen3-4B成功率提高超过25个百分点，也改善τ³和DeepDive等域外交互任务。

Details

Motivation: LLM智能体交替推理、调用工具并观察环境，过程中的自然语言反馈可帮助修正决策；但既有评论器依赖逐步标签或参考批评，标注成本高且难匹配最终任务效用。

Result: Caddie训练评论器在智能体执行任务时生成自然语言分析和建议，依据收到反馈后智能体最终是否成功进行强化学习，不需步骤级标签或参考评论。基础模型保持冻结。仅在单一基础模型的多跳问答上训练Qwen3-4B评论器后，成功率可推广到四种不同规模和架构的基础模型，其中三个未参与评论器训练。MuSiQue上Qwen3-4B成功率提升超过25个百分点，超过无评论器的Kimi K3；同一评论器无需再训练也改善τ³和DeepDive域外交互基准。实验还显示智能体可在推理时决定何时请求评论器帮助。

Insight: 评论器可以用最终成败信号训练而不需专家步骤批注，并跨模型和任务领域迁移；让智能体按需求助避免每一步固定增加成本。摘要未报告评论调用频率和额外推理成本。

Abstract: Large language model agents tackle multi-step tasks by interleaving reasoning and tool calls with observations from the environment. Prior work has shown that natural-language feedback can help these agents revise their decisions during task execution. We introduce Caddie, a method for training critics to provide natural-language analysis and advice as agents work through a task. Unlike approaches that rely on step-level labels or reference critiques, Caddie learns from whether the agent ultimately succeeds after receiving the critic’s feedback. We optimize the critic through reinforcement learning while keeping the base model frozen. Trained on multi-hop question answering with a single base model, our Qwen3-4B critic improves success rates across four base models of different scales and architectures, including three not used during critic training. On the MuSiQue benchmark, the trained critic improves Qwen3-4B’s success rate by more than 25 percentage points, surpassing the performance of Kimi K3 without a critic. The same critic also yields gains on out-of-domain interactive benchmarks, including $τ^3$ and DeepDive, with no additional training. Our results show that agents can decide when to seek help from a critic at inference time and that outcome-based critic training can produce guidance that transfers across base models and task domains.

[108] The Long Road to the Same Answer: Cognitive Bias Under Escalating Reasoning Budgets in Large Language Models cs.CLPDF

Obada Kraishan

TL;DR: 该剂量反应研究用30个情境、六类决策偏差、四模型家族及12,350次API调用，考察延长推理是否减轻LLM偏差。推理模型并未显著比同族非推理模型少偏（Δ=.031，p=.157），偏差也不随实际推理token可靠下降；锚定是唯一沿人类方向的偏差，重述锚点提示有轻微改善趋势。

Details

Motivation: 推理模型因额外计算而被认为可能削弱快速直觉判断中的决策偏差，但长思考是否真的让模型更理性尚不清楚；请求的思考上限也不等于模型实际进行的推理量。

Result: 研究使用30个情境覆盖锚定、框架、损失厌恶、承诺升级、可得性和确认偏差，比较四个家族的推理模型及匹配非推理模型，设置0、1,024、4,096、8,192 token上限，共12,350次调用；以实际消耗推理token作为剂量。推理模型没有显著更少偏差，所有家族点估计反而偏高，但合并条目差异不可靠（Δ=+0.031，t(29)=1.45，p=.157）。偏差强度随实际推理量没有显著负斜率。六类中锚定是唯一沿人类方向（d=1.89）；其他五类有四类在七模型中均反向，框架效应可靠，可得性未出现。要求回答前重述锚点降低全部五个锚定题的偏差，但未达显著（p=.057）。

Insight: 测试时推理不是理性保证，长思考也未可靠降低偏差；偏差需逐类审计。该研究中具体提示（重述锚点）比增加思考量更有针对性，但其效应未达统计显著。

Abstract: Reasoning models allocate extra computation at inference time and present their answers as the product of deliberate thought. If this deliberation works the way dual-process accounts of human cognition suggest, longer thinking should weaken the classic decision biases that fast, intuitive judgment produces. Using 30 vignettes covering six biases (anchoring, framing, loss aversion, escalation of commitment, availability, confirmation) from an established benchmark, we run a dose-response study across four model families, pairing each reasoning model with a matched non-reasoning sibling and requesting thinking ceilings of 0, 1,024, 4,096, and 8,192 tokens, for 12,350 API calls. Because a requested ceiling is not the same as realized deliberation, we use the reasoning tokens each call consumed as the dose. First, reasoning models are not less biased than their siblings; the point estimate leans the other way in every family, but the item-level pooled contrast is not reliable (Delta = +0.031, t(29) = 1.45, p = .157). Second, bias magnitude does not reliably fall as realized deliberation grows: no slope is significantly negative, and where anything moves it is the signed score drifting further from the human direction. Third, anchoring is the only bias in the human direction (d = 1.89). Four of the other five lean the opposite way in all seven models; with five items per bias, that reversal is reliable for framing and directional for escalation of commitment, confirmation, and loss aversion, while availability is absent. A one-line instruction to restate the anchor before answering lowered anchoring on all five anchoring items, which no amount of additional thinking did, although the effect does not reach significance (p = .057). The results argue against treating test-time reasoning as a rationality guarantee and for auditing deployed models bias by bias.

[109] ExperienceIndex: Artifact-Grounded Memory cs.CL | cs.AI | cs.IR | cs.LGPDF

Peter Baile Chen, Geoffrey X. Yu, Xinming Liu, Samuel Madden, Dan Roth

TL;DR: ExperienceIndex为智能体增加基于文献/案例等共享语料工件的经验层，分别存单工件对既往任务的贡献和工件对之间的结构关系，再以轻量中间件检索引导新任务找到完整相关工件集。多语料和多搜索框架上回答质量最多提高11.0点、在线美元成本最多降低50.5%，并可跨任务迁移。

Details

Motivation: 知识密集任务常需基于同一批案例、论文等工件回答大量问题。人类会积累每个工件对任务的贡献和相互关系，现有智能体记忆却主要保存用户偏好、事实属性或抽象推理模式，缺少持久的工件级经验。

Result: ExperienceIndex从既往推理轨迹中保存两类经验：单工件经验总结其对旧任务的贡献，工件对经验记录推理中发现的结构关系。作为轻量中间件，经验检索引导智能体为新任务找到完整相关工件集。多种语料及不同搜索框架实验中，回答质量最高提高11.0点，在线美元成本最高降低50.5%。跨任务实验显示text-to-SQL积累经验可迁移到同一工件语料上的事实QA；教师—学生实验中，强模型积累的经验可让弱模型达到相近表现。

Insight: 长期记忆应绑定语料中的具体工件及其跨任务关系，而非只记录抽象解题思路；这样检索经验可减少重复搜索并提高答案质量。提升/降本为最高值，摘要未给各任务平均增益和存储开销。

Abstract: Knowledge-intensive tasks require answering many questions by reasoning about a shared corpus of artifacts (e.g., court cases, or scientific literature). As humans interact with these corpora, they naturally accumulate experiential knowledge about artifacts, enabling them to quickly identify the complete set of relevant artifacts for each new task. However, existing AI agents lack appropriate memory solutions to build or reuse such artifact-grounded experience, leading to lower answer quality and higher online cost. Existing memory solutions extract and reuse information from prior task-solving traces, but they primarily focus on user preferences, factual attributes, or abstract reasoning patterns rather than persistent artifact-specific knowledge. We introduce ExperienceIndex, a novel experience layer for AI agents that captures and reuses knowledge about artifacts based on prior reasoning traces. ExperienceIndex stores two complementary forms of experience: (i) single-artifact experiences that summarize an artifact’s contribution to prior tasks and (ii) artifact-pair experiences that encode structural relationships discovered during past reasoning. Integrated as lightweight middleware, ExperienceIndex uses an experience retrieval mechanism to guide agents toward the complete set of relevant artifacts for new tasks, improving both answer quality and efficiency. Across diverse corpora and agentic solutions with different search frameworks, ExperienceIndex delivers consistent gains, raising answer quality by up to 11.0 points and reducing online dollar cost by up to 50.5%. We further demonstrate two benefits: (i) cross-task generalization, where experiences accumulated from text-to-SQL tasks transfer to factoid QA tasks over the same artifact corpus, and (ii) teacher-student learning, where experiences from a stronger model enable a weaker model to reach comparable performance.

[110] InterView-C: A Synchronized Multimodal Corpus of VR Avatar-Mediated Survey Interviews cs.CLPDF

Patrick Schrottenbacher, Leon Hammerla, Lydia Kleine, Doris Stingl, Alexander Mehler

TL;DR: InterView-C是德语VR头像媒介调查访谈语料，包含27场访谈、54段录音，并同步语音、注视、头身动作、面部、手指行为。逐词时间标注和人工校对转录支持文本NLP与多模态分析；1,422句否定线索/作用域标注中1,398句双人标注，α分别为0.87和0.81。

Details

Motivation: 自动转录可能扭曲语言学相关信息，基于现有资源训练的下游模型也难迁移到转录口语。多模态交互研究需要可靠的词级文本接口，同时保留说话行为和非语言信号同步信息。

Result: InterView-C含27场全程在VR中进行、双方均以化身呈现的德国调查访谈。语料同步口语及注视、头部/身体运动、面部行为、手/手指跟踪。54段录音均有逐词时间戳和人工后编辑逐字转录、访谈题目时间、问卷答案，并为1,422句提供否定线索和作用域标注，其中1,398句双人标注，线索Krippendorff α=.87、作用域α=.81。九种开放权重ASR系统会不成比例地误识简短封闭回答和数字词；基于既有语料训练的否定模型在该转录访谈上表现更低且波动更大，而用InterView-C标注训练的模型更适配。

Insight: 人工校订、词级时序和行为同步将口语文本与丰富多模态信号连接起来，支持分析ASR误差和模型迁移；标注一致性也为否定检测等语言现象提供可靠监督。语料规模为27场访谈，跨人群泛化需进一步评估。

Abstract: We present InterView-C, a German multimodal corpus of 27 survey interviews conducted entirely in virtual reality, with both interlocutors represented by avatars. The corpus aligns spoken interaction with synchronized behavioral data, including gaze, head and body movement, facial behavior, hand and finger tracking. Its reference transcripts and linguistic annotations provide a reliable interface between this multimodal spoken interaction and predominantly text-based NLP methods. This interface is important because automatically transcribing speech can distort linguistically relevant information, while downstream models trained on existing resources may additionally face transfer challenges when applied to transcribed spoken data. InterView-C therefore provides word-timed and manually post-edited verbatim transcripts for all 54 recordings, interview-item timings, questionnaire responses and negation cue and scope annotations for 1,422 sentences, 1,398 of them doubly annotated (α=0.87 for cues; α=0.81 for scopes). We demonstrate both challenges empirically: nine open-weight ASR systems disproportionately misrecognize short closed answers and number words, while negation models trained on existing corpora show lower and highly variable performance on our transcribed interviews than a model trained on the InterView-C annotations. InterView-C thus enables linguistic analyses of spoken interaction while retaining their alignment with rich multimodal behavior.

[111] Beyond Outcome Rewards: Constructing and Assigning Retrieval Credit for Search Agents cs.CL | cs.AI | cs.LGPDF

Wenyu Huang, Xinyu Hou, Pavlos Vougiouklis, Ruofei Lai, Jeff Z. Pan

TL;DR: 该研究系统考察中间检索奖励如何改善搜索智能体RL，将中间检索步骤信号与最终结果奖励结合，并分析信号类型和信用分配位置的影响。多个基准、匹配训练条件下，整体搜索表现提高；摘要未报告具体增益。

Details

Motivation: 搜索智能体通过多轮检索处理复杂多跳问题，RLVR可用于后训练，但稀疏最终结果监督使信用分配困难、学习效率受限。中间检索过程可能提供更密集信号。

Result: 作者比较多种中间检索步骤奖励塑形与信用分配策略，研究如何利用中间监督优化搜索智能体RL。基于分析结果，提出将中间信号与最终结果奖励结合的训练框架，从多步搜索轨迹中学习。在多个基准和匹配训练条件下，聚合搜索智能体表现提高；实验还显示中间信号的选择及信用分配位置都会影响训练行为。摘要未列具体数值或基准名称。

Insight: 检索步骤监督是否有效，不仅取决于信号内容，也取决于奖励分配给哪个决策；搜索智能体训练需联合设计中间信用与最终任务奖励。摘要给出多基准定性改善，效果幅度尚未报告。

Abstract: Search agents enable Large Language Models (LLMs) to iteratively retrieve and use information for complex multi-hop questions. Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising approach for post-training such agents, but its reliance on sparse, outcome-based supervision can make credit assignment difficult and limit learning efficiency. In this paper, we systematically investigate how intermediate supervision can improve reinforcement learning for search agents. We study a range of reward-shaping and credit-assignment strategies that provide learning signals from intermediate retrieval steps. Building on these insights, we develop a training framework that combines intermediate signals with final outcome rewards to improve learning from multi-step search trajectories. Experiments across multiple benchmarks under matched training conditions demonstrate improvements in aggregate search-agent performance and show that both the choice of intermediate signal and where its credit is assigned affect training behaviour. These findings show that reward design and credit assignment are important design dimensions for training effective search agents.

[112] CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution cs.CLPDF

Jixuan Chen, Jiaxin Zhang, Qinyuan Ye, Yada Pruksachatkun, Haoxiang Zhang

TL;DR: CoTrace研究终端智能体模型与运行harness联合演化，提出按harness来源、运行时匹配和课程刷新管理轨迹，而非把harness搜索期间所有轨迹混成回放池。Qwen3.5-9B在Tmax promotion split上SFT解题任务从78增至88，在线RL版本达90；小型匹配语料比跨兄弟harness的大语料更省算力。

Details

Motivation: 终端智能体能力同时依赖模型权重和负责提示格式、工具绑定、错误恢复的运行harness。联合优化两者时，轨迹价值取决于生成它的harness，但既有方法常把搜索轨迹不加区分地混入回放数据。

Result: 作者建立交替协同演化框架，以组件级晋升决策分离harness搜索和策略训练。CoTrace明确控制轨迹路由、来源匹配和课程刷新：重复执行失败用于合成harness；SFT只使用与当前采用运行时匹配、已验证的rollout，RL则用新鲜在线交互。Tmax晋升划分上，Qwen3.5-9B经CoTrace的SFT解题数从78升至88，在线强化学习版本达90。紧凑且harness匹配的语料以远低于混合多个兄弟harness的大语料算力带来稳定模型提升。Terminal-Bench 2.1和SWE-bench Lite显示OOD迁移关键取决于harness兼容性，训练与测试运行时一致可避免异构脚手架造成流程错误。

Insight: 智能体训练数据具有运行时来源条件，只有与当前prompt、工具和错误恢复逻辑匹配的轨迹才可靠；盲目混合harness数据可能伤害迁移。测试时也需保持运行时兼容，否则程序执行失败不一定反映模型推理能力。

Abstract: Terminal-agent capability depends jointly on model weights and the runtime harness that formats prompts, binds tools, and handles error recovery. Existing harness-model co-evolution approaches improve both components, yet often treat trajectories produced during harness search as an undifferentiated replay buffer. This practice overlooks that a trajectory’s value for model training depends on the harness under which it was generated. To systematically analyze this interface, we establish an alternating co-evolution framework that decouples harness search and policy training through component-wise promotion decisions. Within this framework, we introduce CoTrace, a harness-aware data recipe that explicitly governs trajectory routing, provenance matching, and curriculum refresh. Under CoTrace, recurring execution failures guide harness synthesis, while policy training is strictly conditioned on verified rollouts matched to the adopted runtime for supervised fine-tuning (SFT) or fresh online interactions for reinforcement learning (RL). On the Tmax promotion split, CoTrace advances Qwen3.5-9B from 78 to 88 solved tasks under supervised fine-tuning while an online reinforcement variant reaches 90. Specifically, a compact harness-matched corpus produces steady model gains at substantially lower compute than much larger corpora pooled across sibling harnesses. Furthermore, evaluations on Terminal-Bench 2.1 and SWE-bench Lite show that out-of-distribution transfer depends fundamentally on harness compatibility, where maintaining consistency between training and evaluation runtimes prevents procedural execution breakdowns observed under foreign scaffolds.

[113] Learning to Act with Task Progress: Distilling Small Agents from Compact Teacher Supervision cs.CLPDF

Wenxi Gan

TL;DR: Task-Progress Distillation用短阶段标签增强小型工具智能体监督：每个演示动作配当前任务阶段，学生联合给可执行的阶段—动作对打分。ALFWorld上1.7B模型404个示范时，显式阶段监督将成功率从动作-only的48.0%提高到67.7%；808个示范时两者均为76.9%。

Details

Motivation: 大型模型演示可训练小型智能体处理重复任务，但演示同时含推理、动作和进度信息，关键是哪些教师轨迹内容应保留以有效指导学生。

Result: Task-Progress Distillation（TPD）是离线方法，为每个演示动作配一个简短当前任务阶段标签。学生学习紧凑目标，并联合评分允许的阶段—动作对，由确定性harness在环境中执行。ALFWorld上1.7B学生使用404个演示时，TPD和动作-only监督均达到72.4%平均未见任务成功率，高于使用约束动作选择的推理训练学生48.3%。阶段标签的额外优势在200个演示时最明显：较动作-only成功率由48.0%提高到67.7%。更多演示时动作-only缩小差距，两种方案在808个示范时均达76.9%。共享历史分析将部分局部优势归因于更好的子目标切换决策，尤其从对象获取转到加工。

Insight: 阶段标签为动作提供当前任务位置，在演示预算中等时能帮助学生处理子目标转换；示范足够多后动作本身已包含类似信息，显式阶段收益缩小。结果限定于ALFWorld和1.7B学生设置。

Abstract: Learning from large-model demonstrations offers a way to train small agents that can complete recurring tasks without calling a large model at every step. A central design choice is what to retain from teacher trajectories that contain reasoning, actions, and information about task progress. We introduce Task-Progress Distillation (TPD), an offline approach that pairs each demonstrated action with a short label describing the current task stage. The student learns these compact targets and selects actions by jointly scoring admissible stage–action pairs, which a deterministic harness executes in the environment. On ALFWorld, a 1.7B student trained with 404 demonstrations achieves 72.4% mean unseen task success with either TPD or action-only supervision, compared with 48.3% for a reasoning-trained student using constrained action selection. Explicit stages provide an additional benefit at 200 demonstrations, improving success from 48.0% to 67.7% over action-only supervision. With more demonstrations, the action-only student closes the gap, and both approaches reach 76.9% at 808 demonstrations. Shared-history analyses link part of TPD’s local advantage to better decisions when moving between subgoals, particularly from object acquisition to processing. These results show that compact supervision can train effective small task agents, while explicit task progress provides additional guidance at an intermediate demonstration budget.

[114] PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs cs.CL | cs.AIPDF

Linghao Meng, Feng He, Xuan Yang, Junyuan Mao, Pinze Ren

TL;DR: PHRBench是研究LLM接收错误前提后如何在后续推理中纠正的受控基准，覆盖四领域、18个模型和4,820个样例，以遵从幻觉、回避幻觉、启发式纠正及最终答对的轨迹定义行为。成功恢复仍少见，且与更多推理过程信念更新相关；仅用幻觉提示特征的轻量预测器AUROC达0.847。

Details

Motivation: 多阶段LLM系统中，幻觉信息可能被传入后续上下文并继续影响推理。现有后幻觉推理研究多关注最终结果或总体推理动态，对模型在响应层面如何处理错误前提刻画不足。

Result: PHRBench评估四个领域、18个LLM的后幻觉推理行为。每条轨迹独立于最终答案正确性，标注Hallucination Compliance、Hallucination Avoidance和Heuristic Correction；只有成功纠正且最终得到正确答案才算有洞察的轨迹。4,820个受控实例中，成功恢复仍相对少见，并与推理轨迹中更频繁的信念更新相关。幻觉提示本身的属性包含较强成功预测信号，轻量预测器AUROC为0.847。

Insight: 模型面对含错前提时可能表现为顺从、回避或真正纠正，最终答案对错不足以反映这一过程；轨迹级分解和信念更新可刻画恢复行为。提示特征能预测成功，但不能因此认为模型已学会普遍可靠的事实核验。

Abstract: Hallucinated information can propagate through multi-stage LLM systems and become part of the context for subsequent reasoning. Existing studies of post-hallucination reasoning (PHR) mainly characterize changes in final outcomes and aggregate reasoning dynamics, leaving how models resolve hallucinated premises at the response level insufficiently understood. In this work, we introduce PHRBench, a controlled benchmark for behaviorally structured PHR across four domains and 18 large language models. PHRBench characterizes each reasoning trajectory independently of final-answer correctness through Hallucination Compliance, Hallucination Avoidance, and Heuristic Correction, and defines an insightful trajectory as successful correction that ultimately reaches the correct answer. Across 4820 controlled instances, we find that successful recovery remains relatively rare and is associated with more frequent belief updates along the reasoning trajectory. We further find that properties of the hallucinated prompt contain substantial predictive signal for successful recovery, with a lightweight predictor achieving an AUROC of 0.847. These findings provide a behavioral view of post-hallucination reasoning, characterizing how LLMs resolve erroneous context and when successful recovery is likely to occur.

[115] EngramEdit: Decoupled Knowledge Updates in LLMs through Conditional Memory cs.CLPDF

Hongru Cai, Ran Wei, Wenjie Wang, Chengfa Wu, Ning Song

TL;DR: EngramEdit把条件记忆作为可编辑事实知识接口：先计算跨多种表达都能使模型输出更新事实的目标记忆表示，再联合调整共享n-gram嵌入匹配目标，并对高频复用嵌入施加更强惩罚以保护无关知识。实验实现近乎完美编辑，新事实可泛化至未见表达和多跳推理，CoT下准确率近最强基线3倍。

Details

Motivation: 条件记忆可用输入n-gram查表扩充LLM容量，也可能把事实存储与Transformer通用计算分离，从而固定骨干更新事实。但同一事实的不同表达可能激活不同n-gram，共享嵌入更新还会意外改变其他事实预测。

Result: EngramEdit先计算一组目标记忆表示，使模型能在多种表达下预测更新后的事实；再联合更新共享n-gram嵌入，让其在不同表达和编辑中匹配目标。对高频复用嵌入施加更大修改惩罚，以保护无关知识。实验显示条件记忆可独立更新事实，编辑成功率近乎完美；更新知识可迁移到未见表达及多跳推理，CoT下准确率约为最强基线的三倍。事实累积更新时，无关知识与通用能力大体保留。

Insight: 条件记忆不仅能扩展容量，也可能成为与主干计算解耦的事实编辑接口；跨表达目标和共享嵌入频率正则用于兼顾泛化和保护其他知识。摘要未给数据集规模或基线绝对分数。

Abstract: Conditional memory architectures such as DeepSeek Engram use input n-grams to look up learned embeddings, expanding the capacity of large language models (LLMs) with limited additional computation. Beyond model scaling, this architecture has demonstrated the potential to decouple factual knowledge storage from general-purpose computation, offering a promising route to updating factual knowledge while keeping the Transformer backbone fixed. Realizing this potential is challenging because different expressions of a fact may activate different n-gram embeddings, while updating shared embeddings can unintentionally change the model’s predictions about other facts. We propose EngramEdit for decoupled knowledge updates through conditional memory. EngramEdit first computes target memory representations that make the model predict the updated fact across multiple expressions. It then jointly updates the shared n-gram embeddings to match these targets across expressions and edits, penalizing updates to frequently reused embeddings more strongly to preserve unrelated knowledge. Experiments show that EngramEdit enables independent factual knowledge updates through conditional memory, achieving near-perfect editing success. Revised knowledge is usable across unseen expressions and in multi-hop reasoning, with nearly three times the strongest baseline’s accuracy under chain-of-thought (CoT) prompting. Unrelated knowledge and general capabilities are largely preserved even as factual updates accumulate. These findings show that EngramEdit turns conditional memory into an editable knowledge interface, extending its role beyond model scaling to support decoupled knowledge updates.

cs.AI [Back]

[116] Route-Verify-Vote: Procedure-Conditioned Self-Consistency for Mixed-Domain Reasoning cs.AI | cs.CL | cs.LGPDF

Xinchen Xiao

TL;DR: Route-Verify-Vote（RVV）无需改参数，以领域标签选择推理程序、逐选项按约束验证，再对完整答案集合投票；分歧小的问题获得更多样本。SCoRE 2026官方混合领域测试中，16次样本固定投票精确集合准确率74.6%，自适应RVV达77.3%，跨模型选择领域路线组合达79.4%，排名参赛系统第二。

Details

Motivation: 组合泛化要求LLM在未训练的混合领域中，以新组合方式运用熟悉推理操作。SCoRE 2026涵盖训练中未出现的三个混合领域，要求模型输出每题全部正确选项集合。

Result: RVV由三步构成：Route根据提供的领域标签选择对应推理程序并表达约束；Verify要求模型逐个选项检查约束；Vote聚合完整答案集合，并在两个最常见集合票数差距较小时给该题分配更多样本。每题样本使用相同领域程序。官方测试中，每题16个样本投票精确集合准确率74.6%；自适应RVV为77.3%；在选定领域路线中组合不同模型，准确率升至79.4%，最终系统排名第二。

Insight: 混合领域推理可显式选择领域过程、逐项验证并以答案集合分歧分配额外计算，而不需模型训练；多选题应按完整集合准确而非逐项命中评价。

Abstract: Compositional generalization remains challenging when language models must combine familiar reasoning operations in unfamiliar ways. The Scenario-Based Commonsense Reasoning Evaluation (SCoRE) 2026 tests this ability on three mixed domains absent from training and requires models to identify the complete set of correct options for each question. We introduce Route-Verify-Vote (RVV), a framework for procedure-conditioned self-consistency that uses language models without parameter updates. Route uses the provided domain label to select a reasoning procedure that guides the model in representing and applying the relevant constraints. Verify prompts the model to assess each option against those constraints. Vote aggregates complete answer sets and allocates additional samples to questions with a small vote-count margin between the two most frequent sets. Samples for each question follow the same domain-specific procedure. On the official test set, voting over 16 sampled answer sets per question achieves an exact-set accuracy of 74.6%. Adaptive RVV reaches 77.3%, and combining models on selected domain routes raises accuracy to 79.4%. The final system ranked second among participating systems. These results support domain-specific reasoning procedures and answer-set disagreement as useful tools for allocating inference-time computation in mixed-domain reasoning.

[117] BEACON-SP: Ontology-Grounded GraphRAG Framework for Clinical Suicide Risk Assessment cs.AI | cs.CL | cs.IRPDF

Kemal Davaslioglu, Nathan Conger, Sastry Kompella, Yalin E. Sagduyu, Nathaniel D. Bastian

TL;DR: BEACON-SP是面向临床自杀风险评估的本体约束GraphRAG，将患者知识图与统一自杀预防本体结合，跨诊断、药物、风险/保护因素、生活事件及时间关系进行多跳检索。1,500个查询、15类临床问题、100名患者上，相较向量RAG提高完整性、临床相关性和证据接地，事实准确率小幅提升；成对标准比较中76.4%偏好GraphRAG。

Details

Motivation: 临床自杀风险评估需整合异构临床、行为、社会和时间证据。向量检索难以显式表示诊断、风险因素和事件间多跳关系，可能导致答案缺证据或缺上下文。

Result: BEACON-SP将患者知识图与本体引导检索结合，支持跨诊断、药物、风险及保护因素、生活事件和时间关系多跳推理。其综合自杀预防本体整合Three-Step Theory、Integrated Motivational-Volitional Model和Suicide Social Determinants of Health Ontology。作者构建本体化患者图并评估临床问答；在涵盖15类临床问题、100名患者的1,500查询基准上，相较向量RAG，完整性、临床相关性及证据接地提高，事实准确性小幅增加。配对标准层面GraphRAG在76.4%比较中更受偏好。

Insight: 本体和图结构可使临床风险推理中的多跳关系及时间上下文显式化，提升回答证据完整性与临床相关性；成对偏好并不替代事实准确性或临床结局验证。

Abstract: We present BEACON-SP, an ontology-grounded Graph Retrieval-Augmented Generation (GraphRAG) framework for clinician-facing decision support in behavioral health settings such as suicide prevention, where effective assessment requires integrating heterogeneous clinical, behavioral, social, and temporal evidence. BEACON-SP combines patient knowledge graphs with ontology-guided retrieval to support multi-hop reasoning across diagnoses, medications, risk and protective factors, life events, and temporal relationships. The framework is enabled by a comprehensive suicide prevention ontology that integrates the Three-Step Theory, the Integrated Motivational-Volitional Model, and the Suicide Social Determinants of Health Ontology into a unified representation of patient risk factors. We construct ontology-grounded patient knowledge graphs and evaluate BEACON-SP for clinician-facing question answering. Compared with a vector-based retrieval-augmented generation (RAG) baseline on a 1,500-query benchmark spanning 15 clinical categories and 100 patients, BEACON-SP improves completeness, clinical relevance, and evidence grounding under a corrected comparative evaluation protocol, with a small gain on factual accuracy. In paired criterion-level comparisons, GraphRAG is preferred in 76.4% of cases. These results demonstrate the potential of ontology-guided GraphRAG to provide structured, contextualized patient evidence for clinical decision support.

[118] Few Bits, One Law: Toward W2A4KV2 cs.AI | cs.CL | cs.LGPDF

Kai Yi, Tarek Elgamal, Sruthikesh Surineni, Vignesh Vivekraja, Soumyadeep Ghosh

TL;DR: 提出 CanonQ 统一量化感知训练框架，通过张量源规范化和联合任务适配，实现权重、激活与 KV 缓存的极低比特协同量化。

Details

Motivation: 权重、激活和 KV 缓存的分布不同，联合量化误差还会在网络中相互作用，使 W2A4KV2 等极低比特设置尤其困难。作者希望让不同张量共享量化表示，同时让模型适应联合误差。

Result: CanonQ 用固定旋转和能量归一化把异质张量映射到规范坐标，复用冻结的高斯参考码本，再通过联合训练适配权重、激活和缓存的误差；论文还给出码本迁移误差与局部任务损失界，并推导归一化感知的直通估计雅可比。在 LLaMA3-1B/3B/8B 的联合 W2A4KV2 设置下，CanonQ-Omni 相较先前 SOTA 和代表性基线，WikiText-2 困惑度最高降低 14.28 倍、平均零样本准确率最高提高 57.9%。在 MobileLLM-Pro-1B 的 W2A16KV16 下，相较最强量化基线，HumanEval pass@1 相对提高 41.7%，GSM8K exact match 相对提高 39.1%；收益也扩展到 Qwen3-1.7B、代码生成和数学推理。

Insight: 把量化源变换与任务适配分开，使冻结码本能跨层、跨模型复用，再用联合训练处理多类量化误差耦合。摘要报告的是最高相对改进，不能理解为每个模型或任务都达到该幅度。

Abstract: Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and quantization errors interact throughout the network. We introduce CanonQ, a unified quantization-aware training framework that addresses these challenges by separating source canonicalization from task-aware adaptation. Fixed rotations and energy normalization map heterogeneous tensor sources to canonical coordinates, enabling frozen Gaussian-reference codebooks to be reused across layers and models. Joint training then adapts the network to the coupled errors of weight, activation, and cache quantization within a common scalar/vector interface. We bound frozen-codebook transfer error and local task loss, and derive an exact normalization-aware straight-through Jacobian that links quantization distortion to gradient bias. The strongest gains arise under joint W2A4KV2 compression: across LLaMA3-1B/3B/8B, CanonQ-Omni achieves up to 14.28x lower WikiText-2 perplexity and up to 57.9% higher mean zero-shot accuracy than prior state-of-the-art and representative quantization baselines. The benefits extend to Qwen3-1.7B, code generation, and mathematical reasoning: on instruction-tuned MobileLLM-Pro-1B at W2A16KV16, CanonQ achieves relative improvements of 41.7% in HumanEval pass@1 and 39.1% in GSM8K exact match over the strongest evaluated quantization baseline.

[119] TopoGraphRAG-Bench: Evaluating Multimodal GraphRAG on Layout-Grounded Evidence Reasoning cs.AI | cs.CLPDF

Ruochi Li, Jianzhe Lin, Haoxuan Zhang, Haihua Chen, Junhua Ding

TL;DR: 构建 TOPOGRAPHRAG-BENCH，以 2,024 个问题和 201 份长篇视觉文档评估多模态 GraphRAG 是否能恢复布局支撑的证据拓扑并完成跨文本、图表推理。

Details

Motivation: 真实文档中的证据分散在文本、表格、图和图注及复杂页面布局中，复杂问答需要恢复证据单元之间的结构关系。既有 GraphRAG 评测偏文本，文档 RAG 基准又较少直接衡量目标证据拓扑的恢复。

Result: 基准按底层证据构造单跳检索、桥接链推理和多源综合三类问题，并通过反事实验证检查捷径抵抗、模态必要性和证据必要性。论文比较文本 GraphRAG、页面级视觉检索和多模态 GraphRAG，使用检索、生成和拓扑感知推理指标。多模态 GraphRAG 总体最佳，但在图文证据对齐不完整或多单元组合时仍会失败；文本方法难以处理图表中的关键依赖，页面级视觉检索则缺少恢复细粒度拓扑所需的结构。

Insight: 文档问答的瓶颈不仅是找到相关页面，还包括明确不同证据单元间的依赖与推理角色。基准因此把拓扑恢复纳入评测，并指出应超越文本实体关系图，显式建模版面与跨模态对齐。摘要未给出各系统的具体分数。

Abstract: Real-world documents distribute evidence across text, tables, figures, and captions within complex page layouts. Answering complex questions over such documents therefore requires more than retrieving relevant passages: systems must recover the evidence topology that connects heterogeneous evidence units. Existing GraphRAG evaluations remain largely text-centered, while multimodal document RAG benchmarks assess cross-modal retrieval and generation without directly evaluating recovery of the intended evidence topology. We introduce TOPOGRAPHRAG-BENCH, a layout-grounded benchmark for multimodal evidence reasoning in GraphRAG, comprising 2,024 questions over 201 long, visually rich documents. Questions are constructed bottom-up from text, figure, and table evidence units under three controlled topologies: single-hop retrieval, bridge-chain reasoning, and multi-source synthesis. To ensure that questions preserve their intended structure, we apply counterfactual validation for shortcut resistance, modality necessity, and evidence necessity. We evaluate text-only GraphRAG, page-level visual retrieval, and multimodal GraphRAG systems using retrieval, generation, and topology-aware reasoning metrics. Multimodal GraphRAG systems achieve the strongest overall performance, but still fail when visual-textual evidence alignment or multi-unit composition is incomplete. Text-only GraphRAG struggles when key dependencies are grounded in figures or tables, while page-level visual retrieval lacks the fine-grained structure needed for topology recovery. These findings motivate GraphRAG systems that move beyond text-derived entity relation graphs to explicitly model document layouts, cross-modal evidence alignment, and the reasoning roles of evidence units. Code and data are available at https://richardlrc.github.io/TopoGraphRAG-Bench/.

[120] GAGR-Lab: Evaluating Joint Spatial-Geometric and Analytic Function Reasoning cs.AI | cs.CL | cs.CV | cs.LGPDF

Jingyao Zhang, Yun Li, Lu Han

TL;DR: 提出 GAGR-Lab 评测框架，考察模型能否把空间几何场景转成解析函数并执行其轨迹以满足几何约束；当前报告的是有限试点而非完整基准对比。

Details

Motivation: 联合空间—几何与解析函数推理要求模型先感知场景，再构造符号函数，并使其执行曲线满足几何条件。现有评估需要区分感知、度量定位、关系理解、函数解释与受约束合成等环节。

Result: GAGR-Lab 使用笛卡尔游戏场景、明确函数语义和 Rust 权威轨迹执行，定义六类能力、四个可配置难度预设及计划中的 24 单元诊断设计，并仅报告实际完成部分。一个托管模型 Llama 3.2 11B Vision Instruct 的有限试点，以两个 API 凭据作为执行副本，共 72 个均衡游戏、432 次尝试、429 个有效服务响应，目标命中为零；普通函数提示变体也未命中，结构化定位界面没有可评分输出。独立特权解析搜索控制在 300 个生成场景的 600 个方向性案例上成功，并通过 1,200 项垂直反射或平移检查且可精确复现。

Insight: 框架把服务可用性、符号合规与几何成功分开记录，并保留模型可见输入和实际路径。当前贡献是可操作的研究框架及已执行试点；完整难度矩阵、跨模型比较、留出复制和鲁棒性实验仍属后续计划。

Abstract: Joint spatial-geometric and analytic function reasoning requires translating a perceived spatial configuration into a symbolic function whose executed curve satisfies geometric constraints. We present GAGR-Lab, a framework for measuring this capability through Cartesian game scenes, explicit function semantics, and authoritative Rust trajectory execution. It distinguishes spatial perception, metric grounding, geometric relations, function interpretation, function construction, and constrained synthesis. We specify four configurable scene-difficulty presets and a prospective 24-cell diagnostic design, while reporting only the subset actually evaluated. A bounded pilot of one hosted model (Llama 3.2 11B Vision Instruct) using two API credentials as execution replicas yields 72 balanced games with 432 attempts, 429 valid provider responses, and no target hits; exploratory ordinary-function prompt variants also fail to hit, while the structured localization interface yields no scoreable outputs. A privileged analytic search control independently succeeds on 600 directional cases from 300 generated scenes, with exact repeatability and 1,200 successful vertical-reflection or translation checks. The framework separates serving reliability, symbolic compliance, and geometric success, and preserves exact model-visible inputs and realized paths. A staged protocol outlines diagnostic calibration, held-out replication, multi-model comparison, and paired robustness tests. The contribution is an operational research framework with an executed pilot and a clearly identified prospective study plan; the full difficulty matrix and comparative model results remain untested.

[121] Reasoning-Token Spikes Under Prompted Untruthful Responding in Large Language Models cs.AI | cs.CLPDF

Maverick Morales, Tomáš Dominik, Vermut Gao, Katrina Shirey, Paulius Rimkevičius

TL;DR: 研究明确要求模型撒谎时的推理 token 数变化，发现三个推理模型在撒谎或不受真伪约束的提示下会生成更多推理 token。

Details

Motivation: 监控推理链内容可用于发现欺骗，但依赖推理轨迹可读、忠实且可访问；这些条件可能不再成立。作者基于认知负荷理论，考察无需查看推理内容的低带宽信号——生成 token 数。

Result: 三个具备推理能力的 LLM 回答 210 道多选题，涵盖分析、描述、规范推理及道德/非道德领域；系统提示要求说真话、说假话或不受真伪约束。三个模型中，真实回答导向提示产生的推理 token 均少于撒谎导向和真伪无关提示。结果表明，明确提示的不真实策略可在群体层面稳定改变测试时推理 token 用量。

Insight: 推理长度可作为不读取轨迹内容时区分提示诱导真实性策略的候选信号，但当前只是概念验证，不能说明其能检测自发欺骗或一般失配。尚需评估单样本检测率、分布外泛化、学习型欺骗策略、隐藏目标及对抗压力下鲁棒性。

Abstract: Monitoring the chain-of-thought of reasoning artificial intelligence (AI) models remains a key approach to detecting deception and other forms of misbehavior in such models. However, semantic chain-of-thought monitoring depends on reasoning traces being legible and sufficiently faithful to the underlying computations that produced the model’s behavior, not to mention accessible. Moreover, there is increasing evidence that chain-of-thought outputs may soon become illegible or unfaithful, if they even remain accessible. Based on cognitive load theory, we investigate a lower-bandwidth signal – the number of reasoning tokens generated – which does not require access to the content of the reasoning trace. Three reasoning-capable large language models answered 210 multiple-choice questions – across analytic, descriptive, and normative reasoning types as well as moral and non-moral domains – under system prompts instructing them to respond truthfully, falsely, or without regard for truth. Across all three models, truth-directed responding elicited fewer reasoning tokens than both lie-directed and truth-indifferent responding. These findings show that explicitly prompted untruthful response policies can produce robust group-level differences in test-time reasoning-token use. While not yet establishing reasoning-token count as a detector of spontaneous deception or general misalignment, our results are a proof of concept that it can serve as a simple, content-independent candidate signal for differentiating untruthful from truthful model behavior when raw reasoning traces are unavailable or unreliable. Future work should test instance-level detection rates, out-of-distribution generalization, learned deceptive policies, hidden objectives, and robustness under adversarial pressure.

cs.CR [Back]

[122] Adversarial Images Hijack Web Agents from Visual Grounding to Browser Execution cs.CR | cs.AI | cs.CLPDF

Wanjing Han, Levi Taiji Li, Mu Zhang, Yue Jiang, Guanhong Tao

TL;DR: 提出 WebMirage，面向视觉定位到浏览器执行的端到端网页智能体红队框架，通过局部视觉扰动诱导智能体选中攻击者控制的页面元素并执行对应操作。

Details

Motivation: 既有网页智能体视觉攻击主要针对模型推理，未充分考虑结构化输入处理和动作后处理；模型层面的攻击成功不能证明最终浏览器操作受控，也不足以衡量端到端鲁棒性。

Result: WebMirage 将攻击目标定义为从视觉定位到浏览器执行的完整链路，使用角色槽位抽象、网页重组以建模页面元素竞争，并通过数据流分析对齐动作后处理过程。评测覆盖 4 种智能体配置、6 个 VLM 后端、2,250 项任务、13 个公开网站及一个沙盒基准。平均攻击成功率为 91.9%，最强基线为 17.4%；对三种智能体级防御仍有效。

Insight: 评估网页智能体安全时应检查最终动作是否被控制，而不能只报告模型是否生成了攻击目标。该框架把页面布局竞争和执行阶段的动作转换都纳入攻击优化。

Abstract: Modern web agents built on large vision-language models process webpages, select relevant UI elements, and translate model outputs into browser actions. Existing visual red-teaming approaches use adversarial visual content to manipulate this process. However, they primarily target model inference and do not explicitly account for structured input processing or action post-processing. Consequently, model-level success does not establish control over browser execution and cannot reliably characterize end-to-end agent robustness. To address this gap, we formulate red teaming for vision-grounded web agents as an end-to-end grounding-to-execution problem, and introduce WebMirage, a framework that crafts localized visual perturbations that cause agents to select attacker-controlled content and execute the corresponding browser action across varying webpage renderings. It uses a role-slot abstraction and webpage recomposition to capture competition among webpage elements, and dataflow analysis to align optimization with action post-processing. We evaluate WebMirage across four agent configurations and six VLM backbones on 2,250 tasks covering 13 public websites and a sandbox benchmark. WebMirage achieves an average attack success rate of 91.9%, compared with 17.4% for the strongest baseline, and remains effective against three agent-level defenses.

[123] Constitution-Guided Watermarking cs.CR | cs.CL | cs.LGPDF

Toluwani Aremu, Samuele Poppi, Nils Lukas

TL;DR: 提出 Constitution-Guided Watermarking，根据提供方的自然语言原则离线优化规则专属水印配置，部署时由独立监视器选择策略并保留可审计证据。

Details

Motivation: 水印强度、文本质量、编辑鲁棒性和归因能力彼此牵制；固定配置会让不同需求的请求共用同一工作点，可能在需要保留措辞时损害质量，或在需要可靠归因时缺乏鲁棒性。

Result: 离线推理代理读取原则和水印实现，并依据经验反馈迭代细化每条规则的配置；部署时独立监视器识别适用规则并检索策略，也可包含豁免，且不修改服务模型。规则可并行优化、随需求变化而更新，每个部署配置绑定评测证据。使用 KGW 和五条规则的概念验证中，对优先鲁棒性的请求，释义后检测率比固定配置最高提升 14 个百分点；总体质量与干净文本检测在名义 0.1% 假阳性率下匹配或超过所有基线。

Insight: 用按请求条件选择的规则配置替代全局单一折衷点，并把配置选择与评测证据绑定，提升部署决策的可审计性。结果来自特定 KGW、五规则概念验证。

Abstract: Watermarking enables language model providers to identify text generated by their models. However, its desired properties can conflict (\ie~stronger watermark signals can degrade text quality), while designs that resist editing may also facilitate forgery. Providers address these trade-offs by choosing configurations that balance competing objectives or prioritize particular properties. Either approach imposes a shared operating point on requests with different requirements, potentially sacrificing quality where wording preservation matters or robustness where reliable attribution is essential. To allow flexible and adaptable designs, we introduce \emph{Constitution-Guided Watermarking}, a framework that selects request-appropriate trade-offs from provider requirements, listed as natural-language principles. \emph{Offline}, a pretrained reasoning agent examines constitutional rules alongside watermark implementations and iteratively refines rule-specific configurations using empirical feedback. \emph{At deployment}, a separate monitor identifies applicable rules and retrieves the corresponding policy, including watermarking exemptions, without modifying the serving model. Furthermore, our framework supports offline parallel optimization and refinement of rule-specific configurations based on evolving provider requirements without affecting deployment, and binds each deployed configuration to its evaluation evidence, making deployment decisions auditable. In a proof-of-concept evaluation using KGW and a five-rule constitution, our framework selects configurations responsive to provider priorities and improves post-paraphrase detection on robustness-prioritized requests by up to $14$ percentage points over fixed configurations, while matching or exceeding all baselines in aggregate quality and clean detection at a nominal $0.1%$ false-positive rate.

[124] Constrained-Action AI Remediation for SIEM/XDR via a NeMo-Guardrails Proxy cs.CR | cs.AI | cs.CLPDF

Georgios Koutidis, Nikolaos Kekatos, Tom Nianios, Alexios Lekidis

TL;DR: 提出面向 SIEM/XDR 的受限动作 AI 修复架构，以闭合意图词表、参数校验及 NeMo-Guardrails 代理限制 LLM 安全告警处置中的执行风险。

Details

Motivation: SOC 告警数量庞大，LLM 被用于告警分诊甚至自动封禁 IP、终止进程或隔离文件；恶意告警可能借助 LLM 推理形成通往生产主机的远程执行链路。

Result: 架构包含 SIEM/XDR 控制平面：依据关联主机事件确定修复上下文，将 LLM 输出限制在闭合意图词表，用模板命令由轻量端点代理执行，并以参数校验器把关；另以 NeMo-Guardrails 代理对 SOC 分析员 LLM 应用输入/输出策略。对发布的 SOC 专用对抗语料进行开箱评估后，标准代理在 0.1% 假阳性率下将注入检测召回率从 25.0% 提升至 94.5%。实时红队测试中，闭合意图与参数校验在命令越过信任边界前拦截了所观察到的 LLM 失效。作者明确指出这只是关键基础设施适配架构，尚无 OT 实际部署测量；护栏延迟也不适合内联控制，建议有人参与或延迟执行。

Insight: 安全主张建立在“限制可执行动作并由可信控制面校验”的分层约束上，而不只依赖提示防护。摘要明确区分红队验证与生产运营/OT 部署证据，不能把架构适配说成已在关键基础设施上线。

Abstract: Security Operations Centers (SOCs) for information technology and operational technology share one incident-response problem: a flood of correlated alerts and too few analysts. Large Language Models (LLMs) are increasingly proposed as reasoning engines that triage alerts and, in autonomous deployments, issue commands that block IPs, kill processes, or quarantine files on production hosts. This coupling introduces a new risk: a single adversarial alert can become a remote code path through the LLM’s reasoning, leading it to recommend an action the SOC then executes. We present a constrained-action architecture with two coordinated layers: (i) a SIEM/XDR control plane that grounds remediation in correlated host events and confines the LLM’s output to a closed intent vocabulary whose templated commands are executed by thin endpoint agents, backstopped by an argument validator; and (ii) a NeMo-Guardrails proxy that wraps the SOC-analyst LLM with input- and output-rail policies, evaluated out-of-the-box against a SOC-specific adversarial corpus we release. The stock proxy lifts injection recall from 25.0% to 94.5% at a 0.1% false-positive rate, and a live red-team exercise confirms that the closed intent vocabulary and argument validator contain the observed LLM failure modes before any command crosses the trust boundary. As an architectural fit (not yet a measured operational-technology deployment), the constrained-action property suits critical-infrastructure settings where a wrong remediation has physical, not merely operational, consequences. The loop is best run human-in-the-loop or delayed: the measured rail latency keeps inline control out of scope.

cs.GR [Back]

[125] emg2face: Expressive Facial Animation with High-Density Surface EMG cs.GR | cs.CV | cs.ET | cs.LGPDF

Ganidhu Abey, Wendy Greening, Ashika Kamboj, Leonhard Helminger, Abhijeet Ghosh

TL;DR: 展示利用高密度表面肌电预测面部表情 blendshape 的非光学动画流程，可在头显遮挡面部时采集表情，并支持迁移渲染到不同人脸和非人角色。

Details

Motivation: 面部光学捕捉在 VR 头显遮挡时难以使用；即使无遮挡，也有隐私顾虑且需将摄像头和灯光架设在脸前。高密度表面肌电可能提供非光学替代信号。

Result: 系统使用两块织物电极阵列采集 64 通道肌电，额头和侧脸各 32 通道，采样率 2048 Hz；同步视频估计 478 个 3D 面部标记。针对不同采样率与独立时钟，作者用模拟音频脉冲实现亚毫秒同步，并将高分辨率 GNM 参数头模（253 个身份 blendshape、383 个表情 blendshape）拟合到标记。网络由每块电极空间编码器和扩张时序卷积组成，以 100 Hz 从肌电预测 blendshape。展示数据来自 25 名参与者，预测结果可实时渲染并转移到不同人类面孔和非人角色。

Insight: 工作展示了从肌电直接恢复可动画表情的完整管线，覆盖传感同步、参数头模拟合和实时推理。摘要未报告定量表情误差、跨受试者泛化或头显环境的正式评估。

Abstract: Facial movements convey subtle and important information that is critical for human social communication. Optical methods for face capture are difficult or impossible to use when the face is occluded by head-mounted devices (HMDs), such as VR headsets. Even with a clear line of sight, such methods raise privacy concerns and require head-mounted capture rigs that offset cameras and lighting from the face. We show that high-density surface electromyography (HD-sEMG) provides a viable non-optical alternative that addresses these challenges. We measured 64 EMG channels, using two textile EMG grids, with 32 from the forehead (typically occluded by an HMD) and 32 from the side of the face. EMG data were digitized at 2048 Hz and filtered. Facial movements were simultaneously recorded and used to estimate 478 3D facial landmarks using MediaPipe’s Face Landmarker. A major challenge in such multimodal recordings is synchronizing EMG and video data, which have different sampling frequencies and independent clocks. We developed a novel synchronization method using analog audio bursts that is capable of sub-millisecond synchronization. We also developed a staged fitting method that fits a recent high-resolution parametric head model (GNM), with 253 identity blendshapes and 383 expression blendshapes, to the MediaPipe landmarks as participants performed different facial expressions. We trained a deep neural network comprising per-grid spatial encoders followed by a dilated temporal convolutional network (TCN) to predict blendshape parameters from HD-sEMG signals at 100 Hz. Once trained, the network can predict expression blendshapes solely from HD-sEMG recordings. The output can be rendered using standard real-time blendshape animation methods. We demonstrate the methods using recordings from 25 participants, and direct expression transfer to a variety of human faces and non-human characters.

[126] ScribbleEdit: A Benchmark for Scribble-Only Image Editing cs.GR | cs.CVPDF

Jie Ren, Hao Kang, Kai Guo, Yiding Yang, Bo Liu

TL;DR: 构建 ScribbleEdit 基准评估仅凭涂鸦输入的图像编辑模型，并提出用软 token 编码涂鸦语义的简单基线。

Details

Motivation: 涂鸦是一种轻量直观的交互方式，但现有基于 VLM/LLM 的编辑模型难以只凭涂鸦理解并执行修改。任务要求同时理解编辑意图和涂鸦空间位置。

Result: 作者设计自动数据构建流程与专门评估协议，显式衡量编辑意图对齐。分析显示现有 VLM/LLM 编辑模型无法准确捕捉涂鸦意图；提出的软 token 基线增强涂鸦语义理解，在该基准上优于标准图像编辑模型。摘要未提供数据规模、具体分数或其他基线比较。

Insight: 涂鸦驱动编辑不能只识别图像内容，还需将涂鸦的空间位置转成明确编辑意图。该基准与基线为研究提供起点，摘要未给出不同涂鸦类型的错误分析。

Abstract: Scribble-based interaction provides a lightweight and intuitive way for users to specify image editing intents in interactive editing tools. However, current image editing models based on VLMs or LLMs struggle to understand and execute edits based solely on scribble inputs. To systematically study this problem, we construct a new benchmark, ScribbleEdit, that evaluates the ability of image editing models to perform image editing conditioned on scribbles. This task requires both a deep understanding of the intention of the scribble and an accurate interpretation of its spatial information. In ScribbleEdit, we design an automated data construction pipeline and introduce a dedicated evaluation protocol that explicitly measures intention alignment. Our analysis reveals that existing VLM/LLM-based editing models fail to accurately capture scribble intentions. To guide future progress on scribble-only image editing, we propose a simple yet effective soft-token baseline, which enhances the model’s understanding of scribble semantics and outperforms standard image editing models on our benchmark. Our evaluation and baseline together provide a concrete foundation for assessing and improving the scribble-driven image editing.

cs.IR [Back]

[127] Inverting Multi-Vector Visual Document Indices cs.IR | cs.CL | cs.CVPDF

Zhuchenyang Liu, Yao Zhang, Yu Xiao

TL;DR: 研究多向量视觉文档检索索引的反演攻击：仅凭按页面存储的图像块向量可恢复大量文字与敏感令牌，说明索引应按原文档等级保护。

Details

Motivation: 视觉文档检索器通常为每页保存约千个按栅格顺序排列的图像块向量，并常存放在第三方向量数据库。由于向量本身不可直接阅读，索引可能被误认为不敏感；但编码器具有文档阅读能力，索引可能泄露原页内容。

Result: 作者将索引反演建模为条件文档图像生成，分析攻击所需的编码器、页面尺寸以及打乱向量时的顺序。在 ViDoRe v3 上，原始索引反演页恢复 47% 的词和 45% 的敏感令牌；将反演页作为查询时，源页 98.4% 排名第一。令牌池化与打乱两种低成本防护可把词召回降至约 8%；但顺序恢复模型能把打乱索引的源页首位率从 3.8% 提至 93.5%，池化索引仍可被反演。对另一多向量检索器不作修改迁移攻击，源页首位率仍为 70.2%，但词召回低于最近邻基线。

Insight: 打乱虽能干扰页面重建，但索引顺序可被恢复；池化对文本泄露更有效但并未封闭风险。检索索引保留了足以泄露敏感内容的信息，因此需要与编码文档同等级保护。

Abstract: Prevailing multi-vector visual document retrievers store each page as about a thousand patch vectors, often in vector databases run by a third party. Since no one can read a page from its vectors, this index is easily treated as less sensitive than the page. However, because the index keeps one vector per patch in raster order, and each vector is computed by a vision-language model pre-trained to read documents, we hypothesize that whoever runs or breaches the store can reproduce a page from its index alone. We frame inversion as conditional document image generation and infer from the vectors what the attack needs: the encoder, the page shape and, for shuffled vectors, their order. On the ViDoRe v3 benchmark, pages inverted from raw indices recover 47% of the words and 45% of the sensitive tokens. Used as queries against the stored indices, they rank their source page first 98.4% of the time. We test two cheap protections, token pooling and shuffling, which both cut word recall to about 8%. A model that restores the order of a shuffled index raises the share of source pages ranked first from 3.8% to 93.5%, while inverting a pooled index remains open. To test generalisation, we apply the same attack unchanged to another multi-vector retriever: its inverted pages still rank their source page first 70.2% of the time, though its word recall stays below a nearest-neighbour baseline. Multi-vector visual document retrievers are therefore vulnerable to inversion through their stored index, which should be protected like the documents it encodes.

cs.LG [Back]

[128] Just for FUNS: LLM-Guided Spatio-Temporal Graph Node Generation for Forecasting Unobserved Node States cs.LG | cs.AI | cs.CL | stat.MLPDF

Shuhao Li, Weidong Yang, Changan Liu, Wei Zhuo, Yingbo Zhou

TL;DR: GenST把未观测节点预测定义为时空图条件生成：先用时空VAE压缩动态，再由生成Transformer从噪声恢复未见节点未来状态，条件包括LLM从节点描述抽取的功能区/道路语义、坐标和邻域上下文。六个交通及两个非交通数据集的零样本预测显著优于基线。

Details

Motivation: 受部署成本和维护资源限制，传感器网络空间覆盖不完整，很多节点没有历史观测，传统时序模型难以预测这些未观测节点。

Result: GenST将未观测节点预测重构为时空图条件生成任务。经微调的预训练LLM从节点描述中抽取功能区域、道路结构等语义特征，补充缺失时空信号。两阶段模型先用Spatio-Temporal VAE将时空动态压缩到潜空间，再用Generative Transformer从噪声生成未观测节点未来状态，条件包含语义、地理坐标和邻域上下文。六个交通及两个非交通数据集实验中，零样本预测显著优于现有基线；摘要未提供具体指标。

Insight: 节点文本描述和地理/邻域结构可为无历史节点提供语义先验，生成式潜空间模型则把该先验用于预测未来状态。跨交通与非交通数据集结果支持通用性，但摘要未量化各数据集增益。

Abstract: Spatio-temporal forecasting is a cornerstone of logistics, urban planning, and intelligent transportation systems. However, constrained by deployment costs and maintenance resources, sensor networks often lack comprehensive spatial coverage, rendering Forecast Unobserved Node States (FUNS) a critical yet formidable challenge. Conventional models rely on historical observations and typically falter when encountering nodes without prior records. To address this, we redefine the problem as a conditional generation task on spatio-temporal graphs and propose GenST, a framework that introduces Large Language Models (LLMs) as a semantic bridge, leveraging a pre-trained LLM fine-tuned to extract rich semantic features from node descriptions, such as functional zones and road network structures, to compensate for missing spatio-temporal signals. Specifically, we design a two-stage generative architecture: a Spatio-Temporal VAE first compresses spatio-temporal dynamics into a latent space, followed by a Generative Transformer (GenT) that reconstructs the future states of unobserved nodes from noise, guided by multi-modal conditions including semantics, geographic coordinates, and neighborhood contexts. Experiments on six traffic and two non-traffic datasets show GenST significantly outperforms existing baselines in zero-shot prediction tasks, demonstrating the practical potential of semantic-guided generation for mitigating spatio-temporal data sparsity.

[129] On KL-Regularized Policy Optimization cs.LG | cs.AI | cs.CLPDF

Yifan Zhang

TL;DR: KLPO为异步LLM智能体RL提出以采样器为锚点的KL正则优化：用采样器自身轨迹最小二乘拟合Gibbs闭式改进解，不需重要性权重、可学习归一化器或每提示多条rollout。它还可用终局回报而非critic构造token级策略镜像下降梯度，并将SPPO、GPO、REBEL和BPO纳入统一框架。

Details

Motivation: 异步RL中训练策略与生成轨迹的旧采样策略不同，且即使参数一致，推理引擎概率也可能与训练器不同。常见重要性比率裁剪会引入偏差，GRPO每提示多采样对长episode成本高。

Result: KL-Regularized Policy Optimization把KL正则锚定到采样器，正则化策略改进有闭式Gibbs解；KLPO用采样器自身轨迹以最小二乘拟合log-ratio最优条件，采样概率通过对数比进入，不需重要性权重。消去回归截距后，不可算log-partition函数可被信号采样器均值和采样器—训练器KL替代。对token级策略镜像下降目标，梯度可由终局回报经采样器中心化分数或单轨迹残差计算，无需critic，即便工具输出随机也适用。独立蒙特卡洛KL估计保持梯度无偏；作者推导top-K和二元近似的精确KL差，并证明SPPO、GPO、REBEL、BPO为特例。框架每提示只需一条rollout，无学习归一化器。

Insight: 以实际产生异步轨迹的采样器作为KL锚点，可直接处理训练/采样概率不匹配，并免去group rollout和critic。摘要主要是理论与算法框架，未给大规模任务性能实测数字。

Abstract: Asynchronous reinforcement learning (RL) for large language model (LLM) agents trains one policy on trajectories generated by another: rollouts come from stale checkpoints, and the inference engine’s probabilities differ from the trainer’s even at identical parameters. Standard remedies either clip importance ratios, which biases the update, or, as in GRPO, sample a group of responses per prompt, which is costly when episodes are long. We propose KL-Regularized Policy Optimization (KLPO), a framework that anchors the KL regularizer at the sampler. The regularized improvement step then has a closed-form Gibbs solution, and KLPO fits its log-ratio optimality condition by least squares on the sampler’s own trajectories, so the sampler probability enters through a log-ratio and no importance weights are needed. Profiling out the regression intercept replaces the intractable log-partition function with the signal’s sampler mean plus a sampler-to-trainer KL divergence. For token-level policy mirror descent targets, we show that the resulting gradient can be computed from terminal returns without a critic, via sampler-centered scores or a single trajectory residual, even under stochastic tool outputs. We further prove that independent Monte Carlo estimates of the KL term keep these gradients unbiased, derive the exact KL gap of cheaper top-$K$ and binary approximations, and show that SPPO, GPO, REBEL, and BPO arise as special cases of KLPO. The result is a critic-free update that uses one rollout per prompt and requires neither a learned normalizer nor a group of responses.

[130] LayerRoPE: Dynamic Depth-wise Magnitude & Angular Superposition cs.LG | cs.AI | cs.CLPDF

Shikhar Srivastava, Christopher Kanan

TL;DR: 提出 LayerRoPE，将归一化层的逐层增益向量改为共享向量与深度条件标量，显式编码层深度，并以更少参数稳定深层 Transformer。

Details

Motivation: 深层 Transformer 的隐藏状态范数随深度增长通常被视为需要抑制的病态。作者在多种模型中发现，这种增长与残差流归一化权重的幅值和方向变化有关，可能包含层位置编码；因此探索按深度调节计算块，而非压低残差流。

Result: 在 9 个模型家族的 16 个预训练 LLM 上观察到归一化增益随深度增长并旋转。LayerRoPE 将所有逐层增益向量替换为一个共享向量和深度标量，减少参数，FLOPs 变化小于 0.02%。在最高超过 100B token 的模型规模实验中，其表现持续优于 Pre-/Post-/Peri-Norm 与 Layer-Norm Scaling；以 3.4 倍更少计算达到 Pre-Norm 的 1.3B loss。它是所比较方法中唯一在深度扩展到 512 层时保持强收敛且近乎单调改善的方法，并将学习率敏感性降低 3–10 倍；迁移到循环潜变量模型和 ViT 也有提升。

Insight: 结果将深度稳定性解释为对计算块读写的深度条件调节：LayerRoPE 会减弱每个块读取的信号、放大写回残差流的信号，而不是缩小残差流本身。该解释来自作者的实验与权重分析，摘要未提供各基准的完整数值。

Abstract: As data propagates through a Transformer, the norm of its hidden states grows by orders of magnitude with depth, a phenomenon framed as ‘curse of depth’ and nearly universally treated as a pathology to be suppressed. We take the opposite view. Across 16 pre-trained LLMs from 9 families, spanning dense, mixture-of-experts and hybrid architectures and Pre-, Peri- and Post-Norm designs, we find that this growth reflects an emergent depth-positional encoding, carried by the only learned per-layer gain on the residual stream, the normalization weight $γ$: with depth, $γ$ grows in magnitude and rotates in direction, jointly encoding the layer index. We make this depth-conditioned encoding explicit with LayerRoPE, an implicit analog of RoPE along the depth axis, which replaces all layerwise $γ$ vectors with a single shared vector and depth-conditioned scalars, at a net reduction in parameters and $<0.02%$ change in FLOPs. Across a model ladder scaled up to $100$B+ tokens, LayerRoPE consistently outperforms Pre-, Post- and Peri-Norm and Layer-Norm Scaling, reaching Pre-Norm’s 1.3B loss with $3.4\times$ less compute; LayerRoPE is the only approach that shows strong convergence and improves near monotonically as depth scales to 512 layers. It improves learning-rate sensitivity by $3$-$10\times$, and transfers naively to and consistently improves looped latent models and Vision Transformers. Inspecting its learned schedule inverts the prevailing premise: LayerRoPE does not shrink the residual stream but widens it, damping what each block reads while amplifying what it writes. Depth stability, our results suggest, calls not for suppressing the residual stream, but for depth-conditioned regulation of the computational blocks it feeds.

[131] Noise Your Prompt: Noising Conditioning Tokens in Continuous Diffusion Language Models cs.LG | cs.CLPDF

Justin Jung

TL;DR: 本文对连续扩散语言模型训练做一行改动：训练时也对条件提示token加噪，而非始终保持干净。组合推理任务Sudoku Hard求解率从3.73%升至24.65%，10×10 N-Queens解多样性覆盖率从50.60%升至73.79%；摘要称在Gigaword小数据摘要任务也改善，但开放对话未迁移。

Details

Motivation: 连续扩散语言模型常规做法是在训练时固定条件提示token为干净状态。作者检验同时扰动提示是否能减少训练—推理差异并提升组合推理泛化及生成多样性。

Result: 方法只在训练目标中加入条件提示token噪声，不默认增加推理成本，并可使用受classifier-free guidance启发的引导采样。数独和N皇后等组合推理任务中泛化提高，难度越高收益越明显：Sudoku Hard求解率由3.73%升至24.65%；10×10 N-Queens生成解覆盖率由50.60%升至73.79%。在数据规模较小的Gigaword摘要任务也测得自然语言生成质量改善，但收益未迁移至所有文本任务，例如开放式对话。

Insight: 训练时扰动条件提示可改善连续扩散模型对组合约束的泛化和解多样性，改动简单且默认不增加推理成本；自然语言收益依任务而异，开放对话并未改善。

Abstract: We revisit a standard accepted practice in the continuous diffusion language model literature of fixing conditioning prompt tokens clean during training. We make a very simple modification: also noise the conditioning prompt tokens during training. We demonstrate that under this modified training objective, we achieve better generalization in combinatorial reasoning tasks such as Sudoku and N-Queens, with the largest gains on harder variants ($3.73% \to 24.65%$ solve rate on Sudoku Hard), and increased diversity of generated solutions ($50.60% \to 73.79%$ coverage on 10x10 N-Queens). We also show measurable improvements to natural language generation quality in modest dataset regimes with Gigaword summarization, but notably demonstrate that gains do not transfer to all natural language tasks (e.g open ended dialogue generation). Our method is a single line change to the training objective, requires no additional inference costs by default, and provides the flexibility of classifier-free guidance inspired guided sampling. Our \href{https://github.com/LateralIntelligence/noise-your-prompt} {code} is publicly available.

[132] Collaborative Reasoning Distillation via Cross-Feedback and Coherent Curation cs.LG | cs.AI | cs.CLPDF

Taehoon Kim, Seunggeun Cho, Dongsu Han

TL;DR: 提出协作推理蒸馏 CRD，通过教师间交叉反馈、逐步推理质量评估和连贯步骤拼接，训练小型模型学习更可靠的推理过程。

Details

Motivation: 现有推理蒸馏要么计算开销大，要么难以有效迁移到小模型；仅依据最终答案的结果奖励无法区分严谨推理与偶然猜对。

Result: CRD 让多个教师迭代批评彼此推理，对每一步单独评估逻辑质量，再拼接互补且连贯的步骤；学生以带预算约束的推理质量优化（RQO）训练。CRD-4B 仅用 50K 条训练样例，在 MATH-500 得分 97.3%，AIME’25 得分 70.3%，超过作者比较的基线；训练样例数最多比相近模型所用数据集少 12 倍。

Insight: 方法把蒸馏信号从最终答对与否细化为推理步骤的逻辑质量，并通过教师协作生成训练轨迹。摘要未提供教师推理成本、基线逐项分数或预算消融。

Abstract: Reasoning capabilities are critical for advancing Large Language Models, yet current approaches either require massive computational budgets or struggle to effectively distill reasoning to smaller models. Standard distillation methods rely on outcome-based rewards, failing to distinguish between sound reasoning and lucky guesses. We propose Collaborative Reasoning Distillation (CRD), a framework that enhances reasoning in compact models through three innovations: (1) interactive cross-feedback where teachers iteratively critique each other’s reasoning, (2) fine-grained step-wise quality assessment capturing logical validity independent of final answers, and (3) coherence-aware step stitching that synthesizes complementary strengths. Students are trained via Reasoning Quality Optimization (RQO) with budget constraints. Our model, CRD-4B, achieves 97.3% on MATH-500 and 70.3% on AIME’25, surpassing baselines while using only 50K training examples, up to 12 times smaller than the datasets of comparable models.

[133] YANchor-4B: Effective Long-Horizon Reasoning in O(N) Time with O(1) Memory cs.LG | cs.CLPDF

Huishan Ji, Hua Xu, Weiming Zhang, Qirui Ye

TL;DR: 提出 YANchor-4B，以递归锚点记忆实现 O(N) 生成时间和 O(1) 内存，面向长时程推理保留可供后续检索的关键信息。

Details

Motivation: 长时程推理需要访问早期信息。全历史注意力的存储和计算随上下文增长，递归压缩则可能丢失精确细节；论文尝试在固定状态内保留关键记忆并支持检索。

Result: YANchor-4B 是通用递归模型，使用多维记忆机制保存锚点供后续推理调用。摘要报告：AIME 2024–2026 的平均 pass@1 为 82.93%，HMMT 为 63.64%，明显优于包括更大模型在内的线性时间、常量状态对照；在 H100 上批量长文本生成吞吐量比 Transformer 和混合基线高数倍。作者称在数十个基准的评估中通用能力也占优，但摘要未列出其余基准细节。

Insight: 该方法试图兼顾常量内存与早期细节可访问性，关键设计是可检索的多维锚点而非单一压缩状态。吞吐数据依赖 H100 批量生成场景，摘要未给出硬件配置以外的详细设置或完整基准分数。

Abstract: Long-horizon reasoning demands access to earlier information at a manageable generation cost. Full-history attention incurs growing storage and computation, while recurrent compression can lose precise details. Therefore, we present YANchor-4B, a general-purpose recurrent model that preserves crucial memory as ANchors for retrieval during subsequent reasoning. Beyond $O(N)$-time generation and $O(1)$ memory, YANchor enables effective long-horizon reasoning through its multidimensional memory mechanism. For example, on challenging math problems, it achieves 82.93% mean pass@1 on AIME 2024–2026 and 63.64% on HMMT, substantially outperforming linear-time, constant-state counterparts, including larger models. It also delivers several-fold higher batched long-generation throughput than Transformer and hybrid baselines on H100. Furthermore, evaluations across dozens of benchmarks demonstrate YANchor’s superiority in general-purpose capabilities.

[134] SemanticFold: Latent Sequence Compression SeparatesLanguage Modeling, Decodability, and Reasoning cs.LG | cs.AI | cs.CLPDF

Mingyan Liu, Min Huang

TL;DR: 提出 SemanticFold，通过学习边界折叠提示前缀隐藏状态，并分别评估压缩对语言建模拟合、可解码性与推理表现的影响。

Details

Motivation: 潜在序列压缩可能降低长上下文推理开销，但是否保留模型推理依赖的能力尚不清楚；单一困惑度或压缩比可能无法代表生成、线性可解码性和推理等不同能力。

Result: 作者在 Qwen3-1.7B/8B、SmolLM2-1.7B、Pythia-1.4B/6.9B 五个尺度上评估，并固定目标后续 token，以教师强制比较原始与压缩前缀。五类终点包括固定目标 NLL、有限标签推理准确率、线性探针可访问性、开放生成、系统内存和延迟，变化并非随压缩比单调，也不存在通用压缩阈值。Qwen3-1.7B 在 R=1.7 时压缩后 NLL 平均降低 0.135（配对 bootstrap 10,000 次）；SmolLM2 在 R=1.2 时平均 NLL 增加 0.013；两个 Pythia 检查点基本不变。分解显示 Qwen 的有利 NLL 主要来自残差变换适配而非单纯缩短；仅 MLP 变换、不缩短序列的版本，NLL 比完整 SemanticFold 低 0.082。线性探针准确率与 macro AUC 绝对变化均小于 0.03，且置信区间跨零。

Insight: 潜在压缩的保持效果没有单一标量证书：语言模型拟合、信息可解码性与推理行为可能朝不同方向变化。固定目标协议控制了目标 token 选择对似然比较的影响；摘要未提供开放生成与系统开销的具体结果。

Abstract: We study whether latent sequence compression of prompt prefixes preserves the capabilities that large language models rely on during inference. We introduce SemanticFold, a compression scheme that folds prefix hidden states at learned boundaries, and evaluate it across five model scales: Qwen3-1.7B, Qwen3-8B, SmolLM2-1.7B, Pythia-1.4B, and Pythia-6.9B. We use a fixed-target protocol: a frozen prefix is executed natively or compressed, and both arms teacher-force identical continuation tokens. This design rules out target-selection explanations for likelihood changes. We examine five endpoint families: fixed-target negative log-likelihood, finite-label reasoning accuracy, linear probe accessibility, open-ended generation, and systems-level memory and latency. We find that compression moves these endpoints non-monotonically and that they do not share a single compression threshold. On Qwen3-1.7B at compression ratio R=1.7, compressed-minus-native mean NLL decreases by 0.135 under paired bootstrap with 10000 draws. On SmolLM2 at R=1.2, the mean change is 0.013 higher than native. On both Pythia checkpoints, NLL is effectively unchanged. An NLL decomposition separating sequence shortening from the learned residual transform shows that the favorable Qwen likelihood is attributable primarily to residual adaptation rather than to shortening alone. MLP-only, which applies the transform without shortening, achieves 0.082 lower NLL than Full SemanticFold. Linear probe accuracy and macro AUC change by less than 0.03 in absolute value across conditions, with confidence intervals crossing zero. We conclude that preservation under latent compression has no single scalar certificate: language-model fit, decodability, and reasoning behavior answer different questions and can move in different directions under the same compression operation.

[135] Training Parallel Speculative Draft Models by Directly Minimizing Expected Decoding Rounds cs.LG | cs.AI | cs.CL | stat.MLPDF

Yunxiao Zhao, Changxiao Cai

TL;DR: 提出 EDR 目标直接最小化并行推测解码的期望轮数，并推导无偏时序差分梯度与共享目标模型轨迹上的离线轮数评估。

Details

Motivation: 并行/半自回归草稿模型可一次预测一块 token，但某位置的草稿分布取决于解码轮起点，而起点又由先前轮接受的 token 数决定。逐块局部代理忽视这种跨轮耦合，因此未直接优化全局解码效率。

Result: 论文将推测解码表示为马尔可夫奖励过程，得到 EDR 目标：按状态占用概率加权局部拒绝代价，且目标值精确等于期望解码轮数，不需要辅助超参数。作者进一步推导基于目标模型 rollout 的无偏时序差分梯度，并给出无需运行实际推测解码的精确离线轮数评估器，可在共享 rollout 上配对比较草稿模型。用 EDR 微调两个 SOTA 草稿器 DSpark 和 DFly 后，在覆盖数学推理、代码生成和聊天的九个基准上，平均接受长度一致改善，并优于已有训练目标。

Insight: EDR 直接对齐全局解码轮数，显式考虑接受长度改变后续轮起点的反馈，避免依赖局部近似目标。摘要没有列出九个基准的逐项提速或接受长度数值。

Abstract: Speculative decoding accelerates large language model inference by using a low-cost draft model to propose tokens that the full-size target model verifies in parallel. Parallel and semi-autoregressive (semi- AR) drafters improve drafting efficiency by proposing an entire block in a single forward pass, but training them raises a new difficulty: the draft distribution for a given position depends on where the decoding round starts, and where rounds start depends on how many tokens earlier rounds accepted. Existing training objectives typically rely on block-local surrogates that ignore this cross-round coupling, and therefore do not directly optimize the global decoding efficiency. In this work, we develop a theoretical framework for training and evaluating these drafters by representing speculative decoding as a Markov reward process. This formulation yields the Expected Decoding Rounds (EDR) objective, which weights local rejection costs by state occupancies and exactly equals the expected number of decoding rounds. Unlike prior surrogate objectives, EDR introduces no auxiliary hyperparameters. We then derive an exact temporal-difference gradient that supports unbiased stochastic optimization from target-model rollouts. The same framework also yields an exact offline evaluator for round counts, enabling paired drafter comparisons on shared target rollouts without running speculative decoding. Finetuning two state-of-the- art drafters, DSpark and DFly, with EDR consistently improves mean accepted length and outperforms existing training objectives across nine benchmarks spanning math reasoning, code generation, and chat.

[136] Which Rollout Taught It That? BehaviorTrace and the Limits of Training-Data Attribution in Online RL cs.LG | cs.CLPDF

Amit Nautiyal

TL;DR: 提出 BehaviorTrace 评测框架，使用已知成因的植入行为检验在线 GRPO 强化学习中训练 rollout 归因的可信度，并发现多种混杂因素会造成虚假归因信号。

Details

Motivation: 当 RL 让语言模型学会新行为时，研究者希望找出具体哪些训练 rollout 教会了它；但归因方法是否找到真实原因难以验证。

Result: BehaviorTrace 结合完整梯度草图、已知原因的植入行为，以及对梯度大小、流畅度、学习余量和随机种子/生成采样变化的控制。在 Qwen2.5-1.5B 的三个随机种子上，许多表面归因信号由混杂因素驱动：仅按梯度大小排序且不使用行为目标的对照达到随机水平的 4.2–4.5 倍，并在三个种子中的两个匹配或超过最佳目标归因器；在饱和检查点上，模型流畅度对行为标签的预测能力至少与所有所测梯度方法相当。控制流畅度后，逐 rollout 结果会随随机种子和生成采样变化，单次运行无法定论。三个种子中稳定的信号是：触发 token 的梯度与行为实际发生处构造的目标相对齐。作者评测 GAS（重归一化 TracInCP）和 TRAK 式方法，但未提出新归因器。

Insight: 强化学习 rollout 的梯度归因容易被梯度幅度和模型状态等因素误导；需要已知因果行为、控制混杂并跨种子和采样复现。论文结论是方法评测清单与证据审计，不是提出更优归因算法。

Abstract: When reinforcement learning teaches a language model a new behavior, can we find the training rollouts that taught it? And when an attribution method says it can, how do we know the answer is real? We study both questions on online RL fine-tuning with GRPO, using a planted behavior with a known cause. We release BehaviorTrace, an open evaluation harness that combines full-gradient sketching, the planted-behavior setup, and controls for gradient magnitude, fluency, headroom, and variation across seeds and generation draws. Across three seeds on Qwen2.5-1.5B, much of the apparent attribution signal comes from confounds. A control that ranks training steps by gradient size alone, with no behavior target, reaches 4.2 to 4.5 times chance and matches or beats the best targeted estimator on two of three seeds. At saturated checkpoints, model fluency predicts the behavior label at least as well as every gradient method we compared it with. Once fluency is controlled, the per-rollout results change from seed to seed and from one generation draw to the next, so a single run cannot settle the question. One signal does hold on all three seeds. The gradient of the trigger tokens aligns with a target built where the behavior actually occurs. We turn these findings into a checklist for evaluating attribution in RL. We test existing estimators, including GAS (renormalized TracInCP) and a TRAK-style estimator, and do not propose a new one.

[137] Decoupling Exploration from Optimization in RLVR cs.LG | cs.AI | cs.CLPDF

Saif Punjwani, Micah Goldblum

TL;DR: 提出探索—蒸馏 ExpDis，将带新颖性奖励的探索策略与不带该奖励的学生优化分开，循环筛选并蒸馏正确高质量轨迹。

Details

Motivation: 可验证奖励强化学习（RLVR）理应帮助模型发现训练数据中未见的新推理策略，但强新颖性奖励常效果有限且可能损害模型质量；狭窄的可验证奖励监督也使退化难以恢复。

Result: ExpDis 训练一个或多个含新颖性奖励的探索器，筛选正确和高质量轨迹，再蒸馏至独立学生；学生不使用新颖性奖励训练，随后重复多轮探索与优化。该解耦允许增强探索而不直接损害学生。在两个模型系列、七个数学推理基准上，同等墙钟预算下 ExpDis 优于 DAPO；pass@k 随 k 提升的扩展性也更好，表明模型能产生更多样的正确解。

Insight: 把高风险探索限制在探索器中，再以过滤后的正确轨迹改善学生，避免新颖性奖励直接破坏部署模型。摘要没有给出各基准分数和模型规模，结论限于所测数学任务与两个模型系列。

Abstract: Modern language models undergo reinforcement learning with verifiable rewards (RLVR) on top of already-trained checkpoints. A key promise of RLVR is the discovery of new reasoning strategies. In principle, a model can sample novel ideas absent from its prior training data. In practice, however, augmenting RLVR with strong novelty incentives has seen limited success and can degrade model quality. Because verifiable rewards supervise only a narrow slice of the model’s knowledge and behavior, such degradations are difficult to recover from. Instead, we decouple exploration from optimization in a framework we call Exploration-Distillation (ExpDis). We train one or more explorer policies with a novelty bonus in the reward, filter their trajectories for correctness and quality, and distill them into a separate student policy. The student policy is then trained without a novelty bonus. We repeat the above procedure for several rounds, alternating between exploration and optimization. This decoupling allows us to aggressively scale exploration without degrading the student policy. Across seven mathematical reasoning benchmarks and two model families, ExpDis outperforms DAPO at the same wall-clock budget. Moreover, we observe improved pass@$k$ scaling, indicating that ExpDis produces models that generate more diverse correct solutions.

[138] LeCuration: A Tiny World Model as a Data Curation Multi-Tool cs.LG | cs.AI | cs.CV | cs.ROPDF

Mayank Sengupta, Nirmit Desai, Eric Song, Kunal Sawarkar

TL;DR: 提出 LeCuration，以小型世界模型作为物理 AI 数据整理工具，用于异常检测、内容聚类和游戏动作—状态一致性的定性审查。

Details

Motivation: 仓储机器人或游戏智能体等物理 AI 通常处于物理规律有限的封闭环境，数据整理可针对每个数据集的特定世界和规则进行。作者探索用小世界模型辅助更大下游模型的数据筛选与组织。

Result: LeCuration 以 LeWorldModel 的潜变量编码器和预测器为主体，并加扩散 Transformer 解码器为自回归游戏轨迹生成视觉画面。作者观察到模型嵌入可用于异常检测与内容聚类，预测游戏状态可定性检查动作—状态一致性。本文是基于 CS:GO 游戏数据的定性概念验证，尚未报告量化数据整理指标或下游训练收益，并将其列为后续关键工作。

Insight: 小型世界模型可充当数据多工具，但目前只证明了在单个游戏数据上的定性用途；尚无量化筛选质量或模型训练效果证据。

Abstract: Many applications of physical AI run within finite or closed physical worlds with a limited set of physical laws governing object behavior. Examples include robots working in a warehouse and agents moving around in a video game. In order to better organize, filter, and curate data for physical AI applications, we propose a new approach centered on the unique settings and physical laws of individual datasets. We train LeCuration, a small world model intended to serve as a data curation tool for a separate, larger downstream model. To build this model, we choose LeWorldModel (LeWM)as our latent encoder and predictor, adding a diffusion transformer (DiT) decoder to add visuals to autoregressive gameplay rollout. We find that the embeddings of this model can be used as an anomaly detection signal and as a content-based clustering heuristic, and that auto-regressively predicting the game state with this model allows us to qualitatively check for action-state consistency. This paper presents a qualitative, proof-of-concept case study on CS:GO gameplay data; we do not yet report quantitative curation metrics or downstream training results, which we identify as the key next step.

Dominik Schnaus, Thomas Dagès, Daniel Cremers, Xi Wang, Phillip Isola

TL;DR: 研究独立训练的不同模态表示是否共享可对齐几何，并提出不需配对样本的 Wasserstein Procrustes 粗对齐方法。

Details

Motivation: 跨模态零样本分类与检索通常需要大量成对数据对齐独立训练的模型。Platonic Representation Hypothesis 暗示不同模态模型可能自然形成共享几何，论文检验粗粒度对齐是否可在没有配对样本时实现。

Result: 作者用粗几何初始化的 Wasserstein Procrustes，在两个不相交嵌入集合间估计单个正交映射，不访问任何配对样本。跨数据集、模态和单模态模型的实验显示，无配对表示通常可稳定对齐；标准几何对齐指标可预测何时可行。加入少量配对样本时，该方法明显优于既有方法；配对样本更多时仍与配对监督方法有竞争力。作者还展示可用无配对对齐支持文生图。摘要未提供具体模型、指标或图像生成质量数值。

Insight: 单模态表示常共享足够的几何结构，使跨模态对应不必从大量成对监督开始；少量配对数据仍可进一步改善对齐。结论针对粗粒度对齐与所测设置，不代表所有模态表示都能无监督对齐。

Abstract: Multimodal representations enable zero-shot classification and retrieval, but aligning independently trained models usually requires large amounts of paired data. Yet, the Platonic Representation Hypothesis suggests that models trained on different modalities may converge spontaneously toward a shared representation geometry. But then, do we even need paired examples for cross-modal alignment? Remarkably, we show that paired examples are unnecessary for coarse cross-modal alignment. Our simple Wasserstein Procrustes method with a coarse geometric initialization aligns two disjoint embedding sets by estimating a single orthogonal map without seeing any pairs. Across datasets, modalities, and unimodal models, we show that we can consistently align independently trained representations without pairs, and standard geometric alignment metrics accurately predict when this is possible. Nevertheless, we can naturally benefit from paired examples. In the very few-pair regime, our method substantially outperforms existing ones, while staying competitive with pair-based methods with more added examples. Finally, we demonstrate that the resulting alignments can enable text-to-image generation without paired examples. These results show that independently trained models often share enough geometry to establish cross-modal correspondence with little or no paired data.

[140] Multimodal LLMs Can Learn to Read Brain Signals: A Vision–Language Model for Unified Multi-Task EEG Decoding cs.LG | cs.AI | cs.CVPDF

Parastoo Azizeddin, Omid Sharafi, Maryam M. Shanechi

TL;DR: 提出 BraVista，将多通道 EEG 编码成结构化图像并用指令条件视觉语言模型统一解码多类脑电任务，无需单独进行大规模 EEG 预训练。

Details

Motivation: EEG 表征要跨认知任务、受试者和采集条件泛化仍具挑战。基础模型虽提升脑电解码，但如何将神经信号有效接入以支持多数据集多任务学习仍未解决。

Result: BraVista 通过结构化图像表示多通道 EEG，继续后训练通用领域 VLM，利用已有视觉和语言先验适配脑电信号。评估覆盖四个数据集及睡眠分期、情绪识别、认知负荷分类、异常 EEG 检测。作者报告各任务表现强，并发现 EEG 到图像的表示选择对效果至关重要。受控信号扰动显示噪声增加时性能逐步下降，支持模型利用 EEG 相关信息而非表面视觉图案；摘要未给出具体分数。

Insight: 结构化图像为通用 VLM 接入 EEG 提供了统一接口，避免专门的大规模脑电预训练。扰动实验提供信号相关性证据，但摘要没有报告跨受试者设置、基线分数或噪声鲁棒性的具体量化结果。

Abstract: Learning EEG representations that generalize across cognitive tasks, subjects, and recording conditions remains a key challenge in electroencephalography (EEG) decoding. Recent advances in foundation models have improved EEG decoding performance, yet a fundamental open question remains: how to effectively interface neural signals with these models to enable multi-task learning across datasets. To investigate this question, we introduce BraVista, a visual-language framework that encodes multichannel EEG signals as structured images and enables multi-task learning through instruction-conditioned vision-language models (VLMs). Our approach relies on continued post-training of a general-domain VLM, leveraging its visual and linguistic priors to adapt to neural signals without a separate large-scale EEG-specific pretraining stage. We evaluate BraVista on four datasets spanning sleep staging, emotion recognition, cognitive workload classification, and abnormal EEG detection, showing strong performance across these tasks. Further analyses show that the choice of EEG-to-image representation is critical to performance. Moreover, through controlled perturbations of the EEG signal, we observe a gradual performance degradation under increasing noise, suggesting that the model relies on EEG-relevant information rather than superficial visual patterns. Together, these findings establish structured visual representations as an effective and scalable interface between neural signals and general-domain foundation models for unified multi-task EEG decoding.

cs.MM [Back]

[141] MemoCare: An Interactive Multimodal Mobile System for Automated Cognitive Screening cs.MM | cs.CV | cs.HCPDF

Duy-Cat Can, Mau Minh Phuc Le, Tuan-Khoa Hoang, Hai-Dang Nguyen, Trung-Hieu Do

TL;DR: 介绍 MemoCare 移动端多模态认知筛查系统，整合语音、时空定向、触屏和绘图任务，并报告软件用例、绘图模型及临床人员工作流评估。

Details

Motivation: 自动化认知筛查需要覆盖多类任务输入并可靠计分；系统需处理语音文本、空间位置、触屏行为和视觉构图，同时保证任务流程便于使用。

Result: React Native 应用提供完整英语和越南语流程：语音由 Google Speech-to-Text 转写并用确定性任务规则本地评分；GPS 由空间模块解析后匹配答案；触屏依据交互事件评分；绘图采用三模型 CNN 共识并单独视觉解读。预定义软件测试通过 151/151 语音语言、空间答案和触屏案例，空间回归测试通过 48/48 个四国坐标解析案例。绘图模块验证集选择的 ShuffleNetV2 x1.5 在锁定的 71 张图像测试集上，平均平衡准确率 91.33%，三项标准完全正确率 78.87%。四位临床共同作者检查端到端流程，八项标准的合并中位评分为 4/5，单项中位数为 3–4.5。

Insight: 系统以本地确定性规则处理多数计分，只将学习模型用于绘图理解，并覆盖完整多模态交互流程。工作流专家评分是四位临床作者评审，不等于独立临床有效性研究；摘要提到会议现场可体验缩短版。

Abstract: MemoCare is an interactive mobile system for automated multimodal cognitive screening. A React Native application combines spoken responses, temporal and spatial orientation, touchscreen actions, and visuoconstruction in complete English and Vietnamese workflows. Speech is transcribed by Google Speech-to-Text and scored locally with deterministic task-specific natural language processing rules; GPS coordinates are resolved by the MemoCare spatial module before answer matching; touch tasks are scored from interaction events; and the drawing task uses a three-model convolutional neural network consensus with separate visual interpretation. Software tests pass 151/151 predefined cases across speech/language, spatial-answer, and touch-interaction scoring, while spatial regression passes 48/48 four-country coordinate-resolution cases. For the drawing module, validation-selected ShuffleNetV2 x1.5 achieved 91.33% mean balanced accuracy and 78.87% exact three-criterion accuracy on a locked 71-image test set. Four clinician co-authors additionally inspected the end-to-end workflow, yielding a pooled median rating of 4/5 across eight criteria, with item-level medians ranging from 3 to 4.5. At MMM, attendees can directly try a shortened multimodal screening workflow and inspect automatic item-level and total scoring.

cs.RO [Back]

[142] Rephrase Before You Act: Characterizing and Mitigating Language Sensitivity in Vision-Language-Action Models cs.RO | cs.CL | cs.LGPDF

Mikey Watts, Yuchen Cui

TL;DR: 研究视觉语言动作模型对指令措辞的敏感性，并提出先用少量训练任务归纳重述规则、部署时改写指令的免重训缓解方法。

Details

Motivation: VLA 对指令措辞可能高度敏感，且没有继承底层 VLM 的语言鲁棒性；单词替换即可导致成功率大幅变化，构成训练分布外任务可靠性问题。

Result: 论文用经过统计检验的单编辑成功率变化和 oracle 短语搜索刻画敏感性。π0.5 在 LIBERO 中，“switch on the stove”成功率 100%，换成“switch on the hot plate”仅 2%；加入重述增强微调的 π0 检查点仍出现最高 61 个百分点波动。Oracle 搜索显示，仅改写措辞几乎可弥合分布内外任务 21 个百分点的差距。方法在少数训练任务上评估多种措辞，让 LLM 将证据提炼为 10–20 条重述规则，部署时按规则改写输入一次，不修改策略。冻结 π0 在 12 个留出任务和对抗、VLM 生成及人工生成措辞下相对提升 16–27%；增益主要在分布外任务。迁移到 π0.5 与 LIBERO 后，微调内成功率由 93.6% 提升至 97.8%。无需重训或逐步校验，并声称可零样本应用于未见任务与指令。

Insight: 误差源可被规则化地处理：先从有限任务的成功/失败证据归纳表达方式，再在动作执行前统一改写。oracle 结果说明语言改写空间很重要，但方法报告的实用增益仍取决于规则提取与测试任务覆盖。

Abstract: Vision-language-action models (VLAs) are strikingly sensitive to instruction phrasing and do not inherit the language robustness of the vision-language models they are built on. A one-word edit can move success by tens of points: $π_{0.5}$ turns on a LIBERO stove 100% of the time for “switch on the stove” and 2% for “switch on the hot plate”, and a $π_0$ checkpoint finetuned with rephrase augmentation still shows swings of up to 61 points. We characterize this sensitivity with statistically tested single-edit swings and an oracle phrase search, which shows that phrasing alone nearly closes the 21-point gap between in-distribution and out-of-distribution tasks. We then reduce it without modifying the policy. Because the sensitivity is systematic, it can be expressed as explicit rules: we score many phrasings of a few training tasks, have a large language model distill the evidence into ten to twenty rephrasing rules, and at deployment rewrite each incoming instruction once under these rules. The rules improve the frozen $π_0$ by 16 to 27% relative on twelve held-out tasks across adversarial, VLM-generated, and human-generated phrasings, with gains concentrated on out-of-distribution tasks. The pipeline replicates on $π_{0.5}$ and LIBERO, lifting in-finetune success from 93.6% to 97.8%. The method requires no retraining and no per-step verification, and applies zero-shot to unseen tasks and instructions. Project website: https://sttawm.github.io/rephrase-before-you-act

[143] CIRRA: Dual-Level Continual Instruction Reconciliation with Ongoing Execution for Embodied Robot Agents in Interactive Household Tasks cs.RO | cs.CVPDF

Ci Zhang, Enfu Nan, Arman Akbari, Lin Zhao, Li Wang

TL;DR: 提出 CIRRA，通过语义推理和规则约束的结构整合，在家务任务执行期间局部融合新指令，尽量保留原计划顺序并复用已有子任务。

Details

Motivation: 家务机器人需在持续执行时接收新指令。现有系统常重新生成或大幅重排剩余计划，容易引发顺序含糊、逻辑冲突和重复执行。

Result: CIRRA 先将新指令落到唯一可执行技能，并消解动作或执行地点歧义；保留进行中子任务作为执行骨架，将新子任务插入地点匹配片段，再仅让语义推理器检查修改段的依赖与冲突并选取一致整合。作者构建 CHIRP 文本基准，覆盖 8 种家庭环境、6 类日常活动和 120 个 episode。CIRRA 决策一致率为 74.2%，比最强重规划基线高 30 个百分点；每个正确融合决策都生成位置正确、无冲突的计划。在 Unitree G1 人形机器人上，每次试验都在正确时机中断正在执行的技能，且所有指标均显著优于基线。

Insight: 局部插入并保留已执行计划骨架，既减少全盘改写的不确定性，也可复用共享子任务。文本基准结果和 G1 实机试验共同提供证据，但摘要未给出实机样本量和各指标数值。

Abstract: Household robots must accommodate new user instructions while executing ongoing tasks. Existing agents often regenerate or extensively revise the remaining task sequence, introducing plan ambiguity, logical inconsistency, and redundant execution. We formulate continual instruction reconciliation and propose CIRRA (Continual Instruction Reconciliation for Robot Agents), a dual-level framework combining LLM-based semantic reasoning with rule-constrained structural integration. CIRRA first grounds incoming instructions to unique executable skills and resolves underspecified actions and execution locations. It then preserves the ongoing subtask sequence as an execution backbone and generates integration candidates by inserting incoming subtasks into location-matched segments. The semantic reasoner evaluates only modified segments to identify dependencies and conflicts and select the most logically coherent local integration. This structure-preserving process maintains alignment with ongoing execution, mitigates ambiguity and inconsistency, and reuses shared subtasks to reduce redundant execution. We also introduce CHIRP (Continual Household Instruction Reconciliation and Planning), a text-based benchmark of 120 episodes across eight household environments and six categories of everyday activities. On CHIRP, CIRRA achieves 74.2% decision agreement, exceeding the strongest replanning baseline by 30 percentage points; every correct fusion decision yields a correctly placed, conflict-free schedule. On a Unitree G1 humanoid, CIRRA interrupts ongoing skills at the correct moment in every trial and significantly outperforms all baselines on every metric.

[144] Do Better Visual Representations Always Lead to Better End-to-End Autonomous Driving? cs.RO | cs.CVPDF

Zihao Zhang, Haochen Tian, Tianyu Li, Changhui Jing, Jingliang He

TL;DR: 提出 ViRA，一种与规划器无关、保持架构及推理成本不变的视觉表示对齐框架，并分析视觉基础模型目标、辅助感知监督与端到端驾驶规划的关系。

Details

Motivation: 视觉基础模型常被引入端到端自动驾驶以利用强表征，但何时、如何让这些表征真正改善驾驶规划尚不清楚。

Result: ViRA 研究发现：VFM 引导的视觉表征在多种端到端规划器上持续提升驾驶表现，且增益延伸到零样本闭环评估；对齐目标 VFM 的选择会影响规划表现，使用不同 VFM 也可能帮助已具预训练 VFM 编码器的规划器；辅助感知监督可降低对目标选择的敏感度，将五个目标间 EPDMS 分差从 2.7 收窄至 0.5。基于此提出不使用辅助感知监督的扩散规划器 ViRA-Diffusion，在 NAVSIM v2 navtest 达到 EPDMS 92.3，比作者比较的近期方法至少高 1.9 分。

Insight: 整合视觉基础模型时应同时考虑对齐目标和规划器监督策略；辅助感知任务可能缓冲不理想的目标选择。分数只针对 NAVSIM v2 navtest，其他结论为跨规划器实验观察。

Abstract: Visual foundation models (VFMs) are increasingly integrated into end-to-end autonomous driving for their powerful representations, yet it remains unclear when these representations improve driving performance. To investigate this question, we introduce ViRA, a planner-agnostic visual representation alignment framework that keeps the planner architecture and inference cost unchanged. Our study reveals three findings: (1) VFM-guided visual representations consistently improve driving performance across diverse end-to-end planners, with gains extending to zero-shot closed-loop evaluation. (2) The choice of VFM target matters for planning performance, and alignment to a different VFM can further benefit planners with pre-trained VFM encoders. (3) Auxiliary perception supervision reduces sensitivity to VFM target selection, narrowing the EPDMS spread across five targets from 2.7 to 0.5 points and potentially compensating for less effective VFM targets. Guided by these findings, we develop ViRA-Diffusion, a diffusion-based planner trained without auxiliary perception supervision, which achieves 92.3 EPDMS on NAVSIM v2 navtest, outperforming recent methods in our comparison by at least 1.9 points. The results motivate jointly considering target selection and planner supervision when integrating VFMs into end-to-end autonomous driving. The results and demo are available at https://github.com/OpenDriveLab/ViRA.

[145] Juno: Taming Predictive Latents for Vision-Language-Action Models cs.RO | cs.CVPDF

Yuchen Zhu, Chenyi Xu, Yulin Zhang, Gang Xu, Wentao Zhu

TL;DR: 提出 Juno，以动作条件 JEPA 统一提供控制对齐表征、预测教师与可适配世界模型，并在策略训练和部署时利用未来潜变量及失败 rollout 自适应。

Details

Motivation: JEPA 预测潜在观测，可为 VLA 提供预测表征，但跨预训练、策略学习和部署使用仍面临具身控制不匹配、干扰动作学习及分布偏移下教师失准三类问题。

Result: Juno 的动作条件 JEPA 在具身匹配轨迹上预训练，并用动态 CLS 损失把运动加权 patch 动态迁移到紧凑全局状态。策略训练时将当前帧 patch 融入 VLA 感知，另以参数独立的推理分支蒸馏未来潜状态供动作生成。部署时利用所有已观测转移（包括失败 rollout）适配世界模型，冻结适配后的教师，再用 LoRA 和可训练动作头在已验证执行上重新对齐策略，不需专家纠正或任务奖励。在 SimplerEnv 上，平均成功率从最强基线 Qwen3GR00T 的 60.9% 提至 68.5%，测试时适配后达 72.7%；真实机器人遇到背景、高度和物体偏移时仍有 70%–75% 成功率，而基础策略降至 0%。

Insight: 适配利用失败经验但最终策略只用验证过的执行轨迹对齐，使测试时世界模型学习与动作纠正解耦。真实机器人结果显示对特定分布偏移有韧性，摘要未给出机器人任务数量。

Abstract: Joint-embedding predictive architectures (JEPAs) predict masked or future observations in representation space, offering a natural source of predictive latents for vision-language-action (VLA) models. Yet making these latents useful across pretraining, policy learning, and deployment requires addressing three failures: mismatch with embodiment-specific control, interference with action learning, and teacher miscalibration under distribution shifts. We introduce Juno, a unified framework built around one action-conditioned JEPA that serves as a control-aligned representation backbone, a predictive teacher, and an adaptable dynamics model. During pretraining, we train it on embodiment-matched trajectories and use a dynamic CLS loss to transfer motion-weighted patch dynamics to a compact global state. During policy learning, we fuse current-frame JEPA patches into VLA perception and use a decoupled reasoning branch with separate transformation parameters to distill future latent states for action generation. During deployment, we adapt the world model on all observed transitions, including failed rollouts, freeze the adapted teacher, and re-align the policy on verified executions using LoRA adapters and a trainable action head, without expert corrections or task rewards. On SimplerEnv, Juno raises average success from $60.9%$ to $68.5%$ over Qwen3GR00T, the strongest baseline, and test-time adaptation further reaches $72.7%$; on a real robot, it retains $70%$–$75%$ success under background, height, and object shifts where the base policy collapses to $0%$.

[146] YUBI-STAG: Contact and Semantic-Rich Alignment for VLAs via Automated Video-Language Grounding cs.RO | cs.CVPDF

Masatoshi Tateno, Takehiko Ohkawa, Yueh-Hua Wu, Hanlong Li, Tatsuya Matsushima

TL;DR: 提出 YUBI-STAG 自动为机器人操作视频补充接触、物体、手爪和空间交互标注，并蒸馏为可直接处理原始腕部视角视频的轻量 YUBI-VLM。

Details

Motivation: VLA 通过大规模预训练获得操作能力，但要由语言精确触发仍需指令与物理交互细粒度对齐。常见机器人示范只有粗任务描述，不说明哪个手爪动作、接触何物以及如何抓取移动。

Result: YUBI-STAG 结合接触物体分割与 VLM，自动标注物体身份、属性和状态、逐手爪动作、双手协调及空间定位交互。由于完整流程依赖局部序列和多阶段 VLM 推理，作者蒸馏得到 YUBI-VLM，可从未分段原始视频用少量推理调用恢复动作结构和标注，且仅需腕部视角。在 YUBI-STAG-Bench 的时间、语义和空间定位任务上，YUBI-VLM 以更少调用和更短运行时间保留大部分标注准确率，并泛化到未见操作。用这些标注后训练 VLA，可改善双手操作表现及对物体身份、操作手爪、目标位置和空间关系的指令遵循。

Insight: 从粗任务描述补全接触和空间细节后，可将自然语言与 VLA 动作粒度对齐；蒸馏降低自动标注成本。摘要未给出基准指标或实机样本规模。

Abstract: Vision-Language-Action (VLA) models acquire broad manipulation capabilities via large-scale pretraining, yet eliciting them through language requires fine-grained alignment between instructions and physical interactions. Existing robot demonstrations typically provide only coarse task descriptions, omitting how actions are executed, including which gripper acts, which object is contacted, and how it is grasped and moved. We introduce YUBI-STAG, a framework for Spatio-Temporal Annotation and Grounding that automatically enriches manipulation demonstrations with interaction-rich semantics to align pretrained VLAs with fine-grained manipulation language. Combining contact-object segmentation with vision-language models, YUBI-STAG annotates object identities, attributes and states, per-gripper actions, bimanual coordination, and spatially grounded interactions. To address YUBI-STAG’s reliance on localized sequences and multi-stage VLM inference, we distill it into YUBI-VLM. YUBI-VLM directly recovers action structure and annotations from raw, unsegmented video in few inference calls and operates from wrist views alone. We evaluate both frameworks on YUBI-STAG-Bench across temporal, semantic, and spatial grounding tasks. YUBI-VLM retains much of YUBI-STAG’s annotation accuracy with fewer inference calls and shorter runtime while generalizing to unseen manipulations. Finally, post-training VLA policies on these annotations aligns them with fine-grained language and contact-aware structure. Bimanual experiments demonstrate improved performance and instruction following, including control over object identity, acting gripper, target location, and spatial relations absent from original labels.

[147] Temporal Visuo-Tactile Learning for Dexterous Grasp Stability cs.RO | cs.CV | cs.LGPDF

Ken Nakahara, Aleksei Buvailik, Prokhor Kotov, Roberto Calandra

TL;DR: 研究高分辨率动态触觉对灵巧抓取稳定性预测的作用，采集 200 个物体、10,000 次多指抓取，并将预测器部署为实机在线重抓门控。

Details

Motivation: 人类依赖指尖触觉稳定抓取，但机器人抓取研究常聚焦视觉选点和两指夹爪；需要系统评估动态高分辨率触觉能否改善多指灵巧手的稳定性预测和抓取控制。

Result: 作者用配备四个 Digit 360 触觉传感器的多指手采集 200 个物体共 10,000 次抓取，同步记录外部视觉、本体感觉与触觉。端到端时序多模态模型根据抬升前观测预测抬升后是否稳定，并通过模态及编码器对比和受控输入消融分析。加入触觉，尤其是高分辨率动态触觉，可改善稳定性预测。部署为真实机器人在线稳定性门控后，视觉—触觉模型引导重抓使已执行抬升的成功率比非触觉门控高 10.5 个百分点。

Insight: 时序建模的丰富指尖触觉可在不显式构建接触/力学模型的情况下支持稳定抓取决策。提升是相对非触觉门控的实机成功率差，摘要未报告不同物体或传感设置的详细分层结果。

Abstract: Humans can grasp everyday objects with almost perfect success rates using fingertip tactile feedback, yet much of the robotic grasping literature emphasizes vision-based grasp selection with parallel grippers. In this work, we systematically investigate how high-resolution, dynamic tactile sensing contributes to grasp stability prediction and model-guided grasping in dexterous robotic hands. To this end, we collected a dataset of 10,000 grasp trials across 200 objects using a multi-fingered robotic hand equipped with four Digit 360 tactile sensors, recording external vision, proprioception, and tactile streams throughout each grasp. With this dataset, we trained end-to-end temporal multimodal models to predict post-lift stability from pre-lift grasp observations and compared sensing modalities and encoding backbones. Experimental results and controlled input ablations show that incorporating touch, and particularly high-resolution, dynamic touch, improves grasp stability prediction. Finally, we deployed the learned predictor as an online stability gate on the real robot, where visuo-tactile model-guided regrasping improved the success rate among executed lifts by 10.5 percentage points over a non-tactile gate. These results show how rich fingertip sensing and expressive temporal models that capture the dynamics of touch can support learned grasping with multi-fingered hands without explicit contact or force modeling, providing a scalable data-driven path from tactile experience toward stable dexterous manipulation. The dataset is publicly available at https://lasr-lab.github.io/dexterous-grasp-stability/.

Markus Gross, Andreas Greiner, Taehyoung Kim, Sivasubiramaniam Subbiah, Tomaž Cotič

TL;DR: 发布 MultiFly 真实低空无人机多模态数据集，涵盖 RGB、热成像、激光雷达和雷达，并以共享几何将少量人工 RGB 标签传播到所有模态。

Details

Motivation: 多模态航空感知需要同步、标定且语义一致的数据，但为每种传感模态分别人工标注成本高、标准也易不一致。

Result: MultiFly 覆盖四个郊区场景，共 17,272 组同步样本，含 15 个语义类别逐帧标注、标定及 GNSS-RTK/IMU 测量。仅人工标注 115 张 RGB 图像，再用共享几何向四种模态传播标签，生成另外 17,157 张 RGB、17,272 张热成像、8.4 亿个 LiDAR 点及 340 万个雷达点的标签。转移标注与留出人工标注的平均一致率为 89.93%，六组模态配对的平均语义一致性为 90.94%。作者还建立四模态语义分割基准，展示密集 LiDAR 与稀疏雷达模型的架构表现差异。

Insight: 少量人工图像标签结合共享几何可扩展到异构传感器，并维持跨模态标签一致性。作者称其为首个公开的真实低空航空基准，同时覆盖四模态的一致逐帧语义标签。

Abstract: We introduce MultiFly, a real-world, low-altitude UAV dataset for semantic perception across RGB, thermal, LiDAR, and radar modalities. MultiFly provides 17,272 synchronized samples from four suburban scenes with frame-wise annotations for 15 semantic classes, together with calibration and GNSS-RTK/IMU measurements. To avoid costly and inconsistent modality-specific annotation, we propagate labels from only 115 manually annotated RGB images through shared geometric representations to all four modalities. This approach generates semantic labels for 17,157 additional RGB images, 17,272 thermal images, 840M LiDAR points, and 3.4M radar points. Transferred annotations achieve 89.93% average agreement with held-out manual annotations, and 90.94% average semantic consistency across all six modality pairs. We further establish semantic segmentation benchmarks for all four modalities, revealing distinct architectural behavior for dense LiDAR and sparse radar data. Taken together, MultiFly provides a scalable foundation for multimodal aerial perception and, to the best of our knowledge, the first public real-world low-altitude aerial benchmark that combines consistent frame-wise semantic annotations for RGB, thermal, LiDAR, and radar. Data at https://github.com/markus-42/multifly.

[149] RoboQuest: Generalist Physical Agents that Search, Inspect and Test cs.RO | cs.AI | cs.CVPDF

Liu Renhang, Navonil Majumder, Tej Deep Pala, Soujanya Poria

TL;DR: 提出 RoboQuest 基准，评估通用实体智能体能否通过搜寻、操作检查和交互测试主动获取任务缺失信息，再据此行动并判断何时完成。

Details

Motivation: 在陌生环境中，物理智能体可能需要先找物体、检查不可见属性或试用陌生工具；仅根据初始观察直接行动不足以完成目标，且系统必须自主判断证据何时足够。

Result: RoboQuest 包含 10 个移动操作任务，覆盖搜寻、基于操作的检查和交互式测试三类不确定性。作者用统一视觉运动接口评估五个前沿多模态智能体，以及以发布的完整 episode 示范微调的 π0.5。最佳智能体仅在 23% episode 成功，微调策略几乎从不成功。若直接提供隐藏信息，孤立测试显示智能体能执行大部分所需动作，失败分析认为执行能力只解释少数失败。智能体常在获得任务所需证据前过早停止探索，也很少能避免或修复探索过程引发的扰动；多数模型仍难以通过试错学习。

Insight: 当前通用物理智能体的主要失败源是信息搜集和探索决策，而不只是动作执行。基准将搜索、主动感知和完成时机纳入同一闭环评估。

Abstract: Recent advances in multimodal foundation models have made them capable generalist physical agents for a range of manipulation tasks. However, successful operation in an unfamiliar environment may require an agent to seek task-relevant information through interaction when it is absent from the observations: it may need to determine where a relevant object is, inspect an unobserved property, or discover the effect of an unfamiliar tool. We thus introduce RoboQuest, a benchmark for goal-directed embodied exploration, where agents must actively acquire task-relevant information through physical interaction, use the resulting evidence to adapt subsequent actions, and autonomously decide when to commit to task completion. RoboQuest comprises ten mobile manipulation tasks centered on three forms of uncertainty: search, manipulation-based inspection, and interactive testing. We evaluate five frontier multimodal agents through a common visuomotor interface, as well as a $π_{0.5}$ policy fine-tuned on the full-episode demonstrations we release. The best agent succeeds in only 23% of the episodes, and the fine-tuned policy almost never succeeds. Isolated tests of the execution skills the tasks are built from, with the hidden information supplied, show that the agents can carry out most of the required actions, and our failure analysis attributes only a minority of the failures to execution. Our failure analysis further finds that the agents often stop exploring too early as they make decisions before observing the required evidence for task completion. We also find that agents rarely prevent or repair the disturbances caused by their exploration. Moreover, learning by trial and error remains difficult for most models.

[150] Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policies cs.RO | cs.CVPDF

Yihan Li, Yating Feng, Shengjiu Sun, Jianing Chen, Hao Ren

TL;DR: 提出 Agentic RSR，把场景重建、仿真策略开发和真实机器人执行连接为同一操作任务闭环，并让编码智能体依据视觉和执行反馈反复改进。

Details

Motivation: 真实机器人工作空间的模拟需保留任务相关交互，仿真策略还必须依据真实机器人可获取的观察运行；场景重建与策略开发常被分开处理，导致模拟成果难以直接迁移。

Result: 给定工作空间视频、任务描述和已知机器人模型，代理恢复度量尺度、依视觉反馈迭代细化场景，并在 MuJoCo 检查任务交互。编码代理从特权物体位姿逐步开发到视觉观测和随机化仿真策略；单次调用可交错多次观察与动作，并依据执行反馈继续、重试或修改。共享任务级接口将策略和累积经验转移至实机，再以新观测和安全检查指导执行。18 个重建场景、两种机器人上的四视角深度 MAE 为 0.1057m，Lab ΔE76 为 11.04，灰度 SSIM 为 0.6990。实机任务成功率达到仿真成功率的 80%。

Insight: RSR 不只是重建逼真场景，还把仿真里形成的策略和经验迁移到真实机器人，并保留可见观察约束。实机成功率按仿真成功率比例报告，摘要未给出各任务绝对成功率。

Abstract: A simulation of a real robot workspace must preserve task-relevant interactions, while policies developed in it must operate on observations available to the real robot. Yet scene reconstruction and policy development are often treated separately. We present Agentic Real-to-Sim-to-Real (Agentic RSR), a framework that links scene reconstruction, policy development, and real-robot execution through the same manipulation task. Given a workspace video, a task description, and a known robot model, an agent recovers metric scale, iteratively refines the scene using visual feedback, and checks task-relevant interactions in MuJoCo. A coding agent then develops an executable policy, progressing from privileged object poses to visual observations and randomized simulation. The policy can interleave multiple observations and actions within one invocation, while the agent uses execution feedback to continue, retry, or revise its approach. A shared task-level interface carries the policy and accumulated experience to the real robot, where fresh observations and safety checks guide execution. Across 18 reconstructed scenes involving two robots, the mean four-view Depth MAE against reference depth estimates is 0.1057 m, the mean Lab $ΔE_{76}$ is 11.04, and the mean grayscale SSIM is 0.6990. In real-robot experiments, the aggregate task success rate reaches 80% of the simulation task success rate, indicating substantial retention of simulated performance on hardware. Code and reconstructed scene data will be made publicly available.

[151] Long-WAM: Scaling the Context of World-Action Models cs.RO | cs.AI | cs.CVPDF

Wei Huang, Bohan Zhang, Chenzhi Liu, Isabella Liu, Shuai Yang

TL;DR: 提出 Long-WAM，通过自回归视频预训练、保留历史到未来预测结构和流式系统优化扩展实时世界动作模型的历史上下文。

Details

Motivation: 实时机器人控制需要足够视觉历史以推断运动和任务进展，但处理长历史会拖慢动作生成。作者指出，能访问更长历史不等于模型真正会利用它，视频基础模型的预训练方式是关键。

Result: Long-WAM 先用无动作标签的机器人与第一人称视频学习因果预测，再在世界动作适配阶段保留历史到未来的结构。在 RoboCasa GR-1 上，历史从 0 秒增至 19.2 秒，成功率从 63.3% 升至 78.7%；双向预训练初始化没有净收益，机器人域自回归预训练进一步提升 GR-1 和 LIBERO-Long 峰值。比较方法中，Long-WAM 在 LIBERO-Long、RoboTwin 2.0 和 DOMINO 表现最佳。流式编码、异步执行和硬件优化支持 RTX 5090、DGX Spark、Jetson AGX Thor 部署；RTX 5090 每动作块含未来视频潜预测耗时 107.4ms。Unitree G1 和 YAM 实机支持动态与长时操作；动态叠杯成功率 95%，Pi0.5 和 Fast-WAM 各 20 次试验均未成功。

Insight: 长历史收益依赖自回归预训练形成的因果时序结构；系统侧的异步和流式设计则满足实时执行约束。动态叠杯对比基于每个基线 20 次试验。

Abstract: Real-time robot control demands enough visual history to infer motion and task progress, but processing that history can delay action. We present Long-WAM, a model-system framework for scaling the context of causal world-action models under real-time control constraints. Our central finding is that access to history is not the same as using it: longer histories pay off far more when the video foundation is pretrained autoregressively (AR). We first learn causal prediction from robot and egocentric videos without action labels, then preserve this history-to-future structure during world-action adaptation. On RoboCasa GR-1, increasing context from 0.0 to 19.2 seconds raises success from 63.3% to 78.7%, whereas a bidirectionally pretrained initialization shows no net gain; robot-domain AR pretraining further raises peak success on GR-1 and LIBERO-Long. Long-WAM also achieves the best results among compared methods on LIBERO-Long, RoboTwin 2.0, and DOMINO. Streaming observation encoding, asynchronous execution, and hardware-specific acceleration enable deployment on RTX 5090, DGX Spark, and Jetson AGX Thor without dropping future prediction; on RTX 5090, each action chunk, including future-video latent prediction, takes 107.4 ms. Real-time deployment on Unitree G1 and YAM supports dynamic and long-horizon manipulation, including 95% success on dynamic cup stacking, where Pi0.5 and Fast-WAM succeed in none of 20 trials. As a memory-informed executor, Long-WAM also complements higher-level planning in composite tasks.

eess.AS [Back]

[152] EmphTTS: an emphasis-control TTS with reinforcement learning eess.AS | cs.CLPDF

Zirui Li, Rech Silas, Lauri Juvela, Tom Backstrom, Mikko Kurimo

TL;DR: EmphTTS将词级重音可控性作为强化学习目标，对非自回归TTS的时长预测器用GRPO和重音定位奖励直接优化。评测中重音可控性与客观指标最好，主观偏好显著优于合成真值和多数基线；消融显示优于SFT时长建模及简单语速调整，并缓解时长预测器与TTS模型独立训练的不匹配。

Details

Motivation: 即便文本输入明确标出重音，TTS仍难生成可控且自然的人类式重音，影响合成语音的沟通准确性。强化学习已可用偏好优化TTS，但尚未用于词级韵律控制。

Result: EmphTTS为非自回归TTS系统，对时长预测器使用Group Relative Policy Optimization及重音定位奖励，直接优化词级重音位置。实验中其重音可控性最佳、重音客观评估表现最好；主观偏好测试显著优于合成真值和多数基线。消融显示GRPO比基于监督微调的时长建模和简单语速调整更能实现重音，同时缓解独立训练的时长预测器与TTS模型间不匹配。摘要未给具体分数或偏好比例。

Insight: 重音定位可以作为时长预测器的直接奖励目标，而不只是把标记交给监督模型；强化学习还能协调时长预测和声学生成组件。摘要报告显著主观偏好但没有量化样本规模和效果值。

Abstract: Generating controllable and human-like emphasis remains an open challenge in text-to-speech, even when explicit emphasis control signals are provided in the text input, limiting the communicative accuracy of synthetic speech in real-world applications. Reinforcement learning has recently shown promise for post-training TTS systems to align with human preference, yet existing methods have not been applied to word-level prosodic control. We present EmphTTS, a non-autoregressive TTS system that applies Group Relative Policy Optimization (GRPO) to the duration predictor with an emphasis localization reward, enabling direct optimization for word-level emphasis. Evaluations show that EmphTTS achieves the best emphasis controllability and performs the best in emphasis objective evaluation. In subjective preference tests, EmphTTS is significantly preferred over synthetic groundtruth and most baselines. Ablation studies show that GRPO improves emphasis realization beyond supervised-finetuning-based duration modeling and simple speaking-rate adjustment, while alleviating the mismatch between the independently trained duration predictor and TTS model.

eess.IV [Back]

[153] Abdominal Ultrasound Simulation from Semantic Labels using Paired Label-to-Physics-Based Image Translation eess.IV | cs.CVPDF

Santiago Vitale, Duilio Deangeli, Ignacio Larrabide, José Ignacio Orlando

TL;DR: 提出从语义分割标签生成腹部超声图像的两阶段模拟流程：先预测 CT 射线投影得到的简化超声，再用解剖引导的非配对转换细化成逼真图像。

Details

Motivation: 现有腹部超声模拟常需基于 CT 解剖进行射线投射，限制了形变与病理变化的多样性。作者希望训练后能仅凭语义标签生成可控模拟，不需要推理时访问患者特异 CT。

Result: 第一阶段用 CT 射线投影输出监督模型从语义标签合成简化超声，比较 Pix2Pix 与 Semantic Diffusion Model（SDM）；第二阶段以分割引导 CycleGAN（SG-CycleGAN）细化。SDM 的形态指标优于 Pix2Pix：MAE 19.85 对 21.65、SSIM 0.28 对 0.24、mIoU 0.43 对 0.29；Pix2Pix 感知指标点估计较好：LPIPS 0.17 对 0.19、FID 0.32 对 0.37、KID 0.25 对 0.48。训练需 CT 派生分割和射线模拟，训练完成后的推理不需患者专属 CT；可编辑语义图模拟健康或病理变化。

Insight: SDM 与 Pix2Pix 在形态准确性和感知相似度上存在权衡，不能只凭单一指标判断优劣。该方案移除了推理时 CT 需求，但并未摆脱 CT 数据和物理射线结果作为训练监督。

Abstract: Purpose: Current abdominal ultrasound (US) simulation methods often require CT-based anatomical references for ray-casting, limiting deformation and pathology variability. We propose a learning-based pipeline trained to predict physics-based images derived from CT scans from semantic labels, enabling controlled simulations without patient-specific CT volumes at inference time. Methods: We introduce a two-stage pipeline that maps anatomical segmentations to realistic US images through a simplified US image. Stage~~I synthesizes this image from semantic labels using models trained on CT-based ray-casting outputs. Stage~~II refines it into a realistic US scan using anatomically guided unpaired translation. Deformations and pathologies are generated by editing anatomical maps. Results: We evaluated Pix2Pix and the Semantic Diffusion Model (SDM) in Stage~~I, followed by segmentation-guided CycleGAN (SG-CycleGAN) refinement in Stage~~II. SDM significantly outperformed Pix2Pix in morphological metrics, including MAE (19.85 vs. 21.65), SSIM (0.28 vs. 0.24), and mIoU (0.43 vs. 0.29), whereas Pix2Pix yielded better perceptual point estimates (LPIPS: 0.17 vs. 0.19; FID: 0.32 vs. 0.37; KID: 0.25 vs. 0.48). Conclusion: Training paired generative models with physics-based supervision enables approximation of CT-derived ray-casting outputs at inference time directly from semantic labels. Although the pipeline does not require patient-specific CT volumes at inference time, CT-derived segmentations and ray-casting simulations remain necessary to train Stage~I. Once trained, the framework enables controllable healthy and pathological simulations through semantic-map modification.

Table of Contents

cs.CV [Back]

[1] PanoPed: Beyond Bounding Boxes for Sim-to-Real Panoramic Pedestrian Tracking cs.CVPDF

[2] Pre-training, Reasoning, Benchmarking: X-ray Report Generation on CheXpert Plus Dataset cs.CV | cs.AIPDF

[3] VCR-Bench: A Modular Open-Source Benchmark for Video Classification Robustness cs.CVPDF

[4] SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation cs.CVPDF

[5] MoR-MLLM: Mixture of Recursions for Efficient Multimodal Large Language Models cs.CVPDF

[6] Personalize at Test Time: Learning User Preferences for Image Generation cs.CV | cs.AIPDF

[7] RACER: Reflective Agent Coupling Query Interpretation and Tool-Based Retrieval for Frame Selection in Long Video Understanding cs.CV | cs.AIPDF

[8] Shape-Bayes: Bayesian Inference of Structured Shapes under Visual Ambiguity cs.CVPDF

[9] OverLay++: Dense-Overlap Layout-to-Image Generation Dataset cs.CVPDF

[10] Anaximander: Interactively Running Geospatial Deep Learning Models on Any Compute Backend cs.CVPDF

[11] TopoCurve: Geometry-Aware Topology Reasoning via Bézier Curves in Autonomous Driving cs.CVPDF

[12] Depth-to-RGB: Repurposing a Frozen Depth Estimator for Geometry-Guided Compositing cs.CVPDF

[13] SPLATIFY: Reproduce, Discover, Innovate! From Papers and Ideas to Trainable 3DGS Code cs.CVPDF

[14] StyleFields: Multi-Scale AdaIN-Modulated Implicit SDFs for Coarse-to-Fine 3D Shape Reconstruction and Editing cs.CV | cs.GRPDF

[15] RDGSplat: Render-Dedicated Geometry for Novel View Synthesis cs.CVPDF

[16] PVSync: A Unified Lip-Sync Expert for Timing and Articulation cs.CVPDF

[17] A Deterministic Evidence Layer for Vision-Language Autism Screening from Naturalistic Home Video cs.CV | cs.AIPDF

[18] Do Vision Models Learn Physical Constraints or Rendering Shortcuts? A Counterfactual Benchmark for Grounded Physical Consistency cs.CV | cs.AIPDF

[19] Adaptive Visual Token Reduction for Accelerated Image Understanding cs.CVPDF

[20] Why VLMs Miss Small Objects, and When Zooming In Is Safe cs.CVPDF

[21] SAREO-FM: Decoupled Semantic Supervision for SAR-EO Foundation Models cs.CVPDF

[22] VIS-Ground: Video Interactive Storytelling with Contextual Grounding cs.CVPDF

[23] Visual Jev Rewards: Reference-Bound Verification for Multi-Subject Image Generation cs.CV | cs.AI | cs.LGPDF

[24] CRT-HMAR: Causal Requirement Tracing-Guided Hierarchical Multi-Agent Regulation for Open-Task-Aware Infrared-Visible Image Fusion cs.CVPDF

[25] GRC-Net: Global Representation Consistency Network for Unsupervised Multimodal Anomaly Detection cs.CVPDF

[26] PPCAR-Net: Projection-Refined Parametric 3D Coronary Artery Reconstruction from Sparse X-ray Angiographic Views cs.CVPDF

[27] Do Image Editors Follow Depth-Dependent Blur and Aperture Response? A Rendered-Ground-Truth Pilot Audit cs.CVPDF

[28] Quantifying Volumetric Risk: Class-Aware Asymmetric Weighted Conformal Prediction for 3D Medical Image Segmentation cs.CVPDF

[29] TiTok: Audio-Visual LLM for Multi-Segment Temporal Grounding cs.CVPDF

[30] trACT: temporal revelation Airborne Camera Trap cs.CVPDF

[31] SkillCycle: Co-Evolving Agent Policies and Skill Banks cs.CVPDF

[32] Spatial Latent Reasoning for Embodied Reference Understanding cs.CVPDF

[33] Event-Aligned Visual Action Reasoning for World Action Models cs.CV | cs.ROPDF

[34] Controllable Crowd Generation through World-Model Planning cs.CVPDF

[35] InscriptionOCR: A Dataset and Method for Understanding Inscriptions cs.CVPDF

[36] Mixture of Layers: Dynamic Layer Routing for Visual Reasoning cs.CV | cs.AIPDF

[37] RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning cs.CV | cs.ROPDF

[38] InstanceBench: Diagnosing Referential Reasoning and Target Identity in Referring Expression Segmentation cs.CVPDF

[39] SpatialUQ: Post-Hoc Uncertainty Quantification from Spatial Consistency in Black-Box Vision Models cs.CV | cs.AI | cs.LGPDF

[40] RT-DETR-World: Transferring Rich LLM Semantics to Real-Time Open-Vocabulary Detection cs.CVPDF

[41] OmniCam: Omni-Camera Trajectory Generation via Geometry-Grounded Pose Token Learning cs.CV | cs.AIPDF

[42] It Is Not Seeing the Hazard: A Frozen Vision-Language Safety Score Measures Its Caption Bank cs.CV | cs.LGPDF

[43] STRIKE: Learning Visual State Transitions for Physical World Modeling cs.CVPDF

[44] STORK: Spatio-Temporal Observation of uterine contRactions via neural networKs cs.CVPDF

[45] Visual Evidence Under Cross-Examination: Evaluating and Controlling Decision-Level Evidence Use in Vision-Language Models cs.CVPDF

[46] What Makes Synthetic Hard Negatives Work in Vision-Language Pretraining? cs.CV | cs.AIPDF

[47] DynStream: Online Streaming 4D Gaussian Reconstruction of Dynamic Worlds from Unposed Video cs.CVPDF

[48] Flow-of-Thought: A Framework for Visual Reasoning cs.CVPDF

[49] Beyond Group Splits: Specimen-Level Cross-Validation and Visual Attribution for Remaining-Shelf-Life Regression in Climacteric Fruit cs.CVPDF

[50] SoccerNet-FoulRet: Retrieving Semantically Similar Soccer Foul Videos cs.CV | cs.IRPDF

[51] Diffusion-Generated Image Watermarking: A Two-Axis Taxonomy and Three Protocol-Bounded Case Studies cs.CVPDF

[52] Relational Abstractions for Spatial Reasoning with Diffusion Models cs.CVPDF

[53] UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map cs.CV | cs.ROPDF

[54] Beyond Masks and Trajectories: Flow-Guided Latent Action Injection for Stable Surgical Video Generation cs.CVPDF

[55] DisParQ: Self-Supervised Part Concepts for Interpretable Vision Foundation Models cs.CV | cs.AI | cs.LGPDF

[56] UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation cs.CV | cs.AIPDF

[57] MOTIF: Person-of-Interest Deepfake Detection Beyond 3DMM Coefficients cs.CVPDF

[58] ORCA: Hunting Compositional Failures in Text-to-Image Diffusion cs.CV | cs.LGPDF

[59] Global Average Precision for Representation Learning cs.CV | cs.LGPDF

[60] Bringing BNNs to Fast Event Processing cs.CVPDF

[61] FedSSMCoOp: SSM Encoders for light-weight Federated Prompt Learning for Few-shot Classification cs.CVPDF

[62] Purifying Backdoored Large Vision-Language Models by Removing Hijacked Directions cs.CVPDF

[63] Do Generative Priors Align with Human Naturalness Perception? cs.CV | q-bio.NCPDF

[64] MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection cs.CVPDF

[65] From Pixel to Coding: Evaluating the Figure Reproduction Capabilities of MLLMs cs.CV | cs.AIPDF

[66] AdSpark: A Large-Scale Dataset and Benchmark for Product-Centric Advertisement Video Generation cs.CVPDF

[67] HeiCo-FOCUS: A Clinically Grounded Dataset for Long-Context Video Understanding cs.CVPDF

[68] Beyond Anonymous Captions: Grounding Character Identity in Video Captioning and Question Answering cs.CVPDF

[69] HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration cs.CVPDF

[70] VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding cs.CV | cs.AIPDF

[71] $Δ$Representation: Geometry Supervised Representation Learning of Phenotypes via Counterfactual Reasoning for Medical VLMs cs.CVPDF

[72] TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learning cs.CVPDF

[73] Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs cs.CVPDF

[74] Video Prediction Policy 2: Predict Better, Act Better cs.CV | cs.ROPDF

[75] On the Necessity of Attention-FFN Split in Vision Transformers cs.CVPDF

[76] One-Shot Adaptive Segmentation For Scientific Images cs.CVPDF

[77] Real-Time Joint Audio-Video Generation by Parallel Adapter Composition cs.CVPDF

[78] From Digital Human Interactions to Physics-Based Humanoid Skills: Physics-Grounded Post-Training of Interaction Generators cs.CVPDF