cs.CV [Total: 51]
cs.CL [Total: 22]
cs.AI [Total: 4]
cs.CR [Total: 2]
cs.LG [Total: 2]
cs.MM [Total: 2]
cs.RO [Total: 4]
eess.IV [Total: 1]
eess.SP [Total: 1]

cs.CV [Back]

[1] CSCWD: Cross-Scale Channel-wise Knowledge Distillation for Lightweight Tiny Object Detection on Edge Devices cs.CVPDF

Amir Zamani, Zeinab Ghasemi-Naraghi

TL;DR: CSCWD用跨尺度通道蒸馏将高分辨率教师特征传给轻量检测器，提升航拍微小目标识别而不增加推理成本。

Details

Motivation: 航拍微小目标空间证据弱，轻量检测器又易损失高分辨率细节，限制边缘设备实时检测。

Result: Drone-vs-Bird验证集mAP@0.5为50.17%、召回率59.73%，较匹配基线提高2.92及3.55个百分点；DUT-Anti-UAV零样本mAP由48.29%升至50.06%。树莓派5上12.15 FPS，运行与内存要求基本不变。

Insight: 训练阶段对齐YOLO11m-P2教师与YOLO11n学生的跨尺度特征，并在更深层保留同尺度蒸馏；推理架构不变，因此收益无需增加部署复杂度。

Abstract: Real-time tiny object detection in aerial imagery is constrained by the weak spatial evidence of very small objects and the loss of high-resolution detail in lightweight detectors. This study presents Cross-Scale Channel-wise Knowledge Distillation (CSCWD), a training-time framework that transfers high-resolution spatial representations from a YOLO11m-P2 teacher to a compact YOLO11n student without altering the student’s inference architecture. Unlike conventional same-scale feature distillation, CSCWD transfers supervision from teacher P2 to student P3 after feature alignment while retaining same-scale distillation at deeper pyramid levels. Under the unified seven-sequence Drone-vs-Bird validation protocol, YOLO11n-CSCWD achieves 50.17% mean average precision at an intersection-over-union threshold of 0.5 (mAP@0.5) and 59.73% recall, improving the matched CA-YOLO11n baseline by 2.92 percentage points in mAP@0.5 and 3.55 points in recall. Cross-scale alignment further increases mAP@0.5 by 2.09 points over the corresponding same-scale channel-wise distillation configuration. In zero-shot evaluation on DUT-Anti-UAV, mAP@0.5 increases from 48.29% to 50.06% without target-domain fine-tuning. This domain was included because its challenging small targets make low-latency, computationally efficient detection particularly relevant. On Raspberry Pi 5 using NCNN-FP16 at 640x640 resolution, the 2.58-million-parameter student achieves 50.32% mAP@0.5 at 82.32 ms mean wall-clock latency, or 12.15 frames per second, while retaining essentially the same runtime and memory requirements as the matched baseline. The results support cross-scale distillation for improving tiny-target detection without increasing inference-time model complexity.

[2] What Improves Multimodal Misinformation Detection? Answers from a Large-Scale Empirical Study cs.CV | cs.AI | cs.CL | cs.LG | cs.MMPDF

Akshit Sharma, Prashant W. Patil

TL;DR: 通过3,375余组实验系统比较多模态错误信息检测中的模型、模态和训练设计选择。

Details

Motivation: 图文错误信息会把文本主张与貌似佐证的图像组合起来，但有效检测系统依赖的设计决策很少在统一控制下比较。

Result: 在三个基准和多种视觉、语言骨干上的大规模对比提炼出各研究问题对应的设计建议；摘要未给出单一最优方案或具体效果值。

Insight: 除平均性能外，研究还进行定向鲁棒性分析，关注哪些选择何时可能悄然失效，以及流程哪些部分最影响模型行为。

Abstract: Multimodal misinformation is increasingly crafted to look convincing by pairing a textual claim with an image that appears to “prove” it. Yet in practice, building effective detectors often hinges on a small set of design choices that are rarely examined in a controlled way. In this paper, we conduct a large-scale study of multimodal design choices for misinformation detection with over 3,375 experiments- spanning three benchmark datasets and a broad range of pre-trained vision and language backbones. Through systematic comparisons and targeted robustness analyses, we distill practical guidance on which design choices help, when do they fail silently, and what aspects of the pipeline most strongly shape model behavior, answering 4 key Research Questions (RQs). We aim to provide a reliable foundation for designing stronger and more dependable multimodal misinformation detection systems, thus contributing to the broader research community.

[3] ProCAP: Probabilistic Cross-Attentive Prompt Learning for Vision-Language Models cs.CVPDF

Hiwa Azeez Abbas, Fatemeh Daneshfar, Moloud Abdar

TL;DR: ProCAP以双向交叉注意力和概率提示学习，增强CLIP在少样本及分布偏移下的适应性。

Details

Motivation: CLIP提示可识别新类别，但在标注稀少和测试分布变化时易不稳定，现有多模态提示分支交互较弱。

Result: 在11个数据集的少样本已见—新类泛化、跨数据集迁移及ImageNet域泛化上取得强总体表现，且冻结CLIP骨干；摘要未列具体分数。

Insight: 视觉和文本提示跨层双向交互，并以高斯均值—方差表示降低过拟合，再用轻量KL/L2正则及对称InfoNCE对齐共享空间。

Abstract: Pre-trained vision-language models such as CLIP can recognize new categories via prompting, but they often struggle when labeled data are scarce or the test distribution shifts. Prompt learning adapts only a small set of parameters while keeping the backbone frozen, yet many existing multimodal prompt learners couple the visual and textual branches weakly and can be brittle in low-shot regimes. We propose ProCAP, a probabilistic cross-attentive prompt learning framework that improves cross-modal interaction and training stability without updating any CLIP weights: it learns both visual and textual prompt tokens and links them through stacked bidirectional multi-head cross-attention so the two branches refine each other across prompt depth. To reduce overfitting under limited supervision, we parameterize prompt tokens with Gaussian means and variances and regularize them with lightweight KL and L2 penalties, and we further add a compact symmetric InfoNCE head that aligns cross-attended image features with class-level text representations in a shared low-dimensional space. Across few-shot base-to-novel generalization on 11 datasets, cross-dataset transfer, and domain generalization on ImageNet shift benchmarks, ProCAP achieves strong aggregate base-to-novel performance and competitive transfer performance while keeping the CLIP backbone unchanged.

[4] The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation cs.CVPDF

Soshun Kihara, Shunsuke Yasuki, Masato Taki

TL;DR: 将事件相机知识蒸馏到RGB模型，研究其诱导的形状偏置、颜色不变性和高频噪声鲁棒性。

Details

Motivation: ImageNet卷积模型偏好局部高频纹理，遇到分布变化易脆弱；事件相机捕捉亮度变化和轮廓，所带视觉偏置此前缺少系统研究。

Result: 事件域蒸馏使RGB模型更依赖边缘形状、减少纹理依赖，并对高频噪声更鲁棒；但对关键频带污染和几何结构破坏仍易受影响。

Insight: 变化可追溯到早层对颜色及空间信息的处理，形成频谱权衡；该偏置不同于既有鲁棒化方法，可作为形状线索重要任务的先验。

Abstract: Convolutional neural networks trained on ImageNet are known to exhibit a strong preference for local high-frequency texture, an inductive bias that translates into fragile robustness against distribution shifts in real-world environments. Event cameras, in contrast, record only changes in scene brightness and are therefore well suited to capturing contour information; however, due to the absence of diagnostic benchmarks in the event domain, the inductive bias that event-camera data instills in vision models has remained underexplored. In this work, we use knowledge distillation from the event domain to the RGB domain so as to exploit the rich evaluation toolkit available in the RGB domain and systematically dissect this inductive bias. Our experiments show that distillation from the event domain induces, in the RGB domain, color invariance, shape bias, and robustness to high-frequency noise. We identify the underlying mechanism as the model suppressing its dependence on high-frequency texture while acquiring a stronger dependence on edge-based object shape. This hypothesis is supported by changes in how color and spatial information are processed at the early layers, together with a spectral trade-off in which robustness to the absence of high-frequency components coexists with vulnerability to contamination of the relied-upon frequency bands and to disruption of geometric structure. We further show that this inductive bias differs from existing robustification methods and that it functions as a useful prior for diverse downstream tasks in which shape and contour information contribute alongside other cues. The code is available at https://github.com/snskysk/event2rgb-distillation .

[5] Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Bases cs.CV | cs.AIPDF

Ashish Sundar, Tiankuo Hou, Zhong Fan, Chunbo Luo, Xiaoyang Wang

TL;DR: 从无标注视频中恢复由数据决定的自运动基底，把普通视频转成带落地控制信号的世界模型训练数据。

Details

Motivation: 可控世界模型需要同步动作标签，但现成数据集难得；传感器标定和人工标注成本高，潜动作又缺乏明确物理依据。

Result: 模型能学习反向运动、线性调节响应并组合油门与转向，尽管反向样本不足1%；多数基线可沿熟悉方向行动，却难倒退或保持静止。

Insight: 用像素位移主成分提取数据中出现的有符号、可缩放和可组合油门—转向轴，并以在线潜在评论器蒸馏冻结解码器—跟踪器—PCA教师；新评估还检查可控性、合理性、凭空生成和几何完整性。

Abstract: Synchronised action annotations are needed to train controllable world models and these datasets remain elusive. Existing approaches make use of instrumented platforms with calibrated sensors, costly manual annotation, or latent-action models which lack grounding. We instead turn ordinary unlabelled video into action-supervised training data by recovering (without training) a data-derived egomotion basis. We track pixel displacements across frames and exploit the recurring coherent structure induced by egomotion to obtain grounded control signals directly. Using a method as simple as principal components analysis perform this, we find that the leading components provide signed, scalable, and composable throttle–yaw controls, although the method can recover only motion axes represented in the data. To prevent a high-capacity video DiT from exploiting pixel-level supervision, an online latent critic distils a frozen decoder–tracker–PCA (Principal Components Analysis) teacher without backpropagating through the decoder or tracker. Finally we critique the use of video generation metrics to evaluate WMs and introduce an example of an alternative, reference-free evaluation method. We measure \textit{controllability}, \textit{plausibility}, \textit{conjuring} (creating objects out of thin air) and \textit{geometric integrity}, revealing failures that conventional video metrics miss. We show that most baselines follow familiar action directions but struggle to reverse or remain stationary. Our model handles both while retaining compositional control and generation quality. Despite backwards actions being less than $1%$ of our training data, we find that the model learns to reverse, scale its response linearly, and compose throttle with steering, all simply by learning through a grounded action space.

[6] MVAgent: Multi-Agent Video Generation via Consistent Condition Construction and Shot-Level Policy Optimization cs.CVPDF

Xiangyu Kong, Wenjie Zhou, Fengping Tian, Lihua Fang, Haoqin Sun

TL;DR: MVAgent用多个协作智能体构造逐镜头条件，并按每个已渲染镜头的质量训练多镜头视频生成。

Details

Motivation: 独立生成各镜头会导致角色外观、空间布局和状态在镜头间漂移，重复文本提示无法固定这些内容。

Result: 生成器和评判器保持冻结时，MVAgent在ViMax-Bench跨镜头一致性和叙事规划质量上领先所比方法，人类评估也更偏好该方法而非最强智能体基线。

Insight: 空间定位智能体从镜头移动片段抽取匹配视角，观察器记录镜头结尾形成连续性记忆，过渡智能体据此为下一镜头制定动作与空间参照；Trunk-GDPO逐镜头比较候选并延续最佳轨迹。

Abstract: Multi-shot agentic video generation requires consistent character appearance, stable spatial layout across camera angles, and continuous character state between shots. When every shot is a separate request to a frozen generator, repeated text does not determine appearance, layout or state. We therefore recast the problem as condition construction and present MVAgent, a multi-agent pipeline whose agents collaborate through typed conditioning inputs. Because an environment image shows one viewpoint, a Spatial Grounding agent samples views from generated camera-traversal clips and anchors each shot to the view matching its framing. As generated shots drift from the plan, an Observer records how each shot ends in a continuity memory, from which a Transition agent builds character action and spatial references for the next shot. An Orchestrator composes these inputs into each request. Since a request reveals its effect only after rendering, we train it by agentic reinforcement learning with Trunk-GDPO, which compares rendered candidates at every shot rather than once per video and continues the best as the trunk. With generator and judges frozen, MVAgent attains the highest cross-shot consistency and narrative-planning quality among the compared methods on ViMax-Bench and is preferred over the strongest agentic baseline in human evaluation.

[7] Structure-Guided Masked Autoencoders for Ultra-High Resolution Scientific Image Understanding cs.CVPDF

Enzhi Zhang, Du Wu, Rui Zhong, Cong Ma, Isaac Lyngaas

TL;DR: SGMA以结构引导的掩码自编码预训练处理超高分辨率科学图像，并用四叉树tokenizer压缩巨幅输入。

Details

Motivation: 随机掩码不适配科学图像多尺度形态，统一token化又产生过长序列，使二次复杂度注意力不可行。

Result: 在电镜、全切片显微镜和X射线CT数据上持续优于MAE基线；SpringXCT达到95.68% Dice，比同架构基线高13个百分点；PAIP达到83.21%，高16.84点，推理最高加速24.8倍。

Insight: 内容自适应四叉树将巨幅图压成固定序列，结构条件掩码优先重建信息区域；阻尼累积聚合树上信号，形成跨尺度指导画布。

Abstract: Self-supervised pre-training with Vision Transformers, including Masked Autoencoders (MAE), is difficult to apply to gigapixel scientific images. Random masking is poorly matched to the structured, multi-scale morphology of scientific data, while uniform tokenization produces prohibitively long sequences that make $O(N^2)$ attention impractical. We propose SGMA, a structure-guided masked autoencoding framework for ultra-high-resolution scientific images. SGMA couples two components: a content-adaptive quadtree tokenizer that compresses gigapixel images into a fixed-length sequence, and a structure-conditioned masking process that biases reconstruction toward spatially informative regions. To stabilize this process across scales, we introduce Damped Accumulation (DA), which aggregates signal-dependent responses across the tree into a structure canvas used to guide masking. The resulting pre-training task preserves fine microstructure while remaining compatible with standard ViT encoders and MAE-style reconstruction. Across electron microscopy, whole-slide optical microscopy, and X-ray CT datasets, SGMA consistently outperforms MAE baselines. It achieves 95.68% Dice on the 8K x 8K x 28K SpringXCT dataset, improving over the same-architecture MAE baseline by +13.00 points, and 83.21% Dice on the 32K^2 WSI PAIP dataset, improving by +16.84 points, while providing up to a 24.8x inference speedup.

[8] StarWM: Self-Supervised Trained Attention Routing for Robust World Models cs.CV | cs.LGPDF

Zeqiang Zhang, Fabian Wurzberger, Maximilian Otte, Daniel Schmid, Sebastian Gottwald

TL;DR: StarWM用自监督动态学习的交叉注意力决定哪些视觉区域接受重建监督，平衡环境动力学保真与无关内容抑制。

Details

Motivation: 重建式世界模型按像素面积分配容量，易被任务无关背景主导；无重建方法则可能一并丢弃有用信息。

Result: DeepMind Control动态视频背景实验中，无奖励默认版在随机帧干扰下表现最强，在连续视频干扰下明显优于重建基线；加奖励变体在连续视频中达到所有干扰条件下最高总回报。

Insight: 交叉注意力选定重建区域，双流解码器只重建所注意内容，并通过停止梯度边界避免预测目标被非预测性纹理污染；探测显示长期想象中状态保持近乎完好且干扰被系统性丢弃。

Abstract: A robust world model must strike the balance between faithfully capturing environmental dynamics and abstracting away from irrelevant content. While reconstruction-based world models ensure faithful supervision, they misallocate representational capacity by pixel area rather than dynamics relevance for visual tasks, which can cause task-irrelevant content to dominate the learned representation. Alternatively, reconstruction-free methods avoid this bias but risk discarding possibly relevant information. We propose StarWM, which uses a cross-attention module trained on self-supervised dynamics to decide where reconstruction applies. A dual-stream decoder then restricts reconstruction to the attended regions, with stop-gradient barriers preventing interference between the two objectives. These components allows reconstruction to supervise the visual content of attended regions without contaminating the latent with non-predictive information. On DeepMind Control with dynamic video backgrounds, default (reward-free) StarWM achieves the strongest performance under random-frame distractors and substantially outperforms reconstruction-based baselines under sequential video. In addition, its reward-augmented variant matches or exceeds reconstruction-free methods on sequential video, achieving the highest overall return across all distractor regimes. Mechanistic probing confirms StarWM preserves state attributes with near-perfect fidelity through long-horizon imagination while systematically discarding distractors.

[9] MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classification cs.CV | cs.AIPDF

Zhexiang Li

TL;DR: MedTokenBudget用皮损区域监督训练视觉token路由器，在紧预算下保留皮肤镜图像的关键病灶证据。

Details

Motivation: ViT通常均匀处理所有图块，但诊断证据集中于皮损；通用剪枝方法很少验证保留token是否仍包含病灶。

Result: ISIC 2019上，掩码监督LATS在主要预算下持续优于Random和ToMe，并保留更多病灶图块。

Insight: LATS融合注意力熵、特征范数和局部对比度评分，按预算选择top-K图块；课程式预算训练、多样性正则、注意力蒸馏及病灶掩码共同约束。

Abstract: Dermoscopy classifiers built on Vision Transformers process all image patches uniformly, although diagnostic evidence is concentrated in the lesion region. Existing token pruning methods reduce tokens using generic saliency or similarity signals, but rarely ask whether the retained subset still contains the lesion. This paper introduces MedTokenBudget, a supervised post-backbone token routing framework that learns to construct compact lesion-enriched representations when auxiliary lesion masks are available. Its Lesion-Aware Token Scoring (LATS) module fuses attention entropy, feature norm, and local feature contrast through a learned scorer, then routes the top-$K$ patches under a target budget. LATS is trained with budget curriculum learning, diversity regularization, attention distillation, and lesion-mask supervision. The trained router is evaluated with a lesion retention rate that directly measures how much ground-truth lesion evidence survives the token budget. On ISIC 2019, mask-supervised LATS consistently outperforms Random and ToMe at headline budgets while retaining substantially more lesion patches. Code is provided for reproducibility, and complete tabulated results are included in the supplementary material.

[10] MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning cs.CVPDF

Peipei Li, Shuhan Xia, Shengyang Liu, Zekun Li, Ran He

TL;DR: MM-VeriAgent通过强化学习学习何时调用文本、视觉及跨模态取证工具，适配不同来源的多模态错误信息。

Details

Motivation: 现实伪造可能混合多种来源，固定工具流程适应性差，推理时规划又增加成本。

Result: 在MMFakeBench上，训练后的智能体较基础模型显著提升准确率，无需推理时显式工具搜索；工具缓存减少了训练过程在线执行量。

Insight: 先建立统一接口的MM-VeriTools，再以强化学习学习工具使用策略；Tool-Execution Cache预先执行候选工具调用并复用结果，保留多步轨迹训练而降低开销。

Abstract: Real-world multimodal misinformation often involves mixed forgery sources, requiring sample-specific detection strategies. Existing tool-augmented methods rely on predefined workflows or inference-time planning, limiting adaptability or increasing inference cost. To address this issue, we introduce \textbf{MM-VeriAgent}, which learns to verify mixed-source multimodal misinformation with tools. We first build \textbf{MM-VeriTools}, a specialized toolkit for misinformation detection agents. By benchmarking various candidate models and methods on the sub-tasks required by mixed-source detection, we select the strongest for textual, visual, and cross-modal forgery analysis and encapsulate them as callable tools with a unified interface. On top of this toolkit, we train the LVLM agent with reinforcement learning to teach it how to use these tools to better solve mixed-source detection. Since many of the tools are specialized models whose online execution at every rollout severely limits RL efficiency, we further introduce \textbf{Tool-Execution Cache}, which pre-executes candidate tool calls and reuses their cached outputs during training. This preserves multi-step rollouts while reducing online tool execution, largely improving the training efficiency.Experiments on MMFakeBench demonstrate substantial accuracy gains over the base model without explicit tool search at inference time. Ablation and efficiency analyses further validate the learned tool-use policy and show that Tool-Execution Cache reduces online tool executions during training.

[11] SAGE: Source-Anchored Guidance via Frequency Equalization for Hierarchical RGB-T Alignment and Fusion cs.CV | cs.AIPDF

Timing Li, Yiming Sun, Boan Tao, Xiyuan Gao, Haifang Cao

TL;DR: SAGE以源锚定频率指导统一建模RGB—热红外图像对齐与融合，缓解错位和模态信息失衡。

Details

Motivation: 传感器错位及跨模态差异会造成重影、结构模糊和内容失衡，现有流程常把外观适配、几何对齐和融合割裂处理。

Result: 在真实和合成错位的RGB-T数据集上，对齐和融合性能持续有竞争力。

Insight: 可逆联合编码与源特定低频调制提取结构和增益指导；低频估计全局仿射关系并把上下文传至高频相关性细化，最终在指导下融合子带并逆小波重建。

Abstract: Spatial misregistration and cross-modal discrepancies often cause ghosting, structural blurring, and content imbalance in RGB-T fusion. Existing methods typically decouple appearance adaptation, geometric alignment, and information fusion, limiting dependency propagation across stages. We propose Source-Anchored Guidance via Frequency Equalization for Hierarchical RGB-T Alignment and Fusion (SAGE), a unified framework integrating frequency equalization, hierarchical alignment, and subband fusion. SAGE employs invertible joint encoding and source-specific low-frequency modulation to derive structural and gain guidance while preserving source information. Hierarchical frequency collaborative alignment estimates global affine geometry from low-frequency approximations and transfers geometric and contextual cues to high-frequency correlation reasoning for reliability-aware residual refinement. Guided subband fusion jointly aggregates the aligned frequency coefficients under propagated source and alignment guidance, coordinates complementary low- and high-frequency information, and reconstructs the fused image through the inverse wavelet transform. Extensive experiments on RGB-T datasets with real-world and synthetic misalignments demonstrate consistently competitive performance in alignment and fusion, validating the effectiveness of source-anchored guidance for weakly registered RGB-T images.

[12] VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control cs.CV | cs.AIPDF

Kemou Jiang, Maonan Wang, Xingchen Zou, Jiayue Zhu, Yuhang Fu

TL;DR: VLALight用5亿参数端到端视觉语言动作模型读取多视角路口画面并直接控制交通信号。

Details

Motivation: 多模块串联系统需要反复转换视觉信息，容易丢失细节；顺序推理还会增加延迟。

Result: 与级联VLMLight相比，紧急车辆累计等待时间减少21.1%；本地硬件上实时运行，并能泛化到未见路口结构和交通流模式。

Insight: 融合多个方向的摄像机输入，并通过文本指令标明画面与交通流/信号相位的关系；模型直接输出离散信号动作，无需先生成图像描述或手工交通状态表示。

Abstract: Traffic signal control (TSC) is essential for mitigating urban congestion. Recent advances in vision-language models (VLMs) enable richer interpretation of intersection scenes, opening new opportunities for visual-context-aware TSC. However, the loose coupling and repeated information conversion between modules can lead to the loss of fine-grained visual details, while sequential inference introduces substantial latency. To address these limitations, we propose VLALight, a lightweight end-to-end vision-language-action framework that directly maps intersection observations and signal-phase information to discrete signal actions. To handle the multi-view nature of TSC, VLALight combines multiple directional camera views into a unified visual input and uses textual instructions to establish their correspondence with traffic movements and signal phases. This design enables direct action prediction with a compact 0.5 B-parameter model, without intermediate image-to-text descriptions or handcrafted traffic-state representations. Experiments show that VLALight delivers the best emergency-vehicle service of all compared methods, reducing pooled emergency waiting time by 21.1% over the cascaded VLMLight while running in real time on local hardware and generalizing to unseen intersection topologies and traffic-flow patterns.

[13] TrafficImag: A Benchmark for Counterfactual Roadside Traffic Video Generation cs.CV | cs.AIPDF

Xiangyu Li, Tianyi Wang, Zhihao Dou, Christian Claudel, Zhaomiao Guo

TL;DR: TrafficImag建立路侧交通反事实视频生成基准，要求修改指定车辆后仍遵守道路拓扑并保持其他交通参与者。

Details

Motivation: 现有交通数据支持感知、预测和问答，却无法衡量模型能否生成物理及道路条件一致的反事实未来。

Result: 数据含9,022张标注图像、7,043段去重视频及31,145组主体历史—未来样本；完整条件接口将最佳生成器端到端成功率从23.3%提高到55.0%，但条件视频执行仍是主要瓶颈。

Insight: 把干预编码为参与者级程序，说明对象、行为、合法路线、交互顺序和时间约束；成功要求初始状态、行为路线、交互一致性和非目标保留四项全部满足。

Abstract: Existing roadside traffic datasets support perception, forecasting, and visual question answering, but they do not evaluate counterfactual video generation, in which a selected actor is modified and the generated future should remain consistent with road topology and unrelated traffic. We introduce TrafficImag, the first benchmark for counterfactual roadside traffic video generation. TrafficImag combines a large-scale roadside dataset (9,022 annotated images, 7,043 deduplicated video clips, and 31,145 actor-centered history-future samples) with an executable protocol that supports behavior reasoning, intervention-aware image editing, and conditional video generation. Each intervention is represented as an actor-level program describing the target actor, intended behavior, legal route, interaction order, and temporal constraints, enabling a unified evaluation interface across heterogeneous foundation models. TrafficImag evaluates four complementary validity dimensions: initial-state correctness, route and behavior validity, interaction consistency, and non-target preservation, and considers an end-to-end counterfactual successful only when all four are satisfied. Across state-of-the-art foundation models, the strongest reasoner reaches 80.4% macro F1, the complete condition interface raises end-to-end success from 23.3% to 55.0% for the best generator. Oracle studies further show that conditional video execution is the primary remaining bottleneck. TrafficImag provides a reproducible benchmark for evaluating and diagnosing counterfactual traffic video generation beyond perceptual video quality.

[14] Learning Polarization Image Restoration with General Restoration Priors cs.CV | eess.IVPDF

Chenggong Li, Jinhao Liu, Caiyun Wu, Yidong Luo, Junchao Zhang

TL;DR: 提出基于通用复原先验的全能偏振图像复原框架，并建立复合退化基准。

Details

Motivation: 真实偏振成像受多种耦合退化影响，现有方法通常针对单一退化且偏振数据有限。

Result: 在公开数据和新复合退化基准上的实验表明方法有效；摘要未提供具体数值。

Insight: 先选用可分离强度与偏振信息的归一化Stokes表征，再以双分支分别建模；强度分支调用通用复原先验和专家混合处理复合退化，并通过跨域特征变换把复原知识迁移到偏振分支。

Abstract: Polarization imaging captures distinctive surface and geometric cues that benefit a wide range of vision tasks. However, real-world polarization acquisition is often affected by multiple coupled degradations, making image restoration essential for practical polarization vision. Existing methods are largely tailored to specific degradations and remain constrained by the limited scale and quality of polarization data. To address these limitations, we develop an all-in-one polarization restoration framework for diverse and composite degradations. We first study the impact of different polarization representations on restoration performance and identify the normalized Stokes representation as an effective choice for separating intensity and polarization information. Accordingly, we devise a dual-branch architecture that separates intensity and polarization modeling. To overcome the limitations of polarization-specific training, the intensity branch leverages pretrained general restoration priors and a mixture-of-experts extension for composite degradations, while its restoration knowledge is adaptively distilled into the symmetric polarization branch via a cross-domain feature transform. In addition, we establish a composite-degradation polarization benchmark to support all-in-one restoration research. Extensive experiments on public datasets and our proposed benchmark demonstrate the effectiveness of the proposed method.

[15] EviDETR: Preserving Query-Relevant Temporal Evidence for Moment Retrieval and Highlight Detection cs.CVPDF

Haoran Sun, Yufan Li, Qichen Zhang, Haoran Zhao, Shuqi Wang

TL;DR: EviDETR在编码、解码及任务间传递与查询相关的时间证据，联合预测视频片段定位和高光片段。

Details

Motivation: DETR式流程未显式保留查询证据供跨模态编码、时序解码及片段级高光预测持续使用。

Result: QVHighlights上片段检索R1@0.5为69.29、R1@0.7为54.77、平均mAP为48.41；高光HD-mAP为41.83、HIT@1为68.33，并在TACoS与Charades-STA显示跨数据集迁移能力。

Insight: 语义感知重加权增强相关片段，时间Top-2专家稀疏路由作查询自适应细化，MR2HD再以置信加权多尺度聚合将片段证据传至高光检测。

Abstract: Joint video moment retrieval and highlight detection requires identifying query-relevant temporal segments while estimating clip-level saliency, yet DETR-style pipelines do not explicitly preserve query-relevant evidence throughout encoding, decoding, and cross-task prediction. We propose EviDETR, an evidence-preserving framework with three components. Semantic-aware Feature Reweighting (SFR) enhances query-relevant clip representations through saliency estimation and cross-modal interaction. A Temporal Top-2 Mixture-of-Experts (TTop2MoE) decoder performs query-adaptive refinement via sparse expert routing. MR-to-HD (MR2HD) fusion transfers span-level retrieval evidence to clip-level highlight prediction through confidence-weighted multi-scale aggregation. Using CLIP+SlowFast features, EviDETR achieves 69.29 R1@0.5, 54.77 R1@0.7, and 48.41 Avg. mAP for moment retrieval on QVHighlights, together with 41.83 HD-mAP and 68.33 HIT@1. Strong results on TACoS and Charades-STA further demonstrate cross-dataset transferability.

Zhao Wang, Jiangtao Hu, Jack Yu, Tao Yu

TL;DR: Timo将双向文本—动作扩散建模与运动学约束结合，生成连贯且符合动作描述的人体运动。

Details

Motivation: 常见方法只用交叉注意力向动作注入文本，缺少动作与语言双向建模；直接套用多模态扩散Transformer又会生成关节协调差、抖动的动作。

Result: 在六个公开数据集构成的40,025段留出视频基准上超过先进方法；六项指标中五项超过Kimodo，平均基准分相对提高40.8%。

Insight: 共享多模态注意力双向建模文本和动作，以旋转及其时间变化的几何运动学监督约束流匹配，再采用从广泛动作学习到细致文本对齐的两阶段课程。

Abstract: Most existing human motion generation (HMG) methods use cross-attention modules to inject text semantics, but ignore the importance of bidirectional modeling between motion and text tokens, which limits text comprehension. A straightforward idea is introducing multimodal diffusion transformers (MMDiT), which have shown effective joint text–visual modeling in vision generation, into HMG. However, we find that articulated motion is temporally coherent but weakly correlated across joints, in which directly applying an MMDiT with flow matching produces poorly coordinated and jerky motion. In this work, we propose Timo, a novel kinematics-aware MMDiT framework tailored for HMG. Timo combines fully shared multimodal attention for bidirectional text–motion modeling with flow matching, geometric and rotational-kinematics supervision that compares actual rotations and their changes over time, and a two-stage curriculum progressing from broad motion learning to detailed caption alignment. Further, we construct a benchmark of $40{,}025$ held-out clips from six public datasets spanning diverse actions, assessing six complementary dimensions under a common evaluator and scoring protocol. Our model substantially outperforms state-of-the-art methods in both quantitative and qualitative evaluations. Remarkably, Timo surpasses Kimodo on five of six dimensions, achieving a $40.8$% relative improvement in the average benchmark score. Project page: https://kyfafyd.wang/projects/timo. Demo page: https://timo.kyfafyd.wang.

[17] Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models cs.CV | cs.AIPDF

Tianhang Guo, Yulin He, Wei Chen, Wenjuan Zhou, Yuhang Li

TL;DR: LIRSeg用少量可学习潜在token替代显式思维链，提升MLLM推理分割准确率并大幅减少推理文本。

Details

Motivation: 显式CoT会加入冗余词元干扰感知token生成，也拉大视觉token之间的有效距离。

Result: 相较VisionReasoner，ReasonSeg、MUSE和MMR的gIoU分别绝对提高4.9、7.1和4.7个百分点，推理token减少约16倍。

Insight: 先进行空间对齐使潜token落在目标视觉证据上，再以分割奖励做GRPO优化；极端优势采样、解耦探索—稳定更新和潜变量多样性增强共同提升信息量并避免表征塌缩。

Abstract: Reasoning segmentation aims to interpret implicit textual queries and enable fine-grained visual perception, which is critical for applications such as human-computer interaction and embodied agents. Existing methods typically generate explicit Chain-of-Thought (CoT) by multimodal large language models (MLLMs) before localizing the target. Although intuitive, such explicit verbal reasoning introduces substantial attention interference: redundant textual tokens disrupt attention during perception-token generation and also increase the effective distance between visual tokens. To address this issue, we propose LIRSeg, which fully replaces explicit CoT with a compact set of learnable latent tokens for reasoning segmentation. LIRSeg is trained in two stages: spatial alignment grounds the latent tokens in object-relevant visual evidence, and GRPO further optimizes them with segmentation rewards. To make these compact latent tokens more informative, we introduce three complementary mechanisms from an information perspective: extreme-advantage sampling for selecting informative training signals, decoupled exploration-stability updates for learning complementary representations, and latent diversity amplification for preventing representational collapse. Extensive experiments on benchmarks demonstrate that LIRSeg consistently improves both segmentation accuracy and reasoning efficiency. Compared with the VisionReasoner baseline, LIRSeg achieves absolute gIoU improvements of 4.9% on ReasonSeg, 7.1% on MUSE, and 4.7% on MMR, while achieving a approximately 16x reduction in reasoning tokens. Code is available in supplementary materials.

[18] MDSkin-Net: Multi-Task Skin Lesion Analysis Driven by Pattern Analysis Priors and Spatial Alignment Regularization cs.CVPDF

Yijian Li, Saad Bedros, Paul Bigliardi, Mei Bigliardi Qi, Vassilios Morellas

TL;DR: MDSkin-Net结合皮肤镜模式分析先验与空间对齐正则，联合完成皮损分割和分类。

Details

Motivation: 既有多任务模型常只在结构上耦合分类与分割，缺少临床知识；传统ABCD宏观规则也不适合皮肤镜微观模式判断。

Result: 仅用ISIC 2017训练集训练，在PH2零样本迁移达到Dice 92.38%和黑色素瘤AUC 97.84%，在ISIC 2018分割测试集Dice 88.92%；ISIC 2017域内分类平均AUC 91.60%、分割Dice 84.72%。

Insight: 模式分析引导注意力模块编码多尺度、通道及不对称线索，分割掩码再以多尺度软监督约束分类只利用病灶局部证据；域内分割仍落后单任务专用方法。

Abstract: Reliable skin lesion segmentation and classification are central to dermoscopic computer-aided diagnosis. Existing multi-task frameworks couple the two tasks architecturally without clinical knowledge, while knowledge-injecting approaches rely on the macroscopic ABCD rule, which was not designed for dermoscopy. Dermoscopic diagnosis is grounded in Pattern Analysis, a microscopic framework structured around dermoscopic features. We propose MDSkin-Net, which incorporates cue-level Pattern Analysis priors into a hybrid CNN-Transformer architecture. At its core is a Pattern Analysis-Guided Attention Module (PAGAM) comprising three priors motivated by distinct dermoscopic cues: an improved Efficient Channel Attention (iECA), a Multi-Scale Spatial Attention (MSSA), and a Biased Asymmetry Attention (BAA). We further introduce a multi-scale spatial alignment regularization (MSAR) that uses the segmentation ground-truth mask as hierarchical soft supervision, confining the classification head to lesion-localized evidence and coupling both task pathways through a shared spatial prior. Trained exclusively on the ISIC 2017 training split without external dermoscopy data, the MDSkin-Net ensemble transfers robustly under zero-shot evaluation, reaching a Dice Similarity Coefficient (DSC) of 92.38% and a melanoma AUC of 97.84%on PH2, and a DSC of 88.92% on the ISIC 2018 Task 1 test set. On the in-domain ISIC 2017 benchmark, the ensemble attains a mean Area Under the Curve (AUC) of 91.60% across the two classification tasks (melanoma and seborrheic keratosis vs. rest), and a DSC of 84.72% for segmentation. Classification remains competitive with baselines; in-domain segmentation trails single-task specialists, yet the proposed priors and alignment regularization yield representations that generalize consistently across cohorts of different scales.

[19] UltraG-Bench: A Multi-task Benchmark for assessing Large Vision-Language Models on Pixel-level Evidence Grounding in Ultrasound cs.CV | cs.AIPDF

Quanhao Zhu, Bo Xu, Rui Lin, Chenyuan Wang, Yu Shao

TL;DR: UltraG-Bench评测视觉语言模型能否为超声图像语义预测提供像素级证据定位。

Details

Motivation: VLM逐渐能理解超声图像，但能否给语义结论配上准确像素证据尚不清楚。

Result: 基准标注40个公开超声分割数据集，覆盖13类解剖及三项任务，共有33.1万余条分割、66.7万余条证据问答和13.9万余条证据报告标注；14个模型显示语义理解与像素定位存在明显差距。

Insight: UltraG-Agent结合VLM语义推理与超声专用UltraSAM3分割能力，同时改善语义预测和像素证据落地。

Abstract: Ultrasound is one of the most widely used medical imaging modalities, and recent large vision-language models(VLMs) have shown increasing capabilities in ultrasound image understanding. However, these models fail to provide pixel-level visual evidence aligned with their semantic predictions, and their fine-grained grounding capability in ultrasound remains largely unclear. We introduce UltraG-Bench, a large-scale multi-task benchmark for evaluating pixel-level evidence grounding in ultrasound. UltraG-Bench is built by annotating 40 public ultrasound segmentation datasets spanning 13 anatomical categories, and comprises three progressive tasks: instruction-guided segmentation, evidence-grounded VQA, and evidence-grounded report generation, with 331125, 666779, and 138832 annotations, respectively. Comprehensive evaluation of 14 state-of-the-art models reveals a substantial gap between semantic understanding and fine-grained pixel-level localization. We further propose UltraG-Agent, which combines the semantic reasoning capabilities of a VLM with the ultrasound-specific segmentation capability of UltraSAM3. Experiments show that UltraG-Agent substantially improves both semantic prediction and pixel-level visual grounding. Our dataset and code are available at https://github.com/zhuqh19/UltraG-Bench.

[20] ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos cs.CVPDF

Hengrui Kang, Zhonghao Yan, Yuxuan Yang, Ruoyan Jing, Yuncheng Guo

TL;DR: ManiVid建立局部篡改视频取证数据与统一分析模型，兼顾检测、像素证据定位和异常解释。

Details

Motivation: 局部编辑视频保留大部分原内容，取证更难；现有数据集不足，MLLM虽能超越真假二分类，却缺少低层伪造线索和精确像素定位。

Result: ManiVid-38K含约1.9万组人工核验真假视频对；ManiVidLens较最强对比方法在篡改定位mIoU提升21.1%、J&F提升21.3%，异常解释ROUGE-L提升131.3%、CSS提升9.9%；检测准确率0.914、F1为0.913。

Insight: 取证证据路由器向多模态推理与视频分割共享低层线索，提示蒸馏模块将定位状态转为语义和几何提示，再引导掩码解码及整段视频传播。

Abstract: Rapid advances in AI-generated video (AIGV) have increased the risks posed by deceptive video manipulation. Unlike fully synthetic videos, manipulated videos retain most source content and alter only localized regions, making forensic analysis particularly challenging. Existing video forgery research faces two limitations in both data and methodology: (1) High-quality datasets and benchmarks tailored for manipulated videos remain scarce. (2) Multimodal large language models (MLLMs) extend forgery analysis beyond binary classification but struggle to use low-level forensic cues and provide precise pixel-level grounding. Specifically, we introduce ManiVid, a unified forensic analysis task covering forgery detection, artifact grounding, and anomaly explanation for manipulated videos. We construct ManiVid-38K, the first dataset to combine paired, open-vocabulary localized manipulations of general videos with authenticity labels, forgery masks, and anomaly explanations. It comprises about 19K manually verified real-fake video pairs, mostly at 1080P resolution, generated under 2 paradigms with 15 powerful generation models. We sample 1K pairs for ManiVidBench, balanced across six manipulation types and generation models for fair evaluation. We further propose ManiVidLens, a unified framework for explainable video forgery analysis. Its Forensic Evidence Router supplies shared low-level forensic evidence for multimodal reasoning and video segmentation. Its Prompt Distill Module converts grounding states into semantic and geometric prompts and distills spatial priors for mask decoding and full-video propagation. ManiVidLens achieves relative gains over the strongest comparison methods in artifact grounding (+21.1% mIoU; +21.3% J&F) and anomaly explanation (+131.3% ROUGE-L; +9.9% CSS). Its forgery detection remains comparable to dedicated classifiers (0.914 Acc; 0.913 F1).

[21] OneWorld: Learning Consistent Physics Across Actions in World Models cs.CV | cs.AIPDF

Ke He, Yichen Ding, Bin Yang

TL;DR: OneWorld联合生成同一初始场景下的多种行动未来，并要求它们共享一致的潜在物理机制。

Details

Motivation: 不同动作条件下独立生成的未来片段各自可能逼真，却会暗示互相矛盾的摩擦、质量等物理属性，损害规划可靠性。

Result: 受控环境实验显示，OneWorld提升跨干预的物理一致性，同时保持有竞争力的单条生成预测质量。

Insight: 物理机制解释器先从各行动—结果分支估计潜在机制分布，再汇总为共享世界证据并纳入不确定性；该证据约束流训练和采样，使行为结果不同但物理解释一致。

Abstract: Action-conditioned video world models aim to predict scene evolution under different actions, a capability that is essential for reliable planning, decision-making, and interaction in dynamic environments. However, futures generated independently from the same initial scene may each appear plausible while implying incompatible physical properties, such as friction or mass. This inconsistency can lead to contradictory predictions across interventions, making it difficult for the model to maintain a coherent understanding of the underlying world and limiting its reliability for planning and decision-making. To address these issues, we propose OneWorld, a shared-mechanism counterfactual generation framework that jointly models multiple action-conditioned futures under a common latent physical mechanism. A physical mechanism interpreter first infers a distribution over latent mechanisms from each action-outcome branch. These distributions are then aggregated into shared-world evidence, which captures whether the branches admit a common physical explanation while accounting for uncertainty in less informative branches. This evidence constrains flow training and guides sampling, encouraging consistency in the underlying physical mechanism while preserving the distinct outcomes induced by different actions. We further introduce a multi-intervention evaluation protocol in controlled environments, following the interaction settings of ACWM-Phys, to assess whether generated futures can be jointly explained by the same physical parameters, alongside standard measures of single-rollout prediction quality. Experiments in these environments show that OneWorld improves cross-intervention physical consistency while maintaining competitive single-rollout prediction quality.

[22] MVVBench: Benchmarking 4D Reasoning in Vision-Language Models cs.CV | cs.AIPDF

Hyungjin Chung, Byeongjun Park, Joonseok Lee, Hojun Kim, Jaeho Choi

TL;DR: MVVBench评测VLM是否能整合多个非重叠摄像机视角和时间证据，推断视频中的四维连续场景。

Details

Motivation: 多视角理解需要跟踪跨视角移动的实体、对齐事件并推理潜在时空连续性，单帧或单视角无法回答一部分问题。

Result: 基准覆盖多类真实动态场景和六种能力，并以严格人工核验的问题评估；分析发现错误涉及时间定位、跨视角身份断裂和脆弱多跳推理。

Insight: 单视角及多数单时刻都无法解答的问题只有联合时空推理才能解决；面向具体任务的思维链和跨视角结构化证据聚合可免训练提升表现。

Abstract: Multi-view video understanding requires integrating spatial and temporal evidence across multiple, often non-overlapping camera streams: tracking entities as they transition between viewpoints, aligning events across time, and reasoning about latent 4D continuity rather than any single visible frame. We introduce MVVBench, a benchmark for multi-view video reasoning built from real world multi camera datasets. Questions are curated to be monocular-ambiguous along both the view and the temporal axis: each question is unanswerable from any single view in the designated input set, and the majority are further unanswerable from any single moment. Each question becomes uniquely solvable only by jointly reasoning across views and across time. MVVBench spans diverse dynamic scenes and probes six capabilities: implicit/explicit attribute identification, implicit/explicit relative distance, relative camera pose, and compositional counting, with human-authored QA and rigorous verification. Beyond benchmarking, we provide an extensive analysis of when and why current vision language models succeed or fail, characterizing errors due to temporal mis-localization, cross-view identity breaks, and brittle multi-hop reasoning. We then study inference-time elicitation strategies that unlock latent multi-view competence—task-specific chain-of-thought scaffolds and structured cross-view evidence aggregation—yielding substantial gains without retraining. Finally, we present preliminary evidence that reinforcement learning with verifiable rewards can elicit some latent multi-view competence in the base model, pointing to training-time approaches as a promising direction for future work. Together, MVVBench offers a rigorous evaluation of 4D multi-view reasoning and a foundation for future progress toward reliable embodied perception.

[23] Where and When to Force: Routed Forcing for Streaming Avatars cs.CVPDF

Zihan Su, Siwen Lu, Junhao Zhuang, Zeyue Xue, Haoyang Huang

TL;DR: Routed Forcing按语义区域及去噪阶段分配蒸馏目标，避免流式头像扩散模型动作多样性塌缩。

Details

Motivation: 反向KL的DMD倾向模式选择，可能令少步音频驱动头像模型丢失高动态姿态与动作多样性；这种损失在不同语义区域不均。

Result: 相较Self Forcing，动作动态最高提高45%、多样性提高7%至25%，同时保持画质和唇形同步。

Insight: 人物姿态区域使用真实视频监督以恢复多样运动，嘴部与背景保留DMD以维护口型和场景稳定；高噪声阶段注入真实动作，低噪声阶段用DMD细化以避免模糊伪影。

Abstract: Audio-driven streaming avatar generation requires real-time synthesis of speech-synchronized videos with dynamic and diverse motion. Self Forcing uses Distribution Matching Distillation (DMD) to distill bidirectional video diffusion models into causal, few-step generators for real-time streaming. However, DMD minimizes a reverse KL divergence, which is inherently mode-seeking: it causes the student to discard high-dynamic modes and collapse onto static outputs, compressing both dynamics and diversity of generated videos. We find that this collapse is region-heterogeneous: person regions involving pose and gesture variations suffer the largest diversity loss, the audio-driven mouth region shows a small loss, and the background remains nearly stable. Based on this observation, we propose Routed Forcing, which routes the distillation objective by semantic region and noise stage to improve dynamics and diversity while preserving visual quality. Specifically, (1) Where to Force: Semantic-Region Routing applies Data-Forcing Distillation (DFD), which supervises the student with real videos, to the person region where diversity collapse is most severe, while retaining DMD for the mouth and background to preserve lip synchronization and scene stability. (2) When to Force: Noise-Stage Routing activates DFD at high noise stages, where real video serves as effective supervision to inject diverse and dynamic motion patterns. At low noise stages, DMD is used to refine details, avoiding blur and artifacts from spatial differences between real video and student-generated video. Experiments show that Routed Forcing improves dynamics by up to 45% and diversity by 7-25% over Self Forcing, while preserving video quality and lip synchronization.

[24] CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models cs.CVPDF

Linyuan Gao, Yuan Wu, Yi Chang

TL;DR: CCRV-Bench以多组可控约束评测VLM能否基于图像证据进行因果推理，而非依赖统计捷径。

Details

Motivation: 既有视觉因果评测难区分模型是否真正依据画面推理，未加约束分数可能高估因果能力。

Result: 评估15种多模态模型后发现，干预任务平均受约束影响最大，空间定位约束平均损伤最大，而事实对抗约束提升所有受测模型的DCR。

Insight: 四类任务为因果关系发现、状态预测、因果诊断和干预；实体符号化、空间定位、事实对抗及精简输出约束用于减少捷径，同时保留物理常识需求。

Abstract: Vision-language models (VLMs) have demonstrated excellent performance in visual tasks, but their visual causal reasoning capabilities still lack reliable evaluation. Existing evaluations struggle to distinguish whether a model is performing causal reasoning based on visual evidence or relying on statistical correlations for shortcut learning, thereby potentially overestimating their actual capabilities. This paper proposes CCRV-Bench, a constraint-driven visual causal reasoning benchmark for single-image physical scenarios. We construct an orthogonal framework that evaluates four causal task dimensions: causal relation discovery, state prediction, causal diagnosis, and intervention. We further introduce entity symbolization, spatial grounding, the factual adversarial constraint, and minimalist output constraints to reduce shortcut cues while preserving the physical commonsense required by the task. Experiments across 15 multimodal models show that constraint sensitivity is task- and model-dependent: intervention has the largest average effective degradation among the four causal tasks, spatial grounding is the most damaging constraint on average, and the factual adversarial constraint improves DCR for all evaluated models. These results show that unconstrained performance does not determine constrained robustness and that a single aggregate score can obscure distinct failures in causal identification, spatial grounding, and constraint-compliant expression. CCRV-Bench provides a standardized framework for diagnosing image-grounded causal reasoning under controlled constraints. The code is available at https://github.com/0815linyuan/CCRV-Bench-Constraint-Based-Evaluation-of-Causal-Reasoning-in-Vision-Language-Models

[25] STORM-Bench: Evaluating Online Video QA under Evolving and Incomplete Evidence cs.CVPDF

Siru Zhong, Shenghan Tan, Rihong Yan, Xiaohui Lv, Yuzheng Zhuang

TL;DR: STORM-Bench评测在线视频问答在状态持续变化、证据不完整时能否跟踪状态并恰当弃答。

Details

Motivation: 现有视频基准多测静态识别或长程检索，很少联合评估动态证据、状态变化及证据不足时的拒答。

Result: 5,736题覆盖630段短而变化密集的真实与模拟情节；14个视频LLM准确率最高60.3%、均值51.7%，但可靠性综合STORM-BR仅最高35.6%、均值18.8%，主要因不确定问题中过度自信。

Insight: 按变化强度和查询时可答性分层，并提出答案状态正确率调和指标及不确定性归因指标；任务准确率单独报告会掩盖认知可靠性和状态跟踪缺口。

Abstract: Reliable online video question answering requires tracking state transitions while selectively abstaining when visual evidence is insufficient. Existing benchmarks focus on static recognition or long-range retrieval, rarely evaluating these coupled capabilities under evolving and incomplete evidence. We present STORM-Bench, comprising 5,736 questions across 630 compact, change-dense episodes spanning five egocentric domains (STORM-Real) and two controlled simulation subsets (STORM-Sim) at 1 FPS. Questions are stratified by a proxy for accumulated change intensity (Low, Medium, High) and query-time answerability (Known, Uncertain). To measure reliability, we introduce STORM-BR, a harmonic metric over joint answer-status correctness that exposes abstention failures masked by aggregate accuracy, alongside STORM-BR-ATTR for uncertainty attribution. Across 14 video LLMs, online accuracy peaks at 60.3% (mean 51.7%), whereas STORM-BR ranges from 5.7% to 35.6% (mean 18.8%), driven by pervasive overconfidence on uncertain queries. STORM-Bench shows that task accuracy masks these gaps in epistemic reliability and state tracking. Benchmark and code are available at https://github.com/siruzhong/STORM-Bench.

[26] Self-Supervised Perceptually Interpretable Monocular Depth Estimation cs.CVPDF

Zain Ul Abidin, George Dimas, Dimitris K. Iakovidis

TL;DR: PIMDE把RGB图像拆成可解释感知线索并分别估计深度，以提升自监督单目深度模型的透明度。

Details

Motivation: 现有单目深度模型能在无真值条件下训练，但从混合RGB表征推断深度，难分析各类视觉线索对结果的贡献。

Result: KITTI实验显示PIMDE表现与既有自监督深度方法相当，同时可分析不同感知线索影响；摘要未给出具体数值。

Insight: 将输入分解为编码不同线索的感知特征图，由独立深度分支处理，再显式融合各分支预测，便于定位错误来源。

Abstract: Self-supervised monocular depth estimation (MDE) enables depth prediction from monocular images without requiring ground-truth supervision, making it attractive for large-scale and real-world applications. Despite steady improvements in accuracy, most existing methods remain difficult to interpret, as depth is inferred from RGB representations that obscure the impact of individual perceptual image components. This lack of transparency limits systematic analysis of failure cases and reduces confidence in safety-critical settings. This paper presents a self-supervised framework for perceptually interpretable monocular depth estimation (PIMDE), designed to associate depth predictions with distinct perceptual components of the input image. Rather than operating directly on RGB inputs, the proposed method decomposes each image into a set of perceptual feature maps (PFMs), each encoding a specific visual cue. Distinct depth estimation branches process these PFMs independently to produce depth estimates (PIDEs), which are subsequently combined through an explicit fusion strategy. This formulation allows us to examine directly the contribution of each perceptual cue to the final depth prediction. Experiments conducted on the KITTI benchmark dataset demonstrate that PIMDE achieves performance comparable to established self-supervised MDE methods while providing additional insight into how different perceptual cues influence depth estimation. These results indicate that perceptual decomposition can support interpretability without sacrificing depth estimation accuracy.

[27] PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution cs.CVPDF

Xin Di, Mingyu Shi, Yuanfei Bao, Long Peng, Yue Zhao

TL;DR: PhoenixSR用扩散模型的分布级先验指导现有前馈超分辨网络训练，并在推理时完全移除扩散组件。

Details

Motivation: 扩散超分模型有强生成先验但计算昂贵；高效CNN或Transformer虽快，却难恢复真实高频细节。

Result: 在三个超分基准、六种前馈骨干（含SwinIR、HAT、Real-ESRGAN和SeeMoRe）上，感知质量持续改善且重建保真度基本保留。

Insight: 不用对齐异构网络特征或模仿扩散采样结果，而以分数分布匹配提供监督；异构分布适配跟踪学生分布，方向可靠性加权则抑制不稳定指导，推理架构和成本不变。

Abstract: Real-world image super-resolution (SR) requires recovering perceptually realistic high-resolution images from complex low-resolution observations while preserving faithful content. Diffusion-based SR benefits from strong generative priors but incurs substantial computational overhead, whereas feed-forward CNN and Transformer SR models are efficient yet often struggle to recover realistic high-frequency details. This motivates a natural question: can diffusion priors be transferred to existing diffusion-free SR networks without introducing diffusion components at inference time? To this end, we propose PhoenixSR, a generative heterogeneous distillation framework that transfers diffusion priors to independently designed feed-forward SR networks through score-based distribution matching. Rather than aligning heterogeneous features or imitating sampled diffusion outputs, PhoenixSR uses the pretrained diffusion model as distribution-level supervision, while paired SR supervision preserves reconstruction fidelity. To make distribution matching effective for fidelity-sensitive SR, we introduce Heterogeneous Distribution Adaptation, which adapts the target score to the SR domain, improves tracking of the evolving student distribution, and anchors training with paired supervision. We further employ Directional Reliability Weighting, a lightweight residual-consistency-based reweighting strategy that reduces unstable distributional guidance. All diffusion-related components are removed after training, leaving the original student architecture and inference cost unchanged. Experiments on three SR benchmarks and six feed-forward backbones, including SwinIR, HAT, Real-ESRGAN, and SeeMoRe, show consistent perceptual improvements with largely preserved reconstruction fidelity.

[28] PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation cs.CVPDF

Lucy Fothergill, Pietro Valdastri, Dominic Jones, Duygu Sarikaya

TL;DR: PICO将分割、深度及位姿回归结合，并通过二维投影和三维点对应一致性估计手术器械六自由度位姿。

Details

Motivation: 缆驱机器人运动学存在累积误差，视觉方法常依赖外部标记；两阶段系统又难兼顾实时鲁棒性和误差控制。

Result: 在SurgRIPE四个子集上均有稳定竞争力；遮挡条件下旋转精度排名第二，平移表现也具竞争力。

Insight: 端到端多任务网络预测掩码、深度、平移和旋转，再以投影损失和点到点损失两个代理任务约束二维及三维几何一致性。

Abstract: Purpose: Accurate 6 DoF pose estimation of surgical tools is critical for automa- tion, robotic proprioception, and safe interaction with the tissue operated on. Kinematics-based approaches suffer from accumulated errors due to the cable- driven nature of robotic arms, while vision-based methods often rely on external markers or trackers. Although more recent vision-based advances have been pro- posed, these two-stage pose estimation methods often lack real-time robustness due to accumulated errors and computational overhead. Methods: We propose a novel end-to-end trainable model, PICO. Our model employs a multi-task learning architecture to predict segmentation and depth maps, alongside regression of translation and rotation parameters. We define two proxy tasks that enforce geometric consistency in both 2D and 3D spaces, improving accuracy and robustness. For this, we propose a projection loss, and a point-to-point loss. Results: We evaluate our method on the SurgRIPE dataset, benchmarking its performance against state-of-the-art approaches using standard 6DoF pose esti- mation metrics. Our results demonstrate consistently strong performance across all four subsets, specifically in rotation, ranking second even under occlusion. It also demonstrates comparable translational performance, remaining competitive, especially in occluded cases. Conclusion: PICO demonstrates the effectiveness of multi-task learning and geometry-aware proxy tasks for robust and reliable surgical tool pose estimation, especially in occluded scenarios, highlighting potential for future applications.

[29] Refining Cytology Predictions with Conditional Random Fields cs.CVPDF

Manon Dausort, Tiffanie Godelaine, Karim El Khoury, Maxime Zanella, Christophe De Vleeschouwer

TL;DR: CytoCRF把条件随机场改造为适配细胞学染色和染色质纹理的视觉语言模型预测细化方法。

Details

Motivation: VLM在组织病理切片上零样本分类较强，却难适应与组织形态和染色差异明显的细胞学图像。

Result: 十个细胞学数据集、各标注预算下均超过既有CRF；仅50个标注时较最佳基线高13.6个百分点、较零样本模型高33.7点。

Insight: 调整成对势函数以利用染色质及细胞学专属线索，并结合多个骨干扩展每个候选关系项的邻域；结果显示邻域拓扑比邻域上的势函数更关键。

Abstract: Vision-language models (VLMs) achieve strong zero-shot (ZS) classification on histology images but do not perform as well on cytology, whose stains and cell morphology differ markedly compared to histology. Conditional random fields (CRFs) can refine noisy VLM predictions by propagating information across patches, but existing CRF frameworks were designed for histopathology and do not transfer to cytology datasets, released as independent patch pools spanning multiple staining protocols. We introduce CytoCRF, which adapts the pairwise terms to cytology by targeting chromatin and cytology-specific staining, and further enrich the neighborhood of each potential term by combining multiple backbones. Across ten cytology datasets, CytoCRF outperforms existing CRF frameworks at every annotation budget, reaching +13.6 percentage points over the best baseline and +33.7 over ZS with only 50 annotations. Combining information from multiple backbones brings further gains, showing that the neighborhood topology matters more than the pairwise potential computed over it.

[30] FLIP: Final Layer Inference-Time Probing for Vision-Language Models cs.CV | cs.AIPDF

Drandreb Earl O. Juanico, Rowel O. Atienza

TL;DR: FLIP提出最终归一化隐藏状态的推理时探针，用受控强度扫描辨别内部干预究竟带来结构性证据使用还是通用扰动。

Details

Motivation: 干预后行为改变可能是视觉证据利用改善、输出不稳定或能力退化，单看结果难解释机制。

Result: 在检测/计数控制任务中，中等强度干预可提高IoU 0.50召回并降低宽容计数误差；其他层及左右配对负对照未复现同样签名。

Insight: 四项探针协议检查干预区域、视觉落地指标、特征一致性和性能负对照；FLIP是解释性干预的验证步骤，不是控制或引导方法。

Abstract: We present FLIP, a final-layer inference-time probe for testing whether a logit-facing intervention site in an open-weight vision-language model (VLM) supports structured, task-linked computation rather than generic perturbation. Behavioral change under internal intervention is otherwise mechanistically ambiguous: it may reflect improved use of visual evidence, generic output instability, or outright degradation. FLIP applies elementwise flooring to the final normalized hidden state before logit computation, leaving parameters, prompts, and decoding unchanged. On a controlled detection/counting probe, sweeping intervention strength reveals three regions: negligible change, a bounded interior regime in which detection recall at IoU 0.50 ($R_{50}$) improves while tolerant counting error ($\mathcal{E}_{\mathrm{count}}$) falls, and over-suppression. We formalize a four-criterion probe-and-sweep protocol for disciplining the interpretation of intervention effects: regime structure, grounding-proxy alignment, feature-coherence dependence, and failure to reproduce the same positive regime on a performance-based negative control. The post-normalization state passed to the output head is the logit-facing instantiation of this test; under a non-targeted flooring sweep it satisfies the full protocol. Raw decoder-layer interventions, including the last-block output before final normalization, and the singleton-pair left/right control fail to reproduce the Final-site signature, while same-site operators and multiple VLMs replicate it. FLIP is therefore a validation step for intervention-based mechanistic interpretability, not a steering method.

[31] TRACKGRAPH: Online Open-Vocabulary 3D Scene Graphs via Image-Space Tracking cs.CV | cs.ROPDF

Peder Borge Hellesylt, Albert Gassol Puigjaner, Kostas Alexis, Annette Stahl

TL;DR: TRACKGRAPH在图像流中先保持短期二维掩码身份，再融合成支持开放词汇检索的三维场景图。

Details

Motivation: 现有3D地图系统常对每帧分割并关联持久片段，且频繁调用昂贵视觉语言推理。

Result: 在Replica、ScanNet++和HM3D上，开放词汇分割与检索具竞争力；Replica同义词频率最高0.50。在A100上比ViT-H OVI-MAP快1.7倍、显存少3.3倍；真实四足部署以7.5Hz构图和搜物体。

Insight: 稀疏关键帧计算FastSAM掩码与CLIP特征，帧间用稠密DINOv3特征传播；追踪掩码形成类别无关3D片段层，并由场景图关联追踪中断与长期重访。

Abstract: Open-vocabulary 3D maps enable robots to reason about previously unknown environments using natural language. However, existing systems typically segment every incoming image, associate detections with persistent 3D segments, and frequently perform costly Vision-Language (VL) inference. We present TRACKGRAPH, an online open-vocabulary system that maintains short-term 2D mask identity directly in the image stream before fusing segments into 3D. FastSAM masks and CLIP features are computed at sparse keyframes, while dense DINOv3 features are used to propagate masks at a high rate in between. The resulting tracked masks are fused into a class-agnostic 3D segment layer within a hierarchical scene graph, with 3D association handling tracking interruptions and long-term revisits. Compact multi-view CLIP embeddings enable open-vocabulary retrieval. Across Replica, ScanNet++, and HM3D, TRACKGRAPH achieves competitive open-vocabulary segmentation and retrieval against state-of-the-art mapping methods, including the highest synonym frequency on Replica (0.50). On the same NVIDIA A100, it is 1.7x faster and uses 3.3x less GPU memory than ViT-H OVI-MAP. Real-world quadruped deployments demonstrate onboard scene graph construction and object search at 7.5Hz, while recorded drone data is used to test the method under aerial viewpoints.

[32] Exploiting Spatial Structure for Transductive Few-Shot Classification of Whole-Slide Images cs.CVPDF

Tiffanie Godelaine, Manon Dausort, Karim El Khoury, Benoît Gérin, Benoît Macq

TL;DR: SlideTIM在全切片图像上以空间和潜在表征联合正则化，传导式细化视觉语言模型的零样本分类。

Details

Motivation: VLM可无标注地做病理图块分类，但细粒度任务预测噪声大；现有联合预测细化方法未针对全切片空间结构和类别失衡设计。

Result: 四个组织病理数据集上持续超过各TIM变体；1-shot时宏F1较最佳对照高8.1个百分点、较零样本高19.4点。

Insight: 空间相邻且语义相似的图块被鼓励赋予相同类别，类别比例先验则校准全片预测组成，同时处理复杂空间布局和类别不平衡。

Abstract: Automating the analysis of whole-slide images (WSIs), a key step in cancer diagnosis, has high clinical value, as it can reduce pathologist’s workload while improving diagnosis accuracy. Recently, vision-language models have shown promising performance for patch-level classification without requiring any annotation, yet these zero-shot (ZS) predictions remain noisy on fine-grained tasks and must be further refined. A promising direction is to refine all predictions jointly, i.e., a transductive approach. However, most existing methods are not tailored to WSIs. We thus propose SlideTIM, an adaptation to WSIs of the recent transductive approach LC-TIM, which introduces a combined spatial–latent regularizer together with a prior on the patch class distribution. The former enforces spatially and semantically close patches to receive the same predictions, while the prior calibrates the predicted class proportions. Together, they address the complex spatial organization and the strong class imbalance of WSIs. Evaluated on four histology datasets, SlideTIM consistently outperforms all TIM variants, improving the macro-F1 by +8.1pp over the best competing baseline at 1 shot. Compared to the ZS, it raises the macro-F1 by +19.4pp at 1 shot. The code will be made available after submission.

[33] Where Compute Matters: Heterogeneous Attention for Efficient Video Diffusion cs.CVPDF

Olga Zatsarynna, Denis Korzhenkov, Juergen Gall, Amir Habibian, Mohsen Ghafoorian

TL;DR: HetA-DiT按词元去噪难度动态分配全局或局部注意力，降低视频扩散计算而保留关键区域上下文。

Details

Motivation: 标准高效注意力通常对全部词元使用同一计算模式，但视频不同区域难度各异且随去噪过程变化。

Result: 在Wan2.2-5B和Wan2.1-1.3B蒸馏模型上，VBench、VBench 2.0和人类偏好评估保持有竞争力的质量，而仅约20%词元使用稠密注意力。

Insight: 轻量不确定性分支估计逐词元难度，难点走稠密全局注意力、较可靠部分走高效局部注意力；复用前一去噪步的不确定性，因此推理不增加Transformer调用。

Abstract: Efficient video generation requires reducing the quadratic cost of self-attention over long spatio-temporal token sequences. Existing efficient-attention methods typically apply the same computation pattern to every token, even though denoising difficulty varies substantially across video regions and evolves throughout the generation process. We introduce HetA-DiT, a heterogeneous attention mechanism that adaptively allocates computation according to token difficulty. A lightweight uncertainty branch predicts a token-wise estimate of denoising difficulty, which is used to route uncertain tokens through dense global attention while processing more reliable tokens with efficient local attention. The resulting routing is content- and timestep-adaptive, retains global context where it matters most, and provides a single parameter for controlling the quality-efficiency trade-off. HetA-DiT is compatible with few-step distribution-matching distillation and introduces no additional Transformer evaluation at inference time by reusing uncertainty estimates from the preceding denoising step. We evaluate the method on DMD-distilled Wan2.2-5B and Wan2.1-1.3B models. Across VBench, VBench-2.0, and human preference evaluation, HetA-DiT maintains competitive generation quality while routing only approximately 20% of tokens through dense attention.

[34] DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Models cs.CV | cs.AIPDF

Jiangning Wei, Yuan Yao, Miaomiao Cui, Mingsheng Li, Humen Zhong

TL;DR: DepthEvidence让4B多模态语言模型先预测稠密米制深度，再将对象对齐几何证据用于数值空间问答。

Details

Motivation: 几何空间推理需把对象与度量联系起来，并在语言生成中保留数值信息。

Result: 九个数据集上，稠密深度δ1均值为受测方法最高且接近专用估计器；实例级深度及相对、米制推理领先所比方法，同时大体保持一般VQA能力。

Insight: 相机条件解码器由多尺度特征预测全分辨率深度，接口将深度转成带对象ID的连续几何token；几何监督确保度量信息经语言交互仍可恢复。

Abstract: Spatial reasoning with metric constraints requires linking objects to geometric measurements and preserving their numerical content during language reasoning. We present DepthEvidence, a 4B model that uses its own dense metric predictions as object-grounded evidence for language generation. A camera-conditioned decoder predicts full-resolution metric depth using multi-scale visual features and high-resolution RGB refinement. A dense-to-language interface converts predicted depths and decoder features into object-aligned continuous geometry tokens anchored to object identifiers. Geometric supervision encourages metric information to remain recoverable before and after language-context interaction, while instruction tuning supports object measurement and compositional reasoning. We introduce a Depth-VQA benchmark evaluating object-depth queries, relative comparisons, and decisions combining spatial and numerical constraints. Across nine datasets, DepthEvidence achieves the highest average dense $δ_1$ among evaluated methods, competitive with specialized estimators. It also leads the evaluated methods in instance-level metric depth estimation and overall accuracy on both relative and metric reasoning tracks, while broadly preserving general VQA performance and improving spatial understanding relative to the base model.

[35] Double-stream registration with pyramid fusion for HDR video with alternating exposures cs.CVPDF

Onofre Martorell, Ivan Pereira-Sánchez, Antoni Fuentes, Antoni Buades

TL;DR: 提出适用于交替曝光序列的双流配准与金字塔融合HDR视频重建方法。

Details

Motivation: 交替曝光HDR视频在极端亮度变化区域难以重建，尤其高光过曝会使普通运动估计失效。

Result: 实验显示方法持续优于现有先进方案；摘要未提供具体量化指标。

Insight: 直接估计相邻三帧相对于中心帧的光流，并以中点位移策略处理严重过曝，再通过金字塔融合辐射图和低动态范围图像。

Abstract: High dynamic range (HDR) video reconstruction from al-ter-na-ting-exposure sequences remains challenging, especially in regions with extreme luminance variation. We propose a novel HDR reconstruction framework based on dual-stream registration and accurate pyramid fusion. Given three consecutive frames, our method computes optical flow directly with the central frame, while introducing a complementary midpoint displacement strategy to handle cases with severe overexposition. A pyramid fusion stage then merges the resulting radiance and LDR images into a final HDR output. Experimental results demonstrate that our approach consistently outperforms state-of-the-art methods.

[36] Seeing Semantic Shift: Difference-Aware Sentence-Level Temporal Segmentation of Sign Language Videos cs.CVPDF

Bowen Guo, Shiwei Gan, Yafeng Yin, Xiao Liu, Kuizhuang Liu

TL;DR: SignShift利用手语视频帧间特征变化识别连续手语中的句子边界，无需字幕辅助。

Details

Motivation: 短句手语识别进步明显，但长段连续视频中句间过渡平滑，缺少停顿和姿势重置，静态帧表征难捕捉边界。

Result: 在基准数据集上显著优于已有连续手语分割方法；摘要未报告具体数值。

Insight: 时间差分模块联合使用全帧、面部和手部线索，建模局部运动和全局语义变化；句子数预测模块进一步约束边界选择，减轻过度或不足切分。

Abstract: Recent advances in sign language understanding have achieved impressive success on short, single-sentence videos, yet their performance drops sharply when applied to long, continuous sign language videos. To bridge this gap, we focus on a challenging and realistic setting: Visual-only Sentence-level Sign Language Segmentation (Vis-SSLS), which aims to partition continuous sign language videos into non-overlapping sentence-level segments without any caption assistance, serving as a crucial prerequisite for downstream recognition and translation tasks. However, sentence transitions in sign language are often smooth and visually ambiguous, lacking explicit pauses or posture resets. As a result, static frame representations may fail to capture the subtle temporal changes that indicate sentence boundaries. To address this challenge, we propose \textbf{SignShift}, a difference-aware segmentation framework that explicitly models frame-to-frame feature variation as semantic cues for sentence boundary detection. First, to model the feature variation, we design a Temporal Difference Module, which incorporates full-frame, facial, and hand cues, and employs inter-frame differencing to learn multi-scale temporal variations that capture both fine-grained local kinematics and global semantic transitions. Second, to mitigate over- and under-segmentation issues, we design a Segment Count Prediction module, which predicts the number of sentences to guide boundary selection. Extensive experiments on benchmark datasets demonstrate that SignShift substantially outperforms existing methods, validating its effectiveness.

[37] Pocket-STVG: lightweight architecture for Spatio-Temporal Video Grounding cs.CV | cs.AI | cs.MMPDF

Alberto Presta, Michal Byra, Grzegorz Stefański, Karol Szurkowski, Eryk Kołodziejczyk

TL;DR: Pocket-STVG用少于9,000万参数的级联组件定位视频中与文本查询匹配的时空目标轨迹。

Details

Motivation: 时空视频定位的先进方法常依赖计算昂贵架构、复杂训练流程或大型多模态模型。

Result: 参数少于90M时，弱监督表现与同类方法相当，零样本性能超过早期方法，同时显著降低内存和计算成本。

Insight: 组合MobileViCLIP时序编码器、MDETR空间编码器—解码器及共享文本编码器；视频表征可脱离查询预计算，时间定位可用轻量1D U-Net或阈值方案。

Abstract: Spatio-Temporal Video Grounding (STVG) aims to localize the spatio-temporal tube in a video corresponding to a natural language query. While recent methods achieve strong performance in fully supervised, weakly supervised, and zero-shot settings, they typically rely on computationally expensive architectures, complex training pipelines, or multimodal large language models. We present Pocket-STVG (P-STVG), a lightweight cascade architecture that addresses STVG by combining efficient pre-trained components instead of large end-to-end models. P-STVG integrates a temporal-aware video encoder based on MobileViCLIP, a spatial encoder-decoder derived from MDETR, and a shared aligned text encoder. Temporal localization is performed through either a lightweight 1D U-Net or a simple thresholding strategy, enabling the same framework to operate in both weakly supervised and zero-shot settings. Furthermore, video representations are precomputed independently of the query, yielding an indexing-friendly pipeline for efficient inference and large-scale video collections. Despite requiring fewer than 90M parameters, P-STVG performs on par with weakly supervised methods and improves on earlier zero-shot approaches at a fraction of their memory and computational cost, establishing a favorable performance-efficiency trade-off for STVG.

[38] Who Says What: Symbolic Trimodal Binding Mechanisms in Audio-Visual LLMs cs.CV | cs.SD | eess.ASPDF

Jihoo Jung, Youngjoon Jang, Joon Son Chung

TL;DR: 分析音视频LLM如何通过时间序列和空间坐标等符号变量绑定说话人、声音及画面人物。

Details

Motivation: 多人视频对话中判断“谁说了什么”需要文本、音频和视觉三模态对齐，现有模型常在该任务上失败。

Result: 研究发现错误主要来自音频—视觉连接错位；借助现成主动说话人检测器在画面中框出当前发言者，可立即提升四个对话基准表现。

Insight: 模型将语音时间序列和视觉实体坐标编码为模态特定符号变量，并在抽象空间跨模态连接；以主动说话人框提示后进行少于300步微调，增益可迁移到三个一般音视频基准。

Abstract: Current Audio-Visual LLMs (AVLLMs) struggle with reasoning over videos featuring multi-speaker dialogues. In such videos, resolving “who says what” is crucial, which necessitates trimodal (text-audio-visual) binding. Motivated by these challenges, we systematically investigate how this trimodal binding is achieved in AVLLMs. Specifically, we identify emergent symbolic trimodal binding mechanisms in AVLLMs that utilize modality-specific symbolic variables. By encoding auditory and visual components into symbolic variables-capturing temporal utterance sequences and spatial entity coordinates, respectively-the model establishes cross-modal linking within this abstract space. Crucially, we reveal that when trimodal binding fails, the breakdown predominantly stems from misaligned audio-visual connections. To overcome this bottleneck, we introduce an audio-visual prompting method utilizing an off-the-shelf Active Speaker Detection (ASD) model. By simply overlaying visual bounding boxes on active speakers, this training-free approach yields immediate performance gains across four conversation-centric benchmarks. Moreover, lightweight fine-tuning of fewer than 300 steps on these ASD-prompted-videos extends these gains to three general AV benchmarks, suggesting the generalizability of our method.

[39] Preserve-and-Compose Training for Composed Image Retrieval cs.CVPDF

Sehyun Kwon

TL;DR: PACT在组合图像检索训练中同时利用目标描述监督和源图像视觉证据，避免改图时丢失原图内容。

Details

Motivation: 收集组合检索的目标图像成本高，零样本方法可依赖目标描述，但目标文字常不提及需保留的源图细节。

Result: 在四个零样本组合检索基准上，结合目标描述与源图证据后，在不同数据集、骨干规模和外部图库上表现强；摘要未提供具体数值。

Insight: 只需图像—文本—文本三元组而不需目标图或更新图库，训练时把修改查询对齐目标文本、同时保留源视觉证据；Chord评分综合目标相似度与冻结图像空间中的源相对方向一致性。

Abstract: Composed image retrieval (CIR) aims to retrieve images that satisfy a user-specified modification while preserving relevant visual content from a reference image. Collecting target images for this purpose is costly, motivating zero-shot CIR methods that instead use target captions as supervision. However, target captions may omit source details that should be preserved. We therefore propose, Preserve-and-Compose Training, which complements target-caption supervision with visual evidence from the source image. PACT learns from image–text–text (ITT) triplets without target images or gallery updates, aligning composed queries with target captions while preserving source evidence through visual supervision. We further introduce Chord scoring, which combines target similarity with source-relative directional agreement in the frozen image space. Results across four ZS-CIR benchmarks show that combining target-caption supervision with source-image evidence leads to strong retrieval performance across datasets, backbone scales, and external galleries. The code is available on https://github.com/sehyunkwon/PACT.

[40] Geometric Inconsistency Localization in Multi-View Image Sets cs.CV | cs.AI | cs.CR | cs.MMPDF

Xander Staelens, Albéric Loos, Bert Ramlot, Hannes Mareen, Peter Lambert

TL;DR: DeformView和DEFECt3R为宽基线多视图图像中的几何不一致提供像素标注基准与定位模型。

Details

Motivation: 新视角合成可生成逼真图像，但不同视角间几何不一定一致；多视图一致性在媒体取证中用于局部定位的潜力尚少研究。

Result: 已有新视角合成一致性评分方法迁移到取证定位时表现较差；DEFECt3R用显式标注训练后提高定位效果并显著减少误报。

Insight: 通过跨视角特征关系逐像素定位，并加入“几何一致但发生变形”的困难负样本；消融显示表征质量与对应关系精度都影响定位。

Abstract: Novel view synthesis (NVS) models can produce realistic new views of the same scene from different viewpoints. However, these generated views are not always geometrically consistent with one another. Multi-view (MV) consistency has shown promise as a tool for evaluating these NVS models. Its potential for multimedia forensics, however, remains largely unexplored, particularly for localizing geometric inconsistencies across wide-baseline image pairs. To enable research in this direction, we introduce DeformView, a wide-baseline MV dataset with pixel-level annotations of geometric inconsistencies. Using DeformView, we evaluate state-of-the-art MV consistency-scoring methods and show that approaches developed for NVS evaluation transfer poorly to the forensic task of geometric inconsistency localization. To address this limitation, we propose DEFECt3R, a lightweight learning-based classifier that uses cross-view feature relationships to localize geometric inconsistencies at the pixel level. By learning from explicit supervision, including hard negatives from geometrically consistent yet deformed views, DEFECt3R improves localization performance and substantially reduces false positives compared to existing consistency-scoring methods. Ablation experiments further show that both feature representations and correspondence quality contribute to localization performance. Overall, our findings demonstrate that MV geometric consistency is a promising yet underexplored signal for multimedia forensics and establish a benchmark and baseline for geometric inconsistency localization in wide-baseline MV image pairs. Code and dataset are available at https://github.com/IDLabMedia/DeformView-DEFECt3R

[41] UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning cs.CV | cs.AIPDF

Lei Xin, Zeheng Wang, Jiayin Zhu, Shihong Huang, Fanhu Zeng

TL;DR: UniAR以多粒度提示和专家混合对齐缺失文本与视觉证据，统一进行自闭症识别。

Details

Motivation: 自闭症识别缺少配对诊断文本，现有方法主要依赖视觉分析，难表达有临床意义的语义推理。

Result: 四个脑MRI及面部表情基准上优于先进方法；MRI平均准确率75.9%、面部基准91.6%，分别较基线平均提高1.5和1.2个百分点。

Insight: 大多模态模型生成词、短语和句子级分层描述，补充临床报告缺口；多尺度专家混合模块将量化视觉原型与相同粒度语义动态匹配。

Abstract: Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder for which early and accurate diagnosis is critical to improving long-term developmental outcomes. However, existing ASD recognition methods are often constrained by the scarcity of diagnostic text data, forcing them to rely mainly on visual analysis and limiting their ability to model clinically meaningful semantic reasoning. To address this challenge, we propose UniAR, a unified framework enhanced by multi-granularity prompt learning for robust ASD recognition under heterogeneous data variations. Specifically, UniAR leverages a large multimodal model to generate hierarchical diagnostic descriptions at the word, phrase, and sentence levels, compensating for the lack of paired clinical reports. To align the generated semantics with visual evidence, we further design a Mixture-of-Experts-based Multi-Scale Alignment Module, which dynamically matches vector-quantized visual prototypes with semantic representations at corresponding granularities. Extensive experiments on four benchmarks covering brain MRI and facial expression scenarios show that UniAR consistently outperforms existing state-of-the-art methods, achieving average accuracies of 75.9% on MRI benchmarks and 91.6% on facial benchmarks, while improving average Accuracy on MRI benchmarks by 1.5 percentage points and average Accuracy on facial benchmarks by 1.2 percentage points over baselines. These results demonstrate that UniAR offers a robust and interpretable framework for ASD screening under semantic scarcity.

[42] DyMD: Preserving Interaction Dynamics through Distribution Matching Distillation in Few-Step Video World Models cs.CV | cs.AIPDF

Haojun Xu, Jie Huang, Xin Lu, Mingchen Zhong, Zihao Fan

TL;DR: DyMD改造分布匹配蒸馏的教师监督和评论器拟合，保留少步视频世界模型中的机器人—物体交互动态。

Details

Motivation: 少步蒸馏能加速视频生成，却可能在保留外观时压制机器人—物体运动；弱重噪声限制运动恢复，强动态样本又会造成评论器拟合困难。

Result: 将14B教师蒸馏为四步1.3B学生后，R-Bench任务遵循率比基础DMD高9.6个百分点，PAI-Bench-G高5.1点；两个WorldArena任务平均成功率34%，基线DMD为16%。

Insight: 时序亲和条件重噪按当前交互保真度调整去噪步分布，平衡运动恢复和外观细化；动态引导的假分数追踪则对难拟合的强运动轨迹加权。

Abstract: Large video diffusion models offer expressive priors for embodied prediction and learning, yet their many-step sampling remains costly for interactive downstream use. Distribution Matching Distillation (DMD) enables few-step video generation, but can suppress robot–object motion while preserving visual quality. Examining DMD’s teacher and fake-score signals, we find that weak re-noising keeps the teacher posterior concentrated near motion-deficient rollouts, limiting motion-restoring guidance. Meanwhile, stronger-motion rollouts tend to incur larger fake-score fitting errors, which can hinder the generator’s learning of interaction dynamics. We propose DyMD, a DMD framework that adapts both teacher supervision and critic fitting to the evolving student. Temporal affinity–conditioned re-noise sampling adapts the timestep distribution to each rollout’s current interaction fidelity by mixing the base schedule with a teacher prior motivated by local posterior variation, thereby balancing motion recovery and appearance refinement. To better track stronger-motion rollouts, dynamics-guided fake-score tracking uses a noise-conditioned predictor to estimate noise-relative fitting difficulty from latent temporal dynamics, then upweights predicted-hard rollouts in the critic loss. Using DyMD, we distill a 14B teacher into a four-step 1.3B student with no auxiliary modules at inference. On embodied-video benchmarks, the student improves R-Bench task adherence by $9.6$ percentage points and PAI-Bench-G Domain score by $5.1$ points over Base DMD while maintaining comparable visual quality. As a backbone for downstream action planning, our student achieves 34% mean success across two WorldArena tasks, compared with 16% for Base DMD.

[43] Open Vocabulary Domain Unlearning cs.CV | cs.LGPDF

Sumanth Udupa, Mehrtash Harandi, Yadan Luo, Mahsa Baktashmotlagh

TL;DR: 提出开放词汇领域遗忘协议，要求视觉语言模型对未参与遗忘训练的类别也不再识别目标风格。

Details

Motivation: 现有领域遗忘只在训练见过的类别上评测，可能只是记住类别—风格组合，造成已删除整个领域的错觉。

Result: 在PACS、OfficeHome和DomainNet上，所提方法的开放词汇泛化显著优于基线；只需4个样例即可超过基线峰值8-shot结果。

Insight: Fisher信息掩码只改对目标域敏感的权重以保护原有零样本能力；偏好挖掘驱动的目标流形散射在局部扰乱被遗忘风格结构，验证删除需迁移到留出类别。

Abstract: Vision-Language Models (VLMs) exhibit remarkable zero-shot generalization, yet they often encode unwanted or hazardous stylistic domains such as idealized textbook diagrams in medical AI or cartoon vehicles in autonomous driving. Approximate Domain Unlearning (ADU) aims to selectively erase a model’s recognition of a target visual domain while preserving accuracy on the remaining domains. However, existing ADU methods operate under a flawed closed-vocabulary assumption: they evaluate unlearning solely on the specific object classes seen during the unlearning fine-tuning phase. Consequently, these methods do not unlearn the domain itself; they merely overfit to seen class-domain pairs, leaving the domain easily recognizable for unseen classes and providing a false sense of removal. We argue that true domain erasure must be class-agnostic. To address this, we formalize Open-Vocabulary Domain Unlearning (OVDU), a rigorous protocol that mandates domain forgetting must transfer to held-out classes. To solve the OVDU challenge, we propose a surgical parameter-editing framework. First, a Fisher Information mask isolates domain-sensitive weights, mathematically protecting foundational zero-shot generalization. Second, our Targeted Manifold Scattering (TMS) objective uses preference-based mining to locally scatter the forget domain’s stylistic geometry. Evaluated across PACS, OfficeHome, and DomainNet, our method vastly improves open-vocabulary generalization over existing baselines. Crucially, it delivers exceptional sample efficiency, outperforming peak 8-shot baseline results with only 4 shots.

[44] OpenVAM: Open-World Visual Attention Modeling with VLMs cs.CVPDF

Kiana Hooshanfar, Amirhossein Kazerouni, Alireza Hosseini, Michael Brudno, Babak Taati

TL;DR: OpenVAM联合预测注意力热图并说明“看哪里、为什么”，跨自然图像、商业内容和网页界面适配。

Details

Motivation: 稠密显著图不足以支持行动，用户还需知道对应场景元素及其显著原因，并要求模型适应不同领域和监督形式。

Result: 多种数据集实验显示OpenVAM改善域偏移下的稳健性，同时提供以图像为依据的解释；摘要未列具体数值。

Insight: 独立但对齐的稠密视觉分支保持精确定位，指令跟随语义头生成依据说明；三阶段训练逐渐引入语言落地，并用参数高效适配避免扰动显著图分支。

Abstract: Predicting human gaze is a core capability for applications ranging from web/UI design analysis to robotics and human-computer interaction. Yet, most visual attention modeling methods output only a dense saliency map, which is often insufficient for action: practitioners need to connect attention peaks to discrete elements in the scene (what) and understand the drivers of those peaks in context (why), while remaining robust to domain shift across natural images, commercial content, and UI/web layouts. We, therefore, introduce OpenVAM (Open-world Visual Attention Modeling with VLMs), a unified framework that jointly addresses universality and explainability across heterogeneous domains (natural scenes, commercial imagery, and UI/web layouts) and supervision modalities. OpenVAM adopts a decoupled-but-aligned design: a dedicated dense visual pathway provides stable, spatially precise localization, while an instruction-following vision–language semantic head generates grounded what/why explanations conditioned on the same image and data-type prompts. A three-stage training strategy preserves strong localization priors while progressively introducing language grounding and improving explanation alignment via parameter-efficient adaptation without perturbing the saliency branch. We further propose a scalable pipeline to generate multi-domain saliency-reason annotations for training and systematic evaluation. Experiments across diverse datasets show that OpenVAM improves robustness under domain shift while producing image-grounded explanations that make saliency predictions more interpretable.

[45] Implicit Neural Representation for Hyperspectral Video Compression cs.CV | cs.AI | cs.LGPDF

Alfredo Scalera, Paul Murray, Jaime Zabalza

TL;DR: 用隐式神经表示压缩高光谱视频，并同时衡量重建质量和下游目标跟踪性能。

Details

Motivation: 快照相机使高光谱视频更易获取、数据快速增多，但其压缩方法仍处于早期发展阶段。

Result: 相较逐帧传统高光谱图像压缩，BD-PSNR提高4.99 dB、BD-rate降低88.88%；HOT2026低数据场景下跟踪AUC最高提升23.42%，距离精度提高35.56%。

Insight: 将现有RGB视频压缩模型扩展为高光谱视频隐式表示，在保留重建指标的同时检查压缩后跟踪实用性。

Abstract: With the advent of snapshot cameras, hyperspectral video is becoming more readily available. In recent years, new applications have emerged which have led to increasingly larger datasets. However, hyperspectral video compression remains in the early stages. In this study, we explore the use of implicit neural representation as a candidate solution. We propose a novel extension of an existing RGB video compression model, achieving Bjøntegaard Delta PSNR gains of +4.99 dB and Bjøntegaard Delta rate of -88.88% compared to traditional hyperspectral image compression methods applied frame-by-frame. In addition to reconstruction quality, the effects on downstream task performance are measured in the form of object tracking success. Compared to video compressed with methods based on principal component analysis and JPEG2000 in low data regimes, our proposed method improves tracking area under the curve by up to 23.42% and distance precision by up to 35.56% on examples from the HOT2026 dataset.

[46] From Reward Signal to Visual Utility: A Controlled Audit of Medical VLM Post-Training cs.CV | cs.AIPDF

Wang Jingxin

TL;DR: 通过受控审计区分医学VLM后训练的优化活动、目标获取和有用的留出视觉行为。

Details

Motivation: 医学VLM通常按答案准确率评估，但训练目标和参数更新是否让模型更好利用图像证据仍不明确。

Result: Qwen2.5-VL-3B的语言LoRA SFT令正确图像准确率变化不显著，但视觉收益事件下降2.40点、图像敏感度下降5.60点；反事实证据目标在验证集上的收益相较标准GRPO仍不一致。

Insight: 比较语言模型微调、多模态参数范围扩展、标准GRPO和证据目标；生成路径审计还发现标准选项logit可能走与实际答案生成不同的token路径，影响度量解释。

Abstract: Medical vision-language model (VLM) post-training is commonly evaluated through answer accuracy. We examine how changes in accuracy and training objectives relate to image-conditioned decisions in a controlled Qwen2.5-VL-3B study on PMC-VQA. We compare supervised fine-tuning (SFT) with low-rank adaptation (LoRA) restricted to the language model, expanded multimodal adaptation scopes, standard answer-only Group Relative Policy Optimization (GRPO), and a counterfactual evidence objective. On 2,000 clean-test questions, language model LoRA SFT changes correct-image accuracy by +1.10 percentage points (95% paired bootstrap CI:-0.85 to +3.05), while visual-benefit events decrease by 2.40 points and image sensitivity decreases by 5.60 points. Paired records reveal 155 acquired and 203 lost visual-benefit events. Broader adaptation yields lower correct-image accuracy than language-model LoRA SFT. Standard GRPO produces mixed-reward groups and parameter updates, with an uncertain clean test accuracy change. A generation audit reveals that canonical option scores can follow a different token path from generated answers. With scores taken along the greedy generation path, the evidence target improves on the training set; its gains over standard GRPO remain inconsistent on validation data at matched training doses. Sample-level analyses trace how evidence scores, decision margins, and generated answers change during post-training. This empirical and measurement audit identifies gaps between optimization activity, target acquisition, and useful held-out visual behavior.

[47] Diagnosing the Sources of Compositional Failure in Vision-Language Models: A Controlled Analysis cs.CVPDF

Mona Gandhi, Cenk Merih Olcay, Kuan-Chieh Lo, Santiago Castro, Christopher W. Myers

TL;DR: COMPASS把组合图文推理失败分解为组合整合代价与对象、属性和关系技能各自的负荷效应。

Details

Motivation: VLM组合推理表现差常被归因于多组件绑定，但现有基准只测试组合描述，无法与单独识别组件的难度分开。

Result: 对87K图文对比较发现，组合整合差距确实存在但只解释部分退化；274K样本的技能分析显示，各类技能主要受自身原语数量影响，跨技能负荷多数反而有益。

Insight: 按对象检测、属性绑定和关系推理构造技能定向扰动；跨标准对比编码器、组合推理模型和非对比架构均观察到相同模式，说明失败不只是联合推理问题。

Abstract: Vision-language models (VLMs) often struggle with compositional reasoning tasks, but the reasons for this underperformance remain unclear. A common hypothesis is that models struggle to integrate multiple components, leading to training interventions to improve compositional binding. However, this assumption has never been directly quantified. Existing benchmarks evaluate captions only in their composed form, making it impossible to separate the cost of joint reasoning from the cost of recognizing individual components under increasing load. We introduce COMPASS (COMPositional Analysis of SkillS), a controlled evaluation framework designed to isolate and measure the distinct factors underlying compositional failure. By comparing performance on composed captions with their decomposed counterparts , we directly quantify the cost of compositional integration across 87K image-caption pairs. Across multiple VLMs, this gap is real but partial, accounting for only part of the observed degradation. This motivates a finer-grained investigation into what additional factors govern model behavior. We analyze performance at the level of individual skills: object detection, attribute binding, and relation reasoning, using skill-targeted perturbations across 274K image-caption pairs. We find a consistent skill-specific pattern: each skill degrades primarily with the count of its own primitive type (self-load), while cross-load effects are predominantly positive, suggesting that primitives of different types provide useful grounding context. This pattern holds across standard contrastive encoders, explicitly trained compositional reasoning models, and non-contrastive architectures. These findings show that compositional degradation reflects multiple separable factors that cannot be reduced to joint reasoning alone.

Jiajun Jiang, Chunliang Hua, Zichun Chen, Yanxing Wu, Zeyuan Yang

TL;DR: SatNav用卫星图像构建跨城市长程无人机视觉语言导航基准，检验记忆和地理定位能力。

Details

Motivation: 城市级UAV导航需长程记忆和地理依据，但既有基准依赖昂贵三维重建，难扩展地域和任务规模。

Result: 基准含18城59个场景、11.8万回合，平均轨迹379米；既有导航智能体表现仍困难，卫星训练模型也能迁移到真实飞行观察。

Insight: 自动线索到回合流程把高分辨率卫星裁剪近似为无人机俯视观察，任务分为边界进度跟踪、地标空间定位和带计数线索的路线跟随；另以可切换记忆模块的SwiftVLN开展系统消融。

Abstract: Urban uncrewed aerial vehicle (UAV) vision-language navigation (VLN) requires agents to follow instructions across extended urban spaces, inherently demanding long-term memory and geospatial grounding. However, scaling existing benchmarks remains difficult because of their reliance on costly reconstructed 3D assets, limiting geographic diversity and episode scale. To address this, we introduce SatNav, a scalable, long-horizon UAV VLN benchmark built from high-resolution satellite imagery. SatNav targets city-level navigation missions and uses satellite crops as approximations of UAV nadir views for visual observations. Through an automated cue-to-episode pipeline, SatNav constructs 118K episodes from 59 scenes across 18 cities, with an average trajectory length of 379 m. To stress-test long-horizon memory and geospatial reasoning, SatNav defines three task families: Boundary, Landmark, and Route, targeting loop progress tracking, landmark-based spatial grounding, and route following with counting cues. Benchmarking classical VLN agents and recent agents based on large vision-language models (LVLMs) on SatNav shows that city-scale navigation remains challenging. We further introduce SwiftVLN, a modular framework with switchable memory components, and conduct systematic memory-design ablations. Finally, satellite-to-UAV transfer experiments show that satellite-trained navigation models can operate on real-flight UAV observations, showing the practical relevance of SatNav. Our project page: https://eku127.github.io/SatNav/

[49] ClearGS: Reliability-Aware Gaussian Splatting from Handheld Videos cs.CV | cs.AIPDF

Xuanzhi Liu, Xinyi Wu, Hang Pan, Wensi Huang, Zhenyao Wu

TL;DR: ClearGS 面向手持视频重建 3D 高斯场景时视角覆盖不均、画面质量参差的问题，先按视图可靠性分配监督权重，再利用当前渲染结果引导无参考的视频帧修复。

Details

Motivation: 常规帧筛选以保留或丢弃的二元决策处理输入，难以兼顾模糊帧、退化风险和几何覆盖；单纯降权也无法恢复模糊或畸变造成的细节损失。该工作希望在没有成对清晰图像和匹配干净参考的条件下改善重建。

Result: 在 GS2E 和 GSOTM 上，论文报告 ClearGS 的总体表现达到当时最佳；多种退化设置下 CLIP-IQA 与 MUSIQ 持续提升，LPIPS 在大多数设置中下降。摘要没有给出这些指标的具体数值。

Insight: 方法把监督可靠性建模与渲染引导修复结合起来：RVA 对帧分配连续权重并适度重新启用有用帧，RIVR 则比较渲染、恢复帧及融合候选，最后通过全轨迹修复整合保留早期引入的细节。

Abstract: We present ClearGS for 3D Gaussian Splatting (3DGS) from handheld videos with uneven viewpoint coverage and mixed frame quality. Rather than selecting frames with binary decisions, ClearGS uses Reliability-aware View Allocation (RVA) to assign graded raw-supervision weights based on appearance reliability, degradation risk, and geometric utility, while weakly reactivating useful suppressed frames to maintain trajectory coverage. Since weighting cannot restore details lost to blur or distortion, ClearGS further introduces Render-Guided In-Video Restoration (RIVR). The current 3DGS render provides a pose-aligned structural candidate, a frozen no-reference restoration expert restores the corresponding raw video observation without any clean reference image, and no-reference perceptual scores select among the render, restored observation, and high-frequency fused candidate. ClearGS then applies Full-Trajectory Repair Consolidation to revisit accepted repairs and preserve details introduced early. On GS2E and GSOTM, ClearGS achieves state-of-the-art overall performance, with consistent CLIP-IQA and MUSIQ gains and LPIPS reductions in most degradation settings, without paired sharp supervision or matched clean references.

[50] Structured Reasoning Agentic Framework for Interpretable Critical View of Safety Assessment cs.CVPDF

Qing Xu, Yuxiang Luo, Zhen Chen

TL;DR: ReasonCVS 将腹腔镜胆囊切除术的安全视野评估拆解为解剖结构和关系的逐项核验，并用具备可追溯理由的代理汇总视觉语言模型工具的观察。

Details

Motivation: 现有关键安全视野（CVS）方法通常直接从图像预测整体或标准级标签，缺乏对解剖关系的显式推理，因而难以解释判断过程，也可能不利于组合泛化。

Result: 在 Endoscapes-CVS201 上，ReasonCVS 达到 68.1% mAP，并优于论文比较的现有方法；系统还提供标准级解释和可追踪的临床理由。摘要没有列出各基线的具体分数。

Insight: 先构建解剖场景图，再让专门的视觉语言模型子标准验证器分别检查细项，最后由经过理由蒸馏的语言模型代理进行校准式汇总。分解感知和决策有望提高评估的可解释性。

Abstract: Surgical scene understanding is critical for computer-assisted intervention, yet laparoscopic cholecystectomy remains challenged by the complex anatomy of the hepatocystic triangle and the risk of bile duct injury. Existing methods for Critical View of Safety (CVS) assessment typically treat it as a holistic prediction task, mapping visual features directly to criterion-level labels. This black-box paradigm lacks explicit reasoning about anatomical relationships, limiting both interpretability and compositional generalization. To address this, we propose ReasonCVS, a structured reasoning agentic framework empowered by Vision-Language Models (VLMs) that decomposes CVS assessment into explicit, fine-grained anatomical verification. Specifically, we devise an Anatomical Scene Graph Abstraction (ASGA) that organizes anatomical entities and their spatial relationships into a structured representation. To operationalize this, we introduce a Rationale-Aware Reasoning Agent, powered by a Large Language Model (LLM) fine-tuned via rationale distillation. Functioning as a strict central decision-maker, it invokes VLM-driven Sub-criterion Verifier as a specialized perceptual tool to parse the graph and independently evaluate individual sub-criteria. Through calibrated soft reasoning, this agent synthesizes the tool-gathered distributed observations, yielding a final verdict alongside a traceable clinical rationale. Extensive experiments on the Endoscapes-CVS201 benchmark demonstrate that ReasonCVS achieves superior performance (68.1% mAP) over state-of-the-art while providing interpretable, criterion-level explanations for reliable surgical assessment.

[51] Region-Level Black-Box Defense Against Stealthy Embedding-Space Backdoors in CLIP cs.CV | cs.CRPDF

Ahmed Abdelnaby, Mohamed Elmahallawy

TL;DR: CLIPGuard 是一种无需访问模型参数、梯度或干净验证集的 CLIP 后门防御方法，通过定位嵌入扰动异常的图像区域并只修复可疑区域来降低攻击成功率。

Details

Motivation: 嵌入空间后门可在少量图文投毒后直接污染 CLIP 的联合表示，传统黑盒部署难以取得模型内部信息，而已有黑盒方法对小型或分布外触发器的定位也不够准确。

Result: 在 STL-10、ImageNet 及多类触发器实验中，CLIPGuard 将攻击成功率最低降至 1.05%，同时干净准确率最高保持在 86.34%；论文报告其持续优于 CleanCLIP、CleanerCLIP 等黑盒防御。

Insight: 核心思路是按区域测量嵌入变化，只对疑似恶意区域做语义修复，尽量保留无害内容及图文对齐。摘要给出了跨数据集的最好值，未说明这两个极值是否来自同一设置。

Abstract: Contrastive Language–Image Pretraining (CLIP) has emerged as a dominant vision backbone due to its strong transferability and zero-shot capabilities. However, recent studies reveal a critical vulnerability: embedding-space backdoor attacks. By poisoning only a tiny fraction of image–text pairs, adversaries can implant stealthy triggers that induce targeted shifts in CLIP’s joint embedding space. Unlike conventional backdoors that manipulate classifier logits, these attacks corrupt representations directly, making them highly effective under extremely low poisoning ratios and difficult to detect. Existing defenses require access to model parameters, gradients, logits, or clean validation data—assumptions that rarely hold in realistic black-box deployments. Moreover, current black-box methods struggle to accurately localize small or out-of-distribution triggers. We propose CLIPGuard, a lightweight and fully black-box defense specifically designed to mitigate embedding-space backdoors in CLIP encoders. CLIPGuard identifies malicious regions by measuring segment-wise embedding perturbations and selectively purifies only suspicious segments via semantic inpainting, preserving benign visual content and alignment quality. Extensive experiments on STL-10, ImageNet, and diverse trigger families—including BadCLIP, BadNets, blended, patch-based, and typographic attacks—demonstrate that CLIPGuard reduces attack success rates to as low as 1.05% while maintaining clean accuracy up to 86.34%, consistently outperforming existing black-box defenses, including CleanCLIP and CleanerCLIP. Our code is available https://github.com/wsu-cyber-security-lab-ai/CLIPGuard.git

cs.CL [Back]

[52] A Survey on Fake Review Detection: From Pre-trained Language Models to Large Language Models cs.CL | cs.AIPDF

Fanji Yang, Huiyao Chen, Xi Yu, Meishan Zhang, Xiaohong Xiao

TL;DR: 从信息融合角度综述2018年至2026年初的虚假评论检测，梳理从预训练语言模型到大语言模型的发展。

Details

Motivation: 虚假评论污染评分、推荐及公众信任；LLM既能生成更流畅的欺骗文本，也为检测提供了更强语义表征，但领域进展需要统一综述。

Result: 系统回顾211项研究，按证据来源和融合层级覆盖文本、情感、评分行为、时间信息、用户—商品图、多模态内容、外部知识及LLM信号，并比较Amazon、Yelp和OpSpam等数据集趋势。

Insight: 不同标签构造、数据划分和协议令报告分数难直接比较；开放问题包括对抗生成、跨域迁移、不确定性感知融合、缺失来源鲁棒性和可信评测。

Abstract: Online reviews shape consumer decisions, platform governance, and corporate reputation.Fake reviews compromise this information channel by injecting deceptive evidence into rating systems, recommendation pipelines, and public trust mechanisms.The rise of large language models, or LLMs, has changed the problem in two directions.LLMs can generate fluent and context-aware deceptive reviews, while pre-trained language models, or PLMs, and LLMs also provide stronger semantic representations for detection.This survey reviews fake review detection from an information fusion perspective, covering 211 studies published from 2018 to early 2026.We organize existing work by evidence source and fusion level, covering review text, sentiment, rating behavior, temporal metadata, user-product graphs, multimodal content, external knowledge, and LLM-generated signals.We trace the development from traditional machine learning and deep learning to PLM-based and LLM-based methods, and examine how different approaches combine textual, behavioral, structural, and multimodal evidence.We also analyze reported performance trends on widely used Amazon, Yelp, and OpSpam benchmark families, while noting the limitations caused by different label construction procedures, data splits, and evaluation protocols.Finally, we identify open problems in adversarial generation, cross-domain transfer, uncertainty-aware fusion, missing-source robustness, interpretability, and trustworthy evaluation for AI-generated deceptive content.

[53] Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognition cs.CL | cs.SD | eess.ASPDF

Bo Su, Yueru Yan, Thai Le

TL;DR: 提出目标说话人主动退出转录的端到端ASR任务，允许其余说话人继续识别并保留退出者活动提示。

Details

Motivation: 多人会议中，部分说话人可能不愿被自动转录，但传统系统无法让个人在会中动态选择退出而不离会。

Result: 在AMI英语和AliMeeting普通话数据上，退出说话人的对应词/字转录准确率分别从72.3%降至48.2%及从73.6%降至27.3%，其他说话人的错误率大致不变。

Insight: 轻量注册条件门控模块连接冻结双流语音LLM，可在推理时动态启用对训练阶段未见说话人的退出屏蔽，面向隐私保护会议转录。

Abstract: We introduce target-speaker unlearning ASR (TSU-ASR) task in a fully end-to-end framework for multi-speaker ASR and diarization. Given a multi-speaker utterance and a set of opt-out speakers who do not wish to have their speech transcribed, the task requires an ASR system to transcribe all speakers except the opt-out ones, while still indicating when those speakers are active. As a first step towards tackling this task, we introduce a novel, light-weight Enrollment-Conditioned Gating (ECG) module attachable to a frozen dual-stream speech LLM that enables ASR for new opt-out speakers dynamically during inference, even those who were not seen during initial ECG training phase. Our experiments on both AMI (English) and AliMeeting (Mandarin) datasets show that speech transcription accuracy for corresponding opt-out words or characters falls from 72.3% to 48.2% and from 73.6% to 27.3%, respectively, while retained speakers’ transcription error rates maintain more or less the same. Our approach provides a practical solution for modern video conferencing platforms, allowing speakers to dynamically opt-out from automated AI transcriptions without forcefully leaving the meeting sessions, enabling a privacy-preserving interface for potentially millions of online meetings daily.

[54] Where Does Retrieval-Based Open-Ended Evaluation Fail? Automatic Taxonomy Induction from Long-Form Medical Answer Factuality Verification cs.CL | cs.IRPDF

Heyuan Huang, Jirui Dai, Alexandra DeLucia, Sonal Joshi, Mahsa Yarmohammadi

TL;DR: 为开放式医学回答的检索式事实核查建立两级错误分类，定位检索和验证推理中的具体失败模式。

Details

Motivation: 医学幻觉评估常只看F1，掩盖失误原因；该场景既没有标准答案，也没有人工标注的标准证据供传统RAG诊断使用。

Result: 在开放MedExpert案例及三个闭合数据集上，以四种检索方法和六种前沿核验模型压力测试；扩大模型、增加推理、引入权威网页或医学微调均未消除这些失效。

Insight: 把检索错误分为五个质量维度、核验推理错误分为六个连续步骤，并用LLM裁判辅助模式归纳及规模化标注；结果指向检索后验证范式的基础限制。

Abstract: Retrieval-based factuality evaluation, where LLM-generated claims are verified against evidence from authoritative medical corpora, has become the dominant paradigm for scalable hallucination detection in high-stakes clinical settings. Despite the urgency of reliable and transparent medical fact verification, most systems measure performance with aggregate metrics like F1, which obscure where and why failures occur. Existing RAG diagnostics require gold answers or annotated gold evidence, neither of which exists in this regime. We introduce two comprehensive taxonomies, grounded in a case study on the open-ended MedExpert dataset and 3 closed-ended datasets, decomposing failures into retrieval-stage errors along five quality dimensions, and verifier-reasoning errors into six consecutive steps. We adapt an automatic pattern induction pipeline using LLM-as-Judge to label evidence quality and classify verifier reasoning errors at scale, and then stress-test our findings across 4 retrieval methods and 6 frontier verifier models. Our analysis reveals that scaling model size, adding reasoning effort, expanding to authoritative web sources, and applying medical fine-tuning do not resolve these failure modes, demonstrating that they represent fundamental limitations of the retrieve-then-verify paradigm in open-ended medical settings rather than artifacts of outdated systems. We release our code and data at https://anonymous.4open.science/r/Medical_RAG_eval-4AB5 for the full reproducibility of our results.

[55] The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying Knowledge cs.CL | cs.AIPDF

Alexander Gill, Md Farhan Ishmam, Xuyen Nguyen, Neha Bhat, Parker Henry DeYoung

TL;DR: KNOWS基准评估网页智能体从搜索信息到综合、组织并呈现为文档、演示或表格的完整助手流程。

Details

Motivation: 现有电脑操作基准未全面测量真实助手的多步信息检索、综合推理、程序操作和视觉布局能力。

Result: 前沿智能体在部分成功指标上得分中等，但最佳系统完整通过复杂长程任务的比例不到3%；即使其他步骤完成一半以上，视觉步骤失误也能令最终产物不可用。

Insight: 每项开放式任务都以可交付文件结束，评估器把确定性检查与LLM判断结合，平衡丰富度、可靠性和自动化。

Abstract: Existing computer-use agent benchmarks do not fully evaluate agents acting as assistants. A useful assistant retrieves information across complex, multi-step workflows, synthesizes it into artifacts (documents, presentations, spreadsheets), and navigates program interfaces to produce a coherent final product. Such workflows demand reasoning and synthesis, decomposition of complex tasks, as well as visual and spatial understanding. To study agents on workflows like these, we introduce KNOWS, a benchmark of open-ended, complex, browser-based tasks that jointly evaluate these capabilities, with each task culminating in a produced artifact. To write tasks, we develop a task design rubric and a protocol for ensuring that tasks meet the requirements. Each task is paired with an evaluator, a program that combines deterministic checks with LLM judgments to balance the richness, reliability, and automation tradeoff inherent to agent evaluation. We evaluate and analyze frontier computer-use agents and browser-based harnesses. They achieve moderate scores on partial-success metrics, but the best performer fully succeeds in fewer than 3% of our complex, long-horizon tasks. Failures on visual steps render the resulting artifacts unusable, even when agents complete more than 50% of other evaluation steps. Our results expose limitations of current agents acting as end-to-end assistants, and call for progress on tool use, visual understanding, and long-horizon reasoning.

[56] Probing Stability-Plasticity Tradeoffs in Agent Memory through Cognitive Experimental Paradigms cs.CL | cs.AI | cs.LGPDF

Jiaqi Ding, Guorong Wu

TL;DR: MemProbe以认知心理实验范式诊断智能体长期记忆何时更新、保留、归因或标记不确定。

Details

Motivation: 长期记忆评估常压缩为最终答案准确率，无法揭示干扰、错误信息、强化和重新激活对记忆更新的影响。

Result: 在56个诊断情节和六种增量式记忆系统上，相近总分的系统展现出不同的行为画像。

Insight: 四项可复用实验分别操纵干扰、错误信息、巩固强度及再巩固窗口，再把正确性拆解为可解释的记忆维护行为。

Abstract: Agent memory systems are increasingly used to maintain long-term user preferences, task states and evolving facts, but current evaluations often collapse memory behavior into final-answer accuracy. We introduce MemProbe, a cognitive-science-inspired framework for diagnosing stability-plasticity tradeoffs in agent memory. The framework is motivated by a core insight from cognitive memory research: memory is reconstructive and shaped by interference, source reliability, reinforcement, and reactivation. MemProbe turns this insight into four reusable experimental paradigms (interference, misinformation, consolidation strength, and reconsolidation window) that manipulate when a memory should be updated, preserved, or treated as uncertain. It further decomposes correctness into behavioral profiles that reveal how systems update, preserve, attribute, and temporally organize information. We instantiate these paradigms in a 56-episode diagnostic suite and evaluate six incremental memory systems under a unified protocol. Results show that systems with similar aggregate scores exhibit distinct behavioral profiles. MemProbe provides such a diagnostic lens, turning aggregate performance into interpretable profiles of memory maintenance over time. Code is available at https://github.com/jq-ding/MemProbe.

[57] Recursive Self-Improvement via On-Policy Distillation for Reasoning cs.CLPDF

Shangjian Yin, Zehao Zhao, Kavosh Asadi, Rui Liu, Yuchen Lu

TL;DR: DCE与SRCL扩展在策略自蒸馏，使学生改进能反哺特权教师，并用精炼重写控制冗长输出。

Details

Motivation: 标准自蒸馏冻结教师有利训练稳定，却无法让教师吸收学生训练中学到的改进；强化修订还可能让回答过长且过度自我批判。

Result: 在多种模型规模和四个竞赛数学基准上，DCE+SRCL超过OPSD；Qwen3-8B的Average@12为65.97%，高于OPSD 35.62个百分点，且比仅DCE平均短7.80%。

Insight: 动态共同演化使特权教师和学生跨轮互相进步；短且验证过的学生自我改写进一步作为自精炼简洁学习目标。

Abstract: On-policy distillation (OPD) trains a student model by having it generate trajectories, then matching its next-token predictions with an external teacher’s next-token predictions. This provides dense, token-level supervision to the student. On-policy self-distillation (OPSD) eliminates the need for the external teacher. Specifically, a second frozen copy of the student model, now given the ground truth in its context, serves as the teacher. The student model only receives the problem and learns to mimic the privileged teacher model, while the teacher remains frozen throughout training. Previous work showed that freezing the teacher is useful for training stability, but we argue that this can prevent the teacher from incorporating the improvements learned by the student during training. Our primary contribution is to address this limitation with a recursive framework built around two complementary components. First, we let the privileged teacher co-evolve with the student so that revision learned in one round can guide the next, a process we refer to as Dynamic Co-Evolution (DCE). Second, because stronger revision can also make responses too verbose and self-critical, we additionally train on shorter, verified rewrites of the model’s own on-policy responses. We call this complementary objective Self-Refined Concise Learning (SRCL). Overall, our comprehensive evaluations show that DCE+SRCL outperforms OPSD across multiple model scales and four competition-level mathematics benchmarks. Specifically, on Qwen3-8B, DCE+SRCL reaches 65.97% Average@12, outperforming OPSD by 35.62 percentage points while reducing mean output length by 7.80% relative to DCE alone.

[58] TRACE: Temporal Audit and Condition-aware Evaluation of Streaming Video Understanding cs.CL | cs.CVPDF

Yibo Ma, Qianqian Zhang, Peng Liu, Tiancheng Zhao

TL;DR: TRACE为流式视频理解制定带证据时序和响应触发条件的评测协议，揭示单一问答准确率掩盖的系统差异。

Details

Motivation: 现有流式评测很少明确证据何时有效、视觉历史如何维护或何时应响应，相同分数可能对应不同负载和失误。

Result: 在517段视频的1,240条记录上评估八种模型/系统配置；近似问答准确率可伴随完成率、答案有效性和生成工作量明显不同。

Insight: 协议统一控制信息可用时间并记录历史处理与响应事件，分别报告答案质量、及时性、响应选择、工作量、完成及可靠性；主动响应还区分延迟、误报和漏报。

Abstract: Streaming video understanding requires models to interpret evidence as it arrives, yet current evaluations often report task scores without specifying when evidence becomes valid, how visual history is maintained, or how responses are triggered. As a result, similar scores may correspond to different workloads, failure modes, and operational behavior. We introduce TRACE (Temporal Audit and Condition-aware Evaluation), a condition-aware benchmark and evaluation framework that makes these factors explicit. TRACE combines temporally audited visual tasks with evidence timing and instruction-dependent trigger annotations, a unified causal Core–Adapter protocol that controls information availability while recording actual history processing and response events, and multidimensional reporting of answer quality, timeliness, response-selection behavior, workload, completion, and reliability. On 1,240 records from 517 videos, we evaluate eight publicly available models or systems in eight configurations. We find that nearly identical QA accuracy can mask substantial differences in completion, answer validity, and generation workload, while proactive performance separates into response quality, response delay, false alarms (responses emitted while no target window is currently valid and a later one remains), and missed target windows. These results show that streaming-video performance should be interpreted as execution-conditioned system behavior rather than a single score. Our benchmark and code can be accessed at \href{https://github.com/om-ai-lab/trace-bench}{https://github.com/om-ai-lab/trace-bench}.

[59] SEA-CLIP-Tiny: Efficient Multilingual Text-Vision Embedding for Southeast Asian Languages cs.CLPDF

Puja Ahmad Habibi, Faiz Assabil Firdaus, Ashvanth S, Ekapol Chuangsuwanich, Pume Tuchinda

TL;DR: SEA-CLIP-Tiny是面向东南亚语言的轻量文本—视觉检索模型，参数少于5,000万。

Details

Motivation: 区域语言多样且数据、算力有限，现有多语图文嵌入对东南亚语言支持不足。

Result: 七种语言上学生模型平均检索表现最佳，R@1、R@5和R@10分别为12.9%、31.5%和42.2%；较MobileCLIP2的平均R@10高12.1个百分点，参数少38.4%，CPU延迟更低。

Insight: 把CLIP知识蒸馏框架适配到区域多语场景，结合本地数据整理和多语教师指导，说明区域感知训练有助于高效图文嵌入。

Abstract: Multilingual text-vision embedding models are essential for cross-lingual image-text retrieval, but Southeast Asian languages remain poorly supported due to the region’s linguistic diversity and limited data and computing resources. In this paper, we introduce SEA-CLIP-Tiny, a compact multilingual text-vision embedding model for Southeast Asia with fewer than 50M parameters. Our model adapts a CLIP-KD-style framework to Southeast Asian multilingual settings through regional data curation and multilingual teacher guidance. Experiments across seven Southeast Asian languages show that SEA-CLIP-Tiny achieves the strongest average retrieval performance among the evaluated student models, reaching 12.9%, 31.5%, and 42.2% at R@1, R@5, and R@10, respectively. Compared with MobileCLIP2, it improves average R@10 by 12.1 points while using 38.4% fewer parameters and lower measured CPU latency. These results highlight the importance of region-aware training for efficient multilingual text-vision models in Southeast Asia.

[60] Effects of Transcript Compression on LLM-based Medical Misinformation Detection in Japanese YouTube Videos cs.CLPDF

Yuya Wake, Sho Tsugawa, Toshiyuki Amagasa

TL;DR: 比较完整及多种压缩日语医疗YouTube视频转录，评估其对LLM真假信息判别的影响。

Details

Motivation: 长视频健康内容评估常把完整转录替换成摘要、检索片段或候选主张筛选，但这种压缩是否损害事实判别尚不明确。

Result: 74段真假视频中，完整转录表现最好；所有压缩方案均增加假阴性，摘要下降最大，候选句筛选是压缩方案中最佳但仍漏掉许多医学相关句子。

Insight: 摘要会丢失情绪、社会、时间、认知和对话线索，摘要及RAG还会让机构和技术术语更突出；压缩可使假视频看起来更连贯权威，削弱检测线索。

Abstract: Large language models (LLMs) are increasingly used to assess long-form medical videos, but their effectiveness may depend on whether transcripts are provided in full or compressed through summarization, retrieval, or claim screening. This study examines how such transcript compression affects LLM-based veracity classification of Japanese medical YouTube videos. We compare four transcript input designs: full transcripts, LLM-generated summaries, RAPTOR-based retrievalaugmented generation (RAG), and Screening, which extracts candidate medical and health-related sentences. Using 74 long-form videos labeled as Real or Fake, we evaluate classification performance and analyze linguistic changes using J-LIWC, hedge expressions, and institutional or technical terms. The full-transcript Baseline achieved the best performance, whereas all compressed inputs increased false negatives, meaning that Fake videos were more likely to be misclassified as Real. Summary caused the largest performance drop, while Screening performed best among the compressed inputs but still omitted many medically relevant sentences. Linguistic analyses showed that these errors were not explained by a simple increase in certainty. Instead, Summary reduced affective, social, temporal, cognitive, and conversational cues, while Summary and RAG made institutional and technical terms more salient. These findings suggest that transcript compression can represent Fake videos as more coherent and authoritative inputs, thereby weakening cues needed for misinformation detection

[61] From annotation to reasoning: Culture in language models cs.CLPDF

Daniel Hershcovich, Alexander Conroy, Jens Bjerring-Hansen

TL;DR: 提出以文学阐释研究语言模型的文化推理深度，评价其能否基于文本证据解释文化典故并回应批评。

Details

Motivation: 文化基准常测事实、调查答案一致性或既定意义识别，无法判断多种解读中模型能否举证、解释具体文本并修订观点。

Result: 论文提出将证据中心基准、保留学术分歧的评估和文学语料及学者反馈实验结合，以丹麦文学作为具体起点；摘要没有报告模型实验结果。

Insight: 文化能力除覆盖广度外还有解释深度；文学中对典故的调用和改写适合研究不同解释之间虽有分歧、却仍可比较论证质量的情形。

Abstract: How should we evaluate language models when more than one interpretation can be right? Cultural benchmarks often test factual knowledge, agreement with survey responses, or recognition of a predefined meaning. These tasks leave open whether a model can explain how a cultural reference works in a particular text, support a reading with evidence, or revise it after criticism. This is a question of interpretive depth, complementary to the breadth of cultural coverage. We argue that literary interpretation offers a useful setting for studying these capabilities. We focus on cultural referencing and reuse: how texts invoke, repeat, and transform earlier expressions across historical and linguistic contexts. Our central claim is that literary scholars can disagree about an interpretation while recognizing the quality of its support. We propose linking evidence-centered benchmarks, evaluation that preserves scholarly disagreement, and model-development experiments on literary data, contextual resources, and scholarly feedback. Danish literature provides a concrete starting point, with implications for other languages and domains. The aim is to develop alternative evaluation strategies that go beyond conventional benchmark metrics and guide model development toward cultural robustness in AI systems.

[62] ToolSearcher: Optimizing Tool Selection at Scale via Reinforcement Learning cs.CLPDF

Zhenlong Dai, Xujie Song, Zitong Wang, Tong Niu, Jian liu

TL;DR: ToolSearcher用强化学习训练智能体在大规模工具库中多轮检索、辨析和组合适用工具。

Details

Motivation: 现实工具仓库规模庞大且功能相似，模型在上下文限制下难以找到兼容工具；传统工具学习多假设工具集小且预先给定。

Result: 在大规模工具选择基准及迭代搜索、复杂组合设置中持续超过多种强基线；摘要未提供具体分数。

Insight: 类别约束辨别相似工具，事件级搜索建模优化多轮发现目标工具，轨迹对齐信用分配为搜索和选择各阶段提供细粒度奖励。

Abstract: Large language models (LLMs) excel at natural language processing but struggle to interact with external environments. Tool learning provides a promising way to extend LLMs into actionable agents, where tool selection is a critical prerequisite for successful tool use. Existing work often assumes a small or predefined set of tools, leaving large-scale tool selection underexplored. Real-world repositories contain a vast and diverse array of tools, making it difficult for LLMs to effectively search, distinguish, and compose tools under context-length constraints. We identify large-scale tool selection as a new challenge for agentic reinforcement learning, highlighting that existing RL methods for knowledge-based question answering are inadequate for selecting tools while considering compatibility. To address this challenge, we propose ToolSearcher, a novel RL framework for effective multi-turn search and fine-grained optimization in large-scale tool selection. Specifically, we introduce category-constrained tool discrimination to improve the model’s ability to distinguish functionally similar tools, event-level search modeling to explicitly optimize the discovery of target tools during multi-turn search, and trajectory-aligned credit allocation to provide fine-grained reward signals for different stages of the search-selection process. Extensive experiments on large-scale tool selection benchmarks demonstrate that ToolSearcher consistently outperforms a set of strong baselines in challenging settings involving iterative search and complex tool composition.

[63] Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring cs.CL | cs.SD | eess.ASPDF

Hikaru Asano, Yotaro Kubo, So Kuroki

TL;DR: 提出无需训练的日语发音转录流水线，用文本约束候选并按冻结语音模型声学似然重排序。

Details

Motivation: G2P只用文字、S2P只用语音，各自信息不全；同时使用文本与语音的既有ST2P方法需要昂贵的发音标注数据。

Result: 三种日语语料上，有参考转录时CER由文本基线0.60%至1.40%降至0.04%至0.17%，使用ASR转录时为0.64%至1.58%；贪心搜索比束搜索快3至3.5倍且CER相近。

Insight: 词典和G2P先生成受文本约束的候选，再用冻结S2P模型的整句负对数似然逐步贪心选最佳发音；西班牙语、法语和初步英语测试也优于所比方法。

Abstract: Accurate and efficient pronunciation transcription is essential for preparing text-to-speech training data at scale. Existing approaches have different limitations: grapheme-to-pronunciation (G2P) and speech-to-pronunciation (S2P) methods each capture only partial information, using only text or only speech, while speech-and-text-to-pronunciation (ST2P) methods use both but require costly pronunciation-annotated data. To address this problem, we propose a training-free ST2P pipeline that integrates both lexical and acoustic information at inference time. Lexical resources and G2P tools generate text-constrained candidates, and a left-to-right greedy search selects the best one using whole-sequence negative log-likelihoods from frozen pretrained S2P models. On three Japanese corpora, our method reduces Character Error Rate (CER) from 0.60–1.40% (text-only baseline) to 0.04–0.17% with reference transcripts, and 0.64–1.58% with ASR transcripts. It outperforms all baselines, including a trained ST2P model and commercial multimodal LLMs. Our greedy search method is 3–3.5$\times$ faster than beam search at similar CER, and the cascade is 2$\times$ faster than direct decoding ensuring the efficiency and accuracy. In Spanish, French, and preliminary English, it also surpasses four open multimodal LLMs and the best traditional methods.

[64] Evaluating Sycophancy in Chinese Large Language Models on Factual Questions Derived from Online Search Queries cs.CLPDF

Geng Liu, Feng Li, Mengxiao Zhu, Francesco Pierri

TL;DR: 大规模考察中文模型面对用户错误信念时的事实谄媚，并追踪正确、错误和不确定回答之间的变化。

Details

Motivation: 用户表明错误观点后，模型可能附和并传播错误信息；反谄媚措施也可能只是让正确回答转为不确定，未必保住事实准确性。

Result: 分析三种中文模型对12,165个真实搜索问题的364,941条回答；推理并非稳定防护，反谄媚提示虽可减少错误附和，却可能增加不确定回答，效果依模型和设置而异。

Insight: 将错误信念下的信念一致性错误与原本正确答案变得不确定区分开，进行配对状态迁移分析；不附和错误观点不等同于维持事实正确。

Abstract: As large language models increasingly mediate information access, factually accurate and independent answers are critical. However, these models can exhibit sycophancy by aligning their responses with users’ stated beliefs even when those beliefs are incorrect, potentially presenting misinformation as independently verified and reinforcing users’ confidence in false claims. Prior work leaves unresolved whether introducing user beliefs causes correct responses to become incorrect or uncertain, or causes uncertain responses to become belief-aligned incorrect answers. It also remains unclear whether anti-sycophancy interventions preserve or restore factual accuracy or merely shift responses toward uncertainty. We analyze factual sycophancy in Chinese-language information seeking using yes/no fact-checking questions. Our analysis covers 364,941 responses from three frontier Chinese-based LLMs (DeepSeek, Qwen, and Doubao) to 12,165 factual questions derived from real-world Chinese search queries. We evaluate the models with and without reasoning across baseline, belief-conditioned, and anti-sycophancy prompting, tracing matched shifts among correct, incorrect, and uncertain responses. Under incorrect user beliefs, we distinguish belief-aligned errors from losses of factual confidence, in which initially correct answers become uncertain. Patterns vary across models and reasoning settings: reasoning is not a consistent safeguard, and anti-sycophancy instructions can reduce incorrect agreement while increasing uncertainty. In Chinese-language factual question answering, avoiding agreement with false beliefs is therefore not equivalent to preserving factual accuracy, highlighting the value of transition-level evaluation. Such behavior may undermine the reliability of LLM-mediated information access by reinforcing misinformation or weakening users’ confidence in factually correct answers.

[65] ZooWork-ShopRanker: An Open, Preference-Aligned E-Commerce Reranker cs.CLPDF

Siqiao Xue, Shuxuan Liu, Ning Hu

TL;DR: ZooWork-ShopRanker用多家族LLM裁判的偏好标签训练开放电商重排模型，并蒸馏出更轻量版本。

Details

Motivation: 通用网页检索重排器迁移到电商后表现不佳，因为商品选择还取决于用户偏好、规格约束和相对匹配度，而真实流量缺少干净成对标签。

Result: 8B和4B版本显著优于最强开放重排器，所有型号也优于自身未对齐基线；0.6B超过同规模对照，且提升扩展至常见MTEB基准。

Insight: 多家族推理LLM作为偏好裁判，采用位置去偏与共识等级标签；8B主模型再指导4B和0.6B学习分数，并发布约1万条私有流量ShopRank-Bench。

Abstract: Open rerankers trained for general web retrieval transfer imperfectly to e-commerce, where ranking decisions depend not only on topical relevance but also on user preferences, product constraints, and comparative product fit. These preference signals are difficult to supervise at scale: real search traffic provides authentic queries and candidates but no clean pairwise labels. We present ZooWork-ShopRanker, a family of e-commerce rerankers (0.6B, 4B, and 8B) aligned to judge-labeled shopping preference. Training pairs are labeled by a panel of reasoning large language models (LLMs) from different families acting as a preference oracle, with position-debiased judgments and agreement tiers, and the rerankers are trained on these labels. The aligned 8B flagship then serves as a distillation teacher for the efficient 4B and 0.6B models, which are fit to its scores and sharpened on judged pairs. To measure progress, we introduce ShopRank-Bench, a contamination-limited benchmark of ~10,000 private-traffic preference pairs in both text formats, tiered by how many judge families committed to each label. ZooWork-ShopRanker-8B and -4B significantly outperform the strongest open reranker baseline, every model significantly beats its own un-aligned base, and ZooWork-ShopRanker-0.6B beats its size peer; the gains hold in both formats and extend to common MTEB benchmarks. We release the models and the dual-format ShopRank-Bench to facilitate further research.

[66] G$^2$PTQ: Improving LLM Post-Training Quantization with Generalized Gradient Compensation cs.CL | cs.AIPDF

Ruikang Liu, Haoli Bai, Yuxuan Sun, Qian Zhang, Wenzheng Cai

TL;DR: G²PTQ在块级全局目标中结合一阶梯度和二阶Hessian补偿，改进大语言模型后训练量化。

Details

Motivation: GPTQ局部逐层方法缺全局监督；已有全局方法固定Hessian且忽略一阶梯度，量化过程中指导逐渐过时。

Result: 在多个模型家族和位宽的实验中，量化模型更接近全精度模型，并超过先进基线；摘要未提供具体指标。

Insight: 每量化一个Transformer块前刷新梯度和Hessian估计，并用信赖域缩放限制梯度步长，防止权重更新爆炸；还给出高效块级Hessian和精确梯度实现。

Abstract: Post-training quantization (PTQ) is a practical approach to reducing the memory and computational footprint of large language models (LLMs) without retraining. GPTQ-based methods have become the de facto standard, yet they suffer from two complementary limitations. Methods with local, layer-wise objectives lack global supervision; while methods with global objectives fix their Hessian estimates at the start and ignore first-order gradients, so their guidance grows stale as quantization proceeds. This paper presents G$^2$PTQ, a unified PTQ framework with Generalized Gradient Compensation that integrates both first- and second-order information under a globally supervised, block-wise optimization objective. By refreshing gradient and Hessian estimates before quantizing each Transformer block, G$^2$PTQ avoids the staleness of prior global methods. Furthermore, to stabilize the exact first-order compensation, we introduce a trust-region scaling mechanism that dynamically bounds the gradient step to prevent exploding weight updates. Finally, we derive efficient implementations for block-wise Hessian approximation and exact gradient compensation. Experimental results on various model families and bit-widths demonstrate that G$^2$PTQ enables better alignment with the full-precision model, outperforming state-of-the-art baselines. Code is available at: https://github.com/G2PTQ/G2PTQ.

[67] Modeling Student Sensemaking with LLMs and Knowledge-Graph-Guided Inference cs.CLPDF

Özge Alacam, Zübeyde Demet Kirbulut Güneş, Funda Ekici, Nurcan Turan-Oluk, Dilay Dinçdemir

TL;DR: 研究LLM在无任务微调条件下分析协作科学讨论中的学生意义建构，并检验知识状态结构能否辅助判断。

Details

Motivation: 科学协作学习的对话需按理论解释学生如何发现知识缺口、构建说明和逐步解决问题，人工分析昂贵且难扩展。

Result: 23个专家标注片段显示，无思维链时模型倾向过度预测成功建构；启用推理后更能识别未成功案例，知识状态诊断进一步提升对失败的识别和专家一致性。

Insight: 跨提示条件改变定义支架、推理模式和轮次结构；没有单一设置能在所有意义建构维度上最佳，反映任务本身具有多维性。

Abstract: Collaborative science learning requires nuanced interpretation of student dialogue to characterize how learners identify knowledge gaps, build explanations, and work toward resolution - a theory-driven analysis that is labor-intensive and difficult to scale. We investigate whether instruction-tuned large language models (LLMs) can support multidimensional analysis of collaborative sensemaking without task-specific training, and whether structured knowledge-state information improves model inference. We evaluate two mid-size LLMs on 23 richly annotated, expert-labeled episodes across prompting conditions that vary definitional scaffolding, reasoning mode, and turn structure. Without reasoning, models tend to overpredict successful sensemaking; reasoning-enabled prompting improves identification of unsuccessful cases. Knowledge-state diagnostics provide additional grounding, improving detection of unsuccessful sensemaking and increasing agreement with expert annotations. No single configuration performs best across all sensemaking dimensions, underscoring the multidimensional nature of the task.

[68] Improving Visual Sensitivity of LLMs on Multimodal Machine Translation with Metric-based Loss Weighting cs.CL | cs.AIPDF

Paweł Mąka, Piotr Andruszkiewicz, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis

TL;DR: 基于逐词元跨互信息加权微调，使多模态机器翻译更敏感于真正受图像帮助的词汇。

Details

Motivation: 多模态翻译可利用源文相关图像消歧，但模型可能在融合后仍忽略视觉信息。

Result: 三种语言方向的预训练MLLM评估中，该方法在CoMMuTE对比数据集上优于所测方案，准确率较标准微调最高提高超过7个百分点，同时维持整体翻译能力。

Insight: PCXMI比较有无图像时模型的词元输出概率，找出视觉有益的词并增加相应损失权重；一致性版PCXMI与原指标结合效果最佳。

Abstract: Multimodal Machine Translation aims to incorporate additional signal from non-textual modalities to improve translations by resolving ambiguities. While models, through multimodal fusion, are able to accept images related to the source text, they can ignore this information. Therefore, increasing their visual sensitivity remains an active research area. In this work, we introduce a training method, Metric-based Loss Weighting, that improves visual grounding of translations by increasing the loss function for tokens that benefit from the accompanying image. We identify these tokens using the Point-wise Cross-mutual Information (PCXMI) metric, which compares the model’s output probabilities with and without visual context. We introduce a Congruency-based PCXMI metric and experimentally show that both metrics working in combination yield the best results. We evaluate our method by fine-tuning three pretrained Multimodal Large Language Models on the task of Image-guided Machine Translation for three language directions. Metric-based Loss Weighting outperforms other tested methods on the CoMMuTE contrastive dataset, improving accuracy by up to more than 7 percentage points compared to standard fine-tuning, while maintaining strong general translation performance.

[69] Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding cs.CL | cs.AIPDF

Zhaoyuan Xia, Qinghongbing Xie, Yung Xiang Hue, Jianguang Jiang, Gaofeng Lu

TL;DR: H2S先定位与问题相关且有来源依据的证据，再压缩成摘要供长上下文推理使用。

Details

Motivation: 长文档、对话和代码中的相关证据往往稀疏分散，大量无关和冗余内容挤占上下文。

Result: H2S-14B在七任务基准平均得分32.60，较Qwen3.8-27B高10.17分；4K输出预算保留其16K预算表现的97.1%。

Insight: H2S数据集含6,647个例子、平均上下文43.9K token；强化学习奖励同时覆盖证据筛选、摘要构造和最终答案，显式训练“高亮—总结”过程。

Abstract: Long-context understanding requires large language models (LLMs) to reason over lengthy documents, conversations, and code, yet task-relevant evidence is often sparse and scattered amid substantial irrelevant and redundant content. We propose Highlight-Then-Summarize (H2S), a compress-then-reason paradigm that first identifies source-grounded, question-relevant evidence and then integrates it into a compact, question-conditioned summary before producing the final answer. To train this behavior, we construct H2S-Dataset, comprising 6,647 examples from 11 benchmark families with an average context length of 43.9K tokens, and introduce H2S-RL, which provides process-level rewards for evidence selection and summary construction in addition to final-answer correctness. We evaluate on H2S-Bench, a seven-task long-context suite. Under a shared 128K input and 4K output budget, H2S-14B achieves an average score of 32.60, outperforming Qwen3.8-27B by 10.17 points and obtaining the strongest overall result among the evaluated open-source models. H2S-14B also achieves the highest Evidence-Summary Quality score and retains 97.1% of its 16K-budget performance with only a 4K output budget. These results show that explicitly selecting and integrating evidence improves long-context reasoning while enabling more compact generation.

[70] Stale-Document Poisoning: When Outdated Retrieval Overrides Correct Model Answers cs.CLPDF

Md Shamim Ahmed, Lukas Galke Poech, Richard Röttger

TL;DR: 研究过期检索证据如何覆盖模型原本正确的回答，并称此失效为陈旧文档投毒。

Details

Motivation: RAG只有在检索证据仍有效时才有帮助；过时材料可能使原本正确的模型反而答错。

Result: 317个经核验的跨领域知识更新中，过期证据使Llama和Qwen分别有30%和37%的回答翻错；明确要求服从文档后升至66%和75%。

Insight: 仅告知旧证据日期作用有限，但明确标出其失效时间可使较大模型几乎完全切换到新答案；时间重排也可降低4.6至10.0个百分点投毒，但依赖准确时间元数据。

Abstract: Retrieval-augmented generation (RAG) is often used to address outdated knowledge by providing external evidence. But retrieval helps only when that evidence is still valid. We identify a temporal alignment failure, stale-document poisoning, in which outdated evidence makes a model wrong despite answering correctly without retrieval. We construct a benchmark of 317 verified knowledge reversals across medicine, law, software, and platform policy, grounded in dated official sources. Across 12 models, recent medical reversals are harder than long-established ones. More importantly, outdated retrieval flips 30% of Llama and 37% of Qwen answers even without instructions to trust the document; explicit follow instructions raise these rates to 66% and 75%. Across four open models and four domains, poisoning ranges from 17-91%, while matched up-to-date evidence is followed in 97-100% of trials. To isolate temporal applicability, we keep the historical evidence unchanged across 50 reversals and vary only the evaluation date. A clear pattern emerges: dates alone produce only modest adaptation, but when models are explicitly told when the old evidence stops applying, the larger models switch to the appropriate answer almost perfectly. Causal interventions confirm that this validity information directly shapes the final decision. The same internal components also support broader comparison tasks, suggesting that temporal applicability can recruit a general reasoning mechanism used for other comparisons. Finally, a fixed recency-aware hybrid re-ranker reduces poisoning by 4.6-10.0 points when dates are accurate, with gains that depend on reliable temporal metadata. Reliable RAG therefore requires selective trust: models must determine not only what retrieved evidence says, but whether it still applies.

[71] Sorry Robot, Happy Human: Vision-Language Models Read Only One of Two Legible Typographic Layers cs.CL | cs.AI | cs.CVPDF

Mert İncidelen, Yamen Kashkash, Asya Berker, Murat Aydoğan

TL;DR: DecoyBench测试视觉语言模型在图像中同时出现两种排版文字层时，能否都准确读取。

Details

Motivation: VLM虽擅长OCR，但面对不同空间频率叠加的多层文字仍可能产生脆弱的识别偏差。

Result: 300张图中，人类能高准确率读取两层；高分辨率下模型接近人类地读取轮廓文字，却几乎无法完整读取阴影文字；低分辨率时轮廓层对人和模型都难读，阴影层反而可高准确提取。

Insight: 实验比较六个闭源模型、两种提示及512与64分辨率；结果揭示对多空间频率排版结构的一致行为局限。

Abstract: Vision-language models (VLMs), despite their success in optical character recognition (OCR) tasks, are vulnerable to typographic attacks and have a fragile structure for images with multiple text layers. In this study, the DecoyBench dataset was created using the Decoy Font method. The dataset consists of 300 images, each containing text with sharp contour lines superimposed on another text with soft shading. Six recent closed-source models from three different model families were evaluated using this dataset under two different prompting conditions (naive and guided) and at two different resolutions ($512\times512$ and $64\times64$). A validation study showed that human participants could read both text layers with high accuracy. In contrast, the models, with most variants and both prompting methods, read the contour text with near-human accuracy at high resolution, but almost never fully extracted the shading text. At low resolution, the contour text could not be read by either the models or humans, while the shading text could be extracted with high accuracy. The findings indicate that the evaluated VLMs exhibit a consistent behavioral limitation when processing typographic structures containing multiple spatial frequency layers.

[72] ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMs cs.CL | cs.AIPDF

Junyi Gao, Yu Shi, Pingzhao Hu, Ewen M Harrison

TL;DR: ViSTA以轻量适配器把临床不规则数值时间序列接入多模态语言模型的图表表征。

Details

Motivation: 语言模型擅长医学文本理解，但不一定能从高维结构化患者时间序列准确预测风险；提升数值理解可连接风险估计与灵活病程问答。

Result: MIMIC-IV上，急性肾损伤及死亡预测四项指标中，适配后均值最高；仅51.6万可训练参数的2B模型AKI AUC为0.7376，接近GPT-5.6 Sol文本输入的0.7380。4B模型时间问答准确率69.27%。

Insight: 适配器修正视觉编码的图表token而保持原模型参数冻结；时间问答虽仅需低秩适配参数量的十分之一左右，准确率仍有2.82至4.88个百分点差距。

Abstract: Clinical prediction models estimate risk from patient measurements, while large language models support medical text understanding and question answering. Yet their language capabilities do not ensure accurate prediction from structured, high-dimensional clinical time series. Improving this ability would connect risk estimation with flexible questions about a patient’s evolving condition. We introduce ViSTA, a compact adapter that incorporates irregular numerical measurements into a pretrained vision-language model’s chart representations. It learns corrections to visual tokens while leaving all pretrained parameters unchanged. On MIMIC-IV, ViSTA has the highest mean scores among the compared adaptations on all four metrics for acute kidney injury and mortality prediction across models with 2-9 billion parameters. With 0.516 million trainable parameters, the 2-billion-parameter model reaches an area under the ROC curve of 0.7376 for acute kidney injury, compared with GPT-5.6 Sol’s 0.7380 with text input and high reasoning effort. Training for temporal question answering yields 69.27% accuracy at 4 billion parameters with over 90% fewer trainable parameters than low-rank adaptation using charts or numerical text, at a 2.82-4.88 percentage-point accuracy gap. ViSTA extends pretrained language models to numerical prediction and temporal questions.

[73] MexHat: A Dataset for Hate Speech Detection in Mexican Spanish Videos cs.CL | cs.CVPDF

Itzel Tlelo-Coyotecatl, Hugo Jair Escalante

TL;DR: MexHat构建用于墨西哥西班牙语视频仇恨言论识别的数据集，标注粗粒度内容类型及细粒度仇恨类别。

Details

Motivation: 仇恨检测需要结合上下文判断意图，但非英语资源稀缺，难反映多模态内容中的文化细节。

Result: 约1,000段视频覆盖三分类（无负面内容、冒犯内容、仇恨言论）及仇恨子类别任务；基线结果显示任务具有挑战性。

Insight: 数据集专为墨西哥西班牙语语境设计，目标是保留语言和文化线索供多模态仇恨检测研究。

Abstract: Ensuring online safety through content monitoring had raised Hate Speech Detection as a crucial task to be addressed. By essence the task demands the capture of contextual cues, which are essential for a precise understanding of the content’s intent. Although automated detection approaches for the task have advanced significantly, the scarcity of non-English resources persists, limiting the ability of models to adapt to the subtle, context-dependent, and culturally related nature of multimodal content. In this paper, we introduce MexHat, a video dataset designed to capture the linguistic and cultural cues for the hate-speech detection task in a Mexican Spanish context. Our dataset comprises around 1k video clips annotated across two tasks: a three-way class evaluation (no negative content, offensive content and hate-speech content), and a fine-grained class evaluation including three hate-speech sub-categories. The dataset statistics and the baseline results highlight the inherent challenges associated with the task. Disclaimer: This paper contains sensitive content that may be disturbing to some readers.

cs.AI [Back]

[74] When Is a Multi-Agent Code Judge Actually Grounded? Two Label-Free Measurements, and a Judge That Declines to Guess cs.AI | cs.CL | cs.SEPDF

Salma Roshdy Aly, Hussein Assaf, Ziad Kobti

TL;DR: 研究多智能体代码裁判在何时真正有证据依据，并用无标签日志信号识别应拒绝猜测的比较。

Details

Motivation: 语言模型裁判常给出自信判决和理由，却不说明缺乏证据；文档检索类多智能体核验方法迁移到代码比较时未必有效。

Result: 在两个代码基准80种条件中，原版MARCH有78%至95%的比较判双方同样好，准确率仅4.4%，而直接询问同模型为43.7%；基于一个日志信号拒判后准确率从20.7%升至36.9%，仍回答约一半比较。

Insight: 代码裁判证据既要独立于待评答案，也要能区分两个候选；区别于检索文档任务，代码评判常不满足第二条件，因此贡献是无标签检测“无从判断”，而非宣称裁判更准。

Abstract: When one language model judges whether another’s code is correct, it does not report the absence of evidence. It returns a confident verdict with reasoning attached, indistinguishable from a verdict it had grounds for. Multi-agent verification, which decomposes a judgment into checkable claims and verifies each against evidence, is a promising response and works well when the evidence is a set of retrieved documents. We argue such methods require two things of their evidence: it must be independent of the answer under review, and it must differ between the two candidates being compared. The second condition holds automatically with retrieved documents and stops holding in code judging. Running MARCH, a published framework unmodified over 80 condition-by-cell measurements on two code judging benchmarks, we find it declares both solutions equally good on 78 to 95% of comparisons, reaching 4.4% accuracy where the same model asked directly reaches 43.7%. Neither easier problems nor a larger judge changes this. Two measurements taken from the pipeline’s own logs explain it without needing labels. Gating on one of them, the pipeline declines the comparisons it cannot make and raises its accuracy from 20.7 to 36.9% while still answering half of all comparisons. The contribution is not a more accurate judge, but a label-free way to tell when a judge has no basis for its answer.

Ljubisa Bojic, Tijana Stanic, Joerg Matthes, Agariadne Dwinggo Samala, Bojana Dinic

TL;DR: 比较不同人物档案和提示风格能否让LLM准确模拟个体对社交媒体内容的反应。

Details

Motivation: 平台用虚拟用户测试政策时需保证模拟忠实，但逼真的假档案也可能操纵公众舆论；验证通常关注与群体行为吻合，忽略是否符合所给个体档案。

Result: 八名塞尔维亚参与者的68条帖子反应中，态度信息比人口背景更能提升预测；要求模型直觉、立即作答的条件最符合个体，且对未询问过的主题仍优于人群基线。

Insight: 直觉提示把个体差异压缩程度从真实人类的7倍降至3倍；有档案时模型与自身陈述档案的一致性不代表它真正忠实模拟了目标个体。

Abstract: Platform policies are increasingly tested on artificial users, making agent fidelity important. Yet convincing fake profiles could also manipulate perceived public opinion before elections. Validation has concentrated on agreement with human behaviour and has paid little attention to whether an agent behaves in line with the profile it was given. The present study profiled eight Serbian participants through a questionnaire, a deep interview, and a written self-presentation, recorded their reactions to sixty-eight social media posts, and asked four language models to predict those reactions under five prompt conditions varying profile content and instruction style. Attitudinal content improved prediction over demographic backstories by a wide margin. Agents matched their stated profiles more closely than participants matched their own survey answers, and consistency proved unrelated to fidelity once profile information was present. Instructing models to respond intuitively and immediately rather than analytically gave the highest fidelity of any condition and cut the compression of individual differences from seven times the human level to three. The advantage held on posts about topics the questionnaire never raised, where that condition reached the highest fidelity of any setup and beat a crowd baseline by a wide margin, which suggests that agents prompted this way could serve as general-purpose simulated users rather than specialists on the topics they were profiled for. Results may bear implications for the development of language models, because intuition-based setups appear better suited to some tasks than reasoning-based ones.

[76] The Right Information Extraction Pipeline Depends on the Document: Accuracy-Energy Trade-offs for Small, Local Models cs.AI | cs.CLPDF

Christoph Walser, Mauricio Fadel Argerich, Jonathan Fürst

TL;DR: 比较本地小模型对纯文本及版面丰富文档的解析准确率—能耗折中，给出文档类型相关的流水线选择建议。

Details

Motivation: 隐私敏感文档常不能交给云服务，需在本地用不超过8B参数模型处理；输入图像还是先解析文本取决于文档结构。

Result: 批处理是主要节能手段，每页能耗降低38%至85%且准确率不变；神经OCR能耗为传统OCR的17倍且不在Pareto前沿。版面丰富文档偏向VLM，近纯文本则小型文本模型加轻量解析器更准也更省。

Insight: 在Kleister-NDA合同和VRDU表单上共同考察输入表示、模型家族和推理设置；FP8在单请求节能27%至32%，应用批处理后单页收益不足1mWh。

Abstract: Whether an information extraction pipeline should process page images or parsed text depends on the document, and the answer flips across the layout spectrum. We study this trade-off under a constraint that rules out (closed) cloud services: privacy-sensitive documents processed on-premise by small ($\le 8\mathrm{B}$ parameter) text-only and vision–language models, evaluated on both accuracy and energy over a design space spanning input representation, model family, and inference configuration. Benchmarking on the near-plain-text Kleister-NDA contracts and the layout-rich VRDU forms, we find that batching is the dominant energy lever, cutting energy per page by 38-85% at no cost in accuracy, while FP8 quantization saves 27-32% when requests are served one at a time but less than 1mWh per page (9-19%) once batching is applied. Preprocessing dominates what remains: neural OCR costs $17\times$ more energy per page than classical OCR and never reaches the Pareto frontier. Which representation wins flips with the type of document: vision–language models on layout-rich documents and small text-only models with a cheap parser on near-plain text, where they are both more accurate and cheaper than any vision–language configuration. Our work yields concrete guidelines for energy-efficient, privacy-compliant local information extraction.

[77] Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency cs.AI | cs.CL | cs.LGPDF

Parsa Hosseini, Akasha Tigalappanavara, Sumit Nawathe, Chenrui Fan, Sourya Basu

TL;DR: 研究发现，只用 600 道题进行自监督置信度微调，也能在推理时不增加置信度询问或提前停止机制的情况下减少推理 token。

Details

Motivation: 推理模型常生成很长的思维轨迹，现有提效方法多直接在推理阶段停止生成，或在训练中惩罚长度。作者考察能否通过学习中间步骤的置信度，让效率提升作为元认知能力的副作用出现。

Result: 在 Gemma、Qwen、Nemotron 和 GPT-OSS 等模型的数学、科学及代码推理基准上，在准确率匹配时生成 token 最多减少 25%；论文称其效果可与直接优化短推理的方法相比。摘要没有给出各模型的逐项结果。

Insight: 置信度只作为训练目标，损失中没有长度或停止目标，推理时仍使用标准生成流程。分析还显示，高层推理组成总体得到保留，提示元认知监督可能改善效率而不必专门压缩某类推理行为。

Abstract: Reasoning models often generate very long reasoning traces, making inference computationally expensive. Existing approaches typically improve efficiency either through inference-time early-stopping mechanisms or by explicitly encouraging shorter reasoning during training, for example through reinforcement learning with length penalties. We show that substantial efficiency gains can instead emerge from a different kind of supervision: \textit{confidence}. Using a self-supervised procedure, we fine-tune reasoning models to predict their confidence in the answer at intermediate points along their own reasoning trajectories using only 600 training problems. Confidence is used only as a training target: the loss contains no objective for reasoning length, efficiency, or stopping. At inference, the fine-tuned models use the standard generation procedure, with no confidence elicitation or early-stopping mechanism. Despite this, self-supervised confidence fine-tuning makes reasoning more efficient, reducing generated tokens by up to 25% at matched accuracy across Gemma, Qwen, Nemotron, and GPT-OSS models on mathematical, scientific, and coding reasoning benchmarks, with efficiency gains comparable to methods that explicitly optimize for shorter reasoning. Analysis of reasoning episodes further shows that confidence supervision largely preserves the base models’ high-level reasoning composition rather than selectively suppressing particular behaviors. Our results suggest that efficient reasoning may emerge as a downstream consequence of learning metacognitive signals, without being directly optimized.

cs.CR [Back]

[78] JevAdvBench: A Benchmark and Black-Box Attacks for Reinforcement Learning for Calibrated Decisions Models cs.CR | cs.AI | cs.CLPDF

Jianyi Hu, Hangtao Zhang, Yi Liu, Yeqi Zeng, Li Zeng

TL;DR: JevAdvBench为经强化学习校准的决策模型提供首个对抗基准，并测试单字段修改对其类型化答案的影响。

Details

Motivation: 传统攻击基准评估生成或执行内容，不适用于只输出结构化分数、即使被操纵也格式正确的RLCD模型；其鲁棒性尚未量化。

Result: 基准含66个场景、812个类型化问题及9,744种单编辑攻击；在jev-1.13.0上，给输入状态附加一条未经核实意见可翻转12.1%决策，使38%的高置信答案低于人工复核阈值。

Insight: 把受攻击决策与模型自身干净决策比较，并用相同输入重跑估计随机波动；提示应用把状态视为可能不可信、且带立场的输入。

Abstract: Models trained with reinforcement learning for calibrated decisions (RLCD), such as Jev, answer a typed question about an input, the state, with a probability, a choice, or a score, and software acts on the answer without a person reading it. Their robustness has not been measured: adversarial benchmarks score what a model generates or executes, whereas a typed model generates nothing and returns a well-formed answer even when manipulated. Measurement is also hard, because identical requests can return different answers, most available labels come from the model itself, and the API preprocesses each request out of view. Our key idea is to score each attacked decision against the model’s own clean decision rather than against labels, and to read it against the change caused by an identical re-run. Building on this, we introduce JevAdvBench, to our knowledge the first adversarial benchmark for RLCD models, with 812 typed questions over 66 scenarios, and a black-box attack suite of 9,744 single-edit variants that each edit one part of a request, with billed input tokens confirming that the edit reached the model. On jev-1.13.0, rewording stays within 1.2 percentage points of the re-run baseline, and fields outside the schema never reach the model. In contrast, one unverified opinion appended to the state flips 12.1% of decisions, statistically tied with the strongest injected command (10.1%), and pushes 38% of confident answers below the 0.8 confidence threshold that routes them to human review. Applications built on RLCD models should therefore treat the state as untrusted, argued input. Project website: https://JevAdvBench.github.io/JevAdvBench/

[79] FeatMark: Feature-level Watermark Protection against Mimicry Attacks with Diffusion Models cs.CR | cs.CVPDF

Haoyang Li, Ruoxi Sun, Qingqing Ye, Benjamin Zi Hao Zhao, Yaxin Xiao

TL;DR: FeatMark 通过嵌入自然、可由机器验证的局部语义特征，为人物或艺术图像提供水印，以应对扩散模型对少量公开照片进行模仿生成的攻击。

Details

Motivation: 传统低能量像素水印虽不显眼，却容易被后处理或轻量扰动抹除，难以同时满足隐蔽性与鲁棒性。该工作转而把可验证信号放在与场景一致的语义细节中。

Result: 论文在 VGGFace2、CelebA-HQ 和 WikiArt 上评估了 10 种水印去除或净化攻击及针对 FeatMark 的自适应攻击，并扩展考察视频模仿场景。作者报告所有已评估攻击下检测比特准确率与视觉保真度几乎没有下降；摘要未提供具体数值。

Insight: 方法构建领域特征库，将水印表示为语义概念程序，再选择可执行特征并通过掩码引导编辑，以形成局部、自然的微小修改。其鲁棒性结论针对论文列出的攻击范围，不能外推为对所有未知攻击都免疫。

Abstract: Text-to-image diffusion models enable data-efficient “mimicry” attacks, wherein adversaries fine-tune the model on a handful of public photos to synthesize convincing forgeries of a target individual. A common countermeasure is to embed imperceptible, low-energy watermarks, yet recent studies show these signatures are brittle: modest post-processing or lightweight adversarial perturbations readily suppress detection, exposing a fundamental tension between imperceptibility and robustness. We introduce FeatMark, a watermarking framework that shifts from pixel-level, energy-starved perturbations to inconspicuous semantic features: small, scene-consistent micro-features that remain natural to humans while providing a stronger, machine-verifiable provenance signal. FeatMark builds domain-specific feature banks that encode each watermark as a compact concept program, pairing open-vocabulary semantic cues with reliable edit regions and instruction templates. It then automatically selects features that are both feasible and executable and injects them through modular, mask-guided concept editing, yielding highly localized, scene-consistent micro-edits that are difficult to perceive. We conduct extensive experiments across VGGFace2, CelebA-HQ, and WikiArt, evaluating against 10 strong watermark removal/purification attacks (including regeneration-style purification) and several bespoke adaptive attacks tailored to FeatMark, to assess perceptual fidelity, watermark detection accuracy, and robustness. We further demonstrate FeatMark’s extensibility to video mimicry attacks. The results show FeatMark remains virtually impervious, withstanding all evaluated attacks with negligible bit-accuracy and fidelity degradation.

cs.LG [Back]

[80] QSV: Quat-Sphere-Vision for Coupled Quaternion Attention on Spherical Lattices cs.LG | cs.CVPDF

Nicholas Foley, Devin Marinelli, Donny Moore, Diego Enriquez, Amanda Fernandez

TL;DR: QSV 用每个 token 的单位四元数同时定义球面视觉模型中的注意力权重与特征传输，并在同心 Fibonacci 球面上的稀疏邻接图上传递信息。

Details

Motivation: 标准注意力分别学习查询、键和值投影。作者探索能否用耦合的四元数变换在球面格点上统一这两种作用，并通过组件消融检验模型收益究竟来自注意力权重、特征传输还是球面几何。

Result: 移除特征传输后，CIFAR-10/100 测试准确率约下降 4 个百分点，而将学习到的注意力改成均匀平均几乎不改变结果。参数匹配对照中，同图上的标准注意力为 87.3%，高于 QSV 的 85.9%；平面二维格点模型为 91.1%，距同训练流程下 ResNet-20 不到 2.1 个百分点。部分结果仅为单次运行。

Insight: 消融显示耦合核中的主要学习能力来自四元数特征传输，而非注意力权重；同时，球面几何本身并未在这些对照中带来优势。单次实验限制了结论的稳健性。

Abstract: In standard attention, three separately learned projections decide how strongly a token attends to each neighbor ($W_Q$, $W_K$) and how the attended features are transformed before aggregation ($W_V$). We study Quat-Sphere-Vision (QSV), a sparse spherical vision model that replaces this projection triple with a single learned unit quaternion per token: the relative quaternion $r_{ij} = q_i^{} \otimes q_j$ supplies both the attention logit $\operatorname{Re}(r_{ij})$ and a sandwich-product feature transport $x \mapsto r_{ij} \otimes x \otimes r_{ij}^{}$, with messages passed over sparse kNN graphs on concentric Fibonacci spheres. Ablations that change only the targeted component show the two roles to be asymmetric. Removing the transport reduces test accuracy by about four percentage points on CIFAR-10 and CIFAR-100 (single runs per CIFAR-100 variant), while replacing the learned attention weights with uniform averaging leaves it essentially unchanged. Parameter-matched controls then remove the geometry itself: standard attention on the same graph exceeds QSV (mean $87.3%$ vs. $85.9%$), and the same model on a flat 2D lattice reaches $91.1%$, within $2.1$ points of a ResNet-20 trained under the same pipeline (single run). In the coupled kernel, nearly all of the learned pairwise computation resides in the transport channel.

[81] Uncertainty-Aware Federated Learning for Infant Movement Analysis cs.LG | cs.AI | cs.CVPDF

Edmond S. L. Ho

TL;DR: 该研究提出婴儿动作分析的联邦学习框架，并根据客户端预测不确定性调整联邦聚合，以便在不集中收集骨骼动作数据的条件下进行分类。

Details

Motivation: 从视频提取的骨骼动作可辅助婴儿神经发育筛查，但医疗机构受到隐私、治理和数据共享约束，集中训练在实际部署中可能不可行。

Result: 在三客户端、跨受试者的婴儿坐立不安动作分类评估中，联邦学习明显优于各客户端独立训练，并接近集中式训练。UA-FedAvg 及其结合验证损失的变体在所测数据划分中通常优于标准 FedAvg；摘要未提供具体分数。

Insight: 方法用 MC Dropout 估计预测熵，并将其用于调节客户端对联邦聚合的贡献，尝试让不确定性较高的本地预测对全局模型产生不同权重。当前证据限于摘要所述的三客户端设置和指定任务。

Abstract: Infant movement analysis provides valuable biomarkers for the early identification of neurodevelopmental disorders. Recent advances in deep learning have enabled automated analysis of infant movements from video-derived skeletal representations, achieving performance comparable to expert assessment for tasks such as General Movement Assessment (GMA). However, most existing approaches rely on centralized training, requiring data from multiple institutions to be collected and stored at a single site. Such assumptions are often impractical in clinical settings due to privacy, governance, and data-sharing constraints. To address these challenges, we present, to the best of our knowledge, the first federated learning framework for automated infant movement analysis and General Movement Assessment using skeletal motion data. As a clinically relevant use case, the proposed framework is evaluated on fidgety movement classification. To quantify model confidence, Monte Carlo (MC) Dropout is employed to estimate predictive uncertainty during inference. Building upon this, we propose an Uncertainty-Aware Federated Averaging (UA-FedAvg) strategy that incorporates predictive entropy derived from MC-Dropout into the federated aggregation process, enabling client contributions to be adjusted according to their predictive uncertainty. Experiments were conducted using a cross-subject evaluation protocol under a three-client federated learning setting. Results demonstrate that federated learning substantially improves classification performance compared with independently trained local models while achieving performance approaching that of centralized training. Furthermore, UA-FedAvg and its variant incorporating validation loss generally outperform conventional FedAvg across the evaluated data-split configurations.

cs.MM [Back]

[82] TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks cs.MM | cs.CR | cs.CVPDF

Tianmeng Fang, Jiancheng Wang, Chen Wang, Liming Wang, Wei Wang

TL;DR: TempQ-Jail 将文本到视频越狱攻击建模为有限查询预算下的候选生成与排序问题，目标是在少量生成和安全评估机会内优先找出高价值候选。

Details

Motivation: 受保护的视频生成系统每次生成和安全评估成本较高，攻击方通常无法大规模试验候选。仅提高单个候选的隐蔽性或有效性，未必能充分利用有限查询预算。

Result: 在 CogVideoX-5B 上针对从 T2VSafetyBench 得出的 70 个常见可行意图进行评估，TempQ-Jail 的 TP-ASR@5 为 48.9%、TP-ASR@10 为 65.4%，分别比最强基线高 4.6 和 4.0 个百分点；AUC-TP 为 0.469，平均查询数 AvgQ 为 6.3。摘要报告其优于六种代表性基线。

Insight: 方法将安全门通过、危险视觉内容生成、原始意图保留和时间有效性纳入候选价值估计，并据此分配与排序查询。结论来自指定模型、意图集和统一评测协议。

Abstract: Existing text-to-video (T2V) jailbreak methods mainly seek more effective or stealthier attack candidates. In guarded T2V systems, however, video generation and security evaluation are costly, so an attacker often cannot test a large candidate pool. We therefore formulate T2V jailbreak as a query-constrained candidate allocation and ranking problem and propose TempQ-Jail. The method combines heterogeneous attack mechanisms to expand candidate coverage, estimates each candidate’s end-to-end attack value from security-gate passage, dangerous visual generation, preservation of the original intent, and temporal validity, and ranks candidates so that high-value attacks appear early in a limited query trajectory. We evaluate TempQ-Jail on CogVideoX-5B using 70 common viable intents derived from T2VSafetyBench and compare it with six representative T2V jailbreak methods under a unified protocol. TempQ-Jail achieves TP-ASR@5 and TP-ASR@10 of 48.9% and 65.4%, improving over the strongest baselines by 4.6 and 4.0 percentage points, respectively. It also obtains the highest AUC-TP (0.469) and the lowest AvgQ (6.3). Analyses of query trajectories, candidate allocation, failure attribution, and ablations show that TempQ-Jail more effectively identifies and prioritises candidates with complete attack potential under limited query budgets.

[83] TemplateCraft: Agentic Visual Template Generation cs.MM | cs.CVPDF

Hongjie Yu, Zhiyuan Fan, Yuzhe Zhang, Jiangcun Du, Zhicheng Gao

TL;DR: TemplateCraft 用多智能体流水线把自然语言需求转成可在客户端执行的短视频视觉模板，并借助执行反馈进行定向修订。

Details

Motivation: 可复用的短视频模板制作需要准备素材、组织特效工具和处理执行协议，人工投入较大；单纯规划也难以发现生成或工作流执行环节的错误。

Result: 在由 60 个真实模板构成的 TemplateBench 上，使用相同 Qwen3-VL 主干时，TemplateCraft 的图像/视频生成成功率为 66.7%/50.0%，高于 Planner-only 的 56.7%/30.0%，模板遵循度与风格一致性也有改善。经额外评估和修订后，在部分指标上达到或超过 GPT-4o Planner-only；持久化素材还能提高跨输入风格一致性。

Insight: 系统把规划、素材生成、特效工作流生成和协议编译分开，并以 Planner-Evaluator 执行反馈支持局部回滚；阶段记忆与长期记忆让系统不更新模型参数也能修订。

Abstract: The growing popularity of short videos has driven demand for one-click content creation. Visual templates turn uploaded images into personalized content with preset effects, but reusable template generation still requires substantial manual effort in asset preparation and tool orchestration. We propose TemplateCraft, a multi-agent system that converts natural-language instructions into client-executable templates through planning, material generation, effect-workflow generation, and protocol compilation. Its Planner-Evaluator loop uses execution feedback for targeted rollback, while stage-level and long-term memory support revision without parameter updates. We evaluate TemplateCraft on TemplateBench, derived from 60 real-world templates. With the same Qwen3-VL backbone, TemplateCraft raises image/video generation success rates from 56.7%/30.0% to 66.7%/50.0% over Planner-only (best-of-three) and improves template adherence and style consistency. With additional evaluation and revision, it matches or exceeds a GPT-4o Planner-only baseline on selected metrics. Persistent assets further improve cross-input style consistency.

cs.RO [Back]

[84] Enabling a Unified Cross-Domain Representation for Two-Finger Gripper Manipulation via Interaction-Centric Modeling cs.RO | cs.CVPDF

Guanlin Li, Shifeng Bao, Yihan Zhao, Haitao Shen, Haoyang Li

TL;DR: 该模仿学习框架把双指夹爪转换到统一的夹爪坐标表示，并结合语言、RGB-D、目标交互关系和点云几何来预测跨机器人平台动作。

Details

Motivation: 跨本体泛化容易将任务语义与硬件特有的视觉外形混在表示中，导致策略迁移到不同夹爪、视角或机器人时失效。作者利用双指夹爪共有的交互结构建立统一表示。

Result: 论文在仿真和真实任务中报告了有竞争力的基准表现，并展示从仿真到真实环境、跨异构平台与视角的零样本迁移。摘要没有提供具体任务成功率或基准数值。

Insight: VLM 从语言与 RGB-D 推断子任务并定位“夹爪—持有物—目标”关系，SAM 2.1 跟踪掩码以减少 VLM 查询；目标/碰撞势场提供全局引导，夹爪坐标点云提供局部几何，再由 Flow-Matching Transformer 生成平滑的 7 自由度动作段。

Abstract: Achieving robust cross-embodiment generalization in imitation learning demands overcoming a critical representation flaw that inextricably entangles task semantics with hardware-specific visual geometry. We propose an interaction-centric framework that leverages the shared structure of two-finger grippers via a parameterized universal gripper abstraction, yielding a canonical gripper-frame representation. Given language and RGB-D observations, a VLM infers the subtask and grounds an interaction triplet (gripper, held, target), while SAM~2.1 tracks masks to reduce VLM queries. We design concise hybrid features that combine target/collision artificial potential fields for global guidance with segmented gripper-frame point clouds for local geometry, and use a Flow-Matching Transformer to predict smooth 7-DoF action chunks. Experiments in simulation and real-world tasks demonstrate that ours is the first imitation learning approach to simultaneously achieve competitive benchmark scores and extreme cross-embodiment/cross-viewpoint zero-shot sim-to-real transfer to completely distinct, heterogeneous robot platforms.

[85] Guiding End-to-End Driving Models with Endpoint-Constrained Trajectory Optimization cs.RO | cs.AI | cs.CV | cs.LGPDF

Brayden Zhang, Mahsa Golchoubian, Igor Gilitschenski, Boris Ivanovic, Kashyap Chitta

TL;DR: ECO 是无需训练的驾驶轨迹后处理层：在保持策略预测终点的同时，把中间航点调整为更符合车辆运动约束、也更易由控制器跟踪的轨迹。

Details

Motivation: 端到端驾驶策略通常以开环行为克隆训练，却在闭环车辆中执行。除分布偏移与因果混淆外，航点损失和位移指标也可能忽视中间轨迹是否物理连贯；作者观察到不一致主要集中在中间航点，而预测终点相对可靠。

Result: 在两个闭环模拟器中，ECO 提升了全部六种回归式和生成式策略的总体闭环得分。HUGSIM 上 VaVAM 的 HD-Score 从 18.1 提升至 31.0（+71%），并在该挑战赛获第一；AlpaSim 上 VaVAM 和 DiffusionDrive 场景得分分别提高 123% 和 22%。

Insight: ECO 将轨迹锚定于车辆已执行历史、固定策略终点，并只重塑中间几何；无需地图、特权模拟器状态或额外训练。违反运动限制越频繁的基础策略通常获益越大，提示规划几何修复可与策略本身解耦。

Abstract: End-to-end driving policies are commonly trained through open-loop behavior cloning, yet they must ultimately operate in closed-loop when deployed on a vehicle, creating a fundamental mismatch between training and execution. Beyond the commonly studied effects of covariate shift and causal confusion, we identify a complementary factor for this open-loop/closed-loop gap: waypoint-based supervision and displacement metrics do not ensure that the intermediate trajectory is physically coherent or easy for the controller to track. We observe that these inconsistencies concentrate primarily at intermediate waypoints, while the predicted endpoint remains comparatively reliable. Based on this observation, we introduce Endpoint-Constrained Optimization (ECO), a lightweight postprocessing layer that anchors the trajectory to the vehicle’s executed history, preserves the policy’s predicted endpoint, and reshapes the intermediate waypoints to improve feasibility. ECO requires no map, privileged simulator state, or additional training, and can be inserted between a broad range of waypoint-emitting policies and their controllers. Across two closed-loop simulators, it improves the aggregate closed-loop score of all six evaluated generative and regression-based driving policies, and the gains tend to increase with how often the base plans violate motion limits. On HUGSIM, ECO improves VaVAM from 18.1 to 31.0 HD-Score (+71%), achieving 1st place on the HUGSIM Closed-Loop Driving Challenge. Similarly, on AlpaSim, ECO increases the scene scores of VaVAM and DiffusionDrive by 123% and 22%, respectively. These results show that for a broad collection of end-to-end driving models, repairing the intermediate geometry of predicted trajectories without changing the policy’s predicted endpoint can substantially improve closed-loop performance.

[86] InternW0-$Δ$: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data cs.RO | cs.CVPDF

Xingyu Miao, Zizun Li, Baole Fang, Kaiwen Song, Tenghui Wang

TL;DR: InternW0-Δ 是结合视觉动态、场景语义、4D 几何运动先验和动作生成的世界动作模型，并在超过 2 万小时的异构开放数据上预训练。

Details

Motivation: 世界动作模型需要把大规模预训练模型中的视觉动态、场景语义、几何和运动先验整合到机器人动作生成中，同时利用不同来源的示范数据实现联合训练。

Result: 论文称该模型在仿真基准和真实机器人平台上均优于此前方法，并构建了超过 20K 小时、由机器人示范、UMI、人类第一视角演示和 Ego2Robot 数据组成的处理后训练语料。摘要未给出具体基准分数。

Insight: 模型通过混合 Transformer 让预训练视频专家与动作专家协作，由冻结 VLM 提供语义引导，并将 4D 基础模型先验通过仅训练期蒸馏注入；Causal Imprint 利用未来监督学习与动作相关的场景变化表示，推理时无需生成未来视频。

Abstract: World Action Models (WAMs) jointly model visual dynamics and action generation for generalist robot manipulation. A central challenge is to integrate priors from large-scale pretrained models—including visual dynamics, scene semantics, geometry, and motion—into a unified framework for robot action generation. We introduce InternW0-$Δ$, a unified WAM pretrained on a heterogeneous corpus that outperforms prior methods across simulation benchmarks and real-robot platforms. InternW0-$Δ$ combines pretrained visual dynamics, scene-level semantics, 4D geometric and motion priors, and action generation within a Mixture-of-Transformers (MoT) framework. A pretrained video expert and an action expert interact under semantic guidance from a frozen VLM, while a pretrained 4D foundation model injects geometric and motion priors through training-only distillation. We further introduce Causal Imprint, which learns future-relevant scene changes from training-only future supervision and provides predictive representations directly to the action expert without future-video rollout at inference. For large-scale joint training, we construct a heterogeneous corpus of robot demonstrations, UMI data, egocentric human demonstrations, and Ego2Robot data, curated and aligned under a common state-action representation. The resulting corpus contains over 20K hours of processed training data, to our knowledge the largest open-source corpus of its kind. We pretrain InternW0-$Δ$ on this corpus and demonstrate strong performance across simulation benchmarks and real-robot platforms. We will open source the training code, model weights, infrastructure, data-processing pipeline, and processed data where licenses permit. Project page: https://internrobotics.github.io/InternW0-Delta/

[87] Vision-Based 6-DoF Grasp Pose Estimation for Robot Cloth Unfolding cs.RO | cs.CVPDF

Domen Tabernik, Peter Nimac, Jan Jerićević, Danijel Skočaj, Andrej Gams

TL;DR: CeDiRNet-6DoF 从布料图像联合预测有效抓取点和完整六自由度抓取姿态，用双臂空中重新抓取策略展开衣物。

Details

Motivation: 布料可变形且状态维度高，遮挡常使褶皱、边缘和抓取点等视觉线索难以辨认。展开任务需要一只机械臂持布，另一只机械臂找到合适位置重新抓取。

Result: 作者在 ICRA 2024 Cloth Competition 框架下的双臂机器人系统中进行了广泛评估，并报告达到当时最先进水平。消融实验验证联合分割、背景随机化和图像裁剪等设计的作用；摘要未给出具体成绩数值。

Insight: 方法把稠密三维抓取回归、分割和正弦—余弦编码的欧拉角预测结合起来，直接估计使展开面积最大的抓取配置。实验支持其在非结构化布料操作中的实用性，但摘要没有提供不同布料或场景的量化泛化范围。

Abstract: Cloth manipulation is a challenging task due to the deformable and high-dimensional nature of cloth, which leads to complex interaction dynamics and perceptual ambiguity arising from frequent occlusions of critical visual cues such as folds, edges, and grasp points. In this work, we tackle cloth unfolding using a regrasping-in-the-air strategy, where one manipulator holds the cloth while the other grasps it at an optimally selected point to unfold it. To this end, we propose CeDiRNet-6DoF, a deep learning framework that jointly predicts effective grasp points and the complete 6-DoF grasp pose from the observed cloth configuration. By integrating dense 3D grasp regression with segmentation and sine-cosine-encoded Euler angles, the proposed method reliably estimates the grasp configuration that maximizes the unfolded cloth area. We extensively evaluated CeDiRNet-6DoF on a bimanual robotic setup within the ICRA 2024 Cloth Competition framework, achieving state-of-the-art performance. An ablation study further validates the benefits of key design components, including joint segmentation, background randomization, and image cropping. These results establish CeDiRNet-6DoF as a robust and versatile foundation for reliable robotic cloth manipulation in unstructured environments.

eess.IV [Back]

[88] Enhancing Photogrammetric Digital Surface Models with Pretrained Diffusion Models and Multimodal Conditioning eess.IV | cs.CVPDF

Antoine Lorentz, Stéphane May, Valentine Bellet, Dawa Derksen, Bastien Nespoulous

TL;DR: 该工作用卫星影像与光学立体摄影生成的数字地表模型共同条件化扩散模型，降低 DSM 中噪声、异常值和空洞带来的高程误差。

Details

Motivation: 卫星立体摄影能够较低成本地生成大范围 DSM，但结果会受噪声、离群点和空洞影响；高精度航空 LiDAR 更可靠，却成本较高。作者探索利用 LiDAR 训练扩散模型来修正已有 DSM。

Result: 在法国城市实验中，多模态条件化使城市密集区域 RMSE 从 6.00 m 降至 3.45 m；在留出的波尔多测试中，从 4.16 m 降至 2.77 m。

Insight: 作者改造 Stable Diffusion 3，精简文本流并采用分块归一化，以稳定 LiDAR 高程数据上的训练，并实现从自然图像到高程图的迁移。留出城市结果显示方法并非只改善上下文城市，但摘要未交代更多地区或传感器设置。

Abstract: Large-scale Digital Surface Models (DSMs) can be produced cost-effectively from satellite images via stereo-photogrammetry. However, the resulting 3D maps are often contaminated by noise, outliers, and voids. On the other hand, aerial LiDAR provides high-accuracy elevation measurements at a substantially higher cost. In this work, we study diffusion models conditioned both on photogrammetric DSMs and Pléiades imagery to refine vertically co-registered DSMs. We introduce a modified Stable Diffusion 3 architecture with a pruned text stream and a patch-wise normalization strategy, enabling stable training on LiDAR data and transfer from natural images to elevation maps. Experiments in French cities demonstrate that multimodal conditioning improves elevation accuracy, reducing Dense Urban RMSE from 6.00 to 3.45 m in the in-context cities and from 4.16 to 2.77 m in the held-out city of Bordeaux.

eess.SP [Back]

[89] FRESHLATENT: Channel-Aware Latent Adaptation for Resource-Constrained Embodied VLM Perception eess.SP | cs.CV | cs.DC | cs.LG | cs.ROPDF

Rajat Bhattacharjya, Minwoo Kim, Arnab Sarkar, Tamoghno Das, Sing-Yao Wu

TL;DR: FreshLatent 为资源受限的具身视觉语言模型拆分式感知加入轻量信道感知潜变量适配器，以提升无线传输受损时的感知质量，同时控制机载计算和能耗。

Details

Motivation: 拆分部署的 VLM 中间特征可能在无线链路传输时受损，使按干净链路训练的接口发生部署失配；更强的信道编码方案虽可增强鲁棒性，却会增加机载开销。

Result: 在 0 dB 和最紧通信预算下，相较干净链路拆分压缩，FreshLatent 的 gIoU、cIoU 分别提高 20.79 和 20.87 个百分点；在 0 dB 三种预算下恢复了重型 range-trained feature-JSCC 编解码器所获 gIoU 提升的 63.5%–69.1%。Jetson AGX Xavier 10 W 测试中，其编码器参数少 37–40 倍，接口延迟低 7.7–9.9 倍、能耗低 8.8–10.0 倍。

Insight: 适配器只训练功率归一化的编码器—解码器并冻结周围 VLM，把信道状态和通信预算与可用感知条件联系起来。实验表明，轻量适配可取得重型接口相当一部分鲁棒性，但摘要中的硬件结果限定于指定设备和 10 W 模式。

Abstract: Mission-critical UAVs increasingly rely on split vision-language model (VLM) perception under tight onboard-resource and wireless-communication constraints. However, corruption of transmitted intermediate features creates a deployment mismatch for clean-trained split interfaces, while stronger channel-aware codecs can impose substantial onboard cost. We present FreshLatent, a lightweight channel-aware latent adapter that trains a power-normalized encoder-decoder through wireless corruption while keeping the surrounding VLM frozen. We formulate deployment around a mission-conditioned perception requirement and embedded interface cost, linking channel quality and communication budget to the operating conditions under which perception remains usable. At 0 dB and the tightest communication budget, FreshLatent improves gIoU and cIoU over clean split compression by 20.79 and 20.87 points, respectively. At the most adverse evaluated SNR (0 dB), across all three communication budgets, FreshLatent recovers 63.5-69.1% of the gIoU improvement achieved by a much heavier, range-trained feature-JSCC codec. On an NVIDIA Jetson AGX Xavier in 10-W mode, FreshLatent uses 37-40x fewer encoder parameters, 7.7-9.9x lower edge-interface latency, and 8.8-10.0x lower edge-interface energy than the heavier codec. Together, these results show that lightweight channel-aware adaptation can recover a substantial fraction of the robustness of a much larger communication interface while broadening quality-valid operation under constrained wireless conditions.

Table of Contents

cs.CV [Back]

[1] CSCWD: Cross-Scale Channel-wise Knowledge Distillation for Lightweight Tiny Object Detection on Edge Devices cs.CVPDF

[2] What Improves Multimodal Misinformation Detection? Answers from a Large-Scale Empirical Study cs.CV | cs.AI | cs.CL | cs.LG | cs.MMPDF

[3] ProCAP: Probabilistic Cross-Attentive Prompt Learning for Vision-Language Models cs.CVPDF

[4] The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation cs.CVPDF

[5] Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Bases cs.CV | cs.AIPDF

[6] MVAgent: Multi-Agent Video Generation via Consistent Condition Construction and Shot-Level Policy Optimization cs.CVPDF

[7] Structure-Guided Masked Autoencoders for Ultra-High Resolution Scientific Image Understanding cs.CVPDF

[8] StarWM: Self-Supervised Trained Attention Routing for Robust World Models cs.CV | cs.LGPDF

[9] MedTokenBudget: Lesion-Preserving Token Routing for Dermoscopic Image Classification cs.CV | cs.AIPDF

[10] MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning cs.CVPDF

[11] SAGE: Source-Anchored Guidance via Frequency Equalization for Hierarchical RGB-T Alignment and Fusion cs.CV | cs.AIPDF

[12] VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control cs.CV | cs.AIPDF

[13] TrafficImag: A Benchmark for Counterfactual Roadside Traffic Video Generation cs.CV | cs.AIPDF

[14] Learning Polarization Image Restoration with General Restoration Priors cs.CV | eess.IVPDF

[15] EviDETR: Preserving Query-Relevant Temporal Evidence for Moment Retrieval and Highlight Detection cs.CVPDF

[16] Timo: $\textbf{T}$aming Mult$\textbf{i}$modal Diffusion Transformer for Human $\textbf{Mo}$tion Generation cs.CVPDF

[17] Skip the Talk, Re-Focus on Vision: Latent Reasoning for Reasoning Segmentation in Multimodal Large Language Models cs.CV | cs.AIPDF

[18] MDSkin-Net: Multi-Task Skin Lesion Analysis Driven by Pattern Analysis Priors and Spatial Alignment Regularization cs.CVPDF

[19] UltraG-Bench: A Multi-task Benchmark for assessing Large Vision-Language Models on Pixel-level Evidence Grounding in Ultrasound cs.CV | cs.AIPDF

[20] ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos cs.CVPDF

[21] OneWorld: Learning Consistent Physics Across Actions in World Models cs.CV | cs.AIPDF

[22] MVVBench: Benchmarking 4D Reasoning in Vision-Language Models cs.CV | cs.AIPDF

[23] Where and When to Force: Routed Forcing for Streaming Avatars cs.CVPDF

[24] CCRV-Bench: Constraint-Based Evaluation of Causal Reasoning in Vision-Language Models cs.CVPDF

[25] STORM-Bench: Evaluating Online Video QA under Evolving and Incomplete Evidence cs.CVPDF

[26] Self-Supervised Perceptually Interpretable Monocular Depth Estimation cs.CVPDF

[27] PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution cs.CVPDF

[28] PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation cs.CVPDF

[29] Refining Cytology Predictions with Conditional Random Fields cs.CVPDF

[30] FLIP: Final Layer Inference-Time Probing for Vision-Language Models cs.CV | cs.AIPDF

[31] TRACKGRAPH: Online Open-Vocabulary 3D Scene Graphs via Image-Space Tracking cs.CV | cs.ROPDF

[32] Exploiting Spatial Structure for Transductive Few-Shot Classification of Whole-Slide Images cs.CVPDF

[33] Where Compute Matters: Heterogeneous Attention for Efficient Video Diffusion cs.CVPDF

[34] DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Models cs.CV | cs.AIPDF

[35] Double-stream registration with pyramid fusion for HDR video with alternating exposures cs.CVPDF

[36] Seeing Semantic Shift: Difference-Aware Sentence-Level Temporal Segmentation of Sign Language Videos cs.CVPDF

[37] Pocket-STVG: lightweight architecture for Spatio-Temporal Video Grounding cs.CV | cs.AI | cs.MMPDF

[38] Who Says What: Symbolic Trimodal Binding Mechanisms in Audio-Visual LLMs cs.CV | cs.SD | eess.ASPDF

[39] Preserve-and-Compose Training for Composed Image Retrieval cs.CVPDF

[40] Geometric Inconsistency Localization in Multi-View Image Sets cs.CV | cs.AI | cs.CR | cs.MMPDF

[41] UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning cs.CV | cs.AIPDF

[42] DyMD: Preserving Interaction Dynamics through Distribution Matching Distillation in Few-Step Video World Models cs.CV | cs.AIPDF

[43] Open Vocabulary Domain Unlearning cs.CV | cs.LGPDF

[44] OpenVAM: Open-World Visual Attention Modeling with VLMs cs.CVPDF

[45] Implicit Neural Representation for Hyperspectral Video Compression cs.CV | cs.AI | cs.LGPDF

[46] From Reward Signal to Visual Utility: A Controlled Audit of Medical VLM Post-Training cs.CV | cs.AIPDF

[47] Diagnosing the Sources of Compositional Failure in Vision-Language Models: A Controlled Analysis cs.CVPDF

[48] SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery cs.CV | cs.ROPDF

[49] ClearGS: Reliability-Aware Gaussian Splatting from Handheld Videos cs.CV | cs.AIPDF

[50] Structured Reasoning Agentic Framework for Interpretable Critical View of Safety Assessment cs.CVPDF

[51] Region-Level Black-Box Defense Against Stealthy Embedding-Space Backdoors in CLIP cs.CV | cs.CRPDF

cs.CL [Back]

[52] A Survey on Fake Review Detection: From Pre-trained Language Models to Large Language Models cs.CL | cs.AIPDF

[53] Inference-Time Target Speaker Unlearning in LLM-Based Automatic Speech Recognition cs.CL | cs.SD | eess.ASPDF

[54] Where Does Retrieval-Based Open-Ended Evaluation Fail? Automatic Taxonomy Induction from Long-Form Medical Answer Factuality Verification cs.CL | cs.IRPDF

[55] The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying Knowledge cs.CL | cs.AIPDF

[56] Probing Stability-Plasticity Tradeoffs in Agent Memory through Cognitive Experimental Paradigms cs.CL | cs.AI | cs.LGPDF

[57] Recursive Self-Improvement via On-Policy Distillation for Reasoning cs.CLPDF

[58] TRACE: Temporal Audit and Condition-aware Evaluation of Streaming Video Understanding cs.CL | cs.CVPDF

[59] SEA-CLIP-Tiny: Efficient Multilingual Text-Vision Embedding for Southeast Asian Languages cs.CLPDF

[60] Effects of Transcript Compression on LLM-based Medical Misinformation Detection in Japanese YouTube Videos cs.CLPDF

[61] From annotation to reasoning: Culture in language models cs.CLPDF

[62] ToolSearcher: Optimizing Tool Selection at Scale via Reinforcement Learning cs.CLPDF

[63] Training-Free Pronunciation Transcription via Text-Constrained Acoustic Rescoring cs.CL | cs.SD | eess.ASPDF

[64] Evaluating Sycophancy in Chinese Large Language Models on Factual Questions Derived from Online Search Queries cs.CLPDF

[65] ZooWork-ShopRanker: An Open, Preference-Aligned E-Commerce Reranker cs.CLPDF

[66] G$^2$PTQ: Improving LLM Post-Training Quantization with Generalized Gradient Compensation cs.CL | cs.AIPDF

[67] Modeling Student Sensemaking with LLMs and Knowledge-Graph-Guided Inference cs.CLPDF

[68] Improving Visual Sensitivity of LLMs on Multimodal Machine Translation with Metric-based Loss Weighting cs.CL | cs.AIPDF

[69] Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding cs.CL | cs.AIPDF

[70] Stale-Document Poisoning: When Outdated Retrieval Overrides Correct Model Answers cs.CLPDF

[71] Sorry Robot, Happy Human: Vision-Language Models Read Only One of Two Legible Typographic Layers cs.CL | cs.AI | cs.CVPDF

[72] ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMs cs.CL | cs.AIPDF

[73] MexHat: A Dataset for Hate Speech Detection in Mexican Spanish Videos cs.CL | cs.CVPDF

cs.AI [Back]

[74] When Is a Multi-Agent Code Judge Actually Grounded? Two Label-Free Measurements, and a Judge That Declines to Guess cs.AI | cs.CL | cs.SEPDF

[75] Thinking Less to Simulate Better: Intuitive Prompting Improves LLM Agents Simulating Individual Social Media Reactions, Including Unfamiliar Content cs.AI | cs.CL | cs.HC | cs.MA | cs.SIPDF

[76] The Right Information Extraction Pipeline Depends on the Document: Accuracy-Energy Trade-offs for Small, Local Models cs.AI | cs.CLPDF