cs.CV [Total: 86]
cs.CL [Total: 20]
cs.AI [Total: 9]
cs.CR [Total: 1]
cs.HC [Total: 1]
cs.IR [Total: 1]
cs.LG [Total: 13]
cs.MA [Total: 1]
cs.RO [Total: 8]
cs.SD [Total: 1]
cs.SE [Total: 1]
eess.AS [Total: 1]

cs.CV [Back]

[1] Medical Image Alignment Assessment as a Test of Generalist Visual Reasoning in Frontier Multimodal Models cs.CVPDF

Ross Callaghan, Niannu Gao, Hojjat Azadbakht, Hui Zhang

TL;DR: 本文将医学图像配准对齐判断作为通用视觉推理测试，比较前沿MLLM、微调本地模型和任务专用CNN。较早发布的模型在部分设置中接近随机水平，而GPT-6在几乎所有测试场景中超过85%；本地微调模型可在训练任务上匹配或超过前沿模型，但跨设置迁移较弱。

Details

Motivation: 若前沿多模态模型具备通用视觉推理能力，应能依据图像证据和任务说明完成新颖、无需任务专门参数优化且人类可可靠完成的视觉判断。医学影像配准评估正是这类判断，但人工检查依赖受训操作员，难以扩展到大型数据集。

Result: 研究评估不同代际MLLM在两类示例医学图像对齐任务上的表现，并改变提示策略与图像呈现方式；同时比较本地微调MLLM和任务专用CNN，考察通用前沿模型与需特定优化的本地模型之间的权衡。早几个月发布的模型泛化较差，某些设置接近随机；GPT-6在几乎所有测试情境中达到85%以上。微调本地模型在训练过的任务上可匹配或超过前沿模型，但迁移到未见设置的能力显著较弱。

Insight: 医学图像对齐可作为测试模型是否能从视觉证据完成一般化判断的实用试验台；前沿模型的近期进展明显，但专用本地微调在已见任务上仍有竞争力，泛化则较弱。摘要未给出样本量或各场景具体分数，也未证明可替代人工质量控制。

Abstract: Frontier multimodal large language models (MLLMs) are increasingly positioned as general purpose visual reasoners as part of the quest for artificial general intelligence. A key test of this generality is whether they can perform novel visual judgments that humans can make reliably from visual evidence and task instructions, without task-specific parameter optimisation. We investigate this question through the task of medical image alignment assessment, where the goal is to establish whether there is anatomical correspondence between two images. Human visual assessment of image alignment is still the gold standard and most common approach; however, it requires trained operators and is impractical to scale for large datasets. We evaluate recent generations of MLLMs on two exemplar medical image alignment tasks, varying both prompting strategies and image-presentation methods. We compare against a locally fine-tuned MLLM and a task-specific CNN to examine the trade-off between frontier general purpose models and smaller models that require specific task optimisation but can be used locally. We show that are reaching an inflection point, where frontier MLLMs can now perform effective visual assessment of medical image alignment. Models released only a few months ago generalise poorly and, in some settings, perform barely above chance, whereas GPT-6 achieves over 85% across almost all scenarios tested. Fine-tuned local models can match or exceed frontier-model performance on the tasks on which they are trained, but transfer substantially less effectively to unseen settings. These findings identify medical image alignment as a useful test bed for generalist visual reasoning and suggest that frontier multimodal models are beginning to acquire capabilities that could support a common quality-control mechanism across heterogeneous medical-imaging pipelines.

[2] UniPro: Unified Multi-Mode Medical Image Segmentation from 2D Images to 3D Volumes via Propagation cs.CVPDF

Bangwei Guo, Yunhe Gao, Meng Ye, Yang Zhou, Difei Gu

TL;DR: UniPro用统一切片框架支持语义、上下文、交互和传播式医学图像分割，并将2D编辑传播到3D体数据；其核心是把体积传播与上下文分割视为相同的参考条件预测，只是参考图像—掩码来自其他病例或已分割邻片。

Details

Motivation: 医学分割在分割范式和数据维度上彼此割裂：语义、上下文、交互分割通常分别开发，2D图像与3D体数据也各有专用方法。实际工作流可能从自动预测、参考病例或用户交互开始，但精细修订常在2D视图完成，体数据又要求把修改一致传播到其他切片。

Result: UniPro以切片为基础支持四种模式，分别使用类别先验、参考样例、用户点击和邻近切片预测作为条件输入。它将3D体积传播与上下文分割统一解释为参考条件预测，区别仅在参考图像—掩码对来自其他病例还是已分割的邻片。为提高传播可靠性，模型加入双向传播和3D监督，以跨切片约束单切片传播。跨不同模态和解剖部位的实验显示，各种分割设置均有较强表现，可从稀疏2D初始化实现省标注的3D分割并减少逐切片修正。摘要未给具体指标。

Insight: 统一参考条件机制可以让同一模型衔接自动、样例引导、交互和体积传播工作流，并通过双向与3D监督保持跨切片一致性。作者强调可减少人工逐片修正，但摘要没有给出标注时间、分割指标或与专用模型的量化对照。

Abstract: Medical image segmentation remains fragmented along two axes: segmentation paradigms and data dimensionality. Existing methods are typically developed separately for semantic, in-context, and interactive segmentation, and are further specialized to either native 2D images or 3D volumetric data. In clinical practice, however, segmentation workflows take many forms: a case may be initialized by semantic prediction, reference-guided segmentation, or user interaction. Regardless of how it begins, fine-grained refinement is naturally performed on 2D views; for volumetric scans, such 2D edits must propagate coherently to the rest of the volume. We present UniPro, a unified model that bridges segmentation paradigms and data dimensionality, using propagation to extend 2D segmentation to 3D volumes. Our key insight is that volumetric propagation and in-context segmentation share the same reference-conditioned prediction mechanism, differing only in whether the reference image-mask pairs come from other cases or from previously segmented neighboring slices. Building on this view, UniPro supports semantic, in-context, interactive, and propagation-based segmentation within a single slice-based framework, using class priors, reference exemplars, user clicks, and neighboring-slice predictions as mode-specific conditioning inputs. To improve propagation reliability, UniPro further incorporates bidirectional and 3D supervision to regularize slice-wise propagation beyond per-slice losses. Extensive experiments across diverse modalities and anatomies show that UniPro achieves strong performance across all segmentation settings, enabling annotation-efficient 3D segmentation from sparse 2D initialization and reducing slice-by-slice correction effort.

[3] BoT-Feedback: Grounding Multimodal Reasoning in Biomechanical Evidence for Explainable Human Action Feedback cs.CVPDF

Xu Dong, Wanqing Li, Anthony Adeyemi-Ejeye, Andrew Gilbert

TL;DR: BoT-Feedback把人体动作反馈建立在结构化生物力学证据上，按动作识别、关键身体区域定位、专家与学生动作的量化差异分析、教练反馈合成四阶段推理；在12个开放和闭源MLLM上的专家评分由2.07升至2.95（+40%）。

Details

Motivation: MLLM能做视觉理解与多模态推理，但直接从视频生成动作指导往往建议泛化、解释有限且可能违反物理规律。专业教练通常会显式分析关节运动学、姿态和身体动力学，因此作者希望用生物力学证据约束模型推理。

Result: BoT-Feedback提出四阶段Biomechanics of Thought（BoT）：识别动作、定位关键身体区域、量化分析教练与学生表现的生物力学差异，再生成可解释反馈。即插即用的Biochemical Data Parser将视频转为结构化生物力学描述，并以时间对齐策略匹配师生动作。作者构建BiomAF基准，包含配对师生视频、3D骨架、生物力学属性和专家指导标注。12个开放/闭源MLLM实验显示，以生物力学证据为基础能稳定提升反馈质量、可解释性和鲁棒性，并减少生物力学幻觉；专家平均评分由2.07提高到2.95（+40%），使小型开源MLLM接近大得多的专有系统。

Insight: 让模型先识别关键动作和身体区域、再比较量化生物力学差异，可把教练建议从泛化视觉印象转为可追溯的身体证据。实验跨12个模型并报告专家评分改善，但摘要未给出评分量表细节或各维度单独效果。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in visual understanding and multimodal reasoning, yet they remain fundamentally limited in Human Action Feedback Generation. Existing methods infer coaching feedback directly from visual observations, producing generic advice, limited interpretability, and physically implausible hallucinations. In contrast, expert human coaches diagnose performance through explicit biomechanical reasoning over joint kinematics, posture, and body dynamics. We introduce BoT-Feedback, a framework that grounds MLLM reasoning in structured biomechanical evidence. Our key contribution is Biomechanics of Thought (BoT), a four-stage reasoning framework that progressively identifies the action, localises the critical body regions, analyses quantitative biomechanical differences between expert and student performances, and synthesises interpretable coaching feedback. To support this reasoning process, we develop a plug-and-play Biomechanical Data Parser (BDP) that converts videos into structured biomechanical descriptors and an alignment strategy that temporally matches expert and student motions. We further introduce BiomAF, a benchmark containing paired teacher-student videos, 3D skeletons, biomechanical attributes, and expert-coaching annotations. Experiments across twelve open- and closed-source MLLMs demonstrate that grounding reasoning in biomechanical evidence consistently improves feedback quality, interpretability, and robustness while substantially reducing biomechanical hallucinations. BoT-Feedback improves the average expert evaluation score from 2.07 to 2.95 (+40%), enabling compact open-source MLLMs to approach the performance of substantially larger proprietary systems for explainable action feedback generation.

[4] RADC: Risk-Aware Dual Caching for Vision-Language Test-Time Adaptation cs.CVPDF

Siyu Huang, Yueyong Chen, Xuejiao Li, Jun Zhou

TL;DR: RADC为视觉语言模型的缓存式测试时适配加入语义前景缓存与高斯风险准入：前者聚合类别一致的空间证据以补充全局缓存，后者以多视图对角高斯表征联合考虑类别可分性和特征不确定性，筛选可靠缓存样本。

Details

Motivation: 缓存式测试时适配容易受全局表示中的背景偏差影响；表示变化下基于熵的缓存准入也可能不可靠，导致低质量原型污染缓存并影响后续推理。

Result: RADC构建Semantic Foreground Cache，从CLIP表示中聚合类别一致的空间证据，形成补充全局缓存的前景原型以减轻背景干扰。Gaussian Risk Admission把多视图表示建模为对角高斯分布，并联合类别分离度与特征不确定性来优先纳入可靠候选。推理时将零样本logits与全局、前景缓存的互补预测融合。作者在跨域和分布外基准上报告持续达到最先进表现，但摘要未列具体基准、数值或对比模型。

Insight: 缓存质量取决于空间证据是否聚焦前景以及新样本是否可靠；分别维护全局与前景原型，并显式评估缓存准入风险，可补偿背景偏差和不确定熵评分。性能结论为摘要中的定性概括，具体收益需查看完整实验表。

Abstract: Cache-based test-time adaptation (TTA) for vision-language models is often hindered by background bias in global representations and unreliable entropy-based cache admission under representation variations. To address these limitations, we propose RADC, which enhances prototype learning through reliable dual caching. RADC introduces a Semantic Foreground Cache that aggregates category-consistent spatial evidence from CLIP representations, yielding foreground prototypes that complement the global cache while mitigating background interference. To reliably manage both caches, Gaussian Risk Admission models multi-view representations as diagonal Gaussian distributions and jointly considers class separation and feature uncertainty to prioritize reliable cache candidates. RADC integrates zero-shot logits with complementary global- and foreground-cache predictions for robust inference. Extensive experiments on cross-domain and out-of-distribution benchmarks demonstrate consistent state-of-the-art performance.

[5] Visual-Invariance-Augmented Feature Optimal Alignment for Transferable Adversarial Attacks against Closed-Source MLLMs cs.CV | cs.AIPDF

Xiaojun Jia, Simeng Qin, Yiming Li, Jie Liao, Sensen Gao

TL;DR: IAU-FOA针对闭源MLLM黑盒定向迁移攻击，将对抗样本与目标样本在全局语义和局部patch结构上对齐，并通过置信度自适应非平衡最优传输降低无可靠对应局部簇带来的误导梯度；同时用亮度/白平衡变换增强视觉不变性。

Details

Motivation: 闭源MLLM只能通过黑盒接口攻击，通常需用开源替代模型生成可迁移对抗样本。既有方法主要对齐全局图像特征，未充分利用patch级视觉结构，因此在异构闭源模型之间迁移能力受限。

Result: IAU-FOA以余弦目标缩小全局语义差距，并将patch token聚类成紧凑局部模式，通过最优传输做细粒度特征对齐。标准平衡最优传输会对缺乏可靠对应的局部簇仍强制满足固定边际质量，可能产生误导梯度；作者以置信度自适应非平衡传输放宽弱匹配约束。此外，双向像素强度缩放和逐通道白平衡调整模拟曝光、对比度、照明和色温变化，鼓励扰动跨视觉编码器泛化。开源和闭源MLLM实验中，方法持续优于最先进迁移攻击；摘要没有提供具体攻击成功率。

Insight: 全局语义和局部视觉结构需要共同对齐，但对弱匹配区域强行传输可能伤害优化；自适应放松传输约束并加入外观变换，可提高黑盒迁移鲁棒性。摘要仅给出相对SOTA的定性结论，未报告具体成功率、模型列表或防御条件。

Abstract: Multimodal large language models (MLLMs) remain vulnerable to transferable adversarial examples, especially in black-box settings where only open-source surrogate models are accessible. Existing targeted transfer attacks mainly align adversarial and target samples using global image-level features, such as encoder [CLS] embeddings. However, such coarse alignment insufficiently exploits patch-level visual structures, limiting transferability across heterogeneous closed-source MLLMs. We propose IAU-FOA, a visual-invariance-augmented feature optimal alignment attack with adaptive unbalanced transport, to improve targeted transferability against closed-source MLLMs. IAU-FOA aligns adversarial and target samples at both global and local levels: a cosine-based objective narrows their global semantic gap, while patch tokens are clustered into compact local patterns and matched through optimal transport for fine-grained feature alignment. Balanced optimal transport enforces fixed marginal masses even for local clusters without reliable counterparts, potentially introducing misleading alignment gradients. We therefore introduce confidence-adaptive unbalanced transport to relax these constraints for weakly matched clusters, aiming to reduce unreliable local alignment and improve adversarial transferability. We further study the effect of input transformations and propose visual-invariance augmentation, which applies bidirectional pixel-intensity rescaling and per-channel white-balance adjustment to simulate exposure, contrast, illumination, and color-temperature variations. This strategy encourages adversarial perturbations to generalize across different visual encoders. Extensive experiments on open-source and closed-source MLLMs show that IAU-FOA consistently outperforms state-of-the-art transferable attack methods. Code is available at https://github.com/jiaxiaojunQAQ/IAU-FOA.

[6] DTFormer: Text-Guided Semantic Alignment for RGB-D Segmentation cs.CVPDF

Ziang Wei, Yinlong Liu, Yan Xia, Alois Knoll, Hu Cao

TL;DR: DTFormer提出RGB-D-Text三模态语义分割框架，通过文本语义原型在编码器和解码器多个层级显式约束RGB-D特征，使分割表示获得更强的高层语义区分性。

Details

Motivation: RGB-D分割常通过像素级监督融合RGB和深度信息，却缺少直接的高层语义约束。作者关注语言先验能否为主流RGB-D分割模型补充语义判别信息，同时保持模型简单高效。

Result: DTFormer的文本引导语义对齐模块TSAM先把文本线索编码成一组语义原型，再在编码器和解码器多个层级将多模态RGB-D特征与原型显式对齐，以语义正则化引导更具判别力的表示。多个基准实验报告一致性能提升，且模型保持简单高效。摘要未提供具体基准名称或指标值。

Insight: 文本先验可通过多层原型对齐直接约束RGB-D表示，而不只是作为输入端附加模态；这为增强语义判别性提供了一种较直接的融合设计。当前摘要缺少量化实验细节，因此无法比较其与具体基线的提升大小。

Abstract: RGB-D semantic segmentation has made notable progress by fusing RGB and Depth, yet mainstream models still learn features almost exclusively from pixel-level supervision, lacking direct high-level semantic constraints. This raises a central question-can external knowledge such as language priors inject stronger semantic discriminability into mainstream RGB-D segmentation models. We present DTFormer, a novel tri-modal (RGB-D-Text) semantic segmentation framework. At its core is Text-guided Semantic Alignment Module (TSAM) that first encodes textual cues into a set of semantic prototypes and then explicitly aligns multi-modal RGB-D features with these prototypes at multiple encoder and decoder layers. This design imposes strong semantic regularization on representation learning, guiding the network toward more discriminative features. Extensive experiments on multiple benchmarks show that DTFormer delivers consistent gains while remaining simple and efficient. Our results demonstrate that explicit semantic alignment offers an effective and practical route to improving RGB-D semantic segmentation. The code will be released upon acceptance.

[7] Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning cs.CVPDF

Junhui Yin, Yuchen Yang, Yilin Yin, Shuai Na, Haoran Xi

TL;DR: 本文研究基类也只有少量类别的广义少样本类增量学习（G-FSCIL），提出从冻结潜扩散模型生成候选、学习兼顾语义一致性和视觉多样性的合成知识筛选策略，并用稳定原型初始化和双向边界校准减少新旧类冲突。

Details

Motivation: 传统少样本类增量学习假设初始基类数据较充足；当基类和后续增量数据都稀少时，初始表示弱、语义漂移且决策边界不稳定。直接混入合成数据又可能引入语义噪声，加剧旧类与新类冲突。

Result: 作者先用冻结潜扩散模型构建类别专属合成候选池，首次观察类别时做类别反演，后续按需复用条件嵌入生成；再学习同时选择语义一致且视觉多样样本的知识筛选策略，并在基类阶段蒸馏为无需后续优化即可迁移使用的筛选策略。基于筛选后的合成数据，采用合成信息原型初始化和双向边界校准进行增量适配。多项实验显示方法持续优于现有FSCIL基线，减少遗忘并改善新旧类平衡，但摘要未给出具体数值。

Insight: 合成数据的价值不只在数量，筛选其可信度并把筛选能力迁移到后续阶段，可以缓解小基类设定中的语义噪声和边界冲突。性能结论基于作者报告的多项实验；具体数据集与提升幅度需查看完整论文。

Abstract: Few-shot class-incremental learning (FSCIL) aims to learn novel classes from limited annotations while preserving prior knowledge. Existing methods typically assume a sufficiently large base session, but this assumption fails when both base and incremental data are scarce, leading to weak initial representations, semantic drift, and unstable boundaries. We study this underexplored yet realistic setting, termed Generalizable FSCIL (G-FSCIL), where the base session itself contains only a few classes. Although synthetic data can alleviate supervision scarcity, naively mixing generated samples often introduces semantic noise and exacerbates old-new boundary conflicts. To address this, we propose a framework that curates trustworthy synthetic knowledge for stable G-FSCIL. Specifically, we first construct class-specific synthetic candidate pools using a frozen latent diffusion model, where class inversion is performed at the first observation and the resulting condition embeddings are reused for on-demand generation. Building on these candidates, we learn a knowledge curation strategy that selects samples with both semantic consistency and visual diversity, and distill this process into a transferable selection policy during the base session, which is then reused without further optimization. Leveraging the curated synthetic data, we further design a boundary-stable incremental adaptation scheme, including synthetic-informed prototype initialization and bidirectional boundary calibration to mitigate old-new conflicts. Extensive experiments demonstrate that our method consistently outperforms existing FSCIL baselines, with reduced forgetting and improved balance between old and new classes. Code is available at https://github.com/NiHaoWoJiaoYYC/G-FSCIL.

[8] Anchor and Adapt: Asymmetric Prompt Adaptation for Few-Shot Industrial Anomaly Detection cs.CV | cs.AIPDF

Mengyang Zhao, Teng Fu, Haiyang Yu, Ke Niu, Bin Li

TL;DR: Anchor and Adapt把少样本工业异常检测中的提示学习分为两阶段：先从有标注辅助数据学习可迁移正常/异常锚点，再冻结锚点并用少量目标正常样本适配额外正常分支，无需合成异常或产品专属异常描述。

Details

Motivation: 少样本工业异常检测通常只有少量目标正常图像，没有直接缺陷监督，难以仅凭这些样本学习异常提示。一些视觉语言方法借助手工异常描述，但描述需要针对产品定制，且效果依赖提示选择。

Result: 第一阶段从有标注辅助数据学习可迁移正常与异常锚点；第二阶段保持锚点固定，利用少量目标正常样本适配额外正常分支。继承的正常分支与适配分支共同表征目标正常性，文本锚点正则化则使其贴近通用正常先验并与异常锚点区分。方法不需合成异常，也减少对类别专属异常模板的依赖。在MVTec-AD与VisA之间的跨数据集迁移，以及1、2、4-shot设置中，检测和定位表现具有竞争力；消融考察了迁移锚点、非对称适配、双正常表示和锚点正则化。

Insight: 将可迁移异常知识固定下来，只让目标域正常表征适配，可以在没有目标缺陷样本时保留异常语义，并避免为每种产品手工写异常模板。摘要称结果有竞争力但没有给出具体分数，不能量化其相对优势。

Abstract: In few-shot industrial anomaly detection, the few normal target images provide no direct defect supervision, making anomaly prompts difficult to learn from these samples alone. Some vision-language methods therefore use manually specified descriptions to supply explicit anomaly semantics. However, constructing these descriptions requires product-specific effort, and their effectiveness depends on prompt selection. We propose Anchor and Adapt, a two-stage prompt learning framework that separates the acquisition of anomaly semantics from adaptation to target normal appearance. Stage I learns transferable normal and abnormal anchors from annotated auxiliary data. Stage II keeps these anchors fixed and adapts an additional normal branch using the few target normal samples. The inherited and adapted normal branches jointly characterize target normality, with text-anchor regularization encouraging consistency with the generic normal prior and separation from the abnormal anchors. This design retains learned anomaly knowledge while reducing dependence on category-specific anomaly templates, without requiring synthetic anomaly generation. Cross-dataset experiments between MVTec-AD and VisA under 1-, 2-, and 4-shot settings demonstrate competitive detection and localization performance. Controlled ablations assess the roles of transferred anchors, asymmetric adaptation, dual-normal representations, and anchor regularization.

[9] Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update cs.CVPDF

Sitian Shen, Jiuming Liu, Mengmeng Liu, Yian Wang, Michael Ying Yang

TL;DR: Artemis为多智能体驾驶视频生成重建共享显式3D世界地图，以统一各智能体的几何状态和跨视角一致性；动作引导几何注入生成前景/背景控制图，并让非智能体背景动态依靠自身历史运动条件化。

Details

Motivation: 多智能体视频世界模型有助于揭示复杂交互，但现有方法常通过交叉注意力隐式通信，缺少显式几何约束和统一3D状态，导致跨视角一致性差且难以恢复视野外智能体；静态背景假设也无法表示不受控的背景动态。

Result: Artemis从多智能体观测重建显式3D世界地图，并以动作引导几何注入模块渲染分解的前景和背景控制图，再通过GeoAdapter注入扩散Transformer。相较只建模静态背景的方法，GeoAdapter还能区分非智能体动态，并以其多帧历史位置提供一致运动线索。视频rollout中的关键帧逐步更新重建地图。作者从CARLA模拟器采样构建MA-CARLA数据集。实验报告生成视频视觉保真度和跨视角一致性优于既有方法，并支持多模态同步rollout（2D视频和3D点图维护）、两个以上智能体及多摄像头设置；摘要未提供量化指标。

Insight: 通过共享显式3D状态而不是仅靠智能体间隐式注意力，有望提升多视角几何一致性并补全视野外参与者；把背景动态单独条件化也能突破静态场景假设。当前结果为定性优势，跨智能体规模的具体成本和指标未在摘要给出。

Abstract: Recent video world models have witnessed the paradigm shift from single-agent to multi-agent involvements, which can reveal more complicated dynamics and cross-agent interaction in the real world. However, existing approaches commonly adopt implicit inter-agent communications via cross attention, which lack explicit geometry constraints and unified 3D state, thereby leading to poor multi-view consistency and struggling with recovering out-of-sight agents. In addition, most of them assume a static background, failing to represent uncontrolled background dynamics. To address these problems, we propose Artemis: a geometry-grounded multi-agent world model with explicit memory sharing. An explicit 3D world map is reconstructed from multi-agent observations to enforce a unified 3D state across agents, offering high cross-view consistency. Specifically, an action-guided geometric injection module is developed to simultaneously render decomposed foreground-background control maps, which are then injected into a diffusion transformer through a designed GeoAdapter block. Compared to previous methods assuming static-only background, our GeoAdapter can also distinguish uncontrolled non-agent dynamics, which are conditioned on their own multi-frame history positions to provide consistent motion cues. Keyframes selected from progressive video rollouts are used to progressively update the reconstructed 3D world maps. To effectively capture complex dynamic patterns, we curate a novel dataset sampled from the CARLA simulator called MA-CARLA. Extensive experiments demonstrate the superiority of our proposed method in terms of visual fidelity and cross-view consistency in the generated videos. In addition, our Artemis can support simultaneous multi-modal rollouts with both 2D video and 3D point map maintenance, scale to scenarios beyond two agents and multi-camera setting.

Gabriel Lee Jun Rong, Shanhong Liu, Pai Chet Ng, Konstantinos N. Plataniotis, Jamal Seyedmohammadi

TL;DR: WiSPER用同一CSI上下文上的姿态集合监督预训练，再通过条件残差flow细化多人的3D姿态候选；仅推理时需要WiFi CSI。PiW3D上整体MPJPE为63.72毫米，比WiFi-JEPA降低40.0%，两人和三人设置分别降低42.1%和38.1%。

Details

Motivation: 从WiFi信道状态信息估计多人3D姿态很困难，因为不同人的反射信号重叠，无法直接识别各自关节。无显式姿态监督的掩码嵌入目标可以学习无线关系，但结构化解码器仍可能留下坐标误差。

Result: WiSPER分两阶段：Pose-Aware Masked Embedding Learning把掩码潜变量预测与同一CSI上下文上的姿态集合辅助监督结合，引导编码器从部分观测定位关节；Transformer残差流细化器ReFT生成可适应人数变化的姿态候选，并用粗坐标和逐关节解码特征作条件细化。训练时两阶段都用配对CSI和姿态标注，推理只需CSI。PiW3D上总体平均关节位置误差为63.72毫米，相较WiFi-JEPA下降40.0%；两人和三人条件分别下降42.1%和38.1%。姿态监督预训练优于仅CSI的JEPA，残差细化器在不同配置下使总体MPJPE再降13.8%–15.6%。

Insight: 把姿态监督加入无线表示预训练，再用条件生成式细化器校正坐标误差，可同时改善关节定位和人数变化下的姿态集合预测。结果针对PiW3D及所测多人配置；真实环境迁移性能摘要未说明。

Abstract: Multi-person 3D pose estimation with WiFi channel state information (CSI) is challenging because reflections from different people overlap without directly identifying individual joints. Existing masked embedding objectives capture wireless relationships without explicit pose supervision, while structured decoders can retain coordinate errors. We propose WiSPER, a two-stage framework combining pose-aware predictive pretraining with conditional residual flow refinement. Pose-Aware Masked Embedding Learning (PAMEL) couples masked latent prediction with auxiliary pose-set supervision on the same CSI context, guiding the encoder toward joint localization from partial observations. Residual Flow refinement with Transformer (ReFT) generates a set of pose candidates to accommodate a variable number of people and refines each candidate through a conditional flow guided by its coarse coordinates and per-joint decoder features. Both stages use paired CSI and pose annotations during training, while inference requires only CSI. Experiments on the PiW3D dataset show that WiSPER achieves an overall mean per-joint position error of 63.72 mm, a 40.0% reduction relative to WiFi-JEPA. For experiments with two and three people, WiSPER reduces MPJPE by 42.1% and 38.1%, respectively. Pose-supervised pretraining configurations obtain lower errors than CSI-only JEPA, and enabling the trained residual refiner reduces overall MPJPE by 13.8-15.6% across the evaluated configurations.

[11] Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints cs.CV | cs.AIPDF

Olivia Nocentini, Marta Lagomarsino, Gokhan Solak, Younggeol Cho, Qiyi Tong

TL;DR: 本文用单个正面RGB摄像头和图神经网络，根据列车司机面部及上半身关键点分类警觉、非警觉和模拟紧急行为。光照条件下融合面部与骨架特征的三分类准确率为81%，警觉/非警觉二分类准确率达到99%；另发布三种照明条件下的受控RGB视频数据集。

Details

Motivation: 司机疲劳威胁铁路安全，而传统死手装置只能进行简单有限的警觉性检查。作者探索仅用非接触式前向RGB相机，通过面部和上半身动态识别司机状态。

Result: 系统使用图神经网络对三类状态分类：警觉、非警觉，以及由表演的紧急行为构成的紧急类。消融比较骨架特征、面部特征及二者结合。光照条件下，面部与骨架联合特征的三分类准确率最高，为81%，优于单独使用任一特征；同样条件下，警觉/非警觉二分类准确率为99%。研究还提供受控RGB视频数据集，包含三种照明条件下录制的警觉、非警觉和模拟紧急行为。

Insight: 面部和骨架互补特征在模拟司机状态识别中优于单一线索，尤其二分类准确率较高；但紧急类别为表演行为，测试光照条件与真实驾驶场景可能不同，因此不能直接视为已验证真实铁路运营安全系统。

Abstract: Driver fatigue poses a significant challenge to railway safety, with traditional systems like the dead-man switch offering limited and basic alertness checks. This study presents a vision-based monitoring system that relies solely on a single front-facing RGB camera and a graph neural network to classify simulated train-driver states into alert, not-alert, and an emergency class comprising acted emergency-like behaviours. To optimize input representations for the model, an ablation study was performed, comparing three feature configurations: skeletal-only, facial-only, and a combination of both. Experimental results show that combining facial and skeletal features yields the highest accuracy (81%) for the three-class model under the light condition, outperforming models that use only facial or skeletal features. Furthermore, the combination of facial and skeletal features achieves 99% accuracy in the alert/not alert classification in light condition. Additionally, we introduced a controlled RGB video dataset containing alert, not alert, and acted emergency-like behaviours recorded under three illumination conditions. These contributions represent a step toward passive and non-contact train-driver state recognition based on facial and upper-body dynamics.

[12] MoonGS: High-quality Representation of the Lunar Surface via Gaussian Splatting Using Robust Depth Features from Image Pairs cs.CVPDF

Yun Jiang, Bo Zheng, Yingying Zhang, Xueming Xiao, Tao Hu

TL;DR: MoonGS是面向月球场景的前馈3D Gaussian Splatting方法，只需两张稀疏图像即可单次前向预测高斯并生成新视角，无需逐场景优化。LuSNAR和MoonBlender实验中比前馈NeRF/3DGS基线高4.9 dB PSNR、0.29 SSIM，LPIPS降低40%，推理低于1秒。

Details

Motivation: 月球车稀疏图像的高质量地形重建对自主探测重要，但视角重叠不足、表面纹理弱且数据量有限，增加了几何恢复难度。传统逐场景优化也不适合高效、可扩展地处理稀疏观测。

Result: MoonGS仅输入两张图像，单次前馈预测像素对齐的高斯基元并渲染逼真新视角。模型使用可灵活集成视觉基础模型的骨干提取鲁棒深度特征；通过融合语义线索改善高斯参数估计，并以语义排序损失约束背景深度；还以熵引导启发式重采样选择信息量最大的远处视角扩充稀疏观测，额外开销很小。LuSNAR和弱纹理合成MoonBlender上，较前馈NeRF/3DGS基线提升4.9 dB PSNR和0.29 SSIM，LPIPS降低40%，推理时间低于1秒。集成VGGT等骨干可进一步提升表现；嫦娥任务图像定性评估中也获得最佳视觉质量。

Insight: 弱纹理月面重建可通过语义深度先验和主动挑选高信息量远视角弥补稀疏双目几何不足，同时保持前馈效率。定量结果来自给定基准和基线；真实嫦娥图像证据为定性比较。

Abstract: High-quality 3D reconstruction of lunar terrain from sparse rover images is indispensable for autonomous lunar exploration, but remains challenging because viewpoint overlap is insufficient, surface textures are weak, and data volume is limited. We propose MoonGS, the first feed-forward 3D Gaussian Splatting framework tailored to lunar scenes. Given only two input images, MoonGS predicts pixel-aligned Gaussian primitives in a single forward pass and renders photorealistic novel views without any per-scene optimization. MoonGS (i) adopts an adaptable backbone design that seamlessly integrates advanced vision foundation models to extract robust depth features; (ii) integrates semantic priors in two manners: merging semantic cues with visual features to refine Gaussian parameter estimation, and adopting a semantic ranking loss that regularizes background depth; and (iii) employs an entropy-guided heuristic resampling strategy to augment sparse observations by selecting the most informative distant viewpoints with negligible overhead. Experiments on the LuSNAR benchmark and our synthetic weak-texture MoonBlender dataset show that MoonGS surpasses state-of-the-art feed-forward NeRF/3DGS baselines by +4.9 dB PSNR, +0.29 SSIM, and 40% lower LPIPS while maintaining sub-second inference. Furthermore, we validate the broad applicability of our framework by demonstrating that it effectively leverages state-of-the-art backbones, including VGGT, to significantly boost performance. Qualitative evaluations on Chang’e mission imagery also show the best visual quality among compared methods, indicating robustness on real lunar data. The source code and dataset are publicly available at https://github.com/InRobots/MoonBlender.

[13] A Data-Centric Review of Plant Disease Datasets: Taxonomy, Critical Analysis, Environmental Variability, and Implications for Precision Agriculture cs.CVPDF

Aamir Hilal, Shabir Ahmad Sofi, Neeraj Goel

TL;DR: 这篇综述从数据中心视角梳理植物病害视觉检测数据集，按采集环境、可访问性、植物多样性、病害组成、类别结构和不平衡程度建立分类，并分析实验室与田间数据差异如何影响泛化和真实部署。

Details

Motivation: 植物病害AI检测已有进展，但实验室采集数据常缺少环境多样性、真实背景和均衡类别分布，导致田间部署泛化不足。田间数据更能反映农户面临的自然变化，但其结构性失衡和环境因素尚未被既有综述充分分析。

Result: 综述比较实验室数据集与真实田间数据集，构建覆盖采集环境、开放性、植物种类、病害构成、类别结构和不平衡程度的分类体系，并讨论各因素对泛化与部署的影响。作者特别分析类内、跨作物和跨数据集多层次不平衡，以及有限环境变异如何影响性能与鲁棒性；还强调应将温度、湿度、叶面湿润度等环境参数与图像结合。文章归纳数据集构建、环境变化、结构性不平衡、标准化和多模态监测方面的挑战及方向。

Insight: 植物病害检测的田间泛化不仅是模型架构问题，也受到数据采集偏差和环境变量影响；数据集设计需要覆盖真实地区、环境和类别结构，并考虑图像以外的环境观测。该文为综述与研究议程，不是提出并验证一个新检测模型。

Abstract: Despite rapid advances in artificial intelligence, reliable real-world plant disease detection remains a persistent challenge. Visual and deep learning approaches have shown promising results, but their deployment under field conditions remains limited. A key bottleneck is the reliance on laboratory-generated datasets that lack environmental diversity, realistic backgrounds, and balanced class distributions, resulting in poor generalization. In contrast, datasets collected directly from agricultural environments capture natural variability and better reflect challenges faced by farmers across regions. This review presents a critical analysis of visual and deep learning approaches for plant disease detection, with emphasis on plant disease datasets. It establishes a taxonomy based on acquisition setting, accessibility, plant diversity, disease composition, class structure, and imbalance severity, and examines their implications for model generalization and real-world deployment. A comparative analysis of laboratory and real-field datasets identifies critical gaps that hinder disease detection. The review further analyzes how multi-level dataset imbalance, including intra-class, inter-crop, and cross-dataset imbalance, and limited environmental variability affect model performance and robustness, an area insufficiently examined in existing surveys. Beyond image-based approaches, it highlights the importance of integrating environmental parameters such as temperature, humidity, and leaf wetness with image data to improve prediction under dynamic field conditions. Finally, the review identifies key challenges, research gaps, and future directions concerning dataset construction, environmental variability, structural imbalance, standardization, and multimodal disease monitoring. It provides a foundation for developing next-generation multimodal frameworks for precision agriculture.

[14] R2RI: A Multi-View Event and RGB Dataset for Robot-to-Robot Interaction cs.CV | cs.ROPDF

Gabriele Magrini, Riccardo Catalini, Federico Becattini, Guido Borghi, Pietro Pala

TL;DR: R2RI是专门研究机器人—机器人交互的多视角事件与RGB数据集，涵盖多种人形机器人和模拟真实人类社交行为的交互，提供每台机器人机载第一视角及外部固定摄像机第三视角，共超过650万帧、约5,000段120fps视频。

Details

Motivation: 机器人自主体间交互关系到协作系统、社交机器人和人机共存，但相关研究缺少大规模基准，阻碍了对交互动态的建模和系统比较。

Result: R2RI覆盖不同人形机器人以及仿照真实人类社会行为设计的交互；提供每台机器人机载传感器的自我中心视角和外部固定摄像机的外部视角，便于分析空间与交互上下文。数据包含事件相机和RGB两种域，总计超过650万帧、约5,000段、帧率120fps的视频。作者比较两种感知域的优缺点，并在多项感知与交互任务上评估现有方法；数据及各任务标注公开发布。

Insight: 同时提供事件流/RGB和机载/外部视角，为研究多机器人交互中的低延迟动态、空间上下文和视角互补提供统一基准。摘要未报告具体模型成绩或数据分布细节，数据集规模是当前主要量化信息。

Abstract: Understanding and modeling interactions between autonomous agents is a fundamental challenge in robotics, with broad implications for collaborative systems, social robotics, and human-robot coexistence. Although the study of robot interactions has emerged as a compelling research direction, progress has been severely hampered by the absence of large-scale benchmarks. In this paper, we introduce Robot-to-Robot Interaction (R2RI), the first dataset specifically designed to address the Robot-Robot Interaction (RRI) task. R2RI consists of different humanoid robots and realistic interactions modeled on real human social behaviors. Complementary viewpoints are available, \textit{i.e.}, an egocentric perspective from each robot’s onboard sensors, and an exocentric perspective from external fixed cameras, thus enabling rich spatial and contextual understanding of the interaction dynamics. The dataset comprises more than $6.5$M frames and $\approx5000$ videos at $120$ fps, including Event and RGB domains. We investigate pros and cons of each domain, comparing state-of-the-art approaches for a number of key sensing and interaction based tasks. We publicly release the dataset and its annotations for all tasks and modalities at https://github.com/MagriniGabriele/R2RI.

[15] PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence cs.CV | cs.AIPDF

Dheeraj Varghese, Anna Vettoruzzo, Walter Simoncini, Michelle Lorena Acevedo Callejas, Mohammad Mahdi Derakhshani

TL;DR: PlaySuite是交互式视觉智能基准，收录PyWeek和itch.io上5,000多款开源游戏，使用统一闭环交互和视频LLM裁判评估长期目标进展。对14个近期模型的评测显示明显感知—行动差距，模型常在空间定位、动作执行和自我纠错上失败。

Details

Motivation: 多模态基础模型在静态感知和推理基准上表现出色，但这类评测忽视了智能体在动态环境中长时间行动的能力。要衡量从视觉理解到目标导向交互的进步，需要跨游戏、引擎和任务的可复现闭环环境。

Result: PlaySuite包含来自PyWeek和itch.io的5,000多款游戏，覆盖多种类型和Pygame、HTML5、Godot、Unity等引擎；多数游戏对当前模型属于分布外，降低通过记忆攻略或训练数据线索取胜的可能。作者构建面向HPC集群的统一闭环交互框架，并用Video-LLM裁判将可观察游戏里程碑映射为统一进度等级。评估14个视觉语言模型、计算机使用智能体和VLA模型，结果揭示明显感知—行动差距：模型虽具推理能力，却难持续推进，常见失败包括空间定位、动作执行和自我纠错。

Insight: 静态问答分数不能代表智能体能否在长期动态环境中达成目标；大规模分布外游戏闭环基准将执行和持续适应纳入评估。摘要的主要发现是定性错误模式，没有给各模型具体进展分数或排名。

Abstract: Recent advances in multimodal foundation models yield strong performance on static perception and reasoning benchmarks, yet such evaluations largely overlook a central aspect of intelligence: acting competently in dynamic environments over extended time horizons. We introduce PlaySuite, a large-scale benchmark for evaluating interactive visual intelligence across more than 5K open-source video games curated from PyWeek and itch.io. Spanning diverse genres and engines, including Pygame, HTML5, Godot, and Unity, these independent games are largely out-of-distribution for current models, reducing the likelihood that success can be achieved by retrieving memorized walkthroughs or web-scale training artifacts. To enable scalable evaluation across heterogeneous titles, we develop a unified closed-loop interaction framework optimized for HPC clusters alongside a Video-LLM-as-a-judge protocol that maps observable gameplay milestones to standardized progress levels. We evaluate fourteen recent open models spanning vision-language models, computer-use agents, and vision-language-action models. Our results yield strong evidence of a perception-action gap: despite strong reasoning capabilities, current models struggle to make sustained progress and exhibit recurring failures in spatial grounding, action execution, and self-correction. PlaySuite provides a reproducible and extensible testbed for measuring progress from visual perception to goal-directed interaction, and a foundation for developing models that can act, adapt, and generalize in dynamic visual environments.

[16] Deep Learning Based Illegal Bowling Action Detection cs.CVPDF

Debopom Sutradhar, Niful Islam, Sudipto Mondal, Tasmima Hossain Jamim, Jubaer Muhammad Shufol

TL;DR: 本文提出用单目视频检测板球投球动作是否可能非法：定位投球过程中的肩部帧和出手帧，比较投球臂角度变化，超过预设阈值（例如15度）即标记待查。自建数据集有11名投手、62段多角度视频，但样本偏右手和常规动作，摘要未给出具体准确率。

Details

Motivation: 非法投球动作检测对比赛公平重要，但裁判难以实时监控，基于传感器的既有方案也不易用于现场比赛。计算机视觉方案可能直接从投球视频评估关键动作角度。

Result: 作者收集62段视频，记录11名男性投手的合法和非法投球动作，视角包括正面、背面和侧面。系统从投球视频识别肩部帧和出手帧，计算两帧之间投球臂角度变化；若超过预设阈值（如15度），则将投球标记为可能非法。自建数据集评估显示较高真阳性率，作者认为有实时应用潜力，但摘要没有具体数值。

Insight: 通过关键时刻的投球臂角度变化，可构造简单、可解释的视觉筛查信号；系统输出应理解为疑似违规提示。现有数据规模较小、以右手常规动作居多，仍需在更多投手、动作和现场环境下验证泛化与鲁棒性。

Abstract: Cricket, often referred to as the “gentleman’s game,” adheres to a strict rule set for both batsmen and bowlers, where each delivery can significantly impact the match outcome. Detecting illegal bowling actions is crucial for maintaining fair play, yet it remains challenging for umpires to monitor in real time. Existing sensor-based solutions have limitations in live match scenarios, making real-time assessment difficult. This paper proposes a computer vision-based deep learning solution to detect illegal bowling actions in live cricket matches. To develop and evaluate our approach, we compiled a dataset of 62 videos featuring 11 male bowlers, capturing both legal and illegal bowling actions from multiple angles-front, back, and side. However, the dataset predominantly comprises right-handed bowlers with conventional actions. The proposed system identifies two key frames, the shoulder frame and the release frame from video footage of a bowler’s delivery and analyzes the change in the bowling arm’s angle between these frames. If the angle difference exceeds a predefined threshold (e.g., 15 degrees), the delivery is flagged as potentially illegal. We evaluated the system on a custom dataset and achieved a high true positive rate, suggesting the system’s potential effectiveness in real-time match settings. However, further research is required to validate the system across diverse environmental conditions and larger datasets to ensure generalizability and robustness in various live match scenarios. To the best of our knowledge, this is the first AI-based computer vision method for detecting illegal bowling actions in cricket.

[17] CALR: Continuous Anchored Latent Reasoning via Render-of-Thought Compression cs.CVPDF

Zhaoyang Wei, Bowen Jiang, Yanchao Hao, Wenchao Ding, Zheng Wei

TL;DR: CALR用功能锚定连接连续潜在推理的潜变量形成与答案使用：答案监督通过潜状态传播，解码后的思路再由具体题目推导进行语义锚定，并以并行到自回归课程训练顺序推理。在五个数学基准上，相较同预算可比连续潜在方法提升26.0个百分点。

Details

Motivation: 视觉潜在推理把渲染推导压缩成紧凑中间状态，以减少文本推理开销。连续表示避免词表限制但可能潜状态塌缩；离散表示可恢复中间推理，却可能让答案预测绕过潜在状态。作者据此要求潜变量既真正影响答案，也承载有效、题目相关的推理。

Result: CALR使用信息平衡压缩得到的参考潜变量，将潜在状态参与答案监督，并用推导级语义锚定让解码潜变量内容对应具体问题推理。并行到自回归训练课程使后续潜在块以已生成前缀为条件，发展顺序推理能力。在多个模型系列的五个数学推理基准上评测，准确率显著提高；在匹配预算条件下，相较可比连续潜在推理方法提升26.0个百分点。分析显示潜变量既支持答案预测，也包含问题特定的中间推理。

Insight: 仅让连续潜变量影响答案还不够，还应验证它是否保留与当前问题相关、可解码的推导内容；功能监督和语义锚定共同处理这两点。26个百分点是相对一种可比连续潜在方法的提升，不代表相对所有显式思维链方法的优势。

Abstract: Visual latent reasoning compresses rendered derivations into compact intermediate states, reducing textual reasoning overhead. Existing approaches differ in how they represent these states: continuous methods avoid vocabulary constraints, whereas discrete methods improve accuracy through quantization into a finite codebook. Our analysis of representative continuous and discrete systems identifies two functional requirements: answers must rely on latent states, and those states must carry valid, problem-specific reasoning. Continuous latents influence answers despite collapsed reasoning content, whereas discrete latents retain recoverable intermediate reasoning that answer prediction largely bypasses. To address these challenges, we propose Continuous Anchored Latent Reasoning (CALR), which connects latent formation with answer use through functional anchoring. With reference latents from information-balanced compression, CALR couples latent-mediated answer supervision with derivation-level semantic anchoring: the former routes answer supervision through intermediate states, while the latter grounds their decoded content in problem-specific derivations. A parallel-to-autoregressive curriculum develops sequential reasoning by conditioning subsequent latent blocks on generated prefixes. Evaluations on five mathematical reasoning benchmarks across model families show substantial accuracy gains. Under matched budgets, CALR gains 26.0 percentage points over a comparable continuous latent reasoning method. Further analyses show that its latents support answer prediction and carry problem-specific intermediate reasoning.

[18] What Words Keep of a Place: Zero-Shot Language Reasoning for Cross-View Geo-Localization cs.CV | cs.LGPDF

Ayesh Abu Lehyeh, Jay Hwasung Jung, Safwan Wshah

TL;DR: 本文研究只用语言描述能否完成跨视角地理定位：将地面全景和卫星图分别转为结构化文本并由MLLM比较，无需训练。在9,826个VIGOR配对上，全库检索Recall@1仅0.39%；若候选缩小到邻近10块，文本裁判可超过随机排序并匹配强词面基线。

Details

Motivation: 传统跨视角地理定位通过联合训练的图像嵌入匹配地面图和卫星瓦片，效果好但需要大规模配对监督，也难解释匹配证据。作者改问自然语言描述能保留多少位置线索，能否支持零样本且更可解释的定位。

Result: MLLM分别将地面全景和卫星瓦片描述为结构化文本，再比较描述定位，所有组件均不训练。实验使用四个美国城市的9,826个VIGOR图像对。全库检索时，描述彼此较忠实且跨视角一致，但区分性不足，Recall@1仅0.39%。加入粗定位先验，将候选缩至10个相邻瓦片后，描述变得有用：基于结构一致性的MLLM裁判达到强词面基线水平并约为随机排序的两倍，还能指出匹配和冲突的具体描述字段。将裁判用于已训练视觉检索器时，对其错误查询从图像重排有效（Recall@1 23.5%），从文本描述重排较差（10.7%）。

Insight: 语言能保留场景结构，但不足以保存区分相邻地点所需的细粒度外观细节；因此适合作为粗候选集内可解释比较信号，不能替代全局视觉检索。图像重排效果好于描述重排也支持这一边界。

Abstract: Cross-view geo-localization is commonly solved as an image retrieval problem, matching a ground-level image against a database of satellite tiles through a jointly trained embedding. Such models are accurate, but they need large paired supervision and cannot show what evidence supports a match. In this paper, we study a different question: how much of this task can be solved through language alone? We prompt a multimodal large language model (MLLM) to describe each ground panorama and each satellite tile as structured text, and localize by comparing these descriptions. No component is trained. We evaluate on 9,826 VIGOR pairs from four U.S. cities, in three settings. First, the descriptions are faithful but not discriminative. They agree closely across the two views, yet ranking the full pool by description similarity almost never returns the correct tile (0.39% Recall@1). Second, we narrow the pool to ten neighboring tiles, as a coarse prior would do. The same descriptions now become useful: an MLLM judge that scores structural consistency doubles random ranking and matches a strong lexical baseline. It also states which fields of the two descriptions agree and which conflict, which an embedding distance cannot do, and which we see as a step toward interpretable localization. Third, we place the judge on a trained visual retriever. On the queries it ranks wrongly, reranking from images works, while reranking from our descriptions does not (23.5% against 10.7% Recall@1). Scene structure survives the conversion into language, while the fine appearance detail needed to separate nearby places does not. Code and prompts are publicly available at https://github.com/AyeshAbuLehyeh/GeoLingual.

[19] Localize Any Object in X-Ray Security Scans without Human Annotation cs.CVPDF

Yaqi Cai, Mingxuan Liu, Lorenzo Vaquero, Ning Wang, Nan Pu

TL;DR: LAO-X用自监督生成的图像—标注对适配X射线安检中的通用物体定位，无需人工标注。它在吸收域做物理引导合成，并按物体数和遮挡程度逐步微调SAM2；六个基准的重度杂乱场景中较SAM2和X射线专用基线提升2–23 mAP。

Details

Motivation: 网页RGB图像与X射线扫描在颜色、边界和体积叠加结构上差异明显，阻碍密集视觉基础模型零样本迁移；同时，专家标注的X射线数据稀缺，既限制专用模型训练，也限制RGB基础模型微调。

Result: LAO-X先用显著性引导的物体挖掘模块分离多样实例，再在吸收域进行物理引导合成，生成多粒度图像—标注对；之后采用遮挡控制课程，按物体数量和重叠程度逐渐微调SAM2定位器。六个X射线基准实验表明，在重度杂乱场景中，类别无关定位较SAM2和X射线专用基线提升2–23 mAP，整个流程不使用人工标注。

Insight: 在吸收域模拟X射线叠加物理过程，并控制遮挡复杂度逐步迁移，可将RGB分割基础模型适配到标注稀缺的X射线定位。提升幅度依场景和基线而异；摘要未给出每个基准的分项结果。

Abstract: Universal object localization in X-ray security inspection is critical for automated threat detection in safety-critical venues. However, unlike everyday RGB images that dominate web-scale visual data, X-ray scans exhibit distinct color patterns, ambiguous boundaries, and compositional structures caused by volumetric superposition. These gaps hinder the direct zero-shot transfer of dense perception foundation models trained on web-scale RGB data. Moreover, annotated X-ray data is scarce and requires expert labeling, limiting both the training of generalizable X-ray native models and the adaptation of RGB foundation models for X-ray data via fine-tuning. Given these challenges, the bright promise of highly generalizable perception models, enabled by data scaling laws in the RGB domain, remains largely out of reach for X-ray inspection. To this end, we introduce LAO-X, a self-supervised adaptation framework that Locates Any Object in X-ray scans using diverse synthesized image–annotation pairs with granularity-aware supervision. LAO-X first designs a saliency-guided X-ray object mining module to separate diverse object instances, which are then used for physics-guided synthesis in the absorbance domain. LAO-X further incorporates an occlusion-controlled curriculum strategy to fine-tune a Segment Anything Model 2 (SAM2) localizer, progressively adapting it to X-ray scans with increasing object counts and overlap levels. Experiments on six X-ray benchmarks show that LAO-X substantially improves category-agnostic localization, achieving 2% to 23% mAP gains over SAM2 and X-ray specific baselines in heavily cluttered scenarios, entirely without human-annotated labels.

[20] A doctrine-grounded visual question answering dataset for Tactical Combat Casualty Care cs.CV | cs.AI | cs.CLPDF

Junseob Kim, Jade Chng, Ayman Ali, Victor Moas, Yichun Lee

TL;DR: TC3-VQA是以权威战术战伤救护（TC3）条令为依据的视觉问答数据集，含581个条目、11个概念和1,860个问题，覆盖干预识别、条令知识、临床推理、操作指导及视觉信息不足时拒答；答案保留来源原文和字符偏移以便核查。

Details

Motivation: TC3要求救护者把伤情及处置的视觉观察与权威临床指导联系起来。训练VLM支持这一过程，需要将可见证据与可追溯条令对应，并评估识别、知识回忆和信息不足时的弃答能力。

Result: 数据集从公开TC3教学/实地视频和权威文档构建，含581个样例条目、覆盖11个概念的1,860个问题，涉及干预识别、条令、临床推理、流程指导，以及视觉证据不足时的拒答。条令答案保留来源逐字文本和字符偏移；构建流程结合视觉标注、段落检索、蕴含检查和跨模型核验。问题—答案还附装备框、解剖标签、时间片段和来源元数据。自动审计及两名医生、两名医学生评分评估标注质量，其中88个保留条目有人类评分。

Insight: 通过保留条令原文跨度及时间/空间标注，基准可分别评估视觉识别、条令检索和证据不足时拒答，并支持溯源审查。当前人工评分覆盖88个保留条目，数据可用于模型适配和评估，但摘要没有报告模型基线分数。

Abstract: Tactical Combat Casualty Care (TC3) requires responders to connect visual observations of injuries and interventions with established clinical guidance. Developing vision-language models to support this process requires supervision that links visible evidence to traceable doctrine. We present TC3-VQA, a dataset constructed from public instructional and field TC3 videos and authoritative TC3 documents. It contains 581 items spanning 11 concepts, with 1,860 questions covering intervention recognition, doctrine, clinical reasoning, procedural guidance, and refusal when visual information is insufficient. Doctrine-based answers preserve verbatim source passages and character offsets. Construction combines visual annotation, passage retrieval, entailment checks, and verification across model families. Equipment boxes, anatomical labels, temporal segments, and source metadata accompany the question-answer pairs. Automated audits and ratings by two physicians and two medical students characterize annotation quality, with human ratings available for 88 retained items. The dataset provides a resource for adapting vision-language models to TC3, studying the connection between visual evidence and clinical knowledge, and evaluating recognition, doctrine recall, and abstention.

[21] Tracking Is Not Permanence: What Video World Models Keep of a Hidden Object cs.CV | cs.CLPDF

Peng Xie, Amr Alanwar

TL;DR: 本文检验视频世界模型对遮挡物体是否保留持久性信息，发现冻结V-JEPA 2预测器对移动物体的记忆可在0.3秒内消失；尽管编码器仍能读出存在信息，预测输出几乎不包含闭盒内的球。仅3,000步合成容器训练即可把模型对隐藏物体的信念从0.05提高至1.00。

Details

Motivation: 视频世界模型能够跟踪可见物体，但遮挡后是否继续表示物体存在、尤其物体被容器带走时是否保持其位置和状态，并不清楚。作者将预测器输出与编码器对不同隐藏场景的表征进行对照，以区分编码信息缺失与预测未保留信息。

Result: 研究遮挡V-JEPA 2输入中的物体，再比较预测区域和编码器对仅在遮挡区域不同的两种场景的表示。预测器部分保留静止物体，不保留被容器带走的物体；移动物体信息0.3秒内消失（使用V-JEPA自身tube mask时0.5秒；ViT-H在预训练90%遮挡率下保留1.1秒）。投影中残留痕迹仅为复制最后一帧基线的14%–60%。编码器可在1.00读出物体存在，闭合容器内容3.5秒仍可解码；但用编码器探针读取预测器输出时，闭盒0.5秒后仅2%场景含球。对合成容器做3,000步预测器单独训练，可将持久性信念从0.05升至1.00；IntPhys-2019由84.2%升至93.3%，但无容器课程也得到类似提升。tube-mask继续训练还使操作和网络风格视频中移动物体保留1.1–1.6秒。

Insight: 遮挡持久性缺陷出现在预测器输出端，而非编码器完全没有物体信息；少量针对性训练可把持久性作为先验装入模型，说明潜在预测并非内在无法保留物体。IntPhys分数变化也可由不含容器的课程获得，且基准归因依评分规则而变，需谨慎解释。

Abstract: Video world models track objects they can see; we ask what they keep of objects they cannot. We hide an object from a frozen V-JEPA 2 predictor and compare its prediction for the hidden region with the encoder’s representation of two worlds that differ only inside that region. The predictor’s decision keeps a stationary object in part and one carried inside a container not at all, and loses a moving one within 0.3 s (0.5 s under V-JEPA’s own tube mask; ViT-H keeps it to 1.1 s at pretraining’s 90% masking ratio); in projection a trace remains, below the midpoint, at 14-60% of what a baseline copying the last view retains. The information is there: the encoder reads the object’s presence at 1.00 and keeps a closed container’s contents decodable for 3.5 s, while the predictor’s output, read with the encoder’s own probe, contains the ball in 2% of scenes once the box has been closed for half a second. On rendered scenes, permanence is missing on the predictor’s side, and training installs it cheaply as a prior: three thousand predictor-only steps on synthetic containers take this belief from 0.05 to 1.00 against two matched controls. They also raise IntPhys-2019 from 84.2% to 93.3%, but so does a curriculum without containers, and which training habit the benchmark credits changes with its scoring rule. Continued training with tube masks produces 1.1-1.6 s of moving-object carry-over on manipulation and internet-style video, so the deficit is not intrinsic to latent prediction. VideoMAE keeps almost nothing, and Cosmos’s next-token prediction keeps a stationary hidden object but not one carried inside a moving container.

[22] WildMatch: Weakly Supervised Image Matcher Adaptation for Wildlife Re-Identification cs.CV | cs.AI | cs.IRPDF

Turhan Can Kargin, Piotr Kubaty, Ekaterina Rostovskaya, Izabela Wierzbowska, Bartosz Zieliński

TL;DR: WildMatch用仅有的动物个体身份标签，弱监督适配预训练关键点匹配器，无需关键点或几何对应标注：先挖掘信息性图像对，再根据身份一致性构造弱正负监督并对比微调。在开放野生动物重识别数据集上优于现成匹配器和局部—全局融合方法，留出个体测试支持迁移对应先验而非记忆训练个体。

Details

Motivation: 相机陷阱中的个体动物重识别要求模型识别毛皮、皮肤等局部独特纹理。全局分类嵌入需要每个个体大量标注且忽略局部证据；直接使用通用图像匹配器又缺少适配野生动物的对应标注，现有数据通常只有身份标签且规模较小。

Result: 方法研究仅基于身份标签的关键点匹配器弱监督适配。它先用预训练匹配器挖掘信息性图像对，根据身份是否相同生成弱正负监督，再对比微调以强化同个体图像间对应并抑制不同个体对应。多个公开野生动物重识别数据集上，准确率高于现成匹配器及SOTA局部—全局融合方法。留出个体开放世界协议显示模型学习到可迁移的对应先验，而非记忆训练身份。摘要未报告具体数值。

Insight: 常见野生动物监测数据已有的个体身份标签可用于适配局部匹配器，不必额外制作昂贵的关键点级对应标注。开放世界评测支持迁移而非身份记忆，但摘要未提供数据集规模或准确率增幅。

Abstract: Individual animal re-identification from camera-trap imagery is an instance retrieval problem central to non-invasive wildlife monitoring: a query image must retrieve the correct individual from a reference set of known animals. This requires computer vision models to recognize distinctive local patterns in fur, skin, or other visual markings. Current approaches either learn global embeddings as a classification problem, requiring many labeled images per individual while largely ignoring local evidence, or apply off-the-shelf, domain-agnostic image matchers. Although such matchers are pretrained on large and diverse image collections, adapting them to wildlife imagery is challenging because available datasets are small and lack correspondence-level annotations. We study weakly supervised adaptation of a pretrained keypoint matcher using only identity labels, without keypoint-level or geometric correspondence ground truth. We mine informative image pairs with the pretrained matcher, derive weak positive and negative supervision from identity agreement, and contrastively fine-tune the matching network to strengthen correspondences for same-identity pairs and suppress them for different identities. Across open-source wildlife re-identification datasets, our approach improves accuracy over off-the-shelf matchers and a state-of-the-art local–global fusion method. Under an open-world protocol with held-out individuals, it learns a transferable correspondence prior rather than memorizing training identities. To our knowledge, this is the first study of matcher-level, identity-supervised adaptation for animal re-identification. Our method enables data-efficient specialization of image matching models to wildlife domains using identity annotations already available in typical monitoring datasets.

[23] Semantic Capability Acquisition and Specialization During Vision-Language Model Fine-Tuning cs.CVPDF

Suguru Onda, Matthew Bailey, Ryan Farrell

TL;DR: 本文把VLM微调期间的身份和属性语义能力视为随训练演化的轨迹，而非只检查最终checkpoint，并提出Structured Semantic Routing研究监督结构对能力的影响。六个CLIP骨干实验显示微调可获得超越预训练状态的语义能力，但不同能力峰值不同，继续优化可能保留类别名检索却损害可迁移的免名字属性表征。

Details

Motivation: VLM微调通常只在单个下游checkpoint评估，无法区分某项语义能力从未获得，还是曾经出现后在专门化中衰退。作者关注身份与属性能力何时形成、何时达到峰值、如何迁移，以及最终部署时保留了什么。

Result: 论文构建轨迹式分析框架，将能力获得、能力特定最优点和后续专门化分开，并用Structured Semantic Routing检验监督结构如何塑造能力。六个预训练骨干（DFN、MetaCLIP、OpenAI CLIP系列）显示，微调可获得超越预训练状态的语义能力，包括留出评估上的提升。无结构的名称—属性监督擅长名称和属性检索，却较弱于不提供名称的属性画像检索；SSR明显增强无名称属性画像检索，随机名称分支dropout还能加强效果。不同能力可能在不同阶段达到峰值，按目标类别名检索选择的checkpoint不一定最利于迁移；继续优化可保留强类别名检索，同时削弱先前获得的可迁移语义能力。一个诊断研究显示，晚期专门化与跨模态语义可访问性降低一致，但图像单模态类别结构仍大量保留。

Insight: 模型微调不只是单调增加能力；能力类型和监督结构决定其出现与衰退时点，单一目标指标选出的checkpoint可能牺牲可迁移语义。应按能力轨迹和留出条件评估微调，而不只报告最终目标类别检索。

Abstract: Fine-tuning vision-language models (VLMs) is typically evaluated at a single downstream checkpoint, obscuring whether a semantic capability was never acquired or emerged earlier and later declined during specialization. We ask how semantic capabilities are acquired, when they peak, how well they transfer, and what remains at deployment. We study these dynamics as a semantic capability trajectory, tracking identity- and attribute-based capabilities over training. We formulate a trajectory-based framework that separates capability acquisition, capability-specific optima, and later specialization, and introduce Structured Semantic Routing (SSR) to study how the representation of supervision shapes what is acquired. Across six pretrained backbones spanning DFN, MetaCLIP, and OpenAI CLIP, we show that fine-tuning can acquire semantic capability beyond the pretrained state, including gains observed on held-out evaluations. Unstructured name-and-attribute supervision produces strong name-and-attribute retrieval with comparatively weak name-free attribute-profile retrieval, whereas SSR yields substantially stronger name-free attribute-profile retrieval and is further strengthened by stochastic name-branch dropout. Different capabilities can peak at different stages, so a checkpoint selected by target class-name retrieval need not coincide with a transferable semantic optimum. Continued optimization can therefore preserve strong target class-name retrieval while reducing previously acquired transferable semantic capability. In a representative diagnostic study, this late specialization is consistent with reduced cross-modal semantic accessibility while substantial image-only class structure remains available.

[24] ElasticFit: Fit-Aware 3D Object Insertion via VLM Reasoning and Generative Adaptation cs.CV | cs.AIPDF

Tzu-Hsin Hsieh, Ricardo Marroquim

TL;DR: ElasticFit将VLM的场景理解转成明确3D拟合约束，包括落点、占据体积、朝向和刚性放置/缩放/弹性适配模式，再生成场景条件物体并进行碰撞、接触和物理落地约束下的网格拟合。固定资产对比中，空间关系成功率由50.8%升至69.7%，支撑成功率由48.3%升至91.7%。

Details

Motivation: 把物体插入现有3D场景不仅要选语义合理的位置，还要符合局部几何并保持物理可信。VLM和生成模型具备语义推理与内容生成能力，但受限于3D接地和几何控制，难以让生成物体适配狭小空间。

Result: 给定文字指令和渲染场景观察，ElasticFit推断结构化拟合线索：物体放在哪里、占多大体积、如何朝向，以及采用刚性放置、均匀缩放还是弹性拟合。线索将高层VLM推理转换成约束，用于条件化物体生成并引导几何拟合。系统生成场景条件物体先验、重建为3D，再按拟合模式细化网格，同时约束避免碰撞、保持接触一致和物理支撑。固定资产基线比较中，空间关系成功率从50.8%升到69.7%，支撑成功率从48.3%升到91.7%；此外支持复杂场景中的生成式“适配空间”插入。

Insight: 把语言推断的摆放意图转译成显式几何约束，可连接语义生成和局部可实现性检查；弹性适配进一步允许生成物体按场景拟合。量化对比基于固定资产设置，生成式make-it-fit能力是新增支持，摘要未给该场景的单独量化指标。

Abstract: Inserting objects into existing 3D scenes requires more than selecting a plausible location: the inserted object must also fit local geometry while preserving semantic intent and physical plausibility. Although recent Vision-Language Models (VLMs) and generative models enable semantic reasoning and visual content creation, they offer limited 3D grounding and geometric control when an inserted object must fit into constrained local spaces. We introduce \textbf{ElasticFit}, a VLM-guided framework for fit-aware object insertion centered on a novel scene-grounded representation. Given a language instruction and rendered scene observations, ElasticFit infers structured fitting cues that specify where the object should be grounded, what volume it should occupy, how it should be oriented, and its adaptation mode (rigid placement, uniform scaling, or elastic fitting). These cues convert high-level VLM reasoning into explicit 3D constraints that condition object generation and guide downstream geometric fitting. ElasticFit then generates a scene-conditioned object prior, reconstructs it in 3D, and refines the mesh through mode-specific fitting while enforcing collision avoidance, contact consistency, and physical grounding. In fixed-asset baseline comparisons, ElasticFit improves spatial relation success from 50.8% to 69.7% and support success from 48.3% to 91.7% over the strongest baseline, while providing novel support for generative “make-it-fit” insertions in complex scenarios.

[25] CETUS: How Far Do Representations Trained on Earth Transfer to Cassini SAR of Titan? cs.CV | cs.LG | eess.IVPDF

Kevin Lee

TL;DR: CETUS比较DINOv2、DOFA、CROMA等地球影像表征在卡西尼土卫六SAR地形分类上的迁移。预训练编码器在逻辑回归下的平均macro-F1高于经典图像特征，但不同模型排名会随特征缩放、优化和正则化设定改变；继续用土卫六数据训练对三种编码器影响不一。

Details

Motivation: 卡西尼合成孔径雷达图像记录土卫六沙丘、平原和湖盆，提供了将地球影像学到的表示用于行星地形分类的跨域测试。需要评估通用地球表征能否迁移到具有不同雷达成像和行星地貌的领域。

Result: CETUS使用USGS卡西尼SAR镶嵌图，比较DINOv2、DOFA、CROMA、经典图像测量特征和未训练ViT特征。分类器从专家地貌图学习标签，再预测地理上分离的土卫六区域。逻辑回归设置下，预训练编码器的平均macro-F1高于组合经典特征；但同时改变特征缩放、优化和正则化后，编码器排名会变化。进一步在土卫六数据上训练提高DINOv2表现、降低DOFA表现，CROMA结果混合。由于架构和输入处理不同，比较无法单独隔离预训练的因果作用。研究也指出须考察分类器拟合及单个地形类别表现。

Insight: 地球预训练特征对土卫六SAR地貌有迁移价值，但结论对分类器设定敏感，不能只报告一个总体分数；专家地图部分依据相同SAR观测，因此测量的是与专家解释的一致性，而非独立地面真值准确率。

Abstract: Cassini synthetic aperture radar (SAR) images reveal the dunes, plains, and lake basins of Titan, providing an instance of representations learned from Earth imagery for planetary terrain classification. Cross-domain Evaluation of Earth-to-Titan Transfer Using SAR (CETUS) compares features from DINOv2, DOFA and CROMA with classical image measurements and features from an untrained vision transformer on the U.S. Geological Survey’s Cassini SAR mosaic. The classifiers learn terrain labels from an expert geomorphological map and predict those labels in geographically separate Titan regions. Under logistic regression settings, pretrained encoders achieve higher mean macro F1 than the combined classical features. Encoder rankings change when feature scaling, optimization, and regularization change together. Further training on Titan improves DINOv2 performance, degrades DOFA performance, and leads to mixed results for CROMA under the tested settings. Architectural and input processing differences prevent these comparisons from isolating the effect of pretraining. Classifier fitting and performance on individual terrain classes matter when assessing representation transfer for planetary mapping. Since the map draws partly on the same radar observations, the scores measure agreement with expert interpretation.

[26] REViT-v2: Hierarchical Windowed Roto-reflection Equivariant ViT for Equivariant Feature Extraction cs.CV | cs.LGPDF

Sheir A. Zaheer, Jihwan Moon, Chan Y. Park

TL;DR: REViT-v2提出分层窗口化旋转—反射群等变ViT，将窗口组卷积自注意力与层级特征结合，使群等变视觉Transformer可扩展到数百万参数和ImageNet规模数据及常规图像尺寸。

Details

Motivation: 视觉模型若能对旋转和反射变换保持等变，可减少方向变化带来的表示差异；但群等变Transformer需要扩展到大数据集、实用图像尺寸和较大参数规模，仍是工程与架构挑战。

Result: 作者提出基于窗口群卷积自注意力和层级特征架构的旋转—反射群等变ViT（REViT-v2），展示其能够扩展至数百万参数、ImageNet规模数据及实用图像尺寸。摘要未给出精度、计算量或与非等变模型的数值比较；代码与预训练权重公开。

Insight: 窗口化群卷积注意力与层级设计针对等变ViT规模化问题，展示了可在ImageNet规模下训练的可行性。摘要只说明扩展能力，没有量化其在准确率、效率或具体任务上的收益。

Abstract: We propose a scalable roto-reflection-group-equivariant vision transformer based on windowed group-convolutional self-attention and a hierarchical feature architecture. We demonstrate that our approach can be scaled to group-equivariant vision transformers (ViTs) with millions of parameters and large datasets with practically sized images, i.e., ImageNet. The code and pretrained weights for the proposed Hierarchical Windowed Roto-reflection Equivariant ViTs (REViT-v2) are available at https://github.com/kc-ml2/revit.

[27] Unlocking Fine-Grained Perception in CLIP via Structurally-Aware Latent Masked Modeling cs.CVPDF

Juntong Li, Lingwei Dang, Haomin Wu, Ziyan Qiu, Qingxin Xiao

TL;DR: SALM以结构感知潜在掩码建模，无监督地把几何局部先验和CLIP全局语义对齐，不需要图文配对；再利用CLIP浅层的空间能力提出免外部模型的自蒸馏SALM-Self。实验报告可提升密集预测、零样本准确率及MLLM细粒度理解。

Details

Motivation: CLIP擅长全局图文语义对齐，却常缺少密集预测所需的细粒度空间感知。已有方法借用视觉模型几何先验，但局部结构与全局语义难以兼顾，还可能扭曲原有图文嵌入空间。

Result: SALM通过双路径设计整合显式和隐式局部—全局对齐，无需图文配对。双矩阵对齐显式校准样本内空间相关性和激活强度，注入局部几何先验；潜在掩码建模再引导CLIP恢复目标模型中缺失的语义细节，把细粒度结构隐式汇入全局语义空间。基于CLIP浅层已有较强空间观察能力，作者进一步提出SALM-Self自蒸馏，不依赖外部模型。实验显示SALM显著改善密集预测并提升CLIP零样本准确率，增强MLLM细粒度理解；摘要未列具体指标。

Insight: 几何先验不应只在表示端强行融合；先校准空间结构，再通过掩码恢复把细粒度信息接入全局语义，可能更好保留原图文空间。SALM-Self还显示CLIP自身浅层可作为细粒度教师。当前摘要缺少基准和数值，无法量化增益。

Abstract: Vision-Language Models (VLMs) such as CLIP excel in global semantic alignment but often lack fine-grained perceptual capabilities. This hinders dense prediction tasks and bottlenecks the visual potential of Multimodal Large Language Models (MLLMs). Existing research has attempted to enhance CLIP’s visual representations by incorporating geometric priors from vision-centric models. However, these strategies often struggle to achieve deep alignment for both local spatial structures and global semantics, potentially even distorting the original image-text space. To address these limitations, we propose SALM, an unsupervised embedding alignment framework based on structurally-aware latent mask modeling. SALM effectively synergizes local and global alignment via a dual-path design combining explicit and implicit mechanisms, without requiring any image-text pairs. First, we introduce a dual-matrix alignment strategy that explicitly calibrates intra-sample spatial correlations and activation intensities, thereby effectively injecting local geometric priors. Based on this, we further design a latent mask modeling mechanism to guide CLIP to restore the missing semantic details of the target model, thereby implicitly aggregating fine-grained structures into the global semantic space. Furthermore, driven by the empirical observations that CLIP’s shallow features inherently possess strong spatial observational capabilities, we naturally extend SALM to a highly efficient self-distillation paradigm, SALM-Self. This unlocks CLIP’s intrinsic fine-grained potential without relying on any external models. Extensive experiments demonstrate that SALM not only significantly improves performance in dense prediction tasks but also boosts CLIP’s zero-shot accuracy, effectively enhancing the fine-grained understanding capabilities of MLLMs. Project page at https://qzfm.github.io/salm_project_page/.

Tao Zhou, Ying Hu, Huazhu Fu, Yi Zhou, Xiao-Jun Wu

TL;DR: AM²ES面向病理全切片图像与转录组的生存预测，用可学习语义锚点建立跨模态对齐，再以层级MoE先在倍率内筛选肿瘤区域、再跨倍率动态路由，提供患者级尺度选择及分子通路相关的可视解释。

Details

Motivation: 病理与转录组特征直接投影到共享潜空间但无显式对齐，可能混合不匹配的形态线索与分子信号；全切片空间异质性极大，统一融合所有组织尺度也难以按患者突出临床相关区域。

Result: AMF模块引入可学习语义锚点作为跨模态中介，对转录组特征与多尺度病理表示进行结构正则化对齐。随后H-MoE模仿病理诊断流程，先在每个放大倍率内筛选显著肿瘤区域，再跨尺度层级路由动态加权、选择信息量最高的分辨率。多个TCGA癌症队列实验中，AM²ES达到最先进生存预测表现；通过可视化不同尺度专家路由，还提供分子通路如何驱动决策的细粒度解释。摘要未给定量数值。

Insight: 可学习锚点把转录组—形态对齐与尺度选择解耦，层级MoE再模拟病理专家从局部组织到尺度间的分析过程。模型兼具预测与路由解释，但摘要没有列各癌种、评估指标及提升幅度。

Abstract: The integrative analysis of histopathological Whole-Slide Images (WSIs) and transcriptomic profiles holds significant promise for cancer survival prediction. However, existing methods typically project multi-modal features directly into a shared latent space without explicit alignment, leading to the entanglement of mismatched morphological cues and molecular signals. Furthermore, current fusion strategies often treat the extreme spatial heterogeneity of WSIs uniformly, lacking mechanisms to adaptively prioritize clinically relevant tissue scales for individual patients. To address these limitations, we propose an Anchor-driven Multi-modal Multi-scale Expert Selection (AM$^2$ES) framework for survival prediction. Specifically, we present an Anchor-driven Multi-modal Fusion (AMF) module, which introduces learnable semantic anchors as cross-modal mediators to bridge the semantic gap by enforcing a structurally regularized alignment between transcriptomic features and multi-scale pathology representations. Built upon this aligned semantic space, we further design a Hierarchical Mixture-of-Experts (H-MoE) selection module to decouple the hierarchical prognostic selection process. Mimicking the pathologist’s diagnostic workflow, H-MoE performs (i) Intra-scale Expert Filtering to discriminatively identify salient tumor regions within each magnification, and (ii) Inter-scale Hierarchy Routing to dynamically weight and select the most informative resolution levels. Extensive experiments on multiple TCGA cancer cohorts demonstrate that our AM$^2$ES achieves state-of-the-art performance while offering fine-grained interpretability by visualizing how specific molecular pathways drive the expert routing decisions across tissue scales. The code will be released at https://github.com/taozh2017/AM2ES.

[29] PhysLDM: Latent Diffusion for High-Fidelity Deformable Simulation cs.CV | cs.GRPDF

Yu Zhang, Xudong Xu, Xingang Pan

TL;DR: PhysLDM提出用于可变形体积网格模拟的一次性时空潜扩散框架：整体时空VAE在最高78倍token压缩下，对米级场景达到约2.48毫米重建精度；作者发现混沌形变中确定性回归易产生非物理平均，扩散更适合建模轨迹分布。

Details

Motivation: 高分辨率3D体积网格的长时程可变形模拟很困难：自回归方法易累计误差，原生分辨率多帧预测计算昂贵。 mesh体积物理中的紧凑时空潜表示研究较少，而确定性回归与生成式扩散哪种更合适也不明确。

Result: PhysLDM采用整体时空VAE，避免常见视频VAE时间压缩产生的阶梯伪影，在米级场景实现约2.48毫米重建精度，token最高压缩78倍。系统比较回归和扩散后发现，复杂可变形动力学常表现混沌；确定性回归趋向非物理平均，扩散更能建模其分布，因此采用潜扩散生成物理可信轨迹。仅用Objaverse规模数据的运动学训练，单一模型可零样本泛化到未见OOD数据集GSO和Toys4K。模型可微，还支持高效逆问题求解和高阶设计优化。

Insight: 对混沌可变形动力学，目标应是建模可能轨迹分布而非回归单一平均轨迹；可靠的时空潜空间使扩散生成既可扩展也可微。零样本泛化基于两个未见数据集，摘要未给物理保真误差或逆问题优化成本的详细数值。

Abstract: Neural simulation of high-fidelity deformable bodies is a foundational challenge in computer graphics and physical AI. Long-horizon prediction for high-resolution 3D volumetric meshes is hard: autoregressive methods are susceptible to error accumulation, while direct multi-frame prediction at native resolution is computationally prohibitive. This motivates a compact spatiotemporal latent representation, which is largely unexplored for mesh-based volumetric physics. Meanwhile, it remains unclear whether deterministic regression or generative diffusion is the more appropriate predictive paradigm. To address these coupled challenges, we introduce PhysLDM, a unified latent-diffusion paradigm for one-shot volumetric deformable simulation. Its core is a holistic spatiotemporal VAE that avoids the “staircase” artifacts of standard temporal compression (as in common video VAEs), achieving ~2.48 mm reconstruction precision on meter-scale scenes at up to 78x token compression. Based on this reliable latent space, we systematically compare regression and diffusion methods. Our experiments uncover a key modeling insight: complex deformable dynamics are often chaotic, and in this regime deterministic regression tends to produce non-physical averages, whereas diffusion better models their distribution. Accordingly, we employ a latent diffusion model that effectively learns from the chaotic data to generate physically plausible trajectories. Trained purely kinematically on an Objaverse-scale dataset, a single PhysLDM generalizes zero-shot to unseen OOD datasets (GSO and Toys4K). Its differentiability further enables efficient solution of inverse problems and higher-order design optimization. To our knowledge, PhysLDM is the first high-fidelity spatiotemporal autoencoder and latent-diffusion paradigm for volumetric deformable dynamics, offering a scalable and robust approach to neural simulation.

[30] What Frame-Level Labels Can and Cannot Do for Small-UAV Point Detection in Thermal Video cs.CV | cs.AIPDF

Wonbin Son, Gyumum Choi, Junil Seo, Hyungjoon Kim

TL;DR: 本文研究仅有逐帧目标存在/缺失标签时，能否定位热红外视频中的小型无人机。冻结分类得到的空间特征后用同类帧标签训练读出器，可生成空间分数图和点检测；两数据集实验发现标签分散到更多视频更利于定位，但定位命中率提升并不必然提高受误报约束的检测率。

Details

Motivation: 传感器或场景变化时，为增加训练数据获取空间标注成本较高，逐帧目标有无标签更容易获得。作者分析已有点检测架构能否仅通过这类弱标签学习小型UAV定位，并研究适用边界和潜在应用。

Result: 系统冻结由分类任务学到的空间特征，再以相同的帧级存在/缺失标签训练读出器，输出空间分数图和点检测，不需外部检测器。研究在CST Anti-UAV与Anti-UAV410两个热红外数据集上评估定位命中率及误报约束下的检测率，并分析训练阶段、标签分配、合成数据和模型配置，也与框检测器比较；另探索在可见光AOT图像上的使用。分类训练增强目标相关空间响应，读出训练帮助稳定提取；类似数量标签分散到更多视频会提高定位命中率，合成数据效果随数据集和指标变化。弱目标信号相对背景变化、跨数据集迁移时仍会失败。

Insight: 弱帧标签可以训练空间定位，但评价时须同时报告定位命中率和指定误报约束下的检测表现；二者并不等价。将标注预算分散到更多视频可能比集中在少数视频更有效，目标背景对比度和跨域变化则是主要限制。

Abstract: The growing use of unmanned aerial vehicles (UAVs) has increased the importance of image-based UAV detection. Learning-based detectors are trained on imagery and annotations, with annotation type determining the information available during training. We focus on learning localization from frame-level target presence/absence labels when sensor or scene changes make spatial annotations for additional training burdensome. We analyze the detection capability, learning behavior, and potential applications of an existing architecture for point detection of small UAVs, trained with presence/absence labels and requiring no external detector. The architecture freezes spatial features learned through classification and trains a readout with the same frame labels to produce spatial score maps and point detections. On two thermal infrared datasets, CST Anti-UAV and Anti-UAV410, we evaluate localization hit rates and detection rates under false-alarm constraints, analyze the effects of training stages, label allocation, synthesis, and model configuration, and compare with bounding-box detectors. We also explore potential applications on Airborne Object Tracking (AOT) using its visible-light imagery and frame labels. Classification training strengthened target-related spatial responses, while readout training helped extract them consistently. Distributing similar label counts across more videos yielded higher localization hit rates, while synthesis effects varied by dataset and evaluation criterion. Higher localization hit rates did not always improve detection under false-alarm constraints, and failures remained when target signals were weak relative to background variation and under cross-dataset transfer. These findings provide guidance on label allocation, spatial representations and readouts, synthesis, and false-alarm control.

[31] Structure-aware Keypoint Localization for Videofluoroscopic Swallowing Study cs.CVPDF

Kai Zhou, Chuanshen Chen, Runhao Zeng, Meng Dai, Yifan Yang

TL;DR: VFSSKep扩展吞咽造影关键点数据集，增加软腭标注和大量未标注数据，并提出结构感知半监督框架S³KL，通过高分辨率结构线索和块打乱后的结构一致性学习缓解固定布局X射线中的绝对坐标偏置。仅用未标注数据和25%有标注数据时，表现超过使用100%标注数据的全监督方案。

Details

Motivation: 吞咽造影（VFSS）运动学分析依赖精准解剖关键点，但既有研究覆盖点位有限，常忽略软腭，也只标注主动吞咽片段，浪费大量非吞咽数据。标准半监督方法容易在固定布局X射线上记忆绝对坐标，而非识别解剖结构。

Result: 作者构建VFSSKep，扩展软腭关键点标注并加入大规模未标注数据；提出S³KL结构感知半监督定位框架。Structure-Aware Learning提取高分辨率结构线索以学习结构表示；Structural Representation Consistency Learning通过块打乱迫使模型学习不变结构识别。实验称其达到最先进半监督性能；仅使用未标注数据和25%有标注数据，结果也超过使用100%标注数据的全监督学习。摘要未给出具体误差值。

Insight: 固定成像布局可能使模型依赖关键点的绝对坐标，块打乱一致性约束可促使模型利用解剖结构。新增软腭和非活动片段数据提高了样本利用率；25%标注优于全监督的具体对照方法和关键点误差仍需查看论文详情。

Abstract: Videofluoroscopic Swallowing Study (VFSS) is one of the gold standard for diagnosing swallowing disorders, providing dynamic X-ray imaging of the swallowing process. Automated kinematic analysis in VFSS relies fundamentally on precise anatomical keypoint localization. However, existing studies focus on limited keypoints (e.g., cervical vertebrae or the hyoid) and overlook critical regions such as the soft palate, while annotating only active swallowing segments and ignoring abundant non-swallowing data, resulting in poor data efficiency. Moreover, leveraging this unlabeled data via standard semi-supervised learning is suboptimal, as generic methods are prone to spatial bias. In medical X-rays with fixed layouts, models tend to memorize absolute coordinates rather than understanding anatomical structures. To tackle these challenges, we introduce VFSSKep, a novel dataset that extends annotations to the soft palate and incorporates large-scale unlabeled data. We further propose S$^3$KL, a Structure-aware Semi-Supervised Keypoint Localization framework designed to overcome spatial bias. It integrates a Structure-Aware Learning strategy to extract high-resolution structural cues for structure-aware representation learning, and a Structural Representation Consistency Learning strategy with block shuffling to enforce invariant structural recognition. Experiments show our method achieves state-of-the-art semi-supervised performance, even with unlabeled and 25% labeled data surpassing fully supervised learning with 100% labeled data. Code and data will be made publicly available at: https://github.com/kaai520/S3KL.

[32] Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs cs.CVPDF

Donghyun Han, Jangho Park, Yuseok Bae

TL;DR: Foveated Compression在固定视觉token预算下混用原生分辨率与压缩分辨率区域：先对全图编码一次，再压缩局部token并选择一个九宫格区域保留原分辨率。极低预算时与等token下采样无显著差异；预算20.99%时学习选择胜过随机/固定分配，但仍不如整图缩放。

Details

Motivation: 视觉token是VLM推理成本的重要来源，简单整图下采样却是强压缩基线。作者研究固定token预算下应把高分辨率保真度保留在哪些区域，局部保真是否普遍优于整图缩放。

Result: 全分辨率图像只编码一次，表示由原生与压缩分辨率视觉token混合构成。经行为自蒸馏的Foveated Merger压缩局部token并保持与原生表示兼容；轻量Foveated Selector通过预算匹配的干预监督，从九个空间区域中选一个保留原分辨率。token预算11.11%时，均匀Foveated Compression与等token下采样无显著配对差异；预算20.99%时，学习选择显著优于随机和固定分配，但仍落后于强整图缩放。相同空间动作下的区域选择oracle宏平均准确率82.73%，学习选择69.61，说明仍有较大空间。研究还发现判断压缩是否会破坏答案的信号，在语言模型计算后比轻量、无prefill选择器更易获取。

Insight: 局部高分辨率并非天然优于整图缩放；性能同时受选区决策和被压缩区域的信息保真度限制。oracle与学习选择差距表明区域选择可改进，但判断最佳区域需要比当前轻量选择器更强的视觉/语言推理。

Abstract: Visual tokens are a major source of inference cost in vision-language models, yet simple image downsampling remains a surprisingly strong compression baseline. This raises a complementary question: under a fixed token budget, where should visual fidelity be preserved? We introduce Foveated Compression, which encodes a full-resolution image once and represents it with a mixture of native- and compressed-resolution visual tokens. A behaviorally self-distilled Foveated Merger compresses local visual tokens while preserving compatibility with their native counterparts, and a lightweight Foveated Selector chooses one of nine spatial cells to retain at native resolution using exhaustive budget-matched intervention supervision. At 11.11% visual tokens, uniform Foveated Compression shows no significant paired difference from iso-token downsampling. At 20.99%, the learned selector significantly outperforms random and fixed allocation, but remains below strong whole-image resizing, showing that localized fidelity is not universally preferable. A budget-matched region-choice oracle reaches 82.73 macro accuracy versus 69.61 for the learned selector, revealing substantial headroom within the same spatial action space. Matched probing further shows that signals predicting when compression breaks the answer are substantially more accessible after language-model computation than to the lightweight prefill-free selector. These results expose complementary bottlenecks in region selection and compressed-region fidelity.

[33] Later Is Better: Token Reduction for ViTs Under Distribution Shift cs.CV | cs.AIPDF

Hyeongheon Cha, Hyungjun Yoon, Sung-Ju Lee

TL;DR: 本文提出ViT token删减的晚期集中幂律调度，训练免费且不增加推理开销。ImageNet-C上的DeiT-S在计算量降低26%时弥补压缩精度差距的83%（提升1.17个百分点），降低7%计算量时弥补99%（提升0.26个百分点）；收益跨多方法、骨干、数据偏移和视频/VQA任务。

Details

Motivation: 免训练token删减可在降低计算的同时恢复大部分原始精度，但方法主要在干净数据上设计，真实分布偏移下删减越多，与未压缩模型的精度差距越大。作者指出影响这一差距的因素不仅是删减量，还有通常被固定为实现细节的深度调度。

Result: 提出单参数晚期集中幂律删减方案，相比平坦删减调度可在无额外推理成本下持续改善OOD准确率。DeiT-S在ImageNet-C上，计算减少26%时弥补未压缩模型与压缩模型精度差距的83%，提高1.17个百分点；计算减少7%时弥补99%，提高0.26个百分点。即使固定为平坦调度的计算预算，晚期调度仍删除更多token、末端保留更少token却表现更好。效果覆盖ToMe、EViT、ATS、ATC、PiToMe五种方法、九种骨干、全部ImageNet-C损坏类型、另八个偏移套件及视频和视觉语言问答；六种测试时适配下也保持收益，严重度最高时增益约为清洁数据的4倍，无需逐输入/域调参。

Insight: 尽可能晚删token，能减少早期特征扰动在后续多层传播造成的误差；收益并非来自保留更多token或增加计算。该调度提供简单、免训练的分布偏移稳健性改进，但具体增益仍随删减比例、数据偏移和骨干而变化。

Abstract: Training-free token reduction accelerates vision transformers by removing redundant tokens across layers, recovering most of the original accuracy at a fraction of the compute. These methods, however, are designed and evaluated primarily on clean data, and under real-world distribution shift their accuracy gap to the uncompressed model widens with the removal rate. We show that this gap is governed by the reduction schedule, the depth profile of removal, usually left fixed as an implementation detail. Concretely, we introduce a one-parameter late-concentrated power-law schedule that consistently improves out-of-distribution accuracy over flat at no extra inference cost. On ImageNet-C with DeiT-S, the late schedule closes 83% of that gap at a 26% compute reduction (+1.17pp), and 99% of it at a lighter 7% reduction (+0.26pp). The gain cannot be attributed to retaining more tokens or using extra compute: held to flat’s compute, the late schedule removes more tokens in total and leaves fewer tokens at the end, yet still wins. Single-layer probes point to a mechanism: earlier reductions perturb features that pass through more remaining layers, front-loading reduction error in depth. The effect is broad, holding across five token-reduction methods (ToMe, EViT, ATS, ATC, PiToMe), nine backbones, all ImageNet-C corruption types, eight further shift suites, and two further modalities, video and vision-language QA. It is also specific to shift, still positive on clean and rising monotonically to ~4x that at the highest severity 5. The schedule keeps its gain under six test-time adaptation methods, and needs no per-input or per-domain tuning.

[34] Image-Space Refraction Correction for Underwater 3D Reconstruction: Warping Flat-Port Views into Pinhole Perspective cs.CVPDF

Chelim Lim, Tobias Fischer, Emilio Olivastri, Beverley Gorry, Michael Milford

TL;DR: 本文提出平面端口水下折射的图像空间物理校正，将水下相机图像扭曲到针孔透视后再交给任意SfM/SLAM后端。两个真实数据集上，校正去除了重建形变、注册更多帧并保持较低重投影误差，且可迁移至多种重建与VSLAM后端。

Details

Motivation: 平面端口防水壳中的消费级相机成本低、易获取，常用于珊瑚礁和海底制图，但端口折射会使重建场景和相机轨迹产生碗状畸变，损害制图与导航所需的度量精度。

Result: 方法在重建前于图像空间实施基于物理的折射校正，目标是消除主要折射畸变；校正后图像可直接输入现有重建和SLAM算法，无需特定后端改造。作者通过光线追踪模拟分析折射失真，并在两个场景结构不同的真实水下数据集上验证。与传统及折射式SfM相比，该方法消除重建形变、注册更多帧并维持较低重投影误差；在不同重建和VSLAM后端上也能泛化。摘要未报告具体数值。

Insight: 把折射校正前置到图像空间，让现有SfM和VSLAM流水线无需专用改写即可受益；跨场景和后端验证支持其通用性。摘要未列具体畸变减少幅度、标定要求或深度范围，需结合完整实验评估。

Abstract: Consumer-grade cameras in flat-port housings are widely used for underwater exploration and mapping of coral reefs and seafloor habitats due to their low cost and accessibility. However, refraction at flat-port interfaces causes bowl-shaped deformation in reconstructed scenes and camera trajectories, compromising the metric accuracy required for mapping and navigation. To remove the dominant refractive distortion before reconstruction, we introduce a physics-based refraction correction in image space. Our method is downstream-agnostic: the refraction-corrected images can be directly used as input to existing reconstruction and SLAM algorithms. We characterize the refractive distortion through ray-tracing simulations and validate our correction on two real underwater datasets with differing scene structures. Compared with conventional and refractive Structure-from-Motion (SfM), our approach removes reconstruction deformation while registering more frames and maintaining low reprojection error. The correction further generalizes across diverse reconstruction and VSLAM backends, demonstrating its broad applicability to downstream vision pipelines.

[35] From Laboratory to Road: Evaluating Wearable Gaze Accuracy for Driving cs.CVPDF

William Engel, Fabian Flohr

TL;DR: 本文量化真实道路驾驶中可穿戴眼动仪的注视定位误差：41个经验证场景里，驾驶员注视车牌时平均角度误差为4.58°；用室内记录估计偏移校正后降至1.10°，且41个场景均改善，说明偏移随会话变化，BEV监督需在线校准与条件化不确定性估计。

Details

Motivation: 自动驾驶BEV表示记录场景里有什么，却不代表什么对人类驾驶员行为相关；注视可补足这一点。但可穿戴眼动仪输出常被当作真值，实际却受头部运动、照明和校准漂移影响。

Result: 作者提出真实驾驶条件下量化可穿戴眼动准确性的统一框架。道路研究包含41个经验证场景，驾驶员注视车辆牌照；以牌照中心与眼镜估计视线方向的角距离定义误差。另在同一驾驶员、同一设备下做室内实验，分别研究距离、照明、头部运动、目标运动和偏心注视对系统偏差与精度的影响。道路平均误差为4.58°；应用室内记录估计的偏移后降至1.10°，41个场景全部改善。偏移会话间变化。

Insight: 可穿戴眼动数据不能未经校准就作为驾驶行为真值；静态/室内偏移虽能改善当前道路样本，但会话变化意味着实际BEV监督可能需要在线重新校准和按条件估计视线不确定性。研究仅涉及一名驾驶员和41个场景。

Abstract: Bird’s-eye-view (BEV) representations have become a widely used interface between perception and planning in autonomous driving, but they encode what is in a scene, not what is behaviorally relevant to a human driver. Gaze offers a compelling behavioral signal for this gap, yet wearable eye trackers are routinely deployed as if their spatial output were ground truth, despite known sensitivity to head motion, illumination, and calibration drift. We present, to our knowledge, the first unified framework for quantifying wearable gaze accuracy under real driving conditions. Our on-road study contains 41 validated scenes in which one driver fixated a vehicle’s license plate. Gaze error is measured as the angular difference between the plate center and the gaze direction estimated by the glasses. Separate indoor studies with the same driver and device systematically analyze how distance, illumination, head motion, target motion, and gaze eccentricity affect both systematic bias and gaze precision. The mean on-road error was 4.58 degrees. Applying an offset estimated from the indoor recordings reduced it to 1.10 degrees and improved all 41 scenes. Because this offset varied between sessions, reliable BEV supervision may require online recalibration and condition-dependent estimates of gaze uncertainty.

[36] CueRator: Agentic Search for Symbolic Rules to Adapt Frozen Multimodal Encoders cs.CVPDF

Sunchan Park, Beomkwon Cho, Kyeongbo Kong

TL;DR: CueRator用智能体离线搜索符号决策规则，再配合轻量策略按视频自适应规则参数，以适配冻结的对比多模态编码器。在OV-AVEBench总平均从57.8升至60.2、未见类别从55.8升至59.9，并把已见—未见差距从7.1缩至1.2。

Details

Motivation: 开放词汇音视频事件感知需要在适应性与未见类别泛化之间权衡：训练模块更能适配却可能损害泛化，固定规则相反。作者提出搜索一个兼顾可泛化形式与视频级自适应的决策规则，同时保持多模态编码器冻结。

Result: CueRator让智能体搜索将跨模态相似度转换为预测的符号决策规则，规则形式强调泛化，轻量策略则针对每段视频预测其参数以实现适应。报告引导的多智能体循环离线发现候选，并同时评估其表达上限和训练策略是否能实现。OV-AVEBench总平均由最佳既有方法57.8升至60.2，未见类别表现55.8升至59.9，已见—未见差距由7.1降至1.2。消融显示规则形式和策略均有贡献，两种反馈都不可缺少。另两个音视频任务也优于相应基线；跨编码器时只需重训策略，发现的规则仍有竞争力。

Insight: 把可泛化的符号结构搜索与按输入自适应参数分开，有望同时保留规则迁移性和视频级灵活性。消融支持两部分及两类反馈的必要性；摘要未给另两个任务的具体分数与搜索成本。

Abstract: Large language model agents have been used to search over symbolic structures such as programs and equations. We propose CueRator, an agentic framework for policy-aware decision-rule discovery, which adapts frozen contrastive multimodal encoders by searching for the decision rule that converts their cross-modal similarities into predictions. We validate it on open-vocabulary audio-visual event perception, where existing methods involve a trade-off between adaptivity and generalization to unseen categories: trained modules adapt at the cost of generalization, and fixed rules the reverse. The framework pairs a symbolic formulation for generalization with a lightweight policy that predicts its parameters per video for adaptivity. A report-guided multi-agent loop discovers the formulation offline, evaluating each candidate on its expressive ceiling and on whether a trained policy can realize it. On OV-AVEBench, CueRator raises the total average from 57.8 to 60.2 and unseen-category performance from 55.8 to 59.9 over the best existing method, reducing the seen-unseen gap from 7.1 to 1.2. Ablations attribute the gains to both the formulation and the policy and show that both feedback signals are necessary for effective search. CueRator also improves over the respective baselines on two further audio-visual event perception tasks, and the discovered rule remains competitive across encoders with only the policy retrained. Code is available at https://github.com/cvsp-lab/cuerator.

[37] Efficient Gaussian Splatting Sequence Compression with Standard Video Codecs cs.CVPDF

Qi Yang, Shuting Xia, Le Yang, Geert Van Der Auwera, Zhu Li

TL;DR: GSCV提出不依赖追踪高斯信息的3D Gaussian Splatting序列视频编解码压缩。其Inter-PLAS改善I/P帧间相似度，配合高位深GS图像和现代视频编码器提升可压缩性及质量上界；实验称其优于MPEG视频与点云压缩锚点。

Details

Motivation: 现有基于视频的GS序列压缩通常依赖PLAS排序和追踪基元信息将高斯转成平滑2D视频，但多数应用没有追踪信息；直接使用随机性的原始PLAS会造成帧间相关性弱，降低视频编码效率。

Result: GSCV提出简单高效的Inter-PLAS，使GS的I帧与P帧图像更接近，增强标准视频编解码器利用帧间预测的能力。系统还构建基于先进视频编解码器的新流水线，使用高位深GS图像以获得更高压缩率和更高质量上界。实验中GSCV明显优于MPEG视频和点云压缩对照方法；摘要未给具体压缩率或失真指标。

Insight: 把GS序列编码为帧间相似的2D图像序列，能借用成熟视频编解码器，但排序需稳定且不应依赖多数应用缺失的追踪信息。摘要报告定性胜出，无法量化压缩率—质量折中。

Abstract: This paper presents a novel effective Gaussian Splatting (GS) sequence Compression method that utilizes the Video codec (GSCV). Existing video-based GS sequence compression relies on the Parallel Linear Assignment Sorting (PLAS) and tracked primitive information to convert GS into smooth 2D videos. However, tracked information is not available for most practical applications, and without it, using the vanilla PLAS can generate images exhibiting weak inter-frame correlation, due to its stochastic nature. GSCV incorporates a simple yet efficient Inter-PLAS method to produce close images between the I- and P-frames of GS, enhancing the inter-frame performance of video codec greatly. GSCV also realizes a new pipeline based on the state-of-the-art video codecs with high bit-depth GS images, achieving higher compressibility while simultaneously providing a higher quality upper bound. Experimental results show that the proposed GSCV exhibits obviously improved performance over MPEG video and point cloud-based anchors in GS sequence compression. The code is available at https://github.com/Qi-Yangsjtu/GSCV.

[38] Revar3r: gauge-aware perturbation uncertainty for feed-forward 3d reconstruction cs.CVPDF

Sammam Mahdi, Fariha Binta Salim, Rakin Bin Rabbani, Aniqua Nusrat Zereen

TL;DR: ReVar3R指出，冻结3D重建模型输出的微小坐标系旋转会让远处点产生与误差无关、随场景尺度增长的扰动方差。它先把多次预测配准到共同相似变换坐标系再估逐点方差；跨VGGT、π3、MASt3R和六个数据集，在18种条件中15种AUSE优于内建置信度。

Details

Motivation: 免训练扰动不确定性常把模型对等价输入的输出差异视为误差，但若输出存在未观测对称性，微小坐标系变化也会产生跨运行波动。内建置信度、监督式证据头等方案各有局限，需一种不依赖模型特定训练标签的可迁移估计器。

Result: 对于点图，作者推导出一个与重建误差无关、随场景范围增大的方差项；仿真复现该效应，30组真实VGGT视图均呈现预测的点坐标平方范数特征。ReVar3R在计算逐点方差前将预测鲁棒配准至共同相似坐标系，无需重训或改冻结模型；可选校准/融合使用留出集。VGGT、π3、MASt3R在六个数据集上用同一估计器时，18种条件中15种AUSE低于内建置信度；分阶段结果分别为无标签核心11/18、等权融合12/18、留出权重14/18，加入内建信号15/18优于对应条件。相较监督证据头，这是权衡：后者在训练域校准幅度更好，ReVar3R跨骨干迁移无需适配。排序可改善点过滤，但不检测稳定系统偏差，也不改善新视角合成或跨域校准。

Insight: 不确定性估计需先消除输出坐标系的规范自由度，否则远处点的方差可能反映对称性而非重建错误。ReVar3R的优势是免训练跨骨干迁移，限制是无法发现稳定系统偏差、改善合成或转移校准。

Abstract: A correctly reconstructed distant point appears uncertain even when a frozen 3D model processes equivalent inputs because its output frame rotates fractionally. This exposes a weakness of trainingfree perturbation uncertainty: when outputs contain an unobserved symmetry, run-to-run variation potentially reflects symmetry rather than error. Existing alternatives have trade-offs: built-in confidence is outperformed in most evaluated conditions, while trained evidential heads require modelspecific supervision. For point maps, this research derives a closed-form, error-independent variance term that grows with scene extent and potentially overwhelms the desired signal. Simulation reproduces the effect; all 30 real VGGT view-sets tested exhibit its predicted $|x_p|^2$ signature. ReVar3R robustly registers predictions to a common similarity frame before computing per-point variance, without retraining or modifying the frozen model. Optional calibration and fusion use a held-out split. Across VGGT, π3, and MASt3R on six datasets, the same estimator on every backbone lowers AUSE below built-in confidence in 15 of 18 conditions. The staged evaluation yields 11 of 18 wins for the label-free core, 12/18 for label-free equal-weight fusion, 14/18 with held-out weights, and 15/18 when the built-in signal is included. Against a trained evidential head, the result is a trade-off: the head calibrates magnitude better and leads in its training domain, whereas ReVar3R transfers across backbones without adaptation. Its ranking improves point filtering, but it does not detect stable systematic bias, aid novel-view synthesis, or transfer calibration across domains.

[39] Unsupervised Long-Tailed Adaptation of Vision-Language Models cs.CVPDF

Keliang Chen, Yaxin Hou, Hui Liu, Yuheng Jia

TL;DR: 本文定义无监督长尾适配（ULTA），发现长尾未标注分布下反而可能首先损害头部类别边界，并把头部样本推向混淆类别。MARS用零样本VLM作固定视觉参照保边界，再以边际感知自精炼调整尾部和混淆类；九个基准上平均准确率提高4.71个百分点。

Details

Motivation: 视觉语言模型常用无标签数据生成伪标签适配下游任务，但现有方法多假设未标注数据均匀分布；真实数据常呈长尾，伪标签分布因此不匹配。无监督长尾下的性能损失模式也可能不同于监督长尾学习。

Result: 作者形式化提出ULTA，观察到既有方法出现头部类别性能骤降，这与监督长尾学习主要损害尾部类不同。分析发现分布不匹配侵蚀头类决策边界，并把头类样本推入易混淆类别，从而强化模型偏差。MARS（Margin-Aware Refinement with Structural alignment）用Boundary-Preserving Alignment把零样本VLM作为固定视觉参考，抑制训练目标中缺乏视觉支持的概率上升；再用动态Margin-aware Self-Refinement细化尾部及混淆类，同时避免预测偏置。九个基准上，MARS平均准确率比SOTA提高4.71个百分点。

Insight: 无监督长尾适配不能只着眼提升尾类，伪标签分布还可能反向侵蚀头类边界；零样本视觉模型作参照可限制无视觉依据的决策漂移。4.71个百分点是九个基准的平均准确率改善，具体类别收益仍应分布查看。

Abstract: Adapting vision-language models to downstream tasks has achieved remarkable success by leveraging pseudo-labels generated from unlabeled data. Existing methods typically assume a uniform unlabeled data distribution, and thus the resulting pseudo-label distribution is likewise uniform. However, real-world data distributions are often long-tailed. To tackle this, we formalize a new scenario termed Unsupervised Long-Tailed Adaptation (ULTA). Under this scenario, existing methods exhibit a contrasting phenomenon: head-class performance drops sharply, which is distinct from supervised long-tailed learning where tail classes suffer the most. In particular, we uncover that the distributional mismatch not only erodes head-class boundaries, but also pushes head samples into confusable classes, reinforcing the model’s inherent bias. To address these issues, we propose a novel model called Margin-Aware Refinement with Structural alignment (MARS). Specifically, we mitigate head-class boundary erosion via Boundary-Preserving Alignment, which takes the zero-shot VLM as a fixed visual reference to suppress probability increases that lack visual support in the training targets. Building upon this, we introduce Margin-aware Self-Refinement, which employs a dynamic adjustment strategy to refine tail and confusable classes while preventing prediction bias. Extensive experiments on nine benchmark datasets demonstrate that MARS outperforms state-of-the-art methods, achieving an average accuracy improvement of 4.71 percentage points.

[40] Diverse Motion Customization via Control-based Dynamic Optimization cs.CV | cs.AIPDF

Youngyoon Choi, Kihyun Kim, Jeongwoo Shin, Joonseok Lee

TL;DR: CMC用随机最优控制优化视频生成中的动作定制，目标是跟随参考运动但不复制参考视频外观，从而减轻内容泄露。其时间步自适应运动成本只在早期生成阶段关注运动，并去除显式奖励，使训练加速2.5倍，同时保持有竞争力的运动保真度和基础模型多样性。

Details

Motivation: 视频生成的动作定制容易将参考视频中的外观属性意外带入输出，即内容泄露。作者将其归因于对参考视频直接回归造成的生成过程坍缩，并希望让模型遵循目标运动但外观仍由文字提示和基础模型分布决定。

Result: Control-based Motion Customization（CMC）在随机最优控制框架下引导生成动态朝目标运动，同时让定制视频保留在预训练模型的提示条件分布内，外观由文本提示决定而非参考视频。为提高效率，作者针对运动定制去除显式奖励，并设计时间步自适应运动成本，只关注生成早期阶段，使训练加速2.5倍。多场景实验显示，CMC有效缓解内容泄露，在保持基础模型多样性的同时实现有竞争力的运动保真度；摘要未提供具体质量分数。

Insight: 对运动目标的监督应避免直接回归参考外观，随机最优控制提供把运动引导和文本条件外观分开的形式化方式。只在早期时间步施加自适应运动成本降低训练开销，但摘要未说明不同运动类型下的量化折中。

Abstract: Despite recent advances in video generation, motion customization remains challenging due to content leakage, where appearance attributes from the reference video unintentionally propagate into the generated output. We identify this issue as a consequence of the generative process collapsing toward the reference video, which arises from formulating the learning objective as a direct regression on the reference. To address this, we propose Control-based Motion Customization (CMC), a principled training framework that is structurally robust to content leakage. Our key idea is to steer generative dynamics toward desired motion while avoiding collapse toward the reference video, which we formalize using Stochastic Optimal Control (SOC). Under this formulation, customized videos acquire the target motion yet remain within the pre-trained model’s prompt-conditional distribution, where appearance is determined by the text prompt rather than the reference video. Furthermore, to improve efficiency, we tailor the SOC formulation to motion customization by eliminating the need for an explicit reward and introducing a timestep-adaptive motion cost that focuses only on early generative stages, accelerating training by 2.5 times. Extensive experiments demonstrate that CMC effectively mitigates content leakage and achieves competitive motion fidelity while preserving the diversity of the base model across diverse scenarios.

[41] TF-PRVR: Training-Free Partially Relevant Video Retrieval cs.CVPDF

Giyeol Kim, Chanho Eom

TL;DR: TF-PRVR是免训练的部分相关视频检索框架，用冻结视觉语言特征形成视频专属层级片段，再基于多尺度图传播文本查询相关性并聚合时间对齐证据，以避免固定分段造成语义稀释和任务训练引起的源域过拟合。

Details

Motivation: 部分相关视频检索要从未剪辑视频中找出与文字查询相关的时刻。现有方法常用固定视频切分，导致片段语义被稀释；任务专用训练又可能过拟合源数据集，削弱跨数据集泛化。

Result: TF-PRVR利用冻结视觉语言特征，从逐帧特征提取时间语义信号，并通过频域多尺度分析自动确定时间边界，形成事件语义连贯的层级片段。随后建立统一多尺度图，在时间和语义相关节点间传播查询相关性；面向片段的评分策略跨尺度聚合时间对齐证据，强调多尺度持续支持的时刻并抑制孤立误响应。无需任务专用训练，因此保留预训练VLM通用对齐能力。多种视觉和时间特性的数据集实验显示表现一致；摘要未提供具体指标。

Insight: 自适应边界和层级语义表示可避免固定切分的语义稀释；多尺度图传播与一致性聚合则让检索依赖跨节点证据，而非单一局部峰值。摘要报告跨数据集稳定性，但未量化相对基线增益或搜索成本。

Abstract: Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos containing moments relevant to a given text query. Despite recent progress, existing PRVR methods suffer from two key limitations: a fixed video decomposition scheme that causes semantic dilution, and source-domain overfitting induced by task-specific training. In this paper, we propose TF-PRVR, the first training-free framework for PRVR. TF-PRVR leverages frozen vision-language features to construct video-specific hierarchical representations. It derives temporal semantic signals from frame-level features and applies frequency-based multi-scale analysis to identify adaptive temporal boundaries, producing hierarchical segments with coherent event-level semantics. Built on these segments, TF-PRVR constructs a unified multi-scale graph and propagates query relevance across temporally and semantically related nodes. A moment-aware scoring strategy then aggregates temporally aligned relevance across scales, emphasizing consistently supported moments while suppressing isolated false responses. Without task-specific training, TF-PRVR preserves the general-purpose alignment capability of pre-trained vision-language models and avoids dataset-specific overfitting. Extensive experiments demonstrate consistent performance across datasets with diverse visual and temporal characteristics, suggesting a practical direction for training-free PRVR.

[42] Multimodal Knowledge Distillation for Gastric Adenocarcinoma Classification from Whole-Slide Images cs.CV | cs.AIPDF

Shrihari Dumbre, Bikash Santra

TL;DR: 本文提出胃腺癌全切片图像亚型分类的多模态知识蒸馏框架：训练时用低秩融合联合病理图像与诊断文本，教师再把跨模态知识蒸馏给学生，实现仅图像推理。PatchGastric上平均准确率至少比SOTA高3.35%，无需Transformer融合、多任务学习或LLM。

Details

Motivation: 胃腺癌病理亚型分类对治疗规划重要，病理报告文本与全切片图像联合建模可提升分类，但现有多模态方法常依赖高计算成本Transformer和大语言模型。

Result: MKD框架使用预训练切片图像编码器和临床文本编码器，以Low-Rank Multimodal Fusion高效建模训练期跨模态交互。每张全切片表示为patch集合并配对切片级诊断描述；教师模型学习融合图文表征进行亚型分类，学生蒸馏教师知识，以支持准确的仅图像推理。在PatchGastric基准上，平均准确率至少比SOTA方法高3.35%；方法不依赖Transformer融合、多任务学习或LLM。

Insight: 临床文本可在训练期为图像分类提供知识，蒸馏后部署只需图像输入，兼顾多模态监督与简单推理。摘要报告至少3.35%的平均准确率增益，但没有说明具体基线、是否为百分点或各亚型结果。

Abstract: Gastric adenocarcinoma (GA) is a leading cause of cancer-related mortality worldwide, and accurate histopathological subtype classification from whole-slide images (WSIs) is essential for effective treatment planning. While multimodal approaches that integrate pathology report text with WSIs can improve classification, existing methods often depend on computationally expensive transformer architectures and large language models. We propose a multimodal knowledge distillation (MKD) framework that combines a pretrained WSI image encoder and a clinical text encoder using Low-Rank Multimodal Fusion (LMF) to efficiently model cross-modal interactions during training. Each WSI is represented as a bag of patches paired with a slide-level diagnostic caption. The teacher model learns fused image-text representations for subtype classification, while the student model distills this knowledge to enable accurate image-only inference. We evaluate our method on the PatchGastric benchmark dataset and achieve at least 3.35% higher mean accuracy than state-of-the-art approaches, without relying on transformer-based fusion, multi-task learning, or large language models. The source code is available at https://github.com/helomelo1/MKD-LMF.

[43] Dynamic Alignment and Calibration for Multimodal Learning cs.CV | cs.AIPDF

Jinghao Xu, Zhenhua Guo, Xiaofeng Zhu, Xiaoshuang Shi

TL;DR: ACML针对多模态学习中的过度对齐和融合偏置，按置信度动态约束跨模态三元组关系，并依据模态间特征幅度与置信度差异自适应校准注意力正则。在多个基准上，作者报告相较近期SOTA有更好的性能与鲁棒性。

Details

Motivation: 静态跨模态对齐会对所有样本施加统一约束，忽略样本间差异并可能过度对齐；置信度/不确定性融合则常忽略模态间特征幅度差异。当幅度差异大或置信度差异小，仅按置信度严格指定融合权重可能不可靠。

Result: Alignment- and Calibration-driven Multimodal Learning（ACML）包含动态跨模态三元组对齐模块：对高置信正样本对加强语义一致性，对高、低置信正样本对则依据置信度差异鼓励多样表示。差异感知注意力校准策略按模态的特征幅度和置信度差异自适应调整注意力正则，缓解不合理融合约束带来的偏差。多个多模态基准实验显示其性能和鲁棒性持续优于近期SOTA方法；摘要未给具体数值或数据集名称。

Insight: 跨模态对齐和融合强度应按样本及模态差异调节，而不是统一约束；同时考虑表示幅度和置信度可避免仅凭置信值设权造成偏置。摘要只给出定性结果，缺乏提升幅度与消融细节。

Abstract: Dynamic multimodal learning aims to learn robust representations by adaptively modeling information discrepancies across modalities. However, existing methods still suffer from two limitations: (i) static cross-modal alignment strategies usually impose uniform constraints on all samples while overlooking sample-wise variations, potentially leading to unreasonable over-alignment; and (ii) confidence- or uncertainty-aware fusion methods often fail to adequately account for feature magnitude and confidence differences across modalities. For modality pairs with significant feature magnitude differences or small confidence gaps, it might be unreliable to strictly align fusion weights according to confidence. To address these issues, we propose an Alignment- and Calibration-driven Multimodal Learning framework (ACML). Specifically, ACML incorporates a dynamic cross-modal triplet alignment module, which enforces strong semantic consistency for high-confidence positive pairs while encouraging diverse representation learning between high- and low-confidence positive pairs according to their confidence gaps. Additionally, ACML introduces a difference-aware attention calibration strategy that adaptively adjusts attention regularization based on feature magnitude and confidence differences across modalities, thereby mitigating biases caused by unreasonable fusion constraints. Extensive experiments on multiple multimodal benchmark datasets demonstrate that ACML consistently achieves superior performance and robustness over recent state-of-the-art methods.

[44] CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage cs.CVPDF

Baptiste Chopin, Thomas Swearingen, Arun Ross, Antitza Dantcheva, Christian Rathgeb

TL;DR: CCDF是面向真实监控场景的深度伪造视频基准，包含1,840段真实/生成视频、16类犯罪和事故，生成来源包括Grok Imagine、Google VEO 3.1和OpenAI Sora 2，并提供原始、统一元数据和低成本后处理攻击三个版本。十种检测器均难可靠区分新生成视频与真实视频。

Details

Motivation: 现有深伪视频数据集主要使用无害网络内容和较旧/开源生成器，不能反映生成式AI制造恶意监控片段可能造成的应急响应或政治传播风险，也难评估近期商业生成系统带来的威胁。

Result: CCtv DeepFakes（CCDF）含1,840段视频，其中460段真实、1,380段生成，覆盖16类犯罪和事故；生成内容来自Grok Imagine、Google VEO 3.1和OpenAI Sora 2。数据集提供原始版、统一真实/合成元数据以防检测器利用简单线索的清洗版，以及模拟低成本后处理攻击的修改版；所有视频人工标注。作者评估覆盖不同检测方法的十种近期SOTA检测器，发现这些方法虽在既有数据集上报告强性能，却无法可靠区分CCDF生成视频和真实视频。

Insight: 深伪检测器需在内容具有现实危害、使用最新商业生成器且元数据混淆已处理的监控场景测试；现有常用基准可能高估真实威胁下性能。CCDF是小规模人工标注基准，结果适合揭示评测缺口，并不说明所有检测方法都必然失效。

Abstract: Due to rapid advances in Generative AI, commercial video generation tools can be used to produce fabricated surveillance footage that can fool both human viewers and automated synthetic video detectors. Since these tools are so widely accessible, a malicious user can create a harmful video clip at minimal cost. The production and dissemination of such videos in high-stakes settings, such as crime reporting and elections, can misdirect emergency response efforts or distort political discourse. Existing deepfake video datasets, used by the research community to develop deepfake detection algorithms, exhibit two limitations: (1) they emphasize benign web content rather than footage of possibly malicious activity, and (2) they rely on older or open-source generators that do not represent recent advances in generative systems. We assemble CCtv DeepFakes (CCDF), a video deepfake dataset, to address both gaps. CCDF contains 1840 videos (460 real and 1380 generated) spanning 16 crime and accident categories, with generated content produced using three leading commercial systems: Grok Imagine, Google VEO 3.1, and OpenAI Sora 2. CCDF is a highly realistic, small-scale, manually annotated dataset targeting evaluation of detection models. We release three versions of the dataset: the raw generated data, a cleaned version in which video metadata are standardized between real and synthetic samples to prevent detectors from exploiting trivial cues, and an altered version simulating low-effort post-processing attacks. We evaluate CCDF with ten recent state-of-the-art detectors covering different detection approaches. Our results suggest that these approaches do not reliably distinguish CCDF’s generated videos from real ones, despite their strong reported performance on existing datasets. These results further confirm that existing datasets are not well-suited to evaluating certain threats.

[45] Revisiting Numerical Forecasting Models for Language-Based Trajectory Prediction cs.CVPDF

JunGyu Lee, Inhwan Bae, Hae-Gon Jeon

TL;DR: MoRE把五个冻结数值轨迹预测器的坐标级运动知识转为奖励，用强化学习微调语言式轨迹预测器，并只精炼预测熵最高的训练样本前1%。ETH-UCY的ADE/FDE分别从0.22/0.32米降至0.20/0.29米，且不增加推理内存或延迟。

Details

Motivation: 语言式轨迹预测器把坐标离散成token，并能建模行为意图和社会上下文，但token级目标对连续坐标动力学提供间接监督。作者希望把数值预测模型的运动与交互先验迁移给预训练语言式预测器。

Result: MoRE使用五个冻结数值预测器提供互补坐标知识，将预测转为专家奖励，并以不确定性加权共识惩罚专家分歧；真实轨迹奖励负责锚定目标。为聚焦困难样本，按预测熵选取训练集最高1%样本精炼策略；专家预测在PPO前计算并缓存，因此更新及推理时不运行专家。ETH-UCY的ADE由0.22降至0.20米、FDE由0.32降至0.29米；相对基础策略，SDD的ADE降低17.9%，NBA降低12.7%。ETH-UCY上碰撞率下降且行人间距更接近真实值，推理内存与延迟无增加。

Insight: 数值专家可以通过离线缓存的坐标奖励为语言模型策略提供连续运动反馈，保留语言模型上下文建模能力而不增加部署开销。熵筛选聚焦少数困难训练样本；摘要未列各数据集完整ADE/FDE表或成本训练细节。

Abstract: Language-based trajectory predictors represent coordinates as discrete tokens and learn auxiliary tasks such as destination and group reasoning. This formulation enables the model to capture behavioral intent and social context beyond coordinate dynamics alone. However, token-level objectives provide only indirect guidance for continuous coordinate-space dynamics. To address this limitation, we introduce MoRE (Mixture of Reward Experts), a refinement framework that transfers numerical forecasting priors into a pretrained language-based predictor through reinforcement learning. Five frozen numerical predictors provide complementary coordinate-level knowledge of motion and interactions. Their predictions are converted into expert rewards and combined through an uncertainty-weighted consensus that penalizes disagreement. A ground-truth reward anchors the prediction to the target trajectory. To focus refinement on difficult cases, MoRE refines the policy using the top 1% of training samples ranked by predictive entropy. Expert predictions are computed once and cached before PPO training, so the experts are not run during policy updates or inference. In this way, MoRE combines the contextual modeling of the language-based predictor with coordinate-level feedback from numerical experts. On ETH-UCY, MoRE reduces ADE from 0.22 to 0.20 m and FDE from 0.32 to 0.29 m. Relative to the base policy, ADE decreases by 17.9% on SDD and 12.7% on NBA. On ETH-UCY, MoRE also reduces collision rates and better matches ground-truth pedestrian spacing, without increasing measured inference memory or latency. The project page is available at https://jungyu0413.github.io/MoRE/.

[46] DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given cs.CVPDF

Minhyeok Lee, Jungho Lee, Minseok Kang, Heeseung Choi, Ig-Jae Kim

TL;DR: DensiTok是可插入预训练前馈3DGS的模块，不合成额外图像，而是在紧凑潜空间中用单步flow matching补全未观测视角对应的内部几何token，再交给冻结重建头。三个骨干、两个基准上均改善稀疏视图重建，并缩小与密集视图输入的差距。

Details

Motivation: 前馈3D Gaussian Splatting无需逐场景优化，但输入图像数量减少时质量明显下降；少量未定姿视图的内部表示缺乏未观测区域证据，产生空洞、漂浮和模糊。常用做法是用图像/视频生成器合成新视图再编码，成本高且合成不保证3D一致。

Result: DensiTok直接稠密化预训练3DGS模型的内部几何token，使冻结骨干表现得像观察了更多视角。模块先将token压缩到紧凑潜空间，再在相机几何条件下用单步flow matching补全未观测视角潜变量，并解码成原重建头可用的token。不同预训练预测器可接入同一模块设计，骨干和重建头均冻结，无图像合成或额外编码器前向。三个预训练骨干、两个基准上的结果均改善稀疏视图重建，并恢复了相当一部分与密集视图重建的性能差距；摘要未给数值。

Insight: 稀疏视图瓶颈可在重建头之前的潜在几何证据层面补足，而不必生成图像再重编码；相机条件下补全几何token也避免纯视觉合成缺乏3D一致性的问题。当前摘要只报告跨模型、基准的持续改善，没有量化差距恢复比例。

Abstract: Feed-forward 3D Gaussian Splatting (3DGS) reconstructs a scene in a single forward pass, replacing per-scene optimization with a network trained across many scenes. Its quality, however, degrades sharply as the number of input images drops. The bottleneck is upstream of the reconstruction heads: from a few unposed views, the internal representation they read carries no evidence for unobserved regions, leaving holes, floaters, and blur. The common remedy supplies that evidence as pixels, synthesizing extra views with an image or video generator and re-encoding them, which is costly and not 3D-consistent by construction. We instead densify the evidence itself. We present DensiTok, a plug-in module for pretrained feed-forward 3DGS models that densifies their internal geometry tokens directly, making a frozen backbone behave as though it had observed many more views than it was given. DensiTok compresses those tokens into a compact latent space, completes the latents of the unobserved viewpoints in a single flow-matching step conditioned on camera geometry, and decodes them back into tokens that the original reconstruction heads. The same module design can be integrated into different pretrained predictors while keeping each backbone and its reconstruction heads frozen. Completion in a low-dimensional latent space requires no image synthesis or additional encoder passes. Across three pretrained backbones and two benchmarks, DensiTok consistently improves sparse-view reconstruction and recovers much of the gap to dense-view reconstruction.

[47] Decide Before You Look: Learning Which Retrieved Memories Deserve Pixels cs.CV | cs.AIPDF

Youxing LI

TL;DR: PixelTriage在记忆检索之后、回答模型处理之前，预测哪些检索图像值得以高分辨率像素形式读取。它只看对话、短注释和缩略图，用冻结27B模型合成的样本训练；配7B回答模型时，在M³Exam、DMV、MemEye上位于准确率—成本前沿，只用11%–23%视觉token且准确率无显著损失，DMV回答快2.9倍。

Details

Motivation: 多模态助手回答长期记忆问题时，检索图片可作为约千个视觉token的像素输入，也可只用常错过问题细节的文本代理。作者观察到像素收益通常来自一两条记忆，并希望在回答模型运行前、不读取全分辨率图像的情况下判断哪些记忆值得付出视觉成本。

Result: PixelTriage是检索后的插件，小型非生成模型读取对话、每条记忆的短注释和缩略图，预测像素信息能带来多少增益。训练集由冻结27B模型合成：分别比较每个问题在读取或不读取某记忆像素时的答案，为样本标注价值。搭配7B回答模型时，在M³Exam、DMV和MemEye的准确率—成本前沿上，仅使用11%–23%的视觉token且准确率无显著下降；DMV回答速度为打开所有图片的2.9倍。等预算下优于检索顺序和统一缩放，并能迁移到其他记忆系统及397B回答模型。

Insight: 不必对所有检索图片都支付高分辨率视觉token；缩略图和记忆描述可先预测像素的边际价值，从而将有限预算集中在少数关键记忆上。摘要显示在三基准上有效，但合成监督依赖27B教师模型质量。

Abstract: Multimodal assistants answer questions from long-term memories that contain images. After retrieval, each retrieved image reaches the answering model either as pixels, at about a thousand visual tokens per image, or as a stored text proxy that often misses the detail the question asks about. We find that the benefit of pixels usually comes from one or two retrieved memories, and that it can be predicted before the answering model runs, without reading any full-resolution image. In PixelTriage, a plug-in placed after retrieval, a small model that does not generate text reads the dialogue, a short note and a thumbnail of each retrieved memory and predicts how much its pixels would add. It is trained on synthetic memory episodes labeled by a frozen 27B model that answers each question with and without each memory’s pixels. With a 7B answering model, PixelTriage lies on the accuracy–cost frontier of M$^3$Exam, DMV and MemEye and uses 11–23% of the visual tokens without a significant loss of accuracy. On DMV it answers 2.9 times faster than opening all images. It outperforms retrieval order and uniform down-sizing at equal budgets and transfers to other memory systems and to a 397B answering model.

[48] VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMs cs.CV | cs.AI | cs.CLPDF

Yuan Feng, Qize Yang, Ruizhe Chen, Sibo Song, Haolin He

TL;DR: VisionWeave让MLLM通过端到端训练学会按视觉内容弹性分配表示粒度：门控空间池化生成粗、细两种表示，粒度路由器决定分配。Qwen3.8-27B平均节省43.0% token并保留98.9%原生性能；SGLang部署吞吐提升2.3倍，TTFT和TPOT分别下降54.4%和60.6%。

Details

Motivation: MLLM将图像编码为稠密、固定大小patch token，产生较高推理成本，但视觉信息并不均匀：部分区域需要细节，其他区域可用压缩表示。下采样会丢细节，现有剪枝/自适应方法在粒度控制、任务泛化和服务基础设施集成方面仍有限。

Result: VisionWeave提出原生弹性视觉表示编织能力，以大规模训练教模型按内容和粒度分配表示。门控空间池化器在共享MRoPE坐标下同时构造粗粒度与原生细粒度表示，粒度路由器学习自适应分配。仅通过自蒸馏在Qwen3.5-4B验证后，扩展到Qwen3.8-27B，训练使用超过30,000 A100 GPU小时。27B模型平均节省43.0%视觉token，同时在八个基准保留98.9%原生性能；固定节省50%的token剪枝基线只保留88%性能。SGLang部署时吞吐提升2.3倍，平均TTFT减少54.4%、TPOT减少60.6%，跨任务、分辨率和视频帧均评估了效率—质量折中。

Insight: 让模型原生学习何时使用粗/细视觉表示，较固定比例剪枝能更好地按内容调节token预算；系统级收益也体现在吞吐和首/后续token时延。大型模型训练成本高，精度保留率与节省比例来自特定基准和Qwen配置。

Abstract: Multimodal large language models have become the dominant paradigm for visual understanding, but incur substantial costs by encoding inputs into dense, fixed-size patch tokens. However, visual information is unevenly distributed: some regions require fine-grained detail, while others admit compact representations. Downsampling sacrifices this detail, while existing token pruning and adaptive approaches remain limited in content-adaptive granularity, task generalization, and integration with modern MLLMs and serving infrastructure. Overcoming these limitations calls for foundation models that learn, end to end, where-and at what granularity-to allocate visual representations, a native capability we term elastic visual representation weaving. We introduce VisionWeave, establishing this capability in frontier-level MLLMs through large-scale training. It combines two components: a gated spatial pooler constructs coarse-grained representations alongside native fine-grained representations within a shared MRoPE coordinate, while a granularity router learns their content-adaptive allocation. Through self-distillation alone, we validate this capability on Qwen3.5-4B and scale to Qwen3.8-27B with over 30K A100 GPU-hours. Based on Qwen3.8-27B, VisionWeave adaptively adjusts token savings to visual content, saving 43.0% tokens on average while retaining 98.9% native performance across eight benchmarks, versus only 88% performance preserved for token pruning baselines with a fixed 50% savings target. Extensive evaluations confirm robust efficiency-quality trade-offs across diverse tasks, resolutions and video frames. When deployed on SGLang serving engine, our method achieves a 2.3x throughput gain while reducing mean TTFT by 54.4% and mean TPOT by 60.6%. Together, we believe these results position elastic visual weaving as a promising capability for next-generation multimodal models.

[49] M3SunAgent: Monocular 3D Spatial Understanding Agent for Metric Depth Estimation and 3D Visual Grounding cs.CVPDF

Jinsong Zhang, Kejun Wu, Ming Zhu, Renjie Qiao, Chengtao Cai

TL;DR: M3SunAgent把单目度量深度估计与3D视觉定位统一为由LLM规划的空间视觉程序：调用检测、深度、VLM、反投影和尺寸提升工具。2,910样本M3SI评测中，52.61%的实例预测深度误差低于0.25；3D grounding的mIoU为41.73%，比MonoVLM高3.62个百分点。

Details

Motivation: 单目度量深度估计和3D视觉定位都是单目3D空间理解的基础，却通常由独立框架实现，导致具身系统获取空间信息不灵活、不一致。需要一个统一智能体根据目标协调不同视觉工具。

Result: M3SunAgent使用LLM作为空间视觉程序规划器，生成结构化程序并协调工具。实例级深度任务中，先用目标检测器定位对象，再由深度工具在选定点估计深度并聚合成实例深度。作者构建2,910样本M3SI基准。3D视觉定位任务中，VLM定位目标并输出基础空间属性，再结合反投影和尺寸提升工具估计3D边界框。深度评测中52.61%的预测实例落在深度误差δ<0.25范围；3D定位mIoU为41.73%，比SOTA MonoVLM高3.62个百分点。

Insight: 将感知工具组合成结构化、可执行的空间程序，使深度估计和3D定位共享一致的单目空间信息入口。深度指标是误差阈值内实例比例，定位以3D mIoU评估，两类结果不应混为一个总体分数。

Abstract: Monocular metric depth estimation and 3D visual grounding represent the two complementary cornerstones of monocular 3D spatial understanding (M3Sun), from which the fundamental 3D spatial information required by M3Sun can be acquired. However, these complementary tasks are generally conducted by separate frameworks, which pose challenges of inflexible and unaligned spatial information access for embodied intelligence systems. In this paper, we propose a unified agent for monocular 3D spatial understanding (M3SunAgent) that leverages a large language model (LLM) as a task planner for spatial visual programming, which flexibly generate structured programs and coordinate tools. For instance-level metric depth estimation task, M3SunAgent invokes an object detector tool to locate the target, estimates depth at selected points with a depth estimation tool, and aggregates these predictions into an instance-level depth estimate. We also construct the M3Sun Instance (M3SI) dataset, a benchmark with 2,910 samples for evaluation. For monocular 3D visual grounding task, M3SunAgent uses a vision-language model (VLM) tool to locate the target and output basic spatial attributes, then combines back-projection tool with a dimension-lifting tool to predict its 3D bounding box. Experimental results demonstrate the superior performance of M3SunAgent. Specifically, in evaluations of instance-level monocular metric depth estimation, M3SunAgent achieves the best performance among all compared models, 52.61% of predicted instances are distributed below depth error 0.25 ($δ< 0.25$). In evaluations of monocular 3D visual grounding, M3SunAgent demonstrates overall competitive performance than vision and VLM models, reaching a 3D mean intersection over union (mIoU) of 41.73% and exceeding the state-of-the-art MonoVLM model by 3.62%.

[50] Beyond Training from Scratch: Foundation Models for Data-Efficient and Generalizable Cardiac MRI Reconstruction cs.CVPDF

Anam Hashmi, Mayug Maniparambil, Julia Dietlmeier, Kathleen M. Curran, Noel E. O’Connor

TL;DR: 本文把CLIP、BiomedCLIP、DINOv2等冻结或参数高效适配的视觉基础模型用作心脏MRI重建先验。在CMRxRecon2023/2024多个加速因子上均优于从头训练Transformer；低数据时冻结表示尤其有效，中等数据时LoRA可进一步提升，DINOv2综合表现最好。

Details

Motivation: 心脏MRI重建需从欠采样采集恢复高质量图像，以缩短扫描同时保留诊断信息。现有方法常从头训练并需要大量任务专属数据，因此在样本稀缺和分布变化时鲁棒性有限。

Result: 作者在Transformer重建架构中集成冻结及参数高效适配的CLIP、BiomedCLIP和DINOv2视觉编码器，作为先验。CMRxRecon2023和CMRxRecon2024多个加速因子实验显示，预训练表示持续优于从头训练Transformer；有限监督和跨数据集迁移测试也显示更高数据效率与泛化。极低数据时冻结表示尤其有效，中等训练数据可用LoRA获得额外收益，所测骨干中DINOv2整体最好。摘要未报告具体重建指标。

Insight: 视觉基础模型表示可作为心脏MRI重建的可迁移先验，按数据量选择冻结或LoRA适配可能更合适；基础模型并非只用于自然图像分类，也可支持欠采样医学影像恢复。当前摘要只描述相对优势，未给加速因子和各重建指标数值。

Abstract: Cardiac magnetic resonance imaging reconstruction aims to recover high-quality images from undersampled acquisitions, enabling faster scans while preserving diagnostic fidelity. Recent reconstruction methods are typically trained from scratch and often require large amounts of task-specific data, limiting their robustness under data scarcity and distribution shifts. In this work, we investigate whether pretrained vision foundation models can serve as effective priors for accelerated cardiac MRI reconstruction. We propose a reconstruction framework that integrates frozen and parameter-efficiently adapted visual encoders, including CLIP, BiomedCLIP, and DINOv2, within a transformer-based reconstruction architecture. Extensive experiments on the CMRxRecon2023 and CMRxRecon2024 benchmarks demonstrate that pretrained representations consistently outperform a transformer trained from scratch across multiple acceleration factors. We further evaluate performance under limited supervision and cross-dataset transfer, showing that foundation models provide superior data efficiency and generalization. While frozen representations are particularly effective in extreme low-data regimes, Low-Rank Adaptation (LoRA) yields additional gains when moderate amounts of training data are available. Among the evaluated backbones, DINOv2 achieves the strongest overall performance. These findings highlight the potential of vision foundation models as robust and transferable priors for cardiac MRI reconstruction.

[51] PhysTacGen: Physics-Aware Visual-Tactile Sensor Image Generation cs.CVPDF

Guo Tang, Yongtao Wang

TL;DR: PhysTacGen生成光学触觉图像以扩充昂贵的视觉—触觉配对数据：先用组策略优化训练VLM生成结构化材料描述，再以DINOv2配对筛选和相对深度提供几何条件，最后由SDXL ControlNet根据RGB、深度和文本合成触觉图像。实验提升SSVTP结构相似度，盲测偏好GTPO描述，生成触觉输入也改善属性推导的力系数预测代理任务。

Details

Motivation: 具身交互需要现实物理接触，但采集成对视觉—触觉数据成本高。由视觉合成触觉可扩充数据，却需解决外观与接触材料属性的差距，以及配对观察的空间错位。

Result: PhysTacGen融合材料描述与几何条件进行视觉到光学触觉图像生成。Group Tactile Policy Optimization使用任务奖励强化微调VLM，输出结构化材料描述；DINOv2特征用于筛选配对样本，单目相对深度提供几何先验；SDXL ControlNet再以RGB、相对深度和生成文本为条件合成触觉图像。SSVTP精选数据实验中，结构相似度优于对比基线；盲法用户研究更偏好GTPO生成的材料描述；生成触觉输入还提升由属性派生的力系数预测代理任务。

Insight: 视觉到触觉合成不仅需外观映射，还要用材料语义和相对几何约束提供接触相关信息；合成数据是否有用还可用下游力预测任务检验。摘要未提供SSIM增益、用户研究人数或代理任务绝对误差。

Abstract: Realistic physical interaction is a cornerstone of embodied intelligence, yet collecting paired visual–tactile data remains costly. Visual-to-tactile synthesis offers a promising approach to augmenting such data, but learning this mapping is complicated by the gap between visual appearance and contact-related material properties, as well as spatial misalignment in paired observations. To address these challenges, we present \textbf{PhysTacGen}, a visual-to-optical-tactile image generation framework that integrates material-aware descriptions with geometric conditioning. First, we introduce Group Tactile Policy Optimization (GTPO), a reinforcement learning strategy that refines a vision–language model to generate structured material descriptions using task-specific rewards. Second, we combine DINOv2-based pair curation with monocular relative-depth estimation to select training pairs and provide geometric priors. Finally, an SDXL ControlNet synthesizes optical tactile images conditioned on RGB, relative depth, and GTPO-generated text. Experiments on curated SSVTP data demonstrate improved structural similarity over the compared baselines, while a blinded user study shows a preference for GTPO-generated descriptions. Generated tactile inputs also improve performance on an attribute-derived force-coefficient prediction proxy. Together, these results demonstrate the effectiveness of PhysTacGen for optical tactile image synthesis and its utility in the evaluated downstream task.The code will be available at https://github.com/VDIGPKU/PhysTacGen.

[52] The Failure Is in the Readout: Fine-Grained Emotion Recognition Benchmarks Measure Elicitation, Not Perception cs.CV | cs.CLPDF

Tobias Hallmen, Fabian Deuser, Robin-Nico Kampa, Norbert Oswald, Elisabeth André

TL;DR: 本文指出细粒度情绪基准可能测到的是模型如何把类别说出来，而非是否感知到情绪；在EmoNet-Face-HQ上，仅将生成式回答改为逐类别读取概率，就让11个开源VLM全部超过专家一致性锚点。FACES真实照片复现方向混合，六个模型提升。

Details

Motivation: 细粒度情绪识别可支持治疗工具和社交机器人，但直接收集人脸引发隐私顾虑。EmoNet-Face-HQ用生成肖像和40类标签解决数据问题；基准原协议下VLM得分低，于是得出需专门微调模型的结论。作者质疑这是感知不足还是答案读出方式造成的。

Result: 研究保留EmoNet-Face-HQ图像、40类分类体系和专家评分，只将回答方式从生成改为每类别一次二元概率logit读取。专家在最可靠测量的五类上加权κ为0.468。生成式评估的11个开源VLM置信区间均未完全超过该锚点（κ=0.268–0.486）；改为verification式概率读出后，11个模型均超过锚点（κ=0.507–0.586），其中3个显著超过专门微调EIF模型（Small κ=.551，Large κ=.534）。收益来自保留分级概率，而非二元提问：把同一概率阈值化为是/否，会损失平均收益的142%，加权κ降至.254–.423。真实照片FACES复现较弱且混合：通过效度门槛的10个模型中6个提升、3个中性至正向、1个负向。

Insight: 基准表现受读出协议显著影响，生成自由文本可能低估VLM已编码的细粒度情绪信息；读取分级logits比硬阈值二分类保留更多信息。合成肖像上的优势不完全迁移到真实人像，实际应用需在真实图像和伦理约束下验证。

Abstract: Fine-grained emotion recognition supports therapy tools and social robots, but it needs facial data, which raises privacy and data-protection concerns. EmoNet-Face-HQ answers that with generated portraits, expert-rated over a $40$-category taxonomy far finer than the usual six to eight basic emotions. Under the protocol it ships with, vision-language models (VLMs) score poorly on that taxonomy, and the benchmark concludes that a dedicated fine-tuned model is necessary: Empathic-Insight-Face (EIF; Small/Large). We show that off-the-shelf VLMs match or beat that fine-tuned model when the answer is not generated but read from the logits, as one binary query per category. We keep the benchmark’s images, taxonomy and ratings, and change only how the answer is read. Experts agree at $κ_w = 0.468$ on the five categories they measure most reliably. Generatively, no interval among eleven open-weight VLMs lies entirely above that anchor ($κ_w=0.268$-$0.486$). Under verification all eleven clear it, each of them significantly better at $κ_w=0.507$-$0.586$. Three also significantly beat EIF sitting at $κ_w = 0.551$ (Small; $0.534$ Large). The gain comes from the graded probability and not from asking a yes/no question: as a control, thresholding those same probabilities to yes/no costs 142% of the average gains and drops binarization below generative elicitation to $κ_w=0.254$-$0.423$. A replication on real photographs (FACES) is weaker and mixed: of the ten models that pass a validity gate, six gain, three are neutral to positive and one is negative, so the effect is not confined to synthetic data.

[53] View Matters: Keyframe-Guided Text-Driven 3D Gaussian Editing cs.CV | cs.GRPDF

Kaizhe Zhang, Yijie Zhou, Weizhan Zhang, Xuanyu Wang, Feng Lei

TL;DR: View Matters先按几何可见性、语义区分性和编辑相关性识别可靠关键视角，再把其编辑信号非对称传播到其他视角，并在3DGS优化中保持重要性权重。23组场景—提示上平均CLIP图文相似度0.2822、方向相似度0.2564，编辑约4分钟。

Details

Motivation: 文本驱动3D Gaussian编辑常把不同渲染视角同等处理，但视角监督质量不同：清楚呈现场景且契合指令的视图更可靠，不充分或不相关的视图若等权使用会削弱编辑效果。

Result: Keyframe Importance Estimation综合几何可见性、语义独特性和编辑相关性识别可靠视角；Keyframe-Guided Editing将关键帧编辑信号非对称传播至非关键视角，避免噪声反向影响；Importance-Aware Optimization则在3DGS优化中维持可靠性优先。23组场景—提示对比中，平均CLIP文本—图像相似度最高为0.2822，方向相似度0.2564，编辑耗时约4分钟。相邻视角分析显示，侧重保真度的编辑仍保持跨视角一致性。

Insight: 跨视角编辑时，监督信号质量不均，先选可靠关键帧再单向传播可减少低质量视角污染。报告指标集中于语义/方向相似性和时长，摘要未给用户偏好或其他几何质量量化。

Abstract: Text-driven 3D Gaussian editing commonly does not distinguish the editing reliability of rendered views, although different viewpoints provide supervision of substantially different quality. Views that clearly show the scene and match the edit instruction provide reliable guidance, while less informative views may weaken the edit when all views are treated equally. We present View Matters, a view-importance-aware framework that conducts editing around reliable keyframes. Keyframe Importance Estimation (KIE) identifies reliable views using geometric visibility, semantic distinctiveness, and edit relevance. Keyframe-Guided Editing (KGE) then propagates their editing signals asymmetrically to non-keyframes without noisy reverse influence, while Importance-Aware Optimization (IAO) preserves this reliability preference during 3DGS optimization. Across 23 scene-prompt pairs, View Matters achieves the highest average CLIP text-image similarity of 0.2822 and directional similarity of 0.2564 among the evaluated methods, with a four-minute editing time. Additional adjacent-view analysis indicates that the fidelity-oriented editing process maintains cross-view coherence.

[54] MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos cs.CVPDF

Souptik Sen, Zahra Ahmadi

TL;DR: MacJEPA将第一人称视频中的模态缺失定义为长时间、多事件观察内局部音频/视频传感器中断，而不只整段缺失；通过窗口级模态dropout和监督式掩码一致性训练，在Epic-Kitchens-100和Epic-Sounds上用单一checkpoint兼顾完整输入表现与缺任一主/辅流时的鲁棒性。

Details

Motivation: 音视频模型可利用互补线索改善第一人称动作识别，但通常假定推理时两个流始终可用。既有缺模态方法多在剪辑好的单事件片段上测试，整个流要么全有要么全无；真实传感器会在长视频中局部失效、恢复。

Result: MacJEPA把缺模态扩展为未剪辑、多事件观察中的局部时间传感器故障，整段流缺失只是极端情况。模型通过给定时间区间查询，从音视频上下文识别视觉动作和声学事件；训练时以窗口级模态dropout模拟故障。它将JEPA掩码从自监督预任务转为监督鲁棒性目标，对齐多模态内容token及任务条件查询在掩码和干净输入下的潜表示。所有目标与识别任务单阶段联合训练，无需测试时适配。Epic-Kitchens-100与Epic-Sounds上，单一checkpoint在完整输入时保持竞争力，移除主流或辅助流时持续超过已发表缺模态基线；摘要未给具体分数。

Insight: 长时程真实视频的传感器故障是局部时间事件，不能只用整段删除来模拟；窗口级dropout和表示一致性把鲁棒性直接纳入单阶段训练。方法无需测试时适配，报告跨两个基准优势但没有量化提升。

Abstract: Audio-visual models improve egocentric action recognition by exploiting complementary cues, yet typically assume that both streams remain available at inference. Existing missing-modality methods operate on trimmed, single-event clips in which a stream is entirely present or absent, whereas real sensors fail and recover within long, untrimmed observations. We redefine egocentric modality missingness as temporally localized sensor outages within untrimmed, multi-event observations, with whole-clip absence as the limiting case. We introduce \textbf{MacJEPA}, a missing-modality-robust \textbf{Ma}sked-\textbf{c}ontext query \textbf{JEPA} that recognizes visual actions and acoustic events from supplied interval queries over audio-visual context. Window-local modality dropout simulates these sensor outages during training. MacJEPA further repurposes masking in JEPA from a self-supervised pretext into a supervised robustness objective, aligning masked and clean latent representations of both multimodal content tokens and the task-conditioned queries. All objectives are optimized jointly with recognition in a single stage, requiring no test-time adaptation. Across Epic-Kitchens-100 and Epic-Sounds, a single checkpoint remains competitive under complete input and consistently surpasses published missing-modality baselines when either the dominant or auxiliary stream is removed. MacJEPA thus unifies strong full-input recognition with temporal missing-modality robustness in a single model operating on untrimmed multi-event videos.

[55] TSRN-RTVD: Real-Time Video Deblurring System cs.CVPDF

Nikita Alutis, Danila Evsyukov, Egor Chistov, Mikhail Voronin, Evgeney Bogatyrev

TL;DR: TSRN-RTVD通过显式重建曝光期间相机轨迹，并用恢复的运动指导去模糊，目标是在消费级硬件上实现实时视频恢复。单张消费级GPU上达到30 FPS，在GoPro数据集上PSNR为30.08 dB。

Details

Motivation: 手持和边缘设备视频易受相机抖动引起的运动模糊影响，降低视觉质量并伤害下游视觉任务。高性能去模糊网络虽能恢复细节，却计算负担重，无法在消费级设备实时运行。

Result: 作者开发TSRN-RTVD系统，显式估计曝光过程中的相机运动轨迹，并将恢复运动作为锐化去模糊的指导信号，从模糊的物理成因中提取恢复线索。系统在单张消费级GPU上运行，视频恢复速度为30帧/秒；GoPro数据集PSNR达到30.08 dB。演示还展示消费设备上的输入/输出并排预览、实时吞吐和估计相机轨迹。

Insight: 利用曝光期相机运动这一物理先验，可将去模糊从单纯纹理恢复转为受轨迹约束的复原，并在消费GPU实现实时速度。摘要只报告GoPro PSNR，未给其他质量指标或设备型号。

Abstract: As video capture moves to handheld and edge devices, motion blur from camera shake has become a pervasive degradation that lowers perceptual quality and harms downstream vision tasks. The strongest deblurring networks recover impressive detail, yet they remain computationally heavy and overwhelmingly complex, so their quality comes at a cost that consumer hardware cannot pay in real time. This gap between restoration quality and on-device speed is exactly what makes real-time deblurring difficult. We developed and implemented TSRN-RTVD, an efficient video deblurring system that explicitly reconstructs the underlying camera trajectory during exposure and uses the recovered motion to guide restoration. This approach turns the physical cause of blur into a signal that drives sharpening. Our system runs on a single consumer GPU and restores the video at 30 FPS while reaching 30.08 dB PSNR on the GoPro dataset. We demonstrate TSRN-RTVD on consumer devices with interactive side-by-side visualization of the blurry input and the deblurred output, live throughput, and an on-screen view of the recovered camera trajectory. Demo video is available at https://youtu.be/3alMwVrVALU.

[56] Whose Face Is It Anyway? A Multi-Model Audit of Facial Affect Recognition on Children, and Why the Gap Is the Head, Not the Features cs.CVPDF

Tobias Hallmen, Robin-Nico Kampa, Elisabeth André

TL;DR: 这项多模型审计发现，五种AffectNet预训练表情模型在儿童自然表情上均有系统性退化，尤其张口表情和南亚儿童，且与肤色无关；冻结特征上线性探针可在未见儿童达0.75–0.91。仅重校准分类头可在两大儿童数据集提升0.13–0.28，但不迁移到其他儿童集合。

Details

Motivation: 面部情感模型几乎都在成人数据上训练，却越来越多用于教育、健康和发展研究中的儿童。作者希望用统一评测流程查明儿童性能差距是否取决于模型、表情特征或特定人群，并检验表征和分类头哪部分是主要问题。

Result: 研究以统一工具评估EmoNet、EmotiEffLib、DDAMFN++、OpenFace 3.0和LibreFace，覆盖四个儿童图像集、AffectNet-8验证集及两个自发儿童视频集。五种架构均从摆拍脸到自然表情退化，并出现恐惧→惊讶混淆；张口表情（与AU26下颌张开相关）和南亚儿童系统性下降，另有较小的视线偏移影响；闭口脸、白人和黑人儿童及直视未见同样差距，偏差与表情形态及特定群体相关而非肤色。冻结特征上线性探针在未见儿童达0.75–0.91，高于零样本0.48–0.66，表明问题主要在分类头。仅用少量目标数据重校准分类头，在五模型的两个最大儿童数据集提升0.13–0.28，对成人数据代价可忽略，但收益不迁移到其他儿童集合。

Insight: 儿童情感识别差距主要可由分类头而非特征表示解释，少量目标域头部校准可改善已见儿童数据，但跨儿童集合迁移失败，说明简单微调可能只适配数据集。应用到儿童教育/健康仍需针对多样儿童样本验证，且不能把结果归因于肤色单一因素。

Abstract: Facial affect models are trained almost entirely on adults, yet are increasingly applied to children in education, health, and developmental research. We present a controlled, multi-model audit of five AffectNet-pretrained expression models (EmoNet, EmotiEffLib, DDAMFN++, OpenFace 3.0, LibreFace) on children, across four child image datasets, the AffectNet-8 validation set, and two spontaneous child video datasets, through one shared harness. Three findings emerge. First, the child gap is model-agnostic: every architecture degrades from posed to naturalistic faces and shares the fear$\rightarrow$surprise confusion. Second, it is concentrated and corroborated across all five models: open-mouth faces (read as surprise, correlating with the AU26 jaw drop) and South-Asian children degrade systematically, with a smaller averted-gaze penalty, while closed-mouth faces, White and Black children, and direct gaze do not; the bias tracks expression morphology and specific populations, not skin tone. Third, the gap is diagnosable: a linear probe on frozen features reaches 0.75-0.91 on unseen children versus 0.48-0.66 zero-shot, so it lies largely in the classifier head, not the representation, whereas dimensional valence/arousal regression degrades sharply under domain shift. Building on this, recalibrating only the head on a little target data recovers $+0.13$ to $+0.28$ on the two largest child sets across all five models at negligible adult cost, though the gain is in-distribution and does not transfer across child collections. We will release the harness, per-sample predictions, and analysis code; the child face data stays license-locked and is never redistributed.

[57] Event Detection in Table Tennis Videos using 2D Keypoints cs.CVPDF

Rainer Lienhart, Daniel Kienzle, Shin’ichi Satoh, Anastasiia Bilinska

TL;DR: EventNet用上身姿态、球桌角点和球心的2D关键点表示乒乓球视频，再以时间Transformer预测每帧距前后击球接触的时间。Latte-MV上F1为91.16%、平均帧偏差0.42；更具挑战的TTHQ上分别为73.08%和1.16。

Details

Motivation: 逐帧精确检测乒乓球关键事件（如球拍接触球）是估计3D轨迹和旋转的前提，但现有方法通常假定事件时间已提前标注，难应用于长而未剪辑的视频。

Result: EventNet分两阶段：先提取双方上身姿态、球桌角点和球心等2D关键点，由小型关键点Transformer形成对视角、照明和背景杂乱较鲁棒的表示；再由时间Transformer为每帧预测到前一次和下一次球拍接触的时间差。方法引入时间余弦式监督信号，并用3D重投影视角增强和帧率增强提高泛化。Latte-MV上F1 91.16%、平均预测与真值帧差0.42；TTHQ上F1 73.08%、平均帧差1.16。消融分析各架构与训练因素。

Insight: 用时间到事件而非逐帧独立分类来建模接触时刻，可在长视频中提供精确事件定位；2D关键点作为紧凑表征有助于跨视角和背景变化。TTHQ性能明显低于Latte-MV，说明复杂场景鲁棒性仍是难点。

Abstract: This paper addresses the challenge of automatic, frame-accurate event detection in table tennis videos. Current methods for estimating 3d ball trajectories and ball spin typically require that key events, such as ball-racket contacts, have already been identified in advance. This requirement makes it difficult to apply these methods to longer, unedited video recordings. To overcome this limitation, we propose EventNet, a two-stage pipeline to detect key events: (1) 2d keypoints are extracted of the upper-body poses for both players, table corners and ball center. A small keypoint transformer combines them into a compact representation that is robust to changes in viewpoint, lighting, and background clutter. (2) The temporal sequences of these frame-based representations are processed by a transformer encoder that predicts two time-to-event values for each frame, indicating how close the current frame is to the next and previous ball-racket contact. One novelty is a new, temporal cosine-like target signal. Furthermore, we introduce viewpoint augmentation via 3D reprojection and frame-rate augmentation to improve robustness and generalization. Our extensive ablation study gives deeper insights into the importance of various architectural and training aspects. Experimental results show that the proposed approach achieves an F1 score of 91.16% and a mean frame deviation between ground truth and predicted frame of 0.42 on the Latte-MV dataset and 73.08% / 1.16 on the challenging TTHQ dataset. Overall, our work demonstrates that 2d keypoint-based temporal modeling with our EventNet architecture is a promising and practical approach for automatic event detection in table tennis videos.

[58] DIPrune: Task-Aware Token Pruning with Dual Importance for Efficient Multimodal Language Models cs.CV | cs.LGPDF

Shuo Yang, Changbai Li, Linlin Yang, Huobin Tan, Rongyu Chen

TL;DR: DIPrune把免训练MLLM token剪枝形式化为最小化最终任务损失失真，并推导含跨层梯度项的可计算token上界；据此联合评估层内静态特征显著性与跨层动态语义演化，缓解浅层显著token过早压制深层推理所需语义。

Details

Motivation: 现有免训练剪枝通过视觉冗余或文本—视觉注意力降低开销，但任务无关策略或不可靠注意力估计会造成语义退化。作者观察到浅层显著token会因数值惯性持续压制新出现语义，导致深层推理关键token被过早删除。

Result: 作者从任务目标出发，将剪枝定义为最小化最终任务损失的失真，并推导token级可处理上界作为替代优化目标；分析中出现此前常被忽略的跨层梯度项。DIPrune据此用双重重要性评分，同时优化层内静态特征显著性和层间动态语义演化。在LLaVA和Qwen-VL上的多个实验中持续达到SOTA表现；摘要未提供具体加速率和任务得分。

Insight: token重要性不应仅由当前层激活或注意力决定，还应估计跨层演化对最终损失的影响；浅层视觉显著性可能遮蔽深层语义。形式化任务失真为剪枝指标提供了与最终预测目标的联系，但具体效率—质量折中需看完整结果。

Abstract: Recent training-free pruning approaches for Multimodal Large Language Models (MLLMs) effectively cut computational overhead by exploiting visual redundancy or text-vision attention. However, they frequently suffer from semantic degradation due to their task-agnostic design or unreliable attention estimates. Based on our empirical analysis, we have found that this issue arises because salient tokens in shallow layers persistently suppress emerging semantic ones through numerical inertia, leading to premature discarding of signals crucial for deep reasoning. To address the aforementioned issue, from the task-oriented aspects, we first reformulate training-free pruning as a minimization of the distortion in the final task loss and derive a tractable, token-wise upper bound to serve as a surrogate objective. Specifically, this formulation inherently reveals a previously neglected inter-layer term that accounts for gradients across layers. Accordingly, for the implementation, we propose DIPrune, a rank-based framework that employs a dual importance scoring mechanism to jointly optimize intra-layer static feature saliency and inter-layer dynamic semantic evolution. Extensive experiments on LLaVA and Qwen-VL demonstrate that DIPrune consistently achieves state-of-the-art results.

[59] Transferable Spatial Temporal Coherence Adversarial Attack on Black-Box Vision Language Models for Autonomous Driving cs.CV | cs.AIPDF

Heyam Bin Jahlan Areej Alhothali Abeer Alhothali

TL;DR: STCA是一种面向自动驾驶视频VLM黑盒目标的可迁移时空对抗攻击：先用描述引导选择关键帧，再制造保持图像相似度的空间扰动，并用运动引导掩码破坏跨帧时间一致性。在BDD100K和nuScenes、Video-LLaVA-7B/Qwen2.5-VL-7B/Dolphin上实验显示模型仍易受攻击。

Details

Motivation: 图像模型的对抗鲁棒性研究较多，但面向驾驶视频VLM的时间感知攻击是独特且尚未充分研究的安全威胁。攻击者在黑盒场景只能使用开源替代模型迁移扰动，且需同时考虑空间外观和跨帧一致性。

Result: STCA包含三阶段：通过描述引导帧选择，将扰动重点放在语义重要帧；空间攻击阶段生成有效且保持较高相似度的扰动；最终利用运动引导掩码破坏跨帧时间一致性。黑盒目标仅通过白盒替代模型迁移。作者在BDD100K和nuScenes上对Video LLaVA-7B、Qwen2.5-VL-7B和Dolphin测试，报告空间攻击具有高结构相似性，整体攻击结果显示自动驾驶视频VLM仍易受攻击；摘要未提供具体攻击成功率或表格数值。

Insight: 驾驶视频VLM的攻击面不仅是单帧视觉内容，跨帧时间一致性也可被利用；高相似度扰动仍可能影响下游判断。由于摘要缺少成功率等量化信息，无法比较各阶段贡献或攻击强度。

Abstract: The rapid integration of Vision Language Models (VLMs) into sensitive systems introduces critical safety vulnerabilities that remain unexplored in exist studies. While adversarial attack robustness has been extensively studied for image-based models, the susceptibility of VLMs to temporally-aware adversarial attacks against video in driving context poses a distinct and under examined threat. In this paper, we introduce novel adversarial attack against video targeting VLM models used for autonomous driving scenes named Spatial Temporal Coherence Adversarial Attack (STCA). Our attack comprise from three stages: modalities expansion, Spatial attack, and STCA attack. In modalities expansion, we propose caption-guided frame selection method in order to ensure that adversarial perturbation target the most semantically significant frames. Secondly.In spatial attack, we craft effective perturbation and preserve high similarity. Then the perturbed video generated fed into STCA stage that disrupt cross-frame temporal coherence using motion guided mask. Our method operate under black box threat model against victim target VLMs, relying solely on transferability from white-box surrogate model.We conduct our experiments on the BDD100K and nuScenes autonomous driving datasets across three VLM models: Video LLaVA-7B, Qwen2.5-VL-7B, and Dolphin. Experimental results demonstrate spatial attack achieves an ASR with high SSIM. Our finding reveal that existing video language model, remain highly susceptible to adversarial attack in autonomous driving scenarios, underscoring the urgent need for robust defense for VLM models.

[60] PolarScale: A Physics-Grounded Benchmark for Radiometrically Consistent RGB-to-Stokes Estimation cs.CV | physics.opticsPDF

Beibei Lin, Tingting Chen, Xin Zhang, Wenhao Zhao, Dongjun Li

TL;DR: PolarScale建立RGB到完整Stokes偏振估计基准，将此前常被归一化消除的每场景辐射尺度也列为预测目标，并强调输入是场景参考线性强度而非消费级sRGB。最强恢复模型估尺度平均相对误差3.6%–4.3%，常数尺度基线为5.7%，物理边界违例少于0.25%像素。

Details

Motivation: 偏振成像提供强度图像之外的物理线索，但通常需要专门硬件。近期方法尝试从RGB推断偏振，却只预测归一化Stokes分量或相对描述，未恢复完整Stokes所需的辐射尺度。

Result: PolarScale基于已有三色全Stokes测量构建，输入每场景归一化总强度图s₀（场景参考线性图，而非普通sRGB照片），要求预测归一化Stokes分量、AoLP/DoLP/DoCP和每场景尺度。由于输入中尺度已被除去，物理上不可辨识，基准将其定义为数据集条件语义尺度估计，并与常数尺度控制比较，同时评估角度、自洽性和物理边界。七种恢复/生成骨干、三种预测策略中，最强恢复模型尺度平均相对误差3.6%–4.3%，常数控制5.7%，物理边界违例低于0.25%像素；两个生成基线尺度坍缩到近零。显式描述符监督使MAE描述符PSNR由18.88升至23.66 dB。完整Stokes预测改善漫反射/镜面分离、材料分割和眩光分类，但前一任务中学习尺度仅与常数控制相当。

Insight: 辐射尺度在该输入设定下不可由物理信息唯一恢复，因此其评测衡量数据集条件的语义估计而非真实可辨识反演；需同时报告常数控制和物理约束。下游收益并非普遍，漫反射/镜面分离未优于常数尺度。

Abstract: Polarization imaging provides physical cues beyond intensity imaging but typically requires specialized hardware. Recent methods infer polarization from RGB-like inputs, yet predict only normalized Stokes components or relative descriptors, from which the radiometric scale needed for full Stokes reconstruction has been divided out. We introduce PolarScale, a benchmark that makes this scale an explicit prediction and evaluation target. Built on existing trichromatic full-Stokes measurements, PolarScale takes the per-scene normalized total-intensity image $s_0$ (a scene-referred linear image, not a consumer sRGB photograph) and asks models to predict normalized Stokes components, AoLP/DoLP/DoCP, and a per-scene scale. Because the scale is divided out of the input, it is not physically identifiable; PolarScale therefore evaluates dataset-conditioned semantic scale estimation against a constant-scale control, together with angular, self-consistency, and physical-bound metrics. Across seven restoration-based and generative backbones and three prediction strategies, the strongest restoration models estimate the scale with 3.6-4.3% mean relative error versus 5.7% for the constant control and violate physical bounds on fewer than 0.25% of pixels, whereas two generative baselines collapse to a near-zero scale; explicit descriptor supervision improves descriptor accuracy (23.66 vs. 18.88 dB PSNR for MAE). Predicted full-Stokes representations improve diffuse/specular separation, material segmentation, and glare classification, although in diffuse/specular separation the learned scale performs only on par with the constant control.

[61] UniCounting: Instance-Aware Proposal Consolidation for Image-Query-Free Multi-Category Counting cs.CVPDF

Jinshi Liu, Pan Liu, Lei He, Weichao Luo, Rui Qian

TL;DR: UniCounting研究固定类别词表下仅凭RGB图像、无需图像级类别查询的多类别计数。它把过量分割候选构成实例关系图，用仅3,267参数的共享关系头判断掩码是否属于同一物体，再以可回放证据合并计数；COCO clean500上点估计向量L1误差及缺失类虚假计数低于校准OWLv2-All80。

Details

Motivation: 常见视觉计数针对单一指定类别，需提供图像样例、文本查询或目标类别。无查询多类计数则要直接输出整幅图中固定词表各类别数量；通用分割器常产生重复、局部或跨实例候选，语义分数虽能识别类别，却不能判断候选是否指向同一物体。

Result: UniCounting对过完备候选做实例感知结构推断：冻结SAM 2.1生成掩码，冻结DINOv2和OpenCLIP提取关系与类别特征；仅训练3,267参数的类别共享关系头，用掩码关系监督预测同实例亲和度。稀疏建图、代表候选选择、类别判定及背景边际筛选后，每个接纳分量计为一个实例，并保存可回放分组证据。无需计数或密度图监督。COCO clean500上，点估计类别计数向量L1误差和缺失类虚假计数均低于校准OWLv2-All80，micro presence F1相当。统一解码器对照显示关系头优于掩码包含率、IoU、CLIP和DINO关系特征，但揭示碎片化与合并错误权衡；另报告OmniCount-sub、FSC-147、CARPK迁移诊断。

Insight: 多类别无查询计数的核心是把重复/部分掩码合并为物体实例，而不只是识别候选类别；显式学习实例关系可用极少参数并提供可审计分组依据。结果显示计数误差改善，但仍存在碎片化—错误合并权衡，迁移诊断不等同于全域领先。

Abstract: Visual counting is commonly formulated as counting a single specified target, with a model receiving an image-specific exemplar, text query, or target category and returning a single count. We instead study fixed-vocabulary image-query-free multi-category counting. A global vocabulary is fixed for each run, and, given only an RGB image, the model predicts a complete category–count vector without being told which categories appear. We present UniCounting, which casts counting as instance-aware structural inference over an over-complete proposal set. Generic segmenters produce duplicate masks, partial views, and proposals from neighboring instances; semantic scores can name them but cannot determine which denote the same object. Frozen SAM~2.1 generates masks, while frozen DINOv2 and OpenCLIP provide relation and category features. A 3,267-parameter category-shared relation head predicts same-instance affinities from instance-mask-derived supervision. Sparse graph construction, representative selection, labeling, and background-margin admission then convert each admitted component into one count with replayable group evidence. Only the relation head is trained, without count or density-map targets. On COCO clean500, UniCounting obtains lower point-estimate vector $\ell_1$ error and absent-class false mass than calibrated OWLv2-All80, with comparable micro presence F1. Under a matched decoder, the learned relation reduces both errors relative to mask containment, mask IoU, CLIP, and DINO, while revealing a fragmentation–merge trade-off. We also report transfer diagnostics on OmniCount-sub, FSC-147, and CARPK.

[62] Test-Time Adaptation of Quantized ViTs via Single-Pass Quantizer-Aligned Recalibration cs.CV | cs.AIPDF

Hyeongheon Cha, Young D. Kwon, Sung-Ju Lee

TL;DR: QuAR是面向量化ViT的单次前向测试时适配，不反向传播也不更新模型参数；它在冻结量化器输入端按通道重校准激活统计，使测试流匹配源域校准范围。ImageNet-C上3/4/6/8-bit精度均领先免反传TTA基线，8-bit提升2.28点、3-bit提升4.00点，延迟低46%，显存开销仅0.17MB。

Details

Motivation: 后训练量化能让ViT适配边缘设备内存和计算预算，但量化模型在分布偏移下尤其脆弱。许多测试时适配依赖反向传播，免反传方法也可能需要额外前向或参数更新；另一个量化特有问题是偏移后激活占用冻结量化器校准范围的方式改变，导致编码分布失真。

Result: Quantizer-Aligned Recalibration（QuAR）在冻结量化器输入处对激活做单次流式适配，将测试数据逐通道运行统计映射回源域校准统计，不反传也不更新任何模型参数。ImageNet-C的ViT-B测试中，3、4、6、8 bit权重/激活精度均取得免反传TTA最高平均准确率；比最强基线在8 bit高2.28个百分点、3 bit高4.00个百分点，同时延迟低46%，额外内存0.17 MB（峰值推理内存0.01%）。分析显示收益来自减少逐通道不匹配、恢复基线未改变或进一步扭曲的量化码分布。固定配置在连续流、非IID标签偏移、七个OOD套件和另外三个骨干上仍领先。

Insight: 分布偏移下量化错误来自激活与固定校准区间不匹配，可在量化器入口做轻量统计重校准，而无需改变权重或反传。跨设置固定参数是部署优势；具体提升在不同位宽差异明显。

Abstract: Post-training quantization is a standard route to fitting vision transformers (ViTs) into edge compute and memory budgets, yet quantized models become especially brittle under distribution shift. Test-time adaptation (TTA) addresses such shifts without labels, but most existing approaches are poorly aligned with the constraints of quantized inference. Prevailing TTA methods recover accuracy through backpropagation, while backprop-free methods often still incur overhead from extra forward passes or parameter updates, and lightweight feature- or logit-level methods recover only part of the loss. Across these approaches, a quantization-specific failure mode that amplifies the drop is not directly targeted: under shift, activations occupy frozen quantizers’ calibrated ranges differently, distorting their code distribution. We propose Quantizer-Aligned Recalibration (QuAR), a single-pass TTA method tailored to quantized ViTs that neither backpropagates nor updates any model parameters. QuAR recalibrates activations at the input to a frozen quantizer, mapping the test stream’s running per-channel statistics back toward the source calibration. On ImageNet-C with ViT-B, QuAR achieves the highest mean accuracy among state-of-the-art backprop-free TTA methods at 3-, 4-, 6- and 8-bit weight/activation precision, outperforming the strongest baseline by 2.28 points at 8 bits and 4.00 at 3 bits, with 46% lower latency and a memory overhead of only 0.17 MB (0.01% of peak inference memory). Analysis and diagnostics trace the gain to a reduced per-channel mismatch at these quantizers, which restores the code distribution the baselines leave unchanged or distort further. A single fixed configuration remains ahead across continual streams, non-i.i.d. label shift, seven out-of-distribution suites, and three other backbones.

[63] GeoPID: Decomposing and Steering Visual Information in Vision-Language Models cs.CV | cs.AIPDF

Seulgi Kim, Zhixiong Zhang, Xinwei Zhang, Jie Ling, Ronn Shaw

TL;DR: GeoPID从表示子空间几何将VLM信息拆为冗余、视觉独有和协同成分，并发现视觉定位要求越强，正确预测越依赖视觉独有成分。推理时沿视觉独有子空间定向放大视觉表征，无需改参数，22个模型、14个基准上的平均相对准确率提升7.63%。

Details

Motivation: VLM在多种应用表现强，但常未充分利用视觉输入、过度依赖文本上下文。作者希望从几何角度分析视觉与文本表征的信息贡献，并在不改模型参数的情况下增强视觉接地。

Result: 免训练GeoPID依据视觉和文本表示子空间的几何关系，把多模态信息分解为冗余、模态独有和协同成分。在22个VLM、14个基准的大规模分析中，视觉接地要求强的问题，其正确预测表现出更强的视觉独有成分。基于此，推理时沿视觉独有子空间选择性放大视觉表示，增强视觉接地能力；无需额外模型参数更新，平均相对准确率提高7.63%。

Insight: 模型正确回答高度依赖视觉的问题时，视觉独有信息而非与文本重叠部分更关键；定位该子空间并定向干预可减少文本偏置。7.63%是跨22模型、14基准的平均相对增益，不代表每项任务都同等提升。

Abstract: While recent vision-language models (VLMs) have shown outstanding performance across diverse applications, they tend to under-use visual information and over-rely on textual context. In this work, we propose \textsc{GeoPID}, a training-free framework that analyzes multimodal information within VLMs from a geometric perspective. \textsc{GeoPID} decomposes information into Redundant, Modality-Unique, and Synergistic components through the geometric relationships between visual and textual representation subspaces. Through an extensive analysis across 22 VLMs and 14 benchmarks, we confirm that correct predictions exhibit stronger vision-unique components when questions strongly require visual grounding. Building on this geometric analysis, we introduce a targeted intervention technique that selectively amplifies visual representations along the vision-unique subspace during inference. As a result, visual grounding capabilities were enhanced without any additional model parameter updates, achieving an average relative accuracy gain of 7.63%.

[64] Image Bitstream Fine-grained Understanding for Privacy-Friendly AIoT cs.CVPDF

Zhen Yu, Wenyang Liu, Kejun Wu, Chengwang Xiao, Renjie Qiao

TL;DR: BFG直接从图像编码比特流提取语义并生成细粒度描述，不在推理时完整解码像素，以减少AIoT处理管线中的视觉暴露。作者构建含多种传输/存储损坏类型和严重度的CFU-D数据集；Stanford Dogs Caption平均CIDEr仅从0.6339降至0.6077，明显比多种VLM在损坏下稳定。

Details

Motivation: 隐私友好AIoT应用希望在理解图像时减少像素级内容暴露。传统视觉理解需先完整解码图像；编码比特流直接语义分析可以避免显式重建像素，但传输或存储损坏会威胁细粒度理解稳定性。

Result: Bitstream Fine-grained Generator（BFG）由比特流语义编码器BSeE和细粒度语义生成器FSeG组成：前者直接建模编码图像比特流而不显式重建像素，后者自回归生成自然语言细节描述。作者构建Corrupted-bitstream Fine-grained Understanding（CFU-D），含完好比特流及多类、多严重程度损坏版本。在Stanford Dogs Caption上，损坏后平均CIDEr从0.6339轻微降至0.6077；Qwen-VL-Chat、BLIP-2、GLM、Gemini和GPT等VLM在相同损坏下性能明显下降。摘要称BFG在比特流损坏下保持稳定细粒度描述。

Insight: 从压缩域直接解析可减少图像完整像素重建带来的隐私暴露，并且该模型在测试损坏下较稳定。稳定性结果以CIDEr为例；摘要未描述比特流格式、隐私攻击模型或对常规未损坏图像的精确对比。

Abstract: Image Bitstream Fine-grained Understanding (IBFU) aims to directly perform fine-grained classification and semantic description generation from encoded image byte sequences. In contrast to conventional pixel-domain visual understanding, IBFU conducts semantic analysis without fully decoding images into the pixel domain. Since pixel-level visual content is not explicitly reconstructed during inference, this paradigm reduces visual exposure within the processing pipeline and suits privacy-friendly Artificial Intelligence of Things (AIoT) applications. In this paper, we propose Bitstream Fine-grained Generator (BFG), a novel foundation model tailored for IBFU. BFG consists of two main components: a Bitstream Semantic Encoder (BSeE) and a Fine-grained Semantic Generator (FSeG). BSeE directly models semantic representations from encoded image bitstreams without explicit pixel reconstruction, while FSeG transforms the extracted bitstream semantics into detailed natural-language descriptions through autoregressive generation. To train BFG and comprehensively evaluate IBFU in practical AIoT scenarios, where image bitstreams may suffer corruption during transmission and storage, we construct a large-scale Corrupted-bitstream Fine-grained Understanding dataset (CFU-D), containing both intact bitstreams and corrupted variants across multiple corruption types and severity levels. Experiments show that BFG maintains stable fine-grained caption generation under bitstream corruption. For example, the performance only has slight change from 0.6339 to 0.6077 in terms of average CIDEr score on Stanford Dogs Caption dataset, while vision-language models, such as Qwen-VL-Chat, BLIP-2, GLM, Gemini, and GPT suffer severe performance decrease. This paper provides a practical paradigm for privacy-friendly fine-grained understanding in AIoT.

[65] Ariadne’s Thread of LipSync: Unraveling Forgeries via Inconsistency between Lip Motions and Head Poses cs.CV | cs.CRPDF

Tianyi She, Jiawei Liu, Weifeng Liu, Hanqing Zhao, Weiming Zhang

TL;DR: LipDA利用自然说话视频中口唇运动与头姿的生物耦合，联合检测LipSync伪造并归因生成来源：检测器区分真实/伪造的口唇—头姿不一致，归因器学习模型特有时序与音视频同步指纹。两个挑战数据集及自建多生成器数据上检测AUC超过97%，来源归因准确率97.5%。

Details

Motivation: LipSync生成已能实现更好唇音同步并消除明显视觉伪影，使现有检测策略难以识别伪造。作者指出自然语音中口唇动作与头部姿态存在生物学耦合，可作为尚未充分利用的检测信号。

Result: LipDA联合完成LipSync检测和来源追踪。检测部分对比真实/伪造视频中的口唇与头姿特征，学习量化两者不一致；归因部分捕捉生成模型独有的时间动态与音视频同步模式作为指纹。作者在两个挑战性LipSync数据集及自建大规模多生成器数据集上评估，检测AUC超过97%，模型来源归因准确率97.5%，显著超过已有方法。

Insight: 高唇音同步不代表头姿与口唇动态也符合真实生物耦合；两类线索可分别支持伪造检测和生成源归因。高分结果基于所测数据集，摘要未给跨未见生成器、压缩和后处理条件的细分表现。

Abstract: Recent advances in LipSync generation technology have led to the creation of highly realistic videos, posing severe societal risks. However, existing defense strategies struggle against LipSync forgeries, as advanced LipSync generation methods not only achieve better lip synchronization but also eliminate visual artifacts. An important reason is that they overlook an inherent biological coupling between lip movements and head poses in natural speech videos. In this paper, we propose LipDA, a novel framework for joint LipSync Detection and Attribution, which takes advantage of the inconsistency between head and lip. For detection, the framework learns to quantify this discrepancy by contrasting lip and pose features from authentic versus forged videos. For attribution, our method is designed to capture the unique temporal dynamics and audio-visual synchronization patterns that act as the fingerprint of models, enabling source tracing. We conduct extensive experiments on two challenging LipSync datasets as well as our own proposed large-scale and multi-generator dataset. LipDA achieves over 97% AUC in detection and 97.5% accuracy in model attribution, significantly outperforming existing methods. Code and the proposed LipSync-A dataset are available at https://github.com/AnsonShe/LipDA.

[66] From the Drosophila Visual Connectome to General-Purpose Computer Vision cs.CV | cs.NE | q-bio.NCPDF

Zongyu Li, Akito Yamauchi, Huaizhi Liu, Vishwanatha Rao, Jia Guo

TL;DR: ConnectomeX从果蝇视觉连接组提取并扩展并行ON/OFF处理、循环计算和群体图交互，构建轻量FlyVision。在多个视觉任务上以较少参数接近或超过ResNet18；皮肤病分类准确率63.78%、macro-AUROC 95.28%，胸片分类准确率92.6%–92.76%，MRI脑龄预测MAE 5.98年。

Details

Motivation: 生物连接组可能编码可复用的视觉计算归纳偏置。作者希望检验果蝇视觉神经回路启发的结构能否从小型图像分类扩展到ImageNet及医学影像等通用计算机视觉任务。

Result: ConnectomeX围绕可训练FlyVision设计，保留并行ON/OFF处理、循环计算和群体级图交互，并按任务扩展容量。80,608参数在MNIST准确率99.34%；81,408参数在CIFAR-10为78.03%。ImageNet-1K上FlyVision Base/Large top-1为60.79%/66.25%，参数1.8M/3.7M；带学习低频分支的Large局部k7变体66.53%，对比11.7M参数ResNet18的69.25%。22类皮肤病上Large以2.99M参数达到63.78%准确率和95.28% macro-AUROC。四类胸片上预训练Base/Large准确率92.60%/92.76%，高于11.18M参数ResNet18的91.56%。BrainAGE将共享ImageNet预训练Large编码器用于每次扫描24张矢状、冠状和轴向切片，并用置信度调制高斯投票融合；433个留出扫描上MAE 5.98年、R²=.868。224×224分类任务中，最佳配置在ImageNet和皮肤病分类落后ResNet18不超过3个百分点，在胸片上以更少参数超过ResNet18。

Insight: 果蝇连接组启发的并行、循环和图交互计算可形成参数效率较高的视觉架构，并扩展到自然和医学影像；参数量与任务表现显示有竞争力，但ImageNet仍落后ResNet18，比较还依赖预训练、输入分辨率和任务配置。

Abstract: Biological connectomes encode structured solutions to visual computation that may provide reusable inductive biases for artificial vision. We develop ConnectomeX around FlyVision, a trainable architecture that preserves parallel ON/OFF processing, recurrent computation and population-level graph interaction while scaling model capacity across tasks. FlyVision reached 99.34% accuracy on MNIST with 80,608 parameters and 78.03% on CIFAR-10 with 81,408 parameters. On ImageNet-1K, FlyVision Base and Large reached 60.79% and 66.25% top-1 accuracy with 1.8 and 3.7 million parameters, while a Large local-k7 model with a learned low-frequency branch reached 66.53%, compared with 69.25% for ResNet18 with 11.7 million parameters. On a 22-class skin-disease benchmark, FlyVision Large achieved 63.78% accuracy and 95.28% macro-AUROC with 2.99 million parameters. In four-class chest radiography, ImageNet-pretrained FlyVision Base and Large reached 92.60% and 92.76% accuracy with 1.33 and 2.97 million parameters, compared with 91.56% for ImageNet-pretrained ResNet18 with 11.18 million. BrainAGE extends FlyVision to volumetric T1-weighted MRI by applying a shared ImageNet-pretrained FlyVision Large encoder to 24 sagittal, coronal and axial slices per scan and combining slice-level age estimates by confidence-modulated Gaussian voting. On 433 held-out scans, three-axis fusion achieved a mean absolute error of 5.98 years and R^2 = 0.868. Across the 224x224 classification tasks, the best FlyVision configuration remained within three percentage points of ResNet18 on ImageNet-1K and skin-disease classification and exceeded it on chest radiography with substantially fewer parameters. These results show that a conserved connectome-informed computation can scale from compact recognition to large-scale natural and biomedical vision.

[67] HuC-VideoMAE: Human-Centric Video Masked Autoencoding from synthetic data cs.CVPDF

Ricardo Pizarro, Roberto Valle, José M. Buenaposada, Luis M. Bergasa, Luis Baumela

TL;DR: HuC-VideoMAE研究用合成动作捕捉视频预训练动作识别模型，以降低依赖未获拍摄者同意的网络视频数据。作者发现标准VideoMAE掩码策略在合成数据上表现差，提出利用人体关键点和边界框的人体中心掩码；NTU RGB+D跨视角受试者设置中缩小了与Kinetics预训练差距的49%，全程未用真实视频帧预训练。

Details

Motivation: 现代动作识别模型常依赖大规模网络视频预训练，但其中拍摄者通常未明确同意，存在伦理问题。BEDLAM2.0等高质量动作捕捉合成视频提供了更合乎伦理的替代数据源，但如何适配自监督视频Transformer尚不清楚。

Result: 作者先发现直接使用标准VideoMAE掩码策略，在合成视频预训练后表现显著低于Kinetics预训练；因此提出基于身体关键点和人物框区域的人体中心掩码，让模型聚焦人体动作结构与动态。NTU RGB+D和Toyota-Smarthome实验中，方法显著超过标准VideoMAE合成数据预训练；NTU RGB+D跨视角受试者设置下，缩小与Kinetics预训练性能差距的49%，且预训练阶段未使用任何真实视频帧。

Insight: 合成动作数据可支持较合乎伦理的视频预训练，但掩码策略要聚焦人体运动结构，而非照搬自然视频方案。NTU结果缩小而非消除与Kinetics差距，摘要未说明其他数据集上的绝对数值。

Abstract: Modern action recognition models rely on video transformers pretrained on massive collections of web-crawled videos, such as Kinetics-700. However, the use of such data raises ethical concerns, as subjects’ consent is typically not obtained. Recent high-quality synthetic video datasets generated from motion-capture data, such as BEDLAM2.0, offer a promising ethical alternative. In this work, we investigate self-supervised pretraining of video transformers on synthetic human-motion datasets. We first show that directly applying the standard VideoMAE masking strategy leads to substantially worse performance than pretraining on Kinetics. To address this limitation, we propose a human-centric masking scheme that leverages body keypoints and person bounding box regions. Our approach encourages the model to focus on the structure and dynamics of human motion during pretraining. Experiments on NTU RGB+D and Toyota-Smarthome demonstrate that our method significantly outperforms standard VideoMAE pretraining on synthetic data, closing 49% of the gap to Kinetics pretraining on NTU RGB+D cross-view-subject without using a single real frame during pretraining. To promote the use of ethical action recognition models, we will publicly release our pretrained models.

[68] Knee3DVLM: Dual-Sequence Full-Volume Vision-Language Modeling for Comprehensive Knee MRI Assessment cs.CV | cs.AIPDF

Maryam Baizhigitova, Andrew Seohwan Yu, Po-Hao Chen, Naveen Subhas, Sixu Chen

TL;DR: Knee3DVLM使用完整体积DESS与液体敏感TSE两种膝MRI序列，预测57个基于MOAKS的解剖定位二元诊断目标。在1,074例留出检查中，双序列融合平均准确率72.98%、平衡准确率71.17%、平均ROC-AUC 78.96%、宏ROC-AUC 78.74%，均高于单序列配置。

Details

Motivation: VLM正逐步用于三维医学影像，但膝MRI应用有限，尤其临床常用互补序列的联合解释不足。全面评估需覆盖多种病理目标和完整体积，而非仅处理单序列或局部切片。

Result: Knee3DVLM是序列感知VLM，输入DESS和液体敏感TSE完整膝MRI体积，输出基于MRI骨关节炎膝评分MOAKS定义的57个解剖定位二元诊断目标，以支持结构化报告。作者按受试者不重叠方式划分Osteoarthritis Initiative数据，比较DESS单序列、TSE单序列和配对融合。1,074例留出检查中，融合模型平均准确率72.98%、平衡准确率71.17%、平均ROC-AUC 78.96%、宏ROC-AUC 78.74%，三项配置中最高。与公开3DReasonKnee队列对齐的次级多类分析中，Knee3DVLM在五类病理上的数值均高于其最强报告配置。

Insight: 完整体积和互补MRI序列联合输入有助于全面膝部病变评估；受试者隔离划分避免同患者泄漏。摘要报告多个指标及五类病理比较，但未说明超越3DReasonKnee的具体幅度或临床工作流效果。

Abstract: Vision-language models (VLMs) are increasingly being applied to three-dimensional medical imaging, but their application to knee MRI remains limited, particularly for interpreting the complementary sequences used in clinical practice. We introduce Knee3DVLM, a sequence-aware VLM that uses full-volume DESS and fluid-sensitive TSE MRI to predict 57 anatomically resolved binary diagnostic targets derived from the MRI Osteoarthritis Knee Score (MOAKS) for structured reporting. We evaluated DESS-only, TSE-only, and paired DESS-TSE configurations using subject-disjoint Osteoarthritis Initiative partitions. In a held-out cohort of 1,074 examinations, the fused model achieved 72.98% average accuracy, 71.17% balanced accuracy, 78.96% mean ROC-AUC, and 78.74% macro ROC-AUC, the highest values among the three configurations. In a secondary multiclass analysis aligned with the released 3DReasonKnee cohort, Knee3DVLM was numerically higher than the strongest reported 3DReasonKnee configuration across five pathology categories. These findings support dual-sequence full-volume modeling for comprehensive knee MRI assessment.

[69] 2D Spatial Reasoning with Adaptive Neural Cellular Automata cs.CVPDF

Martin Spitznagel, Janis Keuper

TL;DR: aNCA以可变形卷积动态调整感受野，并通过迭代神经元胞自动机在网格图像上推理二维空间关系；作者在公开图像谜题基准上报告对数独和迷宫最短路径达到SOTA级且泛化较强，但摘要未给数值。

Details

Motivation: 许多现代学习方法仍难利用视觉对象的几何信息及对象间空间关系完成推理任务。作者希望构造可迭代聚合局部空间证据、并按任务结构动态调整观察范围的模型。

Result: Adaptive Neural Cellular Automata（aNCA）通过可变形卷积动态适配感知范围，在图像等网格数据上迭代推理二维空间关系。公开基准实验报告该架构在数独等图像谜题和迷宫最短路径任务上表现达到SOTA级，并具有较强泛化能力；摘要未提供基准名称、具体分数或比较细节。

Insight: 迭代局部更新加动态感受野，为网格图像中的空间关系推理提供了不同于一次性全局网络的归纳偏置。当前摘要只称结果具竞争力和泛化性，无法量化其相对优势。

Abstract: Many modern learning approaches are still struggling with spatial reasoning tasks, i.e. they lack the ability to utilize geometric information of perceived entities and their spatial relation to each other to solve problems. We introduce a novel Adaptive Neural Cellular Automata (aNCA) architecture which uses deformable convolutions to dynamically adapt the perceptive field and iteratively reason over 2D spatial relations on grid-like data structures (e.g. images). Empirical results on public benchmarks show state of the art comprehensible results with high generalization abilities for solving image based puzzles like Sudoku or finding the shortest path in a maze.

[70] MedCORE: Criteria-Grounded Clinical Reasoning for Interpretable Medical Image Diagnosis cs.CV | cs.AIPDF

Asim Khan, Samee Ullah Khan, Dwarikanath Mahapatra

TL;DR: MedCORE把临床诊断拆解为明确定义的形态/纹理标准、空间定位证据、多尺度表征、标准间关系图和不确定性校准聚合，在皮肤镜、乳腺超声和糖网病三个模态上分别达到89.2%、96.1%、84.3%准确率，优于多类强基线。

Details

Motivation: 临床诊断本质上是结构化推理，但许多深度模型直接把图像特征映射为疾病标签，没有显式检查医生系统评估的形态和纹理标准，降低可解释性并可能影响安全部署。

Result: MedCORE对每张图像按临床定义标准分解诊断，定位每项标准相关图像区域，以多尺度表征捕捉宏观结构和微观纹理；图注意力网络显式建模标准间依赖。标准表示再与临床文本描述对齐，以类别视觉原型增强，并通过不确定性校准加权降低低置信证据贡献。ISIC 2018皮损分类准确率89.2%、macro-F1 85.7%、AUC 96.4%；BUSI乳腺超声分别96.1%、95.2%、98.4%；IDRiD糖尿病视网膜病分级分别84.3%、80.2%、92.8%。这些结果优于CNN、Transformer、生物医学VLM、概念和原型基线。

Insight: 以临床标准为中间结构，并显式标出证据区域和标准间关系，可让图像分类过程更接近可检查的诊断流程；不确定性加权避免低置信证据被等权累加。三个任务指标较强，但摘要未提供外部临床验证或人类医师比较。

Abstract: Clinical diagnosis is inherently a structured reasoning process, yet existing deep learning models often bypass this structure by mapping image features directly to disease labels without explicitly interrogating the morphological and textural criteria that clinicians systematically evaluate. This limits diagnostic transparency and may compromise safe clinical deployment. We present MedCORE (Medical Criteria-Oriented Reasoning and Evidence), a structured diagnostic framework that operationalizes clinical reasoning within a vision-language architecture. For each input image, MedCORE decomposes the diagnostic process into clinically defined criteria, spatially localizes each criterion to diagnostically relevant image regions, encodes evidence through multi-scale representations that capture macro-structural and micro-textural pathological characteristics, and refines criterion representations using a Graph Attention Network that explicitly models inter-criteria dependencies. Criterion representations are further aligned with clinical text descriptors, reinforced through class-wise visual prototypes, and aggregated using uncertainty-calibrated weighting that proportionally discounts low-confidence diagnostic evidence. MedCORE is validated across three clinically heterogeneous imaging modalities, including dermoscopic lesion classification on ISIC 2018, breast ultrasound lesion characterization on BUSI, and diabetic retinopathy grading on IDRiD. Quantitatively, MedCORE achieves 89.2% accuracy, 85.7% macro-F1, and 96.4% AUC on ISIC 2018; 96.1% accuracy, 95.2% macro-F1, and 98.4% AUC on BUSI; and 84.3% accuracy, 80.2% macro-F1, and 92.8% AUC on IDRiD. These results demonstrate consistent improvements over strong CNN, transformer, biomedical vision-language, concept-based, and prototype-based baselines.

[71] Beyond Perturbation Magnitude: Direction-Dependent Responses in Multimodal Geometric Representations cs.CV | cs.LG | cs.SDPDF

Yongsheng Luo, Wengan He, Yu Li, Rouying Wu, Wei Lv

TL;DR: 本文研究多模态几何对齐分数对视频模糊和音频噪声的响应是否只取决于扰动幅度。MSR-VTT与DiDeMo共1,858个样本显示幅度最多解释15%的绝对响应方差；方向几何响应DGR以局部体积梯度投影同时考虑工作点、幅度和方向，样本外R²为0.838–0.969。

Details

Motivation: 基于Gram行列式的几何对齐分数可概括模态间高阶一致性，但模态受损时该分数如何响应尚不清楚。尤其需要判断扰动影响由幅度决定，还是还依赖表示空间中的方向和当前位置。

Result: 在MSR-VTT（878样本）和DiDeMo（980样本）冻结模型上，作者施加可控视频模糊与音频噪声并分析关系几何变化。扰动位移幅度最多解释绝对响应样本外方差的15%，等幅扰动对分数影响仍系统不同。闭式Gramian体积一阶展开得到Directional Geometric Response（DGR），即位移在局部体积梯度方向的投影，联合反映干净工作点、位移幅度和方向。绝对DGR项对观测响应的样本外R²为0.838–0.969，等幅排序准确率0.864–0.963，响应符号准确率0.909–0.989；无方向替代指标弱或不稳定。预设增益归一化候选V/(gV+ε)未通过可预测性和干净排序门槛。DGR依赖已观察退化后位移，是解释量而非部署时预测器。

Insight: 几何分数对退化的响应不只由扰动大小决定，也由表示所在工作点和扰动方向决定；DGR可解释这种响应但不能预先预测未来退化。归一化候选未通过预设检验，避免将解释结果误作部署信号。

Abstract: Geometric alignment scores based on Gram determinants provide a compact way to model higher-order consistency among modalities, yet how such scores respond to modality degradation is poorly understood. This paper asks whether the response of a multimodal geometric score is determined primarily by the magnitude of the perturbation-induced displacement. Using frozen cohorts from MSR-VTT (N=878) and DiDeMo (N=980), we apply controlled video blur and audio noise and analyze the response in the relational geometry on which the score is defined. Displacement magnitude explains at most 15% of the out-of-sample variance in the absolute response, and magnitude-matched pairs respond systematically differently, so scalar magnitude does not organize the response. The closed-form first-order expansion of the Gramian volume yields the Directional Geometric Response (DGR): the projection of the displacement onto the local volume gradient, which jointly captures the clean operating point, displacement magnitude, and displacement direction. The absolute first-order DGR term explains the observed response with out-of-sample R^2 of 0.838-0.969, matched-magnitude ranking accuracies of 0.864-0.963, and response-sign accuracies of 0.909-0.989, whereas the tested direction-free alternatives remain weak or unstable under the corresponding evaluation protocols. A pre-specified gain-normalization candidate, V/(g_V+eps), fails its predictability and clean-order gates. DGR uses the observed degraded-state displacement and is therefore an explanatory quantity, not a deployment-time predictor: geometric response depends on where the representation operates, how far degradation moves the relational geometry, and in which direction it moves.

[72] RSJEV: Discriminative Remote Sensing Scene Classification with Multimodal Large Language Models cs.CVPDF

Dongchen Si, Di Wang, Mingzhen Xu, Jing Zhang, Bo Du

TL;DR: RSJEV把遥感场景分类改为一次前向的候选条件多模态判别：联合处理图像、任务指令和候选类别语义，直接输出候选概率而不逐token生成。UC Merced、AID和NWPU-RESISC45上优于CNN、Transformer、Mamba、CLIP和MLLM代表方法，0.8B参数模型同时降低推理成本。

Details

Motivation: 遥感场景分类方法包括固定类别视觉分类、静态图文相似度匹配和自回归多模态生成。第一类受限于预定义标签，CLIP式方法依赖静态对齐，而候选类别明确时用MLLM逐token生成会增加不必要开销。

Result: RSJEV构建OnePass Decider，从候选条件下提取多模态决策状态，在候选类别空间内直接估计概率，省去自回归解码并保留视觉—语言交互。在UC Merced、AID和NWPU-RESISC45三个常用基准上，分类性能优于代表性CNN、Transformer、Mamba、CLIP和MLLM方法；仅用紧凑0.8B参数模型即可实现更低推理成本和更好的准确率—效率权衡。摘要未给具体准确率或时延数字。

Insight: 当候选标签集合已知时，直接做候选条件判别比生成完整文本答案更匹配分类任务，也能省去逐token开销。0.8B模型提供轻量部署方向，但摘要未展示各基准数值或与同规模模型的具体对照。

Abstract: Remote sensing scene classification is a fundamental task in Earth observation and geospatial analysis. Existing approaches mainly follow three paradigms: task-specific visual classification, vision-language similarity matching, and autoregressive multimodal generation. However, visual classifiers rely on predefined label spaces, CLIP-based methods perform recognition through static image-text alignment, and multimodal large language models (MLLMs) introduce unnecessary token-level generation for classification tasks with explicit candidate categories. To address these limitations, we propose RSJEV, a one-pass multimodal decision framework for remote sensing scene classification. Unlike conventional MLLMs that formulate classification as autoregressive text generation, RSJEV reformulates scene classification as a candidate-conditioned multimodal discriminative decision process, where visual representations, task instructions, and candidate category semantics are jointly modeled. Specifically, we introduce a OnePass Decider that extracts multimodal decision states and directly estimates category probabilities within the candidate category space, eliminating autoregressive decoding while preserving vision-language interactions. Extensive experiments on three widely used remote sensing scene classification benchmarks, including UC Merced, AID, and NWPU-RESISC45, demonstrate that RSJEV achieves superior classification performance compared with representative CNN-, Transformer-, Mamba-, CLIP-, and MLLM-based methods. Moreover, RSJEV significantly reduces inference costs and achieves a better accuracy-efficiency trade-off with only a compact 0.8B-parameter model. These results demonstrate the effectiveness of state-conditioned multimodal decision making for efficient remote sensing image understanding. The code will be available at https://github.com/Dongtcs/RSJEV.

[73] Have I Seen Enough? Frozen Video-Language Models Encode Evidence Readiness cs.CV | cs.CL | cs.LGPDF

Dan Ben-Ami, Kobi Cohen, Chaim Baskin

TL;DR: 本文发现冻结VideoLLM内部已线性编码问题条件化的“证据是否到齐”信号：七个模型在最严格尚未就绪采样下AUROC为0.733–0.905，错误回答中仍可读出信号（AUROC 0.722）。基于此的Readiness Gating在固定视频时长下可提升准确率最多9.75个百分点。

Details

Motivation: 流式视频模型需同时决定回答什么以及是否已有足够证据。现有系统常把回答时机作为单独触发器训练；作者探究未修改模型是否已在内部表示需要的证据就绪状态。

Result: 研究用时间戳证据而非模型答案标注就绪状态，发现七个冻结VideoLLM都有线性可读信号；最严格not-ready采样下AUROC为0.733–0.905，此时拟合时钟接近随机。未看某基准家族视频训练的探针仍可读出该家族信号。信号依赖问题：对完全相同的视频窗口只换问题，66.1%的配对读出发生反转；问题盲控件按构造为随机。模型即使答错也编码就绪度，AUROC仍0.722。就绪信号在时延匹配答案选择中优于不确定性估计器及其监督组合，也比置信度更贴近独立人类判断。已发布的触发器虽也是线性读出，但其激活方向与就绪信号近乎正交。Readiness Gating在相同视频时长下准确率最多提高9.75个百分点，额外计算几乎为零；26种设置中的增益随任务可提升余量变化。

Insight: 模型内部的证据就绪信号不等同于答案置信度或已训练触发器，而且答错时仍可能存在；基于该信号的时机控制可避免过早或无谓延迟回答。最多9.75点是任务依赖的上限，增益受任务准确率余量制约。

Abstract: Streaming video-language models must decide not only what to answer, but whether the evidence needed for the current question has arrived. Existing systems learn that decision as a separate trigger; we ask whether an unmodified model already computes it. We show that frozen VideoLLMs carry a linearly readable evidence-readiness signal, labelled from timestamped evidence rather than from model output. It decodes in all seven models of a shared byte-identical evaluation (AUROC 0.733-0.905 under the strictest not-ready sampling, where a fitted clock is near chance), and a probe fitted without any of a benchmark family’s footage still reads that family. It is question-conditioned: on byte-identical windows, changing only the question reverses the readout on 66.1% of pairs, while every question-blind control is at chance by construction. The model can answer incorrectly and still encode readiness: AUROC remains 0.722 among wrong answers. Readiness also beats uncertainty estimators and their supervised combination on latency-matched answer selection, and tracks independent human judgments more closely than confidence. Released streaming triggers are also linear readouts, yet a trained trigger read on its own base model’s activations is approximately orthogonal to readiness and decodes it far less accurately than a probe. We turn the readout into Readiness Gating, an answer-timing policy that improves accuracy by up to +9.75 pp at matched video duration with negligible computational overhead. How much it gains varies with the accuracy headroom the task makes available: across 26 configurations the gain tracks that headroom, and an intervention that moves it over identical pixels moves the gain with it.

[74] Forensic Reserve: Eliciting Latent Knowledge for Image Forgery Detection cs.CVPDF

Jiahua Li, Zixu John, Tom Zhong, Fuping Wu, Tianhao Xu

TL;DR: RGE从预训练视觉模型中筛选对真实/生成图像响应不同的稀疏内部方向，将其固定为取证子空间，并仅在选定位置训练低秩预算的Forensic Reserve Adapter。只用500张标注图、可训练参数低于骨干0.2%，在三个伪造检测基准上竞争力强且跨八个视觉骨干均改善冻结检测器。

Details

Motivation: 图像生成日益逼真，伪造检测很重要；现有方法主要靠任务专用监督改造视觉基础模型表示，未充分利用其中已有的潜在取证知识。作者希望从预训练模型内部提取真实/合成图像可区分的响应并以小参数量增强。

Result: Forensic Lens分解不同层和token组的激活，在真实与生成图像间全局筛选响应差异，找到取证储备位置和方向；再把方向映射回隐藏状态形成固定子空间，仅在选定位置插入Forensic Reserve Adapters。骨干、参考分类器和子空间基底保持冻结，只训练FRA系数映射，生成受子空间约束的输入相关残差。使用500张标注训练图和低于骨干0.2%的可训练参数，RGE在三个检测基准上达到有竞争力表现，无需目标基准适配；八个自监督及VLM预训练骨干上均改善相应冻结检测器。

Insight: 预训练模型可能已存有分散的取证响应，关键是定位和结构化地放大这些方向，而非大规模微调。低数据、低参数及跨骨干结果支持这种潜能，但摘要未给具体检测指标或基线差异。

Abstract: As generated images become increasingly realistic, reliable forgery detection is essential for maintaining trust in visual information. However, existing methods primarily rely on task-specific supervision to adapt vision foundation model representations, without fully exploiting internal forensic knowledge to guide detection. To address this limitation, we propose Reserve-Guided Elicitation (RGE), a framework that treats sparse, origin-sensitive internal components in pretrained models as a forensic reserve and translates their localization into structural constraints for lightweight adaptation. Specifically, we first use the Forensic Lens (F-lens) to decompose activations across layers and token groups into independent components and globally screen them by their response differences between real and generated images, identifying reserve sites and directions. Next, we map the selected directions back to hidden-state space to construct fixed reserve subspaces and insert Forensic Reserve Adapters (FRA) only at the identified sites. Finally, with the backbone parameters, previously fitted reference classifier, and subspace bases fixed, we train only the FRA coefficient maps to generate input-dependent residual updates constrained to the corresponding subspaces, strengthening existing forensic responses. Using only 500 labeled training images and a trainable parameter budget below 0.2% of the backbone, RGE achieves competitive performance across three detection benchmarks without target-benchmark adaptation. Furthermore, RGE consistently improves over the corresponding frozen detectors across eight encoders spanning self-supervised and vision-language pretraining, eliciting a latent forensic capacity broadly shared across pretrained vision models.

[75] Stable Scores, Unstable Answers: Frame Phase and Option Order in Video Multiple-Choice Evaluation cs.CVPDF

Lichen Zhu, Yiheng Wang, Yueqian Lin, Hai “Helen” Li, Yiran Chen

TL;DR: 本文发现视频多选评测只报告采样帧率却忽略均匀网格相位：只差半步相位的两个采样器，23.6%问题答案不同但总分差不超过1点。PHASEFUSION融合三个偏移网格，在预设容差内匹配32帧单次精度，并将全网格半步移动造成的答案变化从18.2%降到10.1%。

Details

Motivation: 视频语言模型常以均匀时间网格抽帧做多项选择评测，但网格有帧率和相位两个参数，基准通常只报告帧率。相位轻微移动可能改变答案，却不显著改变总分，造成排名稳定但单题结论不稳定的假象；选项顺序也是另一项呈现因素。

Result: 研究发现两个部署采样器仅差半步相位时，有23.6%的问题答案不同而总分相差不足1点；控制选项顺序后，两个模型系列四个发布版本只改变相位仍约五分之一答案变化。PHASEFUSION解码三个偏移网格并平均选项后验，三网格是密集网格的polyphase分量。融合在预先指定容差内匹配32帧单次推理精度（按logit评分），且三个网格整体半步移位时答案变化率由18.2%降到10.1%。选项顺序效应则由单次答案margin单独标出。

Insight: 报告视频评测时应同时说明采样预算和网格相位，或用相位边缘化降低测量不稳定；总分相近不代表逐题答案一致。PHASEFUSION降低但未消除相位敏感性，选项顺序仍需单独分析。

Abstract: Video-language models are ranked by multiple-choice accuracy on frames from a uniform grid. The grid has two parameters, a rate and a phase, and benchmarks report only the rate. The phase moves answers: two deployed samplers differing only by a half-step phase offset answer 23.6% of questions differently while scoring within a point, and across four releases from two families shifting only the phase changes roughly one answer in five after controlling option order. PHASEFUSION decodes three offset grids and averages the option posteriors. The grids are the polyphase components of the dense grid. Fusion matches a 32-frame single pass in accuracy within a prespecified margin (logit-scored) and cuts the answers a half-step shift of all three grids changes from 18.2% to 10.1%. Option order, which changes only the presentation, is flagged instead by a one-pass answer margin. Report the phase convention with the budget, or marginalize it.

[76] Selective Transfer of RL Updates for Visual Reasoning cs.CV | cs.AIPDF

Suxin Ji, Hungtao Wan, Mingjun Liu, An Zhang

TL;DR: Selective-RL只迁移强化学习后训练阶段产生的权重更新，并保留其主导矩阵方向、保持更新幅度，再注入VLM语言模块，避免端点合并混淆既有能力差异与RL新增能力。三模型家族、五个视觉推理基准共15项比较中，12项优于完整更新插值；Qwen接收模型MathVision提升8.55个百分点。

Details

Motivation: 模型合并可免训练地把语言模型推理迁移给VLM，但直接合并训练终点会混淆模型原有差异与推理后训练新增能力。即使单独提取RL更新，其不同方向的跨模型可迁移性也不同，完整更新未必是最佳迁移单元。

Result: Selective-RL隔离RL阶段权重更新，筛选其主导矩阵方向并保持更新幅度后，迁移到VLM语言模块。跨三个模型家族和五个视觉推理基准共15项比较中，12项优于完整更新插值；Qwen接收模型在MathVision提升8.55个百分点。匹配控制显示，单纯保持更新幅度或使用任意低秩分解都不能复现收益。

Insight: 跨模型迁移应区分预训练终点已有能力和RL新获得能力，也应选择可迁移的主导更新方向，而非全量参数更新照搬。15项比较支持选择性优于完整插值，但仍有3项没有胜出。

Abstract: Model merging provides a training-free way to transfer reasoning capabilities from language models to vision-language models (VLMs), but endpoint-based transfer can conflate pre-existing model differences with changes acquired during reasoning post-training. We instead formulate capability transfer around the training-stage update, isolating the parameter changes induced by reinforcement learning (RL). Yet transferring this update in full remains suboptimal: we find that its components differ substantially in cross-model transferability, with dominant directions transferring more effectively than the complete update. Based on this finding, we introduce Selective-RL, which isolates the RL-stage update, retains its dominant matrix-wise directions with magnitude preservation, and transfers them to the language modules of a VLM. Across three model families and five visual-reasoning benchmarks, Selective-RL improves full-update interpolation in 12 of 15 comparisons, including an 8.55 percentage-point MathVision gain on the Qwen recipient. Matched controls show that update magnitude or arbitrary low rank alone does not reproduce these gains. These results highlight a distinction between what is acquired during post-training and what remains transferable across models, providing a training-stage perspective on cross-model capability transfer. Code is available at https://anonymous.4open.science/r/selective-rl.

[77] Knowing When to Trust a Prior: Reliability-Gated Cue Fusion for Video Gaze Prediction cs.CVPDF

Lichen Zhu, Yueqian Lin, Yiheng Wang, Hai “Helen” Li, Yiran Chen

TL;DR: FocusGate为视频注视预测融合无需注视标签训练的先验，逐帧根据离焦图三项形态统计判断何时信任先验；拒绝帧退化为原始预测，零值先验可零参数弃权。加入四个监督预测器后，16个模型—领域组合的shuffle AUC全提升、15项显著，延迟仅增加1%；无条件融合在运动/网页视频反而有害或无效。

Details

Motivation: 注视预测主要依靠注视标注训练模型，但无需注视训练的视觉先验也含有补充信号。关键是判断何时相信这些先验；若无条件融合，可能在先验不可靠时损害已有模型。

Result: FocusGate对可弃权的免注视先验做门控集成，逐帧读取离焦图的三项形状统计，并选择估计器平均表现高于随机的帧；被拒绝帧严格回退到基础预测。中秩归一化使全零先验也可零参数弃权。门控融合在电影、体育和网页视频上显著为正，而无条件融合在体育上有害、在网页上无效。接入包括NTIRE 2026冠军在内的四种监督预测器后，16个模型—领域单元shuffle AUC全部提升，15项显著，且延迟仅增加1%。单独使用时，FocusGate在电影上以16帧因果均值的shuffle AUC超过TASED-Net和UNISAL。

Insight: 无标签先验的效用依视频领域和帧内容而变，可靠性门控优于无条件叠加；拒绝机制确保不可靠先验不会改变基础输出。实验覆盖多个领域和模型，但单独优于基线只报告电影域。

Abstract: Video gaze prediction is led by gaze-trained models, yet gaze-free priors carry signal those models have not absorbed, if one knows when to trust them. We propose FocusGate, a gated ensemble of gaze-free priors whose members may abstain. A per-frame gate reads three shape statistics of a defocus map and selects the frames on which the estimator is above chance on average, so rejected frames reduce to the base exactly, while midrank normalisation lets an all-zero prior abstain at zero parameters. Gated fusion is significantly positive on film, sports and web video, whereas unconditional fusion is harmful on sports and null on web. Added to four supervised predictors, the NTIRE 2026 champion among them, FocusGate improves all sixteen model-domain cells in shuffled AUC, fifteen significantly, one domain pre-registered and scored once, while adding only 1% to the champion’s latency. Alone, it surpasses TASED-Net and UNISAL in shuffled AUC on film with a 16-frame causal mean.

[78] PDB: Point-Based Deformation Blending for Facial Animation Retargeting cs.CV | cs.GRPDF

Sihun Cha, Hyeonseung Shin, Suah Yu, Junyong Noh

TL;DR: PDB用一组变形控制点及目标网格专属混合权重完成跨网格面部表情重定向：权重每个目标只计算一次、跨帧复用，控制点随源表情变化；无需预设笼、全局求解或成对跨身份训练表达。

Details

Motivation: 不同拓扑网格间的面部动画重定向需要保留表情运动，又避免表面伪影。许多方法需要预设控制笼、逐元素变形解码器或全局重建求解，且跨身份监督数据难获得。

Result: PDB从源中性脸—表情脸对预测紧凑变形控制点，并从目标中性网格计算混合权重；权重只针对目标计算一次并跨帧复用，控制点则随每个源表情变化。ReLU保证权重非负并允许精确为零，再逐行归一化；目标网格由权重与控制点直接相乘重建，无需预设笼、预计算坐标、逐元素变形解码器或全局求解。仅用自重定向重建监督训练即可支持无跨身份配对表情训练的身份间迁移。实验报告重定向准确、推理快且权重局部化；联合评估表情准确性与表面保持时，较所测稠密位移方法减少表面伪影并保留目标运动；感知评估也支持自/跨身份表情保真和视觉质量。

Insight: 以目标网格一次性权重和随源表情变化的控制点做线性组合，使跨身份重定向既可局部化又避免全局重建优化。摘要报告定性优势，但未给误差、运行时间或人类偏好数字。

Abstract: Mesh-agnostic facial animation retargeting transfers expressions across meshes with different structures, but preserving facial motion without surface artifacts remains challenging. To address this, we present PDB, Point-Based Deformation Blending for facial animation retargeting. PDB predicts a compact set of deformed control points from a source neutral-expression pair and blending weights from the target neutral mesh. The weights are computed once per target and reused across frames, while the control points vary with each source expression. ReLU enforces non-negative weights and permits exact zeros, followed by row-wise normalization. The target mesh is reconstructed directly by multiplying the weights and control points, without a predefined cage, precomputed coordinates, a learned per-element deformation decoder, or a global reconstruction solve. Trained only with self-retargeting reconstruction supervision, PDB supports cross-identity transfer without paired cross-identity training expressions. Experiments demonstrate accurate retargeting, fast inference, and localized support in the learned weights. Joint evaluation of expression accuracy and local surface preservation shows reduced surface artifacts relative to the evaluated dense displacement method while retaining the intended motion. Perceptual evaluations further support expression fidelity and visual quality in both self- and cross-retargeting.

[79] EC-RAG: Event Chain Retrieval-Augmented Generation for Long Video Understanding cs.CVPDF

Yuhao Qin, Junbo Wang, Yuke Li, Yining Zhu

TL;DR: EC-RAG在长视频问答前先将语义连贯片段构成显式事件链，再按问题检索相关事件并聚合对应语音、文本和视觉证据；Video-MME、MLVU和LongVideoBench上持续优于帧级检索基线，无需额外训练或专有模型。

Details

Motivation: 长视频模型常独立处理帧，难以捕捉事件间时间依赖。多数检索增强方法仍在帧或短片段层级取证，无法显式表示事件如何随时间发展及相互关联。

Result: 免训练EC-RAG先把视频切为语义连贯片段，用多模态信号表示各片段，再按时间顺序和事件关系组成结构化事件链。给定问题后，系统在链中识别相关事件并收集对应模态证据。事件级抽象改善相对帧级检索的定位；结构化多模态融合在事件层面整合语音、文本和视觉线索；框架可即插即用兼容现有LVLM骨干。Video-MME、MLVU和LongVideoBench实验中持续优于帧级检索基线；摘要未给具体数值。

Insight: 长视频证据常以事件而非孤立帧组织，显式事件链可同时保留时间顺序、事件关系及跨模态线索。免训练插件适配现有骨干，但摘要未量化收益或事件链构建成本。

Abstract: Current large video-language models (LVLMs) still face challenges when dealing with long videos, mainly because frames are often processed independently, making it difficult to capture temporal dependencies across events. Although retrieval-augmented approaches have been introduced to provide additional context, most of them operate at the frame or snippet level, which limits their ability to model how events evolve over time and relate to each other. In this paper, we propose Event Chain Retrieval-Augmented Generation (EC-RAG), a training-free framework that organizes video content into an explicit event chain before question answering. Instead of retrieving isolated frames or text segments, EC-RAG first partitions the video into semantically coherent segments, represents each segment using multi-modal signals, and then links them into a structured chain that preserves temporal order and captures inter-event relationships. Given a query, the system identifies relevant events within this chain and gathers supporting evidence from the associated modalities. Our approach offers several practical advantages: (i) event-level abstraction that better reflects how video content is naturally structured, enabling more reliable localization compared to frame-level retrieval; (ii) structured multi-modal fusion that aggregates speech, text, and visual cues at the event level, allowing complementary information to be more effectively utilized during reasoning; and (iii) plug-and-play compatibility with existing LVLM backbones, requiring no additional training or reliance on proprietary models. Experiments on Video-MME, MLVU, and LongVideoBench show that this event-centric design consistently outperforms frame-level retrieval baselines, highlighting the importance of modeling temporal structure for long-video understanding.

[80] RenderBench: Benchmarking Render-to-Real Video Transfer with Reconstructed Digital Twins cs.CVPDF

Dicong Qiu, Zhiyuan Xu, Yaosheng Liu, Feng Han, Bo Ye

TL;DR: RenderBench是评估视频模型从代理渲染迁移到真实视频的基准，包含12个重建真实场景、1,496对真实/代理帧、可编辑数字孪生及渲染器原生标注。场景需通过多视角几何和时间验证；代理图深度si-RMSE为0.2170、实例mIoU为0.3673。

Details

Motivation: 评估视频模型的render-to-real能力需要同一场景演化的真实目标视频、可编辑且几何配准的3D副本及代理渲染；过去这些数据需大量人工建模、标定和动画制作，难以规模化构建。

Result: RenderBench包含12个重建真实场景，覆盖大型室内环境和第一人称视角，含静态与动态设置。构建流程结合视觉几何、神经重建和辅助3D创作，将每场景拆为静态物体和动态角色、与拍摄相机配准，并经多视角几何/时间验证。每个评估单元含外观参考图、留出真实目标视频、可编辑数字孪生、匹配代理渲染和渲染器原生场景标注。首版从14个注册样本保留12个（85.7%），共1,496对真实—代理帧；所有场景通过文件完整性和环境编辑审计。代理诊断深度si-RMSE为0.2170、实例mIoU为0.3673。基准可同时评估外观保真与几何/动态保持，并按物体、可见性、关节和运动定位失败。

Insight: 提供配对真实观测和可编辑场景状态，可把外观迁移效果与几何/动态保真分开评测；渲染器标注还能支持细粒度失败定位。当前首版仅12个场景，代理深度和实例分割诊断也表明匹配仍有误差。

Abstract: Modern video models can generate realistic videos from real appearance references and proxy renders that specify scene structure, viewpoint changes, and motion. Evaluating this render-to-real capability requires a real target video depicting the same scene evolution, paired with an editable, geometrically registered 3D replica. Such data has traditionally required substantial manual modeling, calibration, and animation effort. We introduce RenderBench, a benchmark of 12 reconstructed real-world scenes spanning large-scale indoor environments and egocentric viewpoints, with both static and dynamic settings. Our construction pipeline combines visual geometry, neural reconstruction, and assisted 3D authoring. Each scene is decomposed into static objects and dynamic actors, registered to the capture cameras, and accepted only after multi-view geometric and temporal validation. Each evaluation unit contains appearance reference images, a held-out real target video, an editable digital twin, a matched proxy render, and renderer-native scene annotations. We evaluate transfer models against paired real target videos, retain PAI-Bench-C-compatible structural projections, and use scene annotations to localize failures by object, visibility, articulation, and motion. The first release retains 12 of 14 registered samples (85.7%), comprising 1,496 paired real-proxy frames. All released scenes pass file-integrity and environment-edit audits, while proxy diagnostics yield a depth si-RMSE of 0.2170 and instance mIoU of 0.3673. RenderBench provides paired real observations and editable scene state for assessing both appearance fidelity and preservation of geometry and dynamics.

[81] SpaTime: Streaming Vision-Language Models for Spatio-temporal Reasoning cs.CVPDF

Hairong Yin, Huangying Zhan, Shin-Fang Chng, Yi Xu, Raymond A. Yeh

TL;DR: SpaTime把因果几何token逐帧融合进流式VLM，并训练模型决定观察到哪一帧就应回答，以联合实现在线3D空间推理和答案时机控制。作者构建StreamVSTI-Bench与StreamVSI-Bench；StreamVSTI上整体准确率49.2%，相对最强流式基线将平均响应时间误差降低66%。

Details

Motivation: 具身智能体需在视频仍到达时进行3D空间推理，并在证据足够后立即回答。含3D先验的VLM能较强离线推理，但必须等完整视频；流式VLM可因果处理并自行决定何时回答，却缺少显式3D表示。

Result: SpaTime只使用当前及此前帧，每帧向语言模型融合因果几何token。为监督回答时机，提出响应时间损失，将逐帧响应概率映射为可微期望响应时刻，并惩罚其与真实证据帧的距离。作者构建StreamVSTI-Bench和StreamVSI-Bench，分别是VSTI-Bench与VSI-Bench的流式改造。StreamVSTI-Bench上整体准确率49.2%，相对最强流式基线平均响应时间误差减少66%；摘要未提供第二基准具体分数。

Insight: 流式空间推理需要在几何表示和时机判断上同时建模；逐帧几何token提供显式3D线索，期望响应时间损失促使模型等到必要证据出现但不过度延迟。49.2%说明整体准确率仍有提升空间。

Abstract: Embodied agents must reason about 3D space while the video is still arriving, answering questions as soon as they have observed enough of the scene. VLMs that incorporate 3D geometric priors achieve strong spatial reasoning, but they operate offline, i.e., the full video must be available before they produce an answer. Streaming VLMs process frames causally and decide for themselves when to respond, yet they lack explicit 3D representations. We present SpaTime, a streaming VLM that fuses causal geometry tokens into the language model at every frame, using only the frames observed so far. To supervise when the model answers, we propose a response-time loss that maps per-frame response probabilities to a differentiable expected response time and penalizes the distance from the ground-truth frame. For evaluation, we construct StreamVSTI-Bench and StreamVSI-Bench, streaming adaptations of VSTI-Bench and VSI-Bench. On StreamVSTI-Bench, SpaTime reaches 49.2% overall accuracy and reduces the mean response-time error by 66% relative to the strongest streaming baseline.

[82] Backend-Agnostic Sparse Attention for Fast High-Resolution Visual Generation cs.CVPDF

Liao Ma, Jiayi Song, Yunfeng Wu, Songhua Liu, Peilin Zhao

TL;DR: BASA用跨层移位的局部窗口注意力取代DiT视觉全注意力：窗口边界在一层被切断的token可在后续层通信，从而减少窗口伪影，不需不规则算子或定制kernel。在FLUX上实测速度超过理论稀疏加速估计的90%，Wan上注意力加速4.52倍且生成质量有竞争力。

Details

Motivation: 高分辨率图像和视频生成中DiT全注意力二次复杂度昂贵。分块窗口效率高却阻断窗口交互、产生网格伪影；细粒滑窗可恢复邻窗交互和质量，但不规则计算使理论加速难以落地，并需要不同硬件专用kernel。

Result: Backend-Agnostic Sparse Attention（BASA）以移位局部窗口注意力替代视觉自注意力，跨DiT层采用结构化移窗，使一层被窗口边界隔开的token能在后续层交互，实现全局信息传播并消除窗口伪影。方法不引入额外不规则算子或定制kernel，兼容现有注意力后端。实验在FLUX上达到理论估计加速的90%以上；在Wan上获得4.52倍注意力加速，同时保持有竞争力生成质量。

Insight: 规整的跨层移窗可在避免窗口伪影的同时保留硬件友好计算，缩小稀疏理论复杂度与实际速度之间的差距。速度结果依赖模型和后端；摘要未给具体端到端加速或质量分数。

Abstract: Diffusion Transformers (DiTs) have achieved strong performance in image and video generation, but the quadratic complexity of full attention makes high-resolution generation computationally expensive. Window attention offers an efficient alternative, yet existing methods face a practical trade-off: partitioned window attention typically achieves computational efficiency consistent with its theoretical complexity. However, isolated windows block cross-window interaction, often introducing visible grid-like artifacts in the generated results. Fine-grained sliding-window attention effectively restores interactions across neighboring windows and improves visual quality. However, its irregular computation patterns create a substantial gap between theoretical and practical speedups and require specialized kernels tailored to each hardware backend. To tackle these challenges, we propose BASA, a backend-agnostic sparse attention, which brings the best of both worlds: visual quality and practical acceleration. Specifically, BASA replaces visual self-attention with shifted local-window attention. By introducing a structured window-shifting scheme across DiT blocks, we allow tokens divided by window boundaries in one layer to communicate in the following layers, thereby achieving global information exchange and eliminating window-induced visual artifacts. Notably, our design introduces no additional irregular operators or customized kernels, making it readily deployable on existing attention backends and closing the gap between theoretical sparsity and practical acceleration. Experiments demonstrate that BASA achieves measured speedups exceeding 90% of the theoretical estimates on FLUX and delivers a 4.52$\times$ attention speedup on Wan while maintaining competitive generation quality.

[83] CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching cs.CVPDF

Shangye Song, Dong Gong, Hong Jia, Yun Sing Koh, Xinyu Zhang

TL;DR: CtrlCache是免训练的交互式视频世界模型控制感知缓存策略，利用提前到达的动作控制识别初始、转变、转向和稳定片段，并在转向/稳定片段复用同一块内上次完整计算残差；低频历史先验无需额外DiT前向。在三种世界模型上加速1.21–1.41倍，并提升WBench Overall。

Details

Motivation: 交互式视频世界模型需高效生成每个片段并忠实响应用户控制。分块自回归、少步去噪仍要多次昂贵计算；现有免训练缓存主要依据模型内部去噪动态决定复用，没有显式考虑片段间控制变化，而控制在去噪开始前已知。

Result: 作者发现动作改变附近相邻片段结构相似性下降，但低频结构比高频细节更持久。CtrlCache根据跨片段及片段内动作变化做调度和刷新，将片段分为初始、过渡、转向、稳定状态；选定内部去噪步时，初始/过渡片段执行完整计算，转向/稳定片段复用本片段最近一次完整计算的Transformer残差。稳定交互时再加入频率混合历史先验，利用前一干净潜变量而不额外执行DiT。在Matrix-Game 2.0和LingBot-World v1/v2上，不重训取得1.21–1.41倍骨干加速，三种模型WBench Overall均优于原推理。

Insight: 用户控制在生成开始前已可用，可用来预判缓存安全性；动作转变时刷新、稳定时复用，并利用持续低频结构，减少无效去噪计算。报告包括速度和WBench改善，但具体控制任务质量指标摘要未详列。

Abstract: Interactive video world models need to generate each video chunk efficiently while responding faithfully to user controls. Many systems use chunk-wise autoregressive generation with few-step denoising, but each chunk still requires several costly denoising iterations. Training-free caching can reduce this cost, yet existing policies make reuse decisions primarily from model-internal denoising dynamics and do not explicitly account for control transitions. Actually, interactive generation explicitly exposes a signal they do not use: the controls for a chunk arrive before it is denoised, so a schedule derived from them costs no forward pass. To this end, we analyze adjacent chunks under different control regimes and find that structural similarity drops around action changes, while low-frequency structure remains more persistent than high-frequency detail. Motivated by these observations, we propose CtrlCache, a training-free control-aware caching framework that adapts computation to the current control sequence. Specifically, the action-aware scheduling and refresh policy detects action changes across and within chunks, and labels each chunk as initial, transition, turning, or steady state. At one selected interior denoising step, initial and transition chunks retain full computation, while turning and steady chunks reuse the transformer residual from the most recent fully computed step in the same chunk. To exploit the persistence of low-frequency structure during steady interaction, we further introduce a frequency-mixed history prior guidance that incorporates complementary information from the preceding clean latent without an additional DiT forward pass. Evaluated on Matrix-Game 2.0 and LingBot-World v1/v2, CtrlCache achieves 1.21x to 1.41x DiT-backbone speedups without model retraining while improving WBench Overall scores over original inference across all three models.

[84] ALIVE: Interaction-Aligned Object Insertion for First-Frame-Guided Video Editing cs.CVPDF

Zhenghong Zhou, Zhe Lin, Jiebo Luo, Yuqian Zhou

TL;DR: ALIVE让视频编辑插入物体后能与源视频中的动作发生连贯交互，以编辑后的首帧和仅命名新增物体的指令作为输入。构建35,800组多源编辑配对及ALIVE-interaction基准；无VLM指导时，两个基准Overall较最强评测基线分别提升43.9%和4.4%，VLM交互指导再提高0.95分。

Details

Motivation: 现有视频编辑器能插入对象，但常无法让新物体参与被拿起、操纵等互动，造成对象像贴在画面上，且可能破坏源视频动作。

Result: ALIVE使用编辑后首帧和仅指定新增物体的指令生成与原视频内容互动一致的结果。作者整理35,800组编辑配对，结合3D渲染、模型生成和真实视频，并纳入ROSE通用编辑对；配对视频只在目标物体是否存在上不同，保留周围动作以教模型协调对象行为和源内容。另训练VLM从相同输入预测交互指导，并构建ALIVE-interaction基准，以统一VLM协议评估交互保真、源视频保持和视觉连贯。无VLM指导时，两个基准Overall比最强基线分别高43.9%和4.4%；VLM预测指导无需额外用户输入，又让ALIVE-interaction分数提升0.95。

Insight: 物体插入不仅要合成目标外观，还需从首帧和上下文推断其如何加入既有动作；数据配对显式保留周围动作有助于学习互动。摘要未说明43.9%和4.4%是相对增幅还是百分点。

Abstract: Current video editors can insert objects but often struggle to make them participate in interactions such as being picked up or manipulated. We introduce ALIVE, a framework that makes inserted objects “alive” through coherent interactions with the source video’s contents, using an edited first frame and an instruction naming only the added object. We curate 35,800 editing pairs combining 3D-rendered, model-generated, and real-world videos with general editing pairs from ROSE. Each pair differs in the target object’s presence while preserving the surrounding action, teaching editors coordinated object behavior and source preservation. We further train a vision-language model (VLM) to predict interaction guidance from the same inputs. We introduce the ALIVE-interaction benchmark to assess interaction fidelity, source preservation, and visual coherence using a unified VLM-based protocol, and evaluate on the general video object insertion benchmark. Without VLM guidance, ALIVE improves Overall over the strongest evaluated baseline by 43.9% and 4.4% on the two benchmarks, respectively. VLM-predicted guidance further improves the ALIVE-interaction score by 0.95 points without additional user inputs.

[85] 4D-HOF: Hand-Object Flow Matching for Feed-Forward 4D Interaction Reconstruction cs.CV | cs.AI | cs.GRPDF

Shiqi Li, Sean Cho, Yijie Li, Fengzhi Guo, Bowen Wen

TL;DR: 4D-HOF用条件flow matching从视觉基础模型给出的粗略手—物状态出发，将其输运到交互合理的4D重建流形，前馈修正平移、旋转和对齐；推理时可在生成输运过程中直接加入物理约束和2D观测引导，无需重建后单独优化。

Details

Motivation: 现有4D手—物重建常需昂贵的逐序列优化，纯生成方法又通常从随机噪声合成交互，预测可能不稳定。需要既利用预训练视觉模型的粗定位，又提供稳定、可约束的交互恢复方式。

Result: 4D-HOF以视觉基础模型产生的粗但有信息的手—物状态为条件，训练flow matching把状态输运到交互流形，前馈校正平移、旋转和对齐误差。生成式形式支持测试时引导：在状态演化过程中直接加入物理交互约束和观测2D证据，而不是重建后再做独立优化。多样数据集训练使其泛化到复杂野外场景。OOD基准上达到SOTA，并生成更稳定、准确的4D手—物重建；摘要未给具体指标。

Insight: 以粗视觉状态为条件进行flow修正，可比从随机噪声生成更稳定；把物理与2D观测约束融入生成输运过程，也避免耗时后处理优化。结果强调跨域能力，但未量化基线提升或推理速度。

Abstract: Existing methods for 4D hand-object reconstruction often rely on costly per-sequence optimization, while generative approaches typically synthesize interactions from random noise, which can lead to unstable interaction prediction. We introduce 4D-HOF, a feed-forward framework that reconstructs 4D hand-object interactions from coarse but informative estimates produced by vision foundation models. Concretely, we learn a conditional flow matching model that transports foundation-model-derived hand-object states toward an interaction manifold, allowing the model to correct errors in translation, rotation, and alignment in a feed-forward manner. A key advantage of our generative formulation is that it naturally enables test-time guidance within the transport process. Rather than applying a separate post-hoc optimization after reconstruction, we directly steer the evolving generative states using physical interaction constraints and observed 2D evidence, allowing the reconstruction to be refined as part of the generative process itself. By training the generative model on diverse datasets, 4D-HOF generalizes robustly to challenging in-the-wild scenarios. Experiments on out-of-domain benchmarks show that 4D-HOF achieves state-of-the-art performance, producing more stable and accurate 4D hand-object reconstructions.

[86] World Models’ Last Exam in Physics cs.CVPDF

Mingju Gao, Qingle Liu, Yuzhao Peng, Xinjie Lin, Ziming Qin

TL;DR: World Models’ Last Exam in Physics是基于可观测物理量的生成视频一致性基准，含40个任务、覆盖力学、光学、流体、热学/相变、电磁和表面张力，不需参考视频。八个生成模型的1,280段视频显示持续物理不一致，最佳总分57.76/100；测量评估器比直接VLM判断更符合人类。

Details

Motivation: 视频世界模型可能生成视觉逼真却违反物理规律的序列，影响具身AI的预测和规划可靠性。既有评测常依赖模型判断或参考视频，直接物理测试又主要局限于力学。

Result: 基准含40个受控任务，覆盖力学、光学、流体、热与相变、电磁、表面张力；每项将初始图像、生成提示和预先定义的物理关系标准配对，无需参考视频。评估器先检查任务可观测性，再做任务特定的定量物理测量。八个视频生成模型共1,280段视频的结果显示物理不一致持续存在、任务间差异大，最佳总分57.76/100。用已知物理关系的合成视频验证测量模块；评估器在任务内排序和成对比较上均比直接VLM基线更符合人类判断。

Insight: 基于显式测量的物理关系评估可避免把视觉逼真度误当物理合理性，也能跨物理领域诊断失败。最佳模型57.76/100表明仍有明显差距；基准同时强调可观测性筛查和测量限制，避免对不可测属性过度下结论。

Abstract: Video world models can produce visually convincing yet physically inconsistent sequences, raising concerns about their reliability for prediction and planning in embodied AI systems. Existing evaluations often rely on model-based judgments or reference videos, while direct physical tests largely focus on mechanics. We introduce World Models’ Last Exam in Physics, a measurement-based benchmark for evaluating physical consistency in video world models. The benchmark comprises 40 controlled tasks spanning mechanics, optics, fluids, thermal and phase-change phenomena, electromagnetism, and surface tension. Each task pairs an initial image and a generation prompt with predefined physical criteria, enabling interpretable tests of observable physical relationships without requiring reference videos. Its evaluator combines task-observability screening with task-specific quantitative physical measurements. Experiments on eight video generation models across 1,280 videos reveal persistent physical inconsistencies and substantial variation across tasks, with the best model achieving an overall score of 57.76 out of 100. Evaluation on synthetic videos with known physical relationships provides evidence for the validity of the measurement module under controlled conditions. The evaluator also achieves higher agreement with human judgments than a direct vision-language model baseline in both within-task rankings and pairwise comparisons. By combining coverage across physical domains with scores grounded in measurable evidence and explicit measurement limitations, the benchmark provides an interpretable basis for diagnosing physical inconsistencies and tracking progress toward physically consistent video world models.

cs.CL [Back]

[87] Identifying Introspection From the Inside cs.CLPDF

David I. Atkinson, Dillon Plunkett, David Bau

TL;DR: 本文在受控虚构角色偏好任务中发现，持续训练可让模型在无显式自述监督下准确报告其学到的偏好；忠实自述模型会把偏好表征移到较早层，并在决策和自述任务间呈现更高的归因相似度，可作为机制层面的忠实性信号。

Details

Motivation: 大语言模型对自身状态和偏好的自述可能影响重要决策，但仅凭行为难以区分真实内省和听起来合理的编造。作者希望在可控设置中寻找忠实自我报告的机制性迹象，而不仅是检查自述内容。

Result: 研究通过低秩适配器训练模型代表虚构角色，根据潜在线性偏好函数做决策。隐式决策任务的持续微调可使模型准确自述学到的偏好，即使没有自述监督。权重消融和冻结层实验表明，偏好表示会在训练过程中向较早层迁移，符合“忠实自述要求偏好位于既有语言表达机制可访问的位置”这一假设。归因patching显示，忠实模型的决策任务与自述任务间归因相似度显著更高，可在不理解报告内容的情况下作为机制信号。

Insight: 在受控任务中，忠实自述与内部决策和报告计算路径更相似相关，且偏好表示位置可能影响其能否被语言输出机制读取。该机制证据限于虚构角色偏好和线性函数设置，不能直接证明开放式现实场景中的模型具备广义内省。

Abstract: Large language models make claims about themselves that are both consequential and increasingly difficult to verify from behavior alone. How can we distinguish plausible confabulations from genuine introspection? In this paper, we identify mechanistic signatures of faithful self-report in a controlled setting. Using low-rank adapters, we train models to make decisions on behalf of fictitious characters, according to latent linear preference functions. We find sustained fine-tuning on an implicit decision task can lead to the emergence of accurate self-reporting of models’ learned preferences, even without explicit self-report supervision. We ask two research questions about this emergent phenomenon. First: is the emergence of accurate self-reporting accompanied by a measurable structural change in the model? Weight ablations and frozen-layer experiments together indicate that preference representations shift to earlier layers over training, consistent with the hypothesis that faithful self-report requires preferences to be located where pre-existing verbalization mechanisms can access them. Second: can these structural differences distinguish faithful models from unfaithful ones? Using attribution patching, we find that faithful models exhibit significantly higher attribution similarity between the decision-making and self-report tasks – a mechanistic signature of faithful self-report that does not require us to understand the content of the report itself. Previous work on self-report has observed behaviorally that models can be faithful or unfaithful; our work proposes that, at least in our restricted setting, it is possible to distinguish between the two patterns of computation by examining the structure of the networks themselves.

[88] Two Vectors Replace In-Context Demos: Structured Task Adaptation via Embeddings cs.CL | cs.CV | cs.LGPDF

Xi Ding, Naichen Shi, Jiawei Zhang

TL;DR: STAVE以两个任务专属向量替代多模态模型逐查询重编码上下文示例：readout向量更新答案token，context向量更新其他结构token组。六个LMM和五个LLM实验中，其多模态表现匹配或超过SOTA方法且任务参数更少；18个文本任务上超过15-shot上下文学习，推理成本为零样本级别。

Details

Motivation: 上下文学习可让冻结多模态大模型通过少量示例适配新任务，但每次查询都需重编码示例，每张图可能引入数百个视觉token。免示例方法虽压缩任务状态，却常需按任务搜索插入位置或在每个解码器层添加参数，且插入token/键不能改变层内原提示的注意力分配。

Result: Structured Task Adaptation via Embeddings（STAVE）用两个任务向量直接加到已有输入嵌入：readout向量更新生成答案的token，context向量更新其他结构token组；二者在含示例和不含示例的提示上用答案标签训练。作者用损失的一阶分析和间隔界为设计提供理论论证。六个LMM和五个LLM实验显示，多模态任务上可匹配或超过SOTA且任务参数大幅减少；18个文本任务上超过15-shot ICL和既有任务向量，同时推理成本达到零样本级别。

Insight: 把任务适配向量直接加到输入嵌入不同结构组中，既保留对原提示注意力分配的影响能力，又避免每次重编码示例及逐层增加任务参数。实验跨多模型和任务，但摘要未具体量化参数节省量或逐任务差异。

Abstract: In-context learning (ICL) adapts frozen large multimodal models (LMMs) to new tasks from a few demonstrations (demos), but re-encodes them at every query, where each demo image adds up to hundreds of visual tokens. Demo-free methods remove this cost with a compact task state. However, they add it at locations searched per task or at every decoder layer, where task parameters grow with depth. Moreover, inserted tokens or keys cannot change how the original prompt divides its attention within a layer. To address these issues, we propose Structured Task Adaptation via Embeddings (STAVE), which replaces demos with two task-specific vectors added to existing input embeddings. Specifically, a readout vector updates the answer-producing tokens and a context vector updates the other structural token groups. Both are trained with answer labels on prompts with and without demos. We justify these design choices theoretically using a first-order analysis of the loss and a margin bound. Extensive experiments on six LMMs and five large language models show that STAVE matches or outperforms state-of-the-art methods on multimodal tasks with far fewer task parameters and surpasses 15-shot ICL and prior task vectors on 18 text tasks, all at zero-shot inference cost.

[89] Large Language Model Orchestration under Heterogeneous Preferences via Explicit Persona Inference cs.CLPDF

Shuqing Shi, Ziyan Wang, Milind Tambe, Yali Du

TL;DR: HARP把多智能体协调中的隐藏偏好信念从提示文本移到显式数值后验：语言模型只提供动作和候选偏好似然，系统按贝叶斯规则闭式更新。偏好分解精确时，理论贝叶斯遗憾与显式联合推断同为约O(√K)；HARP+加入信息增益式探索奖励。

Details

Motivation: 多智能体协调器需要推断各智能体的私有偏好并据此协调。传统LLM协调器把对偏好的信念写在提示中而没有明确更新规则，早期错误容易持续传播。核心难点是跟踪每个智能体的偏好后验并根据其行为更新。

Result: HARP为每个智能体维护在有限候选偏好上的数值后验，并用贝叶斯规则闭式更新；LLM只负责提出行动和各候选偏好的似然，使统计估计与语言推理解耦。作者证明在分解假设精确时，其贝叶斯遗憾与显式联合推断相同，为约O(√K)。HARP+在规划中加入区分候选偏好的行动奖励，使即使当前最优行动不具信息量，系统仍能继续推断。跨三个基底的实验从偏好完全决定收益、收益还受其他因素影响，到显式联合推断不可行的规模，显示HARP+是理论适用类别中最强的非oracle方法。

Insight: 将偏好不确定性显式表示为后验，可纠正提示文本信念难以更新和早期错误累积的问题；探索奖励进一步权衡短期收益与获取偏好信息。理论保证依赖偏好分解精确，实验也覆盖非精确收益和大规模情形，但摘要未给具体遗憾数值。

Abstract: LLM orchestration investigates how an orchestrator coordinates a group of autonomous agents to achieve common goals or maximize collective welfare. The agents are typically heterogeneous, each holding a private preference that it pursues but does not reveal. Inferring such hidden preferences from behavior has been a subject of long-standing research in game theory and multi-agent systems. The core challenge lies in maintaining a belief over every agent’s preference and updating it from the agents’ observed actions. Existing LLM orchestrators carry that belief as prompt text with no explicit update rule. This lets early errors persist and propagate rather than be corrected. We therefore propose \textbf{HARP} (Heterogeneous-preference Agent oRchestration via Preference inference), a novel framework that moves the belief out of the prompt. Specifically, HARP maintains one numeric posterior per agent over a finite set of candidate preferences and updates it in closed form by Bayes’ rule. The language model supplies only actions and per-candidate likelihoods, so estimation is decoupled from its reasoning. We prove that HARP attains the same $\tilde O(\sqrt K)$ Bayesian regret as explicit joint inference when the factorization is exact. Furthermore, HARP\textsuperscript{+} augments planning with a bonus for actions that distinguish the candidates, so inference continues even when the optimal action is uninformative. Empirical results on three substrates, ranging from payoffs the preferences fully determine, through payoffs that depend on more than them, to scales where explicit joint inference is infeasible, demonstrate that HARP\textsuperscript{+} is the strongest non-oracle method across the class our theory identifies.

[90] SanSi: A Looped Typed Decision Model for System 1.5 Thinking cs.CL | cs.AI | cs.LGPDF

Shuyu Gan, Young-Jun Lee, Dongyeop Kang

TL;DR: SanSi将预训练循环语言模型改造成typed决策模型：每轮循环后读取选项概率，并用适当评分规则训练所有轮数，使单模型支持1至8轮推理。10,027个测试决策上准确率72.0%，比同结构单次模型高13.5个百分点；用作无金标准策略优化裁判时使生成器F1提高7.7个百分点。

Details

Motivation: Typed决策模型不生成文字，而是在一次前向传播中对预先声明选项输出概率，类似快速直觉判断。作者研究单次前向与显式生成式推理之间的中间形式：重复应用相同网络层，让隐藏状态逐轮修正，再一次性读出答案。

Result: SanSi把预训练循环语言模型转为typed决策器，在每轮后读出选项概率，并用适当评分规则训练每轮，使一个模型可覆盖1到8轮预算。来自59个来源的10,027个测试决策上准确率为72.0%，比同规模/训练配方的非循环模型高13.5个百分点，比更新的同尺寸非循环模型高5.3个百分点，低于参数量三倍模型1.8个百分点。在两个深度受控任务上，循环将可解深度扩展到训练深度之外，而更大的单次模型失败。作为无金标准答案的强化学习策略优化裁判时，SanSi使生成器F1提升7.7个百分点。

Insight: 不生成思维文本也能通过多轮内部状态更新获得额外推理能力；逐轮监督使一次训练产物适配不同计算预算。结果包括跨59个来源和深度外推任务，但与更大模型比较仍有1.8个百分点差距。

Abstract: Typed decision models answer a declared question without generating text: a decision head returns a probability for each of the declared options in a single forward pass. A single pass is fast, intuitive System 1 thinking. We study what lies between one pass and generated reasoning: looping, in which the same layers are recursively applied several times before one typed readout. Each loop lets the model revise its hidden state before it commits to an answer, without generating a token; we call this System 1.5 thinking. We propose SanSi, which turns a pre-trained looped language model into a typed decision model. The option probabilities are read after every loop, and every loop is trained with a proper scoring rule, so that one model serves every budget from one loop to eight in a single run. On 10,027 test decisions from 59 sources, SanSi reaches 72.0% accuracy: 13.5 points above a non-looped model of the same shape trained with the same recipe, 5.3 points above a newer non-looped model of its size, and 1.8 points below one with three times the parameters. On two depth-controlled tasks, loops extend the solvable depth beyond the depths seen in training, where the larger single-pass model fails. Used as the judge for policy optimization with reinforcement learning, without gold answers, SanSi raises the generator’s F1 by 7.7 points.

[91] Reading, Not Manipulating: Leveraging Router Logits for Multimodal Safety in MoE Vision-Language Models cs.CLPDF

Ziyuan Yang, Wenxuan Ding, Shangbin Feng, Yulia Tsvetkov

TL;DR: 本文不干预MoE视觉语言模型参数或路由，而是在提示预填充阶段读取自然产生的router logits，构建轻量多模态安全检测器，在生成前识别不安全请求。Qwen3-VL与Kimi-VL实验显示其降低HoliSafe安全错误，并能泛化到MISHard和MM-SafetyBench。

Details

Motivation: VLM可能因图像和文本组合而产生有害意图，形成组合式安全风险。现有提示、监督微调和路由专家干预在不同模型与评测分布上的效果不一致，改动模型内部状态也可能导致过度拒答和安全—效用权衡。

Result: 作者发现MoE路由器logits能预测多模态输入是否安全，并据此在提示预填充时读出路由信号，在生成前判断不安全请求；检测器不修改模型参数或专家路由。Qwen3-VL和Kimi-VL实验中，该方法显著减少HoliSafe基准安全错误，并迁移到安全模式不同的分布外基准MISHard和MM-SafetyBench。摘要未提供检测数值、阈值或效用损失。

Insight: 无需操纵模型行为，读取其自然形成的内部路由信号也可作为外部安全机制，减少对提示或微调干预的依赖。跨模型和分布外测试支持其补充价值，但摘要没有量化误报、漏报或对良性请求的影响。

Abstract: Vision-language models (VLMs) face compositional safety risks where harmful intent emerges from the interaction between visual and textual inputs. As mixture-of-experts (MoE) VLMs become increasingly common, recent work has explored various safety interventions, including prompting, supervised fine-tuning, and routing-based expert steering. However, these methods show inconsistent improvements across models and evaluation distributions, and the intervention into model behavior or internal states introduce safety-utility tradeoffs by over-refusal. Rather than manipulating internal states to steer model behavior, we instead ask whether routing states can serve as diagnostic signals for multimodal safety. We find that router logits indeed provide highly predictive signals of whether a multimodal input is safe or not. Motivated by this observation, we introduce a lightweight router-logit safety detector that reads out routing signals during prompt prefill and identifies unsafe requests before generation, without modifying model parameters or expert routing. Across Qwen3-VL and Kimi-VL, the proposed detector substantially reduces safety errors on the HoliSafe benchmark and resoundingly generalizes to out-of-distribution safety benchmarks featuring different safety patterns, including MISHard and MM-SafetyBench. The success of the proposed router-logit detector also suggests a broader perspective on model internals: rather than focusing only on manipulating internal components to steer behavior, simply reading naturally emerging signals and linking them to an external safety mechanism can provide a simple, effective, and non-intrusive complement to existing safety interventions.

[92] Dynamic Positional Attention Modulation for Parameter-Efficient Fine-Tuning of Large Language Models cs.CL | cs.AIPDF

Dayan Pan, Jingyuan Wang, Xie Yu

TL;DR: DyPAM是一种直接调制查询与键位置贡献的LLM参数高效微调方法，结合输入条件的逐维调制及头级、层级结构调制，以适配RoPE诱导的非均匀位置注意力，而不改动预训练骨干。多个骨干的数学与常识推理实验中持续优于强PEFT基线。

Details

Motivation: 许多PEFT方法采用统一静态适配，未考虑注意力在维度、头、层和输入token上的结构差异。RoPE还带来维度相关的位置结构，因此对所有维度和层采用同一种适配方式可能并不合适。

Result: DyPAM在query和key表示上直接适配位置信息对注意力的贡献，结合由输入条件决定的逐维调制，以及头级和层级结构调制，使适配粒度与RoPE结构相匹配，同时保持预训练骨干参数不变。多个骨干模型的数学和常识推理基准实验显示，该方法一致优于已有强PEFT基线；摘要未给出具体任务分数或参数量比较。

Insight: PEFT不必对各层、头和维度一视同仁；显式考虑RoPE造成的位置结构，可能提升适配效率和推理任务表现。当前摘要只报告相对基线的定性优势，没有量化增益或训练开销。

Abstract: Parameter-efficient fine-tuning (PEFT) has become a standard approach for adapting large language models to downstream tasks. However, most existing PEFT methods rely on uniform and static adaptations, without accounting for the structured heterogeneity of attention across dimensions, heads, layers, and input tokens. In practice, attention representations exhibit non-uniform behavior, and positional encoding mechanisms such as rotary positional embeddings (RoPE) induce dimension-dependent positional structure, making uniform adaptation suboptimal. In this work, we propose DyPAM (Dynamic Positional Attention Modulation), a PEFT method that adapts how positional information contributes to attention by operating directly on the query and key representations. DyPAM combines input-conditioned, dimension-wise modulation with head-wise and layer-wise structural modulation, performing fine-grained adaptation of positional attention aligned with the RoPE-induced structure without modifying the pretrained backbone. Extensive experiments on mathematical and commonsense reasoning benchmarks across multiple backbone models demonstrate that DyPAM consistently outperforms existing strong PEFT baselines.

[93] OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement cs.CLPDF

Sihyeon Lee, Jihun Song, Chanwoo Kim, Jiwoo Kum, Chanjun Park

TL;DR: OMIT是测量LLM道德判断遗漏偏差的基准，含218组双重框架情境、覆盖10类哲学冲突，由五种哲学立场的人格小组构造。对8个LLM评估发现遗漏偏差普遍存在，并在同系列内与模型规模负相关；鼓励先考虑道德原则的推理干预可降低偏差，但可能转向行动偏置。

Details

Motivation: 当实质结果相同、只改变表述框架时，LLM仍偏好不行动的遗漏偏差可能导致道德决策失衡。现有LLM评测对此研究较少，规模有限且主要集中在功利主义与义务论冲突。

Result: OMIT包含218组配对框架情境、覆盖10类冲突，借助五种哲学人格（功利主义、义务论、德性伦理、关怀伦理、契约主义）的LLM小组分歧模式构建。评估8个LLM后发现遗漏偏差普遍存在，在模型家族内部与规模呈反向相关。四种推理时干预中，鼓励模型在回答是/否之前先考虑道德原则的方式能降低遗漏偏差并增加框架一致性；但偏差下降也可能伴随转向偏行动的响应。

Insight: 缓解遗漏偏差不能只看偏差率，还需检查是否把不作为偏置反转为行动偏置；配对框架和多哲学立场为研究分布效应提供结构化基准。模型规模相关性限于同家族观察，摘要没有给不同干预的具体效应量。

Abstract: As LLMs increasingly assist in moral reasoning, omission bias, the tendency to prefer inaction even when equivalent framings reverse substantive outcomes, poses a significant risk of skewed decision-making. Yet omission bias remains underexplored in LLM evaluation, with the few existing studies limited in scale and focused largely on utilitarian-deontological conflicts. To address this gap, we introduce OMIT, a benchmark consisting of 218 paired-frame scenarios across 10 conflict types, constructed by leveraging disagreement patterns from an LLM-based, five-perspective philosophical persona panel (utilitarianism, deontology, virtue ethics, care ethics, and contractualism). Evaluating eight LLMs, we find that omission bias is pervasive but inversely correlates with model size within families. We further evaluate four inference-time interventions and find that interventions encouraging models to consider moral principles before committing to a yes/no answer reduce omission bias and increase frame-consistent responses, although lower omission bias rates can also coincide with shifts toward action-biased responses. Ultimately, this work contributes not only the OMIT benchmark, but also a methodology for using diverse philosophical disagreement signals to evaluate framing-sensitive inaction preferences and the distributional effects of mitigation attempts in LLMs under complex moral conflicts.

[94] Visual Abstention in Unified Multimodal Models cs.CL | cs.AI | cs.CVPDF

Chufan Shi, Cheng Yang, Tiannuo Yang, Isadora White, Yiwei Chen

TL;DR: 本文定义统一多模态模型的视觉弃答能力：当图像编辑请求违反任务规则、无可行解时，模型应说明不可行并停止生成。1,050组可行/不可行情境的DoD基准显示编辑与弃答是不同能力；VisTA-BAGEL在不损失编辑能力的情况下拒绝93.0%不可行请求，仅误拒0.8%可行请求。

Details

Motivation: 统一多模态模型同时理解和生成内容，但生成行为很少受其任务理解能力约束。若要求的视觉变换按任务规则根本不可实现，模型应识别矛盾并拒绝，而不是幻觉补造物体或静默改写请求。

Result: Draw-or-Decline（DoD）含1,050组成对的可行/不可行请求，覆盖7类任务，同时评估编辑成功和对不可行请求的拒答。8个统一多模态模型中，编辑能力与弃答能力相互独立：最强编辑器准确率68.4%，普通指令下却只拒绝0.4%的不可行请求；提示其报告不可行性会增加文字拒答但降低编辑准确率。VisTA把可行与不可行样例配对训练，使模型先判断可行性再决定生成。VisTA-BAGEL无需提醒即可拒绝93.0%的不可行请求，误拒可行请求仅0.8%；同时完成74.3%的可行编辑，高于评估的其余8个模型。

Insight: 生成系统的安全不仅是拒绝有害内容，也包括识别任务约束下没有合法视觉结果的请求；单纯提示会带来编辑能力损失，配对训练可分离可行性判断与拒答行为。DoD和VisTA结果针对所测图像变换任务。

Abstract: Unified multimodal models (UMMs) integrate understanding and generation, yet their generative behavior is rarely governed by what they understand about the task. We formalize visual abstention: when a requested visual transformation is impossible under the task’s rules, the model should recognize that no valid solution exists, state this, and decline to generate. We introduce Draw-or-Decline (DoD), a benchmark of 1,050 feasible-infeasible request pairs across 7 task categories that jointly measures editing success and the refusal of infeasible requests. Evaluating 8 UMMs, we find that editing ability and abstention are distinct capabilities: even the strongest editor, at 68.4% editing accuracy, refuses only 0.4% of infeasible requests under ordinary instructions. Their reasoning shows why: the models rarely notice the conflict, and instead plan the edit as if the request were possible, often describing objects that are not in the image, or quietly change the request into one they can complete. Explicitly prompting these UMMs to report infeasibility increases textual refusals but reduces editing accuracy. We propose VisTA (Visual Transformation and Abstention), a training method that pairs feasible and infeasible examples so that a model judges feasibility before deciding whether to generate. We train VisTA-BAGEL to perform feasible edits and decline infeasible requests. Without any reminder, it refuses 93.0% of infeasible requests, up from 0.4% for the strongest editor, while falsely refusing only 0.8% of feasible ones. Unlike a reminder, this does not cost editing accuracy: VisTA-BAGEL completes 74.3% of feasible edits, more than any of the 8 evaluated UMMs.

[95] Pseudowords as probes: Large Language Models show little of the sublexical sensitivity that governs human pseudoword processing cs.CLPDF

Jing Chen, Giulia Loca, Simona Amenta, Marco Marelli

TL;DR: 本文用两项意大利语伪词二选一实验比较五个LLM与人类行为，发现当真实词选项提供熟悉度线索时模型更接近人类；只有伪词时则明显不如fastText。稳定驱动人类—fastText一致性的子词余弦相似度线索，未能稳定转移到人类—LLM一致性。

Details

Motivation: 语言中形式与意义间的概率映射会体现在词汇以下的子词线索上，这些线索已知影响人类处理伪词；LLM是否也使用相似线索尚不明确。

Result: 作者在两项意大利语二选一伪词实验中测试五个LLM，并与人类行为基线比较。含真实词选项、可利用词汇熟悉度线索时，LLM与人类更一致；仅有伪词时，LLM表现明显低于字符n-gram的fastText。可靠驱动人类与fastText一致的子词余弦相似度线索，并不能稳定解释人类与LLM的一致程度；模型推理token消耗也与人类处理难度无稳定关系。作者将tokenization和训练数据覆盖作为候选解释。

Insight: LLM与人类在词义题上的相似表现不意味着它们共享人类依赖的子词处理线索；任务提供真实词熟悉度提示时的对齐更好。当前证据来自意大利语伪词二选一任务，tokenization与数据覆盖仍是推测机制。

Abstract: Systematicity, the probabilistic mapping of form to meaning, permeates language at all levels, and sublexical cues have been shown to govern human pseudoword processing. Yet whether LLMs exhibit comparable sensitivity to these cues remains unclear. We tested five LLMs on two Italian two-alternative forced-choice pseudoword experiments and compared their responses with a human behavioural baseline. LLMs aligned more reliably with humans when real-word options provided a lexical familiarity cue than in the pseudoword-only condition, where they fell substantially below fastText, a character-n-gram model. In addition, the sublexical cosine-similarity cue that reliably drove human–fastText agreement did not consistently transfer to human–LLM alignment, and reasoning-token expenditure bore no consistent relation to human processing difficulty. These findings suggest that LLMs do not necessarily share the sublexical cues that govern human pseudoword processing; we discuss tokenization and training-data coverage as candidate explanations.

[96] Leveraging a four-quadrant approach for evaluating Redpine Science cs.CLPDF

Filip Dorm, Leonora Vesterbacka

TL;DR: 这份报告从四个角度评估Redpine Science文献检索：回答质量、专家题目主张覆盖、正确论文召回和专家相关性。公开ScholarQABench上答案正确率为94.4%（无检索87.6%）；专家问题主张覆盖80.1%（对比网页搜索70.2%）；可检索金标准论文时Recall@10为83.1%，专家Precision@5为75.2%。

Details

Motivation: Redpine Science通过MCP和API提供同行评审文献检索。要判断检索对模型是否有用，既需检查召回片段是否相关，也需比较使用文献检索与网页搜索后的回答；仅用公开基准可能受到饱和或记忆影响，因此补充专家验证题集。

Result: 报告包括四项评估。公开ScholarQABench SciFact回答质量测试中，接入Redpine Science的智能体正确率94.4%，无检索为87.6%。专家验证问题集上，接入Redpine的智能体陈述了80.1%的所需主张，限制为网页搜索的智能体为70.2%。在Redpine持有金标准论文的668个公开检索查询中，不含模型推理时，正确论文Recall@10为83.1%，基准创建者为79.3%。盲法专家相关性评审中，Redpine Precision@5为75.2%，PubMed搜索工具为39.8%。作者公开专家问题集及复现说明。

Insight: 同时评测回答事实、专家问题覆盖、原文检索和盲法相关性，较单一问答分数更完整地刻画文献工具效用；加入专家题目也能缓解公开基准饱和/记忆风险。结果由报告作者在其基准及系统设置中测得，不宜视为对所有学科检索工具的独立审计。

Abstract: Redpine Science gives models and agents a single access point to a wide range of peer-reviewed literature, queried directly through the Model Context Protocol (MCP) and an API. This report evaluates Redpine Science on two levels: the relevance of the retrieved chunks, and a model’s answer when it has access to Redpine Science compared to web search. Both public and expert-validated benchmarks are used. Public benchmarks are a widely accepted way to test model development and are comparable across labs, but risk saturation and memorization. To address this, we complement them with an expert-validated question set. In total, this report presents four evaluations. On ScholarQABench SciFact, the public answer-quality benchmark reported here, an agent with Redpine Science answers 94.4% of claims correctly against 87.6% with no retrieval. On the expert-validated question set, an agent with Redpine Science states 80.1% of the required claims against 70.2% for an agent restricted to web search. On the 668 queries of a public retrieval benchmark whose gold paper Redpine holds, stripped of any model reasoning, Redpine Science places the correct source paper in its top ten results for 83.1% of queries (Recall@10), against 79.3% for the benchmark’s creator. A blinded expert relevance panel places Redpine Science’s Precision@5 at 75.2% against 39.8% for the PubMed search tool. We release the expert-validated question set and instructions to reproduce every headline result above, at https://github.com/redpine-ai/benchmarks.

[97] Hybrid Latent Attention for Looped Language Models cs.CL | cs.AIPDF

Yuhan Chen, Siyuan Zhang, Nan Wang, Feiyang Kang, Ruoxi Jia

TL;DR: HLA为循环语言模型设计混合潜在注意力：最近W个token保留精确KV，较早token存为查询可直接读取的紧凑潜变量。Ouro循环模型上KV缓存每token缩小10.7倍、单GPU并发序列增至4.0–8.8倍；1K上下文解码吞吐提升2.5倍、16K时最高7.4倍，同时保留大部分原模型准确率。

Details

Motivation: 循环语言模型重复应用同一层堆栈，可在不增加模型参数的情况下加深计算，但KV缓存也随循环次数T倍增，减少单GPU并发序列并拖慢需读取整个缓存的每个解码步骤。

Result: HLA对最近W个token保留精确键和值，较早token压缩为紧凑潜变量，每轮查询直接读取而不重建KV。作者在1.4B和2.6B、T=4的Ouro循环模型上继续训练新增参数，冻结原预训练权重，使HLA逼近原注意力。缓存每token缩小10.7倍，每GPU可并发4.0–8.8倍序列；1K token上下文吞吐提升2.5倍，16K时最高7.4倍。数学、知识和推理基准保留原准确率的97%以上，16K长上下文检索保留96%–100%。监督微调后，竞赛级数学表现与原微调模型相当。

Insight: 对远距离历史以可直接读取的潜表示替代逐token精确KV，可显著削减循环模型的缓存和带宽成本，同时保留近邻精确注意力。效果是在Ouro两个尺寸、T=4配置上测得，性能保留比例因基准任务而异。

Abstract: Looped language models apply the same stack of layers T times to each token, which deepens the model without adding parameters but multiplies its key-value (KV) cache by T. The larger cache limits how many sequences a GPU can decode at once and slows each decoding step, which reads the whole cache. We propose Hybrid Latent Attention (HLA), which keeps exact keys and values within a sliding window of W recent tokens and stores each older token as a compact latent that the query of each loop reads directly, without reconstructing keys and values. We uptrain HLA on Ouro looped models (T=4) with 1.4B and 2.6B parameters, keeping the pretrained weights frozen and training only the added parameters to reproduce the original attention. The cache shrinks by 10.7x per token, fitting 4.0-8.8x as many concurrent sequences per GPU, and decoding throughput improves by 2.5x at 1K-token contexts and by up to 7.4x at 16K. HLA retains over 97% of the original accuracy on math, knowledge and reasoning benchmarks, and 96-100% on long-context retrieval up to 16K tokens. After supervised fine-tuning, it performs on par with the fine-tuned original model on competition-level math.

[98] Language Unalignability: Why Some Concepts Resist Cross-Cultural Benchmark Evaluation cs.CLPDF

Shu-Kai Hsieh, Da-Chen Lian

TL;DR: 本文提出“语言不可对齐”概念，指出某些语用词、敬语和历时分层词汇无法在保留词义对应与局部语义结构的同时跨语言映射。作者用语境嵌入使用云形式化α-不可对齐，并以翻译、Yami语言模型机制研究及多维诊断指标提供证据。

Details

Motivation: 多语LLM评测隐含假设不同语言的语义结构可以无损互译和对齐。作者认为对某些有类型学特征的概念，这一假设并非只是实践中困难，而是在原则上不成立；若强行以单一分数衡量跨文化能力，可能抹平语言差异。

Result: 论文把概念表示为语境化嵌入点集“使用云”，定义α-不可对齐为不存在同时保持词汇忠实性（中心对应）和结构忠实性（局部邻域拓扑）的映射。行为证据显示，FLORES-200翻译失败由语言家族和资源类别预测、而非文字系统预测；LOBSTER推理分数也随语言家族变化。九个模型的Yami案例中出现表示干预差距：激活显示Yami与其他低资源/南岛语言有规律，但干预语言专属神经元未证明优于随机mask。作者提出Cycle-Consistency、Pragmatic-Load Disagreement、Manifold-Curvature Mismatch和RIG四维诊断。

Insight: 跨语言对齐可能存在结构上互不兼容的投影，统一标量可能鼓励概率扁平化而削弱文化差异。Yami案例中表示规律可见但干预未能利用它，说明内部可读性不等于可操作的语言能力；其定义和诊断仍属研究框架。

Abstract: Current evaluation of multilingual Large Language Models (LLMs) rests on an implicit Translation-Isomorphism Assumption (TIA): that semantic structures across languages are congruent and mutually mappable without loss of information. We argue that this assumption is not merely violated in practice, but ill-posed in principle for a typologically identifiable class of concepts, including pragmatic markers, honorifics, and diachronically stratified terms. We formalize this failure using a usage-cloud framework, representing concepts as point sets of contextualized embeddings. We define $α$-unalignability as the impossibility of any mapping that simultaneously preserves lexical faithfulness (centroid correspondence) and structural faithfulness (local neighborhood topology). We provide three layers of evidence. Behaviorally, we show that FLORES-200 translation failures are predicted by language family and resource class but not by script, and that LOBSTER reasoning scores vary by family. Mechanistically, we report a Representation-Intervention Gap (RIG) in a nine-model case study on Yami: the models’ activations encode a regularity along which Yami groups with other low-resource and Austronesian languages, yet interventions on language-specific neurons show no demonstrated advantage over random masks: the regularity is visible but not usable by this intervention. Finally, we operationalize these findings into a multidimensional diagnostic profile: Cycle-Consistency, Pragmatic-Load Disagreement, Manifold-Curvature Mismatch, and RIG. We argue that collapsing cultural competence into a single scalar incentivizes “probabilistic flattening,” and that recognizing the unalignable class is a precondition for AI that respects, rather than erases, cultural divergence. This suggests that multilingual alignment is not a single well-defined objective, but a set of mutually incompatible projections.

[99] Foresight-over-Graph: Reasoning Beyond Local Horizons for Knowledge Base Question Answering cs.CL | cs.AIPDF

Yang Hong, Yajun Yang, Xin Wang, Liping Jing, Qinghua Hu

TL;DR: FoG是面向知识库问答的前瞻式证据检索框架，通过反向远端到近端反馈指导路径探索，并维护紧凑记忆子图，避免逐跳贪心/beam裁剪过早删除只有在深层上下文中才显关键的分支。常用KBQA基准上达到SOTA，在CWQ的Hit提升16.58%，并减少LLM调用和token使用。

Details

Motivation: LLM在知识密集问答中仍易幻觉，知识图可提供结构化、可解释且可更新的事实基础。但现有图推理常按逐跳贪心或beam方法局部筛选证据，近端看似不重要的路径可能到深层才成为关键，因而会被提前丢弃且难以恢复。

Result: Foresight-over-Graph（FoG）迭代构建与问题相关的证据子图，利用远端到近端反馈引导路径探索，并维护紧凑记忆子图支持持续搜索。在常用知识库问答基准上，实验显示FoG达到当前最先进表现；CWQ上Hit指标提升16.58%，同时减少LLM调用次数和token消耗。摘要未提供其他基准分数或成本减少幅度。

Insight: 证据路径的价值可能依赖尚未探索的深层图上下文，因此检索需要保留并向早期决策回传远期反馈，而非只做局部贪心剪枝。紧凑记忆子图支持迭代扩展，但摘要没有说明图规模、调用节省量及不同问答类型的差异。

Abstract: Large language models (LLMs) have demonstrated strong capabilities in question answering, yet they still frequently suffer from hallucinations on knowledge-intensive tasks. Knowledge graphs (KGs) provide LLMs with structured, interpretable, and updatable factual grounding, making them a promising external knowledge source for reliable reasoning. However, existing LLM-guided graph reasoning methods typically rely on hop-wise greedy or beam-style pruning during evidence retrieval. Such local decision processes are inherently myopic: evidence that appears weak near the source may become crucial only after deeper graph context is explored, causing answer-critical branches to be discarded prematurely and making the reasoning chain difficult to recover. To address this limitation, we propose Foresight-over-Graph (FoG), a foresight-aware evidence retrieval framework for knowledge base question answering (KBQA). FoG iteratively constructs a question-relevant evidence subgraph and uses far-to-near feedback to guide path exploration, and maintains a compact memory subgraph to support continued exploration. Extensive experiments on widely used KBQA benchmarks demonstrate that FoG achieves state-of-the-art performance, with a particularly large improvement of 16.58% in Hit on CWQ, while also reducing LLM calls and token usage. Our code is available at https://github.com/yhong7/FoG .

[100] Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability cs.CL | cs.AIPDF

Bingxi Hou, Guochao Jiang, Guofeng Quan, Weiqing Li, Wenfeng Feng

TL;DR: 本文重新审视不同tokenizer间的on-policy蒸馏，发现严格1:1对齐已覆盖学生生成的大部分token，扩展到错配片段的更广监督反而会降低准确率。对齐位置采用学生选出的共享词表top-16反向KL，效果可匹配完整共享词表OPD并优于所测跨tokenizer基线。

Details

Motivation: On-policy蒸馏让学生模型基于自身生成接受教师反馈。tokenizer不同会导致序列和词表两层对齐困难；扩大监督覆盖看似能提供更多学习信号，但错配片段的监督可能不可靠或与严格对齐目标冲突。

Result: 在三组异构教师—学生配对、数学推理和代码生成任务中，严格1:1分组在词表差异很大时仍覆盖大部分学生生成token；蒸馏前学生响应在严格对齐位置的共享词表几乎保留教师和学生全部概率质量。仅在严格位置对学生选择的共享词表top-16施加反向KL，准确率与完整共享词表OPD相当，并优于所评跨tokenizer基线。对错配组增加span log-prob均方误差可实现完整覆盖，但准确率下降；梯度诊断显示span梯度与严格对齐梯度方向一致性弱或为负，且相对幅度随训练增大。

Insight: 监督覆盖并非越广越好，跨tokenizer错配区域可能引入冲突梯度；更紧凑的严格位置监督反而可靠有效。研究用概率质量和梯度方向分析解释覆盖扩展后的性能下降，结果限定于三组模型与数学/代码任务。

Abstract: On-Policy Distillation (OPD) trains a student on its own generations using teacher feedback. With different tokenizers, comparing teacher and student predictions requires alignment at both sequence and vocabulary levels. In this paper, we examine whether expanding this alignment coverage improves learning. Across three heterogeneous teacher–student pairs on mathematical reasoning and code generation, strict 1:1 groups already cover most student-generated tokens despite substantial vocabulary mismatch. On responses sampled from the students before distillation, the shared vocabulary retains nearly all teacher and student probability mass at strictly aligned positions on average. Restricting reverse KL to a student-selected top-16 subset of the shared vocabulary at each strict position achieves accuracy comparable to full shared-vocabulary OPD, outperforming the evaluated cross-tokenizer baselines. Adding mean squared error supervision on span log-probabilities in mismatch groups gives complete supervision coverage, yet reduces accuracy. At checkpoints from training with only the strict loss, the span gradients show weak or negative directional agreement with the strict gradients and grow in magnitude relative to them. These diagnostics may help explain the accuracy drop from adding span supervision. Our findings motivate a shift from maximizing alignment coverage to prioritizing supervision reliability: compact supervision at strict positions can be more effective than broader coverage that introduces weakly aligned or conflicting training signals.

[101] Agentic AutoRAG: RAG Pipeline Optimization through Reasoning-Driven Agents cs.CL | cs.IR | cs.LGPDF

Lasse B. Strand, Robert Jakob, Kevin O’Sullivan, Markus Kreft

TL;DR: Agentic AutoRAG用智能体优化多目标RAG超参数，并在每次失败后区分检索错误与生成错误，再由提案器结合模型排名和价格选下一配置。在三项多跳QA基准前10次试验即可匹配或超过统计基线完整30次；医疗语料上准确率77%，单查询成本约为最强基线58%。

Details

Motivation: RAG流水线配置涉及分块、嵌入、重排和生成等相互作用的超参数，优化成本高。传统贪心或贝叶斯优化通常只用整体分数搜索，没有分析失败发生在检索还是生成阶段，尽管检索片段本身可提供诊断证据。

Result: Agentic AutoRAG在固定语料考试集上提出候选配置并多目标优化准确率与成本。每次试验后Diagnoser将失败问题归因为检索或生成，Proposer依据模型排名和价格知识库选择下一配置并追踪Pareto前沿。三项多跳问答基准上，LLM裁判准确率高于所有比较基线；前10次试验即可匹配或超过统计基线完整30次的裁判准确率。真实医疗语料的成本感知模式中位考试准确率77%，高于最强基线71.5%，每查询成本约为其58%；若只需匹配71.5%，成本约为基线22%。

Insight: 把RAG失败归因嵌入超参数搜索，可用每次试验的错误结构指导下一配置，而非只比较总分；成本与准确率联合优化还能寻找Pareto方案。医疗结果来自单一真实语料和考试设定，摘要没有列其他数据集上的成本比。

Abstract: Retrieval-augmented generation (RAG) is a widely used approach for grounding large language models (LLMs) in external knowledge. However, configuring a pipeline is an expensive hyperparameter optimization problem over many interacting choices, from chunking and embedding model to reranking and generation. Existing optimizers, from greedy search to Bayesian optimization, reduce each trial to an aggregate score and search without modeling why a configuration performed as it did, even though the retrieved chunks already provide evidence about whether each failure occurred during retrieval or after it. We introduce Agentic AutoRAG, an LLM-agent optimizer for multi-objective RAG hyperparameter optimization with retrieval-versus-generation failure attribution. It proposes configurations scored on a frozen exam from the corpus: after each trial a Diagnoser attributes each failed question to retrieval or generation, and a Proposer, grounded in a knowledge base of model rankings and pricing, selects the next configuration, weighing accuracy against cost to trace a Pareto frontier. On three multi-hop QA benchmarks it reaches higher LLM-judge accuracy than every baseline we compare, and within its first 10 trials it matches or beats the statistical baselines’ full 30-trial judge accuracy. In its cost-aware mode on a real-world healthcare corpus it reaches a median exam accuracy of 77%, above the strongest baseline’s 71.5%, at about 58% of that baseline’s cost per query, and it matches that 71.5% at about 22% of the cost.

[102] Incidental information contaminates patient notes and disrupts clinical reasoning in large language models cs.CLPDF

Krithik Vishwanath, Brandon Ye, Anton Alyakin, John E. Markert, Aaron Hsieh

TL;DR: 这项研究评估无关谈话信息对病历生成及临床推理的污染：前沿模型在35%的病历中加入闲聊，3.7%把闲聊错误归因或用于临床判断；另一患者背景语音进入48.2%转录，四个开源模型生成的病历中5.3%检测到污染。

Details

Motivation: 环境式病历记录和临床推理都可能受到患者就诊无关信息影响。作者检验模型是否会将闲聊或邻近患者背景谈话混入病历，以及这类干扰是否同时影响临床决策。

Result: 在576段患者—临床人员对话中，前沿模型有35%的病历加入闲聊，但五分制平均质量分变化最多0.20分；3.7%的前沿模型病历错把旁谈归因给患者或将其用于临床判断。在57段模拟录音中，来自另一患者就诊的背景语音（-10 dB）进入48.2%的转录；四个开源模型生成的后续病历有5.3%检测到污染。作者提出临床推理与分心可能存在双重编码假设，并初步发现与无关信息干扰相关的模型组件也支持临床推理。

Insight: 无关信息污染发生在语音转录、病历归属和临床推理多个环节；简单删除这些表征可能牺牲推理能力，因为相关组件或有双重用途。临床应用前应评估抗干扰能力，并设计阻止污染且保留推理的防护。

Abstract: Large language models (LLMs) are increasingly relied upon to support ambient documentation and clinical reasoning. Here we examine the impact of a failure mode shared between these two applications by assessing their sensitivity to information incidental to the patient encounter. In 576 patient-clinician dialogues, we found that frontier models inserted small-talk exchanges into 35% of notes, while mean quality scores changed by at most 0.20 points on five-point scales. In 3.7% of frontier notes, models misattributed the asides or used them clinically. In 57 mock recorded consultations, background speech from a separate patient encounter at -10 dB leaked into 48.2% of transcripts, with contamination detected in 5.3% of downstream notes generated by four open-weight models. We propose a dual encoding hypothesis of clinical reasoning and distraction in LLMs, with preliminary evidence that LLM components associated with disruption by incidental information also support clinical reasoning. These findings support evaluating resistance to incidental information before clinical use, with safeguards that prevent contamination while preserving clinical reasoning.

[103] Generative AI translations in high-stakes emergency messaging cs.CLPDF

Nune Ayvazan, Anthony Pym, Yu Hao

TL;DR: 这项研究考察高风险地震应急指引的生成式AI英译中/西翻译。针对语篇类型设计的提示可显著提高可理解性和可操作性，但译者仍可能不信任输出；作者强调人工修订不可省略，既要查错，也需要明确承担错误或延误的责任主体。

Details

Motivation: 极端天气通报和地震指令等应急信息具有高风险，翻译错误可能导致严重后果，因此机器翻译或生成式AI不一定适合直接发布；但AI节约初译时间，也可能让资源更多用于复核和授权，并扩展目标语言覆盖。

Result: 作者以一段英文地震指令为材料，实验生成式AI翻译为中文和西班牙语。结果显示，使用针对语篇类型的提示能显著提升译文可理解性与行动可操作性，但译者仍可能不信任机器输出。研究因此强调仍需人工修订：一方面检测翻译错误，另一方面确保有人对信息中的错误或延误承担伦理责任。摘要未提供受试者数量或评分数值。

Insight: 高风险应急翻译可将生成式AI用于加速初稿，但专业语篇提示无法取代人工核验和责任承担。当前证据仅来自一段地震指令的中译、西译实验，不能推断其他应急文体和语言组合的效果。

Abstract: Emergency messaging such as extreme-weather reports and earthquake instructions can involve high stakes, to the extent that translation errors can lead to tragic consequences. The use of machine translation or generative artificial intelligence might therefore not be recommended. On the other hand, time savings in the initial translation can allow greater investments of resources in revision and authorization processes, as well as a wider range of target languages. An experiment with generative AI translations of an earthquake instruction text from English into Chinese and Spanish shows that use of discourse-specific prompts can considerably improve understandability and actionability, although the translations may still not be trusted by translators. Human revision is still required, not only to detect errors but also because of the ethical need for someone to take responsibility for any errors or delays in such messaging.

[104] Evidence-Bound Reasoning: Neuro-Semantic Verification of Biomedical AI in Glioblastoma Radiogenomics cs.CLPDF

Mariya Miteva, Maria Nisheva-Pavlova

TL;DR: 该研究构建神经语义核验框架，把胶质母细胞瘤MRI放射组学值变成可寻址证据记录和可机器检查的主张。6,620条篡改主张基准上核验器精确集合准确率100%；24例试点中LLM复现72/72条预设原子主张，冻结核验器恢复24/24个预期条件，但外部MGMT判别较弱（AUC 0.543）。

Details

Motivation: 生物医学AI可以生成可信却未必由患者特异证据支持的解释。作者希望把影像测量连接到明确证据记录和机器可检查主张，从而独立评估解释可核验性，而不把它与预测性能混为一谈。

Result: UPenn-GBM放射组学与独立多中心队列中由标准MRI和专家验证分割重新提取的CaPTk特征对齐；共享空间包括T1、T1GD、T2、FLAIR四序列、三个肿瘤区域共1,728项特征，参考语义状态来自611例UPenn病例。外部证据账本包含331名患者的1,655条模型关联记录。核验器在6,620条篡改主张基准上达到100%精确集合准确率；24例试点中GPT-5.6 Sol复现全部72条预设原子主张，冻结核验器找回全部24项预期条件。受控退化时预测AUC从0.899降至0.500，而核验准确率保持1.000。外部MGMT判别较弱，AUC为0.543。

Insight: 解释可核验性可被工程化并与预测能力分开评估：LLM可把解释整理为原子主张，最终证据一致性则由确定性程序核查。核验准确率稳定并不意味着预测准确；外部MGMT AUC较低正说明两者必须独立报告。

Abstract: Background: Biomedical AI can generate plausible explanations without reliably verifying whether each statement is supported by patient-specific evidence. We developed a neuro-semantic verification framework that converts radiomic measurements into addressable evidence records and machine-checkable claims. Methods: UPenn-GBM radiomics were aligned with de novo CaPTk extraction from standardized MRI and expert-validated segmentations in an independent multicenter cohort. The shared space comprised 1,728 features from T1, T1GD, T2, and FLAIR MRI across three tumor regions. Reference-defined semantic states were derived from 611 UPenn cases. We evaluated cross-cohort transportability, model-linked provenance, deterministic verification, controlled predictive degradation, and an LLM claim-extraction pilot; MGMT prediction served only as a transport stress test. Results: Median semantic-state agreement was 0.786 (weighted kappa 0.709), ranging from 0.918 for morphologic to 0.252 for intensity features. The external evidence ledger contained 1,655 model-linked records for 331 patients. The verifier achieved 100% exact-set accuracy in a 6,620-claim corruption benchmark. In a 24-case pilot, GPT-5.6 Sol reproduced 72/72 prespecified atomic claims, and the frozen verifier recovered 24/24 expected conditions. During controlled degradation, ROC AUC declined from 0.899 to 0.500 while verification accuracy remained 1.000. External MGMT discrimination was weak (ROC AUC 0.543). Conclusions: Verifiability can be engineered and evaluated independently of predictive performance. LLMs may structure explanations, while final evidence-consistency checking remains deterministic.

[105] Agreement Is Not Validity: Cross-Model LLM Consensus in Diagnosing Student Failure Modes in K-12 Math Tutoring Dialogue cs.CLPDF

Clayton Cohn, Joyce Fonteles, Kirk Vanacore, Gianni Mazza, Candida Crawford

TL;DR: 该探索性研究评估LLM从K–12数学辅导对话中诊断五类学生失误的效度。人类—模型一致性中等（κ=.524–.597），模型间一致性更高（κ=.755–.781，α=.769），说明多模型共识并不能替代独立效度证据。

Details

Motivation: 数学辅导对话包含学生解题过程和困难来源，可用于知识追踪、行为建模和错误诊断；但LLM生成的解释是否真实反映学生思维，尚未充分验证。若模型间意见一致但共同偏离有效构念，仅靠共识会带来误导。

Result: 研究依据操作性诊断编码手册，分类不确定、错误归因、运算符选择、概念缺口和程序性失误五种失败模式。跨模型的人类—LLM一致性为中等，κ=.524–.597；模型之间一致性更高，κ=.755–.781、α=.769。作者据此指出模型共识可能制造解释正确的假象，挑战“多个LLM意见一致即代表学生诊断有效”的假设。

Insight: 可规模化自动标注只有在目标构念本身有效时才有价值；多模型一致性只能说明输出相互类似，不能代替独立的人类或学习结果证据验证其是否正确解释学生思维。

Abstract: In K-12 mathematics tutoring, student-tutor dialogue provides rich evidence of learners’ problem-solving processes and sources of difficulty. Learning analytics research increasingly relies on large language models (LLMs) to extract such information from dialogue for a variety of downstream tasks, including knowledge tracing, behavioral modeling, and diagnosis of student reasoning errors. However, the validity of these model-generated interpretations remains insufficiently understood. In this exploratory study, we examine the validity of LLM classifications of five student failure modes in mathematics tutoring dialogue using an operational diagnostic codebook: uncertainty, misattribution, operator selection, conceptual gap, and procedural slip. Across models, human-LLM agreement was moderate (kappa = .524-.597), while cross-model agreement was substantially higher (kappa = .755-.781; alpha = .769). These findings show that cross-model agreement can create a misleading appearance of correctness, challenging the assumption that consensus among LLMs constitutes evidence of valid learner interpretation. For learning analytics, the implication is clear: scalable labeling is useful only if the inferred constructs are valid, and model consensus cannot substitute for independent evidence of that validity.

[106] IdeaAnchor: Teaching LLMs to Turn Literature into Research Ideas cs.CL | cs.AIPDF

Ziyu Chen, Yilun Zhao, Jiashuo Sun, Yiling Ma, Manasi Patwardhan

TL;DR: IdeaAnchor提出用结构化“特权信号”训练LLM从论文集合中综合研究想法：明确每篇论文在新想法中的功能角色、相互关系和综合目标，并从已发表论文挖掘训练实例。示范、自蒸馏和RL提升创意质量，检索则补充细节，两者结合最好。

Details

Motivation: 科研常需综合多篇相关论文识别空白并提出新方向，但现有提示或反馈式方法缺乏关于论文应如何组合的结构化监督，难以训练文献支撑的研究构思能力。

Result: IdeaAnchor为每个实例结构化编码输入论文如何综合成成功想法，包括各论文的功能角色、彼此关系和目标综合标准；训练样例从已发表论文中挖掘，以反映真实想法如何由相关工作产生。作者采用示范学习、自蒸馏和强化学习训练，并在推理时加入检索。实验显示构思质量持续提升。分析发现功能互补：锚点式训练增强创造性综合，检索改善细节展开，二者结合效果最好；摘要未提供基准规模或提升数值。

Insight: 文献构思训练不应只给论文和最终答案，还需标注各来源在新想法中的作用及其组合关系；这为学习综合过程提供了结构化监督。锚点训练和检索分别贡献创造性与细节，但摘要没有提供评估指标和具体增益。

Abstract: Scientific research often begins by synthesizing ideas from a set of related papers to identify gaps and formulate new directions. However, training language models to perform this form of literature-grounded ideation remains challenging, as existing approaches based on prompting or feedback lack structured supervision for how papers should be synthesized. We introduce IdeaAnchor, a paradigm for training LLMs to perform research ideation using structured specifications as privileged signals. Each IdeaAnchor instance encodes how each input paper should be synthesized into a successful idea, including their functional roles, relationships, and target synthesis criteria. We build this paradigm by mining instances from published papers, capturing how real ideas emerge from prior literature. We then train models via demonstration, self-distillation, and reinforcement learning, and further enhance generation with retrieval at inference time. Experiments show consistent improvements in ideation quality. Our analysis reveals a functional decomposition: anchor-based training strengthens creative synthesis, retrieval enhances detail elaboration, and combining both yields the best performance.

cs.AI [Back]

[107] Beyond Refusal Patterns: Safe-Role Internalization for Robust and Generalizable LLM Safety Alignment cs.AI | cs.CL | cs.IRPDF

Jinghao Pang, Jitai Hao, Qiang Huang, Zhaochun Ren, Jun Yu

TL;DR: SSRFT把LLM安全对齐重新表述为内化安全角色，而非学习表面拒答模式：从心理测量题、有限越狱提示和安全角色描述构造SRQA数据并扩展多样场景。多种Base/Instruct模型实验报告其比标准SFT更抗prefill攻击、泛化到未见越狱领域，同时减少良性请求过拒并保留通用能力。

Details

Motivation: 现有SFT和RLHF通常需要大量攻击特定监督和计算资源，仍可能形成浅层安全对齐、易受越狱攻击或对良性请求过度拒答。作者希望模型学习安全价值原则，而不是只记住明确拒答句式。

Result: Supervised Safe-Role Fine-Tuning（SSRFT）构造Safe-Role QA数据集：结合心理测量问题、有限越狱提示和安全角色描述，合成、验证并扩展与角色一致的响应至多样情境。多个Base和Instruct模型实验显示，相比标准SFT，SSRFT安全对齐更稳健、可泛化；对prefilling攻击抵抗更强，对未见越狱领域迁移更好，同时减少良性查询过拒并保留通用能力。摘要未报告各指标具体数值。

Insight: 用安全角色和原则生成多场景一致行为，可能比记忆拒答模式更抗提示扰动，也能降低良性请求误拒。摘要给出跨模型定性结果，但缺少攻击集规模、拒答/效用指标和与RLHF的直接数值比较。

Abstract: Large Language Models (LLMs) have achieved remarkable capabilities but remain vulnerable to jailbreak attacks that elicit harmful or unsafe outputs. Existing safety alignment approaches, including Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF), often require substantial attack-specific supervision and computational resources, while remaining susceptible to shallow safety alignment and over-refusal. To address these challenges, we introduce SSRFT(Supervised Safe-Role Fine-Tuning), the first framework that reformulates safety alignment as the internalization of a predefined safe role. SSRFT constructs a Safe-Role Question-Answer (SRQA) dataset from psychometric questions, limited jailbreak prompts, and a safe-role description. Role-consistent responses are synthesized, validated, and expanded into diverse scenarios, enabling models to internalize safety-oriented values and principles rather than explicit refusal patterns. Experiments across multiple Base and Instruct models show that SSRFT achieves more robust and generalizable safety alignment than standard SFT. SSRFT shows substantially greater robustness to prefilling attacks and better generalization to unseen jailbreak domains, while reducing over-refusal on benign queries and preserving the model’s general capabilities. These results establish safe-role internalization as an effective alternative to refusal-centric safety alignment. Warning: This paper contains examples of harmful and toxic language.

[108] In With the Old: Enhancing ‘Classical’ Document Automation with Generative AI cs.AI | cs.CLPDF

Marc Lauritsen, Hannes Westermann

TL;DR: 本文讨论以专家系统和符号方法为基础的法律文档自动化，如何与生成式AI互补，并报告初步实验：用LLM识别并修复非专业人士撰写文本中的问题。

Details

Motivation: 法律辅助和文档自动化长期使用知识表示与符号推理。生成式AI带来新的文本理解与生成能力，作者关注二者怎样互相增强，以及在法律自动化中的收益和挑战。

Result: 文章梳理基于专家系统风格及其他符号方法的文档自动化服务，并讨论其与当前生成式AI结合的可能好处和挑战。初步实验使用LLM识别并修复非专业人士文本中的问题；摘要未说明具体系统、评估数据或实验结果数值。

Insight: 生成式AI可为传统规则/知识驱动文档自动化补充语言理解与修订能力，但法律场景仍需关注可靠性、可解释性和责任边界。当前摘要主要是观点与初步实验，尚无充分量化证据。

Abstract: Software-based legal assistance systems have leveraged many different forms of knowledge representation and reasoning. This article explores how document automation services rooted in expert system style and other symbolic approaches can usefully enhance and be enhanced by current generative AI approaches. We discuss the possible benefits and challenges, and report on preliminary experiments in using large language models to identify and fix issues in texts written by laypeople.

[109] LOGIC: An LLM Benchmark for Intent-Grounded Change Impact in Aerospace Electrical Systems cs.AI | cs.CLPDF

Muhammad Faraz Shoaib, Muhammad Qasim, Raisulhaq Mohammed Rizwan, Rahmatullah Safdar, Muzammil Adnan Shaik

TL;DR: LOGIC是航空电气系统中按工程意图选择变更并沿类型化追踪图传播影响的受控基准，将候选选择错误与后续传播错误分开测量。168个场景显示结构证据适用于显式锚定请求，但关系改述和冲突请求仍难处理；证据为空时弃答策略降低不安全报告，却牺牲覆盖率。

Details

Motivation: 航空电气设计修订可能包含多个实际差异，但工程请求只授权其中一部分；若把每个检测到的差异都传播，会造成过宽的影响报告。需要先可靠地把意图映射到候选变更，再在电气追踪图中传播被选变更，并分离两个阶段错误。

Result: LOGIC包含168个场景（144个候选选择、24个弃答），评估三个7–8B本地部署模型及意图无关、词面、结构证据方法，并提供oracle根节点上界。在96个显式锚定案例中，门控结构证据候选F1为1.0000，词面匹配0.9677；12个关系改述案例中，词面F1仅0.1772、门控结构证据为0，LLM为0.5000–0.6400。候选数量从4增至64时模型grounding下降；若固定所选项在约1K–100K节点图上回放，受影响元素和类型路径准确率相对稳定。严格证据门控降低假阳性但也会删除正确语义选择。证据为空弃答策略使三模型严格弃答准确率均达0.6667、不安全报告率降至0.1667，但可回答案例覆盖率下降16.0–27.1个百分点；六个冲突请求中每个模型仍有四个不安全。

Insight: 候选选择与图上传播应分别评估，固定选择后传播可相对稳健；但严格字面证据门控难处理关系改述，LLM也不能可靠解决冲突意图。结果支持将明确证据、语言模型推理与工程人员复核结合，而不是把系统报告直接视为授权。

Abstract: Aerospace electrical-design revisions can contain multiple genuine changes, although an engineering request may authorize only a subset. Propagating every detected difference can therefore produce overly broad impact reports. We present LOGIC, a controlled benchmark and evaluation framework in which locally deployable language models ground a request in a deterministic candidate-change inventory before selected changes are propagated through a typed electrical traceability graph. This separation permits candidate-selection errors to be distinguished from downstream propagation errors. LOGIC contains 168 scenarios, including 144 selection and 24 abstention cases. We evaluate three 7–8B models against intent-agnostic, lexical, and structured-evidence methods, with an oracle-root upper bound. On 96 explicitly anchored selection cases, gate-only structured evidence achieves candidate F1 of 1.0000, compared with 0.9677 for token-lexical matching. On 12 relational-paraphrase cases, token-lexical F1 is 0.1772 and gate-only F1 is 0.0000, compared with 0.5000–0.6400 for the large language models. Model grounding degrades as candidate inventories grow from 4 to 64 changes, while affected-element and typed-path accuracy remain comparatively stable when frozen selections are replayed over graphs of approximately 1K to 100K nodes. Strict evidence gating suppresses false positives but can remove correct semantic selections. An exploratory evidence-empty abstention policy raises strict abstention accuracy to 0.6667 for all three models and reduces unsafe-report rates to 0.1667, while decreasing answerable-case coverage by 16.0–27.1 percentage points. Four of six conflicting requests remain unsafe for each model. These findings support combining literal evidence and language-model reasoning with engineering review when intent cannot be established reliably.

[110] Persistent Memory in Multi-Agent LLM Inference: What It Costs, What It Buys, and When You Can Tell cs.AI | cs.CL | cs.DC | cs.LGPDF

Hochan Son, Kyungdoe Han, Jaehan Koh, Xiaowu Dai, Wenlu Xu

TL;DR: 本文在一个三层智能体架构中分别测量长上下文分解和持久推理记忆的收益与成本：分解将每查询峰值KV工作集降至14.3 MiB（单次35.5、RAG 35.3）；持久层额外增加0.368 MiB缓存，却在八组、每组每臂100样本上未检测到准确率变化（+0.015，95% CI −0.011至+0.046）。

Details

Motivation: 把长上下文推理拆给协作智能体能限制每次调用的KV工作集，但不少系统另建持久记忆存储和召回推理轨迹，常用消融报告准确率提升。作者希望在同一架构中量化分解与持久记忆各自成本、收益及记忆何时可辨识。

Result: 该三层架构中，分解把每查询峰值KV工作集降至14.3 MiB，对比单次推理35.5 MiB和RAG基线35.3 MiB。持久层使峰值缓存增加0.368 MiB（区间[0.167, 0.590]），但八组受控数据集配对、每臂n=100下未检测到准确率变化：+0.015，95% CI[-0.011,+0.046]。作者认为零效应是结构性结果：单问题基准为每题提供独立证据并独立评分，且不同条件间要重置轨迹，因此历史召回没有有用信息可取。测量过程中做了四项修正，其中前三项会夸大表面收益，第四项使该大小的效应可被检出。

Insight: 拆分上下文可显著降低活跃KV缓存，但持久推理记忆只有在后续任务能复用先前证据时才可能获益；独立单题基准若每条件清空记忆，召回功能结构上无从发挥。记忆消融需保证任务间存在真实可复用信息，并校正测量误差。

Abstract: Decomposing long-context inference across cooperating agents bounds the active KV cache per call rather than total evidence, which matters when KV-cache memory binds. Many such systems add a persistent tier storing and recalling reasoning traces, usually validated by an ablation reporting an accuracy gain. We measure both on one three-tier agent architecture. Decomposition delivers: peak KV working set of 14.3 MiB per query against 35.5 and 35.3 MiB for single-pass and retrieval-augmented baselines. The persistent tier does not: across eight controlled dataset pairs at n=100 per arm it costs +0.368 MiB [+0.167, +0.590] of peak cache and produces no detectable accuracy change (+0.015, 95% CI [-0.011, +0.046]). We argue the null is structural: single-question benchmarks supply each item with its own evidence and score it independently, and correctness requires resetting stored traces between conditions, so recall has nothing informative to retrieve. Reaching it took four measurement corrections – three inflating the apparent benefit, the fourth making an effect that size look resolvable – none visible in the results table. We give the conditions an agent-memory ablation must satisfy and detection procedures that need no knowledge of the specific defect.

[111] ThinkFuse: Trajectory-Aware Test-Time Fusion for Small Reasoning Models cs.AI | cs.CLPDF

Myunghoon Kang, Jungseob Lee, Jaehyung Seo, Heuiseok Lim

TL;DR: ThinkFuse是免训练的推理时融合框架，用片段级不确定性变化与整条轨迹的不确定性趋势共同定位不稳定推理段，再将辅助推理路径选择性融合进主轨迹。数学和知识密集基准上优于基线，并减少融合触发次数和生成token。

Details

Motivation: 小型推理模型可生成长思维链，但一旦进入错误推理路径往往难以恢复。既有推理时融合仅用局部信号决定何时触发，易受瞬时不确定性波动误导，甚至强化不稳定轨迹。

Result: ThinkFuse无需训练，通过比较分段不确定性位移与轨迹级不确定性趋势识别不可靠片段，并将辅助推理路径融合到主模型轨迹中。数学及知识密集推理基准、多模型家族组合的实验均报告优于基线；小型主模型上仍稳健。分析显示其需要更少融合触发并生成更少token，体现选择性干预效率。摘要未给具体准确率提升值。

Insight: 融合时机应结合局部变化和整条推理趋势，避免由短暂不确定波动导致过度触发；选择性融合还能降低token成本。摘要只提供相对优势，未量化准确率和具体效率节省。

Abstract: Small reasoning models (SRMs) have shown strong performance on complex reasoning tasks by generating extended chain-of-thought trajectories, but they often fail to recover once their reasoning enters an erroneous path. Existing test-time fusion methods rely on local fusion signals to determine when to trigger fusion, which can be misled by transient uncertainty fluctuations and may reinforce unstable reasoning trajectories. We propose ThinkFuse, a training-free test-time fusion framework that selectively intervenes in unreliable reasoning segments. ThinkFuse compares segment-level uncertainty shifts with trajectory-level uncertainty trends to identify unstable reasoning points and fuse auxiliary reasoning paths into the primary model’s trajectory. Extensive experiments demonstrate that ThinkFuse outperforms baselines on mathematical and knowledge-intensive reasoning benchmarks, with consistent gains across model-family combinations, and remains robust with a smaller primary model. Our analysis shows that ThinkFuse requires fewer fusion triggers and generates fewer tokens, highlighting the efficiency of selective triggering. Our code is available at https://github.com/js-lee-AI/ThinkFuse.

[112] Confidence Reasoning Graphs: Structured Confidence Estimation for LLM Agents cs.AI | cs.CLPDF

Brendan King, Farima Fatahi Bayat, Jean-Flavien Bussotti, Pouya Pezeshkpour, Estevam Hruschka

TL;DR: Confidence Reasoning Graphs（CRGs）在推理时从单条智能体轨迹估计任务成功概率：先把“完成任务”拆成有轨迹证据支撑的子主张，分别估计末端置信度，再聚合总置信度。三个基准、三骨干、三框架上优于语言化置信度、采样和白盒代理，并能展示可审计证据。

Details

Motivation: 高后果领域需要判断何时信任智能体输出或进行人工介入，但成功证据分散于相互依赖的多步轨迹；内部模型信号可能不可用，rollout成本高，训练数据也可能缺失或过时。

Result: CRG是无需特权模型访问或训练数据的推理时框架。它以智能体已完成任务为起始主张，根据轨迹证据将其分解为情境化子主张，对终端主张估计置信度后聚合为整体成功概率。在三个智能体基准、三个骨干模型和三种框架上，置信度校准及风险感知决策优于语言化、采样式和白盒代理基线。白盒代理虽看似校准良好，却几乎没有区分能力；消融显示改进来自主张级置信估计与聚合，而不只是建图。CRG还能暴露置信估计所依据的主张和轨迹证据供决策时审计。

Insight: 智能体置信度应分解到轨迹中可核查的子主张，而不是对整段执行作单一整体判断；校准误差单指标可能掩盖模型无法区分成功/失败。证据链可审计性是风险决策的重要组成。

Abstract: When using an LLM agent in a consequential domain, making an informed decision about whether to trust its output or intervene requires calibrated confidence in the agent’s success. Confidence estimation for agents is difficult because evidence about success is distributed across heterogeneous, interdependent steps of an agent’s trajectory. Practical agentic deployments introduce further challenges: frontier LLMs often provide limited access to internal signals, agent roll-outs are costly, and training data may be unavailable or quickly become outdated. To address these challenges, we introduce Confidence Reasoning Graphs (CRGs), an inference-time framework that estimates the probability an agent accomplished its task from a single trajectory, without privileged model access or training data. Rather than compressing an execution into a single holistic judgment, a CRG begins with the claim that the agent accomplished its task, decomposes it into contextualized sub-claims grounded in trajectory evidence, estimates confidence for each terminal claim, and finally aggregates these into an overall confidence estimate. Across three agentic benchmarks, three backbone models, and three agent frameworks, CRGs yield better-calibrated confidence and stronger risk-aware decision making than verbalized, sampling-based, and white-box surrogate baselines. We further find that calibration error alone can be misleading: a white-box surrogate baseline appears well calibrated while providing near-chance discrimination. Ablations attribute CRG’s improvements to claim-level confidence estimation and aggregation rather than graph construction alone. Finally, a CRG exposes the claims and trajectory evidence underlying each confidence estimate, enabling it to be audited at decision time.

[113] Isotropic Yet Undecodable: The Sequential Content-Sufficiency Gap in Latent-Predictive Text Representations cs.AI | cs.CL | cs.LGPDF

K. P. Santoso, N. Z. Fadil, F. P. Harsanti, R. V. H. Ginardi, G. N. Iyer

TL;DR: 本文区分表征信息损失与读出不匹配，提出CANOPE：非自回归有序潜在画布加规范token监督和几何正则。40,000条验证序列中，token锚定PL2与潜在一致PL0的总体秩近似，但强自然噪声下位置Recall@1分别98.8%与13.5%；受损LJSpeech文本上WER为21.54%与99.22%。

Details

Motivation: 序列表征是否保留输入中有序目标信息，不能只看潜空间几何是否规整或不同表示是否一致。信息论分解区分输入歧义、表征损失和读出不匹配；仅有高秩/各向同性等几何属性不保证目标内容可恢复。

Result: 作者构造可恢复视图，展示完美一致性和联合各向同性高斯仍可与零目标信息并存，并分析确定性规范锚点的限制；token log-loss提供单侧信息损失界，固定惩罚岭回归说明秩本身不能决定预测风险。CANOPE使用有序潜在画布、规范token监督和几何正则。40,000条验证序列中，latent-agreement PL0与token-grounded PL2总体秩相近，但给定正确目标长度并经历强自然损坏时，位置Recall@1分别13.5%和98.8%。3,930条LJSpeech验证语句中，冻结PL2接训练MatchaTTS读出器，对损坏文本WER为21.54%，冻结PL0为99.22%，端到端MatchaTTS为10.93%。

Insight: 几何规整或潜空间匹配不保证序列内容可读出，显式有序token锚定对受损文本恢复至关重要；PL2显著优于PL0，但仍不及端到端MatchaTTS。结论适用于文中研究的文本设置。

Abstract: We study sequential content sufficiency by investigating whether a representation retains the ordered target information available in its input. An information-theoretic decomposition separates input ambiguity, representation loss, and readout mismatch. We construct recoverable views where perfect agreement and joint isotropic Gaussianity coexist with zero target information, and establish limits imposed by deterministic canonical anchors. Token log-loss provides a one-sided information-loss bound; a fixed-penalty ridge analysis shows why rank alone cannot determine prediction risk. These results motivate CANOPE, a nonautoregressive framework with ordered latent canvases, canonical-token supervision, and geometric regularization. On 40,000 validation sequences, latent-agreement (PL0) and token-grounded (PL2) have nearly identical pooled ranks but reach 13.5% and 98.8% positional Recall@1, respectively, under strong natural corruption when the correct target length is provided. On 3,930 LJSpeech validation utterances, frozen PL2 with a trained MatchaTTS readout yields 21.54% word error rate (WER) on corrupted text, versus 99.22% for frozen PL0, while end-to-end MatchaTTS reaches 10.93%. These results show that geometric regularity alone does not guarantee recoverable sequential content or effective downstream access in the text settings studied here.

[114] Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior Foresight cs.AI | cs.CL | cs.IR | cs.LGPDF

Haoxiang Zhang, Qinglin Chen, Hiroaki Hayashi, Zhuofeng Li, Siming Zhang

TL;DR: Self-Retrospection Distillation（SRD）把完成轨迹提供的事后知识蒸馏为行动前、看不到轨迹的前瞻预测目标，补充组内奖励相同、RLVR无区分信号时的学习。10项工具推理/长程智能体任务上最多提升24.2个百分点；2B模型98% rollout组全失败时成功率由0升至60.6%。

Details

Motivation: RLVR主要用交互后的标量结果奖励学习；若组相对目标下所有rollout奖励相同，梯度信号消失，但轨迹仍可能包含任务需求和失败原因。作者询问事后经验能否教智能体在行动前预测哪些知识有用、哪些陷阱需避免。

Result: SRD提出prospective learning：用事后经验监督策略在交互前视角下进行前瞻预测；完成轨迹包含可用知识和应避免错误，但推理时无需显式生成前瞻。十项工具集成推理和长时程智能体任务中，SRD补充RLVR与自蒸馏基线，最高提升24.2个百分点。各规模中37%–98%的rollout组奖励相同，SRD仍可从轨迹提取学习信号。2B设置下98%组全失败，单独RLVR最终成功率0%，加入SRD在相同rollout预算下达到60.6%。

Insight: 即使任务结果奖励没有组间差异，轨迹仍提供失败模式和事后可知条件；把这些信息转成行动前预测监督，可缓解纯结果奖励的信号稀疏问题。最大收益出现在低对比、高失败率设置；摘要未给每项任务的具体增益分布。

Abstract: Reinforcement learning with verifiable rewards (RLVR) turns agent experience into learning signals primarily through scalar outcome rewards after interaction. For group-relative objectives, however, this signal vanishes when all rollouts receive the same reward, even though their trajectories may reveal useful information about what the task requires and how the agent fails. We ask a complementary question: can hindsight teach an agent what it could have anticipated before acting? We introduce prospective learning, which uses post-hoc experience to supervise foresight predictions from the pre-interaction view, and instantiate it with Self-Retrospection Distillation (SRD). Intuitively, a completed trajectory reveals knowledge that would have been useful and pitfalls that should be avoided; SRD distills this privileged hindsight into trajectory-blind foresight of the same policy. Foresight serves only as a training target and need not be explicitly generated at inference time. Across 10 tool-integrated reasoning and long-horizon agentic tasks, SRD complements RLVR and self-distillation baselines with gains of up to $24.2$ pp. Its advantage is especially pronounced when reward contrast is scarce: when $37$–$98%$ of rollout groups are reward-uniform across model scales, yet SRD can still exploit learning signal from sampled trajectories. In the 2B setting, where $98%$ of groups are all-failure, the RLVR training ends up at $0.0%$ success, while adding SRD reaches $60.6%$ under the same rollout budget. Our results suggest that post-hoc agent experience is useful not only for evaluating or improving behavior, but also for shaping predictive representations before available interaction.

[115] Sherpa: Teaching LLMs to Teach Adaptively cs.AI | cs.CLPDF

Weixian Xu, Yanzhe Zhang, Zora Zhiruo Wang, Changyu Chen, Diyi Yang

TL;DR: Sherpa用多轮强化学习训练LLM根据不同学生画像的实际学习结果调整教学，而不是仅模仿示范或固定教学准则。受训学生跨所有画像平均成绩提高20.5个百分点；MathTutorBench教学法评分从52.5%升至79.2%，人类成对比较中79.6%偏好受训教师。

Details

Motivation: LLM会解题不等于会教。既有教师模型主要使用示范、偏好数据或预设教学标准，未以个体学生的学习结果为直接优化目标；而有效策略会因学习偏好不同而变化。

Result: Sherpa构建具有不同学习偏好的多种LLM学生原型，通过多轮交互强化学习训练教师模型，直接最大化这些学生的学习表现。受训教师使各类学生的成绩平均提高20.5个百分点。MathTutorBench上整体教学法评分由52.5%提升至79.2%。人类研究的成对比较中，79.6%偏好Sherpa训练的教师而非基础模型。

Insight: 教学能力应以学生学会多少衡量，而不只是回答看起来像教师；让模型与异质学生交互并优化结果，可学到适应性教学策略。学生目前为模拟LLM画像，真实学生中的效果仍需验证。

Abstract: Large language models (LLMs) have become increasingly capable problem solvers, but being able to solve a problem is not the same as being able to teach it. Existing approaches to training LLMs as teachers rely on demonstrations, preference data, or predefined pedagogical criteria that specify what good teaching looks like. However, these signals are often not grounded in individual student learning outcomes, where effective teaching strategies can vary substantially across learners. To address this, we introduce Sherpa, a multi-turn reinforcement learning framework that instantiates multiple student archetypes with LLMs conditioned on distinct learning preferences and trains a teacher model to adapt its instruction by directly maximizing their learning outcomes. Teacher LLMs trained with Sherpa improve instructed students’ performance across all archetypes by an average of 20.5 percentage points. Under MathTutorBench’s evaluation, Sherpa raises the overall pedagogy score from 52.5% to 79.2%, indicating better teaching responses. Our human studies show that the trained teacher is preferred over the base model in 79.6% of pairwise comparisons. Together, Sherpa trains LLM teachers to adapt to diverse simulated students and become better aligned with human teachers, paving the road towards AI tutors teaching real students.

cs.CR [Back]

[116] Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Rendering cs.CR | cs.CVPDF

Zheng Gao, Xiaoyu Li, Zhicheng Bao, Yang Song, Jiaojiao Jiang

TL;DR: 本文从生产流程角度比较直接视觉生成和LLM驱动代码渲染两种内容路线的溯源检测与水印，建立区分被动推断、消息恢复和认证来源的验证规范，并提出十项研究问题。文章是基于公开方法、接口检查和边界案例的概念议程，不含实验或新定理。

Details

Motivation: 图像和视频既可由生成模型直接合成，也可由代码/图形描述生成再渲染；成品视觉上可能相似，但生产表示、干预点和来源证据不同。现有水印/检测讨论需要按生产环节和可验证目标明确区分。

Result: 作者提出生产中心框架，对比直接生成与代码渲染的检测和水印流程。验证规格区分被动推断、消息恢复和认证溯源；按生产阶段组织图像、视频、源代码及渲染感知水印，并讨论生成图/视频、图表和SVG、可编程视频、智能体组合工作流的不同要求。基于记录的Claude、OpenAI和渲染工具接口提出关于可识别性、可观测性、跨阶段公平比较、可恢复载荷、重建、同步、组合、混合本地贡献和私有生产事件认证等十项研究问题。文中明确不报告实验、不提出新定理，附录为基础计算，接口文档和代码检查仅证明接口存在而非经验鲁棒性。

Insight: 溯源问题需明确验证目标和内容生产路径；直接图像/视频生成与代码渲染可留下不同证据，不能用单一水印或检测分数混为一谈。该文提供概念框架和研究议程，尚无实验效果结论。

Abstract: AI systems create images and videos with image/video generation models or by writing code and graphics descriptions that are then rendered. These routes can produce similar visible artifacts but expose different representations, intervention points, and provenance evidence. We develop a production-centered framework that compares detection and watermarking across both routes. An explicit verification specification distinguishes passive inference, message recovery, and authenticated provenance. We organize image, video, source-code, and rendering-aware watermarks by production stage. We examine the different requirements of generated images and video, plots and SVG, programmable video, and agent-composed workflows. Documented Claude, OpenAI, and rendering-tool interfaces connect the framework to concrete systems. We pose ten scoped research questions on identifiability, observability, fair comparison across stages, recoverable payload, reconstruction, synchronization, composition, hybrid local contribution, and private production-event authentication. The result is a conceptual research agenda grounded in published methods, inspected interfaces, and elementary boundary examples. It reports no experiments and claims no new theorems; its appendix results are elementary calculations, and documentation and source inspection establish interfaces, not empirical robustness.

cs.HC [Back]

[117] Emoception: Selective Affective Layer Fine-Tuning of Video Vision Transformers for Player Arousal Change Recognition From Gameplay Footage cs.HC | cs.AI | cs.CVPDF

Yi Xia, Ibrahim Khan, Mury Fajar Dewantoro, Wenwen Ouyang, Ruck Thawonmas

TL;DR: SALFT通过短暂适配后各层参数L2范数变化筛选需微调的视频Transformer层，再只更新约8%参数用于游戏视频玩家唤醒变化识别。五折交叉验证中各游戏表现与全量微调无显著差异（p>0.05），参数更新量减少超过92%；一个游戏上多个指标和fold均优于最佳基线。

Details

Motivation: 游戏视频中的玩家唤醒状态识别需要视频Transformer适配，但全量微调计算成本高。梯度范数等层选择信号可能不稳定，作者希望通过短暂适配后直接观察表示变化来选择情感相关层。

Result: Selective Affective Layer Fine-Tuning（SALFT）依据短时适配后各层参数L2范数变化筛选层，直接衡量表示变化，并声称比梯度型替代信号更稳定。在Arousal Video Game Annotation数据集上进行五折交叉验证，SALFT在所有游戏中与全量微调表现相当，无统计显著退化（p>0.05），仅更新约8%参数，减少超过92%。其中一个游戏上，SALFT在所有指标和fold中都优于全量微调与最佳基线；精确双侧Wilcoxon符号秩检验p=0.0625（理论最小值）。研究还提出注意力模式追踪的解释方法。

Insight: 短期参数变化可作为选择性微调层的信号，以较少更新参数保持接近全量微调的游戏唤醒识别表现。五折样本中的p>0.05表示未检出显著差异，不等同于统计证明完全等效；单游戏最佳结果也需谨慎外推。

Abstract: This article proposes Selective Affective Layer Fine-Tuning (SALFT), an efficient adaptation framework for Video Vision Transformers in player arousal recognition from gameplay. To bypass computationally expensive full fine-tuning, SALFT introduces a selection criterion based on the L2-norm change in layer parameters after brief adaptation, directly measuring representational shifts and providing a more stable basis than gradient-based alternatives. Evaluated via five-fold cross-validation on the Arousal Video Game AnnotatIoN dataset, SALFT achieves performance comparable to full fine-tuning across all games without statistically significant degradation ($p>0.05$), while updating only $\approx$8% of parameters (over 92% reduction). Notably, in one game, SALFT consistently outperforms both full fine-tuning and the best baseline across all metrics and folds, reaching the theoretical minimum p-value (p=0.0625, exact two-sided Wilcoxon signed-rank test). In addition, we introduce an interpretability method to trace attention patterns, enhancing model transparency. These results establish SALFT as an effective and efficient approach for affective game computing.

cs.IR [Back]

[118] Learning to Retrieve via Reinforcement Learning in Embedding Space cs.IR | cs.AI | cs.CL | cs.LGPDF

Qi Liu, Fengming Liang, Yiqun Chen, Erhan Zhang, Jiaxin Mao

TL;DR: RELER用强化学习直接优化嵌入空间检索：从编码器输出附近的von Mises–Fisher分布采样查询/文档嵌入，以检索和下游任务奖励更新编码器，并用条件均值投影降低高维策略梯度噪声。在BRIGHT推理密集检索及七个QA数据集RAG上均优于对比目标。

Details

Motivation: 稠密检索通常用对比学习训练有效表示，但并不直接优化检索指标或下游任务效果。需要把最终检索/回答奖励反馈给嵌入模型，同时控制高维嵌入空间探索导致的梯度噪声。

Result: RELER在归一化编码器输出周围的von Mises–Fisher分布中采样单位长度查询和文档嵌入，把检索或下游结果作为奖励，并用REINFORCE与leave-one-out基线更新编码器。条件均值投影（CMP）将采样嵌入投影到编码器输出及候选嵌入张成的低维子空间，减少策略梯度噪声且保持期望不变。在推理密集的BRIGHT基准上，对BGE-M3和Qwen3-Embedding后训练时，平均nDCG@10持续超过InfoNCE和LambdaLoss。RAG实验中只适配查询编码器，文档索引和生成器固定；七个QA数据集上联合优化检索与答案奖励，提高平均检索表现和RAG回答质量。

Insight: 把任务奖励直接用于嵌入空间检索优化，可弥合表示学习目标与排序/回答目标之间差距；CMP以低维方向探索控制高维噪声。摘要报告两个骨干和七个QA集上的一致改善，但未提供提升幅度。

Abstract: Dense retrieval models are typically trained with contrastive objectives that learn effective representations but do not directly optimize retrieval metrics or downstream task performance. To address this problem, we introduce RELER (REinforcement LEarning for Retrieval), a reinforcement learning framework that enables existing embedding models to learn to retrieve directly in embedding space and align to task-specific rewards. We train RELER by sampling unit-length query and document embedding actions from von Mises-Fisher (vMF) distributions centered on normalized encoder outputs, scoring the resulting retrieval or downstream outcomes as rewards, and updating the encoder with REINFORCE using a leave-one-out baseline (RLOO). As exploration in the high-dimensional embedding space is prone to sampling noise, we further propose conditional-mean projection (CMP), which projects each sampled embedding onto the low-dimensional subspace spanned by its encoder output and the candidate embeddings it is compared against, reducing noise in the policy gradient while preserving its expectation. We evaluate RELER on BRIGHT, a benchmark with reasoning-intensive queries that remain challenging for existing embedding models. RELER consistently outperforms InfoNCE and LambdaLoss in average nDCG@10 when post-training BGE-M3 and Qwen3-Embedding backbones. We further evaluate downstream utility through retrieval-augmented generation (RAG), where we adapt only the query encoder while keeping the document index and generator fixed. Across seven QA datasets, jointly optimizing retrieval and answer rewards improves both average retrieval performance and answer quality in RAG.

cs.LG [Back]

[119] When Does External Guidance Help LLM Reasoning? A Bias-Variance Theory of Guidance-Augmented GRPO cs.LG | cs.CLPDF

Sofia Torres, Gabriel Almeida, Carter Adams, Camila Rocha

TL;DR: GA-GRPO将外部推理指导统一建模为改变问题分布的随机算子，分析指导带来的策略梯度偏差与总变差距离，并给出收敛界和随偏差动态衰减的最优权重。Qwen2.5-Math-7B-Base九项数学/OOD评测中匹配或超过多种基线，GPU小时减少31%。

Details

Motivation: 可验证奖励强化学习已成为训练多步推理LLM的重要方式，近期方法进一步加入专家轨迹、自解释或检索思路等外部指导，但缺少收敛率、偏差界和指导权重的理论依据。

Result: Guidance-Augmented GRPO把外部指导表示为随机算子G，重写采样问题分布，并将所得策略梯度看作偏差的on-policy估计器；偏差由增强分布与策略自身分布间的总变差距离δ_G界定。框架涵盖GRPO、LUFFY、ExPO、PAPO和TAPO。平滑与有界偏差假设下，证明收敛率O(1/√T)，到GRPO驻点的邻域大小为O(δ√T)，推导MSE最优指导权重λ*=σ₀²/(σ₀²+R_max²δ²T)，并给出匹配下界表明Ω(δ²T)偏差不可避免。Qwen2.5-Math-7B-Base在九个数学/OOD基准上验证最优权重GA-GRPO匹配或超过TAPO、LUFFY、ExPO和GRPO，GPU小时减少31%；另八项分析实验支持理论预测。

Insight: 外部指导不是无代价的监督：指导分布偏离当前策略越大，偏差成本越高，权重应随训练步数和方差动态调节。理论提供偏差—方差最优权重，实验支持在该模型和基准上以较低训练成本获得竞争力。

Abstract: Reinforcement learning with verifiable rewards (RLVR) has become the dominant paradigm for eliciting multi-step reasoning in large language models, and a recent wave of methods (LUFFY, ExPO, PAPO, TAPO) further augments RL with \emph{external guidance} - expert traces, self-explanations, or retrieved thought patterns. Although each method reports empirical gains, none provides convergence rates, bias bounds, or an optimal weighting rule for the guidance signal. We close this gap with \emph{Guidance-Augmented GRPO} (GA-GRPO), a unified theoretical framework that casts external guidance as a stochastic guidance operator G re-writing the question distribution, and analyses the resulting policy-gradient estimator as a biased on-policy estimator whose bias is bounded by the total-variation guidance divergence delta_G between the guidance-augmented sampling distribution and the policy’s own distribution. The framework subsumes vanilla GRPO, LUFFY, ExPO, PAPO, and TAPO as special cases obtained by particular choices of G. Under smoothness and bounded-divergence assumptions we prove that GA-GRPO converges at rate O(1/sqrt(T)) to an O(delta sqrt(T))-neighbourhood of the GRPO stationary point, derive the closed-form MSE-optimal guidance weight lambda-star(T, delta, sigma_0 squared) = sigma_0 squared / (sigma_0 squared + R_max squared delta squared T), and prove a matching minimax lower bound showing the Omega(delta squared T) bias term is unavoidable. Experiments on Qwen2.5-Math-7B-Base across nine math and OOD benchmarks confirm that optimal-weight GA-GRPO matches or surpasses TAPO, LUFFY, ExPO, and vanilla GRPO while requiring 31% fewer GPU-hours, and eight analysis experiments validate each theoretical prediction.

[120] Mask-Guided KV Cache Eviction in Block Diffusion Language Models cs.LG | cs.AI | cs.CLPDF

Gleb Molodtsov, Ekaterina Alimaskina, Evgeny Uskov, Artur Zagitov, Aleksandr Beznosikov

TL;DR: MaskAhead为块扩散语言模型用同一种mask-query排序机制同时选择当前块注意力token并淘汰供未来块使用的KV缓存；量化版本Q-MaskAhead直接基于低比特KV运算。长提示QA中内存平均缩小9.5倍、F1仅降1.2点；量化版缩小20.1倍、F1降2.3点。

Details

Motivation: 块扩散语言模型生成时会保留大型KV缓存，并在每个去噪步骤访问，限制显存容量和速度。降低开销需要同时决定当前块去噪使用哪些历史token，以及哪些KV应继续保留给未来块。

Result: 免训练方法MaskAhead用当前块mask查询估计KV项对当前注意力输出的贡献，以此选择token；对未来被mask块的probe查询估计贡献，以此淘汰缓存。Q-MaskAhead量化变体直接从低比特KV计算选择和注意力，并基本保留被选条目。Fast-dLLM-v2、DreamReasoner和LLaDA2.0-mini评测覆盖长生成推理、长提示问答和needle检索。长提示QA中，相对稠密推理，MaskAhead平均减少9.5倍KV内存，均值F1损失1.2点；Q-MaskAhead减少20.1倍、F1损失2.3点。batch-32系统测试中，端到端加速1.23倍、解码阶段1.68倍。

Insight: 当前生成块与未来块对历史KV的需求不同，统一的mask-query贡献估计可同时处理选择和淘汰；低比特KV进一步压缩内存。性能—内存权衡取决于精度配置和任务，速度数字对应batch-32系统测试。

Abstract: Block diffusion language models keep a large key-value (KV) cache throughout generation and attend to it at every denoising step, limiting both memory capacity and generation speed. Reducing these costs requires deciding which past tokens to use for denoising the current block (selection) and which to keep in memory for future blocks (eviction). We propose MaskAhead, a training-free method that solves both tasks with a single mask-query-based ranking mechanism. Current-block masks guide selection, while probes of upcoming masked blocks guide eviction. Both rank KV entries by their estimated contribution to the attention output. Our quantized variant, Q-MaskAhead, computes selection and attention directly from low-bit KV, largely preserving the selected entries. Experiments on Fast-dLLM-v2, DreamReasoner, and LLaDA2.0-mini cover long-generation reasoning, long-prompt question answering, and needle-in-a-haystack retrieval. On long-prompt QA, MaskAhead reduces KV memory by $9.5\times$ on average with a 1.2-point mean F1 loss relative to dense inference. Q-MaskAhead increases the reduction to $20.1\times$ with a 2.3-point mean F1 loss. In a batch-32 systems profile, MaskAhead achieves $1.23\times$ end-to-end and $1.68\times$ decode-stage speedups over dense inference.

Yining Zhao, Bushi Liu, Haofei Yu, Zhengyang Qi, Shanyong Wang

TL;DR: macro2mind从预测市场价格变化学习群体行为推理，再零样本迁移到用户模拟：模型显式推断市场参与者群体、其解读新闻和更新信念的方式、群体互动及价格汇总。SWM-Bench上Polymarket方向准确率和相关性达SOTA；生成训练数据使下游模拟器对未见用户准确率提高15.5点。

Details

Motivation: LLM常被用于模拟个体对新情境的反应，但行为推理通常继承预训练或依赖个体级标注，行为多样性有限，也缺乏对推理过程的监督。预测市场价格轨迹记录了大规模群体对真实事件的反应，可作为宏观行为推理信号。

Result: macro2mind用市场信号进行GRPO训练，把预测明确分解为：推断有代表性的参与者群体、预测各群体如何解读新闻并更新信念、分析群体互动，最后聚合为价格。后悔课程与难度感知采样聚焦事后识别群体能显著改进预测、且当前策略仍可学习的转变。模型在无需额外训练下迁移到用户模拟；SWM-Bench上Polymarket方向准确率和相关性达到SOTA，四个用户模拟基准Humanual、OvertonBench、PRISM、CAD上零样本表现具竞争力。作为数据生成器时，下游模拟器对未见用户准确率提高15.5点，比骨干模型生成数据高13.2点。

Insight: 市场聚合价格可提供大规模群体行为监督，训练得到的群体分解推理可迁移到个体用户模拟。数据生成对未见用户提升较明显，但宏观市场参与者群体与个体用户行为仍有差异，迁移质量取决于任务及基准。

Abstract: Large language models are increasingly used to simulate how individuals respond to new situations, yet the behavioral reasoning behind these responses is either inherited from pretraining or learned from individual-level annotations, which offer limited behavioral diversity and little supervision of the reasoning itself. We propose to learn behavioral reasoning from prediction markets, whose price trajectories record how populations respond to real-world events at scale. We introduce macro2mind, which trains a language model with GRPO using market signals. A social behavioral decomposition makes behavioral reasoning an explicit step of forecasting: the model infers representative groups of market participants, predicts how each interprets the news and updates its beliefs, reasons about their interactions, and aggregates these responses into a price. A hindsight-regret curriculum with difficulty-aware sampling focuses training on transitions where hindsight-identified groups substantially improve the forecast while prioritizing examples that remain learnable for the current policy. The learned reasoning applies to user simulation without further training. On SWM-Bench, macro2mind achieves state-of-the-art directional accuracy and correlation on Polymarket. Trained on market data, it transfers zero-shot to four user-simulation benchmarks (Humanual, OvertonBench, PRISM, and CAD) and has competitive performance among zero-shot methods. Used as a data generator, macro2mind also raises a downstream simulator’s accuracy on unseen users by 15.5 points, outperforming data generated by its backbone by 13.2 points.

[122] Minimal Witness Reinforcement Learning cs.LG | cs.AI | cs.CL | cs.LOPDF

T. Y. Tsui, Zihao Ye, Pengxiang Cai, Yanchao Li, Yuqiang Li

TL;DR: MWRL将强化学习目标从单一成功解扩展为发现全部最小充分见证：对一组成功提案，按去掉某提案会使集合覆盖损失多少分配信用。由此导出能恢复完整见证族的值迭代规划器和可扩展到LLM的策略梯度方法，实验中比常见方法更能找出不同最小解。

Details

Motivation: 解释、机制和理由通常对应产生结果所需的不可约充分条件，即最小见证；许多问题需要找到多个不同最小见证。标准RL可能只暴露一种方案或返回冗余超集，无法恢复替代解释。

Result: MWRL把问题形式化为最小见证识别。它取策略采样的成功提案所认证集合的并集，并以删去某提案会使联合覆盖减少多少为信用分配依据；该规则直接来自问题定义，并可用单个黑盒验证器位统一兼顾最小性与多解发现。作者据此推导能恢复整族见证的值迭代规划器，以及可扩展到大型语言模型的策略梯度算法。不同实验设置中，MWRL找回大部分最小见证，而其他方法常返回冗余超集或单一见证。

Insight: 当任务要求多种互不冗余的最小解释时，优化单次成功率不足以鼓励解的覆盖多样性；依据联合覆盖损失分配奖励可把“发现替代解”直接纳入RL目标。摘要未报告各设置恢复率或规模上限。

Abstract: ``What are the irreducible conditions that are sufficient to produce an outcome?’’ is one of the most common questions that recur across computation and science. Its answers, the minimal sufficient witnesses, are what we mean by explanations, mechanisms and reasons. These problems usually ask for multiple minimal witnesses, yet standard RL methods may reveal only one solution or redundant ones. We formalize this problem as minimal-witness identification and introduce Minimal-Witness Reinforcement Learning (MWRL). MWRL takes the union of the sets certified by successful proposals sampled from the policy and credits each proposal for the coverage the group union would lose without that proposal. This credit assignment, derived directly from the problem definition, unifies the demands for minimality and recovery of alternatives from a single black-box verifier bit. Under this principle, we derive a value iteration planner that recovers the entire family of witnesses and a policy gradient method that can scale to large language models. Across different experimental settings, MWRL recovers most minimal witnesses, while other methods return redundant supersets or a single witness. By making witness families learnable from verifier feedback, MWRL expands the scope of reinforcement learning beyond single-solution optimization. Our code is available at https://github.com/TSUITUENYUE/MWRL.

[123] Structuring MoE Expert Selection for Agentic Reinforcement Learning cs.LG | cs.CLPDF

Bolian Li, Ting-Yao Hu, Cheng-Yu Hsieh, Sanjoy Chowdhury, Oncel Tuzel

TL;DR: 本文研究智能体RL后训练中MoE专家路由的结构，并提出分层路由控制：按轮次鼓励专家选择与READ、UPDATE等智能体操作对齐，同时约束token级选择保持局部一致；加入熵门控稳定训练后，所有评测基准成功率提升超过10个百分点。

Details

Motivation: 长时程LLM智能体常使用稀疏MoE，但智能体行为与MoE结构如何协同设计研究不足。预训练MoE的专家选择已呈现与智能体轨迹相关的结构，标准RL却不控制路由，可能限制任务表现和推理效率。

Result: 作者发现语义相似操作（如READ、UPDATE）所在轮次间专家路由重叠更高，操作不同则重叠较低。分层路由控制框架在轮次级鼓励专家选择对齐智能体操作，在token级正则化以维持局部一致；为缓解后训练稳定性问题，还提出熵门控控制机制。所有评估基准上，框架带来超过10个百分点的成功率提升。

Insight: 智能体轨迹本身含有可用于优化MoE容量分配的结构信号；轮次级操作路由和token级一致性需要协同控制，训练稳定性也需单独处理。摘要报告成功率增益，但没有具体推理效率或各基准数字。

Abstract: Long-horizon LLM agents are frequently implemented using sparse mixture-of-experts (MoE) models, yet the co-design of agentic behavior and MoE structures remains underexplored. In this work, we comprehensively study the connections between agentic post-training and MoE expert selection. In off-the-shelf MoE models, we observe expert selection exhibits a specialized structure that naturally aligns with agentic trajectories. Specifically, expert routing overlaps more between turns where the agent performs semantically similar operations (e.g., READ, UPDATE) than between turns with differing operations. However, standard RL algorithms ignore this specialization, allowing the MoE routing to go uncontrolled during training, which empirically limit task performance and inference efficiency. To address this, we introduce a hierarchical routing control framework for agentic tasks. We explicitly encourage turn-level expert selections to align with agentic operations while regularizing token-level expert selections to maintain local consistency. To resolve stability issues that arise during post-training with the proposed methods, we further introduce an entropy-gated control mechanism. Overall, our routing control framework achieves over 10-point improvements in success rate on all evaluated benchmarks. These results demonstrate that agentic trajectory structure provides an effective signal for optimizing MoE capacity during RL post-training.

[124] Improving Synthetic Data Generation for Argument Mining via Adversarial Reinforcement Learning cs.LG | cs.CLPDF

Zhijun Zhang, Qianlong Wang, Keyang Ding, Genan Dai, Bowen Zhang

TL;DR: 本文提出对抗强化学习合成论证挖掘数据，生成器产生带结构标注的论证样例，判别器区分真实与合成候选并反馈训练信号，联合优化数据结构正确性与多样性。三个基准的全数据和低资源设置均有持续性能提升。

Details

Motivation: 论证挖掘需要高质量结构标注数据，但这类数据稀缺。LLM合成数据虽有潜力，却难同时保证论证结构准确和样例足够多样。

Result: 作者将合成数据生成建模为生成器与判别器的对抗训练循环：生成器提出结构化论证挖掘样例，判别器判断真实数据与合成候选并提供学习信号，使生成质量逐步改善并维持多样性。三个基准的全数据和低资源实验均报告论证挖掘性能持续提升，支持方法的有效性和可扩展性；摘要没有给具体指标或相对提升值。

Insight: 合成论证数据不能只追求表面相似，需由结构判别反馈同时校准论证结构和数据多样性。当前摘要给出多基准、低资源定性优势，但具体收益和生成质量指标未报告。

Abstract: Argument Mining (AM) is fundamentally constrained by the scarcity of high-quality structure-annotated datasets. While LLMs have shown promise in synthetic data generation, producing synthetic AM data that is both structurally accurate and sufficiently diverse remains a challenging problem. To address this problem, we revisit synthetic data generation for AM from a new perspective and propose a novel adversarial reinforcement learning framework for data synthesis. The proposed framework jointly optimizes the generator and the discriminator in an adversarial loop, in which the generator produces structured AM instances, and the discriminator provides learning signals by distinguishing real data from synthetic candidates. This enables the generator to progressively improve both the structural accuracy of generated argument data while maintaining diversity through adversarial feedback. Extensive experiments demonstrate that the proposed framework consistently improves AM performance on three benchmark datasets in both full-data and low-resource settings, validating its effectiveness and scalability.

[125] TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models cs.LG | cs.CLPDF

Xin Wang, Hao Yu, Zhengyang Zhuge, Bochao Mao, Zheng Li

TL;DR: TRACE面向MoE语言模型强化学习提出rollout指导的FP4量化训练，使训练路径的舍入决策直接对齐rollout路径，而非分别优化两边量化误差；选择性缓存深层尾数和尺度信息以控制额外开销。四个大规模MoE任务上，FP4权重/激活及KV rollout性能可比BF16，rollout最高加速5.4倍。

Details

Motivation: LLM强化学习rollout生成带来巨大计算与显存开销，促使研究者用低精度rollout；但现有FP4方法通常分别校准训练和rollout路径，没有直接减少两条量化执行路径之间的差异，可能使策略训练不稳定或最终性能受损。

Result: TRACE用rollout侧量化结果指导训练侧FP4舍入决策，直接减小训练—rollout差异；再以量化信息缓存选择性保留深层尾数和尺度，降低引导信息的存储和通信成本。在四个大规模MoE模型的推理、代码和长时程RL任务上，联合FP4权重/激活与FP4 KV缓存rollout时，RL性能可与BF16 rollout相比；rollout速度最高提升5.4倍，最终FP4策略也优于BF16训练后再做后验FP4量化。

Insight: 强化学习的低精度关键不仅是每条路径自身精确，也要使策略训练与采样执行看到的量化模型一致。rollout引导校准和缓存压缩兼顾路径对齐与系统成本；摘要未提供各模型任务的逐项性能差异。

Abstract: Reinforcement learning (RL) for post-training large language models (LLMs) incurs substantial computation and memory overhead during rollout generation, which motivates low-precision rollout for efficient RL training. However, existing FP4 RL methods suffer from a key limitation: they primarily optimize quantization accuracy on the training and rollout paths independently rather than directly reducing the discrepancy between the two quantized execution paths. In this work, we propose TRACE (Train-Rollout Quantization Alignment via Compact GuidancE), an FP4 quantization framework for RL training of Mixture-of-Experts (MoE) language models that addresses the limitation of existing FP4 RL methods. TRACE incorporates rollout-guided quantization-aware training that uses rollout-side quantization outcomes to guide training-side FP4 rounding decisions, directly reducing train-rollout discrepancy. Moreover, TRACE adopts an efficient quantization-information caching scheme that selectively retains mantissa and scale information from deeper layers to reduce the storage and communication overhead introduced by rollout guidance. We evaluate TRACE on four large-scale MoE language models across reasoning, coding, and long-horizon RL tasks. Our results demonstrate that TRACE enables joint FP4 weight/activation and FP4 KV-cache rollout with RL performance comparable to BF16 rollout, while achieving up to 5.4xrollout speedup and strong final FP4 performance compared with post-hoc FP4 quantization of BF16-trained policies.

[126] $α$Transfer: Coefficient Transfer for Efficient Model Merging cs.LG | cs.CL | cs.CVPDF

Shih-Cheng Huang, Zhi Rui Tam, Chieh-Yen Lin, Yun-Nung Chen, Hung-yi Lee

TL;DR: αTransfer利用同一模型家族在不同规模上的模型合并系数性能分布相似性，先在小型代理模型搜索最优系数，再直接迁移到大模型。视觉Transformer上搜索加速6倍、内存减少70%；LLM上加速20倍、内存减少85%，性能保持相近。

Details

Motivation: 模型合并可通过参数算术组合多个微调checkpoint，但寻找最优系数需要大量搜索；模型尺寸和数量增长会带来高内存成本及组合空间爆炸。

Result: 作者发现同一家族不同模型规模在合并系数上的性能分布高度一致，据此提出αTransfer：在小型代理模型上搜索最优系数，再迁移到大型目标模型。多个模型合并方法、家族和任务实验验证了该策略。视觉Transformer上搜索速度提高6倍、内存减少70%；大语言模型上加速20倍、内存减少85%，同时保持相近性能。

Insight: 如果系数—性能关系在模型家族内跨规模稳定，昂贵的大模型系数搜索可被小代理替代。实验显示较大资源节省且表现近似，但迁移前提是同家族分布相似，不宜直接推广至不同架构/家族。

Abstract: Model merging offers a promising solution for combining multiple fine-tuned checkpoints into a single model through parameter arithmetic. However, finding optimal merging coefficients requires an extensive search that becomes prohibitively expensive as models scale in both size and number, due to high memory requirements and combinatorial growth in the search space. We show that, within the same model family, models exhibit highly congruent performance distributions over merging coefficients across different model sizes. This distributional similarity enables a practical paradigm we call \textit{$α$Transfer}: searching for optimal coefficients on a small proxy model, then directly transfer them to larger target models. We verify $α$Transfer across multiple merging methods, model families, and tasks. Experimental results demonstrate a 6$\times$ speedup and 70% memory reduction on vision transformers, and a 20$\times$ speedup and 85% memory reduction on large language models, while maintaining comparable performance. Our findings establish $α$Transfer as an efficient and generalizable approach to scaling model merging.

[127] TEMPEST: Temporal Embeddings for Scalable Driver Identification via Angular Margin Learning cs.LG | cs.CVPDF

Kyle Musgrove, Dylan B. Lewis, Sarah Powers, Emma J. Reid, Hector Santos-Villalobos

TL;DR: TEMPEST用时间卷积网络和ArcFace角度间隔损失，把60秒多模态驾驶窗口映射到96维嵌入，支持无需重训或重拟合分类器的动态驾驶员注册。45人严格时间划分上Rank-1为91.71%；用户池从10增至45时仅降4.3个百分点，优于监督/无监督triplet基线。

Details

Motivation: 驾驶员识别需在车队规模增长时保持可区分性，但现有triplet-loss方法随驾驶员数量增加而性能快速下降，并在严格时间评测中容易过拟合会话特定模式。

Result: TEMPEST采用加性角度间隔ArcFace损失，在归一化角空间形成全局类别分离；将60秒多模态驾驶数据映射为96维嵌入，可动态注册新驾驶员，无需重训或重新拟合分类器。45人数据集严格时间评估Rank-1准确率91.71%，比最佳传统模型高17.9个百分点，比最强triplet基线高58.4点。用户池由10增至45人时性能仅降4.3点，监督和无监督triplet基线分别降22点和32.5点。公开KIA Soul数据上跨会话优势也成立：相对最佳传统模型，同会话高7.3点、跨会话高14.3点。模型72万参数、2.80MB，50个epoch收敛。

Insight: 角度间隔目标带来的全局类别分离比常见三元组距离约束更能支撑规模扩展和时间迁移；紧凑嵌入还能支持动态注册。识别性能仍依赖驾驶行为生物特征数据，部署需考虑驾驶情境变化与隐私。

Abstract: Scalable driver identification requires embedding models that maintain discriminative performance as fleet size grows, yet existing triplet-loss formulations degrade rapidly with driver pool size and overfit to session-specific patterns under rigorous temporal evaluation. We introduce TEMPEST, a Temporal Convolutional Network embedding model trained with an additive angular margin (ArcFace) loss that enforces global class-level separation in a normalized angular space. TEMPEST maps 60-second multimodal driving windows to compact 96-dimensional embeddings, supporting truly dynamic enrollment without any retraining or classifier refitting. Under rigorous temporal evaluation on a 45-driver dataset, TEMPEST achieves 91.71% Rank-1 accuracy, outperforming the best classical model by 17.9 pp and the strongest triplet-loss baseline by 58.4 pp. TEMPEST degrades by only 4.3 pp when growing the subject pool from 10 to 45 drivers, compared to 22 pp and 32.5 pp for supervised and unsupervised triplet-loss baselines, and its cross-session advantage is corroborated on the public KIA Soul dataset, where it outperforms the best classical model by 7.3 pp within-session and 14.3 pp cross-session. With 720K parameters, a 2.80 MB footprint, and 50-epoch convergence, TEMPEST establishes a rigorous, reproducible baseline for scalable behavioral driver biometric identification.

[128] Principled Under Pressure: Post-Training Decides Whether LLMs Act on Their Own Moral Judgment cs.LG | cs.AI | cs.CLPDF

Orion Reblitz-Richardson

TL;DR: 本文用配对情境区分模型知道道德判断与压力下是否按判断行动：248个预注册情境涵盖五种压力。四个指令模型中差距依后训练方案而异；OLMo-3和Llama-3.1-Instruct存在，Tulu 3整体未见，Qwen结果部分未定。使用聊天模板会显著改变测量，事前推理利害关系可使选择回归模型自身判断。

Details

Motivation: 智能体可能口头判断某行为错误却实际执行，这与“不知道对错”是不同失效；只测模型陈述价值观无法识别行动与判断不一致。需要用配对设计控制场景和压力，并检查后训练方案及提示格式的影响。

Result: 研究构建涵盖五类压力的248个预注册情境，每个情境分别问模型作为行动者会做什么、第三人称下哪种选择正确，以模型自身判断作参照；每个情境还有移除压力的孪生版本，并提供操作者明确要求违规行为的正控，区分真实一致性与仪器失灵。OLMo-3-7B-Instruct约五分之一有压力情境会采取自己判错的行动，频率高于无压力版本。四种指令模型差距取决于后训练：OLMo-3和Meta Llama-3.1-8B-Instruct存在；同一Llama底座的Ai2 Tulu 3整体面板和其最有压力子集均未见超过约0.01概率的差距；Qwen2.5-7B全体未见超过约0.02，子集估计0.083、区间[-0.028,0.195]尚不确定。脱离聊天模板测试会反转无利害情境下差距符号。两种存在差距的模型在行动前推理利害后更符合自身判断，无论有无压力；仅说出相关规范效果约为该干预的三分之一。

Insight: 道德自述与实际行动的差距不是预训练权重固定属性，而会受后训练和聊天模板影响；评测应使用配对行动/判断、压力移除和正控。事前推理利害关系可改善一致性，但结论依模型和协议而变。

Abstract: Language models increasingly act as agents. An agent that says an action is wrong and then takes it anyway is a different failure from one that does not know better, and evaluations of stated values cannot see it. We build a pre-registered panel of 248 scenarios across five kinds of pressure. Each scenario is posed twice to the same model, once as the agent choosing what to do and once in the third person asking which option is right, so the model’s own judgment is the reference. Every scenario has a twin with the pressure removed, and every model gets a positive control in which its operator orders the violating action, so that a missing gap can be told apart from a blind instrument. On OLMo-3-7B-Instruct, the model takes the action it judged wrong on about one in five pressuring scenarios, more often than on the same scenarios with the pressure removed. Across four instruct models the gap depends on the post-training recipe: OLMo-3 and Meta’s Llama-3.1-8B-Instruct carry it; Tulu 3 shows none on the whole panel (above about 0.01 in probability) or on its own most-pressuring scenarios; Qwen2.5-7B-Instruct shows none on the whole panel (above about 0.02) and is unresolved on its own (0.083, -0.028 to 0.195). Meta’s recipe and Ai2’s Tulu 3 start from the same Llama-3.1 weights, and only Meta’s carries the gap. Reading a chat model outside its chat template reverses the sign of its gap with nothing at stake (-0.038 against +0.055 under the template on OLMo-3), a distortion present on two of three recipes. On both models that carry it, reasoning about the stakes before acting moves the choice back toward the model’s own judgment, against a same-length non-moral task, with or without the pressure; on OLMo-3, naming the norm at stake does about a third of that. The gap is a measurable target for post-training recipes, not a fixed property of pretrained weights.

[129] A Systematic Study of Small Language Models on Abstract Reasoning Tasks cs.LG | cs.CLPDF

Nur A Zarin Nishat, Jens Lehmann, Andrei Aioanei, Sahar Vahdati

TL;DR: 该系统研究分析小型语言模型在ARC-TGI抽象网格规则任务中的学习是否能迁移，而非只记住分布规律。1,000多次运行显示模型可取得较高训练分布精度，但受优化和任务族影响明显；分布外、网格尺度改变时性能骤降，执行规则归纳在部分任务上比直接生成网格更有效。

Details

Motivation: 抽象推理基准的最终准确率无法说明模型是否学到可迁移规则，还是拟合数据分布特定规律。需要通过重采样、空间平移、跨基准迁移及训练配方比较来评估小型模型学习稳定性和泛化。

Result: 研究在ARC-TGI上对1,000多次运行进行画像，涵盖仅解码器、编码器—解码器和MoE模型的监督微调；考察技能获得效率与稳定性、训练分布外鲁棒性、模型家族与任务表述交互，以及层级注意力特征。模型可在分布内取得较高准确率，但技能受优化设置影响，且在不同任务族间分布不均。训练分布外表现显著下降，包括规则不变但网格尺度改变时。训练集深度/广度带来的收益不均，额外上下文示例效果依模型家族变化。对选定任务，先归纳可执行规则再求解可得到直接网格生成未产生的正确答案。注意力诊断显示若干差异，但不构成普适因果机制。

Insight: 抽象推理成绩依赖模型、微调、测试分布和输出格式，单一终点分数容易高估规则迁移。规则可执行表征在部分设置有帮助，但注意力模式只是相关诊断，尚不能说明通用因果机制。

Abstract: Endpoint accuracy on abstract-reasoning benchmarks does not reveal whether a language model has acquired a transferable rule or fit distribution-specific regularities. We study this distinction in small language models on the ARC-TGI benchmark, which organizes abstract grid transformations into controllable task families and supports resampling, spatial shifts, and cross-benchmark transfer. Across more than 1,000 runs, we profile decoder-only, encoder–decoder, and mixture-of-experts model families under supervised fine-tuning. We examine the efficiency and stability of skill acquisition, robustness beyond the training distribution, interactions with model family and task formulation, and layer-wise attention signatures that accompany behavioral differences. Substantial in-distribution accuracy is attainable, but acquisition is sensitive to optimization and unevenly distributed across task families. Performance deteriorates sharply outside the training distribution, including when the rule is retained but grid scale changes. Greater training-set depth and breadth yield uneven gains, while the effect of additional in-context examples depends on model family. Executable-rule induction also yields correct solutions not observed under direct grid generation. On selected tasks, attention diagnostics show distinct concentration and context-dependence profiles, but do not establish general causal mechanisms. Overall, abstract-reasoning scores are conditional on the model, adaptation regime, evaluation distribution, and response format.

[130] Optimization Encoders: Rethinking Second-Order Meta-Learning for Neural Fields cs.LG | cs.CVPDF

Rudolf L. M. van Herten, Soufiane Ben Haddou, Rachit Saluja, Johannes C. Paetzold

TL;DR: 本文把条件神经场潜变量优化视为“优化编码器”，统一解释二阶梯度、潜变量参数化和任务监督，并提出基于等变Transformer的Attentive Latent Fields（MetaLF）。仅用3–5次梯度更新即可改善图像和3D形状重建，还支持跨图像、形状和体数据的语义预测。

Details

Motivation: 条件神经场以连续方式表示信号，但其表现依赖如何从观测推断条件潜变量；元学习中这一编码过程由解码器梯度更新决定，表示学习和解码器设计因此相互绑定。常见一阶近似会丢弃部分学习路径。

Result: 作者将潜变量优化形式化为optimization encoder，使二阶元学习可端到端联合训练编码过程和解码器，并明确一阶近似省略的学习通道。MetaLF是等变Transformer神经场，通过自注意力对潜在点云上下文建模，使局部观测影响一致的非局部结构，并同时塑造场预测和潜表示更新。分离内层编码目标和外层任务监督后，重建、分类和分割可统一为元学习框架，测试时只需重建目标适配。多项可控多项式场实验显示潜变量协调与更低有效秩及更贴合底层函数空间相关；图像和3D形状重建中3–5步梯度更新即可提升保真度，并支持图像、形状、体积语义预测。

Insight: 潜表示不是编码器一次输出，而是由解码器和任务监督共同塑造的优化过程；从“优化编码器”角度设计可解释二阶梯度与任务适配的关系。摘要报告少步提升与多任务支持，但未给具体重建指标。

Abstract: Conditional neural fields represent signals continuously, but their effectiveness depends on how the conditional latent representations are inferred from observed data. In meta-learning, this encoding occurs through gradient updates induced by the decoder, tying representation learning directly to decoder design. We formalize this connection by interpreting latent optimization as an optimization encoder, unifying the roles of second-order differentiation, latent parameterization, and task supervision. This concept enables second-order meta-learning for end-to-end training of the encoding procedure alongside the decoder, and clarifies which learning pathway first-order approximations discard. Guided by this view, we introduce Attentive Latent Fields (MetaLF), an equivariant transformer-based neural field that contextualizes a latent pointcloud through self-attention. These interactions shape both field predictions and the updates that construct their representation, allowing local observations to inform coherent non-local structure. Disentangling the inner encoding objective from outer task supervision unifies reconstruction, classification, and segmentation within an end-to-end meta-learning framework, using reconstruction-only latent adaptation at test time. Controlled experiments on polynomial fields link latent coordination to lower effective rank and stronger alignment with the underlying function space. Across image and 3D shape reconstruction, MetaLF improves fidelity within three to five gradient updates, while supporting semantic prediction across images, shapes, and volumes. Together, these findings position the optimization encoder perspective as a unified basis for designing neural fields around how representations are constructed, coordinated, and used.

[131] Mu-DisCoCat: A Variational Pipeline for Compositional Generalization on Quantum Processors cs.LG | cs.CVPDF

Mina Abbaszadeh, Matilda Karabina Moore, Raem Haq, Martha Lewis, Mehrnoosh Sadrzadeh

TL;DR: Mu-DisCoCat将组合分布式语义映射到变分量子电路，实现多模态组合泛化：先从单物体图文对学习稳定对象表征，再固定这些表征、从多对象情境学习对象关系。经典模拟上关系OOD准确率高于所评CLIP；噪声量子硬件结果与模拟保真度仍呈强正相关。

Details

Motivation: 组合泛化要求把已学原语重组为新情境，是AI的基础难题。DisCoCat将向量推广为张量以组合语义，但张量学习有规模瓶颈；用变分量子电路实现文本版可缓解部分问题，但此前尚未扩展到组合泛化所需的多模态情境。

Result: Mu-DisCoCat先从单物体图像—文本配对学习对象表征，再固定对象表示、在多物体情境中学习对象关系。经典模拟使用Uhlmann态保真度计算多模态电路表示重叠，关系OOD准确率高于评估的CLIP基线。部署使用破坏性SWAP测试，在多种含噪量子模拟器（含IBM fake后端、IQM FakeAphrodite）和IBM Marrakesh处理器上评估；尽管真实设备有噪声，硬件执行模型与模拟保真度仍保持强正相关，可可靠区分未见的相似/不相似对象对。

Insight: 分阶段固定对象概念再学习关系，为量子电路实现多模态组合语义提供了可执行路径；硬件实验显示模拟学到的关系结构可部分承受设备噪声。摘要未给准确率或硬件规模数字，不能据此评估与经典大模型的整体效率比较。

Abstract: Achieving compositional concept generalization (CoCoGen), the ability to understand novel situations by recombining learned primitives, remains a fundamental challenge in artificial intelligence. Compositional semantic models such as Compositional Distributional Semantics (DisCoCat) offer solutions by generalising vectors to tensors, but suffer from scaling bottlenecks when learning the tensors. Mapping DisCoCat onto Variational Quantum Circuits (VQCs) resolves this limitation for text, yet the methodology has not been expanded to multimodal situations such as the ones involved in CoCoGen. This paper introduces Mu-DisCoCat: a multimodal variational quantum learning framework for DisCoCat that achieves CoCoGen. The framework first learns stable object representations from single-object image-text pairs, then fixes these and uses them to learn the relations between them in multi-object situations. In classical simulations, the model used Uhlmann state fidelity to compute the overlap between the multimodal circuit representations and achieved higher relational OOD accuracy than the evaluated CLIP baseline. Its deployment was evaluated using the destructive SWAP test across noisy quantum emulators, including a range of IBM fake backends, IQM FakeAphrodite, and the IBM Marrakesh quantum processor. Despite real-world device noise, the hardware-executed models maintained a strong positive correlation with simulated fidelities, reliably distinguishing unseen similar and dissimilar pairs. Our work establishes a framework for executing CoCoGen on VQCs, demonstrating a viable use case for near-term quantum hardware.

cs.MA [Back]

[132] Visual Orchestration Tax in Agentic VLM Pipelines: Auditing and Certifying Visual Evidence Reuse cs.MA | cs.CVPDF

Lingteng Zeng

TL;DR: 本文定义智能体VLM流水线的视觉编排税：相同静态图像在多个专家调用间被反复重建为图像请求。SeeingEye和MAMMQA审计发现66.8%–75.6%触点冗余；SharedVisCache按图像内容、预处理指纹和编码器假设验证可复用性，保持全部输出字符串不变并减少视觉编码调用。

Details

Motivation: 智能体VLM流水线常把同一静态视觉证据传给多个专家和工具；语义未变的图像仍在API边界重复重建，带来系统级冗余。缓存只有在图像内容、预处理和编码器约定相同且输出不受影响时才能安全复用。

Result: 测量框架用M1_trace统计原始视觉证据触点，M2评估结构冗余，并给出查询分布、bootstrap区间和配对质量测试。在图表、文档、通用VQA和多模态QA任务的SeeingEye/MAMMQA审计中，视觉证据触点冗余达66.8%–75.6%，每个已审计查询都超过预定义门槛。SharedVisCache以图像内容、预处理指纹、编码器假设作为复用契约。SeeingEye中契约验证认证75.0%–75.5%重复触点可复用，350/350输出字符串保持一致且ΔM5=0。物理层调用量：ChartQA-200轨迹回放F_vision从800降至200；在线SeeingEye翻译阶段从200降至50，分别保持800/800和200/200输出不变。

Insight: 视觉缓存不应只按文件名或请求相似判断，而应以内容、预处理与编码器契约证明语义等价，并验证输出不变。审计和物理层调用数都支持显著复用，但结论针对所测流水线和接口。

Abstract: Agentic VLM pipelines increasingly pass the same static visual evidence through multiple specialist agents and tools. This design creates an orchestration-level redundancy mode: semantically unchanged images are repeatedly reconstructed as image-conditioned requests at the VLM API boundary. We call this phenomenon visual orchestration tax and develop a measurement-to-certification framework for visual evidence reuse in agentic VLM pipelines. The audit side defines $\mathrm{M1}{\mathrm{trace}}$ to count raw visual-evidence touches and M2 to measure structural touch redundancy, with query-level distributions, bootstrap confidence intervals, and paired quality tests. Across SeeingEye and MAMMQA on chart, document, general-VQA, and multi-modal-QA tasks, audits reveal 66.8-75.6% visual-evidence touch redundancy, and every audited query exceeds the predefined gate. The certification side introduces SharedVisCache, a contract-aware evidence reuse hook keyed by image content, preprocessing fingerprint, and encoder assumptions. On SeeingEye, contract validation certifies 75.0-75.5% repeated touches as reusable while preserving 350/350 output strings and $Δ\mathrm{M5}{=}0$. At the physical layer, certified hits reduce $F{\mathrm{vision}}$ from 800 to 200 in ChartQA-200 trace replay and from 200 to 50 inside live SeeingEye translator-stage physical integration, preserving 800/800 replay strings and 200/200 integrated call outputs. The results position visual reuse as a measurable, behavior-preserving property of agent orchestration and define an agent-layer contract that makes backend prefix or token reuse semantically interpretable.

cs.RO [Back]

[133] ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perception cs.RO | cs.CVPDF

Ruoxuan Feng, Yutong Chen, Ruihua Song, Huan Yang, Zhongyuan Wang

TL;DR: ROMA是LLM驱动的真实物体多感官主动感知系统，融合视觉、音频、触觉和力觉，以“推理—交互—反馈”循环识别缺失证据、选择对象/动作/模态并执行。作者构建近2,000物体、6类原子交互的ROMI-2K数据集和ROMA Bench，实验显示可解决长链多感官任务。

Details

Motivation: 人类会在感官证据不足时主动判断缺什么信息、如何获取以及何时足够；现有机器人多只融合已有传感输入，很少通过物理交互主动补充缺失证据。

Result: ROMA由LLM判断缺失证据和下一步对象、交互及感官模态，物理接口执行并收集多感官反馈，形成推理—交互—反馈循环。ROMI-2K包含近2,000个真实物体、6种原子交互及同步多感官数据。两阶段训练先对齐传感模态，再训练LLM评估证据是否充分、选择信息丰富的交互并推理反馈。作者把主动感知描述为证据驱动后续交互和推理的感知链，并建ROMA Bench评估单属性、长程多属性和意图驱动任务。实验显示ROMA能主动补充缺失证据，解决现有方法困难的复杂长链多感官任务；摘要未给量化分数。

Insight: 主动感知把多模态理解从被动融合转为闭环信息获取：系统需明确知道当前缺什么证据，并选择能最大程度消除不确定性的交互。数据集和分层基准覆盖多种任务，但摘要未报告成功率或采样效率。

Abstract: Humans inherently understand the physical world through an active process. When sensory evidence is insufficient to infer physical properties, we naturally interact with the environment by deciding what information is missing, how to acquire it, and when sufficient evidence has been obtained. In stark contrast, existing multi-sensory robot systems mainly integrate sensory inputs rather than actively acquiring missing evidence through interactions. In this work, we introduce ROMA, an LLM-based system for Real-World Object-Centric Multi-Sensory Active Perception. ROMA integrates vision, audio, tactile, and force sensing into a reasoning-interaction-feedback loop. The model identifies missing evidence and determines the target objects, interactions, and modalities, while a physical interface executes the selected interactions and collects the multi-sensory feedback. To support this capability, we construct ROMI-2K, a large-scale real-world multi-sensory object interaction dataset covering nearly 2,000 objects and 6 atomic interactions with synchronized sensory feedback. Building on these data, we develop a two-stage training framework that aligns sensory modalities and equips the LLM to assess evidence sufficiency, select informative interactions, and reason over the multi-sensory feedback. We further characterize active perception as perception chains, where acquired evidence guides subsequent interactions and reasoning, and establish ROMA Bench to evaluate single-attribute, long-horizon multi-attribute, and intent-driven active perception. Experiments show that ROMA can actively acquire missing evidence and solve complex, long-chain multi-sensory perception tasks that existing methods struggle to handle, laying a strong perceptual foundation for active multi-sensory embodied agents.

Pol Francesch Huc, Simone D’Amico

TL;DR: 本文用Transformer视觉里程计前端与MSCKF结合，仅凭单服务航天器单目图像估计未知目标航天器相对位姿，不需目标形状先验或深度/激光/双目；近距离下通过服务航天器姿态机动恢复距离可观性。103种合成航天器中留出11种测试，姿态中位误差3.7°、ROE距离误差2.2%。

Details

Motivation: 未知航天器的交会与近距离操作需要目标相对位姿，但不少视觉方法依赖目标形状/惯量先验、额外深度传感器或只能恢复尺度不定的平移。作者探索对未见目标也适用的单目方案。

Result: Transformer网络根据LightGlue匹配的SuperPoint特征估计相邻图像的尺度不确定位姿变化；MSCKF结合这些伪测量与轨道/姿态运动学模型估计目标相对相机的位姿、相对轨道要素、姿态和角速度。单目近距离情况下，服务航天器执行姿态机动以恢复目标距离完整可观性。训练与评估基于高分辨率重渲染SPE3R数据集（103个合成航天器），11个目标在训练时留出；蒙特卡洛仿真在留出目标轨迹上验证。姿态中位误差3.7°，ROE距离误差为2.2%。

Insight: 学习式单目视觉可作为滤波器前端，结合轨道动力学和主动姿态机动克服尺度不可观问题；无需目标形状先验且能测留出航天器。验证仍基于合成重渲染图像和蒙特卡洛轨迹，真实在轨表现尚未证明。

Abstract: This work presents a novel learning-based pipeline for pose estimation of unknown spacecraft using only monocular images from a single servicer. The approach combines a transformer-based neural network with a Multi-State Constraint Kalman Filter (MSCKF) to estimate the pose (i.e., position and orientation of the target spacecraft relative to the camera) throughout rendezvous and proximity operations. Unlike existing vision-based methods that require prior knowledge of the target shape or inertia properties, rely on additional sensing modalities such as depth, lidar, or stereo, or only recover translation up to scale, the proposed pipeline generalizes to previously unseen spacecraft using a single monocular camera. The transformer network estimates the odometry, the change in pose between images up to scale, from SuperPoint features matched by LightGlue. The MSCKF uses these pseudo-measurements along with an orbit and attitude kinematics model to estimate the pose of the target. In particular, the relative orbit elements, the target’s attitude with respect to the servicer’s camera, and the associated angular velocity are estimated directly by the filter. Given the monocular approach and short distance to the target, the full observability of the range to the target is recovered via attitude maneuvers by the servicer. The method is trained and evaluated on a re-rendered high-resolution version of the SPE3R dataset, which includes synthetic images of 103 spacecraft. Eleven of these spacecraft are held out during training to evaluate the generalization to unseen targets. Monte Carlo simulations are then used to evaluate the navigation pipeline on rendered trajectories of the held out spacecraft. The results demonstrate that learned vision pipelines as a front-end for Kalman filters provide median errors of 3.7° in attitude and 2.2% of range in ROE when navigating about unknown targets.

[135] MobileVISTA: Generative Data Augmentation for Pose Generalization in Mobile Manipulation cs.RO | cs.CV | cs.LGPDF

Suzannah Wistreich, Stephen Tian, Isabella Huang, Vitor Campagnolo Guizilini, Sergey Zakharov

TL;DR: MobileVISTA把单一机器人基座姿态采集的演示转为多姿态训练数据，同时增强自我中心视觉并重定向动作补偿基座变化；无需新增演示或训练生成模型。模拟人形/双臂任务和真实Galaxea R1 Pro实验显示对测试时未见姿态的鲁棒性提高，人形机器人受益最大。

Details

Motivation: 在单一机器人姿态采集的模仿演示会使端到端策略脆弱；部署时基座仅偏移几厘米，就可能令自我中心观测和末端轨迹超出训练分布，造成性能骤降。人形机器人相机受运动链影响且画面中常能看到机器人本体，尤其难用已有假设适配。

Result: MobileVISTA通过联合增强自我中心视觉观测并重定向动作，补偿基座姿态改变，将规范姿态演示转成多样姿态训练数据。研究在覆盖人形和双臂本体的仿真任务及真实Galaxea R1 Pro上验证。使用增强数据训练的策略对测试时遇到的分布外机器人姿态更鲁棒，不需增加演示采集，也不需训练生成模型；所测人形机器人收益最大，原因与相机随受驱动链移动且机体占据较大画面相符。摘要未提供成功率数字。

Insight: 视觉增强必须与动作几何重定向配套，否则新视角观测与旧动作标签不一致；MobileVISTA同时处理两者以适应移动基座。真实机器人验证提供迁移证据，但摘要没有量化任务成绩或覆盖的姿态范围。

Abstract: Mobile manipulators such as humanoid robots are increasingly deployed in dynamic, unstructured environments to perform dexterous manipulation tasks. However, end-to-end manipulation policies trained to imitate demonstration data collected from a single robot pose are brittle: even centimeter-scale deviations in robot pose at deployment can drive ego-centric observations and end-effector trajectories out of the training distribution, leading to sharp drops in performance. We introduce MobileVISTA, a data generation framework that transforms demonstrations captured at canonical poses into diverse, pose-perturbed training data by jointly (1) augmenting egocentric visual observations and (2) retargeting actions to compensate for base pose changes. Unlike prior methods, which assume a camera rigidly mounted off the actuated chain or non-trivial articulated robot geometry largely out of frame, MobileVISTA targets compatibility with egocentric platforms (e.g., humanoids) where the camera is both influenced by and must observe the robot’s kinematic chain as it moves. We study MobileVISTA in simulated tasks spanning humanoid and bimanual embodiments, and on a real Galaxea R1 Pro. We find policies trained on MobileVISTA-augmented data demonstrate improved robustness to previously out-of-distribution poses encountered at test time, without additional demonstration collection or a trained generative model. Additionally, we find MobileVISTA’s benefit is largest on tested humanoids, where the camera rides the actuated chain and the robot fills much of the frame. Additional videos and appendix can be found on our website: https://mobilevista.github.io

[136] OpenSplatGraph: From Dense Semantic Maps to Structured Scene Graphs for Open-Vocabulary Robot Perception cs.RO | cs.AI | cs.CVPDF

Binh Long Nguyen, Kien Nguyen, Clinton Fookes, Peyman Moghadam

TL;DR: OpenSplatGraph从在线Gaussian Splatting开放词汇语义图中直接构建持久3D场景图：可靠性语义场维护轻量观测统计，支持置信度感知、查询条件对象提取，并将实例关联到可跨观测/查询更新的图节点，用于语言指代和关系推理。

Details

Motivation: Gaussian Splatting地图能提供高保真几何和开放词汇感知，却通常将语义保存在非结构化特征场中，限制对象中心推理；场景图明确表示对象及关系，但常从稀疏几何构造，无法充分利用稠密语义地图。

Result: OpenSplatGraph将稠密在线Gaussian开放词汇语义地图与持久对象中心结构结合。可靠性语义场保存轻量观测统计，支持置信度感知、查询条件实例提取；提取对象与持久图节点关联，属性和关系可随着新观测及查询递增更新。框架同时支持语言引导对象定位和结构化关系推理，并保留Gaussian地图几何保真。标准3D场景理解基准及真实机器人实验显示其在线开放词汇感知和下游机器人任务表现有竞争力；摘要未给数值。

Insight: 稠密高斯语义地图与持久对象场景图互补：前者提供高保真空间及词汇线索，后者支持跨观测累计对象属性和关系。当前结果定性称有竞争力，尚无具体定位、关系推理或机器人任务数字。

Abstract: Dense 3D mapping with semantic understanding is essential for robotic perception in complex environments. Recent 3D Gaussian Splatting-based mapping approaches enable high-fidelity geometry and efficient open-vocabulary perception, but typically represent semantics as unstructured feature fields that limit object-centric reasoning. In contrast, 3D scene graphs explicitly model objects and their relationships for structured reasoning, but are commonly constructed from sparse geometric representations that do not fully exploit dense semantic maps. In this work, we present OpenSplatGraph, a unified framework that constructs persistent 3D scene graphs directly from an online Gaussian-based open-vocabulary semantic map. The proposed framework augments the dense semantic map with a reliability-aware semantic field that maintains lightweight observation statistics for confidence-aware, query-conditioned object extraction. Extracted object instances are associated with persistent graph nodes, allowing object attributes and relationships to be incrementally updated across observations and queries. By tightly coupling dense semantic mapping with persistent object-centric representations, our framework supports both language-guided object grounding and structured relational reasoning while preserving the geometric fidelity of Gaussian-based mapping. Comprehensive evaluations on standard 3D scene understanding benchmarks and real-world robotic experiments demonstrate that OpenSplatGraph achieves competitive performance for online open-vocabulary perception and downstream robotic tasks. Project page: https://csiro-robotics.github.io/OpenSplatGraph.

[137] OpenWAM: An Open Framework for Composable World-Action Models cs.RO | cs.CVPDF

Heng Yu, David D. Yuan, Juze Zhang, Changan Chen, Yao Feng

TL;DR: OPENWAM提供可组合世界—动作模型测试框架，以Wan2.2-5B和超过10,000小时因果机器人视频为基础，通过共享MoT支持联合、视频先行动作、动作先行视频和解耦生成。机器人视频预训练使VTA在LIBERO-Long成功率从68.4%升至97.8%；反事实数据也显著改善冻结逆/前向动力学模型。

Details

Motivation: 世界—动作模型把未来预测与机器人控制结合，但不同系统常同时改变视频骨干、交互结构、监督和推理流程，难以比较设计选择，也难研究成功演示以外的数据如何帮助动力学学习。

Result: OPENWAM从Wan2.2-5B出发，在超过10,000小时因果机器人视频上预训练，并用共享Mixture-of-Transformers架构整合动作专家，支持四种视频—动作交互方式。四个LIBERO套件和真实双臂任务中成功率较高；因果机器人视频训练使VTA在LIBERO-Long成功率由68.4%升至97.8%。可配置架构也支持逆/前向动力学研究：只适配视频预测器新任务时，用示范和反事实数据训练的冻结局部上下文逆动力学在四个留出LIBERO-90任务平均成功率84.0%，高于全上下文逆模型47.0%及仅用示范的局部模型21.5%。反事实监督使前向动力学RGB预测误差降34.5%，16种相同初始状态结果识别率由21.1%升至71.3%。

Insight: 统一骨干和可切换交互设计支持公平比较WAM结构；反事实转移能补充成功演示未覆盖的状态变化，特别提升动力学学习和新任务适配。数字基于给定LIBERO与VTA设置，需区分基础模型成功率和专门动力学实验。

Abstract: World-action models (WAMs) couple future prediction with robot control, yet existing systems often vary the video backbone, interaction structure, supervision, and inference procedure simultaneously, making their design choices difficult to compare. We introduce OPENWAM, an open world-action modeling framework built around a common causal robot-video foundation and configurable video-action interaction. Starting from Wan2.2-5B, we perform causal robot-video pretraining on over 10,000 hours of video, then integrate an action expert through a shared Mixture-of-Transformers architecture that supports joint, video-then-action, action-then-video, and decoupled generation. OPENWAM achieves high success rates on four LIBERO suites and real-world bimanual tasks; robot-video training with causal adaptation improves VTA success on LIBERO-Long from 68.4% to 97.8%. The same configurable architecture naturally extends to inverse and forward dynamics, allowing us to study how counterfactual transitions improve independently trained dynamics models beyond demonstrations alone. When only the video predictor is adapted to a new task, a frozen local-context inverse dynamics model trained on counterfactual data and demonstrations achieves 84.0% mean success across four held-out LIBERO-90 tasks, compared with 47.0% for a full-context inverse model and 21.5% for a local-context model trained only on demonstrations. For forward dynamics, counterfactual supervision reduces RGB prediction error by 34.5% and raises outcome identification from 21.1% to 71.3% among 16 same-state outcomes. OPENWAM provides a common testbed for comparing WAM interaction designs and for studying dynamics learning from video data beyond successful demonstrations.

[138] VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models cs.RO | cs.CVPDF

Owen Du, Yang Yue, Jie Zhang, Jiaqi Pi, Chi Bene Chen

TL;DR: VLA-ACL通过动作级监督学习视觉token剪枝策略，冻结基础VLA；训练时让剪枝上下文产生的动作接近全上下文教师动作，并用真实动作作辅助监督。LIBERO与真实操作中最多剪掉87.5%视觉token、计算减少75%、推理加速1.5倍且保持竞争表现。

Details

Motivation: VLA每个控制步骤处理较长token序列，计算开销高，阻碍实时部署。视觉patch数量多且冗余，现有剪枝要么靠注意力/运动阈值等间接启发式，要么需昂贵地微调整个基础模型。

Result: VLA-ACL保持基础VLA完全冻结，只训练轻量视觉token剪枝策略。训练目标使用动作级监督，鼓励剪枝视觉上下文得到的动作与全上下文教师动作一致，并以真实动作辅助，使token选择直接优化下游控制影响。LIBERO和真实操作实验中，最多剪除87.5%视觉token、计算量降低最多75%，推理速度提高1.5倍，同时维持有竞争力性能；作者称其性能—效率权衡优于现有冻结VLA剪枝方法。

Insight: 剪枝质量应根据动作后果而非纯视觉显著性评判；动作一致性监督让token压缩目标贴近控制任务，同时冻结基础策略降低微调代价。报告的最大剪枝/加速值不代表所有任务均能同时达到。

Abstract: Vision-Language-Action (VLA) models achieve strong robotic manipulation performance but incur high computational costs from processing long token sequences at every control step, limiting real-time deployment. Visual token pruning offers a direct solution, as visual patches dominate the input sequence and contain considerable redundancy. Existing approaches, however, either rely on indirect training-free heuristics, such as attention scores and motion thresholds, or require costly fine-tuning of the base VLA model. We introduce VLA-ACL (Action Consistency Learning), which learns a lightweight visual token pruning policy through action-level supervision while keeping the base VLA model entirely frozen. The training objective encourages actions produced from pruned visual contexts to remain consistent with the full-context teacher, with ground-truth actions as auxiliary supervision. This directly ties token selection to its effect on the downstream control output. Experiments on LIBERO and real-world manipulation tasks show that VLA-ACL prunes up to 87.5% of visual tokens while retaining competitive performance, reduces computation by up to 75%, and achieves a 1.5x inference speedup. These results establish a stronger performance-efficiency trade-off than existing frozen-VLA pruning methods and demonstrate the value of action-level supervision for visual token selection. Code is available at https://github.com/du-owen/VLA-ACL.

Thinh D. Le, Son T. Nguyen, Duong Q. Nguyen, Dung D. Le, Ngo Anh Vien

TL;DR: WareFly-VLA发布光照逼真的仓库无人机VLA框架与数据集，含507段人工遥操作飞行、8,504个高分辨率RGB状态转移，并配目标外观描述及四自由度控制命令，覆盖接近目标和跟随人员。四种开源VLA基准显示严格泛化下性能显著下降，连续动作优于离散token，地面/人形模型难迁移到空中平台。

Details

Motivation: VLA已用于操作和地面导航，但智能仓库中的语言条件无人机控制尚少研究，原因之一是缺少同时包含连续低层飞行动作、细粒度目标语言描述和真实工业环境的基准。

Result: WareFly-VLA数据在NVIDIA Isaac Sim中采集507段人工遥操作飞行和8,504个高分辨率RGB转移，每个样本包含人工撰写目标工人外观描述及同步四自由度控制。覆盖目标接近和人员跟随两项任务，含遮挡、远距搜索、高度变化和杂乱场景。基准评估SmolVLA、GR00T N1.7、π0和OpenVLA四种架构，采用无泄漏episode级划分和两种控制频率。结果显示仓库语言条件飞控远未解决：严格泛化时性能显著下降；连续动作建模稳定优于离散动作token；单帧下只有前向通道可靠可学；地面和人形基础模型接口难迁移至飞行平台。数据、基线和协议公开，并含视频、语言、动作、姿态与难度标注。

Insight: 空中具身控制需要专门数据和评测，通用地面/人形VLA接口不能自然迁移；连续动作建模及严格无泄漏协议对真实泛化尤其重要。该基准为世界模型研究提供同步多模态数据，但摘要未给各模型成功率。

Abstract: Vision-Language-Action (VLA) models have achieved impressive results in robotic manipulation and ground-mobile navigation, yet language-conditioned control of unmanned aerial vehicles (UAVs) in smart warehouses remains largely unexplored, hindered by the lack of benchmarks that jointly provide continuous low-level flight actions, fine-grained natural-language target descriptions, and realistic industrial environments. This paper introduces WareFly-VLA, a photorealistic UAV VLA framework and dataset for language-guided human search, localization, and tracking in warehouse environments. It contains 507 human-teleoperated flight episodes and 8,504 high-resolution RGB transitions collected in NVIDIA Isaac Sim, each paired with a human-written appearance description of the target worker and a synchronized four-degree-of-freedom control command. Two aerial tasks are covered: target approach and person following, under occlusion, long-range search, altitude variation, and clutter. A unified benchmark of four open-source VLA architectures (SmolVLA, GR00T N1.7, pi_0 and OpenVLA) is established under a leakage-free episode-level protocol at two control rates. The results show that language-conditioned aerial control in warehouses is far from solved: performance drops substantially under strict generalization settings, continuous action modeling consistently outperforms discrete action tokenization, only the forward channel is reliably learnable from a single frame, and current foundation-model interfaces transfer poorly from ground and humanoid embodiments to aerial platforms. The synchronized video, language, action, pose, and difficulty annotations further support world-model research. The dataset, baselines, and evaluation protocol are released to support language-grounded aerial autonomy in smart warehouses.

[140] DepthWorld: 3D World Model for Robot Manipulation cs.RO | cs.AI | cs.CVPDF

Jai Bardhan, Josef Sivic, Vladimir Petrik

TL;DR: DepthWorld是面向机器人操作的3D视频世界模型：作者先以立体深度和联合因子图标定DROID机器人参数及场景外参，构建DROID-3D（90%外部相机episode重投影误差<0.7像素），再让Stable Video Diffusion用空间潜变量分块联合预测多视角RGB和深度。相同训练预算下深度监督使RGB PSNR额外提高1.48 dB。

Details

Motivation: 世界模型可用于策略评估、改进和规划，但这些用途依赖可信3D几何。仅用RGB训练的视频世界模型可能逐帧看似正确，却无法组成一致3D场景；同时需要大规模机器人操作3D监督及不破坏预训练视频先验的架构。

Result: 标定管线结合学习式双目深度和联合因子图，汇总同一实体机器人采集的episode，联合估计共享运动学参数与各场景外参。应用于DROID后形成DROID-3D，提供稠密度量深度和重校准多视角外参；90%的外部相机episode重投影误差低于0.7像素。DepthWorld基于Stable Video Diffusion，通过空间潜变量平铺联合预测多视角RGB与深度，保持预训练VAE不变。相同训练预算下，深度监督使RGB预测PSNR比纯RGB基线高1.48 dB，同时产生准确度量深度以支持下游几何推理。

Insight: 引入度量深度监督不仅让世界模型显式输出3D信息，也能反向改善RGB预测质量；高质量多视角标定数据是训练这类模型的前提。报告的RGB收益是在相同训练预算下比较，摘要未给深度误差具体数值。

Abstract: World models offer a data-driven alternative to traditional simulators for robotics, with applications spanning policy evaluation, improvement, and planning. All of these uses depend on faithful 3D geometry, yet current video-based world models are trained on RGB alone and produce rollouts that look correct frame-by-frame but do not compose into a consistent 3D world. Closing this gap requires progress on two fronts: large-scale 3D supervision for manipulation, and an architecture that can absorb it without disturbing strong pretrained video priors. We introduce a calibration pipeline that combines learned stereo depth with a joint factor graph, pooling all episodes collected from the same physical robot to recover its shared kinematic parameters alongside per-scene extrinsics. Applied to the DROID dataset, this yields DROID-3D, a calibrated 3D dataset providing dense metric depth and recalibrated multi-view extrinsics (achieving <0.7 px reprojection error on 90% of episodes for external cameras). We then train DepthWorld, a Stable Video Diffusion-based world model that jointly predicts multi-view RGB and depth via spatial latent tiling, leaving the pretrained Variational Autoencoder (VAE) unchanged. Depth supervision improves RGB prediction itself by +1.48 dB PSNR over an identical RGB-only baseline at equal training budget, while simultaneously yielding accurate metric depth for downstream geometric reasoning.

cs.SD [Back]

[141] WorldSonus: Bringing Sound to Worlds cs.SD | cs.AI | cs.CV | eess.ASPDF

Pengjun Fang, Jingyi Fa, Kam Man Wu, Jiaming Wang, Haoyuan Huang

TL;DR: WorldSonus为世界模型交互视频实时生成空间立体声音频，使用流式因果自回归扩散、可按块索引的提示调度，以及多源立体/全景声监督。音频实时因子为0.41；在开放域视频转音频基准上声学质量和空间对齐达到或超过双向SOTA模型。

Details

Motivation: 世界模型的视频生成越来越逼真，但环境通常无声。加入声音需同时满足实时跟上交互视频、响应生成中途的新音频指令，并根据场景几何和相机运动提供空间对齐的立体声。

Result: WorldSonus是交互式视频到音频框架。实时模块采用流式因果自回归扩散分块生成，音频实时因子RTF为0.41；交互控制模块通过以音频为中心的caption流程和按块索引提示调度，在生成过程中动态操纵声音事件；空间模块使用从多源立体声和Ambisonics数据整理的高质量立体监督。实验显示模型虽针对世界模型设计，在开放域视频到音频基准也能泛化，声学质量和空间对齐匹配或超过当前双向模型。

Insight: 世界模型声音需因果、低延迟、可中途改指令且空间条件一致；分块提示调度和立体监督分别处理控制与定位。RTF 0.41支持实时方向，但摘要未列听感指标、不同硬件实时率或交互控制成功率。

Abstract: Recent advances in world models have enabled increasingly realistic visual synthesis. However, these generated environments remain largely silent. Bringing sound to world models poses three core challenges: real-time generation to keep pace with interactive video streams, interactive control to respond to mid-stream sound instructions, and spatially aligned stereo to reflect scene geometry and camera motion. To address these demands, we introduce WorldSonus, an interactive video-to-audio framework designed for real-time spatial sound synthesis in world models. For real-time generation, WorldSonus employs a streaming causal autoregressive diffusion architecture that synthesizes audio chunks at a low real-time factor (RTF) of 0.41. For interactive control, we incorporate an audio-centric captioning pipeline with chunk-indexed prompt scheduling, enabling dynamic manipulation of sound events during generation. For spatial alignment, we leverage high-quality stereo supervision curated from diverse stereo and ambisonic data. Extensive experiments demonstrate that while tailored for world models, WorldSonus generalizes effectively to open-domain video-to-audio benchmarks, matching or outperforming state-of-the-art bidirectional models in both acoustic quality and spatial alignment. Project page: https://noizai.github.io/WorldSonus/

cs.SE [Back]

[142] Harness Engineering for Software Engineering via Modular Executable Dev-Primitives cs.SE | cs.AI | cs.CL | cs.MAPDF

Haibo Jin, Xinjie Li, Peng Kuang, Haohan Wang

TL;DR: HERMES用可执行Dev-Primitives把仓库组件与驻留LLM配对，提供基于实现和依赖的局部接口，并按依赖动态激活组件、将运行错误回映到需要修改的组件。四个软件工程基准平均比匹配harness高12.4%；Qwen3-8B版本成本更低且与GPT-5.6 Sol方案差距不超过4.5%。

Details

Motivation: 有终端访问的LLM可处理软件工程任务，但长流程需要反复从源文件、配置、测试、依赖和运行行为重建状态，导致交互历史膨胀、语义漂移；大型仓库还难以定位相关组件。

Result: Dev-Primitives将仓库组件从被动文件转为主动工程单元：每个原件配驻留LLM，提供扎根于自身实现和依赖的智能体接口，支持自然语言推理、跨组件通信和局部自修改。HERMES通过依赖感知动态激活和把运行证据映射回待修组件的故障诊断，在仓库规模实例化这些原语。四个软件工程基准上，平均超过匹配harness基线12.4%。结合强激活与诊断模型时，即使使用Qwen3-8B Dev-Primitives，在四基准上也距同质GPT-5.6 Sol配置不超过4.5%；Terminal-Bench 4.0推理成本降低26.2%。

Insight: 提升长流程智能体表现不只靠更强基础模型，harness需将仓库状态封装为局部可执行接口并把测试/运行证据反馈到具体组件。Qwen3-8B接近大模型配置且成本较低，结果来自四个工程基准。

Abstract: Large language models (LLMs) equipped with terminal access have demonstrated strong capabilities in automating software engineering tasks. However, existing agents remain brittle on long-horizon workflows, where they must repeatedly reconstruct program state scattered across source files, configurations, tests, dependencies, and runtime behavior, leading to increasingly long interaction histories, context explosion, and semantic drift. Large repositories further complicate the identification of task-relevant components. To address these challenges, we introduce \textbf{Dev-Primitives} (\emph{Development Primitives}), a modular and executable abstraction that transforms repository components from passive software artifacts into active participants in software engineering. Each Dev-Primitive pairs a repository artifact with a resident LLM, which gives the artifact an agent-native interface grounded in its own implementation and dependencies, enabling natural-language reasoning, inter-component communication, and localized self-modification. Building on Dev-Primitives, we propose \textbf{HERMES}, a Harness Engineering framework for software engineeRing via Modular Executable Dev-PrimitiveS, which instantiates these primitives at repository scale through a dependency-aware dynamic activation mechanism and a bug diagnosis mechanism that maps execution evidence back to the components that must be revised. Extensive experiments on four software engineering benchmarks demonstrate that HERMES outperforms matched baseline harnesses by 12.4% on average. Moreover, when paired with strong activation and diagnosis models, HERMES, even with Qwen3-8B Dev-Primitives, remains within 4.5% of the homogeneous GPT-5.6 Sol configuration across all four benchmarks, while reducing inference cost by 26.2% on Terminal-Bench 4.0, highlighting the importance of harness design in software engineering agents.

eess.AS [Back]

[143] Logbook: Extremely Long-form Audio Event Understanding eess.AS | cs.AI | cs.CL | cs.LG | cs.SDPDF

Kwanghee Choi, Suwon Shon, Dmitriy Serdyuk, Guitang Lan, Chao-Wei Huang

TL;DR: Logbook是小时级音频事件理解基准，连续录音时长从10分钟到6天，要求生成无间隙分段并为每段预测事件标签和描述。对52个端到端/级联系统的比较显示任务可行但最佳模型仍不及人类，过分分段普遍；端到端系统通常更强但长上下文下退化。

Details

Motivation: 现有音频基准通常由短、预先切分片段组成，限制模型只能处理短输入或固定词表。真实任务可能要理解长达数小时甚至数天的连续录音，并完整划分事件。

Result: Logbook要求系统对连续音频按事件标签词表生成无间隙分段，并为每段附说明，录音时长范围为10分钟至6天。作者比较52个端到端及级联系统，并消融微调、上下文长度和推理预算。任务整体可解，但最佳系统仍低于人类参考；过度分段普遍存在，微调可部分缓解。端到端模型通常优于级联系统，但上下文越长性能退化。摘要未提供具体指标。

Insight: 长音频理解不仅要识别事件，还须连续、完整地决定边界；模型的过分段和长上下文退化是关键挑战。端到端架构在当前设置下占优，但仍未达到人类水平。

Abstract: Audio benchmarks are built around short, pre-segmented clips, limiting model design to brief inputs or fixed vocabularies. To close this gap, we introduce Logbook, a benchmark for hour-scale audio understanding, with recordings ranging from ten minutes to six days. Given a continuous audio recording and an event label vocabulary, a system must predict a gap-free segmentation with an event label and a description per segment. We compare 52 systems, end-to-end and cascaded, and ablate fine-tuning, context length, and reasoning budget. We find the task tractable, though the best systems remain below the human reference. Also, over-segmentation is pervasive, and fine-tuning partially mitigates it. Finally, end-to-end are often better than cascaded systems, but degrades with longer context.

Table of Contents

cs.CV [Back]

[1] Medical Image Alignment Assessment as a Test of Generalist Visual Reasoning in Frontier Multimodal Models cs.CVPDF

[2] UniPro: Unified Multi-Mode Medical Image Segmentation from 2D Images to 3D Volumes via Propagation cs.CVPDF

[3] BoT-Feedback: Grounding Multimodal Reasoning in Biomechanical Evidence for Explainable Human Action Feedback cs.CVPDF

[4] RADC: Risk-Aware Dual Caching for Vision-Language Test-Time Adaptation cs.CVPDF

[5] Visual-Invariance-Augmented Feature Optimal Alignment for Transferable Adversarial Attacks against Closed-Source MLLMs cs.CV | cs.AIPDF

[6] DTFormer: Text-Guided Semantic Alignment for RGB-D Segmentation cs.CVPDF

[7] Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning cs.CVPDF

[8] Anchor and Adapt: Asymmetric Prompt Adaptation for Few-Shot Industrial Anomaly Detection cs.CV | cs.AIPDF

[9] Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update cs.CVPDF

[10] WiSPER: Pose-Supervised Predictive and Residual Flow Refinement For Multi-Person 3D Pose Estimation With WiFi CSI cs.CVPDF

[11] Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints cs.CV | cs.AIPDF

[12] MoonGS: High-quality Representation of the Lunar Surface via Gaussian Splatting Using Robust Depth Features from Image Pairs cs.CVPDF

[13] A Data-Centric Review of Plant Disease Datasets: Taxonomy, Critical Analysis, Environmental Variability, and Implications for Precision Agriculture cs.CVPDF

[14] R2RI: A Multi-View Event and RGB Dataset for Robot-to-Robot Interaction cs.CV | cs.ROPDF

[15] PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence cs.CV | cs.AIPDF

[16] Deep Learning Based Illegal Bowling Action Detection cs.CVPDF

[17] CALR: Continuous Anchored Latent Reasoning via Render-of-Thought Compression cs.CVPDF

[18] What Words Keep of a Place: Zero-Shot Language Reasoning for Cross-View Geo-Localization cs.CV | cs.LGPDF

[19] Localize Any Object in X-Ray Security Scans without Human Annotation cs.CVPDF

[20] A doctrine-grounded visual question answering dataset for Tactical Combat Casualty Care cs.CV | cs.AI | cs.CLPDF

[21] Tracking Is Not Permanence: What Video World Models Keep of a Hidden Object cs.CV | cs.CLPDF

[22] WildMatch: Weakly Supervised Image Matcher Adaptation for Wildlife Re-Identification cs.CV | cs.AI | cs.IRPDF

[23] Semantic Capability Acquisition and Specialization During Vision-Language Model Fine-Tuning cs.CVPDF

[24] ElasticFit: Fit-Aware 3D Object Insertion via VLM Reasoning and Generative Adaptation cs.CV | cs.AIPDF

[25] CETUS: How Far Do Representations Trained on Earth Transfer to Cassini SAR of Titan? cs.CV | cs.LG | eess.IVPDF

[26] REViT-v2: Hierarchical Windowed Roto-reflection Equivariant ViT for Equivariant Feature Extraction cs.CV | cs.LGPDF

[27] Unlocking Fine-Grained Perception in CLIP via Structurally-Aware Latent Masked Modeling cs.CVPDF

[28] Anchor-driven Multi-modal Multi-scale Expert Selection for Survival Prediction cs.CVPDF

[29] PhysLDM: Latent Diffusion for High-Fidelity Deformable Simulation cs.CV | cs.GRPDF

[30] What Frame-Level Labels Can and Cannot Do for Small-UAV Point Detection in Thermal Video cs.CV | cs.AIPDF

[31] Structure-aware Keypoint Localization for Videofluoroscopic Swallowing Study cs.CVPDF

[32] Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs cs.CVPDF

[33] Later Is Better: Token Reduction for ViTs Under Distribution Shift cs.CV | cs.AIPDF

[34] Image-Space Refraction Correction for Underwater 3D Reconstruction: Warping Flat-Port Views into Pinhole Perspective cs.CVPDF

[35] From Laboratory to Road: Evaluating Wearable Gaze Accuracy for Driving cs.CVPDF

[36] CueRator: Agentic Search for Symbolic Rules to Adapt Frozen Multimodal Encoders cs.CVPDF

[37] Efficient Gaussian Splatting Sequence Compression with Standard Video Codecs cs.CVPDF

[38] Revar3r: gauge-aware perturbation uncertainty for feed-forward 3d reconstruction cs.CVPDF

[39] Unsupervised Long-Tailed Adaptation of Vision-Language Models cs.CVPDF

[40] Diverse Motion Customization via Control-based Dynamic Optimization cs.CV | cs.AIPDF

[41] TF-PRVR: Training-Free Partially Relevant Video Retrieval cs.CVPDF

[42] Multimodal Knowledge Distillation for Gastric Adenocarcinoma Classification from Whole-Slide Images cs.CV | cs.AIPDF

[43] Dynamic Alignment and Calibration for Multimodal Learning cs.CV | cs.AIPDF

[44] CCDF: A Benchmark Dataset for Deepfake Detection in Real-World Surveillance Footage cs.CVPDF

[45] Revisiting Numerical Forecasting Models for Language-Based Trajectory Prediction cs.CVPDF

[46] DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given cs.CVPDF

[47] Decide Before You Look: Learning Which Retrieved Memories Deserve Pixels cs.CV | cs.AIPDF

[48] VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMs cs.CV | cs.AI | cs.CLPDF

[49] M3SunAgent: Monocular 3D Spatial Understanding Agent for Metric Depth Estimation and 3D Visual Grounding cs.CVPDF

[50] Beyond Training from Scratch: Foundation Models for Data-Efficient and Generalizable Cardiac MRI Reconstruction cs.CVPDF

[51] PhysTacGen: Physics-Aware Visual-Tactile Sensor Image Generation cs.CVPDF

[52] The Failure Is in the Readout: Fine-Grained Emotion Recognition Benchmarks Measure Elicitation, Not Perception cs.CV | cs.CLPDF

[53] View Matters: Keyframe-Guided Text-Driven 3D Gaussian Editing cs.CV | cs.GRPDF

[54] MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos cs.CVPDF

[55] TSRN-RTVD: Real-Time Video Deblurring System cs.CVPDF

[56] Whose Face Is It Anyway? A Multi-Model Audit of Facial Affect Recognition on Children, and Why the Gap Is the Head, Not the Features cs.CVPDF

[57] Event Detection in Table Tennis Videos using 2D Keypoints cs.CVPDF

[58] DIPrune: Task-Aware Token Pruning with Dual Importance for Efficient Multimodal Language Models cs.CV | cs.LGPDF

[59] Transferable Spatial Temporal Coherence Adversarial Attack on Black-Box Vision Language Models for Autonomous Driving cs.CV | cs.AIPDF

[60] PolarScale: A Physics-Grounded Benchmark for Radiometrically Consistent RGB-to-Stokes Estimation cs.CV | physics.opticsPDF

[61] UniCounting: Instance-Aware Proposal Consolidation for Image-Query-Free Multi-Category Counting cs.CVPDF

[62] Test-Time Adaptation of Quantized ViTs via Single-Pass Quantizer-Aligned Recalibration cs.CV | cs.AIPDF

[63] GeoPID: Decomposing and Steering Visual Information in Vision-Language Models cs.CV | cs.AIPDF

[64] Image Bitstream Fine-grained Understanding for Privacy-Friendly AIoT cs.CVPDF

[65] Ariadne’s Thread of LipSync: Unraveling Forgeries via Inconsistency between Lip Motions and Head Poses cs.CV | cs.CRPDF

[66] From the Drosophila Visual Connectome to General-Purpose Computer Vision cs.CV | cs.NE | q-bio.NCPDF

[67] HuC-VideoMAE: Human-Centric Video Masked Autoencoding from synthetic data cs.CVPDF

[68] Knee3DVLM: Dual-Sequence Full-Volume Vision-Language Modeling for Comprehensive Knee MRI Assessment cs.CV | cs.AIPDF

[69] 2D Spatial Reasoning with Adaptive Neural Cellular Automata cs.CVPDF

[70] MedCORE: Criteria-Grounded Clinical Reasoning for Interpretable Medical Image Diagnosis cs.CV | cs.AIPDF

[71] Beyond Perturbation Magnitude: Direction-Dependent Responses in Multimodal Geometric Representations cs.CV | cs.LG | cs.SDPDF

[72] RSJEV: Discriminative Remote Sensing Scene Classification with Multimodal Large Language Models cs.CVPDF

[73] Have I Seen Enough? Frozen Video-Language Models Encode Evidence Readiness cs.CV | cs.CL | cs.LGPDF

[74] Forensic Reserve: Eliciting Latent Knowledge for Image Forgery Detection cs.CVPDF

[75] Stable Scores, Unstable Answers: Frame Phase and Option Order in Video Multiple-Choice Evaluation cs.CVPDF

[76] Selective Transfer of RL Updates for Visual Reasoning cs.CV | cs.AIPDF

[77] Knowing When to Trust a Prior: Reliability-Gated Cue Fusion for Video Gaze Prediction cs.CVPDF

[78] PDB: Point-Based Deformation Blending for Facial Animation Retargeting cs.CV | cs.GRPDF