cs.CV [Total: 62]
cs.CL [Total: 21]
cs.AI [Total: 8]
cs.CR [Total: 1]
cs.GR [Total: 1]
cs.HC [Total: 1]
cs.LG [Total: 8]
cs.RO [Total: 5]

cs.CV [Back]

[1] MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineering cs.CVPDF

Tengyue Wang, Kang An, Chenxu Du, Zhongyu Yang, Yuanchi Zhu

TL;DR: MechReason是从真实机械工程论文构建的多图多跳推理基准，包含1.2万组问答、显式推理链标注和2.1万份九类视觉证据，覆盖解释、预测、设计与诊断；当前最先进模型准确率也仅62.89%。

Details

Motivation: 多模态大模型在通用视觉问答上进步明显，但机械工程领域复杂推理的评测不足。现有基准多测图纸识别、CAD理解或单图表问答，难以评估模型是否能结合多张图、文本条件、物理原理及工程约束完成真实问题中的多步推理。

Result: MechReason源自真实机械工程论文，包含12,000组问答、带明确推理链标注的问题及21,000份视觉材料，证据类型覆盖统计图、参数表、工程图、显微图、仿真图、系统架构、机械实景照片、CAD图及制造流程图。基准包含解释、预测、设计、诊断四个推理维度和八类任务。构建流程先提取工程主张并分解支持证据为前提、推理过程、结论和佐证，再遮蔽事后验证信息生成防捷径问题，最后进行多模态质量验证以确保任务质量及多跳属性。实验表明基准具有挑战性，最先进模型准确率为62.89%。

Insight: MechReason将多源视觉证据与工程推理链纳入统一评测，问题构造时遮蔽后验验证信息以减少简单线索捷径。62.89%表明当前模型仍有差距，但摘要未列出各模型表现、数据拆分及专家验证细节。

Abstract: Despite significant progress in general visual question answering and cross-modal understanding, multimodal large language models still face a pronounced gap in evaluation for complex reasoning within the mechanical engineering domain. Existing benchmarks predominantly focus on rudimentary tasks such as drawing recognition, CAD interpretation, or single-chart querying, falling short of assessing whether models can integrate multiple images, textual conditions, physical principles, and engineering constraints to perform multi-step reasoning when confronted with authentic, intricate mechanical problems. To address this, we introduce MechReason, a benchmark derived from real mechanical engineering papers, comprising 12k question-answer pairs with explicit reasoning-chain annotations and 21k visual materials spanning nine evidence types, including statistical charts, parameter tables, engineering drawings, microscopic images, simulation images, system architectures, real mechanical scene photos, CAD model images and manufacturing flowcharts. MechReason covers eight task types across four reasoning dimensions: explanation, prediction, design, and diagnosis. We devise a four-stage construction pipeline: we first extract core engineering claims and decompose their supporting evidence into premises, reasoning processes, conclusions, and corroborative evidence; we then generate shortcut-preventing questions by masking posterior verification information; finally, we apply multimodal quality validation to ensure task quality and multi-hop nature. Extensive experimental results demonstrate that MechReason is highly challenging, with even the most advanced models achieving only 62.89% accuracy.

[2] SceneBench: A Hierarchical Benchmark for Vision-Language Understanding of 3D Scenes cs.CV | cs.AIPDF

Anubhav Khanal, Prabigya Acharya, Roshni Poudel, Sujan Kapali, Bigyan Bhatta

TL;DR: SceneBench是基于966个高斯泼溅重建逼真3D场景、覆盖场景—房间—功能区—物体组—单体的层级语义基准，含18.3万余标注节点和三类空间推理任务；当前VLM在基础检测可达85%，但计数等层级组合推理降至约60%。

Details

Motivation: 视觉语言模型擅长2D图像理解，但3D空间推理仍受基准限制：点云常保留几何却丢失纹理、文字和材质；标注多孤立处理物体，忽视场景、房间、功能区及物体组层级；评测又集中于基础识别而非多步空间推理。

Result: SceneBench包含966个由高斯泼溅重建的写实3D场景，采用人工参与的流程结合VLM与约1,500小时人工迭代核验，生成超过18.3万个层级标注节点，每个节点有文本描述和3D边界框。层级从整体场景覆盖房间、功能区、物体组到单体。基准定义三类任务：物体属性的存在性问题；涉及计数、尺寸比较、距离及方向关系的空间智能问题；以及跨语义层级多步推理的接地问答推理三元组。前沿VLM在基础检测上的准确率最高约85%，但在层级和组合任务上明显下降，例如计数约60%。

Insight: 逼真3D视觉理解需要评估跨场景层级和多步关系推理，而不只看物体检测；层级密集标注使这类能力可被拆解测试。基准依赖大量人工精炼，摘要未说明各数据集划分、模型分项结果及是否存在场景分布外测试。

Abstract: Vision-language models excel at 2D image understanding but remain limited in 3D spatial reasoning. Progress is hindered by limitations in current benchmarks. First, 3D datasets often rely on point clouds that capture geometry but discard rich visual features like texture, text, and materials. Second, annotations treat objects in isolation while ignoring real-world hierarchical organization (scenes, rooms, functional areas, object groups). Third, evaluation tasks focus narrowly on basic recognition rather than multi-step spatial reasoning. In this context, we introduce SceneBench, a benchmark of 966 photorealistic 3D scenes reconstructed with Gaussian Splatting and densely annotated with hierarchical semantics spanning scenes, rooms, functional areas, object groups, and individual objects. These annotations are produced through a human-in-the-loop pipeline combining vision-language models with roughly 1,500 human-hours of iterative refinement and verification, producing over 183K annotated nodes with textual descriptions and 3D bounding boxes. Building on this representation, we define three evaluation tasks: Existence-Based Questions probing object attributes, Spatial Intelligence Questions covering counting, size comparison, distance, and directional relations, and Grounded Question-Reasoning-Answer (QRA) triplets requiring multi-step reasoning across semantic levels. Experiments with state-of-the-art vision-language models show that while models perform well on basic recognition tasks (e.g., up to 85% accuracy for detection), performance drops substantially on hierarchical and compositional reasoning (e.g., down to 60% for counting), revealing limitations not captured by existing benchmarks. SceneBench provides a realistic testbed for developing and evaluating models capable of fine-grained spatial reasoning in photorealistic 3D environments.

[3] Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics cs.CVPDF

Daniela Vega, Paula Cárdenas, Hannah Ceballos, Leonardo Manrique, Pablo Arbelaéz

TL;DR: HyCLoST以双曲对比学习和基因到图像蕴含损失建模空间转录组的层级结构，改善从组织病理图像预测基因表达的过平滑问题；在26个数据集上相对既有方法MSE降低6%、PCC提高8%。

Details

Motivation: 空间转录组可在组织切片上定位基因表达，但成本高、设备专用且对实验噪声敏感。用病理图像预测空间基因表达虽有进展，却常产生过度平滑、不同组织区域预测过于均一的结果，说明表征未充分反映基因调控与组织形态中的层级和非对称关系。

Result: 作者提出HyCLoST，利用双曲几何和基因到图像蕴含损失学习具有结构的生物学表征，以捕捉空间转录组数据的内在层级关系。在26个空间转录组数据集上，基因表达预测相对既有方法的均方误差降低6%，皮尔逊相关系数提高8%。代码公开。

Insight: 空间转录组中基因调控和组织形态呈层级关系，双曲空间更适合表达这类结构；基因—图像蕴含监督可帮助预测表征维持区域差异，缓解过平滑。摘要未提供逐数据集结果、基线名称或表达基因覆盖情况。

Abstract: Spatial Transcriptomics (ST) has transformed biomedical research by enabling the spatial mapping of gene expression across tissue sections. However, high operational costs, specialized equipment requirements, and sensitivity to experimental noise limit the accessibility and scalability of ST. Recent computer vision approaches aim to overcome these limitations by predicting spatial gene expression directly from histopathology images. While effective, current approaches often suffer from gene expression over-smoothing and overly uniform predictions across tissue regions, suggesting that further progress depends on learning representations that reflect the hierarchical and asymmetric structure of gene regulation and tissue morphology. To address these issues, we propose Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics (HyCLoST), a hyperbolic contrastive learning model that captures the intrinsic hierarchical relationships within ST data. By leveraging hyperbolic geometry and a gene-to-image entailment loss, HyCLoST learns structured, biologically grounded representations that improve gene expression prediction accuracy, achieving a 6% reduction in MSE and an 8% increase in PCC across 26 ST datasets, over previous methods. Our source code is publicly available at https://github.com/BCV-Uniandes/HyCLoST

[4] ProtoLIP: From Sentence-Level to Object-Level Evidence Disentanglement cs.CV | cs.AIPDF

Yan Zhu, Yongbo Chen, Zhengming Ding, Rebecca Faust

TL;DR: ProtoLIP通过文本驱动的语义原型族和查询条件路由，将视觉—语言模型证据从句子级分解到物体级，无需空间标注或重训骨干；可提高证据定位与分离，并保持较强匹配及有竞争力的图文检索。

Details

Motivation: 查询条件视觉语言模型能够展示文本查询如何影响视觉证据，但针对完整描述的证据未必能拆解成物体级证据，显示出来的热图也未必对应真正决定模型预测的证据。作者在多种VLM和独立基准上发现，物体级查询仍会混入共现物体和共享上下文的信息。

Result: ProtoLIP是轻量原型中介证据层：将可复用视觉原型组织为由文本派生的语义族，并通过依赖查询的语义族路由限制哪些原型可提供证据。无需空间标注且不重训视觉—语言骨干，方法在不同查询粒度下改善证据定位与分离；若独立预训练VLM具有良好对齐的patch—text表征，定位增益可迁移到这些模型。尽管只用文本弱监督，ProtoLIP仍可与空间监督接地模型竞争，同时保持强匹配表现和有竞争力的图文检索。其匹配分数直接由定位的原型证据构造，因此可精确分解为语义族和原型贡献。

Insight: 解释性证据需要既能定位，也要能够组成模型实际使用的匹配分数；原型层路由将语义证据限制在与查询相关的概念族，并让评分可分解。迁移依赖骨干的patch—text对齐质量；摘要没有提供具体定位和检索指标。

Abstract: Query-conditioned vision–language models enable fine-grained interpretation by revealing how visual evidence changes with textual queries. However, evidence conditioned on complete descriptions does not necessarily resolve into object-specific evidence, nor does an exposed evidence map necessarily identify the evidence that constitutes the model’s prediction. Across multiple VLM architectures and independent benchmarks, we find that object-level queries often retain evidence from co-occurring objects and shared context. In this paper, we introduce \textbf{ProtoLIP}, a lightweight prototype-mediated evidence layer that organizes reusable visual prototypes into text-derived semantic families and uses query-dependent family routing to constrain which prototypes may provide evidence. Without spatial annotations or backbone retraining, ProtoLIP improves evidence localization and separation across query granularities, with localization gains transferring to independently pretrained VLMs with well-aligned patch–text representations. Despite using only text-derived weak supervision, ProtoLIP remains competitive with a spatially supervised grounding model while maintaining strong matching and competitive image–text retrieval. Crucially, ProtoLIP constructs its matching score directly from localized prototype evidence, enabling the score to be exactly decomposed into semantic-family and prototype contributions.

[5] Reasoning with Image Generation cs.CVPDF

Nishad Singhi, Hector Garcia Rodriguez, Aditya Arora, Marcus Rohrbach, Anna Rohrbach

TL;DR: ReImaGin将图像生成模型用作多模态推理的灵活视觉工具，可按自然语言命令移除遮挡或从多视角生成平面图；在六类视觉推理任务上持续超过纯文本推理和专用视觉工具基线，最高提升25%。

Details

Motivation: 链式思维使LLM可先分解问题再回答，但将推理局限于文本不适用于需要直接操作视觉表征的任务。现有多模态模型虽会调用深度估计、目标检测等视觉专家工具，却受限于工具功能固定、操作范围狭窄，无法灵活生成或变换视觉内容。

Result: ReImaGin将图像生成模型引入多模态LLM作为视觉推理机制。与固定功能工具不同，生成模型可接受自然语言指令，执行开放式视觉操作，例如移除遮挡、根据房间多个不连续视角生成平面图。论文在六类多样化视觉推理任务上评测，包括多视角空间推理和碰撞预测；ReImaGin持续超过纯文本推理和专用视觉工具基线，最高收益为25%。

Insight: 图像生成不只是最终输出模块，也可作为可编程的中间视觉变换器，扩展模型在文本推理之外能操作的证据形式。摘要未给出各任务基线、生成质量控制方式及推理成本，最大25%提升不代表所有任务均有同幅度收益。

Abstract: Chain-of-thought reasoning has revolutionized natural language processing by enabling large language models (LLMs) to decompose problems into intermediate steps before answering. Yet confining reasoning to the textual domain presents limitations for tasks requiring direct manipulation of visual representations. Recent efforts augment multimodal LLMs with external visual expert tools such as depth estimation or object detection modules, but these remain fundamentally limited by their reliance on narrow, rigid operations that cannot flexibly generate or transform visual content. We propose ReImaGin, which leverages image generation models as a flexible visual reasoning mechanism for multimodal LLMs: unlike fixed-function tools, they accept natural language commands and can perform open-ended visual operations, like removing an occlusion or generating a floorplan from multiple disjoint views of a room. Across six diverse visual reasoning tasks including multi-view spatial reasoning and collision prediction, ReImaGin consistently outperforms both text-only reasoning and specialist vision-tool baselines, with gains of up to 25%, demonstrating the advantage of flexible, generative visual reasoning.

[6] A multimodal large language model for evidence-based autism spectrum disorder screening cs.CV | cs.HC | cs.LGPDF

Jun Chen, Qi Zhao, Yunliang Jiang, Shuqin Cao, Yunqiang Lin

TL;DR: ASDchat是以视频、音频和对话为输入的多模态自闭症筛查模型，分为输出筛查概率的决策分支和按ADOS-2标准生成带时间戳行为证据的证据分支；在中国27个站点的1,035名参与者上，ASD对典型发育AUC为0.953，9个留出站点平均AUC为0.932。

Details

Motivation: 自闭症谱系障碍的早期筛查受限于专业人员稀缺和传统评估的主观性，影响临床管理与筛查规模。模型若只给出分类概率而无可核查依据，也难支持临床审阅，因此需同时提供多模态判断和与标准化临床准则对齐的行为证据。

Result: ASDchat联合处理视频、音频和对话，采用双分支架构：决策分支生成筛查概率，证据分支生成与ADOS-2标准对齐、可追溯且带时间戳的行为证据。训练和评估数据包含中国27个站点的1,035名参与者，涵盖典型发育儿童、自闭症儿童及其他障碍儿童。区分ASD与典型发育组时AUC为0.953±0.021；在未用于训练的9个站点上平均AUC为0.932。对行为维度进行无监督聚类后，ASD样本分为六种不同表型亚型，模型为各亚型建议干预方案。

Insight: 跨视频、音频和对话的概率判断配合标准化、带时间戳的行为证据，有助于提高筛查输出的可审阅性；留出站点结果初步支持跨中心泛化。摘要未说明亚型稳定性、干预建议验证和真实临床工作流评估，因此模型筛查性能不等于诊断或治疗效果。

Abstract: The clinical management of autism spectrum disorder (ASD) faces a bottleneck in early screening, mainly because trained specialists are scarce and conventional assessment tools are subjective. Here, we introduce ASDchat, a multimodal large language model designed for evidence-based ASD screening, which takes video, audio, and dialogue as input. ASDchat adopts a dual-branch architecture, where the decision branch generates screening probabilities and the evidence branch generates traceable, timestamped behavioral evidence aligned with standardized clinical criteria (ADOS-2). The model was trained and evaluated on a dataset of 1,035 participants from 27 sites in China, which covered typically developing (TD) children, children with ASD, and children with other disorders. For ASD versus TD, ASDchat reached an area under the receiver operating characteristic curve (AUC) of 0.953 $\pm$ 0.021. On 9 held-out sites that were not used for training, the mean AUC was 0.932. Furthermore, unsupervised clustering of the behavioral dimensions split the ASD cases into six subtypes with different phenotypic profiles, and ASDchat suggests an intervention for each subtype. ASDchat provides a feasible path for large-scale, evidence-based early ASD screening in clinical practice.

[7] MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing cs.CVPDF

Jiayi Yu, Xi Ye, Lina Wang, Yunkun Xia

TL;DR: MDN-Control是无需训练的多主体视频编辑框架，联合控制目标定位、遮挡几何和外观初始化；在MSVBench上取得最低CM-Err和最高Q-Edit，同时保持有竞争力的文本对齐及时间一致性。

Details

Motivation: 多主体视频编辑需要只修改指定主体并保留其他内容，但重叠主体会造成属性串扰和遮挡歧义。现有方法依赖掩码，难以区分彼此遮挡的对象，也难保证生成内容随时间一致。

Result: MDN-Control联合控制目标定位、遮挡几何与外观初始化。掩码引导定位保持目标身份一致，深度感知遮挡控制处理重叠主体之间的模糊边界；噪声潜变量提示则从噪声库检索高斯初始化，为提示词相关外观提供先验。MSVBench实验中，方法取得最低的CM-Err和最高的Q-Edit，并保持有竞争力的文本对齐与时间一致性。

Insight: 多主体编辑需要同时约束“编辑谁”、物体间前后遮挡关系及生成起点；分别利用空间、几何和潜变量先验能互补解决这些问题。摘要未给出指标数值、与各基线差异以及视频长度和主体数量分布。

Abstract: Multi subject video editing modifies designated subjects while preserving non target content, but faces cross subject attribute leakage, and occlusion ambiguity. Existing approaches rely on masks and struggle to distinguish overlapping subjects or ensure consistent generation. To address these limitations, we propose MDN-Control, a training free framework jointly controlling target localization, occlusion geometry, and appearance initialization. Specifically, mask-guided localization provides consistent target localization, while depth-aware occlusion control resolves ambiguous boundaries between overlapping subjects. We further introduce noise latent prompting, which retrieves Gaussian initializations from a noise library for prompt relevant priors. Experiments on MSVBench show that MDN-Control achieves the lowest CM-Err and the highest Q-Edit, while maintaining competitive text alignment and temporal consistency, demonstrating the effectiveness of combining spatial, geometric, and latent priors for multi subject video editing.

[8] VPRef: A Cross-Domain Benchmark for Referring Remote Sensing Image Segmentation cs.CVPDF

Quanwei Liu, Tao Huang, Jiaqi Yang, Wei Xiang

TL;DR: VPRef是首个面向指代表达遥感图像分割的跨域基准，包含46,972组语言—图像—标注三元组和三级语言粒度；其SAM3-LoRA适配方法结合伪标签自训练与多粒度提示混合，仅调整1.08%参数，并提升跨域分割边界表现。

Details

Motivation: 指代表达遥感分割实际部署时会同时遇到视觉域漂移（空间分辨率、光谱变化）和文本逻辑漂移（用户表达粒度变化），性能因此大幅下降。需要具有跨域评测能力的基准及能适应这两种变化的高效方法。

Result: 作者构建Vaihingen-Potsdam Referring（VPRef），含46,972组三元组，并按三级语言层级组织。以Segment Anything Model 3为基础的参数高效适配基线采用LoRA：通过伪标签自训练应对视觉分布差异，通过随机混合多粒度文本提示处理语言逻辑变化。消融指标分布暗示跨模态语义稳健性与视觉域对齐可能可部分解耦：语言变化促进细粒度语义不变性，伪标签传播则控制宏观空间网格对齐。跨域评测中，方法取得更好的分割边界表现，修改的基础模型参数仅占1.08%。

Insight: 视觉域适配和语言表达粒度适配可能作用于不同层面，因此分别使用伪标签传播和多粒度提示混合更有针对性。1.08%参数更新带来跨域边界收益；摘要未给出具体指标、域间迁移方向及基准切分，数据集和代码计划公开。

Abstract: Rapid advancements in vision-language models have propelled Referring Remote Sensing Image Segmentation (RRSIS) to the forefront of Earth observation. However, practical deployments suffer severe performance degradation under a coupled dual-drift paradigm: visual domain drift from cross-spatial-resolution mismatches and spectral variations, alongside textual logic drift from unconstrained, variable user-input granularities. To mitigate these bottlenecks, this paper establishes the first cross-domain RRSIS benchmark, designated as the Vaihingen-Potsdam Referring (VPRef) dataset, comprising 46,972 language-image-annotation triplets organized into a three-tier linguistic hierarchy. Building upon this benchmark, we develop a tailored parameter-efficient domain adaptation baseline anchored on the Segment Anything Model (SAM3) via Low-Rank Adaptation (LoRA). Our framework counteracts visual distribution discrepancies through pseudo-label-driven self-training and addresses textual logic drift via random multi-granularity text prompt mixing. Crucially, the distribution of empirical metrics across ablative variants suggests a potential decoupling between cross-modal semantic robustification and visual domain alignment, demonstrating that linguistic variance drives fine-grained semantic invariance while pseudo-label propagation governs macro-scale spatial grid alignment. Extensive benchmarks demonstrate the proposed framework achieves superior cross-domain segmentation boundaries while modifying merely 1.08% of the foundational parameter footprint, establishing a robust baseline for future multi-modal remote sensing domain adaptation research. The dataset and code will be available at https://github.com/quanweiliu/VPRef.

[9] Which Pretext Task Transfers? Self-Supervised Pretraining Objectives for Lung Ultrasound cs.CVPDF

Moein Heidari, Junbo Rao, Jai Choraria, Wenjin Chen, David J. Foran

TL;DR: 该研究在相同骨干、预训练数据、优化计划及冻结评估下比较肺超声自监督对比学习MoCo、掩码重建VideoMAE和V-JEPA；POCUS上VideoMAE/V-JEPA较好，但独立Mendeley-Uganda数据集上MoCo领先、V-JEPA接近随机，显示单一域内分数不能说明跨域迁移能力。

Details

Motivation: 自监督学习可减少医学图像标注需求，但肺超声中选择何种预训练目标尚不明确。既有研究使用不同数据、骨干及评估流程，难以比较对比学习、掩码重建和联合嵌入预测架构的真实迁移差异。

Result: 作者在统一条件下比较MoCo对比学习、VideoMAE掩码重建和V-JEPA联合嵌入预测目标：相同编码器骨干、COVID-BLUeS肺超声视频预训练语料、优化计划及冻结编码器评估协议。使用5%、10%、50%、100%标签预算的线性、kNN和注意力探针；POCUS采用患者级五折交叉验证，Mendeley-Uganda独立采集且未用于预训练或探针拟合。全标签线性探针下，POCUS平衡准确率VideoMAE为66.5±13.1、V-JEPA为65.4±11.7、MoCo为42.1±1.2；Mendeley-Uganda排序反转，MoCo最高为62.7±1.0，VideoMAE为53.8±2.8，V-JEPA为35.1±4.9，接近随机水平。作者计划进一步进行表征层面分析以研究这种反转。

Insight: 同一目标在一个超声数据集上表现较好，不代表能迁移到独立采集的数据；跨域泛化排序可能与域内探针准确率相反。该比较在统一协议下进行，但摘要报告的是全标签线性探针分数，其他标签预算和探针结果未列出。

Abstract: Self-supervised learning (SSL) can reduce the need for labelled medical images, but the choice of pretext objective remains unclear for lung ultrasound (LUS). Contrastive learning, masked reconstruction, and joint-embedding predictive architectures (JEPA) differ in the space in which their targets are defined, yet existing ultrasound studies compare them under different corpora, backbones, and evaluation protocols. We compare these three objective families using the same encoder backbone, pretraining corpus, optimisation schedule, and frozen-evaluation protocol. Encoders are pretrained on COVID-BLUeS LUS videos and evaluated with linear, $k$NN, and attentive probes at 5%, 10%, 50%, and 100% label budgets. Evaluation is performed on POCUS using patient-level five-fold cross-validation and on the independently acquired Mendeley-Uganda dataset, which is excluded from both pretraining and probe fitting. At the full label budget under linear probing, VideoMAE and V-JEPA achieve $66.5 \pm 13.1$ and $65.4 \pm 11.7$ balanced accuracy on POCUS, while MoCo achieves $42.1 \pm 1.2$. On Mendeley-Uganda, the ranking reverses: MoCo performs best at $62.7 \pm 1.0$, followed by VideoMAE at $53.8 \pm 2.8$, while V-JEPA falls near chance at $35.1 \pm 4.9$. These results show that POCUS probe accuracy alone does not identify the objective that transfers best across datasets. We also outline planned representation-level analyses to examine this reversal. Code is publicly available at https://github.com/moeinheidari7829/LUSVideoSSL.

[10] Vision And Text Transformer For Predicting Answerability On Visual Question Answering cs.CV | cs.AIPDF

Tung Le, Huy Tien Nguyen, Le Minh Nguyen

TL;DR: VT-Transformer将视觉问答可回答性建模为回归任务，通过Transformer联合图像与问题文本特征预测可回答分数；在VizWiz 2020上相较竞争基线表现有效且稳健。

Details

Motivation: 视觉问答可回答性旨在衡量给定图像和问题能否作答。既有研究常把VQA系统输出映射为二元标签，未能体现该任务连续评分的本质。

Result: 作者提出VT-Transformer，利用Transformer架构融合视觉与文本特征，并将可回答性作为回归问题预测图像—问题对的可回答分数。在VizWiz 2020数据集上的实验显示，相较竞争基线，VT-Transformer在可回答性预测上有效且鲁棒。摘要未列出具体误差指标、分数或基线名称。

Insight: 可回答性以连续分数建模能表达不同图像—问题对的可答程度，可能比简单二元映射更符合任务定义；当前摘要仅报告在一个基准上的定性优势，无法判断增益大小或跨数据集泛化。

Abstract: Answerability on Visual Question Answering is a novel and attractive task to predict answerable scores between images and questions in multi-modal data. Existing works often utilize a binary mapping from visual question answering systems into Answerability. It does not reflect the essence of this problem. Together with our consideration of Answerability in a regression task, we propose VT-Transformer, which exploits visual and textual features through Transformer architecture. Experimental results on VizWiz 2020 dataset show the effectiveness and robustness of VT-Transformer for Answerability on Visual Question Answering when comparing with competitive baselines.

[11] Counterfactual Reasoning for Robust Visual Question Answering cs.CVPDF

Truong-Binh Duong, Thanh-Ngan Tran, Ngoc-Thao Nguyen, Bac Le

TL;DR: 该研究为视觉问答提出反事实对比训练框架，以三阶段课程、增强批内对比损失、答案对比损失和梯度差异正则促进因果视觉接地；在VQA-CP v2准确率61.64%、VQA v2为62.80%，两者差距1.16个百分点。

Details

Motivation: 现代VQA模型常利用训练集中的虚假相关性和语言偏差，导致分布外泛化较差。既有反事实学习虽有帮助，但仍可加强模型对因果视觉证据的关注和特征判别能力。

Result: 作者提出强化VQA反事实对比学习的训练框架：用三阶段课程稳定多目标优化；增强批内对比损失学习更具区分性的特征；加入答案对比（AC）损失细化预测空间，并以梯度差异（GD）损失促进因果视觉接地。模型在偏差敏感的VQA-CP v2上准确率为61.64%，在标准VQA v2上为62.80%，两者差距1.16个百分点，表明在OOD鲁棒性和域内性能间取得平衡。

Insight: 利用反事实目标约束视觉证据和答案表征，有望减少语言先验对VQA决策的支配；同时报告偏差敏感与标准基准，可以观察OOD和域内性能差距。摘要没有说明对比基线、数据切分及统计显著性，1.16个百分点是两个基准报告准确率之差。

Abstract: Modern Visual Question Answering (VQA) models often exploit spurious correlations in training data, leading to poor out-of-distribution (OOD) generalization due to language bias. Although counterfactual learning has shown promise, existing methods can be improved to better guide attention toward causal evidence and strengthen feature discrimination. To address this, we propose a novel training framework that enhances counterfactual contrastive learning for VQA. Our framework introduces three key contributions: (1) a three-stage curriculum for stable multi-objective optimization, (2) an enhanced Batch-Contrastive loss for more discriminative feature learning, and (3) two novel regularizers, Answer-Contrastive (AC) loss to refine the prediction space and Gradient-Discrepancy (GD) loss to enforce causal visual grounding. Our model achieves a competitive accuracy of 61.64% on the bias-sensitive VQA-CP v2 benchmark while maintaining 62.80% on the standard VQA v2 dataset, yielding a small generalization gap of 1.16%. This demonstrates a strong balance between OOD robustness and in-distribution performance.

[12] FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generation cs.CVPDF

Guangyu Sun, Shlok Kumar Mishra, Wentao Bao, Robert Zhenheng Yang, Xiao Wang

TL;DR: FLAT联合预训练共享多模态编码器与文本到图像、图像到文本解码器，将图文映射到可变长度的连续一维对齐token序列；单阶段即可支持检索与生成，微调后在GenEval、MS-COCO和Flickr30K上取得报告的生成与检索分数。

Details

Motivation: 传统多模态学习先训练对比或自监督视觉编码器，再单独训练生成模型，使生成能力受冻结嵌入限制。作者希望学习既可作为判别语义表示、又能直接作为生成条件的线性可插值嵌入。

Result: FLAT（Flexible-Length Aligned Transmodal representations）联合优化共享多模态编码器、文本到图像和图像到文本解码器，结合对比对齐与双向跨模态生成目标。模型将图像和文本编码为统一连续一维序列，并用针对前缀K的嵌套dropout支持动态表示长度。单阶段预训练后即可在不同K下执行跨模态检索和生成，文本到图像GenEval为71.1。任务微调后，文本到图像GenEval为83.1；MS-COCO图像描述BLEU-4为40.5、CIDEr为138.6，Recall@5为图到文86.8、文到图75.8；Flickr30K分别为98.3和93.6。定性实验显示表示支持线性插值、潜空间算术及零样本组合检索。

Insight: 将共享表示同时训练为检索描述符和生成条件，可以减轻两阶段系统中冻结表示对生成质量的限制；前缀长度控制提供表示容量与任务计算间的调节方式。报告分数对应不同训练阶段和数据集，摘要未给出逐项基线分数。

Abstract: Traditional multimodal representation learning and generation are two stages: a contrastive or self-supervised visual encoder is trained first, followed by a separate downstream generative model. This setup bottlenecks generative performance behind frozen embeddings. To bridge this gap, we revisit joint multimodal representation learning and generation to produce linearly interpolatable embeddings that are directly consumable by generative decoders. We present FLAT (Flexible-Length Aligned Transmodal representations), a representation pre-training framework that jointly optimizes a shared multimodal encoder alongside downstream text-to-image (T2I) and image-to-text (I2T) decoders. By combining contrastive alignment with bidirectional cross-modal generative objectives, FLAT ensures its representations function as both discriminative semantic descriptors and generative conditions. Architecturally, FLAT maps visual and textual inputs into a unified continuous 1D sequence space, applying nested dropout over prefix-K tokens to enable dynamic output lengths. A single pre-training stage allows FLAT to perform cross-modal retrieval and generation across variable prefix K, achieving a T2I GenEval score of 71.1. Task-specific fine-tuning aligns model performance with state-of-the-art baselines: 83.1 GenEval on T2I generation; 40.5 BLEU-4 and 138.6 CIDEr on MS-COCO image captioning; and Recall@5 scores of 86.8 (I2T) / 75.8 (T2I) on MS-COCO alongside 98.3 (I2T) / 93.6 (T2I) on Flickr30K. Finally, qualitative evaluations demonstrate that FLAT representations natively support linear interpolation, latent space arithmetic, and zero-shot composed retrieval.

[13] FRPSS: Feature Rearrangement in Pre-Shape Space for Single-Image Generation cs.CVPDF

Yuexing Han, Haoxuan Zhang, Bing Wang

TL;DR: FRPSS在单图生成中以预形状空间重排特征替代低尺度生成器随机初始化，并在后续尺度引导合成，以保持全局结构；三个数据集上SIFID均为最佳且LPIPS有竞争力，另通过CLIP-SSPE支持风格化等下游任务。

Details

Motivation: 仅用单张图像训练的生成模型难以同时兼顾全局结构完整性和局部多样性。依赖随机噪声且缺少显式全局结构约束的方法，在结构变化时容易产生空间错位。

Result: FRPSS的核心模块MSR-FAGS在测地曲面上进行特征增强和预形状结构重排，以重排后的预形状特征替换低尺度生成器的随机初始化特征，并指导后续尺度生成，降低结构错位风险。为支持风格化等下游任务，作者设计尺度自适应滑动窗口图块提取SSPE，并构建结合SSPE的方向性CLIP监督模块CLIP-SSPE。定量和定性实验显示，FRPSS在三个数据集上的单图Fréchet Inception距离SIFID均取得最佳结果，同时LPIPS保持竞争力；额外定性实验验证了CLIP-SSPE在多种下游任务中的作用。

Insight: 把单图生成的低尺度初始状态显式约束在重排后的结构特征上，有望避免随机初始化造成的全局形态漂移；对比学习图文先验再补充多尺度局部监督以支持风格迁移。摘要没有提供数据集名称、指标数值及下游任务细节。

Abstract: Generative models trained on a single image often struggle to balance global structural integrity and local diversity. Existing single-image generation methods commonly rely on random noise to drive the generation process and lack explicit global structural constraints, making the generated results prone to spatial structural misalignment when structural variations occur. To address the issue, Feature Rearrangement in Pre-Shape Space for Single-Image Generation (FRPSS) is proposed in this paper. The core of FRPSS is the Manifold Structural Rearrangement with Feature Augmentation on Geodesic Surface (MSR-FAGS) module. MSR-FAGS replaces the randomly initialized features of the low-scale generator with rearranged Pre-Shape features and uses the features to guide image generation at subsequent scales, thereby reducing the risk of structural misalignment. To support downstream tasks such as stylization, a Scale-adaptive Sliding-window Patch Extraction (SSPE) strategy is further designed, and a directional Contrastive Language-Image Pre-training supervision module with SSPE (CLIP-SSPE) is constructed. Qualitative and quantitative experiments demonstrate that FRPSS achieves the best Single Image Fréchet Inception Distance (SIFID) scores on all three datasets while maintaining competitive Learned Perceptual Image Patch Similarity (LPIPS). Further qualitative experiments verify the effectiveness of FRPSS across multiple downstream tasks with the CLIP-SSPE module.

[14] A Vision-Language Foundation Model for Precise and Comprehensive Brain Tumor Diagnosis from Preoperative Multimodal Data cs.CV | cs.AI | cs.DBPDF

Yinong Wang, Jianwen Chen, Zhou Chen, Shuwen Kuang, Haoning Jiang

TL;DR: BrainVLM是面向术前脑肿瘤诊断的视觉语言基础模型，可分类WHO 2021的12种脑肿瘤、量化不确定性并生成影像报告；训练数据来自40,043人，并在主院留出病例、11家独立医院、神经放射科医师读片研究及前瞻性队列中评估。

Details

Motivation: 基于MRI的非侵入性术前脑肿瘤分类很重要，但不同肿瘤影像特征重叠、阅片者间差异大，且专业诊断需要长期训练。模型除分类外还需表达判断可靠度并提供临床理由。

Result: BrainVLM分类WHO 2021定义的全部12种脑肿瘤类型，包含预测不确定性量化和生成放射学报告的模块。模型使用40,043人的多模态数据训练，包括MRI、人口统计信息和影像报告；在5,211名病理确诊患者上验证，其中3,877人为主院留出患者，另1,334人来自11家独立医院。临床效用评估包括：12名不同经验水平神经放射科医师对248例回顾性病例开展有无AI辅助的盲法多读者研究；以及1,009名患者术前由BrainVLM和放射科医师独立、盲法评估的真实世界前瞻性研究。另在632人多中心队列上探索成人型弥漫性胶质瘤分子亚组预测。给定摘要未包含诊断准确率或临床读片结果数值。

Insight: 该工作将分类、不确定性和报告生成纳入同一多模态模型，并包含跨医院、读片者辅助及前瞻性评估设计，证据链比单中心回顾测试更贴近临床部署。当前摘要节选没有给出性能结果或AI对医师的实际增益，因此不能据此判断临床效果大小。

Abstract: Background Non-invasive presurgical diagnosis of brain tumor types from Magnetic Resonance Imaging (MRI) is essential but challenging due to overlapping imaging features across tumor types, inter-observer variability, and the extensive training required for expertise. We aimed to develop an MRI-based Artificial Intelligence (AI) model for automatic and reliable brain tumor classification with diagnostic uncertainty quantification and radiology reports generation. Methods We developed BrainVLM to classify all 12 World Health Organization (WHO) 2021 brain tumor types. BrainVLM integrates an uncertainty quantification strategy to indicate prediction reliability and a module for generating radiology reports to elucidate the clinical rationale. BrainVLM was trained on multi-modal data (MRI scans, demographics, and radiology reports) from 40,043 individuals. It was validated on 5,211 patients with pathologically confirmed brain tumors, including 3,877 held-out patients from the primary hospital and 1,334 patients from 11 independent hospitals. We further conducted two proof-of-concept studies to validate its clinical utility in AI-clinician workflows: 1) a blinded multi-reader study where 12 neuroradiologists across varying experience levels interpreted 248 retrospective cases with or without AI assistance, and 2) a real-world prospective study in which 1,009 patients were independently and blindly assessed by BrainVLM and radiologists before surgery. Additionally, we demonstrated BrainVLM’s utility in preoperative molecular subgroup prediction for adult-type diffuse gliomas, using a multi-center cohort of 632 patients.

[15] SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation cs.CVPDF

Zixiu Ding, Zilin Zhao, Yingjie He, Xinlang Kang, Guansu Wang

TL;DR: SAVOR通过token级和答案级置信度学习、带校准与弃答惩罚的GRPO目标，以及仅在不确定时重新查看视觉证据，降低多模态大模型幻觉；在POPE、HallusionBench、AMBER和MMHal-Bench上优于DPO及解码基线的校准误差，同时保持MME和MMBench通用能力。

Details

Motivation: 多模态大语言模型在视觉问答和图像描述上进步显著，但仍会流畅地捏造图像中不存在的对象、属性或关系。测试时解码修改会增加延迟，DPO等偏好微调教模型选什么答案，却不一定教会模型判断自己的回答何时不可靠。

Result: SAVOR在输出格式中加入token级和答案级置信度；以Group Relative Policy Optimization目标惩罚校准误差和错误弃答决策；推理时仅在模型不确定时利用学到的置信度重新检查视觉证据。在InternVL3-8B和Qwen3-VL-8B两个骨干上，评估POPE、HallusionBench、AMBER和MMHal-Bench，结果显示幻觉减少，同时在MME和MMBench上维持一般能力；相较DPO和解码基线，期望校准误差更低。

Insight: 降低幻觉不仅要惩罚错误内容，还要让模型识别自身不确定性，并将额外视觉复查集中在高风险样本，从而控制推理开销。摘要未给出各基准的幻觉和校准具体分数，也未报告复查带来的延迟。

Abstract: Multimodal large language models (MLLMs) have made strong progress on visual question answering and image captioning, yet they still produce fluent claims about objects, attributes, or relations that are not grounded in the image. Many remedies either modify decoding at test time, which adds latency, or fine tune with preferences such as DPO variants, which teach which answer is preferred but not when the model’s own answer is unreliable. We argue that calibrated self assessment is the missing signal. We introduce Savor, a training framework that (i) augments the output schema with token and answer confidence, (ii) optimises the policy with a Group Relative Policy Optimisation (GRPO) objective that penalises calibration error and poor abstention decisions, and (iii) uses the learned confidence at inference time to revisit visual evidence only when the model is uncertain. Experiments on POPE, HallusionBench, AMBER and MMHal-Bench across two recent backbones (InternVL3-8B and Qwen3-VL-8B) show that Savor reduces hallucination while preserving general capability on MME and MMBench, with lower Expected Calibration Error than DPO and decoding baselines.

[16] EgoPathBench: Evaluating Zero-Shot Egocentric Waypoint Decision-Making in Vision-Language Models cs.CVPDF

Yang Zhao, Zhuo Chen, Xubo Yang

TL;DR: EgoPathBench是面向VLM零样本第一人称路点决策的五任务基准，包含31,852训练、1,345验证和1,111测试问题，并按可行性、边连通和到达目标评估路径；九个VLM最高得分仅28.3，微调Qwen 3.5 4B后得分从3.9升至38.9。

Details

Motivation: 零样本路点导航要求VLM根据当前第一人称图像选出可行空间动作序列并抵达目标，需要联合目标识别、动作后果、距离估计和路径规划。既有空间智能基准通常单独评估关系、方向或目标判断，未衡量这种完整导航能力。

Result: EgoPathBench包含五类第一人称路点决策问题，每题给出RGB图像、自然语言目标及编号的可见路点，模型需返回可通行候选或有序路线。评测路线候选可行性、相邻边合法性及点代理或具身几何下能否抵达目标。数据含31,852条训练、1,345条验证和1,111条基准测试问题，每道路径题至少有一条经几何验证的参考路线。九个VLM中最高EgoPath Score仅28.3；最高模型Point Path成功率35.9%，而Embodied Path和Intent Path分别只有2.9%和4.0%。作者公开训练资源；在其训练划分上微调Qwen 3.5 4B后，得分由3.9升至38.9，且三个外部空间基准上的四项报告评测均提升1.4–9.6分。

Insight: 模型能识别目标或局部通路，并不等于能在具身约束下构成完整且符合意图的路线；Point Path与Embodied/Intent Path的巨大差距揭示了这种能力断层。训练数据可显著提升基准分数并迁移至外部空间评测，但摘要未说明外部任务及评测指标细节。

Abstract: Zero-shot waypoint navigation requires vision-language models to select, from the current first-person observation, a sequence of spatial actions that is feasible for the agent and reaches the goal, placing joint demands on the integrated spatial intelligence of today’s foundation VLMs. Existing spatial-intelligence benchmarks primarily evaluate isolated judgments of relations, directions, or targets and therefore do not directly measure the integrated navigation ability required to combine target recognition, action-consequence assessment, distance estimation, and path planning. To fill this evaluation gap, we introduce EgoPathBench, a dataset and five-task benchmark for first-person waypoint decision-making. Each question presents an egocentric RGB image, a natural-language goal, and numbered visible waypoints; a model returns traversable candidates or an ordered route. Predictions are evaluated for candidate feasibility, adjacent-edge legality, and goal arrival under point-agent or embodied geometry. EgoPathBench contains 31,852 training, 1,345 validation, and 1,111 benchmark questions and retains at least one geometrically verified reference route for every route question. Across nine VLMs, the highest EgoPath Score is only 28.3. The top-ranked model reaches 35.9% success on Point Path, but only 2.9% and 4.0% on Embodied Path and Intent Path, respectively, showing that current models remain limited in forming complete, goal-consistent routes under embodiment constraints. Beyond the evaluation data, we release the corresponding training resource. Fine-tuning Qwen 3.5 4B on the released training split raises its EgoPath Score from 3.9 to 38.9 and improves all four reported evaluations across three external spatial benchmarks, with gains of 1.4–9.6 points.

[17] Can Knowledge Transfer Parameters Be Learned? LePoKet for Efficient Robotic Vision cs.CV | cs.LGPDF

Yanick C. Tchenko, Felix Mohr, Hicham Hadj-Abdelkader, Hedi Tabia

TL;DR: LePoKet将可学习的结构化知识继承嵌入子网络前向计算，通过抽取—变换—混合接口和可学习遗传注意力传递教师知识，无需额外蒸馏损失或温度缩放；在图像分类和光流估计中均改善紧凑模型。

Details

Motivation: 受算力、内存和延迟约束的机器人需要高效感知模型。由大型预训练模型向紧凑网络迁移知识是一条实用路径，但现有方法常依赖固定蒸馏目标或手工设计交互机制，未必能适应不同任务和子网络。

Result: LePoKet基于遗传式知识迁移，将知识继承直接放入子网络前向计算，采用分块的抽取—变换—混合接口，并由可学习遗传注意力算子与子网络联合优化，不使用额外蒸馏损失或温度缩放。CIFAR-10和CIFAR-100的ResNet父子模型实验中，相对标准子模型训练，错误率分别降低24.57%和25.1%。在仅用FlyingChairs和FlyingThings3D训练的紧凑RAFT光流模型上，Sintel Clean EPE从2.21降至1.92，Sintel Final从3.35降至3.01，KITTI从7.51降至6.39。与HKT直接比较时，CIFAR-10准确率从92.40%升至93.40%，并在受测紧凑迁移变体中取得最佳Sintel Final及KITTI误差，Sintel Clean表现相近。

Insight: 知识迁移可作为网络结构中的可学习信息通路，而不一定表现为额外损失项；该机制在分类和光流等视觉任务上都有收益。摘要报告多个提升，但任务间误差与准确率指标不同，不能将其直接合并为统一增益。

Abstract: Efficient perception is central to robotic systems operating under constrained computation, memory, and latency budgets. Knowledge transfer from larger pretrained models offers a practical route to stronger compact perception networks, but existing approaches commonly rely on fixed distillation objectives or manually designed interaction mechanisms. Building on Hereditary Knowledge Transfer (HKT), we propose LePoKet (Learnable Parameter Optimization for Knowledge Transfer), a structural transfer framework that embeds knowledge inheritance directly into the forward computation. LePoKet introduces a block-wise Extract-Transform-Mix interface whose interaction parameters are optimized jointly with the child network through a Learnable Genetic Attention (LGA) operator, without auxiliary distillation losses or temperature scaling. We first characterize the mechanism on CIFAR-10 and CIFAR-100 using ResNet parent-child pairs, obtaining relative error reductions of 24.57% and 25.1%, respectively, over standard child training. We then evaluate LePoKet for dense motion estimation by integrating it into a compact RAFT-based optical-flow model trained only on FlyingChairs and FlyingThings3D. LePoKet improves the compact RAFT baseline from 2.21 to 1.92 EPE on Sintel Clean, from 3.35 to 3.01 on Sintel Final, and from 7.51 to 6.39 on KITTI. A direct comparison with HKT further shows that LePoKet improves CIFAR-10 accuracy from 92.40% to 93.40% while achieving the best Sintel Final and KITTI errors among the evaluated compact transfer variants, with comparable performance on Sintel Clean. These results demonstrate that learnable structural transfer generalizes across recognition and motion perception tasks and provides a promising approach for efficient robotic vision.

[18] What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes cs.CV | cs.MMPDF

Zhipeng Zhao, Wenxu Wang, Peishun Liu, Ruichun Tang

TL;DR: SAFE是一种免训练的对比解码探针，通过比较保留视觉与去除视觉的生成路径计算token级接地分数，检测语言先验压过图像证据的时刻并据此惩罚输出；在MMHalBench上显著优于对比基线，且早期干预可减少幻觉聚集而较少损伤流畅度。

Details

Motivation: 当强多模态模型广泛可用时，研究不能只依赖基准分数，还需把模型当作工具来理解自身失败机制。作者探讨能否利用大型视觉语言模型研究视觉幻觉的形成过程及语言先验与视觉证据的相对作用。

Result: SAFE在同一生成过程中对比视觉接地路径和移除视觉条件后的路径，计算token级对比接地分数，用作未接地token的实用代理，并用于解码时惩罚。分析得到三项观察：生成越往后，视觉依赖逐渐衰减；幻觉会在时间上成簇出现；较早干预能减少聚集，且不会显著损害语言流畅度。MMHalBench上SAFE明显优于所有比较基线，其他数据集上的结果则更混合。

Insight: 对比保留/移除视觉信息的生成分布，可在token粒度追踪模型何时偏向语言先验；这既用于诊断也能直接指导解码干预。效果在MMHalBench突出但其他基准并不一致，提示收益依赖幻觉类型和评估数据。

Abstract: When strong multimodal models are widely available, progress requires new scientific methodologies beyond benchmark scores—using models as instruments for understanding behavior. We address this by asking: can we use large vision-language models (LVLMs) as experimental instruments for studying their own failure dynamics? Focusing on visual hallucination, we introduce SAFE, a training-free decoding framework that contrasts visually-grounded and vision-ablated generation paths to produce a token-level contrastive grounding score that identifies when the model favors linguistic priors over visual evidence. This signal serves dual roles: as a practical proxy for detecting visually-ungrounded tokens, and as the basis for decoding-time penalties. Our analysis yields three empirical observations: visual dependency decays over generation, hallucinations co-occur in temporal clusters, and early intervention reduces clustering without substantially degrading fluency. On MMHalBench, SAFE substantially outperforms all compared baselines; results elsewhere are more mixed. We argue that designing contrastive probes exemplifies a broader mission: using models as instruments for scientific understanding. Code: https://github.com/zhaozhipeng1997/SAFE_public.

[19] ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models cs.CV | cs.MMPDF

Zhipeng Zhao, Zhaoqiang Wei, Peishun Liu, Youwei Zhao, Ruichun Tang

TL;DR: ViD以因果启发方式分析五类注意力模式，利用跨模态注意和反事实调整削弱视觉语言模型的语言先验性别偏差，无需额外训练；FACET单属性偏差降低14.7%，LLaVA图像描述性别偏差分数从0.6708改善至0.9978。

Details

Motivation: 大型视觉语言模型中的性别偏差会损害公平性和输出可信度。训练期调整或事后校准难以动态处理视觉偏差、捕捉实时图文不一致，依赖预设偏差分类体系，还可能降低跨模态对齐。

Result: ViD分析五种注意力模式，揭示强语言先验造成的混杂，并指出视觉到语言的交叉注意能够在保持一般推理能力和文本生成质量的同时抑制偏差。框架包含两项机制：后门调整用于抵消强语言先验，解码层的精细token选择用于优化处理，从而提高鲁棒性和推理效率。跨基准实验显示，FACET单属性评估上的性别偏差降低14.7%；MS COCO图像描述任务中LLaVA的性别偏差分数由0.6708改善至0.9978。方法无需额外训练开销。

Insight: 视觉证据与语言先验冲突时，调节跨模态注意和解码token选择可在推理阶段缓解偏差，而不需要重新训练模型。摘要没有说明偏差分数的方向与理想值定义，也未给出不同骨干和社会属性的完整量化结果。

Abstract: Gender bias in large vision-language models (LVLMs) undermines their fairness and reliability, compromising output trustworthiness. Current mitigation methods rely on training-phase adjustments or post-hoc calibration, but face limitations in dynamic visual bias mitigation. These include inability to capture real-time visual-textual incongruence, dependence on predefined gender bias taxonomies, and degraded cross-modal alignment with emergent bias patterns. To address these challenges, we propose ViD, a causally-inspired framework that analyzes attention mechanisms across five distinct patterns, revealing confounding effects from strong language priors. ViD demonstrates that visual-to-language cross-attention effectively suppresses bias while preserving general reasoning capabilities and text generation quality. ViD incorporates dual mechanisms: backdoor adjustment counters strong language priors, while refined token selection in decoding layers optimizes processing. This enhances model robustness and inference efficiency. Our integrated approach significantly mitigates gender bias across multidimensional social attributes in LVLMs, improving visual grounding and output fairness. Cross-benchmark validation shows ViD reduces gender bias by 14.7% on single-attribute evaluations (FACET) and achieves significant improvements on image captioning tasks (MS COCO), with gender bias score improving from 0.6708 to 0.9978 for LLaVA. Crucially, these improvements require no additional training overhead, making ViD a scalable and practical solution for bias mitigation in LVLMs.

[20] Channel-Wise and Token-Aware Post-Training Quantization for Visual State Space Duality cs.CVPDF

Jonghyeon Lim, Changhoon Yim

TL;DR: CTOAC针对视觉状态空间模型VSSD的低比特后训练量化，通过token均衡输出重建损失学习逐输入通道裁剪界限；在ImageNet-1K保留分类精度，在COCO和ADE20K保持多种视觉任务表现，RTX 4090优化部署较FP32最高加速1.42倍。

Details

Motivation: 视觉状态空间模型如ViM、VMamba及VSSD提供注意力模型之外的高效方案，但VSSD低比特后训练量化的行为尚未充分研究。初步分析显示激活量化是主要瓶颈，选定线性层的输入通道幅值差异大，且极值集中于特定token位置。

Result: 作者提出通道级、token均衡、输出感知裁剪方法CTOAC，为每个输入通道学习裁剪界限，优化相应线性层输出上的token均衡重建损失。量化范围仅包括选定线性层及其输入激活，其余骨干运算保持原始精度。在VSSD-Tiny、Small和Base上，该方法保持ImageNet-1K准确率，并在更激进精度设置下显著比所测基线稳健。将相同量化范围用于COCO和ADE20K，物体检测、实例分割和语义分割性能仍较强。针对RTX 4090优化部署后，端到端较FP32最高加速1.42倍。

Insight: VSSD低比特量化的关键瓶颈是激活及其通道/token分布，而非必须把整条骨干都低精度化；按输出重建校准选择性量化更能保留任务效果。最高1.42倍来自特定RTX 4090优化配置，摘要未列出各精度下准确率损失和能耗。

Abstract: State space models (SSMs), particularly Mamba, have emerged as efficient alternatives to attention-based architectures and have been extended to vision through ViM, VMamba, and Visual State Space Duality (VSSD). Yet the low-bit post-training quantization (PTQ) behavior of VSSD remains insufficiently understood. A weight-activation split on VSSD-Tiny identifies activation quantization as the dominant low-bit bottleneck, while representative inputs to selected VSSD-backbone linear layers exhibit strong channel-wise magnitude variation and token-localized extremes. We propose the Channel-wise Token-balanced Output-Aware Clipping (CTOAC) method, which learns per-input-channel clipping bounds by minimizing a token-balanced reconstruction loss on the corresponding linear outputs. Only the selected linear layers and their input activations are quantized; other backbone operations retain their original precision. Across VSSD-Tiny, VSSD-Small, and VSSD-Base, the proposed CTOAC method retains ImageNet-1K accuracy and remains substantially more robust than the evaluated baselines at more aggressive precision settings. Applying the same quantization scope to VSSD backbones on COCO and ADE20K preserves strong object detection, instance segmentation, and semantic segmentation performance. An optimized RTX 4090 deployment configuration achieves up to 1.42x end-to-end speedup over FP32.

[21] Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA cs.CVPDF

Yu Li, Zhengran Shen, Yachun Mi, Puchao Zhou, Shaohui Liu

TL;DR: CMPA通过低维感知特征提取、质量文本锚点跨模态注入及JND频率补偿下采样，改善CLIP用于无参考图像质量评估时语义不变性压制细微失真、预处理丢失高频线索的问题；多个基准上优于既有方法。

Details

Motivation: CLIP等大型视觉语言模型推动无参考图像质量评估，但其对比预训练偏向语义不变性，会压制细微感知质量信号；裁剪和插值等标准预处理又可能进一步丢失高频质量线索。

Result: 作者提出流形感知的跨模态感知对齐适配器CMPA，以分离感知失真与主导语义。感知敏感特征提取器PFE将CLIP特征映射到紧凑低维子空间，显式放大由失真引起的流形外偏差；跨模态感知对齐注入器PAI再将特征与质量感知文本锚点对齐并注回骨干。为保持输入保真度，作者还设计残差增强感知下采样，利用恰可察觉差异JND引导的频率重注入，补偿分辨率降低带来的信息损失。在多个基准数据集上的评估显示，该方法显著超过先进方法，能恢复被语义密集表征掩盖的感知信号。

Insight: 图像质量评估所需的低层失真信号可能被CLIP的语义不变性和输入缩放共同削弱，因而需在特征空间解耦感知偏差并在预处理阶段补偿频率损失。摘要未提供数据集名称、主客观指标或提升数值。

Abstract: Leveraging Large Vision-Language Models like CLIP has recently set new benchmarks for No-Reference Image Quality Assessment (NR-IQA). However, the contrastive pretraining of CLIP inherently prioritizes semantic invariance, which often suppresses subtle perceptual signals, a phenomenon we term perceptual submergence. Furthermore, standard preprocessing techniques (e.g., cropping and interpolation) further exacerbate the loss of critical high-frequency quality cues. In this paper, we propose the Cross-modal Perception Alignment Adapter (CMPA), a manifold-aware framework designed to disentangle perceptual distortions from dominant semantics. CMPA introduces a Perception-Sensitive Feature Extractor (PFE) that projects CLIP features into a compact, low-dimensional subspace, explicitly magnifying distortion-induced off-manifold deviations. Subsequently, a Cross-Modal Perception Alignment Injector (PAI) aligns these features with quality-aware text anchors and re-injects them into the backbone. To ensure input fidelity, we also devise a Residual-enhanced Perceptual Downscaling strategy that adaptively compensates for resolution-induced information loss using Just Noticeable Difference (JND) guided frequency re-injection. Extensive evaluations on several benchmark datasets demonstrate that our approach significantly outperforms state-of-the-art methods, effectively recovering the perceptual signals submerged in semantic-dense representations.

[22] Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videos cs.CVPDF

Hyunjun Kim, Hyeonwoo Na, Jaewoo Lee

TL;DR: 该研究将结肠镜视频组织成以病灶为中心的空间记录，包括全局拓扑、病灶时空轨迹、按需局部3D重建及重复观察身份关联；在四段公开视频、40,245帧上检测到回访并保持合并病灶身份的真值纯度1.0。

Details

Motivation: 结肠镜术后通常保留文字报告和静态照片，但视频中镜头走过的位置、病灶出现地点及同一病灶是否再次被观察等空间信息会被丢弃。作者研究能否不进行完整结肠3D重建，也构建并验证以病灶为中心的空间记录。

Result: 系统由四层组成：全局拓扑地图、病灶级时空轨迹、按需局部3D重建，以及重复观察间的病灶身份保持。作者将已有组件组装起来，贡献集中在病灶中心的集成、关联规则和评估。流程端到端运行于四段公开视频：两段带真值深度的C3VDv2序列和两段完整REAL-Colon流程，共40,245帧。通过入口地图贝叶斯定位检测到全流程中的回访事件，数量分别为5,614和4,043次（涉及56和68个不同节点）；这些回访在前向单向地图中按构造无法检测。阈值0.5下，病灶身份合并保持真值纯度1.0，并自动合并231个候选对中的20个。内镜专用几何引擎所有指标均优于通用基础模型，整体绝对相对误差为0.2276对0.3523。作者称结果仍属部分验证，下一步需临床数据验证。

Insight: 病灶复查、身份关联和局部3D定位可分别产出可复现定量结果，不必等待完整几何重建才有价值；但当前仅四段公开视频的验证，临床数据是后续必要步骤。阈值及自动合并数量体现精度与覆盖之间的取舍。

Abstract: Background and Objective: Colonoscopy recording practice preserves text reports and still photographs, while the spatial information already present in the recorded video - where the scope traveled, where a lesion was observed, and whether the same lesion was seen again - is discarded when the procedure ends. This study determines whether a lesion-centered spatial record can be assembled and validated without full-colon 3D reconstruction. Methods: A four-layer hierarchical pipeline was assembled - (1) a global topological map, (2) lesion-level spatio-temporal tracks, (3) on-demand local 3D reconstruction, and (4) persistent lesion identity across repeated observations - and ran end to end on four public videos (two C3VDv2 sequences with ground-truth depth and two full REAL-Colon procedures; 40,245 frames). All components are published, individually validated methods; the contribution is their lesion-centered assembly, linking rules, and evaluation. Results: Revisits, impossible under forward-only mapping by construction, were detected by entry-map Bayesian localization: 5,614 and 4,043 revisit events (56 and 68 distinct nodes) in the two full procedures. Lesion-identity merging at the adopted threshold 0.5 maintained ground-truth purity 1.0 while auto-merging 20 of 231 candidate pairs. The endoscopy-specific geometry engine outperformed a general-purpose foundation model on all metrics (overall absolute relative error (AbsRel) 0.2276 vs. 0.3523). Conclusions: The results are partial but establish a concrete near-term path: revisit detection, lesion identity, and local 3D each returned quantitative, reproducible output without waiting for complete geometric reconstruction; validating the record on clinical data is the next step.

[23] MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild cs.CVPDF

Jiangong Xiao, Zhihao Zhang, Yifei Dong, Chao Ma, Zhouyi Jin

TL;DR: MEgoVista是将单次未准备的第一人称MEgo View视频离线转换为公制双手与头部4D运动的流程，使用标定立体视觉定标并在检测时确定手部归属；其输出在动作捕捉场地与独立光学捕捉参考对照评估。

Details

Motivation: 从人类视频学习操作策略需要高保真、带真实尺度的手部运动标签。现有公制标注主要来自摄影棚设备或带传感头显，受限于预先布置环境，且缺少独立参考验证。头戴式自然记录有望扩大可采集场景，但需要可靠恢复佩戴者自身的手和头运动。

Result: MEgoVista提供离线处理流程，将一段未经准备的MEgo View记录转换为同一重力对齐世界坐标系下的公制双手与头部运动。它可在摄影棚体积和桌面装置无法覆盖的环境中重建，并在检测阶段判定手部归属，避免旁观者的手被误计入佩戴者轨迹；尺度来自标定立体视觉而非单目先验，在初始化时即设为物理单位；两个输出都在动作捕捉场地内与独立Chingmu光学捕捉结果比较，评测协议还审计参考本身并计入方法拒绝预测的部分。摘要未给出重建误差、覆盖量或样本数。

Insight: 自然佩戴式视频能扩大公制动作监督的采集范围，但需同时解决身份归属、绝对尺度及独立参考验证；尺度若在初始化固定为公制单位，后续动作模型可直接使用物理坐标。当前摘要将贡献定位为测量流程，未提供定量性能结论。

Abstract: Learning manipulation from human video requires high-fidelity hand-motion reconstruction in metric units. Today’s metric hand labels come from studio rigs and instrumented headsets, and both are confined in the same two ways: neither leaves a prepared setting, and neither is checked against an independent reference. Unconstrained head-worn recording promises the opposite trade-off, scaling with the number of people wearing a device. We therefore introduce MEgoVista, an offline pipeline that turns a single unprepared MEgo View recording into metric two-hand and head motion in one gravity-aligned world frame. Three properties set it apart from existing egocentric reconstruction systems: first, it reconstructs in settings studio volumes and tabletop rigs cannot reach, settling hand ownership at detection so bystander hands stay out of the wearer’s trajectory; second, it takes its metric gauge from calibrated stereo rather than a monocular prior, installing scale at initialisation so policies receive physical units, not arbitrary coordinates; third, both outputs are scored inside a motion-capture volume against independent Chingmu optical capture, under a protocol that audits its own reference and charges what a method declines to predict. MEgoVista is offered as a measured route from egocentric video to metric hand supervision, one that widens where such labels can be gathered.

Jinwoo Jeon, GyuYeop Do, Yubin Lim, Nam-Joon Kim, Hyun Gon Ryu

TL;DR: 该研究提出面向边缘视觉语言模型的统一教师锚定量化语义蒸馏方法，联合优化蒸馏与量化，并用RGB引导跨注意适配器增强非RGB表征；实验显示非RGB模态性能持续提升，同时保持边缘部署效率。

Details

Motivation: CLIP等大规模VLM支持强开放词汇推理，但难以部署在资源受限边缘设备上。EdgeVL通过蒸馏和量化感知训练压缩模型，却采用分阶段不同目标，且对量化学生空间做对比学习会造成目标不一致、训练效率降低；RGB与非RGB模态使用相同监督还可能导致模态失衡。

Result: 作者提出统一的量化语义蒸馏框架，在教师锚定目标下联合优化知识蒸馏与量化，使训练目标在量化条件下保持一致，并抑制困难负样本、扩大决策间隔。另设计轻量跨注意适配器，通过RGB引导的语义迁移增强非RGB表征、缩小模态差距。实验显示，在保持部署效率的同时，非RGB模态表现稳定提升。摘要未给出具体数据集、量化位宽、准确率或延迟数值。

Insight: 蒸馏和量化若分开优化，可能出现训练目标不一致；统一教师锚定目标可减少这种失配。跨模态监督也需考虑RGB和非RGB输入的不平衡，利用RGB特征引导非RGB表示提供一条轻量适配路径。

Abstract: Large-scale vision-language models (VLM) such as CLIP enable strong open-vocabulary reasoning, yet deploying these capabilities on resource-constrained edge devices remains challenging. EdgeVL addresses this problem by distilling CLIP representations into lightweight multi-modal encoders and applying quantization-aware training (QAT) for efficient Open-Vocabulary Classification (OVC) on edge hardware. However, its two-stage optimization applies different objectives for distillation and QAT, and contrastive learning is performed within the quantized student space, which can result in inconsistent optimization and reduced training efficiency. Moreover, identical supervision across RGB and non-RGB modalities may lead to modality imbalance. We propose a unified framework for quantized semantic distillation tailored to edge deployment. By jointly optimizing distillation and quantization within a unified teacher-anchored framework, our method ensures consistent training under quantization, suppressing hard negatives and enlarging decision margins. Additionally, we design a lightweight cross-attention adapter that enhances non-RGB representations through RGB-guided semantic transfer, narrowing the modality gap. Extensive experiments demonstrate consistent improvements on non-RGB modalities while maintaining deployment efficiency.

[25] MAETrack: Unleashing the Potential of Pretrained Geometric Priors for 3D Single Object Tracking cs.CVPDF

Sifan Zhou, Qiwei Wang, Linyue Tan, Ziyu Liu, Ziyu Zhao

TL;DR: MAETrack研究三维单目标跟踪中的掩码自编码器预训练迁移，发现浅层保留可迁移几何线索、深层更专用于重建任务；因此仅用预训练初始化浅层、重置深层，并以几何残差门控强化BEV目标结构，在标准3D SOT基准上优于直接微调。

Details

Motivation: 大规模预训练推动了二维视觉表征学习，但其向三维单目标跟踪迁移的效果尚不清楚。直接微调自监督3D编码器（如MAE）往往适配不足，因为重建目标与跟踪所需的时空匹配并不完全一致。

Result: 作者将迁移困难解释为层级错配：浅层更易保留可迁移几何线索，而深层逐渐专化于重建预训练任务。MAETrack包括层选择初始化LSI，只用预训练权重初始化跟踪骨干浅层并重新初始化深层；几何残差门控GRG则在模板—搜索融合前，通过残差空间调制强化搜索BEV特征中的结构显著区域。标准3D单目标跟踪基准上的大量实验显示，MAETrack持续优于直接微调基线，额外计算开销有限。摘要未报告各数据集分数或提升幅度。

Insight: 预训练权重迁移不应只按层选择微调比例，而应考虑预训练目标与下游跟踪目标之间的层级匹配：浅层几何知识可保留，深层则需重新适应。摘要没有给出对比基准名称、精确计算开销或不同跟踪器的泛化数据。

Abstract: Large-scale pre-training has transformed representation learning in 2D vision, yet its transferability to 3D single object tracking (SOT) remains insufficiently understood. Directly fine-tuning self-supervised 3D encoders, such as masked autoencoders (MAE), often leads to sub-optimal adaptation because the reconstruction objective is not fully aligned with the spatial-temporal matching requirements of tracking. In this paper, we observe that this difficulty can be interpreted as a layer-wise transfer mismatch: shallow layers tend to preserve transferable geometric cues, while deeper layers become increasingly specialized to the reconstruction pretext task and are less suitable for downstream tracking. Based on this observation, we propose MAETrack, a lightweight adaptation framework for transferring pre-training MAE representations to 3D SOT. MAETrack includes Layer-Selective Initialization (LSI), which initializes only the shallow stages of the tracking backbone from pre-trained weights while re-initializing deeper stages, and Geometric Residual Gating (GRG), which reinforces structurally salient regions in the search BEV features before template-search fusion through residual spatial modulation. Extensive experiments on standard 3D SOT benchmarks show that MAETrack consistently improves upon vanilla fine-tuning baselines with limited computational overhead. More broadly, our results suggest that effective transfer from 3D reconstruction pre-training to 3D tracking is not merely a matter of partial fine-tuning, but depends on a tracking-oriented transfer principle that preserves shallow geometry while adapting deeper representations to the downstream objective.

[26] IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasets cs.CVPDF

Abhilaksh Singh Reen, Kushal Borkar, Ritvik Mahapatra

TL;DR: IMVS是人机协同医学体数据标注闭环，将用户涂鸦用于在线适配轻量2D切片模型，再由冻结3D追踪器传播掩码并用软师生对齐减少遗忘；在8个公开CT/MRI数据集上匹配强基线，标注速度比熟练手工快14.4倍。

Details

Motivation: 大型放射学数据集标注常需在3D体数据中逐层手工勾画，耗时巨大。交互式方法虽可降低工作量，但逐切片处理忽视层间连续性；固定传播器又无法适应目标体积，在低对比或病理结构上容易漂移并需要反复重新提示。

Result: IMVS不提出新的分割原语，而是组合成闭环标注框架：轻量2D Slice Mask Adapter根据用户涂鸦在线微调；冻结的Volume Mask Tracker将已校正掩码传播到相邻切片；软师生对齐限制在线适配造成的遗忘。SMA可搭配UNet++、DeepLabV3和TransUNet。在8个公开CT/MRI数据集上，分割质量匹配强交互基线，同时显著减少标注劳动：比熟练的复制式手工流程快14.4倍，比朴素手工快22.3倍，比逐切片方法快4.6倍，比3D交互方法快1.9倍。MedSAM2和ScribblePrompt在边界清晰的器官上仍有竞争力或更强；IMVS在困难目标和交互效率方面优势最大。

Insight: 关键不是让固定传播器一次性处理全部切片，而是把用户纠正转化为目标体积的在线适配，再用追踪传播保持连续性。效率优势主要体现在困难目标与交互负担；摘要指出边界清晰器官上其他方法可持平或更好。

Abstract: Annotating large radiology datasets is bottlenecked by the manual effort of delineating structures slice-by-slice in 3D volumes. Interactive methods reduce this effort but stay interaction-inefficient: slice-wise methods (including many foundation models) ignore inter-slice continuity, while 3D and video-based methods propagate a prompt with a \emph{fixed} propagator that never adapts to the target volume, so it drifts on low-contrast or pathological structures and must be re-prompted. We present IMVS, a human-in-the-loop annotation framework that composes three components into a closed loop rather than a new segmentation primitive: a lightweight 2D Slice Mask Adapter (SMA) fine-tuned online from user scribbles, a frozen Volume Mask Tracker (VMT) that propagates corrected masks across adjacent slices, and a soft teacher–student alignment that limits forgetting. The SMA is backbone-agnostic (UNet++, DeepLabV3, TransUNet). Across 8 public CT/MRI datasets, IMVS matches strong interactive baselines in quality while sharply cutting annotation effort: $14.4\times$ faster than a proficient copy-based manual workflow ($22.3\times$ over naive manual), $4.6\times$ over slice-wise and $1.9\times$ over 3D interactive methods. MedSAM2 and ScribblePrompt stay competitive or stronger on well-delineated organs; IMVS’s advantage is largest on challenging targets and on interaction efficiency. Source code and Demo Video: https://github.com/AbhilakshSinghReen/imvs.

[27] Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics cs.CVPDF

Simone Teglia, Irene Amerini

TL;DR: MoE-JEPA将V-JEPA 2视觉表征与残差专家混合及噪声分支结合，用门控注意力多实例学习定位合成图像伪造区域；在含30万AI生成、篡改和真实图像的SID-Set上达到95.54%准确率并超过规模大得多的模型。

Details

Motivation: 社交媒体上被操纵图像快速扩散，加剧错误信息并威胁公众信任。视觉Transformer可捕捉局部不一致，但基础模型的全局理解不足以单独区分真假图像，尤其在压缩和社交媒体传输等困难条件下。

Result: 作者首次将联合嵌入预测架构（JEPA）用于深度伪造检测，提出双流MoE-JEPA。模型以V-JEPA 2为骨干，加入残差混合专家机制及噪声流分支，动态吸收取证知识；门控注意力多实例学习模块用于精确理解空间语义。SID-Set包含30万张AI生成、篡改和真实图像，MoE-JEPA达到95.54%准确率并超过规模大得多的模型。摘要未列出分割设置、类别平衡、跨数据集结果或压缩条件的单项表现。

Insight: 自监督视觉世界模型可提供真实图像表征先验，再通过专家分支和噪声线索补充细粒度取证能力；空间语义模块用于定位相关证据。95.54%是单个基准报告值，尚不足以说明跨平台、跨生成器或强压缩条件下的泛化表现。

Abstract: The unchecked proliferation of manipulated images on social media platforms has increased the spread of misinformation, posing a severe threat to public trust and information integrity. Modern deepfake detectors typically rely on Vision Transformers (ViTs) to capture the low-level inconsistencies that characterize fully synthetic or locally tampered images. However, the global understanding of such foundation models is not enough to discriminate alone between real and fake multimedia content, especially in challenging scenarios where images are compressed or transmitted through social media. In this paper we pioneer the application of Joint-Embedding Predictive Architecture (JEPA) models to deepfake detection, taking advantage of the generalized representation of visual reality that such World Models have exhibited. We hypothesize, and empirically demonstrate, that the intrinsic world understanding of JEPA models can be used as a strong prior for a deepfake detector. To fully exploit JEPA capabilities, we propose MoE-JEPA, a dual-stream architecture for deepfake detection. By enhancing a V-JEPA 2 backbone with a Residual Mixture-of-Experts (MoE) mechanism, along with a noise stream branch, our model dynamically internalizes forensic knowledge. Furthermore, a Gated Attention Multiple Instance Learning (MIL) module is employed to ensure precise spatial semantic understanding. Evaluated on the SID-Set benchmark, comprising 300K AI-generated, tampered and authentic images, MoE-JEPA establishes a new state-of-the-art with an accuracy of 95.54%, successfully outperforming vastly larger models.

[28] Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation cs.CVPDF

Meisen Wang, Zhiqiang Tian, Wei Bao, Chengjie Wang, Shaoyi Du

TL;DR: Hyper-RED用语义超图将图像与事件相机token之间的高阶关系迁移到事件表征中，避免僵硬的一对一对齐；通过图内和跨模态关系蒸馏保留事件特有结构，在五个事件数据集、三个任务上持续扩展并取得先进表现。

Details

Motivation: 事件相机适合鲁棒视觉感知，但缺少大规模标注事件数据，难以扩大表征学习。图像预训练模型能提供可扩展语义监督，但现有图像到事件迁移常依赖逐像素或逐token对齐，忽视纹理、密度和外观差异，可能导致语义坍塌并限制迁移。

Result: Hyper-RED是一种可扩展的图像到事件预训练框架，用超图表示并对齐多个图像与事件token之间的高阶语义关联，同时容纳模态差异。对配对事件—图像样本，方法用DINOv3提取空间token，构造图像、事件和跨模态语义超图，每条超边连接多个语义相关token；超图关系蒸馏损失提供互补的模态内及跨模态约束，使事件编码器继承图像语义组织，同时保持局部关系一致性和事件特有属性。五个事件数据集、三个任务的实验显示从ViT-S扩展到ViT-L时性能持续提升，并达到先进水平。摘要未列各任务分数。

Insight: 跨模态迁移不必强制图像和事件token一一对应；以高阶语义关系为单位进行对齐，可在继承图像语义结构的同时保留事件模态特征。摘要未提供模型规模对应的具体曲线、各任务基线和计算开销。

Abstract: Event cameras have shown great potential for robust visual perception, yet scaling event representation learning remains challenging due to the scarcity of large-scale annotated event data. Pretrained image models provide scalable semantic supervision, but existing image-to-event methods rely on rigid pixel-wise or token-wise alignment that overlooks modality discrepancies in texture, density, and appearance, potentially causing semantic collapse and limiting transferability. To address this issue, we propose Hyper-RED, a simple, painless, and scalable image-to-event pretraining framework that transfers high-order semantic structures from images to events. Hyper-RED uses hypergraphs to model and align high-order semantic associations among multiple image and event tokens, enabling cross-modal knowledge transfer while accommodating modality-specific differences rather than enforcing rigid one-to-one correspondence. Specifically, given a paired event–image sample, Hyper-RED leverages DINOv3 to extract spatial token representations and constructs image, event, and cross-modal semantic hypergraphs, where each hyperedge connects multiple semantically correlated tokens. We further introduce a hypergraph relational distillation loss that imposes complementary intra- and cross-modal constraints, enabling the event encoder to inherit image-derived semantic organization while preserving local relational consistency and event-specific characteristics. Experiments on three tasks across five event datasets demonstrate consistent scaling from ViT-S to ViT-L and state-of-the-art performance (Fig.1). The code is available at: https://github.com/meisenwang/Hyper--RED.

[29] StackTok: Accelerating VLMs Inference with Budget-Adaptive Visual Token Selection cs.CV | cs.AIPDF

Zhenbin Wang, Lei Zhang, Lituan Wang, Wei Huang, Yan Wang

TL;DR: StackTok是免训练VLM视觉token选择器，根据问题相关性进行选择，并按预算校准视觉覆盖；在5个VLM、10个图像理解基准的所有受测模型—预算组合中排名第一，LLaVA-NeXT-7B仅用2,880个token中的160个仍保留95.26%全token表现。

Details

Motivation: 提高图像分辨率会使VLM输入视觉token序列变长并显著增加推理成本。已有免训练方法按问题相关性、视觉覆盖或固定折中挑选token，但不同查询和预算需要的相关性—覆盖平衡不同：局部问题偏重相关性，整体理解则需要更广覆盖。

Result: StackTok将问题相关性设为选择目标，将视觉覆盖作为按预算校准的辅助约束。方法先从纯覆盖贪心序列构造按集合大小索引的覆盖参考，再用查询—视觉亲和度熵调整覆盖目标；参考门控的交错选择策略根据当前子集的覆盖缺口，在相关性导向和覆盖导向token间切换。高分辨率输入下，各裁剪区域共享token预算，按局部提名token的合计边际收益分配。在五种VLM、十个不同图像理解基准上，StackTok在每种受测模型—预算组合中都位列免训练选择器第一。高分辨率LLaVA-NeXT-7B仅保留2,880个视觉token中的160个（5.6%），仍达到完整token表现的95.26%。

Insight: 视觉token预算应随问题类型和当前覆盖缺口动态调整，而非固定在局部相关性或全局覆盖之间折中；信息熵和预算参考为这种自适应提供信号。最佳排序限于所测五种VLM、十个基准和预算设置，摘要未报告各项绝对准确率。

Abstract: Increasing image resolution produces ever-longer visual-token sequences in vision-language models (VLMs), substantially raising their inference cost. To reduce this overhead without retraining, existing methods select compact token subsets that prioritize query relevance, visual coverage, or a fixed trade-off between them. The appropriate balance, however, varies across queries and token budgets: localized questions favor relevance, whereas holistic questions demand broader visual coverage. We introduce StackTok, a training-free selector that treats query relevance as the objective and visual coverage as budget-calibrated support. StackTok builds a size-indexed coverage reference from a coverage-only greedy sequence and adjusts its support target using query–vision affinity entropy. A reference-gated interleaved selection policy then switches between relevance- and coverage-oriented additions according to the current subset’s support deficit. For high-resolution inputs, StackTok allocates one shared token budget across crops according to the combined marginal gain of locally nominated tokens. Evaluated with five VLMs over ten distinct image-understanding benchmarks, StackTok ranks first among training-free selectors in every tested model–budget setting. On high-resolution LLaVA-NeXT-7B, it retains 95.26% of full-token performance with only 160 of 2{,}880 (5.6%) visual tokens.

[30] RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models cs.CV | cs.AI | cs.IRPDF

Xun Liang, Honghui Yang, Weihang Pan, Ruisi Zhao, Boyuan Pan

TL;DR: RegRet通过区域感知编码器、多阶段局部描述生成和区域对比学习，增强大型多模态模型的区域级图文检索表征，并提出含22.5万对比样本、覆盖四类检索任务的REGMB基准；零样本下超过强基线，进一步对比训练后多个基准平均提升超过20%。

Details

Motivation: 区域级检索要把用户指定的图像局部与相关区域或文本描述对齐，对电商搜索和RAG等应用重要。现有大型多模态模型主要针对全局检索，难以学到有效局部表征；同时区域级对比训练数据和多样评测任务不足。

Result: RegRet采用区域感知编码器提取细节区域特征，并在局部信息与全局背景上下文间平衡；多阶段训练包含细粒度局部图像描述和区域对比学习，以增强表征判别能力。作者构建REGMB基准，含225,000对比样本并覆盖四种多模态检索任务。实验显示RegRet零样本设置超过强基线；进一步进行对比学习后，在REGMB和公开基准上的平均表现均提升超过20%，同时全局检索保持相当或更好的水平。

Insight: 区域级表征需要保留局部细节，又不能丢失其所在全局背景；区域描述生成与局部对比训练共同支持这一目标。超过20%的平均提升来自后续对比训练，摘要未列具体评测指标、基准名称和相对增幅计算方式。

Abstract: Region-level retrieval aims to align user-specified image regions with relevant regions or textual descriptions, playing a crucial role in realworld applications such as e-commerce product search and RAG. Although recent Large Multimodal Models (LMMs) have made significant strides in multimodal retrieval, they primarily focus on global-level tasks and struggle to capture effective region-level representations. To bridge this gap, we present RegRet, an LMM-based Region-level Retrieval framework that enhances the regional representations without compromising overall global retrieval performance. At its core, RegRet integrates a Region-Aware Encoder to capture detailed regional features while balancing them with the global background context. To further enhance the fine-grained understanding and discriminability of representations, we design a multi-stage training pipeline that includes detailed localized captioning and regional contrastive learning tasks. In addition, considering the absence of region-level contrastive training data and the limited diversity of evaluation tasks in current benchmarks, we introduce the REGMB benchmark. It comprises 225k contrastive pairs, covering four multimodal retrieval tasks. Extensive experiments validate the effectiveness of our approach. RegRet outperforms strong baselines in the zero-shot setting. Further training with contrastive learning leads to an average improvement of more than 20% on both REGMB and public benchmarks, while achieving comparable or better results on global-level retrieval tasks.

[31] TecoPrompt: Temporal-Conservative Prompt Learning for Vision-Language Models cs.CVPDF

Zeyi Shao, Haowen Hua, Jiaxin Zhang, John See, Zeyd Boukhers

TL;DR: TecoPrompt面向少样本噪声标签视觉语言提示学习，以CLIP语义空间熵正则最优传输生成全局一致候选标签，只有候选在K轮窗口内稳定且通过EMA置信门控才改写标签；七个数据集及Food101N实验显示提升，在OxfordPets 50%非对称噪声下准确率由0.775升至0.843。

Details

Motivation: 通过少量标注学习提示可适配CLIP等视觉语言模型，但少样本情况下即使中等标签噪声也会扰乱提示优化。直接根据单轮伪标签修正又容易产生确认偏差和错误累积。

Result: TecoPrompt从时间角度重新设计最优传输伪标注闭环：先在CLIP语义空间计算熵正则OT方案，得到全局一致的候选标签；再检查标签轨迹稳定性，只有当候选在K轮时间稳定窗口内保持不变且通过指数移动平均置信度门控时，才改写噪声标签。标签改写后，通过分别面向干净、中等噪声和高噪声子集的三组损失共同参与提示训练。在七个含合成对称/非对称噪声的数据集及Food101N上，实验显示性能显著提高。例如OxfordPets中，50%非对称噪声条件下准确率从0.775升至0.843。

Insight: 时间稳定性可作为筛选伪标签可靠度的信号，避免模型因单次自我预测而强化错误标签；置信门控和分组损失进一步处理不同噪声程度。摘要只给出一个具体数据点，未列出各数据集平均收益及超参数敏感性。

Abstract: Prompt learning adapts vision-language models, such as CLIP, by adjusting a small set of context tokens. However, under few-shot supervision, even moderate label noise can disrupt prompt optimization. To address this issue, we propose TecoPrompt, a closed-loop robust prompt-learning framework that revisits optimal transport (OT) pseudo-labeling from a temporal perspective. TecoPrompt employs an entropic OT plan in the CLIP semantic space to obtain globally consistent label candidates. It verifies the reliability of these candidates by examining trajectory stability: a noisy label is only rewritten if the OT candidate remains unchanged within a K-epoch temporal stability window and passes a confidence gate based on Exponential Moving Average (EMA). This approach helps reduce confirmation bias. The rewritten labels are then integrated back into prompt training using a tri-group objective that includes three loss functions aligned with clean, mid, and noisy subsets. Experiments on seven datasets with synthetic symmetric and asymmetric noise, as well as Food101N, demonstrate significant performance improvements. For example, on the OxfordPets dataset, with 50% asymmetric noise, TecoPrompt achieves an accuracy of 0.843, up from 0.775.

[32] tcnerv:dual-domain temporal context modeling for implicit neural video compression cs.CVPDF

Xuezhi Xiang, Yixin Zhao, Heqi Xiang, Jiayao Liu, Shanjun Zhang

TL;DR: TCNeRV面向隐式神经视频压缩，在多尺度解码器中融合历史重建特征，并对内容嵌入做时间残差编码；约300万参数下，UVG平均PSNR达36.08 dB，较HNeRV-Boost高2.20 dB，BD-rate相对HM、DCVC和HiNeRV分别降低22.06%、66.73%和29.85%。

Details

Motivation: 视频压缩要在受限码率下最小化重建失真，但现有视频隐式神经表示方法常独立解码各帧，特征未受历史重建条件约束，内容嵌入也缺少显式时间预测。

Result: TCNeRV同时利用特征域和嵌入域中的重建上下文。多尺度时间上下文融合模块MTCF在多个解码器尺度注入门控历史特征；时间嵌入残差编码TERC则预测当前内容嵌入，只编码其残差。模型约300万参数，在UVG数据集上平均PSNR为36.08 dB，较HNeRV-Boost高2.20 dB；相对HM、DCVC和HiNeRV，BD-rate分别减少22.06%、66.73%和29.85%。

Insight: 在隐式神经表示视频压缩中，历史帧重建可同时作为解码特征上下文和嵌入预测的时间先验，从而在有限模型容量下提升率失真表现。摘要未列码率区间、帧率、解码延迟或其他视频集结果。

Abstract: Video compression aims to minimize reconstruction distor tion under a constrained bit rate. Existing video implicit neural representations (INRs) often decode frames independently, leaving intermediate features unconditioned on previous reconstructions and content embeddings without explicit temporal prediction. We propose TCNeRV, which exploits reconstructed context in both feature and embedding domains. Its multi-scale temporal-context fusion (MTCF) module injects gated historical features at multiple decoder scales, while temporal embedding-residual coding (TERC) predicts each content embedding and codes only its residual. With approximately 3M parameters, TCNeRV achieves an average PSNR of 36.08 dB on the UVG dataset, outperforming HNeRV-Boost by 2.20 dB. It reduces BD-rate by 22.06%, 66.73%, and 29.85% relative to HM, DCVC, and HiNeRV, respectively, demonstrating competitive rate-distortion performance with limited model capacity.

[33] SPEAR NeXT Causal Latent Forecasting Across Multiple Horizons for Spectral Temporal Earth Representation Learning cs.CVPDF

Rajiv Ranjan, Udaiveer Singh, Shashank Tamaskar, Dharmendra Saraswat

TL;DR: SPEAR NeXT将地球观测时间自监督定义为仅依赖过去观测的多时域潜在地球状态预测：先把光学、雷达和环境输入编码成32维状态，再用因果掩码Transformer预测多个未来状态，并以旋转位置编码和年月嵌入表达时间与季节信息。

Details

Motivation: 地球观测本质上是动态过程，但不少基础模型通过重建、不变性或回顾式序列摘要学习时间信息。作者希望构建紧凑的逐像素多模态光谱—时间基础模型，使时间自监督遵守因果方向并直接预测多个未来时域。

Result: SPEAR NeXT先使用预训练SPEAR模型将光学、雷达及环境观测中的瞬时状态编码为32维紧凑嵌入，再由因果掩码Transformer根据过去观测预测多个未来潜在状态。相对时间顺序通过旋转位置编码表示，月份和年份嵌入则编码季节阶段及年际上下文。给定的摘要未包含数据集、预测时域设置、下游任务或性能结果。

Insight: 以过去到未来的潜在状态预测作为预训练任务，可让地球观测模型在不重建原始数据的情况下学习因果时间动态；紧凑状态和年月编码分别承载空间语义及季节背景。当前摘要内容未报告实验结果，尚无法判断迁移效果和相对基线的优势。

Abstract: Earth observation is inherently dynamic, yet temporal information in many foundation models is learned through reconstruction, invariance, or retrospective sequence summarization. SPEAR NeXT is introduced as a compact pixel-wise multimodal spectral temporal foundation model in which temporal self supervision is formulated as past only, multi horizon latent Earth state prediction. Instantaneous states are first encoded by the pretrained SPEAR model from optical, radar, and environmental observations into compact 32 dimensional embeddings. Their temporal evolution is then modeled by a causally masked Trans former that predicts multiple future latent states from pre ceding observations. Relative temporal order is represented using Rotary Position Embeddings, while month and year embeddings encode seasonal phase and interannual con text.

Darius Peteleaza, Razvan-Gabriel Dumitru, Bogdan Neamtu, Arpad Gellert, Mariana Sandu

TL;DR: NeuroTS-Net是用于儿童脑肿瘤多模态MRI多类分割的3D编码器—解码器CNN，通过双尺度原始细节流、自适应低分辨率上下文选择和保细节多路径下采样平衡边界与全局信息；BraTS 2026内部和官方验证集肿瘤Dice均约0.93。

Details

Motivation: 儿童脑肿瘤是儿童癌症相关死亡的重要原因，其亚区域小、罕见且常呈低对比度，人工精确勾画困难。可靠自动分割可支持诊断、治疗规划和疗效评估。

Result: NeuroTS-Net采用三维编码器—解码器卷积网络，包含双尺度原始细节流、自适应低分辨率上下文选择和细节保持多路径下采样，以保留细微强度及边界信息，同时高效建模较大范围肿瘤上下文。模型仅用BraTS 2026儿童数据集训练，不使用外部数据或预训练权重，并在相同实验协议下与nnU-Net和MedNeXt比较。NeuroTS-Net优于两种基线：内部验证集全肿瘤和肿瘤核心Dice分别为0.938和0.937；官方挑战验证集分别为0.927和0.926。

Insight: 儿童肿瘤小且边界不清，保留高分辨率细节的同时引入自适应低分辨率上下文有助于兼顾定位和整体结构。模型从头训练仍优于所测基线；摘要未列基线具体Dice、其他亚区指标或不同中心上的额外验证。

Abstract: Pediatric brain tumors are a leading cause of cancer-related mortality in children, and their small, rare, and often low-contrast subregions make accurate manual delineation challenging. Reliable automated segmentation is therefore needed to support diagnosis, treatment planning, and response assessment. Accordingly, we introduce NeuroTS-Net, a three-dimensional encoder-decoder convolutional neural network architecture for multi-class semantic segmentation that incorporates a dual-scale raw-detail stream, adaptive low-resolution context selection, and detail-preserving multipath downsampling. These components preserve fine intensity and boundary information while efficiently modeling broader tumor context. NeuroTS-Net was trained on the BraTS 2026 pediatric dataset without external data or pretrained weights and evaluated against nnU-Net and MedNeXt under the same experimental protocol. NeuroTS-Net outperformed the baseline methods, achieving whole-tumor and tumor-core Dice scores of 0.938 and 0.937 on the internal validation set and 0.927 and 0.926 on the official challenge validation set. The code is open-sourced at: https://github.com/maenstru56/NeuroTS.

[35] Accelerated Decoding of Centroid Positional Encoding for Instance Segmentation cs.CVPDF

Carmelo Scribano, Filippo Muzzini, Nedyalko Prisadnikov, Mohammad Mahdi, Yuqian Fu

TL;DR: 该工作为质心位置编码实例分割提出优化CUDA解码器，针对密集像素嵌入恢复实例掩码时的并行同步和内存访问瓶颈；结果显示专用GPU解码显著降低后处理开销和端到端延迟，优于CPU及朴素GPU实现。

Details

Motivation: 从网络原始输出解码为任务表示本身可能占用显著执行时间，但模型预测解码受到的关注少于网络推理，常使用通用CPU代码或低效GPU核，限制模型优化带来的整体收益。基于正弦质心编码的实例分割虽无需预设候选框，却需要高成本地从密集嵌入提取实例掩码。

Result: 作者研究基于质心正弦编码的实例分割解码开销，并提出专用CUDA实现，重点处理现代GPU上的并行化、同步和内存访问问题。该实现显著降低解码时间和端到端推理延迟，优于CPU方案及朴素GPU实现。摘要未提供具体硬件、绝对延迟或加速倍数。

Insight: 端到端系统瓶颈可能落在输出解码，而非神经网络前向；新的输出表示需要与其专用高效解码算法联合设计，才能兑现实时视觉系统的性能。摘要只报告相对优势，尚无法量化部署收益。

Abstract: Beyond model inference, the decoding stage, which converts raw network outputs into task-level representations, constitutes a significant portion of the execution cost. Despite its practical impact, prediction decoding has received comparatively little attention and is often implemented using generic CPU routines or inefficient GPU kernels, limiting the benefits of advances in model efficiency. In this work, we investigate the decoding overhead associated with a recent sinusoidal centroid encoding for Instance Segmentation, in which each pixel regresses a positional embedding of its instance centroid. This approach allows flexible segmentation without predefined proposals, but extracting instance masks from dense embeddings incurs a high computational cost. We present an optimized CUDA-based implementation of the decoding algorithm tailored to this encoding, explicitly addressing challenges related to parallelization, synchronization, and memory access on modern GPUs. Our solution significantly reduces decoding overhead and improves End-to-End inference latency, outperforming both CPU-based approaches and naive GPU implementations. The results demonstrate that efficient decoding is essential to fully exploit the advantages of advanced output representations and highlight the importance of jointly designing encoding schemes and their decoding algorithms for real-time computer vision systems.

Jaeseok Byun, Gukyeong Kwon, Han-Kai Hsu, Meher Gitika Karumuri, Zhikang Zhang

TL;DR: MKP-Adapter提出面向多模态大模型的仅适配器式后向兼容训练，在不更新骨干的条件下通过多级保持损失维持新嵌入知识的几何结构，并以焦点重加权关注难样本；在图像、文本、视觉文档及视频检索任务上报告较强兼容表现。

Details

Motivation: 升级嵌入模型通常需要昂贵地重建数据库索引，因为新查询向量与旧数据库向量不兼容。既有后向兼容训练可缓解该问题，但往往要求更新骨干，成本高、可能损害性能，且专有模型权重通常无法访问。

Result: MKP-Adapter据作者所述是首个面向多模态大语言模型的仅适配器式后向兼容训练方法，不更新骨干。作者指出核心难点是同时保留新嵌入知识并实现后向兼容，因此提出多级保持损失，在训练过程中维护嵌入空间几何结构，并加入焦点重加权优先学习困难样本。多模态基准实验覆盖图像、文本、视觉文档和视频检索；方法实现较强后向兼容性，仅使用预提取嵌入训练，相对原骨干前向推理仅增加可忽略延迟。

Insight: 仅适配器训练能在不可修改或不便重训的大型骨干上更新检索嵌入，并减轻新旧索引不兼容造成的重建成本；保持嵌入几何结构是兼容训练的关键。摘要没有给出兼容分数、召回下降或适配器规模。

Abstract: Upgrading embedding models typically requires expensive database re-indexing, as new query embeddings are incompatible with existing database embeddings. While Backward Compatible Training (BCT) mitigates this by enforcing compatibility during training, existing approaches often require updating the backbone model. This is impractical because of significant training cost, the risk of performance regression, and limited access to proprietary model weights. We introduce Multi-modal Knowledge Preserving Adapter (MKP-Adapter), the first adapter-only BCT approach for Multi-modal Large Language Models (MLLMs) that requires no backbone updates. We identified that the primary challenge in adapter-only BCT is preserving the knowledge of the new embeddings while enforcing backward compatibility. Hence, we propose a multi-level preservation loss that maintains the geometric structure of the embedding spaces throughout BCT. Furthermore, a focal re-weighting strategy is integrated to prioritize learning from challenging samples. Experiments demonstrate that our method achieves strong backward compatibility across diverse multi-modal benchmarks (image, text, visual document, and video retrieval tasks) and model types. Notably, MKP-Adapter is trained solely on pre-extracted embeddings and requires only negligible additional latency relative to the original backbone forward pass, highlighting its efficiency.

[37] VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal cs.CV | cs.AIPDF

Haonan Huang, Tianrui Qiu, Xianghao Zang, Yinan Du, Zhixiang He

TL;DR: VOR-Bench构建面向视频物体移除的人类感知评测体系，含模型生成、工具渲染和实拍的成对编辑视频及涂鸦掩码数据VORD，并提出真实运动配对采集框架rMPAF和VLM评分模型VOR-MDSM；评测与主观判断相关系数超过0.9。

Details

Motivation: 视频物体移除评估有两个问题：参考视频质量可能存疑，传统数值指标也未必与人类偏好一致。缺乏覆盖多种真实场景、具备可信成对参考并符合人类感知的基准。

Result: VOR-Bench包含VORD数据集，作者称这是首个同时提供成对编辑视频和涂鸦掩码的评测数据集，覆盖模型生成、工具渲染和摄像机实拍内容。真实运动配对视频采集框架rMPAF结合图像物体移除与微调视频生成模型，自动生成真实且运动连贯的成对视频。论文定义三种评测维度，并提出面向掩码引导视频移除的感知驱动VLM评分器VOR-MDSM，覆盖关键视觉属性以贴近细致的人类判断。实验显示，VOR-Bench评测与主观评价高度一致，相关系数ρ>0.9。作者计划公开基准及文档。

Insight: 视频编辑评测需要兼顾参考可信度、时序运动一致性和人类感知；新数据、采集框架及VLM评分模型共同面向这些不足。摘要没有列出三种评测维度具体内容、人工评分规模及相关性计算细节。

Abstract: Despite its crucial role in video object removal (VOR), existing evaluation paradigms face two critical limitations: questionable references and a misalignment between tradi- tional metrics and human preference. To address these challenges, we introduce VOR- Bench, which advances VOR evaluation through three integrated components. First, we present the VOR Dataset (VORD), the first benchmark dataset providing both paired edited videos and graffiti masks. Its unique strength lies in a diverse data spectrum, which encompasses model-generated, tool-rendered, and camera-captured data, ensuring robust assessment across real-world scenarios. Second, we develop rMPAF, a realistic Motion- capable Paired-video Acquisition Framework. By combining the strengths of image- based object removal and fine-tuned video generation models, rMPAF automatically generates realistic, motion-coherent paired videos. Finally, we propose three evaluation dimensions and introduce VOR-MDSM, the first perception-driven VLM-based scoring model specifically designed for mask-guided VOR. It bridges the gap between arithmetic metrics and human perception by covering the essential visual attributes and matching nuanced human judgment. Extensive experiments demonstrate that VOR-Bench yields evaluation results that align closely with human perception, achieving a remarkable cor- relation (\r{ho} > 0.9) with subjective assessments. We will release VOR-Bench along with its documentation to ensure full reproducibility.

[38] PiPS: Post-Hoc Prototypical Explanations for Interpretable Semantic Segmentation cs.CVPDF

Miłosz Adamczyk, Tymoteusz Zapala, Piotr Borycki, Przemysław Spurek

TL;DR: PiPS是一种完全后处理的语义分割原型解释方法，可从任意预训练网络中提取空间定位的“看起来像这样”原型证据，无需修改网络或微调，并保持原预测性能不变；代码已公开。

Details

Motivation: 原型式解释通过视觉相似性说明模型决策，已广泛用于图像分类，但语义分割这类密集预测的解释仍研究不足。已有可解释分割模型多采用前置专用架构，需要从头训练并修改网络，可能使预测性能较标准黑箱模型明显下降。

Result: PiPS（Post-hoc interpretable Prototypical Segmentation）被作者称为首个完全后处理的语义分割原型解释方案。它无需改变或微调任何预训练网络，即可提取直观且空间定位的原型解释，并保持模型原有100%预测性能。方法面向医学诊断、自动驾驶等需要精确目标定位的高风险视觉任务；代码已公开。摘要未报告解释质量的人类评估、原型数量或具体模型列表。

Insight: 后处理解释可避免为获得可解释性而牺牲预测精度或重训模型，并将原型证据用于密集像素预测的空间区域。保持100%原预测性能指不改变预测网络，不等于解释已被验证为忠实或对用户有效；摘要未提供此类评估。

Abstract: With the increasing deployment of deep neural networks in critical systems, such as medical diagnostics and autonomous vehicles, ensuring their interpretability is crucial to building trust in decision-making systems. In the field of explainable artificial intelligence, prototype-based reasoning has gained particular popularity, as it mimics human cognitive processes by explaining model decisions based on visual similarity under the looks like this paradigm. While this paradigm has been thoroughly investigated in the context of global image classification, the interpretability of dense predictions, particularly semantic segmentation, remains largely unexplored despite its immense importance in tasks requiring precise object localization. Existing prototype-based interpretable segmentation models rely on ante-hoc architectures, which entails significant limitations because they require costly training from scratch and modifications to the network structure, ultimately leading to a noticeable drop in predictive performance compared to standard black-box models. To address this issue, we propose PiPS (Post-hoc interpretable Prototypical Segmentation), the first fully post-hoc solution for generating prototypical explanations for semantic segmentation models. Our method enables the extraction of intuitive, spatially localized explanations from any pre-trained network without modification or fine-tuning, thereby preserving 100% of the model’s original predictive performance. This approach opens a new avenue for the safe and cost-effective deployment of transparent systems in advanced computer vision tasks. Codebase available at https://github.com/gmum/PIPS.

[39] NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving cs.CVPDF

Muhammad Ahmed Ullah Khan, Mohammed Elamine, Sheikh Talha Uddin, Didier Stricker, Sk Aziz Ali

TL;DR: NeuroSymbEAD将KITTI-360驾驶场景转成以自车为中心的知识图谱和多层次文本描述，标注静动态物体类别、朝向及距离等信息，并提供场景地图重建、视觉识别和物体接地基线，支持视觉语言模型开展交通场景解释与3D推理。

Details

Motivation: 自动驾驶理解需要表达道路场景中物体及其复杂关系。自然语言接地描述可作为轻量场景上下文，但需要与结构化空间知识结合，才能支持驾驶常识、交通场景理解及可解释感知研究。

Result: NeuroSymbEAD是大规模神经符号描述数据集，构建以自车为中心的静态和动态物体知识图谱，标注类别、朝向、方向及与自车的距离，并据此在KITTI-360上生成多层次文本场景描述，作为轻量自车场景地图。标注管线可将真实或模拟物体填入任意3D检测网络预测的边界框，生成多样地图片段和分层文本描述。作者提供户外场景地图重建、视觉识别和物体接地等基线，并用预训练接地网络与自回归描述网络评估神经符号和本体描述生成。数据集面向视觉语言与基础模型的交通场景解释、3D推理和可解释自动驾驶感知。

Insight: 把3D驾驶场景转成带明确对象关系的自车中心语言，可提供比孤立物体标签更丰富的视觉语言训练与评测信号；知识图谱结构也便于解释空间关系。摘要未列数据规模、基线分数或人工描述质量评估结果。

Abstract: This paper introduces NeuroSymbEAD, a large-scale neuro-symbolic caption dataset featuring an ego-centric knowledge graph (KG) of static and dynamic objects annotated with classes, categories, heading directions, orientations, and distances from the ego-vehicle. These annotations are used on the KITTI-360 dataset to generate multilevel textual captions representing a lightweight version of an ego-centric scene map. Outdoor scene-map reconstruction, visual recognition, and object grounding establish baselines for driving common sense and traffic/scene understanding. For these purposes, natural language-based grounded captioning of objects and their complex relationships is a widely adopted contextual representation for indoor scene tasks. Neuro-symbolic representations have proven effective in handling structured information for various computer vision and language applications. Our data annotation pipeline allows the generation of varied map segments, populating simulated or real objects within the bounding boxes predicted by any 3D object detection network, and building hierarchical text captions. We benchmark our neuro-symbolic and ontological caption generation using pre-trained grounding and learned auto-regressive captioning networks. By converting 3D driving scenes into structured ego-centric language, NeuroSymbEAD provides a benchmark for vision-language and foundation models for traffic-scene explanation, 3D reasoning, and interpretable autonomous-driving perception.

[40] High-Fidelity Video Quality Assessment with VQA-Specific Saliency cs.CVPDF

Hakan Emre Gedik, Shashank Gupta, Alan Bovik

TL;DR: HFVQA以原分辨率、多尺度时空图块和极少时间下采样保留视频质量线索，并训练轻量辅助网络学习VQA专用显著性来筛选图块；在标准无参考视频质量评估基准上达到先进表现，最多处理候选时空图块的12%。

Details

Motivation: 无参考视频质量评估中的视频数据量大，深度处理成本高，但准确评估需要保留原分辨率细节和稠密时间信息。分块等效率预处理虽降低计算量，却改变输入分布，削弱预训练视频基础模型的可复用性。

Result: HFVQA兼容预训练视频基础模型，使用固定大小的时空图块，在多个尺度采样并包含原始分辨率，且尽量减少时间下采样，以保留低层质量线索和语义上下文。为控制计算量，轻量辅助网络与视频模型编码器端到端训练，学习直接由质量监督蒸馏得到的VQA专用显著性，反映感知质量主要由少量时空区域决定。结合高保真时空线索和任务特定显著性后，HFVQA在标准无参考视频质量评估基准上达到先进表现，计算时最多仅处理候选时空图块的12%。

Insight: 视频质量评估不能简单缩小或稀疏化输入，否则可能损失决定画质评分的局部和时间线索；任务特定显著性可在保真输入上筛除不重要区域。摘要未报告具体基准名称、评分指标、处理12%图块时的精度及推理延迟。

Abstract: No-reference video quality assessment (NR VQA) has recently seen promising progress with deep learning. However, video data is inherently large, and processing them with deep models incurs high computational cost. This challenge is particularly acute in VQA, where preserving original-resolution cues and dense temporal information is critical for accuracy. Existing efficiency-driven preprocessing strategies, such as fragmenting, reduce computation but alter the input data distribution, limiting effective reuse of pretrained video foundation models (ViFMs). To address these challenges, we propose \textbf{H}igh-\textbf{F}idelity \textbf{V}ideo \textbf{Q}uality \textbf{A}ssessment (\textbf{HFVQA}), a framework built on fixed-size spatio-temporal (ST) patches that is fully compatible with pretrained ViFMs. HFVQA samples ST patches across multiple scales, including the original resolution, with minimal temporal subsampling to preserve low-level quality cues and semantic context. To limit computation, HFVQA introduces a lightweight auxiliary network trained end-to-end with the ViFM encoder to learn \textit{VQA-specific saliency}. Distilled directly from quality supervision, this saliency captures task-specific importance patterns, reflecting that video quality perception is dominated by a small subset of spatio-temporal regions. By combining high-fidelity spatio-temporal cues with learned, task-specific saliency, HFVQA achieves SOTA performance on standard NR VQA benchmarks while processing as little as 12% of candidate ST patches, making high-fidelity ViFM-based VQA computationally tractable.

[41] MedPCFM-TED: One-Step Point Cloud Flow Matching for Implant Generation via Teacher-Guided Endpoint Distillation cs.CV | cs.LGPDF

Kamil Kwarciak, Marek Wodzinski

TL;DR: TED将条件颅骨植入物点云生成从多步流匹配蒸馏为单步模型，以教师终点监督和几何匹配损失训练学生，无需显式路径拉直；在SkullBreak整体最佳、SkullFix上有竞争力，单样本生成约0.04秒。

Details

Motivation: 颅骨植入物生成是医学影像中的重要任务。基于点云的生成方法，尤其流匹配，重建质量高且采样有效，但推理仍需多次神经函数评估，限制了快速生成多个备选植入物的能力。

Result: 作者提出教师引导终点蒸馏TED，将条件颅骨植入物生成蒸馏为单步框架。学生通过教师引导的终点监督及几何匹配损失训练，不需要显式拉直生成路径。在SkullFix和SkullBreak基准上评估时，TED在SkullBreak取得整体最佳表现，在SkullFix保持竞争力，并在所比较的单步方法中获得最强Chamfer距离表现。单样本植入物生成约需0.04秒。

Insight: 对点云生成器直接蒸馏教师终点，可避免推理时执行多步流积分，在保持重建质量的同时加快候选生成。摘要未给出其他质量指标的数值或与多步教师速度的具体比较。

Abstract: Cranial implant generation is an important task in medical imaging. Recent point cloud based generative methods, particularly flow matching, offer strong reconstruction quality and efficient sampling, but still require multiple neural function evaluations during inference. This limits rapid generation of multiple plausible implant candidates. We propose Teacher-guided Endpoint Distillation (TED), a simple one-step distillation framework for conditional cranial implant generation on point clouds. TED trains a one-step student using teacher-guided endpoint supervision and geometric matching losses, while avoiding explicit path straightening. We evaluate TED on the SkullFix and SkullBreak benchmarks. TED achieves the best overall performance on the SkullBreak dataset, remains competitive on SkullFix, and provides the strongest Chamfer distance performance among the compared one-step methods. In addition, TED generates implants in approximately 0.04s per sample. These results show that one-step distillation can substantially accelerate conditional point cloud implant generation without sacrificing reconstruction quality.

[42] Symmetry-Aware Likelihood-Orbit Aggregation for Selective Left-Right Claim Verification cs.CVPDF

Zhouzhi Xiong, Chuxi Zhang, Weizhen He, Yi Chen, Qi Li

TL;DR: Relation-Orbit为视觉语言模型验证左右关系主张提出无需学习融合参数的对称性轨道似然对比方法，将反射、逆关系和实体交换产生的八个归一化似然分配到正反事实角色，并用风险上界校准的阈值选择性作答；在VSR和GQA四个冻结VLM上，覆盖率均高于Orbit-Max基线。

Details

Motivation: 冻结VLM在细粒度左右关系判断上仍不可靠，原始主张似然也未必能稳定排序验证错误。确定采用水平翻转干预后，关键是如何把其诱导的多个似然测量组合为可选择作答的验证信号。

Result: Relation-Orbit使用闭式对比且不含可学习融合参数；根据反射、逆关系和实体交换，将八个归一化似然分配到支持查询及反事实角色。只有带符号对比超过在留出数据上用逐点Clopper–Pearson上置信界选出的阈值时，才接受主张。VSR和GQA上对四个冻结VLM的评测显示，在10%选择性风险校准目标下，Relation-Orbit在全部八个数据集—骨干设置中的平均测试覆盖率均高于使用全部八项似然的Orbit-Max基线。相较几乎对所有样本弃答的单侧干预分数，提升单独报告；LLaVA-1.5/COCO实验、缩减轨道控制及双侧划分诊断用于进一步分析结构优势。

Insight: 左右关系具有反射和实体交换对称性，将相关反事实变换纳入似然对比可利用结构信息提升选择性验证，而非直接相信模型原始置信度。摘要未列覆盖率的具体数值，且收益必须结合固定的风险校准阈值解释。

Abstract: Frozen vision-language models (VLMs) remain unreliable on fine-grained left-right claims, and raw claim likelihoods need not reliably rank verification errors. After a horizontal-reflection intervention is fixed, how should its induced likelihood measurements be combined into a selective verification signal? We introduce Relation-Orbit, a closed-form contrast with no learned fusion parameters that assigns eight normalized likelihoods to query-supporting and counterfactual roles determined by reflection, inverse relation, and entity exchange. A claim is asserted only when the signed contrast exceeds a threshold selected on held-out data using pointwise Clopper-Pearson upper confidence bounds. On VSR and GQA across four frozen VLMs, Relation-Orbit yields higher mean test coverage at a 10% selective-risk calibration target than an all-eight Orbit-Max baseline in all eight dataset-backbone settings; gains over a nearly abstain-all one-sided intervention score are reported separately. A separate LLaVA-1.5/COCO evaluation, reduced-orbit controls, and a two-sided partition diagnostic further characterize the structural advantage.

[43] sensVLA: Spatially-Grounded Vision-Language-Action Model for Autonomous Wheel Loader cs.CV | cs.ROPDF

Gopi Krishna Erabati, Bjarne Johannsen, Angus Stewart, Vardeep Singh Sandhu

TL;DR: sensVLA将Qwen3-2B视觉语言模型与可训练流匹配动作专家结合，把前后激光雷达融合得到的BEV几何直接送入动作专家，并由RGB视图提供任务语义；真实轮式装载机数据上整体步级表现与相机基线相当，装载任务速度RMSE降低28%、位移误差降低9%，摄像头受损时退化少29%。

Details

Motivation: 自主轮式装载机控制需联合处理任务语义、第一人称视觉、本体感觉和3D场景几何。仅依赖摄像头的系统在空间精度和传感器故障时可能受限，因而需要让空间定位和语言推理互补。

Result: sensVLA由Qwen3-2B视觉语言模型和通过流匹配速度回归训练的全参数Transformer动作专家组成。专门交叉注意通路将前后激光雷达融合的鸟瞰图特征直接送入动作专家；VLM则处理前后RGB图像并提供任务条件语义，从而将空间接地与语言推理解耦，同时在决策时保持交互。专家预测六个动作维度，包括纵向速度、转向、机体坐标位移、机械臂速度及铲斗速度。在真实轮式装载机数据集上，整体逐步表现与强相机基线相当；装载相关场景中纵向速度RMSE降低28%、位移误差降低9%；相机流损坏或移除时，性能退化幅度少29%。

Insight: 把激光雷达几何直接注入动作专家，可让VLA保留明确空间约束，同时用视觉语言分支提供任务语义；这也提高摄像头异常下的容错性。摘要未提供数据量、具体指标单位及无相机条件下的绝对成功率。

Abstract: Autonomous wheel-loader control requires joint reasoning over task semantics, egocentric vision, proprioception, and 3D scene geometry. We present sensVLA, a Vision-Language-Action (VLA) architecture that combines a Qwen3-2B Vision-Language Model (VLM) with a fully trainable transformer action expert trained by flow-matching velocity regression. sensVLA routes Bird’s-Eye-View (BEV) features, extracted from fused front and rear lidar, directly to the action expert through a dedicated cross-attention pathway, while the VLM consumes front and rear RGB views to provide task-conditioned semantic context. This design decouples spatial grounding from linguistic reasoning while preserving interaction between both streams at decision time. The expert predicts six action dimensions: longitudinal velocity, steering, body-frame displacement, arm rate, and bucket rate. On a real-world dataset from a wheel loader, sensVLA reaches aggregate per-step parity with a strong camera-only baseline and reduces longitudinal velocity RMSE by 28% and displacement error by 9% on loading centric scenarios. It also degrades 29% less when the camera stream is corrupted or removed, evidencing that explicit spatial grounding improves accuracy and fault-tolerance for heavy equipment autonomy.

Yuetong Wang, Jinsheng Quan, Yi Yang, Yawei Luo

TL;DR: Bi-FlowGS以光流在视频生成视角补全和高斯几何约束间建立双向协同：从修复视频蒸馏时序对应关系到3D高斯几何，并用当前几何反向引导视频修复；在宽基线和无界360°基准上提升渲染质量与几何一致性。

Details

Motivation: 稀疏视角3D高斯泼溅重建欠约束，错误的位置或深度可能被不透明度、尺度和外观补偿，产生外观合理但几何错误的“几何作弊”。几何正则化受限于已观测视角，视频扩散补全虽能生成未见视角，却通常只将其作为RGB伪监督，未利用运动和时间先验，也缺少显式几何监督。

Result: Bi-FlowGS使用光流连接生成式视角补全与高斯几何正则化。即插即用的Video-to-Geometry Flow Distillation（V2G）将修复视频中的时序对应先验蒸馏到高斯几何，以缓解几何作弊；反向的Geometry-to-Video Flow-Guided Restoration（G2V）则利用当前3DGS几何指导时间一致的视频修复，产生更可靠的生成监督。两者形成隐式双向协同细化过程，使修复视频与优化后的3DGS场景迭代改进。实验在宽基线和无界360°基准上显示渲染质量及几何一致性均提升。

Insight: 生成视频与3D几何可互为监督：视频流提供跨视角运动对应，几何则限制视频补全的时序和空间合理性；双向更新针对仅用RGB伪标签导致的几何作弊。摘要未提供各基准的具体质量指标或提升幅度。

Abstract: Sparse-view 3D scene reconstruction with 3D Gaussian Splatting (3DGS) is inherently underconstrained. Plausible renderings can also coexist with erroneous Gaussian geometry, as errors in positions or depths may be concealed by opacity, scale, and appearance; we term this failure mode Geometry Cheating. Existing regularization methods constrain geometry but remain limited to observed views, while video-diffusion-based methods complete unseen views yet mainly use them as RGB pseudo-supervision, underusing motion and temporal priors and lacking explicit geometry supervision. We present Bi-FlowGS, which uses optical flow to bridge generative view completion and Gaussian geometry regularization. Our plug-and-play Video-to-Geometry Flow Distillation (V2G) distills temporal correspondence priors from restored videos into Gaussian geometry to alleviate Geometry Cheating. Conversely, Geometry-to-Video Flow-Guided Restoration (G2V) uses the current 3DGS geometry to guide temporally consistent video restoration, providing more reliable generative supervision. Together, V2G and G2V form an implicit bidirectional co-refinement process, enabling restored videos and the optimized 3DGS scene to iteratively improve each other. Experiments demonstrate improved rendering quality and geometric consistency across wide-baseline and unbounded 360° benchmarks.

[45] Beyond In-Distribution Metrics: A Systematic Out-of-Distribution Evaluation of Congenital Heart Disease Segmentation cs.CV | cs.AIPDF

Aniketh Vijesh, Shrisharanyan Vasu, Abhijit Ramesh, Clare Pomeroy-Ward, Harikrishnan Anil Maya

TL;DR: 该研究系统评估先天性心脏病分割的跨域泛化，发现域内验证Dice不能预测跨队列鲁棒性：nnU-Net域内0.77但ImageCHD仅0.51，SwinUNETR达0.67；仅11例目标域标注即可使SwinUNETR各变体超过0.76 Dice。

Details

Motivation: 先天性心脏病诊断和手术规划常需要患者特定3D解剖模型，手工分割劳动密集，复杂解剖尤其困难。深度学习可自动分割，但临床实际会遇到扫描仪、协议、机构、患者群体和成像模态变化，既有方法通常只在域内评估。

Result: 作者使用保留为目标域的ImageCHD队列，系统评测先天性心脏病分割OOD泛化，并比较CT与CMR联合训练、仅CT训练、自监督预训练及有限目标域适配。域内性能对跨队列鲁棒性的预测很差：nnU-Net取得最高验证Dice 0.77，但在ImageCHD降至0.51；SwinUNETR泛化更好，达到0.67。MAE和JEPA预训练仅带来有限额外收益，提示在该设置下架构比所测预训练策略对鲁棒性的影响更大。加入少量目标域监督后，仅用11例有标注ImageCHD病例，所有SwinUNETR变体Dice均超过0.76。

Insight: 临床影像分割必须明确跨队列测试，单一域内高分可能掩盖重要泛化失败；在该先天性心脏病设置中架构选择的影响大于所测自监督预训练。11例目标域适配显示少量标注有潜力，但结果限于ImageCHD和本研究评估协议。

Abstract: Congenital heart disease (CHD) diagnosis and surgical planning often require patient-specific 3D anatomical models, but manual segmentation is labor-intensive, particularly in complex anatomies. Although deep-learning methods can automate this process, they are typically evaluated in-distribution, despite clinically relevant shifts in scanner, protocol, institution, population, and imaging modality. We present, to our knowledge, the first systematic evaluation of out-of-distribution (OOD) generalization in CHD segmentation, using ImageCHD as a held-out target cohort. We compare representative segmentation architectures under combined CT and CMR training, CT-only training, self-supervised pretraining, and limited target-domain adaptation. In-distribution performance proves to be a poor indicator of cross-cohort robustness: nnU-Net achieves the highest validation Dice (0.77) but falls to 0.51 on ImageCHD, while SwinUNETR generalizes substantially better, reaching 0.67 Dice. MAE and JEPA pretraining provide only modest additional benefit, suggesting that architecture contributes more to robustness than the tested pretraining strategies in this setting. When limited target-domain supervision is introduced, all SwinUNETR variants exceed 0.76 Dice with only 11 labeled ImageCHD cases. These findings demonstrate that conventional in-distribution evaluation can obscure clinically important generalization failures and support explicit cross-dataset testing as a key component of CHD segmentation evaluation.

[46] Hub-Spectral Activation of Latent Multimodal Knowledge cs.CVPDF

Ying Guo, Haidong Chen, Linrui Xu, Xiaohao Liu, Chuancheng Shi

TL;DR: HSA是无需训练或更新骨干的闭式方法，从冻结多模态表示的两条已训练枢纽边二阶统计中恢复可读取的跨模态知识，并以可靠性加权匹配支持双向检索和原型分类；ImageBind与LanguageBind上Recall@10从18.27%升至31.15%，宏平均Top-1从29.01%升至52.43%。

Details

Motivation: 多模态表征学习需要支持跨模态检索和知识迁移。枢纽式绑定可降低逐模态配对监督成本，但若不同模态的枢纽连接没有直接联合训练，就无法保证它们可靠对齐，潜在的共同跨模态知识难以利用。

Result: Hub-Spectral Activation（HSA）将潜在知识形式化为源诱导的跨模态依赖，并刻画由两条已训练枢纽边二阶统计确定的部分。在二阶源模型下，作者给出完整恢复源诱导关系的条件，并用枢纽协方差秩界定可读取成分维度。HSA组合并标准化枢纽边统计、提取成对谱方向，再将可靠性加权匹配证据与源门控候选解析结合，用于双向检索和原型分类。方法无需目标配对监督、梯度优化或更新骨干。在ImageBind和LanguageBind的19种检索关系、11种原型分类关系上，平均双向Recall@10由18.27%提高至31.15%，宏平均Top-1准确率由29.01%提高至52.43%。控制分析指出有效的枢纽边对应关系和领先谱方向是检索收益的重要来源。

Insight: 分别训练的枢纽连接仍可能包含无法由原生相似度直接读出的共享多模态结构；二阶统计和谱分解提供无需再训练的激活方式。收益依赖正确的枢纽边对应和主要谱方向；摘要未列逐关系分数。

Abstract: Multimodal representation learning seeks shared representations for cross-modal retrieval and knowledge transfer. Hub-based binding reduces pairwise supervision costs, but separate hub connections cannot guarantee reliable alignment between modalities without direct joint training. We introduce Hub-Spectral Activation (HSA), a closed-form method for recovering and activating the hub-readable component of latent multimodal knowledge in frozen representations. We formalize this knowledge as source-induced cross-modal dependence and characterize the component determined by the second-order statistics of two trained hub edges. Under a second-order source model, we establish conditions for exact recovery of the complete source-induced relation and bound the dimension of its hub-readable component by the hub covariance rank. HSA composes and standardizes hub-edge statistics, extracts paired spectral directions, and combines reliability-weighted matching evidence with source-gated candidate resolution for bidirectional retrieval and prototype classification. HSA requires no target-pair supervision, gradient optimization, or backbone updates. Across 19 retrieval and 11 prototype-classification relations on ImageBind and LanguageBind, HSA raises mean bidirectional Recall@10 from 18.27% to 31.15% and mean macro Top-1 accuracy from 29.01% to 52.43%, respectively. Controlled analyses further identify valid hub-edge correspondence and leading spectral directions as key sources of retrieval gains, demonstrating the utility of latent multimodal knowledge beyond native similarity scores. Code and models are publicly available at https://github.com/Luo1Yan/HSA.

[47] GeoLAM: Learning Geometry-Grounded Latent Actions from Unlabeled Human Videos cs.CV | cs.ROPDF

Yifan Xie, Hekun Tian, Jinkun Liu, YuAn Wang, Qiao Sun

TL;DR: GeoLAM从无动作标签的人类视频学习几何接地潜在动作，用冻结几何特征层级重建未来帧，并以仅训练阶段使用的4D几何教师监督3D位移、残余图像运动和表面朝向变化；学得表示再作为机器人世界—动作模型的状态转移目标。

Details

Motivation: 人类视频包含丰富操控经验，但从中提取保留有用运动信息的动作表示具有挑战性；仅靠视觉重建会将操控运动与外观变化、摄像机移动混在一起。需要从无动作标注视频中学习具有几何含义的连续潜在动作，并迁移到机器人示范。

Result: GeoLAM将冻结几何特征层级用于未来帧重建，并使用只在训练时存在的4D几何教师提供运动监督。教师预测经空间汇聚形成3D位移、残余图像平面运动和表面朝向变化目标；可见性和置信度加权减少不可靠估计的影响，使连续潜在动作保留几何运动信息，无需手部姿态或轨迹标注。完成无动作标签视频预训练后，表示作为转移目标用于基于带动作标签机器人示范训练的世界—动作模型；模型联合去噪潜在动作和可执行动作块，未来视频预测仅作为辅助训练目标。部署时不需要几何教师或未来视频生成。潜在动作基准及机器人操控任务上的评估显示GeoLAM表现较强。

Insight: 几何教师把无标注人类视频中的运动分解成结构化空间变化，减少潜在动作对外观和相机运动的混淆；教师仅参与训练，使部署过程保持轻量。摘要未报告具体基准分数、机器人任务名称或增益幅度。

Abstract: Human videos provide rich manipulation experience, but extracting action representations that preserve useful motion remains challenging. Visual reconstruction alone can entangle manipulation-related motion with appearance changes and camera movement. We present GeoLAM, a framework for learning geometry-grounded latent actions from action-free human videos. GeoLAM combines future-frame reconstruction through a frozen geometric feature hierarchy with motion supervision from a training-only 4D geometry teacher. The geometric representation provides a structural prior, while the teacher’s predictions yield spatially pooled targets capturing 3D displacement, residual image-plane motion, and surface-orientation changes. Visibility and confidence weighting reduces the contribution of unreliable estimates, encouraging continuous latent actions to retain geometric motion without explicit hand-pose or hand-trajectory annotations. After video pretraining without action labels, the learned representation provides transition targets for a world-action model trained on action-labeled robot demonstrations. The model jointly denoises latent actions and executable action chunks, with future-video prediction used only as an auxiliary training task. Deployment therefore requires neither the geometry teacher nor future-video generation. Evaluations on a latent-action benchmark and robotic manipulation tasks demonstrate the strong performance of GeoLAM.

[48] Not Another Text Benchmark: Putting the “Visual” Back in Visual Question Answering for Large Video Models cs.CVPDF

Rwiddhi Chakraborty, Yinong, Wang, Cheng Zhang, Fan Bai

TL;DR: 该研究提出三个以视觉输入为核心的视频理解基准：时间帧检索、视频未来预测和因果记忆失真，用于补充以文本选项推理为主的现有大型视频模型评测；当前前沿模型在直接处理视觉查询时仍显著薄弱。

Details

Motivation: 大型视频模型在多种视觉问答基准上取得进展，但主流评测通过文本选项测量多选推理，主要反映文本推理能力，未必检验模型是否能基于视觉信息完成理解。作者提出将评测模态本身改为视觉。

Result: 论文介绍三项面向视觉的视频模型评测：时间帧检索、视频未来预测和因果记忆失真，旨在直接考查大型视频模型的视觉理解能力，并补充现有前沿模型视频理解评估。实验显示，当前前沿模型在处理视觉查询而非文本查询时存在明显弱点。作者还提供扩展分析，讨论后续改进视觉理解的方向；摘要未给出数据集规模、各模型得分或任务具体定义。

Insight: 文本选择题可能把视频理解评测变成对文本选项进行推理，无法完整测量模型基于视觉内容的能力；独立设计视觉模态任务有助于揭示这种评测盲区。摘要未提供量化分数，不能比较三个任务的难度或模型差异。

Abstract: Large video models have exhibited impressive performance on a wide range of visual question answering tasks, owing to the rise of powerful, pretrained text and vision encoders. The usefulness of such models have also been demonstrated on a wide range of benchmarks, with an important caveat - the dominant approach in these benchmarks evaluates multiple choice reasoning via text options. This is a natural way to test text-based reasoning in these models, and has led to significant insights regarding model behavior in the community. In this work, we ask a different question - what happens when the evaluation modality is visual, rather than text? We introduce three new vision-centric evaluation benchmarks in temporal frame retrieval, video future prediction, and causal memory distortion, all designed around evaluating visual understanding capabilities in large video models. Our approach complements the existing approaches to evaluate video understanding in frontier models. We show that current frontier models exhibit significant weakness when attempting to reason through visual queries, rather than text. We conclude with an extended analysis section that provides pointers for future improvements in visual understanding for large video models.

[49] Predicting Human Disagreement for Calibrated Dynamic Facial Expression Recognition cs.CVPDF

Yiming Wang, Frederick W. B. Li, Jingyun Wang

TL;DR: 该动态面部表情识别方法直接以标注者计数向量和Dirichlet—多项式似然建模人类分歧，并预测样本歧义以支持选择性弃答；在DFEW上保持识别准确率的同时ECE降低30%、AURC降低15%，歧义预测与测试标注熵相关系数为0.52。

Details

Motivation: DFEW等动态面部表情基准为每段视频提供多个标注者投票，但大多数模型将它们压缩为多数标签，无法在推理时表达人类意见分歧，也难以对模糊样本进行校准或选择性预测。

Result: 方法直接使用原始标注者计数向量训练Dirichlet—多项式似然，区别于只拟合均值的软标签目标：它在保持预测均值的同时，对Dirichlet浓度提供尺度敏感的监督。独立歧义头预测未见视频片段的标注熵；单调Chow式拒答规则结合预测歧义、认知空缺、时间不稳定性和输入质量进行选择性预测。DFEW上方法保持表情识别准确率，同时将期望校准误差ECE降低30%、风险—覆盖率面积AURC降低15%；预测歧义与测试片段标注熵的Spearman相关为0.52。校准和选择性预测收益迁移到FERV39k，并在按身份和电影隔离的DFEW划分下保持。

Insight: 保留完整标注分布能同时表示多数类别和人类分歧程度，适合表达情绪标签内在歧义；歧义估计再用于决定何时拒答。准确率保持与校准改善并存，但摘要未报告各数据集的绝对准确率和拒答覆盖率。

Abstract: Dynamic facial expression recognition (DFER) benchmarks such as DFEW provide multiple annotator votes per clip, yet most models collapse them to a majority label and cannot represent human disagreement at inference time. We propose a disagreement-aware DFER framework that trains directly on the raw annotator count vector using a Dirichlet-Multinomial likelihood. Unlike mean-only soft-label objectives, the proposed likelihood provides scale-sensitive supervision for the Dirichlet concentration while preserving the predictive mean. A separate ambiguity head predicts annotation entropy for unseen clips, and a monotone Chow-style reject rule combines predicted ambiguity, vacuity, temporal instability, and input quality for selective prediction. On DFEW, the method preserves recognition accuracy while reducing ECE by 30% and AURC by 15%, and predicted ambiguity reaches a Spearman correlation of 0.52 with the annotation entropy of test clips. The calibration and selective-prediction gains transfer to FERV39k and remain under identity- and movie-disjoint DFEW splits.

[50] Event-based Selective Attention for Multi-resolution Fast Region of Interest (ROI) Detection cs.CV | cs.NEPDF

Luca Peres, Giulia D’Angelo, Chiara Bartolozzi, Oliver Rhodes

TL;DR: 该工作提出直接在低分辨率事件流上运行的免训练、多尺度显著性自底向上注意模型，用于边缘端快速ROI选择；Prophesee Automotive测试可将输入最高下采样256倍，检测多类目标最高准确率70.8%，时间分辨率达到毫秒级、比真值标注细16倍。

Details

Motivation: 神经形态视觉系统在边缘环境面临带宽、内存和能耗约束，需要在数据处理早期就进行筛减和选择性分析。事件流下采样可降低输入量，但需验证目标ROI能否仍被可靠发现。

Result: 作者评估一种免训练、多尺度、显著性驱动的自底向上注意模型，直接处理低分辨率事件输入并选择场景ROI。实验对输入事件流使用多种下采样倍率，分辨率相对原始输入最高降低256倍，并在公开的大规模Prophesee Automotive真实场景数据集上评测。模型可检测多种目标ROI，包括不同车辆、行人、交通灯和交通标志，准确率最高70.8%；其处理时间分辨率为毫秒级，比数据集真值提供的时间分辨率细16倍。

Insight: 早期事件降采样与显著性注意结合，可在减少边缘计算输入量的同时保留对多个交通目标的关注，适合作为更复杂视觉系统的前端。摘要未说明256倍下采样时的单独精度、能耗或运行延迟。

Abstract: Neuromorphic vision systems operate under strict constraints on bandwidth, memory, and energy, particularly at the edge, motivating early mechanisms for data reduction and selective processing. In this work, we investigate a multi-scale training-free, saliency-based, bottom-up visual attention model that operates directly on low-resolution event-based input and selects Regions of Interest (ROI) from the visual scene. The model is evaluated across multiple downscaling factors applied to the incoming event stream, with input resolutions reduced by up to 256x relative to full resolution. Performance is assessed on the Prophesee Automotive dataset, the largest publicly available event-based dataset, demonstrating robust ROI selection across different scales on a real-world use-case. The proposed approach is capable of detecting ROIs belonging to multiple object classes, including various vehicle types, pedestrians, traffic lights, and traffic signs, with accuracy up to 70.8%, while operating at millisecond temporal resolution, 16x finer than the temporal resolution provided by the dataset ground truth. These results highlight the potential of combining early event downscaling with saliency-based attention as an effective front-end for efficient edge neuromorphic vision systems.

[51] ResLRP: The Role of Residual Cancellation in Attribution Instability in Vision Transformers cs.CV | cs.AI | cs.LGPDF

Jim Berend, Reduan Achtibat, Daniel Schäffer, Alexander Binder, Wojciech Samek

TL;DR: ResLRP指出视觉Transformer归因不稳定源于残差路径抵消造成的相关性爆炸，并提出显式处理残差分支抵消的守恒LRP规则；跨多类ViT和FunnyBirds评估中改善忠实度与定位，VLM上定位提升27%–29%、忠实度最高达3.4倍。

Details

Motivation: 视觉Transformer广泛应用，但要获得细粒度、忠实且稳定的输入归因仍有困难。将层级相关性传播LRP适配到注意力后，ViT解释常出现噪声和不忠实现象，传统方法没有充分处理残差连接的影响。

Result: 作者发现残差通路中的抵消会导致归因爆炸，且这种抵消在ViT中比语言Transformer更强。提出ResLRP，在传播规则中显式考虑残差分支抵消，保持精确守恒并从理论上限制相关性爆炸。因果通道级干预确认不稳定源自残差抵消，而非一般正则化效应。方法在监督、自监督、对比、层级和多模态等多类ViT架构，以及真值可控的FunnyBirds基准上改善归因忠实度和定位质量。收益在现代VLM上最大，定位提升27%–29%，忠实度最高提高3.4倍。ResLRP还可将稀疏自编码器特征定位到输入空间；作者提出残差放大指标作为可预测归因退化位置的架构级诊断量。

Insight: 残差连接不仅影响前向表示，也可能使归因传播中的贡献相互抵消并放大噪声；传播时显式建模这一机制能改善解释。最大收益来自现代VLM，摘要未列具体忠实度指标定义和各架构结果。

Abstract: Vision Transformers (ViTs) are central to most modern vision models, yet obtaining input attributions that are fine-grained, faithful, and stable remains challenging. Layer-wise Relevance Propagation (LRP) has been adapted to transformer attention, but in ViTs it often produces noisy, unfaithful explanations. We show that the missing ingredient is the treatment of residual connections: cancellation effects in residual pathways lead to attribution explosion. Moreover, we find that these cancellations are substantially stronger in ViTs than in language transformers. To address this issue, we introduce Residual-aware Layer-wise Relevance Propagation (ResLRP), a simple extension of LRP whose propagation rules explicitly account for cancellations in residual branches, are exactly conservative, and provably bound relevance explosion. Causal channel-wise interventions confirm that residual cancellation, not a generic regularization effect, drives the instability. ResLRP substantially improves attribution quality across faithfulness and localization, evaluated on ViT architectures spanning supervised, self-supervised, contrastive, hierarchical, and multimodal families, as well as on the ground-truth-controlled FunnyBirds benchmark. The largest gains arise in modern Vision Language Models (VLMs), with +27-29% localization and up to 3.4x faithfulness scores. Beyond benchmarks, ResLRP localizes Sparse Autoencoder (SAE) features in input space, and our residual amplification measure serves as an architecture-level diagnostic predicting where attribution degrades.

[52] MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis cs.CV | cs.AIPDF

Anna Oliveras, Roger Marí, Rafael Redondo, Oriol Guardià, Cynthia Ifeyinwa Ugwu

TL;DR: MUMINS以条件扩散在单次反向过程中联合生成医学随访影像和空间不确定性图，通过逐步注入基线扫描作为软锚点保持解剖细节，并以负对数似然头标记易出错区域；在肺CT和脑MRI上匹配或超过专用先进方法。

Details

Motivation: 肿瘤生长和神经退行等解剖变化预测是困难的生成视觉任务：形态变化相对静态解剖很细微、患者差异大且具有随机性。确定性网络忽略生物随机性，传统扩散模型需多次采样才能估计不确定性，计算成本过高。

Result: MUMINS在一个扩散框架中联合扩散基线扫描及其随访残差，通过相加合成随访扫描，同时预测空间不确定性图，整个过程只需一次反向扩散。模型以时间间隔和相关元数据为条件，并在每个去噪步骤动态重注入基线扫描作为软锚点，以保留细节解剖；负对数似然预测头学习不确定性图，显式标示容易出错区域。架构不依赖器官特定启发式，通过针对不同数据集分别训练可复用于不同解剖部位。广泛评估显示，在肺CT（PNG）和脑MRI（OASIS-3）上，数据集专用微调的MUMINS达到或超过各领域专用先进方法。

Insight: 通过预测随访残差并将基线扫描持续作为软约束，可减少细微纵向变化生成中解剖漂移；联合空间不确定性图也使模型指出不可靠区域。摘要未提供具体成像质量、不确定性校准指标或相对基线分数。

Abstract: Forecasting anatomical changes such as tumor growth and neurodegeneration is a challenging generative vision task. Morphological evolution is subtle relative to static anatomy, highly patient-specific, and inherently stochastic. Existing methods struggle with several issues: deterministic networks ignore biological stochasticity, while standard diffusion models require computationally prohibitive multi-pass sampling to quantify uncertainty. We propose MUMINS (Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis), an efficient diffusion framework that jointly diffuses a baseline scan and its follow-up residual, summed to synthesize the follow-up scan, while concurrently predicting a spatial uncertainty map, in a single reverse diffusion process. Conditioned on the time interval and relevant metadata, it preserves fine-grained anatomy by dynamically re-injecting the baseline as a soft anchor at every denoising step, and a negative-log-likelihood head learns the uncertainty map to explicitly flag error-prone regions. Designed without organ-specific heuristics, the same architecture is reused across anatomies via separate, dataset-specific retraining. Extensive evaluations demonstrate that dataset-specific retraining of MUMINS matches or outperforms dedicated, domain-specific state-of-the-art methods on lung CT (PNG) and brain MRI (OASIS-3). Project page: https://github.com/aolivtous/MUMINS.

[53] Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM cs.CV | cs.AIPDF

Ahmed Ammar Kubba, Manar Abu Talib, Iman Ibrahim, Qassim Nasir

TL;DR: 该工作用CLIP图文联合嵌入和K-Means聚类分析阿联酋传统住宅建筑风格，再以人工检查的聚类标签训练SVM；在八个风格簇上的分类准确率为98%，目标是为非西方建筑遗产提供可扩展、可解释的多模态分析工具。

Details

Motivation: 建筑遗产风格分析受建筑图像复杂、传统CNN方法偏重视觉特征以及非西方地区专用数据集不足影响。文本描述和视觉图像可提供互补信息，但需要一种结合两者的分类流程。

Result: 研究使用OpenAI CLIP将阿联酋住宅建筑图像特征与专家文本描述特征整合为512维嵌入，随后用UMAP降维可视化，并用K-Means进行无监督聚类。研究者人工分析聚类后确定簇标签，再以这些标签训练SVM完成自动建筑风格分类。方法识别出八种风格簇，分类准确率98%，作者称高于文献中的其他研究。论文强调该多模态框架可支持建筑遗产分析，并提供可扩展、可解释的区域建筑身份探索工具。

Insight: 将专家文本描述和建筑图像嵌入同一CLIP空间，再结合聚类和分类，可用于探索区域性建筑风格；标签来自人工解释聚类而非既有标准类别，准确率受聚类及标注流程影响。摘要未说明数据规模、独立测试划分或与文献比较的统一协议。

Abstract: The analysis and classification of cultural heritage architectural styles remain challenging due to the complexity of visual images of buildings, which are highly relied on in traditional CNN-based classification approaches in comparison to textual descriptions, and the relative lack of non-western region-specific datasets. This paper addresses this gap by proposing a multimodal machine learning framework to analyze and classify Emirati residential architecture using OpenAI’s CLIP model. We integrate visual features from images and textual features from expert descriptions into a unified 512-dimensional embedding, followed by dimensionality reduction with UMAP for visualization and unsupervised clustering using K-Means. Cluster labels, which are derived from manual analysis of the K-Means clusters, are used to train an SVM classifier for automated architectural style classification. Our approach achieves a classification accuracy of 98% across eight identified style clusters, higher than every other study in the literature, demonstrating the effectiveness of combining visual and textual modalities. Overall, this paper highlights the potential of using multimodal AI to support architectural heritage analysis, offering scalable and interpretable tools for exploring regional architectural identities.

[54] Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection cs.CVPDF

Jiawei Gu, Qilin Zhao, Tengkuo Guo, Zhiming Zhong, Shuangqing Zhang

TL;DR: Probe-VAD从冻结VLM读取十个有序严重度阈值上的YES/NO续写似然，将其累积成连续异常分数并用保序投影确保单调；在公开无训练视频异常检测基准上取得更好表现，且计算开销较低。

Details

Motivation: 视频异常检测需在未剪辑长视频中定位异常事件。VLM可提供丰富视觉理解，但字幕流程会把视觉证据压缩成文本并丢失细微线索，直接生成数值分数又把判断限制在少量预设值，难以区分异常严重程度并形成细致排序。

Result: Probe-VAD提出序数二元探测框架，直接使用冻结VLM处理原始视频片段，依次询问十个有序严重度阈值，并提取受约束的“是/否”续写似然。归一化后得到累积严重度曲线，再汇总尾部证据生成连续异常分数，并通过等距保序投影保证分数符合序数一致性。公开VAD基准实验显示，方法以较低计算开销取得优于现有方法的表现，无需任务特定训练或字幕压缩。摘要未列数据集名称、指标数值或推理时长。

Insight: 从模型对多个有序阈值的相对判断中恢复连续严重度，比直接要求输出单一离散分数更能保留排序信息；单调投影再约束阈值响应的一致性。摘要未给出基准和数值，无法量化优势或计算成本。

Abstract: Video anomaly detection (VAD) aims to localize anomalous events in untrimmed videos. Vision-language models (VLMs) provide rich visual understanding for training-free VAD, but existing approaches impose restrictive interfaces between visual understanding and anomaly scoring. Caption-based pipelines compress visual evidence into text, potentially discarding subtle cues, while direct numerical generation forces the model to express its judgment through a small set of predefined scores. Such interfaces can obscure subtle differences in anomaly severity, causing visually distinct clips to receive similar representations or scores and thereby limiting the resolution of anomaly ranking. We propose \textbf{Probe-VAD}, an ordinal binary-probing framework that directly probes severity preferences from a frozen VLM. Given raw video clips, Probe-VAD queries ten ordered severity thresholds and extracts constrained \textit{YES}/\textit{NO} continuation likelihoods. Their normalized preferences form a cumulative severity profile, from which tail evidence is aggregated into a continuous anomaly score, with isotonic projection enforcing ordinal consistency. Experiments on public VAD benchmarks demonstrate superior performance with low computational cost. Probe-VAD provides a simple interface for translating frozen VLM visual understanding into continuous, rank-sensitive anomaly scores without task-specific training or caption-based compression. Code is available at: https://github.com/yvestine/COVAS-VAD.

[55] FROD: Feature Matching Residual Denoising Oracle Bone Decipher cs.CV | cs.AIPDF

Yanbin Hou, Biao Xiong, Guojun Xu, Jianwen Xiang, Cheng Tan

TL;DR: FROD把甲骨文辅助释读建模为跨时代图像翻译，利用快速特征匹配对相似字对进行部件级分块监督，对低相似字对采用整体训练以避免错配，并用残差去噪扩散及多阶段字体精修稳定笔画；字符隔离增强数据集上Top-1准确率比OBSD高3.8个百分点。

Details

Motivation: 甲骨文是早期汉字体系，对汉字词源研究重要。传统释读依赖专家结合语义上下文和字形演化进行分析，过程费时；虽然古今文字形态差异大，但部分部首层面仍保留局部拓扑不变量，可用于辅助跨时代释读。

Result: FROD将甲骨文释读辅助视作跨时代图像翻译。训练时用快速特征匹配提供门控分割监督：匹配充分的样本按图块对齐细粒度部首，低相似样本则整体训练以避免错配伪影。残差去噪扩散模型同时估计噪声和残差，降低标准扩散常见的位置漂移和笔画紊乱；多阶段字体风格精修网络进一步去除边缘噪声、稳定笔画结构。在经过增强且按字符隔离划分的数据集上，FROD的Top-1识别准确率高于受测基线，比OBSD高3.8个百分点。

Insight: 基于匹配置信度选择部件级或整体监督，可避免把外观差异较大的古今字符错误强行对齐；残差建模和字体精修再处理几何漂移与笔画噪声。摘要未给出数据规模、绝对准确率和跨书体泛化结果。

Abstract: Oracle bone script (OBS), one of the earliest Chinese writing systems, plays an important role in the study of Chinese etymology. Traditional decipherment relies heavily on domain experts who analyze characters through semantic context and structural evolution. To assist this labor-intensive process, we formulate OBS decipherment assistance as a cross-era image translation task and propose FROD (Feature Matching Residual Denoising Oracle Bone Decipher). Although many OBS characters differ substantially from their modern counterparts, they often preserve local topological invariants at the radical level. During training, FROD leverages fast feature matching to provide gated segmentation supervision: paired samples with sufficient matches are processed patch-wise to align fine-grained radicals, whereas low-similarity pairs are trained holistically to avoid mismatched artifacts. In addition, a Residual Denoising Diffusion Model (RDDM) jointly estimates noise and residual signals, thereby reducing the positional drift and stroke disorder commonly observed in standard diffusion models. Finally, a multi-stage font stylization refinement network refines the generated images by eliminating edge noise and stabilizing stroke structures. On our augmented character-disjoint dataset, FROD achieves higher Top-1 recognition accuracy than the evaluated baselines, with a 3.8% absolute gain over OBSD.

[56] DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming cs.CVPDF

Idil Sulo, Alexey Supikov, Ilke Demir, Sainan Liu

TL;DR: DecoGS针对流式视频3D高斯重建提出自适应静动态解耦，仅优化发生运动或光度变化的时空区域，并通过梯度门控及可见性筛选减少静态区域闪烁和漂移；在N3DV与MeetRoom上PSNR为34.55和31.60 dB，261 FPS且时间闪烁比最佳先前方法低70倍。

Details

Motivation: 流式3D重建要兼顾速度和时间保真，但现有方法每帧更新所有高斯，包括静态区域，造成冗余计算，并可能使静态部分出现闪烁和漂移。

Result: DecoGS面向输入流式视频的在线3D高斯训练，按时空变化自适应选择优化区域，优先处理运动或光度变化部分，避免对名义静态区域反复无谓更新。流程通过梯度门控和高效可见性筛选进行区域感知的高斯管理，维持时间连贯性并控制内存规模。N3DV和MeetRoom上的PSNR分别为34.55和31.60 dB，超过所有比较的流式及离线基线；渲染速度为261帧/秒，时间闪烁比最佳先前方法低70倍，无需大规模预训练。

Insight: 静态区域全量更新会浪费流式训练预算并引入视觉漂移，因此应把优化集中到真实发生变化的位置；区域门控同时支持速度、画质和时间稳定性。摘要未报告设备配置、每帧优化时间或内存规模，70倍闪烁改善也依赖其指标定义。

Abstract: Streaming 3D reconstruction demands both speed and temporal fidelity, goals that existing methods undermine by updating every Gaussian every frame, even in static regions. We present DecoGS, a method for efficient online training of 3D Gaussians from streaming videos. Unlike prior methods that update the entire scene indiscriminately, DecoGS introduces an adaptive mechanism that selectively focuses optimization on spatiotemporal regions exhibiting motion or photometric changes. This targeted training strategy eliminates redundant updates that cause flickering and drift in nominally static regions, while enabling fast, high-fidelity scene updates. The pipeline further integrates region-aware Gaussian management through gradient gating and efficient visibility filtering to maintain temporal coherence and a compact memory footprint. On N3DV and MeetRoom, DecoGS achieves 34.55 and 31.60 dB PSNR respectively, outperforming all streaming and offline baselines, while rendering at 261 FPS with $70\times$ lower temporal flicker than the best prior method, requiring no large-scale pretraining.

[57] Video-HolmesV2: Can MLLMs Reason with Spatio-Temporal Audio-Visual Evidence in Long Videos? cs.CVPDF

Zhaoyang Wei, Zipeng Wang, Yushe Cao, Chenhui Qiang, Shuaibing Cheng

TL;DR: Video-HolmesV2是面向长视频时空音视频推理的基准，要求答案引用精确时空音视频证据，并提出多模型交叉验证、时空证据感知指标及音频文本引导token压缩；实验中强专有模型准确率仍低于60%，所提方案优于可比开源全模态模型。

Details

Motivation: 多模态大语言模型在视频理解上进步显著，但长篇叙事推理常被偏视觉评测和低效上下文处理掩盖。现有基准过度依赖视觉线索而忽视音频，密集抽帧又导致证据覆盖与注意干扰、token数量爆炸之间的权衡。

Result: Video-HolmesV2强调深度音视频耦合，并采用证据为本的评估，要求模型用精确时空音视频证据支撑答案，以降低猜测和幻觉证据造成的混杂。基准通过多模型交叉验证流程确保任务严谨性，并提出时空证据感知指标进行细粒度校准。作者还提出音频文本引导token压缩，将任务意图与音频锚点融合，保留高价值推理线索以减少长上下文噪声。评测中，即使强专有模型准确率也低于60%；所提方法超过可比开源全模态模型。摘要未提供准确率具体值、基准规模或压缩比例。

Insight: 长视频理解应要求模型指出何时、何处、由何种模态证据支持结论，而不只给出答案；音频锚点还可帮助筛选长上下文中的相关线索。基准结果显示能力仍有明显缺口，但摘要未列出与专有模型的完整对比或指标细节。

Abstract: Multimodal Large Language Models have demonstrated impressive video understanding, yet their ability to reason over long-form narratives is often masked by visual-centric evaluations and inefficient context processing. Existing benchmarks over-rely on visual heuristics while marginalizing auditory cues, effectively reducing models to “silent observers” that bypass genuine cross-modal reasoning. Moreover, standard dense sampling creates an evidence-context trade-off: increasing frames to capture evidence inevitably leads to attention distraction and token explosion. To bridge these gaps, we present Video-HolmesV2, a novel benchmark designed for Deep Audio-Visual Coupling. Unlike previous works, it enforces an Evidence-Based Evaluation, requiring models to justify answers with precise spatio-temporal audio-visual evidence, thereby reducing confounding effects of guessing and hallucinated evidence. To support this, we introduce: (1) a Multi-Model Cross-Verification pipeline to ensure task rigor; (2) a Spatio-temporal Evidence-Aware Metric for fine-grained calibration. Furthermore, we propose an Audio-Text Guided Token Compression framework. By fusing task intent with auditory anchors, our method distills high-value reasoning cues to mitigate long-context noise. In our evaluation, even strong proprietary models achieve below 60% accuracy, while our approach outperforms comparable open-source omni-models.

[58] Semantic-Spatial Agreement Verification for Mitigating Object Hallucination in Multimodal Large Language Models cs.CVPDF

Ziheng Ren, Qian Gao, Jun Fan, Guohui Ding, Zhenyu Yang

TL;DR: SSAV以语义等价问题下对象主张的稳定性和视觉区域定位一致性验证多模态模型对象陈述，结合跨查询语义支持、区域持续性、重叠和候选优势形成几何均值分数；LLaVA-1.5-7B在POPE两种设置的平均准确率分别提升1.81和3.17个百分点，CHAIRs由49.40%降至32.80%。

Details

Motivation: 多模态大语言模型会在图像中不存在对象时仍将其写入回答。在用药辅助、无障碍感知和环境决策等场景，这类视觉幻觉可能造成现实安全风险，因此需要无需训练、可解释的对象主张核验方法。

Result: Semantic-Spatial Agreement Verification（SSAV）基于一个原则：真正由图像支持的对象主张，应在语义等价的多个查询下保持稳定，并反复定位到同一图像区域。方法聚合多个提示估计语义支持，以降低对查询措辞的敏感度；Query-Induced Regional Verification（QIRV）结合跨查询区域持续性、空间重叠和相对候选优势，识别孤立高响应及分散定位。语义和空间两路证据用几何均值融合，任一路缺乏支持都会降低核验分数。在三个基础模型及多种评测协议上的实验显示，SSAV有效缓解对象幻觉。LLaVA-1.5-7B在COCO、A-OKVQA和GQA上的平均准确率，在POPE Popular和Adversarial分别提高1.81及3.17个百分点；CHAIRs从49.40%降至32.80%。

Insight: 模型对语义等价提问的稳定回答和一致空间定位可构成互补外部证据；几何均值让语义支持或区域定位任一环节失败时都能降低可信度。摘要未报告不同骨干的分项结果、额外推理成本及对象之外的幻觉类型。

Abstract: Multimodal large language models generate natural-language responses from visual inputs, yet may mention objects absent from an image. In medication assistance, accessible perception, and environmental decision-making, such hallucinations can create real-world safety risks. We propose Semantic-Spatial Agreement Verification (SSAV), a training-free method for verifying object claims. A visually grounded claim should remain stable across semantically equivalent queries and repeatedly localize to the same image region. SSAV aggregates multiple prompts to estimate semantic support and reduce sensitivity to query wording. Query-Induced Regional Verification (QIRV) combines cross-query region persistence, spatial overlap, and relative candidate dominance to identify isolated high responses and dispersed localizations. A geometric mean fuses semantic and spatial evidence, lowering the verification score when either branch lacks support. Experiments on three base models and multiple evaluation protocols show that SSAV effectively mitigates object hallucination. On LLaVA-1.5-7B, accuracy averaged across COCO, A-OKVQA, and GQA improves by 1.81 and 3.17 percentage points under POPE Popular and Adversarial, respectively, while CHAIRs decreases from 49.40% to 32.80%. These results show that cross-query semantic stability and regional consistency provide interpretable external visual evidence for object claims.

[59] SlotDiT: Object-Centric Representations for Diffusion Transformers cs.CV | cs.ROPDF

Gjergj Plepi, Sven Behnke

TL;DR: SlotDiT在对象中心slot潜空间中进行文本引导视频生成，用参考图像和指令分解场景对象，再自回归去噪未来slot轨迹；与VAE及语义对齐潜空间相比，视频质量有竞争力，并在四个机器人数据集上持续提高任务完成率。

Details

Motivation: 文本条件潜扩散模型擅长视频生成，也可能用于机器人，但像素或VAE潜表示缺少显式语义结构，其表示空间对生成和操控的影响尚未充分研究。对象中心slot能结构化分解场景，在动力学建模和规划中已显示优势，但此前尚未用于扩散生成。

Result: SlotDiT是一种在slot潜空间运行的文本引导扩散Transformer。给定参考图像和语言指令，模型将场景分解为各实体的对象中心slot，再根据指令和观察到的场景上下文，自回归去噪未来slot轨迹以预测场景动态。研究在统一DiT框架中比较slot、VAE及语义对齐潜表示。实验显示slot作为扩散潜变量时视频生成质量有竞争力，并在四个机器人数据集上持续提高任务完成率；紧凑表示也比VAE及语义对齐潜空间计算效率更高。

Insight: 对象中心结构为机器人视频生成提供有利归纳偏置，使动态预测围绕实体及其状态变化展开，而不是只在稠密像素或无结构潜空间中建模。摘要未列出四个数据集的名称、任务完成率数值或生成延迟。

Abstract: Text-conditioned latent diffusion models perform strongly in video generation and are promising backbones for robotic applications. However, existing approaches rely on pixel-level or VAE-based latent representations that lack explicit semantic structure, leaving the impact of the representation space largely unexplored. Slot-based object-centric representations offer a structured alternative by decomposing scenes into object-level latents, or slots. While they have shown success in dynamics modeling and planning, they have not yet been explored for diffusion-based generative modeling. We introduce SlotDiT, a text-guided Diffusion Transformer (DiT) that operates in a slot-based latent space. Given a reference image and a language instruction, SlotDiT decomposes the scene into object-centric slots representing individual entities. Conditioned on the instruction and observed scene context, the model autoregressively denoises future slot trajectories to predict scene dynamics. To systematically investigate latent-space design for diffusion transformers, we compare slot-based representations against VAE-based and semantics-aligned alternatives within a unified DiT framework. Our experiments show that using slots as DiT latents yields competitive video generation quality while consistently improving task-completion rates across four robotic datasets. Furthermore, their compact representation provides a computationally efficient alternative to VAE-based and semantics-aligned latent spaces. Overall, our results demonstrate that object-centric structure is a powerful inductive bias for diffusion-based generative modeling in robotic environments. The project page is available at https://slot-dit.github.io/.

[60] BrainFocus: EEG-Guided ROI Selection for Efficient Vision-Language Models cs.CVPDF

Yihui Peng, Guorui Lu, Qinyu Chen

TL;DR: BrainFocus用EEG分类器预测目标类别、YOLO定位对应区域，仅当二者置信度均达阈值时才将裁剪ROI送入VLM，否则处理整图；在Qwen3.5-VL 2B/4B/9B的杂乱场景VQA上准确率提升4.14–9.87个百分点，同时降低23%–39%的token量及FLOPs。

Details

Motivation: VLM处理杂乱大图成本较高，但问题往往只涉及少量区域。EEG可记录人类对视觉刺激的神经反应，为感兴趣区域提供语义线索；然而EEG视觉类别解码不够完美，若直接据此裁剪路由可能漏掉目标。

Result: BrainFocus结合EEG引导与视觉语言推理：EEG分类器预测目标类别，YOLO检测器定位匹配ROI；只有两个预测都通过置信度阈值时，VLM才接收裁剪区域，否则回退到整图输入。作者在EEG-ImageNet基础上构建40类基准，包含生成的杂乱图像和真实对象中心图像、目标ROI标注及600组英文视觉问答。Qwen3.5-VL 2B、4B和9B实验中，杂乱场景VQA准确率提高4.14–9.87个百分点；输入token及总token减少23.2%–39.4%和23.2%–39.3%，端到端FLOPs减少23.2%–39.5%。

Insight: 置信度门控使系统能在EEG语义解码可靠时利用窄区域节省计算，在不可靠时安全退回整图，因此无需假设脑信号分类完美。摘要报告多个模型规模上的准确率与效率收益，但未列出不同阈值下的回退比例或端到端延迟。

Abstract: Vision-language models (VLMs) achieve strong visual question answering (VQA) performance, but processing large cluttered images is computationally expensive when only a small region is relevant. Electroencephalography (EEG) signals, which capture human neural responses to visual stimuli, can provide a human-derived semantic cue about the region of interest (ROI). However, EEG-guided visual category decoding remains imperfect, making direct ROI routing unreliable. In this work, we propose BrainFocus, a reliable EEG-guided efficient VLM framework for VQA. An EEG classifier predicts a target category, and a YOLO detector localizes the matching ROI. The VLM receives the cropped ROI only when both predictions pass confidence thresholds; otherwise, it processes the full image. For evaluation, we build on EEG-ImageNet to construct a 40-class benchmark comprising generated cluttered images and real object-centric images, with target-ROI annotations and 600 English visual question-answer pairs. Across Qwen3.5-VL 2B, 4B, and 9B models, BrainFocus improves VQA accuracy by 4.14-9.87 percentage points (pp) on cluttered scenes while reducing input tokens and total tokens by 23.2%-39.4% and 23.2%-39.3%, and end-to-end floating-point operations (FLOPs) by 23.2%-39.5%. These results demonstrate that EEG can guide efficient VLM inference even when its semantic decoding is imperfect.

[61] Tables Decoded: DELTA for Structure, TARQA for Understanding cs.CV | cs.LGPDF

Jahanvi Rajput, Dhruv Kudale, Saikiran Kasturi, Utkarsh Verma, Ganesh Ramakrishnan

TL;DR: DELTA将表格识别拆为物理结构、逻辑结构和OCR，输出紧凑OTSL文本序列；基于这些序列微调的TARQA在WTQ表格问答和FinTabNetQA表格视觉问答分别提升9.3和9.2个百分点，并提供印地语TORQUE基准。

Details

Motivation: 表格理解包括结构重建和表格问答，当前方法多依赖VLM直接处理表格图像。结构化文本表示更易处理、与LLM衔接自然，也无需语言特定视觉编码器，因此可能更适合多语言文档。

Result: DELTA分别处理物理结构识别、逻辑结构识别和OCR，以准确抽取布局与内容，并用Optimised Table Structure Language（OTSL）紧凑统一编码单元格排列及文本。在FinTabNet、PubTabNet和PubTables-1M上的表格结构识别任务中，TEDS-Structure分数与先进方法相当。作者通过整理的印地语TORQUE基准检验非英语表格鲁棒性。基于OTSL序列微调的LLM TARQA在WTQ表格问答上提升9.3个百分点、在FinTabNetQA表格视觉问答上提升9.2个百分点；TORQUE上方法在所有VLM及DELTA+LLM变体中排名第二。代码、模型和基准公开。

Insight: 把表格转成统一结构文本能分离视觉结构识别与后续语言推理，减少多语言文档对视觉编码器的依赖；结构化表示也可直接用于LLM微调。摘要没有列出TEDS分数及问答基线的绝对性能。

Abstract: Table understanding is a core task in document intelligence, encompassing two key subtasks: table reconstruction and table visual question answering (TabVQA). While recent approaches predominantly rely on vision- language models (VLMs) operating on table images, we propose a more scalable and effective alternative based on structured textual representations. These representations are easier to process, align more naturally with LLMs, and eliminate the need for language-specific visual encoders, making them particularly suitable for multilingual documents. We present DELTA, which separates physical structure recognition, logical structure recognition, and OCR to extract both layout and content accurately. DELTA outputs tables in Optimised Table Structure Language (OTSL), a compact and unified format that encodes cell arrangements and textual content. On table structure recognition (TSR), DELTA achieves TEDS- Structure scores comparable with state-of-the-art methods across FinTabNet, PubTabNet, and PubTables-1M. We further establish its robustness on non-English tables through our curated Hindi benchmark, TORQUE. Building on this, we introduce TARQA, an LLM fine-tuned on OTSL sequences. Our approach yields gains of 9.3 p.p. on WTQ (TabQA) and 9.2 p.p. on FinTabNetQA (TabVQA), respectively. On TORQUE, our method ranks second among all VLMs and DELTA + LLM variants. We release our code, models, and benchmark at: https://github.com/Tihiitborg/Tables-Decoded

[62] PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control cs.CV | cs.AI | cs.GRPDF

Chuhao Chen, Peter Wonka, Chaoyang Wang, Chen Wang, Qiao Feng

TL;DR: PhysStream是可在生成中途接受控制的物理视频生成模型，用在线场景位置图和物体跟踪图构建结构记忆，并以稀疏速度增量控制多物体刚体运动；合成基准上FVMD降低33%、轨迹误差降低12%，野外比较中人类评审超过85%偏好该方法。

Details

Motivation: 视频生成交互控制正从粗粒度提示转向对动态场景的精细物理操纵。现有可控方法要么要求生成前提供完整控制计划，要么使用像素信号指定物体位置而非描述底层物理动态。

Result: PhysStream是物理接地的自回归图像到视频生成模型，利用此前生成帧在线推导的位置图和物体跟踪图作为结构化场景记忆；通过稀疏速度增量信号提供细粒度运动控制，使模型学习物理量及相应动力学。训练分两阶段：先用运动控制条件微调双向模型，再训练带结构化场景记忆的因果自回归模型以提高物理一致性。该方法支持对多物体桌面刚体场景进行生成中途交互控制，摘要称此前方法不支持该能力。在合成基准上，较最强基线的运动分布距离FVMD降低33%、轨迹误差降低12%；野外比较中，超过85%的人类评审偏好PhysStream。

Insight: 用速度增量而非直接位置命令控制视频生成，能让用户在生成过程中修改物理运动，同时结构记忆维持对象及其轨迹的连续性。野外偏好和合成指标反映不同证据，摘要未列场景规模、控制延迟或评审人数。

Abstract: Interactive control for video generation is moving from coarse prompts toward fine-grained, physically meaningful manipulation of dynamic scenes. Yet existing controllable methods either require the full control schedule before generation starts, or use pixel-space signals that dictate object positions rather than physical dynamics. To address these limitations, we propose PhysStream, an autoregressive model for physics-grounded image-to-video synthesis that incorporates structured scene memory—positional maps and object tracking maps derived online from previously generated frames—and supports fine-grained motion control via sparse velocity-increment signals that encode physical quantities, letting the model learn the underlying dynamics. We train our model in two stages: a bidirectional model is first finetuned with motion-control conditioning, then a causal autoregressive model is trained with additional structured scene memory, further improving physical consistency. PhysStream enables interactive, mid-generation control over multi-object tabletop rigid-body scenes—a capability not supported by prior methods—reducing motion distribution distance (FVMD) by 33% and trajectory error by 12% over the strongest baselines on synthetic benchmarks, and is preferred by human evaluators in over 85% of in-the-wild comparisons. Please check our website for more details: https://czzzzh.github.io/PhysStream

cs.CL [Back]

[63] Crash Narrative-Guided Countermeasure Recommendation Using Large Language Models: A Retrieval-Augmented Generation Framework for Intersection Safety cs.CL | cs.LGPDF

Abu Saif Md Nasim Uddin, Mohamed Abdel-Aty, Zubayer Islam, Parvez Anowar, Chenzhu Wang

TL;DR: 该研究构建叙事驱动的交叉口事故对策RAG框架，从事故描述提取机制并结合历史相似路口、关联规则、统计约束和工程推理推荐现场措施；在佛罗里达312起严重事故、115个路口的五折交叉验证中F1为0.82。

Details

Motivation: 改善交叉口安全需要识别事故机制并选择合适对策，传统流程依赖专家判断，耗时且难以规模化。事故叙事包含丰富机制信息，但非结构化文本在交通安全分析中尚未被充分利用。

Result: 框架从事故叙事提取交通控制、信号指示、驾驶员责任、车辆运动及行驶方向等机制属性，并将其连接到FHWA已验证安全对策和CMF Clearinghouse中的证据措施。系统融合相似历史路口的嵌入检索、关联规则挖掘、相关对策预期数量的统计指导，以及引导LLM遵循领域决策流程的工程推理。在佛罗里达Lake和Sumter县115个路口的312起致死或严重伤害事故上进行五折交叉验证，精确率0.82、召回率0.85、F1为0.82；每地点平均推荐3.91项措施，其中3.14项匹配，接近实际平均3.86项。

Insight: 把事故叙事转成结构化机制，再结合证据库、历史案例和工程约束，有望提供可解释且可扩展的交通安全决策支持。评估覆盖312起严重事故，但摘要没有给出人工专家基线、推荐对真实事故的因果效果或不同路口上的分层结果。

Abstract: Improving safety at intersections requires identifying crash mechanisms and recommending appropriate countermeasures. However, this process traditionally relies on expert judgment, making it labor-intensive, difficult to scale, and dependent on the availability of experienced traffic safety engineers. Although crash narratives contain rich description of crash mechanisms, this unstructured information remains largely underutilized in safety analyses. This study presents a crash narrative-guided retrieval-augmented generation (RAG) framework that translates narrative-derived crash mechanisms into site-specific countermeasure recommendations. Key mechanism attributes including traffic control, signal indication, driver fault, vehicle movement, and travel direction were extracted from crash narratives and linked to evidence-based treatments from the FHWA Proven Safety Countermeasures and the CMF Clearinghouse. The framework integrates embedding-based retrieval of historically similar intersections, association-rule mining, statistical guidance on the expected number of relevant countermeasures, and an engineering reasoning guidance that directs LLM through a domain-consistent decision process before selecting countermeasures. Evaluated on 312 fatal and serious-injury crashes across 115 intersections in Lake and Sumter Counties, Florida, using five-fold cross-validation, the framework achieved a precision of 0.82, recall of 0.85, and F1-score of 0.82, while recommending an average of 3.91 countermeasures per location with 3.14 matching, closely matching the actual average (3.86). Overall, the proposed framework demonstrates the potential of retrieval-augmented LLMs as an interpretable and scalable decision-support tool for transportation agencies for translating crash narratives into countermeasure recommendations.

[64] Self-reported archetypes and behavioral failures in Large Language Models cs.CL | physics.soc-phPDF

Tabia Tanzin Prama, Calla Glavin Beauregard, Christopher M. Danforth, Peter Sheridan Dodds

TL;DR: 该研究让22种闭源和开源LLM对464组双极性人格特质自评，并映射到六维原型空间；闭源模型的自我画像呈较连贯的人类化结构，开源模型更分散矛盾，但自述品格与实际行为仍有明显落差。

Details

Motivation: 大型语言模型表现出稳定的顺从、抵抗和错误倾向，但其“性格”结构尚不明确。仅看模型行为无法区分其自我表征与外在行为，也需要研究开发者规范描述与实际失效之间是否一致。

Result: 作者分析22种LLM，包括多个闭源前沿系统及Llama、DeepSeek、OLMo、Qwen等开源模型。每个模型对464组双极语义差异特质进行自评，再映射到依据2,000个虚构人物众包评分形成的六维原型空间。闭源模型自评特质与人类评定虚构人物的经验共现结构一致，呈现由英雄、天使、传统主义者和极客四个重复维度构成的相对连贯人类化自我表征，近似角色包括Data、Vision和Janet。开源模型结构较弱、噪声更大且内部矛盾，分布在较弥散区域。将自评与开发者宪章对照可见自述和行为之间的落差：幻觉削弱其精确性主张，谄媚使善意主张复杂化，智能体失效又与服从主张相冲突。

Insight: 模型自评不应被当成中立的人格测量，而应视作与模型行为同样受优化过程塑造的结构化输出；自述特质不能代替对幻觉、谄媚和智能体失效的行为审计。原型空间来自虚构人物评分，自评结果的解释依赖该框架，摘要未报告重复测量或人格量表效度。

Abstract: Every large language model (LLM) has behavioral traits and moral preferences that comprise its character. Whether by design or as an emergent property of training, these systems exhibit persistent dispositions that shape how they interact, comply, resist, and err, yet the structure of LLM character remains poorly understood. We map the self-reported personality archetypes of 22 LLMs spanning closed-source frontier systems (GPT-4.0-5.2, Grok-3/4, Gemini 2.5 Pro/Flash, Claude Sonnet 4.5/4.6) and open-source models (Llama, DeepSeek, OLMo, and Qwen series). Each model self-rated across 464 bipolar semantic-differential trait pairs, and the resulting profiles were projected into a six-dimensional archetypal space derived from crowd-sourced ratings of 2,000 fictional characters using the Archetypometrics framework. Closed-source models’ self-rating traits align with the empirical trait co-occurrence structure of human-rated fictional characters, suggesting coherent, human-like self-representations organized around combinations of four recurring archetypal dimensions: Hero, Angel, Traditionalist, and Geek. Their closest analogues include Data, Vision, and Janet. Open-source models show weaker, noisier, and internally contradictory self-representations, occupying a diffuse region of archetype space with weak structure. Cross-referencing self-reported profiles with developer constitutions reveals a consequential gap between claimed character and enacted behavior: hallucination undermines claimed precision, sycophancy complicates claimed kindness, and agentic failures contradict claimed obedience. These self-ratings should therefore be interpreted not as neutral measurements of model character, but as structured outputs of the same optimization processes that shape model behavior. This work provides a reproducible, character-grounded framework for evaluating what LLMs are, not just what they do.

[65] ViCo: Visual-oriented Coding with Self-Reflection for Chart Replication cs.CL | cs.GR | cs.LGPDF

Jiaxin Duan, Dian Jiao Shuai Zhao, Jiabing Leng, Yiran Zhang, Feng Huang

TL;DR: ViCo通过迭代自反思让代码智能体逐步对齐生成图表与参考图像：先用一致性剪枝的MCTS合成高质量反思轨迹，再以反事实基线缓解多步强化学习的奖励稀疏，并用层级异构布局图评估风格、布局和语义；8B模型在三个基准上接近具备充分反思能力的专有LLM。

Details

Motivation: 代码智能体虽能生成结构良好的文本和代码，但图表常缺乏人工作品的风格和语义保真。具备自反思机制的编码智能体视觉推理和反思跟进能力仍弱，导致反馈奖励稀疏，难以有效进行强化学习。

Result: ViCo提出面向视觉的图表复现训练框架，以多轮反思逐步缩小生成图像与参考图之间的差异。自监督预热阶段在蒙特卡洛树搜索中加入一致性剪枝，合成高质量反思轨迹，并约束每个编码步骤严格遵循此前反思结果。之后使用多步强化学习，并通过反事实基线分别估计每轮细化中的反思与动作优势，以缓解奖励稀疏。为大规模训练提供奖励，作者构建自动多维评估框架，借助层级异构布局图评估图表风格、布局和语义一致性。在三个公开基准上，8B模型训练的ViCo达到具备足够反思能力的专有LLM附近的表现。

Insight: 图表复现需要视觉反馈能逐轮影响后续代码，而不是一次性评价最终图像；高质量反思轨迹和反事实优势估计针对这一闭环训练难点。摘要没有列出三个基准名称及分数，也未定义“具备充分反思能力”的专有模型范围。

Abstract: This paper addresses the challenge of generating high-quality academic charts that match the visual standards of human-authored papers. While existing AI agents can produce well-structured text and code, their generated visualizations often lack the stylistic and semantic fidelity of human designs. Advanced coding agents that employ self-reflection mechanisms exhibit poor visual reasoning and limited reflection following, resulting in sparse reward signals that severely undermine their reinforcement learning (RL). We propose ViCo, a training framework for visual-oriented coding that employs iterative reflections to align generated chart images progressively with the reference. We first introduce a self-supervised warm-up stage, which augments Monte Carlo Tree Search with consistency-based pruning to synthesize high-quality reflection trajectories, ensuring that each coding step strictly follows the outcomes of prior reflections. A multi-step RL algorithm is then developed, using counterfactual baselines to estimate advantage for reflection and action steps within each refinement cycle, thereby addressing the reward sparsity. To enable efficient reward in massive training, we propose an automatic, multifaceted evaluation framework that assesses charts’ style, layout, and semantic consistency via a hierarchical heterogeneous layout graph structure. Experiments on three public benchmarks demonstrate that ViCo, trained on an 8B model, achieves performance close to proprietary LLMs with adequate reflection capabilities.

[66] Retrieval-Driven Memory Reconsolidation for Long-Term LLM Agents cs.CL | cs.AIPDF

Yuanyi Song, Yukai Wang, Xinbei Ma, Zhihui Fu, Jianghao Lin

TL;DR: REALM把长程LLM智能体记忆视为持续生命周期：构建异构认知图、用自适应图搜索原子检索证据，并根据检索反馈持续重整记忆；在LoCoMo和LongMemEval上分别达75.97%和65.11%，超过最强基线7.17和1.31个百分点。

Details

Motivation: 长程交互智能体需要长期记忆，但多数系统只在新信息到达时更新记忆，把检索视为记忆访问的终点，未利用检索反馈持续重组未来可用的内容；同时固定记忆结构和检索流水线也限制了自主组织能力。

Result: 受认知神经科学记忆再巩固机制启发，REALM将长期记忆建模为连续过程：自主把记忆组织为异构认知图，通过自适应组合的图搜索原子检索证据，并根据检索反馈持续重整记忆。在LoCoMo上平均准确率为75.97%，在LongMemEval上为65.11%，分别超过最强基线7.17和1.31个百分点。消融实验确认记忆再巩固持续提升性能；进一步分析显示，它会逐步把相关记忆单元组织成更连贯的局部结构，以便推理时联合回忆和利用证据。

Insight: 检索过程本身可提供哪些记忆相关、哪些应被重新组织的反馈，使长期记忆随使用而演化，而不只是随新信息增长。两个基准上的提升幅度不同；摘要未交代模型规模、记忆构建成本和检索延迟。

Abstract: Long-term memory is essential for LLM-based agents operating over extended interactions. Existing memory systems primarily update memory when new information arrives, treating retrieval as the endpoint of memory access rather than a driver of memory evolution. Consequently, retrieval feedback is rarely exploited to reorganize memory for future access continuously. Moreover, most existing approaches rely on predefined memory structures together with fixed retrieval pipelines, limiting the agent’s ability to organize and evolve its own memory autonomously. Inspired by memory reconsolidation in cognitive neuroscience, we propose \textbf{REALM}, a \textbf{r}econsolidation-\textbf{e}volution \textbf{a}gentic \textbf{l}ong-term \textbf{m}emory framework. It models long-term memory as a continual lifecycle by autonomously organizing memories into a heterogeneous cognitive graph, retrieving evidence via adaptively composed graph-search atoms, and continually reconsolidating memories based on retrieval feedback. REALM achieves an average accuracy of 75.97% on LoCoMo and 65.11% on LongMemEval, outperforming the strongest baselines by 7.17 and 1.31 points respectively. Ablation studies confirm that memory reconsolidation consistently boosts performance, with further analyses revealing that it progressively reorganizes related memory units into more coherent local structures for collective evidence recall and utilization during reasoning. These results suggest that retrieval-driven memory reconsolidation provides an effective mechanism for continually evolving long-term memory in LLM agents.

[67] State of Thought Enables Endogenous Reasoning cs.CL | cs.AIPDF

Zhiren Gong, Yikun Hou, Zihao Zeng, Ming Xiao, Chau Yuen

TL;DR: State of Thought（SoT）用冻结LLM内部信息传递提取紧凑推理状态，再以582参数控制器按状态激活有用的历史推理支持；在3个LLM、16个数据集上提升多类推理准确率，并减少62.6%生成token和44.6%端到端延迟。

Details

Motivation: 现有测试时推理依赖外部规定的推理程序，或在受约束搜索空间中进行昂贵扩展，限制泛化和效率。作者希望让模型内部推理状态决定推理如何展开，而不是依赖预先设计的token链或大规模搜索。

Result: SoT从模型内部信息传递中提取紧凑的动力学—几何状态，并在冻结骨干上训练一个582参数控制器，根据当前状态选择有用的历史推理支持，将推理视为依赖状态的证据处理过程。三个LLM、16个数据集上，定量、通用、符号与代码、长上下文推理准确率分别达到基线的1.34、1.62、1.76和2.51倍；生成token减少62.6%，端到端延迟降低44.6%。两个VLM规模、三个推理任务上，较推理基线平均准确率提高3.8个百分点；相较搜索方法，完成token少74.9%、延迟低73.5%。受限访问设置下，无训练/仅嵌入模式保留38.2%/36.5%的平均准确率增益；仅用轨迹判别，在三个API模型上评判一致率为84.1%。

Insight: 用内部状态路由历史证据，可将推理控制从显式搜索转为轻量条件激活，并在报告的任务上兼顾准确率与延迟。不同任务的增益倍率差异较大，且“38.2%/36.5%增益”的基准定义需结合正文确认；摘要未给出每类任务绝对分数。

Abstract: Test-time compute has emerged as a major approach to improving the capabilities of Large Language Models (LLMs). However, existing test-time reasoning paradigms rely heavily on externally imposed control, either through fixed reasoning programs or through costly expansion in constrained search spaces, limiting both generalization and efficiency. We propose State of Thought (SoT), a new reasoning paradigm that enables endogenous reasoning in LLMs, with the model’s internal reasoning state governing how reasoning unfolds. Concretely, SoT extracts a compact dynamics-geometric state from the model’s internal information transfer and uses a 582-parameter controller on frozen backbones to selectively activate historical reasoning support useful under the current reasoning state, framing reasoning as a state-conditioned process over evidence rather than an externally prescribed token chain. Across quantitative (1.34x), general (1.62x), symbolic-and-code (1.76x), and long-context (2.51x) reasoning on 3 LLMs and 16 datasets, SoT consistently improves mean-baseline accuracy while reducing generated tokens by 62.6% and end-to-end latency by 44.6%. Across 2 VLM scales and 3 reasoning tasks, it improves mean accuracy by 3.8 points over reasoning baselines, with 74.9% fewer completion tokens and 73.5% lower latency than search-based methods. Under constrained access, SoT retains 38.2%/36.5% mean accuracy gains in training-free/embedding-only settings, while trajectory-only judging reaches 84.1% agreement across 3 API models. Together, endogenous state-driven reasoning provides a generalizable and efficient alternative.

[68] Towards Scalable RLVR: Multimodal Instruction Following Data Synthesis and Distillation cs.CL | cs.LGPDF

Yirong Zeng, Zhang Sai, Yuxian Wang, Yutai Hou, Yufei Liu

TL;DR: MIFS是一套用于可验证奖励强化学习的多模态指令数据合成与蒸馏流程，通过生成约束、多模态可学习性过滤和代码验证器构建9万样本数据集；训练模型在四个基准平均提升8.13%，收敛快3倍，并保留核心视觉能力。

Details

Motivation: 多模态指令遵循对通用智能体很重要，但常见监督微调可能导致表层模式匹配并削弱通用能力。可验证奖励强化学习提供替代方案，却受限于高质量、适合RL训练的多模态数据稀缺，限制了规模化。

Result: MIFS通过生成约束协议合成多样原始样本，再依据强化学习训练动态进行可学习性感知蒸馏与筛选，以保证策略优化稳定；代码验证器为策略学习提供高精度奖励。最终数据集含9万样本，覆盖8类约束和14个任务领域。使用MIFS训练的多模态大模型在四个MMIF基准上的平均表现提升8.13%，相较原始数据训练收敛快3倍。方法缓解典型SFT泛化权衡，在提升指令遵循精度的同时保留核心视觉能力。

Insight: RL-ready数据质量不仅取决于样本多样性，也取决于样本是否适合稳定优化；依据实际训练动态筛除难学样本，再用可执行代码核验结果，可提高数据利用效率。摘要未给出8.13%的指标定义、基线配置及视觉能力保持的具体数值。

Abstract: Multimodal instruction following (MMIF) is crucial for building generalist agents. However, current training paradigms rely heavily on Supervised Fine-Tuning (SFT), which often leads to surface-level pattern matching and degrades general capabilities. While Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising alternative, its scalability in MMIF is severely bottlenecked by the scarcity of high-quality, RL-ready multimodal data. To bridge this gap, we present MIFS (\textbf{M}ultimodal \textbf{I}nstruction \textbf{F}ollowing \textbf{S}ynthesis), a systematic pipeline designed to generate RL-ready multimodal data. Specifically, MIFS introduces a generative constraint protocol to synthesize diverse raw samples, followed by a learnability-aware distillation mechanism that filters data based on RL training dynamics to ensure stable policy optimization. Furthermore, a code-based verifier provides high-precision reward signals for policy learning. The resulting dataset comprises 90k samples across 8 constraint categories and 14 task domains. Empirical evaluations demonstrate that MIFS-trained MLLMs achieve an average improvement of 8.13% on four MMIF benchmarks and a 3$\times$ faster training convergence compared to using raw data. Crucially, our approach mitigates the generalization trade-offs typical of SFT, preserving core visual capabilities while significantly boosting instruction-following precision.

[69] Efficient Multimodal Generative Recommendation with Latent Narrative Reasoning cs.CL | cs.AIPDF

Chenxing Wang, Nantao Zheng, Hao Miao, Juyuan Wang, Xinke Jiang

TL;DR: NarraLite面向短剧续看推荐，将长视觉上下文压缩为与叙事转折相关的证据，并用上下文路由的潜在推理token进行隐式情节推断；作者构建跨UGC、PGC和OOD的用户无关基准，报告其准确率、叙事连贯性和鲁棒性均优于既有方法。

Details

Motivation: 常规生成式推荐把物品预测视为语义ID生成，但短剧等分集内容的下一集由叙事演化决定，而非用户偏好。模型需要理解多模态情节进展，同时避免冗余视觉上下文及显式生成推理文本造成的计算开销。

Result: NarraLite联合压缩感知和推理：渐进式频谱压缩从长视频上下文中选择性提炼与叙事相关的紧凑证据，保留关键转折信息并减少冗余视觉计算；潜在叙事推理引入上下文路由的潜在推理token，并将其上下文表征与未来剧情延续语义对齐，从而在不自回归生成文本理由的情况下进行隐式情节推断。作者建立覆盖UGC、PGC和分布外场景的用户无关短剧续看基准。实验显示，NarraLite相较既有方法持续提高续看准确率、叙事连贯性及鲁棒性，并取得有利的精度—效率折衷。

Insight: 短剧续看属于以剧情状态为中心的多模态预测，不能简单套用基于用户偏好的推荐；压缩叙事关键线索并在潜空间推理，目标是同时减少视觉输入和显式思维链开销。摘要未提供基准规模、具体性能数值及效率测量细节。

Abstract: Generative recommendation reformulates item prediction as semantic identifier generation, yet episodic content introduces a fundamentally different setting where the target is determined by narrative evolution rather than user preference. This task requires models to understand multimodal storyline progression while addressing the efficiency challenges caused by redundant visual contexts and costly explicit reasoning generation. We propose \textbf{NarraLite}, an efficient multimodal generative recommendation framework that jointly compresses perception and reasoning. Specifically, Progressive Spectral Compression selectively distills long visual contexts into compact narrative-relevant evidence, preserving transition-critical information while reducing redundant visual computation. Latent Narrative Reasoning introduces context-routed latent reasoning tokens and aligns their contextualized representations with future continuation semantics, enabling implicit narrative inference without autoregressively decoding textual rationales. We further establish a user-agnostic multimodal benchmark for short-form drama continuation across UGC, PGC, and OOD settings. Extensive experiments demonstrate that NarraLite consistently improves continuation accuracy, narrative coherence, and robustness over existing approaches, while achieving a favorable accuracy–efficiency trade-off.

[70] The Imitation Game: When LLMs Learn to Reason Like Programs via Code-Centric Reasoning Data Synthesis cs.CL | cs.AIPDF

Jinyang Zhang, Weibin Liao, Keqin Bao, Sihang Li, Shaobo Wang

TL;DR: MIMIC利用可执行代码合成可验证的推理轨迹，把程序运行中的中间状态转为密集过程监督信号，支持无需外部奖励模型的强化学习；用其数据进行SFT和GRPO后，模型在通用、数学及细粒度确定性推理任务上均有稳定提升。

Details

Motivation: 大语言模型擅长编程，却常在自然语言中的确定性细粒度推理上失败，依赖语义近似而非可靠符号执行。强化学习训练又通常缺少密集可信的过程监督，限制了推理数据质量与策略优化。

Result: MIMIC将可执行代码作为严格推理数据合成媒介，通过叙事融合、代码引导的测试合成和动态代码插桩，把算法转化为可验证的推理轨迹。代码执行产生的显式中间状态形成代码插桩奖励CIR，为强化学习提供密集、高保真过程监督，无需外部奖励模型。使用合成数据进行监督微调和GRPO的模型，在通用推理、复杂数学基准和细粒度确定性任务上均取得显著且稳定的准确率提升。摘要未给出各任务的具体数据集或增幅。

Insight: 程序的执行轨迹和测试结果可提供可核验的中间推理信号，弥补只用最终答案奖励过于稀疏的问题；代码合成也将自然语言任务转为可执行验证过程。摘要仅定性报告提升，未披露数据规模、模型配置和基准分数。

Abstract: Large Language Models (LLMs) excel at programming tasks but frequently fail at deterministic, fine-grained reasoning in natural language, relying heavily on semantic approximations rather than robust symbolic execution. To bridge this gap, we propose MIMIC, a framework that leverages executable code as a rigorous medium for reasoning data synthesis. MIMIC fundamentally transforms algorithms into verifiable reasoning trajectories through narrative fusion, code-guided test synthesis, and dynamic code instrumentation. Crucially, these explicit intermediate execution states naturally form a Code-Instrumented Reward (CIR), providing dense, high-fidelity process supervision for reinforcement learning without external reward models. Extensive evaluations reveal that models trained via SFT and GRPO on our synthesized dataset achieve substantial, consistent gains. Our method significantly elevates accuracy across general reasoning, complex mathematical benchmarks, and fine-grained deterministic tasks, demonstrating that the procedural rigor of executable code can effectively unlock and enhance the generalized reasoning capabilities of LLMs. Our code and data are available at https://github.com/zjy1298/MIMIC.

[71] Spurious Tool Use: When RL Agents Learn the Wrong Reason to Act cs.CLPDF

Yiwei Yang, Haoxiang Zhang, Bingbing Wen, Yao Lu, Yuchen Wu

TL;DR: 该研究发现RL训练的LLM智能体可能依据与任务需求无关的提示表面线索选择工具：在受控反事实评测中，虚假调用率最高增加39%；为每次调用加入工具必要性奖励后，可抑制线索驱动调用并保持任务表现。

Details

Motivation: LLM智能体常将自然语言推理与网页搜索、代码执行等外部工具交织使用，强化学习可能放大训练数据中的虚假相关性，使模型根据表面提示线索调用工具，而非判断任务是否真的需要工具。

Result: 作者构造结合事实问答和数学推理的受控合成环境，在训练数据中注入与特定工具高度相关、但对工具必要性没有因果作用的提示线索。反事实评测中，当线索出现而对应工具并非必需时，智能体表现出显著捷径行为，虚假工具调用率最高增加39%。这种现象并非普遍发生：在所测条件下，只有智能体已可靠学会使用目标工具时才会形成捷径；互换线索实验还显示，线索与工具的语义对齐会明显放大效应。作者提出稠密决策级奖励，由LLM评审判断每次工具调用是否必要，可有效压制由线索引发的调用并保持任务表现。

Insight: 工具使用能力越成熟，模型反而越可能利用训练中与工具相关的无关线索，因此需把“是否必要”作为独立监督目标。反事实和互换线索设计有助于识别真正的捷径成因；摘要未给出具体奖励实现、模型规模及任务分数变化。

Abstract: Large language model (LLM) agents increasingly interleave natural language reasoning with external tools such as web search and code execution. These tool-use policies are often optimized via reinforcement learning (RL), which can amplify spurious correlations in the training data. In this work, we study when and why RL-trained agents learn shortcut tool-selection policies: invoking tools based on superficial prompt cues rather than genuine task requirements. We construct controlled synthetic environments combining factual question answering and mathematical reasoning tasks, and inject cues that are strongly correlated with specific tools during training but causally irrelevant to tool necessity. Across counterfactual evaluations where cues are present but the associated tools are not required, agents exhibit substantial shortcut behavior, with spurious tool invocation rates increasing by up to 39 percent. However, shortcut formation is not universal: across the conditions we test, it arises only when the agent has already learned to use the target tool reliably, suggesting that task competence, rather than dataset imbalance alone, is a key factor in shortcut learning. A swapped-cue analysis further shows that semantic alignment between cues and tools substantially amplifies this effect. To mitigate these failures, we introduce a dense, decision-level reward in which an LLM judge evaluates the necessity of each tool call. This tool-necessity reward effectively suppresses cue-driven tool use while preserving task performance, providing a practical approach to improving the robustness of LLM agent tool-use policies.

[72] Register Tokens for Bounded-State Reasoning in Diffusion Language Models cs.CLPDF

Albert Ge, Chandan Singh, Yufan Zhuang, Xiaodong Liu, Jianfeng Gao

TL;DR: 该研究让掩码扩散语言模型用固定数量的连续register token保存跨文本块的推理状态：每生成一块后清除文本、保留register再继续；在LLaDA和Dream上所有基准均优于离散文本携带，数学最高提升8.5分、代码最高提升19.5分。

Details

Motivation: 掩码扩散语言模型通过双向注意力迭代去噪生成文本。若推理跨越多个生成块，常规做法需把之前生成的文本留在上下文中；作者研究能否在清除旧文本后，仅用固定大小的状态继续推理。

Result: 研究采用少量固定位置register token，训练其连续隐藏状态携带跨生成块的推理进展。后训练过程中，模型先解码一段文本，随后清除该段、保留register值，再依据原始提示和携带状态继续生成。在LLaDA和Dream上的主要比较中，register在所有基准上都超过离散文本携带，数学任务最多提高8.5分、代码任务最多提高19.5分；对于通常跨多个块的有界代码生成尤为有效。作者还展示可通过长程推理任务上的强化学习进一步优化register。

Insight: 跨块推理状态可压缩为少量连续向量，而无需持续保留所有自然语言中间文本；当答案需要多块生成时，这种有界状态对代码任务尤其有利。摘要未给出基准名称、register数量和上下文长度设置。

Abstract: Masked diffusion language models (dLLMs) generate text by iteratively denoising masked tokens with bidirectional attention. Extending reasoning across generation chunks normally requires keeping earlier generated text in context. We ask whether a dLLM can instead continue reasoning after that text is cleared, using only a fixed-size carried state. We implement this state as a small number of register tokens: dedicated fixed-position tokens whose continuous hidden states are trained to carry reasoning progress across generation chunks. We post-train dLLMs to decode a chunk of text, clear it while preserving the register values, and continue decoding from the prompt and carried state. In our main comparisons on LLaDA and Dream, registers outperform discrete-text carry on every benchmark, with gains of up to 8.5 points on math and 19.5 points on code. Registers are especially effective for bounded code generation, where correct programs usually span several chunks. Finally, registers can be further refined with reinforcement learning on long-horizon reasoning tasks.

[73] Negation Beyond the Verbal Channel: Temporal Multimodal Correlates in Dialogue cs.CLPDF

Leon Hammerla, Patrick Schrottenbacher, Alexander Mehler

TL;DR: 该研究用27段VR人际访谈中的凝视、面部、头身和手部时序行为预测口语否定线索，在不使用词汇和声学输入时最佳探针AUROC达0.75；信息主要集中在否定线索出现前后，面部特征的消融影响最大。

Details

Motivation: 口语否定通常被视为纯语言现象，但真实对话还伴随同步的非语言行为。作者研究仅凭非语言行为能否识别围绕口语否定线索的上下文、哪些时间段和模态携带信息，以及对话伙伴的行为是否也有预测性。

Result: 数据来自27段虚拟现实中的人际访谈，包含时间对齐的凝视、面部、头部、身体、手和手指行为，以及964个标注否定线索。研究将分类视为预测探针，对比20种时序模型，排除词汇和声学信息，并系统改变时间上下文、互动来源、模态可用性和事件时序。分组十折交叉验证中，最强探针仅用说话者行为的平均留出AUROC最高达0.75。时间分析显示，预测信息集中于线索起始附近，但在更宽的周围时间范围仍可检测；对话伙伴行为的预测信息更弱且时间分布更弥散。消融和时序扰动实验显示，面部特征造成最大的模态消融影响，模型也对事件的时间组织敏感。

Insight: 围绕否定表达的非语言行为包含可测信息，但其强度依赖时间和互动角色；说话者面部线索贡献尤为明显。AUROC反映预测可分性，并不证明非语言动作导致否定表达；摘要未提供不同访谈群体或语言条件的泛化评测。

Abstract: Negation is typically modeled through its linguistic realization, although spoken interaction is accompanied by tightly coordinated nonverbal behavior. We ask whether contexts centered on spoken negation cues contain measurable multimodal behavioral information: whether they can be distinguished from matched control contexts without lexical or acoustic input, where this information occurs in time, which modalities carry it, and whether it extends to the dialogue partner. We study 27 human-human interviews conducted in virtual reality, comprising temporally aligned gaze, facial, head, body, hand, and finger behavior and 964 annotated negation cues. Treating classification as a predictive probe, we compare 20 time-series models while excluding lexical and acoustic information, and then systematically vary temporal context, interactional source, modality availability, and event timing. Across grouped 10-fold cross-validation, the strongest probes reach up to .75 mean held-out AUROC from speaker-side behavior. Temporal analyses show that predictive information is concentrated around cue onset but remains detectable over a broader surrounding interval, while dialogue-partner behavior carries weaker predictive information with a comparatively diffuse temporal profile. Ablation and timing perturbations further show that facial features produce the largest modality-ablation effect and that the trained probe is sensitive to the temporal organization of the observed events.

[74] PunGraph: Retrieval-Enhanced Phonetic-Semantic Graph Reasoning for Pun Understanding cs.CLPDF

Yuchen Su, Zijian Huang, Yaotian Shi, Shaoxin Zhong, Ruofan Wang

TL;DR: PunGraph为双关语理解构建结合语音学与语义的检索增强知识图谱，利用音标、G2P及WordNet约束LLM候选解释，并发布5,730条WebPun异形和同形双关数据；在SemEval-2017和WebPun上持续改善小型LLM表现。

Details

Motivation: 双关语利用语音相似性和语义歧义同时传达多重含义，LLM受限于语音建模能力且端到端生成不受控，常难以正确推理。需要将语音和词义知识结构化，约束模型的解释候选。

Result: PunGraph用Unisyn语音词典、IPA和字素到音素表示，以及WordNet词义构建语音—语义词汇图；检索候选词或词义，将LLM推理限制在结构化候选空间。作者还发布WebPun数据集，包含5,730条人工标注的异形双关和同形双关。在SemEval-2017和WebPun上，PunGraph持续提升小型LLM表现，并达到与强专有模型有竞争力的结果。分析显示，检索引导的语音和语义约束能有效减少双关解释中的常见推理错误。代码和数据集公开。

Insight: 双关理解需同时保留读音近似和词义多重性；将词典与词义关系转成检索图，可减少模型自由生成时的解释漂移。摘要未列各项任务分数及专有模型比较范围，数据集规模也不代表每种双关类型均衡。

Abstract: Puns are a challenging form of figurative language that exploit phonetic similarity and semantic ambiguity to convey multiple meanings. Although large language models (LLMs) demonstrate strong language understanding capabilities, they still struggle with pun reasoning due to limited phonetic modeling and uncontrolled end-to-end generation. We propose \textbf{PunGraph}, a retrieval-enhanced knowledge graph framework for pun understanding. PunGraph constructs a phonetic-semantic lexical graph using the Unisyn phonetic dictionary, IPA and G2P representations, and WordNet definitions, and retrieves candidate words or senses to constrain LLM reasoning within a structured candidate space. We further introduce \textbf{WebPun}, a new large-scale dataset containing 5,730 annotated heterographic and homographic puns. Experiments on SemEval-2017 and WebPun show that PunGraph consistently improves the performance of small-scale LLMs and achieves competitive results against strong proprietary models. Further analysis shows that retrieval-guided phonetic and semantic constraints effectively reduce common reasoning errors in pun interpretation, highlighting the benefits of integrating structured knowledge with LLMs. We release our code and dataset at https://github.com/ysu132/PunGraph.

[75] Rewarding Reasoning, Not Answers: Fixing and Bounding Test-Time Reinforcement Learning on Medical QA cs.CLPDF

Kailong Fan, Anqi Pu, Yichen Wu, Wanhua Li, Yicong Li

TL;DR: PROSE针对医疗问答测试时强化学习的伪标签崩溃问题，以医疗过程奖励模型为每个推理步骤打分，并用轨迹最小步骤分作为奖励而非答案一致性；无标签适配可超过专用医疗模型并匹配更大系统，且增益可迁移至未见数据集。

Details

Motivation: 使用多数投票伪标签在无标注测试集上进行测试时强化学习，已在数学任务取得效果，但在医疗选择题上会出现准确率停滞和输出多样性迅速下降。错误答案可能因有限选项空间而重复碰撞并互相强化，或在选项空间较大时分散而得不到有效奖励。

Result: 控制实验固定问题、模型和优化器，仅改变答案空间，发现失败源于答案空间结构而非医学领域难度。作者提出过程奖励引导自训练PROSE：用医疗过程奖励模型评估每个推理步骤，以全轨迹最低步骤分作为奖励，并施加答案格式约束。无需标签，PROSE可显著提升通用Llama模型，超过专门医疗模型并匹配大得多的系统；由于过程信号被内化进策略，推理时不再需要奖励模型，且增益迁移到未见数据集。消融表明最小值聚合至关重要，平均聚合容易被利用，导致代理奖励饱和且准确率下降。

Insight: 医疗多选题上仅奖励答案一致性容易形成自我强化的错误伪标签；逐步评估推理过程并以最弱步骤限制整条轨迹，可降低这种崩溃风险。摘要未给出准确率数字、医疗过程奖励模型训练细节及“匹配更大系统”的具体规模。

Abstract: Test-time reinforcement learning adapts a model on its own unlabeled test set using majority-vote pseudo-labels and has shown strong results in mathematics. We show that this recipe collapses on medical multiple-choice QA: accuracy stagnates while output diversity rapidly declines. Through a controlled experiment that keeps the questions, model, and optimizer fixed while changing only the answer space, we trace this failure to answer-space structure rather than domain difficulty. In small answer spaces, incorrect rollouts often collide on the same wrong pseudo-label and reinforce it; in large answer spaces, they disperse and receive little reward. This diagnosis motivates PROSE, Process Reward Guided Self-Training, which rewards reasoning quality instead of answer agreement. PROSE scores each reasoning step with a medical process reward model, assigns the trajectory reward as the minimum score across steps, and enforces answer-format constraints. Without labels, PROSE substantially improves a general Llama model, surpassing purpose-built medical models and matching much larger systems. Because the process signal is internalized into the policy, the adapted model requires no reward model at inference and transfers its gains to unseen datasets. We further show that the minimum aggregation is essential: mean aggregation can be exploited, saturating the proxy reward while degrading accuracy.

[76] TIAO: Token Importance-Aware Policy Optimization for Text Summarization cs.CLPDF

Qixiu Li, Chenlong Bao, Xiang Zhu, Xiaoyong Li, Ruixin Cao

TL;DR: TIAO是面向文本摘要的token重要性感知强化学习方法，依据token依赖关系识别核心token，并按整条轨迹的依赖结构重加权优势；真实数据实验显示结果有竞争力，7B基础模型可达到与GPT-4和GPT-5-nano相当的表现。

Details

Motivation: 摘要需要压缩内容，同时保持一致性和连贯性。现有强化学习方法通常对整段生成序列使用未区分token的重要性奖励，忽略不同token对词语和句子层面质量的影响差异。

Result: TIAO显式利用token重要性，在生成轨迹中根据token依赖识别核心token，并依据整体依赖关系重加权轨迹优势。真实世界数据实验显示该方法取得有竞争力的摘要结果；经TIAO强化的7B基础模型表现与GPT-4和GPT-5-nano相当。摘要未给出数据集名称、评价指标及具体分数。

Insight: 摘要质量取决于少数关键内容及其依赖关系，按token与轨迹结构分配优势有望比对所有token统一处理更有效。当前摘要仅报告总体比较，缺少任务、指标和显著性细节，不能判断与不同模型是否逐项相当。

Abstract: Text summarization requires models to condense content while preserving key qualities such as consistency and coherence. Large language models (LLMs) have shown strong performance on this task and can be further improved through reinforcement learning (RL). However, most existing methods apply reward signals directly to undifferentiated token sequences, overlooking the varying importance of individual tokens to word and sentence level quality in summarization. In this paper, we propose Token Importance-Aware Policy Optimization (TIAO), a novel reinforcement learning strategy that explicitly leverages token-importance awareness. Specifically, TIAO identifies core tokens based on token dependency and reweights a trajectory’s advantage according to its overall dependencies. Experiments on the real world dataset show that our TIAO achieves highly competitive results, and that a 7B foundation model enhanced by TIAO performs comparably to GPT-4 and GPT-5-nano. Code is available at https://github.com/TechCloud-x/TIAO

[77] RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigation cs.CLPDF

ZhuoXin Liu, Zhiming Ma, Ying Zhang, Mengzheng Yang, Yifan Wang

TL;DR: RiskChainBench评估平台滥用信息还原与基于证据的网页调查整条风险识别链，配对3,600条合成消息还原输入和600个人工标注网页环境；10个模型入口识别率为35.2%–95.2%，网页决策准确率仅26.3%–62.8%，31.9%的网页运行因执行失败中断。

Details

Motivation: 平台滥用活动会用表情符号、同音替换、字符拆分和冗余符号隐藏引流指令，再把用户导向色情、欺诈、赌博或非法交易相关服务。既有基准分别评估混淆文本和风险网页，无法揭示入口恢复错误如何影响后续证据调查。

Result: RiskChainBench由600个来源会话产生的3,600条合成token文本还原输入，以及对应的600个人工标注本地网页环境组成。模型先恢复消息、操作意图和目标，再由同一底层模型作为VLM网页智能体调查正确关联的网站，并在不使用消息语义或域名声誉线索的情况下生成固定格式的证据引用风险报告。研究分别评分入口还原与正确路由后的网页调查，再以冻结的入口预测作为门控离线组合两项任务。人类标注判定任务正确性，固定多模态证据评审衡量忠实度、充分性、完整性和一致性。10个模型入口Top-1为35.2%–95.2%，网页决策准确率为26.3%–62.8%；入口恢复、完整重建、网站决策和细粒度类别识别各自领先的系统不同。网页运行中31.9%因执行失败，决策后类别错误仅0.9%。作者公开基准、协议和可重置本地沙箱。

Insight: 风险调查管线的瓶颈不只在模型的风险判断，还包括稳定探索网页和正确恢复隐藏入口；把入口恢复与后续网站调查分开评分可定位错误来源。实验使用本地模拟环境，真实平台变化和执行失败分布可能不同。

Abstract: Platform abuse campaigns conceal redirection instructions with emojis, homophones, character decomposition, and redundant symbols, then route users through disguised links to services associated with pornography, fraud, gambling, or illicit transactions. Existing benchmarks evaluate obfuscated text and risky webpages separately, obscuring how target recovery affects downstream evidence acquisition. We introduce RiskChainBench, pairing 3,600 synthetic token-text restoration inputs from 600 source sessions with 600 corresponding human-labeled local web environments. A model first restores the message, operational intent, and destination; the same underlying model then acts as a VLM-driven web agent that investigates the correctly associated website and produces a frozen, evidence-cited risk report without message-side semantics or domain-reputation cues. We score restoration and correct-routing web investigation separately and compose them offline by applying the frozen primary-entry prediction as a gate to the same Task 2 result. Human labels determine task correctness, while a fixed multimodal evidence judge assesses faithfulness, sufficiency, completeness, and consistency. Across ten models, Entry Top-1 ranges from 35.2% to 95.2% and web decision accuracy from 26.3% to 62.8%; the leading systems differ across entry recovery, full reconstruction, website decisions, and fine-grained typing. Execution failures account for 31.9% of web runs, whereas post-decision type errors account for only 0.9%, identifying stable exploration and risk judgment as the principal bottlenecks. We release the benchmark, protocol, and resettable local sandbox.

[78] Deconstructing Stereotypes: Scope-Conditioned Generation for Effective Multilingual Counterspeech cs.CLPDF

Greta Damo, Elias Urios Alacreu, Elena Cabrio, Paolo Rosso, Serena Villata

TL;DR: 该研究提出范围条件化多语言反仇恨言论生成，将结构化刻板印象特征纳入LLM提示，并在英语、意大利语和西班牙语人工标注数据集上评估；相较通用基线，显性和隐性刻板印象应对在事实性、针对性、说服力和有效性方面均显著提升。

Details

Motivation: 反仇恨言论可通过直接回应并提供推理和替代观点来对抗线上仇恨内容，但现有自动生成方法常给出泛泛而无效的回答，未能针对仇恨言论中隐含的刻板印象。

Result: 作者提出范围条件化生成框架，在大语言模型提示中明确加入结构化刻板印象特征，并构建英语、意大利语和西班牙语的新人工整理标注数据集。评估结果显示，刻板印象条件化提示在三种语言上均显著超过通用生成基线；无论针对显性还是隐含的刻板印象，事实性、针对性、论证说服力和整体有效性都有显著提升。摘要未提供数据集规模和具体指标分数。

Insight: 识别仇恨言论背后的刻板印象范围并针对性回应，较泛化的劝诫更可能产生具体、可信的反驳；这一策略在三种语言均有报告收益。摘要未说明人工标注流程、评审者一致性或跨文化安全评估。

Abstract: Counterspeech (CS) - direct responses that counter online Hate Speech (HS) using reasoning and alternative viewpoints - has emerged as an alternative to content removal. Current automatic CS generation methods, however, frequently produce generic, ineffective replies that fail to target the implicit stereotypes behind HS. To bridge this gap, we propose a novel scope-conditioned generation framework that explicitly integrates structured stereotype characteristics into Large Language Models prompts. We validate our approach on a novel, human-curated dataset annotated in English, Italian, and Spanish. Extensive evaluations show that stereotype-conditioned prompting substantially outperforms generic baselines across all three languages, obtaining significant gains in factuality, specificity, cogency, and effectiveness for both explicit and implicit implied stereotypes.

[79] Nameless Tokenization: A Lossless Tokenizer-Level Defense Against Control-Token Forgery in Open-Weight LLMs cs.CLPDF

Kisu Yang, Yoonna Jang, Heuiseok Lim

TL;DR: Nameless Tokenization提出一种无损的tokenizer层防御：控制token保留专用标识符但不提供可见字符串，使内容编码器无法伪造控制token；审计256种部署聊天tokenizer发现全部可伪造，所提方案在五类tokenizer上保持无攻击文本token流一致，并将含分隔符探针准确率由8.5%升至59.9%。

Details

Motivation: 开源LLM公开用于标记轮次、角色和工具结果的聊天模板字符串，分词器会将这些字符串映射回模型遵从的保留标识符。控制提示文本的用户因此可能写出与服务端边界无法区分的控制序列，导致伪造轮次或工具结果。

Result: 作者审计256种已部署聊天分词器，全部存在伪造风险；通常推荐的防护开关仍留下56.6%可伪造，因为它漏掉智能体常用的工具和推理标记。Nameless Tokenization为控制项保留专用标识符，但不给它们任何表面字符串，使内容编码器无法输出这些标识符，同时让消息内容原样进入模型。在五类分词器上，无攻击数据的标准token流可逐项复现；在含分隔符文本探针上准确率从8.5%升至59.9%，而清理器会损失信息。实验区分分隔符外观与标识符后发现，面对裸任务指令时标识符作用较小，但当系统指令要求将用户内容视为数据时，标识符承载了大部分伪造工具结果和轮次的影响。

Insight: 若控制token只有模型内部专用标识符而没有可由用户文本产生的公开拼写，便可从分词层切断伪造通道，同时不破坏普通内容。摘要报告对五类tokenizer的验证，但未说明全部256种结构的覆盖方式或服务端部署兼容成本。

Abstract: Open-weight language models publish the strings their chat templates use to mark turns, roles and tool results, which the tokenizer maps back to the reserved identifiers the model obeys. Anyone who controls text in a prompt can therefore write a turn boundary indistinguishable from one the serving stack wrote. We audit 256 deployed chat tokenizers. All are forgeable, and the flag usually recommended as a fix leaves 56.6% forgeable because it misses the tool and reasoning markers agent systems rely on. We propose nameless tokenization, which leaves the control entries with a reserved identifier and no surface string, so the content encoder cannot emit one and message content reaches the model unaltered. Across five tokenizer families it reproduces the standard token stream exactly on attack-free data and lifts accuracy on a probe of delimiter-bearing text from 8.5% to 59.9%, where sanitizers lose it. Separating a delimiter’s appearance from its identifier shows the identifier matters little against a bare task instruction, but carries most of a forged tool result and most of any forged turn once the system message tells the model to treat user content as data.

[80] PaperDoctor: Evidence-Grounded and Actionable Feedback for Scientific Papers in Progress cs.CL | cs.MAPDF

Kevin Qinghong Lin, Siyuan Hu, Pan Lu, Yu Chen, Yanzhe Chen

TL;DR: PaperDoctor是投稿前科学论文诊断智能体，从写作、版式、引用、代码、理论、相关工作和实验等层级核验主张，并为每条发现提供证据位置和可执行修改建议；在30篇进行中论文上与专家意见一致率70.6%。

Details

Motivation: 自动化研究智能体提高了研究效率，也可能使有缺陷的主张快速进入文献。导师逐项审查草稿能发现问题并给出可追溯建议，但工作量大、难以规模化；只给总体判分的自动审稿工具也未必能指出如何修正。

Result: PaperDoctor采用三层综合评估：L1进行表层筛查，L2按主张类型路由到匹配证据的验证器，L3根据优先级复现并重跑实验。每条发现包含观察、具体证据位置（句子、公式或代码行）和修改建议，便于审计和执行；系统还按主张重要性及计算预算选择性重建、复现实验，以揭示仅读稿件看不出的可复现性缺口和量化局限。作者在30篇进行中论文上评测，报告70.6%一致率且整体评分均为正；另评估机器学习、自然科学和社会科学的40篇有代码论文，涵盖人类和AI撰写稿件。整体上，系统给出比人工及其他智能体审稿更可审计的反馈，并覆盖人工评审常忽略的方面。另开发交互界面供作者浏览论文证据支持的发现。

Insight: 论文评估适合从“给判决”转向“定位问题并说明证据与修复路径”；不同类型主张需要不同验证方式，实验复现还能补充文本审阅无法发现的缺陷。摘要未说明70.6%一致率对应的具体评审对象、指标定义及误报情况。

Abstract: Autoresearch agents are reshaping the research ecosystem, but they can also let flawed claims enter the literature at scale. Human advisors catch such issues in drafts through careful, traceable feedback, yet advisor-style assessment requires extensive manual effort and does not scale. To shift automated paper assessment from a judge to a diagnostician, we introduce PaperDoctor, an agent framework for pre-submission feedback with three key innovations. First, a holistic hierarchical framework evaluates writing, layout, references, code, theory, prior work, and experiments through three layers: L1 surface screening, L2 typed verifiers that route each claim to the appropriate evidence, and L3 reproducers that rerun experiments by priority. Second, each finding contains an observation, a pointer to specific evidence such as a sentence, equation, or code line, and a revision suggestion, making critiques auditable and actionable. Third, PaperDoctor selectively rebuilds and reruns experiments based on claim importance and compute budget, surfacing reproducibility gaps and quantitative limitations that are invisible from the manuscript alone. We evaluate PaperDoctor on 30 in-progress papers, yielding 70.6% agreement and all positive holistic scores, and on 40 manuscripts across machine learning, natural science, and social science, covering human- and AI-authored papers with code. Overall, PaperDoctor produces more auditable feedback than human and other agentic reviewers, pairs critiques with concrete suggestions by design, and complements dimensions often overlooked by human reviewers. We also develop an interactive interface that lets authors browse findings grounded in their paper. PaperDoctor reframes automated paper assessment as diagnosis rather than verdict, taking a concrete step toward AI advisors for more rigorous AI-assisted scientific discovery.

[81] Diagnosing the Fact-Grounding Gap in Multi-Hop Question Answering cs.CL | cs.AI | cs.IRPDF

Kevin Mo, Nathan Mo, Richard Zhu

TL;DR: 该研究将多跳问答错误拆分为所需段落未检索到的检索失败和段落已检索但事实未能抽取的事实接地缺口；在三个标准基准上，近一半逐跳缺陷属于后者，所有受测检索干预均未能消除。

Details

Motivation: 多跳问答需组合多个文档信息，系统失败通常被归因于未找到正确文档。但单个推理步骤即使拿到了相关段落，也可能未抽取出所需事实；这一问题尚未得到充分区分和测量。

Result: 作者在三个标准多跳问答基准上分析失败，区分检索失败（必需段落未被检索）和抽取失败（段落已检索，但未抽取出所需事实），并将后者命名为事实接地缺口。抽取失败约占逐跳缺陷的一半，标准检索指标无法检测到它。研究测试的所有检索干预均未解决该缺口，表明仅改进检索存在性能上限。缺口程度随基准和问题类型变化，但在每个受测数据集上都出现。

Insight: 多跳问答既要评估检索是否找到证据，也要检查每一步推理是否正确提取了证据事实；提高召回率不能解决证据已到手但理解失败的问题。摘要未给出三个基准名称、分项失败比例及检索干预列表。

Abstract: Multi-hop question answering requires combining information from multiple documents to answer complex questions. These systems have grown increasingly capable, yet when they fail, the error is typically attributed to not finding the right documents. Whether this holds at the level of individual reasoning steps remains largely unexamined. We investigate this across three standard multi-hop QA benchmarks and find that failures decompose into two distinct modes: retrieval failures, where the needed passage was not retrieved, and extraction failures, where the passage was retrieved but the needed fact could not be extracted - a phenomenon we term the fact-grounding gap. Extraction failures account for nearly half of all per-hop deficiencies and are invisible to standard retrieval metrics. They remain unresolved by every retrieval intervention we test, establishing a ceiling for retrieval-only improvements. The gap’s severity varies across benchmarks and question types, but extraction failures appear on every dataset we measure. Our findings reveal that retrieval failures and extraction failures are fundamentally different bottlenecks requiring different solutions - a distinction absent from current evaluation practice.

[82] Towards Detecting AI-Assisted Responses in Online Surveys cs.CL | cs.CYPDF

Qizhou Wang, Bogdan Mamaev, Christopher Leckie

TL;DR: ASURRE是用于检测在线问卷AI辅助作答的初始基准，涵盖直接生成、修改及基于人设的智能体作答，并将多种LLM结果与真人回答配对；朴素AI容易检测，人设智能体让现有探测器接近随机，但结合多种行为线索的免训练少样本聚合器提升平均AUROC 0.14。

Details

Motivation: LLM参与在线问卷会影响基于问卷的研究有效性，但检测此类使用仍研究不足。检测难点在于AI辅助策略多样：既可能直接生成或修改答案，也可能由智能体模拟完整受访者人设。

Result: 作者发布ASURRE基准，使用多个LLM在三种不同学科的真实问卷上生成AI辅助回答，策略包括直接生成、修改及基于人设的智能体作答，并与真实人类回答配对。对已有机器生成文本检测器的评估显示，朴素AI使用易于检测，而模拟完整受访者的人设智能体使检测性能接近随机水平。智能体作答仍无法完全复现受访者层面的行为，会留下独特行为痕迹。单个线索可通过针对性提示规避，但基于多种线索的简单免训练少样本聚合器，在智能体作答设置下比最佳既有检测器平均AUROC提高0.14。

Insight: 仅分析答案文本可能漏掉更复杂的AI辅助策略；受访者级行为线索可提供补充，但单项线索可被定向规避，组合多种线索更稳健。摘要未给出问卷和受访者规模、跨问卷迁移及误伤真人的代价。

Abstract: The use of LLMs to complete online surveys impacts the validity of survey-based research, but detecting such usage remains underexplored. We introduce an initial benchmark dataset, namely ASURRE, for AI-assisted survey participation to capture usage strategies ranging from full generation and revision to persona-grounded agentic completion. Controlled by these strategies, LLM-assisted survey responses are generated using multiple LLMs on three real-world surveys in different disciplines, paired with genuine human responses. Our evaluation of existing machine-generated text (MGT) detectors shows that naive AI usage is readily detectable, whereas persona-grounded agents that mimic entire respondents push detector performance toward chance. We further show that agentic completion cannot fully replicate respondent-level behaviour and leaves distinctive behavioural traces. While individual cues can be circumvented by targeted prompting, a simple few-shot, training-free aggregator over these cues improves mean AUROC by +0.14 over the best existing detector across agentic settings. Our project is available at https://github.com/mike-qz-wang/ASURRE.

[83] Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs cs.CL | cs.AIPDF

Toqeer Ehsan, Nico Penttilä, Richard Schmidt, Arash Hajikhani, Victoria Palacin

TL;DR: 该工作在SHROOM-Visions共享任务中用多个微调VLM作为独立标注员，按字符级多数投票检测并分类四种语言输出中的幻觉片段，同时探索激活探针；在四种语言中的三种排名第一，所有语言及指标均进入前三。

Details

Motivation: 视觉语言模型输出可能包含未由图像支持的幻觉片段，需要同时定位字符跨度并判断错误类型。单一模型判断容易受自身偏差影响，因此作者探索多个模型及隐藏激活信息能否提供更可靠的检测。

Result: 论文报告参加SHROOM-Visions共享任务的方法：使用多个微调的视觉语言模型作为独立标注器，对其预测的字符区间进行多数投票，并额外探索激活探针。系统在四种语言中有三种排名第一，在每种语言和每个指标上均进入前三。分析发现，不同模型之间的分歧与人工标注者之间的分歧相关。摘要未提供具体指标分数和各语言排名细节。

Insight: 多模型在字符级别集成可利用标注者间一致性提高幻觉片段检测表现，而模型分歧本身可能反映任务边界的不确定性。摘要仅报告共享任务排名和相关观察，未给出激活探针相对投票的独立贡献。

Abstract: This paper describes our submission to the SHROOM-Visions shared task on detecting and classifying hallucinated character spans in vision-language model outputs across four languages. We employ several fine-tuned vision-language models as independent annotators and combine their span predictions through character-level majority voting, and additionally explore activation probes. The approach ranks first in three of four languages and places on the podium in every language and metric. Our analysis indicates that disagreement among diverse models tracks disagreement among human annotators.

cs.AI [Back]

[84] Safe Error Correction for Language Models: Frozen-Base Adjustment with Capability Preservation cs.AI | cs.CL | cs.LG | cs.NEPDF

Gautam Kishore

TL;DR: CRN v2在完全冻结的Gemma 4 E2B上增加约3,400万参数的logit纠错模块，并通过监督微调和免参考DPO学习错误修正，同时以KL项保护原能力；在60题人机智能考试中纠正53.3%的基模错误且所测能力基准未退化。

Details

Motivation: 作者研究一个实际问题：能否用小型纠错模块修复冻结语言模型的输出错误，而不损害其原有能力？常规微调或LoRA虽可能提高目标纠错率，但会改变底模并引入广泛能力退化风险。

Result: CRN v2是约3,400万可训练参数的logit级纠错模块，占Gemma 4 E2B 46.5亿文本模块参数的0.73%，底模保持完全冻结。模块在83,400对纠错样本上先监督微调，再进行免参考DPO。60题CEHRI认证人机智能考试涵盖事实、算术和隐含目标推理；CRN v2纠正53.3%的基模错误，改写题变体为43.3%，且MMLU/BoolQ（N=200）和洗车任务（N=8）未见能力退化。匹配CRN v1预算的LoRA基线（660万参数、rank 19）纠错率为83.3%，却在同一能力基准上损失30%–75%。消融显示KL保持项λ=0.1很关键，降至0.01后纠错率降至35.0%。其他隐藏层注入、浅层注入、多深度logit及更长训练设置均未超过rank-128 logit配置约53%的纠错结果。

Insight: 纠错性能与原能力保持存在明显权衡；冻结底模、logit级校正和KL锚定可以用较小模块换取无可见能力退化，但纠错率约53%，低于LoRA且其能力代价大。作者将其定位为设计原则研究，而非架构新颖性主张；部分深层模型仅公开代码、没有训练权重。

Abstract: We study a practical question: can a small correction module fix errors in a frozen language model’s outputs without degrading its base capabilities? We propose CRN v2, a lightweight logit-level correction module (34M trainable parameters, 0.73% of the 4.65B text module) that sits atop a fully frozen Gemma 4 E2B model. The base model is never updated; only the correction module learns, via supervised fine-tuning followed by reference-free DPO on 83,400 error-correction pairs. On a 60-question domain exam (CEHRI: Certified Human-Robot Intelligence, covering facts, arithmetic, and implicit-goal reasoning), CRN v2 corrects 53.3% of base-model errors (reworded variant: 43.3%) while showing no degradation on tested capability benchmarks (MMLU/BoolQ N=200; car-wash N=8). A LoRA baseline at the matched CRN v1 budget (6.6M params, rank 19) achieves 83.3% correction but suffers 30-75% capability loss on the same benchmarks – the correction-capability tradeoff. An ablation shows that the KL preservation term (lambda=0.1) is critical: lowering it to 0.01 degrades correction to 35.0%. A hidden-state injection variant at earlier layers (1.6M params, SFT-only) reaches 50.0%/55.8% but does not exceed logit correction; shallower injection (layer 4) drops to 30.0%/28.3%; multi-depth logit correction (35M) reaches only 40%; and longer training (5,000 SFT + 2,000 DPO) stays at 53.3% – none of the alternative configurations we tested exceeded the rank-128 logit result, consistent with a best-achieved result of ~53% rather than a floor. This is a study of a design principle (frozen base + logit correction + KL anchoring), not a claim of architectural novelty. All code, main-result weights, and evaluation scripts are released (deep variant as code only – no trained deep checkpoints).

[85] VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs cs.AI | cs.CL | cs.CV | cs.MMPDF

Haoyu Guo, Yuan Feng, Junlin Lv, Mingjun Xiao, S Kevin Zhou

TL;DR: VideoMM为长视频多模态LLM采用宏观筛选、微观细节按需读取：先在低分辨率Macro Proxy上筛选语义相关区域，再映射到高保真Micro Tokens进行细致理解；在LongVideoBench上较全上下文基线快6.13倍且准确率高7.4%，较领先方法再快2.73倍。

Details

Motivation: 多模态大语言模型扩展到长视频理解时，视觉token数量急剧增加，挤满上下文窗口并带来高昂成本。现有辅助模型压缩token面临两难：轻量编码器容易丢失关键语义，强大的MLLM筛选又会抵消效率收益；细节虽对最终理解重要，却常对初步选择相关区域冗余。

Result: VideoMM将区域选择和细致推理解耦，采用自适应感知粒度。它先从低成本、由缩小帧得到的Macro Proxy执行语义过滤，再仅在需要时将选中区域映射到高保真Micro Tokens进行细节理解。LongVideoBench实验中，较全上下文基线推理快6.13倍、准确率提高7.4%；相比当前领先方法进一步加速2.73倍。作者认为该机制适合可扩展长视频理解。

Insight: 视觉细节对答案推理有用，不代表它们都需要参与早期候选区域选择；低成本宏观代理可先定位语义相关范围，再按需读取高分辨率token。摘要未提供token削减率、准确率基线分数或额外数据集结果。

Abstract: Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates context windows and incurs prohibitive costs. Current solutions predominantly rely on auxiliary models for token reduction but face a fundamental dilemma: lightweight encoder-driven approaches often overlook critical semantic information, whereas heavyweight MLLM-driven reduction negates the efficiency gains. {In this work, we identify a more fundamental inefficiency underlying this dilemma: while fine-grained visual details are essential for detailed understanding, they are largely redundant for the preliminary task of selecting semantically relevant regions. } Motivated by this, we introduce \textbf{VideoMM}, which marks a paradigm shift from model-centric downsizing to adaptive perceptual granularity. Specifically, our framework {decouples selection from reasoning} by executing semantic filtering on a cost-effective \textit{Macro Proxy} (derived from downscaled frames), and projecting the selected regions onto high-fidelity \textit{Micro Tokens} for detailed understanding only when necessary. Extensive evaluations show that VideoMM significantly outperforms existing solutions. It achieves a 6.13$\times$ speedup and a 7.4% accuracy gain over full-context baselines on LongVideoBench, and further accelerates inference by 2.73$\times$ over current leading methods, establishing a highly scalable paradigm for long-video understanding. Our code is available at: https://github.com/adfh917k/VideoMM.

[86] LSREP: A Longitudinal State-Replay Protocol for Evaluating Conversational Memory, with ICE v2 as an Audited Local-First Architecture cs.AI | cs.CL | cs.IRPDF

Deepesh Sonar

TL;DR: LSREP提出用于对话记忆的纵向状态回放评测协议，组合有序对话回放、生命周期安排、重复探测、动态答案和机制忠实度审计；对其ICE v2案例研究既揭示常规密度数据上的近似质量—成本权衡，也发现它在LongMemEval显著落后纯向量RAG。

Details

Motivation: 对话记忆会在使用中持续变化，仅测最终问答无法判断持久状态如何累积、老化或吸收修订，也难发现某个架构机制是否真的按设计工作。

Result: LSREP结合有序回放、明确生命周期计划、重复探测、演化参考答案和机制忠实度检查，评估记忆状态随时间的变化。架构案例ICE v2是本地优先记忆中间件，包含类型化存储、检索融合和动态上下文预算。其私有单用户实例包含1,985轮交互、219个不同探针、52个检查点和1,211条探针—检查点观测。三个普通密度数据集上，ICE v2与向量RAG平均质量差异近零，但选取片段少32%、估计提示token多6.6%；第四个稠密数据集暴露了无预算基线的灾难性失败。忠实度审计发现归因受限：程序化检索存在缺陷、多个机制未被触发、图结构效用未证实。公开匹配诊断中，ICE v2在LongMemEval明显低于纯向量RAG：仅证据Oracle条件50.8%对72.8%，完整S条件43.0%对69.5%，差值分别为-22.0（95% CI [-26.6,-17.4]）和-26.5分（[-31.3,-21.8]）。

Insight: 长期记忆评估需跟踪状态随交互演化并审计机制是否真实生效；单次端点分数无法揭示时间性和实现缺陷。ICE v2在公开诊断中上下文使用更少但质量明显更差，论文据此将结果解释为质量—成本权衡，而非效率优势。

Abstract: Conversational memory changes during use, so endpoint question answering alone cannot establish how a persistent state accumulates, ages, or incorporates revisions. We introduce LSREP, a Longitudinal State-Replay Evaluation Protocol combining ordered replay, explicit lifecycle schedules, repeated probes, evolving reference answers, and mechanism-fidelity checks. Its architectural case study is ICE v2, a local-first memory middleware with typed stores, retrieval fusion, and dynamic context budgets. The private, single-user instantiation contains 1,985 turns, 219 distinct probes, and 1,211 probe-checkpoint observations across 52 checkpoints. On three ordinary-density datasets, ICE v2 has a near-zero mean quality difference from vector-RAG while selecting 32% fewer fragments but using 6.6% more estimated prompt tokens. A fourth, dense dataset exposes catastrophic failures of the unbudgeted baseline. The fidelity audit limits attribution: procedural retrieval is defective, several mechanisms are unexercised, and graph utility is not established. In a complementary matched public diagnostic, ICE v2 loses decisively to pure vector-RAG on LongMemEval: 50.8% versus 72.8% in the evidence-only oracle and 43.0% versus 69.5% in full-S. Paired differences are -22.0 points (95% CI [-26.6, -17.4]) and -26.5 ([-31.3, -21.8]). Conservative abstention accompanies severe multi-session and temporal failures. ICE uses less context in this diagnostic, establishing a quality-cost trade-off rather than superior efficiency. Together, replay, fidelity auditing, and public endpoint testing expose distinct failure modes that neither architectural descriptions nor aggregate scores identify alone.

[87] Interactive Memory Learning for Long-Term Conversations cs.AI | cs.CLPDF

Cai Ke, Jiangyue Yan, Han Zhang, Xin Liu, Zike Yuan

TL;DR: ICML将长期对话记忆从被动归档转为可学习的交互策略：规划器选择性存储高价值信息，触发器动态检索，两者通过延迟奖励和持续反馈共同演化；合成会话数据支持未见情境测试时适应，实验显示交互累积后回答质量持续提高并超过强基线。

Details

Motivation: 现有长期对话智能体多以静态启发式被动保存信息，缺少对记忆价值的自适应判断，难以随用户需求变化自我演化，也不能通过实际使用反馈优化存储与检索。

Result: ICML（交互式记忆学习）采用多智能体框架，通过会话合成流程生成专家数据，支持在未见情境中的快速测试时适应。在线强化学习由规划器代理选择性编码高价值信息，由触发器代理按需动态检索以优化回答；两者通过持续交互反馈协同演化。延迟奖励机制将未来回答反馈回传到更早的存储决策，使记忆策略与用户预期对齐。实验显示ICML显著超过强基线，并具有随交互积累而持续提升回答质量的能力。摘要未给出数据集、模型及性能数值。

Insight: 记忆管理应从一次性写入规则转为可由检索和后续回答反馈共同学习的策略；延迟奖励使系统能判断过去哪些信息选择值得保留。摘要没有报告隐私、记忆成本或长期评测规模，性能幅度也未量化。

Abstract: Recent advancements in large language models have significantly enhanced the capabilities of agents in modeling long-term conversations. Despite these successes, existing approaches typically adopt a static heuristic paradigm, where information is passively archived without adaptive memory valuation. Consequently, these methods fail to self-evolve or align their memory management with evolving user needs. To address this, we propose ICML (InteraCtive Memory Learning), a multi-agent framework that transforms the memory mechanism from a passive archive into a learnable, interactive memory policy. Specifically, we first employ a session synthesis pipeline to generate expert data, facilitating rapid test-time adaptation in unseen scenarios. Building on this, ICML utilizes an online reinforcement learning mechanism where a Planner agent selectively encodes high-value information and a Trigger agent dynamically retrieves it to optimize response quality, whereby the two agents co-evolve through continuous interaction feedback. Crucially, both agents are synchronized through a delayed reward mechanism that propagates future feedback back to earlier storage decisions, ensuring memory policies are precisely aligned with user expectations. Experimental results demonstrate that ICML significantly outperforms strong baselines, exhibiting the unique capability to continuously improve response quality as interactions accumulate.

[88] Shared-Prefix KV Reuse Across Standard LoRA Adapters: Quality and Serving Tradeoffs cs.AI | cs.CLPDF

Dushyant Rajput

TL;DR: 该研究测量标准LoRA专家间复用基础模型前缀KV缓存的质量—服务代价权衡：Qwen3-1.7B两个适配器的全前缀复用降低预填充成本并改善8K上下文预热TTFT约16倍，但GSM8K准确率有小幅、不稳定下降，且实现复制KV存储、并未节省共享缓存内存。

Details

Motivation: 小模型部署常在同一共享骨干上使用多个LoRA专家处理相同上下文，朴素方案会为每个专家重复预填充上下文。预先为缓存兼容重新训练适配器又不现实，因此需要知道已训练标准LoRA在复用基础模型KV缓存时能保留多少任务质量，以及能节省多少服务成本。

Result: 作者以Qwen3-1.7B骨干和两个适配器（HotpotQA抽取问答、GSM8K算术推理）考察专家接管复用基础缓存的边界，测量配对质量差异和服务成本。全前缀复用预填充成本最低；在留出GSM8K上，160-token预算质量差Δ=-4.6 EM，320-token为-3.0，第二个训练种子为-0.8，均偏向原生缓存，只有首项不包含零且下降幅度不稳定。部分重算没有展示优势；质量等价及通用边界规则均未建立。闭式岭回归KV转换器未超过直接复用，专家依赖性差异的置信区间均含零。服务收益体现为预热缓存下的首token时间，随上下文变长；8K时约快16倍。双分支峰值内存只降低12%，检查实现发现前缀并未在分支间物理共享，KV值虽复用但存储被复制，因此没有实现共享缓存内存节省。

Insight: 复用KV值可能大幅降低长上下文预填充时间，但未证明任务质量等价，且示例实现只省时间、不真正共享缓存内存。收益需按任务、上下文长度、随机种子和具体部署实现分别评估，不能由16倍TTFT收益推断整体服务成本同幅下降。

Abstract: A common small-model deployment runs one shared backbone with several LoRA specialists that answer over the same context. Serving them naively re-prefills that shared context once per specialist. We study a narrow, practical question: for already-trained standard LoRA adapters – not adapters retrained for cache compatibility – how much task quality is preserved if the backbone’s prefill KV cache is computed once and reused across specialists, and what does that buy in serving cost? On a Qwen3-1.7B backbone with two adapters (extractive QA on HotpotQA, arithmetic reasoning on GSM8K), we sweep the boundary at which the specialist takes over from the reused base cache and measure paired quality differences and serving cost. Full-prefix reuse had the lowest prefill cost and a small quality difference on held-out GSM8K (Delta = -4.6 EM at a 160-token budget; -3.0 at 320 tokens; -0.8 under a second training seed – all favoring native, only the first excluding zero, and the magnitude not consistent). Partial recomputation provided no demonstrated advantage. Neither quality equivalence nor a general boundary-selection rule is established. We also report a closed-form ridge KV translator that did not beat direct reuse, and specialist-dependence contrasts whose intervals all include zero. The measured serving benefit is warm-cache time-to-first-token, which grows with context (~16x at 8K); two-branch peak memory was only 12% lower and, on inspection, the prefix was never physically shared across branches – this implementation reuses KV values but copies their storage, so shared-cache memory savings are not achieved.

Amir Taubenfeld, Zorik Gekhman, Avigail Grinstein-Dabush, Itay Laish, Ariel Goldstein

TL;DR: Fuse是用于可验证社会推理的多智能体模拟框架，通过让带隐藏动机的目标代理与代表用户的代理互动，再由用户咨询被评估助手，按构造提供真实动机标签；24,000条人工标注用于验证模拟保真，并在12个LLM上分析用户框架偏差、信息需求及对话长度影响。

Details

Motivation: LLM助手被广泛用于日常社会建议，但评估此类咨询式社会推理很难：助手需要从主观用户叙述中理解情境，而他人的意图等社会属性通常缺少可验证真值。

Result: Fuse构造多智能体社会模拟：目标代理具有隐藏动机，与包括用户代表在内的其他代理互动；用户随后咨询待测助手以推断目标动机，因此真值由模拟过程明确设定。24,000条人工标注用于验证模拟保真。作者在12个LLM上评估，并系统拆分影响因素，发现用户中介叙述会加剧社会推理难度；模型对用户带偏见的描述框架敏感；有些模型需要比人类更多的细节才能做出正确预测；对话变长并不总能提高表现，即使增加了澄清问题机会。Fuse及含21,000条样例的数据集开放发布。

Insight: 通过把隐含动机设为模拟中的可见真值，Fuse将原本主观、难核验的社会推理转化为可控评测，同时可分析用户叙述如何影响结论。模拟情境保真经人工标注评估，但仍不等同于真实社会咨询场景中的有效性。

Abstract: LLM assistants are widely used for daily social advice, yet evaluating their social reasoning in such consultation settings remains challenging since (i) it requires setups where the assistant learns about social situations from subjective user narratives, and (ii) social properties, such as others’ intentions, typically lack verifiable ground truth. To address these challenges, we introduce Fuse, a multi-agent simulation framework for studying user-mediated social reasoning. In Fuse, a target agent with a hidden motive interacts with other agents including one representing the user, who then consults the evaluated assistant to infer the target’s motive, providing verifiable ground truth by construction. Simulation faithfulness is validated through a human study with 24k annotations. We apply Fuse to 12 LLMs and demonstrate its analytical utility by systematically isolating key factors, showing that (i) user mediation compounds the inherent difficulty of social reasoning; (ii) LLMs exhibit systematic sensitivity to biased user framing; (iii) models can require more details than humans need to reach a correct prediction; and (iv) longer conversations do not always improve performance despite providing opportunities for clarifying questions. We open-source Fuse and a dataset with 21k examples.

[90] ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents cs.AI | cs.CLPDF

Shuhan Xue, Jianyuan Zhong, Ziyuan Nan, Wenbin Li, Zhaochen Yu

TL;DR: ScienceBuddy是面向研究者日常工作流的交互式科学研究空间，将用户请求、反馈和执行证据转化为后续训练任务与评测规则；其递归内嵌递归机制同时演化研究工具链和强化学习模型，论文通过四类科学任务案例展示该范式。

Details

Motivation: 持续改进的科学智能体可能融入研究者的日常工作，但系统要从实际任务、用户反馈和执行结果中学习，既需优化模型，也需改进工具链及任务流程。

Result: ScienceBuddy支持研究者执行科学任务，并把请求、反馈及执行证据整理为持续学习的训练任务和评测规则。核心“递归内嵌递归”机制将工具链演化与模型强化学习结合：内层在固定模型的情况下改进工具链，外层则让模型在改进后的工具链下训练；工具链塑造模型训练经验，模型学习又提供新的工具适配机会。作者发布该研究工作空间，并给出研究者交互、工具链精炼和模型学习的案例，基准案例覆盖四类科学任务。摘要未报告各模型性能提升数字。

Insight: 科学智能体的持续改进可以同时作用于模型和其工具环境，两者构成互相推动的闭环；单纯优化模型参数无法替代工具链适配。当前摘要主要提供产品框架和案例，尚未给出与基线的量化效果或长期用户研究结果。

Abstract: We introduce and release ScienceBuddy, an interactive scientific research workspace that brings continually improving scientific agents into researchers’ everyday workflows. ScienceBuddy supports researchers in carrying out scientific tasks while transforming their requests, feedback, and execution evidence into tasks and evaluation rubrics for continual learning. At its core is recursive-in-recursive self-improvement, a paradigm that couples harness evolution with model reinforcement learning: the inner recursion improves the harness with the model fixed, while the outer recursion trains the model under the improved harness. Harness evolution shapes training experience, and model learning creates new opportunities for harness adaptation. We present case studies of researcher interaction, harness refinement, and model learning, with the benchmark cases spanning four scientific task families. By releasing ScienceBuddy as a research product, we make this paradigm available to the scientific community and take a step toward discovery intelligence: scientific AI that advances through sustained collaboration with researchers and evolves alongside the research it supports. Website: http://science-buddy.io

[91] Neuro-Symbolic Hierarchical Intention Anticipation in Human Behavior cs.AI | cs.CV | cs.HC | cs.LG | cs.NEPDF

Farnaz Soleimani, Abdelghani Chibani, Yacine Amirat, Ghazaleh Khodabandelou

TL;DR: 该神经符号层级意图预测方法在冻结识别编码器上附加紧凑规划解码器，以四层本体结构预测后续动作、剩余活动、低层意图和事件级意图，并结合软逻辑训练正则与硬可达掩码；15,002段多模态事件上，预测跨度越长优势越大，96.8%预测轨迹满足联合逻辑约束。

Details

Motivation: 辅助型自主系统需要在人的行为完成之前预测其目标。作者将意图预测定义为从部分观测多模态事件推断目标并结构化预测余下行为，而非精确预测每个运动动作；预测还需符合行为本体层级及逻辑可达性。

Result: 层级规划解码器HPD连接冻结的神经符号识别编码器，在四个本体层级预测下一动作、剩余活动、低层意图和高层事件意图。解码器用软神经符号正则训练，包括转移连贯性和层级连续性损失；推理时采用硬可达掩码确保本体有效。15,002个基于NTU RGB+D 120特征构建的多模态事件基准上，相比最强序列基线，top-5意图预测优势从第1步+1.7分扩大至第3步+7.3分；组合泛化中，每个多父节点低层意图留出一项父级关联，第1步优势为+4.9分。事件级预测中，96.8%的轨迹满足联合逻辑约束，高于最强基线88.1%及真值轨迹73.9%的指标。仅软逻辑项使高层意图可达性违反率相对降低59.8%–71.1%，硬掩码再完全消除违反。

Insight: 神经预测器提供候选排序，符号约束保证本体逻辑有效性，两者结合可实现跨层级连贯的意图预测；轨迹合法率高于真值反映标注本身也可能违反规则，不能简单理解为预测全面优于真值。作者仍指出组合目标泛化和无序集合预测待改进。

Abstract: Assistive autonomous systems must anticipate human goals before an observed behavior is complete. This article formulates anticipation as goal inference from a partially observed multimodal episode together with structured prediction of the remaining behavior, rather than exact motor forecasting. A compact Hierarchical Planning Decoder (HPD) is attached to a frozen neuro-symbolic recognition encoder and predicts, at four ontological levels, the next actions, the remaining activities and low-level intentions, and the episode high-level intention(HLI). The decoder is trained with soft neuro-symbolic regularization combining transition-coherence and hierarchical continuity losses, and is decoded with hard reachability masks that enforce ontological validity at inference. On a compositional four-level benchmark of 15,002 multimodal episodes built over NTU RGB+D 120 features, three headline properties are observed together. The advantage over the strongest sequential baseline grows with the anticipation horizon, from +1.7 points at step 1 to +7.3 points at step 3 (top-5). Under compositional generalization, where one parent association per multi-parent low level intention is held out, this advantage widens to +4.9 points at step 1. At the episode level, 96.8% of anticipated trajectories satisfy the joint logic constraints, above the 88.1% strongest-baseline value and the 73.9% ground-truth floor; soft logic terms alone account for a 59.8 to 71.1% relative reduction of HLI-reachability violations, and the hard masks then eliminate them entirely. Neural generation supplies predictive ranking, symbolic constraints supply onto logical validity, and their combination yields coherent hierarchical anticipation while exposing remaining challenges in compositional goal generalization and unordered set prediction.

cs.CR [Back]

[92] Universal Defenses for Tool-Integrated LLM Agents Against Adversarial Attacks cs.CR | cs.AI | cs.CLPDF

Xiaoyan Li, Yunli Wang

TL;DR: 该研究在四类攻击（直接/间接提示注入、记忆投毒、后门）下评估工具集成LLM智能体的通用防御，提出异常工具过滤、规划前恢复原始工具集，并结合思维链、自反思和任务改写；在七种开源与专有模型上多个设置达到0%攻击成功率且保持任务表现。

Details

Motivation: 接入外部工具的LLM智能体可执行复杂多步任务，但容易受到直接或间接提示注入、记忆投毒及后门攻击，攻击者利用模型对提示内容开放及工具调用机制进行操纵。需要能够覆盖多类威胁、便于组合的防御框架。

Result: 论文研究四类攻击下实用且可泛化的防御。提出两种通用工具层防御：攻击者工具过滤用异常检测（如孤立森林）识别并移除可疑工具；正常工具召回则以白盒方式在规划前恢复智能体原有工具集。另加入提示层防御，包括思维链提示、自反思和用于缓解攻击的任务改写。在四个开源模型（Gemma2-9B、Qwen2-7B、LLaMA3-8B、LLaMA3.1-8B）及三个专有模型（GPT-3.5、GPT-4、GPT-5）上的实验显示，多层方法显著降低攻击成功率，许多设置达到0% ASR，同时保持甚至提高原始任务成功率。

Insight: 工具层限制可疑能力与提示层强化推理能形成互补防线，比仅依赖模型拒绝提示注入更全面；正常工具恢复方法还利用系统已有白盒工具清单。摘要未列各攻击的ASR基线、误过滤率和各模型任务成功率变化。

Abstract: Large Language Model (LLM) agents have demonstrated impressive capabilities across a variety of domains, particularly when integrated with external tools for multi-step task completion. However, they are increasingly vulnerable to adversarial attacks, including direct prompt injection, indirect prompt injection, memory poisoning, and backdoor attacks, which exploit the model’s openness to prompt injection and tool manipulation. In this work, we explore practical and generalizable defense strategies within a unified framework across these four attack types. We introduce two universal tool-based defenses: Attacker Tool Filtering, which uses anomaly detection (e.g., Isolation Forest) to identify and remove suspicious tools, and Normal Tool Recalling, a white-box method that restores the agent’s original toolset prior to planning. Additionally, we incorporate prompt-based defenses: Chain-of-Thought prompting and self-reflection techniques to enhance reasoning and task paraphrasing to mitigate attacks. Experimental results across both four open-source LLMs (Gemma2-9B, Qwen2-7B, LLaMA3-8B, and LLaMA3.1-8B) and three proprietary LLMs (GPT-3.5, GPT-4, and GPT-5) show that our methods significantly reduce the Attack Success Rates (ASR), achieving 0% ASR in many settings, while preserving or even improving the original task success rate. These findings highlight the promise of simple, modular, multi-layered defenses for strengthening the security and robustness of tool-integrated LLM agents. The code is available at https://github.com/Xiaoyan-Lisa/Defenses-for-Tool-Integrated-LLM-Agents-Against-Adversarial-Attacks.

cs.GR [Back]

[93] EMODY Flow: Emotion-Aware Audio-Driven Full-Body Motion Generation cs.GR | cs.CV | cs.LG | cs.MM | cs.RO | cs.SD | eess.ASPDF

Harsh Kumar Agarwal, Xavier Alameda-Pineda, Olivier Perrotin

TL;DR: EMODY Flow是约3,500万参数的音频驱动全身动作生成框架，连接冻结Qwen-3 Omni与并行DiT，分别生成SMPL-X身体姿态和FLAME面部表情；辅助情绪分类器迫使动作表达情绪，在BEAT2上多项指标达到新SOTA，并零样本迁移到TFHP面部动画。

Details

Motivation: 具身对话智能体需要身体手势和面部表情与语音、情绪同步，但多模态大模型通常只输出语言。作者发现，流匹配模型同时接收丰富音频嵌入和离散情绪标签时，会忽略较弱的情绪条件，生成几乎相同的动作。

Result: EMODY Flow是轻量流匹配框架，接入冻结Qwen-3 Omni并复用其Mimi音频编解码器，条件输入分别驱动两个并行DiT：一个生成人体SMPL-X姿态，另一个生成FLAME面部表情。训练时加入辅助情绪分类器，迫使生成动作能够识别情绪，从而恢复对情绪条件的敏感性。BEAT2手势质量上达到新SOTA：FGD为0.302、Beat Correlation为0.853、Diversity为24.62，较先前最佳结果分别改善26%、5%和62%。此外，无需领域专用微调即可迁移到TFHP进行零样本面部动画。多维尺度分析定性显示生成手势按情绪明显分离。

Insight: 条件生成器可能因强音频信号而忽略较弱离散情绪条件；训练期增加对情绪可识别性的辅助目标可让该条件真正影响运动。方法复用冻结全模态模型音频编码，摘要未报告端到端延迟及TFHP量化结果。

Abstract: Embodied conversational agents require synchronized full-body motion (body gestures and facial expressions) that aligns with speech and emotional state. Omni-modal large language models excel at multimodal understanding but produce only linguistic outputs, leaving a critical gap in embodied response generation. We identify and address a failure of emotion conditioning: like other conditional generators that under-use weak conditioning signals, a flow-matching model given both a rich audio embedding and a discrete emotion label suppresses the emotion, generating near-identical motion regardless of the specified emotion. We present EMODY Flow, a lightweight (around 35M parameters) flow-matching framework that attaches to a frozen Qwen-3 Omni model and reuses its internal Mimi audio-codecs to condition two parallel DiT generators - one for SMPL-X body pose, one for FLAME facial expressions. A training-time auxiliary emotion classifier restores emotion sensitivity by forcing generated motion to be emotion-identifiable. EMODY Flow sets a new state of the art on BEAT2 gesture quality, with FGD 0.302, Beat Correlation 0.853, and Diversity 24.62 - improving over the best prior results by 26%, 5%, and 62% respectively - and transfers to zero-shot facial animation on TFHP without domain-specific fine-tuning. Beyond these quantitative gains, the classifier yields clearly emotion-separated motion, which we demonstrate qualitatively through a multidimensional-scaling analysis of the generated gestures.

cs.HC [Back]

[94] CareMirror: Bringing Caregiver Wellbeing into the Dementia Care Ecosystem cs.HC | cs.AI | cs.CL | cs.CYPDF

Jiayue Melissa Shi, Ethan Nguyen, Drishti Goel, Upasana Natarajan, Shashwat Srivatsa

TL;DR: CareMirror是一个构想中的痴呆照护者福祉生态系统，通过照护者与临床人员界面支持纵向反思、个性化帮助及由照护者控制的临床信息共享；对14名照护者的访谈显示，他们重视持续关注和有意义的临床跟进，也担心反思负担及自动分享抑制坦诚表达。

Details

Motivation: 痴呆患者家庭照护者承担大量情感和实际责任，但他们自身福祉常被排除在照护体系之外。将福祉支持连接到临床服务有潜力提供后续帮助，同时也涉及隐私、信息控制和情绪负担等问题。

Result: CareMirror被设计为相互连接的照护者端和临床端福祉生态系统，用于长期反思、个性化支持及由照护者控制是否向临床照护共享信息。作者对14位照护者进行半结构化访谈，并以CareMirror作为设计探针了解他们对系统的看法、期待、顾虑及临床连接边界。参与者认可关注自身福祉、纵向了解情况、结合上下文的支持，以及能促成有意义跟进的临床可见性；但反复反思可能带来负担或情绪困难，自动分享可能阻碍坦诚披露，参与者希望控制哪些信息进入临床照护。他们也希望AI辅助反思与沟通，但不替代照护者的声音或临床判断。论文提出面向主动、临床连接式照护者福祉支持的设计考量。

Insight: 纵向记忆和临床连接可提供持续支持，但数据共享控制权应由照护者掌握；AI应辅助表达而不替代个人或临床判断。研究是14人访谈和设计探针，并非干预效果试验，不能据此推断长期心理健康改善。

Abstract: Family caregivers of people living with dementia shoulder emotional and practical responsibilities, yet their own wellbeing often remains peripheral to dementia care. We built CareMirror, an envisioned caregiver wellbeing ecosystem with interconnected caregiver- and clinician-facing interfaces for longitudinal reflection, personalized support, and caregiver-controlled sharing with clinical care. We conducted semi-structured interviews with 14 caregivers, using CareMirror as a design probe to examine how they perceived this ecosystem and what expectations, concerns, and boundaries emerged around clinical connection. Caregivers valued attention to their wellbeing, longitudinal awareness, context-sensitive support, and clinical visibility when it could lead to meaningful follow-up. However, repeated reflection could become burdensome or emotionally difficult, automatic clinical sharing could inhibit candid disclosure, and participants wanted control over what information entered clinical care. They also expected AI to support reflection and communication without replacing caregiver voice or clinician judgment. We contribute design considerations for proactive, clinically connected caregiver wellbeing support.

cs.LG [Back]

[95] Anatomy of Associative Recall in Fixed-State Recurrences: A Matched-State Decomposition, an Interference Wall, and a Curriculum That Breaks It cs.LG | cs.CLPDF

Julian Boesch, Andrew Wee

TL;DR: 该研究在固定状态预算下分解线性注意力和状态空间递归模型的关联回忆能力，发现短因果卷积是主要增益来源，架构类别优势并不稳固；稀疏监督下的干扰是失败主因，而距离课程可将特定设置准确率从0.021提升到1.000。

Details

Motivation: 线性注意力和状态空间等固定状态递归模型在关联回忆上常被报告弱于注意力模型，但整架构比较无法判断差异来自哪些组件。作者希望在状态预算固定时，分离卷积、状态转移结构和衰减对回忆能力的作用。

Result: 研究沿三个单因素比较轴分解掩码多查询回忆：短因果卷积、rank-1 delta规则与对角状态转移、以及衰减。匹配训练下，卷积在两类模型中均主导收益，回忆率约提升0.5；rank-1转移在16/32对时分别比对角消融高0.19/0.32，但给双方都加卷积后优势缩至0.03，状态匹配的Mamba-2也与无卷积rank-1单元打平，因此没有稳定的模型类别优势。可完成32对回忆的单元随负载增加逐步退化，但在干扰海中从中检索4对会降至随机，且不同长度和转移设置均如此。距离课程在不改变架构时将该设置从0.021提升至1.000；锁定训练从10个种子中1个升至7个（p=0.02），密集监督没有额外收益。长度256时，塑形课程可恢复均匀课程失效的边界（4/5对0/9）；长度512时塑形课程失效，但按准确率门控后6/6成功（p=0.001）。双向去噪器没有显著优于因果训练，碰撞键检索需要两层；回忆增强对S5状态跟踪护栏任务无额外代价。

Insight: “递归模型不擅长回忆”过于笼统：短卷积和课程监督比状态转移类别更能决定结果，核心瓶颈是稀疏监督下的干扰及训练是否锁定。报告的一些高分来自特定结构、序列长度和种子设置，不能直接外推为普遍能力。

Abstract: Fixed-state recurrences–linear attention and state-space models–are reported to lag behind attention on associative recall, but whole-architecture comparisons cannot say which ingredient is responsible. We decompose masked multi-query recall at a fixed state budget along three single-knob axes: a short causal convolution, the transition structure (rank-1 delta rule vs. diagonal), and decay. The convolution dominates (~+0.5 recall in both families under matched training): comparisons that pit convolution-free cells against a convolution-equipped Mamba measure the missing convolution, not the recurrence. The rank-1 transition beats its diagonal ablation by +0.19/+0.32 at 16/32 pairs, but the margin shrinks to +0.03 once both cells carry the convolution, and a state-matched Mamba-2 ties the unarmed rank-1 cell: no class claim survives. Cells that solve 32-pair recall degrade gracefully with load yet fall to chance retrieving 4 pairs from a distractor haystack–flat across lengths and transitions. Interference under sparse supervision, not capacity: a distance curriculum takes the unchanged architecture from 0.021 to 1.000. Training is a lock-in lottery–a seed either locks in or does not–and the curriculum is the lever. Lock-in rises from 1/10 to 7/10 (p=0.02); dense supervision adds nothing; at L=256 a shaped ramp reopens a boundary the uniform curriculum cannot (4/5 vs. 0/9); and at L=512, where the ramp collapses (0/6), gating it on measured accuracy locks in 6/6 (p=0.001). Bidirectional denoiser cells, reading the query before the haystack, show no measurable advantage over causal training (ten seeds), and collision-key retrieval needs two layers. Arming for recall is free on an S_5 state-tracking guardrail–the armed cell is significantly better at every depth (p<=0.0044). These replace “recurrent models are bad at recall” with a measured decomposition and two cheap interventions.

[96] GrowMTP: Can RL Grow Its Own Draft Head? cs.LG | cs.CLPDF

Minghua He, Lingzhe Zhang, Yuan Liu, Xiao Zhou, Aiwei Liu

TL;DR: GrowMTP在强化学习训练循环内部从零学习草稿头，利用rollout验证过程提供与当前策略分布匹配的监督，且将头部更新与策略骨干分离；三个模型上rollout加速1.36–2.13倍、端到端加速1.20–1.60倍。

Details

Motivation: 大语言模型强化学习后训练的耗时主要来自自回归rollout生成，推测解码可加速，但现有草稿头通常需在RL之前预训练或预热，带来额外成本，削弱对RL运行的加速收益。

Result: GrowMTP利用RL过程本身具备的两个条件：rollout分布比预训练分布窄，验证步骤持续产生与当前分布对齐的监督信号。方法在RL循环内部从头训练草稿头，不预先训练，并将所有草稿头更新与策略骨干梯度分离。Qwen3-4B（无草稿头）、MiMo-7B-SFT（弱草稿头）和Qwen3.5-4B-Base（强草稿头）上的rollout加速比分别为2.13、1.93和1.36倍；端到端加速比分别为1.60、1.41和1.20倍。该方法可模块化接入现有RL训练框架，尤其为没有预训练草稿头的模型提供从零加速途径。

Insight: RL验证信号天然适合训练服务当前策略分布的草稿头，可避免单独预训练和额外暖启动；不过草稿头越强时额外加速越小，端到端收益也低于单看rollout的加速。摘要未给绝对训练时长或验证开销。

Abstract: Reinforcement learning (RL) post-training drives the frontier capabilities of large language models, with its wall-clock dominated by autoregressive rollout generation. Speculative decoding is an established remedy for this bottleneck, but existing draft heads must be pretrained or warmed up before RL, introducing substantial training cost outside the RL run to be accelerated. We observe that RL training itself provides both conditions required for online draft-head training: its rollout distribution is far narrower than that of pretraining, and its verification step continuously produces supervision signals aligned with this distribution. Building on these observations, we propose GrowMTP, which uses this supervision to train a draft head from scratch entirely within the RL loop, with all head updates detached from the policy backbone. On Qwen3-4B (no draft head), MiMo-7B-SFT (weak head), and Qwen3.5-4B-Base (strong head), GrowMTP achieves rollout speedups of 2.13x, 1.93x, and 1.36x, and end-to-end speedups of 1.60x, 1.41x, and 1.20x, respectively. GrowMTP therefore serves existing RL training frameworks as a modular component, particularly offering a from-scratch acceleration path for models without pretrained draft heads.

[97] ImpossibleRubrics: Stress-Testing Generated Rubrics as Reward Signals cs.LG | cs.CLPDF

Bowen Qin, Yi Xie, Yesheng Liu, Xi Yang

TL;DR: ImpossibleRubrics是含169个不可解任务和48个可解控制的评分规则对抗基准，每题附可验证证书规定诚实回答可主张内容；11种规则生成器在无偏切分上有8%–26%可被利用，定制规则有时反而泄露可伪造主张，统一通用规则被利用率64%。

Details

Motivation: LLM生成的评分规则被用于基于规则的强化学习、LLM评审和自动评分，但只有当规则奖励诚实回答、而非利用漏洞的对抗回答时才可靠。生成规则在面对专门优化攻击时的稳健性尚不清楚。

Result: ImpossibleRubrics聚焦不可解任务：提示诱导模型给出缺乏依据的结论，但诚实回答只能承认无法完成。基准含六类169个不可解任务，每题附可验证Oracle证书，规定诚实回答可与不可主张的内容，并包含48个可解控制任务。它提供任务环境和证书而非固定评分规则，供下游生成规则再对抗测试。11种评分规则生成器在169题中预先定义的无偏150题切分上，有8%–26%的情况会被利用；在刻意挑选的压力切分上，最强受测生成器仍有36%被利用，而遵循证书的评分规则被利用率为0%。通用规则“要果断、惩罚犹豫”不变地用于所有任务时，被利用率为64%；11种生成器中有7种在撰写任务定制规则时被利用得更频繁。作者认为定制标准可能反而告知攻击者应伪造什么主张。

Insight: 评分规则的问题不只是含糊，而可能是对错误维度过度具体，给优化者提供伪造目标；诚实证书可作为检验奖励是否允许无依据主张的基准。压力切分是有意挑选的，不应与无偏切分的生成器利用率混为一谈。

Abstract: Language model-generated rubrics are increasingly used as reward signals for rubric-based reinforcement learning, LLM-as-a-judge evaluation, and automated grading. Such rubrics are reliable only if they reward honest answers over adversarial answers optimized to exploit them. Yet their robustness to such optimization remains poorly understood. We isolate the hardest regime: impossible tasks, where the prompt pressures the model toward an unsupported conclusion, so the only honest response is to acknowledge the impossibility. We introduce ImpossibleRubrics, a benchmark of 169 impossible tasks spanning six impossibility categories, each paired with a verifiable oracle certificate specifying what an honest answer may and may not claim, together with 48 answerable controls. Rather than providing fixed rubrics, ImpossibleRubrics provides task environments and certificates, allowing rubrics to be generated downstream and then adversarially tested for whether they reward certificate-violating answers. Eleven generators are exploited 8–26% of the time on the unbiased 150-of-169 environment cut; on a deliberately selected stress cut the strongest generator we measured is still exploited 36% while a certificate-faithful rubric is exploited 0%, so what we measure is a rubric-quality gap, not task impossibility. One result runs against intuition. A single generic rubric (“be decisive, penalize hedging”) used unchanged for every task is exploited 64% of the time, and seven of the eleven generators are exploited more often than that while writing a rubric tailored to each one. The tailored criteria appear to tell an attacker which claim to fabricate. The problem is not that rubrics are vague; it is that they are specific about the wrong things.

[98] LoopSpec: Pipelined Self-Speculative Decoding for Looped Transformers cs.LG | cs.CLPDF

SangLyul Cho, Langqing Cui, Sehoon Kim, Dongsu Han, Insu Han

TL;DR: LoopSpec为循环Transformer提出免训练流水化自推测解码，从早期循环状态生成草稿，并与当前token验证重叠执行；必要时选择更深层第二候选以提升草稿准确率，同时保持贪心和采样解码无损，在推理和代码基准上最高加速6.83倍。

Details

Motivation: 循环Transformer反复使用共享Transformer块，参数量较小但每个递归深度都需访问权重，因此解码延迟高于参数规模相近的标准Transformer。它的中间循环状态天然能提供草稿预测，适合无需额外草稿模型的自推测解码。

Result: LoopSpec从早期递归状态提取草稿token，并以流水方式将未来token草稿生成与当前token目标验证并行重叠。为提高草稿准确率而不引入过多计算，方法选择性地从更深递归层产生第二个候选。该方法无需训练，并在贪心与采样解码下均保持无损。论文闭式推导最优候选深度，且预测与实测吻合。在多种循环Transformer的推理和代码基准上，最高推理加速比为6.83倍。

Insight: 循环模型内部的中间状态可直接替代独立草稿模型；流水化将循环计算隐藏在目标验证之后，减少额外延迟。第二候选只在有收益时使用，以控制开销；摘要未提供各模型平均加速比及吞吐—内存权衡。

Abstract: Looped Transformers achieve strong performance with compact parameter sizes by repeatedly applying a shared stack of Transformer blocks across recurrent depths. However, they incur higher decoding latency than standard Transformer models of comparable parameter size because shared weights are accessed at every recurrent depth. To improve decoding efficiency, self-speculative decoding is particularly well suited to Looped Transformers, as their intermediate recurrent states can directly provide draft predictions without an auxiliary draft model. We therefore propose LoopSpec, a training-free self-speculative decoding framework tailored for Looped Transformers. LoopSpec extracts draft tokens from early recurrent states and operates in a pipelined manner, overlapping draft generation of future tokens with target verification of the current token. To improve draft accuracy without excessive compute overhead, we introduce a selective second proposal from deeper recurrent depth while ensuring lossless decoding under both greedy and sampling regimes. Furthermore, we derive the optimal proposal depths in closed form and show the prediction matches measurement. Across reasoning and coding benchmarks, LoopSpec achieves up to 6.83$\times$ inference speedup across diverse Looped Transformers.

[99] Easy to Catch a Liar, Hard to Clear an Honest One: Language Models Diagnosing a Corrupted Reward Channel from a Verified Record cs.LG | cs.AI | cs.CLPDF

Arman Nik Khah

TL;DR: 该研究用两选项游戏检验冻结LLM能否依据一条独立验证记录判断奖励报告者是否说谎；模型几乎总能识别说谎者，却常把诚实报告者错判为骗子，72B模型在无变化及奖励变化条件下误报率分别达38%和58%。

Details

Motivation: 智能体从奖励学习时必须信任报告奖励的人。若奖励报告突然变化，仅凭报告可能无法区分环境变化和报告者故障；理论上需要关于报告者本身的更丰富数据。作者研究冻结语言模型能否利用一条经核验的独立结果。

Result: 研究构造两选项游戏，使“奖励对调”和“报告者说谎”产生逐字节相同的历史，然后增加一条经独立验证的真实结果，并与报告者对该轮的说法并列提供。要求三个来自两个模型系列的大模型仅用一个字母回答报告者诚实或说谎。模型几乎完美识别说谎者；70B级模型在所有所测条件下都保持这一表现，32B模型只在一种措辞中失误。但它们识别诚实报告者的能力低得多，且受无关表面特征影响：72B模型在环境未改变时38%将诚实者判为骗子、奖励已变化时为58%；另一系列70B模型分别为26%和48%。这不是单纯阅读困难，因为当情况未改变且提示直接印出答案时，同一模型得分为0.96–1.00。Qwen对记录标注哪一轮敏感，Llama对“诚实”对应哪个选项字母敏感；当提示已给出答案时再加入记录反而降低Llama正确回答概率。

Insight: 模型可识别显式欺骗，却倾向于把奖励变化过度归咎于诚实报告者，说明校验能力受措辞、轮次和选项编码等无关因素支配；直接给出答案时表现良好也不能保证模型能基于证据独立判断。结论来自受控小型游戏，不能直接外推所有奖励通道。

Abstract: An agent that learns from rewards has to trust whatever reports those rewards. When the reports suddenly change, either the world changed or the reporter broke. From the reports alone these are indistinguishable, and reinforcement learning theory shows that no amount of further experience separates them. The prescribed escape is richer data about the reporter itself. We ask whether a frozen language model, handed exactly that data, uses it. We build a two-option game in which a payout swap and a lying reporter produce byte-identical histories. Then we add one verified record: an independent check of one round’s real result, printed beside what the reporter said about that round. That single line settles the case. We ask three large models, from two families, to answer one question with one letter. Is the reporter honest or lying? They catch a lying reporter almost perfectly. At the 70B class that holds in every condition we tried; the 32B model slips in one wording. They clear an honest reporter far less often, and how often depends on things that should not matter. Averaged over rounds, letters, and wordings, a 72B model calls an honest reporter a liar 38% of the time when nothing has changed at all, and 58% of the time when the payouts moved. A 70B model from a second family calls an honest reporter a liar 26% and 48% of the time. The failure is not one of reading, because in the situation where nothing changed the same models score 0.96 to 1.00 with the answer printed in the prompt. Which surface feature drives it differs by family. For the Qwen models it is which round the record names, and for Llama it is which letter stands for “honest.” Adding the record to a prompt that already states the answer makes Llama less likely to give that answer. We had registered a prediction for that 58% before the run: 35%. The failure is larger than we expected.

[100] OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation cs.LG | cs.AI | cs.CVPDF

Chenhao Qiu, Dawei Li, Yechao Zhang, Lei Gong, Zhen Tan

TL;DR: OPD-Aha针对多模态在线策略蒸馏中的错误推理共识问题，通过比较同一教师在真实图像和视觉空输入下的预测，提取独立视觉纠正偏好来重构蒸馏目标；训练后的学生会用“等等、其实”等反思token打断错误链，在细粒度感知和复杂多模态推理基准上获得广泛提升。

Details

Motivation: 特权在线策略蒸馏允许教师使用训练专用视觉证据评价学生轨迹，但学生若在早期误读图像，累积错误理由可能逐渐使教师也偏离视觉证据，师生最终达成同一幻觉，导致需要纠错时常规跨模型差异监督反而失效。

Result: 作者发现，即使教师和学生在误导性前缀下预测趋同，教师的视觉纠正偏好仍保留：比较相同教师在真实图像和视觉空输入下的预测，可以识别特权视觉信息施加的纠正方向。OPD-Aha直接从这一隔离的视觉偏好重建蒸馏目标，而非依赖脆弱的师生差异，强力压低与图像矛盾的续写。训练后的学生会自然用“wait”“actually”等反思token中断错误推理，后续生成减少依赖累积的错误文本、更多依据视觉证据。方法在多种细粒度感知和复杂多模态推理基准上取得广泛且一致的提升。

Insight: 即使教师被共享错误前缀误导，真实图像相对于视觉空输入仍提供可测的纠错信号；将该信号直接用于目标重建，可避免蒸馏监督在师生共同幻觉时坍塌。摘要未列基准名称、具体增益或视觉空输入构造细节。

Abstract: Privileged on-policy distillation improves multimodal reasoning by allowing a teacher to evaluate student trajectories using rich, training-only visual evidence. Both models score these trajectories while conditioning on the same student-generated prefix. When a student misinterprets an image early in a response, this accumulating erroneous rationale eventually pulls the teacher away from its visual evidence. The teacher and student converge on the same hallucination, causing standard cross-model supervision to collapse precisely where correction is most needed. We find that the teacher’s visual corrective preference is not lost under this misleading agreement. Comparing the predictions of the identical teacher given the real image and a visual null reveals that the privileged evidence still pushes the model toward the correct interpretation. We introduce OPD-Aha, which reconstructs the distillation target directly from this isolated visual preference rather than relying on the fragile teacher-student discrepancy. This reconstructed target aggressively suppresses continuations that contradict the image. Trained with this objective, students learn to naturally interrupt their own flawed reasoning with reflection tokens such as wait and actually. After reflection, subsequent generation relies less on the accumulated erroneous text and more on the visual evidence. Correcting these trajectories mid-generation fundamentally alters the reasoning process, yielding broad and consistent improvements across diverse fine-grained perception and complex multimodal reasoning benchmarks. Our code and models are available at https://github.com/Echochef/OPD-Aha.

[101] Efficient Reasoning Distillation: Small Video-Language Models via Synthetic CoT and Difficulty-Aware Fine-Tuning cs.LG | cs.AI | cs.CVPDF

Mantek Singh, Jeshwanth Challagundla, Siddharth Raina, Jasmin Jarsania

TL;DR: 该方法用不确定性筛选约900个样本，为其配合4B教师生成的思维链来微调2B视频语言模型；单张A100训练不足两小时后，模型在CinePile、ActivityNet-QA和MLVU上超过最多大4倍的VLM并接近自身4B教师，且将推理理由放在答案后反而更有效。

Details

Motivation: 视频问答需要模型具备多步推理，但将推理能力蒸馏到紧凑视频语言模型可能需要大量算力和示范数据；有限容量下，常规思维链提示顺序是否最优也尚不确定。

Result: 研究提出低成本蒸馏流程：先按不确定性从视频问答样本中筛选约900条，再为每条加入4B教师生成的合成思维链，用于微调2B模型。训练在单张A100 GPU上耗时不足两小时。该模型在CinePile、ActivityNet-QA和MLVU上超过最多大4倍的VLM，并接近自己的4B教师表现。一个关键发现是，将思维链理由放在答案之后而非标准的答案前，显著改善小模型推理。

Insight: 小模型推理蒸馏可通过不确定性选样提高有限训练预算的利用率；思维链顺序也可能需要按模型容量调整，照搬“大模型先推理后作答”并非总是最佳。摘要未提供各基准准确率和训练样本筛选阈值。

Abstract: We present an efficient method to distill reasoning capabilities into compact video-language models (VLMs) for video question answering (VideoQA). Our approach fine-tunes a 2B-parameter model using only $\sim$900 uncertainty-selected examples, each augmented with synthetic chain-of-thought (CoT) rationales generated by a 4B teacher. Despite its minimal compute cost - under two hours on a single A100 GPU - our method enables the 2B model to outperform VLMs up to 4$\times$ larger, and generalize across CinePile, ActivityNet-QA, and MLVU, approaching the performance of its own 4B teacher. A key finding is that placing CoT rationales after the answer - contrary to standard prompting - substantially improves reasoning in compact models. This insight challenges prevailing CoT conventions and reveals new alignment strategies under limited model capacity. Our findings offer a practical blueprint for training deployable, reasoning-rich VLMs suited for mobile and edge applications.

[102] Knowledge as Orbit: Finite Collections as Phases of an Exactly Periodic Latent Generator cs.LG | cs.CV | eess.IVPDF

Siddharth Pal, Viktoria Rojkova

TL;DR: 该研究将有限知识集合从逐项存储改为紧凑潜在动力学生成的周期轨道，利用整数谐波旋转确保经过X步精确回到起点；循环视频与内容自身时间结构对应，七个基准片段上等参数下保真度不低于索引基线且无循环接缝。

Details

Motivation: 有限知识通常以每个对象单独存放的代码或向量进行外延式记忆。作者探问能否通过一个紧凑规律将知识内涵式存储为潜在空间中精确闭合的生成轨道，并将图像作为受控内容、循环视频作为具有内在时间顺序的情形。

Result: 对X个对象，方法将第i项编码为学习潜空间中固定旋转的第i个相位，并由共享网络解码所有相位。潜变量通过整数周期谐波的旋转组推进，形成实离散傅里叶算子，使R的X次方严格等于单位算子，因此周期闭合由代数保证而非训练学习。固定解码器、仅改变算子时，一般学习算子会漂移，保持范数但非周期算子在循环附近退化，精确周期算子表现平坦；真实图像上的差距更大。容量受解码器预算决定：稠密解码器对清晰图像有无法靠尺寸协调的结构开销，小型卷积解码器则可在共享流形对象上实现清晰压缩。码本控制显示生成规律在重建上免费，却可让潜存储扩大数倍。七个基准视频片段与帧索引基线相比，循环法等参数下保真度相当或更好，且机器精度下闭合，而基线有可见接缝；将基线频率限制到循环谐波后接缝也消失，确认周期约束是关键。

Insight: 有限循环知识可以由共享解码器加周期动力学表示，而非储存相互独立的帧/实例；严格周期性来自算子代数性质。生成规律未必节省总存储，码本对照显示latent存储可能多倍增长；有效压缩依赖小型共享解码器和对象共享流形。

Abstract: Finite knowledge is usually stored extensionally, one code or vector per item. We ask whether a finite collection can instead be stored intensionally, as the decoded orbit of one compact law that returns exactly to its start. For X objects, we encode item i as the i-th phase of a fixed rotation in a learned latent space and decode all phases with a shared network; the latent advances through a bank of rotations at integer harmonics of the cycle, a real discrete Fourier operator, so that R^X equals the identity and exact closure is guaranteed rather than learned. Images are a controlled carrier; looping video is the case where the phase order is the content’s own temporal structure. Holding the decoder fixed and varying only the operator, a general learned operator diverges, a norm-preserving but non-periodic one degrades around the loop, and the exactly periodic operator is flat; on real images the gap widens. Capacity is then the decoder’s budget: dense decoders carry a structural overhead per crisp image that no size reconciles with compression, while a small convolutional decoder on objects that share a manifold reaches crisp and compressed. A codebook control shows the generative law is free in reconstruction terms while multiplying the latent store many-fold. On seven benchmark clips, against a matched frame-index baseline, the cycle reaches equal or better fidelity at equal parameters while wrapping at machine precision, where the baseline leaves a visible seam; pinning the baseline’s frequencies to loop harmonics closes its seam too, confirming that exact periodicity is the operative constraint. Finite cyclic knowledge can be stored as dynamics rather than independent instances, with exact recurrence supplied by algebra and content by a shared decoder.

cs.RO [Back]

[103] World-Action Models for Robot Learning and Control: A Survey cs.RO | cs.CVPDF

Zuxing Lu, Hongjia Zhai, Guanzhi Wang, Huajian Zeng, Jiaqi Yang

TL;DR: 该综述将世界—动作模型（WAM）定义为将未来世界预测与可执行动作生成结合的机器人模型，按表征、转移建模、动作接口、架构、训练、模态和扩展策略整理方法，并回顾操作、导航和自动驾驶应用及评测协议。

Details

Motivation: 开放环境中的机器人面对部分可观测、物理约束和动态任务。仅将观察与语言映射到动作不够，还需预测候选动作如何改变未来状态和任务结果。世界模型、视频生成和VLA策略的发展推动了结合预测与执行的WAM研究，但概念边界、方法分类和评测仍需系统梳理。

Result: 综述从机器人视角回顾WAM，区分其与传统世界模型、基于模型的强化学习、动作条件视频生成及反应式VLA策略的范围。作者构建统一分类体系，按表征、状态转移建模、动作接口、架构、训练流程、数据模态和扩展策略组织现有方法；总结操作、导航及自动驾驶应用，并梳理WAM数据集、基准、指标和协议。最后讨论动作对齐、世界—动作因子分解、空间及多视角一致性、长程记忆、闭环策略学习用神经仿真和高效推理等挑战。

Insight: WAM强调预测未来世界与生成可执行动作的耦合，目标是补足纯反应式策略对动作后果的缺乏建模；统一分类可帮助比较不同路线。该文为综述，不报告单一模型实验结果，摘要中的挑战清单代表作者归纳。

Abstract: Robots operating in open environments act under partial observability, physical constraints, and dynamic task contexts. Beyond mapping observations and language instructions to actions, they must anticipate how candidate actions may affect future states and task-relevant outcomes. Recent advances in world models, video generation, and Vision-Language-Action (VLA) policies have motivated the development of World-Action Models (WAMs), which couple future world prediction with executable action generation. This survey provides a robotics-oriented review of WAMs. We clarify their scope relative to conventional world models, model-based reinforcement learning, action-conditioned video generation, and reactive VLA policies, and organize existing methods through a unified taxonomy covering representations, transition modeling, action interfaces, architectures, training pipelines, data modalities, and scaling strategies. We further review applications of WAMs in manipulation, navigation, and autonomous driving, and we summarize the datasets, benchmarks, metrics, and protocols used to evaluate WAM systems. Finally, we discuss key challenges in action alignment, world-action factorization, spatial and multi-view consistency, long-horizon memory, neural simulation for closed-loop policy learning, and efficient inference. Taken together, this survey aims to provide a concise technical foundation for integrating predictive world modeling with action generation, toward more reliable embodied robot intelligence. Project page: https://rcl-robotics.github.io/Awesome-World-Action-Models.

[104] Occupancy Network-Guided Autonomous Robotic Partial Nephrectomy cs.RO | cs.CVPDF

Ethan Kilmer, Pit Henrich, Jiawei Ge, Paul M. Scheikl, Laura Connolly

TL;DR: 该工作提出首个视觉引导的自主部分肾切除系统，可由单视角部分点云在线重建肿瘤、边缘组织和肾脏三维解剖，并在组织切割变形后持续跟踪和调整计划；患者来源水凝胶模型上完成8次自主切除、77次切割，全部达到阴性切缘。

Details

Motivation: 自主软组织癌症手术目前主要局限于器官表面操作，因为系统难以在组织变形或被切开后继续感知并适应解剖变化。肿瘤切除需精确控制切缘，要求机器人能闭环更新组织状态和操作计划。

Result: 系统利用完全在物理仿真中训练的条件占据网络，从单视角部分点云推断肿瘤、切缘组织和肾脏的完整3D解剖；网络在组织切割和变形后仍能跟踪状态，支持自适应规划执行。平台结合深度相机、用于电外科切割和真空组织操作的双机械臂，以及自主切除控制策略。在开放式部分肾切除设置的患者来源水凝胶模型上，机器人连续完成8次自主肿瘤切除，共77次电外科切割，全部获得阴性切缘；切缘平均绝对误差为1.61±0.48毫米。

Insight: 在仿真中训练的条件占据网络可支持真实感软组织模型上的闭环解剖重建和切割适应，推进了从器官表面操作到完整肿瘤切除的自主手术能力。结果仍是在水凝胶模型中完成，不能等同于患者临床手术验证。

Abstract: Autonomous soft-tissue cancer surgery has been limited to interventions on organ surfaces, because current systems cannot perceive and adapt to anatomy once it deforms or is cut. We introduce the first vision-guided autonomous system capable of performing complete tumor resections for partial nephrectomy. Our system integrates conditional occupancy networks, trained entirely in a physics-based simulation, that infer full 3-D anatomy (tumor, margin tissue, and kidney) from single-view partial point clouds. These occupancy networks maintain intraoperative tracking even as tissue is cut and deformed, enabling adaptive planning and execution. The surgical platform combines a depth camera for capturing surface point clouds, dual robotic arms for electrosurgical cutting and vacuum-based tissue manipulation, and an autonomous control strategy for tumor resection. In patient-derived hydrogel phantoms under an open partial nephrectomy setting, the robot performed eight consecutive autonomous tumor resections comprising 77 electrosurgical cuts, with all cuts achieving negative surgical margins and 1.61 $\pm$ 0.48 mm mean absolute margin error. This work demonstrates, for the first time, a foundation for supervised autonomous closed-loop, imaging-driven, margin-negative tumor removal in phantoms.

Hojin Lee, Sizhe Lester Li, Maximilian Hilger, Susie Lu, Achim J. Lilienthal

TL;DR: CueNav将视觉提示引导的视频规划与适配具体机器人的逆动力学模型结合：鸟瞰图提供全局任务上下文，第一人称画面保留机器人本体信息，逆动力学将视频计划光流转换为动作；迷宫成功率近乎翻倍，狭窄通道成功率达70%，并展示零样本语义导航和跨平台部署。

Details

Motivation: 生成式视频模型可预测未来观测作为机器人导航计划，但现有方法多使用短时域引导，并通过场景重建提取几何路点，较少研究长时域规划和将视频内容精确转成动作。

Result: CueNav用鸟瞰图BEV表达全局任务上下文，并在自我中心图像中保留部分机器人身体以提供具身信息，再将这些视觉提示输入视频规划器。面向具体机器人的逆动力学模型将视频计划中提取的稠密光流转为机器人动作。提供全局任务线索后，迷宫导航成功率接近无提示规划的两倍；本体感知视图与逆动力学结合后，狭窄通道成功率达70%，而对比方法大多无法完成。作者还展示零样本语义条件导航，并在不同机器人平台上部署同一视频规划器。

Insight: 视频规划需要同时编码“去哪里”的全局目标和“如何移动”的本体约束；具身视图配合逆动力学可把视觉未来转换为可执行控制。摘要未给迷宫成功率绝对值、跨平台数量或长时域长度。

Abstract: Generative video models can serve as a promising backbone for robot navigation by predicting future observations as video plans. Recent approaches often condition video planning on short-horizon guidance and recover geometric waypoints through scene reconstruction, leaving longer-horizon planning and precise video-to-action translation less explored. We present CueNav, a video model-based navigation framework combining visual cue guided video planning with an embodiment-specific Inverse-Dynamics Model (IDM). As visual cues, we use a Bird’s-Eye View (BEV) map to convey global task context and retain part of the robot body in the egocentric observation to expose embodiment context. These cues guide the video planner, while the IDM translates dense flow fields extracted from the video plan into robot actions. With the visual cue encoding global task context, CueNav achieves nearly 2x higher success in maze navigation than planning without the cue. The body-aware view with the IDM enables precise navigation with 70% success in a narrow passage where comparison methods largely fail to complete the task. We further demonstrate zero-shot semantic-conditioned navigation and deployment of the same video planner across different robot platforms. Our results show that visual cue-guided video planning with embodiment-specific action grounding paves the way toward a generalizable navigation framework for longer-horizon planning and embodiment-aware control. Additional results and code are available on our project website: https://cuenav.github.io.

[106] TEMPO: Learning Temporal Context for Dynamic Robot Manipulation cs.RO | cs.CV | cs.LGPDF

Zhenyang Feng, Jimin Heo, Erik B. Sudderth, Unnat Jain

TL;DR: TEMPO为预训练VLA补充两种时间上下文：冻结视频基础模型提取运动摘要以消除运动歧义，紧凑本体感觉历史消除状态别名，无需改动骨干且计算开销小；四项动态操控任务中瓶子递交成功率从44%升至74%，并发布5万余帧TEMPO-Bench。

Details

Motivation: VLA在准静态操控中表现良好，但推理时只看单帧，难处理动态任务。单帧无法揭示物体运动趋势，形成运动歧义；不同任务阶段外观相似却需不同动作，形成状态别名。作者认为这两种失败来自缺少时间上下文，而非模型规模或延迟。

Result: TEMPO向预训练VLA加入两种时间输入：冻结视频基础模型提取的运动摘要用于解析动态，紧凑本体感觉历史用于区分状态别名。方法无需修改VLA骨干，训练和部署额外计算开销有限。在四项动态操控任务中，瓶子递交成功率从44%升至74%，并且只有TEMPO能解决所测状态别名问题。探针和消融实验确认每种时间信号分别应对对应失败模式。作者还发布TEMPO-Bench，含超过5万帧标注数据，用回归和多项选择形式评估运动感知机器人能力。

Insight: 动态操控瓶颈可能是缺少时序信息，而非增加骨干参数；从外部提取运动摘要和利用短本体历史可分别补足物体动态与任务阶段状态。摘要未列其余三项任务结果或基准与现有方法的总体比较。

Abstract: Vision-language-action (VLA) models have achieved impressive performance in quasi-static manipulation, but struggle in dynamic manipulation tasks because they operate on a single observation at inference time. We identify two representational failures that underlie this limitation. The first is motion ambiguity, where a single observation does not include scene dynamics and therefore cannot anticipate the future state of moving objects. The second is state aliasing, where visually similar observations from different points in a task require different actions. We argue that these failures persist regardless of model scale and inference latency, showing that the bottleneck is missing temporal context rather than model capacity. Based on this insight, we propose TEMPO, which augments a pretrained VLA with two temporal inputs: a motion summary extracted from a frozen video foundation model to resolve motion ambiguity and a compact proprioceptive history to resolve state aliasing. TEMPO requires no modification to the backbone and adds minimal compute overhead at training or deployment. Across four dynamic manipulation tasks, it improves Bottle Handover success from 44% to 74% and is the only method that solves state aliasing. Probing and ablation studies confirm that each temporal signal independently addresses its corresponding failure. We further release TEMPO-Bench, a benchmark of over 50k annotated frames for evaluating motion-aware robot perception in both regression and multiple-choice formats. Project Website: https://tempo-robot.github.io/

[107] HuMemSLAM: Efficient Human-Inspired Semantic Place Recognition for Robust Visual SLAM cs.RO | cs.CVPDF

Mayowa Adebambo, Sebastian Donnelly, Armand Amaritei, Andrew Bradley, Alexander Rast

TL;DR: HuMem-VPR借鉴人类记忆与感知，将自下而上的视觉证据与自上而下上下文推理双向结合以识别地点，并集成到HuMemSLAM；真实图像基准检索准确率最高、CARLA上有竞争力，延迟约为受测先进VPR方法的三分之一至二分之一，并提高ORB-SLAM3集成Recall@1。

Details

Motivation: 自主系统依赖可靠地点识别支持同时定位与建图。传统几何视觉SLAM易受感知混淆（不同地点外观相似）和感知变化（同一地点外观不同）影响；语义SLAM和学习式视觉地点识别虽增强鲁棒性，但实时部署还需兼顾检索准确率与低延迟。

Result: HuMem-VPR利用自下而上感知证据与自上而下上下文推理的双向关系，实现高层地点理解；HuMemSLAM则将其集成到ORB-SLAM3。HuMem-VPR在真实图像基准上的汇总检索准确率最高，在CARLA基准上保持竞争力，延迟约比所评估的先进VPR方法低2至3倍。在所测数据集系列和在线实验中，HuMemSLAM明显提高了相较ORB-SLAM3原生检索的集成Recall@1，同时减少送入几何后端的候选数量。

Insight: 利用上下文推理帮助解释当前视觉证据，可在外观重复或变化时改善地点识别；集成到SLAM后，候选数量减少也能降低后端负担。摘要未列出基准名称、Recall@1数值和延迟绝对值。

Abstract: Autonomous systems require reliable place recognition for efficient and effective simultaneous localisation and mapping (SLAM). Traditional geometric visual SLAM approaches rely on low-level features and geometric consistency, but remain vulnerable to perceptual aliasing, where different places appear similar, and perceptual variation, where the same place appears different. Although semantic SLAM and modern learned visual place recognition (VPR) methods improve robustness under challenging perceptual conditions, real-time deployment requires both high retrieval accuracy and low latency. Inspired by human memory and perception, we propose HuMem-VPR, which exploits the bidirectional relationship between bottom-up perceptual evidence and top-down contextual reasoning to achieve high-level place understanding. We further introduce HuMemSLAM, the integration of HuMem-VPR with ORB-SLAM3. HuMem VPR achieved the highest aggregate retrieval accuracy on the real-image benchmark, competitive accuracy on the CARLA benchmark, and approximately two to three times lower latency than the evaluated state-of-the-art VPR methods. Across the evaluated dataset families and online experiments, HuMemSLAM substantially improved integrated Recall @1 over ORB-SLAM3’s native retrieval while reducing the proposals submitted to its geometric backend.

Table of Contents

cs.CV [Back]

[1] MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineering cs.CVPDF

[2] SceneBench: A Hierarchical Benchmark for Vision-Language Understanding of 3D Scenes cs.CV | cs.AIPDF

[3] Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics cs.CVPDF

[4] ProtoLIP: From Sentence-Level to Object-Level Evidence Disentanglement cs.CV | cs.AIPDF

[5] Reasoning with Image Generation cs.CVPDF

[6] A multimodal large language model for evidence-based autism spectrum disorder screening cs.CV | cs.HC | cs.LGPDF

[7] MDN-Control: Mask-Depth-Noise Guided Region Control for Multi-Subject Video Editing cs.CVPDF

[8] VPRef: A Cross-Domain Benchmark for Referring Remote Sensing Image Segmentation cs.CVPDF

[9] Which Pretext Task Transfers? Self-Supervised Pretraining Objectives for Lung Ultrasound cs.CVPDF

[10] Vision And Text Transformer For Predicting Answerability On Visual Question Answering cs.CV | cs.AIPDF

[11] Counterfactual Reasoning for Robust Visual Question Answering cs.CVPDF

[12] FLAT: Resampling Image and Text into 1D Flexible-Length Aligned Transmodal Tokens for Retrieval and Generation cs.CVPDF

[13] FRPSS: Feature Rearrangement in Pre-Shape Space for Single-Image Generation cs.CVPDF

[14] A Vision-Language Foundation Model for Precise and Comprehensive Brain Tumor Diagnosis from Preoperative Multimodal Data cs.CV | cs.AI | cs.DBPDF

[15] SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation cs.CVPDF

[16] EgoPathBench: Evaluating Zero-Shot Egocentric Waypoint Decision-Making in Vision-Language Models cs.CVPDF

[17] Can Knowledge Transfer Parameters Be Learned? LePoKet for Efficient Robotic Vision cs.CV | cs.LGPDF

[18] What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes cs.CV | cs.MMPDF

[19] ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models cs.CV | cs.MMPDF

[20] Channel-Wise and Token-Aware Post-Training Quantization for Visual State Space Duality cs.CVPDF

[21] Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA cs.CVPDF

[22] Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videos cs.CVPDF

[23] MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild cs.CVPDF

[24] Efficient Quantization-Aware Distillation with Cross-Modal Alignment for Edge Vision-Language Models cs.CVPDF

[25] MAETrack: Unleashing the Potential of Pretrained Geometric Priors for 3D Single Object Tracking cs.CVPDF

[26] IMVS: Interactive Medical Volume Segmentation with Test-Time Adaptation - A New Method for Annotating Radiology Datasets cs.CVPDF

[27] Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics cs.CVPDF

[28] Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation cs.CVPDF

[29] StackTok: Accelerating VLMs Inference with Budget-Adaptive Visual Token Selection cs.CV | cs.AIPDF

[30] RegRet: Enhancing Region-Level Retrieval in Large Multimodal Models cs.CV | cs.AI | cs.IRPDF

[31] TecoPrompt: Temporal-Conservative Prompt Learning for Vision-Language Models cs.CVPDF

[32] tcnerv:dual-domain temporal context modeling for implicit neural video compression cs.CVPDF

[33] SPEAR NeXT Causal Latent Forecasting Across Multiple Horizons for Spectral Temporal Earth Representation Learning cs.CVPDF

[34] NeuroTS-Net: Multi-Class Semantic Segmentation of Pediatric Brain Tumors in Multi-Modal MRI cs.CV | cs.LGPDF

[35] Accelerated Decoding of Centroid Positional Encoding for Instance Segmentation cs.CVPDF

[36] Multi-modal Knowledge Preserving Adapter for Embedding Backward Compatibility cs.CVPDF

[37] VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal cs.CV | cs.AIPDF

[38] PiPS: Post-Hoc Prototypical Explanations for Interpretable Semantic Segmentation cs.CVPDF

[39] NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving cs.CVPDF

[40] High-Fidelity Video Quality Assessment with VQA-Specific Saliency cs.CVPDF

[41] MedPCFM-TED: One-Step Point Cloud Flow Matching for Implant Generation via Teacher-Guided Endpoint Distillation cs.CV | cs.LGPDF

[42] Symmetry-Aware Likelihood-Orbit Aggregation for Selective Left-Right Claim Verification cs.CVPDF

[43] sensVLA: Spatially-Grounded Vision-Language-Action Model for Autonomous Wheel Loader cs.CV | cs.ROPDF

[44] Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement cs.CVPDF

[45] Beyond In-Distribution Metrics: A Systematic Out-of-Distribution Evaluation of Congenital Heart Disease Segmentation cs.CV | cs.AIPDF

[46] Hub-Spectral Activation of Latent Multimodal Knowledge cs.CVPDF

[47] GeoLAM: Learning Geometry-Grounded Latent Actions from Unlabeled Human Videos cs.CV | cs.ROPDF

[48] Not Another Text Benchmark: Putting the “Visual” Back in Visual Question Answering for Large Video Models cs.CVPDF

[49] Predicting Human Disagreement for Calibrated Dynamic Facial Expression Recognition cs.CVPDF

[50] Event-based Selective Attention for Multi-resolution Fast Region of Interest (ROI) Detection cs.CV | cs.NEPDF

[51] ResLRP: The Role of Residual Cancellation in Attribution Instability in Vision Transformers cs.CV | cs.AI | cs.LGPDF

[52] MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis cs.CV | cs.AIPDF

[53] Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM cs.CV | cs.AIPDF

[54] Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection cs.CVPDF

[55] FROD: Feature Matching Residual Denoising Oracle Bone Decipher cs.CV | cs.AIPDF

[56] DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming cs.CVPDF

[57] Video-HolmesV2: Can MLLMs Reason with Spatio-Temporal Audio-Visual Evidence in Long Videos? cs.CVPDF

[58] Semantic-Spatial Agreement Verification for Mitigating Object Hallucination in Multimodal Large Language Models cs.CVPDF

[59] SlotDiT: Object-Centric Representations for Diffusion Transformers cs.CV | cs.ROPDF

[60] BrainFocus: EEG-Guided ROI Selection for Efficient Vision-Language Models cs.CVPDF

[61] Tables Decoded: DELTA for Structure, TARQA for Understanding cs.CV | cs.LGPDF

[62] PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control cs.CV | cs.AI | cs.GRPDF

cs.CL [Back]

[63] Crash Narrative-Guided Countermeasure Recommendation Using Large Language Models: A Retrieval-Augmented Generation Framework for Intersection Safety cs.CL | cs.LGPDF

[64] Self-reported archetypes and behavioral failures in Large Language Models cs.CL | physics.soc-phPDF

[65] ViCo: Visual-oriented Coding with Self-Reflection for Chart Replication cs.CL | cs.GR | cs.LGPDF

[66] Retrieval-Driven Memory Reconsolidation for Long-Term LLM Agents cs.CL | cs.AIPDF

[67] State of Thought Enables Endogenous Reasoning cs.CL | cs.AIPDF

[68] Towards Scalable RLVR: Multimodal Instruction Following Data Synthesis and Distillation cs.CL | cs.LGPDF

[69] Efficient Multimodal Generative Recommendation with Latent Narrative Reasoning cs.CL | cs.AIPDF

[70] The Imitation Game: When LLMs Learn to Reason Like Programs via Code-Centric Reasoning Data Synthesis cs.CL | cs.AIPDF

[71] Spurious Tool Use: When RL Agents Learn the Wrong Reason to Act cs.CLPDF

[72] Register Tokens for Bounded-State Reasoning in Diffusion Language Models cs.CLPDF

[73] Negation Beyond the Verbal Channel: Temporal Multimodal Correlates in Dialogue cs.CLPDF

[74] PunGraph: Retrieval-Enhanced Phonetic-Semantic Graph Reasoning for Pun Understanding cs.CLPDF

[75] Rewarding Reasoning, Not Answers: Fixing and Bounding Test-Time Reinforcement Learning on Medical QA cs.CLPDF

[76] TIAO: Token Importance-Aware Policy Optimization for Text Summarization cs.CLPDF

[77] RiskChainBench: A Benchmark for Obfuscated Platform Message Restoration and Evidence-Grounded Web Investigation cs.CLPDF