cs.CV [Total: 62]
cs.CL [Total: 23]
cs.AI [Total: 2]
cs.AR [Total: 2]
cs.CR [Total: 1]
cs.GR [Total: 1]
cs.IR [Total: 1]
cs.LG [Total: 4]
cs.MM [Total: 1]
cs.RO [Total: 11]
eess.IV [Total: 3]
q-bio.GN [Total: 1]

cs.CV [Back]

[1] Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment cs.CV | cs.AI | cs.LGPDF

Henry O. Velesaca, David Freire-Obregon, Luigi Miranda, Abel Reyes-Angulo

TL;DR: 该研究评估开源视觉语言模型对奥运跳水视频的零样本动作质量打分，发现将模型文本推理特征用于集成回归比直接采用模型分数更有效。

Details

Motivation: 奥运动作质量评估需要理解复杂人体运动，而专家评分又具有主观性。作者希望检验开源视觉语言模型能否在不针对任务训练的条件下分析跳水动作，并支持可解释的半自动评估。

Result: 研究在 AQA-7 基准上评估 VLM，并提出回归集成框架，将模型生成的语义推理与阶段子分数结合，经过 TF-IDF、降维和集成学习预测最终比赛分数。单独 VLM 的 Spearman 相关低于 0.32；四模型集成达到 0.67。文本推理特征持续优于原始数值子分数，说明解释文本含有丰富动作质量信息。

Insight: 当前 VLM 直接打分能力有限，但其分阶段语义分析可以作为回归模型的有效特征；更适合把模型用作可解释的辅助分析工具，而非独立裁判。

Abstract: Automated action quality assessment (AQA) in Olympic sports remains a challenging task due to the complexity of human motion and the subjectivity inherent in expert judging. This work evaluates the capability of open-source Vision-Language Models (VLMs) to perform zero-shot action quality assessment on Olympic diving videos using the AQA-7 benchmark dataset. In this regard, a regression-based framework is pro-posed to leverage both the semantic reasoning and phase-level sub-scores generated by the VLMs, combining TF-IDF vectorization, dimensionality reduction, and ensemble learning to predict final competition scores. Experimental results show that standalone VLMs achieve moderate Spearman correlations below 0.32, while the proposed ensemble regression framework substantially improves performance in the reported evaluation, reaching a Spearman correlation of 0.67 with a four-model configuration. Textual reasoning features con-sistently outperformed raw numerical sub-scores, highlighting the richness of VLM-generated explanations for action quality analysis. These findings suggest that VLMs hold strong potential as assistive tools for explainable and semi-automated sports performance evaluation. The code is publicly available on GitHub https://github.com/hvelesaca/olympic diving judge vlm

[2] RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment cs.CVPDF

Fangjie Li, Mai Bui, Charan Mohan, Michael Miga, Matthieu Chabanas

TL;DR: RAUL 用高质量参考探索视频辅助定位后续输尿管镜视频轨迹，并由重建轨迹计算技能指标，且无需额外跟踪设备。

Details

Motivation: 输尿管镜手术中未能完整导航肾脏解剖区域可能导致再次干预。虽然经验更丰富的医生再干预率更低，但缺少客观量化镜体导航表现、判断受训者技能水平的指标。

Result: RAUL 先用每个仿体的一段慢速高质量参考探索视频建立参考重建，再将后续探索视频定位到该参考中。作者以电磁跟踪镜体姿态评估定位精度，并根据仿体探索轨迹计算导航指标、比较不同经验住院医师。九个仿体上的平均平移 RMSE 为 0.5±0.1 毫米；相较标准 SfM，逐帧定位覆盖率从 50.5±14.9% 提升至 86.1±7.2%。重建轨迹的既有导航指标能显著区分高、低经验受训者。

Insight: 以仿体参考视频约束后续视频定位，可以在无需外部跟踪传感器的情况下大幅补足传统 SfM 的轨迹缺失，为规模化、自动化的技能评估提供视频路径。

Abstract: Objective: Incomplete navigation of anatomy during ureteroscopic kidney stone surgeries can contribute to repeat interventions. While skilled surgeons have lower reintervention rates, there are no objective metrics to quantify scope-navigation performance to evaluate when a trainee becomes skilled. This work aims to recover ureteroscope trajectories from endoscopic video and derive navigation metrics to quantify differences in skill. Methods: We propose RAUL, a reference-assisted reconstruction framework for recovering ureteroscope trajectories from ureteroscope videos only in phantoms. For each phantom, we use a slow, high-quality reference exploration video to generate a reference reconstruction. We localize subsequent exploration videos against this reference. We evaluate localization accuracy against electromagnetically tracked scope pose. We compute navigation metrics from phantom exploration trajectories to compare surgical residents across experience levels. Results: The proposed reference-assisted framework achieves a mean translation root mean square error of $0.5 \pm 0.1$ mm across 9 phantoms. Compared to standard Structure-from-Motion (SfM), the proposed pipeline increases frame-wise localization coverage from $50.5 \pm 14.9%$ to $86.1 \pm 7.2%$ of all video frames. The reconstructed trajectories revealed significant differences between high- and low-experience trainees in established navigation metrics. Conclusion: RAUL enables substantially more complete recovery of ureteroscope trajectories from videos compared to standard SfM pipelines, enabling trajectory-based skill assessment without additional tracking equipment. Significance: To the best of our knowledge, this is the first use of video-only recovery of ureteroscope trajectories without external tracking sensors for skill assessment, supporting scalable automated assessment of ureteroscopy navigation skill.

[3] Riemannian–Lorentz Fusion of Vision Transformers and State-Space Models cs.CV | cs.AI | cs.CL | cs.MMPDF

Badri N. Patro, Vijay S. Agneeswaran

TL;DR: RLPF 将 ViT 与状态空间模型的语义对应参数组映射到共同坐标，在洛伦兹双曲空间做正则化测地重心融合，并通过输入相关门控组合双分支输出。

Details

Motivation: 模型合并可避免从头训练的成本，但现有权重合并通常要求架构和参数形状对齐。视觉 Transformer 与状态空间模型使用不同 token 混合算子，异构融合需要保留两种架构并建立语义角色对应。

Result: 作者提出黎曼-洛伦兹参数融合 RLPF：对齐参数组投影至共同坐标，将部分坐标提升到洛伦兹双曲面，求正则化测地重心后解码回两分支；归一化参数仍按欧氏空间处理，学习门控按输入组合分支 logits。微调后在 CIFAR-10、Oxford-IIIT Pet 和 ImageNet-1K 分别达到 82.37%、75.04% 和 78.58%，高于各自最佳父模型。ImageNet-1K 的报告初始化结果为 77.80%。

Insight: 双曲几何可作为异构网络参数语义对齐的一种融合工具，但作者明确指出 RLPF 不是免训练的单模型合并：最终系统保留双分支，门控和最终模型均经过训练。

Abstract: Scaling deep learning faces critical bottlenecks: data exhaustion, exponential training costs, and resource concentration. Model merging combines pre-trained checkpoints without gradient descent, offering orders-of-magnitude savings versus retraining. Combining independently trained vision models is difficult when their architectures and parameter shapes differ. Existing weight-space merging methods generally assume aligned, shape-compatible checkpoints, whereas a Vision Transformer (ViT) and a state-space model (SSM) implement token mixing with different operators. We study a hybrid Heterogeneous merging setting that retains both architectures while aligning parameter groups by semantic role. Our proposed Riemannian–Lorentz Parameter Fusion (RLPF) method projects aligned groups to common coordinates, lifts selected coordinates to the Lorentz hyperboloid model of hyperbolic space, computes a regularized geodesic barycenter, and decodes the result into the two branches. A learned gate then combines branch logits for each input. Component groups use fixed curvature values, with normalization parameters treated as Euclidean. In the results available in this manuscript, the fine-tuned system obtains 82.37% on CIFAR-10, 75.04% on Oxford-IIIT Pet, and 78.58% top-1 accuracy on ImageNet-1K; the corresponding best-parent accuracies are 76.54%, 71.42%, and 76.42%. On ImageNet-1K, the reported pre-fine-tuning initialization reaches 77.80%. These results support further study of geometry-aware heterogeneous fusion, but not a training-free single-checkpoint merge: RLPF is a two-branch hybrid whose gate and reported final models are trained.

[4] WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones cs.CVPDF

Nishad Sahu, Changzhong Qian, Guangzhou Cai, Shounak Sural, Ragunathan

TL;DR: WZPlanner 发布包含合成与真实工区驾驶样本的数据集，并用 BoundaryFormer 联合预测车道边界、工区边界和轨迹，提升闭环工区驾驶得分。

Details

Motivation: 施工工区的临时交通管制和道路封闭会改变车道几何，车载地图可能没有记录；结构化几何监督的公开数据又稀缺，限制自动驾驶系统感知和规划的泛化。

Result: WorkZonePlan 含 14.9 万余合成及 5 千余真实多模态样本，为车道边界、工区边界和驾驶轨迹提供 3D 标注，并含 76 个 CARLA 闭环场景在三种天气下回放得到的 228 条评测路线。半自动生成流程 WAVE 配合 BoundaryFormer 联合预测边界多项式和轨迹；消融发现使用边界 slot 特征的独立轨迹解码器优于仅用 slot attention。增强版 BF++ 有相机及相机加激光雷达变体。在四模型共同的 211 条路线中，两变体得分 63.0 和 64.4，高于 SimLingo 的 59.3 和 TransFuser++ 的 26.1，模型也更小。

Insight: 工区驾驶中将道路边界结构和轨迹共同预测，能利用临时几何约束改善规划；数据集同时含仿真与真实样本，闭环评测关注驾驶表现而不仅是离线感知。

Abstract: Work zones alter lane geometry through temporary traffic controls and closures that may be absent from on-board maps, challenging autonomous vehicle (AV) perception and planning. Generalization is also limited by scarce public datasets with structured geometric supervision. We present WorkZonePlan, a dataset comprising 149K+ synthetic and 5K+ real-world multimodal samples with 3D annotations for lane boundaries, work zone boundaries, and driving trajectory options. It also provides 76 closed-loop CARLA scenarios replayed under three weather conditions, yielding 228 Bench2Drive-format evaluation routes. We introduce WAVE (Work-zone-focused AV data generation in Virtual and rEal Environments), a semi-automated pipeline for creating the dataset, and BoundaryFormer (BF), a transformer-based model that jointly predicts lane and work zone boundary polynomials and driving trajectories. BF uses slot attention for boundary prediction. Ablations show that a separate trajectory decoder using boundary slot features substantially improves trajectory prediction over a slot-attention-only approach. Building on this finding, BF++ offers Camera and Camera+LiDAR variants with metric ground-plane encoding, typed boundary/trajectory queries, long-range point anchors, image-space curve refinement, and conservative gated LiDAR fusion. On the 211 routes common to all four models at the evaluation freeze, BF++-Camera and BF++-Camera+LiDAR achieve Driving Scores of 63.0 and 64.4, respectively, compared with 59.3 for SimLingo and 26.1 for TransFuser++ (TF++). BF++ is 40 times smaller than SimLingo and more than 10 times smaller than TF++, while achieving higher Driving Scores. These results support jointly predicting lane boundaries, work zone boundaries, and driving trajectories as a promising direction toward safer AV operation in work zones. Code and dataset: https://github.com/Nishad-Sahu/WZPlanner.

[5] Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge cs.CVPDF

Dayoung Kil, Seong-heum Kim

TL;DR: EUMU 以共享多模态模型联合完成图像多概念标签、开放词汇检测和图像描述，并在挑战赛资源限制下通过任务间线索复用取得赛道第一。

Details

Motivation: MUMU 挑战要求单个高效模型同时处理多概念图像标签、开放词汇目标检测和图像描述，独立运行各任务会错失互补信号，也可能难满足移动场景资源预算。

Result: EUMU 基于共享预训练多模态模型，利用提示能力做检测和描述，并在共享视觉特征上训练轻量头预测图像质量、场景和事件标签。推理时跨任务复用结果：描述线索帮助找回漏检目标，检测结果反过来修正描述，图像统计与检测、描述输出共同改进标签预测。模型含 239.169M 参数、23.947 GFLOPs、峰值推理显存 4.5GB，在第八届 LSVOS MUMU 赛道获得 17.3409 分并夺冠。

Insight: 三个视觉任务之间可互相提供校验线索；统一模型共享表示并在推理时跨任务修订，有助于同时提高一致性和控制计算资源。

Abstract: The Mobile Unified Multimodal Understanding (MUMU) Challenge requires a single efficient model to jointly perform multi-concept image tagging, open-vocabulary object detection, and image captioning. We present Efficient Unified Multimodal Understanding (EUMU), the winning solution for the MUMU Track of the 8th LSVOS Challenge. EUMU builds on a shared pretrained multimodal model, using its prompt-based capabilities for detection and captioning and training lightweight heads on shared visual features to predict quality, scene, and event tags. Rather than treating the three tasks independently, EUMU applies task-aware inference refinement by reusing task outputs as cross-task cues. For detection, caption cues help recover objects missed by the initial detection. For captioning, detection cues help refine the caption to better reflect the detected objects. For tagging, image statistics refine quality predictions, while caption and detection cues refine scene and event predictions. This design unifies all three tasks within a single model while satisfying the challenge’s resource constraints. EUMU contains 239.169M parameters, requires 23.947 GFLOPs, uses 4.5 GB of peak inference memory, and achieves a final challenge score of 17.3409. Code and models are available at https://github.com/Dayoung-Kil/EUMU.

[6] ParticleSplat: Self-supervised Object-centric Latent Particle Splatting cs.CV | cs.ROPDF

Lyuxing He, Daniel Guo, Elizabeth Terveen, Deepak Pathak, David Held

TL;DR: ParticleSplat 将场景表示为物体中心的潜在粒子，并转成与粒子对齐的三维高斯，通过多视角重建自监督学习三维结构和可编辑表征。

Details

Motivation: 二维潜在粒子方法能以对象为中心表示图像，但缺乏明确三维几何和空间推理能力，限制其用于机器人操作等具身下游任务。

Result: ParticleSplat 在 DLP 思路上构造三维潜在粒子空间，用新视角合成目标训练。模型联合编码带相机位姿的多视图到共享三维对象中心潜在空间，再将粒子变换为粒子对齐的 3D Gaussian，其组合可重建完整场景。在模拟和真实数据上，模型无需监督即可学出对象掩码，并支持通过修改潜在粒子移动物体等可控三维场景编辑；学习到的三维表示也提升了机器人操作下游表现。

Insight: 将二维对象粒子与三维高斯基元对应，使潜在对象表示能够承载显式空间结构；多视角一致性既提供自监督信号，也让编辑操作可作用于物体级表示。

Abstract: We present ParticleSplat, a self-supervised object-centric learning method that decomposes scenes into a set of latent ‘’particles’’ representing semantic entities through feedforward 3D Gaussian Splatting. Building on the Deep Latent Particles (DLP) framework, which represents images as a set of particles with attributes such as position, scale, and visual appearance, we address a key limitation of DLP: its inherently 2D nature, which prevents explicit 3D spatial and geometric reasoning that are critical for downstream tasks such as robotic manipulation. Leveraging the structural similarity between latent particles and 3D Gaussian primitives, we introduce a 3D latent particle space trained with a novel view synthesis objective. Our model jointly encodes multiple views with camera poses into a shared 3D object-centric latent space, then transforms particles into particle-aligned 3D Gaussians whose composition reconstructs the full scene. On simulated and real-world datasets, we show that this formulation inherently learns object masks without supervision and supports controllable 3D scene editing, such as moving objects by modifying particles in the latent space. We further establish that the learned 3D representation improves downstream performance on robotic manipulation tasks.

[7] SCOUT: Sim-to-Real Text-Based Person Retrieval by Embedding-Space Prediction over Frozen Video Features cs.CV | cs.IRPDF

Abdarahmane Traoré, Andy Couturier, Éric Hervet

TL;DR: SCOUT 将合成到真实的文本行人检索转为冻结视频特征到文本嵌入空间的预测，再用参数高效适配和属性重排提高首位精度。

Details

Motivation: 用合成数据训练、在真实图库检索的跨模态行人检索通常依赖昂贵微调交叉编码器。作者考察冻结编码器的预测式嵌入方法能否竞争，并分析哪些对齐与重排策略可迁移到真实域。

Result: SCOUT 用可训练预测器把冻结 V-JEPA 视频编码器的 patch token 映射到冻结 EmbeddingGemma 文本嵌入空间，采用双向 InfoNCE，基础模型不微调编码器。训练免对齐分数可正确排序三个候选文本编码器的检索表现；ExPLoRA 视频编码器适配和基于 VLM 的属性分解重排使排行榜 R@1 增加 2.2 点。AI City Challenge 2026 Track 4 上完整检索-融合-重排系统 mAP@10 为 84.25，单独提交的冻结模型为 60.63；训练组件总开销约 95 GPU 小时。

Insight: 冻结跨模态编码器能否匹配，取决于嵌入几何是否相近；冻结基线的首位精度短板可通过有针对性的轻量适配和属性重排弥补。论文特别说明 CMP 微调交叉编码器只是完整系统的一个融合成员，不能当作替代方案。

Abstract: Text-based person retrieval under a sim-to-real gap (synthetic training data, a real-image gallery) is usually tackled with costly fine-tuned cross-encoders. We ask whether a frozen-encoder system can compete. We present SCOUT, which casts cross-modal retrieval as prediction in embedding space. A trainable predictor maps the patch tokens of a frozen video encoder into the embedding space of a frozen text encoder under a bidirectional InfoNCE objective, and no encoder is fine-tuned in the base model. The video encoder is V-JEPA, the text encoder is EmbeddingGemma, and the predictor is initialized from a Qwen3.5-0.8B decoder. We make three findings. First, the best frozen text encoder is simply the one whose geometry best matches the video features. A training-free alignment score ranks three candidate text encoders in the same order as their retrieval accuracy on our held-out split (Spearman $ρ= 1.0$); a fourth, LLM-based encoder shows the rule is metric-dependent, holding for a neighborhood-overlap score ($ρ= 0.8$) but not for a linear probe ($ρ= -0.2$). Second, two precision-targeted levers, parameter-efficient ExPLoRA adaptation of the video encoder and a training-free attribute-decomposed reranker built on a vision-language model, improve the top-rank precision that otherwise limits the frozen system, adding 2.2 points of leaderboard R@1. Third, a local-versus-public calibration study explains which interventions transfer to the real domain. On AI City Challenge 2026 Track 4 the full retrieve-fuse-rerank system reaches 84.25 mAP@10 on the final leaderboard, while a single frozen model submitted alone reaches 60.63. Our trained components cost about 95 GPU-hours. CMP, the dataset authors’ fine-tuned cross-encoder that trains for sixteen GPU-days, is one fusion member of the full system, not an alternative. Code and annotations: https://github.com/abtraore/SCOUT-ECCV

Khang Nguyen Quoc, Minh-Phuoc Tran, Gia-Han Truong, Luyl-Da Quach

TL;DR: SOLAR 把番茄叶病理解建模为生成式视觉问答，覆盖六类诊断任务，并用融合专家模块对齐视觉特征与任务相关语言表征。

Details

Motivation: 现有植物病害方法多把症状识别、严重程度评估和问答诊断当作彼此孤立的预测任务，难以综合视觉症状和语义上下文形成完整且可解释的诊断理解。

Result: SOLAR 使用基于混合专家的融合模块对齐视觉特征和任务感知语言表示，把番茄病害分析组织为单模型多任务生成式 VQA。评测数据包含 41,677 张图像和 216,209 组问答，覆盖封闭式与开放式 QA。作者报告 SOLAR 在所有任务上持续超过视觉单模态、视觉语言及专用任务模型，在准确性、鲁棒性和多模态推理方面表现更强。

Insight: 将诊断过程统一为问题驱动的生成任务，允许在症状、严重程度和解释之间共享知识；单一多模态模型因而能从多个任务中学习互补的植物病理语义。

Abstract: Artificial intelligence for plant disease analysis has advanced from task-specific classifiers to multi-modal models capable of jointly interpreting visual and textual information. However, practical deployment in precision agriculture remains limited because most existing approaches treat disease understanding as isolated prediction tasks, failing to capture the complementary relationships among symptom recognition, severity assessment, and question-driven diagnostic reasoning. In tomato pathology, accurate interpretation of diseased leaves requires more than label prediction; it demands integrating visual symptoms with semantic context to support a comprehensive and explainable understanding. Here, we present SOLAR, a multimodal generative model that understands tomato disease spanning six question-answering tasks. SOLAR learns to align visual features with task-aware language representations by Fusion Expert module based on mixture-of-expert, enabling it to generate contextually relevant answers across diverse diagnostic tasks. By formulating tomato disease analysis as a generative Visual Question Answering (VQA) task, SOLAR provides a flexible framework that supports multi-task inference within a single model while improving performance and cross-task knowledge sharing. We evaluate SOLAR on $41,677$ images, including $216,209$ Question-Answering (QA) pairs to understand tomato leaf disease under both closed and open-ended QA settings. Experimental results show that SOLAR consistently outperforms state-of-the-art vision-only, vision-language, and task-specific models across all tasks, demonstrating superior accuracy, robustness, and multimodal reasoning. These findings highlight the potential of generative multimodal modeling as an effective direction for understanding of plant disease. The code for this study is available at https://github.com/EnalisUs/SOLAR.

[9] Selective Cotton Boll Localization for Robotic Harvesting: Evaluation of Deep Learning Vision Models Under Field Conditions cs.CV | cs.ROPDF

Thevathayarajh Thayananthan, Xin Zhang, Isuru Laddusinghe Badu, Jonathan Harjono, Glen C. Rains

TL;DR: 该研究在田间条件比较多代 YOLO 与多种分割模型用于棉铃定位，并在 UR5e 机械臂采摘实验中验证 YOLOv12-m-seg 的实时感知效果。

Details

Motivation: 选择性机器人采棉需要在自然光照、天气和现场复杂背景下准确检测并分割棉铃，模型既要满足定位精度，也要能以足够速度驱动机械臂。

Result: 研究采集三台相机拍摄的 1,008 张田间标注图像，比较 YOLOv8 至 YOLOv13 检测器及多种直接和检测提示分割方法。检测模型中 GELAN-s 在 mAP、速度间较均衡，mAP 86.1%、F1 79.0%、单图 42.3 毫秒；直接分割中 YOLOv12-m-seg 的 AP@0.5 为 83.7%、单图 20.4 毫秒。面积对照中该模型对人工分割掩码的 R² 为 0.966，高于 GELAN-s + SAMv2.1 Tiny 的 0.860。UR5e、定制末端执行器和 ZED2i 双目相机的田间采摘实验进一步验证了其实时检测、分割和选择性采摘能力。

Insight: 田间最终评价不能只看离线 AP，还需检查掩码面积是否吻合并验证机械臂实际作业；该工作把检测速度、分割精度和机器人采摘连成完整评测链。

Abstract: This study developed and evaluated a deep-learning-based perception framework for selective robotic cotton picking. The dataset contained 1,008 annotated field images collected using three cameras under varying natural lighting and weather conditions. Object-detection models from the YOLOv8 through YOLOv13 families were evaluated using their default configurations, while segmentation performance was assessed using YOLOv8-seg, YOLOv11-seg, YOLOv12-seg, the Segment Anything Model (SAM), SAMv2.1, FastSAM, and Grounded-SAM with the Recognize Anything Model (RAM). Among the detection models, GELAN-s achieved the most favorable balance between mean average precision (mAP) and inference speed, obtaining an mAP of 86.1%, precision of 81.6%, recall of 76.6%, and an F1-score of 79.0%, with an average inference time of 42.3 ms per image. Among the direct segmentation models, YOLOv12-m-seg provided the most favorable balance between AP@0.5 and FPS, achieving a segmentation AP@0.5 of 83.7% with an inference time of 20.4 ms per image. In the detection-prompted segmentation approach, bounding-box prompts generated by GELAN-s improved the localization of cotton bolls for SAM and SAMv2.1, while SAMv2.1 Tiny consistently outperformed FastSAM and Grounded-SAM with RAM. In the area-based evaluation against manually annotated segmentation masks, YOLOv12-m-seg achieved an $R^2$ value of 0.966, compared with 0.860 for GELAN-s + SAMv2.1 Tiny. Field experiments conducted using a UR5e robotic manipulator, a custom end-effector, and a ZED2i stereo camera further validated the effectiveness of the YOLOv12-m-seg model for real-time cotton boll detection, segmentation, and selective picking under varying confidence levels. These results demonstrate that YOLOv12-m-seg provides an efficient perception model for robotic cotton harvesting and has strong potential for field deployment.

Yinuo Zhang, Bingshuo Liu, Zhiying Tu, Dianhui Chu, Qingbin Liu

TL;DR: 该方法用多模态检索增强生成评估科学图像质量，在 SIQA 理解赛道夺得 ICME 2026 挑战赛第一名。

Details

Motivation: 科学图像包含复杂领域语义，自动质量评估既要理解图像内容，也要按专家标准打分；单纯依赖模型内部知识可能缺少相关参考案例。

Result: 作者构建同时融合文本语义和细粒度视觉特征的多模态索引，并设计多路检索与融合机制，为大语言模型提供相关参考案例，以支持 SIQA 理解赛道和评分赛道。实验表明该框架与专家判断标准有效对齐；最终在 ICME 2026 Grand Challenges 的 SIQA-U 理解赛道获得第一名。

Insight: 领域相关的文本和视觉参考案例可补充模型对复杂科学图像的判断依据；论文报告的明确竞赛结果是理解赛道第一，摘要未给出评分赛道名次。

Abstract: This paper proposes a Retrieval-Augmented Generation (RAG) framework for scientific image quality assessment, designed to simultaneously address both the understanding track (SIQA-U) and the scoring track (SIQA-S) of the SIQA challenge. We construct a multimodal index that integrates textual semantics with fine-grained visual features, and develop a multi-route retrieval and fusion mechanism to provide large language models with highly relevant reference cases, thereby enhancing their capability to evaluate complex scientific images. Experimental results demonstrate that the proposed framework effectively aligns with the judgment criteria of human experts. Ultimately, our method achieves 1st place in the SIQA-U track of the SIQA challenge at the ICME 2026 Grand Challenges.

[11] VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors cs.CVPDF

Yuhang Han, Hao Wang, Jiaxi Cao, Xingyu Liu

TL;DR: VGGT-GS SLAM 以 VGGT 前馈位姿和深度作为先验，对未标定单目视频做子地图可微束调整，并引入高斯原生对齐改善全局一致性。

Details

Motivation: 单目高斯泼溅 SLAM 在未标定视频上需要同时处理相机位姿、场景地图、内参和镜头畸变。若缺少可靠初值和子地图间全局约束，定位与渲染质量容易受影响。

Result: 系统从前馈 VGGT 位姿及深度先验出发，执行子地图可微束调整，联合优化相机位姿和 3D 高斯地图；通过解析标定雅可比优化子地图共享内参及径向-切向畸变。为增强全局一致性，提出高斯原生对齐 GNA，在连续子地图间以相机为锚进行尺度细化，并验证闭环候选。标准室内基准实验显示，未标定条件下定位精度持续改善且渲染质量较强。

Insight: 把标定参数与高斯地图、相机位姿放入同一个可微子地图优化过程，再用高斯表示直接对齐尺度和闭环候选，为未标定单目 SLAM 提供了端到端几何约束。

Abstract: We present VGGT-GS SLAM, a monocular 3D Gaussian Splatting SLAM system designed for uncalibrated videos. Starting from feed-forward VGGT pose and depth priors, our system performs submap differentiable bundle adjustment that jointly refines camera poses and a 3D Gaussian map, while optimizing submap-shared intrinsics and radial–tangential distortion through analytic calibration Jacobians. To improve global consistency, we introduce Gaussian-native alignment (GNA) for camera-anchored scale refinement between sequential submaps and verification of loop-closure candidates. Extensive experiments on standard indoor benchmarks show consistent improvements in localization accuracy and strong rendering quality under uncalibrated settings, establishing a strong baseline for uncalibrated Gaussian SLAM.

[12] IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models cs.CVPDF

Dasom Choi, Sangjun Moon, Hyeongchan Im, Jaeeon Park, Jingun Kwon

TL;DR: IMFD 用指令式大型视觉语言模型在整图上联合定位多个人脸并分类真伪，将预测人脸框作为指令中的视觉线索以加强定位和伪造检测。

Details

Motivation: 传统多脸伪造检测会逐张裁剪人脸并独立验证，忽略背景上下文和人脸之间的关系，导致整体判别效果受限。

Result: IMFD 是端到端单阶段多脸伪造检测器，同时定位人脸并输出每张脸的伪造标签。方法将预测人脸框显式加入指令，作为视觉提示辅助指令接地及真伪判别，而非仅把人脸框预测作为联合训练目标。作者把已有多脸伪造数据集转换成指令格式用于训练和评估。实验分析显示，整合人脸框指令线索可以提升检测，在多项比较中持续优于先进方法。

Insight: 人脸框既可作为检测输出，也可反过来成为视觉语言模型指令中的结构化证据；整图上下文与实体间关系因此能保留在伪造判断流程中。

Abstract: The rapid increase of deepfakes has raised significant concerns due to their spread on social media. Traditional multi-face forgery detectors crop and verify each face independently, ignoring background context and inter-face relationships, which often yields suboptimal performance. To overcome these limitations, we leverage instruction-based Large Vision-Language Models (LVLMs), which can interpret entire images and follow complex textual instructions. We propose a simple yet effective single-stage multi-face forgery detector, called IMFD (Instruction-based Multi-face Forgery Detector), which is trained end-to-end to jointly localize faces and predict per-face forgery labels. Rather than treating face box prediction only as a joint objective, IMFD explicitly integrates predicted face bounding boxes into the instruction as visual cues that enhance instruction grounding and forgery detection. To support the training and evaluation of IMFD, we convert existing multi-face forgery datasets into an instruction-based format. Experimental results and analyses show that IMFD improves multi-face forgery detection by integrating face bounding boxes into the instruction, and consistently outperforms various state-of-the-art methods.

[13] VideoResearcher: Self-Improving Tool Design for Long-Video Understanding cs.CVPDF

Dingqiang Ye, Dongdi Zhao, Kaishen Wang, Qingqiao Hu, Jingchen Sun

TL;DR: VideoResearcher 是无需训练的多智能体长视频工具开发框架，通过分析求解轨迹找出能力缺口、自动构造并验证工具，再将新工具用于后续视频推理。

Details

Motivation: 长视频理解智能体的有效工具链通常依赖人工设计和反复试错。现有自改进方法多只调整影响较小的提示、重组预定义微工具，或难以让工具系统优化稳定收敛。

Result: VideoResearcher 采用求解与演进双循环：分析工具使用轨迹发现能力短板，协调专门智能体开发并验证可执行工具，再复用演进出的工具改善后续视频证据获取。整个过程迭代优化工具而不更新模型参数。实验中，它在自改进智能体中达到先进性能，并接近人工设计系统的上界。

Insight: 让智能体把失败轨迹转化为新的视频处理工具，可以扩展证据获取能力而无需微调模型；有效性依赖工具能被自动执行和验证，形成工具设计闭环。

Abstract: Video agents have made substantial progress in long-video understanding. Yet effective video-agent systems require costly, time-consuming manual design and trial and error. Current self-improvement methods either refine low-impact prompts, recombine predefined micro-tools, or struggle with convergence in harness optimization. To bridge this gap, we target high-impact video-tool with VideoResearcher, a training-free multi-agent framework that autonomously designs, tests, and refines tools for video understanding, like a human researcher. VideoResearcher operates through dual Solving and Evolving loops: it analyzes tool-use trajectories to identify capability gaps, coordinates specialized agents to develop and validate executable tools, and reuses evolved tools to strengthen evidence acquisition in subsequent video reasoning. Through iterative tool refinement and validation, it progressively strengthens evidence acquisition without updating model parameters. VideoResearcher achieves state-of-the-art performance among self-improving agents and approaches the human-designed upper bound, demonstrating a training-free paradigm for long-video understanding that expands agent capabilities through autonomous tool development while reducing costly manual engineering.

[14] Beyond Patch Removal: Persistent Adversarial Effects in Vision-Language-Action Policies cs.CV | cs.ROPDF

Enhao Wu, Fusen Guo, Yuxin Cao, Ziyang Lyu, Lin Li

TL;DR: 研究提出贴片移除后的状态恢复协议，发现 VLA 面对对抗贴片造成的行动偏离后仍会持续受影响；及时训练恢复适配器能改善恢复，延迟干预则收益下降。

Details

Motivation: 针对视觉语言动作策略的对抗贴片既可能立即破坏动作，也可能在贴片移除后留下持续状态影响。既有评估多关注攻击持续期间，没有区分即时损害和移除后的不可恢复效应。

Result: 作者在匹配动作块边界移除贴片并测量剩余步数预算中的恢复能力，使用干净、随机贴片、偏差匹配和固定方向控制区分对抗效应、遮挡、动作误差大小与方向持续性，并测试受控干预延迟下训练的恢复适配器。在 OpenVLA-OFT 的 EDPA 攻击下，经过五个动作块后 LIBERO-Long 仅 36.2% 回合仍可恢复；偏差匹配和固定方向控制分别为 89.9% 和 87.0%。自回归 OpenVLA 也出现持续效应。恢复适配器在一个动作块延迟下将恢复率从 7.7% 提高到 47.4%，但延迟增加后收益明显下降。

Insight: 对抗干预会改变策略后续状态而不只是当前动作，移除贴片并不意味着状态复原；恢复机制需要尽早触发，并专门覆盖攻击诱导状态。

Abstract: Adversarial patches to Vision-Language-Action (VLA) policies can cause both immediate action corruption and persistent state effects that remain after the patch is removed. Existing evaluations largely focus on continuous attacks and do not separate these two effects. We introduce a state-restoration protocol that removes the patch at matched action-chunk boundaries and measures subsequent recoverability under the same remaining step budget. Clean, random-patch, deviation-matched, and fixed-direction controls distinguish adversarial effects from occlusion, action-error magnitude, and directional persistence. We also evaluate a recovery adapter trained on attack-induced states under controlled intervention latency. On OpenVLA-OFT with EDPA attacks, only 36.2% of LIBERO-Long episodes remain recoverable after five chunks, compared with 89.9% and 87.0% for the deviation-matched and fixed-direction controls. Similar persistent effects are observed on autoregressive OpenVLA. The recovery adapter improves recovery from 7.7% to 47.4% at one-chunk latency, but its benefit decreases substantially with delayed intervention. These results show that adversarial effects can persist after patch removal and that timely intervention is critical for recovery.

[15] GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model cs.CVPDF

Zixiang Ai, Zhenyu Cui, Yufei Guo, Wenwen Qiang, Lei Chen

TL;DR: GAPrompt++ 通过多尺度点偏移提示、关键点提示和层级传播注入点云几何信息，以少于 2% 可训练参数实现强于现有提示式 PEFT、甚至全量微调的迁移表现。

Details

Motivation: 预训练三维视觉模型全量微调下游任务需要较高计算和存储成本。现有提示式参数高效微调忽略点云固有几何结构，难同时编码细粒度几何和粗粒度结构语义，并在网络层级中有效传递。

Result: GAPrompt++ 包含提取多尺度几何特征、在适配时执行实例级几何调整的 Point Shift Prompter；突出局部显著点和细节结构的 Keypoint Prompter；以及在特征提取各层传播多粒度几何线索的 Prompt Propagation。在多个基准上，其表现达到提示式 PEFT 先进水平，且训练参数不足 2%，部分结果超过全量微调。作者另基于 3D Gaussian Splatting 和多视图立体重建构造两个更具挑战性的数据集。

Insight: 点云参数高效适配应将几何先验注入多个尺度并贯穿特征层级，而不是只追加无结构提示；新基准还旨在减轻现有数据集趋于饱和的问题。

Abstract: Pre-trained 3D vision models have substantially advanced point cloud analysis, yet adapting them to downstream tasks via full fine-tuning is computationally expensive and storage-intensive. Parameter-Efficient Fine-Tuning (PEFT) offers a promising alternative by reducing both adaptation cost and storage burden. However, existing prompting-based approaches ignore the intrinsic geometric structures of point clouds, thereby limiting their adaptation capability. This limitation stems from their inability to encode both fine-grained geometric cues and coarse-grained structural semantics, as well as failing to propagate such information effectively through the model hierarchy. To address these challenges, we propose GAPrompt++, a multi-granular geometry-aware prompting method that provides richer geometric guidance for efficient 3D task adaptation. Specifically, we introduce a Point Shift Prompter that extracts multi-granular geometric features across different scales, enabling instance-specific geometric adjustments during adaptation. Next, a Keypoint Prompter adaptively generates point-level prompts to highlight local geometric saliency and fine-grained structural details. Furthermore, a Prompt Propagation mechanism injects these multi-granular geometric cues throughout the feature extraction hierarchy, strengthening the ability to capture essential geometric characteristics. Extensive experiments show that GAPrompt++ achieves state-of-the-art performance among prompting-based PEFT methods and even surpasses full fine-tuning across diverse benchmarks, while requiring less than 2% trainable parameters. In addition, to address the saturation of existing evaluation datasets, we construct two more challenging benchmarks derived from 3D Gaussian Splatting and Multi-View Stereo reconstruction, offering diverse and realistic point cloud scenarios to promote future research.

[16] SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement cs.CVPDF

Jiabei Zeng, Chiqin Li, Kaizhou Li, Fei Chang, Yong Li

TL;DR: SeetaPsych v1.0 是面向行为心理测量的开源视觉工具包，统一支持面部情绪、摄像头心率、注视点及场景注视跟随等分析模块。

Details

Motivation: 行为心理测量可从视觉行为分析中受益，但已有技术模块分散在任务专用系统中，接口不统一且部署要求各异，妨碍复用和大规模可重复分析。

Result: SeetaPsych v1.0 提供四个主要模块：统一面部情绪分析（表情识别、面部动作单元检测、效价-唤醒度估计）、摄像头心率估计、屏幕注视点估计和场景注视跟随；还含人脸检测、关键点检测和头部检测等预处理模块。模块采用 Pipeline/Runner 架构，自动解析属性依赖、构建计算图并共享中间结果。工具包提供标准 Python API 和交互式 WebUI，支持可复现的大规模分析及免代码快速评估。

Insight: 统一模块接口和中间结果复用可减少心理视觉分析中重复部署与预处理工作；该工具的重点是可扩展基础设施，面向心理学、行为科学及人机交互研究。

Abstract: Automated visual analysis opens new avenues for behavior–based psychological measurement. Nevertheless, existing technological modules are typically scattered across task specific systems with heterogeneous interfaces and disparate deployment requirements. In this work, we present SeetaPsych v1.0, an open source, unified and extensible computer vision toolkit designed to extract psychologically relevant signals from facial images and/or face based videos. The current release encompasses four major core modules aiming at behavior–based physiological perception: unified face based emotion analysis (simultaneous facial expression recognition, facial action unit detection, and valence–arousal estimation), camera based heart rate estimation, screen point–of–gaze estimation, and scene gaze following. A suite of auxiliary preprocessing modules for human centric visual analysis is also included, comprising face detection, facial landmark detection, and head detection. These functionalities are encapsulated within a modular Pipeline/Runner architecture that automatically resolves attribute dependencies, constructs computation graphs, and support intermediate result sharing among modules. SeetaPsych provides standardized Python APIs to facilitate reproducible, large scale analyses, alongside an interactive WebUI for rapid, code–free method evaluation. Overall, SeetaPsych offers an integrated and accessible visual measurement platform for research in psychology, behavioral science, human computer interaction, and related fields.

[17] Understanding and Exploiting Diagonal Attention Sparsity in Autoregressive Image Generation cs.CV | cs.PFPDF

Daeun Kim, Junwha Hong, Changhun Oh, Yoonsung Kim, Yoonhyeong Lee

TL;DR: 论文系统分析自回归图像生成中的注意力稀疏结构，发现预填充与解码不对称及独特对角稀疏性，并据此设计跳过对角方向 KV 项的机制。

Details

Motivation: 自回归图像生成每个请求需生成数千视觉 token，注意力 KV 缓存访问逐渐成为解码瓶颈。稀疏注意力已用于文本模型，但其稀疏假设是否适用于图像生成尚不明确。

Result: 作者首次在多种负载和开源模型上系统刻画自回归图像生成的注意力稀疏性，发现预填充与解码存在明显不对称，注意力集中于提示和局部 token，且视觉 token 空间局部性产生独特对角稀疏模式。基于此提出对角感知稀疏注意力，在近期窗口内选择性跳过对角方向的 KV 项。基于 FlexGen、FlashAttention-2 和定制 GPU kernel 实现后，相较稠密推理吞吐最高提升 3.1 倍、延迟改善 1.19 倍，质量下降低于 2%。

Insight: 图像 token 的空间顺序形成文本稀疏模式未必具备的注意力结构；针对对角方向裁剪缓存访问，能以较小质量损失换取生成效率。

Abstract: Autoregressive image generation has emerged as a paradigm for multimodal AI systems due to its compatibility with transformer-based LLM serving infrastructures. However, generating thousands of visual tokens per request makes decoding increasingly bottlenecked by KV cache accesses during attention computation. Sparse attention is particularly attractive for this workload because many visual generation applications tolerate moderate quality degradation in exchange for improved performance and efficiency. While sparse attention has been extensively explored for text-based LLM inference, it remains unclear whether its sparsity assumptions generalize effectively to autoregressive image generation. We present the first systematic characterization of attention sparsity in autoregressive image generation across diverse workloads and representative open-source models. Our analysis reveals several distinguishing properties, including a pronounced prefill-decode asymmetry, strong attention concentration on prompt and local tokens, and a unique diagonal attention sparsity pattern arising from the spatial locality of visual tokens. Motivated by these observations, we propose a diagonal-aware sparse attention mechanism that selectively skips KV entries along the diagonal attention direction within a recent window. Implemented on top of a GPU-based serving system using FlexGen, FlashAttention-2, and custom kernels, our approach achieves up to 3.1x throughput and 1.19x latency improvements with less than 2% quality degradation compared to dense inference.

[18] Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generation cs.CVPDF

Tri Cao, Hung Nguyen, Phong Nguyen, Khoi Nguyen

TL;DR: Recency Forcing 针对训练与推理时 KV 缓存上下文不一致，在注意力 logit 中对远期帧施加随去噪步变化的非正偏置，并以精确重参数化实现零额外推理开销。

Details

Motivation: 自回归长视频生成在长时域会退化：训练时短片段的所有上下文都在 KV 缓存中，但推理时受内存限制，远期帧会被逐出，造成训练条件与推理条件之间的差异。简单截断上下文又会损失运动连贯性。

Result: 作者提出位置响应指标，衡量模型对不同时间距离帧的敏感度，发现上下文影响随距离快速衰减且依去噪步变化。Recency Forcing 据此在预 softmax 注意力 logit 上加非正、随时间步变化的 Temporal Response Bias，使远期帧影响逐渐减弱而不缩短上下文或改训练目标。Biased Attention Reparameterization 将偏置精确移到 softmax 外，使其可作为标准 FlashAttention 调用、无额外开销。训练免和训练式设置下，在 VBench 与 VBench-Long 达到长时域生成先进表现。

Insight: 让训练时远期上下文的贡献逐步接近推理时缓存逐出后的状态，可弥合长视频生成的缓存不匹配，同时保留必要的时间信息。

Abstract: Autoregressive (AR) video generation degrades over long horizons due to an overlooked train-inference discrepancy we term KV eviction mismatch: models train on short clips where all context frames reside in the KV cache, but at inference, memory constraints force distant frames to be evicted from the KV cache - removing context the model was conditioned on. Rather than simulating eviction via context truncation - which discards temporal information the model still needs and degrades motion coherence - we keep the context but while progressively reducing the influence of distant frames, making their eventual eviction negligible. To guide this design, we introduce the positional response $R( Δ, , t_{\text{denoise}})$, a perturbation-based sensitivity measure revealing that context influence decays steeply with temporal distance and varies systematically across denoising steps. Motivated by this analysis, we propose Recency Forcing, which applies a non-positive, timestep-dependent bias, termed Temporal Response Bias (TRB), on pre-softmax attention logits derived directly from $R$, closing the train-inference gap without modifying context length or training objectives. We further introduce Biased Attention Reparameterization (BAR), an exact reformulation that moves the bias outside the softmax, making TRB a standard FlashAttention call at zero overhead. Recency Forcing operates in both training-free mode and training-based mode. Experiments on VBench and VBench-Long demonstrate state-of-the-art long-horizon generation quality at no additional inference cost.

[19] Benchmarking MLLMs via Cognitive Expected Scene Graph for Safety-Critical Visual Negation Understanding cs.CVPDF

Zhiyun Jiang, Hanyong Wang, Binbin Liang, Yu Xie, Menglong Yang

TL;DR: SNUS 将视觉场景否定理解限定于安全认知目标，构建局部风险的密集否定描述数据集，并提出结构化、极性敏感的预期场景图评分。

Details

Motivation: 真实理解不仅要识别图像中存在的物体，还需推理安全场景中“本应存在但缺失”的信息。开放式否定任务边界不清，模型的肯定偏置及传统指标在否定语义下容易失效。

Result: 作者定义安全认知下的场景否定理解任务 SNUS，构建高保真负向描述数据集，将密集断言与局部风险对应，并提出认知预期场景图 CESG Score，以结构和极性为依据评分。实验发现当前多模态大模型仍难完成该任务，传统指标遇到语义反转时会失效；SNUS 与 CESG 为风险感知情境理解和反事实认知提供基准和评测基础。

Insight: 缺失信息应通过“预期场景结构”明确表示，否则模型肯定偏置和常规文本指标都难以区分危险物存在与缺位；安全任务限定使否定推理可被结构化评估。

Abstract: True machine intelligence requires transcending passive pixel registration to master top-down functional reasoning over absent information via visual negation understanding. However, unconstrained visual negation paradigms remain overly open-ended, and pervasive affirmation bias causes both existing Multi-Modal Large Language Models (MLLMs) and evaluation metrics to fail under negative semantics. To solve these intertwined challenges systematically, we first anchor the boundaries of negation reasoning within specific cognitive goals. Specifically, by focusing on safety as a highly pragmatic and critical cognitive dimension, we define the task of \textbf{S}cene \textbf{N}egation \textbf{U}nderstanding under \textbf{S}afety Cognition (\textbf{SNUS}). Under this framework, we construct a high-fidelity negative caption dataset mapping dense assertions of localized hazards. Concurrently, we propose the Cognitive Expected Scene Graph (CESG) Score, a structure-grounded, polarity-aware evaluation metric. Extensive experiments demonstrate that while current models struggle on the task, traditional metrics completely collapse under semantic reversals. Conversely, our framework delivers a solid benchmark for SNUS, providing a rigorous foundation to advance risk-aware situational comprehension and counterfactual cognition.

[20] Region-Level Policy Optimization for Fine-grained MLLM Perception cs.CVPDF

Yuheng Shi, Xiaohuan Pei, Minjing Dong, Chang Xu

TL;DR: Vision-RL2 将细粒度 MLLM 感知中的候选区域选择视作强化学习动作，用冻结读者评估区域对答案概率的影响，再以稀疏视觉编码集中处理证据。

Details

Motivation: 提高图像分辨率可改善多模态大模型的细粒度感知，却会增加视觉编码和语言模型预填充成本。定位目标区域与识别区域内容对分辨率要求不同，且注意力蒸馏提案带噪，离散区域选择无法直接为提案网络提供答案忠实度监督。

Result: 诊断显示区域定位可承受比内容识别强约 3–4 倍的 token 压缩，支持先粗略定位、再放大证据。Vision-RL2 把连贯候选区域视作动作，由冻结 MLLM 读者根据移除该区域对答案似然的影响评分；互补的减法和加法目标分别抑制干扰提案、补回遗漏证据。仅更新提案预测器，无需区域标注、响应采样或推理轨迹。六个细粒度基准、四种 MLLM 骨干上，各 token 预算下均超过基座准确率，并以约少 4 倍视觉 token 超过基座最大预算的准确率。

Insight: 定位和识别不必使用相同分辨率；将区域选择作为可评价动作并由答案变化提供奖励，可以用较少视觉 token 聚焦有效证据。

Abstract: Fine-grained visual perception in MLLMs is commonly improved by raising the resolution, but the added visual tokens inflate vision-encoding and language-model prefilling costs. We show that the two operations underlying fine-grained perception, localizing the region of interest (RoI) and recognizing its content, have different resolution requirements. In a controlled diagnostic, localization tolerates roughly 3 to 4 times stronger token compression than recognition, which motivates localizing from a coarse view and concentrating resolution on the selected evidence. Decoding coordinates with the MLLM can be trained end-to-end from answers, but costs a full model pass per query and depends on grounding ability. A lightweight proposal network distilled from the model’s attention is fast, but inherits the noise of its attention targets. The RoI from the proposal network reaches the answer through a discrete region choice, so its faithfulness to the answer cannot supervise the network. We therefore optimize the proposal network with region-level reinforcement learning, which we call Vision-RL2. It treats coherent regions as actions, and a frozen MLLM reader scores each one by how its removal changes the answer likelihood. Complementary subtractive and additive objectives suppress distracting proposals and recover missing evidence, updating only the predictor without region annotations, response sampling, or reasoning trajectories. The refined proposal further enables a sparse encoding that magnifies evidence and excludes background tokens. Across six fine-grained benchmarks and four MLLM backbones, Vision-RL2 improves accuracy over the base model at every token budget and surpasses its largest-budget accuracy with about 4 times fewer visual tokens. Code is available at https://github.com/YuHengsss/VisionRL2 .

[21] AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization cs.CVPDF

Xu Yuan, Yi Wang, Zhuohang Jiang, Haohao Qu, Yujuan Ding

TL;DR: 这篇综述将 AI 智能眼镜定义为软硬件协同的可穿戴智能系统，梳理硬件、第一人称智能、交互设计、应用场景及五项核心研究挑战。

Details

Motivation: 人工智能正使智能眼镜从第一人称拍摄和显示设备转变为实时个人助理平台，但形态、算力和续航限制要求感知、推理、交互与应用在系统层面共同设计。

Result: 综述围绕四个方面组织研究：限定感知、计算、反馈与持续部署的硬件基础；将第一人称信号转化为感知、上下文和智能体能力的可穿戴智能；用户在活动中请求、接收、纠正和管理帮助的交互设计；以及医疗、无障碍、情境学习、日常辅助、文化旅游和工业支持等应用。作者总结五项跨领域挑战：新一代硬件、可信第一人称智能、终身个性化记忆、主动智能和具身基础模型。

Insight: 智能眼镜需作为持续感知、受资源约束且可个性化的智能平台整体设计，单独提升模型能力不足以解决真实世界的续航、交互和可信性问题。

Abstract: Recent advances in artificial intelligence (AI) are reshaping smart glasses from egocentric capture and display devices into platforms for wearable intelligence. Smart glasses increasingly serve as wearable AI systems that connect first-person observation with real-time assistance under strict form-factor constraints. We frame this transition through the lens of \emph{AI smart glasses} and define them as a system-level concept in which egocentric sensing, resource-aware computing, intelligent reasoning, multimodal interaction, and real-world application constraints are co-designed for personalized assistance in the physical world. To systematically study this perspective, we organize the survey around four connected dimensions. First, we examine the hardware foundation that bounds sensing, computation, feedback delivery, and sustained deployment. Second, we study wearable intelligence, where egocentric signals are transformed into perceptual, contextual, and agentic capabilities. Third, we discuss interaction design, through which users request, receive, correct, and regulate assistance during ongoing activity. Fourth, we analyze application scenarios across healthcare, accessibility, situated learning, daily life assistance, cultural tourism, and industrial support, showing how domain requirements reshape system design and evaluation. We further identify five cross-cutting research challenges for future AI smart glasses: next-generation hardware, trustworthy egocentric intelligence, lifelong personalized memory, proactive intelligence, and embodied foundation models. By centering smart glasses as wearable-intelligence platforms, this survey provides a unified framework for organizing technologies, applications, and open challenges in this emerging area.

[22] SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes cs.CVPDF

Suji Kang, Seok-Young Kim, Young Bin Kim, Taewook Ha, Dieter Schmalstieg

TL;DR: SnapPhysics 从单张图像重建物体并构造物理感知场景图，将几何和物体关系作为上下文交给视觉语言模型估计质量、摩擦及重心。

Details

Motivation: 混合现实中的物理交互不仅需要几何，也依赖质量、摩擦和重心等属性。通过视频分析动力学估计代价高，直接让视觉语言模型看单图推断又缺少几何依据和物体间关系。

Result: SnapPhysics 无需训练，将实例级三维重建和空间对齐与物理感知场景图结合，图中编码物体关系和度量几何，再作为结构化上下文支持 VLM 物理属性推理。在 3D-FRONT 上，场景级 F-score 比最佳学习方法提高 18.6%；在具有真实质量标注的实拍场景上，相较仅用 VLM，平均绝对对数差误差最高降低 20.5%，对数尺度相关 r² 最高提高 19.6%。该系统无需人工调参即可支持物理交互式混合现实。

Insight: 先恢复可度量三维结构，再把物体间空间关系交给语言模型推断物理属性，可弥补单图语义先验缺乏几何落地的问题。

Abstract: We propose SnapPhysics, a training-free framework that reconstructs 3D objects and estimates their physical properties such as mass, friction, and center of gravity from a single image. For physically coherent interactions in mixed reality (MR), such properties are as important as geometry. Prior approaches infer them by analyzing object dynamics in video, which is computationally costly, or by querying vision-language models (VLMs) on single images, which lacks geometric grounding and inter-object relationships. We address these limitations by combining instance-level 3D reconstruction and spatial alignment with a physics-aware scene graph that encodes these relationships and per-object metric geometry as structured context for VLM-based property reasoning. Experiments on 3D-FRONT show that SnapPhysics improves scene-level F-Score by 18.6% over the best learning-based method, and on real captured scenes with ground-truth mass, it reduces the mean absolute log difference error (mALDE) by up to 20.5% and improves log-scale correlation ($r^2_{\mathrm{ls}}$) by up to 19.6% over VLM-only estimation. SnapPhysics enables physically interactive MR experiences without manual parameter tuning. Project page: https://snapphysics-ismar2026.github.io/.

[23] Absence is Presence: Understanding Visual Scene Negative Events Under Safety Cognitive Constraint cs.CVPDF

Zhiyun Jiang, Hanyong Wang, Binbin Liang, Yu Xie, Menglong Yang

TL;DR: CRCD 把安全场景中物理缺失转为反事实潜在变化描述，通过安全预期与实际画面对比，联合修复缺陷物体、推断完全缺失的安全物体并缓解表征偏差。

Details

Motivation: 传统场景理解侧重图像中实际存在的信息，但安全领域也必须识别本应存在却缺失的关键物体。视觉语言模型受肯定偏置、心理补全能力不足和表征偏差影响，难推断这种语义否定事件。

Result: CRCD 将任务重构为反事实潜在变化描述，通过对比合成的安全预期与现实画面识别语义缺失。双分支反事实重建架构中，非模态补全部分恢复有缺陷物体，功能关联分支推断完全缺失的安全物体；多条件表征学习把通用特征投射到预定义安全标准子空间，以缓解表征偏差。最终解码重建场景原型与输入之间的特征级语义残差，缩小非存在搜索范围并激活否定逻辑。实验验证其有效性，为该任务建立较强基线。

Insight: 将否定描述转成“安全预期场景与现实之间的语义残差”，可以把开放式想象约束为安全标准下的缺失检测，并分别处理部分损坏和完全不存在的物体。

Abstract: Traditional scene understanding focuses on affirmative information objectively present in images. However, in safety-critical domains, comprehending key information that should exist but is actually absent is vital for risk mitigation. To bridge this gap, we focus on visual scene negative captioning with safety as the cognitive constraint. The core challenge is to convert physical absence into semantic negative events. Existing vision-language models (VLMs) struggle with this process because affirmation bias suppresses negative reasoning, while limited mental filling capability and representation bias further hinder the inference of absent information. To address these challenges, we propose a negative captioning framework based on counterfactual reconstruction and contrastive decoding (CRCD). Inspired by human cognition, CRCD reformulates the task as counterfactual latent change captioning to bypass affirmation bias. It contrasts a synthesized safe expectation with reality to identify semantic omissions. To address limited mental filling, we design a dual-branch counterfactual reconstruction architecture. The amodal completion branch restores defective objects, while the functional association branch infers completely absent safety objects. Concurrently, a multi-condition representation learning mechanism is integrated to mitigate representation bias by projecting universal features onto predefined safety criteria subspaces, thereby capturing information across more dimensions. By decoding feature-level semantic residuals between the reconstructed scene prototype and raw input, CRCD bounds the non-existence search space and activates the decoder’s negative logic. Extensive experiments validate the effectiveness of CRCD, establishing a high-performance baseline for this pioneering task.

[24] Socialized UAV Cross-Task Learning: Towards Cross-Granularity Collaboration through Hierarchical Interaction cs.CVPDF

Xinjie Yao, Ruipu Zhao, Yunqi Zhu, Zhihe Fan, Zhoupeng Guo

TL;DR: CGSC 将无人机检测与实例分割中的跨粒度协作建模为层级交互调节，通过逐步启用并自适应调节任务信息交换，减少干扰并利用互补特征。

Details

Motivation: 异构任务联合学习常用特征共享、蒸馏或辅助监督耦合，但表征与监督粒度不匹配时容易造成任务干扰、教师偏差或单向坍缩。无人机视觉中的检测与分割分别代表粗、细粒度知识。

Result: 作者提出 CrossUAV 基准，统一评估无人机目标检测和实例分割；并提出跨粒度社会化协作 CGSC，按网络层级调节任务何时、何处及如何交换信息。框架逐步激活跨任务交互，并依据各任务贡献自适应控制交互强度，在抑制有害干扰的同时利用粗细结构互补。大量实验显示检测与分割两项任务均持续提升。

Insight: 跨任务学习效果取决于信息交换发生的层级、时机和强度；把协作设计成自适应层级交互，比静态地共享全部特征更能兼顾检测与分割粒度差异。

Abstract: Joint learning across heterogeneous tasks is often treated as task coupling through feature sharing, distillation, or auxiliary supervision. However, in cross-task learning, mismatched representational and supervisory granularities make such coupling prone to interference, teacher bias, or unidirectional collapse. We argue that cross-granularity learning is fundamentally a problem of hierarchical interaction regulation rather than simple task coupling. This issue is particularly evident in UAV perception, where visual shifts and detection–segmentation objectives naturally form coarse- and fine-grained knowledge sources. To systematically study this problem, we introduce CrossUAV, a UAV benchmark for joint object detection and instance segmentation that provides a unified evaluation platform for cross-granularity task collaboration. To address these challenges, we propose Cross-Granularity Socialized Collaboration (CGSC), a progressive and adaptive framework that regulates when, where, and how tasks exchange information across network hierarchies. CGSC progressively activates cross-task interactions and adaptively adjusts the strength according to task contribution, suppressing harmful interference while exploiting complementary coarse- and fine-grained structures. Extensive experiments demonstrate consistent improvements on both tasks, validating hierarchical dynamic interaction as an effective mechanism for cross-granularity collaboration.

[25] BINDER: A Latent Variable Model for Probabilistic Medical Image Registration cs.CVPDF

Stefano Cerri, Amirhossein Hassankhani, Yaël Balbastre, Koen Van Leemput

TL;DR: BINDER 将医学图像配准建模为带潜在体素对应关系的概率模型，利用闭式迭代更新实现鲁棒非线性配准，并首次支持高维三维多模态形变的不确定性量化。

Details

Motivation: 通用医学图像配准既要适配单模态也要适配多模态数据，非线性形变还可能存在不确定性。作者希望在互信息配准准则上建立统一概率建模，并获得可直接优化与采样的推断算法。

Result: BINDER 假设待配准图像间存在潜在的逐体素对应关系，并据此推导专用优化和 MCMC 采样方法，均只需闭式迭代更新。用于非线性配准时得到类似 demons 的高效优化器，在多种单模态和多模态任务上开箱即用且鲁棒；配套采样器可在高维三维形变的多模态配准场景中量化不确定性。

Insight: 将空间插值背后的潜在对应关系显式概率化，使优化和采样可以复用同一建模基础；不确定性估计特别适用于传统确定性配准难以表达的多模态形变歧义。

Abstract: We propose a new probabilistic model for general-purpose medical image registration that builds upon the mutual information registration criterion. It centers around a spatial interpolation technique that assumes latent voxel-wise correspondences between the images being registered. By exploiting these latent variables, we derive dedicated optimization and MCMC sampling techniques that only involve closed-form iterative updates. When applied to nonlinear registration, an efficient demons-like optimization algorithm is obtained that shows robust out-of-the-box performance across a variety of monomodal and multimodal registration tasks. We also demonstrate a corresponding sampler that can quantify, for the first time, uncertainty in multimodal registration scenarios with very high-dimensional 3D deformations. Our code, which we call BINDER (Bayesian INference for DEformable Registration), is freely available at https://github.com/ste93ste/BINDER.

[26] BinoGen: Scaling egocentric binocular data for embodied visual perception and learning cs.CV | cs.MMPDF

Chunpeng Li, Ya-tang Li

TL;DR: BinoGen 自动生成室内环境中具身感知的双目第一人称视频及稠密标注，构建两千万张以上图像数据，并验证其可改善真实视觉任务和支持跨身体形态研究。

Details

Motivation: 具身感知依赖持续、连贯的视觉经验，但大规模双目第一人称观测及稠密标注采集昂贵困难。观察者的视高、视场、双目几何和运动轨迹也会改变视觉经验，需在数据中体现身体形态差异。

Result: BinoGen 联合建模生成式场景、概率物体实例化、外观随机化、随机轨迹和可配置双目相机，生成同步双目视频及深度、光流、法线、语义图、物体坐标和相机位姿等监督，数据集含两千万张以上标注图像。使用该数据训练可持续改善深度估计、目标检测和视频目标跟踪等真实视觉任务。对相同环境生成类人和类鼠观察视角的配对样本后，身体形态专门适配显著提高性能，联合训练则可使单模型在两种形态上都具竞争力。

Insight: 具身视觉数据不应只改变场景，还需改变观察者的相机高度、双目结构和运动方式；受控配对视角可分离环境因素与身体形态对感知学习的作用。

Abstract: Embodied visual perception relies on temporally coherent visual experience accumulated through continuous engagement with the environment. However, collecting large-scale egocentric binocular observations together with dense annotations remains costly and difficult. Moreover, visual experience is shaped not only by the environment but also by the embodiment of the observer, including viewing height, field of view, binocular geometry, and motion through the scene. To address these challenges, we present BinoGen, an automated framework for generating large-scale, embodiment-aware egocentric binocular visual experiences in indoor environments. BinoGen jointly models environmental and observer variation through generative scene synthesis, probabilistic object instantiation, appearance randomization, stochastic trajectory generation, and configurable binocular camera setups. The framework produces synchronized binocular videos together with dense multimodal supervision, including depth maps, optical flow, surface normals, semantic maps, object coordinates, and camera poses. Using BinoGen, we construct a dataset comprising more than 20 million annotated images for supervised learning. We demonstrate two complementary utilities of BinoGen. First, incorporating BinoGen data consistently improves real-world visual perception, including depth estimation, object detection, and video object tracking. Second, paired human-inspired and mouse-inspired observations from the same environments enable controlled investigation of how observer embodiment affects perceptual learning. Embodiment-specific adaptation substantially improves performance, while joint training enables a single model to perform competitively across both embodiments. Together, these results demonstrate that large-scale, controllable visual experience can improve embodied perception…

[27] CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding cs.CVPDF

Shuai Zhang, Hongye Hou, Qinghe Liu, Zhuoxiao Li, Dongli Wu

TL;DR: CitySTAR 将城市级开放词汇三维定位转成结构化约束推理，在十亿级点云上构造场景图，用成对超图和双向拓扑验证消歧。

Details

Motivation: 现有三维指代定位多依赖特征相似度或直接匹配，难把自然语言意图与十亿级城市点云中的隐含语义、几何结构和空间关系结合起来。

Result: CitySTAR 是免训练的推理框架，先将原始城市点云提升为可查询开放词汇三维实例场景图，并由代码大模型驱动的工具补充节点属性和空间关系证据；随后用成对超图建模目标与上下文拓扑并双向验证。反思式跨模态定位模块综合拓扑一致性和候选相关的二维视觉证据，在带度量信息的三维上下文图上决策。作者同时提出 CitySTAR-3D，改进语义覆盖、实例完整度、框精度及空间关系复杂度。实验显示该方法提升开放世界城市定位，并保持可解释性和泛化能力。

Insight: 在大规模场景中，目标与周围实体的拓扑关系可补充单纯语义相似度；把语言描述转成可计算约束，再用二维证据和拓扑互相核验，有助于结构化消歧。

Abstract: 3D grounding aims to localize target entities in complex scenes from natural language and plays a fundamental role in embodied perception and spatial reasoning. However, existing approaches mostly rely on feature similarity or direct matching, making it difficult to connect natural-language intent with the implicit semantic and geometric structures hidden in billion-scale urban point clouds. We reformulate city-scale 3D grounding as structured constraint reasoning, where description semantics are organized into computable cross-modal constraints over open-vocabulary 3D entities, attributes, and spatial relations. We present CitySTAR, a training-free framework for reasoning-driven urban 3D grounding. CitySTAR lifts raw billion-scale urban point clouds into a query-ready scene graph of open-vocabulary 3D instances, with CodeLLM-driven tools supplying multimodal evidence for node attributes and 3D spatial relations. It then models target-context topology with paired hypergraphs and performs bidirectional topology verification for structural disambiguation. Finally, a Reflective Cross-modal Grounding module integrates topology consistency and candidate-centered 2D visual evidence to make decisions over a metric-aware 3D context graph. To further support this setting, we introduce CitySTAR-3D, an enhanced benchmark that improves semantic coverage, instance completeness, bounding-box fidelity, and spatial-relation complexity in city-scale 3D grounding. Extensive experiments show that CitySTAR consistently improves open-world urban 3D grounding while maintaining strong interpretability and generalization.

Yitong Xing, Yuhao Cheng, Yanping Li, Yichao Yan

TL;DR: TPRD 在 DETR 蒸馏前修正教师的阶段预测：恢复早期更准确的正例、压制过度自信负例，同时保留非目标类别暗知识。

Details

Motivation: DETR 计算开销较高，难部署到边缘设备。现有蒸馏多关注对齐蒸馏点，却忽视教师监督自身质量；DETR 阶段预测可能非单调，早期正确定位或分类会在后续退化，负预测则可能变得过度自信。

Result: TPRD 是可插拔教师预测精炼模块。正预测校正 PPC 从更早阶段恢复准确的正例定位和分类信号；负预测抑制 NPS 降低过度自信负例对学生的误导；最大暗知识保留 MDKP 只精炼目标类别 logits，同时保留非目标类别间关系。MS COCO 和 PASCAL VOC 实验显示，该方法有效且稳健。

Insight: 教师网络并非所有阶段的预测都单调变好，因此蒸馏前整合阶段信息可改善监督可靠性；保留非目标类别关系还能避免精炼目标置信度时丢失有用暗知识。

Abstract: Detection Transformers (DETRs) achieve strong performance in object detection but remain challenging to deploy on edge devices due to their high computational cost. Existing DETR distillation methods mainly focus on aligning distillation points, while largely overlooking the quality of the teacher’s supervision itself. We observe that due to stage-wise non-monotonic prediction behavior in DETRs, well-localized or correctly classified predictions from earlier stages may degrade in later ones, and some negative predictions become increasingly overconfident. As a result, relying solely on the current stage’s predictions yields inaccurate and inconsistent supervision. To address this issue, we propose Teacher Prediction Refinement Distillation (TPRD), a plug-and-play module that refines teacher predictions before distillation by exploiting stage-wise prediction information. TPRD improves supervision quality through Positive Prediction Correction (PPC), which corrects degraded positive predictions by restoring more accurate ones from earlier stages, ensuring reliable localization and classification signals, and Negative Prediction Suppression (NPS) suppresses the influence of overconfident negatives, preventing them from providing misleading supervision to the student. To preserve informative dark knowledge, we further introduce Maximum Dark Knowledge Preservation (MDKP), which selectively refines target-class logits while retaining non-target relations. Extensive experiments on MS COCO and PASCAL VOC demonstrate the effectiveness and robustness of the proposed method. Our code is available at https://github.com/xingyitong1/TPRD.

[29] Beyond the Foreground: FOV-Aware Polyp Image Synthesis via Lesion-Guided Adaptive Mucosal Context Propagation cs.CVPDF

Tong Wang, Yuting He, Bin Ren, Yutong Xie, Guanyu Yang

TL;DR: LAMP 用视场掩码明确区分息肉、有效黏膜和镜头外区域，再通过病灶引导的自适应黏膜上下文传播生成兼容背景。

Details

Motivation: 合成肠镜图像和掩码可缓解息肉标注稀缺，但现有前景引导生成将所有非病灶像素视为背景，直接用于肠镜会把黑色镜头外区域混入黏膜，并因局部推理导致纹理和光照不一致。

Result: LAMP 用视场掩码区分病灶、有效黏膜与相机外部；病灶到黏膜交叉注意力提取病灶外观条件，再通过受视场约束的多方向视觉键值传播在合法组织区域扩散，最后用自适应门控将其残差融合进扩散 U-Net。五个息肉数据集实验显示，生成质量显著超过既有方法，并持续提升五种下游分割模型表现。

Insight: 医学图像合成需要显式尊重成像视场，而非把黑色边缘当成可生成背景；跨区域传播病灶条件可保持黏膜纹理和光照上下文的连贯。

Abstract: Synthetic image and mask pairs can alleviate scarce colonoscopy annotations, but realistic synthesis requires preserving the supplied lesion while generating compatible mucosa. Existing foreground-guided methods treat all non-foreground pixels as background and rely mainly on local integration. Directly applying them to colonoscopy causes two problems: non-mucosal black regions contaminate generated tissue, and local reasoning produces inconsistent mucosal texture and illumination. We propose LAMP, the first foreground-guided framework for polyp image synthesis based on lesion-guided adaptive mucosal context propagation. LAMP explicitly separates the lesion, valid mucosa, and camera exterior using a field-of-view (FOV) mask. Lesion-to-Mucosa cross-attention extracts lesion appearance conditions for valid-mucosa locations, while FOV-constrained multidirectional Vision Receptance Weighted Key Value propagates them over legal tissue support. An adaptive gate then controls their residual fusion into the diffusion U-Net. Extensive experiments on five polyp datasets demonstrate that LAMP substantially outperforms existing methods in overall generation quality and consistently improves five downstream segmentation models. Our code will be released at https://github.com/wangtong627/LAMP.

[30] An Event Preserving Velocity Invariant Representation for Event Cameras cs.CVPDF

Mikihiro Ikura, Luna Gava, Jiahang Wu, Chiara Bartolozzi, Arren Glover

TL;DR: SCARF 为事件相机提出实时、速度不变且保留原始事件的表示，可同时处理快速运动、静止场景和独立运动物体。

Details

Motivation: 事件相机通过异步独立像素实现低延迟、高时间分辨率，但带来新的算法挑战。速度不变表示可缓解慢速运动漏观测和快速运动模糊，却常把事件变成类图像表示而丢失时间信息。

Result: 作者提出中心激活感受野集合 SCARF，在保留原始事件的同时构造速度不变表示，并一致处理快速运动、静止场景和独立运动物体。实验表明其计算效率与表示质量均达到先进水平，适用于实时视觉任务。

Insight: 速度鲁棒性不必以丢弃事件时序为代价；直接对事件集合建立中心感受野表示，可兼顾不同速度条件下的信息完整性。

Abstract: Event cameras provide low-latency, high temporal resolution perception for real-time vision tasks such as robotics.The novel circuitry (i.e. asynchronous, independent pixels) that enables these advantages also introduces new algorithmic challenges. Velocity-invariant representations alleviate missing observations under slow motion and motion blur under fast motion, but most discard temporal information by converting events into image-like representations. We propose Set of Centre Active Receptive Fields (SCARF), a real-time velocity-invariant representation that preserves raw events while consistently handling fast motion, stationary scenes, and independently moving objects. SCARF achieves state-of-the-art performance in both computational efficiency and representation quality.

[31] QCPruner: Query-Conditioned Population Coverage for Visual Token Pruning cs.CVPDF

Shengli He, Yongchao Liang, Roumeng He, Junjie Zeng, Jiyuan He

TL;DR: QCPruner 让视觉 token 的目标项与候选代表项都根据查询相关性加权，再用单调次模覆盖目标在固定预算下裁剪冗余。

Details

Motivation: 多模态大语言模型视觉 token 数量庞大，免训练裁剪可降低后续层计算，但固定预算下必须保留与问题相关的证据并避免冗余。既有方法通常没有用统一的查询效用同时衡量待覆盖视觉 token 和候选代表。

Result: QCPruner 用关键词匹配查询锚点融合两种跨模态线索得到效用，并将其用于视觉相似性覆盖中的目标与候选代表权重。所得非负设施选址目标单调且次模，可使用标准贪心近似保证，无需训练或参数更新。在 LLaVA-1.5、LLaVA-NeXT、LLaVA-Video 和 Qwen2.5-VL 上，各报告 token 预算下完整系统裁剪方法平均相对表现最高。LLaVA-1.5-7B 保留 576 个 token 中的 32 个时保留未裁剪性能的 96.1%；Qwen2.5-VL-7B 保留 1296 个中的 256 个时为 96.7%。

Insight: 查询效用应同时决定哪些视觉证据值得保留，以及哪些 token 能代表这些证据；双侧加权的次模覆盖使裁剪预算更集中于与当前问题相关的视觉内容。

Abstract: The high visual-token load in multimodal large language models (MLLMs) motivates training-free pruning to reduce later-layer computation, but under a fixed budget, pruning must preserve query-relevant evidence while avoiding redundancy. Existing methods rank tokens, diversify selected subsets, or optimize coverage without using a shared per-visual query utility to weight both visual targets and candidate representatives. We introduce QCPruner, which makes both roles query-conditioned through bilateral utility weighting. Using keyword-matched query anchors, QCPruner fuses two cross-modal cues into utility and applies it to both visual targets and candidate representatives within visual-affinity-based coverage. The resulting nonnegative facility-location objective is monotone and submodular, retains the standard (1-1/e) greedy guarantee, and requires no model training or parameter updates. Across LLaVA-1.5, LLaVA-NeXT, LLaVA-Video, and Qwen2.5-VL, QCPruner achieves the highest average relative performance among evaluated complete-system pruning methods at every reported token budget. At 32 of 576 tokens on LLaVA-1.5-7B, it retains 96.1% of unpruned performance, versus 93.9% for the strongest evaluated baseline. At 256 of 1296 tokens on Qwen2.5-VL-7B, the corresponding values are 96.7% and 92.5%.

[32] AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models cs.CV | cs.AIPDF

Longyin Zhang, Parth Sakhare Mahendra, Chengwei Wei, Ning Zhang, Lim Ming Chong

TL;DR: AVTrace 是评估全模态模型音视频时间推理的诊断套件，覆盖事件定位、同步、顺序预测与跨模态理解，并揭示现有模型在同步和链式推理上的薄弱。

Details

Motivation: 全模态模型可以描述视频内容，但是否能定位事件发生时间、保持事件顺序并判断音视频同步，仍缺少系统评测；文本参考相似度也未必能反映时间定位能力。

Result: AVTrace 含起始与区间定位、同步判断、下一步预测、跨模态定位、事件链解析和事件条件理解等任务，共 34,114 个训练样例，开发集 3,500、测试集 7,000，按类别平衡。五种开源全模态模型按各自输入配置评测，归一化后确定性打分。五个系统的同步验证都低于测试集多数类基线 0.556，链解析、事件条件接地和理解得分也较低。开发集扰动显示模型对模态移除和视觉处理变化存在任务依赖敏感性，但原因尚未隔离；参数高效时间后训练可改善 Gemma4-E4B-it 的部分指标。

Insight: 音视频时间能力不能用语义文本相似度代替；专门诊断套件可定位同步、顺序和时间接地短板，且后训练收益需同时检查外部任务上的轻微变化或退化。

Abstract: Omni models can describe video content, but can they locate events in time, preserve event order, and judge audio-visual synchronization? We introduce AVTrace (Audio-Visual Temporal Reasoning Assessment and Capability Evaluation), a silver-standard diagnostic suite spanning onset and span grounding, synchronization, next-step prediction, cross-modal localization, chain parsing, and event-conditioned comprehension. It contains 34,114 training examples and category-balanced development and test splits of 3,500 and 7,000 examples. We evaluate five open omni models under their respective input configurations using reference-blind response normalization followed by deterministic scoring. All five off-the-shelf systems score below the test split’s majority-label baseline of 0.556 on synchronization verification, and obtain low scores on chain parsing and event-conditioned grounding and comprehension. Development-set perturbations reveal task-dependent sensitivity in Qwen3-Omni-30B to modality removal and changes in visual input processing, without isolating their underlying causes. Parameter-efficient temporal post-training improves Gemma4-E4B-it on several benchmark metrics. On three external image benchmarks, task metrics change modestly, including some degradations, while teacher-forcing perplexity decreases. Together, these findings show that semantic reference-text overlap should not be treated as a proxy for temporal localization, and that AVTrace can identify task-specific weaknesses while providing a testbed for temporal post-training.

[33] Astronex-World 1.0: Real-Time Interactive World Model Foundation cs.CV | cs.AI | cs.ROPDF

Xin Zhou, Cong Miao

TL;DR: Astronex-World 1.0 是可控实时视频世界模型，依据相机轨迹、连续动作和具身标识生成未来状态，并同时提供全上下文和因果持续生成版本。

Details

Motivation: 具身智能和自动驾驶需要能根据动作预测视觉世界如何演化的可控视频模型。模型还需支持持续长时域生成、相机运动控制以及 rollout 中插入事件，并在有限硬件上训练和实时运行。

Result: 模型接受文本或初始图像，并根据帧对齐相机轨迹、连续动作和具身 ID 预测未来视觉状态，可在 rollout 指定位置插入文本事件。模型家族包括双向全上下文版和带块因果注意力及跨块 KV 缓存的因果版，均基于 Wan2.2-TI2V-5B；PRoPE 编码相机内外参，64 维动作流调制各 Transformer 层。五阶段训练依次发展控制、转换因果结构、蒸馏少步学生、恢复混合域动力学并做分布匹配。因果版生成 832×480、24 fps 视频，在两张 L20 48GB GPU 上完成训练，单张卡可实时流式运行；WBench Navi 得分 73.5，Full 得分 70.0。

Insight: 分阶段训练可把相机和动作控制能力迁移到块因果持续生成模型；显式预留动作输入输出接口，也为后续具身交互和自动驾驶微调提供基础。

Abstract: We present Astronex-World 1.0, an open controllable video world-model foundation. Given a text prompt (text-to-video) or an initial observation (image-to-video), the model predicts future visual states under frame-aligned camera trajectories, continuous actions, and an embodiment identifier, and accepts text events inserted at a specified position of a rollout. The family provides a bidirectional model for full-context generation and a causal model with block-causal attention and cross-block KV caching for persistent generation, both built on the Wan2.2-TI2V-5B prior. PRoPE injects camera intrinsics and extrinsics, while a 64-dimensional action stream modulates every Transformer layer. A five-stage training path develops bidirectional camera and action control, converts the backbone to block-causal generation, distills a few-step student, restores mixed-domain dynamics, and applies asymmetric DMD/DMD2 distribution matching. The causal model generates 832x480 video at 24 fps. All five training stages run on two NVIDIA L20 48 GB GPUs, and the causal model streams in real time on one. It scores 73.5 on WBench Navi and 70.0 on WBench Full. On Full, this 5B model is above the 13.6B LongCat-Video and the 14B Helios, within one point of the 22B LTX-2.3, and above YUME 1.5, which is post-trained from the same 5B prior on NVIDIA A100 GPUs. The reserved action input and output interfaces allow post-training for embodied intelligence and autonomous driving.

[34] A Smaller Transformer in Your Transformer cs.CVPDF

Dhananjay Tomar, Marius Aasan, Andreas Kleppe, Adín Ramírez Rivera

TL;DR: Transformer-Within-Transformer 在后处理中将计算相似的连续 ViT 层融合为单个学习代理层，减少参数和推理计算，并在自然图像及若干病理任务上保持竞争力。

Details

Motivation: 视觉 Transformer 的不同深度阶段存在局部相似计算，说明层级计算可能冗余；现有利用冗余的方法要么不真正降低推理计算，要么显著损害模型表达能力。

Result: 作者统一形式化 block 冗余，并提出后处理方法 TWT，将连续冗余层组融合为一个学习到的代理层。该方法减少参数量和推理计算；在自然图像任务上，深度减半仍与原模型表现相当，在多个组织病理下游设置中达到或超过原基线。

Insight: 学习单层代理来近似连续层组，提供了压缩深度同时保留表达能力的途径；其效果依赖哪些层块确实具有可替代的局部计算。

Abstract: Recent findings indicate that Vision Transformers settle into locally similar computational phases, implying a level of depthwise computational redundancy. However, existing methods to exploit this redundancy either fail to reduce inference compute or severely degrade model expressivity. In this work, we formalise a unified view of block redundancy that decouples the geometry from specific surrogate interventions. We then introduce Transformer-Within-Transformer (TWT), a post-hoc method that fuses contiguous groups of redundant layers into a single learned surrogate layer. TWT reduces parameter count and inference compute while remaining competitive with original models using half the depth on natural images, and in several downstream histopathology settings, TWT matches or even improves on the original baseline.

[35] A Free Lunch? Adapting PP-OCRv6 for Historical Text Recognition cs.CVPDF

Benjamin Kiessling

TL;DR: 该研究将轻量 PP-OCRv6 适配到历史手稿行识别，并与 CRNN 比较不同预训练、领域训练和少样本适配策略，显示异质预训练有助泛化。

Details

Motivation: 大型视觉语言模型虽报告了较高历史文本识别成绩，但计算成本高、依赖大规模预训练且可能幻觉，实际应用有限。历史自动文本识别仍多采用数据需求较低、视觉依据直接的紧凑 CRNN。

Result: 作者把无需强语言模型的轻量 PP-OCRv6 用于历史文本行识别，在多语言拉丁和阿拉伯文字材料上比较通用预训练、领域训练、语料级微调和手稿特定少样本适配。PP-OCRv6 从零训练时并不总能超过 CRNN 基线，但异质预训练显著改善泛化；与基于 Qwen3.5 的 Medusa 识别器比较时，微调后的 PP-OCRv6 可超过面向历史拉丁文字的较大 VLM。

Insight: 历史手稿识别未必需要大型语言模型：紧凑识别器在适当异质预训练下可兼顾视觉依据与泛化，且避免部分高算力和语言幻觉问题。

Abstract: Despite impressive reported scores, large vision-language models have seen limited practical uptake in historical automatic text recognition because of their computational cost, dependence on large-scale pretraining, and hallucination. Historical ATR therefore continues to rely largely on compact CRNN line recognizers, which are visually grounded and trainable on modest data. Lightweight recurrence-free recognizers promise the accuracy of larger models with the practical advantages of CRNNs, yet have not been comprehensively evaluated on historical writing. We adapt PP-OCRv6, a recent compact text recognizer without strong language modeling, for historical line recognition and compare it with a conventional CRNN across generalized pretraining, domain-specific training, corpus-level fine-tuning, and manuscript-specific few-shot adaptation on multilingual Latin- and Arabic-script material. While PP-OCRv6 does not consistently outperform the baseline when trained from scratch, heterogeneous pretraining produces markedly better generalization. Comparisons with the Qwen3.5-based Medusa recognizer further show that fine-tuned PP-OCRv6 can outperform a large VLM tailored towards historical Latin-script HTR.

Farooq Ahmad Wani, Maria Sofia Bucarelli, Mujtaba Hussain Mirza, Oleksandr Pryymak, Aryo Pradipta Gema

TL;DR: 研究发现 VLM 的问题措辞会改变跨模态注意力的空间频率响应：冗长提示可增强图像损坏下鲁棒性，细粒度问题则更易与同频损坏相互作用。

Details

Motivation: 视觉语言模型在图像损坏下较脆弱，且同一视觉输入只因问题措辞不同便可能产生不同鲁棒性。作者希望解释冗长提示和复杂细节问题为何带来相反影响。

Result: 研究发现，把“有猫吗”扩写成礼貌详细的提示可明显提升鲁棒性，而询问杯子颜色及其相对椅子位置等细粒度问题会使模型在损坏下更脆弱。两种现象都可由问题条件化跨模态注意力解释：冗长问题拓宽注意力在空间频率上的支持范围，细粒度问题则集中到更少视觉尺度；当注意力频率与损坏频率重合时答案漂移最大。在 Qwen3-VL 和 LLaVA-OneVision、GQA 与 CLEVR 上，8B 模型的冗长改写使漂移方差降低 70–81%；扩展提示也带来可测准确率收益。

Insight: 提示不仅表达语义，还会重塑图像 patch 的注意力频率滤波；有意识地补充提示可在某些视觉损坏下提高稳定性，但更细粒度的问题可能对对应空间频率的干扰更敏感。

Abstract: Vision-language models (VLMs) are fragile under image corruption. We find that the wording of the question affects VLMs in two opposite ways. Verbose questions make VLMs substantially more robust—e.g., rephrasing “Is there a cat?” into “Please look carefully and answer: is there a cat?”. Conversely, VLMs become more fragile under corruption when the question is semantically complex or finer-grained, e.g., “what colour is the cup left of the chair?” instead of “is there a cup?”. Both effects stem from question-conditioned cross-modal attention, which induces a spectral filter over image patches: verbose questions broaden its frequency support, while fine-grained questions concentrate it onto fewer visual scales. The model’s answer drifts most when this filter and the corruption sit on the same spatial frequencies. We test the filter view on Qwen3-VL and LLaVA-OneVision across GQA and CLEVR; verbose paraphrasing reduces drift variance by 70–81% on the 8B models. The practical recipe—pad the prompt—further yields measurable gains in accuracy, even under image corruption.

[37] Bridging Modalities on the Cortex: Surface-based MRI to PET Translation with a Diffusion Bridge cs.CV | cs.AIPDF

Yitong Li, Alexandra Samoylova, Fabian Bongratz, Timo Grimmer, Dennis M. Hedderich

TL;DR: DB-SUiT 在皮层表面流形上把 MRI 转译为 FDG-PET 表面，利用球面视觉 Transformer 和扩散桥保留折叠几何，并在失智症数据上提升自动分类表现。

Details

Motivation: FDG-PET 的皮层低代谢是失智症诊断的敏感生物标志，但费用、辐射暴露和可及性限制临床使用。MRI 转 PET 提供替代路径，然而体素生成方法未显式处理疾病模式主要所在的高度褶皱皮层结构。

Result: 作者提出表面扩散桥 DB-SUiT，直接在皮层流形上进行 MRI-to-PET 转译。条件球面 U 形视觉 Transformer 使用球面卷积编码多尺度表面特征，以瓶颈 Transformer 建模长程空间依赖，并加入人口统计和皮层下条件。在两个数据集（包括不同失智类型）上，合成高保真度优于基线。自动分类中，合成 PET 表面相较 MRI 提升 14.2%，相较 PET 体积提升 11.3%，接近真实 PET 表面；盲法读片准确率为合成 PET 85.5%、MRI 75.8%、真实 PET 95.2%。模型在外部队列及训练未包含的失智亚型上无需重训仍能泛化。

Insight: 针对皮层疾病信号的跨模态合成应在皮层流形而非仅在体素空间建模；表面几何先验有助于保留解剖结构，同时可在无需辐射的 MRI 输入下改善诊断信息。

Abstract: Cortical hypometabolism measured by Fluorodeoxyglucose Positron Emission Tomography (FDG-PET) is a highly sensitive biomarker for dementia diagnosis. However, high costs, radiation exposure, and limited accessibility constrain its clinical utility. While cross-modal synthesis from Magnetic Resonance Imaging (MRI) offers a promising alternative, existing volumetric generation methods do not explicitly account for the highly folded cortical geometry, where disease-related patterns predominantly reside. To address this, we introduce a novel surface-based diffusion bridge framework DB-SUiT for MRI-to-PET translation that operates natively on the cortical manifold. A conditional Spherical U-shaped vision Transformer (SUiT) is specifically designed to model the intricate cross-modal relationships while preserving surface topology. It combines spherical convolutional encoders for multi-scale surface feature extraction with bottleneck Transformers to capture long-range spatial dependencies, while incorporating demographic and subcortical conditions to refine the synthesis. Evaluated on two datasets, including subjects with different dementia types, DB-SUiT demonstrates high-fidelity synthesis that substantially outperforms other baselines. In automated dementia classification, synthesized PET surfaces improve performance over MRI by 14.2% and PET volumes by 11.3%, approaching the performance of real PET surfaces. In a blinded reader study, synthetic PET achieved 85.5% diagnostic accuracy, compared with 75.8% for MRI and 95.2% for real PET. This further demonstrates cross-cohort and cross-pathology generalization, as the model was evaluated without retraining on an external cohort that included a dementia subtype not represented during training. Our code is available at https://github.com/ai-med/DB-SUiT.

[38] Task-Oriented Semantic Feature Transmission for Multi-Task Satellite Remote Sensing over Low-SNR Channels cs.CV | cs.LGPDF

Shuoyuan Sun, Hongyu Wang, Mugen Peng, Wenjia Xu

TL;DR: 该方法绕过像素重建，直接通过低信噪比信道传输多任务预训练骨干提取的卫星图像语义特征，并在接收端恢复任务所需结构。

Details

Motivation: 传统卫星遥感采用先重建图像、再做推理的链路，优化像素保真度与分类、检测等下游目标不一致，在低信噪比时尤其不利。

Result: 作者提出面向任务的传输框架，直接发送多任务预训练骨干提取的语义特征。轻量信道适配模块压缩特征以降低带宽，接收端特征恢复器修复信道损坏后的任务相关结构；骨干冻结，适配器与任务专属头在随机 SNR 条件下联合优化，并使用任务和特征级监督。在加性高斯白噪声设定下，场景分类和目标检测实验于多种 SNR 条件下均优于重建导向的 JSCC 基线，低 SNR 区域提升最大。

Insight: 通信资源应优先保留下游推理所需语义，而非重建所有像素；冻结骨干后联合学习信道压缩和任务头，使传输目标与分类、检测目标对齐。

Abstract: Conventional satellite remote sensing transmission follows a reconstruct-then-infer paradigm that optimizes pixel-level fidelity, creating an objective mismatch with downstream tasks such as classification and detection, especially at low SNR. This paper investigates a task-oriented framework that bypasses image reconstruction and directly transmits semantic features extracted by a multitask-pretrained backbone. A lightweight channel adaptation module (CAM) compresses feature dimensionality for bandwidth reduction, and a feature restorer recovers task-relevant structure after channel corruption. With the backbone frozen, the CAM and task-specific downstream heads are jointly optimized with task and feature-level supervision under random-SNR training. Under the adopted AWGN setting, experiments on scene classification and object detection show consistent gains over reconstruction-oriented JSCC baselines across different SNR conditions, with the largest improvements in the low-SNR regime.

Md Mahfuzur Rahman, Pengzhan Zhou, A. F. M. Abdun Noor, Md Imam Ahasan, Md Mustafizur Rahman

TL;DR: MTF-Net 在循环融合中结合行人框动态、姿态、局部环境和场景语义，提前预测行人是否横穿，并在 PIE 和 JAAD 上取得高 AUC 和实时速度。

Details

Motivation: 自动驾驶需要提前判断行人意图以保障安全，但已有方法往往只建模单一模态的时间变化，或仅在粗粒度语义层融合多模态信息。

Result: MTF-Net 联合建模运动学、外观和上下文信号，融合边界框动态、人体姿态关键点、局部环境与场景级语义四种模态。带门控线性单元的循环融合框架自适应调节跨模态信息流，配合三个时间编码分支和注意力融合头，在实际横穿发生前数帧预测意图。在 PIE 与 JAAD 基准上超过近期 Transformer 和图模型，AUC 分别最高达 0.95 与 0.94，同时保持实时运行。

Insight: 可靠的行人意图判断来自对不同时间尺度的运动、姿态和场景上下文进行有原则的融合，不必依赖更复杂的单体架构。

Abstract: Accurately predicting pedestrian intentions is crucial for ensuring safe and proactive interaction between autonomous vehicles and pedestrians. However, existing approaches often depend on architectures that either model temporal dependencies within individual modalities or fuse modalities only at coarse semantic levels. To address these limitations, we propose MTF-Net, a novel Multi-Modal Temporal Feature Fusion Network that jointly models kinematic, appearance, and contextual cues for pedestrian intention prediction. MTF-Net integrates four complementary modalities-bounding-box dynamics, human pose keypoints, local context, and scene-level semantics within a recurrent fusion framework enhanced by gated linear units (GLUs). These GLU-based modules adaptively regulate cross-modal information flow, enabling interpretable and efficient feature interaction across temporal scales. Through three dedicated temporal encoding branches and an attention-guided fusion head, the proposed model robustly anticipates pedestrian crossing intentions several frames before they occur. Extensive evaluations on the PIE and JAAD benchmarks demonstrate that MTF-Net surpasses recent transformer- and graph-based models, achieving up to 0.95 AUC on PIE and 0.94 AUC on JAAD, while maintaining real-time performance. The results highlight that reliable pedestrian intention prediction arises from principled multi-modal fusion rather than excessive architectural complexity.

[40] A Two-Stage Multi-Scale Attention-Based Network for Weakly Supervised Cataract Fundus Image Enhancement cs.CVPDF

Xiaoyong Fang, Yue Wang, Xiangyu Li, Wanshu Fan, Dongsheng Zhou

TL;DR: TSMSA-Net 通过域转换合成真实风格白内障眼底配对样本，并加入多尺度注意力恢复细节，在无需配对训练图像时改善增强及下游血管分割和分类。

Details

Motivation: 白内障会导致视力损失并妨碍后续眼底诊断，但白内障视网膜配对图像难以获取，增强方法也常无法充分恢复细节或产生伪影。

Result: 作者提出两阶段多尺度注意力网络 TSMSA-Net。先通过域转换合成真实风格的白内障图像以缓解成对数据获取困难，再用多尺度注意力阶段提取更多有用细节，减少增强伪影。在 Kaggle 和 ODIR-5K 数据集上，即使没有配对训练图像，TSMSA-Net 仍超过当时先进白内障眼底增强方法，并展现一定泛化能力；增强结果还提升白内障图像上的血管分割和分类性能。

Insight: 无配对监督可借助域转换构建训练桥梁，而多尺度特征注意力有助于在去除白内障干扰时保留视网膜细节；下游任务改善说明增强对分析有实际价值。

Abstract: Cataract is a major cause of vision loss and hinders further diagnosis. However, cataract fundus image enhancement often grapples with challenges such as limited paired cataract retinal images and insufficient recovery of fine details in the retinal images. To mitigate these challenges, we in this paper propose a two-stage multi-scale attention-based network (TSMSA-Net) for weakly supervised cataract fundus image enhancement. Our TSMSA-Net leverages the domain transformation to synthesis paired real-like cataract images, solving the problem of difficult acquisition of paired images. To further extract detailed information from fundus images and reduce the generation of artifacts during the enhancement process, we propose a multi-scale attention-based stage to learn more useful features for cataract image enhancement. Experimental results on Kaggle and ODIR-5K demonstrate that our TSMSA-Net outperforms current state-of-the-art cataract fundus images enhancement even without paired images and exhibits certain generalization ability. Experimental results on Kaggle and ODIR-5K datasets indicate that our TSMSA-Net outperforms the current state-of-the-art methods for cataract fundus image enhancement, even in the absence of paired images. Additionally, it demonstrates a certain level of generalization capability. The enhancement also can improve the performance of vessel segmentation and classification in cataract images.

[41] Scene-Q: Confidence-Aware Coarse-to-Fine Querying of 3D Scenes with Selective VLM Reasoning cs.CV | cs.ROPDF

Juno Kim, Yesol Park, Hye-Jung Yoon, Byoung-Tak Zhang

TL;DR: Scene-Q 先用温度校准的检索分数评估置信度，仅对歧义较大的三维场景查询调用视觉语言模型，在准确性和检索成本间分流。

Details

Motivation: 室内移动机器人需要将开放词汇自然语言请求落到一致的三维地图上。基于对比图文编码器的余弦相似度检索虽然高效，但遇到近义标签或多个相似实例时容易混淆。

Result: Scene-Q 采用置信度感知的粗到细查询：对编码器分数做温度缩放，高置信查询直接快速检索；低置信查询才调用推理 VLM，在少量 top-K 候选中结合原始多视角图像和实例框重新排序，以利用上下文消歧。在 ScanNet200 开放词汇三维实例分割和真实重建上的自然语言三维实例检索中均有改进，空间及关系类查询增益最大，同时保持大量请求走快速路径。

Insight: 并非所有查询都需要昂贵视觉语言推理；校准置信度可把简单样例交给快速检索，把歧义样例交给多视角、关系感知的精判。

Abstract: Indoor mobile robots require open-vocabulary scene understanding that grounds natural-language queries in a consistent 3D map. Many existing systems ultimately rely on cosine-similarity retrieval with contrastive image–text encoders, which is efficient but brittle when labels are near-synonymous or multiple similar instances appear. We present Scene-Q, a confidence-aware coarse-to-fine querying framework that normalizes encoder scores with temperature scaling and selectively invokes a reasoning VLM only for low-confidence cases. High-confidence queries are answered by fast retrieval, while ambiguous ones are reranked over a small top-K candidate set using the original multi-view images and instance bounding boxes, enabling context-aware disambiguation at low cost. Scene-Q improves open-vocabulary 3D instance segmentation on ScanNet200 and natural-language 3D instance retrieval on real-world reconstructions, with the largest gains on spatial and relational queries while keeping a substantial fraction of queries on the fast path.

[42] AI or Real: Detecting Partially Altered Videos Under Resource-Constrained Environments cs.CV | cs.DCPDF

Tamoghna Chakraborty, Md Nurul Absur, Sourya Saha, Saptarshi Debroy

TL;DR: 该轻量视频检测器用冻结 MobileNetV3-Small 检查整帧以识别部分伪造视频，并通过时序难负例和校准采样降低场景切换误报与真实类失准。

Details

Motivation: 生成式视频发展后，实际威胁从整段伪造转向只篡改部分帧；现有高准确检测器依赖 4 亿参数以上骨干，难部署到边缘设备。

Result: 方法将 DINOv2-Base 教师蒸馏到冻结 MobileNetV3-Small 学生，结合温度退火软标签、注意力多样性正则、帧级监督和残差特征适配器。针对部分伪造特有失误，使用同视频时间难负例处理合法场景切换的误报，并通过校准感知采样改善占主导的纯真实类别阈值失准。在 55,393 个拼接测试样本、伪帧占比 6.2%–31.2% 的评测中，学生闭合了教师与轻量模型性能差距的 58%，教师 AUC 为 0.766；RTX A4000 上处理 16 帧片段需 3.65 毫秒，模型文件 150.4MB，满足其目标边缘设备的内存和延迟预算。

Insight: 部分视频篡改需要整帧检测及对时间连续性的建模，不能只依赖人脸裁剪；把场景切换作为难负例并针对真实类校准，可改善实际部署中的误报与阈值问题。

Abstract: The proliferation of generative video models has shifted the practical detection threat from fully fabricated clips to partially manipulated footages. Although modern detectors achieve strong accuracy using foundation backbones of 400M+ parameters, their resource footprint precludes edge deployment. In this paper, we present a lightweight full-frame detector for partially manipulated AI-generated video, designed for deployment on edge hardware without face-detection preprocessing. The system distills a DINOv2-Base teacher into a frozen MobileNetV3-Small student through a pipeline that combines temperature-annealed soft-label transfer, attention-diversity regularization, frame-level supervision, and a residual feature adapter that conditions ImageNet features for artifact detection. We additionally target two failure modes specific to the partial-manipulation regime: false positives on legitimate scene cuts, addressed through within-video temporal hard negatives; and threshold-level miscalibration on the dominant pure-real class, addressed through calibration-aware sampling. Evaluation on a 55,393-sample spliced test set across fake-frame ratios from 6.2% to 31.2% demonstrates the student model closing 58% of the gap to the DINOv2-Base teacher (AUC 0.766) while running at 3.65 ms per 16-frame clip on RTX A4000 with a 150.4 MB checkpoint compatible with edge-device memory and latency budgets.

[43] CleanVideo: Adaptive Concept Erasure for Text-to-Video Diffusion Models cs.CV | cs.AIPDF

Junchi Liao, Hongji Li, Wenrui Zhou, Lijie Hu

TL;DR: CleanVideo 用视觉时空特征、去噪步和文本语义共同控制低维子空间干预，按帧和步骤选择性擦除视频扩散模型中的目标概念。

Details

Motivation: 把概念擦除从图像扩展到视频更困难，因为目标概念会跨帧和去噪步骤逐渐显现；固定干预可能漏掉目标，也可能导致模糊、抖动和内容失真。

Result: CleanVideo 采用三模态门控机制，在低维子空间中选择何处、何时以及是否干预，联合处理时空视觉特征、时间步信号和文本语义。对可明确界定替代概念的目标，方法把擦除内容导向自然替代项，同时保留非目标内容。在三个视频扩散模型上的帧级和视频级实验中，CleanVideo 擦除目标概念并保持视觉保真度与时间连贯性，超过既有基线；在受保护流水线完整的条件下也能抵抗概念恢复攻击。

Insight: 概念擦除需随时间和视觉区域自适应，而不是逐帧统一修改；多条件门控允许只在目标实际出现的时空位置施加干预。

Abstract: Concept erasure aims to selectively eliminate undesired visual semantics from pre-trained generative models without compromising their general utility. Extending concept erasure from images to video is nontrivial. Target concepts emerge gradually and vary across frames and denoising steps. As a result, fixed interventions may miss the target or introduce blurring, jitter, and content distortion. We propose CleanVideo, a selective erasure framework that performs low-dimensional subspace intervention controlled by a tri-modal gating mechanism. By jointly processing spatiotemporal visual features, timestep signals, and textual semantics, CleanVideo determines where, when, and whether to intervene, steering erased content toward natural surrogate concepts when such surrogates can be clearly defined while preserving non-target content. Experiments on three video diffusion models show that CleanVideo effectively erases target concepts while maintaining visual fidelity and temporal coherence, outperforming existing baselines under frame-level and video-level evaluations and under concept-recovery attacks when the protected pipeline remains intact.

[44] Not All Layers Are Equal: Dynamic Layer Routing for Reliable CLIP OOD Detection cs.CVPDF

Ignacio M. De la Jara, Cristian Rodriguez-Opazo, Damith Ranasinghe

TL;DR: Voyager 学习 CLIP 各层的动态路由器，根据输入选择稀疏层专家用于分布外检测，比固定层融合或提示学习更有效且成本更低。

Details

Motivation: 跨层信息聚合可改善 CLIP 分布外检测，但既有工作主要研究如何融合层特征；不同输入可能需要信任不同层，固定聚合方式未必适用。

Result: 作者将问题转为学习“对当前输入应信任哪些层”，用可泛化的弱分布外上下文构造监督，训练轻量路由器从 CLIP 深度中选择以最终层为锚点的稀疏专家。三个基准上 Voyager 均改善 OOD 检测；ImageNet-1K 的平均 FPR@95 为 18.86，比可比的最强提示学习方法好 8.8 个百分点。换用既有先进提示方法的监督源后，收益仍保留，说明关键优势来自可学习路由器而非特定监督。路由器约两分钟训练完成、内存低于 1GB，约比现有提示学习方法高效 20 倍。

Insight: 输入相关的层选择比固定融合更能利用 ViT 深度中的异质信息；轻量路由器在不增加大规模微调开销的情况下实现了按样例自适应的 OOD 判断。

Abstract: Information aggregation across model layers are revealed to improve OOD detection. In contrast to crafting a method for layer-wise information aggregation in recent work, we investigate if layer selection is a learnable problem. In other words, we transpose the question from how to fuse layers to one asking which layers to trust for an input. Using a generalizable, weak, out of distribution context crafting approach for supervision, shown to be more effective than state of the art methods’ mechanisms, we formulate learning a lightweight router to select a sparse, final-layer-anchored expert over CLIP’s layer depth for OOD detection. Across three diverse benchmarks we demonstrate our learnable routing method dubbed Voyager improves OOD detection. On ImageNet-1K, Voyager achieves an average FPR@95 of 18.86, outperforming the strongest, comparable, prompt-learning method by 8.8 points. These gains persist across multiple supervision sources, including those used by existing state-of-the-art prompt-learning methods, demonstrating that, whilst our weak OOD supervision context is highly effective, the key advantage is realized from the learnable router component rather than the supervision source. Significantly, Voyager is highly practical; router learning takes approximately two minutes using less than 1 GB of memory, making it approximately 20x more efficient than current prompt-learning approaches. Anonymized Code: https://anonymous.4open.science/r/Voyager/

[45] AgriScope: Pixel-Grounded Multimodal Understanding for Agricultural Images cs.CVPDF

Abderrahmene Boudiaf, Mohamad Alanssari, Irfan Hussain, Sajid Javed

TL;DR: AgriScope 将农业图像理解扩展到图像、区域和像素级统一接地任务，并用超过 50 万图像、1,100 万指令样本的 AgriGround 支持训练。

Details

Motivation: 农业图像需在复杂真实条件下识别植物病害、害虫、作物结构和植物种类。现有多模态大模型多只输出文本，缺少像素级接地，难支持细粒度农业理解和区域操作。

Result: AgriScope 结合生物语义编码、稠密空间表征和像素解码，在统一框架中支持接地描述生成、指代表达分割和多轮多模态农业交互。作者构建 AgriGround，含 50 万以上图像和 1,100 万指令样例，覆盖病害分析、作物和杂草识别、虫害识别及细粒度植物学理解；数据通过多阶段自动标注管线生成，包括描述、短语接地、分割掩码和任务指令合成。多项农业视觉语言任务实验显示其像素接地能力有效。

Insight: 农业领域的多模态理解需把生物学语义和像素位置联合建模；大型密集接地数据集与统一图像、区域、像素任务接口可推动超越纯文本答案。

Abstract: Agricultural image understanding requires fine-grained recognition of plant diseases, pests, crop structures, and botanical species under complex real-world conditions. Despite recent advances in Multimodal Large Language Models (MLLMs), existing models remain limited to text-only outputs and lack pixel-level visual grounding capabilities. In this work, we introduce AgriScope, a unified pixel-grounded multimodal framework for agricultural image understanding. AgriScope jointly supports image-level, region-level, and pixel-level understanding within a unified framework, enabling tasks such as grounded caption generation, referring expression segmentation, and multi-turn multimodal interaction for agricultural imagery. AgriScope integrates biologically specialized semantic representations with dense spatial grounding through biological-semantic encoding, dense spatial representations, and pixel decoding. To support large-scale grounded learning, we introduce AgriGround, a large-scale pixel-grounded agricultural multimodal instruction-tuning dataset containing over 500K images and 11M instruction-following samples spanning plant disease analysis, crop and weed identification, insect pest recognition, and fine-grained botanical understanding. AgriGround is constructed through a multi-stage automatic annotation pipeline that integrates multimodal caption generation, phrase-level grounding, segmentation mask generation, and task-oriented instruction synthesis to produce densely grounded supervision. Extensive experiments across multiple agricultural vision-language tasks demonstrate the effectiveness of AgriScope in pixel-grounded multimodal understanding, establishing a strong benchmark for agricultural vision-language learning and visual grounding. The dataset and code will be made publicly available at (https://github.com/boudiafA/AgriScope)

[46] FreqDINO++: A Frequency-Guided Multi-Task Routing Vision Foundation Model for Universal Ultrasound Analysis cs.CVPDF

Qing Xu, Yixuan Zhang, Yue Li, Xiangjian He, Qian Zhang

TL;DR: FreqDINO++ 将任务共享与专属知识路由、多尺度超声频率特征和全局-局部协同解码结合，在 27 种临床超声任务中超过强基线并展现未见数据泛化。

Details

Motivation: 超声分析需同时支持病灶分割和良恶性分类等稠密与全局任务，但自然图像预训练模型存在明显领域差距。逐任务微调大型视觉骨干计算成本高，也忽视了异构任务间共性。

Result: FreqDINO++ 包含参数高效整合共享和任务特定知识的多任务路由适配器、提取超声多尺度频率特征的频率感知增强器，以及通过全局-局部 token 交互促进稠密与全局任务协作的任务对齐解码器。大规模多任务及外部单任务超声基准实验覆盖 27 种临床场景，结果持续超过强基线和近期基础模型，并对未见数据表现出较好泛化。

Insight: 超声的频率结构与任务间共享特征需要同时利用；通过路由适配而不是为每个任务单独微调整个骨干，可兼顾计算效率和任务协作。

Abstract: Ultrasound image analysis plays a crucial role in cancer screening and prenatal diagnosis, yet comprehensive assessment requires jointly addressing tasks such as lesion segmentation and benign-malignant classification. While recent vision foundation models have shown remarkable universal representations, unlocking their potential for ultrasound is bottlenecked by the considerable domain gap from natural images. Existing methods typically fine-tune heavy vision encoders for isolated tasks, incurring substantial computational overhead while overlooking the underlying commonalities across heterogeneous tasks. In this work, we propose FreqDINO++, a frequency-guided multi-task routing vision foundation model for universal ultrasound analysis. We first introduce a Multi-task Routing Adapter (MR-Adapter) to support parameter-efficient integration of task-common and task-specific knowledge, a Frequency-aware Feature Enhancer (F$^2$-Enhancer) is then designed to capture the rich multi-scale frequency characteristics of ultrasound images, and a Task-aligned Collaborative Decoder (TC-Decoder) is devised to promote collaboration between dense and global prediction tasks through global-local token interaction. Extensive experiments on large-scale multi-task and external single-task ultrasound benchmarks demonstrate that FreqDINO++ consistently outperforms strong baselines and recent foundation models across 27 diverse clinical task scenarios, while also showing promising generalization to unseen data. The code is at https://github.com/MingLang-FD/FreqDINO-Plus.

[47] EliGSiR: Continual RGB-D Mapping with Gaussian Splatting under Bounded Compute cs.CV | cs.ROPDF

Björn Ellensohn, Elmar Rueckert, Christian Rauch

TL;DR: EliGSiR 面向持续到来的 RGB-D 观测，在有限优化预算下自适应筛选视角、调整监督分辨率并按需增加高斯几何表示。

Details

Motivation: 传统 3D Gaussian Splatting 假设观测已完整获得且可长时间优化；在线持续建图则需在新数据持续到达时保留旧区域重建，并在有限算力预算内更新地图。

Result: EliGSiR 包含地图引导视角调度以剔除冗余输入并按地图状态重审视角、负载自适应保真度以根据建图压力调整监督分辨率，以及定向几何扩展以把深度监督与高斯创建分离、只在反复 RGB-D 观测显示缺失或错位时扩展几何。作者在 Replica、TUM RGB-D、ScanNet++ 和真实传感器序列评测最终重建和采集过程中的地图。在 TUM 指定序列和相同真值位姿下 PSNR 为 21.52 dB，高于 SplaTAM 的 19.42 dB；使用实时 ORB-SLAM3 位姿时为 23.02 dB、155.5 秒，也优于相应 CaRtGS 比较结果。

Insight: 在线建图应把有限算力按地图状态分配到有信息量的视角、图像细节和缺失结构，而非固定优化计划；评估中也检查采集过程里的地图质量。

Abstract: Conventional 3D Gaussian Splatting assumes a closed set of observations and long optimization schedules. Continual RGB-D mapping in contrast poses the problem that new observations arrive online, while previously reconstructed regions must be preserved. We present EliGSiR (Evidence-guided Load-adaptive Incremental Gaussian Splatting with Image Replay), a continual Gaussian mapper that controls how the available optimization budget is used as the reconstruction evolves. Map-Guided View Scheduling filters redundant incoming views and reconsiders retained views according to the current state of the map. Load-Adaptive Fidelity adjusts supervision resolution to the current mapping load instead of following a fixed resolution schedule. Targeted Geometry Growth separates depth supervision from Gaussian creation and adds geometric capacity only where repeated RGB-D observations indicate missing or misplaced structure. Together, these mechanisms adapt which views are optimized, how much image detail is used, and where the representation grows while mapping remains active. We evaluate EliGSiR on Replica, TUM RGB-D, ScanNet++, and real RGB-D sensor sequences, considering both the final reconstruction and the map available throughout acquisition. On TUM RGB-D fr3/long_office_household, EliGSiR reaches 21.52 dB with the same ground-truth mapping poses used by the controlled baselines, compared with 19.42 dB for SplaTAM. In the tracked-pose comparison, EliGSiR with live ORB-SLAM3 poses reaches 23.02 dB in 155.5 s, compared with 20.10 dB in 230.9 s for CaRtGS using its native tracker. We further evaluate reconstruction throughout acquisition and show how EliGSiR adaptive view scheduling, supervision fidelity, and geometry growth improve the use of the available mapping budget.

[48] MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving cs.CVPDF

Shuai Liu, Hechangle Gong, Hao Jiang, Runlin He, Junxiang Zhan

TL;DR: MM-Future 联合生成多种配对的未来场景和驾驶动作假设，通过多模态扩散共同演化并对轨迹候选进行未来条件评分。

Details

Motivation: 自动驾驶的决策和场景变化相互耦合，且未来可能存在多种模式；只预测单一未来或只建模动作无法充分表达不确定性及行动对场景的影响。

Result: MM-Future 为每个假设结合结构化动作先验与独立未来场景来源，再经模态感知扩散 Transformer 双向共同演化场景-动作对。多视角视频被压缩为面向规划的 MM-Tokens，以支持高效多模态 rollout；候选轨迹由共享历史和配对预测未来共同评分。在 NAVSIM navtest 上 PDMS 为 94.0、EPDMS 为 91.5；HUGSIM 零样本闭环评测 HD-Score 为 32.3。消融显示其稳定优于单模态假设和仅动作版本。

Insight: 把多种未来场景与相应动作成对预测，可显式建模驾驶决策和世界演化的双向关系；规划器还能据共同未来而非孤立动作轨迹选择方案。

Abstract: Autonomous driving involves coupled decision-making and scene evolution under multi-mode uncertainty. To capture this coupling and uncertainty, we introduce MM-Future, a world-action model that generates multiple paired scene-action hypotheses and models bidirectional interaction within each pair. Each hypothesis is initialized from a structured action prior and an independent future scene source, which are then co-evolved through a modality-aware diffusion Transformer. To support efficient multi-mode rollout, MM-Future compresses multi-view video into planning-oriented representations, dubbed MM-Tokens. Finally, a future-conditioned proposal scorer ranks trajectory candidates by shared history context and their paired predicted future. On NAVSIM navtest, MM-Future achieves 94.0 PDMS and 91.5 EPDMS, while attaining a 32.3 HD-Score in zero-shot closed-loop evaluation on HUGSIM. Ablations show consistent improvements over both single-mode and action-only variants, validating the benefit of multi-mode joint world-action modeling.

[49] Compact Vision Models for Iris Presentation Attack Detection under Presentation Attack Instrument Shift and Environmental Degradation cs.CV | cs.CRPDF

Athanasios Angelakis, Marta Gomez-Barrero

TL;DR: 研究比较三个从零训练的小型虹膜呈现攻击检测模型在未知攻击工具和环境退化下的性能，发现最优小模型仍有较高绝对错误，不能据此视为可部署。

Details

Motivation: 虹膜呈现攻击检测在未知攻击设备或验证时未出现的采集条件下可能失效。边缘部署需要小模型，但其跨域性能及固定阈值下的风险需要量化。

Result: 作者在 LivDet-Iris 2017 的 Notre Dame 子集评估三个可训练参数约不超过 26 万、从零训练且不使用外部预训练或数据增强的视觉模型，采用五个随机种子，并将验证集选定阈值原样迁移到已知攻击、未知攻击、受损及汇总测试集。从已知到未知攻击时，APCER 增加 17.11–30.47 个百分点，D-EER 增加 7.38–12.73 个百分点。ZACH-ViT 的未知攻击 APCER 和 D-EER 最低，但错误仍高；作者明确指出相对最佳模型的优势不代表面对未知攻击工具已具备部署准备度。

Insight: 低参数量的比较优势与实际安全可用性是两回事；未知呈现攻击和环境移位会显著恶化错误率，因此应报告固定阈值跨域表现而非只看开发集结果。

Abstract: Iris presentation attack detection (PAD) is security-critical when a subsystem that appears reliable during development encounters presentation attack instruments (PAIs) or acquisition conditions absent from validation data. We benchmark three compact scratch-trained computer-vision models, each with at most approximately 0.26 million trainable parameters, on the Notre Dame subset of LivDet-Iris 2017 under PAI-driven domain shift and environmental degradation. All models are trained without external pretraining or data augmentation and evaluated over five seeds. A validation-selected threshold is transferred unchanged to the known-attack, unknown-attack, corrupted, and pooled test partitions. From known to unknown attack presentations, Attack Presentation Classification Error Rate (APCER) increases by 17.11-30.47 percentage points and Detection Equal Error Rate (D-EER) increases by 7.38-12.73 percentage points. At the validation-selected threshold, ZACH-ViT obtains the lowest unknown-attack APCER (47.69 +/- 4.84%) and D-EER (38.87 +/- 0.93%), while Compact-TransMIL obtains the lowest Bona Fide Presentation Classification Error Rate (BPCER). ZACH-ViT also gives the lowest unknown-attack BPCER at an APCER limit of 10% (81.29 +/- 1.95%). The high absolute errors show that the comparative advantage of the best compact model does not constitute deployment readiness under unknown PAIs.

[50] TouchSight: Bare-Handed Tactile Prediction from Egocentric Video via Generative Visual Augmentation cs.CV | cs.AIPDF

Danyan Zhou, Jinxuan Lu, Jiawei Lin, Tianxing Chen, Chuqiao Lyu

TL;DR: TouchSight 从单目第一人称视频预测稠密手部接触力，并利用生成视频将戴手套训练数据转换为裸手外观，缓解真实场景域差距。

Details

Motivation: 触觉信号能直接测量接触和作用力，是理解物理交互和灵巧操作的重要信息，但采集需要在接触界面安装传感器，设备昂贵、侵入性强且限制大规模数据收集。

Result: TouchSight 使用 500 小时压力手套记录及大量手物交互数据，从单目第一人称视频估计全手稠密接触力。针对训练手套外观与真实裸手场景间的差异，作者构建 TwinTouch-20H：20 小时配对视觉数据，由视频生成模型将戴手套录像重绘成不同背景下的裸手画面，同时保留原始触觉标签。TouchSight 可从手套视频和生成裸手视频预测力，在 OakInk2 上超过先前接触预测方法；定性上能泛化到未见数据集的自然裸手第一人称视频，且手套监督规模增加时表现持续改善。

Insight: 生成式外观转换能在保留真实测量触觉标签的前提下扩展裸手视觉训练数据，从而有望在采集阶段不使用触觉传感器、仅用视频恢复接触力。

Abstract: Tactile signals provide direct contact and force measurements that are essential for understanding physical interactions and enabling dexterous robotic manipulation. However, tactile sensing requires direct measurement at contact interfaces, making large-scale data collection reliant on intrusive, costly, and restrictive instrumentation. We present TouchSight, a monocular egocentric vision framework for dense full-hand contact force prediction that leverages 500 hours of pressure-glove recordings and extensive hand-object interaction (HOI) data. To address the appearance gap between gloved training data and bare-hand real-world scenarios, we construct TwinTouch-20H: 20 hours of paired visual data in which generative video models re-render gloved recordings as bare-hand observations against new backgrounds while preserving the original measured tactile labels. TouchSight predicts dense force from both gloved and generated bare-hand videos, outperforms prior contact prediction methods on OakInk2, qualitatively generalizes to natural bare-hand egocentric videos from unseen datasets, and improves consistently as glove supervision scales. These results demonstrate that dense tactile signals can be recovered from egocentric vision alone, without tactile instrumentation at capture time.

[51] When Do Language-Grounded Explanations Help? A Graph-Bottleneck for Farm Monitoring Interpretable Sheep Facial Pain cs.CV | cs.AIPDF

Alam Noor, Miguel Guti’errez Gait’an

TL;DR: 研究发现语言描述引导的注意力并不保证羊脸疼痛解释有效；改用仅依据 SPFES 概念分数的瓶颈分类器后，解释更可验证但 κ 略有下降。

Details

Motivation: 基于面部表情的自动疼痛识别可支持羊群持续福利评估，但养殖人员需要可信依据，而不只是分类分数。作者检验语言描述引导的注意力能否产生真正有意义的解释。

Result: 模型让检测到的面部区域关注羊疼痛面部表情量表 SPFES 的临床描述。消融完整描述对预测 logit 的影响约 10^-4，最受关注线索仅在 32.6% 区域与疼痛级别一致，说明注意力图、门控和生成文本给出的解释并不成立。作者移除外观旁路，设计只读取 SPFES 概念分数的概念瓶颈分类器，并用逐区域状态标注监督；Cohen κ 降低 0.05–0.10，但少数疼痛状态检出率达其基础发生率的 3.5–8.3 倍，且无严重度监督仍学得耳部和眼部严重度排序。仅去掉状态监督会使 κ 不变、概念准确率降至 0.109。

Insight: 注意力和自然语言解释看起来合理，并不意味着模型真的依赖相应临床概念；概念必须对预测有结构性作用并接受语义标签检验，且临床类别失衡时总体概念准确率可能误导。

Abstract: Automated pain recognition from facial expression could make continuous welfare assessment practical in sheep, but adoption depends on trust: a stockperson cannot act on a score that arrives without justification. We ground a model in the Sheep Pain Facial Expression Scale (SPFES) by letting each detected facial region attend over text embeddings of the clinical descriptors and then test whether the resulting explanations mean anything. They do not. Ablating an entire descriptor changes the predicted logit by about $10^{-4}$, and the most-attended cue agrees with the predicted pain level in only $32.6%$ of regions, although the attention maps, the learned gate, and the generated text all proposed otherwise. We therefore remove the appearance bypass with a concept bottleneck whose classifier reads only SPFES concept scores, supervised by per-region state annotations that image-level pipelines discard. This costs $0.05$–$0.10$ in Cohen’s $κ$ but yields concepts that are demonstrably learned: minority pain-indicating states are recovered at $3.5$–$8.3\times$ their base rates, and the ear and eye severity orderings emerge without severity supervision. Removing the supervision alone leaves $κ$ unchanged while concept accuracy falls to $0.109$, showing that architectural necessity does not imply semantic validity. We also show that pooled concept accuracy is misleading under clinical imbalance and provide a cross-validated, protocol-matched benchmark of seven methods on this dataset.

[52] Cross-Architecture Foundation-Model Distillation for Edge Flood Segmentation cs.CV | cs.LGPDF

Fabian Schmalstieg, Karsten Mueller, Wojciech Samek

TL;DR: 研究将 3 亿参数 Prithvi-EO-2.0 教师蒸馏到 70 万参数 EfficientViT-B0，用无标注卫星影像扩大学生训练集，并部署为 Jetson 上的轻量洪水分割模型。

Details

Motivation: 地理空间基础模型可取得较强洪水分割效果，但模型体积限制其在内存受限边缘设备上的使用；手工标注训练场景又成本高。

Result: 作者以 252 个人工标注 Sen1Floods11 场景微调教师，并用其监督额外无标注 Sentinel-2 影像，扩大学生训练数据。252 场景相同预算下教师监督训练与直接训练具竞争力，且在多种设定下改善 STURM-Flood。扩展至 2,500 场景后，浮点学生在 Sen1Floods11 达 0.787 水体 IoU，教师为 0.822；在 STURM-Flood 与教师持平，但仍低于教师的 WorldFloods-v2 结果。经激活替换和量化感知训练后，学生成为 1.5MB INT8 TensorRT 引擎，在 Jetson Xavier NX 上每张 512×512 图像 GPU 计算耗时 5.57 毫秒，运行设备内存约 14MB。

Insight: 基础模型可把固定人工标注预算扩展为更大的弱标注训练集，最终得到可部署边缘模型；外部干净基准上固定 MNDWI 阈值也有竞争力，因此结果应解读为泛化检验，而非证明模型胜过简单光谱规则。

Abstract: Geospatial foundation models can provide strong flood-segmentation performance, but their size limits deployment on memory-constrained edge hardware. We distill a 300-million-parameter Prithvi-EO-2.0 teacher, fine-tuned on the 252 manually labeled Sen1Floods11 training scenes, into a 0.7-million-parameter EfficientViT-B0 student. The teacher supervises additional unlabeled Sentinel-2 imagery, allowing the student training set to grow without new manual annotations. At the matched budget of 252 scenes, teacher-supervised training is competitive with direct training and improves STURM-Flood performance across tested configurations; a geometry-matched control shows that label source alone does not explain the difference. Scaling the teacher-supervised pool to 2,500 scenes narrows the remaining student–teacher gap: the float student reaches 0.787 water intersection over union on the Sen1Floods11 test split against 0.822 for the teacher, matches the teacher on STURM-Flood under our evaluation protocol, and remains below it on WorldFloods-v2. After activation replacement and quantization-aware training, the student runs as a 1.5-megabyte 8-bit integer (INT8) TensorRT engine on a Jetson Xavier NX at 5.57 milliseconds of graphics processing unit (GPU) compute per 512-by-512 image, with approximately 14 megabytes of runtime device memory. A fixed modified normalized difference water index (MNDWI) threshold is competitive with both models on the two clean external benchmarks, so we interpret those benchmarks as generalization tests rather than as evidence of learned-model superiority over a spectral rule. The results support the conclusion: foundation-model supervision can amplify a fixed manual annotation budget into a substantially larger training set and yield a compact, deployable edge model.

[53] SenseFuse: Label-Free Fusion of Image and Shape Encoders for Open-Vocabulary 3D Instance Segmentation cs.CV | cs.ROPDF

Euiseok Han, Tri Ton, Hwanhee Kim, Seungyeon Ryu, Chang D. Yoo

TL;DR: SenseFuse 无需标签地融合二维图像编码器和三维形状编码器，仅改进开放词汇三维实例分割的掩码标签阶段，并利用两种编码器互补的错误模式。

Details

Motivation: 开放词汇三维场景理解是机器人空间推理和操作的基础，但当前方法在掩码标注时多依赖二维图像或图像蒸馏表征，没有充分利用三维形状信息。

Result: 作者发现二维图像与三维形状编码器的失败模式大体不同，很少给出相同错误标签，而两个二维编码器则常重复犯同样的错。SenseFuse 根据单场景未标注候选掩码估计无标签敏感度，以毫秒级选择场景级融合权重，仅调整现有流程的掩码标注阶段。在 ScanNet200、Replica 和 ScanNet++ 的所有评估设定中，标签精度均提升，恢复了 oracle 权重可得增益的 67%–100%（中位数 93%）；22 个报告设定中有 21 个提高实例 AP。

Insight: 异构表征的错误互补性可用于免标签融合权重选择；相较增加另一个相似二维编码器，加入三维形状信号更可能提供独立判别证据。

Abstract: Open-vocabulary scene understanding is fundamental for robotics, laying the groundwork for spatial reasoning and object manipulation. While closed-vocabulary 3D instance segmentation heavily leverages 3D shape information, state-of-the-art open-vocabulary methods remain predominantly restricted to 2D image features or image-distilled representations during mask labeling. In this paper, we propose SenseFuse, a label-free fusion method that balances 2D image and 3D shape encoders for robust open-vocabulary 3D instance segmentation, refining only the mask-labeling stage of existing pipelines. We reveal that 2D image and 3D shape encoders exhibit largely disjoint failure patterns and rarely share identical wrong labels, whereas two 2D image encoders frequently repeat the same errors. This distinct behavior makes the 2D and 3D pair inherently complementary. We introduce an adaptive mechanism that selects a scene-level fusion weight to maximize a label-free sensitivity measure, estimated directly from a single scene’s unlabeled proposals in milliseconds. SenseFuse improves labeling accuracy in every evaluated setting across ScanNet200, Replica, and ScanNet++, recovering 67-100% (median 93%) of the gain achievable with an oracle weight, and it raises instance AP in 21 of 22 reported settings. Code is available at https://github.com/hanes1207/SenseFuse.

[54] Grounded Product Understanding in Livestream Videos cs.CVPDF

Xinyu Zhang, Junjie Chen, Jiawei Ge, Qianlong Li, Libin Ma

TL;DR: GPUB 基准联合考查直播电商中的商品身份识别与支持片段定位；UniPro 通过共享多模态表示把配对 mAP 提升至 21.53%，但任务仍很难。

Details

Motivation: 电商直播中多个商品分散在不同时间出现，商品理解模型需找出商品并定位相关片段以支持剪辑和信息提取。已有基准通常分开评测商品检索和时间定位，没有检查商品身份与时间证据是否正确对应。

Result: GPUB 含 3,000 段直播实例、质量控制的多时刻标注和超过 31,000 件时尚商品目录，主任务要求根据视频和候选商品同时识别目标商品并定位支持片段，另提供商品检索和片段定位子任务。现有多模态模型仍很弱，最佳基线配对 mAP@.3 仅 10.13%。作者提出 UniPro，以共享多模态编码形成商品对齐、时间结构化表征，将该分数提升至 21.53%，GPrU Joint R@1@.3 达 37.23%。

Insight: 检索命中和时间片段命中必须作为配对结果联合评估，否则无法判断定位片段是否真的支持所识别商品；基准也显示目前模型离可靠直播商品理解仍有差距。

Abstract: E-commerce livestreams have emerged as an important channel for presenting products to online consumers, containing multiple products whose information is scattered in different moments. This poses significant challenges for downstream product understanding applications, such as product-centric livestream clipping, where models need to identify the product and its relevant segments for information gathering. However, existing benchmarks for general product understanding typically evaluate product retrieval and temporal localization in isolation, leaving the critical correspondence between product identity and temporal evidence largely unassessed. To address this limitation, we introduce GPUB, a large-scale benchmark comprising 3,000 livestream instances with quality-controlled multi-moment temporal annotations and a catalog of over 31K fashion products. GPUB supports three evaluation tasks: the main task Grounded Product Understanding (GPrU) requires jointly identifying the target product and localizing its supporting moments from a livestream video and a candidate product set; Product Retrieval and Product Moment Localization serve as two complementary subtasks. Evaluation of existing multimodal models shows that GPrU remains highly challenging, with the best-performing baseline achieving only 10.13% Pair mAP@.3. To narrow the performance gap, we further develop UniPro, a unified product understanding model that derives product-aligned and temporally structured representations from shared multimodal encoding, improving Pair mAP@.3 to 21.53% while achieving 37.23% Joint R@1@.3 on GPrU.

[55] DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering cs.CVPDF

Luca De Grandis, Silvia Cappelletti, William Raccagni, Marcella Cornia, Lorenzo Baraldi

TL;DR: DocAttriBench 用遮蔽候选文档元素后困惑度变化自动生成文档问答答案来源归因，建立含 23.7 万文档、29.6 万问答的细粒度接地基准。

Details

Motivation: 文档视觉问答的答案接地仍缺少标注：多数基准没有来源定位标签，已有标签质量有限，而人工构建细粒度元素级标注成本高。

Result: DAB 将答案来源归因到文本块、表格和图片等具体版面元素。作者提出 MAPPET，结合文档布局与语言模型，通过遮蔽候选元素观察困惑度上升，将对模型置信度贡献最大的元素作为答案来源。对多个既有 Document VQA 数据集应用后，构成 23.7 万份文档、29.6 万问答对的元素级接地基准。评测显示，较大模型通常答案准确率更高，但即使最强模型也常不能定位支撑答案的元素。

Insight: 答案正确和来源正确是不同能力；遮蔽后困惑度变化提供可扩展的元素级归因生成方式，可用于检验模型是否真正依据页面证据作答。

Abstract: Answer grounding in document visual question answering remains an open challenge: most benchmarks lack grounding annotations or provide limited-quality labels, while constructing grounded datasets still requires costly manual effort. We introduce DocAttriBench (DAB), a large-scale benchmark for fine-grained, element-level source attribution in Document VQA, grounding answers to specific layout elements such as text blocks, tables, and images. To build DAB, we propose a Mask-based Perplexity-Derived Attribution method (MAPPET) that combines document layout and language modeling to identify the most informative element for each answer. MAPPET measures the increase in perplexity after masking candidate elements and attributes the answer to the element contributing most to model confidence. Applying MAPPET to multiple existing Document VQA datasets yields DAB, with 237k documents and 296k question-answer pairs with element-level grounding. We benchmark grounding-capable multimodal LLMs on DAB, evaluating answer accuracy, attribution accuracy, and overall answer quality. Results show that while larger models generally achieve higher answer accuracy, even the strongest models often fail to localize the supporting elements. DAB provides a scalable benchmark for developing grounded, verifiable, and trustworthy Document VQA models. Dataset and code are available at https://aimagelab.github.io/DocAttriBench/.

Yulong Chen, Ziqian Zhang, Haoyu Zhang, Ao He, Senmao Li

TL;DR: RefineEdit 通过比较双分支对同一源图像二值编码的概率判断，动态选择可编辑位置和比特，其他内容复制源状态，实现无需训练的文本引导图像编辑。

Details

Motivation: 文本引导编辑需实现目标改变并保留无关内容，但扩散编辑依赖的空间控制不精确时会漏改或误改；因果自回归编辑又受固定解码顺序限制，难以修订早期决定。

Result: RefineEdit 基于生成式精炼网络，使用全局二值图像码精炼把编辑定位和内容生成结合起来。编辑分支从源图像中间状态初始化并复用逐渐形成的布局；比较源分支和编辑分支对同一源采样比特的概率，以带符号差异选择编辑位置和比特，其余比特继续复制源状态。自适应空间冻结限制掩码扩张，有限比特锁定让近期选中的位置仍可编辑。方法无需额外训练、外部掩码或注意力控制；在 PIE-Bench 九类编辑中，背景 PSNR、LPIPS、MSE、SSIM 保持分数最佳，整图及编辑区域 CLIP 得分也最高。

Insight: 把定位决策融入生成过程，并持续比较源分支与编辑分支的证据，可在逐步精炼时重新判断哪些比特应修改，从而缓解固定掩码和不可回退解码的限制。

Abstract: Text-guided image editing must introduce the requested changes while preserving unrelated source content. Diffusion-based editors rely on spatial controls whose inaccuracies can leave edits incomplete or alter unrelated regions. Causal autoregressive editors face a further constraint: their fixed decoding order limits revision of earlier decisions. We introduce RefineEdit, a training-free prompt-to-prompt image editing framework built on a Generative Refinement Network. Our key idea is to couple edit localization with content generation through the global refinement of binary image codes, allowing editing evidence to be reassessed as the image evolves. RefineEdit initializes an editing branch from an intermediate source state, reusing the emerging layout. We compare the probabilities assigned by the two branches to the same source-sampled bits, using their signed differences to select editable positions and bits. Selected bits follow editing refinement, while the remaining bits copy the evolving source state. To stabilize editing across refinement steps, adaptive spatial freezing limits unnecessary mask expansion, while finite bit locking keeps recently selected bits editable. The framework requires no additional training, external masks, or attention control. Across nine editing categories of PIE-Bench, RefineEdit achieves the best background-preservation scores in PSNR, LPIPS, MSE and SSIM, together with the highest whole-image and edited-region CLIP scores among the evaluated methods.

[57] PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videos cs.CVPDF

Di Wen, Kailun Yang, Jimmy Weissert, Luc Maria Scherrer, Cedric Zöllner

TL;DR: PROVIA 在完整第一人称视频中跟踪操作事实状态和正确流程进度，使用逐帧顺序检验在线检测失误，也允许人员恢复后继续评估。

Details

Motivation: 程序操作中的失误会改变工作状态，之后每一步都须按实际已做内容而非理想计划判断。只评估第一次失误的协议会切断录制，甚至让固定时间规则在不看视频时也显得有效。

Result: PROVIA 分开维护两种状态：包含实际操作步骤及失误的事实状态，以及依据正确示范、经贝叶斯状态合并得到的流程自动机后验和每个操作者的执行状态。只有在正确状态分支中推进程序状态，失误和纠正分支保留原状态；顺序检验将逐帧失误概率转为警报。使用同一滤波器和优化规则，在 CaptainCook4D、IndustReal、HoloAssist、IMPACT-ego 上优于所评估的受控基线。误报预算为每分钟 0.1 时，CaptainCook4D 召回率为 0.154 对 0.128，HoloAssist 为 0.034 对 0.015；流水线运行速度为 58–70 fps。

Insight: 在线流程监控需要同时记住实际发生过什么与规范流程已到何处，并把失误后的纠正当作独立分支，而非把视频在首次错误处截断。

Abstract: An assistant watching egocentric video should notice a mistake from past frames alone, before the next step begins, and keep working once the person recovers. A mistake changes the state of the work, so every later step has to be read against what was done rather than against the plan. The first-mistake protocol that current online methods report on cuts each recording at its first mistake, so a fixed-time rule that never looks at the video is right on every case. We evaluate on complete trials, where mistakes and recoveries arise naturally, under a validation false-alarm budget and against controls that use timing alone. PROVIA keeps two records apart: a factual state, a learned summary of the steps each actor performed, mistakes included, and the accepted progress, an exact posterior over the state of an automaton induced from correct demonstrations by Bayesian state merging and over the execution status of each actor. Procedure-state transitions occur only in the correct-status branch; the mistake and correction branches retain the source state. A sequential test turns the per-frame mistake probability into alarms. With one filter and one optimization rule, PROVIA ranks mistakes best among the evaluated controlled baselines on CaptainCook4D, IndustReal, HoloAssist and IMPACT-ego. At a validation budget of 0.1 false alarms per minute it recalls .154 against .128 on CaptainCook4D and .034 against .015 on HoloAssist, where it leads at every budget. The pipeline runs at 58-70 frames per second. The source code is available at https://github.com/Kratos-Wen/PROVIA.

[58] Earth Surface Immune System for Rapid Monitoring of Unknown Anomalies cs.CVPDF

Jingtao Li, Qian Zhu, Xinyu Wang, Deren Li, Liangpei Zhang

TL;DR: ESIA 将地表异常监测分为类别无关的时序变化定位和多模态开放词汇识别，再通过测试时嵌入适应处理未见灾害类型。

Details

Motivation: 气候变化和人类活动使地表异常更频繁且多样，异常类别历史样本少且难预测；现有方法通常只识别特定类别或停留在区域定位，未提供可操作的异常属性。

Result: ESIA 借鉴生物免疫系统分为先天与适应性阶段。先天阶段将卫星时间序列中的异常视为未知变化，不预设类别，生成二值定位图，速度为 14.51 km²/s，F1 比最强通用基线高 37%。适应性阶段用负选择过滤文本提示，再将保留提示与局部图像块交给多模态基础模型，识别未知异常的类别、受影响面积和损害严重程度，识别 F1 超过 80%。突变机制仅需一对参考图像，以 3.26 秒调节少量嵌入适配场景。全球数据集覆盖六类、19,801.60 km²，并用于卡霍夫卡大坝垮塌后第聂伯河三角洲退化农田和 2025 年洛杉矶 Palisades 火灾烧伤程度分析。

Insight: 先用类别无关变化检测发现未知异常，再以开放词汇多模态模型描述其属性，可将定位扩展为可行动监测；极少参考样本的快速测试时适配支持场景特定识别。

Abstract: Earth surface anomalies, driven by escalating climate change, and expanding human activities, are increasing in both frequency and diversity, yet their limited historical data and unpredictability make them fundamentally different from conventional remote sensing targets. Existing methods address specific anomaly categories or stop at localization, leaving a gap between detection and actionable information. Here we present ESIA, an Earth Surface Immune System whose architecture is constrained by three principles from the biological immune system, refined over millions of years against equally diverse and uncertain threats. A non-specific innate immune stage treats anomalies as unobserved changes in time-series satellite imagery, generating binary localization maps at 14.51 km2/s without assuming any anomaly category, surpassing the strongest general baseline by 37% in F1. A specific adaptive immune stage applies negative selection to filter text prompts and matches surviving prompts with localized image patches through a multi-modal foundation model, enabling open-vocabulary recognition of unknown anomaly attributes including category, affected area, and damage severity, with recognition F1 exceeding 80%. A mutation mechanism tunes minimal embeddings at test time, adapting to each scene in 3.26s using a single reference image pair. We validate ESIA on a global-scale dataset covering 19,801.60 km2 across six anomaly categories, comparing against 22 models, and further apply it to quantify degraded farmland in the Dnipro Delta following the Kakhovka Dam collapse and assess burn severity from 2025 Palisades Fire in Los Angeles. This unprecedented flexibility in handling unknown anomalies opens new avenues for real-time disaster response and environmental surveillance.

[59] ERCPMP-Gx: Endoscopic Image and Video Dataset for Morphological, Histopathological, and Genomic Characterization of Colorectal Polyposis cs.CV | cs.AIPDF

Zahra Ghaffari, Massih Bahar, Mojgan Forootan, Ali Darvishi, Hamidreza Bolhasani

TL;DR: ERCPMP-Gx 发布患者层级的结直肠息肉病内镜图像与视频数据，并在可用时关联组织病理和胚系基因信息，支持综合识别遗传性息肉综合征。

Details

Motivation: 遗传性息肉综合征可能是结直肠癌前病变，也关联肠外肿瘤；早期识别和准确分类关系到诊断、个体化管理及家族监测。现有公开内镜数据多以单个散发息肉组织，缺少患者级表型与病理、遗传信息关联。

Result: ERCPMP-Gx 汇集内镜、组织病理和基因组数据，包含 160 张图像及相应视频片段，主要来自白光、窄带、放大窄带及近焦模式。约 80% 病例为临床或遗传确认的家族性腺瘤性息肉病、Peutz–Jeghers、幼年性息肉病和神经节瘤病等遗传综合征；其余约 20% 为非遗传息肉及形态相似病变，支持鉴别分类。每条记录在可用时关联标准化内镜标注、代表性病理和临床报告的胚系发现。

Insight: 面向遗传综合征的 AI 需要患者级多模态标注，不能把息肉逐个孤立处理；同时纳入形态相似的非遗传病变可支持临床鉴别诊断。

Abstract: Hereditary polyposis syndromes can be precursor lesions to colorectal cancer and are associated with a broad spectrum of extracolonic tumors. Early identification and accurate classification of these syndromes are essential for timely diagnosis, individualized patient management, and targeted surveillance strategies for affected families. However, public endoscopic datasets are largely organized around the individual sporadic polyp, and none links the polyposis phenotype to histopathology and germline findings at the patient level. Here, we present ERCPMP-Gx, an endoscopic, histopathological, and genomic dataset developed to support the application of artificial intelligence (AI) in the recognition, characterization, and classification of colorectal polyposis. Most procedures were performed using the Olympus EVIS X1 system with white-light endoscopy (WLE), narrow-band imaging (NBI), magnifying NBI (M-NBI), and NBI with near focus modes, yielding 160 images and accompanying video clips. Approximately eighty percent of cases represent clinically and/or genetically confirmed hereditary polyposis syndromes (PG), including familial adenomatous polyposis (FAP), Peutz-Jeghers syndrome (PJS), juvenile polyposis syndrome (JPS), and ganglioneuroma syndrome (GNS), while the remaining twenty percent comprise non-hereditary polyps and polyp-mimicking lesions with overlapping morphological features (Non-PG), included to support differential classification. Each released record is linked, where available, to standardized endoscopic annotations, representative histopathology, and clinically reported germline findings, forming an AI-ready, patient-level annotation framework. The dataset is publicly accessible at Mendeley (https://doi.org/10.17632/nzyfc544bx.2). For the latest updates and further information, readers are referred to the DataBioX website: https://databiox.com.

[60] Paint-Anything: Unified Any-Color Control for Image Generation and Editing cs.CV | cs.AI | cs.LGPDF

Ji Xie, Dewei Zhou, Xinyu Huang, Zhennan Chen, Xun Wang

TL;DR: Paint-Anything 训练统一的十六进制颜色提示接口，通过真实图像对象颜色标注与精确纯色锚点，支持图像生成和编辑的任意对象级颜色控制。

Details

Motivation: 专业设计需要对物体颜色指定任意 24 位十六进制值。已有颜色生成、编辑和上色方法常依赖专门颜色表示或复杂推理流程；小型语言模型已能理解十六进制值与颜色语义，为更通用接口提供基础。

Result: Paint-Anything 用对象级颜色监督学习生成与编辑共享的十六进制提示接口。数据管线从真实图像构建 Paint-500K，包括对象接地、感知颜色标注和编辑配对合成；为处理阴影导致的近似颜色标签，再加入像素与十六进制值完全一致的纯色锚点，只用于高噪声时间步，低噪声训练仍使用自然图像。作者构建 ACBench-T2I 和 ACBench-Edit 评测对象颜色保真度。基于 FLUX.2-4B，两个基准分数相对基座分别提升 85.3% 和 28.3%，平均 CompColor 得分也最高。

Insight: 用真实物体监督保持自然外观，再用纯色锚点校正精确色值，可兼顾颜色语义和数值准确性；单一十六进制提示格式同时覆盖生成和编辑。

Abstract: Professional design requires any-color control: the ability to specify an object’s target color with any 24-bit hex value for image generation and editing. Prior work has explored color generation, editing, and colorization, but often relies on dedicated color representations or specialized inference procedures. Advances in large language models offer a simpler starting point: even compact models can associate hex values with color semantics. We present Paint-Anything, which learns a shared hex-prompt interface for generation and editing through object-level color supervision. We develop a data pipeline that constructs Paint-500K from real images through object grounding, perceptual color labeling, and editing-pair synthesis. Since shadows make real-image labels only approximate colors, we complement this supervision with pure-color anchors whose pixels exactly match their paired hex values. These anchors are used only at high-noise timesteps, leaving low-noise training to natural images. We further introduce Any Color Benchmark (ACBench), comprising ACBench-T2I and ACBench-Edit, to measure object-level hex color fidelity across both tasks. On FLUX.2-4B, Paint-Anything improves ACBench-T2I and ACBench-Edit scores by 85.3% and 28.3%, respectively, relative to the base model, with ablations supporting the training recipe. It also achieves the highest average CompColor score among the compared methods.

[61] SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos cs.CV | cs.GRPDF

Peiyu Liu, Dingxi Zhang, Federico Tombari, Marc Pollefeys, Christina Tsalicoglou

TL;DR: SplashSplat 用实拍同步多视角数据集和观测约束的流体高斯表示重建飞溅液体，依据可观测证据决定何处施加物理结构。

Details

Motivation: 液体飞溅持续时间短，液膜会撕裂成细丝和液滴，外观高度依赖视角且缺乏稳定可追踪纹理，因此真实飞溅重建比烟雾、合成液体或缓慢变形表面更困难；此前缺少同步多视角数据集。

Result: 作者发布 20 个真实场景基准，涵盖稳定流动到剧烈飞溅，由七台同步、标定的 4K 相机以 60 fps 拍摄，并提供人工细化的逐视角液体和容器掩码及固定划分。SplashSplat 从掩码融合逐帧液体有符号距离场，利用相邻帧距离场的 level-set 输运估计粗速度，再用随流运动、依据新观测校正且在覆盖丢失处重采样的拉格朗日载体解码局部高斯以可微渲染。在实拍和合成基准上优于先进动态高斯泼溅方法，运动更符合物理直觉且训练成本更低；同一表示还支持无需重优化的时间插值和风格迁移。

Insight: 只在观测能约束的地方引入物理结构，可避免无依据的刚性假设；掩码几何、粗流场与可更新粒子共同应对短暂、拓扑变化大的液体飞溅。

Abstract: A splash lives for a fraction of a second: sheets tear into ligaments and droplets, appearance is view-dependent and nearly textureless, and little persists long enough to track. Reconstruction research has consequently focused on smoke, synthetic liquids, or gently deforming surfaces. To our knowledge, no synchronized multi-view dataset of splashing liquids exists. We therefore introduce a benchmark of 20 real scenes, from coherent streams to violent splashes, captured by seven synchronized, calibrated 4K cameras at 60 fps, with manually refined per-view liquid and container masks and fixed evaluation splits. We further present SplashSplat, built on a single principle: impose physical structure only where the observations can constrain it. Per-frame liquid SDFs fused from the masks provide the geometry, level-set transport between consecutive SDFs yields a coarse velocity field, and Lagrangian carriers advected along this flow, corrected against each new observation and reseeded where coverage is lost, decode local Gaussians for differentiable rendering. SplashSplat outperforms state-of-the-art dynamic Gaussian splatting methods on our real captures and on a synthetic benchmark, with physically more plausible motion and a lower training cost. The same representation supports temporal interpolation and style transfer without re-optimization.

[62] Can 4D Foundation Models Remember? cs.CVPDF

Guangzhao He, Hadar Averbuch-Elor, Wei-Chiu Ma

TL;DR: PersistBench 用全景 360° 视频作为全知参照，评估 4D 基础模型的物体恒常性、运动连续性和外观保持，发现物体离开视野后记忆显著退化。

Details

Motivation: 现有 4D 基础模型能感知和重建动态环境，但是否记得自己曾观察到什么仍未明确。既有基准多用像素指标，也缺少物体离开视野后的真值，无法以对象为中心评估视觉记忆。

Result: PersistBench 提供数据集和指标套件，利用 360° 视频作为全景真值，评测物体恒常性、运动连续性与外观保持。对多个类别和模型的评测显示，当前模型通常只能维持短期一致性；一旦物体离开视野，表现会明显下降。

Insight: 重建当前可见画面与记住曾经离开视野的对象是不同能力；全景视频可以提供对象离场后的参照，直接衡量 4D 模型是否具备持续的对象中心记忆。

Abstract: Perceiving and remembering the visual world is fundamental to navigating and interacting with our environment. Current 4D foundation models, such as camera-controllable video models or 4D reconstruction models, can perceive and reconstruct dynamic environments, but how well they remember what they have perceived remains an open question. Existing benchmarks largely rely on pixel-level metrics and lack ground truth for objects once they leave the field of view, making them unable to evaluate visual memory in an object-centric manner against references. To fill this gap, we introduce PersistBench, a dataset and metric suite that leverages 360° videos as omniscient ground truth and proposes three evaluation aspects: object permanence, motion continuity, and appearance preservation. Evaluating various models across diverse categories reveals that current models can only maintain short-term consistency that degrades significantly once objects leave the field of view. Our findings highlight the gap between current model capabilities and robust visual memory (“seeing is not remembering”), providing guidance for future development of 4D foundation models. Dataset and code are available on the project page: https://guangzhaohe.com/persistbench.

cs.CL [Back]

[63] Neo-Classic: A Benchmark for Evaluating Linguistic-Aesthetic Reasoning in Classical Chinese Poetry cs.CLPDF

Han Zhang, Zihan Gu, Zhiyuan Wang, Tianyi Ma, Jiacheng Lu

TL;DR: Neo-Classic 用当代专家创作的格律诗和逆向理解任务评测古诗词模型，发现模型从历史文本迁移到新作时表现大幅下降，尤其难以进行篇章级排序与规划。

Details

Motivation: 大语言模型在传统古诗词基准上准确率较高，但这可能来自熟悉预训练样式，而非可迁移的语言审美推理。需要能降低直接记忆检索可能性、并检查层级约束的评测。

Result: Neo-Classic 构建当代专家创作的严格格律样本外诗集，并设计五类行为探针测试层级约束满足。对 Qwen3-Max、Gemini-3-Pro 和 DeepSeek-V3.2 等模型评测后发现，从历史文本切换到当代文本时表现下降 20–50%；篇章排序任务准确率仅 0–13%。专家级引导能使增强推理模型提高到 36%，但仍明显落后于人类专家。

Insight: 模型可能掌握局部格律模式，却缺乏组织全篇结构所需的全局规划能力；评测新创作和逆向理解任务能揭示传统语料准确率掩盖的迁移差距。

Abstract: While Large Language Models (LLMs) achieve high accuracy on established Classical Chinese Poetry benchmarks, it remains challenging to distinguish transferable Linguistic-Aesthetic Reasoning from reliance on familiar pre-training patterns. To address this issue, we introduce Neo-Classic, an evaluation benchmark that combines a constructionist Out-of-Sample (OOS) dataset with a suite of reverse understanding probes. Unlike traditional benchmarks that rely on verification or generation over historical corpora, Neo-Classic comprises strictly metrical poetry authored by contemporary experts, reducing the possibility of direct retrieval. We evaluate state-of-the-art models, including Qwen3-Max, Gemini-3-Pro, and DeepSeek-V3.2, across five behavioral probes designed to test hierarchical constraint satisfaction. Our results reveal two primary limitations. First, a performance gap of 20 to 50 percent emerges when models transition from historical to contemporary texts. Second, models exhibit substantial difficulties in discourse-level ordering tasks, with standard accuracy remaining low (0 to 13 percent). Although expert-level guidance improves the performance of reasoning-enhanced models to 36 percent, a notable gap with human experts persists. These findings suggest that while current LLMs capture local formal patterns, they struggle with global hierarchical planning required for robust Linguistic-Aesthetic Reasoning.

[64] Modality Discrepancy Transformer for Ambivalence and Hesitancy Recognition cs.CL | cs.CVPDF

Shiyu Luo, Yu Wang, Jiawen Huang, Zhaoxiang Xiao, Chenxi Huang

TL;DR: MDT 用九类模态 token 显式编码临床视频中面部、声音和语言之间的差异，并结合文本条件调制与晚期融合识别矛盾和犹豫状态。

Details

Motivation: 矛盾与犹豫是面部、声音和语言通道呈现不一致信号的情感状态，而常规多模态融合会抑制这种跨模态冲突，难以从临床视频中识别。

Result: 模态差异 Transformer 将原六 token 设计扩展为九 token：三个模态嵌入、三个绝对差特征和三个通过线性投影学习的 Hadamard 乘积差异特征。九个 token 经 Transformer 自注意力处理，并使用 FiLM 文本条件调制和 LoRA 微调；推理时通过文本引导晚期融合，将文本辅助头与完整多模态输出结合。在第三届 ABAW 挑战 BAH 数据集上，标注测试集宏 F1 为 0.7408，私榜为 0.7368，比最强已发表基线高 10 个百分点以上，单 GPU 训练不到 20 分钟。

Insight: 对矛盾情绪而言，模态间不一致本身就是信号，应显式表征绝对差异和交互差异，而不是在融合时将其平均消除。

Abstract: Ambivalence and hesitancy (A/H) are affective states in which individuals express contradictory signals across facial, vocal, and linguistic channels. Automatically recognising A/H in clinical videos requires detecting cross-modal disagreement – the signal that standard fusion methods suppress. Based on the conflict-aware multimodal fusion framework of Bekhouche et al., we present the Modality Discrepancy Transformer (MDT). MDT enriches the original 6-token design to a 9-token representation comprising three modality embeddings, three absolute-difference features, and three Hadamard-product discrepancy features learned through linear projections. These nine tokens undergo Transformer self-attention, with FiLM-based text-conditioned modulation and LoRA fine-tuning as core architectural components. A text-guided late fusion branch blends a text-only auxiliary head with the full multimodal output at inference. On the BAH dataset from the 3rd ABAW Challenge, MDT achieves 0.7408 Macro F1 on the labelled test split and 0.7368 on the private leaderboard, outperforming the strongest published baseline by over 10 points while training in under 20 minutes on a single GPU.

[65] Reflective Recovery: A Self-Supervised Method for Reasoning by Learning from Mistakes cs.CLPDF

Qirui Chen, Renjie Pi, Jiahui Gao, Lingpeng Kong

TL;DR: Reflective Recovery 将失败推理轨迹中的错误前缀转成自监督恢复训练样例，提升模型从错误状态自我纠正的能力，并缓解只用正确轨迹训练的扩展瓶颈。

Details

Motivation: 依赖完美推理轨迹的模仿学习在问题集有限时会出现扩展坍缩，增加正例不再持续提高性能。推理时模型也无法保证中间步骤正确，一旦出错常会被累积错误进一步误导。

Result: 该方法截取失败轨迹的初始片段，将其与提示拼接后引导模型产生有效解答，把常含错误的前缀转化为恢复训练数据；无需外部评论器或奖励模型。在 DeepSeek-R1-Distill-Qwen-7B 上，AIME 2025 准确率从 30.0% 提升至 37.5%，Minerva 从 37.6% 提升至 47.8%。分析显示，该方法突破扩展坍缩现象，并诱发自我纠错行为。

Insight: 训练模型继续处理错误状态，比只模仿完整正确轨迹更贴近真实推理时的恢复需求；失败轨迹本身可成为过程监督信号。

Abstract: Data-driven fine-tuning is widely adopted to enhance reasoning in Large Language Models (LLMs) due to its simplicity and efficiency. However, mainstream imitation learning methods that rely exclusively on perfect reasoning trajectories suffer from a Scaling Collapse: when the problem set is limited, increasing positive examples fails to yield continuous improvement. However, during inference, an LLM can not guarantee that every intermediate step is correct and is therefore prone to errors. Once such errors arise, the LLM often struggles to recover and may be further misled by the accumulation of previous mistakes. To address this, we propose Reflective Recovery, a simple yet effective self-supervised approach that transforms failed reasoning attempts into recovery training data. Specifically, we extract initial segments of failed trajectories, concatenate them with prompts, and use them to guide the LLM toward valid solutions. Because these segments from failed trajectories are likely to contain errors, this process teaches models to recognize and correct mistakes during reasoning, enabling recovery from erroneous states without relying on external critics or reward models. Evaluated on extensive benchmarks, Reflective Recovery significantly improves performance. On DeepSeek-R1-Distill-Qwen-7B, it boosts accuracy from 30.0% to 37.5% on AIME 2025 and from 37.6% to 47.8% on Minerva. More importantly, analyses demonstrate that it breaks the scaling collapse barrier and enables models to develop emergent self-correction behaviors, representing a paradigm shift from outcome-oriented memorization to process-oriented reflective reasoning.

[66] VisKG-LM: Compiling Knowledge Graphs into Visual Memory for Multiple-Choice Question Answering cs.CL | cs.IR | cs.LGPDF

Yixin Peng, Er Jin, Shiwei Luo, Diego Collarana, Stefan Decker

TL;DR: VisKG-LM 将候选相关知识图谱路径离线编译为保留分支结构的图像缓存，待语言模型理解问题后再读取视觉记忆，减少重复在线图传播。

Details

Motivation: 知识图谱问答通常在线用图神经网络编码检索子图并与语言模型融合；同一静态图子结构会在候选打分、训练轮次和评估中反复重编码，产生不必要开销。

Result: VisKG-LM 将每个候选对应的检索子图序列化为带关系标签的路径，并渲染成保持路径分支结构的图像，离线编码一次后缓存。推理时语言模型先纯文本理解问题和候选，仅在最后一层读取缓存视觉记忆的全局布局和局部关系细节。在 CommonsenseQA、OpenBookQA 和 MedQA-USMLE 测试集上，相较 GreaseLM 分别提高 1.2、0.8、4.3 分；以约 400M 在线参数匹配或超过 7B GraphVis。相对接收相同路径文本的纯文本对照，分别提高 4.2、6.5、5.1 分。

Insight: 将静态图知识编译成可复用的视觉记忆，并延后到文本问题已理解后再读取，可以避免在线重复传播；与路径文本对照的收益说明图像布局接口提供了额外信息。

Abstract: Knowledge graphs are usually integrated into question answering by encoding a retrieved subgraph with a graph neural network and fusing it with the language model in the online inference path. The same subgraph is therefore re-encoded from scratch every time a pair is scored, across training epochs, seeds, and evaluation runs, even though the knowledge graph never changes. We ask whether the retrieved knowledge graphs can instead be compiled once, offline, and then accessed as read-only memory. VisKG-LM shows that it can, by decoupling graph encoding from language reasoning. It serializes each retrieved candidate-specific subgraph as Relation-Labeled Paths and renders the result as an image whose two-dimensional layout preserves the branching structure of the paths. Each image is encoded once, offline, and cached for reuse. At inference, the language model contextualizes the question and candidate from text alone, and only its final layer consults the cached visual memory, reading both its global layout and its local relational detail. The graph information thus enters only after the text has been understood. On the test sets of CommonsenseQA, OpenBookQA, and MedQA-USMLE, VisKG-LMimproves over GreaseLM by $1.2$, $0.8$, and $4.3$ points, respectively, while matching or surpassing GraphVis, a $7$B vision-language model, with only about $400$M online parameters. Against a matched text-only control that receives the identical Relation-Labeled Paths, it gains $4.2$, $6.5$, and $5.1$ points across the three benchmarks. These gains show that the complete visual-memory interface adds value beyond path textualization alone and support compiled visual memory as an alternative to online graph propagation.

[67] Advantage Scale Calibration Imbalance in Group-Relative Optimization under Low-Variance Rewards: Diagnosis and Bounded Recovery cs.CL | cs.LGPDF

Fei Ding

TL;DR: 论文把组相对优化中的低方差奖励区分为不可置信微扰与可信小差距，并提出过滤低于奖励分辨率的信号及有界恢复可信差距的 MaxNorm-AC。

Details

Motivation: 验证器强化学习中的组相对优化常把优势尺度视为实现细节。低方差时，极小噪声不应成为偏好信号，但可信而较小的奖励差异又应被学习，同时不能扭曲 KL 校准。

Result: 作者提出三向优势尺度校准接口，说明同一组内尺度分母会同时决定奖励分支强度、提示级批次权重，以及将奖励分支还原到原始基数尺度后形成的有效 KL 校准。由此解释 RLOO/Dr.GRPO 可能让可信小差距被 KL 压制，而 GRPO 标准差分母会无界放大小差距。进一步提出奖励分辨率协议以过滤低于分辨率的差异，并提出 MaxNorm-AC 对可信非零差距作有界基数恢复。在稠密和 MoE 架构、数学和代码推理实验中，MaxNorm-AC 优于最强稳健尺度基线，并截断低方差逆尺度长尾。

Insight: 关键不是把所有小优势一概归零或放大，而是区分不可分辨噪声与可信的基数差异，并把尺度对优化和 KL 的联合作用显式校准。

Abstract: In verifier-style RLVR, group-relative optimization often treats advantage scale as an implementation detail. This paper separates two low-variance cases: sub-resolution jitter that should not become a preference signal, and credible but small cardinal gaps that should be learned without distorting KL calibration. We propose an advantage-scale three-way calibration interface: the same within-group scale denominator simultaneously determines the reward-branch strength, prompt-level batch weight, and the effective KL calibration induced when the reward branch is re-expressed on the original cardinal scale. This interface explains why RLOO / Dr.GRPO can let credible small gaps become KL dominated, whereas GRPO’s standard-deviation denominator can amplify tiny gaps without bound. Based on this interface, we further introduce the Reward-Resolution Protocol and MaxNorm-AC, respectively filtering sub-resolution gaps and providing bounded cardinal recovery on credible nonzero gaps. Across dense / MoE architectures and math / code reasoning, MaxNorm-AC improves over the strongest robust-scale baseline while truncating the low-variance inverse-scale tail.

[68] To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives cs.CLPDF

Wenqi Zhou, Zhuorui Yu, Kaiao Wen, Hao Zheng, Xinyi Zheng

TL;DR: ReaLMem 用真实多年个人视觉档案和第一人称主观标注评估长期多模态记忆，从事实回忆扩展到人格推断和预测式个性化，并提出时间加权用户画像模块。

Details

Motivation: 个性化数字助理需追踪长期经历和变化中的偏好，而现有长期记忆基准多为合成、纯文本，缺少日常记忆中的视觉记录、真实因果关联的纵向数据，评估也停留在浅层事实回忆。

Result: 作者构建 ReaLMem，基于真实多年个人视觉档案并配第一人称主观标注，将评测分为事实回忆、人格推断和预测式个性化三个递进层级。ChronoProfiler 为用户属性计算时间稳定分数并将其作显著性先验，以处理随时间冲突的偏好，并组合复杂决策中同时生效的偏好。对前沿多模态大模型和记忆系统的评测发现，预测式个性化是持续的能力上限，模型与记忆系统之间存在明显差距；高质量且具时间信息的表征可显著改善个性化。

Insight: 长期记忆不只是存储事件，还要区分稳定属性和阶段性变化，并利用真实视觉档案推断未来个性化需求；预测个性化比事实检索更难，构成当前瓶颈。

Abstract: As AI systems evolve into personalized digital companions, a central capability is reasoning over a user’s long-term personal history: not merely storing past events, but tracking longitudinal experiences and evolving preferences. Progress here is bottlenecked by evaluation, existing long-term memory benchmarks are largely synthetic and text-only, they overlook the visual records that anchor everyday human memory, lack the authentic and causally connected longitudinal data that real personalization demands, and consequently remain confined to shallow factual recall. We introduce ReaLMem (Real-world Long-term Multimodal Memory), the first benchmark built from authentic multi-year personal visual archives, paired with first-person subjective annotations. ReaLMem evaluates models across three cognitive tiers of increasing difficulty: factual recall, persona inference, and predictive personalization. We further propose ChronoProfiler, a temporal-weighting profiling module that computes temporal stability scores for user attributes and applies them as a salience prior, resolving conflicts among temporally inconsistent preferences and helping models compound multiple co-active preferences in complex personalized decisions. Extensive evaluation of frontier multimodal large language models (MLLMs) and memory systems on ReaLMem reveals predictive personalization as a consistent ceiling, exposes clear performance gaps and bottlenecks between MLLMs and memory systems, and shows that high-quality, temporally informed representations substantially improve personalization. Together, ReaLMem and ChronoProfiler provide an authentic testbed and a simple, effective mechanism for long-term personalization, laying a foundation for future research on lifelong AI companions.

[69] Less Is More: Graph-free Multimodal RAG via Multi-signal Late Fusion cs.CLPDF

Tithi Rakshit, Hongkuan Zhou, Lavdim Halilaj, Yuqicheng Zhu

TL;DR: TrioRAG 无需构建语料级知识图，将问题、锚点图像和视觉语言模型增强问题分别检索，再通过晚期融合合并证据。

Details

Motivation: 图结构多模态 RAG 可支持跨文档问答，但构建语料级图谱成本高、查询慢且维护困难。对于包含噪声网页图片的问题，还需要检验图像检索与文本信号如何互补。

Result: TrioRAG 基于共享多向量索引独立检索三个信号：问题文本、锚点图像以及由图文共同生成的 VLM 增强问题，并用晚期融合组合结果。作者另构建 AutoQA 汽车多模态基准，问题依据噪声网页图片而非干净文档插图，需跨手册推理；作者明确将其定位为模型整理的测试集，而非人工验证的金标准。三个基准上，TrioRAG 与图 RAG 持平或更好，总成本更低、单次推理快 1.6–2.3 倍。AutoQA 中图像检索文档级召回率仅 19.3%，文本信号尤其 VLM 增强查询保持了检索稳健性。

Insight: 多模态检索不必先构造全局图结构，多个互补查询信号可在检索后融合；噪声网页图像检索召回低时，视觉语言模型增强的文本查询仍能提供稳定证据。

Abstract: Graph-based retrieval-augmented generation (RAG) is widely used for multimodal, cross-document question answering. However, building corpus-level graphs is expensive, slow to query, and difficult to maintain. We present TrioRAG, a graph-free multimodal framework that integrates evidence from three complementary signals: the question, the anchor image, and a VLM-enhanced query generated from both. Each signal retrieves independently over a shared multi-vector index of page text and page images, and the results are combined through late fusion. Further, we introduce AutoQA, a multimodal automotive benchmark whose questions are grounded in noisy, web-sourced images rather than clean document-sourced figures. Its questions require reasoning across manuals. We position it as a model-curated testbed rather than a human-validated gold standard. Across three benchmarks, TrioRAG matches or outperforms graph-based systems while reducing total cost and accelerating per-query inference by 1.6-2.3 times. By construction, AutoQA grounds its questions in out-of-corpus web images. In this setting image retrieval reaches only 19.3% document-level recall, while text-derived signals, especially the VLM-enhanced query, keep retrieval robust.

[70] CliniCIRCA: A Modular LLM Framework for Constructing Longitudinal Mental Health Patient Journeys from Raw EHR Narratives cs.CL | cs.AI | cs.IR | cs.LGPDF

Aiwei Ivy Zhang, Nimra Ishfaq, Mohit Chandra, Santiago Alvarez Lesmes, Adam Coscia

TL;DR: CliniCIRCA 从无事件时间戳的精神科出院叙述中恢复临床事件时间线，经临床人员纠错形成金标准，再以时间锚定摘要构建银标准训练集。

Details

Motivation: 精神健康患者的生物、心理和社会经历分散在非结构化叙述中，临床医生需要理解纵向变化，但缺少事件级时间戳使时间顺序恢复困难。

Result: CliniCIRCA 是多阶段 LLM 框架，按日历锚定且显式处理时间不精确性。作者从 MIMIC-III 的 14,882 例精神科住院记录中建立 52 篇出院摘要基准，系统生成 15,891 条带时间标签事件；经临床人员在环审查纠正 629 处错误，得到验证金标准。基于校正时间线的时间定位摘要将每篇来源压缩至原长度的约 1/1.52，并扩展生成 1,000 条银标准时间线作为训练数据。与零样本和少样本提示相比，指令微调总体改善五个开源模型的事件抽取、时间标注和摘要表现。

Insight: 无时间戳的临床叙述仍可通过多阶段时间恢复和临床纠错转为纵向记录；人工验证的小规模金标准可支撑更大规模银标准数据及下游模型适配。

Abstract: In mental health care, reasoning over patient journeys is a key task for clinicians. Yet these journeys, encompassing a longitudinal progression of biological, psychological, and social events, are often spread across disparate unstructured text narratives, making temporal recovery challenging. We present CliniCIRCA, a multi-stage LLM framework for Calendar-anchored, Imprecision-aware Reconstruction of Clinical Annals. To our knowledge, CliniCIRCA is the first to temporally classify clinical events across unstructured discharge summaries without event-level timestamps. From 14,882 MIMIC-III mental health admissions, we first construct a benchmark of 52 discharge summaries on which CliniCIRCA produces 15,891 temporally tagged events. After correcting 629 errors based on a clinician-in-the-loop evaluation, we produce verified gold-standard labels. Finally, the corrected timelines drive a temporally grounded summarization stage that compresses each source 1.52 times into a date-grouped chronological record. We then scale the framework to generate 1,000 silver-standard timelines and evaluate them as training data. Compared with zero- and few-shot prompting, instruction tuning generally improves five open-weight models on event extraction, temporal tagging, and summarization across silver and clinician-verified evaluations.

[71] Chain-of-Thought Entropy as a Reliability Signal: A Preregistered Reproduction cs.CL | cs.LGPDF

Theodore O. Cochran

TL;DR: 这项预注册复现支持思维链熵轨迹形状与答案正确性相关，但总熵下降幅度的关系依设置而异，并发现末步熵在多个模型任务组合中更有判别力。

Details

Motivation: 此前研究报告思维链熵轨迹的形状能预测答案正确性，而总熵下降幅度不能；其中幅度结论仅基于单模型、单随机种子的 300 题实验，形状结论则覆盖更完整基准，值得独立复现。

Result: 作者在确认性运行前于 OSF 注册方案，使用四个开源模型（含此前未测的推理蒸馏模型）完整评测 GSM8K 和 MATH-500。轨迹形状信号得到复现；幅度信号随设置变化。在锚定模型上，单调与非单调轨迹的准确率差分别为 GSM8K 9.6 点、MATH-500 27.5 点，而总熵下降与正确性的秩相关分别为 -0.018 和 0.414。推理蒸馏模型的二值形状信号触发率约 1%，不足以估计预注册对比，但分级违规次数仍可预测。探索性分析中，末步熵在八个模型-基准组合的 ROC 面积均超过二值形状标记。

Insight: 熵轨迹形状的预测性比总熵下降幅度更稳定，但不同模型的信号可用性仍有差异；复现还提示末步熵可能是更简单有效的风险信号，需注意这是探索性比较。

Abstract: This empirical study is an independent reproduction of the dissociation Zhao reported in 2026. The shape of a large language model’s chain-of-thought entropy trajectory predicts whether the final answer is correct, while the magnitude of its total entropy drop does not. The dissociation merits reproduction because the magnitude half rests on a single 300-problem run with one model at one seed, while the shape half was reported at full scale on both benchmarks and on a second model family. Registered at OSF before any confirmatory run, the reproduction crosses the complete GSM8K and MATH-500 benchmark test sets with four open-weight models including one reasoning-distilled model of a kind the original did not test. The shape signal replicates. The magnitude signal divides by setting. On the anchor model the accuracy gap between monotone and non-monotone chains is +9.6 percentage points on GSM8K and +27.5 on MATH-500, while the rank correlation of the total entropy drop with correctness is -0.018 on GSM8K and +0.414 on MATH-500. On the reasoning-distilled model the binary form of the shape signal fires on about one chain in a hundred, too few to estimate the registered contrast, while the graded violation count remains predictive there. In an exploratory comparison the final-step entropy alone outperforms the binary shape flag in all eight model-by-benchmark cells by ROC area, and in six or seven by the risk-coverage area the original reports, depending on an integration range the original does not state. The study contributes a reproduction of the shape signal at full test-set scale under seven documented protocol differences, a map of the settings where the magnitude signal holds and fails, and measurements of four protocol dependencies the original does not report.

[72] Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection cs.CLPDF

Bo Xu, Chenyuan Wang, Xinyu Chen, Quanhao Zhu, Rui Lin

TL;DR: ProKDA 先学习梗图相关背景知识，再训练有害性检测和边界对齐，按阶段优化单一目标以减少解释与判别任务间的干扰。

Details

Motivation: 多模态大语言模型被用于有害梗图检测和解释，但“先解释再判别”常在同一训练过程中耦合两种目标，引发任务干扰，检测表现受限，甚至不如简单监督微调。

Result: ProKDA 模仿人工标注者的学习过程，先用智能体流程构建梗图理解所需外部背景知识，再分三阶段依次训练背景知识学习、有害性检测和有害性边界对齐。不同于联合优化解释与分类的方案，每阶段仅聚焦一个训练目标，让背景知识逐步转化为稳健检测决策。在三个公开有害梗图基准上，该方法取得先进检测表现，并提供准确、可解释且有证据支持的审核判断。

Insight: 解释和分类目标同时训练可能彼此竞争；先建立背景知识，再学标签判定和边界，可将解释需要的信息逐步变成更可靠的检测能力。

Abstract: Hateful memes spread abusive content through implicit interactions between images and text, posing serious threats to the safety of online communities. In recent years, multimodal large language models have been widely used for hateful meme detection and are increasingly adopted to generate explainable detection results. However, we find that existing explain-then-detect methods often couple explanation generation and label prediction within the same training process. This coupling causes interference between task objectives, leading to limited detection performance and even worse results than simple SFT baselines. To address these challenges, we propose ProKDA, a progressive knowledge-to-decision alignment method for explainable hateful meme detection. Inspired by the human annotation training process, ProKDA first uses an agentic background knowledge construction pipeline to obtain external knowledge related to meme understanding. It then adopts a three-stage training strategy that sequentially performs background knowledge learning, hatefulness detection learning, and hatefulness boundary alignment. Unlike prior explain-then-detect methods that jointly optimize both tasks, ProKDA focuses on a single training objective at each stage. This design reduces interference between the two tasks and progressively transforms background knowledge into robust detection decisions. Experiments on three public hateful meme benchmarks show that ProKDA achieves state-of-the-art detection performance and provides accurate, explainable, and evidence-supported decisions for hateful meme moderation. Project page: https://meizhiyuan88666.github.io/prokda.

[73] PetriBench: Benchmarking LLM Reasoning over Dynamic State Spaces cs.CL | cs.AI | cs.LOPDF

Pyrros Koussios, Benjamin Jäger, John Hua Yao, Ajay Sridhar, Violet Xiang

TL;DR: PetriBench 用可扩展 Petri 网状态空间评测大语言模型推理，设置四类时域与范围不同的任务及精确答案，并分析难度、测试时计算与结构复杂度的影响。

Details

Motivation: 现有大语言模型推理基准常只测单一能力、依赖外部知识或扩展成本高，难系统描述模型在动态状态转换与并发系统中的推理能力。

Result: PetriBench 采用用于并发和分布式系统建模的 Petri 网，构建自包含、可扩展的动态状态空间基准。四类任务覆盖不同范围与时间跨度，难度分为 Easy、Medium、Hard，并通过增加结构复杂度程序化生成且用精确真值评估。多种专有与开源模型的准确率随难度增加而一致下降；困难实例暴露更明显的任务专项能力差异。测试时计算能提升表现，但对不同推理任务的作用不同；程序化生成使结构复杂度与任务难度平滑扩展。

Insight: 显式状态转换和精确可验证真值提供了无需外部知识的推理评测场景，既可比较能力，也可分析测试时计算在不同任务类型中的收益差别。

Abstract: Characterizing LLM reasoning remains an open challenge, as many existing benchmarks isolate specific reasoning skills, rely on external knowledge, or are costly to extend. We introduce PetriBench, a compact, fully self-contained, and scalable benchmark for evaluating LLM reasoning over dynamic state spaces using Petri nets, a mature formalism for modeling real-world concurrent and distributed systems. PetriBench organizes reasoning into four task families varying by scope and temporal horizon, with Easy, Medium, and Hard levels generated by increasing structural complexity and evaluated against exact ground truth. Across a diverse set of proprietary and open-weight models, accuracy decreases consistently with difficulty, while harder instances expose increasingly distinct task-specific capability profiles. Additional analyses show that test-time compute improves performance but interacts differently with different reasoning tasks, and that procedural generation yields smooth scaling with structural complexity. Together, these results show that PetriBench provides a unified and extensible setting for probing the strengths, limits, and scaling behavior of LLM reasoning.

[74] Before the Arrest: Benchmarking LLMs on Criminal Profiling from Incomplete Evidence cs.CL | cs.CYPDF

Yutong Yao, Yanjie Cao, Guanhua Chen, Xu Yang, Junchao Wu

TL;DR: PIJ 基准包含五国 2,500 起真实凶杀案件，评测大语言模型从不完整证据进行犯罪画像、过程重建和量刑预测，发现隐式推理差距与人口属性归因偏差。

Details

Motivation: 法律和刑事司法中的大语言模型研究多针对逮捕后身份已知的情形，对逮捕前根据不完整现场证据推断嫌疑人特征这一关键任务关注不足。

Result: PIJ 涵盖五个国家的 2,500 起真实凶杀案件，设三项贯穿调查流程的任务：基于零散现场证据进行溯因推断的犯罪画像、结构化信息抽取式的犯罪过程重建，以及法律演绎式量刑预测。九种大语言模型评测显示，从显式事实抽取转向对未知嫌疑人画像的隐式推理时，表现系统性下降；动机和受害者-犯罪者关系等类别是主要瓶颈。分析还发现模型与人类专家之间差距明显，并存在性别、年龄和动机归因偏差。

Insight: 刑事推断任务中的不完整证据会放大模型的推理短板和人口属性偏见；当前模型结果不能替代专家判断，基准强调了逮捕前画像这一高风险能力缺口。

Abstract: Large Language Models (LLMs) are increasingly applied to legal and criminal justice tasks, yet existing work focuses almost exclusively on post-arrest scenarios where the suspect’s identity is already known, leaving the critical pre-arrest challenge of inferring suspect characteristics from incomplete evidence largely unexplored. To fill this gap, we introduce the Profiling, Investigation, and Judgment (PIJ), comprising 2,500 real homicide cases from five countries. PIJ evaluates LLMs across three tasks that span the entire criminal investigation pipeline: criminal profiling, which requires abductive reasoning to infer suspect attributes from fragmentary scene evidence, crime process reconstruction, which tests structured information extraction, and sentence prediction, which demands legal deductive reasoning. We evaluate 9 powerful LLMs and find that performance degrades systematically as tasks shift from explicit fact extraction to implicit reasoning over unknown suspect profiles. Categories requiring inferential reasoning, such as motivation and victim-offender relationships, remain the primary bottlenecks. Further analysis reveals substantial gaps between LLMs and human experts, along with pervasive biases in gender, age, and motive attribution. Our findings indicate that pre-arrest inference from incomplete evidence remains an open challenge.

[75] DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression cs.CLPDF

DeepSeek-AI, :, Anyi Xu, B. Li, Bangcai Lin

TL;DR: DeepSeek-V4.1-Flash 通过因果编码器-解码器架构、跨层 KV 复用、FP4 缓存和有界回放降低多模态长上下文智能体的缓存占用与推理成本。

Details

Motivation: 长时域智能体使模型负载越来越偏输入侧，长上下文预填充仍昂贵；庞大 KV 缓存还会挤占 HBM/SSD 容量并增加数据传输带宽需求，成为继续降低部署成本的瓶颈。

Result: 论文介绍 552B 总参数、最长支持百万 token 上下文的多模态 MoE 模型。因果编码器-解码器架构在解码时每 token 激活 16B 参数、预填充时激活 8B。压缩稀疏注意力 CSA2 的跨层 KV 复用与 FP4 缓存将常驻 HBM 的全局 KV 降至每 token 890 字节，约为 DeepSeek-V4-Flash 的四分之一；SWA Bounded Replay 将常驻 SSD 或主机内存的缓存压至约八分之一。尽管缓存大幅缩小，作者报告其性能明显优于基线，并在 45T 多模态 token 上预训练、经完整后训练后，在多类文本及多模态智能体场景取得强表现。

Insight: 该系统针对智能体输入密集型负载分别压缩预填充计算、HBM 全局缓存和持久缓存，强调架构与部署策略协同降低长上下文成本；性能比较以论文报告为准。

Abstract: The widespread adoption of long-horizon agents has made model workloads increasingly input-heavy. Although prior work has substantially reduced the cost of long-context computation, prefill remains computationally expensive, and large KV caches continue to strain HBM and SSD capacity and data-transfer bandwidth. Together, these compute, storage, and bandwidth demands constitute the primary bottleneck to further lowering deployment costs. To address this challenge, we introduce DeepSeek-V4.1-Flash, a multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens. With its Causal Encoder-Decoder (CED) architecture, the model activates 16B parameters per token during decode but only 8B parameters during prefill, substantially improving cost efficiency for agentic workloads. To push the limits of KV cache compression, DeepSeek-V4.1-Flash combines cross-layer KV cache reuse in Compressed Sparse Attention 2 (CSA2) with FP4 KV caching. These designs reduce its global KV cache footprint (always in HBM) to 890 bytes per token, roughly 1/4 of the corresponding footprint of DeepSeek-V4-Flash. Further, through a dedicated deployment optimization known as SWA Bounded Replay, DeepSeek-V4.1-Flash reduces its persistent KV cache footprint (always on SSD or in host memory) to roughly 1/8 of that of DeepSeek-V4-Flash. Despite its much smaller KV cache footprint, the model delivers substantially better performance than the baseline. In addition, we streamline the DeepSeek-V4 architecture and introduce several efficient architectural extensions. We pretrain DeepSeek-V4.1-Flash on a multimodal corpus comprising 45T tokens and conduct comprehensive post-training, yielding strong performance across diverse text-based and multimodal agentic scenarios. Model checkpoints are available at https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash.

[76] The Public Discourse Corpus (PDC): A Speaker-Attributed Dataset for Valence and Epistemic Modality with Target Speaker Participation cs.CLPDF

Bo Chen

TL;DR: PDC 是首个对公众人物访谈语音同时标注情感效价与认知情态的数据集，含 100 位说话者的 998 段视频，并提出目标说话者参与度标注体系。

Details

Motivation: 访谈语料需确保分析的是目标人物本人发言，而非主持人或第三方；同时研究者需要把情感效价和说话者对信息的认知立场联合起来研究，但既有公开语料缺少这类标注。

Result: PDC 涵盖七个职业领域、100 位说话者和 998 段视频，经句子切分及筛选后包含 186,642 句、约 310 万词。作者提出五类目标说话者参与度 TSP 标注体系，标注一致性 κ=0.616；使用以音频为先的流水线，结合本地 Whisper 语音识别和 pyannote 说话人分离，将目标人物轮次与采访者、第三方分开。语料、工具、跨提供方验证样本及处理流水线均公开。

Insight: 语料构建不只需标注语言现象，也要记录目标说话者是否实际参与相关发言；TSP 可作为其他访谈数据集的通用质量控制方法。

Abstract: We introduce the \textbf{Public Discourse Corpus (PDC)}, the first dataset of public-figure interview speech jointly annotated for affective valence and epistemic modality. The corpus contains 998 videos from 100 speakers across seven professional domains, yielding 186,642 sentences (3.1 million words) after sentence segmentation and filtering. To ensure that all retained videos contain analyzable speech from the intended speaker, we introduce \textbf{Target Speaker Participation (TSP)}—a five-category annotation taxonomy with documented inter-annotator reliability ($κ= 0.616$)—as a key methodological contribution that any corpus construction project can adopt. Target-speaker turns are separated from interviewer and third-party speech through an \textbf{audio-first diarization pipeline} combining local Whisper ASR with pyannote speaker separation, released as an open-source implementation. We release the annotated corpus, the annotation tools, the cross-provider validation sample, and the complete processing pipeline. The dataset is available at https://huggingface.co/datasets/ictchenbo/public-discourse-corpus.

[77] Lens: Bringing the Right Semantic Perspective into Focus for Training-Free Multimodal Representation Learning cs.CL | cs.AIPDF

Xinran Liu, Shouqian Shi, Yixian Chen, Ruizhi Chen, Xin-Wei Yao

TL;DR: Lens 是免训练多模态表征框架，用任务专属短语锚定表示所需的语义视角，再读取该短语的上下文化状态，改善下游任务嵌入。

Details

Motivation: 专用嵌入模型的数据规模和多样性可能小于大语言及多模态模型的大规模预训练语料。后者擅长按任务视角选证据和整合多模态信息，但已有免训练语义提取方法常未将表征对准下游任务所需视角，导致显著输入内容主导表示。

Result: Lens 提出语义视角锚定，为任务匹配一个专属读出短语，明确后续抽取位置应承担的解释角色；上下文化短语读出则把同一短语置于完整输入之后并聚合其 token 状态，兼顾完整上下文和任务视角。无需参数更新、架构修改或重排，在 36 个 MMEB 数据集的总体 Precision@1 达 63.9，比同骨干最接近的免训练嵌入基线高 10.2 点。

Insight: 表示质量不仅取决于编码了什么输入，也取决于读出时采用什么语义视角；在完整上下文后放置任务锚定短语，可引导模型形成任务条件化证据整合表示。

Abstract: High-quality representations are essential for a wide range of downstream tasks. Dedicated embedding models are explicitly optimized for representation learning, yet their training data are often more limited in scale and diversity than the massive corpora used to pretrain modern large language models and multimodal large language models. Large-scale pretraining and instruction following enable autoregressive models to select relevant evidence, integrate multimodal information, and infer semantics under different task perspectives, creating a distinctive opportunity for training-free representation learning. However, our analysis reveals that existing semantic-elicitation methods do not reliably orient the extracted states toward the semantic perspective required by the downstream task. Consequently, the resulting representations often remain dominated by salient input content. We characterize this problem as semantic perspective misalignment and propose Lens, a training-free framework that makes representation readout task-directed. Semantic Perspective Anchoring associates the task-required perspective with a task-specific readout phrase, specifying the interpretive role of the positions later used for extraction. Contextualized Phrase Readout places the same phrase after the complete input and aggregates its token states, combining full-context access with the anchored perspective. The resulting representation reflects task-conditioned evidence integration and inference rather than a generic summary of salient content. Without parameter updates, architectural modification, or reranking, Lens achieves an overall Precision@1 of 63.9 across all 36 MMEB datasets, outperforming the closest same-backbone training-free embedding baseline by 10.2 points.

[78] Schema-Anchored Latent Reasoning for Semantic Parsing-Based Knowledge Base Question Answering cs.CLPDF

Guangze Gao, Zixuan Li, Sikui Zhang, Chunfeng Yuan, Wenjuan Li

TL;DR: SALR 以连续隐式推理延迟对知识库 schema 元素的离散选择，并通过 schema 代码反馈引导复杂逻辑形式构造。

Details

Motivation: 基于语义解析的知识库问答需从异构大型知识库中选出与问题相关的关系和类别并组合成可执行逻辑形式。大语言模型若在中间推理过早离散承诺 schema，错误选择会层层传递并造成最终逻辑形式错误。

Result: SALR 在隐藏状态中生成多步连续思维，以延迟显式逻辑形式决策；同时用由金标准逻辑形式确定性生成的 schema 轨迹监督，将连续思维对齐到知识库 schema 代码本。每步推理后把已对齐 schema 代码作为反馈输入后续步骤，不要求模型输出文本推理轨迹。在 GrailQA 和 WebQSP 上总体优于强基线；GrailQA 组合式问题上比强语义解析基线 TIARA 高 2.86 F1。分析显示 schema 反馈影响逻辑形式生成，schema 信息可从潜在状态恢复。

Insight: 将 schema 作为隐藏推理的连续对齐对象，可避免模型太早输出离散关系选择；随后以 schema 中介反馈逐步引导逻辑形式生成。

Abstract: Semantic parsing (SP)-based knowledge base question answering aims to answer natural language questions by generating executable logical forms (LFs) over knowledge bases (KBs). When applying Large Language Models (LLMs) to this task, a key challenge over large, heterogeneous KBs is selecting question-related schema elements (i.e., relations and classes) and composing them into complex LFs. Recent LLM-based methods often make early discrete commitments to schema elements during intermediate reasoning, allowing incorrect intermediate schema decisions to propagate and finally result in incorrect LFs. To overcome this limitation, we propose SALR, a schema-anchored latent reasoning method for LF construction. It performs multi-step reasoning by generating continuous thoughts in the model’s hidden states, thereby delaying the explicit commitment to LF decisions. To ground this latent reasoning process in the corresponding KB schema, SALR aligns continuous thoughts with a codebook of KB schema elements through an alignment objective supervised by schema traces deterministically derived from gold LFs. It then incorporates the aligned schema codes into inputs for subsequent reasoning steps. This schema-mediated feedback guides LF generation without requiring the model to emit an explicit textual reasoning trajectory. Experiments on GrailQA and WebQSP show that SALR achieves consistent overall gains over strong baselines. Notably, on compositional questions from GrailQA, SALR outperforms TIARA, a strong SP-based baseline, by 2.86 F1 points. Further analyses show that schema-mediated feedback affects LF generation and that schema information is recoverable from the latent states.

[79] What Does Privileged Information Add to On-Policy Self-Distillation? cs.CLPDF

XiuYu Zhang, Wei Chow, Junfeng Fang, Zhenkai Liang, Tat-Seng Chua

TL;DR: AMPLE-Math 在同答案的不同推理视图间比较在策略自蒸馏，发现自蒸馏本身解释了大部分收益，而特权参考的额外价值有限且依赖学生模型和 rollout 形式。

Details

Motivation: 在策略自蒸馏让语言模型从看到答案或解答的自身冻结副本学习，但额外参考究竟贡献多少、是否只是蒸馏本身所致并不清楚；不同推理长度和模式也可能改变收益。

Result: 作者构建 AMPLE-Math，含 5,319 道数学题和六种答案相同的推理视图，并与匹配的无参考蒸馏比较。启用思考的教师监督直接回答 rollout 时，无参考蒸馏已解释 Qwen3-1.7B 在思考评测中域内外的大部分提升；额外参考证据较弱，Qwen 上精炼解答效果最大，SmolLM3-3B 在第 50 步完整轨迹带来 2 个百分点。效果依赖训练学生：同检查点把短直接回答 rollout 改为长思考 rollout，在两模型家族上都从增益转为损失。教师画像和损失干预还显示，改变 token 级监督可能几乎不改变学生行为。

Insight: 特权参考的价值主要在于促进直接回答与思考模式之间已有能力的迁移，而不只是向学生揭示更多解题步骤；其效果取决于学生和 rollout 模式，不能视为普遍收益。

Abstract: On-policy self-distillation (OPSD) lets a language model learn from a frozen copy of itself that sees an answer or a worked solution. Giving the teacher this extra information seems to offer the student more to learn, but how much does it add beyond distillation itself? To isolate that contribution, we construct AMPLE-Math, a reusable suite of 5,319 mathematical problems with six reasoning views that share the same answer, and compare each view with matched reference-free distillation. With a thinking-enabled teacher supervising direct-response rollouts, reference-free distillation accounts for much of Qwen3-1.7B’s improvement under thinking-enabled evaluation, both in domain and on external benchmarks. Evidence for an additional reference benefit is modest in Qwen, strongest for a polished solution, whereas complete traces add two percentage points in SmolLM3-3B at step 50. These benefits depend on the student being trained. At the same checkpoint, replacing short direct-response rollouts with long thinking-enabled rollouts turns gains into losses in both families while the problems, references, and evaluation stay fixed. Teacher profiles and matched loss interventions in Qwen further show that changing token-level supervision can leave student behavior largely unchanged. Together, these findings suggest that OPSD can improve access to existing reasoning capabilities through parameters shared by direct-response and thinking-enabled inference. The value of a privileged reference is what it adds to this cross-mode transfer, not how much of the solution it reveals.

[80] UniPolicy: Unified Objective-Specific Policies for Generative Search Advertising cs.CLPDF

Kun Yao, Yuhang Zhou, Yichi Zhang, Zeliang Tong, Shengri Xue

TL;DR: UniPolicy 用目标专属前缀、稀疏 MoE-LoRA 路由和残差层解耦搜索广告的相关性、点击与商业价值目标，并在在线 A/B 测试中提升点击及收入。

Details

Motivation: 生成式搜索广告系统常只对齐 eCPM 等单一业务奖励，或简单融合多个奖励；这会忽视相关性和点击倾向等用户体验目标，并因梯度竞争导致总体性能次优。

Result: UniPolicy 在共享骨干内用目标专属前缀 token、稀疏 MoE-LoRA 路由及目标专属残差 FFN 分层解耦不同业务目标的参数和策略表达空间。它从多阶段行为反馈构建成对偏好，补充已曝光未点击样本的相对偏好信息，并强化点击候选在生成分布中的优势。推理时支持并行、可定制多策略 beam search，在固定召回预算下分配候选配额。大规模离线实验实现多指标均衡提升且保持召回质量；真实搜索广告系统七天在线 A/B 测试中 CTR 提高 0.71%、RPS 提高 1.58%、广告收入提高 1.32%，服务延迟稳定。

Insight: 对异质广告目标做层级参数解耦，比把多个业务奖励简单加权更能避免梯度冲突；在线结果显示可以在维持服务延迟的同时兼顾用户行为和商业指标。

Abstract: Search advertising connects user intent with commercial content and plays a critical role in platform monetization. Recent systems typically align pretrained generative models with a single business reward, such as eCPM, or use naive reward fusion for preliminary multi-objective alignment. However, an ideal search advertising system must jointly account for heterogeneous objectives, including relevance, click propensity, and commercial value, to balance user experience and business value while mitigating globally suboptimal performance caused by gradient competition. We propose UniPolicy, an objective-aware multi-policy alignment framework. UniPolicy combines objective-specific prefix tokens, sparse MoE-LoRA routing, and objective-specific residual FFNs to hierarchically decouple parameters within a shared backbone, providing differentiated parameter and policy-expression spaces for different business objectives. It further constructs pairwise preferences from multi-stage behavioral feedback, supplementing the relative preference information in exposed-but-unclicked samples and strengthening the relative advantage of clicked candidates in the generation distribution. At inference, UniPolicy supports parallel, business-customizable multi-policy beam search, flexibly allocating candidate quotas across objectives under a fixed retrieval budget. Large-scale offline experiments show that UniPolicy delivers balanced improvements across multiple metrics while preserving retrieval quality, outperforming single-objective reinforcement learning and naive reward-fusion baselines. In a 7-day online A/B test on a real search advertising system, UniPolicy improves CTR by 0.71%, RPS by 1.58%, and advertising revenue by 1.32%, while maintaining stable serving latency.

[81] HerHealthEval: Evaluating Multilingual and Register-Sensitive Understanding of Women’s Health Communication cs.CLPDF

Hassan Saeed Hassan Albattra, Mazen Mohammed Bahgat, Rahatara Ferdousi, Hana Essam Sayed Ahmed Amrya, Mariam Mousa

TL;DR: HerHealthEval 用英语、法语和现代标准阿拉伯语及六种表达语体评估女性健康沟通理解，发现总体准确率会掩盖语种相关的漏分诊风险。

Details

Motivation: 医疗场景中的模型评估多关注回答质量，却常假设模型已正确理解患者的担忧；同一健康问题换用口语、委婉、情绪化或信息不完整的表达时，理解和风险判断可能发生变化。

Result: HerHealthEval 为每个临床病例提供英、法、阿语匹配版本，并设置标准、临床、日常表达、间接/含蓄、情绪担忧和刻意信息不足六类语体；前五种保留相同临床信息，最后一种检验模型是否会请求澄清。框架评测担忧分类、风险校准、澄清行为、格式合规与跨语体一致性。结果显示，汇总准确率和一致性会掩盖安全失误：语言风险监督不对称时，多语适配模型在法语和阿语出现 0.994 漏分诊率；使用源自语料、跨语言不变的风险标签重新适配后，分别降至 0.572 和 0.558。

Insight: 多语医疗评测应把语体变化、不确定时澄清行为以及标签监督的来源和跨语种不变性纳入分析；仅报告整体准确率无法发现严重的语言特定漏诊风险。

Abstract: Large language models are increasingly used in healthcare communication, yet most evaluations emphasize response quality while assuming that the user’s concern has been interpreted correctly. We introduce HerHealthEval, a controlled evaluation framework for multilingual understanding of women’s-health communication. For each clinical case, HerHealthEval provides matched versions in English, French, and Modern Standard Arabic using six communicative forms: canonical, clinical, layperson, indirect or hedged, emotionally concerned, and deliberately under-specified. The first five express the same underlying concern and retain the same clinical information, whereas the under-specified form intentionally omits relevant details to test whether the model recognizes that clarification is needed. We evaluate a multilingual instruction model and QLoRA-adapted variants on concern classification, risk calibration, clarification behavior, parse compliance, and cross-form consistency. Results reveal that aggregate accuracy and consistency can conceal safety-relevant failures. A multilingual adaptation model reaches 0.994 under-triage in French and Arabic under language-asymmetric risk supervision. A controlled re-adaptation using source-derived, language-invariant risk labels reduces under-triage to 0.572 and 0.558, respectively. These findings show that robust multilingual healthcare evaluation requires explicit testing of register variation, uncertainty handling, and the provenance and invariance of adaptation labels.

[82] On-Demand Attention: Language Models Know When to Recall cs.CLPDF

Haibo Feng, Ruiqi Liang, Hanyang Peng, Shiqi Yu

TL;DR: ODA 用轻量召回头估计当前生成步骤调用全局历史注意力的收益，只在有价值时读取完整 KV 缓存，以减少长上下文推理中的全局读取。

Details

Motivation: 长上下文推理和智能体任务需要高效访问历史，但全注意力解码每一步都读取不断增长的全部上下文，无论这些历史是否有助于下一个 token。

Result: 作者发现预训练模型在全局读取前的解码状态已包含预测全局注意力收益的信息。按需注意力 ODA 采用局部优先解码，由轻量召回头判断何时选择性调用全局注意力；只训练召回头，不改动预训练权重，并保留完整历史 KV 缓存以备后续读取。作者在 vLLM 中实现 GPU 侧条件执行，将减少的全局读取转化为长上下文实际加速。Qwen、Gemma 及混合注意力骨干实验中，ODA 恢复了局部注意力大部分性能损失，同时明显减少全局读取。

Insight: 模型自身的局部状态可判断何时需要回看历史，因此保留完整缓存但按需访问，能够在信息可用性与读取成本之间取得折衷。

Abstract: Reasoning and agentic workloads increasingly demand efficient long-context inference. Yet full-attention decoding reads the growing history at every step, regardless of its benefit to the next prediction. We show that a pretrained model’s decoding states already contain information predictive of this benefit, before the global read. Building on this finding, we introduce On-Demand Attention (ODA), a local-first decoding method that uses a lightweight recall head to selectively invoke global attention as its predicted benefit changes during generation. ODA trains only the recall head, leaving pretrained weights unchanged and the complete historical KV cache available for future recall. We further implement GPU-side conditional execution in vLLM, translating reduced global reads into practical decoding speedups over full attention at long context lengths. Experiments across Qwen and Gemma models, including hybrid-attention backbones, show that selective recall recovers most of the performance lost under local attention while substantially reducing global reads. These findings support long-context inference in which pretrained models guide their own access to the information they retain.

[83] RetireOPD: Self-Retiring On-Policy Distillation for Agentic Reinforcement Learning cs.CL | cs.AIPDF

Yan Yu, Zhengxi Lu, Yizhou Liu, Yichen Pan, Aozhe Wang

TL;DR: RetireOPD 先用环境奖励训练具备专长的教师，再联合强化学习和自蒸馏训练无专长学生，并依据能力差距自动退出教师监督。

Details

Motivation: 多轮智能体强化学习每条轨迹只有单个标量奖励，因此在策略蒸馏用具备任务专长的自教师提供逐 token 稠密监督。但特权信息本身不能保证教师可靠，教师监督的收益也随训练阶段改变。

Result: RetireOPD 先用环境奖励训练与学生解耦、带技能条件的教师，再联合 RL 和 OPD 训练无技能学生。自适应退出机制不按预定时间表停止蒸馏，而是在师生差距停止缩小且学生达到教师目标成功率比例后，由学生自行放弃教师监督，之后仅用 RL 训练。在 1.5B–7B 的 Qwen2.5 模型上，ALFWorld 成功率较 RL 基线提高 14.1%–18.8%，WebShop 准确率提高 11.8%–19.0%，且所有设置均超过技能条件教师。

Insight: 教师监督应只在学生仍能从其获得收益时保留；让退出条件由师生行为差异和相对成功率触发，可避免固定蒸馏计划造成过度依赖。

Abstract: Multi-turn agents trained with reinforcement learning (RL) receive a single scalar reward per trajectory, which motivates self on-policy distillation (OPD) to supply dense token-level supervision from a self-teacher with privileged task skills, letting a skill-free student internalize them. This recipe, however, is undermined by two findings in agentic tasks: privileged information alone does not always make a teacher reliable, and the benefit of teacher supervision is stage-dependent. We therefore propose RetireOPD (Self-Retiring On-Policy Distillation), which first optimizes a decoupled, skill-conditioned teacher with environment rewards and then trains a skill-free student jointly with RL and OPD. Rather than following a predefined distillation schedule, RetireOPD adopts Adaptive Retirement: the student drops the teacher on its own once their discrepancy stops shrinking and it reaches a target fraction of the teacher’s success rate, after which training proceeds with RL alone. Across Qwen2.5 models from 1.5B to 7B, RetireOPD improves ALFWorld success rate over RL baseline by 14.1% to 18.8% and WebShop accuracy by 11.8% to 19.0%, and surpasses its own skill-conditioned teacher in every setting.

[84] JEPA-Anything: Learning Predictive Models across Different Worlds cs.CLPDF

Taoyong Cui, Zhongyao Wang, Xinyue Xu, Weiyang Liu, Zhaochen Yu

TL;DR: JEPA-Anything 以正交预测因子分解作为跨领域预测学习框架，在七类世界中改善动力学预测、分布外泛化和长时域预测，并报告生物实验支持的干预发现。

Details

Motivation: 现有世界模型往往针对视觉、临床、物理等单一领域，尚不清楚是否存在能在差异极大的系统间通用的学习原则，使模型预测未来并指导干预。

Result: JEPA-Anything 扩展联合嵌入预测架构，以正交预测因子分解把潜在目标拆为互补因素，通过专用路径学习后在共享预测设计中重组。评测覆盖视觉、生物、临床轨迹、控制、分子动力学、物理场和天气七个领域，包含十项匹配动力学任务、千余临床事件预测及四个系统的 100 步分子 rollout。相较匹配 JEPA 基线，十项动力学任务报告指标均改善；Interventional Pong 单次干预预测误差下降 34.8%；四个分子系统的一步和 100 步误差均为对比方法最低。作者还报告一个因子提名的生物干预获细胞共培养、患者来源类器官、肿瘤组织片和小鼠实验支持，并从潜在轨道模式恢复开普勒指数，拟合斜率 -1.4991。

Insight: 用可分离且互补的潜在因素预测世界变化，可能成为跨领域的共同建模原则；该工作还尝试把表征预测连接到可检验干预，而不只限于离线预测指标。

Abstract: World modeling enables intelligence to anticipate consequences, guide interventions, and learn from interaction. Yet predictive models remain domain-specific: can a common learning principle support world modeling across radically different systems? We introduce JEPA-Anything, a domain-agnostic framework based on orthogonal predictive factorization (OPF). Extending joint-embedding predictive architectures, OPF decomposes latent targets into complementary factors, learns them through dedicated pathways, and recombines them within a shared predictive design. We evaluate JEPA-Anything across seven domains: vision, biology, clinical trajectories, control, molecular dynamics, physical fields, and weather. Experiments span representation learning, intervention prediction, out-of-distribution generalization, and long-horizon dynamics, including 10 matched dynamics tasks, forecasting of over 1,000 clinical events, and 100-step molecular rollouts across four systems. Against matched JEPA baselines, JEPA-Anything improves reported metrics on all 10 dynamics tasks and reduces single-intervention prediction error on Interventional Pong by 34.8%. It achieves the lowest one-step and 100-step molecular errors among compared methods in all four systems. Beyond prediction, a factor-nominated biological intervention receives experimental support in cell co-cultures, patient-derived organoids, tumor fragments, and mice; latent orbital modes recover the Keplerian scaling exponent with a fitted slope of -1.4991. These results support a common factorized predictive principle across heterogeneous worlds, connecting world modeling with intervention and experimentally grounded scientific discovery. Code: https://github.com/Gen-Verse/JEPA-Anything

[85] Unifying Models of Intergroup Hostility in Online Discourse cs.CL | cs.SIPDF

Patrick Gerard, Julia Mendelsohn, Kristina Lerman

TL;DR: 研究在 2024 年美国大选期间的 286 万条社交媒体帖子中统一建模六种群际敌意理论，发现边界和威胁建构是核心机制，并呈现特定时间顺序。

Details

Motivation: 社会心理学、道德心理学和政治学提出的群际敌意理论多并行发展，对敌意如何产生的解释不一，且很少在真实话语中相互比较，造成对修辞机制的理解碎片化。

Result: 作者分析 TikTok、Truth Social 和 Twitter/X 在 2024 年美国总统大选期间的 286 万条帖子，在共同经验框架中建模六种理论机制：边界建构、威胁建构、替罪羊、负面评价、非人化和行动导向。结构上，边界和威胁建构构成系统锚点；时间上常见顺序为边界建构、贬损和行动导向较早出现，非人化与威胁建构较晚，替罪羊机制最晚。

Insight: 将多种理论放进同一真实语料框架，有助于比较其关系而不局限于单标签敌意检测；发现的先后模式为理解群际修辞如何升级提供了经验依据。

Abstract: Hostile rhetoric toward social groups can normalize exclusion and justify mistreatment, as well as contribute to rising polarization and political violence. Efforts to moderate hostile rhetoric in online speech draw on foundational theories in social and moral psychology, and political science. However, these theories were developed largely in parallel, often propose different and sometimes conflicting accounts of how hostility develops, and have rarely been tested against each other in real discourse. The result is a fragmented understanding of the rhetorical mechanisms of hostility, without a clear sense of how they appear, and relate to each other, in real-world discourse. Using 2.86 million posts from TikTok, Truth Social, and Twitter/X during the 2024 U.S. presidential election, we model the mechanisms of six foundational theories of intergroup hostility – boundary construction, threat construction, scapegoating, negative evaluation, dehumanization, and action orientation – within a common empirical framework to recover the broader organization of intergroup hostility rhetoric. Structurally, we find that boundary construction and threat construction anchor the system; temporally, we find that these mechanisms tend to follow a regular ordering: boundary construction, derogation, and action orientation tend to appear early; dehumanization and threat construction later; scapegoating latest. Mapping how these theoretical frameworks actually manifest in discourse bridges longstanding divisions across social science traditions and presents computational social science with a clearer empirical foundation for modeling intergroup hostility rhetoric beyond single-label detection.

cs.AI [Back]

[86] Geopolitical Divisions Across Languages in Large Language Models cs.AI | cs.CL | cs.CYPDF

Maxim Chupilkin

TL;DR: 研究用三种聊天模型针对 112 种语言评价乌克兰战争相关陈述，发现回答立场会随提问语言变化，并与各国现实政治倾向呈相关模式。

Details

Motivation: 越来越多人使用聊天机器人了解世界事件，但同一用户用不同语言询问时，模型是否给出相同政治判断尚不清楚；语言差异可能反映训练文本及信息传播中的偏向。

Result: 作者让 GPT、Claude 和 Gemini 以 112 种语言评价有关乌克兰战争的 20 条陈述，共收集 67,200 个回答。不同语言下亲俄与亲乌回答比例存在差异；按国家官方语言汇总后，倾向模式与公众对俄罗斯的好感、联合国投票中对乌克兰的支持及对乌援助程度相呼应。三种模型均出现这一总体模式，移除单独陈述配对后仍持续。

Insight: 提问语言可能是模型政治回答差异的系统性因素；研究提出训练数据可能受信息战影响并再传播地缘偏差的路径，但结果是关联性观察，不能单独证明具体因果机制。

Abstract: People increasingly turn to AI chatbots for news and explanations of world events. But do they receive the same political answers when they ask in different languages? Here we show that the language of a question can change how the same AI systems assess the war in Ukraine. We ask GPT, Claude and Gemini to evaluate twenty statements about the war in 112 languages, collecting 67,200 responses. The balance between Russia-leaning and Ukraine-leaning responses differs across languages. When we group responses by countries’ official languages, they follow a pattern resembling worldwide political divisions: relatively more Russia-leaning answers correspond to more favourable public views of Russia, less support for Ukraine in United Nations votes, and less aid to Ukraine. The broad pattern recurs across all three models and remains when individual statement pairs are removed. Our findings suggest a possible route through which information warfare may shape the text used to train AI models, which may in turn spread geopolitical biases.

[87] Language-model groups overstate consensus when replaying human deliberation on a reasoning task cs.AI | cs.CL | cs.CY | cs.MAPDF

Tengfei Shao

TL;DR: 研究把 100 个人类 Wason 讨论组与匹配的大模型智能体组重放比较，发现智能体组在不同参与和评分口径下都显著高估共识，且共识不代表正确。

Details

Motivation: 完全共识率常被视为群体认知指标，但结果会受参与规则和最终状态定义影响。若将大模型群体作为人类 deliberation 的模拟器，需判断其是否重现了真实人群的讨论结果分布。

Result: 作者用相同代码评分，重放 100 个留出人类 Wason 群体，并为每位参与者初始答案设置信念锚定智能体。人类共识估计随评分口径为 24.0%–57.0%，约五分之一参与者从未发言，而智能体几乎总会参与。提交口径及参与匹配两种事后敏感性分析中，智能体组共识仍高出 34.0–44.4 个百分点；两种校正结果相差不到 0.5 点。去掉早停和可记忆答案后，推理模式群体几乎一致同意错误答案。模拟共识不追踪群体准确率，信念锚定智能体也不能无偏估计人类群体结果。

Insight: 比较人类与模型群体时必须对发言参与和终态评分作显式对齐；高一致可能是集体错误，不足以代表集体认知或正确性。

Abstract: Full-consensus rates are often treated as indicators of collective cognition, yet depend on how participation and final states are operationalized. We replayed 100 held-out human Wason groups with matched large language model (LLM) agent groups, seeding one belief-anchored agent per participant’s pre-discussion answer and scoring agents and people with the same code. Across human scoring definitions, estimates ranged from 24.0% to 57.0%; about one fifth of participants never posted, whereas agents almost always did. Agent groups remained more consensual in two post-unblinding sensitivity analyses: the submit-based comparison (n = 98) yielded gaps of 34.0 and 43.9 percentage points for chat and reasoning modes, and the participation-matched comparison (n = 45) yielded gaps of 34.1 and 44.4 points. These complementary routes reduced different measurement asymmetries yet converged within 0.5 percentage points. The gap persisted without early stopping and under a reparameterization removing the memorizable answer; reasoning-mode groups then agreed nearly unanimously, mostly on incorrect answers. Simulated consensus did not track collective accuracy, and belief-anchored agent groups were biased estimators of the human group-outcome distribution in this setting. These analyses provide a scoring-explicit basis for assessing simulated-group estimates of human deliberative outcomes.

cs.AR [Back]

[88] CovR: Coverage-Aware Hardware Verification via Reasoning-Guided Reinforcement Learning cs.AR | cs.CLPDF

Manar Abdelatty, Maryam Nouh, Sherief Reda

TL;DR: CovR 用仿真和覆盖率反馈训练硬件验证测试平台生成智能体，把覆盖质量纳入奖励，在 Verilog、RTLLM 和 CVDP 基准上提高测试覆盖。

Details

Motivation: 硬件设计验证可能占总设计投入七成。现有大语言模型测试平台生成工作主要关注功能正确性，容易忽略覆盖率这一关键质量指标。

Result: CovR 将自反思循环与仿真反馈结合以生成覆盖导向测试平台，并用强教师构造 16,514 组自然语言规范、RTL 推理和测试平台样例，再通过工具产生的仿真及覆盖奖励强化学习学生模型。微调模型在 VerilogEval/RTLLM V2.0 的 cov@10 为 93.81%，在 CVDP 为 87.76%，分别超过先进方法 7.97 和 3.59 个百分点；嵌入智能体迭代后分别达到 94.27% 和 91.39%。作为完整验证流程的激励引擎时，覆盖提高 18.95%，突变检测分提高 1.19%，仍发现 4.46% 未检出故障。

Insight: 测试生成应同时奖励功能正确和覆盖质量；即便覆盖率显著提升，剩余未检故障仍说明单一指标不等同于完整验证。

Abstract: Design verification remains one of the most resource-intensive stages of hardware development, often consuming up to 70% of the total design effort. While recent work has explored using Large Language Models (LLMs) to automate testbench generation, most existing approaches focus narrowly on functional correctness, overlooking the critical aspect of coverage quality. To bridge this gap, we present CovR, an agentic framework for automated testbench generation that combines self-reflection loops with simulation-based feedback to maximize coverage. Using this pipeline, we construct a large-scale dataset of 16,514 natural specification RTL reasoning testbench tuples with a strong teacher model, enabling coverage-aware supervision. Building on this, we propose a reinforcement learning (RL) framework tailored for coverage-driven testbench generation, leveraging tool-derived rewards from simulation and coverage feedback to optimize a student model. Experimental results show that the CovR finetuned model achieves 93.81% cov@10 on VerilogEval and RTLLM V2.0, and 87.76% cov@10 on CVDP, outperforming state-of-the-art approaches by 7.97% and 3.59%, respectively. Furthermore, deploying the finetuned model back into the agentic refinement pipeline further improves cov@10 to 94.27% on VerilogEval and RTLLM V2.0 and 91.39% on CVDP. Moreover, when integrated as a plug-in stimulus engine for full verification workflows, CovR improves coverage by 18.95% and mutation detection score by 1.19%, while revealing 4.46% undetected failures, highlighting the importance of optimizing for coverage in LLM-based hardware verification.

[89] MiX: Micro-Inverted-Scaling for End-to-End Low-Bit Vision-Language Model Acceleration cs.AR | cs.CVPDF

Yuan Liao, Jae-sun Seo

TL;DR: MiX 提出反转传统共享指数微缩放的低比特格式，以每元素私有指数共享尾数，并提供 4.5 比特端到端 VLM 推理和定制硬件加速器。

Details

Motivation: 边缘 VLM 受内存带宽限制，需要低于 8 比特的端到端量化。多模态 token 动态范围差异很大，标准块格式中的单个离群值可能占据共享指数范围，使其他值下溢并破坏注意力图。

Result: Micro-Inverted-Scaling 不是多个尾数共享一个指数，而是将每元素私有指数组织在一个共享尾数下；为处理 VLM 不对称离群值，作者提出双格式 MiX-MX 推理框架。将共享尾数代数分解后，可映射到用移位器替代乘法器的定制加速器。在多个 VLM 端到端评测中，4.5 比特 MiX 在多模态基准上准确率与 NVFP4 相当或更高。相较 Focus 加速器，MiX 硬件面积效率提高 25%，不同模型获得 2.3–4.5 倍速度提升和 1.4–2.9 倍能耗下降。

Insight: 多模态动态范围不适合简单用块共享指数表示；反转指数和尾数的共享方式可缓解离群值导致的微缩放坍塌，并使低比特运算更适合边缘硬件。

Abstract: The deployment of Vision-Language Models (VLMs) on edge devices is severely bottlenecked by memory bandwidth, necessitating aggressive sub-8-bit quantization. Since edge accelerators are strictly constrained by area and power, they require end-to-end quantized models. However, the extreme dynamic range gap between multi-modal tokens causes standard block formats to suffer “microscaling collapse,” where a single massive outlier hijacks the shared exponent, underflowing surrounding elements and destroying attention maps. To break this bottleneck, we propose Micro-Inverted-Scaling (MiX), a novel format that mathematically inverts the microscaling paradigm: rather than grouping multiple mantissas under one shared exponent, MiX groups private, per-element exponents under a single shared mantissa. To handle asymmetric VLM outlier topologies, we introduce an adaptive dual-format (MiX-MX) inference framework. By algebraically factoring out the shared MiX mantissa, this framework maps to a custom accelerator, replacing multipliers with efficient shifters. Evaluated end-to-end on multiple VLMs, our 4.5-bit MiX formulation exhibits equivalent or superior accuracy on multi-modal benchmarks compared to NVFP4. Simultaneously, the MiX accelerator delivers a 25% improvement in area efficiency over the NVFP4 baseline and a 2.3-4.5x speedup with 1.4-2.9x energy reduction across models compared to the state-of-the-art accelerator Focus, proving the inverted-scaling datapath is physically superior for efficient VLM deployment.

cs.CR [Back]

[90] AUDITPLAN: Commit, Then Answer for Auditable Safety Alignment cs.CR | cs.AI | cs.CLPDF

Sai Sri Pushpa Jampani, Kshitij Mishra, Asif Ekbal

TL;DR: AUDITPLAN 让模型先生成结构化安全计划再作答，并只在计划正确时发放答案奖励，以强化内部计划与最终回答的可信约束关系。

Details

Motivation: 安全微调通常只评价最终回答，难区分稳健拒绝与两类不良捷径：对良性请求一概拒答，或给出听似合理却没有约束回答的安全理由。

Result: AUDITPLAN 使用单模型先输出包含威胁标签、意图动作和明确约束的简洁计划，再以该计划为条件生成回答；部署时计划可隐藏但供机器审计。训练先监督微调，再使用 FAITHGATE 门控奖励：仅当安全计划正确时才给予答案奖励，抑制表面安全但计划不忠实的行为。在 Qwen2.5-3B-Instruct 上，FAITHGATE 将攻击成功率由 24.0% 降至 11.6%，漏洞成功率由 1.0% 降至 0.36%，过度拒答由 11.0% 降至 2.0%，优于只训答案、自由解释和加权结构奖励。Qwen-3-4B 和 Qwen2.5-7B 的确认实验呈相同趋势。

Insight: 将可审计的内部承诺与回答奖励绑定，可同时约束有害回答和无差别拒答；评估不仅要看拒答稳健性，也需检查安全计划是否真正支配最终行为。

Abstract: Safety tuning pipelines judge only the final answer, which makes it difficult to distinguish robust refusal from two undesirable shortcuts: blanket refusal on benign requests and polished but unfaithful safety rationales that do not actually constrain the answer. We propose AUDITPLAN, a single-model plan-then-answer approach where the model first emits a compact structured safety plan and then answers conditioned on it. The plan records a threat label, intended action, and explicit constraints, enabling machine-checkable auditing while remaining hidden from users at deployment. We train this behavior with supervised fine-tuning followed by reinforcement learning with FAITHGATE, a reward-gating objective that grants answer reward only when the safety plan is correct. This discourages safe-looking but unfaithful behavior and promotes tighter plan-answer coupling. Across Qwen backbones, AUDITPLAN improves both robustness and auditability: on Qwen2.5-3B-Instruct, FAITHGATE reduces ASR from 24.0% to 11.6%, LSR from 1.0% to 0.36%, and over-refusal from 11.0% to 2.0%, outperforming answer-only RL, free-form explanation, and weighted-sum structured rewards. Similar trends hold for Qwen2.5-1.5B-Instruct. Larger-model confirmation runs on Qwen-3-4B-Instruct and Qwen2.5-7B-Instruct preserve the same trend suggesting that explicit internal commitments can make safety alignment more faithful, robust, and auditable.

cs.GR [Back]

[91] Printing the Underdetermined: Materializing Multi-solutionness in Figurative Paintings cs.GR | cs.CVPDF

Yutao Ming, Teng Xu, Youjia Wang, Yunyang Liu, Fengmin Yang

TL;DR: 该工作将具象绘画中单幅图像无法唯一确定的三维场景解释显式化，使用视频生成、多视角高斯泼溅重建和实体打印呈现多解性。

Details

Motivation: 传统绘画三维重建常假设单幅作品对应一个可恢复的场景，但画外背面、遮挡体积以及透视、阴影等线索都可能允许多个合理三维解释。

Result: 作者提出将多解性作为可见且可触的输出。流程从一幅绘画采样多个相机环绕多视角视频，用视频生成模型合成视角（因没有显式三维约束，帧级漂移是预期现象），再分别通过 3D Gaussian Splatting 重建成点状高斯场景；密度光晕和重影用于暴露未确定自由度，最后通过 DreamPrinting 将表示制成实体艺术品。

Insight: 对信息不足的图像，多个互不相同但均兼容的三维解释不应一律当作重建误差；把多解性本身做成可比较、讨论的数字或实体产物，可支持新的绘画空间解读。

Abstract: Figurative paintings are often approached as if they depict a single recoverable 3D scene: viewers infer depth and occlusion, and reconstruction pipelines attempt to converge to one stable model. We instead foreground multi-solutionness, the non-uniqueness of 3D configurations compatible with a single painted image, and propose a workflow that keeps this non-uniqueness visible and material. Multi-solutionness arises from two sources: unobserved content, where backsides and occluded volumes admit multiple plausible completions, and observed cues, where perspective, shading, and occlusion still underconstrain geometry. When additional views are synthesized by a video generative model without explicit 3D constraints, small frame-level drifts become inevitable rather than exceptional. Our pipeline samples multiple camera-orbit multi-view video sequences from one painting, reconstructs each sequence with 3D Gaussian Splatting into a point-based Gaussian scene representation where density halos and ghosting expose unresolved degrees of freedom, and fabricates these representations as physical artifacts using DreamPrinting. By treating multiple compatible interpretations as explicit outputs rather than residual error, we provide a computational framework for spatial readings of figurative painting that can be inspected, compared, and discussed in both digital and physical form.

cs.IR [Back]

[92] Think Thrice Before Reranking: Multi-perspective Evidence and Reasoning Integration for Text Reranking cs.IR | cs.CLPDF

Lijun Liu, Zhengzong Chen, Wenyan Li, Yuanyuan Zhao, Fei Huang

TL;DR: MERIT-Rank 让大语言模型从多个互补视角生成查询-文档相关性推理，再联合整合排序，并用渐进策略优化稳定推理轨迹。

Details

Motivation: 基于单条推理轨迹的重排方法容易受推理错误影响，也难同时表示文档相关性的多面证据。

Result: MERIT-Rank 构建多轨迹推理空间，从多个视角评估查询和文档相关性，再由联合重排器将不同轨迹汇总为统一排序决定。作者还提出渐进式排序策略优化 PRPO，通过分阶段优化目标稳定推理轨迹并持续提升排序质量。在推理密集和传统检索基准上，MERIT-Rank 持续优于有竞争力的基线；4B 模型在 BRIGHT 上超过大多数 7B 乃至 32B 重排模型。

Insight: 多个互补推理路径可以降低单一解释错误对最终排序的支配性；分阶段优化有助于让推理过程稳定服务于检索排序目标。

Abstract: Reasoning-based reranking with Large Language Models (LLMs) has shown promising improvements in text ranking. However, current methods predominantly rely on a single reasoning trajectory, resulting in rankings that are susceptible to reasoning errors and inherently constrained in modeling the multifaceted signals underlying document relevance. To resolve this dilemma, we propose MERIT-Rank(Multi-perspective Evidence and Reasoning Integration for Text Reranking), a framework that models complementary reasoning trajectories to improve reranking robustness. MERIT-Rank formulates a Multi-Trajectory Reasoning Space (MTRS) that evaluates query-document relevance from multiple perspectives and introduces a joint reranker that consolidates these reasoning paths into a unified ranking decision. We further develop Progressive Rank Policy Optimization (PRPO), a progressive training framework that stabilizes reasoning trajectories while continually improving ranking quality through staged optimization objectives. Experiments on both reasoning-intensive and traditional retrieval benchmarks show that MERIT-Rank consistently achieves superior performance over competitive baselines. The 4B model notably outperforms most 7B and even 32B rerankers on BRIGHT.

cs.LG [Back]

[93] Learn Your Own Thoughts: Abstract Token Curriculum cs.LG | cs.AI | cs.CL | stat.MLPDF

Khashayar Gatmiry, Avrajit Ghosh, Parsa Mirtaheri, Jason D. Lee, Nika Haghtalab

TL;DR: ATC 通过逐步增加问题分布的复杂度，促使模型在连续表示空间形成无需直接监督的抽象中间思维，并在图可达性和算术任务上验证。

Details

Motivation: 思维链方法依赖对思考 token 的显式监督，需要丰富且任务专属的数据。作者希望不设计人工草稿或直接监督思维 token，也能训练有效的连续中间表征。

Result: 抽象 token 课程 ATC 按一系列逐渐复杂的问题分布训练模型，使其在连续表示空间发展内部抽象“思维”。论文同时给出理论与实验依据：理论上，对单层 softmax 注意力学习奇偶函数时，ATC 会使注意力自然聚焦于上下文中最容易预测下一 token 的 CoT token；实验上，在图可达性与算术学习任务上验证了有效性，并报告相对既有连续思维训练方法的优势。

Insight: 训练课程可以通过由易到难的数据分布诱发模型自行形成中间表示，不必显式标注完整思维过程；当前实证任务仍集中于图可达性和算术学习。

Abstract: Large Language Models (LLMs) have achieved remarkable reasoning capabilities by utilizing chain-of-thought (CoT) as a scratchpad for intermediate stages of thinking. However, CoT techniques require explicit supervision on thinking tokens, which requires rich, task-specific data. In this work, we propose Abstract Token Curriculum (ATC), a novel curriculum learning framework that elicits effective continuous intermediate representations without direct supervision or manual scratchpad design. ATC gradually increases problem complexity through a sequence of distributions, training the model to develop internal abstract thoughts'' in the continuous representation space. This paper provides both theoretical and experimental evidence for the benefits of ATC and its advantages over previous methods for training continuous thoughts. Theoretically, we show that for learning parity functions with single-layer softmax attention using ATC, attention naturally focuses on the CoT tokens in the context that provide the easiest path’’ to predicting the next token. Experimentally, we show ATC’s effectiveness on graph reachability and arithmetic learning tasks.

[94] Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning cs.LG | cs.CLPDF

Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Yian Ma, Lianhui Qin

TL;DR: Uni-LaDiR 将不同模态教师推理步骤编码到共享潜在思维空间，并用扩散预测后续思维块，在视觉推理与机器人操作基准上取得相对提升。

Details

Motivation: 多模态推理需在整个思考过程中利用多种模态信息，但现有方法常把各模态专属思维 token 拼成同一序列，让模型自行处理表示差异。

Result: Uni-LaDiR 通过统一编码器把不同模态教师推理步骤映射为共享思维 token，并训练其保留后续推理、答案或动作所需信息。由于相同上下文可对应多个有效后续步骤，方法采用扩散模型根据输入和先前块预测下一思维 token 块；编码器与扩散推理器共享权重联合训练。推理时不再依赖教师观察。在 11 个视觉语言基准和两个视觉语言动作套件上，相对最强评估基线，视觉推理任务提升 7.3%，机器人操作提升 6.1%。

Insight: 把模态特定思维转入共同潜在空间，可减少序列拼接时的表示断层；扩散式块预测能够表达同一上下文下多种合理推理后续。

Abstract: Multimodal reasoning requires models to draw on information from multiple modalities throughout the reasoning process. Yet existing methods often concatenate modality-specific thought tokens in a single sequence, leaving the model to bridge representational differences as it reasons across modalities. We introduce Uni-LaDiR (Unified Latent Diffusion Reasoner), a framework that brings these thoughts into a shared latent space for reasoning. A unified encoder maps teacher reasoning steps from different modalities into shared thought tokens, trained to preserve the information needed for later reasoning steps and the final answer or action. Because the same context can support multiple valid next steps, we use diffusion to predict the next block of thought tokens from the input and preceding blocks. Jointly training the encoder and diffusion reasoner with shared model weights encourages thought tokens to be both useful for the task and predictable from the available context. At inference, the model generates these tokens without teacher observations. Across eleven vision-language model (VLM) benchmarks and two vision-language-action (VLA) suites, Uni-LaDiR achieves relative gains over the strongest evaluated baselines of 7.3% on visual reasoning tasks and 6.1% on robot manipulation tasks.

[95] MATCH: Model-Aware Tool Learning with Curriculum Scheduling and Hierarchically Gated Rewards cs.LG | cs.AI | cs.CLPDF

Shihao Liu, Hao Yin, Lijun Liu, Zhengzong Chen, Yuanyuan Zhao

TL;DR: MATCH 以随策略能力变化的课程调度选择当前边界样本，并用层级门控奖励约束工具名称、参数键和值的信用分配。

Details

Motivation: 强化学习可根据反馈优化大语言模型工具调用，但固定难度阈值会逐渐脱离策略能力边界；简单加和奖励则可能在工具本身选错时仍把论元层面的功劳错误归给策略。

Result: MATCH 是闭环工具学习框架。模型感知课程 MACL 使用奖励更新样本难度，每轮选择靠近当前能力边界的样本并加入 top-k 较难样例。层级工具调用门控奖励 HTGR 依次评分工具名、参数键和值，只有前置层正确才在后续层给分；同一奖励同时用于 GRPO 更新和课程难度刷新。在 API-Bank 和 BFCL V3 上，总准确率分别为 72.19% 和 62.87%，超过主要监督与强化学习基线；四个骨干、两个模型家族的实验均有稳定提升。

Insight: 工具调用奖励应遵循调用结构：只有工具选择正确时才评价其参数是否正确；让奖励同时影响训练和难度调度，可使课程跟随策略能力共同演变。

Abstract: Tool learning enables large language models (LLMs) to use external tools for tasks beyond parametric knowledge. Reinforcement learning can optimize tool-call behavior from feedback, but current methods still face two problems: fixed-threshold curricula can become misaligned with the policy’s evolving capability boundary, and additive rewards can leak argument-level credit when the predicted tool is wrong. To address these problems, we propose MATCH, a closed-loop framework for model-aware tool learning with curriculum scheduling and hierarchically gated rewards. Model-Aware Curriculum Learning (MACL) maintains reward-derived sample difficulty that co-evolves with the policy, and each epoch selects samples near the current capability boundary together with a top-k pool of harder cases. Hierarchical Tool-call Gated Reward (HTGR) scores tool name, argument key, and argument value as a gated chain, granting credit at each level only when prerequisites hold. The same HTGR rewards drive both GRPO updates and MACL’s difficulty refresh, closing the loop between policy optimization and sample scheduling. On API-Bank and BFCL V3, MATCH reaches 72.19% and 62.87% overall accuracy, outperforming the main supervised and RL-based baselines. Backbone experiments further show consistent improvements across four backbones from two model families.

[96] Don’t Mask the Environment: Observation Supervision Changes How Agents Explore Under RL cs.LG | cs.AI | cs.CLPDF

Juzheng Zhang, Disha Makhija, Manoj Ghuhan Arivazhagan, Vinayshekhar Bannihatti Kumar, Rashmi Gangadharaiah

TL;DR: ActObs 在监督微调中同时预测轨迹里的环境观察 token 与动作 token，借此让策略学习动作后果，改善后续强化学习的探索和 pass@k。

Details

Motivation: 智能体轨迹记录动作及后续环境结果，但常规监督微调只对智能体动作 token 计算损失，把环境观察作为上下文而不作为预测目标。作者考察这种训练约定是否为后续强化学习提供最佳初始化。

Result: ActObs 增加对轨迹中已存在观察 token 的监督，部署时智能体仍不生成观察，因此无需添加数据、参数、序列 token 或前向计算。两种方法微调后表现相近，但 GRPO 后出现差异：Qwen3-4B 上 ActObs 在 Terminal-Bench 2.0 的所有评估采样预算下 pass@k 更高；Qwen3-8B 的 pass@1 稳定性有所折衷，但 pass@16 高 3.4 个百分点并解决更多不同任务。跨域 aider-polyglot 代码编辑也有改善。分析显示联合监督使策略在 RL 中保留更多熵、参数移动更少，并避免动作单边训练导致环境预测低于基座。

Insight: 学习预测环境观察可强化模型对动作后果的内部模拟，为后续策略探索做准备；价值主要在强化学习阶段显现，且可通过熵与策略移动解释。

Abstract: Agent trajectories record what an agent does and what happens next. Yet standard supervised fine-tuning (SFT) applies loss only to agent-authored action tokens, using environment observations as context but not as prediction targets. We ask whether this convention provides the best initialization for subsequent reinforcement learning. We introduce ActObs, which also supervises the observation tokens already present in each trajectory. Although deployed agents never generate observations, learning to predict them encourages the policy to model action consequences without adding data, parameters, sequence tokens, or forward passes. The methods perform similarly after SFT but diverge after GRPO. On Qwen3-4B, GRPO from ActObs achieves higher pass@k at every evaluated sampling budget than its action-only counterpart on Terminal-Bench 2.0. On Qwen3-8B, it trades some pass@1 reliability for higher pass@k (+3.4 pp at pass@16) and solves more distinct tasks. The advantage extends to cross-domain code editing on aider-polyglot (+4.2 pp at pass@1 at 4B), whose tasks are unseen during SFT and RL. ActObs retains more entropy during RL while requiring less policy movement, leaving the final policy closer to its SFT initialization. Our analysis traces this difference to SFT: action and observation gradients rapidly become orthogonal, while action-only training leaves a large residual observation gradient and degrades environment prediction below the base model. Joint supervision prevents this one-sided specialization, preserving consequence prediction and preparing the policy for downstream exploration.

cs.MM [Back]

[97] From Models to Systems: A Comprehensive Survey of Efficient Multimodal Learning cs.MM | cs.AI | cs.CL | cs.CV | cs.LGPDF

Pan Wang, Siwei Song, Hui Ji, Siqi Cao, Heng Yu

TL;DR: 这篇综述以模型、算法和系统三个层级系统化高效多模态学习，并通过 300 余篇工作及 MLLM 案例分析效率、效用与隐私的跨层协同。

Details

Motivation: 多模态模型扩张带来计算、内存和部署瓶颈，高效多模态学习迅速发展，但效率在学习栈的何处体现、如何实现仍缺乏统一框架。

Result: 综述从 300 余篇代表性工作提炼模型、算法、系统三级分类，分别讨论架构精简、执行优化与硬件感知编排，并综合分析层间纵向协同如何影响效率-效用-隐私权衡。通过多模态大语言模型案例，梳理研究从结构改造走向全栈资源编排的演进；还面向不同应用讨论优化方案，并提出效率应成为模型设计内生属性的愿景及后续挑战。

Insight: 多模态效率不能只由模型参数量衡量，算法执行和系统硬件编排同样关键；跨层协同决定效用、效率和隐私之间的整体折衷。

Abstract: The rapid expansion of multimodal models has surfaced formidable bottlenecks in computation, memory, and deployment, catalyzing the rise of Efficient Multimodal Learning (EML) as a pivotal research frontier. Despite intensive progress, a cohesive understanding of what, how, and where efficiency is manifested across the learning stack remains fragmented. This survey systematizes the EML landscape by introducing the first structured, model-to-system taxonomy. We distill insights from over 300 seminal works into three hierarchical levels–model, algorithm, and system–addressing architectural parsimony, execution refinement, and hardware-aware orchestration, respectively. Moving beyond a purely categorical review, we offer a methodological synthesis of the vertical synergies between these layers, elucidating how cross-layer co-design contributes to the fundamental “Efficiency-Utility-Privacy” trade-off. Through an integrative case study of Multimodal Large Language Models (MLLMs), we trace the field’s evolutionary trajectory from initial structural adjustments to modern full-stack resource orchestration. Furthermore, we provide a holistic discussion and application-specific optimization blueprints for diverse domains and posit a paradigm shift toward self-regulating intelligence, where efficiency is an intrinsic, emergent property of the model’s fundamental design rather than a post-hoc constraint. Finally, we present open challenges and future directions that will define the trajectory of EML research. This survey establishes a structured framework for multimodal systems that are not only high-performing and generalizable but natively efficient and ready for ubiquitous deployment. A continuously updated version is available at https://github.com/pwang322/Efficient-Multimodal-Learning-Survey.

cs.RO [Back]

[98] 4D Radar Perception Algorithms for Autonomous Driving: A Review cs.RO | cs.CV | eess.SPPDF

Xumin Wu, Jun Zhou, Jilin Mei, Chen Min, Yu Hu

TL;DR: 这篇综述按感知任务和算法演化梳理自动驾驶 4D 毫米波雷达，从目标检测扩展到运动、定位、稠密空间与动态场景理解。

Details

Motivation: 4D 毫米波雷达算法近年来从信号处理和目标检测发展到语义分割、运动估计、占用预测及动态场景重建，需要总结不同任务、数据、标注和物理先验的研究基础。

Result: 综述介绍雷达基础、数据表达和质量增强方法，再梳理目标级感知、运动与定位、局部及稠密空间感知、动态场景理解。跨方向比较纯雷达学习、多模态融合、跨模态监督和知识蒸馏，重点讨论仰角、Doppler 测量及雷达物理先验的利用方式。作者汇总现有数据集的任务覆盖、输入、标注与评估协议，最后讨论共同挑战和未来研究方向。

Insight: 4D 雷达研究正在从稀疏目标检测迈向动态空间理解；任务导向综述有助于辨析不同算法结论究竟由何种传感信息、标注和协议支持。

Abstract: Research on 4D millimeter-wave radar perception algorithms has flourished in recent years, extending from signal processing and object detection to semantic segmentation, motion estimation, occupancy prediction, and dynamic scene reconstruction. This review organizes the field according to the evolution of perception tasks and algorithms. It first introduces radar fundamentals, data representations, and quality-enhancement methods, and then reviews object-level perception, motion and localization, local and dense spatial perception, and dynamic scene understanding. Across these directions, we compare radar-only learning, multimodal fusion, and cross-modal supervision and knowledge distillation. Particular attention is paid to how elevation, Doppler measurements, and radar physical priors are exploited across tasks. We further summarize the task coverage, input data, annotations, and evaluation protocols of existing datasets, clarifying the empirical support for different research directions. Finally, we discuss the common challenges and future directions of 4D radar perception for autonomous driving. This review provides a task-oriented perspective on the transition from sparse object perception to dynamic spatial understanding.

[99] VABench: Measuring Embodied Spatial Intelligence through Visual Demonstrations, Active Perception, and Metric Control cs.RO | cs.CVPDF

Zhongbo Zhang, Jiayi Jin, Yifan Wang, Zaibin Zhang, Haiwen Diao

TL;DR: VA-Bench 评估多模态模型从 RGB 示范中学习、主动选择视角、执行度量动作并根据反馈修订的完整具身空间闭环，发现主动感知能明显提升成功率。

Details

Motivation: 空间智能不只是描述物体位置，还需在观测不全时主动获取证据、统一空间坐标并执行动作。现有评测难覆盖从观察、推理到修正的完整闭环。

Result: VA-Bench 要求通用 MLLM 从纯 RGB 示范学习程序上下文，主动选择相机视角、发出度量笛卡尔指令并依据执行反馈修正；不提供特权物体姿态、oracle 轨迹或学习动作头，仅用模型无关控制器执行目标。基准含 14 个基础任务族、7 种留出几何/布局变体及五物体长程组合任务。最佳模型在标注运行中目标定位得分 100%、空间关系 78.9%，但三次运行宏平均任务成功率只有 53.93±3.17%。主动相机控制使匹配比较中的成功率从 27.86% 提高到 57.50%；留出几何可使成功率下降超过 30 点，且没有模型完成严格长时域任务。

Insight: 语言和空间关系判断得分高不等于能成功执行具身任务；主动视角获取能显著改善操作，但几何迁移及长时程闭环仍是明显瓶颈。

Abstract: Spatial intelligence requires more than describing object locations. Under incomplete observation, models must identify and acquire missing evidence, interpret it in a common spatial frame, and act on it. We introduce VA-Bench to evaluate the complete observe-reason-act-revise loop. General-purpose MLLMs learn procedural context from RGB-only demonstrations, actively select camera viewpoints, issue metric Cartesian commands, and revise them from execution feedback. Models receive no privileged object poses, oracle trajectories, or learned action heads. A fixed model-agnostic controller executes only model-specified targets. VA-Bench contains 14 base task families (11 single-arm and three dual-arm), seven held-out geometry/layout variants, and a long-horizon five-object composition track. We evaluate 12 primary model conditions in three independent runs over the same 20 physically verified seeds per base task, reporting terminal success, nine trajectory-level behavioral diagnostics, and subtask progress. First, the best-performing model scores 100.0% on target localization and 78.9% on spatial relations in the annotated run. Its three-run macro-average task success is only 53.93+/-3.17%. Second, active camera control significantly improves task success over passive multi-view observation. In one matched comparison, success rises from 27.86% to 57.50%. Third, held-out geometric transfer can reduce task success by over 30 percentage points. No model completes a strict long-horizon episode, despite substantial partial progress. VA-Bench thus tests whether general-purpose MLLMs can turn visual demonstrations and actively acquired evidence into successful embodied action.

[100] LapaTrack-3D: 6 DoF pre-operative shape tracking for laparoscopic surgery cs.RO | cs.CVPDF

Jingwei Song, Javid Hussain Jakir, Ray Zhang, Wenwei Zhang, Hao Zhou

TL;DR: LapaTrack-3D 改造 ORB-SLAM2，利用术前三维形状先验和伪分割从单目腹腔镜视频实时恢复器官位姿与 6DoF 轨迹。

Details

Motivation: 腹腔镜手术中缺少触觉反馈和透明视野，需把术中视频与 CT 等术前数据对齐，才能准确定位目标器官内部解剖结构。

Result: 方法以 ORB-SLAM2 为基础，作四项改动：用基本三维器官形状初始化单目跟踪；以伪分割分离器官和背景；将三维形状作为位姿图优化的几何先验；改造 MSRCP 图像增强以应对复杂照明。体内和体外实验显示其可应对弱光、快速运动、器官离开视野、局部可见和器官相对背景移动等情况。对 1280×720 视频处理速度为 13 Hz。

Insight: 术前形状先验可为单目手术视频跟踪提供缺失深度的几何锚点，伪分割和照明增强则应对腹腔镜环境的主要视觉干扰。

Abstract: This work proposes a real-time 6 Degree-of-Freedom (6 DoF) tracking algorithm for monocular laparoscopic surgery. It provides alignment between intra-operative video and pre-operative data (e.g., CT). The 6 DoF tracking offers a solution for accurately locating the internal anatomy of the target organ despite the lack of tactile feedback and transparency. The ORB-SLAM2 framework is adopted and modified for prior-based 3D tracking with four major modifications. First, the primitive 3D shape is used for fast initialization of the ORB-SLAM2 monocular mode. Second, a pseudo-segmentation strategy is employed to separate the target organ from the background for tracking. Third, the 3D shape is incorporated as a geometric prior in its pose graph optimization. Fourth, the Multi-Scale Retinex with Chromaticity Preservation (MSRCP) algorithm is leveraged and modified for image enhancement in challenging illumination scenarios. In-vivo and ex-vivo experiments validate that LapaTrack-3D provides robust 3D tracking and effectively handles typical challenges such as poor illumination, fast motion, out-of-field-of-view scenarios, partial visibility, and ``organ-background’’ relative motion. LapaTrack-3D achieves a processing rate of 13 Hz for 1280*720 pixel video.

Marco S. Tayar, Felipe Tommaselli, Gianluca Capezutto, Pedro Antonio Rabelo Saraiva, Pedro H. V. de Freitas

TL;DR: VLN on the Fly 是机载视觉语言导航栈，将指令接地、深度目标恢复、样条规划和强化学习控制分成可检查阶段，在室内飞行中完成大多数目标导航。

Details

Motivation: 无人机完全机载视觉语言导航必须在有限算力下完成接地、规划和控制，而且单阶段错误不易在飞行中定位。端到端策略把步骤融合，失去模块化栈便于检查的能力和安全验证点。

Result: 系统先用量化 VLM 将指令接地到粗图像网格，再由深度提升为三维目标；快速 B-spline 规划器生成可行轨迹，预训练强化学习策略将其跟踪为多旋翼电机指令。15 次受控室内飞行中，三种日常目标成功到达 13 次，平均目标误差 5.72 厘米、平均 GPU 利用率 39.3%。另有 6 次杂乱环境飞行中，在机载感知门控下跟踪了无碰撞轨迹。

Insight: 将语义定位、几何恢复、轨迹规划和飞行控制拆成可观测阶段，既保留视觉语言导航能力，也让各阶段错误能分别检查。

Abstract: Running vision-language navigation fully onboard an aerial robot is hard, since grounding, planning, and control must share limited compute and a single-stage error is difficult to isolate in flight. End-to-end aerial policies fuse these stages into one network, giving up the observability and safety checks a modular stack keeps available. We propose VLN on the Fly, an onboard stack that keeps grounding, planning, and control as separate, inspectable stages. A quantized VLM grounds an instruction to a coarse image cell, depth lifts it to a 3D goal, a fast B-spline planner returns a feasible trajectory, and a pretrained reinforcement learning policy tracks it to motor commands across quadrotors. Across 15 onboard flights over three everyday referents in a controlled indoor volume, the stack reaches the target in 13 of 15 trials with 5.72 cm mean goal error and 39.3% average GPU utilization. In 6 additional cluttered-environment trials, the stack tracks collision-free trajectories under onboard perception gating.

[102] LLM-Guided Transformation of Non-Critical Driving Scenes into Safety-Critical Scenarios Using Augmented Reality cs.RO | cs.AI | cs.CVPDF

Noura Fady, Farah Khaled, Catherine M. Elias

TL;DR: 该流程用计算机视觉提取真实驾驶场景风险特征，再由大语言模型设计碰撞风险行为并通过 AR 合成，自动把安全场景转成安全关键测试用例。

Details

Motivation: 自动驾驶安全测试需要真实可信的危险场景，但从真实道路收集此类数据成本高且存在安全风险。

Result: 系统检测并跟踪道路参与者，计算距离、速度、运动方向和碰撞时间等安全特征并判断场景危险程度。对安全场景，LLM 生成可造成碰撞的对象和行为，再通过增强现实融合回原场景。nuScenes 评估中，安全场景分类准确率为 97.52%，并成功生成行人穿越、后车超车和突然停车等测试情境。

Insight: 以真实场景视觉和运动线索为基础，再用生成式规划和 AR 注入风险，可扩展测试用例而不必让真实车辆实际经历危险；结果支持模拟测试用途。

Abstract: Testing Autonomous Driving Systems (ADS) requires realistic safety-critical scenarios, but collecting such data from real-world driving is costly and unsafe. This paper presents an automated pipeline that transforms safe driving scenes into safety-critical scenarios by combining computer vision, Large Language Models (LLMs), and Augmented Reality (AR). The system detects and tracks road users, extracts safety features including distance, velocity, motion direction, and Time-to-Collision (TTC), and assesses scene criticality. Safe scenes are modified by an LLM, which generates realistic collision-inducing objects and behaviors that are integrated into the original scene using AR. The proposed pipeline was evaluated on the nuScenes dataset, achieving 97.52% safety classification accuracy and successfully generating realistic scenarios such as pedestrian crossings, rear overtaking vehicles, and sudden-stop events. The results demonstrate an effective and flexible approach for automated generation of safety-critical scenarios to support the testing and validation of autonomous driving systems.

Wenyuan Xie, Mengyang Hong, Yongzhong Wang, Yanbiao Ji, Yijin Zhou

TL;DR: Navi-Agent 用视觉地点和运动历史构建无坐标导航拓扑，实现零样本连续环境语言导航中的近似自定位、进度确认和视觉重访恢复。

Details

Motivation: 连续未知环境中的语言导航要求智能体按长程指令行动。现有零样本方法通常依赖几何定位或坐标表示；去除深度和全局坐标后，如何保持地点记忆、确认进度并从偏航恢复仍很难。

Result: Navi-Agent 将视觉观察和执行运动历史组织为导航拓扑，节点表示视觉地点、边表示运动转移，以此支持基于观察的近似自定位、任务进度验证和视觉重访恢复。闭环流程先将指令拆成子目标，再执行局部视觉导航，并通过拓扑确认到访地点。零样本 VLN-CE 基准和真实机器人实验显示，该方法在几何受限方法中达到先进表现，并与依赖几何定位的方法保持竞争力。

Insight: 地点拓扑能在不建立全局坐标的情况下提供持久空间状态；视觉重访与历史运动边为进度确认和迷航恢复提供了共同结构。

Abstract: Vision-Language Navigation in Continuous Environments (VLN-CE) requires an embodied agent to execute long-horizon instructions in unknown environments. Existing zero-shot VLN-CE systems typically maintain spatial states through geometric localization or coordinate-based representations. Recent geometry-constrained navigation removes depth and globally consistent coordinates, but maintaining persistent spatial awareness for place confirmation, progress verification, and recovery remains challenging. We present Navi-Agent, a zero-shot VLN-CE agent that constructs a coordinate-free spatial state from visual observations and executed motion histories. Navi-Agent organizes this state as a navigation topology, where nodes represent visual places and edges represent motion transitions. This representation enables observation-based approximate self-localization, task progress verification, and visual revisitation-based recovery. Navi-Agent performs closed-loop navigation by decomposing instructions into sub-goals, executing local visual navigation, and verifying visited places through the constructed spatial state. Experiments on zero-shot VLN-CE benchmark and real-world robot platforms show that Navi-Agent achieves state-of-the-art performance among geometry-constrained methods while remaining competitive with approaches relying on geometric localization.

[104] OmniMimic: Dynamics-completed Motion Augmentation for Multi-style Omnidirectional Quadruped Locomotion cs.RO | cs.CV | eess.IVPDF

Sheng Wu, Guoqiang Zhao, Zhe Yang, Fei Teng, Zhikun Zhou

TL;DR: OmniMimic 将方向受限的动物步态示范扩展为覆盖全向速度的四足机器人多步态策略，结合动力学补全、课程式命令扩展和步态专家残差。

Details

Motivation: 动物示范能为四足机器人提供自然且有辨识度的步态，但示范方向覆盖有限，无法为后退、横向和转向命令提供足够的风格一致监督。

Result: OmniMimic 先通过时间反转、受约束动力学补全和矢状面反射，构造已观测方向以外的机器人专用运动学和物理监督；再逐步将命令范围从示范分布扩展至目标逐轴速度边界。共享 actor 配合软门控、按步态专化的残差专家，平衡通用技能和步态特有修正。在仿真的四种步态中，相较匹配 APEX 基线，前进和后退参考速度下平均足端位置 RMSE 降低 12.9%，均匀笛卡尔命令网格上的速度跟踪 RMSE 降低 63.1%。

Insight: 先从受限示范中补全物理上合理的其他方向数据，再课程式扩展命令空间，可减少直接外推导致的风格失真，并让一个策略覆盖多个步态。

Abstract: Animal demonstrations provide quadruped robots with natural and distinctive gait styles that are difficult to specify through hand-crafted rewards. However, their narrow directional coverage leaves little style-consistent supervision for backward, lateral, and turning commands. We present OmniMimic, a training framework that turns directionally limited animal demonstrations into a single multi-gait policy over target per-axis velocity ranges. OmniMimic first combines temporal reversal, constrained dynamics completion, and sagittal reflection to construct robot-specific kinematic and physical supervision beyond the observed directions. It then expands commands progressively from the demonstrated velocity distribution toward the target per-axis bounds, and uses a shared actor with soft-gated, gait-specialized residual experts to balance reusable locomotion skills with gait-specific corrections. Across four gaits in simulation, OmniMimic reduces mean foot-position RMSE at forward and backward reference velocities by 12.9% and velocity-tracking RMSE on a uniform Cartesian command grid by 63.1%, compared with the matched APEX baseline. The project page is at https://OmniMimic.github.io.

[105] CoRef-GS: Cooperative Referring Gaussian Splatting for Multi-Agent Scene Understanding cs.RO | cs.CV | eess.IVPDF

Zhikun Zhou, Kunyu Peng, Runyi Yang, Junhao Cai, Di Wen

TL;DR: CoRef-GS 在多机器人融合高斯地图上做协同指代表达定位，联合几何与语义对齐，并从查询机器人的视角推理目标与地标关系。

Details

Motivation: 具身机器人需要从指定视角把物体和关系语言查询定位到场景。多机器人场景中目标或地标可能只被另一机器人看到，地图对齐还必须同时保留实例语义可比性和查询视角下的空间关系。

Result: CoRef-GS 为各机器人构建开放词汇实例级高斯地图，再用跨机器人几何和语义一致模块对齐部分重叠地图，并通过视角条件掩码关系图完成定位。作者提出双四足机器人 CoQuad-Ref，覆盖真实和模拟室内场景。模拟场景中精化后旋转误差从粗初始化 2.58° 降至 0.15°；真实场景指代 mIoU 从 ReferSplat 的 52.6% 提升至 68.8%。

Insight: 地图融合不仅要配准几何，还应让跨智能体的开放词汇实例语义保持可比；关系解释仍须锚定查询机器人视角。

Abstract: Referring scene understanding for embodied robots requires grounding object- and relation-centric language queries from a designated viewpoint. While a local semantic Gaussian map can support such grounding within one agent’s observations, cooperative settings require this ability to remain effective after independently reconstructed maps are aligned and fused. In this setting, the referred target or its contextual landmark may come from another agent’s observations, while spatial relations must still be interpreted from the querying robot’s viewpoint. We formulate this problem as cooperative referring Gaussian grounding over fused maps, which requires geometric alignability, instance-level semantic comparability, and view-conditioned relation reasoning. Existing language-aware Gaussian methods mainly focus on single-map querying, whereas Gaussian registration methods optimize geometric or photometric alignment without preserving language-grounding-oriented semantic compatibility. We propose CoRef-GS, a cooperative referring Gaussian splatting framework. CoRef-GS constructs local open-vocabulary instance-aware Gaussian maps, then aligns partially overlapping maps with a cross-agent alignment module by geometric and semantic consistency, and grounds queries using a view-conditioned mask relation graph. We further introduce CoQuad-Ref, a dual-quadruped benchmark spanning both real-world and simulated indoor scenes. Experiments show that, on simulated scenes, CoRef-GS reduces the rotation error from 2.58° after coarse initialization to 0.15° after refinement, and improves real-world referring mIoU over ReferSplat from 52.6% to 68.8%. The established benchmark and source code will be publicly released at https://github.com/ruojiruoli17/CoRef-GS.git.

[106] INSPECT: Learning Robot View Selection from Assistant Use cs.RO | cs.CVPDF

Di Wen, Kailun Yang, Wenhao Guo, Yitian Shi, Junwei Zheng

TL;DR: INSPECT 从智能眼镜装配辅助记录中学习机器人检查视角偏好，结合对象身份干预和证据级监督，在齿轮箱及角磨机视频上改善可验证判断。

Details

Motivation: 装配检查机器人需判断部件是否存在及安装正确与否。第一人称装配辅助视频中的头部运动、工件操作和口头状态确认都包含视角与操作结果证据，但机器人目标域视角策略缺少标签。

Result: INSPECT 使用智能眼镜助理的部件问答和下一步指导记录学习机器人视角偏好。PI-TwinSwap 通过成对身份干预校准对象证据；按主张索引的监督区分证据需求与相机可复现观察变化；对象中心校准将相对视角偏好适配到机器人位姿，并用子句级筛选检查预测证据。机器人只依赖当前观察和已知位姿选择视角，不看候选图像。齿轮箱图像上，其视角效用优于非 oracle 基线，人类评定完整可验证性从保持当前视角的 34.8% 提高至 41.7%；将相对视角选择迁移到 IMPACT 角磨机视频后，冻结感知头的正确率从 50.6% 提至 54.3%。

Insight: 助理记录里的相机运动和语言反馈可作为视角偏好的弱监督；将视角选择与具体证据要求对齐，有助于提高机器人结论的可复核性。

Abstract: Robots inspecting an assembly must determine which parts are present and whether they are correctly installed. During egocentric assembly assistance, head motion and workpiece handling reveal evidence for these checks, while spoken state confirmations link observations to procedural outcomes. We introduce INSPECT, which learns robot view preferences from records of a smart-glasses assistant that answers part queries and provides next-step guidance. Presence-Invariant TwinSwap (PI-TwinSwap) calibrates object evidence through paired identity interventions. Claim-indexed supervision separates evidence requirements from camera-reproducible observation changes. Object-centered calibration adapts relative view preferences to robot poses, while clause-level screening checks predicted evidence. The robot selects views using only its current observation and known poses, without candidate images. Evaluation uses annotated assistant-video replay to simulate state feedback, without target-domain view labels for policy training. On images of physical gearbox assemblies, INSPECT achieves the highest view utility among the compared non-oracle policies and raises human-rated full verifiability from 34.8% to 41.7% compared with keeping the current view. On commercial angle-grinder recordings in IMPACT, the transferred relative-view selector increases the correct decision rate from 50.6% to 54.3% with a frozen perception head. The source code is available at https://github.com/Kratos-Wen/INSPECT.

[107] DexTouch-WM: Learning Action-Conditioned Tactile World Models from Human Touch for Dexterous Robot Manipulation cs.RO | cs.CVPDF

Yan Qin, Yue Chen, Wenwei Lin, Shujia Liu, Chuqiao Lyu

TL;DR: DexTouch-WM 用人手触觉和动作扩展灵巧操作世界模型训练，在保持五小时机器人监督不变时增加人类交互数据，提升未见机器人任务中的视觉、几何和接触预测。

Details

Motivation: 训练接触丰富的灵巧操作预测模型需要稠密触觉交互数据，但真实机器人数据昂贵且与特定传感器和身体形态绑定，难以规模化。

Result: DexTouch-WM 是动作条件世界模型，联合预测未来 RGB 观测和双侧触觉动态。作者在人手和灵巧机器人手上部署布局相同的柔性压阻传感阵列，并把人类动作重定向到机器人动作空间，使人类交互可监督机器人预测所用的同一动力学模型。模型用解剖结构感知触觉 token 和对齐动作条件，耦合预训练视频专家与轻量触觉专家。在固定五小时机器人监督、逐步将人类交互由 0 增至 100 小时的实验中，即使人类和机器人任务集合互不重叠，留出机器人域的视觉、几何和接触预测仍明显提升。模型还用于策略评估代理环境和生成合成轨迹进行真实机器人策略学习。

Insight: 身体与传感器接口对齐后，人类触摸可提供与机器人任务互补的规模化接触动力学数据；无需替代机器人监督，额外人类交互仍能带来迁移收益。

Abstract: Learning predictive models of contact-rich dexterous manipulation requires dense tactile interaction, but such data are costly to scale on real robots and remain tied to embodiment-specific sensors. We introduce DexTouch-WM, an action-conditioned world model that learns from scalable human touch to jointly predict future RGB observations and bilateral tactile dynamics. Our insight is that human and robot manipulation share transferable contact dynamics when their tactile observations and action spaces are made compatible. We deploy flexible piezoresistive arrays with a shared sensing layout on both human and dexterous robot hands, and retarget human motion into the robot action space so that human interaction can supervise the same dynamics model used for real-robot prediction. DexTouch-WM couples a pretrained video expert with a lightweight tactile expert using anatomy-aware tactile tokens and aligned action conditioning. In human-to-robot scaling experiments, we keep five hours of real-robot supervision fixed while increasing human interaction from 0 to 100 hours, and observe substantial improvements in held-out robot-domain visual, geometric, and contact prediction despite disjoint human and robot task sets. Beyond prediction, we evaluate the world models as surrogate environments for policy evaluation and as generators of synthetic trajectories for real-robot policy learning, showing that scalable human interaction provides a complementary data axis for learning dexterous robot world models.

[108] OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher cs.RO | cs.CV | cs.LGPDF

Damiano Da Col, Maximilian Igl, Peter Karkus, Kashyap Chitta, Boris Ivanovic

TL;DR: OPTED 将向量化输入上的强化学习教师与相机端到端驾驶学生分开训练，再用教师监督在真实日志神经重建的闭环仿真中微调学生。

Details

Motivation: 仅扩展预训练数据的收益逐渐递减，闭环后训练有助于解决行为克隆策略的误差累积，但基于传感器的驾驶策略在闭环强化学习中需要昂贵仿真交互。

Result: OPTED 先在 HD 地图和边界框等特权向量输入上训练 RL 教师，再由教师监督预训练学生进行闭环微调。作者将方法用于 TransFuser 和 VaVAM 两种相机驾驶模型，在真实驾驶日志的 3D Gaussian Splatting 神经重建环境 AlpaSim 中后训练，驾驶分数分别提高 1.6 倍和 9.5 倍。受控实验显示，相比直接 RL 后训练，OPTED 用约少三个数量级的仿真交互达到相当闭环表现，同时更接近人类驾驶先验。

Insight: 把昂贵的闭环策略优化转移到较易训练的特权教师，再蒸馏回传感器学生，可大幅减少仿真交互，同时减少学生策略偏离人类示范的程度。

Abstract: As scaling pre-training data alone yields diminishing returns, post-training is becoming increasingly important across physical AI domains such as autonomous driving. End-to-end driving policies are pre-trained in open loop with behavior cloning on human demonstrations. However, compounding errors during closed-loop deployment can take the vehicle outside the training data distribution, increasing the risk of safety-critical incidents. Closed-loop post-training can mitigate this risk but requires costly simulation for sensor-based policies. We propose OPTED (on-policy fine-tuning for end-to-end driving) which decouples reinforcement learning from the post-training of the end-to-end policy: a privileged teacher is trained using RL on vectorized inputs (HD-map and bounding boxes). This teacher then provides supervision to the pre-trained student during closed-loop post-training. We apply OPTED to two camera-based models, TransFuser and VaVAM, and fine-tune them in AlpaSim, using neural reconstructions (3DGS) of real driving logs. Driving scores increase by factors of 1.6$\times$ and 9.5$\times$, respectively. In controlled experiments OPTED matches closed-loop performance with approximately three orders of magnitude fewer simulator interactions than direct RL post-training, while staying closer to the human prior. Project page: https://01dami23.github.io/opted/

eess.IV [Back]

Emanuele Artioli, Farzad Tashtarian, Christian Timmerer

TL;DR: PRESLEY 用生成式层对视频背景可移除区域自适应降质并在客户端恢复，在匹配码率下显著改善背景质量，同时保持前景逐比特一致。

Details

Motivation: 传统视频编解码对各区域一视同仁。若能识别观众较少关注的背景块，在发送端有控制地降质并让客户端生成恢复，可节省码率；但无条件修复可能造成失真，且需判断哪些区域可被恢复。

Result: PRESLEY 在前序 ELVIS 上将破坏性块移除改成由可移除性掩码控制的原位自适应降质，通过位打包侧信道传输各块强度，并使用条件于已传视觉先验的生成骨干恢复。系统分别优化降质区域选择、节省编码比特和恢复。对前作在 13 种码率阶梯、多个编码器与数据集上进行同码率比较，背景 BD-rate 平均减少 56.4%。相对原始画质基线，在目标低码率区最多节省 29.4% BD-rate，23 段序列中 17 段背景质量更好，前景逐比特不变。精确组合 oracle 显示现有复杂度启发式已取得 83.3% 可节省比特，剩余该维度空间约为总码率 5%；恢复后损伤可在传输前预测，留出集相关系数 0.400。

Insight: 生成式传输的关键不仅是选哪些背景块降质，还要在发送前预测恢复损伤；前景保持逐比特不变，适用于把码率重点投向视觉重要区域。

Abstract: Traditional codecs treat every region of a frame alike; a generative layer can instead degrade the regions a viewer attends to least and reconstruct them at the client. We present PRESLEY, which extends the prior conference work ELVIS by replacing destructive block removal with adaptive in-place degradation under a removability mask, signaling per-block strength in a bit-packed side channel, and restoring via generative backbones conditioned on transmitted visual priors rather than unconditioned in-painting. We separate the problem into three goals: choosing which blocks to degrade, degrading them so the encoder spends fewer bits, and restoring them. Against its predecessor at matched rate, PRESLEY achieves a decisive mean -56.4% BD-rate reduction on delivered background quality across 13 rate ladders spanning multiple codecs and dataset families. Against pristine baselines, PRESLEY defines the operating regime of generative transport: delivering substantial bitrate savings (up to -29.4% BD-rate) and superior background quality (17/23 sequences) in the target bit-starved regime, while maintaining foreground fidelity bit-exact. We further map where the theoretical headroom in this class of architecture lies. Using an exact leave-one-superblock-out combinatorial oracle as an additive empirical bound, we show that existing complexity heuristics already capture 83.3% of bit-cost savings, bounding remaining cost-axis headroom at about 5% of total bitrate. We then identify and model the primary unaddressed axis – post-restoration damage – which disperses widely (4.9-8.4 dB). We prove that this damage is predictable before transmission (held-out rho = +0.400), establishing the feasibility of transmit-time restorability modeling and defining the roadmap for joint rate-distortion-restoration selection rules.

[110] Mammography Foundation Models for Opportunistic Prediction of Major Adverse Cardiovascular Events eess.IV | cs.CV | cs.LGPDF

Paula Feldman, Nusrat Binta Nizam, Sunwoo Kwak, Batuhan Karaman, Katerina Dodelzon

TL;DR: 研究显示乳腺 X 光基础模型即使只输入筛查影像、未使用心血管监督或钙化标注，也能预测五年主要不良心血管事件并识别相关血管信息。

Details

Motivation: 心血管疾病是女性主要死亡原因，但风险评估常依赖缺失、过期或不易获得的临床变量。常规筛查乳腺摄影包含与心血管风险相关的乳腺动脉钙化，可能提供无需新增成像的机会性风险信息。

Result: 作者构建 22,497 名女性、随访五年的 MACE 队列并连接电子病历结局，共 500 起事件（患病率 2.22%）。原为乳腺癌任务预训练的专用基础模型在不使用临床变量、仅以筛查乳腺片为输入时 AUROC 分别为 0.823 和 0.822，明显高于仅年龄模型的 0.765。虽然训练未将乳腺动脉钙化作为标签，两模型仍对放射科记录有钙化者给出明显更高风险，并显示与血管发现一致的激活模式。

Insight: 基础模型可能从常规乳腺片中恢复未显式监督的血管风险线索，为补充常规临床评估提供机会；该结果支持筛查用途的研究潜力，不意味着取代现有风险评估。

Abstract: Cardiovascular disease (CVD) remains the leading cause of death among women, yet cardiovascular risk assessment often relies on clinical variables that may be missing, outdated, or unavailable in routine care. Screening mammography offers an opportunity for opportunistic cardiovascular risk stratification because it is routinely acquired and contains vascular features, including breast arterial calcifications (BAC), that are associated with cardiovascular risk and events. We evaluate whether mammography specific foundation models, originally pretrained for breast cancer-related tasks, can transfer to cardiovascular risk prediction without cardiovascular specific supervision or explicit BAC annotation. We constructed a 5-year major adverse cardiovascular event (MACE) cohort of 22,497 women linked to electronic health record outcomes, including 500 events (2.22% prevalence). The foundation models achieved AUROCs of 0.823 and 0.822 substantially exceeding an age-only model (AUROC 0.765), despite using only the screening mammogram as input, with no clinical variables. Both foundation models evaluated assigned substantially higher predicted risk to patients with radiologist-documented BAC, despite BAC never being used as a training label, and showed activation patterns consistent with vascular findings. Together, these findings suggest that mammography foundation models can recover clinically relevant cardiovascular risk information directly from mammographic pixels and suggest that screening mammography may provide an opportunistic source of cardiovascular risk information to complement conventional clinical assessment without additional imaging. Code is available in https://github.com/PauFeld/MammoCVD

[111] The segmentation ceiling: why explicit left-ventricular masks do not improve learned ejection-fraction regression eess.IV | cs.CVPDF

Farshid Farhadi Khouzani, Paul La Plante, Bryar Mustafa Shareef, Laxmi Gewali

TL;DR: 论文提出分割误差上限，推导左心室逐帧面积误差如何传导至射血分数误差，解释为何当前分割信息无法改善 EchoNet-Dynamic 上的视频回归。

Details

Motivation: 射血分数由舒张末期和收缩末期左心室容积计算，常见直觉认为显式分割左心室会改善超声视频 EF 估计；但分割精度要达到何种程度才能超过直接回归并不清楚。

Result: 作者从 EF 的归一化容积差推导分割面积误差到 EF 误差的闭式传播关系，定义可检验的 segmentation ceiling。基于 EchoNet-Dynamic、UniFormer-S 和患者内误差相关性，盈亏平衡点约为每帧 10% 面积误差，而代表性分割器约为 14%。四种注入分割/面积信息的策略均未超过原始视频基线，真值掩码收益仅来自标签泄漏。研究转而用强增强和权重平均改善泛化，密集视频评估 R² 为 0.806、MAE 4.08，接近 R(2+1)D 的 0.811；异方差 beta-NLL 还能给出校准且有信息量的不确定度。

Insight: 显式中间表征并非总能改善预测：只有掩码精度优于误差传播所决定的门槛才值得使用。该文据此把泛化和不确定性估计作为更实际的提升方向。

Abstract: Accurate estimation of left ventricular ejection fraction (EF) from echocardiography is central to cardiovascular care, and deep learning enables automated EF prediction from echocardiographic video. Because EF is clinically derived from left-ventricular (LV) volumes, a widely held intuition is that explicit LV segmentation should improve prediction. We introduce a quantitative criterion, the segmentation ceiling, that makes this testable: from EF as a normalized difference of end-diastolic and end-systolic volumes, we derive in closed form how per-frame segmentation area error propagates into EF error, and thus the accuracy a mask must reach before it can improve on direct regression. Using EchoNet-Dynamic, a UniFormer-S backbone, and the empirically measured within-patient error correlation, the criterion places the break-even near 10% per-frame area error, whereas a representative segmenter operates at roughly 14%, above the ceiling. Consistent with this, four strategies for injecting segmentation or area information (a predicted-mask channel, end-diastolic/end-systolic clip sampling, and per-bin and amplitude area-consistency objectives) fail to beat a raw-video baseline; ground-truth masks help only through label leakage. Input representation thus not being the limit, we identify generalization as the practical lever: weight averaging with strong augmentation attains a test R^2 of 0.806 (MAE 4.08) under a matched dense-clip protocol, comparable to an R(2+1)D baseline (0.811) while tightening the validation-to-test gap. Finally, a heteroscedastic beta-NLL formulation yields informative, well-calibrated per-prediction uncertainty, larger for clinically harder low-EF cases, where Monte-Carlo dropout does not. The segmentation ceiling gives a concrete design criterion for when mask-guided EF estimation is worthwhile, plus a simple, uncertainty-aware recipe for EF regression.

q-bio.GN [Back]

[112] Large Language Model Agents for Evidence Based Genetic Disease Severity Classification q-bio.GN | cs.AI | cs.CLPDF

Tohid Ghasemnejad, Ahmadreza Argha, Mark Grosser, John Wang, Min Yang

TL;DR: 该 ReAct+RAG 智能体依据 ACMG 严重程度指南和 ACOG 生活质量标准，为 10,211 个人类表型本体术语提供带证据的遗传病严重程度分类。

Details

Motivation: 遗传病严重程度分类主观且耗时，会拖慢基因组筛查；商业检测面板规模和重叠差异很大，需要更标准化、可解释的表型和基因层级严重程度判断。

Result: 系统检索 PubMed 文献，生成可解释推理链并独立核验论断，按表型分类 10,211 个 HPO 术语。在专家整理的队列上准确率为 93.55%、MCC 为 0.9237，82.6%–91.4% 的论断获直接证据或有效推断支持。随后汇总 8,738 个基因对，识别出 3,283 个呈严重或极严重表现的常染色体隐性遗传基因对；外部验证与 Mackenzie’s Mission 基因列表一致率为 95.2%。

Insight: 把指南条款、文献证据检索和独立论断核验纳入智能体流程，有助于将主观分类转为可追溯、可复用的遗传筛查依据。

Abstract: Disease severity classification for genetic conditions is subjective and labor-intensive, creating bottlenecks in genomic screening, where commercial panels vary widely in size and overlap. We developed an autonomous AI agent integrating Reasoning and Acting (ReAct) with Retrieval-Augmented Generation (RAG) to classify 10,211 Human Phenotype Ontology terms. It uses American College of Medical Genetics (ACMG)-endorsed severity guidelines and American College of Obstetricians and Gynecologists (ACOG) quality-of-life criteria to retrieve PubMed literature, generate interpretable reasoning chains, and independently verify claims. At the phenotype level, using expert-curated cohorts, the agent achieved 93.55% accuracy (MCC 0.9237) with 82.6% to 91.4% of claims supported by direct evidence or valid inferences. Gene-level severity was aggregated across 8,738 pairs, identifying 3,283 autosomal recessive pairs with severe or profound presentations. External validation showed 95.2% concordance with Mackenzie’s Mission gene list. This system enables standardized panel design by providing reliable, automated classification supported by direct evidence.

Table of Contents

cs.CV [Back]

[1] Can Vision-Language Models Judge Olympic Diving? From Reasoning to Scores in Zero-Shot Action Quality Assessment cs.CV | cs.AI | cs.LGPDF

[2] RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment cs.CVPDF

[3] Riemannian–Lorentz Fusion of Vision Transformers and State-Space Models cs.CV | cs.AI | cs.CL | cs.MMPDF

[4] WZPlanner: Safe End-to-End Path Planning for Autonomous Driving in Work Zones cs.CVPDF

[5] Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge cs.CVPDF

[6] ParticleSplat: Self-supervised Object-centric Latent Particle Splatting cs.CV | cs.ROPDF

[7] SCOUT: Sim-to-Real Text-Based Person Retrieval by Embedding-Space Prediction over Frozen Video Features cs.CV | cs.IRPDF

[8] A Multi-Modal Generative Model for Tomato Disease Leaves Understanding cs.CV | cs.AIPDF

[9] Selective Cotton Boll Localization for Robotic Harvesting: Evaluation of Deep Learning Vision Models Under Field Conditions cs.CV | cs.ROPDF

[10] Scientific Image Quality Assessment via Multi-modal Retrieval-Augmented Generation cs.CV | cs.CLPDF

[11] VGGT-GS SLAM: Uncalibrated Monocular Gaussian Splatting SLAM with Feed-Forward Priors cs.CVPDF

[12] IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models cs.CVPDF

[13] VideoResearcher: Self-Improving Tool Design for Long-Video Understanding cs.CVPDF

[14] Beyond Patch Removal: Persistent Adversarial Effects in Vision-Language-Action Policies cs.CV | cs.ROPDF

[15] GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model cs.CVPDF

[16] SeetaPsych v1.0: An Open-source Computer Vision Toolkit for Behavior-based Psychological Measurement cs.CVPDF

[17] Understanding and Exploiting Diagonal Attention Sparsity in Autoregressive Image Generation cs.CV | cs.PFPDF

[18] Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generation cs.CVPDF

[19] Benchmarking MLLMs via Cognitive Expected Scene Graph for Safety-Critical Visual Negation Understanding cs.CVPDF

[20] Region-Level Policy Optimization for Fine-grained MLLM Perception cs.CVPDF

[21] AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization cs.CVPDF

[22] SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes cs.CVPDF

[23] Absence is Presence: Understanding Visual Scene Negative Events Under Safety Cognitive Constraint cs.CVPDF

[24] Socialized UAV Cross-Task Learning: Towards Cross-Granularity Collaboration through Hierarchical Interaction cs.CVPDF

[25] BINDER: A Latent Variable Model for Probabilistic Medical Image Registration cs.CVPDF

[26] BinoGen: Scaling egocentric binocular data for embodied visual perception and learning cs.CV | cs.MMPDF

[27] CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding cs.CVPDF

[28] Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement cs.CVPDF

[29] Beyond the Foreground: FOV-Aware Polyp Image Synthesis via Lesion-Guided Adaptive Mucosal Context Propagation cs.CVPDF

[30] An Event Preserving Velocity Invariant Representation for Event Cameras cs.CVPDF

[31] QCPruner: Query-Conditioned Population Coverage for Visual Token Pruning cs.CVPDF

[32] AVTrace: Diagnosing Audio-Visual Temporal Reasoning in Omni Models cs.CV | cs.AIPDF

[33] Astronex-World 1.0: Real-Time Interactive World Model Foundation cs.CV | cs.AI | cs.ROPDF

[34] A Smaller Transformer in Your Transformer cs.CVPDF

[35] A Free Lunch? Adapting PP-OCRv6 for Historical Text Recognition cs.CVPDF

[36] Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Models cs.CV | cs.AIPDF

[37] Bridging Modalities on the Cortex: Surface-based MRI to PET Translation with a Diffusion Bridge cs.CV | cs.AIPDF

[38] Task-Oriented Semantic Feature Transmission for Multi-Task Satellite Remote Sensing over Low-SNR Channels cs.CV | cs.LGPDF

[39] MTF-Net: Multi-Modal Temporal Feature Fusion Network for Pedestrian Intention Prediction cs.CVPDF

[40] A Two-Stage Multi-Scale Attention-Based Network for Weakly Supervised Cataract Fundus Image Enhancement cs.CVPDF

[41] Scene-Q: Confidence-Aware Coarse-to-Fine Querying of 3D Scenes with Selective VLM Reasoning cs.CV | cs.ROPDF

[42] AI or Real: Detecting Partially Altered Videos Under Resource-Constrained Environments cs.CV | cs.DCPDF

[43] CleanVideo: Adaptive Concept Erasure for Text-to-Video Diffusion Models cs.CV | cs.AIPDF

[44] Not All Layers Are Equal: Dynamic Layer Routing for Reliable CLIP OOD Detection cs.CVPDF

[45] AgriScope: Pixel-Grounded Multimodal Understanding for Agricultural Images cs.CVPDF

[46] FreqDINO++: A Frequency-Guided Multi-Task Routing Vision Foundation Model for Universal Ultrasound Analysis cs.CVPDF

[47] EliGSiR: Continual RGB-D Mapping with Gaussian Splatting under Bounded Compute cs.CV | cs.ROPDF

[48] MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving cs.CVPDF

[49] Compact Vision Models for Iris Presentation Attack Detection under Presentation Attack Instrument Shift and Environmental Degradation cs.CV | cs.CRPDF

[50] TouchSight: Bare-Handed Tactile Prediction from Egocentric Video via Generative Visual Augmentation cs.CV | cs.AIPDF

[51] When Do Language-Grounded Explanations Help? A Graph-Bottleneck for Farm Monitoring Interpretable Sheep Facial Pain cs.CV | cs.AIPDF

[52] Cross-Architecture Foundation-Model Distillation for Edge Flood Segmentation cs.CV | cs.LGPDF

[53] SenseFuse: Label-Free Fusion of Image and Shape Encoders for Open-Vocabulary 3D Instance Segmentation cs.CV | cs.ROPDF

[54] Grounded Product Understanding in Livestream Videos cs.CVPDF

[55] DocAttriBench: Benchmarking Answer Grounding in Document Visual Question Answering cs.CVPDF

[56] Refinement Is Inherently Editable: Training-Free Prompt-to-Prompt Image Editing with Generative Refinement Network cs.CVPDF

[57] PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videos cs.CVPDF

[58] Earth Surface Immune System for Rapid Monitoring of Unknown Anomalies cs.CVPDF

[59] ERCPMP-Gx: Endoscopic Image and Video Dataset for Morphological, Histopathological, and Genomic Characterization of Colorectal Polyposis cs.CV | cs.AIPDF

[60] Paint-Anything: Unified Any-Color Control for Image Generation and Editing cs.CV | cs.AI | cs.LGPDF

[61] SplashSplat: Reconstructing Splashing Liquids from Real-World Multi-View Videos cs.CV | cs.GRPDF

[62] Can 4D Foundation Models Remember? cs.CVPDF

cs.CL [Back]

[63] Neo-Classic: A Benchmark for Evaluating Linguistic-Aesthetic Reasoning in Classical Chinese Poetry cs.CLPDF

[64] Modality Discrepancy Transformer for Ambivalence and Hesitancy Recognition cs.CL | cs.CVPDF

[65] Reflective Recovery: A Self-Supervised Method for Reasoning by Learning from Mistakes cs.CLPDF

[66] VisKG-LM: Compiling Knowledge Graphs into Visual Memory for Multiple-Choice Question Answering cs.CL | cs.IR | cs.LGPDF

[67] Advantage Scale Calibration Imbalance in Group-Relative Optimization under Low-Variance Rewards: Diagnosis and Bounded Recovery cs.CL | cs.LGPDF

[68] To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives cs.CLPDF

[69] Less Is More: Graph-free Multimodal RAG via Multi-signal Late Fusion cs.CLPDF

[70] CliniCIRCA: A Modular LLM Framework for Constructing Longitudinal Mental Health Patient Journeys from Raw EHR Narratives cs.CL | cs.AI | cs.IR | cs.LGPDF

[71] Chain-of-Thought Entropy as a Reliability Signal: A Preregistered Reproduction cs.CL | cs.LGPDF

[72] Learn Before You Judge: Progressive Knowledge-to-Decision Alignment for Explainable Hateful Meme Detection cs.CLPDF

[73] PetriBench: Benchmarking LLM Reasoning over Dynamic State Spaces cs.CL | cs.AI | cs.LOPDF

[74] Before the Arrest: Benchmarking LLMs on Criminal Profiling from Incomplete Evidence cs.CL | cs.CYPDF

[75] DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression cs.CLPDF

[76] The Public Discourse Corpus (PDC): A Speaker-Attributed Dataset for Valence and Epistemic Modality with Target Speaker Participation cs.CLPDF

[77] Lens: Bringing the Right Semantic Perspective into Focus for Training-Free Multimodal Representation Learning cs.CL | cs.AIPDF