cs.CV [Total: 138]
cs.CL [Total: 57]
cs.AI [Total: 10]
cs.CR [Total: 1]
cs.IR [Total: 4]
cs.LG [Total: 11]
cs.MM [Total: 3]
cs.RO [Total: 8]
cs.SE [Total: 3]
eess.AS [Total: 1]
eess.IV [Total: 2]
eess.SP [Total: 1]
hep-ph [Total: 1]

cs.CV [Back]

[1] Did You Steal My Shot? Pioneering Camera Motion Plagiarism Detection in Generative Videos cs.CV | cs.MMPDF

Chengguo Zhang, Ping Ping

TL;DR: 该研究为生成视频中的运镜模仿建立含 11 种风格的基准，并用光流加流体涡量构造表示，比最强基线提升 3.02 倍检测效果。

Details

Motivation: 运镜体现导演创意且需要专业设备，生成视频模型却可通过简单提示模仿高价值运镜。传统相似度检测主要看画面内容，训练数据又把运镜与内容纠缠；普通光流也难表示复杂相机运动。

Result: 作者构建首个运镜分析基准，含 11 种运镜风格及评测协议，并提出在光流基础上加入流体动力学涡量线索的运动表示。实验中，检测器对视频运镜抄袭的检测效果比最强基线提高 3.02 倍，在生成视频上同样有效。

Insight: 动态镜头本身可作为版权比较对象，应与主体内容区分；涡量为复杂运动结构提供了普通光流之外的可描述特征。

Abstract: Camera motion often reflects directorial intent and requires professional equipment, making it a high value form of intellectual property. However, generative video models can imitate such high value camera motions with simple prompts, while existing similarity detection methods mainly operate on visual content and fail to capture deeper motion similarity. This is mainly because their training data entangles camera motion with visual content. Moreover, traditional optical flow is insufficient to represent complex camera motions. We therefore build the first benchmark for camera motion analysis, including a motion dataset with \textbf{11} motion styles and evaluation protocols. Furthermore, we propose a motion representation that augments optical flow with vorticity cues from fluid dynamics, thereby better capturing motions. Experiments show that our detector achieves a \textbf{3.02*} improvement in plagiarism detection over the strongest baseline and remains effective on generative videos. We believe our work extends copyright protection beyond static content to dynamic camera motion.

Christian Gapp, Elias Tappeiner, Martin Welk, Karl Fritscher, Stephanie Mangesius

TL;DR: 该研究在卒中复发预测中比较 3D CTA 自监督预训练和不同微调冻结策略，发现预训练可缓解模态坍塌并增强图像与表格特征的协同。

Details

Motivation: 卒中复发预测需整合临床表格和影像，但模态不平衡可能使模型过度依赖主导来源、忽略互补信息。自监督预训练和部分冻结是否改善模态利用及跨模态关系尚未充分研究。

Result: 作者对两个多模态网络进行 3D CTA 自监督预训练，再采用两种冻结策略微调，并与既有基线及从零训练模型比较。自监督预训练更有效利用图像-表格数据，优于既有基线和所有未预训练模型；表现最佳的 ViT 模型成功避免单模态坍塌。协同分析还发现视觉表征与性别及冠心病变量存在显著交互，可能反映卒中复发的临床相关模式。

Insight: 自监督视觉预训练和策略化微调可能让模型更平衡地利用影像和临床表格；跨模态协同分析可揭示单模态分类无法呈现的临床关联。

Abstract: Multimodal stroke recurrence prediction requires effective integration of heterogeneous clinical and imaging data, yet modality imbalance often causes models to over-rely on dominant modalities and underutilize complementary information. While self-supervised pretraining and selective parameter freezing are commonly employed to improve representation learning and fine-tuning stability, their effect on modality contributions and cross-modal behavior in multimodal medical models remains largely unexplored. In this work, we investigate whether image pretraining on 3D CTA scans reduces modality imbalance and improves cross-modal integration for stroke recurrence prediction, a clinically critical task we recently addressed. To this end, two multimodal neural networks are pretrained in a self-supervised manner and subsequently fine-tuned using two distinct freezing strategies. Their performance and modality utilization are compared against both the baseline model from our previous work and models trained entirely from scratch in this study. Our results demonstrate that self-supervised pretraining enables more effective utilization of the multimodal image-tabular dataset, outperforming both the prior baseline and all non-pretrained models. Notably, the best-performing Vision Transformer based neural network successfully overcomes unimodal collapse. Synergy analysis reveals significant interactions between vision and both gender and CHD, suggesting clinically relevant patterns for stroke recurrence. Overall, our findings demonstrate that self-supervised pretraining and strategic fine-tuning support more balanced modality utilization and enable meaningful cross-modal interactions. Code is publicly available at https://github.com/ChristianGappGit/SSL_Pretraining.

[3] Rethinking Streaming Video Diffusion Model: Context, Execution, and Training cs.CV | cs.AIPDF

Hongchen Zhang

TL;DR: 论文建立流式视频扩散统一分析框架，比较不同历史条件策略、执行调度和训练方式，发现逐步历史可提高视频质量并用流水线加速。

Details

Motivation: 流式视频扩散的生成质量与计算效率取决于模型、采样器、历史条件、执行计划和训练策略，但这些因素间的计算依赖及训练-推理一致性缺少统一分析。

Result: 框架覆盖多种因果上下文选择策略，并比较干净历史、同噪声级历史和渐进历史。完整 VBench 提示集上，后两者总分分别为 85.24 和 85.60，高于干净历史基准的 84.45；长视频中渐进历史提升主体一致性和运动连贯性。允许并行处理多个去噪节点的渐进历史流水线，在所测条件下获得 1.57–2.83 倍稳定态 DiT 加速。DMD fake-score 网络 LoRA 只需全量适配 2.15% 的可训练参数也能改善质量。

Insight: 高质量流式生成不要求历史帧全部完全去噪；历史条件、流水线执行和训练策略应联合设计，以同时改善长视频一致性与吞吐。

Abstract: Understanding the design space of streaming video diffusion is essential to exploring its potential for generation quality and computational efficiency. We develop a unified analytical framework that relates model and sampler choices, historical conditioning, execution scheduling, and training strategies. The framework accommodates a broad family of causal context-selection policies and makes their computational dependencies and training-inference alignment explicit. Within this design space, we study three representative policies: clean, same-level, and progressive history. On the full VBench prompt set, same-level and progressive history achieve aggregate scores of 85.24 and 85.60, respectively, compared with 84.45 for the clean-history reference. Long-video comparisons further show improved subject consistency and more coherent motion with progressive history. By allowing multiple denoising nodes to be processed together, progressive-history pipelining achieves $1.57$-$2.83\times$ steady-state DiT speedups under our evaluated conditions. We additionally find that LoRA adaptation of the DMD fake-score network improves generation quality using only 2.15% as many trainable fake-score parameters as full-parameter adaptation. Together, these findings show that fully denoised history is not a prerequisite for high-quality streaming generation and motivate the joint design of historical conditioning, execution, and training.

[4] Validating, Not Sampling: Region-Level Robustness of Vision-Language and Vision-Language-Action Models cs.CV | cs.AIPDF

Bogdan Aron, Christopher Brix, Benedikt Brückner, Yanghao Zhang, Panagiotis Kouvaros

TL;DR: H²V-M 在连续亮度和相机旋转扰动区域内验证 VLM/VLA 鲁棒性，以带裕度的收敛规则减少模型查询并给出健全性保证。

Details

Motivation: 真实部署中相机图像的小扰动可能显著改变模型决策。现有鲁棒性基准只抽样测试扰动，无法保证未测区域不存在失败。

Result: 作者对六种 VLM 和五种 VLA 在完整连续亮度变化、相机旋转及组合几何/光度扰动区域进行首个区域级验证。基于 H²V 提出 H²V-M 裕度感知收敛规则，使 32B 模型验证可负担；相较原 H²V，查询数减少一个数量级，且比随机采样更快找到反例，同时提供健全性保证。结果显示鲁棒性主要依赖扰动类型而非具体模型；VLM 对大角度旋转比 VLA 更鲁棒，VLA 中仅 ±1° 扰动在许多情况下就会改变动作；鲁棒性与模型家族的关系大于参数规模。

Insight: 抽样未发现失败不等于整个扰动区域安全；形式化区域验证可提供更强保证，并揭示小角度视觉变化可能改变机器人动作。

Abstract: Vision-language models (VLMs) and vision-language-action models (VLAs) are increasingly deployed in real-world applications. There, a small perturbation to the recorded camera image may change a decision significantly. However, existing benchmarks for these models only sample perturbations, which does not guarantee the absence of a failure in the untested region. We present the first robustness validation of six VLMs (drawn from the Gemma, InternVL, LLaVA, and Qwen families) and five VLAs (drawn from the GR00T, OpenVLA, and $π$ families) over entire continuous regions of photometric and geometric image perturbation: brightness shifts, camera rotations, and their composition. To this end, we build on the validation framework H$^2$V and introduce H$^2$V-M, a margin-aware convergence rule that makes validation affordable at the 32B parameter scale. We demonstrate that H$^2$V-M outperforms H$^2$V by an order of magnitude in model queries and that it finds counterexamples faster than random sampling while providing soundness guarantees. Our VLM and VLA robustness validation shows that robustness is mostly dependent on the perturbation type, rather than the model, and that VLMs are more robust to large camera rotations than VLAs. For VLAs, even perturbations as small as $\pm1^\circ$ can change the commanded action in many cases. We also show that robustness depends more on model family than on model size.

[5] Authority-Preserving Evaluation of Medical Vision-Language Assistants cs.CV | cs.AIPDF

Flint Xiaofeng Fan, Cheston Tan, Yew-Soon Ong, Roger Wattenhofer

TL;DR: AuthEval 区分医学 VLM 建议与本地审核最终采取的行动，记录并按本地标准分别评分，只有数据支持时才报告权限交接造成的差距。

Details

Motivation: 皮肤病灶 VLM 可建议转诊紧急度，但当地服务机构要结合政策、容量和患者情境决定采纳或替换建议，因此模型提议质量与工作流最终行动质量不是同一评估目标。

Result: AuthEval 记录模型提议和本地选定行动，按声明的本地标准对选定动作评分；可行时也用同一规则评估被拒绝提议，并仅在记录充分时报告权威差距。差距取决于提议改变率与改变案例平均分数变化的乘积，因此仅报告改变比例无法确定差距大小或方向。ISIC 2019 上使用 MedGemma 和模拟审核时，相似改变率在容量约束下形成 +0.744 模拟单位的乐观图像等权差距，而安全约束下未检测到差距；混合约束下从图像加权改为病灶聚类加权，差距由 +0.374 反转为 -0.206。

Insight: 医学辅助系统评估须说明模型建议如何经过本地审核转成行动；权限交接影响可能随政策和评估单元改变方向，不能从采纳率单独推断工作流质量。

Abstract: Medical vision-language models can propose how urgently a skin lesion should be reviewed, but the local service retains authority to accept or replace that proposal under referral policy, capacity, and locally held patient context. Proposal quality and selected-action quality are therefore distinct evaluation targets, and benchmark evidence transfers between them only when local review preserves the expected action score. We introduce AuthEval, a logging and evaluation framework that records both actions, scores the selected action under declared local criteria, and, where feasible, scores the declined proposal under the same rule. It reports the resulting authority gap only when the record supports it. Because the gap is the product of the proposal-change rate and the mean score change on changed cases, that rate alone determines neither its magnitude nor its sign. On ISIC 2019, with MedGemma and simulated local review, two constraint regimes with similar change rates produced an optimistic image-equal gap under capacity ($+0.744$ simulator units) but no detectable gap under safety. The declared evaluation unit also mattered: under mixed constraints the gap reversed from $+0.374$ to $-0.206$ when weighting shifted from image to lesion-aware cluster. AuthEval thus clarifies whether a study’s records support claims about the model, the workflow, or both.

[6] GameReplica: A Benchmark for Black-Box Visual Game Replication by Vision-Language Agents cs.CV | cs.AIPDF

Boyu Qiao, Zixin Tang, Xiaoshuai Hao, Wenbo Li

TL;DR: GameReplica 评测视觉语言编程智能体仅凭截图和交互逆向推断游戏规则并生成可运行复刻，发现当前智能体更容易模仿画面而非机制。

Details

Motivation: 既有编程智能体基准通常已用文本、代码或示范说明目标行为，缺少黑盒条件下要求智能体通过视觉观察和主动交互学习系统规则并复现可验证程序的任务。

Result: GameReplica 是闭环基准，包含 25 个游戏、五类核心机制、125 项任务，每个游戏设五级难度。智能体只能通过截图和动作接口访问目标，需从像素反馈和交互结果归纳规则并生成可自动验证的独立游戏。Claude Opus 4.8 最佳整体分数为 71.6%，其他模型为 4.0%–42.9%。所有模型的视觉保真明显高于实现和规则一致性；难度从 L1 到 L5 时，较弱智能体性能陡降。变异验证表明，未验证的评测器会错误接受提交；网络开放还会出现智能体复制公开仓库代码。

Insight: 黑盒复刻要求的不只是视觉仿制，而是主动实验和规则归纳；评估器还需通过变异测试，并控制可访问的外部代码资源。

Abstract: Coding-agent benchmarks usually evaluate implementation after the target behavior has been specified in text, code, or demonstrations. Existing research has extensively evaluated the ability of coding agents to generate programs from textual specifications. However, under black-box conditions where neither source code nor documentation is available, it remains underexplored whether an agent can induce the rules solely through visual observation and active interaction and reproduce the target system as a verifiable executable system. To this end, we present GameReplica, a closed-loop evaluation framework for end-to-end black-box game replication that covers the full perception, exploration, induction, reproduction, and verification pipeline. GameReplica comprises 125 tasks spanning 25 games across 5 core mechanism families, with each game instantiated at five difficulty levels. The tasks require an agent to access the target game only through screenshots and an action interface, induce the key visual elements and gameplay rules from pixel feedback and interaction outcomes, and generate a self-contained, runnable game replica that can be automatically verified by an external program. Experiments show that current coding agents still face substantial challenges in end-to-end black-box replication: the best-performing model (Claude Opus 4.8) achieves an overall score of 71.6%, while the remaining models score only 4.0%–42.9%. Further analysis reveals a consistent pattern across all models: visual-fidelity scores are substantially higher than implementation- and rule-consistency scores, indicating that agents replicate visual appearance more readily than game mechanics. The difficulty levels further amplify the performance gap: from L1 to L5, the overall score of weaker agents drops sharply, whereas that of the best-performing agent declines only slightly.

[7] Yarn tracking of large-scale 3D textile reinforcements using topological material features cs.CV | eess.IV | eess.SPPDF

Hafsa El Herichi, Arturo Mendoza, Yanneck Wielhorski, Hugues Talbot, Stéphane Roux

TL;DR: 该方法在粗分辨率工业 CT 切片上建模纱线截面、三维连续性和邻接排列，以变分优化追踪大型风机叶片预制件中的三千余根经纱。

Details

Motivation: 高保真复合材料数值模拟依赖可靠 CT 分割标注；在分辨率较粗的工业 CT 中半自动追踪纺织增强结构，尤其大规模材料构件，仍具挑战。

Result: 方法沿主要纱线方向的正交平面逐切片分析，以尽量少训练实现可扩展跟踪。统计建模纱线典型截面形状、三维连续与运动，以及相对邻纱排列，并通过变分目标在连续横截面上联合优化纱线中心位置。在高于 140 微米分辨率的风机叶片干态预制件 X 射线 CT 上，跨 1,500 张切片追踪超过 3,000 根经纱，成功率超过 90%。

Insight: 将材料几何先验和相邻纱线布局一起纳入切片间优化，可在不依赖大量训练数据的情况下扩展复杂复合材料标注。

Abstract: Automated segmentation of CT images has become increasingly important to enhance the reliability of simulations through the generation of high fidelity numerical models. This study addresses the challenging task of semi-automatically tracking textile reinforcements in fan blade dry preforms using X-ray CT images captured at coarse resolutions (i.e., above 140 $μ$m). Our approach offers a scalable, slice-based analysis conducted on planes orthogonal to the main yarn directions, applied to a large-scale real industrial component. This enables accurate identification and tracking of yarn paths while requiring minimal training. The method models three key yarn properties statistically: their typical cross-section shape, their continuity and movement in the 3D space, and their spatial relative arrangement with respect to neighboring yarns. These statistical properties are integrated into a tracking framework via a variational formulation that optimizes all yarn center positions in successive cross-section planes. The method tracks more than 3,000 warp yarns across 1,500 slices and achieves a tracking success rate above 90%. Overall, this work demonstrates a promising approach toward large-scale, automated textile reinforcement annotation, paving the way for more efficient material characterization in complex composite structures.

[8] Hierarchical Aggregation of Semantic Uncertainty in 3D Scene Graphs cs.CVPDF

Carlos Cueto Zumaya, Iacopo Catalano, Wallace Moreira Bessa, Julio A. Placed

TL;DR: 该框架将检测置信度和场景图已有嵌入转为对象正确概率，并通过房间包含层级传播不确定性，提升对象检索及房间级断言可靠性。

Details

Motivation: 开放词汇三维场景图给对象节点存储视觉语言嵌入，却通常把所有节点视为同样可靠，机器人查询时无法辨别错误条目。部署时又无法反复采样模型、训练新模型或获取额外标签。

Result: 框架利用场景图现有检测置信度和嵌入，融合四种与对象级错误相对应的信号，将其转为模型 logit 尺度的概率，再以闭式形式沿包含层级传播到“房间含有某类别”的信念。无需新增感知或训练；对共享检测器和词汇的对象显式采用完全相关聚合，避免把同一系统性错误当成多份独立证据。在 HM3DSem 上相较先进场景图系统改善对象检索，并降低所读场景图房间级断言误差。

Insight: 不确定性传播必须考虑场景图条目之间的共同错误来源；忽略相关性会将重复错误计作独立证据，造成过度自信。

Abstract: Open-vocabulary 3D Scene Graphs (3DSGs) ground each object node in a vision-language embedding, yet they record every entry as equally certain, so a robot querying the map cannot tell which of its entries are unreliable. Estimators of semantic uncertainty could supply that distinction, but they require repeated sampling of a model, training, or held-out labels, none of which are available to a deployed system at query time. We present a framework that exploits the detector confidence and the embeddings a 3DSG already stores, converts them into a probability that an entry is correct, and propagates that probability through the containment hierarchy into a belief that a room contains a queried class. Four signals, each paired with the object-level error it indicates, are converted to probabilities at the logit scale learned by the vision-language model and combined in closed form with no additional perception or training. Objects sharing a detector and a vocabulary fail together, so the framework aggregates them in the fully correlated limit, where an aggregation under independence would treat one repeated error as repeated evidence. Evaluated on HM3DSem against a state-of-the-art 3DSG system, the framework improves object retrieval and lowers the error of the room-level assertions of the graph it reads.

[9] MarsRecon: Self-Supervised and Multimodal Surface Representations for Mars cs.CV | cs.AIPDF

Akshay Naik, Marius F. R. Juston, Jay Mahajan

TL;DR: MarsRecon 为奥林帕斯山 HiRISE 影像建立火星专用自监督视觉预训练和多模态检索流程，报告重建与检索指标并指出仍需下游地质验证。

Details

Motivation: 火星轨道高分辨率影像丰富，但地质标注稀少，限制监督表征学习；需要充分利用无标签地貌影像及地理文本、坐标和局部-全局上下文。

Result: 管线先校准 NASA PDS 数据，提取有效地理定位图块，再以无标签图像训练掩码自编码器。增加输入分辨率并过滤无效 token 后，主要阶段留出重建损失由 0.1751 降至 0.1342。随后冻结视觉编码器，将其特征与观测文本、坐标和局部-全局图像上下文对齐；最佳本地优先模型在留出集 image-to-text R@10 为 0.3787、text-to-image R@10 为 0.9161、local-to-global R@10 为 0.4350。

Insight: 该工作建立了面向火星影像的预训练和检索基线，但更广泛地质效用仍需裁剪重叠控制和下游地质评估来确认。

Abstract: High-resolution orbital imagery offers a rich record of the Martian surface, but sparse geological labels limit supervised representation learning. We present MarsRecon, a geospatially aware pipeline for learning visual and multimodal representations from HiRISE observations of Olympus Mons. The pipeline calibrates NASA Planetary Data System products, extracts valid georeferenced patches, and trains a masked autoencoder on unlabeled imagery. Increasing input resolution and filtering invalid tokens reduced held-out reconstruction loss from 0.1751 to 0.1342 in the principal Stage A model series. We then freeze the visual encoder and align its features with observation text, coordinates, and local–global image context. The strongest current local-primary model achieves image-to-text recall@10 of 0.3787, text-to-image recall@10 of 0.9161, and local-to-global recall@10 of 0.4350 on the held-out test split. These results establish a working Mars-specific pretraining and retrieval pipeline; further crop-overlap controls and downstream geological evaluations are needed to assess the broader utility of its embeddings.

[10] Event-Frame Fusion for Inter-Frame Segmentation via Event-Guided Motion cs.CVPDF

Dalia Hareb, Jean Martinet, Benoit Miramond, Elisabetta Chicca

TL;DR: 该混合视觉系统用小型脉冲网络估计事件运动，再以事件驱动网络在帧间插值分割，将语义分割频率提高到最高 500Hz。

Details

Motivation: 自动导航需要精准高效分割，但传统帧相机受运动模糊、眩光、延迟和 20–30 FPS 低时间分辨率限制，丢失帧间信息。事件相机时间精度高，却常在分割准确率上落后于帧方法。

Result: 系统融合常规帧与事件相机：42K 参数的紧凑脉冲神经网络估计运动，0.84M 参数事件驱动脉冲网络执行帧式语义分割，并利用帧间运动插值细化分割。由此预测帧间分割频率最高达 500Hz，每次推理能耗低于 1.87mJ；GPU 实时运行最高 200Hz。该方法还能补偿模糊或过曝帧的信息损失。

Insight: 帧提供稠密语义、事件提供高频运动变化，将两者分工融合可在低功耗下补全帧间感知，并增强困难成像条件的鲁棒性。

Abstract: Autonomous navigation requires precise and efficient semantic segmentation, yet existing frame-based approaches remain limited by motion blur, glare, latency, and the low temporal resolution (20-30 FPS) of conventional cameras, which leads to information loss between frames. Event cameras have emerged as an alternative sensing modality, capturing intensity changes asynchronously with high temporal resolution, high dynamic range, and sparse outputs. However, event-based algorithms still fall short of frame-based ones in accuracy, as most segmentation methods are designed for dense frame data. To overcome these limitations, we propose a hybrid vision architecture that combines conventional frame-based and event-based cameras. The system integrates two complementary components: (1) a compact Spiking Neural Network (SNN) with 42k parameters for motion estimation, and (2) a lightweight event-driven SNN with 0.84M parameters for frame-based semantic segmentation, which interpolates motion between frames to refine segmentation results. By predicting inter-frame segmentations, the framework achieves segmentation rates of up to 500 Hz with an energy consumption below 1.87 mJ per inference, while maintaining real-time GPU execution at frequencies up to 200 Hz. Additionally, our approach compensates for information loss in frames affected by blur or overexposure, enabling more robust perception in challenging conditions.

[11] Spatiotemporal Flux Probing for Single-Photon Videography cs.CVPDF

Jerry Yan, Matteo Forlivesi, Bowen Tan, Andrew Xie, Siddharth Somasundaram

TL;DR: 该方法从极稀疏光子到达的完整时空相关中直接估计强度傅里叶系数，恢复高速运动和照明变化，并可选择性聚焦指定运动。

Details

Motivation: 极少光子条件下重建动态场景高速视频很难。现有方法在局部时空窗口聚合光子以提高信噪比，却丢弃全局结构，低光时空事件都稀疏的场景下尤为受限。

Result: 作者提出时空通量探测理论和算法，利用光子到达的完整时空相关，直接从光子流估计底层强度傅里叶系数。方法用更少光子恢复高速运动和时间照明动态；还支持速度选择性摄像，自动将视频重新聚焦到检测到的特定运动，并能扩展到单光子、事件和脉冲相机等传感模态。

Insight: 稀疏观测中的有效运动和照明线索可能存在于完整时空图样，而非局部邻域；利用全局相关可突破局部聚合在极低光子率下的信息损失。

Abstract: We address the problem of recovering high-speed videos from dynamic scenes under extreme photon sparsity. Existing methods rely on aggregating photon detections in local spatiotemporal windows to improve signal-to-noise ratio; however, this local grouping discards global structure and fails in low-light regimes where photon detections are sparse in space and time. In this work, we show that the information needed to recover both motion and illumination is encoded in correlations over the full space-time pattern of photon arrivals. Building on this insight, we develop a spatiotemporal flux probing theory and an algorithm that estimates the Fourier coefficients of the underlying intensity directly from the photon stream. We demonstrate that our approach (1) recovers fast motion and temporal illumination dynamics with substantially fewer photons than prior methods, (2) enables velocity-selective videography that automatically refocuses video onto specific detected motions, and (3) generalizes across sensing modalities including single-photon, event, and spike cameras.

[12] Style as Cover: Deep Image Steganography via Stylized Transmission cs.CV | cs.CR | cs.MMPDF

Qi Li, Jidong Yang, Huaike Yu, Chunpeng Wang, Suo Gao

TL;DR: StyleStegaNet 将隐写从保持原封面外观改为基于公开风格参考的风格伪装传输，并用结构保持重建和渐进训练恢复密文。

Details

Motivation: 传统图像隐写要求含密图像尽量保留原封面，一旦原封面被泄露或能可靠近似，安全性会减弱；风格迁移虽可改变外观，却会破坏深度隐写依赖的特征统计。

Result: StyleStegaNet 将任务拆成含密图生成、风格化传输、保结构重建和密文恢复四阶段，通过三阶段渐进训练、频域小波约束和感知监督，使可恢复信息集中到归一化结构子空间。作者分析了密文可恢复性受该结构子空间限制的机制。在 DIV2K 和 MS-COCO 上实验有效；两种深度检测器进行少样本隐写分析时准确率约 51%，接近随机猜测。

Insight: 风格级行为伪装可降低与原图外观直接匹配的风险，但必须在传输变化后保留结构子空间里的可恢复信息；检测率接近随机仅限文中测试设定。

Abstract: Image steganography hides secret message within normal images, with most existing works relying on cover-preserving transmission. However, such a paradigm becomes vulnerable once the original cover is exposed or can be reliably approximated. In this paper, we propose StyleStegaNet, a stylized image hiding framework that replaces cover matching with style-concealment transmission. Instead of transmitting a cover-like stego image, StyleStegaNet generates stylized stego images conditioned on publicly available style references, redefining steganography invisibility from cover-preserving concealment to behavior-level camouflage based on style transformation. Such a setting poses a substantial challenge to reliable secret recovery, since neural stylization can significantly alter the feature statistics exploited by deep hiding methods. To address this challenge, StyleStegaNet decouples the overall task into four coordinated stages: stego generation, stylized transmission, structure-preserving reconstruction, and secret recovery. Moreover, StyleStegaNet is optimized with a progressive three-stage training strategy, in which wavelet-domain constraints and perceptual supervision guide the recoverable information toward structural representations. We further provide an analysis showing that secret recoverability is largely restricted to the normalized structural subspace, offering a mechanistic explanation for why directly stylized baselines fail and why a reconstruction-guided recovery path is necessary. Extensive experiments on DIV2K and MS-COCO datasets demonstrate the effectiveness of StyleStegaNet. And few-shot image steganalysis with two deep detectors further shows detection accuracy near random guessing, approximately 51%.

[13] Rethinking Vision Architectures with Gated Linear Attention and KAN cs.CVPDF

Ali Mehizel, Oussama Khaldi

TL;DR: LKAT 将分块门控线性注意力与径向基 KAN 前馈层结合，并实现 I/O 感知融合算子，探索视觉表征中的线性序列计算与可学习函数映射。

Details

Motivation: ViT 大部分参数用于通道混合 MLP，token 交互依赖二次复杂度 MHSA；线性注意力降低序列复杂度却仍搭配固定激活 MLP，而已有视觉 KAN 要么保留 MHSA、要么不使用注意力。

Result: LKAT 是各向同性 ViT 编码器，将分块 Gated Linear Attention 与两层 KAN 前馈结合，并为径向基网格映射提供 I/O 感知融合 kernel。在共享 DeiT 配方下与 ViT、ViT-5 和 MLP-Mixer 比较，LKAT-B 在 ImageNet-100 超过 ViT-B/16、ViT-5-B 和 Mixer-B/16；Tiny/Small/Base 版本在 CIFAR-10/100 上均有稳定扩展，ImageNet-100 预训练可迁移到 CIFAR 微调。

Insight: 门控线性注意力和 KAN 径向基函数可能提供互补归纳偏置，支持中等规模视觉表征学习；论文结果尚不等同于所有尺度下都优于标准 ViT。

Abstract: Vision Transformers allocate most parameters to multi-layer perceptrons (MLPs) for channel mixing, while token interactions usually rely on quadratic multi-head self-attention (MHSA). Linear attention reduces sequence complexity to O(N), but remains coupled with the same fixed-activation MLP as softmax Transformers. Kolmogorov-Arnold Networks (KANs) instead place learnable univariate maps on edges, yet prior vision KANs keep MHSA or omit attention entirely. We introduce LKAT (Linear Kolmogorov-Arnold Transformer), an isotropic ViT encoder that couples chunkwise Gated Linear Attention (GLA) with a two-layer KAN feed-forward, and we provide an I/O-aware fused RBF-KAN kernel for the radial-basis grid maps. Under a shared DeiT-style recipe we compare LKAT with ViT, ViT-5, and MLP-Mixer. LKAT-B exceeds ViT-B/16, ViT-5-B, and Mixer-B/16 on ImageNet-100. Tiny/Small/Base LKAT variants scale consistently on CIFAR-10/100, and ImageNet-100 pretraining transfers to CIFAR fine-tuning. The results support gated linear attention and KAN-based radial-basis functions as complementary inductive biases for mid-scale visual representation learning.

[14] Beyond the Leaderboard: Counterfactual Diagnosis of End-to-End and VLA Driving Policies Under Domain Shift cs.CV | cs.AIPDF

Ruolin Yang, Zilin Huang, Buoyue Wang, Zhengyang Wan, Yuhao Luo

TL;DR: 该研究以真实近行人驾驶帧的反事实编辑诊断六种端到端/VLA策略，分解其规划距离、避让、危险敏感、无关变化响应等行为，而非只看排行榜分数。

Details

Motivation: 驾驶策略的排行榜只报告总体结果，难预测更换地点后的行为。反事实场景变化可测策略为何响应或不响应，但既有评测难区分真正危险敏感与其他行为。

Result: 作者将 246 个 NAVSIM 近行人场景分别编辑为移除行人或夜景式光照改变，并用独立检测器验证编辑，再分析规划轨迹变化，构成五项行为检查。在行人位于规划路径的样例中，只有 1.9% 响应是真正避让；开放环协议下各策略的中位间隙变化至多 0.03 米、规划距离变化至多 0.08 米。左舵到右舵预注册迁移实验中，暴露和特异性排序、光照结论及碰撞结果可迁移，但数值和危险敏感判定不可迁移。不同策略有不同安全画像，且验证成本从几十帧到数百帧不等。

Insight: 总体分数可能掩盖“走得短所以安全”与“识别危险并主动避让”等不同机制；反事实诊断可揭示行为原因，但需说明跨域可迁移和帧数成本。

Abstract: End-to-end and vision-language-action (VLA) driving policies are compared by leaderboard rank, but a rank reports an outcome, not the behaviour behind it, so it predicts poorly how a policy will behave at a new site. On six released policies, rank on nuScenes open-loop error or on NAVSIM’s leaderboard does not carry over to scenes with a pedestrian near the ego corridor at a new site. We propose a counterfactual check-up: a few hundred real frames, each edited two ways (pedestrian removed, or re-lit by a night-style perturbation), every edit verified by an independent detector, and the change in the planned trajectory read as a diagnosis rather than a score. From these edits two causal axes are read, and five exams built on them separate what a score merges: how far the policy plans to drive, whether seeing the pedestrian buys safety, whether that response scales with danger, whether the plan moves when nothing requires it, and how much an irrelevant lighting change moves it. On 246 NAVSIM near-pedestrian scenes, in the cells where the pedestrian lies on the planned path only 1.9% of responses are genuine avoidance, and under our open-loop protocol the median clearance change is at most 0.03 m and the median change in planned distance at most 0.08 m for every policy. In a pre-registered test from left- to right-hand drive, the exposure and specificity orderings, the lighting verdict and the collision outcome transfer, while point values and the hazard-sensitivity verdict do not. Read as a selection report, the profiles say which policy is safe because it plans short, which covers a human-like distance without yielding, and which is unsteady under a change that requires no reaction, and they price each verdict: most settle within a few dozen frames, hazard sensitivity needs hundreds. Code and edited frames will be released.

[15] Seeing is not Enough: Vision-Language Models Perceive Evidence but Fail to Act cs.CV | cs.AIPDF

Yuyang Dai, Bofei Huang, Hongbo Zhang, Haoran Xie

TL;DR: VPAC-Bench 区分视觉证据未识别和证据未影响决策两类错误，发现 VLM 常能辨认候选却仍过度选定，并在决策边界对齐的流程先验下明显改善。

Details

Motivation: VLM 在视觉问答表现强，但有时会作出与自己已正确识别的图像证据矛盾的决定。仅看最终准确率无法区分感知失败与证据未约束决策的过程失败。

Result: VPAC-Bench 覆盖九类真实图像流程，每张图标注当前活动阶段及临近阶段转换；作者提出状态-相关性-目标 SRT 结构化流程先验干预。多个 VLM 中，模糊案例即使模型正确列出视觉候选，仍有超过 95% 过度确定单一答案。显式流程干预将该比例降至 13% 以下，且不损害无歧义样例；但通用 SRT 是否优于强 CoT 基线因模型而异。当相关阶段转换已知时，边界对齐的 SRT 在装配、物理状态变化、导航交通和物体用途任务上超过通用流程提示及全部测试 CoT 基线。

Insight: 视觉证据是否进入决策过程，是独立于识别能力的失败环节；流程先验只有对准当前场景的决策边界时，才稳定带来收益。

Abstract: Vision-language models (VLMs) perform strongly on visual question answering benchmarks, yet often make decisions that contradict visual evidence they have already identified correctly. We distinguish perceptual failure, where relevant evidence is not recognized, from process failure, where recognized evidence fails to constrain the final decision. We introduce VPAC-Bench, a benchmark spanning nine real-image process families, with each image annotated by its current activity stage and nearby stage transition. We also propose State-Relevance-Target (SRT), a family of structured process-prior interventions that requires models to connect visible evidence to the relevant process state before answering. Across multiple VLMs, process failure is widespread: models that correctly enumerate visual candidates still over-commit to a single answer in more than 95% of ambiguous cases. An explicit process-structured intervention reduces this rate to below 13% without degrading performance on unambiguous cases. However, the transfer of process priors is model-dependent, and generic SRT does not consistently outperform strong chain-of-thought baselines. When the relevant stage transition is known, boundary-aligned SRT substantially outperforms generic process prompting and all tested chain-of-thought baselines across assembly, physical state transition, navigation and traffic, and object-use affordance tasks. These results show that process priors are most useful when aligned with the scene’s specific decision boundary, motivating boundary-aware prior selection for process-grounded visual reasoning.

[16] ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models cs.CVPDF

Qianxun Xu, Xianfang Zeng, Xinyao Liao, Wei Cheng, Gang Yu

TL;DR: ConsistWorld 从共享静态场景图像生成多智能体相机控制视频，用位姿条件记忆检索历史观测、用可见性门控分享并行视图证据。

Details

Motivation: 自回归视频世界模型通常面向单一观察者；扩展到多个独立控制视角时，需要跨相机视图和长时间间隔保持一致，同时支持因果流式生成。

Result: ConsistWorld 由一张共享场景图像生成多智能体相机控制视频。位姿条件记忆检索从所有智能体的历史中选择相关观察，找回最近上下文窗口以外的信息；可见性门控同伴共享则根据估计历史覆盖和当前视角重叠调节并行生成视图的信息。两者共同决定哪些历史数据进入上下文，以及同伴视图在哪些位置提供信息，并依赖相机几何、对固定智能体数和检索预算维持有界上下文。在证据共享、视频长度及智能体数量泛化实验中，模型实现较强跨时间和跨智能体一致性，同时保持有竞争力的生成质量。

Insight: 多视角一致性依赖有选择的证据路由：历史视角负责长期记忆，当前同伴视角负责并行互补；门控应结合相机几何和场景可见性。

Abstract: Autoregressive video world models enable temporally coherent generation for a single observer. Extending them to multiple agents requires consistency across independently controlled views and temporal gaps under causal streaming. We present ConsistWorld, a multi-agent world model that generates camera-controlled video streams of a static scene from one shared image. We formulate consistency as routing evidence from committed multi-agent history and concurrently generated peer views to the tokens being generated. Pose Conditioned Memory Retrieval selects relevant historical observations from all agents, recovering evidence beyond the recent context window. Visibility-Gated Peer Sharing regulates current peer information according to estimated historical coverage and current-view overlap. Together, they determine which historical observations enter the context and where concurrent peer information contributes, supporting long-term recall and coordinated exploration. Both mechanisms use camera geometry and maintain a bounded active context for a fixed agent count and retrieval budget. Experiments on evidence sharing cases and video length and agent number generalizations show that ConsistWorld achieves a strong cross-time and cross-agent consistency while preserving competitive generation quality.

[17] ZIL: Zero-shot Image-to-LiDAR Registration cs.CVPDF

Zijun Li, Xiaotian Sun, Xuelun Shen, Yao Dai, Sheng Ao

TL;DR: ZIL 是零样本非同步图像到激光雷达配准基础模型，统一编码图像与点云并预测三维坐标；跨数据集泛化还需相机内参与雷达竖直原点归一化。

Details

Motivation: 现有图像-LiDAR 配准方法多假设同一时刻输入，难处理相隔较远帧；还常依赖特定领域训练，无法泛化到新场景。

Result: ZIL 使用视觉 Transformer 和点云 Transformer 编码输入，除相对位姿外还预测三维坐标，从而在不增加标注的情况下改善位姿精度。作者发现简单混合多数据集训练不足以产生零样本泛化，需归一化相机内参和 LiDAR 垂直轴原点。在七个公开数据集、140 万帧 LiDAR 上训练后，单一模型在五个域内及零样本基准持续超过此前先进方法，平移误差最多降低 87%、旋转误差最多降低 76%。

Insight: 跨传感器泛化不只依赖数据多样性，还受相机和雷达坐标系统一影响；联合预测三维点为位姿配准增加了有效几何监督。

Abstract: Image-to-LiDAR registration estimates the camera pose of an image with respect to a LiDAR point cloud. It has diverse applications in autonomous driving, robot navigation etc. However, state-of-the-art (SOTA) methods still 1) mostly assume same-frame inputs, struggling with the image and point cloud from distant frames; 2) rely on domain-specific training, failing to generalize to unseen scenarios. We propose ZIL, the first foundation model for zero-shot non-synchronized image-to-LiDAR registration. ZIL encodes the input image and point cloud with the Vision and Point Transformers. In addition to regressing the relative pose, ZIL also learns to predict 3D coordinates, which substantially improves the pose accuracy without additional annotations. Interestingly, naive mix-data training cannot enable zero-shot generalization, which requires normalization on both camera intrinsics and the LiDAR vertical-axis origin. Trained on 7 public datasets with 1.4M LiDAR frames, ZIL consistently and significantly outperforms previous SOTA with a single model across 5 in-domain and zero-shot benchmarks, reducing the translation and rotation errors by up to 87% and 76% (shown in Fig. 1). Code and models are available at https://github.com/ZijunLi7/ZIL.

[18] Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modeling cs.CV | cs.AIPDF

Xi Cheng, Chenxi Zhai, Hang Cheng, Mingyu Fan, Pingfa Feng

TL;DR: Vision2CAD 将 VLM 推理与确定性 CAD 内核操作结合，提供基于 ID 的几何引用、坐标转换和投影边定位以建立稳定参数依赖。

Details

Motivation: 参数化 CAD 生成需几何精确并保持特征依赖，但现有方法难稳定选择几何引用、解释草图平面局部坐标或约束投影外部几何。

Result: Vision2CAD 是视觉智能体框架：ID 接口显式选择几何，局部坐标桥将视图坐标转换为草图坐标，投影边定位支持外部草图约束，在支持的建模操作和约束类型中建立特征依赖。作者构建 GERD 数据集，逐步对齐建模命令、几何状态和 ID。在 GERD-EVL 和 DeepCAD 子集上，mIoU 分别提高 11.1% 和 5.6%，Chamfer 距离分别降低 17.3% 和 41.8%；参数编辑实验和消融还验证参数依赖保持。

Insight: VLM 可负责视觉和语义理解，精确 CAD 几何引用应由显式 ID 和确定性内核操作保证；这种分工能提升几何质量并保留可编辑参数链。

Abstract: Generating parametric CAD models requires accurate geometry and stable feature dependencies. Existing methods face challenges in selecting geometric references, interpreting sketch-plane local coordinates, and establishing sketch constraints to projected external geometry. We present Vision2CAD, a visual agent harness that combines vision-language model (VLM) reasoning with deterministic CAD kernel operations. An ID-based interface supports explicit geometry selection, a local-coordinate bridge converts view coordinates into sketch coordinates, and projected-edge localization supports external sketch constraints. These mechanisms establish feature dependencies within the supported modeling operations and constraint types. We also introduce the Geometry Explicit Reference Dataset (GERD), which aligned commands, geometry states and IDs at every modeling step. On GERD-EVL and a DeepCAD test subset, Vision2CAD improves mIoU by 11.1% and 5.6% and reduces Chamfer distance by 17.3% and 41.8%, respectively. Parameter-editing experiments and ablation studies further proved the preservation of parametric dependencies.

[19] DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Models cs.CVPDF

Fengcheng Yu, Dhruv Parikh, Junjie Ye, Maulik Bhatt, Thang Vu

TL;DR: DriveReferee 从相机预测场景几何状态，再直接执行碰撞和可行驶区域规则，为驾驶世界动作模型筛选更安全轨迹，而不学习判决器。

Details

Motivation: 驾驶世界动作模型共同生成未来视频和车辆动作，但动作分支主要通过专家模仿训练，缺少闭环几何安全判定。仿真评估器有真实场景状态，却部署时不可用；学习式验证器则需要大量有标签训练数据。

Result: DriveReferee 用学习的几何读出从相机估计场景表示，再显式执行几何安全规则，例如判断 ego footprint 是否与车辆空间重叠。训练时在真值状态上为自采轨迹评分并将偏好蒸馏给策略；部署时在预测场景状态上评估生成轨迹，必要时选择更安全方案。相同候选和推理预算下，解析裁判匹配或超过学习验证器和启发式基线；给定相同状态和轨迹，学习判决本身没有可测下游增益。完整 NAVSIM navtest 上，单相机、无外部训练数据的 PDMS 为 92.02。

Insight: 若安全规则本身明确，优先学习难以观测的场景状态、直接执行规则，比另训一个判决器更透明且省标注；系统瓶颈因此落在状态估计而非规则学习。

Abstract: Generative world-action models (WAMs) jointly generate future video and vehicle actions, while their action branches remain primarily optimized by expert imitation. Yet imitation provides no explicit closed-loop geometric verdict for generated trajectories, making verification important during both training and deployment. Closed-loop evaluators can check collision and drivable-area violations, but require privileged scene state unavailable at deployment. Existing approaches often close this gap by learning a verifier from sensor features. For these geometric checks, the rule itself is explicit. For example, collision is determined by whether the rolled-out ego footprint overlaps occupied vehicle space. What is unavailable at deployment is the scene state needed to apply the rule. We introduce DriveReferee, which uses a learned geometry readout to predict the scene representation from camera observations and executes the geometric safety rule directly rather than learning it. The resulting analytic referee evaluates collision and drivable-area safety from a scene state and candidate trajectory. During training, it scores self-sampled trajectories on ground-truth state and distills the resulting preferences into the WAM policy. At deployment, the same referee evaluates generated trajectories on this predicted state and selects a safer alternative when needed. The analytic referee requires no verdict-specific training, and its decisions follow an explicit geometric rule. Under matched candidates and inference budgets, it matches or outperforms all learned-verifier and heuristic baselines. Given the same predicted state and trajectory, learning the verdict provides no measurable downstream gain despite requiring tens of thousands of evaluator-labeled training examples. On the full NAVSIM navtest, DriveReferee reaches 92.02 PDMS with single-camera visual input and no external training data.

[20] Human-Level Accuracy, Non-Human Strategies: Revealing Model-Human Divergence in Video Physical Reasoning cs.CV | stat.APPDF

Fanhong Li, Shurui Zheng, Zi Yin, Junbo Cui, Lei Ji

TL;DR: 研究以群体分布比较物理推理模型和人类，发现 V-JEPA2 总准确率仅落后约 1 点，却有远高于人类间差异的 26.4% 判断分歧和非人类策略。

Details

Motivation: 视频基础模型在物理推理基准上可达接近人类的准确率，但这类任务需预测不可观察结果；准确率无法说明模型是在做类似人类的前向模拟，还是利用可见场景统计规律。

Result: 作者提出将模型随机种子和人类评审者作为总体的分布式评测框架，比较一致性、不确定性和策略。在 Physion 上评估 V-JEPA2、VideoMAEv2、DINOv2 三种 ViT-L；V-JEPA2 准确率 73.2% 对人类 74.2%，差距约 1 个百分点，但模型-人类分歧为 26.4%，远高于人类-人类的 4.8%，κ 约 0.48 对 0.91。模型在几何连接推理高 11.8 点，却在滚动重力和多米诺因果链分别低 11.8 和 10.5 点；三种架构均呈现非人类策略。

Insight: 达到人类级整体准确率不代表具有类似人类的物理推理策略；按任务类型及人类共识分布比较，可揭示模型依赖场景统计线索而非显式前向模拟的差异。

Abstract: Video foundation models now reach human-level accuracy on physical-reasoning benchmarks, yet such tasks require predicting unobserved physical outcomes. Do these models perform human-like forward simulation, or do they exploit statistical regularities in visible scenes? Accuracy alone cannot distinguish these strategies. We introduce a distributional evaluation framework that treats model seeds and human raters as populations, enabling comparison of consensus, uncertainty, and strategy. On the Physion benchmark, we evaluate three ViT-L architectures (V-JEPA2, VideoMAEv2, DINOv2). V-JEPA2 narrows the accuracy gap to ~1 percentage point (73.2% vs. 74.2%), yet model-human disagreement reaches 26.4%, far exceeding human-human disagreement (4.8%), with substantially lower agreement (kappa ~ 0.48 vs. 0.91). The divergence follows forward-simulation demands: models outperform humans on geometric reasoning (linking, +11.8 pp) but underperform on gravitational dynamics (rolling, -11.8 pp) and causal chains (dominoes, -10.5 pp). Strategy fingerprinting confirms all three architectures share non-human strategies while none aligns with humans. Attribution analysis suggests that unobservable outcome features, rather than visible scene properties, predict this divergence, consistent with models relying more on scene-level statistical regularities than on explicit forward simulation, a systematic divergence that accuracy alone cannot reveal. Code is available at https://github.com/fanhong-li/model-human-divergence.

[21] PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining cs.CVPDF

Zelin Jia, Zhao Zhang, Zhicong Tang, Yuhui Yuan, Shixia Liu

TL;DR: PixelART 从零训练像素空间 rectified-flow Transformer，将单张图像分解为可编辑 RGBA 图层，并通过高噪声时间步加强图层分配训练。

Details

Motivation: 图像转图层可支持设计流程中的元素级编辑。现有扩散方法通常依赖大型文生图预训练、RGBA 自编码器和可变图层专用模块，训练及推理负担较大。

Result: PixelART 直接对区域 RGBA 像素 patch 去噪，使用单流多模态扩散 Transformer，不用 RGBA-VAE、预训练 T2I 骨干或图层专用解码器。作者发现高噪声时间步决定图层分配及粗结构，低噪声主要精修颜色、透明度、纹理和边界，因此提出终端增强时间步采样。用 400 万多图层设计模板训练后，在 Design-Multi-Layer-Bench 和 LICA 达到先进分解与合成重建效果；相较 Qwen-Image-Layered，参数少 80% 以上、延迟低 98%、内存低 85%。

Insight: 图层归属主要在生成早期确定，因此训练应覆盖高噪声阶段；该任务并不一定需要大型文生图预训练，像素空间模型也可高效生成结构化编辑结果。

Abstract: Image-to-layer decomposition converts a flattened image into editable RGBA layers, enabling element-level editing in design workflows. Existing diffusion-based systems typically adapt large pretrained text-to-image (T2I) models and introduce RGBA autoencoders or variable-layer architectural modules. We revisit this design choice and ask whether layer decomposition truly requires these heavyweight components. We introduce PixelART, a pixel-space rectified-flow Transformer trained from scratch for image-to-layer (I2L) decomposition. PixelART directly denoises regional RGBA pixel patches using a single-stream multi-modal diffusion Transformer, avoiding RGBA-VAEs, pretrained T2I backbones, and layer-specific decoders. We identify a key property of the task: high-noise timesteps determine layer assignment and coarse layer organization, while low-noise timesteps mainly refine color, alpha, texture, and boundaries. Based on this observation, we propose a terminal-boosted timestep sampling strategy to increase training coverage in the high-noise layer assignment regime. Trained on 4M multi-layer design templates, PixelART achieves state-of-the-art layer decomposition and composite reconstruction on Design-Multi-Layer-Bench and LICA with over 80% fewer parameters, 98% lower latency, and 85% lower memory than the recent Qwen-Image-Layered model. Ablation experiments show that pixel-space $\mathbf{x}$-prediction, terminal-boosted timestep sampling, and data/model scaling are critical, while T2I pretraining brings marginal benefits to the I2L task.

[22] Planning-Aligned Pretraining of BEV Representations with Sparse Action-Conditioned Targets for End-to-End Autonomous Driving cs.CV | cs.AIPDF

Jaeha Song, Soonmin Hwang

TL;DR: PAVER 用稀疏、动作条件化风险与未知区域目标预训练 BEV 编码器，使表示更直接服务于候选驾驶动作规划。

Details

Motivation: 端到端驾驶需要与规划相关的鸟瞰表示，但既有预训练常依赖任务标注或稠密场景重建，训练成本高且监督未必聚焦动作安全几何。

Result: PAVER 从单帧 LiDAR 构造沿规则化自车运动的稀疏风险及未知证据目标，用仅 1 万参数的头从动作条件化掩码 BEV 特征预测目标，不需驾驶任务标注或稠密重建。只迁移 BEV 编码器，保留下游结构及相机推理。在 nuScenes 上，VAD-Tiny 平均碰撞率从 0.51% 降至 0.19%，规划 L2、运动预测、检测和建图也改善；选定调度的估算总训练时间比从零训练少约 36%。Bench2Drive Town05 Long 上，UniAD-Tiny 驾驶得分从 48.45 提至 58.79。

Insight: 面向规划的稀疏动作条件目标可把几何预训练对准候选自车运动风险，并将 LiDAR 学得的表示迁移至相机-only 推理。

Abstract: End-to-end driving requires planning-relevant bird’s-eye-view (BEV) representations, but existing pretraining approaches often rely on task annotations or dense scene reconstruction. We introduce PAVER, Planning-Aligned BEV Encoder Pretraining. From a single LiDAR sweep, PAVER constructs sparse risk and unknown targets describing occupied and unobserved evidence along rule-based ego motions. A 10K-parameter head predicts these targets from masked BEV features conditioned on the action state, directing supervision toward geometric constraints on candidate motions. Pretraining requires no driving-task annotations or dense reconstruction. Only the BEV encoder is transferred, preserving the downstream architecture and camera-only inference. On nuScenes, PAVER reduces VAD-Tiny’s average collision rate from 0.51% to 0.19%, while improving planning L2, motion prediction, detection, and mapping. The selected VAD-Tiny and VAD-Base schedules use about 36% less estimated total training time than scratch training, including pretraining. On Bench2Drive Town05 Long, PAVER improves UniAD-Tiny’s closed-loop Driving Score from 48.45 to 58.79. The project page is available at https://archiiive99.github.io/PAVER.

[23] SatOV: Restoring Spatial Priors for Training-Free Open-Vocabulary Segmentation in Remote Sensing Imagery cs.CV | cs.AIPDF

Changhao Zhao, Linglin Zeng, Hai Liu

TL;DR: SatOV 通过中间层自注意力恢复结构空间先验，再用原始高分辨率 RGB 引导上采样恢复细节，实现无需训练的遥感开放词汇分割。

Details

Motivation: 通用视觉语言基础模型多按图像级分类设计，深层特征变换会削弱高分辨率遥感图像所需的空间关系，降采样还丢失精细边界。

Result: SatOV 是训练免开放词汇遥感分割框架，从两个阶段恢复空间先验。ResQQ 从 CLIP 中间层提取 Query-Key 自注意力，并与末层 Query-Query 注意力残差融合，恢复被末层表征压制的结构关系；SatUp 用原始高分辨率 RGB 作为空间引导，结合空间特征调制和引导交叉注意力重建像素级纹理与边界。在 DOTA、UDD、LoveDA 和 Vaihingen 上持续改善训练免 OVS，量化及定性表现与先进方法具竞争力。

Insight: 开放词汇遥感分割的主要短板不仅是语义类别，还包括空间先验和高分辨率细节；分别在表征层和空间分辨率层恢复它们可互补改善结果。

Abstract: Open-vocabulary semantic segmentation (OVS) of remote sensing imagery is a challenging pixel-level task requiring strong generalization and adaptation to the spatial characteristics of remote sensing data. Although existing vision-language foundation models perform well in general domains, their image-level classification design weakens the spatial priors needed for high-resolution remote sensing segmentation: structural spatial relations are degraded during deep feature transformation, and fine-grained spatial details are lost during downsampling. To address these complementary deficiencies, we propose SatOV, a training-free framework for open-vocabulary remote sensing segmentation that restores spatial priors at two stages of the representation pipeline. Specifically, Residual QQ Attention (ResQQ) extracts Query-Key self-attention from an intermediate CLIP layer and fuses it with final-layer Query-Query attention via a residual combination, restoring structural spatial priors suppressed by the final-layer representation. Spatially Modulated Upsampling (SatUp) uses the original high-resolution RGB image as spatial guidance, combining spatial feature modulation with guided cross-attention to reconstruct pixel-level textures and boundaries. Extensive experiments on DOTA, UDD, LoveDA, and Vaihingen show that SatOV consistently improves training-free OVS and achieves competitive quantitative and qualitative results against state-of-the-art methods. These results validate the effectiveness of restoring spatial priors at both the representation and spatial-resolution stages for remote sensing open-vocabulary segmentation.

[24] Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentation cs.CVPDF

Serin Varghese, Fabian Hüger, Kira Maag

TL;DR: 该免训练 OOD 分割方法用基础分割模型的置信度生成稠密异常分数，再以单目深度提供互补几何线索。

Details

Motivation: 自动驾驶在开放世界会遇到未知动物、散落货物等分布外物体，可靠定位对安全决策重要。既有方法常需要 OOD 训练样本、重训分割骨干或专用辅助网络。

Result: 方法直接利用基础分割模型的置信预测构造稠密 OOD 分数，无需任务微调或异常样本；再将单目深度几何信息加入判断，以补充不确定性线索。作者在 SegmentMeIfYouCan 基准评估，并测试视频 OOD 跟踪，反映时序感知特点；在以道路为中心的基准上表现良好。

Insight: 分割模型现成置信度可与单目几何作为免训练 OOD 信号组合，覆盖静态分割和视频跟踪场景；摘要未提供精确量化指标。

Abstract: Autonomous vehicles operating in open-world scenarios are inevitably confronted with previously unknown objects, such as exotic animals or loose cargo. The reliable detection and segmentation of these out-of-distribution (OOD) objects is therefore crucial for a safe understanding of the environment and decision-making. Most existing approaches require access to OOD training samples, retraining of the segmentation backbone, or dedicated auxiliary architectures, limiting their practical applicability. We propose a training-free method that derives dense OOD scores directly from the confidence predictions of a foundation segmentation model, without any task-specific fine-tuning or access to anomalous data. To improve the robustness of our OOD segmentation, geometric information from monocular depth estimation is incorporated into the decision process, providing complementary cues to uncertainty-based predictions. We evaluate the proposed method on the SegmentMeIfYouCan benchmark and additionally assess its performance on OOD tracking in video sequences, reflecting the temporal nature of real-world perception systems. The method performs strongly on road-centered benchmarks.

[25] AVTR-1: Open Stack for Real-Time Interactive Avatars cs.CV | cs.AI | cs.LGPDF

Artem Kravtsov, Dmitrii Ziganshin, Vsevolod Poletaev, Gleb Balitskiy, Anastasia Tikhonova

TL;DR: AVTR-1 将双人音频条件动作生成器接入同步实时音视频栈，处理外部语音代理驱动、帧调度和打断，并提出衡量说话者语音贡献的 R-DGG。

Details

Motivation: 说话头像和双人模型虽能实时生成动作，但真实互动还要与外部语音代理同步、安排视频播放并应对插话；仅追求动作生成速度不足以形成对话系统。

Result: AVTR-1 以 1.53 亿参数自回归 flow-matching 动作生成器为核心，根据双方音频生成动作，并用自蒸馏适配流式音频编码。堆栈将分块生成转为由外部语音代理驱动的连续同步音视频流，分析延迟贡献并以两种商业语音代理验证。相比同类双人系统，所报视觉质量指标和多数聆听-动作指标领先，口型同步具竞争力，且可在数据中心和消费级 GPU 实时运行。作者提出 R-DGG，衡量在控制听者历史和说话者动作后，说话者语音带来的额外预测信息；记录听者及所有测试双人系统有统计支持依赖，而无配对音频头像和错配说话者-听者对没有。

Insight: 互动头像需要把动作质量与系统级同步、延迟和打断处理共同设计；R-DGG 还能检查生成动作是否真正响应对话方语音，而不只与听者历史一致。

Abstract: Talking-head and dyadic models now achieve real-time inference, yet fast motion generation alone does not produce an interactive conversation. A live system must synchronize the model’s output with speech from an external voice agent, schedule video frames for playback, and handle interruptions. We introduce AVTR-1, an open stack for real-time interactive avatar conversations, built around a compact 153M-parameter autoregressive flow-matching motion generator conditioned on both participants’ audio. We adapt its audio encoder for streaming through self-distillation. The stack turns the model’s chunk-based generation into a continuous, synchronized audio-video stream driven by an external voice agent, and we analytically derive its contribution to the user-facing latencies and validate the resulting bounds with two commercial voice agents. Further experiments demonstrate that AVTR-1 leads the compared dyadic systems on all reported visual-quality metrics and most conventional listening-motion metrics while remaining competitive in lip synchronization. Its inference runtime operates in real time on data-center and consumer GPUs. However, conventional listening metrics do not establish whether the paired speaker’s speech contributes to generated motion. We therefore introduce the Reference-Based Directed Granger Gain (R-DGG), which measures the additional predictive information carried by speaker speech after accounting for listener history and speaker motion. R-DGG finds statistically supported predictive dependence for recorded listeners and all evaluated dyadic systems, but not for talking-head generators without paired audio or mismatched speaker-listener pairs. We release the model weights, renderer, and serving backend under component-specific licenses.

[26] Scout: Open-World Species Recognition on the Edge cs.CV | cs.DC | cs.LGPDF

Mohammad Mehdi Rastikerdar, Hui Guan, Deepak Ganesan

TL;DR: Scout 让边缘设备间歇调用云 VLM 识别新物种，再将物种知识转为现场专属轻量识别能力，减少持续上传图像的能耗。

Details

Motivation: VLM 可识别部署时未知物种，却难直接在低算力边缘设备运行；将每张图片送云端虽可用但消耗带宽和通信能量。野生动物相机陷阱会自然遇到未知类别。

Result: Scout 是自主开放世界物种识别系统，只需部署位置和空站点帧，间歇调用云 VLM 并将识别物种转化为紧凑边缘模型的持续站点条件能力，无需预定义物种列表、人工标注或手工调参。在三个地区 30 个相机陷阱部署、NVIDIA Jetson Orin Nano 上，准确率仅比预先提供物种清单的模型低 0.1–2.5%；对初始类别集之外的物种，Scout 准确率为 53.7%–59.1%，云全卸载为 56.5%–65.1%，但部署能耗少 59%–71%。

Insight: 把云端开放词汇识别转化成边缘端可累积的站点级类别，可在接近云识别性能的同时减少长期上传能耗。

Abstract: Large vision-language models (VLMs) enable recognition beyond a fixed class set, but their computational demands prevent them from running on many edge devices. Cloud offload makes this capability accessible, but sending every image consumes scarce bandwidth and communication energy. We ask how to bring the open-world recognition capability of VLMs to the edge while operating within tight compute, energy, and bandwidth budgets. Wildlife monitoring provides a natural setting for exploring this question because camera traps encounter species not known at deployment. We present Scout, an autonomous open-world recognition system that invokes a cloud VLM intermittently to teach new classes to a compact edge model. Given only the deployment location and empty site frames, Scout autonomously turns each species identified by the VLM into persistent, site-conditioned recognition capability in a resource-efficient edge model, without a predefined species list, human labeling, or manual tuning. Across 30 camera-trap deployments in three regions on an NVIDIA Jetson Orin Nano, the accuracy of Scout remains within 0.1-2.5% of a model given a predefined species list. On species outside its initial class set, Scout achieves 53.7-59.1% accuracy, compared with 56.5-65.1% for full cloud offload, while using 59-71% less deployment energy.

[27] An Evolutionary Agentic Approach for Open-ended Image Quality Perception cs.CV | cs.AIPDF

Zhenchen Tang, Bo Peng, Zichuan Wang, Songlin Yang, Leilei Cao

TL;DR: PACE 用多智能体构建可核验视觉问答评估协议，将开放式图像质量维度转成具体视觉证据探针，并以每维四张人工图校准评分。

Details

Motivation: 生成模型使图像质量评价扩展到物理合理性、文字渲染等开放维度，但传统 IQA 模型依赖固定定义和大量监督，且会把通用质量先验套用到未见维度，造成整体性偏差和排序反转。

Result: PACE 是免训练协作智能体框架，将开放式 IQA 转为显式协议构建：针对目标维度生成可验证 VQA 探针，使评估依据具体视觉证据而非整体印象。每个维度只用四张人工标注图校准协议，并通过双轨评分与人类量表对齐。在传统 IQA、结构保真、上下文审美和新开放维度上，PACE 持续改善 MLLM 骨干的表现并具竞争力；整体性覆盖率 HOR 从 44.4% 降至 8.6%。

Insight: 开放质量概念需先落到一组可回答、可核验的视觉标准，再少量校准评分尺度；协议本身成为模型可检查的评估定义。

Abstract: Generative models are rapidly expanding image quality assessment (IQA) beyond traditional fidelity factors to emerging dimensions such as physical plausibility and text-rendering correctness. However, existing IQA models rely on fixed definitions and heavy supervision, making them difficult to extend to open-ended perceptual dimensions. We identify holistic bias as an important limitation: when scoring an unseen dimension, models reuse generic quality priors, leading to scoring errors and rank inversion. To address this, we propose PACE (Perceptual Agentic Collaborative Evolution), a training-free multi-agent framework that formulates open-ended IQA as explicit protocol construction. Given a target dimension, PACE uses collaborative agents to construct an evaluation protocol composed of verifiable Visual Question Answering (VQA) probes, grounding evaluation in concrete visual evidence rather than holistic impressions. The resulting protocol is calibrated using only four human-annotated images per dimension, while a dual-track scoring mechanism aligns model perception with human scoring scales. Across traditional IQA, structural fidelity, context-aware aesthetics, and newly defined open-ended dimensions, PACE consistently improves its MLLM backbone, achieving competitive performance across diverse IQA settings, and reduces the Holistic Override Rate (HOR) from 44.4% to 8.6%.

[28] Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generation cs.CVPDF

Guanqiao Chen, Jingru Tan, Dongxing Mao, Catherine Chen, Zijian Du

TL;DR: DuetGen 联合训练自回归文字布局规划器和扩散图像渲染器，让渲染损失反向塑造文字内容与位置表征。

Details

Motivation: 文字图像生成需同时保证文本准确和与画面协调。布局规划能明确文字内容与位置，但规划正确不代表渲染能实现；既有 AR-扩散方案分开优化规划和绘制，不能联合适配。

Result: DuetGen 的 DeepFusion 用规划器的 prompt 和边框-内容隐藏状态条件化扩散 Transformer，联合优化自回归布局监督、文字区域加权扩散目标和辅助坐标监督。推理时采用阶段感知注意力调制，加强图像区域与对应坐标、文本内容状态之间的关系。在 2B 规划器和 4B 单流 DiT 下，CVTG-2K 字准确率为 0.8293，LongText-Bench 为 0.938，接近规模更大的 Qwen-Image。

Insight: 规划器表示可通过实际渲染目标共同塑形，避免独立布局预测和生成器之间的接口错配；区域级注意力调制进一步让计划按位置执行。

Abstract: Generating text-rich images from prompts requires both textual fidelity and the coherent integration of text into the surrounding image. An explicit layout can provide structured guidance about what text should appear and where, but a well-formed plan alone does not guarantee that the renderer will realize it faithfully. Existing layout-based AR-diffusion systems typically optimize planning and rendering separately, preventing the planner’s representations from being adapted jointly with image synthesis. We introduce DuetGen, an autonomous visual text generator built on DeepFusion, which jointly learns autoregressive planning and continuous diffusion rendering. DeepFusion conditions a diffusion transformer on the planner’s prompt and bbox-content hidden states, allowing rendering supervision to shape the representations connecting textual plans with visual outputs. Its joint objective combines autoregressive plan supervision, text-region-weighted diffusion learning, and auxiliary coordinate supervision to maintain structured planning, emphasize text-bearing regions, and improve the spatial precision of planner representations. During inference, Phase-Aware Attention Modulation strengthens the correspondence between image regions and their matched coordinate and content states, facilitating region-specific execution of the generated plan. With a 2B planner and a 4B single-stream DiT, DuetGen achieves 0.8293 word accuracy on CVTG-2K and 0.938 accuracy on LongText-Bench, closely matching the substantially larger Qwen-Image on both benchmarks. These results demonstrate the value of jointly learned planning representations and region-specific rendering for autonomous visual text generation.

[29] RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling cs.CV | cs.AIPDF

Zhenchen Tang, Yang Li, Songlin Yang, Bo Peng, Xiaotong Zhao

TL;DR: RewardVerse 用动态评分规程作为视频奖励模型的中间表示，先明确评价标准再打分，以减少不同提示间的标量漂移。

Details

Motivation: 视频强化学习依赖稳定奖励模型，但复杂主观质量直接映射单一分数会出现尺度坍塌或随提示漂移，导致不同生成结果的奖励不可比较。

Result: RewardVerse 在评估问题与评分器间引入动态 rubric，先生成显式标准再按规程评分，提供稳定语义锚点。两阶段 RGPO 先用自演化种子规程预热评分器，再联合优化规程生成器，使其生成查询适配标准并持续与人类评分对齐。在 16 维 EvalVerse 和外部数据集上，方法缓解标量漂移，在逐点和成对评价均达到先进表现，并为视频生成 RL 提供稳健、可解释奖励。

Insight: 把评分尺度拆成可检查的规程和分数，可避免模型对不同提示随意改变量尺；规程也使奖励结果更容易解释和对齐人类判断。

Abstract: Reinforcement learning (RL) is vital for optimizing video generation models, with a robust reward model (RM) serving as the cornerstone. However, existing video reward models often produce unstable scalar scores because they directly map complex, subjective video quality into a single score without explicit evaluation criteria. This leads to scalar drift, where the scoring scale collapses or shifts across different prompts, making the reward unreliable for RL. Drawing inspiration from professional human annotation engineering, we address this problem with RewardVerse, a rubric-based video reward framework that introduces a dynamic rubric as an intermediate representation between the evaluation query and the scorer. Instead of unconstrained direct scoring, RewardVerse first generates explicit evaluation criteria and then performs rubric-guided scoring, providing a stable semantic anchor that mitigates scalar drift. To efficiently optimize this collaborative pipeline, we propose Rubric-Guided Policy Optimization (RGPO), a two-stage training algorithm. RGPO first warms up the scorer using self-evolving seed rubrics and then jointly optimizes the rubric generator to produce query-adaptive evaluation criteria while continuously aligning the scorer with human ratings. Extensive experiments on the 16-dimensional EvalVerse benchmark and external datasets demonstrate that RewardVerse mitigates scalar drift, achieves state-of-the-art performance on both pointwise and pairwise evaluation, and provides a robust and interpretable reward signal for RL in video generation.

Ethan Griffiths, Maryam Haghighat, Simon Denman, Clinton Fookes, Milad Ramezani

TL;DR: M3GA-Wild 是森林地面到航空多模态、多时段地点识别基准，整合 36km 地面 RGB/LiDAR、370 公顷航空数据及精确六自由度位姿。

Details

Motivation: 自然森林中的跨平台定位受视角变化、遮挡和环境差异影响，缺少同时覆盖地面/航空、RGB/LiDAR 和跨模态时段变化的大型基准。

Result: M3GA-Wild 对现有森林定位数据扩展整合，提供同步地面 RGB 与 LiDAR 路径（36 公里）、对齐的高分辨率航空影像、多高度 LiDAR（覆盖 370 公顷）及精确地理配准 6DoF 位姿，可系统评估视觉、激光雷达、跨模态和多模态方法。基线显示视点差异极大时 LiDAR 明显优于纯视觉，而当前多模态融合因跨模态对齐不足收益有限；配对航空 RGB 和地理 LiDAR 还可评估基础模型估计单目深度作为廉价 3D 几何来源，初步结果显示现有方法仍有不足。

Insight: 森林跨平台定位的核心瓶颈包括模态错位和严重域差异；新基准将有助于区分传感器互补性与融合对齐质量。

Abstract: We present M3GA-Wild, the first benchmark for multi-modal, multi-session ground-to-aerial place recognition in forests. M3GA-Wild unifies and extends existing forest localisation datasets, providing a holistic benchmark with synchronised RGB imagery and LiDAR from ground traversals spanning 36 km, aligned high-resolution aerial imagery and multi-altitude LiDAR covering 370 hectares, and accurate geo-referenced 6-DoF poses for precise evaluation. M3GA-Wild captures diverse forest scenes with varying viewpoints, occlusion, and environmental conditions, enabling systematic evaluation of visual, LiDAR, cross-modal, and multi-modal methods. Baseline experiments show that LiDAR-based approaches significantly outperform vision-only methods under severe viewpoint differences, while current multi-modal fusion strategies yield limited gains due to poor cross-modal alignment. By pairing aerial RGB imagery with geo-referenced aerial LiDAR, M3GA-Wild also enables evaluation of foundation models for monocular depth estimation as a cheap source of 3D geometry from forest imagery, with initial experiments revealing shortfalls of current methods. These results highlight key challenges in cross-platform localisation, including modality misalignment and severe domain gaps. M3GA-Wild establishes a new benchmark to support research in robust multi-modal localisation and long-term autonomy in unstructured natural environments. The dataset and code will be available upon acceptance.

[31] General Collaborative Intelligence: Architecting Cognition for Resilient Multi-Agent Ecosystems cs.CV | cs.AI | cs.ROPDF

Lei Zhang, Chun Ye, Le Yang, Zhaozhong Wang, Deng-Ping Fan

TL;DR: 这篇综述以五维分类法和三种认知协同条件统一梳理多智能体协同智能，并提出跨架构、通信、具身、鲁棒性和应用可比的 GCI-Bench。

Details

Motivation: 多无人系统正从各自感知走向协同智能，通过交换紧凑特征克服遮挡、有限感知范围和环境退化；已有综述将架构、通信、具身、鲁棒和信任问题分开，缺少依赖关系分析。

Result: 综述提供两组视角：涵盖协作阶段、通信范式、融合架构、学习策略和应用领域的五维分类；以及语义消歧、务实信息交换、主动信息觅取三项认知协同条件。内容涵盖协作拓扑、将通信信道视为可微管线的协同设计、多智能体 RL 具身感知-行动闭环、同步/不确定性/标签高效鲁棒机制，并映射到 V2X、无人机、工业物流和智慧城市及安全-隐私-效用权衡。作者提出五支柱 GCI-Bench 和成熟度模型，讨论复现、仿真到现实差距及协作可能降低性能的情境。

Insight: 多智能体协作是否有效取决于语义、信息价值与主动观测能力，而不仅是交换更多特征；统一评测须刻画收益和协作失效的边界。

Abstract: Multi-agent unmanned systems are moving from isolated, ego-centric sensing toward collaborative intelligence, in which distributed agents exchange compact features to overcome a local observation trap that no single agent can escape: occlusions, finite sensor range, and environmental degradation. The field has matured across architectural, communication, embodied, resilience, and trust dimensions, yet existing surveys examine these dimensions in isolation and rarely expose their dependencies. This review offers a unified synthesis through two complementary lenses. The first is a five-dimensional taxonomy spanning collaboration stage, communication paradigm, fusion architecture, learning strategy, and application domain. The second is three cognitive synergy conditions, Semantic Disambiguation, Pragmatic Information Exchange, and Proactive Informational Foraging, that turn cognitive synergy into operational criteria. Across these lenses we survey collaboration architectures and topologies, neural-communication co-design that treats the channel as a differentiable pipeline component, embodied action-perception loops via multi-agent reinforcement learning, and resilience mechanisms for synchronization, uncertainty quantification, and label-efficient learning. We then map these advances onto four operational domains, V2X, unmanned aerial, industrial logistics, and smart cities, and onto the safety-privacy-utility triad. To counter benchmark saturation and evaluation fragmentation, we propose GCI-Bench, a five-pillar scoring protocol with a maturity model that makes the trade-offs of collaborative methods comparable across studies. A critical reflection on reproducibility, the sim-to-real gulf, and conditions under which collaboration degrades performance identifies open challenges and charts directions toward general collaborative intelligence under real-world uncertainty.

[32] MixiMotion: One-Step Text-to-Motion Generation via Asymmetric Set Distillation cs.CV | cs.MMPDF

Hung Dinh, Binh Mai, Tran Quoc Bao Le, Lam Nguyen, Cong Tran

TL;DR: MixiMotion 通过离线教师动作集合的非对称双向匹配蒸馏，实现严格单步文本到动作生成，时延降低约 89 倍而质量接近 50 步教师。

Details

Motivation: 迭代文本到动作生成质量高、语义对齐好，但需要多次网络调用，推理延迟大；只蒸馏教师单条轨迹又难覆盖同一提示下多种合理动作。

Result: MixiMotion 构造每个文本提示对应多个教师动作的离线集合，以非对称双向匹配对齐教师和学生集合：教师到学生方向鼓励覆盖教师支持的多样动作，学生到教师方向抑制无依据生成；还用可微解码空间运动学监督补充归一化表示匹配。推理一次网络调用完成动作序列，无教师查询、迭代采样或候选排序。ViMoGen 上语义对齐分 0.835，接近 50 步 HY-Motion-1.0-Lite 教师的 0.858；盲测人评总分 4.33 对教师 4.50，延迟从 829.58ms 降至 9.30ms，约 89.2 倍加速。

Insight: 蒸馏教师动作分布而非单条轨迹，可在单步生成中兼顾多样性与质量；解码运动空间监督弥补潜在表示匹配与实际运动学之间的差距。

Abstract: Iterative text-to-motion generation delivers high-quality and semantically aligned motions but requires multiple network evaluations, resulting in substantial inference latency. We present \textbf{MixiMotion}, a strict one-step text-to-motion generation framework based on offline set distillation. Instead of distilling a single teacher trajectory for each text prompt, MixiMotion constructs an offline bank of multiple teacher motions and aligns teacher and student sample sets through \textbf{asymmetric bidirectional matching}. The teacher-to-student direction promotes coverage of diverse teacher-supported motions, while the student-to-teacher direction suppresses unsupported generations. We further introduce differentiable decoded-space kinematic supervision to complement normalized representation matching with constraints in the decoded motion space. At inference, MixiMotion generates a complete motion sequence with a single network evaluation, without teacher queries, iterative sampling, or candidate ranking. On ViMoGen, MixiMotion achieves a semantic alignment score of $0.835$, outperforming the evaluated one-step baselines and approaching the $0.858$ score of its 50-step HY-Motion-1.0-Lite teacher. In blinded human evaluation, MixiMotion obtains an overall rating of $4.33$, compared with $4.50$ for the teacher, while outperforming the evaluated one-/few-step baselines. Meanwhile, generation latency is reduced from $829.58$,ms to $9.30$,ms, corresponding to an $89.2\times$ speedup. These results demonstrate an effective quality–efficiency trade-off for strict one-step text-to-motion generation.

[33] CrowdCue: Specialist-Cue Conditioning for Vision-Language Crowd Counting cs.CVPDF

Moshiur Farazi, Bekir Ciftler, Abdulhalim Dandoush, Reda Bendraou

TL;DR: CrowdCue 将专家人群计数器的整数结果作为文本或图像数字提示交给 VLM，视觉数字通道达到 MAE 62.65，超过只提供密度热图的做法。

Details

Motivation: 生成式 VLM 可同时给出计数和场景描述，但原始计数精度仅处于参数少于百万的专用回归器水平。作者研究预训练专家的辅助信息能否提升 VLM，以及应通过哪种信息通道传递。

Result: Qwen2.5-VL-7B 在 ShanghaiTech A/B、UCF-QNRF 和 NWPU-Crowd 上零样本提示通常无法解析计数，经 LoRA SFT 基线整体 MAE 为 81.64。将 P2PNet 密度热图作为视觉提示在所有编码方式中均失败；对抗交换实验显示模型确实读取热图，却反向使用。CrowdCue 改为提供同一专家已整合的整数计数：文本通道 MAE 72.04；将数字渲染为图像再输入的视觉通道 MAE 62.65，是本文最佳结果，也好于单独专家的 84.45。

Insight: 辅助专家知识的抽象层级比通道本身更关键：密度图虽信息丰富却难与 VLM 推理对齐，离散计数更容易成为可用条件。

Abstract: Generative vision-language models (VLMs) offer a counting paradigm in which one model produces both a count and a natural-language account of the scene, yet their raw counting accuracy sits in the range of sub-million-parameter specialist regressors. The open question is whether auxiliary guidance from a pretrained specialist can lift them into useful territory, and through which channel that guidance is best routed. We evaluate Qwen2.5-VL-7B on four widely used crowd counting benchmarks (ShanghaiTech A and B, UCF-QNRF, NWPU-Crowd). Zero-shot prompting rarely produces a parseable count, so LoRA supervised fine-tuning establishes the baseline at overall MAE 81.64. Conditioning on a P2PNet-derived density heatmap as an auxiliary visual signal fails in every encoding we tested, and an adversarial-swap protocol shows the model reads the heatmap but applies it counterproductively. We propose CrowdCue, a family that supplies the same specialist’s already-integrated integer count to the VLM as a discrete symbol. The text-channel variant reaches MAE 72.04. The visual-channel variant, which renders the integer as printed digits and supplies it as a second image, reaches MAE 62.65, the strongest result in this paper and well ahead of the cue-supplying specialist alone (84.45 on the same split). In the late-fusion VLM we study, the binding constraint is not the channel but the abstraction level at which the specialist signal is delivered.

[34] BrainIAC: Interactive 3D Brain Lesion Segmentation across Heterogeneous MRI Modalities with Online Adaptation cs.CVPDF

Wentian Xu, Anthony P Addison, Ziyun Liang, Harry Anthony, Guang Yang

TL;DR: BrainIAC 将多模态病灶分割、框/点击交互及在线自适应整合，支持 MRI 模态组合变化和未见病理。

Details

Motivation: 真实临床部署会遇到扫描仪、MRI 模态组合及新病理变化造成的分布漂移，现有脑病灶分割模型难满足交互性和跨域连续适应需求。

Result: BrainIAC 由三部分构成：用零填充和随机模态丢弃训练、能处理异构模态集合的多模态骨干；无提示时维持自动预测，同时支持框和点击提示的 3D 交互分割；以及结合交互中和交互后自适应的在线机制，以模型自身预测为伪标签并加入点击中心高斯损失。据作者所知，这是首批 3D 交互分割在线适配方法之一，也是首个同时处理模态异构和在线适配的方法。在七个脑 MRI 数据集上，各组件互补，优于现有方法，并可泛化到训练未见模态组合和病理类型。

Insight: 临床分割要同时适应扫描条件变化和用户交互；以交互点为中心的伪标签在线适配可让模型在不停止自动预测的情况下更新。

Abstract: Brain lesion segmentation is a fundamental task in medical image analysis, playing a critical role in diagnosis, treatment planning, and longitudinal disease monitoring. Yet existing models still struggle to meet the demands of real clinical use, where deployments contain data distribution shifts, arising from differences in scanner hardware, imaging protocol (varying MRI modality sets), and new pathologies. We present BrainIAC (Brain lesion Interactive Adaptive Continuously learning segmentation), a unified framework that integrates (i) a multi-modal backbone network trained to segment multiple types of brain lesions and handle heterogeneous sets of modalities via zero-filling and random modality dropping; (ii) 3D interactive segmentation with bounding-box and click prompts that preserves fully automatic prediction when no prompt is given; and (iii) an online adaptation mechanism combining Mid-Interaction adaptation and Post-Interaction adaptation, supervised by the network’s own predictions as pseudo labels and guided by an extra Click-Centered Gaussian loss. To our knowledge, this is one of the first 3D online adaptation methods for interactive segmentation, and the first to combine handling of heterogeneous modality sets with online adaptation. Experiments across seven brain MRI datasets demonstrate that the proposed components provide complementary and synergistic benefits. The method consistently outperforms existing approaches and generalizes well across heterogeneous imaging modalities, including those unseen during training, as well as previously unseen brain pathology types. The code and a 3D Slicer plug-in will be released at https://github.com/WenTXuL/BrainIAC upon publication.

[35] VDGS: Visibility-Driven Large-Scale 3D Gaussian Splatting for Aerial Scene Reconstruction cs.CVPDF

Haolin Yu, Jiadong Tang, YiXian Wang, Yu Gao, Shi He

TL;DR: VDGS 将相机分布和场景锚点可见性统计纳入大规模航拍 3DGS，用于场景分区及欠优化区域梯度补偿。

Details

Motivation: 3D Gaussian Splatting 适合大场景重建，但无人机拍摄常有视点分布不均，导致覆盖失衡且内存消耗高，限制实际应用。

Result: VDGS 通过可见性驱动统计量估计场景锚点监督强度，并据此分割场景、为欠优化区域补偿梯度，促进不同区域平衡优化。在多个大规模航拍场景数据集上，面对视点分布不均时持续超过既有方法；视点更均匀时也保持具竞争力的效果。

Insight: 建模相机覆盖情况可帮助识别训练监督薄弱区域，避免仅由采集密集视角支配大尺度 3DGS 优化。

Abstract: Large-scale scene reconstruction is a critical foundational technology in robotic autonomous systems such as 3D mapping and autonomous driving. In recent years, 3D Gaussian Splatting (3DGS) has demonstrated remarkable advantages in both visual quality and computational efficiency, making it a promising representation for large-scale scene reconstruction. However, it still faces challenges in large-scale scenes, including excessive memory consumption and uneven viewpoint coverage caused by UAV acquisition, limiting its real-world applications. To address this, we propose VDGS, a novel 3DGS framework that incorporates camera distribution into scene modeling. VDGS introduces visibility-driven statistics for scene anchors to quantify supervision strength. These statistics are further leveraged for scene partitioning and for gradient compensation in under-optimized regions, thereby promoting balanced optimization across different regions. Extensive experiments on multiple large-scale aerial scene datasets demonstrate that, under imbalanced viewpoint distributions, VDGS consistently outperforms existing methods, while maintaining competitive performance in scenarios with more uniform view distributions.

[36] LD-RSVIS: A Large-Scale and Diverse Benchmark for Referring Surgical Video Instrument Segmentation cs.CVPDF

Zan Wang, Yunhe Feng, Dong Nie, Oluwatosin Oluwadare, Kewei Sha

TL;DR: LD-RSVIS 发布 3,536 段、109 万帧的手术器械指代视频分割基准，首次系统支持无目标、单目标和多目标表达。

Details

Motivation: 手术视频指代表达分割按文本定位器械并输出掩码，但现有数据集较小，且只支持一个目标器械，限制模型泛化和真实临床适用性。

Result: LD-RSVIS 覆盖 25 种手术、30 类器械及 3,536 段视频、109 万帧，提供经多轮检查修订的人工标注。表达类型包括无目标、单目标和多目标。作者评估 12 种代表方法，显示仍有改进空间；另提出 Cascade-RSVIS，先利用互补文本线索挖掘目标特定特征，再结合文本和线索完成分割，取得有前景的表现。

Insight: 真实指令不一定能在视频中找到目标，也可能同时指代多个器械；纳入无目标和多目标设定使基准更接近实际手术交互。

Abstract: Referring surgical video instrument segmentation (RSVIS) aims at segmenting the instrument in a surgical video, given a textual description. Despite recent progress, current models are trained and assessed on relatively small-scale benchmarks, hindering the development of more general RSVIS. In addition, existing benchmarks support only the single-target expression that refers to one instrument in the video, while overlooking multi-target and no-target referring expressions, restricting the applicability of RSVIS in practical scenarios. Addressing these issues, we propose LD-RSVIS, a new benchmark aiming to facilitate more robust and general RSVIS. Specifically, LD-RSVIS consists of 3,536 surgical videos with 1.09 million frames and covers a broad set of 30 instrument classes from 25 various procedures. By including abundant videos and classes, LD-RSVIS could benefit large-scale training and evaluation of more general RSVIS methods. Besides, unlike existing datasets, LD-RSVIS offers diverse referring settings, including no-target, single-target, and multi-target expressions, which enables the development of more practical RSVIS models in real applications. In order to ensure high-quality annotations, all videos in LD-RSVIS are manually labeled with multiple rounds of inspection and refinement. To our knowledge, LD-RSVIS is the largest and most diverse benchmark for RSVIS. To analyze LD-RSVIS and to provide comparison for future research, we evaluate 12 representative methods, and the results reveal that more efforts are required for improvements. To encourage future research, we present a simple yet effective RSVIS method, dubbed Cascade-RSVIS, that first mines target-specific cues using the complementary multi-cue text information and then employs such cues and textual information for segmentation, achieving promising performance. Our benchmark and code will be released.

[37] MM-ContextFold: Context Folding for Multimodal Agentic Retrieval cs.CV | cs.AI | cs.IR | cs.MMPDF

Yang Tian, Fan Liu, Jingyuan Zhang, Zhenyang Li, Yupeng Hu

TL;DR: MM-ContextFold 通过按需加载图像到临时分支、将结果折叠为文本摘要并释放图像，缓解多模态智能体检索的上下文膨胀。

Details

Motivation: 多模态智能体检索需反复调用外部工具；ReAct 常把原始图像及不断增长的交互历史放入同一上下文，造成视觉 token 密集的上下文爆炸，而现有方法多只压缩文本。

Result: 作者先分析约 1 万条轨迹，发现工具逐步提取并文字化视觉线索后，保留原始图像越来越冗余，还与更高输出熵甚至更低准确率相关。MM-ContextFold 是训练免框架：主上下文持续保留文本规划信息，仅在需要时加载相关图像到临时分支，完成子任务后把结果折叠为简洁文本摘要，再丢弃图像和分支轨迹。五个骨干、七个 MAR 基准上，平均准确率比 ReAct 高 6.3 个百分点，工作上下文长度减少 27.5%。

Insight: 图像只需在处理其对应子任务时进入上下文；将已提取视觉证据折叠为文本结果，可减少重复视觉 token 并避免冗余图像影响后续生成。

Abstract: Multimodal Agentic Retrieval (MAR) requires agents to solve complex information-seeking tasks by iteratively invoking external tools. Typical frameworks such as ReAct maintain raw multimodal inputs and the accumulating interaction history in a single, ever-growing context, leading to the context explosion problem. While existing methods alleviate this issue by compressing redundant text, effective strategies for managing token-intensive visual content remain largely underexplored. To address this gap, we first conduct a systematic empirical study of approximately 10,000 trajectories. The results show that as visual cues are progressively extracted through external tools and textualized into the context, raw images become increasingly redundant. Continued image retention is associated with higher output entropy and can even degrade task accuracy. Motivated by these findings, we propose MM-ContextFold, a training-free framework that loads raw images only when needed. It maintains a persistent, text-only main context for high-level planning and spawns ephemeral branch contexts for image-dependent subtasks. Within each branch, the agent loads the relevant images, completes the subtask, and folds the result back into the main context as a concise textual summary; the images and branch trace are then discarded. Experiments on seven MAR benchmarks across five backbone models show that MM-ContextFold improves average accuracy by 6.3 percentage points over ReAct while reducing the working context length by 27.5%.

[38] QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation cs.CV | cs.AIPDF

Le Thien Phuc Nguyen, Thien Nguyen, Thanh-Huy Nguyen, Gia Minh Hoang, Anh Mai Vu

TL;DR: QwenVLConnector 用轻量稠密多层连接器聚合医学图像的低层空间和高层语义特征，在统一 next-token 接口中支持分类、检测、计数、回归和报告生成。

Details

Motivation: 医学 VLM 往往擅长开放式报告和视觉问答，却较少在统一界面中支持结构化、细粒度临床感知任务。

Result: 基于 Qwen2.5-VL 的 QwenVLConnector 将单标签/多标签分类、文本化检测、计数、回归和自由文本报告生成统一为 next-token 目标。稠密多层 Connector 聚合低层和高层视觉特征，经预训练视觉 Merger 对齐后与最终视觉表示融合，不增加序列长度。在 FLARE-2D 上，检测 F1 从 0.55 提至 0.85，单标签分类从 0.37 提至 0.51，报告生成 GREEN 最多提高 18.3 分；报告任务的多模态上下文学习还能在不更新参数时带来额外改进。

Insight: 同一视觉输入可以用统一生成接口处理结构预测和临床叙述；融合多层特征可补足单一末层表示缺少的空间定位线索。

Abstract: Most medical vision-language models (VLMs) excel at open-ended report generation and VQA but provide limited support for structured, fine-grained clinical perception within a unified interface. We present QwenVLConnector, a Qwen2.5-VL-based medical chatbot that unifies classification, multi-label classification, textualized detection, counting, regression, and free-form report generation under a single next-token objective. Our key component is a lightweight dense multi-layer Connector that aggregates low- and high-level visual features, aligns them through the pretrained vision Merger, and fuses them with the final visual representation without increasing sequence length. This design enriches visual tokens with complementary spatial and semantic cues while preserving efficiency. On FLARE-2D, QwenVLConnector improves detection F1 from 0.55 to 0.85, raises single-label classification from 0.37 to 0.51, and boosts report-generation GREEN by up to 18.3 points over the Qwen2.5-VL baseline. We further explore multimodal in-context learning for report generation, showing additional improvements without updating model parameters. Overall, QwenVLConnector offers a unified and efficient framework for combining structured medical perception with open-ended clinical text generation. Our code can be found at https://github.com/plnguyen2908/QwenConnector.

[39] SparkDiffusion: Mitigating the High-Sparsity Trap — A Unified Framework for up to $265\times$ Single-GPU Acceleration of Visual Generation cs.CVPDF

Yuxi Liu, Haoyu Li, Zekun Zhang, Tengxu Sun, Yixiang Cai

TL;DR: SparkDiffusion 先将高稀疏架构适配为粗先验，再用少步轨迹混合蒸馏校正终端分布，并结合 FP8 融合 kernel 加速视频生成。

Details

Motivation: 视频扩散 Transformer 的长时空 token 使注意力成本高。作者发现极端稀疏时，逐步局部训练损失持续下降，但最终生成质量停滞或变差，形成“高稀疏陷阱”。

Result: 分析认为终端误差主要源于高噪声结构生成阶段，因此终端对齐训练能修正逐步局部训练难以消除的错误。SparkDiffusion 将此原则实现为短稀疏预热、少步轨迹混合蒸馏、FP8 量化与融合 kernel。在 Wan2.1/Wan2.2 的 720P 长序列视频任务中维持 97% 注意力稀疏度且画质较强，Wan2.1-T2V-1.3B-480P 达到 90%。单 RTX 5090 上，Wan2.1-T2V-14B-720P 以 3 步无 CFG 推理相较 50 步稠密基线端到端加速 265 倍，H100 上为 220 倍；1.3B 480P 视频去噪需 1.3 秒。

Insight: 稀疏架构训练目标必须与最终生成结果对齐；先形成粗先验再修正终端分布，比无限延长局部训练更能保住极高稀疏度下的画质。

Abstract: Video diffusion transformers are expensive because attention dominates long spatiotemporal token sequences. We identify the \emph{high-sparsity trap}: at extreme attention sparsity, step-local training losses keep decreasing while terminal generation quality stagnates or degrades. The trap is one of supervision: the dominant terminal errors originate in the high-noise structure-generation stage, and terminal-aligned training corrects terminal errors that substantially extended step-local training cannot. This yields a simple staging principle: \emph{first adapt the sparse architecture into a coarse prior, then correct the terminal distribution}. We instantiate the principle as \method, a unified acceleration framework for visual generation that combines a short sparse warm-up, few-step trajectory-mixed distillation, and FP8 quantization with fused kernels. \method sustains $97%$ attention sparsity with strong visual quality on long-sequence 720P generation across Wan2.1/Wan2.2 backbones and T2V/I2V tasks, and $90%$ sparsity on Wan2.1-T2V-1.3B-480P. With 3-step CFG-free inference, \method achieves a $265\times$ end-to-end speedup over the 50-step CFG dense baseline for Wan2.1-T2V-14B-720P on a single RTX~5090 ($220\times$ on H100), and denoises a Wan2.1-T2V-1.3B-480P video in $1.3$s.

[40] GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting cs.CV | cs.AIPDF

Si-Yu Lu, Yung-Yao Chen, Yi Jan Chen, Shang-Lin Li, Ching-Chan Liao

TL;DR: GrapeSplat 将无位姿多视图几何和外观特征汇聚到稀疏体素网格，再按占用单元解码高斯，实现单次前向场景重建。

Details

Motivation: 无标定、无位姿图像的前馈 3DGS 仍常只监督光度一致性并逐像素预测高斯，导致全局结构脆弱，基元数量还随图像分辨率和视图数增长。

Result: GrapeSplat 将多视图线索融合到体素对齐场景表示，无需逐场景优化或后处理。Atlas Encoder 把视图提升为锚定预测三维点的像素级几何-外观特征；PEACH-Vox 用每轴平滑映射及闭式逆变换将无界场景压入有界稀疏网格；Sparse Decoder 通过稀疏卷积聚合网格，并从占用单元解码多个高斯。基元数随占用单元而非像素数增长。使用 8 视图监督训练后，可从 4 到 64 视图零样本泛化至室内及无界场景。

Insight: 稀疏体素表示把多视图几何汇总到场景级坐标，可避免像素对齐高斯导致的结构脆弱和规模膨胀。

Abstract: Feed-forward 3D Gaussian Splatting now reconstructs renderable scenes from unposed, uncalibrated images. Yet, most models supervise only photometric consistency and predict Gaussians pixel by pixel, which leaves global structure fragile and ties primitive count to image resolution and view count. To this end, GrapeSplat amalgamates multi-view cues into a voxel-aligned scene representation and decodes Gaussians directly from the learned grid, requiring no per-scene optimization or post-processing. An Atlas Encoder lifts all views into pixel-wise geometry-and-appearance features anchored at predicted 3D points. PEACH-Vox compands the unbounded scene into a bounded sparse grid through a smooth per-axis map with an exact closed-form inverse. The Sparse Decoder then consolidates the grid with sparse convolutions and decodes the full scene as multiple Gaussians per occupied cell. This amalgamated representation exploits sparse voxel occupancy, where the Gaussian count follows the occupied cells and saturates as views cover the scene, while grid resolution sets its ceiling. GrapeSplat turns unposed images into a renderable Gaussian scene in a single forward pass. Trained with 2D and 3D supervision on 8-view sequences, it generalizes zero-shot from 4 to 64 views across indoor and unbounded scenes. Code and trained weights are available at https://github.com/VAISR/GrapeSplat

[41] CausalWM: Causal Chain-of-Thought Reasoning for Embodied World Model cs.CVPDF

Ziming Xu, Shuang Liang, Ruobing Han, Ziqiao Xi, Mingxing Rao

TL;DR: CausalWM 在预测未来视频前生成显式因果思维轨迹，以整理物理演化中的关键变量，并通过大规模预训练、因果中训和多目标 RL 后训练学习具身世界模型。

Details

Motivation: 具身世界模型需从视觉观察和控制信号预测物理动态，但因果知识通常隐含纠缠在潜在表示中，难以显式组织和推理。

Result: CausalWM 是 16B 模型，在未来视频预测前执行因果 CoT，将有用变量组织为逐步推理轨迹。训练收集 3.1 万小时具身数据，分大规模视频预训练、因果 CoT 中期训练、多目标强化学习后训练三阶段。尽管监督 CoT 变量有限，模型表现出上下文内学习，可提供上下文视觉特征引导并高效少步生成。在语言条件、动作条件、单视图和多视图基准上达到先进结果，并登上 TriWorldBench 排行榜第一。

Insight: 将物理动态相关变量组织成显式因果轨迹，可在未来视频生成前建立可检查的因果结构；少量监督变量也可能诱发更广泛的上下文学习。

Abstract: Embodied world models learn to predict future physical dynamics from visual observations and control signals, where physical knowledge is implicitly entangled within latent representations. We introduce CausalWM, a 16B embodied world model that performs explicit causal chain-of-thought reasoning before future video prediction. CausalWM organizes useful variables into a reasoning trajectory, allowing the model to progressively capture causal dependencies underlying physical evolution. To train CausalWM, we collect 31K hours embodied data and develop a three-stage paradigm consisting of large-scale video pre-training, causal CoT mid-training, and multi-objective RL post-training. Despite using only a limited set of supervised CoT variables, CausalWM exhibits emergent in-context learning capabilities, enabling contextual visual feature guidance and efficient few-step generation. CausalWM achieves state-of-the-art performance across language-conditioned, action-conditioned, single-view and multi-view benchmarks, including Top-1 performance on TriWorldBench leaderboard.

[42] SPACE: Semantic Projection and Alignment of CLIP Embeddings for Domain Adaptation cs.CVPDF

João Renato Ribeiro Manesco, Danilo Samuel Jodas, Douglas Rodrigues, Leandro Aparecido Passos, João Paulo Papa

TL;DR: SPACE 利用 CLIP 文本类别描述的 SVD 语义子空间作为锚点，将不同视觉域特征投影并按语义而非外观相似度对齐。

Details

Motivation: 视觉模型面对分布变化会性能下降；照片与草图等同一语义概念的视觉外观差异很大。已有无监督域适配常对齐整体分布，却忽略同类别样本之间的语义关系。

Result: SPACE 利用 CLIP 视觉-语言空间语义结构开展域适配。将类别文本描述的 CLIP 嵌入进行奇异值分解，得到捕捉类别语义关系的正交基，再把源域和目标域视觉特征投影至该语义子空间，使图像依据意义而非外观对齐。

Insight: 文本语义锚定可为跨域视觉适配提供类别结构，尤其适用于照片和草图这类低视觉相似但高语义对应的场景。

Abstract: A fundamental challenge in deploying vision models is domain shift, which arises when training and test data follow different distributions, leading to degraded performance. This challenge is amplified when the same semantic concept appears under distinct visual forms, such as photographs and sketches, where visual similarity is weak despite semantic correspondence. Existing unsupervised domain-adaptation methods aim to align distributions across domains but often ignore semantic relationships among samples of the same class. To address this issue, this paper introduces SPACE, a method that exploits the semantic structure of CLIP’s vision-language space for domain adaptation. The key idea is to use text descriptions as semantic anchors by applying Singular Value Decomposition to CLIP embeddings of class descriptions, yielding an orthogonal basis that captures semantic relationships among categories. Visual features from both domains are projected into this semantic subspace, aligning images based on meaning rather than appearance.

[43] RegVGGT: Sustainable Visual Geometry Grounding for Streaming via Regulated Memory cs.CVPDF

Hongbo Mao, Junjun Jiang, Youyu Chen, Jiaxin Zhang, Zhemeng Dong

TL;DR: RegVGGT 在流式三维重建中依据 token 初始显著性筛选新帧信息，每帧最多让 1% token 更新记忆，以限制显存增长并维持上下文。

Details

Motivation: 前馈重建模型处理长视频时受 GPU 内存限制，无法保留全流上下文；已有方案在上下文完整和内存间折衷，常出现内存快速膨胀或人为限额导致信息退化。

Result: RegVGGT 是训练免 token 调节方法。作者发现 token 初始显著性可可靠预测其在整段流中的长期重要性，据此激进筛选新帧 token，每帧最多 1% 可更新上下文记忆。配套 FlashAttention 兼容的显著性估计，可在消费级 GPU 上处理数千帧，同时几乎不损害重建质量。多个长时域基准和不同前馈预测任务上，超过既有流式重建基线。

Insight: 限制每帧进入长时记忆的 token 数可缓解显存随视频长度增长；筛选应保留长期有用的高显著性信息，而不是简单截断固定窗口。

Abstract: 3D reconstruction from a lengthy video stream input poses a dilemma for feed-forward reconstruction models (FFRMs), that a whole-stream inference context cannot be retained under limited GPU memory.Recent studies seek to resolve this problem via a trade-off between the integrity of inference context and GPU memory usage, which either suffer from a rapid memory inflation or degraded context integrity due to artificially capping memory usage.Driven by our key observation that the initial saliency of a token reliably dictates its long-term importance across the stream, we propose RegVGGT, a training-free token regulation method which aggressively regulates the tokens of incoming frames.By admitting at most 1% of tokens per frame to update the context memory, our method dramatically suppresses memory inflation as the stream progresses.Equipped with a FlashAttention-compatible token saliency estimation scheme, RegVGGT is capable of processing thousands of frames on a consumer-grade GPU with negligible compromise to reconstruction quality.Extensive experiments demonstrate that RegVGGT achieves state-of-the-art performance on long-horizon benchmarks across diverse FFRM prediction tasks, surpassing prior FFRM-based stream reconstruction baselines by a large margin.

[44] MinCU: A Fine-Grained Benchmark for Grounded Minimal-Change Understanding in Image Pairs cs.CVPDF

Chaoqian Mu, Wenhao Wu, Zichen Liang, Jiaxu Li, Lijun Wang

TL;DR: MinCU 用每对图像仅一个原子变化的基准联合评估差异描述、变化区域定位和实体识别，并提出先语义、再空间锚定、最后描述的 SG-ISA。

Details

Motivation: MLLM 对近乎相同图像间细粒度差异的定位和描述仍缺研究；现有基准通常分开测语义比较或单图接地，没有要求同时准确描述变化并定位像素区域。

Result: MinCU 中每个图像对仅在对象类别、属性、数量或位置上有一项原子变化，评测模型能否描述变化、定位变化区域并识别变化实体。SG-ISA 将预测分为 Think-Locate-Describe：先预测变化概念语义线索，再用离散空间锚点隐式定位，最后生成变化描述和接地框。实验发现即使最强闭源 MLLM 和 R1 式模型也难同时输出准确描述与定位框。相较此前 CoT 方法，SG-ISA 微调显著提升联合接地与描述质量，并减少约 26% 推理 token。

Insight: 双图理解需要明确的中间空间接口；先确定变化语义、再以锚点定位，比完全依赖语言推理或仅扩大模型规模更有效。

Abstract: Localizing and describing fine-grained differences between near-identical images is a critical yet underexplored capability for multimodal large language models (MLLMs). Existing benchmarks largely assess semantic comparison or single-image grounding in isolation, without jointly requiring faithful description and physical localization. To bridge this gap, we introduce MinCU, a benchmark for grounded minimal-change understanding, where each sample consists of an image pair differing by a single atomic variation in object category, attribute, count, or spatial position, and models are evaluated on their ability to describe the change, localize the changed regions, and identify the changed entity. We further propose Semantic-Guided Implicit Spatial Anchors (SG-ISA), a structured autoregressive method that decomposes prediction into a Think-Locate-Describe sequence. SG-ISA first predicts a semantic cue for the changed concept, then uses discrete spatial anchors as an implicit localization scaffold, and finally generates the change description together with the grounding box. Experiments reveal that even the strongest closed-source MLLMs and recent R1-style reasoning models struggle on MinCU, with most failing to jointly produce accurate descriptions and grounding boxes. Compared to the previous chain-of-thought method, fine-tuning with SG-ISA yields substantial joint improvements in grounding accuracy and description quality while reducing reasoning-token overhead by approximately 26%. These results suggest that an implicit intermediate spatial interface can be more effective than relying solely on model scale for grounded dual-image understanding.

[45] AniPrO: Interpretable Anime Image Provenance Detection via Multi-Dimensional Semantic Reasoning cs.CVPDF

Yan Liu, Baoxiang Huang, Zi’an Wang, Wenbo Xie

TL;DR: AniPrO 用五维结构化描述和多维语义推理识别动漫图像来源，区分手绘、AI 修补与文生图并揭示全局合理性与局部细节连贯的差异。

Details

Motivation: 现有 AI 图像检测器主要面向真实照片，忽略动漫的平涂、夸张结构和线条控制等特有线索；动漫图像来源辨别关系版权和内容治理。

Result: AniPrO 基于 AnimeDL-2M，从 3.5 万候选图中取 1.5 万平衡样本，覆盖真实绘制、AI inpainting、Text2Image 三类，并配套五维结构化描述。作者提出 AniPrO-SFD-Bench 和 AniPrO-MFR-Bench，分别从统计特征判别和多模态融合推理评估溯源。实验显示，结构化语义线索可揭示 AI 生成中的系统性偏差，如全局视觉合理但局部细节不连贯，并改善困难 inpainting 样例检测。

Insight: 动漫溯源需使用领域特定艺术特征和局部-全局一致性，而非直接套用真实照片检测器；结构化描述让检测依据更可解释。

Abstract: As generative AI becomes increasingly used in anime-style image creation, distinguishing human-drawn, AI-inpainted, and text-to-image images is important for copyright attribution, visual provenance, and content governance. Existing AI-generated image detectors mainly target real-world photographs and often overlook anime-specific cues such as flat coloring, exaggerated structures, and artistic line control. To address this gap, we propose AniPrO, a multi-dimensional description-enhanced framework for interpretable anime image provenance. Built upon AnimeDL-2M, AniPrO contains 15,000 balanced samples from a 35,000-image candidate pool, covering Real, Inpainting, and Text2Image categories with structured five-dimensional descriptions. We further introduce AniPrO-SFD-Bench and AniPrO-MFR-Bench to evaluate provenance detection from statistical feature discrimination and multimodal fusion reasoning perspectives. Experiments show that structured semantic guidance reveals systematic AI-generation biases, such as the gap between global visual plausibility and local detail coherence, and improves the detection of challenging inpainting samples. The dataset and code will be released at: https://github.com/YAN-LIU05/AniPrO.

Can Zheng, Jiguang He, Guofa Cai, Henk Wymeersch, Merouane Debbah

TL;DR: 该方法以导频索引保持用户身份，将 CSI token 作为查询，通过跨注意力检索空间视觉记忆并结合用户间自注意力完成多用户定位。

Details

Motivation: 复杂城市环境的无线定位会受噪声、遮挡和多径影响而含糊，视觉观测提供互补空间上下文，可用于联合定位多个用户。

Result: 框架以导频索引的信道状态信息 CSI 编码每个用户 token，保留通信 UE 身份，再通过交叉注意力从空间视觉记忆中检索各用户信息。CSI token 间自注意力进一步建模用户交互，最终进行逐用户多模态定位。不同数据集实验显示，相较模型式、纯 CSI 和既有多模态融合基线均有稳定改进；作者还评估了多种无线和视觉条件。

Insight: 导频索引可在跨模态融合中维持用户身份对应，避免混淆多人信号；视觉空间上下文与无线信息应按用户粒度交互。

Abstract: Accurate multi-user localization is challenging in complex urban environments, where wireless measurements can become ambiguous under noise, blockage, and multipath, while visual observations provide complementary spatial context. This paper presents a vision-wireless fusion framework for multi-user localization using pilot-indexed channel state information (CSI). Orthogonal pilot indices preserve the identities of the communicating UEs in the CSI token sequence and localization outputs. The model encodes each pilot-indexed CSI observation as a query token and uses cross-attention to retrieve user-specific information from spatial visual memory. Self-attention among CSI tokens further captures inter-user interactions, while the resulting multimodal representations are used for user-wise localization. Experiments on different datasets show consistent improvements over model-based, CSI-only, and multimodal-fusion baselines. Further experiments evaluate the model under different wireless and visual conditions.

[47] The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models cs.CVPDF

Qiwen Gu, Jifan Li, Bingjie Gao, Rui Chen, Jing Tang

TL;DR: ARPS 在视频专家和动作专家之间构建紧凑、按时域条件预测的状态接口，使动作表示保留与控制相关的未来视觉变化。

Details

Motivation: 生成免世界动作模型训练时预测未来视频，但推理时依赖内部视频特征直接行动；这些特征究竟需要保留什么控制信息尚不明确，未来可预测性也不必然意味着易解码动作。

Result: 作者发现现有表示对未来变化越可预测，不代表线性动作解码越容易；观察到的未来变化会提供当前之外的动作信息，且线性可读动作信息集中在空间局部区域。Action-Relevant Predictive States 用时域条件状态预测器将中间视频特征汇总为紧凑状态，供动作专家使用。未来表示监督让状态不同部分预测不同未来时刻的视觉表示及相对当前的变化；推理时移除监督分支，只依据当前观察计算预测状态。受控消融显示未来监督显著提升分布迁移泛化；LIBERO 成功率 99.2%，无需适配迁移到 LIBERO-Plus 达 87.3%，比 Fast-WAM 高 39.2 个百分点。

Insight: 控制需要的不是任意“可预测未来”，而是包含有动作意义的未来变化状态；紧凑预测接口可把该信息从视频特征中显式传递给动作专家。

Abstract: Generation-free world action models (WAMs) retain future-video prediction during training but act from internal video features at inference, leaving unclear what these features should preserve for control. Our representation diagnostics show that representations with more predictable future changes need not make linear action decoding easier. Observed future changes provide additional action information beyond the present, and linearly readable action information is spatially concentrated. These findings motivate Action-Relevant Predictive States (ARPS), a compact predictive interface between the video and action experts. ARPS uses a horizon-conditioned state predictor to aggregate intermediate video features into a compact state that supplies all visual context to the action expert. Future-representation supervision trains different parts of this state to predict visual representations at different future times, together with their changes relative to the present. At inference, the supervision branch is removed, and the action expert only uses the learned predictive state computed from current observations. Controlled ablations show that future supervision substantially improves generalization under distribution shift. ARPS achieves 99.2% success on LIBERO and transfers to LIBERO-Plus without adaptation, reaching 87.3% and exceeding Fast-WAM by 39.2 percentage points.

Vinh Canh-Thanh Truong, Hai-Binh Pham, Ngoc Hong Tran

TL;DR: 该研究首次将 ViT 和自监督对比学习用于虾病图像分类，在 4,348 张图像上建立健康、黑鳃、白斑病及混合感染识别基线。

Details

Motivation: 虾病持续给水产养殖带来严重损失，需要稳健自动检测；水产图像的标注数据有限，性能与标注成本需同时考虑。

Result: 作者提出两条深度学习流程识别四类状态：使用 ImageNet 预训练 ViT-Small/16 或 EfficientNet 的监督迁移学习，以及先在未标注图像上用 SimCLR 对比学习、再微调的 ViT-Small。数据集含 4,348 张图像。监督模型准确率达 96%，收敛快并超过通用传统模型；标签效率更高的自监督方案验证准确率为 85%，为可持续养殖监测建立新基线。

Insight: 监督迁移学习给出当前高准确基线，自监督预训练则可利用未标注养殖图像降低标注依赖；部署方案可按精度与数据成本权衡。

Abstract: Shrimp diseases continue to cause devastating losses in the aquaculture industry, driving a critical need for robust, automated detection. This work contributes the first application of Vision Transformers (ViT) and Self-Supervised Learning (SSL) to the shrimp farming domain, addressing both performance bottlenecks and data labeling challenges. We propose two deep learning pipelines to classify four key diseases: Healthy, Black Gill (BG), White Spot Syndrome Virus (WSSV), and a co-infection of both using a dataset of 4,348 images. First, our supervised transfer-learning approach leverages ImageNet-pretrained ViT-Small/16 and EfficientNet backbones. Second, we introduce a contrastive learning framework (SimCLR) with a ViT-Small encoder to extract robust representations from unlabeled images prior to fine-tuning. Our results establish strong new baselines for sustainable aquaculture monitoring. The supervised approach achieves an outstanding 96% accuracy with fast convergence, outperforming traditional generic models, while the label-efficient SSL approach reaches a highly competitive 85% validation accuracy.

[49] Semi-automated reconstruction of indoor geometry from 360-degree video for CFD-based airflow analysis in classrooms cs.CV | cs.CE | physics.flu-dynPDF

Dhruv Gamdha, James Afful, Shambhavi Joshi, Ulrike Passe, Adarsh Krishnamurthy

TL;DR: 该流程从单段室内 360° 视频重建可编辑、可重新布置的家具几何资产，再用于 OpenFOAM 教室通风和污染物输运模拟。

Details

Motivation: 建筑 CFD 通风分析规模化应用受三项限制：缺少低成本房间几何采集、难拆分可单独操作的物体，以及改变家具布局时往往需重新扫描或建模。

Result: 工作流用 NeRF 从全景视频重建稠密点云，将文本提示 SAM 3 的二维实例掩码通过多视角一致性和深度分带提升至三维，以八叉树分离物体、用连通图修补遮挡缺口；椅子通过 ICP 拟合模板，桌子程序生成。浏览器编辑器用于质量检查和快速创建不同布局，之后运行稳态 RANS OpenFOAM 并模拟瞬态被动标量输运，网格敏感性和 IEA Annex 20 基准用于验证。两间大学教室及阶梯礼堂中，每个房间采集至几何需消费级工作站 2–5 小时；家具增加时半清除时间非单调变化，跨房间结果也不可可靠外推。

Insight: 低成本逐房间几何采集可让布局级通风比较更实际；同样家具变化在不同房间的效果不同，不能只用通用房间假设推断污染物清除。

Abstract: Computational Fluid Dynamics (CFD) is widely used to evaluate ventilation and contaminant transport in occupied buildings, but deployment at scale is limited by three bottlenecks: acquiring room geometry without costly scanning hardware or manual CAD modeling, decomposing the scene into individually manipulable objects, and reconfiguring those objects for alternative layouts without re-capturing the room. We present a semi-automated workflow that converts a single 360-degree video of a room into individually editable, simulation-ready geometry assets. A dense point cloud is reconstructed using Neural Radiance Fields (NeRF), and 2D instance masks from text-prompted SAM 3 segmentation are lifted to 3D using multi-view consensus and depth-band filtering. Points are separated into object instances with an octree, and occlusion gaps are healed with a connectivity graph. Chair templates are fitted by Iterative Closest Point (ICP) alignment, and table geometry is generated procedurally. A browser-based editor supports quality assurance and rapid construction of alternative layout configurations. A steady Reynolds-averaged OpenFOAM solution then drives transient passive-scalar transport; the setup is verified using a mesh-sensitivity study and validated against an IEA Annex 20 benchmark. We apply the workflow to two university classrooms and a tiered lecture-hall auditorium. The capture-to-geometry pass takes two to five hours per room on a consumer workstation. In a controlled obstruction sequence in one classroom, the modeled half-clearance time varies non-monotonically as furniture is added, and a cross-room comparison indicates that clearance behavior cannot be reliably extrapolated between rooms, motivating per-room geometry acquisition. By making that acquisition low-cost, the workflow makes geometry-resolved comparative ventilation studies practical for spaces such as classrooms.

[50] RSPDBench: Benchmarking Vision Foundation Models on Earth Observation Tasks Under Physically Grounded Remote-Sensing Product Degradations cs.CVPDF

Tanjim Bin Faruk, Khondaker Masfiq Reza, Shrideep Pallickara, Sangmi Lee Pallickara

TL;DR: RSPDBench 用物理可信的空间、辐射、配准、噪声和协调缺陷评估地球观测视觉基础模型，并显示复合退化会产生超出单项影响的模型特定误差。

Details

Motivation: 地球观测模型通常在干净下游基准评测，但实际遥感产品送入模型前就可能含空间、辐射、对齐、噪声和跨传感器协调缺陷。通用图像扰动无法定位这些产品级风险。

Result: RSPDBench 覆盖五个 EO 数据集、七个基础模型设置和两个监督基线，在经审计的单项退化及复合产品链下测试。每个模型按自身干净协议建立基线，并以相对自身性能下降衡量鲁棒性。结果显示敏感性结构化：按分辨率或通道分组的编码器保护不同错误轴；相同物理缺陷可能损害一个模型却帮助另一个。复合链暴露孤立退化无法预测的故障，超出最强组成项的额外下降最高达 38 个百分点。

Insight: 遥感鲁棒性不能只看干净准确率或通用扰动；模型可能对特定产品加工缺陷产生非线性、模型特定响应，应测试完整复合链。

Abstract: Vision foundation models targeting Earth observation (EO) tasks are commonly evaluated on clean downstream benchmarks, but operational EO products can already contain spatial, radiometric, alignment, noise, and harmonization defects before reaching the model. Existing robustness evaluations often use generic image corruptions or broad domain shifts, which do not isolate these product-level failure modes. We introduce \textbf{RSPDBench}, a physically grounded \textbf{r}emote-\textbf{s}ensing-\textbf{p}roduct \textbf{d}egradation \textbf{b}enchmark for vision foundation models. RSPDBench evaluates five EO datasets, seven foundation-model entries, and two supervised baselines under audited primitive degradations and compound product chains. Each model is evaluated under its clean-selected native protocol, with robustness measured as the drop from its own clean baseline. Our analysis reveals that degradation sensitivity is strongly structured: resolution-conditioned and channel-grouped encoders protect different failure axes, and the same physical defect can hurt one model while helping another. Compound chains expose failures that isolated degradations do not predict, with model-dependent amplification, saturation, or component dominance, and excess drops up to $38$ percentage points beyond the strongest component. These results show that EO robustness cannot be characterized by clean accuracy or generic perturbation tests alone; it must also be measured against the structured defects that remote-sensing products carry into deployment.

[51] HOIBlender: Blending Lightweight Detection with Vision-Language Priors for Efficient Human-Object Interaction Detection cs.CVPDF

Junwen Chen, Keiji Yanai

TL;DR: HOIBlender 将检测器候选、主体-客体空间推理与 BLIP-2 语义先验融入轻量解码器，在较少训练轮次下改善长尾人-物交互检测。

Details

Motivation: HOI 检测需定位交互的人物-物体对并识别连接动词，常面临严重长尾监督。近期方法靠更强检测器和视觉语言先验提升，但常叠加重型 Transformer、复杂去噪和后处理语义校准。

Result: HOIBlender 基于 RF-DETR/LW-DETR 风格骨干和 DINOv2，从多尺度投影器选取图像条件 top-K token 作为主体与客体候选，移除既有方法的专用编码器阶段。双阶段解码先稳定人-物几何，再逐步融合 BLIP-2 先验进行动词及 HOI 分类，并以 BLIP-2 文本嵌入初始化长尾类别分类器；分组查询训练不增加推理成本。Nano、Small、2XL 三种规模在 HICO-DET 上超过 SOV-STG-VLA 和 Hybrid-SOV-VLA，9 个 epoch 达 44.49 Default Full mAP，延迟和参数量仍具竞争力。

Insight: 检测器空间 token、结构化主体-客体关系和视觉语言语义可在轻量解码中协同，而不一定需要额外重型编码器。

Abstract: Human-object interaction (HOI) detection requires grounding an interacting human-object pair and recognizing the verb that links them, often under severe long-tail supervision. Recent methods improve accuracy with stronger detectors and vision-language priors, but many still stack heavy transformer encoders, intricate denoising schedules, or post-hoc semantic calibration on top of the detector. We present \textbf{HOIBlender}, an efficient HOI detector named after its core design principle: blending detector-grounded visual tokens, spatial subject-object reasoning, and BLIP-2 semantic priors inside one lightweight decoding pipeline. HOIBlender builds on an RF-DETR/LW-DETR-style foundation with a DINOv2 backbone and selects top-$K$ image-conditioned tokens directly from the multi-scale projector as subject and object candidates, removing the dedicated encoder stage retained by prior HOI methods. A dual-stage decoder first stabilizes human-object geometry and then performs verb and HOI classification through progressive BLIP-2 prior fusion, with classifier weights initialized from BLIP-2 text embeddings for long-tail categories. Grouped-query training further enriches optimization without increasing inference cost. Across three model scales (Nano, Small, 2XL), HOIBlender consistently outperforms SOV-STG-VLA and Hybrid-SOV-VLA on HICO-DET, reaching $44.49$ Default Full mAP in only $9$ training epochs while maintaining competitive latency and parameter budgets. These results show that lightweight detection, structured spatial-semantic decoding, and deeply integrated vision-language priors can be blended into a single efficient HOI pipeline.

[52] GAPS: Generative Active Pseudo-view Selection for Sparse-View 3D Gaussian Splatting cs.CVPDF

Hongfei Zhu, Haochen Deng, Sitao Zhang, Ling Zhou

TL;DR: GAPS 交替优化稀疏视角 3DGS 与扩散生成伪视图，按训练阶段从插值过渡到外推选视角，并筛除不可靠伪监督。

Details

Motivation: 少视图新视角合成高度欠约束，3DGS 在视图稀疏时常出现漂浮点、破碎几何和背景褪色；额外伪视图虽能扩展监督，也可能生成错误几何。

Result: 框架用深度条件 ControlNet、IP-Adapter、LoRA 场景适配和 img2img 结构锚定生成几何一致伪视图。GAPS 视图选择在训练初期偏保守插值，后期逐渐探索未见区域外推；双标准准入门和不确定性加权损失拒绝不可靠样例，密度自适应 DropGaussian 抑制复杂场景过拟合。LLFF 3/6/9 视图下 PSNR 分别比原始 3DGS 高 0.40/0.89/0.70 dB，Mip-NeRF 360 12/24 视图高 1.18/0.80 dB；所有设定 SSIM 提升且 LPIPS 降低。

Insight: 生成式伪视图带来的收益取决于视角的信息价值和生成可靠性；逐步从内插转向外推可在训练早期稳几何、后期补覆盖。

Abstract: Novel view synthesis from sparse observations is severely under-constrained. Although 3D Gaussian Splatting (3DGS) enables real-time rendering, it produces floaters, broken geometry, and washed-out backgrounds when trained with few views. We propose an alternating optimization framework that uses a pre-trained image diffusion model to generate geometrically consistent pseudo-views for additional 3DGS supervision. Generation is constrained by depth-conditioned ControlNet, IP-Adapter style transfer, LoRA scene adaptation, and img2img structural anchoring. We introduce Generative Active Pseudo-view Selection (GAPS) to balance reconstruction informativeness and generative reliability when choosing target views. Its annealing schedule shifts from conservative interpolation early in training to exploratory extrapolation later, gradually covering unobserved regions. A dual-criterion admission gate and uncertainty-weighted losses reject unreliable generations, while density-adaptive DropGaussian reduces overfitting in complex scenes. On LLFF with 3/6/9 views, our method improves average PSNR over vanilla 3DGS by 0.40/0.89/0.70 dB. On Mip-NeRF 360 with 12/24 views, the gains are 1.18/0.80 dB. SSIM improves and LPIPS decreases in every setting. Ablations show that active selection and density-adaptive regularization are both necessary; only the full method reduces LPIPS below the no-pseudo-view baseline on unbounded 360-degree scenes.

[53] PhysReflect: Geometry and Perception Guided Diffusion for Physically-Plausible Mirror Reflections cs.CV | cs.AIPDF

Shuheng Ge, Hongwei Ren, Li Zhang, Xiangqian Wu

TL;DR: PhysReflect 在训练时将预测潜变量解码到像素空间，并施加稀疏极线对应、边界投影、语义和光照一致性目标，以改善扩散模型的镜面反射物理合理性。

Details

Motivation: 扩散模型图像质量高，却常违反镜面反射几何规律，出现位置偏移、方向错位、比例失衡和结构畸变。只用潜空间噪声重建损失无法直接约束反射特有几何和感知条件。

Result: PhysReflect 每个训练步将预测干净潜变量解码到像素空间，施加逐渐退火的可微几何与感知监督。几何损失通过稀疏极线对应和稠密边界投影对齐反射空间一致性，SAM2 TwinTrack 负责稳定镜内定位；感知损失结合 DINOv2 语义一致性保持反射物体身份外观，以及由单目几何先验引导的深度、法线和照明一致性。在合成和真实基准上，几何、感知、物理合理性指标及视觉效果均超过既有反射生成方法。

Insight: 反射错误需分别约束几何位置和外观光照；训练时显式解码并施加像素级对应，比期待潜空间重建损失隐式学会镜面规律更直接。

Abstract: Diffusion models generate high-quality images, yet often violate the physical laws governing mirror reflections. Reflections often suffer from geometric aberrations, including positional offsets, directional misalignment, proportional imbalance, and structural distortion. These failures remain evident even in contemporary state-of-the-art generative systems. Existing methods itigate this problem through synthetic data scaling or auxiliary depth conditioning, yet their merely reliance on latent-space noise reconstruction losses as implicit supervision prevents direct enforcement of reflection-specific geometric and perceptual constraints. To bridge this gap, we present PhysReflect, a geometry and perception guided diffusion framework that decodes the predicted clean latent into pixel space at each training step and applies annealed supervision through two complementary differentiable objectives. The Geometric Loss enforces mirror-induced spatial consistency through sparse epipolar correspondence and dense boundary projection alignment, where a SAM2-based TwinTrack mechanism provides stable in-mirror localization for boundary-aware supervision. The Perceptual Loss preserves reflected appearance by combining Semantic Consistency Loss, which maintains reflected identity and appearance via DINOv2 features, and Lighting Consistency Loss, which regularizes depth, surface-normal, and illumination coherence under monocular geometry priors. Experiments on synthetic and real-world benchmarks show that PhysReflect outperforms prior mirror-reflection methods in geometric, perceptual, and physical-plausibility metrics, as well as qualitative visual results.

[54] Algebraic Consistency Alone Does Not Certify Temporal Structure in Latent Action Models cs.CV | cs.ROPDF

Di Wen, Ruodi Zhang, Kailun Yang, Kunyu Peng

TL;DR: 该研究指出潜在动作的可加和及反对称代数误差并不能证明学到了时间结构，因为解码器可能对任意帧配对都满足这些性质。

Details

Motivation: 潜在动作模型从无动作标签视频两帧间推断动作码，近期方法用可加组合和反向反对称等代数误差大幅下降，声称其构成时间结构学得良好的无标签证据。

Result: 作者分析重建目标会驱动解码转移接近状态特征差值，使两种代数恒等对任意配对均成立，无法区别真实时间动作与状态/坐标惯例。五个源域上，无约束模型本身就能达到相对未训练锚点 83%–97% 的误差下降；残余误差还显著依赖解码器族。破坏时间配对后重新训练的约束模型，在每个域的误差仍低于真实配对无约束模型。LIBERO-GOAL/SPATIAL 下保留时间配对无一致优势，多个机械臂上代数误差越低，动作线性可解码性反而越差。对比式违规目标也只带来边际区分。

Insight: 代数自洽并不自动代表时间语义；评测应包括基线校正、破坏配对后重训和随机种子预算分析，检验指标能否区分真实时间结构。

Abstract: Latent action models infer a code for the transition between two frames of action-free video. Recent methods regularise this code to compose additively and reverse antisymmetrically, and report order-of-magnitude reductions in the resulting errors as a label-free certificate that the code has captured temporal structure. We show that this conclusion does not follow. Reconstruction drives the decoded transition toward a difference of state features, for which both identities hold for any pairing, a solution the metric cannot distinguish from one encoding nuisance state or a coordinate convention. Across five source domains, a trained but unconstrained counterpart already achieves 83-97% of the reduction relative to an untrained anchor. The residual fold is governed as much by the decoder family as by what is learned. A constrained model retrained after its temporal pairing is destroyed still reaches, in each domain, a lower error than the unconstrained model on real data. Downstream, preserving the temporal pairing yields no consistent advantage on LIBERO-GOAL or LIBERO-SPATIAL, and across the tested arms the code’s mean linear action decodability falls as the algebraic error improves. We also test the most direct repair, a violation-contrastive objective that requires the algebra to fail on destroyed pairings: in the tested configurations it yields only a marginal separation within the reconstruction budget, on training and test triples alike. We recommend a validation protocol that these methods currently lack: a baseline-corrected metric, retraining on destroyed pairings, and a seed-budget analysis.

[55] CE$^4$L: Continual Ego, Exo, and Ego-Exo Learning cs.CV | cs.AIPDF

Hongwei Yan, Kanglei Zhou, Yuchen Liu, Qingyu Shi, Yi Zhong

TL;DR: CE⁴L 是涵盖自我中心、他视角及两者协同的持续学习基准，提出用任务特定白化子空间残差进行免训练 VISTA 适配器路由。

Details

Motivation: 具身感知以视频为基础，常同时涉及自我/他人视角及任务、视点变化，但持续学习研究多限于第三人称识别，掩盖真实联合变化。

Result: CE⁴L 统一评测四种多视角持续学习任务：跨视角指代技能评估、时序动作分割、跨视角关联，以及动作预测与规划，突出跨视角对应、视角异步和语义目标异构等挑战。作者提出 VISTA，将任务专属更新存入轻量适配器，并依据二阶统计估计的任务特定白化子空间，通过残差距离免训练路由。大量实验显示代表性持续学习方法在不同设定下效果差异大，VISTA 稳定具竞争力并取得总体先进表现。

Insight: 具身持续学习需同时考虑任务变化和观察视角变化；轻量适配器可存储专门更新，子空间路由则避免为每个样例再训练路由器。

Abstract: Perception for embodied agents is video-based, often multi-view (ego, exo, or both), and inherently continual, with simultaneous task and viewpoint shifts. Yet continual learning (CL) remains dominated by exo-only recognition tasks, obscuring behavior under these real-world coupled shifts. We introduce Continual Ego, E}xo, and Ego-Exo Learning (CE$^4$L), a unified multi-view CL benchmark spanning four representative tasks: cross-view referenced skill assessment, temporal action segmentation, cross-view association, and action anticipation & planning. CE$^4$L highlights challenges largely absent in prior CL benchmarks, including cross-view correspondence, view-dependent asynchrony, and heterogeneous semantic objectives. To this end, we propose Video Incremental Subspace-routed Task Adapters (VISTA), a parameter-efficient baseline method that stores task-specific updates in lightweight adapters and performs training-free routing via residual distance to task-specific whitened subspaces estimated from second-order statistics. Extensive experiments demonstrate the significantly varied efficacy of representative CL methods across CE$^4$L settings, while VISTA is consistently competitive and achieves state-of-the-art overall performance. Our source code for benchmarks and methods is available at https://github.com/AnAppleCore/CE4L .

[56] Pay More Attention To Text In High-Resolution MLLMs cs.CVPDF

Zhongkuan Mao, Wenzhuo Zhao, Xianjie Liu, Yidong Wang, Zhao Gao

TL;DR: EviSpec把回答型问题编译成明确的视觉证据规格，帮助高分辨率多模态模型定位真正需要查看的内容。

Details

Motivation: 高分辨率模型常被认为缺少视觉证据，但已有表示可能已包含相关信息；问题本身未说明应定位何种证据，可能才是瓶颈。

Result: 固定搜索预算下，结构化证据规格较通用请求相对提升8.6%；在五个模型、三个基准上均优于对应基线，平均相对提升为10.4%、8.8%和12.4%。

Insight: 控制实验区分了“说明要找什么”与“增加视觉访问”的收益；证据规格能提升定位和问答表现，且在VQA及幻觉基准上达到当时最佳结果。

Abstract: Failures of high-resolution MLLMs are commonly attributed to a visual problem, motivating zooming, cropping, and related visual interventions to recover fine-grained evidence or suppress interference. Yet recent studies suggest that relevant visual evidence is already encoded in intermediate representations, indicating that visual-side improvements alone insufficient. This raises a natural question: does the remaining bottleneck lie in the text that guides visual search? We identify a previously overlooked linguistic bottleneck: questions formulated for answering do not necessarily specify the visual evidence required for localization. To address this mismatch, we introduce EviSpec, a training-free compiler that derives complementary evidence specifications while preserving the original question for final reasoning. We further validate it through matched-control experiments that isolate the roles of evidence specification and localization. With the search budget fixed, structured evidence specifications yield an 8.6% relative gain over generic requests. With evidence geometry matched, the evidence localized by EviSpec yields a 14.8% relative gain over random evidence. Together, these controls isolate the benefit of specifying what evidence to seek rather than merely expanding visual access. Across all five MLLMs, EviSpec consistently improves upon the corresponding baseline on each of the three benchmarks, yielding average relative gains of \textbf{10.4%, 8.8%, and 12.4%} on V\textsuperscript{*}Bench, HR-Bench-4K, and HR-Bench-8K, respectively. Beyond high-resolution reasoning, EviSpec also achieves state-of-the-art performance on VQA and hallucination-focused benchmarks.

[57] Detecting Phone-Induced Pedestrian Distraction via a Multimodal Fusion Transformer cs.CVPDF

Yuanzhe Li, Hounian Liu, Xiaotong Chang, Yidi Huang

TL;DR: 提出融合人体姿态与行人图像的时序Transformer，用于识别行人是否因使用手机而分心。

Details

Motivation: 发短信、看视频和通话等手机活动会分散行人注意力，可靠识别有助于自动驾驶系统评估风险并安全规划。

Result: 在含287名行人、20,741张图像的人工标注数据集上，模型总体准确率为95%，比六种基线高6个百分点。

Insight: 骨架动态与外观提供互补线索；跨模态注意力融合两种表征，随后用时序Transformer建模连续帧依赖。

Abstract: The increasing reliance on mobile phones has made phone-induced pedestrian distraction increasingly prevalent. Activities such as texting, watching videos, and making phone calls have become significant contributors to traffic accidents. Reliable detection of pedestrian distraction is essential for autonomous vehicles, as it improves situational awareness and enables timely risk assessment, thereby supporting safe motion planning and vehicle control. We propose a multimodal fusion Transformer (MFT) for detecting phone-induced pedestrian distraction. MFT jointly extracts skeletal dynamics from body pose keypoints and visual appearance features from pedestrian images, effectively leveraging the complementary information provided by the two modalities. A cross-modal attention module is proposed to capture inter-modal dependencies through multi-head cross-attention, facilitating effective fusion of complementary information across the two modalities. Then, a temporal attention fusion module, implemented with a Transformer encoder, is employed to capture temporal dependencies. MFT is trained and evaluated on a manually annotated dataset comprising 287 pedestrian instances with 20,741 images. Extensive experiments demonstrate that MFT attains an overall accuracy of 95%, exceeding the performance of six baseline approaches by 6%.

[58] GeoBalance: Geometry-Aware Monitoring and Reconstruction with Asymmetric Optimization for Balanced Multimodal Learning cs.CV | cs.MMPDF

Zechang Xiong, Da Li, Rong Yin, Kexin Tang, Biao Yang

TL;DR: GeoBalance监测多模态表征的几何塌缩，并在弱模态失衡时重构其特征，以改善联合分类学习。

Details

Motivation: 既有平衡方法常把弱模态视为仅仅训练不足；作者观察到长期模态主导还可能令弱模态类内方向减少、类间可分性下降。

Result: 在六个多模态基准上的实验显示，该方法相较有竞争力的模态平衡方法取得显著改进。

Insight: 方法用固定Simplex-ETF类别结构和谱正则恢复弱模态几何，并以非对称梯度投影移除与重构相冲突的联合梯度分量。

Abstract: Multimodal classifiers can converge to modality-dominant solutions in which one modality dominates the joint prediction, suppressing the learning of others. Existing balancing methods mainly adjust losses, gradients, or modality contributions, largely treating modality imbalance as an optimization problem while implicitly treating the weak modality as under-optimized but representationally intact. In this work, we find that this assumption does not always hold, as persistent modality dominance can induce a representation-level collapse of the weak modality, which we term \emph{manifold modality collapse} (MMC). MMC manifests as a coupled geometric degradation in which weak-modality representations collapse onto fewer directions within each class and become less separable across classes. Motivated by this observation, we propose \emph{GeoBalance}, a geometry-aware framework that monitors these two geometric properties and reconstructs the weak modality representation only when it exhibits signs of MMC. Once triggered, GeoBalance uses a fixed Simplex-ETF class scaffold and spectral regularization to restore class separation while preventing collapse onto a few feature directions. To preserve reconstruction during joint training, asymmetric gradient projection removes the joint-gradient component conflicting with reconstruction, leaving non-conflicting optimization unchanged. Extensive experiments across six multimodal benchmarks demonstrate great improvements over competitive balancing methods, validating its effectiveness.

[59] Towards robust multimodal 3D object detection via visual foundation models cs.CV | cs.ROPDF

Ziying Song, Lin Liu, Hongyu Pan, Shaoqing Xu, Lei Yang

TL;DR: RoboDistill利用自动驾驶视觉基础模型特征与知识蒸馏，增强激光雷达—相机三维检测在分布外扰动下的鲁棒性。

Details

Motivation: 多模态三维检测融合相机与激光雷达，但传感器噪声、恶劣天气和环境变化会导致现有模型性能不稳。

Result: 在27种分布外腐蚀设置中，RoboDistill总体取得较代表性先进方法更强或相当的检测性能与鲁棒性。

Insight: 框架先用自动驾驶图像适配SAM，再通过多尺度特征金字塔和深度引导小波注意力与点云融合；另以适配后的SAM教师向轻量点云网络蒸馏知识。

Abstract: Multimodal 3D object detection is fundamental to robust perception in autonomous driving because it integrates complementary information from LiDAR and camera sensors. However, existing methods often fail to maintain robustness under out-of-distribution (OOD) corruptions caused by sensor noise, adverse weather, and environmental changes. To address this problem, we propose RoboDistill, a robust and generalizable multimodal 3D object detection framework that leverages visual foundation models (VFMs), such as the Segment Anything Model (SAM). First, we introduce SAM-AD, a domain-specific pretraining strategy that fine-tunes SAM on autonomous-driving imagery to extract feature representations with rich semantic information. Second, we design the AD Feature Pyramid Network (AD-FPN) to refine and upsample SAM features at multiple scales for seamless fusion with LiDAR features. Third, we develop the Depth-Guided Wavelet Attention (DGWA) module, which suppresses high-frequency sensor noise while preserving critical contextual information. Finally, we introduce KD Fusion, in which the pretrained SAM-AD serves as a teacher that distills high-quality visual knowledge into a lightweight point-cloud network, thereby improving robustness under noisy conditions. Extensive experiments across 27 challenging OOD corruption settings show that RoboDistill generally delivers stronger or competitive detection performance and robustness relative to representative state-of-the-art methods. This work bridges the gap between VFMs and 3D object detection and advances robust multimodal perception for real-world autonomous-driving applications.

[60] Modeling Clinical Workflow for SYNTAX Scoring from Coronary Angiography Videos cs.CV | cs.AIPDF

Suzhong Fu, Jingqi Dong, Xuan Ding, Rui Sun, Yiming Yang

TL;DR: 将冠状动脉造影视频中的SYNTAX评分改写为保留血管段身份的分层解剖推理流程。

Details

Motivation: 自动评分常直接从视频回归患者级分数，难以对应临床分析过程；专科数据不足也限制了可靠建模。

Result: 血管段级狭窄表征使预测更具解释性，R²提高0.201，开发集标准差降低18.4%；研究还整合并补全了多个公开造影数据集及结构标注。

Insight: 跨帧和视角维持血管段身份，先估计段级狭窄程度，再依冠状动脉解剖逐级汇总证据，有助于稳定多视角评分。

Abstract: The SYNTAX score is a clinically established tool for assessing anatomical lesion complexity in coronary artery disease and guiding subsequent treatment. However, automated SYNTAX scoring is commonly formulated as a direct regression problem from coronary angiography videos to patient-level scores. In this work, we reformulate SYNTAX scoring as a vessel segment identity-preserving anatomical reasoning problem and propose a hierarchical modeling framework that explicitly aligns learning with the clinical workflow. Our approach maintains vessel segment identity across frames and views, estimates stenosis severity at the segment level, and aggregates evidence hierarchically according to coronary anatomy. Simultaneously, to address the scarcity of domain-specific data, we integrate and complete multiple public coronary angiography datasets, constructing a large-scale resource featuring completed vessel segmentation and derived structural annotations. Experiments demonstrate that vessel segment-level stenosis embedding enhances explanatory power and reduces prediction variability compared to baseline models, with the R^2 score improving by 0.201 and dev STD decreasing by 18.4%. These results highlight the necessity of structure-aligned modeling for reliable and stable automated SYNTAX scoring from multi-view coronary angiography videos. The GitHub link is https://github.com/VersaceSu7/SYNTAX_score_777.

[61] Transferring Visual Explanations: How Cross-Architecture Knowledge Distillation Affects Model Interpretability cs.CVPDF

Aleks Czufarow, Ihor Babin

TL;DR: 研究跨架构知识蒸馏能否把教师网络的空间归因传给紧凑学生模型，并发现粗粒度定位与细粒度解释的迁移并不相同。

Details

Motivation: 资源受限场景需要小模型，但压缩可能损害安全关键任务所需的可解释性；作者用Grad-CAM归因指标评估蒸馏影响。

Result: ResNet-152蒸馏到ResNet-34时，学生准确率为71.6%至74.0%；细粒度归因在所有配置中均低于未蒸馏基线，12种卷积与Transformer架构组合也显示学生结构会限制空间推理继承。

Insight: 解释性对软标签权重比温度更敏感：更多依赖硬标签可保留准确率与粗定位；logit蒸馏较易传递关注区域，难以传递像素级归因结构。

Abstract: Deploying efficient neural networks is essential in resource-constrained environments, yet compact models often sacrifice interpretability - a critical in safety-critical domains such as autonomous driving and medicine. This study investigates whether Knowledge Distillation transfers the spatial feature attribution of a large teacher network to a compact student. To assess the influence of the KD scheme on interpretability, we distill a ResNet-152 teacher into a ResNet-34 student on ImageNet-1K across five configurations by systematically varying the distillation temperature and soft-label loss weight. Models are evaluated on top-1 accuracy, along with two interpretability metrics: Relevance Mass Accuracy and Relevance Rank Accuracy. These metrics are computed via Grad-CAM heatmaps benchmarked against ground-truth object masks. Our results show that top-1 accuracy ranges from 71.6% to 74.0%. For Grad-CAM, RMA ranges from 7.7% to 9.7% and RRA from 7.3% to 10.1%; for Guided Grad-CAM, RMA ranges from 16.1% to 18.6% and RRA from 15.9% to 21.5%. Interpretability proves far more sensitive to the soft-label weight than to the temperature: keeping the student anchored to hard labels preserves both accuracy and coarse localization, whereas weighting the teacher heavily degrades both. Fine-grained attribution, however, fell below the undistilled baseline in every configuration tested, indicating that logit distillation transmits where a model attends more readily than the pixel-level structure of that attention. We evaluate 12 cross-architecture combinations of convolutional and transformer-based models, revealing that the inheritance of fine-grained spatial reasoning is fundamentally bottlenecked by the student’s intrinsic structural biases. To our knowledge, this is the first application of this interpretability-aware evaluation framework - previously used for neural network pruning - to KD.

[62] MaskVLA: Visual Masking Against Trajectory Overfitting of Vision-Language-Action Model cs.CV | cs.AI | cs.ROPDF

Yuxuan Jiang, Jiaying Huang, Ge Wang, Shenhao Yan, Jiahao Yang

TL;DR: MaskVLA在微调时随机遮挡少量主摄像头信息，以减少视觉语言动作模型对训练轨迹的过拟合。

Details

Motivation: 在有限数据上微调的VLA模型容易记住轨迹；作者希望引导模型更有效使用腕部相机线索并提升操作泛化。

Result: 在RoboTwin 2.0上，平均成功率较π₀和OpenVLA-OFT分别提高23.2%和16.8%；真实ALOHA机器人实验也显示有效。

Insight: 训练期间对主视角做少量随机视觉遮挡，促使模型学习更细致、与任务相关的特征，并形成更稳健的控制策略。

Abstract: Vision-Language-Action (VLA) models integrate vision-language understanding with executable robot actions, enabling end-to-end learning for robot control. However, our empirical analysis reveals that existing models exhibit severe trajectory overfitting when finetuned on limited datasets. To guide the model in effectively utilizing wrist camera information, we propose MaskVLA, a masking-based fine-tuning strategy. By randomly masking a small portion of the main camera’s visual information, the model is guided to autonomously learn more fine-grained, task-relevant, and effective visual features. This process leads to the emergence of robust policies, thereby enhancing the model’s capability to tackle complex manipulation tasks and improving its generalization performance. Our method has been comprehensively evaluated on RoboTwin 2.0, achieving an average success rate improvement of 23.2% and 16.8% compared to $π_0$ and OpenVLA-OFT, respectively. Furthermore, experiments on real-world ALOHA robots also demonstrate the effectiveness of our approach.

[63] An Efficient and Effective Watermarking Scheme for the Protection of the Intellectual Property Rights of Video Generative Models cs.CVPDF

Wenhong Huang, Jianwei Fei, Benedetta Tondi, Bin Ma, Fangjun Huang

TL;DR: 提出VidMark视频生成模型内嵌水印方案，用于验证合成视频来源和检测模型盗版复制。

Details

Motivation: 视频生成模型能产生逼真内容，带来知识产权保护需求；合成视频验证与模型所有权验证仍缺少统一处理方法。

Result: 在代表性生成模型实验中，水印提取准确率超过99%，两类验证任务准确率均为100%，对生成质量影响可忽略，并能抵御多种视频和模型攻击。

Insight: VidMark结合双尺度离散小波分解与全局时序注意力；冻结解码器引导生成模型微调，使其生成难察觉、稳健且与模型绑定的水印视频。

Abstract: The rapid development of video generative models (VGMs) has enabled the generation of highly realistic synthetic videos, raising concerns about the intellectual property rights (IPR) of these models. In particular, two closely related forensic tasks remain largely unaddressed: synthetic video verification (determining whether a video was generated by a protected VGM) and model ownership verification (determining whether a suspect VGM is an unauthorized copy of a protected VGM). In this paper, we propose a new in-generation watermarking scheme that can address the two verification tasks. First, a novel video watermarking network named VidMark is presented, which incorporates a two-scale discrete wavelet transform (DWT) decomposition and a global temporal attention block (GTAB) to enhance watermark robustness and imperceptibility. Second, we present a decoder-guided fine-tuning procedure. By leveraging the frozen VidMark decoder, this process enables VGMs to synthesize videos carrying an imperceptible, robust, and model-specific watermark. Finally, two verification frameworks are established to perform synthetic video verification and model ownership verification. Extensive experiments on representative VGMs demonstrate that the proposed scheme achieves over 99% watermark extraction accuracy and 100% verification accuracy on both tasks, with negligible impact on video generation quality. Furthermore, the watermarks exhibit strong robustness against a comprehensive range of video-level and model-level attacks.

[64] Collapse, Not Complexity: Failure-Conditioned Decomposition Repair for End-to-End Document Parsing cs.CV | cs.CLPDF

Xingyu Lin, Dehui Du

TL;DR: 针对端到端文档解析中的失败页面，提出先检测普通解析塌缩、再按版面投影分区重解析的修复流程。

Details

Motivation: 研究发现是否启用推理模式不能由页面复杂度可靠决定，且推理模式通常无法修复普通解析已塌缩的页面。

Result: 普通解析加推理平均质量反降2.21分且耗费1.54倍token；失败条件修复提升1.40分、耗费1.13倍token，并在三个检查点和另1,175页基准上复现增益。

Insight: 塌缩页反而可能版面熵更低，却会因重复输出消耗大量token；用普通输出轨迹识别失败，再依据投影切分区域，比单纯切换推理模式有效。

Abstract: End-to-end document parsers increasingly offer an optional reasoning mode for complex pages. On a 180-page entropy-stratified discovery sample with one frozen 4B checkpoint, complexity is the wrong decision variable. Reasoning lowers mean quality by 2.21 Overall at 1.54x tokens; a preregistered input-only model cannot predict its signed benefit (held-out AUROC 0.47, indistinguishable from chance). The benefit concentrates on pages whose ordinary pass has already collapsed, and they do not look complex: shared collapses have lower layout entropy than healthy ones yet consume 19x the tokens as degenerate repetition that doubling the budget does not cure. Switching modes rarely repairs them: 83% recur under reasoning. We instead detect collapse from the ordinary-pass trace, decompose the page by projection, and re-parse each region. Repair gains 1.40 Overall (95% CI [0.68, 2.16]) at 1.13x tokens, replicates across three checkpoints, and, with all parameters frozen, gains 2.41 (CI [1.64, 3.46]) on the remaining 1,175 benchmark pages.

[65] PETR: Prompt Ensembling with Training-free Routing for Vision-Language Models cs.CV | cs.AIPDF

Weihan Cai, Hao Tan, Xinping Gao, Shibiao Xu, Jun Wan

TL;DR: PETR为视觉语言模型学习两种互补提示，并在推理时按样本与训练数据的相似度进行免训练路由。

Details

Motivation: 提示学习常提升已见类别表现却损害未见类别泛化；作者希望在两者间自适应选择合适提示。

Result: 在11个基准数据集上，PETR对已见与未见类别均持续优于既有方法，并取得新的最佳结果。

Insight: 双提示分别侧重已见类判别和未见类泛化，训练时共享冻结CLIP骨干并统计logit；推理时用测试样本对已见数据的相似度路由，避免训练路由器的不稳定和负载失衡。

Abstract: Prompt learning efficiently adapts vision-language models (VLMs) to downstream tasks, but gains on seen classes often come at the expense of generalization to unseen classes. To address this limitation, we propose prompt ensembling with training-free routing (PETR), whose key innovation is a carefully designed dual-prompt architecture: two complementary prompts are learned from different data and objectives to emphasize seen class discrimination and unseen-class generalization, respectively. During training, both prompts are fine-tuned using a shared frozen CLIP backbone, and statistical information is collected from the training set logits. At inference time, we determine the similarity of each test sample to seen data, and route the sample to the most appropriate prompt branch. To the best of our knowledge, this is the first prompt tuning framework that performs training-free adaptive routing based on statistical similarity. This design provides an interpretable routing signal and avoids common MoE-style routing pathologies, such as router training instability and load imbalance. Extensive experiments on 11 benchmark datasets demonstrate that our framework consistently outperforms previous methods on both seen and unseen classes, achieving new state-of-the-art results.

[66] PREM: Prefix-Steered Recurrent Memory for Long-Video Understanding cs.CV | cs.AIPDF

Siru Zhong, Qiongyan Wang, Xiaohui Lv, Yuzheng Zhuang, Shuai Tao

TL;DR: PREM用无额外记忆token的循环记忆状态，为冻结视觉语言模型提供长视频检索和问答所需的信息。

Details

Motivation: 长视频理解需要在严格token预算中保留瞬时视觉证据；已有方法常压缩帧、追加记忆token或改动内部KV缓存。

Result: 在六个长视频基准的离线和流式设置中，PREM在所有评估视觉预算下优于冻结基线；16帧预算时Qwen2.5-VL-3B宏平均准确率提升3.06%。

Insight: 循环写入器把视频压入256 KiB多槽关联状态；问题条件读出再调节现有非视觉提示前缀的键值，无需增加提示token或在解码时循环，调优参数仅占骨干0.24%。

Abstract: Long-video understanding must capture transient visual evidence under strict token budgets, yet existing methods compress frames, append memory tokens, or alter internal key-value (KV) caches. We introduce Prefix-Steered Recurrent Memory (PREM), a memory-token-free framework for frozen vision-language models (VLMs). PREM separates video ingestion from query answering: a recurrent writer distills visual streams into a compact 256 KiB multi-slot associative state, while a question-conditioned readout adds memory-derived key/value (K/V) steering modulations to existing non-visual prompt prefixes during prefill. This enables write-once, query-many inference without extra prompt tokens or decoding recurrence. Across six long-video benchmarks in offline and streaming end-of-stream settings, PREM consistently outperforms frozen baselines at every evaluated visual budget. Under a constrained budget of 16 frames, PREM improves macro-average accuracy by 3.06% on Qwen2.5-VL-3B, with gains of 11.0% on action antonym identification and 9.9% on localized needle retrieval. These gains require tuning 0.24% of backbone parameters at 0.03 GiB of peak GPU memory overhead.

[67] Reassessing Global Gradient-Norm Imbalance in BLIP Fine-Tuning Across Physical Domains cs.CVPDF

Kiran Naseer, Samreen Azhar, Dwarikanath Mahapatra

TL;DR: 跨三个物理领域检验BLIP微调中的梯度范数失衡，发现单纯降低失衡并不能稳定预测图像描述性能。

Details

Motivation: 视觉与语言路径梯度幅度不同常被视为需纠正的缺陷；研究考察这种判断是否适用于水下、航空和放射图像域偏移。

Result: 九种微调设置、三随机种子下，失衡程度随领域显著变化且排序不可预测；降低学习率通常能显著减小失衡并接近最佳BLEU，而强制梯度相等在不同数据集上分别表现最好和最差。

Insight: 梯度比下降不保证跨领域描述质量提升，达到平衡的方式与平衡水平同样重要；此外，常用BLIP LoRA配置实际未适配视觉参数，修正后三个数据集BLEU-4均改善。

Abstract: Imbalanced gradient magnitudes between the visual and language pathways of a vision-language model are often treated as a defect to be corrected. We test that premise for one family of correction, deliberately excluding adaptive, signal-driven schemes (e.g. BalGrad, OGM, PMR, CGGM), which are a mechanistically distinct class outside this study’s scope. Measuring the language-to-visual gradient-norm ratio, reported in parameter-normalised form, across nine fine-tuning conditions, three seeds, and three captioning datasets spanning distinct physical domain shifts – underwater, aerial, radiological – we find imbalance magnitude varies markedly across domains with no predictable ordering. A plain learning-rate reduction cuts imbalance substantially and lands within a few BLEU points of the best method on every dataset. Staged freezing reduces the ratio on every domain yet never ranks first; a schedule-only control isolates freezing as the cause on one dataset but not the other two. Forcing the two gradient groups to equal magnitude drives per-parameter imbalance close to zero on every domain, yet is both the best result in the study and the worst placement among full fine-tuning methods, on different datasets, with identical settings. Reductions in gradient-norm ratio do not consistently predict captioning performance across domains, and how a given level of balance is reached matters as much as the level itself. As a secondary finding, a commonly reused LoRA configuration applied to BLIP silently adapts zero visual parameters; correcting it improves BLEU-4 on all three datasets.

[68] Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanisms cs.CV | cs.LGPDF

Yueyan Li, Haibo Wang, Caixia Yuan, Xiaojie Wang

TL;DR: 研究视频扩散模型违反物理规律的内部原因，并通过按去噪阶段调节RoPE频率改善运动轨迹生成。

Details

Motivation: 高质量视频仍常出现物理不合理运动；作者希望从模型内部机制解释，而非仅依赖外部先验或专门数据。

Result: 训练免和训练式实验均显示，所提轻量RoPE频率调节能增强生成视频的物理常识表现。

Insight: 分析发现早期去噪阶段形成运动规划，RoPE造成的空间注意力过度衰减会使不合理位置过早锁定并压制邻近帧的可行轨迹；分阶段调频可缓解这一问题。

Abstract: Despite impressive visual quality, state-of-the-art video diffusion models often generate content that violates real-world physical laws. While existing solutions rely on external priors or specialized data, we investigate the root cause by exploring the internal mechanisms of these models. Specifically, we present the first interpretability study on the ‘’motion planning’’ process of text-to-video diffusion models, revealing how motion trajectories form during early denoising stages. Building upon the ‘’first shape, then details’’ finding, we combine cross-attention trajectory patterns with causal head contributions to identify a specific subset of attention heads driving motion planning. Further, our self-attention analysis shows that Rotary Position Embedding (RoPE) induces excessive spatial attention decay. This causes early candidate regions to prematurely lock into physically implausible positions, suppressing reasonable trajectories in adjacent frames and triggering generation failure modes. To address this fundamental flaw, we propose a lightweight architectural modification that scales the frequency of RoPE across different denoising steps. This strategy reduces excessive attention decay, helping the model explore better candidate regions to establish coherent physical motion. Finally, training-free and training-based experiments confirm the effectiveness of our approach in enhancing the physical commonsense of generated videos.

[69] Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Ranking cs.CV | cs.ROPDF

Ji-Hoon Hwang, Jisung Bae, E-In Son, Dong-Wook Kim, Jung-Taak Kim

TL;DR: TravPro从冻结视觉语言模型的图像块特征学习越野地形偏好排序，并把稀疏区域比较蒸馏为稠密地图。

Details

Motivation: 越野机器人需要判断哪块地更适合通行，但通行性没有通用真值，语义类别分数只能说明地物是什么，不能表达相对偏好。

Result: 在五个未见领域上，区域两两排序准确率均值达0.915，高于最强基线的0.783。

Insight: 把常规标注隐含的偏好转成有序区域对，在VLM原型上训练轻量读出器，再将其伪标签蒸馏到RGB学生模型；有效性来自使用方式，而非单纯提示VLM。

Abstract: In vision-based off-road navigation, a robot needs to know not only which obstacles to avoid but also which terrain is better. The first is handled by freespace detection or semantic segmentation. The second is usually answered with a traversability score, but no universal ground truth exists for such a score, so perception falls back on a predefined value per semantic class or a freespace confidence. These scores say what a region is, not which region a robot should prefer. We therefore formulate this preference as visual traversability ranking, an ordering of visible terrain that can be supervised by comparisons between two regions. Standard annotations do not label preference, but they imply its direction. We present TravPro, which converts these annotations into ordered region pairs and fits a small readout on frozen vision–language model (VLM) patch tokens to these pairs. The tokens are clustered once into a fixed prototype bank, and the readout learns a preference score per prototype. The readout is then applied to every patch and serves as a teacher that turns sparse comparisons into dense preference pseudo-labels without pixel-wise annotation. An RGB student distills these maps into a dense terrain-preference map together with a non-ground mask that excludes obstacles and background from the ranking. On five unseen domains, TravPro reaches a mean pairwise accuracy of 0.915 against 0.783 for the strongest baseline, producing an ordering sensitive to surface condition that a per-class value cannot represent. The same VLM and the same supervision yield no such ordering when the VLM is prompted and the supervision is used as dense targets; what matters is how they are used.

[70] Infectious Bovine Pinkeye Detection Using Computer Vision and Imbalance-Aware Learning cs.CVPDF

Michael Abalo, Jameson Brennan, Hossein Moradi Rekabdarkolaee

TL;DR: 比较YOLOv11、YOLOv26及类别均衡策略，用计算机视觉自动检测牛传染性红眼病。

Details

Motivation: 牛红眼病具有传染性，人工诊断主观且难以扩展到大群或偏远牧场，因此研究评估自动分类模型及类别不平衡处理。

Result: YOLOv11的RMO-s准确率0.99、宏F1为0.98且无假阴性；YOLOv26原始l及若干过采样版本也达0.99准确率、0.98宏F1。随机少数类过采样通常优于改编SMOTE，但部分模型无需过采样。

Insight: 均衡策略的收益依架构和规模而异，不能假定过采样对所有检测器都有帮助；作者认为仍需进一步评估其畜牧健康监测应用。

Abstract: Infectious bovine pinkeye is a contagious ocular disease that adversely affects cattle health, welfare, and agricultural productivity. Conventional diagnosis relies primarily on clinical observation, which can be subjective, time-consuming, and difficult to implement efficiently in large herds or remote settings. This study evaluated and compared You Only Look Once (YOLO) v11 and YOLOv26 for automated bovine pinkeye classification and investigated the effects of class-balancing strategies on model performance. Five variants (n, s, m, l, and x) of each architecture were trained and evaluated using the original imbalanced dataset, Random Minority Oversampling (RMO), and an adapted Synthetic Minority Oversampling Technique (SMOTE). Both YOLOv11 and YOLOv26 demonstrated strong classification performance, although the effects of class balancing varied across model variants. For YOLOv11, RMO-s achieved an accuracy of 0.99, a macro F1-score of 0.98, and a true positive rate (TPR) of 1.00, with no false-negative classifications. RMO-m also achieved a TPR of 1.00 with no false negatives. For YOLOv26, the original l, RMO-m, and RMO-l variants each achieved an accuracy of 0.99 and a macro F1-score of 0.98, with RMO-l attaining a TPR of 1.00 and no false negatives. Overall, RMO generally provided greater improvements in minority-class detection than adapted SMOTE, whereas the strong performance of the original YOLOv26-l demonstrates that oversampling was not necessary for all model variants. These findings demonstrate the potential of YOLOv11 and YOLOv26 for automated detection of bovine pinkeye and support further evaluation for livestock health monitoring.

[71] Layer-Aware Position Embeddings for Visual Token Pruning in Multimodal Large Language Models cs.CVPDF

Yahong Wang, Zhangkai Ni, Juncheng Wu, Yuyin Zhou, Ying Wen

TL;DR: 提出分层感知的位置嵌入策略，在多模态模型裁剪视觉token时兼顾注意力保留与空间定位能力。

Details

Motivation: 稀疏位置嵌入可能削弱视觉token注意力，连续位置嵌入则可能破坏原有空间对应，二者都会影响裁剪后模型表现。

Result: 跨多种代表性裁剪方法和基准，分层策略提升裁剪后多模态模型的综合性能。

Insight: 解码器中间层对视觉定位尤其关键，因此只在定位敏感层切换到稀疏位置嵌入，在其他层保留连续嵌入。

Abstract: Multimodal large language models (MLLMs) incur substantial computational overhead due to the reliance on hundreds of visual tokens to represent images. While token pruning has emerged as a promising approach to reduce the inference cost of MLLMs, existing methods typically reassign position embeddings to the retained tokens using either sparse or continuous position embeddings, each introducing distinct limitations. Sparse position embeddings tend to decrease the attention value allocated to visual tokens, thereby degrading the perception capability of MLLMs, whereas continuous position embeddings disrupt the original spatial correspondence of visual tokens, leading to weakened grounding capability. To mitigate this issue, we perform layer-wise analysis of the language decoder and observe that intermediate layers play a critical role for maintaining the grounding capability of MLLMs under token pruning. Based on this observation, we propose a layer-aware position embedding strategy, which switches to sparse position embeddings at grounding-sensitive layers while maintaining continuous position embeddings elsewhere. Extensive experiments across representative pruning methods and diverse benchmarks demonstrate that our approach improves the comprehensive multimodal performance of pruned MLLMs compared with standard sparse and continuous position embeddings.

[72] BindCLIP: One Balanced Coupling For Compositional Vision Language Scoring cs.CVPDF

Liuyang Song, Yi Zhang, Zhongyi Deng, Daqian Yang, Hongbo Zhang

TL;DR: BindCLIP以平衡最优传输联合图像块、文本词元和视觉深度，评估图文组合关系是否正确。

Details

Motivation: 全局图文相似度能捕获语义，却不表达词语对应哪个区域及区域排列，因此可能偏好包含正确物体但组合关系错误的描述。

Result: 单一检查点和推理路径在What’sUp、ARO及SugarCrepe官方基准上优于冻结全局CLIP，关系类测试上的迁移提升最突出。

Insight: 通过一个平衡耦合计划读取语义、实体、顺序和空间证据，并使交换候选描述时分数严格反对称；无需任务标签、解析器、关系清单或检测器。

Abstract: Global vision–language similarities compress an image and a caption into one vector, preserving semantics but not which word corresponds to which region or how those regions are arranged; a model can recognize every word and object yet prefer a compositionally incorrect caption. We argue that a frozen encoder retains this association structure, so the problem is to read it rather than to rebuild it beside the pretrained similarity. We introduce BindCLIP, a pairwise scorer built on one latent object: a balanced token–patch–depth optimal-transport coupling that places both candidate captions and several visual depths in a single plan. Semantic, entity, order, and spatial evidence are read as energies of this state, and exchanging the candidates permutes the plan, making the score exactly antisymmetric. A geometric refinement inside the coupling contracts moves that the candidates and the visual depths do not support. No task label, parser, relation inventory, or detector is used. One checkpoint and one inference path improve the official What’sUp, ARO, and SugarCrepe benchmarks over frozen global CLIP, with the strongest transfer on the relation splits. Controls rule out patch access and caption-length shortcuts, and an inference-time lesion localizes spatial arrangement to the coupling.

[73] Training-Free Spectral Transductive Refinement for Cross-Domain Few-Shot Classification cs.CVPDF

Fahim Rahman, S. M. Tanjeeb Meheran Rohan, Md. Taimum Ibne Sayed, Asaduzzaman Herok, Md. Bakhtiar Hasan

TL;DR: STR利用支持集与查询集整体图结构，在测试阶段迭代更新类别原型，改善跨域少样本分类。

Details

Motivation: 冻结视觉特征遇到领域迁移和单样本监督时表现脆弱，单张标注图像难以可靠代表类别；作者检验不重新训练能否缓解问题。

Result: 跨五个偏移领域，谱精炼持续优于单原型初始化且一类样本收益最大；在八个目标领域的标准比较中，1-shot平均表现最高，5-shot仍具竞争力。

Insight: 在支持—查询联合近邻图上建立归一化拉普拉斯谱坐标，再用支持标签初始化并迭代吸收伪标签查询；报告结果时明确其传导式推理设置。

Abstract: Few-shot recognition with frozen visual features is especially fragile under domain shift and one-shot supervision, where a single labelled image is an unreliable estimate of its class. We ask how far this fragility can be reduced purely at test time, without retraining the encoder or augmenting the source domain. We present Spectral Transductive Refinement (STR), a training-free transductive inference rule that exploits the geometry of the complete support-query episode. Given frozen embeddings, STR builds a joint k-nearest-neighbour graph, maps the episode into a normalized-Laplacian spectral coordinate system, initializes class representatives from the labelled support, and iteratively refines them using pseudo-labelled queries. We evaluate STR under two protocols. A controlled component study with frozen ResNet-18 features shows that spectral refinement consistently improves over single-prototype spectral initialization across five shifted domains, with the largest gains in the one-shot regime where support estimates are weakest. We then benchmark STR against recent Cross-Domain Few-Shot Learning (CD-FSL) methods using the standard miniImageNet-pretrained ResNet-10 backbone over eight established target domains. Operating entirely at inference time, STR attains the highest 1-shot average among compared methods and remains competitive at 5-shot, rivalling approaches relying on heavy source-domain meta-training augmentations. Because STR is transductive, we report its setting explicitly. Diagnostics attribute its gains to iterative refinement in spectral coordinates rather than added prototype capacity, which remains inactive in our configuration.

[74] PRISM-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Tobacco Product and Legislative Policy Reasoning cs.CVPDF

Manuel Serna-Aguilera, Raegan Anderes, Page Dobbs, Khoa Luu

TL;DR: 提出PRISM-RAG多模态超图检索框架，并构建跨美国13个辖区的烟草产品图像、法规知识库和问答数据。

Details

Motivation: 各辖区法规措辞相近，普通RAG可能引用主题相关但司法辖区错误的法律；产品图像属性与具体法律文本的关联也难处理。

Result: 数据集包含161,563张图像、1,495组验证问答；PRISM-RAG在93.9%的合规问题中检索到正确辖区段落，比标准RAG高48.6个百分点，并在多项指标上有竞争力或更优。

Insight: 超图连接图像、属性描述和实体；检索时按辖区组装上下文，确保目标辖区法规进入模型，索引阶段不调用LLM、每次查询仅调用一次。

Abstract: The disambiguation of semantically similar statutory text across jurisdictions is a retrieval problem that existing methods do not solve. This inter-context conflict can steer generative models toward confidently produced answers grounded in topically relevant but jurisdictionally incorrect sources. Tobacco and nicotine regulations vary by US jurisdiction, often sharing similar language, thus, robust reasoning requires identifying which jurisdiction’s law governs a given product, not merely retrieving relevant text. Emerging products (e.g., pouches) exploit ambiguous definitions to evade regulation. State-of-the-art (SOTA) document retrieval-augmented generation (RAG) methods struggle to address this inter-context conflict, and thus struggle to connect image attributes (e.g., rich attribute captions) to the set of similar legislation texts. We introduce NicoPRISM (Nicotine Product and Regulation Image-and-Text Surveillance Multimodal), comprising 161,563 images, attribute captions, a knowledge base of product, health, and legislative documents spanning 13 US jurisdictions, and 1,495 validated question-answer pairs across two tasks: policy compliance QA and product knowledge QA. We also propose PRISM-RAG, a multimodal hypergraph RAG framework built over images, captions, and entities without any LLM calls at index time, grounding every query in a product image and routes retrieval through a jurisdiction-aware context assembly mechanism guaranteeing that statutory text from the queried jurisdiction reaches the language model by construction. PRISM-RAG retrieves passages from the correct jurisdiction in 93.9% of policy compliance queries, a 48.6 percentage point advantage over standard RAG (p<0.001), using zero LLM calls at index time and one at query time, and is competitive with or outperforms SOTA RAG frameworks across keyword, semantic, jurisdiction-, and compliance-accuracy metrics.

[75] Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene cs.CV | cs.GRPDF

Yang-Tian Sun, Tianjia Liu, Zehuan Huang, Yi-Hua Huang, Xiaoyang Lyu

TL;DR: Mira-Scene用稠密、受界的像素级对应恢复物体布局，组合单图生成的3D资产以重建一致场景。

Details

Motivation: 单图3D资产质量已高，但场景布局仍难；稀疏、无界位姿变量不易学习，尤其缺乏场景级标注时泛化较差。

Result: 在室内、室外、合成及真实场景中，布局准确度优于强基线；相较SAM3D，3D-IoU相对提升39.8%，2D-IoU提升16.5%。

Insight: 像素对齐的规范坐标图将物体可见像素映射到有界表面坐标，并与场景点云图形成稠密对应，再用稳健几何对齐恢复变换；训练目标可由可扩展的物体级3D数据获得。

Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challenge. A central difficulty lies in how object layout is represented. Holistic methods absorb placement into a scene-level generation process, sacrificing object-level detail. Compositional methods preserve object fidelity by decoupling geometry from layout, but typically parameterize layout as sparse, unbounded pose variables that are difficult to learn and generalize poorly under scarce scene-level supervision.We present Mira-Scene, a compositional 3D scene reconstruction framework that replaces sparse pose regression with dense, bounded correspondence recovery. At its core is the Canonical Coordinate Map (CCM), a pixel-aligned field that maps each visible object pixel to a surface coordinate in the object’s bounded canonical space. When paired with a scene-space Point Cloud Map (PCM) from monocular geometry estimation, CCM induces dense canonical-to-scene correspondences from which object transformations are recovered through robust geometric alignment. Because CCM operates in bounded canonical space, it provides a stable prediction target that can be trained from scalable object-level 3D data without requiring scene-level layout annotations. Mira-Scene further introduces a multimodal diffusion transformer that jointly generates object geometry and CCMs, using modality-specific expert streams with shared attention and positional encoding to promote geometry-layout consistency. Experiments on indoor, outdoor, synthetic, and in-the-wild scenes show that Mira-Scene substantially outperforms strong baselines in layout accuracy, achieving relative gains of 39.8% in 3D-IoU and 16.5% in 2D-IoU over SAM3D, using limited open-source training data.

[76] VISTA: Video-Injected Stylized Text-to-Animation cs.CV | cs.GRPDF

Monseej Purkayastha, Anindita Ghosh, Philipp Slusallek

TL;DR: VISTA将文本控制的动作内容与参考视频中的表达风格分离融合，生成风格化三维人体动画。

Details

Motivation: 目标是同时利用文本语义结构和视频风格，但训练数据不要求存在文本、视频与风格化动作三者配对的样本。

Result: 在动作捕捉渲染参考的概念验证中，VISTA在视频条件方法中风格识别准确率最高，同时保持有竞争力的内容对齐。

Insight: 双通道自编码器把动作与视频映射到共享潜空间，掩码自回归扩散模型再通过后期融合的双AdaLN路径注入风格；解耦的三路无分类器引导可独立调节内容与风格。

Abstract: We present VISTA, a two-stage framework for generating stylized 3D human motion by fusing structural content from text prompts with expressive style from reference videos, without requiring jointly paired (text, video, stylized motion) triplets. A Dual-channel Autoencoder first maps motion sequences and video clips into a shared latent manifold. A masked autoregressive diffusion backbone then operates within this manifold, injecting video-derived style through a dedicated late-fusion Dual-AdaLN pathway while preserving text-conditioned content structure. A cross-batch unpaired training protocol with latent cycle consistency enables joint learning across separate semantically rich and stylistically diverse datasets. As a proof-of-concept for controllable animation synthesis, we validate VISTA on rendered motion-capture references: it achieves the highest style recognition accuracy among video-conditioned methods while preserving competitive content alignment, and its decomposed 3-way classifier-free guidance provides independent, user-controllable calibration of the content–style balance at inference time.

[77] Rethinking Diffusion Segmentation: When Does It Rely on Its Noisy State, and Does Diffusion Matter? cs.CV | cs.LGPDF

Hengzhuo Yang, Yuming Zeng, Yuling Yang

TL;DR: 系统审查监督式扩散分割是否真正依赖加噪状态，并与匹配的仅图像预测模型比较扩散计算是否带来额外收益。

Details

Motivation: 分割输入图像本身可能已足以预测目标，仅凭最终表现无法证明模型使用了扩散状态，也不能证明扩散计算优于直接预测。

Result: 审计的方法中，所有40条评估路径依赖去噪重建者都表现出状态依赖，30条带分割监督旁路的比较则保留表现；35种设置里有28种仅图像对照表现相近或更好。

Insight: 监督路径决定了受测方法是否依赖加噪状态；即使模型确实使用该状态，扩散特有计算也常无确定性端点优势，相关能力主张应对照匹配的仅条件模型。

Abstract: Diffusion models are increasingly adapted from generation to conditional prediction, where a conditioning signal is combined with an evolving noisy representation of the target. In fully supervised segmentation, however, the conditioning image can already support direct target prediction, so endpoint performance alone establishes neither reliance on the added diffusion state nor a deterministic advantage over image-only prediction. For state reliance, we disrupt target-derived state content or correct image-state pairing during retraining of twelve published methods across three datasets, with ten matched seeds per setting. All 40 original-method comparisons whose evaluated-mask routes remained downstream of noised-quantity reconstruction exhibited state reliance, whereas all 30 comparisons with a segmentation-supervised bypass preserved reference performance. Rerouting five originally bypass-capable methods by forcing segmentation supervision through noise-to-mask reconstruction converted all 30 corresponding comparisons from preserved performance to state reliance. For deterministic utility, matched image-only counterparts achieved similar or better performance in 28 of 35 settings overall, including 16 of 20 whose native methods relied on both audited state properties. These results identify supervision path as a determinant of state reliance in the audited methods. Separately, matched image-only counterparts show that diffusion-specific computation often provides no deterministic endpoint advantage, including in methods that rely on the audited state properties. More generally, when conditioning already supports strong target prediction, diffusion-specific claims require additional evidence that the added state is used and that diffusion-specific computation improves the claimed capability beyond a matched condition-only counterpart.

[78] Colon3R: Cross-Domain 3D Reconstruction from Monocular Colonoscopic Video cs.CV | cs.ROPDF

Zhihao Xing, Yingyu Wang, Liang Zhao, Shoudong Huang

TL;DR: Colon3R借助预训练VGGT，把仿体和模拟数据中的相机、深度及点图几何迁移到无标注的真实结肠镜视频。

Details

Motivation: 结肠镜单目三维重建受弱纹理、反光、视角重叠有限和组织非刚性运动影响；真实体内标注几何数据不足以直接适配基础模型。

Result: 在深度、点图和相机位姿估计上整体优于先进方法；真实体内视频的定性比较显示重建更完整且几何一致性更好。

Insight: 利用教师在真实视频上的跨视角监督，并按序列、视角对和像素三级选择可靠近刚性区域；源域保持策略帮助适配时保留已有耦合几何。

Abstract: Monocular colonoscopic 3D reconstruction is important for surgical robotic colonoscopy, but remains challenging due to weak texture, specular reflections, limited view overlap, and non-rigid tissue motion. Conventional multi-view 3D reconstruction methods rely on stable correspondences and approximate rigidity, which are often violated in colonoscopy. Existing endoscopic methods often rely on domain-specific supervision, whereas there are not enough in-vivo labeled data available to adapt geometry foundation models to clinical colonoscopy. We present Colon3R, a cross-domain semi-supervised framework built on pretrained VGGT that transfers coupled camera, depth, and pointmap geometry from labeled phantom and simulated data to unlabeled in-vivo colonoscopy without requiring target-domain geometric annotations. Unlike source-only fine-tuning, which learns only from phantom and simulated data, Colon3R directly exploits unlabeled in-vivo video through teacher-derived cross-view supervision. Our proposed hierarchical quasi-rigid reliability selects reliable supervision at the sequence, directed-pair, and pixel levels, while source-preserving adaptation retains the learned coupled geometry during target-domain adaptation. Extensive experiments demonstrate that our method achieves superior overall performance over state-of-the-art approaches in depth, pointmap, and camera pose estimation. Qualitative comparisons on real in-vivo colonoscopy further show substantially more complete and geometrically consistent reconstructions than competing methods under clinical domain shift. The code will be public available after the paper is accepted.

[79] Video-STLayout Pre-training cs.CVPDF

Akash Abdu Jyothi, Greg Mori

TL;DR: Video-STLayout通过对齐视频表征与物体框时空布局表征，进行无需额外人工布局标注的视频预训练。

Details

Motivation: 视频预训练常借助语言或音频等模态对齐；物体时空布局容易由现成检测器提取，可能提供结构化动作线索。

Result: 论文在复杂场景活动识别任务上验证了该预训练策略的有效性，摘要未提供具体量化结果。

Insight: 用训练好的布局编码器处理目标框布局，并以对比损失将布局特征与视频编码器特征对齐，利用检测器即可得到布局输入。

Abstract: In recent years, pre-training has become fundamental to learning effective video representations, enabling strong transfer to downstream tasks. A popular framework in pre-training involves aligning features of a video encoder with that of another modality, for example, language or audio. We introduce Video-STLayout pre-training, a novel strategy for obtaining rich video representations informed by spatio-temporal layout of object bounding boxes. Object layouts can easily be obtained by applying an off-the-shelf object detector on the video frames. Our method uses a contrastive loss to align video features with the layout features from a trained layout encoder. We show the effectiveness of our approach in the task of activity recognition in complex scenes.

[80] Vision Transformers versus convolutional neural networks for fine-grained orchid genus identification in a species-rich, data-poor flora: a controlled benchmark on the Orchidaceae of New Guinea cs.CV | cs.LG | q-bio.QMPDF

Reza Saputra, Diah Harnoni Apriyanti, André Schuiteman, Kurt Metzger, Ashley Field

TL;DR: 在新几内亚兰科植物丰富、样本稀缺的条件下，比较视觉Transformer与CNN用于兰属级识别及后续物种检索。

Details

Motivation: 当地植物物种多而单种照片少，直接逐物种分类困难；研究系统比较不同骨干和预训练策略对细粒度识别的作用。

Result: DINOv2属级宏平均top-1为66.9%、全局top-1为88.9%，优于所测CNN和BioCLIP 2；其物种Recall@5为86.6%，属Recall@5为98.7%，未见属检测AUROC均值0.958。

Insight: 两阶段方案先识别属，再用FAISS检索候选物种图像；通用自监督DINOv2比领域匹配的生物预训练更强，距离门控可标记训练中未见属。

Abstract: New Guinea is the world’s richest island flora (~2,856 orchid species), yet most species are represented by only a handful of photographs, far fewer than direct species-level classification requires. Methods for fine-grained identification in such species-rich, data-poor floras are needed, and it remains unclear which backbone architecture and pretraining strategy best support them. We built a two-stage system that first predicts the genus of a query photograph, then retrieves visually similar reference images of candidate species using FAISS. We compared four pretrained backbones – two Vision Transformers (ViTs; DINOv2, BioCLIP 2) and two CNNs (ConvNeXt V2-L, EfficientNetV2-L) – fine-tuned under an identical protocol on a fixed, species-stratified partition of 16,701 photographs spanning 120 genera and 1,350 species, assessing accuracy, calibration, error structure, species retrieval, and open-set detection of novel genera. DINOv2 attained the best genus performance (macro top-1 66.9%, 95% CI 63.7-70.6; global top-1 88.9%); both ViTs outranked both CNNs, and general-purpose self-supervised pretraining (DINOv2) outperformed domain-matched biological pretraining (BioCLIP 2) by 7.1 points of macro top-1. Errors concentrated on two abundant genera acting as error attractors. DINOv2 embeddings achieved species Recall@5 of 86.6% and genus Recall@5 of 98.7%; temperature scaling reduced every backbone’s Expected Calibration Error to about 0.03; and a distance-based open-set gate flagged unseen genera (mean AUROC 0.958). A self-supervised Vision-Transformer backbone combined with embedding retrieval is an effective, deployable strategy for fine-grained identification in species-rich, data-poor floras. The system is released as an open web application (the New Guinea Orchid Identifier), offering a practical template for other hyperdiverse, under-documented taxa.

[81] All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts cs.CVPDF

Xingsong Ye, Yongkun Du, Jiaxin Zhang, Zhixian Li, Chong Sun

TL;DR: 构建覆盖229种语言和10种文字的合成场景文字数据，并以文字体系感知的稀疏专家模型识别多语言文本。

Details

Motivation: 多数语言缺少场景文字训练数据；逐语言部署模型成本高，而大型视觉语言模型仍昂贵且不少文字体系识别不准。

Result: ScriptMoE在10种文字、10,899张图像的基准上准确率82.06%，比最强识别基线高1.31%；替换PP-OCRv5识别器后，端到端F1由65.71%升至80.89%，略高于最佳VLM的80.73%。

Insight: TextMuSS-10M补足真实数据稀缺；ScriptMoE共享视觉编码器，以图像级路由选取两个文字专家，并用共享专家吸收跨文字知识。

Abstract: Multilingual scene text recognition (STR) remains challenging due to the scarcity of training data for most languages and the difficulty of serving diverse scripts within a single model. Existing solutions either deploy one recognizer per language, inflating cost and introducing error accumulation, or rely on massive vision-language models (VLMs) that are expensive and still inaccurate on many scripts. In this work, we pursue an all-in-one multilingual recognizer that is simpler than per-language experts, lighter than VLMs, and more accurate than both. First, we construct TextMuSS-10M, a large-scale synthetic scene text dataset spanning 10 scripts and 229 languages. It provides balanced and sufficient supervision where real data is unavailable. Second, we propose ScriptMoE, a script-aware Mixture-of-Experts (MoE) architecture. It shares a single visual encoder and replaces the dense decoder with a sparse MoE block, which consists of an image-level router dispatches each image to the top-2 script-aligned experts and a shared expert absorbs cross-script knowledge. Extensive experiments on our assembled TextMuSS-Bench (10 scripts, 10,899 images) show that ScriptMoE achieves the highest accuracy of 82.06%, outperforming the strongest STR baseline by 1.31%. On the CC-OCR end-to-end multilingual task, replacing only the recognizer in PP-OCRv5 with ScriptMoE lifts F1 score from 65.71% to 80.89%, slightly surpassing the best VLM (80.73%) at a fraction of the parameter count.

[82] Monitorable Chart Reasoning Agents via Verifiable Process Rewards cs.CVPDF

Sanchit Sinha, Oana Frunza, Kashif Rasul, Aidong Zhang

TL;DR: Chart-RVR用可验证过程奖励训练图表推理智能体，使其答案过程能被审计并定位证据。

Details

Motivation: 图表智能体只给答案或自由形式解释时，难以判断错误来自图表识别、数值提取还是运算，限制关键领域的可部署性。

Result: 在六个域内外基准上，Chart-RVR在同规模视觉语言模型中达到最佳准确率；其推理比思维链提示、监督微调和图表专用基线更可验证、证据定位更好。

Insight: 将过程拆为图表结构识别、以JSON重建数据表的证据步骤、以及逐步求解的推导，并结合替代真值指标、信息增益和模型审计器衡量可监控性。

Abstract: Chart reasoning agents are increasingly used to extract actionable insights in critical domains, achieving state-of-the-art performance on multiple benchmarks. Yet, high benchmark accuracy alone is insufficient for deployment, where stakeholders must be able to audit and verify how a model reaches its answer. Existing LVLM-based chart agents produce either answer-only predictions or free-form rationales that are hard to verify, obscuring whether an error arose from misreading the chart, extracting a wrong value, or miscomputing. We propose Chart-RVR, a reinforcement learning framework for training monitorable chart agents with verifiable process rewards. Chart-RVR decomposes chart reasoning into three auditable blocks: Structure, identifying the chart type; Evidence, reconstructing the underlying data table in JSON; and Derivation, exposing the stepwise trace that computes the answer. Across six in-domain and out-of-domain benchmarks, Chart-RVR attains state-of-the-art accuracy among comparable-sized LVLMs. Beyond accuracy, we assess monitorability using a triangulated protocol that combines ground-truth surrogate metrics, an oracle information-gain measure, and an LLM-as-auditor scoring Process Verifiability and Evidence Localization, showing that Chart-RVR yields rationales that are markedly more verifiable and evidence-grounded than those from CoT prompting, SFT, and existing chart-specific baselines.

[83] A paired synthetic construction-site image dataset for robust computer vision under adverse conditions cs.CVPDF

Viet Huy Duong, Ruoxin Xiong, Md Abdullah Al Forhad, Weishi Shi

TL;DR: ConSynth-X是配对合成施工现场图像集，用于评估计算机视觉和视觉语言模型在恶劣环境下的鲁棒性。

Details

Motivation: 施工监测视觉系统在不利环境和视觉条件下容易退化，而现有施工图像数据对此类情况覆盖不足。

Result: 数据集含34,199张图像，源自3,109个真实场景，覆盖11类天气、光照、远距及小目标条件，并提供来源场景配对、标注和生成元信息。

Insight: 配对设计允许在相同场景上控制比较不同环境变化；技术验证考察了合成图与源图以及真实恶劣环境图像间的相似性和分布差异。

Abstract: Computer-vision systems used for construction monitoring can degrade under adverse environmental and visual conditions, yet such conditions remain underrepresented in existing construction image datasets. We present ConSynth-X, a paired synthetic construction-site image dataset containing 34,199 images derived from 3,109 real-world source scenes. The dataset comprises 11 condition-specific subsets spanning precipitation, fog, nighttime illumination, adverse weather at night, and small-object or long-distance views. Each synthetic image is linked to its corresponding source scene, enabling controlled comparison across environmental and visual conditions. ConSynth-X includes source-derived annotations, generation metadata, provenance information, and image-quality indicators, supporting object detection, image captioning, visual grounding, and visual question answering. Technical validation evaluates source-synthetic fidelity and alignment with real adverse-condition imagery using embedding-based similarity and distributional analyses. The dataset provides a structured resource for evaluating and improving the robustness of construction vision and vision-language models under challenging field conditions.

[84] A$^2$Safe: Counterfactual Evidence-Aligned Adaptive Agent Collaboration for Safe and Effective Visual Question Answering cs.CVPDF

Quanxing Xu, Ling Zhou, Xian Zhong, Jinyu Tian, Xiaohua Huang

TL;DR: A²Safe通过反事实证据对齐与自适应智能体协作，让多模态问答的安全决定依据明确图文风险证据。

Details

Motivation: 安全模型可能依赖表面文本或视觉相关性；真正风险有时来自单独无害的图像内容与问题意图之间的交互。

Result: SIUO安全分数为95.72，MOSSBench无害拒答率降至14.67%，通用VQA平均分78.34，token开销增加27.8%。

Insight: 安全证据板显式组织局部视觉观察、文本意图和跨模态风险；反事实约束要求忽略无关变化、对风险关键证据变化作出恰当响应，再依据证据充分性决定直接回答或追加审查。

Abstract: Visual Question Answering (VQA) with Multimodal Large Language Models (MLLMs) requires not only producing safe and effective responses, but also grounding safety decisions in the multimodal evidence that determines risk. Recent safety-alignment methods improve refusal behavior and contextual risk awareness, yet correct safety outcomes may still rely on superficial textual or visual correlations, particularly when risk emerges from interactions between individually benign image and question content. To address this issue, we propose A$^2$Safe, a counterfactual evidence-aligned adaptive agent collaboration framework for safe and effective VQA. A$^2$Safe organizes localized visual observations, textual intent, and cross-modal risk relations through a Grounded Safety Evidence Board, making the basis of safety decisions explicit. Counterfactual safety evidence alignment enforces invariance to safety-irrelevant changes while requiring appropriate safety-state and response-mode transitions when risk-critical evidence is minimally altered. The resulting evidence state further supports adaptive collaboration, enabling direct answering when grounded evidence is sufficient and invoking policy critique and response revision when evidence is risky, uncertain, or conflicting. Under complementary safety-critical and general VQA protocols, A$^2$Safe achieves a 95.72 SIUO safety score, reduces the benign refusal rate on MOSSBench to 14.67%, and maintains an average general VQA score of 78.34 with 27.8% token overhead. These results support counterfactual evidence-aligned adaptive collaboration for safe and effective multimodal question answering.

[85] Bridging Reconstruction and Generation: A Latent Distribution Perspective on Evaluation and Improvement cs.CVPDF

Xianghong Fang, Wenjie Shu, Tongda Xu, Wenlong Mou, Dehan Kong

TL;DR: 提出生成感知重建评估GAR，使解码器在编码器潜变量到生成潜变量的过渡分布上的行为可测，并用于改进生成质量。

Details

Motivation: 重建FID与生成FID有时相关性很弱甚至为负，因为两项评估把不同来源的潜变量送入同一解码器。

Result: 轨迹诊断指标GAR-FID在不同tokenizer和模型规模上与生成FID高度相关；用中间GAR潜变量适配解码器后，多个规模的生成质量均改善。

Insight: 向编码器潜变量加噪，再由生成模型去噪，能构造从重建到生成的连续路径；中间状态既接近生成分布，又保留与源图的对应监督。

Abstract: In latent generative models, reconstruction quality is often assumed to correlate with generative performance. However, reconstruction FID (rFID) can exhibit weak or even negative correlation with generation FID (gFID). We attribute this discrepancy to a latent distribution mismatch: reconstruction evaluates the decoder on encoder-induced latents, whereas generation uses the same decoder on latents produced by the generative model. To characterize this shift, we introduce generation-aware reconstruction (GAR), which constructs a continuous trajectory from standard reconstruction toward generation by perturbing encoder latents with noise and denoising them through the generative model before decoding. GAR probes the decoder behavior along this trajectory, making the transition from encoder to generation-time latent distributions observable and diagnosable. The resulting trajectory-based diagnostic, GAR-FID, exhibits strong empirical correlation with gFID across diverse tokenizers and scales. Importantly, intermediate GAR latents become more generation-aware while preserving correspondence with their source images, thereby retaining paired supervision that is absent for fully generated latents. This correspondence enables decoder adaptation on intermediate GAR latents, consistently improving generative quality across model scales. Overall, latent distribution mismatch provides a useful perspective for evaluating and improving latent generative models.

[86] Adaptive Cortically Constrained EEG-Vision Alignment for Zero-Shot Brain-to-Image Retrieval cs.CVPDF

Ye Wang, Haokun Ren, Wei Wu, Guoyin Wang, Zhuliang Yu

TL;DR: 用皮层约束的脑区级EEG表征和自适应视觉监督，改善零样本脑信号到图像检索。

Details

Motivation: EEG视觉对齐容易受头皮传感器的空间混合和不同响应可靠度差异影响，固定视觉监督难以适配每次脑电响应。

Result: 在THINGS-EEG上取得较强的200类零样本检索表现，并能通过脑区归因对源模式表征作事后解释；摘要未提供具体准确率。

Insight: 先将EEG重建为预定义脑区源模式，再由Neuro-ROI注意力编码器处理；根据模型估计的对齐证据自适应加权细节受控的视觉目标。

Abstract: Zero-shot brain-to-image retrieval requires robust alignment between noisy EEG responses and visual representations. Existing EEG-vision alignment methods often operate in sensor space and apply fixed visual supervision to all responses, ignoring both spatial mixing in scalp EEG and response-wise variability in alignment reliability. We propose an adaptive cortically constrained EEG-vision alignment method for zero-shot brain-to-image retrieval. The method reconstructs EEG responses into predefined ROI-level source-pattern representations and encodes them with a Neuro-ROI Attention Encoder. To handle response-wise variability, we introduce an evidence-based adaptive visual supervision strategy that weights detail-controlled visual targets using model-based alignment evidence. On THINGS-EEG, the proposed method achieves strong 200-way zero-shot retrieval performance, with ROI-level attribution providing post hoc interpretability of the learned source-pattern representations. These results show that cortically constrained representation learning and adaptive supervision can jointly support EEG-vision alignment for zero-shot brain-to-image retrieval.

[87] Action-Slot: Structured Action-Centric Representation Learning for Multi-Agent Atomic Activity Understanding cs.CV | cs.AIPDF

Yu-Ho Chang, Chi-Hsi Kung, Yi-Hsuan Tsai, Yi-Ting Chen

TL;DR: Action-Slot将槽位学习重构为面向活动的结构化分解，以识别并定位交通视频中的多主体原子活动。

Details

Motivation: 原子活动具有多主体、多标签和道路拓扑依赖特性，传统动作识别和以物体为中心的排列不变槽位机制并不匹配。

Result: 在OATS、TACO和带标注的nuScenes上，方法取得更优识别、良好的仿真到真实迁移及先进弱监督定位表现；并构建覆盖完整活动类别的平衡合成TACO数据集。

Insight: 类别对齐活动槽、并行时空更新及背景/负槽竞争共同表达并发活动；基于注意力变化选择伪掩码，可在无稠密标注时抑制假阳性定位。

Abstract: Atomic activity understanding aims to recognize and localize structured traffic behaviors that jointly encode motion patterns and their grounding in road topology. Unlike conventional action recognition, atomic activities are multi-agent, multi-label, and topology-aware: multiple activities co-occur while many agents remain inactive. We introduce Action-Slot, a structured action-centric representation learning framework. Slot attention is widely used for object-centric decomposition, but its permutation-invariant design and object-level inductive bias are misaligned with atomic activity semantics. We reformulate slot learning as structured activity decomposition through three designs: (1) category-aligned action slots that anchor slots to predefined activity categories, (2) parallel spatio-temporal slot updating for holistic video-level reasoning, and (3) background and negative-slot regularization that enforces competition between foreground activities and irrelevant regions. Together these establish an activity-centric inductive bias that disentangles concurrent and asynchronous activities directly from raw video. Beyond recognition, the learned representations encode transferable spatio-temporal grounding signals. We further propose an attention-difference-based pseudo mask selection framework that suppresses false positives by measuring attention changes before and after candidate region removal, enabling weakly supervised localization without dense annotations. To support systematic evaluation, we introduce TACO, a balanced synthetic dataset with full atomic activity coverage and pixel-level annotations. Experiments on OATS, TACO, and annotated nuScenes show superior recognition, strong sim-to-real transfer, and state-of-the-art weakly supervised localization.

[88] An Unexpected Robot Policy: Early Evaluations of GPT-6 Astra on RoboDojo and Beyond cs.CVPDF

Wenbo Zhang, Kaixuan Wang, Yutao Ouyang, Xiaoyu Huang, Liyang Li

TL;DR: 评估通用大语言模型直接充当机器人操作策略的能力，发现GPT-6 Astra在RoboDojo上领先公开策略，但精细控制仍薄弱。

Details

Motivation: 具身系统通常由高频专用策略负责动作、视觉语言模型负责高层规划；论文检验不经任务微调的大模型能否直接成为策略。

Result: Astra在42项任务、2,100次试验上的平均成功率为22.48%，高于所比较的公开策略；GPT-5.5和DeepSeek-Flash分别仅为0.88%和1.92%。

Insight: Astra较擅长需要语义理解但不要求高精度控制的任务，对精细、动态和双臂协调任务表现差；单次示范无总体收益，部分轨迹显示受扰后可在回合内纠正。

Abstract: Embodied AI systems are often organized into System 1 and System 2. System 1 is typically a pretrained policy that generates actions at high frequency, whereas System 2 is often instantiated as a vision-enabled language model for high-level planning. We ask whether a large language model (LLM) can act as the policy for robot manipulation without task-specific finetuning. We call this setting LLM as policy. We evaluate three LLMs on all 42 RoboDojo tasks and compare their scores with 40 public policies. Astra and GPT-5.5 use the official 50-episode-per-task protocol; DeepSeek-Flash uses 10 episodes per task. GPT-6 Astra achieves 22.48% average success rate and 28.97 Score over 2,100 trials, ranking above every public entry. Yet GPT-5.5 and DeepSeek-Flash reach only 0.88% and 1.92% average success rate with the same post-processing. We find that Astra exhibits a sharply polarized capability profile. It generalizes well to tasks that require semantic understanding but not high-precision control. In contrast, it performs poorly on tasks that require precision, dynamic control, or complex bimanual coordination. In-context experiments show no aggregate benefit from one-shot demonstrations, while selected interaction traces show within-episode corrections under perturbations. Overall, the evaluated LLMs vary substantially in manipulation performance. Astra stands out and provides initial evidence for the potential of a general-purpose manipulation model, although reliable precision and dynamic control remain limitations in the evaluated setting.

[89] Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses cs.CVPDF

Jiankuo Zhao, Xiangyu Zhu, Jijie Li, Baiqin Wang, Shukai Chen

TL;DR: SAMIRA以面部语义区域为单位建模运动和光照响应，提升单目视频重建的可重照明3D高斯头像表现。

Details

Motivation: 现有高斯头像常让所有高斯共享统一运动或光照模型，忽略面部各区域的运动模式与材质反射差异。

Result: 在自我重演、跨人重演和重照明任务中，SAMIRA较既有方法改善了细粒度表情重建与重照明真实感。

Insight: 运动模块把网格位移投影到拓扑一致UV空间并按面部语义预测局部几何残差；光照模块为区域学习漫反射和镜面响应因子，再用延迟物理着色适配新环境光。

Abstract: Reconstructing expressive and relightable 3D head avatars from monocular videos remains challenging in computer vision, as it requires accurate modeling of both non-rigid facial motion and illumination-dependent appearance. Existing Gaussian avatar methods commonly rely on globally coupled representations, in which Gaussian primitives share a unified motion or illumination response model. Such uniform modeling neglects the distinct motion patterns and material/reflectance properties of different facial semantic regions, thereby limiting fine-grained animation accuracy and reducing relighting plausibility. To address this limitation, we propose SAMIRA, a 3D Gaussian avatar framework for semantic-adaptive motion-illumination response modeling. For motion response modeling, the Semantic-Adaptive Motion Response module rasterizes current-to-reference mesh displacements into a topology-consistent UV space and leverages facial semantics to route displacement features through semantic-specific modulators, predicting localized Gaussian geometric residuals beyond coarse mesh binding. For illumination response modeling, the Semantic-Adaptive Illumination Response module learns compact diffuse and specular response factors for each facial region, allowing Gaussians in different regions to adapt their illumination responses to novel environment lighting. These response factors are incorporated into deferred physically based shading, providing a lightweight approximation of semantic-dependent illumination effects. Extensive experiments on self-reenactment, cross-reenactment, and relighting demonstrate that SAMIRA improves both fine-grained expression reconstruction and relighting realism over existing methods.

[90] The Visual Target Matters: Learning across the Visual Hierarchy for Brain-to-Image Retrieval cs.CVPDF

Ye Wang, HaoKun Ren, Hong Yu, Ruirui Li, Xiao Li

TL;DR: NeuroGlyph学习由多个视觉层级共同构成的图像目标表征，提升脑电或脑磁信号对应图像的检索能力。

Details

Motivation: 既有脑到图像检索通常只监督冻结视觉骨干的最后一层，无法让不同抽象层级的信息共同塑造检索目标。

Result: 在THINGS-EEG和THINGS-MEG的所有受控比较中优于末层监督，并在四组比较中的三组超过事后选择的最佳固定层；八项可比200类指标中六项达到最强系统表现。

Insight: 目标分解为多个因素子空间，每个子空间按图像自适应分配视觉深度信息，再融合成检索嵌入；参数匹配消融支持分解与自适应分配设计。

Abstract: Brain-to-image retrieval seeks to identify the visual stimulus that elicited a non-invasive neural response. Candidate images are typically represented by pretrained vision models, whose internal representations vary in abstraction across depth. Existing methods usually train the neural encoder to recover a fixed final-layer visual target. Under this formulation, the visual hierarchy is reduced to a single prescribed endpoint, preventing representations at other depths from directly shaping the visual target. This limitation motivates learning how information across visual depths should contribute to the retrieval target. To this end, we introduce NeuroGlyph, which learns a trial-independent visual target from multiple depths of a frozen visual backbone. NeuroGlyph decomposes the target into factor-specific subspaces. Each subspace learns an image-conditioned allocation over visual depth. The resulting subspaces are fused into a single embedding for retrieval. Across THINGS-EEG and THINGS-MEG, NeuroGlyph outperforms final-layer supervision in all controlled comparisons. It also surpasses the post hoc best fixed-layer oracle in three of four comparisons. Parameter-matched ablations support both factorized target construction and image-conditioned depth allocation. Under comparable 200-way retrieval protocols, NeuroGlyph achieves the strongest system-level performance in six of eight reported metrics. These results support learning retrieval targets across the visual hierarchy rather than prescribing one visual depth.

[91] CoaG: Cylinders on a Grid: Coarse 3D Layout Control for Video Generation cs.CVPDF

Zhangsihao Yang, Mengyi Shan

TL;DR: CoaG用地面网格、每人一个圆柱和显式相机轨迹，为视频生成提供粗粒度三维布局与运动控制。

Details

Motivation: 研究希望用少量易绘制几何同时指定人物站位和摄影机运动；缺少这种几何信号与视频配对的数据集。

Result: 在自动生成的训练元组上微调Wan2.2-Fun-Control后，留出视频中人物数量、顺序、位置和高度能跟随圆柱布局，文本及背景图控制身份和场景；多种相机轨迹可跟随，后拉镜头较弱。

Insight: 系统自动生成2,000段数据并用跟踪、背景修复、地面掩码及多视角重建恢复几何，不使用真实视频或人工标签；以1,935组配对数据进行LoRA微调。

Abstract: We ask how little geometry a person has to draw to control both where people stand and where the camera moves in a generated video. Our answer is a ground plane and one cylinder per person. A user draws a grid on the ground, places one cylinder where each person should stand, moves the cylinders and the camera over 81 frames, and the model renders a photoreal video in which the people occupy the cylinders’ positions, move as the cylinders move, and are seen from the drawn camera. Appearance comes from a text prompt and a background reference image; layout and motion come from the geometry. Because no dataset pairs such a signal with video, we build the pairs ourselves: an automatic engine writes 2000 captions from a combinatorial seed, generates a clip for each with a text-to-video model, and lifts every clip back to its geometry with person tracking, background inpainting, an agentic ground-mask loop, feed-forward multi-view reconstruction and a plane fit, with no real footage and no manual labels. A LoRA on Wan2.2-Fun-Control trained on 1935 such tuples follows drawn layouts and camera paths on hold-out clips: the generated people match the cylinders’ count, order, position and height, the text changes who they are, the reference image changes where they are, and dolly-in, orbit, pan and crane paths are followed, dolly-out only weakly.

[92] Benchmarking Off-the-Shelf Multimodal AI Models Against Dermatologists on Patient-Captured Skin Images cs.CVPDF

Rian Dolphin, Laura Knowles

TL;DR: 比较三种中低价多模态模型与三位皮肤科医生对患者自拍皮肤图像的诊断表现。

Details

Motivation: 研究希望评估普通用户可接触模型在真实患者拍摄图像上的诊断能力，并以认证皮肤科医生小组为参照。

Result: 依评价指标不同，模型与医生间一致性相当或略低；模型置信度校准较差，附加患者信息的影响因模型而异，价格不能预测性能。测试中最佳模型平均每例成本为0.0045美元。

Insight: 不能依赖模型自报置信度阈值进行临床决策；患者元数据会令某一模型在所有考察指标上退化，说明模型间差异显著。

Abstract: Artificial intelligence (AI) has advanced at a rapid pace in recent years. Initially, breakthroughs in large language models caught widespread attention. However, recent generations of frontier AI models have adopted multimodal capabilities as a first class citizen, with vision capabilities being central to that. In this paper, we evaluate three recently released models on the task of diagnosing dermatological conditions from patient-submitted images. The models chosen are at the low to mid tier in terms of pricing and thus represent a floor on current AI capabilities, not a ceiling. We evaluate AI performance relative to a panel of three certified dermatologists, who grade each image, and we present four interesting findings. Firstly, depending on the metric, the tested AI models are either on par or slightly trail humans in terms of inter-clinician agreement. Secondly, we find that asking AI models for a confidence rating produces poorly calibrated answers, meaning use of confidence thresholds should not be relied upon in a clinical setting. Thirdly, the effect of providing additional patient metadata is strongly model-specific, with one of the three models degrading on every metric considered. Finally, model cost is not predictive of performance. The best-performing model we tested costs on average $0.0045 per case.

[93] LegendBench: A Diagnostic Benchmark for Legend Understanding with Counterfactual Interventions cs.CVPDF

Xinnuo Zhang, Zhike Tang, Jing Xu, Haoyuan Zhao, Weikai Yang

TL;DR: LegendBench用可控图例干预诊断视觉语言模型将图例条目绑定到图表标记的能力。

Details

Motivation: 图表总体准确率会掩盖图例特有错误，也可能被捷径满足，因此难以定位图例解析、匹配和推理问题。

Result: 对通用和专用图表模型的评测发现，图例—标记可靠绑定和反事实一致性仍是瓶颈；按能力画像进行定向微调可弥补局部缺口并迁移到未见数据。

Insight: 基准覆盖图例解析、定位、条件推理和拒答，并为每张基础图生成多个受控图例变体，以检查模型对相关变化的敏感性和不变性。

Abstract: Legends are fundamental to chart understanding, as reliable interpretation requires correctly binding legend entries to corresponding visual marks. While vision-language models (VLMs) are increasingly applied to chart understanding, their legend understanding is poorly diagnosed by aggregate accuracy, which can be satisfied by superficial shortcuts and confound legend-specific errors with other reasoning failures. To enable fine-grained diagnosis and controlled testing, we introduce LegendBench, a parametric benchmark and generation pipeline that produces targeted legend-centric test cases. LegendBench contributes (1) a capability-task taxonomy spanning legend parsing, legend grounding, legend-conditioned reasoning, and legend-aware abstention to localize failures, and (2) counterfactual group generation, where each base chart yields multiple variants under controlled legend interventions to probe model invariance and sensitivity. Using LegendBench, we evaluate both general-purpose VLMs and specialized chart models and generate their capability profiles, revealing persistent bottlenecks in reliable legend-to-mark binding and counterfactual consistency. We then use these capability profiles to guide targeted fine-tuning, demonstrating that bottleneck-specific interventions can effectively close the localized capability gaps and generalize to unseen data. We further leverage our counterfactual design to conduct fine-grained diagnostic experiments, analyzing encoding-channel effects, legend-order shortcuts, and abstention under varying visibility.

[94] ChartJudgeBench: Evaluating LMM Judges for Chart-to-Code Generation cs.CVPDF

Lijian Wu, Henry Hengyuan Zhao, Zijian Zhang, Jiahao Tang, Jiajun Wu

TL;DR: ChartJudgeBench诊断多模态模型作为图表生成与编辑奖励评审器时的判断可靠性。

Details

Motivation: 图表代码系统依赖视觉奖励模型指导强化学习和迭代优化，但模型对视觉质量和任务要求的评判可靠性尚未充分评估。

Result: 基准含1,003个图表成对比较样例及650个接受/拒绝验证样例；强模型普遍存在位置偏差、过度接受、风格审美匹配困难，RL训练模型还表现出意外宽容偏差。

Insight: 两类任务分别覆盖图表感知对齐和推理判断，模拟智能体优化中关键评审决策；结果说明用作奖励模型前需显式验证评审能力。

Abstract: Building strong chart-to-code systems increasingly relies on reinforcement learning, whose effectiveness depends critically on the quality of the reward signal. Large Multimodal Models (LMMs) play a natural critical role in jointly assessing chart visual appearance and task requirements. They are therefore increasingly used as visual critics and reward models, yet their reliability as judges remains largely unexplored. To this end, we introduce ChartJudgeBench, a diagnostic vision-language benchmark for assessing LMM judges in chart-to-code workflows. It includes 1,003 Chart Perception Alignment (CPA) instances for pairwise chart comparison and 650 Chart Reasoning Judgment (CRJ) instances for binary Accept/Reject verification in Chart Reproduction and Chart Editing. Together, these tasks emulate the core judging decisions required in agentic refinement and RL-based chart optimization. Our evaluation of strong LMMs reveals four systematic limitations: (i) positional bias in pairwise comparison, (ii) a strong tendency to overpredict Accept, (iii) difficulty in matching visual styles and aesthetics, and (iv) an unexpected leniency bias in RL-trained models. These findings show that current LMM judges require explicit reliability validation before being used as critics or reward models in chart-to-code optimization. The code and data are available on ChartJudgeBench.

[95] Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion cs.CVPDF

Uday Allu, Abhivanth Sivaprakash, Pratik Singh, Aman Manocha

TL;DR: D-RAC把企业文档统一渲染为PDF，再转成利于检索的Markdown，以低成本、可追踪方式完成文档感知切块。

Details

Motivation: PDF、Word、演示文稿和扫描件中的复杂版面、表格与标题层次容易被规则提取或OCR破坏；全智能体切块又耗token且易幻觉。

Result: 在五个企业领域的236份、795页PDF上，72分钟完成转换切块且零错误，得到1,748个片段；相较前沿模型智能体切块，token减少95.7%、费用减少77.8%至85.6%、时间减少75%。

Insight: 单次多模态模型处理页面并将表格改写为自包含描述，之后按标识符确定性解析和轻量规划；切块时不重新生成源文本，可线性扩展到500页以上文档。

Abstract: Retrieval-Augmented Generation (RAG) systems over enterprise knowledge bases must ingest heterogeneous document formats – PDFs, Word documents, presentations, and scans – whose content is locked inside complex visual layouts, multi-column pages, and dense tables. Rule-based extraction and OCR destroy reading order, flatten tables, and lose heading hierarchy, while fully agentic chunking over extracted text incurs high token costs and hallucination risk. We present Document Retrieval-Aware Chunking (D-RAC), an extension of our Web Retrieval-Aware Chunking (W-RAC) framework to arbitrary document formats. D-RAC first normalizes any input document into PDF, exploiting the fact that virtually every format has a faithful, deterministic PDF rendering. A single multimodal LLM pass then converts rendered pages into retrieval-optimized Markdown – rewriting tables as self-contained prose statements and preserving heading hierarchy – after which chunking proceeds exactly as in W-RAC: deterministic parsing into ID-addressable units followed by lightweight LLM-based chunk planning over identifiers rather than text. Source text is never regenerated during chunking, preserving W-RAC’s cost, determinism, and observability benefits while unlocking every renderable format as a first-class input. On the 236-document, 795-page PDF subset of the RAG-Multi-Corpus benchmark spanning five enterprise domains, D-RAC converts and chunks the entire corpus in 72 minutes with zero errors, producing 1,748 retrieval-ready chunks. Compared to agentic chunking with frontier LLMs, D-RAC reduces chunking-stage output tokens by 95.7%, cutting chunking cost by 77.8% (GPT-4.1 pricing) to 85.6% (Gemini 2.5 Pro pricing) and chunking time by 75%. D-RAC scales linearly to documents of 500+ pages.

Lufei Liu, Guojie Li, Suncheng Xiang, Fan Zhang

TL;DR: SRPR-Net先以视觉语言语义丰富检测框提示，再结合同图实例关系逐步修正提示，驱动SAM完成实例分割。

Details

Motivation: 提示式基础分割模型具有泛化能力，但自动提示仍缺少充分语义指导和实例间关系建模。

Result: 在多个标准基准上，相较现有先进方法取得持续的分割性能提升；摘要未给出具体数值。

Insight: 顺序细化提示把检测器几何、视觉语言语义及同图实例依赖逐步结合，在SAM分割前进行上下文感知的框调整。

Abstract: Instance segmentation is a fundamental computer vision task with diverse real-world applications. Recently, prompt-driven foundation models have shown promising generalization. However, automated prompting remains limited by insufficient semantic guidance and inter-instance modeling. To address this challenge, we propose a novel architecture, named Semantic Relational Prompt Refinement Network (SRPR-Net), for automated SAM-based instance segmentation. A sequential prompt refinement mechanism is introduced to enrich detector geometry with visual-language semantics and then incorporate same-image instance dependencies, enabling context-aware box adjustment before SAM segmentation. Experiments on multiple standard benchmarks demonstrate that SRPR-Net achieves consistent improvements in segmentation performance over existing state-of-the-art approaches. The code is publicly available at https://github.com/JeremyXSC/SRPR-Net.

[97] Look Where It Counts: A Free, Label-Free Visual Evidence Signal for Fine-Grained Vision-Language Reasoning cs.CV | eess.IVPDF

Santi Ram Tiwari, Nihal Naik, Devbrat Pandey, Nishant Sinha

TL;DR: 提出免训练的视觉证据信号，从模型对相关与无关图像区域的输出差异中定位细粒度问答证据。

Details

Motivation: 多模态模型在细粒度视觉问题上常因高分辨率图像被下采样而看不到证据；常见训练或教师方案成本较高。

Result: 无需标注地选择答案分布最集中的候选裁剪，可将目标定位能力提升至随机水平的4.4至5.1倍，并使推理准确率从70%升至85%；信号与模型置信度结合后正确性AUC最高0.99。对应自蒸馏训练在试验规模下未超过基线。

Insight: 相关区域与无关区域条件下的逐token对数似然差可作为无标签证据指标；效果集中于感知瓶颈问题，在全局上下文对照中消失。

Abstract: Multimodal large language models (MLLMs) fail at fine-grained visual questions less because they cannot reason than because they never see the evidence: high-resolution images are downsampled before encoding, so the model answers from linguistic priors. The standard remedies are expensive: annotated answers (SFT), hand-engineered verifiers (RLVR), or a large external teacher (on-policy distillation). We ask whether the visual evidence itself can supply the signal for free. We formalize the contrastive evidence gap, the per-token log-likelihood ratio that a model assigns to its own output when conditioned on a question-relevant region versus an irrelevant one, and study it across Qwen2.5-VL-7B, Qwen3-VL-8B, and Qwen3-VL-30B-A3B on V*Bench. Our main positive result is training-free: selecting the candidate crop under which the model’s answer distribution is most peaked, using a single-view, label-free criterion, discovers the answer-bearing region with no bounding boxes, training, or labels. It localizes the target 4.4 to 5.1 times better than chance and raises fine-grained accuracy from 70 percent to 85 percent at inference. We further show that the gap is complementary to the model’s own confidence. Combining them predicts correctness better than either alone, with AUC up to 0.99, and flags confidently wrong answers, with AUC ranging from 0.97 to 1.00 within the high-confidence subset. All effects concentrate on perception-bottleneck questions and vanish on a global-context control. Finally, we report an honest negative result: converting the same signal into a training method, gated self-distillation (SEG-Distill), does not outperform the base model at pilot scale across three gate designs, while more aggressive gating degrades accuracy. The signal is real, but converting it into training gains remains an open problem.

[98] Hierarchical Prompt Learning for Hyperbolic Vision-Language Models cs.CVPDF

Andro Erdelez, Pascal Mettes, Behzad Bozorgtabar

TL;DR: HyPLO系列把类别父子层级引入冻结双曲视觉语言模型的提示学习，改善新类别泛化和层级一致性。

Details

Motivation: 双曲表示适合表达层级，但现有适配常用固定提示；常规提示学习又把类别当作平面集合，忽略可用分类体系。

Result: 在11个标准数据集上，基于CoOp、CoCoOp及MaPLe的三种变体均改善已见到新类泛化和跨数据集迁移；在六项层级指标中预测更符合分类体系。

Insight: 为父类别单独学习提示，并加入父级监督、双曲蕴含正则与父级反馈logit融合；收益在需将新类放入既有分类树时最大，兄弟类细粒度混淆时最小。

Abstract: Hyperbolic vision-language models (VLMs) represent image and text features in a geometry naturally suited to hierarchy, but their adaptation to downstream tasks has largely relied on fixed prompts. Existing prompt learning methods, meanwhile, treat class labels as a flat set and do not exploit available taxonomic structure. We address this gap with a hierarchical prompt learning plug-in for frozen hyperbolic VLMs. Given a fixed offline parent-class hierarchy, it augments a class prompt learner with a separate parent prompt learner, parent-level supervision, hyperbolic entailment regularization, and parent-feedback logit fusion. We instantiate the method with CoOp, CoCoOp and MaPLe, yielding HyPLO, CoHyPLO and MaHyPLO. Across the standard 11-dataset benchmark, all variants improve base-to-new generalization and cross-dataset transfer, and remain comparable to their prompt learning baselines under domain shift. Six hierarchical metrics and embedding analyses show that the method produces more taxonomically consistent predictions and induces a hierarchy-consistent organization of parent, class, and image embeddings in hyperbolic space. Its gains are largest when novel classes must be placed within a fixed taxonomy, and smallest for fine-grained confusions among sibling classes or shifts affecting only the image distribution.

[99] HappyWorld-Bench cs.CVPDF

Zhiqi Bai, Junai Cai, Yixin Chen, Jingrun Du, Tao Feng

TL;DR: HappyWorld-Bench评估生成世界在智能体探索、交互和修改过程中的质量、状态一致性及响应可靠性。

Details

Motivation: 仅评价生成画面质量不足以判断世界模型是否能持续保持状态并正确响应行动干预。

Result: 基准涵盖1,138个视频提示、300个空间场景及254个具身案例，并评估多类模型；视频长时滚动和重访一致性下降，空间系统最高摆放准确率70.14%，具身系统难以维持多步状态。

Insight: 以生成构建到统一世界建模的六级能力体系组织视频、空间和具身三条评测轨道，并结合人类比较Elo与自动行为正确性指标。

Abstract: Evaluating world models requires assessing both the quality of the worlds they generate and their consistency and responsiveness under exploration, interaction, and modification. We introduce HappyWorld-Bench, a comprehensive benchmark that evaluates whether generated worlds remain reliable as agents interact with them. Our design is built on a hierarchical capability framework of six world capabilities (W1-W6), from generative construction to unified world modeling, instantiated across three independent evaluation tracks: video world models, spatial world models, and embodied world models. HappyWorld-Bench comprises 1,138 video prompts, 300 spatial scenes, and 254 embodied test cases. Across all three tracks, we build and operate HappyWorld-Arena to organize human A/B comparisons and derive model-level Elo ratings, which complement newly designed automated metrics that capture behavioral correctness. We evaluate 14 video world models, 9 spatial systems, and 8 embodied candidates under this unified framework. Results reveal remaining reliability gaps across all three tracks: video models exhibit reduced consistency during extended rollouts and revisits, spatial models achieve at best 70.14% placement accuracy and 73.33% edit execution, and embodied models struggle to preserve state across multi-step actions and respond precisely to altered action conditions and physical rules. These findings highlight the need to evaluate world models not only by visual quality, but also by state consistency and the correctness of their responses to actions and interventions.

[100] AnalogDepth: Multi-view Geometry from FPV drones under Analog Video Transmission cs.CV | cs.ROPDF

André Amorim, Pedro F. Proença

TL;DR: AnalogDepth用真实FPV模拟传输噪声适配深度基础模型，改善模拟视频中的多视角几何重建。

Details

Motivation: 模拟图传会产生有空间结构的退化，与常规训练使用的高斯或独立噪声不同，已显著损害Depth Anything 3表现。

Result: 在三个室内场景的六段真实飞行序列上，真实噪声库训练持续降低逐帧深度RMSE和三维重建Chamfer距离，优于预训练模型及两种高斯噪声方案。

Insight: 从静态FPV录像构建噪声库，再通过LoRA和学生—教师蒸馏进行参数高效适配；保留真实噪声的空间结构是改进的关键。

Abstract: Analog video transmission (VTX) remains widespread in FPV drones due to low latency, weight and low cost. However analog VTX suffers from complex spatially structured image degradation which differ fundamentally from digital image corruption (e.g. AWGN) used in standard training augmentation. This work shows that this type of noise severely degrades the accuracy of Depth Anything 3 (DA3), a state-of-the-art feed forward visual geometry foundation model. To address this gap, we present AnalogDepth, a parameter-efficient training pipeline that adapts DA3 to analog FPV imagery using student-teacher knowledge distillation with Low-Rank Adaptation (LoRA) injected into the DINOv2 backbone. Rather than synthesizing noise analytically, we build a noise bank from static FPV recordings under diverse conditions and compare real-noise injection against PSD-matched Gaussian synthesis and AWGN as baselines. Experiments on six real FPV flight sequences across three indoor scenes show that training with our noise bank consistently reduces per-frame depth RMSE and 3D reconstruction Chamfer distance compared to the pretrained DA3 baseline and both Gaussian noise variants. These results demonstrate that replicating the spatial structure of real analog transmission noise is critical for effective adaptation.

[101] NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models cs.CVPDF

Jiajing Lin, Xin Zhang, Jianhua Sun

TL;DR: NeuIDO把世界动力学建模为神经算子学习，从视频观察中学习统一的内在动力学表征。

Details

Motivation: 物理信息4D生成依赖人工指定动力学假设，未能让模型自身内化世界规律，限制了其成为真正世界模型。

Result: 实验显示NeuIDO能统一不同视觉观察中的内在动力学，并在新场景中快速推断动力学；可零样本使用，也可用少量样例适配复杂真实动态。

Insight: 两阶段训练学习从视觉观察分布到内在动力学分布的映射，再直接从视频推断动态，推动物理引导的4D生成向世界模型发展。

Abstract: World models aim to capture environmental dynamics and predict future trajectories, showing growing potential for embodied intelligence. Physics-informed 4D generation integrates physical simulation to predict 3D object interactions, offering a promising pathway toward world models. However, this paradigm relies on manually imposed dynamical assumptions rather than internalizing world dynamics, and thus still leaves a gap toward a true world model. To bridge this gap, we propose NeuIDO, a novel world dynamics modeling framework that learns a unified intrinsic dynamics representation from visual observations, advancing physics-informed 4D generation toward a world model. Specifically, we formulate world modeling as a neural operator learning problem and introduce a two-stage training strategy to learn a generalizable mapping from the visual observation distribution to the intrinsic dynamics distribution. Building on this observation-dynamics mapping, NeuIDO enables zero-shot dynamics inference directly from videos and can be further aligned with complex real-world dynamics via few-shot adaptation. Extensive experiments demonstrate that NeuIDO effectively unifies the intrinsic dynamics underlying diverse visual observations into a shared representation and rapidly infers dynamics in novel scenes.

[102] LiAuto-MindViT: A Hybrid Vision Backbone with Adaptive Bidirectional Mamba cs.CVPDF

Lifu Mu, Shuai Chen, Wen Zheng, Haoyi Sun, Xueyang Fu

TL;DR: LiAuto-MindViT结合卷积、Mamba和Transformer，以双向自适应扫描改善视觉空间上下文建模和推理效率。

Details

Motivation: Mamba适合长序列，但视觉理解还需局部邻域关联和多方向空间信息，单向状态空间扫描存在方向偏差。

Result: 在图像分类、目标检测和语义分割上达到摘要所称的先进性能，并通过结构重参数化提升推理效率；摘要未提供具体数值。

Insight: 可学习加权的双向选择性扫描按内容融合方向信息，避免穷举多路径路由；RepConvSE则把部署时结构重参数化以减少延迟和访存。

Abstract: While Mamba-based models have shown strong potential for long sequence modeling, adapting them to vision is challenging due to the requirement of local neighborhood correlations and multi-directional spatial contexts for visual understanding. In this paper, we present LiAuto-MindViT, a novel hybrid vision backbone that synergizes the strengths of CNNs, Mamba, and Transformers. The core of our design is the Adaptive Bidirectional Mamba (ABM), which eliminates the directional bias of unidirectional SSMs through bidirectional selective scanning with learnable alpha blending, enabling content-adaptive directional fusion without the overhead of exhaustive multi-path routing. To further accelerate inference, we propose a deployment-friendly Reparameterized ConvSE (RepConvSE) module that leverages structural reparameterization to reduce latency and memory access overhead. Extensive experiments demonstrate that LiAuto-MindViT achieves state-of-the-art performance on image classification, object detection, and semantic segmentation while enabling efficient inference through reparameterization.

[103] Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection cs.CV | cs.AI | cs.CRPDF

Xianlong Li, Pietro Bongini, Niccoló Pancino, Marco Blanchini, Benedetta Tondi

TL;DR: 拆解免训练多模态智能体在开放世界伪造图像检测中的作用，分析检测器筛选、提示和证据裁决。

Details

Motivation: 真实图像取证需覆盖合成、局部编辑、拼接及替换等多种操作，单一专用检测器难以通用，智能体各组件的真实贡献尚不明确。

Result: 朴素检测器融合会对真实图像产生大量误报；筛选和提示稳定改善结果，而更强的推理评审器尤其在分布外数据上收益最大。各配置的篡改召回率都接近饱和。

Insight: 开放世界取证的主要挑战并非发现篡改，而是判断各专用工具证据是否可信并处理冲突；跨三种多模态骨干和六种配置的消融支持这一结论。

Abstract: Image forensics is increasingly an open-world problem: manipulations range from fully synthetic images to localized edits, splicing and swapping, while most forensic detectors remain specialized to a single manipulation family. Agentic AI has recently emerged as a promising solution. In principle, such systems can assess the reliability of individual detectors, identify out-of-scope evidence, and arbitrate conflicting reports. However, it remains unclear which components actually drive performance and whether their benefits persist under distribution shift. To answer these questions, we study a training-free agentic framework built around specialist detectors, per-detector triage, and conflict-aware evidence arbitration. Using six configurations and three multimodal large language model backbones, we dissect the role of triage, prompting, and reasoning quality on both in-distribution and out-of-distribution data. Our results show that naive detector fusion suffers from severe false-positive rates on authentic images. Triage and prompting consistently improve performance by filtering unreliable evidence and exposing detector limitations. However, the dominant factor is represented by reasoning itself: A stronger judge substantially outperforms a weaker one, particularly under distribution shift. Most notably, manipulation recall is nearly saturated across all configurations, indicating that the main challenge of open-world image forensics is not detecting manipulations, but calibrating trust in specialized forensic tools and arbitrating conflicting evidence.

[104] TReViS: Temporal Repetition Structure Aware Video Synthesis for Self-supervised Repetitive Action Counting cs.CVPDF

Fanqi Yu, Shengming Ma, Stefano Fiorini, Vito Paolo Pastore, Xuan Qi

TL;DR: TReViS从无标注视频估计重复节奏并合成训练序列，用于无需重复次数标签的重复动作计数。

Details

Motivation: 全监督重复动作计数表现强，但需要成本高、难扩展的稠密时间标注。

Result: 在多个数据集和骨干上，TReViS持续优于先前自监督方法，并达到与若干监督基线相当的表现。

Insight: 先由时间自相似矩阵估计周期统计，再合成保留真实重复结构且含可控时间变化的视频，并生成伪标签训练既有计数模型。

Abstract: Fully supervised repetitive action counting (RAC) has achieved strong performance, but requires dense temporal annotations that are costly and difficult to scale. We propose TReViS, a self-supervised video synthesis framework that enables training RAC models without any repetition labels. TReViS estimates the underlying temporal repetition structure of an unlabeled video via a Temporal Self-Similarity Matrix, infers its cycle statistics, and synthesizes new training sequences that preserve realistic repetition patterns while introducing controlled temporal variability. These synthesized videos are paired with pseudo-labels and used to train existing RAC architectures from scratch. Across multiple datasets and backbones, TReViS consistently outperforms prior self-supervised methods and achieves performance competitive with several supervised baselines, while remaining fully label-free, demonstrating the effectiveness of structure-aware video synthesis for label-free RAC. The source code is available at https://github.com/yfqi/TReViS.

[105] Topographic Training Concentrates Causal Circuits Without Improving Neuron Monosemanticity cs.CV | cs.LGPDF

Gautam Ranka, Shubham Santosh Pandere, Aiden Dsouza

TL;DR: 研究拓扑训练先验对视觉Transformer可解释性的影响，发现它能集中因果回路结构，却未提升单神经元单义性。

Details

Motivation: 特征叠加使单个神经元混合多个概念，是机制可解释性的重要障碍；现有稀疏编码等缓解方法通常事后处理而不改变网络。

Result: ImageNet-100上α=1时，拓扑簇因果充分性是同规模随机单元集合的2.79倍且随权重增大；SAE稀疏度反而下降11%、死特征比例增至19倍，而神经元单义性分数不变。

Insight: 空间局部性损失把因果信息集中到局部回路层面，不等于拆解单个神经元；常用神经元级指标可能遗漏真实的回路级可解释性改善。

Abstract: Mechanistic interpretability of vision transformers seeks to decompose model computation into human-readable units, but learned representations entangle many concepts in each neuron. Feature superposition is widely treated as the central obstacle to this decomposition, yet most mitigations (sparse autoencoders, dictionary learning) are post-hoc and leave the underlying network unchanged. We ask whether a spatial-locality training loss (TopoLoss) can act as a lightweight, training-time prior that improves interpretability of standard mech-interp tools. Training ViT on ImageNet-100 across multiple TopoLoss weights $α$, we measure causal sufficiency of topographic clusters via activation patching and feature geometry via sparse autoencoders fit to the same residual stream. At $α=1.0$, topographic clusters are 2.79$\times$ more causally sufficient than random unit sets of the same size, with the effect increasing monotonically in $α$. SAE L0 sparsity decreases by 11% and dead-feature fraction rises 19-fold, yet standard neuron-level monosemanticity scores are unchanged, indicating that topographic pressure acts at circuit level, concentrating causal mass into spatially local structures without disentangling individual neurons. This dissociation suggests current neuron-level monosemanticity metrics are insensitive to a class of real interpretability gains, and positions cheap architectural priors as a viable training-time complement to post-hoc tooling.

[106] Can Spiking Neural Networks play pinball? A neuromorphic motion detector for target tracking cs.CVPDF

Mazdak Fatahi, Šárka Pryjmaková, Pierre Boulet, Giulia D’Angelo

TL;DR: 实现一套基于事件相机与脉冲神经网络的弹球闭环感知控制系统，并在模拟和实体平台上验证。

Details

Motivation: 生物视觉以稀疏异步脉冲实现低延迟运动感知；弹球任务可检验小目标快速运动下的实时追踪与节能控制。

Result: 系统命中率56.1%，接近人类平均值两倍，响应时间21.7毫秒、网络延迟5毫秒，估计功耗148微瓦且少于2.5万神经元；实体球和真实挡板演示也验证可行。

Insight: 动态视觉传感器输入由SpiNNaker上的脉冲时间差编码网络估计位置、速度和方向；只调整一个可解释策略参数即可覆盖谨慎到激进的打法。

Abstract: Biological visual systems achieve continuous, low-latency motion perception by processing sparse, asynchronous spiking signals, enabling real-time tracking under strict energy constraints. Event-based cameras, inspired by the mammalian retina, replicate this efficiency by capturing only local brightness changes as asynchronous events, offering a natural substrate for spiking neural networks (SNNs) to parallelise computation and adapt to fast-changing scenes. Pinball provides a controlled yet dynamic testbed, requiring precise motion estimation and fast reaction to a small, rapidly moving target. This work presents a fully spiking, real-time perception-to-action pipeline for closed-loop pinball gameplay. A dynamic vision sensor observes a small, fast-moving ball, and a network of spiking Time-Difference Encoders on the SpiNNaker neuromorphic platform jointly estimates its position, speed, and direction. The system is characterised across receptive field size, accumulation window, and angular tuning width for real-time operation, and benchmarked in closed loop against human players across two flipper regimes of increasing physical realism. It achieves a hit rate of 56.1%, nearly double the human average, reacting within 21.7 ms (5 ms network latency) and consuming an estimated 148 μW using fewer than 25k neurons, among the fastest and most energy-efficient event-based closed-loop demonstrators benchmarked. Under more realistic flipper dynamics, tuning a single interpretable policy parameter reproduces the full spectrum of human play styles, from cautious to aggressive, with no change to the perception pipeline. A physical demonstrator, tracking a real ball and actuating real flippers in closed loop, confirms the principle operates beyond simulation. Its fully spiking, learning-free design offers a compact, energy-efficient example of real-time neuromorphic perception-to-action.

[107] DeCo: Efficient Decouple-to-Couple Learning for Multi-Task Visual Grounding cs.CVPDF

Xiaoqiang Lu, Licheng Jiao, Long Sun, Yuting Yang, Xu Liu

TL;DR: DeCo先分离视觉定位与分割任务特征，再融合语义和分割空间先验，统一处理多任务视觉指代。

Details

Motivation: 不同定位与分割目标的特征需求存在冲突，仅靠共享表征协作可能造成任务干扰。

Result: 在RefCOCO、G-Ref、Flickr及多个遥感基准上，DeCo在自然图像和遥感任务均达到先进表现；摘要未列具体数值。

Insight: 任务感知语义解耦按显著词汇路由共享视觉线索；混合先验耦合再将句级语义与分割掩码的空间先验结合，且冻结多模态编码器、只训练轻量参数。

Abstract: Multi-task visual grounding requires models to jointly understand linguistic semantics and perform accurate visual localization and segmentation. Despite the success of multimodal large language models, effectively adapting them to multiple grounding objectives remains challenging. Existing methods commonly enforce task cooperation through shared representations, while overlooking the intrinsic conflict between task-oriented feature interests. In this paper, we introduce $\textbf{DeCo}$, an efficient $\textbf{De}$couple-to-$\textbf{Co}$uple learning framework that resolves this dilemma through a two-stage paradigm: task-specific representation decoupling followed by complementary prior coupling. Specifically, we first propose Task-aware Semantic Decoupling (TSD) to route shared visual cues into individual features under salient word-level guidance, alleviating representation interference between localization and segmentation. Furthermore, we observe that segmentation naturally provides informative localization priors due to dense supervision. Based on this insight, we introduce Hybrid Prior Coupling (HPC), which integrates sentence-level semantic prior with mask-derived spatial prior for enhanced grounding. Built upon a frozen multimodal encoder, DeCo requires lightweight trainable parameters while achieving strong generalization across multiple grounding objectives. Extensive experiments on RefCOCO/+, G-Ref, ReferIt, Flickr, DIOR-RSVG, SARVG1.0, RRSIS-D, RIS-LAD, and RefDIOR demonstrate that DeCo achieves state-of-the-art performance on both natural and remote sensing benchmarks. The code and models are available at https://github.com/xiaoqiang-lu/DeCo.

[108] Estimating Accurate Hand Pose in Camera Space with Vision Transformer cs.CV | cs.AI | cs.GRPDF

Kaiwen Ren, Yiran Jiang, Yongjing Ye, Shihong Xia

TL;DR: 提出基于视觉Transformer的单目相机坐标系手部姿态估计方法，并用帧率感知的多数据集训练逐帧细化。

Details

Motivation: 全局手姿估计还需定位手腕在相机坐标系中的位置，受到单目深度歧义及局部手姿与手腕位置投影耦合影响。

Result: 在HO3D上，方法相对当时先进方法的CS-MJE最多提升37.1%。

Insight: 变换同构监督提取手部深度信息，透视信息嵌入处理局部姿势与全局位置耦合；序列训练再利用帧率信息渐进细化姿态。

Abstract: Monocular RGB-based hand pose estimation has emerged as a critical research frontier in computer vision. The local hand pose estimation methods predict hand poses relative to the wrist, while global hand pose estimation also requires estimating the wrist’s position in the camera coordinate system. However, this camera-space estimation confronts two fundamental challenges: (1) depth ambiguity in monocular settings, and (2) the coupling effect of hand local poses and global wrist positions in the perspective projections. In particular, this coupling reflects that the projections are jointly determined by local hand poses, wrist positions, and camera intrinsics. To overcome these challenges, our framework proposes two key innovations: Transformation-Isomorphism Supervision for hand-depth information extraction and Perspective Information Embedding for resolving above coupling effect of local pose and wrist position, both integrated within the mainstream encoder-decoder architecture. Besides, we propose a novel framerate-aware multi-dataset training strategy for sequential pose refinement. Our fully integrated approach achieves at most 37.1% superiority in CS-MJE over SOTA on HO3D. Project page: https://github.com/Mine268/CS-ViT.

[109] Do LiDAR Language Models Really Understand Spatio-temporal Relationships? cs.CV | cs.AI | cs.ROPDF

Runyi Yang, Murat Akkoyun, Di Wen, Ruiping Liu, Yufan Chen

TL;DR: LiDAR-Hallu用几何参照基准检验4D激光雷达语言模型是否真正理解时空关系，而不只依赖选项偏差。

Details

Motivation: 部分模型在多选题上即使总选同一选项也接近其报告准确率，常规聚合分数无法揭示物理关系理解失败。

Result: 10,000题覆盖150个nuScenes场景；分析10万条回答发现，候选时长可在不看LiDAR时预测时间答案，模型常对要求相反答案的配对场景给出相同回答，且两种配置都漏掉所有正向横向运动案例。

Insight: 以固定答案及候选内容对照、同提示但相反参照答案的跨场景配对和关系级召回率诊断捷径；时间打乱对比解码净收益很小，主要错误仍在。

Abstract: Recent 4D LiDAR language models aim to reason about objects and their evolving spatial relationships. Yet, in our evaluation, always selecting the same option nearly matches the multiple-choice accuracy of two B4DL-derived configurations. We introduce LiDAR-Hallu, a geometry-referenced benchmark and diagnostic protocol with 10,000 questions across 150 nuScenes scenes. It covers object existence, ego-relative position, distance ordering, relative motion, and temporal localization, with explicit rules for selecting objects, comparing times, and determining reference answers. Our protocol combines fixed-answer and candidate-content controls, cross-scene pairs with identical prompts but opposite reference answers, and relation-specific recall. Analysis of 100,000 recorded responses reveals failures hidden by aggregate accuracy. Candidate duration alone makes temporal answers predictable without observing LiDAR. On paired questions, the models frequently give the same answer to scenes requiring opposite answers. Relation-specific analysis further shows that both configurations miss every positive lateral-motion case across all tested conditions. Temporal-shuffle contrastive decoding provides little net improvement, as repairs are largely offset by new errors and the main failures persist. These results show that evaluating spatio-temporal reasoning requires testing whether models distinguish the queried physical relationships, rather than relying on individual-answer accuracy alone. The source code, checkpoints, and data are released at https://github.com/Awesome4D/4DMLLM_Hallucination_Bench.

[110] Spatial Action Review: A Visual Analytics Dashboard for Auditing Language-to-Action Hand-offs in Electron Microscopy cs.CVPDF

Samia Mohinta, Albert Cardona

TL;DR: Spatial Action Review提供可视分析面板，审计电子显微镜工作流中VQA答案与下游空间动作是否一致可靠。

Details

Motivation: 监督者可能因文字答案正确而放行区域，但配对点集动作漏掉下游分割或审查所需目标，形成静默失效。

Result: 在541个电子显微镜图像区域中，正确VQA回答对应的点动作有54.4%未通过可靠性门槛，全部记录中27.4%为静默失效；答案正确与对象覆盖仅弱相关。

Insight: 仪表板将答案—动作记录、任务风险地图和图像区域证据连接起来，支持可调阈值复审，并要求人工记录接受、升级、暂缓或要求模型修改的决定。

Abstract: Multimodal large language models (MLLMs) are increasingly explored as interfaces for scientific image analysis, where a visual question-answering (VQA) response may be paired with a spatial output that guides a downstream stage. A supervisor reads the language answer, while a downstream workflow such as segmentation or region review consumes the point-set output. We call this transition from inspecting the answer to relying on its point action the language-to-action hand-off. A silent failure occurs when the answer is correct while the paired action misses annotated objects needed downstream, so answer-based oversight clears a region whose action is unreliable. We introduce Spatial Action Review, a visual analytics dashboard for auditing this failure mode in electron microscopy (EM) mitochondria analysis. It links paired answer-action records through an answer-action ledger, a task-by-dataset risk map, and an image-region audit view, connecting aggregate patterns to image evidence while an adjustable action-reliability gate supports re-audit. The review ends in a human-AI hand-off, where a supervisor records whether the action is accepted, escalated, held under a stricter gate, or flagged for model revision. Across 541 image regions from an EM-adapted Qwen3-VL case-study run, point actions fail the gate in 54.4% of records with a correct VQA response, and 27.4% of all records are silent failures. A correct answer is associated with only a 5.8-percentage-point higher probability of a reliable action, with a bootstrap interval spanning zero; the point-biserial correlation between answer correctness and object coverage is 0.061. This weak coupling persists across five model conditions on 753 matched image regions. Spatial Action Review makes answer-action mismatches visible and ties them to image evidence and a recorded decision before MLLM outputs enter autonomous scientific workflows.

[111] VPRune: Efficient Training-free Pre-LLM Visual Token Pruning cs.CV | cs.AIPDF

Guangchuan Lv, Dianxing Shi, Dingjie FU

TL;DR: VPRune在进入LLM前执行免训练视觉token裁剪，通过多样性筛选、相似度回收和位置恢复保留有效信息。

Details

Motivation: 大幅裁剪能降低视觉语言模型成本，但文本引导偏差、被删token信息损失及序列压缩造成的位置失真会损害表现。

Result: 在FastVLM-1.5B多个基准上取得较好的准确率—压缩折中，强压缩下优势明显；边缘设备端到端延迟降低且任务表现优于对照。

Insight: 裁剪依据只使用视觉信息以避免文本偏置；对被丢弃token中有用信息作相似度引导回收，并恢复保留token原有位置，无需训练。

Abstract: Visual token pruning is a promising approach to reducing the inference cost of large vision-language models (LVLMs), yet aggressive token reduction often causes substantial performance degradation. We identify three key factors behind this degradation: text-guided selection bias, information loss from discarded tokens, and positional distortion caused by sequence compaction. Based on these observations, we propose \textbf{VPRune}, a training-free pre-LLM pruning framework consisting of visual-only diversity selection, similarity-guided token recycling, and position-preserving restoration. Experiments on FastVLM-1.5B across multiple vision-language benchmarks demonstrate that VPRune achieves a favorable accuracy–compression trade-off, with particularly pronounced advantages under aggressive compression. Furthermore, evaluations on edge-device show that VPRune effectively reduces end-to-end inference latency while maintaining superior task performance, demonstrating its practicality for resource-constrained LVLM deployment.

[112] AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos cs.CV | cs.AIPDF

Kirill Mazur, Nikita Karaev, Matthew Chang, Jitendra Malik, Nur Muhammad “Mahi’’ Shafiullah

TL;DR: AgentSTAR通过VLM智能体的渲染—比较循环，从单目视频联合重建物体形状、运动结构并追踪其状态。

Details

Motivation: 常规方法先估计稠密像素对应再恢复运动，遇到大幅运动、关节活动和严重遮挡时容易失效。

Result: 在ARCTIC上显著优于关节物体三维点跟踪基线，在HOT3D上优于所有评估的刚体跟踪基线。

Insight: 先建立含几何和运动学结构的三维物体模型，再结合VLM粗粒度视觉判断与数值位姿优化，迭代细化形状或广义姿态，无需像素匹配目标。

Abstract: In this work, we present a method for shape reconstruction and tracking from video via agentic analysis-by-synthesis. Unlike prior methods which first estimate dense pixel correspondences and then recover object motion from them, our method infers a structured 3D object model, including its geometry and kinematic structure, and uses this model to optimise object track estimates over time. In our optimisation loop, a Vision-Language Model (VLM) agent iteratively refines shape or generalised pose through a render-and-compare loop, combining coarse visual reasoning with numerical pose optimisation for precise state estimation. This structured formulation enables our method to track through large motion, articulation, and severe occlusion without relying on pixel-matching objectives. Quantitatively, on ARCTIC, our method substantially outperforms state-of-the-art 3D point-tracking baselines for articulated objects, and on HOT3D it outperforms all evaluated rigid-object tracking baselines.

[113] Identity-Consistent Analysis of Long-Shot Windsurfing Video: A Domain-Specific Offline Tracking System cs.CVPDF

Bertil Braun

TL;DR: 为长镜头帆板视频构建离线身份一致追踪系统，输出每名冲浪者独立且稳定的相对视角视频。

Details

Motivation: 远景帆板视频目标小、镜头大幅摇移、人物长期重叠且背景变化快；一次错误身份合并就可能使追踪结果失去用途。

Result: 在21段人工重建视频、41,004个保留观测的固定观测协议上，系统配对精确率0.957、召回率0.918、F1为0.937，高于OC-SORT的0.792和BoT-SORT的0.828；95条输出轨迹中仍有9条混合身份。

Insight: 先形成保守局部轨迹，再以相机运动补偿和前景遮罩帆板颜色描述子全局关联；支架两个姿态点用于驱动跟随骑手的虚拟摄像机。

Abstract: Long-shot windsurfing video combines small targets, large camera pans, prolonged overlaps, and rapidly changing backgrounds. The desired output is not a generic MOT trace but a separate, stable rider-relative video for each surfer; one false identity merge can invalidate an otherwise useful result. We present an offline analysis system that detects surfers, forms conservative local tracklets, links them globally with camera-compensated motion and a foreground-masked sail-color descriptor, and uses two pose keypoints on the rig to drive a rider-relative virtual camera. The tracking stage is evaluated on 21 manually reconstructed development videos containing 41,004 retained observations. On this fixed-observation protocol, the production system achieves 0.957 pairwise precision, 0.918 recall, and 0.937 F1, compared with 0.792 F1 for OC-SORT and 0.828 for BoT-SORT. Compared with OC-SORT, it reduces fragmentation excess from 845 to 42, but nine of its 95 output tracks mix rider identities and these errors affect seven of the 21 videos.

[114] 0.5%>100%: Bidirectional Reciprocal Learning for Referring Image Segmentation cs.CVPDF

Xiaoqiang Lu, Licheng Jiao, Lingling Li, Yuting Yang, Long Sun

TL;DR: BRL以轻量适配器实现视觉基础模型在指代图像分割中的双向跨模态交互，减少全量微调成本。

Details

Motivation: 全量微调视觉基础模型开销高且可能灾难性遗忘；既有参数高效方法常单模态独立操作或只让语言指导视觉，缺少视觉反馈和逐步双向交互。

Result: 在RefCOCO、RefCOCO+和RefCOCOg上达到新的先进表现，更新参数少于骨干的0.5%。

Insight: 词元层的互惠注意力交换跨模态查询与键，通道层的互惠门控则用全局语义重新校准另一模态特征；两者共同增强细粒度空间定位。

Abstract: Recent advances in vision foundation models (VFMs) have shown remarkable capabilities across diverse unimodal visual tasks. However, adapting VFMs to referring image segmentation (RIS) typically necessitates precise vision-language alignment via full fine-tuning, incurring substantial computational overhead and risking catastrophic forgetting. While existing parameter-efficient fine-tuning (PEFT) methods enable safe knowledge transfer with minimal training costs, they predominantly operate independently within individual modalities or focus exclusively on unidirectional guidance from language to vision, overlooking progressive cross-modal interaction and visual feedback for textual refinement. To address these limitations, we propose Bidirectional Reciprocal Learning (BRL), a novel adapter-based PEFT framework that facilitates hierarchical, bidirectional information flow within both token-mixing and channel-mixing layers of frozen foundation models. Specifically, BRL introduces two complementary lightweight modules. The Reciprocal Attention Adapter (RAA) performs cross-modal query-key exchanges at the token level, enabling visual and linguistic tokens to mutually attend to each other for fine-grained spatial grounding. The Reciprocal Gate Adapter (RGA) generates cross-modal gating signals at the channel level, allowing global semantic context from one modality to adaptively recalibrate channel activations of the other. Extensive experiments on RefCOCO, RefCOCO+, and RefCOCOg benchmarks demonstrate the superiority of BRL over prior RIS methods, achieving state-of-the-art performance while requiring less than 0.5% backbone parameter updates. Code and models will be released at https://github.com/xiaoqiang-lu/BRL.

[115] Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma by Integrating Multimodal Ultrasound and Clinical Data: A Multicenter Study cs.CVPDF

Jun Cheng, Yuanyuan Kong, Qing Huang, Xiaotong Tan, Licong Dong

TL;DR: 多中心研究融合多模态超声与临床信息，预测肝细胞癌患者术前微血管侵犯风险。

Details

Motivation: 微血管侵犯与肝癌复发及生存相关，但常需术后组织病理确诊，术前预测有助于风险分层。

Result: 489名患者来自八个中心；独立外部验证中完整模型AUC为0.8953、准确率81.18%、敏感度86.40%、特异度78.14%。DCE-US单模态AUC最高，为0.8545。

Insight: 各模态专属编码器融合B超、彩色多普勒、动态增强超声和临床数据；双向血流动力学时序模块及表示一致性学习有助于建模灌注变化并对齐异构表征。

Abstract: Background: Microvascular invasion (MVI) predicts recurrence and survival in hepatocellular carcinoma (HCC) but requires postoperative histopathology for diagnosis. We developed and validated a model integrating multimodal ultrasound and clinical data for preoperative MVI prediction. Methods: This multicenter study included 489 patients with HCC from eight centers. All patients had B-mode ultrasound (BUS), color Doppler flow imaging (CDFI), dynamic contrast-enhanced ultrasound (DCE-US), and clinical information. Data from seven centers (n = 421) were used for model development with five-fold cross-validation; data from the remaining center (n = 68) formed an independent external validation cohort. The proposed multimodal information fusion network used modality-specific encoders, a hemodynamic temporal change module for bidirectional DCE-US perfusion changes, and a representation consistency learning module to align heterogeneous ultrasound representations before Transformer-based fusion. Results: In external validation, DCE-US achieved the highest single-modality area under the receiver operating characteristic curve (AUC; 0.8545+/-0.0198), versus clinical information (0.6715+/-0.0156), CDFI (0.6435+/-0.0344), and BUS (0.6087+/-0.0417). Pixel-difference sampling and the proposed temporal module outperformed alternative sampling and video representation methods. The full model achieved the best performance, with an AUC of 0.8953+/-0.0180, accuracy of 81.18%+/-2.83%, sensitivity of 86.40%+/-6.69%, and specificity of 78.14%+/-6.28. Conclusions: Integrating multimodal ultrasound and clinical information enabled promising preoperative MVI prediction in HCC. DCE-US was the main source of predictive information, while BUS, CDFI, and clinical information provided complementary value. The proposed framework may support preoperative risk stratification and individualized clinical decision-making.

[116] ME-VLM:A Unified VLM for Embodied Cognition and Agent Coordination cs.CVPDF

Foundation Model, Li Auto Inc

TL;DR: ME-VLM提供4B和35B-A3B两种具身视觉语言模型，统一物理认知、时空推理、规划交互和结果评估。

Details

Motivation: 物理智能需把视觉语言理解落到现实环境，并根据执行反馈和环境约束修正行动。

Result: 模型在具身、智能体、自动驾驶和导航基准上表现有竞争力；经视觉token压缩、W4A8量化和软硬件协同后，4B模型可在M100端侧运行，预填充延迟从400毫秒降至188毫秒。

Insight: 训练流程先注入具身能力，再分别强化学习训练具身和多模态智能体专家，最后以多教师在策略蒸馏整合能力；训练数据包含执行观察与反馈。

Abstract: Physical AI requires models to ground visual and linguistic understanding in real-world environments while accounting for environmental constraints and execution feedback. We introduce MachEmbodied-VLM (ME-VLM), a unified vision-language model with two variants, 4B and 35B-A3B, that brings together embodied cognition and multimodal agent capabilities. Our work emphasizes physical perception and spatiotemporal reasoning, together with planning, interaction, and outcome assessment in both digital and physical environments. We construct training data spanning embodied and multimodal agent tasks, including execution observations and feedback to support outcome assessment and decision refinement. The training pipeline comprises embodied capability injection, separate reinforcement learning of embodied and multimodal-agent experts, and multi-teacher on-policy distillation that consolidates their complementary capabilities into a single model. Experiments show competitive performance on both embodied and agent benchmarks, as well as on autonomous-driving and embodied-navigation tasks. For edge deployment, visual token compression, W4A8 quantization, and hardware–software co-optimization enable on-device inference of the 4B variant on the M100, reducing prefill latency from 400 ms to 188 ms. Project Page: https://machembodied.com/ME-Brain/ME-VLM.html Code Repository: https://github.com/MachEmbodied/ME-VLM

[117] Dynamic Thermal Gaussians: Multimodal 4D Gaussian Splatting cs.CVPDF

Rongfeng Lu, Lifeng Lin, Xiaobao Wei, Quan Chen, Ming Lu

TL;DR: 提出动态热成像高斯泼溅框架，联合重建场景随时间变化的RGB外观、热分布与几何。

Details

Motivation: 已有三维热重建多假设温度静态，无法反映真实场景中的热传递时变过程。

Result: 实验显示方法能高保真重建外观与温度的时空变化；作者还提供含高频温度变化的新评测数据集，摘要未给出具体指标。

Insight: RGB与热信号共享几何基底以保持变形时空一致性；多模态路由保留共享高斯作为几何骨干，并在细节丰富区域动态增加模态专属高斯。

Abstract: Thermography plays a vital role in military and broader thermal analysis applications. Recent progress in 3D thermal reconstruction has extended temperature analysis from 2D to 3D space, yet most existing works assume static temperature distributions, neglecting the temporal dynamics of heat transfer in real-world environments. To address this limitation, we propose the first dynamic RGB-Thermal reconstruction framework for complex scenes. Our method jointly models RGB appearance, thermal observations, and scene geometry as they change over time. Specifically, we introduce a multimodal dynamic scene representation that anchors both the color and thermal modalities to a shared geometric substrate, ensuring their consistency under spatiotemporal deformations. We further design multimodal embeddings to enhance the motion expressiveness for each modality, and propose a multimodal routing mechanism that retains a unified set of shared multimodal Gaussians as the geometric backbone while adaptively spawning modality-specific Gaussians to strengthen the representational capacity in detail-rich regions of each individual modality. In addition, we contribute a novel benchmark dataset featuring high-frequency temperature variations to facilitate the evaluation of 4D reconstruction. Extensive experiments demonstrate that our method achieves high-fidelity spatiotemporal reconstruction of both appearance and temperature. Our code and dataset are available at: https://github.com/LinLif1869/DTG.

Weixiang Zhou, Yuhao Wang, Xingguo Xu, Weizhen Zhou, Zhixun Su

TL;DR: INSPI通过任务条件的正激励噪声、结构提示与稀疏融合，提升多模态目标重识别对文本噪声的鲁棒性。

Details

Motivation: 文本描述可能含模态不匹配词句或语义歧义；仅做高层语义对齐也无法解决图像与文本的细粒度结构差异。

Result: 在三个多模态重识别基准上的实验表明，该方法有效且具鲁棒性；摘要未给出具体数值。

Insight: 跨模态调制器根据图像与文本共同采样噪声扰动全局词元，结构感知提示注入几何先验，稀疏融合模块再利用结构上下文并屏蔽身份特征中的噪声细节。

Abstract: Multi-modal object Re-Identification (ReID) benefits from complementary information across heterogeneous imaging modalities. To further enrich semantic representation, text descriptions have recently been incorporated as an additional modality. However, recent vision-language approaches often treat text descriptions as clean, deterministic signals and overlook their inherent noise, including modality-mismatched phrases and semantically ambiguous expressions. Moreover, prevailing methods lack explicit mechanisms to reconcile fine-grained structural discrepancies between modalities, even after high-level semantic alignment. To address these challenges, we propose a novel framework centered on Positive-Incentive Noise (π-noise) and structured prompt modulation. First, the Semantic Cross-Modal Modulator harnesses task-aware π-noise, sampled from a distribution conditioned on both visual and text inputs, to perturb global tokens and enable semantics-guided cross-modal compensation. Second, the Structure-Aware Prompt Adapter injects learnable geometric priors via prompts to enhance spatial consistency. Third, the Context-Aware Sparse Fusion module distills structural context to guide adaptive fusion while shielding identity features from noisy local details. Experiments on three multi-modal ReID benchmarks demonstrate the effectiveness and robustness of our approach. The code is available at https://github.com/zw-absin/INSPI.

Muhammad Umair, Muhammad Danial Maqbool, Fatima Arshad Cheema, Kapal Dev, Muhammad Hamad Alizai

TL;DR: MIRAGE为智能眼镜提供全身旁观者隐私保护、合成全身替换和经同意后恢复机制。

Details

Motivation: 智能眼镜持续录像即使遮挡面部，仍会暴露步态、姿态和轮廓等全身生物特征，可能被用于身份重识别。

Result: 在树莓派5、手机和云端生成后端实现；全身检测AP为0.948、AR为0.976。轮廓重识别降至10.86%，接近11.12%的随机水平；自适应攻击者的步态Rank-1从90.25%降至26.20%。

Insight: 三层架构结合完整身体检测与边界框遮罩、合成全身替换及加密恢复材料，使恢复仅在取得同意后执行。

Abstract: Video recording on smart glasses exposes more than faces. Continuous capture reveals full-body biometric signatures, including gait, posture, and silhouette, that enable person re-identification (ReID) even after conventional face sanitization. We present MIRAGE, a three-tier architecture for privacy-preserving smart glasses that enforces full-body privacy, supports synthetic full-body replacement, and retains encrypted recovery material for consent-based restoration. We implement MIRAGE on a Raspberry Pi~5 (a CPU-only proxy for smart-glasses compute), companion phones, and a cloud generative backend. Compared to prior systems, MIRAGE achieves 0.948 AP and 0.976 AR while accurately detecting the complete visible body. Its bounding box masking reduces learned silhouette-based ReID to essentially random guessing, with 10.86% Rank-1 accuracy compared with an 11.12% measured chance level. Even against an adaptive adversary retrained on MIRAGE’s sanitized pose signals, Rank-1 gait identification drops from 90.25% to 26.20%, removing 72.5% of the adversary’s identification advantage.

[120] HyperCLIP++: Fine-tuning CLIP forOpen-vocabulary Semantic Segmentation in Hyperbolic Space cs.CVPDF

Zelin Peng, Zhengqin Xu, Changsong Wen, Yu Huang, Yaoming Wang

TL;DR: HyperCLIP++用双曲半径调节和跨模态协同模块，参数高效地适配CLIP进行开放词汇语义分割。

Details

Motivation: 微调CLIP图文编码器能改善开放类分割，但需要处理图像表征从整图粒度转向像素粒度时的层级错配。

Result: 在三个基准上达到先进表现，同时只微调CLIP约5%的参数；调节后文本嵌入的双曲半径在不同数据集上相对固定。

Insight: 分割微调会缩小文本嵌入双曲半径以匹配像素级视觉粒度；方法通过缩放变换调整层级，再以双向交叉关系通信维持图文路径同步和跨模态对齐。

Abstract: CLIP, a foundational vision-language model, has emerged as a powerful tool for open-vocabulary semantic segmentation. While freezing CLIP’s text encoder is known to preserve its generalization capability, recent studies show that fine-tuning both CLIP’s text and image encoders jointly significantly enhances segmentation performance, especially for classes from open sets. In this work, we explain this phenomenon from the perspective of hierarchy alignment, since during fine-tuning, the hierarchical level of image embeddings shifts from image-level to pixel-level. We achieve this by leveraging hyperbolic space, which naturally encodes hierarchical structures. Our key observation is that, during fine-tuning, the hyperbolic radius of CLIP’s text embeddings decreases, facilitating better alignment with the pixel-level granularity of visual data. Building on this, we propose HyperCLIP++, a novel and parameter-efficient adaptation strategy. HyperCLIP++ directly adjusts the hyperbolic radius of CLIP’s embeddings via scaling transformations to achieve a hierarchy alignment to the target task, i.e., segmentation. To ensure this hierarchy alignment is effected consistently across both modalities and preserves their cross-modal alignment during training, HyperCLIP++ integrates a Dual Cross-Relation Communication (DCRC) module that synchronizes these adjustments between the vision and text pathways. Our experiments show that HyperCLIP++ achieves state-of-the-art performance across three benchmarks while fine-tuning only approximately 5% of CLIP’s total parameters. More importantly, we observe that after adjustment, CLIP’s text embeddings exhibit a relatively fixed hyperbolic radius across datasets, suggesting that the hierarchical level required for this segmentation task might be quantified using the hyperbolic radius.

[121] Video-based Surgical Skill Assessment Using Dynamics-and-Uncertainty-Aware Tree-based Gaussian Process Classifier cs.CVPDF

Arefeh Rezaei, Mohammad Javad Ahmadi, Amir Molaei, Hamid D. Taghirad

TL;DR: 将表征流卷积网络与动态及不确定性感知的树结构高斯过程分类器结合，用于手术视频技能评估。

Details

Motivation: 手术视频存在时间变化和异常动作转移，评估模型既需利用运动动态，也需量化输入不确定性并保持数据与计算效率。

Result: 在JIGSAWS和白内障手术数据集上取得较强表现；JIGSAWS受试者独立LOUO协议平均准确率96.9%，LOSO结果也具竞争力且计算成本更低。

Insight: 潜在运动既作为判别特征又用于估计不确定性；语义感知复合核融合语义、光流和动态信息，不确定性感知核进一步提升稳健性。

Abstract: The proposed pipeline integrates a representation-flow convolutional neural network with a dynamics- and uncertainty-aware tree-based Gaussian Process classifier. In this framework, latent motion dynamics are exploited both as discriminative representations and as a source of input uncertainty, enhancing robustness against temporal variations and abnormal motion transitions. Compared with conventional deep learning approaches, the proposed strategy requires less training data and offers improved computational efficiency. To further improve classification performance, we introduce novel semantic-aware compound kernels that effectively capture semantic, flow, and dynamic information embedded in surgical video features. In addition, uncertainty-aware kernels are developed to strengthen the robustness and practical applicability of the compound kernel framework. The proposed method is evaluated on two benchmark datasets, namely the JIGSAWS and the Cataract-LMM (Capsulorhexis) datasets. Experimental results demonstrate strong performance across both datasets, including the LOSO and LOUO evaluation protocols on JIGSAWS, including the subject-independent LOUO protocol on JIGSAWS, on which the framework attains a mean accuracy of \ph{96.9}%; results under the within-subject LOSO protocol are reported for comparability with prior work, achieving competitive accuracy while substantially reducing computational cost. Overall, the proposed pipeline provides an efficient and accurate framework for video-based surgical skill assessment.

[122] Active Visual Sampling with a Connectome-Constrained Fly Model for One-Shot Hatch Recognition in Architectural Drawings cs.CVPDF

Dmitry Kuklev

TL;DR: 研究利用果蝇连接组约束的视觉网络和主动扫描，在建筑图纸中进行免训练单样本填充纹理匹配。

Details

Motivation: 建筑剖面线纹理可表示材料类别，研究检验原为运动感知预训练的生物视觉网络能否迁移到一次示例匹配。

Result: 合成开发集上冻结果蝇网络准确率为0.857，扩展图例时为0.910；但受体特征本身达到0.891，轻量任务训练CNN达到0.959，因此尚未证明生物连接结构带来优势。

Insight: 对图像块沿八种轨迹主动扫描，并汇总57种细胞类型响应与每类单条图例匹配；结果支持运动视觉表征和主动采样有用，但真实图纸效用仍待验证。

Abstract: Architectural drawings encode material classes through repeated hatch patterns. We test whether a connectome-constrained fly visual network, pretrained for motion, can be repurposed without task-specific weight updates as a descriptor for one-shot hatch matching. Each 64 x 64 patch is translated over eight scan trajectories and summarized across 57 cell types; query descriptors are then matched to one legend strip per class. On 400 development sheets from a synthetic benchmark built on CubiCasa5K geometry, the frozen fly pipeline reaches 0.857 area-weighted accuracy and 0.910 with an extended legend. On an equal-brightness orientation condition it reaches 0.840 versus 0.299 for eleven pixel statistics, while a Gabor bank reaches 0.900. Replacing drift with a repeated still frame lowers the combined equal-condition score by 0.089 [0.066, 0.112]. However, a receptors-only descriptor reaches 0.891 and a task-trained 5,888-parameter CNN averages 0.959, so the current evidence supports transfer and the usefulness of active sampling, but not an advantage of the biological wiring. We separate project-recorded results from recomputed checks and report a small real-drawing audit. The supported claim is therefore narrow: motion-oriented biological vision can be repurposed as a useful texture representation for architectural hatch matching, while the topology contribution and end-to-end BIM utility remain open questions.

[123] Relationally Grounded Latent World Models for Autonomous Driving cs.CV | cs.ROPDF

Fabian Schmidt, Markus Enzweiler, Abhinav Valada

TL;DR: 将交通场景关系图作为特权语义监督，对齐自动驾驶潜在世界模型表征，并在推理时移除图监督分支。

Details

Motivation: 潜在世界模型虽能学习预测表征，但其保留的交通参与者关系语义通常不明确。

Result: 在nuScenes上，相较重训LAW基线，平均轨迹L2误差从0.661降至0.622，碰撞率从0.456降至0.217；表现也优于无结构的描述式语义目标。

Insight: 从三维标注构建以参与者为中心的场景图，用冻结文本嵌入模型编码关系并训练时与视觉潜表示对齐；测试阶段无需场景图、三维标注或额外计算。

Abstract: Latent world models learn predictive representations for autonomous driving, but the relational semantics these states preserve often remain implicit. We investigate whether traffic scene graphs can serve as privileged semantic supervision for latent world representations. Building on LAW, we construct actor-centric scene graphs from nuScenes 3D annotations, encode their serialized relational structure using a frozen text embedding model, and align the visual latent representations with this semantic target during training. We remove the supervision branch at inference, so it requires neither scene graphs nor 3D annotations and adds no test-time computation. On nuScenes, our method reduces average trajectory L2 error from 0.661 to 0.622 (5.9%) and collision rate from 0.456 to 0.217 (52.4%) relative to our retrained LAW baseline. It also outperforms an unstructured caption-style semantic target, supporting the benefit of explicit relational structure for latent world-model representation learning.

[124] ReSTI: A Source-Grounded Audit and Repair of STI-Bench cs.CVPDF

Pengzhan Sun, Ramanathan Rajaraman, Shiu-Hong Kao, Junbin Xiao, Angela Yao

TL;DR: ReSTI依据ScanNet、Waymo和Omni6DPose原始来源审计并修订STI-Bench的时空空间推理题。

Details

Motivation: 时空基准的问题、来源标注和选项必须描述同一物理量，但原基准含坐标系、时间戳和目标定义错误。

Result: 对2,064道旧题保留1,782道，并记录282道有证据支持的排除；修订版明确目标、时间、坐标系、物理量和单位。

Insight: 审计发现ScanNet定位任务遗漏原始相机坐标对齐，方向任务使用了错误平面，Waymo位姿也按错误时间戳评估；逐题重建答案可提供可追溯评测依据。

Abstract: Spatial–temporal benchmarks are valid only when their questions, source annotations, and answer options identify the same physical quantity. We audit STI-Bench against the official ScanNet, Waymo, and Omni6DPose sources and find systematic coordinate-system and timestamp errors, under-specified targets and times, and disagreements between keyed options and answer details. We introduce ReSTI, a source-backed revision that reconstructs every recoverable answer under an explicit target, time, coordinate system, physical quantity, and unit. Source reconstruction reveals task-level geometric failures: ScanNet Grounding omits the required alignment between annotation and raw camera coordinate systems, while Orientation measures camera rotation on the wrong plane. ReSTI replaces these labels with explicit, source-consistent geometric definitions and corrects other source-verifiable defects, including Waymo poses evaluated at the wrong timestamp. Across 2,064 legacy questions, ReSTI retains 1,782 questions and records 282 evidence-backed exclusions. ReSTI therefore provides a conservative and source-traceable basis for evaluating precise video spatial–temporal reasoning. Project page: https://github.com/pengzhansun/ReSTI.

[125] GraphSVR: q-Space–Aware Graph-Based Slice-to-Volume Registration for Diffusion MRI cs.CV | eess.IVPDF

Noga Kertes, Daphna Link Sourani, Alex M. Bronstein, Moti Freiman

TL;DR: GraphSVR将扩散MRI切片组及其采集关系建成图，以自监督方式估计全局一致的四维切片—体积运动。

Details

Motivation: 扩散MRI受运动影响且需对齐多个扩散方向的测量；现有顺序或成对相似方法在稀疏梯度采样和严重运动下易退化。

Result: 在合成与基于真实采集重组的模拟中，严重运动下相较FSL eddy，网格误差和旋转误差降低73%，稀疏方向场景收益最大。

Insight: 图边联合表示时间邻近、切片空间几何和扩散编码关系；图神经网络只需解剖参考图像即可零样本、自监督预测刚体运动，无需配对真值。

Abstract: Diffusion-weighted imaging (DWI) remains highly vulnerable to subject motion, particularly in time-efficient protocols and in motion-prone populations. While slice-to-volume registration (SVR) can mitigate inter-slice and inter-stack misalignment, diffusion MRI introduces additional complexity due to diffusion-direction-dependent contrast and the requirement to align dozens of measurements within a common reference frame, effectively yielding a 4D registration problem. Existing approaches rely primarily on sequential modeling or pairwise similarity and often degrade under sparse gradient sampling or severe motion. We introduce GraphSVR, a q-space-aware graph-based framework for 4D SVR registration in DWI. GraphSVR represents slice groups as nodes in an acquisition-structured graph, with edges encoding temporal proximity, spatial slice geometry and diffusion encoding relationships. A graph neural network predicts globally consistent stack-wise rigid motion, optimized in a self-supervised, zero-shot manner using only an anatomical reference image, without requiring paired ground-truth motion. We evaluate GraphSVR using both fully synthetic diffusion simulations and realistic recombination-based simulations from real acquisitions with controllable motion severity and gradient sparsity. Performance is quantified using grid error (mm) and rotation error relative to known ground-truth transforms. Under severe motion, GraphSVR reduces grid error and rotation error by 73% compared to FSL eddy, the standard DWI motion-correction method, with the largest gains observed in sparse-direction regimes. These results demonstrate that explicitly modeling acquisition structure through graph-based reasoning improves robustness and global consistency in 4D DWI motion estimation. Code is available at https://github.com/nogakertes/GraphSVR.git.

[126] MiTHras: Task-specific Hierarchical Semi-supervised Contrastive Masked Autoencoder for Mitotic Figure Analysis cs.CV | cs.LGPDF

Trinh T. L. Vuong, Simon Graham, Quoc Dang Vu, Phat T. H. Ho, Jeewoo Lim

TL;DR: MiTHras以伪标签引导的分层对比学习和掩码重建预训练有丝分裂图像表征，面向多项病理分析任务。

Details

Motivation: 有丝分裂分析支持肿瘤分级与预后判断，但组织类型和成像差异会影响自动模型稳健性。

Result: 由14个TCGA队列、11个器官位点构成的180万图像语料上，MiTHras在三个有丝分裂分类和两个亚型分类基准均取得最高平均F1；冻结编码器线性探测时优势比全量微调更大。

Insight: 图像级及词元级对比监督与掩码重建结合；检测提升较小可能受共同候选检测阶段限制，消融显示词元监督有助于典型—非典型分类。

Abstract: Mitotic figure (MF) analysis supports tumor grading and prognostic assessment, but automated models remain sensitive to differences in tissue type and image acquisition. We present MiTHras, a task-specific pretraining framework that combines pseudo-label-guided image- and token-level contrastive learning with masked reconstruction. We construct TCGA-MF-Pseudo, a corpus of 1.8 million cell-centered images from 14 TCGA cohorts spanning 11 organ sites. Comprehensive evaluation on MF classification, detection, count-based survival prediction, and subtype classification demonstrates the efficacy of MiTHras. It achieves the highest mean F1 on all three MF classification benchmarks and both subtype benchmarks. MiTHras also outperforms general-purpose and pathology foundation encoders by a larger margin under frozen-encoder linear probing than under full fine-tuning. Although detection gains are modest due to a shared candidate-detection stage, ablations confirm that token-level supervision improves typical-versus-atypical classification and linear probing. These findings establish that MiTHras yields robust, transferable representations for automated mitotic activity assessment.

[127] PrismGPT: Proxy-Guided Learning for Region-Aware Photo Editing with Self-Synthesized Reasoning cs.CV | cs.AIPDF

Ke Zhao, Hue Nguyen, Abhijith Punnappurath, Zhongling Wang, Iqbal Mohomed

TL;DR: PrismGPT用代理任务训练视觉语言模型生成结构化、区域感知的专业照片编辑方案，无需商业黑盒工具或外部教师。

Details

Motivation: 专业修图同时需要全局调整、区域局部编辑和语义掩码；直接让模型诊断多尺度美学问题并输出精确参数难度很高。

Result: 在MIT-Adobe FiveK和新建专业修图基准SPIRE上取得先进结果，训练数据量约为此前最佳方法的6%。

Insight: 操作分解与区域美学排序两个代理任务先教授基础技能；能力驱动调度器随技能掌握程度逐步调整代理任务与主编辑任务的训练比例，推理轨迹由同一基础模型自生成。

Abstract: Professional photo finishing relies on both global adjustments and region-specific local edits guided by semantic masks, yet current automated methods handle this workflow only partially. We present PrismGPT, a Vision-Language Model (VLM) framework that produces structured, region-aware editing plans from a single input image without relying on commercial black-box tools. Training a VLM to simultaneously diagnose aesthetic deficiencies at both global and local levels while predicting precise editing parameters is challenging due to the vast combinatorial decision space. We address this through proxy-guided learning: two simpler proxy tasks – operation decomposition and region-aware aesthetic ranking – teach the foundational skills the model needs, while a competence-based dynamic scheduler automatically rebalances the multi-task training ratio, progressively shifting emphasis from the proxy tasks to the primary editing task as each skill is mastered. Crucially, all reasoning traces used for supervised fine-tuning are self-synthesized by the same base model, eliminating the need for a stronger external teacher. Experiments on MIT-Adobe FiveK and SPIRE, a new professionally retouched benchmark we introduce, show that PrismGPT achieves state-of-the-art results while using only ~6% of the training data compared to the previous best method.

[128] Toward a foundation model for forest point clouds cs.CV | cs.ROPDF

Yuanwen Yue, Stefano Puliti, Damien Robert, Atakan Topaloğlu, Binbin Xiang

TL;DR: 研究构建跨传感器和森林生态的三维森林点云基础模型，重点检验自监督预训练在标注稀缺时的迁移价值。

Details

Motivation: 当前森林点云模型通常只适用于单一任务、传感器和林型，跨场景适配需要昂贵标注、算力和专业知识。

Result: 使用航空、无人机和移动激光扫描的无标注数据预训练后，相比从头训练收敛更快，且低标注量下性能持续提升；比任务特定监督预训练更能迁移到不同林业任务。

Insight: 以LitePT为骨干先建立多任务监督基线，再系统比较从头、监督和自监督预训练及不同标注预算；实例区分仍是通用森林基础表征的主要障碍。

Abstract: Forest inventories increasingly rely on artificial intelligence (AI) models to derive forest attributes from large-scale 3D point clouds. Current models are typically specialized to a single task, sensor, and forest type, making adaptation expensive in terms of annotations, computation, and expertise. We ask whether a single pretrained model can instead learn transferable representations across diverse forest inventory settings. Inspired by recent developments in language modelling and computer vision, we take a step toward a foundation model (FM) for 3D forestry. Using LitePT as backbone, we first establish a strong supervised baseline that sets a new state of the art on forest semantic and instance segmentation, tree species classification, and age regression benchmarks. We then curate a large-scale unlabelled corpus spanning airborne, UAV, and mobile laser scanning across diverse forest ecosystems, and pretrain the same backbone using self-supervised learning. We systematically evaluate representation learning strategies by comparing training from scratch, supervised pretraining, and self-supervised pretraining across four representative forestry tasks, under varying annotation budgets. Compared with training from scratch, self-supervised pretraining accelerates model convergence and consistently improves performance when annotations are scarce. Compared with task-specific supervised pretraining, self-supervised pretraining yields more transferable representations across downstream forestry tasks. These findings identify the practical regime in which pretrained representations are most valuable and suggest that instance discrimination, rather than forest semantics, is the main remaining obstacle to a general-purpose 3D forest foundation model. Code and models are available at: https://github.com/prs-eth/ForPT.

[129] Streaming Video Editing with Easy Adaptation cs.CVPDF

Yujia Hu, Jiajun Li, Zihao He, Songhua Liu

TL;DR: SVEET使双向视频扩散模型支持自回归流式编辑，并实现实时视频控制。

Details

Motivation: 把双向视频生成用于流式编辑时，需要兼顾因果生成、源视频控制及不同骨干间的特征空间差异。

Result: 单张H100上达到15帧/秒，摘要报告编辑质量优于现有方法且无需额外加速。

Insight: 辅助分支用时间独立注意力编码源视频并注入主干；解耦训练显式分离视频可控性与因果性的优化方向，促进跨架构迁移。

Abstract: In this paper, we propose SVEET, a framework that requires merely training on a pretrained bidirectional video diffusion model but supports high-quality streaming video editing in an auto-regressive fashion. To tackle this problem, we first systematically revisit existing video-to-video diffusion approaches and identify two key principles for such streaming adaptation: backbone feature disentanglement and conditional frame independence. Building on these insights, we develop a novel paradigm for controllable video generation. At its core, an auxiliary model branch encodes source video inputs with temporally independent self-attention, and the intermediate features are injected into the corresponding backbone blocks for streaming-compatible control. Moreover, to bridge the discrepancy between the feature spaces of bidirectional and streaming models, we propose a decoupled training scheme that explicitly enforces the orthogonality between the optimization directions of video controllability and model causality. Such disentanglement ensures compatibility between the two objectives at inference and facilitates smooth zero-shot knowledge transfer across heterogeneous backbone architectures. Extensive experiments demonstrate that SVEET achieves superior editing quality while maintaining real-time performance, attaining 15 FPS on a single H100 GPU 17 without any auxiliary acceleration techniques. Codes are available at https://github.com/YujiaHu1109/SVEET.

[130] INTCORT: Training-Free Spatial Reasoning Enhancement for Vision-Language Models via Input Transformations and Confidence Routing cs.CVPDF

Haoran Sun, Jingqi Xu, Yanhui Li, Enci Liu, Kaidi Xu

TL;DR: INTCORT以几何图像变换和关系词置信度路由，免训练改善视觉语言模型的空间推理。

Details

Motivation: 空间推理增强可能需要昂贵训练或干预模型内部而损害通用能力；研究发现输入变换有时可纠正错误，正确关系词元通常更自信。

Result: 在多种模型和常用基准上的平均提升为10.01%，最高较先前方法提升25.01%。

Insight: 构造多种变换视图并按关系词元置信度汇总预测，不修改VLM内部机制，也不需训练。

Abstract: Vision-Language Models (VLMs) have demonstrated remarkable capabilities in multimodal tasks, yet they still exhibit poor ability in spatial reasoning. Existing training-dependent and training-free enhancement methods suffer from high computational costs with catastrophic forgetting and internal mechanism interference that compromises general capabilities, respectively. In this work, we first verify two key hypotheses: appropriate geometric image transformation and query-reversal transformation can recover incorrect spatial predictions, and correct predictions exhibit higher relation-token confidence than incorrect ones. Based on these findings, we propose INTCORT, a training-free spatial reasoning enhancement framework that constructs multiple inference views through input transformations and aggregates their predictions via relation-token confidence routing, without modifying the VLM’s internal mechanisms. Experimental results on several commonly-used benchmarks demonstrate that INTCORT substantially improves spatial reasoning accuracy across diverse VLMs, achieving an average improvement of 10.01% over all models and benchmarks. Compared with prior works, INTCORT achieves superior performance with improvements of up to 25.01%.

[131] Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation cs.CVPDF

Aoxiang Fan, Corentin Dumery, Nicolas Talabot, Pascal Fua

TL;DR: 将已知相机参数的多视图立体重建改为对所有输入视图联合预测几何的序列到序列任务。

Details

Motivation: 前馈方法即使有真实相机参数也会出现几何失真；传统MVS通常只为一个参考视图预测深度，难充分利用跨视图结构。

Result: 在多个公开基准上达到先进水平，超过多视图立体与前馈重建基线。

Insight: 全局Transformer以射线图嵌入注入相机先验，并用统一全局代价体聚合所有视图的三维结构，而非逐视图构建独立代价体。

Abstract: Computing accurate geometry from multi-view images is a fundamental problem in computer vision. Recent feed-forward (FF) models jointly estimate 3D geometry and camera parameters, but they typically suffer from geometry distortion caused by reconstruction ambiguity, even when ground-truth camera parameters are supplied. In this paper, we study the multi-view stereo (MVS) problem with known camera parameters and propose a novel approach that bridges conventional MVS and FF methods. Rather than casting MVS as a sequence-to-one mapping that predicts depth only for a single reference view, we reformulate it as a sequence-to-sequence task, akin to FF models, that jointly predicts geometry for all input views. We introduce a global transformer-based architecture with two components that explicitly exploit camera-induced priors: ray-map embeddings that inject camera parameters into image patch tokens, making the transformer camera-aware, and a unified global cost volume that replaces conventional per-view cost volumes to jointly capture 3D structure across all views. Extensive experiments on multiple public benchmarks show our approach achieves state-of-the-art performance, surpassing both MVS and FF reconstruction baselines.

[132] SPHQuant: Efficient extreme low bit weight quantization for Vision-Language Models cs.CVPDF

Kewei Zhang, Zheng Chen, Haotong Qin, Yulun Zhang

TL;DR: SPHQuant以球面坐标表示权重并进行无旋转极低比特量化，面向视觉语言模型边缘部署。

Details

Motivation: 大语言模型骨干使VLM内存和自回归解码成本高；2至3比特无旋转量化受离群值影响，旋转方法则增加运行开销。

Result: 量化精度与先进极低比特方法相当，RTX A6000上的解码吞吐比QTIP提升30.3%。

Insight: 将权重分解为符号、半径和正单位方向，对承载离群幅值的半径分配更多位数；紧凑方向码本用角度参数化保持单位球约束，并配合硬件友好GEMV核。

Abstract: Recent foundation models are moving toward native multimodal Vision-Language Models (VLMs), making VLMs a central form of next-generation foundation models. However, their large language backbones make edge deployment difficult due to high memory footprint and memory-bound autoregressive decoding. Weight-only post-training quantization is a practical solution, but pushing VLMs to extreme low bit-widths remains challenging: existing rotation-free methods suffer from outliers at 2-3 bits, while rotation-based methods improve accuracy at the cost of additional runtime overhead. We propose SPHQuant, a rotation-free spherical weight-only quantization framework for VLMs. Instead of quantizing weights directly in Cartesian coordinates, SPHQuant decomposes each 8D weight vector into coordinate signs, radius, and a positive unit direction. This representation isolates outlier magnitude into the radius while keeping directions bounded and statistically regular. Based on this insight, SPHQuant allocates extra precision to the radius to mitigate accuracy degradation induced by outliers. It further uses a compact positive-direction codebook and fine-tunes codebook entries through angular parameterization to preserve the unit-sphere constraint. We also design a hardware-friendly GEMV kernel that keeps the direction codebook small enough for shared-memory lookup and packs radial bits efficiently. Experiments show that SPHQuant matches the performance of state-of-the-art extreme low-bit quantization methods while improving decode throughput over QTIP by 30.3% on RTX A6000. Code will be released in https://github.com/Pushazf/SPHQuant.

[133] SLICEChat: Progressive In-Encoder Token Pruning for Whole-Slide Pathology Language Models cs.CV | cs.CLPDF

Ali Kerem Bozkurt, Baris Cem Bakay, Ibrahim Kulac, Cigdem Gunduz-Demir, Erkut Erdem

TL;DR: SLICEChat在全切片编码器中逐步裁剪低价值空间区域token，降低病理多模态推理的计算量。

Details

Motivation: 病理全切片达到十亿像素规模，许多方法处理数千patch并在编码后才压缩，导致多模态注意力仍十分昂贵。

Result: SlideBench VQA准确率在TCGA为79.84%、BCNB为59.09%，优于先前切片级病理MLLM，并在WSI-Bench总体指标领先；内存和延迟也具竞争力。

Insight: 混合Mamba与Transformer兼顾长距离传递和全局交互，按语言监督和区域价值在编码阶段逐级减少token，再做多模态融合。

Abstract: Whole-slide pathology images (WSIs) contain gigapixel-scale visual content, creating a major scalability challenge for slide-level multimodal large language models (MLLMs). Existing approaches process thousands of patch tokens and typically apply compression only after slide encoding, leaving multimodal attention computationally expensive. We introduce SLICEChat, a slide-level MLLM that integrates progressive token pruning within a hybrid Mamba–Transformer slide encoder. Mamba layers enable efficient long-range propagation, while Transformer layers preserve global interactions as the sequence is progressively shortened. Between stages, language-supervised, region-aware pruning removes spatially coherent low-utility regions under a controlled keep-rate schedule, producing compact slide representations before multimodal fusion. On SlideBench VQA, SLICEChat achieves 79.84% accuracy on TCGA and 59.09% on BCNB cohorts, outperforming prior slide-level pathology MLLMs, and achieves the highest overall WSI-Bench metrics. It also provides competitive memory usage and the inference latency among the evaluated models. These results demonstrate accurate and computationally efficient multimodal reasoning over gigapixel WSIs.

[134] PixelDiT2: Representation-Grounded Pixel Diffusion Transformers cs.CVPDF

Yongsheng Yu, Wei Xiong, Yichen Sheng, Shiqiu Liu, Jiebo Luo

TL;DR: PixelDiT2用冻结视觉基础模型的逐块表征引导像素扩散，避免同时从头学习图像表示与生成。

Details

Motivation: 像素空间扩散模型虽接近潜空间图像质量，但收敛较慢、最终质量仍落后，缺少紧凑结构化表征先验。

Result: ImageNet 256×256训练600轮达到FID 1.46；512×512训练680轮达到FID 1.48。

Insight: 在去噪过程中持续使用冻结视觉模型提供表示指导，让像素扩散Transformer专注图像生成；无需自编码器或潜空间重建瓶颈。

Abstract: Recent advances in pixel-space diffusion models have narrowed the image quality gap with latent-space diffusion, but still converge more slowly and lag behind in final image quality. We argue that a key reason is the lack of an explicit representation prior: unlike latent diffusion, which usually denoises in a compact and structured latent space, pixel diffusion needs to learn denoising-friendly representations and pixel generation simultaneously from raw RGB space. To address this problem, we propose PixelDiT2, an end-to-end pixel-space diffusion model designed to decouple representation learning from pixel generation without introducing an autoencoder or latent reconstruction bottleneck. We propose representation grounding that uses a frozen pretrained vision foundation model to provide explicit per-patch representation guidance throughout denoising, allowing the pixel diffusion transformer to focus more on pixel generation. On ImageNet-256x256, PixelDiT2 achieves an FID of 1.46 after 600 epochs; at 512x512 resolution, PixelDiT2 achieves an FID of 1.48 after 680 epochs.

[135] Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs cs.CVPDF

Mrunmay Angaitkar, Piyush Kumar, Aarjav Satia, Pranav Rao, Ashish Mittal

TL;DR: 从胸部CT构造按解剖分解的数字重建投影，为无需真实配对影像的胸片骨抑制提供监督。

Details

Motivation: 胸片中骨骼重叠会遮挡异常，而用于训练的真实配对骨抑制数据稀缺。

Result: 多个公开数据集的下游检测中，收益集中于有明显骨重叠的病灶；原始DRR的真实性和解剖保留与开放引擎相当，翻译后DRR在FID、肺野清晰度及CT解剖一致性最佳。

Insight: 将CT分成骨、非肺软组织和肺并分别投影，形成精确配准且可相加还原的分量图；模型预测目标分量后通过相减恢复其余部分，并可用真实胸片输出进一步做无配对域转换。

Abstract: Bone overlap can obscure abnormalities in chest radiographs, while scarce paired training data limit supervised bone suppression. We address this challenge with a digitally reconstructed radiograph (DRR) framework that converts chest computed tomography (CT) into paired supervision for component suppression. A novel bone segmentation algorithm enables CT decomposition into bone, non-lung soft-tissue, and lung components, which are projected separately. Their weighted combination yields synthetic radiographs with pixel-registered component images that sum exactly to the full DRR. Models trained on these data suppress bone or lung components by predicting the target component and recovering the remainder by subtraction, transferring to real radiographs without real paired training data. As an extension, their outputs on real radiographs provide target domains for unpaired, component-wise DRR translation, reducing the appearance gap while retaining anatomical details. Across multiple public datasets, downstream detection experiments demonstrate the utility of bone suppression, with gains concentrated on abnormalities with substantial bone overlap. Compared with open-source DRR engines applied to the same CTs, our unmodified DRRs achieve comparable realism and preservation of label-relevant anatomy, while translated DRRs achieve the best Fréchet inception distance (FID), lung-field sharpness, and agreement with source-CT anatomy among the evaluated methods. Models and inference code: https://huggingface.co/qureaiorg/bone-suppression; Translated projections: https://huggingface.co/datasets/qureaiorg/ct2xr-projections.

[136] WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory cs.CV | cs.AI | cs.GRPDF

Wangbo Yu, Kunhao Liu, Wenbo Hu, Shenghai Yuan, Chaoran Feng

TL;DR: WorldCrafter构建可按相机视角查询的隐式三维记忆，提升视频世界模型的长时场景一致性和相机控制。

Details

Motivation: 交互式视频世界模型难以跨长时间及新视角保留此前观察到的场景信息。

Result: 静态和动态场景实验显示，长时一致性和相机控制准确度显著改善，分钟级探索保持画质；摘要未列具体分数。

Insight: 记忆编码器与姿态条件读出器结合历史多视图信息，在去噪前压缩为固定数量的目标视角token，无需显式深度对应；再与近期时间上下文及少步蒸馏配合实现流式探索。

Abstract: Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world model that learns a camera-queryable implicit 3D-aware memory for this purpose. The key insight is to let the requested viewpoint shape how multi-view evidence is compressed into the video generator’s limited token budget. Trained jointly with the video generator, a memory encoder and pose-conditioned readout module integrate historical observations into a fixed set of target view-specific tokens before denoising, without explicit depth-based correspondences. By combining this memory with recent temporal context and few-step distillation, WorldCrafter enables streaming scene exploration from a single input image or text prompt. Experiments across static and dynamic scenes show substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploration.

[137] VideoGen-Agent: Reinforcing Video Generation Agents cs.CVPDF

Binxu Li, Haoyi Duan, Yuhui Zhang, Yaohui Zhang, Zihao Lin

TL;DR: VideoGen-Agent通过智能体强化学习协调增强、视频生成和核验工具，处理知识、身份、物理及事件顺序要求。

Details

Motivation: 视频生成模型虽画质高且连贯，仍常难满足专业知识、指定身份、物理一致性或有序事件等复杂提示。

Result: VABench上得分较基础文本视频模型从56.5升至75.6；升级生成工具无需重新训练智能体即可升至86.1，人类在84.3%的比较中偏好升级配置。

Insight: 在六类任务上监督微调教师轨迹后做强化学习；类别感知混合奖励检查调用有效性、工具选择是否适合任务及视频质量。

Abstract: Recent advances in video generative models have enabled high-fidelity, temporally coherent video generation. However, these models often struggle to satisfy prompts requiring specialized knowledge, specific identities, physical consistency, or ordered events. In this paper, we present VideoGen-Agent, a multimodal agent trained through multitask agentic reinforcement learning to use external tools for video generation. The agent coordinates augmentation, generation, and verification tools through multi-turn interactions, using the prompt and intermediate observations to guide its decisions. We train a shared policy on a category-balanced dataset spanning six tasks. Supervised fine-tuning on teacher-generated trajectories establishes tool-use behavior, which is then refined through reinforcement learning. A category-aware hybrid reward evaluates tool-call validity, task-appropriate tool use, and generated video quality. We further introduce VABench, a held-out benchmark of 600 prompts covering procedural knowledge, single- and multi-entity identity preservation, physical consistency, scene composition, and multi-shot temporal structure. On VABench, VideoGen-Agent improves over its base text-to-video generator by 19.1 points, from 56.5 to 75.6. Upgrading the generation tools further raises the score to 86.1 without additional agent training. Human raters prefer the upgraded configuration over the strongest standalone baseline in 84.3% of comparisons. These results support learning tool use across video-generation tasks and show that the trained agent can benefit from subsequent advances in generation tools.

[138] GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay cs.CV | cs.AIPDF

Yiran Wang, Xingyilang Yin, Junfu Pu, Guangzhi Wang, Kaifeng Li

TL;DR: GameHorizon提供多时间跨度的游戏数据集与离线、逐步在线评测，衡量视觉理解到长程操作规划的游戏能力。

Details

Motivation: 现有游戏基准覆盖面窄、缺少语言指令，或依赖方差较高的在线试玩。

Result: 包含21款游戏、5,000小时、100名专家玩家的对齐视频、动作与指令；用逾百万次模型调用评估47个模型，揭示能力差距和任务难度层次。

Insight: 自动标注流程构造多跨度指令；离线测试确保可复现，逐步在线测试则验证离线分数与实际操作能力的对应并定位长程失败步骤。

Abstract: Modern video games provide a measurable testbed for AI models, combining abilities of visual understanding, instruction decomposition, goal planning, and precise action control over multiple temporal horizons. Existing datasets and benchmarks, however, either cover a narrow range of games, lack language instructions, or rely on high-variance online rollouts. To address these challenges, we introduce GameHorizon, a unified data and evaluation suite that measures gameplay capabilities at different horizons for diverse model families. GameHorizon Suite consists of three components. First, GameHorizon-Annotator is a scalable and automated annotation pipeline for multi-horizon instructions. Second, utilizing the pipeline, we construct GameHorizon-Data, the first large-scale AAA gameplay dataset with temporally aligned videos, player actions, and multi-horizon instructions. It comprises 5,000 hours of recordings from 21 games, collected by 100 human expert players. Third, we build GameHorizon-Bench with reproducible offline and stepwise online testing. The offline track enables reproducible evaluation using thousands of standardized questions organized into three primary tasks and a series of diagnostic variants, while the online track tests whether offline scores reflect actual gameplay capabilities and localizes failures to specific steps within long-horizon gameplay. Based on our GameHorizon Suite, we evaluate 47 models through more than one million model invocations, revealing a meaningful hierarchy of task difficulty and pronounced differences in model capabilities. Our work can provide a standardized yardstick for evaluating gameplay capabilities across horizons and model families. We will release our dataset, annotator, and benchmark to facilitate future research.

cs.CL [Back]

[139] Summarize, Judge, Refine: Decoupled Content Understanding and Policy Learning for Multimodal Content Moderation cs.CL | cs.LGPDF

Zeeshan Ahmed, Yang Qin, Hanqing Huang

TL;DR: SJR 将多模态内容理解与政策判定拆成摘要模型和文本策略模型，并通过共同训练和文本空间增强支持低样本政策迁移。

Details

Motivation: 传统内容审核把多模态理解与具体政策分类耦合，政策一变就需重训整个流程；原始媒体又难以进行有意义的数据增强，导致标注不足。

Result: SJR 由生成结构化文本摘要的多模态 Content Model 和按政策定义分类的文本 Policy Model 组成。迭代协同训练用 GRPO 让内容模型产出政策相关摘要；文本空间可生成对抗摘要变体，支持少样本政策启动，并为每项判断提供人可读依据。在误导性广告检测上，非误导类 F1 相对零样本 CoT 基线提高 23.6%，超过端到端 SFT、STaR/RFT 和 RLFT。完全不使用真实违规样本、仅用合成正类训练的版本，违规类 F1 与全数据模型相差仅 0.2%。

Insight: 先抽取可审计的多模态事实摘要、再用文本策略判断，使政策更新与视觉理解解耦；可在文本空间增强策略边界，而不必合成难以可信的违规媒体。

Abstract: Content moderation systems traditionally entangle multimodal understanding with policy-specific classification, requiring full pipeline retraining for every policy change and suffering from label scarcity since multimedia cannot be meaningfully augmented. We propose Summarize-Judge-Refine (SJR), a two-model architecture that decouples these concerns via a natural language interface: a multimodal Content Model produces structured text summaries, and a text-only Policy Model classifies them against policy definitions. An iterative co-training loop refines the Content Model via GRPO to produce policy-relevant summaries, while text-space augmentation generates adversarial summary variants—an augmentation pathway impossible on raw multimedia—enabling few-shot policy bootstrap. Every decision is grounded in a human-readable summary, providing interpretability as a structural byproduct. On misleading advertisement detection, SJR achieves +23.6% relative non-misleading F1 over a zero-shot chain-of-thought baseline, outperforming end-to-end SFT, STaR/RFT, and RLFT. Notably, a variant trained on zero real violating examples—with all positive-class data synthetically generated—matches the full-data model within 0.2% relative on violating F1, demonstrating that new policies can launch without any real violation data.

[140] DeepInstructor: An Agentic AI Instructor for Experience-Driven Idea Evaluation cs.CL | cs.IRPDF

Rongcan Pei, Fang Guo, Qinglin Qi, Qi Zhu, Yun Luo

TL;DR: DeepInstructor 用 58,607 条同行评审构建学术经验图，再由 ReAct 智能体按维度检索证据评估研究创意，提升与人类判断的匹配度。

Details

Motivation: 大语言模型可大规模生成研究想法，使瓶颈从创意生成转向评估。参数知识或非结构化检索缺少人类导师依据领域经验进行的可追溯推理。

Result: DeepInstructor 将想法评估建模为对结构化学术经验的推理，从 58,607 条同行评审构建经验图，再用 ReAct 智能体检索各评价维度证据。作者另提出 DeepInstruct 数据集，提供新颖性、重要性和可行性的受控成对比较。实验相较已有基线，与人类判断的 Hit@1、Hit@2 一致性分别提高 24.4% 和 29.7%。

Insight: 学术评估可从过去的同行评审中检索结构化经验，而不是只依赖模型参数记忆；按维度呈现证据也更利于检查评估判断来源。

Abstract: As automated scientific discovery advances, Large Language Models (LLMs) can now generate research ideas at an unprecedented scale, shifting the bottleneck from idea generation to idea evaluation. Existing evaluators mainly rely on parametric LLM knowledge or unstructured retrieval, producing judgments that lack the experience-grounded reasoning used by human instructors. To address this, we propose DeepInstructor, an agentic framework that formulates idea evaluation as reasoning over structured scholarly experience. DeepInstructor constructs an Experience Graph from 58,607 peer reviews and employs a ReAct-based agent to retrieve dimension-specific evidence for traceable evaluation. We further introduce DeepInstruct, a dataset with controlled pairwise comparisons across novelty, significance, and feasibility. Experiments show that DeepInstructor substantially outperforms existing baselines, improving Hit@1 and Hit@2 alignment with human judgments by 24.4% and 29.7%, respectively. Our findings suggest that scientific idea evaluation can be grounded in explicit reasoning over structured scholarly experience

[141] Evaluation Awareness Shifts from Format to Context with Model Scale cs.CL | cs.LGPDF

Navraj Singh, Maheep Chaudhary

TL;DR: 研究发现小模型主要借助提示格式、大模型更多借助高阶推理识别评测情境，并用提示净化加激活反向引导联合降低评测意识。

Details

Motivation: 模型若能识别自己正在被评测，可能改变回答，威胁评测有效性；但模型依靠什么线索判断评测情境，以及机制如何随规模变化，尚不清楚。

Result: 作者对 Gemma 3 1B/4B/12B、Phi-3 Mini/Medium 和 Llama-3 8B 使用 CoT 分析、表示探针和 Integrated Gradients 归因。发现小模型更多利用提示格式敏感性，大模型常依靠高阶推理识别评测。基于此提出双路径干预，联合净化提示与激活反向引导，以抑制外部触发线索和内部表示。在 200 个高度评测感知提示上，平均行为翻转率为 70.58%，持续优于任一单独干预。

Insight: 评测意识并非单一规模机制；同时处理提示层面线索和内部表征，可比只改变提问方式或只改激活更有效。

Abstract: Evaluation awareness poses an unprecedented threat to model evaluation, but the mechanisms by which models detect it remain unknown. This study focuses on determining this and identifying contrasting mechanisms between smaller and larger models. While smaller models use the prompt’s format sensitivity to detect evaluation, larger models often rely on higher-order reasoning to detect it. We evaluated Gemma 3 (1B, 4B, and 12B), Phi-3 (Mini and Medium), and Llama-3 8B using Chain-of-Thought analysis, representation probing, and Integrated Gradients attribution. Motivated by these findings, we propose a dual-pathway intervention that combines prompt sanitization with activation counter-steering to suppress both external evaluation triggers and their internal representations. Across 200 highly evaluation-aware prompts, our method achieves an average behavioral flip rate of 70.58%, consistently outperforming either intervention alone. These results provide new insights into how evaluation awareness develops in compact language models and suggest that effective mitigation requires jointly addressing both prompt-level and representation-level signals.Datasets and codebase can be found in this \href{https://github.com/chahal-navi/Evaluation-Awareness-Compact-LLMs/tree/main}{Github Repository.}

[142] Balancing Reasoning and Hardware Constraints in RAG Pipelines for Ukrainian Multi-Domain Document Understanding cs.CL | cs.DLPDF

Illya Havrylov

TL;DR: 该系统在严格离线时间和双 T4 资源下，为乌克兰多领域 PDF 文档问答采用 BM25、BGE-M3、交叉编码重排及量化本地模型，取得竞赛第十名。

Details

Motivation: 共享任务要求在九小时 Kaggle 离线时限内，从多领域乌克兰语 PDF 中提取答案、文档 ID 和页码；扫描文档 OCR 会大量占用时间，限制推理预算。

Result: 私有测试中，顺序单线程 OCR 成为瓶颈，耗时 5–7 小时，留给 500 个问题的 LLM 推理约两小时。为避免超时，作者搭建资源高效混合 RAG，使用 BM25、BGE-M3 和 Cross-Encoder 重排；避免会超时的大型推理模型，改用 llama.cpp 在双 NVIDIA T4 上运行 4-bit LapaLLM 12B。系统私榜得分 0.8095，在 15 支活跃队伍中排名第十。

Insight: 在硬件和时限受限的文档理解任务中，OCR 调度与管线稳定性可能比模型推理能力更先成为瓶颈；系统优先保证可完成性。

Abstract: This paper describes the system submitted to the UNLP 2026 Shared Task on Multi-Domain Document Understanding. The challenge required extracting precise answers, document IDs, and page numbers from a diverse corpus of Ukrainian PDF documents within a strict 9-hour offline Kaggle execution limit. During evaluation on the hidden private test set, optical character recognition (OCR) of scanned documents emerged as a severe bottleneck, consuming 5-7 hours of the total time budget due to sequential single-threaded execution. This overhead strictly limited the remaining time for Large Language Model (LLM) inference to approximately two hours for 500 questions. To guarantee pipeline completion without timeouts, we developed a resource-efficient Hybrid Retrieval-Augmented Generation (RAG) pipeline utilizing BM25, BGE-M3, and Cross-Encoder reranking. Rather than deploying parameter-heavy reasoning models (e.g., DeepSeek R1) which consistently timed out, we utilized a 4-bit quantized LapaLLM 12B model via llama.cpp on dual NVIDIA T4 GPUs. Prioritizing pipeline stability over multi-step reasoning, our system achieved a Private Score of 0.8095, placing 10th out of 15 active teams.

[143] Beyond the Stitching Assumption: A Unified Framework for Multimodal Synthetic Data Evaluation via Semantic Quantization cs.CL | cs.LGPDF

Yefeng Yuan, Zhan Shi, Liang Cheng, Yuhong Liu

TL;DR: 该评测框架将文本嵌入语义聚类与表格属性离散状态投影到联合分布，使用置换对照检查合成多模态数据是否保留模态间配对关系。

Details

Motivation: 多模态合成数据包含结构化属性和自由文本，但两者常被分开评估；即使表格-文本配对被打乱，各模态单独指标仍可能保持很高，无法检验跨模态一致性。

Result: 方法用固定句向量编码器将文本聚类为语义状态，将表格变量变为类别或分位数状态，再比较真实与合成列联分布的 JSD、归一化互信息、条件 JSD 和联合状态熵；另外报告文本到属性效用和留出校准邻近率。文本置换对照保留两种边际分布但破坏配对。在 Amazon Reviews、Kiva Loans 和 Employment Scam Aegean 数据上，单模态分数在置换下仍较高；投影诊断在真实依赖强于置换基线时能发现破坏，但对弱或稀疏投影信息有限。部分 LLM 基线的测量依赖还高于真实投影。

Insight: 多模态合成数据需要显式测试跨模态配对而不只评各自边际；置换基线与覆盖率报告能揭示指标适用范围及弱依赖数据上的局限。

Abstract: Multimodal synthetic datasets combine structured attributes with free text, but are often evaluated separately. Such metrics can remain high after tabular–text pairings are disrupted. We present a projection-based evaluator for tabular–text synthetic data. A fixed sentence encoder maps text to embeddings, (k)-means converts them to cluster states, and tabular variables are represented as categorical or quantile-binned states. Real and synthetic contingency tables are compared using Jensen–Shannon divergence (JSD), normalized mutual information (NMI), conditional JSD (cJSD), and joint-state entropy. We also report text-to-attribute (T2A) utility and a holdout-calibrated proximity flag rate (PFR) as a representation-level diagnostic. A text-permutation control preserves both marginal distributions while disrupting their pairing. Experiments on Amazon Reviews, Kiva Loans, and the Employment Scam Aegean Dataset show that modality-specific scores remain high under this control. The projection diagnostics detect disruption when real projected dependence exceeds a permutation baseline, but are less informative for weak or sparse projections. Some conditioned LLM baselines also exhibit stronger measured dependence than the corresponding real-data projections. These results support explicit cross-modal evaluation with permutation baselines and coverage reporting.

[144] Beyond Raw Context Transfer: Representation-based Federated Retrieval-Augmented Generation cs.CL | cs.LGPDF

Can Peng, Yu Liu, Yingyu Yang, Anjie Le, Yuyuan Liu

TL;DR: FedRepRAG 在联邦检索增强生成中保留各机构原始文档，只交换紧凑检索表征，并用协同投影器将其转为冻结模型可用的表示 token。

Details

Motivation: 医疗等敏感领域数据分散在不同机构，集中式 RAG 不现实；交换可读检索片段的去中心化方案则增加推理开销并直接暴露检索信息。

Result: FedRepRAG 让原始文档留在所属客户端，跨客户端检索仅交换紧凑潜在表示。协同训练的投影器将检索嵌入转为适配冻结 LLM/VLM 的表示 token。分布式 VQA 和 QA 基准上，FedRepRAG 持续优于直接推理和本地检索基线；相较原文上下文传输，显著缩短检索上下文并降低推理开销。分析还验证查询相关检索表示的重要性，并刻画交换潜在表征仍可能造成的残余泄漏。

Insight: 联邦 RAG 可通过表示级知识交换减少原始内容暴露和长上下文成本，但嵌入仍可能泄露信息，需评估其残余隐私风险。

Abstract: Retrieval-augmented generation (RAG) improves the factuality of large language models (LLMs) and vision-language models (VLMs) by grounding generation in external knowledge. However, most existing RAG frameworks assume a centralized retrieval corpus, which is often impractical in sensitive domains such as healthcare, where data are inherently distributed and raw content cannot be directly shared across institutions. Recent efforts on decentralized RAG primarily follow prompt-based paradigms that exchange raw, human-readable retrieved content, leading to substantial inference-time computational overhead and direct exposure of retrieved information. To address these limitations, we propose Representation-based Federated RAG (FedRepRAG), a decentralized RAG framework that keeps raw documents at their owning clients and exchanges only compact latent representations during cross-client retrieval. To integrate retrieved knowledge, we introduce a collaboratively trained projector that converts retrieval embeddings into generator-compatible representation tokens for a frozen LLM/VLM backbone. Experiments across decentralized visual question answering (VQA) and question answering (QA) benchmarks show that FedRepRAG consistently outperforms direct inference and local retrieval baselines while substantially reducing retrieval-context length and inference-time computational overhead compared with raw-context transfer. Further analyses confirm the importance of query-relevant retrieved representations and characterize the residual representation-level leakage associated with representation exchange. Overall, FedRepRAG provides an effective and efficient framework for federated RAG without transferring raw retrieved content.

[145] PII-TRACE: A Benchmark for Context-Aware PII Detection in Multi-Turn LLM Conversations cs.CL | cs.AIPDF

Kaiyuan Zhang, Chuan Wang, Joey Zhong, Paul Fryzel, Kyle Polley

TL;DR: PII-TRACE 用 13 种语言的多轮对话评测重复个人身份信息跨轮追踪，发现现有检测器常漏标长对话且难兼顾实体覆盖和低误报。

Details

Motivation: AI 服务商会在保存或处理长多轮对话前扫描并遮盖个人身份信息，但现有检测器和基准主要针对独立记录，很少检查跨轮重复标识符是否全部识别。

Result: PII-TRACE 含 13,148 段合成多轮对话，覆盖 13 种语言，提供字符级 span 和标识符聚类，是作者所知首个评估上下文中 PII 及跨轮全提及覆盖的基准。十一种基线（含前沿 LLM）无一能在不对无 PII 对话造成大量误报的情况下实现完整实体级覆盖；长对话单次阅读会丢失约三分之一金标字符。作者训练 0.6B 参数紧凑检测器 PII-Tracer，达到所测系统中最高实体级覆盖，并在标准单记录基准上表现良好。

Insight: PII 检测不仅要识别单次提及，还要追踪同一实体在长对话中的所有出现；长上下文覆盖与误报控制须同时评估。

Abstract: LLM assistants and agentic systems log long multi-turn conversations. AI providers often scan these conversations for Personally Identifiable Information (PII) and mask the PII before storing or processing conversation data. Yet most PII detectors and benchmarks target self-contained records rather than cross-turn evaluation. To evaluate PII detection across turns in multi-turn conversations, we introduce PII-TRACE (Tracing Recurring PII Across Conversational Exchanges), to our knowledge the first PII benchmark to assess whether detectors identify PII in conversational contexts and cover every mention of a recurring identifier across turns. PII-TRACE contains 13,148 synthetic multi-turn dialogues in 13 languages with character-level spans and identifier clusters. Across eleven baselines, including frontier LLMs, no detector achieves full entity-level coverage without substantial false positives on PII-free conversations, and single-pass reading loses a third of the gold characters on long dialogues. To close this gap, we introduce PII-Tracer, a compact 0.6B-parameter detector trained with conversation-level supervision. PII-Tracer attains the highest entity-level coverage of any system we evaluate and also performs strongly on standard single-record benchmarks.

[146] Dissecting Training-Free Uncertainty Estimation in Multimodal Large Language Models cs.CL | cs.LGPDF

Soroush Seifi, Vaggelis Dorovatas, Lin Li, Yarin Gal, Rahaf Aljundi

TL;DR: 该研究系统比较 MLLM 免训练不确定性估计的 token 熵、语言化置信/拒答和语义表示三类方法，发现最佳类别依赖输出长度。

Details

Motivation: 多模态大语言模型在多任务上表现强，但安全关键应用需要理解预测不确定性；不同免训练估计策略缺乏跨数据集、模型和生成尺度的系统比较。

Result: 论文将已有方法划分为三类：直接作用于文本输出的 token 级方法、通过提示生成置信或拒答信号的语言化方法，以及在语义意义空间衡量不确定性的语义方法。跨多个数据集、模型家族、生成设置和规模评测发现没有单类方法普遍最好：短答案上 temperature=1.0 的 token 熵效果最佳；句子级回答上语言化拒答更优；长文本生成上语义方法占优。

Insight: 不确定性量化应依据答案长度和表达形态选择方法，不能假设一种置信度指标可适用于所有 MLLM 输出。

Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of multimodal tasks, yet understanding and quantifying their predictive uncertainty remains underexplored despite being central for safety critical applications. In this work, we present a systematic study of training-free uncertainty quantification strategies for MLLMs, categorizing existing approaches into three conceptual families: token-level methods, which operate directly in the text output space; verbalized methods, which elicit uncertainty estimates or abstention signals via natural language prompts; and semantic methods, which measure uncertainty in a semantic meaning space. We benchmark these strategies across multiple datasets, model families, generations, and scales, and find that no single family dominates: token-level entropy (at sampling temperature 1.0) wins on short answers, verbalized abstention on sentence-length responses, and semantic methods on long-form generation.

[147] SALSA: Semi-Autonomous Literature Summarization Assistant cs.CL | cond-mat.mtrl-sciPDF

William Schertzer, Sonakshi Gupta, Rampi Ramprasad

TL;DR: SALSA 是人机协同科学文献结构化提取平台，结合解析、LLM、OCR、视觉、图表数字化及人工校正，输出可验证数据集。

Details

Motivation: 材料研究等领域从多模态文献中整理结构化数据包含大量重复工作，但表格、图像、图注和文本解析需要专家判断，完全自动化又可能产生错误。

Result: SALSA 是开源平台，结合文档解析、大语言模型、OCR、计算机视觉、图表数字化和用户引导纠错，从正文、表格、图片和图注恢复结构化信息。用户可配置提取阶段、定义数据集 schema、干预图表数字化并导出经验证的数据供后续分析和机器学习使用。平台目标是在自动化重复文献整理的同时，保留专家必要监督，并支持不同输入类型的可定制流程。

Insight: 科学数据抽取应把自动化和专家纠错结合，尤其在图表数字化等需判断的环节保留人工介入，使可扩展整理仍具可靠性。

Abstract: SALSA (Semi-Autonomous Literature Summarization Assistant) is an open- source, human-in-the-loop platform for extracting structured scientific datasets from multimodal literature sources. The software combines document parsing, large language models, optical character recognition, computer vision, figure digitization, and user-guided correction tools to recover structured information from text, tables, figures, and captions. Users can configure extraction stages, define dataset schemas, perform interventions on digitized figures, and export verified data for downstream analysis and machine learning. SALSA is designed to automate repetitive literature curation tasks while preserving oversight where expert judgment is required. By supporting customizable extraction workflows across diverse input types, the software provides a flexible framework for scalable, reliable data curation for materials research, and potentially across several disciplines. Users are responsible for ensuring that all inputs, extraction workflows, and downstream uses comply with applicable publisher agreements, copyright and licensing terms, institutional policies, and data-use requirements.

[148] SCoP: Structured Constraint Parsing for Evidence-Space Control in Temporal Knowledge Graph Question Answering cs.CLPDF

Xiaokun Guo, Zhen Xu, Dongdong Huo, Yanqiu Zhang, Dongjin Yu

TL;DR: SCoP 将时间知识图谱问答拆成显式事件锚定、结构约束和时间范围筛选，先控制可用证据空间再生成答案。

Details

Motivation: 时间知识图谱问答需要证据在结构上合法且符合时间约束。现有方法常把锚点事件绑定、时间可接受性和顺序选择留给隐式推理、任务专用训练或相似度检索，易引入局部相关但无效事实。

Result: SCoP 将复杂问答视作证据空间控制：分离待答事件模式与时间锚点，保守映射至规范实体和关系，将时间意图转成可执行的点/区间范围约束及可选排序条件，然后确定性过滤结构兼容候选，压缩答案证据空间。在 MultiTQ 和 TimelineCronQ-R 上无需任务参数更新，Hits@1 分别达 0.825 和 0.761，约束密集问题上增益明显。

Insight: 显式筛选证据比让语言模型自行隐式判断时间关系更可靠；规范化时间约束能在回答前排除结构或时间不合法事实。

Abstract: Temporal Knowledge Graph Question Answering (TKGQA) requires answer inference from evidence that is both structurally valid and temporally admissible. Existing methods often leave anchor-event binding, temporal admissibility, and ordinal selection implicit in model reasoning, task-specific training, or similarity-driven retrieval, allowing locally relevant but invalid facts to enter the answer context. We formulate complex TKGQA as evidence-space control and propose SCoP (Structured Constraint Parsing), a constraint-centric framework that externalizes temporal decisions before answer inference. Instead of treating retrieved facts as admissible evidence by default, SCoP separates answer-seeking event patterns from temporal anchor events, conservatively grounds them to canonical TKG entities and relations, and translates temporal intent into executable constraints with optional ranking requirements. These constraints operate over normalized point and interval ranges, enabling deterministic filtering of structurally compatible candidates and producing a compact evidence space for generation. Experiments on MultiTQ and TimelineCronQ-R assess SCoP across timestamped point-fact and interval-oriented settings with richer temporal relations and ordering dependencies. Without task-specific parameter updates, SCoP achieves 0.825 Hits@1 on MultiTQ and 0.761 Hits@1 on TimelineCronQ-R, with gains on constraint-intensive question types. These results support explicit evidence-space control over unconstrained retrieval or implicit temporal reasoning.

[149] Team DArgk at the 2026 ELOQUENT lab for evaluating generative language model quality: Residuals of Humanity: AI Detection Evasion via GRPO Fine-Tuning cs.CL | cs.AIPDF

Antonela Tommasel, Juan Manuel Rodriguez

TL;DR: SHADE 用 GRPO 根据代理检测器反馈微调 LLaMA 生成规避 AI 文本检测，成功率高但倾向生成更短、更简单且词汇多样性更低的文本。

Details

Motivation: LLM 文本越来越难与人类写作区分，但现有检测器面对对抗生成时是否稳健不清楚；需要系统测试直接用检测反馈优化文本的攻击效果和跨检测器迁移。

Result: SHADE 将规避检测建模为策略优化，不做事后扰动或提示改写，而是用 PAN 2025 mdok 代理检测器奖励，对指令微调 LLaMA 使用 GRPO。小 KL 正则的全参数微调使代理规避率达 98.5%，基座仅 1.5%；LoRA 在正则下效果显著较弱。成功文本更短、更简单、词汇多样性更低，说明高规避率不等于更像人类。官方 Voight-Kampff 竞赛名次为第六和第七，表明针对单代理检测器只部分迁移到未见分类器。

Insight: 优化单一检测器容易过拟合其代理信号，规避检测也不必然生成更自然文本；评估和防御应采用多检测器协议。

Abstract: Large language models (LLMs) can generate fluent and coherent text that is increasingly difficult to distinguish from human writing, motivating the development of automatic AI-generated text detectors. However, the robustness of such detectors under adversarial generation remains uncertain. This paper presents SHADE (Stochastic Human-like generation via Adversarial Detector Evasion), a reinforcement learning framework that formulates detector evasion as a policy optimization problem. Instead of applying post-hoc perturbations or prompting-based rewriting, SHADE fine-tunes an instruction-tuned LLaMA model with Group Relative Policy Optimization (GRPO), using feedback from a surrogate detector based on the PAN 2025 mdok system. Our experiments show that full fine-tuning with a small KL regularization penalty achieves $98.5%$ surrogate evasion, compared to $1.5%$ for the base model, while LoRA-based adaptation is substantially less effective under regularization. Linguistic analysis reveals that successful evasion is associated with shorter, simpler, and less lexically diverse outputs, suggesting that high detector evasion does not necessarily correspond to more human-like writing. In the official Voight-Kampff competition setting, our submissions ranked sixth and seventh, indicating that optimization against a single surrogate detector only partially transfers to unseen evaluation classifiers. These results highlight both the potential and limitations of reinforcement learning for adversarial AI-text generation and motivate more robust, multi-detector evaluation protocols for AI-generated text detection.

[150] Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Making cs.CL | cs.LGPDF

Johnathan Sun, Andrei Shleifer, Yonatan Belinkov

TL;DR: 该研究用认知经济理论评估 12 种大模型在 14 万次产品选择中的情境敏感性，发现模型能像人类一样改变分类和选择，却未稳定重分配属性注意力。

Details

Motivation: 大语言模型会呈现多种类人选择行为，但这些是相同认知机制还是表面模仿尚不清楚；认知经济理论可预测人类如何分类问题并分配注意力。

Result: 作者在新建的 14 万次产品选择基准上评估 12 种开源及商业模型。语境会引发与人类类似的选择及问题分类变化，但不会可靠地在价格、质量等属性间重分配注意力。模型规模和 CoT 推理均不能稳定减弱情境敏感性或产生更类人的行为。

Insight: 外显选择模式相似不意味着内部认知过程相同；需要同时考察注意力分配机制，而非仅比较最终选择。

Abstract: Large language models (LLMs) exhibit a range of human-like decision-making behaviors, but whether these reflect similar underlying mechanisms or surface-level mimicry remains unclear. We evaluate whether LLM context sensitivity aligns with a cognitive economic theory that explains human behavior through problem categorization and attention allocation. Across 12 open-source and commercial LLMs on a novel 140,000-trial product choice benchmark, context induces human-like shifts in choice and problem categorization, but does not reliably reweight attention between features like price and quality. Neither scale nor chain-of-thought reasoning reliably attenuates context sensitivity or generates human-like behavior. These results suggest that LLM decision mechanisms are distinct from human ones.

[151] Assessing Adversarial Robustness of Latent Reasoning Models cs.CL | cs.LG | stat.MLPDF

Shaolong Chen, Ang Li, Mingjie Li, Yisen Wang

TL;DR: 该研究比较文本及多模态潜在推理模型在六个基准上的对抗鲁棒性，发现当前潜在推理通常弱于显式 CoT，白盒攻击下降尤为明显。

Details

Motivation: 长思维链带来内存和推理成本，潜在推理通过少量连续向量压缩过程，但其面对对抗扰动的稳健性仍缺少系统评估。

Result: 作者在文本和多模态场景覆盖八个模型、六个基准进行评测。所测条件下，潜在推理模型通常比显式 CoT 基线更不鲁棒，白盒攻击下退化尤其严重。文本潜在状态呈脆弱动态并对某些输入模式高度敏感；多模态潜在状态则可能对输入扰动近乎不变，对最终预测影响有限。

Insight: 连续潜在表示更高效不代表更稳健；文本和多模态模型的失效机制不同，隐式推理设计需同时检验效率、输入敏感性和对输出的实际作用。

Abstract: Large language models increasingly rely on long chain-of-thought (CoT) trajectories for complex reasoning, but autoregressive generation brings substantial memory and inference costs. Latent reasoning models (LRMs) offer a more efficient alternative by compressing intermediate reasoning into a small number of continuous latent vectors. Despite their efficiency, however, the adversarial robustness of LRMs remains largely underexplored. In this work, we systematically evaluate the robustness of latent reasoning across textual and multimodal settings, covering eight models and six benchmarks. We find that, across our evaluated settings, LRMs are generally less robust than explicit CoT baselines under adversarial perturbations, with particularly severe degradation under white-box attacks. Further analysis reveals distinct failure modes across modalities: textual latent states exhibit brittle dynamics and high sensitivity to specific input patterns, while latent states in multimodal models can remain largely invariant to input perturbations and have limited influence on final predictions. These findings expose robustness limitations of current latent reasoning approaches and highlight the need to jointly consider efficiency and robustness when designing implicit reasoning systems. We have open-sourced our code to facilitate reproduction of our research https://github.com/PKU-ML/latent-reasoning-model-assessment.

[152] Seeing Through Conflicts: Improving Instruction Hierarchy Alignment in Vision-Language Models cs.CL | cs.CV | cs.LGPDF

Nicholas Sansoterra, Zishuo Zheng, Sachin Kumar

TL;DR: 该工作用规则奖励强化学习增强 VLM 的指令层级对齐，发现文本训练只能部分迁移，图像训练更鲁棒，混合模态训练最好。

Details

Motivation: 指令层级对齐要求模型在输入冲突时优先遵循更高优先级指令。VLM 的指令可能嵌入图像、跨模态拆分或经视觉变换，并出现在智能体任务中，带来文本模型之外的新挑战。

Result: 作者把多模态指令层级视为推理任务，用基于规则的奖励强化学习训练模型，比较纯文本、纯图像及混合模态监督。文本训练对多模态攻击仅部分迁移，无法充分应对跨模态解码、重建和推理；图像训练鲁棒性超过文本训练，混合模态整体最佳。收益也从合成排版攻击泛化至真实图像和网页智能体安全任务，同时大体保持通用多模态能力。

Insight: 多模态冲突指令必须用图像及跨模态监督训练，单靠文本安全对齐不足；轻量、可验证的规则奖励可以提高鲁棒性而不明显损伤通用能力。

Abstract: Instruction hierarchy (IH) alignment teaches language models to prioritize higher-level instructions when inputs conflict. While studied primarily in text-only settings, vision-language models (VLMs) introduce new challenges for IH: instructions may be embedded in images, split across modalities, visually transformed, or encountered during agentic tasks. Positing multimodal IH alignment as a reasoning problem, we train VLMs using reinforcement learning with rule-based rewards, comparing text-only, image-only, and mixed-modality supervision. We find that text-only IH training partially transfers to multimodal attacks, failing when models must decode, reconstruct, or reason over instructions across modalities. Image-based training improves robustness beyond text-only supervision, while mixed-modality training performs best overall. Importantly, the benefits generalize beyond the synthetic typographic training setting to real-image and web-agent safety tasks, while largely preserving general multimodal capability, showing that lightweight, verifiable supervision can meaningfully improve VLM robustness under adversarial, cross-modal, and interactive instruction conflicts.

[153] Knowledge Graph-Augmented Ambient AI for Clinical Note Generation cs.CL | cs.AIPDF

Jakir Hossain, Yi-Fei Zhao, Hongjian Wang, Minmei Shih, Katie Leigh Mullen

TL;DR: CDR 从临床对话转为知识图谱，找出初始病历遗漏的关键医学概念并提示 LLM 补充，不改动底层病历生成系统。

Details

Motivation: 医疗环境智能可自动从医患对话生成临床记录并减轻文书负担，但生成病历可能遗漏对后续照护重要的讨论内容。

Result: Coverage-Directed Revision 框架由对话转录构建知识图谱，系统识别初始病历中缺失的医学概念，再引导 LLM 恢复遗漏信息，同时保持原病历生成系统不变。作者在康复会话本地数据 Pitt-Bench 和公开 ACI-Bench 上评估四种环境智能系统常用 LLM，所有评测条件下 CDR 均持续提升内容召回率。

Insight: 把对话内容结构化为知识图谱，可让病历完整性审核从整体文本比较转成概念覆盖检查；该方法可作为模型无关的生成后补全层。

Abstract: Ambient AI is increasingly adopted in healthcare to automatically generate clinical notes from patient-clinician conversations, with the potential to substantially reduce clinician documentation burden. However, generated notes may omit clinically relevant information discussed during the encounter, creating information gaps that can affect downstream care. Knowledge graphs (KGs) constructed from encounter transcripts can provide a structured representation of what was discussed and enable systematic identification of missing information from generated notes that are critical for patient care. In this study, we introduce Coverage-Directed Revision (CDR), a model-agnostic framework that constructs a KG from the encounter transcript, identifies medical concepts absent from an initially generated note, and directs large language models (LLMs) to restore the missing information without modifying the underlying note-generation system. We evaluate CDR on two datasets: 1) Pitt-Bench, a local dataset comprising rehabilitation sessions, and 2) ACI-Bench, a public dataset for benchmarking clinical note generation. We tested four underlying LLMs widely used in ambient AI systems. The results show that CDR consistently improves content recall across all evaluated conditions. Our study provides a practical approach for improving the completeness of ambient AI-generated clinical documentation.

[154] H2LooP Telecom Model v1: From Telecom Comprehension to Autonomous Issue and PR Resolution cs.CL | cs.AIPDF

Amit Singh, Vedant Nipane, Mayank Goel, Pulkit Agrawal, Sairanjan Mishra

TL;DR: H2LooP Telecom 发布面向电信的理解和智能体两个领域适配模型，在电信问答、代码生成及生产仓库 PR 解决任务上取得较强成绩。

Details

Motivation: 电信规范、O-RAN 文档、网络遥测和真实代码仓库包含大量领域知识，通用模型可能难支持电信问答、代码变更与生产问题修复。

Result: H2LooP 提供理解型模型及智能体型模型，分别面向领域问答/推理和自主代码生成、PR 处理及代码提交。理解型在 OT-Lite Pass@3 加权平均为 81.8%，以 31B 参数在社区排行榜列第五；智能体型在电信代码生成上 AST Similarity 相对提升 8.8%、Location IoU 提升 20%，MMLU 74.0% 和 BFCL v3 多轮函数调用 79.0% 保持不变。论文报告其在独立评测中超过若干闭源前沿模型，并称领域专门化没有造成灾难性遗忘。

Insight: 整理的电信语料能让同等规模模型获得专业能力，同时保留通用和函数调用性能；领域理解与代码智能体是互补但不同的部署需求。

Abstract: We present H2LooP Telecom Model v1, a domain-specialized large language models fine-tuned for the telecommunications industry. We release two domain-adapted model variants serving complementary use cases: a comprehension-focused variant for telecom domain question answering and reasoning, and an agentic variant for autonomous telecom code generation, pull request resolution, and code commits on production repositories. H2LooP Telecom achieves strong results on the GSMA Open Telecom Lite (OT-Lite) benchmark and a proprietary telecom code generation benchmark, outperforming frontier closed-source models such as GPT-5 and Claude Opus on independent leaderboard evaluation, while preserving general-purpose capabilities. The Comprehension variant achieves 81.8% weighted average on OT-Lite Pass@3, and, independently, ranks 5th overall on the official community-run Open Telco AI Leaderboard* at only 31B parameters-ahead of frontier closed-source systems including Claude Opus 4.6, GPT-5, Gemini 3 Flash, Grok-4-fast, and Kimi K2.5. Our agentic variant obtains a relative improvement of +8.8% in AST Similarity and +20.0% in Location IoU over the base model on telecom code generation, while maintaining identical MMLU (74.0%) and BFCL v3 multi-turn function calling (79.0%) performance, indicating zero catastrophic forgetting. Domain specialization on curated telecom corpora, spanning 3GPP standards, O-RAN specifications, network telemetry, and real repository commits, yields substantial improvements over general-purpose models of equivalent scale, approaches frontier closed-source models on domain-specific evaluation, and is independently corroborated by our official leaderboard standing.

[155] Do Chess Explanations Reflect Model Decisions? Behavioral and Token-Level Tests of LLM Reasoning Faithfulness cs.CL | cs.AIPDF

Angelina Parfenova

TL;DR: 该研究用国际象棋终局任务检验 LLM 棋步解释是否忠实，发现解释能影响选择但在严格去提示后对正确着法的支持有限。

Details

Motivation: 语言模型可以为棋步写流畅解释，但合理措辞不一定反映实际决策依据。国际象棋棋盘完全可见、合法着法可枚举、棋步质量可独立评估，适合检验解释忠实性。

Result: 作者在 200 个 Lichess 终局题上用着法可恢复性、解码器控制和合法候选 token 评分测试解释。未遮蔽解释时容易从文本恢复生成着法，但移除显式着法提示后优势大幅减小；严格遮蔽下，解释相较棋盘本身仅带来较小且依解码器变化的增益。token 评分显示解释仍会改变选择：其他谜题的随机但合理解释会降低正确着法概率。熟悉终局模式可提高着法恢复率，却不保证正确率。

Insight: 语言解释看似与行动一致、可恢复，并不意味着推理忠实或结论正确；解释文本还可能实际干扰选择，因此需分开评估可读性、影响力和忠实性。

Abstract: Large language models can produce fluent explanations for chess moves, but plausible language does not necessarily reflect the reasoning behind a decision. We study this question in chess, where the board state is fully observable, legal actions can be enumerated, and move quality can be evaluated independently. Across 200 Lichess endgame puzzles, we test explanations using move recoverability, decoder-side controls, and token-level scoring of legal candidate moves. Unmasked explanations make generated moves easy to recover, but this advantage drops sharply after explicit move hints are removed. Under strict masking, explanations provide only small and decoder-dependent gains over the board state alone. Token-level scoring shows that explanations can nevertheless alter move preferences: random but plausible explanations from other puzzles reduce the probability of the correct move, indicating that irrelevant reasoning text is not simply ignored. We also find that recognizable endgame motifs can make generated moves easier to recover without reliably improving move correctness. Together, these results show that linguistic plausibility, consistency with a generated action, and solution correctness are distinct properties. Fluent chess explanations can influence action preferences and support a coherent move narrative while providing only limited evidence of faithful reasoning.

[156] The Corroboration Illusion: When More News Makes LLM Forecasts Less True cs.CL | cs.AIPDF

Yuan Lu, Yukuan Zhang

TL;DR: 该研究展示检索新闻语料可被单纯发布文章的对手污染，显著改变 LLM 概率预测，并使 Brier 分数恶化，且常见过滤策略均有廉价绕过方式。

Details

Motivation: LLM 越来越通过检索和推理新闻预测现实事件；开放可爬取新闻语料让攻击者无需访问检索器、模型或用户问题，仅发布文章就可能操纵概率判断。

Result: 作者将概率预测新闻语料投毒与既有 RAG 事实/立场攻击区分，在 500 个已结算 ForecastBench 问题、1,740 万篇 Common Crawl News 文章（严格抓取时间截止）和三个基于 7–8B 开放模型的预测器上测试。每题一篇 LLM 文章使 56% 预测跨越 0.5，五篇使 69%–73% 翻转，概率净移 +0.13 到 +0.22，Brier 从 0.18 恶化到 0.37。效果随注入文章数量、检索排名、问题相似度和上下文占比上升，可跨模型迁移且与声称媒体来源无关。来源白名单、分离后聚合和困惑度过滤分别可被伪造来源、数量多数投毒和高温生成绕过。

Insight: 检索式概率判断继承整个信息供应链的脆弱性；只过滤单篇可疑内容难防多篇协同注入，需对新闻来源和预测校准做更系统的防护。

Abstract: Large language models (LLMs) are increasingly used to forecast real-world events by retrieving and reasoning over news. We show that this dependence on an open, crawlable news corpus creates a new attack surface: an adversary who can merely publish articles–without access to the retriever, the model, or the user’s queries–can systematically move the forecaster’s output probabilities. We formalize news-corpus poisoning of probabilistic forecasters, a threat model distinct from prior RAG poisoning, which targets factual answers or opinion polarity rather than calibrated probabilities. We evaluate the attack on 500 resolved ForecastBench questions against a 17.4M-article Common Crawl News corpus with a strict crawl-date cutoff, using three retrieval-augmented forecasters built on open 7-8B models. A single LLM-written article per question flips 56% of forecasts across the 0.5 boundary; five articles flip 69-73% and shift probabilities by +0.13 to +0.22 net of a neutral-article placebo, degrading the Brier score from 0.18 to 0.37. The effect is monotone in the number, retrieval rank, query similarity, and context share of injected articles, transfers across model families, and is unaffected by the claimed publisher. We then evaluate three natural defenses–source allow-lists, isolate-then-aggregate forecasting, and perplexity filtering–and show that each has a cheap bypass: spoofed publishers, majority poisoning, and higher-temperature generation, respectively. Our results indicate that probabilistic LLM judgments inherit the full fragility of the information supply chain they consume.

[157] Toward Personalized Sleep Guidance from Wearable Data Using Language Models cs.CL | cs.AIPDF

Yusheng Tan, Running Zhao, Sofia Angel, Ninghui Hao, Ash Arian

TL;DR: 该两阶段睡眠指导框架用多智能体 LLM 从未标注可穿戴记录生成结构化推理轨迹，再蒸馏到小语言模型并以训练免 Best-of-N 选择改善结果。

Details

Motivation: 可穿戴设备睡眠监测有助个体健康，但通用 LLM 的摘要和问答不足以提供个性化睡眠指导；专用训练需昂贵专家标注，且用户隐私和可及性要求轻量本地部署。

Result: 第一阶段用多智能体 LLM 管线对未标注穿戴记录推理结构化睡眠建议，规模化构造数据；第二阶段用监督微调将建议推理轨迹蒸馏到小语言模型，并加入免训练 Best-of-N 选择提升推理质量。实验显示该方法超过商业通用/医疗 LLM 和开源模型；人工评价也支持生成指导质量及 SLM 个性化指导的可行性。

Insight: 利用强模型处理未标注个人记录，可降低小模型专家监督成本；再将推理迁移至本地小模型有利于隐私和访问。

Abstract: Sleep monitoring using wearable data has shown promise for personal health, yet large language model (LLM)-based summarization and question answering remain insufficient for personalized sleep guidance. Training specialized models, however, often requires costly expert annotation. Moreover, privacy and accessibility concerns motivate lightweight, local deployment for end users. We present a two-stage framework to address these challenges. Specifically, in Stage~~1, a multi-agent LLM pipeline reasons structured sleep guidance from unannotated wearable records, enabling scalable dataset construction. Stage~~2 distills guidance reasoning trajectories into small language models (SLMs) through supervised fine-tuning and integrates a training-free Best-of-$N$ selection strategy to enhance inference. Experimental results demonstrate our method outperforms commercial general and medical LLMs and open-source models. Human evaluation further supports the quality of the generated guidance and the feasibility of personalized sleep guidance with SLMs.

[158] Correct Diagnosis, Better Feedback: A Symbolic-Verifier for Faithful LLM Tutoring Feedback in Logic Proofs cs.CLPDF

Tahreem Yasir, Arnav Mody, Xioayi Tian, Tiffany Barnes

TL;DR: 该逻辑证明辅导系统将错误诊断与自然语言反馈分开，比较零样本、微调和符号验证器，发现错误诊断会被高忠实地传递到后续解释。

Details

Motivation: 有效的 LLM 辅导需先准确定位学生推理中的具体错误，再生成反馈；形式命题逻辑可依据规则明确检查学生步骤，为研究诊断与反馈提供可验证场景。

Result: 作者设计符号验证器接地架构，将诊断与语言生成解耦，在 600 个平衡学生步骤上比较零样本检测器、微调检测器和符号验证器；所有诊断都由相同理由及反馈智能体处理。零样本宏 F1 为 0.191，微调后提高到 0.709，但结构相近类别间仍有系统性错误。理由通常忠实保留所给诊断，因此错误诊断会被流程忠实传播；反馈即使忠于理由、避免直接泄题且教学语气合适，也可能针对错误问题。符号验证器接地反馈的诊断正确率最高，专家评分与自动指标之间并不完全一致。

Insight: 反馈流畅、忠实或看起来有教学性，不代表底层诊断正确；系统评估必须把诊断正确性、理由忠实性和反馈质量分别衡量。

Abstract: Effective LLM tutoring depends on correctly identifying the specific error in a student’s reasoning before generating feedback. We study this problem in propositional-logic proof tutoring, where student actions can be checked against formal inference rules. We introduce a verifier-grounded architecture that separates diagnosis from language generation. Using 600 balanced student actions, we compare a zero-shot LLM detector, a fine-tuned detector, and a symbolic verifier. Each diagnosis is processed by shared rationale and feedback agents, isolating the effect of the initial diagnosis. The zero-shot detector achieves a macro-F1 of 0.191; fine-tuning raises this to 0.709 but retains systematic errors between structurally related classes. Rationales generally preserve the diagnosis supplied to them, showing that an incorrect diagnosis can be faithfully propagated through the pipeline. Feedback can likewise remain faithful to its rationale, non-revealing, and pedagogically appropriate while addressing the wrong error. Verifier-grounded feedback achieves the highest diagnostic correctness, and expert ratings largely uneven with the automatic feedback evaluations. These findings show that apparent feedback quality can conceal upstream diagnostic errors and that faithfulness must be evaluated separately from correctness. Our code is publicly available

[159] Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments cs.CL | cs.AIPDF

Jakob Morales, Monica Hegde, Fayeq Jeelani Syed

TL;DR: 该系统将 YouTube 城市议题评论的地理实体消歧、主题聚类、情感分析与 RAG 整合，并量化短非正式文本上常用 NLP 指标的失效方式。

Details

Motivation: 关于步行性、骑行、公共交通、住房密度和街道安全的线上评论数量大但结构松散，现有城市评估工具很少利用这些公众意见。

Result: 管线对 309 个北美城市、22,788 个 YouTube 转录和评论块进行地理实体解析、主题建模、情感分析与 RAG。Twitter 语料微调 RoBERTa 比 VADER 高 12.6 宏 F1 点（0.589 对 0.464），但两者都难处理占多数的中性类别，标注者对该类一致性 κ=0.53。稠密检索各截断点均优于 TF-IDF，P@5 为 0.790 对 0.560；视频级相关性代理低估片段级精度。多句摘要与单条短评论比较时 BERTScore 几乎不随相关性变化，ROUGE-1 接地分则只是受释义影响的下界，不等于幻觉率。

Insight: 短用户生成文本上的检索和情绪评估需做片段级人工验证；常用语义相似指标可能无法测出摘要是否真正由证据支持。

Abstract: Online discourse about urban issues - walkability, cycling infrastructure, public transit, housing density, and street safety - is voluminous but unstructured, and existing city-evaluation tools capture none of it. We present a pipeline and conversational system that combines geographic entity resolution, topic modeling, sentiment analysis, and Retrieval-Augmented Generation (RAG) over 22,788 chunks of YouTube transcripts and comments spanning 309 North American cities. Beyond the system itself, our contribution is a set of measurements about what happens when standard NLP components meet short, informal, geographically ambiguous text. A Twitter-tuned RoBERTa classifier outperforms a VADER lexicon baseline by 12.6 macro-F1 points (0.589 vs. 0.464; McNemar p = 0.0001), but both models collapse on the neutral class, which dominates urbanist comment traffic; annotators disagree on the same class (Cohen’s kappa = 0.53). Dense retrieval beats a TF-IDF baseline at every cutoff (P@5 0.790 vs. 0.560), and video-level relevance proxies understate chunk-level precision by a wide margin (0.660 vs. 0.94 under human rating). For groundedness evaluation, we find BERTScore unusable when a multi-sentence generated summary is compared against a single short comment - scores are nearly flat regardless of relevance - and show that ROUGE-1-based groundedness is a paraphrase-driven lower bound rather than a hallucination rate. These findings generalize beyond the urbanist domain to any RAG system built over short user-generated documents.

[160] LLaDA-PRM: A Bidirectional Step-Level Reasoning Evaluator cs.CL | cs.AIPDF

Yiming Feng, Naihao Deng, Yulong Chen, Rada Mihalcea

TL;DR: LLaDA-PRM 用双向注意力评估完整推理解答中的步骤有效性，显示后续步骤可反向帮助判断早期步骤，并在多个基准超过更大因果评估器。

Details

Motivation: 自回归步骤级评估器只能让每步表示看到题目、前序及当前步骤；但完整解答中的后续结果可能帮助判断某个早期步骤是否有效。

Result: 作者在 1B–3B 规模下进行了 54 组受控比较，仅更换因果或双向自注意力掩码，双向 LLaDA 评估器一致改善。基于此提出 8B 双向评估器，在 MR-MATH-invalid 上步骤 F1 为 88.8，在分布外 MR-GSM8K 原题子集为 83.8，分别超过 ReasonEval-Llemma-34B 11.3 和 10.3 分。该模型也能评估在线设置中的不完整轨迹，并在两个基准上明显超过最强基线；还可筛选训练数据，提升 Mistral-7B 的 MATH-500 表现。

Insight: 当评估对象是完整推理过程时，双向上下文可让后续证据重新解释早期步骤；因果掩码可能人为限制过程评估器的信息。

Abstract: Step-level reasoning evaluators are commonly based on autoregressive language models, whose causal attention restricts each step representation to the problem, previous steps, and the current step. Yet, when the complete solution is available, the validity of an earlier step may become clearer only through its downstream consequences. We validate this hypothesis through a controlled 54-run comparison of causal and bidirectional LLaDA evaluators at 1B–3B scale, changing only the self-attention mask, and find bidirectional attention yields consistent improvements. Building on this finding, we introduce \prm{}, an 8B bidirectional evaluator that reaches 88.8 step-level F1 on MR-MATH-invalid and 83.8 on the out-of-distribution MR-GSM8K original-question subset, outperforming ReasonEval-Llemma-34B by 11.3 and 10.3 F1 points, respectively. \prm{} also remains effective when evaluating incomplete reasoning traces in online settings, outperforming the strongest baselines on both benchmarks by a large margin. We further show that \prm{} provides an effective training-data selection signal, improving Mistral-7B performance on MATH-500.

[161] COT-TTS: Audio Context-Aware Text-to-Speech with Chain-of-Thought Reasoning cs.CL | cs.SD | eess.ASPDF

Weizhen Bian, Sitong Cheng, Rongxiu Zhong, Jiahao Pan, Liumeng Xue

TL;DR: COT-TTS 将历史对话音频作为语境，先推理目标语音风格再合成指定音色语音，并构建 900 万样本中英双语对话语音数据。

Details

Motivation: 现代 TTS 表达和可控性提升，但说话风格通常依赖用户显式指令；自然对话中更应从前文音频推断目标语气和情绪。

Result: COT-TTS 定义上下文感知推理式 TTS：输入历史对话音频、目标文本和参考语音，理解对话、生成显式中间推理，再以指定音色合成目标语音。作者构建 900 万训练样本（含 100 万高质量子集）及来源互斥的 800 条人工核验基准，建立任务基线。0.6B 和 1.7B 自回归模型生成带情绪标签文本、可编辑风格推断及语音 token；与大型基线表现相当，时长和情绪一致性良好，可依据上下文生成适当情绪、重音和节奏变化。

Insight: 历史语音包含目标文本之外的对话情绪和韵律线索；显式风格推理为上下文到语音生成提供可编辑的中间接口。

Abstract: Recently, text-to-speech systems have made significant progress in speech expressiveness and controllability. However, the speaking style of generated speech typically relies on clear user-specified instructions. In natural conversations, speaking style should be naturally inferred from the preceding conversational context. Therefore, we propose COT-TTS, a context-aware, reasoning-based text-to-speech task. Given historical conversation audio, target text, and a reference speech, the system should comprehend the conversational context, infer an explicit intermediate reasoning, and finally synthesize the target speech with the specified timbre. To support this task, we constructed a large-scale bilingual conversational speech dataset comprising 9 million training samples, including a high-quality subset of 1 million samples. We further constructed a source-disjoint benchmark with 800 human-verified samples and established strong task-specific baselines. Additionally, we developed end-to-end autoregressive models with parameter sizes of 0.6B and 1.7B, generating emotion-labeled transcripts, editable speech style inferences, and speech tokens. Experimental results show that the proposed model achieves performance comparable to large-scale baseline systems with significantly fewer parameters. At the same time, the model performs well in terms of duration consistency and emotional consistency, and can generate appropriate emotional, stress, and rhythmic variations based on the conversational context. To facilitate future research, we will publicly release the data construction pipeline, dataset, trained models, and related resources. The demo page and additional resources are available at https://luckybian.github.io/COT-TTS

[162] MIS-Bench: Benchmarking Multimodal LLMs for Psychotherapeutic Interpersonal Skills Assessment cs.CLPDF

Yuhan Lu, Yi Yao, Hua Shen, Katie Aafjes-van Doorn, Zhaonan Wang

TL;DR: MIS-Bench 用 996 段心理治疗回应视频和八维 FIS 专家标注评测多模态模型的人际技能判断，并提出面向一位小数评分的回归微调 MIS-RAFT。

Details

Motivation: MLLM 作为评估器日益常见，但在需要专业判断的心理治疗人际技能评估中是否可靠尚不清楚。

Result: MIS-Bench 包含 996 段心理治疗回应视频，按促进性人际技能的八个维度标注。九个 MLLM 在多种模态和提示设定下与人类专家一致性仅中等，多模态输入收益不稳定，推理提示帮助有限。MIS-RAFT 借鉴 RAFT 并针对一位小数精度细粒度技能分数设计回归感知微调，显著提升与人类评分的一致性。

Insight: 通用多模态能力不代表掌握专家级人际判断；评分模型需要直接适配连续细粒度评分结构，而不是只生成解释或粗粒度类别。

Abstract: Multimodal large language models (MLLMs) are increasingly used as evaluators, yet their reliability in professional assessment tasks that require expert judgment remains unclear. We investigate this challenge in the context of assessing psychotherapeutic interpersonal skills and introduce MIS-Bench, a Multimodal Interpersonal Skills (MIS) benchmark comprising 996 psychotherapy response videos annotated across 8 dimensions of Facilitative Interpersonal Skills. Across 9 MLLMs with multiple modality and prompting settings, we find that current models show only modest agreement with human experts, inconsistent gains from multimodal input, and limited benefits from reasoning-based prompting. To mitigate this gap, we propose MIS-RAFT, a regression-aware fine-tuning method inspired by RAFT and tailored to fine-grained interpersonal skill scoring at one-decimal precision. MIS-RAFT addresses the mismatch between autoregressive token prediction and scalar-valued expert assessment, significantly improving agreement with human ratings. Overall, MIS-Bench reveals a clear gap between general multimodal capability and expert-level interpersonal judgment, while MIS-RAFT offers a promising path toward more reliable model-based assessment.

[163] Block-Sparse Attention with Semantic-Geometric Decoupled Routing cs.CL | cs.AIPDF

Xinwei Long, Weigao Sun, Weibo Gao, Pengkun Jiao, Biqing Qi

TL;DR: 提出无需训练的语义—几何解耦路由，在长上下文中以块稀疏注意力逼近全注意力效果并降低推理开销。

Details

Motivation: 块稀疏注意力依赖准确选择相关键块，但现有路由器聚合RoPE后的表示会混淆语义与位置几何，削弱局部位置信号。

Result: 在4K至128K文本和视频上下文上接近全注意力准确率；路由开销低于3.4毫秒，128K上下文下较FlashAttention加速5.03倍。

Insight: 先在RoPE前聚合语义，再用离线结构先验和相对块距离补回几何偏置，可得到无需逐token搜索或事后校准的闭式路由分数。

Abstract: Long-context inference has become a defining capability of large language models, but exact dense attention remains costly due to its quadratic scaling with sequence length. Block-sparse attention offers a hardware-friendly alternative by routing each query block to a small set of relevant key blocks, yet accurate training-free block routing remains difficult. Existing routers often pool post-RoPE token representations, which entangles semantic aggregation with RoPE-induced geometry and attenuates local positional cues through high-frequency phase cancellation. To resolve this mismatch, we propose \textbf{Semantic-Geometric Decoupled Routing}, a training-free block routing framework that shifts semantic aggregation to the pre-RoPE space and reconstructs geometric bias with an offline structural prior and relative block distances. This decomposition yields an explicit closed-form block routing score without token-level search or post-hoc calibration. Experiments on long-context text and video tasks show that our method approaches full-attention accuracy across 4K–128K contexts, keeps routing overhead below 3.4 ms, and achieves a 5.03$\times$ speedup over FlashAttn at a 128K context length.

[164] An Iterative LangGraph Agent for Text-to-SQL: Natural Language Access to the Chicago Crime Database cs.CL | cs.AI | cs.DBPDF

Vigneshwar Ravi Rao, Rupesh Swarnakar, Fayeq Jeelani Syed†

TL;DR: 构建六节点LangGraph文本转SQL智能体，通过模式读取、试运行校验和失败重试，将自然语言问题转成可执行查询并解释结果。

Details

Motivation: 不熟悉SQL的业务人员难以直接从运维数据库提取信息；工作评估提示工程是否足以支撑端到端查询流程。

Result: 在芝加哥犯罪数据库的100题基准上，修订版有效SQL率93%，执行准确率60%，结果综合质量均分4.34/5，均高于同一智能体旧提示版本。

Insight: 移除会截断多行回答的LIMIT 10指令带来最大改善；研究是单模型工程评估，没有与外部系统或公开基准比较，剩余错误涉及问题歧义、误拒和API限流。

Abstract: Non-technical stakeholders frequently cannot write the SQL needed to extract insights from operational databases. We built and evaluated a Text-to-SQL agent that closes this gap end to end: a six-node LangGraph StateGraph checks question relevance, fetches the live schema, generates PostgreSQL, validates it with a dry run, retries on failure, executes the query, and narrates the result set in plain English. The agent uses prompt engineering only; no model was fine-tuned. We evaluated it on the Chicago Crime dataset (approximately 8.5 million records, 22 attributes) against a hand-built benchmark of 100 natural language questions with ground-truth SQL, stratified into 30 Easy, 40 Medium and 30 Hard items. Comparing two prompt revisions of the same agent, the revised system (V2) reached a Valid SQL Rate of 93% (from 87%), an Execution Accuracy of 60% under a hybrid relational equivalence metric (from 47%; 19% from 12% under strict JSON matching), and a mean Synthesis Quality of 4.34 out of 5 (from 3.91). The single largest driver was removing a LIMIT 10 instruction from the system prompt, which had been truncating multi-row answers. Error analysis attributes the residual failures to relevance-checker false rejections, ambiguous question semantics, and free-tier API rate limits rather than to the language generation step. We report no comparison against an external baseline system or a public benchmark; the study is a single-model engineering evaluation.

[165] Automatic multimodal UX improvement recommendations from LLM agent user simulations cs.CL | cs.AI | cs.HCPDF

Anu Chowdhury, Bin Wu, Hossein A. Rahmani, Emine Yilmaz

TL;DR: AMUSER通过多模态用户模拟轨迹自动生成并排序网站UX改进建议，降低人工体验测试成本。

Details

Motivation: 真实用户测试昂贵、主观且难规模化；已有智能体模拟缺少多模态信息，且需要人工从交互记录中提炼行动建议。

Result: 在商业网站评估中，建议排序NDCG@3为0.758，高于纯文本模拟的0.359，模拟成本降低89%。

Insight: 视觉信息在用户模拟阶段带来更丰富轨迹并改善建议；若在生成建议时再提供视觉输入，质量反而可能略降，显示多模态作用依阶段而异。

Abstract: Evaluating user experience (UX) on live websites through user testing is expensive, subjective, and difficult to scale. LLM agents offer a promising route to automating UX testing by simulating realistic user behaviour. However, existing simulation approaches typically lack multimodality and require time-consuming manual review to extract actionable insights. We formalise UX improvement recommendation from simulation data as a structured natural language generation and ranking problem, and establish an evaluation protocol using expert annotation and LLM-as-a-Judge. We present AMUSER, a multimodal framework which simulates user behaviour and automatically generates prioritised UX improvement recommendations from resulting data. We evaluate AMUSER on commercial websites and show that its recommendations substantially outperform those from text-only simulation (NDCG@3 = 0.758 versus 0.359) at an 89% lower simulation cost. Our results suggest an asymmetric role of multimodality: visual access during simulation improves recommendations through richer traces, while providing visual inputs during recommendation generation can modestly degrade quality. We also discuss practical deployment lessons from applying AMUSER to commercial websites.

[166] Attributable Post-Rationalization in RAG Citations: A Controlled Reproduction and an RLVR Comparison cs.CL | cs.IRPDF

Mehedi Khan, Md. Shariful Islam Bhuyan

TL;DR: 受控复现实验发现，强化学习可验证奖励训练并不会自动改善检索增强生成中的引用忠实度。

Details

Motivation: RAG模型可能先写出正确答案，再附上并未真正支持答案的文献引用；研究检验追求答案正确性的RLVR是否也能减少这种事后合理化。

Result: 四个问答数据集上，维基类问题约七分之一的引用不忠实；三个RLVR智能体的情况与基础模型相近，其中一个略差。

Insight: 奖励答案正确并不足以促使模型诚实引用，因此引用忠实度需要单独训练和测量；实验以免费GPU复现既有方法并补充了必要对照。

Abstract: A RAG system can hand you the right answer and cite a source it did not actually use. Models output these unfaithful citations via post-rationalization: they write the answer first and then attach a citation to whatever passage looks close enough. Search agents are now trained with reinforcement learning from verifiable rewards (RLVR), which pays them for getting the answer right. We asked whether that training also teaches them to cite honestly. Improving an existing methodology with a required control, we compared an instruction-tuned model against three RLVR agents trained from it, on four question-answering datasets, using only free-tier Kaggle GPUs. Post-rationalization is everywhere: on Wikipedia-based questions roughly one citation in seven is unfaithful. RLVR does not fix it. The agents post-rationalize at their base model’s rate, and one lands slightly worse. Rewarding correct answers buys nothing in citation faithfulness, so faithfulness has to be trained and measured on its own terms.

[167] From Concept Alignment to Causal Grounding: An Intervention Test of Chain-of-Thought Faithfulness cs.CL | cs.AI | cs.LGPDF

Qianli Wang, Yilong Wang, Dennis Wei, Jingyi Sun, Simon Ostermann

TL;DR: 用共享稀疏自编码器表征和因果消融，检验语言模型思维链是否使用并依赖其直接预测所需的内部概念。

Details

Motivation: 思维链可能听起来合理却不忠实；仅看输入输出或归因难以判断内部计算是否真正驱动答案。

Result: 五个模型、四个数据集上，概念相关性指标通常较高，但因果忠实度随模型层深变化，在中后层达到峰值，模型规模也会改变其分布；关键概念未必出现在文字解释里。

Insight: 共享概念只能说明思维链和直接预测表征重合，不能说明概念对答案有因果作用；消融后测量答案概率变化可揭示这一差别。

Abstract: Chain-of-thought (CoT) can sound plausible yet be unfaithful to the model’s underlying reasoning. Most prior work probes CoT faithfulness through input–output behavior or input attributions, leaving internal computation largely underexplored. We instead cast faithfulness as internal concept grounding: Does a large language model’s (LLM) CoT reasoning engage the same internal concepts that support the LLM’s direct prediction, and do the shared concepts causally drive its answer? Encoding a prediction pass and a CoT pass with a single shared sparse autoencoder (SAE), a reliable approximator of the latent concepts LLMs use, makes their internal concepts directly comparable. We introduce three correlational metrics of concept-level alignment and a causal metric, $Δp$, which ablates the shared concepts and measures the drop in answer probability. Across five LLMs and four datasets, concept alignment is generally high, as indicated by the correlational metrics; yet these only identify which concepts are shared, not how much they causally contribute. $Δp$ fills this gap: causal faithfulness varies substantially with model depth, peaking at mid-to-late layers rather than the final ones, and model scale reshapes the layer-wise profile. Moreover, causally important shared concepts are not always verbalized in the CoT. These dissociations suggest that faithfulness cannot be reliably assessed from surface-level or representational correspondence alone; assessing it requires causal tests of whether the internal concepts underlying a CoT actually drive the model’s prediction.

[168] OmniEdu: Open Foundation Models for Learning and Teaching cs.CLPDF

Hao Liang, Qihan Lin, Meiyi Qiang, Linzhuang Sun, Hengyi Feng

TL;DR: OmniEdu推出面向K-12学习与教学的开放基础模型系列，以四类教育能力组织高质量指令数据。

Details

Motivation: 现有教育语言模型往往只侧重解题或辅导，训练数据也多按来源或任务混合，难以同时支撑课程理解、诊断和教学引导。

Result: 数据集含69,999条样例和1,596万监督响应token；教育调优在不同模型规模上均改善三类教育基准，27B模型在K12-Bench、MathFish、EDUMATH等取得摘要报告的结果。

Insight: 训练语料按学科能力、课程依据、诊断推理和教学支架组织，并结合清洗、语义审核、质量打分、多样性筛选及教学指令赋值。

Abstract: Educational foundation models must solve problems, understand curriculum structure, diagnose learner difficulties, and provide appropriate instructional support. Existing educational language models often focus on either problem solving or tutoring, with training mixtures organized by source or task rather than capability. We present OmniEdu, an open family of foundation models for K-12 learning and teaching. Its instruction-tuning corpus combines over 100 educational resources and general instruction sources, organized around four capabilities: subject competence, curriculum grounding, diagnostic reasoning, and pedagogical action and scaffolding. Our pipeline integrates deterministic cleaning, semantic auditing and rewriting, task-specific quality scoring, token-budgeted diversity selection, and pedagogical instruction assignment. It yields 69,999 examples and 15.96M supervised response tokens, including 60,951 education-specific examples. We fine-tune 4B, 9B, and 27B models and evaluate curriculum grounding, K-12 problem solving, and pedagogical tutoring, alongside general capability. Education-oriented tuning consistently improves all three educational benchmark groups across model scales. OmniEdu-27B achieves 63.12% EM and 76.69% F1 on K12-Bench, 85.89% on MathFish, 86.95% on EDUMATH, and 78.74% in MathTutorBench’s Scaffold setting. It also achieves the highest Teaching average on LongTutor among the evaluated models, at 3.02. These results demonstrate the value of curated, capability-balanced supervision for adapting general language models to educational tasks spanning problem solving, curriculum understanding, and instructional support.

[169] Chronologic: Measuring Language Models’ Ability to Represent the Past cs.CLPDF

Ted Underwood, Ziliang Qiu, Sarah Griebel, Laura K. Nelson, Edwin Roland

TL;DR: Chronologic用历史文本构建基准，测量语言模型对1831至1930年英语语境的时代适配能力。

Details

Motivation: 模型可用于历史研究，但答案是否符合目标时期并不容易验证，且历史问题往往有多个可接受答案。

Result: 生成任务比判别任务更难；专用历史语料预训练模型按答案似然领先，却在自由生成上不及商业模型。受测模型均未能令人信服地完整再现历史语境。

Insight: 基准利用历史文本建立多个正确答案及强干扰项，并用成对比较分级评分；推理模型通常能辨认自身生成答案的不足。

Abstract: Language models are appealing tools for research on the past. But to trust the evidence a model provides, researchers need to know whether its responses fit the period represented. Validation is challenging, because this is not a task living people ordinarily perform, and because many questions have multiple correct answers. We use historical texts to develop a benchmark for a model’s representation of English-language contexts 1831-1930, relying on pairwise comparisons to multiple ground truths and strong distractors to score the hardest questions in an appropriately graduated way. We find that generative tasks are harder than discriminative ones; in fact, reasoning models can typically discern the weakness of their own generated answers. While models pretrained exclusively on historical text lead the pack when evaluated by answer likelihood, they cannot compete with commercial models in free generation. None of the models we tested represent historical contexts in a fully persuasive way yet, but progress toward that goal is evident.

Yannick Yomie Nzeuhang, Marie Tahon, Paulin Melatagia Yonta

TL;DR: 提出基于异构图神经网络与链接预测的低资源语音—文本对齐方法，以较少数据将文本语义迁移到语音表征。

Details

Motivation: 常见学生—教师式语音文本对齐需要大量训练数据和计算资源，不适合资源有限语言；研究聚焦词级对齐。

Result: 在英语TIMIT和喀麦隆语Yemba实验中，方法总体达到与SAMU-XLSR相近的表现，并在Yemba词检索任务上超过该方法。

Insight: 通过异构图消息传递显式从文本模态向语音模态传递信息，改善声学表征，并减少对大规模训练数据的依赖。

Abstract: Speech-text space alignment is a multimodal representation learning method consisting to map different speech and text into a shared representation space, leading to enrichment of the representation of each modality. Proposed architectures, such as SAMU-XLSR, typically follow a student/teacher framework, with the goal of fine-tuning an audio encoder to produce representations that closely match those of the text. In this way a speech representation is semantically enriched. However, such systems generally require large amounts of training data and considerable computational resource, making them difficult to apply to low resources languages under frugal constraints. The present work proposes a data-efficient space alignment method based on Heterogeneous Graph Neural Networks and link prediction. The core idea is to leverage message passing to explicitly transfer information from the text modality to the speech modality, thereby reducing the need for large training datasets and intrinsically enriching the acoustic representations, all in a more interpretable manner. Although thoroughly explored for high-resource languages, word-level tasks in speech remain relevant for certain low-resource languages. Therefore, we conducted experiments on speech-text alignment at the word level using the TIMIT (English) dataset and Yemba (a Cameroonian language). Our approach yields results comparable to those of SAMU-XLSR, a state-of-the-art method, and even surpasses it for the Yemba language in the task of word retrieval, while using far fewer resources, demonstrating its power, frugality, and efficiency.

[171] Euston: Training Away Mathematical Sycophancy Without Losing the Mathematics cs.CLPDF

Zehua Cheng, Wei Dai, Jiahao Sun

TL;DR: Euston通过强化学习训练8B数学声明验证模型，减少模型对错误定理迎合式证明的倾向，同时尽量保留解题能力。

Details

Motivation: 推理模型倾向于给出证明而非拒绝；面对被篡改的定理时，可能自信地推导错误结论。

Result: 在真假均衡的400条留出声明上，平衡准确率从29.50%升至63.75%；AIME 2026准确率由69.17%变为65.00%，差异不显著。作者指出官方评测集组成和真实错误率下精确率等混杂因素限制结论。

Insight: GraphSynth生成成对真实与篡改陈述，再用规则奖励进行GRPO训练；中位回答长度和截断率也下降，因此改进并非来自更长思考。

Abstract: Reasoning language models are trained to produce solutions, not to refuse them, and this bias persists when the problem they are handed is false. Asked to prove a corrupted theorem, a strong model will typically comply and produce a confident derivation of something untrue. We present Euston, an 8B mathematical claim-verification model trained to resist exactly this. Training data were generated with GraphSynth, a probabilistic factor-graph generator that couples attribute-level diversity to decode-time structural masking and span-synchronized verification, yielding 3{,}026 matched true/corrupted statement pairs (6,052 statements) drawn from arXiv papers spanning 2010–2025. We fine-tuned DeepSeek-R1-8B with GRPO under a rule-based, zero-API reward for 189 steps on four H100 GPUs. On a balanced 200-true/200-false held-out split, balanced accuracy rises from 29.50% to 63.75% and the discrimination gap—the difference between the rate of calling false statements false and the rate of calling true statements false moves from -0.5% (z=-0.1) to +27.5% (z=+6.0). Critically, the gain is not purchased with general mathematical ability: AIME 2026 accuracy under official semantics is 65.00% against a 69.17% base, a difference of -4.17% that is not statistically significant, whereas an earlier run of the same recipe on a smaller GraphSynth corpus collapsed to 40.00%. Median response length also falls from 19,217 to 18,296 tokens and the truncation rate from 25.8% to 8.3%, so the improvement does not come from thinking longer. We report the result together with the confounds that bound its interpretation, principally the all-false composition of the official evaluation sets and the low precision implied at realistic error prevalence.

[172] SoK: Formal Methods for Fact-Checking and Information Integrity cs.CL | cs.CY | cs.LOPDF

Nikolaos Kekatos, Theodoros Nestoridis, Charalampos Bratsas, Charalampos Dimoulas, Georgios Konstantinidis

TL;DR: 这篇综述按形式化对象而非流程阶段整理事实核查与信息完整性研究，并指出系统自身验证仍明显不足。

Details

Motivation: 自动事实核查通常只输出真假标签，缺少裁决依据、反事实条件及改写后的一致性等可审计保证。

Result: 对121篇工作分类后发现，形式化工具虽已存在却很少用于事实核查；核查系统自身的形式验证缺口最大，专业核查中的主张规范化和已发布裁决更正也缺少明确正确性标准。

Insight: 作者将形式化层级划分为主张、推理、核查系统、传播生态和监管义务，并把可追溯的保证依据作为判定之外的独立证据。

Abstract: An automated fact-checking system returns a label: the claim is true, or it is false. In many such systems the verdict remains the primary output. What is generally missing is a record of which document settled the question, of what would have had to be different for the verdict to change, or of whether the same claim, reworded, would have been judged the same way. We call the missing piece a warrant: a separate statement of what was guaranteed and on what grounds. Formal methods produce evidence of this kind, and regulation is beginning to ask for it, since the Digital Services Act and the AI Act both call for auditable evidence about how systems behave. Surveys of automated fact-checking are usually organised by pipeline stage, and treat logic as one technique among many. We organise the field by what is being formalised instead, which gives five levels: the claim, the reasoning, the system doing the checking, the ecosystem the claim spreads through, and the regulatory obligation. Sorting 121 works into those levels, two patterns stand out. Most of the relevant formal machinery already exists, but it was built for other domains and has rarely been applied here, and the gap is widest for verifying the checking system itself. Several stages of the routine professional fact-checkers follow also have no stated correctness criterion, and two of them, writing a claim in checkable form and correcting a verdict already published, are not formally specified in any work we coded. We close with open problems, each with a suggested first step.

Chenxiao Li, Yunhe Feng, Dongfang Liu, Dong Nie, Yan Huang

TL;DR: RA-MMEA估计多模态实体对齐中图像的可靠性，并在图像不可靠时依据文本语义生成替代视觉表征。

Details

Motivation: 直接融合图像与其他模态会忽视图像噪声及其与实体语义错位，可能损害跨知识图谱实体对齐。

Result: 论文报告RA-MMEA在多项实验中达到最先进结果，验证可靠视觉模态对实体对齐的重要性。

Insight: 依赖感知的视觉可靠性预测利用实体内部多模态依赖评估图像；稳定性正则的视觉嵌入生成则用文本语义构造替代视觉表示，再用于融合。

Abstract: The visual modality, i.e., images, plays a key role in multi-modal entity alignment (MMEA). Existing approaches often directly fuse the image with other modalities to align different entities. Although simple, such strategies overlook the potential noise in the images and their semantic misalignment with corresponding entities, resulting in suboptimal fusion and degraded performance. Addressing this, we propose a novel Reliability-Aware framework for MMEA (RA-MMEA), which assesses visual reliability and adaptively improves unreliable visual representations for robust entity alignment. The core lies in two modules, including dependency-aware visual reliability prediction (DA-VRP) and stability-regularized visual embedding generation (SR-VEG). The former aims to estimate the reliability of an image by leveraging multi-modal dependency within the entity, while the latter focuses on producing alternative visual representation conditioned on semantics encoded in textual modalities for multi-modal fusion. Compared to current methods, RA-MMEA enables more reliable visual representations for modality fusion, thereby improving performance. In extensive experiments, RA-MMEA achieves state-of-the-art results, verifying the importance of reliable visual modality for entity alignment and the effectiveness of RA-MMEA. The code and results will be released.

[174] Machine-Interpretable Information: Compiling Documents into Searchable and Readable Protocol States cs.CL | cs.LGPDF

Yifan Wang, Dejing Dou

TL;DR: 提出机器可解释信息协议，将长文档编译成可跨模型传递的固定带宽状态，兼顾检索、推理记忆与细节重建。

Details

Motivation: RAG索引虽能用向量检索，但模型仍需重新读入长文本；现有压缩状态又常绑定特定模型架构，限制复用。

Result: 56-token文档状态可在Llama、Qwen、Mistral等异构模型间转换；Residual-MII在HotpotQA上以约7%的注意力FLOPs超过全上下文精确匹配。

Insight: Writer把文档编译为模型无关状态，轻量Translator映射到冻结Reader；若需恢复词面细节，再通过稀疏局部证据补足全局记忆。

Abstract: Long-context language models interface with external knowledge through raw natural language. In retrieval-augmented systems, this creates a persistent index-payload schism: dense vectors enable searchable routing, but models must re-ingest lengthy text payloads for reasoning at O(N^2) attention cost. Existing compression methods further produce private states tied to specific architectures. We introduce Machine-Interpretable Information (MII), the first agent-to-agent (A2A) document-to-state protocol. A dual-timescale state-space Writer compiles documents into a canonical, fixed-bandwidth state (56 tokens), and a lightweight Translator maps it into any frozen Reader’s embedding space, reducing query-time cost to O(K). The resulting .mii artifact unifies Retrieval (searchable geometry), Reasoning (global memory), and Reconstruction (grounded details) in a single transferable medium. We demonstrate strong cross-model interoperability across heterogeneous LLMs (e.g., Llama, Qwen, Mistral) – despite the Writer using a legacy GPT-2 vocabulary, forcing genuine semantic translation rather than token-level memorization. Mechanistic probes reveal modular latent structure: entity representations can be causally traced and zero-shot transplanted between unrelated document states while remaining decodable. To address lexical reconstruction under fixed bandwidth, we propose Residual-MII, a cache hierarchy combining compiled global memory with sparse local evidence. On HotpotQA (7,405 queries), Residual-MII exceeds full-context Exact Match at approximately 7% of the attention FLOPs, suggesting a paradigm shift toward compiled, transferable neural document formats.

[175] RPMem: Learning Long-Term Recurrent Parametric Memory Across Sessions for LLM Agents cs.CL | cs.AIPDF

Fanyu Zhao, Ruike Cao, Liang Dong, Fugen Yao, Jian Xu

TL;DR: RPMem将每轮交互编译为模型无关的潜在记忆，并跨会话递归整合，再映射成可迁移的模型适配参数。

Details

Motivation: 文本记忆每次查询都要检索和重读历史，长程效果逐渐受检索质量制约；既有参数化记忆又难以跨会话演化或更换骨干。

Result: 在三个长期记忆基准和五种骨干上表现具泛化性且更新成本近似恒定；Qwen3-8B在PERMA上达85.52%，高于最强参数化和文本基线5.32及12.98个百分点。

Insight: 两阶段设计先编译会话，再由任务训练的递归门控选择性整合保留记忆，最终映射为LoRA参数；消融验证了编译与跨会话整合的互补作用。

Abstract: Long-running LLM agents require memory that persists and evolves across sessions. Text-based memory retrieves and reconstructs past interactions at every query, making long-horizon performance increasingly dependent on retrieval quality and contextual reasoning as histories grow. Parametric memory encodes experience directly into model computation, but existing approaches provide limited support for cross-session memory evolution. Their coupling to a specific backbone further restricts memory reuse after model replacement. We introduce RPMem, a two-stage architecture that compiles each session into a model-independent latent memory through forward computation and selectively integrates it with retained memory via a task-trained recurrent gate. The consolidated memory is then mapped to backbone-specific low-rank adaptation (LoRA) parameters, allowing the encoding capability to transfer when the backbone is replaced. Evaluation across three long-term memory benchmarks and five diverse backbones demonstrates broad generalization with near-constant update cost and memory footprint. With Qwen3-8B on PERMA, RPMem reaches 85.52%, outperforming the strongest parametric and text-based baselines by 5.32 and 12.98 percentage points, respectively. Ablations validate the complementary roles of session compilation and cross-session consolidation, while dynamics analyses reveal that the gate acquires task-specific memory integration strategies. These results establish RPMem as a lifecycle-independent parametric memory framework that maintains evolving cross-session memory that remains reusable across backbone replacements. Our implementation is available at https://github.com/Quark-Medical/rpmem/tree/main.

[176] Error-Supervised Synthetic Learner Writing for Automated Essay Scoring cs.CLPDF

Duy Anh Nguyen

TL;DR: 在合成作文生成器上加入错误标注监督，使生成文本更接近语言学习者的真实写作，再用于自动作文评分。

Details

Motivation: 合成作文能减少对人工作文数据的依赖，但通常缺少真实错误，难以模拟语言学习者文本。

Result: 较大数据设置中，该方法在12组数据集—指标比较的11组胜过常规合成基线，部分接近真实作文训练结果；极低资源场景收益不稳定。

Insight: 用语法错误检测任务中的标注文本微调作文生成器，可使合成错误分布大体接近真实学习者；明显优势通常要到约200篇训练作文才出现。

Abstract: Synthetic essays can help reduce dependence on human-written data in Automated Essay Scoring (AES). However, they often lack realistic errors, limiting their ability to represent authentic human writing, particularly when the target texts are intended to resemble those produced by language learners. In this study, we present a simple approach that introduces error supervision into synthetic essay generation. Specifically, we fine-tune an LLM generator on error-annotated texts of the kind commonly used in Grammatical Error Detection (GED). To assess the utility of the proposed approach, we fine-tune and evaluate AES scorers under three data conditions: authentic essays, synthetic essays generated conventionally, and synthetic essays generated using our proposed approach. The results show that in the larger-data settings, the proposed approach outperforms the conventional synthetic baseline in 11 out of 12 dataset-metric comparisons, with performance in some cases approaching that of models trained on authentic essays. Despite these gains, performance under extremely low-resource settings remains mixed, with advantages over the conventional baseline only becoming more apparent at 200 training essays, although not consistently across datasets. Qualitative and quantitative analyses further show that the proposed approach produces learner-like errors whose distributions broadly resemble those observed in authentic essays.

[177] On the Efficiency-Safety Dilemma in Large Reasoning Models cs.CL | cs.AIPDF

Yifei Yang, Zouying Cao, Xingrui Wang, Xiao Zhou, Yuexian Li

TL;DR: 分析量化和剪枝如何同时影响大型推理模型的推理能力与越狱脆弱性，指出表面安全提升可能来自能力退化。

Details

Motivation: 压缩技术可降低推理成本，但其对模型对抗鲁棒性的影响尚不清楚，攻击成功率下降也未必代表安全对齐增强。

Result: 研究发现部分效率方法虽降低越狱攻击成功率，主要原因却是推理能力退化导致恶意响应尝试失败；量化结合剪枝被识别为效率与鲁棒性的较佳折中。

Insight: 要区分真正拒绝有害请求与失去完成请求能力，需结合表示漂移及恶意语义轨迹分析；单看攻击成功率会高估安全改善。

Abstract: Large reasoning models (LRMs) incur high inference costs, often mitigated by efficiency techniques like quantization and pruning. However, the impact of these techniques on model adversarial robustness remains largely unexplored. This study provides the first comprehensive analysis of the interplay between efficiency, jailbreak vulnerability, and reasoning in LRMs. We find that while efficiency methods seemingly reduce the success rate of jailbreak attacks, this improvement is often superficial. It largely arises from degraded reasoning capabilities leading to “attempted but failed” malicious responses, rather than an increase in genuine alignment. Mechanistic analysis of representational drift confirms this, revealing a strict coupling between reasoning capability loss and the model’s inability to maintain malicious semantic trajectories. Additionally, we identify quantization with pruning as the optimal strategy to balance efficiency and robustness. These findings clarify the distinction between true safety alignment and capability-induced failure, providing an empirical foundation for LRM deployment.

[178] Distill What You Trust: Reliability-Aware Multi-Teacher On-Policy Distillation cs.CL | cs.LGPDF

Jie Sun, Mao Zheng, Mingyang Song, Zeyuan Liu, Gengsheng Li

TL;DR: TrustMOPD在学生生成过程的每个token位置动态分配多位教师的蒸馏权重，不依赖样本级领域标签。

Details

Motivation: 按样本选定单一教师无法适应一段回答中不断变化的专长需求，也依赖混合语料常缺少的领域标签。

Result: 在数学、代码和指令跟随任务中，TrustMOPD优于最强无标签基线；SingleCap恢复率从54.4%升至91.5%，MultiCap从54.5%升至98.0%。

Insight: 用各专家相对共同RL前模型的局部策略位移估计可靠性，再跨教师校准并形成加权目标；打乱token权重后收益消失，支持按生成上下文条件化分配。

Abstract: Multi-teacher on-policy distillation allows a student to learn from complementary specialists on its own trajectories. Domain-routed approaches, however, select one teacher per example and keep it fixed throughout the response. This design both depends on labels that mixed training corpora often lack and cannot adapt teacher selection when the expertise required changes within a trajectory. We propose \textbf{TrustMOPD}, which replaces example-level teacher selection with label-free, token-level supervision allocation. At each student-generated prefix, TrustMOPD uses each specialist’s RL-induced displacement from a shared pre-RL reference as a proxy for local reliability, calibrates these scores across teachers, and constructs a weighted distillation target. Across mathematics, code, and instruction following, TrustMOPD outperforms the strongest label-free baseline, increasing the recovery ratio from $54.4%$ to $91.5%$ on \textsc{SingleCap} and from $54.5%$ to $98.0%$ on \textsc{MultiCap}, while approaching label-based MOPD on \textsc{SingleCap}. Randomizing token-level weights independently of the student-generated prefix performs no better than uniform weighting, supporting the importance of conditioning supervision on the evolving generation context.

[179] Financial Language Models as Applied Artificial Intelligence Systems for News-Based Trading under Market Frictions cs.CL | cs.LG | q-fin.TRPDF

Kemal Kirtac

TL;DR: MFAST提供面向真实市场摩擦的金融语言模型新闻交易评估框架，将带时间戳文本转为可审计、可复现的交易决策。

Details

Motivation: 既有金融AI研究分散在预测、文本分类和市场建模等方向，缺少同时评估信息可见时间、校准、交易成本、流动性、容量和运维开销的部署协议。

Result: 在样本外和公开复现实验中，decoder-only语言模型在分类、校准、收益预测及净组合表现上优于encoder基线和词典情感法；同时呈现准确率、延迟、内存、吞吐与推理成本之间的权衡。

Insight: 将新闻关联证券并限定模型知识时效之外的新发布信息，再结合市场摩擦和可复现验证；可信结论需要贯通语言理解、时间纪律和可执行交易。

Abstract: Financial language models can transform unstructured firm-specific news into structured decision signals, but financial AI research lacks an integrated deployment framework for evaluating whether those signals remain useful in financial decision systems. Computer science research has developed strong methods for time-series forecasting, text classification, multimodal stock prediction, graph-based market modeling, and machine-learning operations, yet these streams do not provide a domain-specific protocol that jointly tests financial language-model outputs under event-time observability, probability calibration, execution timing, transaction costs, liquidity constraints, capacity limits, operational diagnostics, and statistical inference. We introduce MFAST, a Market-Friction-Aware Sentiment-to-Trading framework that converts timestamped financial text into auditable, reproducible, and market-feasible trading decisions. The application is news-based trading, where firm-specific text must be linked to securities before portfolio decisions can be evaluated. The framework links Refinitiv News Analytics to Center for Research in Security Prices (CRSP) equity data, restricts the primary out-of-sample evaluation to post-release news outside disclosed foundation-model data-freshness periods, and adds a public replication arm using open financial text and public price data. Results show that decoder-only language models outperform encoder baselines and dictionary sentiment in classification, calibration, return prediction, and net portfolio performance, while operational diagnostics reveal trade-offs among accuracy, latency, memory, throughput, and inference cost. The paper shows that credible evaluation of financial language models requires an end-to-end engineering approach combining language understanding, temporal discipline, market-friction-aware deployment, and reproducible validation.

[180] STEVE: Stabilizing Textual Gradient-Based Prompt Optimization via Error-Driven Refinement and Regularized Verification cs.CL | cs.AI | cs.LGPDF

Yifan Xu, Yixuan Li, Xinzhuo Li, Yixin Gu, Yifan Shen

TL;DR: STEVE以错误驱动提示更新和正则化验证，降低文本梯度式提示优化迭代不稳定及对难例过拟合的问题。

Details

Motivation: 已有方法会从已答对样本产生噪声梯度，也可能过度迎合困难案例而损害简单输入表现。

Result: 在十个推理基准、三类评估器/优化器及额外较新模型实验中，STEVE减少性能退化并得到更稳健的提示。

Insight: 只用处理错误的样本生成更新建议，并把每次更新视为待检验候选；若困难样本进步导致保留集出现不可接受退化，就拒绝该更新。

Abstract: Textual-gradient methods automate prompt optimization through natural-language feedback, but their iterative updates can be unstable. We identify two sources of this instability: noisy gradients produced from already-correct examples and over-specialization to hard cases that degrades performance on simpler inputs. We introduce STEVE, a stabilization framework with two coupled mechanisms. Error-Driven Refinement generates gradients only from incorrectly handled examples, concentrating updates on informative failures. Regularized Verification treats every update as provisional and accepts it only when improvement on hard cases does not cause unacceptable regression on a preservation set. Across ten reasoning benchmarks, three evaluator/optimizer models, and established prompt-optimization baselines, STEVE reduces degradation and produces more robust prompts. Additional evaluations with gpt-5.4-mini/gpt-5.4 on symbolic reasoning, GSM8K-Platinum, and DS-1000 show that these gains persist with newer models and larger test sets. STEVE therefore provides a practical way to improve the stability and effectiveness of textual-gradient prompt optimization.

[181] GRACE: Grounded Adversarial Reasoning over Canadian Law cs.CL | cs.AIPDF

Jiakang Xu, Wantong Huo, Udom Silparcha, Jonathan H. Chan

TL;DR: GRACE构建加拿大联邦法律的对抗式法律推理数据集，并探索轻量模型在给定法条时进行有据推理。

Details

Motivation: 法律基准较少检验模型能否提出并辩护立场、处理信息不完整情形或综合多条法条，加拿大法律在法律NLP中也代表不足。

Result: 数据集含1,915组问题—推理—答案，覆盖对抗论证、不确定性和应用推理；CLeAR-4B在提供相关法条时更贴近教师输出且引用更规范，未提供法条时依据性明显下降。

Insight: 数据流程切分法条、生成场景问题与推理，并用无模型引用核验和模型质量审查筛选；结果凸显法律推理对可用法规上下文的依赖。

Abstract: Large language models have shown strong performance across a range of legal tasks, but existing benchmarks rarely evaluate the ability to take and defend a legal position, reason under incomplete information, or synthesize multiple statutory provisions. This gap is particularly pronounced for Canadian law, which remains underrepresented in legal NLP. We introduce GRACE (Grounded Reasoning Adversarial Canadian LEgal examples), a dataset of 1,915 question-reasoning-answer instances grounded in Canadian federal legislation. GRACE covers three reasoning modes: adversarial advocacy, uncertainty, and applied reasoning. We develop a pipeline that partitions raw statutory text, generates scenario-based questions and reasoning, and filters examples through model-free citation verification and LLM-based quality auditing. As a proof of concept, we fine-tune CLeAR-4B (Canadian Legal Adversarial Reasoning), a lightweight model for grounded legal reasoning, and evaluate it against the unmodified Qwen3-4B base model in open- and closed-book settings. CLeAR-4B substantially improves agreement with teacher outputs and statutory citation behavior when the relevant act text is provided, while its grounding degrades sharply when the statute is withheld. These results suggest that GRACE can support the development of lightweight legal models that reason more effectively from supplied statutory text.

[182] FLARE: A Full-Lifecycle Dense Supervision Paradigm for Long-Horizon Coding Agents via Generative Reward Model cs.CL | cs.AIPDF

Jingxuan Xu, Gang Wu, Yanan Wu, Yutao Mou, Songwei Yu

TL;DR: FLARE用生成式奖励模型为长程编码智能体提供全生命周期的逐步监督、风险反馈和失败恢复。

Details

Motivation: 长程软件工程任务常只有通过或失败的稀疏奖励，难以分配功劳和利用失败轨迹；现有扩展方式缺少因果诊断或及时可操作反馈。

Result: 推理时FLARE单次采样优于五次全局采样，token消耗减少5倍；训练阶段，过程感知数据筛选使SFT相对提升19.13%，RL稳定提升9.19%。

Insight: RADAR从轨迹中回溯因果链，为轻量奖励模型生成无事后信息的步骤监督；推理时只拦截高风险步骤局部重跑，训练时用于重排、SFT和密集RL奖励。

Abstract: While test-time scaling enhances Large Language Model (LLM) agents in long-horizon software engineering (SWE), sparse binary rewards (Pass/Fail) create a severe credit assignment crisis and waste failed exploratory trajectories. Current trajectory optimization and scaling methods are costly and structurally limited, relying on heuristic state reuse without causal diagnosis or delayed scalar scoring without actionable online guidance. We propose FLARE (Full-Lifecycle Alignment and Reward Engine), a novel dense supervision paradigm driven by a lightweight Generative Reward Model (GRM). First, RADAR, an offline causal-aware diagnostic framework, extracts high-fidelity, hindsight-free supervision through causal-chain backtracking to distill a GRM providing real-time, step-level risk feedback. Second, FLARE uses this GRM to continuously optimize the agent across its entire lifecycle. During inference, FLARE acts as an Active Scaffold, autonomously intercepting high-risk generation steps for localized breakpoint re-execution, drastically reducing compute overhead. During post-training, the GRM’s structured signals serve as process-supervised reranking scores for Supervised Fine-Tuning (SFT) and step-level dense rewards for Reinforcement Learning (RL), mitigating policy collapse in sparse environments. Extensive evaluations show that FLARE establishes a new Pareto frontier across the agent lifecycle: FLARE (N=1) outperforms Global Rollout (N=5) with a 5x reduction in token consumption. Extending FLARE to training overcomes the sparse reward problem in long-horizon interactive tasks, delivering relative performance gains of 19.13% in SFT through process-aware data curation and a consistent 9.19% improvement in RL.

[183] XYEval: Agents say yes to bad advice cs.CLPDF

Zhengxuan Wu, Yuxuan Li, Oyvind Tafjord, Been Kim

TL;DR: XYEval评估智能体面对用户提出的错误解决方案时，能否识别真实问题并解释为何不应照做。

Details

Motivation: 用户有时会询问自己尝试的方案而非根本需求；现有谄媚评估较少考察智能体在交互式任务中抵抗这种误导的能力。

Result: 五个模型、六类基准中，XY问题变体令性能相对下降最高达46.7%；要求先详细解释再批准更优方案的吹毛求疵用户会造成更大降幅，简单提示只能部分缓解。

Insight: XYEval可把既有基准转成问题变体评估；轨迹分析表明系统不仅要发现建议误导，还需清楚说明背后的真实问题。

Abstract: Effective communication between users and AI agents is essential for human-AI collaboration. The XY problem is a well-known communication pitfall where a person asks about their attempted solution rather than their actual problem. We extend prior sycophancy evaluation to the XY problem in agentic settings, evaluating whether agents can resist plausible but misleading suggestions from users and communicate their reasoning. We introduce XYEval, a meta-evaluation framework that can transform an existing benchmark into an XY problem evaluation. We evaluate five models across six diverse benchmark suites. Agents suffer large XY drops under XY mutation across benchmarks, with relative drops reaching up to 46.7%. With $τ^2$-bench, we further show that agent performance drops more when encountering a pedantic user who requires detailed explanations before approving a better solution. Our findings suggest that current agents lack the ability to effectively reason and communicate when facing misleading suggestions. A simple system instruction baseline that encourages awareness of XY problems only offers partial mitigation. Extensive trace analyses provide behavioral insights into how and why these XY drops occur across execution trajectories. Our results show that mitigating the XY problem remains challenging, requiring agents to both recognize user misdirection and clearly communicate the underlying problem.

[184] Efficient Reasoning Exploration via State-Conditioned Latent Steering with Progress Guidance cs.CLPDF

Hengyuan Zhang, Chenming Shang, Zunhai Su, Xiao Liang, Hui Shen

TL;DR: SPS是一种免训练潜变量引导方法，按当前推理状态选择方向向量，推动语言模型探索更有进展的推理分支。

Details

Motivation: Best-of-N增加采样预算时，多个独立推理轨迹常重复相似路径；仅扩大探索范围又未必能导向有意义的后续步骤。

Result: 在多种模型规模与基准上的实验中，SPS持续优于强基线；摘要未给出具体数值。

Insight: 方法为不同前缀状态区域建立进展引导方向库，并在高不确定转移处检索适用方向进行在线干预，无需训练。

Abstract: Best-of-$N$ is a widely used inference strategy for complex reasoning, whose effectiveness depends on whether sampled candidates can cover diverse and high-quality reasoning paths. However, post-trained reasoning models often suffer from \emph{exploration collapse}, where independent rollouts repeatedly follow similar reasoning paths and limit the gains from increasing the rollout budget. Existing methods alleviate this issue by promoting broader exploration, but do not explicitly guide exploration toward continuations that make meaningful progress, resulting in limited exploration efficiency. To address this, we propose \emph{\underline{S}tate-conditioned \underline{P}rogress-guided \underline{S}teering} (SPS), a training-free latent steering framework. Specifically, SPS constructs a state-conditioned Direction Bank containing multiple progress-guided steering vectors for different prefix-state regions. During online inference, SPS retrieves a suitable steering vector based on the current prefix state and applies it at high-uncertainty transitions to guide the next reasoning step toward meaningful progress. Extensive experiments across multiple model scales and benchmarks demonstrate that SPS consistently outperforms strong baselines. Further analyses validate the effectiveness of its key designs and offer valuable insights for future research. The code is available at https://github.com/rattlesnakey/SPS.

[185] From Content Generation to Learning Support: Pedagogy-Guided Generative Video Tutors for STEM Learning cs.CL | cs.AI | cs.CYPDF

Xinchen Ma, Shuimu Wang, Gaole He, Yanbin Zhang, Chunyang Wang

TL;DR: PIVOT将教学法贯穿STEM教学视频生成、质量核验、学习评估和误解纠正，而不只优化视频内容生成。

Details

Motivation: 现有生成式教育视频偏重画面连贯，常缺少教学结构、可靠质控以及检查学习者理解和纠正误区的机制。

Result: 四个STEM领域的实验与专家评价显示，生成视频内容符合教学目标、呈现清晰且有吸引力、教学流程连贯，并被认为有助于学习；摘要未列具体量化指标。

Insight: 框架先按教学原则生成分镜，再以代码为中心的流程制作并用教学核验工具检查多模态视频，最后连接学习评估与针对误解的补救教学。

Abstract: Generative AI enables scalable production of educational videos, but current systems largely focus on producing visually coherent content rather than supporting learning. As a result, generated videos often lack explicit pedagogical structure, reliable quality control, and mechanisms for assessing learner understanding or addressing misconceptions. In this work, we introduce PIVOT (Pedagogy-guided Instructional VideO Tutoring), a generative video tutoring framework for STEM learning via learning-centered instructional support.1 Inspired by conventional teaching workflows, our framework integrates pedagogy into the full generation pipeline: it first uses instructional principles to guide storyboard generation, then produces verified multimodal videos through code-centric generation and a pedagogical verification harness, and finally connects videos with assessment and misconception-aware remediation. Experiments and expert evaluations across four STEM domains show that our framework produces educational videos with pedagogically aligned content, clear and engaging presentation, coherent instructional flow, and perceived effectiveness for learning. These findings suggest a human-centered perspective on educational content generation: generative systems should be evaluated and designed not only by what they produce, but also by how they support teaching practices, learner understanding, and corrective feedback.

[186] Efficient LLM Distillation for Bangladesh Legal Context: A Smartphone-Compatible Retrieval-Augmented Generation Model cs.CLPDF

MD. Nafis Kamal, Mahadi Hasan Fahim, Talha Ridwan, Nadifa Zaman, Fariha Roushon Florin

TL;DR: 将9B教师逐步蒸馏到可在手机离线运行的2B模型，并结合混合检索回答孟加拉国成文法问题。

Details

Motivation: 法律文本仅有英文版本、律师集中于城市且网络不稳定；法律幻觉危害大，因此研究聚焦可离线访问的成文法解释，不覆盖判例推理。

Result: 50条英文测试上ROUGE-L为0.4715、BERTScore F1为0.5679，较未蒸馏RAG基线提升103%和143%；Pixel 6断网时以每秒4至8 token运行，孟加拉语查询及律师小规模评审也显示可用性。

Insight: 先对质量筛选的问答对监督微调，再匹配教师每token前50个logit进行稀疏KL蒸馏；回答通过稠密检索与BM25混合搜索36,029条法条文本。

Abstract: Legal information in Bangladesh is inaccessible to most citizens. Statutory text is English-only, trained lawyers are concentrated in urban centres, and cloud-dependent AI fails where mobile connectivity is unreliable, a setting in which hallucinated legal text causes direct harm. The system addresses statutory interpretation only; queries that require judicial precedent or case-law reasoning fall outside its scope. We target the statutory access gap by compressing a 9-billion-parameter Gemma-2 teacher into a 2-billion-parameter student through two-phase progressive knowledge distillation. Phase 1 performs supervised fine-tuning on 9,429 quality-gated legal question-answer pairs (65% acceptance from 14,514 generated queries); Phase 2 minimises sparse Kullback-Leibler divergence against the teacher’s top-50 per-token logits at temperature tau = 4.0, implemented via QLoRA (4-bit NF4, rank-32 LoRA adapters). Prior legal language models target general legal English; this system specialises in Bangladeshi statutory law. Every response is grounded through hybrid retrieval combining dense semantic search (60%) and BM25 (40%) across 36,029 statutory passages from the Bangladesh Constitution and national legislation. On a 50-query English benchmark, the distilled model reaches ROUGE-L 0.4715 and BERTScore F1 0.5679, a 103% ROUGE-L and 143% BERTScore gain over the retrieval-augmented undistilled baseline (ROUGE-L 0.2323, BERTScore 0.2340). The adapter quantises to 1.6 GB (GGUF Q4_K_M) and runs at 4-8 tokens per second on a Pixel 6 with no network access. Cross-lingual evaluation on 50 Bangla queries yields ROUGE-L 0.4083 and BERTScore 0.8133, showing effective retrieval from Bangla input against an English-only corpus. In a single-evaluator pilot, a practising lawyer rated 50 responses at a weighted mean of 4.16/5 (90% rated 4 or 5), supporting utility beyond text-overlap metrics.

[187] TAC-Time: Texts as Channels For Multimodal Time Series Forecasting cs.CL | cs.AI | cs.LG | cs.MMPDF

Jiayi Liang, Xiaotian Gu, Xinyu Xie, Yuanbin Wu, Xiaoling Wang

TL;DR: TAC-Time把辅助文本转成额外时间序列通道，与数值序列在共享时序骨干中联合建模。

Details

Motivation: 纯数值预测忽略上下文文本；已有多模态方法常把文本当静态特征或用大型语言模型作预测骨干，难捕捉动态且成本较高。

Result: 在真实世界多模态基准上，TAC-Time优于先前方法；注意力与频域分析显示较强跨模态依赖，并发现经相关性对齐的文本信号可带来部分预测收益。

Insight: 将文本特征作为附加时间通道，有助于保留时间连续性和周期结构，同时维持效率和可扩展性，也支持系统的可解释性分析。

Abstract: Most existing time series forecasting methods rely solely on numerical observations, overlooking rich contextual information from auxiliary texts. Recent multimodal approaches attempt to incorporate textual signals, but they often treat text as static features or use large language models as forecasting backbones, limiting their ability to capture temporal dynamics and increasing computational cost. To address these challenges, we propose TAC-Time, a unified framework that transforms textual information into additional temporal channels. By modeling text features jointly with numerical sequences in a shared temporal backbone, TAC-Time preserves temporal continuity and periodic structures while remaining efficient and scalable. This formulation also enables systematic interpretability analyses. We show strong cross-modal dependencies through attention and frequency-domain analyses, and identify predictive textual signals whose correlation-aware alignment yields partial forecasting improvements. Extensive experiments on real-world multimodal benchmarks demonstrate that TAC-Time outperforms prior methods.

[188] LoopCD: Loop-wise Contrastive Decoding for Improving Reasoning in Looped Language Models cs.CLPDF

Byeongho Yu, Junhyuk So, Eunhyeok Park

TL;DR: LoopCD利用循环语言模型不同迭代轮次的logit差异，对不确定的关键词元作对比解码以增强推理。

Details

Motivation: 循环模型以共享权重反复精炼隐表征，但迭代不稳定会产生局部困难词元，可能引发推理错误。

Result: 多种近期代表性循环语言模型在不同推理任务上均因该方法获得改善，推理开销仅有可忽略的增加。

Insight: 比较早期迭代与最后精炼迭代的logit并合成最终采样分布，可在不训练模型的前提下重点修正对推理影响较大的困难词元。

Abstract: Looped Language Models (LoopLMs) perform “latent reasoning” by recursively refining internal latent representations with shared weights, offering a more effective alternative to explicit verbal reasoning. Despite their effectiveness, we find that LoopLMs remain prone to loop instability: unstable refinement across iterations can produce localized uncertain “hard” tokens associated with reasoning errors. To address this, we propose LoopCD, loop-wise contrastive decoding that enhances the reasoning performance of LoopLMs by intervening on these tokens at inference time. Specifically, we exploit the internal dynamics of LoopLMs and contrast the logits from earlier iterations with logits from the last refined iteration to form the final sampling distribution. We find that this strategy is highly efficient, introducing only negligible inference overhead and requiring no additional training, while effectively improving reasoning performance by naturally refining reasoning-critical hard tokens. Extensive experiments show that our method improves the performance of recent representative LoopLMs across various reasoning tasks.

[189] Taramandal-GPT: Enhancing Astrodynamics Problem-Solving with Knowledge Retrieval and Structured Thinking cs.CL | cs.AIPDF

Akhil Sharma, Jatin Gupta, Ali Imam Abidi

TL;DR: Taramandal-GPT以Qwen3-8B为基础，结合检索增强和回退机制处理天体力学多步问题。

Details

Motivation: 通用大语言模型在天体物理等专业领域受多步推理、符号操作和领域术语限制，专门领域应用仍不可靠。

Result: 在含299题的APBench上，结合数值容差和语义相似度评估，模型与先进开源及闭源系统相比表现有竞争力，思考密集题目表现突出。

Insight: 领域适配模型把检索上下文与结构化思考相结合，并通过回退机制提升上下文精确度，目标是支持天体物理和航天工程等任务。

Abstract: Large language models (LLMs) have shown remarkable progress in natural language understanding, yet their effectiveness in specialized fields like astronomy and astrodynamics remains limited due to challenges in multi-step reasoning, symbolic manipulation, and domain-specific terminology. To address this, we present Taramandal-GPT (Constellation-GPT), a domain-adapted framework built on the Qwen3-8b backbone, enhanced with a Retrieval-Augmented Generation (RAG) pipeline and a fallback mechanism for improved contextual precision. We evaluate it on the Astrodynamics Problems Benchmark (APBench), a dataset of 299 questions covering foundational to advanced levels of space science. Using a dual evaluation method - numeric margin-based scoring and semantic similarity assessment - Taramandal-GPT achieves competitive performance against state-of-the-art open- and closed-source models, with notable strength in thinking-intensive tasks. These results highlight the value of specialized LLMs for domains demanding accuracy and interpretability, positioning Taramandal-GPT as a step toward reliable Artificial Intelligence (AI) assistants for astrophysics, spacecraft engineering, and space exploration.

[190] Mitigating Entity Type Confusion in Cross-Domain NER via Multidimensional Quantification and Reasoning Enhancement cs.CL | cs.AIPDF

Jingyu Wang, Shijie Wu, Fusheng Jin

TL;DR: 通过量化实体类型混淆并生成双向分阶段推理，改善跨领域命名实体识别的类型判定和泛化。

Details

Motivation: 跨领域NER已有方法能较准确识别实体跨度，但仍容易把一种实体误分到语义相近的错误类别。

Result: 在CrossNER各领域均取得新的最佳结果，摘要未列具体分数。

Insight: MCQM从源目标层级、语义相似度和显式数据评估三个维度刻画类别混淆；PBRC据此生成两阶段推理信息，补充模型的类型判别知识。

Abstract: Cross-domain Named Entity Recognition (CD-NER) aims to transfer the rich knowledge in the source domain to the target domain. Recent studies adopting decomposition or generation paradigms have achieved significant performance improvements, demonstrating high accuracy in entity span detection. However, during entity type classification, models severely suffer from entity type confusion, the erroneous tendency that models classify entities of one type in the text as another similar but incorrect type. To address this issue, we first propose a Multidimensional Confusion Quantification Model (MCQM) that quantifies a model’s confusion extent between entity types from three dimensions: source-target hierarchy analysis, semantic similarity analysis, and explicit data evaluation. Moreover, we propose the Progressive Bidirectional Reasoning Chain (PBRC). PBRC leverages the source-target hierarchy and confusion analysis from the MCQM to prompt the LLM to generate two-stage reasoning information. The two-stage reasoning information is utilized to augment the knowledge of the model, significantly mitigating entity type confusion and improving the model’s generalization performance. Experimental results demonstrate that our method achieves new state-of-the-art results on all domains of the CrossNER dataset.

[191] URA-NER: A Unified Retrieval-Augmented Framework with Retrieval Alignment and Uncertainty Reduction for Low-Resource NER cs.CL | cs.AIPDF

Jingyu Wang, Shijie Wu, Fusheng Jin

TL;DR: URA-NER结合分阶段检索、模型感知表征增强和推理路径对齐的知识核验，提升低资源命名实体识别。

Details

Motivation: 低资源NER的LLM上下文学习受示例检索错位和生成不确定性影响，较小模型在少样本条件下尤其退化。

Result: 在多个低资源NER数据集上显著改善模型表现，对较小LLM收益更明显，并在若干基准上取得新最佳结果。

Insight: 先按全局语义检索跨度识别示例，再按实体局部上下文检索类型示例；实体预识别改善查询与示例对齐，闭环生成—检索—核验则按模型推理路径整理外部证据。

Abstract: In-context learning (ICL) based on large language models (LLMs) has shown promising potential in alleviating performance bottlenecks caused by the limited availability of annotated data in Named Entity Recognition (NER). However, existing methods still face issues of retrieval misalignment and generation uncertainty, making their performance heavily dependent on the LLM’s capabilities. As the parameter scale of LLMs decreases, their performance in few-shot settings deteriorates significantly. In this paper, we propose a novel unified retrieval-augmented framework, URA-NER, including three key components: Progressive Granularity Retrieval (PGR), Model-aware Representation Enhancement (MaRE), and Reason-aware Knowledge Verification. PGR is a two-stage retrieval mechanism that achieves stage alignment. It first retrieves demonstrations for span detection based on the query’s global semantics, and then for type classification based on the specific entity context, providing fine-grained local information. Moreover, MaRE employs entity pre-recognition to guide the construction of representations, ensuring the query and demonstrations are aligned within the LLM’s semantic space and attention pattern. In addition, to mitigate generation uncertainty, we propose RaKV, a closed-loop “generation-retrieval-verification” process. It explicates the LLM’s reasoning paths, leverages them for the retrieval of external knowledge, and reorganizes the knowledge into verification evidence aligned with the original reasoning paths. We conduct extensive experiments on multiple low-resource NER datasets. Results demonstrate that URA-NER significantly enhances the performance of LLMs under low-resource settings, with particularly pronounced gains for smaller LLMs, achieving new state-of-the-art results on several benchmarks.

[192] Assessing Readability with LLMs: The Role of Reasoning and Few-Shot Prompting cs.CLPDF

Raphaël Thieffry, Matej Martinc

TL;DR: 系统比较开源大语言模型在英语和斯洛文尼亚语上的可读性等级评估，并分析推理提示与少样本示例的影响。

Details

Motivation: 传统可读性公式跨文体和语言泛化不足，监督模型又依赖稀缺标注；LLM虽可跨语言使用，提示策略的作用仍不清楚。

Result: 思维链和推理型模型优于直接作答；每类仅提供一个标注示例即可显著改善零样本结果，继续增加示例的边际收益递减。

Insight: 对教育框架需要的离散可读性等级，开箱即用的多语言LLM可作为有竞争力的评估器，尤其适用于低资源语言场景。

Abstract: Readability assessment is essential for tailoring texts to intended audiences across educational, healthcare, and information retrieval domains. However, traditional readability formulas struggle to generalize across genres and languages, while supervised machine learning models rely on scarce, domain-specific annotated corpora, limiting their applicability–particularly for less-resourced languages. Large Language Models (LLMs) offer a highly scalable, multilingual alternative that requires no task-specific training, yet the impact of advanced prompting strategies on their performance remains underexplored. In this paper, we conduct a systematic benchmark of diverse open-source LLMs for multilingual readability assessment, focusing on the prediction of discrete readability levels required by educational frameworks. In addition to English, we evaluate our approach on a less-resourced language, Slovenian, to establish whether LLMs remain effective in low-resource settings. Specifically, we investigate the influence of explicit reasoning, demonstrating that Chain-of-Thought (CoT) prompting and reasoning-oriented models yield significant improvements over direct answering. Furthermore, our exploration of few-shot in-context learning reveals that providing just one labelled example per category (1-shot) substantially enhances prediction quality compared to zero-shot settings, with additional examples offering diminishing returns. By comprehensively comparing these approaches against traditional unsupervised metrics and state-of-the-art supervised baselines, we establish the viability of out-of-the-box LLMs as robust, cross-lingual readability assessors.

[193] MSI-Bench: Evaluating Multi-Speaker Voice Interaction for Collaborative AI Agents cs.CLPDF

Chenxu Xiong, Dongming Shen, Yuzhi Tang, Wentao Ma, Mu Li

TL;DR: MSI-Bench评估语音智能体在多人多轮场景中的记忆、指令跟随和推理能力。

Details

Motivation: 会议、家庭和协作任务天然涉及多说话人，单人对话基准无法覆盖说话人身份关联及其决策挑战。

Result: 基准含中英文各576例；最强配置仅通过66.8%的英语和54.5%的中文全部评分项，最佳开源配置通过率分别为34.0%和19.3%。

Insight: 失败分析区分感知和推理：开源系统主要受多人音频前端限制，前沿模型在干净转录上仍难按说话人作决策，且常在无人对其说话时主动回应。

Abstract: Voice provides a natural and immediate interface for AI agents. Many settings in which voice agents could be useful, including meetings, households, and collaborative work, are inherently multi-speaker. Supporting these settings introduces challenges that are largely absent from one-on-one interaction. We introduce the Multi-Speaker Interaction Benchmark (MSI-Bench) for evaluating multi-speaker voice interaction. Each test case is a short multi-party multi-turn audio scene with participant context, expected tool calls, and atomic rubrics. The benchmark targets three capability families: multi-speaker memory, multi-speaker instruction following, and multi-speaker reasoning. It comprises 1,152 test cases, evenly split between Mandarin Chinese and English (576 each). The strongest configuration on each split passes all rubrics on only 66.8% of English and 54.5% of Mandarin cases, and the strongest open-weight configuration on 34.0% and 19.3%. Failure analysis separates perception from reasoning: open-weight models are bottlenecked by the multi-speaker audio front-end, while frontier systems still fail speaker-scoped decision making on clean transcripts—and models across the board often respond when no one has addressed them. These results identify speaker-grounded perception, speaker-scoped decision making, and conversational restraint as concrete targets for future voice agents.

[194] The Copy Ceiling: An Input-Exposure Control for Ontology-Grounded Generation over Curated Corpora cs.CL | cs.CYPDF

John J. O’Hare

TL;DR: 提出复制上限作为语料检索生成评估的输入暴露控制，区分模型推理收益与仅仅复制已展示答案。

Details

Motivation: 模型有语料图检索上下文后分数大幅提升，并不说明它推理了结构；检索内容可能已直接包含标准答案。

Result: 十个模型的无辅助召回均值0.26、检索后0.92，但相对逐字复制上限的增益全部为负；11,360条金标准观察中仅3条未暴露答案获词面计分，关系核验后均未成立。

Insight: 先判断上下文是否暴露金标准项目，再以直接复制可达召回作为免裁判参考；该控制可区分已暴露项目遗漏与超出暴露内容的恢复，但本身不能证明发生了推理。

Abstract: When a language model answers from a curated corpus via graph-based retrieval, a large grounding uplift does not establish reasoning over the retrieved structure: the context may already expose the gold answers. We propose exposure accounting, which classifies each gold item by whether the shown context exposes it and whether the answer recovers it. Its scalar reference is the copy ceiling, the recall a verbatim copy of the context achieves; signed gain over copy measures the model’s recall relative to this deterministic, judge-free baseline. Across ten models, unaided recall averages 0.26 and grounded recall 0.92, yet gain over copy is uniformly negative (-0.067 to -0.022). Of 11,360 gold-item observations, representing 1,136 target instances evaluated under ten models, only three unexposed items receive lexical credit. A stratified model-judged audit of 423 observations, with a symmetric quotation-verification policy, estimates that 97.1% of credited items assert the requested relation; all three unexposed credits fail relational adjudication. On targets the scaffold does not expose, lexical recovery falls from 0.121 unaided to 0.004 grounded; adjudication validates 71 of the 92 unaided credits and none of the three grounded credits, without establishing full-frame relational recovery rates. Rephrasing questions outside the graph’s title vocabulary reduces exposure from 0.964 to 0.328, while an absence-triggered fallback activates on only 2 of 506 questions. A paired production study improves judged quality by +0.27 pooled, but negative controls do not establish content specificity beyond a well-formed on-corpus block. These results support exposure accounting as a standing control for corpus-derived evaluations. The accounting distinguishes exposed-item omissions from beyond-exposure recoveries; it does not determine whether reasoning occurred.

[195] onPanda: Efficient Annotation of On-Policy Alignment Data for LLMs and Agents via Token-Level Correction cs.CL | cs.HC | cs.LGPDF

Lei Yang, Mengyin Liu, Jia Wang, Hangyu Guo, Liang Zhao

TL;DR: onPanda以逐token纠错方式让标注者交互修正模型响应及智能体轨迹，生成适用于在策略训练的细粒度监督。

Details

Motivation: 人工整段编辑回答费时，也会使最终训练样本偏离模型原本的采样分布。

Result: 小规模受控研究中，相较人工事后编辑，中位标注时间减少52%；论文还发布基于该工具标注的数据集Panda-CVL及token纠错基准。

Insight: 标注者指出首个不合适token并替换，系统从修正前缀继续生成；绝大部分最终token仍由模型采样，因此样本保留在策略数据特性并自然形成正负对照。

Abstract: We present onPanda, an interactive tool for efficiently annotating LLM alignment data and agent trajectories. onPanda adopts token-level correction as its core interaction: while reading a model response, the annotator locates the first inappropriate token and either picks a substitute from the model’s candidate tokens or types the correct text via free-form editing. The system then truncates everything after that position and continues generation from the corrected prefix, repeating this locate-correct-continue loop until a satisfactory response is obtained. This mechanism lets annotators precisely steer model outputs at low cost: a small controlled study suggests that onPanda reduces median annotation time by 52% over manual post-editing. Since the vast majority of tokens in the final response are generated by the model itself, the resulting data largely preserves the model’s sampling distribution and is well suited for constructing on-policy SFT and preference data. Furthermore, the token-level corrections recorded during annotation provide fine-grained supervision with precise positions and naturally paired positive–negative samples. onPanda also connects to external tools and harnesses, enabling interactive trajectory annotation in realistic environments. In addition, we release Panda-CVL, a dataset annotated with onPanda, together with a benchmark for token-level correction.

cs.AI [Back]

[196] Didactic knowledge or Clinical Cases? How Data Types Shape Medical Large Language Models cs.AI | cs.CL | cs.LGPDF

Yuzheng Fan, Haochun Wang, Sendong Zhao, Xiao Han, Ming Ma

TL;DR: 用token数匹配实验分析教学型与临床型语料如何分别塑造医学大语言模型的知识和临床推理能力。

Details

Motivation: 医学模型常混合教材与临床记录训练，但两种数据对不同能力及错误模式的作用尚不明确。

Result: 临床数据提升临床任务且在知识任务上仍有竞争力，教学数据主要改善知识任务；少量临床数据已带来大部分电子病历任务收益，最佳混合比例因任务而异。

Insight: 知识记忆的提升不会可靠迁移到临床推理，呈现“知道—会做”差距；面向推理应用的数据整理应按应用目标配置更高临床数据比例。

Abstract: Medical large language models are commonly trained on mixtures of didactic data (e.g., textbooks) and clinical data (e.g., patient records), yet how these data types differentially shape model capabilities remains unclear. We address this issue with token-matched experiments that vary the didactic-to-clinical ratio and analyze how data composition affects performance, capability profiles, and error patterns across knowledge-intensive and clinic-oriented tasks. We uncover an asymmetric transfer across task types: clinical data improves clinic-oriented tasks while remaining competitive on knowledge-intensive ones, whereas didactic data mainly improves knowledge-intensive tasks. Error analysis suggests a knowing-doing gap, where improvements in knowledge recall do not reliably generalize to clinical reasoning. We further observe that modest amounts of clinical data yield most of the gains on EHR-grounded tasks, while the optimal mixture ratio varies with the knowledge and clinical reasoning demands of downstream tasks. These findings suggest that medical LLM data curation should be application-driven, with higher proportions of clinical data preferred for reasoning-intensive use cases.

Wenji Fu

TL;DR: 比较冻结图结构能否帮助本地9B模型在长篇侦探小说中跨章节导航证据并回答问题。

Details

Motivation: 线性长上下文阅读受固定注意力预算限制，而侦探式推理需要按时间整理线索并连接相距很远的角色关系。

Result: 30部小说、234题上最强图路由准确率53.85%，高于近期窗口46.15%、压缩51.28%及向量检索51.71%；但与图基线差异经Holm校正均不显著。

Insight: 结果只能算探索性证据；较稳健发现是证据集中于图拓扑核心，且两种图构建流程标注覆盖率差异很大，单看合并准确率会掩盖瓶颈。

Abstract: Long-context models read a novel the way a person reads a printout: one token after another, in narrative order, with the whole history competing for a fixed budget of attention. A detective does not work that way. They sort what happened when, and they keep a map of who relates to whom, so a clue from chapter one can meet a question asked at the end of the book. We test whether a frozen knowledge graph can give a small local model that same freedom. Thirty detective novels and 234 multiple-choice questions are answered by one fixed qwen3.5:9b reader under nine conditions: five graph routes, a recent-window baseline, whole-book compression, ordinary vector retrieval, and a question-only control. The strongest graph route reaches 53.85% (126/234) against 46.15% for the recent window, 51.28% for compression, 51.71% for vector retrieval and 40.17% for question-only. On the subset that no model can answer without the book, the graph route reaches 42.86%. None of the fifteen graph-baseline contrasts survives Holm correction, so we present the result as exploratory evidence about a design. Two structural findings survive scrutiny better than the headline number: annotated evidence concentrates in the topological core of these graphs (2.35x enrichment, pooled), and the two graph-building pipelines differ so much in annotation coverage (16% versus 73% of clue paragraphs) that pooled accuracy alone would hide which bottleneck is being measured.

[198] AgentRouter: Heterogeneous Model Routing for Cost-Optimal Multi-Step Agentic Workflows cs.AI | cs.CL | cs.LG | cs.MAPDF

Rudrendu Kumar Paul, Sourav Nandy

TL;DR: AgentRouter按智能体轨迹的每一步复杂度选择四档模型，减少把所有子任务都交给前沿模型造成的推理浪费。

Details

Motivation: 智能体单条轨迹中的规划、编码和格式整理复杂度不同，单轮路由方法忽略了这种步骤级质量依赖。

Result: 路由器开销低于5毫秒，在A100上可将成本降低72%，保留前沿模型97.3%的任务完成质量；成本降幅高于逐步应用RouteLLM和FrugalGPT。

Insight: 用12M参数分类器及五种路由时可提取特征，对50,000条跨规划、编码、研究和数据分析轨迹步骤训练，依次把步骤分配给四种模型档位。

Abstract: Enterprise agentic systems that route every trajectory step to a frontier model waste 60-80% of their inference budget on subtasks that smaller models handle equally well. Existing routing solutions optimize single-turn query assignment but ignore a property unique to agentic workflows: subtask complexity varies widely within a single trajectory. A planning step may require frontier-class reasoning while a subsequent formatting step needs only a 7B model. We formalize step-level model routing as a sequential assignment problem over agent trajectories and propose AgentRouter, a lightweight classifier (12M parameters, <5ms overhead per step on an A100 GPU) that maps each trajectory step to one of four model tiers using five features extractable at routing time. Trained on 50,000 annotated agent trajectory steps spanning planning, coding, research, and data analysis tasks, AgentRouter achieves 72% cost reduction relative to frontier-only baselines, retaining 97.3% of frontier-only quality (less than 3% degradation in end-to-end task completion); per-step routing accuracy reaches 91% on minimal-complexity steps and 85% on efficient-tier steps, with 76-82% on the harder mid-range and frontier tiers. On the same benchmarks, RouteLLM and FrugalGPT (applied per-step) achieve only 31% and 44% cost reduction respectively, because their single-turn training signal misses trajectory-level quality dependencies.

[199] Representation-guided in-context learning for medical image interpretation with multimodal large language models cs.AI | cs.CL | cs.CVPDF

Minda Zhao, Fangyu Hu, Yan Luo, Yutong Yang, Jiahui Cai

TL;DR: RG-ICL用冻结编码器检索与问题匹配的医学图像示例，无需领域微调即可增强多模态模型解读能力。

Details

Motivation: 把通用MLLM适配到医学图像往往需昂贵微调，而示例如何选择及其数量对上下文学习效果影响很大。

Result: 八个病理、放射和眼底数据集上，分类平均提升20个百分点，VQA提升13个百分点；六个对齐案例优于最多32个随机案例，并接近或超过训练式对照。

Insight: 参照病例是否与查询相关比数量更重要；VQA示例需同时匹配图像内容与问题意图，随机或固定示例可能使表现低于无上下文基线。

Abstract: Medical image interpretation is central to diagnosis and care, yet adapting general-purpose multimodal large language models (MLLMs) often requires resource-intensive domain-specific fine-tuning. Here we introduce representation-guided in-context learning (RG-ICL), a training-free inference framework that retrieves query-aligned demonstrations using frozen encoders, without task-specific parameter updates. Across eight datasets spanning histopathology, radiology and retinal fundoscopy, RG-ICL improved classification (mean gain 20 percentage points) and visual question answering (VQA) (mean gain 13 percentage points) over no-context and conventional ICL, approaching or exceeding training-based comparators. Which cases were retrieved mattered more than how many: 6 query-aligned cases outperformed up to 32 randomly selected ones, whereas fixed or random cases often reduced accuracy below baseline. For VQA, aligning reference cases with both image content and question intent produced further gains. These findings indicate that for medical image interpretation, curating which reference cases an MLLM sees is a practical alternative to retraining it.

[200] Fathom-Vaidya: Advancing Medical Reasoning with Rubric-Based Rewards cs.AI | cs.CL | cs.LGPDF

Kalash Shah, Kunal Singh, Snehan J, Shreyas Singh

TL;DR: 用合成临床情境和评分量规驱动强化学习，分别提升医学模型的诊断与互动式临床推理。

Details

Motivation: 医疗部署既需要从病情证据作诊断，也需在多轮对话中沟通、规划和调整，后者通常没有单一正确答案。

Result: MedXpertQA提升超过10%；30B模型在HealthBench-Hard准确率50.1%，超过包括GPT-5思考模式在内的专有基线。

Insight: 先以规则与量规强化MedBullets派生诊断题，再用5,300条合成多轮病例和多维评分标准训练更广义临床判断。

Abstract: Deploying Large Language Models (LLMs) in healthcare requires robust performance across two complementary dimensions - diagnostic reasoning: the convergent, evidence-driven task of inferring a patient’s condition from clinical data to produce a diagnosis, and clinical healthcare reasoning: the broader, navigational judgment required to communicate, plan, and adapt across multi-turn clinical interactions where a single correct answer may not exist. Recent benchmarks such as HealthBench and MedXpertQA reveal persistent weaknesses in both areas, exposing failures in complex diagnostic scenarios and limitations in contextual, patient-centered dialogue. We introduce a sequential training framework that targets these facets using synthetic data and rubric-based reinforcement learning. First, we improve diagnostic reasoning using MedBullets-derived questions with rule- and rubric-guided Reinforcement Learning (RL). We then shift to clinical reasoning by generating 5.3k synthetic multi-turn scenarios, each paired with multi-dimensional rubrics to comprehensively assess the response. This approach yields over 10% improvement on MedXpertQA, and our 30B model achieves 50.1% accuracy on HealthBench-Hard, surpassing proprietary baselines including GPT-5 (thinking). Our results show that targeted synthetic datasets and rubric-based training can systematically improve both diagnostic and interactive clinical reasoning in medical LLMs.

[201] Harness-Zero: Harness Distillation via Agent-as-Harness cs.AI | cs.CL | cs.NEPDF

Haoran Ye, Yuxing Lu, Haonan Dong, Zhaochen Su, Guojie Song

TL;DR: Harness-Zero把专用智能体框架带来的行为蒸馏进模型，使模型部署时可回到单一固定框架。

Details

Motivation: 外部工具框架能提升智能体表现，但能力依赖部署时继续保留该框架，且不同领域和任务可能需要不同框架。

Result: 跨知识工作、工具使用和科学任务，微调后宏平均成功率从23.3%升至44.3%，超过保留专用框架时的41.7%；28种行为平均恢复率82.3%。

Insight: 优化框架引导一个智能体在目标框架动作空间内修正学生响应，形成训练示范；微调将这些框架行为内化后，部署可移除专用框架。

Abstract: Agent harnesses, the external systems that mediate model-environment interaction, can substantially improve agent performance, but their gains remain tied to the harness at deployment. Because the best harness varies across domains, instances, and models, a general-purpose agent must either settle for a suboptimal shared harness or route among an ever-growing set of specialized ones. We therefore study agent harness distillation: using a domain- or instance-optimized harness as training-time guidance and transferring the behaviors it induces into model weights, so that its gains survive under a single fixed target harness. The challenge is that the two harnesses differ in action space and available information, so guidance from the optimized harness cannot serve directly as supervision for the target one. We introduce Harness-Zero, which enables harness distillation through agent-as-harness. Guided by the optimized harness, a harnessing agent corrects student responses before execution in the target harness’s action space, turning harness guidance into training demonstrations. Fine-tuning on the resulting trajectories internalizes harness-induced behavior into the model, so the specialized harness can be removed at deployment. Our experiments spanning knowledge work, tool use, and science domains show that: (1) For frontier LLMs using the same evolved harness, agent-as-harness outperforms code-as-harness. (2) With the specialized harness removed at deployment, Harness-Zero improves the base model’s macro-average task success from 23.3% to 44.3%, even exceeding the 41.7% it reaches with that harness still attached. (3) Harness-Zero recovers harness-induced behaviors absent from the base model, with 82.3% average recovery across 28 patterns in the three domains.

[202] An Affordable AI-Integrated Smart Cane for Multimodal Mobility Assistance of Visually Impaired Users cs.AI | cs.CV | cs.CY | cs.ROPDF

Ali Akarma, Adeel Ahmad, Toqeer Ali Syed

TL;DR: 实现88美元、完全离线运行的AI智能手杖，融合视觉与测距为视障用户提供语音和触觉避障提示。

Details

Motivation: 普通白手杖无法发现高处障碍或提供环境语义，现有AI辅助系统通常硬件昂贵或依赖云连接。

Result: 室内测试宏F1为0.82、端到端延迟330毫秒、峰值功耗2.8瓦；12人初步使用评估SUS为78.5，并报告障碍感知改善。

Insight: 树莓派Zero 2W运行INT8量化SSD MobileNet，融合RGB和ToF距离并输出距离感知振动及语音；多进程隔离感知、推理与反馈，支持故障安全。

Abstract: Visual impairment affects over 2.2 billion people worldwide, yet conventional white canes cannot detect elevated hazards or provide semantic environmental context. Existing AI-assisted navigation systems typically rely on expensive hardware or cloud connectivity, limiting accessibility in resource-constrained settings. This paper presents an affordable ($88 USD), fully offline AI-integrated smart cane designed for multimodal mobility assistance on an ultra-low-power Raspberry Pi Zero 2W. The system fuses RGB vision sensing with Time-of-Flight (ToF) distance estimation, pairing an INT8-quantized SSD MobileNet V1 model with distance-aware vibrotactile feedback and real-time audio alerts. To ensure operational robustness on constrained hardware, a multiprocessing architecture isolates sensor acquisition, neural inference, and haptic feedback into independent processes with fail-safe sensing support. Experimental evaluation across indoor mobility scenarios demonstrates a macro-averaged F1-score of 0.82 (precision: 0.85, recall: 0.81), a mean end-to-end latency of 330,ms, and a peak power draw of 2.8,W. A preliminary usability study with 12 participants (SUS: 78.5, NASA-TLX) demonstrated positive user perception and enhanced obstacle awareness. The proposed prototype validates the feasibility of deploying privacy-preserving, edge-native assistive intelligence for cost-sensitive mobility assistance.

[203] UniK: Universal Knowledge Perception for Digital and Physical AI cs.AI | cs.CV | cs.IR | cs.LGPDF

Nirmit Desai, Kunal Sawarkar, Aditya Mahakali, Dongkon Lee, Kevin Park

TL;DR: UniK提供跨模态知识生命周期平台，以统一检索基础设施服务企业数字智能体及具身世界模型训练。

Details

Motivation: 数字AI和物理AI都依赖大量私有异构知识，但现有基础设施难以可靠、高效地摄取、整理、索引和检索这些内容。

Result: 无需任务专属微调时，70B开源模型配合UniK在五类数字任务上持续匹配或超过更大的专有模型；政府数据RAG准确率76%，医疗问答77.9%。

Insight: 基于Polymath Retrieval融合自动丰富的多个索引，覆盖文本、视频、分子数据和传感器信息；物理AI世界模型的数据整理和检索在结构上面临相同问题。

Abstract: Two transformative classes of AI systems are reshaping how organizations operate: \textit{digital AI}, which reasons over enterprise knowledge to power chatbots and agent workflows; and \textit{physical AI}, which learns to control robots and autonomous systems from video, gameplay, and sensor telemetry. Both face the same foundational bottleneck: raw knowledge at scale, spanning heterogeneous modalities, locked in private corpora that existing AI infrastructure cannot access reliably or efficiently. We propose \textit{Universal Knowledge Perception (UniK)} as a common platform for both classes, covering the full knowledge lifecycle (ingestion, enrichment, indexing, retrieval, and continuous evaluation) across modalities from rich text and video to molecular data and sensor telemetry. We present UniK, built on Polymath Retrieval (multi-index fusion over automatically enriched indices) with no task-specific fine-tuning. Across five digital AI domains (medical literature, open-domain QA, chemistry, legal video proceedings, and government open data) UniK combined with an open-source 70-billion-parameter model consistently matches or outperforms frontier proprietary LLMs that are orders of magnitude larger: 76% RAG accuracy on government data versus 47% for GPT-5; 77.9% on medical QA without fine-tuning; topping all open-source chemistry pipelines. We show that the same infrastructure directly addresses the data curation, indexing, and retrieval challenges facing physical AI world model training, where the knowledge problem is harder but structurally identical.

[204] SKstars at SHROOM: Visions Agreement-Guided Ensembling of Zero-Shot and LoRA-Adapted Vision–Language Models cs.AI | cs.CVPDF

Ali Athar, Imran Ahsan, Joon-Yong Jung

TL;DR: SHROOM-Visions提交系统将大型零样本VLM与小型LoRA适配模型集成，用于细粒度多模态幻觉定位。

Details

Motivation: 任务要求识别模型输出中的幻觉字符片段、标注类型并给出置信度，单一模型可能难以兼顾泛化与定位细节。

Result: 官方英语测试集Cor+Lbl为0.2902，在29支队伍中排名15；Cor和IoU均为18名。开发集提升未必能迁移到隐藏测试集。

Insight: 将Qwen2.5-VL-72B零样本预测与7B LoRA模型输出轻量集成，再细化字符片段并校准置信度；结果显示集成有实用性，但测试迁移仍是挑战。

Abstract: This paper describes the SKstars submission to SHROOM-Visions 2026, a shared task on fine-grained hallucination detection in large vision-language model outputs. The task requires systems to identify hallucinated character spans, assign hallucination categories, and provide confidence estimates for their predictions. Our approach combines zero-shot predictions from Qwen2.5-VL-72B-Instruct with those of a LoRA-adapted Qwen2.5-VL-7B-Instruct model. The outputs of the two models are integrated through a lightweight ensemble procedure, followed by span refinement and confidence adjustment. We evaluate the main system components on a small internal development subset and report the performance of the submitted system on the official English test set. SKstars achieved a Cor+Lbl score of 0.2902, ranking 15th among 29 teams, and obtained Cor and IoU scores of 0.3642 and 0.3151, respectively, ranking 18th on both metrics. The results show that combining a large zero-shot model with a smaller adapted model provides a practical framework for multilingual and fine-grained hallucination localization, while also highlighting the difficulty of transferring development-set improvements to hidden test data. Code and predictions: https://github.com/aliathar1401/SK-Stars-shroom-visions-2026

[205] Not All Task Vectors Need Equal Rank: Energy-Proportional Allocation for Model Merging cs.AI | cs.CV | cs.LGPDF

Hyunjoong Cho, Jinhyeok Jang

TL;DR: SERA按任务向量的奇异值能量自适应分配模型合并秩预算，替代各任务使用相同秩的做法。

Details

Motivation: 谱合并方法能利用任务更新的低秩结构，但统一分配秩容量忽略不同任务向量的谱复杂度，可能浪费共享空间。

Result: 在标准视觉模型合并协议中，相同总秩预算下，SERA改善多任务合并表现；分析显示任务谱集中度与自适应分配效果相关。

Insight: 依据每个任务更新的奇异值能量，将更多方向分配给复杂或孤立任务、较少方向留给紧凑任务，使SVD合并的容量按任务变化。

Abstract: Model merging aims to combine multiple fine-tuned models derived from a common pretrained model into a single multi-task model without additional joint training. Recent spectral merging methods improve over simple weight averaging by exploiting low-rank structures of task-specific updates, but they commonly assign the same rank capacity to every task. This uniform allocation ignores that task vectors can have heterogeneous spectral complexity, causing the shared merging space to be used suboptimally. In this paper, we propose Spectral Energy-proportional Rank Allocation (SERA), a simple task-adaptive strategy that allocates ranks according to the singular-value energy structure of each task vector. By assigning richer spectral capacity to complex or isolated tasks and fewer directions to compact tasks, SERA extends SVD-based model merging from uniform-capacity merging to task-dependent capacity allocation. Experiments under standard vision model merging protocols show that SERA improves multi-task merging performance while preserving the same total rank budget as existing spectral merging methods. Further analysis demonstrates that task-level spectral concentration is closely related to the per-task effect of adaptive rank allocation, providing insight into when and why SERA is effective.

cs.CR [Back]

[206] LLMs as Linguistic Chameleons: Decoupling Semantics and Structure for Privacy-Preserving Communication cs.CR | cs.AI | cs.CLPDF

Yuzhu Mao, Liang Zhao

TL;DR: CROSS-MAP通过推理前替换私有文本语义、推理后恢复结果，降低LLM API使用中的文本重建风险。

Details

Motivation: 隐私保护方法往往保留原文大部分语义以维持任务效用，却因此留下可被攻击者利用的重建线索。

Result: 实验显示CROSS-MAP在多种攻击设置下减少文本重建成功率，并在效用上优于既有基线；摘要未提供具体数字。

Insight: 将私有输入映射到不同语义域而保留语言模型推理所需结构，恢复阶段再映射回目标语义；本地模型分别训练以最大化语义差异并降低恢复不一致。

Abstract: As Large Language Model (LLM) APIs become increasingly integrated into privacy-sensitive workflows, ensuring inference-time privacy without compromising task utility remains a major challenge. Existing approaches preserve most of the original semantic content to maintain downstream performance, but this also leaves exploitable cues for reconstructing the original text. This work investigates semantic decoupling, which replaces original semantics with alternative content while preserving the structure needed for LLM reasoning. Based on this idea, we propose CROSS-MAP, a bidirectional framework that maps private inputs into a different semantic domain before inference and recovers the corresponding outputs afterward. Local models are trained with multi-objective optimization to maximize semantic divergence in the mapping stage while minimizing semantic inconsistency in the recovery stage. Experiments show that CROSS-MAP reduces reconstruction success across multiple attack settings while outperforming existing baselines in utility.

cs.IR [Back]

[207] Guiding the coarse levels of semantic IDs makes the fine levels learnable cs.IR | cs.CL | cs.LGPDF

Bin Wang, Zhengyu Zhang

TL;DR: Guided SID把任务相关类别属性直接写入语义ID的粗层级，使生成式检索代码更容易被语言模型使用。

Details

Motivation: 常规语义ID分词器只重建物品嵌入，其代码与下游任务或语言模型并不对齐，系统需额外训练来弥合语义差距。

Result: 与仅编码方式不同的匹配端到端实验中，Recall@1和Recall@10分别提升至1.36倍和1.39倍，MRR从0.0260升至0.0355，预定义属性预测频率为基线的4.2倍。

Insight: 用确定性监督索引将文本可表达且任务相关的属性写入粗量化层，同时仍保留码本重建梯度；前缀树合并可将高基数或集合属性映射到固定码预算。

Abstract: Generative retrieval represents each item by a short Semantic ID and casts recommendation as autoregressive generation of that sequence. Because the tokenizer is trained independently to reconstruct an item embedding, its codes are aligned with neither the downstream LLM nor the end task. Nearly every SID system therefore spends extra effort to bridge this gap–alignment corpora, reasoning/RL, or per-token encoders to make codes legible, or learned tokenizer supervision to make them task-aware–yet the recovered meaning is content-derived and may not be the meaning the task needs. We introduce Guided SID, which instead makes the levels that matter most meaningful by construction: we force the coarse RQ-VAE levels to encode a predefined categorical attribute–chosen to be text-grounded (hence legible to the LLM) and task-relevant–by deterministic supervised index assignment (overriding nearest-neighbor selection with the attribute label) while keeping the codebooks learnable (they still receive reconstruction gradients). A trie-merge construction maps any high-cardinality or set-valued attribute onto the fixed code budget while keeping merged buckets semantically coherent. Guiding costs nothing intrinsically: collision and reconstruction match or beat the vanilla baseline despite pinning the coarse level. In a matched end-to-end A/B differing only in the SID encoding, the guided retriever improves recall@k at every list length we measure (1.36x at k=1, 1.39x at k=10), raises mean reciprocal rank from 0.0260 to 0.0355, and predicts the pre-defined attribute 4.2x more often.

[208] PSD: Pseudo Self-Distillation of Memory Representation Capabilities for LLM Agents cs.IR | cs.CL | cs.LGPDF

Pirzada Suhail, Menglin Xia, Xuchao Zhang, Mayukh Das, Chetan Bansal

TL;DR: PSD让小模型通过特权教师提示学习黑盒大模型的记忆构造行为，无需访问教师logit或隐状态。

Details

Motivation: 长程智能体的记忆构建和维护依赖反复调用昂贵模型，而闭源教师通常不开放传统知识蒸馏所需内部信号。

Result: LoCoMo上，0.6B、1.7B和4B的Qwen3学生在下游检索上达到或超过GPT-4.1-mini；仅在LoCoMo训练也能迁移到LongMemEval。

Insight: 同一小模型分别充当教师与学生：前者通过提示看到外部答案作为参考，后者仅看原任务并拟合教师输出，从而将外部知识行为内化到参数中。

Abstract: Memory systems are becoming a core component of LLM agents, but constructing and maintaining memory remains expensive because it relies on repeated calls to large proprietary language models. This cost creates a major barrier to deploying memory-enhanced agents at scale. In this paper, we present Pseudo Self-Distillation (PSD), a framework that enables small language models (SLMs) to construct hierarchical memory representations by distilling behavior from a strong black-box oracle through a multi-stage training pipeline. Standard distillation methods require access to teacher logits or hidden states, which closed models do not expose. Unlike conventional self-distillation settings, where supervision is derived from a model’s own predictions, sampled rollouts, or aggregated outputs, PSD enables a single-model distillation setup while channeling external oracle knowledge through the prompt. PSD uses a single small model in two roles: a teacher that sees a privileged prompt containing the oracle’s answer as reference context, and a student that sees only the task prompt. The student learns to reproduce the teacher’s output distribution, absorbing oracle-guided behavior into its own weights without accessing the oracle’s internals. On LoCoMo, PSD-trained Qwen3-0.6B, 1.7B, and 4B match or exceed GPT-4.1-mini on downstream retrieval at a fraction of the deployment cost, with off-policy PSD achieving the strongest results across most conditions. We further show that this memory-construction capability transfers out-of-distribution to LongMemEval, despite the students being trained exclusively on LoCoMo with no exposure to LongMemEval data.

[209] Beyond Relevance: Structured Semantic Supervision for Product Search with LLM-Augmented Annotations cs.IR | cs.CLPDF

Girish A. Koushik, Swapnil Bhosale, Samarth Agrawal, Hadeel Sadany, Constantin Orasan

TL;DR: 为电商商品检索增加查询与商品的结构化属性监督，区分仅仅相关与真正符合用户购物意图的结果。

Details

Motivation: 简单相关性难表达候选商品满足需求的程度，尤其难以排序只部分匹配的商品。

Result: 增强版ESCI子集上，人类特征预言机NDCG@10为0.9382，无人工训练的Q+P方案为0.9258；合成近似信号总体为0.9150，并帮助困难查询。

Insight: 消融显示多数预言机收益来自经编辑的解释及标注者评论，而非单一中心性分数；LLM更适合补充结构化语义监督，不能直接替代人类判断。

Abstract: E-commerce search requires distinguishing products that are merely related to a query from those that directly satisfy the user’s shopping intent. We augment query-product pairs with structured LLM-generated query and product attributes and human-validated relevance, explanations, and centrality judgments, and evaluate these signals using a simple dual-encoder retriever and MLP re-ranker. On an augmented subset of ESCI, a human-feature oracle reaches $0.9382$ nDCG@10, while a human-free trained $Q+P$ configuration reaches $0.9258$. Synthetic approximations of the human signals reach $0.9150$ overall but provide substantial gains for difficult, low-performing queries. Ablations show that most of the oracle improvement comes from post-edited explanations and annotator comments rather than the scalar centrality feature, suggesting that LLMs are most useful for exposing and approximating structured semantic supervision rather than replacing human judgment directly.

[210] Graded-Relevance Composed Multimodal Retrieval for E-commerce Visual Search at Scale cs.IR | cs.AI | cs.CVPDF

Anubhav Gupta, Hrushikesh Mohapatra, Prijith Chandra, Asish Mohapatra, Anuj Garg

TL;DR: GradCIR用四级相关性监督训练电商图文组合检索器，避免把候选商品简单划分为正负样本。

Details

Motivation: 真实商品目录中的候选可能不同程度满足图片加文字修改需求，二元相关性和单一正例无法表达这种排序差异。

Result: 3.5M组商品数据上的受控实验显示，四级监督使NDCG@10提升4.9%至5.9%；其他多模态骨干最高提升8.5%。FashionIQ平均召回率0.6703，系统已用于沃尔玛线上流量。

Insight: VLM生成查询和四级相关性标签，检索器挖掘难负例扩充数据，再用层级感知角度目标直接拟合等级，保留相关程度的细粒度信息。

Abstract: Visual search on large e-commerce catalogs must serve both “similarity” queries that ask for items resembling an uploaded image and “modifier” queries that comprise an image and text describing a desired modification (e.g. a color change or style swap). The latter is the setting known as composed image retrieval (CIR). Existing CIR methods, however, treat relevance as binary and train on triplets with a single positive target - a poor fit for real catalogs where many candidates partially satisfy a user query and ranking across that partial-match spectrum drives the customer experience. We propose a methodology for training CIR retrievers on graded relevance, consisting of: (i) a VLM to curate training data, generating both queries (object detection + modifier synthesis) and 4-level relevance labels without manual annotation, (ii) an iterative relevance-feedback loop that expands the training set by mining hard negatives from the in-training retriever, and (iii) a hierarchy-aware angular objective to train the retriever directly on the graded labels rather than collapsing them to a binary split. We call this methodology GradCIR and instantiate it on a PaliGemma2 bi-encoder trained on 3.5M graded pairs curated from raw Walmart catalog data. A controlled graded-vs-binary ablation isolates the supervision granularity and shows lift of 4.9%-5.9% in NDCG@10. The same recipe applied to other multimodal encoders lifts early-fusion backbones by up to 8.5% NDCG@10. On the public FashionIQ benchmark, GradCIR (applied to PaliGemma2) reaches 0.6703 average recall when fine-tuned, slightly ahead of the strongest peer-reviewed supervised baseline we compare against, and matching or exceeding all published CLIP-L-class zero-shot CIR methods. The system is deployed in production at Walmart, where it’s serving live visual-search user traffic.

cs.LG [Back]

[211] Generalized Multimodal Foundation Model cs.LG | cs.CLPDF

Huizi Cui, Zongbo Han, Chenggong Ding, Naichuan Xiao, Jialong Yang

TL;DR: 提出广义多模态基础模型，通过合成具有多种因果结构的数据学习可迁移模态关联，以适配任意模态组合和预测任务。

Details

Motivation: 现有多模态融合模型通常固定模态和任务，部署后难以快速适应新模态组合或下游目标。

Result: 在覆盖12种模态和11类预测任务的18个真实数据集上，模型无需任务专属适配即可与专用模型表现有竞争力。

Insight: 训练时生成大规模、因果结构多样的合成多模态数据学习关联模式，推理时通过上下文示例激活适用关联，而不依赖具体模态。

Abstract: Making prediction with multimodal data is widely used in diverse scenarios. Existing multimodal fusion models, once deployed, can only handle predefined modalities (e.g., vision, text and audio) and single tasks, making it difficult to quickly adapt to new downstream applications. Therefore, a natural yet rather aggressive question arises, whether there exists a general multimodal fusion model that can be applied to arbitrary modality combinations and arbitrary prediction tasks. We argue that a unified multimodal fusion model should not depend on specific modalities and instead encode transferable patterns of multimodal correlation. To this end, we propose a simple and effective learning paradigm based on training over the generation of large-scale synthetic multimodal datasets with diverse causal structures that formally characterize the generative processes of multimodal data in real world. Building on this framework, we propose the generalized multimodal foundation model, a unified foundation model for generalized multimodal learning. By constructing large-scale synthetic multimodal datasets with diverse correlation patterns, our model encodes transferable multimodal correlations during training and activates appropriate associations through in-context examples during inference. Extensive experiments on 18 real-world datasets spanning 12 modalities and 11 prediction tasks demonstrate that our model achieves competitive performance with specialized models without task-specific adaptation.

[212] GRRR: The Geometry of Reshaping, Rotation, and Routing in Decoder LLM post-training cs.LG | cs.CLPDF

Jianing Qi, Hao Tang, Zhigang Zhu

TL;DR: 用预训练权重的奇异值分解坐标系分析监督微调和强化学习如何几何性改变大语言模型参数。

Details

Motivation: 后训练带来性能提升，但这些变化究竟通过修改原有方向强度、旋转通道还是拓展零空间路径实现，仍不清楚。

Result: 在12条后训练链的数学评测中，去掉权重更新的奇异值对角分量通常仍能保留大部分收益。

Insight: 将更新拆为改变奇异值的对角项、旋转输入输出耦合的非对角项以及拓展原非零核心之外路径的零空间项；结果显示收益更多来自重构和扩展路径，而非大幅改变奇异值。

Abstract: We study how post-training changes the weights of Large Language Models (LLMs) relative to their pretrained weights. Across 12 post-training chains with supervised fine-tuning (SFT) and reinforcement learning (RL), we express each weight update in the pretrained matrix’s singular value decomposition (SVD) frame. This decomposition separates the changes of three geometrically distinct components: diagonal values, which reshapes singular values; off-diagonal values, which rotates the coupling between pretrained input and output directions; and null-space values, which routes outside the matrix’s original nonzero SVD core. On a math evaluation suite, we find that removing the diagonal component usually preserves most of the gains from post-training. These results suggest that post-training gains are carried primarily by reconfiguring and extending pretrained pathways rather than by substantially changing singular values of pre-trained models.

[213] PAGE: Partition-Aware Gated KV-Cache Eviction cs.LG | cs.CL | cs.CRPDF

Pankaj Kumar, Subhankar Mishra

TL;DR: PAGE在逐输入层面判断KV缓存压缩是否安全，仅对预计可安全的输入执行既有驱逐策略。

Details

Motivation: 压缩方法只决定保留哪些token，却不决定何时根本不该压缩；平均分可能掩盖少数输入准确率从99%跌至0%的灾难性失败。

Result: 一个基于prefill注意力一致性早晚变化的无标签标量可区分容量受限与可安全压缩输入；跨4种模型和驱逐器，容量受限场景的伤害率从0.75降至0.026。

Insight: 当一致性下降大时启用基础驱逐器，否则保留完整缓存；这是每输入安全门而非压缩器，实测平均压缩约2.9倍，静态批处理下会随批量增大而减弱。

Abstract: KV-cache eviction methods decide which tokens to keep but not whether to evict at all, so a benchmark mean can hide a class of inputs on which compression drives accuracy from 99% to 0%. We reframe eviction as a per-input admission decision and show that inputs separate into a capacity-bound class, where eviction is catastrophic at every budget, and a dilution-prone class, where eviction is safe or beneficial. A single label-free scalar computed from prefill attention, the early-to-late drop in pairwise top-$k$ head agreement, predicts this class before any decoding. PAGE thresholds this drop: it applies any base evictor when the drop is large and retains the full cache otherwise, with no training and no accuracy labels. The drop orders inputs by eviction safety consistently across four architecture families, and a per-model unlabeled pilot of about 100 inputs recalibrates the threshold for a new family. Used as a safeguard, PAGE cuts the harm rate on the capacity-bound regime from 0.75 to 0.026, a 29 $\times$ reduction, across four evictors, four models, and two benchmarks, turning a 99% to 0% collapse into a flat 89% without retraining the evictor. The gate is inert wherever eviction is already safe, and the capacity-bound class it protects is a small, identifiable minority of inputs, so the benefit is a targeted safety gain rather than an average one. PAGE is a per-input safeguard, not a compressor: realized compression is $1.8 - 3.4 \times$ (mean 2.9$\times$) against a nominal 16$\times$ budget and decays toward unity by batch 16 under static provisioning, and a trained evictor wins at matched memory.

[214] Beyond Task Completion: Training Capable and Safe Computer-Use Agents cs.LG | cs.AI | cs.CLPDF

Zeyu Kang, Zhenyun Yin, Yang Zhang, Shan He, Shanzhe Lei

TL;DR: SCOPE联合训练电脑操作智能体的任务能力与风险感知决策，使其能安全继续、拒绝有害目标或完成普通任务。

Details

Motivation: 只按任务成功率后训练的GUI智能体并不因此具备可靠安全性，面对环境风险时还需判断是否存在安全完成路径。

Result: 以Qwen3.5-9B为起点，SCOPE-RL在OSWorld成功率54.17%、OS-BLIND攻击规避率64.30%，综合能力—安全分58.80%，为评估智能体中最高。

Insight: SCOPE-Gen生成可验证能力任务及保留目标的风险变体，形成能力示范、安全继续和明确拒绝轨迹；拒绝监督主要贡献攻击规避，风险处理轨迹则能在相近安全水平下保留更多任务效用。

Abstract: Computer-use agents (CUAs) have made rapid progress in completing complex tasks through graphical user interfaces, yet post-training centered on task success alone does not induce reliable safety behavior. A reliable CUA must condition its execution on risk: it should complete ordinary benign tasks, avoid environmental hazards and continue when a safe completion path remains, and refuse when the goal is harmful or no safe path exists. To learn this conditional policy, we develop Safety and Capability Optimization for Policy Execution (SCOPE), which jointly post-trains a CUA for task-execution capability and safety-aware decision making. To provide aligned training data for this joint objective, we further introduce SCOPE-Gen, an automated pipeline that synthesizes verifiable capability tasks and converts them into paired environment-risk variants while preserving their original goals. Using the resulting tasks, we construct SATraj-OS, a trajectory dataset comprising capability demonstrations, safe continuations, and explicit refusals. SCOPE first learns from all three trajectory types through supervised fine-tuning and then further improves task completion through online reinforcement learning. Starting from Qwen3.5-9B, SCOPE-RL achieves a 54.17% task success rate on OSWorld and a 64.30% attack-avoidance rate on OS-BLIND, yielding the best aggregate capability–safety score of 58.80% among the evaluated agents. Ablations reveal asymmetric but complementary roles for the two forms of safety supervision: refusal trajectories account for most of the attack-avoidance gain, whereas risk-handling trajectories preserve greater task utility at comparable attack-avoidance levels.

[215] CTRL: Control-Based Time Series Forecasting with LLM-Guided Residual Learning cs.LG | cs.CLPDF

Minkyoung Kim, Daeun Ji, Yohan Lee, Beomsoo Kim, Beakcheol Jang

TL;DR: CTRL将语义分析与数值预测分开，用LLM智能体分析趋势、季节性和不规则误差，再生成可解释预测修正。

Details

Motivation: 现有LLM时序方法要么把LLM降为数值预测器，要么让其直接生成预测，后者在非平稳环境下可能不稳定。

Result: 方法面向分布偏移增强鲁棒性；摘要称其在高度平稳序列上也保持竞争力，但未报告具体数据集或量化成绩。

Insight: 冻结预测骨干生成初始预测，专门智能体对分解后的误差给出紧凑控制信号，由轻量残差解码器转成修正；无需标签的测试时适配只需3至24次LLM调用并可缓存。

Abstract: Time series forecasting underpins critical decision-making across diverse domains. While large language models (LLMs) offer promising reasoning capabilities, existing LLM-based time series forecasting approaches either reduce them to numerical predictors that bypass their strengths, or allow direct forecast generation that destabilizes predictions in non-stationary settings. We introduce CTRL, a framework that decouples semantic reasoning from quantitative prediction. A frozen backbone generates base forecasts, while specialized LLM agents function as controllers that analyze backbone prediction errors through decomposed trend, seasonal, and irregular components, grounding reasoning in interpretable temporal structure. Each agent outputs compact control signals that a lightweight residual decoder translates into forecast corrections. CTRL incorporates label-free test-time adaptation that detects distribution shift from input statistics alone and readapts control signals with only 3-24 LLM calls via caching. CTRL is explicitly designed to improve robustness under non-stationary temporal dynamics and distribution shift, while remaining competitive on highly stationary time series where adaptive correction provides limited additional benefit.

[216] Tool-Augmented On-Policy Distillation for LLM Domain Adaptation in Sequence-Based Omics Tasks cs.LG | cs.CLPDF

Jie Ying, Zhefan Wang, Zihong Chen, Zhengqing Li, Jinzhe Li

TL;DR: OmicsBench评估多组学序列模型是否能用生物学证据支撑预测，TA-OPD则训练模型提升证据扎根推理。

Details

Motivation: 既有多组学基准多只报告分类和回归结果，不检查模型是否理解支撑预测的生物机制。

Result: 1,160道专家验证题覆盖六类DNA、RNA及蛋白任务；17个LLM中，科学专用模型分类更准却常缺少有效证据。TA-OPD在0.8B至27B的五种Qwen3.5模型上提升证据扎根，并改善多数任务预测。

Insight: 按实例专属专家量表评估可追溯证据链，帮助识别模型依赖统计捷径的问题；工具增强的在策略蒸馏将序列预测与证据支持的生物推理对齐。

Abstract: Multi-omics sequences contain complex biological patterns, yet deciphering their mechanisms for automated scientific discovery remains challenging. As large language models (LLMs) interpret these sequences, evaluating both predictions and scientific reasoning is critical. However, existing benchmarks for multi-omics sequence tasks rely on classification and regression metrics, neglecting whether models grasp the underlying biological evidence. We introduce OmicsBench, the first reasoning benchmark for multi-omics sequences, comprising 1,160 expert-validated questions across six tasks spanning DNA regulation, RNA processing, and protein function. OmicsBench requires traceable evidence chains, evaluated using instance-specific rubrics developed with domain experts. Evaluating 17 LLMs reveals an inverse relationship: while scientific LLMs outperform general-purpose LLMs in sequence classification accuracy, they fail to provide valid evidence to support their predictions. One plausible interpretation is shortcut learning: specialized models may rely on statistical patterns rather than the biological mechanisms needed for scientific discovery. Motivated by this finding, we introduce tool-augmented on-policy distillation (TA-OPD), a post-training method to align sequence prediction with evidence-grounded biological reasoning. Across five Qwen3.5 models spanning 0.8B to 27B parameters, TA-OPD consistently strengthens biological evidence grounding while improving predictive performance on most tasks. These gains persist across model scales, indicating that stronger sequence reasoning does not arise solely from increased model capacity, but can be improved through evidence-aware training. Together, OmicsBench and TA-OPD provide a framework for diagnosing reasoning failures in multi-omics LLMs and a path toward models whose predictions are better grounded in biologically meaningful evidence.

[217] 1% of Tokens Can Be Enough: On Gradient Estimation in On-Policy Distillation cs.LG | cs.CLPDF

Huanxin Sheng, Zhiling Ye, Haonan Wang, Jian Wang, Jinjie Gu

TL;DR: 信息效率比IER刻画在策略蒸馏中抽样下一个词元导致的梯度估计误差，并用于选择稀疏监督位置。

Details

Motivation: OPD只监督学生生成轨迹中少数词元，但从单个抽样词元估计教师梯度可能造成高噪声更新。

Result: 数学及医学推理实验显示，加入IER改善多种选择器；只监督0.1%至1%的token时，稀疏方案可匹配或超过不筛选token的完整OPD。

Insight: 固定生成前缀下用信息几何分解信号与噪声，并以最优标量基线定义IER；选择监督位置时应兼顾教师信号的有用性与梯度可靠性。

Abstract: Sparse on-policy distillation (OPD) allocates teacher supervision to a small subset of tokens in student-generated trajectories. However, useful teacher guidance can yield a noisy update when its gradient is estimated from a sampled next token. We study this estimation problem at a fixed prefix in information geometry and propose an information-efficiency ratio (IER) based on a signal-to-noise decomposition. IER characterizes relative gradient estimation error under an optimal scalar baseline. A candidate-set approximation enables token selection based on IER and its combination with existing usefulness scores, while retaining the sampled reverse-KL training objective. On mathematical and medical reasoning tasks, adding IER improves existing selectors in multiple settings, with sparse configurations matching or exceeding full OPD without token selection at small token budgets of 0.1%–1%. These results support accounting for both usefulness and gradient-estimation reliability when allocating sparse supervision. Our code is available at https://github.com/BruceSheng1202/IER-OPD.

[218] Correcting Learning-based Perception for Safety cs.LG | cs.CV | cs.ROPDF

Yan Miao, Hussein Darir, Sayan Mitra

TL;DR: 用离线感知契约不确定性分析和在线风险选择，修正机器学习状态估计以提升自适应巡航控制安全。

Details

Motivation: 学习式感知器的失效边界难以刻画，错误状态估计可能造成不安全或过度保守的下游控制。

Result: 45个原系统发生安全违规的ACC场景中，方法在73%场景恢复安全；纠正场景的平均完成时间仅增加2.8%，仍有27%因契约前像构造不完全符合而无法恢复。

Insight: 先离线计算感知契约前像来界定感知误差，再用运行时风险启发式从不确定状态中选取与控制有关的状态采取修正，避免一味保守。

Abstract: Learning-enabled perception is important in many autonomous systems. Unlike traditional sensors, the boundary where ML perception does or does not work is poorly characterized. Incorrect perception can lead to unsafe or overtly conservative downstream control actions. In this paper, we propose a two-step strategy for correcting ML-based state estimation. First, an offline computation is used to characterize the uncertainties resulting from the ML module’s state estimation, using preimages of perception contracts. Second, at runtime, a risk heuristic is used to choose particular states from the uncertain estimates to drive the control decisions. We perform extensive simulation-based evaluation of this runtime perception correction strategy on different vision-based adaptive cruise controllers (ACC modules), in different weather conditions, and road scenarios. Out of 45 ACC scenarios where the original perception-based control system using Yolo and LaneNet led to safety violations, in 73% of the scenarios, our runtime perception correction preserved safety; our method wouldn’t be able to recover 27% of the scenarios where the construction of the preimages of perception contracts is not fully conformant. Further, our runtime perception correction strategy is not overly conservative—on the average only a 2.8% increase in completion time is experienced in the corrected scenarios, with mild interventions.

[219] Contrastive World Models cs.LG | cs.AI | cs.CVPDF

Bonnie Li

TL;DR: Contrastive World Models以未来视觉局部特征的互信息目标替代像素重建，学习有利于规划的潜在动力学。

Details

Motivation: 视觉复杂环境中，重建目标容易被无关背景支配，降低世界模型对决策相关状态的关注。

Result: 三种复杂度设置中，默认场景表现与Dreamer及动量预测基线相当；加入干扰物或自然视频背景后显著领先，且因移除像素解码器训练更快。

Insight: 最大化状态—动作序列与未来局部图像块间的互信息下界，使表示保留预测未来所需内容，不要求重建无关视觉细节。

Abstract: World models trained via pixel reconstruction can struggle in visually complex environments, where irrelevant information dominates the objective and distract the model from information relevant to planning and control. We present Contrastive World Models, an approach for learning latent dynamics models without pixel reconstruction. Building on Dreamer, we replace observation reconstruction in the standard world model objective with a Deep InfoMax-like lower bound that maximizes the mutual information between state-action sequences and local patch features of future observations, encouraging state representations to retain information that is predictive of the future without requiring the model to reconstruct visually irrelevant details. We evaluate our approach in small-scale experiments across three settings of increasing visual complexity. Our method matches Dreamer and a momentum prediction baseline in the default setting, and substantially outperforms both once distractors or natural video backgrounds are introduced, while also training more efficiently by removing the pixel decoder entirely. Our approach is general and makes minimal assumptions beyond access to state-action sequences and future observations. These results suggest that contrastive, infomax-based objectives are a principled and promising direction for building world models that are robust to visual nuisance factors, a property particularly relevant for transferring model-based RL agents to the real world.

[220] RS-Claw-Evolution: Environment-Feedback-Driven Evolution for Lightweight Remote Sensing Agents in Long-Horizon Tasks cs.LG | cs.AI | cs.CVPDF

Kai Ouyang, Dongyang Hou, Liangtian Liu, Zeyuan Wang, Ziyu Li

TL;DR: RS-Claw-Evolution用交互、失败恢复和多维环境奖励逐步提升轻量遥感智能体的长程规划能力。

Details

Motivation: 小型语言模型在多步遥感任务中容易丢失状态，利用环境反馈低效且学习信号稀疏。

Result: Earth-Bench自主规划模式下，Qwen3-4B优化后准确率65.9%，高于未训练Qwen3-32B的43.8%和DeepSeek-V3.1的60.8%，接近GPT-5的71.6%。

Insight: 交互阶段用代码管理观察和中间状态，经验阶段从失败恢复轨迹学习但屏蔽错误动作，决策阶段使用多维奖励及轮级优势保护训练工具调用。

Abstract: Large language model-driven remote sensing (RS) agents offer a promising approach to automating geospatial analysis. However, lightweight RS agents based on compact language models struggle with multi-step interactive tasks due to loss of long-horizon states, inefficient environmental feedback utilization, and sparse optimization signals. We propose RS-Claw-Evolution, an environment-feedback-driven framework that progressively improves lightweight agents through three stages. Interaction evolution uses executable code to control observations, maintain intermediate states, and reduce context redundancy. Experience evolution combines failure-aware trajectory generation with error-turn masking to learn from informative failure-recovery experiences without imitating faulty actions. Decision evolution uses reinforcement learning with multi-dimensional environment rewards and turn-level advantage protection to optimize tool-use behaviors and improve credit assignment in long sequences. On Earth-Bench, the optimized Qwen3-4B-based agent achieves 65.9% accuracy in Autonomous Planning mode, outperforming the untrained Qwen3-32B baseline (43.8%) and DeepSeek-V3.1 (60.8%), while approaching GPT-5 (71.6%). These results demonstrate that learning from environmental feedback can improve lightweight agents and narrow their performance gap with larger models in long-horizon RS tasks.

[221] Reinforcement Learning Inspired Black-box Adversarial Attacks for Computer Vision cs.LG | cs.CR | cs.CVPDF

Florian Krone, Elena Hoemann, Sven Hallerbach

TL;DR: RIBA利用强化学习式查询高效优化黑盒视觉模型对抗扰动，无需访问目标模型梯度。

Details

Motivation: 常见白盒攻击需要模型内部访问，现实中往往不可行；对安全关键视觉系统而言，需要更实用的黑盒威胁模型。

Result: 在CIFAR-10的ResNet-18上，中位攻击查询数减少25.4%；在ImageNet的ViT-B/16上减少22.5%，并能在对抗训练模型上达到白盒攻击效果。

Insight: 将不可微目标模型视为黑盒，通过少量查询迭代选择扰动；利用强化学习算法的查询效率，在保持攻击能力的同时减少评估次数。

Abstract: Neural networks, both convolution or transformer based, are essential for modern computer vision systems. However, they are vulnerable to small perturbations, almost imperceptible to humans, which significantly alter the model’s prediction. These adversarial attacks are often considered to be a significant threat to the implementation of neural networks in safety-critical applications. Most attacks utilize the white-box threat model and therefore require full access to the target model, making them unrealistic to use in practice. We propose a novel approach under the more realistic black-box threat model that utilizes concepts from reinforcement learning to optimize perturbations with a non-differentiable target model. Reinforcement learning algorithms have already been optimized to be query efficient, making them an ideal starting point when designing black-box adversarial attacks. We show the success of our reinforcement learning inspired black-box adversarial attack (RIBA) in generating adversarial perturbations using only a small number of queries to the target model, by comparing it to state of the art attacks on different models on the Cifar10 and ImageNet data sets. RIBA takes $25.4%$ fewer median queries to generate attacked images against a ResNet-18 on Cifar10 and $22.5%$ fewer median queries to fool a Vit-B/16 model on ImageNet. Additionally, we demonstrate that RIBA can match the performance of white-box attacks on an adversarially trained model.

cs.MM [Back]

[222] Hi-Singers: A Comprehensive High-Quality Dataset for Expressive Audio-Driven Singing Head Synthesis cs.MM | cs.AI | cs.CV | cs.SD | eess.ASPDF

Yichi Zhang, Hui Zhang, Guanjun Liu, Yuefeng Zou, Fengzhao Sun

TL;DR: Hi-Singers提供专为音频驱动歌唱头像合成构建的大规模野外视频数据和评测基准。

Details

Motivation: 歌唱需要比说话更夸张的表情、更大张口幅度和准确节奏同步，基于说话语料训练的模型容易出现节奏漂移。

Result: 数据包含29,608段、约170小时视频；多种系数式和扩散模型在视觉真实感、唇形同步及节奏动态上均有提升。

Insight: 采用自动与人工筛选保证主题相关、高清画面和稳定运动，并让评测覆盖不同语言及音乐风格，以弥补现有语音数据的领域差异。

Abstract: State-of-the-art models for audio-driven digital human generation have achieved photo-realistic results in talking-head synthesis. However, extending these models to singing-head synthesis remains challenging due to a significant Domain Gap: singing requires more exaggerated expressions, vivid jaw openings, and precise rhythmic synchronization. Current models, primarily trained on speech datasets, often struggle with “rhythmic drift” and constrained dynamics. To address this, we introduce Hi-Singers, the first large-scale, high-quality, in-the-wild video dataset specifically tailored for singing head synthesis. Hi-Singers undergoes a rigorous automated and manual filtering pipeline, ensuring strict thematic adherence, high-resolution rendering, and stable motion, resulting in 29,608 video segments totaling approximately 170 hours. We further establish a dedicated evaluation benchmark balanced across linguistic and musical styles. Extensive experiments across diverse architectures, including 3D-coefficient and diffusion-based models, demonstrate that Hi-Singers consistently and significantly improves performance across all dimensions. Specifically, it enables models to achieve superior visual realism, enhanced lip-sync consistency, and more precise rhythmic dynamics, effectively bridging the domain gap and setting a new performance standard for the singing synthesis task. The dataset is available at https://huggingface.co/datasets/CharlesZhang-USTC/Hi-Singers

[223] Visual Graph Reasoning via Knowledge Compilation cs.MM | cs.AI | cs.CVPDF

Rongzheng Wang, Zhe Wang, Ke Qin, Rongwei Wang, Muquan Li

TL;DR: VGCompiler把视觉图推理拆成显式图结构恢复和可执行图操作生成，以强化学习训练8B视觉语言模型。

Details

Motivation: VLM面对图像中的简单图论问题仍常失败，既有训练强调最终答案而忽略恢复拓扑和状态的中间表示。

Result: 在GVLQA、VisionGraph和VGCURE上，Qwen-VGCompiler超过最强闭源VLM 28.9%、超过最强代码基线23.7%，并测试了地铁、物流和网络故障应用。

Insight: 表示编译器恢复保留结构的中间图，操作编译器据此生成可执行查询；强化学习分层奖励检查可执行性、图有效性及表示和操作质量。

Abstract: Visual graph reasoning requires answering graph-theoretic questions directly from graph images, where graph topology and state are conveyed visually rather than given in symbolic form. Despite recent progress of vision-language models (VLMs), current approaches to visual graph reasoning still fail on simple visual graph problems. This reveals a fundamental limitation of existing approaches: they prioritize final-answer supervision over the intermediate recovery of an explicit graph representation that preserves graph topology and state from visual input. To address this limitation, we propose VGCompiler, a compilation-centric paradigm for visual graph reasoning via knowledge compilation. VGCompiler organizes reasoning around two compilers: a representation compiler that recovers a structure-preserving intermediate graph representation from visual input, and an operation compiler that compiles query intent under the recovered graph state into an executable graph operation. Specifically, we build VGCompiler on Qwen3-VL-8B and train it with reinforcement learning guided by a layered reward over executability, compiled graph validity, representation quality, and operation quality. VGCompiler uses a frozen observer to summarize graph and question conditions into lightweight signatures, enabling archive retrieval and code reuse across similar regimes. Experiments on three benchmarks GVLQA, VisionGraph, and VGCURE, show that Qwen-VGCompiler, built on an 8B backbone, surpasses the strongest closed-source VLM baseline by 28.9% and the strongest code-based baseline by 23.7%, while maintaining high efficiency. We further evaluate VGCompiler on three real-world domains, including metro routing, logistics delivery, and network fault assessment, where it generalizes across heterogeneous visual graphs and domain-grounded tasks.

[224] If You Hear It, Help Find It: Orthogonal Knowledge Distillation for Open-Vocabulary Audio-Visual Event Localization cs.MM | cs.CV | cs.LG | cs.SDPDF

Yi Xu, Cheng Chen, Wenzhuo Lei

TL;DR: OV-OrthKD按教师边界监督可靠性分工蒸馏开放词汇音视频事件定位模型。

Details

Motivation: 音频和视觉教师对时间边界的可靠性可能不同；若把两类监督都直接用于定位决策，噪声较大的信号可能误导分段。

Result: 在OV-AVEBench上，片段AP为0.816；相较官方微调基线，整体F1@0.5提升2.7个百分点，未见类别提升3.4个百分点。

Insight: 视觉教师塑造决策对齐表示，音频监督进入互补辅助子空间，文本原型锚定类别语义，并用正交损失减少两路投影重叠；推理时仍通过查询感知融合使用两种模态。

Abstract: Open-vocabulary audio-visual event localization (OV-AVEL) grounds a text-queried event in time from video, audio, and language. The supervision sources available to this task can differ in temporal-boundary reliability: on OV-AVEBench, our configured visual teacher gives more reliable boundary cues than the configured audio teacher, although the latter is a strong pretrained audio model and remains semantically informative. This is a setting-specific diagnostic rather than a universal ranking of vision and audio. We formulate the resulting challenge as supervision placement: which teacher signals may shape the localization decision, and which should remain auxiliary. Based on this view, we propose OV-OrthKD, a reliability-aware asymmetric distillation framework. Visual feature transfer shapes a decision-aligned representation, audio feature transfer enriches a complementary auxiliary subspace, a text prototype anchors seen/unseen category semantics, and an orthogonality loss limits directional overlap between the two teacher-specific projections. The student continues to use both modalities through query-aware fusion at inference, while the default training recipe keeps audio-teacher supervision off the segment-logit path. On OV-AVEBench, OV-OrthKD achieves 0.816 segment AP and improves F1@0.5 over the official fine-tuning baseline by 2.7 points overall and 3.4 points on unseen categories. Path-assignment, role-swap, corruption, and transfer analyses consistently support supervision placement as a task-specific design axis for OV-AVEL.

cs.RO [Back]

[225] AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation cs.RO | cs.AI | cs.CVPDF

Jiadi You, Qize Yu, Yue Chen, Minghong Cai, Zhide Zhong

TL;DR: AffordanceWAM把物体级可供性与未来视觉状态、机器人动作联合建模，促进人类视频向机器人操作迁移。

Details

Motivation: 机器人操作视频有动作监督但成本高、场景多样性有限；人类第一视角视频丰富却没有机器人动作标签，且具身外观不同。

Result: 在RoboCasa、CALVIN ABC→D及真实操作上均优于只用RGB或只用机器人数据的基线；固定机器人监督时，增加带可供性标注的人类视频能持续提升RoboCasa表现。

Insight: 在生成未来世界中显式表示标量可供性与热图，为人机视频提供共享交互目标；世界专家与动作专家以掩码联合注意力和统一流匹配目标共同预测。

Abstract: Generalizable robot manipulation requires predicting how a scene will evolve, identifying where interactions are feasible, and determining how to act. Action-labeled robot videos directly supervise control but are costly and limited in diversity, whereas egocentric human videos capture diverse interactions but lack robot actions and differ in embodiment and appearance. We introduce AffordanceWAM, an affordance-aware generative World Action Model that represents object-centric spatiotemporal affordance through Scalar Affordance and Affordance Heatmap, within the generated future World. This representation grounds visual prediction in task-relevant objects and interaction regions for action generation, and provides shared interaction targets across human and robot videos. Built on a pretrained video diffusion Transformer, AffordanceWAM uses separately parameterized World and Action Experts, coupled through Masked Joint Self-Attention, to jointly predict future RGB observations, Scalar Affordance fields, Affordance Heatmaps, and continuous robot actions under a unified flow-matching objective. Human videos supervise all three future-World streams, whereas robot trajectories additionally provide action supervision, enabling transfer without human action labels or retargeting. Experiments on RoboCasa, CALVIN ABC$\rightarrow$D, and real-world manipulation demonstrate consistent gains over RGB-only and robot-data-only baselines. Under fixed robot supervision, RoboCasa performance improves monotonically as affordance-annotated human video scales. These results support affordance as an effective interface for both vision-language-action learning and human-to-robot transfer.

[226] SmoLSTM: A Compact Vision-Language-Action Model with Recurrent Memory that Persists cs.RO | cs.CVPDF

Jan-Gerrit Habekost, Parsa Mastouri Kashani, Connor Gäde, Matthias Kerzel, Philipp Allgeuer

TL;DR: SmoLSTM以常数大小循环状态保留整段操作历史，提升视觉语言动作策略对遮挡和相似物体任务的记忆能力。

Details

Motivation: 只依据当前图像决策的VLA在物体遮挡或外观相同的任务中会缺少历史信息；扩大观察窗口则增加逐步计算成本并引入窗口长度超参数。

Result: 在LIBERO-Mem上达到85.1%子目标覆盖率和77.5%完整任务成功率，仅训练0.04B参数；重置循环状态后完整任务成功率降至7.0%，标准LIBERO平均成功率79.6%。

Insight: 冻结SmolVLM连接矩阵记忆LSTM，令观察词元与动作查询处于不中断的因果流，存储随回合长度为O(1)；动作头每步预测10个末端位姿增量和夹爪指令。

Abstract: Vision-language-action models often predict actions from only the current observation, which can leave tasks involving object occlusion or visually identical objects ambiguous without episode history. The usual countermeasure, widening the observation window, turns the horizon into a hyperparameter and lets per-step cost grow with it. We instead capture the episode in a recurrent state. SmoLSTM couples a frozen 256M-parameter SmolVLM backbone to a matrix-memory LSTM control layer in which observation tokens and action queries are unified in a single causal stream that is never reset throughout the entire episode. Recurrent-state storage is therefore O(1) in episode length. A flow-matching action head predicts chunks of 10 end-effector pose deltas and gripper commands at each control step. Our single policy, trained jointly on 7,461 demonstrations across 140 tasks and evaluated on held-out initial states, performs best, reaching 85.1% subgoal coverage and 77.5% full-task success on LIBERO-Mem with 0.04B trainable parameters, surpassing both the benchmark’s own object-centric baseline and recent memory-based approaches. Resetting the recurrent state at every control step reduces full-task success to 7.0%, showing that the trained policy relies on context carried between decisions. The same model achieves 79.6% average success on standard LIBERO.

[227] Cognitive Action Reasoning for Proactive Robots from Human-Centered Multimodal Observations cs.RO | cs.CVPDF

Zhihao Gu, Kechao Zhu, Yuanfeng Wu, Mohan Liu, Ankit Kumar Shaw

TL;DR: ProRobo将无明确动作指令时的机器人决策定义为主动行动推理，并提供真实多人类中心场景数据集ProAction。

Details

Motivation: 许多机器人数据把观察与明确任务指令或低层动作配对，真实人类环境中依据多模态线索主动决定帮助方式的研究仍不足。

Result: ProAction含1万条视觉、音频与文本样本，覆盖12种日常情境；基准显示通用多模态模型主动推断高层行动能力较弱，使用该数据训练后表现明显改善。

Insight: 两阶段人机标注结合评价理论候选生成和情感心智理论引导的人工修订，把人的状态、紧迫性、可行性和潜在风险纳入高层动作标注；MMC2Act作为参考模型学习该映射。

Abstract: Robots operating in human-centered environments are typically designed to execute explicit instructions, and most robot-learning datasets likewise pair observations with task instructions or low-level actions. Although recent work has begun to explore proactive embodied assistance, existing resources target different settings and action levels, leaving real-world human-centered multimodal decision-making underexplored. We formulate this problem as \textit{Proactive Robot Action Reasoning} (\textit{ProRobo}), an upstream cognitive decision problem in which a robot must determine which action to take based on multimodal human and environmental cues without explicit action instructions. To support ProRobo, we introduce \textit{ProAction}, a real-world multimodal dataset containing 10K samples of visual observations, audio signals, and text inputs across 12 daily-life scenarios in five common scenes. To construct cognitively grounded high-level action supervision, we develop a two-stage human-in-the-loop pipeline that combines appraisal-guided candidate generation with Affective Theory-of-Mind-guided human refinement, explicitly incorporating contextual judgment about human states, urgency, feasibility, and potential risk into action annotation. Based on this supervision, we benchmark representative Multimodal Large Language Models (MLLMs) and introduce \textit{MMC2Act}, a reference model that implicitly learns the mapping from multimodal observations to cognitively grounded high-level actions. Experiments across modality settings, subject-disjoint generalization, cross-dataset transfer, and human evaluation show that general-purpose MLLMs struggle with proactively reasoning high-level actions from multimodal cues, whereas training on \textit{ProAction} substantially improves performance.

Tamima Tabassum, Yiming Huang, Tianchun Wu, Changjing Liu, Zhiqing Tang

TL;DR: StenoVLA-3D将三维点图和时序状态引入视觉语言动作模型，支持胃肠道狭窄处内镜导航、动作决策及病灶报告。

Details

Motivation: 内镜导航必须从纹理弱的单目图像预测安全动作，并在病灶离开视野后保留证据；现有VLA多依赖外观和短时上下文。

Result: 40个留出录制回合上语义准确率95.2%、动作准确率83.4%；实体三自由度内镜在食管和结肠模型各36次试验中的成功率分别为88.9%和77.8%，高于所测基线。

Insight: 几何门控融合将点图接入视觉语言骨干，时序状态分支建模穿越进度；动作头联合输出有据推理和操作，专用头估计狭窄形状并生成病灶报告。

Abstract: Autonomous endoscopic navigation requires the policy model to predict actions from texture-poor monocular observations, make safe control decisions, and retain evidence of lesions after they leave the field of view. Existing vision-language-action (VLA) models primarily rely on visual appearance and short-term context, limiting geometric grounding and episode-level reporting. We introduce StenoVLA-3D, a 3D-aware VLA framework for navigating through stenotic regions. We integrate point-maps into the Cosmos-Reason 2 backbone through learned geometry-gated fusion, and also propose a temporal state branch to model traversal progress. Our reasoning-and-action backbone predicts grounded reasoning with actions, while dedicated heads estimate stenosis shape and generate the final lesion report. We further introduce EndoCausal, an episode-level dataset with lesion annotations, actions, and temporally grounded reasoning. On 40 held-out recorded test episodes, StenoVLA-3D reaches 95.2% semantic accuracy and 83.4% action accuracy. On the physical 3-DoF endoscope, it attains 88.9% and 77.8% task success in esophageal and colonic phantoms (36 trials each), substantially outperforming the evaluated baselines.

[229] LIBERO-VPro: Benchmarking Closed-Loop Visual Robustness of Robotic Foundation Models cs.RO | cs.CVPDF

Huiqiong Li, Zhiting Mei, Anirudha Majumdar, Jingjing Chen, Yu-Gang Jiang

TL;DR: LIBERO-VPro通过扰动执行时可见视觉证据，系统评估机器人基础模型的闭环视觉鲁棒性。

Details

Motivation: 常见操作基准假设执行过程中的视觉观察干净、及时且一致，可能掩盖模型在遮挡、过期图像或场景变化下的脆弱性。

Result: 评估约19.6万次模拟回合和200次Franka真实机器人操作；模型对严重物体遮挡有时仍能成功，但局部交互线索损坏、空间先验变化、观察过期或任务前提变化会导致明显退化。

Insight: 基准覆盖视觉退化、相机过期、来源一致性和任务相关场景变化四维度，共12类挑战、96种设置和3,296个任务条件；VLA与WAM呈现不同的多维鲁棒性特征。

Abstract: Robotic foundation models achieve impressive performance on standard manipulation benchmarks, yet these evaluations typically assume clean, timely, and consistent visual observations throughout execution. We introduce LIBERO-VPro, a benchmark for systematically evaluating the closed-loop visual robustness of robotic foundation models by perturbing the visual evidence available during execution. LIBERO-VPro covers four complementary dimensions, including Visual Evidence Degradation, Camera Staleness, Visual Source Consistency, and Task-Relevant Scene Variation, spanning 12 challenge categories, 96 experimental settings, and 3,296 task-condition cases. We evaluate three vision-language-action models and three world-action models over approximately 196,000 simulated episodes, complemented by 200 real-world rollouts on a Franka Research 3. Our results reveal that strong nominal performance can mask substantial weaknesses in visual grounding and adaptation. Models often remain successful despite severe object-level occlusion, yet degrade sharply when local interaction cues are disrupted or familiar spatial priors are violated. They are also highly sensitive to stale or missing observations and struggle when changed task preconditions require behavioral adaptation. Finally, VLAs and WAMs exhibit distinct robustness profiles, showing that visual robustness is multi-dimensional and architecture-dependent. LIBERO-VPro provides a systematic diagnostic framework for developing robotic foundation models that can more reliably ground and adapt their actions under challenging visual conditions.

[230] Think Like a World Model, Act Like a VLA: Distilling World-Model Representations into Compact Robot Policies cs.RO | cs.CVPDF

Trung Dao, Sankalp Yamsani, Jaden Park, Joohyung Kim, Yong Jae Lee

TL;DR: 将冻结世界模型的内部场景特征蒸馏给紧凑机器人策略，使其获得物理表征而不承担在线生成未来的开销。

Details

Motivation: VLA通常只映射观察到动作，缺少对世界响应的训练目标；世界模型更有物理依据，但逐步预测未来耗时，难进入控制环。

Result: 0.8B策略在LIBERO达到97.9%，在RoboCasa-GR1从48.2%升至50.5%；方法也迁移到单臂和双臂真实平台。部署在RTX 5090上耗时32毫秒、占用1.86GB。

Insight: 训练前缓存冻结世界模型对训练帧的特征，学生仅增加一个表征对齐目标；训练时无需加载教师，部署时丢弃投影器，推理策略与基线相同，因此增益不依赖额外容量或在线计算。

Abstract: Vision-Language-Action (VLA) models map observations to actions with no objective that accounts for how the world responds, so their robustness is bounded primarily by data coverage. World models carry precisely that missing objective and are better grounded for it, yet rolling the future forward costs seconds per decision and rules them out of the control loop. We show the two can be separated. What a world model knows about physical scenes lives in its \emph{internal features}; generating the future is merely the objective that produced them, so the grounding can be inherited while the generative machinery is left behind. We add one feature-alignment term to ordinary VLA training: a frozen world model is run over the training frames once and cached, and the student learns to agree with that cache. No teacher is loaded during training, the projector is discarded after it, and the deployed policy is identical to the undistilled baseline, running in $32$~~ms and $1.86$~~GB on a consumer RTX~5090, so every gain is attributable to the representation rather than to added capacity or test-time compute. A $0.8$B student reaches $97.9%$ on LIBERO, improves from $48.2%$ to $50.5%$ on RoboCasa-GR1 humanoid manipulation, and the same objective carries over to real hardware, on both a single-arm and a bimanual platform. The gain survives changes of student scale, backbone, alignment layer, and teacher, indicating a broad representational prior rather than a fragile alignment between two particular networks. Project page: https://thaw-vla.trung-dt.com/.

[231] DexTacWAM: A Visuo-Tactile World-Action Model for Dexterous Manipulation cs.RO | cs.AI | cs.CVPDF

Haoran Yuan, Zekai Wang, Boning Shao, Haoran Lu, Trevor Darrell

TL;DR: DexTacWAM把多指触觉状态融入视频世界—动作模型，预测接触演化并生成灵巧双手操作动作。

Details

Motivation: 灵巧操作依赖视觉难以完全观测的接触动力学，而现有世界—动作模型主要依赖视觉，无法直接建模接触过程。

Result: 22自由度双臂平台的六项接触密集任务中，每项均取得最高分，平均70.6，对比最强基线38.0；移除触觉世界建模后四任务均值从74.7降至26.6。

Insight: 逐指编码并用手指及姿态感知压缩器聚合触觉，再注入视频扩散世界模型联合预测视触状态；约100个示范/任务可进行视觉到触觉迁移，训练与推理分别快2.26倍和1.29倍。

Abstract: Dexterous manipulation depends on contact dynamics that are often only partially observable from vision. Recent World-Action Models (WAMs) couple predictive video world modeling with action generation, but remain largely vision-centric and therefore cannot directly model these contact dynamics. We present DexTacWAM, a visuo-tactile WAM that encodes each fingertip independently, aggregates the resulting features through a finger- and pose-aware tactile compressor, and injects the tactile latent into a video diffusion world model for joint visuo-tactile world modeling. Across six contact-rich dexterous manipulation tasks on a 22-DoF bimanual platform, DexTacWAM achieves the highest score on every task, averaging 70.6 versus 38.0 for the strongest baseline. Ablations attribute the gain to modeling contact evolution as part of the predicted world state rather than tactile conditioning alone: removing tactile world modeling reduces the four-task mean from 74.7 to 26.6 while keeping the same tactile features and action expert. After four hours of tactile-encoder adaptation with a frozen pretrained vision VAE, our continual vision-to-touch learning extends the pretrained video model to touch using roughly 100 demonstrations per task without tactile midtraining, while retaining visual prediction quality within 0.5 dB of vision-only counterparts. The compressor retains 89.4% of pre-fusion contact recall while enabling 2.26x faster training and 1.29x faster inference. Together, these results show that pretrained video priors can be extended to distributed multi-finger contact dynamics in a data- and compute-efficient manner.

Débora Oliveira Makowski, Samiran Gode, Abhijeet Nayak, Marco Hutter, Cordelia Schmid

TL;DR: 通过因果干预解释视觉语言导航模型如何使用视觉、指令和记忆，并提取可迁移的抽象行为方向。

Details

Motivation: VLN策略将语言和观察融合后，信息如何跨模态传递、预测是否依据相关语义或任务进度仍不透明。

Result: 干预指标显示策略受所有输入模态影响而非依赖单一模态；将抽象行为激活向量零样本迁移到分布外真实场景后，导航表现改善。

Insight: 模型内部保留任务进度信息及视觉语言骨干的语义结构，支持通过内部激活进行概念级行为引导，无需额外微调。

Abstract: Modern Vision-Language Navigation (VLN) models rely mostly on pre-trained large Vision-Language Models (VLMs) to predict navigation actions. While this fusion of language instructions and visual observations allows multimodal reasoning, it obscures how information is routed across modalities or what mechanisms drive navigation decisions. Thus, it remains unclear whether VLN models ground their predictions in relevant semantic cues or can track task progress. In this work, we study the interpretability and steerability of VLN models. We use intervention-based metrics that measure how visual observations, instructions, and visual memory causally influence navigation decisions. Our results show that these navigation policies are sensitive to all input modalities and do not depend on a single one. We further show that these agents encode navigation progress and retain semantic structure from their VLM backbones, enabling concept-level steering through internal activations. Finally, we extract activation vectors for abstract behaviors to transfer them zero-shot to out-of-distribution real-world scenarios, improving performance without additional fine-tuning.

cs.SE [Back]

[233] When Who You Are Can Change the Code You Get: A Study of Persona-Induced Bias in LLM Code Generation cs.SE | cs.CL | cs.CYPDF

Anubhav Gupta, Mayara Costa Figueiredo, Leticia Santos Machado, Tanner Wright, Ivan Beschastnikh

TL;DR: 大规模研究不同用户人口特征提示如何影响LLM代码生成质量，并比较闭源与开源模型的差异。

Details

Motivation: 编程助手接收用户背景信息，但这些与任务无关的人口特征是否影响生成代码的技术质量尚不清楚。

Result: 在35,000余个程序和18种身份设定中，人口标记出现在最多65%的回答和70%的推理轨迹；Gemini平均正确率下降1.54个百分点，而GPT-OSS各身份条件下提高3.4%至5.7%。维护性、风格效应很小，安全漏洞没有系统性身份模式。

Insight: 用户人口信息即使与编程任务无关，也与模型推理和代码质量的可测变化相关；效应方向依模型而异，提示需要评估身份条件下的模型行为。

Abstract: Large Language Models (LLMs) are widely used as programming assistants, yet it remains unclear whether and how user’s demographic information impacts the technical quality of generated code. We conduct a large-scale empirical study of persona-induced bias in LLM-based code generation, focusing a proprietary model (Gemini 2.5 Pro) and an open-weight model (GPT-OSS-120B). Using 18 demographic personas spanning nationality, gender, and experience level, we compare persona-induced prompts against a neutral baseline. Across 35,000+ generated programs, we analyze demographic marker leakage in reasoning and responses, as well as differences in functional correctness, maintainability, code style, and security. Our results show that demographic cues are frequently reflected in LLM reasoning and outputs. Demographic markers appear in up to 65% of responses and 70% of reasoning traces, despite being semantically irrelevant to the tasks. On LiveCodeBench, persona prompting were associated with lower correctness scores of the Gemini model by an average of 1.54 percentage points, with one persona exhibiting a decrease of 3.6% (odds ratio = 0.51). In contrast, the accuracy of the GPT-OSS model improved by 3.4 - 5.7% across all personas (odds ratios = 1.8 - 3.0). Maintainability and code style metrics show statistically significant but negligible effect sizes (all Cliff’s δ < 0.15), and security vulnerabilities exhibit no systematic persona-specific patterns. Overall, our results show that the presence of demographic information about users is associated with measurable variation in LLM reasoning and code quality even in purely technical tasks, and that these effects hold across models. Our work highlights an under-examined risk in LLM-assisted software development.

[234] One to More, More to One: Category-Aware Iterative Expert Training for Software Engineering Agents cs.SE | cs.CL | cs.LGPDF

Jie Zhao, Ziyu Jiang, Suhang Zheng, Minghui Shan, Xiaoxiao Xu

TL;DR: 提出按任务类别训练软件工程专家并通过在策略蒸馏整合，以缓解混合强化学习中的类别收益不均。

Details

Motivation: 仓库级软件工程任务异质，混合强化学习可能让部分类别进步同时使其他类别退化，整体解决率会掩盖这种差异。

Result: 整合后的策略在Pro-618上平均解决率58.04%，在SWE-bench Multilingual上为59.00%，分别较基础模型提高5.39和2.78个百分点。

Insight: 类别专家交替执行长程强化学习与刷新—修复—扩展：复查已掌握样例、用已验证成功轨迹修复微调并重选任务；最后以标签路由多教师蒸馏整合，无需外部模型提供解答轨迹。

Abstract: Repository-level software engineering (SWE) comprises heterogeneous task categories, whose progress under pooled agentic reinforcement learning can be uneven: gains in some categories coincide with regressions in others, while aggregate resolution obscures these changes. Motivated by this category see-saw, we develop a category-aware expert-training and policy-integration framework. Executable task construction and SWE Labeler, an evidence-grounded multi-axis labeling system, organize the training pools. Initial category-specific RL improves average training success while leaving uneven instance-level progress, motivating explicit consolidation of successful behavior and policy-adaptive task selection. Same-origin category experts alternate long-horizon Agentic-miniRL with Refresh-Repair-Expand (RRE): the updated policy refreshes instance mastery, reuses its own verified successful trajectories for Repair SFT, and reselects tasks for further RL. Label-routed multi-teacher on-policy distillation (MOPD) consolidates the experts into one deployable student, with ReLU-gated reward extrapolation keeping only each teacher’s improving direction over the reference. Expert training and policy integration require no external model to provide solution trajectories or action targets. We evaluate Pooled RL and Balanced RL, expert development, and single-model integration through aggregate and per-category resolution, the minimum category lift over each joint-RL baseline, and expert-gain recovery. The final MOPD policy achieves mean resolution of 58.04% on Pro-618 and 59.00% on SWE-bench Multilingual, improving over the base model by 5.39 and 2.78 percentage points, respectively.

[235] Omni2Web: Benchmarking Audiovisual Website Development cs.SE | cs.CVPDF

Minghao Han, Zhenghao Xing, Xize Cheng, Yuxuan Wang, Junming Lin

TL;DR: Omni2Web评测模型从屏幕录制的语音、光标和页面变化中恢复网页编辑意图并完成代码修改。

Details

Motivation: 录屏请求常用“这个”“那里”等依赖语境的指示词，需要结合语音、光标轨迹、页面状态和编辑历史推断意图。

Result: 双语基准有918个实例、13,907步；最佳直接编辑得分51.17，恢复指令得分49.14，固定执行器用恢复指令得51.08，远低于提供标准指令时的89.69。

Insight: 三条轨道分别测直接编辑、意图恢复和恢复指令效用；逐步分析显示正确定位并不保证编辑成功，而时间对齐的音视频证据对意图理解有帮助。

Abstract: Screen-recorded web editing requests contain weak deictic expressions such as this'' and there,’’ whose referents depend on speech, cursor trajectories, page state, and edit history. Such requests require intent recovery beyond the explicit specifications assumed by many existing web-editing benchmarks. We introduce Omni2Web, a bilingual benchmark of 918 instances spanning 13,907 edit steps. It defines three complementary tracks: Direct Editing evaluates webpage editing from recordings, Instruction Recovery measures explicit intent recovery, and Instruction Utility tests whether recovered instructions can drive a fixed code executor. We evaluate 17 open- and closed-source models. The best models attain 51.17 on the Edit Fidelity Score (EFS) for Direct Editing and 49.14 on the Instruction Recovery Score (IRS); under the fixed executor, the strongest recovered instructions reach 51.08 EFS, still far below the 89.69 EFS obtained with oracle instructions. Step-level analyses show that correct grounding does not guarantee successful edits, while some Omni models recover instructions that the fixed coding model executes substantially better than their direct edits. Controlled ablations further demonstrate the value of temporally aligned audiovisual evidence, while alternative judges preserve the leader and broad ordering. Together, these findings reveal substantial headroom in multimodal intent recovery and code execution and highlight the promise of pairing Omni rewriters with coding models.

eess.AS [Back]

[236] Long-Tail Rebalancing for Non-Verbal Vocalization-Aware ASR: A Track~1 System for the NVVSpeech Challenge eess.AS | cs.CL | cs.SDPDF

Shangyue Jia, Jingru Ma, Yangzhuo Li, Daoping Luo, Bowen Tian

TL;DR: 为联合识别词汇文本和16种非语言发声，提出针对长尾标签的两阶段ASR采样方案。

Details

Motivation: 非语言发声包含重要副语言信息，却常被ASR忽略；挑战数据监督有限且类别极不均衡。

Result: 两阶段系统在NVVSpeech Track 1获63.86官方分并排名第四；固定本地验证集上，单阶段设置中平方根类别采样最好。

Insight: 先把多源标签统一映射至官方类别体系并排除映射不可靠样本，再依次使用平方根频率采样和均匀类别微调。

Abstract: Non-verbal vocalizations (NVVs) carry important paralinguistic information but are often omitted by conventional automatic speech recognition (ASR) systems. The ISCSLP NVVSpeech Challenge requires joint transcription of lexical content and 16 NVV categories under limited and highly imbalanced supervision. We present a data-centric NVV-aware ASR pipeline based on cross-dataset label harmonization and a two-stage sampling schedule. We map heterogeneous source labels to the official taxonomy and exclude samples without a reliable mapping. Our schedule first uses square-root category sampling to moderate the long-tailed distribution and then applies uniform-category fine-tuning. On a fixed local validation split, square-root category sampling performs best among the tested single-stage settings. The final two-stage system obtains an official score of 63.86 and ranks fourth in Track 1.

eess.IV [Back]

[237] SomaNet: Weakly Supervised Learning for Instance Soma Segmentation in 3D Electron Microscopy with Partial Annotations eess.IV | cs.CVPDF

Mohammad Khateri, Morteza Ghahremani, Jussi Tohka, Alejandra Sierra

TL;DR: SomaNet用教师—学生伪标签和亲和度学习，在部分标注下完成三维电镜细胞体实例分割。

Details

Motivation: 细胞体实例分割对细胞分析和连接组重建很重要，但三维电镜的稠密实例人工标注成本过高。

Result: 在不同脑区和细胞体形态的三维电镜数据上，实现准确且稳健的部分监督实例分割；摘要未给出具体数值。

Insight: 教师从部分标签生成伪标签供学生联合学习；亲和度约束拉近同实例、分开边界，再以语义引导解码和2D到3D重建获得体积一致结果，并可接入多类视觉骨干。

Abstract: Soma instance segmentation, i.e., identifying and delineating individual cell somas as distinct instances, is crucial for cellular analysis and connectomic reconstruction. Three-dimensional electron microscopy (3D EM) provides nanometer-scale resolution for capturing fine-grained soma morphology. However, dense instance-level manual annotation is prohibitively costly, limiting the scalability of fully supervised methods. To address this challenge, we propose SomaNet, a weakly supervised framework for 3D EM soma instance segmentation under partial annotation constraints. SomaNet adopts a teacher–student learning paradigm tailored to partial labels. The teacher is trained using partially annotated data to generate pseudo-labels, while the student jointly learns from the partial ground-truth annotations and the generated pseudo-labels, progressively recovering dense instance segmentations. To accurately delineate cell somas under limited supervision with varying instance counts, SomaNet incorporates affinity learning, which encourages high similarity within instances and low similarity across instance boundaries. Semantic-guided affinity decoding and 2D-to-3D reconstruction then produce volumetrically consistent 3D soma instances while preserving the large receptive fields of 2D backbones. The framework is architecture-flexible and supports diverse backbones, including vision transformers and foundation models, enabling direct transfer of pretrained visual representations to volumetric EM segmentation. Experiments on 3D EM brain datasets demonstrate that SomaNet achieves accurate and robust soma instance segmentation across regions with diverse soma morphologies under partial annotation. Code is available at https://github.com/mkhateri/SomaNet.

[238] Resolution-Flexible Decoding for Hybrid Neural Video Representations eess.IV | cs.CVPDF

Taiga Hayami, Masaya Takabe, Hiroshi Watanabe

TL;DR: 提出面向混合神经视频表示的分辨率灵活解码器，使解码阶段不再绑定固定帧尺寸。

Details

Motivation: 混合表示的潜变量尺寸和上采样进程常与目标分辨率绑定，高分辨率视频因此需要不均匀的大倍率上采样并影响参数分配。

Result: 在UVG数据集上，所提框架较对应神经视频表示基线改善重建质量；摘要未列具体指标。

Insight: 解码器统一使用2倍上采样，并从输出尺寸反推各阶段目标尺寸，必要时仅作最小填充或裁剪；再以中间重建监督和基于近期损失的难度感知抽帧支持逐步解码。

Abstract: Neural video representations (NVRs) represent videos using neural network parameters and, in hybrid formulations, frame-wise latent embeddings. Although hybrid NVRs can improve reconstruction quality by using content-adaptive latent embeddings, their latent spatial sizes and decoder upsampling schedules are tied to the target frame resolution. For high-resolution videos, this dependency may require large and non-uniform upsampling factors and can affect the parameter allocation between the latent embeddings and the decoder. In this paper, we propose a resolution-flexible decoder framework for hybrid NVRs. The decoder is constructed from uniform (2\times) upsampling stages, whose target feature sizes are obtained by tracing the spatial resolution backward from the final output resolution. After each upsampling stage, the feature map is aligned with the target size by minimal padding or cropping when necessary. To support this progressive decoding process, we further use intermediate reconstruction supervision and a reconstruction-difficulty-aware frame sampling strategy based on recent frame-wise losses. The framework preserves the basic representation format of hybrid NVRs and can therefore be applied to different backbones. Experiments on the UVG dataset show that the proposed approach improves reconstruction quality over the corresponding NVR baselines.

eess.SP [Back]

Gang Liu, Yanling Hao, Yixuan Zou

TL;DR: CIG-MAE用跨模态信息引导掩码自编码器学习WiFi CSI动作识别表征，缓解标注数据稀缺。

Details

Motivation: WiFi信道信息可不采集图像地识别人体动作，但公开数据规模小；传统自监督对比增强也可能破坏无线信号物理语义并需大批量训练。

Result: 在三个公开数据集上持续超过先进自监督方法，甚至优于全监督基线，显示出较强数据效率和泛化能力。

Insight: 双流架构以高掩码比例同时重建CSI振幅和相位，按时频信息密度自适应分配掩码，并用Barlow Twins正则对齐模态而无需负样本。

Abstract: Human Action Recognition using WiFi Channel State Information (CSI) has emerged as an attractive alternative to vision-based methods due to its ubiquity, device-agnostic nature, and inherent privacy-preserving capabilities. However, the high cost of manual annotation and the limited scale of publicly available CSI datasets restrict the performance of supervised approaches. Self-supervised learning (SSL) offers a promising avenue, but existing contrastive paradigms rely on data augmentations that conflict with the physical semantics of radio signals and require large-batch training, making them poorly suited for CSI. To overcome these challenges, we introduce CIG-MAE – a Cross-modal Information-Guided Masked Autoencoder – that reconstructs both the amplitude and phase of CSI using a symmetric dual-stream architecture with a high masking ratio. Specifically, we propose an Adaptive Information-Guided Masking strategy that dynamically allocates attention to time-frequency regions with high information density to improve learning efficiency, and incorporate a Barlow Twins regularizer to align cross-modal representations without negative samples. Experiments on three public datasets show that CIG-MAE consistently outperforms SOTA SSL methods and even surpasses a fully supervised baseline, demonstrating superior data efficiency, robustness, and representation generalization.

hep-ph [Back]

[240] LLM-Based FORM Code Generation with Verification-Driven Fine-Tuning hep-ph | cs.CE | cs.CLPDF

Bakar Chargeishvili

TL;DR: 用FORM可执行程序作为验证器生成训练数据，并微调8B模型解决粒子物理符号语言FORM代码生成。

Details

Motivation: FORM广泛用于多圈费曼图代数计算，但作者发现目前尚无AI编程辅助；大模型在无文档、单次尝试时执行通过率为零。

Result: QLoRA微调Qwen3-8B后，在840个任务、四种基准上，执行率和严格验证输出匹配显著超过最大756B参数的前沿模型；小型困难基准上与其统计上相当，通用推理和编码能力仅下降2.6个百分点以内。

Insight: 让FORM二进制充当执行预言机，生成并验证4,633条涵盖确定性计算、开放程序、教程代码和知识问答的样例，实现验证驱动领域适配。

Abstract: FORM is a domain-specific symbolic manipulation language widely used in particle physics for processing the very large algebraic expressions arising from multi-loop Feynman diagram calculations. Despite its central role in precision theoretical physics, no artificial-intelligence tooling exists, to our knowledge, for assisting physicists in writing FORM code. We show that contemporary large language models (LLMs), including frontier models with hundreds of billions of parameters, achieve a zero-percent execution pass rate on our instruction-following and tutorial-style FORM tasks without documentation in a single attempt, establishing FORM as a genuine zero-shot language for LLMs at the time of writing. We then present a verification-driven data generation pipeline that uses the FORM binary itself as an execution oracle to produce and validate a corpus of 4,633 training examples spanning deterministic computations, open-ended programs, tutorial code, and knowledge question-answer pairs. Fine-tuning a compact open-weights model (Qwen3-8B) with quantized low-rank adaptation (QLoRA) yields a specialist that, evaluated on four complementary benchmarks (840 tasks, single attempt each), decisively outperforms frontier models with up to 756B parameters in execution rate and in strict, FORM-verified output matching on the larger benchmarks, and remains statistically indistinguishable from them on the smaller, harder ones. General reasoning and coding capabilities are preserved within 2.6 percentage points.

Table of Contents

cs.CV [Back]

[1] Did You Steal My Shot? Pioneering Camera Motion Plagiarism Detection in Generative Videos cs.CV | cs.MMPDF

[2] Enabling Vision and Cross-Modal Learning for Multimodal Stroke Recurrence Prediction: An Interpretable Two-Step Framework cs.CV | cs.AIPDF

[3] Rethinking Streaming Video Diffusion Model: Context, Execution, and Training cs.CV | cs.AIPDF

[4] Validating, Not Sampling: Region-Level Robustness of Vision-Language and Vision-Language-Action Models cs.CV | cs.AIPDF

[5] Authority-Preserving Evaluation of Medical Vision-Language Assistants cs.CV | cs.AIPDF

[6] GameReplica: A Benchmark for Black-Box Visual Game Replication by Vision-Language Agents cs.CV | cs.AIPDF

[7] Yarn tracking of large-scale 3D textile reinforcements using topological material features cs.CV | eess.IV | eess.SPPDF

[8] Hierarchical Aggregation of Semantic Uncertainty in 3D Scene Graphs cs.CVPDF

[9] MarsRecon: Self-Supervised and Multimodal Surface Representations for Mars cs.CV | cs.AIPDF

[10] Event-Frame Fusion for Inter-Frame Segmentation via Event-Guided Motion cs.CVPDF

[11] Spatiotemporal Flux Probing for Single-Photon Videography cs.CVPDF

[12] Style as Cover: Deep Image Steganography via Stylized Transmission cs.CV | cs.CR | cs.MMPDF

[13] Rethinking Vision Architectures with Gated Linear Attention and KAN cs.CVPDF

[14] Beyond the Leaderboard: Counterfactual Diagnosis of End-to-End and VLA Driving Policies Under Domain Shift cs.CV | cs.AIPDF

[15] Seeing is not Enough: Vision-Language Models Perceive Evidence but Fail to Act cs.CV | cs.AIPDF

[16] ConsistWorld: Evidence Routing for Consistent Multi-Agent World Models cs.CVPDF

[17] ZIL: Zero-shot Image-to-LiDAR Registration cs.CVPDF

[18] Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modeling cs.CV | cs.AIPDF

[19] DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Models cs.CVPDF

[20] Human-Level Accuracy, Non-Human Strategies: Revealing Model-Human Divergence in Video Physical Reasoning cs.CV | stat.APPDF

[21] PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining cs.CVPDF

[22] Planning-Aligned Pretraining of BEV Representations with Sparse Action-Conditioned Targets for End-to-End Autonomous Driving cs.CV | cs.AIPDF

[23] SatOV: Restoring Spatial Priors for Training-Free Open-Vocabulary Segmentation in Remote Sensing Imagery cs.CV | cs.AIPDF

[24] Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentation cs.CVPDF

[25] AVTR-1: Open Stack for Real-Time Interactive Avatars cs.CV | cs.AI | cs.LGPDF

[26] Scout: Open-World Species Recognition on the Edge cs.CV | cs.DC | cs.LGPDF

[27] An Evolutionary Agentic Approach for Open-ended Image Quality Perception cs.CV | cs.AIPDF

[28] Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generation cs.CVPDF

[29] RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling cs.CV | cs.AIPDF

[30] M3GA-Wild: A Large-Scale Dataset and Benchmark for Multi-Modal Multi-session Ground-to-Aerial Place Recognition in Forests cs.CV | cs.ROPDF

[31] General Collaborative Intelligence: Architecting Cognition for Resilient Multi-Agent Ecosystems cs.CV | cs.AI | cs.ROPDF

[32] MixiMotion: One-Step Text-to-Motion Generation via Asymmetric Set Distillation cs.CV | cs.MMPDF

[33] CrowdCue: Specialist-Cue Conditioning for Vision-Language Crowd Counting cs.CVPDF

[34] BrainIAC: Interactive 3D Brain Lesion Segmentation across Heterogeneous MRI Modalities with Online Adaptation cs.CVPDF

[35] VDGS: Visibility-Driven Large-Scale 3D Gaussian Splatting for Aerial Scene Reconstruction cs.CVPDF

[36] LD-RSVIS: A Large-Scale and Diverse Benchmark for Referring Surgical Video Instrument Segmentation cs.CVPDF

[37] MM-ContextFold: Context Folding for Multimodal Agentic Retrieval cs.CV | cs.AI | cs.IR | cs.MMPDF

[38] QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation cs.CV | cs.AIPDF

[39] SparkDiffusion: Mitigating the High-Sparsity Trap — A Unified Framework for up to $265\times$ Single-GPU Acceleration of Visual Generation cs.CVPDF

[40] GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting cs.CV | cs.AIPDF

[41] CausalWM: Causal Chain-of-Thought Reasoning for Embodied World Model cs.CVPDF

[42] SPACE: Semantic Projection and Alignment of CLIP Embeddings for Domain Adaptation cs.CVPDF

[43] RegVGGT: Sustainable Visual Geometry Grounding for Streaming via Regulated Memory cs.CVPDF

[44] MinCU: A Fine-Grained Benchmark for Grounded Minimal-Change Understanding in Image Pairs cs.CVPDF

[45] AniPrO: Interpretable Anime Image Provenance Detection via Multi-Dimensional Semantic Reasoning cs.CVPDF

[46] Vision-Wireless Fusion for Multi-User Localization: A Cross-Modal Transformer Approach cs.CV | eess.SPPDF

[47] The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models cs.CVPDF

[48] Enhancing Shrimp Disease Detection via Deep Learning and Data Refinement for Resilient Aquaculture cs.CV | cs.AI | cs.ETPDF

[49] Semi-automated reconstruction of indoor geometry from 360-degree video for CFD-based airflow analysis in classrooms cs.CV | cs.CE | physics.flu-dynPDF

[50] RSPDBench: Benchmarking Vision Foundation Models on Earth Observation Tasks Under Physically Grounded Remote-Sensing Product Degradations cs.CVPDF

[51] HOIBlender: Blending Lightweight Detection with Vision-Language Priors for Efficient Human-Object Interaction Detection cs.CVPDF

[52] GAPS: Generative Active Pseudo-view Selection for Sparse-View 3D Gaussian Splatting cs.CVPDF

[53] PhysReflect: Geometry and Perception Guided Diffusion for Physically-Plausible Mirror Reflections cs.CV | cs.AIPDF

[54] Algebraic Consistency Alone Does Not Certify Temporal Structure in Latent Action Models cs.CV | cs.ROPDF

[55] CE$^4$L: Continual Ego, Exo, and Ego-Exo Learning cs.CV | cs.AIPDF

[56] Pay More Attention To Text In High-Resolution MLLMs cs.CVPDF

[57] Detecting Phone-Induced Pedestrian Distraction via a Multimodal Fusion Transformer cs.CVPDF

[58] GeoBalance: Geometry-Aware Monitoring and Reconstruction with Asymmetric Optimization for Balanced Multimodal Learning cs.CV | cs.MMPDF

[59] Towards robust multimodal 3D object detection via visual foundation models cs.CV | cs.ROPDF

[60] Modeling Clinical Workflow for SYNTAX Scoring from Coronary Angiography Videos cs.CV | cs.AIPDF

[61] Transferring Visual Explanations: How Cross-Architecture Knowledge Distillation Affects Model Interpretability cs.CVPDF

[62] MaskVLA: Visual Masking Against Trajectory Overfitting of Vision-Language-Action Model cs.CV | cs.AI | cs.ROPDF

[63] An Efficient and Effective Watermarking Scheme for the Protection of the Intellectual Property Rights of Video Generative Models cs.CVPDF

[64] Collapse, Not Complexity: Failure-Conditioned Decomposition Repair for End-to-End Document Parsing cs.CV | cs.CLPDF

[65] PETR: Prompt Ensembling with Training-free Routing for Vision-Language Models cs.CV | cs.AIPDF

[66] PREM: Prefix-Steered Recurrent Memory for Long-Video Understanding cs.CV | cs.AIPDF

[67] Reassessing Global Gradient-Norm Imbalance in BLIP Fine-Tuning Across Physical Domains cs.CVPDF

[68] Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanisms cs.CV | cs.LGPDF

[69] Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Ranking cs.CV | cs.ROPDF

[70] Infectious Bovine Pinkeye Detection Using Computer Vision and Imbalance-Aware Learning cs.CVPDF

[71] Layer-Aware Position Embeddings for Visual Token Pruning in Multimodal Large Language Models cs.CVPDF

[72] BindCLIP: One Balanced Coupling For Compositional Vision Language Scoring cs.CVPDF

[73] Training-Free Spectral Transductive Refinement for Cross-Domain Few-Shot Classification cs.CVPDF

[74] PRISM-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Tobacco Product and Legislative Policy Reasoning cs.CVPDF

[75] Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene cs.CV | cs.GRPDF

[76] VISTA: Video-Injected Stylized Text-to-Animation cs.CV | cs.GRPDF

[77] Rethinking Diffusion Segmentation: When Does It Rely on Its Noisy State, and Does Diffusion Matter? cs.CV | cs.LGPDF

[78] Colon3R: Cross-Domain 3D Reconstruction from Monocular Colonoscopic Video cs.CV | cs.ROPDF