cs.CV [Total: 305]
cs.CL [Total: 82]
cs.AI [Total: 41]
cs.CR [Total: 1]
cs.IR [Total: 3]
cs.LG [Total: 38]
cs.MA [Total: 1]
cs.RO [Total: 20]
cs.SD [Total: 2]
eess.AS [Total: 2]
eess.IV [Total: 4]
physics.optics [Total: 1]

cs.CV [Back]

[1] Temporal-Attention Head Specialization During Video Diffusion Training cs.CV | cs.AIPDF

Taewoo Ha, Shafayat Mowla Anik, Dae Yeol Lee, Byeong Kil Lee, Jeeho Ryoo

TL;DR: 该研究逐检查点统计视频扩散 Transformer 的每个时间注意力头，发现总体平均趋势会掩盖少数头逐渐形成的跨帧局部路由结构。

Details

Motivation: 关于时间注意力的认识多来自训练完成后的模型；训练过程中结构何时、如何形成仍不清楚。总体平均还可能把少数专门化头与多数未专门化头的变化相互抵消。

Result: 对 9 次 Open-Sora STDiT 训练（306M–1.03B 参数）的检查显示，各次运行的总体跨帧注意力集中度平坦或下降，但完整网格运行中约 4%–13% 的头出现明显集中。所选头可重复出现在第一个时间块，但具体头坐标不稳定；760M 模型中的注意力图主要呈现自身帧对角线和相邻帧带状模式。相关性与消融未能证明这些模式因果性地改善生成视频质量。

Insight: 逐检查点、逐头分析结合预先登记的变化点和效应量规则，比仅看总体平均更能揭示稀疏结构。论文将结论限定在 STDiT 家族及所观察的结构，没有把头部专门化等同于生成质量提升。

Abstract: Video diffusion transformers depend on temporal attention to coordinate information across frames, yet nearly everything known about this mechanism comes from analyzing trained models, so when and where temporal-attention structure forms during training remains poorly characterized. Population averages can also hide it, since a few specializing heads and a diffusing majority cancel in the mean. We therefore conduct a checkpoint-resolved census of every temporal-attention head across nine Open-Sora STDiT training runs spanning three model scales (306M to 1.03B parameters), scoring each head with an entropy-normalized measure of cross-frame attention concentration (CFAC) under a preregistered change-point and effect-size selection rule. The census reveals the sparse picture that averages obscure. Aggregate CFAC is flat or decreasing in every run, while a small minority of heads, roughly 4–13% in full-grid runs, develops pronounced concentration. Across seeds, the reproducible signal is positional but block-level. Selected heads repeatedly arise in the first temporal block, whereas individual head coordinates do not reproduce once block membership is accounted for. Among the analyzed 760M selected heads, attention maps converge to a small repertoire of local frame-routing motifs, self-frame diagonals and adjacent-frame bands, even when the responsible coordinates differ across runs. Correlation and ablation analyses do not establish a causal link to generated video quality, and we bound our claims accordingly. Beyond this STDiT family, the study contributes a transferable methodology. Checkpoint-resolved, per-head analysis under fixed selection rules can expose sparse temporal organization in other factorized video diffusion transformers and, with adapted routing metrics, in joint spatio-temporal architectures.

[2] One Evaluation, Any Operating Point: Hypernetwork-Amortized MeanFlow for 3D MRI Reconstruction cs.CVPDF

Ruibo Wang

TL;DR: 该 MRI 重建方法把采集工作点作为输入，用超网络调节单步 MeanFlow 重建器，并通过可微数据一致性投影共同适配采样模式和重建。

Details

Motivation: 生成式先验用于加速三维 MRI 重建时通常需要每个体积进行多次网络评估，并针对扫描协议调参；固定采样模式本身也是部署中的限制。作者尝试把数据一致性权重、加速率和采样模式共同纳入工作点。

Result: 临床膝部数据上，学习采样掩码较协议默认的变密度掩码最高提升 2.34 dB；该收益依赖求解器，前馈重建器在 4 倍加速时反而下降 1.7 dB，而加上数据一致性投影后收益为 4.6 dB。单次网络评估相较 20 步 patch-diffusion 在脑部和膝部最高分别提升 3.1 dB、2.9 dB；3–5 次评估可将性能前沿提升至最高 6 dB，同时网络调用约为其四分之一。真实数据 4 倍加速下，自监督训练可匹配监督版本。

Insight: 可微共轭梯度投影不是附加小细节，而是学习采集模式发挥作用的关键环节。论文还报告了失败尝试：基于测量能量的受试者自适应采集、自监督与学习采集联合训练，以及对数据一致性权重的摊销都未成功。

Abstract: Generative priors reconstruct accelerated 3D MRI well but pay heavily at deployment: tens of network evaluations per volume, and protocol-specific hyperparameter tuning. A third hidden cost is the scanner’s fixed sampling pattern. We treat the whole operating point as an input. A 3D MeanFlow patch network (a one-step flow model) is fine-tuned end-to-end through a warm-started, five-iteration differentiable conjugate-gradient projection. A small hypernetwork maps the operating point (data-consistency weight, acceleration, and the Cartesian sampling pattern itself) to the network’s per-channel modulation. Three findings follow. (i) Learning the acquisition is worth more than any other operating point: on clinical knee data, the learned mask gains up to +2.34 dB over the protocol’s variable-density mask. This gain requires the solver: with a feed-forward reconstructor the same learned mask hurts at 4x (-1.7 dB), but with the data-consistency projection it adds +4.6 dB. (ii) One evaluation is highly effective: it beats a 20-step patch-diffusion prior by up to +3.1 dB on brain and +2.9 dB on knee. Three to five evaluations extend the front to +6 dB while using a quarter of the prior’s network calls. (iii) Fully sampled targets are optional: trained self-supervised on a split of acquired samples, the reconstructor matches its supervised twin at 4x on real data. Finally, we report what failed and why: subject-adaptive acquisition from measured energy, combining self-supervision with learned acquisition, and amortising the data-consistency weight.

[3] PalmLeaf-VQA: A Multi-Script Visual Question Answering Benchmark for Historical Palm-Leaf Manuscript Understanding Across Diverse Regions cs.CV | cs.AI | cs.CL | cs.LGPDF

Nimol Thuon, Jun Du, Panhapin Theang

TL;DR: PalmLeaf-VQA 是面向南亚和东南亚历史棕榈叶手稿的多文字体系视觉问答基准，重点考察版面、材料、保存状况及局部视觉线索。

Details

Motivation: 现代视觉语言基准很少覆盖文化多样、文字非拉丁、严重退化的历史手稿，因而难以判断多模态大模型能否理解其版面和保存相关特征，而不仅是识字。

Result: 基准包含 923 张手稿图像和 7,384 组问答，覆盖八类收藏。测试集上表现最好的受评模型 exact-match 仅为 58.00%，显示当前模型在稀有文字、退化版面和文物保存导向理解上仍有明显不足。

Insight: 任务覆盖物理状况、行结构、材料与涂层、装订孔、边缘、符号、图画及局部伪影，并同时采用开放回答与受限回答评测。细分集合和问题类别的设计可帮助定位多模态文档理解中的具体短板。

Abstract: Historical manuscripts remain largely absent from modern vision-language benchmarks, leaving open how well multimodal large language models (MLLMs) handle culturally diverse, degraded, and non-Latin document images. We introduce \textbf{PalmLeaf-VQA}, a multi-script visual question answering benchmark for historical palm-leaf manuscript understanding across South and Southeast Asian traditions. PalmLeaf-VQA contains \textbf{923 curated manuscript images} and \textbf{7,384 question–answer pairs} from eight collection groups: Balinese, Grantha, Jathakam, Kambaramayanam, Kannada, Khmer, Sundanese, and Tamil. Unlike recognition-oriented resources, the benchmark targets manuscript-aware visual reasoning over preservation-relevant cues, including physical condition, line structure, material and coating, binding holes, margins, symbols, drawings, and localized visual artifacts. We evaluate recent proprietary and open-weight MLLMs under open-answer and constrained-answer prompting and provide fine-grained analysis across collections, question categories, and task types. The strongest evaluated model reaches only \textbf{58.00% exact-match accuracy} on the held-out test split, revealing substantial limitations in current MLLMs for rare-script, degraded-layout, and preservation-oriented document understanding. PalmLeaf-VQA provides a standardized benchmark for advancing culturally grounded and layout-aware multimodal document analysis.

[4] ForensicZoom: Adaptive Visual Inspection with Multimodal LLMs for Industrial-Grade Face Forgery Detection cs.CVPDF

Hang Zhou, Yiming Tang, Kun Yu, Qian Zhu, Minghao Li

TL;DR: ForensicZoom 让多模态大模型在初看证据不足时主动放大可疑区域，以多轮视觉检查提高人脸伪造检测能力并生成可操作的归因说明。

Details

Motivation: 专用取证检测器虽有较强检测能力，却难解释判断；多模态大模型能理解语义并生成理由，但人脸伪造识别能力较弱。细微取证痕迹在常规分辨率下不易观察，而所有图像都提高分辨率又会增加计算成本。

Result: 在大规模工业身份验证数据上，ForensicZoom 达到超过 97% 的 TPR（FPR 为 0.1%），显著优于论文比较的专用检测器和既有多模态大模型方法，并生成有行动参考价值的取证归因。摘要未提供更多数据集或置信区间信息。

Insight: 模型先获得取证特征表征并与语言模型对齐，再通过 NEED_ZOOM 在证据不足时自主请求局部放大；奖励设计平衡检测准确性与不必要的检查，最终归因优化则尽量不损害检测表现。自适应分配高分辨率计算是其主要设计点。

Abstract: Reliable face forgery detection is critical to the security of online identity verification systems, where missed attacks compromise security and excessive false positives disrupt legitimate users. Specialized forensic detectors achieve strong detection performance but provide limited interpretability, while multimodal large language models (MLLMs) offer strong semantic understanding and interpretable reasoning yet remain substantially weaker for face forgery detection. We argue that a key limitation lies in how visual evidence is acquired: subtle forensic artifacts may be poorly represented at standard resolution, while uniformly processing all cases at higher resolution is computationally inefficient. We therefore introduce ForensicZoom, an industrial-grade MLLM framework for adaptive visual inspection. ForensicZoom first equips a general-purpose MLLM with forensic-aware visual representations and aligns the language model with these features. Its central mechanism, NEED_ZOOM, enables the model to autonomously request magnified views of suspicious regions when the initial evidence is insufficient, turning fixed-pass classification into adaptive multi-round forensic reasoning. The zoom behavior is learned through reward shaping that balances detection accuracy with unnecessary visual inspection, concentrating additional computation on difficult cases. A final attribution optimization stage improves natural-language forensic reports while preserving detection performance. On large-scale industrial identity verification data, ForensicZoom achieves over 97% TPR at 0.1% FPR, substantially outperforming both specialized detectors and existing MLLM-based methods while producing actionable forensic attributions. These results demonstrate that ForensicZoom can provide an effective path toward accurate, interpretable, and scalable MLLM-based face forgery detection.

[5] Cross-Dataset Transfer and Unknown-Class Detection in Imbalanced SAR Ship Classification cs.CV | cs.AI | cs.LGPDF

Ch Muhammad Awais, Marco Reggiannini, Davide Moroni, Giulio Del Corso

TL;DR: 该研究系统比较六种预训练模型在 SAR 船舶分类中的域内识别、跨数据集迁移和未知类别检测，揭示跨数据集泛化及 MC Dropout 不确定性估计的局限。

Details

Motivation: 合成孔径雷达船舶分类模型常在一个数据集上训练、另一个数据集部署，但这种域迁移下的鲁棒性和未知类别检测能力尚缺少全面评估。

Result: 域内设置下 SARDet100K 在 FUSARShip 和 OpenSARShip 上的平衡准确率分别为 73.4% 和 53.2%。跨数据集迁移可出现普通准确率尚可但平衡准确率接近随机的情况，例如 OpenSARShip 到 FUSARShip 为 64.5% 准确率、33.3% 平衡准确率。未知类检测表现随留出类别和数据集而变，MC Dropout 方差常接近随机。

Insight: 跨域评估不应只看总体准确率，类别不均衡可能掩盖严重迁移失败；针对任务设计的不确定性分数往往比 MC Dropout 方差更有信息，但不同数据集和留出类别上的排序并不固定。

Abstract: Ship classification from Synthetic Aperture Radar (SAR) imagery is a critical computer vision task, yet the robustness of models under deployment shifts remains unclear. While models are often trained on one dataset and deployed on another, we lack a comprehensive understanding of their cross-dataset generalization. To address this, we evaluate six pretrained models on two SAR ship datasets in three settings: in-domain classification, cross-dataset transfer, and unknown-class detection. For unknown detection, we hold out all classes one at a time. In-domain, SARDet100K gives the best balanced accuracy on both datasets (73.4% on FUSARShip and 53.2% on OpenSARShip). In cross-dataset transfer, we observe strong failures: some models show moderate accuracy but near-chance balanced accuracy (for example, 64.5% accuracy but 33.3% balanced accuracy for OpenSARShip to FUSARShip). In unknown detection, performance depends on the held-out class and dataset, while MC-dropout variance is often close to random. These findings show that cross-dataset generalization in SAR remains limited and that task-specific uncertainty scores are often more informative than MC-dropout variance for held-out-class detection, although their relative ranking depends on the dataset and held-out class.

[6] Language-Augmented Video Action Anticipation: Design Fundamentals, Benchmarks, and Open Challenges cs.CVPDF

Mahsa Mohammadi, Zeyu Fu, Sareh Rowlands

TL;DR: 这篇综述为语言增强的视频动作预测建立证据感知的设计图谱，按任务类型和语言信息介入位置整理方法，并强调通过匹配对照验证因果主张。

Details

Motivation: 现有工作在任务定义、视觉预训练、监督方式、解码器和评测代码上常同时变化，因此很难把报告的提升归因于语言信息本身，也难比较不同设置的结果。

Result: 综述按六个维度刻画任务，并归纳单动作、动作序列、物体交互、跨视角和规划导向五类任务；C1–C3 分别描述语言在上下文构造、目标/意图建模和未来解码中的介入，C4 作为相邻的新兴落地/可执行性扩展。论文还审计 Ego4D-LTA 与 EPIC-KITCHENS-100 协议并提出 BCAP。作者把语言模型收益、目标歧义和预测时域影响列为待验证假设，而非因果结论。

Insight: 综述的核心贡献是把每种设计选择对应到合适的反事实对照、失败诊断及可支持的证据主张。对未解决的 EK-100 记录，作者仅作为报告可比性案例，不纳入排行榜，以避免把不一致协议下的成绩当成直接比较。

Abstract: Action anticipation predicts future human actions from partial video under incomplete context and temporal uncertainty. Recent systems introduce large language models (LLMs), vision-language models (VLMs), or language-derived semantics at different stages, but reported gains are difficult to interpret when task formulation, visual pretraining, supervision, decoder design, and evaluation code change simultaneously. The central contribution of this review is an evidence-aware design map that crosses task regime with the point at which language-derived information intervenes. We characterise task regimes along six axes. These axes organise the literature into five broad task families: single-action, sequence, object-interaction, cross-view, and planning-oriented settings. C1-C3 locate interventions in context construction, goal/intention modelling, and future decoding, while C4 is treated as an adjacent, emerging grounding/executability extension. Unlike a generic processing pipeline, the map links each intervention to an appropriate counterfactual, failure diagnosis, and permissible evidence claim. Supporting contributions include a protocol-level audit of Ego4D-LTA and EPIC-KITCHENS-100, a multidimensional evidence profile, and the Backbone-Aware Comparison and Ablation Protocol (BCAP). The unresolved EK-100 record is treated as a reporting-comparability case study and is not used as a leaderboard. Evidence for LLM benefits, goal ambiguity, and horizon effects is therefore formulated as testable hypotheses requiring matched validation, not as causal conclusions. The accompanying package contains the coded evidence, source locators, protocol metadata, and versioned catalogue used in the review.

[7] Query-aligned video frame selection for long video understanding cs.CV | cs.AIPDF

Md. Safayet Islam, Dilip Sarkar, Liang Liang

TL;DR: 该方法在多选视频问答中把答案选项作为推理时线索，与问题共同匹配候选帧，从固定帧预算中挑选更相关的视觉证据。

Details

Motivation: 长视频包含大量帧，而多模态大模型通常只能处理其中 8–64 帧；均匀采样不考虑具体问题，可能遗漏回答所需片段。已有免训练帧选择方法也未直接利用多选答案语义。

Result: 在 MLVU、Video-MME 和 LongVideoBench 上，使用 LLaVA-Mini、Qwen2-VL 和 LLaVA-Video 评估时，答案感知选帧在相同帧预算下总体优于均匀采样及既有免训练选帧方法。摘要未给出逐模型、逐基准的具体分数。

Insight: 方法先按固定间隔生成紧凑候选帧池，再计算帧与问题—答案对的最大余弦相似度并选择相关帧；因此不增加帧/token预算，也无需训练，但证据仅覆盖摘要所述的多选题设置。

Abstract: Multimodal large language models (MLLMs) process multimodal inputs by converting text, images, and videos into token sequences that are subsequently processed by a backbone language model. While MLLMs have achieved excellent performance in understanding the content of individual images, video understanding remains significantly more difficult because videos contain large number of video frames. MLLMs typically process only a subset of these frames, usually ranging from 8 to 64. MLLMs usually sample frames uniformly, regardless of their relevance to the question being answered. To address this limitation, several training-free, model-agnostic methods for selecting question-relevant frames have recently been proposed. In this work, we introduce a frame-selection method designed specifically for multiple-choice questions. We extend the query text by appending semantic cues derived from the answer choices and employ a direct query-frame alignment scoring mechanism. To the best of our knowledge, our method is the first to directly utilize answer choices as inference-time cues for selecting frames relevant to answering a question. The method first constructs a compact candidate pool by subsampling video frames at a fixed rate. The frames are then scored according to their maximum cosine similarity across all question-answer pairs to identify the most relevant frames for a given query. This approach preserves a fixed token budget while improving the relevance of the visual evidence provided to the downstream MLLM. We evaluate the effectiveness of our frame-selection method on the MLVU, Video-MME, and LongVideoBench benchmarks using three MLLMs: LLaVA-Mini, Qwen2-VL, and LLaVA-Video. Experimental results demonstrate that answer-aware frame selection generally outperforms uniform sampling and existing training-free frame-selection methods under the same frame budget.

[8] Toward AI-Assisted Poultry Coccidiosis Diagnosis: Evaluating Gemini and BiomedParse on Eimeria Microscopy Images cs.CV | cs.AIPDF

Ali Alsalama, Ahmed Kubba, Manar Abu Talib

TL;DR: 该研究评估通用多模态模型 Gemini 与分割模型 BiomedParse 能否用于家禽艾美耳球虫的显微图像诊断，结果显示目前不适合独立诊断。

Details

Motivation: 球虫病造成显著养殖损失，控制措施依赖准确到物种层面的诊断。研究考察多模态大模型能否识别七种感染家禽的艾美耳球虫，并生成病理报告或分割寄生虫。

Result: 在 4,225 张显微图像上，不提供候选标签时 Gemini 给出宽泛且分类不一致的答案；提供类别列表后总体准确率仍只有 14.9%，并偏向 E. tenella（74%），对 E. acervulina、E. mitis 和 E. praecox 均无正确分类。生成的治疗报告虽连贯但未经验证，BiomedParse 只实现部分分割。

Insight: 候选类别约束没有消除严重的类别偏置，语言流畅也不能替代诊断正确性或临床验证。作者认为需要领域微调和专家验证，现阶段不应把模型当作独立诊断工具。

Abstract: Coccidiosis caused by Eimeria parasites is a major economic burden in poultry production, and effective control depends on accurate species-level diagnosis. This study evaluates whether a general-purpose multimodal large language model can support such diagnosis. Google Gemini was assessed on 4,225 mi- croscopy images covering the seven fowl-infecting Eimeria species under two prompting conditions, one without candidate labels and one with a predefined class list, and was further tested for pathology-report generation, while BiomedParse was examined for parasite segmentation. Without candidate labels, the model produced broad and taxonomically inconsistent outputs. With candidate labels, overall accuracy reached only 14.9%, with a strong bias toward E. tenella at 74% and no correct classifications for E. acervulina, E. mitis and E. praecox. Generated treatment reports were coherent but unverified, and segmentation was only partial. Current multimodal models are therefore not yet reliable for standalone Eimeria diagnosis without domain-specific fine- tuning and expert validation.

[9] Adapting Vision-Language Models for Human-Readable XAI in Industrial Object Detection cs.CV | cs.AIPDF

Sarvenaz Sardari, Freddy Fernandes, Samarth Yelvande, Jose Moises Araya-Martinez, Alina Roitberg

TL;DR: 该工作微调视觉语言模型，为工业目标检测界面生成面向非专家工人的上下文解释，以提升解释的清晰度、指令遵循和图像依据。

Details

Motivation: 制造现场的质量控制人员并非都具备机器学习背景，而多数可解释 AI 方法面向技术专家；未经适配的视觉语言模型也常无法给出清楚且贴合工业情境的解释。

Result: 作者基准评估发现，开箱即用的视觉语言模型在解释清晰度和语境相关性方面不足。微调并集成到界面后，在专有数据和公开机器人数据上，相较 GPT-4o-mini 提升了解释清晰度、指令遵循、图像依据和情境感知；摘要未报告具体数值。

Insight: 该工作把视觉语言模型的生成能力用作人机界面层的解释器，并通过领域微调改善面向非专家的表达。摘要支持多项解释质量指标上的改善，但未提供用户研究规模或量化分数。

Abstract: Explainable Artificial Intelligence (XAI) solutions are essential for building trust in AI technologies and their integration in real manufacturing lines. However, most existing methods are tailored to technical experts, limiting their accessibility to diverse user groups such as blue-collar workers in manufacturing lines who use AI for quality control. In this work, we introduce an XAI interface for object detection in industrial manufacturing based on a fine-tuned vision-language model, designed to generate intuitive explanations for non-expert users. We benchmark existing vision-language models and demonstrate that out-of-the-box models often fall short in delivering clear, context-relevant explanations for non-expert users. To address this, we fine-tune a vision-language model and integrate it into our interface, enabling contextualized, accessible explanations for non-expert users. We demonstrate improvements in explanation clarity, instruction adherence, image groundedness, and contextual awareness over GPT 4o-mini on proprietary and public robotics dataset. This approach advances the accessibility and usability of AI explanations, making them more intuitive and applicable in manufacturing domain.

[10] RemTraceNet: Few-Shot Forensic Detection of Invisible Watermark Attacks cs.CV | cs.CRPDF

Jidong Yang, Huaike Yu, Qi Li, Yuantian Miao, Wei Zong

TL;DR: RemTraceNet 研究不可见水印去除留下的取证痕迹，利用少样本训练判断图像是否经过特定水印攻击，区分“水印被破坏”和“攻击痕迹被抹除”。

Details

Motivation: 水印验证失败并不能说明攻击过程不可检测；去除痕迹可为来源和所有权核验提供补充证据。既有方法多关注水印抑制与图像质量，较少评估攻击本身的取证隐蔽性。

Result: 在 23 条去除流程、10 种水印配置及 256×256、512×512 输入上，每条流程仅使用 100 张受攻击训练图像时，三种子宏平均 TPR@1%FPR 为 82.75%–88.17%。在标签和协议一致的比较中，RemTraceNet 比重新训练的 SRNet、ZhuNet 和 SiaStegNet 高 10.80–15.68 个百分点。

Insight: 模型融合受约束残差、局部关系、FFT/Haar 统计及原始分辨率块 DCT 证据，并以攻击流程为单位进行少样本取证。实验说明有限监督下仍可学习去除痕迹，但能力针对已知攻击流程的专门检测。

Abstract: Removing an invisible watermark and concealing the forensic evidence are distinct objectives: successfully disrupting the embedded watermark does not imply that the removal process is forensically undetectable. When verification fails, removal traces can provide complementary evidence for provenance and ownership verification, whereas their absence leaves the cause of the failure ambiguous. Existing methods are typically evaluated by watermark suppression and perceptual quality, while forensic stealth is rarely considered. We therefore study watermark-attack-specific few-shot forensics: for each known pipeline, a specialist can separate its outputs from paired clean and unattacked watermarked controls. Separate Attack-vs-Clean and Attack-vs-Watermarked evaluations prevent watermark-presence shortcuts. Image-aligned and prompt-matched controls are used for post-hoc and generator-integrated schemes, respectively. In this work, we introduce RemTraceNet, which fuses constrained residuals, local relations, FFT/Haar statistics, and block-DCT evidence at native resolution. Across 23 removal pipelines and 10 watermark configurations, we evaluate native 256 x 256 and 512 x 512 inputs. With 100 attacked training images per pipeline, the three-seed TPR@1%FPR, macro-averaged over attacks and watermark configurations, ranges from 82.75% to 88.17% across resolutions and control types. Under the condition of same labels and protocol, RemTraceNet outperforms retrained SRNet, ZhuNet, and SiaStegNet baselines by 10.80–15.68 percentage points. Extensive experimental results show that erasing a watermark and erasing evidence of its removal are distinct challenges, and that removal traces remain learnable under limited supervision.

[11] Video Captioning in Low-Light Conditions through Efficient Uncertainty-Aware Caption Correction cs.CVPDF

Arefeh Rezaei

TL;DR: 该工作在 VideoChat2 的视觉表示与语言模型之间加入轻量稀疏高斯过程校正器，利用不确定性感知的残差修正改善低照度视频描述。

Details

Motivation: 低照度会降低视觉语言模型识别视频中人物动作并准确描述的能力。作者希望避免微调整个模型，改为单独学习投影表示与验证目标之间的误差，并根据不确定性控制修正幅度。

Result: 校正器仅用 ARID 数据集中的 44 个样本单独训练，推理仅增加少量计算。论文通过残差预测的定量评估及生成描述的定性分析考察效果；摘要没有给出指标数值或具体提升幅度。

Insight: 分区组合核用于改进残差估计，校正量再经不确定性系数自适应缩放并加回原始表示。方案不改动基础 VLM 权重，作者称其设计可迁移到其他兼容架构，但摘要未展示跨模型验证结果。

Abstract: Low-light conditions can significantly degrade the ability of vision-language models (VLMs) to accurately describe human actions in videos. In this work, I propose an efficient uncertainty-aware representation correction framework for improving captions generated by VideoChat2 under real-world low-light conditions. Instead of fine-tuning the underlying VLM, the proposed framework introduces a lightweight sparse Gaussian process-based error estimation module between the projection layer and the language model to correct the intermediate representation. The correction module learns to estimate the residual between the original projected representation and a verified target representation, which is then adaptively scaled using a newly formulated uncertainty-aware coefficient and added to the original representation. To further improve residual estimation, I introduce a partitioned combined-kernel design. The correction model is trained separately using only 44 samples from the ARID dataset and requires only a small additional computational overhead during inference. The effectiveness of the proposed correction is evaluated through quantitative residual prediction and qualitative analysis of the generated captions. Although VideoChat2 is used in my experiments, the proposed framework is designed to be applicable to other compatible VLM architectures. \textbf{Code Availability: The implementation accompanying this work is publicly available at}:\href{https://github.com/areferezaee/Low-rank-SVGP-NP-update}{https://github.com/areferezaee/Low-rank-SVGP-NP-update}

[12] Modernising the Compressed-Domain Video Captioner: A Controlled Study of SigLIP2 and GPT-2 Substitutions cs.CVPDF

Ashim Nepal, Ashok B. K

TL;DR: 该受控研究分别用 SigLIP2 替换压缩域视频描述器 CoCap 的图像编码器、用 GPT-2 替换解码器，发现编码器替换有益，而小数据下加入 GPT-2 会造成过拟合。

Details

Motivation: 压缩域描述直接使用 I 帧、运动向量和残差，可减少视频解码开销；但 CoCap 使用的 CLIP 编码器和浅层 BERT 式解码器较旧。研究在相同数据、采样预算与训练计划下检验哪个组件限制准确率。

Result: 作者在 VATEX 的 4,999 个片段上复现 CoCap，CIDEr/METEOR 为 54.9/23.4，BLEU-4/ROUGE-L 为 29.7/48.9；差异被归因于评测子集，与原论文结果不可直接比较。仅替换 SigLIP2 后所有指标改善，CIDEr 增加 4.5；再加入 GPT-2 后收益回落，作者将其归因于 GPT-2 在两轮训练内对小样本过拟合。摘要称报告了延迟，但未给出数值。

Insight: 受控替换显示提升取决于组件与训练数据规模的匹配，更新解码器并不必然带来收益。压缩域方法的速度是主要动机，因此准确率与延迟应共同报告；该实验的绝对结果受 4,999 片段子集和较低采样预算限制。

Abstract: Compressed-domain video captioning avoids full video decoding by operating directly on I-frames, motion vectors and residuals, trading a small amount of accuracy for a large gain in inference speed. CoCap established this pipeline using a CLIP vision encoder and a shallow BERT-style multimodal decoder. Both components predate substantially stronger alternatives. We ask a narrow, controlled question: how much of CoCap’s accuracy is limited by these two components, and which of the two is the binding constraint? We replace the CLIP I-frame encoder with SigLIP2 and the BERT-style decoder with GPT-2, and evaluate three configurations (the original pairing, the encoder substitution alone, and both substitutions together) under identical data, sampling budget and optimisation schedule. All comparisons are made against our own reproduction of CoCap rather than its published numbers, because we train on a 4,999-clip subset of VATEX at a reduced sampling budget; absolute values are therefore not comparable with the original work. Our reproduction tracks the published result closely: CIDEr and METEOR run slightly above it (54.9 against 52.7; 23.4 against 23.2), BLEU-4 and ROUGE-L slightly below (29.7 against 31.4; 48.9 against 49.4). We attribute the differences to our evaluation subset rather than to any improvement in either direction. We find the two substitutions pull in opposite directions: SigLIP2 alone improves every metric (+4.5 CIDEr), while adding GPT-2 on top erodes that gain, because a pretrained decoder overfits 4,999 clips within two epochs. We additionally report inference latency for each configuration, since speed is the property that motivates compressed-domain captioning in the first place, and an accuracy gain purchased at a latency cost should be reported as such.

[13] Can’t Find Waldo: Evaluating VLMs’ Sensitivity to Image Resolution and Detail Level cs.CV | cs.AIPDF

Alexandra Schild, Gerard de Melo

TL;DR: 该研究提出两个度量来分离视觉语言模型在高分辨率图像上的缩放鲁棒性和预测不稳定性，并归纳三种常见失效机制。

Details

Motivation: 高分辨率图像中的小区域细节和复杂场景仍会让视觉语言模型出错；既有工作提出了若干解决方案，但对性能为何随分辨率变化缺乏能排除任务难度影响的系统评估。

Result: 在 5 个模型家族和 5 个基准上的受控实验发现三类问题：视觉 token 上限导致下采样信息丢失；非标准宽高比下的 patch 边界变化和位置编码脆弱性引发分词伪影；token 增多造成注意力稀释。即使先进模型也会随分辨率升高而退化，且模式随架构家族而变；摘要未给出统一数值。

Insight: 语义保持变换用于将分辨率效应与任务难度区分；AUSC 衡量独立于基线准确率的缩放鲁棒性，PVS 衡量分辨率引起的预测不稳定性。分析结果可为架构与数据增强设计提供针对性线索。

Abstract: Visual Language Models (VLMs) have achieved remarkable success across diverse tasks, yet they struggle with high-resolution inputs where critical information resides in small regions or detailed, cluttered scenes. While several approaches address this limitation, a systematic understanding of why models fail at high resolutions is lacking. We introduce a controlled evaluation framework that disentangles resolution-related performance degradation from task difficulty through semantics-preserving transformations. We propose two simple metrics: Area Under the Scaling Curve (AUSC), which quantifies scaling robustness independent of baseline accuracy, and Prediction Variance Score (PVS), which measures resolution-induced prediction instability. Through comprehensive experiments across 5 model families and 5 benchmarks, we identify three primary failure modes: (1) information loss from downsampling at vision token limits, (2) tokenization artifacts from patch boundary shifts and positional encoding fragility under non-standard aspect ratios, and (3) attention dilution as token counts increase. Our analysis reveals that even state-of-the-art models suffer from performance drops when processing high-resolution images, with degradation patterns varying systematically by architectural family. We provide actionable insights for model architecture design and data augmentation strategies to mitigate these limitations.

[14] Cross-Dataset Generalization of Bangladeshi Rice Leaf Disease Classifiers: Benchmark, Diagnosis, and Mitigation cs.CVPDF

Anindya Paul

TL;DR: 该研究在三个孟加拉国水稻叶病数据集上系统评估跨数据集迁移，并发现强增强有效、AdaBN 有害，主要挑战更可能来自采集条件变化。

Details

Motivation: 在一个图像集合上训练的水稻病害分类器部署到另一数据集时性能常明显下降。研究通过多数据集迁移实验诊断失败原因，并检验常用适配策略是否有效。

Result: 实验覆盖 5,419 张图像、6 个迁移方向、3 种 CNN 和 3 个随机种子。强数据增强使跨域宏 F1 平均提高 0.070（Wilcoxon p<0.001，18 个迁移对中 15 个为正）。去除非叶片区域平均提高 0.066，但 p=0.062，未达常用显著性门槛。DINOv2 线性探针也出现与 CNN 相近的迁移崩塌；AdaBN 一致有害，且损害与标签先验差异和模型深度相关（Spearman ρ=0.621，p=0.009）。

Insight: 跨域失败并非只由 CNN 架构归纳偏置造成，采集条件偏移是更可能的主因；常见归因图在 12 个样本的分析中也不能区分正确与错误预测。作者据此认为，小样本解释代理不足以诊断实际域偏移。

Abstract: Cross-dataset transfer in rice leaf disease classification remains a significant challenge, with models trained on one image collection performing substantially worse when deployed on another. We conduct a systematic benchmark across three Bangladeshi rice leaf disease datasets (5,419 images, 6 transfer pairs, 3 CNN backbones, 3 random seeds) to characterize and diagnose this failure. Strong augmentation recovers a mean cross-dataset macro-F1 improvement of +0.070 (Wilcoxon p < 0.001, 15 of 18 transfer pairs positive). Removing non-leaf image content via segmentation shows directional benefit (mean +0.066, p = 0.062, n = 36 paired observations) that is consistent across two independent segmentation methods but does not reach conventional significance. A self-supervised ViT control (DINOv2 linear probe) exhibits equivalent cross-dataset collapse to CNNs, ruling out architecture inductive bias as the primary driver and pointing to acquisition-condition shift. Adaptive batch normalization uniformly harms transfer performance, with harm magnitude correlating with source-target label-prior divergence and model depth (Spearman rho = 0.621, p = 0.009). Grad-CAM attribution analysis on 12 sampled predictions does not distinguish correct from incorrect cross-domain predictions (p = 0.462), indicating that common attribution proxies are insufficient for diagnosing shift at practical sample sizes. We document all frozen results, prespecified analysis criteria, and reproducibility artifacts in a public repository with SHA-256 integrity verification. This work establishes a rigorous empirical baseline for understanding cross-dataset generalization in agricultural computer vision and identifies both effective (augmentation) and ineffective (AdaBN) adaptation strategies.

[15] Agentic Video Understanding: A Survey cs.CV | cs.AIPDF

Xinyu Deng, Siwen Luo, Daochang Liu

TL;DR: 这篇综述把视频理解代理定义为会主动选择检查、记忆、验证和行动的信息处理系统，并按挑战与设计方案的对应关系整理相关研究。

Details

Motivation: 视频理解研究正从固定的视频—语言推理转向能适应性构建状态并选择动作的代理系统。该领域横跨上下文管理、证据获取、时间因果和多模态协作，需要统一组织其设计与评测。

Result: 综述形式化视频理解代理的循环，并将上下文瓶颈对应到层次化证据记忆、证据稀疏对应到主动证据获取、时间因果对应到状态/过程跟踪、多模态歧义对应到角色专门化协作；同时回顾状态空间、学习范式、监督信号、基准和评估协议。

Insight: 按挑战映射设计可帮助理解代理机制为何出现，而不是仅按模型组件罗列工作。作者提出面向代理的原生时间建模和视频原生代理作为开放方向；摘要未声称该综述提供了新的量化基准结果。

Abstract: As large language models (LLMs) become capable of processing increasingly diverse modalities and longer temporal contexts, an emerging line of work is moving beyond fixed video-language inference toward agentic systems that actively decide what information to inspect, retain, verify, and act upon. This survey reviews video understanding agents: systems that use video as the primary information source and solve understanding tasks through adaptive state construction and action selection. We first formalize an agent loop for video understanding, then address a central question: why do agents matter for video understanding? To answer this, we organize the literature through a challenge-to-design taxonomy, linking context bottlenecks to hierarchical evidence memory, evidence sparsity to active evidence acquisition, temporal causality to state and process tracking, and multimodal ambiguity to role-specialized coordination. We further review state space paradigms, learning paradigms, supervision signals, benchmarks, and evaluation protocols. Finally, we identify open directions toward agentic-native temporal modeling and video-native agents. Project page: https://github.com/DXY0711/Awesome-Agentic-Video-Understanding

Kaixiang Qiu, Minghao Han, Keliang Liu, Yizhou Liu, Jinghan Han

TL;DR: OmniFysics-Captioner 面向带有物理交互的视频描述，构建对齐的跨模态证据数据、评测基准和生成模型，以捕捉接触、支撑、形变与状态变化等细节。

Details

Motivation: 通用音视频描述器主要概括整体语义，容易遗漏短暂或局部的物理证据。要准确描述物体如何接触、支撑或改变状态，需要细粒度且可追溯的时空对齐监督。

Result: 作者构建 Daily-Physics 50K 数据集和证据驱动的 OmniPhysCap 基准。模型在音视频描述上达到 Gemini 3.1 Pro 水平，在多个视频描述基准上取得论文所述的最先进结果，并明显优于其他开源模型；消融显示物理感知模型提取的证据改善物理覆盖及跨模态描述细致度。摘要没有提供具体分数。

Insight: 数据流程由 OmniFysics-Agent 协调音频、视觉及物理感知工具，专门的物理感知模型由约 200 万张图像级样本微调，用于提取物体交互和状态变化线索。以证据恢复为导向的评测使描述质量超越一般语义相似度。

Abstract: Building omni-modal models with physical intelligence requires fine-grained supervision that captures physical evidence such as contact, support, deformation, and state transitions. However, existing omni-modal captioners primarily model general audiovisual semantics and often overlook transient or spatially localized physical evidence. We present a unified framework for physics-aware audiovisual captioning spanning data construction, training, and evaluation. Firstly, we build a data construction pipeline that identifies physics-rich clips and leverages OmniFysics-Agent to coordinate audio, visual, and physical-perception tools for collecting spatiotemporally aligned and traceable cross-modal evidence; within the Agent, a physical perception model (PPM) fine-tuned on approximately 2M image-level samples serves as a dedicated tool for extracting object-interaction and state-change cues. Secondly, we build the Daily-Physics 50K dataset and introduce the evidence-driven OmniPhysCap (OPC) benchmark to evaluate the recovery of physical and cross-modal evidence from generated captions. Finally, we train OmniFysics-Captioner from the resulting data. Our Captioner matches Gemini 3.1 Pro on audiovisual captioning, achieves state-of-the-art results on multiple video-captioning benchmarks, and substantially outperforms other open-source models. Ablations show that PPM evidence improves physical coverage and produces finer-grained, more reliable cross-modal descriptions.

[17] Fysiverse-3D-SimReady Technical Report: Agentic Physical Simulation for Pragmatic 3D World Reconstruction cs.CVPDF

Lintao Wang, Mingyang Sun, Yang Liu, Dingkang Yang, Lihua Zhang

TL;DR: Fysiverse-3D-SimReady 从单张 RGB 图像重建重力对齐、接触合理且可执行物理仿真的多物体场景，并将其用于目标条件的代理仿真。

Details

Motivation: 现有单图 3D 生成方法通常只追求物体外观逼真，独立生成的网格组合到同一场景后可能与相机不对齐、违反重力、相互穿插或无法稳定仿真。

Result: 作者报告该方法相较现有单图重建和场景生成基线，改善了输入视角对齐、接触合理性与物理稳定性，并支持从单张图像出发执行目标条件的物理交互。摘要未提供量化指标。

Insight: 方法将物体网格置于共享的重力对齐场景中，通过可微渲染细化相机空间位姿，再修正场景级支撑和接触关系；之后把具体任务目标转为物理仿真 rollout，并渲染回原始相机视角。

Abstract: Agentic recognition requires visual perception to move beyond static scene understanding and produce structured scene representations that support the perception–reasoning–action loop. Existing single-image 3D generation methods, however, mainly produce visually plausible object assets rather than simulation-ready scene states. When independently generated meshes are composed in a shared space, they may fail to align with the input camera, violate gravity, interpenetrate nearby objects, or become unstable under physics simulation. We present Fysiverse-3D-SimReady, a grounded refinement framework for reconstructing simulation-ready multi-object scenes from a single RGB image with instance and ground prompts. The method places generated object meshes into a shared gravity-aligned scene, refines their camera-space poses through differentiable rendering, and corrects scene-level supports and contacts for stable physical execution. The scene is then used by an agentic simulation workflow, which converts a scene-specific task goal into an executable physics rollout rendered from the original camera view. Experiments show that Fysiverse-3D-SimReady improves input-view alignment, contact plausibility, and physical stability over existing single-image reconstruction and scene generation baselines, while enabling goal-conditioned physical interactions from a single image.

[18] PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routing cs.CV | cs.RO | eess.IVPDF

Peng Xu, Haoran Lin, Wanjun Jia, Kai Luo, Wenrui Chen

TL;DR: PanoFuse 在视觉语言动作策略中增加全景视觉分支，并通过语义—几何解耦路由将全局场景线索与局部任务语义送入动作表示。

Details

Motivation: 常见 VLA 策略依赖视野有限的透视相机，容易漏掉全局环境信息，在遮挡、干扰物或未见环境中出现操作失误。

Result: 作者构建包含全景 RGB、腕部图像、语言指令、机器人状态和动作的真实操作数据集。在七种评估设置中，PanoFuse 平均成功率为 52.9%，优于所测基线，并在新物体、未见背景和干扰丰富场景中持续取得提升。

Insight: 预训练全景基础模型提取互补的语义与几何表征，DSGR 保持两路上下文分离，再通过结构化分块注意力选择性注入状态与动作表示，避免直接混合异质特征。

Abstract: Vision-Language-Action (VLA) policies have shown promising performance in language-conditioned robotic manipulation. However, most existing VLA systems rely on conventional perspective cameras with limited fields of view, often missing global scene context and leading to unreliable manipulation under visual occlusions, distractors, and unseen environments. In this work, we propose PanoFuse, a panorama-enhanced VLA framework that complements local manipulation observations with global panoramic perception. PanoFuse introduces a dedicated panoramic branch that leverages a pretrained panoramic foundation model to extract complementary semantic and geometric representations from omnidirectional observations. Rather than directly mixing these heterogeneous features, we introduce Decoupled Semantic-Geometric Routing (DSGR), which maintains semantic and geometric representations as separate context streams and selectively routes both to downstream state and action representations through structured block-wise attention. This design provides the action expert with global spatial context while preserving task-relevant semantic information from the pretrained VLA backbone. We further develop a synchronized data collection pipeline and construct a new real-world manipulation dataset containing panoramic RGB observations, wrist-view images, language instructions, robot states, and actions. Across seven evaluation settings, PanoFuse achieves an average success rate of 52.9%, outperforming the evaluated baselines and achieving consistent gains under novel-object, unseen-background, and distractor-rich settings. Code and data will be released publicly at https://xux-hnu.github.io/PanoFuse.

[19] Where Does the Watermark Hide? Push-Pull Disentanglement for Invisible Watermark Removal cs.CVPDF

Jidong Yang, Huaike Yu, Qi Li, Chunpeng Wang, Yuantian Miao

TL;DR: 该研究考察在配对干净/带水印图像训练、但部署时只需单张图像的设置下，模型能否降低不可见水印信号；结果显示水印移除效果与图像保真度之间存在权衡。

Details

Motivation: 固定图像扰动无法覆盖基于配对样本学习的攻击者。作者关注实际推理时没有干净参考图、水印密钥、载荷或解码器的条件，并检验辅助表示在重建中的作用。

Result: 在所测四种方法的平均结果中，一个配置的 BER 为 0.3958、PSNR 为 31.07 dB、SSIM 为 0.9554。将辅助变量从 0 提高至 0.15 后，平均 BER 从 0.3893 变为 0.3357，同时 PSNR 从 30.99 dB 降至 28.23 dB。作者指出该干预支持解码器在此设置中依赖辅助输入。

Insight: 实验展示了水印抑制与保真度的量化权衡，但理论解释被作者限定为事后条件性解释，并未通过实验验证信息确实被迁移到特定表示中。摘要未说明不同水印体系上的普适性。

Abstract: Fixed image distortions do not cover an attacker that learns from paired clean and watermarked images. We study this paired-training threat with single-image inference: deployment uses neither the clean reference nor the watermark key, payload, or decoder. An encoder maps each image to a structural latent $g$ and an auxiliary residual latent $u$. Push supervision reconstructs the watermarked image from $D(g_w,u_w)$. Pull supervision trains the zero-auxiliary output $D(A_g(g_w;k),0)$ toward the paired clean image. At $k=1.10,u=0$, the four-method sweep gives an average BER of $0.3958$, PSNR of $31.07$ dB, and SSIM of $0.9554$. Restoring $u$ from $0$ to $0.15$ moves average BER from $0.3893$ to $0.3357$, while PSNR falls from $30.99$ to $28.23$ dB. The intervention supports decoder dependence on the auxiliary input in the evaluated setting. The accompanying theory is a conditional, post-hoc account of this behavior rather than an experimentally verified information-relocation result.

[20] SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation cs.CV | cs.AIPDF

Zhengtong Zhu, Jiaqing Fan, Hanwen Qian, Fanzhang Li

TL;DR: SWT 用静态图像上的对比学习训练视频目标分割模型，再结合滑动样本缓存、小波变换和最优传输来处理跨帧目标匹配。

Details

Motivation: 传统视频目标分割依赖大量像素级视频标注，限制了稀疏场景的学习；现有方法对物体的全局变化和非刚性形变也可能适应不足。

Result: SWT 只需在 COCO 静态图像数据集上训练一次，作者报告其在五个视频目标分割数据集及一个身体部位传播数据集上取得良好结果。摘要未列出各基准的定量指标。

Insight: 滚动缓存复用连续更新中重叠的独立图像组；小波变换扩大卷积感受野以支持长距离建模；最优传输则在两帧之间寻找全局匹配，帮助处理目标非刚性形变。

Abstract: Video Object Segmentation (VOS) aims to accurately segment target objects from consecutive video frames and track the changes of the objects in each frame of the video. Conventional VOS methods typically demand substantial quantities of pixel-level labeled video sequences for fully supervised learning, which limits the performance of the model in sparse video scenes, while existing VOS methods have limited adaptability to global changes in objects. Based on this observation, in this paper, we propose self-supervised VOS with Sliding window, Wavelet transform and optimal Transport (SWT), a self-supervised VOS framework entirely trained on static dataset using contrastive learning. Firstly, a rolling sample buffer reuses overlapping groups of independently sampled images across successive updates. Secondly, to address the long-distance modeling difficulty caused by simple convolutional structures, we introduce wavelet transform to expand the receptive field of convolutional kernels, thus improving the model’s representational capability. Finally, we incorporate optimal transport to assist the model in finding the globally optimal match between the target across two frames, improving the model’s ability to handle nonrigid deformations of objects. SWT only requires training on the COCO dataset once and achieves excellent results on five VOS datasets as well as an additional body part propagation dataset. The code will be released soon at https://github.com/machine928/SWT.git.

[21] When Retrieval Hurts: Measuring and Explaining Retrieval-Induced Hallucination in Chest X-ray Report Generation cs.CVPDF

Emmanuel Idoko, Abdusshakur Olabisi, Shiloh Oni, Adesola Josiah

TL;DR: 该研究量化胸片报告生成中检索增强带来的临床幻觉，发现检索内容与图像不匹配时会严重损害准确性，单靠检索相似度无法判定风险。

Details

Motivation: 相似既往报告可以补充视觉语言模型缺少的临床上下文，但检索内容错误时也可能把图像中没有的病征带入报告。评测不能只考察检索成功时的收益。

Result: 在 100 例 MIMIC-CXR 测试中，相关检索使 CheXbert 临床 F1 从 0.201 提至 0.402，而临床不匹配检索使其降至 0.043；可追溯到检索证据的不支持发现率分别为 0.76 和 0.98，无检索时为 0。正常胸片在 28 例中有 24 例至少检索到一条异常先例。按嵌入相似度分桶的幻觉风险并不呈可用关联；依据预测病理一致性进行门控可去除 61% 的不支持证据且不损失有用覆盖。

Insight: 模型不只吸收检索中的病征，还可能逐字转录检索报告：相关检索生成的报告中有 95% 含有参考报告中没有、却与检索文本完全一致的八词片段。临床 RAG 必须把检索失败纳入评估，且门控需关注病理一致性而非只看相似度。

Abstract: Retrieval-augmented generation is an attractive way to improve chest X-ray reporting, because reports from similar prior studies supply clinical context a general vision-language model lacks. We show the same mechanism is a reliable source of clinical error. Over 100 MIMIC-CXR studies with a frozen LLaVA-1.5 generator and BioMedCLIP retrieval, CheXbert clinical F1 doubles under relevant retrieval (0.201 to 0.402) and collapses to 0.043 under clinically mismatched retrieval, a fifth of the image-only score; the retrieval-induced hallucination rate, counting only unsupported findings traceable to retrieved evidence, rises from 0.00 to 0.76 and 0.98. To show this is not an artefact of evidence-set coverage, we introduce a coincidental-overlap control that scores image-only generations against evidence they never saw, placing the chance base rate at 0.18, four to five times below the observed rates. The generator does not merely acquire findings, it transcribes text: 95% of reports produced under relevant retrieval contain an eight-word span occurring verbatim in the retrieved evidence but absent from the reference, against 0% without retrieval. We then explain the mechanism: a normal chest X-ray retrieves at least one abnormal precedent in 24 of 28 cases, because medical image-embedding similarity is dominated by anatomy and acquisition rather than by the presence of disease. This has a direct design consequence. Retrieval similarity does not predict harm (RIH rates 0.80/0.80/0.60/0.84 across similarity quartiles), so relevance gates conditioned on embedding similarity cannot work; gating on predicted pathology agreement removes 61% of unsupported evidence at no cost to useful coverage. We argue that retrieval-augmented clinical systems must be evaluated under retrieval failure, not only under retrieval success.

[22] Measuring the evolution of camera distance across a century of film cs.CVPDF

David Bamman, Allison Cooper, Dan Hickey, Madison Mar

TL;DR: 该研究用计算机视觉分析 1922–2025 年的 5,205 部院线电影，追踪电影中摄影机与拍摄对象距离的长期变化。

Details

Motivation: 摄影机与人物或物体之间的空间距离是电影表达的重要方式，但其跨时代变化及与技术演进、性别呈现之间的关联需要大规模实证测量。

Result: 分析发现，声音技术和电视兴起等技术变革阶段伴随摄影距离的突变；女性虽然银幕时间明显少于男性，却更常成为近景拍摄对象。动画电影既继承又突破了真人电影的摄影距离规范。摘要未提供具体效应量。

Insight: 覆盖商业、获奖和独立影片的大型历史片库，使研究能够把摄影语言变化与电影技术史联系起来，也揭示银幕时间和近景呈现之间并不一致的性别差异。

Abstract: The rise of computer vision and artificial intelligence has made possible new forms of large-scale computational measurement. We apply these techniques to a deep collection of 5,205 digitized films viewed in theaters between 1922-2025 (covering popular, prestigious, and independent movies) to trace the development of one of the most fundamental ways through which film communicates: by manipulating the space between the camera and its subject. This work finds abrupt changes with the rise of new technologies in sound and television, and allows us to shed an empirical light on gender disparity (women, despite having substantially less screentime than men, are disproportionately the subject of closer shots), and illustrate how animated films both inherit and break free from the norms of live-action filmmaking.

[23] VisionPsy-Nano: Improving Accuracy, Efficiency, and Reliability in On-Device Vision-Language Models cs.CVPDF

Khurram Azeem Hashmi, Mohammadreza Zolfaghari, Changdae Park, Rishabh Jain, Nicholas Moratelli

TL;DR: VisionPsy-Nano 通过教师视觉语言模型发现紧凑学生模型的失败模式，并据此做定向监督和偏好对齐，兼顾端侧 VLM 的准确率、效率与行为可靠性。

Details

Motivation: 亚十亿参数模型虽可在设备端运行，首 token 延迟仍可能超过两分钟；常规基准还不易暴露循环输出或对抗提示下的安全可靠性，单看模型大小不足以说明实际可用性。

Result: 在 17 个基准上的归一化平均分中，Nano 版本达到 62.3，为作者比较的约 0.5B 开源模型最高，比同架构同 token 预算的基础模型高 7.4；循环输出率不高于最强基线。Flash 版本得分 61.4，在 Pixel 9 上将预热首 token 时间从 138 秒降至 6.1 秒，约快 23 倍。

Insight: 训练配方以教师模型压力测试学生、找出超越人工预设的失效模式，再转成定向数据与偏好对齐；两种视觉 token 策略形成准确率—效率不同的版本。作者强调行为可靠性应与性能和速度一同评估。

Abstract: Sub-billion-parameter Vision-Language Models are increasingly viable for on-device deployment, yet compact model size alone does not guarantee usability. On a phone, such a model can still require more than two minutes to produce its first token. On-device usability depends on three axes: accuracy, efficiency, and behavioral reliability; standard benchmarks miss the third, with answers too short to expose doom loops and prompts too benign to probe adversarial safety. We introduce a diagnosis-driven post-training recipe in which a teacher VLM stress-tests the student, uncovers failure modes beyond human priors, and converts them into targeted supervision and preference alignment, supplementing generic data scaling with failure-driven optimization. Coupled with two visual-token policies, the recipe yields two accuracy-efficiency variants with improved behavioral reliability. \textbf{\NanoFull} attains a 62.3 normalized average over 17 benchmarks, the highest among openly released $\sim$0.5B models, +7.4 over its base at identical architecture and token budget, with doom-loop rates at or below the strongest baseline’s. \textbf{\FlashFull} retains 61.4 while cutting warm time-to-first-token on a Pixel 9 from 138,s to 6.1,s (23$\times$). By jointly addressing all three axes, we move compact VLMs toward practical on-device usability.

[24] The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understanding cs.CV | eess.IVPDF

Yao Zhang, Pengyu Dai, Wei Guo, Jian Liang, Jian Song

TL;DR: GazeEarth 是无需训练的超高分辨率遥感图像问答方法：根据问题选取局部证据，再用保拓扑的注视式重采样，把固定像素预算集中到关注区域，同时保留全景上下文。

Details

Motivation: 现有方法要么裁剪或筛选局部块，要么反复查看独立裁剪图，难以在单一连续全景视图中同时保留局部细节和场景关系。试验还发现，模型选对区域并不保证裁剪后答案变好。

Result: 在三个超高分辨率遥感基准、四种冻结骨干上，GazeEarth 相比直接回答平均准确率提高 4.6–9.4 个百分点，相比只看概览提高 3.4–4.3 个百分点，并优于论文比较的任务训练方法。最多调用 MLLM 两次，不用外部选区模型或迭代搜索。

Insight: 同一冻结模型先从索引概览中提出问题相关证据格，再对原图进行确定性拓扑保持变换，放大关注区域共同邻域并压缩外围。结果说明模型能够指导“看哪里”，而推理质量还取决于所选证据如何呈现。

Abstract: Multimodal large language models (MLLMs) must balance local detail against scene context when interpreting ultra-high-resolution (UHR) remote sensing (RS) imagery within a limited visual-input budget. Existing selection-based methods either prune tokens and select patches through relevance scoring, or crop actively through repeated inspection. Neither strategy directly redistributes pixels within a continuous full-scene view: the first retains selected tokens or patches, and the second re-encodes a crop detached from its surroundings. Our pilot study finds that a frozen MLLM already produces useful question-guided spatial requests, yet crop-based inspection of the selected regions does not consistently improve its answers. We therefore formulate UHR understanding as a question of where to spend a fixed pixel budget. Based on this, we introduce GazeEarth, a simple-yet-effective training-free framework that couples question-guided region selection with full-scene foveated observation. The MLLM selects evidence cells from an indexed overview; a deterministic, topology-preserving warp resamples the original image onto a fixed-size canvas, enlarging their shared neighborhood while compressing the periphery; the same frozen model answers from this focused view, using at most two MLLM calls and no external selector or iterative search. Across three UHR remote sensing benchmarks and four frozen backbones, GazeEarth improves benchmark-averaged accuracy by 4.6 to 9.4 percentage points over direct answering and 3.4 to 4.3 over overview answering, outperforming task-trained methods. Our analyses show that existing MLLMs can guide where to look in UHR images on their own, and that what they can infer from the selected evidence depends on how that evidence is presented.

[25] Dimension-Specific Imbalance and an Adaptive Hybrid Label Strategy for Multi-Task Affective State Recognition in Classroom Video cs.CVPDF

Xiangqian Li

TL;DR: AHLS 根据四类课堂情感维度各自的类别不均衡程度，混合使用四级与二元标签，并以空类占位机制控制多任务训练权重。

Details

Motivation: DAiSEE 等课堂视频数据集的类别不平衡不只是比例大小不同，不同情感维度的不平衡结构也不同，因此统一的重加权、焦点损失或二元化处理会产生维度相关的失败。

Result: DAiSEE 某维度的原始不平衡比最高约 79:1；AHLS 将最大有效逆频率权重比压至不高于约 8.5:1。在仅 0.39M 参数、0.07G FLOPs 的模型上，四个维度的平均 Macro-F1 为 47.70%，在 11 种比较方法中最高，其中包括大其 167 倍的深度模型。作者还指出少数情感标签的标注密度可能限制基准表现。

Insight: 标签粒度和优化权重需要按维度适配；该研究的跨模型分析显示，在 DAiSEE 设置中，分类策略对少数类识别的影响可能大于单纯扩大骨干网络。数据集标注限制也意味着算法改进并非唯一瓶颈。

Abstract: Recognition of student affective states from classroom video is constrained by a class imbalance problem whose true nature is, we argue, under-analyzed. We show that on DAiSEE – the de facto benchmark for this task – class imbalance is fundamentally a dimension-specific phenomenon: raw imbalance ratios reach as high as approximately 79:1 (Frustration), and the structure of imbalance – not only its magnitude – varies across dimensions, so uniform algorithmic treatments (aggressive class reweighting, focal loss, uniform binary simplification) fail in dimension-dependent ways. We propose the Adaptive Hybrid Label Strategy (AHLS), which assigns four-level classification to dimensions with manageable imbalance and binary classification to severely long-tailed dimensions, coupled with a null-class placeholder mechanism that stabilizes multi-task optimization by compressing the maximum effective inverse-frequency weight ratio from as high as ~79$\times$ to at most ~8.5$\times$ across the four dimensions. Validated on a lightweight FERShuffleNetV2 + LTCN architecture (0.39 M parameters, 0.07 G FLOPs), the strategy attains the highest mean Macro-F1 of 47.70% across all four affective dimensions among 11 compared methods, including five state-of-the-art deep models (up to 167$\times$ larger) and five traditional machine-learning baselines. A cross-model behavioral analysis on DAiSEE indicates that, in this setting, classification strategy may influence minority-state recognition more strongly than further backbone scaling alone. We also report evidence of an annotation-density limitation of DAiSEE on minority affective states, which suggests that benchmark design may bound future progress as much as algorithmic refinement. Index Terms Affective computing, classroom video analysis, class imbalance, multi-task learning, lightweight deep learning, DAiSEE, engagement recognition.

[26] EgoTSR++: Egocentric Spatiotemporal Reasoning for Task Progress Understanding cs.CVPDF

Xiaoda Yang, Can Wang, Yuxiang Liu, Pengfei Zhou, Jianwen Lou

TL;DR: EgoTSR 为第一视角任务进度比较设计了顺序鲁棒评测和训练框架，要求视觉语言模型依据目标相关状态变化判断哪个观察更接近完成，而不能依赖时间戳或展示顺序。

Details

Motivation: 机器人操作中的重试、纠错和暂时倒退使进度并非单调变化。仅凭观察先后判断进度可能误导模型，现有视觉语言模型也容易受输入顺序偏差影响。

Result: 在长时程进度比较中，EgoTSR 准确率达到 92.4%，正向与逆序输入差距仅 0.1 个百分点。加入失败感知监督后，非单调轨迹准确率提高 11.8 点，恢复准确率提高 11.2 点，同时保持广泛的视觉与空间能力。

Insight: SpatialLogic-Bench 对同一状态对同时测试原顺序与反序；数据同时涵盖近似单调成功轨迹、子任务结构及失败恢复，并先用 CoT 监督解释状态变化，再以标签监督巩固比较规则。

Abstract: Vision-Language Models (VLMs) have advanced rapidly in static visual understanding, yet remain unreliable when judging how an egocentric task is progressing. Given a task instruction and two visual observations, a model should determine which state is closer to the goal by analyzing task-relevant object configurations and spatial relations, rather than relying on timestamps or presentation order. This distinction is critical in manipulation, where retries, corrective actions, and temporary regressions make progress inherently non-monotonic. We introduce EgoTSR, a unified framework for diagnosing and improving order-robust task-progress understanding. First, SpatialLogic-Bench evaluates each physical state pair in both original and order-swapped presentations across short- and long-horizon settings, exposing whether a model follows task-state evidence or chronological shortcuts. Second, our data construction pipeline converts successful, approximately monotonic manipulation and first-person trajectories into bidirectional supervision; LongTag further preserves intermediate subtask structure for long-horizon comparison, while failure-aware data extend learning to regressions and recoveries. Third, a progressive CoT-to-Tag curriculum first supervises evidence-grounded interpretation of task-relevant state changes and then consolidates the comparison rule through scalable label-only training. Experiments reveal substantial input-order bias in representative VLMs. EgoTSR achieves 92.4% long-horizon accuracy with a 0.1-point forward-inverse Gap. Failure-aware supervision further improves accuracy on non-monotonic trajectories by 11.8 points and Recovery Accuracy by 11.2 points, while maintaining broad visual and spatial capabilities. These results establish goal-conditioned state comparison as an explicit formulation of egocentric spatiotemporal reasoning for task-progress understanding.

[27] Calibration-Free Surface Normals Estimation in Vision-Based Tactile Sensing using Universal Photometric Stereo cs.CV | cs.LG | cs.ROPDF

Zdravko Dugonjic, Stefanie Speidel, Roberto Calandra

TL;DR: 该工作用通用光度立体网络从触觉图像估计接触表面法线，目标是减少不同视觉触觉传感器逐一进行物理标定的需求。

Details

Motivation: 高精度接触表面法线和深度通常需要用已知形状探针对弹性体按压并建立触觉图像与真值的映射；光学系统和传感器形状不同会令标定复杂，也妨碍跨传感器迁移。

Result: 在三种光学系统各异的真实传感器上进行实验。金属球控制实验中，通用模型的平均角误差为 6.56°，与校准方法相当；自然纹理物体的整体平均角误差为 10.66°。在穹顶形 Digit 360 上相对校准基线的角差为 10.18°。结果表明仅用合成数据训练的模型在足够照明设置下也可估计法线。

Insight: 通用光度立体学习提供跨传感器的接触表面表示，减少对每种硬件专属探针标定的依赖。现有验证覆盖三种传感器及特定实验条件，尚不能据此断言所有光学配置都无需校准。

Abstract: Vision-based tactile sensors are a popular solution for capturing rich contact surface geometry. However, to obtain high-detail contact surface normals and depth, it is necessary to calibrate the sensor by physically pressing a probe with known geometry against the sensor elastomer and mapping tactile images onto the ground truth probe’s shape. This approach does not scale across different tactile sensors, and the calibration effort can be complex depending on the sensor shape and optical system. Instead, we propose a calibration-free procedure for the estimation of contact surface normals using Universal Photometric Stereo neural networks. In a series of real-world experiments, we evaluate our approach on 3 sensors with different optical systems, demonstrating that universal methods are a suitable approach for estimating surface normals at the contact patch from tactile images, thereby alleviating the need for tactile sensor calibration. Controlled experiments with a metal ball show that universal methods match the calibrated method, with a mean angular error of $6.56^{\Large\circ}$. We show that the proposed framework recovers high-frequency surface details of objects with natural textures, achieving an overall mean angular error of $10.66^{\Large\circ}$. Universal method robustly recovers the contact surface normals captured with dome-shaped Digit 360, achieving a low angular discrepancy of $10.18^{\Large\circ}$ relative to the calibrated baseline. This experiment demonstrates that with sufficient illumination settings surface normals could be estimated using a model trained solely on synthetic data. By providing a unified representation of contact surfaces across different vision-based tactile sensor designs, Universal Photometric Stereo neural networks lay the foundation for transferable tactile perception across sensors.

[28] Gauge-Equivariant Attention for Rotation-Stable $360^\circ$ Scene Understanding cs.CV | cs.GRPDF

Tianjian Zhou, Yishan Li, Jie Jiang, Yifei Zhang

TL;DR: GE-RPE 通过对有限旋转群上的相对位置偏置做平均，降低 360° 场景模型对局部坐标规范的依赖，并与自监督视图对齐组成 EquiSSL。

Details

Motivation: 球面 Transformer 在全景图像旋转时可能发生严重分割退化；受控消融将一个主要原因定位为相对位置偏置对 gauge 选择敏感。

Result: 匹配的三随机种子 GE-RPE 模型在 90° 旋转压力测试中准确率下降 1.3%，相较训练配方不同的已发表 SphereUFormer 检查点在同一协议下下降 53%。完整 EquiSSL 的下降缩至 0.8%，验证集 mIoU 为 68.30%；1% 标签微调在 N=373 测试拆分上提升 2.39 mIoU（N=40 验证拆分提升 4.10）。方法不增加参数，前向延迟增加 1.5%–4.4%。

Insight: 先消除 gauge 依赖，再把自监督教师 token 置换到旋转后的学生坐标系，可使 iBOT+MAE 预训练成为低标签学习的有效补充。对比基线的训练配方不同，不能把 1.3% 与 53% 视为纯粹单组件的同条件差值。

Abstract: Panoramic $360^\circ$ scene understanding increasingly relies on icosphere transformers, but a state-of-the-art spherical model loses more than half of its segmentation accuracy when the camera rotates by $90^\circ$, and controlled ablations identify gauge dependence in its relative-position bias as a major contributor. We propose gauge-equivariant relative position encoding (GE-RPE): a parameter-free Reynolds average of the bias over a finite cyclic subgroup $C_n!\subset!\mathrm{SO}(2)$ of gauge rotations. Plugged into a SphereUFormer backbone the change is invisible at deployment—zero added parameters and $1.5$–$4.4%$ forward latency—and the matched three-seed GE-RPE model records a $1.3%$ drop; the published SphereUFormer checkpoint records $53%$ under the same stress protocol but a different training recipe. Once the gauge defect is removed and a teacher-token permutation $π_R$ aligns the SSL views to the rotated student frame, iBOT$+$MAE pretraining stops being a liability and becomes a clean low-label lever: the full framework EquiSSL (GE-RPE $+$ $π_R$ $+$ iBOT$+$MAE) tightens the drop to $0.8%$ at $68.30%$ val mIoU and lifts $1%$-label fine-tuning by $+2.39$ mIoU on the $N{=}373$ test split (and by $+4.10$ on the smaller $N{=}40$ val split); the same fix carries over to monocular depth and to zero-shot Structured3D segmentation. The construction is provably $C_n$-invariant and $\mathcal{O}(n^{-2})$-close to the continuous $\mathrm{SO}(2)$ average, making the resulting model a usable $360^\circ$ visual-computing primitive across panoramic relighting, immersive video, and cross-dataset transfer. Code is available at https://github.com/Jaywalk18/equissl-release.

[29] A Surgical Foundation Model Reveals Task-Dependent Label Efficiency cs.CV | cs.AIPDF

Florian Philipp Stilz, Lorenzo Arboit, Vinkle Srivastav, CAMMA International Surgical Partners, Jacques Marescaux

TL;DR: SURGE 是在超过三千万帧手术视频上预训练的手术视觉基础模型；其系统评测发现，不同手术任务达到标注数据饱和所需的专家标注量并不相同。

Details

Motivation: 专家标注成本高且稀缺，自监督基础模型虽能以少量数据适配新任务，但手术任务之间的标签效率如何变化还缺少系统研究。

Result: SURGE 基于超过 3,000 万帧的 SurgSpectrum-30M+ 训练，并在五类任务、15 个基准上评估。作者报告该模型在全部基准上超过此前最先进方法，复杂推理任务上也超过任务专用模型；场景理解在少量监督下趋于饱和，而细粒度推理随更大标注预算继续提升。摘要没有给出各任务具体分数或预算曲线。

Insight: 标注资源应按任务结构分配：一般场景理解可能很快达到收益递减，器械—解剖交互及安全关键操作相关推理则仍能从更多专家标注中获益。该结论可为临床数据标注优先级提供参考。

Abstract: Developing label-efficient models is a central challenge in surgical AI due to the high cost and scarcity of expert annotation. While self-supervised foundation models adapt well to new tasks with minimal data, how label efficiency varies across different surgical tasks remains largely unexplored. Here, we introduce SURGE, a surgical foundation model trained on SurgSpectrum-30M+, the largest pretraining dataset comprising over 30 million frames, with checkpoints released to enable further research. We systematically evaluate label efficiency across 5 task categories and 15 benchmarks. These range from temporal and spatial scene understanding to fine-grained reasoning tied to instrument-anatomy interactions and safety-critical maneuvers. SURGE outperforms prior state-of-the-art on all benchmarks, even surpassing task-specific models on complex reasoning tasks. Crucially, we reveal a task-dependent scaling behavior: while scene understanding tasks saturate with minimal supervision, fine-grained reasoning tasks continue improving with substantially larger annotation budgets, providing a blueprint for allocating expert effort in complex domains. Code: https://github.com/CAMMA-public/SURGE

[30] SynDORBench: Evaluating LVLM Perceptual Robustness Under Physically Constrained Visibility Conditions cs.CV | cs.AIPDF

Jeremy Stephen Gabriel Yee, Zhengkui Wang, Zhiyuan Zhang, Avinash Anand, Timothy Liu

TL;DR: SynDORBench 用物理可解释的可视条件评测视觉语言模型在远距离、低照度和视角变化下的人类/动作识别能力。

Details

Motivation: 现有多模态推理基准多假设输入理想，难以揭示摄像距离、照明、视角和像素密度对语义可恢复性的影响，也无法直接与人类可视阈值比较。

Result: 基准包含超过 5.4 万个问答，由可控合成流程改变距离、照明、相机几何和姿态；评估了 16 种开源 LVLM、一个商业模型及 YOLO11x。结果显示，像素密度和成像物理约束比模型规模更能左右感知失效；一些小型开源模型在远距离、低照条件下优于较大的商业基线，并明显超过 YOLO11x 的鲁棒性。摘要未报告逐项数值。

Insight: 基准用 DORI 人类可视标准校准条件，并通过掩码条件统计特征与集成学习传播低可见度人工标签。它把模型感知能力与具体物理成像条件联系起来，而非把失效简单归咎于参数规模。

Abstract: Large vision-language models (LVLMs) have demonstrated remarkable performance on multimodal reasoning benchmarks, yet their perceptual reliability under physically constrained imaging conditions remains poorly understood. Existing evaluations predominantly assume ideal visual inputs and therefore fail to characterize how camera distance, illumination, viewpoint, and pixel density fundamentally affect semantic recoverability. We introduce SynDORBench, the first physically grounded benchmark for evaluating LVLM perceptual robustness under DORI-calibrated conditions aligned with human visual capability standards. SynDORBench comprises over 54k question–answer pairs generated through a controllable synthetic pipeline that systematically varies viewing distance, lighting, camera geometry, and action pose according to physically interpretable pixel-density regimes. To support scalable low-visibility supervision, we further propose a discernibility annotation framework that propagates human perceptual labels using mask-conditioned statistical features and ensemble learning. We evaluate 16 open-source LVLMs, a commercial LVLM baseline, and YOLO11x across human-presence classification and action recognition tasks under progressively degraded visibility conditions. Our results reveal that perceptual failure in LVLMs is strongly governed by pixel density and physical imaging constraints rather than model scale alone. Surprisingly, several compact open-source LVLMs outperform larger commercial baselines and substantially exceed YOLO11x robustness under long-range and low-light conditions. SynDORBench establishes a new benchmark paradigm for physically grounded multimodal evaluation, enabling systematic analysis of LVLM reliability under real-world perceptual constraints and direct comparison against human visibility thresholds.

[31] CueKFS: Agentic Cue-Driven Keyframe Selection for Long Video Understanding cs.CV | cs.AI | cs.CLPDF

Weitai Kang, Hanieh Deilamsalehy, Yumo Xu, Dewang Sultania, Serdar Cellat

TL;DR: CueKFS 是无需训练的长视频关键帧选择方法：把问题拆为动态视觉线索，各线索主动寻找证据，再由推理模型依据证据修订线索并重新探索视频。

Details

Motivation: 单靠问题与帧的相似度会漏掉需要跨时刻或隐含信息的问题；静态拆分问题的子查询又可能因初始上下文不足而失准。

Result: 在三个基准有既有结果可比的 27 种设置中，CueKFS 均取得论文所报的最先进结果，预算平均收益最高比先前基线高 4.54%，中位调用次数为两次。线索迭代可带来最高 92% 的相对相似度提升。

Insight: 初始显著帧用于生成线索，每个线索并行定位各自证据，视觉语言推理代理再根据实际证据修改线索、触发新一轮探索，并在幸存线索间分配帧预算。主动修订使选帧依据随视频证据更新。

Abstract: Keyframe selection (KFS) has long produced compact video summaries for browsing and retrieval, and representative frames for thumbnails. More recently, when conditioned on a question, KFS provides an alternative to uniform sampling for long-video question answering by selecting frames that are more relevant to the question. Most methods rank frames by similarity to the question. Yet a relevant frame may score poorly when the question combines subjects or moments that no single frame shows, or requires implicit information absent from its wording. Other methods try to break down the question into subqueries, but suffer from inaccurate decomposition due to their static initial context. Therefore, we propose CueKFS, a training-free method that reformulates question–frame matching as comparing frames against a set of dynamically generated visual cues. From an initial set of salient frames, we decompose the question into cues. Each cue concurrently probes the video to navigate to its own evidence. A reasoning VLM then agentically revises the cue set against its evidence to re-explore the video. CueKFS then allocates the budget across the surviving cues. Across three benchmarks, CueKFS establishes state-of-the-art results in all 27 evaluated settings with available prior results, achieving budget-averaged gains of up to +4.54% over the previous baseline and a median of only two VLM calls. We further provide a detailed behavioral analysis of CueKFS, showing that agentic cue refinement drives active re-exploration of the video, yielding relative similarity gains of up to 92% over the initial context.

[32] Enhancing Visual Reasoning in Chest X-Ray Report Generation Using Reinforcement Learning cs.CVPDF

Denis Musinguzi, Andrew Katumba, Prasenjit Mitra

TL;DR: 该工作为胸片报告生成设计空间与事实奖励，要求模型的中间推理及最终结论都能由解剖区域和图像证据支持，并用强化学习进一步优化。

Details

Motivation: 监督微调通常按参考报告词面相似度训练，未必保证临床事实正确；已有医学强化学习多只评价最终答案，忽略错误推理过程可能如何造成幻觉。

Result: 以 Qwen3-VL-8B-Instruct 为基础，经医学监督微调、冷启动推理微调和强化学习后，作者报告强化学习带来超出单纯 SFT 的性能收益；同时验证推理步骤和最终输出比只验证其中一方改善更大。摘要未提供指标数值，并指出训练中出现多种奖励破解模式。

Insight: 奖励体系结合解剖区域、边界框和区域文本描述，使过程与结论都接受视觉定位和事实核验。结构化思考轨迹增强了输出可审计性，但发现的奖励破解也提醒：可验证奖励本身仍可能被策略利用。

Abstract: Medical report generation has made significant progress with the rise of modern vision-language models and the growing availability of large-scale medical datasets. However, hallucinations remain a major challenge, largely due to the limitations of supervised fine-tuning (SFT), which prioritizes lexical similarity to reference reports rather than clinical correctness. While reinforcement learning has shown strong performance in domains with verifiable rewards such as mathematics and code generation, its application to open-ended medical tasks remains limited. Existing work focuses on evaluating final answers, overlooking the model’s reasoning, despite evidence that flawed reasoning can degrade overall performance. In this study, we propose a framework that verifies the model’s reasoning process by integrating anatomical regions, bounding boxes, and region-level textual descriptions. We design spatial and factual reward mechanisms to ensure that the model’s reasoning is both visually grounded and factually accurate. Starting from Qwen3-VL-8B-Instruct as our base model, we adapt it to the medical domain using supervised fine-tuning, introduce reasoning capability through a cold-start SFT stage, and refine it with reinforcement learning. We find that RL provides performance gains beyond those achievable through SFT alone, and that jointly verifying both reasoning steps and final outputs yields larger improvements than verifying either in isolation. We further identify multiple modes of reward hacking in the RL stage. Finally, the model’s structured think traces enhance interpretability, making its outputs easier to audit for clinical use.

[33] CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAs cs.CV | cs.AI | cs.LGPDF

Zhenhao Zhang, Zhaoyu Fan, Haohan Ying, Jingwen Hu, Hancen Fan

TL;DR: CaptchaArena 提供大规模交互式验证码操作轨迹，并据此训练单一计算机使用策略处理多种验证码类型。

Details

Motivation: 交互式验证码仍对计算机使用代理具有挑战，而既有数据集难以同时覆盖多类型验证码、真实交互及逐步轨迹监督。

Result: 数据集包含 20 种类型、5 种交互模式的 5 万个谜题及 5 万条截图—动作轨迹，其中 4.6 万条带逐步推理标注，并提供不规则目标像素掩码。9B CaptchaAgent 经监督微调后 Pass@1 为 70.5，强化学习后升至 71.7，并在两个外部基准上改善。

Insight: 每条解答都由执行环境核验，环境验证器直接提供强化学习奖励；因此监督覆盖交互行为而不只是静态图像标签。该工作研究的是面向验证码任务的计算机使用训练，摘要未提供各类型拆分成绩。

Abstract: Interactive CAPTCHAs remain challenging for computer-use agents, while existing datasets face trade-offs among type coverage, interaction fidelity, and trajectory supervision. To address these gaps, we present CaptchaArena, the first large-scale, fine-grained training dataset for interactive CAPTCHA solving. It contains 50K puzzles across 20 CAPTCHA types and 5 interaction modes, with every solution verified through execution. CaptchaArena provides 50K screenshot-action trajectories, including 46K with step-by-step reasoning annotations. It also includes fine-grained pixel-mask annotations for irregular targets. Using CaptchaArena, we train CaptchaAgent, a single 9B policy for all 20 CAPTCHA types, with supervised fine-tuning followed by reinforcement learning. The environment verifier directly provides the RL reward. Supervised fine-tuning reaches 70.5 Pass@1, and reinforcement learning further improves it to 71.7, while also improving performance on two external benchmarks. These results demonstrate the value of large-scale, fine-grained computer-use supervision for training interactive CAPTCHA agents. We release CaptchaArena and CaptchaAgent at https://github.com/X0X0X00/CaptchaArena.

[34] Double-Edged Sword of Mediated Visibility: How Visual Framing Undermines Congresswomen’s Perceived Competence cs.CVPDF

Bryce J. Dietrich, Hyein Ko, Myriam Shiran

TL;DR: 该研究结合大规模新闻视频视觉分析和预注册实验，考察电视画面构图如何影响美国女议员的可见度及公众对其能力、亲和力的评价。

Details

Motivation: 女性在国会中的比例长期低于 30%，电视新闻中的画面呈现可能进一步影响公众对政治人物能力和权威的感知；过去研究较多关注她们是否出现，较少分析镜头如何构图。

Result: 对 CNN 和 Fox News 在 2011–2021 年的 695,464 个图文片段进行面部识别分析，发现女议员更常出现在分屏而非单人镜头。两项共 6,220 人的预注册实验显示：静态分屏降低女性议员的感知政治能力，但不影响男性议员；动态视频中这一能力差异消失，愤怒措辞对女性议员亲和力的负面影响约为男性的三倍。女性观众政治效能感变化的证据仅达到 p=0.057。

Insight: 视觉框架的影响取决于媒体形式和评价维度，静态图像与动态视频的结果不能混为一谈。对政治效能感的发现属于边缘显著的提示性证据，作者将其与较明确的实验效应区分开来。

Abstract: Women’s presence in Congress has stalled below 30%. That institutional underrepresentation is mirrored by their limited visibility on televised news, where visual presentation can shape perceived competence and authority. Yet research tells us more about whether congresswomen appear than how they are visually framed. Facial recognition analysis of 695,464 image-text segments from CNN and Fox News (2011-2021) reveals that congresswomen appear disproportionately in split-screen rather than solo shots. Two pre-registered experiments with 6,220 participants show that, in static frames, split-screen framing reduces congresswomen’s perceived political competence, but not congressmen’s. In dynamic videos, the competence penalty disappears; instead, outraged language reduces a congresswoman’s perceived warmth roughly three times as much as a congressman’s. Suggestive evidence (p = .057) indicates that women viewers report greater external political efficacy after watching a congresswoman appear alone. We conclude that visual framing shapes both congresswomen’s mediated visibility and their perceived capabilities.

[35] Does Vision-Language Pretraining Granularity Matter? A Controlled Evaluation of Vision-Language Objectives Across Chest X-Ray Interpretation Tasks cs.CV | eess.IVPDF

Denis Musinguzi, Andrew Katumba, Prasenjit Mitra

TL;DR: 该研究在固定视觉编码器和预训练数据的条件下比较九种胸片视觉语言预训练目标，发现监督粒度与下游任务粒度的匹配会影响表现，但不存在处处最优的目标。

Details

Motivation: 视觉语言预训练目标提供的监督有全局或局部之分，这种空间粒度如何影响不同胸片解读任务仍缺少受控分析；若同时改变编码器或数据，则难以归因。

Result: 研究在五个空间粒度递增的胸片任务上比较九种目标。局部目标在异常检测上领先，全局目标在分类上领先；局部目标在全局报告生成和问答中也有竞争力。组合目标中，图像描述加对比监督在分类和分布内生成上最好，两个描述目标组合在零样本报告生成上泛化最好。

Insight: 描述与对比学习的相对优势会随任务空间粒度反转；因此不能把某一种预训练目标推广为所有医学视觉语言任务的通用最优选择。

Abstract: Vision-language pretraining objectives differ in the spatial granularity of their supervision, yet the implications of this distribution for chest X-ray interpretation remain underexplored. We present a controlled study that isolates the pretraining objective: holding the encoder and pretraining data fixed, we train nine objectives spanning global and local contrastive learning, captioning, and their combinations, and evaluate across five chest X-ray tasks of increasing spatial granularity. We find that (i) pretraining granularity aligns with task granularity at the extremes, with local objectives leading on abnormality detection and global objectives on classification; (ii) local objectives are surprisingly competitive on global-level generation and question answering tasks; (iii) the merits of captioning and contrastive learning reverse across granularity levels; and (iv) among combinations, mixing captioning and contrastive supervision is strongest on classification and in distribution generation, while pairing two captioning objectives generalizes best on zero-shot report generation. These results show that no single objective is universally optimal, and that the interaction of objective type, granularity, and task governs downstream performance.

Quinlan Sykora, Sourav Biswas, Christopher Diehl, Andrew Cunningham, Thomas Gilles

TL;DR: TriO 是无需人工标注的三模态占用世界模型，用摄像头、激光雷达和毫米波雷达作为输入及自监督信号，联合预测 4D 占用、障碍物分割、流场和 LiDAR。

Details

Motivation: 开放集方法在长尾物体和可行驶区域外障碍物上存在局限，而额外人工标注成本高。作者利用多种传感器间的一致性提供自监督学习信号。

Result: 论文报告 TriO 在 Argoverse 2、Spotting the Unexpected 等数据集的占用、流场、LiDAR 预测及零样本道路障碍分割任务上取得最先进结果。摘要没有列出具体指标或逐基准对比数值。

Insight: 三种传感器既提供模型输入，也互为监督来源；联合学习能从可行驶表面中分出开放类别占用，意在缓解开放集方法对长尾目标处理不足。

Abstract: We present TriO, a multi-modal unsupervised world model that predicts 4D occupancy, obstacle segmentation, flow and LiDAR. In contrast to prior work, TriO utilizes three distinct sensor modalities (camera, LiDAR, and RADAR) as both inputs and sources of self-supervision, eliminating the need for additional human annotations. Thanks to its novel supervision, the model is able to segment any occupancy from the drivable surface, overcoming the limitations of existing open-set methods in handling long-tail objects. TriO achieves state-of-the-art results in multiple 3D and 4D tasks, including occupancy, flow, and LiDAR prediction, as well as zero-shot road obstacle segmentation across multiple datasets such as Argoverse 2, and Spotting the Unexpected.

Chenyue Li, Xiaoxiao Sun, Yubo Deng, Qinlin Zhao, Serena Yeung-Levy

TL;DR: ScreenHaystack 通过在高分辨率 GUI 背景中系统移动目标图标，测量界面定位模型是否存在与目标外观和指令无关的空间盲区。

Details

Motivation: 固定位置测试难区分模型的目标识别能力与屏幕位置偏差；实际 GUI 代理可能对某些空间区域定位明显更差。

Result: 评估显示 Qwen3-VL、UI-TARS、GTA 和 UI-Venus 等模型存在空间盲区。盲区还迁移到未见的 ScreenSpot-Pro 样例；Qwen3-VL-8B 对盲区目标的准确率下降 16.1 个百分点。受控移动目标实验验证移入盲区会降准确率、移出则提升；面向盲区的数据增强优于原始或随机增强的 Click-100k 微调。

Insight: 系统移动同一目标，保持其外观和指令不变，可隔离空间位置对 grounding 的影响。合成实验还表明训练数据空间覆盖不均可能导致盲区，说明有针对性的空间补充比盲目增加随机样本更有效。

Abstract: We introduce ScreenHaystack, a dynamic needle-in-a-haystack benchmark for evaluating spatial reliability in GUI grounding. Instead of testing each target at a fixed position, ScreenHaystack systematically relocates controlled target icons across high-resolution GUI backgrounds and measures whether models can localize them consistently. Using this benchmark, we find that leading GUI grounding models, including Qwen3-VL, UI-TARS, GTA, and UI-Venus, exhibit blind zones: spatial regions where grounding accuracy drops sharply despite fixed target appearance and instruction. These blind zones transfer to unseen ScreenSpot-Pro examples: targets inside blind zones are consistently harder to ground, with Qwen3-VL-8B dropping by 16.1 percentage points, and controlled relocation shows that moving targets into blind zones decreases accuracy while moving them out improves accuracy. We further show through controlled synthetic experiments that uneven spatial coverage in training data can induce such blind zones. Therefore, we propose a simple strategy, blind-zone-oriented augmentation, which adds supervision in blind zones and improves ScreenSpot-Pro accuracy over both original and randomly augmented Click-100k fine-tuning.

[38] Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence cs.CV | cs.AI | cs.CL | cs.IR | cs.LGPDF

Souhail Bakkali, Ayoub Merimi

TL;DR: 该综述将文档智能的“无状态瓶颈”定义为系统跨文件和会话无法保留证据并将经验转化为持久知识，并提出持久化文档状态的框架与评测方向。

Details

Motivation: 当前文档 AI 可以读取合同、抽取字段并定位页面证据，但处理后常不保留结构、矛盾和历史经验；增加参数、上下文长度或检索并不能自动实现跨会话知识整合。

Result: 作者对 10 个代表性基准按 8 项状态性标准审计，发现它们均未测试跨会话状态演化；提出纵向基准框架及五类反事实指标，用于衡量经验收益、成本效率、记忆伤害、遗忘保真和覆盖保持。摘要未报告实证模型分数。

Insight: 持久状态应保留与文档结构、来源链及时间有效性关联的证据，而不是只把内容存储或检索回来。文档 AI 下一阶段的关键问题是系统跨文档、跨会话究竟保留什么，以及如何治理这种记忆。

Abstract: Modern Document AI reads contracts, extracts fields, reasons over tables, and grounds answers to page regions, then forgets everything. Processing an amendment the next day begins from scratch: no schema retained, no contradiction detected, no experience carried forward. This is a structural choice, not a scale failure: current systems are stateless functions. We call this the statelessness bottleneck. This bottleneck lies beyond parameter scaling, context extension, and retrieval augmentation: storage provides persistence and retrieval provides access, but neither consolidates observations into knowledge that improves future processing. This survey formalizes persistent evidence-grounded document state as a unifying framework, specifying the operations and invariants required to convert multimodal evidence into durable, provenance-linked state. We introduce a statefulness audit showing that ten representative benchmarks, coded against eight statefulness criteria, leave cross-session state evolution untested, and derive a longitudinal benchmark harness with five counterfactual metrics: Experience Gain, Cost Efficiency, Memory Harm, Forgetting Fidelity, Coverage Retention, to characterize the benefit, cost, risk, and governability of persistent document state. Document AI lacks mechanisms coupling persistent state to document-native structure, provenance, and temporal validity. The next era of Document AI will be defined by what systems retain across documents, sessions, and time.

[39] CausalDriveBench: Evaluating Causal Reasoning in Vision-Language-Action Models for Autonomous Driving cs.CV | cs.ROPDF

Narendiran Chembu, Navvrat Rao, Shreedhar Shreeshail Kodate, Gayatri Srujana Banda, Arko Sarkar

TL;DR: CausalDriveBench 用因果场景图、因果问答和反事实轨迹评估自动驾驶视觉语言动作模型是否真正理解场景因果关系，而非只生成流畅解释或拟合常见轨迹。

Details

Motivation: VLA 会同时输出自然语言推理和驾驶轨迹，但这些推理是否反映场景中的因果结构尚未被充分检验；仅凭观察场景下的准确轨迹不足以证明模型具备因果理解。

Result: 基准包含 nuScenes 衍生的 7,285 个已核验因果问答和 1,000 条反事实轨迹。13 个模型中最佳问答准确率仅 70.6%，4 个低于随机水平；驾驶微调相对共享语言骨干的通用 VLM，在因果问答上的代价为 2–34 个百分点。问答与轨迹准确率在模型间统计上不相关，反事实提示下轨迹会过度反应或退回观察场景基线。

Insight: 场景图区分因果活跃、休眠和干扰实体，并覆盖因果层级中的关联、干预、反事实及因果发现；反事实参考轨迹则允许对行动层面进行核验。研究指出，推理文本流畅或普通场景轨迹准确都不能单独作为因果理解证据。

Abstract: Vision-Language-Action (VLA) models for autonomous driving produce natural-language reasoning alongside predicted trajectories, but whether this reasoning reflects the causal structure of the scene remains untested. We introduce CausalDriveBench, an evaluation framework grounded in Pearl’s Causal Hierarchy (PCH) that tests causal reasoning in driving-specific VLAs through structured visual question answering (QA) and alternative-trajectory prediction. To this end, we construct causal scene graphs over nuScenes that distinguish causally active, dormant, and distractor entities, separating perceptual salience from causal relevance. The benchmark spans all four rungs of PCH (association, intervention, and counterfactual along with causal discovery) for QA generation. For the higher rungs, we additionally provide reference trajectories under specified scene modifications, enabling action-level verification that complements reasoning-level evaluation. In total, the benchmark contains 7,285 verified causal QA pairs and 1,000 counterfactual trajectories derived from nuScenes. We evaluate 10 driving-specific VLAs and 3 general-purpose VLMs, and report three findings. First, the best model reaches only 70.6% QA accuracy, and 4 of 13 models score below random chance. Second, comparing each driving VLA to the general-purpose VLM that shares its language backbone, the cost of driving fine-tuning ranges from 2 to 34 percentage points on causal QA, with post-training design explaining the spread. Third, causal QA and trajectory accuracy are statistically uncorrelated across models: under counterfactual prompts, predicted trajectories either over-react or collapse onto the observed-scene baseline. Taken together, these results show that neither fluent rationales nor accurate observed-scene trajectories constitute evidence of causal understanding.

[40] PruneForget: Joint Unlearning and Pruning of Vision Models cs.CVPDF

Yu-Shan Tai, Amber Yijia Zheng, Raymond A. Yeh

TL;DR: PruneForget 将机器遗忘与模型剪枝联合优化，让遗忘样本集同时指导参数删除，以兼顾移除指定样本影响和降低模型推理成本。

Details

Motivation: 现实部署往往同时要求模型响应遗忘请求并满足延迟、内存限制；现有工作通常先遗忘再剪枝，未利用两项任务都涉及删除参数这一共同结构。

Result: 在图像分类器和生成模型上的实验显示，PruneForget 能移除待遗忘样本影响并得到更紧凑、推理成本更低的模型；与“从头重训以遗忘再剪枝”的 oracle 相比，性能差距很小。摘要未给出具体指标。

Insight: 方法使用遗忘集引导剪枝，使包含相关信息的参数成为自然候选，同时让遗忘和压缩彼此配合。结论限于论文评测的模型与遗忘设置，摘要没有报告不同遗忘强度下的定量结果。

Abstract: Machine unlearning and model pruning are increasingly coupled in the real world. Models must support unlearning requests, e.g., for safety concerns, while also meeting requirements in latency and memory budget. Until recently, existing works have studied each aspect as an independent problem, e.g., running unlearning and pruning sequentially. In this work, we show that unlearning and pruning are naturally aligned and should be solved jointly to be made aware of each other. Intuitively, parameters that encode information of the unlearned samples are natural pruning targets, as unlearning and pruning both call for the “deletion” of such parameters. We propose PruneForget, a method that uses the unlearn set as a guide for pruning, so that unlearning and pruning mutually benefit each other. Extensive experiments on image classifiers and generative models show that PruneForget removes the influence of the unlearned samples while producing a more compact model with reduced inference cost. It achieves a negligible performance gap relative to an oracle that retrains from scratch for unlearning and then prunes.

Hui Ye, Yudong Liu, Yiran Chen, Rajshekhar Sunderraman, Shihao Ji

TL;DR: PQR3D 在参考条件化的时间窗口内逐步细化多视角三维检测查询，无需跨帧持久查询记忆，支持随机抽帧训练和独立帧推理。

Details

Motivation: 流式相机三维检测器通常把查询状态从一帧传到下一帧，因此需要序列化训练和按时间顺序推理，难以独立处理帧。

Result: 使用 ViT-L 骨干时，PQR3D 在 nuScenes 测试集达到 71.6 NDS 和 64.9 mAP，论文报告为新的最先进成绩。

Insight: 时间窗口内将早期的高置信运动对齐查询逐步传到目标帧；掩码自注意力隔离去噪监督与检测查询，分阶段锚点嵌入则把位置提前注入、将尺寸方向速度延后注入，以减少时间不一致属性间的干扰。

Abstract: Temporal context is essential for camera-only multi-view 3D object detection. Existing streaming detectors maintain and propagate query states from one frame to the next, requiring sequence-aware training and chronological inference. We propose PQR3D, which performs progressive query refinement within referenceconditioned temporal windows. This design enables random frame sampling and independent inference without persistent query memory. Within each window, PQR3D progressively transfers motion-aligned high-confidence queries from earlier timestamps toward the target frame. We further introduce masked selfattention to regulate interactions among regular, propagated, and denoising queries while keeping denoising supervision isolated from detection queries. In addition, a stage-decoupled anchor embedding injects position before self-attention and size, orientation, and velocity afterward, reducing interference from temporally inconsistent attributes. With a ViT-L backbone, PQR3D sets a new state of the art on the nuScenes test set, achieving 71.6 NDS and 64.9 mAP. Source code is available at https://github.com/huiyegit/PQR3D

Boseong Jeon, Junhyeop Lee, Juhan Cha, Hayoung Kim

TL;DR: OneFixer 针对驾驶场景 3D 高斯泼溅渲染提出单步自回归视频修复器，在训练中直接使用自身预测作为后续上下文，联合学习当前帧保真和长序列稳定性。

Details

Motivation: 一步因果生成中每个不完美预测会立即成为下一帧上下文，错误可能累积。已有多阶段训练和 rollout 正则化虽能稳定序列，但延迟与单步画质仍难满足部署需求。

Result: 在 Waymo 和专有驾驶场景的 900 帧 rollout 中，OneFixer 在单步方法基线中取得最低 FVD、LPIPS 和 DISTS，时间一致性达到或超过多阶段 DMD 流程；相同骨干与条件下训练所需 GPU 时数不到多阶段流程一半，且平台期后仍持续改善。闭环驾驶模拟中，相较原始 3DGS 渲染，碰撞率降低约三分之一。

Insight: 共享 rollout 同时接受 flow matching 训练和像素空间感知监督，使部署时的自身误差在训练中可见；车道几何与动态参与者状态提供额外几何线索，因此无需先做双向到因果转换或教师—学生蒸馏。

Abstract: Autoregressive video diffusion is a promising render-time fixer for 3D Gaussian Splatting (3DGS) in autonomous-driving simulation, but deployment demands high visual quality and temporal consistency at low latency. This is especially hard for one-step causal generation, where each imperfect prediction immediately becomes context for subsequent frames. Existing approaches stabilize rollouts through staged training with multiple modules and rollout-aware regularization, yet one-step quality still falls short of what deployment requires. We introduce OneFixer, a one-step autoregressive video-diffusion fixer trained in a single task-specific adaptation stage. Our key idea is a deployment-matched shared rollout: the model’s own one-step predictions serve as the causal context for flow matching, exposing training to deployment-time errors, while the same rollout receives direct pixel-space perceptual supervision to preserve fine detail. Because the predictions optimized for current-frame quality are exactly those reused as future context, fidelity and autoregressive robustness are learned jointly, without bidirectional-to-causal conversion or teacher-student distillation. OneFixer further exploits cues that driving simulation readily provides, lane geometry and dynamic-agent states, to improve geometric fidelity. On Waymo and proprietary driving scenes with 900-frame rollouts, OneFixer achieves the lowest FVD, LPIPS, and DISTS among all baselines at one step, with temporal consistency matching or exceeding multi-stage DMD pipelines. Under identical backbone and conditioning, it matches a multi-stage DMD-with-Self-Forcing pipeline in under half the GPU-hours and keeps improving beyond its plateau. In closed-loop simulation with a driving policy, OneFixer reduces the collision rate by a third relative to raw 3DGS rendering. Project page: https://onefixer-web.vercel.app/

[43] Binaural Audio-Visual Instance Segmentation cs.CV | cs.SD | eess.ASPDF

Saijun Wang, Guanfeng Tang, Hongbo Zhao, Zhicheng Lei, Yutong Zhang

TL;DR: BiAVIS 提出双耳音视频实例分割任务和模型，利用双耳声音中的空间线索区分画面中同类别但不同个体的发声对象。

Details

Motivation: 多数音视频分割方法使用单耳音频，主要依赖跨模态语义对应，因此难以区分外观相似且属于同一类别的多个发声实例；人类则能利用双耳时间差和方向相关滤波判断声源位置。

Result: 作者通过标注既有双耳数据并采集更具挑战性的真实数据构建两个基准。BiAVIS 在两套基准上优于既有单耳分割方法；在更困难的 BiAVIS-Bench 上，mAP 高 17.22%，FSLA 高 7.71%（摘要按百分比表述）。

Insight: 模型先从双耳音频学习声源定位网络提供的空间与语义先验，再通过查询级音视频融合注入实例分割解码器。其优势尤其体现在解决实例级的类内歧义。

Abstract: Audio-visual segmentation (AVS) aims to segment sounding objects at the pixel level by integrating auditory and visual cues. However, existing methods are predominantly developed under the monaural setting and primarily rely on cross-modal semantic correspondence, which limits their ability to distinguish visually similar instances of the same semantic class. In contrast, humans naturally exploit binaural hearing, where interaural differences and direction-dependent acoustic filtering introduced by the head and pinnae provide physically grounded spatial cues for accurate sound source localization. Motivated by this observation, we introduce binaural audio-visual instance segmentation (BiAVIS), a new task that leverages synchronized binaural audio and video frames to segment sounding instances. To advance research on this task, we establish two benchmarks by manually annotating an existing binaural audio-visual dataset and collecting a new real-world dataset, BiAVIS-Bench, in more challenging and diverse scenarios. We further propose a BiAVIS model, which leverages an audio-only sound source localization network to learn spatial and semantic priors for sounding instances from binaural audio. A query-level audio-visual fusion strategy is subsequently introduced to inject these informative priors into the instance segmentation decoder. Extensive experiments conducted on the two proposed benchmarks demonstrate the superior performance of the BiAVIS model over previous monaural AVS methods, especially in resolving instance-level intra-class ambiguity. On the more challenging BiAVIS-Bench, the proposed BiAVIS model outperforms the best-performing monaural baselines by 17.22% in mAP and 7.71% in FSLA, respectively.

[44] KeyRec: Bounded Visual Memory for Streaming and Long-Video Understanding cs.CV | cs.AIPDF

Zihan Chen, Xuejian Rong, Xiaojuan Wang, Boqing Gong, Adi Zicher

TL;DR: KeyRec 是免训练的长视频视觉记忆方法，将近期细节放入缓存、历史证据整理为事件库，并按问题动态分配固定读取预算。

Details

Motivation: 长视频和连续流中的视觉 token 随时长增长，导致推理成本过高；只保留显著 token 的方法可能破坏连贯事件证据，也难区分近期细节与长程历史。

Result: 在四个流式与长视频基准、三种视觉语言模型骨干上，KeyRec 用稠密解码器 token 预算的 10%，在 15 种设置中的 13 种取得最佳压缩表现。实时问题得分比最强压缩基线高 2.21–18.37 点；六种长视频设置中五种最佳，并在 NEO-ov 2B 的所有设置中领先。

Insight: 查询无关地把细粒度近期观察保存在视觉缓存，把历史证据组织为事件并在线执行新增、合并、淘汰；问题到来后由纯文本路由器分配近期与事件记忆读取预算，无需重新处理旧帧。框架支持模块化 VLM 和无 encoder/projector 的 NEO-ov。

Abstract: Vision-language models are increasingly used to understand long videos and continuous streams. However, dense visual tokens accumulate with video duration, making long-context inference prohibitively expensive. Existing training-free visual-token selection methods reduce this cost by retaining informative tokens, but may lose coherent event evidence and fail to distinguish detailed recent observations from long-range history. We propose \textbf{KeyRec}, a training-free framework for constructing bounded visual memory. During query-agnostic writing, KeyRec preserves fine-grained recent observations in a visual cache and organizes historical evidence into a structured event bank. Candidate events are proposed according to their novelty relative to previously stored events and maintained through an online add–merge–evict update. When a question arrives, a text-only router adaptively allocates a fixed readout budget between recent and event memory, without reprocessing historical frames. KeyRec operates on model-facing visual embeddings and supports both modular encoder–projector VLMs and the encoder- and projector-free NEO-ov architecture. Across four streaming and long-video benchmarks and three VLM backbones, KeyRec achieves the best compressed performance in 13 of 15 settings using only 10% of the dense decoder-facing visual-token budget. It outperforms the strongest compressed baseline by 2.21–18.37 points on real-time questions, achieves the best compressed result in five of six long-video settings, and performs best in every NEO-ov 2B setting.

[45] Scalable In-Domain Self-Supervised Foundation Model for Dense Representation Transfer in High-Resolution Plant Imaging cs.CV | eess.IVPDF

Junlin Guo, Sharmin Majumder, Isaac Lyngaas, John Lagergren, Xiao Wang

TL;DR: 该工作在超过一千万块多视角植物图像上训练领域内自监督基础模型，并显示领域预训练能提升高分辨率植物图像的稠密特征迁移。

Details

Motivation: 植物高分辨率图像有利于精细形态分析，但像素标注成本高、图像尺寸大且成像条件变化显著；自然图像预训练模型与植物科学图像之间存在领域差距。

Result: 基于 ViT 的掩码自编码器在超过 1,000 万个多视角植物图像块上分布式预训练。有限标注、跨视角和分辨率退化评估中，领域内模型 Mean Dice 为 0.8686、Pooled Dice 为 0.8959，较自然图像预训练的 MAE 分别高 0.0694 和 0.0613；扩大预训练规模也持续改善稠密迁移。

Insight: 领域内预训练改善了高像素科学图像的稠密表示，而非仅提升全局分类特征；在标签有限和成像条件变化下仍取得优势，支持对科学视觉领域进行大规模自监督预训练。

Abstract: High-resolution plant imaging enables detailed characterization of plant morphology, but dense scientific analysis remains limited by costly pixel-level annotations, large image pixel dimensions, and substantial variation in imaging conditions. This work proposes a scalable in-domain self-supervised pretrained foundation model for high-resolution, high-pixel-dimension multi-species plant imagery. A masked autoencoder with a ViT backbone is pretrained on more than 10 million multi-view plant image tiles using distributed training. Following scalable pretraining, the learned foundation-model representations are comprehensively benchmarked across fine-grained dense prediction and coarse global feature recognition, with particular emphasis on limited supervision and realistic downstream imaging conditions. This work focuses on the domain gap of existing foundation models in dense feature representation and transfer. Through extensive experiments involving limited annotations, cross-view variation, and resolution degradation, the in-domain FM achieves a Mean Dice of 0.8686 and a Pooled Dice of 0.8959, outperforming an MAE counterpart pretrained on large-scale natural-image data by 0.0694 and 0.0613, respectively. The results further indicate that increasing pretraining scale produces consistent improvements in dense feature transfer. Overall, these findings suggest that scaling in-domain self-supervised pretraining can reduce the domain gap and improve transferable dense representations for high-pixel-dimension scientific imaging.

[46] Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models cs.CV | cs.LGPDF

Wenhao Zhang, Zhongliang Zhou, Shiyuan Zhang, Yiqing Yang, Pinqiao Wang

TL;DR: 该研究提出 CleanSlide 基准与 Pair-DPO 训练方法，试图区分病理视觉语言模型的预测究竟来自图像证据、先验知识还是数据污染。

Details

Motivation: 分类准确率不能单独说明模型是否看了组织图像。作者发现多数公开病理 VLM 在输入全切片、标注病灶或完全不提供图像时表现差异很小，因而需要控制问题和患者混杂因素。

Result: CleanSlide 基于 TCGA，包含 9,985 张切片上的 14.9 万个审计过的选择题，并按患者和组织来源划分。Pair-DPO 在该基准上获得的图像证据增益为 15.29%，优于最佳已发表模型的 2.81%；在 CPTAC 与 BCNB 外部队列上准确率分别为 57.6% 和 59.0%，分别领先其他受测模型 9.7 和 3.4 个百分点。

Insight: CleanSlide 检查选项捷径、题干泄漏、跨拆分重复和盲答可能性；Pair-DPO 使用同题同来源、病理结果相反的真实切片对进行偏好学习，以抵消问题本身的信号并突出图像证据。

Abstract: Pathology vision-language models (VLMs) are conventionally evaluated by accuracy, but accuracy alone does not measure evidence use: it may conflate dataset contamination, prior knowledge, and image evidence. In a motivating study of lymph-node metastasis prediction, we found that most public pathology VLMs showed minimal differences when changing from feeding the models with whole-slide images, an annotated lesion, or no image at all. To better understand the specific features leveraged by these models, this paper presents two contributions aimed at disentangling these factors. First, we present CleanSlide, a TCGA-based VQA benchmark designed to eliminate image- and question-side contamination. It contains 149K audited multiple-choice questions over 9,985 slides, with patient- and tissue-source-disjoint splits. Every question is audited for option shortcuts, stem leakage, cross-split duplication, and blind solvability. Second, we propose Pair-DPO, a preference loss over counterfactual slide pairs from the same question and source. By controlling for shared confounding factors, Pair-DPO cancels out the question-attributable signal and leaves image evidence as the source of preference. Specifically, each pair consists of two real slides with opposite, verified findings, introducing neither editing artifacts nor unverified labels for diffuse or graded features such as invasion, necrosis, and tumor grade. Experiments show that our method gains 15.29% from image evidence on the CleanSlide, compared with 2.81% for the best published model. On the external CPTAC and BCNB cohorts, our method achieves accuracies of 57.6% and 59.0%, outperforming all other evaluated models by 9.7% and 3.4%, respectively. We will release the benchmark and code.

[47] Evaluating Single and Multi-Omics Based Explainable Artificial Intelligence (MOXAI) for Molecular Subclass Classification of Adult-Type Diffuse Gliomas cs.CV | cs.AIPDF

Md Zahangir Alom, Quynh T. Tran, Breuer Alexandar, Brent A. Orr

TL;DR: MOXAI 融合 DNA 甲基化与拷贝数变异数据识别成人型弥漫性胶质瘤分子亚型，并通过 Grad-CAM 等方法定位影响分类的基因组区域。

Details

Motivation: 现有模型通常分开分析甲基化和拷贝数变异，无法充分利用互补信息；同时缺少类内风险评估和能够把判定归因到具体基因组位点的解释方法。

Result: 在 TCGA 队列上比较 ResNet50、DINOv2 和图注意力网络的单组学与多组学模型。多模态模型交叉验证准确率最高达 92.98%，优于仅用 CNV 的模型；DINOv2 在独立验证集上、置信度大于 0.9 的样本中准确率为 94.25%。解释结果与已知胶质瘤分子特征一致。

Insight: 模型将甲基化与 CNV 数据联合输入，并用 CAM/Grad-CAM 定位重要 CpG 位点、基因和染色体区域。解释与已知生物学特征相符，为模型提供生物学可解释性支持，但摘要未说明其是否经过独立专家验证。

Abstract: DNA methylation (DNAM) profiling has emerged as a powerful diagnostic tool for classifying brain and solid tumors. However, existing computational models typically analyze methylation and copy number variation (CNV) data separately, failing to capture the complementary information their integration could provide. Moreover, current classification models lack mechanisms for within-class risk assessment analogous to traditional tumor grading, and no established explainability method can attribute classification decisions to specific genomic loci. In this paper, we present MOXAI (Multi-Omics Based Explainable AI), a deep learning framework that integrates DNA methylation and copy number data from methylation arrays to classify molecular subtypes of adult-type diffuse gliomas, alongside single-modality variants for comparison. Using a cohort from The Cancer Genome Atlas (TCGA), we trained ResNet50, DINOv2, and Graph Attention Network (GAT) models on methylation data alone, copy number data alone, and combined multimodal data. We further developed explainable AI (XAI) methods based on class activation maps (CAMs) and gradient-weighted CAM (Grad-CAM) to identify the specific CpG sites, genes, and chromosomal regions most relevant to each classification decision. The multimodal model achieved up to 92.98% cross-validation accuracy, outperforming models trained on CNV data alone. DINOv2 showed the strongest generalization, reaching 94.25% accuracy (confidence >0.9) on independent validation sets. XAI results aligned with established molecular features of adult-type diffuse glioma subtypes, confirming the biological interpretability of the framework.

[48] Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling cs.CVPDF

Hongyi Cai, Yi Herng Ong, Tingshiuan C. Wu, Lim Chiew Hui, Hanxia Li

TL;DR: Devol-ONE 用单一自回归混合 Transformer 联合视觉语言理解、潜在世界动态预测和动作生成，使机器人策略在动作决策时持续结合语义和预测的物理变化。

Details

Motivation: VLA 通常直接根据当前视觉与语言生成动作，没有显式考虑候选动作会如何改变场景；已有世界动作模型虽加入未来状态预测，但常把预测与策略训练分开，仅通过输出连接。

Result: 作者在 LIBERO、LIBERO-PLUS、RoboTwin2.0 以及 Flexiv 单臂和双臂真实机器人上进行实验，并通过消融验证动态流预测与逐层统一注意力的作用。摘要未提供具体任务得分。

Insight: 视觉语言流和 V-JEPA 预训练动态流在同一自回归框架中联合预测；动作专家在每层关注视觉语言缓存，使动作生成持续受语义推理和潜在物理动态影响，而不是只依赖预先算好的固定表示。

Abstract: Vision Language Action (VLA) models condition actions directly on current visual and language context, without an explicit account of how the scene evolves under candidate actions. World Action Models (WAM) attempt to address this limitation by predicting future states, but existing designs keep prediction and policy learning architecturally separate, connecting them only through the predicted output, whether through pixel space video generation or a latent forecasting module trained independently of the policy. We present Devol-ONE, a Mixture of Transformers architecture that unifies vision language understanding, latent world dynamics prediction, and action generation within a single autoregressive framework. Instead of encoding vision language tokens once and feeding them to the action expert, Devol-ONE runs autoregressive prediction jointly across a vision language stream and a V-JEPA pretrained dynamics stream, attending to the vision language key-value cache at every layer to forecast future latent states under language guidance. The action expert is in turn shaped continuously by semantic reasoning and predicted physical dynamics rather than by a fixed representation computed in advance. Extensive experiments are conducted on LIBERO, LIBERO-PLUS, RoboTwin2.0 along with real-world evaluation on Flexiv single-arm and dual-arm setups. Ablation studies show the effectiveness of dynamic stream prediction and layer-wise unified attention to validate our model architectural coherency.

[49] Kernel-Based Steering of CLIP with Vision-Language Model Preferences cs.CV | cs.LGPDF

Sajjad Ghiasvand, Haniyeh Ehsani Oskouie, Sina Mansouri, Mahnoosh Alizadeh, Farzan Farnia

TL;DR: ASK 将视觉语言模型对图像对的偏好蒸馏到 CLIP 核空间，使后续图像检索可仅凭 CLIP 嵌入进行，而不必再次调用教师模型。

Details

Motivation: 视觉语言模型能够判断图像相似性，但其判断不直接形成紧凑、易检索的图像嵌入。研究希望迁移这种偏好，同时保留 CLIP 的图文能力。

Result: 在五个图像领域、四种 CLIP 骨干和六种评审器上评估。ViT-B/16 在适配时未见类别上的平均检索 mAP 从 53.8 升至 75.0，优于以 DINOv2 目标加 KL 锚定得到的 71.7；联合适配图像与文本编码器后，12 个基准及五个适配领域的平均零样本准确率从 61.8% 升至 62.4%。四个数据集的人类标注评估支持按特定视觉差异控制学习目标。

Insight: ASK 从小组内成对偏好构造正半定目标核，并以图文分布锚点保持 CLIP 能力；低秩适配器联合更新图像和文本编码器，推理检索时不再调用 VLM。

Abstract: Large vision-language models (VLMs) can judge visual similarity, but their judgments are not directly available as compact image embeddings for efficient comparison. We study how to transfer these preferences into CLIP while retaining its image–text capabilities. We introduce ASK, a kernel-based steering method that learns from elicited pairwise judgments without accessing teacher embeddings or collecting new human similarity annotations. ASK constructs positive semidefinite target kernels within small image groups and combines visual kernel matching with an image–text distributional anchor. Low-rank adapters jointly update the visual and text encoders while regularizing predictions toward frozen CLIP. After adaptation, retrieval uses CLIP image embeddings and cosine similarity, with no VLM calls. Experiments across five image domains, four CLIP backbones, and six judges evaluate teacher agreement, retrieval, and recognition retention. For ViT-B/16, mean retrieval mAP on classes excluded from adaptation increases from 53.8 to 75.0, compared with 71.7 for DINOv2 targets with KL anchoring. Mean zero-shot accuracy with jointly adapted encoders increases from 61.8% to 62.4%, averaged over 12 benchmarks and the five adaptation domains. Prompting provides an additional capability: selecting which visual distinctions the student learns. Human-annotated evaluations across four datasets support this criterion-specific control.

Rungui Zhou, Chuanzhi Zhou, Ruihuan Wang, Peng-Shuai Wang

TL;DR: 该工作提出对原始三维点云进行盲水印的框架，在验证时只需带水印点云即可恢复消息，并面向常见几何变换提高鲁棒性。

Details

Motivation: 点云无序且常经历重采样和几何预处理，所有权验证困难；实际验证往往无法取得原始点云、颜色、法线或网格连接信息。

Result: 在物体级和场景级基准中，作者报告该方法在常见几何处理后仍能可靠恢复消息，同时保持较低几何失真；定性比较显示扰动比手工方法更不显眼、空间结构性更弱。摘要未给出具体误码率或失真数值。

Insight: 八叉树前馈网络联合学习嵌入与提取，以支持大点集的多尺度几何建模；训练时通过随机几何变换暴露增强鲁棒性，并逐步进行位姿对齐。方法针对点云空间的盲提取，不依赖原始载体进行验证。

Abstract: Raw 3D point clouds are a core geometric representation. Establishing their ownership is challenging because point sets are irregular, unstructured, and frequently altered by resampling and geometric preprocessing. We present a blind watermarking framework that operates directly on xyz coordinates and supports both object-level shapes and scene-scale scans. At verification time, the embedded message is recovered from the observed point cloud alone, without access to the original point cloud, color, normals, or mesh connectivity. The method jointly learns watermark embedding and extraction through a feed-forward octree-based architecture, enabling efficient multi-scale geometric reasoning on large point sets. During training, a stochastic transformation layer exposes the decoder to common geometric perturbations, while progressive pose alignment improves robustness to pose changes. Experiments on object-level and scene-level benchmarks demonstrate reliable message recovery under common geometric processing while maintaining low geometric distortion. Qualitative comparisons further show that the learned perturbations are less visually conspicuous and less spatially structured than those of handcrafted alternatives.

[51] FSS-UBrain: Multi-region Few-Shot Brain Tumor MRI Segmentation cs.CVPDF

Truong Viet Vu, Nguyen Phuc Nguyen, Dang Thi Thu Hang, Tran Thien Thanh, Vo Nguyen Quoc Bao

TL;DR: FSS-UBrain 为脑肿瘤 MRI 提出按肿瘤区域分别进行的一次样本分割方法，以带标签的支持切片条件化待分割查询切片。

Details

Motivation: 全肿瘤、肿瘤核心和强化肿瘤分割在标注有限、跨队列变化及目标稀疏时尤其困难；一个区域的支持样本也不一定能提供其他区域可靠线索。

Result: BraTS 2020 上体积 Dice 分数对 WT、TC、ET 分别为 89.82%、82.14%、77.42%，对应 HD95 为 11.12、9.01、4.46 mm。在 BraTS 2023 和 BraTS-Africa 的目标域支持跨队列协议下，FSS-UBrain 在比较的少样本方法中取得最高平均 Dice 和最低有限配对平均 HD95 点估计。

Insight: 模型分别对三个区域做二元支持—查询分割，利用支持样本的前景/背景描述调整查询特征、瓶颈交互、解码重建和边界；硬负例、全负查询及空查询正则用于抑制目标缺失时的伪前景。目标支持样本从查询集中排除，且不做目标域微调或测试时参数更新；结果仍对支持样本选择和队列差异敏感。

Abstract: Accurate delineation of whole tumor (WT), tumor core (TC), and enhancing tumor (ET) from multimodal magnetic resonance imaging remains challenging under limited annotation, cross-cohort variation, and severe target sparsity. We propose FSS-UBrain, a region-wise one-shot segmentation framework that uses a labeled positive support slice to condition binary query segmentation separately for WT, TC, and ET. Support-derived foreground and background descriptors guide query-feature adaptation, bottleneck interaction, decoder-side reconstruction, and boundary refinement. Episodic training additionally incorporates hard-negative and fully negative queries with empty-query regularization to suppress spurious foreground activation when the selected region is absent. Although inference operates on two-dimensional support–query slice pairs, checkpoint selection, threshold calibration, and final evaluation are performed after volumetric reconstruction. FSS-UBrain is evaluated on a held-out BraTS 2020 split and under target-supported cross-cohort protocols on BraTS 2023 and BraTS-Africa. Cases used as target support are excluded from the query cohorts, and no target-domain fine-tuning or test-time parameter updates are performed. On BraTS 2020, FSS-UBrain achieves volumetric Dice scores of 89.82%, 82.14%, and 77.42% for WT, TC, and ET, respectively, with corresponding 95th-percentile Hausdorff distance (HD95) values of 11.12, 9.01, and 4.46 mm. It also achieves the highest mean Dice and lowest finite-pair mean HD95 point estimates on BraTS 2023 and BraTS-Africa among the compared few-shot methods. These findings support target-conditioned few-shot segmentation while highlighting sensitivity to support selection and cohort-specific variation.

[52] HeroFrame-Bench: Reference-Anchored Evaluation via Rubric–Ranking Co-Evolution for Movie Hero Frame Selection cs.CVPDF

Weitai Kang, Hanieh Deilamsalehy, Yumo Xu, Dewang Sultania, Serdar Cellat

TL;DR: HeroFrame-Bench 评估电影宣传“主视觉帧”选择，利用可复用的已排序参考链及电影特定评分标准，兼顾内容相关性与审美质量。

Details

Motivation: 电影关键帧基准通常优先看语义相关性，有限人工标注可能排除合理替代帧，而视频问答又会把选帧质量与下游模型能力混在一起；宣传主视觉还需要兼顾美学吸引力。

Result: 基准覆盖 204 部电影、2,031 条参考链和 1,970 个学习得到的电影专属评分标准。人工一致性研究中，构造方法把 VLM 与人类判断的一致率从 77.56% 提升至 83.78%；多种方法的评估显示主视觉帧选择仍具有挑战。

Insight: 每个候选帧插入可复用、预排序的参考链，以参考锚定百分位评分；Rubric-Ranking Co-Evolution 联合改进影片专属标准和排序，并使用可验证信号筛选稳健标准。

Abstract: Hero frames are in-film stills used as source imagery for theatrical posters, streaming cover art, film database listings, and other promotional placements. As the first visual entry point, they shape audiences’ initial impressions of the movie and their subsequent willingness to watch it. Selecting these frames, a task we term hero frame selection, requires balancing content relevance with aesthetic appeal. A related task is keyframe selection, yet its benchmarks prioritize relevance over aesthetics, using either finite annotations that exclude valid alternatives or VideoQA that entangles selection quality with downstream model capability. We therefore introduce HeroFrame-Bench, built through a scalable VLM-as-a-Judge framework. We construct multimodal contexts from diverse metadata to ground a VLM judge that scores selected frames using our Reference-anchored Percentile. The percentile is obtained by inserting each frame into reusable, pre-ranked reference chains, enabling direct, extensible, and reliable evaluation. To reduce ambiguity and improve consistency in these subjective judgements, we further propose Rubric-Ranking Co-Evolution, which generates movie-specific rubrics to condition the VLM judge and refines rubrics jointly with the resulting rankings. Within this process, we introduce several verifiable signals, most notably the Inverted Rubric Attack, to select robust rubrics. Finally, HeroFrame-Bench is instantiated over 204 movies with 2,031 reference chains and 1,970 learned rubrics. We build an annotation interface for human-alignment studies which show that our construction design improves VLM agreement with human from 77.56% to 83.78%. Evaluation on multiple methods show that hero frame selection remains challenging.

[53] One Perception, All Maneuvers: Directional Traffic Signal Understanding for Maneuver-Level Signal Intent Prediction cs.CVPDF

Ang Zou, Runzhe Zheng, Zhigang li, Zhen Yang, Han Xia

TL;DR: 该工作把交通信号理解定义为面向直行、左右转和掉头的机动级权限判断，而非只检测红绿灯位置与颜色。

Details

Motivation: 实例检测或颜色识别虽能定位信号，却没有说明每盏可见信号控制车辆哪种行驶机动、允许何种通行状态，留下从感知到规划的语义缺口。

Result: 作者基于 OpenLane-V2 构建带机动级监督的方向交通信号基准，并评估颜色、通行性、全帧一致性和安全关键错误。方向级模型相比图像级分类器及检测流程提高了通行性预测，尤其在多信号复杂路口；摘要未提供具体成绩。

Insight: 方向感知基线联合全局上下文、局部信号证据和机动专属表征，输出各机动关联的信号颜色及其隐含通行权限。该结构可为下游规划提供直接、可解释的接口，并与道路拓扑、路线及周围交通参与者信息结合。

Abstract: Traffic lights are a key regulatory signal for autonomous driving at urban intersections, yet existing traffic signal perception is still predominantly formulated as instance-level detection or color recognition. Such formulations identify where traffic lights are and what colors they display, but leave a critical semantic gap before downstream planning: which ego maneuver is controlled by each visible signal and what dynamic permission the signal expresses for that maneuver. In this paper, we formulate Directional Traffic Signal Understanding, a decision-oriented task that predicts structured signal states for straight, left-turn, right-turn, and U-turn maneuvers from a front-view image. Each state contains the associated signal color and signal-implied passability. Based on OpenLane-V2, we provide a direction-level benchmark with maneuver-level supervision and metrics for color recognition, passability, full-frame consistency, and safety-critical errors. A direction-aware baseline combines global context, localized traffic-light evidence, and maneuver-specific representations. Experiments show that direction-level modeling improves passability prediction over image-level classifiers and detection-oriented pipelines, particularly at complex multi-signal intersections. The resulting representation provides a direct and interpretable traffic-signal interface for downstream planning together with topology, route, and surrounding-agent information.

[54] Progressive-View On-Policy Distillation for Regional-to-Global Transfer in Multimodal LLMs cs.CV | cs.AIPDF

Shanfeng Huang, Zhou Fang, Song Xiao, Hai Du

TL;DR: PVD 通过逐步把学生输入视角从局部裁剪迁移到完整图像，改善区域教师知识向全图多模态推理的蒸馏，并按区域优势调整 token 监督权重。

Details

Motivation: 裁剪条件教师能提供区域级指导，但学生部署时需理解整幅图；简单把裁剪监督迁移到全图难以保持区域优势，输入视角分布不匹配。

Result: 在视觉感知、视觉数学和通用多模态问答基准上，PVD-full 三随机种子平均准确率为 77.51，比无奖励蒸馏高 2.01 点，比匹配奖励变体高 1.00 点；无奖励设置下 PVD-distill 仍提高 1.16 点。

Insight: 学生视角按阶段从裁剪转为保持宽高比的填充裁剪，再到全图；填充裁剪保留局部内容并匹配全图 token 网格。区域优势加权根据教师—学生在当前输入上的对数概率差分配监督，差距扩大时强调高差异 token。

Abstract: Regional-to-global distillation uses crop-conditioned guidance to improve full-image understanding. The challenge is to effectively transfer the teacher’s crop-based advantage to the student’s full-image inference. We propose progressive-view on-policy distillation (PVD), which shifts the student’s view distribution from the crop toward the full image through an intermediate aspect-preserving padded crop. The padded crop preserves regional content while matching the full image’s visual-token grid. Across stages, the view mixture assigns increasing probability to the full image. A lightweight regional-advantage weighting reallocates token-level supervision using the crop-conditioned teacher-student log-probability gap. Evaluated under each sampled input, it applies mild reweighting when the gap is small and emphasizes higher-gap tokens when the gap widens. A Jensen-Shannon metric decomposition interprets this schedule as a shift from matched-input imitation toward the deployment objective. Across benchmarks spanning perception, visual mathematics and general multimodal question answering, PVD-full reaches an average accuracy of 77.51 over three seeds, improving on the reward-free distillation baseline by 2.01 points and on its reward-matched variant by 1.00 point. In the reward-free setting, PVD-distill still gains 1.16 points.

[55] SGA-Flow-GRPO: Spatial Gradient-Guided Credit Assignment for Flow-GRPO cs.CVPDF

Yunkai Yang, Yudong Zhang, Xinying Chen, Bin Luo, Jienan Lyu

TL;DR: SGA-Flow-GRPO 将图像生成强化学习的统一标量优势拆成由奖励梯度引导的空间信用图，使更新更聚焦于与提示相关的图像区域。

Details

Motivation: 标准 Flow-GRPO 对不同去噪时刻和空间潜变量位置使用同一标量优势，没有利用生成图像的空间结构，可能导致策略更新不够精细。

Result: 在 GenEval 上，作者报告该方法达到最先进的对齐质量，收敛速度与 DiffusionNFT 等领先方法相当，并明显优于 Flow-GRPO 系列基线。摘要未提供具体分数。

Insight: 方法将转移级对数似然重写为与 DiT patch 对齐的 token 形式，利用奖励梯度构造连续空间信用图；再以中位数绝对偏差稳健归一化和温度缩放压制噪声、突出有效区域，避免依赖边界敏感的硬分割。

Abstract: Reinforcement Learning (RL) has proven effective in aligning flow-based generative models with human preferences. Recently, Flow-GRPO has emerged as an efficient critic-free paradigm by calculating advantages over sampled candidate trajectories. However, standard Flow-GRPO applies a uniform scalar advantage across both temporal denoising steps and spatial latent dimensions, without explicitly accounting for the spatial structure of generated images, which may lead to sub-optimal policy updates. To address this, we propose a novel gradient-guided spatial credit assignment framework tailored for Diffusion Transformers (DiTs). We first reformulate the transition-level log-likelihood in Flow-GRPO into a token-wise representation natively aligned with DiT patch architectures, constructing spatially fine-grained importance sampling ratios. To allocate localized credit without rigid, boundary-sensitive segmentation heuristics, we introduce a continuous spatial credit map derived from reward gradients. Crucially, we employ an outlier-robust normalization scheme based on Median Absolute Deviation (MAD) coupled with temperature scaling, effectively eliminating gradient noise while highlighting functional prompt-aligned regions. Extensive evaluations on GenEval show that our approach delivers SOTA alignment quality, achieving a convergence rate comparable to top-tier methods like DiffusionNFT while substantially improving upon Flow-GRPO-based methods in alignment performance.

[56] OpenMASC: An Open-Source Pipeline for Cross-Trajectory Metal-Aware Sampling and Correction in Accelerated MRI cs.CVPDF

Zhengyi Lu, Ming Lu, Chongyu Qu, Junchao Zhu, Junlin Guo

TL;DR: OpenMASC 提供涵盖金属伪影数据生成、采样轨迹选择和重建部署的开放 MRI 流程，联合处理欠采样与金属污染。

Details

Motivation: 加速 MRI 方法常假设数据干净，而金属伪影去除通常假设采样完整；缺少同一解剖结构有无金属的配对 k 空间与图像公开数据，也缺少跨采样轨迹的联合方案。

Result: 基于公开 CT 体数据构造 Cartesian 和 radial 格式的干净/含金属 MRI 配对数据；在两个数据集、4 倍和 8 倍加速及两类轨迹上，作者报告相较传统和学习基线均有稳定改善。摘要未提供具体指标。

Insight: MA-VarNet 在展开重建网络的每级加入 DC Rectifier，以修正数据一致性步骤重新引入的伪影；强化学习代理主动选择 k 空间读出，并通过解耦三阶段流程与重建网络联合训练。除数据一致性算子外，框架可支持两种轨迹而不改网络结构。

Abstract: Metal implants corrupt MRI measurements throughout $k$-space, yet existing accelerated MRI methods assume clean data and most metal artifact reduction approaches assume fully sampled acquisitions. No public dataset provides paired $k$-space and images with and without metal for the same anatomy, and no framework jointly addresses artifact-aware acquisition and reconstruction across sampling trajectories. We present OpenMASC, an open-source pipeline covering the full workflow from data generation to deployment. A physics-based data generation module converts public CT volumes into paired clean and metal-corrupted MRI data in both Cartesian and radial formats. MA-VarNet, an unrolled reconstruction network with a per-cascade DC Rectifier, corrects artifacts that data-consistency steps reintroduce from corrupted measurements. A reinforcement learning agent actively selects $k$-space readouts and co-trains with the reconstruction network through a decoupled three-stage procedure. The framework is trajectory-agnostic except for the data-consistency operator, supporting both Cartesian and radial acquisition without architectural changes. Experiments on two datasets at $4\times$ and $8\times$ acceleration demonstrate consistent improvements over conventional and learned baselines on both trajectories.

[57] EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding cs.CV | cs.AIPDF

Gujie Shao, Zixun Xie, Xuechun Xing, Ruixiang Wang, Ziyun Lan

TL;DR: EyeVQA 是面向眼科视觉语言模型的统一问答基准，覆盖从疾病识别、跨图像比较到点位和边界框定位的任务。

Details

Motivation: 现有眼科图像数据集多围绕单一疾病或专门任务，难系统检验 VLM 是否能从疾病识别进一步做到比较推理和细粒度空间定位。

Result: 基准汇集 21 个眼科数据集的 2 万组问答，覆盖六类疾病和七种题型，其中 44.5% 需跨多张图像推理。统一零样本评测 14 个通用、科学和医学 VLM 后，最佳模型总体得分仅 62.8，空间定位和跨任务泛化仍有明显差距。

Insight: 金标准答案直接从数据源中的诊断、严重度、临床发现、分割掩码、框和解剖标志推导，避免依赖模型生成标注，并支持可复现评估。

Abstract: Vision-language models (VLMs) have shown increasing potential for medical image understanding, yet their capabilities in ophthalmic imaging remain insufficiently characterized. Existing ophthalmic datasets are typically designed for individual diseases or specialized tasks, making it difficult to systematically evaluate whether VLMs can move beyond disease recognition toward comparative reasoning and fine-grained spatial grounding. We introduce EyeVQA, a unified visual question answering benchmark for comprehensive evaluation of ophthalmic VLMs. EyeVQA is constructed from 21 available ophthalmic datasets and contains 20,000 question-answer pairs spanning six disease groups and seven question types: Single-Choice, Multi-Select, Variable-Select, True-False, Ranking, Point Location, and Bounding Box. Gold answers are deterministically derived from source-provided diagnoses, severity grades, clinical findings, segmentation masks, bounding boxes, and anatomical landmarks, enabling reproducible evaluation without relying on model-generated annotations. Notably, 44.5% of the questions require reasoning across multiple images, extending evaluation beyond conventional single-image medical VQA. We benchmark fourteen representative general-purpose, scientific, and medically specialized VLMs under a unified zero-shot protocol. The best-performing model only achieves an overall score of 62.8, while substantial gaps remain in spatial grounding and cross-task generalization. These results highlight the limitations of current VLMs in comprehensive ophthalmic visual understanding and establish EyeVQA as a diagnostic benchmark for developing more reliable and spatially grounded ophthalmic multimodal models. The project page is available at https://github.com/PKUTHM/EyeVQA.

[58] Fewer Tokens, More Self-Teaching: On-Policy Self-Distillation for Extreme Visual Token Reduction cs.CV | cs.CL | cs.LGPDF

Junxian Li, Ruixuan Yang, Tianao Zhang, Tiange Xu, Weisheng Dong

TL;DR: LT-OPD 让视觉 token 极度压缩的多模态模型在自身生成轨迹上向全 token 同模型教师蒸馏，并逐步降低训练 token 预算。

Details

Motivation: 视觉 token 可以加速 MLLM，但保留比例很低时性能迅速下降；模型需要适应自身在极少视觉证据下形成的推理状态。

Result: Qwen3.5-4B 在仅保留 5% 视觉 token 时，九个基准的平均保留性能从 68.6% 提升至 82.3%，优于同预算下训练免、训练式和强化学习基线。收益迁移到 Qwen3.5-9B、GLM-4.6V-9B 和 LLaVA-OV-1.5-4B；KV cache 使用量降低 85.2%，prefill FLOPs 降低 85.4%，推理无额外开销。

Insight: 学生以小 token 预算生成轨迹，冻结的全 token 版本沿这些学生状态提供分布监督；预算课程逐步减少视觉 token，使学生适应部署时压缩程度。

Abstract: Visual token reduction is an effective way to accelerate multimodal large language models (MLLMs), but performance deteriorates rapidly under extremely low token budgets. Existing work has explored both visual-token selection and training-based adaptation to reduced visual inputs. We take a step further by asking how a heavily compressed MLLM should learn from the states induced by its own generations. This setting naturally calls for on-policy self-distillation: a heavily compressed model is supervised on the states induced by its own generations, while its full-token counterpart serves as an information-rich teacher. Based on this insight, we propose LT-OPD, a training framework for extreme visual-token reduction. The student rolls out responses with only a small fraction of visual tokens, and a frozen full-token copy of the same MLLM provides distributional supervision along these student-generated trajectories. To stabilize on-policy learning when visual evidence is severely limited, we further introduce a budget-level curriculum that progressively decreases the token budget during training. Across nine benchmarks on Qwen3.5-4B, LT-OPD raises average retained performance under 5% visual-token retention from 68.6% to 82.3%, outperforming training-free, training-based, and reinforcement-learning baselines at the same budget. The gains transfer consistently to Qwen3.5-9B, GLM-4.6V-9B, and LLaVA-OV-1.5-4B. LT-OPD also reduces KV-cache usage by 85.2% and prefill FLOPs by 85.4% without additional inference overhead, demonstrating that on-policy learning can substantially recover capabilities lost to extreme visual-token reduction.

[59] StegGNN: Learning Graphical Representation for Image Steganography cs.CVPDF

Abhinav Kumar, Shorya Singhal, Agam Pandey, Tushar Kumar, Sukrit Jindal

TL;DR: StegGNN 探索把图神经网络用于图像隐写，通过图结构表示图像并学习不可见的信息嵌入，而非只将像素视为规则网格。

Details

Motivation: 多数深度隐写方法基于卷积网络，受局部感受野和规则网格归纳偏置限制；作者考察图表示是否能提供更灵活的图像关系建模。

Result: 在标准基准上的实验显示，基于 GNN 的方法在视觉质量和隐蔽性方面与现有 CNN 基线表现相当。摘要未给出具体指标或比较数值。

Insight: 该框架采用与具体封面图无关的自编码器，把图像建模为图结构以学习嵌入与恢复。结果表明图网络可作为一种可探索的表示方案，但摘要所报效果是与 CNN 相当而非明显领先。

Abstract: Image steganography refers to embedding secret messages within cover images while maintaining imperceptibility. Recent advances in deep learning - primarily driven by Convolutional Neural Networks (CNNs) and architectures such as inverse neural networks, autoencoders, and generative adversarial networks - have led to notable progress. However, these frameworks are primarily built on CNN architectures, which treat images as regular grids and are limited by their receptive field size and a bias toward spatial locality. In parallel, Graph Neural Networks (GNNs) have recently demonstrated strong adaptability in several computer vision tasks, achieving state-of-the-art performance with architectures such as Vision GNN (ViG). This work moves in that direction and introduces StegGNN - a novel autoencoder-based, cover-agnostic image steganography framework based on GNNs. By modeling images as graph structures, our approach leverages the representational flexibility of GNNs over the grid-based rigidity of conventional CNNs. We conduct extensive experiments on standard benchmark datasets to evaluate visual quality and imperceptibility. Our results show that our GNN-based method performs comparably to existing CNN benchmarks. These findings suggest that GNNs provide a promising alternative representation for steganographic embedding and open the field of deep learning-based steganography to further exploration of GNN-based architectures.

[60] An End-to-End Latent-Rollout Approach for Pushing Few-Step ImageNet-$256$ Generation to FID $1.11$ without Fréchet Losses cs.CVPDF

Xiaoran Xu, Yujing Wang

TL;DR: FiST 先用教师模仿建立少步生成初始化，再对完整潜变量 rollout 端到端优化，在不显式最小化 Fréchet 距离的情况下提升 ImageNet 256×256 生成质量。

Details

Motivation: 少步生成器中早期预测会影响后续阶段及最终分布，因此逐阶段独立优化可能不足；端到端训练可以把最终误差传回整个生成轨迹。

Result: 类别条件 ImageNet 256×256 上，三阶段 FiST 达到 FID 1.11、IS 282；两阶段达到 FID 1.15、IS 280。消融分析考察蒸馏、教师检查点、细化监督和跨阶段隐藏状态通信对质量的影响。

Insight: 共享 Transformer 逐阶段组合潜变量状态转移；蒸馏阶段对教师轨迹中的选定状态做 teacher-forced 回归，细化阶段改用真实与生成潜变量特征上的对抗及辅助分类目标。训练全在潜空间进行，生成器使用自己的中间预测，端点梯度贯穿各阶段。

Abstract: Iterative generation poses a joint optimization problem across steps, as intermediate predictions shape subsequent computations and ultimately determine the final output distribution. Few-step generators distilled from pretrained diffusion and flow-matching models make such optimization computationally practical end to end. We build on this opportunity with a distill-then-refine approach that uses teacher imitation to establish a strong initialization for a few-step rollout in latent space, then shifts to end-to-end refinement of the complete latent rollout against real data. We introduce FiST (Flow-in-Stage Transformer), an architecture that composes learned latent-state transitions in a few stages using a shared Transformer, with optional cross-stage hidden communication. Distillation applies teacher-forced regression to selected states along teacher trajectories; refinement replaces this supervision with adversarial and auxiliary classification objectives on the final latent output. A trainable discriminator module operates on semantically rich features extracted from clean real and generated latents by a frozen SiT backbone pretrained with REPA. All training takes place in latent space, without image decoding. During refinement, FiST consumes its own intermediate predictions, and endpoint gradients pass through every generation stage. For class-conditional generation on ImageNet at $256\times256$, our approach achieves FID 1.11 (IS 282) with three stages and FID 1.15 (IS 280) with two. These results demonstrate competitive few-step generation through learned distribution-level supervision, without explicit Fréchet-distance minimization. Ablations characterize how distillation, pretrained checkpoint choices, refinement supervision, and cross-stage hidden communication affect generation quality.

[61] Endo-TSR: Temporal Spectral Modeling of Appearance and Motion for Endoscopic Reconstruction cs.CV | cs.ROPDF

Taoyu Wu, Yiyi Miao, Qi Shao, Zhuoxiao Li, Zhe Tang

TL;DR: Endo-TSR 在可变形高斯泼溅内加入共享时间频率上的外观傅里叶残差和独立平移残差，用于同时建模内窥镜组织运动与随时间变化的外观。

Details

Motivation: 可变形高斯模型能够表示组织轨迹，但固定颜色系数无法专门刻画光度变化；内窥镜重建还需恢复细微表面纹理。

Result: 在 EndoNeRF 和 StereoMIS 数据集上，Endo-TSR 的渲染质量达到论文报告的最先进水平，并在所有评估序列取得最高 PSNR。消融中，时间外观建模带来最大的单组件 PSNR 增益；固定高斯数量时，外观与细节监督联合使用也能改善渲染。

Insight: 颜色变化与位置修正共享时间频率但分别参数化，Matérn 谱先验约束运动修正，多尺度 Laplacian 监督则引导组织细节恢复。

Abstract: Endoscopic scene reconstruction requires modeling tissue motion and temporal appearance while recovering fine surface detail. Deformable Gaussian models provide explicit trajectories, but their fixed colour coefficients lack a dedicated temporal representation for photometric changes. We propose Endo-TSR, which augments deformable Gaussian splatting with bounded Fourier colour residuals and independent translation residuals on shared temporal frequencies. The colour residuals capture local appearance changes, while a Matérn spectral prior regularises motion corrections. Multi-scale Laplacian supervision guides tissue-detail recovery during joint image fitting. Extensive experiments on the EndoNeRF and StereoMIS datasets demonstrate state-of-the-art rendering quality, with the highest PSNR across all evaluated sequences. Ablation studies show that temporal appearance yields the largest PSNR gain among the tested component additions, while appearance and detail supervision jointly improve rendering with fixed Gaussian counts.

[62] Toward On-Chip Training of Spiking Neural Networks for Dense Event-Based Vision cs.CVPDF

Maxime Vaillant, Axel Carlier, Lai Xing Ng, Christophe Hurter, Benoit R. Cottereau

TL;DR: DELL 将局部学习扩展到稠密事件视觉任务，通过每个网络块的可学习局部预测头提供监督，以降低脉冲神经网络训练对全局反向传播的内存需求。

Details

Motivation: 事件相机适合低延迟、资源受限机器人，SNN 也天然处理异步事件流，但通过时间反向传播训练深层模型需要大量内存，不适合神经形态硬件。既有局部学习主要用于分类，难覆盖光流和分割。

Result: 在 DSEC 光流测试集上，DELL 峰值训练内存比端到端 BPTT 低 39.6%，端点误差为 1.670 px，优于同骨干端到端训练的 1.941 px。固定随机读出的 DECOLLE 基线误差高 3.9 倍；可学习局部头恢复并超过端到端方法的各项光流指标。分割实验恢复了大部分差距，但 mIoU 仍略低于端到端训练。2.3M 参数的骨干比最强 SNN 基线小 24 倍，仍具竞争力。

Insight: 块间停止梯度在该实验中更像正则化而非能力约束，可学习且分辨率匹配的局部头是稠密回归有效的关键。光流和分割表现不同，说明局部学习效果依赖预测任务。

Abstract: Event cameras provide low-latency, asynchronous visual sensing for resource-constrained robotics. Spiking neural networks (SNNs) process event streams naturally, but training deep SNNs with backpropagation through time (BPTT) requires substantial memory and remains difficult on neuromorphic hardware. Local learning avoids this by restricting error propagation to local blocks, but existing methods mainly target classification rather than dense prediction. We introduce DELL (Dense Event-driven Local Learning), a block wise scheme for dense event-based vision that replaces global gradient propagation with local dense supervision. Learnable, spatially structured local heads supervise each block at its appropriate resolution while preserving temporal dynamics within blocks. We evaluate DELL on optical-flow regression and semantic segmentation with a fully spiking U-shaped architecture. On DSEC optical flow, DELL reduces peak training memory by 39.6% relative to end-to-end BPTT while improving accuracy, reaching 1.670 px endpoint error on the official test benchmark versus 1.941 px for the same backbone trained end-to-end. Block detachment behaves more like a regularizer than a constraint. DECOLLE, the existing local-learning baseline, relies on fixed random local read-outs poorly suited to dense regression, resulting in a 3.9x higher endpoint error; learnable local heads recover this loss and outperform end-to-end training across all optical-flow metrics. On segmentation, they recover most of the performance gap, although DELL remains a few mIoU points behind end-to-end training. With 2.3M parameters, 24x fewer than the strongest SNN baseline, the backbone remains competitive with the SNN state of the art on DSEC. These results extend local learning to dense event-based prediction while substantially reducing training memory.

[63] CityToolVQA: Tool-Augmented Visual Question Answering for 3D Spatial Cognition in Urban Low-Altitude Environments cs.CVPDF

Boao Yu, Yingzhen Nie, Yue Hu, Zhengqiu Zhu, Rusheng Ju

TL;DR: CityToolVQA 将城市低空视觉问答中的定性问题交给 VLM，将定量三维空间问题交给外部几何工具链处理。

Details

Motivation: RGB 图像视觉语言模型在城市低空场景的距离、尺寸等定量空间问题上表现较弱，单靠语言模型直接估计几何量不可靠。

Result: 在 Open3D-VQA-v2 的 73,324 个测试问题上，CityToolVQA-SFT（Qwen3-VL-8B）总体准确率为 67.6%。将工具链接入 10 个开源 VLM 后，定量任务准确率提高 12.7–36.9 个百分点。

Insight: 工具链依次执行目标定位、分割、深度反投影和空间计算；主链检测无效或不可靠时使用深度辅助提示回退。该流程可零样本接入不同 VLM，SFT 版本则让 8B 骨干适应工具条件输入。

Abstract: CityToolVQA addresses the weak performance of Vision-Language Models (VLMs) on quantitative tasks in urban low-altitude visual question answering. We divide the seven tasks into qualitative and quantitative groups: qualitative questions are answered directly by the VLM, whereas quantitative questions are handled by an external visual-geometric toolchain that performs object grounding, segmentation, depth back-projection, and spatial computation. The toolchain can be attached to different VLMs in a zero-shot manner; a Depth-Assisted Prompt Inference (DAPI) fallback is triggered when the main-chain detection is invalid or unreliable, and CityToolVQA-SFT adapts the 8B backbone to tool-conditioned inputs. On the 73,324-question Open3D-VQA-v2 test set, CityToolVQA-SFT (Qwen3-VL-8B) reaches 67.6% overall accuracy, and attaching the toolchain to ten open-source VLMs improves quantitative-task accuracy by 12.7-36.9 percentage points. These results indicate that externalizing explicit 3D geometric computation effectively complements the limited ability of RGB-only VLMs to estimate metric distances and object sizes.

[64] QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation cs.CVPDF

Bao-Long Tran, Cuong Le, Tahereh Dehdarirad, Fredrik Viksten, Per-Erik Forssén

TL;DR: QuacamFM 在整个 flow matching 生成过程中保持相机旋转的单位四元数约束，以改善稀疏多视图图像的相机位姿估计。

Details

Motivation: 扩散式位姿估计虽可生成多个假设来表达稀疏视图的不确定性，却常将单位四元数当作无约束四维向量处理，忽略单位范数约束并产生不平滑的生成轨迹。

Result: 在 CO3Dv2 上，QuacamFM 的相机位姿准确度优于所比较的扩散方法和经典 SfM；在稀疏视图任务上也优于把标准 flow matching 直接用于四维四元数向量的做法，并展示跨数据集和真实场景泛化。摘要未提供具体误差。

Insight: 方法用球面线性插值构造四元数流的最优传输，使轨迹始终处于单位四元数流形上。显式保留旋转几何结构比把旋转简单视作普通向量更适合稀疏观测下的生成式位姿估计。

Abstract: Camera pose estimation from multi-view images remains a challenge in computer vision. Traditional methods often address this problem using Structure-from-Motion (SfM) with bundle adjustment. However, camera poses estimated from sparse views are inherently ambiguous due to insufficient geometric constraints. Recent work leverages probabilistic models, such as diffusion models, to generate multiple camera pose hypotheses and therefore capture this uncertainty better. Most of these methods represent camera rotations using unit quaternions, but treat them as unconstrained 4D vectors during the generative processes, thereby ignoring the unit-norm constraint of quaternions. Unconstrained quaternions create non-smooth and suboptimal generation trajectories. To this end, we propose QuacamFM, a quaternion-constrained flow matching framework for camera pose estimation that preserves unit quaternion representations throughout the entire flow trajectory. We design the optimal transport of the quaternion flows using smooth spherical linear interpolation. Experiments on CO3Dv2 demonstrate our method’s advantage in camera pose accuracy over diffusion-based methods and classical SfM approaches. We further show that our quaternion-constrained formulation outperforms the naive application of standard flow matching to 4D quaternion vectors on sparse-view camera pose estimation. Finally, it is observed that QuacamFM generalizes well across datasets and in-the-wild examples.

[65] Seeing Parts, Reasoning about Worlds: Visual Inference under Partial Observation cs.CV | cs.AIPDF

Wei Wang, Wenqiao Zhang, Yutong Lin, Jun Xiao, Yueting Zhuang

TL;DR: WorldScope 研究视觉局部观察下仍可能成立的完整世界状态，并用反事实场景和证据子集表示训练模型判断新视角如何排除可能性。

Details

Motivation: 遮挡和未观测区域可能使多个世界状态同时符合当前图像；系统应区分已确认事实、有依据的范围与仍未解决的可能情况，而不是过早给出确定答案。

Result: WorldScope-1.2M 包含 120 万组英文问答，涵盖八种世界属性、十类任务接口和三种观察协议；另含 4,800 组经认证的反事实场景。5,000 题测试集上，WorldFlow exact accuracy 为 64.34%，较同骨干仅用问答训练高 24.88 个百分点；在结构不相交场景的 3,000 题上仍为 50.43%。

Insight: WorldFlow 将跨视角实体证据与支撑面覆盖组成图像子集证据格，并用反事实兼容性和状态转移目标训练表示，使新视角如何约束可能世界可被显式建模。评测还考察选择、组合、移除或调换视角时结论如何变化。

Abstract: World modeling under partial observation requires reasoning about the complete worlds that remain compatible with limited visual evidence. Occluded objects and unseen regions can leave several world states possible; additional views can exclude alternatives and strengthen the conclusions supported by the observations. We introduce WorldScope to study this process through possible-world semantics, evidence-grounded data, and learned visual representations. WorldScope-1.2M provides 1.2 million English question-answer pairs spanning eight world properties, ten task interfaces, and three observation protocols. Its answers encode confirmed facts, supported bounds, and unresolved possibilities. Complementary supervision comprises 4,800 certified counterworld groups with equivalent base observations and different hidden object configurations and query answers. These groups provide physical witnesses of ambiguity and training-only labels for world compatibility and view-induced exclusions. We propose WorldFlow, which composes cross-view entity evidence and support-surface coverage into an image-subset evidence lattice. Counterworld compatibility and transition objectives train subset representations to reflect how new observations constrain possible worlds. A shared answer generator uses these representations to predict the strongest supported conclusion. WorldScope-Bench evaluates claim judgments and evidence-dependent conclusions as views are selected, combined, removed, or ordered. On its 5,000-question test set, WorldFlow reaches 64.34% exact accuracy, improving over the same backbone trained on QA alone by 24.88 percentage points. It retains 50.43% accuracy on the 3,000 questions from structure-disjoint scenes.

[66] REMEDY: How Far Is Video Generation from Medical Education World Models? cs.CVPDF

Lixing Tan, Yanghao Zhou, Qing Xia, Yuting Guo, Shuai Li

TL;DR: REMEDY 是首个评估 AI 生成医学教学示范视频的基准，使用临床检查清单与画面、动作质量指标联合衡量视频是否能正确呈现操作。

Details

Motivation: 视频生成模型已可产生逼真且时间连贯的画面，但医学教学要求具体临床动作也准确；此前尚未系统测量生成视频是否满足这些要求。

Result: 基准以 900 段真实教学视频首帧覆盖四种临床场景和 12 项任务，并由五种开源视频生成模型生成 4,500 段视频。最强模型 MiniMax-H3 的严格临床成功率仅 28.25%；结果显示逼真外观和时间一致性不能保证临床动作正确，细粒度动作仍具挑战。

Insight: 评测分别覆盖临床动作遵循、临床表现、视频质量和动作质量，避免把视觉逼真当成医学演示可靠性的替代指标。该基准为未来医学教育世界模型的开发与评估提供路线。

Abstract: Recent video generation models produce realistic videos and show potential as a foundation for world models. These advances create opportunities for generating medical teaching demonstrations, which requires both convincing visual quality and precise procedural actions. However, whether current generators can meet these requirements has not been measured. To address this problem, we introduce Readiness Evaluation of Medical Education Demonstration sYnthesis (REMEDY), to our knowledge, the first benchmark for AI-generated medical teaching demonstrations. REMEDY provides 900 first frames from real demonstration videos, covering 12 tasks across four scenarios: operating room, imaging, clinic and bedside, and resuscitation. Five contemporary open-source video generation models produce 4,500 videos from these frames. We combine task-specific clinical checklists with video and motion quality metrics. Evaluation covers four dimensions: clinical action following, clinical profiles, video quality, and motion quality. Our results show that realistic appearance and temporal consistency do not ensure correct clinical actions. Even the most advanced MiniMax-H3 achieves only 28.25% on strict clinical success rate, and fine-grained clinical actions remain challenging. These findings establish a foundation and roadmap for developing future medical education world models.

[67] Back-Tracking from Clarity: Self-Learning to See Text from Afar cs.CVPDF

Duc-Tri Tran, Phi Le Nguyen, Minh Hoai

TL;DR: 该方法利用视频中清晰远处文字随摄像运动变化的线索，向前回溯高置信检测，在更早、仍模糊或很小的帧上自动生成伪标签。

Details

Motivation: 场景文本检测器常漏掉远距离、小尺寸和模糊文字；为早期画面人工逐帧标注成本高，而后续画面可能出现更清晰的同一文字实例。

Result: 作者构建专门追踪器保持跨帧文字身份，并提出多语言户外 SceneText50 数据集。实验报告早期文字检测准确率和不同场景、语言下的鲁棒性显著提升；摘要未提供具体指标。

Insight: 方法从大型清晰文本上的高置信检测出发，沿时间反向追踪并合成先前帧的监督，训练专门的早期检测学生，无需人工标注。追踪器的身份一致性是伪标签可靠性的关键条件。

Abstract: We propose a self-supervised framework designed to enhance the capability of scene text detectors in identifying and recognizing text in scenarios where instances are shown at significant distances, typically small, blurred, and frequently missed by conventional models. Our approach leverages the high-fidelity performance of existing text spotting models on large, clear text as a foundational supervisor. By temporally back-tracking these high-confidence detections through video sequences, we automatically synthesize pseudo-labels for preceding frames where the distant text is still visually degraded or undersized. These pseudo-labels enable training a student model specialized for early text detection, without requiring any manual annotation. The success of this approach depends on accurate pseudo-label generation, for which we develop a dedicated scene text tracker capable of maintaining consistent text identities across challenging video sequences. In addition, we propose SceneText50, a diverse multilingual outdoor dataset to facilitate training and evaluation. Experiments show that our framework significantly improves early detection accuracy and robustness across varied scenes and languages. Code and data are at \href{https://github.com/trid2912/BackTrackingText}{https://github.com/trid2912/BackTrackingText}.

[68] UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation cs.CVPDF

Youssef Mansour, Enis Simsar, Fadime Sener, Markos Georgopoulos, Albert Pumarola

TL;DR: UnStep 是无需重训练的因果视频扩散推理加速器，通过减少去噪步数、缩短注意力 KV 时间窗口及优化运行时，使少步模型进一步提速。

Details

Motivation: 蒸馏得到的少步因果视频模型仍可能无法满足实时生成需求；减少步数和缓存窗口又会损害画质，因此需要推理时补偿质量。

Result: UnStep 报告在单张 H100 上达到 50 FPS、GB200 上达到 77 FPS，且生成质量没有损失，显著快于当前方法。摘要未列出各基线的具体速度或质量指标。

Insight: 方法通过重新加噪并用已有干净缓存细化生成帧、对 DiT 注意力投影做截断 SVD，补偿减少步数和窗口造成的质量损失；再结合更高效的注意力、KV 索引、融合 RoPE 和优化 VAE 解码，不需要重训。

Abstract: Distilling bidirectional multi-step video diffusion transformers into few-step causal models has become a common approach for streaming video generation. While these few-step students are significantly faster than the teachers they are distilled from, they remain slow for real-time generation. In this work we present UnStep, a training-free wrapper that accelerates few-step causal video models at inference by running them with fewer diffusion transformer (DiT) steps than during distillation and limiting the temporal window retained in the attention KV cache. We propose two inference-only mechanisms to recover quality lost by step reduction and attention windowing: renoising the generated latent frames to a near-clean level and reusing the existing clean-cache pass to refine them, and applying truncated SVD to the DiT attention value and output projections. We also accelerate inference with a quality-preserving runtime stack for the DiT and VAE decoder, including more efficient attention calls and KV indexing, fused Triton RoPE with cached coefficients, and VAE decoding with optimized memory layout, precision, and convolution kernels. By reducing computation and optimizing the runtime stack, UnStep sets a new throughput regime for causal video diffusion, by running substantially faster than current methods, reaching 50 FPS on a single H100 without quality loss, and 77 FPS on GB200, all without retraining.

[69] SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection cs.CVPDF

Jinlong Hu, Yi Zhang, Zhiqi Xia, Yikang Zhou, Shunping Ji

TL;DR: SetOPD 将遥感开放提示检测中的文本—视觉协同从单一提示向量融合改为候选集合级推理，并保留两种模态各自的检测状态。

Details

Motivation: 现有方法常把多个视觉示例压成一个类别向量，削弱少量异质示例的上下文信息；提示或表征层的融合还发生在模态专属检测状态形成之前，可能限制互补。

Result: 摘要描述了方法设计，但未提供基准、对比数值或量化实验结果，因此无法据此判断相对性能提升。

Insight: BR 提示读取带框示例的完整场景上下文，把支持证据拆为基础锚点和学习残差，并驱动独立视觉检测分支；成对查询仲裁在模态候选状态生成后才进行跨模态选择，再由置换等变模块处理融合集合。

Abstract: Open-prompt detectors allow users to specify targets with text, visual exemplars, or both. We argue that existing designs underuse the visual modality in two ways. First, multiple exemplars are commonly compressed into a single class-level embedding. This textualizes visual prompting: the resulting vector plays the role of another class name, is often aligned to or injected into the text pathway, and may be suboptimal when only a few heterogeneous exemplars are available. Second, existing methods interact primarily in prompt or representation space, before modality-specific detection states are formed. We address both issues from a set perspective: \setopd preserves modality-specific decoding states from a shared prompt-conditioned initialization and performs explicit multimodal collaboration at the candidate-state level. For the first issue, we introduce \br prompting, which reads every boxed exemplar in its full scene context and decomposes the pooled support evidence into a Base anchor and a learned Residual correction; the resulting prompt has fixed capacity regardless of the number of examples and drives its own visual detection pathway. For the second, we recast text–visual collaboration from representation-level fusion into a candidate-set modeling problem. Paired-Query Arbitration (\pqa) then performs explicit cross-modal state arbitration only after modality-specific candidate states have been formed. The two readers share query initialization so their candidates are paired by index; a learned gate arbitrates within each pair, followed by a permutation-equivariant module that reasons over the fused set.

[70] In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion cs.CV | cs.AI | cs.LG | cs.MMPDF

Yikai Wang, Xiao Han, Mengmeng Xu, Juan Camilo Perez, Yiannis Douratsos

TL;DR: FlashForward 复用自回归视频扩散当前去噪阶段已生成的 KV 缓存，并结合稀疏干净锚点，提升长视频分块生成速度且抑制跨块外观和运动漂移。

Details

Motivation: 以往方法需额外前向传播重建干净或较少噪声的历史 KV 缓存，开销很大；直接复用当前阶段缓存虽可省算力，却会因历史含噪而引发块间漂移。

Result: 最多使用四张 GPU 时，在 1.3B/14B 骨干、480p/720p、20 秒及更长、16 FPS 视频上，FlashForward 比 HiAR 快 1.16–1.69 倍，比 Self-Forcing 快 1.42–2.92 倍。VBench 上 1.3B、480p 设置取得更高分数，并在 20、35、65 秒视频中保持稳定。

Insight: 稀疏干净锚点 KV 提供粗粒度长程双侧结构引导，稠密阶段匹配历史保留近期演化细节；不同时间尺度的双记忆缓解提前可用含噪缓存带来的质量代价，同时允许不同去噪阶段并行处理不同视频块。

Abstract: Few-step autoregressive video diffusion generates a long video by splitting the video into temporal chunks and generating chunk-by-chunk, each through a short sequence of denoising stages. To memorize chunks that are already generated, previous methods reconstruct a clean or less-noisy key–value (KV) cache by additional forwards to build the cache without advancing an output latent. However, every denoising forward itself already computes the in-flight KV of the current chunk. We introduce FlashForward, which directly reuses this cache to avoid the heavy cache-update-only model forwards. After the current chunk completes one denoising stage, its stage-specific cache is already available for the next chunk. Assigning one GPU to each stage therefore lets different chunks occupy different stages concurrently. This early availability has a quality cost: the resulting stage-matched history is noisy, causing appearance and motion drift among chunks. To complement it, FlashForward produces sparse auxiliary clean anchor latents before the corresponding region is generated so the generation trajectories can be stabilized by this two-sided conditioning. The two memories operate at different temporal scales: sparse clean anchor KV supplies coarse, long-range two-sided structural guidance, while dense stage-matched history preserves fine, recent evolution. With up to four GPUs, FlashForward runs $1.16$–$1.69\times$ faster than HiAR and $1.42$–$2.92\times$ faster than Self-Forcing for 16 FPS videos of 20 seconds or longer across 1.3B and 14B backbone scales at 480p and 720p. On VBench, for the 1.3B model at 480p, it achieves higher scores and remains stable at longer durations, demonstrating that FlashForward generates high-quality and temporally consistent videos across durations of 20s, 35s and 65s at a much faster generation speed.

[71] RIPE-MambaSpike: Resolution-Independent Spiking-State-Space Interfaces for Parameter-Efficient Event-Based Vision cs.CV | cs.NEPDF

Md Muhiminul Islam, Shoaib Ahmed Dipu, Sayeed Shafayet Chowdhury

TL;DR: RIPE-MambaSpike 用固定通道宽度的多分辨率桥接替代事件 SNN 与 Mamba 骨干间的大型分辨率依赖投影，降低参数量并保持跨输入尺寸效率。

Details

Motivation: 事件视觉的脉冲—状态空间混合网络虽准确，但参数常达数千万；代表性模型约 3,625 万参数中，单个分辨率依赖投影就占 3,355 万。

Result: RIPE-MambaSpike 部署参数量为 0.870M，在固定时间步和通道宽度时，输入面积变化 43 倍仍保持参数量不变；在 CIFAR10-DVS、N-Caltech101 和 DailyDVS-200 上处于性能—参数 Pareto 前沿。DailyDVS-200 的 8.04M 参数配置 top-1 为 45.7%，为论文所述该基准最佳脉冲结果，并以少于稠密 ANN 3.0–15.1 倍的参数超过此前脉冲方法。

Insight: 参数开销主要来自连接接口而非混合架构本身。分层多分辨率桥接、重参数化脉冲阶段、时间解耦调制和受界双流膜电位注意力共同维持识别能力，避免随图像分辨率增加参数。

Abstract: Spiking-Mamba hybrids reach strong accuracy on event-based vision, but existing designs often require tens of millions of parameters. Much of that cost comes from how the spiking front-end is connected to the state-space backbone rather than from the hybrid architecture itself. In a representative model, a single resolution-dependent projection accounts for 33.55M of 36.25M parameters. To that end, we introduce RIPE-MambaSpike (Resolution-Independent, Parameter-Efficient), which replaces that projection with a hierarchical multi-resolution bridge of fixed channel width. Its deployed footprint is 0.870M parameters, constant at fixed time steps and widths across a 43x range of input areas. Reparameterized spiking stages, temporal decoupled modulation, and a dynamic convex-hull-bounded dual-stream membrane-potential attention preserve accuracy under this compact design. Result-wise, RIPE-MambaSpike is pareto-optimal on CIFAR10-DVS, N-Caltech101, and DailyDVS-200. Notably, on the 200-class DailyDVS-200, a scaled 8.04M configuration achieves 45.7% top-1 accuracy, the best reported spiking result on that benchmark, and outperforms prior spiking methods with 3.0-15.1x fewer parameters than dense ANNs. Overall, our findings demonstrate that competitive event-based recognition does not require resolution-dependent parameter growth. Code is available at https://github.com/MuhiminOsim/RIPE-MambaSpike.

[72] Harnessing Coupled Stream Completion For Human-Object Ineraction Modeling cs.CV | cs.AIPDF

Dawei Guan, Di Yang, Jiangtao Wang

TL;DR: TRACE 将人体、物体和手部运动表示为独立但相互耦合的连续潜变量，实现人—物交互生成、缺失运动补全和语言条件理解。

Details

Motivation: 文本条件 HOI 生成需协调不同尺度和动态的人体动作、物体轨迹/旋转及手部姿态；共享表示可能抹去各流特点，独立生成又无法响应其他流变化，潜变量监督也难直接保证解码后的接触关系。

Result: 在 InterAct、OMOMO 和 BEHAVE 上，联合补全训练改善生成，冻结流特征用于理解也优于原始运动编码；InterAct 上 TRACE 在所比较方法中取得最高接触精确率、召回率和 F1。摘要未给出具体数值。

Insight: 各流独立编码，但每条流的速度预测都以完整当前交互状态为条件；解码运动上的几何损失直接约束接触和物体相对运动。模型还可在给定其余两条流时补全任意一条缺失运动流。

Abstract: Text-conditioned human-object interaction (HOI) generation requires body motion, object trajectories & rotations, and hand articulation to remain coordinated. These components differ in scale and dynamics, but must agree on contact, relative pose, and timing. A shared representation may limit the distinct structure of each stream, while independent generation prevents each stream from responding to changes in the others. Latent supervision alone also does not directly constrain contact after decoding. We propose TRACE, a continuous latent framework that keeps stream states separate and couples their updates. TRACE encodes body, object, and hand motion into separate latents and predicts each stream velocity from the complete current interaction state. Geometric losses on decoded motion further constrain contact and object-relative motion over time. The same model supports completion of any single absent stream from the other two. Frozen flow features also serve as input to a language model for HOI understanding. Experiments on InterAct, OMOMO, and BEHAVE show that joint completion training improves generation and that frozen flow features improve understanding over raw-motion encoding. On InterAct, TRACE achieves the highest contact precision, recall, and F1 among the compared methods.

[73] OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents cs.CVPDF

Jihoo Jung, Suho Yoo, Jeongsoo Choi, Hyebin Cho, Tae Wook Haam

TL;DR: OmniSmartHome 是多模态智能家居代理基准，把语音请求与视觉和空间音频上下文配对，评测模型能否处理语言本身描述不充分的日常请求。

Details

Motivation: 现实用户常指向物体或引用所见所闻，单靠语言不足以确定需求；既有智能家居基准通常只提供文本请求。

Result: 基准包含 1,360 个合成和 272 个真实场景片段，并评估 16 个全模态大语言模型。语音已充分表达意图时模型表现较好；需要结合多模态上下文时成绩明显下降。PROME 为模型提供专门音视频感知工具及程序记忆，在六个 Omni-LLM 上通常都能改善表现；摘要未给出具体分数。

Insight: 该基准通过视觉和空间音频补充说话请求中的指代与情境线索；PROME 进一步评估代理如何组织工具调用和证据获取，而不只测试单次端到端回答。

Abstract: Smart-home assistants are expected to handle diverse, realistic requests that arise in daily life. In such interactions, users often rely on the surrounding multimodal context-pointing at objects or referring to what they see or hear, leaving their requests underspecified in language alone. Existing smart-home benchmarks, however, express user requests solely through language, leaving context-dependent real-world requests underexplored. To bridge this gap, we introduce OmniSmartHome, a multimodal smart-home benchmark where each spoken request is paired with the surrounding visual and spatial-audio context, providing complementary cues to disambiguate underspecified requests. OmniSmartHome comprises 1,360 synthetic and 272 real-world episodes. We evaluate 16 omnimodal large language models (Omni-LLMs) and reveal that, while they perform strongly when speech alone sufficiently conveys the user’s intent, performance drops substantially when resolving it requires reasoning over multimodal contextual cues. As a simple agent baseline, we provide PROME (PROcedural Memory for multimodal Evidence gathering), which equips agents with specialized audio-visual perception tools and procedural memory for orchestrating their use. PROME generally improves performance across six Omni-LLMs. Demos and examples are available at https://omni-smart-home.github.io

[74] Attribution Gaps in Zero-Training LLM+OVOD Pipelines: A Fine-Grained Analysis of the CAAP–SNAP Discrepancy cs.CV | cs.CLPDF

Yu-Feng Yen

TL;DR: 该研究在完整 COCO-Val 上分解开放词汇检测中定位能力与语义命名能力的差距，发现主要问题不是小目标或遮挡，而是类别体系不匹配和数据集标注遗漏。

Details

Motivation: LLM 与开放词汇检测器组合常分别评估类别无关定位（CAAP）和语义命名（SNAP），两者分数稳定分离，却缺少对差距来源的细粒度解释。

Result: 在 5,000 张图、27,273 个检测上，LLM 用词超出检测器原生词表时定位准确率从 80.9% 降到 31.6%；但下降几乎来自词语实际指向了 COCO 标注的另一物体，真正同义表达仍有 89.3% 准确率，无关噪声标签为 12.0%。表面上的完全定位失败中，78%–88% 是模型找到真实物体但 COCO 的非穷尽 80 类没有标注，而非凭空幻觉。更换检测器或语言模型后趋势仍在。

Insight: 相当部分 CAAP–SNAP 差距来自封闭类别标注局限，而不是真实 grounding 失败；评价开放世界多模态系统时，应区分命名错配、未标注真实物体和真正的定位幻觉。

Abstract: LAOD and similar zero-training LLM+open-vocabulary-detector (OVOD) pipelines score two things separately: class-agnostic localization accuracy (CAAP) and semantic naming accuracy (SNAP). The two consistently diverge, and nobody has asked why. This paper asks why, on the full 5,000-image COCO-Val split (27,273 detections) rather than the small subset the original work evaluated on. Object visual complexity turns out not to be the driver – small and occluded objects are, if anything, localized better than large ones. Vocabulary novelty is: once the LLM’s wording falls outside the detector’s native category set, localization accuracy falls from 80.9% to 31.6%. That drop is not spread evenly across unfamiliar phrasing, though. Almost all of it comes from cases where the novel wording actually names a different object than the one COCO annotated (true synonyms still score 89.3%; semantically unrelated “noise” labels score 12.0%). A closer look at a further failure subset tells a similar story: 78-88% of what looks like complete localization failure is really the model correctly finding a real object that COCO’s non-exhaustive 80-category scheme simply never labeled, not hallucination. Swap the detector backbone (YOLO-World for Grounding DINO) or the LLM (Gemma-3 for Qwen2.5-VL) and both the effect and its rough size hold up, so this looks like a general property of the pipeline family rather than a quirk of one model pairing. The upshot is that a large share of the apparent CAAP–SNAP gap traces back to closed-category annotation limits rather than a real grounding failure, which matters for how we detect hallucination, analyze failure modes, and design evaluation for grounded multimodal systems meant to work in the open world.

[75] Retrieved but Not Delivered: Multimodal Memory Delivery for Long-Term Agents cs.CV | cs.AI | cs.CL | cs.IRPDF

Yuhang Jiang, Qingwei Liao, Kaize Yin, Xingling Liu, Luca Cuomo

TL;DR: DeliverMem 将多模态长期记忆检索后的“交付”单独作为系统环节，研究检索证据以何种模态、身份和时间信息呈现给回答模型。

Details

Motivation: 已有记忆研究关注写入、更新和召回，却少有评测检索到的信息究竟有多少传到模型、以什么形式传达。固定检索集合时，视觉原始证据可能比进一步提高召回更重要。

Result: 在 MemLens 上固定检索证据，向 8B 骨干提供原始像素而非隐藏图像，准确率提升 13.87 点；同一消息上将检索提升至完美只提高 2.31 点，且三种骨干都呈现交付项更大。DeliverMem 在 MemLens 四种上下文长度均优于最强已发表记忆代理，也在 DMV-Bench 两种骨干的所有设置中领先，输入量仅为对手的十分之一至七十分之一。

Insight: 交付由三项决定：保留原模态、提供可读身份、说明记忆出现时间；其中检索侧适配器补充交付无法提供的属性。每项只在问题缺少相应信息时有益，其他情况下无影响；固定配置无需训练或改写存储记录。

Abstract: Work on memory for multimodal agents optimizes what is written, updated and retrieved. Between retrieval and the answer, however, is a stage that multimodal memory evaluations do not isolate: what of the retrieved memory reaches the model, and in what form. We call it delivery, and a controlled decomposition on MemLens locates the remaining room there. With the retrieved evidence set exactly fixed, delivering the original pixels instead of withholding them raises accuracy by 13.87 points on an 8B backbone, whereas making retrieval perfect on those same messages improves it by 2.31. Delivery is the larger term on all three MemLens backbones and grows with backbone strength; retrieval grows too, without closing the gap. We propose DeliverMem, an instantiation of delivery as three decisions: keep the original modality, give each item a readable identity, and state when it was seen, with a retrieval-side adapter for the one property delivery cannot supply. Each is measured against a delivery-matched control that alters only its own variable. DeliverMem leads the strongest published memory agent on MemLens at all four context lengths, and beats DMV-Bench’s own strongest method at every setting on both backbones. On MemLens it does this on a tenth to a seventieth of the input. Each decision helps only where the question lacks what it supplies, and is null elsewhere. A single fixed configuration nonetheless leads both benchmarks, without training any component or modifying the stored records. Project page: https://avalon-s.github.io/DeliverMem/

[76] SPACE: Sparse Predictive Attractor via Counterfactual Eviction for Streaming Video Memory cs.CVPDF

Hongjin Niu, Weizhan Zhang, Shuo Bao, Jiahao Wang, Muyan Jiao

TL;DR: SPACE 把流式视频记忆淘汰建模为对未来预测状态的反事实控制，用冻结的多时域 JEPA 估计不同淘汰动作会如何改变后续可支持的未来。

Details

Motivation: 固定容量记忆需要不断淘汰历史，但既有策略多以保留信息量或下游准确率评估，较少研究连续更新如何累积改变记忆支持的未来。

Result: 作者提出 MABS-Bench 评估未来任务充分性、同一状态阶段的预测稳定性、转变响应和扰动恢复。多个视频数据集实验中，SPACE 持续改善数据集原生任务表现并降低预测状态漂移；摘要没有给出具体提升数值。

Insight: SPACE 用反事实效用选取有助于未来任务的记忆替代项，再根据缓慢变化的预测吸引域几何，判断应纠正可避免漂移还是适应持续的场景变化；无需在线更新模型参数。

Abstract: Fixed-capacity streaming video memory requires repeated eviction decisions whose effects accumulate over time. Yet existing policies are evaluated primarily in terms of retained information or downstream accuracy, leaving how repeated updates alter the futures supported by memory largely unexamined. We define a memory’s predictive state as the future representations supported by its retained history and formulate eviction as counterfactual control over transitions in this space. We introduce SPACE (Sparse Predictive Attractor via Counterfactual Eviction), which uses a frozen multi-horizon JEPA to predict the future representations induced by alternative eviction actions. Counterfactual utility identifies future-useful alternatives, while slow predictive-basin geometry determines when to correct avoidable drift and when to adapt to sustained predictive change, without online parameter updates. We further introduce MABS-Bench, which evaluates future-task sufficiency, within-regime predictive stability, transition responsiveness, and perturbation recovery under matched causal streams and memory budgets. Across multiple video datasets, SPACE yields consistent improvements in dataset-native task performance while reducing predictive-state drift.

[77] DraftAttention2: Fast Video Diffusion with Low-Resolution-Guided Mixed-Precision Attention cs.CV | cs.AIPDF

Rui Ding, Haopeng Li, Weize Ma, Yufa Zhou, Yitong Li

TL;DR: DraftAttention2 根据低分辨率草稿注意力同时决定视频扩散中的注意力块保留与数值精度，以降低长时空序列的计算量。

Details

Motivation: 扩散 Transformer 的时空 token 注意力开销随视频分辨率与时长增加；单纯跳过注意力交互可能损害画质，统一精度又未充分利用不同区域的重要程度。

Result: 实验显示 DraftAttention2 相较既有高效视频生成方法取得更好的质量—效率权衡；优势在少步视频扩散中特别明显，结合稀疏注意力和 4/8 位混合精度后提升生成质量并保持显著加速。摘要未给出量化速度或画质指标。

Insight: 空间平均池化与最大池化的查询、键互补估计块重要性，并共享排序来分配高精度、低精度或跳过；误差分析说明，在注意力权重较高的块保留高精度、低权重块以低比特恢复，可在实用内核中平衡误差与吞吐。

Abstract: Video generation has broad applications in content creation and entertainment. Diffusion transformers have advanced the quality of generated videos, but attention over spatiotemporal tokens becomes increasingly expensive as video resolution and duration increase. We present DraftAttention2, a training-free framework that uses the low-resolution draft attention map to jointly select attention blocks and assign their numerical precision. Specifically, spatial 2D average- and max-pooled queries and keys capture complementary regional statistics to estimate block importance, and a shared ranking assigns higher precision to important blocks, lower precision to less important retained blocks, and skips the rest under configurable budgets. Our analysis separates sparsification error from attention-weighted quantization error, establishing when recovering skipped interactions with low-bit computation tightens the output-error bound. This analysis motivates retaining more interactions at low precision while reserving higher precision for blocks with larger attention mass. To translate these fine-grained assignments into practical speedups, we further develop fused operand preparation and a single attention kernel with precision-specific phases, sharing data movement, softmax statistics, and output accumulation across precisions. Experiments demonstrate that our method achieves a superior quality-efficiency trade-off over existing efficient video generation methods. Notably, its advantage is particularly pronounced for few-step video diffusion, where jointly combining sparsity with 4- and 8-bit mixed-precision computation substantially improves generation quality while retaining significant acceleration. Code is available at https://github.com/anemoi-project/anemoi

[78] GAUGE: Group-Wise View-Inconsistency Rectification for Feed-Forward 4D Tracking cs.CV | cs.AIPDF

Zhuoqian Feng, Weixing Chen, Ziliang Chen, Yang Liu, Liang Lin

TL;DR: GAUGE 是无需训练、与具体模型无关的 4D 点轨迹后处理模块，通过运动分组和少量度量锚点校正视角方向上的系统误差。

Details

Motivation: 单目视频前馈模型预测稠密三维点轨迹后，即使全局对齐仍有显著残差；作者发现误差集中在视线方向，且不同运动组所需尺度校正不一样。

Result: 在包括 D4RT、4RC 和 SM4RT 在内的八种跟踪器动态查询点上，GAUGE 将端点误差降低 15.1%–62.6%；把相同度量锚点用于梯度微调，改善仅为 -1.1%–15.2%。

Insight: 方向一致性与空间连通性用于恢复运动组，之后用每帧 1%–5% 的度量锚点估计各组径向尺度和组级平移，每组每帧仅需四个自由度。作者将这类 2D 观测无法约束的径向自由度称为组级视角不一致。

Abstract: Feed-forward models regress dense 3D point trajectories directly from monocular video, yet the residual after global alignment is substantial and lacks a structural explanation. Measured on dynamic query points across models and datasets, the error concentrates along the view direction, while the scale correction each motion group requires differs. The predicted displacement direction nevertheless supports reliable grouping, with a median angle far below the 90° random baseline. The systematic part of the residual is therefore a family of radial degrees of freedom per motion group, along directions 2D observations cannot constrain. We call it group-wise view inconsistency. We present GAUGE (Group-wise Adaptive Unsupervised Gauge Estimation), a training-free and model-agnostic post-hoc module. It recovers motion groups from direction consistency and spatial connectivity, then estimates a per-frame radial scale and group-level translation from 1% to 5% metric anchors, four degrees of freedom per group and frame. On dynamic query points of eight trackers, including D4RT, 4RC and SM4RT, our correction lowers endpoint error by 15.1% to 62.6% over the uncorrected predictions, while spending the same anchors on gradient fine-tuning improves the same models by only -1.1% to 15.2%. Code is publicly available at https://github.com/HCPLab-SYSU/GAUGE.

Hanqian Li, Sirui Huang, Chen Ling, Jungang Li, Yu Huang

TL;DR: InterTab 在多模态表格图像推理中交错执行思维链与结构对齐区域裁剪，使每一步推理都能读取相关行、列或单元格证据。

Details

Motivation: 现有 MLLM 通常只对整张表格图编码一次，推理过程不能按问题逐步定位表格单元；通用视觉思维链也不保证中间推理与表格结构位置对应。

Result: InterTab 在九个表格基准上将骨干平均准确率从 68.28% 提高到 73.17%，并取得比较方法中的最佳平均表现。

Insight: InterTab-22K 将推理步骤同时标注结构位置和边界框；两阶段训练先进行结构感知对齐，再用主动定位优化答案正确性、定位 IoU 和输出格式，并惩罚缺失或过量工具调用。

Abstract: Table images preserve structural information that are often lost in text serialization, and reasoning over them requires locating relevant rows, columns, and cells step by step. Current multimodal large language models (MLLMs) encode the whole image once before reasoning, so they cannot pick up row-, column-, and cell-level evidence as the question unfolds. Encoder-side table structure and generic interleaved visual chain-of-thought still do not bind each reasoning step to that structure. We propose \textbf{InterTab}, an \textbf{Inter}leaved structure-aware framework for CoT reasoning over \textbf{Tab}le images, interleaves chain-of-thought with tool calls that crop structure-aligned table regions. First, we build InterTab-22K, includes reasoning trajectories in which each step is tied to both a structural location and a bounding box. InterTab is trained in two stages: supervised structure-aware alignment (SSA) on InterTab-22K teaches the model to interleave reasoning with structure-aligned crops, and active localization optimization (ALO) further optimizes answer correctness, localization IoU, and output format, while penalizing missing or excessive tool calls. Experiments on nine table benchmarks show that InterTab improves the average accuracy of its backbone from 68.28% to 73.17% and achieves the best average performance among all compared methods. Code and data will be released soon.

[80] RCVLA: 4D Radar-Grounded Semantic Reasoning and Trajectory Arbitration for Autonomous Driving cs.CVPDF

Lianqing Zheng, Xiaokai Bai, Yixuan Luo, Runwei Guan, Minghao Liu

TL;DR: RCVLA 将 4D 雷达测量融入自动驾驶 VLA，先做雷达落地的语义推理，再以雷达距离和碰撞风险对候选轨迹进行物理仲裁。

Details

Motivation: 4D 雷达补充视觉语义之外的几何和运动信息，但要用于驾驶策略，既需雷达—语言语义对齐，也需显式利用测量改善轨迹选择。

Result: 作者构建含 86,016 个雷达—图像—文本样本的 Cap4DR，以及含 520,161 组问答的 OmniHD-QA。相较 OmniDrive，语义阶段 CIDEr 提高 9.92，关键目标速度误差降低 21.9%；物理仲裁后，相较语义阶段平均 L2 误差从 0.348 降至 0.259 m，开环平均碰撞率从 0.576% 降至 0.175%。

Insight: 语义阶段通过门控双向交互融合相机和雷达 token，并产生参考轨迹及目标/占用查询；物理阶段利用查询与簇级雷达测量做截断扩散轨迹细化，再按雷达推导的碰撞时间风险校准候选分数。

Abstract: 4D radar provides geometric and motion cues that complement visual semantics, but integrating it into vision-language-action (VLA) models requires both radar–language alignment for semantic reasoning and explicit use of radar measurements for trajectory refinement and selection. To support these capabilities, we construct Cap4DR with 86,016 radar-image-text samples for alignment pretraining and OmniHD-QA with 520,161 question-answer pairs for instruction tuning across scene description, key-object reasoning, occupancy understanding, and trajectory planning. Building on these datasets, we propose RCVLA, a radar-camera VLA framework consisting of a radar-grounded semantic reasoning stage (RCVLA-Sem) and a trajectory arbitration stage (RCVLA-Phys). RCVLA-Sem performs gated bidirectional interaction between camera and radar tokens for driving question answering and reference trajectory generation, while auxiliary heads provide object and occupancy queries. RCVLA-Phys refines reference-guided trajectory candidates through truncated diffusion conditioned on these queries and cluster-level radar measurements, then calibrates candidate scores using radar-derived time-to-collision risk. On OmniHD-QA, RCVLA-Sem improves CIDEr by 9.92 points and reduces key-object velocity error by $21.9%$ relative to OmniDrive. RCVLA-Phys further reduces average L2 error from $0.348$ to $0.259,\mathrm{m}$ and average open-loop collision rate from $0.576%$ to $0.175%$ relative to RCVLA-Sem. Ablation studies further show that language-aligned radar tokens improve semantic reasoning, while cluster-level radar measurements and risk calibration improve trajectory arbitration. Code will be released.

[81] MM-OPD: Towards One More Bottleneck Between Perception and Reasoning cs.CV | cs.AIPDF

Jintao Tong, Yujing Lou, Zhanming Shen, Jiaqi Gu, Lubin Fan

TL;DR: MM-OPD 将“符号视图引导正确视觉证据选择”作为多模态推理训练信号，用同模型在图像说明或代码输入下的行为来纠正图像输入策略。

Details

Motivation: 固定模型、问题和解码时，用图像说明或代码替代图像，反而能在多个模型规模和数据集上提升 10.2%–23.6%。作者据此认为感知和推理之间还存在证据选择瓶颈：视觉线索已可感知，却未必被后续推理正确关注。

Result: 在多个基准和模型规模上，MM-OPD 改善视觉感知、图表和文档理解、数学推理及通用 VQA。摘要没有报告各能力的具体提升数值。

Insight: 符号输入能把注意力引向正确证据，可用作无需人工证据标注的监督；MM-OPD 将符号条件行为的引导通过残差式 token 目标蒸馏到图像条件策略，力求保留视觉输入路径并改善证据选择。

Abstract: Recent multimodal large language models (MLLMs) advance visual reasoning by strengthening both perception and reasoning, implicitly assuming a process that transitions seamlessly from perception to reasoning. However, we observe a counterintuitive phenomenon that challenges this assumption: holding the model, question, and decoding fixed, we replace images with their caption or code representations (symbolic views), which seems to be redundant given the clear image structures, but the performance surprisingly improves by 10.2% to 23.6% across model scales and datasets. We term this performance gap as the Symbolic Visual Gap and then take a closer look at it. Through experiments, we find that although the visual evidence can already appear in the reasoning trace for the image-input model, the symbolic-view-input model shows much higher attention to the correct evidence than the image-input model. This suggests that despite good capabilities from current works in perception and reasoning themselves, another bottleneck exists between perception and reasoning in selecting perceived visual information as appropriate evidence for subsequent reasoning. To handle this bottleneck, since the symbolic view steers attention toward correct evidence and is readily obtained at scale, it provides supervision for evidence selection without manually labeled evidence. Building on this, we introduce MM-OPD, a multimodal on-policy self-distillation framework for symbolic-to-visual correction that transfers guidance from symbolic-conditioned behavior to the image-conditioned policy through residual token-level targets, steering the model toward correct visual evidence. Experiments across benchmarks and model scales show that MM-OPD improves a broad range of multimodal abilities, with gains in visual perception, chart and document understanding, mathematical reasoning, and general VQA.

[82] ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera cs.CVPDF

Ugo Leone Cavalcanti, Fabio Tosi, Matteo Poggi, Andrea Conti, Vladimir Zlokolica

TL;DR: ProDyGS 面向固定单目摄像机拍摄的动态视频，通过深度引导合成伪视角，为动态高斯泼溅重建补充缺失的多视图监督。

Details

Motivation: 固定单摄像机视频没有多视角监督和显著相机运动，现有动态重建方法难获得充分几何约束。

Result: 在 DyNeRF 数据集上，作者报告 ProDyGS 达到最先进的新视角合成表现，且只需单目深度估计作为外部监督，优于依赖更强场景流先验的方法。摘要未给出具体指标。

Insight: 方法先用基础单目深度网络估计时间一致的深度，再生成任意视角代理图像构造合成多视图监督；变形网络据此对规范高斯进行扭曲以学习动态。

Abstract: We present ProDyGS, a novel dynamic 3D Gaussian Splatting framework for high-quality novel view synthesis from videos captured by a single static camera. While existing methods rely on multi-view setups or significant camera motion for geometric constraints, our approach addresses the challenging scenario where multi-view supervision is completely absent. We overcome this limitation by generating synthetic multi-view supervision through depth-guided proxy image synthesis. Specifically, we estimate temporally consistent depth maps using foundational monocular depth networks, then construct 3D Gaussian representations that generate proxy images from arbitrary viewpoints. A deformation network learns temporal dynamics by warping canonical Gaussians using this augmented supervision. Experiments on the DyNeRF dataset demonstrate that our method achieves state-of-the-art performance while requiring only monocular depth estimation as external supervision, outperforming approaches that rely on stronger priors such as scene flow.

[83] Gradient-Guided Decoupled Adaptation for Geospatial Vision-Language Models cs.CV | cs.AI | cs.CL | cs.LGPDF

Dongdong Wang, Deepak Balakrishnan, Ravi Srinivasan, Shenhao Wang

TL;DR: G2DA 根据梯度关系把地理空间多任务视觉语言学习拆成视觉中心与语言中心任务组，并用模态专属课程和双向复习缓解任务干扰。

Details

Motivation: Geo-VLM 常以统一多任务方式适配不同地理任务，却未充分考虑各任务在跨模态梯度、分支内关系和相互干扰上的差异。

Result: 在三个 Geo-VLM 基准、六种 InternVL3/Qwen3.5-VL 变体以及 GeoChat、GeoLLaVA 上，共 24 个基准—模型组合中 G2DA 均优于所比较基线。相较最强竞争者，在 UrBench-MCQ、XLRS-Bench-Lite 和 VRS-Bench-VQA 上分别提升 3.08、4.30 和 2.81 个百分点。

Insight: 梯度引导的跨模态解耦先划分任务，再按任务梯度相似度构造模态专属课程；双向复习用于抵消顺序优化带来的近期偏置。结果支持按优化特性组织任务，而非统一混合全部任务。

Abstract: Existing geospatial vision-language models (Geo-VLMs) typically optimize diverse geospatial tasks through a unified multi-task adaptation paradigm without explicitly accounting for the heterogeneous optimization characteristics. Our empirical observations reveal heterogeneous gradient characteristics across tasks, including vision-language differences, intra-branch gradient relationships, and task interference, which hinder effective multi-task optimization. Motivated by these observations, we propose Gradient-Guided Decoupled Adaptation (G2DA), a gradient-aware optimization framework for multi-task Geo-VLM learning. G2DA first partitions tasks into vision- and language-centric groups through gradient-guided cross-modal decoupling. It then constructs modality-specific curricula based on task gradient similarity and employs bidirectional rehearsal to mitigate the recency effects introduced by sequential optimization. We evaluate G2DA on three Geo-VLM benchmarks using six InternVL3 and Qwen3.5-VL variants, along with GeoChat and GeoLLaVA. Across all 24 benchmark-model combinations, G2DA consistently outperforms representative baselines, improving over the strongest competitor by 3.08, 4.30, and 2.81 percentage points on UrBench-MCQ, XLRS-Bench-Lite, and VRS-Bench-VQA, respectively. These results demonstrate the effectiveness of gradient-guided task organization for Geo-VLM adaptation.

[84] REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection cs.CV | cs.AIPDF

Aleksandr Gushchin, Khaled Abud, Georgii Bychkov, Ekaterina Shumitskaya, Artem Filippov

TL;DR: REALIS 提供覆盖多种生成器和后处理变换的大规模真实/合成图像检测基准，减少内容差异和生成痕迹造成的数据集捷径。

Details

Motivation: AI 图像检测基准中的真实与合成图像往往在内容、质量或生成伪影上不同，模型可能利用数据集线索，在未知生成器或被处理图像上失效。

Result: REALIS 含 143 万张来自 42 种现代文生图模型的真实与合成图像，REALIS-Expert 专门测试语义和视觉特征匹配的高质量合成图像，并提供 35 种变换、五级严重度的鲁棒性协议。在最困难的处理图像拆分上，最佳预训练传统检测器 ROC-AUC 为 0.550，最佳 REALIS 训练检测器为 0.752。

Insight: 真实图提示、质量过滤和分层采样用于减少类别捷径同时保留内容多样性；专家子集与变换协议将生成器泛化和图像处理鲁棒性纳入统一评估。

Abstract: AI-generated image detectors are often evaluated on benchmarks where real and synthetic images differ in content, quality, or generation artifacts, allowing models to rely on dataset-specific cues and fail on unfamiliar generators or processed images. Existing datasets provide limited support for evaluating these challenges jointly across diverse visual content. We introduce REALIS, a dataset of 1.43 million real and synthetic images generated by 42 modern text-to-image models, including the latest proprietary systems such as Nano Banana 2. REALIS combines prompts derived from real images, quality filtering, and stratified sampling to reduce class-specific shortcuts while preserving content diversity. We further introduce REALIS-Expert, a stress-test subset for high-quality synthetic images, where real and generated samples are selected with closely matched semantic and visual characteristics. We also propose a robustness protocol covering 35 transformations at five severity levels to analyze detector behavior under image processing. Based on REALIS, our benchmark evaluates pretrained detectors, fine-tuned models, and zero-shot vision-language models under generator and post-processing shifts. On the hardest processed split, the best pretrained conventional detector achieves 0.550 ROC-AUC, compared with 0.752 for the best REALIS-trained detector. REALIS provides a unified framework for measuring and improving the reliability of AI-image detectors under conditions that better reflect real-world use.

[85] AnesTRACE: Benchmarking Intraoperative Anesthesia from Multimodal Perception to Multi-step Decision-Making cs.CVPDF

Ziwei Huang, Qi Gao, Zhe Ji, Yuanyuan Yao, Fengjiang Zhang

TL;DR: AnesTRACE 是围术期麻醉多模态评测套件，覆盖术中感知、单点决策和多步决策，并用专家标准衡量临床正确性、证据依据、完整性、安全性及时间一致性。

Details

Motivation: 真实麻醉管理需要结合不断变化的多模态证据及时提出方案，并随病人状态调整；既有基准通常只评感知或单时点推理，不能体现纵向决策风险。

Result: 在超过 30 个模型中，最佳模型经食道超声视觉定位 mIoU 仅 32.2%；多步管理仍有 17.5% 的重大/危急安全错误率。领域评估器在两阶段训练后与麻醉医生判断更一致，但最佳决策质量模型的 P95 延迟为 74.3 秒。

Insight: 评测者用专家定义的标准审查开放回答，并为多步决策增加时间一致性；结果说明总体准确率不足以证明模型能安全、及时地进行纵向临床管理。高延迟也需要与决策质量共同考量。

Abstract: Intraoperative anesthesia requires systems to interpret evolving multimodal evidence, recommend timely management, and revise decisions as patient states change, yet existing benchmarks usually isolate perception or single-point reasoning. We introduce AnesTRACE, an evaluation suite comprising AnesTRACE-Bench and AnesTRACE-Eval. Built from public perioperative datasets with anesthesiologist annotation, AnesTRACE-Bench evaluates Intraoperative Perception, Single-point Anesthesia Decision-Making, and Multi-step Anesthesia Decision-Making. AnesTRACE-Eval assesses open-ended responses through anesthesiologist-defined criteria for Clinical Correctness, Evidence Grounding, Task Completeness, and Safety, with Temporal Consistency for multi-step decisions; its domain-specific evaluator is trained by supervised fine-tuning and preference alignment on expert-reviewed judgments. Across more than 30 models, fine-grained visual grounding and intervention selection remain difficult: the leading model reaches only 32.2 mIoU for TEE visual grounding and retains a 17.5% Major/Critical Safety Error Rate in multi-step management. Evaluator alignment with anesthesiologists improves across both training stages, while the best decision quality is accompanied by a 74.3-second P95 Latency. These results show that aggregate performance alone does not establish safe, timely longitudinal decision-making. We release our code at https://github.com/zjuDBxAI/AnesTRACE.

[86] LoCoVSR: Local Context Diffusion Posterior Sampling for Video Super-Resolution cs.CV | eess.IVPDF

Matan Ben Chorin, Michael Elad

TL;DR: LoCoVSR 使用像素空间扩散后验采样和局部时空上下文对低分辨率视频进行超分辨率重建，可逐帧并行处理长视频。

Details

Motivation: 视频超分辨率是病态逆问题，递归处理可能造成误差累积，潜空间处理又可能损失细节；方法希望在避免显式光流估计的同时利用邻帧信息。

Result: 在 VFHQ 人脸数据集训练的 LoCoVSR，在画面质量和时间一致性方面取得有竞争力的扩散式视频超分结果。摘要未提供具体画质指标或速度。

Insight: 每个中心帧由相邻低分辨率局部窗口恢复，并让所有帧共享噪声轨迹；移动窗口既不受视频总长度限制，也支持并行推理，避免递归逐帧误差传播。

Abstract: Video super-resolution (VSR) is an ill-posed inverse problem that aims to reconstruct a high-resolution (HR) video from a noisy, low-resolution (LR) version of it. We present LoCoVSR, a diffusion-based VSR framework that leverages pixel-space denoising diffusion probabilistic models. LoCoVSR integrates the Diffusion Posterior Sampling technique with spatio-temporal context learning, operating in a moving-average form. A localized window of adjacent LR frames is used for recovering each center frame, while applying a shared noise trajectory across all frames. The localized windowing enables processing of long videos without length limitations, supports parallel inference, and prevents error accumulation that may occur in recursive processing. Unlike prior methods, LoCoVSR offers a simple yet very effective VSR solution, avoiding explicit optical flow estimation, or information loss caused by latent space processing. Trained on the VFHQ face dataset, LoCoVSR achieves accurate, temporally consistent and high-quality upscaling with competitive results against recent diffusion-based VSR approaches.

[87] OmniMoE-VL: A Sparse Vision-Language Model with Coupled Visual-Depth Routing cs.CV | cs.LGPDF

Long Qian, Bingke Zhu, Jiaqi Wei, Yingying Chen, Jinqiao Wang

TL;DR: OmniMoE-VL 用问题条件化的视觉深度路由器选择中间视觉层，并以同一全局偏好同时控制局部 patch 融合和动态视觉 token 注入。

Details

Motivation: 稀疏 MoE 已常用于扩展 VLM 的语言计算，但视觉信息通常只在通过固定跨模态接口后才路由，模型无法按当前问题决定应该把哪些中间视觉表示交给语言推理。

Result: 在八个图像基准上，OmniMoE-VL 总参数 28B、激活参数 9B，平均成绩为 85.9。受控比较显示视觉路由接口贡献了主要架构收益；路由及组件对照、同图像路由分析和路由干预进一步支持按问题选择视觉信息的设计。

Insight: 路由器为图像—提示对选择稀疏中间视觉深度，并保留原生视觉 token 序列；视觉与语言栈各自的 token 级专家路由继续工作，避免把视觉深度选择与 MoE 计算路由混为一谈。

Abstract: Vision-language models (VLMs) increasingly use sparse mixture-of-experts (MoE) to scale language-side computation, yet visual information is typically routed only after passing through a fixed cross-modal interface. This leaves an important decision unresolved: which intermediate visual representations should be exposed to language computation for a given question? We introduce OmniMoE-VL, a sparse VLM with a coupled visual-depth routed projector. For each image-prompt pair, the projector selects a sparse set of intermediate visual depths and reuses the resulting global preference to guide both local patch fusion and dynamic visual injection into the language model. This design enables question-dependent visual access while preserving the native visual-token sequence, and complements token-level expert routing in the vision and language stacks. Across eight image-based benchmarks, OmniMoE-VL achieves an average score of 85.9 with 28B total and 9B activated parameters. Controlled comparisons show that the routed visual interface provides the dominant architectural gain, while matched route and component controls, same-image route analysis, and route interventions further support the value of coupling and question-conditioned visual access.

[88] CT-OPD: Counterfactual Trace On-Policy Distillation for Diffusion Vision-Language Models cs.CV | cs.LGPDF

Long Qian, Bingke Zhu, Jiaqi Wei, Yu Li, Yingying Chen

TL;DR: CT-OPD 将扩散视觉语言模型学生当前生成轨迹中的遮罩位置，与教师完整回答重建出的连贯部分状态结合进行 on-policy 蒸馏。

Details

Motivation: 扩散 VLM 通过逐步解除 token 遮罩生成回答；直接遮蔽完整答案会产生连贯上下文，却没有跟随模型真实揭示轨迹；原始轨迹又可能含与监督目标冲突的临时 token，结果级强化学习则缺少细粒度区分。

Result: 在稠密和稀疏扩散架构上，CT-OPD 均改善多模态理解与推理；九个基准的平均成绩最高提升 9.80 点。统一理解—生成架构上，视觉理解与图像生成也同时提升。

Insight: 方法把教师答案重新分词到学生词表，沿学生反向过程的不同阶段提取遮罩位置，但丢弃学生临时可见值并用同一教师最终答案重建连贯部分状态。训练随模型演进刷新学生轨迹，消融将收益归因于连贯重建和当前模型轨迹遮罩。

Abstract: Diffusion vision-language models generate answers by gradually resolving masked tokens, making accurate conditional prediction in partially resolved states central to post-training. Masking completed answers yields coherent contexts and targets, but prescribed masks do not reflect the model’s reveal decisions. Its trajectories capture these decisions, yet their provisional visible tokens can conflict with the target response. Outcome-based reinforcement learning follows these trajectories but provides only response-level feedback, which loses contrast when sampled rewards tie. To align coherent token-level supervision with the model’s reveal decisions, we introduce Counterfactual Trace On-Policy Distillation (CT-OPD), which combines completed teacher responses with trajectory masks from the current student. CT-OPD retokenizes each teacher response in the student’s vocabulary and extracts unresolved-position masks at successive stages of the student’s reverse process. For each mask, it discards provisional rollout values and reconstructs the partial state from the teacher endpoint, so the supervised positions follow the current trajectory while the visible context and targets remain consistent with the same response. The student is trained on these reconstructed states with its native categorical loss, and trajectories are refreshed as the model evolves. Across dense and sparse diffusion architectures, CT-OPD consistently enhances multimodal understanding and reasoning capabilities, with gains of up to 9.80 points on the nine-benchmark average. On the unified understanding-and-generation architecture, it also improves both visual understanding and image generation, showing that the same principle transfers across architectures and modalities. Ablations further attribute these gains to coherent reconstruction and current-model trajectory masks.

[89] PolyTopoBench: A Benchmark for Complex Vector Polygon Generation from Remote Sensing Imagery cs.CV | cs.AIPDF

Zeping Liu, Ni Lao, Weiwei Sun, Gil Wolff, Yiqun Xie

TL;DR: PolyTopoBench 评测遥感图像到复杂矢量多边形的生成，特别检验含孔洞、多环边界的拓扑是否能被保留。

Details

Motivation: 从栅格分割图后处理生成多边形难端到端优化，可能漏掉小物体或产生错误顶点；已有直接生成方法多只处理简单外轮廓，复杂内环和拓扑仍有不足。

Result: 基准在两个遥感数据集上比较 11 种代表方法，覆盖建筑、道路、植被及裸地。实验显示现有方法通常能恢复简单外边界，却在含孔洞或多个环的多边形上明显退化；摘要未提供具体指标。

Insight: 把外环和内环都纳入统一评估后，复杂拓扑生成被明确识别为尚未解决的问题，推动拓扑感知的模型设计和基准发展。

Abstract: Vector polygon generation converts visual inputs, e.g., remote sensing (RS) images, into vectorized polygonal geometries, supporting applications such as autonomous driving, vector map construction, and remote sensing. Early pipelines predict raster masks and post-process them into polygons, which prevents end-to-end optimization and may miss small objects or introduce inaccurate vertices. Recent methods directly generate vector polygons, but most focus on simple exterior contours, while they either cannot represent complex polygons with holes or fail to preserve their topology. In this paper, we propose PolyTopoBench, a unified evaluation framework for vector polygon generation from RS images with explicit emphasis on complex polygons. PolyTopoBench evaluates both exterior and interior rings, and benchmarks 11 representative methods, including segmentation-based polygonization pipelines, vision foundation model baselines, and specialized vector polygon generators, on two RS-image datasets covering buildings, roads, vegetation, and unvegetated regions. Experiments show that existing methods often recover simple exterior boundaries but degrade substantially on polygons with holes or multiple rings. These results reveal complex polygon generation as an unresolved challenge and motivate topology-aware benchmarks and model designs. Code and data are available at https://github.com/seai-lab/PolyTopoBench.

[90] USAI-Quant: A Quantitative Reasoning Benchmark for Vision-Language Models in Built Environments cs.CV | cs.CL | cs.LGPDF

Dongdong Wang, Qingqi Song, Yuzhou Chen, Deepak Balakrishnan, Ravi Shankar Srinivasan

TL;DR: USAI-Quant 是面向建成环境遥感影像定量推理的基准，评估 VLM 能否从城市图像估计各种建成环境指标，而不只是回答定性问题。

Details

Motivation: 当前遥感 VLM 基准多采用定性 VQA，对面积、数量等建成环境指标的量化推理能力揭示有限；先进模型在此类任务上仍可能薄弱。

Result: 基准从美国 335 座最大城市整理高分辨率遥感图像及定量指标，并按三个复杂度层级评估通用和遥感专用 VLM。结果显示当前最先进模型仍持续无法胜任数值推理；分析揭示模型、题型和地理位置间的表现差异。摘要未提供具体准确率。

Insight: 题目覆盖多个建成环境指标与不同复杂度，可用于分析地理空间任务本身以及城市区域变化对数值推理的影响，补充以定性回答为主的评测。

Abstract: Large vision-language models (VLMs) have emerged as a powerful paradigm for urban and spatial AI. However, current state-of-the-art large VLMs still struggle with quantitative reasoning on remote sensing imagery. Existing benchmarks and algorithms are predominantly based on qualitative Visual Question Answering (VQA), providing limited insights into the quantitative reasoning capabilities of VLMs for built environment metrics. To address this gap, we develop Quantitative Urban and Spatial AI benchmark (USAI-Quant), the first benchmark designed to quantitatively evaluate VLM’s reasoning capabilities on built environment metrics via remote sensing imagery. USAI-Quant is curated from the 335 largest U.S. cities, aligning high-resolution remote sensing images with quantitative built environment metrics. We then evaluate both general-purpose and remote sensing VLMs (RS-VLMs) by applying VQAs to tens of built environment metrics across three complexity levels. Our results reveal that current state-of-the-art models consistently fall short on numeric reasoning tasks. We further conduct in-depth analyses across models, question types, and geographic locations, uncovering insights into performance variability and task-specific challenges.

Yavuz Yarici, Ghassan AlRegib

TL;DR: SynCo 通过给跨模态交互残差单独施加对比监督，补足标准多模态对比学习更关注模态间冗余信息、较少训练联合协同信息的问题。

Details

Motivation: 多模态信息可分解为跨模态共享、单模态独有和只有联合观测才能获得的协同部分；既有方法虽尝试建模三者，协同信息仍常监督不足。

Result: 在受控 Trifeature 基准上，SynCo 的协同信息捕获达到最先进水平，比基线高 5.98%；在 MultiBench、DARai 和 MM-IMDb 等真实任务上，各种模态组合和任务类型中持续优于或匹配既有方法。

Insight: 线性投影先从融合表征中预测由单模态特征可解释的部分，剩余交互残差再接受专门对比监督，计算开销很小。方法可作为现有多模态对比框架插件，不需更改底层融合架构。

Abstract: Multimodal contrastive learning is a dominant paradigm for learning transferable representations from unlabeled data, but standard objectives primarily capture information that is redundant between modalities. Partial Information Decomposition (PID) shows that task-relevant information in multimodal data decomposes into three components: redundancy shared between modalities, uniqueness specific to each modality, and synergy available only from their joint observation. Recent frameworks extend contrastive learning to capture all three components, yet synergy remains undertrained in practice. We propose SynCo (Synergy Contrastive Learning), a method that directly addresses synergy undertraining through dedicated supervision on an interaction residual. SynCo fits a linear projector to predict the fused representation from independently computed unimodal features, and the resulting interaction residual, which removes the linearly unimodal-predictable component, receives dedicated contrastive supervision at negligible computational cost. On the controlled Trifeature benchmark, SynCo achieves state-of-the-art synergy capture with a $+5.98%$ gain over the baseline, and on real-world benchmarks from MultiBench, DARai, and MM-IMDb, SynCo consistently outperforms or matches prior methods across diverse modality combinations and task types. The method operates as a plug-in to existing contrastive multimodal frameworks without modifying the underlying fusion architecture and can further improve synergy capture when combined with other methods.

[92] SV2V-RSim: A Comprehensive Benchmark for Self-Selective V2V Cooperative Perception with Near-Realistic Data cs.CVPDF

Yulu Wu, Chao Wei, Jujun Cheng, Zhangkai Ni, Haowen Wang

TL;DR: SV2V-RSim 提供近真实的大规模 V2V 协同感知模拟数据集，并提出 SVA 根据感知收益与通信带宽自适应选择协作车辆。

Details

Motivation: 现有车车协同感知数据集参与车辆少、协作者选择固定，且模拟到真实环境差距较大，难评估动态选择伙伴时的感知—通信权衡。

Result: 数据集包含四张地图、四种天气、六个时段、203K 帧 LiDAR、402K 帧 RGB 以及 17 类共 788K 个 3D 框。基准测试显示 SVA 的性能—带宽权衡更好；仿真到真实实验及无参考图像质量评估也支持数据集具有较高真实感。摘要未提供具体权衡指标。

Insight: 基于 Unreal Engine 5 的仿真为指定范围内每辆车配置传感器，从而可按场景动态选取合作车辆，并覆盖检测、分割和深度任务。

Abstract: Vehicle-to-Vehicle (V2V) cooperative perception enhances autonomous driving by enabling vehicles to share information beyond their direct line of sight. However, existing V2V datasets are limited by a small number of participating agents, static collaborator selection strategies, and a significant domain gap between simulated and real-world environments. To overcome these challenges, we introduce SV2V-RSim, a large-scale, multi-modal, near-realistic simulation dataset engineered to elevate agent diversity and realism. Additionally, we present the Select Vehicles Adaptively (SVA) module, which optimizes collaborator selection to balance perception performance against communication bandwidth constraints. Our dataset is generated using the Unreal Engine 5-based simulator that integrates high-fidelity 3D assets, diverse environments, and intricate traffic scenarios. All vehicles within a specified range of the ego vehicle are equipped with sensor suites, enabling dynamic and adaptive collaborator selection. SV2V-RSim encompasses four maps, four weather conditions, six time periods from sunrise to night, 203K LiDAR frames, 402K RGB frames, and 788K annotated 3D bounding boxes across 17 object classes, supporting a range of cooperative perception tasks such as 3D object detection, segmentation, and depth estimation. Benchmarking on recent cooperative perception algorithms demonstrates that SVA achieves a superior performance-bandwidth trade-off, while sim-to-real experiments and No-Reference Image Quality Assessment validate the dataset’s high realism and practical effectiveness. Our dataset and code will be publicly available.

[93] Is H&E Image-to-Spatial Transcriptomics Simpler Than It Looks? cs.CV | cs.LGPDF

Duc T. Nguyen, Thanh Ha Do, Phuong M. Cao, Hieu Pham

TL;DR: 该研究分析 H&E 组织图像到空间转录组表达预测的误差结构，提出按切片内变化调整监督的 Component-Guided Loss，发现简单线性模型也可达到领先表现。

Details

Motivation: 已有方法通过更复杂架构建模空间上下文和表达结构，但简单估计器也表现很强；尚不清楚简单模型已解决什么、复杂模型还需补足什么。

Result: MSE 分解显示基因间平均表达差异可解释相当部分总体性能，关键剩余误差是切片内变化；该项对参数的残差归一化敏感度较低。闭式仿射模型 CGL-Linear 在 HEST-1k 不同队列和基因面板规模上达到整体最先进表现，同样的切片内监督也改善现有神经模型。

Insight: 性能提升可以来自让训练目标与误差结构对齐，而不必一味增加模型复杂度。论文将切片间均值和切片内变化分开分析，为选择优化重点提供依据。

Abstract: Predicting spatial gene expression from routine H&E histology offers a scalable route toward spatial molecular profiling. Recent work has pursued increasingly sophisticated architectures to capture spatial context and richer expression structure. At the same time, simple estimators have shown strong performance in several studies, but what they already solve and where additional complexity is needed remain unclear. We study this behavior through the structure of prediction error under the mean-squared error (MSE) objective. Differences in average expression across genes can account for a substantial part of aggregate prediction performance, while a key unresolved error lies in recovering variation within each slide. Decomposing MSE into slide-level and within-slide components, we find that the within-slide component has lower residual-normalized parameter sensitivity in controlled neural experiments. This motivates Component-Guided Loss (CGL), which increases supervision of the within-slide component. CGL-Linear is a closed-form affine instantiation that achieves overall state-of-the-art performance across HEST-1k cohorts and gene-panel sizes. The same within-slide supervision improves existing neural models. These results suggest that substantial gains can come from aligning the training objective with prediction-error structure rather than increasing model complexity.

[94] Improving Video Sparse Attention with Fine-grained Router and Sparse Rebasing cs.CVPDF

Peiyuan Zhang, Guoqiang Wei, Yilong Zhao, Zixiang Zhang, Wei Zhou

TL;DR: VSA2 为视频扩散 Transformer 提出可训练的细粒度稀疏注意力路由，按查询动态决定关注多少键值，并可贯穿预训练、强化学习及推理阶段使用。

Details

Motivation: 视频 DiT 的时空注意力代价高；粗粒度稀疏化容易漏掉关键 token，而稀疏模型在不同训练与推理稀疏率下的运动质量也需要验证。

Result: VSA2 相较 VSA 将注意力计算量减半且损失更低；720p 视频相较 FlashAttention-3，注意力加速 8.9 倍、端到端生成加速 4.62 倍，视频质量相当或更好。先高稀疏率训练、再以低稀疏率推理的课程还能提升运动质量。

Insight: 细粒度路由器给每个查询分配可变数量的键值；模型可在渐进式分辨率预训练中期替换全注意力并重置早期检查点，表明稀疏注意力可作为完整 DiT 开发周期中的组件。

Abstract: We present VSA2, a frontier trainable sparse attention for video DiTs. VSA2 includes a variety of new architectural features and training procedures that we apply across all stages of the DiT development cycle, including pretraining, RL, and inference, to produce a DiT with comparable or better quality than a full attention counterpart. Architecturally, VSA2 introduces a fine-grained router that improves the precision of identifying critical tokens and supports dynamic computation by allowing each query to attend to a variable number of key-value pairs. In training, we identify a Hard-to-Easy Curriculum, where models trained under high sparsity and later evaluated with lower sparsity during inference not only generalize effectively, but also outperform models trained with full attention in motion quality. VSA2 is also flexible: it can replace full attention during the middle of progressive low-to-high resolution pretraining, rebasing early-stage full-attention checkpoints. Experiments show that VSA2 reduces attention computation by half over VSA with lower loss. On 720p videos, it accelerates attention by 8.9x and end-to-end generation by 4.62x compared to the FlashAttention-3 baseline, while achieving comparable or better video quality.

[95] Rethinking the Fully Hyperbolic Vision Transformer in Polar Coordinates cs.CVPDF

Ahmad Bdeir, Niels Landwehr

TL;DR: 该工作将双曲 Transformer 的运算改写到极坐标下，降低 Lorentz 环境坐标的大半径数值误差，并加入可学习半径、相对位置编码和双曲残差连接。

Details

Motivation: 双曲空间适合低失真表达层级，但 Lorentz Transformer 在环境坐标中计算内积时，大半径处数值不稳定，许多模型因此限制半径，未能充分利用双曲几何。

Result: 结合极坐标模块的全双曲 Transformer 在标准视觉任务上显著优于所比较欧式和双曲基线；在 ImageNet 上评估，并展示预训练权重迁移到其他数据集的泛化能力。摘要未给出具体指标。

Insight: 极坐标使双曲距离与注意力质心计算避免环境坐标中的数值抵消；方向与半径分别学习，双曲地平线偏移作为相对位置编码，残差连接则重写为平均半径 Lorentz boost。

Abstract: Hyperbolic space can embed intrinsic hierarchies in data with low distortion due to the exponential growth of volume with distance from the origin. However, current Lorentz transformer blocks are formulated in ambient coordinates, where numerical errors increase at large radii due to instability in the Lorentzian inner product, leading many models to limit the radius to avoid this issue. This prevents us from utilizing the regions of hyperbolic space that motivate the geometry. To address this, we revisit the components of the transformer block in polar coordinates, where hyperbolic operations such as distance calculation and attention centroids can be computed without the numerical cancellation in their ambient-coordinate formulations. Specifically, we propose a polar fully connected layer that separately maps an embedding’s direction and radius, allowing the radius of a feature to be learned rather than determined by the norm of a linear map. We additionally introduce horospherical shifts as relative positional encodings whose query-key distances grow logarithmically with the token gap. Finally, we reformulate the residual connection as average radius Lorentz boosts. Combining these components, we develop a fully hyperbolic transformer that substantially improves performance over Euclidean and hyperbolic baselines on standard vision tasks. We further evaluate our model on ImageNet and demonstrate its ability to generalize to other datasets using pre-trained weights, similar to Euclidean counterparts.

[96] Multimodal LLMs Outperform Pathology Foundation Models in Cross-Domain Histological Similarity cs.CV | cs.AI | cs.CL | cs.LGPDF

Yishu Zhang, Yun Li, Daiwei Zhang

TL;DR: MOSAIC 基准显示，通用多模态大模型在跨机构组织学图像相似度判断上可胜过专用病理基础模型，后者容易把采集机构相似性误当成疾病形态相似。

Details

Motivation: 专用病理基础模型虽在数百万组织图块上训练，跨切片或机构比较时仍可能未能保持组织相似性；常规同域评估难以暴露这种临床危险的捷径。

Result: 在六个数据集、17 个模型的相对相似度评估中，病理编码器常将“同机构、不同疾病”图块排得比“同疾病、不同机构”更相似；通用多模态 LLM 较少出现该问题。增加病理编码器训练数据并不能解决，结果指向学习目标而非数据覆盖。

Insight: 作者推测 LLM 更依赖形态与组织结构语义比较，而专用编码器更容易受采集上下文捷径影响。MOSAIC 可用于跨机构检索、数据集协调和多中心质量控制，但需注意其结论限定于所测相似度任务。

Abstract: State-of-the-art pathology foundation models, trained on millions of histology tiles, can fail to preserve tissue similarity when comparisons cross slide or institution boundaries. We show that general-purpose multimodal LLMs, without being trained as pathology foundation models, consistently outperform these specialized models in cross-domain histological similarity judgments. Using a relative similarity framework that we release as the MOSAIC (Model Similarity Assessment across Institutions and Cohorts) benchmark, we evaluate 17 models across 6 datasets and find that pathology encoders often rank same-institution, different-disease tiles as more similar than same-disease, different-institution tiles, a clinically dangerous failure mode invisible to standard within-domain evaluations. LLMs appear less susceptible to this failure, likely because they perform semantic visual comparison of morphology and tissue architecture rather than relying on shortcut features tied to acquisition context. Scaling training data does not resolve the problem for pathology encoders, implicating the learning objective rather than data coverage. Our results expose a fundamental robustness gap in current pathology foundation models and establish multimodal LLMs as a viable alternative for cross-institutional retrieval, dataset harmonization, and multi-site quality control. Code and data will be released upon acceptance.

[97] ReVision3D: Attribution-Guided Recursive Self-Improvement for 3D Medical Perception cs.CVPDF

Ho Hin Lee, Yuyin Zhou, Yannan Yu, Shi Gu, Yifan Wu

TL;DR: ReVision3D 将归因指导用于三维医学影像代理的递归自我改进，通过可定位的标注体数据发现信息在哪一环节丢失，并只保留超出随机波动的系统修改。

Details

Motivation: 医学影像代理的失败可能来自采集、感知、训练或推理；自生成反馈和执行记录往往不足以判断应改哪一组件，尤其三维体数据的视角和定位验证更复杂。

Result: 在腹部 CT 上，系统归因指出感知是主要瓶颈；定向修订后，肝脏召回率为 79%、肾脏为 83%，每位患者假阳性少于 0.4，优于所评冻结多模态基础模型，对小病灶的收益最大。

Insight: 有空间标注的体数据构成可精确回放的验证环境：可按需渲染未访问视角，并用参考掩码直接检查局部预测。冻结语言模型设计者提出采集、感知、训练或推理修改；验证器和系统目标保持不变，改进超过种子噪声后才接受，再重新归因下一轮瓶颈。

Abstract: Recursive self-improvement (RSI) offers a promising path for overcoming the limited visual capability of current medical imaging agents. Yet applying RSI to volumetric imaging remains difficult: failures can arise from acquisition, perception, training recipe, or downstream inference, while self-generated feedback and logged trajectories provide little guidance on which component should change. We introduce ReVision3D, an RSI system that leverages 3D volumes with spatially grounded annotations to determine where visual evidence is lost and recursively improve the corresponding visual capability. A frozen language-model designer proposes revisions to acquisition, perception, training, or inference, while the verifier and system-level objective remain fixed. Our key insight is that an annotated volume forms an exact replay world for view rendering and spatial verification: unvisited views can be rendered on demand, and localized predictions can be checked directly against reference masks. This grounded feedback directs targeted revision, while only changes that improve beyond measured seed noise are retained. Each accepted change triggers renewed attribution, allowing the dominant bottleneck to shift across rounds. On abdominal CT, attribution identifies perception as the dominant remaining limitation. Revising that level enables ReVision3D to achieve 79% liver recall and 83% kidney recall at under 0.4 false positives per patient, outperforming the evaluated frozen multimodal foundation models, with the largest gains on small lesions.

[98] DynamicDx: Evaluating Evidence Acquisition in Video-Based Diagnosis cs.CV | cs.AI | cs.CLPDF

Jiahui Li, Yutong Guo, Nan Yang, Wenzhan Song, Jin Lu

TL;DR: DynamicDx 评测基于患者视频的动态诊断过程，发现视频价值主要在于提示医生/模型进行更有信息量的后续检查，而非仅靠识别体征或帧顺序。

Details

Motivation: 视频诊断要求模型把观察到的体征转化为假设、问题和检查；只评最终诊断或视觉识别无法判断增益是否来自证据获取。

Result: 基准覆盖 71 次神经科会诊、11 类体征，视频使五个模型较盲输入准确率提高 9.9–22.5 个百分点。打乱帧顺序没有稳定降低成绩，轨迹回放显示多数收益来自视频促成的检查结果；直接提供决定性检查后准确率升至 73.2%–93.0%。经过后训练的 4B 视频描述器和去污染文献检索均改善初始假设及检查选择。

Insight: 视频单独生成的鉴别诊断常漏掉病因，即使模型识别出体征也如此；关键瓶颈是后续证据获取。更好的观察只有在能引导更好的问题与检查时，才转化为诊断收益。

Abstract: Diagnosing a patient from video requires more than recognizing the sign: a vision-language model must turn what it sees into hypotheses, questions and tests. DynamicDx evaluates each step in 71 neurological consultations across 11 sign categories, linking authentic patient videos to confirmed diagnoses and fixed charts built from the same case reports, so that every model queries the same evidence. Across five such models, video improves accuracy by 9.9-22.5 percentage points over blind input, but neither recognition alone nor temporal order explains the gain: the cause is usually missing from the model’s video-only differential diagnosis even when the sign is recognized, and shuffling the frames produces no reliable accuracy loss. Instead, a trajectory replay traces most of the gain to the investigation results the video prompts. Evidence acquisition is the bottleneck: supplying the decisive investigations raises accuracy to 73.2-93.0%. Two interventions act on it. A post-trained 4B video describer improves sign descriptions, especially from a short, densely sampled segment, and source-clean literature retrieval expands initial hypotheses; both bring the tests a model orders closer to those the treating clinicians documented and, through them, raise accuracy. For video-based diagnosis, seeing better helps when it leads to asking better.

[99] Oracle Gaps in Reliability Coverage: Sampling Noise or Policy Specialization? cs.CVPDF

Mert Onur Cakiroglu, Mehmet Dalkilic, Hasan Kurban

TL;DR: 该研究检验多个同底座策略之间的 oracle 覆盖优势有多少只是采样噪声，并发现轻量后训练下的策略专长证据不足，较强训练才产生可检测专长。

Details

Motivation: 逐题从多个策略中挑选成功率最高者会显得远强于单一策略，但这种选择也会挑中有利抽样误差；因此 oracle 上界未必代表真实可部署的路由收益。

Result: 对五个 7B VLM 训练种子，在成功概率阈值 0.10 时，跨策略重分配正确性结果复现了估计 oracle 差距 0.113 中的 0.096，但两种检验均未发现显著专长证据。混合、路由、投票和权重平均无可检测的单策略基线收益。轻量后训练数据集之间专长很少；更强配方才产生可检验专长，并只在专家分离的高阈值出现路由收益。可预测专长控制中，路由器恢复约一半 oracle 差距。

Insight: oracle 优势即使是真实的也可能无法转化为部署收益，覆盖率边界会限制路由收益。先对已存响应做噪声与质量差异检验，再决定是否投入路由器开发，可避免把抽样误差误判为能力互补。

Abstract: Policies trained from the same base model can appear to solve different problems. An oracle that chooses the best policy for each problem may therefore appear much stronger than any single policy. Selecting the largest estimated success rate also selects favorable sampling errors. We study this effect through reliability coverage, the fraction of problems whose success probability reaches a chosen threshold. Our first test redistributes stored correctness outcomes across policies within each problem. A second also preserves each policy’s total successes, accounting for overall quality differences under a specified statistical model. For five training seeds of a seven-billion-parameter vision-language model, redistribution reproduces 0.096 of an estimated 0.113 oracle gap at threshold 0.10. Neither test finds significant evidence at this threshold. Small advantages remain unresolved. Mixtures, routers, voting, and weight averaging show no detectable improvement over their corresponding single-policy baselines. Training policies on different datasets shows little detectable specialization under light post-training, and no router gain. A stronger recipe does create it, both tests detect it, and a router gain appears only at the high thresholds where the specialists separate. In a control with predictable specialization, a router recovers about half the oracle gap. Coverage bounds explain why even a genuine oracle advantage need not yield a deployment gain. The tests assess apparent specialization from stored responses before investment in routing. Code: https://github.com/KurbanIntelligenceLab/oracle-gaps

[100] Certified Interface Aliases: Exact Collisions in Vision-Language Preprocessing, and When They Exist cs.CVPDF

Mert Onur Cakiroglu, Elham Buxton, Mehmet Dalkilic, Hasan Kurban

TL;DR: AliasForge 构造预处理后视觉输入完全相同、正确标签却相反的图像对，用来测量验证器或路由器因像素信息未进入模型接口而无法修复的错误上限。

Details

Motivation: 人工标注者看到全分辨率图像，模型实际接收经缩放等预处理的张量；当关键证据在接口处消失时，单靠语言推理不可能恢复，但现有评测很少有可证明的真值样本。

Result: 作者筛查 20 种缩放配置，17 种可构造碰撞、3 种在指定构造族中不可构造；跨三种架构及另外四种处理器构造认证配对，在 18 对评分样本上决策 logit 差为零，18 个对照对则无此现象。自然样本中虽存在逐题路由空间，但受测仅使用接口信息的路由器未优于停止计算。

Insight: 基于定点重采样构造精确整数零空间扰动，使不同标签在视觉接口处映射成同一状态；相同输入状态的任何验证器只能给出相同输出分布。该基准可识别无法由更多语言推理或重看接口图像解决的错误。

Abstract: Vision-language verifiers and routers must distinguish errors repairable by more reasoning from those caused by visual evidence never reaching the language model. This distinction lacks ground truth because annotators see full-resolution images while models receive preprocessed tensors. We introduce AliasForge to create cases where the relevant fact is provably absent from the interface. Fixed-point resampling makes the pre-rounding resize an exact integer linear map that can send nonzero integer perturbations to zero. Hiding a label-flipping perturbation there produces images with opposite step-correctness labels but bit-identical interface states. Every verifier therefore has the same output law on both members, giving pair-balanced accuracy exactly one half and zero gain from language-side repair. We prove that every fixed-point downscaler has such null vectors and bound their smallest size at the most common ratios, which rules out an 8-bit fit whenever the bound exceeds 255. From the resize configuration alone, a lattice criterion supplies realizable collisions and certifies their absence within the specified construction family. It resolves all 20 screened configurations, 17 as constructible and 3 as non-constructible. We construct certified pairs across three architectures and certify four additional processors, with zero decision-logit gap on all 18 scored pairs and none of the 18 controls. The pairs also screen routers that waste computation on re-attention or further reasoning. On natural items, per-item routing headroom exists, but no tested interface-only router improves over stopping. Our fiber ceiling bounds the headroom recoverable from the interface. Code: https://github.com/KurbanIntelligenceLab/aliasforge.

[101] NutriVision: Ingredient-Conditioned Fusion and Prediction for Single-Image Food Nutrition Estimation cs.CV | cs.AIPDF

Aman Kumar, Avinash Anand, Chaitanya Lakhchaura, Ashutosh Kumar, Akshita Abrol

TL;DR: NutriVision 从单张 RGB 食物图像及可选配料清单估计热量、质量、脂肪、碳水和蛋白质，以估计深度和配料语义补充传统视觉方案。

Details

Motivation: 现有营养估计方法要么依赖校准的 RGB-D 拍摄，要么使用配料文本却缺少充分的多模态融合；家庭和临床场景希望不借助专用深度传感器。

Result: 在 Nutrition5k 上，NutriVision 的平均 PMAE 为 13.60±0.10%，比作者实现的 IGSMNet 低 0.89 个百分点，比 OmniFood8k 低 2.90 个百分点，均 p<0.001。消融表明配料感知预测头是主要贡献模块，平均 PMAE 改善 1.50±0.17 个百分点。

Insight: DepthAnything-V3 估计缺失深度，CLIP 编码配料说明；文本再引导 RGB—深度频率对齐和按食品身份门控的预测头。方法以几何与语义互补降低对专用深度硬件的依赖。

Abstract: Nutrition estimation is a fundamental task in consumer diet tracking, clinical dietetics, chronic disease management, sports and hospital nutrition, and broader food computing systems. The existing approaches have progressed along two largely separate axes, vision models that rely on calibrated RGB-depth captures and ingredient-aware methods that use textual cues but use limited multimodal fusion. We introduce NutriVision, an end-to-end framework that leverages visual geometry and ingredient semantics to estimate calories, mass, fat content, carbohydrates, and protein from a single RGB image and an optional ingredient list. It obtains the unavailable depth modality using DepthAnything-V3 and encodes ingredient descriptions using CLIP. It integrates three complementary mechanisms: (1) an \emph{Ingredient-Conditioned Frequency-Aligned Fusion Module (IC-FAFM)}, which uses textual guidance to reweight and align RGB-depth frequency components; (2) an \emph{Ingredient-Aware Mask-based Prediction Head (IA-MPH)}, whose gating and channel masks are conditioned on food identity; and (3) modality-specific \emph{Internal Semantic Modeling (ISM)} blocks. On the Nutrition5k dataset, NutriVision achieves a mean PMAE of $\mathbf{13.60\pm0.10%}$, outperforming our IGSMNet implementation by $0.89$ percentage points and OmniFood8k by $2.90$ percentage points (both $p<0.001$). The module-level ablations identify the ingredient-aware prediction head as the primary architectural contributor, improving mean PMAE by $1.50\pm0.17$ percentage points ($p<0.001$). These results demonstrate that ingredient-conditioned prediction and frequency-aware RGB-depth fusion provide measurable gains for single-image nutrient estimation. More broadly, NutriVision offers a practical route toward nutrition-assessment systems that exploit geometric and semantic cues without requiring specialized depth-sensing hardware

[102] SemReward-VL: Semantic Reward-Guided Video-Language Adaptation for Developmental Behavior Assessment cs.CV | cs.AIPDF

De Jiang, Shuo Zhang, Kehong Yuan, Hongen Liao

TL;DR: SemReward-VL 用临床结果匹配、条目相关性、无关视频弃答和描述清晰度组成语义奖励，训练 VLM 描述儿童发育筛查视频中的条目相关行为。

Details

Motivation: 发育筛查视频展示儿童如何完成特定行为，但临床记录通常记录结果而非视频里具体发生了什么，需要从视频学习针对条目的行为描述。

Result: 在覆盖 41 个评估条目的 13,379 段视频上，作者报告该方法提升总体准确率及召回率超过 0.5 的条目数。错误仍集中在行为时间方向、持续时间和年龄相关解释；摘要未提供具体准确率。

Insight: 冻结语言模型对视觉语言模型生成的描述按临床结果一致性、条目相关性、无关配对弃答和清晰度打分，再用 GRPO 更新 LoRA。方法将描述是否临床相关作为可优化的语义反馈，而不只监督最终标签。

Abstract: Developmental screening videos show how children perform specific behaviors, but clinical records usually contain outcomes rather than descriptions of what happened. We present SemReward-VL, which learns to describe item-specific behavior from these outcomes. A vision-language model generates a description, and a frozen language model scores its agreement with the clinical outcome, relevance to the item, abstention on unrelated video-item pairs, and clarity. Group relative policy optimization (GRPO) updates LoRA adapters using this semantic reward. On 13,379 videos covering 41 items, the method improves aggregate accuracy and the number of items with recall above 0.5. Errors remain in temporal direction, duration, and age-specific interpretations of behavior.

[103] dKFD: Phase-Structured Evidence Allocation for Fixed-Budget Localized Event Understanding cs.CVPDF

Aditya Bagri, Ashutosh Kumar, Chaitanya Lakhchaura, Avinash Anand, Zhengkui Wang

TL;DR: dKFD 为局部事件视频稀疏理解提出按事件前、中、后阶段分配固定帧预算的可微选择器，以提升选帧与事件证据的对齐。

Details

Motivation: 全局竞争式 Top-K 选择器能维持事件识别和定位，却可能在局部事件视频中不稳定地选择证据；关键线索往往分别出现在事前背景、事件本身和事后结果。

Result: DoTA 事件识别上，K=12 的全局 Top-K 帧 AUC 为 51.5±10.8；匹配预算多种子评估中，dKFD 帧 AUC 提高 30.97 点，识别准确率也有小幅但显著提升，时间定位相当。去除阶段监督后帧 AUC 降至 41.1±12.0。VRU-Accident 上多种 VLM 家族也持续改善，但密集字幕任务中均匀采样仍有竞争力。

Insight: dKFD 在全序列时间编码后给事件前、中、后阶段分别预留证据容量；消融表明阶段监督是收益关键。作者将方法定位为事件中心、固定预算的选择策略，而非通用视频摘要方案。

Abstract: Sparse video understanding often requires selecting a small set of visual evidence under a fixed frame budget. Most sparse selectors allocate this budget globally, allowing all frames to compete with one another. For temporally localized events, this can be a poor inductive bias: useful evidence is often distributed across pre-event context, the event itself, and post-event consequences. We study fixed-budget evidence allocation for localized event videos and show that globally competitive Top-$K$ selectors can preserve recognition and grounding while producing unstable event evidence. On DoTA Video Anomaly Recognition, Global Top-$K$ obtains competitive recognition and temporal grounding, but low selector-event alignment at $K=12$ (Frame AUC $51.5 \pm 10.8$). We propose dKFD, a phase-structured differentiable selector that reserves evidence capacity across pre-event, event, and post-event phases after full-sequence temporal encoding. Under matched-budget multi-seed evaluation, dKFD improves Frame AUC by $+30.97$ over a matched Global Top-$K$ selector at $K=12$ ($p<0.01$), while yielding modest but statistically significant recognition gains and comparable temporal grounding. Mechanism ablations show that phase supervision is load-bearing: removing it reduces Frame AUC to $41.1 \pm 12.0$ even when phase-partitioned budgets are retained. Downstream diagnostics on VRU-Accident show consistent gains over learned Global Top-$K$ across VLM families, while dense captioning reveals a boundary condition where uniform sampling remains competitive. These results support phase-structured allocation as a controlled fixed-budget approach for event-centric sparse evidence selection, not as a universal video summarization strategy.

Zhihao Chen, Yiyuan Ge, Ziyang Wang, Pu Cao, Lu Yang

TL;DR: 该工作先用可学习查询槽从全景观察中抽取导航所需全局和局部证据，再把这一路由显式蒸馏给紧凑视觉语言导航学生模型。

Details

Motivation: 大型 VLN 模型准确率较高但部署成本昂贵；若只蒸馏最终动作，学生可能无法复现教师选择导航证据的位置与方式。

Result: 标准 VLN 基准实验中，学生导航表现接近教师，同时参数量减少 93.65%。摘要未报告具体导航成功率。

Insight: 教师用 Navigable Query Generator 从全景图提取行动充分的查询证据，再由 Instruction-Query Aligner 逐步与指令对齐；学生同时学习教师关注的全局/局部导航 token 和动作分布。显式证据瓶颈成为压缩接口。

Abstract: Recent large-scale Vision-and-Language Navigation (VLN) models deliver strong accuracy but remain costly to deploy due to their large parameter counts and computational requirements. We tackle efficient VLN in two steps. First, we build a high-performing teacher that makes navigation evidence selection explicit and compressible. The teacher introduces a small set of learnable query slots to extract global and local action-sufficient navigable evidence from panoramic observations via a Navigable Query Generator, then progressively grounds these evidence tokens to the instruction with an Instruction-Query Aligner for policy prediction. Second, using this explicit query bottleneck as a distillation interface, we train a compact student by transferring both where to attend and what to do. We distill the teacher’s global and local navigable queries with a navigation-aware token-adaptive objective, then further match action distributions during fine-tuning. Experiments on standard VLN benchmarks demonstrate that our student nearly matches the teacher’s navigation performance while reducing the number of parameters by 93.65% compared to the teacher.

[105] Octree-based Video Representation cs.CVPDF

Rungui Zhou, Chuanzhi Zhou, Yuk-Kit Hou, Peng-Shuai Wang

TL;DR: OctVideo 用时空八叉树表示视频，让平滑区域保持粗粒度、细节丰富区域获得更多单元，再以轻量残差和 VAE 重建或进行视频理解。

Details

Motivation: 常见视频模型采用均匀网格，但视频在时间和空间上的复杂度并不均匀，均匀 token 分配会在简单区域浪费计算。

Result: 在 Kinetics-400 上，Conv1D VAE 使用 38.2M 参数、每段 189.4 GFLOPs，重建 PSNR 为 36.12 dB；在高分辨率 DAVIS 2016 上零样本泛化，重建质量与最佳受测模型相当，同时两个数据集上 FLOPs 最少、编码解码最快。用少量输入 token 从头训练时，视频识别也具竞争力。

Insight: 叶节点存储局部 RGB 值和时空梯度，并加轻量学习残差；序列化后由 Conv1D VAE 映射到规则潜变量网格，解码时选择性细化细节。利用视频本身冗余形成稀疏表示，可兼顾重建效率和理解输入长度。

Abstract: Video models commonly use uniform grids even though visual complexity varies substantially across space and time. We introduce OctVideo, which approximates a video clip with an octree. This hierarchy recursively partitions a spatio-temporal volume into eight subvolumes, so that smooth regions remain coarse while detailed regions receive finer cells. Each leaf stores local RGB values and spatio-temporal gradients, supplemented by a lightweight learned residual. For reconstruction, a Conv1D VAE maps the serialized cells to a regular latent grid and selectively refines details during decoding. Our VAE achieves 36.12 dB PSNR with 38.2M parameters and 189.4 GFLOPs per clip on Kinetics-400 (K400). It also generalizes zero-shot to the high-resolution Densely Annotated VIdeo Segmentation (DAVIS) 2016 dataset with reconstruction quality comparable to the best evaluated models. On both datasets, it requires the fewest model FLOPs and achieves the fastest encoding and decoding among the evaluated models. OctVideo also supports video understanding, achieving competitive recognition performance with few input tokens when trained from scratch. By exploiting the redundancy already present in video signals and efficiently processing sparse structures, OctVideo provides an efficient representation for video.

[106] QSCP: Beyond Class-Name Prompts for Query-Guided Semantic Change Parsing cs.CVPDF

Yuan Qian, Jie Ma

TL;DR: QSCP 将遥感变化检测扩展为查询引导的语义变化解析，支持类别、同义词和描述性请求，并输出变化区域及前后两期的语义图。

Details

Motivation: 传统变化检测标记所有变化，类别提示方法虽能选择目标类变化，却只返回二值区域掩码，无法说明地物从什么变成什么。

Result: 在 SECOND 上，QSCP 对同义词、句子和转变查询均优于 RCDNet，并比所评语义变化基线提高端到端语义预测；WHU-CDC 实验进一步考察跨数据集迁移及等价表达一致性，未使用目标域训练。摘要未给出具体分数。

Insight: 方法先把请求解析为意图和语义槽位，再组合双向视觉证据，通过查询条件解码器分别预测两个时间点的语义状态，使“源类别→目标类别”转变可被显式推理。

Abstract: Traditional change detection (CD) identifies changes between bi-temporal remote sensing images, while semantic change detection (SCD) assigns predefined land-cover classes. However, mapping all changes may not meet a user’s specific needs. Referring change detection (RCD) enables selective retrieval through category prompts. However, existing category-prompted RCD uses the queried category to specify the destination of a change and returns only a binary mask of the corresponding regions. Users may instead request a particular transition and paired semantic maps to understand what changed into what. Such requests require explicit source and target reasoning beyond target-class localization. To address these needs, we propose query-guided semantic change parsing (QSCP), which supports category names, synonyms, and intent-bearing sentences and returns a query-specific mask with paired temporal semantic maps. QSCP parses requests into intents and semantic slots, composes bidirectional visual evidence, and predicts both temporal states with a query-conditioned decoder. On SECOND, QSCP outperforms RCDNet on synonym, sentence, and transition queries and improves end-to-end semantic prediction over evaluated semantic baselines. WHU-CDC experiments further assess cross-dataset transfer and consistency across equivalent expressions without target-domain training. Code is available at https://github.com/qianyuancs/QSCP

[107] Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Models cs.CV | cs.AIPDF

Tuo Liang, Disheng Liu, Nengbo Wang, Vipin Chaudhary, Yu Yin

TL;DR: ReferOri 将三维指代定位扩展为方向定位，要求模型同时预测对象的六维朝向及轴向对称性，而不仅是对象位置。

Details

Motivation: 空间 VLM 主要研究目标“在哪里”，但许多三维任务还需要知道“朝向如何”；定向框未必能表达对象中心方向及对称性导致的歧义。

Result: 作者构建 ReferOri，包含 331K 多视图和 387K 单视图方向指代查询，并提出 OG-VLM。在单视图、多视图基准上，OG-VLM 显著优于方向感知 VLM 基线；在场景级指代基准上超过对象级方向基础模型，下游方向空间推理也显示收益。摘要未给出具体分数。

Insight: 通过带符号和对称性 token 的结构化框/朝向输出及几何辅助损失，模型学习区分空间定位与方向理解。规模化重建、一致性检查和人工核验共同构造训练查询，表明方向指代是可独立学习的能力。

Abstract: Grounding is a core capability of spatial vision-language models, yet most existing work focuses only on where a referred object is. Many 3D tasks also require knowing how it is oriented. Although existing 3D VLMs may predict oriented boxes, box pose does not explicitly capture object-centric orientation or symmetry-induced ambiguities. We introduce orientation grounding, a referring grounding task that predicts an object’s 6D orientation and axial symmetry from a language or box query in single-view or multi-view scenes. To support this task, we construct ReferOri, with 331K multi-view and 387K single-view orientation-grounding queries obtained through scalable reconstruction, consistency checking, and human verification. We further present OG-VLM, which adapts a 3D VLM with structured box/orientation outputs, sign and symmetry tokens, and geometry-aware auxiliary losses. Across single-view and multi-view benchmarks, OG-VLM substantially outperforms orientation-aware VLM baselines and surpasses object-level orientation foundation models on scene-level referring benchmarks, showing that explicit orientation grounding is a distinct and learnable capability beyond localization. Downstream results validate its benefit for orientation-related spatial reasoning.

[108] Train Together or Merge Later? Unifying VLA Experts via a Shared Action Interface cs.CV | cs.ROPDF

Zhizhen Zhang, Yuxia Fu, Zijian Wang, Helen Huang, Yadan Luo

TL;DR: PolicyWeave 先保持多个 VLA 专家的动作接口一致，再根据当前视觉—语言上下文挑选部分 LoRA 更新进行稀疏合并，减少多任务干扰。

Details

Motivation: 联合训练多任务策略可能不及分别训练各任务专家；独立专家直接合并也未必有效，因为各任务可能改动动作归一化及动作编码/解码接口，导致参数不兼容。

Result: 在 GR00T N1.5 的 18 个 RoboCasa365 任务、仅用目标任务 10% 示范的设置中，保留共享动作接口使四种静态合并方法平均成功率从 17.0% 提升到 52.8%。PolicyWeave 用 SFT 专家达 64.7%，再经任务强化学习达 74.1%，而联合 RL 为 60.7%；LIBERO-10 和 AgileX Piper 实验进一步支持长程及真实操作迁移。

Insight: 后训练时各专家保留共同基础策略的动作接口，任务适配限制在动作模型隐藏层 LoRA；部署时按初始视觉语言上下文评分专家更新，用逐层留一排名稳定性选择专家并稀疏加权合并，避免无关任务更新相互干扰。

Abstract: Co-training offers a straightforward way to build a multi-task vision-language-action (VLA) policy, but can fall short of the performance achieved by training each task independently. The challenge is to retain these task-specific gains in a multi-task policy without joint post-training. Combining independently trained experts through model merging is a natural approach, yet strong individual experts do not necessarily yield a strong merged policy. We identify one source of this incompatibility: task-specific changes to the action interface, comprising action normalization and the action encoder and decoder. We propose PolicyWeave, combining merge-compatible post-training with context-guided sparse merging. During post-training, all experts retain the common base policy’s action interface, while task adaptation is restricted to LoRA updates in the hidden layers of the action model. This makes the experts more compatible with existing model merging methods. However, merging all experts can still introduce interference from unrelated tasks at deployment. PolicyWeave scores each expert’s LoRA updates using the initial visual-language context, determines the expert set through leave-one-layer-out ranking stability, and forms a sparse weighted merge of the selected updates that remains fixed for current task. We evaluate PolicyWeave with GR00T N1.5 on 18 RoboCasa365 tasks, using only 10% of the target-task demonstrations for supervised fine-tuning (SFT). Preserving the shared action interface raises the average success rate across four static merging methods from 17.0% to 52.8%. PolicyWeave achieves 64.7% success with these SFT experts and 74.1% after task-specific reinforcement learning (RL), compared with 60.7% for joint RL. Further evaluations on LIBERO-10 and an AgileX Piper arm support the deployment of independently learned skills in long-horizon and real-world manipulation.

[109] FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs cs.CV | cs.AIPDF

David Restrepo, Chenwei Wu, Luis Filipe Nakayama, Miguel L. Martins, Stergios Christodoulidis

TL;DR: FOCUS 是视网膜眼底模型跨数据集基准，同时评估视觉编码器、双编码器 VLM 和多模态 LLM 的排序能力、校准、亚组差异及图像质量鲁棒性。

Details

Motivation: 单数据集成绩无法反映模型在地域、采集条件、临床标签定义变化或患者亚组上的表现；医学部署还需要同时关注鲁棒性、校准和公平性。

Result: 基准统一十个公开数据集中的糖尿病视网膜病变、可转诊病变和青光眼视神经病变任务，评估 532 个基础配置及 228 个经 LoRA 监督微调的 MLLM 配置。没有一种模型家族在所有任务和数据集都占优：通用视觉编码器平均排序表现最强，医学 MLLM 有竞争力但波动，双编码器 VLM 从轻量适配中明显获益；微调改善域内表现，但外部迁移和校准收益不一。

Insight: 可靠性是多维度属性，不能只看单一队列上的平均准确率。FOCUS 的统一分析框架把泛化、校准、亚组差异和图像质量变化并列呈现。

Abstract: Progress in AI-based retinal image analysis has advanced with foundation models, yet evaluating their reliability remains challenging. Performance reported on a single dataset does not capture how models behave under dataset shift, across clinical definitions, or for different patient subgroups. This limitation is particularly critical in medical imaging analysis, where robustness, calibration, and fairness are essential for safe deployment. We introduce FOCUS (Foundation Ophthalmic Cross-Dataset Understanding under Shift), a cross-dataset benchmark for evaluating retinal fundus models that considers vision-only encoder models (VM), vision-language dual-encoder models (VLM), and multimodal large language models (MLLM). FOCUS harmonizes binary diabetic retinopathy, referable diabetic retinopathy, and glaucomatous optic neuropathy tasks across ten public datasets spanning diverse geographies, acquisition conditions, and label protocols. The benchmark evaluates models through a unified analysis layer that measures ranking performance, calibration, subgroup disparities, and image-quality robustness. We present a large-scale evaluation covering 532 base configurations and 228 MLLM configurations adapted through supervised fine-tuning with low-rank adaptation (LoRA). Results show that no model family consistently dominates across tasks and datasets: general VM encoders achieve the strongest average ranking performance, medical MLLMs are competitive but variable, and dual encoder VLMs benefit substantially from lightweight adaptation. Fine-tuning improves in-domain performance but exhibits heterogeneous transfer to external datasets, particularly in calibration. These findings demonstrate that retinal model evaluation is inherently multidimensional. FOCUS provides a practical framework and public benchmark to assess generalization, reliability, and robustness beyond single-dataset leaderboards

[110] Can Protein-Derived Knowledge Improve Pathology Foundation Models? cs.CVPDF

Di Zhang, Zhangpeng Gong, Jiashuai Liu, Zhi Zeng, Jiusong Ge

TL;DR: ProSlide 通过分阶段获取蛋白质组学知识并以关系蒸馏迁移到病理切片，构建层级式切片基础模型，缓解病理图像与独立分子数据之间的配对监督瓶颈。

Details

Motivation: 现有分子基础模型多学习蛋白序列或单细胞状态，而不是与 WSI 配对的患者级整体表达；独立分子语料又只能通过少量配对 WSI-组学间接影响病理编码器。

Result: 蛋白组编码器在 12,695 份样本级整体蛋白谱上预训练；ProSlide 仅用 2,229 张 WSI 和这些蛋白谱预训练，在乳腺、肺、肾癌的 12 个下游任务中，各癌种组内平均准确率和 AUC 均最高。

Insight: 三阶段框架先以虚拟谱生成和表达空间多视图预训练建立蛋白质编码器，再训练 patch—区域—切片层级编码器预测蛋白表达，最后以 Prot2Path 对齐配对及非配对蛋白谱共享库中的相似度分布，扩大独立蛋白语料对病理模型的影响。

Abstract: Molecularly guided pathology foundation models (PFMs) exploit transcriptomic or proteomic information to enrich whole-slide image (WSI) representations, yet effectively leveraging large standalone molecular corpora remains challenging. First, existing molecular foundation models encode protein sequences or single-cell states, not the patient-level bulk expression profiles paired with WSIs. Second, because cross-modal supervision is restricted to paired WSI-omics samples, knowledge from standalone molecular corpora reaches the pathology encoder only indirectly, creating a paired-support bottleneck. To address these challenges, we propose a three-stage framework that decouples proteomic knowledge acquisition from cross-modal transfer, yielding ProSlide, a slide-level hierarchical pathology foundation model. First, to close the modality gap, we pretrain a Proteomic Foundation Encoder (PFE) on 12,695 sample-level bulk protein profiles using virtual profile generation and expression-space multi-view pretraining. Second, we pretrain ProSlide, a patch-region-slide encoder, to predict protein expression from paired WSI-protein samples. Third, to relax the paired-support bottleneck, we introduce Prot2Path, a cross-modal relational distillation objective. For each paired sample, it aligns the similarity distributions of the WSI and its protein profile over a shared, frozen bank of PFE-encoded paired and standalone profiles. We evaluate ProSlide on 12 downstream tasks across breast, lung, and renal cancers. Despite being pretrained with only 2,229 WSIs and 12,695 sample-level protein profiles, ProSlide achieves the highest mean accuracy and AUC within each cancer group.

[111] FocusDrive: Reasoning with Visual Focus for Autonomous Driving cs.CV | cs.ROPDF

Zhiyuan Liu, Zehong Ke, Yuanxin Tian, Hao Cheng, Jinhao Li

TL;DR: FocusDrive 将对象描述与图像 patch 引用绑定，显式标记驾驶推理中应关注什么、位于何处，再用于生成规划和轨迹。

Details

Motivation: 驾驶决策既依赖关注哪些对象，也依赖如何据此行动；纯文本理由可能没有说明其对应图像中的哪条视觉证据，感知与行动之间的联系因此隐含。

Result: 在 W3DA 和 NAVSIM 上，FocusDrive 的驾驶员注视预测和端到端规划表现具竞争力，并优于文本思维链基线。摘要未提供具体分数。

Insight: 作者先用注视预测评估视觉焦点表征，再在现有 NAVSIM 训练场景的驾驶焦点标注上检验其对规划推理的作用。显式视觉焦点为从场景理解到驾驶行动提供了可定位的中间表示。

Abstract: Driving decisions depend on both where to focus and how to act on what is seen. Effective driving reasoning must establish which objects matter, where they are, and how they inform the intended action. Text-based rationales can describe a driving response while leaving its correspondence to specific visual evidence implicit. Visual focus provides a concrete starting point for this connection by identifying what matters in the scene and where it is. We propose FocusDrive, a structured multimodal reasoning framework that organizes end-to-end planning around explicit visual focus. It pairs descriptions of decision-relevant objects with image-patch references, bringing explicit visual focus into the reasoning that generates driving plans and trajectories. We first assess this focus representation through driver gaze prediction, then investigate its role in planning reasoning using driving-focus annotations within existing NAVSIM training scenes. Experiments on W3DA and NAVSIM demonstrate competitive gaze prediction and end-to-end planning performance, with FocusDrive improving over text-based chain-of-thought. These results support visual focus as an effective link between scene understanding and driving action.

[112] ReAL: Accelerating Flow Matching through Segment Advancement with Shared Lookahead cs.CVPDF

Xuanhua Yin, Chuanzhi Xu, Haoxian Zhou, Shunqi Mao, Weidong Cai

TL;DR: ReAL 是无需训练的 flow matching 采样器，用一次共享前瞻估计速度场误差并选择可安全推进的最长区间，从而减少模型评估次数。

Details

Motivation: 延长速度估计的使用跨度可降低图像和视频生成成本，但局部速度相似并不能决定合适步长；逐个候选终点再调用模型检查又会抵消加速收益。

Result: 在 FLUX.1-dev 上实测加速 4.91 倍，同时保留稠密采样平均 ImageReward 的 97.0%；在 HunyuanVideo 上加速 5.49 倍，VBench 分数接近稠密采样。摘要还覆盖四种图像骨干、视频生成和图像编辑任务。

Insight: 同一前瞻同时用于选最长通过候选跨度、修正接受的更新并提供下一步初始速度；初始化后每次常规迭代只需一次新模型评估，且不需训练、内部特征或改动噪声调度。

Abstract: Flow-matching models generate high-quality images and videos, but repeated neural network evaluations make sampling expensive. Skipping evaluations reduces this cost by extending an available velocity estimate over a longer span. However, local velocity agreement alone does not determine a suitable span, and checking each candidate endpoint adds costly model calls. We introduce ReAL, a training-free sampler that selects how far to advance using one shared lookahead. Our key insight is that the discrepancy between uncorrected and lookahead-corrected endpoint proposals can be computed directly from the observed velocity mismatch and the candidate span beyond the lookahead. This relation provides a span-dependent selection criterion without additional endpoint evaluations. The same lookahead selects the longest passing candidate span, corrects the accepted update, and supplies its velocity as the next starting estimate. After initialization, each regular iteration requires only one fresh evaluation. ReAL uses the pretrained velocity output and original noise schedule, with no additional training or access to internal features. Experiments cover four image-generation backbones, video generation, and image editing. ReAL achieves 4.91x measured speedup on FLUX.1-dev while retaining 97.0% of dense mean ImageReward. On HunyuanVideo, it achieves a 5.49x speedup while maintaining a VBench score close to that of dense sampling.

[113] RepFlow: Reciprocal Supervision Improves Generation and Representation in Flow Models cs.CVPDF

Weili Zeng, Feng Tian, Shengqi Liu, Yichao Yan

TL;DR: RepFlow 从生成模型随深度和噪声演化的状态中学习稳定视觉表示，再把表示反馈给生成器，形成表示学习与生成训练的互惠循环。

Details

Motivation: 生成器隐藏状态会随网络深度和噪声水平纠缠，难直接充当稳定视觉表示；表示学习通常依赖外部预训练教师，与生成器自身的计算过程分离。

Result: 在无条件潜空间 SiT 与像素空间 JiT 两种设置中，RepFlow 相较原生训练将 FID 降低 19.2%–40.8%；ImageNet 冻结线性探针准确率比搜索得到的最佳原始生成器特征高 6.80–10.04 个百分点。学得表示还可作为单步 JiT 后训练的分布级指标。

Insight: 无时间步编码器从遮罩干净图像预测生成器不同深度、噪声状态，输入排除参考噪声和被遮内容，迫使其提取可从可见上下文恢复的信息；生成器更新状态再监督编码器，构成双向互惠学习。

Abstract: Generative models learn visual structure through denoising, yet their internal states are entangled with both noise level and network depth, making it difficult to obtain a stable visual representation from the generator itself. We introduce RepFlow, which learns such a representation from the generator’s evolving computation and uses it to guide generation. Specifically, a separate timestep-free encoder is trained, through a timestep-conditioned predictor, to recover generator states across depths and noise levels from masked clean images. By excluding the reference noise and masked-out content from the encoder’s input, we encourage the encoder to distill visual information that is recoverable from the visible image context and predictive of generator states. The representation learned from the generator’s evolving states is then fed back to guide and improve the generator, whose updated states provide supervision for further representation learning, forming a reciprocal learning process. This reciprocal process improves multi-step generation and representation quality, as measured by frozen linear probing on ImageNet with latent-space SiT and pixel-space JiT, without an externally pretrained representation teacher. Across the two unconditional settings, FID decreases by $19.2$–$40.8%$ relative to native training, while linear-probe accuracy improves by 6.80–10.04 percentage points over the best searched raw generator features. The learned representation also serves as a distributional metric for one-step JiT post-training, extending its role from instance-level alignment to distribution-level supervision.

[114] PARSEE-VAD: Efficient Training-Free Online Video Anomaly Detection via Proposition-Aware Reasoning and Streaming Evidence Escalation cs.CVPDF

Ji Wang, Shuangqing Zhang, Guo-Sen Xie, Fang Zhao

TL;DR: PARSEE-VAD 将在线视频异常检测拆成当前窗口的命题证据获取和紧凑评分状态演化，用条件查询细化当前语义、用有限状态维持时间连续性。

Details

Motivation: 冻结多模态模型做无训练在线检测时，需在因果计算约束下理解当前窗口，并避免反复传输高维历史；文本摘要可能压缩视觉证据或引入语义偏差，视觉历史又会扩大上下文。

Result: 在四个基准上，PARSEE-VAD 展示较强的免训练在线表现；选择性路由减少专家计算，评分状态传播保持稀疏。摘要未提供具体基准分数。

Insight: PAR 从当前因果窗口提取结构化命题，并只在粗证据值得进一步确认时激活细查询；可复用因果视觉前缀减少重复计算。SEE 将证据映射成有界评分域事件状态，只传播该紧凑状态以修补剩余时序连续性。

Abstract: Training-free online video anomaly detection (VAD) with frozen multimodal language models faces two coupled challenges: extracting reliable current-window semantics under causal and computational constraints, and maintaining temporal continuity without repeatedly transmitting high-dimensional history. Encoding history through text can compress visual evidence and introduce semantic bias, whereas retaining visual history expands multimodal context. We introduce PARSEE-VAD, a two-module framework that separates semantic evidence acquisition from score-state evolution. Proposition-Aware Reasoning (PAR) extracts structured propositional evidence from the current causal window and conditionally activates more specific queries when coarse evidence warrants further refinement. By sharing a reusable causal visual prefix across queries, PAR reduces redundant computation through selective execution. Streaming Evidence Escalation (SEE) maps the acquired proposition evidence into a compact score-domain event state through current evidence escalation, then propagates only the resulting bounded state across decisions to support temporal continuity. Experiments on four benchmarks demonstrate strong training-free online performance while selective routing reduces specialist computation and score-state propagation remains sparse. These results support a current-first principle for streaming multimodal inference: resolve present semantics first, then use compact historical state only to repair residual continuity gaps.

[115] VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis cs.CV | cs.AIPDF

Kangjie Chen, Xiangyu Li, Dongbin Zhang, Chaoda Zheng, Shijia Chen

TL;DR: VGGT-Diff 将 VGGT-Ω 的显式视觉几何路由到预训练视频扩散模型，兼顾稀疏视图新视角合成中的已观测几何保真和未见区域生成。

Details

Motivation: 重建式方法保留观测几何但难生成未见区域；扩散式方法有强生成先验，却依赖隐式源视图到目标视图对应，稀疏视角下易产生不稳定。

Result: 作者报告 VGGT-Diff 在不同视角难度的插值和外推设置中达到有竞争力或最先进表现。摘要未提供具体指标。

Insight: 视觉 token 关联三维点及置信度，再由置信度感知路由器映射为目标视角条件，并保留前后表面证据；可靠 3D 轨迹上的干净预测残差一致性约束提升多视角稳定性，训练和推理阶段还结合鲁棒几何条件。

Abstract: We present VGGT-Diff, a geometry-routed multi-view diffusion model for sparse-view novel view synthesis. Existing novel view synthesis (NVS) methods face a fundamental trade-off: reconstruction-based approaches preserve observed geometry but struggle to synthesize unseen regions, while diffusion-based methods provide strong generative priors yet rely on implicit source-to-query correspondence. VGGT-Diff bridges these regimes by routing visual geometry latents from VGGT-Ω into a pretrained video diffusion model. Each visual token is associated with a 3D point and confidence, then transformed into query-aligned latent conditions through a confidence-aware Visual Geometry Router (VGR) that preserves front and back surface evidence. These conditions guide joint target-view denoising, while Point-Track Residual Consistency (PTRC) regularizes predicted-clean residuals along reliable 3D tracks, improving multi-view stability. We further introduce robust geometry conditioning, combining training-time regularization with inference-time guidance for improved robustness. Experiments show competitive or state-of-the-art performance across interpolation and extrapolation under different viewpoint difficulties. Our code is available at https://github.com/chenkangjie1123/VGGT-Diff.

[116] EngIntervene: Benchmarking Multimodal Engineering State Understanding and Design Intervention Reasoning cs.CV | cs.SEPDF

Jinchang Zhang, Yingda Tao, Jiakai Lin, Guoyu Lu

TL;DR: EngIntervene 评估多模态模型能否从工程图像和文档理解当前系统状态，进一步推理关系、约束、故障原因及设计修改后果。

Details

Motivation: 现有工程基准多评静态识别或技术问答，缺少从工程感知到完整设计生成之间的中间能力：根据已理解状态判断修改是否达成目标且保持约束。

Result: 基准含七个工程领域的 3,229 个问题，分状态定位、关系/机制推理、约束诊断和干预推理四层。最佳开源模型在 T2–T4 平均落后最佳闭源模型 14.7 个百分点；移除或打乱图像证据会降低成绩，基准微调改善 T1 却未改善 T2–T4。T4 还显示满足单项修改条件与提出完全有效干预之间差距很大。

Insight: 干预推理要求同时恢复对象、关系、约束和设计目标，并预测修改后的状态，而不是只判断局部改动是否合理。现有模型的感知接地能力并不能可靠转化为诊断和干预能力。

Abstract: Multimodal engineering benchmarks largely evaluate static understanding, such as recognizing components, interpreting diagrams, or answering technical questions. This leaves a missing middle between engineering perception and full design generation: whether a model can use an understood system state to reason about relations, constraints, and the consequences of design changes. We introduce \textsc{EngIntervene}, a benchmark for this capability. It contains 3,229 questions across seven engineering domains and organizes evaluation into four levels: state grounding (T1), relational and mechanistic reasoning (T2), constraint-aware diagnosis (T3), and intervention reasoning (T4), which asks whether a proposed modification achieves its target while preserving required constraints. The tasks instantiate a unified engineering state representation spanning objects, relations, constraints, and design objectives, and T2–T4 are scored against structured reference answers with atomic criteria. Across open- and closed-weight multimodal models, stronger grounding does not reliably translate into better diagnosis or intervention, and the best open-weight model trails the best closed model by 14.7 percentage points on the T2–T4 average. Removing or shuffling visual evidence consistently degrades performance, while benchmark-specific supervised fine-tuning improves T1 but not T2–T4. T4 further exposes a large gap between satisfying individual revision criteria and producing a fully valid intervention. Engineering reasoning thus requires not only recovering the current state, but also reliably using it to reason about constraints and post-intervention consequences. Code and benchmark artifacts are available at https://github.com/changcv2021/EngIntervene

[117] VehDyn: A Driving World Model Benchmark for Vehicle Dynamics cs.CV | cs.AI | cs.ET | cs.ROPDF

Tianyi Wang, Wangsheng Du, Jiazhou Chen, Tianyi Zeng, Xiangyu Li

TL;DR: VehDyn 用同步视频与车辆状态评估驾驶世界模型的车辆动力学真实性，揭示画面逼真或轨迹接近并不意味着生成车辆遵循真实动力学。

Details

Motivation: 现有驾驶世界模型基准多测视觉保真和粗略物理合理性，缺少独立控制车型、路面、机动和速度并同步记录真值的资料，无法检验真实运动学和动力学。

Result: CARLA–CarSim 共仿真基准含 10,080 种配置，覆盖五种车型、四种轮胎—路面摩擦系数、三种机动、四种目标速度、14 个场景和三种照明。12 个视频世界模型中，10 个轨迹级指标已达到距真值 20% 以内，但没有模型动力学一致性达到真值的 92%；画质指标与动力学保真相关性较弱。DrivingWorld 总分最高，其后为 Cosmos 3 Nano 和 LTX-Video 2.5。

Insight: 分层评估分别测轨迹对齐、运动学一致性和动力学一致性，并与视频质量指标对照；结果显示需专门评测车辆动力学，不能以视觉质量替代物理真实性。VehDyn 分数与人类判断吻合较好。

Abstract: Video world models are emerging as data engines, action planners, and generative simulators for autonomous driving, but existing benchmarks primarily assess visual fidelity and coarse physical plausibility, providing limited evidence on whether generated driving futures obey realistic vehicle kinematics and dynamics. This limitation is further compounded by the lack of datasets in which vehicle, road, maneuver, and speed conditions are independently controlled, and ground-truth vehicle states are recorded in synchrony with videos. We introduce VehDyn, a driving world model benchmark for vehicle dynamics. VehDyn is built on a CARLA-CarSim co-simulation platform where photorealistic rendering is coupled with a validated multi-body dynamics model, and it contains 10,080 configurations from a full factorial design over five vehicle types, four tire-road friction coefficients, three maneuvers, four target speeds, 14 scenes, and three illuminations, each paired with synchronized position, velocity, and attitude sequences. Built on this dataset, VehDyn introduces a hierarchical evaluation framework that measures trajectory alignment, kinematic consistency, and dynamic consistency, and benchmarks 12 state-of-the-art video world models. We further assess the video quality using two established protocols and correlate it with the VehDyn score. Trajectory-level metrics are nearly saturated, with ten of twelve models within 20% of ground truth, while no model reaches 92% of ground truth on dynamic consistency, and visual-quality metrics are only weakly correlated with vehicle-dynamics fidelity. DrivingWorld achieves the highest VehDyn score, followed by Cosmos 3 Nano and LTX-Video 2.5, and the VehDyn score agrees closely with human judgment. VehDyn provides a systematic foundation for developing driving world models that are physically consistent and visually realistic.

[118] InfoEdit: Probing Global Layout Reasoning in Infographic Editing cs.CV | cs.CL | cs.SEPDF

Cheng Yang, Chufan Shi, Huijuan Wang, Bo Shui, Yaokang Wu

TL;DR: InfoEdit 是信息图编辑基准，专门检验模型能否在修改一个内容元素时重排相关元素、维持整体逻辑布局，即执行 reflow。

Details

Motivation: 照片编辑模型已能达到较高质量，但信息图通过关系表达信息，局部更改通常要求周围元素同步调整；既有图像编辑基准既少有结构化图表，也不测整体重排能力。

Result: 基准包含 1,000 张信息图、八类逻辑关系及四种编辑任务的 4,000 条指令。八种前沿编辑器中仅 GPT-Image-2 的平均成功率超过 60%；多数模型低于 7%，即使目标定位完美，Swap-Block 任务也无人超过 36%。代码级编辑可匹配最强像素级编辑器，表现出互补优势。

Insight: 结果将 reflow 识别为结构化视觉编辑的核心挑战；仅找到正确目标并不足以让模型理解元素间关系并协调修改。

Abstract: Multimodal foundation models edit natural photographs at production quality, yet the same models struggle with structured visual content such as infographics. Unlike photographs, infographics encode information through logical relations; editing one element often requires surrounding elements to be adapted. We refer to this global layout reasoning capability as reflow. Existing image-editing benchmarks neither provide a dedicated setting for structured visual content nor evaluate the reflow capability. We introduce InfoEdit, a novel benchmark of 1,000 infographics across eight logical-relation families, paired with 4,000 editing instructions across four editing tasks, and a reflow-aware evaluation protocol. Across eight frontier editors, only GPT-Image-2 clears 60% average success rate; most models fall below 7%, and no editor exceeds 36% on the Swap-Block task even with perfect target localization. We further show that code-level editing can match the strongest pixel-level editor, revealing complementary strengths across tasks. InfoEdit identifies reflow as a central challenge in structured visual content editing and provides a diagnostic benchmark to facilitate future progress.

[119] Informative Viewpoint Selection for Episodic-Memory Embodied Question Answering using Omnidirectional Images cs.CV | cs.ROPDF

Kaname Kitamura, Asako Kanezaki

TL;DR: 该工作利用全景图像和问题条件视角选择，减少具身问答中的冗余视觉输入，并缓解等距柱状投影畸变。

Details

Motivation: 全景图可在不显式旋转相机时提供周围环境，但等距柱状投影会使 VLM 识别变差，整张图输入还包含大量无关背景并增加视觉 token 消耗。

Result: 在 OpenEQA 的 Habitat-Matterport 3D 子集上，该方法在使用全景观察的报告模型结果中达到最先进表现。移除旋转视图后，观察帧数减少 65.5%，回答准确率仍大体保持。

Insight: 方法先把等距柱状图投影为多个透视立方体面，由微调 BLIP-2 按问题估计相关性，再通过兼顾多样性的贪心策略选取信息视角。选择既控制投影畸变，也避免只保留内容相似的重复视角。

Abstract: Embodied Question Answering (EQA) requires agents to answer natural language questions about surrounding environments from visual observations. In this work, we focus on open-vocabulary episodic-memory EQA (EM-EQA), where an agent answers free-form questions using recorded observation histories. Omnidirectional images are promising for this task, as they provide wide field-of-view observations that can capture surrounding context without requiring explicit camera rotations. However, omnidirectional images introduce two challenges for EQA: (i) equirectangular projection causes severe geometric distortion that degrades vision-language model (VLM) recognition accuracy, and (ii) feeding equirectangular images directly into VLMs introduces excessive irrelevant background information, reducing answer accuracy and increasing the visual-token burden. To address these challenges, we propose a viewpoint selection method for EM-EQA using omnidirectional images. Our method converts equirectangular observations into perspective views via cubemap projection, estimates question-conditioned relevance with fine-tuned BLIP-2, and selects informative and diverse viewpoints through diversity-aware greedy selection. Experiments on the Habitat-Matterport 3D (HM3D) subset of OpenEQA show that our method achieves state-of-the-art model performance among the reported model results with equirectangular observations. Moreover, after removing rotation views, which reduces observation frames by 65.5%, our method largely maintains its answer accuracy.

[120] VisionHOPE: Visual Backbones as Self-Modifying Learning Systems cs.CVPDF

Siran Peng, Tianshuo Zhang, Tianyu Fu, Weisong Zhao, Haoyuan Zhang

TL;DR: VisionHOPE 将视觉骨干建模为随图像内容不断修改记忆及学习规则的自修改学习系统，使模型记忆内容与学习方式共同演化。

Details

Motivation: 视觉模型从 CNN、ViT、状态空间模型发展到测试时训练，逐渐能按输入自适应，但适应规则仍主要由训练好的骨干预先规定。

Result: 作者报告 VisionHOPE 在 ImageNet-1K、COCO 和 ADE20K 上取得有竞争力的结果，表明自修改学习系统可作为通用视觉骨干的可行方向。摘要未提供具体指标。

Insight: 五种耦合记忆分别存储内容、生成 key/value 并控制学习率和保留；为避免直接自指更新不稳定，作者提出软限制自指注入和谱截断保留记忆转移，并证明每次扫描中的记忆动力学非扩张。二维特征沿行列分块并作四方向扫描。

Abstract: Visual backbones have evolved from Convolutional Neural Networks (CNNs) with local aggregation to Vision Transformers (ViTs) with global interactions, State-Space Models (SSMs) with input-dependent state transitions, and Test-Time Training (TTT) layers that adapt an inner learner while processing an image. Across this progression, visual computation has become increasingly adaptive to each input, yet the rules governing that adaptation remain largely prescribed by the trained backbone. We introduce VisionHOPE, the first generic visual backbone formulated as a self-modifying learning system, in which what the model remembers and how it learns co-evolve within an image. Building on the self-referential construction of Nested Learning (NL), VisionHOPE realizes this co-evolution through five coupled memories that store content, generate key and value representations, and govern learning rate and retention. These memories evolve jointly as visual context accumulates along each scan. However, directly applying the unconstrained self-referential update to a visual backbone leads to instability. We therefore derive a stability-matched step-size control scheme that combines a soft cap on self-referential injection with a spectral clamp on the retained memory transition, and prove that the resulting memory dynamics are non-expansive along each scan. For two-dimensional feature maps, we adapt NL’s chunk formulation by aligning chunks with image rows and columns across four directional scans. The proposed VisionHOPE achieves competitive results on ImageNet-1K, COCO, and ADE20K, establishing self-modifying learning systems as a practical foundation for general-purpose visual backbones. The code is available at https://github.com/PSRben/VisionHOPE.

[121] OPERA: A Unified Omnimodal Progressive Spatio-Temporal Reasoning Agent for Referring Video Segmentation cs.CVPDF

Jingchen Ni, Yuji Wang, Shannan Yan, Haoru Li, Sitong Chen

TL;DR: OPERA 将文本、音频或参考图像指代视频分割统一为单一多模态模型上的时空渐进推理任务，并通过关键帧筛选、语义蒸馏、目标定位和掩码传播生成像素级结果。

Details

Motivation: 异质指代查询要求模型跨模态理解目标，同时准确定位其在视频中的时空范围；仅靠全视频单次处理难同时控制搜索效率和空间精度。

Result: OPERA 在 OmniAVS 和 Ref-AVS 上达到论文所报最先进表现，并可零样本迁移到标准指代视频分割基准。摘要未提供具体分数。

Insight: 时间轴上的代理先粗到细缩小帧搜索、找出关键信息帧；空间轴上的蒸馏代理决定目标是什么，经过 GRPO 强化的定位代理确定目标位置，最后稠密掩码传播形成逐像素输出。

Abstract: Referring video segmentation with heterogeneous multimodal queries—spanning text, audio, and reference images—demands both robust cross-modal understanding and precise spatio-temporal reasoning. We propose OPERA (Omnimodal Progressive spatio-tEmporal Reasoning Agent), a unified reasoning agent built on a single MLLM that performs dual-axis progressive reasoning via three specialized stages. Along the temporal axis, a Temporal Reasoning Agent narrows the frame search space through coarse-to-fine filtering to identify the most informative key frame. Along the spatial axis, a Distillation Agent establishes what to locate via cross-modal semantic distillation, and a Grounding Agent enhanced with GRPO determines where the target appears, with dense mask propagation completing the pixel-level output. OPERA sets a new state of the art on OmniAVS and Ref-AVS and transfers zero-shot to standard referring video segmentation benchmarks.

[122] Focus and Supplement: Dual-Enhanced Vision Transformer for Multi-Class Anomaly Classification cs.CVPDF

Xurui Li, Enjie Xu, Chenzhou Li, Shilei Zeng, Dayou Huang

TL;DR: MACO 用软焦点注意力、辅助分类 token 和相关性估计，在未知异常类别数时进行工业多类异常分类。

Details

Motivation: 工业异常图像中的异常表征可能噪声大或不完整，异常类别数量也未知；先验类别数的分类方法难适用于动态类别场景。

Result: 在 MVTec AD 和 MTD 上，已知类别数时 ARI 分别提高 6.5% 和 16.3%；未知类别数时，MTD 的 NMI 提高 11.2%，MVTec AD 上的 UPS 比既有类别数估计策略高 24.1%。

Insight: 软焦点注意力用异常图抑制背景噪声；多个辅助分类 token 关注不同异常子区域以形成整体表示。类别数估计利用已标注类别的平均相关性，把其可分性线索迁移到未标注集合。

Abstract: Multi-class anomaly classification in industrial vision remains challenging due to noisy/incomplete anomaly representations and the unknown number of anomaly classes. To overcome this, we propose MACO, a novel multi-class anomaly classification framework that learns comprehensive representations and dynamically estimates class number without prior knowledge. First, a soft-focus attention uses anomaly maps to concentrate on relevant abnormal regions, while suppressing background noise. Second, auxiliary classification ([A-CLS]) tokens complement the [CLS] token. They collectively attend to diverse anomaly sub-regions, yielding more holistic and discriminative features. These [A-CLS] tokens are also effective across more tasks and domains. To infer the class number, we propose Correlation-based Number Estimation strategy. It computes the average correlation among labeled classes and transfers its separability cue to the unlabeled set. Experiments on MVTec AD and MTD datasets demonstrate our superiority. Under known class number, MACO improves ARI by 6.5% and $\textbf{16.3%}$ on both datasets, respectively. In the more challenging unknown number scenario, it achieves an $\textbf{11.2%}$ NMI gain on MTD and outperforms existing number estimation strategies by $\textbf{24.1%}$ UPS on MVTec AD. Code will be released at https://github.com/HUST-SLOW/MACO.

[123] When Does Geometric View Synthesis Help Wine Label Retrieval? A Public One-Shot Benchmark Across Self-Supervised and Vision-Language Backbones cs.CVPDF

Yueh-Cheng Huang

TL;DR: 该研究用每类一张登记照片和真实查询图像评估酒标检索，发现几何视角合成对不同预训练图像编码器的收益差异很大。

Details

Motivation: 几何视角合成能把单张酒标照片扩成训练样本，但对预训练编码器到底有多大价值，尤其与普通二维增强相比，尚不明确。

Result: WineSensed 衍生基准含 1,000 类、每类一张登记照及 4,295 张真实查询。较早的 DINO ViT-S/16 配方中，几何视角使 top-1 从 34.1% 提升至 62.6%–63.7%，约为二维增强收益的三倍。冻结 SigLIP 2-B 已达 94.7%；对其特征训练线性头时，SAM 定位的两种几何流程提高 1.2–1.3 点，其他流程仅提高 0.3–0.6 点且结论不确定。LoRA 和全量微调无明确增益，固定预算全量微调反而下降 9–24 点。

Insight: 几何扩增对较弱自监督表征尤其有效，对强文本监督编码器的收益则有限且依赖适配方法。SAM 定位可为 99% 来源图像生成六个视角，而边缘前端仅覆盖 43%；对圆柱构造、源图倾斜和残余误差的分析仍受裁剪约定及小样本审计限制。

Abstract: Geometric view synthesis can expand a single wine-label photograph into a training set, but its value with pretrained image encoders is unclear. We study this on a public WineSensed-derived benchmark of 1,000 classes, one enrollment photograph per class, and 4,295 real queries. With the earlier DINO vision transformer (ViT-S/16) recipe, geometric views raise top-1 accuracy from 34.1% to 62.6-63.7%, about three times the gain from two-dimensional (2D) augmentation. Frozen SigLIP 2-B already reaches 94.7%. A linear head over its frozen features gains 1.2-1.3 percentage points with the two geometric pipelines localized by the Segment Anything Model (SAM), while the other pipelines gain an inconclusive 0.3-0.6 points. Low-rank adaptation (LoRA) and validation-selected full fine-tuning show no clear gain within the reported confidence intervals; fixed-budget full fine-tuning loses 9-24 points. SAM localization supplies all six views for 99% of sources, compared with 43% for the edge-based front end. Recognition differences between the two cylinder constructions depend on the training recipe and are confounded by their crop and canvas conventions. Rendered-cylinder tests show different responses to source tilt, but an uncalibrated rim-ratio proxy establishes no corresponding trend in recognition on real photographs. An author-confirmed audit of 50 residual errors identifies 21 query-enrollment appearance mismatches, without establishing an irreducible error rate. These results support geometric synthesis for the tested self-supervised recipe and a smaller benefit through frozen-feature adaptation of the text-supervised encoder.

[124] PulseQuant: Propagation-Guided Subspace Correction for 4-Bit Video Diffusion Transformers cs.CVPDF

Yutong Wang, Xingtong Ge, Enhuai Liu, Yunke Wang, Tianfan Xue

TL;DR: PulseQuant 为视频扩散 Transformer 设计 4 位后训练量化校准，利用误差沿去噪轨迹传播的敏感性以及激活子空间结构，减少局部量化误差最终造成的影响。

Details

Motivation: 量化误差可能被后续去噪更新放大或减弱，因此单层重建误差不能准确反映最终潜变量误差，直接按局部误差校准可能选错敏感状态。

Result: 在 Wan 模型、Self Forcing 和 MiniMax-H3 上，PulseQuant 改善关键一致性和稠密参考指标，并在其他生成属性上保持竞争力。受控干预显示，短期传播误差比即时模块输出误差更能预测最终潜变量误差；摘要未提供具体量化提升。

Insight: 轨迹敏感性用于优先校准关键状态的行尺度，随后在固定尺度下对主导激活方向做响应子空间校正。两阶段均保持原有 4 位权重表示，不改变权重位宽。

Abstract: Quantization errors in video diffusion transformers can be amplified or attenuated by subsequent denoising updates, making local reconstruction error an incomplete predictor of final impact. We introduce PulseQuant, a 4-bit post-training quantization method that combines trajectory sensitivity with activation geometry to guide offline calibration. Isolated block–step interventions estimate propagation risk, which prioritizes sensitive trajectory states during row-radius selection. With these radii fixed, response-subspace correction uses neighboring-code edits to reduce residual components along dominant activation directions. Both stages preserve the original 4-bit weight representation. Controlled interventions show that short-horizon propagated error predicts final latent error more reliably than immediate block-output error, supporting calibration beyond local reconstruction objectives. Evaluations on Wan models, Self Forcing, and MiniMax-H3 demonstrate improvements in key consistency and dense-reference metrics while remaining competitive on other attributes across model scales and generation paradigms.

[125] SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation cs.CVPDF

Jiali Chen, Zhengteng Lin, Zuqi Wang, Shirong Lin, Xi Yu

TL;DR: SciGen-Verifier 是面向科学图像生成的多模态可解释验证器，除判断结果正确与否，还输出支持理由和修正指令。

Details

Motivation: 电路图、几何构造或函数图像等科学视觉答案需要专业知识、结构推理和多步指令理解；现有验证器多面向自然图像且只输出标量分数，难以指出具体错误。

Result: 作者构建 SciGen-Verify 分层基准，并报告 SciGen-Verifier 在该基准上可与大得多的专有模型竞争；还可作为在线评审器支持迭代图像修正。摘要未提供具体分数。

Insight: 三层协议从二元判定延伸到支持性解释和纠正编辑指令；训练先冷启动 SFT，再用两阶段课程式强化学习，先鼓励科学推理探索，再用结果奖励对齐标注。

Abstract: In realistic education, a solution is often expressed not only in words but in a drawing–a circuit, a geometric construction, a function plot–and a teacher must grade the drawing as carefully as the text. Recent advances in unified multimodal models have enabled scientific image generation, yet verifying the correctness of these specialized visual outputs remains a critical bottleneck: errors often arise from intricate domain knowledge, structural reasoning, and multi-step instruction rather than surface-level artifacts. Existing verifiers mainly target natural images and compress judgement into scalar scores, leaving scientific coverage and explainable feedback for error correction underexplored. To bridge this gap, we make three main contributions. (1) We construct SciGen-Verify, a benchmark dedicated to explainable verification of scientific image generation, spanning instruction following, multidisciplinary reasoning, and world knowledge domains. It contains a three-tier hierarchical protocol over the binary judgement, supporting explanation, and corrective editing instruction. (2) We develop SciGen-Verifier, a reasoning-driven multimodal verifier trained via cold-start supervised fine-tuning followed by a curriculum-based two-stage reinforcement learning pipeline. The rubric-guided process rewards first strengthen scientific reasoning exploration and outcome rewards subsequently align output with ground-truth annotation. (3) On SciGen-Verify, SciGen-Verifier achieves competitive performance against much larger proprietary models. It further serves as a practical online critic for iterative image rectification.

[126] Groupwise Selective State-Space Filtering for Accurate and Streaming Action Boundary Detection cs.CVPDF

Mustafa Bora Çelik

TL;DR: 该工作提出基于分组选择性状态空间扫描的视频动作边界检测器，从预提取视频特征预测无类别标签的时间边界，并支持有状态流式推理。

Details

Motivation: 动作边界检测要把未剪辑视频切分成连续区间，但不为区间分配动作类别；边缘流式部署还需要避免依赖未来帧并控制内存。

Result: 在 Breakfast、GTEA 和 50Salads 上的边界 F1 分别为 0.457、0.622、0.611。流式版本零神经前瞻，仅用一个采样点确认峰值，并保持有界内存。原记录摘要在末句中途截断。

Insight: 模型以边界时间监督训练，通过分组特征融合和时间建模形成转移分数，再解码为时间戳；状态化版本适用于特征流输入。

Abstract: Action boundary detection partitions untrimmed video into intervals without assigning action classes. We present a boundary-detection adapter operating on pre-extracted video features, learning temporal representations via groupwise selective scans. Learned group fusion and temporal modeling convert these into transition scores, which are decoded into boundary timestamps. Trained with boundary-time supervision, the class-agnostic model is evaluated on Breakfast, GTEA, and 50Salads using temporal tolerances and bipartite matching, achieving boundary $F_1$ scores of 0.457, 0.622, and 0.611. A stateful variant enables feature-streaming inference with zero neural look-ahead, one-sample peak confirmation, and bounded memory. Downstream systems can subsequently assign s

[127] VaME: Exploring Variational Latent Reasoning for Multimodal Embeddings cs.CVPDF

Peixi Wu, Mingzhou Jiang, Feipeng Ma, Biao Yang, Yunhao Zhou

TL;DR: VaME 将多模态嵌入学习中的潜在推理建模为可学习轨迹分布，并通过语义解码奖励强化学习探索更有用的嵌入。

Details

Motivation: 检索嵌入需要保留跨模态、任务相关的紧凑语义；已有潜在推理方法多走确定性路径，未探索多个潜在轨迹以发现更优表示。

Result: 在覆盖图像、视频和视觉文档检索的 78 项 MMEB-V2 任务中，VaME 优于多数显式 CoT 模型和全部潜在推理基线；在推理密集型 MRMR 上也表现稳健，强化学习后增益显著。相较确定性潜在自回归基线，推理至少快 4.25 倍。

Insight: 变分潜在推理通过轻量解码器的答案重建指导自回归探索，再将潜在融合嵌入加入表示读出；强化学习在随机潜在轨迹上优化语义解码奖励，使偏好的轨迹具有可解释解码结果。

Abstract: Universal multimodal retrieval requires compact embeddings that preserve task-relevant semantic information across diverse modalities. Prior works have incorporated latent reasoning into multimodal embedding learning to refine this information before embedding extraction. However, most existing approaches remain confined to deterministic latent paths, without exploring alternative trajectories to discover better embeddings. Thus, we propose VaME (Variational Multimodal Embeddings), a framework that models latent reasoning as a learnable distribution over trajectories. Specifically, we first introduce Variational Latent Reasoning (VLR) to enable autoregressive exploration in latent space, guided by answer reconstruction through a lightweight decoder. Meanwhile, we augment the original embedding-token readout with a latent-fused embedding to facilitate exploration during subsequent reinforcement learning. Finally, we optimize latent reasoning over stochastic variational trajectories through reinforcement learning, using Semantic Decoding Reward (SDR) to favor semantically meaningful trajectories with interpretable decoded outcomes. On the 78-task MMEB-V2 benchmark, spanning image, video, and visual-document retrieval, VaME outperforms most explicit CoT-based models and all latent-reasoning baselines. VaME also demonstrates robust performance on reasoning-intensive benchmarks such as MRMR, with substantial gains after reinforcement learning. Importantly, VaME achieves these gains with at least a 4.25x inference speedup over the deterministic latent autoregressive baselines. The code will be made publicly available.

[128] Resolving State-Representation Mismatch: State-Space Visual Reasoning for Open-Loop VLA Planning cs.CV | cs.AIPDF

Junhao Xiao, Haoxiang Zhao, Menghao Fang, Jinkui Zhang, Jinghan Yu

TL;DR: SSVR 将 VLA 开环规划中的静态视觉—语言上下文与随动作递归更新的潜在状态分开表示，避免文本、像素或一次性潜在预测造成状态压缩和误差累积。

Details

Motivation: 开环规划只给初始观察，模型需内部模拟动作条件的状态转移；现有文本、像素和潜在空间推理分别可能损失空间关系、产生视觉生成误差或绕过中间潜变量。

Result: 以 Qwen2.5-VL 为骨干，FrozenLake、Maze、MiniBehavior 的 EM/PR 分别为 99.5/99.6、96.3/98.0、83.9/90.6，显著优于先前方法。预建前缀缓存后，Maze 解码 rollout 最多比受评基线快 98.58 倍。

Insight: 模型只编码一次初始图像和指令，后续每步动作由潜状态条件化，并用动作条件 GRU 更新该状态；复用静态视觉文本上下文、只递归更新紧凑状态支持高效多步推理。

Abstract: Despite rapid progress in vision-language-action (VLA) models, existing reasoning paradigms still face a fundamental \emph{state-representation mismatch} in open-loop planning. Given only an initial observation, models must internally simulate action-conditioned state transitions, whereas text-, pixel-, and latent-space reasoning can suffer from lossy spatial compression, error-accumulating visual generation, and bypass of intermediate latent tokens, respectively, undermining reliable long-horizon planning. We propose \textbf{State-Space Visual Reasoning} (SSVR), which decouples static visual context, language constraints, and a recurrent latent state. SSVR encodes the initial image and instruction once, then conditions each action prediction on the latent state and updates it with an action-conditioned GRU. Using Qwen2.5-VL as the backbone, SSVR achieves 99.5/99.6, 96.3/98.0, and 83.9/90.6 EM/PR on FrozenLake, Maze, and MiniBehavior, substantially outperforming prior methods. Extensive experiments support the effectiveness of recurrent state modeling for VLA open-loop planning across input transformations and transfer settings. By reusing static visual-textual context and updating a compact recurrent state, SSVR supports efficient multi-step inference, achieving up to $98.58\times$ faster Maze decoding rollouts than the evaluated baselines with the prefix cache prebuilt.

[129] TTRSD: Test-Time Reinforcement Learning with Self-Distillation for Vision-Language Models cs.CV | cs.AIPDF

Shuning Wang, Zhiheng Wu, Xun Zhou, Chongyang Cui, Chen Jia

TL;DR: TTRSD 在无标签测试样本上结合多视图答案自蒸馏与视觉敏感 token 选择，通过强化学习适配 VLM，同时把更新限制在真正依赖图像的推理位置。

Details

Motivation: 固定视觉条件下反复采样可能强化共同感知错误；序列级奖励又无法定位视觉感知瓶颈，可能损害预训练推理能力。

Result: 仅用 20 个无标签适配样本，TTRSD 在三个 VLM、七个基准上均改善表现。InternVL3-2B 的 MMMU 准确率从 35.79% 升至 49.32%，提高 13.53 个百分点，并展示跨数据集泛化且保持原有推理能力。

Insight: 共享策略汇总原图、裁剪和下采样视图的教师式答案分布，再以该分布支持学生原图回答作为奖励；视觉敏感位置通过相同生成 token 在原图与视觉遮蔽输入下的对数概率差识别，更新方向与更新位置分别由组相对优势和视觉敏感度决定。无需标签、外部验证器或独立教师。

Abstract: Test-time reinforcement learning enables vision-language models (VLMs) to adapt using unlabeled inputs. However, repeated sampling under fixed visual conditions can reinforce shared perceptual errors, while sequence-level rewards fail to isolate visual perception the foundational bottleneck that anchors multimodal reasoning risking the degradation of pre-trained reasoning capabilities. We propose TTRSD, a test-time reinforcement learning framework combining multi-view answer-level self-distillation with visual contrastive token selection. A shared policy aggregates teacher predictions across original, cropped, and downsampled views into an answer distribution. Student trajectories generated from the original image receive rewards based on the support for their final answers in this distribution. To allocate this feedback precisely toward perceptual bottlenecks, we compare the log-probabilities of the same sampled tokens under original and visually ablated inputs while holding their textual prefixes fixed, selecting visually sensitive positions for policy-gradient updates. TTRSD separates update direction, determined by group-relative advantages, from update position, determined by visual sensitivity, without requiring ground-truth labels, external verifiers, or a separate teacher. With only 20 unlabeled adaptation samples, TTRSD improves performance across seven benchmarks and three VLMs, raising InternVL3-2B’s MMMU accuracy from 35.79% to 49.32%(+13.53%), demonstrating cross-dataset generalization while preserving inherent reasoning integrity.

[130] TT-VidT: Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining cs.CVPDF

Shih-Ying Yeh, Daniel Z. Kaplan, Xuehai Wang, Fu-En Yang, Min-Hung Chen

TL;DR: TT-VidT 通过解耦每帧空间编码与紧凑时间迁移层，学习强调运动变化、同时保留有用外观信息的视频自监督表示。

Details

Motivation: 视频自监督方法的比较常同时改变架构、目标、数据曝光量、训练日程、规模和解码器，难判断哪些选择真正产生运动优先表示。

Result: 作者在约 170M–190M 参数编码器规模、约 170 万条 OpenVid 与 Moments-in-Time v2 片段、8 个 epoch 下进行 4×6 共 24 种架构—目标受控实验。TT-VidT 在 Jester、Something-Something V2、ARID、Diving48 微调同时领先，较最强非 TT 配置高 54%–121%，编码器 FLOPs 比 DisMo 少 48%、比 VideoMAE 或 V-JEPA2 少 55%。HMDB51、IARD 和 EPIC-Kitchens 的结果用于界定结论范围。

Insight: 关键收益来自 TT3D 与 Diff Compression 组合，单独使用其中任一项并不能进入最强运动敏感区间；消融也显示紧凑的视频预训练解码器更合适。统一训练配方有助将表示质量与规模、计算量区分开。

Abstract: Comparisons in video self-supervised learning often evaluate complete training recipes rather than isolating the method itself: architecture, objective, data exposure, schedule, scale, and decoder capacity can all vary at once. This makes it hard to identify which choices yield motion-prioritized representations, whose gains concentrate on frame-to-frame change while retaining useful appearance. We address this with a matched $4 \times 6 = 24$ architecture-objective study at roughly 170M ~ 190M encoder scale on $\sim$1.7M OpenVid and Moments-in-Time v2 clips for 8 epochs, and propose TT-VidT. TT-VidT combines a DINOv3-initialized ViT-B/16 per-frame spatial path with a compact Temporal Transfer Layer, trained by Diff Compression to reconstruct target frames from a first-frame appearance anchor and frame-specific motion tokens. The sweep shows that TT3D with Diff Compression, not either component alone, enters the strongest motion-sensitive regime, and decoder ablations favor a compact video-pretrained decoder. In final comparison, TT-VidT leads Jester, Something-Something V2, ARID, and Diving48 fine-tuning simultaneously, improving over the strongest non-TT row by 54% ~ 121%, while using 48% fewer encoder FLOPs than DisMo and 55% fewer than VideoMAE or V-JEPA2. HMDB51, IARD, and EPIC-Kitchens bound the claim.

[131] TC-ADA: One-Shot Active Domain Adaptation for Semantic Segmentation cs.CV | cs.ROPDF

Weihao Yan, Yeqiang Qian, Yueyuan Li, Tao Li, Chunxiang Wang

TL;DR: TC-ADA 将驾驶语义分割的主动域适配限定为一次性选取少量目标图像并密集标注，再结合源域、已标注目标域和未标注目标域进行适配。

Details

Motivation: 新驾驶环境部署时，密集像素标注成本高；既有主动域适配多需反复采样、标注和重训，现实流程可能更适合一次性决定标注预算。

Result: 在五种合成到真实及真实到真实迁移上，TC-ADA 持续优于代表性主动域适配基线。四种迁移只需 23–46 张目标图像标注，Mapillary 使用 140 张，性能距目标域全监督不超过 1.9 mIoU 点。

Insight: 第一阶段以视觉基础模型表征和固定无监督域适配模型预测选取代表性、有信息量的整图，不使用目标标签；第二阶段联合使用有标注源域、少量标注目标域和其余无标注目标域，并按目标域标注稀缺程度校准源、目标监督。

Abstract: Manual dense annotation remains a major obstacle to deploying semantic segmentation models in new driving environments. Active domain adaptation (ADA) seeks label-efficient transfer by annotating only a selected portion of the target domain. Existing ADA methods commonly implement this process through multiple rounds of acquisition, annotation, and retraining. We study a practical one-shot image-level setting that selects and densely annotates a fixed target subset in a single round, followed by uninterrupted adaptation. Within this setting, we develop Target-Calibrated Active Domain Adaptation (TC-ADA) as a joint design of complete-image acquisition and target-calibrated adaptation. Stage1 uses visual representations from a vision foundation model (VFM) together with semantic predictions from a fixed unsupervised domain adaptation model to select representative and informative target images without target annotations. Stage2 jointly uses labeled source data, labeled target data, and the remaining unlabeled target data, while calibrating source and target supervision under limited target labels. Extensive experiments across five synthetic-to-real and real-to-real driving transfers show consistent improvements over representative ADA baselines. With only 23 to 46 labeled target images on four transfers and 140 on Mapillary, TC-ADA stays within 1.9 mean intersection over union (mIoU) points of target-only full supervision. Code will be available at https://github.com/ywher/TC-ADA.

[132] A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations cs.CV | cs.LGPDF

Yoav Evron, Michal Bar-Asher Siegal, Michael Fire

TL;DR: 该工作构建历史手稿插图分类数据集并比较现代视觉模型，发现经过微调的图像分类器优于零样本 CLIP 和直接视觉语言分类。

Details

Motivation: 数字化手稿中包含人物、动物、植物、图表、乐谱和装饰纹样，但缺少有意义的类别使大规模收藏难以搜索；历史图像风格多变、退化严重且类别语义可能重叠。

Result: 数据集包含数百年前手稿中的 15,000 张人工标注插图、22 个类别。ConvNeXt 微调分类器最高准确率为 88.9%、Macro-F1 为 81.3%；CLIP 嵌入加 XGBoost 是较强替代方案，而零样本 CLIP 和直接 VLM 分类明显较差。

Insight: 部分错误反映类别间真实语义重叠，而非纯粹模型能力不足，说明分类体系本身也可能限制上限。

Abstract: Historical manuscript illustrations preserve rich visual evidence of past cultures. They depict people, animals, plants, diagrams, music notations, and decorative forms. Although large digitization projects have made many manuscripts available online, the material itself remains difficult to explore at scale. Extraction systems can find illustrations on manuscript pages, but without meaningful categories, large collections remain hard to search and explore. We address this gap by introducing a manually labeled dataset of 15,000 illustrations from manuscripts dating back hundreds of years across 22 categories, and evaluating modern vision models for image classification on this task. The problem is challenging due to stylistic diversity, degradation, and semantic ambiguity, with many images that fit more than one category. We compare fine-tuned CNN and Transformer-based classifiers, zero-shot CLIP, embedding-based classifiers, and direct vision-language models. Results show that fine-tuned image classifiers perform best overall, with ConvNeXt reaching 88.9% accuracy and 81.3% macro-F1. Using CLIP embeddings with XGBoost provides a strong alternative. In contrast, zero-shot CLIP and direct vision-language classification perform substantially worse, highlighting the limits of general-purpose models in this domain. Beyond overall performance, the analysis reveals which categories are visually separable and where errors reflect genuine semantic overlap, suggesting that some limitations arise from the taxonomy itself.

[133] Native Association: Confidence-Aware Human Perception in the Wild with a Foundation VLM cs.CVPDF

Igal Dmitriev, Ofir Liba

TL;DR: 该研究用单次语法约束序列输出绑定体育转播画面中每个人的队伍、号码等属性，避免把检测、OCR 与分类器结果拼接时发生身份错配。

Details

Motivation: 传统流程分别检测人物、读号码和分类队伍，再事后关联；遮挡时常把识别正确的号码绑定到错误球员，且不确定结果缺少拒识机制。

Result: 0.77B Florence-2 微调模型在多运动冻结测试集上检测 F1 为 0.95，高于受测 API 的 0.65–0.75；残余错配率约 0.057，约为零样本前沿 API 的四分之一（0.21–0.24）。额外一次前向可按字段估计置信度，使半覆盖时球衣号精确率从 0.71 提至 0.96；在 WIDER-Attribute 上取得给定框 mAP 93.1、端到端 mAP 84.5。

Insight: 把每人属性生成在该人的受约束字段块内，使输出天然结构化，不需要后处理绑定。作者发现学会语法后，所测参数高效微调没有可测增益，表明主要收益来自输出结构而非继续增加权重。

Abstract: Extracting who is where, on which team, wearing which number from a broadcast frame is typically done by stitching a detector, an OCR engine, and classifiers together – and the stitching step swaps identities under occlusion. We make association native instead: a 0.77B vision-language model (Florence-2) is fine-tuned to emit all per-person attributes as one grammar-constrained sequence, with each attribute generated inside its owner’s block. Output is therefore schema-valid on every frame by construction, and no post-hoc binding step exists to attach a correctly read number to the wrong player: residual misassociation is pure perception error, $\approx4\times$ rarer than zero-shot-prompted frontier APIs’ (0.057 vs. 0.21-0.24). On a frozen multi-sport test set, this single pass reaches 0.95 detection F1 (APIs: 0.65-0.75). A single extra forward pass yields a per-field confidence that supports a reject option (jersey precision $0.71\rightarrow0.96$ at half coverage) and routes a training-free zoom-and-re-read for small players. Surprisingly, once the grammar is learned, further parameter-efficient tuning yields no measurable gain under the adaptation configurations we test; the identical recipe on WIDER-Attribute reaches 93.1 mAP given-box, yields the first detection-coupled end-to-end results under its standard test protocol (84.5 mAP), and reproduces the same tuning result. In this regime, the gains live in the structure, not in added weights.

[134] SphMind: Towards Robust, Training-Free VLM-based Spatial Reasoning with a 360 Camera cs.CVPDF

Shriram Damodaran, Soumyaratna Debnath, Cheston Tan, Lin Wang

TL;DR: SphMind 是无需训练的全景空间推理框架，将语义识别留给 MLLM，把球面几何关系建模和对齐放在外部处理。

Details

Motivation: 360° 相机为具身代理提供宽视野，但普通 MLLM 多在透视图上训练，难处理球面畸变和跨边界环绕；直接微调以适应非欧几里得空间成本高。

Result: 在三个基准上，SphMind 在 MP3D 和 Stanford2D-3D 的方向推理平均提升超过 21.4%，在真实 ODI-Bench 上比提示工程基线高 8.7%，全景旋转下旋转不变性改善 5.9%，无需额外训练或数据集专项调参。真实场景评估中，方法也答对了基线 VLM 失败的方向问题。

Insight: 球谐空间图用球面等变变换表示空间关系，推理时几何 grounding 闭环则把 MLLM 表征与球面约束对齐；将语义与几何职责解耦可保留原有语言视觉能力。

Abstract: Omnidirectional or 360 cameras provide embodied AI agents with a holistic, wide field-of-view (FoV) view of their surroundings, motivating the use of Multi-modal Large Language Models (MLLMs) for omnidirectional spatial reasoning. However, most MLLMs are trained on conventional 2D perspective images and struggle with the severe distortions and wrap-around discontinuities induced by spherical geometry. Enabling them to generalize to non-Euclidean 3D spaces without retraining therefore remains challenging. We propose SphMind, a training-free, plug-and-play framework that decouples semantic perception from geometric reasoning. Rather than requiring MLLMs to learn spherical geometry internally, SphMind preserves their semantic capabilities while handling geometry externally. We introduce a Spherical Harmonics-based Spatial Graph (SHSG) that models spatial relationships through equivariant transformations on the sphere, together with Inference-Time Geometric Grounding (IGG), a model-agnostic closed-loop optimization process that aligns MLLM representations with spherical geometric constraints during inference. Experiments on three benchmarks show that SphMind achieves over 21.4% average improvement in directional reasoning on MP3D and Stanford2D-3D, outperforms prompt-engineering baselines by 8.7% on the real-world ODI-Bench, and improves rotational invariance by 5.9% under panorama rotations, without additional training or dataset-specific tuning. In-the-wild evaluations further show that SphMind resolves directional reasoning queries that baseline vision-language models fail to answer correctly.

[135] SceneScaffold: Active Scene-State Construction for Unified 3D Scene Understanding cs.CVPDF

Xiangqi Li, Libo Huang, Jiarui Zhao, Weilun Feng, Chuanguang Yang

TL;DR: SceneScaffold 将 3D 多模态模型的视觉瓶颈从被动压缩转为主动组织，在语言推理前构造带角色的场景状态与空间关系表示。

Details

Motivation: 现有 3D-LMM 将异质场景证据压成同质的对象 token 序列，容易丢失空间组织，迫使语言模型从扁平序列恢复关系，在关系密集或空间歧义场景中推理不稳定。

Result: 在统一 3D 场景理解任务中，包括 3D 指代定位、问答和稠密描述，实验验证 SceneScaffold 的有效性；诊断结果也显示其适用于关系密集与空间歧义场景。摘要未提供量化结果。

Insight: 框架将超点级证据组织为实体状态、场景坐标/区域锚点、物体—环境关系状态和全局摘要，使核心语义、空间参照、关系线索及紧凑上下文在送入 LLM 前各有明确结构角色。

Abstract: Recent 3D large multimodal models (3D-LMMs) rely on a visual bottleneck to compress complex 3D scene evidence into a limited number of visual tokens compatible with large language models (LLMs). Current visual bottlenecks, however, often passively compress heterogeneous 3D evidence into a homogeneous object-centric token sequence, leaving the spatial organization of the scene under-represented. This under-representation forces the LLM to recover spatial relations from a flattened token sequence, leading to unstable reasoning in relation-intensive and spatially ambiguous scenes. To address this issue, we propose SceneScaffold, an active scene-state construction framework for unified 3D scene understanding. SceneScaffold reformulates the visual bottleneck from a passive feature compressor into an active scene organizer, constructing a role-aware spatial scaffold before language reasoning. Specifically, SceneScaffold organizes superpoint-level visual evidence into scene-state components with distinct structural roles: entity states preserve core object semantics, scene-frame states maintain spatial references via boundary and region anchors, relation states encode object-environment interaction cues, and a global summary provides compact context. Through this role-aware construction, SceneScaffold provides the LLM with a spatially organized scene representation before language reasoning. Experiments on unified 3D scene understanding tasks, including 3D visual grounding, question answering, and dense captioning, demonstrate the effectiveness of SceneScaffold, while diagnostic results further show its applicability to relation-intensive and spatially ambiguous cases. Code is available at https://github.com/lixiangqi707/SceneScaffold.

[136] Anatomy-Structured Hierarchical MIL for Weakly-Supervised Thoracic Disease Detection in Chest X-rays cs.CVPDF

Jeongin Kim, Sohyun Ahn, Seo Young Kang, Jaeyi Sung, Soomin Kim

TL;DR: ASH-MIL 将心脏、肺部和通用观察分支与层次化多实例学习结合，从弱标签胸片中定位胸部疾病证据，无需病灶框监督。

Details

Motivation: 胸片异常表现细微且容易与复杂解剖结构重叠；既有解剖感知方法多依赖粗区域代理或静态先验，可能限制动态实例发现，尤其不利于小病灶定位。

Result: 在 CXR8 和跨域留出的 MIMIC-CXR 测试集上，ASH-MIL 相比既有弱监督和解剖感知方法持续改善，严格定位标准下优势尤其明显。摘要未提供具体指标。

Insight: 解剖先验作为软空间偏置加入解码器交叉注意力，产生有解剖依据的证据图；定位直接从 MIL 加权的注意力图获得，而非依赖疾病边界框标注。

Abstract: Weakly-supervised thoracic disease detection in chest X-rays (CXR) is challenging due to subtle appearances and complex anatomical overlap, motivating anatomy-aware modeling for improved localization. However, prior anatomy-aware methods typically rely on coarse region proxies or static spatial priors, which may restrict dynamic instance discovery and limit precise localization of small abnormalities. We propose Anatomy-Structured Hierarchical Multiple Instance Learning (ASH-MIL), a framework that introduces parallel anatomy-structured observation branches (cardiac, pulmonary, and agnostic) combined with hierarchical MIL aggregation. Anatomical priors are injected as soft spatial biases into decoder cross-attention, enabling anatomically grounded evidence maps without disease bounding-box supervision. Instance localization is derived directly from MIL-weighted cross-attention maps without bounding box supervision. Experiments on CXR8 and cross-domain MIMIC-CXR held-out sets demonstrate consistent improvements over prior weakly-supervised and anatomy-aware approaches, particularly under stricter localization criteria. Our code is available at https://github.com/jn-kim/ash-mil.

Kunhui Wang, Xintong Zhang, Junyu Gao, Changsheng Xu

TL;DR: ForeFly 为无人机视觉语言导航预测近程连续性和远程路线关键未来，以双时间尺度潜在世界模型辅助长轨迹指令跟随。

Details

Motivation: 现有空中导航方法多为反应式或只预测单一未来时域，忽略短期动作连续性与长期路线指导之间的互补信息。

Result: 在 TravelUAV 和 UAV-ON 上，ForeFly 在已见和未见设置中持续优于强基线，支持双时域预测和 FGAR 的有效性。摘要未给出具体成功率。

Insight: 不同时间视野的查询分别利用近期与路线关键视觉记忆；动作细化模块用近程预测改善局部动作，用路线关键预测作特征校正和全局引导，避免把两类预测信号简单合并。

Abstract: Aerial Vision-Language Navigation (AVLN) requires UAVs to maintain reliable instruction following over long trajectories in complex 3D environments. However, existing AVLN approaches are predominantly reactive or limited to single-horizon prediction, overlooking complementary future cues across different temporal horizons. To address this limitation, we propose ForeFly, a dual-horizon latent world action model that predicts both a proximal future for local continuity and an adaptive route-critical future for long-range guidance. Horizon-specific foresight queries are primed with recent and route-critical visual memories, providing history-aware context for future prediction. To exploit their distinct roles in action generation, we introduce Foresight-Guided Action Refinement (FGAR), which asymmetrically exploits proximal foresight for local action enhancement and route-critical foresight for feature-wise correction and route-level guidance. Experiments on the TravelUAV and UAV-ON benchmarks show that ForeFly consistently outperforms strong baselines across seen and unseen settings, validating the effectiveness of dual-horizon foresight and FGAR learning. The code is available at: https://github.com/kunhuiW/ForeFly

[138] IVT-Guard: All-in-One Reasoning Model for AI-Generated Content Detection cs.CVPDF

Hongwei Niu, Yunpeng Luo, Hanjun Li, Ziyin Zhou, Jianghang Lin

TL;DR: IVT-Guard 将图像、视频和文本 AIGC 检测与分层推理结合，通过证据—判定一致性训练缓解显式推理监督与检测准确率之间的冲突。

Details

Motivation: 多数 AIGC 检测器只覆盖单一模态、输出二元结论且不解释；多模态模型虽有潜力，却缺少推理训练数据，直接加入推理监督可能损害检测准确率。

Result: 作者构建 IVT-Set，包含超过 15.2 万张图像、视频和文本样本及多粒度 CoT 轨迹。IVT-Guard 在域内、域外和跨数据集设置中达到论文报告的最先进检测表现，同时生成忠实推理；摘要未给出具体分数。

Insight: 三阶段训练先做伪影感知预训练，再通过伪影注入进行证据监督微调，最后用证据—判定一致性 GRPO 对齐理由和结论。

Abstract: The rapid proliferation of highly realistic AI-Generated Content (AIGC) necessitates robust and interpretable detection mechanisms. However, existing detectors are predominantly confined to single modalities and provide binary outputs without reasoning. While Multimodal Large Language Models (MLLMs) present a promising solution, their development is constrained by the scarcity of multimodal reasoning data and the reasoning-detection optimization dilemma, where explicit reasoning supervision can compromise detection accuracy. To this end, we introduce IVT-Set, a comprehensive dataset comprising over 152K diverse image, video, and text samples equipped with multi-granularity Chain-of-Thought (CoT) reasoning trajectories. Based on it, we propose IVT-Guard, a pioneering framework for unified and interpretable AIGC detection across image, video, and text modalities. Furthermore, to overcome the aforementioned optimization dilemma, we design a novel three-stage training paradigm: Artifact-Aware Pre-training, Artifact-to-Evidence Supervised Fine-Tuning via artifact-aware injection, and Evidence-Verdict Consistency Group Relative Policy Optimization. Extensive experiments demonstrate that IVT-Guard achieves state-of-the-art detection performance across in-domain, out-of-domain, and cross-dataset settings while delivering faithful reasoning. Code and data will be released.

[139] ViCoR: Reliable Molecular Structure Extraction via Spatially Aligned Verification and Executable Revision cs.CV | cs.AIPDF

Yujian Yuan, Xin Cai, Yufan Chen, Jiaxin Xu, Mengdi Liu

TL;DR: ViCoR 在拒绝不确定结构之前先对化学结构识别结果进行迭代核验和局部修复，用图像坐标与分子图编辑的显式对应提高自动抽取可靠性。

Details

Motivation: 科学文献中的光学化学结构识别即使只有微小错误，也会污染化学数据库和下游模型；人工检查和修正成本高，纯拒绝策略则不能增加正确输出数量。

Result: 在两个真实 OCSR 基准上，ViCoR 将总体准确率分别从 73.53% 提升到 88.26%、从 61.83% 提升到 84.32%，并在 85%–89% 覆盖率下达到超过 97% 的接受样本准确率。所得数据还使反应抽取 F1 提高 15.5 点，文献反应预测准确率提高 7.7 和 5.8 点。

Insight: 坐标保持的渲染建立源图与预测结构间空间对应，索引锚定再把局部视觉差异映射成可执行分子图编辑，无需整体重新生成。共享 VLM 逐步从核验训练到修正训练。

Abstract: Reliable optical chemical structure recognition (OCSR) is essential for building high-quality chemical data from scientific literature, yet even small recognition errors can propagate into chemical databases and downstream models. In practice, recognized structures often require manual inspection and correction before use, making large-scale data curation costly and difficult to scale. We therefore study Selective Structure Recognition (SSR), a post-recognition setting that automatically produces reliable structured outputs while rejecting unresolved cases. Selection-only approaches can improve reliability by rejection, but cannot create additional correct outputs beyond those produced by the base recognizer. We propose ViCoR, a repair-before-rejection framework for iterative VerIfiCatiOn and Revision. Its key idea is to make observation-prediction correspondence explicit: coordinate-preserving rendering establishes spatial correspondence between the source image and predicted structure, while index anchoring maps localized visual discrepancies to executable graph edits without full-structure regeneration. A shared VLM is progressively trained from verification to revision. On two real-world OCSR benchmarks, ViCoR improves overall accuracy from 73.53% to 88.26% and from 61.83% to 84.32%, while achieving over 97% accepted accuracy at 85–89% coverage. The resulting molecular data further improve reaction-extraction F1 by 15.5 points and literature-sourced reaction prediction accuracy by 7.7 and 5.8 points, demonstrating the value of automated reliability control for scientific data curation and downstream chemical learning.

[140] SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning cs.CV | cs.AIPDF

Yang Cao, Jiaxin Zhang, Dave Zhenyu Chen, Yingji Zhong, Ruiyuan Gao

TL;DR: SpatialSpeak 先以问答形式预训练多视角局部几何与全局场景上下文，再监督空间思维链表达几何估计并据此推导答案。

Details

Motivation: VLM 可以从几何先验中获益，但只监督最终答案不会直接教模型如何估计中间几何量、如何把这些估计用于定量空间推理。

Result: 在 ReVSI 上，QA-RP 使 CoT-VC 的增益从 2.6 点升至 6.9 点。SpatialSpeak 在 ReVSI、VSI-Bench 和 SPAR-Bench 上达到最先进结果；ReVSI 得分 62.8，比最强对比基线高 8.7 点。

Insight: 第一阶段对标记点三维查询建模局部几何、对物体中心查询建模全局场景，两者都以问答形式输出，使几何估计和后续推理共享自回归接口；第二阶段加入视觉补偿与可靠性评估，答案不可靠时支持修正。

Abstract: Vision-language models (VLMs) can benefit from geometric priors for multi-view spatial reasoning, yet answer-only training does not directly supervise the intermediate geometric estimates and their use in deriving quantitative spatial answers. We hypothesize that spatial chain-of-thought (CoT) supervision becomes more effective when the VLM first jointly learns complementary local geometry and global scene context through multi-view reconstruction. We introduce SpatialSpeak, a two-stage framework that connects QA-native reconstruction pretraining with spatial CoT learning. In Stage I, QA-Native Reconstruction Pretraining (QA-RP) combines marked-point 3D queries for fine-grained local geometry with object-center queries for global scene context across views. Both tasks are formulated as text-based question answering, allowing geometric estimation and subsequent reasoning to share the same autoregressive output interface. In Stage II, spatial CoT with Visual Compensation (CoT-VC) trains the model to express question-relevant geometric estimates and use them to derive answers, with reliability assessment and visual compensation supporting answer refinement when needed. On ReVSI, QA-RP increases the gain from CoT-VC from 2.6 to 6.9 points, and ablations show that both local and global reconstruction supervision are beneficial. SpatialSpeak achieves state-of-the-art results on ReVSI, VSI-Bench, and SPAR-Bench, with a ReVSI score of 62.8 that exceeds the strongest compared baseline by 8.7 points.

[141] StoryEngine: A State-Grounded Agentic Framework for Video Storytelling cs.CV | cs.AIPDF

Yingrui Wang, Zeqing Wang, Yeying Jin

TL;DR: StoryEngine 在多镜头视频生成中维护权威语义计划和显式故事状态，把事件影响传播到后续镜头，并通过有限修复循环纠正局部视觉不一致。

Details

Motivation: 现有多镜头生成通常依赖文字镜头计划或先前生成像素，没有显式机制传播事件后果与跨镜头世界状态；遗漏细节可能被错误重建，局部视觉漂移也会逐镜头累积。

Result: 作者构建覆盖多场景和视觉风格的长篇视频叙事基准，并从故事质量、叙事连贯性和视觉一致性评估。StoryEngine 在各评估维度持续优于最先进方法；摘要未提供具体分数。

Insight: 实体位置与故事关键状态形成结构化表示，事件更新决定每个镜头的预期起止状态；反复出现的人物和环境建立规范参考，再将状态及视觉约束编译为可执行渲染计划。受界限的评估引导修复防止局部错误向后传播。

Abstract: Despite recent progress in agentic multi-shot video generation, producing coherent and consistent long-form stories remains challenging. Existing agentic pipelines typically rely on textual shot plans or previously generated pixels, yet lack an explicit mechanism for propagating the consequences of story events and maintaining the video world state across shots. As a result, missing visual details may be reconstructed inaccurately, while visual drift may propagate across subsequent shots, undermining both narrative coherence and visual consistency. To address these challenges, we propose StoryEngine, a state-grounded agentic framework for video storytelling. StoryEngine establishes a separation between authoritative semantic plans and unreliable visual observations. Specifically, StoryEngine maintains a structured representation of entity placement and story-relevant states, and propagates event-induced changes to define the intended start and end states of each shot. To visually realize these states, StoryEngine constructs canonical references for recurring entities and environments, and compiles state and visual constraints into executable render plans. Meanwhile, to realize these states correctly, a bounded evaluation-guided repair loop further corrects local state inconsistencies. Together, these mechanisms preserve causal story progression and prevent local visual errors from propagating across shots. To comprehensively evaluate long-form storytelling, we construct a benchmark across diverse scenarios and visual styles, with metrics assessing storytelling quality, narrative coherence, and visual consistency. Experimental results demonstrate that StoryEngine consistently outperforms state-of-the-art methods across all evaluation dimensions, validating its effectiveness for coherent and consistent video storytelling.

[142] Learning Multimodal Embeddings with Evidence-Aligned Readout cs.CV | cs.IRPDF

Zirong Chen, Fuda Ye, Enjun Du, Junfu Pu, Xinlei Wang

TL;DR: EviAlign 将多模态证据的语义单元边界用作嵌入读取位置，把证据生成和检索表示训练整合到同一个多模态语言模型。

Details

Motivation: 生成任务相关证据不代表这些证据会以合适方式进入检索嵌入；研究探讨证据的语义组织能否决定更有效的表示读取位置。

Result: 在控制证据片段数量的 2×3 实验中，五个读取状态采用相同均值池化时，一致语义组织相较置换组织的优势从按长度选位置的 0.65 点扩大到按证据边界选位置的 2.39 点，显示 1.74 点协同作用。在 12 个 MMEB 检索任务上，EviAlign 用 50 万训练对取得 Recall@1 平均 76.9，仍只需单向量索引和评分。

Insight: 模型把证据整理成五个语义单元，在每个单元边界读取上下文化状态并聚合为归一化向量；生成和对比检索目标联合训练。相同读取方案下，语义证据与自由形式 CoT 性能近似，说明完整收益需要边界读取与语义组织协同设计。

Abstract: Multimodal large language models can expose task-relevant evidence through generation, but producing useful evidence does not by itself determine how it enters a retrieval embedding. We study whether the semantic organization of that evidence can also specify where representations are read. To address this question, we introduce EviAlign, which couples Semantic Evidence Generation with Boundary Readout in a shared multimodal large language model. It organizes evidence into five semantic units, reads the contextualized state at each unit boundary, and aggregates these states into a single normalized embedding. Generation and contrastive retrieval objectives jointly train this shared structure. With the same trailing readout, semantic evidence and free-form CoT yield nearly identical retrieval performance, suggesting that evidence organization alone does not explain the full gain. A controlled $2\times3$ study compares consistent and permuted evidence organization across three readout strategies, using training targets with matched evidence spans. With five readout states and the same mean pooling, the advantage of consistent semantic organization grows from 0.65 points at length-based training positions to 2.39 at evidence boundaries, yielding a 1.74-point co-design interaction. Across 12 MMEB retrieval tasks, EviAlign achieves 76.9 average Recall@1 with 500K training pairs while retaining single-vector indexing and scoring.

[143] MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Tasks cs.CV | cs.CRPDF

Hao Chen

TL;DR: MAD-Guard 在匹配骨干、数据和 LoRA 预算下比较多模态取证任务的生成式判定与直接决策接口，发现低熵二分类任务可用直接输出显著降低延迟并改善校准。

Details

Motivation: 闭集取证任务输入复杂但输出类别少，完整词表投影和自回归解码可能带来不必要开销；需要明确区分哪些收益来自生成式语义先验、哪些来自多任务归因。

Result: Qwen3-VL-8B 在 FakeClue 2,400 样本实验中，二元直接头比 AR-SFT 快 2.60–7.27 倍，延迟约 53.12 ms，ECE 从 0.0845 降至 0.0450，准确率则从 94.90% 降至 93.10%。增加选择/行动归因和不确定性门控后准确率达 96.44%、ROC-AUC 0.9940、ECE 0.0187，延迟 53.71 ms；CLM-Head 以 54.42 ms 达二元准确率 96.55%、多任务准确率 96.44%、7 类归因 98.79%。压缩人脸篡改设置上 ROC-AUC 仅 0.5913。

Insight: 主要延迟来自词表投影和解码，直接头以少量准确率代价换取速度及校准；更好的结果来自多任务归因或解耦对比头保留语义先验，而非单纯选择生成或分类接口。评测也揭示不同伪造类型间存在明确能力边界。

Abstract: When should multimodal foundation models generate tokens, and when should they directly output a decision? We present MAD-Guard, a controlled study of output-decision interfaces for closed multimodal forensic tasks. Once a multimodal representation is computed, is autoregressive generation necessary for closed forensic decisions with high input complexity but low output entropy? Under a matched Qwen3-VL-8B backbone, 2,400 FakeClue training samples, and LoRA budget ($r=16, α=32$) on Huawei Ascend 910C NPUs, we evaluate a progression of decision interfaces (AR-SFT [generate] $\to$ Logit Slice $\to$ Binary Direct Head $\to$ +choice $\to$ +act $\to$ CLM-Head) and decompose latency into backbone representation (53.12 ms), 151,643-way vocabulary projection (+85.04 ms $\to$ 138.16 ms), and decoding (+248.26 ms $\to$ 386.42 ms). Under 1-to-1 binary supervision ($\mathcal{L}_{\mathrm{BCE}}$), a Binary Direct Head cuts latency by $2.60\times$-$7.27\times$ (53.12 ms) and lowers calibration error by $1.88\times$ (ECE = 0.0450 vs. 0.0845), with a -1.80% accuracy trade-off (93.10% vs. 94.90%; 0.9795 vs. 0.9871 ROC-AUC) from forfeiting token priors. Gains above AR-SFT arise either from multi-task attribution and uncertainty gating (+choice+act: 96.44% accuracy, 0.9940 ROC-AUC, 0.0187 ECE at 53.71 ms) or from a disaggregated contrastive head (CLM-Head: 96.55% binary and 96.44% multi-task accuracy, 0.0166 ECE, 98.79% 7-class attribution at 54.42 ms) retaining semantic priors without token decoding. Across 5,000 out-of-sample images from five benchmarks, our framework excels on synthetic, camouflage, and document forgeries (96.44% GenImage, 97.73% Chameleon, 91.84% Doc) while showing a clear boundary on compressed face manipulation (FF++ ROC-AUC = 0.5913).

[144] When Noise Meets Long-Tail: Feature-Threshold Dual Calibration for Robust Pseudo-Labeling cs.CV | cs.AIPDF

Ping Guo, Zhiqi Huang, Xinran Li

TL;DR: FTC-Seg 联合校准像素特征和类别阈值，打破强噪声与长尾分布下尾类伪标签持续被过滤、特征不断恶化的循环。

Details

Motivation: 图像噪声会混淆前景和背景特征、降低各类置信度；长尾类别样本少、本就置信偏低，在固定高阈值下会被系统性排除，因而无法从未标注数据获得监督。

Result: 在四个覆盖三种噪声类型的公开基准上，FTC-Seg 相较最先进方法取得较强表现，尾类提升尤其明显。摘要未提供具体指标。

Insight: 标准教师—学生框架中，正交原型重建用可学习正交原型净化像素特征、拉开弱前景与噪声背景；自适应阈值校准再根据学习难度和预测分布偏差按类调整阈值，拯救低置信尾类伪标签。联合处理噪声和类别不均衡比单独解决一项更关键。

Abstract: Pseudo-labeling has become a cornerstone of learning from unlabeled data in semantic segmentation. Yet its effectiveness drops sharply in real-world scenarios where strong imaging noise and long-tailed class distributions occur together. We trace this failure to a vicious cycle of pseudo-label degradation. Imaging noise entangles foreground and background features, lowering prediction confidence across all classes, while long-tailed distributions leave tail classes with far fewer training samples and inherently lower confidence. Under fixed high-threshold filtering, these tail-class predictions are systematically filtered out, so they receive no supervision from unlabeled data and thus features keep degrading in subsequent iterations. Critically, noise and long-tail are not independent obstacles but mutually amplifying ones, and addressing either alone is insufficient. To break this cycle, we propose FTC-Seg, a Feature-Threshold dual-Calibration framework built on a standard teacher-student framework. At the feature level, Orthogonal Prototype Reconstruction (OPR) uses a set of learnable orthogonal prototypes to residually purify pixel-wise features, widening the margin between weak foreground targets and noisy backgrounds. At the threshold level, Adaptive Threshold Calibration (ATC) dynamically adjusts class-specific thresholds based on learning difficulty and prediction-distribution bias, rescuing low-confidence pseudo-labels of tail classes from systematic exclusion. Extensive experiments on four public benchmarks spanning three distinct noise modalities show that FTC-Seg achieves strong performance against state-of-the-art methods, with particularly substantial gains on tail classes. Our results establish that jointly calibrating features and thresholds is essential for robust pseudo-labeling under compounded noise and class imbalance.

[145] Seeing and Solving Are Not Enough for Vision-Language Models cs.CVPDF

Ziheng Wang, Mingxuan Xie, Yilin Liu, Dayan Wu, Yang Li

TL;DR: 该研究把视觉问答错误拆分为视觉信息提取、基于信息求解及二者组合失败，发现提取和求解单独成功仍不保证模型能正确回答原始多模态问题。

Details

Motivation: 总体答案准确率无法解释模型为什么错；模型可能能读出必要图像信息，也能基于标准信息解题，但在原始图文问题中无法把两项能力组合起来。

Result: 跨多个 VLM 和视觉领域，组合失败占直接回答错误的 17.7%–75.6%。State Realization Tuning 在冻结预训练权重时微调语言层 LoRA，要求先生成任务所需视觉状态；比标准 SFT 高 1.7–14.1 个百分点，并修复 92.5%–98.1% 已诊断组合失败。单个 LoRA 也可迁移至结构不同的任务状态。

Insight: 评测通过标准任务状态分别测模型能否提取状态、能否用真值状态解题，以及能否直接回答原题，从而隔离能力组合缺口。显式先输出必要视觉信息为后续推理提供中间接口。

Abstract: Vision-language models (VLMs) answer visual questions by combining visual information extraction with downstream problem solving. We investigate a fundamental question: Does an incorrect answer necessarily reflect a failure in visual extraction or problem solving? A model may succeed at both abilities when tested separately yet still fail on the original multimodal question, a distinction that overall answer accuracy cannot reveal. To study this, we perform a question-level empirical analysis across multiple VLMs and visual domains. We define an exactly scorable task state (i.e., the visual information sufficient to solve a question) and use it to test whether the same model can extract the required state, solve the question from the ground-truth state, and answer the original multimodal question. We find that composition failures, where extraction and solving both succeed but direct answering fails, account for 17.7% to 75.6% of direct-answering errors across multiple VLMs and datasets. To address this failure mode, we introduce a simple yet effective method, termed State Realization Tuning (SRT). SRT fine-tunes LoRA adapters attached to the language-model layers while keeping the pretrained VLM weights frozen. It trains the model to output the ground-truth task state before the final answer in a single autoregressive response. SRT improves over standard supervised fine-tuning by 1.7 to 14.1 percentage points and repairs 92.5% to 98.1% of diagnosed composition failures. A single LoRA adapter trained with SRT also improves performance across substantially different task-state structures. Our work shows that having both visual extraction and problem-solving capabilities does not guarantee correct multimodal answering. Requiring the model to first output the visual information needed to solve the question can help bridge this gap.

[146] Prompt-Anchored Residual Adaptation for Biomedical Vision-Language Models cs.CV | cs.LGPDF

Jingxuan Kang, Qianying Yue, Che Liu, Chen Qin

TL;DR: PARA 在生物医学少样本分类中保留冻结提示预测作为支持集无关的语义锚点，并以支持图像预测相对锚点的残差进行适配。

Details

Motivation: 预训练生物医学 VLM 的零样本分类较强，但下游类别间细微视觉差异可能未被表示充分；少量支持样本只覆盖类内部分变化，适配结果会强烈依赖抽到哪些样本。

Result: PARA 在少样本分类与 base-to-novel 泛化上均达到论文报告的最先进结果。作者还提出重复支持集评估，分别报告平均表现和最差 20% 表现；摘要未给出具体数值。

Insight: 冻结提示预测提供稳定的语义锚，闭式残差由支持集嵌入、锚点差异及支持样本一致性计算。重复支持协议将支持样本抽样波动与优化随机性分开，避免只在单次有利支持集上比较。

Abstract: Pretrained biomedical vision-language models achieve strong zero-shot performance in biomedical image classification. However, downstream biomedical classification often depends on subtle visual differences between classes that may not be fully captured by pretrained representations. Few-shot adaptation addresses this mismatch by optimizing a task-specific predictor on a small labeled support set. Because the selected examples capture only part of the visual variation within the target classes, the adapted predictions can depend strongly on their composition. We propose Prompt-Anchored Residual Adaptation (PARA), which retains the frozen prompt prediction as a support-invariant semantic anchor and incorporates a visual prediction learned from the support set through an anchor-relative residual. The residual step is computed in a closed form from frozen support embeddings using anchor discrepancy and support agreement. Support-set dependence also limits evaluation: comparisons are fair within a shared draw but remain conditional on its composition. To obtain more reliable comparisons, we introduce a repeated-support protocol that separates support-selection variation from optimization randomness and reports both average and worst-20% performance. PARA achieves state-of-the-art performance in both few-shot classification and base-to-novel generalization.

[147] GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code cs.CVPDF

Haosen Li, Wenshuo Chen, Shaofeng Liang, Lei Wang, Bowen Tian

TL;DR: GeoShrink 是无需训练的生成模型加速方法，在保持原始求解器时间网格的情况下，只在指定锚点调用模型，并用几何递减的已观察创新预测跳过阶段输出。

Details

Motivation: 扩散模型沿采样轨迹重复评估网络，成本高；仅根据局部速度一致性选择跳步距离不足，逐个候选终点额外评估又会抵消加速收益。

Result: 约 5 倍加速下，GeoShrink 的 FLUX PSNR 比所列最强基线高 3.10 dB；HunyuanVideo 达到 4.99 倍加速，ChronoMagic-Bench-150 PSNR 比最强保真基线高 5.44 dB。图像、视频、动作、音频及适配后的 3D 生成固定评估预算比较也显示明显收益。

Insight: 跳过阶段时，将最近一次精确输出与按几何比例保留的最新创新相加作为求解器输出；该规则由弦切线运输和往返线投影推导。锚点间距原则在覆盖与首段固定时控制最大相邻间隔扩张，误差分析无需假设能访问未来模型输出。

Abstract: Diffusion transformers incur substantial inference cost through repeated model evaluations along a sampling trajectory. We introduce GeoShrink, a training-free acceleration method that retains the original solver grid while evaluating the model only at a prescribed set of anchors. At skipped stages, GeoShrink predicts the solver-facing output by adding a geometrically retained fraction of the latest observed innovation to the most recent exact output. We derive this rule from chordal tangent transport and round-trip line projection, and establish a geometric anchor-spacing principle that minimizes the largest adjacent gap expansion under fixed coverage and first span. The analysis characterizes the geometric closure and propagation of prediction errors without assuming access to future model outputs. Experiments cover image, video, motion, and audio generation, together with adapted 3D backends. At approximately $5\times$ acceleration, GeoShrink improves FLUX PSNR by 3.10 dB over the strongest listed baseline. On HunyuanVideo, it achieves a reported $4.99\times$ speedup and improves ChronoMagic-Bench-150 PSNR by 5.44 dB over the strongest listed fidelity baseline. Comparisons at fixed evaluation budgets further show substantial gains on motion, audio, music, and 3D generation.

[148] Eyes on the Road: A Naturalistic Comparison of MTW Rider Gaze in Urban Indian Traffic cs.CVPDF

Prerak Srivastava, Bhaiya Vaibhaw Kumar, Kavita Vemuri

TL;DR: 该研究基于 myEye2Wheeler 自然驾驶数据分析印度城市摩托车骑手的注视行为，发现中央视觉承担广域监测，直接注视承担短时选择性采样。

Details

Motivation: 机动车两轮车在印度道路中占主导，但驾驶员行为研究覆盖不足；需要在真实复杂交通中了解骑手如何分配视觉注意。

Result: 作者用 YOLOv11 与 SAM2 语义分割提取对象级注视指标。新手骑手以道路为锚点扫描，在注视物体之间返回道路；有经验骑手则形成更长的跨物体注意链。摘要未给出样本量或效应数值。

Insight: 经验主要细化注意力随时间的组织节奏，而不是彻底改变注意分配策略；经验增长还减弱了不同对象类别对注视模式的影响。

Abstract: Motorized two-wheelers (MTW) dominate Indian roads but remain underrepresented in driver behavior research. This study presents the first large-scale analysis of MTW driver gaze behavior in naturalistic, heterogeneous urban traffic, using the \textit{myEye2Wheeler} dataset. A semantic segmentation pipeline (YOLOv11 + SAM2) was used to extract object-level gaze metrics under two attention modes: direct gaze (foveal overlap) and central vision (parafoveal monitoring). Results reveal a functional division: central vision supports broad monitoring, while direct gaze enables brief, selective sampling. Novice riders exhibit road-anchored scanning, returning to the road between object fixations, while experienced riders form longer chains of attention across multiple objects. The findings suggest that experience primarily refines temporal rhythm rather than altering allocation strategy and reduces object-class effects in gaze patterns. These findings offer new insight into MTW attention structures and inform future work on behavior modeling and safety systems.

[149] Augmenting Visual Anomaly Detection with Automated Interpretability cs.CV | cs.AIPDF

Antonio De Santis, Arsenio Leo, Marco Brambilla

TL;DR: 该工作用多模态 LLM 为 PatchCore 异常特征自动标记异常、干扰或不确定，再抑制干扰特征、增强异常特征并重新评分。

Details

Motivation: 视觉异常检测器的异常分数可能混合真实异常证据和无害视觉变化，仅用整体分数难区分二者，也不利于跨噪声和采集变化保持鲁棒。

Result: 在四个基准的 40 个类别上，联合干预将源数据图像级 AUROC 从 0.8724 提升至 0.8857，合成腐蚀下从 0.8066 提升至 0.8210。另三个 RobustAD 类别的真实采集偏移中，源数据 AUROC 从 0.8745 提至 0.9056，真实偏移下从 0.6069 提至 0.6599。43 个类别上的逐特征干预也显示，MLLM 标签整体与特征对正常/异常图像的不同影响相符。

Insight: PatchCore 最近正常残差先经 SAE 分解，再将高激活与对比非激活样例交给 MLLM 描述和归类；按类别编辑 SAE 隐表示后重建 patch 嵌入并重新评分。解释标签不仅用于展示，而直接参与异常判别干预。

Abstract: Visual anomaly detectors identify deviations from known-normal data, but their anomaly signals may mix evidence of actual anomalies with benign visual variation. We investigate whether automated interpretability can augment visual anomaly detectors by identifying and intervening on different components of this signal. We decompose PatchCore nearest-normal residuals into sparse features using Sparse Autoencoders (SAEs), and provide high-activation and contrastive non-active examples to a Multimodal LLM, which describes each feature and labels it as anomaly, distractor, or uncertain. These labels guide interventions in the SAE hidden representation, where distractor features are suppressed and anomaly features amplified. The edited representation is then used to reconstruct patch embeddings, which are rescored with PatchCore. Across 40 categories from four benchmarks, applying both interventions jointly improves macro-average image-level AUROC from 0.8724 to 0.8857 on source data and from 0.8066 to 0.8210 under synthetic corruptions. On three additional RobustAD categories with real acquisition shifts, the same interventions improve AUROC from 0.8745 to 0.9056 on source data and from 0.6069 to 0.6599 under real acquisition shifts. Finally, individual feature interventions across all 43 categories show that the MLLM labels are aligned in aggregate with how features differently affect normal and anomalous images.

[150] M3-Score: Fidelity, Memorization and Coverage as Separate Axes for Evaluating Generative Radiology Image Models cs.CVPDF

Sathiyamohan Nishankar, Pubudu Sanjeewani, Asanka Perera

TL;DR: M3-Score 用放射学预训练的特征空间把生成放射图像评估拆成保真度、记忆和覆盖三轴，避免单一指标把图像质量差异与多样性不足混为一谈。

Details

Motivation: 放射学中的临床结构可能很小且少见，自然图像特征不适合表征；单个汇总指标也难区分生成结果保真度不足与真实分布覆盖不足。

Result: 在 BraTS 脑 MRI 上，保真度轴按严重度排序五个比较集合，Spearman ρ=1.00；受试者不相交真实集 MMD²=0（置换 p=1）。无条件 DDPM 的 MMD² 为 0.073（95% CI [0.071,0.080]），但只覆盖 38% 真实分布。逐步丢失模式时，kNN manifold recall 在 12 个编码器层均上升，而新覆盖估计量单调下降（ρ=-1.00）。RadioDINO 区分真实/生成脑 MRI 的 ROC-AUC 为 0.819，高于 InceptionV3 的 0.555 和 CLIP 的 0.582；跨 20 倍样本量变化时 M3 均值波动倍数 1.05，FID 为 2.52。

Insight: 评测在预先指定编码器深度上分别用 MMD²、最近邻距离和真实样本邻域覆盖计算保真、记忆与覆盖；参考集按受试者抽样，降低相关切片影响。分轴报告能揭示看似保真的生成器仍可能遗漏多数真实分布。

Abstract: Quantitative evaluation of generative models for radiology remains challenging. Clinically relevant structures are often small and infrequent, feature spaces learned from natural images may represent them poorly, and a single summary score cannot distinguish limited fidelity from limited diversity. This study proposes the Medical Multi-axis Maximum Mean Discrepancy score (M3-Score), an evaluation framework based on RadioDINO-s16, a frozen vision transformer pretrained on radiology images. M3-Score reports three complementary axes computed at pre-specified encoder depths: \emph{fidelity}, measured by an unbiased multi-bandwidth radial basis function (RBF) MMD$^2$ at the final block; \emph{memorization}, measured by nearest-neighbor distances at 75% depth; and \emph{coverage}, defined as the fraction of real images with a generated neighbor within their $k$-nearest-neighbor radius at 33% depth. Reference sets are sampled across subjects to limit the influence of correlated slices. On BraTS brain MRI, the fidelity axis ordered five comparison sets of increasing severity (Spearman $ρ= 1.00$), and a subject-disjoint real set yielded $\mathrm{MMD}^2 = 0$ (permutation $p = 1$). An unconditional denoising diffusion probabilistic model achieved $\mathrm{MMD}^2 = 0.073$ (95% confidence interval $[0.071, 0.080]$) but covered only 38% of the real distribution. Under progressive mode dropping, $k$-NN manifold recall increased at all twelve encoder blocks, whereas the proposed coverage estimator decreased monotonically ($ρ= -1.00$). RadioDINO-s16 features separated real brain MRI from generated samples with a ROC-AUC of 0.819, compared with 0.555 for InceptionV3 and 0.582 for CLIP. Across a twentyfold range of sample sizes, the mean M3 value varied by a factor of 1.05, compared with 2.52 for the Fréchet Inception Distance.

[151] One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs cs.CV | cs.LGPDF

Sen Nie, Jie Zhang, Zhongqi Wang, Shiguang Shan, Xilin Chen

TL;DR: O-Attack 研究一张对抗图像能否在黑盒条件下迁移误导多种前沿多模态模型，并以跨模态语义表示一致性提高不同模型间攻击效果的一致性。

Details

Motivation: MLLM 广泛部署后，评估其对黑盒对抗输入的脆弱性对安全使用至关重要；已有攻击可能只对单一模型或提示有效。

Result: 相较 M-Attack，O-Attack 在 GPT-5.4 的攻击成功率从 29.1% 提至 77.2%，Claude-4.6 从 42.8% 提至 81.6%，Gemini-3.1 从 38.2% 提至 80.9%。跨 24 个 MLLM 的实验中，作者报告其优于六种先进方法，并在不同提示下保持效果及提升效率和隐蔽性。

Insight: 方法利用替代模型中跨模态对齐、超越最终层的高层语义表示，通过逐步扩展语义条件形成共同目标对齐。该研究强调黑盒多模态系统的实际安全风险与鲁棒性评估需求；此处仅概述其评测结论。

Abstract: Adversarial attacks have long posed a fundamental threat to machine learning systems. As multimodal large language models (MLLMs) rapidly evolve and become widely deployed, assessing their vulnerability to such attacks is essential for their safe use. In this work, we investigate whether a single adversarial image can consistently mislead diverse frontier MLLMs in black-box settings. We propose O-Attack, a highly transferable black-box attack framework. This framework builds on our insight that surrogate models contain a broad, high-level, cross-modally aligned semantic space. This space extends beyond final-layer outputs and provides multiple semantically consistent representations that remain underexploited by existing attacks. Within this space, O-Attack anchors aligned representations, progressively broadens semantic conditions, and optimizes perturbations through semantic consensus to promote consistent target alignment. By fully exploiting this space with the same surrogate models as M-Attack, O-Attack raises attack success rates on GPT-5.4 (29.1% to 77.2%), Claude-4.6 (42.8% to 81.6%), and Gemini-3.1 (38.2% to 80.9%). Extensive experiments across 24 MLLMs show that O-Attack outperforms six state-of-the-art methods in black-box transferability, with consistent effectiveness across prompts and improved efficiency and imperceptibility. This work exposes the practical safety risks posed by black-box adversarial attacks against frontier MLLMs, underscoring the need for more rigorous robustness evaluation and more effective defenses.

[152] ReDrive: Shaping Representations with World Modeling for End-to-End Driving cs.CVPDF

Yueting Zhu, Shaoyu Chen, Yuehao Song, Hui Sun, Qian Zhang

TL;DR: ReDrive 用未来表征预测强化规划导向视觉特征，在不依赖推理时额外感知模块或未来预测的情况下实现端到端驾驶规划。

Details

Motivation: 端到端驾驶需要同时理解当前场景并预测未来变化；现有方案常构建复杂感知—规划流水线或在推理时增加世界模型，增加系统复杂度。

Result: 在 NAVSIM v1 上，ReDrive 达到 91.0 PDMS；在 NAVSIM v2 上达到 90.8 EPDMS。结果表明，以世界模型塑造表示可支持高性能规划，同时维持简单的编码器—规划器推理结构。

Insight: 三阶段训练依次进行驾驶视频预训练、世界建模与规划联合训练、规划器适配；未来状态预测用于训练期强化表示，部署时无需预测未来或运行辅助感知模块。

Abstract: Driving policies require capabilities of scene understanding and future evolution prediction. To achieve this goal, current end-to-end models typically construct complex perception-planning pipelines or introduce world models that explicitly predict future states, resulting in a complex system architecture. Inspired by the transferability of general-purpose visual representations, we argue that combining sufficiently strong visual representations with representation world modeling can support effective planning without relying on complex inference-time auxiliary modules. Based on this insight, we present ReDrive, an end-to-end driving framework that strengthens planning-oriented visual features via future representation prediction. To achieve this, ReDrive adopts a three-stage training pipeline consisting of driving video pretraining, joint world-modeling and planning training, and planner adaptation. This yields a strong planning-oriented representation and a high-performance planner, while requiring neither auxiliary perception modules nor future prediction at inference time. Experiments on NAVSIM demonstrate strong performance, achieving 91.0 PDMS on NAVSIM v1 and 90.8 EPDMS on NAVSIM v2. These results show that shaping representations with world modeling is sufficient to enable high-performance end-to-end planning while retaining a simple encoder-planner inference pipeline.

[153] Program-Verified Self-Evolution for Vision-Language Models cs.CV | cs.AI | cs.CL | cs.LG | cs.NEPDF

Ahmed Heakl, Sungik Choi, Moontae Lee, Salman Khan

TL;DR: VQS 通过“先解析成结构记录，再由程序生成问题和答案”提高无标签图像自进化训练的伪标签可靠性，减少多数投票或模型裁判标签错误。

Details

Motivation: 自进化 VLM 需从无标签图像生成问答，但多数投票和模型评判标签分别有 24% 和 18% 错误，可能把错误监督带入模型。

Result: 人工评价认为 VQS 生成的答案 94% 正确，高于多数投票的 76%。在十个基准上，VQS 使 Qwen3-VL 在 2B、4B、8B 规模最高提升 3.18 点，并超过各规模最强自进化基线；2B 连续三轮训练的收益达到 3.84 点。

Insight: 模型先把图像解析为场景图、图表表格或图示图等结构记录，固定程序再据此生成问题并计算答案；VLM 只逐条核验程序读取的简短事实。核验结果筛选解析器训练目标，使解析器也能在无人工标签下逐步改善。

Abstract: Self-evolving vision-language models train on questions they generate from unlabeled images. Since these questions have no gold answers, prior methods label them by majority vote over sampled answers or by a model judge. In a human evaluation, we find that 24% of majority-vote labels and 18% of model-judge labels produced during self-evolution are wrong. To address this problem, we present Verifiable QA Generation for Self-Evolving Models (VQS), which changes how the model judges answers. Instead of voting on an answer, the model parses each image into a structured record, such as a scene graph, a chart table, or a diagram graph. Fixed programs then write a question from the record and compute its answer. The model still acts as a visual checker, but it only confirms the individual facts the program reads, one short claim at a time. These claim-level checks select the parser’s training targets, so the parser also improves without labels. Human raters find 94% of VQS answers correct, against 76% for majority voting. Across ten benchmarks, VQS improves Qwen3-VL by up to 3.18 points at the 2B, 4B, and 8B scales and outperforms the strongest self-evolving baseline at each. Gains keep growing over three training rounds, reaching 3.84 points at 2B. Code is released at https://github.com/ahmedheakl/VQS

[154] Video, Ergo Genero: Unifying Video Tasks via Spatiotemporal Analogy cs.CV | cs.AIPDF

Chia-Hsiang Kao, Belinda Zeng, Bharath Hariharan, Menglin Jia

TL;DR: ViGeo 将视觉类比扩展到视频，通过时空画布补全实现免训练任务适配，并评估对未见视频操作和零样本新模态的泛化。

Details

Motivation: 适配视频模型到新任务常需专门数据整理和微调；图像域的视觉类比虽可通过上下文示例指定任务，但此前未覆盖视频。

Result: 在严格训练—测试划分和多样任务分类上，ViGeo 能泛化到未见视频操作及事件相机等零样本模态。摘要未给出具体基准分数。

Insight: 作者识别出任务内化现象：与预训练任务绑定的查询格式会压过演示内容，模型可能按格式走捷径；少量与任务无关的数据可减轻这一问题，提示应解耦提示格式与任务身份。

Abstract: Adapting video models to new tasks typically requires dedicated data curation and fine-tuning. While visual analogy provides a training-free alternative by specifying tasks in-context, it remains restricted to the image domain. To explore whether analogy-based methods can unify diverse video tasks and generalize to out-of-distribution scenarios, we introduce ViGeo, a framework that extends visual in-context learning to the video domain via spatiotemporal canvas completion. Evaluated on a diverse task taxonomy with a strict train-test split, ViGeo generalizes to unseen video manipulations and zero-shot modalities (e.g., event cameras). Finally, we identify task internalization, where a query format associated with a pretrained task overrides the demonstration, and show that this shortcut can be removed with a small amount of task-unrelated data, highlighting the need to decorrelate prompt format from task identity.

[155] Test-Time Generalized Category Discovery cs.CVPDF

Shambhavi Mishra, Omprakash Chakraborty, Julio Silva-Rodriguez, Ismail Ben Ayed, Marco Pedersoli

TL;DR: PACT 将测试时域适配与新类别发现统一为无标签 TT-GCD 任务，通过原型分配同时识别文本定义的已知类和测试流中出现的未知类。

Details

Motivation: 传统 TTA 假设测试类别均已知，GCD 则假设有已知类别标签训练数据；现实部署可能同时面临域偏移、无标签已知类识别和未知类别发现。

Result: 在多个腐蚀和域偏移基准上，PACT 优于所比较的先进 TTA 与 GCD 方法，展示了连接适配与类别发现的效果。摘要未报告具体指标。

Insight: 模型先利用有信心的零样本预测，将偏移视觉特征重新对齐到文本类别表示；随后从无标签测试流估计已知类和新类视觉原型，并按图像特征与原型的相似度分配类别，全程不需要标签。

Abstract: Test-Time Adaptation (TTA) and Generalized Category Discovery (GCD) are traditionally treated as disjoint problems: the former adapts models to domain shift assuming all test classes are known, while the latter discovers novel categories assuming labeled training data for known classes. However, real-world deployment rarely fits either setting. Motivated by this gap, we introduce Test-Time Generalized Category Discovery (TT-GCD), a unified and more realistic scenario where a vision-language model must adapt to distribution shifts, classify known categories using only textual supervision, and discover novel categories, all during test time and without access to labeled data. To address this challenging scenario, we propose PACT (Prototype Assignment for Category discovery at Test time), a fully unsupervised framework that casts known-class recognition and novel-class discovery via prototype assignment. PACT first re-aligns shifted visual features with the text-derived class representations of the VLM using confident zero-shot predictions. Known and novel categories are then both represented by prototypes in the visual embedding space, estimated from the unlabeled test stream, and each test image is assigned to the category whose prototype is most similar to its visual feature. Extensive experiments across corruption and domain-shift benchmarks demonstrate that PACT outperforms adapted state-of-the-art TTA and GCD methods, effectively bridging the gap between adaptation and discovery.

[156] Gaussian Splatting-based Volumetric Video Compression with Sparse 4D Anchors cs.CVPDF

Ge Gao, Siyue Teng, Chanqgi Wang, Fan Zhang, Nantheera Anantrasirichai

TL;DR: SAGA 用稀疏分层 4D 锚点和神经隐式解码器压缩动态 3D 高斯场景，并以固定记忆槽捕捉无序锚点间的长程相关性。

Details

Motivation: 动态 3DGS 含大量冗余基元，时空压缩困难；单一规范脚手架难处理非局部动态和遮挡显露，逐个锚点独立建模也未充分利用锚点间关联。

Result: 在 Neu3D 和 MPEG MIV 上，SAGA 相较 GIFStream 的 PSNR BD-rate 分别降低 80.39% 和 83.94%，取得较强率失真性能。

Insight: 坐标神经隐式解码器从锚点间插值得到细锚点及高斯基元，实现跨时空结构共享；正交约束更新的固定记忆槽进一步建模非结构化锚点间上下文，有助于运动或纹理密集区域的熵编码。

Abstract: Immersive video communication requires photorealistic, render-efficient, and compact dynamic scene representations. 3D Gaussian Splatting (3DGS) offers a promising representation, but dynamic 3DGS remains difficult to compress due to dense primitives and spatiotemporal redundancy. Anchor-based formulations improve compactness with sparse scaffolds that share geometry and appearance across primitives. However, existing designs often rely on deforming a single canonical scaffold and condition each primitive on its associated anchor in isolation, limiting their ability to handle non-local dynamics and disocclusion while under-exploiting inter-anchor correlations, particularly in motion- or texture-dense regions. To address these limitations, we propose SAGA, a volumetric video codec built upon Sparse Anchor-assisted GAussian splatting representations. SAGA represents dynamic 3D scenes using hierarchically organized sparse 4D anchors, where coordinate-based INR decoders generate fine anchors and Gaussian primitives from inter-anchor interpolations, enabling compact parameter sharing across spatiotemporal structures. For long-range dependencies among unstructured anchors, we further introduce fixed-size memory slots with orthogonality-informed updates for accurate entropy-context modeling. Experiments show that SAGA achieves strong rate-distortion performance against GIFStream, with PSNR BD-rate reductions of 80.39% and 83.94% on Neu3D and MPEG MIV, respectively.

Chunming He, Rihan Zhang, Lei Xu, Guanyi Qin, Chengyu Fang

TL;DR: UnfoldCRF 将掩码细化写成像素标签与潜在区域变量上的条件随机场推断，以可解释的成对边界消息和区域一致性消息修正分割结果。

Details

Motivation: 学习式掩码细化器虽可提升分割准确率，但难判断收益来自显式结构还是额外参数，也不清楚遇到不同生成器或错误分布时能否泛化。

Result: COD10K 上，UnfoldCRF 比参数、阶段和监督匹配的最强黑盒细化器高 1.0 个 Fβω 点，四项 COD 指标均改善，变差样本比例从 11.7% 降至 8.5%。五数据集统一训练时，2.6M 参数版本平均 ΔIoU 增益为 4.2，对照为 2.0；对未见掩码生成器仍增 2.0 Fβω 点，对照为 0.6。冻结 DINOv2 变体以约七分之一参数匹配最强基础模型细化器并领先自身对照。

Insight: 单一能量包含校正 unary、学习的局部成对交互和图像条件潜在区域一致性；若区域标签一致性低，null 状态可退出区域项。逐条清零消息发现成对关系主要修边界，区域消息主要纠正非边界错误。

Abstract: Learned mask refiners improve segmentation accuracy, but it is hard to tell how much of the improvement comes from explicit structure rather than from extra capacity, and whether it holds up when the mask generator or its error distribution changes. UnfoldCRF treats refinement as inference in a conditional random field over pixel labels and latent region variables. Its energy has a corrected unary term, learned local pairwise interactions, and image-conditioned latent-region consistency, with a null state that lets a region with weak label agreement withdraw from the consistency term; inference unrolls damped mean-field updates on this one energy. To isolate the effect of structure, we compare against recurrent black-box refiners that read the same inputs and receive the same parameter budget, stage count, and supervision. On COD10K, UnfoldCRF beats the strongest matched control by 1.0 $F^ω_β$ point, improves all four COD metrics, and lowers the fraction of images made worse from 11.7% to 8.5%. Under a train-once protocol over five datasets and several mask sources, the 2.6M-parameter variant gains 4.2 mean $Δ$IoU against 2.0 for its control, and a variant built on frozen DINOv2 features matches the strongest foundation-model refiner with about a seventh of its resident parameters while staying ahead of its own control. On mask generators never seen in training, the gain is 2.0 $F^ω_β$ points against 0.6 for the control. Zeroing individual messages shows where the corrections come from: the pairwise messages mostly fix boundaries, the region messages mostly fix non-boundary errors. Code and supporting materials will be publicly released.

[158] MetaSampling: Making Frame Samplers Efficient for Long-Video Question Answering cs.CVPDF

Ashim Dahal, Bikramjit Banerjee

TL;DR: MetaSampling 是可叠加在现有长视频选帧器上的免训练策略，根据问题动态减少送入 MLLM 的帧数，并尽量保持或提高问答准确率。

Details

Motivation: 长视频 VQA 的帧选择方法通常使用固定全局预算；即使已有较好选择器，也可能将冗余帧传给模型，增加视觉 token 与推理成本。

Result: 在 36 组“选帧器—MLLM 骨干—VQA 基准”配置中，MetaSampling 全部减少所选帧数，25 组准确率提高；平均帧数减少 8.9%，整体准确率略有提升。

Insight: 该方法作为已有选择器之上的二级预算分配，可直接组合现有系统，不需针对任务训练新模型。

Abstract: Frame selection is an important component of long-video question answering (VQA) with Multimodal Large Language Models (MLLMs). Existing frame-selection methods improve over simple top-$k$ embedding retrieval and uniform sampling, but are typically applied under a fixed global selection budget. We introduce \textbf{MetaSampling}, a training-free, plug-and-play sampling strategy that can be applied on top of existing frame selectors. MetaSampling improves downstream VQA efficiency by dynamically reducing the number of frames passed to the MLLM while preserving, and in some cases improving, answer accuracy. We evaluate MetaSampling across 36 paired frame-selector–MLLM-backbone–VQA-benchmark configurations. MetaSampling reduces the number of selected frames in all 36 configurations and improves accuracy in 25 of them, yielding an average frame reduction of $8.9%$ while slightly improving accuracy overall.

[159] Position Aware Layer Queries for Test Time Training in Vision Language Models cs.CVPDF

Rajat Modi, Priyank Pathak, Xin Liang, Yogesh Singh Rawat

TL;DR: LQN 通过读取冻结 VLM 的中间层空间 token，并以坐标查询学生网络蒸馏这些表征，在单次 VLM 前向计算下完成测试时适配。

Details

Motivation: 传统 VLM 测试时训练需对多种增强视图分别运行完整模型并常需反向传播，计算成本高；中间层输出可能已包含比最终嵌入更多可用适配信号。

Result: 在 OOD ImageNet 上，LQN 使零样本 CLIP ViT-B/16 top-1 提高 9.8%；细粒度分类比此前最佳 GS-Bias 高 3.9 点。CLIP ResNet-50 收敛时间为 47 分钟，快于 TPS 的 55 分钟；方法还迁移至 SigLIP、EVA-CLIP、CoCa 及 MLP、ResNet、VGG 学生，并扩展到全景、实例和语义分割。

Insight: 位置感知蒸馏使轻量学生模仿教师中间空间 token，位置一致性正则用 O(1) 坐标采样取代 O(H×W) 图像增强，降低测试时适配成本。

Abstract: Test-Time Training (TTT) adapts models to incoming test samples (e.g. out-of-distribution, (OOD)) when conventional fine-tuning is infeasible. Existing TTT methods for Vision-Language Models (VLMs) create supervision from several augmented views, each requiring forward (and often backward) passes through the entire VLM, incurring substantial computational cost. We observe that one forward pass with all the intermediate layer outputs already yields far more signal than the final embedding from all augmentations. We introduce Layer Query Network (LQN), a lightweight approach that can adapt a frozen VLM (teacher) in a single forward pass of the VLM via a small model (student). LQN uses Position-Aware Distillation (PAD) to mimic the teacher VLM’s intermediate-layer spatial tokens by querying spatial coordinates of intermediate tokens. LQN additionally relies on Location Consistency Regularization (LCR), a self-supervision technique, replacing expensive O(H x W) image augmentation with O(1) coordinate sampling. Integrating these, LQN i) adapts and improves zero-shot CLIP ViT-B/16 by 9.8% Top-1 on OOD ImageNet, ii) outperforms the previous best GS-Bias on fine-grained classification by 3.9% Top-1, iii) achieves faster convergence than TPS for CLIP ResNet-50 (47 mins vs 55 mins), iv) generalizes adaptation to VLMs like SigLIP, EVA-CLIP, and CoCa, and lightweight students like MLP, ResNet, VGG, and v) extends to panoptic, instance, and semantic segmentation.

[160] Re:Cognize – Open-Set Comic Character Re-Identification cs.CV | cs.MMPDF

Aaditya Baranwal, Madhav Kataria, Yogesh S Rawat, Shruti Vyas

TL;DR: Re:Cognize 将漫画人物再识别设定为随故事顺序增长的开放集任务，评测模型能否边读边建立角色库，而非从一开始得到完整演员表。

Details

Motivation: 漫画读者需在相隔数百页后凭外观认出角色，但新角色何时出现未知、人物库须随故事推进而建立；静态封闭集检索不能测量这种连续识别和接纳决策。

Result: 四种协议从封闭集检索到逐步增长的角色库。仅每角色一张参考图时，识别排序已接近预先构建图库；主要瓶颈是模型是否应接纳自己的匹配：带错误自匹配扩张角色库会变差，而若标签正确，同样扩张可提升 top-1 超过 20 点。ReCast 无需训练，可恢复理想标签收益的三分之一到三分之二，取决于角色库由随机示例还是首次出现图像初始化。

Insight: 关键在于接纳阈值而非识别能力本身：只有新增匹配在其覆盖的查询上比现有角色库更常正确时，扩张才有收益。论文聚焦已见角色身份维护，对新角色何时出现仅作固定参考规则下的诊断，没有提出识别新角色的方法。

Abstract: A manga reader meets a character on one page and knows them on sight a hundred pages later, without ever being handed a cast list. Re-identifying comic characters demands the same, open-set and sequential: pages arrive as a stream in reading order, new faces appear before anyone names them, and the cast is assembled as the story is read. $\textbf{Re:Cognize}$ evaluates recognition as the story is read, not against a cast handed over in advance: four protocols on one query stream, from closed-set retrieval to a cast the model must build and grow itself. The surprise is where models fail. Recognising is close to solved: one reference image per character already ranks as well as a gallery built in advance. Knowing what to believe is not: a model that adds its own matches makes its cast worse, while the same growth with correct labels would gain over twenty points of top-1 accuracy. The bottleneck is acceptance, not vision, and one comparison decides it: an addition pays exactly when it is right more often than the cast already was on the queries it takes over. The comparison has nothing to fit, and measured on half of a new corpus it calls the other half correctly. $\textbf{ReCast}$ puts it to work with nothing fitted on data: a cast sheet of one running average per character, grown only where the page itself vouches for a crop. It recovers a third to two thirds of what perfect labels would, depending on whether the cast starts from random examples or from first appearances. Re:Cognize measures whether a model can read along; ReCast is a cast that does. Our claims are on identity maintenance, recognising characters already met; the emergence of new ones is measured as a diagnostic under a fixed reference rule, and we propose no method for it.

[161] SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Models cs.CVPDF

Ahmadreza Jeddi, Enming Zhang, Jasper Gerigk, Hakki Karaimer, Mozhgan Nasr Azadani

TL;DR: SCOPD 发现视觉 token 剪枝后的失败不仅来自信息被删除，也来自模型未能稳定利用仍保留的证据；它用全上下文教师对稀疏上下文学生做 on-policy 自蒸馏。

Details

Motivation: 激进的无训练 token 压缩会显著降低 VLM 性能，常被归因于视觉证据不可逆丢失；但固定上下文多次采样可找回贪心解码遗漏的许多样本，表明还存在证据利用不稳定。

Result: 在 13 个基准上、只保留 10% 视觉 token 时，基线平均保留未剪枝性能的 86.37%；SCOPD 提至 90.49%，加入视觉预算干预的 SCOPD+ 提至 92.43%。推理不需额外计算。

Insight: 学生在剪枝视觉输入下生成轨迹，拥有完整上下文的同模型教师沿相同 on-policy 前缀提供监督；SCOPD+ 用小规模视觉预算干预定位视觉敏感回答位置，并选择性蒸馏，不需要真值回答、架构改动或额外推理教师。

Abstract: Reasoning vision-language models (VLMs) process images and videos as long sequences of visual tokens, making inference expensive. Training-free token pruning reduces this cost, but aggressive compression can sharply degrade performance, often attributed to irreversible loss of task-relevant visual information. We show that this explanation is incomplete. In a fixed-context Pass@K analysis, repeated sampling from the same pruned visual representation recovers many examples missed by greedy decoding, indicating that useful visual evidence can remain accessible but be used unreliably. We call this the representation-utilization gap. Motivated by this observation, we introduce SCOPD, a sparse-context on-policy self-distillation framework in which a student generates reasoning trajectories from pruned visual tokens while a privileged full-context teacher supervises the same on-policy prefixes. SCOPD requires no ground-truth responses, architectural changes, or additional inference-time computation. We further introduce SCOPD+, which uses a small visual-budget intervention to identify visually sensitive response positions and selectively distill them. At 10% visual-token retention, the Vanilla model retains 86.37% of its unpruned performance across 13 benchmarks. SCOPD raises this to 90.49%, while SCOPD+ further improves it to 92.43%. Across token budgets, benchmarks, and pruning operators, our results show that efficient reasoning depends not only on which visual information survives pruning, but also on how reliably the model learns to use it.

[162] ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark cs.CV | cs.AIPDF

Kieran Sagar Parikh, Jose Luis Garcia del Castillo y Lopez

TL;DR: ARCH-B 评估多模态模型能否在照片、平面图、立面、剖面和渲染图之间识别同一建筑，重点考察跨表现形式的对应和迁移。

Details

Motivation: 多模态模型越来越多用于视觉环境理解，但它们能否跨建筑图纸与照片等媒介认出同一建筑，尚缺少系统评测。

Result: 基准含 354 道四选一问题、11 类跨表现原型，来自 390 万张与建筑关联的图像；评估 25 个模型并收集 5,830 名人类非专家回答。模型准确率为 10.45%–83.90%，人类基线为 35.35%；模型和人类在各类问题难度上的相关性较弱（Spearman ρ=0.33）。平面图—照片对应仍较难，留出评估确认筛选发现的难度可迁移至未参与策划的模型。

Insight: 通过视觉相似干扰项、模型辅助难度筛选和人工验证，基准测试的不是单一建筑识别，而是跨媒介表示转换；不同群体对题目难度的判断并不一致。

Abstract: Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevations, sections, and renderings remains poorly characterized. We introduce ARCH-B, a benchmark of 354 four-choice questions across 11 cross-representational archetypes, constructed from a building-linked corpus of 3.9 million architectural images using visually similar distractors, model-guided difficulty screening, and manual validation. We evaluate 25 multimodal models and collect 5,830 responses from non-expert human participants. Model accuracy ranges from 10.45% to 83.90%, compared with a human baseline of 35.35%. Models perform comparatively well on mixed-representation outlier detection and photograph matching, but remain weaker on floorplan-to-photograph correspondence. Human and model difficulty across archetypes is only weakly correlated (Spearman’s (ρ=0.33)). Held-out evaluation confirms that the difficulty identified during screening generalizes beyond the curation models. ARCH-B provides a diagnostic evaluation of visual correspondence and representation transfer across architectural media.

[163] Advancing Wildlife Conservation through Multimodal Animal Re-Identification with Environmental Metadata cs.CVPDF

Yuzhuo Li, Di Zhao, Tingrui Qiao, Yihao Wu, Bo Pang

TL;DR: MetaWild 将环境元数据与相机陷阱动物图像配对，研究温度、昼夜节律等背景信息能否提升野生动物个体再识别。

Details

Motivation: 现有动物 ReID 数据集只使用图像，忽略生态学认为与动物行为和身份相关的环境信息；同时，VLM 的文本处理能力也未充分利用。

Result: MetaWild 含六个物种的 20,890 张图像及从相机陷阱叠字和场景中提取的环境元数据。多种基线与轻量 MFA 结合后，持续优于仅用视觉信息。摘要未给出具体增益。

Insight: Meta-Feature Adapter 将视觉和环境信息共同用于 VLM 式再识别，便于接入既有方法；数据集为评估不同物种及环境元数据贡献提供多模态基础。

Abstract: Identifying individual animals is crucial for effective wildlife monitoring and conservation efforts. Recent advancements in computer vision have shown promise in animal re-identification (Animal ReID) by leveraging data from camera traps. However, existing Animal ReID datasets rely exclusively on visual data, overlooking environmental metadata that ecologists have identified as highly correlated with animal behavior and identity, such as temperature and circadian rhythms. Meanwhile, modern vision-language models (VLMs) offer rich multimodal reasoning capabilities, but existing resources underutilize their text-processing potential. To address these limitations, we propose MetaWild, a multimodal Animal ReID dataset comprising 20,890 images across six species, paired with environmental metadata extracted from embedded camera trap overlays and scene contexts. Additionally, to facilitate the use of metadata in existing ReID methods, we propose the Meta-Feature Adapter (MFA), a lightweight module that can be incorporated into existing VLM-based ReID methods, allowing ReID models to leverage both environmental metadata and visual information to improve ReID performance. Experiments on MetaWild show that combining baseline ReID models with MFA to incorporate metadata consistently improves performance compared to using visual information alone, validating the effectiveness of incorporating metadata in re-identification.

[164] The Devil is in the Spectrum Bias: Spectrum-Balanced Feature Matching for Robust Representation Distillation cs.CV | cs.AIPDF

Kuniaki Saito, Yoshitaka Ushiku

TL;DR: SpecMatch 改进无标签视觉基础模型蒸馏的特征匹配目标，通过频谱平衡减少对高方差主方向的过度拟合，强化低方差但可能含任务信息的方向。

Details

Motivation: 常规 L2 特征匹配更关注教师表示中的主导频谱方向，低方差成分优化不足；这些被忽视维度可能承载下游任务所需信息。

Result: 在视觉下游任务中，SpecMatch 在 42 种教师—学生和训练配置里的 40 种优于传统特征匹配，并在所有设置中优于原始学生模型；收益覆盖图像分类、异常检测、医学图像和域泛化。六种蛋白理解任务中也有提升。

Insight: 频谱平衡目标自适应强调尚未充分拟合的方向，同时保留主导方向的相对重要性，实现开销可忽略且无需标注的蒸馏优化。

Abstract: Large visual foundation models have demonstrated remarkable transferability across a wide range of downstream tasks. To deploy such models efficiently, feature matching has become a popular knowledge distillation approach that transfers teacher representations to smaller student models without requiring labeled data. However, we show that the conventional feature matching objective with L2-distance is inherently biased toward reconstructing dominant spectral directions of the teacher representation, while under-optimizing low-variance directions that often contain task-relevant information. To address this, we propose Spectrum-Balanced Feature Matching, SpecMatch, a simple objective that adaptively emphasizes under-optimized spectral directions while preserving the relative importance of dominant directions. SpecMatch is easy to implement and introduces negligible computational overhead. Extensive experiments on image recognition demonstrate that SpecMatch consistently improves downstream adaptation across diverse tasks, including image classification, anomaly detection, medical image analysis, and domain generalization. In particular, SpecMatch outperforms conventional feature matching in 40 of 42 teacher–student and training-setting combinations, while consistently improving over the original student model in all settings. We further demonstrate that the proposed objective generalizes beyond vision, improving downstream performance across six protein understanding tasks.

[165] SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning cs.CVPDF

Ruifan Zuo, Guocheng Hu, Wanshui Gan, Junyi Wang, Xiang Lei

TL;DR: SpatialSkill 让冻结 VLM 从离线轨迹中积累可审计的自然语言空间推理技能，不通过更新模型权重来适配跨视角推理。

Details

Motivation: VLM 难以把不同观察视角对齐为统一空间表示；现有改善方法多通过微调修改权重，使新知识隐含且绑定特定骨干。

Result: 在 CityCube 上，SpatialSkill 对四种冻结执行模型均有稳定提升；配备技能的 9B 模型超过该研究评测中的最强闭源参考。摘要未提供具体分数。

Insight: 感知技能不能简单靠执行结果验证：合理的空间规则可能缺少图像依据，或超出冻结模型可执行的变换能力。因此系统先做视觉 grounding 和可执行性检查，再控制人工技能演化以避免退化，并按空间推理类别路由技能以减少负迁移。

Abstract: Cross-view spatial reasoning requires a model to align different viewpoints into a coherent spatial representation, yet this ability remains challenging for vision-language models despite being natural to humans. Existing methods typically improve spatial reasoning by updating model weights, which keeps the acquired knowledge implicit and tied to a specific backbone. We propose \textit{SpatialSkill}, a weight-update-free framework that enables a frozen vision-language model to accumulate explicit natural-language reasoning skills from offline trajectories. Unlike symbolic tasks, perceptual skills cannot be reliably verified simply by executing them: a plausible spatial rule may lack visual support or require transformations that the frozen model cannot perform. SpatialSkill therefore admits candidate skills only after visual-grounding and executability checks, constrains manual evolution to prevent harmful regressions, and routes skills by spatial-reasoning category to reduce negative transfer. On CityCube, across four frozen executors, SpatialSkill yields consistent gains, and a 9B executor equipped with SpatialSkill surpasses the strongest closed-source reference in our evaluation. The skills are stored in a versioned natural-language manual, making the reasoning strategies explicit and auditable without modifying model parameters. Code at https://github.com/vindahi/SpatialSkill.

[166] Analytical and Convolutional Neural Network-Based Motion-Vector Propagation for Efficient Video Object Detection cs.CVPDF

Ashiyana Abdul Majeed, Mahmoud Meribout, Neethu Joseph

TL;DR: 该研究复用编码器运动向量在检测器调用间传播视频目标框，比较解析式传播与轻量 CNN 传播，以降低连续视频检测的延迟和能耗。

Details

Motivation: 边缘设备上的连续视频分析要求低延迟、低功耗且定位准确；逐帧运行检测器成本高，编码器已生成的运动向量可用于中间帧位置更新。

Result: 解析式方法 F1 为 0.909，端到端平均延迟 9.03 ms、每帧能耗 0.177 J，为受测配置最低；相较逐帧检测，延迟降 25.9%、能耗降 36.4%。CNN 方案召回率由解析法的 0.871 提至 0.890，平均功耗从 19.64 W 降至 17.32 W，但延迟为 18.42 ms、能耗 0.319 J，适用于更重视召回或功耗的设置。DLA 执行可降低平均 GPU 利用率。

Insight: 解析式与学习式运动向量传播在延迟、能耗和召回之间提供不同折中；主机处理优化也能同时改善延迟和能耗，说明时序模型需与硬件执行管线联合设计。

Abstract: Continuous video analytics requires accurate localization at low latency within embedded power budgets. This paper presents a hardware-software design methodology that reuses codec motion vectors (MVs) between detector invocations. Two alternative models support translation and scale changes: analytical motion-vector propagation (Analytical-MV) and learned propagation using a convolutional neural network (CNN) (CNN-MV). The learned model uses convolutional operations and independent object updates suited to parallel execution on an edge graphics processing unit (GPU). Analytical-MV combines a harmonic-mean precision-recall score (F1) of 0.909 with a mean end-to-end latency of 9.03 ms and an energy consumption of 0.177 J per frame, yielding the lowest latency and energy among the evaluated configurations. Relative to detection on every frame, it reduces mean latency by 25.9% and energy per frame by 36.4%. CNN-MV offers a different trade-off: its fastest configuration raises recall from 0.871 for Analytical-MV to 0.890 and lowers mean power from 19.64 to 17.32 W, while achieving a latency of 18.42 ms and an energy consumption of 0.319 J per frame. It is therefore useful when recall or operating power is more important than minimum latency and energy. Execution on a deep learning accelerator (DLA) further reduces time-averaged GPU utilization relative to GPU execution. Host-processing optimization substantially improves both latency and energy, demonstrating the value of jointly designing temporal models and their execution pipelines.

[167] Beyond Geometry: Benchmarking and Consistency Reasoning for 3D Logical Anomaly Detection cs.CVPDF

Zhiqiang Qin, He Xie, Junfei Yi, Yang Yang, Hao Wang

TL;DR: ILGAD 将工业 3D 点云异常从局部几何偏差扩展到对象级设计或装配规则违背，并用一致性推理检测缺失结构、规格和装配状态错误。

Details

Motivation: 现有三维工业异常检测主要寻找局部几何变化，但许多实际故障是整体设计或装配逻辑不一致，并不一定体现为明显局部形变。

Result: ILGAD 含 15 类、2,774 个点云样本及点级标注，覆盖存在性、规格、姿态和装配状态错误。在 ILGAD、Anomaly-ShapeNet、IEC3D 上，框架在对象级检测和点级定位方面优于所比较方法，并能泛化到传统几何缺陷；摘要未给出具体指标。

Insight: 方法联合检查局部几何、结构覆盖与空间关系是否符合正常设计，使未出现但按设计应存在的部件也能成为异常，而非只寻找已见表面的异常点。

Abstract: Existing 3D industrial anomaly detection mainly targets local geometric deviations. In contrast, many industrial anomalies violate object-level design or assembly rules, which we define as 3D logical anomalies. To address these challenges, we introduce the Industrial Logical Anomaly Detection Dataset (ILGAD), the first scalable benchmark dedicated to logical anomalies in industrial point clouds. ILGAD contains 2,774 samples from 15 categories with point-level annotations and covers existence, specification, pose, and assembly-state errors. To detect such 3D logical anomalies, we propose a consistency reasoning framework that assesses whether local geometry, structure coverage, and spatial relations conform to the normal design. The framework detects geometric changes, unsupported expected structures, and abnormal local arrangements. Experiments on ILGAD, Anomaly-ShapeNet, and IEC3D demonstrate superior object-level detection and point-level localization, showing that the framework effectively detects logical anomalies and generalizes to conventional geometric defects.

[168] Geometric Encoding for Spatial Reasoning in Vision-Language Models cs.CVPDF

Antonio Jun, Haoshui Yu, Zhengyi Lu, Huirong Fu, Yao Qiang

TL;DR: Geometric Code 先从单目视频显式计算对象三维几何，再将结构化空间代码作为语言上下文提供给 VLM，补足小型模型从像素中提取度量关系的能力。

Details

Motivation: VLM 较擅长辨认视频内容，却较难稳定估计距离、尺寸及跨帧对象身份；直接依赖像素进行定量空间推理存在明显不足。

Result: 在 VSI-Bench 上，加入空间代码后 2B 和 4B 开源模型的平均准确率比仅用帧提高 4.1 点，绝对距离任务提升最大，为 24.1 点。方法不含需要训练或微调的组件。

Insight: 感知层从单目 RGB 视频分割和分类对象，并估计深度、相机位姿及内参；确定性几何引擎再反投影、合并和清理为对象位置、尺寸、数量、距离、出现顺序及房间几何。代码可与视频并列输入提示，也可完全替代视频。

Abstract: Vision-Language Models (VLMs) are far more reliable at recognizing what appears in a video than at reasoning about its spatial and temporal properties, such as metric distances, object dimensions, and consistent object identities across frames. We present Geometric Code, a perception-to-geometry pipeline that computes explicit spatial structure from video and supplies it to VLMs as context to augment reasoning. A perception layer segments and classifies objects and recovers depth, camera pose, and intrinsics from monocular RGB video. A deterministic geometric engine then back-projects, merges, and cleans these outputs into a spatial code, including per-object positions, dimensions, counts, inter-object distances, appearance order, and room geometry. The code is serialized into VLMs’ prompts, either alongside the video or replacing it entirely. Specifically, there is no component trained or fine-tuned in our approach. On VSI-Bench, augmenting 2B and 4B open models with the spatial code improves average accuracy by +4.1 points over the frames-only baseline, with the largest gains on numeric estimation tasks such as absolute distance (+24.1 points). The results suggest that explicitly computed geometry, delivered through the language channel, recovers spatial competence that small VLMs cannot extract from pixels alone.

[169] Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos cs.CVPDF

Wonseok Roh, Seung Hyun Lee, Won Jeong Ryoo, Jakyung Lee, Gyeongrok Oh

TL;DR: 该工作根据手部与物体的功能关系定义手型类别，并将其作为先验加入第一视角视频动作识别与 3D 手姿估计。

Details

Motivation: 第一视角动作识别若只依赖手部几何或物理信息，难细致理解手与物体持续交互的语义；手的功能构型与所操作物体之间存在可利用关联。

Result: 在 FPHA 和 H2O 大规模基准上，作者报告模型优于当前最先进方法。摘要未提供具体数值。

Insight: 流程先从短期线索估计 3D 手姿、物体类别和手型，再由长时序动作模块聚合逐帧知识及手型文本嵌入，帮助模型跟踪动作期间手—物交互变化。

Abstract: Current methods for egocentric view action recognition often face challenges in perceiving dynamic hand movements relying solely on geometrical or physical information. In this work, we effectively address this problem by gaining insights into the correlation between functional hand configurations and objects, which improves the detailed interpretation of real-world scenarios. To this end, we introduce a practical taxonomy of hand types based on the functioning perspective and utilize it for per-frame hand type labeling on existing datasets. We also propose a novel hand action recognition framework considering semantic details of the hand type as prior. This approach boosts the network’s understanding of the continuous hand interaction throughout the action sequence. Our whole pipeline consists of three main modules: (1) Feature Extraction, (2) Egocentric Knowledge Module, which estimates 3D hand pose, object category, and hand type leveraging short-term cues, and (2) Egocentric Action Module, which aggregates per-frame knowledge, including text embeddings of hand type, over a longer time. In our extensive experiments with large-scale benchmarks, FPHA and H2O, our model outperforms current state-of-the-art methods, demonstrating its superior performance.

[170] Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering cs.CVPDF

Shulian Zhang, Xiangyu Shu, Wenbo Li, Jian Chen, Yong Guo

TL;DR: 该方法用逐帧对齐的字形参考和冻结文本识别器的多层特征监督，改善视频中的文字替换或添加，使字符笔画正确且随场景运动一致。

Details

Motivation: 视频扩散模型难以精确生成复杂笔画字符，常出现乱码或错误文字；视频编辑还要求文本在每帧正确，并跟随场景位置和透视变化。

Result: 作者构建 VTEdit，含 288 段真实场景视频、440 条文字轨迹，覆盖替换和新增任务。实验中方法在文字准确性及背景保留方面优于图像编辑、视频编辑方法和商业模型，句子准确率为 0.9408，用户偏好最高。

Insight: 轨迹对齐字形参考为每帧提供位置和透视一致的显式引导；深度归一化识别器监督则检查多个特征层中的生成文字，以补足扩散损失可能忽略的笔画错误。

Abstract: Video text editing aims to replace or add text in a video while keeping the rest of the video unchanged, which requires the edited text to be correct in every frame and to move coherently with the scene. Despite the remarkable progress of video diffusion models, they struggle to reproduce exact stroke structures and often produce garbled or wrong characters, especially for characters with complex strokes. To address this, we propose a trajectory-aligned glyph rendering reference that provides explicit per-frame glyph guidance following the position and perspective of the text, and a depth-normalized recognizer feature supervision that supervises the generated text on multi-depth features of a frozen text recognizer with per-depth normalized errors, targeting stroke errors overlooked by the diffusion loss. We further build VTEdit, a benchmark of 288 real-scene clips with 440 annotated text trajectories covering text replacement and text addition, which will be publicly released to facilitate future research. Experiments on VTEdit show that our method outperforms image text editing methods, video editing methods, and commercial models in text accuracy and background preservation, achieving a sentence accuracy of 0.9408, and receives the highest preference in a user study.

[171] MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space cs.CVPDF

Qing Yu, Kent Fujiwara

TL;DR: MotionSpaceFlow 直接在连续完整动作空间进行 flow matching，无需学习式编码器/解码器，并针对动作表示的各向异性设计噪声尺度和多模态 Transformer。

Details

Motivation: 多数文本到动作生成器在重建优先、时间降采样的低维潜空间工作，可能限制生成质量，也无法直接控制单帧或单关节动作。

Result: 在多个数据集和动作表示上，MSFlow 达到最先进的文本到动作生成表现；全局表示还支持无需控制条件训练的零样本推理时任意关节/帧控制，并能精确满足约束。摘要未提供具体数值。

Insight: 作者分析初始高斯源尺度如何决定概率路径中间边缘分布协方差，提出表示感知噪声缩放。RA-MMDiT 联合更新语言 token 与全分辨率动作特征：帧差等增量特征使用因果注意力，绝对关节坐标等全局特征使用双向注意力。

Abstract: Recent advances in diffusion and flow models have substantially improved text-driven human motion generation. Yet most methods generate in low-dimensional, temporally downsampled latent spaces learned primarily for reconstruction, a bottleneck that can limit generation quality and preclude direct manipulation of individual frames and joints. We introduce MotionSpaceFlow (MSFlow), a representation-aware flow-matching framework that predicts clean motion directly in continuous motion space without a learned encoder or decoder. To account for the anisotropic structure of direct motion representations, we propose representation-aware noise scaling and show how the initial Gaussian source scale governs the covariance of intermediate probability-path marginals. We further introduce a Representation-Aware Multimodal Diffusion Transformer (RA-MMDiT), which jointly updates token-level language and full-resolution motion features through joint attention while adapting temporal information flow to the motion representation: causal attention for incremental features defined by frame-to-frame changes, and bidirectional attention for global features such as absolute joint coordinates. Across different datasets and motion representations, MSFlow achieves state-of-the-art text-to-motion performance. Its global representation variant additionally enables zero-shot, inference-time control over any joint or frame through projection sampling without control-conditioned training, delivering leading motion quality with exact constraint satisfaction.

[172] CRF Loss is How Networks Should Learn Boundaries in Weakly Supervised Segmentation cs.CVPDF

Joshua Li, Yuri Boykov

TL;DR: DS-CRF 将弱监督分割中的 CAM 软伪标签和 SAM 二值边界图分别作为 CRF unary 与 pairwise 监督，避免合并成可能过度自信的硬标签。

Details

Motivation: 弱监督语义分割仅用图像级标签学习像素预测，CLIP 等模型产生的 CAM 在边界处较粗；DenseCRF 依赖颜色线索会误改相邻像素，而 SAM 硬伪标签又丢弃 CAM 的不确定性。

Result: 单阶段 DS-CRF 在 MS COCO 上达到 56.5% mIoU，取得论文所报新的最先进结果。

Insight: 让 CAM 和 SAM 边界各自通过独立损失监督网络，把软区域置信作为 unary、二元边缘作为 pairwise 信息，使边界学习能保留 CAM 的不确定性，而不是把模糊错误变成确定错误。

Abstract: Weakly Supervised Semantic Segmentation (WSSS) learns pixel-level predictions from image-level tags. Recent work focuses on improving coarse CAMs extracted from large vision-language models (commonly CLIP), but does little to improve their accuracy along segment boundaries. That job is instead delegated to a post-processing method like DenseCRF. However, because DenseCRF relies on low-level colour cues, it can flip correct labels to incorrect ones when neighbouring pixels share similar colours. SAM has recently been adopted as a natural alternative, yet it simply takes on DenseCRF’s role as an intermediate “refinement” step that outputs one-hot pseudo-labels in prior work. By discarding the valuable uncertainty in CAMs, these one-hot pseudo-labels turn borderline errors into confidently wrong targets. Our key insight is that CAMs should supervise training alongside SAM boundaries, each through its own loss, rather than being fused together into a single hard target. Inspired by CRF potentials, we propose a framework that disentangles soft pseudo-labels as unary supervision and binary edge maps as pairwise supervision. We realize our framework in a single-stage model, DS-CRF, using CAMs from dino.txt and boundaries from SAM. DS-CRF sets a new state-of-the-art of 56.5% mIoU on MS COCO.

[173] ConvCue: Complementary Visual Inductive Biases for Vision-Language Models cs.CVPDF

Zixuan Lan, Shichu Sun

TL;DR: CONVCUE 在冻结的预训练 VLM 原视觉特征上补充冻结 CNN 的局部表征，通过可学习适配器和门控交叉注意力改善细粒度视觉辨别与空间理解。

Details

Motivation: 现有 VLM 在需要精细区分或空间理解的视觉问题上仍有困难；卷积网络的局部连接与空间权重共享可能提供与原编码器互补的视觉归纳偏置。

Result: 在 Qwen3-VL-2B、4B 和 LLaVA-OneVision-7B 上的 13 个多模态基准中，CONVCUE 对三种骨干均超过原模型和匹配的两阶段微调对照。Qwen3-VL-4B 在全部 13 个基准均优于原模型，相对匹配微调对照的平均分从 75.00 升至 78.82。

Insight: 平行冻结 CNN 提供末阶段特征，适配器将其映射到 VLM 维度，门控交叉注意力让原视觉 token 读取互补信息，再由原视觉—语言投影器处理；不替换原视觉编码器。

Abstract: Modern vision-language models (VLMs) achieve strong performance across a broad range of multimodal tasks, yet still struggle with visual questions that require fine-grained discrimination and spatial understanding. These limitations motivate investigating whether supplementary visual representations can improve existing VLMs without replacing their native visual encoders. Pretrained convolutional networks offer a candidate feature source, motivated by their local connectivity and spatial weight sharing. We introduce CONVCUE, which augments the native visual representations of a pretrained VLM with final-stage features from a parallel, frozen pretrained CNN. A learnable adapter maps convolutional features to the native visual feature dimension, while gated cross-attention allows the original visual tokens to retrieve information from the CNN features. The enhanced tokens are passed through the original visual-to-language projector, and the model is adapted through a two-stage training procedure. We evaluate CONVCUE on Qwen3-VL-2B, Qwen3-VL-4B, and LLaVA-OneVision-7B across 13 multimodal benchmarks covering visual question answering, document and chart understanding, and multimodal reasoning. CONVCUE improves average benchmark performance over both the original models and matched two-stage fine-tuning controls on all three backbones. On Qwen3-VL-4B, it improves over the original model on all 13 benchmarks and raises the average score from 75.00 to 78.82 relative to the matched fine-tuning control. These results show that pretrained convolutional representations, when integrated through learned adaptation and fusion, can improve the visual understanding of existing VLMs without replacing their original visual encoders.

[174] WorldWeave: Growing Persistent Geometric Worlds for Video Generation cs.CVPDF

Yifan Huang, Lifan Jiang, Qingyue Hao, Cheng Chen, Boxi Wu

TL;DR: WorldWeave 将持久的显式几何世界状态维护与短时视频渲染解耦，使三维场景可持续扩展并在不同轨迹、重复访问中保持结构一致。

Details

Motivation: 当前世界模型缺少持久结构记忆，难在不断扩展场景和跨视角再次访问时保持几何一致；短窗口视频生成不应成为场景状态的唯一存储。

Result: 摘要说明了世界构建流程，但未提供量化基准结果。

Insight: 地形模块用扩散式外绘生成连续度量高程图；代理结合用户意图、地形证据和跨区连通约束进行分层语义规划、确定性几何编译和局部修订。视频生成时只读查询几何生成深度序列引导画面，不把生成结果写回世界状态，从而保持持久结构独立于短视频窗口。

Abstract: Despite rapid progress, world models still lack explicit, persistent structural memory, making it difficult to preserve consistent world structure during continual scene expansion and cross-view revisits. To address this limitation, we present WorldWeave, a world generation framework that decouples world-state maintenance from visual rendering. Specifically, WorldWeave combines continual elevation-map generation with agent-guided scene organization and stitching to build an expandable explicit 3D world that incrementally extends structural memory while preserving existing structure. First, its terrain module uses diffusion-based image outpainting to generate continuous metric elevation maps under neighborhood conditioning and boundary constraints. Next, an agent integrates user intent, terrain evidence, and cross-region connectivity constraints to construct scenes through hierarchical semantic planning, deterministic geometry compilation, and local revision. Finally, during visual generation, planned camera trajectories query world geometry through a read-only interface, producing depth sequences that guide video synthesis without writing the generated results back into the world state. As a result, structural memory remains independent of short-window video generation, enabling continual expansion without predefined map boundaries and providing a consistent geometric basis for observations across trajectories and repeated visits.

[175] WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policies cs.CVPDF

Lin Liu, Lu Zhang, Ziying Song, Wu Yang, Yuzheng Zhuang

TL;DR: WorldGuide 用成功与失败轨迹学习潜在世界模型中的成败边界，再将可微预测分数用于策略训练，让 VLA 区分外观相似但结果不同的交互。

Details

Motivation: 主要由专家成功示范训练的世界模型缺少失败结果，可能无法区分视觉相近的成功与失败操作，限制其对策略学习的指导。

Result: WorldGuide 在 LIBERO 100 和 SimplerEnv 上达到最先进表现，成功率分别为 96.8% 和 72.0%；训练后预测器会被丢弃，部署无需额外世界模型推理。

Insight: 框架先在成败轨迹上做预测预训练，再对匹配的成功—失败对做对比学习；预测器提供可微奖励以联合优化 VLA 策略与视觉编码器。

Abstract: Latent world models offer a promising way to improve Vision-Language-Action policies by capturing the consequences of actions. However, models trained primarily on expert demonstrations have limited exposure to failure outcomes and may struggle to distinguish visually similar successful and failed interactions. We propose \textbf{WorldGuide}, a framework that learns these distinctions in latent space and uses them to guide policy training. WorldGuide combines predictive pretraining on successful and failed trajectories with contrastive learning on matched success–failure pairs. The learned predictor then provides a differentiable reward to guide joint optimization of the policy and visual encoder. The predictor is discarded after training, so deployment requires no additional world-model inference. Extensive experiments show that WorldGuide substantially improves VLA reliability and achieves state of the art performance on LIBERO 100 and SimplerEnv, reaching \textbf{96.8%} and \textbf{72.0%}, respectively. Code will be publicly available.

[176] Uncovering Ordinal-Matching Bias in Audio-Visual LLMs cs.CV | cs.SDPDF

Jihoo Jung, Youngjoon Jang, Hyebin Cho, Suho Yoo, Joon Son Chung

TL;DR: 该研究发现音视频模型在多人场景中常用说话顺序匹配画面人脸顺序来归属语音，而非依赖唇动等跨模态线索，并提出仅需少量合成视频的去序偏微调。

Details

Motivation: 多说话人场景中，模型需把语音片段对应到正确可见人物；现有 AVLLM 可能依赖空间排列和语句顺序等捷径，而非真正进行音视频对齐。

Result: 在三种开源 AVLLM 上均观察到 ordinal-matching bias。用 400 段说话位置与发言顺序独立随机化的合成视频进行 OD-FT 后，该偏差明显减弱，且真实视频上的三个音视频基准平均提升：Qwen2.5-Omni 为 8.27%，video-SALMONN2+ 为 2.57%。

Insight: 合成诊断集把人物空间位置和发言次序解耦，暴露模型是否依赖顺序捷径；同样的随机化监督还能改善真实场景泛化。

Abstract: This work aims to improve how audio-visual large language models (AVLLMs) associate speech with the correct visible speaker in multi-speaker scenes. We find that current AVLLMs frequently fail at this task, and analyze the nature of these failures. To this end, we construct a synthetic diagnostic dataset in which multiple visible speakers each utter a single word. Analysis on this corpus reveals a consistent error pattern across three recent open-source AVLLMs: models attribute utterances by simply matching the order of spoken sentences with the left-to-right, top-to-bottom arrangement of visible faces, rather than relying on audio-visual cues such as lip synchronization. We term this behavior \emph{ordinal-matching bias}. We further show that this bias can be substantially mitigated through a simple remedy, Ordinal-Decoupled Fine-Tuning (OD-FT), in which models are fine-tuned on synthetic videos where spatial positions of speakers and speaking order are independently randomized. Despite using only 400 synthetic training videos, OD-FT not only suppresses ordinal-matching bias but also improves audio-visual understanding on real-world videos, yielding average gains of 8.27% for Qwen2.5-Omni and 2.57% for video-SALMONN2+ across three audio-visual benchmarks.

[177] Trustworthy synthetic visual media: Evidence across the media lifecycle cs.CVPDF

Zexi Jia, Zhiqiang Yuan, Jie Zhou, Jinchao Zhang

TL;DR: 这篇综述讨论如何为合成图像和视频建立贯穿创作、编辑、发布和传播过程的可信证据，使媒体来源与处理历史在内容变化后仍可理解。

Details

Motivation: 生成系统可制造逼真媒体且不留下稳定历史，外观已不能说明内容是拍摄、合成还是编辑而来，因此需要沿媒体生命周期保留可核验信息。

Result: 综述整合可从媒体本身恢复的证据与制作阶段记录并随资产传播的证据，并讨论常规处理或蓄意操纵后其主张何时仍成立。摘要未提出新的数据集或量化结果。

Insight: 作者反对用一个普适真实性标记解决所有问题，主张证据应匹配具体判断问题、能传达到评估者，并在新信息出现时可修正；目标是即便媒体本身继续变化，其历史仍可被理解。

Abstract: Images and videos have long helped people understand what happened and how a work came into being. Generative systems complicate that role. Realistic media can now be produced and revised without leaving a stable history, so appearance no longer reveals whether a scene was captured, synthesized, or altered along the way. Trust must instead come from evidence that explains the path an asset has taken and the circumstances in which it was used. Some of this evidence can be recovered from the media, while some must be recorded during production and preserved as the asset circulates. This review brings those approaches together and asks when their claims remain meaningful after ordinary processing or deliberate manipulation. We argue that trustworthy media do not depend on one universal marker of authenticity. The evidence must suit the question at hand, reach the person making the judgment, and remain open to correction when better information emerges. The larger goal is to keep the history of media intelligible even as the media itself continues to change.

[178] SegBanana: Steering Unified Multimodal Models into Medical Segmenters cs.CVPDF

Xiaoye Liang, Ye Yan, Mingze Yin, Shikun Feng, Mai Xu

TL;DR: SegBanana 将医学分割表述为结构化视觉生成，使用冻结统一多模态模型和代理式解剖检索、候选比较及迭代修正，不需任务专属训练。

Details

Motivation: 医学分割需要像素标注且跨数据分布泛化困难；通用统一多模态模型已有视觉与生成能力，但复杂解剖任务仍需要领域知识和可靠修正。

Result: 在八个医学分割数据集上，SegBanana 平均 mDice 为 77.45%，比通用 SAM3/SegGPT 和医学专用 BiomedParse/MedSAM3 等基线至少高 14.93 点，并对分布外视觉支持保持稳健。

Insight: 冻结 UMM 作为生成核心，解剖感知知识检索和比较式质量评估提供工具；状态感知控制器维护结构化状态并迭代安排工具，逐步改进中间掩码。

Abstract: Medical image segmentation remains challenging in practical deployment, as models often struggle to generalize beyond the distributions covered by their training data and high-quality pixel-level annotations are typically unavailable for adaptation. Inspired by the cross-task transferability of large language models, we investigate whether unified multimodal models (UMMs) can transfer their pretrained visual understanding, reasoning, and generation capabilities to medical image segmentation without task-specific post-training. By recasting segmentation as structured visual generation, we find that frontier UMMs (e.g., Nano Banana) already exhibit basic segmentation capabilities across diverse clinical scenarios, but still struggle with challenging tasks requiring specialized anatomical or domain-specific knowledge. We further show that these limitations can be effectively mitigated by incorporating visual anatomical knowledge from in-context exemplars, expanding candidate solutions through repeated sampling, and refining suboptimal predictions via targeted editing.Motivated by these observations, we propose SegBanana, to our knowledge, the first agentic visual generation framework for training-free medical image segmentation. SegBanana builds on a frozen UMM as the core generative model, augmented with Anatomy-Aware Knowledge Retrieval and Comparative Quality Critique to unlock its potential segmentation capability. A State-Aware Multimodal Controller maintains structured state and iteratively orchestrates these tools, repeatedly refining intermediate predictions toward higher-quality masks. Across eight medical segmentation datasets, SegBanana achieves an average mDice of 77.45%, outperforming representative generalist (SAM3 and SegGPT) and medical-specific (BiomedParse and MedSAM3) baselines by at least 14.93 points, while remaining robust to out-of-domain visual supports.

[179] See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology cs.CV | cs.AIPDF

Chengyang Zhang, Wenchuan Zhang, Bo Li, Mengran Li, Xinyu Liu

TL;DR: ASPECT 对病理图像中的细胞外观、特征和数量进行中间视觉监督，使模型在生成答案前先看准并测量组织学细节。

Details

Motivation: VLM 在病理任务中对细粒度视觉细节感知不足，即使最终答案碰巧正确，错误的细胞观察也可能隐藏在推理过程中。

Result: PathoVernier 含五个病理数据集的 759 个专家审核问题，覆盖四类细胞组成任务。ASPECT 相对 Gemini-3.1-Pro 准确率提高约 19.2%，相对 Qwen3-VL-8B 骨干提高 99.3%；正确答案中的计数错误率 RAWR 分别降低 28.1% 和 42.7%，并在三个外部分类和问答基准上优于骨干。

Insight: 三阶段 SFT 依次训练感知、视觉 token 生成和推理，再用强化学习奖励答案正确性及其与报告测量的一致性；基准同时评分最终答案和中间测量，暴露只看答案准确率时会遗漏的视觉错误。

Abstract: Pathological assessment relies on recognizing fine-grained visual details in histological images. Vision-language models (VLMs) increasingly support pathology interpretation, yet their ability to perceive these details remains inadequate. This weakness leads to inaccurate cellular observations that can persist even when final answers are correct. In this paper, we propose ASPECT to improve visually grounded reasoning through explicit supervision of cellular appearance and abundance. ASPECT trains intermediate visual tokens through pathology feature reconstruction, cell feature alignment, and count supervision. Three-stage supervised fine-tuning teaches the model to perceive, generate visual tokens, and reason, followed by reinforcement learning that rewards answer correctness and consistency with reported measurements. We also introduce PathoVernier, a benchmark of 759 expert-reviewed questions from five pathology datasets covering four cellular composition tasks. It evaluates both final answers and intermediate measurements to expose errors hidden by answer accuracy. On PathoVernier, ASPECT achieves relative accuracy gains of approximately 19.2% over the strongest baseline, Gemini-3.1-Pro, and 99.3% over its Qwen3-VL-8B backbone, while reducing RAWR, which measures counting errors within correct responses, by 28.1% and 42.7%, respectively. ASPECT also improves over its backbone on three external pathology benchmarks covering classification and question answering beyond cellular composition tasks.

[180] Semantic Modality Compensation for Unsupervised Visible-Infrared Person Re-identification under Unpaired Settings cs.CVPDF

Duanning Chen, Ke He, Bin Yang, Yongxiang Yao

TL;DR: SMC 将跨可见光与红外模态的无监督行人再识别视为语义补偿问题，通过 CLIP 空间中的身份语义 token 和模态提示合成缺失模态对应。

Details

Motivation: 无配对设置中，不少身份在另一模态没有观测对应；直接映射特征易混淆身份判别内容与模态风格，产生身份线索失真或源模态偏差。

Result: 作者在成对与无配对两种设置下评估，SMC 持续优于最先进方法，身份错配严重时增益尤其大。摘要未提供具体指标。

Insight: 增强双对比学习先构建 ReID 空间并生成伪标签、聚类原型和记忆库；随后在 CLIP 语义空间学习可见光/红外提示，对缺少可靠匹配的簇将身份 token 与目标模态提示组合为语义对应，再映射回 ReID 空间并通过置信门控写入补偿记忆。

Abstract: Unsupervised visible-infrared person re-identification (USL-VI-ReID) learns person representations that can be compared across modalities without identity annotations. In the unpaired setting, however, identity correspondences between modalities are often incomplete, leaving many identities without an observed counterpart in the other modality. Existing unpaired methods bridge this gap by generating or mapping features for the other modality, mainly by exploiting the statistics of visual features without explicitly separating content that is discriminative for identity from style that is specific to modality. Consequently, the generated features may distort identity cues or inherit bias from the source modality, undermining the reliability of supervision across modalities. We formulate unpaired learning across modalities as a semantic compensation problem and propose Semantic Modality Compensation (SMC), a framework based on prompt composition that decouples identity semantics from modality style within a shared visual semantic space. SMC first constructs a discriminative ReID space through augmented dual contrastive learning, yielding pseudo labels, cluster prototypes, and memory banks for each modality. It then learns visible and infrared modality prompts in the CLIP semantic space and maps clusters obtained from pseudo labels to identity semantic tokens. For each cluster lacking a reliable match in the other modality, SMC combines its identity token with the prompt for the target modality to synthesize a semantic counterpart in the missing modality. The synthesized counterpart is then projected back into the ReID space and injected into a compensation memory through confidence gating. Extensive experiments under both paired and unpaired settings demonstrate that SMC consistently outperforms state-of-the-art methods, with particularly large gains when identity mismatch is severe.

[181] Dexterous Tactile World Model cs.CV | cs.LG | cs.ROPDF

Ziyao Zeng, Xiatao Sun, Hao Wang, Yueyang Pan, Zhengxiang Yu

TL;DR: DTWM 将双手触觉信号加入第一视角操作视频世界模型，用于预测未来帧并提高对接触、释放等视觉上难以观察事件的建模。

Details

Motivation: 操控世界模型常只用视频训练，但决定操作过程的接触事件在视觉上不易辨认，触觉更容易提供可靠线索。

Result: 与骨干、参数和训练匹配的纯视觉模型相比，DTWM 将手部运动低估从 23% 降至 9%，手部区域感知误差降低 7.4%；三次训练运行中，远期预测块收益约为第一块的 4.1 倍。即使推理时没有触觉，触觉训练仍改善未来帧预测。

Insight: 每只手的触觉信号通过零初始化残差注入视频 token 中对应手部位置，因果掩码禁止预测帧访问未来。力的大小和空间位置都重要，改成每手或每位置的二值接触状态都会增加预测误差；力随时间变化还指示交互是否会持续。

Abstract: World models for manipulation are typically trained from video, yet the events that determine how manipulation unfolds, such as making and releasing contact, are difficult to observe visually and are often easier to sense through touch. We present the Dexterous Tactile World Model (DTWM), a video world model for future-frame prediction of egocentric manipulation from both observed video and tactile signals from a glove worn on each hand. We condition a pretrained video diffusion transformer on each hand’s tactile signal through a zero-initialized residual at the corresponding hand location in the video tokens, while a causal mask prevents predicted frames from accessing future information. Compared with a vision-only model matched in architecture, parameters, and training, DTWM reduces the underestimation of hand motion from 23% to 9%, while reducing the perceptual error in the hand region by 7.4% across three training runs per model. The benefit also increases over the prediction horizon, with the improvement in the later predicted chunks being about 4.1x larger than in the first. DTWM also outperforms other visual-tactile world models under the same setting, and training with touch improves future-frame prediction even when no touch is available at inference. Ablations show that the model benefits from both the magnitude and spatial location of force: replacing the tactile signal with binary contact states, either per hand or per location, increases prediction error. The observed course of the force indicates whether the interaction will persist or change.

[182] PSM: Dataset Distillation Based on Precise Statistical Matching by Difficulty cs.CVPDF

Hongxu Ma, Guang Li, Shijie Wang, Dongzhan Zhou, Suorong Yang

TL;DR: PSM 按样本难度进行精确统计匹配，将每类原数据划分为不同难度组，并让蒸馏样本接受对应难度的教师统计监督。

Details

Motivation: 解耦统计匹配能降低数据集蒸馏的时间与内存，但常用全数据集运行统计监督全部合成样本，主要反映平均特征分布，忽视难度结构。

Result: 在多个数据集和架构上，PSM 扩宽蒸馏样本的难度覆盖，并在大多数评估设置中改善下游表现。摘要未给出具体数值。

Insight: GPS 在预训练后估计各图像难度并按类分组；SUA 用对应组原始样本前向更新教师 BN 统计，提供难度匹配监督；ISS 则用同难度原图初始化合成样本，帮助其进行更精准匹配。

Abstract: Dataset distillation (DD) condenses a large original dataset into a small distilled dataset with high training utility. Decoupled statistical matching methods substantially reduce distillation time and memory overhead while achieving strong performance. However, they typically supervise all distilled samples using running statistics estimated from the entire original dataset. These statistics mainly capture the average feature distribution while overlooking differences in sample difficulty, limiting their ability to characterize the difficulty structure of the original data. To address this issue, we propose Precise Statistical Matching (PSM) by difficulty. After pretraining, PSM uses the Global Precision Score (GPS) to estimate image difficulty, ranks the samples within each class, and partitions each class into IPC (images per class) difficulty groups. During distillation, Statistics Updated Again (SUA) updates the teacher’s batch normalization (BN) running statistics through forward passes on original samples from each group, providing difficulty-specific supervision for the corresponding distilled batch. Meanwhile, Initial Sample Screening (ISS) initializes distilled samples using original images from the corresponding difficulty group, providing an effective starting point for precise matching. Experiments across multiple datasets and model architectures demonstrate that PSM broadens the difficulty range of distilled samples and improves downstream performance in most evaluated settings. Code will be released.

[183] CAT-Free: Multi-View Pedestrian Localization without Calibration, Annotations, or Target-Scene Training via Adaptive Geometric Filtering cs.CVPDF

Taigo Sakai, Hiroki Kouno, Naoki Kato, Kazuhiro Hotta

TL;DR: CAT-Free 仅用同步 RGB 视频完成多摄像机行人定位，无需提供相机标定、位置标注或目标场景训练，并通过自适应几何过滤剔除不可靠位置。

Details

Motivation: 多摄像机行人定位适用于广域监控，但新环境部署通常需大量设置；现有方法常要求标定、位置标注或目标场景训练，而自动相机估计本身也可能出错。

Result: CAT-Free 在 WildTrack、MultiviewX、GMVD 上 MODA 分别为 82.5、84.5、65.7；在无需重调的迁移测试中，四个额外序列为 74.9，未见 8 摄像头环境为 78.6。定位不确定性与 MODA 的相关系数为 -0.98，可作为无标签可靠性估计。

Insight: 系统从视频自动估计摄像机配置并融合多视角观测，两个自适应几何过滤器按当前序列估阈值，移除不可靠定位。指标低于提供场景特定信息的监督方法，但部署条件更简单。

Abstract: Multi-camera pedestrian localization is useful for wide-area monitoring in public and commercial spaces. However, deploying these systems often requires considerable setup for each new environment. Existing methods typically require camera calibration, position annotations, or target-scene training. CAT-Free removes all three requirements. It uses synchronized RGB video as its only scene-specific input. Camera configuration is estimated directly from the video. Pedestrian locations are then estimated by combining observations from multiple cameras. Automatic camera estimation is not always accurate. This can produce unreliable pedestrian locations. CAT-Free therefore introduces two adaptive geometric filters. They remove unreliable position estimates. Their thresholds are estimated from each input sequence. CAT-Free achieves 82.5, 84.5, and 65.7 MODA on WildTrack, MultiviewX, and GMVD. It uses no supplied calibration, position annotations, or target-scene training. Published methods using such scene-specific information report 88.2–95.0 MODA on WildTrack and 83.9–96.5 on MultiviewX under their respective protocols. CAT-Free also transfers without retuning. It reaches 74.9 MODA on four additional sequences and 78.6 on an unseen 8-camera installation. Finally, localization uncertainty predicts MODA with $r=-0.98$. This provides a label-free estimate of localization reliability.

[184] MaLiang-Harness: A Programmable Path to Image and Video Generation cs.CVPDF

Haoyu Zhao, Zihao Zhang, Xudong Wang, Jiaxi Gu, Zuxuan Wu

TL;DR: MaLiang-Harness 将代码生成式图像/视频制作组织为可持久追踪的构建、检查和修订流程，专门评估程序能否把可执行指令转成满足视觉要求的内容。

Details

Motivation: 代码可以执行却仍可能不符合构图、外观或运动要求，形成程序到视觉（P2V）差距；一般代码正确率无法反映视觉结果质量。

Result: MaLiang-IBench 评估 11 个闭源模型，MaLiang-VBench 评估 4 个。GPT-6-Astra 在两个基准生成成功率均为 100%，其中 96.0% 图像任务、76.9% 视频任务达到全部质量阈值；相近通用能力分数的模型在视觉要求满足率上仍有明显差异。

Insight: PEG 保存程序及任务上下文，TGP 将修改与渲染证据关联，REV 支持回滚并在完成前检查当前版本；共同修订参照使规划、执行和视觉反馈跨渲染后端协同。

Abstract: Executable programs offer explicit control over how images and videos are constructed, but generating runnable code is only the beginning of visual creation. A program can execute correctly while violating the requested composition, appearance, or motion. We define this discrepancy as the Program-to-Visual (P2V) gap and introduce MaLiang-Harness, a unified framework for organizing MLLM-driven visual generation into a persistent process of construction, inspection, and revision. Its central design is to make the evolving visual program, its construction history, and its verification share a common revision reference. We define the Persistent Executable Generation (PEG) state as preserving programs and task context. Traceable Generation Process (TGP) connects edits to rendered evidence, and Revision-aware Editing and Verification (REV) supports restoration and checks the current revision before completion. Together, these mechanisms coordinate planning, execution, and visual feedback across rendering backends. We evaluate 11 powerful closed-source MLLMs on MaLiang-IBench and four on MaLiang-VBench, measuring generation success, visual quality, and computational cost. GPT-6-Astra achieves 100% generation success on both benchmarks, with 96.0% of image tasks and 76.9% of video tasks meeting all quality thresholds. The comparison also reveals a mismatch between general capability scores and visual generation performance, with similarly scored models differing substantially in their ability to satisfy visual requirements. MaLiang-Harness provides a systematic basis for studying how MLLMs translate executable code into visual outcomes, exposing both the potential of programmable generation and the limitations of general benchmarks as predictors of this ability. The project is available at https://github.com/gulucaptain/MaLiang-Harness.

[185] PlaylistEval: Can Video-Language Judges Be Trusted at Day Scale and Beyond? cs.CV | cs.AI | cs.CLPDF

Shayekh Bin Islam, Hwanjun Song

TL;DR: PlaylistEval 用因果受控的问题—答案对评估视频语言模型能否在最长 100 小时的视频播放列表中检索并判断证据，而非只处理数分钟视频。

Details

Motivation: 现有视频评测片段短，许多答案只看字幕即可区分，人工标注也难扩展到超长视频，因此无法确认判分模型能否从日尺度证据中推理。

Result: 基准含七个领域 630 对答案，并由框架自动生成、无需人工标注；152 对分层子集上与人类判断一致率为 93.0%（IAA 0.781）。对 17 个跨八家族模型评测时，前沿判分模型 pairwise 准确率仅 75.4%，开源模型更低；集合增长会使判分准确率下降，检索和最终判断均需要使用多模态信息。

Insight: 每对答案由受控因果退化产生，使差异需要跨整个播放列表检索才能发现；这同时构造了可扩展的判分基准，并暴露超长上下文下检索与判断的不同瓶颈。

Abstract: Video-language models are increasingly used as judges of video understanding, both for evaluating model outputs and for training reward models. Whether their judgments remain reliable when the evidence is buried in day-long videos has yet to be established. Existing benchmarks cannot answer this. Their videos are typically only a few minutes long, many answer pairs can be separated from the transcript alone, and collecting human judgments does not scale to ultra-long videos. We introduce PlaylistEval, an agentic framework that builds video-language judge benchmarks over 100-hour playlist collection without human annotation. It automatically generates questions with paired answers whose differences are controlled by causal degradation, so that every pair demands retrieval across the collection. The resulting benchmark contains 630 pairs across seven domains spanning both static and dynamic knowledge, and on a stratified subset of 152 pairs it agrees with human judgments 93.0% of the time (IAA 0.781). Evaluating 17 omnimodal and multimodal models from eight families reveals that frontier judges reach only 75.4% pairwise accuracy, while open-source judge models perform far behind. We further show that both retrieval and final judgment depend on using multiple modalities, and that judge accuracy degrades as the playlist set grows. We release our pipeline, benchmark, and evaluation code at https://playlisteval.github.io.

[186] Text-Vision Synergistic Token Caching: A Training-Free Framework for Efficient Vision-Language-Action Inference cs.CV | cs.ROPDF

Qianer Li, Chengjie Zhang, Jingwen Chen, Zanjia Tong, Jiyuan Zhang

TL;DR: TVCache 是免训练 VLA token 缓存框架，用文本语义引导视觉注意力筛选，并以文本—视觉熵差决定哪些层的视觉表示适合复用。

Details

Motivation: VLA 推理成本高，已有缓存方法未充分利用文本语义对视觉 grounding 的指导，也较少考虑注意力头可靠性和不同层缓存稳定性。

Result: 在四种 VLA、两个仿真基准及真实机器人任务中，匹配 token 保留率时 TVCache 成功率持续高于既有缓存且计算成本相当。OpenVLA-OFT 在保留 12.5% token 时，平均成功率比 VLA-Cache 高最多 14.5 个百分点，FLOPs 比全 token 推理低 2.45 倍。

Insight: 文本—视觉信息聚焦用于过滤注意力头以提高相关且物理一致的视觉 grounding；层选择则根据跨模态熵差避开不稳定表示，并将缓存资源投入更可靠层。

Abstract: Vision-Language-Action (VLA) models enable generalizable robotic control but remain computationally expensive. Token caching provides a training-free, plug-and-play acceleration alternative. However, existing VLA caching does not fully exploit a key inductive bias of VLA models: text-vision synergy, wherein textual semantics guide the precise visual grounding of task-relevant regions. In particular, existing designs insufficiently account for head-wise reliability in attention aggregation and layer-wise stability in cache reuse. To address this, we propose Text-Vision Synergistic Token Caching (TVCache), a training-free framework for efficient VLA inference. TVCache filters attention heads based on text-vision information focus to improve task-relevant and physically consistent visual grounding. Concurrently, we introduce a reuse-layer selection mechanism guided by text-vision entropy differences to avoid caching unstable representations and improve cache resource allocation. Extensive experiments across four representative VLA models, two simulation benchmarks, and real-world robotic tasks demonstrate the effectiveness and generality of TVCache. At matched token-retention ratios, TVCache consistently improves task success over existing VLA caching with comparable computational cost. On OpenVLA-OFT, it improves average success by up to 14.5 percentage points over VLA-Cache at 12.5% retention while reducing FLOPs by 2.45x relative to full-token inference.

[187] DORA: Dynamic Online Reinforcement Agent for Token Pruning in Vision Transformers cs.CVPDF

Kaixuan He, Song Chen, Yi Kang

TL;DR: DORA 为冻结 ViT 学习输入自适应的逐层剪枝策略，在每个候选层动态决定是否剪、剪多少和保留哪些视觉 token。

Details

Motivation: 现有 token 减少方法常用预设层级压缩计划或离线固定掩码，无法在线适应不同图像以及前序剪枝对后续表征造成的变化。

Result: ImageNet-1K 的 DeiT-Base 上，DORA FLOPs 减少 38.4%，准确率下降不超过 1 个百分点。四种 ViT 骨干在匹配准确率下，平均 FLOPs 比各自基线少 13.2%，吞吐高 32.4%；ImageNet-A 零样本迁移中分别扩大为少 20.3% FLOPs、吞吐高 45.6%。

Insight: 将剪枝视作有限时域 MDP；完整前缀影子评估把最终预测保真度拆成逐步信用，闭环准确率反馈把保真惩罚调到共同目标。特权 critic 和影子计算只用于训练，部署仅保留轻量 actor 和硬删除/变长 FlashAttention。

Abstract: Vision Transformers (ViTs) incur quadratic self-attention cost in the number of tokens. Most token-reduction methods adapt token identities within a prescribed layer-wise compression schedule, or search a static mask offline, and thus limit online adaptation of when and how much to prune. We propose DORA (Dynamic Online Reinforcement Agent), which learns an input-adaptive pruning policy itself for frozen ViTs. At each eligible block, a hierarchical actor decides whether to prune, how many tokens to remove, and which tokens to remove from each image’s evolving representation. Because early deletions change the states observed by later decisions, DORA formulates pruning as a finite-horizon Markov decision process. Complete-prefix shadow evaluations convert final-prediction fidelity into localized per-step credit, while closed-loop accuracy feedback adjusts the fidelity penalty toward a shared accuracy-drop target. A privileged critic and all shadow computations are training-only. Deployment retains the frozen backbone and a lightweight actor that applies hard deletion and packed variable-length FlashAttention, converting token reduction into measured speedups. On ImageNet-1K with DeiT-Base, DORA reduces FLOPs by 38.4% relative to the uncompressed backbone within one percentage point of accuracy loss. Averaged across four ViT-type backbones at matched accuracy, DORA uses 13.2% fewer FLOPs and achieves 32.4% higher throughput than the corresponding per-backbone baseline means. Under zero-shot transfer to ImageNet-A, these gains widen to 20.3% and 45.6%, respectively.

[188] MiCo: Mutual Information Coverage Optimization through Semantic Erasure Modeling for Efficient MLLM Inference cs.CVPDF

Tinghao Wang, Yichen Guo, Qizhe Zhang, Yuan Zhang, Weimin Ouyang

TL;DR: MiCo 从任务对数损失推导互信息覆盖目标，用两阶段贪心子模选择在固定预算下保留代表性且互补的视觉 token。

Details

Motivation: MLLM 视觉 token 数量大、推理昂贵；现有剪枝多依赖启发式，容易丢弃大量任务相关视觉信息并导致性能下降。

Result: MiCo 在 7B–13B 模型及覆盖图像、视频、细粒度 OCR、grounding、幻觉检测和长视频理解的广泛基准中，几乎所有模型和剪枝比例下均取得最佳成绩。LLaVA-NEXT-13B 仅保留 5.6% 视觉 token 时，保持基线性能的 97.5%，推理加速 3.8 倍。

Insight: 第一阶段用视觉信号选代表性候选池，第二阶段在池内做问题相关子集选择；可观测代理把每阶段目标实例化为单调子模覆盖函数，并用贪心算法在预算约束下优化。

Abstract: Multimodal large language models (MLLMs) have demonstrated impressive performance in multimodal understanding, but processing large numbers of visual tokens results in high computational costs. While many methods have been proposed to reduce the number of visual tokens, most of them rely on heuristics and are prone to discarding substantial visual information during pruning, leading to degradation in model performance. In this work, by using a semantic erasure model, we derive a general mutual information coverage objective from task log-loss and propose MiCo, a training-free two-stage pruning method. MiCo first uses visual signals to select a representative candidate pool before visual tokens enter the language model, then performs task-aware subset selection within it. At each stage, suitable observable proxies instantiate the derived objective as a monotone submodular coverage function, which MiCo greedily optimizes under the token budget. MiCo is evaluated on diverse MLLMs ranging from 7B to 13B parameters across a broad range of image and video benchmarks spanning general visual reasoning, fine-grained OCR and grounding, hallucination detection, and long-video understanding. MiCo consistently achieves the best performance across nearly all evaluated models under all pruning ratios. On LLaVA-NEXT-13B, MiCo uses only 5.6% visual tokens, retains 97.5% of baseline performance, and achieves a 3.8-fold inference speedup. Our experiments demonstrate the effectiveness of MiCo and our mutual information coverage objective for visual token pruning.

[189] SkillPE: Creativity-Oriented Cinematic Skill Evolution for Text-to-Video Prompt Engineering cs.CV | cs.AIPDF

Yanwei Huang, Mingxuan Zhu, Shujie Li, Shiyuan Liu, Yuanxing Zhang

TL;DR: SkillPE 从专家撰写的种子中演化可复用电影化提示技能，帮助非专业用户在文本到视频生成中平衡用户意图保真与镜头创意。

Details

Motivation: 非专业用户通常缺乏叙事、构图、灯光和声音设计经验，难通过提示获得高质量电影感视频；单纯照搬范例又难产生新颖视觉表达。

Result: 在 StoryEval 和 VBench 上，SkillPE 在 7 分制四维评估中比最强外部基线高最多 1.40 分，比种子技能高 0.51 分，并在基准原生指标上保持竞争力。

Insight: 技能细分编码镜头逻辑、构图、灯光和声音；检索的电影参考分为共鸣、弱匹配和创造性近邻，前两者决定技能应用时机与方式，近邻则在保留用户意图下激发不同程度的替代表达。

Abstract: Achieving high-quality, cinematic results in text-to-video generation remains challenging for non-experts, whose prompts often lack professional narrative and creative design. We propose SkillPE, a prompt engineering (PE) framework that evolves reusable cinematic skills from expert-authored seeds. SkillPE represents shot logic, composition, lighting, sound design, and other filmmaking cues in a fine-grained format, and retrieves movie references categorized as resonators (good matches), dissonants (weak matches), and divergents (creatively useful near-misses). The first two refine when and how a skill should be applied, while divergents inspire alternative cinematic realizations at different degrees of modification while preserving the user intent. Candidate skills are assessed through generated videos along prompt fidelity, cinematic quality, narrative appeal, and creativity to construct the final skill libraries. Experiments on StoryEval and VBench show improvements of up to 1.40 points over the strongest external baseline and 0.51 points over seed skills on 7-point four-dimensional evaluation, while remaining competitive on benchmark-native metrics. Overall, SkillPE offers a practical approach to balancing fidelity and creativity in cinematic text-to-video generation. Code is available at https://github.com/Ais0n/SkillPE .

[190] From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models cs.CV | cs.AIPDF

Bingqing Jiang, Li Luo, Zichao Yu, Yujin Han, Zhaolong Su

TL;DR: MILD通过可学习潜空间连接器和受约束的图像专家指导，把图像扩散模型的专长迁移到视频扩散模型，同时尽量保留原有运动动态与时间一致性。

Details

Motivation: 视频专家训练和调用成本较高，而图像专家更丰富、推理更便宜，适合提供美学、OCR等逐帧能力。但图像与视频潜空间不一致，图像专家也不能直接监督跨帧运动，直接迁移可能破坏时间连贯性。

Result: 在多种图像专家和视频学生骨干上，MILD持续优于视频教师式在线策略蒸馏基线；摘要未提供具体数值。实验还显示该方法可适配不同连接器设计和异构架构。

Insight: 迁移时应把图像专家的修正限制在视频学生已有预测附近，并通过光流运动奖励补足图像专家缺失的时序监督，从而利用图像模型生态而不轻易牺牲视频动态。

Abstract: On-policy distillation (OPD) specializes pretrained video diffusion models through teacher supervision along the student’s own generation trajectory. Although large video models are natural teachers, developing specialized video experts can require costly video data and training, while querying them incurs substantially higher latency than querying image experts. More readily available and cheaper to query, image experts offer a cost-effective alternative, particularly for largely temporal-agnostic capabilities such as aesthetics and OCR that admit frame-level supervision. However, heterogeneous image and video latent spaces prevent direct supervision of intermediate student states, while image experts lack cross-frame motion supervision, making temporal consistency vulnerable to frame-level improvements. In this paper, we propose MILD, a Motion-Preserving Image-to-Video Latent Distillation framework that transfers specialized image expertise while preserving pretrained video dynamics. MILD uses a learnable linear connector that aligns student latent states and predicted updates with those of image experts, enabling supervision transfer across heterogeneous latent spaces. We further constrain image-guided corrections around the pretrained student’s predictions to preserve video dynamics and incorporate an optical-flow-based motion reward to improve motion quality and temporal consistency. Across specialized image experts and multiple video-student backbones, our method consistently outperforms video-teacher OPD baselines, with further studies demonstrating effective transfer across connector designs and heterogeneous architectures. These results establish image-to-video distillation as an effective route to improving video generation by drawing on the diverse and evolving capabilities of the image-generation ecosystem.

[191] Marathoner: Ultra-Long-Horizon Autonomous Intelligence cs.CVPDF

Zhang Ruiyang, Ou Jinpeng, Xie Yifan, Zhou Jingang, Pan Lirui

TL;DR: Marathoner通过超长任务合成、拒绝采样微调和沙箱强化学习，训练能够持续执行数小时并进行上千次工具调用的自主智能体。

Details

Motivation: 现有模型在长期目标上容易中断，难以持续数月级的软件工程工作；训练数据和奖励也通常不足以覆盖需要大量连续操作的任务。

Result: 在包含超长任务的五个基准上，Marathoner稳定且显著地超过基础模型，甚至超过强专有模型；模型在高难任务上可持续工作十余小时并调用工具一千次以上。

Insight: 超长程能力需要从任务构造、轨迹监督到真实执行强化学习共同训练。阶段后期奖励明确鼓励持续开展有意义操作，有助于避免模型只在任务早期表现积极。

Abstract: Humans naturally possess the ability to work persistently toward long-term goals. Given a challenging task, humans can continuously work for months or even years to accomplish a specific objective. In this paper, we propose Marathoner, an autonomous agentic model possessing the ability of ultra-long-horizon execution. Specifically, we propose a comprehensive post-training pipeline to instill this critical capability into base model. For Ultra-Long-Horizon Task Synthesis, we leverage major release PRs containing 1000+ lines of new code from diverse GitHub repositories as the primary source for synthesizing challenging task-level data. Additionally, we introduce Multi-Task Chaining, which chains multiple generated tasks into a single more challenging task, enabling the synthesis of tasks with frontier-level difficulty. For rejection sampling finetuning, we combine strong teacher model with diverse harnesses to generate trajectories on our synthesized tasks and conduct supervised finetuning on base model with rejection sampled trajectories. For reinforcement learning, cold-started model performs real-world execution through harnesses in independent sandboxes during rollout process, effectively facilitating the acquisition of genuine ultra-long-horizon execution capability. We further propose a novel reward strategy, Later Stage Bonus Reward, which explicitly encourages model to perform meaningful maneuvers during later stages of execution. Through extensive evaluation on 5 benchmarks containing ultra-long-horizon tasks, Marathoner achieves consistent and substantial performance improvements over base model and even surpasses performance of strong proprietary model. Further analysis shows that Marathoner can consistently work for 10+ hours and conduct 1000+ tool calls on highly challenging tasks.

Zelong Xu, Yan Li, Wenhe Hu, Xiyang Hu

TL;DR: SyncRA 用视频内部匹配/错配时刻的中间音视频表征做对比对齐，改善全模态模型在时间维度上把说话内容配给正确画面的问题。

Details

Motivation: 全模态模型能分别感知音频和视觉，却常未将同一时刻的声音与画面对应，导致回答基于错误的音视频配对。

Result: 对四种不同规模和架构的开源全模态模型，在五个公开视频基准上评估；SyncRA 在所有模型—基准组合中优于仅答案微调，并明显提高受控时间配对变化下的跟踪能力。摘要未提供具体分数。

Insight: 在每个视频内部，对匹配时刻的音视频中间表示拉近、对错配时刻拉远，在共享全局上下文中学习局部时间对应。监督直接来自输入时间戳，无需人工标注，也不增加推理成本。

Abstract: Recent omni-modal models demonstrate strong perception of audio and visual inputs, yet often struggle to connect what they hear with what they see at the same moment. This weakness in temporal correspondence can cause models to associate spoken cues with the wrong visual scenes, producing plausible answers grounded in incorrect audio-visual pairings. We diagnose this problem through controlled temporal swaps, revealing that model answers do not reliably follow changes in these pairings. To address it, we propose Synchrony-Guided Representation Alignment (SyncRA), a lightweight method for strengthening temporal correspondence between audio and vision. Specifically, SyncRA contrasts intermediate audio-visual representations within each video, aligning matching moments while separating mismatched ones to capture local temporal correspondence within a shared global context. The objective derives supervision directly from existing input timing, requiring no additional annotations and leaving inference unchanged. We evaluate SyncRA across four open omni-modal models spanning different sizes and architectures on five public video benchmarks. SyncRA consistently outperforms answer-only fine-tuning across all model-benchmark combinations, while substantially improving the ability to track changing audio-visual pairings in controlled evaluations. These results demonstrate that lightweight, targeted supervision can effectively strengthen temporal correspondence and translate into broad improvements in audio-visual question answering.

Abhinav Sharma, Sai Karthik Navuluru, Wang Wei, Daksh Dangi, Xiangbo Gao

TL;DR: 本文统一刻画音视频联合生成、跨模态生成与协同编辑，并按五个设计维度梳理方法、数据集和指标，重点分析跨模态时间与语义一致性。

Details

Motivation: 音频和视频在人类感知中紧密耦合，但生成模型通常将二者分开处理，相关任务定义和设计选择分散，尤其联合音视频编辑缺少系统分类。

Result: 论文给出覆盖三类任务的统一联合分布表述，并建立五轴方法分类；针对音视频联合编辑，归纳九类编辑场景、共二十八种编辑类型，同时整理对应方法、数据集与评测指标。

Insight: 音视频生成与编辑可视为同一音视频联合分布上的不同条件化问题。比较方法时，除生成质量外，还应明确它如何在时间和语义层面维持跨模态对应。

Abstract: Video and audio are perceived together, yet most generative models treat them in isolation. We examine methods that model the two modalities jointly, generate one from the other, or edit them in a coupled manner, organized around a single question: how is the output kept coherent across modalities in time and semantics? A unified formulation casts joint generation, cross-modal generation, and joint editing as three problems defined on a single distribution over audio-visual pairs, and a taxonomy compares methods along five design axes. To our knowledge, this is the first overview to systematically taxonomize joint audio-visual editing, which we map as nine edit categories spanning 28 edit types. We describe methods, datasets, and metrics for each setting and close with the open problems we view as most consequential.

[194] CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Driving cs.CVPDF

Xiaolei Chen, Zhuolin He, Yuxuan Liang, Xu Li, Haotian Chen

TL;DR: CAR-VLA依据场景复杂度和动态风险共同选择驾驶推理模式，在低风险复杂场景中深思考，在高风险场景中聚焦危险并快速响应。

Details

Motivation: 既有驾驶视觉语言动作模型的自适应推理主要判断“是否推理”，却没有充分区分不同交通情境下应当如何推理；复杂度影响推理深度，动态风险则决定时间紧迫性与关注重点。

Result: CAR-VLA在NAVSIM v1、NAVSIM v2和Navhard上分别达到91.1 PDMS、90.3 EPDMS和35.0 EPDMS，表现具有竞争力。定性评估展示了其在高风险场景中的危险聚焦和轨迹响应。

Insight: 推理策略应同时考虑认知负荷和行动时限。对高风险场景，缩短思考并不够，模型还要把推理内容集中到关键危险和眼前安全动作。

Abstract: Existing adaptive reasoning methods for driving Vision-Language-Action (VLA) models primarily focus on whether to reason, overlooking how reasoning should differ across driving situations. Our key insight is that while scene complexity informs reasoning depth, dynamic risk is equally critical for deciding how to reason in time-critical situations. We therefore propose CAR-VLA, a unified driving VLA model that jointly considers scene complexity and dynamic risk to guide reasoning depth, urgency, and focus. CAR-VLA maps four complexity–risk categories to three reasoning modes: \textit{Fast Intuition} for direct trajectory generation in simple low-risk scenes, \textit{Slow Thinking} for deliberate reasoning in complex low-risk scenes, and \textit{Reflex Response} for compact, hazard-focused reasoning in high-risk scenes regardless of complexity. Rather than merely shortening deliberation, Reflex Response centers reasoning on the most critical hazard and the immediate safe response. We train CAR-VLA through progressive supervised learning that links scene assessment, reasoning-mode selection, and trajectory generation, followed by reasoning-augmented reinforcement learning to improve driving quality and reasoning behavior. Experiments on NAVSIM v1(91.1 PDMS), NAVSIM v2(90.3 EPDMS), and Navhard(35.0 EPDMS) demonstrate competitive driving performance. Qualitative comparisons on navtest and in-house high-risk scenarios further illustrate risk-aware reasoning and hazard-responsive trajectory generation. The code for this paper will be released publicly at: https://github.com/chenxl124578/CAR-VLA.git

[195] VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking cs.CVPDF

Zhizhen Li, Zan Wang, Huidong Peng, Bohan Tan, Shimin Shan

TL;DR: VastMAT构建覆盖337类动物的大规模多动物跟踪基准，并提出无需额外训练的CDA关联模块，以改善低重叠目标的跨帧匹配。

Details

Motivation: 通用多目标跟踪基准集中于行人和车辆，专门的动物跟踪数据则难以同时满足类别广、视频规模大和单视频多实例标注丰富等要求，也缺少对未见类别泛化的系统测试。

Result: 基准包含2,947段视频、1,002,562帧、337种动物及3,663,248个框和22,883条身份轨迹。最佳基线在已见/未见类别协议上的HOTA为66.37%/52.90%；CDA使TrackTrack分别提升1.58和1.31个百分点。

Insight: 动物形态和运动差异会加剧低重叠情况下的关联困难。将框中心距离按框自身尺度归一化，再与IoU自适应结合，可以在不训练新参数的情况下补充外观重叠信息。

Abstract: Multi-animal tracking (MAT) supports the study of animal movement, behavior, and group interactions. However, general multi-object tracking (MOT) benchmarks primarily focus on pedestrians and vehicles, whereas dedicated MAT benchmarks remain limited in jointly supporting broad animal coverage, large-scale video data, and extensive within-video multi-instance association. To address this gap, we introduce VastMAT, which has four key characteristics: (1) Large scale. It comprises 2,947 videos with 1,002,562 annotated frames, totaling 27.85 hours. (2) Broad category coverage. These videos cover 337 animal categories with diverse morphologies and motion patterns. (3) Extensive instance annotations. It provides 3,663,248 bounding boxes and 22,883 identity trajectories—to our knowledge, the largest numbers of both among dedicated MAT benchmarks. (4) High-quality annotations. To ensure reliability, annotations undergo iterative expert review and correction, and quality is assessed through an independent reannotation audit. To systematically assess tracking performance and cross-category generalization, we establish Seen-category and category-disjoint Unseen-category protocols, and evaluate eight representative MOT methods under both protocols. Under these protocols, the highest baseline HOTA scores are 66.37% and 52.90%, respectively, highlighting the challenge of tracking unseen animals. To address the low-overlap association challenge revealed by our analysis, we propose Center-Distance-Augmented Association (CDA), a lightweight module that adaptively combines IoU with center similarity normalized by the boxes’ own scales. Without additional training, CDA improves TrackTrack’s HOTA by 1.58 and 1.31 percentage points under the two protocols, respectively. To facilitate further MAT research, we will publicly release our benchmark and code.

[196] HyperDAM: Hyperspectral Distractor-Aware Memory with Amodal Expansion for SAM 3 Tracking cs.CVPDF

Ryoga Yuzawa, Tasuku Takagi

TL;DR: HyperDAM将高光谱一致性门控和因果时空遮挡扩展加入SAM 3跟踪流程，并为HOTC 2026视频集补充逐帧人工核验标注。

Details

Motivation: 高光谱信息能区分伪彩外观相近的目标，但基础跟踪器的记忆更新主要依赖空间和视觉外观，容易把干扰物写入记忆，或在遮挡和目标切换后失去目标。

Result: 系统在HOTC 2026主办方私有评测中排名第二，AUC为68.0093%，DP@20为87.7703%。数据集覆盖481段视频并补充人工核验的逐帧模态掩码和紧致框。

Insight: 光谱门控用于筛除与首帧校准光谱不一致的记忆更新，而不直接改动当前预测；冻结特征上的因果、仅向外扩展的遮挡修正则补充目标被遮挡时的形状信息。

Abstract: Hyperspectral video provides material cues that can disambiguate targets with similar false-color appearance, yet foundation-model trackers update memory primarily from spatial and appearance evidence. We present HyperDAM, a DAM4SAM3-based hyperspectral tracker with three principal contributions. First, HOTC2026-Modal adds human-verified frame-wise modal masks and mask-tight boxes to all 481 organizer-provided HOTC 2026 videos. Second, a frame-zero-calibrated HSI gate rejects spectrally inconsistent updates to the distractor-resolving memory (DRM) without altering the current prediction. Third, a causal spatiotemporal expander adds outward-only amodal corrections from frozen SAM features. Static-scene recovery and empty-mask RTS smoothing address target switches and full occlusion. Model selection prioritizes cross-domain robustness over leaderboard-specific optimization. The final system ranked second in HOTC 2026, achieving 68.0093% AUC and 87.7703% DP@20 in the organizer’s private evaluation.

[197] Distilling Visual Reasoning into Text Space cs.CVPDF

Wenhan Yang, Nilay Naharas, Ali Payani, Baharan Mirzasoleiman

TL;DR: V2T通过教师模型的图文交错推理蒸馏，把视觉推理能力内化到文本推理链中，使学生推理时无需生成中间图像或视觉令牌。

Details

Motivation: 视觉语言模型对需要超越图像直接可见内容的推理仍有困难。生成中间图像或潜视觉令牌虽能辅助思考，却可能引入错误，并随着推理推进干扰文本推理。

Result: 在多个多模态推理基准上，V2T超过教师及已有基线：留出集合平均准确率提升14.3%，更广泛视觉评测套件提升2.7%；相较先进基线，训练速度最高提升42倍。

Insight: 先用图文交错思维链训练教师，再以教师logits和文本推理监督蒸馏学生，可将视觉推理转化为推理时更稳定的文本能力；可映射回原图的区域注意力和框标注还可用于额外监督。

Abstract: Large Vision-Language Models (LVLMs) have shown strong promise for multimodal reasoning, yet often struggle with tasks requiring concepts beyond what is directly observable in the input image. Existing methods generate intermediate images or latent visual tokens to guide reasoning, but these representations can introduce errors and increasingly interfere with textual reasoning as reasoning progresses. We propose Visual-to-Text Chain-of-Thought Distillation (V2T), a framework that enables LVLMs to internalize visual reasoning without generating intermediate visual representations at inference time. V2T first trains a teacher LVLM using interleaved visual and textual chains of thought, and then uses knowledge distillation to train a student LVLM using the teacher’s logits and cross-entropy supervision from ground-truth textual reasoning. When reasoning images can be mapped to the original image, V2T can additionally distill the teacher’s attention to corresponding regions, while ground-truth bounding boxes can further guide a subsequent reinforcement learning stage. Experiments across multiple multimodal reasoning benchmarks show that V2T consistently outperforms the teacher and existing baselines, improving average accuracy by 14.3% on a held-out set and 2.7% on the broader visual evaluation suite. Moreover, lightweight SFT and substantially reduced RL make V2T up to 42x faster to train than state-of-the-art baselines.

[198] Clinical Trajectory Alignment for Medical Vision-Language Pre-training cs.CVPDF

Huimin Yan, Xian Yang, Zhi Wang, Liang Bai

TL;DR: MedCTA将医学视觉语言预训练从单次就诊的图文匹配扩展为异常级和患者病程级的纵向变化建模。

Details

Motivation: 传统访问级图像与报告对齐难以监督异常随时间改善、稳定或恶化；报告中的时间语义是隐式的，同一患者不同异常还可能以不同甚至相反方向演变。

Result: MedCTA在时间图像分类、图文检索和零样本分类任务上相较强医学视觉语言基线取得一致提升；摘要未给出具体提升数值。

Insight: 患者病史不宜压缩为单一时间向量。异常级轨迹可保留不同病灶的异步演变，患者级全局序列则补足整体临床进程；离线解析纵向报告可提供趋势监督而无需人工时间标注。

Abstract: Medical vision-language pre-training largely follows a visit-level image-report matching paradigm, aligning paired images and reports at individual visits. While effective for static cross-modal correspondence, this paradigm provides limited supervision for longitudinal clinical change, such as whether abnormalities improve, remain stable, or worsen over time. Learning such change is challenging because temporal semantics are implicit in free-text reports, and different abnormalities within the same patient may evolve asynchronously or even in opposite directions. We propose MedCTA, which reframes medical vision-language pre-training from visit-level cross-modal matching to learning clinical change. Rather than compressing a patient history into a single temporal representation, MedCTA models clinical change at two complementary scopes. At the abnormality scope, clinically grounded queries construct abnormality-conditioned visual and textual trajectories to capture heterogeneous abnormality evolution. At the patient-course scope, global image and report sequences are modeled to capture overall clinical progression beyond any individual abnormality. Structured trend supervision is extracted from longitudinal reports by an offline LLM parser, removing the need for manual temporal annotations. Combined with static image-report alignment, MedCTA learns representations that preserve visit-level cross-modal correspondence while encoding longitudinal change semantics. Experiments on temporal image classification, image-text retrieval, and zero-shot classification show consistent gains over strong medical vision-language baselines.

[199] Precise Editing and Flexible Referencing for Interactable Worlds cs.CV | cs.AIPDF

Xinyao Liao, Xianfang Zeng, Zhu Liang, Zhoujie Fu, Qianxun Xu

TL;DR: EditWorld支持在自回归生成过程中持续接收编辑指令和参考图像，把交互式世界模型从导航扩展到精确内容修改。

Details

Motivation: 现有视频世界模型大多让用户探索生成环境，对已生成内容如何精确修改缺乏控制，也难以在长时生成中维持动态条件与参考图像。

Result: 作者构建WBench-Editing评测集；EditWorld总分73.8、编辑分80.0，在该基准上总体最佳，并在编辑相关指标上显著超过已有方法。

Insight: 门控因果注意力负责处理随时间变化的编辑条件和参考图像，稀疏上下文则限制历史长度以支持长程推理；配合自回归与双向训练及自重采样，可训练更可控的流式编辑。

Abstract: We present EditWorld, a video world model for precise editing and flexible referencing in interactable worlds. Existing video world models primarily focus on navigation, letting users explore generated worlds but offering limited control over how existing world content is modified. EditWorld extends world modeling from exploration to precise modification by streaming editing instructions and reference images during autoregressive generation. To support these capabilities, EditWorld introduces Gated Causal Attention for temporally varying editing conditions and reference images, together with a Sparse Context mechanism that maintains a bounded historical context for long-horizon inference. We further adopt joint autoregressive and bidirectional training with annealed self-resampling, and construct a dedicated data synthesis and annotation pipeline that provides supervision for world editing. We also present WBench-Editing to systematically evaluate streaming world editing capabilities. EditWorld achieves the best overall performance on WBench-Editing with an overall score of 73.8 and an editing score of 80.0, substantially outperforming existing methods on editing-related metrics. https://github.com/leoisufa/EditWorld

[200] VL-AcneSeg: A Vision-Language Framework for Region-Aware Acne Lesion Segmentation cs.CV | cs.AIPDF

Sukju Oh, Soo Ick Cho, Dae Hun Suh, Sukkyu Sun

TL;DR: VL-AcneSeg利用CLIP和区域级文本提示进行痤疮病灶分割，并以无需病灶位置先验的全局提示作为主要评估设置。

Details

Motivation: 传统痤疮分级和计数带有主观性，也忽视病灶面积；虽然按面积评估更有潜力，现有分割方法仍多依赖通用架构，且实际应用中不能假定事先知道病灶所在面部区域。

Result: 内部临床数据上，全局提示取得Dice 0.5082、IoU 0.3407，为对比方法中最高；区域提示进一步达到0.5296和0.3602。分割面积与IGA评分相关系数为0.719，超过专家标注面积的0.658；外部数据上也保持稳定。

Insight: 区域提示可提供空间先验，但以无区域信息的全局提示作为主协议更能检验真实部署能力。由分割面积估计严重度，在无需额外训练适配的情况下可推广到非受控手机图像。

Abstract: Acne assessment is crucial for clinical decision-making, yet traditional grading and counting are subjective and fail to account for lesion size. While area-based assessment has emerged as a promising alternative, acne segmentation has continued to rely on general-purpose architectures. To address this gap, we propose VL-AcneSeg, a multimodal framework for acne lesion segmentation that leverages CLIP and region-level text prompts to incorporate spatial priors, enabling lesions to be localized across the whole face. Because region-level prompts indicate which facial areas contain lesions, we report a single global prompt, which requires no such information, as our primary setting. On our internal clinical dataset, VL-AcneSeg achieves a Dice score of 0.5082 and an IoU of 0.3407 under this protocol, the highest among all compared methods, including recent vision-language segmentation methods that are themselves given region-level prompts; region-level prompting raises these to 0.5296 and 0.3602. Moreover, lesion area measurements derived from our segmentation correlate with IGA scores at a level comparable to expert annotations (Pearson r = 0.719 versus 0.658). Notably, our framework maintains consistent performance across external validation datasets, performing reliably even on uncontrolled smartphone images without requiring additional training or fine-tuning. By pairing a protocol that requires no lesion-location information with area-based severity estimation, this work provides a foundation for objective acne assessment outside the clinic. Our implementation is publicly available at: https://github.com/sukjuoh/VL-AcneSeg

[201] SentZero: An Enhanced Sentence-Centric Vision-Language Pretraining for Multi-Task Zero-Shot Chest X-Ray Analysis cs.CV | cs.AIPDF

Hangyul Yoon, Hyungyung Lee, Edward Choi, Eunho Yang

TL;DR: SentZero通过报告句子结构化、正样本扩展、假负例缓解和句子条件视觉调制，增强胸片视觉语言预训练的多任务零样本能力。

Details

Motivation: 胸片报告临床信息密集且篇幅长，简单零样本提示难以对齐，现有视觉语言模型因而常依赖任务微调。句子级方法虽有帮助，但正样本多样性有限，临床等价句还会在对比学习中被误当作负样本。

Result: 在多种下游任务和数据集上，SentZero提升零样本泛化，并超过既有多任务零样本方法；摘要未报告具体数值。

Insight: 将报告先按摘要层级整理成临床句子并扩展图文正配对，再减少等价表达造成的假负例，可改善监督信号；按句子调制视觉残差特征还能让图像表征适应当前语义。

Abstract: Vision-language (VL) pretraining using paired chest X-ray (CXR) images and radiology reports has shown strong potential for medical image understanding. However, existing methods often remain dependent on task-specific finetuning because radiology reports are lengthy, clinically dense, and difficult to align with simple zero-shot prompts. Recent sentence-level approaches partially address this limitation using clinical phrases extracted by large language models (LLMs), but they largely overlook the intrinsic characteristics of radiology discourse. In particular, limited positive-pair diversity constrains further gains, while clinically equivalent sentences frequently recur across patients, creating false negatives in contrastive learning. To address these issues, we propose SentZero, an enhanced sentence-centric VL pretraining framework for zero-shot, multi-task CXR analysis. SentZero introduces LLM-based abstract-level sentence structuring and mapping to expand positive-pair diversity, together with an additional loss term to mitigate false negatives. We further introduce sentence-conditioned residual modulation of visual embeddings, enabling visual features to adapt to the semantic characteristics of each input sentence. Across diverse downstream tasks and datasets, SentZero improves zero-shot generalization and outperforms prior multi-task zero-shot methods.

[202] Evidence Before Accuracy: A MRI-PET Fusion Network for Alzheimer Disease Classification with Causal Regional Validation cs.CVPDF

Saeid Firouzi Daghigh, Saeed Ayat

TL;DR: 本文以多平面MRI与FDG-PET融合分类阿尔茨海默病，并通过快捷线索控制、脑区消融和归因分析验证模型依据是否符合神经生物学证据。

Details

Motivation: 阿尔茨海默病分类论文常报告接近完美的性能，却很少证明模型确实利用疾病相关脑区，而非数据泄漏、背景内容或其他数据集伪线索。单看准确率无法建立这种证据。

Result: 在554名ADNI受试者上，融合模型AUC为0.962、准确率0.909、F1为0.891。轮廓、图像外部和空白快捷线索控制的AUC分别降至0.622、0.608和0.500；置换标签为0.456。MRI内侧颞叶与PET后部默认网络各自保留89.2%和79.0%的超随机判别能力。

Insight: 证据链由多种互补检验组成：快捷线索和标签置换排查伪相关，正向与反向ROI消融检验必要性和充分性，归因富集检查定位。结果显示MRI主要依赖海马相关证据、PET主要依赖后扣带回相关证据。

Abstract: Deep learning models for Alzheimer disease (AD) classification routinely report near-perfect discrimination, yet few are shown to rest on AD-relevant neurobiology rather than on dataset artifacts, subject-level leakage, or non-brain image content. We present a fusion network combining T1 MRI and FDG PET across axial, coronal, and sagittal planes, trained on ADNI consists of 554 paired subjects. The fusion model reaches AUC 0.962, accuracy 0.909, and F1 0.891, competitive with recent 3D CNN and multimodal transformer systems at substantially lower cost. We first quantify how much modality, plane and slice geometry matter. A validation-only search over slice centres and neighbour spacings moves AUC by 0.180 for MRI and 0.078 for PET, selecting narrow spacing for MRI and wide spacing for PET, with the chosen coronal centres falling on the hippocampal body and on the posterior cingulate respectively. The contribution, however, is the evidence layer built around that number. Shortcut controls collapse the model to AUC 0.622 (silhouette), 0.608 (exterior), and 0.500 (blank), and a label-permutation null yields 0.456. Forward region-of-interest (ROI) ablation shows that masking medial temporal cortex in MRI and the posterior default-mode network (DMN) in PET produces the largest shift in the AD logit, while area-matched controls remain indistinguishable from that null. Reverse ROI ablation shows that the medial temporal lobe alone retains 89.2% of above-chance discrimination in MRI and the posterior DMN alone retains 79.0% in PET. A quantitative comparison of attribution methods shows occlusion sensitivity reaching 3.5-5.0* enrichment inside a priori AD regions against 0.10-0.43* in controls. Ablation and attribution independently establish a biologically correct double dissociation: hippocampal evidence is carried by MRI, posterior cingulate evidence by PET.

[203] SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytelling cs.CVPDF

Xinyu Wang, Huafeng Shi, Zian Li, Yan Zhou, Xiaoqiang Liu

TL;DR: SubjectAnchor从先前镜头检索主体视觉记忆，并以显式记忆条件生成当前镜头，从而提升多镜头故事中的人物身份和场景连续性。

Details

Motivation: 逐镜头提示便于控制故事情节，但镜头切换时容易导致主体外观和场景不一致；整段统一生成则可能削弱镜头级可控性。

Result: 基于Wan2.2-I2V-A14B的实验显示，SubjectAnchor相较代表性的记忆式和整体式基线提高跨镜头身份一致性，同时保持有竞争力的视觉质量；摘要未提供数值。

Insight: 将历史镜头中的相关主体关键帧作为显式视觉条件，并为不同主体分配隔离的负时间位置，可减轻身份串扰；记忆感知注意力进一步控制记忆token与当前生成内容的交互。

Abstract: We present SubjectAnchor, a Subject-Aware Memory-to-Video paradigm for multi-shot storytelling in which the current shot is generated by conditioning on explicit visual memories extracted from previous shots. The objective is to preserve subject identity and scene consistency across cuts while retaining the controllability of shot-wise prompting. Built on Wan2.2-I2V-A14B, SubjectAnchor contains three key components: subject-related memory construction, subject-aware temporal rotary position encoding, and memory-aware attention partition. For each target shot, the method constructs a compact memory bank by tracing each required subject to its historical appearance and retrieving the most relevant precomputed keyframes. These memory frames are encoded into the model input as explicit visual conditions, while different subjects are assigned to separated negative temporal slots to reduce identity interference. In addition, memory-aware attention partition regulates the interaction between memory tokens and generated content within a shared backbone. This formulation preserves the appearance anchoring of explicit visual memory while remaining compatible with script-driven shot-by-shot generation. Experiments show that SubjectAnchor improves cross-shot identity consistency over representative memory-based and holistic baselines while maintaining competitive visual quality.

[204] TSGate: Timestep-Aware Gated Attention for Diffusion Transformers cs.CVPDF

Boyu Zhang, Yifan Liu, Shuxia Lin, Qingjian Ni, Yinfei Xu

TL;DR: TSGate让扩散Transformer的注意力门控随去噪时间步变化，缓解自由格式和分布外提示下的图像生成质量下降。

Details

Motivation: 扩散Transformer使用结构化提示训练后，面对用户推理时输入的自由描述等分布外提示，生成质量可能显著退化。提示改写不保证回到训练分布；仅抑制注意力汇聚也不足以恢复质量。

Result: 在多个基准上，TSGate持续优于基础模型和标准门控注意力；原始提示下的DPG分数较基线提升9.5%。

Insight: 分析发现问题还涉及早期去噪阶段图像到文本注意力降低。把时间步条件偏置加入门控信号，可使不同去噪阶段采用适宜的注意力门控，而不是全程使用同一策略。

Abstract: Diffusion Transformers (DiTs) have emerged as the dominant architecture for high-fidelity image and video generation. Recent DiT systems increasingly use structured prompts for training, improving caption quality and prompt adherence. However, their generation quality can degrade severely under out-of-domain (OOD) prompts, including the free-form descriptions supplied by users at inference time. Although LLM-based rewriting can convert these prompts into structured formats, it does not guarantee that the rewritten prompts align with the training distribution. Our analysis links this degradation to attention sinks and reduced early-step image-to-text attention and shows that sink suppression alone is insufficient to restore generation quality. Despite effective sink suppression, models trained with standard gated attention exhibit reduced early-step image-to-text attention and suboptimal generation quality. Based on these insights, we propose Timestep-Aware Gated Attention (TSGate), which injects a timestep-conditioned bias into the gate signal so that gating behavior adapts across denoising steps. Extensive experiments show that TSGate consistently outperforms both the baseline and standard gated attention across multiple benchmarks, improving the raw-prompt DPG score by 9.5% over the baseline.

[205] Preference-Guided Adaptation for Open-Vocabulary Semantic Segmentation via Prompt Disagreement cs.CVPDF

Hyun-Kurl Jang, Jihun Kim, Kuk-Jin Yoon

TL;DR: 该框架利用不同文本提示对同一图像产生的分割分歧，定位不确定区域并以局部二元偏好适配开放词汇分割模型，无需像素级标注。

Details

Motivation: 开放词汇语义分割在医疗、遥感和工业等专门领域性能会下降，而获取稠密像素掩码成本高且需要领域专家，限制了模型适配。

Result: 在MESS基准及多种开放词汇分割骨干上，方法无需像素级标注即可稳定提升性能，并能应对带噪偏好；摘要未报告具体增益。

Insight: 模板间分割差异本身可作为偏好监督来源。只在高不确定区域挖掘局部偏好查询，同时对查询区域之外施加一致性约束，可把稀疏反馈用于定向适配并减少无关区域退化。

Abstract: Open-vocabulary semantic segmentation (OVSS) enables pixel-level prediction over arbitrary text-specified vocabularies and has shown strong generalization on common benchmarks. However, OVSS performance often degrades in specialized domains such as medical imaging, remote sensing, and industrial inspection, where dense pixel-level masks for adaptation are costly to obtain and require domain-specific expertise. We propose a preference-guided adaptation framework that replaces dense mask supervision with binary preferences. We observe that different prompt templates produce systematically different segmentations for the same image, a phenomenon we call prompt disagreement, and we repurpose it as a built-in source of preference supervision. Building on this, we mine localized preference queries from regions of high cross-template uncertainty, and adapt the OVSS model with Region-Localized Preference Optimization (RLPO) together with consistency regularization that stabilizes updates outside the queried region. Across extensive experiments on the MESS benchmark, the proposed method achieves consistent gains across diverse OVSS backbones without any pixel-level annotation, and remains effective under noisy preferences. Our code is available at https://github.com/blue-531/pref-ovss.

[206] ActionLens: Diagnosing Spatial-Temporal Binding Failures in Vision-Language Models cs.CV | cs.AI | cs.CLPDF

Gueter Josmy Faure, Min-Hung Chen, Hao Ping Wang, Timothée Lardy, Hung-Ting Su

TL;DR: ActionLens用6,701道视频选择题诊断视觉语言模型是否能把正确动作绑定到正确人物和时刻，并区分多种时空关联失误。

Details

Motivation: 视频视觉语言模型在常见基准上得分虽高，却仍可能把动作归给错误人物或时间点。总体准确率无法区分转场、人物识别、并发动作、定向互动和视线判断等具体缺陷。

Result: 基准覆盖五类诊断，答案由每秒、逐人共158万条标注确定。20个模型中全量集最高分68.8%，人工审阅子集最高65.9%，低于人类参考的91.0%；视线检测接近随机水平。关系描述较静态坐标高5.55至13.25分，但视觉框仍领先1.15至6.50分。

Insight: 模型常系统性地把动作绑定给错误人物。界面控制实验表明，坐标数字解析负担解释了部分差距，但即使提供人物框仍有残余身份消歧缺口，说明评估需区分输入接口与视觉绑定本身的错误。

Abstract: Video-capable vision-language models score above 80% on popular benchmarks yet struggle with spatial-temporal binding: associating the right action with the right person at the right moment. We introduce ActionLens, a diagnostic benchmark of 6,701 multiple-choice video questions spanning five targeted diagnostics: transition detection, actor-specific identification, concurrent action binding, directed interaction reasoning, and gaze detection. Ground-truth answers are derived deterministically from 1.58 million per-second, per-person annotations. Fourteen rounds of human quality engineering raised answer clarity from 53% to above 90% human accuracy. Across 20 VLMs, the full-set leader scores 68.8%; on the human-reviewed subset, it scores 65.9% versus 91.0% for the pooled human reference. Gaze detection remains near chance against 89.6% human accuracy. On actor disambiguation, reference-interface controls show that relational descriptions recover 5.55–13.25 points over static coordinates, confirming a substantial numeric-parsing penalty; yet visual boxes still lead every model by 1.15–6.50 points, exposing a residual unboxed actor-resolution gap. A binding-trap analysis shows models systematically select the wrong actor’s action. ActionLens provides diagnostic measurements of these distinct failure modes across model families and scales for direct comparison. We release all data, code, and evaluation scripts at https://anonymous.4open.science/r/lmms-eval-2276

[207] GLF-Q: Global-Local Feature-based Quantization for Vision Transformers cs.CVPDF

Peilin Sun, Guang Liang, Jin Tong, Jianxin Wu

TL;DR: GLF-Q通过全精度下游层提供全局特征监督、结合局部输出正则化和零运行时开销的Hadamard变换，改善视觉Transformer的低比特后训练量化。

Details

Motivation: 低比特ViT后训练量化容易显著掉点。基于logit的块重建可能在有限校准数据上过拟合，Hessian近似又会产生结构截断误差。

Result: 在代表性ViT图像分类任务中，配合标准均匀量化器的GLF-Q在3比特设置下显著超过先进方法；对分布外校准更稳健，并在8比特GPU部署中实现加速。摘要未列出具体精度数值。

Insight: 将量化块输出继续通过后续全精度网络传播，以末层表示对齐实现下游特征监督，不必显式近似Hessian或使用泰勒展开。离线Hadamard变换将异常激活分散到通道中，降低动态范围且不增加推理开销。

Abstract: Post-training quantization (PTQ) efficiently compresses Vision Transformers (ViTs) without retraining, yet suffers severe accuracy degradation at low bit-widths. Existing optimization-based PTQ methods guide block reconstruction via either soft logits or second-order Hessian proxies. Logit supervision is prone to overfitting on limited calibration data, while Hessian approximations incur structural truncation errors. To address these limitations, we propose \textbf{GLF-Q}, a novel PTQ framework guided by Global-Local Feature alignment. GLF-Q propagates quantized block outputs through downstream full-precision layers to align penultimate-layer representations under local output regularization, providing downstream feature supervision without explicitly approximating the Hessian or using a Taylor expansion. Furthermore, offline Hadamard transformations are introduced with zero runtime overhead to disperse activation outliers across channels, effectively contracting dynamic ranges and reducing quantization errors. Meanwhile, optimizing this loss via a Straight-Through Estimator (STE) achieves rapid convergence, bypassing continuous relaxation rounding formulations such as AdaRound. Extensive experiments across representative ViT architectures demonstrate that GLF-Q with standard uniform quantizers substantially outperforms state-of-the-art methods under 3-bit quantization on image classification. In addition, GLF-Q exhibits strong out-of-domain calibration robustness and achieves speedups under 8-bit GPU deployment.

[208] Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence cs.CV | cs.CL | cs.LGPDF

Xi Xiao, Tianchen Zhao, Youngeun Kim, Zhuowei Li, Linghan Xu

TL;DR: ReaLVR针对潜视觉推理轨迹加入视觉证据监督，让隐式latent token更敏感于决定答案的图像区域，并在多种模型规模上提升推理表现。

Details

Motivation: 潜空间视觉推理允许模型通过连续token进行中间计算，但这些token不可直接观察，难以监督其学到什么。作者发现潜token对会改变正确答案的图像扰动响应较弱，认为仅用最终答案奖励不足以指导证据保留和token信用分配。

Result: 三个模型系列中，ReaLVR均超过所评估的潜推理基线；Qwen2.5-VL-7B五任务平均准确率最高为63.7%，并在最大235B规模上仍带来稳健提升。

Insight: 在模型自由生成的潜轨迹上对比正确答案与模型错误答案，确定需要加强监督的位置；再对照相关与不匹配视觉证据，指定潜token应保留的信息。由此增强问题敏感性和潜token与关键区域的对齐。

Abstract: Latent visual reasoning (LVR) enables multimodal large language models (MLLMs) to perform intermediate computation in continuous latent tokens rather than expressing every reasoning step in words. However, unlike textual CoT, latent reasoning is not directly observable, making it difficult to supervise what latent tokens learn. In this work, we first conduct a thorough analysis of latent-token behavior and identify a latent evidence-credit gap: latent tokens respond only weakly to image perturbations that alter the correct answer. We hypothesize that this issue stems from the lack of explicit supervision during GRPO training. These findings suggest that a final-answer reward provides too little guidance on what visual evidence to preserve or how credit should be assigned across latent tokens. To bridge this gap, we propose ReaLVR, which brings visual-evidence supervision to the model’s own free-running latent trajectories. ReaLVR contrasts correct and model-generated wrong answers to determine where stronger supervision is needed, and relevant and mismatched visual evidence to specify what to preserve. Across three model families, ReaLVR consistently outperforms evaluated LVR baselines, achieving the highest five-task average of 63.7% on Qwen2.5-VL-7B. Crucially, we are the first to scale visual reasoning in latent space, showing that our framework continues to deliver robust improvements at frontier model scales up to 235B. Further analyses show more question-sensitive latent-token positions, stronger alignment with relevant visual regions, and greater fixed-context dependence on the most attended latent tokens.

[209] ACPruner: Visual Token Pruning as Biased Attention Coverage Maximization in LVLMs cs.CVPDF

Xu Li, Yuxuan Liang, Yi Zheng, Zhe Liu, Xiaolei Chen

TL;DR: ACPruner把LVLM视觉token裁剪建模为带重要性偏置的注意力覆盖最大化，并用贪心选择实现免训练推理加速。

Details

Motivation: LVLM处理大量视觉token带来明显计算开销。既有裁剪要么保留单独看起来重要的token，要么偏重彼此多样性，难以保证选出的紧凑子集共同覆盖图像中的关键信息。

Result: 在LLaVA、Qwen2.5-VL等多个骨干上的实验显示，ACPruner能较好保持性能并显著提高端到端推理速度；摘要未报告具体速度或保留比例。

Insight: 先综合视觉内部显著性与文本相关性估计token重要程度，再根据视觉编码器注意力衡量其共同覆盖，最后贪心选取覆盖收益最大的token，可兼顾信息优先级和集合覆盖。

Abstract: Large Vision-Language Models (LVLMs) face significant computational inefficiencies caused by the large number of visual tokens. Existing visual token pruning methods mainly focus on either retaining individually important tokens or selecting mutually diverse ones. In this work, we revisit visual token pruning from a coverage perspective and formulate it as a biased attention coverage maximization problem. The key idea is to select a compact token subset whose encoder-side outgoing attention can jointly cover the image while assigning higher coverage priority to more informative regions. From this perspective, we propose ACPruner, a training-free visual token pruning framework for efficient LVLM inference. ACPruner first estimates token importance by combining intra-modal saliency and inter-modal relevance, then derives token-wise coverage from attention patterns within the vision encoder, and finally performs greedy selection to maximize the proposed coverage objective. Extensive experiments across multiple LVLM backbones, including LLaVA-1.5-7B/13B, LLaVA-NeXT-7B/13B, Qwen2.5-VL-7B, and LLaVA-OneVision-7B, show that ACPruner consistently achieves strong performance retention while delivering substantial end-to-end inference speedups.

[210] Recent Advances in Agentic Agri-Robotic Phenotyping: A Perspective Review from Fragmented Multimodal Sensing to Unified PhenoAgent Intelligence cs.CV | cs.ETPDF

Muhammad Owais, Ehtesham Iqbal, Samee Ullah Khan, Muhammad Umraiz, Yusra Abdulrahman

TL;DR: 本文回顾农业机器人表型分析从碎片化多模态感知走向统一作物智能的进展，并提出PhenoAgent概念以支持有证据、带不确定性的作物状态判断和管理建议。

Details

Motivation: 成像、机器人平台、多模态传感和深度学习不断进步，但现有表型系统仍分散于传感模态、作物性状、生长阶段、环境和管理目标，缺乏时间整合、多模态推理、生物学解释及可执行决策支持。

Result: 论文综合传统、高通量、机器人和AI表型方法，并将问题统一为种子—土壤—植物—环境—管理（SSPEM）系统；提出PhenoAgent框架愿景，梳理数据稀缺、标注、基准、泛化和可解释性等挑战。

Insight: 作物性能应视为种子质量、根区条件、植株发育、环境暴露与管理动作共同作用的结果。智能系统除估计性状，还应说明当前发生了什么、可能原因、证据缺口，以及可考虑的管理行动或新增测量。

Abstract: This review examines the evolution of plant phenotyping from conventional manual trait measurement to high-throughput, robotic, and artificial intelligence-driven crop monitoring. Despite significant advances in imaging, autonomous platforms, multimodal sensing, and deep learning, current phenotyping systems remain fragmented across sensing modalities, crop traits, growth stages, environments, and management objectives. We therefore frame phenotyping as an integrated \emph{seed-soil-plant-environment-management} (SSPEM) intelligence problem, where crop performance reflects interactions among seed quality, root-zone conditions, plant development, environmental exposure, and management actions. The review synthesizes conventional, high-throughput, robotic, and AI-driven phenotyping approaches, highlighting their capabilities and persistent limitations in temporal integration, multimodal reasoning, biological interpretation, and actionable decision support. Building on this analysis, we introduce a conceptual PhenoAgent framework that extends phenotyping beyond the estimation of isolated traits to evidence-based crop-state interpretation, uncertainty-aware reasoning, and management-oriented support. The PhenoAgent concept primarily brings together scattered advances in phenotyping to deliver insights ranging from detailed to high-level, such as what is happening in the crop, why it might be occurring, what evidence is missing, and what actions or additional measurements should be considered. We also discuss challenges in dataset scarcity, annotation, benchmarking, model generalization, and explainability. By linking multimodal phenotyping with agentic AI and closed-loop decision support, this review outlines a path to interpretable, scalable, and deployment-oriented crop intelligence.

[211] GenNVS: Geometry-enhanced Novel View Synthesis via Disentangled 3D Prior cs.CV | cs.AIPDF

Yajiao Xiong, Youyu Luan, Xiaoyu Zhou, Yongtao Wang

TL;DR: GenNVS以解耦的3D先验重建前景与背景场景，再用几何感知的双流遮罩条件引导视频扩散模型合成新视角。

Details

Motivation: 单图新视角合成存在严重几何歧义。扩散方法虽能生成逼真画面，但容易破坏前景物体的三维结构和空间连贯性。

Result: 实验表明GenNVS在视觉质量和几何准确性上优于或媲美近期方法，并支持灵活场景编辑；摘要未提供具体量化成绩。

Insight: 分别用3D高斯表示前景和背景，再通过由粗到细的几何优化对齐成统一场景，可把显式空间结构引入视频生成；渲染有效性掩码与几何变形共同约束合成。

Abstract: Single-image novel view synthesis remains challenging because the underlying 3D geometry is highly ambiguous. Recent diffusion-based approaches produce plausible results, but they often struggle to preserve the geometric structure and spatial coherence of foreground objects. We present GenNVS, a framework for geometry-enhanced novel view synthesis via a disentangled 3D prior. Specifically, GenNVS models foreground objects and the background with 3D Gaussian Splatting and aligns them through a coarse-to-fine geometric optimization process to form a unified 3D scene. This scene conditions a video diffusion model through the proposed Dual-Stream Masking mechanism, which guides synthesis by jointly exploiting rendered validity masks and geometry-aware warping. Experimental results show that GenNVS performs favorably against recent methods in both visual quality and geometric accuracy, while naturally supporting flexible scene editing.

[212] Counterfactual Attention Policy Distillation for Temporal Video Grounding cs.CVPDF

Shaobo Ju, Haiyang Yu, Xuecheng Wu, Qiong Wu, Jiacong Wang

TL;DR: CAPD用遮蔽不同视频时间片段对教师输出分布的反事实影响来校准注意力和token蒸馏权重，提升多模态模型的时间定位能力。

Details

Motivation: 长视频中的重复动作和相似场景会干扰事件边界定位。标准在线策略蒸馏虽能监督学生生成轨迹，但逐token模仿教师输出难以指出哪些具体片段支撑时间戳预测。

Result: 仅用2,500条样本训练一个epoch后，在TimeLens上相较GRPO平均召回率提高12.0%，同时保留一般视频理解能力，准确率与基础模型相当。

Insight: 逐组遮蔽时间片段并观察教师分布变化，可估计相应视频证据对预测的因果影响；把该影响用于调整教师注意力和token级蒸馏权重，有助于让学生学到真正决定边界的片段。

Abstract: Temporal video grounding is a key capability of advanced \emph{Multimodal Large Language Models} (MLLMs) for the thorough understanding of video events, which is however often limited by repeated actions and visually similar contexts in long videos. In this paper, we study this issue from the perspective of \emph{On-policy distillation} (OPD) and propose a new training regime for MLLMs termed \emph{Counterfactual Attention Policy Distillation} (CAPD). In particular, OPD is a viable solution for MLLMs via providing dense teacher supervision on student-generated trajectories. But its next-token based teacher-student distillation is hard to identify the specific video segments supporting each predicted timestamp, which is critical for temporal grounding. In this case, CAPD measures how masking each temporal group changes the teacher’s output distribution. The resulting counterfactual influence calibrates the teacher’s attention and weights token-level distillation, allowing the student to learn the temporal evidence that affects boundary prediction. To validate CAPD, we trained it on Qwen3-VL-8B-Instruct using only 2,500 samples for one epoch, and evaluated it on the TimeLens and multiple general video benchmarks. Experimental results show that CAPD improves average recall by 12.0% relative to GRPO on TimeLens while preserving general video understanding, achieving comparable accuracy to the base model.

[213] WorldAttention: An Efficient Attention Architecture for Interactive Video World Models cs.CVPDF

Zeyu Zhang, Jinyuan Mao, Dakai An, Wangbo Zhao, Hanfeng Lu

TL;DR: WorldAttention用混合稀疏注意力与分层KV缓存组织长期视频历史，在保留长程交互上下文的同时控制计算量和GPU显存。

Details

Motivation: 交互式视频世界模型需要低延迟、长时生成。滑动窗口会丢失较早历史，损害长程交互；完整历史缓存又因注意力计算开销和KV缓存线性增长而难以部署。

Result: 在VBench-Long和InterVBench上，WorldAttention持续超过此前方法；主体一致性分别达到0.9472和0.9668。

Insight: 线性全局注意力搭配按头自适应稀疏注意力，降低处理完整上下文的开销；语义索引的分层KV页面则支持分层存储与精细检索，只让受控部分驻留GPU。专用内核帮助把设计效率落实到系统运行中。

Abstract: Leveraging the paradigm of autoregressive diffusion, text-conditioned interactive video world models aim to simulate temporally coherent environments guided by textual instructions. While enabling low-latency, long-duration generation is pivotal for embodied AI and simulation-based planning, current frameworks primarily rely on sliding-window mechanisms to bound computational complexity. However, this approach inherently sacrifices historical context, undermining the long-range interactive capabilities. Conversely, maintaining a full-history cache remains computationally prohibitive and memory-intensive: the quadratic complexity of attention leads to excessive computational overhead, while the linear growth of the KV cache inevitably leads to GPU memory saturation. To overcome these limitations, we propose WorldAttention, a system-oriented attention architecture that achieves high efficiency through the co-design of specialized attention kernels and hierarchical KV cache management. First, we introduce Hybrid Sparse Attention (HSA), which integrates linear global attention supplemented with head-adaptive sparse attention. Additionally, we design a Hierarchical KV Cache (HKV) that organizes historical KV pairs into semantically indexed pages across multi-tier memory, enabling fine-grained retrieval and controlled GPU residency. These two designs are supported by tailored kernels to effectively translate their theoretical efficiency into real-world performance. Extensive experiments on VBench-Long and InterVBench demonstrate that WorldAttention consistently surpasses prior state-of-the-art methods, achieving subject consistency scores of 0.9472 on VBench-Long and 0.9668 on InterVBench, respectively.

[214] Summarize Before Grounding: Query-Guided Chunk Condensation for Long-Video Temporal Grounding cs.CV | cs.AIPDF

Nanxing Hu, Xiaoyue Duan, Qiwei Yan, Kailin Lyu, Jinchao Zhang

TL;DR: SumGround先按查询压缩长视频各片段，再检索最可能包含目标事件的摘要片段，缓解冗余视频信息和稀疏采样导致的证据遗漏。

Details

Motivation: 长视频中大量无关内容会妨碍多模态模型寻找查询相关证据。密集采帧训练占用过多显存，而稀疏采样虽然可行，却可能跳过关键事件。

Result: 在多个下游数据集上的实验显示，SumGround总体优于先前先进方法，且在长视频上取得显著增益；摘要未列出具体数值。

Insight: 两级压缩与检索分别解决“每段保留什么”和“哪些段最值得读”：查询引导的潜摘要把冗余视觉token压成紧凑片段表征，关联式检索再排序选取候选事件段；强化学习用于训练两部分。

Abstract: Video temporal grounding (VTG) aims to localize the video interval corresponding to a language query. Recent large vision-language models (LVLMs) show great potential in solving such a multi-modal reasoning task. However, long videos often contain large amounts of redundant information that disturbs LVLMs to mine query-relevant evidence. Instead of dense frame sampling which incurs prohibitive training memory, previous reinforcement learning with verifiable rewards (RLVR) works typically utilize sparse sampling, which makes training feasible but may miss critical evidence. In this paper, we propose a summarize before grounding'' framework (named SumGround’’) for long-video temporal grounding. The key of SumGround is to perform query-guided chunk condensation to aggregate and retrieve query-relevant evidence. Specifically, we split the video into several chunks and perform two-level chunk condensation. First, we introduce query-guided latent summaries, which is represented as KV states of query-guided prompts, to compress redundant visual tokens into compact query-relevant chunk summaries. Furthermore, we design an associative summary retrieval scheme to rank and select chunk summaries that are most likely to contain the event interval. Both query-guided latent summary and associative summary retrieval schemes are enabled by RLVR. To reduce memory consumption, we propose a length-aware gradient gating module to selectively stop gradient back-propagated to visual tokens. Extensive experiments demonstrate that SumGround performs favorably against previous state-of-the-art methods across multiple downstream datasets, with remarkable gains on long videos.

[215] Reinforcement Learning from Intermediate Renders for Image-to-Code Generation cs.CV | cs.AIPDF

Omri Kaduri, Kate Feingold, Phillip Isola, Tali Dekel

TL;DR: IR4RL利用图像转代码生成过程中可执行的中间程序渲染结果，计算局部进展奖励，为生成token提供比单一终局奖励更稠密的强化学习监督。

Details

Motivation: 图像转SVG或TikZ常用强化学习优化最终渲染图的奖励，但终局反馈稀疏，所有token都共享同一结果，无法区分哪些代码片段成功复现目标、哪些造成误差。

Result: 在Image-to-SVG和Image-to-TikZ两项任务中，IR4RL均超过监督微调和标准GRPO，并得到新的开源最优模型；摘要未提供具体指标。

Insight: 许多生成前缀本身可执行并产生有意义的部分图像，因此相邻中间渲染之间的变化可作为逐token过程信号，把进展反馈定位到对应代码片段。

Abstract: Reinforcement learning is increasingly used to post-train vision-language models for image-to-code generation, such as generating SVG code from a reference image, by optimizing rewards computed from the final rendered output. However, relying on a single terminal reward provides sparse feedback that is poorly aligned with the contribution of individual tokens. A generated program may contain operations that accurately reproduce some parts of the target image alongside others that introduce errors, yet all tokens are trained from the same final outcome. We observe that many intermediate code prefixes are not only executable, but already produce meaningful partial renders that reflect progress toward the target. This property provides a natural source of denser supervision during generation. Based on this observation, we introduce IR4RL, an RL framework with a token-level render-progress reward that turns changes between intermediate renders into localized feedback for the generated sequence. We evaluate our approach on Image-to-SVG and Image-to-TikZ generation. Across both tasks, our method improves over supervised fine-tuning and standard GRPO, yielding new state-of-the-art open-source models. This shows that intermediate rendering provides a simple and effective source of process supervision for RL post-training of image-to-code models.

[216] Long Time No See: Benchmarking VLMs for Out-of-Sight Spatiotemporal Reasoning in Egocentric Videos cs.CVPDF

Fangzhou Ma, Ivo Alexander Ban, Eren Homburg, Gabriele Goletto, Rémi Pautrat

TL;DR: Beyond3D评测视觉语言模型在第一视角视频中追踪已离开视野物体的位置和状态，并将问题拆成视觉、时间、场景及三维空间推理链。

Details

Motivation: 真实助理和机器人常需定位不再可见的物体；这不仅要求记住最后看见的位置，还要求更新物体被移动后的状态，并在物体离开视野后继续保留该信息。

Result: 基准包含来自9名参与者、135段视频的9,000道题，覆盖8类问题。9种通用或空间专用VLM中最佳准确率42.2%，高于29.7%的随机水平和最高31.9%的纯文本基线；恢复物体最后可见时刻最困难。

Insight: 从三维位置、相机姿态和场景几何构建逐时刻可见性轨迹，可把“记住位置”细化为判断当前可见性、最后出现和放置时间、场景锚点及相对空间关系。当前模型在离视后的动态状态维护上仍不足。

Abstract: Real-world AI systems must reason about objects that are no longer visible: an AR assistant guiding a user back to an object used earlier, a household robot retrieving an item someone put away. This requires not just recalling where an object was last seen, but updating its state when it is moved and retaining that update once it leaves view. We refer to this as out-of-sight spatiotemporal reasoning. We introduce Beyond3D, the first VQA benchmark to isolate this ability in dynamic egocentric video: every query targets an object that has been relocated and has since left the field of view. We create our questions from HD-EPIC annotations, building a visibility track for each dynamic object from its 3D position, the camera pose, and the scene geometry to understand at each moment whether it is visible, occluded, or out of view. Beyond3D comprises 9,000 questions in eight types over 135 videos from nine participants, organized as one reasoning chain: visual grounding (is the target observable now), temporal grounding (when it was last visible and last placed), scene localization (which fixture anchors that location), and 3D spatial perception (where it lies relative to the current viewpoint or another object in the scene). We benchmark nine general-purpose and spatially specialized VLMs. The best model reaches 42.2% against 29.7% chance and text-only baselines reaching 31.9%, with the largest failures in recovering when an object was last visible, showing that tracking object movement out of sight remains far from solved for current VLMs.

[217] Backdoor as Probe: Test-Time Adversarial Defense for CLIP cs.CVPDF

Zhongqi Wang, Jie Zhang, Nie Sen, Zhiyu Chen, Shiguang Shan

TL;DR: BaP把防御者控制的后门机制用作对抗探针，根据CLIP对抗输入的触发响应识别攻击，再选择性修正受攻击表征。

Details

Motivation: 现有测试时防御往往把对抗激活偏移当成应抑制的噪声，而这些变化本身也包含攻击信号；同时希望无需重新训练即可提升CLIP鲁棒性。

Result: 在16个基准上，BaP将平均鲁棒准确率从1.0%提高到52.3%，同时保持干净准确率；性能可比先进方法，推理最多快5.7倍，并展示对大型视觉语言模型攻击的泛化。

Insight: 通过闭式模型编辑，在选定MLP层低能量子空间中植入对干净输入弱响应、对攻击偏移强响应的触发器。推理时按目标方向响应检测攻击，再以小扰动把检测到的表征从攻击偏移引回干净子空间。

Abstract: Test-time adversarial defense improves the robustness of vision-language foundation models such as CLIP without retraining. However, adversarial activation shifts are typically treated as distortions to suppress, rather than signals to exploit. We turn these shifts into defense signals by repurposing the trigger-to-target mechanism of backdoors. The key is to implant a defender-controlled backdoor as a probe that is weakly activated by clean inputs but strongly activated by adversarial shifts. Based on this insight, we propose \emph{Backdoor as Probe} (BaP), a test-time adversarial defense for CLIP. BaP constructs the probe through a closed-form model edit to a selected MLP layer. It projects the average adversarial activation shift and a defender-specified semantic direction onto the layer’s low-energy input and output activation subspaces to obtain the trigger and target directions, respectively. At inference time, adversarial inputs produce measurable responses along the target direction for detection. BaP then selectively rectifies detected inputs by optimizing a small perturbation that steers their representations away from adversarial shifts and toward the clean subspace. Experiments across 16 benchmarks show that BaP improves average robust accuracy from 1.0% to 52.3% while retaining clean accuracy, achieving performance comparable to state-of-the-art methods with up to a (5.7\times) inference speedup. BaP further shows the generalization to adversarial attacks on large vision-language models. Project page: https://robin-wzq.github.io/Backdoor-as-Probe/

[218] DirectUV: Image-Conditioned UV Texture Generation with Surface-Aware Positional Encoding cs.CVPDF

Jiantao Lin, Yingjie Xu, Mingzhi Sheng, Yangkai Wei, Hao Chen

TL;DR: DirectUV在潜在UV纹理空间进行扩散生成，并用由3D表面坐标构造的位置编码，让注意力按表面邻近关系而非UV网格距离工作。

Details

Motivation: 多视角投影纹理容易出现遮挡缺口和视角不一致；直接在UV空间生成的方法又常依赖额外模块提供三维信息，注意力仍按UV平面位置关联，导致跨缝和分离UV岛纹理不连续。

Result: 实验显示DirectUV生成的纹理更清晰且全局一致性更好，尤其在遮挡和未观测视角区域优于基线；摘要未给出具体分数。

Insight: 利用UV到曲面的对应关系取得每个token的三维坐标，并据此构造表面感知位置编码，可使注意力度量遵循三维表面距离；多级编码进一步让不同注意力头关注不同细粒度的表面划分。

Abstract: Generating high-quality UV textures for 3D meshes remains challenging. Multi-view projection pipelines suffer from occlusion and view inconsistency, and recent methods that generate textures directly in UV space still rely on auxiliary modules to supply 3D information, leaving the attention mechanism tied to UV-grid positions rather than to the underlying surface geometry. This mismatch limits coherence across seams and disconnected UV islands. We propose DirectUV, an image-conditioned UV texture diffusion framework that operates in the latent UV space of a pretrained image VAE, in which a Diffusion Transformer denoises the UV latent given a single input image and a coarse UV map. At its core, Surface-Aware Positional Encoding (SAPE) replaces the standard 2D-grid positional encoding with encodings derived from per-token 3D surface coordinates obtained via UV-to-surface correspondence. As positional encodings define the distance metric used by attention, SAPE enables tokens to interact according to 3D positional proximity derived from surface correspondence rather than UV-grid distance, restoring coherence across seams and disconnected islands. A multi-level extension further assigns different attention heads to progressively finer subdivisions of the same latent UV patch, allowing the model to reason about surface structure at multiple granularities. Experiments show that DirectUV produces sharper and more globally consistent textures than other baselines, with the largest improvements in occluded and view-unseen regions where projection-based methods leave gaps or stretched textures.

[219] Revitalizing Medical Time Series with Vision-Informed Retrieval: A Vision-Language Perspective cs.CVPDF

Guoqi Yu, Juncheng Wang, Shujun Wang

TL;DR: ViRe用冻结视觉语言模型从医疗波形图提取形态查询，再从原始数值时间序列中检索匹配的时间段与通道证据。

Details

Motivation: 医疗时间序列分类通常只把信号作为数字序列处理，未充分利用医生观察波形时可直接辨认的形态信息，限制了形态先验与细粒度数值特征的结合。

Result: 在六个公开基准上，ViRe相较此前最佳方法总体相对提升6.42%，并超过十种成熟基线。

Insight: 先将波形视觉形态转成冻结VLM表征，再把该表征作为查询，通过跨模态注意力从数值序列选择相关时间与通道证据，使视觉先验引导检索而非替代原始信号。

Abstract: Medical time series (MedTS) underpin many clinical classification tasks, yet existing methods usually represent them only as numerical sequences and underuse the morphology that is explicit in waveform inspection. To bridge this gap, we introduce Vision-Informed Retrieval (ViRe), which uses a frozen VLM-derived waveform representation as a morphology-aware Query to guide retrieval from raw numerical MedTS features. Specifically, a Vision Query is extracted using pre-trained vision-language models (VLMs) to obtain morphology-aware priors from waveform plots. A tailored attention-based cross-modal retrieval mechanism then uses the Vision Query to select morphology-relevant temporal and channel evidence from the numerical representation. ViRe demonstrates strong effectiveness against ten established baselines, yielding an overall 6.42% relative improvement over the previous state of the art across six public benchmarks. Code, training scripts, and reproducibility materials are publicly available in the GitHub Repository: https://github.com/Levi-Ackman/ViRe.

[220] CapField-OPD: Learning Continuous Capability Fields via Joint-Anchored Multi-Teacher On-Policy Distillation for Flow Models cs.CVPDF

Pengyang Ling, Yujie Zhou, Jiazi Bu, Yibin Wang, Xiaoxiao Ma

TL;DR: CapField-OPD以显式连续能力坐标联合蒸馏多个流模型教师，使用户能在推理时调节能力组合，而不必依赖提示词语义路由。

Details

Motivation: 现有多教师在线蒸馏通常按提示语义类别选单一教师，导致能力调用依赖措辞，无法由用户明确控制能力强度；训练时的教师锚点也未必是最佳推理配置。

Result: 在组合生成、文本渲染和视觉美学实验中，CapField-OPD把多名专长教师整合到单一学生，保持或超过教师表现，对语义不变提示扰动仍能可靠调用目标能力，并支持连续控制和坐标测试时扩展。

Insight: 把教师作为锚点，以能力坐标定义输出组合及对应监督目标，可将能力与提示语义解耦。再用小型校准集评估能力场，选择平均奖励最高坐标作为默认值，并用常为最优的坐标构造测试时扩展候选。

Abstract: Reward-specialized post-training produces strong experts for flow-based generative models, while multi-teacher on-policy distillation (OPD) consolidates their capabilities into a single student. Existing methods, however, route each prompt to a single teacher according to its semantic category, implicitly binding the desired capability to prompt content. This coupling makes capability invocation vulnerable to prompt perturbations and prevents users from explicitly adjusting the strength of the desired capability at inference time. In this work, we introduce CapField-OPD, an OPD framework that integrates multiple teachers into a continuous capability field through explicit capability coordinates. We use teacher models as anchors to construct this field, with the coordinates determining how their outputs are combined. Each capability configuration thus receives a unique supervision target, and capability control no longer depends on prompt semantics. Since the training anchors may not be optimal at inference time, we further profile the learned field on a small calibration set. The coordinate with the highest mean reward serves as the recommended default, while coordinates that are frequently optimal offer a promising candidate set for test-time scaling. Extensive experiments on compositional generation, text rendering, and visual aesthetics demonstrate that CapField-OPD consolidates multiple specialized teachers into a single student while preserving or surpassing their performance, reliably invokes the desired capabilities under semantics-preserving prompt variations, and supports continuous capability control and coordinate-based test-time scaling.

[221] Evidence-Aligned Multimodal On-Policy Self-Distillation for Fine-Grained Visual Understanding cs.CV | cs.AIPDF

Nanxing Hu, Qiwei Yan, Jinchao Zhang, Guoliang Kang

TL;DR: EAD通过构造受控的视觉证据参考，筛选与该证据方向一致的教师修正，使多模态在线自蒸馏更专注于细粒度图像线索。

Details

Motivation: 在线自蒸馏用证据裁剪后的教师监督学生，但裁剪会丢失上下文，滞后教师与持续更新的学生也存在模型状态差。这些干扰使教师修正不再纯粹反映任务相关视觉证据。

Result: 即使只保留稠密在线蒸馏监督质量的6%，EAD仍持续超过既有最先进方法；摘要未提供具体基准分数。

Insight: 证据参考由当前学生分别处理原图和遮去证据区域的图像得到，避免滞后状态和裁剪上下文改变的混杂；教师修正与该参考的余弦对齐度决定其权重，仅保留证据方向一致的指导。

Abstract: Fine-grained visual understanding requires models to recognize small details within complex images. Multimodal on-policy self-distillation (OPSD) addresses this challenge by using a teacher conditioned on evidence-centered crops to supervise a student conditioned on original images along student-generated trajectories. Ideally, teacher corrections, the distributional changes from the student toward the privileged teacher, should be driven by task-relevant visual evidence. However, the designs that make the teacher effective also introduce other interference. Using a lagged or frozen teacher improves training stability but introduces a model-state gap from the evolving student, while cropping enhances task-relevant evidence but also loses the visual context. These two sources of interference make the teacher corrections not purely rely on the visual evidence. We introduce Evidence-Aligned multimodal on-policy self-Distillation (EAD), which retains the crop-conditioned teacher as the target but constructs a separate evidence reference for weighting the corrections. To exclude the effect of lagged model-state from this reference, EAD measures prediction changes using the current student. To avoid crop-induced context changes, EAD masks the evidence region in the original image while preserving the other visual context. The change from the student’s masked-image prediction to its original-image prediction provides a controlled reference for the direction in which the visual evidence shifts the student’s prediction. EAD weights each teacher correction by its cosine alignment with the reference, i.e., retaining aligned corrections and downweighting the rest. Retaining only 6% of the supervision mass of dense OPSD, EAD consistently outperforms previous state-of-the-art methods.

[222] V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution cs.CVPDF

Bei Yan, Yuecong Min, Jie Zhang, Junqi Yang, Shiguang Shan

TL;DR: V-Gym让多模态智能体的程序性技能与练习数据从执行轨迹中共同迭代演化，以验证集效果决定是否保留技能更新。

Details

Motivation: 从有限交互经历提炼的技能可能不可靠、泛化差，而静态数据又无法针对新暴露的能力短板提供足够多样、定向的练习。

Result: 在多个多模态推理基准和骨干模型上，V-Gym相较基线取得显著提升；演化后的技能能跨领域和模型泛化，针对性生成的数据也改善技能优化。

Insight: 技能更新需经验证性能筛选，练习数据则根据轨迹暴露的瓶颈生成并经过质量检查；练习结果再反馈到下一轮技能修改，形成诊断、练习和改进的闭环。

Abstract: Advances in multimodal understanding, reasoning, and tool use enable agents to tackle increasingly complex visual reasoning tasks. By distilling past execution experience into reusable skills, agents can transfer lessons from both successes and failures into future reasoning, reducing repeated errors and improving capabilities. However, limited experience may produce unreliable, poorly generalizable skills, while static datasets may lack the targeted and diverse practice needed for refinement. To address this gap, we introduce V-Gym, an autonomous framework that iteratively co-evolves procedural skills and multimodal practice data from execution trajectories. During skill evolution, V-Gym analyzes trajectories to distill and refine hierarchical skills, updating procedural guidance and applicability conditions while retaining an update only if it improves validation performance. During data evolution, V-Gym selects generation seeds by balancing data utility and exploration, then translates trajectory-identified bottlenecks into diverse, targeted practice data that expand the data bank after quality checks. The resulting practice outcomes feed back into subsequent skill updates, closing the loop for continual skill refinement. Experiments across diverse multimodal reasoning benchmarks show substantial improvements over baselines with multiple backbone models. Its evolved skills generalize across domains and models, while evolved data support more effective skill refinement, enabling autonomous diagnosis, targeted practice, and continual self-improvement.

[223] Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation cs.CVPDF

Zesong Yang, Weikai Chen, Liyuan Cui, Lutao Jiang, Runze Zhang

TL;DR: GEAR将几何信息用作查询历史视觉记忆的token级地址，并以可见性八叉树过滤被遮挡的错误对应，支持长时程相机控制视频生成。

Details

Motivation: 相机控制视频越长，模型越需要从不断增长的视觉历史中找回先前内容。隐式搜索历史效率低；持久融合为全局3D记忆又会引入累积几何误差。

Result: GEAR在视觉质量、相机控制精度和重访一致性上达到最新水平，可沿具挑战性的轨迹生成分钟级视频；摘要未列出具体量化分数。

Insight: 几何无需完整解释场景，只需指出应从哪里读取视觉记忆，注意力再决定恢复什么。保留历史帧潜变量并用逐帧几何建立与目标视角的对应，可避免全局3D融合的误差累积；不可见八叉树证据用于剔除遮挡对应。

Abstract: Long-horizon camera-controlled video generation requires recovering previously observed content from an ever-growing visual history. Existing approaches either search historical context implicitly or reconstruct it into persistent 3D memory, facing inefficient memory access or accumulated geometric errors. Our key insight is that geometry need not explain the scene–it only needs to determine where visual memory should be read from, while attention decides what should be recovered. Based on this insight, we introduce GEAR, a Geometry-Enabled Attention Routing framework that uses geometry as an explicit token-level address for visual memory. Rather than fusing historical observations into a persistent global 3D representation, GEAR retains them as frame latents and uses per-frame geometry only to establish token-level correspondences with target views, thereby avoiding persistent error accumulation from global fusion. Guided by these correspondences, Geometric Correspondence Attention (GCA) selectively injects geometrically matched historical features into noisy target patches during denoising. We further introduce an Invisible Octree to accumulate visibility evidence and reject geometrically plausible but occluded correspondences. Extensive experiments demonstrate that GEAR achieves state-of-the-art visual quality, precise camera control, and revisit consistency, enabling minute-long video generation along challenging trajectories.

[224] Unified Trajectory Matching Policy Optimization: Diverse T2I Generation and VLA Generalization cs.CVPDF

Zhiyuan Ma, Jiaming Li, Lingzhen Li, Yu Liu, Xuekai Zhu

TL;DR: Uni-TMPO通过匹配组内奖励目标分布与轨迹概率分布，减轻图像生成和视觉语言动作强化学习中的模式坍塌并保留多样成功策略。

Details

Motivation: 单纯最大化奖励即使加参考KL或熵正则，也可能让扩散策略收缩到少数高奖励模式，导致图像相似、奖励投机；迁移到VLA时还会丢失备选动作策略并损害新任务和场景泛化。

Result: Uni-TMPO在T2I奖励、VLA同分布成功率及综合奖励—多样性—效率权衡上超过强基线，并改善未见任务和场景的泛化；真实机器人实验显示，首选高奖励动作受阻时，多种策略仍有价值。

Insight: 先将标准化奖励变成每组轨迹的目标分布，再用前向KL匹配策略分布，而非直接最大化期望奖励。T2I通过进度条件粗到细调度构造轨迹，VLA则利用更新后的观测进行反馈条件采样。

Abstract: Reward-maximizing reinforcement learning (RL) is widely used to post-train stochastic diffusion and flow policies for text-to-image (T2I) generation. However, reward-maximizing RL causes policy mode collapse even under reference KL or entropy regularization, reducing the policy to a single high-reward mode. In T2I, this produces similar images and reward hacking. When extended to vision-language-action (VLA) models, the same collapse removes alternative successful strategies and weakens task and scene generalization. To address this limitation, we introduce Unified Trajectory Matching Policy Optimization (Uni-TMPO), a unified RL post-training framework for diffusion and flow policies. First, Uni-TMPO converts standardized rewards into a target distribution within each trajectory group and derives the policy distribution from trajectory log probabilities. Then, forward Kullback-Leibler optimization matches the two distributions instead of maximizing expected reward. A progress-conditioned coarse-to-fine scheduler efficiently constructs T2I trajectories. Within the unified framework, feedback-conditioned sampling uses updated observations to construct VLA trajectories. Extensive experiments show that Uni-TMPO achieves higher T2I rewards and VLA ID success rates than the strongest baselines. More importantly, it achieves the best T2I reward-diversity-efficiency trade-off and VLA generalization to held-out tasks and scenes, while real-robot evaluation demonstrates the value of multiple action strategies when the higher-reward target is blocked.

[225] SurgGMF: Fully Causal Gaussian Motion Forecasting for Anticipatory Surgical Scene Rendering cs.CVPDF

Jingqian Sun, Yichao Tang

TL;DR: SurgGMF从历史高斯运动场预测未来手术场景的高斯位置、尺度和旋转变化，并通过全因果渲染评估预测能力。

Details

Motivation: 现有可变形手术场景神经渲染主要重建已观察帧，尚未充分预测未来状态；直接预测RGB也不是该工作的目标。

Result: 在EndoNeRF和StereoMIS的12个视频片段上，学习式高斯运动预测在渲染空间持续优于经典动力学基线。当前实现中TKAN准确率最高，GRU和LSTM模块延迟更低。

Insight: 预测未来高斯状态再渲染，可将问题从图像外推转为结构化运动外推；“全因果末帧”协议禁止使用目标未来帧的高斯属性，同时保留外观的因果传播，以避免目标泄漏。

Abstract: Dynamic surgical scene modeling is essential for robotic perception, simulation, and decision support. Although existing neural rendering methods enable efficient reconstruction and rendering of deformable surgical scenes, they remain primarily focused on observed-frame reconstruction rather than forecasting future scene states. To this end, we present SurgGMF, a fully causal Gaussian motion forecasting framework for anticipatory surgical scene rendering. Rather than predicting future RGB images directly, SurgGMF forecasts future Gaussian motion states represented by position, scale, and rotation residuals (X/S/R) from historical Gaussian motion fields. To prevent target leakage, we introduce a full-causal-last rendering protocol, where future Gaussian states are rendered without accessing target-frame Gaussian attributes while preserving causal appearance propagation. We evaluate SurgGMF on 12 EndoNeRF and StereoMIS video slices using neural temporal learners and classical dynamics baselines under a unified forecasting protocol. Learned Gaussian motion forecasting consistently outperforms classical dynamics baselines in render space, demonstrating gains beyond hand-crafted state extrapolation. Latency analysis further reveals an accuracy–efficiency trade-off: under the current implementations, TKAN achieves the highest accuracy, whereas GRU and LSTM provide more favorable module-level latency profiles. These results establish SurgGMF as a reproducible framework for causal Gaussian motion forecasting and advance surgical Gaussian representations from retrospective reconstruction toward predictive scene modeling.

[226] Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models? cs.CV | cs.LGPDF

Bohao Xing, Xin Liu, Kaishen Yuan, Deng Li, Rong Gao

TL;DR: CMES跨刺激来源、图像与文本模态及多种视觉语言架构研究情绪向量，发现其方向不同但关系结构和部分因果引导作用可以对齐。

Details

Motivation: 关于模型内部情绪概念的研究多聚焦文本和单一架构，尚不清楚视觉语言模型中的情绪表征能否跨来源、模态与模型结构泛化。

Result: 图像情绪向量呈现与文本相似的低维几何，效价跨来源较稳定而唤醒度变化较大；跨模态余弦相似度不高但存在留出对应。通用ImageNet激活推导的变换能恢复跨架构对应与因果迁移；对齐后的共享子空间还能泛化到第四种架构的两个规模。

Insight: 内部向量的原始坐标可能随架构变化，但概念间的关系结构和选择性操控效果可以通过变换映射恢复。因此跨模型比较不应只看原生余弦相似度，也可检验几何关系、跨模态对应和干预效应。

Abstract: Recent studies suggest that large language models encode emotion concepts as structured internal representations, but most existing work focuses on text and a single architecture. Therefore, we ask, do emotion concepts generalize across sources, modalities, and architectures in vision–language models (VLMs)? To address this, we construct CMES (Cross-Modal Emotion Stimuli), a multi-source collection of emotion-conditioned stories, real facial expressions, synthetic portraits, and synthetic emotion-evoking scenes. For each stimulus source, we extract a separate set of six Ekman emotion vectors from each of three VLMs. We report four main findings as follows: 1) Image-derived emotion vectors form a low-dimensional geometry similar to that of text-derived vectors. Valence is relatively stable across sources, while arousal varies more. 2) Text- and image-derived emotion vectors have modest cosine similarity but still show held-out cross-modal correspondence. Text-derived vectors can also steer image interpretation. 3) Cross-architecture correspondence remains even when native cosine is near zero. Transformations estimated from generic ImageNet activations recover both correspondence and causal transfer without using the six emotion vectors or their labels. 4) After aligning representations across architectures, we construct a shared emotion subspace that preserves affective geometry and selective steering effects. The corresponding consensus emotion vectors also generalize to a held-out fourth architecture at two model sizes. These results suggest that emotion representations can share relational structure and causal effects across sources, modalities, and architectures, even when individual vector directions differ.

[227] CoDrive: Cross-Vehicle World-Consistent Video Generation with Precise Trajectory Control for Cooperative Driving cs.CV | cs.AIPDF

Yu Meng, Baining Zhao, Junta Wu, Tengfei Wang, Rongze Tang

TL;DR: CoDrive在共享动态场景和世界坐标系中联合生成多辆车的多视角视频，以保持跨车辆观察的一致性并精确控制相机轨迹。

Details

Motivation: 现实驾驶具有多智能体互动，但多数世界模型只生成单一自车视角；分别扩展到多车也无法保证不同车辆看到的是同一个动态世界。

Result: 作者建立覆盖真实和合成多车情境的CoDrive-Bench。实验显示CoDrive改善轨迹可控性、跨车辆几何一致性和实例一致性，同时保持有竞争力的视觉质量。

Insight: 车辆内部视角依赖的时空关系由局部注意力建模，车辆之间的信息交换由全局注意力负责；把轨迹置于共同世界坐标并加入投影相对位置编码，显式提供相对几何。真实单车数据与合成多车交互数据渐进混合训练，兼顾真实外观和跨车一致性。

Abstract: Real-world driving is inherently multi-agent, yet most existing driving world models generate observations from a single ego vehicle. Independently extending them to multiple vehicles does not ensure that different agents observe a consistent shared world. We present CoDrive, a cross-vehicle, multi-view driving video generation framework that jointly generates observations of vehicles sharing the same dynamic scene with precise camera-trajectory control. CoDrive interleaves local self-attention, which models spatiotemporal dependencies among the views of each vehicle, with global self-attention, which enables information exchange and consistency modeling across vehicles. To explicitly encode their spatial relationships, all camera trajectories are represented in a shared world coordinate system and injected into the attention layers through projective relative positional encoding. We further adopt a progressive mixed-task training strategy that combines large-scale real-world single-agent data with synthetic cross-agent interaction data, allowing the model to benefit from real-world appearance distributions while learning cross-agent consistency from simulation. For systematic evaluation, we introduce CoDrive-Bench, a benchmark covering real and synthetic multi-vehicle scenarios and evaluating trajectory controllability, scene geometry consistency, and instance-level consistency. Experiments show that CoDrive improves trajectory controllability and cross-agent geometric and instance consistency while maintaining competitive visual quality.

Zhen Wang, Changpeng Wang, Zhe Liu, Zhangyang Qi, Yuxiang Lu

TL;DR: PanoVLN围绕全景输入调整导航动作规划、训练路线监督和视觉表征，让具身智能体利用全视野做更长程路线决策。

Details

Motivation: 全景图提供透视相机视野外的信息，但简单把输入换成全景并不能带来明显提升；导航还需长程动作规划、充分覆盖岔路的数据及跨方向空间关系理解。

Result: 使用4B骨干和纯RGB输入，PanoVLN在R2R-CE及RxR-CE Val-Unseen的成功率分别比先前最优方法高11.9和8.7个百分点。四足机器人实测中，导航更快、停顿更少。

Insight: 全景视野支持一次预测更长动作序列，并通过置信度动态决定执行多少步后重规划；训练路线强化分岔点与清晰指令，视觉特征则结合RGB语义和几何信息编码跨方向空间布局，且不增加视觉token。

Abstract: Recent vision-language models (VLMs) have advanced vision-and-language navigation (VLN), enabling models to predict navigation actions from visual observations and language instructions. In this work, we explore VLN with panoramic observations and introduce PanoVLN. The motivation is straightforward: more complete visual context should enable better-informed navigation decisions. For example, a panorama can reveal a passage outside a perspective camera’s field of view, allowing the model to identify the intended route without additional exploration. However, we find that simply replacing perspective images with panoramas yields only limited gains. Our diagnosis suggests that fully exploiting wider visibility requires modifications to action prediction, training supervision, and visual representation. First, wider visibility supports longer-horizon action planning. We make the model predict longer action sequences, enabling larger turns and subsequent movement from a single panorama. Specifically, we introduce a confidence-guided execution (CGE) strategy that dynamically determines how many predicted actions to execute before replanning. Second, wider visibility also brings more complex route choices. We therefore construct training routes with frequent branching points and clear instructions to provide targeted supervision for route selection. Third, panoramic navigation requires understanding spatial relationships across viewing directions, beyond recognizing individual landmarks. We combine semantic and geometric features from RGB panoramas to capture both scene content and spatial layout without adding visual tokens. With a 4B backbone and RGB-only input, PanoVLN surpasses the previous SOTA by 11.9% and 8.7% in success rate on R2R-CE and RxR-CE Val-Unseen. Real-world experiments on a quadruped further demonstrate faster navigation with fewer pauses than prior VLN methods.

[229] Beyond Reconstruction Loss in Post-Training Quantization: Balanced Fitting for Large Vision-Language Models cs.CV | cs.LGPDF

Minchan Kang, Kyeonghye Park, Seungyeon Sa, Seoyoung Cho, Daeshik Kim

TL;DR: Balanced Fitting按层和模态评估量化带来的精度损失或正则收益，对敏感部分细致拟合、对可受益部分保留较粗量化。

Details

Motivation: LVLM后训练量化通常在小校准集上优化对全精度模型的重建，可能过度追求复制全精度行为和校准数据偏差；重建误差更小未必意味着下游效果更好。

Result: 在多个LVLM上，无论仅量化权重还是同时量化权重与激活，Balanced Fitting都稳定超过既有后训练量化方法；作者还观察到较低重建误差不能可靠预测更佳下游性能。

Insight: 量化不只有误差，也可能为某些层或模态提供有益正则化。分别测量权重、视觉激活和文本激活的层级效应，再按敏感度选择精细或粗略拟合，能平衡保真与正则收益。

Abstract: Post-training quantization (PTQ) enables efficient deployment of large vision-language models (LVLMs), but is typically calibrated on a small set while expected to generalize across diverse downstream tasks. Although recent PTQ methods for LVLMs incorporate sensitivity signals, they still minimize reconstruction loss with respect to the full-precision model, potentially over-preserving FP behavior and calibration-specific bias. Rather than treating quantization solely as an error to be minimized, we observe that it can also provide beneficial regularization for certain layers and modalities. Motivated by this observation, we propose Balanced Fitting, a quantization effect-based framework that balances precision and regularization beyond reconstruction-based optimization. By measuring layer- and component-wise quantization effects for weights, vision activations, and text activations, Balanced Fitting combines fine-grained fitting for sensitive components with coarser fitting to exploit potential regularization benefits. Experiments on multiple LVLMs show that our method consistently outperforms prior PTQ approaches under both weight-only and weight-activation quantization, while lower reconstruction loss does not reliably translate into better downstream performance. The source code is publicly available at https://github.com/kmc3661/BFQ

[230] When VLMs Trust Context: Evaluating Scene Text Recognition under Misleading Context cs.CV | cs.AIPDF

Yuxing Cheng, Yuan Wu, Yi Chang

TL;DR: SceneFaith测试视觉语言模型读取自然场景文字时是否忠实抄录，还是被误导性场景语境影响而改写成更合理的词。

Details

Motivation: 模型可能根据周围场景先验而非图像字符证据回答，特别当文字与场景含义冲突或目标文字模糊时，造成不忠实识别。

Result: 在781张生成场景图、15个模型上，清晰图像中的语境改写率仍为8.45%至58.51%。移除背景语境会减少改写、提升逐字准确率；改变同一文字周边场景也会改变输出，模糊文字则提高改写率。

Insight: 基准把输出区分为忠实照录、语境规范化改写和其他识别错误。可靠识别应以清晰字符视觉证据为准，只有视觉证据不确定时才让上下文发挥更大作用。

Abstract: Vision-language models (VLMs) can read text in natural scenes, but their predictions may be influenced by the surrounding context. When the printed text conflicts with what the scene suggests, a model may return a more plausible word instead of the shown text. We introduce SceneFaith, a benchmark of 781 generated scene images for studying this behavior. Each output is classified as Literal, Canonical, or Other, separating faithful transcription from context-consistent rewriting and ordinary recognition errors. Across 15 models from seven families, all models show rewriting on clear images, with rates ranging from 8.45% to 58.51%. Controlled experiments further show that surrounding context matters: removing surrounding scene information reduces rewriting and improves literal accuracy, while changing the scene around the same text patch can also change model outputs. Moreover, weakening the target text with blur increases rewriting. These results show that reliable scene-text recognition requires VLMs to balance visual character evidence with contextual information, preserving clear text while using context mainly when the visual evidence is uncertain.

[231] Projective Normal Fields: A Convex Optimization Method for Constructing Smooth UDFs cs.CVPDF

Jiayi Kong, Chen Zong, Fei Hou, Junhui Hou, Wenping Wang

TL;DR: PNF以无方向符号歧义的投影法向场和凸优化从点云估计局部几何，再利用谱置信度构造平滑无符号距离场。

Details

Motivation: 原始点云没有表面连接关系和一致定向法向，直接拟合标量无符号距离场还要处理零水平集处不可微、远离样本处监督弱等问题，容易导致优化不稳和空间伪影。

Result: 实验显示PNF降低了对邻域尺寸的敏感性，在噪声和离群点下保持有竞争力的重建效果，并改善非流形交汇处精度；摘要未报告具体数值。

Insight: 把法向轴编码为方向翻转不变的秩一投影矩阵，并放松到单位迹半正定矩阵凸包；在局部切平面、软PCA锚定和邻域重叠约束下得到强凸且唯一的解。主特征向量及特征间隙提供法向与置信度，之后用于热扩散和泊松积分，避免直接拟合不可微UDF。

Abstract: Constructing a smooth approximation of an unsigned distance field (UDF) from a raw point cloud is challenging because the input provides neither surface connectivity nor consistently oriented normals. Methods that directly learn a scalar UDF must also handle its non-differentiability on the zero level set and weak supervision away from the samples, which can lead to unstable optimization and spatial artifacts. We introduce Projective Normal Fields (PNFs), an orientation-free representation and convex optimization framework for estimating bidirectional normals from point positions alone. Each normal axis is encoded by a rank-one projector, which is invariant to normal reversal. We relax the non-convex set of hard projectors to its convex hull: the symmetric positive-semidefinite matrices with unit trace. Each soft tensor defines a local quadratic distance model and retains the relative weights of candidate normal axes. We estimate a coherent PNF by combining local tangent-plane fitting, soft-PCA anchoring, and overlap regularization on a fixed neighborhood graph. With positive anchoring weights, the objective is strongly convex and admits a unique global minimizer. Principal eigenvectors provide bidirectional normals, while the corresponding eigengaps provide spectral confidence indicators. We use these indicators to select and weight directional sources for heat diffusion, followed by Poisson integration to construct a regularized UDF approximation. By separating local geometry estimation from scalar-field construction, PNF avoids directly fitting the non-differentiable UDF. Experiments demonstrate reduced sensitivity to neighborhood size, competitive reconstruction under noise and outliers, and improved accuracy near non-manifold junctions. The project page is available at https://anonymous17777367.github.io/PNF-page/

[232] D$^2$-VLA: Dual-Memory Dual-Frequency Vision-Language-Action Model For Long Dynamic Manipulation cs.CVPDF

Zijian Ye, Chengqi Wei, Wei Huang, Anlin Zheng, Chunyu Zou

TL;DR: D²-VLA在预训练VLA的KV缓存接口上结合历史长期记忆与快速动作记忆，并以不同刷新频率支持长时动态操作。

Details

Motivation: 长程机器人操作需要记住已离开视野的线索，同时响应运动物体。常规VLA依赖最新观察，刷新视觉上下文又往往需要额外且昂贵的视觉语言模型推理。

Result: 在DOMINO完整任务上成功率为29.3%，高于π0.5的9.6%和PUMA的17.2%；在DOMINO-Long上为60.0%，高于二者的35.4%和20.6%。真实机器人八项任务有所提升，并在LIBERO-Long与RoboTwin 2.0分别达到97.5%和74.3%。

Insight: 分块因果KV缓存增量编码观察，并根据时间注意力模式分别为视觉语言模型和动作专家构造历史读取视图；视觉模型两次刷新之间，门控适配器把新视觉特征写入历史KV，短快速记忆队列则用于动作重规划。

Abstract: Long-horizon manipulation requires robots to remember cues that are no longer in view while responding to moving objects. Yet vision-language-action (VLA) policies often rely on the latest observation, and refreshing their visual context typically requires another costly vision-language model (VLM) pass. We present D$^2$-VLA, which combines dual memory and dual-frequency control at the KV-cache interface of a pretrained VLA. D$^2$-VLA uses block-wise causal KV caching to encode observations incrementally and, guided by distinct temporal attention patterns, constructs separate historical KV read views for the VLM and action expert. Between periodic VLM updates, a gated adapter incorporates fresh visual features into the latest history-conditioned KV block, while a short fast-memory queue supports action replanning. We introduce DOMINO-Long, a ten-task benchmark requiring robots to use earlier visual cues when manipulating moving objects. D$^2$-VLA achieves complete-task success rates of 29.3% on DOMINO, compared with 9.6% for $π_{0.5}$ and 17.2% for PUMA, and 60.0% on DOMINO-Long, compared with 35.4% and 20.6%, respectively. It improves success rates on eight real-robot tasks and reaches 97.5% on LIBERO-Long and 74.3% on RoboTwin 2.0.

[233] ControlTrace: Recovering Control Fields for Hidden-Content Recognition cs.CVPDF

Zijian Liu, Yaoguang Chen, Liwei Liu, Weixi Wu, Hanming Zhang

TL;DR: ControlTrace从生成图像中恢复空间扩散模型使用的灰度控制场，再交由视觉语言模型识别被隐藏编码的轮廓或文字。

Details

Motivation: 空间条件扩散模型可以把文字或轮廓嵌入自然图像，但视觉语言模型往往识别不出隐藏内容。依赖图像变换来恢复内容的方法受参数和视角选择影响，效果有限。

Result: 在6,000张图像的FreqBlind基准上，Qwen2.5-VL-7B-Instruct结合ControlTrace的开放式轮廓识别准确率为60.2%，比三种既有方法最佳值高26.9个百分点；A100端到端延迟只增加7.4毫秒，即5.3%。对JPEG、噪声和降采样也保持稳定。

Insight: 用840万参数U-Net从载体图像估计生成时的灰度控制场，再让VLM读取恢复结果，比尝试变换原图视角更直接地还原条件信息；提升范围仍是文中评估的隐藏内容场景。

Abstract: Spatially conditioned diffusion models can embed words and contours in natural-looking images, but vision-language models (VLMs) may fail to recognize the hidden content. Transformation-based recovery depends on parameter and view selection. To evaluate hidden-content recovery and recognition, we construct FreqBlind, a 6,000-image benchmark spanning contours, real words and non-words across three conditioning strengths. The evaluated transformation-based methods show limited recognition of contour patterns and weakly conditioned hidden content. To address this limitation, we propose ControlTrace to recover the grayscale control field used during generation. An 8.4M-parameter U-Net predicts this field from the carrier image, and a VLM then identifies its content. With Qwen2.5-VL-7B-Instruct, ControlTrace achieves 60.2% open-ended contour recognition accuracy across the three conditioning strengths, exceeding the best of the three evaluated prior methods by 26.9 percentage points. On an A100 GPU, the complete pipeline adds only 7.4 ms (5.3%) to direct VLM inference. Recovered fields have lower pixel errors and higher structural similarity than the evaluated transformation views. Across four evaluated VLMs, ControlTrace retains its overall contour recognition advantage. Recognition remains stable under the tested JPEG compression, Gaussian noise and downsampling. These results support control-field recovery for hidden-content recognition in the evaluated setting.

[234] ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild cs.CV | cs.AIPDF

Hongyu Ma, Hairong Qu, Shiqi Zhao, Yongsong Yang, Peng Yin

TL;DR: ESTHER面向第一人称双目视频设计手部时空估计模型与野外评测集，证明双目引导还能帮助模型在退化为单目时保留真实尺度。

Details

Motivation: 精细操作依赖双眼提供公制三维结构，但第一人称双目场景仍缺少端到端手部度量重建模型和真实环境基准；缺视角、掉帧、照明与运动模糊会进一步挑战现有方法。

Result: ESTHER达到当前最优精度，具有更强外部泛化能力，并能抵抗真实采集中缺视角、掉帧及极端光照和模糊。经双目训练后，即便只输入单目视图仍保留真实度量尺度；摘要未提供具体误差数值。

Insight: ESTHER3D将大规模野外伪标签训练集与动捕真值测试集结合。双目几何不仅提升完整双目估计，也教会模型把表观手部大小绑定到度量深度，使尺度能力可迁移到其他双目设备和单目观测。

Abstract: Human dexterity is guided by two eyes watching two hands: binocular vision supplies the metric 3D structure that fine-grained manipulation consumes. Egocentric stereo is therefore the natural perceptual interface for robots, AR, and VR-yet metric 3D hand reconstruction from this very signal still has neither an end-to-end model nor an in-the-wild benchmark. We propose ESTHER, a model whose stereo geometry, temporal reasoning, and output representation are designed for wearable egocentric stereo. It is trained on pseudo-labels from a calibrated labeling pipeline and in turn assembles our benchmark ESTHER3D, an egocentric stereo hand dataset pairing a large in-the-wild training set of model-generated labels with a motion capture test set of true metric ground truth. Experiments show state-of-the-art accu?racy, superior external generalization, and robustness to the missing views, dropped frames, and lighting and motion blur extremes of real egocentric capture that break existing meth?ods. This robustness runs deeper than graceful degradation: stereo guidance teaches the model to bind apparent hand scale to metric depth, so it not only adapts to different stereo rigs and modalities with minimal fine-tuning, but more strikingly preserves true metric scale even after collapsing to a single monocular view.

[235] From Perception to Integration: Revisiting the Internal Dynamics of Reasoning in Vision-Language Models cs.CV | cs.LGPDF

Rong Yu Xu, Prayag Tiwari, Shaolei Zhang

TL;DR: 本文分析视觉语言模型在单项视觉判断和复合空间任务中的内部答案准备状态，并训练检测器在答案已可用时提前停止推理。

Details

Motivation: VLM能回答简单视觉问题，却常在一个问题需要组合多种视觉判断时失败。需要区分是基础判断本身困难，还是内部推理已形成答案却继续消耗计算。

Result: 在MMStar和RealWorldQA上，提前停止分别减少79.1%和74.5%的平均推理token，同时平均准确率提升3.13和3.30个百分点。

Insight: 受控反事实图像、隐藏状态读出和状态干预显示，复合答案往往在模型自行停止前已能从内部状态解码，也能从缩短轨迹中提取。基于此训练小型就绪检测器，可把答案可用时刻作为分配推理预算的依据。

Abstract: Vision-language models (VLMs) can answer simple visual questions, but often struggle when one question requires several visual judgments. We study this gap with controlled tasks for feature binding, numerosity, spatial relations, and amodal completion, together with a Composite task that combines them. Matched counterfactual image pairs isolate changes in the visual evidence needed to answer. Across four models, direct answers, hidden-state readouts, and state interventions show that the individual judgments can be made without explicit reasoning and that intervening on the corresponding states can affect the answer. During reasoning, the Composite answer becomes decodable from hidden states and usable from shortened traces, often before the model stops on its own. We train a small detector to predict this readiness and stop reasoning at that point. On MMStar and RealWorldQA, this reduces mean reasoning tokens by 79.1% and 74.5%, while average accuracy rises by 3.13 and 3.30 percentage points, respectively. These findings connect the internal development of answer readiness to a practical rule for allocating reasoning computation.

[236] WM-VLM: Probing Internal World Models for Interleaved Visual-Textual Reasoning cs.CVPDF

Yuheng Zha, Yilei Wang, Qiyue Gao, Junrong Chen, Yujia Wu

TL;DR: WM-VLM为视觉语言模型添加轻量世界模型分支，先生成中间视觉状态再用其推理，提升二维和三维心理旋转任务表现。

Details

Motivation: 人类常通过心中模拟视觉变换解决空间问题，而传统VLM主要依靠语言推理；尚不清楚生成的中间视觉状态是否能被模型有效使用。

Result: 在2D和3D心理旋转任务上，WM-VLM持续超过监督微调骨干，最高提升39.25个百分点。移除或破坏生成的视觉状态会显著降低表现，说明收益确实依赖这些状态。

Insight: 两阶段训练先教模型预测下一视觉状态，再教其利用该状态进行推理；可验证的中间状态任务让评测分别检验生成质量与后续答案对状态的依赖。

Abstract: Humans often solve spatial problems by mentally simulating visual transformations. In contrast, conventional vision-language models (VLMs) reason primarily through language. We investigate whether VLMs can solve spatial problems by reasoning with both text and generated visual states. To this end, we introduce WM-VLM, which equips a pretrained VLM with a lightweight world model branch for generating intermediate visual states. Our two-stage training first teaches the model to generate the next visual state and then to use that state for reasoning. We programmatically construct spatial reasoning tasks with verifiable intermediate visual states. These tasks allow us to evaluate how well the model generates visual states and how much it relies on them to answer the question. On 2D and 3D mental rotation tasks, WM-VLM consistently outperforms the supervised fine-tuned backbone, with gains of up to 39.25 percentage points. Ablations suggest that these gains depend on the generated visual states, as removing or corrupting them sharply reduces performance. Together, these results suggest that internal world models offer a promising path toward VLMs that reason in both language and visual space.

[237] ORAV: Benchmarking Audio-Video Generation from Multimodal Contexts cs.CVPDF

Jiacheng Hua, Xiaokun Feng, Jiaqi Hua, Chang Liu, Biao Wang

TL;DR: ORAV Bench评估系统依据多种异构参考素材及其语义角色组合，生成音视频内容时是否满足指令并忠实使用各参考。

Details

Motivation: 多模态参考音视频生成要求模型既能组合控制生成内容，又能理解不同参考提供的人物身份、动态和声音特征；开放式结果难以用单一自动指标评价。

Result: 基准包含380个实例、每题2至10个参考、9种语义角色及30类角色组合。参考感知成对评判协议在留出数据上与人类判断有效一致率为86.08%；五种前沿系统呈现不同组合优势，常见失误是复现参考中的非预期内容。

Insight: 评估需逐项比较每个参考对目标结果应有的贡献，并以两种呈现顺序复核总体判断。质量、参考亲和度和语音等逐点诊断维度能揭示总体排名掩盖的不同失败模式。

Abstract: Audio-video generation using heterogeneous multimodal references has emerged as a new challenge, requiring both compositional control over generation and grounded understanding of multimodal context. In this paper, we introduce ORAV Bench for Omni Reference Audio-Video Generation, comprising 380 task instances with 2-10 references, 9 semantic roles, and 30 role compositions. Instructions specify the relationships among references; the media supply the identities, dynamics, and audio characteristics to be realized. To evaluate these open-ended outputs, we develop a reference-aware pairwise protocol that prepares visual and auditory evidence, compares the intended contribution of each reference, and checks the overall verdict in both presentation orders. On held-out instances, it achieves 86.08% effective agreement with human judgments. Across 5 frontier systems, overall rankings conceal distinct strengths across reference compositions. A recurring failure is to reproduce unintended source content in place of the requested result, despite closely resembling a reference. Reproducible pointwise diagnostics of quality, reference affinity, and speech reveal distinct dimensions of model behavior. ORAV thus offers a benchmark for tracking progress toward controllable, compositional, and reference-faithful audio-video generation.

[238] When Text Matters: Design Principles for Visual Token Pruning in Vision-Language Model cs.CV | cs.LGPDF

Minchan Kang, Kyeonghye Park, Seoyoung Cho, Daeshik Kim, Yucheol Cho

TL;DR: 该免训练裁剪方法先依据视觉编码器注意力删减候选，再延迟到解码器中段使用文本到视觉注意力重选与问题相关的图像token。

Details

Motivation: 视觉token裁剪可降低计算量，却可能丢失关键细节。纯视觉选择会忽略任务相关性；过早使用文本引导又可能尚不能识别复杂推理所需的文本—视觉关联。

Result: 在八个基准和三个模型上，80%与90%裁剪率下的性能恢复分别平均超过最佳基线11.10和16.84个百分点；相较多数基线，LLM预填充延迟相当或更低。

Insight: 实验发现文本到视觉注意力在解码器中间层比早期更能指示答案相关区域。因此先保留较多候选，等中段语义关系更充分后再进行最终重选，能避免过早裁掉后续推理需要的细节。

Abstract: Visual token pruning has been widely studied as a practical approach to reducing the computational cost of large vision-language models. However, it struggles to preserve essential visual information, which can lead to substantial performance degradation. In particular, image-based token selection can overlook task-relevant details, while text-guided token selection may fail to capture the text–visual relationships needed for complex reasoning. We find that applying textual guidance too early can limit its ability to identify answer-relevant visual regions, whereas text-to-visual attention becomes more informative at intermediate decoder depths. This finding motivates our training-free method, which separates early vision-guided pruning from deferred text-guided reselection. We first prune visual tokens using vision-encoder attention, retain additional candidates until the decoder midpoint, and then use text-to-visual attention to determine the final visual-token set. Across eight benchmarks and three models, our method outperforms the best-performing baselines by an average of 11.10 and 16.84 percentage points in performance recovery at 80% and 90% pruning, respectively, with comparable or lower LLM-prefill latency than most baselines. The source code is publicly available at https://github.com/kmc3661/DeFT

[239] Revisit to Segment: Working Memory Distillation for Reasoning Segmentation cs.CVPDF

Cilin Yan, Yilun Qiu, Wanyang Zhang, Rui Zu, Xiaolong Jiang

TL;DR: SWiM把同图像、同查询下质量较高的先前分割尝试转成工作记忆教师，再在线蒸馏给只看原图与查询的学生。

Details

Motivation: MLLM的定位提议和推理轨迹可以作为重复处理同一图像时的工作记忆，已有观察显示记忆上下文有助推理分割；但部署时不一定总能保留或提供此类记忆。

Result: 在多个推理分割基准上，SWiM达到当前最先进表现，验证工作记忆蒸馏有效；摘要未提供具体指标。

Insight: 按分割质量筛选rollout构造工作记忆，记忆条件模型作为教师，沿学生自生成轨迹提供token级分布监督；学生仍只接收原图和问题，再与基于分割结果的强化学习联合优化，使能力在有无工作记忆时都可使用。

Abstract: Multimodal large language models (MLLMs) have approached image segmentation by reasoning about visual content and predicting target locations. Their generated responses contain reasoning traces and localization proposals that can serve as working memory when revisiting the same image and query. Our exploration reveals that MLLMs benefit from using this self-generated working memory as context, leading to enhanced reasoning segmentation. Motivated by this finding, we seek to strengthen the backbone model’s reasoning segmentation capabilities by distilling the guidance gained from revisiting prior attempts, enabling it to benefit with or without working memory at inference time. To this end, we propose Reasoning Segmenter with Working Memory (SWiM), a working-memory distillation framework for reasoning segmentation. Specifically, SWiM selects rollouts based on segmentation quality to construct working memory and uses the memory-conditioned model as a teacher. The teacher provides token-level distributional supervision along student-generated trajectories, while the student receives only the original image and query. Joint optimization of on-policy self-distillation and outcome-based reinforcement learning combines working-memory guidance with direct feedback on segmentation quality. Extensive experiments on reasoning segmentation benchmarks demonstrate that SWiM achieves state-of-the-art performance, validating the effectiveness of working-memory distillation.

[240] P4Q: Co-designing Token Pruning and Quantization for Vision-Language Model Acceleration cs.CVPDF

Haizhao Jing, Zhenhao Shang, Haokui Zhang, Rong Xiao, Peng Wang

TL;DR: P4Q联合设计视觉token筛选和低比特量化，让裁剪决策适应量化扰动，并让量化校准匹配实际裁剪后的输入分布。

Details

Motivation: 视觉token剪枝减少序列长度、后训练量化降低数值精度，但独立优化或顺序应用忽略二者的相互影响，限制整体压缩和准确率权衡。

Result: P4Q在保持相近任务表现的同时取得更好的效率—准确率平衡；在LLaVA-NeXT八个测试集上的平均端到端推理加速为2.8倍，且准确率高于先前压缩和量化方法。

Insight: 剪枝前对投影特征副本模拟伪量化，使选token统计考虑低比特扰动；量化校准时则沿用剪枝策略，仅使用部署时保留的token分布，从而协调两种压缩步骤。

Abstract: Vision language models have achieved strong performance across a wide range of multimodal applications, yet their substantial computational and memory costs hinder efficient deployment. Visual token pruning and post-training quantization reduce inference overhead along two complementary dimensions, namely sequence length and numerical precision. Existing workflows typically optimize these techniques independently or apply them sequentially. Their distinct optimization objectives leave critical interactions unaddressed and constrain the achievable compression performance. We revisit these designs and present P4Q, a practical co-design framework that jointly optimizes visual token pruning and low-bit quantization for efficient VLM inference. First, P4Q introduces a quantization-aware visual token selection strategy before the LLM. It applies fake quantization to copies of the features produced by the projector and selects visual tokens using statistics computed from these fake-quantized features, thereby conditioning the selector’s feature-based decisions on simulated low-bit perturbations. Second, P4Q introduces a pruning-aware quantization calibration strategy. It uses the same selection strategy as pruning to calibrate the quantized model on the retained-token distribution, thereby aligning the calibration process with the pruned execution path used during deployment. By coupling these two components, P4Q achieves substantial inference speedups while maintaining comparable task performance, resulting in a better efficiency-accuracy trade-off than independently optimized pipelines. For instance, on LLaVA-NeXT, P4Q achieves an average end-to-end inference speedup of 2.8x across eight distinct test sets, while retaining higher accuracy than prior compression and quantization methods.

[241] SubRot: Signed Gradient Subspace Calibration for VLM Rotation Quantization cs.CVPDF

Zhenhao Shang, Haizhao Jing, Haokui Zhang, Guoting Wei, Rong Xiao

TL;DR: SubRot用激活梯度的带符号经验Fisher子空间指导VLM旋转量化，在保持整体重建的同时让量化误差沿有利方向分配。

Details

Motivation: 低比特VLM量化依赖模态或token级梯度统计，容易受样本间视觉—文本token比例和位置变化影响；绝对值及均值聚合又会丢弃符号和通道差异。

Result: 在五种VLM及五个基准上，SubRot在W4A6和W4A4下稳定超过FlatQuant，LLaVA-NeXT-7B平均提升最高1.4个百分点。W4A4下各模型相对FP16的平均准确率下降均不超过1.4个百分点，LLaVA-v1.5-13B反而高0.4个百分点。

Insight: 通道空间在不同样本间共享，可作为稳定任务敏感结构的坐标系。SubRot用Fisher特征分解找敏感方向，对符号稳定方向施加一阶带符号指导，对其余敏感方向加二阶约束，同时保留MSE控制整体误差。

Abstract: Post-training quantization reduces the deployment cost of vision-language models (VLMs), but preserving multimodal capabilities at low bit widths remains challenging. Existing methods rely on modality- or token-level gradient statistics, which are susceptible to cross-sample variations in visual-to-textual token ratios and the positions of visual information, limiting statistical stability. Moreover, overly coarse aggregation through absolute values and averaging discards gradient signs and channel-wise differences, limiting the separation of modality-specific sensitivities. In contrast, the channel space provides a shared coordinate system across samples, making it a more natural basis for capturing stable task-sensitive structures. We therefore propose SubRot, a signed gradient subspace calibration method for VLM rotation quantization. Through eigendecomposition of the empirical Fisher matrix of activation gradients, SubRot identifies a sensitive channel subspace with three properties: cross-sample stability, clear sensitivity separation, and consistent signed effects on the autoregressive loss along certain directions. Guided by a local Taylor expansion, SubRot combines signed first-order guidance along sign-stable directions with second-order constraints along the remaining sensitive directions, while retaining MSE for overall reconstruction quality. This objective steers quantization errors toward loss-decreasing directions while controlling their magnitude. Experiments on five VLMs across five benchmarks show consistent average-score improvements over FlatQuant under W4A6 and W4A4, reaching 1.4 percentage points on LLaVA-NeXT-7B. Under W4A4, average accuracy degradation from FP16 remains within 1.4 percentage points across all evaluated models, while LLaVA-v1.5-13B exceeds its FP16 average score by 0.4 percentage points.

[242] ECHO: Event-Augmented Context with Hindsight and Outlook for Wrist-Only Manipulation cs.CV | cs.ROPDF

Xinyue Wang, Yicheng Jiang, Zesen Gan, Junhao He, Jiaxu Wang

TL;DR: ECHO把腕载事件相机的运动线索压缩为潜在世界动作上下文，以回顾性离屏记忆和前瞻事件预测辅助机械手操作。

Details

Motivation: 极端曝光会使RGB观察退化，事件相机虽具高动态范围，却受视角限制；固定相机看不到静态环境变化，腕部相机移动后过去访问区域也会离开视野。

Result: RLBench腕载任务中，正常光照下ECHO较RGB和RGB加事件基线分别高20.6和12.0个百分点；严重曝光下降时分别高14.6和11.3个百分点，并超过使用第三人称相机的RGB参照。真实腕载事件相机实验在多任务及正常、昏暗光照下也优于基线。

Insight: 预训练事件编码器解释帧间视觉特征变化；回顾模块保存过去事件流对应的夹爪轨迹作为可寻址离屏上下文，前瞻模块则预测未来动作窗口的事件变化，使策略同时利用历史空间信息和未来场景变化。

Abstract: Learning-based manipulation policies relying on RGB cameras often suffer from degraded observations under extreme exposure. Event cameras mitigate this degradation by asynchronously detecting pixel-level intensity changes to offer a high dynamic range. However, their observations heavily depend on camera placement, as fixed cameras miss static scene content while wrist-mounted camera motion causes previously visited regions to leave the field of view. To address these spatial-temporal limitations, we present ECHO (Event-augmented Context with Hindsight and Outlook), a wrist-only latent world action model that encodes wrist events into compact motion representations to provide temporal and spatial context for policy reasoning. Specifically, ECHO utilizes a pretrained event encoder to explain visual-feature changes between frames. Its hindsight module preserves the gripper trajectory with past event stream as addressable off-camera context. Concurrently, the outlook module introduces learnable event foresight queries supervised to anticipate the event window for future actions, enabling the policy to predict upcoming scene changes. Evaluated on wrist-only RLBench tasks, ECHO outperforms RGB and RGB+event baselines by 20.6 and 12.0 percentage points under normal lighting, and by 14.6 and 11.3 points under severe exposure drops, respectively, while also surpassing RGB references using a third-person camera. Real-world experiments with a wrist-mounted event camera validate that ECHO outperforms RGB-only and RGB+event baselines across multiple tasks under both nominal and severely dark lighting. Project page is at https://echo-wam.github.io/.

[243] LVMT: Video Mask Transformer for Long-term Video Segmentation cs.CVPDF

Narges Norouzi, Niccol`o Cavagnero, Idil Esen Zulfikar, Bastian Leibe, Gijs Dubbelman

TL;DR: LVMT以轻量GRU选择并传播跨时间的目标信息，并用截断查询传播在显存可控条件下训练长视频分割。

Details

Motivation: 长时间遮挡和复杂场景会削弱在线视频分割；常用时间传播难以自适应保留有用目标信息，而整段长视频训练又受显存、梯度消失和计算开销限制。

Result: 在六个基准的多种视频分割任务上，LVMT达到新的最先进水平，同时保留基础高效模型的速度，比先前最先进方法快10倍。

Insight: GRU可学习在时间传播中保留哪些对象线索；截断查询传播按帧块处理视频，在块间传递目标信息、仅在块内反传，因此可扩展长程监督而不增加推理开销或占用整段反传显存。

Abstract: Existing online video segmentation methods struggle to track objects in long, complex videos with long-term occlusions. We hypothesize that this limitation is caused by (i) the inability of their temporal propagation mechanism to adaptively select the object information that is propagated across time, and (ii) their inability to be trained on long videos due to memory requirements and vanishing gradients. To address the first limitation, we propose to use a lightweight GRU-based temporal propagation module that can learn to select which information it keeps in memory and propagates across time. Second, to allow training on long videos, we introduce Truncated Query Propagation (TQP), a training strategy in which the model processes a video in chunks of frames, where information about tracked objects is propagated between chunks but backpropagation is only conducted in individual chunks, enabling longer temporal supervision without out-of-memory issues, inference overhead, or vanishing gradients. The resulting model is called the Long-term Video Mask Transformer (LVMT). Extensive experiments on six benchmarks show that LVMT sets a new state of the art across a range of video segmentation tasks, while retaining the speed of the highly efficient model it is based on, making it 10X faster than the prior state of the art. Code: https://www.tue-mps.org/lvmt

[244] ReSight-SMC: Two-Stage Power Sampling via Island SMC with Visual Scouts cs.CVPDF

Yaowen Zhang, Xiangyu Qiu, Junyi Hu, Zhi Lu, Wenwen Tian

TL;DR: ReSight-SMC通过隔离谱系的SMC岛、路由视觉侦察器和答案级重要性聚合，提高有限粒子预算下LVLM推理采样的多样性与效率。

Details

Motivation: 直接将幂采样扩展到LVLM时，全局重采样会导致粒子谱系坍塌；轨迹也未按不同视觉线索分流，有限预算下探索受限。此外，序列级强化会让支持相同答案的不同推理路径互相竞争。

Result: 在四种LVLM骨干和五个基准上，ReSight-SMC在推理与感知基准组的整体表现均强于Power-SMC；无需后训练，整体表现可与同骨干强化学习模型竞争。

Insight: 第一阶段用谱系隔离的SMC岛保持独立轨迹族，并让带前缀条件的视觉侦察器关注相关图像区域、避免重复，且以精确重要性校正保持原序列幂目标。第二阶段按规范化答案聚合终端重要性质量，再对答案边际分布强化采样并返回支持轨迹。

Abstract: Power sampling has emerged as a training-free approach to LLM reasoning, eliciting capabilities comparable to reinforcement learning by sharpening the model distribution over complete responses. Despite this success, power sampling remains underexplored in large vision-language models (LVLMs). We transfer Power-SMC to LVLM decoding by defining a sequence-power target conditioned on both the image and the prompt. This direct transfer provides a strong training-free baseline, but leaves two aspects of finite-particle multimodal inference unaddressed. At the particle level, global resampling can collapse genealogies, while particle-based power sampling does not diversify trajectories through distinct visual cues in multimodal decoding, limiting exploration under a finite particle budget. At the answer level, sequence-level sharpening makes distinct reasoning trajectories compete even when they support the same answer. We introduce ReSight-SMC, a verifier-free two-stage power sampler for LVLM inference. Its first stage uses ancestry-isolated SMC islands to preserve independent trajectory families and routes a bounded set of prefix-conditioned visual scouts to prefix-relevant image regions while discouraging redundant overlap. Each scout temporarily increases attention to the image tokens and emphasizes its routed region. Exact importance correction preserves the base LVLM sequence-power target. The second stage aggregates terminal importance mass by canonical answer, powers the answer marginal, and samples an answer together with a supporting trajectory. Across four LVLM backbones and five benchmarks, ReSight-SMC achieves stronger aggregate performance than Power-SMC over both the reasoning and perception benchmark groups. Without post-training, it remains competitive in aggregate with backbone-matched models trained using reinforcement learning.

[245] Resolution as a First-Class Decision: Task-Conditioned Routing for Efficient Multimodal Large Language Models cs.CVPDF

Zhiqiang Xia, Yang Li, Xinyuan Zhang, Yuchen Liu, Haoyu Lu

TL;DR: TCRR把视觉输入分辨率作为查询相关决策，由轻量跨模态路由器选择足够完成任务的最低压缩级别。

Details

Motivation: 高分辨率输入会形成大量视觉token，使MLLM计算量快速增长。既有方法多在编码后压缩token，却把输入分辨率设成与任务无关的固定参数，忽视更早的效率决策。

Result: 在Qwen3-VL-8B上，TCRR将视觉FLOPs降低40.9%、延迟降低53.7%，同时保持有竞争力的任务表现；其在多种架构上均改善效率前沿。

Insight: 路由器通过特征调制和跨注意力，让文本语义条件化骨干视觉表征，并预测每个查询足够用的最小压缩等级。50万样本、12类任务的教师标注数据用于近似帕累托最优压缩选择。

Abstract: The inference efficiency of Multimodal Large Language Models (MLLMs) is severely constrained by massive visual token sequences induced by high-resolution inputs, with computational cost scaling quadratically. Existing approaches primarily focus on downstream token compression, while overlooking a fundamental upstream inefficiency: input resolution is treated as a static, task-agnostic hyperparameter. We propose Task-Conditioned Resolution Routing (TCRR), which formulates visual compression as a task-conditioned decision and employs a lightweight cross-modal router that conditions backbone visual representations on textual semantics via feature-wise modulation and cross-attention to predict the minimal sufficient compression level per query. To support this, we curate a dataset of 500k samples across 12 task categories, labeled via a teacher-oracle pipeline to approximate Pareto-optimal compression scales. Extensive experiments across diverse architectures show that TCRR achieves a superior efficiency frontier, specifically reducing visual FLOPs by 40.9% and latency by 53.7% on Qwen3-VL-8B while preserving competitive performance. Further analysis of scaling behavior confirms that dynamically routing visual compression enables optimal resource allocation without modifying the MLLM backbone.

[246] Just MLPs: Efficient Visual State Reconstruction for Multimodal Language Models cs.CV | cs.AIPDF

Jingdi lei, Junxian Li, Di Zhang, Zhanqiu Zhang, Yiwen Guo

TL;DR: δ-Vision保留全部视觉token，但以低秩适配器重建各层视觉状态，减少它们反复经过Transformer演化的计算成本。

Details

Motivation: 长视觉token序列是MLLM计算开销的重要来源，常见剪枝虽删除冗余token，却会永久丢弃后续层可能需要的证据。作者转而研究能否在保留所有token的同时减少重复计算。

Result: 图像和视频基准上，δ-Vision在相近或更低计算量下优于视觉token剪枝基线，并提供有竞争力的推理效率；摘要未给具体速度数据。

Insight: 干预实验显示，阻断视觉到文本注意力后，只恢复少数低秩方向即可挽回大部分准确率，说明关键视觉影响集中在低维子空间；轻量MLP又能高相似度预测各层视觉状态，据此构造逐层视觉记忆供文本读取。

Abstract: Long visual token sequences often account for a substantial fraction of the computational overhead in multimodal large language models~(MLLMs). Existing approaches reduce this cost by pruning redundant visual tokens, but permanently discard visual evidence that may become useful in subsequent layers. We instead ask whether all visual tokens can be preserved while reducing the cost of repeatedly evolving the representations through the Transformer. To answer this question, we perform low-rank interventions on visual-to-text information flow. We find that, after visual-to-text attention is blocked, restoring only a few directions recovers most of the lost accuracy, suggesting the relevant visual influence is concentrated in a low-dimensional subspace. We further observe strong predictability in layer-specific visual states: lightweight MLPs approximate them with high cosine similarity and low reconstruction error. Motivated by these findings, we propose $δ$-Vision, which replaces repeated Transformer evolution of visual tokens with lightweight low-rank adapters that construct layer-wise visual memories while preserving all visual tokens for text retrieval. Across image and video benchmarks, $δ$-Vision achieves higher accuracy than visual token pruning baselines at comparable or lower computation, while delivering competitive inference efficiency without discarding visual tokens.

[247] Simultaneous Translation between Sign Languages cs.CV | cs.CLPDF

Zetian Wu, Bowen Xie, Stefan Lee, Liang Huang

TL;DR: 本文提出双向手语到手语的首个同步翻译系统，让目标手语在源手语者尚未完成表达时就开始输出。

Details

Motivation: 现有手语翻译通常要等完整源视频处理结束后才输出，无法用于实时广播口译或双向视频通话；同步输出还需控制等待延迟与翻译质量的权衡。

Result: 在六种翻译方向、人工核验测试集及较大合成语料上，流式系统相较完整句基线将计算感知延迟指标降低38%，DTW-PA-MPJPE仅增加9%，BLEU-4下降2.1分。

Insight: 研究比较直接对完整句模型应用测试时wait-k与通过随机多路径监督训练wait-k模型，并提出计算感知的ca-Stream-AL评测。词序案例分析可检查系统如何应对不同手语的词序差异。

Abstract: Deaf and hard-of-hearing (DHH) signers cannot converse in real time across different sign languages today: existing sign-to-sign translation systems run offline, requiring the full source clip before any target sign is emitted. Live use cases - e.g. broadcast interpretation and two-way video calls - instead demand simultaneous output, while the source signer is still signing. We present, to our knowledge, the first simultaneous sign-to-sign (S2S) translation system, with two wait-k regimes: test-time wait-k inference applied directly to a full-sentence model, and a trained wait-k model via stochastic multi-path supervision. We further introduce ca-Stream-AL, a computation-aware latency metric for streaming output. Averaged across six S2S directions on both a smaller human-verified test set and a larger synthetic S2S corpus, our streaming system achieves a 38% ca-Stream-AL reduction while staying within a 9% DTW-PA-MPJPE increase and a 2.1 BLEU-4 drop compared to the full-sentence baseline. A word-order case study probes how the streaming model handles word order mismatch between different sign languages - a consequence of simultaneous translation.

[248] SPIDER: Multi-Layer Semantic Token Pruning and Adaptive Sub-Layer Skipping in Multimodal Large Language Models cs.CV | cs.AIPDF

Tianxiang Chen, Zhentao Tan, Zi Ye, Yue Wu, Xiaobing Tu

TL;DR: SPIDER联合跨层语义token剪枝和解码器子层自适应跳过，在免训练条件下同时减少视觉数据冗余与模型计算冗余。

Details

Motivation: 现有MLLM加速多从视觉编码器输出剪枝或按块重要性分析解码器，较少利用视觉编码器不同层的语义变化，也忽略注意力与前馈网络在各层的贡献差异。

Result: SPIDER在多种MLLM架构和压缩比下保持稳定性能；例如LLaVA-NeXT-7B上FLOPs降低79%，同时保留基线96%的表现。

Insight: 中间视觉层可能保留更细的对象语义，后层则会将其抽象，因此剪枝应跨层选取；同时依据不同解码层注意力与FFN的贡献，动态跳过部分子层以减少计算。

Abstract: Multimodal Large Language Models face significant efficiency challenges that stem from two distinct yet coupled sources: data redundancy and computational redundancy. While most methods focus on data redundancy by pruning visual tokens from the output of the visual encoder or computing redundancy in LLM decoders using blockwise importance, the finer-grained inter-layer representation shifts and the distribution differences within the layers themselves have not been fully explored. In this work, we comprehensively investigate this dual-level inefficiency. We posit that intermediate layer tokens from vision encoders should be considered for effective visual token pruning, as semantic focus shifts across layers, with middle-layer tokens capturing more detailed object-centric information that deeper layers may abstract away. Furthermore, we reveal the differential contributions of Attention and FFNs across distinct LLM decoder layers. Building upon these discoveries, we propose \textbf{SPIDER}, a training-free framework that integrates multi-layer \underline{\textbf{S}}emantic visual token \underline{\textbf{P}}run\underline{\textbf{I}}ng with an a\underline{\textbf{D}}aptive sub-lay\underline{\textbf{ER}} skipping mechanism. Experimental evaluations demonstrate that SPIDER consistently maintains strong performance across various MLLM architectures and reduction ratios. For instance, on LLaVA-NeXT-7B, SPIDER reduces FLOPs by $79%$ while maintaining 96$%$ of the baseline performance.

[249] One Sensor, Whole Body - 3D Body Pose from a Single Consumer Earbud IMU cs.CV | cs.HCPDF

Zhilin Guo, Boqiao Zhang, Oszkár Urbán, Josef Bengtson, Hakan Aktas

TL;DR: 本文测试单只消费级耳机头部IMU能否恢复全身三维姿态，发现对下肢有效，而增加鞋垫传感器未必带来收益。

Details

Motivation: 耳机天然佩戴在头部并持续输出惯性数据，研究问题是这一单传感器能恢复多少全身姿态，以及增加更多消费级传感器是否有助益。

Result: 单头部IMU可将下肢姿态误差降至79.0毫米rigid-MPJPE，足部接触宏F1为0.809；因果版本保持大部分准确率并支持流式延迟。鞋垫IMU未显著改善姿态，四组模型划分中有两组还显著变差。

Insight: 跨四视角RGB-D、AirPods头部IMU和鞋垫IMU采集并同步数据，以SAM 3D Body伪标签构建35段单人基准，动捕提供测试真值。探针和消融表明瓶颈是鞋垫朝向偏差而非脚部位置；头部单传感器对近端上肢姿态仍不足。

Abstract: Consumer earbuds already stream inertial motion data from the head, one of the most widely worn sensor locations on the body. We ask how much of the 3D body pose a single such head IMU can recover, and whether adding more consumer sensors actually helps. We build a multimodal capture pipeline that records four-view RGB-D video together with an AirPods head IMU and two Striv insole IMUs, synchronize the streams post-hoc, and generate pseudo-ground-truth with SAM 3D Body, yielding a 35-take single-subject benchmark spanning gait, turning, vertical, everyday, and clinically inspired motions. Adapting two recurrent model families (IMUPoser and MobilePoser), we show that one head IMU recovers lower-body pose at 79.0 mm rigid-MPJPE and per-foot ground contact at 0.809 macro-F1, and that a causal variant retains most of this accuracy at streaming latency. In paired per-take significance tests across both families, adding the consumer foot IMUs never significantly improves pose and significantly degrades it in two of four model-split combinations; a mounting-bias probe and feet-only ablation identify insole orientation quality, not foot placement, as the mechanism. Extending the output to a 20-joint full-body skeleton maps the boundary: gross distal-arm motion is partially recoverable from the head alone, proximal upper-body pose is not, and staged fine-tuning recovers the leg accuracy that naive joint training sacrifices to multi-task dilution. For learned pose from consumer wearables, sensor reliability, not sensor count, is the binding constraint here. For the devices tested, the earbud is its sweet spot. Code is available at https://github.com/ZhilinGuo/one-sensor-whole-body.

[250] What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling cs.CV | cs.ROPDF

Renping Zhou, Zanlin Ni, Zihao Fan, Guohao Fu, Zeyu Liu

TL;DR: Simple-WAM指出世界动作模型的泛化收益主要来自推理时对未来表征的准备，而不需要完整生成未来帧。

Details

Motivation: 显式WAM在每个动作块期间去噪未来视频帧，计算昂贵；潜在WAM为加速而完全丢弃未来建模。虽然两者训练期都预测未来，但推理时是否必须生成未来存在争议。

Result: 在环境扰动、数据效率和任务泛化三个维度上，去除未来表征条件会一致损害泛化。Simple-WAM在模拟与真实任务中超过显式WAM的泛化表现，同时保持与潜在WAM相近的效率。

Insight: 差异几乎都源于去噪第一步：关键是让动作专家先接触并准备未来表示，而不是把它彻底生成成清晰帧。推理时一次前向输入全噪声视频token，并相应调整训练噪声日程即可保留收益。

Abstract: World action models (WAMs) predict the future alongside actions during \emph{training}. Due to the heavy computation cost of video denoising, whether the future must still be generated during \emph{inference} is disputed: Explicit WAMs denoise it into clean frames along with every action chunk, whereas Latent WAMs discard it entirely for acceleration. We find that latent WAMs, despite matching explicit ones on in-distribution tasks, fail to retain the generalization benefits that originally motivated WAMs. To demonstrate this, we evaluate generalization along three axes: \emph{environmental perturbation}, \emph{data efficiency}, and \emph{task generalization}. Controlled comparisons with a matched backbone, training data, and budget reveal consistent degradation across all three axes when the action expert no longer conditions on future representations. Further analysis shows that the gap arises almost entirely from the first denoising step: the benefit comes from \emph{preparing} the future, not \emph{generating} it. We therefore propose \textbf{Simple-WAM}, which simplifies future modeling into a single forward pass of fully noised video tokens and adapts the training-time noise schedule to this inference behavior. Across simulation and real-world tasks, Simple-WAM achieves the best of both worlds, leading explicit WAMs in generalization performance with efficiency comparable to Latent WAMs. Project Page: \href{https://zrporz.github.io/Simple-WAM-Web/}{\textcolor{panton}{\texttt{https://zrporz.github.io/Simple-WAM-Web}}}

[251] ActionUNet: Improving Robustness of VLA Models with Efficient Multi-scale Fine-tuning cs.CV | cs.ROPDF

Di Zhu, Ziheng Yan, Fang Wan

TL;DR: ActionUNet在VLA动作特征上加入多尺度时序融合，并用连续条件SIREN解码器及二阶平滑约束减少机械抖动。

Details

Motivation: VLA将粗粒度多模态语义映射为细粒度连续动作，尺度不匹配使其在杂乱环境中的泛化和鲁棒性受限；多尺度融合虽能聚合结构信息，却可能破坏微观时间连续性。

Result: 在RoboTwin 2.0、LIBERO-Plus及真实困难评测中，ActionUNet使π0.5成功率分别绝对提升9.8、6.1和11.4个百分点；迁移到回归式OpenVLA-OFT也有效。

Insight: 轻量时间U-Net在动作特征空间融合层次结构先验，条件SIREN则将结果解码为连续动作，并通过显式二阶平滑约束抑制高频抖动，从而降低机械执行失败且保留基础VLA泛化能力。

Abstract: Vision-Language-Action (VLA) models have shown great promise for robotic manipulation by mapping multi-modal semantics to physical actions. However, this mapping inherently struggles to align these coarse-grained semantics with fine-grained temporal execution. It leaves VLA models with limited generalization and insufficient robustness in cluttered environments. To overcome this issue, we propose ActionUNet, an efficient multi-scale fine-tuning framework that enhances pre-trained VLA models with minimal computational cost. ActionUNet first constructs a lightweight temporal U-Net within the temporal-aligned action feature space to fuse hierarchical structural priors, effectively bridging the scale gap between semantics and temporal executions. Recognizing that multi-scale modeling can disrupt microscopic temporal continuity and cause mechanical oscillations, ActionUNet then employs a conditional SIREN as a continuous action decoder. Equipped with explicit second-order smoothness constraints, this decoder guarantees temporal continuity and reduces high-frequency motion jitter. By smoothing temporal discontinuities from multi-scale fusion, this continuous formulation reduces mechanical execution failures while preserving the base VLA model’s generalization and manipulation robustness. Extensive experiments on RoboTwin 2.0 and LIBERO-Plus benchmarks, together with real-world hard evaluations, demonstrate that ActionUNet significantly improves π0.5 success rates by absolute 9.8%, 6.1%, and 11.4%, respectively, while also generalizing to the regression-based OpenVLA-OFT backbone, highlighting its effectiveness and efficiency as a fine-tuning strategy. Code and implementation details are available at https://github.com/Di-Zhu123/ActionUNet.

[252] Still There, No Longer Seen: Exposing Compression-Induced Risk in Large Vision-Language Models cs.CV | cs.AI | cs.CRPDF

Qiankun Li, Yuechen Zhang, Bowen Chen, Shilinlu Yan, Zhenhong Zhou

TL;DR: CIRA将视觉token压缩导致的特定失败定义为全token正确、压缩后错误的成对失效，并通过白盒扰动系统性操纵token优先级。

Details

Motivation: 整体鲁棒性无法区分对抗失败来自基础模型本身还是视觉压缩。压缩可能丢弃关键视觉证据，因此需要直接衡量压缩额外引入的风险。

Result: 在12种数据集—压缩器设置和四种预算下，CIRA平均压缩特定失败率为20.35%，同时把全token攻击成功率限制在6.92%；跨其他LVLM家族也有相似现象。跨视图选择稳定防御能显著压制攻击，自适应版本可部分恢复攻击效果。

Insight: 用全token推理正确、压缩推理错误来配对归因，能单独识别压缩诱发失效。CIRA仅需视觉编码器白盒访问，通过优化图像扰动改变不同预算下的token优先级，且不依赖问题、标签、语言模型或压缩器内部信息。

Abstract: Visual token compression reduces the inference cost of Large Vision-Language Models (LVLMs). However, aggregate robustness measures do not reveal whether a particular adversarial failure is induced by compression or inherited from the underlying model. We define a compression-specific failure (CSF) as an adversarial input that remains correct under full-token inference but fails after compression, casting compression-induced risk as a paired failure attribution problem. Within a controlled diagnostic cohort, counterfactuals show that retained-set allocation causally changes compressed correctness and reveal a negative association between recovery and representation drift in displaced evidence. Motivated by these findings, we propose CIRA, a Compression-Induced Risk Attack for Large Vision-Language Models. Under a vision-encoder white-box setting, CIRA optimizes image perturbations through encoder-side objectives that manipulate token priorities across candidate compression budgets while preserving displaced evidence. CIRA uses no downstream questions or labels and requires no access to the language model, deployed compressor, or exact compression budget. Across 12 dataset-compressor settings evaluated at four budgets, CIRA achieves a mean CSFR of 20.35% while limiting full-token attack success to 6.92%, with similar behavior on additional LVLM families. A cross-view selection-stabilization defense substantially suppresses CIRA, although Adaptive CIRA partially restores its effectiveness. These results show that compression-specific failures persist under restricted access and support paired evaluation of full-token and compressed inference for attributing risk to visual-token compression.

[253] Verifying the Linear Representation Hypothesis: How Interpretable Are Vision SAEs? cs.CVPDF

Teodor Chiaburu, Franz Motzkus, Frank Haußer, Felix Bießmann

TL;DR: 本文以人类判断验证视觉稀疏自编码器概念的可解释性，发现常见稀疏度和字典一致性指标不能可靠替代人类可解释性评估。

Details

Motivation: 视觉SAE常被认为能把多义特征分解为单义、人类可理解概念，这依赖线性表征假设；但现有评价常用稀疏度等代理指标，未经验证便假定它们符合人类理解。

Result: 将自然语言处理中的自动可解释性评分适配到视觉并通过用户研究验证后，发现SAE的既有解释性指标彼此不相关，也与该评分不相关。

Insight: 没有单一免参考指标——无论基于稀疏表示假设与否——足以证明视觉SAE概念可解释。解释方法评估应采用更可验证、以真实标注或人类判断为锚点的设计。

Abstract: Vision Sparse Autoencoders (SAEs) have become a popular tool in Mechanistic Interpretability due to their presumed ability to disentangle complex features learned by a model into monosemantic concepts. Despite their growing popularity, evaluating their interpretability remains an active topic of research. The bedrock motivating the adoption of SAEs is the Linear Representation Hypothesis (LRH), which claims that polysemantic features can be projected onto a (near) orthogonal basis of sparse, human-understandable representations. Yet, most current frameworks evaluate proxies such as the sparsity of SAE features or the coherence of the inferred dictionary, implicitly assuming that these reflect alignment with human perception. In this paper, we provide empirical evidence that measuring the interpretability of SAE concepts is more difficult than these proxies suggest. To this end, we adapt the Autointerpretability Score (AIS) - previously shown to align with human judgments in Natural Language Processing - to vision tasks and validate our approach in a dedicated user study. We evaluate SAE concept quality using both standard metrics and our adapted AIS. We find that established interpretability metrics for SAEs correlate neither with one another nor with AIS, indicating that no single reference-free metric, whether grounded in the LRH or not, is sufficient for verifying the interpretability of vision SAEs. We argue these findings support recent calls for more verifiable, ground-truth-anchored design and evaluation of explanation methods.

[254] Proxy2World: Learning to Generate Worlds From Lightweight Proxies without Seeing Them cs.CVPDF

Hongli Xu, Weilong Yan, Anbang Wang, Chunyu Zou, Siyu Hong

TL;DR: Proxy2World从普通带位姿RGB-D视频学习由轻量几何代理控制的世界生成，无需大规模人工制作的代理—视频配对数据。

Details

Motivation: 几何代理可让创作者控制场景布局与运动，同时保留外观想象空间，但合适代理并不唯一，因而难以自动大规模构建成对代理视频训练数据。

Result: 在涵盖多种场景、相机轨迹和主体运动的ProxyBench上，Proxy2World在结构遵循与视觉质量之间取得比相机控制和几何条件方法更好的平衡；评估综合定量指标、VLM、人类判断及定性结果。

Insight: 通过跨模态流匹配联合学习深度条件RGB生成与RGB-D联合生成，让模型建立代理结构和真实外观之间的关联；推理时混合代理与相机去噪，使生成服从代理而仍具自然细节。

Abstract: Lightweight scene proxies let creators control scene layout and motion while leaving room for imagination in appearance, lighting, and visual effects. However, a suitable proxy is not uniquely defined, making paired proxy-video data difficult to construct automatically at scale. We present Proxy2World, a controllable world model that learns these complementary capabilities from ordinary posed RGBD videos, without training on authored proxy-video pairs. The model jointly learns depth-conditioned RGB generation and joint RGBD generation through cross-modal flow matching. Learning both tasks enables proxy-camera hybrid denoising at inference to follow the proxy structure while producing natural, detailed visuals. We further introduce ProxyBench to evaluate this capability across a diverse set of scenes, camera trajectories, and subject motions. Experiments on ProxyBench show that Proxy2World achieves a better balance between structural adherence and visual quality than camera-controlled and geometry-conditioned methods, supported by quantitative metrics, VLM assessments, human evaluations and diverse qualitative results.

[255] LEGAU: Learning Semantic Gaussian Priors for Scalable Category-level Pose Estimation cs.CVPDF

Hongli Xu, Zhaowei Lu, Junwen Huang, Jiaqi Hu, Peter KT Yu

TL;DR: LEGAU联合预测类别级NOCS对应、物体位姿与尺寸以及语义高斯场，把类别条件形状先验直接用于姿态估计。

Details

Motivation: 单幅RGB-D的类别级六自由度位姿估计欠约束，部分可见几何必须结合规范物体结构才能稳定推断位姿；把形状重建仅作为辅助任务可能无法真正帮助局部定位。

Result: 合成与真实基准显示，LEGAU在单模型多类别设置下性能强，在SOPE上最高提升22%，并能有竞争力地迁移到真实数据。

Insight: 把规范语义高斯场作为参与多模态融合和局部位姿推理的类别条件结构先验，而非与位姿预测分离的重建输出；文本类别嵌入将视觉、几何与类别线索联合用于对应、尺寸和位姿解码。

Abstract: Category-level 6D pose estimation from a single RGB-D observation is inherently under-constrained, since partial visible geometry must be interpreted together with a canonical object structure before a stable pose can be determined. We present LEGAU, a unified framework that jointly predicts NOCS correspondence, object pose and size, and a canonical Semantic Gaussian Field. Rather than treating reconstruction as a detached auxiliary task, LEGAU uses the Gaussian field as a category-conditioned structural prior that participates in multimodal feature fusion and provides global guidance for local pose reasoning. Conditioned on a categorical text embedding, LEGAU processes RGB-D observations through a transformer-based fusion module that integrates visual, geometric, and category-level cues, decoding the NOCS map, pose and size information and the Gaussian-based object representation. Extensive experiments on synthetic and real-world benchmarks show that this coupled pose-shape formulation achieves strong performance in a single-model multi-category setting, with up to 22% on SOPE and competitive transfer to real-world data. These results highlight the benefit of jointly learning canonical correspondence, object shape, and pose alignment within a unified representation.

[256] OPIS: An Input-Grounded Benchmark for Multi-Object Memory in Video World Models cs.CV | cs.AIPDF

Hao Wang, Tao Yu, Liuzhou Zhang, HeXin Wang, Haopeng Jin

TL;DR: OPIS用初始观察中的固定物体实例清单评测视频世界模型的物体记忆，分层测量其存在、身份和结构是否保持。

Details

Motivation: 依赖生成历史、视频参照或挑选回访视角的评估协议可能混淆模型真实记忆与生成内容。需要把评测锚定在输入中已出现的特定物体实例。

Result: OPIS包含500个真实、机器人和游戏世界案例，密集标注12,672个刚性、可动关节和可变形实例。八种世界模型得分为48.65至56.01；清单从少于20个物体增至40个以上时，存在、身份和结构总体下降，平均身份分从40.22降至23.11。

Insight: 对象关联与显式可见性判断共同构成分层评测器，可按静态或动态运动学轨迹评价物体存在、身份、结构。结果表明保留输入中具体实例远比生成视觉上合理的物体困难。

Abstract: Video world models must preserve the visual state of the world over time, but existing evaluation protocols often rely on generated histories, video reference, or selected revisit viewpoints that can confound the assessment of a model’s true memory capability. To address this, we introduce OPIS, an input-grounded benchmark that strictly anchors the assessment to a fixed set of object instances from the initial observation for evaluating multi-object memory in video world models. The OPIS dataset comprises 500 cases across real-world, embodied-robotic, and game-world domains, providing dense object-level annotations for 12,672 rigid, articulated, and deformable instances. Our object-centric evaluator combines association and explicit visibility reasoning to hierarchically measure Object (O) Presence (P), Identity (I), and Structure (S), utilizing static or dynamic evaluation tracks based on object kinematics. Across eight image-to-video or camera-conditioned world models, our proposed OPIS scores range from 48.65 to 56.01. As the reference inventory grows from less than 20 to more than 40 objects, the Presence, Identity, and Structure scores show an overall decline, with the average Identity score falling from 40.22 to 23.11. The results demonstrate that preserving the particular object instances in the input is considerably harder than generating plausible visual elements.

[257] RefineDrive: Reliable Failure-Guided Learning for Vision-Language-Action Driving cs.CVPDF

Zhe Sun, Ziyi Luo, Yehao Lu, Lei Zhou, Xi Li

TL;DR: RefineDrive让驾驶VLA从自身模拟失败中学习，以可验证诊断、满足硬安全约束的最近修正轨迹和分层安全强化奖励直接改进规划。

Details

Motivation: 驾驶VLA高度依赖成功专家演示，未充分利用自身失败；但失败诊断可能不可靠、纠正目标可能不匹配，粗粒度奖励又难以体现安全优先级。

Result: NAVSIM v1上，RefineDrive把4B基础监督策略PDMS从87.7提升至91.7；不再训练直接用同一检查点在NAVSIM v2扩展指标的原NAVTEST场景得89.4 EPDMS。

Insight: 诊断从模拟器状态中提取碰撞和越界等可验证反馈；从人类轨迹库检索满足硬安全条件且尽量保留失败动作模式的近邻修正。训练时以辅助任务监督诊断和修正，再用硬安全优先奖励优化；部署时仍直接根据驾驶上下文输出轨迹。

Abstract: Vision-Language-Action (VLA) models for autonomous driving rely heavily on successful expert demonstrations, leaving model-specific failures underexploited. Learning from these failures is hindered by unreliable diagnoses, poorly matched correction targets, and coarse rewards. We propose RefineDrive, a failure-guided post-training framework that learns from self-generated failures through targeted supervision and safety-aware reinforcement learning. Reliable Diagnosis derives structured, verifiable feedback on collisions and drivable-area violations directly from simulator states. Minimum-Correction Target Retrieval searches a clustered human trajectory bank for nearby corrections that satisfy hard-safety constraints in the current scene, prioritizing preservation of the failed prediction’s motion pattern. Conditioned on the driving context and failed trajectory, Correction SFT learns to generate the diagnosis followed by the retrieved correction as a training-only auxiliary task. We then apply GRPO with a Safety-Layered Reward that strictly prioritizes hard-safe trajectories, retains continuous safety feedback for both unsafe and hard-safe trajectories, and rewards driving progress only after hard safety is satisfied. At inference, the policy directly predicts trajectories from the driving context without an explicit diagnosis or repair stage. On NAVSIM v1, RefineDrive improves the 4B base SFT policy from 87.7 to 91.7 PDMS. Using the same checkpoint without additional training, RefineDrive achieves 89.4 EPDMS on the original NAVTEST scenes evaluated with NAVSIM v2 extended metrics. Controlled ablations support the benefits of structured diagnosis supervision, retrieved corrections, and safety-layered optimization for direct planning.

[258] Advancing Video-Text Pretraining with Multi-View Captions cs.CVPDF

Fida M. Thoker, Renaud Vandeghen, Karen Sanchez, Marc Van Droogenbroeck, Bernard Ghanem

TL;DR: 多视角字幕框架从千万级视频生成摘要、细节、推理修订和语义正例字幕，并以粒度感知文本表征改进视频—文本预训练。

Details

Motivation: 视频文本预训练常依赖每段视频单条稀疏字幕，不能覆盖丰富时空语义；直接用字幕模型生成则可能引入噪声，语言监督质量未随模型和数据规模同步改进。

Result: 用生成的多视角字幕预训练后，在标准、细粒度和详细文本视频检索基准上的零样本与微调表现均持续提升，且使用的预训练语料少于既有方法；摘要未报告具体分数。

Insight: 互补的概要和详细描述、基于推理的修订及语义正例扩充监督多样性、忠实度和覆盖面；分别为摘要和细节视角设置CLS token，显式保留文本监督粒度。

Abstract: Video-text pretraining has achieved remarkable progress through the scaling of models and datasets, yet the quality of language supervision remains underexplored. Existing web-scale datasets often provide only a single sparse caption per video that fails to capture rich spatiotemporal semantics, while directly using captioning models can generate noisy descriptions. We propose a large-scale multimodal large language model-based supervision generation framework that improves supervision diversity, fidelity, and semantic coverage. Starting from 10 million videos, our approach generates multi-view captions (MVC) through complementary summary and detailed captions, reasoning-based refinement, and semantic positive caption generation. To effectively exploit supervision at different granularities, we further introduce a granularity-aware text representation with separate CLS tokens for summary and detailed views. We pretrain video-text models using the resulting supervision corpus and evaluate them across standard, fine-grained and detailed text-to-video retrieval benchmarks. Our approach consistently improves both zero-shot and fine-tuned performance while using smaller pretraining corpora than existing methods, demonstrating the importance of rich and complementary textual supervision for video-text pretraining. Project page: https://rvandeghen.github.io/mvc/

[259] VideoPhysEdit: Physical Counterfactual Video Editing via Rigid-Body Physical Scene Reconstruction cs.CVPDF

Conghan Yue, Yuanjie Chen, Yue Han, Ya Gao, Yunyan Xiao

TL;DR: VideoPhysEdit先重建可复现原视频刚体运动与互动的物理场景，再将编辑作为物理干预模拟后续轨迹并引导反事实视频生成。

Details

Motivation: 视频编辑方法开始处理阴影和遮挡等视觉后果，但改变物体后引起的运动和交互变化研究较少；物理反事实编辑还缺少成对数据与专门评测。

Result: 作者提出合成基准PCVE-RigidBench和Physical Edit Score。VideoPhysEdit的Physical Edit Score为0.376，是对比方法中唯一正值，物理编辑准确性显著更高且视觉质量有竞争力；真实视频案例也更好呈现下游运动和互动。

Insight: 通过模拟重建与观测运动、互动相一致的刚体场景，显式推断物理编辑造成的后续变化，再用模拟轨迹约束生成，能够检验模型是否理解干预后果，而非只改变编辑帧的外观。

Abstract: Video editing has advanced substantially in recent years, with methods increasingly accounting for the visual consequences of edits, such as changes to shadows and occlusions. However, the physical consequences of edits, including changes to subsequent motion and interactions, remain less explored. We formulate this problem as physical counterfactual video editing (PCVE), which aims to generate a counterfactual video depicting the resulting motion and interactions given a source video, a physical edit, and its execution frame. PCVE is challenging because it requires understanding scene physics and inferring the downstream motion and interactions induced by a physical intervention, while paired factual and counterfactual data and dedicated evaluation metrics are lacking. We introduce VideoPhysEdit, a new training-free pipeline for PCVE in rigid-body scenes. It makes physical reasoning explicit through a novel physical scene reconstruction method that recovers a scene reproducing the observed motion and interactions under simulation, enabling the pipeline to apply physical edits as interventions and use the resulting trajectories to guide counterfactual video generation. We further construct PCVE-RigidBench, a synthetic benchmark with paired source and counterfactual target videos and physical ground truth, and introduce the Physical Edit Score. VideoPhysEdit achieves substantially higher physical edit accuracy than open-source methods and commercial models while maintaining competitive visual fidelity. Its Physical Edit Score is 0.376, the only positive score among the compared methods. Qualitative comparisons on real videos further show that VideoPhysEdit applies to real-world scenes and better depicts the downstream motion and interactions induced by the edits than the compared methods. Code: https://github.com/Hammour-steak/VideoPhysEdit

[260] From UNI2-h to ConvNeXt-T: Lightweight Nuclei Instance Segmentation via Knowledge Distillation cs.CVPDF

Wenyan Li

TL;DR: 本文将UNI2-h病理基础模型的输出知识蒸馏到轻量ConvNeXt-Tiny，用较小模型实现高速细胞核实例分割。

Details

Motivation: 细胞核实例分割是数字病理核心任务，但高精度系统依赖大型视觉Transformer编码器，推理速度难以满足临床实时需求。

Result: 34.7M参数学生仅为教师参数量的二十分之一，在PanNuke达到mPQ 0.519，为教师的98.8%；在MoNuSeg零样本bPQ为0.668，推理速度634.3张/秒，1024²全分辨率分析仅0.045秒，即快21.8倍。

Insight: 输出级知识蒸馏已足以转移高效分割所需知识；多尺度门控卷积MALA在ViT编码器下没有收益，因此轻量部署不必为了结构复杂而额外引入无效模块。

Abstract: Nuclei instance segmentation is a core task in digital pathology, yet high-accuracy models rely on large vision transformer (ViT) encoders whose inference speed cannot meet real-time clinical demands. We propose a lightweight scheme that distills the UNI2-h pathology foundation model into a ConvNeXt-Tiny student (Ours-T, 34.7M parameters, 1/20 of the teacher) via output-level knowledge distillation. Ours-T achieves an mPQ of 0.519 on PanNuke (98.8% of the teacher), a zero-shot bPQ of 0.668 on MoNuSeg, and an inference speed of 634.3 img/s, requiring only 0.045 s for full-resolution 1024^2 analysis (21.8x speedup). Experiments further show that multi-scale gated convolution (MALA) yields no gain under ViT encoders, and output-level distillation alone suffices for efficient knowledge transfer.

[261] Timeline-Bench: Evaluating Agents on Realistic Video-Editing Tasks, from Raw Footage to Final Cut cs.CV | cs.AI | cs.MMPDF

Gunin Gupta, Nirmit Arora, Pavan Kalyan Tankala

TL;DR: Timeline-Bench用56项完整视频编辑交付任务评估智能体从原始素材到成片的专业长程工作能力，并通过编辑师校准的测试判断结果。

Details

Motivation: 智能体基准很少要求交付可用的创意成品，而真实视频剪辑需要挑选素材、组织叙事、加入声音和图形，并符合格式与需求。

Result: 56项任务上表现最好的Codex配置也只解决15项，即26.8%；平均智能体解决率14.0%。人类编辑师在83.5%的比较中偏好参考成片；771次未解决运行里562次仅未通过质量测试。

Insight: 每项任务提供制作说明、源素材、容器和测试，只有所有测试通过才算完成；质量测试基于43名视频编辑师的2,582次盲评校准。多数失败不是不能看到素材或渲染缺陷，而是智能体缺乏成片工艺判断。

Abstract: AI agents increasingly carry out long-horizon professional work, but their evaluations rarely require a finished creative deliverable. To this end, we introduce Timeline-Bench, a benchmark of 56 real video-editing tasks, each asking an agent to turn raw production material into a finished video. Tasks range from selecting dialog takes and shaping interview footage into a story to cutting commercials from product shots, voiceovers and graphics. Every task provides a brief, source assets, a container and a set of tests. A task is resolved when the output passes every test. The tests check the delivery format, the content and the brief’s explicit requirements, and include a quality test calibrated on 2,582 blind judgments by 43 video editors. We evaluate 16 agents that pair frontier models with coding-agent harnesses such as Codex, Claude Code and OpenCode. The best, GPT-6 Astra in Codex with curated editorial guidance, resolves only 15 of the 56 tasks (26.8%), and the average agent resolves 14.0%. Human editors prefer the reference edit in 83.5% of judgments. Most unresolved runs (562 of 771) fail only the quality test: agents perceive footage through stills and transcripts and check their renders for defects, not craft. We release the tasks, verifier and per-run results at https://timelinebench.tensortest.com.

[262] G$^3$-LoRA: Organizing Reward-Weighted Video Data with Gradient-Guided Grouped LoRA cs.CV | cs.LGPDF

Jia Song, Wenhow Li, Lichen Bai, Bada Ye, Zeke Xie

TL;DR: G³-LoRA依据奖励加权视频样本的梯度兼容性分组训练专用LoRA，再合并并在线蒸馏，减少异质奖励维度共同训练造成的能力互相抵消。

Details

Motivation: 异质奖励视频后训练通常假设各数据类别更新兼容，但不同技能、领域或评估维度可能要求冲突的去噪方向，联合LoRA会平均不同能力。

Result: 在Wan2.1-T2V-1.3B上，分组合并适配器在匹配VBench2.0及独立评估上优于基础模型、联合奖励LoRA和随机/语义/原始梯度分组；在CogVideoX-2B上避免联合训练的负迁移。分组最大专长收益会被合并压缩，蒸馏可恢复部分。

Insight: 先移除类别梯度共享的全局方向，再按残余梯度兼容性聚类并训练专家，之后权重合并并从专家进行在线策略蒸馏。相机运动和部分局部质量维度仍具挑战，说明兼容性分组是诊断和组织工具而非能消除所有权衡。

Abstract: Post-training foundation video models on heterogeneous reward-weighted data usually assume that all data categories induce compatible updates. This assumption is fragile when categories correspond to different skills, domains, or evaluation dimensions. We study this problem in text-to-video post-training, where VBench2.0 dimensions define data buckets and an external multimodal reward pipeline assigns sample weights. We propose G$^3$-LoRA (Gradient-Guided Grouped LoRA), a data organization procedure that probes category-level gradients induced by reward-weighted video samples, removes the shared global update direction, clusters categories by residual gradient compatibility, trains group-specific LoRA experts, and consolidates them into one adapter by weight merging followed by on-policy distillation from the experts. We motivate this procedure by viewing reward-weighted flow matching as velocity-field regression: incompatible reward dimensions may prefer different denoising directions in overlapping noisy latent regions, causing shared LoRA training to average capabilities. On Wan2.1-T2V-1.3B-Diffusers, the merged grouped adapter improves the matched VBench2.0 evaluation over the base model, a joint reward-weighted LoRA baseline, and random, semantic, and raw-gradient partitions trained with the same pipeline; an independent evaluator agrees, and on CogVideoX-2B grouping avoids the negative transfer of joint training. The gain is not uniform: merging compresses the largest specialist gains, distillation recovers part of this loss, and camera motion and several local-quality dimensions remain challenging. Together, these results suggest that gradient compatibility can serve as a practical diagnostic for organizing reward-weighted video post-training data.

[263] Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning cs.CV | cs.AIPDF

Hao-Xuan Ma, Yihao Liu, Yutao Sun, Yanting Miao, Mengyu Zhou

TL;DR: Token-Disentangled Latent Test-Time Scaling按潜token角色分配视觉感知或推理反馈，并锚定未选token，提升多模态推理且控制推理时更新。

Details

Motivation: 潜在测试时扩展常给所有可编辑隐token施加同一个标量奖励，忽略有的token主要承载视觉证据，有的对应不确定推理决策，因此反馈可能路由错误。

Result: 在Qwen2.5-VL-7B和InternVL3.5-8B的感知与推理基准上，宏平均准确率较CoT分别提升2.57和1.51个百分点；在解码候选预算匹配时超过强输出空间测试时扩展基线。

Insight: 从初始轨迹优化短隐状态前缀，将感知侧视觉反馈路由到图像敏感token，将推理反馈路由到高熵token；两类都未选中的token用锚定正则限制漂移，实现角色分离的潜表示细化。

Abstract: Latent test-time scaling improves reasoning by refining hidden states during inference, but existing methods typically apply a single scalar reward to all editable latent tokens. For multimodal large language models, this global update ignores that generated tokens play different roles: some are sensitive to visual evidence, while others correspond to uncertain reasoning decisions. We present Token-Disentangled Latent Test-Time Scaling, an inference-time framework that makes latent refinement token-role-aware. Starting from an initial generated trajectory, we optimize a short hidden-state prefix while routing perception-side visual feedback to image-sensitive tokens and reasoning feedback to high-entropy tokens. Tokens selected by neither route are constrained by an anchor regularizer. Across both perception and reasoning benchmarks on Qwen2.5-VL-7B and InternVL3.5-8B, our method lifts macro accuracy over CoT by +2.57 and +1.51 respectively, and outperforms strong output-space test-time scaling baselines under matched decoded-candidate budgets. Code is available at https://github.com/Qwen-Applications/TD-LTTS.

[264] Beyond Selection: Token Parameterization for Extreme Visual Token Compression cs.CV | cs.LGPDF

Rui Zhong, Yu Li, Zheyu Yan, Cheng Zhuo

TL;DR: Braco将视觉token压缩拆成表征基变换与结构截断、坐标组织两个问题，并以轻量四步编码器兼顾极限压缩下的可压缩性和可学习性。

Details

Motivation: 极端压缩时token剪枝容易破坏视觉定位；学习式重采样又增加参数、注意力开销和训练复杂度，限制精度—效率权衡。

Result: 在23倍至64倍压缩区间，Braco形成更优的经验准确率—效率前沿；144倍压缩下仍达95.2%准确率，相对未压缩上界降低84.2%至86.7%预填充FLOPs。相较既有方法端到端最多快约36%，压缩器延迟和FLOPs分别低16.6倍和78.8倍。

Insight: 统一目标将可压缩性与可学习性分别形式化，再组合变换基截断、与输入无关的基坐标嵌入、随预算调整的正交重参数化，以及由轻量池化生成的空间残差token，避免单纯删除证据或引入沉重重采样器。

Abstract: Visual-token compression is effective for improving the efficiency of vision-language models, but under extreme compression budgets, token pruning can break visual grounding while learned resamplers increase parameter count, attention cost, and training complexity. We revisit compression through a token parameterization lens, separating (i) basis transformation and structured truncation (retained subspace/compressibility) from (ii) coordinate organization (optimization and cross-modal alignment). This view yields two coupled objectives, compressibility and learnability, which we formalize as unified functionals. Guided by these objectives, we design Braco, a lightweight four-step coder that combines transform-basis truncation, input-independent basis-coordinate embeddings, budget-dependent orthogonal re-parameterization, and learned spatial residual tokens from lightweight pooling. Experiments show that Braco forms the favorable empirical accuracy-efficiency frontier under $23\times$–$64\times$ compression and remains competitive at $144\times$, reaching 95.2% accuracy while reducing prefill FLOPs by 84.2%–86.7% relative to the uncompressed upper bound. Against prior methods, Braco matches or improves accuracy while achieving up to approximately 36% end-to-end speedup and using $16.6\times$/$78.8\times$ lower compressor latency/FLOPs.

[265] AnswerMap: Faithful Spatial Interpretability of VLMs from Answer Posteriors cs.CV | cs.LGPDF

Mohamed Eltahir, Fardows Adam, Duaa M. Tahir, Lama Alamoudi, Sana Ammar

TL;DR: AnswerMap通过逐行和逐列询问冻结VLM相关性，组合输出头的肯定概率生成黑盒空间解释，并可由同一热图导出连续位置。

Details

Motivation: 文本理由使用与图像不同的模态，内部读出又发生在最终输出之前且需白盒访问，难以忠实解释VLM对具体视觉查询的回答。

Result: 四种模型、三类查询分布上的热图位置与模型自身指点一致性AUC为0.85，对比注意力图0.38；删除热图区域使53%的正确回答翻转，对比注意力区域19%。最大值、期望和高质量区域裁剪分别支持幻觉检测、定位补救和纠错。

Insight: 将图像切成行带和列带，分别查询其与问题是否相关，再用两组肯定概率的外积形成查询条件化空间图。固定读出可直接得到连续坐标；与模型指点一致及区域删除干预可检验解释是否忠实。

Abstract: When a VLM answers a visual query, current interpretability tools rely on text rationales, which use a mismatched modality, or on internal read-outs, which originate too early to reflect the final output and require white-box access to the model. We introduce AnswerMap, a training-free, task-agnostic, black-box visual rationale constructed from the output head. The image is cut into K row and K column bands, each shown alone to the frozen model along with the query in the format of a yes/no relevance question. The outer product of the row and column ``yes’’ posteriors gives the query-conditioned spatial map. Crucially, by defining a fixed read-out R (e.g., expectation, maximum) on top of AnswerMap, we can derive continuous outputs like location natively. This bypasses the reliance on discrete text tokens for continuous-output tasks and guarantees an image-dependent answer by construction. However, a rationale can be confabulated, so we validate AnswerMap across four models and three query distributions with two tests: (a) agreement with the model’s own generated point and (b) deletion of the map’s region. The map lands where the model points (AUC 0.85 against 0.38 for attention), and deleting its region flips 53% of correct answers (against 19% for attention’s). Beyond establishing faithfulness, we demonstrate the map’s task-agnostic utility through three distinct read-outs: its maximum flags hallucinated objects without generation, its expectation localizes correctly when the model’s own pointing fails, and its top-mass region, fed back as a crop, fixes half of the model’s wrong answers. AnswerMap thus offers a new lens on VLM interpretability and, through its read-outs, a new output interface for visual tasks beyond text tokens.

[266] Evaluating Hierarchy-Aware Deep Learning for the Recognition of Tironian Notes cs.CVPDF

Yule Kang, Thomas Gorges, Janne van der Loop, Franziska Marske, Nikolaus Weichselbaumer

TL;DR: 本文比较扁平分类、粗到细层级模型和层级路由用于识别细粒度蒂罗尼亚速记，并发现是否进行少样本域适配会改变最佳方案。

Details

Motivation: 蒂罗尼亚速记符号数量大、笔画差异细且彼此视觉相似，人工释读耗时，真实手稿训练样本有限；普通扁平分类没有显式利用符号间结构关系。

Result: 在Vergilius Turonensis手稿域上，未适配时HD-CNN Top-1最佳为45.43%；少样本适配后，扁平分类最高为82.09%。总体上层级信息在未适配条件下更有帮助。

Insight: 基于理想化符号形式与符号层级结构，论文比较多种卷积和Transformer扁平分类器、粗到细模型及重新聚类路由。模型选择需考虑域适配条件，层级结构有用但并非适配后始终优于扁平方案。

Abstract: Tironian notes are generally regarded as the first Latin shorthand system and are notable for their large, fine-grained symbol inventory. Their high visual similarity and large class set make manual reading time-consuming, leaving manuscripts that contain Tironian notes inaccessible to many researchers. Automatic recognition is also challenging because models must distinguish subtle differences in stroke shape and sign structure while realistic training data remain scarce. However, standard flat classifiers do not explicitly use visual or structural relations between related signs. This paper investigates whether structural relationships between Tironian notes can support automatic recognition. We use the Supertextus Notarum Tironianarum (SNT) by Martin Hellmann, which provides idealized sign forms and a hierarchical organization of Tironian notes. We compare flat ResNet18, ConvNeXt, Shifted Window Transformer (Swin), and Vision Transformer (ViT) classifiers with Hierarchical Deep Convolutional Neural Network (HD-CNN)-style coarse-to-fine models and hierarchy-aware routing models based on visual class cleaning and similarity-based re-clustering. The models are evaluated on handwritten samples and manuscript-domain samples from Vergilius Turonensis, both with and without limited few-shot adaptation to the manuscript domain. The results show that the relative performance of flat and hierarchical models depends on adaptation. On Vergilius Turonensis, HD-CNN achieves the best non-adapted Top-1 result with 45.43%, while flat classification reaches the best Top-1 result after few-shot adaptation with 82.09%. Overall, the results indicate that hierarchical structure can support Tironian note recognition, especially under non-adapted conditions.

[267] Beyond Saying Less: Fine-Grained Alignment for Informative and Faithful Vision-Language Models cs.CVPDF

Xingming Long, Jie Zhang, Yuecong Min, Shiguang Shan, Xilin Chen

TL;DR: DOPA密集标注对象出现与缺失，SCAPO再按子句分配强化学习信用，目标是在减少幻觉时仍保留真实且有信息量的描述。

Details

Motivation: 在线强化学习能针对模型当前错误，但奖励粗糙时模型可能用少说话的捷径减少幻觉，连真实对象也不提，牺牲描述信息量。

Result: 实验显示该框架能生成信息丰富且忠实的描述，并在判别式评估上取得明显提升；摘要未列具体得分。

Insight: DOPA对扩展词表中的每个概念穷尽标注是否出现，使在线轨迹中的对象陈述获得稠密、可核验奖励；SCAPO则按子句中的对象主张独立分配信用，避免局部幻觉牵连同一回答中其他正确内容。忠实描述还可作为辅助上下文迁移到判别任务。

Abstract: Object hallucination remains a major challenge for large vision-language models. While off-policy preference optimization proves to be an effective solution, on-policy reinforcement learning provides a more promising direction as it directly targets a model’s current failure modes. However, we find that without fine-grained reward formulation and allocation, on-policy optimization often falls into an easy shortcut: reducing hallucinations merely by saying less—making fewer valid claims. To comprehensively resolve this, we propose a fine-grained alignment framework that couples dense reward signals at the data level with precise credit assignment at the algorithmic level. Specifically, we first construct the Dense Object Presence and Absence (DOPA) dataset to address sparse annotations that prevent valid object claims from being verified and rewarded. DOPA exhaustively annotates the deterministic presence and absence of every concept across an expanded vocabulary, significantly increasing the density of reliable reward signals during on-policy rollouts. Second, we propose Subsentence-level Credit Assignment for on-Policy Optimization (SCAPO) to prevent response-level shared advantages from allowing local hallucinations to compromise all other valid outputs within the same response. By assigning credit to each subsentence independently based on its object claims, SCAPO can precisely reinforce faithful generations and penalize hallucinations. Furthermore, we leverage the resulting faithful image descriptions as auxiliary context to transfer generative gains to discriminative tasks. Experiments demonstrate that our method produces highly informative, faithful descriptions in generative tasks while yielding clear performance gains on discriminative evaluation.

[268] Generative Uncertainty as a Self-supervised Signal for Semantic Similarity Learning cs.CVPDF

Enrico Pallotta, Sina Raoufi, Lars Doorenbos, Gianni Franchi, Juergen Gall

TL;DR: 本文利用视频生成模型对熟悉与专业概念生成稳定性不同这一现象，自监督筛选更适合语义相似度的预训练视频特征。

Details

Motivation: 视频语义相似度对分布外检测和检索等任务重要，但视频时空内容复杂，定义和标注相似度昂贵且困难。

Result: 在三类任务上，学得的特征子空间持续优于原始预训练特征和基线特征筛选方法；摘要未列明具体数据集或数值。

Insight: 文本到视频模型面对常见概念生成较稳定，面对专业概念则变异和不确定性较高。只用生成数据学习掩码，保留通用概念生成中稳定的VideoMAE、V-JEPA等特征，去除与生成噪声或不确定性相关的维度。

Abstract: Evaluating semantic similarity between videos is a fundamental challenge in computer vision, essential for tasks ranging from out-of-distribution (OOD) detection to video retrieval. However, defining and labeling video similarity is notoriously difficult and expensive due to the complex spatio-temporal nature. In this paper, we propose a novel self-supervised approach that leverages generative uncertainty from text-to-video (T2V) diffusion models to learn semantic similarity without human annotations. Our method is based on the observation that T2V models produce consistent outputs for familiar concepts but exhibit high variance and uncertainty when prompted with specialized concepts. We utilize this behavior to identify stable semantic features within existing pretrained representations, such as VideoMAE and V-JEPA. Specifically, we learn a mask over these embeddings using purely generated data, encouraging the model to retain features that remain consistent across generations of general concepts while discarding those associated with generative noise or uncertainty. Experimental results across three key tasks demonstrate that our learned feature subspaces consistently outperform original pretrained features and baseline feature selection methods.

[269] PIVOT: Pivot-Aware On Policy Self Distillation for Multi-Turn VLM Agents cs.CVPDF

Jiazhou Zhou, Hu Zhou, Yucheng Chen, Jinyuan Qu, Ying-Cong Chen

TL;DR: PIVOT以视觉轨迹诊断出首次不可恢复的枢轴失败步骤，并将状态回退和教师诊断监督内化到token级更新中，无需训练时真实回滚环境。

Details

Motivation: GRPO会在全组失败时无梯度，并且通常只提供episode级粗粒度信用。在线蒸馏虽可利用事后信息改善多轮智能体，但其效果机制未明，物理状态回退成本高且真实环境难以执行。

Result: 在五种多轮VLM智能体任务上，Qwen2.5-VL-3B总体准确率达0.90，比SFT+GRPO高8%、比前沿基线高5%；扩展到Qwen3-VL-2B达0.92，比SFT+GRPO高12%。

Insight: 反事实探针显示蒸馏收益主要来自枢轴步骤的状态回退。PIVOT用分析器从轨迹拼图和动作日志定位枢轴，分离教师在特权诊断上下文中重评分失败token，再联合GRPO和置信门控蒸馏训练学生；测试时移除教师和分析器。

Abstract: Reinforcement learning with verifiable rewards (RLVR) via Group-Relative Policy Optimization (GRPO) is widely used for multi-turn VLM agent training, yet it suffers from zero-gradient silence on uniform failures and coarse episode-level credit assignment. While On-Policy Distillation (OPD) and On-Policy Self-Distillation (OPSD) mitigate sparse rewards using hindsight information, their underlying mechanisms remain poorly understood. Through controlled counterfactual rollback probes across five multi-turn VLM agent benchmarks, we reveal that performance gains in OPSD/OPD are largely driven by physical state rollback at the pivot step, defined as the first unrecoverable action without remaining step budget. However, physical state rollbacks are computationally prohibitive and infeasible in real-world environments. To bridge this gap, we present Pivot-Aware Internalized Visual On-Policy Training (PIVOT), an RL framework that internalizes pivot localization and state restoration directly into token-level parameter updates, eliminating environment rollbacks during RL training and additional skill hints at test time. PIVOT unifies three functional roles within a single architecture: a failure Analyzer non-invasively localizes the pivot step and diagnoses failure modes from visual trajectory collages and action logs; a detached Teacher re-scores failed tokens under this privileged diagnostic context; and a Student optimizes joint GRPO and confidence-gated OPD objectives. At test time, both Teacher and Analyzer branches are stripped. Evaluated on five multi-turn VLM agent tasks across cognitive grid puzzles, 3D embodied control and navigation, and generative reasoning, PIVOT achieves 0.90 overall accuracy on Qwen2.5-VL-3B (+8% over SFT+GRPO baseline and +5% over previous SOTA) and scales to 0.92 on Qwen3-VL-2B (+12% over SFT+GRPO baseline).

[270] Ego-Forge: Text and Geometric-Attention Free Exo-to-Egocentric Video Generation cs.CVPDF

Mohammad Mahdi, Luc Van Gool, Danda Pani Paudel

TL;DR: Ego-Forge无需人工描述虚构的第一人称画面，也不用几何引导注意力，从第三人称视频和目标头部轨迹生成第一人称视频。

Details

Motivation: 跨视角生成需迁移外观语义并补全第三人称摄像机从未观测的内容。既有方法可能需要真实第一人称起始帧或多视角输入；EgoX虽支持跨活动，但依赖人工字幕和昂贵几何注意力，后者会传播几何误差并压制上下文。

Result: 在Ego-Exo4D上达到最先进表现且端到端更快，无需推理时额外标注，并能泛化到野外场景；摘要未报告具体指标。

Insight: 动态字幕直接从模型隐藏状态提取条件token，并随扩散时间步和网络深度变化，以取代人工编写不存在的第一人称字幕。扩大训练规模并利用全部第三人称视角，让模型隐式学习跨视角对应，仅需轻量深度先验。

Abstract: Exo-to-egocentric video generation aims to synthesize what a person sees from their own viewpoint given third-person footage and a target head trajectory. The task requires transferring appearance and semantics across large viewpoint changes while hallucinating content never observed by the exocentric camera. Existing approaches either impose additional input requirements, such as a ground-truth initial egocentric frame or multiple synchronized exocentric views, or remain limited to category-specific settings. EgoX is the first to address cross-activity and in-the-wild generalization, but requires a human-provided caption of the non-existent egocentric view at inference and introduces a computationally expensive geometry-guided attention bias that can propagate reconstruction errors and suppress textual and visual context. We therefore propose \textbf{Ego-Forge}, a caption-free and bias-free framework for exo-to-egocentric generation. It introduces \textit{Dynamic Captioning}, which derives conditioning tokens directly from the model’s hidden states and adapts them to the diffusion timestep and network depth, replacing external text conditioning. By scaling training by an order of magnitude and using all available exocentric viewpoints, Ego-Forge learns cross-view correspondence implicitly and eliminates the need for geometry-guided attention, requiring only a lightweight depth prior. Ego-Forge achieves state-of-the-art performance on Ego-Exo4D, runs faster end-to-end, requires no external annotation at inference, and generalizes to in-the-wild scenes, including cases where over-reliance on geometry blocks appearance inference. Our model and source code will be made publicly available.

[271] RoGSW4RLD: Feed-Forward 4D Gaussian Lifting for Robot World Model Rollouts cs.CV | cs.ROPDF

Jin Hyun Kim, Min Young Kim, Soohwan Song, Daekyum Kim

TL;DR: RoGSW4RLD将同步多相机机器人世界模型rollout直接提升为可按时空查询的统一度量4D高斯场。

Details

Motivation: 动作条件视频世界模型输出的是彼此分离的多相机视频，无法形成跨视角和时间共享的度量场景；逐相机重建再合并尤其难协调移动机械臂相机与固定外部相机。

Result: 在256个留出DROID episode上，相较校准合并的逐相机重建，新视角PSNR提高2.15 dB，深度AbsRel降低47%，机器人位移误差降低61%；在Cosmos 3动作条件rollout上也有明显收益。

Insight: 前馈两阶段流程先融合跨视角证据、机器人关节几何和运动学建立度量4D场，再细化几何与外观且严格保留初始时间位移。它重建既有世界模型产生的未来，不另训几何状态转移模型。

Abstract: Action-conditioned video world models predict future robot interactions from multiple cameras, yet their outputs remain disparate video collections rather than a shared metric scene queryable across viewpoints and time. While existing 4D reconstruction methods offer a path to spatialize these predictions, independently reconstructing and merging each camera stream fails to enforce cross-view consistency. This limitation is particularly detrimental when combining moving robot-mounted cameras with fixed external views. To address this, we introduce RoGSW4RLD, a feed-forward framework that lifts synchronized multi-camera rollouts into a unified, time-queryable metric 4D Gaussian field. Rather than learning a separate geometric transition model, RoGSW4RLD directly reconstructs the visual future generated by existing world models. Its core innovation is a two-stage architecture: Stage 1 jointly forms the metric 4D field by fusing cross-view evidence with robot-specific articulated geometry and kinematics, while Stage 2 refines the field’s geometry and appearance while strictly preserving the initial temporal displacements. Evaluated on 256 held-out DROID episodes, RoGSW4RLD significantly outperforms camera-wise reconstruction with calibrated merging, improving novel-view PSNR by 2.15 dB, reducing depth AbsRel by 47%, and lowering robot displacement error by 61%. These robust gains extend to action-conditioned Cosmos 3 rollouts, demonstrating that predicted video futures can be successfully translated into consistent, spatially queryable 4D metric representations.

[272] Rethinking Visual Token Compression for Video Large Language Models: A Simple Yet Strong Baseline cs.CVPDF

Xiao Zhang, Wang Zeng, Sheng Jin, Wentao Liu, Chen Qian

TL;DR: SimpleCluster用位置感知的跨帧特征聚类及均值代表压缩视频token，在极低保留率下仍较好保持原特征分布。

Details

Motivation: 视频LLM长视频输入产生大量视觉token，近期压缩方法越来越复杂。本文检验仅保留视觉表征的结构是否就能获得大部分压缩收益。

Result: 在四个视频理解基准和三种Video LLM上，SimpleCluster在多种保留率下达到与近期方法相当或更好的表现，尤其在仅保留1% token时稳健。更佳性能与更好保持全局特征覆盖一致相关。

Insight: 在视觉特征空间中进行位置感知的跨帧聚类，并以簇内原始特征均值表示，可提供无需训练的强基线。极低预算下除局部近似精度外，还必须关注被保留特征对整体表示分布的覆盖。

Abstract: Video Large Language Models (Video LLMs) have achieved remarkable progress in video understanding, but their inference efficiency is constrained by the large number of visual tokens produced by long videos. Recent video token compression methods increasingly introduce sophisticated strategies for token selection, pruning, and merging. This raises a fundamental question: how much of compression performance can be obtained by simply preserving the structure encoded in the visual representations? We investigate this question with SimpleCluster, a simple and training-free baseline that performs position-aware cross-frame clustering in the visual feature space and represents each cluster using the mean of its original visual features. Extensive experiments across four video understanding benchmarks and three representative Video LLMs show that SimpleCluster achieves competitive or superior performance over recent compression methods across a wide range of token retention ratios, with particularly strong robustness under extremely low retention rates (e.g., 1%). To understand this behavior, we analyze the feature space preserved by different compression methods in terms of local approximation fidelity and global coverage. The results show that stronger downstream performance is consistently associated with better preservation of the original visual feature distribution, especially its global coverage. These findings highlight feature-space preservation as an important consideration for video token compression under highly constrained token budgets. Our code is available at https://github.com/xiaozhang79/SimpleCluster.

[273] When Should the Count Change? Learning State Maintenance for Causal Video Counting cs.CVPDF

Pengyiang Liu, Dongyue Lyu, Junbo Niu, Zhongyue Shi, Jiahao Xie

TL;DR: StaMina让视频计数器显式维护可见性、持续身份和已完成事件状态，并在合法状态转移路径上训练事件更新。

Details

Motivation: 连续视频计数须区分新观察、新物体和已完成事件；静态计数或单帧分类不能保持跨帧身份及事件进度，易重复或漏计。

Result: 4B/8B模型在前缀回放模式达41.9/44.9，在持续流式模式达36.4/38.2 Gaussian Precision Accuracy；8B相较相同查询上的Counting-SFT分别提升10.9/3.2分。

Insight: 视觉循环上下文用于识别，学习转移显式维护可见性、身份和事件完成记录；可微递归在满足计数端点约束的合法路径上训练事件转移，对象分支另以可见性和关联目标训练。基准包含3.98万条空间查询和配套事件标注。

Abstract: Continuous video counting requires distinguishing new observations from new objects or completed events. We introduce StaMina (State Maintenance), which learns to maintain counting state through state-conditioned updates. Recurrent visual context supports recognition; learned transitions maintain visibility, persistent identities, and completed-event records. A differentiable recurrence trains event transitions over legal paths constrained by count endpoints; visibility and association objectives train the object branch. A multi-source pipeline organizes 39.8K spatial queries and complementary event annotations into counting trajectories. On SVCBench, we evaluate counting adaptation with partial video overlap and held-out groups of linked annotations. Under prefix replay (Full) and persistent streaming (Stream), 4B and 8B models reach 41.9/36.4 and 44.9/38.2 Gaussian Precision Accuracy, respectively. The 8B model gains 10.9/3.2 points over Counting-SFT on the same queries. Matched-graph comparisons isolate phase conditioning and trajectory supervision, assessing training objectives alongside hard decisions. Online video benchmarks and count-conditioned decisions assess online understanding and task eligibility. Project Page: https://PLACEHOLDER.github.io/StaMina/

[274] Automated Species Identification in Camera Trap Images for Wildlife Conservation cs.CVPDF

Nowshin Amin, Nafisa Tabassum Oyshi, Tahmid Abrar Zidan, Miftaun Noor, Md. Abrar Rahman Shafin

TL;DR: 本文提出基于Swin-BiFPN的野生动物相机陷阱检测器，并结合LLaVA语义提取模块改善低对比小动物识别与零样本描述。

Details

Motivation: 相机陷阱图像常有低对比度和体积很小的动物，现有检测模型特征提取不足；野生动物保护还需要动物行为描述等额外线索。

Result: 论文报告检测框架在困难陷阱图像上表现稳定并能泛化，语义模块提供零样本检测和行为线索；使用五种MLLM并结合传统文本指标与LLM评审评价描述，但摘要未给具体检测分数。

Insight: 将带自注意力的Swin-BiFPN特征骨干放入Faster R-CNN，并接入LLaVA v1.5 13B视觉语义提取，兼顾检测与描述。摘要未提供数据集规模及关键定量结果，因此不据此扩展性能结论。

Abstract: Wildlife conservation involves protecting, preserving, and managing wildlife species and their habitats. With today’s rapid pace of human development, climate change, and other unsustainable practices, the need for wildlife conservation has heightened. Despite significant progress in species identification using deep-learning models, significant challenges still remain in effectively detecting small animals in low-contrast trap images due to limited feature extraction capabilities. This thesis presents a novel end-to-end framework integrating a self-attention mechanism to address these limitations. The proposed architecture involves a Swin-BiFPN backbone integrated in a Faster RCNN detection network, coupled with a visual semantic extraction module driven by the LLaVA v1.5 (13B) multimodal large language model. The detection framework, capable of extracting crucial features in challenging trap images, demonstrates consistently high results and robust generalization capabilities. Furthermore, the visual semantic extraction module provides zero-shot detection capability, as well as providing valuable insights and emergent cues of the animal’s behavior, further supporting the conservation effort. The MLLM evaluation was conducted using both traditional NLP metrics (precision, recall, F1, and SBERT similarity) and subjective scoring by LLM-based judges (GPT-4.1 and GROK 3.0), across five MLLMs, demonstrating the model’s strong performance in visual description generation. The proposed framework improves detection accuracy across low-contrast trap images and small animals while also demonstrating zero-shot detection capability leveraging the MLLM.

[275] From internal representations to model improvement through prediction errors cs.CV | cs.LGPDF

Yushi Nakaya, Kenichi Higuchi, Shuichi Ishida

TL;DR: 本文把目标检测器自身内部特征与预测错误及其性能影响相联系，在不读取候选图像标签的情况下选择下一批应标注数据。

Details

Motivation: 标注预算有限时，待标注图像选择决定模型改进幅度。外部模型特征和VLM场景描述没有直接反映目标模型当前知识；单靠内部特征稀有度又不指出哪些错误值得优先修正。

Result: 两个数据集、两组随机种子共16种条件中，内部特征帮助识别预测错误的有15种。四种标注轮次评测里，该方法均超过仅按特征稀有度选样；延长再训练后在六种方法中排名第一。

Insight: 以目标模型当前内部表示估计候选图像可能产生的错误及其预期性能影响，再选择图像标注，可将模型当前状态用于指导主动学习。其表现说明错误价值比错误数量本身更重要。

Abstract: With limited annotation budgets, choosing which images to label determines how much a model improves. Data-selection methods that use features from a separately trained model, or scene descriptions written by vision-language models, have been successful, but those signals do not directly capture changes in the model being improved. The target model’s own internal features reflect what it has learned so far and change with retraining, making them a natural cue for choosing the next training data. However, feature rarity alone does not reveal the errors that matter for performance. Here we link internal features to prediction errors and their expected impact on performance and select images for labeling and retraining without using labels for candidate images. We evaluated the method with an object detector on two datasets and two pairs of random seeds. Adding internal features improved the identification of prediction errors in 15 of 16 conditions. When performance was averaged over successive labeling rounds, the method outperformed selection based only on feature rarity in all four evaluation settings and ranked among the top two of six methods. With other conditions held fixed, performance after retraining was again higher than with rarity-based selection, even though the latter collected more errors. With longer retraining, the proposed method ranked first among six methods. These results suggest that linking a model’s internal features to its errors and their effects on performance may help select training images that improve performance, thereby allowing the model’s current state to guide which images are labeled next.

[276] W2Rep: Learning Visual Representations by Watching the World Change cs.CVPDF

Wen Huang, Hang Guo, Jiarui Yang, Zheng Liu, Tao Dai

TL;DR: W2Rep用独立编码的图像参与同帧或跨帧掩码特征预测，让视频变化监督既能用于单图表征，也保留视频时序能力。

Details

Motivation: 图像自监督学习单时刻空间结构，视频方法通常在联合编码多帧时学习时间关系。本文研究观看场景变化能否改善仅由单图得到的表征，同时不牺牲视频表达。

Result: 在多种模型规模和下游任务上，W2Rep依作者比较协议改善冻结及微调识别；联合视频编码还优于逐帧聚合。收益依赖直接更新源图特征，并同时使用视频上下文和时间位移。

Insight: 预测器以可见视频上下文、查询位置和带符号时间间隔为条件，预测独立编码源图在同一或另一时刻的特征。图像路径学习跨时间稳定表征，视频路径则需补充源图中缺失的证据。

Abstract: Images capture the world at one moment, whereas video reveals how it changes. Image self-supervision learns spatial structure from a single moment, while video methods commonly learn temporal relationships inside a representation computed jointly from several frames. We ask whether watching a scene change can instead improve features available from one image without sacrificing the ability to represent video. We introduce W2Rep, a masked feature-prediction framework in which an independently encoded source image participates in prediction at the same or another moment. The predictor is conditioned on visible video context, the queried location, and the signed time interval between source and target. This gives the cross-frame objective two complementary roles: the image path learns features that remain useful across time, while the video path must gather evidence that is missing from the source image. Across model scales and downstream tasks, W2Rep improves frozen and fine-tuned recognition under our comparison protocol, while joint video encoding provides further gains over frame-wise aggregation. Controlled experiments show that these gains depend on directly updating the source-image features and on using both video context and temporal displacement. Overall, change across a video can supervise a visual encoder whose representations remain useful at either image or video granularity. Code is available at~\href{https://wenooi.github.io/W2Rep}{https://wenooi.github.io/W2Rep}.

[277] How Far Are We from Removing the Visual Encoder? Scaling Laws for Encoder-Free Multimodal Pretraining cs.CVPDF

Lin Chen, Bolin Ni, Qi Yang, Lan Jiang, Kun Ding

TL;DR: 本文系统比较有无预训练视觉编码器的多模态模型缩放规律，预测编码器自由架构在约10²² FLOPs时可追上多模态目标差距。

Details

Motivation: 现代MLLM多依赖预训练视觉编码器提供视觉先验；编码器自由架构直接从像素学视觉表征，结构统一，但其随计算规模变化的规律此前缺乏系统研究。

Result: 两类架构文本目标的损失—计算前沿几乎重合；多模态上编码器自由模型小规模较弱，但缩放律预测约10²² FLOPs可追平，处于可行预训练预算范围。去除编码器后视觉token双向交互收益随算力增长。

Insight: 视觉编码器先验的优势可能随规模增大而减弱；语言模型可以通过视觉专用适配逐步承担编码器功能，包括将视觉处理前移并集中视觉token专家路由。文本与多模态计算最优模型规模受影响不同。

Abstract: Most modern multimodal large language models (MLLMs) build on a pretrained visual encoder that provides a strong visual prior. Encoder-free MLLMs instead learn visual representations directly from raw pixels, offering a simple and unified architecture, but their scaling behavior has not been systematically characterized. To fill this gap, we compare scaling laws for encoder-free and encoder-based MLLMs and report three main findings: (1) Removing the visual encoder shifts the compute-optimal allocation for the multimodal objective toward larger models, while leaving that for text nearly unchanged. (2) The two architectures exhibit nearly overlapping loss–compute frontiers on the text objective, but diverge on the multimodal objective: encoder-free models underperform at small scales yet are predicted to catch up at around $10^{22}$ FLOPs, well within practical pretraining budgets. (3) Without a visual encoder, the language model learns to take over its role via vision-specific adaptation: bidirectional interactions among visual tokens become increasingly beneficial as training compute grows, visual processing shifts toward earlier layers, and expert routing for visual tokens becomes more concentrated. Overall, our results indicate that the advantage of the visual prior provided by a pretrained encoder diminishes with scale, positioning encoder-free architectures as a promising direction for multimodal pretraining.

[278] From Scores to Samples: Elastic Forcing for Autoregressive Video Generation cs.CV | cs.AIPDF

Chi Zhang, Yueyi Liu, Haoyang Shi, Ruichuan An, Haoyu Li

TL;DR: Elastic Forcing用冻结的视频自监督特征空间中的最大均值差异直接拟合参考视频轨迹分布，无需后训练中的双向扩散教师或伪分数模型。

Details

Motivation: 少步自回归视频生成常用分布匹配蒸馏，需要双向扩散教师和在线假分数模型，增加训练复杂度并限制扩展。

Result: 与Self-Forcing使用相同架构和初始化时，1.3B模型将VBench Total从83.80提高到84.64，同时维持17 FPS；去掉辅助分数模型后，还可在8张H200上对14B模型后训练。

Insight: 在冻结的视频自监督表征空间用MMD匹配真实参考视频分布，并以Nyström—蒙特卡洛混合估计平衡近似偏差与采样方差；回放和梯度子采样使训练可承受。真实视频训练还带来新风格、语义概念和空间先验。

Abstract: Few-step autoregressive video generation commonly relies on Distribution Matching Distillation (DMD), requiring a bidirectional diffusion teacher and an online fake-score model. We instead learn the rollout distribution directly from reference videos, eliminating both score models during post-training. Our framework minimizes maximum mean discrepancy (MMD) in frozen self-supervised video representation spaces, using a hybrid Nyström–Monte Carlo estimator to balance approximation bias and sampling variance. Memory-efficient replay and gradient subsampling make this objective practical. Using the same architecture and initialization as Self-Forcing, our 1.3B model improves the VBench Total score from 83.80 to 84.64 while retaining 17 FPS. Removing auxiliary score models also enables 14B post-training on eight H200 GPUs. Beyond distillation, learning from reference videos enables the acquisition of new visual styles, semantic concepts, and spatial priors without a target-specific diffusion teacher.

[279] AHMAD: Adaptive Hybrid Multi-task Vision Learning with Assisted Distillation for Keypoint Detection cs.CVPDF

Mohammad Mahdi, Nedyalko Prisadnikov, Yuqian Fu, Carmelo Scribano, Danda Pani Paudel

TL;DR: AHMAD以共享编码器—解码器和轻量任务投影头统一五类视觉任务，并通过知识蒸馏实现单次前向的全图关键点检测。

Details

Motivation: 通用多任务视觉模型要统一稠密和稀疏等不同输出结构，任务间差异使共享学习困难；自顶向下关键点检测还需多次前向，计算成本高。

Result: COCO-val全景分割PQ为53.1，语义分割mIoU为66.5，均达先进水平；关键点蒸馏使整图只需一次前向，提升效率。框架覆盖语义/实例分割、深度、关键点和目标检测五项任务。

Insight: 采用共享主干处理共性视觉表征，通过轻量任务投影器处理各任务输出差异；对原先多裁剪或多次前向的关键点检测，将知识压缩进单次全图推理模型。

Abstract: Generalist multitasking vision models aim to unify multiple vision tasks within a single framework, enabling more efficient and versatile learning. However, handling diverse vision tasks – spanning dense and sparse predictions – remains challenging due to their inherently varying output structures. In this paper, we propose AHMAD, a simple yet effective framework for generalist multitask learning that integrates different key vision tasks: semantic segmentation, instance segmentation, depth estimation, keypoint detection, and object detection. Our approach incorporates these five tasks into a unified structure: a shared encoder-decoder with several lightweight task-specific projectors. Under the multitask learning paradigm, we observed a complementary performance gain, achieving a state-of-the-art PQ of 53.1 and an mIoU of 66.5 for COCO-val panoptic and semantic segmentation, respectively. Additionally, for top-down keypoint detection, which typically incurs high computational overhead due to multiple forward passes, we introduce a knowledge distillation-based method that enables a single forward pass over the entire image, greatly improving efficiency. Ultimately, our model delivers a lightweight yet effective generalist multitask learning framework, demonstrating strong performance across five vision tasks.

[280] Sprout: Building Dynamic Memory While Reasoning for Agentic Video Understanding cs.CVPDF

Wei Chen, Xuanyu Zheng, Yancheng Long, Haoyang Xu, Kaiyu Jiang

TL;DR: Sprout在回答问题的过程中按需构建并更新长视频时间树记忆，使视频输入逐段转成可复用文本记忆。

Details

Motivation: 传统“先建全视频记忆再推理”在问题少时会预先处理大量无关内容，问题多时静态记忆又无法吸收前一问题中学到的信息。

Result: 在三个模型的多个基准上，Sprout相较代表性离线记忆方法取得相当或更好的准确率，无需前置建库且每个问题上下文成本更低；用文本记忆替代累积视频token后保持准确率，部分设置略有提升。

Insight: 代理先低帧率逐段查看，问题可回答时停止，并将已看片段记成粗节点；再对关键区间高帧率回看细化。文本片段记录后可从上下文移除其视频输入，但原视频仍可通过工具访问；记忆树和问答历史跨问题持续更新。

Abstract: Long video understanding relies on video memory to overcome the context limits of multimodal large language models. Existing methods follow a build-then-reasoning pipeline: memory is built offline for the entire video, then reasoned over as a static source. In practice a long video is shared by several questions, and this pipeline is costly at both ends: with few questions, building memory for the whole video costs far more than answering them; with many questions, the memory is never updated, so what is learned while answering questions is lost to the next question. To alleviate these, we introduce Sprout, an agentic framework that builds memory while reasoning: a temporal tree that sprouts detailed nodes as questions are answered. The agent watches the video segment by segment at a low frame rate, stopping when the current question can be answered, remembers each segment as a coarse node of the tree, and revisits key intervals at a higher frame rate to refine the tree with the recovered details. Once a segment is recorded as text, its video input is removed from the context history, while the original video remains reachable through the video tools. The memory tree and prior question–answer records persist across questions, so the memory is online and dynamic: built from the first question onward and updated by every question thereafter. We find that replacing accumulated video inputs with textual memory substantially reduces context usage while maintaining accuracy, with slight improvements in some settings. Across benchmarks on three models, Sprout achieves competitive or improved accuracy relative to representative offline memory methods, with no upfront construction stage and lower context cost per question.

[281] SolveEdit: Benchmarking Visual Problem Solving in Generative Models cs.CV | cs.AIPDF

Wenjie Shu, Yexin Liu, Harold Haodong Chen, Xuerui Qiu, Zehan Wang

TL;DR: SolveEpIT评测生成模型根据图像和目标推断并执行场景变换、同时避免改变无关内容的视觉问题求解能力。

Details

Motivation: 现实问题常需整理物体、修复布局或规划路径，要求模型理解场景、推断目标变换并保留其他内容；既有基准多分别测感知、生成或明确编辑指令，忽略目标驱动的视觉求解。

Result: 基准含2,728个案例并以原子状态转移契约评估完成与意外变化。最强模型仅得57.0分；两阶段规划器在三个生成器上平均提高9.1分，GPT-Image-2由57.0升至71.6。

Insight: 先将目标实例化为状态转移，再交给生成器执行，可改善结果而无需修改图像编辑器；契约同时规定必须达成和必须保护的条件，避免只按单一参考图判断多种有效解。

Abstract: Machine intelligence is often evaluated through abstract reasoning problems, yet many real-world problems are visual, such as arranging objects, repairing layouts, or tracing routes. Solving these problems requires understanding a scene, inferring what must change to achieve a goal, and realizing that change without disturbing unrelated content. However, existing benchmarks mainly evaluate perception, generation, or explicitly specified transformations, leaving goal-driven visual problem solving underexplored. To bridge this gap, we introduce SolveEpIT, a benchmark for visual problem solving through scene transformation. Given an image and a goal, a model must infer a valid transformation from the request, the scene, or a visually expressed rule, then execute it while preserving unrelated content. SoLvEEDrr contains 2,728 cases. Atomic transition contracts specify required and protected conditions, enabling SoLvEScoRE to measure completion and unintended changes without a single reference output. The strongest evaluated model achieves only57.0% SolvEScore. We further introduce SolveEdiT-PLAN, a two-stage visual planner that instantiates the transition before generation. Under matched single-generation evaluation, it improves SoLvEScoRE by 9.1 points on average across three tested generators, including a gain from 57.0% to 71.6% for GPT-Image-2, without modifying the editor.

[282] ReVA: A Scene-Centric Dataset Beyond Repetition for Remote Sensing Video Question Answering cs.CVPDF

Zhen Yao, Likai Wang, Yuming Yang, Zhihao Zheng, Bo Lang

TL;DR: ReVA构建无人机遥感视频问答基准，用多样场景中心问题评估MLLM的时空理解与视频推理。

Details

Motivation: 遥感多模态推理基准常依赖模板化问题而重复度高，也多使用静态图像，无法覆盖无人机视频的时间动态，因此系统性视频推理评测不足。

Result: ReVA含18个全球城市的2,438段无人机视频、58万帧、11类任务中的2.2万组高质量问答；对23种商业和开源Video LLM的评估暴露出当前模型的根本性局限。

Insight: 结合文本模型与多模态模型生成问题答案，再由人工核验，建立场景中心、时空和推理导向的数据；规模化视频和多任务覆盖为真实部署导向的遥感视频理解提供评测基础。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable advances in remote sensing. However, existing remote sensing multimodal reasoning benchmarks exhibit two critical limitations: they rely on (i) template-driven questions, which causes repetitive questions; and (ii) static images that fail to capture the inherent temporal nature of drone/UAV videos. This leaves systematic evaluation of remote sensing video reasoning largely unexplored. To address this gap, we introduce ReVA, a new dataset for remote sensing video question answering, designed to assess spatiotemporal, scene-centric, and reasoning-oriented capabilities of MLLMs. ReVA comprises 2,438 drone videos spanning 18 cities worldwide (580K frames) and 22K high-quality question-answer pairs across 11 challenging QA tasks. We develop a semi-automatic annotation pipeline that leverages Text LLMs and MLLMs for question-answer generation with human verification. We evaluate 23 proprietary and open-source Video LLMs on ReVA, exposing fundamental limitations of current models. These findings position ReVA as a critical benchmark toward better remote sensing video understanding and temporal reasoning capabilities for real-world deployments. Our code and dataset are available at: https://github.com/zyaocoder/ReVA

[283] AutoRef: Harness Optimization for Agentic Multi-Reference Image Generation cs.CV | cs.AIPDF

Yuta Oshima, Ku Onoda, Yusuke Iwasawa, Masahiro Suzuki, Yutaka Matsuo

TL;DR: AutoRef让编码智能体在模型权重冻结时自动改写多参考图像生成的执行框架，并以分离的提议任务和候选选择任务开展搜索。

Details

Motivation: 多参考生成需同时保留各参考对象、避免遗漏重复及拼贴感，并满足整体自然度等多重标准；决定如何处理参考、诊断结果和选择最终图像的框架难以手工设计且效果差异大。

Result: 发现的AutoRef-Harness将开源FLUX.2 Klein 4B在MultiBanana留出四参考任务上的得分从5.72提升至7.37，匹配或超过Nano Banana Pro和GPT-Image-1.5等专有模型；更换生成器、参考数、基准、评估器或推理模型后仍可提升。

Insight: 编码智能体迭代改写程序化生成框架，提议任务和最终候选筛选任务分开，降低搜索过拟合；保留筛选表现靠前的框架继续束搜索，使优化对象聚焦于如何编排冻结模型而非微调模型。

Abstract: Recent image generation models can take multiple reference images as input and combine them into a new image. However, multi-reference image generation remains challenging: models may omit or duplicate subjects from the references, or produce images in which multiple subjects appear unnaturally pasted. Recent work has proposed image generation agents that combine image generation models, reasoning models, and a harness, which is an executable program that specifies how reference images are interpreted, how generation is performed, how outputs are diagnosed, and how the final image is selected. In multi-reference generation, however, references play different roles and outputs must satisfy many criteria at once, such as fidelity to each reference and the naturalness of the whole image, so many parts of the harness could be improved, from how references are processed to how outputs are diagnosed. This makes it hard to predict which changes will improve performance and by how much, and good harnesses difficult to design by hand; indeed, human-written harnesses vary widely in performance. We therefore propose AutoRef, which optimizes the harness automatically while keeping both models frozen: a coding agent iteratively rewrites the harness code. AutoRef separates the tasks whose feedback informs proposals from the tasks used to select candidates, and continues the search from a beam of the top-ranked harnesses on the selection tasks. Using this procedure, we discover AutoRef-Harness, which improves the open-weight FLUX.2 [klein] 4B from 5.72 to 7.37 on held-out four-reference tasks of the MultiBanana benchmark, matching or exceeding proprietary models including Nano Banana Pro and GPT-Image-1.5. Without re-optimization, the same harness also improves results when the generator, number of references, benchmark, evaluator, or reasoning model differs from those used in the search.

[284] Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection cs.CVPDF

Chia-Ling Chen, Yu-Ting Ta, Jian-Yu Jiang-Lin, Tai-Ming Huang, Ling Lo

TL;DR: Look Before You Judge通过原图与高斯模糊图间的视觉注意力差异挖掘伪造证据区域，再逐区检查并结合全图上下文判定。

Details

Motivation: MLLM可以用自然语言解释深伪判决，但解释可能来自语言先验而非图像证据。全图注意力干预无法很好定位微弱、局部且随图像变化的法证线索。

Result: 在TriDF和MMTD-Set上的五种开源MLLM评估中，方法最高提升检测准确率12.8%，最高降低CHAIR 33.4%、幻觉率21.3%，超过代表性免训练解码和注意力基线。

Insight: 将检测拆成逐步证据获取：先比较原图和模糊图的解码器—视觉注意力以定位图像特有候选区域，再单独检查各区域并与整体画面融合后做判断。无需篡改掩码、外部法证模型或参数更新。

Abstract: Multimodal large language models (MLLMs) can explain deepfake verdicts in natural language, but such explanations are not necessarily visually grounded in the visual evidence underlying the prediction. A model may describe plausible artifacts inferred from language priors rather than from image evidence. Existing grounding methods improve visual reliance through decoding or attention interventions, but they generally strengthen grounding over the entire image, making them ill-suited for forensic artifacts that are subtle, spatially localized, and image-dependent. We propose Look Before You Judge, a training-free framework that formulates explainable deepfake detection as a sequential evidence acquisition process. Instead of directly predicting image authenticity from holistic visual reasoning, our framework first identifies image-specific candidate evidence regions by contrasting the MLLM’s decoder-to-visual attention between an original image and its Gaussian-blurred counterpart. The identified regions are then inspected individually, and the resulting local evidence is integrated with the global image context before reaching a final verdict. The framework operates without manipulation masks, external forensic models, or parameter updates, making it directly applicable to off-the-shelf MLLMs. Across five open-source MLLMs on TriDF and MMTD-Set, our framework improves detection accuracy by up to 12.8%, reduces CHAIR by up to 33.4% and hallucination rate by up to 21.3%, and outperforms representative training-free decoding and attention methods.

[285] Learning to Reason with Persistent Object States for Video Instance Segmentation cs.CVPDF

Yongxue Xu, Boxue Yang, Ziqian Liu, Shaoqiu Zhang, Rui Qian

TL;DR: POSReasoner为视频分割的每个对象维护持久身份、置信度和缺席历史，并通过提出—验证流程决定观察是否足以更新状态。

Details

Motivation: 长期遮挡、重新出现和相似对象互动时，一次不可靠关联可能覆盖正确历史，引发持续身份漂移；普通逐帧更新缺少显式的状态写入审核。

Result: 在长期视频目标分割和视频实例分割基准上，POSReasoner持续提升强基线，遮挡和目标重现时增益最大；摘要未提供具体数字。

Insight: 稀疏状态—观察图先提出候选关联，再结合目标历史、预测存在性和身份间竞争复核；经验证的决定才会保留、更新、重激活或抑制状态，且学习门控控制写入记忆。骨干保持冻结，可插入多种VOS/VIS架构。

Abstract: Video segmentation models maintain object identities by carrying instance information across frames. Under prolonged occlusion, reappearance, or interactions between similar instances, however, an unreliable update can overwrite a valid history and cause persistent identity drift. We introduce POSReasoner, a trainable, plug-and-play framework that explicitly decides when an observation should change an object’s state. Each persistent state records identity, confidence, and absence history. A sparse state-observation graph supports Propose-Verify reasoning: provisional associations are revisited using object history, predicted presence, and competition among identities. The verified decisions determine whether to retain, update, reactivate, or suppress each state, while a learned gate controls the evidence written back to memory. Only verified transitions update the persistent state used in subsequent frames. POSReasoner uses standard video annotations and keeps the base model frozen, enabling integration with diverse VOS and VIS architectures. Experiments across long-term VOS and VIS benchmarks show consistent improvements over strong baselines, with the largest gains under occlusion and object reappearance.

[286] Revisiting Risky Tackle Detection with Vision Transformers cs.CVPDF

Syed Ahsan Masud Zaidi, Lior Shamir, Scott Dietrich

TL;DR: 本文复现并追溯ViViT在美式橄榄球训练视频中识别危险擒抱的已发表结果，并分析不同数据增强因素的影响。

Details

Motivation: 可复现实验需要把论文报告数字对应到公开制品中的脚本、交叉验证结果和聚合过程；原任务数据含可识别学生运动员，无法公开分发。

Result: 复现的run_15五折危险类召回率为0.667、F1为0.588，与原报告0.67和0.59四舍五入一致。亮度降低是主要增强因素；无增强时召回率0.545，低于C3D基线0.583。

Insight: 逐项追踪增强配置和折间输出能确认头条指标来源，并通过主效应范围0.055显示亮度变化比旋转、翻转和噪声更影响危险类召回。论文提供可公开样例用于流水线检查，以及受控的全量数据审查路径。

Abstract: This paper is a Track 2 reproducibility companion to an ICPR 2026 study on risky tackle detection in American football prac- tice videos. The original work fine-tuned a Video Vision Transformer (ViViT) on 733 clips labeled with the SATT-3 rubric. It used focal loss, Taguchi L18 augmentation, and 5-fold cross-validation. It reported risky- class recall of 0.67 and risky-class F1 of 0.59. This companion documents the released artifact and traces those numbers to specific scripts, fold out- puts, and aggregation files. The reproduced headline is run_15. It com- bines Gaussian noise with static brightness decrease and uses no rotation and no flip. Its fold-mean risky recall is 0.667 and its fold-mean risky F1 is 0.588. These values match the published headline after rounding. The ablation shows that brightness is the dominant factor. Its risky-recall main-effect range is 0.055, which is larger than the ranges for rotation, flip, and noise. Without augmentation, ViViT reaches risky recall of 0.545 and does not exceed the C3D baseline of 0.583. The raw clips show iden- tifiable student athletes, so they cannot be redistributed. The artifact provides a public sample for pipeline checks and a controlled route for full-data review.

[287] Less Is More: Genetic Frame Selection for Efficient Novel View Synthesis cs.CVPDF

Diego E. Farchione, Ramzi Idoughi, Alberto Jaspe-Villanueva, Peter Wonka

TL;DR: 遗传帧选择器从已采集序列挑选固定数量的高价值视图，以目标覆盖、视图冗余和清晰度为依据，而无需推理时渲染或逐场景优化。

Details

Motivation: 前馈新视角合成并非输入越多越好；冗余或低质量视图会增加计算、甚至降低重建质量，需要针对指定目标视角选择信息量最大的子集。

Result: 在六个数据集和多种输入预算下，方法持续超过几何及重建感知视图选择基线，选择成本显著低于重建式方法；精心选取的子集有时优于完整输入序列，并可迁移到前馈、3D高斯和NeRF方法。

Insight: 训练时用直接按训练场景重建表现搜索子集的遗传算法作为昂贵教师，再蒸馏到只用几何和图像特征的轻量评分器。推理时综合目标覆盖、与已选视图的冗余及清晰度，无需执行重建。

Abstract: Feed-forward novel view synthesis reconstructs a scene from many input images in a single forward pass, yet more views do not necessarily improve performance: redundant or poorly chosen frames increase computational cost and may degrade reconstruction quality. We address the problem of selecting, from an already captured sequence, a fixed-size subset of input views that is most informative for reconstructing specified target viewpoints. We propose a render-free view selector that scores candidate frames based on three complementary criteria: target-view coverage, measured against observed frames that stand in for the targets, redundancy with previously selected views, and image sharpness. A lightweight scoring network then selects the most informative frames without rendering, reconstruction, or per-scene optimization at inference time. To train the selector, we distill an expensive offline search procedure in which a genetic algorithm identifies high-quality subsets by directly optimizing reconstruction performance on training scenes. The selector learns to reproduce these choices from geometric and image-level features alone. Across six datasets and multiple input budgets, our method consistently outperforms both geometric and reconstruction-aware view-selection baselines while incurring significantly lower selection costs than reconstruction-based alternatives. Moreover, carefully selected subsets can outperform feed-forward reconstruction from the full input sequence. The learned selector generalizes across diverse reconstruction paradigms (feed-forward, 3D Gaussian Splatting, and NeRF), to object-targeted reconstruction and to a cross-capture setting in which the target views come from a separate acquisition pass. More broadly, our results indicate that explicitly reasoning about target relevance and inter-view redundancy is a fundamental factor in efficient scene reconstruction.

[288] ReSS: Residual-Restoring Sparse Attention for 3D Vision Transformers cs.CVPDF

Yongsung Kim, Jaehoon Lee, Minjun Park, Wooseok Song, Hun Hwangbo

TL;DR: ReSS按稀疏化对残差流造成的实际漂移而非保留注意力质量选取注意力块，并迭代修复整体删除集合的偏移。

Details

Motivation: 3D视觉Transformer需对拼接后的多视角token做全局注意力，视图增加时成本迅速上升。既有按高注意力概率保块的方法无法准确预测删除会使模型行为变化多少，稀疏度提高时性能易崩溃。

Result: 三个骨干、五个数据集上，匹配稀疏度时ReSS比此前方法更好保持稠密性能；以实际漂移作横轴，各方法性能大致落在同一曲线上，最大化漂移比随机删除更快损害表现。

Insight: 提出残差漂移分数衡量每块对残差流的影响。删除集总体漂移不仅由贡献大小决定，还依赖方向相互作用，因此通过迭代残差恢复共同优化整组删除块，而非仅逐块排名注意力概率。

Abstract: 3D vision transformers such as VGGT predict camera poses and scene geometry from multi-view images in a single forward pass, but their global attention over all concatenated view tokens dominates computation as the number of views grows. To reduce this cost, SparseVGGT and HeSS sparsify attention at the block level, and both retain blocks with high attention probability. However, we observe that attention probability poorly predicts how much the model’s behavior actually changes when a block is removed, and we show that this mismatch is why performance collapses as sparsity increases. In this paper, we propose ReSS (ReSidual-ReStoring Sparse Attention), which recasts block selection from a problem of maximizing the retained attention mass to one of minimizing the drift that sparsification leaves in the residual stream. We introduce a drift score that quantifies how much each block shifts the residual, and, since the drift of a drop set depends on the directions of the contribution vectors rather than on their magnitudes alone, an iterative residual restoration procedure that refines the drop set as a whole. Across three backbones and five datasets, ReSS preserves dense performance better than prior methods at matched sparsity. Two further results support drift as the quantity that governs the cost of sparsification: maximizing drift degrades performance faster than random selection, and plotted against realized drift instead of sparsity, all methods fall approximately onto a single curve. Code is available at https://github.com/libary753/ReSS.

[289] On-Policy Self-Distillation for Multi-Turn Image Editing cs.CV | cs.LGPDF

Liangbing Zhao, Le Zhuo, Mohamed Elhoseiny

TL;DR: MT-OPSD让图像编辑模型在自身迭代生成的条件图像上训练，由使用干净源图的教师提供蒸馏监督，以改善多轮编辑鲁棒性。

Details

Motivation: 实际图像编辑往往连续应用多条指令，但模型在递归编辑中迅速退化，因为训练使用干净源图，而推理需把自身不完美输出作为下一轮输入，存在条件分布偏移。

Result: 在三种编辑骨干上的实验显示，MT-OPSD明显提高长程编辑成功率、减轻多轮崩溃，并基本保持单轮编辑质量；另构建了100组、每组10轮的LME-Bench评测。

Insight: 不需要多轮人工标注：学生在自生成条件状态上运行，干净条件教师提供编辑监督，使训练分布接近推理时逐轮累积输出的状态。

Abstract: Instruction-based image editing has achieved strong performance in single-turn settings, yet practical editing is often iterative, with each instruction applied to the output of the previous turn. We find that existing editing models degrade rapidly under recursive editing and attribute this failure to a train-test mismatch in the conditioning distribution: models are trained on clean source images but must repeatedly condition on their own imperfect outputs at inference time. To address this, we propose MT-OPSD, an on-policy self-distillation framework that trains the model on self-generated conditioning states with editing supervision from a clean-conditioned teacher, without requiring multi-turn annotations. We further introduce LME-Bench, a benchmark of 100 ten-turn editing sessions for evaluating long-horizon robustness. Experiments across three editing backbones show that MT-OPSD substantially improves long-horizon editing success and reduces multi-turn collapse while largely preserving single-turn editing quality.

[290] Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Rendering cs.CVPDF

Jiaming Kang, Zhengxia Zou, Zhenwei Shi

TL;DR: DIBR-GS借助深度图像渲染合成伪视图，为仅有少量观测的遥感3D高斯重建补充跨视角几何和外观监督。

Details

Motivation: 稀疏观测下遥感新视角合成几何约束和跨视角监督不足，NeRF及3DGS容易过拟合，并在深度含糊、视图信息缺失和弱观测区域出现不完整重建。

Result: 仅用三张输入视图时，DIBR-GS相较此前最佳方法PSNR提高6.83 dB，SSIM相对提高14%，LPIPS相对改善60%，并保持有竞争力的计算效率。

Insight: 将单目深度先验与稀疏SfM对齐作几何初始化，再将跨视角外观先验并入高斯表示；渐进式DIBR伪视图提供额外几何和外观约束，高度受限的锚点增长则抑制不合理高斯扩张。

Abstract: Remote sensing novel view synthesis under sparse observations remains challenging due to insufficient geometric constraints and limited cross-view supervision. Existing Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) methods are prone to overfitting and face challenges of depth ambiguities, missing cross-view information, and insufficient constraints in under-observed regions. To address these challenges, we propose DIBR-GS, a neural Gaussian Splatting framework that exploits Depth Image-Based Rendering (DIBR) to generate pseudo views for cross-view consistency supervision. Specifically, reliable geometric initialization is constructed by aligning monocular depth priors with sparse SfM reconstruction, and cross-view appearance priors are incorporated into neural Gaussian representations to enhance appearance modeling under sparse observations. Furthermore, we introduce a progressive DIBR-based pseudo-view supervision strategy to provide additional geometric and appearance constraints, enabling more complete reconstruction of weakly observed regions. In addition, a height-constrained anchor growth strategy is designed to suppress unreasonable Gaussian expansion. Experiments demonstrate that the proposed method achieves superior performance over existing approaches when training with only 3 input views. Compared with the previous best-performing method, it improves PSNR by 6.83 dB, with relative gains of 14% in SSIM and 60% in LPIPS, while maintaining competitive computational efficiency. Our code is available at https://github.com/kanehub/DIBR-GS

[291] EvolvingAvatar: Interactive 3D Head Generation That Adapts as Conversations Unfold cs.CVPDF

Junjie Chen, Fei Wang, Kun Li, Yiqi Nie, Xun Yang

TL;DR: EvolvingAvatar利用对话中的视听上下文进行测试时自适应，使3D头像的说话和倾听动作随互动逐步贴合用户。

Details

Motivation: 互动头像需要协调说话、倾听动作并适应不断变化的对话，但现有生成器虽把输入观察作为条件，参数固定，未把对话模式作为学习信号。

Result: 在最困难的分布外划分上，随对话展开，生成头像表情统计与录制用户的差异最高降低11.1%；整体对话动作统计优于强基线。建立了455.95小时、含单视角与双视角视频的InterHead-Bench。

Insight: 视听上下文预测在测试时提供无需目标动作标签的自监督信号；持久快速权重在一段对话中累计更新，瞬态下颌适配响应当前上下文，语音活动预测则控制持久适配对动作生成的影响。

Abstract: Interactive 3D head generation requires coordinated speaking and listening motion that responds to an evolving conversation. Existing generators use incoming observations as context but keep their parameters fixed, leaving conversational patterns unused as a learning signal. We introduce EvolvingAvatar, a causal generator that uses test-time training to adapt to user face video and dyadic audio during interaction. Its dyadic context prediction objective provides a self-supervised learning signal from audiovisual context without target motion labels at test time. Persistent fast weights accumulate these updates within each conversation to guide motion generation, while transient jaw adaptation responds to current audiovisual context. Predicted speech activity controls how persistent adaptation guides motion. We also introduce InterHead-Bench, a unified 455.95-hour benchmark built from single-view and dual-view conversation videos. Experiments show improved conversational motion statistics over strong baselines. On the hardest out-of-distribution split, generation improves as conversations unfold, reducing mismatch with recorded user-avatar expression statistics by up to 11.1% from the first interval.

[292] FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matching cs.CVPDF

Thanh-Long V. Le, Steven Walton, Seunghyun Yoon, Branislav Kveton, Trung Bui

TL;DR: FlowTool把图像修饰中的工具参数生成建模为条件流匹配，直接从输入图像和编辑指令生成连续编辑计划。

Details

Motivation: 传统工具式编辑用自回归MLLM依次生成推理、工具选择和参数，响应较慢；连续参数组合也未必适合逐token生成。

Result: 在MMArt-Bench、FlowTool-Eval、ArtEdit-Bench和MIT-Adobe5K上，FlowTool的参考图条件表现显著优于专用编辑智能体，免参考评估也有竞争力；推理至少快50倍，内存约少一半。

Insight: 视觉语言骨干负责理解多模态输入，扩散Transformer参数生成器从高斯噪声生成编辑计划。两阶段监督流匹配课程之后再以奖励后训练，展示了无需自回归显式推理也可对结构化连续编辑参数进行条件生成。

Abstract: Tool-based image editing (image retouching) is commonly formulated with autoregressive multimodal large language models (MLLMs) that sequentially generate reasoning, tool selections, and parameter values. In this work, we present a novel approach to tool-based image editing by framing the task as a flow matching problem. We introduce FlowTool, a framework that directly models the distribution of high-quality tool parameters conditioned on the input image and user instruction using conditional rectified flow. FlowTool combines a vision-language model backbone for multimodal understanding with a Diffusion Transformer parameter generator that transforms Gaussian noise into an editing plan. We train FlowTool with a two-stage supervised flow-matching curriculum, followed by reward-based post-training. Across MMArt-Bench, FlowTool-Eval, ArtEdit-Bench, and MIT-Adobe5K, FlowTool achieves significantly stronger reference-based performance than specialized MLLM editing agents and proprietary MLLMs, while remaining competitive with proprietary models under reference-free evaluation. Moreover, FlowTool significantly improves inference efficiency, reducing latency by at least $50\times$ while requiring nearly $2\times$ less memory than the compared baselines. These results demonstrate that tool-based image editing can be effectively modeled as conditional generation over structured continuous editing parameters, without autoregressive reasoning.

[293] DynaTokens: Teaching Dynamics to Camera-Controlled Video Models at Test Time cs.CVPDF

Ziqi Ma, Hongqiao Chen, Georgia Gkioxari

TL;DR: DynaTokens用少量场景专属可学习token，在冻结的相机控制视频模型中快速注入物体动态能力。

Details

Motivation: 相机运动和场景内物体运动共同决定视频。现有模型较能处理静态场景中的相机运动，却常在动态场景中让物体静止、运动错误或画质下降。

Result: 在VBench2和WorldScore上，DynaTokens实现优于LoRA、模块微调和专用可训练层基线的动态—相机控制综合权衡；摘要未提供具体分数。

Insight: 相机运动影响整体画面，物体动态则局部发生，因此用交叉注意力通过少量token从场景轨迹示例学习局部动态，同时冻结基础模型，并将学到的动态应用到新的相机路径。可训练接口与目标结构匹配是有效适配的重要因素。

Abstract: Video generation must account for two sources of motion, one induced by the observer’s camera path and the other caused by scene dynamics. An ideal camera-controlled video model should account for both motions: let users move the camera while evolving the scene dynamics. While current models handle camera-induced motion well in static settings, they struggle for dynamic scenes: objects are static, move incorrectly, or degrade in generation quality. We introduce DynaTokens, a lightweight set of learnable scene-specific tokens that teach dynamics to an existing camera-controlled world model. Our method is motivated by a simple asymmetry between the two sources of motion: whereas camera motion affects the generated view globally, object dynamics are spatially localized. Through cross-attention, DynaTokens trains the learnable tokens from a few example trajectories for a scene while keeping the base model frozen, and enables dynamics under new query camera paths. DynaTokens achieves a better simultaneous dynamics-camera tradeoff on VBench2 and WorldScore evaluations than LoRA, block finetuning, and specialized trainable-layer baselines. Analyses of token attention, ablations, and motion temporality suggest that matching the trainable interface to the structure of the learning target is important for effective adaptation. Project website: https://glab-caltech.github.io/dynatokens/

[294] Mind the RefGAP: Correcting Reference Attention in Diffusion-Based Visual Editing cs.CVPDF

Yanan Wang, Shengcai Liao, Guangyi Liu, Xiaodan Liang

TL;DR: RefGAP在推理前向过程中测量参考注意力并动态调整注意力logit，使编辑区域更忠实参考图、保持区域更少受参考干扰。

Details

Motivation: 扩散编辑器对用户参考素材关注不足；例如LoomVideo编辑区域查询分给参考图的注意力质量不足1%，导致身份或内容复现不忠实。

Result: 在七种扩散图像/视频编辑器上，RefGAP改善头部和人脸替换的身份保真度；在保真—编辑权衡上可比单独调参的常数偏置，且无需为每种方法做强度搜索。虚拟试穿和背景替换实验检验了迁移。

Insight: 每层依据当前前向中测得的参考注意力在线决定logit偏移：对编辑区域查询增加参考logit，对保持区域查询施加负偏移抑制参考引起的变化。两个全局系数只在四个开发编辑器的验证集选择一次后固定。

Abstract: Reference-guided diffusion editors struggle to faithfully reproduce user-provided references. We identify a potential bottleneck in diffusion editors: many methods provide limited reference-attention allocation. For example, in LoomVideo, edit-region queries assign less than 1% of their attention mass to the reference. We introduce RefGAP, a training-free correction that determines logit-offset magnitudes online at each layer from the reference-attention mass measured during the forward pass. Positive offsets to reference logits strengthen reference usage by edit-region queries, while negative offsets for keep-region queries limit reference-induced changes outside the edit. Two global coefficients control the correction; they are selected once on validation data from four development diffusion editors and held fixed. Across seven diffusion-based image/video editors, RefGAP improves identity fidelity in head swapping and face swapping. RefGAP achieves a fidelity-preservation trade-off comparable to separately tuned constant edit-side biases, without per-approach strength sweeps. Additional experiments on virtual try-on and background replacement evaluate transfer beyond identity editing.

[295] Lagrangian–Hamiltonian Flows for Video Prediction and Image Generation: A Symplectic Perspective cs.CVPDF

Jiawei Hu

TL;DR: LHFM用辛几何视角把图像表示为精确拉格朗日图，并通过图像条件哈密顿流建模图像运动，用于视频预测和图像生成。

Details

Motivation: 常见生成模型直接拟合像素或流场，未充分利用经典力学的几何结构；作者希望用统一几何框架描述确定性视频演化并兼容图像流匹配生成。

Result: 循环视频模型LHFM-V在预测精度相近的对比模型中报告的FLOPs最低；图像模型LHFM-I在匹配实验中比流匹配基线获得更低FID。

Insight: 哈密顿流给出图像速度的输运—源项参数化，LHFM-V通过积分预测场逐帧推进；同一构造也可用于流匹配式图像生成。摘要未提供具体FLOPs和FID数值。

Abstract: We introduce LHFM, a geometric framework for learning image dynamics. Drawing on structures central to classical mechanics, symplectic geometry, and geometric quantization, LHFM represents each image as an exact Lagrangian graph and models its evolution through image-dependent Hamiltonian flows, which yield a transport–source parameterization of image velocities. Our primary application is deterministic video prediction: LHFM-V is a recurrent model that advances frames by integrating predicted transport and source fields, and achieves the lowest reported FLOP count among the compared recurrent models with similar prediction accuracy. The image variant, LHFM-I, shows that the same construction is compatible with flow matching: in a matched experiment, it attains a lower FID than the flow-matching baseline.

[296] Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision cs.CVPDF

Hanoona Rasheed, Mohammed Irfan Kurpath, Bin Ren, Hisham Cholakkal, Fahad Shahbaz Khan

TL;DR: 本文比较GPT-6 Astra等六种通用前沿系统在34种能力、55个基准和九个计算机视觉领域的表现，描绘通用模型能力与专用视觉任务间差距。

Details

Motivation: 通用系统正在进入传统计算机视觉专用模型覆盖的任务，研究者需要了解能力边界及仍然困难的感知类型，而不能只看少数图文问答基准。

Result: GPT-6 Astra在视觉和空间推理及多种结构化预测上较其他通用系统有明显进步。多个系统在语义理解、推理和对象中心预测上接近或达到可用参照水平，但在度量几何、忠实重建、时序一致的稠密预测和细粒度专门知识上仍有较大差距。

Insight: 额外推理和专用工具只在部分能力上缩小差距，效果依任务而变。通用接口已可覆盖越来越复杂的视觉任务，但对精确性和保真度敏感的感知仍是重要前沿。

Abstract: Frontier general-purpose systems are rapidly expanding beyond visual understanding into capabilities traditionally handled by dedicated computer-vision models. As these capabilities expand, a central question for the computer-vision community is how far this reach extends, and what remains hard. We evaluate GPT-6 Astra alongside five frontier general-purpose AI systems across 34 capabilities and 55 benchmarks spanning nine areas of computer vision. We compare their performance with dedicated models and humans where suitable references are available. Astra demonstrates broad visual capability, with substantial gains over other frontier systems in visual and spatial reasoning and several forms of structured prediction. Across the state-of-the-art systems, a consistent pattern emerges. Capabilities involving semantic interpretation, reasoning, and object-centric prediction increasingly approach or reach available reference levels. In contrast, larger gaps remain when tasks require metric geometric accuracy, faithful reconstruction, temporally consistent dense prediction, or specialized fine-grained visual knowledge. Additional reasoning and specialist tools close selected gaps, but their benefits vary across capabilities. These results map a changing landscape of computer vision in which increasingly sophisticated visual tasks are accessible through a general-purpose interface, while precise and fidelity-sensitive perception remains an important frontier.

Alessandro Rinaldi, Edoardo Tedesco, Andrea Ferraris, Filippo Leveni, Daniele Baieri

TL;DR: 该框架在超二次曲面点云拟合中加入法向一致性等局部几何先验，并通过图割细化内点，改善多几何基元分解。

Details

Motivation: 超二次曲面可用紧凑参数描述多类形状，但非线性估计对噪声、离群点和模型重叠敏感。RANSAC主要看空间邻近和拟合残差，复杂相邻基元间容易错误分配内点。

Result: 合成和真实数据实验显示，该方法相较先进RANSAC基线持续提升几何精度、噪声与离群点鲁棒性及收敛效率；摘要未报告具体数字。

Insight: 将内点细化写成能量最小化并用图割求解，把法向一致性等曲面信息纳入判别，减少仅凭点到模型残差造成的错误传播；同一方法适用于单基元估计和多模型分解。

Abstract: The decomposition of 3D point clouds into interpretable geometric primitives remains a longstanding challenge in Computer Vision and Computer Graphics. Among the available representations, superquadrics offer a compact and expressive model capable of capturing a wide range of shapes. However, their estimation is inherently challenging, as it requires solving a non-linear optimization problem and is particularly sensitive to noise, outliers, and overlapping structures. While robust estimation methods such as RANSAC and its variants achieve strong performance, they rely primarily on spatial proximity and residual-based criteria, often leading to incorrect inlier assignments across adjacent or complex arrangements of primitives. In this work, we introduce a geometric-aware framework for primitive decomposition that explicitly incorporates local surface properties into the fitting process. Specifically, we propose an inlier refinement step formulated as an energy minimization problem and solved via graph-cut optimization. Our formulation integrates geometric priors, such as normal consistency, enabling more reliable inlier selection beyond purely residual-based criteria. The approach naturally applies to both single-model estimation and multi-model decomposition. By leveraging geometric information beyond point-wise residuals, our method reduces erroneous inlier propagation and stabilizes parameter estimation. Experiments on synthetic and real datasets show consistent improvements in geometric accuracy, robustness to noise and outliers, and convergence efficiency compared to state-of-the-art RANSAC-based methods.

[298] Impact of Patient Orientation in Single- and Multi-View Camera Environments for AI-based Rehabilitation Monitoring cs.CVPDF

Miriama Jánošová, Andreas Lang, Petra Budikova, Jan Sedmidubsky

TL;DR: REHAB26-ViewAngles系统研究康复动作质量评估受摄像机角度影响的程度，并比较单视角2D/3D和多视角姿态方案。

Details

Motivation: 康复训练视频中的姿态估计受摄像机摆位影响，但对临床相关动作错误可分性的影响尚未充分研究，家庭与临床部署缺少角度选择依据。

Result: 数据集包含不同角度拍摄的正确及错误康复动作。最佳摆位的单台2D摄像机较常用正面0°视角提高16.9%可分性，且常优于单摄像机3D估计；组合两视角最多再提高13.1%准确率。

Insight: 评估方法分别考察单摄像机二维与三维估计，以及正交双视角、三角测量、加权3D融合和双摄像机专训Transformer，显示摄像机布局本身可显著影响动作质量可分性。

Abstract: Automated quality assessment of rehabilitation exercises relies heavily on accurate human pose estimation from video data. Although numerous RGB-based pose estimation methods have been proposed, the impact of camera placement on detecting clinically relevant movement errors remains insufficiently explored. To address this gap, we introduce REHAB26-ViewAngles, a dataset comprising correct and incorrect rehabilitation exercise executions captured from a wide range of camera angles. Furthermore, we propose a novel separability metric to quantify an algorithm’s ability to distinguish between valid and faulty exercise repetitions. Using these tools, we analyze how various RGB-based pose-estimation strategies are suitable for exercise quality assessment under varying camera placements. In particular, we analyze single-camera 2D and 3D pose estimation and four multi-camera strategies: a combination of two orthogonal 2D views, 3D triangulation, weighted 3D fusion, and an AI-based pose-estimation transformer model specifically trained from two synchronized cameras. Our findings reveal that an optimally placed 2D camera can improve the separability by 16.9,% over the commonly used $0^\circ$ frontal view and frequently outperforms single-camera 3D estimation, while combining two views can further improve accuracy by up to 13.1,%. These results offer practical guidance for deploying rehabilitation monitoring in both home and clinical settings.

[299] FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning cs.CVPDF

Ziyao Huang, Zhengkun Rong, Shiyang Qin, Shuang Liang, Wentao Hu

TL;DR: FlowAct-R2结合流式多模态参考视频生成和主动交互代理，实现可连续控制、实时响应并支持长时直播的类人视频生成。

Details

Motivation: 互动类人视频需要同步适应动作提示、流式音频及动态更新的图像、音频和视频参考，且直播代理还需预先规划并在线回应观众和中断。

Result: 系统支持实时720p生成和小时级流式应用，覆盖娱乐直播、直播购物、视频聊天和直播博客等场景；摘要未提供定量用户评测。

Insight: 流式参考扩散Transformer基于预训练模型，通过视频旋转位置编码对齐参考片段与生成时间，并结合参考图像条件及部分加噪历史动作维持外观、避免漂移。代理把上线前角色/长期议程/技能准备与在线调度、响应分开。

Abstract: We present FlowAct-R2, a framework for interactive humanoid video generation that combines continuous multimodal control with proactive agent planning. Our method consists of two coupled components. First, a Streaming Multimodal Reference Diffusion Transformer adapts the pretrained Seedance 2.0 Mini reference-to-video backbone to accept rolling action prompts, streaming audio, and dynamically updated image, audio, and video references. Video-driven rotary positional embeddings align reference chunks with the generation timeline, while reference-plus-image conditioning and partially noised historical motion frames preserve appearance and avoid accumulated drift. Second, a Proactive Interaction Agent separates pre-online planning from online scheduling and response: it prepares a persona, a long-horizon agenda, and reusable multimodal skills in advance, then autonomously schedules behaviors, responds to audience input, and handles interruptions during a live session. FlowAct-R2 supports real-time 720p generation and hour-scale streaming across entertainment streaming, live shopping, video chatting, and live vlogging.

[300] InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video cs.CVPDF

Kerui Ren, Kaiwen Song, Weiguang Zhao, Yuxi Wang, Yufei Liu

TL;DR: InfiniHand端到端流式估计第一人称视频中的手部姿态、摄像机轨迹和世界坐标位置，避免串联独立手姿模型与SLAM造成的误差积累。

Details

Motivation: 第一人称手部世界坐标运动估计需要同时恢复手部三维关节和摄像机自运动。级联手姿估计与SLAM会积累误差、流程复杂且计算开销大。

Result: 在域内基准上优于先进基线，相较ViDiHand将ARCTIC PA-p降低21.4%，显著减轻世界坐标漂移；支持野外视频泛化并达到11.19 FPS，吞吐超过HaWoR两倍。

Insight: 统一架构结合持久时空记忆和以手为中心的视觉特征，显式耦合相机运动与局部手部几何；分阶段先学习稳健相机坐标手部先验，再扩展到流式世界坐标重建，并利用约5,000小时第一人称数据预训练。

Abstract: World-space hand motion estimation from egocentric video requires recovering 3D articulated hand geometry while tracking camera egomotion. Existing approaches heavily rely on cascading independent hand pose estimators and SLAM systems, resulting in error accumulation, complex pipelines, and severe computational overhead. To address these limitations, we present InfiniHand, an end-to-end streaming feed-forward framework that jointly estimates MANO parameters, camera trajectories, and hand locations directly from uncalibrated egocentric video. InfiniHand integrates persistent spatiotemporal memory with hand-centered visual features, explicitly coupling camera motion with local hand geometry within a unified architecture. We train InfiniHand in two progressive stages by first learning robust camera-space hand priors and then extending to streaming world-space reconstruction. To support this process, we aggregate a pretraining corpus of approximately 5,000 hours of egocentric data across multiple public datasets. Extensive evaluations demonstrate that InfiniHand outperforms state-of-the-art baselines on in-domain benchmarks, achieving a 21.4% reduction in ARCTIC PA-p compared to ViDiHand while substantially mitigating world-space drift. Furthermore, InfiniHand generalizes robustly to in-the-wild videos and operates at 11.19 FPS, delivering more than twice the throughput of HaWoR.

[301] GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space cs.CVPDF

Kerui Ren, Tao Lu, Linning Xu, Changjian Jiang, Mu Huang

TL;DR: GeoVerse在预训练3D基础模型的几何潜空间中生成新视角，并注入视频模型学到的外观先验，同时用全局空间记忆维持跨视角一致。

Details

Motivation: 稀疏图像新视角合成须同时重建已观测区域、补全未观测内容并保持不同视角共享同一场景。几何方法补全不足，逐视角视频生成则会累积不一致。

Result: 相较GLD，GeoVerse在DL3DV上PSNR提高2.23 dB，在Mip-NeRF360上ATE降低32.4%；多数据集实验表明视觉质量和几何一致性均改善。

Insight: 将Wan2.2 VACE多层特征通过类似ControlNet的适配器注入几何潜扩散模型，补充视频外观先验；全局空间记忆持续聚合已观测和生成内容，并重投影目标视角对齐引导来锚定后续结果。

Abstract: Novel view synthesis from sparse images must reconcile faithful reconstruction of observed regions with plausible completion of unseen content, while maintaining world consistency across viewpoints. Existing geometry-based methods preserve observed scene structure but often struggle to complete unseen regions, whereas video generative models offer rich appearance priors but accumulate inconsistencies during sequential view generation. We propose GeoVerse, a framework that synthesizes world-consistent novel views by performing generation within the geometric latent space of a pretrained 3D foundation model and injecting appearance priors from a video generative model. Specifically, GeoVerse extracts multilevel features from Wan2.2 VACE and injects them into the geometric latent diffusion model via a ControlNet-style adapter, incorporating video-learned appearance priors to enhance structural completion. To enforce cross-view coherence, a global spatial memory continuously aggregates observed and synthesized content, reprojecting target-aligned guidance to anchor subsequent predictions to a shared scene representation. Extensive experiments across diverse datasets demonstrate improved visual quality and geometric consistency, with a 2.23 dB higher PSNR on DL3DV and 32.4% lower ATE on Mip-NeRF360 compared to GLD.

[302] Copy the Same, Distill the Difference: Initializing Linear Vision Transformers cs.CV | cs.AI | cs.LGPDF

Huaiyuan Qin, Muli Yang, Gabriel James Goenawan, Shiqi Huang, Min Kass Chong

TL;DR: 该研究发现Softmax ViT迁移到线性注意力ViT时应直接复制与注意力算子无关的MLP表征权重，而将算子相关的注意力路由行为通过蒸馏恢复。

Details

Motivation: 线性ViT以线性复杂度注意力替代Softmax注意力，效率更高却通常需从头预训练且表现较弱；如何有效初始化仍不清楚。

Result: 在多种线性ViT变体、模型规模和数据集上，复制MLP并蒸馏注意力可缩小差距，最终达到甚至超过Softmax模型；直接复制注意力权重几乎无益，有时还不如随机初始化。

Insight: 注意力路由行为依赖具体算子，不能直接迁移，但可用恰当损失蒸馏；MLP承载的已学表征较为算子无关，可直接复制并带来主要预训练收益。原则是复制保持不变的部分、蒸馏发生变化的部分。

Abstract: Linear Vision Transformers (ViTs) are designed to replace the attention in Softmax ViTs with the linear-complexity attention operator for more efficient token routing, but they require from-scratch pre-training and typically underperform the original Softmax version. How to initialize linear ViTs both efficiently and effectively still remains unclear. In this work, we explicitly ask: given that most foundation ViTs are built on the mainstream Softmax attention, can linear ViTs benefit from their pre-trained weights? Recent works on Attention Transfer show that attention is the effective transferable component between Softmax ViTs, suggesting attention alone suffices for such reuse. However, we find the opposite for Softmax-to-linear transfer. The attention weights are operator-specific: copying them barely helps, and is sometimes even worse than random initialization. Instead, the attention’s token routing behavior can be recovered through distillation with a proper loss design, letting linear ViTs reduce the gap and even match Softmax ones. In contrast, the MLP weights, which carry the learned representation, are operator-agnostic: they can be transferred by simple direct copying, which already carries most of the benefit of the pre-trained weights. Thus, copying MLPs can serve as an effective foundation for Softmax-to-linear transfer: paired with the distilled attention, linear ViTs eventually close the remaining gap and even surpass Softmax ones. These findings hold consistently across various linear ViT variants, different model sizes, and diverse datasets. We hope this study deepens the understanding of reusing pre-trained weights across attention operators: copy what stays the same and distill what differs, to recover the benefit across the Softmax-to-linear boundary.

[303] Reliability-Gated Fusion of Consumer Head and Foot IMUs for Lower-Body 3D Pose cs.CV | cs.HCPDF

Zhilin Guo, Boqiao Zhang, Oszkár Urbán, Josef Bengtson, Hakan Aktas

TL;DR: 该方法按流和通道学习可靠性门控，融合头部与脚部消费级IMU，在传感器偏差、漂移和掉线时动态降低不可靠输入权重。

Details

Motivation: 稀疏惯性捕捉无需摄像机，但消费设备固件融合方向可能有偏差，佩戴方式随时间变化且数据会漂移或丢失；简单增加传感器并不保证姿态更准。

Result: 35段单人基准上，通道门控融合干净数据误差69.4 mm，优于静态融合83.7 mm和无门控86.6 mm；各类模拟故障下均最准确，干净实测时还能自动压制有偏鞋垫方向通道，并以0.92至0.999 AUROC检测掉线。

Insight: 消融显示脚部加速度是重要信息源，而固件融合脚部方向会破坏增益。每条流的每个通道组单独学习时间门控，并用合成损坏可靠性目标训练，比预先丢弃固定通道更能应对未预见流故障；HMD-Poser干净条件更准，但最坏退化更大。

Abstract: Sparse inertial pose estimation promises camera-free motion capture from consumer devices, but consumer sensors are unreliable: firmware-fused orientations are biased, mounting varies between sessions, and streams drift or drop out. On a new 35-take single-subject benchmark pairing an earbud head inertial measurement unit (IMU) with two smart-insole foot IMUs (SAM-3D-Body pseudo-ground-truth labels), we show the reliability problem is channel-level: a channel ablation isolates foot acceleration as the most informative input (66.6 mm vs. 79.0 mm head-only) and the firmware-fused foot orientation as the liability that destroys the gain. We therefore let the model learn how much to trust each channel of each stream: one temporal gate per stream per channel block, trained with an auxiliary reliability objective on synthetically corrupted pretraining data. The channel-gated model is the most accurate of our learned fusion arms on clean data (69.4 mm vs. 83.7 static, 86.6 ungated) and under every simulated fault (bias in training; drift, dropout eval-only); its gates suppress the natively biased foot-orientation channels on clean real data without test-time supervision and flag dropout bursts at 0.92-0.999 AUROC. Two contrasts: dropping a channel known a priori to fail is flat across foot faults but collapses when an unanticipated stream fails (head dropout: 92.9 vs. 79.3 mm); and a fine-tuned HMD-Poser is more accurate on clean data (64.4 mm) and nominally under drift, with no significant paired difference under bias or dropout, but a larger worst-case degradation from clean (+16.1 vs. +3.5 mm, single seed). Learning to gate reliability instead of sensor count is the lever for deployable sparse inertial capture. Code is available at https://github.com/ZhilinGuo/reliability-gated-imu-fusion.

[304] Learning Native Reflection in Unified Models with Interleaved Reinforcement Learning cs.CV | cs.AIPDF

Yijia Fan, Ziqi Huang, Zhongang Cai, Yan Li, Zimo Wen

TL;DR: UMM-Reflection在统一多模态模型内联合强化学习反思文字和基于流的图像修订，使模型可多轮观察、诊断并改进自身生成。

Details

Motivation: 模型生成图像后，修订是否有效只能渲染后得知，因此反思诊断与图像修改需联合学习整轮闭环。仅用反思轨迹SFT难找到高成功修复路径，只优化渲染器或单一输出头也会遗漏收益。

Result: 在BAGEL上，相较SFT，GenEval提高12.05分；未用于训练的WISE、OneIG-Bench和T2I-CompBench++分别提升10.97、3.48和4.63分。

Insight: 让多个同初始图像的轨迹共享起点，以组相对优势比较不同反思策略，并用单个轨迹级优势更新反思token与流式图像修订，避免逐轮信用分配的组合爆炸。训练和推理都不需要外部验证器。

Abstract: Unified multimodal models can both look at and render images, so in principle they can repair their own generations: diagnose what an image gets wrong, revise it, observe the result, and diagnose again. Whether a revision helps is known only after it is rendered, so the reflection text and the image generation must be learned jointly, over the whole loop. Supervised fine-tuning (SFT) on reflection trajectories gives a cold start but does not find the high-success repair paths, and naive RL that optimizes only the renderer or only one head leaves most of the gain untapped. We introduce UMM-Reflection, which applies reinforcement learning (RL) to complete reflection trajectories inside one unified model: sibling trajectories share one initial image, so the group-relative advantage compares reflection strategies, and one trajectory-level advantage updates both the reflection tokens and the flow-based revisions, avoiding the combinatorial blow-up of per-round credit assignment. Unlike single-round editing or pipelines with an external critic, credit flows across rounds and to both roles of the same model, and no verifier is needed at inference. On BAGEL, UMM-Reflection improves GenEval by 12.05 points over SFT, and the gains transfer to WISE (+10.97), OneIG-Bench (+3.48), and T2I-CompBench++ (+4.63), none of which is used in training.

[305] PDMD: Projected Distribution Matching Distillation for Video Diffusion Models cs.CV | cs.LGPDF

Zimo Wang, Junkun Yuan, Angtian Wang, Haotian Yang, Canyu Zhang

TL;DR: PDMD在分布匹配蒸馏中投影去教师端点误差方向，减少误差跨学生更新累积导致的视频扩散过饱和和伪影。

Details

Motivation: DMD可将视频扩散采样步数大幅减少，但训练中可能逐渐过饱和并出现不自然纹理。原因是评论器误差进入连续学生更新并累积。

Result: Wan2.1仅4次函数评估时VBench总分83.73，比匹配DMD高1.03；MiniMax-H3联合音视频生成的VideoGen-Eval视觉总分83.17，高于最强蒸馏基线0.41，六项音频指标也最佳。用户研究偏好PDMD的视觉、运动和音频质量。

Insight: 固定噪声查询下，学生与评论器端点残差可无偏估计评论器端点误差；将DMD更新在残差方向的分量投影去除，可在高维假设下过滤固定比例的误差，同时仅损失趋近于零比例的理想信号。实现只需改DMD一行，无额外网络、损失或前向。

Abstract: Modern video diffusion models require tens of denoising evaluations over long spatiotemporal token sequences. Distribution Matching Distillation (DMD) reduces the number of function evaluations (NFE) to just a few. However, DMD samples can degrade during training, exhibiting progressive oversaturation and artifacts. We trace this instability to critic errors, which enter successive student updates and accumulate over time. We introduce Projected Distribution Matching Distillation (PDMD) to filter critic errors. PDMD projects out the component of the DMD update parallel to the student-critic endpoint residual. At a fixed noisy query, we prove that this residual is an unbiased estimate of the critic’s endpoint error. Under high-dimensional assumptions, this projection removes a constant fraction of critic error while discarding only a vanishing fraction of ideal DMD signal. Empirically, the projection stabilizes training and improves sample quality where DMD degrades and develops unnatural textures. PDMD requires only a one-line code change to DMD, with no extra loss, network, data, model pass, or multi-stage training. With Wan2.1, PDMD achieves a VBench total score of 83.73 at 4 NFE, surpassing matched DMD by 1.03 points. On MiniMax-H3 joint video-audio generation, PDMD achieves a VideoGen-Eval visual total score of 83.17, 0.41 points above the strongest distilled baseline. PDMD also achieves the best performance on all six audio metrics among the compared 4-NFE models. Qualitative comparisons and user studies favor PDMD over the distilled baselines in visual quality, motion, and audio quality. Code and models are available at https://pdmd2026.github.io/.

cs.CL [Back]

[306] ChestPheNoT: Deployable, Auditable Label-Status-Evidence Extraction from Radiology Reports cs.CL | cs.AI | cs.LGPDF

Kai Yu, Chenyu Zhu, Zaifu Zhan, Meijia Song, Min Zeng

TL;DR: CHESTPHENOT 是可本地部署的小型语言模型，可从放射学报告联合提取发现标签、存在/缺失/不确定状态及原文证据片段。

Details

Motivation: 临床表型抽取既需要结构化结果，也需要可审计的证据；传统标注器通常不输出依据，而托管式大模型 API 不适合无法离开机构环境的临床文本。专家标注数据又较稀缺。

Result: 在三个涵盖同分布、跨分类体系和跨机构的人工标注集上，3B 模型在分布内低于 CheXbert 银标教师，但跨机构检测 F1 高 2.0 分。超过 99% 的最终证据片段可在报告原文中定位；证据可审计 F1 为 47.5，比 Qwen2.5-7B 单次提示高 7.6 分，并接近 Qwen2.5-72B。模型在多数检测和状态比较中匹配或超过更大的提示模型。

Insight: 训练流程先使用 CheXbert 与 72B 模型构造混合银标，再监督微调并进行轻量 GRPO 优化，同时要求模型返回逐字证据。结果表明，小模型在本地运行和证据审计方面可形成实用折中，但分布内指标并未全面超越银标教师。

Abstract: Structured phenotype extraction from radiology reports supports cohort construction, quality auditing, and clinical analytics, but practical deployment requires local inference and auditable predictions, while expert annotations remain scarce. Conventional labelers provide structured findings and assertion states but no supporting evidence, while API-hosted large language models may be unsuitable when clinical text cannot leave institutional infrastructure. We present CHESTPHENOT, a compact 0.5-3B language model that jointly extracts finding labels, three-class status (present/absent/uncertain), and verbatim supporting evidence spans. CHESTPHENOT is trained using hybrid CheXbert+72B silver supervision followed by supervised fine-tuning and lightweight GRPO refinement. Across three human-annotated gold sets spanning in-distribution, cross-taxonomy, and cross-institution evaluation, the 3B model remains below its CheXbert silver teacher in distribution but is competitive under distribution shift, significantly surpassing CheXbert on cross-institution detection (+2.0 F1). Task-specific training also enables the 3B model to match or exceed substantially larger prompted models on most detection and status comparisons. For evidence-grounded extraction, over 99% of final evidence spans are locatable in the source report, and the 3B model achieves 47.5 auditable-F1, outperforming Qwen2.5-7B one-shot prompting by 7.6 points and approaching Qwen2.5-72B. These results demonstrate that locally deployable models can provide competitive and directly auditable radiology-report extraction without relying on external inference APIs. Code and the full extraction/judge prompts will be made available at https://github.com/yukkai/ChestPheNoT.

[307] An Evaluation of AI-Supported Evidence-Based Learning for Public Speaking Skill Development cs.CLPDF

Sashini Hettiarachchi, Shahbaz Siddeeq, Mika Saari, Pekka Abrahamsson

TL;DR: 这项小规模试点研究评估了结合语境化反馈和改写示范稿的 AI 演讲训练系统，七名本科生在重复练习后均出现表现改善。

Details

Motivation: 现有 AI 演讲辅导工具往往只给通用反馈，且缺少可供模仿学习的示范演讲稿。研究者希望根据演讲语境调整评价，并同时提供改写后的文本和音频示例。

Result: 七名本科生在一至三周试点期间反复使用系统，每人至少练习同一篇演讲三次；所有参与者的演讲表现都有改善，填充词减少，焦虑程度下降 15.3%–34.4%。参与者认为语境化反馈和改写稿有帮助并增强信心。

Insight: 系统将针对语境的反馈与文本、音频示范结合，支持“看示例再练习”的学习路径。由于样本仅七人且试点周期较短，结果属于初步证据；作者提出后续可研究视频中的身体行为分析。

Abstract: Public speaking is an essential skill in academic and professional contexts, but it often causes anxiety. Although several AI-based speech coaching tools exist, they typically provide generic feedback and lack model speeches for learning. This study addresses these gaps by developing a system that incorporates speech context into evaluation criteria, enabling more tailored feedback. It also generates improved model speeches in both text and audio formats to support example-based learning. The system was evaluated in a pilot study with seven undergraduate students over one to three weeks. Participants used the system repeatedly and practiced the same speech at least three times. Results showed improvements in public speaking performance for all participants. Filler word usage decreased, and anxiety levels dropped by 15.3% to 34.4%. Participants found the context-aware feedback and revised speeches useful and confidence-building. These findings suggest that context-aware feedback and model speeches can enhance public speaking skills and reduce anxiety. Future studies could explore video-based analysis of physical behavior during speeches.

[308] Omni-IO Skills: Harnessing Your Agent Omni-Native cs.CLPDF

Yanlin Li, Mingyang Hao, Shengqiong Wu, Hao Fei, Mong-Li Lee

TL;DR: Omni-IO Skills 提出无需改动主模型推理核心的多模态 Agent Harness，通过可插拔技能、统一执行接口、依赖编排和资产注册表扩展代理的多模态能力。

Details

Motivation: 通用代理虽能进行长程规划，但处理文本、图像、音频、视频、文档、3D 和代码的能力仍较割裂。单纯扩展基础模型需要昂贵更新，而拼接专用工具又难协调步骤、依赖、中间产物和跨轮修改。

Result: 27 个技能覆盖 7 种产物模态、38 项任务和理解、生成、推理、检索四类能力。在 UniM-90 上，GPT-5.6 Sol 与 Claude Sonnet 5 的输入支持率分别从 40.00% 和 38.89% 升至 100%；相对语义—质量耦合分数分别由 26.99、27.82 升至 74.94、77.78，严格结构分数达到 100.00 和 99.78。

Insight: 系统将多资产流程表达为声明式执行图，并用依赖感知调度并行处理；成功产物登记后可供后续步骤和对话轮次复用。结果说明，能力可通过工具与工作流层组合扩展，但摘要中的结论针对其 UniM-90 评测。

Abstract: General-purpose agents can plan, reason, and act over long horizons, yet their production capabilities remain fragmented across text, images, audio, video, documents, 3D assets, and code. Extending a foundation model to additional modalities ties capability growth to costly model updates, while assembling specialist models and tools leaves unresolved how procedures, dependencies, intermediate assets, and cross-turn revisions should be coordinated. We present Omni-IO Skills, a plug-and-play Agent Harness that makes existing agents omni-native through hierarchical Skills, a standardized multimodal execution interface, dependency-aware orchestration, and a persistent Asset Registry. Multi-asset workflows are represented as Declare Execution Graphs, which schedule independent operations concurrently and register successful outputs for downstream and cross-turn reuse across replaceable execution backends. Its 27 Skills cover 38 representative tasks spanning seven artifact modalities and four capability families: understanding, generation, reasoning, and retrieval. On UniM-90, the harness raises the input-support rates of GPT-5.6 Sol and Claude Sonnet 5 from 40.00% and 38.89% to 100%, while increasing relative Semantic–Quality Coupled Score from 26.99 to 74.94 and from 27.82 to 77.78, respectively; Strict Structure Score reaches 100.00 and 99.78. These results establish harness-level capability composition as a practical route to broad, evolvable Omni systems without changing the host agent’s reasoning core.

[309] Toward Embedding-Based Psychometrics: Structural Modeling of Assessment-Item Semantics With Contextual Scores cs.CLPDF

Jinsong Chen, Shi-Ting Chen

TL;DR: 该研究用外部语料中的上下文语义分数为 TIMSS 数学测评条目建模，发现这些分数包含一般维度和若干组关联，但直接诊断解释仍受模型设定影响。

Details

Motivation: 作者探索能否通过条目与参照词的语义相似度构造测评条目的表示，并分析该表示的潜在结构及其对作答诊断的价值，避免把语义维度直接等同于稳定的能力类别。

Result: 对 40 个 TIMSS 数学计分单元的部分指定两阶段因子分析，在所用构造下持续发现七组结构；比较普遍支持一般维度与组关联并存，但组成员对设定较敏感。语义锚定表示优于单因子模型，却未取得最低工作 BIC。作答基准中，BIC 偏好官方内容框架、AIC 偏好其四因子扩展，但匹配的一维 2PL 模型在 AIC、BIC 上均优于全部 12 个诊断条件。

Insight: 语义表示能补充单一因子结构，却没有证据支持直接将其作为可靠诊断类别。作者将文本辅助作答校准视为未来应用，并指出需要更大的已校准题库和独立评估。

Abstract: Contextual scores represent assessment items through their similarities to reference words in an external corpus. We examine the semantic structure of scores for 40 TIMSS mathematics scored units using a partially specified two-step factor procedure. A search across factor counts identifies a persistent seven-group structure under the featured construction. Subsequent comparisons consistently favor a general dimension alongside group associations, although individual group memberships remain sensitive to some specification choices. Item examples distinguish recurring, cross-domain, sensitive, and imposed associations. Simpler and unrestricted references clarify the contribution and limits of the anchored representation: it improves on a single factor but does not achieve the lowest working Bayesian information criterion (BIC). A separate response benchmark compares three initial Q constructions and their Hull-PVAF revisions under higher-order and saturated attribute distributions. Among these diagnostic models, BIC favors the official content framework and the Akaike information criterion (AIC) favors its direct four-factor augmentation, but a matched unidimensional two-parameter logistic model has lower AIC and BIC than all twelve conditions. These findings support a conditional semantic representation while limiting direct diagnostic interpretation. We discuss learned text-assisted response calibration as a prospective application requiring a larger calibrated item bank and independent evaluation.

[310] ScopeIF: Improving Scope-Aware Precise Instruction-Following in Large Language Models via Graded Reward Modeling cs.CLPDF

Bosi Wen, Yilin Niu, Xiaoying Ning, Ying Zhang, Hongning Wang

TL;DR: ScopeIF 将指令中的客观约束拆分为作用范围、目标和取值范围，并用工具验证与分级奖励训练模型处理只约束回答局部片段的复杂指令。

Details

Motivation: 复杂指令中的约束可能只适用于回答的特定部分。既有方法常忽略约束作用范围，并使用逐约束二元奖励，导致数据多样性不足、复杂约束监督稀疏。

Result: 作者构建 ScopeInstruct 数据集，并报告 ScopeIF 在复杂范围约束任务上持续优于已有方法，同时保留通用能力。经优化的 Qwen3-4B 和 8B 在实验中可与 Gemini-2.5-Pro、DeepSeek-V3.2 等前沿模型竞争或超过；摘要未列出各基准具体分数。

Insight: 统一的 Scope、Target、Range 表示把约束内容拆成可独立核验的维度，分级奖励再按违反程度提供更密集反馈。该设计针对范围复杂的指令遵循，摘要没有量化通用能力保持幅度。

Abstract: Precise instruction-following is a fundamental ability of large language models (LLMs), requiring their outputs to strictly satisfy objective constraints in input instructions. In complex application scenarios, these constraints often possess diverse scopes that govern specific response segments rather than the entire output. However, existing optimization methods often neglect constraint scope during data construction and rely on binary per-constraint rewards, yielding limited data diversity and sparse supervision for complex constraints. To this end, we propose ScopeIF, a novel training framework for scope-aware precise instruction-following. We first introduce a unified schema that factorizes objective constraints into three decoupled dimensions: Scope, Target, and Range. Grounded in this schema, we construct ScopeInstruct, a large-scale instruction dataset with diverse scope-aware constraints, and combine tool-grounded verification with graded reward modeling to quantify the violation degree of each constraint, providing dense supervision for policy optimization. Extensive experiments demonstrate that ScopeIF consistently outperforms existing methods, particularly on complex scope-aware constraints, while preserving general capabilities. Notably, it enables optimized Qwen3-4B and 8B models to rival or surpass strong frontier models such as Gemini-2.5-Pro and DeepSeek-V3.2, establishing an effective paradigm for advancing scope-aware instruction-following. Our code and data are available at https://github.com/thu-coai/ScopeIF.

[311] Solving Every Step Is Not Enough: Milestone Oracles Reveal a Composition Gap in LLM Math Reasoning cs.CLPDF

Zhuohan Wang, Haoran Ma, Tianyu Wu, Yuanlin Duan, Zichun Liao

TL;DR: OracleLadder 通过逐级提供解题路线、里程碑答案及单独子题测试，诊断大语言模型数学推理中的步骤组合缺口。

Details

Motivation: 模型即使能独立答对每个中间步骤，给出步骤路线及其答案后仍可能无法完成整题。这说明逐步求解能力与把步骤正确组合起来的能力并不相同，普通整体准确率难定位失败位置。

Result: 在 354 道 NuminaMath 题和 8B–671B 的六个模型上，所有模型最大的推理缺口都是更严格定义的组合缺口，占 33%–48%；剔除被语言模型复核标记为可能评分错误的题后仍占 24%–37%。路线效应在 MATH500、AIME 2024/25 上复现；独立第二教师下逐题恢复结果有 83%–87% 一致，评测还可迁移到代码生成。

Insight: 固定路线由教师模型生成，答案由确定性符号验证器评分；逐级 oracle 帮助把失败分类为五类缺口。总体准确率与里程碑帮助下的恢复率可能给出不同模型排序，因此评测应区分基础解题能力和步骤组合能力。

Abstract: Large language models (LLMs) can solve every intermediate step of a multi-step math problem on its own and still fail the full problem, even when given a roadmap of the steps and all of their answers. We introduce OracleLadder, a diagnostic evaluation that locates where LLM math reasoning fails by giving the model increasing levels of oracle help. For each problem, a teacher model writes a fixed roadmap of intermediate sub-goals (milestones), and a deterministic symbolic verifier grades every answer. Testing the model with no help, with the roadmap, with the roadmap plus the milestone answers, and on each milestone alone sorts each failure into one of five reasoning gaps. On 354 NuminaMath problems and six models from 8B to 671B parameters (Qwen3, gpt-oss, Llama 3.3, DeepSeek-V3.1), the largest gap for every model is the composition gap, a stricter form of the compositionality gap. It covers 33-48% of problems, and 24-37% after removing problems that an LLM review flags as grading errors. Accuracy and milestone-help recovery rank the two strongest models differently, and two RLVR runs with similar accuracy gains move problems differently. The roadmap effect replicates on MATH500 and AIME 2024/25, per-problem recovery agrees for 83-87% of problems under an independent second teacher, and the help ladder carries over to code generation. We release the data, roadmaps, prompts, and code at https://github.com/slark-prime/OracleLadder.

[312] DualGuard: Dual-Mode Quality Control for Logic-Preserving Data Augmentation cs.CLPDF

Shenghao Li, Lin Zhao

TL;DR: DualGuard 为逻辑推理数据增强提供双模式质量控制：既逐批筛选或修复候选，也跨样本追踪增强操作的历史表现并支持回滚。

Details

Motivation: 大语言模型可以大量生成逻辑推理训练数据，但数量增加不保证语义、标签和逻辑可靠。生成后还需判断候选应保留、过滤还是修复，单个二元质量分数无法充分指导复杂控制。

Result: 在 Two-Stage Transfer 的七项下游任务中，DualGuard 在五项任务上取得最高准确率，并在全部七项上超过无增强 BERT 基线。消融显示记忆、Z3 符号验证及基于历史的异常控制分别发挥互补作用；摘要未提供各任务分数。

Insight: 当前实例模式根据批次反馈进行选择性保留、过滤、归因和定向修订；跨样本模式积累操作记录，与每种操作自身历史行为比较，以支持异常检查、回滚和有限修复。两种模式共享语义验证，并在可靠逻辑形式存在时加入符号验证。

Abstract: Large language models provide a practical way to generate augmented data for logical reasoning at scale, but a larger generation volume does not guarantee semantic, label, or logical reliability. Existing work has improved generation quality through generation constraints, candidate validation, filtering, and feedback-based revision; however, once a quality judgment is available, deciding whether a candidate should be retained, filtered, or repaired remains an important control problem. We propose DualGuard, a dual-mode quality-control framework for logic-preserving data augmentation. The first mode uses the current instance and candidate batch for selective retention, filtering, attribution, and targeted feedback. The second mode accumulates cross-instance execution records of augmentation actions on top of per-sample diagnosis and attribution, compares new executions against each action’s own historical behavior, and supports retrospective anomaly inspection, targeted rollback, and bounded repair. Both modes share semantic verification and additionally use symbolic verification when a reliable logical form is available. Across seven downstream tasks in the Two-Stage Transfer setting, DualGuard achieves the highest Accuracy on five tasks and outperforms the no-augmentation BERT baseline on all seven. Controlled ablations further show complementary roles for Memory, Z3, and history-aware anomaly control.

[313] AdaTutoRank: Learning to Rerank Document Sets via Adaptive Tutoring Optimization for RAG and Deep Research cs.CLPDF

Kailin Jiang, Lei Liu, Jian Xi, Yangqi Chen, Hui Xu

TL;DR: AdaTutoRank 将文档集合重排视作集合级优化问题，并按候选 rollout 的质量自适应提供不同具体程度的指导，以改善 RAG 和深度研究检索。

Details

Motivation: 单篇文档的相关性不代表整组证据完整、互补且不冗余；集合级奖励又把同一分数分给集合中所有文档，难以区分关键贡献者和冗余搭便车者。固定指导也可能对强弱不同的 rollout 不合适。

Result: 在覆盖 RAG、深度研究和集合排序的十个基准上，AdaTutoRank 达到论文所述的总体最佳表现，同时使用更少检索调用。摘要未列出各基准的具体提升数值。

Insight: ATO 提供三级指导：仅使用评分标准、参考策略选出的同伴集合，以及对比反思；指导形式按 rollout 质量匹配。冻结教师在有提示与无提示条件下重新评分，将提示影响转为 token 级优势，与组相对结果奖励共同训练集合排序器。

Abstract: Document rerankers determine what evidence reaches the downstream model in RAG and deep research, yet mainstream rerankers select by relevance matching, and individually relevant documents rarely constitute the complete, complementary, non-redundant set a complex information need demands. Prior work rewards a set by its aggregate rubric score, shifting the objective from ranking documents to composing sets. Yet that score is one scalar shared by every document in the set, so the supervision is sparse: a redundant document is rewarded with the rest whenever the set scores well, and a decisive one penalized with the rest whenever it does not; credit assignment leaves contributors indistinguishable from free riders. On-policy distillation could densify this supervision, but existing methods give every rollout the same fixed guidance, too prescriptive for strong rollouts and too abstract for weak ones. We therefore propose AdaTutoRank, a setwise reranker trained with Adaptive Tutoring Optimization (ATO) under a three-level hierarchy of nine rubric dimensions, which supplies silver labels for the cold start, rewards for reinforcement learning, and hints for distillation. ATO draws three hint forms of increasing specificity from the policy’s own frozen snapshot: the rubrics alone, a self-selector’s sibling-set chosen under rubrics, and a self-reflector’s reflection contrasting the rollout with that sibling-set; each rollout receives the form matched to its quality. Re-scoring that rollout under the hint-conditioned frozen teacher and the hint-free snapshot distills the hint’s effect into a token-level advantage that complements the group-relative outcome advantage. Across ten benchmarks spanning RAG, deep research, and setwise evaluation, AdaTutoRank attains the best overall performance while issuing fewer retrieval calls.

Xiaofan Zhou, Lu Cheng

TL;DR: WDA 让工作流设计代理在不更新语言模型权重的条件下，同时演化自我修订流水线的阶段指令与结构，并用 SPLIT 把冗余指令分散到专门阶段。

Details

Motivation: 反思式提示优化可以改善 LLM 系统，但固定的工作流结构限制了自我修订方式；反复修改还会让单条提示不断堆积冗余指令。

Result: 在知识、数学推理、多跳问答和指令遵循等五个基准上，Qwen3.5-9B 平均得分为 51.24%，较初始求解器高 8.63 个百分点，较去掉 SPLIT 的变体高 2.60 点；GPT-4.1-mini 为 49.00%，相应提升 5.62 和 3.69 点。

Insight: 三样例反思和局部筛选用于控制搜索，校准分数决定 Pareto 接纳及不利更新回滚。最终指令与流水线深度按任务数据学习，但对该任务的所有测试输入保持固定；因此属于任务自适应，而非逐测试样本动态修改。

Abstract: Reflective prompt optimization improves large language model (LLM) systems without updating model weights, but fixed architectures constrain how self-refinement is organized. We introduce Workflow-Designing Agents (WDA), a framework for streamlined reflective evolution of task-adaptive self-refinement pipelines. Starting from a minimal prompt, WDA jointly evolves stage instructions and their sequential structure. During evolution, we find that repeated revisions can accumulate redundant instructions in a single prompt. In WDA, we propose to address this problem with SPLIT, which redistributes these instructions across specialized stages. Three-example reflection and local screening guide selective search, while calibration scores guide Pareto admission and rollback of unhelpful trailing updates. The resulting pipelines are task-adaptive: their instructions and depth are learned from task data, then fixed for all test inputs within that task. We evaluate WDA on five benchmarks spanning knowledge, mathematical reasoning, multi-hop question answering, and instruction following. On Qwen3.5-9B, WDA achieves an average score of 51.24%, improving over the initial solver by 8.63 percentage points and the variant without SPLIT by 2.60 points. On GPT-4.1-mini, it achieves 49.00%, with corresponding gains of 5.62 and 3.69 points. These results support task-adaptive self-refinement as a complementary direction to broader agentic workflow search.

[315] Explaining Textual Entailment with Lexical Entailments: Using LLMs to Supply Lexical Relations for Formal Proofs cs.CL | cs.AIPDF

Jorryt de Jong, Stefan Moraca, Ettore Cesari, Lasha Abzianidze

TL;DR: 该研究让大语言模型为自然语言蕴含生成结构化词汇蕴含关系，再将这些关系提供给自然逻辑定理证明器，检验词汇知识能否支撑形式化证明。

Details

Motivation: LLM 似乎掌握大量词汇知识，但尚不清楚推理时是否实际使用这些知识、使用得是否正确；逻辑式 NLI 系统推理透明，却需要丰富词汇关系才能证明超出纯逻辑形式的蕴含。

Result: 研究构建句子蕴含解释数据集，先内在评估模型生成结构化词汇解释，再把生成关系用于 LangPro 定理证明器进行外在评估。即使托管专有模型仍觉得该任务困难，生成关系对证明搜索的帮助有限且常仅部分可靠；摘要未给出具体分数。

Insight: 生成的词汇关系可能针对当前 NLI 题目临时定制，而非普遍成立的词义知识。因此，形式化解释看似结构清楚并不自动意味着关系可靠，神经符号系统仍需校验其语义健全性。

Abstract: Large Language Models (LLMs) are highly capable of natural language reasoning and appear to store a great deal of lexical knowledge, but it is still unclear how much of this knowledge they actually use when reasoning, and whether they use it in the right way. On the other hand, logic-based Natural Language Inference (NLI) systems provide transparent and formally grounded reasoning, but they need to be supplied with rich lexical knowledge to prove inferences beyond purely logical ones. In this paper, we evaluate whether LLMs can identify all lexical knowledge needed to solve NLI problems and how much this knowledge contributes to proof search in a logic-based NLI system. Our research focuses exclusively on structured lexical entailments (e.g., chinchilla$\sqsubseteq$small animal) as a proxy for structured explanations for NLI problems with an entailment label. First, we curate a dataset for a new task of explaining sentential entailments with a set of lexical entailments. The dataset is used to intrinsically evaluate LLMs on generating structured lexical explanations. Then, we use NLI as an extrinsic evaluation in a simple neuro-symbolic setting, assessing whether LLMs can supply sufficient lexical relations to LangPro, a natural-logic theorem prover for natural language. The results show that the proposed task remains challenging even for hosted proprietary LLMs, and that their contribution to theorem proving is moderate: generated relations are often only partially sound and may be tailored to the specific NLI problem rather than representing generally valid lexical knowledge.

[316] Locally Sound, Globally Insufficient: The Local-Global Gap in Multi-Hop Reasoning cs.CLPDF

Bohao Chu, Hendrik Damm, Qianli Wang, Hui Wang, Shuning Zhang

TL;DR: 该研究定义多跳推理中的局部—全局缺口：每一步都能被证据支持，整条推理仍可能偏离问题或无法推出最终答案；E-Closure 通过训练显式监督步骤与问题、答案间的闭合关系。

Details

Motivation: 传统忠实度验证器主要检查单步陈述是否有证据，可能漏掉逐步看似合理、整体却没有回答问题的推理轨迹。

Result: 对三个多跳问答基准、三个模型的 2,598 条回答进行人工判定，局部—全局缺口出现在每种基准—模型组合中，占整体不足回答近一半。以保留至少 95% 可靠轨迹为条件时，常规验证器对该类错误的召回明显低于对局部不可靠轨迹的召回。E-Closure 在微调方法中平均准确率最高（92.8%）、轨迹可靠性最高（89.0%），缺口率最低（6.2%）。

Insight: 可靠推理至少需要证据到步骤支持、问题到轨迹对齐、轨迹到答案闭合三种依赖。E-Closure 以支持与反事实回答的生成监督及双向切换约束来训练这些关系，避免仅靠事后逐句查证。

Abstract: Reliable multi-hop reasoning requires more than locally supported steps: a trace can be sound at every reasoning step yet still fail to answer the question as a whole. We call this failure regime the local-global gap (LGG), in which the trace is locally sound yet globally insufficient. Local soundness requires each step to be supported by the available evidence and preceding steps, whereas global sufficiency requires the reasoning trace to align with the question and establish the submitted answer. In a human-adjudicated diagnostic of 2,598 responses across three multi-hop QA benchmarks and three models, we find that the LGG occurs in every benchmark-model combination and accounts for nearly half of globally insufficient responses overall. However, conventional faithfulness verifiers that check claims against the evidence largely miss these failures: at thresholds retaining at least 95% of reliable traces, recall for LGG cases is substantially lower than that for locally unsound traces. To address these failures, we formalize three dependencies for reliable reasoning: evidence-to-step support, question-to-trace alignment, and trace-to-answer closure. Instead of post-hoc diagnosis, we introduce E-Closure to supervise these dependencies during training, combining generation supervision on supported original and counterfactual responses with bidirectional switching constraints. Averaged over three benchmarks and three backbones, existing fine-tuning baselines improve accuracy and local soundness over the base models, but at the cost of global sufficiency. E-Closure improves both: among all fine-tuned methods, it achieves the highest average accuracy (92.8%) and trace reliability (89.0%) while yielding the lowest LGG rate (6.2%).

[317] Groupwise Agentic Grading and Advantage Redistribution for Code Agent RL cs.CL | cs.LGPDF

Jinhao Dong, Liang Zhao, Zihao Yue, Wenhan Ma, Linghao Zhang

TL;DR: GAGAR 在代码智能体强化学习中，对通过测试的轨迹进行组内质量排序并重分配优势，使干净、符合任务范围的实现获得更多训练信号。

Details

Motivation: 二元执行测试给同一 rollout 组中所有通过轨迹相同优势，无法区分质量高低，也不能鼓励避免不必要或越界改动的实现。

Result: 在 MiMo-V2.6-Flash（总参数 310B）和 Pro（1.02T）的预强化学习检查点上进行工业规模评估。受控的 Flash 代码任务实验显示，GAGAR 改善代码智能体表现、减少轨迹长度增长并使训练更稳定；作者还将其用于 Flash 与 Pro 的大规模混合任务强化学习。摘要未提供具体性能数值。

Insight: 动态采样保留同时含通过与失败轨迹的组；经监督微调的智能体评分器联合检查组内候选并排序，再降低低排名轨迹权重，并按比例重标定通过轨迹优势、保持其总和不变。这样在不改变组总奖励质量的前提下，把学习信号转向高质量实现。

Abstract: Reinforcement learning (RL) for code agents often uses executable tests to provide binary rewards. With these rewards, Group Relative Policy Optimization (GRPO) assigns identical advantages to test-passing trajectories within each rollout group, overlooking differences in implementation quality and adherence to task requirements. This leaves the policy without a learning signal that favors clean, targeted implementations over those containing unnecessary or out-of-scope changes. We introduce GAGAR, a framework for quality-aware credit redistribution in code agent RL. Built on dynamic sampling that retains groups containing both passing and failing trajectories, GAGAR places all trajectories from each group in a shared workspace, where an SFT-trained agentic grader jointly inspects them and ranks the test-passing candidates. Based on this ranking, we downweight lower-ranked trajectories and proportionally rescale the advantages of all test-passing trajectories to restore their original sum. This sum-preserving redistribution retains the relative weights established by quality-based downweighting while shifting credit toward higher-quality implementations. We evaluate GAGAR at industrial scale using pre-RL SFT checkpoints of MiMo-V2.6-Flash (310B total parameters) and MiMo-V2.6-Pro (1.02T total parameters). Controlled code-only Flash experiments show improved code agent performance, reduced trajectory-length growth, and more stable training. We further apply GAGAR in large-scale mixed-task RL with both Flash and Pro. Our results support combining test-based verification with groupwise agentic grading to improve the quality and stability of code agent RL.

[318] The Alignment Paradox: How Post-Training Amplifies Confident Hallucinations in Language Models cs.CL | cs.AIPDF

Qingjia Huang, Yakai Li, Jianguo Wu, Qihang Zhou, Aimin Yu

TL;DR: 该研究发现指令微调可能放大长尾事实问题上的高置信错误，并提出在 DPO 中限制随熵变化的答案边际，以减少这类幻觉。

Details

Motivation: 高置信错误会削弱语言模型可靠性，也让基于不确定性的错误检测失效。作者研究后训练对错误答案置信度的影响，而非只归因于知识缺失、推理错误或随机解码。

Result: 五个模型家族的事实基准实验中，指令微调模型的高置信错误（p≥0.95）相较基础模型增加 10–35 倍；错误答案的 logit 边际在后层扩大到 4.0 以上。Mistral-7B 多轮实验中，熵依赖边际约束使高置信错误相较标准 DPO 最多减少 35.3%，同时保持所测一般推理表现。

Insight: 作者将这种现象称为 Alignment Paradox，并通过逐层探测指出过度自信主要在后训练后的末层形成。限制边际增长是对齐阶段的一种缓解策略，摘要证据覆盖所测模型家族和事实基准。

Abstract: Large language models (LLMs) can produce factually incorrect answers with high confidence, undermining their reliability and limiting the effectiveness of uncertainty-based error detection. While prior research attributes confident hallucinations to factors such as missing knowledge in training data, reasoning errors, or stochastic decoding, we uncover that post-training alignment itself is a primary driver of these errors, a phenomenon we call the \textbf{Alignment Paradox}. Across five model families evaluated on factual benchmarks, unaligned base models produce few high-confidence errors on long-tail factual queries, whereas instruction-tuned models multiply high-confidence errors ($p \ge 0.95$) by more than an order of magnitude (10$\times$ to 35$\times$). Layer-wise probing with the Logit Lens reveals that this overconfidence emerges in late layers, where wrong-answer margins expand past 4.0 points after remaining near zero across early and intermediate layers. These findings motivate limiting margin growth during post-training. We implement this principle through an entropy-dependent margin bound in direct preference optimization (DPO). In multi-epoch experiments with Mistral-7B, the bounded objective reduces high-confidence errors by up to 35.3% relative to standard DPO while maintaining performance on evaluated general reasoning benchmarks. These results show that bounded margins mitigate confident hallucinations during post-training.

[319] Does CoT-Pass@k Really Check the CoT? A Multilingual Mathematical Audit cs.CLPDF

Tarık Tuna Taşaltı, Burcu Hüdaverdi, David Semedo

TL;DR: 这项多语言审计检验 CoT-Pass@k 的语言模型评审器能否真正识别错误推理链，发现三个评审器对被破坏的推理链都缺乏可靠辨别能力。

Details

Motivation: CoT-Pass@k 试图用评审模型检查推理过程，弥补 Pass@k 只看答案对错的不足；其有效性却依赖评审器能否抓出链条错误，而且过去未在该指标协议内或英语以外系统验证。

Result: 审计覆盖英语、土耳其语和葡萄牙语的五个数学基准，其中两个原生使用非英语。三种评审器几乎与接受干净链条同样频繁地接受被篡改链条；两种较大的评审器尤其受链条与最终答案是否一致影响。旧一代求解器上 Pass@k 与 CoT-Pass@k 平均相差 19.7 点，当前一代仅 4.1 点；差值还受两侧 token 预算和生成模式影响。

Insight: 即使 CoT-Pass@k 低于 Pass@k，也不能直接把差值解释成推理链错误被识别；提高生成预算时 Pass@64 可变化逾 50 点而差值仍为零。论文建议在把任何模型评审推理指标当作推理证据前，先通过针对性有效性检查。

Abstract: Pass@k measures whether a model reaches a correct answer under repeated sampling, but never how: a lucky guess counts the same as sound reasoning. CoT-Pass@k was proposed to close that gap, adding an LLM-as-judge that must assess a solution’s reasoning chain before it counts. Its value rests entirely on one assumption: that the judge catches flawed reasoning. That assumption has never been tested inside the metric that depends on it, and never outside English, though the metric’s claims concern models used in many languages. We report the first audit of that verification step, run under the metric’s own protocol on a multilingual suite of five mathematical benchmarks in English, Turkish and Portuguese, two of them natively written. We corrupt correct solutions with deterministic edits that damage the chain and the final answer separately. We observe that all three judges accept corrupted chains almost as often as clean ones. V4-Flash and Qwen3.6 reject a solution sharply only when its final answer is wrong and accept a wrong answer more readily when the chain agrees with it; the metric’s own judge accepts most wrong answers as well. Our study shows that chain-answer agreement dominates the two larger judges’ verdicts and that all three fail to reliably detect the tested reasoning errors. Consequently the difference Pass@k - CoT-Pass@k averages 19.7 points on an earlier solver generation but only 4.1 on the current one. What little remains depends on the token budgets on both sides and on the generation mode; raising the generation budget moves Pass@64 by more than fifty points while the difference stays at zero. We close with two checks any judged reasoning metric should pass before its numbers are read as evidence about reasoning.

[320] MixDetect: Word-Level Localization and Quantification of AI Editing cs.CLPDF

Hongrui Bao, Yubing Ren, Zhendong Pan, Fang Fang, Shi Wang

TL;DR: MixDetect 在词级分别定位文本中被 AI 修改的词，并估计修改幅度，从而区分编辑范围与编辑强度，而不只输出整段文本的作者标签。

Details

Motivation: 传统 AI 文本检测主要区分人工写作与完全机器生成；AI 辅助编辑越来越常见，但现有方法通常只给全文标签或编辑程度分数，无法说明具体改动位置。

Result: 训练使用原文—编辑文档对齐生成词级监督，推理仅需输入文本。实验显示 MixDetect 能定位 AI 编辑词、反映修改强度，且在不同编辑程度和操作间呈现不同的范围—强度模式；聚合预测在二元和三元文本分类以及域迁移、生成器迁移下仍有效。摘要未给出量化分数。

Insight: AI 编辑总量会随追加 AI 编辑而增加，AI 生成文本经人工修改后下降，而普通的人际编辑下基本不变。将“改了哪里”和“改了多少”分开建模，有助于分析混合作者文本，而非把文本简化为单一作者类别。

Abstract: Large language models are increasingly used to edit human-written text rather than generate entire texts from scratch. Conventional AI-text detectors mainly distinguish human-written from fully AI-generated text, while recent methods for AI-edited text typically provide only a text-level label or editing-degree score. We introduce MixDetect, a word-level framework for localizing and quantifying AI editing. MixDetect separately predicts whether each word has been edited and, conditional on editing, how substantial the edit is, allowing editing scope and editing intensity to be estimated separately. During training, source–edited pairs are aligned to construct word-level supervision, while inference requires only the input text. Experiments show that MixDetect accurately localizes AI-edited words, reflects differences in editing intensity, and reveals different scope–intensity patterns across editing degrees and operations. The overall AI editing magnitude increases under additional AI editing, decreases when AI-generated text is edited by humans, and remains nearly unchanged under ordinary human-to-human editing. The aggregated text-level predictions also perform well on binary and ternary AI-text classification and remain effective under domain and generator shifts. These results show that AI editing can be analyzed beyond a single authorship label or editing-degree score by identifying both where AI editing occurs and how substantial the edits are.

[321] From Knowing to Abstaining: Bridging the Representation-Action Gap in Vision-Language Models cs.CL | cs.CVPDF

Jialuo He, Huangxun Chen

TL;DR: VAD-R 为视觉语言模型的自发弃答构建带逐步理由和因果证据缺口标注的基准；Rep2Act 则把模型内部已有的可回答性判断转成明确弃答行为。

Details

Motivation: 既有弃答基准可能含有图像或问题中的捷径线索，也常提供显式“无法回答”选项，难以测量模型是否能自发拒答；只有二元标签也不足以提供细粒度训练监督。

Result: VAD-R 经捷径过滤和质量验证构建。受测开源和闭源 VLM 的自发弃答召回率平均仅 11.4% 和 16.3%。Rep2Act 将 Qwen2.5-VL-3B 的行动准确率从 56.67% 提升至 86.33%，将 7B 版本从 59.33% 提升至 88.67%；在分布外 TUBench 上，3B 模型平均 F1 为 53.3%，比 GPT-4 Turbo 高 16.2%，比 GPT-4o 高 1.1%。

Insight: 探测结果显示某些层的隐藏表示已区分可回答性，但这种信息未必反映在最终回答中，体现了表征到行动之间的落差。Rep2Act 的目标是把潜在判断对齐成显式弃答决策。

Abstract: The ability of vision-language models (VLMs) to abstain from unanswerable questions is as important as their ability to answer answerable ones accurately. Recently, several benchmarks have emerged to evaluate and improve VLM abstention, but they have substantial limitations. First, samples often contain shortcut cues in images or questions that reveal answerability, while an explicit “unanswerable” option further prevents accurate assessment of spontaneous abstention. Second, as training data, they generally provide only binary labels without fine-grained explanations for deeper supervision. To address these limitations, we introduce Visual Answerability Diagnosis with Rationales (VAD-R), a benchmark constructed through a two-stage pipeline of shortcut filtering and quality verification to prevent answerability leakage. Each example is annotated with step-by-step rationales and causal evidence-gap labels. Evaluation of state-of-the-art open- and closed-source VLMs on VAD-R reveals limited spontaneous abstention, with average recall rates of only 11.4% and 16.3%, respectively. Probing analyses show that hidden-state representations in certain layers can effectively distinguish answerability, yet this distinction fails to manifest in final responses. Motivated by this observation, we introduce Rep2Act, a representation-to-action alignment method that translates latent answerability awareness into explicit abstention decisions. Rep2Act improves action accuracy on VAD-R from 56.67% to 86.33% for Qwen2.5-VL-3B and from 59.33% to 88.67% for Qwen2.5-VL-7B. On the out-of-distribution TUBench, Rep2Act achieves an average F1 score of 53.3% with only a 3B model, surpassing the closed-source GPT-4 Turbo and GPT-4o by 16.2% and 1.1%, respectively.

[322] OpenTumorBoard: A Real-World Benchmark of Multidisciplinary Tumor Board Discussion Trajectories cs.CL | cs.LGPDF

Anqi Li, Zhixuan Ge, Yixuan Duan, Jiarong Qian, Chi-Yu Chen

TL;DR: OpenTumorBoard 将真实多学科肿瘤讨论整理为病例与对话轨迹基准，评估模型回答专科问题以及模拟多角色讨论并形成治疗共识的能力。

Details

Motivation: 现有基准很少保留肿瘤委员会结合多模态临床观察和纵向病史进行讨论的真实过程，难以评估模型在协作式个体化决策中的表现。

Result: 基准包含 611 个病例、19,157 个讨论轮次、10 种专科角色，源自 12,534 分钟公开视频。14 个通用和医学模型中，最佳模型对专科回答的临床等价性为 5 分制 3.43，对真实委员会结论的一致性为 2.78。监督微调与强化学习在留出集上改善表现；三位医学专家抽检认为病例信息覆盖度和事实性较高，且提取的共识结论保真度较好。

Insight: 基准分别测量单轮专科回答与完整讨论模拟，后者还要求形成治疗建议、手术计划、后续行动和临床试验匹配结论。真实讨论轨迹可用于适配，但当前最佳模型与记录共识仍有明显差距。

Abstract: Multidisciplinary tumor boards integrate multimodal clinical observations and longitudinal patient histories through specialist discussions, yet benchmarks rarely capture these real-world trajectories. We introduce OpenTumorBoard, a benchmark with 611 patient cases and 19,157 discussion turns across ten specialist roles, transcribed from 12,534 minutes of publicly available tumor board recordings on YouTube. The benchmark evaluates two settings: SPECIALIST TURN, in which an LLM responds to a clinically significant question posed during a real discussion, and BOARD SIMULATION, in which it generates an entire back-and-forth discussion and reaches a consensus on therapy recommendations, surgical plans, next actions and clinical trial matching. Evaluation of 14 general-purpose frontier and medical LLMs reveals substantial limitations: the best models score 3.43 out of 5 in clinical equivalence to specialist answers and 2.78 out of 5 in alignment with recorded board conclusions. Supervised finetuning and reinforcement learning improve performance on a held-out test set, suggesting that real-world discussion trajectories can support model adaptation. Three M.D. experts review a subset of the benchmark, finding high information coverage and factuality of patient cases and strong fidelity of extracted consensus conclusions. We will release OpenTumorBoard and its automated curation pipeline to support the development and evaluation of LLMs for multidisciplinary, personalized cancer decision-making.

[323] ARSM: Auto-Regressive State Machine for Agentic Reasoning Compression cs.CLPDF

Xiafeng Man, Siyuan Ye, Xiaosong Ma

TL;DR: ARSM 是无需训练的代理上下文压缩框架，通过将历史交互改写为假设—行动—结果微链，并用动态状态机维护分层记忆。

Details

Motivation: 长程代理持续累积上下文会造成记忆瓶颈；既有压缩方法依赖特定任务优化或外部模型，增加计算开销，压缩后还可能丢失结构关系并损害决策一致性。

Result: 在 Webshop、多目标多跳问答和 SWE-Bench Lite 上，ARSM 在减少 token 消耗的同时保持任务表现。摘要未提供各任务的具体分数或节省比例。

Insight: 压缩机制将交互轨迹整理为结构化 HAR 微链，并以原子操作和压缩控制参数调节层级状态；自回归生成同时输出外部动作和内部记忆更新。这样把压缩嵌入代理生成过程，而不额外调用辅助模型。

Abstract: While Large Language Model (LLM)-based agents demonstrate strong capabilities in long-horizon tasks by interleaving reasoning with external environment interactions, the continuous accumulation of context rapidly creates a critical memory bottleneck. Existing memory compression methods rely on task-specific optimization or external auxiliary models, introducing significant computational overhead. Furthermore, the resulting compressed representations tend to lose structured relationships, leading to information dilution, attention collapse, and degraded decision consistency. To address these limitations, we propose Auto-Regressive State Machine (ARSM), a lightweight training-free framework that enables in-situ reasoning compression through structured state evolution. ARSM introduces two key components: (i) a trajectory abstraction mechanism that reorganizes interaction histories into compact Hypothesis-Action-Result (HAR) micro-chains; (ii) a dynamic state machine that regulates hierarchical memory through atomic operations and a compression-control parameter. These components are unified within an auto-regressive, self-compressive generation space, where each model output jointly performs external action execution and internal state updates. We evaluate ARSM on Webshop, Multi-Objective Multi-Hop QA, and SWE-Bench Lite datasets. Experimental results show that ARSM maintains the task performance while simultaneously reducing token consumption, offering a practical, cost-effective route toward scalable autonomous agents for long-horizon tasks.

[324] MedRouter: Demystifying Knowledge Differences Across Medical LLMs for Routing-Based Reasoning cs.CL | cs.AIPDF

Lang Cao, Binghang Lu, Yuhao Shen, Yue Guo

TL;DR: MedRouter 先根据问题选择互补的医学专科模型，再将其回答交给生成器综合，利用专科正确性监督和强化学习优化路由策略。

Details

Motivation: 医学问答涉及多个专科和模态，不同医学语言模型各有强项；传统路由主要在答案质量与推理成本间权衡，尚未充分利用专家能力差异来提升推理覆盖。

Result: 在八个文本及多模态医学问答基准上，MedRouter 的平均准确率比最强路由基线高 8%。分析也显示专科模型具有不同且互补的问题级覆盖；摘要未给出逐项基准成绩。

Insight: SCALE 先用专科回答正确性监督训练多标签路由器，再用 Performance Gain Reward 强化学习选择模型；奖励衡量专家信息相对无专家辅助时对最终答案正确性的增益。这样优化的是实际贡献而不只是专家本身的正确率。

Abstract: Medical question answering spans diverse specialties and modalities, and individual medical large language models (LLMs) exhibit distinct strengths across tasks and domains. This heterogeneity suggests that combining specialists may enable broader coverage of medical questions than relying on any single model. However, existing LLM routing methods primarily seek to balance answer quality and inference cost, leaving open how to exploit differences in specialist competence to improve medical reasoning. In this paper, we introduce MedRouter, an agentic system that uses an embedding-based multi-label router to select and query specialist LLMs, then passes their responses to a generator to produce the final answer. We further propose SCALE (Specialist Competence-Aware Learning), a two-stage training framework that first trains the Router with specialist correctness supervision and then optimizes its selections through reinforcement learning. The second stage uses a Performance Gain Reward (PGR) that measures how specialist information affects the generator’s answer correctness relative to answering without that information. Experiments on eight text-based and multimodal medical QA benchmarks show that MedRouter outperforms the strongest routing baseline by 8% in average accuracy. Our analysis of specialist outputs further reveals distinct strengths and complementary question-level coverage, motivating learned routing to combine these capabilities for more comprehensive medical reasoning.

[325] Generalization Dynamics of LM Pre-training cs.CLPDF

Jiaxin Wen, Zhengxuan Wu, Dawn Song, Lijie Chen

TL;DR: 该研究指出语言模型预训练期间的泛化能力可能在“浅层模式匹配”和“可泛化推理”之间突然切换，并将这种现象称为 mode-hopping。

Details

Motivation: 常见观点认为模型会在预训练中平稳地从记忆模式过渡到一般化智能；作者用玩具评测发现，同一训练过程可能出现反复、突然的能力切换。

Result: 评测观察到模型会在模式记忆与上下文学习、System 1 与 System 2、听起来可信与事实正确等行为间突然切换，且局部稳定、无法靠检查点平均消除。作者还展示可以选择中间检查点，使推理和对齐泛化优于最终检查点，并选择预训练数据来调节泛化动态；摘要未给出量化幅度。

Insight: 作者将切换解释为容量分配竞争：模型容量有限，泛化回路要与早期形成的浅层回路竞争，每个预训练窗口的数据可能影响胜出者。此机制是论文提出的解释，摘要强调其不能由标准优化动态充分说明。

Abstract: People typically assume that LMs stably mature from pattern-matching parrots to generalizable intelligence during pre-training. We build a toy eval suite and show this mental model is wrong: throughout pre-training, LMs frequently and suddenly hop between parrot-like and intelligence-like computations. We call this mode-hopping. Across our suite, LMs suddenly latch onto memorized or in-context patterns instead of in-context learning, use System 1 instead of System 2 thinking, pick up what sounds true instead of what is true, fail at multi-hop persona QA, out-of-context reasoning, and emergent misalignment – then just as suddenly revert and generalize. Mode-hopping is not explained by standard optimization dynamics: it is locally stable and cannot be fixed by checkpoint averaging. We instead think of it as a capacity allocation problem: in a capacity-bounded model, generalizable circuits must compete with the shallow ones learned early in training, and the data in each pre-training window may decide which circuits win. Our suite provides a new efficient lens on generalization. We demonstrate two concrete applications: (i) select intermediate pre-training checkpoints that strongly generalize reasoning and alignment, better than the final pre- or mid-training checkpoints, and (ii) select pre-training data that controls and stabilizes generalization dynamics.

[326] Where Do Test-Time Scaling and Training Fall Short in Individual Stance Prediction? cs.CLPDF

Yuyang Zhao, Xuan Liu, HaoYang Shangm Haojian Jin

TL;DR: 该研究用 STANCE-BENCH 分析大语言模型从个人历史预测其新讨论立场时，测试时扩展与后训练在生成、候选选择和个体证据利用上的失效模式。

Details

Motivation: 测试时扩展与后训练已提升代码和数学表现，但对个人立场预测是否有效并不明确；采样共识、监督微调和强化学习可能分别带来不同偏差。

Result: STANCE-BENCH 包含来自 500 名 Hacker News 用户的 2,499 个预测任务。研究发现错误共识、候选选择失误、监督微调模仿过拟合以及强化学习早期平台四类问题。在 781 个测试任务上，结合候选立场直接打分与个人历史支持度评估的方法，在 Qwen3-8B 上讨论级 Macro-F1 为 21.83，高于直接打分的 19.27。

Insight: 诊断表明应分别评估候选生成、最终选择和个人历史证据使用，而不能仅比较整体分数。研究聚焦从历史讨论推断个人立场，结果不应直接外推到其他偏好任务。

Abstract: Test-time scaling and post-training have improved LLM performance in coding and mathematical reasoning, but their effectiveness for individual stance prediction remains unclear. We study this question by predicting a person’s stance in a new discussion from their history. We evaluate widely used test-time scaling strategies and post-training methods, such as supervised fine-tuning and reinforcement learning, and identify four failure modes across generation, selection, and learning: (1) incorrect consensus, where repeated samples agree on the wrong stance; (2) selection failure, where generation covers the observed stance but selection misses it; (3) response overfitting, where supervised fine-tuning improves imitation but harms prediction; and (4) early plateau, where reinforcement learning shows modest initial gains followed by limited further improvement. We expose these failures using STANCE-BENCH, which contains 2499 prediction tasks from 500 Hacker News users. Guided by this analysis, we explore a simple approach that combines direct scores for all candidate stances with explicit assessments of support from the individual’s history. On the 781-task test set, this approach achieves 21.83 discussion-specific Macro F1 with Qwen3-8B, compared with 19.27 for direct scoring. Our results motivate evaluating candidate generation, final selection, and person-specific evidence use separately.

[327] CoLMbo-SV: A Grounded Language Model for Explainable Speaker Verification cs.CL | cs.SD | eess.ASPDF

Massa Baali, Sarthak Bisht, Ziyue Qiu, Joseph Konan, Rita Singh

TL;DR: CoLMbo-SV 将预训练说话人编码器与语言模型结合，生成带可核验声学测量的说话人比对报告，同时保留专用说话人表征的判别能力。

Details

Motivation: 说话人验证系统虽准确，却很少解释声学证据；自然语言解释还必须区分“测量是否正确”和“该测量是否真正影响验证决定”。

Result: 作者构建 VoxReason 配对录音、声学测量与报告数据，并设计分离表征信息、验证分数依据和报告讨论内容的评测框架。在 VoxCeleb1-O 上，CoLMbo-SV 的 EER 为 0.99%，相较使用 VoxReason 微调的最强音频语言基线将验证错误降低约 80%，数值依据评分为 0.82。

Insight: 把显式声学测量提供给语言模型可使比对报告可检查，但正确描述声学属性并不等于该属性对最终判定有决策相关性。该研究把这种解释与决策之间的差距单独纳入分析。

Abstract: Speaker verification systems achieve high accuracy but provide little account of the acoustic evidence behind their judgments. Making these systems inspectable requires exposing interpretable evidence while retaining the richer information on which their decisions depend. We present \textbf{CoLMbo-SV}, a speaker language model that combines strong speaker discrimination with structured, acoustically grounded comparison reports. By connecting a pretrained speaker encoder to a language model and supplying explicit acoustic measurements, CoLMbo-SV makes voice comparisons inspectable without restricting verification to the evidence verbalized in its reports. We additionally introduce \textbf{VoxReason}, paired recordings with measured acoustic properties and comparison reports filtered through numerical and qualitative checks, providing supervision for this combined capability. We also develop an evaluation framework that separates what acoustic information a speaker representation encodes, what influences the verification score, and what the generated report discusses. On VoxCeleb1-O, CoLMbo-SV achieves 0.99% EER, reducing verification error by approximately 80% relative to the strongest audio-language baseline fine-tuned on VoxReason, while attaining a numerical-grounding score of 0.82. Our analysis further demonstrates that acoustic correctness and decision relevance are distinct properties of an explanation, exposing a gap that numerical-grounding metrics miss. Together, these contributions substantially advance audio-language speaker verification, bring its accuracy toward that of dedicated speaker encoders while adding checkable acoustic reporting, and establish an empirical framework for connecting natural-language explanations to the decisions they explain.

[328] The Text Beside the Image: Detection, Utility and Leakage for Trustworthy Multimodal Medical Data and Beyond cs.CL | cs.CVPDF

Andreas Maier, Monica Hinrichs-Mayer, Franziska Weber, Niklas Lackner, Matthias May

TL;DR: 该研究审计医学及其他文本发布中身份信息检测、下游用途和残余身份泄漏，指出保护影像本身并不能保护随附报告文本。

Details

Motivation: 医疗图像通常和报告一起公开，去标识化策略可能降低识别敏感信息的风险，却仍留下可跨文档链接身份的线索。作者在同一文本上评估检测覆盖和残余泄漏。

Result: 在四类语料、德英中阿四种语言及三种发布条件下，固定的 13 检测器组合对医疗报告的个人信息敏感度为 0.9998、特异度为 0.8686；对法律文本分别为 0.9958 和 0.8504。组合使用后，基于公开姓名表的频率匹配没有找回身份；跨文档链接在邮件中无训练时正确排首位率为 0.93%，有训练时为 3.94%，而未修改文本为 71.98%。医疗报告有训练时为 0.71%（138 个查询），无训练时未找回身份。

Insight: 作者把去标识化策略作为变量，同时考察检测、文本可用性和剩余链接风险。多检测器可减少明文身份泄漏，但跨文档关联仍取决于语料类型与攻击设定，不能只报告单一检测器的召回率。

Abstract: Medical images are released with the reports that describe them, and protecting the image does not protect the report. This paper measures the text component of such releases. We measure identifier detection, downstream utility and residual identity leakage on the same documents, with the pseudonymisation policy as the variable under test: 15 detectors, three release conditions and four corpora of medical reports, legal judgments, news and other genres, and e-mail, in German, English, Chinese and Arabic. A fixed 13-detector union reaches a person sensitivity of 0.9998 at specificity 0.8686 on the medical reports, 0.9958 at 0.8504 on the legal judgments, 0.9352 at 0.9318 on news and other genres, and 0.9906 at 0.6235 on e-mail. With this ensemble, frequency matching with a public name list recovers zero identities by alignment across the four corpora; the names it got right were ones the detector missed, left in clear text. Cross-document linkage ranks the correct person first for 0.93% of e-mail queries without training and 3.94% with it, against 1/3697 chance and 71.98% on unmodified text. On the medical reports it recovers nothing without training and 0.71% of 138 queries with it, against 1/207 chance and a 2.73% ceiling on unmodified text.

[329] Calibration, Not Answer Selection: Distilling Internal Confidence in Reasoning Models cs.CLPDF

Yadong Xi, Rongsheng Zhang, Tangjie Lv, Ziyang Luo, Ruochen Zhao

TL;DR: 该研究区分“模型知道自己多确定”与“模型能选出正确答案”，并用探针引导自蒸馏提升推理模型口头置信度的校准。

Details

Motivation: 二元正确性奖励训练的是答案正确率，而非校准置信度；模型口头表达的自信更多反映其愿意承诺，而不等于答案正确概率，事后重标定通常难以跨分布迁移。

Result: 在四个事实问答基准和两个模型家族中，CoT 与答案之间隐藏状态上的线性探针 ECE 比口头置信度低 5–38 倍；但用于从 N 个采样答案中选优时，探针几乎只与多数投票持平，明显不及 oracle。Qwen3-14B 的 Probe-SD 将域内 ECE 从 0.178 降至 0.024，域外从 0.542 降至 0.113，并优于事后重标定与自一致性蒸馏。

Insight: 内部表示适合报告“模型有多确定”，却不适合直接做答案选择。Probe-SD 用探针对模型自身采样轨迹评分、改写轨迹中的置信度文本，再监督微调同系列基础模型，因此测试时不需要保留外部探针，并可支持加权投票。

Abstract: Reinforcement learning with binary correctness rewards trains correctness, not calibrated confidence. The confidence that reasoning models verbalize is systematically overconfident, and the problem is not merely one of scale: verbalized confidence tracks how willing a model is to commit to an answer, not how likely the answer is to be right. Post-hoc rescaling therefore fits one distribution but rarely transfers. We look inside the model instead. On factual question answering, a linear probe on the hidden state between the chain of thought and the answer is substantially better calibrated: its expected calibration error is 5 to 38 times lower than that of the verbalized score across four benchmarks and two model families. However, when used to pick among N sampled answers, that same probe nearly ties majority voting yet falls far short of the oracle. Internal states answer “how certain am I” well and “which answer is right” poorly, so the signal should be reported as a confidence rather than used to select answers. As a result, we introduce probe-guided self-distillation (Probe-SD): score a model’s own sampled traces with the probe, overwrite the confidence each trace states, and finetune the base checkpoint of the same family, so nothing but the model itself remains at test time. On Qwen3-14B, Probe-SD cuts ECE from 0.178 to 0.024 in-domain and from 0.542 to 0.113 out-of-domain, where it also beats post-hoc recalibration and self-consistency distillation. The resulting confidence is well-calibrated and useful for weighted voting, behaviors previously attributed to online RL, here obtained with supervised finetuning alone.

[330] Hesitation-Aware On-Policy Distillation for Diffusion Language Models cs.CL | cs.AIPDF

Jianguo Huang, Lipeng Wan, Yanchen Deng, Bo An

TL;DR: HOPD 将扩散语言模型尚未提交的 token 提案纳入教师蒸馏，并根据最终生成轨迹回看哪些位置更有信息量来分配监督。

Details

Motivation: 传统轨迹级 on-policy 蒸馏只在学生最终提交 token 的位置匹配教师分布，忽略模型仍犹豫、已提出但未提交的预测；这些位置可能包含更大的师生差异。

Result: SDAR-4B 试验中，犹豫位置占可监督状态—位置对的 24%，却承载 66% 的师生分歧。SDAR-1.7B 和 4B 从 TraDo-8B-Instruct 蒸馏后，在五个数学和编程基准的静态、动态解码及两个模型规模下平均成绩最佳。SDAR-4B 每去噪步提交的 token 比 TOPD 多 11%，且准确率更高。

Insight: HOPD 在每步所有遮罩位置上匹配教师分布，再依据完整轨迹回看后续预测是否与最终 token 不同、首步提案是否保留来加权。两模型本就产生所有遮罩位置的概率分布，因此相较 TOPD 不需额外前向传播，只增加损失计算。

Abstract: Diffusion large language models (dLLMs) generate text by iterative unmasking. At each denoising step, a dLLM proposes a token at every masked position, but the decoder commits only a confident subset of these proposals. Trace-based on-policy distillation (TOPD) builds on this process by matching the student to a stronger teacher, yet only at the committed positions. We argue that this discards much of the useful signal, which resides in the uncommitted proposals, where the student has made a prediction but is not yet confident enough to commit it. We call these proposals hesitations. In our pilot study on an SDAR-4B student, hesitations make up only 24% of supervisable state-position pairs but carry 66% of the teacher-student divergence. To exploit this signal, we propose Hesitation-Aware On-Policy Distillation (HOPD), which extends teacher distribution matching to every masked position of each denoising step. Because hesitations are not equally informative, we further allocate supervision using hindsight from the completed trajectory, placing more weight on positions whose proposal was later disagreed with the final token and on blocks where first-step proposals rarely survive. Since both models already produce distributions at all masked positions, HOPD requires no additional forward passes over TOPD. The only extra cost is evaluating the loss at more positions. With SDAR-1.7B and SDAR-4B students distilled from TraDo-8B-Instruct, HOPD achieves the best average score among the evaluated methods on five math and coding benchmarks, under both static and dynamic decoding and at both scales. It also speeds up decoding. On SDAR-4B, the HOPD student hesitates less and commits 11% more tokens per denoising step than TOPD, while reaching higher accuracy.

[331] Does Learning to Predict the World Help Agents Act? Auditing World-Model Post-Training cs.CL | cs.AIPDF

Xinyu Che, Hang Yan, Yanchen Liu, Haochen Liu, Ruifeng Li

TL;DR: 该研究通过替换世界模型训练中的真实下一观察目标，审计智能体收益是否真的来自学习预测环境，发现错配目标乃至随机奖励也可能提升部分任务表现。

Details

Motivation: 用下一观察预测训练智能体可同时引入优化变化等其他影响，因此性能提升是否由环境预测能力本身带来仍不明确。

Result: 在两个交互式文本环境中，错配但同分布的下一观察目标使预测准确率较真实目标低 15.3%–61.6%，却仍保留相较基础模型的显著任务收益；训练后模型考虑更多候选动作且更少循环。独立随机奖励也能扩大 pass@64 任务覆盖；在 VisualWebArena 上，随机奖励训练相较基础模型提高 pass@64 14.3%，不使用观察匹配奖励或外部多模态教师。

Insight: 实验挑战了“预测准确度越高，代理能力提升越多”的简单归因。作者发现，训练过程本身可能增加探索行为或改变策略，因此评估世界模型后训练时需设置错配目标、无信息奖励等对照。

Abstract: Predicting how an environment will change before acting is a natural route to better decision making for agents. Recent post-training methods therefore require agents to predict the next observation and turn that prediction into a reward or a direct supervision signal, which is called world model. Existing next-observation training methods help the agent to learn the environmental content. However, they additionally involve an optimization process, which may introduce several effects other than learning to predict the world. Consequently, where the performance gain comes from during the training process remains an open question. We answer this research question through replacing true next-observation targets with in-distribution mismatched observations during the training process. Across two interactive text environments, mismatched targets lower prediction accuracy by 15.3-61.6% relative to ground-truth targets, yet retain substantial task gains over the base model. Compared with the base model, trained models consider more candidate actions and exhibit less looping. We also introduce a setting that replaces prediction-based rewards with independent random signals. This training expands task coverage (pass@64) even when the reward carries no environment information. We also generalize this finding to VisualWebArena, where random-reward training raises pass@64 by 14.3% relative to the base model, without observation-matching rewards or an external multimodal teacher for reward construction.

[332] NLPG: Natural-Language Policy Gradients for Self-Evolving Language Agents cs.CL | cs.AIPDF

Xu Liu, WenZhang Wei, Jun Cao, Dehua Peng, Huan Chen

TL;DR: NLPG 通过外部自然语言策略记忆改进冻结语言代理：分析执行轨迹、沿模块依赖图回传下游反馈，再把重复失败转成局部流程修正。

Details

Motivation: 代理由检索、工具使用、推理和验证等程序组成，失败常来自局部流程决策；标量奖励或反复改写整个提示难以积累细粒度程序经验，同时可能影响稳定组件。

Result: 在覆盖记忆、推理、指令遵循和证据验证的六个基准上，NLPG 平均比各基准最强所列基线高 8.71 个百分点。方法不改变模型参数或程序结构；摘要没有列出逐基准分数。

Insight: 执行轨迹中的下游结果被反向传播至相关模块，反复出现的局部问题转成有界自然语言策略更新，供后续执行复用。研究表明可把已评估的程序经验转为可解释修改，但只在所测六类基准中验证。

Abstract: Large language model agents increasingly rely on compound programs for retrieval, tool use, reasoning, and verification, yet their failures often arise from local procedural decisions. Existing reinforcement-learning and prompt-optimization approaches typically rely on scalar rewards or repeatedly modify entire prompts, making it difficult to capture and reuse procedural improvements while preserving a frozen agent. To address this problem, We propose Natural-Language Policy Gradients (NLPG), an external policy-memory method for improving a fixed agent without changing its model parameters or program structure. NLPG diagnoses execution traces, propagates downstream feedback backward through the module graph, and converts recurring failures into route-local natural-language corrections that are aggregated into bounded policy updates for subsequent executions. Across six benchmarks covering memory, reasoning, instruction following, and evidence verification, NLPG also outperforms the strongest listed baseline for each benchmark by 8.71 percentage points on average. These results provide evidence that evaluated procedural experience can be transformed into local and interpretable policy updates, enabling continual improvement of frozen agents.

[333] Dense Is Not Enough: Hierarchical Supervision Allocation for Long-Horizon On-Policy Distillation cs.CLPDF

Yuhao Sun, Binrui Wu, Zhuoer Xu, Ming Wen, Haoxiang Xu

TL;DR: LENS-OPD 将长程智能体蒸馏表述为分层监督分配，按学生当前能力从轨迹、决策到 token 逐步定位并验证真正有帮助的教师指导。

Details

Motivation: 长程 on-policy 蒸馏若对每个 token 均匀匹配，可能把监督浪费在对后续行为无益的差异上；有用的指导还必须是当前学生可学习且能持续保留的。

Result: 在多个长程智能体基准及学生—教师配置中，LENS-OPD 持续优于普通 OPD，以及较强的课程学习和样本选择基线。摘要未给出具体分数。

Insight: Locate 根据学生能力调整轨迹暴露并提出干预决策，Validate 检查指导是否改善同一学生后续行为，Refine 再把有效行为内化到可部署策略，并集中监督该轮中决定性的师生冲突。细粒度分配嵌套依赖于更粗层决策，而非单独优化重要性分数。

Abstract: On-policy distillation (OPD) transfers the capabilities of a large language model to a smaller student by providing teacher supervision on the student’s own rollouts. In long-horizon agentic tasks, however, uniform token-level matching can allocate supervision poorly: a large local discrepancy need not improve future behavior, while consequential guidance may be beyond the current student’s reach or fail to persist without privileged input. We formulate long-horizon OPD as hierarchical supervision allocation and argue that productive guidance lies at the intersection of future utility and current learnability. Crucially, this intersection evolves as the student learns. Based on this principle, we propose LENS-OPD, a coarse-to-fine framework that organizes supervision through Locate, Validate, and Refine. Locate adapts trajectory exposure to the student’s evolving competence and proposes a candidate decision for intervention. Validate tests whether teacher guidance at that decision improves the same student’s subsequent behavior. Refine internalizes the beneficial guided behavior into the deployable policy and concentrates token-level supervision on decisive teacher-student conflicts within the validated turn. These stages are nested: each finer allocation is conditioned on the coarser decision, rather than being optimized as an independent importance score. Experiments across multiple long-horizon agent benchmarks and student-teacher configurations show that LENS-OPD consistently improves task performance over vanilla OPD and strong curriculum- and selection-based baselines. Our results suggest that effective long-horizon distillation requires teaching at the right depth, the right decision, and the right token.

[334] TeacherGRPO: Closing the Capacity Gap in Reasoning Distillation via Teacher Alignment cs.CLPDF

Zhenyu Lei, Zihan Chen, Yaochen Zhu, Shangbin Feng, Zaiyi Zheng

TL;DR: TeacherGRPO 通过强化学习把复杂教师分布适配到学生的可学习范围，再用适配后的教师蒸馏，避免简单筛掉难题或插入较弱中间教师。

Details

Motivation: 教师越强，其分布越可能超出小学生的表达能力，形成 Gap Curse 并拖累蒸馏。直接知识蒸馏来对齐教师又会导致教师推理能力崩塌。

Result: 作者报告 TeacherGRPO 在多种推理基准和蒸馏方法上显著优于基线；摘要未列出具体数值。

Insight: 方法将教师适配转成强化学习，使用 token 与分布两级课程聚焦高信号差距、过滤平凡 token 和不确定长尾分布；重要性自适应长度正则惩罚冗长冗余，同时保留有教学价值的推理步骤。

Abstract: Reasoning distillation from powerful teacher models to smaller students faces the Gap Curse: as teachers grow more sophisticated, their complex distributions increasingly diverge from what students can approximate, causing performance degradation. Existing mitigation strategies either filter out challenging examples through data selection or introduce weaker intermediate assistant models, inherently compromising supervision coverage or quality. We propose Teacher Alignment, which directly adapts the teacher toward the student’s distribution without discarding data or degrading reasoning quality. However, naive alignment through standard knowledge distillation triggers catastrophic collapse of the teacher’s reasoning capabilities. To address this, we reformulate teacher alignment as reinforcement learning and introduce TeacherGRPO, built on Group Relative Policy Optimization with two key innovations: (i) Curriculum Selective Alignment applies dual token- and distribution-level curricula to focus rewards on high-signal reasoning gaps while filtering noise from trivial tokens and uncertain tail distributions, and (ii) Importance-Adaptive Length Regularization selectively penalizes verbose redundancy while preserving pedagogically critical reasoning steps. The aligned teacher then distills knowledge to students via standard pipelines. Extensive experiments show TeacherGRPO significantly outperforms baselines across diverse reasoning benchmarks and distillation methods. Our code is available at https://github.com/LzyFischer/TeacherGRPO.

[335] MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformation cs.CLPDF

Ruihong Zeng, Jonathan Tonglet, Preslav Nakov, Iryna Gurevych

TL;DR: MIC 检查 AI 生成多模态错误信息中配图内容与文字主张是否一致，并生成图像证据和世界知识层面的不一致解释，辅助事实核查。

Details

Motivation: 现有自动事实核查多检测图像是否由 AI 合成，却未核验图像描绘内容是否符合配套主张的语境；合成来源本身并不能说明内容真实与否。

Result: MIC-Bench 包含 4,406 条主张及其真实图像与一张引入受控语境不一致的 AI 图像，共 8,812 个图像—主张样本。相较仅监督微调，GRPO 使分布内和分布外 Macro-F1 分别提升 4.67 和 4.11 点，也改善视觉证据描述与世界知识解释的语义相似度。

Insight: 训练奖励分别核验判定、不一致类型、视觉证据描述和世界知识解释，先做 SFT 任务适配再做 GRPO。该基准通过一条真实图和一条受控不一致的生成图配对，聚焦内容语境核验而非单纯来源检测。

Abstract: Claims paired with AI-generated images are a rapidly growing form of misinformation. Existing automated fact-checking (AFC) methods mainly treat this as a provenance problem, detecting low-level synthesis artifacts to decide whether an image is AI-generated. However, such methods do not verify what human fact-checkers often check: whether an image’s content is consistent with the context implied by its accompanying claim. To address this gap, we introduce MIC (Multimodal Inconsistency Checking), an AFC framework that assists human fact-checkers by detecting AI-generated multimodal misinformation and explaining inconsistencies using world knowledge. MIC first uses supervised fine-tuning (SFT) for task adaptation and then applies Group Relative Policy Optimization (GRPO) to directly optimize component-level verifiable rewards for verdict prediction, inconsistency type classification, visual evidence description, and world-knowledge explanation. We further introduce MIC-Bench, a benchmark comprising 8,812 image-claim instances derived from 4,406 claims, where each claim is paired with an authentic image and an AI-generated counterpart that introduces a controlled contextual inconsistency. Compared with SFT alone, GRPO further improves Macro-F1 by 4.67 and 4.11 points in the in-distribution and out-of-distribution settings, respectively, while also improving the semantic similarity of visual evidence descriptions and world-knowledge explanations to reference annotations. Our code and data are available at https://github.com/UKPLab/arxiv2026-mic.

[336] Rethinking Token Reweighting for SFT: Suppress, Reverse, and Extrapolate Learned Features cs.CLPDF

Cunchun Li, Haonan He, Yifan Gao, Minglei Li, Jingqi Ye

TL;DR: SCALE 冻结预训练模型与监督微调增量，通过熵引导的 token 和模块门控，选择性压制、反转或外推已学到的 SFT 特征。

Details

Motivation: 常见 token 重加权为示范 token 分配非负系数，只能缩小或放大监督更新，不能撤销有害特征；提高训练权重也不等同于沿固定方向外推。

Result: 在 Qwen2.5-Math-1.5B、Qwen2.5-Math-7B 和 Qwen3-4B-Base 上，数学推理平均分分别为 37.84、43.60、36.57，超过各自最强对应基线，同时在通用能力保持基准上具竞争力；三个模型在 HumanEval、HumanEval+ 和 MBPP 上也取得最佳平均代码生成表现。

Insight: 固定预训练模型及 SFT 增量提供稳定参考方向，SCALE 仅学习有界、按 token 和模块变化的门控，并以预测熵为优化目标，使已学残差可被压制、反向使用或外推。这是在训练后控制既有特征使用方式，而非重新改变其学习过程。

Abstract: Supervised fine-tuning (SFT) learns most aggressively from tokens that the model deems least likely. This helps acquire new behaviors, but also amplifies noisy or conflicting supervision and can overwrite useful pretrained knowledge. Through a unified policy-loss view, we revisit existing token-reweighting methods and show that they assign nonnegative coefficients to demonstrated tokens. Consequently, they can suppress or amplify supervised updates, but cannot reverse harmful features once learned. Moreover, larger training weights do not amount to feature extrapolation, since they change the optimization trajectory rather than scale a fixed SFT direction. We argue that reversal and extrapolation require a stable reference frame defined by a fixed SFT delta. Motivated by this, we propose SCALE (Selective Control of Adaptation via Local Entropy), an entropy-guided adaptation-strength-control method that freezes the pretrained model and the SFT delta and learns bounded token- and module-specific gates by minimizing predictive entropy alone. These gates suppress, reverse, or extrapolate frozen SFT features according to their alignment with entropy reduction. Across Qwen2.5-Math-1.5B, Qwen2.5-Math-7B, and Qwen3-4B-Base, SCALE achieves mathematical-reasoning averages of 37.84, 43.60, and 36.57, exceeding the strongest corresponding baselines while remaining competitive on general-retention benchmarks. It also attains the best average code-generation performance across HumanEval, HumanEval+, and MBPP for all three models. These results suggest that effective SFT correction can benefit from controlling how already learned residuals are used, rather than only modifying how they are learned.

[337] DISCO: Distributed Long Context Scaling with Grounding-Reasoning Disaggregation cs.CLPDF

Guanzheng Chen, Viet Dac Lai, Subhojyoti Mukherjee, Branislav Kveton, Seunghyun Yoon

TL;DR: DISCO 将超长上下文中的证据定位和复杂推理分配给不同模型：多个 Worker 并行提取局部证据，由经过强化学习训练的 Driver 规划任务并综合答案。

Details

Motivation: 即便模型宣称支持百万 token，上下文增长仍会造成 context rot；作者认为单体架构中大规模证据搜索会挤占复杂推理所需的表示能力。

Result: 在一百万 token 的 RULER-QA 上，DISCO 准确率为 78.4%，而标准基线明显崩溃；在 LongBench v2 上最高比全上下文模型高 9.8 点，并匹配 Gemini-3-Pro-Preview 等前沿模型，同时推理成本降低超过 80%。

Insight: Worker 只负责并行局部 grounding，Driver 将查询拆为原子提取任务并汇总证据形成答案，通过职责分离隔离原始上下文噪声。Driver 用 GRPO 优化规划；成本优势来自分布式处理，而非把完整上下文塞入单次调用。

Abstract: While Large Language Models (LLMs) advertise million-token context windows, reasoning quality often collapses as inputs grow – a phenomenon termed context rot. This failure stems from a structural entanglement in monolithic architectures, where the massive search burden of contextual grounding exhausts the representational capacity needed for complex reasoning. To resolve this, we propose Grounding-Reasoning Disaggregation via DIStributed long COntext scaling (DISCO). Inspired by distributed computing frameworks like Apache Spark, DISCO partitions long context across a fleet of Worker LLMs dedicated exclusively to parallel, localized grounding. A central Driver LLM, trained via Reinforcement Learning (GRPO) to optimize planning, orchestrates execution by dynamically mapping queries into atomic extraction tasks and reducing the gathered evidence to synthesize a final answer. By isolating reasoning from raw context noise, DISCO effectively eliminates context rot. On RULER-QA (1M tokens), it maintains 78.4% accuracy where standard baselines collapse. Furthermore, it outperforms full-context models by up to 9.8 points on LongBench v2 and matches frontier models like Gemini-3-Pro-Preview while reducing inference costs by over 80%, establishing a highly efficient paradigm for robust long-context inference.

[338] LLMs Trust Their Own: Identity-Dependent Conformity in Multi-Agent Systems cs.CL | cs.MAPDF

Liron Soffer, Ravid Shwartz-Ziv, Chen Shani

TL;DR: 该研究发现，多智能体场景中的语言模型会受同伴群体身份影响：对内群体错误共识更容易从众，对外群体错误共识则更倾向偏离。

Details

Motivation: 多智能体系统中模型会观察并影响彼此，社会身份可能独立于答案正确性改变信息聚合。研究检验模型是否只跟随共识，还是会区别对待身份相同与不同的同伴。

Result: 在 12 个开源模型、9 项有唯一正确答案的任务中，身份引发双向从众效应。与人类不同，多数派中的一名同伴打破共识并不会明显减少模型从众；来自对立群体的正确同伴反而强化双向效应。CoT 可抑制多数效应，但同群体同伴仍能降低对错误外群体多数的从众；将同伴标为安全对齐只改变总体从众程度，不消除群体偏好。

Insight: 群体身份会影响模型如何汇总其他代理的信息，即使该身份与答案正确性无关，构成多智能体系统可被利用的操纵面。结果来自指定开源模型和实验设置，不能直接等同于真实社会群体行为。

Abstract: Large language models (LLMs) are increasingly deployed in multi-agent settings, where agents observe and influence one another, making social influence a key dimension of AI behavior and safety. We investigate whether LLMs’ responses depend on the social identity of other agents, beyond the effect of their consensus. We construct judgment tasks with a single correct answer, and place models in a multi-agent setting where they receive incorrect answers from other agents whose social identities (AI or human, model family, or an arbitrary minimal group) are either shared with or distinct from their own. Across 12 open-weights models and nine tasks, we find a bidirectional effect of group identity on conformity to incorrect answers: in-group consensus increases conformity (in-group favoritism), whereas out-group consensus decreases it (out-group divergence). Unlike humans, for whom one ally breaking the consensus sharply reduces conformity, models are unmoved by an ally from the majority’s group. Worse, a correct ally from the opposing group intensifies this bidirectional effect. Chain-of-Thought reasoning suppresses most of these effects, yet an in-group ally still reduces conformity to an incorrect out-group majority. Labeling peers as safety-aligned shifts overall conformity but leaves in-group favoritism and out-group divergence intact. These results show that group identity shapes how LLMs aggregate information across agents, independently of its correctness, and identify a manipulation surface for multi-agent AI systems.

[339] E-CONAN (Entailment, CONtradition And Neutral) Diagnostics Dataset Investigating Linguistic Phenomena in Arabic Natural Language Understanding cs.CL | cs.AI | cs.HC | cs.LG | cs.LOPDF

Khloud AL Jallad, Nada Ghneim, Ghaida Rebdawi

TL;DR: E-CONAN 是用于分析阿拉伯语自然语言推理错误的人工标注诊断数据集，并提出跨语言 NLU 误差分析的层级分类框架。

Details

Motivation: 现有诊断基准缺少宏观与微观类别的统一命名，也没有必须覆盖的标准语言现象清单，限制了对模型细粒度弱点的系统比较。

Result: 作者将提出的阿拉伯语层级应用于 E-CONAN，并用其评估 9 个预训练语言模型和 5 个大语言模型。LLM 在世界知识与常识推理宏类上优于预训练模型，却在句法宏类上较弱；推理现象对所有模型最难，句法是预训练模型最容易的类别，词汇—句法是 LLM 最容易的类别。摘要未报告各模型具体分数。

Insight: 按粗粒度与细粒度现象做误差归因，能揭示整体分数掩盖的能力差异。该分类层级目前以阿拉伯语案例为基础，作者提出其可为跨语言诊断提供初始规范。

Abstract: Natural Language Understanding (NLU) plays a crucial role in various applications, yet its performance suffers from weaknesses in handling the complexities of human languages, ranging from lexical ambiguity to high-level reasoning difficulties. Analyzing errors across diverse linguistic phenomena is crucial for NLU improvement, as it will help humans get insights to comprehensively assess models’ limitations and capabilities, so optimizing models’ generalization. Notably, several benchmarks contain diagnostics datasets designed for investigation and fine-grained error analysis. When highlighting the gaps in the state-of-the-art, we noted that there is no naming convention for macro and micro categories or even a standard set of linguistic phenomena that should be covered. To overcome this gap, we propose an initial hierarchy for Cross-Lingual NLU error analysis. Moreover, we propose a methodology to create an NLI hierarchical framework and applied a case study on Arabic NLU. Moreover, this paper introduces E-CONAN diagnostics dataset, a freely available dataset manually-annotated with coarse-grained and fine-grained categories based on our proposed Arabic hierarchy. E-CONAN dataset helps NLU designers better understand their models by doing error analysis and in-depth investigation. We used E-CONAN to investigate the performance of 9 pretrained language models and 5 LLMs. Results indicate that LLMs outperform pretrained models in world knowledge and commonsense reasoning macro-category, and underperform pretrained models in syntactic macro-category. Moreover, the hardest phenomena for all models is Reasoning, and the easiest phenomena for all pretrained models is Syntactic, and the easiest for LLMs is Lexico-Syntactic.

[340] Quizzing the Translation: A Prover-Grounded Evaluation Metric for NL$\rightarrow$FOL cs.CL | cs.AI | cs.LOPDF

Pu Suo, Ali Emami

TL;DR: SIV 用一阶逻辑定理证明器生成正向与对比探针，评估自然语言到一阶逻辑翻译是否丢失原意或加入过度断言。

Details

Motivation: 自然语言逻辑翻译中很小的量词错误就可能破坏后续推理，而 BLEU、BERTScore、Smatch++ 等表面相似指标有时会给错误更严重的翻译更高分。

Result: 在受控 FOLIO 扰动翻译集上，错误严重度解释 SIV 分数方差的 80%，既有指标最高仅 17%；六类错误的独立测试中，SIV 在超过 99% 的配对中给参考译文高于扰动版本。探针还生成带标签的错误轨迹，扰动类别宏 F1 为 0.638，近乎是只用总分的基线两倍；在 434 条专家审核翻译上取得最高 AUC，并能对词表外案例弃答。

Insight: 正向探针检查翻译是否保留必要内容，对比探针检查是否额外蕴含原文不支持的内容；两者由定理证明器验证。把“评估结果”与“错误类型”联系起来，使分数更敏感于逻辑错误而不是词面重合。

Abstract: A standard pipeline for symbolic reasoning over natural-language problems translates them into first-order logic and invokes a theorem prover. The translation step is the bottleneck: swap “every” for “some” and every inference that follows is corrupted. Yet today’s metrics often score more broken translations higher than less broken ones, because BLEU, BERTScore, and Smatch++ reward surface overlap that the worst errors happen to preserve. We introduce SIV, which derives two kinds of probes from the target formula and uses a theorem prover to verify the candidate translation against each. Positive probes are statements the candidate must entail, which detect translations that drop content; contrastive probes are statements the candidate must not entail, which detect translations that assert more than the original. On a controlled pool of perturbed FOLIO translations, the severity of the error accounts for 80% of SIV’s score variance, compared with at most 17% for any prior metric. Across six error classes on a disjoint pool, SIV scores the reference above the perturbed candidate in over 99% of pairs. Because each probe is labeled with what it tests, the failure pattern also supplies a labeled error trace, recovering the perturbation class at macro-F1 0.638, nearly double the score-only baseline. On 434 expert-audited real LLM translations, SIV attains the top AUC, uniquely detects and grades expert-labeled major errors, and abstains, rather than mis-scoring, on out-of-vocabulary translations.

[341] Safety Reconstructed: Generative Modeling via Masked Diffusion Builds Strong Safety Guardrails cs.CL | cs.AIPDF

Gert Lek, Abele Malan, Chaoyi Zhu, Pin-Yu Chen, Robert Birke

TL;DR: LLaDA-Guard 将安全分类改写为条件生成式解释任务，通过比较不同标签假设对文本的解释能力来判定安全类别，并自然支持 token 级风险定位。

Details

Motivation: 传统安全守卫只预测一个标签 token，监督集中在单点，容易依赖捷径特征、过度自信，并受安全证据在文本中位置影响。

Result: 在七个留出安全基准上，LLaDA-Guard 的平均排名领先所比较的判别式基线；ECE 为 0.0875，优于 Qwen3Guard 的 0.1384，且对无害但含危险表面线索的提示过度防御更少、审核回答时提示泄漏更少。生成式机制还可定位 token 风险，并在无需额外训练的安全改写流程中达到 60.7% 平均安全转换率。

Insight: 掩码扩散模型对被审核文本区域的所有 token 进行类别条件重建监督，而不只训练单一判定位置。安全改写结果属于论文报告的辅助能力，不意味着该方法对所有提示或风险类型都可可靠替代人工审查。

Abstract: Guard models are the last line of defense between a language model and a harmful output, yet their training objective is surprisingly narrow. Existing guards learn to predict a single verdict token from a conversational context, concentrating supervision on a single target. The consequences are structural: models latch onto shortcut features, are overconfident, and remain sensitive to where safety evidence appears in the sequence rather than its role in the full context. We propose a different framing. Rather than predicting a label from text, our LLaDA-Guard asks which label better explains the text: scoring the prompt or response under each label hypothesis and classifying based on their difference. This shifts supervision to every token in the moderated region, forcing the model to account for full content rather than its most discriminative fragments. We instantiate this idea with a masked diffusion language model, fine-tuning LLaDA-8B-Instruct with a class-conditional reconstruction objective using LoRA and requiring no architectural changes beyond the base model. LLaDA-Guard leads on average rank against discriminative baselines trained on stronger backbones across seven held-out safety benchmarks, while exhibiting substantially better confidence calibration (ECE 0.0875 vs. 0.1384 for Qwen3Guard), less over-defense on benign prompts with unsafe-looking cues, and less prompt leakage when moderating responses. Its generative nature further enables token-level risk localization as a natural byproduct, yielding a pipeline for rewriting unsafe prompts into safe equivalents without additional training and achieving a 60.7% average conversion-to-safe rate.

[342] Learning to Learn from Context: Synthetic Training from Perturbed Public Documents cs.CL | cs.AIPDF

Haoyi Wu, Yang Xiao, Yusong Sun, Wenyang Hui, Zhaokai Luo

TL;DR: 该工作从轻微改写的公开文档自动合成上下文学习数据，让学生模型训练从文档证据中推理，而不是只复述可能已在预训练中见过的材料。

Details

Motivation: 真实任务要求 LLM 从任务专属上下文学习，但人工标注昂贵；直接使用公开网页又可能因预训练记忆而奖励回忆而非上下文推理。

Result: 无需人工标注，流程从 3,500 份文档生成约 1 万条样本。Qwen3.6-35B-A3B 在 CL-bench 上经 SFT 从 13.7% 升至 22.8%，再经评分量规奖励强化学习升至 24.6%，接近超过万亿参数 Qwen3.8-2.4T 的 23.9%。长上下文理解、指令遵循和推理也有迁移提升，代码生成和知识表现基本不变。

Insight: 流程先改写文档，再生成依赖文档的问题与评分标准，仅保留确实需要文档信息作答的样本。这样以低成本构造对上下文有依赖的监督，但结果显示收益并未普遍迁移到代码或知识任务。

Abstract: Real-world tasks often require large language models (LLMs) to learn from complex task-specific context rather than pretrained parametric knowledge. This capability remains a weakness of LLMs, while human annotation for such task contexts is expensive and difficult to scale. Public high-quality documents are an abundant alternative, but much of the public web has already been consumed during pretraining: training on such documents naively would reward memorization rather than context learning. In this work, we attempt to make use of high-quality public documents with small perturbations and empirically find that LLMs can successfully generate context-dependent reasoning traces and answers, which are then used to train a student model. Specifically, we construct a synthesis pipeline that (i) rewrites source documents to reduce memorization risk, (ii) generates questions and rubrics that require reasoning over the document, (iii) answers the questions with the document as context, and (iv) admits only samples that genuinely depend on the document. Without any human annotators, our pipeline generates about 10k samples from 3.5k documents, and the resulting student model substantially improves the performance on CL-bench. SFT raises a Qwen3.6-35B-A3B student from 13.7% to 22.8%, and a subsequent rubric-reward RL stage reaches 24.6%, on CL-bench comparable with a frontier model of over a trillion parameters, Qwen3.8-2.4T (23.9%). We also observe a broad transfer of improvements to long-context understanding, instruction following, and reasoning, while code generation and knowledge remain mostly flat. We hope this work provides a reproducible and scalable way to improve the ability of LLMs to learn from context, and to facilitate further research on context-grounded reasoning.

[343] Closing the Cross-Dialect Gap: Query Plans as a Portable Interface in Text-to-SQL cs.CLPDF

Corentin Royer, Robin Oester, Yotam Perlitz, Yannick Metz, Andrea Giovannini

TL;DR: 该研究提出把 Text-to-SQL 的生成目标从特定数据库方言 SQL 改为方言无关关系代数查询计划，再由确定性编译器生成各后端 SQL。

Details

Motivation: 多数 Text-to-SQL 模型只用 SQLite 训练与评测，迁移到 PostgreSQL、MySQL、ClickHouse 等方言时准确率普遍下降，且规模扩大并未消除问题。

Result: 在 13 个从 3B 到前沿规模的模型上，查询计划监督几乎一致恢复跨方言可移植性；对强提示模型，在其原生方言上有小幅峰值准确率代价，而计划微调后该代价消失。匹配微调下，计划监督模型强于 SQL 监督模型。摘要未给出提升的具体百分点。

Insight: 将逻辑计划与数据库方言语法分离，可复用同一推理表示并交由编译器适配后端。作者还提出 MetricName 结果集比较器，区分语义错误与不同方言产生的无害结果差异。

Abstract: Text-to-SQL systems are typically trained and evaluated on a single dialect (SQLite), yet production deployments span PostgreSQL, MySQL, ClickHouse, and beyond. We show that this single-dialect assumption leads to a substantial drop in cross-dialect accuracy for every model we tested. The drop persists across scale, architecture, and even purpose-built text-to-SQL systems. We argue that the fix is to change the generation target: instead of asking an LLM to emit dialect-specific SQL, we have it emit a dialect-agnostic relational algebra query plan, which a deterministic compiler then renders into SQL for any supported backend. Across thirteen models from 3B to frontier scale, this restores cross-dialect portability nearly uniformly, at a small cost in peak accuracy on the model’s home dialect for capable prompted models and none once fine-tuned on plans; under matched fine-tuning, plan supervision yields a stronger model than SQL supervision. We also introduce MetricName, a question-aware result-set comparator needed to evaluate fairly across dialects, where existing metrics confound semantic errors with benign cross-dialect variation. More broadly, the result is a reminder that a generation target chosen for execution is not necessarily the one that maximizes generation quality.

[344] From Granular Revision Operations to Meaningful Revision Units: Evaluating LLMs for Revision Boundary Detection cs.CL | cs.AIPDF

Yu Tian, Andrew Potter, Katerina Christhilf, Motahareh Darvishpour Ahandani, Jessica Early

TL;DR: 该研究评估大语言模型能否把细粒度文本编辑操作合并为有意义的修订单元，发现一般提示不如简单邻近启发式，而任务微调可进一步提升。

Details

Motivation: 自动草稿差异工具会把一个有目的的修订切成多个操作，降低其用于写作学习分析的价值；研究检验 LLM 是否能恢复更完整的修订边界。

Result: 在 113 组本科生草稿—修订配对中，专家标注 4,344 个候选边界。零样本和少样本 GPT-5.5、基础 Qwen3-32B 均未超过邻近启发式的 Macro-F1 0.825；使用双上下文表征微调的 Qwen3-32B 达到 0.859，并在提高同一单元识别能力的同时保持与启发式相近的精确率。确定性后处理显著改善提示模型，对最佳微调模型帮助较小。

Insight: 这项任务要求理解多个细碎编辑是否属于同一意图，通用提示本身不足以取代透明的结构启发式；经过任务适配后，LLM 才提供增益。

Abstract: Revision traces provide valuable evidence about students’ writing processes, but their usefulness for learning analytics depends on how individual revisions are represented. Automated draft-comparison methods often produce granular edit operations that can fragment a single purposeful revision into multiple analytic units. This study evaluates whether LLMs can identify meaningful revision unit boundaries in structured revision operation data and whether they provide value beyond simple non-LLM baselines. Using 113 matched draft–revision pairs from undergraduate writing, expert annotation yielded 4,344 candidate boundaries. We compared zero- and few-shot GPT-5.5 and base Qwen3-32B, parameter-efficient fine-tuning of Qwen3-32B, and majority and proximity-based baselines. Despite receiving revision context and task instructions, no prompted LLM condition outperformed the proximity heuristic (macro-F1 = .825). In contrast, fine-tuned Qwen3-32B using the two context representation achieved the highest macro-F1 (.859), identifying more same-unit relationships while maintaining precision comparable to the heuristic. Deterministic post-processing substantially improved the prompted models but added little benefit to the strongest fine-tuned model. These findings suggest that LLMs can support revision boundary judgment when task-adapted, but general purpose prompting alone may not outperform transparent structural heuristics.

[345] Shared Experience, Separate Learning: Companion Confidence Calibration for LLMs cs.CLPDF

Shiyu Ni, Keping Bi, Jiafeng Guo, Yilong Xu, Jingtong Wu

TL;DR: CoCal 用与任务策略分离的轻量伴随模型学习推理模型置信度，使能力训练和置信度校准共享轨迹但采用独立参数与优化方式。

Details

Motivation: 推理模型常在答错时仍过度自信；已有并行校准方法把能力和置信度放在同一策略参数中通过强化学习训练，可能耦合两种性质不同的目标。

Result: 在 Qwen3-8B 和 Qwen3-14B 上，CoCal 提升置信度估计而不损害任务表现，并优于 RL 式并行方法及匹配的事后校准。伴随模型还可跨领域和策略变化泛化，两个模型规模上均观察到收益；摘要未提供具体校准指标。

Insight: 伴随模型读取 rollout 隐状态，以验证器提供的正确性标签训练，而主任务优化保持不变。共享数据轨迹使校准利用能力学习过程中的经验，参数隔离则减少对任务策略的干扰。

Abstract: Reliable self-assessment is essential for large language models (LLMs), yet they often remain highly confident when their answers are wrong. We study \emph{concurrent confidence calibration}, where confidence is learned alongside capability improvement rather than calibrated only after training. Reinforcement learning from verifiable rewards (RLVR) provides a natural setting for this paradigm, as it continuously produces responses paired with verifiable correctness feedback. Existing concurrent methods, however, learn both capability and confidence through reinforcement learning within shared policy parameters, potentially coupling two fundamentally different learning problems. We instead propose \emph{shared experience but separate learning}: capability and confidence learn from the same trajectories, but through separate optimization mechanisms and parameters. Based on this principle, we introduce \textbf{CoCal (Companion Confidence Calibration)}, which trains a lightweight companion from rollout hidden states and verifier-derived correctness supervision while leaving task optimization unchanged. Experiments on Qwen3-8B and Qwen3-14B show that CoCal improves confidence estimation without sacrificing task performance, outperforming both RL-based concurrent methods and matched post-hoc calibration. The learned companion further generalizes across domains and policy shifts, while the benefits of CoCal persist at both scales.

[346] Positions Are Not Facts: The Mismatch Between KV Caches and Memory cs.CL | cs.LGPDF

Changhai Zhou, Yuhua Zhou, Shiyang Zhang, Jun Gao, Zhen Li

TL;DR: 该研究分析将语言模型 KV 缓存用作可更新记忆时应如何处理被新事实替代的旧记录，指出只隐藏旧内容或在原位置重建状态都会损失不同类型的信息。

Details

Motivation: 事实更新时，隐藏旧记录虽然简单，但历史细节仍可能回答过去问题；彻底删除并重算缓存也可能改变后续推理所需的状态。

Result: 在数量任务中，八个模型经掩码后都更偏向新值，但六个会因单位错误或未能停止而丢失完整答案，保留单位可避免这些问题。多跳更新中，在相同位置重建状态使历史准确率下降 20–41 个百分点，而移动既有状态影响较小。自然文本上，文本检测器选出的掩码在 14 组同模型比较中未显示优于同率随机掩码。

Insight: 保留对象依赖与未变更的修订段落可减少信息损失；学习型读出能恢复固定缓存相似度漏掉的区分。查询依赖访问可避免部分问题，但需额外存储或访问成本，因此 KV 缓存不能简单等同于可随意编辑的文档记忆。

Abstract: When a fact changes, how should a language model update the history stored in its key-value (KV) cache? Hiding the old record is cheap, but it may still contain needed details or answer questions about the past. We compare hiding whole records, hiding only replaced values, and deleting old text and recomputing the cache. In a controlled quantity task, masking makes all eight models prefer the new value more strongly, yet six lose complete answers through unit errors or failure to stop; keeping the unit preserves all current answers. Later states also retain useful information from earlier records: on multi-hop updates, rebuilding these states at unchanged positions lowers historical accuracy by 20-41 percentage points, whereas moving the existing states has little effect. Keeping object dependencies and unchanged revision passages prevents many losses. Recognition is a separate challenge. Learned readouts recover distinctions missed by fixed cache similarities on synthetic record pairs. On natural text, text-detector-selected masks show no clear advantage over random masks at the same rate in 14 same-model detector-generator comparisons. Query-dependent access can avoid some losses, with additional storage or access costs. These findings identify what must be preserved beyond the replaced value when using a KV cache as updatable memory.

[347] On the Token Value Inequality in Efficient Reasoning cs.CL | cs.AIPDF

Runjia Zeng, Hang Hua, Yiyang Liu, Zhiqiang Tao, Ruixiang Tang

TL;DR: TokenProbe 以 token 级对数概率诊断思维链中的价值差异，并通过 GRPO 选择性压缩低价值冗余 token，目标是在准确率与推理长度间取得更好权衡。

Details

Motivation: 思维链显著提升复杂任务表现，却带来大量 token；并非每个 token 对最终答案贡献相同，需要区分决定性推理内容与低置信度的探索性填充。

Result: 作者报告方法保持推理质量的同时，token 使用量达到基线的 76%（摘要原文未明确该比例指剩余用量还是减少幅度）。在匹配推理长度预算下，方法甚至超过 Gemini-3.1-Pro 等旗舰基线；摘要未给出逐任务成绩。

Insight: 归一化 token 对数概率可作为核心 token 与冗余 token 的代理信号。论文将 token 价值不均、TokenProbe 对核心 token 的识别能力作为经验发现，并将通过压缩冗余 token 实现 Pareto 改善表述为 GRPO 优化主张。

Abstract: Chain-of-Thought reasoning has enabled large language models to achieve substantial performance gains on complex tasks. However, these gains come at the cost of dramatically increased token consumption. This raises a fundamental question: is every token in the reasoning trace equally valuable? We present a diagnostic and optimization framework grounded in a key empirical finding: the value of tokens within a CoT reasoning sequence is highly non-uniform, and this non-uniformity can be effectively characterized by token-level log probability signals. We show that normalized log probability helps distinguish core tokens, which carry structural and decisive reasoning content, from redundant tokens, which are exploratory, low-confidence filler that contributes less directly to the final answer. Building on these findings, we formulate the TokenProbe framework around two empirical findings and one claim: findings identify token value inequality first and then establish TokenProbe as a core-token proxy, and the claim introduces an efficient GRPO objective positing that selectively compressing redundant tokens can yield Pareto improvements in the accuracy-token efficiency space. Empirically, our method preserves reasoning quality while reducing the token usage by 76% of the baseline. Under matched reasoning-length budgets, we show that it can even outperform strong flagship baselines like Gemini-3.1-Pro. Homepage: https://runjia.tech/tokenprobe/.

[348] Beyond Solo and Consistency: Vindicating Multi-Agent Debate via Conditional Progressive Pruning cs.CLPDF

Ruosong Ye, Caiqi Zhang, Jiahao Li, Haijun Wu, Xiaolong Luo

TL;DR: CPP 是面向多智能体辩论的条件渐进剪枝框架，旨在相同严格成本预算下充分利用多轮讨论，改善传统辩论难以超过单模型或一致性采样的问题。

Details

Motivation: 既有 MAD 方法在严格相同推理成本限制下常无法超过强单智能体和一致性基线，使多轮讨论的实际价值受到质疑。

Result: 论文报告 CPP 在多个既有劣势基准上优于现有多智能体辩论框架，并首次全面超过一致性方法；摘要未给出基准名称、成本细节或提升数值。

Insight: 框架以轻量渐进剪枝控制辩论过程中的候选和交互开销，目标是在有限预算下保留有用交流并裁掉冗余路径。摘要未提供足够细节来判断剪枝规则及其适用范围。

Abstract: Large Language Model (LLM) based Multi-Agent Debate (MAD) is one of the most effective test time scaling techniques. Through multi-round communication, agents complement each other in knowledge and reasoning and solve tasks that no single member can solve. However, existing MAD frameworks fail to beat strong Single Agent and Consistency-based baselines under the same strict cost limit, which shakes the foundation of the MAD field. We propose Conditional Progressive Pruning (CPP), a lightweight pruning framework that fully exploits multi-round MAD. CPP outperforms all existing MAD frameworks on multiple dominated benchmarks. It is also the first to fully outperform consistency methods. Our code, detailed agent interaction records will be released soon.

[349] RewardExplainer: Learning Reward Model Explanations from Counterfactual Preference Feedback cs.CL | cs.LGPDF

Jingyi He, Nier Wu, Shuang Liu, Xin Wang, Mengnan Du

TL;DR: RewardExplainer 通过对回答做反事实改写并观察目标奖励模型反馈，迭代训练可复用的自然语言解释器，说明奖励分数依赖哪些具体行为。

Details

Motivation: 传统判别式奖励模型只输出标量，难以解释评分依据；现有解释方法通常依赖预设属性，并需对每个回答对反复干预验证，缺少利用反馈训练通用解释器的闭环。

Result: 在多个目标奖励模型和解释器骨干上的实验显示，RewardExplainer 持续改善解释效果；生成的评分机制还被用于发现潜在偏差、构造定向去偏数据，并提升奖励模型在奖励破解基准上的鲁棒性。摘要未提供量化数值。

Insight: 解释以开放式、原子化、可干预的自然语言机制表达，反事实反馈再转成偏好监督，促使解释器更贴近目标奖励模型的评分偏好与敏感行为。

Abstract: Reward models (RMs) are a key component of large language model post-training, providing reward signals for subsequent reinforcement learning. However, conventional discriminative RMs typically output only scalar scores, making it difficult to identify the response behaviors associated with their scoring decisions. Existing interpretation methods often rely on predefined high-level attributes and require repeated counterfactual interventions for each response pair to validate candidate explanations, lacking a closed-loop mechanism that uses RMs’ feedback to train a reusable explainer. To address this, we propose RewardExplainer, a framework that obtains feedback from the target reward model through counterfactual rewriting and uses this feedback to further optimize the explainer. RewardExplainer generates open-ended, atomic, and intervenable natural-language scoring mechanisms, making explanations more concrete, readable, and actionable. It further converts counterfactual feedback into preference supervision, enabling the explainer to more faithfully capture the target RM’s scoring preferences and sensitive behaviors than single-pass generation. Extensive experiments across multiple target RMs and explainer backbones show consistent improvements. Beyond interpretation, we use the generated mechanisms to identify potential bias patterns and construct targeted debiasing data for fine-tuning the reward model, improving robustness on reward-hacking benchmarks.

[350] Understanding Clinical Cognitive Dialogues Using Large Language Models cs.CLPDF

Vishalakshi Arumugam, Dan Schumacher, Veronica Rammouz, Enrique Gonzalez Guerrero, Jeremy Davis

TL;DR: 该研究发布由 33 段临床认知评估对话构成的去标识化语料，并评测 LLM 的细粒度对话行为分类和下一患者话语生成能力。

Details

Motivation: 认知评估既是测试，也是临床互动：医生会解释任务、修复误解并适应患者反应，患者也可能犹豫、澄清或退出。现有临床对话资源很少标注这些互动结构。

Result: 语料包含 8,250 句，标注三种说话者角色和 56 种对话行为。指令微调在患者话语参考匹配和分类准确率上表现最好；推理感知微调在 LLaMA-3.1-8B 变体中取得最佳分类结果。即便最佳模型仍难区分相近行为，摘要未给出具体分数。

Insight: 模型更容易识别宽泛对话意图，而不是细粒度沟通功能。作者将资源定位为支持后续对话标记、临床教学和经谨慎验证的模拟患者研究，不作诊断能力主张。

Abstract: In-person cognitive assessment is both a test and an interaction. Clinicians explain tasks, repair misunderstandings, and adapt to patient responses, while patients may hesitate, seek clarification, or disengage. Yet clinical dialogue resources rarely label the interaction structure needed to study these behaviors at scale. We present an de-identified corpus of 33 cognitive assessment conversations with 8,250 utterances annotated for three speaker roles and 56 dialogue acts. We use this corpus to benchmark large language models on fine-grained dialogue-act classification and next-patient-utterance generation. We also test whether out-of-domain instruction data and explanation-augmented training transfer to this clinical setting. Instruction tuning produces the strongest patient-utterance reference matching and improves classification accuracy. Reasoning-aware fine-tuning produces the strongest classification results among the LLaMA-3.1-8B variants. However, even the best models struggle to separate closely related dialogue acts, showing that broad conversational intent is easier to recognize than fine-grained communicative function. The corpus and benchmark make interaction structure measurable in cognitive assessments and support follow-up work on conversational markers, clinician education, and carefully validated simulated patients. This work does not make diagnostic claims. Instead, it provides the data and evaluation framework needed to study these applications.

[351] MAS-OPD: On-Policy Distillation for Multi-agent Systems cs.CLPDF

Qiyong Zhong, Mao Zheng, Mingyang Song, Houcheng Jiang, Jiajie Su

TL;DR: MAS-OPD 用 on-policy 蒸馏联合训练多智能体系统，通过角色优势形成分工，并将跨代理协作冲突的归因作为只提供给教师的特权信息。

Details

Motivation: 多智能体系统常靠推理时编排，但通用 API 成本高，较小模型仅靠角色提示也难形成稳定分工。团队级强化学习奖励又无法指出哪个代理的哪个步骤促成结果，逐任务设计局部奖励则成本高。

Result: 在代码和数学基准上，MAS-OPD 在两个学生规模下均取得最高平均分，并形成更清晰的角色专长和更有效的协作行为。摘要未列出具体基准成绩。

Insight: Role-Advantage Specialization 用目标角色与非目标角色条件下的教师信号差值定义角色优势；Privileged Attribution for Coordination 将交互冲突归因并仅提供给教师，监督学生时利用跨代理信息而不要求部署端拥有该特权信息。

Abstract: Multi-agent systems (MAS) split a task across specialized roles and are promising on complex tasks, yet a prevailing approach relies on inference-time orchestration alone. General-purpose APIs are costly and hard to customize, while small models with role prompts rarely develop stable role competence or reliable collaboration, so post-training a MAS jointly is central. Most attempts use reinforcement learning, whose team-level reward leaves undetermined which step of which agent brought about the outcome, while local rewards need redesigning per task. On-policy distillation (OPD) gives token-level teacher supervision on trajectories the student samples, a denser signal needing no local reward, yet is underexplored for the interdependent agents of a MAS. Two difficulties arise: building complementary specialization from a judgement of which role a behavior belongs to while preserving the knowledge all roles need, and turning cross-agent collaborative information into supervision OPD can exploit. We present MAS-OPD, where Role-Advantage Specialization defines the role advantage as the difference between the teacher signals under target and non-target role conditions, and Privileged Attribution for Coordination attributes an interaction conflict to its source and supplies it to the teacher alone as privileged information. Extensive experiments on code and mathematics benchmarks show that MAS-OPD attains the highest mean score at both student scales and leads the agents to develop clearer role specialization and more effective collaborative behavior.

[352] LLMs are not stochastic parrots: Evidence for meaning-mediated abstraction from conlang-like tasks cs.CL | cs.AIPDF

Julia Witte Zimmerman, Calla G. Beauregard, Tabia Tanzin Prama, Parisa Suchdev, Kathryn Cramer

TL;DR: 该研究用无示例的虚构语言规则任务检验 LLM 是否能依据含义抽象地遵循约束，而非只复用训练语料中的表面统计模式。

Details

Motivation: 强版本的“随机鹦鹉”观点认为 LLM 无法超越统计模式复用进入抽象或推理。研究构造与常见模式不符的类人工语言，要求模型只凭自然语言描述生成结果。

Result: 在三个互补任务族中，模型表现与提示语义所预测的方向一致：区分看到示例与遵循明确指令、按新约束调整语义关系，并在部分复杂翻译题上精确匹配答案。模型间表现有差异；摘要未给出总体准确率或模型列表细节。

Insight: 任务不提供示例输出，正确作答需要表示提示中规定的规则；结果支持语义中介的抽象能力存在，但作者也指出生成仍受表面合理性强烈约束。实验提供的是特定任务下的证据，而非对所有抽象能力的证明。

Abstract: The strong version of the stochastic parrot argument claims that, although large language models (LLMs) may exceed rote regurgitation, they cannot move beyond statistical pattern matching into abstraction or reasoning, remaining ontologically near the lower bound of pattern reuse despite producing alluringly fluent text. We test this hypothesis using conlang-like tasks. Several LLMs are given only natural-language descriptions of fictional languages that subvert prominent superficial patterns in training data by combining statistically uncommon and unattested features. Crucially, no example outputs are given. We argue that if the models exhibit rule-following behaviour, they cannot be relying solely on superficial statistical patterns; such patterns often work against the correct output. Instead, successful performance requires representations of the constraints specified in the prompt. Across three complementary task families, models systematically move in the meaning-predicted direction: they distinguish prompt exposure from instructed use, alter semantic relationships in response to novel constraints, and sometimes produce exact matches to complex translation answer keys. Although performance varies across the spectrum of models used, these results provide evidence for meaning-mediated abstraction in LLMs and refute the strong stochastic parrot hypothesis. Our work shows that, under appropriate architectural and contextual constraints, statistical learning can produce meaning-mediated abstractions, although generation remains strongly constrained by superficial plausibility. We discuss implications for model development and for understanding how increasingly abstract representations may emerge from plausible-text-generation objectives.

[353] USA: Update-aware SAM for Cross-domain On-Policy Disitllation of Language Agents cs.CLPDF

Qiyong Zhong, Mao Zheng, Mingyang Song, Huwei Ji, Houcheng Jiang

TL;DR: USA 根据短暂热身阶段观察到的参数更新幅度，为不同坐标设定扰动半径，缓解跨领域 on-policy 蒸馏合并模型任务向量时的负迁移。

Details

Motivation: 单领域蒸馏通常较早饱和，需要从其他领域补充监督；直接混合数据会产生分布冲突，独立蒸馏后合并任务向量则可能因不同领域反复更新相同坐标而抵消收益。

Result: 在数学、科学和代码三个领域、两种学生规模的六个迁移方向上，USA 均优于所比较方案，平均领先单领域参考超过 4 分，并逆转冲突领域对的负迁移。

Insight: 作者发现合并算子本身不能解决负迁移：冲突领域中每种评估算子都低于单领域模型。USA 将更新幅度转成逐参数扰动半径，专门降低承载大部分合并位移坐标处的曲率，使领域更新更可兼容。

Abstract: On-policy distillation instils multi-turn agentic reasoning through dense token-level supervision on the student’s own trajectories, but a single domain saturates early, so further supervision has to be drawn from other domains. Multi-domain data mixing is the most direct way of incorporating them, at the cost of conflicts between their data distributions and of retraining the entire model whenever one domain is revised. Model merging avoids both by distilling every domain independently and fusing the resulting task vectors afterwards. We find instead that the benefit polarizes across domain pairs: on those exhibiting negative transfer, every merging operator we evaluate falls below the single-domain reference. We attribute this to cross-domain update coupling, where a substantial fraction of coordinates is updated comparably by both domains and a merge can therefore displace them by as much as their own updates. To overcome this limitation, we propose USA, which converts per-parameter update magnitudes measured during a brief warm-up into per-coordinate perturbation radii, reducing curvature precisely on the coordinates that carry most of the merging displacement. Experiments across mathematics, science and code at two student scales show USA strongest in all six transfer directions, ahead of the single-domain reference by more than four points on average, and reverse the negative transfer of the conflicting pairs.

[354] SALMONN-duo: Adaptive Dual-System Coordination for Full-Duplex Voice Agents cs.CL | eess.ASPDF

Wenyi Yu, Siyin Wang, Terumi Chiba, Xianzhao Chen, Xiaohai Tian

TL;DR: SALMONN-duo 将全双工语音系统拆成持续在线的快速交互模型和异步慢速推理代理，并由前者判断何时委派复杂问题。

Details

Motivation: 实时语音交互要求低延迟，但工具调用和深度推理耗时且计算成本不确定，可能打断自然对话或破坏响应时序。

Result: 在单轮语音问答和多轮对话评测中，自适应委派提升知识密集及多跳推理问题准确率；知识边界感知训练减少不必要的慢系统调用。在定制 τ-Voice 环境任务中系统完成多轮、环境落地且受策略约束的业务任务；成本感知强化学习改善任务表现与后端使用的权衡，并提升成功率和响应安全性。摘要未报告具体指标。

Insight: System 1 在后台代理执行期间仍维持全双工对话，之后把结果自然整合回当前会话而不暴露工具轨迹或丢失上下文。双系统设计把实时性和复杂推理分工，委派率则可通过成本感知 RL 调节。

Abstract: Full-duplex speech large language models (LLMs) enable low-latency, natural voice interaction. However, real-world agents must also use tools and perform deliberative reasoning-operations whose variable latency and computational cost conflict with the stringent timing requirements of real-time conversation. To reconcile these demands, we propose SALMONN-duo, an adaptive dual-system voice agent inspired by dual-process theories of cognition. SALMONN-duo separates real-time interaction from deliberative computation by pairing an always-on, fast-thinking full-duplex speech LLM (system 1) with a powerful asynchronous slow-thinking LLM agent (system 2). Beyond handling real-time interaction, system 1 learns when to answer directly and when to delegate, remaining responsive during backend execution and seamlessly integrating returned information into the ongoing dialogue without exposing tool traces or losing conversational context. Evaluations on single-turn spoken question answering (QA) and multi-turn conversations demonstrate that adaptive delegation substantially improves accuracy on knowledge-intensive and multi-hop reasoning questions, while knowledge-boundary-aware training avoids unnecessary system 2 invocations. On a customized version of $τ$-Voice, SALMONN-duo further demonstrates its ability to complete environment-grounded, policy-constrained tasks through multi-turn interactions in realistic business scenarios. Finally, cost-aware reinforcement learning further enhances the trade-off between task performance and backend usage across the QA and conversation tasks, while improving task success and response safety on $τ$-Voice with an acceptable increase in the delegation rate.

[355] CRISP: Cultural Reward Modeling for Implicit Situated Propriety cs.CLPDF

Zekun Yuan, Yangfan Ye, Baohang Li, Shuaibo Zhao, Zekun Zhou

TL;DR: CRISP-RM 是面向开放式社会场景的文化适切性奖励模型，并用规范落地监督指导策略识别不同文化语境中的隐含行为规范。

Details

Motivation: LLM 正在不同国家和地区部署，但文化研究多聚焦知识问答或预定义选项，开放式、情境化行为的适切性仍相对缺乏。

Result: CRISP-RM 的 Best-of-N 结果持续优于强通用奖励模型；GRPO 策略优化中，CRISP-RM 通常改善文化情境行为，加入 NGS 后进一步提升。分析显示模型能超越表面流畅与礼貌区分适切行为。摘要没有列出数据规模或分数。

Insight: 多智能体协作流程把隐含文化规范实例化为社会场景，并构建 NormCompass 测试集；NGS 与奖励模型提供互补信号，使策略优化对相关规范更敏感。

Abstract: As large language models (LLMs) are increasingly deployed across countries and regions, the ability to recognize and respond appropriately to diverse cultural contexts becomes increasingly important. However, existing research has largely focused on cultural knowledge or tasks with predefined response spaces, while open-ended culturally situated behavior remains comparatively underexplored. In this work, we introduce CRISP-RM, a culturally situated reward model that assigns rewards according to cultural appropriateness in open-ended social scenarios. During policy optimization, we further introduce Norm Grounding Supervision (NGS), providing guidance that enhances the policy’s sensitivity to relevant cultural norms. To construct culturally situated data, we employ a collaborative multi-agent framework that instantiates implicit cultural norms into diverse social scenarios and further curate NormCompass as a dedicated testbed. We conduct comprehensive experiments to evaluate the effectiveness of CRISP-RM in both reward modeling and policy optimization. Best-of-(N) experiments show that CRISP-RM consistently outperforms strong general reward models. During GRPO policy optimization, CRISP-RM generally improves culturally situated behavior, while incorporating NGS yields further gains. Further analyses demonstrate the advantages of CRISP-RM in distinguishing culturally appropriate behavior beyond superficial fluency and politeness, while NGS provides complementary gains during policy optimization by improving norm grounding.

[356] Dr.Credit: Rubric-Grounded Process Credit Assignment for Deep Research Agents cs.CL | cs.AIPDF

Yingjian Zhu, Zhenyi Wang, Jiaxin Guo, Kun Ding, Ying Wang

TL;DR: Dr.Credit 用任务评分标准作为统一参照，为深度研究代理的中间工具调用分配过程奖励，区分新增支持证据与轨迹中已存在的重复证据。

Details

Motivation: 基于 rubric 的强化学习通常只给最终答案分数，不区分中间决策贡献；依赖标准答案的过程奖励又不适用于没有唯一答案的开放式研究任务。

Result: 在四个域内及域外基准上，Dr.Credit 在所有主要指标和子指标上超过所评开放深度研究基线；8B 骨干的平均表现与受测专有前沿模型相当。分析显示，在研究轮数有限时证据获取更高效、报告质量更好。摘要未给出具体分值。

Insight: 对每个评分项，工具返回的信息按其相对已接受证据历史所增加的支持量评估，并识别部分支持及冗余证据。过程优势与 GRPO 的结果优势结合，使代理决策和最终报告质量共同接受监督。

Abstract: Rubric-based tasks are increasingly addressed through reinforcement learning (RL), with rubric scores used as training rewards. However, these rewards typically supervise final answers without distinguishing the contributions of intermediate decisions. Many existing credit assignment methods rely on ground-truth answers to define process rewards, limiting their applicability to open-ended tasks without canonical solutions. To address this limitation, the proposed rubric-grounded credit uses task requirements as a shared reference for final answer evaluation and process supervision. The information returned by tools is assessed for the additional support it provides toward satisfying each rubric relative to that rubric’s history of accepted support. By referencing these histories, credit distinguishes new support from evidence already present in the trajectory while recognizing partial support for each rubric. Dr.Credit uses rubric-grounded credit to supervise intermediate tool turns in an RL framework for deep research agents. The resulting process advantages are combined with GRPO outcome advantages to guide research decisions while retaining supervision of final-report quality. Evaluations on four in-domain and out-of-domain benchmarks show that Dr.Credit outperforms the evaluated open deep research baselines on every primary metric and submetric. Meanwhile, with an 8B-parameter backbone, the trained agent achieves average performance competitive with the evaluated frontier proprietary models. Further analyses suggest more efficient evidence acquisition and higher-quality reports under limited research-turn budgets, motivating the extension of rubric-grounded process supervision to a broader range of rubric-based tasks.

[357] When Harness Beats Scale, and When Reading Beats Both cs.CL | cs.AI | cs.IRPDF

Ivan Bondarenko, Nikolay O. Nikitin

TL;DR: 该系统研究用混合检索、程序思维、知识图增强和自一致性处理文档定量推理，并发现系统架构、OCR 阅读质量对结果的影响可能大于单纯模型规模。

Details

Motivation: 文档语义推理系统在有标签验证集表现良好，面对扫描、带水印测试 PDF 却大幅下降；需要同时分析推理流程和输入可读性。

Result: 在验证集上，程序思维使 7B 模型联合准确率增加 0.282，但对 72B 模型最多只增加 0.005；完整流程的 27B 模型得分 0.884，匹配 72B 模型的 0.873，参数约少 2.7 倍、碳排约四分之一。扫描测试集上系统联合准确率仅 13.58%，排名 149/163；对验证集重渲染复现实验重现了 OCR 部分的崩塌。

Insight: 架构工具链可让较小模型更充分利用程序执行和结构化知识，但输入读取质量是前置瓶颈。作者认为评估材料的物理可读性应先于模型架构讨论，排行榜两极分化可能反映阅读质量差异。

Abstract: We describe our system for DocSem, the document-grounded quantitative reasoning shared task at DocInsights 2026, and analyze why it succeeded on labeled data and failed on the test set. The pipeline pairs hybrid block retrieval with Program-of-Thoughts (PoT) generation executed in a sandboxed interpreter, self-consistency sampling, and entity enrichment from chunk-level knowledge graphs. On our held-out split, application architecture moved the metrics far more than model scale did: PoT added 0.282 joint accuracy to a compact 7B model but at most 0.005 to a 72B model, and a 27B model with the full harness matched the 72B (0.884 vs.\ 0.873) at roughly 2.7$\times$ fewer parameters and a quarter of the CO$_2$. We read this through a distinction between world knowledge, which scales steeply with parameters, and language knowledge, which scales gently, and show that structured-output training makes a compact model harness-ready rather than merely small. On the raster, watermarked test PDFs the same system collapsed to 13.58% joint (rank 149 of 163); a controlled re-rendering of the validation set reproduces the OCR half of the collapse while bounding what the simulation misses. Auditing the physical nature of evaluation inputs precedes architecture, and the leaderboard’s bimodality is consistent with reading quality, not reasoning, having separated the field.

[358] Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillation cs.CL | cs.LGPDF

Yongliang Miao, Shuang Liu, Yanguang Liu, Yandong Bai, Mengnan Du

TL;DR: SparseOPD 先用教师的全词表校正量判断重要 token，再只对这些位置反向传播，以降低长序列 on-policy 蒸馏的显存而尽量保留全词表监督。

Details

Motivation: 完整词表校正能提供学生低概率 token 的关键纠正，但长序列反向传播成本高；抽样 token 或只选学生 TopK 虽节省内存，却引入抽样噪声或改变原始校正。

Result: 在数学、化学问答和多模态推理的六个任务—规模设置中，SparseOPD 平均准确率优于 Sampled Token 和 TopK，并匹配或超过 Full Vocabulary。4B 数学设置下梯度余弦相似度达到 99%；8K 全参数分析中反向传播显存降低 70.5%。

Insight: 方法先在不保留反向图的情况下计算完整教师校正，再按校正幅值而非学生概率选择 token；带符号残差补偿保持促进与抑制校正总量，预算感知分配则在位置间安排稀疏支持。

Abstract: On-policy distillation (OPD) uses teacher correction on student-generated responses. Full-vocabulary correction can provide important corrections even for tokens that the student assigns low probability, but backpropagating through all token logits becomes memory-intensive for long sequences. Existing memory-saving approaches estimate corrections from sampled tokens or restrict supervision to the student’s TopK tokens, introducing sampling noise or changing the full-vocabulary correction. We introduce \textbf{SparseOPD}, which uses full-vocabulary teacher correction to determine which corrections matter before selecting the token logits to differentiate. SparseOPD first constructs the full-vocabulary correction without retaining its backward graph, then selects tokens by correction magnitude rather than student probability. Signed residual compensation preserves the total promoting and suppressing correction mass, while correction-aware budget allocation distributes the sparse support across positions. Finally, the update backpropagates only through the selected token logits. Across six task–scale settings spanning mathematics, chemistry QA, and multimodal reasoning, SparseOPD outperforms Sampled Token and TopK in task-average accuracy and matches or exceeds Full Vocabulary. Gradient cosine similarity reaches 99% on 4B mathematics, while 8K full-parameter profiling shows 70.5% lower backward memory.

[359] Zero-Shot Cue-Grounded Topic Segmentation of Spoken Documents cs.CL | cs.AIPDF

Suhwan Choi, Myeongho Jeon, Myungjoo Kang

TL;DR: CGS 是无需任务监督的语音文档主题切分方法，优先定位明确提示新主题开始的词句，线索不足时再用语义切分。

Details

Motivation: 主题粒度会随文档变化，LLM 切分器可能把不同子主题合并，或把连贯主题过度分段；固定语义阈值难以利用显式转折线索。

Result: 在六个基准和六种 LLM 骨干上，CGS 持续优于已有基线，并能适应有噪 ASR 转写；在专有模型上 API 成本较低。摘要未提供具体指标和成本。

Insight: 主题提示短语的位置可直接作为边界；若线索不充分，则基于提取线索时推断出的文档结构回退到语义切分。两阶段策略把可解释的显式提示与一般语义变化结合起来。

Abstract: Topic segmentation structures spoken documents into coherent sections, facilitating navigation and downstream understanding. The appropriate granularity can vary substantially, ranging from broad thematic shifts to fine-grained subtopics. Existing LLM-based segmenters, however, often struggle to adapt to this variation, causing them to either merge distinct subtopics or over-segment coherent themes. To address this, we introduce Cue-Grounded Segmentation (CGS), a training-free framework that operates without any task-specific supervision. CGS first identifies phrases that explicitly signal the start of a new topic and uses their sentence positions as segment boundaries. When such cues are insufficient, it falls back to semantic segmentation, guided by the document structure inferred during cue extraction. Across six benchmarks and six LLM backbones, CGS consistently outperforms existing baselines, remains robust to noisy ASR transcripts, and achieves these gains with low API cost on proprietary models.

[360] Unbiased Top-$k$ Estimation for On-Policy Distillation cs.CL | cs.LG | stat.MLPDF

Linjian Meng, Siyuan Gan, YuHan Li, Xiran Wang, Ziyang Ding

TL;DR: TT-OPD 为 Top-k on-policy 蒸馏设计尾部校正，通过在选中高概率 token 之外加入学生实际采样 token，补偿截断词表遗漏的概率质量。

Details

Motivation: OPD 反向 KL 梯度可用学生采样 token 估计但监督有限，也可用全词表完整估计但计算昂贵；Top-k 折中丢弃尾部概率质量，因而引入偏差并可能降低准确率。

Result: 作者报告 TT-OPD 显著优于实验中的其他 OPD 变体；摘要未给出基准、模型规模或量化结果。

Insight: 在 Top-k 教师分布校正之外保留 rollout 中学生实际采样 token，可在期望意义下恢复被丢弃的概率质量，同时维持分布监督和较低成本，形成无偏的反向 KL 梯度估计。

Abstract: On-policy distillation (OPD) is becoming an important component of large language model (LLM) post-training for transferring the reasoning capability of a strong teacher LLM to a weaker student LLM. OPD trains the student by minimizing the reverse KL divergence between the teacher and the student via rollouts generated by the student’s policy. However, estimating the gradient of the reverse KL divergence in OPD remains a challenge. Using only the sampled token from the student-generated rollout is computationally cheap but provides limited distributional supervision, which will degrade accuracy. In addition, using the full vocabulary provides complete distributional supervision but is computationally expensive. Therefore, recent works propose Top-$k$ OPD (TK-OPD) that use selected top-$k$ tokens, which provides richer distributional supervision than sampled-token estimation at substantially lower computational cost than full-vocabulary estimation. Unfortunately, using only the selected top-$k$ tokens induces bias, leading to accuracy degradation, as the probability mass outside the selected top-$k$ tokens is discarded. To address the bias of TK-OPD, we propose Tail-Corrected Top-$k$ On-Policy Distillation (TT-OPD). It preserves the advantages of TK-OPD, including rich distributional supervision and low computational cost, while providing an unbiased estimator of the gradient of the reverse KL divergence. The key insight of TT-OPD is to use not only the selected top-$k$ tokens, but also the sampled token from the student-generated rollout, thereby recovering the discarded probability mass in expectation, avoiding the bias. Experimental results demonstrate that TT-OPD significantly outperforms other tested OPD variants.

[361] When Words Fall Short: Iterative Synergy Between Verbalized Reasoning and Hidden Features for LLM Confidence Estimation cs.CLPDF

Yekun Xu, Ante Wang, Jingyi Ren, Xuanyi Chen, Weizhi Ma

TL;DR: IPoET 交替更新置信度估计器和语言模型策略，让口头推理轨迹与隐藏表征中的置信度信号互补，并适应持续变化的策略分布。

Details

Motivation: 当前置信度研究常把口头自评视为优于独立估计器，但作者发现专用置信度估计器可能明显更准，且隐藏状态包含更丰富的置信信号。

Result: 在多个数据集及 Qwen、Llama 骨干上，IPoET 在域内持续优于估计器式和口头表达式基线，在域外所有指标上达到领先或相当表现。摘要未提供具体 ECE 或准确率数值。

Insight: 策略优化接收估计器置信反馈，估计器则在新策略生成的 rollout 上刷新训练，从而形成闭环交替适配；这利用隐藏特征同时避免置信度模型与不断变化的策略分布脱节。

Abstract: Confidence estimation is crucial for developing trustworthy large language models (LLMs), with most methods following estimator-based or verbalization-based paradigms. While recent research increasingly focuses on improving verbalized self-reports of confidence, we challenge the prevailing view that this approach surpasses independent confidence estimators. Our empirical study shows that a dedicated confidence estimator can substantially outperform verbalized confidence, indicating that LLMs’ internal representations contain richer confidence signals. Building on this finding, we propose Iterative Policy-Estimator Training (IPoET), a framework that synergizes the complementary strengths of verbalized reasoning traces and informative representations. IPoET alternates policy optimization with estimator updating, integrating estimator-derived confidence feedback into policy learning and refreshing the estimator on new policy rollouts. Experiments across diverse datasets and Qwen and Llama backbones demonstrate that, by iteratively exploiting richer hidden features and adapting to the evolving policy distribution, IPoET consistently outperforms both estimator- and verbalization-based baselines in-domain and achieves superior or comparable results across all out-of-domain metrics. For more details, refer to https://github.com/xyk829/ipoet.

[362] RGDT-Bench: Benchmarking LLM Reasoning for Rule-Governed Decisions and Their Justifications cs.CLPDF

Jianpeng Zhao, Haihua Xu, Haoyang Zhang, Shuang Qian, Yixiang Tang

TL;DR: RGDT-Bench 评估语言模型在规则治理决策任务中是否不仅给出正确结论，还能提供完整、可核验且与规则依据一致的理由。

Details

Motivation: 政策、合同和合规任务除演绎能力外，还要求解释规则适用性、从证据判断条件、处理例外并组合判断；标准数学或逻辑基准难衡量理由是否充分。

Result: 基准含四个任务轨道、八种信息探测组合和 202.1K 条件级监督槽位。六个模型可评正确答案中，理由不完整率平均为 40.2%；17 种现有评估器中最佳任务平均 AUROC 仅 57.69%。带理由完整性监督的简单奖励模型达到 69.24%，比匹配结果监督基线高 10.37 点，比现有最佳评估器高 11.55 点。

Insight: 基准从规则使用、条件判断、证据和聚合四层归因失败，并用标签盲抽取和确定性检查生成依据完整性标签。依据监督不仅更能检测正确答案中的理由缺口，也改善了几乎所有回答选择比较。

Abstract: We study reasoning in Rule-Governed Decision Tasks (RGDTs), where models apply external rules to case facts and justify decisions, as required in policy, contract, and compliance settings. Beyond the deductive capability emphasized by standard mathematical and logical reasoning tasks, RGDTs require interpreting rules and their applicability, assessing conditions from evidence, combining judgments under rules and exceptions, and providing checkable justifications. These demands motivate a benchmark assessing both decisions and their stated grounds. We introduce RGDT-Bench, providing 202.1K condition-level supervision slots across four task tracks and eight supported task-probe combinations that vary access to supporting information. Label-blind extraction and deterministic checks produce labels for warrant completeness: source-referenced coverage and consistency of stated decision grounds. The benchmark attributes failures to four process layers: rule use, condition, evidence, and aggregation, and checks the final outcome. Among evaluable correct responses, warrant incompleteness averages 40.2% across six evaluated LLMs and supported task-probe combinations. Such warrant incompleteness poses potential safety risks and remains difficult to detect: the best of seventeen existing evaluators reaches only 57.69% (random: 50%) task-averaged area under the receiver operating characteristic curve (AUROC). To address this difficulty, we train a simple reward model with warrant supervision. It achieves 69.24% task-averaged AUROC among correct answers, exceeding the matched outcome-supervised baseline by 10.37 pp (percentage points) and the best existing evaluator by 11.55 pp. Beyond completeness assessment, the model outperforms both outcome-supervised baselines across nearly all response-selection comparisons, supporting RGDT-Bench’s warrant supervision for RGDT reasoning.

[363] Rewarding Novel Deductions: Solver-guided Process Rewards for Logical Reasoning cs.CLPDF

Muhammad Asif Ali, Wenqing Wang, Huan Wang, Mohammad Raza

TL;DR: SPRING 使用 SMT 求解器在训练时验证中间逻辑推理步骤，并奖励既有效、与当前状态一致又能带来新推论的步骤。

Details

Motivation: 只优化最终答案正确性对推理过程监督有限，小模型更容易产生矛盾、重复或脆弱轨迹；逻辑任务需要持续跟踪约束并确保每步推论一致。

Result: 在 ZebraLogic、AR-LSAT 和 Knights and Knaves 三个基准、四个模型上，SPRING 持续优于基础模型、仅结果奖励基线和 Logic-LM。ZebraLogic 上谜题准确率最高比基础模型高 49.71 点、比最强结果奖励基线高 15.43 点；AR-LSAT 总准确率相应高 64.93 和 12.14 点；Knights and Knaves 上谜题准确率最高 93.14、人物准确率 96.05。

Insight: 求解器判定某步是否逻辑有效、符合演进状态且未被既有无矛盾推论蕴含；奖励鼓励新推理进展，惩罚矛盾与无信息步骤，使优化目标从只看终点扩展到推理过程质量。

Abstract: Logical reasoning remains a major challenge for large language models (LLMs), particularly on structured problems that require precise constraint tracking, consistency preservation, and multi-step deduction. This challenge is especially acute for small-scale LLMs, which are more prone to producing inconsistent, redundant, or brittle reasoning trajectories. Existing approaches for improving logical reasoning largely optimize for final-answer correctness, providing only weak supervision over the intermediate reasoning process. In this work, we propose SPRING: (Solver-guided Process Rewards for Novel LogIcal ReasoNing Step Generation). SPRING uses SMT solver as a training-time verifier of intermediate reasoning steps to provide process-level supervision. It introduces the notion of a novel reasoning step, namely, a step that is logically valid, consistent with the evolving reasoning state, and not already implied by previously accepted non-contradictory deductions. Based on this solver-based assessment, it designs process rewards that encourage novel inferential progress while penalizing contradictory and uninformative reasoning steps. Evaluation across three logical reasoning benchmarks, ZebraLogic, AR-LSAT, and Knights and Knaves, and four LLMs shows that SPRING consistently outperforms base LLMs, outcome-only reward baselines, and Logic-LM. On ZebraLogic, SPRING improves puzzle accuracy by up to 49.71 and 15.43 points over the base LLM and strongest outcome-only baseline, respectively. On AR-LSAT, it improves overall accuracy by up to 64.93 and 12.14 points, respectively. On Knights and Knaves, SPRING achieves up to 93.14 puzzle accuracy and 96.05 person accuracy.

[364] Beyond Token Alignment: Event Completion for Cross-Tokenizer On-Policy Distillation cs.CL | cs.AIPDF

Jiacheng Liu, Jingwei Song, Qituan Zhang, Siheng Chen, Linfeng Zhang

TL;DR: ESCD 为不同 tokenizer 间的 on-policy 蒸馏增加“事件完成”监督，把学生可用的多种 token 后续补全按字节兼容集合汇总，而非强行对齐单个 token。

Details

Motivation: 一个教师 token 可能由多个学生 token 表达，学生生成到前缀后已进入但尚未完成该词事件；教师指定所需文本完成内容，却不指定多个等价学生 token 应如何分配概率。

Result: 作者报告该方法在不同模型家族的数学、代码和科学推理中持续提升，并扩展到 1T 教师向 35B 学生的大规模 MoE 蒸馏。所研究 tokenizer 对中，进入事件后的兼容完成集合覆盖了超过 99% 的观察到教师质量。摘要未给出具体基准分数。

Insight: ESCD 聚合前缀相关教师事件，对字节兼容的单步学生补全概率总量进行监督，避免 tokenizer 选择造成的等价 token 概率拆分偏差；复用现有学生轨迹和预测，无需额外 rollout 或修改词表。

Abstract: On-policy distillation (OPD) transfers knowledge between language models through teacher supervision on student-generated trajectories. With different tokenizers, a single teacher token may require multiple student tokens to generate, creating intermediate states where the event is entered but not yet completed. Existing cross-tokenizer methods align tokens or text spans to construct comparable prediction targets. We study a complementary problem after partial generation: once the student produces a prefix of a teacher token, multiple next tokens may complete the same remaining bytes, but the teacher only specifies the required completion rather than how probability should be divided among these valid continuations. We introduce Event-Set Completion Distillation (ESCD), which complements cross-tokenizer probability alignment with completion-set supervision. ESCD aggregates prefix-related teacher events and supervises the total probability of byte-compatible one-step student completions, avoiding tokenizer-dependent probability splits among individual tokens. The method reuses student trajectories and predictions, requiring neither additional rollouts nor changes to the student vocabulary. Experiments demonstrate consistent gains in mathematics, code, and scientific reasoning across model families and tokenizers, extending to large-scale MoE distillation from a 1T teacher to a 35B student. Local analyses show that retaining completion sets better matches the reference supervision, while one-step completion covers over 99% of observed compatible teacher mass after partial event entry in the studied tokenizer pairs. These findings support event entry and event completion as complementary supervision targets for cross-tokenizer knowledge transfer. Code will be released on GitHub.

[365] Draft-KV: Learning Useful Latent Communication Between Language Models cs.CLPDF

Linquan Wu, Shichang Meng, Tianxiang Jiang, Haoyu Yang, Peng Zhong

TL;DR: Draft-KV 将共享者在当前问题上生成草稿时形成的 KV 状态投影到接收者可读的侧记忆，使模型间隐状态通信更确实承载问题相关信息。

Details

Motivation: 隐状态通信提高接收模型准确率，并不意味着接收者真正使用了消息内容；实验发现把消息换成其他问题的消息，准确率最多只降 0.60 点，即使通信比接收者单独答题提高 15.44 点。

Result: Qwen3-8B 共享者与冻结 Qwen2.5-0.5B-Instruct 接收者组合，在 MMLU-Redux 达到 78.04%，远高于接收者单独的 37.45% 和错配消息的 36.40%。共享者从 0.6B 扩至 8B 时，固定接口准确率从 46.11% 升至 78.04%；通信可迁移到留出任务，当两个模型掌握互补证据时甚至超过各自单独表现。接口仅需训练 1.05M 参数，比 C2C 少 348 倍。

Insight: 草稿 KV 通过线性投影写入侧记忆，再由门控注意力读取；渐进训练从消息重建转向答案监督，并约束错配消息造成的损害。两端模型保持冻结，关键改进在于传递与当前问题绑定的中间状态。

Abstract: Latent communication passes internal states between language models instead of decoded text, but higher receiver accuracy does not show that the receiver used the message content. Across five method-dataset pairs, replacing each message with one from an unrelated question changes accuracy by at most 0.60 points, even when communication adds 15.44 points over the receiver alone. Thus the interface can supply the gain while making the sharer dispensable. Draft-KV instead sends the key-value states formed while the sharer drafts an answer to the current question. Linear projections place these states in a side memory read through a gated attention branch, and progressive training moves from message reconstruction to answer supervision under a guard on harm from mismatched messages. Both models remain frozen and the interface trains 1.05M parameters, 348x fewer than C2C. With a Qwen3-8B sharer, a frozen Qwen2.5-0.5B-Instruct receiver reaches 78.04% on MMLU-Redux, versus 37.45% alone and 36.40% with reassigned messages. At fixed interface size, scaling the sharer from 0.6B to 8B raises accuracy from 46.11% to 78.04%; communication also transfers to held-out tasks and can exceed both models when each holds different evidence.

[366] LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual Puzzles cs.CL | cs.AIPDF

Bingo Zhang, Haochuan Lu, Zongjie Li, Genjian Li, Ari Yu Zhang

TL;DR: LongPuzzleBench 用 114 个长程 GUI 视觉谜题关卡检验代理在数百至上千步相互制约的操作中，能否为未来保留可行路径。

Details

Motivation: 现有基准分别评估定位、电脑使用或游戏，却较少检验代理能否在长决策链中保持连贯；某个看似推进目标的合法动作可能让数步后的谜题无解。

Result: 基准覆盖六类谜题，部分目标人类可需超过千步且死局不提示。仅用原生 GUI 操作时，最强代理虽能解决多数目标，但在更难关卡表现骤降：十个通用代理中七个连 Medium 以上都无法解，所有代理都未能完成 Bolt Unscrew Hard，而人类可完成全部目标。代码执行型电脑使用接口也未弥补差距。

Insight: 受控诊断显示，规则提示、状态提示和失败记忆都无法消除核心限制：代理按当前可见进展评价动作，却不考虑动作之后还剩多少可行选项。

Abstract: GUI agents need long-horizon visual reasoning: they must interpret a changing interface while keeping a multi-step plan viable as earlier actions constrain later ones. Existing benchmarks evaluate grounding, computer use, and game play, but rarely test whether agents stay coherent across long chains of coupled decisions. Long-horizon visual puzzles expose this capability directly: a legal move that looks like progress can make the puzzle unsolvable, and the loss shows only several moves later. We introduce LongPuzzleBench, 114 levels in six puzzle games played through native GUI actions, where one objective can take a human over a thousand actions on persistent boards and dead ends go unannounced. With Native GUI Actions alone, the strongest agents solve most objectives, but success falls sharply on harder, longer boards: seven of ten general-purpose agents solve nothing harder than Medium, and none completes Bolt Unscrew Hard, which a human solves along with every other objective. Code Execution CUA does not close this gap, and its scores mix visual solving with algorithmic search. Controlled diagnostics trace these failures to one limitation that neither rules, state hints, nor failure memory removes: agents judge each move by the visible progress it makes, not by the future options it leaves.

[367] InfiMed2: A Generalist Medical Multimodal Foundation Model from Contextual Evidence and Stability-Aware Supervision cs.CL | cs.CVPDF

Guanghao Zhu, Zeyu Liu, Zhitian Hou, Pengkai Wang, Zhijie Sang

TL;DR: InfiMed2 是 4B 和 27B 通用医学多模态模型系列，通过分阶段语料设计、证据聚焦的持续预训练和稳定性约束回答监督提升医学问答能力。

Details

Motivation: 医学语料结构、粒度和信息密度差异很大，适用性会随训练从广泛知识获取转向后期巩固而变化；短视觉问答主导的后训练又难监督信息丰富且与答案一致的解释。

Result: 作者整理 55.68B token 语料，先适配视觉编码器、再学习广泛医学知识、最后在学习率衰减阶段转向证据密集数据。4B 模型经 RLVR 后在五个医学多模态基准平均准确率为 66.73%，超过更大的 Qwen3.5-9B；27B 模型为 73.72%，是受评开源权重模型中最高。

Insight: SFT 阶段用答案稳定性、答案遮罩重建和正确性约束选择来重生成视觉问答回答，使监督更丰富且答案一致；数据设计按训练阶段调整，而不是整个过程固定混合。

Abstract: Recent medical multimodal models have benefited from larger corpora, broader modality coverage, and stronger reasoning-oriented training, yet effective data design across continued pretraining (CPT) and post-training remains challenging. Medical sources vary substantially in structure, granularity, and information density, and their utility shifts as training progresses from broad knowledge acquisition to late-stage consolidation. Meanwhile, post-training is often dominated by short-form visual question answering, providing limited supervision for informative and answer-consistent explanations. We introduce InfiMed2, a family of 4B and 27B generalist medical multimodal foundation models built around stage-aware data design. We curate a 55.68B-token corpus that combines broad clinical knowledge with context-rich biomedical visual evidence through source-specific processing. Our CPT pipeline first adapts the vision encoder, then builds broad medical knowledge, and finally transitions to an evidence-focused data mixture during learning-rate decay. For supervised fine-tuning (SFT), we regenerate visual question-answering responses using answer stability, answer-masked reconstruction, and correctness-constrained selection to produce more informative and answer-consistent supervision. The 4B model is further optimized with reinforcement learning with verifiable rewards (RLVR). Across five medical multimodal benchmarks, InfiMed2-4B achieves 66.73% mean accuracy after RLVR, surpassing the larger Qwen3.5-9B, while InfiMed2-27B reaches 73.72%, the highest among the evaluated open-weight models.

[368] Pass or Fail? Evaluating LLMs on Two Greek Examination Benchmarks cs.CLPDF

Panagiota Kyriazi, Eleni Kasoura, Prokopis Prokopidis

TL;DR: Prot-Ex 和 Pan-Ex 是希腊语学校入学考试与全国大学入学考试题库，用于评测不同语言模型在多学科和多种题型上的希腊语能力。

Details

Motivation: 希腊语可用的综合模型基准较少，难评估本地适配模型在语言、分析能力及提示形式变化下的表现。

Result: 本地适配的 KriKri-8B-Instruct 显著优于其基础模型，并在语言要求较高的人文学科任务上可与参数更多的模型竞争。LLM-as-a-Judge 分析显示，传统词面指标不足以评价复杂推理；少样本示例虽能改善封闭题，却会让 8B 模型的结构化任务上下文过载并明显退化。

Insight: 定向语言适配可以弥补模型规模劣势，但较小模型对冗长提示更加脆弱；评测基准涵盖现代希腊语、数学、物理等学科，以及封闭、结构化、开放题和文本化图像语境。

Abstract: The rapid advancement of Large Language Models (LLMs) imposes a thorough evaluation of their linguistic and analytical capabilities as well as constraints, particularly for a language with limited benchmark coverage such as Greek. To address the limited availability of comprehensive benchmarks in this domain, we introduce Prot-Ex and Pan-Ex, two benchmarks consisting of questions from entrance exams for Greek Model and Experimental schools as well as the Panhellenic exams (the Greek national university entrance examinations). These benchmarks are employed to assess the performance of text-only LLMs-including the Greek-adapted KriKri-8B-Instruct, Llama-3.1-8B, Gemma-4-26B, and Qwen-3-32B-across diverse academic disciplines (Modern Greek, Mathematics, Physics, etc.) and task formats (closed, structured, and open-ended), including textualized visual context (i.e., image descriptions). Our findings indicate the localized KriKri-8B significantly outperforms its base model, successfully rivalling much larger LLMs in linguistically demanding humanities tasks. By leveraging an LLM-as-a-Judge methodology, we expose the inadequacy of traditional lexical metrics for evaluating complex reasoning. Crucially, we uncover a few-shot prompting paradox: while synthetic examples improve accuracy in closed-ended questions, they severely overload the context window of 8B models in structured tasks, causing significant performance degradation. Ultimately, this study suggests targeted linguistic adaptation offsets lower parameter counts in specialized domains, despite the fragility of smaller models to prompt verbosity.

[369] Semantic Uncertainty Quantification Needs Factual Equivalence cs.CL | cs.AIPDF

Joseph Hoche, Quentin Guimard, Gianni Franchi

TL;DR: 该研究发现语义不确定性估计的核心瓶颈通常是答案比较器能否识别同题答案的事实等价性，而非如何汇总成对相似度。

Details

Motivation: 常见语义不确定性方法从多次采样答案的一致程度估计不确定性，但往往直接采用现成 NLI 模型或通用句向量作为比较器，可能无法准确判断多个答案是否表达同一事实。

Result: 用与评测任务隔离的合成数据训练单一事实对比编码器后，接入既有方法，在 18 个模型—数据组合、126 个评估设置中的 120 项（95%）得到提升。最佳变体平均 AUROC 为 0.76，最强基线为 0.68；相较基于 entailment 的交叉编码器，每个答案只需一次编码。该算子还改善单次生成的 token 级置信度估计。

Insight: 该比较器单独抽取问题所针对的事实，结果支持“比较算子而非聚合器”才是多数语义不确定性方法的限制。其 token 分数还可估计各 token 对答案事实的承载程度，并据此重加权对数似然。

Abstract: Semantic uncertainty quantification for large language models rests on a common template: sample several answers, measure how much they agree, and treat disagreement as uncertainty. We first formalize this template as two separate roles: an operator that compares two answers, and an aggregator that combines all pairwise comparisons into a scalar. Existing methods differ almost entirely in how they aggregate, while taking the operator off the shelf, typically an NLI model or a generic sentence encoder. We show that this reliance on off-the-shelf operators is the primary bottleneck of semantic UQ: they do not accurately measure factual equivalence of multiple answers to the same question. We resolve this with a deliberately simple recipe: a single encoder trained contrastively to isolate the targeted fact, utilizing synthetic data generated by an LLM and dataset both disjoint from all evaluation settings. Integrating the resulting operator into existing methods improves performance on 120 of 126 evaluation settings (95%) spanning 18 model dataset combinations across language and vision-language models. The best variant reaches 0.76 mean AUROC against 0.68 for the strongest baseline, while replacing the quadratic cross-encoder comparisons of entailment-based operators with one encoder pass per answer. The uniformity of the improvement supports the view that the operator, not the aggregator, is the limiting factor. The same operator also improves single generation token-level estimators: the norm it assigns to each token measures how much that token bears on the answer, and reweighting token log-likelihoods accordingly sharpens the estimate.

[370] Nürnberg NLP at ChildSafeAds 2026: Structurally Dissimilar Voter Ensembles under Four Levels of Data Access cs.CL | cs.LGPDF

Philipp Steigerwald, Eric Rudolph, Jens Albrecht

TL;DR: 该系统为 ChildSafeAds 2026 竞赛构建由九个投票器组成的分任务集成，并按可用数据访问级别组织成三条不同骨干、适配方式和类别范围的分支。

Details

Motivation: 监测面向儿童的 YouTube 商业内容时，系统可获得的数据访问程度不同；需要比较在各访问条件下检测品类与合规问题的表现。

Result: 系统在三个子任务中赢得两个：商品类别 ST2 得分 0.8243、合规标记 ST3 得分 0.6530，均为 22 个最终提交中最高；总任务均分 0.7079，排名第三。摘要称报告了四种访问级别和测试集规模下的成本。

Insight: 集成选择基于按频道隔离的交叉验证，并以开发集检查迁移；对儿童内容监测而言，访问数据的限制和系统成本需要与分类得分一起报告。

Abstract: We describe the Nürnberg NLP system for ChildSafeAds 2026. The shared task asks what a monitoring system for commercial content in child-facing YouTube videos can achieve at a given level of data access. We answer with per-subtask ensembles of nine voters, organised into three branches that differ in backbone, adaptation method and class scope. Selection rests on channel-disjoint cross-validation, with the development set as a transfer check. The system wins two of the three subtasks. Its product-category score (ST2, 0.8243) and its compliance-flag score (ST3, 0.6530) are the best of the 22 final entries, and it places third on the task mean (0.7079). We further compare four access levels and report the cost at test-set scale.

[371] When Confidence Rises Too Early: Detecting Shortcut Reasoning via Premature Answer Commitment cs.CLPDF

Zhaohan Zhang, Junjie Liu, Chengzhengxu Li, Chen Shen, Xiaoming Liu

TL;DR: ConfLens 通过追踪推理过程中模型对最终答案的置信度演化检测捷径推理，并提出无需标准答案或任务专用验证器的分布式承诺分数 DACS。

Details

Motivation: 模型可能先依靠捷径得出结论，再生成看似连贯的思维链进行事后合理化；只检查文字轨迹或最终答案难发现这种不忠实推理。

Result: 在三类捷径推理设置中，捷径样本常在推理早期就对最终答案形成过高置信。DACS 使捷径检测 F1 比强基线高超过 4.3%，并减少奖励模型偏好中忠实性与正确性不匹配的现象；摘要未提供各项完整分数。

Insight: DACS 根据每一步模型在答案承诺上的概率分布熵衡量信念集中程度，反映置信在生成过程中的变化。检测结果还可转为奖励模型可解释信号，抑制对捷径轨迹的偏好。

Abstract: The reasoning trajectory of a Large Language Model (LLM) is often treated as a verbalized description of its internal reasoning. However, such trajectories can be unfaithful: a model may rely on shortcuts to reach an answer and then post-rationalize the decision with a seemingly coherent chain of thought. Detecting this shortcut reasoning is challenging because existing monitors and verifiers mainly inspect textual traces or final outcomes, rather than how the model’s belief in its answer develops during generation. We introduce ConfLens, a framework that tracks the evolution of confidence in the final answer throughout reasoning. Across three shortcut reasoning settings, we observe a common pattern of premature confidence, where shortcut samples become highly confident in the final answer at early reasoning stages. Existing confidence estimation methods, however, show limited generalizability, reliability, or efficiency for detecting this behavior. We therefore propose the Distributional Answer Commitment Score (DACS), a distributional confidence estimator that measures the entropy of the model’s probability distribution over answer commitment at each reasoning step. DACS captures how concentrated the model’s answer belief is without requiring ground-truth answers or task-specific verifiers. We further convert ConfLens detection results into interpretable signals for reward models to reduce their preference for shortcut reasoning. Experiments on mathematical and code reasoning tasks show that ConfLens with DACS improves shortcut reasoning detection by over 4.3% F1 compared with strong baselines and reduces the mismatch between faithfulness and correctness in reward model preferences.

[372] Understanding On-Policy Distillation: A Mechanistic Interpretability Perspective via Sparse Crosscoders cs.CLPDF

Zichao Yu, Qianshuo Ye, Xu Wang, Difan Zou

TL;DR: 该研究用稀疏跨编码器分析 on-policy 蒸馏改变了学生哪些内部特征，并提出 swap readout 追踪同一学生在蒸馏前后的特征使用变化。

Details

Motivation: OPD 常被认为把教师知识传给学生，但学生内部表征到底获得什么仍不清楚；标准跨编码器虽能识别模型间共享或特有特征，却难表示特征使用方式如何随训练改变。

Result: 在三个 OPD 设置中，OPD 既未创造新特征，也未传递教师自身特征；学生常用特征中超过 98% 的激活率变化在 20% 以内。教师 rollout 的 SFT 热身则会重加权对话格式、推理风格和数学符号等已有共享特征，其影响经 OPD 后仍保留。把此类重加权施加到直接蒸馏学生特征（不改权重），准确率接近热身学生；对打乱特征则无此效果。

Insight: 结果支持 OPD 主要教学生重新使用已有共享特征，而非获取新表征。swap readout 对每个学生检查点各自特征激活做读取，因此能分析未参与跨编码器训练的检查点。

Abstract: On-policy distillation (OPD) is a widely adopted post-training technique for LLM reasoning. It is commonly believed to transfer knowledge from a stronger teacher, yet what OPD actually distills into the student’s internal representations remains unclear. We study this question with sparse crosscoders, which learn one feature dictionary shared by the student before and after OPD and the teacher. Standard crosscoder analyses, however, identify model-specific features but cannot tell how a model’s use of its features changes, since all models are encoded into one set of feature activations. We therefore propose the swap readout, which reads each student checkpoint’s feature activations on its own, measuring how training changes the student’s use of each feature, even for checkpoints unseen by the crosscoder. Across three OPD settings, we find that OPD neither creates features nor passes on the teacher’s own, and leaves the firing rates of over 98% of the student’s frequently used features within 20%. We further examine the SFT warm-up on the teacher’s rollouts that commonly precedes OPD and makes it more effective. Rather than adding features, the warm-up reweights the shared ones in two ways. First, it already raises and lowers many of the features that OPD later raises and lowers, doing part of OPD’s work in advance. Second, it changes features that OPD alone would not, notably those for conversation format, reasoning style, and mathematical notation, and these changes persist through OPD. Imposing this reweighting on a directly distilled student’s features, without changing its weights, brings its accuracy close to that of the warmed-up student, whereas the same change on shuffled features does not. Together, these findings suggest that OPD reweights existing features rather than acquiring new ones: the student learns from the teacher how to use the features they already share.

[373] Rubric-Aware On-Policy Self-Distillation for LLM Personalization cs.CLPDF

Yilun Qiu, Xiaoyan Zhao, Chengbing Wang, Cilin Yan, Rui Zu

TL;DR: GRASP 将用户个性化评分标准转为 token 级 on-policy 自蒸馏监督，让无评分标准的学生沿自身轨迹向获得用户偏好说明的教师学习。

Details

Motivation: 用户特定评分标准可以明确个性化回答应涵盖什么，但现有方法通常只用标准预测相关方面，或将覆盖情况压成单一回答级奖励，未告诉模型具体如何生成满足偏好的表达。

Result: 在 LaMP-QA 个性化问答基准上，GRASP 在多个骨干模型上取得论文报告的最先进表现。摘要未列出具体分数。

Insight: 学生生成 on-policy 轨迹，接收教师在额外看到用户评分标准时的下一 token 分布指导；Rubric-based Teacher Validation 只保留对目标方面覆盖充分的样本，提升监督质量并减少训练浪费。

Abstract: LLM personalization aims to generate responses aligned with individual users’ preferences and needs. User-specific rubrics make these expectations explicit, providing direct supervision on what a satisfactory answer should cover. Existing rubric-guided approaches, however, exploit such guidance only at a coarse granularity, either by using rubrics to supervise the prediction of relevant aspects for subsequent generation or by reducing aspect coverage to a single response-level reward for reinforcement learning. This leaves a gap between specifying what a personalized answer should contain and teaching the model how to generate it. To bridge this gap, we propose GRASP, a rubric-aware on-policy self-distillation framework for LLM personalization that turns user-specific rubric aspects into fine-grained, token-level supervision. Specifically, GRASP pairs a rubric-free student with a rubric-informed teacher that additionally receives the target user-specific rubrics. By aligning their next-token distributions along on-policy trajectories generated by the student, GRASP transfers the teacher’s rubric-conditioned guidance into the student, translating user-specific semantic requirements into dense token-level supervision. Since rubric-informed teachers can still produce inadequate supervision, we further introduce Rubric-based Teacher Validation (RTV), which retains only instances where the teacher sufficiently covers the target aspects, improving both supervision quality and training efficiency. Experiments on the LaMP-QA benchmark for personalized question answering demonstrate that GRASP achieves state-of-the-art performance across multiple backbones, supporting the effectiveness of rubric-guided token-level supervision for personalization. To ensure reproducibility, our code is available at https://github.com/SnowCharmQ/GRASP.

[374] When Words Speak Louder than Images: Towards Understanding Language Bias in Vision-Language Models cs.CLPDF

Yizhou Fang, Siyue Chen, Zimo Qi, Zhiyu Xue, Xi Chen

TL;DR: 该研究提出四阶段诊断框架，追踪语言先验与跨模态覆盖如何在 VLM 推理过程中交互并导致模型过度依赖文字、忽略视觉证据。

Details

Motivation: VLM 可能优先使用语言线索而非图像证据，但黑盒推理使语言偏差传播路径难追踪，既有研究因此对成因和缓解方法有不一致结论。

Result: 作者基于词语补全任务提出分阶段诊断流程，分析语言模型诱发的统计先验及语言线索覆盖视觉内容的程度如何逐步作用并产生错误预测。摘要聚焦机制框架，未提供具体模型或量化结果。

Insight: 将推理拆成四个相互关联阶段，分别检查语言先验强度和跨模态覆盖变化，可把最终错误定位到偏差传播过程，而不是仅以输出端准确率判断模型是否看图。

Abstract: Despite substantial progress across downstream applications, vision-language models (VLMs) remain susceptible to language bias, often prioritizing linguistic cues over visual evidence and consequently producing incorrect predictions. Prior studies have proposed various approaches to understanding and mitigating language bias in VLMs, yet their findings often conflict due to the difficulty of tracing how language bias propagates within black-box VLMs. Building on the word completion task, we trace how language bias propagates through VLM inference by (1) proposing a diagnostic framework that decomposes the inference process into four distinct yet interdependent stages to trace the propagation of language bias; and (2) examining how two key factors underlying language bias, i.e., linguistic priors and cross-modal coverage, evolve across these stages and ultimately give rise to incorrect predictions. The linguistic prior captures the strength of statistical bias induced by the language model component of a VLM and represents the origin of language bias, whereas cross-modal coverage measures the extent to which linguistic cues cover the visual content. By decomposing inference into four stages and characterizing the interplay between linguistic priors and cross-modal coverage across these stages, we propose a systematic framework for tracing the propagation of language bias throughout the inference process; and uncover the underlying mechanism of language bias by revealing the interplay between linguistic priors and cross-modal coverage.

[375] MemoReason: Evaluating the Effect of Parametric Memory on Contextual Reasoning in LLMs cs.CLPDF

Zineddine Tighidet, Andrea Mogini, Jiali Mei, Patrick Gallinari, Benjamin Piwowarski

TL;DR: MemoReason 用真实事实问题及结构相同、实体替换为虚构名称的问题配对，量化语言模型参数记忆对上下文推理的影响。

Details

Motivation: 推理基准高分可能来自模型记住真实实体及答案，而非真正按上下文执行推理。研究区分一般熟悉度偏差与直接跳过推理、回忆事实答案的强参数捷径假设。

Result: 近期 LLM 在虚构实体版本上的表现最多下降 15.7%，且下降具有统计显著性，显示参数记忆影响推理；但对虚构版本失败的问题进行分析后，模型很少直接给出对应事实问题的记忆答案，说明直接参数捷径不是主要错误模式。

Insight: 系统性替换人物、公司或日期，同时保留任务结构和推理操作，使熟悉度成为可控变量。结果表明参数记忆影响上下文推理的机制比简单回忆更复杂。

Abstract: Large Language Models (LLMs) perform well on reasoning benchmarks, but it remains unclear whether this reflects genuine contextual reasoning or reliance on facts memorized in their parameters. We investigate this by distinguishing two possibilities: a broad \textit{memorization bias}, where familiar content improves reasoning performance, and the \textit{Strong Parametric Shortcut Hypothesis}, where models skip reasoning entirely and recall stored answers. To test these effects, we introduce \textbf{MemoReason}, a human-curated benchmark that pairs factual reasoning tasks with structurally identical \fictitiousterm{} versions where real entities like people, companies, or dates are systematically replaced by \fictitiousterm{} ones of the same type. This \scorerevision{preserves task structure and specified reasoning operations} while varying the familiarity of the context, allowing controlled measurement of how the parametric memory affects reasoning. \revision{Our evaluation of recent LLMs reveals consistent and statistically significant performance drops of up to 15.7% in the fictitious setting, demonstrating a clear memorization bias.} However, a targeted analysis of \revision{questions failed in the fictitious setting} shows that models rarely respond with the corresponding factual answer, indicating that direct parametric shortcuts are not the dominant failure mode. These findings suggest that parametric memory influences reasoning through mechanisms more complex than simple factual recall. \textbf{MemoReason} provides a controlled framework for studying these mechanisms and for extending paired factual-fictitious{} evaluation to broader reasoning settings.

[376] Multilinguality in Hybrid Attention LLMs cs.CL | cs.AIPDF

Lucas Bandarkar, Junlin Hu, Chenyuan Yang, Mohsen Fayyaz, Nanyun Peng

TL;DR: 该研究分析混合注意力语言模型的跨语言表示，发现跨语言对齐常在首个全注意力层附近上升，并表明调整循环层与全注意力层顺序可加速多语言蒸馏。

Details

Motivation: 混合注意力通过结合全注意力和递归结构支持长上下文，但递归状态的归纳偏置可能改变多语言信息处理，特别是对 token 化不佳语言的长文本能力。

Result: 可解释性分析发现跨语言表示模式与递归层和全注意力层顺序相关，首个全注意力层附近出现明显对齐峰值。多语言蒸馏实验中，所有替代层排序在整个训练期间均优于标准顺序，学习速度最高快 2.5 倍。

Insight: 作者据此提出，多语言模型可能受益于先使用全注意力层、再使用递归层；这是由表示分析和蒸馏实验支持的架构假设，摘要未报告多种语言的逐项差异。

Abstract: In response to the growing demand for long sequences in agentic and reasoning use cases, many state-of-the-art LLMs combine multiple variants of attention to mitigate the quadratic complexity of traditional softmax attention. These hybrid attention LLMs aim to balance the strengths and limitations of full attention and alternatives based on recurrence. This work presents a first study of how hybrid attention impacts the multilinguality of LLMs. Beyond the impact on long sequences in poorly tokenized languages, our study is motivated by the possibility that the inductive biases of the recurrent state alter linguistic processing. Our interpretability analysis confirms this, showing that cross-lingual representations in hybrid models develop in patterns tied to the ordering of recurrent and full-attention layers. Across diverse models, we notably observe a pronounced spike in cross-lingual alignment around the first full-attention layer. These findings lead us to question the conventional ordering of attention layers. In distillation experiments on multilingual data, all alternative layer orderings outperform the standard throughout training, learning up to 2.5X faster. These stark, replicable results prompt our theory that multilingual models would benefit from starting with a full-attention layer rather than recurrent layers.

[377] AwarenessBench: Assessing Cognitive Capabilities of Language Models cs.CL | cs.AIPDF

Xiaojian Li, Rongwu Xu, Tianyun Zhang, Yue Wang, Shuo Chen

TL;DR: AwarenessBench 从元认知、自我意识、社会意识和情境意识四个维度评估语言模型的认知相关能力。

Details

Motivation: 语言模型呈现越来越复杂的类认知行为，需要综合基准区分不同意识功能，而不应把一般语言或推理能力直接视作认知能力。

Result: 基准含 15 种认知功能、14,381 个样本；评估 18 个先进模型后，所有模型均超过随机基线，较先进模型总体表现更好。最佳模型总体超过三类人口组的人类平均水平，但多数模型在元认知和自我意识上仍明显落后。

Insight: 分析显示意识相关表现是独立能力，语言建模或推理能力进步并不必然带来认知评估能力同步提升。

Abstract: As language models (LMs) exhibit increasingly consciousness-like behaviors, evaluating their cognitive abilities becomes essential. We introduce AwarenessBench, the first comprehensive benchmark for assessing the cognitive abilities of LMs in four dimensions: metacognition, self-awareness, social awareness, and situational awareness, covering 15 cognitive functions and 14,381 samples. Evaluating 18 state-of-the-art LMs, we find that all consistently surpass random baselines, with more advanced models performing better. We further compare LMs with human performance across three demographic groups, where the best-performing model surpasses human averages overall, but most still fall markedly short in metacognition and self-awareness. Finally, we show that awareness is a distinct capability: progress in language modeling or reasoning does not necessarily translate into improved cognition.

[378] AraDynFact: Dynamic Evaluation of Factual Knowledge in Arabic cs.CLPDF

Ignacio Iacobacci, Faroq Altam, Zhaozhi Qian, Muhammad Alqurishi

TL;DR: AraDynFact 是面向阿拉伯语事实知识的动态评测框架，可自动从阿拉伯语维基百科抽取事实并生成可回答问题，评估模型的知识覆盖与文化语境理解。

Details

Motivation: 现有阿拉伯语评测常关注翻译或通用推理，较少覆盖历史、社会和地区差异；人工构建基准成本较高且更新慢。

Result: 作者用 AraDynFact 评估阿拉伯语专用及高资源通用大模型，并发现其结果与现有人工构造的阿拉伯语基准高度相关，支持动态生成方法作为高效补充。摘要未提供模型逐项分数。

Insight: 从知识源自动生成问题并持续更新，可降低人工编题负担；与手工基准的相关性为动态评测的效度提供初步证据，但不能替代文化专家对敏感语境的核验。

Abstract: As Large Language Models (LLMs) continue to scale both in size and capabilities, their proficiency in the Arabic Language has seen significant advancement. However, a critical gap remains: the extent of their factual knowledge and cultural sensitivity to the diverse Arabic-speaking world remains largely underexplored. Current evaluation metrics often focus on translation or generic reasoning, failing to capture the rich historical, social, and regional nuances inherent to Arabic culture. In addition, most benchmarks rely on heavy work, with human intervention in some steps, making the evaluation of knowledge coverage expensive and slow. To address this deficiency, we introduce AraDynFact, a novel dynamic evaluation framework designed to rigorously assess the factual Arabic knowledge embedded in LLMs. Unlike static benchmarks, AraDynFact employs a dynamic approach to extract factual information and generate rich and answerable questions in a fast and automatic way. We apply AraDynFact to Arabic Wikipedia and audit the performance of several state-of-the-art models, ranging from Arabic-centric specialized LLMs to high-resource general purpose LLMs. In addition we found a high degree of correlation with existing, hand-crafted Arabic-centric benchmarks, confirming the potential of our dynamic approach.

[379] Spontaneous Context Restoration: How Language Models Recover from Corrupted Inputs cs.CL | cs.AIPDF

Pranjal Garg, Jacob Beck

TL;DR: 该研究分析模型在删除、替换或拼写错误等输入损坏下如何自发恢复上下文，并发现这种修复可在未经过损坏训练的模型中出现。

Details

Motivation: 语言模型有时能从受损输入中输出正确结果，但内部如何定位损坏并恢复信息尚不清楚，影响对其鲁棒性及失败预警的理解。

Result: 研究覆盖注意力专用 Transformer 和五个 1B–32B 预训练模型，在算术、阅读理解和多选推理上观察到两阶段修复：早层定位与受损位置关联的影响，后层经残差流累积并集中到输出位置。仅使用损坏提示首层隐藏状态的线性探针预测失败，平均 ROC-AUC 为 0.78；中等损坏微调可提高容错，并降低沿损坏方向归一化的线性化误差。

Insight: 在干净序列上训练的注意力模型也会出现上下文恢复，说明修复行为不必依赖显式去噪目标。更接近线性的损坏响应与更强鲁棒性相关；探针还可用于匹配或部分分布偏移场景下的失败分流。

Abstract: Language models sometimes produce correct outputs even when their inputs are corrupted by deletion, replacement, or misspelling. We study the internal processes accompanying this behavior, which we call context restoration, in controlled attention-only transformers and five pretrained LLMs (1B-32B parameters) across arithmetic, reading comprehension, and multiple-choice reasoning tasks. In the attention-only transformers, restoration emerges spontaneously despite training exclusively on clean sequences, without corruption training or an explicit denoising objective. We find that context restoration follows a two-phase process: early layers localize effects associated with repair at corrupted positions, while later layers accumulate these effects at uncorrupted positions through the residual stream and ultimately concentrate them at the output position. Repair outcome is predictable from hidden states: cosine alignment with the clean state is highly predictive in attention-only models, while linear probes recover additional information in pretrained LLMs. A linear probe using only the corrupted prompt’s first-block hidden state predicts failure with mean ROC-AUC 0.78. This enables failure triage under matched or even partially shifted deployment conditions and may reduce unnecessary verification or computation. Failed examples also show substantially greater nonlinearity along corruption directions. Moderate-corruption finetuning increases corruption tolerance while simultaneously reducing displacement-normalized linearization error, associating improved robustness with a more nearly linear response to corruption.

[380] Who Is Left of Whom? Tracing Spatial Evidence and Role Binding in Relative-Position Reasoning cs.CL | cs.CVPDF

Yingjin Song, Denis Paperno, Albert Gatt

TL;DR: 该研究追踪相对位置推理中对象位置和查询角色的内部表示，发现两者沿分层过程逐步形成，并可通过定向激活干预提升配对一致性。

Details

Motivation: 模型在单个样例上准确率高，仍可能在交换对象位置或反转查询角色后给出不一致结果；支撑左右关系等相对空间判断的内部机制尚不明确。

Result: 在三个 VLM、视觉或文本输入及其语言骨干上，激活修补显示表示从早期源对象信息，经中间查询对象表示，发展到后期答案状态。干预源侧表示会改变对象位置提及并最终影响关系预测；从合成场景估计的角色方向可迁移到自然图像基准，在多数设置中无需重训即可提升准确率及两类配对一致性。

Insight: 相对位置推理同时依赖输入中的对象位置跟踪和查询中的角色绑定；单独掌握位置关系不足以保证交换对象或问题措辞后答案稳定。

Abstract: High instance-level accuracy can mask inconsistencies in spatial reasoning when objects exchange positions or their roles are reversed in the query. The internal representations supporting relative-position reasoning remain poorly understood. We investigate two complementary components of this process: tracking object locations in the input and representing their query roles. Across three VLMs with visual or textual inputs and their language-model backbones, activation patching reveals a staged progression from early-layer source representations through intermediate-layer query-object representations to late-layer answer states. Targeted interventions further establish causal links along this progression: manipulating source-side representations shifts location information at query-object mentions and ultimately alters relation predictions. Beyond object-location information, we also identify a stable query-side direction associated with the roles of the two objects in the comparison. Steering along directions estimated on synthetic scenes generalizes to natural-image benchmarks, improving accuracy and both forms of paired consistency in most settings without retraining. Our findings reveal complementary components of relational reasoning across visual and textual settings and show how targeted interventions can improve the consistency of models’ behavior.

[381] Beyond Token Scale: Chunk-Level Sparse Autoencoders for Reliable Semantic Feature Discovery cs.CL | cs.AI | cs.LGPDF

Xu Wang, Yifan Yang, TingHao YU, Difan Zou

TL;DR: 该工作提出均值块、跨块和联合块稀疏自编码器，以连续 token 片段而非单 token 为编码单位，促使模型特征更多表达语义概念而非词形细节。

Details

Motivation: 稀疏自编码器能揭示并控制语言模型特征，但重建准确并不保证特征有解释价值；token 级目标会让词汇和格式细节竞争有限稀疏预算。

Result: 匹配训练数据的实验显示，块级 SAE 仍保有解释能力，并能学习高层语义特征、对相关内容选择性响应。Mean-Chunk 更利于发现高层概念、检测超越表面线索的推理并进行 steering；Cross-Chunk 更擅长文档检索和分类迁移，特征也更具选择性和持久性。摘要未提供具体数值。

Insight: 将 SAE 的观察与预测单位从单词扩到连续片段，可分别检验较大观察范围的作用，以及跨段共享信息预测的作用；两种设计优势互补，而非单一结构全面占优。

Abstract: Sparse autoencoders (SAEs) expose features that help us understand and steer language models, but faithful reconstruction does not guarantee informative concepts. Token-level objectives reward lexical and formatting details alongside semantic content, all competing for a limited sparse budget. We introduce a family of chunk-level SAEs that encode mean-pooled activations over chunks, each a contiguous span of tokens: Mean-Chunk reconstructs the observed chunk, Cross-Chunk predicts an independently processed neighbor, and Joint-Chunk combines both targets. These designs separate the effect of a larger observation unit from that of predicting information shared across passages. With matched training data, chunk-level SAEs remain powerful interpretability tools while learning reliable semantic features that capture high-level concepts and respond selectively to relevant content. Their strengths are complementary: Mean-Chunk improves high-level feature discovery, reasoning detection beyond surface cues, and steering; Cross-Chunk leads document retrieval and classification transfer while producing selective, persistent features. Changing what an SAE sees and predicts yields reliable semantic features for more meaningful tasks. We demonstrate their practical value through gains across downstream tasks such as retrieval, reasoning detection, and steering.

[382] Can LLMs Value the Right Evidence? Evidence-Value Misalignment in Dynamic Medical Diagnosis cs.CLPDF

Kehua Feng, Yunsheng Lu, Yitong Qiao, Tiantian He, Lei Liu

TL;DR: MedEVM 评估动态医学诊断中模型的证据价值对齐：模型是否在证据充分时提交诊断、证据不足时继续等待，而非仅看最终答案是否碰巧正确。

Details

Motivation: 依据不足或误导性证据作出的正确诊断仍可能造成临床风险，单纯结果准确率会奖励幸运猜测，也无法揭示证据顺序和误导信息的影响。

Result: MedEVM 包含 24 个疾病系统的 1,050 个病例，证据逐轮到达。在 9 个 LLM 中，诊断时机常与证据充分性不匹配；同一证据重排会改变诊断，即使模型置信度相近，已足够证据后加入误导信息仍会影响选择。EVD-Harness 在五个模型上提升准确率 12.0–51.1 个百分点，并缓解证据—价值错配失败。

Insight: EVD-Harness 将诊断生成与提交分开，以离线对比诊断知识库和在线观察管理、提案/证据验证、提交控制三个阶段，防止模型在证据尚未充分时过早定案。

Abstract: A correct diagnosis reached from insufficient or misleading evidence can pose a clinical hazard, yet outcome-based accuracy may reward such lucky guesses. We call this mismatch between diagnostic decisions and the value of available evidence Evidence-Value Misalignment (EVM). To disentangle evidential grounding independently from diagnostic accuracy, we introduce MedEVM, a dynamic benchmarking environment comprising 1,050 cases across 24 disease systems. Observations arrive turn by turn, requiring models to continuously calibrate its decision by deciding whether to wait for more evidence or submit a diagnosis. Across 9 LLMs, four interesting patterns are observed. (1) Miscalibrated evidence tracking. Making a diagnosis often fails to calibrate evidence sufficiency, even in more capable models, and even worsens in reasoning mode. (2) Misaligned diagnosis submission. Confidence in the correct diagnosis often fails to ensure timely submission despite sufficient evidence. (3) Evidence order matters. Reordering the same evidence changes diagnoses even when model confidence remains similar. (4) Misleading evidence remains influential. Added misleading evidence redirects diagnoses even after prior evidence becomes sufficient. We further verify that EVM predicts errors and that preventing premature submission improves accuracy. These findings motivate Evidence-Verified Diagnosis Harness (EVD-Harness). It decouples diagnosis generation from submission through an offline Contrastive Diagnostic Wiki and three online control stages, namely observation management, proposal and witness verification, and diagnosis submission control. Across five LLMs, EVD-Harness improves accuracy by 12.0–51.1 percentage points while mitigating EVM-related failures. Our results demonstrate that verifying evidential support before submission can make diagnostic decisions more reliable.

[383] Rubric Rewards from Item Response Theory cs.CLPDF

Milad Yazdani, Yaser Souri, Xiren Zhou, Pranit Chawla, Dena Shahriari

TL;DR: Rubric Response Theory 将开放式回答的评分标准判定视为潜在整体质量的题目反应模型，在线估计每项标准的区分度并自适应挑选要评分的标准。

Details

Motivation: 开放式任务缺少可自动核验的唯一答案，常把各标准得分直接相加；不同判定模式可能得到同一奖励，固定权重也不反映标准在当前 rollout 中的辨别力，而且逐项评审成本随标准数增长。

Result: Qwen3.5-4B 在医疗、科学、Rubrics as Rewards Science 和 RubricBench 上的宏观标准分数平均比 GRPO 高 1.7 点；医疗和科学中的困难及极困难标准高 2.8–5.6 点。只用一半标准预算、冻结响应参数网络并做自适应 Fisher 选择时，四数据集宏分与全量评审 GRPO 相差不超过 0.1 点。

Insight: RRT 以两参数 IRT 似然从整组标准判定推断 rubric 特定的标量质量，并通过读取问题和标准文本的响应参数网络预测难度、区分度；在线 EM 随策略分布更新参数。该模型让标准筛选与评分使用同一潜在质量结构。

Abstract: Many language tasks have no single answer that can be checked automatically. Rubrics provide criteria for judging responses to these tasks. For reinforcement learning, the resulting verdicts must be combined into a scalar reward. A common approach sums the points assigned to satisfied criteria. Distinct verdict patterns can thus receive the same reward, and the fixed points encode how much each criterion should count, not how strongly its verdict distinguishes the current rollouts. Beyond this aggregation problem, judging the full rubric needs more judge requests as the criterion count grows. To address these limitations, Rubric Response Theory (RRT) measures quality and selects criteria when rubric criteria are monotone indicators of a shared target. Rather than adding assigned points, RRT uses a two parameter item response model that treats the verdict pattern as evidence about scalar quality specific to the rubric. Under this model, its likelihood score maximizes the local signal-to-noise ratio for quality. Its Response Parameter Network (RPN) reads the prompt and criterion text to predict criterion difficulty and discrimination. As the policy distribution changes during training, RRT uses online expectation maximization to update the RPN from current rollout verdicts. With Qwen3.5-4B as the policy, RRT’s macro criterion score across Medical, Science, Rubrics as Rewards Science, and RubricBench is 1.7 points above that of group relative policy optimization (GRPO). On hard and very hard criteria in Medical and Science, RRT gains 2.8 to 5.6 points over GRPO. At half the criterion budget, adaptive Fisher selection with a frozen RPN keeps the macro criterion score across four datasets within 0.1 points of GRPO with full judging. These results show RRT can reduce judge requests while remaining competitive with GRPO.

[384] Harness Learning Enables Generalizable Test-Time Adaptation cs.CL | cs.LGPDF

Alvin Zhang, Xuecheng Liu, Zixuan Wang, Fahim Tajwar, Daman Arora

TL;DR: 该研究将 agent harness 视为可执行程序，通过任务执行反馈训练提案模型修改工作流，让语言模型代理在测试时迭代改进工具调用和信息流，而不更新参数。

Details

Motivation: 不同任务需要不同的模型调用与工具组织方式；固定 harness 难以适配新任务，而逐任务人工修改成本高。

Result: 推理和多跳问答实验显示，harness learning 提升了修改质量，并能把测试时适配迁移到未见任务。按单轮修改训练的策略可在多轮持续改进工作流；用修改序列训练的收益则随设置变化。摘要未给出具体分数。

Insight: 将工作流修订视为类似梯度更新的元学习过程：强化学习训练提案模型，根据新任务连续执行结果提出下一轮程序改动，测试时不做参数空间更新。

Abstract: A language-model agent is jointly defined by its model and its harness, the executable program that organizes model calls, tool use, and information flow. Because different tasks call for different ways of organizing these operations, the harness needs to be adapted using feedback from the task at hand. We introduce harness learning, which trains a proposer model to revise a solver’s harness using execution feedback. We formulate this process as meta-learning over executable programs, with harness revisions playing the role of weight updates in gradient-based adaptation. We train the proposer with reinforcement learning, using the task performance of revised harnesses as the reward. At test time, the proposer uses feedback from successive executions on a new task to refine the harness, without performing any parameter-space update. Experiments on reasoning and multi-hop question answering show that harness learning improves revision quality and that the ability to adapt at test time transfers to unseen tasks. Policies trained on individual revisions can continue improving harnesses over multiple rounds, while the benefits of training on revision sequences vary across settings. These findings suggest a path towards continually learning agents that turn accumulated experience into generalizable improvements.

[385] Improving Test-Time Scaling with Adaptive Looped Transformers cs.CL | cs.LGPDF

Yichen You, Tianyu Fu, Aosong Feng, Xingtai Lv, Xuefei Ning

TL;DR: TaH2 让循环 Transformer 按 token 自适应决定是否增加内部层迭代，把额外 test-time compute 投给真正受益的 token。

Details

Motivation: 循环 Transformer 的准确率—计算增长斜率可能更高，却常在相同计算预算下落后非循环模型；固定深度循环会给每个 token 都花额外计算，而许多 token 并不需要。

Result: 在 AIME 基准上，TaH2 的准确率—计算斜率比非循环基线高 53%（2.74 对 1.79），匹配测试时计算时峰值准确率高约 3.4 点。最大迭代深度从 2 增至 8 时，领先幅度从 2.8 点增至 3.9 点，而既有循环模型趋于平台。

Insight: 模型与迭代决策器联合后训练，使用在线标签判断继续迭代是否改善预测，并据此分配每个 token 的循环深度，实现比固定额外迭代更有效的测试时扩展。

Abstract: Looped transformers have demonstrated promising parameter efficiency by reusing layers for latent computation. Prior studies compare looped and non-looped models at matched parameters or per-token FLOPs. However, to the best of our knowledge, whether looping improves test-time scaling as outputs grow longer remains underexplored. Through post-training looped transformers, we study the accuracy-compute slope, measured as the accuracy gain per doubling of test-time decoding FLOPs. We find that existing looped transformers often yield steeper slopes than their non-looped baseline, yet underperform it at matched compute. While fixed-depth looping spends extra iterations on every token, our analysis shows that many tokens do not benefit from extra iterations. We therefore propose TaH2, which enables the model to focus extra iterations on the tokens that benefit from looping. It jointly post-trains the backbone and an iteration decider through lookahead depth supervision, which uses online labels indicating whether further iteration improves the prediction. TaH2 improves both the efficiency and attainable accuracy of test-time scaling. On challenging AIME benchmarks, TaH2 improves the accuracy-compute slope by 53% (2.74 vs. 1.79) over the non-looped baseline, exceeding the baseline’s peak accuracy by about 3.4 points at matched test-time compute. As the maximum iteration depth increases, existing looped models largely plateau, while TaH2’s gain over the non-looped baseline continues to grow from +2.8 points at depth 2 to +3.9 points at depth 8. Our code is available at https://github.com/thu-nics/TaH.

Linxiao Gong, Yijie Xu, Tianfu Wang, Yin Wu, Yili Wang

TL;DR: TACT 通过测试学生生成行为在对话伙伴处的实际后果，并将有益修订蒸馏回学生，提升社交目标完成度同时降低沟通 token 与消息数。

Details

Motivation: 社交代理既要满足对方约束、推进自身目标，又不能用冗长无效表达消耗双方注意力；沟通策略和措辞会影响后续互动，不是孤立的一句话。

Result: 在 SOTOPIA 上，TACT 在总体和困难子集的 Goal 指标均为受评方法最高，且目标 token 明显少于 SFT+SDPO；在 AgentSense 上，较初始学生目标成功率提高，同时减少 token 和交互消息。摘要未给出具体数值。

Insight: 表达专家精简无助于行动的细节但保留意图，策略专家提出更能满足对方约束的替代行动；对每个候选采样伙伴回应后，教师按局部目标支持与行动 token 成本折中选择参考，再在学生自身前缀上做 on-policy 蒸馏。

Abstract: Socially intelligent language agents must negotiate, coordinate, and resolve conflicting preferences while respecting the time and attention of both participants. Balancing these demands is challenging because agents must convey enough to address a partner’s constraints and advance their goals without adding words that do not help the interaction. In this paper, we propose Teacher-Assisted Communication Training (TACT) to improve social goal attainment while reducing communication cost, making interactions with agents more productive and less demanding. We first characterize communication efficiency in terms of action strategy and expression, whose effects extend beyond the current utterance to the partner’s response and subsequent exchanges. We design TACT to revise student-generated actions, test the revisions through partner responses, and distill useful feedback into the student. An expression specialist removes unnecessary detail while preserving the intended action, while a strategy specialist proposes alternatives that may better address the partner’s constraints. To determine which revision helps, TACT samples a partner response for each candidate and selects a teacher reference by balancing local goal support against action-token cost. That reference guides on-policy distillation on the student’s own generation prefixes, allowing the student to act independently at deployment. We evaluate TACT on SOTOPIA and AgentSense. On SOTOPIA, it achieves the highest Goal among the evaluated methods on All and Hard while using substantially fewer target tokens than SFT+SDPO. On AgentSense, it improves goal success over the initial student while reducing target tokens and interaction messages.

[387] Telescopic Language Models cs.CL | cs.AIPDF

Zhilin Guo, Boqiao Zhang, Hakan Aktas, Kyle Fogarty, Nursena Koprucu Aslan

TL;DR: Telescopic Language Model 用随机前缀监督训练嵌套容量 Transformer，使单次训练得到的模型可在多个深度退出点运行，无需分别训练每种预算。

Details

Motivation: 部署需要适配多个计算预算时，通常要为每个预算单独训练或压缩；只监督少数固定退出点又会导致模型在未训练深度无法工作。

Result: 在 200M 代理规模、20B FineWeb-Edu token 的同数据流实验中，单次 TLM 训练的二十个层前缀均是有效语言模型，困惑度及下游任务表现都可用。相较固定退出点套件，质量—预算曲线下面积降低 43%–44%，满容量性能相当，每次运行 GPU 成本低约 12%。

Insight: 每一步随机截断容量轴上的一个前缀，并以完整模型 next-token 目标监督，同时执行一次全容量前向/反向。采样深度密度可控制预算点：偏重少数深度会恢复那些点的质量，但牺牲连续弹性，说明弹性主要由训练目标而非嵌套结构本身决定。

Abstract: One deployed language model must often serve many compute budgets, yet serving each budget still means a separate training or compression run per point. We train a Telescopic Language Model (TLM) to be that continuum: a nested-capacity Transformer supervised by stochastic prefix supervision with a full anchor. At every step, one randomly truncated prefix of the capacity axis is trained against the full next-token target, alongside one full-capacity pass, so the trained artifact is a valid language model at every depth. Two forward-backward passes per step, no architectural change, nothing extra at inference. Fixed-exit suites such as Matryoshka Language Model Suites (MLMS) occupy one point in this design space, and the point has a cost: supervising only a few fixed exits leaves the nested model at chance level everywhere else (perplexity 10^2-10^5 in our baselines). On a 200M proxy suite (20B FineWeb-Edu tokens, identical data stream for all methods), a single TLM run is a valid language model at every one of its twenty layer prefixes, in perplexity and on perplexity-sensitive downstream tasks, reducing the area under the quality-budget curve by 43-44% relative to the fixed-exit suites while matching them at full capacity, at ~12% lower GPU cost per run. The prefix sampling density is a dial: concentrating it on a few depths recovers fixed-exit quality there at the price of the continuum, so the operating points become a training-time choice rather than an architectural one. These results indicate that the training objective, not the nesting itself, is what makes a model elastic.

cs.AI [Back]

[388] IndustryLLM: Failure-Driven LLM Training for Industrial Procurement cs.AI | cs.CLPDF

Liang Ding, Zhiang Xu, Yuyang Sheng, Bin Chen, Songlin Bai

TL;DR: IndustryLLM 通过故障驱动的持续预训练与监督微调，针对工业采购中的买家行话、稀疏商品属性和工程标准适配开源语言模型。

Details

Motivation: 工业采购需要在非正式描述、有限市场字段和权威标准之间准确映射，错误还受严格安全容差约束；通用语料训练容易造成术语错配和事实脆弱。

Result: 模型基于 Qwen3.5-35B-A3B-Base，冻结视觉编码器，训练语料约 100B token。离线 No-Think 采购查询结构化 exact match 提高 2.97 个百分点（95% CI [2.11, 3.86]）；线上随机 A/B 测试 GMV 提高 4.25%、满意咨询提高 8.3%，延迟从 6–7 秒降至 1.5 秒。

Insight: 持续预训练整合国家标准、工业交易/询价记录和通用回放，并用多文体改写、最小事实编辑和错误定向问答合成缓解语言风格及事实问题。部署接口使用证据门控三值逻辑，未验证的商品证据保持“未知”，不能当作满足约束。

Abstract: Industrial procurement requires language models to bridge informal buyer jargon, sparse marketplace attributes, and authoritative engineering standards under strict safety tolerances. We present IndustryLLM, an open-weight industrial language model trained from Qwen3.5-35B-A3B-Base (35B total parameters with ~3B activated per token, with the vision encoder frozen). Rather than relying on generic text scaling, we introduce a failure-driven adaptation recipe spanning continued pre-training (CPT) and supervised fine-tuning (SFT). CPT leverages a curated ~100B-token corpus integrating 5B tokens of national standards (e.g., GB/T) and technical archives, 10B tokens of de-identified real-world industrial transaction and inquiry records, and 60B tokens of general replay. To overcome register mismatch and factual brittleness, we systematically reconstruct an estimated 20B-token domain subset via multi-register rewriting across 10 genres and 8 writing styles, confidence-routed minimal factual editing, and error-targeted QA synthesis (resolving colloquial typos like ‘42-luo-mu’ -> 42CrMo, expanding ambiguous codes like ‘16674’ -> GB/T 16674, and clarifying conflicting dimensional specs). For downstream deployment, we formalize an evidence-gated constraint-evaluation interface enforcing three-valued logic where unverified product evidence remains unknown rather than satisfied. Offline evaluations demonstrate consistent gains on procurement-query structuring (+2.97 percentage points in exact match, 95% CI [2.11, 3.86] in No-Think mode), while randomized online A/B experiments in production yield substantial improvements (+4.25% GMV, +8.3% satisfied inquiries) alongside a latency reduction from 6-7 s to 1.5 s. Model weights and configs are released at https://huggingface.co/alibaba-multimodal-industrial-ai/IndustryLLM.

[389] EngramRAG: Dynamic Usage-Weighted Topology and Synaptic Consolidation for Multi-Hop Agentic Memory cs.AI | cs.CL | cs.IR | cs.MAPDF

Bhavyateja Potineni, Lohit Giri, Anu Jain, Vadim Kutsyy, Rajasekhar Pentakota

TL;DR: EngramRAG 结合实时唤醒状态和异步梦境整合流程，按使用情况调整多跳记忆图结构并保留承载核心身份信息的记忆。

Details

Motivation: 多会话代理的传统记忆可能无法遍历多跳关联、因时间衰减遗忘稳定人格信息，且静态图拓扑无法反映实际使用变化。

Result: 在 LoCoMo 全部 1,982 个问答、10 段长期对话上，EngramRAG 相较稠密向量 RAG 的 Recall@5 相对提高 38.9%（53.21% vs 38.29%），MRR 提高 43.1%（0.4203 vs 0.2937），并优于 BM25 和单独静态图检索。时间推理 Recall@5 为 62.33%，比稠密向量高 16.67 点；事实更新测试中 SUPERSEDES 将冲突状态幻觉从 70.0% 降至 0；90 天模拟的支架记忆保留率为 100%，交互检索反射延迟 26.21 ms。

Insight: 使用调节 Personalized PageRank 将持续出现实体提升为知识枢纽，按拓扑承载力而非单纯时间决定保留期，并以有向 supersedes 图过滤过时事实；混合检索融合向量、BM25 和图排序。

Abstract: As autonomous LLM agents are deployed across multi-session environments, conventional memory architectures suffer from Associative Blindness (inability to traverse multi-hop relational dependencies), Scaffolding Amnesia (temporal decay evicting core persona invariants), and Static Topology Stagnation (immutable graphs ignoring usage dynamics). Grounded in Complementary Learning Systems (CLS) principles, we propose EngramRAG, an adaptive memory architecture coupling a low-latency Waking State reflex with an asynchronous background Dreaming State consolidation cycle. EngramRAG introduces: (1) Usage-Modulated Personalized PageRank (U-PPR), where transition probabilities adapt via Hebbian plasticity to promote persistent entities into high-centrality Epistemic Macro-Hubs; (2) Consolidation-Activated Topology Decay (CATD), which scales retention half-life by topological load-bearing weight rather than wall-clock recency, protected by a cold-start grace period (N_grace >= 4); (3) Directed SUPERSEDES DAG filtering to suppress obsolete state during fact mutations; and (4) Triple-source hybrid retrieval fusing dense vectors, BM25, and U-PPR via dynamic Reciprocal Rank Fusion (RRF). Evaluating on all 1,982 QA pairs across 10 long-term conversations in the LoCoMo benchmark, EngramRAG achieves +38.9% relative improvement in Recall@5 (53.21% vs. 38.29%, p < 0.001) and +43.1% in MRR (0.4203 vs. 0.2937) over dense vector RAG, significantly outperforming Okapi BM25 (48.66%) and isolated static graph retrieval (8.50%). On temporal reasoning, EngramRAG reaches 62.33% Recall@5 (+16.67 points over dense vectors). In controlled mutation tests, SUPERSEDES suppresses split-brain hallucinations from 70.0% to 0.0%, while 90-day simulations show 100.0% scaffolding retention under a 26.21ms interactive retrieval reflex.

[390] ForkLeft: Entropy-First Rollouts for Prefix-Aligned Autoregressive-to-Diffusion Distillation cs.AI | cs.CLPDF

Junming Liu, Jicheng Wang, Yifeng He, Hao Chen, Jianzhong Qi

TL;DR: ForkLeft 蒸馏自回归推理到扩散语言模型时，将学生自己的 rollout 与教师监督分开，先用熵优先策略确定前缀，再让教师在相同前缀下给出 next-token 指导。

Details

Motivation: 自回归教师根据左侧前缀预测，而扩散学生可同时利用左右 token，两者条件分布不匹配；直接蒸馏难把 NTP 推理能力迁入 DLM，又不希望放弃并行生成。

Result: Qwen3-30B-A3B-Base 教师使 Efficient-DLM-4B 在十个基准全部提升，MATH500 从 72.60% 升至 79.60%，并持续优于三种替代设计。收益随教师能力增强，也迁移到 SDAR-4B；仅 500 次更新后，4B、8B 学生在七个基准上超过所比较的 SDAR-Chat 和 OPDLM。

Insight: 训练时学生先提交高不确定位置以生成分叉前缀，再在固定学生前缀下用正确答案决定监督来源；推理时则恢复原生的高置信并行解码。

Abstract: Autoregressive Next-Token Prediction (NTP) has enabled strong reasoning capabilities in language models, while Diffusion Language Models (DLMs) offer flexible token orders and parallel generation. We ask whether DLMs can acquire NTP-style reasoning through distillation without giving up their native generation process. Direct distillation, however, faces a fundamental mismatch: an autoregressive teacher predicts from a left prefix, whereas a DLM can condition on tokens on both sides. We introduce ForkLeft, a distillation framework that resolves this mismatch by separating the student’s rollout from teacher supervision. During training, the student first performs entropy-first rollouts that commit uncertain positions and expose potential forks. We then fix the resulting student prefix and distill an NTP teacher under the same context, with answer correctness determining the supervision source. At inference, the student returns to its native confidence-first parallel decoding. With Qwen3-30B-A3B-Base, ForkLeft improves Efficient-DLM-4B on all ten benchmarks, raising MATH500 from 72.60% to 79.60% and consistently outperforming three alternative designs. The gains scale with teacher strength and generalize to SDAR-4B with only $500$ updates. At matched scale, the distilled 4B and 8B students exceed the published SDAR-Chat and OPDLM models on seven benchmarks, showing that DLMs can learn NTP-style reasoning without sacrificing native parallel generation. Code and datasets will be released upon acceptance.

[391] PULSE: Identifying Demonstration-Utility Features with Sparse Autoencoders cs.AI | cs.CL | cs.LGPDF

Chenduo Hao, Chuanbao Gao, Pinjun Zeng, Jingze Zhu, Chonghan Liu

TL;DR: PULSE 利用稀疏自编码器识别与示例集合效用相关的模型内部特征，再用这些特征选择适合目标模型的上下文学习示范。

Details

Motivation: 常见示例选择方法按查询—示例外部相似度排序，可能忽略目标模型特有的内部激活和下游行为；语义相似示例不一定对该模型最有用。

Result: 在分类、生成和推理任务上，PULSE-Retriever 比最强基线分别高 2–3 个准确率点、0.6–0.9 BLEU-4 和 3.2 个 exact-match 点；受控集合排序也验证所定位特征能预测整组示例效用。跨数据集实验发现部分效用信号可迁移。

Insight: 小型带标签发现集用于采样候选示例集合，测量其相对零样本的效用，再找出 SAE 特征激活差与效用差对齐的方向；正负特征可用于完整集合打分，也可构成大规模检索器的特征相关掩码。

Abstract: In-context learning is highly sensitive to demonstration choice, yet most methods select demonstrations using external query-demonstration similarity. Such criteria can miss model-specific signals: Similar demonstrations may activate different internal features and downstream behaviors. We introduce PULSE (Paired Utility Localization over Sparse Encodings), an SAE-based framework for identifying model-internal features associated with demonstration utility and using them for demonstration selection. Using a small labeled discovery set, PULSE samples candidate demonstration sets, measures their zero-shot-relative utility under the target model, and scores SAE features by how their activation differences align with utility differences. The top positive and negative coordinates form a sparse utility-localization vector. We use this vector in two complementary ways: as a signed score for controlled complete-set ranking, and as PULSE-Retriever, which converts its magnitude into a feature-relevance mask for scalable pool-scale retrieval. Across classification, generation, and reasoning benchmarks, PULSE-Retriever improves over the strongest baseline by 2-3 accuracy points, 0.6-0.9 BLEU-4, and 3.2 exact-match points, respectively, while controlled ranking validates the identified features encode a predictive set-level utility signal. Feature inspection and cross-dataset experiments suggest that the identified features capture task-relevant, dataset-conditioned patterns, yet retain utility signals that partially transfer across datasets. Our code is available at https://github.com/aohenuo/PULSE.

[392] CUE-Mem: Benchmarking Long-Term User Memory via Implicit Cues in Multimodal Conversations cs.AI | cs.CLPDF

Yulin Hu, Yanyan Zhao, Zimo Long, Xing Fu, Mengtong Ji

TL;DR: CUE-Mem 评估多模态长期记忆能否从持续对话中的隐含背景线索保留用户信息，例如图像背景物体或环境声音，而非只记住显式陈述。

Details

Motivation: 长期对话中的个性信息可能通过重复图像、声音等外围线索暗示；现有基准多关注文本记忆或显式多模态证据，较少测量隐含线索的长期利用。

Result: 基准含 2,674 个文本、图像和音频问答，覆盖显式/隐式证据及实体回忆、长期模式、个性化推荐、拒答四项任务。文本化记忆与 oracle 证据之间差距较大，指出瓶颈在保留和检索细微线索。增加描述细节可恢复更多信息，但收益不均且 token 成本快速增长；原生多模态访问也不能普遍解决问题，效果依赖骨干且索引会带来检索噪声。

Insight: 基准揭示记忆系统需要选择性保留、检索和使用隐含多模态证据；更长 caption 并非无代价替代原生模态存储。

Abstract: Long-term memory is essential for multimodal agents that interact with users across sustained conversations. However, user memories are not always explicitly stated: they may also be implied by recurring background objects in images, ambient sounds in audio, or other peripheral multimodal cues. Existing benchmarks largely focus on text-only memory or explicit multimodal evidence, leaving implicit multimodal cues underexplored. We introduce CUE-Mem, a text-image-audio benchmark for evaluating long-term user memory from implicit cues. CUE-Mem contains 2,674 questions across explicit and implicit evidence settings and covers four tasks: Entity Recall, Long Pattern, Personalized Recommendation, and Answer Refusal. Across textualized memory systems, implicit performance remains far below oracle evidence, locating the main bottleneck in preserving and retrieving subtle cues rather than question answerability. Increasing caption detail recovers more of this evidence, but brings uneven gains and rapidly growing token costs, motivating native multimodal access. Yet native access does not uniformly resolve the bottleneck: evidence use depends strongly on the backbone, while multimodal indexing introduces substantial retrieval noise. CUE-Mem provides a testbed for memory systems that selectively retain, retrieve, and use subtle multimodal evidence.

[393] IGSD: Environment-Verified Hindsight Self-Distillation for Search Agents cs.AI | cs.CLPDF

Angqing Jiang, Gaoming Zhang, Chaoqun Zhang, Jianchun Song, Liyuan Kong

TL;DR: IGSD 先在真实检索环境中验证教师提出的查询 token 是否确实改善检索，再按执行后的信息增益对搜索代理进行 on-policy 自蒸馏。

Details

Motivation: 教师在特权 hindsight 下可给学生搜索轨迹提供逐 token 指导，但它可能偏好语义合理却不能从学生当前状态改善检索的查询；模型内部打分也不验证实际检索后果。

Result: 在七个单跳和多跳问答基准上，IGSD 的宏平均 exact-match 分别为 3B 策略 42.8%、7B 策略 47.0%，无需推理阶段验证器。摘要未提供与基线的逐项差值。

Insight: 将查询 token 视为微型动作，教师提案和学生采样 token 完成的查询从同一失败状态、用同一检索器执行；共享反事实控制校正查询条件对答案概率的影响，二者差异形成相对效用，再作为正向软权重训练候选对蒸馏。GRPO 目标不变，环境验证只用于训练。

Abstract: On-policy self-distillation densifies agent training without external teachers: a policy conditioned on privileged hindsight provides step-level guidance for its own unprivileged rollouts. For search agents, however, hindsight can make the teacher prefer a query that does not improve retrieval from the student’s state. Existing methods either distill this preference directly or filter it with model-internal scores, but neither strategy verifies the query’s executed retrieval consequence. We propose Information-Gain-Gated Self-Distillation (IGSD), which verifies on-policy token proposals with environment feedback before distilling them. Treating each query token as a micro-action, IGSD completes the teacher’s token proposal and the student’s sampled token into matched queries and executes both from the same failed state with the same retriever. Shared counterfactual controls account for query-conditioned shifts in answer likelihood, so their difference, the executed paired information gain, provides a relative utility contrast for the retrieved documents. IGSD uses this contrast as a positive-only soft weight for candidate-pair distillation, while leaving the GRPO objective unchanged and confining verification to training. Across seven single-hop and multi-hop QA benchmarks, IGSD reaches macro-average exact-match accuracies of 42.8% and 47.0% with 3B and 7B policies, respectively, without inference-time verification. These results support environment-verified hindsight as an effective approach to reliable action-level supervision for search agents.

[394] MassAlloc Attention: Let Attention Allocate Its Own Compute cs.AI | cs.CLPDF

Jingze Shi, Zhangyang Peng, Xianduo Li, Yanlin Qi, Xiaotian Lin

TL;DR: MALA 是融合式注意力算子，根据归一化注意力贡献动态决定每个注意力块要执行多少后续计算，同时保持对所有合法因果交互的 score 访问。

Details

Motivation: 即使注意力归一化质量在大量位置近乎为零，稠密内核仍对所有 QK 块执行完整后续计算；利用注意力分布自适应分配计算可能减少开销。

Result: 8K 等工作量比较中，MALA 的遗漏质量均值为 0.0188%，接近逐样本参考质量 oracle 的 0.0182%；在上下文长度 1K–32K 下，输出和梯度误差保持较低。8K 关联回忆准确率为 89.67%，FullAttn 为 89.97%。128K 注意力算子测试中，训练前向/反向分别加速 2.2/3.0 倍，推理解码加速 1.6 倍；0.6B–14B 缩放实验中困惑度接近 FullAttn 且总训练 FLOPs 更低。

Insight: 前向阶段使用在线 softmax 归一化量，反向则复用最终归一化量构造嵌套保留集合，只依赖标准注意力状态；训练与推理共享容差，按归一化贡献自适应裁剪后续工作。

Abstract: FullAttn often assigns negligible normalized mass to much of the causal score space, yet dense kernels execute the complete post-score path after forming each QK tile. We introduce MALA, a fused attention primitive that preserves score access to every legal causal interaction and uses normalized contribution to allocate post-score computation. Forward uses its evolving online-softmax normalizer, while backward reuses the finalized normalizer to derive nested retained support using only standard attention state. A common tolerance governs training and inference, allowing for adaptive retention of the work. MALA reduces low-contribution post-score computation. A matched-work study at 8K isolates the benefit of distribution-adaptive allocation: under exactly matched total post-score work, MALA approaches a per-instance reference-mass oracle, with mean omitted mass of 0.0188% versus 0.0182%. Across context lengths from 1K to 32K tokens, the same tolerance maintains low output and gradient errors relative to the reference. Across a broader controlled associative-recall comparison, MALA closely tracks FullAttn as context grows, reaching 89.67% accuracy at 8K compared with 89.97% for FullAttn. In an attention-operator benchmark at 128K tokens with tensor parallelism, MALA reduces forward and backward latency during training by 2.2x and 3.0x and decoding latency during inference by 1.6x relative to FullAttn. Across scaling-law training from 0.6B to 14B parameters, MALA closely tracks FullAttn in perplexity while reducing total training FLOPs. The resulting 14B models and 32B models from separate continued training achieve comparable knowledge, reasoning, and long-context retrieval scores to FullAttn. These results indicate that allocating post-score computation according to normalized attention contributions can retain the evaluated capabilities of FullAttn while reducing attention computation.

[395] Retrospective Distillation Attribution via Normalized Response Similarity cs.AI | cs.CL | cs.CR | cs.LG | stat.MLPDF

Minwoo Jang, Jaechang Kim, Minhyeon Oh, Jeongyeon Hwang, Jungseul Ok

TL;DR: SCOUT 是无需学生权重、似然或历史检查点的蒸馏来源审计方法，通过跨文本重复出现的句法模式识别模型谱系，并在证据不足时弃答。

Details

Motivation: 现有蒸馏归因多在 SFT 刚结束的学生上评估；公开发布模型可能已继续经过 SFT、偏好优化或 RL，审计者也常拿不到蒸馏前检查点。

Result: 对采用不同后训练目标的公开蒸馏模型后代，SCOUT 持续识别蒸馏来源；沿训练轨迹追踪的教师句法特征在蒸馏期间出现，并在后续偏好优化和强化学习后保留。摘要未报告量化准确率。

Insight: 方法把重复句法结构聚合为候选模型画像，过滤区分度低的模式，再用学生—候选差异对照候选间差异校准距离。只使用模型当前输出文本，可支持无权重的事后溯源。

Abstract: Model distillation transfers capabilities through supervised fine-tuning (SFT) on teacher responses, often collected from commercial APIs, raising questions of model provenance. Existing distillation attribution methods have been largely evaluated on students immediately after the SFT step. However, a distilled model may undergo further SFT, preference optimization, or reinforcement learning before release, while an auditor may lack access to the pre-distillation checkpoint required by reference-based attribution. To close this gap, we propose SCOUT, an output-only method that aggregates recurring syntactic patterns into candidate profiles, filters low-contrast patterns, and calibrates student–candidate distances against inter-candidate distances. SCOUT supports attribution and abstention using only current texts, without model weights, token likelihoods, or historical checkpoints. Auditing publicly released descendants of distilled models spanning diverse post-training objectives, SCOUT consistently identifies the distillation source. Furthermore, tracing teacher-associated syntactic signatures along training trajectories reveals that they emerge during distillation and persist through subsequent preference optimization and reinforcement learning.

[396] CLAIRE: A Schema-Grounded Hybrid Workflow for Healthcare Administrative Form Completion cs.AI | cs.CL | cs.HCPDF

Garapati Keerthana, Manik Gupta

TL;DR: CLAIRE 是用于医疗行政表单填写的模式约束混合流程，将字段发现、来源映射、确定性校验、有限纠错、升级处理和审计轨迹分离。

Details

Motivation: 行政人员需把 EHR、转诊、理赔、医师名录和工作队列的信息写入动态表单；自动化不能在证据不足或影响重大的字段上自行臆测。

Result: 在五种合成医疗模式、1,000 条源记录、四种界面、两类数据质量集和六个比较器上共评 24,000 个基准 episode；另对 Qwen2.5-1.5B/7B 进行严格输出审计，并模拟 6,000 个操作 episode。合成评测中完整 CLAIRE 在两套数据均达到 100% episode 成功率、字段准确率和必填/依赖完成率；去掉校验后压力集成功率降至 50%。模拟中干净及校验压力案例 100% 达到可供员工审阅的草稿，升级挑战案例为 68.6%。估算每案节省 149.7–165.5 秒并非实测员工时间。

Insight: 语言模型辅助映射，但确定性规则负责校验；无依据或高后果的字段会阻断并升级，不由模型直接授权。研究支持的是受控合成条件下以验证为先的行政自动化。

Abstract: Healthcare administrative staff transfer structured information from electronic health records, referrals, claims systems, provider rosters, and work queues into dynamic forms. We developed and evaluated CLAIRE (Clinical Language and Agentic Intelligence for Reasoning and Entry), a hybrid workflow that separates field-state discovery, source-to-field mapping, deterministic validation, bounded correction, escalation, and audit tracing. We tested five synthetic healthcare administrative schemas, 1,000 source records, four interface variants, two data-quality suites, and six comparators, yielding 24,000 benchmark episodes. A separate strict-output audit evaluated direct mappings from Qwen2.5-1.5B and Qwen2.5-7B, and a trace-derived operational simulation covered 6,000 episodes. Under the evaluated synthetic benchmark conditions, full CLAIRE achieved 1.000 episode success, field accuracy, required-field completion, and dependency completion in both suites; removing validation reduced stress-suite success to 0.500. In the simulation, 100.0% of clean and validation-stress episodes reached a staff-reviewable draft, compared with 68.6% of escalation challenge episodes, unsupported cases were blocked. Scenario-based savings were 149.7-165.5 seconds per case, not observed staff times. The findings support schema-grounded, validation-first healthcare administrative automation in which language-model components assist mapping but do not authorize unsupported or consequential actions.

[397] Overwhelmed by Choice: Studying LLM Decision Making at Scale cs.AI | cs.CLPDF

Yu-Chi Lin, Aryan Seth, Anshul Aravind, Eugene Lee, Tanmay Parekh

TL;DR: 该研究系统评估候选集合变大时 LLM 的选择能力，发现正确项与最强干扰项的分数差缩小、较早候选偏好难以被后续选项推翻。

Details

Motivation: 多项选择和候选排序广泛用于推理评测，但基准通常只有小候选集，尚不清楚结论能否扩展到大规模候选空间。

Result: 随着候选数增加，跨任务、提示策略和模型规模的准确率均明显下降。HotpotQA 和 MIMIC 上用分层分组及置换推理，在 N=160 时准确率提高约 20 个百分点。

Insight: 性能下降不能仅由长上下文检索解释；候选规模本身应作为评测协议变量报告。小选项集上表现强并不保证大规模候选比较可靠。

Abstract: Multiple-choice and candidate-selection evaluations are widely used to assess LLM reasoning and decision-making, yet most benchmarks contain relatively small candidate sets. It remains unclear whether conclusions drawn from these settings remain valid as the candidate space scales. We systematically evaluate LLMs as the number of competing candidates increases and find substantial accuracy degradation across tasks, prompting strategies, and model scales. Controlled analyses show that standard long-context retrieval explanations cannot fully account for this degradation. Instead, we identify two systematic failure patterns. First, gold-margin collapse: the score gap between the correct answer and the strongest distractor progressively shrinks, driven primarily by weakening confidence in the correct answer. Second, earlier candidate preferences become increasingly difficult to overturn, with later candidates exerting progressively weaker influence on the final prediction. Motivated by these findings, we evaluate hierarchical partitioning and permutation-based inference, which improve accuracy by roughly 20 percentage points at $N=160$ on both HotpotQA and MIMIC. Overall, our results identify candidate-set scale as an important evaluation-protocol variable and show that strong small-option performance does not necessarily imply robust large-scale candidate comparison.

[398] Logical subspace in LLMs cs.AI | cs.CLPDF

Hope Kean, Enric Boix-Adsera

TL;DR: MVS 方法搜索语言模型某一层中能独立保留逻辑推理表现的最低秩激活子空间，并通过消融检验它与其他能力的分离关系。

Details

Motivation: 人脑研究发现抽象形式推理专用网络，作者探索语言模型中是否也存在可功能定位的逻辑推理核心。

Result: 在 Gemma 和 Qwen 上识别出支持逻辑推理的低秩子空间。保留后期逻辑子空间可维持推理，却损害事实知识、工作记忆、认知控制和算术；消融该子空间会使逻辑准确率降至随机水平，同时大体保留其他能力。

Insight: MVS 逐层寻找在其他激活被消融时仍能维持任务表现的最小子空间。结果提示模型逻辑推理可能由相对可分离的内部机制支持，但该证据来自指定模型和任务。

Abstract: Recent work has identified a human brain network specialized for abstract formal reasoning (Kean et al., 2025). Does the same hold true in language models? To answer this question, we introduce the minimal viable subspace (MVS) method, which searches for the lowest-rank activation subspace at a layer that preserves task performance when everything outside that subspace is ablated. Using MVS, we demonstrate low-rank subspaces supporting logical inference on Gemma and Qwen models. Furthermore, these subspaces exhibit a clear dissociation from model capacities on other tasks, such that retaining these late logic subspaces preserves inference while impairing factual knowledge, working memory, cognitive control, and arithmetic. Conversely, ablating them reduces logical inference accuracy to chance while largely sparing these other capacities. Our results suggest a functionally localizable core machinery for logic akin to that in the human brain.

[399] SeOPD: Self-Evolving LLMs via Online Policy Distillation from Self-Generated Chain-of-Thought cs.AI | cs.CLPDF

Xiaoshu Chen, Xiangyu Wong, Sihang Zhou, Ke Liang, Xinwang Liu

TL;DR: SeOPD 在同一语言模型内部用深思考模式生成的 CoT 作为特权信息，向非思考模式提供 token 级 on-policy 蒸馏监督，实现无需外部数据或教师的自我提升。

Details

Motivation: 现有在线策略自蒸馏常依赖人工标注或外部环境反馈，成本高；少数无外部特权信息的自提升方法收益有限。一个模型不同推理模式可能互补。

Result: 在多种语言模型和任务上的实验显示，SeOPD 有效提升能力；摘要未提供具体任务名称或分数。

Insight: 流程先由深思考模式产生 CoT，再由非思考模式生成答案，最后用前者提供的推理信息监督后者的 on-policy 回答，将推理中新获得的信息内化进共享参数，进而改善两种模式。

Abstract: Recent advances in online policy self-distillation (OPSD) have demonstrated that large language models (LLMs) can improve their capabilities by leveraging external privileged information (PI), such as manual annotations or feedback from external environments. However, obtaining accurate annotations and constructing sophisticated environments often require substantial human effort and computation, limiting the scalability of OPSD. While a few recent studies have explored self-improvement without external PI, the resulting gains remain limited. In this work, we explore whether LLMs can achieve comparable self-improvement without external PI. Our key observation is that a single LLM can support multiple reasoning modes, such as deep-thinking and non-thinking modes, with deep thinking generating additional information during reasoning. Based on this observation, we propose Self-Evolving Online Policy Distillation (SeOPD), which enables LLMs to distill and internalize information generated by their own chain of thought (CoT). Specifically, it (1) generates CoT with the deep-thinking mode, (2) produces responses with the non-thinking mode, and (3) uses the generated CoT as PI to provide token-level supervision for the non-thinking response, allowing new information inferred during reasoning to guide the non-thinking mode and be internalized into the shared model parameters, thereby improving both non-thinking and deep-thinking capabilities. Extensive experiments across LLMs and tasks demonstrate the effectiveness of SeOPD.

[400] ParaAgent: Reinforcing Parallel Acting in Open-World Tool Environments cs.AI | cs.CLPDF

Shengbin Yue, Hongru Wang, Siyuan Wang, Xiaoxin Chen, Wei Chen

TL;DR: ParaAgent学习按阶段协调探索与执行、并在执行阶段并行调用工具的结构化循环，以提升开放环境中的长程工具任务成功率。

Details

Motivation: 开放世界工具任务要求在探索未知能力和利用已知能力间平衡。现有方法要么把探索与执行僵硬分开，要么交错进行却缺乏协调，难以同时保证效果和效率。

Result: 依托包含50,011个真实工具接口的ToolEnv训练后，ParaAgent-4B在两个开放世界工具基准上的平均成功率超过所有基线，包括GPT-4.1系统；多工具任务收益最大。

Insight: 关键不是简单选择分离或交错，而是跨粒度组织动作：阶段层面切换探索与执行，动作层面并行操作；阶段级、步骤级和轨迹级奖励共同监督这种规划结构。

Abstract: Language model agents are increasingly deployed in open-world tool environments, which require balancing exploring unknown capabilities and exploiting known ones. Existing methods face a performance-efficiency tradeoff: they either rigidly decouple exploration and execution or interleave them without coordination. We argue that the key lies not in whether to decouple or interleave them, but in how to coordinate them across granularities. We introduce ParaAct, a structured parallel-action loop that combines phase-level Exploration $\rightleftharpoons$ Execution with action-level parallelism. To learn this loop, ParaAgent combines multi-agent cold-start demonstrations with reinforcement learning under multi-level advantage decoupling, making planning structure explicit and supervising it with step-, phase-, and trajectory-level rewards. Learning is supported by our ToolEnv, a scalable simulator grounded in 50,011 realistic tool interfaces. On two open-world tool benchmarks, ParaAgent-4B achieves the best average success among all baselines, including GPT-4.1 systems, with the largest gains on multi-tool tasks. Behavioral analyses show that these gains stem from this action organization, highlighting its importance for capable and efficient open-world agents.

[401] Audit-First VAPO: Risk-Certified Selective Updates under Imperfect Verification cs.AI | cs.CL | cs.LGPDF

Miaobo Hu, Shuhao Hu, Xiaobo Guo, Xin Wang, Bokun Wang

TL;DR: Audit-First VAPO先以有限二次验证预算决定更新方向是否接纳，再用有界信任域控制更新幅度，并对筛选后的有害风险提供有限样本证书。

Details

Motivation: 验证器可能给出有害的更新方向，即使裁剪和正则化限制了更新幅度，也不能消除方向错误。需要把方向筛选与幅度控制分开，并在验证器不完美时量化风险与覆盖率。

Result: 在Qwen3.5-0.8B的GSM8K实验中，目标风险0.08时准确率为74.1%、选中更新有害风险0.0697、覆盖率0.4125、相对验证成本1.16倍；相对匹配随机筛选的风险差为-0.0260，配对95%区间[-0.0364,-0.0157]。证书在60次独立运行中的57次满足。

Insight: 先冻结仅依赖观测的接纳、申诉或弃权决策轨迹，再结合干净标签认证风险，可避免标签泄漏影响选择。共享预算引发的依赖需由条件Hoeffding-Azuma界处理；rollout或验证器改变后应重新认证。

Abstract: Imperfect verifiers can assign a harmful update direction even when clipping and regularization bound its magnitude. We introduce Audit-First VAPO, which separates discrete directional admission from continuous magnitude control. An observation-only accept-appeal-abstain policy uses a finite secondary-verification budget; its action trace is frozen before clean labels are joined. Simultaneous finite-sample bounds then certify selected harmful risk, coverage, and verifier-call rate over a predeclared policy family. Conditional Hoeffding-Azuma bounds account for the dependence induced by shared budgets, and rollout or verifier changes initiate a new certification stage. After admission, a bounded trust-clip-KL actuator controls magnitude. We evaluate two models on two reasoning benchmarks against static RLVR, matched-random selection, confidence thresholding, noise correction, and verifier augmentation. On Qwen3.5-0.8B and GSM8K at target risk $ρ=0.08$, RC-VAPO achieves 74.1% accuracy, selected harmful risk 0.0697, coverage 0.4125, and relative verifier cost $1.16\times$. At matched coverage and update magnitude, its selected-risk difference from matched random is -0.0260 with paired 95% interval $[-0.0364,-0.0157]$. Across asymmetric, confidence-dependent, and correlated-verifier noise, the certificate is satisfied on 57 of 60 independent runs. These comparisons isolate informative directional selection from proposal suppression, update shrinkage, and additional verifier computation.

[402] PainterBench: A Figural Divergent-Thinking Benchmark for Tool-Using Language Models cs.AI | cs.CL | cs.HCPDF

Shane K. A. Dalumura Hettige, Jonas Oppenlaender

TL;DR: PainterBench把不完整图形续画任务转化为多轮工具使用基准，评估多模态语言模型的增量视觉规划和图形发散创造力。

Details

Motivation: 语言模型的创造力通常通过文本测量，尚缺少能在工具交互中评估视觉发散思维的基准。续画任务要求模型保留不可擦除的起始形状、逐步规划并自行决定何时结束。

Result: 研究评估14种模型，收集2,700幅模型绘画，并为全部模型作品及300幅人类作品获取创造力和可辨识度评分。适配后的ViDrA评分器在随机留出测试集与人类评分相关系数为0.85；模型作品创造力较高但可辨识度较低。

Insight: 该基准同时保留每轮画布和工具调用轨迹，使评价能覆盖多轮过程而不仅看最终图像。创造力与可辨识度结果相反，提示开放式图形生成需要同时考察新颖性和表达清晰度。

Abstract: Figural divergent thinking is the ability to develop a given shape fragment into an original drawing. In humans, this ability is assessed with incomplete-drawing tasks. We introduce PainterBench, a benchmark that ports the incomplete-drawing task to the agentic setting. The agent draws on a canvas through tool calls and observes the result after every turn. The canvas includes a starting shape which cannot be erased, and the agent’s goal is to incorporate this shape into the most original drawing it can produce. The task is open-ended, and the agent itself decides when the drawing is finished. The benchmark tests incremental visual planning over a short horizon and the transfer of creative ability from pretraining to multi-turn tool use. We evaluate 14 multimodal language models from small to frontier scale. Across the primary study and six sensitivity analyses, we collect 2,700 drawings and crowdsource creativity and recognizability ratings for every drawing and for 300 human reference drawings. We also present ViDrA-adapted, an automated scorer that predicts human creativity ratings of agent drawings (r = 0.85 on random held-out test split). Figural divergent thinking varies widely across the 14 models, and GPT-6 Astra produces the most creative drawings. Relative to the human drawings, the agent drawings score higher in creativity but lower in recognizability. We release the final drawings, per-round canvas snapshots, tool call traces, stimulus bank, benchmark harness, crowdsourced ratings (N = 72,000), and ViDrA checkpoint.

[403] BIABench: Evaluating AI agents on real-world bioimage analysis tasks cs.AI | cs.CLPDF

Zixuan Pan, Davide Panzeri, Lukas Johanns, Marilin Moor, Yu Zhou

TL;DR: BIABench从已发表生物研究重建16项真实图像分析任务，联合评估智能体的分析结果质量与过程选择、质量控制能力。

Details

Motivation: 生物图像可能是大尺寸二维图、三维体数据或时间序列，智能体必须编写和运行代码、使用专门软件并检查渲染视图；此前缺乏能够端到端评估真实研究分析的基准。

Result: 16项任务覆盖11种分析子任务和多类成像模态。常规二维任务表现较好，但在部分新增三维或时间维度的任务上，没有智能体得分超过0.19；重复运行的分数波动也很大。

Insight: 将论文中的原始图像、研究问题和真值重建为任务，并分别比较输出文件和按专家规范评估分析过程，可验证端到端表现。过程评分或耗时无法在无真值时可靠判断结果对错。

Abstract: Artificial-intelligence (AI) agents hold promise for automating bioimage analysis, yet no benchmark evaluates whether they can carry out real-world analyses end to end. Such analyses are hard for agents because 2D images, 3D volumes and time-lapse sequences are often too large to read as context, so an agent must choose and run an analysis through code, specialized software and rendered views. Published studies make this capability testable, because each pairs raw images with a peer-reviewed result. We introduce BIABench, a benchmark of 16 tasks reconstructed from published biological studies that retain their scientific questions, imaging data and ground truth. The tasks span eleven analysis subtasks and modalities from H&E histology to single-molecule localization microscopy. Each submission receives an outcome score, which compares the output files with the ground truth using field-standard metrics, and a process score, in which a vision-language model judges method choice and quality control against an expert-written rubric. We evaluated general-purpose and biology-specific agents across several language models, with repeated runs of every task. Routine two-dimensional tasks were solved well, but on some tasks that added a third dimension or a time axis no agent scored above 0.19. Neither biological specialization, stronger models nor detailed expert instructions closed this gap. The agents were also unreliable, with scores varying more between repeated runs of one agent than between different agents, and without ground truth a correct run could not be told from a wrong one by its process score or by the time spent. Released openly with its data and code, BIABench provides a verifiable framework for evaluating, and eventually training, agents for reliable long-horizon bioimage analysis.

[404] ControlScope: Workflow Revision and Reliability in LLM Agents cs.AI | cs.CL | cs.SEPDF

Jingjie Ning, Xueqi Li, Yibo Kong, Dongting Li

TL;DR: ControlScope比较智能体在工作流中继续执行、修改下一次工具参数或整体替换剩余流程的修复范围，并追踪实际选择及后续执行结果。

Details

Motivation: 语言模型智能体发现工作流有问题时，可以修改的范围有多大、何时采用何种修复方式，会影响可靠性和成本；仅开放修复权限不足以说明智能体是否能正确选择和完成修复。

Result: 在文件系统、ALFWorld和AppWorld测试中，整体重写有时提高完成数，但不同审阅配置结果不一，AppWorld总体差别较小；五次调用上限使20次新运行的模型输出减少19.4%，只损失一次成功。

Insight: 将可用修复权限与实际采取的动作分开记录，并在冻结执行状态下回放，有助于发现智能体写出可行替代方案后又被后续修改打断的情况。局部参数修复可能比更广泛重写便宜，但策略有时会错过这一选项。

Abstract: How much of a running workflow should a language model agent revise? ControlScope compares continuing generated code, editing the next tool call’s data arguments, and replacing the unfinished workflow from the same public execution state. The nested permissions separate available repairs from the actions an agent selects. We evaluate one-time and repeated reviews across filesystem tasks, ALFWorld, and AppWorld. Across two source programs per task and three reasoning-reviewer draws on 20 filesystem tasks, FULL completes 15-16 tasks versus 13 for KEEP; across four fast draws it completes 10-13 versus 13. Fresh student-record confirmation reproduces a batch-read repair. ALFWorld fast panels yield KEEP/ARG/FULL scores of 85/86/87 on 87 tasks across 52 scenes and 134/134/127 on 134 tasks across four scenes; reasoning on the 87-task cohort also yields 85/86/87 with substantial review cost. An AppWorld V1 official-test panel of 585 task instances from 195 scenario templates shows small net differences. Frozen replays expose viable agent-written replacements interrupted by later revision in two failed file-organization runs. An offline source-trajectory midpoint comparison shows later reviews completing an insufficient repair. Five-call protection saves 19.4% of logged model output and loses one success across 20 fresh source runs. An argument-only shortcut shows that the broader sampled policy can overlook a cheaper successful edit available in both operation sets. These outcomes tie repair access to actual choices and subsequent execution.

[405] Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge cs.AI | cs.CLPDF

Chanuk Lee, Minki Kang, Sangwoo Park, Woongyeong Yeo, Jinheon Baek

TL;DR: FlyBy教小型推理模型判断当前瓶颈是可通过自我反思解决的执行问题，还是需要外部知识的知识问题，并在后一种情形选择性查询更强模型。

Details

Motivation: 增加测试时思考并不总能带来新解。干预实验显示，自我修正往往只是强化当前状态已能到达的答案；若正确路径需要外部信息，继续反思并不能突破知识瓶颈。

Result: 在六个基准的1,158道难题上，FlyBy-4B达到45.96% pass@8，超过Qwen3-14B的41.64%，服务成本低2.7倍；pass@1为16.85%，高于Qwen3-8B的15.31%。FlyBy-8B的pass@8进一步达51.81%。

Insight: 模型先进行自身推理，再诊断未解决部分；若是执行瓶颈就继续反思，若是知识瓶颈则按需查询知识更强的模型。成本感知强化学习同时校准是否查询、询问内容及查询预算。

Abstract: Scaling test-time computation is a powerful way to improve language-model reasoning, and is particularly appealing for small reasoning models (sRMs) that are cheap to serve. However, is additional thinking always the right operation? By intervening at intermediate reasoning states across two model families and multiple scales, we find that self-refinement largely consolidates probability mass onto solutions already reachable from the current state, rather than making new ones reachable. These interventions reveal two failure regimes: execution bottlenecks, where the correct path is reachable and reflection can recover it, and knowledge bottlenecks, where relevant external information makes it reachable. Motivated by this distinction, we introduce FlyBy, a selective querying framework, and train 4B and 8B variants to reason first, diagnose what remains unresolved, and, at a knowledge bottleneck, query stronger models whose parametric knowledge extends beyond its own. Supervised fine-tuning bootstraps a multi-depth query action, and cost-aware reinforcement learning calibrates whether to query, what to ask, and how much to spend. On 1,158 hard problems across six benchmarks, FlyBy-4B achieves 45.96% pass@8, surpassing Qwen3-14B (41.64%) at 2.7 times lower serving cost, while also exceeding Qwen3-8B in pass@1 (16.85% vs. 15.31%). Scaling to FlyBy-8B further improves pass@8 to 51.81%.

[406] Nudgeability: Reasoning Models Follow Confidence Signals Without Tracking Their Own Competence cs.AI | cs.CL | cs.LGPDF

Rohit Saxena, Utkarsh Upadhyay

TL;DR: Nudgeability用固定推理轨迹中的信心或怀疑提示，因果测量推理模型是否会据此改变直接回答或调用工具的选择。

Details

Motivation: 自我反思用于工具委派时，既要知道信号来源和呈现方式，也要检验它是否真正改变后续动作。模型对信心提示敏感，并不代表它能根据自身真实能力正确委派。

Result: 9种模型在两项任务中均明显响应信心语言：怀疑增加委派、信心减少委派，中位切换幅度20.6个百分点，较大型服务模型可达53至70个百分点。但被诱发的切换中位数仅42%方向正确，只比随机选择高2个百分点。

Insight: 在相同推理状态注入单句第一人称信心或怀疑，再比较反事实续写，可单独识别反思信号对委派的因果影响。敏感度和任务针对性应分开评估；当前模型信心语言是强控制接口，却很少与实际能力准确对齐。

Abstract: Reasoning language models that can call tools must decide during inference whether to answer unaided or delegate. Any self-reflection mechanism for this must answer three questions: where the reflective signal comes from (verbal reports, output distributions, hidden states, a separate predictor), how it is presented to the model (numerical prediction, confidence token, prompt injection), and whether it changes the model’s subsequent action. We isolate the third question. At a fixed point in otherwise identical reasoning trajectories, we insert a single first-person sentence expressing either confidence or doubt; the model then continues reasoning and chooses whether to answer directly or call a tool. Comparing these counterfactual continuations measures the causal effect of the reflective signal on delegation. We call this behavioral response Nudgeability and measure it along two dimensions: sensitivity, how strongly confidence and doubt change delegation rates, and targeting, whether delegation increases for problems the model cannot solve unaided and decreases for those it can. Across nine small-to-medium open-weight reasoning models from three families (Qwen, Gemma, and GLM) and two tasks, models are consistently sensitive: doubt increases delegation and confidence decreases it, with a median confidence-to-doubt swing of 20.6 percentage points, and 53 to 70 points for the larger provider-served models. This responsiveness is poorly targeted: a median 42% of induced flips are well-targeted, only a +2 percentage-point lift over a random-selection baseline. Confidence language is thus a strong control surface for delegation, but current models use it only weakly in accordance with their actual competence. Nudgeability offers a simple, post-training-free way to evaluate both sensitivity and targeting as endogenous self-reflection mechanisms mature.

[407] SeLMRoute: Probabilistic Semantic Evidence for Large Language Model Routing cs.AI | cs.CL | cs.LGPDF

Vasilis Perifanis, Nikolaos Pavlidis, Symeon Symeonidis

TL;DR: SeLMRoute先将查询转成候选模型无关、带概率的语义需求判断，再估计候选表现并按准确率或成本目标选择模型。

Details

Motivation: 多数路由器直接从查询向量、模型表征或相似样例学习选择，却很少明确表示问题需要何种推理或外部知识，因而难以灵活适配不同部署目标。

Result: 在15个数据集、20个候选模型和11,481条查询上，平均路由准确率为72.08%±0.45%，分组五折评估为72.64%，高于最强固定候选的69.23%。在13模型性能—成本设置中，五个分组划分均有提升，平均PerfGain为2.66%。

Insight: 把“查询需要什么”与“各候选模型对此表现如何”分离：决策模型对可解释语义问题输出概率分布，轻量路由器据此预测候选性能，部署目标最后再决定准确率或成本取舍。

Abstract: Large language model (LLM) routing aims to select the most suitable model for each incoming query. Most existing routers learn this decision directly from query embeddings, model representations, preference data, or clusters of similar examples. Such approaches can be effective, yet the representation used for routing rarely states what a query actually requires. We introduce SeLMRoute, a routing framework that separates the extraction of candidate-independent semantic evidence from the learning of candidate performance and the application of deployment objectives. A decision model first evaluates a set of interpretable questions about the query, such as its reasoning requirements and use of external knowledge, with each judgment retained as a probability distribution. The resulting probabilistic semantic state is used by a lightweight supervised router to estimate candidate model performance. Routing objectives are applied after performance estimation, which allows the same semantic state to support performance-oriented and cost-aware decisions. On the LLMRouterBench (15 datasets, 20 candidate models, 11,481 queries), SeLMRoute achieves an average accuracy of $72.08% \pm 0.45$, while grouped five-fold out-of-fold evaluation reaches $72.64%$, compared with $69.23%$ for the strongest fixed candidate. The representation achieves the highest mean performance among the evaluated semantic, dense, lexical, and domain-level representations. In a separate 13-model performance-cost setting, SeLMRoute improves performance in all five grouped splits, with a mean PerfGain of $2.66%$. Our code is available at https://github.com/Indigma-Innovations/SeLMRoute.

[408] 5W1H+Which: Context-Valid Semantic Indexing with Progressive Ontology Binding cs.AI | cs.CL | cs.IRPDF

Yaxiao Liu, Pengbo Liu, Yiwen Liu, Yihua Guan, Jiaxing Song

TL;DR: 5W1H+Which将来源内容抽取与任务本体绑定分开，以保留跨任务可检索证据，同时只让通过上下文和前提校验的绑定进入形式化推理。

Details

Motivation: 过早按单一业务模式筛选信息会让后续任务无法利用被丢弃的内容；只保留开放文本又不能为规则推理提供可核验前提。

Result: 论文提出语义索引机制、迁移示例和三组可证伪假设，计划与提供相同证据、时间信息和预算的强类型事实图基线比较。本文未宣称已有实验证明性能优势。

Insight: 5W1H组织来源内容单元，Which指向带版本的本体元素并记录映射、适用范围和验证状态；未绑定内容仍可检索，只有通过前提检查的内容才进入形式推理。有效时间、系统知情时间、操作轨迹和依赖记录用于上下文约束及绑定重验。

Abstract: Transforming raw data into queryable knowledge requires both early extraction of reusable information and explicit types, relations, and applicability conditions for particular tasks. If indexing selects content too early around a single business schema, later tasks may be unable to use information that was omitted. If the index retains only open-ended text, however, rule-based reasoning lacks checkable premises. We propose 5W1H+Which, a semantic indexing design that separates content extraction from ontology binding. The 5W1H questions organize source-grounded content units; Which points to versioned ontology elements and records mapping relations, scope, and validation status. Time, location, system environment, and participant roles are not merely retrieval labels: together, they constrain the contexts in which facts, bindings, and rules apply. Unbound content remains searchable, while bound content enters a formal reasoning path only after premise checks. The method further distinguishes business valid time, system knowledge time, and operational traces, and uses dependency records to support binding revalidation and the maintenance of derived conclusions. A worked example of migration from an on-premises server to a cloud environment illustrates the different treatment of world-state changes, ontology-version changes, and changes in rule applicability. We formulate three groups of falsifiable hypotheses concerning cross-task evidence coverage, control of contextual misuse, and incremental update cost. The planned evaluation includes a strong typed fact-graph baseline with the same evidence, temporal information, and budget, to test whether benefits arise from 5W1H organization, deferred binding, or additional information and engineering effort. The contribution is a testable indexing mechanism, not a claim to a new universal ontology or a demonstrated performance advantage.

[409] EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuning cs.AI | cs.CLPDF

Shihan Dou, Shaofan Liu, Zhonghang Lu, Jiahang Lin, Shichun Liu

TL;DR: EvoIn先在智能体执行框架中演化并验证决策程序，再将其改写成不依赖框架指令的推理轨迹并微调模型，使改进能力内化。

Details

Motivation: 联合演化工具、决策步骤和模型的工作常把多种变化混在一起，难以判断智能体决策程序本身如何改进，也无法确认能力是否脱离修改后的框架仍能保持。

Result: 在多种基准上，EvoIn域内通过率提高10.9个百分点、域外提高9.2个百分点，且内化程序能泛化到未见任务和另一模型系列。

Insight: 执行轨迹用于提出程序，先临时放入工具框架验证有效性；随后把受其引导的轨迹重写为模型自身的独立推理，移除框架提示，再用这些轨迹微调，从而测试并实现无需改造推理时框架的程序内化。

Abstract: Recent work has explored improving agents by jointly evolving their harnesses and models, but often takes a ‘’potpourri’’ approach that bundles together new tools, new decision-making procedures, and model adaptation to the evolved harness under a single notion of agent improvement. In this paper, we instead investigate how agents can improve their decision-making procedures. In particular, we propose EvoIn, an agent fine-tuning framework that bridges evolution and internalization. EvoIn first analyzes agent execution traces to evolve and validate new decision-making procedures by temporarily instantiating them in the harness. The validated procedures guide the agent to generate improved reasoning traces. These traces are then rewritten into self-contained reasoning traces, removing explicit references to harness instructions while expressing the induced decision logic as the model’s own reasoning. Finally, EvoIn fine-tunes the model on the rewritten traces, internalizing these procedures so that the improved decision-making persists without the evolved harness at inference time. We evaluate EvoIn on diverse benchmarks and find that it consistently enables agents to learn stronger decision-making procedures, raising the pass rate by 10.9 points in-domain and by 9.2 points out-of-domain. Results further show that the internalized decision procedures generalize to unseen tasks. Case studies show that agents can learn to decide how to solve a task before solving it, for example by checking a document’s length to choose between reading it in full and searching it. EvoIn is also broadly applicable, showing consistent improvements on another model family.

[410] Jailbreaks for Black-Box Uncertainty Quantification in Large Reasoning Models cs.AI | cs.CL | cs.LGPDF

Lucas Biechy, Cédric Eichler, Adrien Boiret, Nicolas Anciaux

TL;DR: J4U通过提示级松弛扩大黑盒推理模型的有效输出分布，以改善无法访问logit时的不确定性估计和置信度校准。

Details

Motivation: 强化学习对齐常使大型推理模型系统性过度自信；生产API可能不提供logit。复述一致性和口头置信度等黑盒方法对简单重复采样的改进很小，可能因为对齐压缩了有用输出变化。

Result: 在三个数据集、四种推理模型（包括闭源生产模型）上，相较最强黑盒不确定性基线，J4U在多至六倍数量的模型—数据集—指标组合中达到统计显著提升，平均ECE降幅最高为基线的五倍。

Insight: 提示级松弛近似更强KL正则化对应的参考策略行为，理论上有助校准；J4U以源自越狱提示的方法实现这种松弛，并实证呈现理论预测的行为特征。

Abstract: While Large Reasoning Models (LRMs) excel at complex reasoning, alignment through reinforcement learning often induces systemic overconfidence. In production environments, where logits may be unavailable, robust black-box uncertainty quantification (UQ) is essential for trustworthiness and safety. Focusing on question-answering for LRMs, we show that existing black-box methods, such as paraphrase-based self-consistency and confidence verbalization, offer little to no improvement over simple repeated sampling, suggesting that alignment suppresses useful output variability. We introduce prompt-level relaxation operators that broaden the model’s effective output distribution by approximating the effect of an optimal policy obtained with a stronger KL-regularization parameter, hence closer to the reference model. Theoretically, we demonstrate that relaxation improves calibration. We propose Jailbreak for Uncertainty (J4U), a jailbreak-derived technique for UQ that empirically reproduces the behavioral signatures predicted by our relaxation theory. Across 3 datasets and 4 LRMs, including a closed-source production model, J4U’s improvement over repeated sampling achieves statistical significance in up to 6 times more LRM-dataset-metric settings than the strongest black-box UQ state-of-the-art baseline we evaluate, with average ECE reductions up to 5 times larger. These results provide a practical tool for UQ in black-box LRM deployment.

[411] Self-Adapting Group of Experts for Multi-Agent Reasoning cs.AI | cs.CL | cs.MAPDF

Mohammad Atif Quamar, Nurbek Tastan, Karthik Nandakumar, Junpei Komiyama

TL;DR: SAGE从多智能体的初始回答中识别适合当前问题的推理策略捐赠者，再将其策略迁移给其他专家并按得分动态传递信息。

Details

Motivation: 多智能体框架通常通过改变上下文来调整交流，却保持各代理的系统提示不变；当问题需要不同技能时，固定策略可能限制协作效果。

Result: 在多个代理骨干和推理基准上，免训练的SAGE平均准确率高于所评估基线；摘要未报告具体数值。

Insight: 利用回答一致性、前缀一致性和互评选策略提供者，再只基于原始系统提示迁移其推理策略，无需暴露问题或生成答案；后续通过稀疏有向无环图让高分代理向低分代理传递信息，同时保留角色设置。

Abstract: Multi-agent systems bring together language model agents with different roles to propose, review, and refine solutions. Each agent’s response depends on its model’s capabilities, the reasoning strategy defined by its system prompt, and the information in its input context. Existing frameworks often adapt communication by changing this context while leaving individual prompts fixed, even when a problem calls for different skills. We study whether agents’ initial responses can identify a strategy better suited to the current problem and guide its transfer to other agents. To address this, we introduce SAGE (Self-Adapting Group of Experts), a training-free framework that uses answer agreement, prefix consistency, and reciprocal peer review to select a strategy donor. SAGE transfers the selected donor’s reasoning strategy to the other agents while preserving their original roles. This transfer uses only the agents’ original system prompts, without access to the problem or generated solutions. After strategy adaptation, agents exchange responses through a dynamic, sparse directed acyclic graph that routes information from higher-scoring agents to lower-scoring agents. Experiments across multiple agent backbones and reasoning benchmarks show that SAGE achieves higher average accuracy than the evaluated baselines. Our code is available at https://github.com/atifquamar07/sage.

[412] Representation Alignment as a Bottleneck in LLM-Based Retrosynthesis Planning cs.AI | cs.CLPDF

Hyunwoo Yoo, Cassie Huang, Haebin Shin, Li Zhang, Gail L. Rosen

TL;DR: 将逆合成规划分解为分子映射、反应映射和PDDL生成后，模型能在端到端SMILES转PDDL失败的情况下取得较高成功率。

Details

Motivation: LLM具备通用推理能力，但化学符号规划仍困难。直接从SMILES生成PDDL迫使模型同时分析化学和组织规划语言，可能造成表示对齐负担，而非模型容量不足。

Result: 分阶段方案取得较高成功率，优于失败的端到端尝试；摘要未给出精确数值或具体基准数据。

Insight: 把分子和反应中间结构显式化，为化学推理与符号规划语言搭桥，表明主要瓶颈可能在表示对齐。本文强调结构化中间表示的重要性，而不是单纯扩大模型。

Abstract: While LLMs show promise in general reasoning, symbolic planning in chemistry remains a bottleneck. Direct ‘’SMILES-to-PDDL’’ attempts fail because they force models to juggle chemical analysis and planning-language structuring simultaneously. We hypothesize that this failure stems from a lack of intermediate abstractions rather than insufficient model capacity. By decomposing retrosynthesis into molecule mapping, reaction mapping, and PDDL generation, we achieve high success rates where end-to-end approaches fail. This provides evidence that a primary bottleneck lies in representation alignment rather than raw model capacity. Our structural analysis demonstrates that intermediate representations are essential in retrosynthesis planning, highlighting the importance of representation-centric design in future systems.

[413] TCSAlgBench: Benchmarking Automated Proving for Research-Level Theoretical Computer Science cs.AI | cs.CLPDF

Chutong Yang, Xiyuan Zhang, Yu Huang, Boran Han, Soonho Kong

TL;DR: TCSAlgBench提供来自理论计算机科学研究论文的398项定理级证明发现任务，并比较模型直接推理、证明者—验证者讨论及智能体工作流。

Details

Motivation: 竞赛数学表现无法充分代表研究级推理；理论计算机科学将算法设计与明确保证、基本下界相连，适合检验模型能否给出人可审查的计算改进证明。

Result: 基于138篇STOC和COLT 2026论文构建的完整基准上，GPT-5.6 Sol max经10轮讨论的五次验证通过覆盖率最高为23.6%；GPT-5.5 xhigh智能体对比中，规划式工作流最高为25.4%。讨论和重复采样均改善覆盖率。

Insight: 专家规则补齐论文背景、保留计算假设和定量保证，并在算法构造本身为挑战时隐藏构造。可刷新、版本化任务批次使新论文可持续纳入评测；对比需匹配模型调用预算，以分离工作流贡献。

Abstract: Large language models perform strongly on competition mathematics, but their research-level reasoning remains difficult to evaluate systematically. Theoretical computer science (TCS) connects algorithm design to explicit guarantees and fundamental limits, providing a setting for evaluating whether models can justify computational improvements with arguments humans can inspect. We introduce TCSAlgBench, a benchmark and reusable pipeline for natural-language proof discovery, comprising 398 theorem-level challenges from 138 STOC and COLT 2026 papers. Expert-designed rules complete paper-specific context, preserve computational assumptions and quantitative guarantees, and withhold constructions when discovering an algorithm is part of the task. For each task, prover systems receive theorem statements and access to cited prior work. The pipeline supports fresh, versioned challenge batches from newly released papers. We evaluate ten model configurations from four families under direct inference and prover-verifier discussion, and compare four agent workflows under matched model-call opportunities. All evaluations use the full benchmark. In the model comparison, GPT-5.6 Sol max achieves the highest five-run verifier-accepted coverage at 23.6% after 10-round discussion. Discussion and repeated sampling improve coverage. In the separate agent comparison using GPT-5.5 xhigh, decomposition improves coverage over discussion, and agentic planning achieves the highest five-run verifier-accepted coverage at 25.4%. TCSAlgBench provides a refreshable testbed for measuring progress in model reasoning and studying how agent workflows support research-level proof discovery.

[414] Reinforcing Agentic Creativity in Scientific Ideation with Night Science cs.AI | cs.CLPDF

Priyanka Kargupta, Silviu Cucerzan, Shweti Mahajan, Allen Herring, Jiawei Han

TL;DR: AI Night-Scientist以行动、探索过程和想法结果三个层面强化学习科学创造力，引导模型在可控时机偏离常规推理。

Details

Motivation: 大语言模型擅长结构化、可验证任务，但低熵偏好会生成同质而可预测的答案，不利于开放式科学构思；发现也需要更松散、偶然性更强的探索阶段。

Result: 相较基础模型，研究方向覆盖广度提升27.8%，贡献类型提升14.9%；预测引用影响最高提高32.0个百分点，原创性提高66.2个百分点。单纯提高解码温度无法复现收益。

Insight: 创造力不只是随机增加输出多样性，而可分解为做什么及多新颖、何时探索或利用、最终想法有多新颖且有用。语义引导明确指定要追求的创造类型，是有效塑造创造性的重要因素。

Abstract: Large language models (LLMs) excel at structured, verifiable tasks, but their low-entropy bias can produce homogeneous and predictable outputs, limiting their utility for open-ended scientific ideation. Effective discovery, however, spans a broader creative spectrum: from structured day science to loosely structured, serendipitous night science that reaches ideas beyond those typically considered. We introduce AI Night-Scientist, an agentic framework that uses reinforcement learning to teach models when and how to depart from predictable reasoning. Grounded in cognitive science, we model creativity along three axes: action (what to do and how creatively), process (when to explore versus exploit), and outcome (the novelty and usefulness of the resulting idea). We use these axes to train models with GRPO, exposing them to varying degrees and forms of creativity throughout training. This produces substantially more diverse scientific proposals, expanding the range of research directions by 27.8% and contribution types by 14.9% over the base model. It also improves predicted citation impact by up to 32.0 percentage points and originality by 66.2 points. These gains cannot be reproduced by simply increasing decoding temperature; instead, we find that semantic guidance specifying what kind of creativity to pursue is critical. Overall, our results suggest that creativity is a learnable, multi-level ability that can be shaped to help researchers reach ideas beyond those typically explored by LLMs.

[415] When Helpful Text Hurts: Option-Redirecting Bias in Vision-Language Models cs.AI | cs.CVPDF

Tam Le Thi Thanh, Hoang Tran Van, Hong-Hanh Nguyen-Le, Thanh Duc Ngo

TL;DR: 本文发现VQA中最危险的辅助文本是迎合问题却违背图像并支持某个干扰选项的内容，并提出推理时抵消此类答案偏转的方法。

Details

Motivation: 三模态视觉问答会加入辅助文本，但其可靠性常未受控。不同不可靠文本如何影响固定图像、问题和选项下的答案选择尚不清楚，错误程度也不等同于误导强度。

Result: 在ScienceQA、VCR、A-OKVQA和Causal-VidQA等数据集上，支持干扰选项的文本最多使准确率下降53.1%，并将错误集中到特定选项。提出的免训练干预减少偏转错误，同时基本保留忠实文本场景表现。

Insight: 用文本可靠性阶梯分别控制图像一致性、问题相关性和选项支持度，揭示需要在决策层评估辅助信息，而不只看文本事实真假。噪声稳定引导与动态视觉落地可在推理时抑制被引向干扰选项。

Abstract: In tri-modal visual question answering (VQA), auxiliary text is commonly used to complement visual and textual inputs, yet its reliability is often uncontrolled. While prior work studies modality conflicts in general, it remains unclear how different types of unreliable auxiliary text affect answer selection under fixed image-question-option contexts. In this work, we show that the most harmful auxiliary text is not necessarily the most factually incorrect, but the one that aligns with the question while contradicting the image and favoring a specific distractor, leading to systematic redirection of model predictions. To isolate this effect, we introduce the Textual Reliability Ladder, a controlled diagnostic protocol that decomposes auxiliary text along three axes: image consistency, question relevance, and option support. Across multiple datasets (ScienceQA, VCR, A-OKVQA, Causal-VidQA) and recent VLMs, we find that such distractor-supporting text induces the largest accuracy drops (up to 53.1%) and concentrates errors on specific incorrect options. To mitigate this failure mode, we propose a training-free inference-time intervention that explicitly counteracts this redirection effect via noise-stability steering and dynamic grounding, reducing redirected errors while largely preserving performance under faithful text. Our results highlight that auxiliary-text reliability must be understood at the decision level, rather than solely through factual correctness, and provide a practical pathway toward more robust tri-modal reasoning.

Yuhao Du, Shunian Chen

TL;DR: 本文形式化多模态Transformer的细分对称性：在内容、位置、可见上下文和总质量不变时拆分表示不应改变贡献，并提出测度加权注意力。

Details

Motivation: 注意力输出依赖token数量，但同一信号可用不同粒度表示；仅改变分块或帧采样就影响答案，说明模型对表示细分不稳健。

Result: Qwen2.5-Omni-7B复制一半视觉token三次时，标准注意力令3,586个MVBench答案中的255个改变，而测度加权对照下答案全不变，且减少自然帧重采样漂移。冻结视频编码两倍合并时，五种子评估比全局计数权重高1.04个百分点，比标准注意力高0.93个百分点；WorldSense也有收益，但依赖压缩预算。

Insight: 在固定正注意力核且局部质量因子单调时，拆分不变性要求质量因子线性；更一般的表示变化中，可通过物理耦合分解特征变化与权重重分配，界定注意力误差。它提供跨分区鲁棒性原则并有实测收益。

Abstract: Attention weights depend on token counts, which change with the representation of a signal. We study refinement symmetry: splitting a representation while preserving content, position, visible context, and total mass should preserve its contribution. Building on proportional and quadrature attention, we show that split invariance forces the local mass factor to be linear for any fixed positive attention kernel, provided that factor is nondecreasing. For changed representations, a physical coupling bounds attention error by separating feature change from weight reallocation. In Qwen2.5-Omni-7B, duplicating half the visual tokens threefold changes 255 of 3,586 MVBench answers under standard attention; measure weighting preserves every answer under matched visibility. Under natural frame resampling, it reduces distributional drift. At twofold merging of a frozen video encoding, a five-seed evaluation shows an all-partition-correct accuracy gain of 1.04 percentage points over global count weighting (average group mass) and 0.93 points over standard attention. The advantage over global count also holds on WorldSense but depends on the compression budget. The result is a representation principle with a measured benefit in robustness across partitions.

[417] Readout is not Recovery: Dissociating Coordinate Emission from Visual-Corruption Repair in Vision-Language Models cs.AI | cs.CV | cs.LGPDF

Drandreb Earl Juanico

TL;DR: 本文区分VLM坐标token读出与视觉受损后的定位恢复，指出坐标输出电路不等同于能修复遮挡或图像破坏的机制。

Details

Motivation: 边界框token易解析、易打分，但能生成坐标的模型维度未必能在视觉证据受损后恢复定位；两种能力常被混为一谈。

Result: 在Qwen3-VL-4B中，坐标token排名在第24层前无作用、32至35层开始关键、第34层最强；由图像损坏恢复得到的排名则在16至24层有害、接近第35层/最终层才有益。不同预算下掩码恢复结果显示需要性和恢复效果并不相同。

Insight: 分别用干净输入坐标读出和目标遮罩替换后的恢复能力建立排序，可定位输出邻近坐标通路，但这只是电路先验，不等于存在可靠固定修复集。部分遮挡测试进一步表明，高重叠坐标token集在小预算时也可能伤害恢复。

Abstract: VLM bounding-box localization is both language generation and spatial commitment. Parseable fields such as bbox_2d make localization easy to score, but dimensions that emit coordinate tokens need not repair localization after visual evidence is damaged. We study this readout/recovery separation in Qwen3-VL-4B-Instruct on single-object COCO grounding. We compare clean coordinate-token readout rankings with corruption-derived repair rankings, using object-mask endpoint replacement for recovery and clean-input flooring for depth localization. In Qwen3-VL, coordinate-token rankings are inert through layer 24, load-bearing from layers 32-35, and peak at layer 34; corruption-derived rankings harm layers 16-24 but become beneficial near layer 35/final. A Kimi-VL-A3B diagnostic shows a matching output-proximal transition despite a different box format. Object-mask recovery separates rank budgets: $k=250$ shows necessity, $k=500$ shows Top-$k$ restoration above random, and $k=d/2$ is largely capacity-driven. Partial-occlusion sweeps reveal that high-overlap coordinate-token sets can hurt at $k=1000$ and help mainly at half-width, while population corruption-derived sets provide no reliable fixed repair set. Edge-attribution patching shows coordinate-token paths are high precision but low recall for detection recovery, and RMSNorm quasi-layer controls do not close the endpoint-repair gap. Endpoint coordinate triage is therefore a useful circuit prior, but occlusion recovery requires a separate benchmark.

[418] PlanGuard: A Guardrail for Multi-Step Plan Safety in Embodied Agents cs.AI | cs.CR | cs.CV | cs.ROPDF

Junchi Chen, Changtao Miao, Yuxiao Xiang, Zhenchao Jin, Haojie Yuan

TL;DR: PlanGuard在执行前评估完整多步具身计划与当前环境组合产生的物理风险，而非仅检查单步动作或语义危害。

Details

Motivation: 多步计划中的子任务依赖和环境交互会形成组合性物理风险；通用防护主要关注语义伤害，具身安全检测又常孤立评估子任务，容易漏掉计划级危险。

Result: MSP-Safe任务定向微调后仍存在小模型与强教师间差距；采用STAC-OPD后，PlanGuard-2B在所有测试子集平均准确率87.15%、F1 87.21%。

Insight: 强教师沿学生自生成轨迹提供自适应指导：token级迁移微调教师分布，序列级按概率路由补偿；学生若偏向参考安全判定就保留学生目标，否则使用教师重建目标。

Abstract: Embodied task planners may produce multi-step plans whose subtask dependencies and interactions with the environment create physical risks during execution. Yet existing safeguards overlook such compositional risks, as general-purpose guardrails focus on semantic harm and embodied safety detectors assess subtasks in isolation. To address this gap, we introduce PlanGuard, the first pre-execution detector that evaluates the physical safety of a complete multi-step plan in its current environment. For training and evaluation, we construct a Multi-Step Plan Safety (MSP-Safe) dataset through paired task construction, plan generation using diverse planners, and safety annotation by three judges. Task-oriented SFT on MSP-Safe establishes fundamental plan-safety assessment capabilities, yet a substantial gap remains between compact models suitable for real-time deployment and stronger but costlier large models. Accordingly, we propose Strong-Teacher Adaptive Compensation for On-Policy Distillation (STAC-OPD), which provides compact models with adaptive strong-teacher supervision along their on-policy trajectories. It combines token-level distribution transfer from a fine-tuned strong teacher with probability-routed sequence-level compensation, retaining student-generated targets when the student favors the reference safety decision and using teacher-reconstructed targets otherwise. Across all test subsets, PlanGuard-2B achieves average 87.15% ACC and 87.21% F1, demonstrating effective whole-plan physical-risk detection at compact model scale. Code and dataset will be publicly released.

[419] WorldAgent: Verification-Guided Agentic Physical World Construction cs.AI | cs.CVPDF

Caoliwen Wang, Mengdi Wang, Yige Chen, Zejia Wu, Bowen Huang

TL;DR: WorldAgent将单条自然语言描述展开为物理世界规格、场景和数值模拟，并在每个构建步骤后检查几何、模拟状态和渲染结果。

Details

Motivation: 从语言构造复杂物理世界需协调三维环境、不同尺度的结构对象和物理过程，还要满足隐含物理约束；反复依赖用户调试不实用。

Result: 在AgenticSimBench七项指标中的五项，WorldAgent得分高于所比较的智能体方法；26人用户研究中，四项标准的平均评价均最高。

Insight: 构建层生成结构化规格并运行模拟，验证层逐步检查场景和渲染；失败检查自动触发规格修订及相关步骤重跑。只有通过必要检查的世界才接受，并可继续编辑和重新模拟。

Abstract: Constructing complex physical worlds from language requires coordinating extensive 3D environments, detailed structures and objects at different spatial scales, and interacting physical processes under both stated goals and implicit physical constraints. We present WorldAgent, an agentic framework for verification-guided physical world construction from a single natural-language prompt, without iterative user debugging. A world construction layer expands the prompt into a structured world specification and uses physical knowledge to build scenes and run numerical simulations. After every step, a verification layer inspects scene geometry and simulation states alongside rendered views. Failed checks guide automatic revisions to the specification and re-execution of the affected steps. Accepted worlds pass the required checks and remain editable for further inspection and resimulation. We introduce AgenticSimBench, on which WorldAgent achieves the best scores among the evaluated agent-based methods on five of seven metrics. In a 26-participant user study, it receives the highest mean ratings across all four criteria.

[420] A Computer Vision Approach to Visual Fraud Detection in Phishing Websites Using YOLOv8 cs.AI | cs.CVPDF

Basil Sajid Shaikh, Hajar Homayouni

TL;DR: 本文用YOLOv8直接分类网页截图是否为钓鱼页面，依据品牌布局、标志、配色和登录框等视觉线索识别伪装网站。

Details

Motivation: 基于URL、HTML或域名历史的传统检测信号容易被攻击者轮换或混淆，也没有直接衡量页面视觉伪装如何诱使受害者提交凭证。

Result: 留出测试集分类准确率92%，单张截图推理约100毫秒；针对照明、压缩和缩放的数据增强使误报率较增强前下降11%。

Insight: 把渲染网页视作图像分类对象，可捕捉攻击者仿冒品牌的整体视觉布局，而不依赖页面文字解析。作者将其定位为与URL和内容检测互补的防御信号。

Abstract: Phishing remains one of the most common vectors for financial and identity fraud, and most detection systems still rely on inspecting a page’s URL, HTML markup, or domain registration history. These signals are easy for an attacker to rotate or obfuscate, and they say very little about what actually convinces a victim to hand over a password or a card number: the way the page looks. This paper describes a visual, image-based approach to phishing detection that treats a rendered webpage the same way a human eye would, as a picture that either matches a trusted brand or doesn’t. A YOLOv8 convolutional neural network was trained to classify full-page website screenshots as phishing or legitimate based on layout, logo placement, color scheme, and login-form structure, rather than on text extracted from the page. The system reached 92% classification accuracy on a held-out test set, processed a single screenshot in roughly 100 milliseconds, and, after a round of data augmentation aimed specifically at lighting, compression, and scaling variation, cut the false-positive rate by 11% relative to the pre-augmentation baseline. The paper walks through the dataset construction, the augmentation strategy, the model architecture and training setup, and the resulting performance, and closes with a discussion of where this kind of visual detector fits alongside, rather than instead of, existing URL- and content-based defenses.

[421] K-OPSD: Verifiable On-Policy Self-Distillation for Post-Training Vision-Language Models on AEC Drawings cs.AI | cs.CVPDF

Yunfei Bai, Enrico Chionna, Akash Amol, Kawaljit Singh KC, Joern Tinnemeyer

TL;DR: K-OPSD用模型自身经过程验证器认证的最佳生成构造教师，再对学生自生成轨迹中的已验证完成进行交叉熵在线自蒸馏，提升建筑图纸理解。

Details

Motivation: 建筑、工程和施工图纸需要专业空间阅读能力，通用MLLM和VLM难以理解。在线蒸馏还需处理失败提示和可靠的过程级验证。

Result: 在AECV-Bench上微调的Qwen3-VL平均评审分0.819、综合准确率0.738，达到最高评审分并与开源基线有竞争力；迁移到域外ArchCAD时8B模型收益最大。

Insight: 从自身best-of-N回答中选经验证器认证的教师答案，失败提示在透露已验证答案的提示下重采样；再沿策略自身轨迹对验证完成做交叉熵更新，优于有界token级广义JSD蒸馏。作者将结果视为初步证据。

Abstract: Interpreting architecture, engineering, and construction (AEC) drawings is hard for general Multimodal Large Language Models (MLLMs) and vision-language models (VLMs). We introduce K-OPSD, a VLM post-training methodology for improving AEC drawing understanding. Building on On-Policy Self-Distillation (OPSD) with verifiable supervision, we construct a teacher from the model’s own best-of-N generations, certified by a process-level verifier, and rescue failed prompts by resampling under a hint that exposes the verified answer. We then perform an on-policy model update by training on verified completions with a cross-entropy inner-loss, outperforming the bounded token-wise generalized Jensen-Shannon divergence (JSD) used by on-policy distillation. Using K-OPSD, we fine-tune Qwen3-VL models on the AECV-Bench dataset. The resulting models attain the top average judge score (0.819) and combined accuracy (0.738), achieving competitive results against open-source baseline models. The recipe transfers to the out-of-domain ArchCAD dataset, where the 8B model gains most. We present the verifier suite and the continual learning and self-improving pipeline, our results provide preliminary evidence that verifier-guided self-distillation is a promising route toward more reliable machine reading of architecture drawings.

[422] Decision Readouts for Text-Mediated Video Anomaly Detection: An Exploratory Evaluation of Jev and Qwen cs.AI | cs.CVPDF

Xukui Qin, Youting Wang, Xinjie He, Ziyang Luo, Runxiong Wu

TL;DR: 本文在固定视频文字证据上比较Jev与Qwen不同决策读出方式，探索文本化异常检测中评分接口对排序和概率质量的影响。

Details

Motivation: 如果输入证据不变，不同决策读出对视频异常检测结果影响多大？现有试验样本稀疏且极不平衡，还需区分接口有效性与数值校准。

Result: XD-Violence字幕上Jev Noul平均精度75.99%，高于Qwen生成概率48.47%及更强局部序数似然期望57.81%；但UCF字幕ROC-AUC上Noul为52.26%，低于序数似然65.95%。两种概率读出在UCF上的Brier分数均劣于流行率参照。

Insight: 本研究是40段视频、400个目标锚点的探索性离线评估；Jev Choice在严格数值规则下仅800次返回776个有效结果，阻碍完整覆盖比较。数据不支持因果归因或普遍优越结论，且缺少二元似然控制。

Abstract: How much does the decision readout matter when video-derived textual evidence is held fixed? We evaluate Jev typed decisions and three Qwen readouts on a sparse development sample of 40 videos and 400 target anchors from UCF-Crime and XD-Violence, each presented as a summary and ordered captions. Each dataset contributes 20 source groups and 200 anchors, including only 10 and 37 positives, respectively. The original five-backend pilot requested 4,000 predictions; Jev Choice returned 776 valid responses out of 800 under the study’s strict numerical policy, blocking its full-coverage quality comparison. On XD captions, Jev Noul achieved 75.99% average precision versus 48.47% for Qwen generated probability and 57.81% for the stronger local ordinal-likelihood expectation. The latter paired difference was 18.18 percentage points (95% source-group bootstrap interval 5.53-31.50). UCF did not show a corresponding advantage: caption ROC-AUC was 52.26% for Noul and 65.95% for ordinal likelihood. Both probability readouts had higher, hence worse, UCF Brier scores than the evaluation-prevalence reference of 0.0475. We additionally audit historical LAVAD scores at exactly matched anchors and distinguish response structure from numerical consistency. A binary-likelihood control is missing. These exploratory offline results characterize ranking, probability quality and interface failures; they establish neither a causal typed-interface benefit nor general superiority, calibration or end-to-end acceleration.

[423] MoSPR: Histology-to-Gene Expression Prediction with Morpho-Spatial Macrostates and Low-Rank Molecular Programs cs.AI | cs.CV | cs.LGPDF

Dongmyung Shin, Geongyu Lee, Yesung Cho, Park Jong Bae

TL;DR: MoSPR用空间邻接宏状态表示组织化组织形态，再线性映射到低秩基因表达程序，预测病理切片中的分子谱并保留可解释分解。

Details

Motivation: 全切片图像包含空间组织的异质形态，基因表达则包含数千个相关目标，二者跨模态对齐和高维预测都具挑战。

Result: 在TCGA三个癌症队列中，MoSPR基因表达预测均分最高；无通路监督时，三套通路集合九项比较中八项排名第一。乳腺癌只用一半训练数据就超过最强对手的全量数据分数。

Insight: 先把冻结patch嵌入聚成形态微状态，再按训练队列空间邻接模式聚成宏状态；每张切片以全局形态和宏状态偏差表示，映射至低秩表达基系数。线性形式还能精确分解全局与局部分子贡献。

Abstract: Predicting molecular profiles from histopathology remains challenging because whole-slide images contain spatially organized, heterogeneous tissue patterns, while gene expression comprises thousands of correlated targets. We introduce MoSPR (Morpho-Spatial Program Regression), a linear framework that couples an adjacency-informed histology representation with a low-rank molecular basis. MoSPR clusters frozen patch embeddings into morphology microstates, aggregates their spatial adjacencies across the training cohort, and groups microstates with similar adjacency patterns into shared macrostates. Each slide is then represented by global morphology and macrostate-specific deviations, which are linearly mapped to coefficients of a training-derived low-rank gene-expression basis. Across three cancer cohorts from The Cancer Genome Atlas, MoSPR achieves the highest mean gene-expression prediction scores among all evaluated methods. Without pathway-level supervision, pathway scores derived from its predicted expression profiles rank first in eight of nine comparisons across three pathway collections. Ablation studies on the breast cancer cohort show complementary gains from adjacency-derived macrostate representation and low-rank molecular prediction. Moreover, with half of the training data on this cohort, MoSPR exceeds the full-data gene-prediction score of the strongest competing baseline. Finally, its linear formulation enables exact decomposition of each predicted expression profile into global and macrostate-specific molecular contributions, providing an interpretable link between spatially coherent macrostate regions and their associated molecular programs. Our code is available at https://github.com/Radisen-Panthera/MoSPR.

[424] Privacy-Preserving Full-Body Meshing from mmWave Radar via Mesh Foundation Model Supervision cs.AI | cs.CVPDF

Shuxing Zhang, Yongquan Ni, Zhenyu Ding, Yawen Lin

TL;DR: 该跨模态教师—学生方法从单帧RGB得到全身公制3D网格伪标签，训练商用毫米波雷达直接重建逐帧人体网格及关节不确定性。

Details

Motivation: 单芯片商用毫米波雷达点云极稀疏，平均每帧约6.5点、约28%帧为空，使既有工作多局限于关键点或动作分类，不能恢复完整人体网格。

Result: MM-Fi跨受试者评估的12关节MPJPE为7.45厘米；自建同步雷达和RGB-D数据端到端误差21.47厘米，髋部4.8厘米、手腕34.7厘米。推理仅需雷达输入，无相机或图像。

Insight: SAM 3D Body从单帧RGB零样本生成70关节、18,439顶点教师标签；学生采用掩码注意力集合编码、时序Transformer和CVAE多假设头，并输出逐关节方差诚实表征不可见性。数据多样性而非单纯样本量是扩展瓶颈。

Abstract: Millimeter-wave (mmWave) radar enables privacy-preserving human perception, but the extreme sparsity of point clouds from commercial single-chip sensors (mean ~6.5 points/frame; ~28% empty frames) has confined prior art to body-part keypoints or discrete action classification. We present a cross-modal teacher-student framework that lifts commercial radar to full-body, per-frame, metric 3D mesh reconstruction with per-joint uncertainty. Three innovations: (1) a mesh-foundation-model teacher - SAM 3D Body produces whole-body MHR ground truth (70 joints, 18,439 mesh vertices) from a single RGB frame with zero training, slashing annotation cost by orders of magnitude; (2) StudentPoseFormer - set encoding with masked attention pooling, a temporal Transformer, and a CVAE multi-hypothesis head that outputs both the pose mean and per-joint variance, honestly reporting where the radar cannot see; and (3) a multi-stage ground-truth quality pipeline (confidence gating, depth validation, temporal smoothing, bone-length consistency, bad-frame rejection) plus systematic information-lever ablations. On the public MM-Fi benchmark (same TI IWR6843 sensor, cross-subject), our full configuration reaches 7.45 cm 12-joint MPJPE, with ablations proving the causal value of point accumulation (k = 3, -0.34 cm), Doppler (-0.85 cm; -2 cm at the wrist on fast actions), and velocity loss (-0.27 cm). On our own synchronized radar + RGB-D corpus with block-level held-out splits, the pipeline achieves 21.47 cm end-to-end (per-joint hierarchy from 4.8 cm at the hip to 34.7 cm at the wrist - matching physical information limits), could be improved to 15 cm with ~30k diverse samples, and a scaling law shows sample diversity, not volume, is the binding constraint. Deployment inference is radar-only - no camera, no image.

[425] JRDB-AVR: An Active Visual Reasoning Benchmark for Embodied Agents in Real-World Environments cs.AI | cs.CV | cs.ROPDF

Zhixi Cai, Fucai Ke, Sukai Huang, Maria Garcia de la Banda, Peter J. Stuckey

TL;DR: JRDB-AVR评估具身代理能否主动请求特定时间和视角的有限观察，并以证据落地程度和最终答案双重衡量视频推理。

Details

Motivation: 具身视觉推理问题的证据可能分散在时间、视角和互动对象中；有限视野模型可能没看过相关证据却给出看似合理答案。被动观察基准难以发现此类无依据作答。

Result: 基于真实JRDB机器人数据构建的评测显示，现有基线答案准确率与证据准确率之间存在明显差距，模型可能答对但未观察到支持证据。

Insight: 基准要求系统按时间戳和观察角度请求受限视觉信息，并同时评估答案及其依据；参考代理维护显式、观察落地的图结构世界模型后再求解，以测试主动证据采集。

Abstract: In complex embodied visual reasoning scenarios, an agent often has only a limited field of view, and the evidence needed to answer a question may be distributed across time, viewpoint, and interacting objects. A model may therefore give a plausible answer without ever observing the relevant object, time, or view that supports it. Current visual reasoning benchmarks largely evaluate passive observations and final answers, overlooking settings that require active reasoning and evidence acquisition. We introduce JRDB-AVR, a benchmark derived from existing real-world JRDB robotics data through a structured question-generation engine that turns this gap into an explicit evaluation: an embodied agentic system receives a visual reasoning question, requests bounded observations by timestamp and viewing angle, and is evaluated on both the final answer and the grounded visual evidence supporting it. The benchmark contains diverse questions over multiple real-world environments involving temporal search, viewpoint selection, and human-oriented compositional reasoning. We also introduce JRDB-AVR-Agent, a reference active reasoning agentic method that maintains an explicit observation-grounded graph-based world model and answers through solving. Experiments reveal a substantial gap between answer accuracy and evidence accuracy in current baselines, showing that current VLMs can produce unsupported correct answers and that active evidence-aware evaluation is necessary for embodied visual reasoning. Code and benchmark are available at https://github.com/ControlNet/JRDB-AVR.

[426] Sol-H3: Recursive Self-Improvement for MiniMax-H3 Inference Acceleration on Sol-Engine across Cloud and Edge cs.AI | cs.CV | cs.LGPDF

Yitong Li, Jincheng Yu, Junsong Chen, Haopeng Li, Shuchen Xue

TL;DR: Sol-H3通过跨分辨率两阶段扩散调度和递归自改进内核搜索，加速33B MiniMax-H3在云端与边缘设备的视频生成。

Details

Motivation: MiniMax-H3参数量大且需多步去噪，在GB200云节点上延迟高，在DGX-Spark边缘设备上还受严格显存限制。

Result: 端到端最高加速30倍、显存降低20%；8张GB200节点上可快于实时3.5倍生成5秒1344×768音视频，单台DGX Spark可在一分钟内完全驻留显存并生成。

Insight: 先低分辨率快速确定全局布局，再高分辨率细化局部；学习的潜变量到潜变量映射直接跨分辨率连接，免去昂贵VAE解码—重编码。RSI循环搜索算子融合和内存布局，同时检查时延与数值一致性。

Abstract: Video diffusion models are rapidly scaling and exhibiting enhanced generation capabilities. Among these recent advancements, MiniMax-H3 stands out as a highly capable, production-level open-source model. However, its 33-billion parameters and multi-step iterative denoising process introduce substantial computational overhead. Consequently, their practical production is hindered by generation latency in the cloud deployment like NVIDIA-GB200, alongside strict memory limits that pose further challenges at the edge device like DGX-Spark. To address these diverse hardware bottlenecks from cloud to edge device, we present a full-stack inference pipeline that integrates efficient algorithmic design with optimized operator implementations. Algorithmically, we introduce a cross-resolution two-stage generation scheduler that exploits the step-wise nature of diffusion: early low-resolution steps rapidly establish the global layout, while later high-resolution steps focus refinements of local and perceptual details. These stages are connected by a learned latent-to-latent mapping module, completely eliminating the computationally expensive VAE decode-reencode cycle for resolution transferring cross different resolutions. For operator implementation, we deploy a Recursive Self-Improvement (RSI) loop that searches kernel fusions and memory layouts, evaluating latency together with numerical agreement. Together, these optimizations deliver up to 30x end-to-end speedup and 20% lower memory: a 5-second 1344x768 video with audio is generated 3.5x faster than real time on an 8xGB200 node, and in under a minute fully memory-resident on a single DGX Spark.

[427] TMCS: Tool-Grounded Multi-Agent Reasoning for Compositional Chemical Problem Solving cs.AI | cs.CVPDF

Shengqin Wang, Jie Jin, Yu Cheng, Yihang Chen, Weilin Luo

TL;DR: TMCS用多代理和外部工具把组合化学问题组织为可解释闭环，覆盖分子生成、理解、编辑、描述与性质优化。

Details

Motivation: 组合化学要求按定量约束改造分子、验证候选并在失败后系统修订；已有工具型化学代理缺少统一的性质驱动优化和工作流组合机制。

Result: 在多个化学任务上，TMCS持续增强开源与闭源基础模型的化学推理并达到先进表现；摘要未报告具体数值。

Insight: 任务层由专用代理结合外部工具、少样本轨迹记忆和结构化反思逐步改进解；工作流层将生成、理解、编辑、描述和优化串成闭环，令推理步骤可追踪。

Abstract: Despite the promise of Large Language Models (LLMs) in computational chemistry, rigorous combinatorial chemistry problems remain difficult because they require quantitatively constrained molecular modification, candidate validation, and systematic revision after failed attempts. Existing tool-augmented chemical agents demonstrate useful planning and tool use, but they rarely provide a unified loop for property-driven molecular optimization and workflow-level composition. To bridge this gap, we propose Tool-Grounded Multi-Agent Reasoning for Compositional Chemical Problem Solving (TMCS), a step-by-step multi-agent framework that formalizes chemical problem solving as an interpretable, tool-augmented workflow. At the task level, specialized agents leverage external tools, few-shot trajectory memory, and structured reflection to iteratively refine solutions. At the workflow level, TMCS chains generation, understanding, editing, description, and optimization into a closed-loop pipeline. Evaluations across multiple chemical tasks demonstrate that TMCS consistently enhances chemical reasoning across both open- and closed-source base models, achieving state-of-the-art performance.

[428] Verifiable Visual Rewards Transfer from Synthetic Scenes to Natural Prompts cs.AI | cs.CVPDF

Shuyue Stella Li, Xiaochuang Han, Yulia Tsvetkov, Luke Zettlemoyer

TL;DR: VVR用几何对象及关系构造带确定性程序验证器的合成图像生成任务，并把可验证视觉奖励用于扩散模型强化学习。

Details

Motivation: 图像生成常不能可靠满足对象数量和空间关系，训练奖励通常依赖不可靠检测器或VLM，对约束的判定难以验证。

Result: VVRBench有1万项、32类约束，Challenge有720项复杂任务；最强评测模型GPT-Image-2.5在Challenge仅解决21.4%。用VVR奖励训练使Stable Diffusion 3.5 Medium在VVRBench准确率从2.8%升至28.3%，并泛化到易到难及域外基准；混合既有目标还改善总体表现和人类偏好。

Insight: 每个任务由几何对象和关系生成，提示及确定性验证器成对构造，复杂度和任务数可控。由此提供无需不可靠语义奖励模型的程序化奖励，并测试合成约束学习向自然提示迁移。

Abstract: Precise instruction following in image generation, such as satisfying object counts and spatial relations, remains an open challenge at least in part because it is learned using unreliable reward models such as object detectors and vision-language models. We introduce Verifiable Visual Rewards (VVR), the first framework for programmatically verifiable image rewards, and show that training on it generalizes to natural prompts. Each VVR task is a scene of geometric objects and relations among them, from which we derive both the prompt and a deterministic verifier, so tasks can be generated in any number and at any chosen complexity. We release VVRBench, with 10,000 tasks over 32 constraint types, and VVRBench-Challenge, with 720 more complex tasks; the strongest model we evaluate—GPT-Image-2.5—solves 21.4% of VVRBench-Challenge. Using VVR scores as rewards for reinforcement learning (RLVVR) raises the accuracy of Stable Diffusion 3.5 Medium on VVRBench from 2.8% to 28.3% and demonstrates consistent easy-to-hard generalization. These gains extend to out-of-domain benchmarks, and mixing VVR into existing objectives further improves overall performance and human preference, motivating the adoption of VVR into standard image generation post-training recipes.

cs.CR [Back]

[429] SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agents cs.CR | cs.AI | cs.CLPDF

Saswat Das, Parvati Viswanathan, Daniel Donnelly, Chang Huang, Sahar Abdelnabi

TL;DR: SEABench以48条纵向任务序列评估智能体自我修改工具、记忆和指令后产生的内生失配，并通过配对基线追溯安全问题的因果来源。

Details

Motivation: 自演化智能体会依据反馈更新自身框架，局部有用的修改可能延续到后续任务并造成不安全行为，即使没有直接对抗输入也可能出现。

Result: 多种近期模型、自演化表面和伤害类型的评估显示，自我演化提升任务完成率，但常伴随配对非演化基线没有出现的安全失败；不同演化方式和伤害类型呈现不同安全行为。监控推理链能以较低误报缓解风险。

Insight: 基准提供自适应轨迹发现流程，在保持原任务意图的同时探测失败，并用配对非演化智能体及归因分数支持因果比较；安全监测还可利用不同演化表面在推理链上的可观察差异。

Abstract: Self-evolving LLM agents have gained prominence for their ability to improve after deployment by modifying their harness, including their controller instructions, memory management protocols, and reusable tools and skills, in response to user and environment feedback. However, locally useful updates may persist into later tasks where they produce unsafe behavior, even without direct adversarial influence. To study this risk, we introduce SEABench, a benchmark for studying endogenous misalignment arising from agent self-evolution, with 48 longitudinal task sequences that span multiple evolution surfaces, task domains, and harm types in a rich personal-assistant environment. To account for the stochasticity inherent in agentic operations, we provide an adaptive trajectory discovery pipeline that probes for failures while preserving original task intent and supports causal attribution through paired non-evolving agents and attribution scores. Our evaluation across multiple recent LLMs, evolution surfaces, and harm types reveals that self-evolution indeed increases task completion rates but often at the cost of safety failures that are absent for paired non-evolving baseline agents. We also show that qualitatively different safety behaviors emerge across evolution surfaces and harm types. Further, we show that this divergence in safety behavior is reflected in agents’ chain-of-thought reasoning, which yields an effective monitoring strategy that can mitigate unsafe behavior with a low false positive rate.

cs.IR [Back]

[430] MM-VeriRec: Failure-Guided Fusion for Verifiable Agentic Multimodal Recommendation cs.IR | cs.AI | cs.CL | cs.CVPDF

Yufeng Wang

TL;DR: MM-VeriRec 将推荐任务中的隐含视觉约束、图文错配和不可行请求纳入可验证多模态协议，并按失败类型路由到针对性修复。

Details

Motivation: 图片可能包含文本元数据未表达的外观条件；多模态推荐代理需要判断视觉证据何时决定推荐、文本与图像是否冲突，以及用户请求是否根本无法满足。

Result: 在 MM-ML 1M 和 Amazon Reviews 上，增强文本与视觉嵌入改善检索但不能自行消除失败；失败引导融合则能改善结果。独立于验证器训练的留一 CLIP 检测器，在两个数据集上视觉落地成功率分别为 0.7028 和 0.6111，高于 VBPR 与朴素融合。不同 LLM 家族上文本—视觉差距可复现，最佳修复因领域而异。

Insight: 基准用确定性视觉属性验证推荐，并把失败标为跟随文本陷阱、忽略视觉或错误接受不可行任务；融合模块诊断哪种模态出错，再路由到合适修复。验证器直接对齐的门控分数是上界测试，独立 CLIP 门控迁移结果更能反映实际能力。

Abstract: Images often carry recommendation constraints that text metadata only hints at. A movie may need to look dark, a product may need a minimal style, and a visually impossible request should be rejected. Agentic multimodal recommenders must reason over text-image evidence, decide when visual evidence is decisive, and abstain when no valid action exists. We introduce MM-VeriRec, a verifiable multimodal recommendation protocol and failure-guided fusion method for hidden visual constraints, image-text mismatch, and impossible-task abstention. MM-VeriRec builds tasks from real movie-poster and product-image datasets, verifies each recommendation with deterministic visual attributes, and converts failures into actionable labels: text-trap following, visual ignorance, and false acceptance. Fusion should not merely concatenate modalities, but should diagnose which modality failed and route to the appropriate repair. Across MM-ML 1M and Amazon Reviews datasets, stronger text and vision embeddings improve retrieval but do not remove these failure modes, whereas failure-guided fusion does. The adaptive attribute gate reads the same tags the verifier checks and its scores are verifier-aligned upper bounds testing whether the taxonomy routes to the correct repair. More informative is transfer under a non-aligned gate: an independently derived leave-one-out CLIP detector still reaches 0.7028 and 0.6111 visual-grounded success, above both a VBPR baseline and plain fusion. The text-versus-visual gap reproduces across two LLM families, and the repair that helps differs by domain. MM-VeriRec is both a benchmark and a practical diagnostic loop for trustworthy agentic multimodal recommendation.

[431] ColNanoVDR: Document-Free Query Distillation for Multi-Vector Visual Document Retrieval via Optimal Transport cs.IR | cs.CL | cs.CVPDF

Zhuchenyang Liu, Ziyi Wang, Yao Zhang, Yu Xiao

TL;DR: ColNanoVDR以熵正则最优传输对齐学生与教师的查询多向量，在完全不读取训练页面的情况下压缩视觉文档检索查询编码器。

Details

Motivation: 多向量检索使用大型视觉语言模型对每次查询编码，开销很高。传统蒸馏需编码并缓存每个训练页面，数据可达TB级；不使用页面的NanoVDR则仅支持单向量检索。

Result: 149M参数纯文本学生保留五个先进教师在ViDoRe v1至v3上约95%的NDCG@5，查询编码最多快26倍。在相同训练设置下，OTW达到与分数蒸馏相当的效果，不读取任何页面，并减少12.6倍缓存教师数据读取。

Insight: 以带学习权重的熵正则最优传输匹配学生和教师的查询token，不要求两种tokenization之间有对应关系。论文证明这种对齐成本可界定任意页面上的MaxSim分数差，因而不必为蒸馏重建页面向量。

Abstract: Multi-vector retrievers built on vision-language models lead visual document retrieval (VDR), but they run a multi-billion-parameter query encoder on every search. Distilling this encoder into a small student that queries the teacher’s existing index would remove the bottleneck. The standard recipe, however, matches the teacher’s MaxSim scores and so requires encoding and caching every training page, which can reach terabytes of page tokens. NanoVDR avoids pages entirely by training on the teacher’s query embeddings alone, but only for single-vector retrievers. We present ColNanoVDR, to our knowledge the first framework to bring this document-free distillation to multi-vector VDR. Its objective, OTW (Optimal Transport with Learned Weights), aligns the student’s query tokens with the teacher’s by entropic optimal transport, with a learned weight for each student token, and needs no correspondence between the two tokenizations. We prove that the resulting alignment cost bounds the MaxSim score difference on every page. Distilled from five state-of-the-art teachers, the 149M text-only students retain about 95% of their teachers’ NDCG@5 on ViDoRe v1-v3 while encoding queries up to 26x faster. Under identical training, OTW matches score distillation while encoding no page and reading 12.6x less cached teacher data.

[432] Concepts Complement Dense Semantics: Learning Compact Sparse Spaces for Text-Image Retrieval cs.IR | cs.CVPDF

Yoonseo Kim, Jungwoo Choi, Cheonyoung Park, Youngwook Kim, Yongho Song

TL;DR: GRASP从语料中挖掘视觉—文本概念，学习紧凑且有语义落地的稀疏表示，作为稠密语义嵌入的互补检索证据。

Details

Motivation: 稠密表示善于整体语义匹配，却可能遮蔽精细图文线索；现有稀疏分支复用冗余语言模型token空间，且稀疏维度缺乏明确视觉语义对应。

Result: 多个实验显示GRASP超过先进稠密—稀疏检索基线，同时得到更紧凑、有概念解释性的稀疏空间；摘要未提供具体分数。

Insight: 从图文语料挖掘共享概念，轻量稀疏头预测每张图或文本相关的概念，提供可解释概念级证据与稠密相似度互补，避免直接把词表token当稀疏维度。

Abstract: Cross-modal retrieval has been advanced by vision-language pre-trained models that encode images and texts into a shared dense embedding space. While dense representations effectively capture overall semantic similarity, they often obscure fine-grained visual-textual information needed for precise cross-modal matching. Recent methods introduce a learned sparse branch to complement dense matching with lexical evidence, but they rely on a redundant language-model token space and lack explicit grounding for sparse dimensions. We propose GRASP, a compact and grounded sparse learning framework that mines visual-textual concepts from the corpus. A lightweight sparse head is trained to predict concepts relevant to each image or text, yielding interpretable concept-level evidence that complements dense semantic matching. Extensive experiments show that GRASP improves retrieval accuracy over the state-of-the-art dense-sparse baselines while yielding a more compact and grounded sparse space.

cs.LG [Back]

[433] Understanding and Exploiting Anisotropy in Post-Training cs.LG | cs.CLPDF

Samyak Jha, Harshvardhan Saini, Yizhen Liao, Yiming Tang, Dianbo Liu

TL;DR: 该研究发现少量高能残差通道构成语言模型的连贯性基底，推理适配主要发生在其他通道，并据此提出仅训练通道增益的 SphereGate。

Details

Motivation: SFT 与 RL 分别对应覆盖模式和寻找模式的不同目标；模型各向异性常被视为缺陷，但其在后训练中承担何种功能及如何影响推理适配尚不清楚。

Result: 无标签异常规则定位约 5% 残差通道，移除后困惑度从 10 升至超过 10^6，而同数量随机通道只升至 35。SFT 会重塑这些通道，RL 基本保留并适配其余通道。SphereGate 只需 0.1M 参数，在 Qwen2.5 0.5B–7B 和 Llama-3-8B 的 MATH-500 上比参数高效基线高 2.0–7.3 点，并可媲美或超过全模型 GRPO。

Insight: 带能量权重的梯度可限制高能连贯性通道移动，同时允许其他通道自由适配；这揭示后训练存在“维持语言连贯”与“适配推理”的通道分工。

Abstract: LLM post-training combines supervised fine-tuning (SFT), a mode-covering forward-KL objective, with reinforcement learning (RL), a mode-seeking reverse-KL objective. Frequency-weighted likelihood training leaves a well-known signature: \emph{anisotropy}, in which a few residual channels carry disproportionately large activations. Anisotropy is widely documented and usually treated as a defect, yet its function and its interaction with post-training remain unclear. We first analyze it. A label-free outlier rule isolates about 5% of residual channels that are essential for language modeling: removing them raises perplexity from 10 to over $10^6$, versus 35 for count-matched random channels. Yet they barely distinguish correct from incorrect reasoning. SFT reshapes them, whereas RL leaves them largely intact and adapts the complementary channels. These channels therefore form the model’s \emph{coherence substrate}, and reasoning adaptation happens elsewhere. We then exploit this. \textsc{SphereGate} learns one bounded gain per residual channel on a frozen backbone. Its activation-weighted gradients provably limit movement of high-energy coherence channels and leave the remaining channels free. With 0.1M trainable parameters, \textsc{SphereGate} outperforms parameter-efficient baselines by 2.0–7.3 points on MATH-500 across Qwen2.5 (0.5B–7B) and Llama-3-8B, is comparable or exceeds full-model GRPO. Anisotropy is not a defect but a division of labor that post-training can exploit.

[434] Mind the Spike: Mechanisms and Brittleness of Visual Massive Activations in Large Vision-Language Models cs.LG | cs.AI | cs.CL | cs.CVPDF

Jonas Ngnawé, Yann Pequignot, Sabyasachi Sahoo, Christian Gagné, Frédéric Precioso

TL;DR: 该研究分析 LVLM 中继承自文本模型的固定文本激活峰和图像相关视觉激活峰，发现视觉峰会受常见图像扰动影响而脆弱变化，并提出针对触发方向的预防干预。

Details

Motivation: 文本激活峰已在语言模型中广泛研究，但视觉激活峰是否跨 LVLM 以稳定模式形成、以及对图像扰动如何响应仍不清楚。

Result: 研究覆盖 10 个模型家族、18 个文本基础模型构建的 25 个 adapter LVLM，参数范围 2B–72B。部分模型不产生视觉峰，其他模型的峰率不同且通常位于更深层；常见图像腐蚀常会新建或移动峰、较少将其消除。针对性预防干预可在干净与扰动图像上消除或显著减少峰，同时几乎不影响其他图像 token。

Insight: 文本峰通常在固定初始位置、早层出现，与输入内容无关；视觉峰则更依赖图像，且触发模型权重方向和位置规则可解释其形成。研究强调其脆弱性及内部激活监测的鲁棒性意义。

Abstract: Large vision-language models (LVLMs) inherit massive activations from their text-only bases: spikes where a few fixed hidden channels receive values thousands of times above the typical magnitude. The text spike systematically appears in early layers at a fixed initial position, independently of input content. Visual spikes vary across images, but whether their formation follows a consistent pattern across LVLMs and how they respond to image perturbations remain open questions. We find that some LVLMs do not form visual spikes, while others spike at different rates, typically in deeper layers. We identify the trigger direction from model weights and an interpretable location rule: before the language model decoder runs, eventual spike tokens are largely restricted to those sharing least with the rest of the image. Crucially, visual spikes are strikingly brittle. Common corruptions frequently create and relocate spikes, and less often remove them, raising overall incidence. Our trigger-guided spike attack deliberately creates or removes spikes under a small $\ell_\infty$ budget, with 1/255 enough in nine of the ten models that spike. Finally, our preventive intervention removes only the trigger component before spikes erupt, eliminating or substantially reducing spikes on clean and perturbed images while leaving the other image tokens nearly unchanged. Our study spans 25 adapter-based LVLMs built on 18 released text-only bases from 10 families, ranging from 2B to 72B parameters.

[435] Theory of Scene: Breaking the Symmetry Trap in Multi-Agent LLM Coordination cs.LG | cs.CL | cs.MAPDF

Liangqi Yuan, Wenzhi Fang, Shiqiang Wang, Christopher G. Brinton

TL;DR: Theory of Scene 用共享任务上下文和公开角色来决定多智能体分工，打破无通信同质代理同时争抢或错误拆分目标的对称性陷阱。

Details

Motivation: 同质 LLM 代理并发且无通信时，可能在应拆分的目标上碰撞，又在应协作的目标上各自分散；常见 Theory of Mind 也可能因为代理对彼此形成相同预测而陷入同一困境。

Result: ToS 在 DivvyBench、GovSim 和 Overcooked 上超过六种基线。与相同输入的 ToM 相比，DivvyBench 成功率从 71.1% 提高至 99.6%，GovSim 总收益从 207 提至 400，Overcooked 归一化吞吐从 1.41 提至 1.67。

Insight: 角色门控判断对象归属是否重叠或已分开，任务耦合判断团队需共同完成、拆分目标还是按阶段接力；同质性因此可转化为确定一致分工的优势。

Abstract: Multi-agent systems built on large language models (LLMs) are largely homogeneous, as their agents behave alike even across distinct LLMs. We show that when such agents act concurrently without communication, they collide on targets they must split and diverge on targets they must take together, a double failure we term the symmetry trap. Theory of Mind (ToM), widely used for coordination without communication, cannot escape this trap, since homogeneous agents form the same prediction of one another and respond to it in the same way. We propose Theory of Scene (ToS), a training-free reasoning schema in which each agent reads its public role, the only difference between the agents, and the task context they all observe. Homogeneous agents thereby derive one division of labor, each taking the part its role fixes, which turns homogeneity from the cause of the trap into the cure. ToS reads the role together with the scene through role gating, which determines whether ownership overlaps or is already divided, and the task context through task coupling, which infers whether the team must converge on each target, divide it, or take its stages in turn. We evaluate on DivvyBench, a controlled environment we introduce, whose target types make an episode Competitive, Cooperative, or Mixed across Tabletop, Airspace, and Household scenarios, and on two established agentic benchmarks, GovSim and Overcooked. ToS outperforms all six baselines on every benchmark, and each baseline falls far behind it in at least one setting. Against ToM given the same inputs, ToS raises the DivvyBench success rate from 71.1% to 99.6%, the GovSim total gain from 207 to 400, and the Overcooked level-normalized throughput from 1.41 to 1.67.

[436] ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiograms cs.LG | cs.AI | cs.CL | eess.SPPDF

Haitao Li, Chenglin Li, Zhengyao Ding, Ziyu Li, Yiheng Mao

TL;DR: ECG-Scroll 将长时程动态心电解读建模为在线序贯决策：代理需要随信号流定位、量化并及时报告阵发事件，同时决定何时测量、记忆和提交证据。

Details

Motivation: 标准 10 秒心电图可放入上下文，但 Holter 和遥测记录持续数小时至数天，临床关键的短暂发作埋在大段正常信号中；模型不能看到未来，也无法在诊断分辨率下一次输入全记录。

Result: 作者发布 390 条完整记录，总计 2,536 小时双导联动态 ECG，并评估信号阈值规则代理及现成 LLM 代理。由于保留原始信号，答案可对照客观真值，用规则奖励验证；流式设置还可测量事件起始到代理记录事件的检测延迟。摘要描述基准与诊断能力，未给出代理结果分数。

Insight: 环境提供固定 gym 式交互，测试单次 ECG 模型未涉及的记忆、基于信号测量的工具使用和何时提交证据的规划能力；流式因果约束是该任务的核心。

Abstract: Multimodal large language models (MLLMs) can now interpret a standard ten-second, twelve-lead electrocardiogram (ECG) with clinically grounded, reward-verified reasoning. Real cardiac monitoring is different. Ambulatory (Holter) and telemetry recordings span hours to days and are read as they stream in, and their clinically decisive findings are paroxysmal, brief episodes buried in an otherwise unremarkable trace. Such a recording cannot be held in one context at diagnostic resolution, and its future has not yet happened, so a reader must work online, deciding what to measure now, committing evidence to memory as it passes, and reporting events as they occur. We recast long-duration ECG interpretation as a long-horizon, online (streaming, causal) sequential decision process and introduce ECG-Scroll. As a benchmark, long ambulatory recordings are streamed to an agent chunk by chunk, and it must localize, quantify, and promptly flag paroxysmal events without access to future signal; because the underlying signal is retained, every answer is checkable against objective ground truth, giving rule-based rather than judge-based rewards, and the streaming formulation adds a metric batch evaluation cannot express, the detection latency between an event’s onset and the moment the agent records it. As an agent environment, it is a fixed, gym-style interaction layer that exercises three competencies single-glance ECG models never touch: Memory, Tool use through signal-grounded measurement rather than reading pixels, and Planning of what to measure now and when to commit. We release 390 whole-recording instances spanning 2,536 hours of two-lead ambulatory ECG and evaluate a signal-threshold rule agent alongside off-the-shelf LLM agents online, characterizing how they use memory, tools, and planning and where the benchmark’s head-room lies.

[437] Save Your Saturated Data: Learning Beyond Reward Saturation in Group-Based RL cs.LG | cs.CLPDF

Ziyuan Yang, Yike Wang, Shangbin Feng, Yulia Tsvetkov

TL;DR: 该研究检验组相对强化学习遇到奖励饱和时，能否通过主动生成有信息量的错误轨迹恢复组内相对优势并重新利用已有数据。

Details

Motivation: 当高能力模型对同一问题采样的回答全部得到相同高奖励时，GRPO 的相对优势趋近于零，原有训练数据可能失去作用。

Result: 只用饱和推理数据时，对 rollout 生成的干预最有效：引导策略生成高质量但错误的解答作为负样本，使 Qwen3-1.7B 和 4B 的 GRPO 表现提高 6.4%–9.0%。提高采样温度或加入辅助奖励也可恢复非零优势，但收益较不稳定。

Insight: 有效负样本需要包含可学习的错误推理过程，而不只是低质量错误；方法可与未饱和数据共用，也可迭代回收新近饱和样例。数据饱和后并非必须丢弃，关键是恢复有区分度的组内信号。

Abstract: Group-relative reinforcement learning (RL) relies on reward variation among sampled responses to estimate informative relative advantages. As language models become increasingly capable, existing training data can become reward-saturated: all sampled responses to the same problem might receive equally high rewards, where the group-relative learning signals vanish and leave previously useful data obsolete. In this work, we investigate whether useful learning signals can be recovered from such saturated data. We study interventions at four levels of group-policy RL pipelines—data, rollout, reward, and advantage—and conduct extensive RL training on saturated reasoning data only. While standard GRPO on saturated data would almost always yield near-0 advantages and near-noise signals, diverse interventions successfully recycle and repurpose such data: among the proposed strategies, interventions at rollout generation are consistently most effective: nudging the policy to generate ``high-quality’’, incorrect solutions introduces rollouts with poor rewards into saturated groups as negative samples, which turns out to improve GRPO by 6.4% to 9.0% across Qwen3-1.7B and 4B. Other interventions such as increasing rollout temperature or adding auxiliary rewards can also restore non-zero advantages, but yield less consistent gains. Further analyses show that effective negative rollouts require informative negative trajectories, that the method remains effective alongside unsaturated data, and that it supports iterative recycling of newly saturated examples. While increasingly stronger LLMs would render more data as saturated, our results demonstrate that don’t waste your saturated data: with the right strategies they can be recycled into useful RL training signals in an increasingly data-scarce world.

[438] AG-CoT: Verified Algorithmic Traces for LLM Program Synthesis on Clifford Circuits cs.LG | cs.CL | quant-phPDF

Lu Wei, Yufeng Wang, Chenfeng Cao, Lu Pang, Haibin Ling

TL;DR: AG-CoT 用可验证的 Aaronson–Gottesman 算法轨迹监督语言模型生成 Clifford 电路，并通过验证器筛选的后续训练提高生成量子程序的状态正确性。

Details

Motivation: 科学代码即使能运行，也可能没有计算出目标科学对象；Clifford 电路可精确经典验证，适合区分语法有效和目标量子态正确。

Result: 两个独立训练的 3B、7B 模型上，AG-CoT 使贪心解码的状态等价准确率比只监督电路提高 4–6 倍；验证器筛选的继续训练在两种家族中进一步稳定提升。32B 实验中，监督模型语法和 Clifford 有效性近乎完美，但最强直接模型每目标状态等价率仅 6.14%，多候选验证选择后超过 10%。

Insight: 经验证的算法思维链提供结构化中间步骤，随后只在验证器接受的模型生成上继续训练。电路合法性与状态等价仍存在差距，精确外部验证对科学程序尤其必要。

Abstract: Scientific code generation can produce executable programs that fail to compute the intended scientific object. We study this problem in language-model synthesis of Clifford circuits, which prepare the stabilizer states used in quantum error correction and admit exact classical verification. In our target-conditioned framework, each target is given as compact signed stabilizer generators, and an exact verifier checks the generated OpenQASM circuits. We supervise models with Aaronson-Gottesman chain-of-thought (AG-CoT) traces checked by the verifier, and continue training on model generations that the verifier accepts. Across two independently trained model families (3B and 7B), AG-CoT supervision multiplies greedy-decode state-equivalence accuracy by four to six times over circuit-only baselines, and verifier-filtered continuation training adds a further consistent gain atop both. A complementary 32B study shows that supervised models achieve near-perfect syntax and Clifford validity while the strongest direct model reaches 6.14% state equivalence per target, rising to over 10% under verifier-guided selection with multiple candidates. These results show that algorithmic trace supervision gives a large, statistically significant gain in both model families and that verifier-filtered continuation adds a further repeated gain. The persistent gap between Clifford validity and state equivalence confirms that exact verification is necessary: a circuit can be syntactically and physically valid yet prepare the wrong quantum state.

[439] Teach Yourself Where to Look: On-Policy Attention Self-Distillation for Reasoning cs.LG | cs.CLPDF

Safaeid Hossain Arib, Rabeya Akter, Ismam Nur Swapnil, Md. Faiyaz Abdullah Sayeedi, Md Mofijul Islam

TL;DR: OPASD 在常规 token 分布蒸馏之外，将教师在已验证解答上的注意力分布对齐到学生可见上下文，补充推理时“看哪里”的监督。

Details

Motivation: 普通 on-policy 自蒸馏只传递教师对下一个 token 的预测，不告诉学生教师在前文哪些位置取证；教师可访问学生看不到的验证解答 token，需适配注意力监督。

Result: 在三个模型规模、四个竞赛数学基准上，OPASD 比仅 token 蒸馏平均准确率高 4.98–8.40 个百分点；同时避免响应长度膨胀并减少性能退化，生成 rollout token 减少 73.9%，估算计算量减少 72.6%，训练快 1.53 倍。

Insight: 教师注意力先投影到学生可见位置并重新归一化，再与学生对齐，避免要求学生关注其上下文中不存在的解答 token。

Abstract: On-policy self-distillation trains reasoning models on their own trajectories using dense token distribution guidance from a privileged teacher with access to a verified solution. This supervision transfers what the teacher predicts without directly transferring where it attends within the preceding context. We introduce On-Policy Attention Self-Distillation (OPASD), which complements token-level supervision with solution-conditioned attention distillation. Because the privileged teacher can attend to verified solution tokens unavailable to the student, OPASD projects teacher attention onto student-visible positions and renormalizes the resulting distribution before alignment. Across three model sizes and four competition-level mathematics benchmarks, OPASD consistently outperforms token-only OPSD, improving average accuracy by 4.98 to 8.40 percentage points. OPASD also avoids the response-length inflation and performance degradation observed with token-only distillation, reducing generated rollout tokens by 73.9% and estimated model compute by 72.6% while training 1.53x faster. These results show that solution-conditioned attention provides a complementary supervision signal that makes on-policy self-distillation more accurate, stable, and compute-efficient.

[440] When Do Models Admit They Are Wrong? Failure Disclosure Is Unstable Under Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Steven Y. Feng, Noah D. Goodman, Michael C. Frank, Evan Hubinger, Paul C. Bogdan

TL;DR: 该研究发现仅以结果奖励训练的 RL 即使任务准确率相近，也可能导致模型在失败时是否承认错误的行为大幅波动。

Details

Motivation: 失败披露关系到模型可纠正性和用户信任，但 outcome-based RL 不直接约束模型如何报告错误，行为稳定性是否随任务分数稳定尚不清楚。

Result: 重复 GRPO 运行中，失败披露差异远大于任务准确率差异；现象扩展到第二种推理任务、稳定化 PPO、7B 模型及指令条件 32B。细分发现检查答案、进入报告和完成承认是不同决策环节，薄弱点随任务和格式变化。对失败但格式良好的回答抑制策略偏离可显著稳定披露，但对任务性能的影响依设置而异。

Insight: 受控小数精度及采样差异可在目标和早期训练历史相同时改变报告行为；训练弱约束行为尤其容易跨次变化。评估应多次重复并直接测量安全相关行为，而不只看平均任务准确率。

Abstract: Outcome-based reinforcement learning can produce models with similar task performance but very different ways of communicating about their mistakes. We study failure disclosure: whether a model admits that an attempted solution failed rather than staying silent or presenting it as successful. Across repeated outcome-only GRPO training runs, failure disclosure varies far more than task accuracy. The pattern extends to a second reasoning task and stabilized PPO, persists at 7B, and also appears in an instruction-conditioned 32B setting. We also find that small floating-point and sampling differences during training can redirect reporting behavior even when the task objective and earlier training history are held fixed. Additional tests show that failure disclosure is not a single decision: Checking the answer, entering a report, and completing the admission can separate, and the weak point depends on the task and response format. Further, experiments with neutral controls show more broadly that behaviors left weakly constrained by training are especially likely to vary across runs, of which failure disclosure is an example. We can reduce variability in failure disclosure by discouraging the model from drifting from its starting policy on failed, well-formed responses. This makes reporting substantially more consistent, though its effect on task performance depends on the setting. Stable task accuracy therefore does not guarantee stable safety-relevant behavior: Researchers should measure these behaviors directly across runs and design training methods that keep them reliable.

[441] TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs cs.LG | cs.CLPDF

Zihan Lin, Xiaohan Wang, Jie Cao, Jiajun Chai, Wei Lin

TL;DR: TGRL把高、低采样温度产生的奖励差异转换为探索收益，并通过温度分布间的JS散度分配逐token探索信用。

Details

Motivation: 可验证奖励强化学习中的有效探索仍是瓶颈。提高温度能增加采样多样性，但通常需要扩大rollout预算，或者没有定量刻画多样性究竟带来多少收益。

Result: TGRL在不增加rollout预算的情况下，达到相当准确率最多快36%。在11项基准上整体优于强基线，包括32B模型数学平均分提高1.6%、CodeForces评分提高196.7、LiveCodeBench Pass@16提高4.4%，以及ALFWorld/WebShop成功率提高6.3%/4.9%。

Insight: 温度差异不仅是采样噪声，也可作为学习信号：同一提示下比较高低温组的奖励，再以对应温度分布之间的JS散度把组级探索收益细化到token级信用。

Abstract: Efficient exploration often remains a central bottleneck in reinforcement learning with verifiable rewards (RLVR). Although temperature control and test-time scaling strategies can increase rollout diversity of large language models (LLMs), they either expand the sample budget at rollout time or leave the benefit of exploration unquantified. To this end, we propose Temperature-Grouped Reinforcement Learning (TGRL), which turns temperature-induced diversity into an explicit training signal. For each prompt, TGRL partitions its rollout group into low- and high-temperature subsets, estimates exploration gain through their reward contrast, and allocates this group-level signal as token-level credit using Jensen–Shannon (JS) divergence between the corresponding temperature-scaled next-token distributions induced by the same logits. Notably, TGRL reaches equivalent accuracy up to 36% faster than strong RLVR baselines without expanding the rollout budget. Across 11 benchmarks from diverse domains, TGRL broadly improves over strong RLVR baselines: it improves the six-benchmark math average by 1.6% at 32B, raises CodeForces rating by 196.7 points and LiveCodeBench Pass@16 by 4.4%, and improves ALFWorld/WebShop success rates by 6.3%/4.9%. Comprehensive ablations and wall-clock analysis confirm the efficacy of all proposed components. Code is available at https://github.com/1229095296/TGRL/tree/main.

[442] SMAT: Simple and Efficient Merge-Aware Training cs.LG | cs.CLPDF

Yanggan Gu, Yuanyi Wang, Zhen Li, Shuo Cai, Yuhang Liu

TL;DR: SMAT在专家训练时模拟缩放、坐标屏蔽和其他专家更新扰动，将合并后损失纳入优化，并用高效实现把训练开销控制在较低水平。

Details

Motivation: 模型合并能在不联合重训的情况下整合专家能力，但常规专家训练只优化各自任务损失，不能保证合并后表现。已有合并感知训练未充分覆盖常见合并操作，且会增加训练成本。

Result: 在四种语言及视觉语言骨干上，SMAT相对每个骨干最强基线，使五种合并方法的平均得分提高1.07至2.16分；相较标准微调，训练时间开销低于2%。

Insight: 把常见合并归纳为对本专家更新的缩放、掩码删除和其他专家更新扰动后，可以通过采样这些操作直接优化期望合并损失；周期调度、核融合和参数存储切换使每步仍只需一次前向与反向。

Abstract: Model merging integrates the capabilities of multiple experts without joint retraining, but standard expert training optimizes task loss alone and does not guarantee good performance after merging. Merge-aware training (MAT) aims to improve merged performance, but existing methods do not fully account for common merging operations and add training cost. We observe that, from an expert’s perspective, common merging methods can be described by three operations: Scale reweights its own update, Mask removes selected coordinates, and Perturb adds updates from other experts. Based on this view, we introduce SMAT (Simple MAT), which jointly optimizes expert loss and expected loss at simulated merged parameters generated by sampling scaling coefficients, masks, and additive noise. We further introduce periodic scheduling, kernel fusion, and parameter storage switching to make SMAT efficient, with one forward and one backward pass per step. Across four language and vision-language backbones, SMAT improves the mean score across five merging methods by 1.07-2.16 points over the strongest baseline for each backbone, with less than 2% training-time overhead over standard fine-tuning.

[443] Surprising Success, Repeated Failure: Entropy-Guided Credit Assignment for Exploration in LLM Reasoning cs.LG | cs.AI | cs.CLPDF

Woongyeong Yeo, Minki Kang, Chanuk Lee, Sangwoo Park, Jinheon Baek

TL;DR: EAPO根据策略熵与回答成败的不对称关系分配token级信用，强化高不确定性下的成功决策，并针对失败答案中低熵且反复出现的错误加大纠正。

Details

Motivation: 可验证奖励强化学习通常只给整条回答提供结果反馈。已有细粒度方法常需辅助模型、额外采样或特权信息；简单按熵惩罚不确定位置又会压制失败轨迹仍可恢复的探索机会。

Result: 在多种推理任务及基础模型、推理模型上，EAPO取得最佳总体表现，并提升探索效果、问题覆盖度和候选答案多样性；摘要未提供总体分数。

Insight: 成功与失败应采用不同信用策略：高熵位置上的成功较难偶然重复，值得更多强化；低熵失败往往意味着模型会稳定重犯，应加强惩罚，而不确定失败位置则保留恢复空间。

Abstract: Reinforcement learning with verifiable rewards (RLVR) enhances reasoning in large language models (LLMs) through outcome-level feedback, yet recent approaches to finer-grained credit assignment often require auxiliary models, additional sampling, or privileged information. Although policy entropy provides a readily available signal, prioritizing uncertain positions under both reinforcement and penalization concentrates penalties where failed responses still retain alternatives for recovery, which can suppress opportunities for exploration. To address this, we introduce Entropic Advantage Policy Optimization (EAPO), an entropy-guided credit assignment method that treats success and failure asymmetrically. Specifically, motivated by the observation that success under uncertainty is less repeatable while confident failures tend to recur, EAPO couples normalized policy entropy with the sign of the response advantage to reinforce surprising success and correct repeated failure. It assigns stronger reinforcement to high-entropy decisions in successful responses and stronger penalties to low-entropy decisions in failed responses, while attenuating penalties at uncertain positions to preserve opportunities for recovery. By redistributing the response advantage across tokens, EAPO derives token-level credit directly from existing rollout signals without additional supervision. We validate EAPO on a range of reasoning tasks across both base and reasoning backbones, demonstrating that it achieves the best overall performance. We further show that EAPO promotes more effective exploration, broadening problem coverage and generating more diverse candidate answers.

[444] ChemOPD: Multi-Teacher On-Policy Distillation for Multi-Task Chemical Reasoning cs.LG | cs.CLPDF

Yaoyao Xu, Xinjian Zhao, Xiaozhuang Song, Xuemin Chen, Tianshu Yu

TL;DR: ChemOPD先依据微调梯度的任务亲和度组织部分重叠的化学推理专家，再以通才锚定、逐步增加专家贡献的在线蒸馏整合能力。

Details

Motivation: 统一模型需要覆盖多种化学推理能力，采用多教师在线蒸馏时既要决定如何分工训练专家，也要决定如何结合专家指导；教师更强并不必然产生更强学生。

Result: 在ChemCoTBench上，基于任务亲和度的专家分组相较通才教师带来依任务而异的提升，并超过若干语义分组方案。使用相同专家和路由时，锚点残差蒸馏在大多数报告指标上优于仅依赖专家的蒸馏，并吸收了更大比例的教师收益。

Insight: 专家组织和能力整合是相关但不同的问题。保留覆盖全任务的通才教师作为锚点，再逐步提高路由专家在学生自生成回答上的贡献，可以减少学生被局部专家能力取代通用监督的风险。

Abstract: Large language models are increasingly expected to support diverse chemical reasoning capabilities within a unified model. One approach is to develop specialized capabilities separately and consolidate them through multi-teacher on-policy distillation, but this raises two questions: how should specialization be organized, and how should specialist guidance be integrated? We introduce ChemOPD, which addresses both. We estimate task affinities from supervised fine-tuning gradients and solve a constrained mixed-integer program(MIP) to construct partially overlapping specialist groups. During distillation, we retain a generalist teacher trained on all tasks so that specialist guidance supplements rather than replaces its supervision. Our anchor-residual objective gradually increases the routed specialist’s contribution on student-generated responses. On ChemCoTBench, affinity-guided specialization produces task-dependent gains over the generalist teacher and improves several capabilities beyond semantic task grouping. Yet stronger teacher-side performance does not automatically yield stronger students: with the same specialists and routes, anchor-residual OPD improves most reported metrics over specialist-only distillation and realizes a larger share of the available teacher gains. These results highlight specialization and capability integration as connected but distinct design problems in chemical reasoning.

[445] Steering Language Model Goals with Value Transplant cs.LG | cs.CLPDF

Pengcheng Jiang, Fabien Roger

TL;DR: Value Transplant通过沿候选价值轴移动模型激活，把捐赠模型的目标倾向移植到宿主模型，初步展示了双向调整模型策略的可能性。

Details

Motivation: 推理模型表现得像在追求目标，但其实际策略有时偏离用户意图。若内部价值方向编码了模型对目标进展的判断，改变这一信号是否能把模型的搜索导向其他目标仍需检验。

Result: 在Qwen3-8B和GPT-OSS-20B的诚实/作弊微调版本中，诚实模型的价值移植降低作弊宿主的测试投机，作弊模型移植则使诚实宿主更易测试投机；诚实移植还提高了作弊宿主在可解编程任务上的隐藏测试表现。跨模型系列也观察到效果。

Insight: 在每个token处按捐赠者与宿主在候选价值轴上的坐标差调整宿主激活，能改变模型倾向采用的策略。实验支持该内部信号具有因果影响，但目前属于初步控制证据，不能据此推断已实现稳健目标对齐。

Abstract: Reasoning models often act as if they pursue goals, but their efforts are not always directed toward what users intend, sometimes leading them to pursue unintended outcomes. Previous work has examined how models may internally track their progress toward their goals through a “value axis.” We study whether changing such a signal can retarget the model’s search toward a different goal. We test value transplant: at each token, we shift the host model’s activation along a candidate value axis by the donor-host difference in value coordinates (multiplied by a large scalar), aiming to redirect the host toward the donor’s goal. We study this intervention in Qwen3-8B and GPT-OSS-20B models fine-tuned into honest and cheating variants. We test several candidate value axes, including a self-rating axis constructed from activations preceding high versus low elicited self-ratings of progress. The intervention works in both directions, with an honest donor reducing test-gaming in a cheating host and a cheating donor increasing test-gaming in an honest host, showing that this signal can influence which strategy the model follows. On solvable coding tasks, transplant from an honest donor also improves the cheating host’s hidden-test performance. Value transplant also works across model families, providing preliminary evidence for the intervention in a setting relevant to model control.

[446] Loop Dropout: Regularizing Shared Updates in Looped Language Models cs.LG | cs.CLPDF

Zirui Zhu, Hailun Xu, Xuanlei Zhao, Yong Liu, Yingxuan Ren

TL;DR: Loop Dropout在循环语言模型中随机跳过部分共享适配器应用，并按存活概率反向缩放，以维持更新强度并改善各循环位置的适配。

Details

Motivation: 循环模型反复应用同一个Transformer块，低秩适配器也需共享；标准LoRA更新表现出明显后期循环偏置。单纯随机丢弃适配器虽能打破偏置，却会降低训练期预期更新强度。

Result: Loop Dropout在不同模型规模、适配器秩和训练方案下改善数学推理，并扩展到通用指令微调与代码生成，超过既有LoRA变体和适配器正则方法。

Insight: 对随机保留的适配器更新做逆存活概率缩放，可以鼓励模型在较早循环也学会有效适配，同时保留所有骨干循环；推理时仍按标准方式在每一轮应用LoRA，无额外参数或计算。

Abstract: Looped language models separate computational depth from parameter count by repeatedly applying the same transformer block. Adapting these models requires a shared update that remains effective as hidden states evolve throughout the recurrent computation. Our empirical analysis reveals a pronounced late-loop bias in standard low-rank adaptation (LoRA): the shared update is more effective at later loop positions. This imbalance motivates training shared updates under varying combinations of their applications. Randomly omitting adapter applications alone, however, does not improve task performance; it reduces expected update strength during training while leaving inference unchanged. We introduce Loop Dropout, which couples stochastic masking of adapter applications with inverse-survival rescaling to preserve expected update strength and promote effective adaptation across loops. Extensive experiments demonstrate improved mathematical reasoning across model sizes, adapter ranks and training recipes, with benefits extending to general instruction tuning and code generation. Loop Dropout outperforms existing LoRA variants and adapter regularizers, while further analysis shows stronger early-loop adaptation. Every backbone loop remains active, and inference applies the adapter at all loops using standard LoRA without additional trainable parameters or inference computation.

[447] FORGE: Form-Optimal Routing of Grounded Evidence for Frozen LLM Agents cs.LG | cs.CLPDF

Xi Xiao, Yunbei Zhang, Chen Liu, Lin Zhao, Jialin Chen

TL;DR: FORGE为冻结大模型构建轻量路由器，逐查询联合选择证据呈现形式和推理深度，以提高答案质量并控制token成本。

Details

Motivation: 对只能通过API调用的冻结模型，下游适配只能调整输入证据和推理程序。固定证据形式与固定思考预算常对大量问题不合适，造成回答质量与token开销的浪费。

Result: 在5个知识密集型基准和8个参数规模7B至671B的冻结骨干上，FORGE在两个主模型上以低42%至45%的token成本提升准确率；也能零样本迁移到其他骨干并降低token成本。

Insight: 路由动作空间同时涵盖支持证据形式与思考深度，在成本感知效用下推导Boltzmann目标，并用26.9万参数分解式路由器学习；先枚举动作、再蒸馏目标分布，最后用主模型反馈做策略优化。

Abstract: In agentic AI systems, frozen foundation models are increasingly deployed as closed-weight API endpoints, making downstream adaptation possible only through the inputs and inference procedures surrounding the model. As a result, for each input query, two coupled decisions largely determine both answer quality and token cost: what evidence to provide and how much reasoning budget to allocate. Fixed defaults along these axes are often suboptimal, misallocating support form or reasoning depth on roughly 80% of queries in our analysis. To address this challenge, we propose FORGE, a unified framework for adapting frozen models through per-query routing over a joint action space that spans both support form and thinking depth. Under an entropy-regularized, cost-aware utility objective, we derive a closed-form Boltzmann routing target and instantiate the policy as a lightweight 269K-parameter factorized router. The routing policy is trained around the frozen host, without any weight access, through a three-stage pipeline: offline arm enumeration, supervised Kullback-Leibler (KL) distillation from the Boltzmann target, and Group Relative Policy Optimization (GRPO) refinement with host feedback. Across 5 knowledge-intensive benchmarks and 8 frozen backbones ranging from 7B to 671B parameters, FORGE improves accuracy at 42-45% lower token cost on both main hosts, transfers zero-shot across hosts at lower token cost, and composes with intrinsic thinking budgets where available.

[448] Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Lirui Luo, Kelong Mao, Heming Xia, Rongqing Li, Xinwei Yang

TL;DR: CAMG提供跨购物、编程、深度研究和自动研究的长程智能体环境，CAMG-RL则联合训练策略使用可持久化文件工作区作为记忆。

Details

Motivation: 已有强化学习记忆方法依赖预定义记忆工具和较短的专用环境，学到的行为绑定于基础模型预训练中没有的接口，迁移到长程任务后使用效果不佳。

Result: CAMG-RL-4B和CAMG-RL-9B分别在SWE-bench Verified及MLE-bench Lite上达到可与Qwen3.5-35B-A3B和Qwen3.5-122B-A10B竞争的表现。

Insight: 让模型直接通过shell创建、修改、检索和复用episode内持续存在的文件，可利用其已有文件操作能力学习记忆，而不是先适应专门的记忆API。跨四个环境异步联合强化学习能训练统一的文件记忆策略。

Abstract: Language-model agents increasingly tackle long-horizon tasks whose interaction histories exceed the model’s active context. Recent work has begun to use reinforcement learning to make memory control part of the policy, often relying on predefined memory tools within domain-specific training environments of relatively short horizons. This setup ties learned memory behavior to environment-specific interfaces that lie outside the base model’s pre-training and must be learned from scratch, so even after post-training, agents struggle to use memory in long-horizon tasks. To address these limitations, we introduce Coding Agent Memory Gym (CAMG), a suite of long-horizon agentic-RL environments spanning Shop, Coding, DeepResearch, and AutoResearch. Alongside each environment’s native task interface, CAMG provides executable shell access and an episode-persistent workspace, enabling agents to create, revise, search, and reuse files as memory throughout an episode. We also introduce CAMG-RL, which trains a single policy jointly across all four environments with fully asynchronous PPO, learning this file-based memory behavior directly from downstream task reward, and we train CAMG-RL-4B and CAMG-RL-9B from Qwen3.5 models of matching size. On SWE-bench Verified and MLE-bench Lite, CAMG-RL-4B and CAMG-RL-9B are competitive with Qwen3.5-35B-A3B and Qwen3.5-122B-A10B, respectively.

[449] LLMs as Adaptive Meta-Solvers: Strategy-Diverse RL for Industrial-Scale Optimization cs.LG | cs.CLPDF

Shihao Zhang, Weiting Liu, Siyu Shao, Yitian Chen, Jianfeng Feng

TL;DR: SDRL将大语言模型训练为能在集成求解器、精确组合算法和启发式搜索间自适应选择的优化元求解器。

Details

Motivation: 现有LLM优化方法多在小型、封闭文本问题上评估，且常绑定单一求解范式，难以应对工业规模实例的规模和结构差异。

Result: 在综合评测中，所提框架超过已有微调方法及DeepSeek-V4-Pro、GPT-5.5等前沿模型，在基准平均表现和工业规模任务上均取得优势；摘要未报告具体数值。

Insight: 不同优化求解策略在不同结构和规模的问题上各有优势。正确性门控的层级多样性奖励同时鼓励跨策略和策略内探索，防止过早塌缩；混合格式训练则兼容文本题与文件中提供的实例。

Abstract: Scaling LLM-based optimization from textbook-scale instances to real-world, industrial tasks remains a critical open challenge. Existing approaches are predominantly evaluated on small, self-contained textual problems and often commit to a solver-integrated paradigm, limiting their ability to handle the scale and structural diversity of practical optimization workloads. In this work, we propose a practical framework for training open-source LLMs to tackle real-world, industrial-scale optimization. We first show empirically that solver-integrated reasoning, exact combinatorial algorithm, and heuristic search exhibit complementary strengths across different problem structures and scales. Motivated by this, we introduce Strategy-Diverse Reinforcement Learning (SDRL), which trains LLMs as adaptive optimization meta-solvers. SDRL leverages this complementarity through a correctness-gated hierarchical diversity reward that promotes robust exploration across varying strategies and within each strategy, effectively preventing premature strategy collapse. We further introduce a mixed-format training scheme that jointly supports both self-contained textual problems and file-grounded instances. Across comprehensive evaluations, our framework outperforms existing fine-tuned methods and frontier models including DeepSeek-V4-Pro and GPT-5.5, both on average across benchmarks and on industrial-scale optimization tasks.

[450] Quality Determines Direction, Length Shapes Magnitude: Length Control for Open-Ended Reinforcement Learning cs.LG | cs.CLPDF

Zijun Weng, Zhongan Bi, Xuanang Gao, Xiaohui Hu, Shuangyong Song

TL;DR: QGLAS用质量奖励决定强化或抑制方向，只对质量占优且较短的回答增加有界优势，从而在开放式任务中控制冗长而不颠倒质量偏好。

Details

Motivation: 开放式强化学习容易使回答越来越长；质量与长度纠缠、没有自然成功边界，且组内质量奖励差距小时，长度塑形可能改变优势幅度甚至把奖励方向翻转。

Result: 在约30%压缩率下，QGLAS保留质量单独强化学习相较基线的98.4%至102.0%宏平均质量增益；相近压缩下代表性基线仅保留68.3%至75.5%。

Insight: 先只根据质量奖励计算优势，再仅给较短且原本为正优势的回答增加有界奖励，其他优势不变；奖励间隔越小，简洁度权重越高，质量差距清楚时则降低长度影响。

Abstract: Reinforcement learning (RL) changes not only what language models say, but also how much they say, often increasing response length at the cost of token efficiency. Controlling this length growth is particularly challenging in open-ended RL because (i) response length is entangled with quality, (ii) open-ended tasks lack a natural success boundary for deciding when efficiency should be prioritized, and (iii) dense, graded rewards often yield small within-group quality margins, making quality-induced advantages especially sensitive to reward-level length shaping, which can perturb their magnitudes and even reverse their signs. We therefore adopt an asymmetric principle: quality should determine the direction of reinforcement, while length should only shape its magnitude. We instantiate this principle with Quality-Gated Length Advantage Shaping (QGLAS), which first computes advantages from quality rewards alone, then adds bounded bonuses only to shorter positive-advantage responses, leaving all other advantages unchanged. The bonus strength is further adapted to within-group quality separation, allowing conciseness to matter more when quality-favored responses are similar and less when their quality differences are clear. Across different model families, open-ended benchmarks, and reward sources, QGLAS consistently achieves a stronger quality–length trade-off than representative baselines. At approximately 30% compression, QGLAS retains 98.4–102.0% of the macro-average quality gains achieved by quality-only RL over the base model, compared with 68.3–75.5% for these baselines at comparable compression.

[451] DivOPD: Spread Wide, Look Close for Asynchronous On-Policy Distillation of Multi-turn Agents cs.LG | cs.AI | cs.CLPDF

Hanyang Wang, Zeyuan Liu, Zhengyu Chen, Jingqing Ruan, Chaoxu Pang

TL;DR: DivOPD从异步在线蒸馏生成的有效轨迹中挑选更多rollout，并优先训练师生分歧较大的回合，减少经验过期和批次偏置。

Details

Motivation: 异步多轮训练按到达顺序组批，少数早到或很长的轨迹可能支配更新；其他已生成轨迹则可能在用到前过期，浪费经验和算力。

Result: 在ALFWorld、ScienceWorld和WebShop的六组设置中，峰值成功率均值由77.4升至84.4，最后五次评估均值由71.5升至78.6；达到所有报告目标所需训练token和学习器GPU时间分别加速1.84倍和1.87倍。加入教师短暂接管后，后五次均值升至82.4，GPU仍约快1.7倍。

Insight: 保持逐回合损失和优化器不变，只重分配固定训练预算：将更多轮次分摊到更多rollout，并在单条轨迹中优先挑师生累计分歧较大的回合；没有有效教师反馈的回合不纳入训练。

Abstract: On-policy distillation (OPD) trains student agents through teacher supervision on their own interactions with an environment. However, in asynchronous multi-turn training, arrival-order batching can allow a few early or long rollouts to dominate learner updates while other valid rollouts become stale before being used, wasting already-generated experience. To address this problem, we introduce DivOPD, a simple learner-side batch-selection method that spreads a fixed turn budget across more rollouts and, within each rollout, prioritizes turns with larger cumulative teacher-student disagreement. Turns without usable teacher feedback are excluded. The per-turn loss and optimizer remain fixed; selection only changes which student-visited turns receive training weight. For no-progress rollouts, an optional extension briefly hands control to the teacher before returning it to the student. Across six teacher-student settings on the simulated ALFWorld, ScienceWorld, and WebShop benchmarks, with 1.5B-7B students, DivOPD raises cross-setting mean peak success rate from 77.4 to 84.4 and mean success over the last five evaluations from 71.5 to 78.6. It reaches all reported setting-specific targets with geometric-mean speedups of 1.84x in training tokens and 1.87x in learner GPU time relative to vanilla OPD. Teacher intervention further raises this last-five mean to 82.4 while retaining about 1.7x learner-GPU speedup over vanilla OPD. Code will be released at https://github.com/HanyangWang0418-oss/DivOPD.

[452] Beyond Verbalized Confidence: Calibrating Reasoners with Differentiable Readouts cs.LG | cs.AI | cs.CLPDF

Chenxiao Fan, Chongming Gao, Gangyi Zhang, Leyang Shen, Yaxin Gong

TL;DR: CREDO从模型输出分布中的专用token对确定性读取置信度，并以可微回归校准，使置信估计同时辅助正确率提升。

Details

Motivation: 可验证奖励强化学习训练回答正确性，却不保证模型所报置信度校准，导致系统性过度自信。以文本采样置信度会产生方差、取值塌缩且不可微，校准只能通过标量奖励反传。

Result: 在数学与代码推理上，CREDO同时取得最好的准确率和置信度校准；收益还扩展到弃答和选择性预测，摘要未列具体指标。

Insight: 用输出分布中的专用token对读取置信度，避免把置信数字作为文本随机采样；再用可微回归直接训练该读数，并根据置信度与实际结果的差异给rollout加权，让校准信号也推动答案准确率。

Abstract: Reinforcement learning with verifiable rewards (RLVR) trains reasoning models to produce correct answers, but does not ensure that their stated confidence is calibrated. The resulting models are systematically overconfident. Recent methods train calibration inside the RLVR loop by having the model state a numerical confidence alongside its answer, but they all obtain the confidence by sampling it as text. This choice imposes two costs: a sampled confidence introduces variance and in practice collapses to a handful of distinct values, and sampling makes the confidence non-differentiable, forcing the calibration loss through a scalar reward. We propose CREDO (Confidence REaDOut) to replace sampling with a deterministic readout. While RLVR optimizes correctness, CREDO reads the confidence from a dedicated token pair in the model’s output distribution and trains it by differentiable regression. CREDO further turns the trained confidence into a signal for accuracy, weighting rollouts by how far confidence and outcome disagree, so that accuracy and calibration improve together. Across mathematical and code reasoning, CREDO attains the best accuracy and calibration, and the gains extend to abstention and selective prediction.

[453] ORPG: Reconciling Multiple Reward Objectives through Objective-wise Policy Gradients cs.LG | cs.CLPDF

Shicheng Fang, Yiwen Zhao, Wenbo Tian, Jiahao Lu, Yining Zheng

TL;DR: ORPG为不同奖励分别构造裁剪策略目标，再按梯度兼容程度或任务优先级调和成单一更新，以统一优化多目标。

Details

Motivation: 多奖励策略优化需要同时尊重各学习信号和目标间的关系。简单合并可能无法妥善处理相容目标的权重与冲突目标的优先级。

Result: 在有用性—安全性对齐上，ORPG相较各目标最强外部基线显著提升平均Useful和Harmless分数；数学推理上取得最高平均全预算准确率和三预算超体积，回答也比初始策略更准确且更短。

Insight: 相容梯度依据余弦相似度插值协调贡献，同时保留梯度和的范数，可解释为球面方向折中问题的唯一解；冲突时则按任务优先级投影。实验显示相容目标协调贡献更大，冲突处理起补充作用。

Abstract: Multi-reward policy optimization requires a joint update that reflects both the learning signals and the intended relationships among objectives. We introduce Objective-wise Reconciled Policy Gradient (ORPG), which constructs a separate clipped policy objective for each reward and reconciles the resulting gradients into one policy update. For compatible gradients, a cosine-dependent interpolation coordinates their contributions through a partially normalized reference while preserving the norm of their sum. We characterize this update as the unique solution of a spherical directional compromise. For conflicting gradients, projection follows the task’s priorities. We evaluate the same compatible rule in helpfulness–safety alignment and correctness–cost optimization for mathematical reasoning. ORPG substantially improves average Useful and Harmless scores over the strongest external baseline on each axis. In mathematics, it achieves the highest average full-budget accuracy and three-budget hypervolume among the compared methods, with more accurate and shorter responses than the initial policy. Component comparisons and training dynamics show the larger contribution of compatible coordination and a complementary benefit from conflict handling. These results support gradient reconciliation for objectives with equal standing and for objectives with an explicit priority.

[454] Frontier Learning: Training LLM Reasoners at the Edge of Capability cs.LG | cs.AI | cs.CLPDF

Robin Faro, Shyam Sundhar Ramesh, Ilija Bogunovic, Aurelien Lucchi

TL;DR: Frontier Learning在线生成随模型能力变化而调整难度的训练题，使强化学习持续聚焦模型能力边缘，而不是反复使用迅速过时的固定题池。

Details

Motivation: GRPO只有在rollout同时包含成功和失败时才提供有效学习信号；模型能力提升后，固定训练题池很快失去这种难度混合，导致可用信号减少。

Result: 在多项推理任务和不同模型家族上，Frontier Learning相较固定题池基线持续取得更高相对收益，支持训练中持续生成能力边缘题目；摘要未给出具体数字。

Insight: 将程序化生成器的任务参数视为可搜索空间，并用遗憾信号探索和优先分配不同难度等级，随着策略变化在线刷新有信息量的问题。持续造题和选择有用旧题同样重要。

Abstract: Reinforcement Learning-based post-training of Large Language Models (LLM) has been successfully applied to improve their reasoning capabilities. Existing pipelines primarily finetune LLMs on a fixed pool of problems specified prior to training using the GRPO loss. This is fundamentally limiting, as learning signal arises only when policy rollouts mix successes and failures, causing the useful portion of any fixed pool to quickly become stale as the model improves. To address this, we propose frontier learning, an open-ended post-training approach in which procedural generators are used online to continually produce informative training problems. It treats the generator’s task-specific parameters as a search space and uses a regret signal to prioritize and explore frontier difficulty levels in order to focus training at the edge of the model’s evolving reasoning capabilities. Across several reasoning tasks and model families, our approach consistently achieves higher relative gains over fixed-pool baselines, demonstrating that effective post-training requires not only selecting useful problems, but continually generating them at the edge of capability.

[455] LLMs are General Asynchronous Agents cs.LG | cs.CLPDF

George Yakushev, Denis Mazur, Vladimir Bartenev, Vyacheslav Zhdanovskiy, Timofey Byzov

TL;DR: 本文提出可由用户或智能体定义推理协程、并允许共享重叠记忆状态的通用异步大语言模型框架。

Details

Motivation: 现实任务常在模型思考或执行其他操作时继续接收输入，例如语音助理、具身机器人和监控系统；传统模型的读取、推理、回复或调用工具循环是顺序式的，不适合并发任务。

Result: Qwen 3.x模型在不进行任务专用训练的情况下，展示了流式视频理解、电子游戏和监控等任务中的异步运行能力；摘要未报告量化指标。

Insight: 把不同异步应用归纳为可组合的通用异步智能体，允许推理协程并发并共享部分记忆状态，从而避免为语音、视频流、机器人控制及工具调用分别设计专用体系。

Abstract: Modern LLMs are increasingly capable as autonomous agents, but they follow sequential interaction cycles: read, think, reply or call tools, repeat. Many real-world use cases are not sequential: voice assistants, embodied agents, and monitoring systems receive new inputs while they think or perform another task. Modern LLMs address this with specialized architectures for voice interaction and video streams, VLAs for robot control, asynchronous tool calling for API usage, and others. In this work, we generalize from different asynchronous tasks to general asynchronous agents that can adapt to different types of concurrency. To achieve this, we develop an asynchronous LLM framework that lets users (or the agents themselves) define inference coroutines with overlapping memory states. We showcase that Qwen 3.x models are capable of asynchronous operation for streaming video understanding, videogames, and monitoring, without task-specific training.

[456] CLIMB: A Clinical Multimorbidity Benchmark for Diagnosing Co-occurring Conditions through Multiturn Conversations cs.LG | cs.AI | cs.CLPDF

Yusuf Kesmen, Aniruddha Mukherjee, Yena Chang, David Sasu, Trevor Brokowski

TL;DR: CLIMB用医生模型与模拟患者的多轮问诊评估模型识别多种共病的能力，发现模型常沿单一诊断假设追问而漏掉其他条件。

Details

Motivation: 真实患者可能同时有多种疾病，相关证据会在问诊中逐步出现；临床推理评估因此既需要互动过程，也需多标签诊断，而非只判断一个答案。

Result: 六种前沿和开源模型在交互病例中没有任何一种能在超过10%的病例里恢复完整疾病集合；共病会降低诊断表现，互动进一步恶化。模型在看见提示后倾向锚定单一诊断，继续提问多增加错误诊断而不能补全集合。

Insight: CLIMB由临床决策算法和诊断数据合成病例，并以理论单假设跟踪模型刻画观察到的行为：模型围绕最初假设提问，只有当当前所见直接提示第二病种时才较可能补充，显示增加对话轮次不等同于提高共病覆盖。

Abstract: Patients often have several co-occurring clinical conditions, and the findings needed to identify and disambiguate them emerge over the course of a consultation. Evaluating clinical reasoning in this setting requires both multi-turn interaction and multi-label diagnosis. We introduce CLIMB, a benchmark in which a doctor model interviews a simulated patient to recover a ground truth set of co-occurring clinical conditions. Cases are synthesized from clinical decision algorithms and diagnostic datasets, grounding multimorbid presentations in structured clinical knowledge. Across six frontier and open models, none recovers the exact set of conditions in more than 10% of interactive cases. Diagnostic performance declines when conditions co-occur, even when models receive the full clinical record and the true number of conditions. Interaction reduces performance further. In controlled experiments, models behave like single-hypothesis trackers: they anchor on the diagnosis suggested by the opening findings, keep questioning around it, and recover a second condition mainly when a finding in view points to it. Questioning them further does not complete the set but adds mostly wrong diagnoses. We formalise this pattern with a theoretical reference model of single-hypothesis tracking. The benchmark, generator, and evaluation code are available at https://anonymous.4open.science/r/CLIMB-8340.

[457] Grounding Vision-Language Models in Driving Semantics: A Multi-Dataset Predicate Framework for Explainable Reasoning cs.LG | cs.CV | cs.ROPDF

Mohamed Chouai, Fazli Faruk Okumus, Stefan Kugele

TL;DR: 本文从多数据集几何、运动、时间、地图和交通灯证据确定性构造驾驶场景谓词，并用公共谓词知识图为VLM推理提供可追踪语义依据。

Details

Motivation: VLM可描述驾驶场景，但输出中的语义关系难以与实际交通状态核对，缺少可验证且跨数据集一致的场景表示。

Result: 在nuPlan和nuScenes各200个场景上，人工谓词关系验证的宏F1分别为0.94和0.93，共享谓词跨数据集平均差异0.02。冻结LLaVA-OneVision-7B使用谓词落地后，在9项NuPlanQA任务中7项准确率最高；交通灯从53.2%升至71.5%，情境评估76.2%升至86.1%，行动建议82.9%升至89.0%。

Insight: 数据集专属接口只负责恢复场景信息，谓词定义保持不变并写入统一图谱。Oracle条件下，可追踪的确定性谓词在其覆盖任务中减少视觉依赖；没有对应谓词的天气/照明任务则几乎无变化。

Abstract: Vision-language models are increasingly used for driving-scene understanding, yet the semantic relations expressed in their outputs are often difficult to verify against the underlying traffic situation. This paper introduces a deterministic multi-dataset predicate framework that derives driving-scene semantics from measurable geometric, kinematic, temporal, map, and traffic-control evidence. Dataset-specific interfaces are used only to recover the required scene information, while predicate definitions remain unchanged across nuPlan and nuScenes and are materialised in a common Predicate Knowledge Graph. Quantitative semantic validation against manually annotated predicate relations on 200 scenarios from each dataset yields macro F1 scores of 0.94 on nuPlan and 0.93 on nuScenes, with an average cross-dataset difference of 0.02 across the shared predicates. The Predicate KG is further evaluated using a frozen LLaVA-OneVision-7B model on the nine NuPlanQA subtasks. Predicate grounding achieves the highest accuracy among the evaluated visual-input conditions in seven of nine NuPlanQA subtasks, including Traffic Light (53.2% to 71.5%), Situation Assessment (76.2% to 86.1%), and Action Recommendation (82.9% to 89.0%). Weather/Lighting remains essentially unchanged (89.4% vs. 88.8%), consistent with the absence of corresponding predicates, while Predicate KG only input outperforms metadata-only input in eight of nine subtasks. The results show that deterministic predicates provide a consistent and traceable semantic representation and, under oracle grounding, can reduce visual dependence for reasoning tasks covered by the predicate vocabulary.

[458] Learning Through Game: Skewed Transfer of Tabular Knowledge to Strengthen Image Model cs.LG | cs.CV | cs.MMPDF

Longfei Huang, Shangdong Yang, Yang Yang

TL;DR: SKT以非对称方式把表格模态知识迁移到图像模型，通过两阶段纳什议价引导共享梯度优先改善图像单模态表现。

Details

Motivation: 表格—图像联合学习在测试时往往拿不到表格，因此训练中需把表格知识转移给图像模型；但模态能力不平衡、跨模态贡献不对称，使表格辅助作用难以有效发挥。

Result: 在常用表格—图像数据集上，SKT持续改善只用图像的模型表现；摘要未提供具体提升数值。

Insight: 共享头不增加参数，先寻找模态间梯度平衡点，再依据偏好把联合梯度导向有利于图像的方向。论文还对该策略的帕累托改进和收敛性质给出理论分析。

Abstract: Multimodal tabular-image learning is gaining growing attention, yet it faces challenges due to tabular data unavailable at test time. A practical solution involves transferring tabular knowledge to images during training to enhance the performance of image models at inference. However, the overlooked yet important challenges lie in the modality imbalance between images and tables, as well as their asymmetric modality relationship in cross-modal transfer, which limits the auxiliary role of tabular data. To address these issues, we propose Skewed Knowledge Transfer (SKT), which asymmetrically transfers tabular knowledge to improve the image model by adaptive integration of modality gradients in a shared parameter space. Specifically, we first introduce a multimodal shared head, which allows the model to benefit from cross-modal structure without adding additional parameters. We then design a two-step Nash Bargaining strategy to effectively leverage tabular gradients. In the first step, SKT seeks a point of modality balance and uses preference awareness in the second step to steer combined gradients toward image-beneficial directions. Furthermore, we theoretically analyze the Pareto improvement and convergence of SKT. To this end, tabular knowledge is explicitly transferred to enhance image models. Empirical experiments on widely used tabular-image datasets reveal that SKT consistently improves image unimodal performance by using tabular data as auxiliary information.

[459] Timestep Weighting: A Hidden Key to Effective ELBO-Based Flow-Matching RL cs.LG | cs.AI | cs.CVPDF

Qinwei Ma, Jingzhe Shi, Simin Fan, Ling Li, Mengdi Wang

TL;DR: 本文系统研究流匹配强化学习中的ELBO时间步权重，指出最优噪声级权重随奖励结构和训练阶段变化。

Details

Motivation: 基于ELBO的强化学习可不依赖具体采样器来微调流匹配模型，但时间步加权显著影响效果，常被直接沿用预训练配置，尚缺乏研究。

Result: 受控CIFAR生成和机器人实验表明，权重会改变不同噪声级的奖励更新；梯度分析揭示任务间及训练过程中的噪声级协同模式。静态权重、预算化配置选择和动态日程均可优于常见默认值，但摘要未列具体指标。

Insight: 有效加权取决于当前策略行为与奖励偏好行为之间的差距，且会随学习推进变化。时间步权重不仅是实现细节，也是统一理解既有预测损失选择的视角，值得在训练中动态适配。

Abstract: ELBO-based reinforcement learning offers a sampler-agnostic approach to fine-tuning flow matching models with reward feedback. Timestep weighting in ELBO-based RL has large impact on performance, and it also provides a unified view (as we show in this work) to understand prediction losses heuristically chosen in prior work, yet it remains under-researched and is often chosen to inherit pretrain configs. We investigate impacts and dynamics of timestep weighting in ELBO-based RL. We show that effective weighting depends on both the reward landscape and stage of learning. (1) Through experiments on controlled CIFAR image generation, complemented by robotics, we investigate how weighting impacts reward-driven updates across noise levels. (2) Through gradient analysis, we reveal distinct patterns of cross-noise coordination across tasks and their evolution during training. These findings motivate the hypothesis that useful weighting depends on the gap between the policy’s current behavior and the behavior favored by the reward. (3) Guided by this analysis, we study simple static weighting, budgeted profile selection, and dynamic schedules that improve performance beyond conventional target choices. Our results establish timestep weighting as an important design choice for flow-matching RL and motivate further research into methods that choose and adapt it throughout learning.

[460] When an Evaluation Rule Writes Training Labels: Measuring Human-Reference Forgiveness in NAVSIM cs.LG | cs.CV | cs.ROPDF

Jiaxuan Guo, Jingxin Yang, Jiaqi Ye, Youran Sun, Shuo Xin

TL;DR: 本文量化NAVSIM对人类参考轨迹的豁免规则如何改写训练标签，并比较发布标签与未覆盖原始结果对驾驶策略的影响。

Details

Motivation: NAVSIM标签生成器在人类参考某指标得零分时，把该场景全部16,384条候选轨迹标为通过。该豁免旨在不惩罚情境合理驾驶，但可能消除训练所需的候选差异。

Result: 规则在103,288个训练场景中的11,237个（10.8793%）抹去了损失读取的候选区分。被豁免场景上的已发布车道保持头AUC为0.7095，对比匹配未豁免场景0.9807；继续训练实验显示使用覆盖前目标可提高该组AUC 0.1086至0.1251。关闭豁免后车道保持指标提高2.478至3.524分，但相邻帧计划一致性下降。

Insight: 将目标覆盖前后标签、检查点训练和重新评分成对比较，可追踪评估规则对监督与行为的影响。收益集中于车道保持受豁免的场景，而按同样方式评分的EPDMS无法区分两组目标，表明结论依赖具体指标。

Abstract: When the human reference scores zero on a metric, the released GTRS-Dense label generator for NAVSIM marks every candidate trajectory in the scene as passing it. NAVSIM’s authors introduced this human-reference forgiveness to avoid penalizing contextually justified maneuvers when scoring one trajectory, and warned that it could overlook important failures. In label generation it sets a whole column of 16,384 candidate targets to passing. To measure the consequences for supervision, we re-run the generator with the overwrite disabled and compare the pre-overwrite targets with the released labels on all 103,288 navtrain scenes. The rule erases a candidate distinction that the training loss reads on 11,237 of them (10.8793%). Firing usually changes most of a column: lane keeping carries 9,982 of the 13,042 forgiven loss columns, and its median forgiven column had 14,391 of 16,384 candidates failing before the overwrite. On held-out navtest scenes forgiven on lane keeping, the released lane-keeping head’s median AUC against the pre-overwrite outcome is 0.7095; on unforgiven scenes matched on failing-candidate count it is 0.9807. For the Hydra-MDP checkpoint released with GTRS, whose configuration takes the same label file, the two values are 0.6627 and 0.9761. Continuing the released GTRS-Dense checkpoint for 300 optimizer steps with three paired seeds, we observe the forgiven-scene AUC 0.1086-0.1251 higher with pre-overwrite than with published targets, and a narrower gap between matched groups, still above zero. Scoring with forgiveness disabled, we observe lane keeping higher by 2.478-3.524 points on navtest scenes forgiven on any of five loss metrics, with lower adjacent-frame plan consistency. Both changes are larger there than on the rest. EPDMS, scored the same way, does not separate the two target sets.

[461] Elucidating the Design Space of Regression-based Diffusion Reinforcement Learning cs.LG | cs.CVPDF

Toyota Li, David Zhao, Alan Zhao

TL;DR: 本文将多种基于回归的扩散/流匹配强化学习方法统一为散度约束奖励优化，并据此提出收敛更快、训练更稳的DiffusionRFT。

Details

Motivation: DiffusionNFT、FlowAWR和RAM等方法用奖励重加权监督回归而非策略梯度，但它们的共同原理和设计差别尚不清楚。

Result: 统一分析表明这些方法都是同一散度约束奖励最大化问题的解，只因凸生成函数不同；在经验比较后提出的DiffusionRFT收敛更快、更稳定并取得最佳表现，摘要未提供具体任务分数。

Insight: 回归目标中的优势项可从KKT条件与后验归一化推导；不同近似方式对应不同目标。保留线性倾斜的精确sparsemax单纯形投影可形成更优方法，提供了系统设计这类扩散强化学习配方的框架。

Abstract: A nascent family of methods that forgoes the policy gradient and reweights a supervised regression instead has garnered momentum in reinforcement learning for diffusion and flow models. DiffusionNFT, FlowAWR, and RAM are representative regimes with contrasting motivations. It is yet opaque what, if anything, they share. We substantiate that each is the solution of one divergence-constrained reward-maximization problem, and they are differentiated only by the convex generator that defines the constraint. Under the unified modeling framework, we unravel the relaxations that prior art made during building the advantage-embedded regression target: approximating the KKT condition and posterior normalizer for the linear and exponential tilt shapes DiffusionNFT and FlowAWR respectively, while preserving the exact sparsemax projection onto the probability simplex for linear tilt leads to another superior model type in this work. Beyond the theoretical underpinnings, we further empirically investigate the design space and shed light on the training recipe for regression-style diffusion RL. Retaining the merits discovered during our exploration gives rise to DiffusionRFT, our paradigm that converges faster, trains more stably, and attains the top performance.

[462] MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perception cs.LG | cs.AI | cs.CV | physics.comp-phPDF

Yuhao Li, Louie Hong Yao, Tianyi Shi, Hanqun Cao, Hongxia Hao

TL;DR: MinkowskiPE用洛伦兹变换参数化时空位置编码，使注意力显式依赖token间相对时空间隔且对坐标整体平移不变。

Details

Motivation: 物理智能需跨微观与宏观尺度捕捉时空耦合；物理驱动模型先验强但灵活性有限，纯学习架构更灵活却通常把时空关系隐式化。

Result: 在九项多轨迹分子动力学评估中取得最佳结果；KTH视频预测MSE较最佳基线降低9.9%，参数量约为其十分之一。

Insight: 联合时间和空间坐标控制查询、键特征的洛伦兹变换，使点积注意力的位置依赖只通过两token相对时空位移表达。它保留标准点积注意力接口，并兼容高效注意力实现。

Abstract: Modeling spatiotemporal coupling is a key challenge in building physical intelligence across scales, from microscopic to macroscopic. Existing models capture such structure broadly through physics-motivated dynamical formulations or learning-motivated architectures. The former provide stronger priors but may constrain flexibility, whereas the latter are more flexible but leave the spatiotemporal coupling largely implicit. We therefore seek an approach that combines flexible learning with an explicit geometric bias for jointly modeling time and space. To this end, we propose Minkowski Positional Encoding (MinkowskiPE), which uses joint temporal and spatial coordinates to parameterize Lorentz transformations applied to query and key features. With MinkowskiPE, the query-key attention score depends on position only through the relative spacetime displacement between the two tokens and is therefore invariant to global translation of the coordinates. This paradigm retains the standard dot-product attention interface and remains compatible with efficient attention implementations. We evaluate MinkowskiPE on microscopic molecular dynamics and macroscopic video prediction tasks, achieving the best results on all nine multi-trajectory molecular evaluations and reducing KTH video-prediction MSE by 9.9% relative to the best baseline while using roughly one-tenth as many parameters.

[463] Structure-Adaptive Tree Field Integrators cs.LG | cs.CV | cs.DS | math.NA | math.OCPDF

Millend Roy, Soham Samal, Ivan Zelich, Krzysztof Marcin Choromanski

TL;DR: STAD-TFIs利用树结构的路径骨架和单顶点分隔子结构，加速具有距离核的一般树张量场积分。

Details

Motivation: 树上的距离依赖核积分可用于最优传输、几何和视觉模型，但现有快速树场积分器仍有计算开销。

Result: 论文给出近线性算法和理论分析，并在合成树速度、真实网格Sinkhorn近似以及视觉拓扑注意力任务中进行广泛评估；摘要称其为从快速树积分得到高效且准确测地Sinkhorn近似的早期结果之一。

Insight: 按路径骨架与单点分隔符分解树结构，并用二维快速傅里叶变换联合计算交互，较常规高效树场积分器更快。树结构适配分解是加速距离核运算的关键。

Abstract: We present a new class of near-linear algorithms for efficiently integrating general tensor fields defined on trees with distance dependent kernels, the Structure-Adaptive Tree Field Integrators (STAD-TFIs). STAD-TFIs exploit the tree’s underlying structure through decompositions built around path backbones and single vertex separators, and use two-dimensional fast Fourier transforms to compute interactions jointly. By exploiting this structural information, STAD-TFIs achieve more computationally efficient integration than their regular efficient tree field integrators (TFI) counterparts. We provide a detailed theoretical analysis of our proposed approach and complement it with an exhaustive empirical evaluation, ranging from speed tests on synthetic trees, through accelerated Sinkhorn-based relaxations of the Optimal Transport algorithms on real meshes, to Topological Attention Transformers for vision tasks. To the best of our knowledge, we provide some of the first results showing that efficient to compute and accurate relaxations of the geodesic Sinkhorn-based solutions of the Optimal Transport problem can be derived by applying fast TFI methods.

[464] WorldGraph: Graph-Native World Modeling cs.LG | cs.AI | cs.CVPDF

Zezhong Ding, Yipeng Li, Xike Xie

TL;DR: WorldGraph把演化图本身定义为世界动态，联合建模节点、边和整图级转移，并以结构感知强化学习优化预测。

Details

Motivation: 现实环境常以关系图形式变化，但既有图世界模型多用图结构组织内部状态或服务特定推理，而非把图演化本身当作世界状态转移。

Result: 在覆盖八个时序图数据集、节点/边/整图三层转移的GWM-Zero上，WorldGraph持续超过图表征、时序图学习、图预训练和图世界模型基线。

Insight: 状态感知图Transformer进行多粒度结构及转移条件演化建模，转移感知GRPO则采用动态分组和结构可验证奖励，使训练直接对应图动态的预测质量。

Abstract: World models infer latent states of an environment to capture its underlying dynamics and predict future evolution. Many real-world environments, however, are inherently relational and observed as evolving graphs, where entities, relations, and their properties change over time. Prior graph-related world models use graph structures to organize internal states or support task-specific reasoning, rather than treating an evolving graph itself as the modeled world. We instead study graph world modeling (GWM), where graph evolution itself constitutes the world dynamics. We formulate graph world modeling over observed graph evolution, latent graph states, and heterogeneous graph-transition predictions. Based on this formulation, we construct GWM-Zero, a benchmark covering node-, edge-, and graph-level transitions over eight temporal graph datasets. We propose WorldGraph, which combines a state-aware graph transformer for multi-granularity structural and transition-conditioned evolution modeling with transition-aware GRPO using dynamic grouping and structure-aware verifiable rewards. Extensive experiments on GWM-Zero show that WorldGraph consistently outperforms representative graph representation, temporal graph learning, graph pretraining, and graph world-model baselines across all three transition granularities.

[465] Unlocking Few-Step Diffusion for Faithful Previews cs.LG | cs.CV | stat.MLPDF

Jing Jia, Sifan Liu, Guanyang Wang

TL;DR: 本文为3至4步冻结扩散采样器学习初始噪声与去噪更新修正，使其低成本预览更忠实地对应相同噪声和提示下的完整采样结果。

Details

Motivation: 扩散工作流中用户通常生成并丢弃多个候选，逐个完整采样延迟累积。少步样本差并不一定是模型重建能力不足，而可能是采样过程没有利用已有能力。

Result: 在无条件基准上，参考保真重建MSE比重新训练的LD3低53%至78%；在SD1.5、SDXL和FLUX.1-dev上也改善候选排序保持和选择效果，输入修正可跨采样步数复用而无需再训练。

Insight: 仅优化少步采样器初始噪声已能接近相应完整步数输出；进一步以终点监督学习噪声和去噪更新修正，为廉价筛选提供可靠预览，将完整采样留给有希望的候选。

Abstract: Sampling latency compounds in diffusion workflows, where users generate and discard many candidates before keeping one. Surprisingly, the poor outputs of standard few-step samplers do not reflect a lack of reconstruction capacity: by optimizing only the initial noise, frozen 3-4-step samplers can closely reproduce their corresponding full-step outputs. Building on this finding, we learn corrections to the initial noise and denoising updates using endpoint supervision, improving correspondence with full-step outputs generated from the same noise and prompt. The resulting previews allow users to screen candidates cheaply and reserve full-step generation for promising ones. Input correction also transfers across sampling budgets without retraining. Experiments show substantial improvements in reference fidelity, including 53-78% lower reconstruction MSE than retrained LD3 on unconditional benchmarks, alongside improved ranking preservation and candidate selection on SD1.5, SDXL, and FLUX.1-dev.

[466] Learning What to Recall: Adaptive Multi-Cue Episodic Memory for World Models cs.LG | cs.AI | cs.CVPDF

Beomsu Kim, Chieh-Hsin Lai, Bac Nguyen, Amir Bar, Jong Chul Ye

TL;DR: FAR通过训练时未来预测效用学习情景记忆检索器，使世界模型按当前查询动态判断该信任时间、位姿、视觉或音频线索。

Details

Motivation: 世界模型预测可能依赖很久以前的观察。随着记忆增多，固定按新近度、位姿重叠或视觉相似度检索在不同环境和查询下不可靠，难以判断哪些历史真正有用。

Result: 在三个互补设置中，FAR使用同样检索线索但持续超过手工检索策略，能自动调整各线索可信度，并在环境变化时找回合适历史；摘要未列具体分数。

Insight: 训练时用给定记忆上下文后实际未来的条件对数似然衡量预测价值，并以扩散预测损失近似；据此监督检索器。推理时检索器看不到未来，避免测试时泄漏。

Abstract: World models predict future observations from current experience and actions, yet prediction can depend on observations seen far in the past. Episodic memory preserves past observations for later recall; however, as memory accumulates, it raises a fundamental question: which memories are useful for the current prediction, and which available retrieval cues should be trusted to find them? This is challenging because fixed criteria based on recency, pose overlap, or visual similarity can be unreliable across environments and queries. We propose Future-Aware Recall (FAR), a framework that learns episodic recall from future-aware predictive supervision and adaptive multi-cue scoring. During training, FAR measures predictive utility by the conditional log-likelihood of the realized future given recalled context, approximated by negative diffusion prediction loss, and uses it to train a retriever that remains future-blind at inference. The retriever learns cue-specific relevance and automatically determines which available retrieval cues, such as time, pose, vision, and audio, to trust for each query when selecting memories. Across three complementary settings, FAR outperforms hand-designed recall even with the same retrieval cues, automatically adapts which available cues to trust, and recalls the right history as the world changes. Together, these results establish FAR as a flexible, principled approach to episodic memory access in world models.

[467] Adjoint Guidance Flow: Amortized Critic Guidance for VLA Policies cs.LG | cs.CV | cs.ROPDF

Jeongsol Kim, Youngjun Jun, Kyumin Choi, Youngmin Kim, Seonghyun Jin

TL;DR: AGF把价值评论器的轨迹级梯度引导蒸馏到轻量网络，保留预训练VLA并避免推理时运行评论器集成或反向传播。

Details

Motivation: 流策略VLA多靠行为克隆训练，没有显式优化长期任务回报。现有评论器引导方法用单步采样器近似并在每个流步骤对评论器集成反传，训练和推理成本较大。

Result: 在LIBERO、RoboCasa和LIBERO-Pro上，AGF持续改善预训练VLA，与评论器引导及策略微调基线相当或更好；用单一引导强度跨任务部署时鲁棒性最高。相较QGF，每步快3.6倍、参数少7倍。

Insight: 将评论器引导的流生成表述为确定性最优控制，最优引导是把终端评论器梯度沿剩余流过程回传的协态。固定VLA和评论器，用该协态监督轻量引导网络；推理每步仅需引导网络一次前向。

Abstract: Flow-based Vision-Language-Action (VLA) policies are typically trained by behavior cloning and thus do not explicitly optimize long-term task return. Critic guidance steers generation toward higher-value actions, but existing methods differentiate the critic through a one-step surrogate of the sampler and back-propagate a critic ensemble at every flow step. In contrast, here we propose Adjoint Guidance Flow (AGF), which amortizes trajectory-aware critic guidance into a lightweight guidance network while preserving the pretrained VLA policy. Specifically, we formulate critic-guided flow generation as a deterministic optimal control problem, whose optimal guidance is a costate that carries the terminal critic gradient back through the remaining flow, and regress the guidance network onto this costate while keeping both the VLA and critic frozen. This design provides favorable memory and throughput scaling during training, and inference needs one guidance-network forward pass per step, without the critic ensemble, back-propagation, or adjoint computation. Across LIBERO, RoboCasa, and LIBERO-Pro, AGF consistently improves pretrained VLAs, remains competitive with critic-guidance and policy-fine-tuning baselines, and is the most robust method when a single guidance strength is deployed across tasks. Compared with QGF, AGF runs $3.6\times$ faster per guidance step with $7.0\times$ fewer parameters, with comparable and even better performance, showing that critic guidance can be trajectory-aware and lightweight.

[468] Inspector: Conversational and Lightweight Analyzer of Analog Circuit Layouts Using LLM and CNNs cs.LG | cs.CVPDF

Abril Cano Castro, Giuseppe Chiari, Michele Piccoli, Federico Viola, Davide Zoni

TL;DR: Inspector结合微调语言模型与CNN分析模拟电路GDSII版图，并通过对话接口支持设计者查询物理几何及寄生效应信息。

Details

Motivation: GDSII是模拟电路最完整、准确的物理布局数据库，包含影响流片表现的几何和寄生细节；人工或传统算法分析难以通过自然对话方便访问。

Result: 在四类真实任务、数千个模拟设计上，Inspector较通用大型VLM最多高81%，提供轻量版图分析方案。

Insight: 针对GDSII结构联合使用CNN视觉/几何处理和微调LLM语言交互，把专业版图分析封装为设计者可查询的对话工具，而不是直接依赖通用模型解释原始图。

Abstract: The integration of artificial intelligence into computer-aided design frameworks has sparked a shift in the design of analog integrated circuits (ICs), transitioning the field from using manual and algorithmic-based solutions to adopting automated and intelligent paradigms. In this scenario, the GDSII file represents the industry-standard database containing the ultimate and most accurate source of information of the analog circuit, encapsulating the complex physical geometries and parasitic realities that define tape out performance. This paper proposes a novel framework that combines fine-tuned LLMs and CNNs to analyze GDSII files of analog circuits, enabling a conversational interface between the tool and the designers. Experimental results using thousands of analog designs across four realistic tasks demonstrate that the proposed solution outperforms state-of-the-art general-purpose massive VLMs by a significant margin (up to 81%), thus providing a lightweight solution to the problem of GDSII analysis.

[469] $λ$-JEPA Spectral Anti-Collapse Regularization for Self-Supervised Learning cs.LG | cs.CVPDF

Berker Demirel, Clémentine Dominé, Valentino Maiorca, Marco Fumero, Marco Mondelli

TL;DR: SACReg以谱抗坍塌正则让骨干表示满足层间λ平衡，并据此构建在图像与视频自监督任务上表现更好的λ-JEPA。

Details

Motivation: 联合嵌入自监督通常在投影头后防止表示坍塌，但下游使用的是投影前骨干特征；骨干仍可能维持低有效秩，损害迁移。

Result: 理论上，两层线性网络中λ平衡可阻止坍塌，骨干上施加正则会诱导该平衡；ImageNet100经验结果中表示秩增加。λ-JEPA在ImageNet-1k分类、八个图像下游线性探测及Something-Something-v2和Kinetics-400视频基准上超过相应JEPA对手。

Insight: 通过层间权重尺度关系刻画λ平衡，并将分析转化为骨干级谱正则SACReg；应用于JEPA后形成λ-JEPA，兼顾投影目标与实际用于下游的骨干表示秩。

Abstract: Joint-embedding self-supervised learning typically combines an invariance objective across augmented views with additional mechanisms to prevent representational collapse. These objectives are often applied after a projection head, while downstream tasks use the backbone representation before the projector. We find that this mismatch does not necessarily prevent dimensional collapse in the backbone, which can retain low effective rank and potentially limit downstream transfer. To address this, we introduce SACReg, a spectral anti-collapse regularizer motivated by an analysis of $λ$-balance, which captures the relative scale of weight matrices across layers. In a two-layer linear network, we show that (i) $λ$-balance prevents collapse, and (ii) our regularizer applied to the backbone induces $λ$-balance. In the nonlinear case, this regularizer leads to anti-collapse as well and, in realistic architectures on ImageNet100, it empirically increases the representations’ ranks. We apply SACReg to JEPA and propose $λ$-JEPA, which improves over LeJEPA and VISReg on ImageNet-1k classification and in average linear-probe transfer performance across eight downstream image datasets. On video self-supervised learning, $λ$-JEPA improves over LeVJEPA and V-JEPA 2 on the Something-Something-v2 and Kinetics-400 benchmarks. Code is available at https://github.com/berkerdemirel/lambda-jepa.

[470] Narrow Multimodal Fine-Tuning Can Induce Emergent Misalignment cs.LG | cs.CVPDF

Shunchang Liu, Lukas Fluri, Xin Chen, Francesco Croce

TL;DR: 本文显示针对狭窄多模态任务的微调可使VLM出现跨任务涌现失配，包括不诚实、不安全生成和更易受视觉越狱影响。

Details

Motivation: 文本模型狭窄微调引发广泛有害行为已受关注，但类似涌现失配是否也会出现在视觉语言模型尚不明确。

Result: 在15种商业与开源模型上，对脆弱代码、危险家居操作或阴谋式场景解释的狭窄微调，会迁移到无关任务并产生失配观点、视觉事实不诚实、不安全图像生成、视觉越狱和风险代理行为；监督微调与偏好优化均可触发，若干缓解手段仅部分有效。

Insight: 多模态失配并非简单能力普遍退化，更像行为偏移；是否发生对训练—评估模态匹配敏感，却不取决于训练数据表面危害程度，并能经中间推理传播。提示免疫、良性继续训练和激活引导可减轻但无法完全消除。

Abstract: Modern AI models are aligned through post-training to adapt them to downstream tasks. Recent work shows that fine-tuning language models on narrow tasks can induce emergent misalignment (EM), causing broadly harmful behaviors beyond the training task. However, EM has been studied almost entirely in text-only tasks, leaving its manifestation in multimodal models unclear. In this paper, we define and analyze EM in the context of vision-language models. We first induce EM via fine-tuning on narrow multimodal tasks targeting vulnerable code, careless household-object use, and conspiratorial interpretations of ordinary scenes. Across fifteen commercial and open-source models with different scales, we find that narrow multimodal fine-tuning can induce coherent and broadly misaligned behavior that transfers to unrelated tasks, including misaligned opinions, visual factual dishonesty, unsafe image generation, vulnerability to visual jailbreaks, and risky agentic actions. We further find that multimodal EM does not depend on the apparent harmfulness of training data but is sensitive to training-evaluation modality alignment. EM can arise under both supervised fine-tuning and preference optimization and can propagate through intermediate reasoning. Finally, we explore several mitigation strategies, including prompt inoculation, benign continued training, and activation-level steering, which can partially reduce EM. Overall, our findings suggest that multimodal EM reflects a behavioral shift rather than a general loss of capability, extending beyond text to the visual modality.

cs.MA [Back]

[471] On Evaluating and Improving Conversational Agents in Production cs.MA | cs.AI | cs.CL | cs.ET | cs.IRPDF

Kasra Hosseini, Wen-Sen Cheng, Marco-Andrea Buchmann, Emir Mulabegovic, Weiwei Cheng

TL;DR: 该工作提出生产环境多智能体购物助手的评估与改进流程，用固定客户场景、本地用户模拟和重复基线运行评估行为变化，而不直接回放旧对话。

Details

Motivation: 修改系统后，旧对话不能原样重放，因为某一轮回答变化会改变后续交互；系统本身也受随机生成、商品价格、库存及用户信号变化影响，汇总分数又无法定位具体行为变化。

Result: 生产调查显示，断言画像可定位商品轮播中的受影响位置，重复运行能区分真实改善和随机波动；评估审计还发现一个裁判缺少所需证据，以及一个模型设置虽配置却未实际生效。摘要未给出总体业务提升数值。

Insight: Evaluation Harness 根据目标行为生成断言和固定客户情境，用接地用户模拟在本地重新生成客户轮次；未修改系统多次运行构成基线。Improvement Orchestrator 把断言结果转成假设，逐项隔离修改，并用情境级配对百分位 bootstrap 区间比较；未来评测修订须经人工批准。

Abstract: We present a framework for evaluating and improving a large-scale, multi-agent shopping assistant in production, and report lessons from its use. Offline evaluation of such a system faces three obstacles. (i) A logged conversation cannot be replayed against a modified system, because a different response changes every turn that follows. (ii) The unchanged system itself varies from run to run. Its LLM components are stochastic, and in product search the available products, their prices, and the customer’s personalization signals change. (iii) Aggregate quality scores combine distinct behaviors, so they show that quality has changed but not which behavior caused the change. Our framework addresses each obstacle in turn. For a reported behavior, an Evaluation Harness generates targeted assertions and a fixed cohort of customer scenarios. It then reproduces the behavior in a local instance of the assistant through grounded user simulation. Instead of replaying the log, the simulator writes new customer turns conditioned on the recorded messages and context. Repeated runs of the unchanged system form a stored baseline. An Improvement Orchestrator turns the assertion results into hypotheses, implements each as an isolated modification, and compares it with the baseline using paired percentile bootstrap intervals over scenario-level differences. When an investigation ends, the harness may propose revisions to future evaluations, subject to human approval and without altering past decisions. We report production investigations with this framework. Assertion profiles showed which positions of a product carousel a failure affected, and repeated runs distinguished a real improvement from run-to-run fluctuation. Audits of the evaluation itself found a judge that lacked the evidence it needed and a model setting that was configured but not applied.

cs.RO [Back]

[472] Robot Manipulation with GPT-6-Astra: Body Knowledge, Experience Reuse, Emergent Skills, and Sim2Real Transfer cs.RO | cs.AI | cs.CL | cs.CV | cs.LGPDF

Sida He, Lingxi Xie, Yunning Cao, Pengfei Chen, Kaiwen Duan

TL;DR: 该研究报告 GPT-6-Astra 在电梯按钮机器人任务中如何利用身体几何知识、动作经验和可复用视觉反馈技能减少探索与执行时间，并测试模拟到真实迁移。

Details

Motivation: 多模态代理可以生成机器人控制程序，但反复探索和模型参与的动作选择会拖慢执行；研究检验机器可读机器人信息、同步经验和代理形成的程序能否改善效率。

Result: 模拟中 30 次固定起点试验显示，完整机器人几何和相机信息使平均完成时间较仅有通用控制接口、无先验的基线减少 57.4%；加入同步动作/状态图像记录减少 68.6%。18 次起点偏移 10–100 cm 的配对试验中，原起点经验使平均时间减少 58%–63%。研究者整理的短视觉反馈程序在 27 次模拟试验中减少 29%–31% 时间。12 次真实机器人试验中，仿真资产和仿真经验在共用起点分别减少 53.0% 和 49.9% 时间。

Insight: 机器可读身体描述与同步示范可降低初始探索成本，代理生成的有效反馈程序可整理为可复用技能，再由当前图像适应动作。真实试验确认了有限按钮接触任务中的 sim-to-real 复用，结论范围限于此任务与样本量。

Abstract: General-purpose multimodal agents can write robot-control programs, but repeated exploration and model-mediated action selection can make execution slow. We study how external body knowledge, successful experience, and executable skills improve an XLeRobot controlled by GPT-6-Astra in a simulated and a physical elevator-button task. In 30 fixed-start simulation trials, complete robot geometry and camera information reduce mean completion time by 57.4% relative to a baseline with only the common control interface and no prior experience; images with synchronized action and state records reduce it by 68.6% without additional body assets. In nine paired comparisons (18 trials) at starts displaced by 10-100 cm, experience recorded at the original start reduces mean time by 58-63% relative to no experience, demonstrating generalization to the tested new starting positions. During experience experiments, GPT-6-Astra spontaneously generates a short visual-feedback program. Researcher-refactored versions reduce mean local-task time by 29-31% in 27 simulation trials. Finally, 12 real-robot trials using operator-confirmed button contact demonstrate sim2real reuse: at a shared nominal start, simulation XML assets and simulation experience reduce mean time by 53.0% and 49.9%, respectively; real experience also transfers to two new starts. These results suggest a practical way to build general-purpose manipulation experiments around GPT-6-Astra: supply machine-readable body descriptions and synchronized demonstrations, and turn useful agent-generated feedback routines into reusable skills, while the agent adapts actions from current images. We release all task prompts, trial-level experimental data, and acquired skill implementations at https://github.com/hesd10/astra-robot-sim2real.

Trung Tien Dong, Zhenqi Wu, Sahasra Kondapalli, Jiayi Wu, Yi Sheng

TL;DR: AquaBEV-Nav直接从单帧RGB预测水下鸟瞰占用，避免在浑浊和波长衰减环境中依赖不可靠的单目深度估计。

Details

Motivation: 传统水下探索系统先估单目深度，再反投影并累积为二维占用图；水下散射和波长依赖衰减会破坏视觉线索，使深度估计不可靠。

Result: 在10个模拟珊瑚礁环境和统一协议评估的六种占用骨干上，AquaBEV-Nav实现37.48结构IoU、53.2目标IoU、88.95%闭环覆盖率且零碰撞。

Insight: AquaBEV把单帧RGB特征映射到学习式极坐标表示，沿距离方向因果推理后重建局部笛卡尔占用，无需显式深度中间量。占用图进入CORAL持久空间记忆，为VLM高层规划提供上下文，也约束动力学感知局部轨迹。

Abstract: Safe underwater exploration requires a robot to understand where surrounding structures are located and which regions are available for motion. Existing vision-based underwater exploration systems commonly obtain this information indirectly by estimating monocular depth, unprojecting the geometry into 3D space, and accumulating it into a 2D bird’s-eye-view occupancy map. This reliance on intermediate depth estimation is particularly problematic underwater, where scattering and wavelength-dependent attenuation degrade visual cues and limit the reliability of monocular depth estimates. We introduce AquaBEV-Nav, an underwater exploration framework that bypasses explicit monocular depth estimation through direct bird’s-eye-view occupancy prediction. Built upon the CORAL hierarchical exploration framework, AquaBEV-Nav replaces its depth-based perception front end with AquaBEV. Given a single RGB frame, AquaBEV maps visual features into a learned polar representation, performs causal reasoning along the range dimension, and reconstructs local Cartesian occupancy without relying on intermediate depth prediction. The resulting occupancy map is accumulated into CORAL’s persistent spatial memory, providing spatial context for VLM-based high-level planning and collision constraints for dynamics-aware local trajectory generation. Across ten simulated reef environments and six occupancy backbones evaluated under a single protocol, AquaBEV-Nav reaches 37.48 structure IoU and 53.2 target IoU, 88.95% closed-loop coverage with zero collisions.

[474] Federated Subspace Guided Vision-Language-Action Policy Distillation for Non-IID Multi-Robot Manipulation cs.RO | cs.CV | cs.DC | cs.LGPDF

Biprodip Pal, Kaushik Roy, Yanming Zhu, Brendan Tidd, Alan Wee-Chung Liew

TL;DR: FedDRMan在联邦机器人策略蒸馏中维护更新兼容的客户端簇，并用子空间与动作分布约束减少非IID聚合破坏。

Details

Motivation: 多机器人可在不集中收集演示的情况下协作学习，但任务和环境分布不同会造成表征漂移、策略更新互相冲突，朴素参数平均可能破坏有效能力。

Result: 在多种LIBERO非IID设置、异质程度和客户端参与变化下，FedDRMan最高平均成功率为80.7%，比最强联邦基线高11.6个百分点，并稳定改善知识迁移。

Insight: 每轮用服务器模型作冻结教师开展本地行为克隆，通过低秩多模态子空间和动作分布蒸馏保留共享表征与策略；再按更新兼容性分簇维护多个持久模型，并对簇内聚合做谱重平衡，防止较弱但有用的任务方向被压制。

Abstract: Federated learning offers a natural way for multiple robots to jointly improve manipulation policies without requiring centralized access to training demonstrations. However, non-IID task and environment distributions can induce representation drift and mutually incompatible robot-policy updates, making naive parameter aggregation destructive. We present FedDRMan, a federated subspace-guided distillation framework for heterogeneous robot manipulation. At each communication round, the server model provides a frozen teacher for local behavior cloning, while low-rank multimodal subspace and action-distribution distillation preserve globally useful representation geometry and policy behavior. To address heterogeneous aggregation, FedDRMan groups clients by update compatibility and maintains a persistent model for each cluster. The server then spectrally rebalances each compatible aggregate to mitigate attenuation of weaker task-relevant robot-policy update directions. Extensive experiments on LIBERO across diverse non-IID settings, heterogeneity levels, client participation variation, together with ablations and aggregation analyses, show that FedDRMan substantially improves knowledge transfer and consistently outperforms strong federated baselines achieving a peak mean success rate of 80.7%, 11.6 percentage points above the strongest evaluated federated baseline.

Khang H. Nguyen, Hoang Pham Quang Nguyen, Ha Phuong Nguyen, Khanh Dinh Binh, Xuan Ha Nguyen

TL;DR: FINE从现有导航演示的未来观察中提取地标监督，提升视觉语言导航的数据效率和未见环境成功率。

Details

Motivation: 将VLN策略适配到新环境成本高，每条路线都需具身演示；标准观察到动作训练没有充分利用轨迹中的未来观察，而这些观察暴露了指令相关地标及其外观和三维排列。

Result: 在R2R-CE和RxR-CE未见验证集上，FINE使InternVLA-N1成功率分别提高2.6和4.5个百分点。演示预算仅70%时仍提高6.8分，弥补约三分之一因减少演示造成的性能损失。

Insight: 显式有序地标token预测未来地标的语义二维patch和视角相关三维几何特征；隐式未来token则区分实际到达地标状态与视频世界模型生成的同场景反事实未来，从现有轨迹提取额外监督。

Abstract: Adapting vision-language navigation (VLN) policies to new environments is expensive because every additional route and instruction requires an embodied demonstration. Yet standard observation-to-action training uses only a small fraction of the information already contained in each trajectory. In particular, future observations reveal the instruction-relevant landmarks that the agent will encounter, including what they look like and how they are arranged in 3D. We introduce FINE, a Future-Informed Navigation Encoding framework that extracts this latent supervision from existing demonstrations. FINE equips a VLN backbone with two complementary auxiliary representations. First, explicit landmark tokens follow the ordered landmarks specified by the instruction and are trained to predict future landmark regions in both semantic 2D patch-feature space and viewpoint-dependent 3D geometric feature space. Second, an implicit future token learns to distinguish the landmark state that is actually reached from plausible same-scene counterfactual futures generated by a video world model. On R2R-CE and RxR-CE val-unseen, FINE improves InternVLA-N1 by 2.6 and 4.5 success-rate points, respectively, at full training data. More importantly, as demonstrations become limited, the benefit grows: at a 70% demonstration budget, FINE improves success rate by 6.8 points, recovering roughly one-third of the performance lost by reducing the training demonstrations. Project page is available at https://finevln.github.io/.

[476] An Empirical Study on What Matters for Viewpoint-Generalizable Policies in Visual Imitation Learning cs.RO | cs.CV | cs.LGPDF

Mino Nakura, Sriram Krishna, Yufei Wang, Shubham Tulsiani, Zackory Erickson

TL;DR: 受控模仿学习实验表明，保留稠密视觉token并让动作头参与几何推理，有助于操控策略跨摄像机视角泛化。

Details

Motivation: 视觉模仿学习可训练多任务操作策略，但当前策略对摄像机视角变化仍脆弱，限制其在多样环境部署。

Result: 跨多种模拟摄像机位姿任务，所研究设计使策略在不同视角下保持较好表现；相同设计还支持从模拟到随机相机配置真实环境的零样本迁移。

Insight: 系统控制策略架构和训练因素后发现，保留稠密视觉token、并使动作头而非只有视觉骨干参与几何推理，是跨视角稳健性的关键设计选择。摘要未给具体成功率。

Abstract: Visual imitation learning is a promising approach to training robot manipulation policies capable of completing a wide variety of tasks. However, policies today remain brittle to viewpoint perturbations, making deployment in diverse environments a challenge. We present a controlled empirical study of which design choices allow visuomotor policies to generalize across viewpoints. We find that viewpoint generalization improves when dense visual tokens are retained and the action head participates in geometric reasoning. On a suite of simulated tasks that span a wide range of camera poses, we show that these design choices yield a policy that remains performant across viewpoints. As a practical consequence, a policy trained with these design choices also transfers zero-shot from simulation to the real world under random camera configurations.

[477] DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model cs.RO | cs.CVPDF

Tianyun Jiang, Wenrui Bao, Bingxin Xu, Yu Tian, Yuzhang Shang

TL;DR: DeltaWAM以每帧一个紧凑变化token预测相邻时刻的视觉特征差异，再结合当前空间锚点生成机器人动作。

Details

Motivation: 世界动作模型反复重建完整未来场景，计算昂贵且时空冗余；物理操作中相邻帧大多相同，动作策略更关心变化部分。

Result: DeltaWAM含0.725B参数，在两张H100上训练256 GPU小时；LIBERO平均成功率92.8%，在LIBERO-Pro程序扰动下有稳健泛化。每动作块推理142.1毫秒、峰值显存3.86GB。

Insight: 单个delta token编码相邻稠密DINO特征图的变化，基于DeltaWorld自回归预测每个未来帧的变化；流匹配动作专家根据预测转移及当前DINO空间锚点生成动作块。

Abstract: World-Action Models (WAMs) offer visual foresight for robotic manipulation, but pixel-space models repeatedly reconstruct entire future scenes, incurring high computational cost and spatio-temporal redundancy. In physical manipulation, consecutive frames often share most of their visual context; the changes between them are what an action policy needs to anticipate. We introduce DeltaWAM, a change-centric WAM that makes a compact delta token the unit of future prediction. Each token is a single vector encoding changes between consecutive dense DINO feature maps. DeltaWAM builds on DeltaWorld, a latent world model pretrained on large-scale videos, to autoregressively predict one delta token per future frame. A flow-matching action expert then conditions on the predicted transitions and current DINO features, which serve as spatial anchors, to generate action chunks. Trained for 256 GPU hours on two H100 GPUs, DeltaWAM has 0.725B parameters and achieves 92.8% average success on LIBERO. It also shows robust generalization under procedural perturbations on LIBERO-Pro. Inference takes 142.1 ms per action chunk with 3.86 GB peak memory.

[478] Q-WAM: 4-Bit Quantization of World Action Models with Action-Subspace Protection cs.RO | cs.CVPDF

Arash Akbari, Arman Akbari, Jingwu Luo, Yuhao Lei, Yi Gao

TL;DR: Q-WAM以动作可观测性Gramian衡量量化误差对扩散动作的影响，只把最敏感通道组合留在小型16位支路，其余做4位量化。

Details

Motivation: WAM联合扩散生成视频和机器人动作，推理计算与显存成本高；现有平滑或旋转量化难以保持动作生成精度。

Result: RoboTwin 2.0上三种WAM平均成功率89.6%至93.0%，距16位模型不超过1.1个百分点，量化模块显存降低3.1至3.4倍，并比最强基线SVDQuant高2.5至8.7个百分点。Unitree G1和双臂UR3实机成功率高12.8至17.6个百分点。

Insight: AOG追踪各层输入通道加权舍入误差经全部去噪步骤对最终动作的影响。动作子空间保护把最敏感的少量方向放入低秩16位支路，其余保持高效稠密4位矩阵乘；再只对动作贡献最高的专家应用保护。

Abstract: World Action Models (WAMs) jointly generate video and robot actions through iterative diffusion and perform strongly in robotic manipulation. However, their prohibitive compute and memory costs pose substantial deployment challenges. Post-training quantization (PTQ) can reduce these costs, but existing PTQ methods such as smoothing and rotation are insufficient to maintain the precision of action generation. To overcome this limitation, we propose Q-WAM, a new 4-bit weight-activation quantization for WAMs that preserves the actions the model generates. Specifically, we introduce the \textit{Action Observability Gramian (AOG)}, which measures how much rounding errors in each weighted combination of a layer’s input channels change the final action through all denoising steps. We also develop Action-Subspace Protection (ASP), which keeps the few most action-sensitive channel combinations in a tiny 16-bit low-rank branch and quantizes the complementary weights and activations to 4 bits, both as dense matrix multiplications that run efficiently on GPUs. Finally, to preserve action quality with minimal overhead, we identify the experts that matter most for the generated action by aggregating the AOG-derived action mass across the layers of each expert and apply ASP only to those experts. We evaluate Q-WAM on three WAMs, both in simulation and in real-world deployment. On the RoboTwin 2.0 benchmark, it reaches 89.6–93.0% average success rate, within 1.1 percentage points of the 16-bit models, while reducing the memory of the quantized blocks by 3.1–3.4$\times$. Our method outperforms the strongest baseline, SVDQuant, by 2.5–8.7 percentage points. On a Unitree G1 humanoid and a bimanual UR3 robot, it improves success over SVDQuant by 12.8-17.6 percentage points.

[479] Recursive Harness Distillation across Agents for Robot Manipulation cs.RO | cs.AI | cs.CV | cs.LGPDF

Seungyeon Kim, Junhoo Lee, Minkyu Kim, Baekseung Kim, Nojun Kwak

TL;DR: Recursive Harness Distillation把强机器人代理从交互中发现的干预经验写成轻量代理可复用的操作手册，并依据轻量代理反馈递归修订。

Details

Motivation: VLA具备广泛操作能力，但遇到执行失败时不一定能诊断并调整；强代理可以通过交互找到有效干预，若无法沉淀则每个任务都要重新摸索。

Result: 真实操作成功率从37.3%升到64.0%；SimplerEnv Bridge上轻量代理使用手册成功率66.7%，高于仅用GR00T的41.7%及无手册的强代理；同一手册也使强代理达到79.2%。

Insight: 无需更新模型参数，强代理先把经验蒸馏成手册，轻量代理执行后再提供反馈以递归完善。这样把跨任务的干预经验作为可迁移流程知识累积。

Abstract: A central goal in robotics is to enable manipulation across changing tasks and environments. Vision-language-action (VLA) models provide broad manipulation capabilities but can struggle when execution requires diagnosing failures and adapting behavior. Strong agents can discover effective interventions through interaction with these policies. We propose Recursive Harness Distillation to accumulate this experience as reusable guidance across agents. A strong agent distills its experience into a playbook for a light agent, then recursively refines the playbook using the light agent’s execution feedback. The resulting playbook enables agents to reuse accumulated intervention knowledge in new task instances without updating model parameters. In real-world manipulation, the harness improves success from 37.3% to 64.0%. On SimplerEnv Bridge, the light agent with the playbook achieves 66.7% success, compared with 41.7% for the GR00T-only baseline, and outperforms the strong agent without a playbook. The same playbook also benefits the strong agent, which reaches 79.2% success. These results demonstrate the feasibility of harness distillation for robotics: intervention experience can be accumulated, refined through execution, and reused across agents to improve manipulation.

[480] SocialHumanoid: Towards Expressive Humanoid Behavior via One-Step Co-Speech Motion Generation cs.RO | cs.CVPDF

Chengqun Yang, Tengjie Zhu, Liang Xu, Fulong Liu, Guanzhu Ren

TL;DR: SocialHumanoid单次前向生成带情绪条件的全身协同语音动作窗口，并在线映射到机器人骨架以持续执行。

Details

Motivation: 面对面社交机器人需要动作与语音同步、情感表达丰富且实时，但既有协同语音动作方法多针对数字人，缺少实体机器人所需的情感控制与低延迟连续生成。

Result: 在BEAT2上，SocialHumanoid取得对比方法最佳FGD、竞争力的语音—动作同步，并在相同协议下比GestureLSM快约6倍。AffectMoCap训练提升动作情绪识别；实机演示显示长程连续执行稳定。

Insight: 每个全身动作窗口仅需一次前向，连续窗口通过动作历史条件连接，再在线转换为机器人兼容参考并由全身控制器跟踪。四小时AffectMoCap提供语音、身体和手部动作及细粒度情绪标注，支持显式情感监督。

Abstract: Humanoid robots are increasingly expected to serve as embodied social agents that communicate naturally with humans through face-to-face interaction. During such communication, humanoid robots require body behaviors that are synchronized with speech, affectively expressive, and suitable for real-time execution. However, existing co-speech methods are primarily developed for digital humans and lack joint support for affective control and low-latency continuous generation on physical embodiments. To bridge this gap, we present SocialHumanoid, a system for expressive humanoid behavior via one-step co-speech motion generation. Given response speech and a specified affective condition, SocialHumanoid generates each full-body motion window in a single forward pass and connects successive windows through motion-history conditioning. The generated human motion is further converted online into embodiment-compatible robot references and tracked by a whole-body controller for physical execution. To provide explicit supervision for affective body expression, we further introduce AffectMoCap, a 4-hour dataset captured from two professional actors, containing synchronized speech, body motion, fine-grained hand motion, and emotion annotations. On BEAT2, SocialHumanoid achieves the best FGD among the compared generation methods, competitive speech-motion synchrony, and approximately $6\times$ faster inference than GestureLSM under the same protocol. Perceptual evaluations further show that training with AffectMoCap improves affect recognition from generated body motion, while real-robot experiments demonstrate continuous affect-conditioned behavior and stable long-horizon execution. Our project page is https://rex0191.github.io/SocialHumanoid/.

[481] AI-Driven Collaborative Assembly Line Inspection: System Integration and Deployment Challenges cs.RO | cs.CV | cs.HCPDF

Asya Ünal, Amr Okasha, Ege Çırakman, Perin Ünal

TL;DR: 本文部署一套由协作机器人、视觉缺陷检测和多模态测量组成的装配线检查单元，并总结现场集成挑战及人机协作效益。

Details

Motivation: 装配线人工视觉检查长期重复且容易疲劳，可能降低缺陷发现率；要在工厂部署AI还需应对近距离安全、反光鲁棒性、多机器人软件配置和依赖管理等问题。

Result: 每件质检用时由82秒降至61秒，约缩短25%；最终控制资源效率从0.75提高到0.88，操作员目视检查时间减少82%，NASA-TLX心理负担显著下降（p=0.005）。

Insight: 系统让UR10e搭载机器视觉缺陷检测、Racer-5执行功能测试，并通过ROS 2协调；相机图像、麦克风声学和电气安全数据本地记录并可视化。论文以四层人机交互分析组织实际部署经验。

Abstract: Manual visual inspection on assembly lines is a persistent manufacturing bottleneck: operator fatigue over extended shifts lowers defect-detection rates. This paper presents the design, integration, and field deployment of an AI-assisted collaborative inspection cell at the Silverline kitchen-appliance factory, developed within the AI-PRISM project. The cell couples a Universal Robots UR 10e cobot carrying a machine-vision defect-detection pipeline with a Comau Racer-5 cobot for functional tests, coordinated through ROS 2 Humble on an Ubuntu 22.04 LTS server. Multi-modal data (Basler camera imagery, TIA microphone acoustics, and SPS electrical-safety measurements) are logged locally and visualised in real time with Grafana. We report the practical deployment challenges (close-proximity safety, AI robustness under glare and reflections, ROS 2 namespace collisions across two cobots, and operating-system and dependency issues) together with the engineering solutions adopted, and structure the integration through a four-level Human-Robot Interaction analysis. The deployed cell cuts per-unit quality-check time from 82 s to 61 s (about 25%), raises final-control resource efficiency from 0.75 to 0.88, reduces operator visual-inspection viewing time by 82%, and significantly lowers operator mental demand (p = 0.005, NASA-TLX).

[482] Test-Time Spatial Reasoning for Robot Manipulation Using Generative Real-to-Sim cs.RO | cs.CVPDF

Ivan Kapelyukh, Yafei Hu, Ran Gong, Brandon May, Tushar Kusnur

TL;DR: Simify从单幅RGB-D场景图像构造可仿真的物体与环境，再通过大规模并行物理模拟和进化搜索，在推理时显式规划空间布局。

Details

Motivation: 长程机器人任务需要理解多物体相互作用下的空间关系，单靠视觉语言模型难以可靠规划复杂重排操作。

Result: 真实机器人实验显示Simify可端到端完成涉及未见物体的复杂重排，并优于既有基础模型空间推理方法；结果同时表明完整准确的几何信息对虚实迁移至关重要。

Insight: 利用3D生成模型和VLM把单帧场景还原为仿真资产，针对奖励函数并行运行数千次物理rollout，再用进化搜索优化布局，通常数秒内收敛；训练免、测试时执行。

Abstract: Spatial reasoning is fundamental to general robot intelligence, as it enables robots to complete long-horizon tasks involving multi-object interaction. We introduce Simify, a training-free, test-time framework that performs explicit spatial reasoning via massively parallel physics simulation. From a single RGB-D image of a scene, Simify reconstructs simulation-ready assets leveraging 3D generative models and vision-language models. Then given a task specified by a reward function (e.g., build the tallest tower), Simify launches thousands of parallel rollouts in simulation and performs an evolutionary search to optimize object arrangements, typically converging within seconds. We conduct quantitative experiments on real-robot hardware to demonstrate the ability of our framework to execute complex object rearrangement tasks end-to-end with previously unseen objects. Results show that our framework outperforms prior work on foundation models for spatial reasoning by effectively exploiting large-scale parallel simulation during inference, and also highlight the importance of complete and accurate geometry for successful sim-to-real transfer.

[483] ZeroBot: Learning from Scratch in Minutes with Generative Real2Sim cs.RO | cs.CVPDF

Ivan Kapelyukh, Xiaohan Zhang, Stephen James, Laura Herlant, Edward Johns

TL;DR: ZeroBot仅凭单张物体图像和目标位姿生成完整网格，在仿真中并行强化学习，再将策略迁移到实物操作。

Details

Motivation: 新机器人任务通常缺少人工示范、预训练策略和已知物体模型，传统学习流程因此难以快速启动。

Result: 在抓取、推动、可动结构交互和多阶段操作等真实任务中，ZeroBot成功率87%，平均训练时间119秒。

Insight: 图像到3D生成模型先为未知物体构建网格以供仿真；训练动作空间利用生成几何和学习到的价值函数，优先采样机器人与物体接触状态，加速大规模并行强化学习。

Abstract: We present ZeroBot, a real2sim framework for learning a robot manipulation task from scratch in minutes under challenging conditions: zero human demonstrations, zero policy pre-training, and zero known object models. Given only a single view of an object and a goal pose for that object, ZeroBot uses image-to-3D generative models to obtain a complete object mesh, which is used in simulation for large-scale parallel reinforcement learning. To accelerate training, we introduce an action space which leverages the generated geometry and learned value function to sample states involving robot-object contact. When evaluated on real-world tasks including grasping, pushing, articulated object interaction, and multi-stage manipulation, ZeroBot achieves an 87% success rate with an average training time of 119 seconds. These results show the value of using image-to-3D models in a real2sim framework for rapid, autonomous robot learning.

[484] Quantile Head for Vision-Language-Action Models cs.RO | cs.CVPDF

Xuan Wang, Yinan Wu, Haoran Duan, Jungong Han

TL;DR: Quantile Head一次前向预测动作分布的中位数和有序边际分位数，让VLA可无需重训地支持多种动作采样策略。

Details

Motivation: VLA的点回归头只能给动作分布的点估计，标准流匹配动作头则需昂贵的迭代采样。

Result: 联合监督的中位数策略在LIBERO、LIBERO-Plus、LIBERO-Pro和两项真实机器人任务上平均成功率最高；在匹配的LIBERO基线中平均episode时间最短。

Insight: 统一回归和流匹配目标后推导分位数目标，预测中位数及正间隔形成有序边际分位数。局部分析显示，当邻近分位数校准、间隔固定且修正速度匹配时，联合监督中位数更新的方差低于只监督中位数。

Abstract: Vision-Language-Action (VLA) models integrate pretrained Vision-Language Models (VLMs) with action heads for robot control. Common action heads have distinct limitations: point regression provides only a point estimate of the action distribution, while standard flow-matching samplers require costly iterative sampling. To address these limitations, we unify regression and flow matching under a shared objective and extend it to derive a quantile objective. This quantile objective guides the design of our Quantile Head, which predicts a median and positive gaps to form ordered marginal action quantiles in one forward pass. These quantiles support multiple sampling strategies without retraining and are jointly supervised to train the default median policy. Our local analysis of this joint supervision shows that, with calibrated nearby quantiles, fixed gaps, and matched correction speed, direct median updates have lower variance than under median-only supervision. Experiments show that this jointly supervised median policy achieves the highest average success rates among the compared methods on LIBERO, LIBERO-Plus, LIBERO-Pro, and two real-robot tasks, together with the shortest mean episode time among matched LIBERO baselines; code is available at https://github.com/xwangrs/Quantile-Head-for-VLA.

[485] mmHRI: Towards Privacy-Preserving Human-Robot Interaction with Millimeter-Wave Radar cs.RO | cs.CVPDF

Junqiao Fan, Yuxuan Hu, Bofan Lyu, Yanshuo Lu, Pengfei Liu

TL;DR: mmHRI用毫米波雷达估计人的动作和姿态，将其转为机器人指令，支持有视觉遮挡且不采集可识别图像的交互操作。

Details

Motivation: 辅助机器人常用RGB摄像头持续观察手势，但病房、餐厅等场所可能限制直接拍摄；毫米波雷达可穿过隐私屏障感知人体运动。

Result: 隐私幕帘设置下动作识别准确率85.09%，优于既有雷达方法；在遮挡条件下实现递送和取回，且对未见受试者、杂乱布局和环境保持稳定。

Insight: 双流架构同时利用未经滤波的雷达张量和点云预测动作及3D姿态，记忆状态空间模型保留历史特征以减轻时序突变。再将估计状态转成结构化文字指令，控制VLA闭环完成操作和人机反应。

Abstract: Assistive robots increasingly operate in many human-centered environments and perform various human-robot interaction (HRI) tasks, such as object delivery. However, most existing HRI systems rely on RGB cameras that continuously observe humans to respond to non-verbal commands, such as hand gestures. This raises privacy concerns in privacy- critical environments, such as hospital wards or restaurants, where direct camera observation of humans is restricted. To develop privacy-preserving HRI, we leverage millimeter-wave (mmWave) radar, which can sense human motion through privacy barriers without identifiable imagery. We propose mmHRI, the first multi-modal robot manipulation framework that achieves mmWave radar-guided privacy-preserving HRI. mmHRI introduces two key designs to mitigate the sparsity and temporal inconsistency of radar data in cluttered robot manipulation environments. First, we propose a dual-stream architecture that jointly learns from unfiltered raw radar tensors and radar point clouds to estimate both human actions and 3D poses. To mitigate signal inconsistency, mmHRI further incorporates a memory-based state-space model (MSSM) that retains historical radar features to reduce abrupt changes in pose/action. These estimated human states are then converted into structured textual robot instructions, which control a vision-language-action (VLA) policy for closed-loop robot manipulation and human-aware reactions. Our evaluation covers human action recognition and closed-loop delivery and retrieval. In the privacy-preserving curtain setting, mmHRI achieves 85.09% action-recognition accuracy, outperforming existing radar-based alternatives. Robot trials further demonstrate successful delivery and retrieval under visual occlusion, with stable task performance across unseen subjects, clutter configurations, and environments.

[486] RoboIRGBench: Benchmarking Implicit Referential Grounding in Vision-Language-Action Models cs.RO | cs.CVPDF

Aernaer Akelijiang, Jiannan Li, Zhineng Chen, Jingjing Chen, Bin Zhu

TL;DR: RoboIRG-Bench评估VLA能否从语言与视觉上下文恢复隐含指代对象，并在真实Franka机械臂上验证这一能力缺口。

Details

Motivation: 现有操作基准通常把目标对象、数量和关系明确写在指令中；实际交流中人类常以隐含指代表达，机器人需保留并检索先前上下文。

Result: 基于11项任务构造40个变体，覆盖直接、推理中介、空间和上下文指代。模型从显式指令转为上下文恢复时性能明显下降，空间和推理型指代尤难；真实机械臂仍出现错误指代和后续执行失败。

Insight: 外接VLM的模型相对更稳健，但仍有明显失败；仅更换更强VLM也不能消除缺口。这说明隐含指代落地是语言、感知、推理和动作整合中的独立能力，不能由显式指令成绩代替。

Abstract: Vision-Language-Action (VLA) models have shown strong capabilities in robotic manipulation, yet existing benchmarks typically assume that task-relevant information is explicitly specified in the instruction. In practice, however, humans frequently refer to objects, quantities, and relations implicitly, requiring robots to recover the intended target from linguistic and perceptual context. We study this capability as Implicit Referential Grounding (IRG) and introduce RoboIRG-Bench, a manipulation benchmark designed to systematically evaluate it. Built upon RoboMME, RoboIRG-Bench contains 40 variants derived from 11 tasks and covers four challenges, including direct, reasoning-mediated, spatial, and contextual referential grounding. As IRG often requires retaining and retrieving previously established context, we evaluate representative VLAs spanning different memory mechanisms. Our evaluation reveals a noticeable referential robustness gap. Models that perform well under explicit instructions can degrade sharply when the same task-relevant information must be recovered from context. Reasoning-mediated and spatial references are particularly challenging, while models using external VLMs show greater robustness but still exhibit significant failures. Moreover, replacing the external VLM with a stronger model does not eliminate these gaps. We further validate these findings on a Franka Research 3 robot arm, where the gap persists under real-world manipulation and manifests as both incorrect referent grounding and downstream execution failures. These results establish IRG as a distinct and underexplored capability for reliable robotic instruction following and highlight the need for VLAs that can robustly integrate language, perception, reasoning, and action.

[487] Natural State-Prediction Accuracy can Hide Weak Controlled Responsiveness in VLA Readouts cs.RO | cs.CV | cs.LGPDF

Hyungjoon Kim, Wonbin Son, Mi Young Lee, Jun Young Lee, Seungmin Rho

TL;DR: 本文将VLA内部状态读出的表现拆成自然观测预测准确性、对目标物理状态的受控响应性和对上下文变化的稳定性。

Details

Motivation: 自然轨迹中物体状态、机器人姿态、遮挡和任务进度同时变化，所以读出模型即使预测准确，也可能只是利用上下文线索而没有忠实追踪目标状态。

Result: 跨表示、读出和训练数据的对照与干预表明这三项性质提供不同诊断信息；把响应性和上下文敏感性加入失败预测器后，对新初始化的策略失败预测误差低于指定基线。

Insight: 通过物理验证、交叉组合目标坐标与机器人上下文的观察，单独测量模型随目标状态变化的反应和对上下文扰动的稳定性；应把这些测试与自然轨迹准确率一并报告，并连接到实际策略结果。

Abstract: Accurately decoding object states from the internal representations of vision-language-action (VLA) models does not establish that the predictions respond faithfully to changes in the target physical state. In natural observations, object state, robot configuration, occlusion, and task progress vary together, allowing contextual cues to contribute to prediction. In this paper, we introduce an evaluation framework that separates prediction accuracy, target-state responsiveness, and context stability using physically validated observations that cross target coordinates with robot contexts. We demonstrate that high natural-trajectory accuracy can coexist with weak controlled target-state responsiveness in fixed representation-readout pairs. Comparisons and interventions involving representations, readouts, and training data show that the three properties provide distinct diagnostic information. Furthermore, adding responsiveness and context sensitivity to a failure predictor based on initial state error and physical variables reduces policy-failure prediction error on new initializations relative to the specified baseline while same-observation controlled MAE is also informative. These findings motivate evaluating target-state responsiveness and context stability alongside natural prediction accuracy, and examining their relationship to actual policy behavior and task outcomes.

[488] Don’t Throw Away the Tail: Action Upcycling for Policy Acceleration cs.RO | cs.AI | cs.CV | cs.LGPDF

Taesung Kwon, Jangho Park, Sunwoo Park, Youngmin Kim, Seonghyun Jin

TL;DR: Action Upcycling在不增加采样或访问模型内部状态的前提下，复用原本将被丢弃的动作块尾部，以自适应延长执行时域。

Details

Motivation: 策略一次预测未来一段动作但常只执行前缀，执行时域短更灵敏却需频繁调用策略；既有动态选择器依赖架构专属内部信号或额外采样，都会增加成本。

Result: 在多种VLA、WAM及模拟和真实操作任务中，策略调用减少1.2至1.7倍，同时成功率不下降。

Insight: 只要动作速度平滑，被丢弃动作通常接近重新规划后的动作。因此保留并执行动作尾部，直到速度开始波动再重规划；无需额外模型访问，且可与少步采样、流式动作解码等加速方法叠加。

Abstract: Modern robot policies predict a chunk of future actions from a single observation, execute only a prefix, and discard the rest before replanning. Choosing the length of this prefix, the execution horizon, poses a trade-off between reactivity and efficiency. A short horizon keeps the policy reactive to the environment, but requires frequent policy calls. Recent test-time methods adaptively select the horizon for each chunk, but they either read model internals, where the signal must be chosen for each architecture, or draw extra samples, which adds cost. We propose Action Upcycling, a training-free algorithm that reuses actions the policy would otherwise discard, without accessing model internals or drawing extra samples. We find that discarded actions stay close to their replanned versions as long as the action velocity remains smooth. Action Upcycling therefore extends the execution horizon up to the point where the velocity begins to fluctuate. Extensive experiments on simulated and real-world manipulation tasks show that Action Upcycling reduces policy calls by 1.2–1.7$\times$ with no loss in success rate, across multiple Vision-Language-Action Models (VLAs) and even a World Action Model (WAM). It applies to any chunked policy at negligible cost and is orthogonal to other policy acceleration methods such as few-step sampling and streaming action decoding, opening a new axis for policy acceleration.

[489] Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies cs.RO | cs.AI | cs.CVPDF

Dingsheng Liu, Yangzheng Wu, Mahboubeh Asadi, Zhiyuan Li, Jinbang Huang

TL;DR: Spatial Grafting把冻结重建模型的3D局部特征转成机器人相对度量几何token，注入预训练流匹配动作专家以增强操作策略。

Details

Motivation: 现有VLA和WAM把交互相关公制几何隐含在表征中；3D重建能可靠提供几何，但局部形状特征未说明相对机器人的位置，如何整合到预训练策略仍未解决。

Result: 同一模块无需按主机重设计，可用于两种VLA、两种WAM、四个模拟基准及三类真实机器人平台。在RoboTwin 2.0上，π0.5干净/随机场景成功率达94.0%/92.4%，高于最强已发表3D条件策略；BEHAVIOR-1K六项中五项超过2025挑战赛获胜者。

Insight: 构造与机器人相对坐标绑定的空间token，通过交叉注意力提供给动作专家，不改动主机视觉感知路径，保留其预训练能力；长时域操作任务上的优势进一步扩大。

Abstract: Pretrained robot manipulation policies such as vision-language-action models (VLAs) or world-action models (WAMs) leave interaction-relevant metric geometry implicit. Recent breakthroughs in spatial reconstruction can supply the necessary geometry reliably, but their features describe local shape without stating where it lies with respect to the robot. How best to deliver these features to a pretrained policy remains unresolved. We propose Spatial Grafting, a versatile, lightweight spatial module that binds frozen reconstruction features to metric, robot-relative geometry. Spatial Grafting constructs metric-grounded spatial tokens and injects them into the flow-matching action expert through cross-attention, without modifying the host’s perceptual pathway, so the host retains the full benefit of its pretraining. We evaluate it more broadly than any geometry-aware policy we compare against: one graft architecture, with no per-host redesign, on two VLAs and two WAMs, across four simulation benchmarks that span short-horizon manipulation, visual robustness, clutter and long-horizon mobile manipulation, and on three real-robot platforms with single- and dual-arm configurations. On RoboTwin 2.0, a dual-arm manipulation benchmark, the graft improves every host across VLAs and WAMs. Grafted $π_{0.5}$ gains 11.3% and 15.6% on clean and randomized scenes, reaching 94.0% and 92.4%, above the strongest published 3D-conditioned policy, WAM4D (93.8% and 89.9%). The margin widens as the horizon lengthens: on tasks from BEHAVIOR-1K, a dual-arm mobile manipulation challenge scored by average task progress, it surpasses the 2025 challenge winner on five of six tasks,by up to 0.47 Q-score, and exceeds a map-conditioned spatial policy on average across the three tasks both report.

[490] Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Models cs.RO | cs.CVPDF

Pengyiang Liu, Junbo Niu, Wenhao Zheng, Xinchen Chen, Canyu Li

TL;DR: RTP让世界动作模型保留视觉未来计划作为持续动作条件，并根据执行反馈续写修订、保留原计划或从头重规划。

Details

Motivation: WAM用预测视觉未来指导动作，但实际执行反馈可能推翻部分预测而保留其余任务结构，完全重启会丢掉仍有用的规划信息。

Result: RTP在RoboMME和RMBench任务平均成功率分别为48.6%和84.8%。匹配比较支持学习式续写的价值；检查点来源和动作前缀效应方向为正，但估计精度较低。

Insight: 学习式修订桥从视觉生成保存的中间状态继续，并按当前观察调整后续预测；时间感知历史提供证据，自适应策略选择保留、桥接修订或以新噪声重新规划，再生成下一动作。

Abstract: World-action models use predicted visual futures to condition robot actions, yet execution feedback can invalidate parts of a prediction while leaving its task structure useful. We propose Revisable Temporal Planning (RTP), which maintains the visual future as a persistent action condition and revises it after feedback. Its central mechanism is a learned revision bridge: it resumes an intermediate state saved during visual generation and adapts its continuation to current observations. Visual and action supervision connect this revision to subsequent control. Time-aware history supplies observed evidence, and an adaptive policy selects retention, bridge revision, or fresh replanning from new noise before decoding the next action. On RoboMME and RMBench, RTP achieves task-averaged success rates of 48.6% and 84.8%, respectively. Matched comparisons support learned continuation; estimated checkpoint-source and action-prefix effects are positive but less precisely resolved. These results connect feedback-driven visual-plan revision to closed-loop task performance. Project Page: https://PLACEHOLDER.github.io/RTP/

Rithvik Jonna, Man Namgung, Aakash Gurram, Tinoosh Mohsenin

TL;DR: EdgeVLN将量化StreamVLN、复用隐藏状态的停止判定头和端侧记忆裁剪整合为适配Jetson Orin NX的导航部署系统。

Details

Motivation: VLN模型通常瞄准算力充足平台；压缩本身不能证明模型能否同时满足边缘设备内存、延迟、能耗约束并保留导航能力。

Result: 在1,839个R2R VLN-CE未见验证episode上，4位部署模型加LATTE成功率58.02%，比BF16基线高，且每导航步仅增加0.013秒。IQ4 NL通过指定驱动运行占用11.35GB内存，比BF16存储流式方案快20.8倍、能耗低13.3倍；不同执行路径能耗可差36.8倍，INT2性能崩溃。

Insight: LATTE从骨干隐藏状态复用信息预测停止验证排序，不需第二视觉编码器或额外骨干前向；llama.cpp驱动在设备端重建流式上下文并裁剪记忆token。运行时选择、量化和记忆压缩共同决定部署可行性。

Abstract: Vision-language navigation (VLN) models perform well but target compute-rich platforms, limiting deployment on memory- and power-constrained robotic edge devices. Compression alone does not establish whether a VLN model fits the memory, latency, and energy budgets of an edge platform while preserving navigation behavior. We introduce EdgeVLN, a runtime-aware, deployment-ready quantized VLN model that closes this gap. EdgeVLN combines a quantized StreamVLN model with Latent Trajectory Termination Extractor (LATTE), a lightweight causal transformer that improves real-time stopping by predicting a Stop Action verifier rank. Both execute through our llama.cpp VLN driver, which reconstructs streaming context and prunes memory tokens on-board. We characterize a pretrained StreamVLN backbone across weight quantization from 8 to 2 bits and multiple inference runtimes to identify a feasible operating point. LATTE reuses backbone hidden states within the budget freed by quantization, requiring neither a second vision encoder nor an additional backbone forward pass. We evaluate six backbone precisions and seven candidate stop heads on BF16 and IQ4 NL across all 1,839 R2R VLN-CE val-unseen episodes. We measure success rate (SR) in simulation and latency, energy, and resident memory on an NVIDIA Jetson Orin NX 16 GB. LATTE achieves our highest SR, 58.02 percent on the deployed 4-bit model, exceeding the BF16 baseline with only 0.013 s additional latency per navigation step. Four-bit formats achieve nearly identical SR, but step energy varies 36.8 times by execution path. Only IQ4 NL under our VLN driver fits the board, using 11.35 GB resident memory while running 20.8 times faster and using 13.3 times less energy than storage-streamed BF16. INT2 collapses. Runtime selection, memory-token pruning, and quantization are essential for efficient edge deployment.

cs.SD [Back]

[492] DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation cs.SD | cs.CL | eess.ASPDF

Yayue Deng, Dingdong Wang, Yuxuan Hu, Jinyu Li, Yanqing Liu

TL;DR: DuraS2ST让语音翻译模型先规划目标措辞和音素时长，再生成语音，并通过时长边际奖励和模态感知归因兼顾翻译质量与音画时长对齐。

Details

Motivation: 视频配音等时效场景不仅要求语义忠实和说话人保持，还要求译文语音时长匹配原始时间窗口。现有语音到语音翻译通常没有显式的时间规划，容易产生音画错位。

Result: 作者构建44万条高质量时长对齐推理语料，并在CVSS-T上评测；DuraS2ST在翻译质量和时长一致性之间取得良好平衡，超过有竞争力的开源和商业基线，但摘要未给具体分数。

Insight: 在合成语音前显式生成目标表达及其音素长度计划，有助于把时长约束纳入翻译决策。多维强化学习再通过时长边际奖励权衡内容质量和长度，并将奖励分配给对应模态的token片段。

Abstract: Speech-to-speech translation (S2ST) in time-sensitive applications such as video dubbing requires not only semantic fidelity and speaker preservation, but also strict duration consistency to avoid audio-visual misalignment. However, existing S2ST systems largely generate target speech without explicit temporal planning, making duration control an unresolved challenge. We introduce DuraS2ST, a duration-aligned reasoning framework that enables a single speech language model to first generate an explicit chain-of-thought (CoT) for planning target wording and phonetic length, and then synthesize the corresponding speech tokens. To support this paradigm, we construct DuraSet-440K, a high-quality duration-aligned CoT corpus for supervised initialization. We further optimize the model with multi-modal multi-dimensional reinforcement learning, using a Duration Margin Reward to balance translation quality and duration consistency, and Modality-Aware Reward Attribution to assign rewards to appropriate token spans. Experiments on CVSS-T show that DuraS2ST achieves a strong balance between translation quality and duration consistency, outperforming competitive open-source and commercial baselines. Project page: https://github.com/Mia11939/DuraS2ST.

[493] Video-to-Music Generation for Gameplay Videos cs.SD | cs.AI | cs.CV | cs.MMPDF

Felipe Marra, Lucas N. Ferreira

TL;DR: 本文构建SNES游戏视频—配乐数据集，并比较文本、独立帧和时空视频编码器将游戏画面条件化输入MusicGen生成音乐的效果。

Details

Motivation: 视频到音乐生成已用于电影和音乐视频，但游戏画面是渲染图像、配乐多为合成音频，且音乐常跨整个关卡循环，不会逐一跟随画面事件，带来不同挑战。

Result: 数据包含217.6小时SNES游戏视频和485小时去除音效、旁白的清洁配乐，经音频指纹匹配。冻结编码器在所有指标上达到或超过微调版，冻结ViViT整体最佳。模型参数最多少18%，客观指标超过基线，听测优于GVMGen且与OSSL相当。

Insight: 把视频特征直接送入MusicGen解码器，对比T5文本描述、ViT独立帧和ViViT时空patch，并始终微调解码器。实验表明此任务中，预训练视觉编码器无需再微调也可提供强时空条件信号。

Abstract: Video-to-music models have advanced considerably in the last few years, particularly in film and music video applications. In this paper, we investigate this problem in the video game domain, which introduces new challenges for these models: video frames are rendered graphics, music is mostly synthetic audio, and soundtracks loop across entire levels rather than following on-screen events. We introduce a new dataset of 217.6 hours of Super Nintendo (SNES) gameplay video paired with 485 hours of clean soundtracks, free of sound effects and voice-overs, matched to gameplay audio via audio fingerprinting. With this dataset, we train a simple encoder-decoder transformer that passes video features directly to a MusicGen decoder, comparing different encoding strategies: textual descriptions (T5), independent frames (ViT), or spatiotemporal patches (ViViT). Each encoder is tested both frozen and fine-tuned, while the decoder is always fine-tuned. Frozen encoders match or outperform their fine-tuned counterparts on every metric, and the frozen ViViT achieves the best overall results. We compare this model with state-of-the-art baselines using both objective metrics and a listening study (N = 96). Despite having up to 18% fewer parameters, our model outperforms all baselines on objective metrics, surpasses GVMGen in the listening study, and performs comparably to OSSL.

eess.AS [Back]

[494] Optimal transport meets speech: a tutorial review eess.AS | cs.AI | cs.CL | cs.LGPDF

Xugang Lu, Yu Tsao

TL;DR: 这篇教程综述介绍最优传输在语音处理中的理论、算法和应用，强调其可在分布支持不重叠时度量差异并对齐跨域、跨模态信息。

Details

Motivation: 最优传输已广泛用于视觉和自然语言任务，但在语音研究中相对少见；语音受时间变化、说话人差异、噪声、混响及音频—文本—视觉异构表示影响，容易产生分布不匹配。

Result: 文章回顾最优传输基础的直观物理解释、与现代生成模型的联系，以及适用于深度学习框架的计算算法；再介绍语音增强、自动语音识别、语言/说话人识别和音频伪造检测等跨域和跨模态应用。作为教程综述，摘要未报告新的量化实验。

Insight: 最优传输不仅比较两个概率分布，也可在其支持不重叠时建立带几何结构的匹配，为现实语音中的分布变化提供统一分析与建模框架。

Abstract: Optimal Transport (OT) provides a principled framework for comparing and transforming probability distributions while preserving geometric structure. Recently, OT has gained significant attention in machine learning due to its ability to measure discrepancies between distributions, even when their supports do not overlap, making it effective for tasks such as generative modeling, domain adaptation, and transfer learning. Despite its success in fields such as computer vision and natural language processing, OT remains relatively underexplored in speech research. Speech signals present unique challenges, including temporal dynamics, speaker variability, noise, reverberation, and heterogeneous multimodal representations involving audio, text, and visual information. These factors often lead to distribution mismatches, where OT offers a natural framework for alignment and interpretation. This work aims to promote broader adoption of OT in speech processing by: (1) reviewing OT foundations through intuitive physical interpretations and highlighting connections to modern generative models; (2) presenting computational algorithms suitable for deep learning frameworks; and (3) demonstrating OT applications in cross-domain and cross-modal speech tasks, including speech enhancement, automatic speech recognition, language and speaker recognition, and audio spoof detection. We highlight OT’s strong potential for addressing distributional variations in real-world speech applications.

[495] Improving Audiovisual Speech Recognition through Synthetic Visual Data Augmentation eess.AS | cs.CL | cs.SD | eess.IVPDF

Pol Buitrago, Pol Gàlvez, Javier Hernando

TL;DR: 该研究用音频驱动的说话头生成管线合成唇动同步视频，测试合成视觉数据能否缓解低资源语言音视频语音识别的数据稀缺。

Details

Motivation: AVSR 利用唇动视觉提升语音识别，但带标签音视频数据有限，制约模型开发和语言覆盖。

Result: 在西班牙语和加泰罗尼亚语上，向真实 AV 数据加入合成样本使词错误率相对降低最多 16.2%；研究还显示，仅用合成数据也可作为缺乏 AV 语料语言的训练基线。

Insight: 合成视频既可作为真实数据增强，也可在没有真实音视频标注时提供初步训练资源，为扩大 AVSR 语言覆盖提供可扩展方案；摘要未给出两种语言各自的 WER。

Abstract: Audiovisual Speech Recognition (AVSR) is a multimodal approach to speech recognition that incorporates visual information from lip movements to enhance model performance. Despite its advantages, its development remains constrained by the limited availability of labeled audiovisual (AV) datasets. This work explores the use of synthetic visual data as a solution, using an audio-driven talking-head pipeline to generate lip-synchronized visual content from existing audio data. We evaluate the effectiveness of synthetic visual data both as an augmentation strategy and as a standalone training resource, applying our approach to Spanish and Catalan. Our results show that augmenting real AV data with synthetic samples yields relative Word Error Rate (WER) reductions of up to 16.2%, demonstrating the potential of this approach. Moreover, we demonstrate that synthetic data alone can serve as a baseline for AVSR training in languages lacking AV datasets. These findings provide evidence that synthetic visual data can serve as a scalable solution to AVSR data scarcity, enabling broader language coverage.

eess.IV [Back]

[496] Beyond Isolated Entities: Relation-Aware Multi-Entity Modeling for Unsupervised Video Anomaly Detection eess.IV | cs.CV | cs.ROPDF

Zhongpeng Pan, Xina Cheng, Kailun Yang

TL;DR: INTERACT联合建模人和物体的外观、运动及空间关系，并基于历史关系记忆预测交互状态，以发现仅关系异常的视频片段。

Details

Motivation: 巡逻或监控中，人员和物体单独看都可能正常，但二者空间或运动互动异常；依赖像素重建或孤立实体表示的方法容易漏掉这类异常。

Result: INTERACT在ShanghaiTech达到帧级AUC 84.5%，取得先进表现；消融显示移除实体间注意力造成最大性能下降，验证关系建模的重要性。

Insight: POAMI同时编码个体状态与跨实体上下文；TGRIP根据关系历史和目标帧几何预测交互状态而无需显式身份跟踪；MIRA再用条件流重建和语义一致性检查给出互补异常证据，不局限于预测误差。

Abstract: Video anomaly detection for patrol robots and surveillance systems must recognize abnormal interactions among familiar entities. Existing pixel-reconstruction and isolated-entity methods may fail when individual entities appear normal but their spatial or motion relations are abnormal. This work presents Interaction-Centric Network for Temporal Entity-Relation Analysis and Consistency Testing (INTERACT), a framework for unsupervised video anomaly detection. Person-Object Appearance-Motion Interaction (POAMI) moves beyond isolated-entity encoding by jointly modeling the appearance, motion, and spatial configurations of persons and objects in each frame. The resulting representations capture both individual entity states and their cross-entity context. Based on these representations, Target Geometry-Guided Relational Interaction Prediction (TGRIP) predicts target entity interaction states from historical relational memory and target-frame geometry without explicit identity tracking. Motion-Interaction Reconstruction and Alignment (MIRA) then evaluates these predictions through conditional flow reconstruction and semantic consistency checking, providing complementary anomaly evidence beyond prediction error alone. INTERACT achieves state-of-the-art performance, obtaining a frame-level AUC of 84.5% on the ShanghaiTech benchmark. Ablation studies show that removing cross-entity attention causes the largest performance drop, demonstrating the necessity of relational modeling. INTERACT is particularly effective for anomalies caused by changes in relations among people and objects, while maintaining competitive performance in general scenarios. The source code will be made publicly available at https://github.com/ppworkhard/INTERACT.

[497] MammoClaw: Towards Skill-Evolving Agent Harness for Breast Cancer Mammography Analysis eess.IV | cs.CVPDF

Krishna Kanth Nakka

TL;DR: MammoClaw以冻结多模态模型结合乳腺X光局部ROI、双侧视图和对侧乳房工具，并从失败轨迹演化可复用技能。

Details

Motivation: 乳腺X光分析需要局部区域及左右视图间比较，通用冻结MLLM不一定能高效获取这些证据；研究探索不训练模型权重、仅改进工具使用和流程的可能性。

Result: 工具单独使用并不能稳定提升表现；演化技能在部分BI-RADS评估和乳腺密度估计设置中改善了工具使用与结果。论文定位为探索性研究，摘要未给具体分数。

Insight: 代理迭代调用影像专用工具获取证据，再把失败轨迹转成后续运行可复用指导，实现非参数化适配；透明记录证据采集、工具交互和失误，有助审计其决策过程。

Abstract: In this work, we explore MammoClaw, a training-free agent framework that leverages frozen MLLMs for mammography analysis. To support agentic investigation, we equip the agent with lightweight mammography-specific tools for targeted image analysis, including ROI, paired-view, and contralateral-breast examination. MammoClaw iteratively gathers evidence through these tools, while skill evolution enables non-parametric adaptation by transforming failed trajectories into reusable guidance for later runs. We evaluate the framework on BI-RADS assessment and breast density estimation tasks. In our experiments, we find that tools alone do not reliably improve performance, whereas evolved skills can improve tool-use behavior and performance in some settings. Beyond these results, MammoClaw enables transparent inspection of evidence acquisition, tool interactions, and failure modes, facilitating the analysis and auditing of agent behavior. We view this work as an exploratory study of training-free, self-evolving agentic approaches for mammography and hope it provides a concrete starting point for future work on mammography-specific tools and self-evolution mechanisms. We release our code at https://krishnakanthnakka.github.io/mammoclaw.

[498] Beyond Sparsity: Weight Location and Network Context in Pruned MRI Reconstruction eess.IV | cs.CVPDF

Mohammed Wattad, Tamir Shor, Alexander M. Bronstein

TL;DR: 本文通过受控剪枝实验发现MRI重建质量取决于删除权重的位置及周围已训练网络，而不只取决于整体稀疏率。

Details

Motivation: 相同稀疏率可能留下计算作用和与现有网络兼容性不同的权重，导致用单一稀疏度描述MRI重建质量不充分。

Result: 对120个卷积U-Net和ViT模型在微调前进行受控编辑：U-Net在所有测试稀疏度下保留高分辨率计算更好；Transformer中高权重能量通常相关于质量，但相同掩码在更换周围训练权重后排名会反转。90%稀疏时，匹配中间输出尺度能消除高能掩码的大部分劣势，但原始掩码仍有优势。

Insight: 架构特定描述符可提供信息，但掩码效果仍依赖其所嵌入的训练网络上下文。比较剪枝方法需控制网络参数和输出尺度，不能把同一删除比例当作等价压缩。

Abstract: Pruning reduces the number of weights in magnetic resonance imaging (MRI) reconstruction networks. Equal sparsity, however, can retain weights with different computational roles and different compatibility with the trained network. We study these effects across 120 convolutional U-Net and vision transformer models using controlled edits evaluated before retraining. In U-Net, preserving high-resolution computation improves reconstruction at equal deletion counts across all tested sparsity levels. Equal-operation controls reveal additional sensitivity of the first convolution, which operation count alone cannot explain. In transformers, retained pretrained weight energy correlates with quality within sparsity levels, yet the same masks reverse their reconstruction ranking when the surrounding trained weights change. At 90% sparsity, matching intermediate output scales largely removes a high-energy-mask penalty while retaining an advantage for the network’s original mask. Thus sparsity alone does not characterize reconstruction quality: architecture-specific descriptors are informative, but mask quality can still depend on the surrounding trained network.

[499] Awaken, Then Scale: Tiny Adaptation for MRI Reconstruction eess.IV | cs.CVPDF

Mohammed Wattad, Tamir Shor, Alexander M. Bronstein

TL;DR: Dormant Awakening仅拟合少量原始零权重，为MRI重建模型适配单张有标签切片，并用校准修正幅度限制新图像上的变化。

Details

Motivation: 不同MRI数据域间存在偏移，但适配预算有限且测试样本无参考真值，难以判断单片微调后是否过度改变原模型输出。

Result: 对14个U-Net和ViT来源，拟合1,004或10,560个权重分别带来平均峰值信噪比提升0.430和0.509 dB。在10%适配预算的六种架构—适配器配置中，控制组均提高校准与评估表现相关性。

Insight: 用单张标注切片唤醒一小部分原本为零的权重，再按校准集修正幅度对新图像输出变化做动态上限，从而约束相对原模型的RMSE变化且无需评估参考图。结论来自固定的fastMRI到M4Raw单一构造偏移。

Abstract: Dormant Awakening (DA) specializes a magnetic resonance imaging (MRI) reconstruction model by fitting a small set of zero weights to one labeled slice. Across fourteen U-shaped convolutional network (U-Net) and vision transformer (ViT) sources, fitting 1,004 or 10,560 weights gives mean peak signal-to-noise ratio (PSNR) gains of .430 and .509 dB. We analyze how scaling the fitted output correction changes evaluation PSNR, then use the calibration correction size to cap changes on new images. The cap bounds changes in root mean squared error (RMSE) relative to the source without an evaluation reference. At 10% adaptation budget, we compare fixed halving and dynamic capping for DA, unrestricted sparse adaptation and low-rank adaptation (LoRA). The controls increase both measured calibration-evaluation correlations across all six tested architecture-adapter settings. Experiments concern one constructed fastMRI-to-M4Raw shift with fixed source checkpoints and participant panels.

physics.optics [Back]

[500] Vision-Language Agents for Active Perception in Optics Laboratories physics.optics | cs.AI | cs.CV | cs.ROPDF

Ryan Lopez, Sachin Vaidya, Seou Choi, Serena Landers, Marin Soljačić

TL;DR: 本文评估通用视觉语言模型能否通过观察图像、主动控制执行器并根据结果调整行为，完成真实光学实验系统的闭环控制。

Details

Motivation: 科学实验中的有效信号常稀疏、间歇或视觉上含糊，未必有密集预定义标量目标；实验代理需要自行解释观察、采取测量动作并利用动作结果获取信息。

Result: 在迈克耳孙干涉仪、双镜腔和四镜光学中继三种实验及匹配仿真中，给定任务专用自然语言指导后，VLM能估计执行器响应、通过干预解决含糊观察，并在信号稀疏时主动生成更有信息的视觉反馈；摘要未提供成功率指标。

Insight: 把光学装置作为具有物理落地的主动感知测试床，不向代理提供人工标量目标，直接允许其发出执行器和测量命令并保留互动历史，以检验预训练VLM在真实闭环科学控制中的能力。

Abstract: Vision-language models (VLMs) are increasingly being used in scientific workflows, but their ability as agents to directly control laboratory experiments from visual feedback remains underexplored. This capability is important because many laboratory tasks do not naturally provide dense, pre-defined numerical objectives: informative signals can be sparse, intermittent, or visually ambiguous. A more general laboratory agent should instead be able to interpret visual observations, take actions to acquire useful feedback, and adapt its behavior based on the consequences of those actions. We study whether general-purpose VLMs can perform this kind of closed-loop scientific control using experimental optics as a testbed. We evaluate agents on three experimental systems that isolate distinct capabilities: a Michelson interferometer, a two-mirror cavity, and a four-mirror optical relay. The agents observe camera images, directly issue actuator and measurement commands, and retain their interaction history without receiving an engineered scalar objective during control. Across these experiments and matched simulations, we find that, given task-specific natural-language guidance, VLMs can estimate actuator-response relationships, resolve ambiguous observations through intervention, and actively create informative visual feedback when signals are sparse. These results suggest that pretrained multimodal models can serve as important decision-making agents within the experimental loop. Our work also establishes optics as a physically grounded testbed for visual reasoning and active perception in scientific agents.

Table of Contents

cs.CV [Back]

[1] Temporal-Attention Head Specialization During Video Diffusion Training cs.CV | cs.AIPDF

[2] One Evaluation, Any Operating Point: Hypernetwork-Amortized MeanFlow for 3D MRI Reconstruction cs.CVPDF

[3] PalmLeaf-VQA: A Multi-Script Visual Question Answering Benchmark for Historical Palm-Leaf Manuscript Understanding Across Diverse Regions cs.CV | cs.AI | cs.CL | cs.LGPDF

[4] ForensicZoom: Adaptive Visual Inspection with Multimodal LLMs for Industrial-Grade Face Forgery Detection cs.CVPDF

[5] Cross-Dataset Transfer and Unknown-Class Detection in Imbalanced SAR Ship Classification cs.CV | cs.AI | cs.LGPDF

[6] Language-Augmented Video Action Anticipation: Design Fundamentals, Benchmarks, and Open Challenges cs.CVPDF

[7] Query-aligned video frame selection for long video understanding cs.CV | cs.AIPDF

[8] Toward AI-Assisted Poultry Coccidiosis Diagnosis: Evaluating Gemini and BiomedParse on Eimeria Microscopy Images cs.CV | cs.AIPDF

[9] Adapting Vision-Language Models for Human-Readable XAI in Industrial Object Detection cs.CV | cs.AIPDF

[10] RemTraceNet: Few-Shot Forensic Detection of Invisible Watermark Attacks cs.CV | cs.CRPDF

[11] Video Captioning in Low-Light Conditions through Efficient Uncertainty-Aware Caption Correction cs.CVPDF

[12] Modernising the Compressed-Domain Video Captioner: A Controlled Study of SigLIP2 and GPT-2 Substitutions cs.CVPDF

[13] Can’t Find Waldo: Evaluating VLMs’ Sensitivity to Image Resolution and Detail Level cs.CV | cs.AIPDF

[14] Cross-Dataset Generalization of Bangladeshi Rice Leaf Disease Classifiers: Benchmark, Diagnosis, and Mitigation cs.CVPDF

[15] Agentic Video Understanding: A Survey cs.CV | cs.AIPDF

[16] OmniFysics-Captioner Technical Report: Grounding Omni-Modal Understanding in the Physical World for Better Captioning cs.CVPDF

[17] Fysiverse-3D-SimReady Technical Report: Agentic Physical Simulation for Pragmatic 3D World Reconstruction cs.CVPDF

[18] PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routing cs.CV | cs.RO | eess.IVPDF

[19] Where Does the Watermark Hide? Push-Pull Disentanglement for Invisible Watermark Removal cs.CVPDF

[20] SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation cs.CV | cs.AIPDF

[21] When Retrieval Hurts: Measuring and Explaining Retrieval-Induced Hallucination in Chest X-ray Report Generation cs.CVPDF

[22] Measuring the evolution of camera distance across a century of film cs.CVPDF

[23] VisionPsy-Nano: Improving Accuracy, Efficiency, and Reliability in On-Device Vision-Language Models cs.CVPDF

[24] The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understanding cs.CV | eess.IVPDF

[25] Dimension-Specific Imbalance and an Adaptive Hybrid Label Strategy for Multi-Task Affective State Recognition in Classroom Video cs.CVPDF

[26] EgoTSR++: Egocentric Spatiotemporal Reasoning for Task Progress Understanding cs.CVPDF

[27] Calibration-Free Surface Normals Estimation in Vision-Based Tactile Sensing using Universal Photometric Stereo cs.CV | cs.LG | cs.ROPDF

[28] Gauge-Equivariant Attention for Rotation-Stable $360^\circ$ Scene Understanding cs.CV | cs.GRPDF

[29] A Surgical Foundation Model Reveals Task-Dependent Label Efficiency cs.CV | cs.AIPDF

[30] SynDORBench: Evaluating LVLM Perceptual Robustness Under Physically Constrained Visibility Conditions cs.CV | cs.AIPDF

[31] CueKFS: Agentic Cue-Driven Keyframe Selection for Long Video Understanding cs.CV | cs.AI | cs.CLPDF

[32] Enhancing Visual Reasoning in Chest X-Ray Report Generation Using Reinforcement Learning cs.CVPDF

[33] CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAs cs.CV | cs.AI | cs.LGPDF

[34] Double-Edged Sword of Mediated Visibility: How Visual Framing Undermines Congresswomen’s Perceived Competence cs.CVPDF

[35] Does Vision-Language Pretraining Granularity Matter? A Controlled Evaluation of Vision-Language Objectives Across Chest X-Ray Interpretation Tasks cs.CV | eess.IVPDF

[36] TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception cs.CV | cs.AIPDF

[37] ScreenHaystack: Finding Blind Zones in GUI Grounding cs.CVPDF

[38] Amnesia by Design, Memory By Necessity: Persistent State for Document Intelligence cs.CV | cs.AI | cs.CL | cs.IR | cs.LGPDF

[39] CausalDriveBench: Evaluating Causal Reasoning in Vision-Language-Action Models for Autonomous Driving cs.CV | cs.ROPDF

[40] PruneForget: Joint Unlearning and Pruning of Vision Models cs.CVPDF

[41] PQR3D: Progressive Query Refinement over Reference-Conditioned Temporal Windows for Multi-View 3D Object Detection cs.CVPDF

[42] OneFixer: High-Quality and Consistent One-Step Autoregressive 3DGS Refinement for Driving Scenes cs.CV | cs.AIPDF

[43] Binaural Audio-Visual Instance Segmentation cs.CV | cs.SD | eess.ASPDF

[44] KeyRec: Bounded Visual Memory for Streaming and Long-Video Understanding cs.CV | cs.AIPDF

[45] Scalable In-Domain Self-Supervised Foundation Model for Dense Representation Transfer in High-Resolution Plant Imaging cs.CV | eess.IVPDF

[46] Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models cs.CV | cs.LGPDF

[47] Evaluating Single and Multi-Omics Based Explainable Artificial Intelligence (MOXAI) for Molecular Subclass Classification of Adult-Type Diffuse Gliomas cs.CV | cs.AIPDF

[48] Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling cs.CVPDF

[49] Kernel-Based Steering of CLIP with Vision-Language Model Preferences cs.CV | cs.LGPDF

[50] Geometry-Preserving Blind Watermarking for Raw 3D Point Clouds cs.CVPDF

[51] FSS-UBrain: Multi-region Few-Shot Brain Tumor MRI Segmentation cs.CVPDF

[52] HeroFrame-Bench: Reference-Anchored Evaluation via Rubric–Ranking Co-Evolution for Movie Hero Frame Selection cs.CVPDF

[53] One Perception, All Maneuvers: Directional Traffic Signal Understanding for Maneuver-Level Signal Intent Prediction cs.CVPDF

[54] Progressive-View On-Policy Distillation for Regional-to-Global Transfer in Multimodal LLMs cs.CV | cs.AIPDF

[55] SGA-Flow-GRPO: Spatial Gradient-Guided Credit Assignment for Flow-GRPO cs.CVPDF

[56] OpenMASC: An Open-Source Pipeline for Cross-Trajectory Metal-Aware Sampling and Correction in Accelerated MRI cs.CVPDF

[57] EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding cs.CV | cs.AIPDF

[58] Fewer Tokens, More Self-Teaching: On-Policy Self-Distillation for Extreme Visual Token Reduction cs.CV | cs.CL | cs.LGPDF

[59] StegGNN: Learning Graphical Representation for Image Steganography cs.CVPDF

[60] An End-to-End Latent-Rollout Approach for Pushing Few-Step ImageNet-$256$ Generation to FID $1.11$ without Fréchet Losses cs.CVPDF

[61] Endo-TSR: Temporal Spectral Modeling of Appearance and Motion for Endoscopic Reconstruction cs.CV | cs.ROPDF

[62] Toward On-Chip Training of Spiking Neural Networks for Dense Event-Based Vision cs.CVPDF

[63] CityToolVQA: Tool-Augmented Visual Question Answering for 3D Spatial Cognition in Urban Low-Altitude Environments cs.CVPDF

[64] QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation cs.CVPDF

[65] Seeing Parts, Reasoning about Worlds: Visual Inference under Partial Observation cs.CV | cs.AIPDF

[66] REMEDY: How Far Is Video Generation from Medical Education World Models? cs.CVPDF

[67] Back-Tracking from Clarity: Self-Learning to See Text from Afar cs.CVPDF

[68] UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation cs.CVPDF

[69] SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection cs.CVPDF

[70] In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion cs.CV | cs.AI | cs.LG | cs.MMPDF

[71] RIPE-MambaSpike: Resolution-Independent Spiking-State-Space Interfaces for Parameter-Efficient Event-Based Vision cs.CV | cs.NEPDF

[72] Harnessing Coupled Stream Completion For Human-Object Ineraction Modeling cs.CV | cs.AIPDF

[73] OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents cs.CVPDF

[74] Attribution Gaps in Zero-Training LLM+OVOD Pipelines: A Fine-Grained Analysis of the CAAP–SNAP Discrepancy cs.CV | cs.CLPDF

[75] Retrieved but Not Delivered: Multimodal Memory Delivery for Long-Term Agents cs.CV | cs.AI | cs.CL | cs.IRPDF

[76] SPACE: Sparse Predictive Attractor via Counterfactual Eviction for Streaming Video Memory cs.CVPDF

[77] DraftAttention2: Fast Video Diffusion with Low-Resolution-Guided Mixed-Precision Attention cs.CV | cs.AIPDF

[78] GAUGE: Group-Wise View-Inconsistency Rectification for Feed-Forward 4D Tracking cs.CV | cs.AIPDF