cs.CV [Total: 87]
cs.CL [Total: 32]
cs.AI [Total: 7]
cs.CR [Total: 1]
cs.IR [Total: 1]
cs.LG [Total: 6]
cs.RO [Total: 8]
cs.SD [Total: 1]
cs.SE [Total: 1]
eess.IV [Total: 1]
q-bio.NC [Total: 1]

cs.CV [Back]

[1] CORAL-KV: Compact Cross-Layer Prediction and Residual Coding for Autoregressive Video KV Caches cs.CV | cs.LGPDF

Albert Ge, Akash Haridas, Utkarsh Saxena, Ruijing Yang, Ian Colbert

TL;DR: 提出 CORAL-KV，以跨层预测和残差量化压缩自回归视频扩散增长的 KV 缓存，并提供跨视频共享或当前视频自适应拟合两种保真—内存设置。

Details

Motivation: 长视频生成中 KV 缓存持续增长，是显存瓶颈。聚类量化虽能压缩相似向量，但重建误差会在后续帧注意历史时累积；视频模型缓存层之间还存在未利用的依赖。

Result: CORAL-KV 用每层缓存状态预测后续层的 key/value，再量化预测残差。块对角加低秩（block-DPLR）预测器由头内通道关系建模的块对角部分和跨头依赖的全局低秩项组成。可复用预测器跨视频共享，也可对当前视频重拟合轻量块对角预测器以提升保真。HY-WorldPlay、MAGI-1 上，可复用配置较 QVG-4 的 PSNR 分别高 0.32、4.95 dB，缓存分别少 48%、37%；相较 QVG-Pro，视频自适应配置在 MAGI-1 上 PSNR 高 3.77 dB，缓存少 33.7%。长程生成保真更高、时间断裂减少，生成延迟相近。

Insight: 跨层相关性可用于预测缓存并只编码残差，减少逐层独立量化误差；共享与视频自适应配置对应不同存储和保真权衡。

Abstract: Autoregressive video diffusion models maintain a growing attention key-value (KV) cache, making memory a key bottleneck for long video generation. Recently, clustering-based quantization has emerged as an effective method to compress video KV caches by grouping similar key and value vectors then quantizing residual errors. However, when later frames attend to the compressed history, small reconstruction errors can compound as the video grows. Beyond the within-layer similarity exploited by clustering, we find strong dependencies across cache layers in video models. This motivates Coral-KV - Calibrated Offline, Residual-coded, and Adapted Locally - a KV-cache compression framework that uses cache states in each layer to predict keys and values in subsequent layers, then quantizes the remaining prediction residuals. We construct compact block-diagonal-plus-low-rank (block-DPLR) predictors: block-diagonal components model channel relationships within each attention head, while a global low-rank term models dependencies between heads. Coral-KV exposes a flexible fidelity-memory trade-off: it can reuse its predictors across videos or refit lightweight block-diagonal predictors to the current video for higher fidelity. Across extensive evaluations on both HY-WorldPlay and MAGI-1, our reusable configuration improves PSNR over QVG-4 by 0.32 dB and 4.95 dB, respectively, while using 48% and 37% less cache memory. Against QVG-Pro, our video-adapted configuration improves MAGI-1 PSNR by 3.77 dB while using 33.7% less cache memory. Coral-KV also maintains higher reconstruction fidelity over extended generation and reduces temporal discontinuities while retaining comparable generation latency.

[2] MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Vision cs.CVPDF

Xinzhe Wang, Changjian Jiang, Kaiwen Song, Xudong Li, Kerui Ren

TL;DR: 提出 MIRAGE，将前馈视觉 3D 几何锚定到 LiDAR-IMU 度量运动，并按对应支持度与跨模态一致性调节在线位姿校正，兼顾准确尺度和高保真 Gaussian 重建。

Details

Motivation: 前馈 3D 先验可从图像流高质量重建，但度量尺度不可靠、长程轨迹漂移；LiDAR-惯性运动有准确物理尺度，却缺少高保真重建所需的图像空间一致性。

Result: MIRAGE 融合前馈视觉几何和 LiDAR-IMU 度量运动，并依据匹配支持度及模态间一致性调节在线位姿修正，以联合估计度量位姿和高质量高斯重建。在 Oxford Spires、M2DGR、INS 上实现准确度量轨迹估计，超过常用于视觉基准但计算昂贵的 COLMAP。作者还构建多模态采集平台，为长时程大规模室内重建建立视觉专用新基准的高精度 6DoF 参考轨迹，并评测近期单目方法；摘要未列具体误差数值。

Insight: 几何重建与度量运动各有优势，按视觉对应和跨模态一致性加权融合可补足彼此短板；工作也贡献长时室内重建评测数据。

Abstract: Feed-forward 3D priors enable high-quality reconstruction from image streams but often lack reliable metric scale and suffer from long-term trajectory drift. In contrast, LiDAR–inertial estimation provides metrically accurate motion but lacks the image-space consistency needed for high-fidelity reconstruction. We propose $MIRAGE$, which anchors feed-forward visual geometry to LiDAR–IMU metric motion and regulates online pose corrections according to correspondence support and cross-modal agreement, jointly enabling accurate metric pose estimation and high-fidelity Gaussian reconstruction. Experiments on Oxford Spires, M2DGR and INS show that MIRAGE achieves accurate metric trajectory estimation, outperforming COLMAP, a widely used but computationally expensive reference for vision-only benchmarks. Motivated by the scarcity of long-horizon monocular benchmarks for large-scale indoor reconstruction, we further build a multimodal data-collection platform and use MIRAGE to establish accurate 6-DoF reference trajectories for a new vision-only benchmark. We benchmark recent monocular large-scale reconstruction methods on this dataset, providing a systematic evaluation of their performance in long-horizon indoor scenes.

[3] TerraAgent: Demonstration-Grounded Multi-Agent Reasoning for Long-Context Remote Sensing Visual Question Answering cs.CVPDF

Jingwen Huang, Yiming Fang, Hanxiao Wu, Boyuan He, Keyi Luo

TL;DR: 提出 AVA，一个免训练遥感 VQA 框架，以 GSD 分桶示范检索、证据类型子问题图和反事实视觉依赖审计降低先验作答。

Details

Motivation: 遥感问答正确答案未必来自图像证据；跨地面采样距离、传感器和城市纹理检索到的示范可能不匹配，长视觉上下文会稀释证据、误差可在多步推理传播，先验知识作答又被标准准确率掩盖。

Result: GDR 按 GSD 分桶、依据场景图检索示范，并剔除答案缺乏图像支持的示范；MACE 将查询拆为证据类型子问题 DAG，路由至感知工具，并在共享账本记录验证来源、限制重复感知；CVA 通过对引用证据做消融/交换反事实测试最终答案，计算视觉依赖分数并用于置信度校准和强制证据重查。在 RSVQA-LR/HR、VRSBench、LHRS-Bench 上，较同设置最强基线平均准确率最高提高 2.40 分，视觉依赖从 0.28 升至 0.49，先验作答率从 46.2% 降至 21.7%，幻觉率从 17.1% 降至 9.8%；成本为单次骨干前向的 2.6 倍，不需微调。

Insight: 通过反事实改变引用证据检验答案是否真由图像驱动，可量化视觉依赖并区分“答对”与“看图答对”。

Abstract: Remote sensing visual question answering (RS-VQA) requires answers that truly depend on image evidence, yet current remote sensing multimodal large language models (RS MLLMs) are still evaluated mainly by accuracy, which cannot reveal whether a correct answer was produced without using the image. This setting introduces three challenges: demonstrations retrieved across different ground sample distances (GSD), sensors, and city textures may be poorly matched; real queries often involve long visual contexts from multi-scale tiles, multi-temporal frames, and retrieved knowledge, where evidence can be diluted and errors can propagate through multi-step reasoning; and prior-only answering remains invisible to standard metrics. We present AVA, a training-free framework that wraps a frozen RS MLLM with three modules. GDR performs GSD-bucketed, scene-graph-based demonstration retrieval and filters demonstrations whose answers are unsupported by their images. MACE decomposes each query into an evidence-typed sub-question DAG, routes sub-questions to suitable perception tools, and records verified provenance in a shared evidence ledger with bounded re-perception. CVA audits the final answer through counterfactual perturbations of cited evidence, including ablation and swap, and computes a visual-dependency score for confidence calibration and evidence-forcing re-query. On RSVQA-LR/HR, VRSBench, and LHRS-Bench, AVA improves average accuracy by up to 2.40 points over the strongest same-setting baselines, raises the visual-dependency score from 0.28 to 0.49, reduces the prior-only answer rate from 46.2 percent to 21.7 percent, and lowers the hallucination rate from 17.1 percent to 9.8 percent, with 2.6x the cost of a single backbone forward pass and no fine-tuning.

[4] TraceICL: Thread-Resolved Demonstration Curation with Consistency Calibration for Robust Multimodal In-Context Learning cs.CVPDF

Yigit Yilmaz, Elena Petrova, Mehmet Kaya, Lucia Rossi, Amir Rahman

TL;DR: 提出训练免参数更新的多模态 ICL 框架 AVA，通过线程分解、影响力演示筛选和弱模型一致性校准提升交错图文示例的绑定与抗噪性。

Details

Motivation: 冻结 LVLM 仅靠少量图文答案示范学习新任务，但交错上下文容易把示例绑定到错误图像、冗余示范挤掉有效信息、噪声答案被直接复制。

Result: TRD 将交错上下文切分成逐样本 thread 并用显式边界重组；IDS 多一次前向估计候选示范边际影响，去冗余并按价值排序；WSC 用弱同类模型的重建置信度评分各示范，在解码时软重加权。在五个视觉语言基准的交错 4-shot 设置中，较同设定最强基线平均提高 1.7 分，VizWiz 最高提高 2.4；缩小 ScienceQA-IMG 对视觉信息的依赖差距；30% 示例含噪时保留大部分收益。延迟增加 26%，可用离线缓存摊销；全程冻结 LVLM，不计算梯度。

Insight: 多模态 ICL 的主要问题包括示例结构、冗余和不可靠答案，可在推理前后分别处理；抗噪收益伴随一次额外筛选前向成本。

Abstract: Interleaved multimodal in-context learning (ICL) lets frozen large vision-language models (LVLMs) acquire new tasks from a handful of image-text-answer demonstrations, yet it remains fragile: demonstrations bind to the wrong images, redundant exemplars crowd out informative ones, and noisy answers are copied verbatim into predictions. We present AVA, a training-free framework that organizes the demonstration pipeline of multimodal ICL into three composable stages. A Thread-Resolved Decomposer (TRD) segments the interleaved context into per-sample threads and re-stitches them with explicit boundaries, restoring image-text binding. An Influence-scored Demonstration Selector (IDS) estimates each candidate’s marginal influence with one extra forward pass, removes redundancy, and orders the survivors by descending value. A Weak-to-Strong Consistency Calibration (WSC) module scores each demonstration by a weak sibling model’s reconstruction confidence and softly reweights its contribution during decoding. On five vision-language benchmarks with interleaved 4-shot prompts, AVA improves the strongest same-setting baseline by +1.7 points on average, with gains of up to +2.4 points on VizWiz, shrinks the require-visual performance gap on ScienceQA-IMG, and retains most of its gain under 30% noisy demonstrations, at a 26% latency overhead that an offline cache amortizes. No gradients are ever computed; the LVLM stays frozen.

[5] ForcingBooster: Adaptive Patch-wise Denoising for Fast Autoregressive Video Diffusion cs.CVPDF

Zekai Gu, Peng Wang, Jiahao Lu, Yongsen Mao, Cheng Lin

TL;DR: 提出 ForcingBooster，为自回归视频扩散的每个 patch 动态分配去噪步数，易区域提前停止、难区域继续细化。

Details

Motivation: 现有模型生成新视频块时通常在所有空间 patch 上均匀分配计算，忽视静态、简单或重复区域更易去噪，而复杂区域需更多步骤和上下文；统一预算既浪费易区域算力，也可能使全局少步设置无法细化难区域。

Result: ForcingBooster 是可适配多种少步自回归扩散模型的通用框架，仅增加轻量路由模块和少量训练。它根据 patch 难度动态分配去噪：简单区域提前结束，困难区域获得更多细化步骤。实验中视频 patch 总去噪步数约减少 50%，生成画质与四步基线相当。

Insight: 空间异质性需要逐 patch 预算，而非全帧统一去噪步数；该动态分配在减算力同时保持四步基线视觉质量。

Abstract: Autoregressive video diffusion models have become a leading approach to real-time interactive video generation and video world modeling. However, existing methods typically allocate computation uniformly across space when generating the next video chunk, updating all patches with the same denoising schedule and number of function evaluations. This ignores the spatial heterogeneity of video content: static, simple, or recurring regions are often easier to denoise, while other regions require further refinement or additional context. A uniform budget thus leads to redundant computation on easy patches, whereas reducing the fixed step count can leave difficult patches insufficiently refined. We introduce \methodname{}, a general framework that dynamically allocates denoising steps to individual patches: easy patches stop early to improve efficiency, while difficult patches receive more refinement steps. This design accelerates generation with negligible quality degradation. Our method is compatible with most existing few-step autoregressive diffusion models, requiring only a lightweight routing module with modest training. Experiments demonstrate that \methodname{} reduces the total number of denoising steps applied across video patches by about 50% while maintaining visual quality comparable to the four-step baseline.

[6] Mind the Temporal Gap: Evaluating Video Models for Temporal Understanding in Driving cs.CV | cs.ROPDF

Shiva Sreeram, Erfan Aasi, Tsun-Hsuan Wang, Alaa Maalouf, Daniela Rus

TL;DR: 系统评估视频语言模型在驾驶场景中的时间动作理解，发现提示方式不稳定且有类别偏差，而中间视觉特征的轻量探针/LoRA 可恢复较强运动辨别能力。

Details

Motivation: 视频语言模型常被当作通用视频推理器，但在驾驶等安全关键领域是否能稳健理解时间动态尚不明确。

Result: 作者用需识别驾驶视频自车运动动作的受控任务开展研究。标准、视觉、少样本及 CoT 提示均不可靠，且高度依赖任务/模型并持续存在类别偏差，尽管新模型在特定少样本任务上有明显提升。相比之下，对中间视觉特征训练轻量 LoRA 和简单探针能获得较强运动判别性能，说明运动线索往往已存在于模型中，但最终视频到语言路径未能可靠利用。

Insight: 当前 VLM 在驾驶时间理解上常更像受偏差驱动的帧级识别器，而非可靠时序世界模型；中间表示可能保留可用运动信息。

Abstract: Modern video-language models are increasingly treated as general-purpose video reasoners, yet it remains unclear whether they robustly capture temporal dynamics in safety-critical settings such as driving. We study this question through controlled ego-motion tasks that require identifying actions from driving videos. Across video-language models, we find that standard prompting, visual prompting, few-shot prompting, and chain-of-thought prompting remain unreliable and highly task- and model-dependent, with persistent class biases, although newer models show substantial task-specific few-shot gains. In contrast, lightweight LoRA finetuning and simple probes trained on intermediate visual features recover strong motion-discriminative performance, indicating that motion-relevant cues are often present inside the models but are not reliably used by the final video-to-language pathway. These results suggest that, in driving, current video-language models remain unreliable temporal reasoners and often behave more like frame-level, bias-driven recognizers than dependable temporal world models.

[7] Feature Competition and Its Representational Origins in Vision Language Models: Evidence from the Stroop Paradigm cs.CVPDF

Nurbüke Teker, Rui Xiao, Zeynep Akata, Shuchen Wu

TL;DR: 用 Stroop 心理学范式研究 VLM 对冲突图中文字与颜色线索的选择偏差，并从表示空间解释文本线索更具影响力的原因。

Details

Motivation: 当一幅图像中多个特征都与问题相关时，VLM 如何决定依据哪类线索回答尚不清楚；如 Stroop 图中单词含义与文字颜色冲突时应报告颜色。

Result: 作者将 Stroop 范式用于对比式和生成式 VLM，发现跨模型都存在稳定文本偏置：文字与颜色冲突时，模型更常围绕文本内容作答而非报告颜色。表示分析显示文本线索嵌入更强、可分性更高；这种不对称还预测干预难度，沿文本相关方向 steering 显著容易于沿颜色相关方向。

Insight: 同一图像的不同特征拥有不平等的表示显著性，VLM 会被文本线索主导；这一偏差在行为和表示两个层面均有证据。

Abstract: When you ask a vision-language model (VLM) a question with an image, it answers your question based on the image. But to act means to choose: saying one thing means choosing to respond not say another. This becomes an issue when the image contains multiple features that equally relate to the question at hand: how would VLMs choose to respond? This problem is precisely studied by the classical Stroop task in psychology: among a set of deliberately designed images whose text and color conflicts (e.g., \textcolor{blue}{RED}), participants are instructed to report the color. We adapt this psychological paradigm to a benchmark and prompted a range of contrastive and generative VLMs on their behavior. Across models, we observe a persistent bias toward the feature of text in Stroop images: when text and color disagree, models preferentially generate responses centered to the text rather than color. We then opened the black box and examined the source of this bias and why certain features influences the model’s behavior more than others. In the embedding space, we found that textual cues are represented more strongly and separably than color cues. This representational asymmetry predicts intervention success: steering models toward text-related directions is substantially easier than steering them toward color-related directions. Using a classical psychological paradigm, we demonstrate, at both behavioral and representational levels, that distinct features within the same image can exert unequal influence on VLM behavior. Our findings suggest that VLMs assign different degrees of saliency to different features within the same image, highlighting the need to understand how cue-specific saliency shapes their performance in widely used downstream applications.

[8] Bridging Human and Model Attention: Explainability Analysis of CNN, Mamba, and ViT Architectures with Gaze-Based Validation cs.CV | cs.HC | cs.LGPDF

Marco Stefani, Edoardo Parpaiola, Matteo Bino, Gianluca Caregnato, Francesco Roncolato

TL;DR: 用眼动注视真值系统量化比较 CNN、ViT 和 Vision Mamba 的解释热图与人类视觉注意，并用多种相似度指标分解二者对齐。

Details

Motivation: 高风险应用需精确理解模型依据。既有解释性研究多定性比较，难判断模型显著区域是否与人类视觉注意一致。

Result: 作者将后验归因图和眼动热图统一归一化为空间概率分布，在细粒度分类、医学影像和情绪识别中使用架构专属 XAI 方法，测量 Jensen–Shannon 相似度、卡方相似度和 Pearson 相关，分别反映支持重叠、质量差异和结构共变。CNN 注意较全局、显著图扩散，在一般场景与人类感知相关较好；ViT 更常集中于区分性微特征；Mamba 在医学任务解释性强，但自然图像强度分布与人类不同。指标分析显示支持重叠可近乎 1，同时线性相关接近 0，提示单一指标会掩盖分布差异。作者还研究骨干冻结和集成策略。

Insight: “关注区域有重叠”不代表注意强度分布或空间结构相关；多指标及眼动真值可揭示不同架构的解释差异。

Abstract: High-risk applications of deep learning require precise characterization of model decision-making. We conduct a systematic explainability evaluation across Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), and Vision Mamba (ViM). Unlike predominantly qualitative studies, we quantify the alignment between model attention and human visual perception using eye-tracking ground truth. We formalize this comparison via a standardized normalization pipeline mapping post-hoc attribution maps and gaze heatmaps onto spatial probability distributions. Alignment is evaluated across fine-grained classification, medical imaging, and emotion recognition using architecture-specific XAI methods. We measure fidelity using Jensen-Shannon similarity, Chi-square similarity, and Pearson correlation, three complementary estimators capturing support overlap, mass discrepancy, and structural co-variation. Our results reveal distinct attention dynamics: CNNs tend to exhibit a more global focus, with spatially more diffuse saliency maps that correlate well with human perception in general contexts, while ViTs demonstrate fine-grained, patch-level attention, often focused on discriminative microfeatures. The Mamba architecture shows biased behavior: it achieves strong explainability in medical tasks but exhibits divergent intensity distributions in natural images; our analytical characterization of the metrics makes this dissociation explicit, since near-unit support overlap is attained simultaneously with a vanishing linear correlation. We further analyze the effect of backbone freezing and ensemble strategies on model interpretability. The results highlight how architectural and training choices influence the alignment between model saliency and human visual attention.

[9] Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction cs.CV | cs.LGPDF

Utkarsh Saxena, Ruijing Yang, Mehdi Rezagholizadeh, Akash Haridas, Vikram Appia

TL;DR: 提出 Zebra3D，将稀疏线性混合注意力按层应用于预训练 3D 基础模型，以提高多视图重建效率且不需从头训练。

Details

Motivation: 前馈 3D 基础模型可从无位姿图像重建场景，但全局注意力随视图数呈二次成本，限制大规模视图集合扩展。不同深度层对注意力替换的敏感性不一致。

Result: 作者在 VGGT、HunyuanWorld-Mirror、π³ 上观察到相同趋势：早层较适合线性注意力，中晚层更敏感、注意更集中。Zebra3D 在可替换层用线性中心注意力，在敏感层用 tile-sparse 注意力，并通过 landmark summaries 保留未选上下文。闭式仿射拟合可免训练转换；可选后训练结合任务监督及输出/关系特征蒸馏。三个骨干上高稀疏度仍保持较强重建与相机位姿准确度，免训练版本接近稠密模型。输入视图数增加时端到端加速最高 7.1×（1,024 视图）。后训练 Zebra3D-VGGT 平均注意力稀疏度 94% 时，RealEstate10K AUC@30 为 80.5%，距同数据和日程微调的稠密 VGGT 仅 1.1 个百分点。

Insight: 按深度分配注意力结构比全层统一稀疏更有效；高视图数带来更大速度收益，同时指标比较明确控制了后训练设置。

Abstract: Feed-forward 3D foundation models reconstruct scenes from unposed images, but the quadratic cost of global attention limits their scalability to large view sets. We present Zebra3D, a layerwise sparse-linear hybrid attention framework that improves the efficiency of pretrained 3D foundation models without training from scratch. Across VGGT, HunyuanWorld-Mirror, and $π^3$, we observe a broadly consistent depth-wise pattern: early stages are relatively tolerant to linear replacement, while sensitive middle-to-late stages tend to exhibit more concentrated attention. Zebra3D exploits this structure by assigning linear-centered attention to tolerant stages and tile-sparse attention to sensitive stages, using landmark summaries to preserve unselected context. Closed-form affine fitting enables training-free conversion, while optional post-conversion training combines task supervision with output and relational feature distillation. Across all three backbones, Zebra3D achieves strong reconstruction and camera-pose accuracy at high attention sparsity, with training-free variants remaining close to their dense counterparts. End-to-end speedups increase with input view count, reaching up to $7.1\times$ at 1,024 views. After post-conversion training, Zebra3D-VGGT reaches 80.5% RealEstate10K AUC@30 at 94% mean attention sparsity, within 1.1 percentage points of dense VGGT fine-tuned on the same data and schedule.

Kun Li, Sami Sebastian Brandt, Michael Ying Yang

TL;DR: 提出 SAIL，通过帧级动态与全局语义锚点分离的潜变量结构、移位感知细化和连续记忆，改善指代表达引导的音视频分割身份一致性。

Details

Motivation: 指代音视频分割需根据语言描述及视听线索精确分割特定对象，需跨视觉、音频、语言细粒度交互。目标可能因遮挡、声音渐弱或身份歧义在对象间错误转移，导致时序不一致。

Result: SAIL 用双 token 将帧级动态与全局语义锚点解耦，显式表征目标移位线索；移位感知细化模块按领域证据校正漂移，解码器将细化嵌入与连续记忆更新结合，保持空间—时间连贯和身份一致。在两个 Ref-AVS 基准上，作者报告显著超过现有 AVS、Ref-VOS 和 Ref-AVS 方法；摘要未列指标数值。

Insight: 全局身份锚点与帧间变化应分别建模，以避免瞬时遮挡或音频变化造成目标切换。

Abstract: Referring Audio–Visual Segmentation (Ref-AVS) is an emergent multimodal task requiring the precise identification and segmentation of a specific object based on a natural language expression grounded in both visual and auditory cues. Unlike traditional AVS, which segments generic sound sources, or referring video object segmentation (Ref-VOS), which relies solely on visual–textual grounding, Ref-AVS necessitates fine-grained tri-modal interaction across vision, audio, and language. However, existing methods often fail to maintain consistency when subjected to target shift, a phenomenon where the model erroneously transfers its focus between objects due to transient occlusions, acoustic fading, or identity ambiguities. To address this, we propose a novel Shift-Aware Identity-guided Latent (SAIL) refinement framework. It introduces a dual-token strategy that decouples frame-level dynamics from a global semantic anchor to explicitly model target-shift cues. We design a shift-aware refinement module that rectifies drift by aligning tokens with domain-specific evidence. Finally, we leverage a decoder that integrates the refined embeddings with a continuous memory update to maintain spatio-temporal coherence and identity consistency throughout the video sequence. Extensive experiments conducted on two Ref-AVS benchmarks demonstrate the effectiveness of our proposed method, significantly outperforming existing AVS, Ref-VOS, and Ref-AVS approaches. The code will be released after publication.

[11] Reference-Free Food Volume Estimation from Egocentric Stereo Video cs.CVPDF

Vivan Kumar, Gautham Vinod, Fengqing Zhu

TL;DR: 提出无需场景尺度参照物的第一人称立体视频食物体积估计，通过可穿戴设备校准基线和 VIO 位姿重建真实尺度 3D 网格。

Details

Motivation: 现有立体视觉食物份量估计往往要求用户用手机多次拍照或在画面放置标尺进行尺度校准，增加操作负担，不利于被动饮食监测。

Result: 方法使用 FoundationStereo 零样本立体匹配、SAM 2 食物分割，并对关键帧做 TSDF 融合，从一次可穿戴第一人称立体录像重建上菜食物的 3D 网格。利用设备工厂校准的立体基线和机载视觉惯性里程计相机位姿，实现无参照物自动重建。五种录制食物上的初步体积估计平均绝对百分比误差为 9.1%。

Insight: 可穿戴设备的校准双目基线和机载位姿可替代画面尺度物体，实现自动真实尺度恢复；当前结果仅覆盖五种食物，应视为初步验证。

Abstract: Current stereo vision-based approaches for food portion estimation are hindered by the user burden of using a mobile phone to capture multiple images or placing a reference object in the scene for scale calibration. As a step towards passive dietary intake monitoring, we introduce a method that uses stereo video from a wearable egocentric device to reconstruct food items in true physical scale to accurately estimate volume. By utilizing FoundationStereo for zero-shot stereo matching, SAM 2 for food segmentation, and TSDF fusion over a set of keyframes, our method yields a visually and metrically accurate 3D mesh of any plated food item from a single stereo recording. We leverage the unique offerings of wearables, such as a factory-calibrated stereo baseline and camera poses estimated on-device via visual-inertial odometry (VIO), to perform fully automatic reconstruction without a scale reference object in the scene. We show strong initial volume estimation results across five recorded food items, achieving a mean absolute percentage error of 9.1%.

[12] CaptchaAgent: Verifiable Visual Reasoning for CAPTCHA Solving cs.CVPDF

Shangquan Sun, Ruoyu Chen, Zhirui Liu, Xiang Liu, Chenghao Qian

TL;DR: 提出 CaptchaAgent，以实体/属性/空间关系组成的 V-IR、局部高分辨率证据细化和反事实一致性检查进行交互式验证码推理。

Details

Motivation: 现代推理验证码同时要求细粒度感知、组合关系推理和浏览器操作；端到端 VLM 容易因漏物体、计数错误或关系混淆而将错误传至最终动作。

Result: CaptchaAgent 不从截图直接预测动作，而先构造视觉中间表示 V-IR 明确记录实体、属性和空间/拓扑关系；符号型 ASCII 协议要求解析器明确承诺对象集合和数量。对模糊区域进行局部证据复查，并在保持任务不变的变换下测试动作稳定性。三个专有骨干在 Open CaptchaWorld 上较同骨干商业浏览器代理基线 Pass@1 高 21.3–25.8 个百分点；独立离线 Oedipus-data 上较 Oedipus 求解器高 9.2–12.3 个百分点。追踪显示精确计数、连续几何和有序执行仍是自动化难点。

Insight: 显式中间表示和局部重看可阻止对象识别/关系错误直接传播到动作；基准覆盖开放场景与独立离线数据。

Abstract: Modern reasoning CAPTCHAs require fine-grained perception, compositional relation reasoning, and grounded browser interaction. End-to-end vision-language model agents remain brittle in this setting because a missed object, incorrect count, or confused relation can propagate directly to the final action. To address this problem, we present CaptchaAgent, a structured visual reasoning framework for interactive CAPTCHA solving. Instead of predicting an action directly from a screenshot, CaptchaAgent first constructs a visual intermediate representation (V-IR) that explicitly records entities, attributes, and spatial or topological relations. A symbol-only ASCII protocol further requires the parser to commit to a concrete object set and count. Building on this global representation, localized evidence refinement revisits ambiguous regions at higher effective resolution, while counterfactual consistency verification tests whether the resulting action remains stable under task-preserving transformations. Across three proprietary backbones on Open CaptchaWorld, CaptchaAgent improves Pass@1 by 21.3-25.8 percentage points over a commercially available browser agent baseline evaluated with the same backbones. On the separate offline Oedipus-data benchmark, it further improves average Pass@1 by 9.2-12.3 percentage points over the Oedipus solver across three matched backbones. The intermediate traces show that exact counting, continuous geometry, and ordered execution remain major sources of automation difficulty for the evaluated agents, providing practical guidance for designing more resilient compositional CAPTCHAs.

[13] Domain Adaptation of SAM 2.1 for Building-Component Segmentation in Image-Based 3D Reconstruction cs.CVPDF

Ehsan Agha Ebrahimi, Yong-Cheol Lee, Keith G. Mills

TL;DR: 微调 SAM 2.1 以提升建筑图像 11 类构件分割，再将改进掩码用于 NeRF 场景分组与 3D 自动重建。

Details

Motivation: 基于图像扫描的建筑构件 3D 重建需要先在 2D 图像中分割构件，以便在 3D 环境中一致分组；通用分割基础模型需适配建筑类别和场景。

Result: 作者在 HBD 数据集上微调 SAM 2.1，数据含 42 栋建筑的 2,679 张标注图，覆盖墙、窗、天花板、门、柱、梁、地板、开口、幕墙、屋顶和电梯 11 类。按逐类 IoU、Dice 和 mIoU 评估，微调后 mIoU 从 49.9% 提升至 69.6%。与 SegFormer 的逐类掩码比较显示，SAM 2.1 在部分大面积构件类别更好。将掩码聚合到 NeRF 后，微调 SAM 2.1 在用户选定分组尺度下也改善了构件分组。

Insight: 2D 语义掩码精度改善可传递到 NeRF 的 3D 构件分组，说明建筑重建质量受前端分类分割影响。

Abstract: 3D reconstruction of building components using image-based scanning requires appropriate segmentation of the objects in the 2D building images. In order to benefit from consistent grouping of the 2D masks in 3D environments, vision foundation models such as the Segment Anything Model have been utilized by Group Anything with Radiance Fields (GARField) to perform 3D segmentation. This study fine-tuned SAM 2.1 on the HBD dataset, consisting of 2,679 annotated images from 42 buildings, to enhance multi-class segmentation of 2D building images, covering 11 classes (Wall, Window, Ceiling, Door, Column, Beam, Floor, Opening, Curtain Wall, Roof, and Lift). The model was evaluated using per-class IoU, Dice, and mIoU metrics, and the results show an improvement in mIoU from 49.9% to 69.6%, indicating a meaningful improvement in class segmentation and providing a more accurate model for distilling the masks in 3D. SegFormer was then used as a baseline, generating per-class masks for comparison with SAM 2.1, which indicates improvement in some object classes with larger surface area. The masks in the building images were grouped in the neural radiance field, and the pretrained SAM 2.1 was compared with the fine-tuned SAM 2.1 in the newly rendered images. This comparison shows that fine-tuning improves the grouping of building components at a user-selected grouping scale. This advances the application of Group Anything with Radiance Fields (GARField) in 3D, enabling better segmentation of building structures for 3D auto-reconstruction.

[14] Selective Spatio-Temporal Fruit Inspector (S$^2$FI): A Mamba-based Framework for Rotational Fruit Quality Assessment cs.CVPDF

Hao Tian, Jie Hu, Guoqi Shan, Fan Wang, Wenzhuo Zhang

TL;DR: 提出 S²FI，一种结合 3D 卷积与 Mamba 的果品旋转质检网络及低成本传送带系统，按信息量加权帧并以线性复杂度建模时序。

Details

Motivation: 中小型果蔬种植者难以承担大型智能分拣系统，而人工分选效率低、标准不一致且劳动需求高；果品旋转检查还面临运动模糊和遮挡。

Result: S²FI 用 3D 卷积编码器和 Mamba 骨干提取时空特征，旋转过程中自适应赋予信息帧较高权重，以缓解模糊/遮挡并捕捉长程依赖。硬件采用双传送带和弯曲导轨，支持家用电源、快速部署及嵌入式运行。作者构建包含 6,460 个样本的传送带果品视频数据集；留出测试集上，该方法在所比较基线中达到准确率、效率和实用性最佳折衷。摘要未列准确率和速度数值。

Insight: 按旋转过程选择关键帧可降低冗余视觉信息，同时轻量 Mamba 适配低成本设备；效果报告目前为定性折衷描述。

Abstract: The global fruit and vegetable industry confronts severe post-harvest sorting challenges for small and medium-scale growers. Large intelligent sorting systems are too costly, while manual sorting suffers from low efficiency, inconsistent standards, and high labor demand. To bridge this gap between expensive equipment and inefficient manual work, this study develops a low-cost, high-efficiency, lightweight fruit sorting system driven by deep learning, suitable for small and medium growers. We propose the Selective Spatio-Temporal Fruit Inspector (S$^2$FI) architecture, which combines a 3D convolutional encoder with a Mamba-based backbone.It efficiently extracts spatiotemporal features, adaptively weighs informative frames during fruit rotation, and models long-range dependencies with linear complexity, reducing motion blur and occlusion. The hardware uses a dual-conveyor and curved rail design, supporting household power, fast deployment, and lightweight embedded deployment to improve affordability. We also built a conveyor-based fruit quality video dataset with 6,460 samples. Experiments on the held-out test set show that our method achieves the best trade-off among accuracy, efficiency, and practicality, outperforming the compared baselines on the test set, achieving an excellent balance of accuracy, speed, and practicality for real-world sorting.

Hao Zhang, Zhiqian Zheng, Linfeng Tang, Xinyu Xiang, Jiayi Ma

TL;DR: AD-SRF 将多模态图像融合的视觉质量优化与语义增强分开处理，再通过不可见语义图重组，以提升下游分割而不牺牲融合图像观感。

Details

Motivation: 图像融合通常需要同时优化视觉质量与语义属性，但两类目标存在冲突：提升分割语义可能损害融合图像质量。作者希望在退化输入下仍得到清晰融合结果，并强化其对下游分割的语义支持。

Result: 方法先用基于 Transformer 的恢复式融合网络建立视觉基线，并结合跨模态检索和信息恢复—融合协同损失；随后加入攻防博弈，攻击者学习削弱分割的扰动，防御者从原始输入恢复缺失语义，再用不可见语义图将其融回结果。迭代交互使防御者逐步增强语义属性。论文报告在视觉质量和语义属性上同时取得更优表现；摘要未给出具体指标。

Insight: 关键设计是将视觉质量与语义能力解耦优化，并通过不可见语义图重新整合，使分割收益不必以可见观感退化为代价。可用摘要支持的是定性实验结论，未提供数值或具体数据集。

Abstract: Existing image fusion methods struggle to balance visual quality and semantic attributes due to the inherent conflict between their optimization objectives. To address this challenge, we propose an attack-defense semantic reinforcement framework for multi-modal image fusion, termed AD-SRF. By decoupling the optimization of these two aspects and then losslessly reintegrating them, this framework injects rich semantic attributes into the fused image without compromising its visual quality. First, we develop a transformer-based restorative visual fusion network as a strong visual baseline. Equipped with the cross-modal retrieval module and the information restoration-fusion collaborative loss, it produces highly visible fused images even under degraded conditions. Second, we introduce an attack-defense game mechanism to strengthen the semantic attributes of the fused images. The attacker learns perturbation patterns that impair downstream segmentation, whereas the defender restores missing semantics from the original inputs and reintegrates them into the fused image through an imperceptible semantic map. Through iterative adversarial interaction, this mechanism drives the defender to continually strengthen the fused image’s semantic attributes, boosting downstream segmentation performance without compromising visual quality. Extensive experiments demonstrate that AD-SRF achieves a win-win performance in both visual quality and semantic attributes. The code is publicly available at https://github.com/HaoZhang1018/AD-SRF.

Hao Zhang, Xuhui Zuo, Jiayi Ma

TL;DR: 提出 W2F，以视觉—语义互助方式做多模态图像融合，通过对象感知融合损失、信息恢复先验、跨模态注意及梯度校正共同优化视觉质量和决策表现。

Details

Motivation: 既有多模态图像融合在视觉域和语义域优化之间存在差距，限制感知能力提升；融合图像要保留视觉细节，也需为语义任务提供可靠证据。

Result: W2F 用分割引导融合损失提供对象级结构信息，以嵌入信息恢复先验在退化条件下增强视觉分支给语义分支的证据。IGM-Att 和 PC-Att 通过局部/全局交互形成场景表征；特征搜索从视觉融合和语义融合任务抽取互补特征，再以梯度校正和一致性学习协调两个分支。大量实验显示，其视觉观感和决策准确率均优于 SOTA；摘要未给具体基准分数。

Insight: 将视觉保真和语义决策作为协同目标优化，而非独立分支；跨任务特征互补与梯度校正用于缩小优化落差。

Abstract: Existing multi-modal image fusion (MMIF) methods generally face an optimization gap between the visual and semantic domains, limiting the enhancement of perception capabilities. To overcome this long-standing barrier, this work proposes W2F, a new visual-semantic mutual reinforcing paradigm for MMIF. First, we reinforce the foundation for visual-semantic collaboration by amplifying feature complementarity through two targeted designs. Specifically, the segmentation-guided fusion loss introduces object-aware structural guidance into visual fusion, while the embedded information restoration prior strengthens the ability of visual fusion to provide reliable perceptual evidence for the semantic branch under degraded conditions. Then, we introduce a strong multi-modal information interaction mechanism composed of interactive gated mixed attention (IGM-Att) and progressive coupling attention (PC-Att). These modules ensure comprehensive scene representation from both local and global perspectives, providing informational support for visual-semantic collaboration. Finally, we construct a collaborative mechanism to couple visual fusion and semantic fusion. It employs a feature search module to extract complementary key features from both tasks, enriching the representational potential of visual and semantic information. Meanwhile, a gradient correction strategy ensures collaboration from the optimization perspective, enhancing performance for both visual and semantic fusion through consistency learning. Extensive experiments demonstrate that W2F surpasses state-of-the-art methods in both visual appeal and decision accuracy. The code is publicly available at https://github.com/HaoZhang1018/W2F.

[17] A Lightweight Velocity Correction Framework for Improving Instruction Following in Few-Step Text-to-Image Generation cs.CVPDF

Yating Gao, Zhenlong Zhu, Wen Zihao, Lenan Zhang, Jiexiong Wang

TL;DR: 该轻量速度修正器在冻结的少步文生图模型轨迹上学习残差，无需增加骨干前向次数，使复杂指令遵循率提升 17.60 个百分点，额外延迟仅 26.9 毫秒。

Details

Motivation: 少步文生图生成快，但在多主体、交互、空间关系、计数和属性绑定等复杂提示上容易出错。直接改动生成器参数或增加推理步数会牺牲轻量部署目标，因此作者尝试仅修正采样过程中的速度预测。

Result: 框架针对冻结的 6B 参数生成器，在选定采样步加入少于 20M 参数的共享修正器。由于早期修正会改变后续状态，On-Trajectory Flow-Bridge Supervision 在修正后实际到达的轨迹状态上构造残差监督；修正器与生成器并行运行，只训练修正器，不需要奖励优化或再蒸馏。在目标复杂场景分布的成对指令遵循评测中，相对冻结 Z-Image-Turbo 的 NetWin 提升 17.60 个百分点，每张图仅增加 26.9 ms（0.84%）端到端延迟，骨干评估次数不变。

Insight: 监督信号必须对应部署时修正后的真实轨迹，否则早期残差改变状态后，后续训练目标会与推理分布错位。结果支持其在指定生成器、复杂场景分布和成对评测上的效率收益；摘要没有说明其他生成器上的迁移表现。

Abstract: Few-step text-to-image generators produce high-quality images with few network forward passes, yet struggle with complex prompts involving multiple subjects, interactions, spatial relations, counting, and attribute binding. Can these errors be reduced without changing the generator’s parameters or increasing its forward-pass count? We propose a lightweight correction framework for a frozen 6B-parameter generator. The generator predicts velocities that determine how its intermediate image representation is updated; a corrector with fewer than 20M parameters learns residual adjustments at selected sampling steps. Because earlier corrections change the states encountered at later steps, our On-Trajectory Flow-Bridge Supervision derives residual targets at the states actually reached during corrected generation. A single corrector is shared across selected steps and runs in parallel with the generator. Only the corrector is trained, requiring neither reward optimization nor re-distillation. To our knowledge, this is the first framework for lightweight velocity-residual adaptation of fully frozen few-step text-to-image generators that preserves their original sampling schedule and forward-pass count. On our target complex-scene distribution, the framework achieves a +17.60-percentage-point NetWin over frozen Z-Image-Turbo in pairwise instruction-following evaluation, with only 26.9 ms (0.84%) additional end-to-end latency per image and no increase in backbone evaluations.

[18] What Egocentric Video Embeddings Encode and How to Combine Them with Inertial Sensors for Human Activity Recognition cs.CVPDF

Kansuke Habano

TL;DR: 该研究发现头戴式视频嵌入主要编码相机朝向，而惯性信号更适合区分跨人的活动；在 WEAR 上沿视频图传播惯性预测，使宏平均 F1 从 0.648 升至 0.852。

Details

Motivation: 第一人称视频与穿戴惯性传感器常同步采集，但预训练视频嵌入具体编码了什么、如何与惯性信号互补仍不清楚。直接融合两种模态未必能有效利用各自的判别信息。

Result: 研究分析 VideoMAEv2、CLIP、DINOv2 和 VC-1 嵌入，发现其主要方向受相机观察位置支配：在 Ego-Exo4D 的第一人称视频中，头部朝向解释度 R² 为 0.49–0.70，而外视角不呈现该现象；在 WEAR 上，场景布局也能解释嵌入。肢体惯性信号可区分不同参与者的活动。作者移除视频图主导成分后，在不保留时间顺序、每秒片段随机使用一个肢体信号的设置下，将惯性分类预测沿参与者内部视频图传播；WEAR 的按主体交叉验证宏平均 F1 从 0.648 提升到 0.852。传播对视频图有效，而单分类器模态融合或加入惯性图边表现更差。

Insight: 两种模态承担不同角色：视频嵌入提供同一参与者内部的片段相似结构，惯性信号提供活动标签信息。结果来自 WEAR 的特定主体内图传播设置；不能泛化为所有数据集或声称直接特征融合更优。

Abstract: Egocentric video and body-worn inertial sensors are increasingly recorded together, and the video is usually encoded by pretrained models. What these embeddings represent when the camera sits on the head, and how they should be combined with inertial sensing, has received little attention. Across VideoMAEv2, CLIP, DINOv2 and the egocentric VC-1, the leading principal directions of the embedding are dominated by where the camera looks. Measured head orientation explains them on Ego-Exo4D for egocentric (R^2 0.49-0.70) but not exocentric cameras, and the scene layout explains them on WEAR. The part that the limbs’ inertial signals predict separates activities across people. In a set-level probe, the rest separates exercise sets within a participant but not activities across people. This is consistent with separate roles: the video finds the clips of the same set, and the inertial classifier labels them. On WEAR, with temporal order removed and one random limb per one-second clip, we propagate inertial predictions over a within-participant video graph whose leading components are removed. This raises subject-wise cross-validated macro-F1 from 0.648 to 0.852. In our comparisons, propagation helps only over the video graph, and fusing the modalities in one classifier, or adding inertial edges to the graph, performs worse.

[19] BLEND: Balancing Personalization vs. Generalization in Federated Vision-Language Models cs.CV | cs.LGPDF

Payam Abdisarabshali, Fardis Nadimi, Kasra Borazjani, Naji Khosravan, Richeng Jin

TL;DR: BLEND 通过共享全局视觉/文本适配器、客户端个性化视觉投影适配器及零样本锚点损失，平衡联邦视觉语言模型的个性化与跨客户端泛化。

Details

Motivation: 联邦视觉语言模型需要在分散客户端数据上适配，同时兼顾每个客户端的个性需求和跨客户端泛化。只共享模型或只做本地适配都难以兼顾这两个目标。

Result: BLEND 选择性微调并聚合 VLM 参数：全局视觉与文本适配器在客户端共享，每个客户端另有个性化视觉投影适配器。损失函数混合全局与个性化适配器输出以促进个性化，并利用零样本 VLM 的投影头构造锚点以促进泛化。论文报告在多种系统设置下持续优于现有基线；摘要未给出数据集、指标数值或具体系统设置。

Insight: 该设计将跨客户端共享能力与本地视觉适配拆分，并用零样本投影头约束个性化结果，减少个性化对通用表示的破坏。现有摘要只能支持定性比较，不能据此补写提升幅度或数据集表现。

Abstract: Federated vision-language models (FedVLMs) represent one of the emerging frontiers of machine learning, aiming to integrate federated learning within the fine-tuning pipelines of vision-language models (VLMs). In this work, we introduce BLEND, a new framework designed to jointly enhance the personalization and generalization capabilities of FedVLMs. BLEND proposes a selective VLM parameter fine-tuning and aggregation strategy that consists of (i) global vision and text adapters shared across clients, and (ii) a personalized vision projection adapter tailored to each client. BLEND further introduces a novel loss function that blends the outputs of the global and personalized adapters to achieve personalization, while simultaneously promoting generalization through a principled anchor design implemented via the projection heads of the zero-shot VLM. Extensive experiments demonstrate that BLEND consistently outperforms state-of-the-art baselines, highlighting its ability to effectively balance personalization and generalization across diverse system settings. (Code is available at: https://github.com/payamsiabd/BLEND.git)

[20] UniDeblur: Unified Motion Deblurring via Fourier Convolution Learning cs.CVPDF

Xintian Mao, Jiansheng Wang, Huaiyuan Wang, Qingli Li, Yan Wang

TL;DR: UniDeblur 用频域全局滤波学习模糊形成的卷积过程，面向多相机、多场景统一处理运动模糊，并报告在域内与分布外基准上均有竞争力。

Details

Motivation: 现有单幅去模糊模型往往针对特定场景，跨相机和图像内容时性能明显下降。像素级映射容易拟合图像内容，而忽略模糊本身的卷积结构，因此难以适应多来源模糊。

Result: 作者构建多来源去模糊数据集并设计数据剪枝与质量控制流程，提出基于 Fourier Convolution Learning 的统一框架。在频域进行模糊自适应的全局滤波器学习，避免空间域核估计受局部支持范围限制。论文报告该模型可处理不同来源和场景的运动模糊，在域内及 OOD 基准上取得有竞争力的结果；摘要未给出具体数值或数据集名称。

Insight: 方法着眼于学习模糊的卷积过程，而非单纯建立输入像素到清晰像素的映射。数据集整理和质量控制也是统一模型的重要组成部分；摘要结论为定性描述，尚无可引用的提升幅度。

Abstract: Image deblurring is a fundamental task in computer vision, yet existing methods mainly specialize in isolated scenarios. Consequently, the deblurring performance of these models drops significantly across scenarios with different cameras and image contents. This motivates the development of a unified motion deblurring framework that can handle diverse blur patterns. To this end, we construct a multi-source dataset and develop a data pruning and quality control pipeline. Then, to restore blur images with various motion blur kernels across different scenarios, we propose a unified motion deblurring framework via Fourier Convolution Learning. Existing deblurring networks usually rely on pixel-level mappings and overlook the convolutional nature of blur. Thus, the network mostly fits the image content itself rather than learning the convolution process, making it difficult to handle multi-source blur images. Instead of relying on spatial mapping, we perform blur-adaptive global filter learning in Fourier space, which avoids the limited spatial support of kernel estimation. Extensive experiments demonstrate that our unified model effectively handles motion blurs across diverse sources and scenes, achieving competitive performance across both in-domain and OOD benchmarks. Code will be released at github.com/DeepMed-Lab-ECNU/Single-Image-Deblur.

[21] In-Context Learning Can Help Vision-Language Models Overcome Training Priors cs.CVPDF

Kun Wang, Xindi Wu, Sanghyuk Chun, Olga Russakovsky, Esin Tureci

TL;DR: 受控视觉上下文示例能让 VLM 在与训练先验冲突的反事实图像上更依赖视觉证据，五类任务中最高报告提升 27.2%；当视觉能力本身薄弱时，示例帮助有限。

Details

Motivation: VLM 可能因训练中学到的统计先验而忽略图像中与先验冲突的证据。单看错误难以判断原因是缺少视觉能力，还是模型已有能力却被先验带偏，因此需要受控评测区分两者。

Result: 作者在五类视觉任务上比较先验冲突与先验一致的反事实样例。加入示例后，Qwen3-VL 235B 和 32B 在先验冲突样例上的准确率分别提升 27.2 和 15.1 个百分点，而先验一致样例准确率基本不变；五个 VLM 家族的提升范围为 9.7–30.3 个百分点。表示分析显示示例会将注意力转向视觉依据并降低对先验线索的依赖。若底层视觉能力弱或缺失，上下文学习的纠错作用有限。

Insight: 部分所谓视觉推理失败可能源自模型未调用已有的视觉 grounding 能力，而非完全缺少该能力；控制先验冲突的测试有助于诊断这一差别。提升仅适用于具备相关视觉能力的模型与所测反事实任务，不能认为上下文示例可以普遍补足能力缺口。

Abstract: Vision-language models (VLMs) learn strong statistical regularities during training, which can make them fail to properly respond to visual evidence when input images violate those regularities. It is challenging to disambiguate these prior-induced errors from errors caused by the model missing the underlying visual capabilities. In this work, we use controlled visual in-context learning to encourage the model to focus on the visual evidence, and demonstrate that this alone is frequently sufficient to correct the errors – suggesting that the models in fact do possess the relevant visual capabilities. Specifically, we show that across five vision-centric tasks, demonstrations yield large gains on prior-conflicting counterfactual examples ($+27.2%$ for Qwen3-VL 235B and $+15.1%$ for Qwen3-VL 32B) while leaving accuracy on prior-aligned examples nearly unchanged. These findings generalize across five VLM families with gains from $+9.7%$ to $+30.3%$. We analyze visual representations and find that demonstrations indeed redirect attention toward grounding cues while reducing reliance on cues that support the learned prior. Finally, we find that in-context learning is limited when the underlying visual capability is weak or absent. Together, these results show that current VLMs possess visual grounding capabilities that standard evaluations may overlook, underscoring the need for controlled evaluation design in diagnosing and improving model capability.

[22] MVGraph: Benchmarking LVLMs on Evidence Composition across Multi-View Visual Graph cs.CV | cs.CLPDF

Yingjie Zhu, Han Cheng, Xuefeng Bai, Youcheng Pan, Yang Xiang

TL;DR: MVGraph 用 8,000 个需跨视图取证的多图问题及 64,000 个诊断样例评测 LVLM，发现跨视图边对齐和关系组合是突出瓶颈。

Details

Motivation: 真实图结构证据可能分散在不同来源、时间快照或局部观察中，但既有图推理基准通常只给单个完整图，无法测量模型能否跨视图对齐并组合证据。

Result: MVGraph 包含 8,000 个实例，覆盖八类图论任务，来自局部不完整视图和时间视图两种多图场景；每题均经程序构造与验证，保证不能仅凭单个视图求解。基准还将能力拆为感知、对齐、组合、推理四阶段，提供 29 项诊断任务、64,000 个实例及用于评估中间过程的标准中间表示。对 15 个 LVLM 的评测显示，多图推理整体困难，跨视图边对齐与关系级组合是主要瓶颈；时间约束和视图数量增加也暴露更多能力边界。

Insight: 通过强制证据跨视图分布并验证单视图不可解，MVGraph 将跨视图证据组合与单图理解区分开；阶段诊断和标准中间表示便于定位错误发生在何处。摘要没有列出具体模型分数，所述能力瓶颈来自对 15 个模型的定性诊断。

Abstract: We introduce MVGraph, a benchmark for evaluating large vision-language models (LVLMs) on multi-graph reasoning where the evidence required by a query is distributed across multiple interrelated visual graph views. Although such evidence commonly resides in source-specific graphs, temporal snapshots, or local observations, existing graph reasoning benchmarks remain confined to a single self-contained structure, assessing only graph perception and reasoning while leaving the alignment and composition of evidence across views underexplored. MVGraph comprises 8k instances spanning 8 \textit{graph-theoretic} tasks, abstracted from two multi-graph scenarios (partial and temporal graph views). Each problem is programmatically constructed and verified to be unsolvable from a single view. Beyond end-to-end evaluation, we decompose multi-graph reasoning into four complementary capabilities—Perception, Alignment, Composition, and Reasoning—and design 29 diagnostic tasks with 64k instances to probe each one, along with golden intermediate representations for evaluating the intermediate process. Across 15 LVLMs, we reveal the difficulty of multi-graph reasoning and identify cross-view edge alignment and relation-level composition as prominent bottlenecks through stage-oriented diagnostics. Meanwhile, temporal constraints and increasing view counts expose further capability boundaries. Code and data are available at https://github.com/AAAndy-Zhu/MVGraph.

[23] Video Codec-Guided Training-Free Token Compression for Video Large Language Models cs.CVPDF

Xihua Sheng, Ruijie Liu, Chang Wen Chen

TL;DR: 该无训练视频 token 压缩方法利用压缩视频中的残差与运动矢量构造候选池，再做局部特征比较；在三种 VLLM、四个视频基准上达到与 FlashVID 相当或更好的效果，并减少特征比较。

Details

Motivation: 视频大语言模型处理长视觉 token 序列的推理开销高。现有免训练压缩虽然减少送入语言模型的 token 数，但在帧内 token 保护和跨帧合并阶段仍需大量视觉特征比较，压缩本身也会带来成本。

Result: 方法将编码参考帧依赖、运动矢量和残差信息映射到视觉 token 网格：残差生成 token 保护的紧凑候选池，运动信息沿参考帧链传播，为稀疏采样帧间的时间 token 合并提供局部候选。随后仅在候选范围内比较视觉特征并作出压缩决策，不修改基础 VLLM。三种代表性 VLLM、四个视频理解基准的实验中，性能与当前先进免训练基线 FlashVID 相当，部分设置超过它，同时显著减少 token 保护和时间匹配所需的特征比较。

Insight: 压缩视频编码信息可作为低成本搜索先验，让相似性计算集中在更可能相关的 token 上，从而改善准确率与计算量的折衷。论文没有给出摘要级具体压缩率、延迟或各基准分数，且评测仅覆盖所列模型与基准。

Abstract: Video large language models (VLLMs) rely on long visual token sequences to understand complex temporal content, which makes visual token compression important for efficient inference. Existing training-free compression methods mainly reduce the number of tokens sent to the language model, but the compression process itself can still require many visual feature comparisons, especially for intra-frame token protection and inter-frame temporal token merging. This paper proposes a video codec-guided training-free token compression method for VLLMs that uses coding information already available in compressed video as a low-cost search prior. The method aligns reference-frame dependencies, motion vectors, and residuals with the visual token grid. Residual information forms compact candidate pools for token protection, while motion information is propagated along reference-frame chains to construct localized candidates for temporal token merging between sparsely sampled frames. Local visual feature similarity comparison is then used within these candidates to make the final compression decisions, without modifying the base VLLM. Experiments on three representative VLLMs and four video-understanding benchmarks show that the proposed method achieves performance comparable to the state-of-the-art training-free baseline FlashVID, and in some settings surpasses it, while substantially reducing the feature comparisons required by token protection and temporal matching. These results demonstrate that codec information can effectively improve the accuracy-complexity tradeoff of video token compression.

[24] MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing cs.CV | cs.AI | cs.MMPDF

Siyi Qian, Hanqing Yang, Weihuang Lin, Zihao Yang, Yichen Lu

TL;DR: MotionCoach 通过多轮工具调用与自验证，为专业动作视频编辑构造文本提示和参考片段；在 Seedance 2.0 与 MiniMax-H3 上分别将总体分数从 55.1 提升至 65.6、从 51.2 提升至 64.5。

Details

Motivation: 专业动作编辑要求细粒度技术与时间结构，仅给动作名称不足以指导视频模型，可能出现动作关键细节错误，例如 Stoppie 指令下错误抬起前轮。现有编辑模型虽然能改外观、背景、风格和一般动作，但缺少专业动作知识。

Result: MotionCoach 是经训练的多模态智能体，通过多轮工具使用、自我验证，生成落地的文本提示和参考视频片段，作为外部专业动作知识供编辑模型使用，而不重新训练视频编辑器。训练数据流水线构建轨迹；智能体在 MotionCoach-SFT-10k 上冷启动，再在 MotionCoach-RL-2k 上进行 GRPO，奖励覆盖提示、动作结果视频和格式。作者提出含 314 项专业动作编辑任务及细粒度参考标注的 VPMEBench。实验中，Seedance 2.0 总分由 55.1 升至 65.6，MiniMax-H3 由 51.2 升至 64.5。

Insight: 把动作知识编码成可供现有编辑器消费的多模态条件，能在不重训视频生成模型的情况下提升专业动作可控性。分数提升针对 VPMEBench 与文中指定的两种编辑模型；摘要未给出各子指标拆分或其他编辑器上的表现。

Abstract: Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Beyond general scenarios, professional motions are significant in performance, sports, and martial arts. This paper focuses on professional motion editing, which involves fine-grained motion technique and temporal structure. Given professional motion names but lacking detailed descriptions, existing models often fail to generate professional motions, such as incorrectly lifting the front wheel under a Stoppie instruction. To address this challenge, we introduce MotionCoach, a trained multimodal agent that uses multi-turn tools and performs self-verification, producing a grounded prompt and a reference clip as reliable and sufficient multimodal guidance to inject external professional motion knowledge into video editing models. To supply training data, we build a data pipeline to construct trajectories. We cold-start the agent on MotionCoach-SFT-10k and apply Group Relative Policy Optimization (GRPO) on MotionCoach-RL-2k with rewards on the motion guidance prompt, the motion outcome video, and the format. For evaluation, we introduce VPMEBench, comprising 314 professional motion editing tasks with fine-grained references and annotations. Extensive experiments show that MotionCoach improves the overall score from 55.1 to 65.6 on Seedance 2.0 and from 51.2 to 64.5 on MiniMax-H3. Learning to construct multimodal guidance enables precise professional motion editing without retraining video editing models.

[25] The Evidence Anchoring Boundary: Where Visual Interventions Matter and When They Help in Multimodal LLMs cs.CV | cs.AIPDF

Qiji Zhou, Junyi Hu, Peiyu Wang, Yue Zhang

TL;DR: 研究提出视觉干预的 Evidence Anchoring Boundary，并据此选择性路由干预：校准后属性题准确率提升 1.56–1.81 个百分点，而对所有题统一做反事实相减可能无效或有害。

Details

Motivation: 免训练视觉干预可以减轻多模态大模型幻觉，但不同解码层的干预影响力可能不同；即使它改变答案，也可能破坏原本正确的判断。需要弄清干预在哪一层仍能改变证据利用，以及哪些题型适合采用。

Result: 作者在三个模型家族的六个检查点上，逐层施加 RMS 强度匹配的视觉残差编辑，发现干预效果随深度持续减弱，并定义该编辑的操作起点为 Evidence Anchoring Boundary（EAB）。用校准查询固定边界后，在独立测试查询中，EAB 前的干预效果是边界后的 13.78–26.10 倍；中间层读出还显示，干预影响力可能在答案偏好稳定前就已消失。对存在性、属性和关系问题的反事实相减可能纠正误导偏好、保持不变，也可能删掉支持正确答案的偏好。因此作者设计校准式选择路由，在校准支持该题型干预时才修改预测；三个检查点的全量属性准确率提高 1.56–1.81 个百分点，普遍相减中性或有害。

Insight: 模型内部对证据的锚定与答案偏好稳定不是同一时刻；干预效果取决于层位置和问题类型。EAB 是针对该视觉残差编辑定义的操作边界，不能直接视为所有干预方法通用的模型层常数。

Abstract: Visual interventions provide a training-free way to reduce hallucinations in multimodal large language models. However, an intervention may have little leverage at some layers and may damage a correct answer even when it changes the output. We investigate where visual interventions retain leverage and when they improve predictions. First, we apply the same visual-residual edit at successive decoder layers, matching its RMS strength across depth. Across six checkpoints from three model families, we observe a persistent drop in intervention effect and define its operational onset for this edit as the \textbf{Evidence Anchoring Boundary (EAB)}. With boundaries fixed on calibration queries, held-out effects on disjoint evaluation queries before EAB are $13.78\times$–$26.10\times$ larger than those after it. Comparison with intermediate readouts shows that the edit can lose leverage before answer preferences stabilize. Second, we compare counterfactual subtraction across presence, attribute, and relation questions. Subtraction can correct a misleading preference, leave a decision unchanged, or remove a preference supporting the correct answer. Based on these observations, we develop calibrated selective routing, which preserves the original prediction unless calibration supports an intervention for the question type. It improves full-set attribute accuracy by $1.56$–$1.81$ percentage points across three checkpoints, while universal subtraction is neutral or harmful.

[26] Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion cs.CVPDF

Tianyu Zhang, Shuai Huo, Dengchao Jin, Hewei Liu, Meng Lei

TL;DR: UniGVC 用单一码流支持双向高质量回放与自回归低延迟流式解码；1080p 下 BI 模式在 0.0005 bpp 仍有时间稳定性，AR 模式达 36.85 FPS，速度比 BI 快 250 倍以上。

Details

Motivation: 双向视频扩散能利用完整序列上下文，压缩质量较好，但需要等待整段序列且延迟大；自回归模型支持低延迟流式解码，却因时间上下文受限而压缩效率较低。实时传输与后续高质量回放常同时需要这两种能力。

Result: UniGVC 是一个统一生成式视频编解码器，从同一码流支持两种解码模式：UniGVC-BI 使用密集注意力双向 DiT 做随机访问、高质量解码；UniGVC-AR 使用窗口化自回归 DiT 做低延迟流式解码。两路共享分层潜变量编解码器并递归生成超低码率条件，BI 路径还作为条件教师对 AR 路径进行单步蒸馏；轻量条件视频解码器进一步降低流式延迟。标准 1080p 基准上，BI 模式在评测方法中取得总体率失真—感知折衷最佳，在最低 0.0005 bpp 仍生成时间稳定视频；AR 模式以 36.85 FPS 解码 1080p，速度超过 BI 的 250 倍。

Insight: 系统在同一码流上兼顾实时预览与后续高质量回放，核心是共享潜变量条件并让双向模型监督单步 AR 解码。码率、质量和速度结论属于所测标准 1080p 基准；摘要未列出具体失真或感知指标。

Abstract: Video diffusion models can reconstruct visually compelling content from severely compressed representations at ultra-low bitrates, but they impose a rigid deployment trade-off. Bidirectional (BI) models achieve high quality through dense full-sequence attention, yet require the entire sequence before reconstruction and incur substantial latency. Autoregressive (AR) models enable low-delay streaming, but their restricted temporal context reduces compression efficiency. This tension is particularly relevant when a video stream must be decoded in real time yet is also stored for later, quality-oriented playback, making AR and BI models natural choices for the live and replay stages, respectively. To support both stages, we present UniGVC, a Unified Generative Video Codec that supports two decoding modes from a single bitstream. UniGVC-BI employs a BI-DiT with dense attention for quality-oriented random-access decoding, whereas UniGVC-AR uses windowed AR-DiT for low-delay streaming. Both paths share a hierarchical latent codec that recurrently produces the same conditions with ultra-low bitrates, allowing UniGVC-BI to serve as a conditional teacher for single-step distillation of UniGVC-AR. A tiny conditional video decoder further reduces streaming latency while preserving most of the reconstruction quality. On standard 1080p benchmarks, UniGVC-BI achieves the best overall rate-distortion-perception trade-off among the evaluated methods and produces temporally stable video at rates as low as 0.0005 bits per pixel. Meanwhile, UniGVC-AR remains competitive while decoding 1080p video at 36.85 FPS, over $250\times$ faster than UniGVC-BI. Code and models will be released later.

[27] What Visual Representations Do World Action Models Need? cs.CV | cs.ROPDF

Kai Liu, Jiangran Lyu, Tingyu Deng, Yixin Zheng, Jingtian Wan

TL;DR: 针对世界动作模型，研究系统比较视觉表示与五种接入机制，并提出 R²-WAM；在 RoboCasa GR1 Tabletop 和 RoboTwin 2.0 上成功率分别为 84.7% 和 92.8%。

Details

Motivation: 世界动作模型继承视频生成模型的视觉先验，但其 VAE 表示主要为重建画面优化，未必适合操控。额外视觉表示可能帮助操作，不过以往工作常同时改变表示和整合机制，难以区分改进来源。

Result: 作者在受控设置下比较视觉表示、五种整合机制及特征组合，得出三点发现：通用视觉表示可带来更广泛的鲁棒性收益，且能匹配或超过为特定能力预训练的表示；通道级联合预测的平均成功率最高，分析认为收益与未来特征预测及动作专家利用新增信息有关；额外来源应按相对已有表示新增的任务相关信息选择，同一来源可能因组合不同而有益或有害。即使最佳组合带来的增益也小于在纯 VAE 基线上加入强通用表示的初始收益。所得表示方案 R²-WAM 在 RoboCasa GR1 Tabletop 达 84.7%，在 RoboTwin 2.0 达 92.8%，较 VAE-only 基线分别提高 5.9 和 2.2 个百分点。

Insight: 对 WAM 来说，先加入强通用视觉表示通常比继续堆叠多源特征更关键；表示组合应以新增任务相关信息为准，整合机制也会影响是否能用好信息。结论基于所测两项机器人基准与比较方案。

Abstract: World Action Models (WAMs) inherit powerful priors from pretrained video generation models, but their variational autoencoder (VAE) representations are optimized for visual reconstruction rather than manipulation. External visual representations can improve manipulation, but existing methods couple representation choices with different integration mechanisms, obscuring their individual effects. We systematically compare visual representations, five integration mechanisms, and feature combinations under controlled settings. Our study yields three main findings. First, strong general-purpose visual representations provide broader robustness gains and can match or outperform representations pretrained for specific visual capabilities. Second, channel-wise joint prediction achieves the highest average success rate; further analyses suggest that future-feature prediction and the action expert’s effective use of added visual information contribute to its gains. Third, additional sources should be selected for the task-relevant information they contribute beyond existing representations, as the same source can help one combination but harm another. However, even the best evaluated composition provides a smaller additional gain than the initial improvement from adding a strong general-purpose representation to the VAE-only baseline. We instantiate the resulting Representation Recipe as R$^2$-WAM. It achieves state-of-the-art performance on RoboCasa GR1 Tabletop with an 84.7% success rate and reaches 92.8% on RoboTwin 2.0, improving over the VAE-only baselines by 5.9 and 2.2 percentage points, respectively. Taken together, these findings suggest that future work should prioritize stronger general-purpose visual representations and more effective mechanisms for integrating them into WAMs, with feature composition serving as a supplementary route to improvement.

[28] Learning Features, Not Layouts: Feature-Axis Attention as a Transfer Prior for Medical Imaging cs.CVPDF

Aon Safdar, Mohamed Saadeldin

TL;DR: FAD-ViT 将空间轴与特征轴注意力严格解耦，发现以特征轴为主的全局注意力在不损害从头训练表现的情况下增强医学影像迁移，最高迁移增益约为三倍。

Details

Motivation: 自然图像预训练模型迁移到医学影像时，受域偏移、成像模态差异和标注稀缺影响，表现不稳定。作者认为标准 ViT 主要在空间 token 上做全局注意力，适合物体布局推理，却未必契合医学影像中跨扫描仪重复出现的纹理与特征相关性。

Result: 以往通道感知混合结构将通道注意力叠加在空间混合主干上，无法单独测量两个注意力轴的作用。FAD-ViT 严格解耦空间轴和特征轴，使特征轴注意力成为主要全局算子，并可控制注意力轴。在 23 项分类、分割和低数据任务中，作者匹配 token 化方式、模型容量和评测流程后发现：从头训练性能基本不变，但迁移明显增强；相同 ImageNet 预训练下迁移增益最高约三倍，所有留出分割任务均有稳定改善，参数量最多可降至基线的四分之一，计算量也更低。优势在纹理比几何更关键的任务上最大。

Insight: 全局注意力所作用的轴本身可作为迁移设计变量；强调通道/特征相关性可能更适合医学影像跨设备复用。最高约三倍是迁移增益的报告口径，摘要没有具体任务表格数值，结论限定于所测 23 项任务和匹配设置。

Abstract: Natural-image-pretrained foundation models are increasingly adapted to medical imaging, yet transfer remains unreliable under domain shift, modality heterogeneity, and label scarcity. We trace part of this fragility to an overlooked design choice. Standard vision transformers place all global modeling on self-attention over spatial tokens, an object-layout prior well suited to natural scenes but not to medical images, where the discriminative signal lies in feature correlations and texture that recur across scanners while layout does not. We ask whether the axis of global attention, spatial versus feature, is itself a lever for transferable medical representations. Existing channel-aware hybrids confound this question, adding channel attention to a spatially-mixed backbone and leaving the axes coupled and the feature axis unmeasurable in isolation. We design FAD-ViT, a backbone that strictly decouples the two axes, making feature-axis attention the primary global operator and the attention axis a controlled variable. Evaluating comprehensively across 23 classification, segmentation, and low-data tasks under matched tokenization, capacity, and protocol, we find that shifting global attention from the spatial to the feature axis leaves from-scratch performance essentially unchanged, yet markedly strengthens transfer. Identical ImageNet pretraining yields up to roughly three times the transfer gain, with consistent improvements on every held-out segmentation task at up to a quarter the parameter count and far lower compute than standard and channel-attention baselines. The advantage is largest where texture rather than geometry is discriminative, tracking greater reuse of pretrained features. The axis of global attention is thus a design lever for medical transfer, and making it channel-primary is a simple, cheap, and principled choice.

[29] Redirecting Teacher Supervision: Temporal-Response-Guided Latent Distillation for Video-Language Models cs.CVPDF

Xinkai Lu, Junli Zha, Haolan Wei, Jiahui Wang, Chao Zhou

TL;DR: TRG 根据视频学生表示对局部时间扰动的响应调整教师隐藏态监督方向，在四个视频基准上使 4B 学生相对输出级 OPD 基线的宏平均准确率提高 2.86 个百分点。

Details

Motivation: 在线策略蒸馏会基于学生自己生成的序列传递教师知识，但直接对齐隐藏状态并未利用学生对时间变化的响应来决定监督方向，因而对视频任务中的时间学习支持不足。

Result: Temporal-Response Guidance（TRG）先测量表示对局部时间扰动的响应，再将教师修正量在这些响应张成空间中的投影加回原始修正量，并恢复原修正量范数。投影不单独归一化，响应空间之外的修正分量也予以保留。采用正交切空间投影和分离梯度的目标构造时，TRG 改变监督方向，同时保持目标构造时的余弦损失值和对齐表示的梯度范数。在 TempCompass、Video-MME、MVBench 和 Video-MMMU 上，4B 学生相对报告的仅输出 OPD 基线宏平均准确率提升 2.86 个百分点。

Insight: 监督方向由学生对局部时间扰动的敏感方向引导，能将隐藏状态蒸馏用于时间表征学习，而不只是直接拉近教师与学生表示。摘要报告的是四基准宏平均增益，并给出保持损失值和梯度范数的特定构造条件。

Abstract: On-policy distillation (OPD) transfers capabilities through teacher predictions on student-generated sequences, as studied by GKD and MiniLLM for language models and Video-OPD for video tasks. We ask how internal supervision can further support temporal learning. Direct hidden-state alignment does not explicitly use the student’s temporal responses to choose a supervision direction. We propose Temporal-Response Guidance (TRG), which measures representation responses to local temporal perturbations, adds the teacher correction’s projection onto their span back to the original correction, and restores its original norm. The projection is not normalized separately, and correction components outside the response space are retained. With an orthogonal tangent projector and a detached target, TRG changes the supervision direction while preserving the cosine-loss value and aligned-representation gradient norm at target construction. On TempCompass, Video-MME, MVBench, and Video-MMMU, TRG improves the 4B student’s macro accuracy by 2.86 percentage points over the reported output-only OPD baseline.

[30] GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs cs.CV | cs.AI | cs.CLPDF

Yongxin Zheng, Hao Wu, Fang Li, Hu Fu, Peiran Yin

TL;DR: GeoGR 联合压缩三维场景 token 与语言模型中的视觉计算：跨视角聚合为带语义锚点的体素 token，并按相关性分组跳层；在两种 7B 3D VLM 上保留 95.2%/96.8% 性能，prefill 加速 6.8×/6.1×。

Details

Motivation: 多视角表示让图像/视频 VLM 能理解三维场景，但重复观察同一区域会造成 token 冗余，而且并非每层 LLM 计算都需要所有视觉 token，推理成本因此较高。

Result: GeoGR 分两阶段处理。投影层模块 GeoSemZip 将跨视角观察合并为 3D 体素 token，结合语义显著性和空间覆盖形成紧凑场景表示，并把未选体素聚合成上下文锚点以保留信息。LLM 层的 GroupRoute 利用 token 相关性在较短层区间局部稳定、长区间变化的特点，结合晚进入、早退出和可恢复分组跳过：低相关 token 暂时跳过完整层并保存隐藏状态，在预算选择的锚点层重新加入。压缩感知后训练集含 67K 样本，为原训练池的 30%。相对稠密后训练模型，LLaVA-OneVision-7B 和 Video-3D LLM-7B 分别保留 95.2% 和 96.8% 性能，prefill 分别加速 6.8× 与 6.1×。

Insight: 方法同时消除视角冗余与逐层视觉计算冗余，且通过上下文锚点和可恢复跳层降低信息损失。结果覆盖含/不含显式 3D 空间编码的两种模型；性能保留率相对于各自稠密后训练版本。

Abstract: Multi-view representations enable pretrained image and video vision-language models to understand 3D scenes, but their long visual token sequences make inference costly. Redundancy arises both from repeated observations of the same scene regions across views and from processing all visual tokens at every LLM layer, regardless of their relevance to the current computation. We propose GeoGR, a two-stage framework that jointly compresses scene representations and visual computation. At the projector level, GeoSemZip consolidates cross-view observations into 3D voxel tokens and combines semantic saliency with spatial coverage to construct a compact scene representation. Unselected voxel features are aggregated into contextual anchors to retain scene information that would otherwise be discarded. At the LLM level, we identify an effective visual computation window and observe that query-conditioned token relevance remains locally stable but changes over longer layer intervals. Guided by these findings, GroupRoute combines late entry and early exit with recoverable group-wise skipping. Low-relevance tokens bypass complete LLM layers while retaining their hidden states and can rejoin the active group at subsequent anchor layers selected under a computation budget. For compression-aware post-training, we construct a compact dataset of 67K samples by retaining 30% of the original training pool. With this protocol, GeoGR retains 95.2% and 96.8% of the dense post-trained models’ performance on LLaVA-OneVision-7B and Video-3D LLM-7B, respectively, while accelerating LLM prefill by $6.8\times$ and $6.1\times$. These results demonstrate the consistent effectiveness of GeoGR across 3D VLMs with and without explicit 3D spatial encoding, highlighting a favorable performance-efficiency trade-off. The code is available at https://github.com/EIT-NLP/GeoGR.

Jiagan Huang, Zikun Zhou, Hongpeng Wang, Guangming Lu, Jun Yu

TL;DR: VLN-AIEP 将指令执行进度估计直接融入导航决策，通过地标锚定轨迹过滤已执行指令内容，并用导航标签监督进度学习；在 R2R、RxR、CVDN 和 R2R-CE 上取得有竞争力表现。

Details

Motivation: 多步视觉语言导航要求智能体在每个决策点匹配当前观察与尚未执行的指令。常见图方法把候选轨迹与整条指令匹配，已完成内容可能干扰后续动作；既有进度估计又依赖显式进度标签、复杂训练阶段或昂贵在线 LLM 推理。

Result: VLN-AIEP 将访问轨迹与指令关联，抑制对应已执行内容的嵌入，再用待执行指令匹配候选位置。进度估计与导航决策耦合后，正确导航依赖准确进度，使进度模块能直接从导航决策标签学习，无需进度标注。为此，作者构造地标锚定轨迹表示，编码指令所指地标的语义标签及相对视点几何，并用这些空间参照将已访问轨迹对应到已完成的指令内容。R2R、RxR、CVDN 和 R2R-CE 实验显示，方法在多项指标上表现有竞争力；摘要未给出具体分数。

Insight: 用决策结果间接监督进度估计，降低了对进度专用标注和额外在线推理的依赖；地标语义与视点几何提供轨迹—语言对齐锚点。报告结论为多基准、多指标的有竞争力表现，并非摘要所述的全面 SOTA。

Abstract: In Vision-Language Navigation (VLN) tasks involving multi-step instructions as guidance, an agent must associate its observations with the relevant instruction content at each decision point. Most graph-based methods commonly match candidate trajectories with the entire instruction, allowing already executed content to interfere with subsequent decisions. Although instruction-execution progress provides a direct cue for separating executed and pending content, existing progress estimation approaches often rely on explicit progress supervision, sophisticated progress-learning stages, or costly online reasoning with LLMs. In this paper, we propose a robust VLN framework with Awareness of Instruction-Execution Progress (VLN-AIEP), which couples progress estimation with navigation decision-making. VLN-AIEP associates the visited trajectory with the instruction to suppress embeddings corresponding to executed content, and then matches candidate locations with the pending content. This coupling makes correct navigation decisions depend on accurate progress estimation, allowing the progress estimator to learn directly from navigation decision labels without explicit progress annotations. To support progress estimation, we construct a landmark-anchored trajectory representation that encodes the semantic labels and viewpoint-relative geometry of instruction-referred landmarks. These landmarks serve as spatial references for associating the visited trajectory with executed instruction content. Extensive experiments on R2R, RxR, CVDN, and R2R-CE demonstrate that the proposed method achieves favorable performance across multiple metrics.

[32] Evolving Creatives with Clicks: CTR-Driven Advertising image Editing via Attribute Disentanglement and Preference Alignment cs.CV | cs.AIPDF

Xu Zhang, Haohan Wang, Zheng Zhang, Yingjie Xia, Wei Feng

TL;DR: ECC 将广告图优化从重新生成改为选择性属性编辑，先识别与 CTR 相关的 28 个属性，再用真实点击偏好优化编辑建议；作者报告 CTR 显著超过现有方法。

Details

Motivation: 电商广告创意优化越来越看重线上点击率而非仅视觉美观。基于 CTR 奖励的生成与强化学习方法往往对效果不佳图像中的所有属性一视同仁，可能连有助于点击的属性也被修改。

Result: Evolving Creatives with Clicks（ECC）将目标改为精细编辑：通过 ANOVA 和随机森林回归从大量图像属性中筛出与 CTR 显著相关的 28 项；利用不同 CTR 图片间的属性对比，对提示模型进行指令微调以生成编辑建议，再用真实点击偏好优化建议，因为从参考样本导出的建议未必都有效。作者提出 Consistent Preference Optimization（CPO），要求语义等价但顺序打乱的建议保持偏好一致，以缓解 DPO 过拟合并提升偏好泛化。实验报告广告图 CTR 显著提高，并以较大幅度超过先进模型；摘要未提供具体 CTR 或数据集规模。

Insight: 关键是保留促进点击的属性、只调整有害属性，并用真实点击偏好而非仅由参考图片推导的建议作为最终选择信号。由于摘要没有数值和评测细节，不能补写提升幅度或泛化范围。

Abstract: The optimization objective for e-commerce advertising creatives has shifted from aesthetic quality to online business metrics like click-through rate (CTR). Recent methods generate appealing ad images from product images by constructing CTR-based reward signals and refining prompt generation via Reinforcement Learning. Such paradigms equally penalize all attributes within an underperforming image, even though some are actually beneficial to clicks. In this work, we propose Evolving Creatives with Clicks (ECC), which reformulates creative optimization as fine-grained editing rather than generation from scratch. ECC selectively refines attributes that hurt CTR while preserving those that contribute positively. Specifically, faced with a rich attribute space across massive images, ECC first identifies 28 attributes significantly correlated with CTR via ANOVA and Random Forest regression. Based on attribute contrasts between images with disparate CTRs, we instruction-tune a prompt model to generate editing suggestions, then refine it with real click preferences since reference-derived suggestions are not uniformly beneficial. Furthermore, we introduce Consistent Preference Optimization (CPO) as ECC’s preference optimization strategy, which enforces consistency across semantically equivalent shuffled suggestions to mitigate DPO overfitting and improve preference generalization. Extensive experiments demonstrate that ECC significantly improves the CTR of ad images, outperforming state-of-the-art models by a substantial margin. The complete data pipeline, including attribute extraction and analysis, the resulting dataset, and source code will be released upon acceptance.

[33] A4-MR: Abnormality-aware Anatomical Alignment for MR cs.CVPDF

Noel D’souza, Zhijian Yang, Nishank Singla, Pranay Doshi, Krisztian Koos

TL;DR: A4-MR 是用约 5 万项 MRI 研究训练的 3D 视觉语言基础模型，学习解剖定位、解剖级影文对齐和异常感知表征，在异常检测、膝部分割和器官定位等任务上优于或接近专用基线。

Details

Motivation: 现有 MRI 视觉语言模型在真实场景中的解剖定位和病理感知表示仍不足。临床下游任务既要求理解解剖位置，也需要区分正常与异常组织。

Result: A4-MR 使用约 50,000 项 MRI 检查（491,000 个序列）训练，其中约一半配有放射学报告。模型通过噪声标签大规模预训练学习解剖定位，在解剖层面进行图文对齐，并分别建模健康和异常解剖。在下游任务中，异常检测 AUROC 比 MedSigLIP 高 1.7；冻结编码器做膝关节分割时，比端到端任务专用 MedNeXt 高 1.4 Dice；在 AMOS 腹部器官分割上与最佳任务专用模型相差不超过 0.4 Dice。无需解剖提示时，其 3D 解剖定位能力与提供真实框的 MedSAM2 相当。

Insight: 以解剖为单位的多模态对齐与正常/异常区分可让一个 MRI 基础模型覆盖定位、分割和病变相关任务。分割中冻结编码器即可超过特定端到端基线，显示表征可迁移；结论依赖其训练数据与所测下游任务。

Abstract: Recent advances in large-scale foundation models have enabled strong generalization across a wide range of clinical and research tasks in magnetic resonance imaging (MRI). However, existing vision-language MRI models remain limited in anatomy-specific localization and pathology-aware representation, particularly in real-world settings. We introduce A4-MR, a 3D vision-language foundation model trained on approximately 50,000 MRI studies comprising 491,000 series, roughly half of which are paired with radiology reports. A4-MR is designed to: (1) learn anatomy localization through large-scale pretraining with noisy labels; (2) align image and text representations at the anatomical level; and (3) learn distinct representations of healthy and abnormal anatomy. Across a diverse set of downstream tasks, A4-MR outperforms existing foundation models, including a +1.7 AUROC improvement over MedSigLIP for abnormality detection. Using a frozen encoder, A4-MR also surpasses an end-to-end task-specific MedNeXt model for knee segmentation by +1.4 Dice and performs comparably to the best task-specific model for abdominal organ segmentation on AMOS, within 0.4 Dice. Finally, without anatomical prompts, A4-MR localizes 3D anatomy comparably to MedSAM2 provided with ground-truth bounding boxes. Together, these results demonstrate that anatomy-level multimodal alignment and abnormality-aware representation learning can enable a single MRI foundation model to support localization, segmentation, and pathology-related tasks.

[34] What Do Visual-Head Discovery Scores Actually Find? Attention Source, Necessity, and Random-Control Pitfalls in Vision-Language Models cs.CVPDF

Md Abdul Kadir, Daniel Sonntag

TL;DR: 该研究系统分析视觉头发现分数、注意力来源与验证方式，发现查询跨度注意力更能找到必要头，而视觉头引导效果并不优于同层随机头。

Details

Motivation: VLM 研究常按注意力模式分数选出关注问题相关图像区域的头，再通过引导或屏蔽验证它们。但选分数的注意力来源和查询类型如何影响选头，以及引导能力能否证明这些头确有特殊作用，尚不清楚。

Result: 研究在 Qwen3-VL-8B-Instruct 上对查询类型、发现语料和注意力读取 token 位置进行 2×3×2 全因子比较，并用 CERS 测 steerability、NCS 测 necessity，均与层匹配随机头组比较。影响大小排序显示注意力来源与查询类型远大于语料：更换来源时 top-100 头集合中位数仅保留 49 个，更换查询保留 55 个，更换语料保留 84 个；同一数据两半则共享 96%–99%。必要性随注意力来源变化：查询跨度注意力发现的头比末 token 注意力发现头更必要，差值 0.083、p=6×10⁻¹⁰；指代表达+查询跨度头组高于 250 个层匹配随机组 17–19 个标准差，Holm 校正 p=0.048，并在若干新近 VLM 上复现。相反，已发现头组的引导效果不高于随机组（rank p≥0.14）。

Insight: 头组是否必要与它是否能被强力引导是不同问题；此处必要性可区分发现设置，而所用强度下的 steerability 并不特异。注意力读取位置和查询形式会显著改变被发现头集合，论文据此提出视觉头发现结果的报告协议。结论主实验来自 Qwen3-VL-8B，必要性现象另在多个模型复现。

Abstract: Attention heads that attend to image regions relevant to a question are increasingly used to steer, ground and interpret vision-language models (VLMs) and to reduce their hallucinations. They are mostly found by ranking heads with an attention- pattern score and validated by steering or masking them. We ask how the choices inside such a discovery score shape the heads it returns, and which of the two validations identifies them. On Qwen3-VL-8B-Instruct we vary the query type, the discovery corpus and the token positions whose attention is read (the attention source) in a full 2 x 3 x 2 design, and test all 12 head-sets for steerability (CERS: Contrastive Evidence-Region Steering score) and necessity (NCS: Necessity Con- trast Score) against layer-matched random head-sets. (1) The attention source and the query type reshape the selected heads far more than the corpus: changing the source keeps a median of 49 of the top-100 heads, the query 55 and the cor- pus 84, while two halves of the same data share 96-99. (2) Necessity follows the attention source: head-sets discovered from query-span attention are more nec- essary than last-token ones (difference 0.083, p=6 x 10^-10), and the two re- ferring + query-span sets lie 17-19 standard deviations above 250 layer-matched random sets (Holm-adjusted p=0.048). The referring + query-span effect re- plicates on several recent VLMs. (3) Steerability is not specific to the discovered heads: no discovered head-set steers better than its layer-matched random sets (rank p >= 0.14), and random sets drawn from the same or from any layer span the discovered sets’ scores. Necessity therefore separates the discovery settings, while steering at this strength does not. We turn these findings into a protocol for reporting visual-head discoveries.

[35] Replaying the Movie in Your Mind Decoding Dynamic Visual Perception and Recall from EEG cs.CVPDF

Zikai Fang, Tian-Yi Zhou, Xuan-Hao Liu, Yixi Li, Xiaoyu Xing

TL;DR: PAIR 是 20 名参与者观看自然视频后立即回忆的 EEG 基准；当前协议下感知与回忆的状态可高度区分，但若干语义解码任务性能数值接近，且感知在两项粗粒度比较中更高。

Details

Motivation: EEG 对外部视觉感知内容的解码进展很快，但人在脑中回放动态场景时，神经表征保留了哪些内容仍不明确。需要对同一刺激下的观看和即时回忆进行直接比较。

Result: PAIR 采用交错、逐片段范式，采集 20 名参与者观看自然视频及紧随其后的视觉回忆数据。评测包括细粒度与粗粒度层级语义分类、运动/颜色/物体数量/人脸/人物存在等元特征解码，以及区分感知和回忆状态的任务。在被试内验证中，多个模型—任务组合的数值表现相近；经过多重比较校正后，两项粗粒度比较中感知准确率更高。相对而言，状态解码能高准确地区分感知和回忆。去除 alpha 频段后状态准确率仍高，但这并不能排除眼动或其他任务相关信号的贡献。

Insight: 相同视频内容的语义信息在感知和内在回忆中可能有相近可解码程度，但产生这些表征的状态仍可被区分。解码准确率不等同于纯视觉神经表征证据，因为当前验证协议下眼动等任务相关因素仍可能参与。

Abstract: Decoding dynamic visual content from EEG has advanced rapidly for visual perception, yet it remains unclear which aspects of neural representations are preserved when people internally replay dynamic scenes. We introduce PAIR, an EEG benchmark collected from 20 participants using an interleaved, clip-wise paradigm that pairs naturalistic video viewing with immediate visual recall. This design enables a comparison between externally driven perception and internally generated recall for the same stimulus content within a fixed trial sequence. We benchmark multiple decoding models on hierarchical semantic classification at both fine-grained and coarse-grained levels, meta-feature decoding tasks covering motion, color, object number, face, and human presence, and a state-decoding task that discriminates perception from recall. Within-subject validation results show numerically similar performance for several model–task combinations, alongside higher perception accuracy in two coarse-grained comparisons after multiple-comparison correction. In contrast, perception and recall are highly separable at the state level under the present validation protocol. State accuracy remains high after alpha-band ablation, although this does not exclude ocular or other task-related contributions.

[36] Measurable Semantic 3D Gaussian Splatting with Joint Region and Depth Supervision for Interactive Building Inspection cs.CVPDF

Yi Zhang, Tian Tan, Ray Kai Leung Su

TL;DR: 该框架为 3D Gaussian Splatting 加入区域、深度和语义监督，使建筑模型可测量并支持构件检查；在 QuakeCity/HKUPB 上深度 MAE 降低 58.1%/86.8%，HKUPB 尺寸测量相对误差低于 1.1%。

Details

Motivation: 仅有逼真的图像式三维重建不足以满足建筑检查所需的几何可测量性、语义结构和交互访问能力。工程应用还需要区分构件并量化实际尺寸与面积。

Result: 方法用掩码区域监督抑制无关背景、聚焦目标区域；以多视图立体重建点云生成参考几何，对 Gaussian 中心进行逐点深度监督，为真实表面位置和尺度测量提供锚点；同时为每个 Gaussian 原语学习类别特征，实现语义渲染和构件级检查。这些功能集成到 AEC-SplatTwin 平台，提供实时可视化、语义分析、定量测量和 MLLM 辅助交互。在合成 UAV 巡检 QuakeCity 和手机采集 HKUPB 上，Gaussian 中心深度 MAE 分别降低 58.1% 与 86.8%，语义场 mIoU 分别为 0.8529 和 0.8642；HKUPB 高度、宽度、面积测量平均相对误差分别为 0.33%、1.07%、0.60%。

Insight: 区域掩码聚焦对象、深度锚点赋予几何尺度、Gaussian 语义特征支持构件识别，三者共同将 3DGS 从视觉重建扩展为可测工程表示。测量误差数据报告于 HKUPB；合成与真实采集数据集的具体任务指标需分别理解。

Abstract: Image-based 3D reconstruction provides a scalable representation for building inspection and maintenance. However, photorealistic reconstruction alone does not fully provide the geometric measurability, semantic structure, and interactive information access required for engineering applications. This study proposes a measurable semantic 3D Gaussian Splatting (3DGS) framework with region and depth supervision for interactive building inspection from multi-view imagery. Mask-based region supervision suppresses irrelevant backgrounds and focuses optimization on target regions. Point-wise depth supervision guides Gaussian centers toward physical surfaces using reference geometry derived from multi-view stereo (MVS) point clouds, providing geometric anchors for measuring physical dimensions and areas. A semantic Gaussian field associates learnable class features with individual Gaussian primitives, enabling semantic rendering and component-level inspection. These capabilities are operationalized through AEC-SplatTwin, an interactive building inspection platform supporting real-time visualization, semantic analysis, quantitative measurement, and multimodal large language model (MLLM)-assisted interaction. On the synthetic UAV-inspection QuakeCity and smartphone-captured HKUPB datasets, the framework reduces Gaussian-center depth MAE by 58.1% and 86.8%, while its semantic field achieves mIoU values of 0.8529 and 0.8642. On HKUPB, the mean relative errors for height, width, and area measurements are 0.33%, 1.07%, and 0.60%. These results show that the proposed framework extends 3DGS beyond visual reconstruction into a measurable, semantically structured, and interactive engineering representation for building inspection.

Jingyu Guo, Jiaxin Huang, Chengxing Lin, Xiaoyu Luo, Cheng Wen

TL;DR: GuidedNav 用子任务/地标引导训练前置注意力，并用几何监督塑造导航表示；在 R2R-CE 与 RxR-CE val-unseen 上成功率较最强先前结果分别提高 8.1% 和 13.1%，且推理更快。

Details

Motivation: 视觉语言导航要求智能体跟踪长指令进度、定位当前目标地标并理解空间结构。端到端策略通常只靠动作标签间接学习这些能力，容易利用训练动作相关性，而未学到可泛化的语言 grounding 与几何关系。

Result: GuidedNav 在训练阶段直接塑造连接指令与动作的表示：子任务和地标引导将原生前置注意力指向当前指令片段及相关视觉区域；空间引导则使策略内部表示对齐编码长期上下文和局部结构的几何特征。这样无需推理阶段额外生成中间文本或在线编码几何。作者同时发布标注增强的 Guided-R2R 与 Guided-RxR。实验显示，作为单目 RGB 策略，方法在 R2R、RxR、CVDN 及连续环境 R2R-CE 上有较强结果；相对先前最强结果，R2R-CE 和 RxR-CE val-unseen 成功率分别提升 8.1% 和 13.1%，且推理速度更快。

Insight: 模型将当前要完成的子任务与空间几何直接写入动作前表示，从训练时加强 grounding，避免把额外推理链放到部署时。报告的两个成功率增幅对应特定连续环境的未见验证集；摘要未列出其余基准的详细指标。

Abstract: Vision-and-language navigation (VLN) requires an agent to track progress through an extended instruction, identify landmarks relevant to its current objective, and understand the surrounding spatial structure to act. End-to-end navigation policies typically rely on action supervision to implicitly learn these capabilities. Without explicit guidance on the evidence underlying each decision, however, policies can overfit to correlations predictive of training actions rather than learn the task-relevant grounding and geometry needed for generalization. Our insight is to guide the representations that connect instructions to actions: identifying what remains to be done determines which visual evidence matters, while understanding the geometry around that evidence informs how to move. We introduce GuidedNav, a unified framework that explicitly shapes these representations through training-time guidance. Subtask and landmark guidance steer native pre-action attention toward the active instruction segment and relevant visual regions, grounding action prediction in the current objective. Spatial guidance aligns the policy’s internal representations with geometric features that capture long-horizon context and local spatial structure. Together, these objectives strengthen navigation capabilities while avoiding the inference overhead of intermediate textual reasoning and online geometric encoding. We also introduce Guided-R2R and Guided-RxR, two annotation-enriched navigation datasets that support more interpretable VLN research. GuidedNav establishes state-of-the-art performance among the compared monocular RGB policies, improving success rates by 8.1% and 13.1% relative to the strongest prior results on R2R-CE and RxR-CE val-unseen, respectively, while achieving faster inference. Extensive experiments further demonstrate the effectiveness and real-world transferability of our approach.

[38] From Glance to Focus: Mitigating Recognition Laziness in MLLMs for Fine-Grained Recognition cs.CVPDF

Yutong Yang, Zhuqi Liu, Mouxing Yang, Xi Peng

TL;DR: LIVE 提出 MLLM 的“细粒度识别惰性”现象，并通过动态候选集与类别特定识别技能进行免训练纠正；在 13 个基准、24 种方法比较中报告有效且可跨模型泛化。

Details

Motivation: 多模态大模型具备一定视觉感知和类别知识，但细粒度识别表现仍不理想。只对特定领域做后训练可能损害未见领域泛化；作者将问题归因于某些候选列表与识别指导下，视觉线索未能充分关联类别概念。

Result: 研究把推理时的 FGVR Laziness 定义为视觉线索和类别概念关联不足，导致模型未充分利用已有能力。免训练框架 LIVE 联合调整候选列表与识别指导：先按查询生成紧凑且可靠的类别候选集，再挖掘类内特征与类间差异形成类别特定技能，最后依据识别不确定性和类别混淆选择性调用细节指导。对 13 个基准、24 种先进方法的实验覆盖细粒度类别识别、动作识别及一般类别识别，作者报告 LIVE 在不同 MLLM 主干上有效并具有泛化性；摘要未给出具体分数。

Insight: 方法把部分识别错误解释为推理时的“看得不够细”，通过缩小候选空间和按需提供类别差异信息来唤起潜在能力，而无需模型微调。当前摘要提供的是广泛基准范围的定性结论，没有量化提升或单独数据集结果。

Abstract: Multimodal Large Language Models (MLLMs) generally fall short of expectations in Fine-Grained Visual Recognition (FGVR), although they exhibit promising FGVR foundations, i.e., visual perception and broad category knowledge. Most existing studies seek to remedy this deficiency by adopting domain-specific post-training, at the risk of compromising generalization to unseen domains. Different from these efforts, in this paper, we revisit the FGVR mechanism underlying MLLMs from both the empirical and theoretical perspectives and uncover an inference-time phenomenon termed FGVR Laziness. In brief, FGVR Laziness refers to the insufficient association between visual cues and category concepts under certain candidate category lists and recognition guidance, leaving the FGVR foundations of MLLMs largely under-utilized. To mitigate FGVR Laziness, we propose Laziness-resIstant Visual rEcognition (LIVE), a training-free framework which jointly refines candidate lists and recognition guidance to elicit the latent FGVR capability of MLLMs. Specifically, LIVE first performs query-adaptive candidate inference to derive a compact yet reliable candidate list. Meanwhile, LIVE constructs category-specific FGVR skills by mining the intra-category characteristics and inter-category differences. Finally, LIVE selectively invokes detailed skill guidance according to recognition uncertainty and category confusion, shifting MLLM-based FGVR from a cursory glance to a focus on associating discriminative visual cues with category concepts. Extensive experiments on 13 benchmarks against 24 state-of-the-art methods spanning fine-grained category recognition, action recognition, and general category recognition, verify the effectiveness and generalizability of LIVE across different MLLM backbones. The code will be released upon acceptance.

[39] PreCoG: Preview-Edit for Efficient Video Correction in Generation-Time cs.CVPDF

Yilai Liu, Wenqi Pei, Zhifeng Lu, Shiyuan Zhang, Zongxi Liu

TL;DR: PreCoG 利用低成本预览诊断视频生成错误，并在缓存轨迹上局部编辑、只完成选定候选；取得最高 VBench/T2V-CompBench 分数，同时以 VSR 56% 的推理时间接近其最佳 VS2 分数。

Details

Motivation: 迭代式文生视频需要根据反馈纠正构图与时间一致性错误，但现有方式每次修改往往重新完整生成，重复计算且可能破坏已正确内容。

Result: PreCoG 是生成阶段的视频迭代纠错框架。PreQA 从低成本预览中诊断语义失败并构造修正条件；PreEdit 在缓存的生成轨迹上按条件编辑，并衰减与修正方向正交的变化，以减少对正确内容的干扰。系统仅对选定候选完成生成，复用其缓存轨迹，减少重复计算并维持预览与最终视频的语义一致性。实验中 PreCoG 的 VBench 与 T2V-CompBench 得分最高；在 0.56× VSR 推理时间下，其 VS2 分数接近 VSR 的领先值。此外，在推理时间为 GENMAC 的 0.86× 时，PreCoG 在三项质量与对齐指标上均胜过 GENMAC。

Insight: 用预览决定是否以及如何修正，并复用同一候选的生成轨迹，可避免每轮从头生成；正交变化衰减用于保护未出错内容。速度比值以各比较方法为参照，摘要未给出绝对耗时或全部分数。

Abstract: Iterative text-to-video generation relies on feedback to correct compositional and temporal failures. However, existing methods typically require another full generation run for each correction, repeating computation and potentially disrupting already correct content. We introduce PreCoG, an iterative framework for correcting semantic failures during video generation. PreQA diagnoses failures from low-cost previews and constructs corrective conditions, while PreEdit edits cached generation trajectories under these conditions, attenuating orthogonal changes to limit disruption of already correct content. PreCoG completes generation only for the selected candidate, reusing its cached trajectory to reduce redundant computation and help preserve semantic consistency between the preview and the final video. Experiments show that PreCoG achieves the highest VBench and T2V-CompBench scores and approaches VSR’s leading VS2 score at $0.56\times$ its inference time. It also outperforms GENMAC on all three quality and alignment metrics at $0.86\times$ its inference time.

[40] High-Throughput Generative Video Super-Resolution on a Single Consumer GPU cs.CVPDF

Georgios Panaretou, Sotirios Chatzis

TL;DR: 该零样本生成式视频超分框架将空间放大与时间稳定分开，在单张 RTX 4090 上 720p 交错推理最高约 32 FPS；4K 时混合注意力最多加速 44%，但明确以重建保真换取感知质量和速度。

Details

Motivation: 扩散先验能为视频超分恢复高频细节，但迭代采样和繁重的时空耦合妨碍实际部署。作者关注无需端到端重训、可在单张高端消费级 GPU 运行的 HD 视频超分工作点。

Result: 零样本框架完全由预训练组件组成：时间蒸馏的一步扩散模型负责空间放大，轻量预训练光流插帧器在超分关键帧间合成中间帧以稳定时间一致性。分辨率感知混合注意力在零样本下将选定高分辨率全局注意力层替换为邻域注意力，同时保留语义关键的低分辨率全局注意力。单张 NVIDIA RTX 4090 上，交错推理 720p 最高约 32 FPS；4K 时注意力替换相对原实现最高加速 44%。标准 VSR 基准显示其速度—质量折衷显著偏向效率，保持较强无参考感知质量和有竞争力的时间一致性，但牺牲部分重建保真度；复杂运动仍是局限，简单运动门控可部分缓解。

Insight: 通过分离空间增强和时间稳定，避免对完整时空扩散过程进行高成本端到端推理。速度数字依赖单卡 4090 与指定分辨率/交错设置；复杂运动局限仍存在，方法并非在像素重建保真度上无代价。

Abstract: Generative video super-resolution (VSR) can recover visually compelling high-frequency detail by leveraging diffusion priors, but iterative sampling and heavy spatio-temporal coupling make practical deployments difficult. We study a different operating point: practical HD generative VSR on a single high-end consumer GPU without end-to-end retraining. To this end, we present a zero-shot framework built entirely from pretrained components. The proposed system decouples spatial enhancement from temporal stabilization. A time-distilled one-step diffusion backbone handles spatial upscaling, while temporal coherence is promoted by a lightweight pretrained flow-based interpolator that synthesizes intermediate frames between super-resolved keyframes. To further improve scalability, we introduce a resolution-aware hybrid attention scheme that, in a zero-shot manner, replaces selected high-resolution global-attention layers with neighborhood attention while preserving global attention in semantically critical low-resolution layers, while also improving temporal consistency. Experiments show that the proposed framework reaches up to ~32 FPS at 720p resolution under interleaved inference on a single NVIDIA RTX 4090. At 4K, the proposed attention substitution can yield up to a 44% speedup over the original attention implementation. Across standard VSR benchmarks, the method consistently shifts the speed-quality trade-off decisively toward runtime efficiency, trading reconstruction fidelity for strong no-reference perceptual quality, while remaining reasonably competitive against generative approaches in temporal consistency. It also exposes clear limitations in handling more challenging motion, which a simple motion gate partially mitigates. Code will be released upon acceptance.

[41] Destination-Conditioned Adaptation with Semantic-Geometric Alignment for Generative Inbetweening cs.CVPDF

Zhiyu Xu, Wei Shang, Yushen Xu, Wenwen Li, Zhiyan Xu

TL;DR: DSG-GI 为视频插帧加入目标帧渐进引导和语义—几何对齐，使预训练视频扩散模型更忠实到达目标帧；标准与大运动基准上改善时间稳定性、目标一致性和感知质量。

Details

Motivation: 生成式插帧要在起始帧与目标帧间合成时间连贯的中间帧。预训练图像到视频扩散模型具备大运动先验，却未专门学习到达指定终点，因而可能生成单帧逼真但整体漂离目标或在大位移、非刚性运动下不稳定。

Result: DSG-GI 包含目标条件适配和语义—几何对齐。目标帧被视为序列终点，并沿生成轨迹提供逐步增强的引导；同时将主干特征的逐 token 时空关系几何与冻结视频基础编码器对齐，并对概率路径靠近数据终点的样本施加与 flow matching 一致的潜在流约束。作者在标准和大运动插帧基准上报告，方法提升时间稳定性、目标帧忠实度与感知质量；摘要没有列出数据集、分数或计算开销。

Insight: 方法既显式要求轨迹到达目标帧，也约束运动过程中的语义—几何结构，分别针对终点漂移和运动不连贯。摘要仅支持定性改进结论，无法据此给出提升幅度或训练/推理代价。

Abstract: Generative inbetweening aims to synthesize temporally coherent intermediate frames between a start frame and a target frame. Although pretrained image-to-video diffusion models provide strong priors for large-motion inbetweening, they are not explicitly designed to reach a specified target frame. They may therefore generate realistic individual frames while drifting from the target or producing unstable motion under large displacements and non-rigid dynamics. We propose DSG-GI, a framework that adapts pretrained latent video diffusion models through \textbf{D}estination-Conditioned Adaptation and \textbf{S}emantic-\textbf{G}eometric Alignment. Destination-Conditioned Adaptation treats the target frame as the destination of the sequence and provides temporally progressive guidance along the generated trajectory. Semantic-Geometric Alignment aligns the token-wise spatio-temporal relational geometry of backbone features with that of a frozen video foundation encoder and applies a flow-matching-aware latent flow constraint to samples near the data endpoint of the probability path. Together, these components strengthen destination guidance and preserve coherent semantic-geometric motion structure. Extensive experiments on standard and large-motion inbetweening benchmarks demonstrate improvements in temporal stability, target-frame faithfulness, and perceptual quality. Our code will be made publicly available.

[42] Golden Anchor for Video Generation cs.CV | cs.LGPDF

Jinyuan Xu, Shitong Shao, Lichen Bai, Zikai Zhou, Guoxi Huang

TL;DR: Golden Anchor Learning 用下游视频反馈优化文生图生成器所产的 I2V 锚帧；在四种视频模型上将 VBench 均分提高 2.97%–8.46%，动态程度提高 5.62%–38.24%，并迁移到未参与训练的模型。

Details

Motivation: 当前可控视频生成常由文生图模型先生成锚帧，再交给图像到视频模型控制身份、构图和风格。但图像的美学和质量分数未必能预测下游视频质量，优化单帧图像指标甚至可能损害视频运动。

Result: 分析发现，锚帧结构/纹理评分与 I2V 视频质量在视觉和运动维度上呈负相关。对 T2I 模型按图像奖励微调会产生结构和角色细节更密集、图像指标更高的锚帧，却降低所测所有 I2V 模型的视频奖励，并不可预测地改变运动。Golden Anchor Learning（GAL）冻结 I2V 模型，用候选锚帧生成的视频反馈为图像级偏好打分，再通过 DPO 微调 T2I 生成器。在四种 I2V 模型上，VBench 平均分较未调优生成器提高 2.97%–8.46%；视频在 VideoReward-Overall、抽取帧在 HPSv3 和 UniPercept 上也更高；VBench 动态程度提高 5.62%–38.24%。GAL 仅用 HunyuanVideo-1.5 生成结果训练，增益也迁移至另外三个模型。

Insight: 锚帧应按其诱发的视频效果优化，而不应仅按单图美学评分优化；单图高分与下游视频质量可能冲突。跨模型增益是在只用 HunyuanVideo-1.5 渲染训练的条件下观察到，改善范围以所测四个 I2V 模型和指标为限。

Abstract: Video generation supports digital content creation, with applications in virtual avatars, AI-driven filmmaking, interactive game engines, and world models. State-of-the-art systems achieve controllability primarily through image-to-video (I2V) generation, in which an injected anchor image determines the identity, composition, and style of the resulting video. In modern pipelines, this anchor is synthesized by a text-to-image (T2I) generator. This raises a largely overlooked question: Are images obtained directly from the T2I model truly suitable for current video models? Our analysis shows that anchor aesthetic and quality scores are weakly correlated with downstream video quality. The structure-and-texture score is negatively correlated with I2V video quality in both the visual and motion dimensions. Fine-tuning the T2I model on an image reward accordingly yields anchors with visibly denser structural and character detail: they score higher on image metrics, yet lower the video reward on every I2V model we test and change downstream motion unpredictably. We therefore introduce Golden Anchor Learning (GAL), to our knowledge the first framework for learning golden anchors by optimizing a T2I generator with downstream video feedback. GAL evaluates candidate anchors through the videos they induce under a frozen I2V model and converts video rewards into image-level preferences for DPO fine-tuning of the T2I generator. On all four I2V models, GAL raises the VBench average by $2.97%$–$8.46%$ over the untuned generator. The rendered clips also score higher under VideoReward-Overall, and their extracted frames under HPSv3 and UniPercept. GAL yields consistent motion gains across all four I2V models, as measured by a $5.62%$–$38.24%$ increase in VBench dynamic degree. Although GAL is trained only on HunyuanVideo-1.5 renders, these gains extend to the other three I2V models.

[43] FPD-Drive: Future Policy Distillation for End-to-End Autonomous Driving cs.CVPDF

Li-Heng Chen, Qifeng Chen, Chengwei Wu, Yingjie Zhang, Sheng Yang

TL;DR: FPD-Drive 用可访问未来观测的教师生成多样轨迹监督，并通过安全感知评分修正筛选候选轨迹；部署时学生不需未来信息，在 NAVSIM v1/v2 达到报告的 SOTA。

Details

Motivation: 端到端自动驾驶通常只用真实驾驶日志中实际执行的一条轨迹训练，难以监督同一场景下的其他有效行为。扩大多轨迹覆盖又让从候选中安全选取变得更困难。

Result: FPD-Drive 将特权未来知识蒸馏到视觉驾驶策略。Future-Privileged Multi-Target Distillation 使用能访问记录未来观测的教师，为学生提供多样、高质量轨迹目标，扩展单一人类轨迹监督。Safety-Aware Score Correction 修正安全与不安全近邻候选之间的排序错误，并提高被低估安全候选的分数。部署时学生既不需要未来观测，也不需要教师推理。基础模型在 NAVSIM v1 navtest 达到 94.9 PDMS、NAVSIM v2 navhard 达到 55.9 EPDMS；扩展版 FPD-Drive-Pro 分别达到 95.5 和 58.1，均在所比较方法中取得 SOTA。HUGSIM 零样本闭环评测得到 HD-Score 45.1、RC 55.3。

Insight: 训练时可用未来观测构造更丰富的监督目标，但部署策略仍只依赖当下视觉信息；安全评分校正专门处理相近安全/不安全候选的误排序。基准 SOTA 仅指摘要所列比较范围。

Abstract: End-to-end autonomous driving models are typically trained on real-world driving logs, which record only the trajectory actually executed in each scene. This provides limited supervision for learning alternative valid behaviors. Multi-target supervision can mitigate this limitation, but broader trajectory coverage makes safe candidate selection more challenging. We propose FPD-Drive, an end-to-end planner that distills privileged future knowledge into a visual driving policy to improve both multi-trajectory supervision and safety selection. Specifically, we introduce Future-Privileged Multi-Target Distillation to transfer diverse, high-quality trajectory targets from a teacher with access to recorded future observations to the student. These targets extend supervision beyond the single recorded human trajectory. For candidate selection, we further introduce Safety-Aware Score Correction to correct ranking errors between nearby safe and unsafe candidates and raise underestimated safety scores of safe candidates. At deployment, the student requires neither future observations nor teacher inference. Our base model achieves 94.9 PDMS on NAVSIM v1 navtest and 55.9 EPDMS on NAVSIM v2 navhard. The scaled FPD-Drive-Pro improves these scores to 95.5 PDMS and 58.1 EPDMS, respectively, achieving SOTA performance among the compared methods on both benchmarks. Zero-shot closed-loop evaluation on HUGSIM further yields an HD-Score of 45.1 and RC of 55.3.

Chenjie Zhao, Jiangtian Nie, Jiawen Kang, Yuxu Lu, Ryan Wen Liu

TL;DR: AMGT 将可见光/红外图像、AIS 船舶信息及无人机运动几何结合，用图学习做海上船舶识别与跟踪；在 MAP-M2UAV50 上报告较高准确性和效率，摘要未给具体指标。

Details

Motivation: 无人机海上监视适合大范围、低成本交通监测，但实际环境受多模态传感、成像恶劣和无人机运动导致空间错位影响，难以保持稳定态势感知。

Result: AMGT 先用多参数透视变换对齐并融合可见光与红外图像，以改善低能见度和复杂光照下感知；AIS 消息通过插值和线性预测进行时间同步。随后用混合模态 MAir-YOLOv8-OBB 检测小型定向船舶，再由 MAir-SORT 跟踪。图学习关联网络建模船舶间以及船舶与无人机间的时空依赖，运动感知坐标统一策略 MCU 用于缓解无人机运动造成的非线性错位。在 MAP-M2UAV50 数据集上的实验被描述为准确且高效，摘要未报告检测/跟踪指标数值。

Insight: 该方案在图关联前分别处理跨光谱配准、AIS 时序同步和无人机运动坐标变化，针对不同错位来源逐步融合信息。结果目前只支持 MAP-M2UAV50 上的定性优势；不能补写检测精度或实际部署速度。

Abstract: The unmanned aerial vehicle (UAV)-based maritime surveillance is becoming an important part of maritime Internet of Things (IoT) and intelligent transportation systems. It provides a flexible and cost-effective way to large-scale maritime traffic monitoring. However, achieving robust situational awareness remains challenging in practical maritime environments. The main challenges arise from heterogeneous sensing modalities, adverse imaging conditions, and spatial misalignment caused by UAV motion. To address these problems, this paper proposes an airborne multi-modal graph learning-driven framework, termed AMGT, for vessel identification and tracking in UAV-assisted maritime IoT. Specifically, visible and infrared images are first aligned and fused through a multi-parameter perspective transformation model. This improves visual perception under low visibility and complex illumination conditions. Automatic identification system (AIS) messages are then temporally synchronized using interpolation and linear prediction. To detect small and oriented vessels, we develop a mixed-modality MAir-YOLOv8-OBB detector, followed by the MAir-SORT algorithm for stable vessel tracking. We further design a graph learning-driven association network to model temporal dynamics and spatial dependencies among vessels and between vessels and UAVs. A motion-aware coordinate unification (MCU) strategy is also introduced to reduce nonlinear misalignment caused by UAV motion. Experiments on the MAP-M2UAV50 dataset show that AMGT achieves high accuracy and efficiency. The results demonstrate its potential for UAV-assisted maritime IoT applications, including vessel monitoring, traffic situational awareness, and intelligent maritime transportation services. The dataset and code will be available at https://github.com/MAPGroup/AMGT.

[45] Jag: Direct Box Prediction for Efficient Visual Grounding cs.CVPDF

Xiuyuan Zhu, Ke Lu, Hao Wu, Zijin Du, Dongming Zhang

TL;DR: Jag 用轻量回归头从多模态模型最后一个有效 token 状态一次性预测四个框坐标，免去自回归坐标生成和文本解析；准确率优于基础模型，并以较低单请求延迟和显存达到专用方法的竞争力。

Details

Motivation: 视觉定位既要理解图文语义，也要预测几何框，但自回归多模态模型通常逐 token 输出坐标序列，给定位推理增加额外计算。直接连续预测可更匹配框的几何结构。

Result: Jag 在紧凑预训练多模态模型上增加轻量回归头，读取受图像与指代表达条件化的最后一个有效输入 token 状态，并同时预测四个边界框坐标。几何监督联合适配语言主干、视觉合并模块和回归头，使定位损失同时塑造多模态表示与坐标映射。推理仍进行图像—语言处理，但只需一次前向传播输出框，无坐标生成及文本解析。多个基准上，Jag 相较基础模型在所测目标尺寸与表达类别中持续提升 grounding 准确率；消融显示联合适配表示和回归头明显优于仅训练回归头。相对专用 grounding 模型，准确率有竞争力，同时单请求延迟和 GPU 显存更低。

Insight: 将答案结构直接匹配到连续几何框，使模型无需将框离散成文字 token 再解码。摘要未给出具体数据集分数、速度或显存数值，专用模型对比仅能概括为准确率有竞争力、资源需求较低。

Abstract: Visual grounding combines image–language understanding with geometric prediction, yet autoregressive multimodal models often express a box as a coordinate sequence. Sequential decoding adds computation to the multimodal processing needed for localization. Adapting these representations to box geometry offers a route to direct prediction. We present Jag, which adapts a compact pretrained multimodal model for direct continuous box prediction. A lightweight regression head reads the last valid input-token state, conditioned on the image and referring expression, and predicts all four box coordinates together. Geometric supervision jointly adapts the language backbone, visual merger, and regression head, allowing localization losses to shape both the multimodal representations and the coordinate mapping. Inference retains image–language processing and returns the box in one forward pass, without coordinate generation or text parsing. Across benchmarks, Jag consistently improves grounding accuracy over its base model across the observed target sizes and expression groups. Component ablation show that jointly adapting the representations and head substantially improves accuracy over training the head alone. Against existing specialized grounding models, it achieves competitive accuracy with lower single-request latency and GPU memory use. These results show how supervision tailored to the geometric answer can specialize a compact pretrained multimodal model for accurate grounding and efficient direct prediction. Project page: https://xyzzzh.github.io/Jag/

[46] Vision Transformers Learn Word Meaning from Images Alone cs.CV | cs.CLPDF

Anders Gjølbye, Sebastian Ray Mason, Stella Frank, Lars Kai Hansen

TL;DR: 研究发现仅用图像自监督预训练的 DINOv3-H/7B 能在渲染文字的视觉嵌入中形成词义结构，包括同领域词聚集、国家—首都向量关系及词与视觉对象类别对齐。

Details

Motivation: 视觉模型只看像素训练，能否学到图像中文字的语义而不只是字形特征，是理解视觉表征能力边界的问题。文本或标签监督可能让模型学到语言关系，因此需要仅图像训练的受控分析。

Result: 作者从词语图像与匹配控制图像的嵌入差异构造词表示，并控制拼写相似度，检验语义相关词是否在嵌入空间中相邻。两个最大 DINOv3 模型中，同一行业的品牌名以及同一语义域的名词会聚类；国家—首都对呈现类似文本词向量的稳定向量偏移；词表示还与其命名的视觉对象类别表示对齐。作者称 DINOv3-H 和 DINOv3-7B 是首批展现显著渲染词语义结构的自监督视觉模型。与文本、语音编码器的比较发现同词表示间存在共享结构；用其中任一编码器进行对比对齐能进一步增强 DINOv3-H 词级语义结构，而其他微调视觉模型变化不大。

Insight: 像素自监督可能通过视觉共现和字形/语义统计，在词图像表征中形成可测的概念关系；结果说明模型不只编码文字外观。语义分析针对渲染词、所用 DINOv3 模型和控制方法，不能直接等同于模型具备一般语言理解能力。

Abstract: Can a vision model learn what words mean from pixels alone? We show that the two largest DINOv3 vision transformers organize words rendered in images by word meaning, despite being pretrained using self-supervision on images only, without paired captions, class labels, or other language supervision. We derive word representations from embedding differences between word images and matched controls, then test whether semantically related words are neighbors within each model’s embedding space, while controlling for spelling similarity. We find that brand names in the same industry group together, as do nouns from the same semantic domain. Country-capital pairs exhibit consistent vector offsets, similarly to word embeddings trained on text. These word representations also align with the representations of the visual object categories they name. DINOv3-H and DINOv3-7B are, to our knowledge, the first self-supervised vision models to show substantial semantic structure for rendered words. Comparisons with text and speech encoders reveal shared structure among representations of the same words. Contrastive alignment with either encoder further strengthened DINOv3-H’s word-level semantic structure, while leaving the other finetuned vision models largely unchanged. Image-only training can therefore teach vision models not just what words look like, but also how their meanings relate.

[47] Beyond a Single Crop: Contextualized Embeddings for Player Re-Identification cs.CVPDF

Ge Luo, Changhuo Yang, Weisi Fan, Rui Yang, Shaokai Wang

TL;DR: ContextReID 将同帧队友和跨帧观察作为上下文生成球员身份嵌入；在三个多目标跟踪基准上，Rank-1 和 mAP 均优于单裁剪嵌入方法。

Details

Motivation: 广播体育视频中的同队球员外观常相似，但同一球员会在视频中以不同视角和周边场景反复出现。传统重识别只从单人裁剪学习身份特征，忽略了可用于区分相似球员的空间和时间上下文。

Result: ContextReID 将同一帧中其他球员以及广播序列其他帧的观察一并纳入身份表示，通过视觉语言模型对一组球员裁剪输入，为单个球员生成上下文感知嵌入。联合上下文学习与检索目标促使模型捕捉跨帧身份关系，同时维持匹配所需的区分性。在三个多目标跟踪基准上的实验中，ContextReID 相较常规单裁剪嵌入，在 Rank-1 和 mAP 上均有提升；摘要未提供各基准具体分数。

Insight: 身份线索不只存在于个体外观，还可由同帧共现关系和序列重复观察补足。评测支持广播体育视频中使用上下文提升检索，但摘要未报告不同场景、遮挡或队服相似度条件下的收益幅度。

Abstract: Person re-identification is typically addressed by learning identity-discriminative embeddings from individual person crops. However, player re-identification in broadcast sports videos presents a unique challenge: players from the same team often share similar appearances, while video sequences provide repeated observations of the same players under different viewpoints and surrounding contexts. Existing crop-based approaches largely ignore this contextual information, which can be critical for resolving visually similar identities. Here, we propose ContextReID, a contextualized embedding framework that represents a player by jointly considering other players in the same frame and observations from different frames of the broadcast sequence. By incorporating both co-occurring players and cross-frame observations, the model learns identity features relative to the surrounding visual context rather than relying only on isolated appearance cues. We implement this framework with a vision-language model that takes sets of player crops as input and generates context-aware embeddings for individual players. A combined contextual learning and retrieval objective encourages the model to capture cross-frame identity relationships while maintaining discriminative embeddings for player matching. Experiments across three multi-object tracking benchmarks show that ContextReID improves player retrieval over conventional single-crop embedding approaches in both Rank-1 and mAP. These results highlight the utility of spatial and temporal context for reliable player identification in broadcast sports videos.

[48] Deep Learning Approach for RealTime Contraction Detection in Laboring Dairy Cattle cs.CVPDF

Sebastian Puchala, Dominik Gronkiewicz, Marcin Gołębiewski, Grzegorz Grodkowski, Grzegorz Gwardys

TL;DR: 研究用 100 次奶牛分娩视频构建产犊宫缩识别数据集，包含 8,500 个宫缩动作和约 25,000 段非宫缩序列；CNN/ViT 方法报告检测准确率超过 95%。

Details

Motivation: 畜牧业需要自动监测动物行为和健康，以便及时发现难产相关情况。产犊期间的宫缩若能通过视频实时识别，可为及时干预提供信号。

Result: 作者采集 100 次奶牛分娩视频，提取 8,500 个宫缩动作和约 25,000 段非宫缩序列作为数据集。方法使用图像处理及 CNN、Vision Transformer 等深度学习模型，从视频帧提取特征并分类宫缩与非宫缩。研究报告宫缩检测准确率超过 95%，并指出该系统有望用于乳业实时监测和难产干预。摘要未说明按动物或视频划分的评测方式、其他分类指标或外部验证情况。

Insight: 该工作提供产犊视频识别的可行性证据和较大数量的事件片段，但超过 95% 的准确率需要结合类别平衡、切分粒度和跨个体验证方式解读。摘要没有披露这些细节，不能推断真实部署下的灵敏度或误报率。

Abstract: Currently, the animal production sector is undergoing rapid development of techniques that allow automatic monitoring of animal behaviour and health. This paper presents a computer vision-based approach for the automatic recognition of labor contractions in cows. During the course of the study, videos depicting 100 cow births were collected. From the obtained videos, 8500 cow contraction actions and about 25 000 non-contraction sequences were extracted which constituted the dataset. Leveraging image processing techniques and deep learning algorithms like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), our methodology extracts relevant features from video frames to detect and classify contractions. Our study demonstrates a high accuracy rate of over 95% in detecting labor contractions. This automated system has the potential to enhance productivity and animal welfare in the dairy industry by providing real-time monitoring and facilitating timely intervention during difficult calvings. The video demonstration of the system can be found at the following URL: https://www.youtube.com/watch?v=8fTSG5D7dZ0

[49] SheafPrune: Sheaf-Guided Graph Propagation for Visual Token Pruning cs.CVPDF

Xiaoyang Ma, Chi Wang, Hong Sun

TL;DR: SheafPrune 用模态特定映射和稀疏文本—视觉图传播相关性，再在视觉图上做度数校正和 top-k 保留；LLaVA-NeXT 保留 10% token 时 prefill 净加速 5.15×。

Details

Motivation: 多模态大模型处理完整视觉 token 序列会增加 prefill 开销，许多 token 与指令无关。单 token 显著性难以表达 token 之间的依赖；图选择的效果则取决于关系如何传播重要性及节点度数如何影响排序。

Result: SheafPrune 采用受 sheaf 几何启发的支持约束传播：先用模态特定映射和稀疏文本—视觉图传递相关性，再在独立视觉图上继续传播并按节点度数校正。剪枝器在冻结语言模型前一次性保留硬 top-k 子集，约 4.5M 参数，通过冻结 LLaVA-NeXT-8B 主干上的语言建模目标端到端训练。显式条件化保留率使单个检查点可覆盖不同预算。四个主干、十个基准和七种剪枝率的统一基线重实现评测中，SheafPrune 在 28 个“主干—预算”组合里的 22 个保持效果最佳；中度到激进剪枝时优势随压缩加大。在 LLaVA-NeXT 上保留 10% 视觉 token，prefill 净加速 5.15×，端到端 FLOPs 减少 84.0%。

Insight: 图关系传播和度数校正共同避免重要性仅由局部显著性或高连接度决定，并可用单一模型适配不同 token 预算。22/28 的领先统计与特定统一评测协议有关；10% token 结果专指 LLaVA-NeXT。

Abstract: Multimodal large language models process the complete visual token sequence, increasing prefill cost even when many tokens are irrelevant to the instruction. Token-wise saliency captures limited inter-token dependence; graph-based selection instead depends on how relations govern importance propagation and ranking. We study support-constrained propagation with node-degree correction. Inspired by sheaf geometry, SheafPrune uses modality-specific maps and a sparse text–visual graph to transfer relevance, then propagates scores on a separate visual graph and corrects them for degree. It retains a hard top-$k$ subset once before the frozen language model. The selector has about $4.5$M parameters and is trained end-to-end through the frozen LLaVA-NeXT-8B backbone using only the language-modeling objective. Explicit retention-ratio conditioning lets one checkpoint serve every budget. Across four backbones, ten benchmarks and seven pruning ratios, with all baselines re-implemented under one protocol, SheafPrune achieves the best retention at $22$ of $28$ backbone–budget settings, with monotonically growing margins in the moderate-to-aggressive regime. On LLaVA-NeXT, retaining $10%$ of visual tokens yields a $5.15\times$ net prefill speedup and an $84.0%$ end-to-end FLOPs reduction. Together with component ablations, these results support graph-constrained importance propagation and degree correction as a design for visual token selection across the evaluated backbones and tokenization schemes, improving the trade-off between accuracy retention and inference cost. code:https://github.com/Bob0817912/SheafPrune_ICLR_2027

[50] CV-OPD: Contrastive Vision On-policy Distillation cs.CV | cs.LG | cs.MMPDF

Haowei Wang, Hao Lin, Qi Zhu, Jiayi Ji, Deyi Ji

TL;DR: CV-OPD 通过正负图像裁剪下的教师分布对比，补足 on-policy 蒸馏缺少视觉约束的问题，减少学生只凭答案提示走捷径；多个细粒度视觉基准上视觉推理能力得到改善。

Details

Motivation: On-policy distillation 能从教师输出为 VLM 学生提供密集监督，但作者发现学生即使相关图像区域被遮挡或加噪仍能答对，说明它可能没有真正利用视觉证据。理论分析将此归因于蒸馏中视觉约束不足，使学生能够依赖答案提示等捷径。

Result: Contrastive Vision OPD（CV-OPD）在相同学生前缀下比较正向和负向图像裁剪诱导的教师分布，并添加间隔式对比约束。方法引入与答案无关的负教师及 Contrastive Divergence Loss，以正负教师对比约束学生特征分布；再用 Discrepancy Aware Gate 根据 token 级和样本级差异选择与视觉相关的 token 参与优化，从而校正学生对视觉区域的利用。多个细粒度视觉基准实验显示，CV-OPD 能显著缓解捷径行为，并持续提升现有 VLM 的视觉推理能力；摘要未给出具体分数。

Insight: 只匹配答案输出分布不保证学生建立视觉 grounding；用正负裁剪产生的教师差异提供显式视觉约束，可让训练信号指向证据相关 token。摘要报告多基准定性收益，但未说明增益幅度或模型/数据集列表。

Abstract: On-policy distillation (OPD) reveals versatility and convenience during VLM post-training, providing dense supervision for student from teacher. However, we observed an anomaly that the distilled VLM could still answer the questions accurately even when the related visual regions were masked or replaced with noise. Building on this observation, our quantitative and qualitative experiments demonstrate that OPD, which uses the answer as a hint, has failed to teach students to genuinely seek out and rely on visual evidence. Our theoretical analysis suggests that this failure arises from a shortcut enabled by the lack of visual constraints during distillation. To address the issue, we introduce Contrastive Vision On-policy Distillation (CV-OPD), which compares teacher distributions induced by positive and negative crops while conditioning on the same student prefix and augments optimization with a margin-based contrastive constraint, which is modulated with discrepancy gating across token and sample level. Specifically, CV-OPD first introduces a negative teacher unrelated to the answer and designs a Contrastive Divergence Loss (CDL) that constrains the feature distribution of student by contrasting the positive and negative teachers, correcting how the student exploits visual regions. The CV-OPD introduces a Discrepancy Aware Gate (DAG) that uses token-level and sample-level discrepancies to select visually relevant tokens for optimization, directing the student’s attention toward visual content. Extensive experiments across a broad range of fine-grained visual benchmarks demonstrate that CV-OPD substantially alleviates shortcut and consistently improves the visual reasoning capabilities of existing VLMs.

[51] OWLET: On-Policy Weighted Learning via Evidence Transfer for Video Large Language Model Post-Training cs.CVPDF

Qitan Lv, Ke Fan, Hong Wang, Wen Wu, Yilin Wang

TL;DR: OWLET 用含全局上下文和问题相关局部窗口的教师视图，为视频推理 RL 提供证据特权监督，并重分配 token 信用、对齐时空状态；摘要只给出方法动机，未包含实验结果。

Details

Motivation: 视频大模型后训练常用 RL 或 on-policy distillation，但两者对视觉证据的利用有限：RL 将同一条回答级奖励均摊到所有 token，忽略各 token 对视觉证据的依赖程度；OPD 虽提供 token 级输出分布监督，却没有直接约束产生输出的时空表示。作者观察到全局时间信息与问题相关细节结合时，同一模型回答更准确。

Result: OWLET 从更丰富的教师视图中提取训练信号，该视图将均匀全局上下文与问题条件化的局部窗口结合，无需更大教师模型。Evidence-aware Credit Redistribution 比较两种视图下的 token 似然，根据相对证据支持度重分配正的回答级优势；Spatiotemporal State Alignment 则在验证器接受的回答上对齐两种视图的隐藏状态。给定摘要在方法描述处结束，没有提供基准、对比方法或结果数值，因此不能补述其实际效果。

Insight: 该方法尝试把视觉证据的局部差异转化为细粒度 RL 信用分配，并以隐藏态对齐补足输出蒸馏的不足。当前可用摘要仅支持机制描述，不足以确认性能提升或效率变化。

Abstract: Post-training has become a key stage for eliciting reasoning capabilities in Video Large Language Models (Video-LLMs). Existing post-training methods mainly follow two paradigms: reinforcement learning (RL) and on-policy distillation (OPD). However, they do not fully exploit visual evidence for effective training. RL supervises the policy with a single trajectory-level reward, which is too coarse-grained for video reasoning: the same response-level advantage is applied to every generated token, disregarding that the tokens of a video response are grounded in the visual stream to very different degrees. OPD provides token-level supervision through output-distribution matching, but lacks direct supervision of the spatiotemporal representations that produce those outputs. We observe across extensive experiments that the same model reasons more accurately when its video view combines global temporal context with question-relevant details. Comparing the same student-generated response under this view and uniform sampling reveals changes in token likelihoods and internal representations, providing a training signal for evidence use. Building on this observation, we propose OWLET, an evidence-privileged RL method that derives training signals from a richer teacher view. This view couples uniform global context with question-conditioned local windows, providing visual evidence without requiring a larger model. To better exploit this privileged visual evidence, OWLET introduces (i) \textbf{evidence-aware credit redistribution}, which compares token likelihoods across the two views and redistributes positive response-level advantages according to their relative evidence support; and (ii) \textbf{spatiotemporal state alignment}, which aligns the two views’ hidden states on verifier-accepted responses.

[52] Decoding Register Tokens Preserves Global Scene Details cs.CV | cs.LGPDF

David Jacob Drexlin, Julius Hense, Jonas Dippel

TL;DR: 保留视觉 Transformer 的四个 register token 可改善图像重建；ImageNet-1K 上 DINOv2/DINOv3 ViT-B 的重建 FID 分别降至 0.472/0.442，DINOv2 生成 FID 降低 9.8%。

Details

Motivation: 预训练 ViT 除空间 patch token 外还学习非空间 register token，已有研究认为它们编码光照、模糊和风格等全局属性。常见 patch 解码器丢弃这些信息，只靠 patch 重建外观，可能遗漏全局场景细节。

Result: 研究使用带 register token 的冻结编码器构造表示自编码器，让解码器通过联合自注意力同时处理四个 register token 和全部 patch token；并用外观探针、成对重建误差分析及固定解码器下的 register 替换研究其作用。生成时训练多头注意力池化预测器从采样 patch 恢复 register 特征，不改扩散模型或其样本。在 ImageNet-1K 上，ViT-B+DINOv2 的平均重建 FID 为 0.472，较仅 patch 基线降低 9.5%；DINOv3 为 0.442，降低 5.2%，对应 PSNR 分别为 19.73 和 20.54 dB。生成任务中，DINOv2 模型平均 FID 为 1.641，在相同采样 patch 下较仅 patch 基线低 9.8%。

Insight: 全局 register 特征为已有空间 patch 表示补充场景外观信息，可同时改善重建与从固定采样 patch 进行的生成。量化结果限定于 ImageNet-1K、ViT-B 和指定 DINO 编码器/基线。

Abstract: Pretrained vision transformers learn structured image representations spanning spatial patch tokens and non-spatial tokens. Recent analyses suggest that non-spatial register tokens encode global scene properties such as illumination, blur, and style. Yet patch-based image decoders discard these outputs, leaving the decoder to recover image appearance from patches alone. We investigate whether retaining register features improves decoding when the complete spatial patch representation is already available. We study this question using representation autoencoders (RAEs) with frozen register-equipped encoders. Our decoder processes four register tokens together with all patch tokens through joint self-attention. Appearance probes, paired reconstruction-error analysis, and fixed-decoder register substitutions examine which global image properties are accessible from registers and how their values affect reconstructed pixels. For generation, we train a multi-head attention pooling (MHAP) predictor to recover register features from sampled patches, keeping the pretrained diffusion model and its samples unchanged. On ImageNet-1K, our ViT-B decoders achieve mean reconstruction FIDs of 0.472 with DINOv2 and 0.442 with DINOv3, reductions of 9.5% and 5.2% relative to their respective patch-only baselines. The corresponding PSNRs are 19.73 and 20.54 dB. For generation, our DINOv2 models achieve a mean FID of 1.641, 9.8% below the patch-only baseline on identical sampled patches.

[53] Sonic-AMG: Streaming Human Motion Generation from Spatial Audio cs.CV | cs.GR | cs.LG | cs.RO | cs.SDPDF

Jingcheng Ni, Zekun Li, Zhiyang Dou, Xiaoyan Cong, Ziyao Zeng

TL;DR: Sonic-AMG 从空间音频流式生成人体运动，用 rehearsal training 缓解训练时教师强制与推理自回归历史不匹配，并以生成根姿态更新相对声源位置；在 SAM 上取得 SOTA FID 和 R-precision。

Details

Motivation: 由空间音频生成运动既需理解声音内容，也需估计声源相对于身体的位置。已有方法多依赖完整音频与空间序列离线生成，而真实的人类反应必须在不知道后续声音的情况下在线产生。

Result: Sonic-AMG 将声音内容和身体相对声源几何分别编码为 token，由带 flow head 的因果 Transformer 生成连续运动潜变量，再由因果解码器恢复运动片段。标准教师强制训练使用真实运动历史和相对声源位置，但流式推理改用模型生成历史，造成训练—推理偏移。rehearsal training 将全序列教师强制监督与短程自回归自生成预测结合，以降低历史差异；spatial feedback 则在 rehearsal 训练和推理时都根据生成根姿态重新计算身体相对声源位置。在 SAM 基准上，作者报告 FID 和 R-precision 达到 SOTA，并支持跨声音事件与声源位置实时生成连贯反应。

Insight: 让训练也经历短程自生成状态，并在训练和推理中一致更新声源相对坐标，分别应对历史分布偏移和空间条件漂移。摘要没有给具体分数或帧率，SOTA 限于 SAM 基准及所比较方法。

Abstract: Modeling human reactions to spatial audio requires understanding both what is heard and where it comes from. Prior work generates motion offline from complete acoustic and spatial input sequences. Humans, however, react to sounds without knowing what they will hear next. We present Sonic-AMG, to our knowledge the first framework for streaming human motion generation from spatial audio. The model encodes acoustic content and body-relative source geometry as separate tokens. Conditioned on these tokens, a causal transformer with a flow head generates continuous motion latents, from which a causal decoder reconstructs motion segments. Standard teacher-forced training derives motion histories and body-relative source locations from ground-truth motion, whereas streaming inference relies on generated motion for both, resulting in a training-inference mismatch. To reduce this history discrepancy, we introduce rehearsal training, which combines full-sequence teacher-forced supervision with supervised prediction along short autoregressive self-rollouts. To keep spatial conditioning consistent with generated motion, we propose spatial feedback, which recomputes body-relative source locations from generated root poses during both rehearsal training and inference. On SAM, Sonic-AMG achieves state-of-the-art FID and R-precision. It further supports real-time online generation of coherent reactions across sound events and source locations. Project page: https://jingchengni.com/sonic-amg/.

[54] PAGE: Parts-Aware Guidance for Co-Speech Gesture Portrait Video Generation cs.CVPDF

Yabiao Wang, Jiafu Wu, Yicheng Xu, Teng Hu, Shengzhe Zhou

TL;DR: PAGE 在训练时对嘴唇、眼睛、手部等区域加权，并在推理时进行一致性与分区运动引导，提升语音驱动肖像视频的细节和音画对齐；作者构建中文播报数据集 CAS。

Details

Motivation: 语音驱动的同说话手势视频生成需从一张参考图和语音生成肖像视频。扩散方法虽提升整体视觉质量，但局部细节易退化，手势和面部动作也可能与音频错位。

Result: PAGE 是不依赖特定主干的优化框架，同时作用于训练目标和去噪轨迹。Parts-Specific Reweighting（PSR）在训练时自适应提高嘴唇、眼睛、手等感知关键区域的监督权重；推理时 Consistency Classifier Guidance（CCG）使用音频条件潜变量分类器识别并修正音画不一致，Differential Guidance（DG）分别优化面部和身体运动以减少跨区域干扰。作者构建 Chinese Announcer Speech（CAS），称其为首个全面中文同说话手势肖像视频基准，相比 PATS 包含更多身份、视频片段和场景多样性。在 PATS 和 CAS 上，PAGE 在感知质量、手势多样性及音画对齐方面达到所比较方法中的 SOTA；摘要未列具体数值。

Insight: 训练时强化局部关键区域、推理时纠正音画一致性并解耦脸部/身体运动，分别处理细节与整体对齐问题。性能结论覆盖 PATS 和新建 CAS，摘要未报告分项提升幅度。

Abstract: Co-speech gesture video generation aims to synthesize realistic, audio-driven portrait videos from a single reference image and a speech signal. Despite advances in visual quality, diffusion-based approaches still suffer from degraded local details and imperfect audio-visual alignment. We present PAGE (Parts-Aware GuidancE), a general, backbone-agnostic optimization framework for diffusion-based generation that enhances local spatial fidelity and global audio-visual consistency at both the training-objective and denoising-trajectory levels. During training, we propose Parts-Specific Reweighting (PSR), which adaptively increases supervision in semantically important regions such as lips, eyes, and hands, improving visual fidelity in perceptually critical areas. During inference, we introduce Consistency Classifier Guidance (CCG), an audio-conditioned latent classifier that identifies and corrects audio-visual inconsistencies in the generated video. We further design Differential Guidance (DG), an efficient inference strategy that refines facial and body motion separately while avoiding cross-region interference. To enable large-scale evaluation, we construct the Chinese Announcer Speech (CAS) dataset, the first comprehensive Chinese benchmark for co-speech gesture portrait video generation. Compared with the widely used PATS dataset, CAS includes substantially more identities, video clips, and scene diversity. Extensive experiments on both PATS and CAS demonstrate that PAGE achieves state-of-the-art performance in perceptual quality, gesture diversity, and audio-visual alignment. Project page: https://aigc-explorer.github.io/PAGE/.

Georgios Floros, Evangelos Sartinas, Orestis Vangelis, Maria Pateraki

TL;DR: NovaSplat 用手机短视频在线 onboarding 构建新物体的 3D Gaussian 模型，同时作为检测/粗定位模板和可微精定位底座；Lite 推理版快 3.1×且准确率损失很小。

Details

Motivation: 没有 CAD 模型的新物体 6D 姿态估计仍很困难。免模型方法需在 onboarding 阶段从头建立物体表示，过去性能长期落后于基于模型的方法。

Result: NovaSplat 从 onboarding 时采集的短手机视频训练 3D Gaussian Splatting 表示，用作检测模板和粗姿态估计依据，也作为可微精化主干。精化器用光度和几何损失优化物体到相机的姿态，并采用无梯度奇异性的连续旋转参数化。在家居物体基准上，NovaSplat 超过所有比较的基于模型方法；在包含无纹理和镜面表面的困难工业基准上，超过所有免模型竞争者并显著缩小与基于模型方法的差距。NovaSplat-Lite 推理变体速度提升 3.1×，准确率代价很小。

Insight: onboarding 得到的可微 3D 表示兼具模板检索和姿态优化用途，弥合免模型方法在困难物体上的性能差距。Lite 速度是相对主方法的提升；摘要未给家居/工业基准分数及“可忽略”精度损失的具体值。

Abstract: 6D pose estimation of novel objects without CAD models remains an open challenge: model-free methods must build the object representation from scratch during onboarding and have long trailed their model-based counterparts. We present NovaSplat, a model-free pipeline that closes this gap. From a short smartphone video captured at onboarding, we train a 3D Gaussian Splatting (3DGS) model that serves both as a template source for detection and coarse pose estimation and as a differentiable backbone for pose refinement. Our refiner optimizes the object-to-camera pose with combined photometric and geometric losses under a continuous rotation parametrization free of gradient singularities. On a household-object benchmark, NovaSplat surpasses all model-based methods. On a challenging industrial benchmark with textureless and specular surfaces, it outperforms all model-free competitors while substantially narrowing the gap to model-based ones. We further introduce NovaSplat-Lite, an inference variant that is $3.1\times$ faster at negligible accuracy cost. Code will be made available at \href{https://github.com/POSE-Lab/novasplat}{https://github.com/POSE-Lab/novasplat}.

[56] LETHE: Defending against Unauthorized Image-to-Video Generation via Value Diversity Collapse cs.CV | cs.CRPDF

Boheng Li, Yueming Xing, Yiming Li, Jie Zhang, Tianwei Zhang

TL;DR: LETHE 通过压缩图像 I2V 模型读取的参考值向量分布并吸引后续帧关注这些塌缩 token，主动降低未经授权图生视频的身份/视觉忠实度；多模型实验报告保护效果领先。

Details

Motivation: 图像到视频扩散模型可以把单张参考照片变成高质量且主体一致的视频，可能被用于未经同意地制作个人影像。发布前给图像加入对抗扰动是主动防护思路，但既有方法在常见扰动预算下保护有限，原因是模型如何读取参考图尚未充分理解。

Result: 作者通过凸几何分析将参考图 value 向量的分散程度识别为后续帧读取参考图的关键因素，并实验发现轻微收缩该分散度即可显著破坏生成视频。LETHE 结合两个目标：Value Collapse 将参考 value 向量推向均匀化，Attention Attraction 则促使后续帧注意这些被压缩的 token，以放大视觉破坏效果。作者还构建两个以人为主体的 I2V 防护基准，并在多个现代 I2V 模型上实验，报告其保护效果达到 SOTA 且适用性广；摘要未提供扰动强度、成功率或用户感知指标。

Insight: 防护针对的是 I2V 模型读取参考图的内部机制，通过削弱参考 value 的多样性而非仅局部像素扰动来降低主体一致生成。结果是针对未经授权生成的主动保护评测；摘要未量化保护强度或合法场景下的副作用。

Abstract: Image-to-video (I2V) diffusion models can animate a single reference image into high-quality, subject-consistent videos, posing threats of misuse as anyone can turn personal photos into fabricated videos without consent. A promising solution is to proactively add an adversarial perturbation to the image before release, such that videos generated from it would be unfaithful or visually corrupted. However, due to an insufficient understanding of what governs how subsequent frames read the reference image in modern I2V models, existing protections struggle to offer strong protection under common perturbation budgets. In this paper, we approach the problem by exploring this underlying reading mechanism. Through a convex geometric analysis, we theoretically identify the spread of the reference value vectors as a key factor governing this reading process, and empirically find that even a mild contraction of this spread can severely degrade the generated video, making it an efficient lever for protection. Guided by this insight, we propose LETHE, a novel protection method that directly disrupts this reading process. LETHE pairs two complementary objectives, where a value collapse objective drives the reference value vectors toward uniformity, while an attention attraction objective draws subsequent frames toward these collapsed tokens to amplify corruption. We further construct two human-centric I2V protection benchmarks and conduct extensive experiments with multiple modern I2V models, which demonstrate the state-of-the-art protection performance and versatility of LETHE.

[57] ThinkDrag: Semantic Drag-Based Image Editing with Visual Reasoning cs.CVPDF

Armando Fortes, Tianyi Wei, Chindanai Trakantannarong, Shangchen Zhou, Xingang Pan

TL;DR: ThinkDrag 将拖拽点约束解释为对象/场景级语义变化，并用端点标记显式提供图像对应关系；在 DragBench++ 等实验中达到 SOTA 级生成质量与合理性，同时保持有竞争力的点跟随精度。

Details

Motivation: 拖拽式编辑让用户指定起点和目标点来控制图像空间变化，但现有方法常把拖拽当作简单几何位移。当修改需要结合图像内容推断合理语义变化时，稀疏点约束信息不足。

Result: ThinkDrag 是统一多模态拖拽编辑框架，训练模型将点约束关联到有意义的对象级和场景级变换，并可选择生成显式推理轨迹，解释预期编辑，特别用于消歧。基于跨图注意力分析提出 Drag Endpoint Markers，为每条拖拽在图像空间提供显式对应信号。作者构建配有推理轨迹的语义拖拽变换监督数据集，并发布包含挑战性任务及参考编辑结果的 DragBench++。实验显示，ThinkDrag 达到所比较方法中的 SOTA，生成质量和合理性提升，同时点跟随精度仍有竞争力；摘要未给具体数值。

Insight: 拖拽端点仅定义几何约束，模型还需推断用户想要的语义变化；显式端点标记和可选推理轨迹为对应关系与意图解释提供支持。当前摘要报告综合比较结论，但未列具体基准分数或跟随误差。

Abstract: Drag-based image editing provides an intuitive interface for spatially controlled image manipulation by allowing users to specify handle and target points. Existing methods have made substantial progress through optimization-based, one-step, and feed-forward formulations, but they often interpret drag instructions as geometric displacements. This limits their effectiveness when the desired edit depends on interpreting image content and inferring a plausible semantic transformation from sparse point constraints. We introduce ThinkDrag, a unified multimodal framework for drag-based image editing with visual reasoning. ThinkDrag is trained to associate point constraints with meaningful object- and scene-level transformations, and can optionally produce an explicit reasoning trace that interprets the intended edit before image generation. This reasoning trace improves interpretability, particularly for ambiguous drags. Drag Endpoint Markers, motivated by an analysis of cross-image attention, provide an explicit correspondence signal that grounds each drag in image space. To support this framework, we construct a supervised dataset of semantic drag transformations paired with reasoning traces and introduce DragBench++, a benchmark targeting challenging drag-based editing scenarios with reference edit solutions. Experiments show that ThinkDrag achieves state-of-the-art performance, improving generation quality and plausibility while maintaining competitive point-following precision.

[58] VideoAWR: Reinforcing Video Flow Models with Decoupled-Timestep Advantage-Weighted Rectification cs.CVPDF

Zheming Fu, Wenbin Ning, Ruizhe He, Wei Shang, Xiaoxiao Ma

TL;DR: VideoAWR 用 EMA 策略生成受 CFG 引导的高保真 rollout，同时以无 CFG 条件分布作为优化锚点，避免视频流模型的冷启动退化和引导爆炸；Wan2.1 1.3B/14B 实验显示视觉与运动质量改善。

Details

Motivation: 视频流模型的回归式 RL 通常要求无 CFG 采样，使回归目标匹配参考边际速度，但无引导 rollout 可能落入低保真区域，组内奖励差距不再代表感知质量。若改用 CFG rollout 又把目标绑定在引导分布上，EMA 更新可能导致引导几何放大。

Result: VideoAWR 将采样分布与优化锚点解耦：EMA 参考策略使用 CFG 产生高保真 rollout，训练策略则对无 CFG 条件锚点做优势加权修正。论文证明该目标数学上精确：中心化优势在期望中抵消锚点，过滤掉与奖励无关的引导偏移，仅保留奖励相关协方差增量。因此训练后单分支无 CFG 推理仍可保持测试时 CFG 原有语义。另提出 Decoupled Timestep Rectification，每条 rollout 独立采样监督时间步以提升样本效率且不引入偏差。Wan2.1-1.3B 和 14B 实验报告优化稳定，并在启用和不启用 CFG 两种设置下提升视觉及运动质量。

Insight: 引导用于获得可区分奖励的高保真训练样本，而优化目标仍锚定无引导条件分布，从而化解采样质量与目标分布之间的冲突。摘要未提供 FID、运动指标或效率数字；理论保证针对文中解耦目标。

Abstract: Regression-based RL for flow models mandates sampling \emph{without} classifier-free guidance (CFG) to align the rectification target with the reference marginal velocity. Extending Advantage-Weighted Rectification (AWR), which dynamically scales this regression target based on reward, to video generation encounters a cold-start pathology: unguided rollouts collapse into low-fidelity regions where intra-group reward gaps remain wide but no longer track perceptual quality, rendering the optimization target arbitrary. Conversely, utilizing guided rollouts to restore fidelity, while keeping the regression target tied to the guided sampling distribution, provably triggers a geometric guidance blow-up under exponential-moving-average (EMA) updates. We propose \textbf{VideoAWR}, which resolves this tension by untying sampling from the optimization anchor. An EMA reference policy generates \emph{guided} rollouts to restore reward separability, while the trainable policy is rectified against the \emph{unguided} conditional anchor. We prove this decoupled objective is mathematically exact: the centered advantage cancels the anchor in expectation, filtering out the reward-neutral guidance offset and retaining only the reward-correlated covariance increment. Consequently, inference runs single-branch and CFG-free, yet inference-time CFG preserves its original semantics. Furthermore, we introduce \emph{Decoupled Timestep Rectification}, supervising each rollout at an independently sampled timestep without bias to improve sample efficiency. Experiments on Wan2.1-1.3B and 14B demonstrate stable optimization and superior visual and motion quality in \emph{both} CFG-free and CFG-enabled regimes. Code is available at \pdfstartlink attr{/Border [0 0 0]} user{/Subtype /Link /A << /S /URI /URI (https://github.com/Fuzm7/FlowAWR) >>}% \textcolor{pearDark}{VideoAWR}\pdfendlink.

[59] CoVA: Composing VAE Representations for Generative Learning cs.CVPDF

Zhaowei Chen, Yikai Ge, Linze Li, Yao Tang, Xiang Li

TL;DR: CoVA 在线组合 VAE 特征形成语义和空间结构引导，并校正软标签嵌入平均造成的条件强度混淆；ImageNet 256² 上 SiT-XL/2 的 FID 从 17.2 降至 7.4。

Details

Motivation: 预训练视觉编码器表示能改善扩散 Transformer 训练，但依赖额外编码器并增加训练成本。直接使用生成模型 VAE 特征更轻量，却因面向重建而缺少生成学习所需的语义区分性和空间结构。

Result: CoVA 联合训练轻量 latent composer，使用类别监督、掩码潜变量重建和水平翻转一致性，在线将 VAE 特征组合成分阶段引导信号，并生成样本相关类别后验。训练早期将 SiT 中间特征与组合表示对齐，随后移除逐渐有害的对齐，转用 composer 的分离后验进行样本自适应软标签条件化。作者还指出软标签平均类别嵌入会缩小范数，使语义插值与条件强度混淆；单是减小条件强度就可能降低 FID 却损害 Recall。CoVA 通过恢复硬标签范数隔离后验方向的语义作用。方法增加 8.5M 仅训练用参数（SiT-XL/2 的 1.3%），无推理开销。在 ImageNet 256×256 上 400K 步，FID 从 17.2 降至 7.4（57%）；使用 CFG 时，400 个 epoch 达到 FID 2.03，而原始 SiT-XL/2 用 1,400 epoch 得 2.06。

Insight: 除了引入辅助表征，软标签条件的范数变化本身也会影响 FID，因此必须分离语义方向与条件强度。CoVA 报告在 ImageNet 256² 的显著质量/训练效率收益，8.5M 参数只在训练时使用。

Abstract: Representation alignment with pretrained visual encoders improves diffusion transformer training but requires auxiliary encoders and extra training overhead. Recent approaches instead exploit representations from the generative model’s own variational autoencoder (VAE). However, reconstruction-oriented VAE features are not optimized for the semantic discrimination and spatial structure needed for generative learning. We introduce \textbf{CoVA} (\textbf{Co}mposed \textbf{VA}E Representations), a lightweight framework that composes VAE features online into stage-wise guidance for flow-matching training. A small latent composer is jointly trained with class supervision, masked latent reconstruction, and horizontal-flip consistency, yielding semantically discriminative, spatially structured dense features and sample-dependent class posteriors. CoVA aligns intermediate SiT features with the composed representations early in training, then removes the increasingly detrimental alignment and reuses detached composer posteriors for sample-dependent soft label conditioning. We further uncover a hidden confound in soft label conditioning: averaging class embeddings attenuates their magnitude, coupling semantic interpolation with conditioning strength. This attenuation alone can substantially improve FID while degrading Recall, revealing a non-semantic source of the apparent gain. CoVA corrects this confound by restoring the hard-label magnitude, isolating posterior-dependent directional semantics. CoVA adds only 8.5M training-only auxiliary parameters (1.3% of SiT-XL/2) and introduces no inference-time overhead. On ImageNet 256$\times$256, CoVA reduces SiT-XL/2 FID from 17.2 to 7.4 (\textbf{57%}) in 400K steps. With classifier-free guidance, it achieves an FID of \textbf{2.03} in only 400 epochs, versus 2.06 after 1,400 epochs for vanilla SiT-XL/2.

[60] Why DiT Models Underperform as Representation Learners without Long Skip Connections cs.CVPDF

Benyuan Meng, Yiliang Zhang, Jin-Wen Wu, Qianqian Xu, Qingming Huang

TL;DR: 受控从头训练表明 DiT 的长跳连可改善扩散特征质量：它把扩散噪声信息直接传到输出端，减轻主干图像表示被噪声污染，从而提升生成与理解统一所需的特征。

Details

Motivation: 扩散模型中间特征可用于统一图像生成与判别理解，但已有研究发现 DiT 虽生成能力强，表征质量却偏弱。作者考察长跳连是否影响该问题，以及其作用机制是否与扩散训练目标相关。

Result: 通过受控从头训练，作者发现带长跳连（LSC）的 DiT 能产生更好的视觉特征。机制分析指出，扩散主干输入含潜变量图像和噪声；噪声变量实际编码扩散轨迹信息，而预测 v 或 ε 需要同时使用这两类信号。若两者都通过主干传播，噪声会污染图像信号；LSC 可将扩散噪声直接传向需要它的输出位置，降低主干中噪声信号强度，改善特征质量。作者据此认为 LSC 并非纯粹技巧，而与扩散目标结构相关。

Insight: 提升生成目标优化与获得高质量理解表征之间存在架构层面的张力，长跳连通过隔离扩散轨迹信号帮助保留图像语义特征。摘要没有给具体表征基准、模型规模或提升数值，结论主要来自机制分析与受控训练。

Abstract: Diffusion feature, i.e., intermediate activations extracted from diffusion model backbones, has emerged as a promising approach for unifying generation and vision understanding (discrimination). Despite the advancement of diffusion backbones into Diffusion Transformers (DiT), it has been found in previous literature that DiT models tend to yield weaker features despite their stronger generation capability. This poses a threat to good generation-understanding unification. In this work, we show via controlled from-scratch training that long skip connections (LSCs) affect feature quality: a DiT with LSCs can produce better features. Furthermore, through detailed diagnosis, we reveal the mechanism causing this effect. Specifically, the input to a diffusion backbone contains both the latent image and the diffusion noise, where the diffusion noise, though appearing in the form of noises, actually reflects the information of the diffusion trajectory. To make the final prediction of a noisy variable ($v$ or $ε$), the diffusion backbone needs both signals. However, carrying both signals through the main backbone effectively “pollutes” the image signal with noises, leading to poor feature quality. In comparison, LSCs can shortcut diffusion noises directly to where they are needed, leaving much weaker noise signals in the main backbone, thus improving feature quality. To name the broader impact, this reveals that LSCs are not a mere trick but closely related to the diffusion objective. The code is at https://github.com/Darkbblue/dit-lsc.

[61] TextVBench: Evaluating Text Rendering and Preservation in Video Generation cs.CVPDF

Ruiqiang Zhang, Hengyi Wang, Chang Liu, Guanjie Wang, Zehua Ma

TL;DR: TextVBench 将视频文字生成/保留评测建模为多目标时空对应，分别测 prompt 指定文字生成（T2V）和参考图文字保留（Ref2V）；评测中 MiniMax-H3 的 T2V TextVScore 为 68.32。

Details

Motivation: 视频生成器可能生成逼真场景，却把少量文字拼错、遗漏提示要求或在帧间改变文字。逐帧 OCR 不足以评估多目标场景，因为必须将嘈杂 OCR 区域匹配到预期文字，并分别判断空间准确度与时间一致性。

Result: TextVBench 包含两个互补轨道：T2V 衡量提示文字的创建和维持，Ref2V 衡量参考图中文字的保留。两者使用目标条件候选选择而非开放式 VLM 转录，支持一个目标对应多个 OCR 区域，并把帧级空间保真与跨帧时间保真分开。长度加权调和分数汇总指标，额外文字诊断揭示单一 OCR 分数隐藏的错误；基准按文字、布局、承载对象和运动属性分组，便于定位能力限制。所评模型中，MiniMax-H3 在 T2V 的 TextVScore 为 68.32，最强 Ref2V 分数为 56.51；属性切片显示同时出现的参考文字区域越多，表现下降越明显。

Insight: 基准关注文字目标与 OCR 检测区域之间的时空对应关系，不把 OCR 单次识别率等同于视频中的文字生成和保持能力。摘要未明确最强 Ref2V 模型，且多文字区域导致退化的趋势应结合具体分组结果解读。

Abstract: Modern video generators can synthesize convincing scenes while rendering a few characters incorrectly, omitting requested text, or changing it across frames. Measuring these failures is harder than applying OCR independently to each frame: when a scene contains multiple text targets and multiple noisy OCR regions, the evaluator must first determine which observation belongs to which intended text. We introduce TextVBench, a benchmark and evaluation framework that formulates visual-text evaluation as a multi-target, multi-instance spatiotemporal correspondence problem. TextVBench contains two complementary tracks: TextVBench-T2V measures the creation and maintenance of prompt-specified text, while TextVBench-Ref2V measures preservation of text from reference images. Both tracks use target-conditioned candidate selection rather than unconstrained VLM transcription, support one target mapping to multiple OCR regions, and separate frame-level spatial fidelity from cross-frame temporal fidelity. A length-weighted harmonic score summarizes these factors, while extra-text diagnostics expose failure modes hidden by a single OCR score. The benchmark is organized around controlled text, layout, carrier, and motion attributes so that aggregate scores can be traced back to specific capability limits. Across the evaluated model runs, MiniMax-H3 reaches a T2V TextVScore of 68.32, while the strongest Ref2V score is 56.51; attribute slices reveal a pronounced drop as the number of simultaneous reference text regions increases.

[62] When MLLMs miss what humans read: diagnosing and learning to read squint text cs.CV | cs.AIPDF

Chen Peng, Shan Huang, Jianbo Huang, Linrui Qin, Qibo Sun

TL;DR: SquintBench/SquintCtrl 研究 MLLM 对嵌在图像粗结构中的微弱文字识别失败；通过 on-policy 蒸馏，Squint OPSD 在 SquintBench 达到 88.61 ANLS，远超未适配主干的 26.50。

Details

Motivation: 多模态大模型可能无法读出人类眯眼仍能辨认的、融入图像粗结构中的文字，甚至回答图中没有文字。该问题来自实际内容审核案例；作者希望区分视觉证据本身不足与模型空间选择/文字识别不足。

Result: 作者将此类文字命名为 Squint Text，构建含 1,076 张生产审核图片的 SquintBench 和用于机制诊断的合成控制集 SquintCtrl。冻结权重分析发现，隐藏文字保留粗粒度信号，但字形身份表征较弱；提供正确空间区域后，字符身份显著更易读，说明空间选取是主要瓶颈。固定视觉 token 预算时抑制高频内容也有助于阅读，token 数量可能同样影响。Squint OPSD 让冻结教师获得缩小图像视图及真实转录作为特权上下文，以 token 级分布监督学生的 on-policy 轨迹；推理时学生只看原始图像。方法在 SquintBench 达到 88.61 ANLS，未适配主干为 26.50，原视图最佳通用模型为 24.44，现成模型在缩小视图上最高为 68.60。

Insight: 视觉证据在图中存在不代表模型能够正确选择对应区域并读出文字；特权视图和转录可用于训练，但不需在推理时增加辅助图像。提升针对 SquintBench 的 ANLS，摘要未说明独立外部数据集表现。

Abstract: Multimodal LLMs can fail to read text embedded in an image’s coarse structure (text a human recovers by squinting) and report that no text is present. We name this class Squint Text and study it as a recognition deficiency, motivated by cases from a production moderation pipeline. We introduce SquintBench, comprising 1076 production-derived moderation images, and SquintCtrl, a controlled synthetic suite for mechanism diagnosis. Frozen-weight analysis shows that hidden text leaves a coarse signal while glyph identity is weakly represented; identity becomes substantially more accessible when the correct spatial regions are supplied, implicating spatial selection as a major bottleneck. Suppressing high-frequency content also improves reading at a fixed visual-token budget, while visual token count may also contribute. These findings motivate Squint OPSD: a frozen teacher receives a downscaled view and the ground-truth transcription as privileged context, and its token-level distributions supervise a student along on-policy trajectories. At inference, the student reads the original image alone. Squint OPSD reaches 88.61 ANLS on SquintBench, versus 26.50 for the unadapted backbone, 24.44 for the best general-purpose model on the original view, and 68.60 at best for an off-the-shelf model under a downscaled view. These results substantially narrow the gap between available visual evidence and its generated read-out without auxiliary views at inference.

[63] GraftOOD: Grafting Out-of-Distribution Exemplars into Advantage-Weighted Rectification for Video Reward Optimization cs.CVPDF

Zheming Fu, Ruizhe He, Wenbin Ning, Xiaoxiao Ma, Xuan Yang

TL;DR: GraftOOD 将格式匹配的分布外视频示例混入部分在线 rollout，以序列级示例监督补足奖励优化并缓解运动塌缩；Wan2.1-1.3B 的 Dynamic Degree 从 4.86 升至 44.41，但 HPSv3 从 8.10 降至 7.32。

Details

Motivation: 视频奖励优化可能提高代理奖励却降低视频运动动态，作者称为 motion collapse；即使采用视频级运动质量奖励也可能发生。单一标量奖励难以稳定兼顾动态性和视觉质量。

Result: GraftOOD 在选定 prompt 组中用分布外视频示例替换部分在线 rollout。共享速度回归目标结合组内相对奖励修正与序列级示例监督，不需要示例生成轨迹，也无需额外监督损失系数；论文还将最优场刻画为两个来源目标场按来源后验加权的组合。作者构建 GraftSet-Video，含 2,397 个提示对应的 9,588 个格式匹配示例。在 Wan2.1-1.3B 上，相对仅奖励 FlowAWR，Dynamic Degree 从 4.86 提升到 44.41，HPSv3 从 8.10 降至 7.32，VisionReward 则接近不变。主设置下，三种示例增强方法的十项指标中 GraftOOD 领先九项。示例频率和组内数量消融显示运动—奖励之间存在权衡，增加示例并非所有指标都改善。

Insight: 外部分布视频示例能补充标量奖励缺少的序列级运动监督，但动态度提高不等价于运动更连贯或视觉更可信；质量指标同时出现退化。应把结果理解为特定模型上的多目标折衷，而非所有维度统一提升。

Abstract: Video reward optimization can increase proxy rewards while reducing video dynamics, a mismatch we identify as \emph{motion collapse}, including under a video-level motion-quality reward. We propose \textbf{GraftOOD}, which replaces part of the online rollouts in selected prompt groups with out-of-distribution video exemplars. A shared velocity-regression objective combines group-relative reward rectification with sequence-level exemplar supervision, requiring neither exemplar generation trajectories nor an additional supervised-loss coefficient. We characterize its pointwise optimal field as a source-posterior-weighted combination of the two source-specific target fields. We construct \textbf{GraftSet-Video}, containing 9,588 format-matched exemplars for 2,397 prompts, to supply external supervision. On Wan2.1-1.3B, GraftOOD raises Dynamic Degree from 4.86 to 44.41 relative to reward-only FlowAWR, while HPSv3 decreases from 8.10 to 7.32 and VisionReward remains close. At the main setting, GraftOOD leads nine of ten metrics among three exemplar-augmented methods. Ablations of exemplar frequency and within-group count reveal dynamics–reward trade-offs rather than uniform gains from increasing exemplar usage. These results support external exemplar supervision as a complement to scalar reward feedback, without equating higher measured dynamics with coherent, visually plausible motion in the generated videos. Code is available at \href{https://github.com/Fuzm7/FlowAWR}{GraftOOD}.

[64] S-Space: Exploring Spatial Workspace in Multimodal Language Models cs.CV | cs.CL | cs.LGPDF

Zhiyuan Shi, Xiang Li, Xingzhuo Guo, Shangchen Miao, Weiliang Chen

TL;DR: S-Space 发现 MLLM 对象 token 中存在可读出水平、垂直和距离坐标的线性子空间，并显示视角变化推理的主要瓶颈是空间变换能力，而非空间表征完全缺失。

Details

Motivation: 多模态语言模型在空间推理上表现有潜力，但支撑能力的内部机制不清楚；需要识别模型是否形成内部空间工作区，以及感知、变换与语言回答如何利用它。

Result: 研究提出 S-Space：对象 token 表示中的线性子空间，编码连续水平、垂直和距离坐标。研究通过空间答案得分对对象 token 激活的梯度识别坐标轴，并发现该子空间并非由特定数据或提示诱导，非空间问题下仍可读出。作者将其视作内部空间工作区：感知阶段把物体位置写入其中，读出支持空间判断，视角变化时内部推理会对其进行变换；因果干预可改变空间判断，同时大体保留非空间回答。案例还显示 S-Space 会为未见实体和观察者分配位置，并连接物理方向与抽象语言含义。诊断发现方位词读出会系统混合基数方向与图像相对参照系；感知—计算拆分显示，模型可形成有用空间表示，但跨视角可靠推理所需的空间变换仍是瓶颈。

Insight: 表征探针和因果干预共同支持模型内部确有可操作的坐标工作区；错误更多可能发生在变换阶段。参照系混淆揭示这种能力也有系统性边界，不能仅靠发现线性坐标子空间就推断空间推理普遍可靠。

Abstract: Multimodal language models (MLLMs) exhibit promising spatial reasoning capabilities, yet the internal mechanisms supporting them remain poorly understood. We uncover S-Space, a linear representation subspace in which object-token representations encode continuous coordinates along horizontal, vertical, and distance axes. Although we identify these axes by differentiating spatial-answer scores with respect to object-token activations, S-Space is intrinsic rather than induced by specific data or prompts, remaining readable under non-spatial questions. We show that S-Space functions as an internal spatial workspace of MLLMs. Perception encodes object locations into it, forming spatial representations that can be directly read out to support accurate spatial judgments. Internal reasoning transforms it for changing viewpoints. Verbal responses selectively access it, evidenced by causal interventions that alter spatial judgments while largely preserving non-spatial responses. Case studies further show that S-Space assigns locations to unseen entities and the observer, and connects physical directions with abstract linguistic meanings, suggesting both the capabilities and limitations of large-scale language training. Finally, we use S-Space as a diagnostic tool for spatial reasoning failures. Direction-word readouts reveal systematic coupling between cardinal and image-relative reference frames. More importantly, a perception-computation decomposition exposes a key bottleneck: MLLMs can form capable spatial representations, yet fall short in the spatial transformations required to reason reliably across viewpoint changes.

Yan Zhou, Yang Yang

TL;DR: Stride 将信息图要求满足度评估与错误位置定位分开，再按全局/局部尺度分派给构图和修图子智能体，并只接受验证分数提升的候选；在多项基准上开源系统匹敌或超过专有模型。

Details

Motivation: 信息图单张图片需要同时满足视觉、文字和语义约束。局部编辑难以修复整体构图问题，整图重生成又可能破坏已经正确的区域；随机生成器和不完美验证器还使单步迭代不可靠。

Result: Stride 将冻结生成器上的迭代优化建模为具历史的演化策略。它分离约束评估（是否满足要求）与视觉定位（问题在哪里、如何违反），再将全局修改路由给 composer 子智能体、局部修正路由给 retoucher。两个子智能体各自规划并生成多个候选，Stride 仅当候选提升验证器分数时才接受，以减少迭代回归。在完全开源的生成器—验证器系统上，Stride 在 BizGenEval 超过 Nano-Banana-2.0 和 Seedream-5.0-Pro；在 IGenBench 匹配 GPT-Image-2.0 并超过 Seedream-5.0-Pro；在 WISE 达到新的 SOTA，并在所有评测基准上明显超过既有智能体方法。

Insight: 尺度感知路由、多候选冗余和单调接受共同应对全局/局部编辑尺度错配与随机迭代退化。各基准上的比较对象不同，摘要未给具体分数；结论也依赖其验证器评分和开源生成器设置。

Abstract: Infographic generation challenges text-to-image models because a single image must satisfy numerous visual, textual, and semantic constraints. Iterative agentic refinement with a multimodal verifier is a natural remedy, but existing methods face a scale mismatch: local edits cannot correct global composition errors, while full regeneration may destroy already-correct regions. We introduce Stride, a constraint-grounded multi-agent framework that treats refinement over any frozen generator as a history-aware evolution strategy. Stride separates constraint evaluation - whether each requirement is satisfied - from visual grounding - where and how it is violated. It then routes global revisions to a composer subagent and local corrections to a retoucher subagent. Each subagent conducts internal planning and generates multiple candidates, while Stride accepts a candidate only when it improves the verifier score, reducing regression across iterations. Because stochastic generators and imperfect verifiers make any single step unreliable, it is this combination of scale-aware routing, per-step redundancy, and monotonic acceptance that yields stable improvement across iterations. With fully open-weight generator-verifier systems, Stride outperforms proprietary systems including Nano-Banana-2.0 and Seedream-5.0-Pro on BizGenEval, matches GPT-Image-2.0 and surpasses Seedream-5.0-Pro on IGenBench, and achieves a new state-of-the-art score on WISE, while substantially outperforming existing agentic methods across all evaluated benchmarks.

[66] Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Grounding cs.CVPDF

Zhihao Chang, Lei Zhai, Shuyuan Yang, Zhixi Feng

TL;DR: APD 将遥感开放集定位拆成“是否有视觉支持”和“目标在哪里”，通过查询扰动下的参考锚点稳定性训练拒识；实验报告模型既能拒绝不存在目标，也改善存在目标定位。

Details

Motivation: 开放集遥感视觉定位不仅要定位目标，还须判断图像是否包含足够证据。闭集定位模型对不存在目标也常输出看似合理的框，把定位置信与真实视觉支持混淆。

Result: AnchorProbe-Distill（APD）以教师—学生框架学习 Visual Support。教师 APD-T 把原始查询作为参考锚点，解释查询扰动产生的定位变化：语义保持查询应仍指向标注目标；近类别歧义查询根据是否形成可靠替代锚点或坍缩到参考锚点来判定；远类别反事实查询提供拒绝监督。随后将这种参考感知推理蒸馏到学生 APD-S，使模型只凭一张图和一个查询即可联合定位或拒识。实验显示，模型能够拒绝图像中不存在的目标，同时也提高对存在目标的定位能力；摘要未报告具体指标。

Insight: 用扰动查询下锚点是否稳定作为视觉支持证据，将拒答能力与坐标回归放入统一定位任务中。当前摘要只给定性实验结果，未说明遥感数据集、拒识阈值或定位提升数值。

Abstract: Open-set visual grounding in remote sensing requires models to determine not only where a queried object is located, but also whether the image provides sufficient evidence for the query at all. Existing closed-set grounding models, however, tend to return plausible boxes even for absent objects, blurring localization confidence with genuine Visual Support. We introduce AnchorProbe-Distill (APD), a teacher-student framework that recasts open-set grounding as Visual Support learning. APD builds on the insight that supported queries should induce coherent spatial anchors, whereas unsupported or mismatched queries tend to produce unstable or misleading localization patterns. APD-T therefore uses the Original Query as a Reference Anchor to interpret query perturbations: Semantic-Preserving Queries retain the annotated target, Near-Category Ambiguous Queries are resolved according to whether they form a reliable alternative anchor or collapse onto the Reference Anchor, and Far-Category Counterfactual Queries provide rejection supervision. This reference-aware reasoning is distilled into APD-S, enabling unified localization and rejection from a single image–query pair. Experiments show that APD enables the resulting model to reject absent targets while also improving its localization of present targets.

[67] Auditing VLM Benchmarks from Existing Evaluation Runs cs.CVPDF

Denis Degtiarev, Anna Gromova, Sergey Katkov, Artem Mikhailin, Safina Mukhamedshina

TL;DR: 本文将已完成 VLM 评测留下的预测和评分用于基准审计；在 MMStar 中发现 20.2% 题目图像带来的准确率增益为零，超出匹配置换零模型 3.2 个百分点，集中于数学和科学。

Details

Motivation: VLM 每次评测都会生成逐题预测、判定和元数据，但排行榜通常只保留汇总分数并丢弃这些产物。利用已存运行结果可审计基准是否真正依赖图像，而无需重新开展完整评测。

Result: 作者为 VLMEvalKit 增加后处理审计层，包含六个检测器，并进行一次移除视觉输入的文本重跑；输出逐题报告和汇总统计，主要指标附置换零模型超额、比例区间及模型池敏感性。对专门要求图像不可缺少的 MMStar，以三种模型审计发现 20.2% 题目图像未带来总体准确率提升；逐题匹配置换零模型解释 17.0%，剩余超额为 3.2 个百分点（校正置换 p=0.001），集中在数学和科学，粗粒度感知类没有这一现象。作者认为这与知识替代视觉证据相符，但确认机制仍需逐题人工复核。另一检测器标出 134 题：所有可解析回答模型都选择同一非金标准答案，候选主要在感知类别。替换 LLM 判分为精确字符串匹配不改变结论；差异都来自一个自由回答无法被解析的模型。二元 yes/no 基准上检测器校准会失效，作者将其报告为适用边界。

Insight: 逐题旧产物可以揭示“高基准分但不看图”的潜在问题，并用模型池、置换基线和校准分析避免把原始零增益直接归因于作弊。3.2 个百分点为匹配零模型后的超额；知识替代视觉只是与类别分布一致的解释，尚未由逐题审查确认。

Abstract: Every evaluation run of a vision-language model (VLM) already produces per-question artifacts (predictions, judged correctness, metadata) that leaderboards reduce to a single score and then discard. We reuse those artifacts to audit the benchmark itself, and add an audit layer to VLMEvalKit: six detectors that run as post-processing over saved outputs, plus one additional text-only rerun with visual inputs removed, emitting a per-question report. The layer reports per-question findings together with aggregate audit statistics; for the headline quantities, it attaches permutation-null excess where applicable, interval estimates for proportions, and sensitivity to the model pool. Auditing MMStar, a benchmark curated specifically so that the image is indispensable, with three models, we find zero aggregate accuracy gain from the image on 20.2% of its questions. An item-matched permutation null accounts for 17.0%, leaving a +3.2 pp excess (corrected permutation p = 0.001). This excess is concentrated in the mathematics and science categories and is absent from coarse perception, a localization consistent with knowledge substituting for visual evidence; confirming that mechanism would require item-level review. A second detector flags 134 questions on which every model that answered in parseable form picked the same non-gold option, and these candidates peak in the perception categories, whereas the zero-gain excess is largest in mathematics and science & technology. Replacing the LLM judge with exact string matching changes no conclusion, and every scoring discrepancy between the two traces to one model whose free-form answers a parser cannot read. On a binary yes/no benchmark the detectors measurably fall out of calibration, a scope boundary that we measure and report. The audit layer, the prediction artifacts and the generated reports accompany this submission.

[68] ELMA: Benchmarking Anaphoric Compositions for Long-Term Text-to-Motion Generation cs.CVPDF

Shun Kato, Dixin Yang, Kotaro Amaya, Yuiga Wada, Kazumi Fukuda

TL;DR: ELMA 发布带密集分段标注的长程文本到动作数据集，强调跨段照应约束；在其上微调现有模型后，长期动作的整体物理真实性与语义对齐均有改善。

Details

Motivation: 文本驱动人体动作生成在短片段上已有进展，但难以处理包含照应关系的多段指令：先前片段建立的状态和约束必须在后续动作中持续保留，这对数字人持续运行等应用很重要。

Result: 作者提出长时程照应组合动作生成任务，并构建 ELMA episodic 数据集。全自动采集和过滤流程从野外视频中提取高质量、连续的 30 秒片段，提供密集分段级标注以保留跨片段依赖和长程状态叙事。利用 ELMA 对现有先进动作生成模型微调后，广泛实验显示当前模型处理上下文依赖指令存在根本性不足；ELMA 训练能显著改善整体物理真实性和语义对齐，并建立新的长程动作生成基线。摘要未提供数据规模或指标数值。

Insight: 把跨段依赖显式标注为数据和任务核心，可评估模型是否持续维护先前动作建立的状态，而非只生成局部合理片段。性能提升为摘要定性结论，未报告数据集数量、具体指标或模型差异。

Abstract: Text-guided long-term human motion generation is essential for applications such as continuously operating digital avatars. Despite recent progress on short clips, existing models struggle with multi-segment instructions that involve anaphora, where constraints established in earlier segments must be preserved over time. In this paper, we introduce a novel task of long-term motion generation from such anaphoric compositions. To mitigate this, we present ELMA, an episodic long-term motion dataset with dense segment-level annotations that preserve cross-segment dependencies. Built via a fully automated collection and filtering pipeline, ELMA extracts high-quality, continuous 30-second clips from in-the-wild videos, capturing the episodic narratives necessary for long-range state modeling. Leveraging this dataset, we fine-tune state-of-the-art motion generation models to incorporate long-range context. Extensive experiments reveal fundamental shortcomings in current models when handling context-dependent instructions. We demonstrate that ELMA enables significant improvements in both global physical realism and semantic alignment, setting a robust new baseline for long-term motion synthesis.

[69] Benchmarking Answer-Grounding Consistency in Remote Sensing Visual Question Answering cs.CVPDF

Ping Guo, Zhiqi Huang, Xinran Li, Linkun Yu, Jingyin Pei

TL;DR: AESP 评估遥感 VQA 的答案是否被模型给出的定位证据支持，并构建含 15,027 样本的 G-RSVQA；七种模型均有证据支持失败，子集内最多 50.82% 正确答案缺乏所给定位依据。

Details

Motivation: 带 grounding 的遥感视觉问答会同时给出文本答案和相关目标定位。现有评测分别计算答案正确率和定位质量，却未直接检查模型自己的定位证据是否真的支持自己的答案。

Result: Answer-Evidence Support Protocol（AESP）按存在性、计数和比较问题设计规则，判断 grounding 证据能否支撑模型生成的答案。作者构建 Grounded Remote Sensing VQA（G-RSVQA），含 15,027 条问题、参考答案及相关对象级标注。七种带 grounding 的视觉语言模型实验显示，三类问题都存在证据支持失败；在证据评估子集中，正确答案中最多 50.82% 没有被模型给出的 grounding 证据支持。

Insight: 答案正确与 grounding 看似合理并不保证二者一致；单独汇报准确率和定位分数会遗漏这种内部矛盾。50.82% 是子集及题型中的最高比例，并非所有正确回答的总体比例。

Abstract: In grounded remote sensing visual question answering, a model produces a textual answer and identifies relevant objects in the image as grounding evidence. Existing evaluations measure answer correctness and localization quality, but do not directly assess answer-grounding consistency. We propose the Answer-Evidence Support Protocol (AESP) to assess this consistency through evidence support: whether the grounding evidence supports the model’s own answer. AESP applies task-specific rules to existence, counting, and comparison questions. We further construct the Grounded Remote Sensing Visual Question Answering (G-RSVQA) benchmark, containing 15,027 samples with questions, reference answers, and all related object-level annotations. Experiments on seven grounded vision–language models reveal failures of evidence support across all three question types. Up to 50.82% of correct answers in the evidence evaluation subset are not supported by the provided grounding evidence.

[70] PhysForge: Material-Controllable 3D Reconstruction with Separable Components cs.CVPDF

Yuchen Wang, Yanqi Bao, Zheng Gu, Zhengqing Chen, Jieqi Shi

TL;DR: PhysForge 将视频扩散模型的材料条件动态用于物理属性拟合，并把复杂交互拆成可独立优化的对象/语义组件；在 PhysAssets 和 Google Scanned Objects 上报告材料控制与组件级建模优势。

Details

Motivation: 近期物理 3D 生成能产生外观逼真且可仿真的资产，但材料行为往往仅从外观推断，难以控制；复杂物体交互和语义部件之间的耦合也使物理参数估计困难。

Result: PhysForge 基于视频扩散模型，包含两个互补模块。PhysFit 以材料条件 VDM 动态作为物理属性拟合参照，使用窗口化拟合聚焦能揭示材料的交互，并用 Hallucinated Forcing 区分 VDM 虚构的非物理运动与真实材料响应。PhysComp 将复杂交互拆为独立物体和语义组件，使物理参数可分别优化、灵活组合用于联合仿真。在 PhysAssets 和 Google Scanned Objects 上，作者报告相较现有方法具有更强的材料相关物理响应控制；常见和不常见材料的 CLIP 与物理可控性分数均为最高。定性比较、组件消融和用户研究也支持所述改进，但摘要未提供具体数值。

Insight: 通过材料条件视频动态提供参照，并剥离扩散模型自身的非物理运动，可将视觉生成先验用于材料参数拟合；组件拆分则处理复合交互。量化结论限于摘要所列两项数据集和 CLIP/物理可控性指标。

Abstract: Recent advances in physical 3D generation have enabled visually faithful assets with simulatable mechanical behavior. However, existing methods provide limited control over material behavior beyond appearance-based inference and struggle to estimate physical properties from complex interactions between objects and semantic parts. Therefore, we present PhysForge, a Video Diffusion Model (VDM)-based framework for addressing these challenges, comprising two complementary modules for material-controllable physical fitting and componentlevel interaction modeling. The first, PhysFit, leverages material-conditioned VDM dynamics as references for physical-property fitting, introducing windowed fitting to focus on material-revealing interactions and Hallucinated Forcing to disentangle nonphysical motion hallucinated by the VDM from material responses. The second, PhysComp decomposes complex interactions into individual objects and semantic components, enabling their physical parameters to be optimized independently and flexibly composed for joint simulation. Experiments on PhysAssets and Google Scanned Objects demonstrate that, compared with existing methods, PhysForge provides stronger control over material-dependent physical responses while supporting component-level physical modeling for complex interactions. It achieves the best CLIP and physical controllability scores on both common and uncommon materials, with qualitative comparisons, component-level ablations, and a user study further supporting these improvements. Our project page is available at https://masterwanna.github.io/PhysForge.html .

[71] GLIMPSE: Global-Local Indexing with Multi-Precision Spectral Encoding for Explorable Video World Models cs.CVPDF

Zhufeng Xu, Henglei Lv, Bailin Deng, Yikang Ding, Xiaoqiang Liu

TL;DR: GLIMPSE 用多精度频带坐标和几何条件频谱衰减降低错误投影地址的影响，以固定局部读取预算检索视频记忆；在匹配预算下优于确定性位置传输的几何对应与光度一致性。

Details

Motivation: 可控相机视频世界模型需要相机回到旧场景时保持一致。把历史特征渲染到目标视角会将深度/姿态误差转化为重影；位置传输虽能移动历史 patch 地址而非内容，却仍给不准确投影分配完整位置精度。

Result: GLIMPSE 提出全局—局部记忆接口。局部 patch 记忆提供视角相关外观，循环全局记忆提供场景上下文；检索时在固定局部读取预算下选择历史 patch。多精度坐标按频带表示位置，并用几何条件频谱衰减降低不准确投影地址对后续计算的影响。在相同检索与读取预算下，GLIMPSE 相较确定性位置传输提升几何对应和光度一致性；摘要未给具体数值或下游视频质量评分。

Insight: 位置坐标精度也应反映投影几何可靠性：模糊/不准确地址不宜以完整频率强度注入记忆。比较控制了读取预算，报告的是对应和光度一致性改善，尚不能据摘要推断各类相机运动下的增幅。

Abstract: A camera-controlled video world model must keep a scene consistent when the camera returns to it. Memories that render stored features into the target frame can turn depth and pose errors into ghosting or duplicated structure. Positional transport avoids that resampling by relocating a historical patch’s address rather than its content, but assigns full positional precision even to inaccurate projections. We present GLIMPSE, a global-local memory interface with band-wise multi-precision coordinates and geometry-conditioned spectral attenuation to reduce sensitivity to inaccurate projected addresses. Local patch memory supplies view-specific appearance, while recurrent global memory provides scene context. Footprint-guided retrieval selects historical patches under a fixed local read budget. Under matched retrieval and read budgets, GLIMPSE improves geometric correspondence and photometric consistency over deterministic positional transport.

[72] Improving Semantic Coverage in AI Test & Evaluation through Generative Augmentation cs.CVPDF

Connor Hashemi, Bharadwaj Ravichandran, Connor Anderson, Shitij Govil, Brandon RichardWebster

TL;DR: 该三阶段生成式流程在不需语义标签或重训被测模型的情况下检测并补齐测试集语义覆盖缺口；日/夜分类与检测实验中，扩充测试集更能区分是否见过缺失语义的模型。

Details

Motivation: AI 测试评估通常只有留出测试集，不知道训练数据覆盖哪些语义条件。如果时间、天气或地点等关键输入条件在测试集中不足，评估结论可能被语义覆盖缺口误导。

Result: 流程先让 VLM 对语义因素做零样本二元标注，再在嵌入空间聚类，找出最影响下游模型行为的语义；随后用扩散图像到图像模型将已有图像转换到覆盖不足的语义域，同时保留场景内容并改变高层外观；最后通过合成图像嵌入的统计分析验证覆盖改善，再将合成图像纳入测试集。合成数据只用于丰富测试集，不重训被评模型。在图像分类和目标检测的日/夜语义缺口实验中，扩充测试集更能区分训练时见过与未见过该语义的模型，使评估结论更接近理想的充分覆盖测试集。

Insight: 合成增广被用于修复评估集覆盖，而非提升被测模型；嵌入统计用于检查语义覆盖是否确实拓宽。验证集中仅报告分类、检测的昼夜差异，摘要未给具体指标或其他语义变量结果。

Abstract: In test and evaluation (T&E) of AI models, evaluators typically have access only to a held-out test dataset and no knowledge of the training data or its semantic composition. If critical input conditions—such as time-of-day, weather, or scene location—are underrepresented in this test dataset, T&E results can be misleadingly due to this semantic coverage gap. We propose a three-stage generative AI pipeline to detect and fill such semantic gaps without requiring ground-truth labels of these semantics. First, vision-language models (VLMs) perform zero-shot binary labeling of semantic factors, and an embedding-space clustering step identifies which semantics most affect downstream model behavior. Second, diffusion-based image-to-image models transform existing covered images into the underrepresented semantic domain, preserving scene content while augmenting high-level appearance. Third, statistical analysis of the augmented image embeddings verifies that the synthetic imagery improves dataset coverage before it is incorporated. Crucially, the synthetic data is used only to enrich the test set and no model retraining is performed for T&E. We validate the full pipeline on both image classification and object detection under day/night semantic gaps, showing that the augmented test datasets better distinguish models with and without exposure to the missing semantic, thereby yielding T&E conclusions that more closely match those of an ideal, fully covered dataset. Code available at https://github.com/Hashe037/DEDUCE

[73] KVeil: First-Place Solution to ECCV 2026 LifeGenIP Challenge on Unlearnable Videos cs.CVPDF

Boheng Li, Yueming Xing, Yiming Li, Jie Zhang, Han Qiu

TL;DR: KVeil 是 ECCV 2026 LifeGenIP 不可学习视频挑战赛两个阶段的第一名方案，通过降低参考条件信息并分区施加难以察觉的扰动，保护人脸视频免遭未授权个性化生成。

Details

Motivation: 少量人脸视频已足以让个性化视频生成模型复现个人身份，带来身份隐私风险。挑战赛要求在有限且不可感知的扰动预算下，防止未经授权的参考式或微调式定制。

Result: 第一阶段提出 Reference Capacity Collapse：用两个互补损失削弱参考条件携带的信息，同时保持后续视频表示对参考仍有依赖；Motion-Guided EOT 提升对未知推理条件的鲁棒性。第二阶段还考虑基于微调的定制和未见生成模型，提出双层保护：人脸区域基于合成目标身份构造结构对齐扰动，背景区域增强第一阶段的白盒破坏效果。作者报告白盒参考式定制下接近完全保护，并对其他定制范式、不同模型和时间攻击保持效果。两个方案均建立在 LETHE 工作上；摘要未给扰动幅度或各攻击条件下的数值。

Insight: 保护目标是使输入视频难以被用于身份定制，同时满足有限、不可感知扰动预算；脸部和背景采用不同策略以应对不同威胁。比赛第一名和接近完全保护是摘要报告，具体视觉质量副作用与感知阈值未提供。

Abstract: The rapid development of personalized video generation has raised serious concerns over identity privacy, as a few facial videos of a person now suffice to reproduce their identity in synthetic videos. This report presents the first-place solutions to both phases of the ECCV 2026 LifeGenIP Challenge on Unlearnable Videos, which aims to protect facial videos from unauthorized customization under a limited and imperceptible perturbation budget. For Phase 1, we introduce Reference Capacity Collapse, a pair of complementary losses that degrade the information carried by the reference condition while keeping subsequent video representations dependent on it, together with a Motion-Guided EOT mechanism that improves robustness across unknown inference conditions. Phase 2 further considers tuning-based customization and unseen generative models. To address both threats within a single perturbation, we design a two-layer framework that protects the facial and background regions separately, constructing structure-aligned perturbations from a synthetic target identity in the former and strengthening the white-box disruption of Phase 1 in the latter. Our method achieves nearly perfect protection under white-box reference-based customization, and remains effective under other customization paradigms, various models, and temporal attacks. Both solutions are built upon our recent work LETHE. We hope our solutions can inspire future work on protecting facial videos against unauthorized customization. Our code is available at https://github.com/AntigoneRandy/KVeil.

[74] State-Isolated Vision Mamba via Update-Tendency Routing for Underwater Image Enhancement cs.CVPDF

Yan Luo, Laibin Chang, Zefan Feng, Yi’ang Chen, Kui Jiang

TL;DR: IsoMamba 按 token 的状态更新倾向聚类并路由到隔离的 Mamba 状态流，缓解异质图像内容竞争共享隐状态；水下增强基准上报告多项 SOTA 和更干净的状态响应。

Details

Motivation: Vision Mamba 通过递归状态演化建模长程空间依赖，但已有方法主要改进 token 排列、扫描或专家路由，较少研究异质图像区域应如何组织递归状态。不同更新行为的 token 共用状态可能产生持续跨内容干扰，作者称为 State Contention。

Result: 作者提出 State Isolation 原则：状态更新倾向相容的 token 在独立递归状态流中演化。IsoMamba 以 Δ 引导构造模型内生更新表示，通过无标签聚类发现更新兼容的 token 组，再按 cluster—route—isolate 流程路由到隔离的 Mamba 专家。针对水下图像不同波长的重建难度，还设计动态通道级重加权目标。多个水下增强基准实验显示，IsoMamba 持续达到所比较方法中的 SOTA，并产生更干净的隐状态响应；摘要未列出数据集、指标和具体分数。

Insight: 状态组织按更新兼容性而非 token 顺序划分，目标是减少共享递归状态中的内容干扰；动态通道权重补偿波长差异。当前摘要只给总体定性结论，没有量化各基准收益。

Abstract: Vision Mamba has recently emerged as an efficient alternative to convolutional and Transformer-based architectures by modeling long-range spatial dependencies through recurrent state evolution. Existing studies primarily improve token serialization, scanning strategies, or expert routing, yet largely overlook a state level question question: how should recurrent states be organized for spatially heterogeneous visual restoration? In this paper, we show that forcing tokens with heterogeneous update behaviors to recurrently modify a shared hidden state leads to persistent cross-content interference, which we term \textbf{State Contention}. We further argue that effective recurrent modeling should organize state evolution according to token compatibility rather than token ordering. Based on this observation, we introduce \textbf{State Isolation}, a new recurrent state organization principle for Vision Mamba,tokens with compatible state-update tendencies evolve within independent recurrent state streams. To instantiate this principle, we propose \textbf{IsoMamba}, a $Δ$-guided architecture that constructs model-intrinsic update representations, discovers update-compatible token groups through label-free clustering, and routes them to isolated Mamba experts following a \textbf{cluster–route–isolate} paradigm. In addition, we develop a dynamic channel-wise reweighting objective to compensate for wavelength-dependent reconstruction difficulty in underwater images. Extensive experiments demonstrate that IsoMamba consistently achieves state-of-the-art performance on multiple underwater image enhancement benchmarks while providing cleaner hidden state responses, validating the effectiveness of state isolated recurrent modeling.

[75] LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos cs.CV | cs.AI | cs.ROPDF

Zhiyuan Xiang, Peidong Liu, Mingyang Li, Jiawei Li, Wenhow Li

TL;DR: LAPT-Scale 从 23.3K 小时第一人称视频学习连续潜在动作，再进行机器人 embodiment 对齐和任务后训练；人工视频标注量由 1K 增至 5K 小时时，真实机器人成功率从 63.3% 提高到 85.0%。

Details

Motivation: 通用机器人策略的扩展受限于昂贵的具身交互数据。大规模第一人称人类视频可提供动作经验，却没有机器人动作标签；现有潜在动作标注在复杂真实视觉和多样操作动力学下可能较噪。

Result: LAPT-Scale 包含两部分：LAM 从人类视频帧间视觉变化中学习连续潜在动作，作为人类导出的隐式监督；Policy 先做人类视频潜在动作预训练，再进行目标机器人 embodiment 对齐和任务专用后训练。与向量量化 LAM 不同，连续潜在空间保留细粒度运动和交互动力学。方法结合感知、语义及光流对齐监督，超越单纯像素重建来训练帧间转移。LAM 用 23.3K 小时第一人称视频训练；随着带标注人类视频从 1K 增至 5K 小时，真实机器人成功率由 63.3% 提升至 85.0%。策略还可泛化到未见视觉条件。

Insight: 大规模人类视频可通过连续潜在动作提供无需显式机器人动作标签的预训练信号，之后再与目标机器人形态对齐。报告的 63.3%→85.0%对应 1K→5K 小时人工视频规模设置；摘要未说明机器人任务和硬件细节。

Abstract: Scaling generalist robotic policies is limited by the high cost of collecting embodied interaction data. Large-scale egocentric human videos offer a rich alternative, but they lack robot action labels, and existing action annotation methods are often noisy under real-world visual complexity and diverse manipulation dynamics. We introduce LAPT-Scale, a scalable latent action pre-training paradigm with two components: LAPT-Scale-LAM learns continuous latent actions by explaining frame-to-frame visual transitions in human videos and uses them as human-derived supervision, while LAPT-Scale-Policy trains a VLA policy through human-video latent-action pre-training, target-robot embodiment alignment, and task-specific post-training. Unlike prior vector-quantized LAMs, LAPT-Scale-LAM uses a continuous latent space to preserve fine-grained motion and interaction dynamics. We further combine perceptual, semantic, and optical-flow alignment signals to improve transition-level supervision beyond pixel reconstruction. Trained on 23.3K hours of egocentric video, LAPT-Scale-LAM provides implicit action supervision for policy pre-training, yielding consistent scaling gains and improving real-robot success from 63.3% to 85.0% as annotated human video scales from 1K to 5K hours. The learned policy also generalizes to unseen visual conditions.

[76] Gaussian Splatting with Reflections Guided by What is Seen cs.CVPDF

Yiming Liang, Tianyu Xiao, Hiroshi Ishikawa

TL;DR: 该 2D Gaussian Splatting 框架将输入图像中可直接观测的环境信息用于近场反射建模，并结合混合外观表示和视角相关镜面模型；在公开基准及新建数据集上改善渲染质量与几何精度。

Details

Motivation: NeRF 和 3DGS 在常见场景新视角合成上表现良好，但较难捕捉视角相关镜面效应，尤其是近场反射。仅表示无穷远光源的环境贴图不足，而仅从反射间接监督的环境 Gaussian 也难以精确建模。

Result: 作者提出基于 2D Gaussian Splatting 的框架，直接利用输入图像中可见的环境信息，并结合混合反射外观表示与视角相关镜面建模。评测覆盖公开基准和新整理的近场反射数据集，论文报告相较现有方法渲染质量和几何准确性更好；摘要没有列数据集名称、指标或提升数值。

Insight: 关键是从图像中直接利用可观测环境线索来约束近场反射，而非只依赖环境贴图或反射结果的间接监督。摘要结论为定性比较，无法补充具体指标或对不同材质/光照条件的影响。

Abstract: While novel view synthesis methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have shown impressive performance on common scenes, they often struggle with capturing view-dependent specular effects, particularly near-field reflections. Existing methods utilize environment maps, which only represent lights from infinity, or environment Gaussians, which rely solely on indirect supervision from reflections, are insufficient for accurately modeling such effects. Here, we propose a framework based on 2D Gaussian Splatting (2DGS) that leverages directly observable environment information in input images. Our approach also integrates a hybrid reflection appearance representation and view-dependent specular modeling. Experiments on public benchmarks and a newly curated near-field reflection dataset demonstrate that our method achieves superior rendering quality and geometric accuracy.

[77] OccludeBench: Can VLMs Find What’s Missing? cs.CV | cs.CLPDF

Jasin Cekinmez, Addison J. Wu, Ryo Mitsuhashi, Linrong Cai, Xingyu Fu

TL;DR: OccludeBench 区分由阴影/反射直接恢复遮挡物与由场景语境推断两类任务；五种 VLM 在直接案例准确率平均 42.7%，显著低于推断案例的 62.7%。

Details

Motivation: 理解图像中被完全遮挡、因而不可见的物体需要从剩余物理线索或场景上下文推断。作者希望定位 VLM 在视觉证据恢复过程中的具体失败环节，而不只测最终答案。

Result: OccludeBench 是人工整理的全遮挡物体恢复基准，分直接线索案例（如阴影或反射）和场景语境推断案例。五种 VLM 的直接案例平均准确率为 42.7%，推断案例为 62.7%，相差 20.0 个百分点；人类分别为 63.4% 和 68.5%，差异不显著。四阶段诊断工具 OccludeTrace 显示瓶颈出现在从完整图像投影中恢复相关物体：模型在失败样例中只有 50% 能找回该物体，而正确作答样例中为 91%。长推理、工具和少样本提示效果不稳定，无法可靠消除差距。对具图像生成能力的两种模型，先补绘候选隐藏物体、再让模型依据可见物理线索检验该假设，可将两类差距降至统计上不显著。

Insight: 模型更擅长借助整体语境猜测，而不擅长从局部物理投影证据恢复被遮挡实体；分阶段诊断揭示了答案错误的视觉定位瓶颈。补绘再核验的效果目前报告于具图像生成能力的两种模型，不能泛化到所有 VLM。

Abstract: How well can vision-language models (VLMs) reason about what is missing from an image? We study this question with OccludeBench, a manually curated benchmark for recovering fully occluded objects from the visual evidence that remains. OccludeBench distinguishes direct cases, where the hidden object must be recovered from a specific physical cue such as a shadow or reflection, from inferential cases, where it can be inferred from broader scene context. Across five VLMs, accuracy averages 42.7% on direct cases versus 62.7% on inferential cases, exhibiting a 20.0-point gap. Humans attain higher accuracies of 63.4% versus 68.5% for direct and inferential images, respectively, with no significant gap. To locate this failure, we introduce OccludeTrace, a four-stage diagnostic that isolates where the visual reasoning process breaks down. The bottleneck emerges when models must recover the relevant object from the projection within the full image: they succeed on only 50% of failed examples, compared with 91% of examples they answer correctly. Extended reasoning, tool use, and few-shot prompting yield inconsistent improvements and do not reliably eliminate the gap. In contrast, an inpaint-then-confront intervention, which prompts models to first generate a candidate hidden object and then evaluate that hypothesis against the visible physical cue, reduces the gap to a statistically non-significant difference for both models with image-generation capabilities. Together, our results establish a tractable, controlled diagnostic for isolating how VLMs reason about visual content that is missing from an image.

[78] Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability cs.CVPDF

Haonan Wang, Yuchen Wang, Jingyu Lu, Qixiang Zhang, Lehan Wang

TL;DR: Neurons++ 用先图像 fMRI 预训练、再受试者专属微调的串行视觉流解码同时重建图像和视频，并显式组织空间、语义、语言和时间线索；视频重建达到 SOTA，图像重建有竞争力。

Details

Motivation: fMRI 视觉解码对理解人类感知和脑机接口有价值。生成式方法能重建看起来合理的图像/视频，但视觉逼真不等于结果确实由脑活动支持，因此需要检查神经活动与视觉输出之间的可解释联系。

Result: Neurons++ 从原 Neurons 会议版的视频重建扩展到静态图像和视频，并将并行任务条件改为受皮层启发的串行解码。模型先进行图像—fMRI 预训练得到稳定的空间/语义初始化，再分别针对图像和视频重建做受试者专属微调；串行流程把 fMRI 表征组织成空间、语义、语言层面和时间线索。标准基准实验中，视频重建达到 SOTA，图像重建具有竞争力。神经—视觉分析显示，神经扰动能定性地控制输出方向，fMRI 编码器读出对刺激相关皮层特征敏感，并支持 ROI 引导的语义调节；摘要未列具体分数。

Insight: 研究不仅评估重建质量，也用神经扰动、皮层特征读出和 ROI 调制检查模型是否保留脑信号相关结构。结果支持定性可控性和跨图像/视频任务框架，摘要未给出重建指标或样本规模。

Abstract: Decoding visual experience from fMRI is important for understanding human perception and developing brain-computer interfaces. Recent generative decoding methods can reconstruct plausible images and videos, but visual plausibility alone does not ensure that the output is faithfully grounded in brain activity. In this work, we propose Neurons++, a visual-stream fMRI reconstruction framework for both static image and dynamic video reconstruction. Compared with our conference version Neurons, Neurons++ extends the paradigm from video-only reconstruction to visual-stream reconstruction for both images and videos, and replaces parallel task conditioning with serial cortex-inspired decoding. The model first uses image-fMRI pretraining to obtain a stable spatial-semantic initialization, and then performs subject-specific fine-tuning for image and video reconstruction separately. The serial design organizes fMRI-derived representations into explicit spatial, semantic, language-level, and temporal cues. Extensive experiments show that Neurons++ achieves state-of-the-art video reconstruction and competitive image reconstruction across standard benchmarks. Beyond reconstruction fidelity, neural-to-visual analyses indicate that Neurons++ exhibits qualitative directional controllability under neural perturbation, that its fMRI encoder read-out is sensitive to stimulus-relevant cortical features, and that it supports ROI-guided semantic modulation. Code and model weights are available at: https://github.com/xmed-lab/NeuronsPlusPlus.

[79] SimVTA: Simulation-Grounded Video-Trajectory Alignment for Driving World Action Models cs.CVPDF

Changhui Jing, Haochen Tian, Hongchen Li, Tianyu Li, Caojun Wang

TL;DR: SimVTA 在 3DGS 重建场景中用仿真为高奖励驾驶轨迹渲染匹配未来视频，再联合 GRPO 规划与视频 flow-matching 更新；NAVSIM v1 的 PDMS 从 86.2 提升到 91.3。

Details

Motivation: 驾驶世界动作模型通过配对轨迹和未来观测学习，RL 可探索替代轨迹改善规划，但真实驾驶日志只含实际轨迹的未来视频，替代候选缺乏匹配视觉监督。

Result: SimVTA 将轨迹优化与仿真视频监督结合：为每个观测采样候选轨迹，在 3D Gaussian Splatting 重建的真实场景中由 World Engine 等仿真器渲染高奖励候选的未来视频，提供不依赖模型自身预测的轨迹匹配监督。渲染预算有限时，优先监督已渲染候选中未来误差更高的样本。随后用 GRPO 优化轨迹规划，并对匹配视频施加 flow-matching 损失更新共享表示；部署时模型直接预测轨迹，不调用仿真器。NAVSIM v1 上，WAM 初始模型 PDMS 从 86.2 增至 91.3（+5.1）；NAVSIM v2 达 88.2 EPDMS，HUGSIM 闭环评测平均 HD-Score 为 38.8。消融显示视频监督更新共享表示有益，进一步优先高误差未来帧还能改善表现。

Insight: 仿真使替代策略轨迹也有视觉未来监督，视频损失通过共享表示回流到规划器，推理阶段不承担仿真开销。数值分别对应 NAVSIM v1/v2 和 HUGSIM 的不同指标，不能直接互比。

Abstract: Driving world action models (WAMs) learn from paired trajectories and future observations. Post-training with reinforcement learning allows the policy to explore alternative trajectories and improve planning using driving rewards. However, driving logs contain future videos only for the recorded trajectories, leaving these alternatives without corresponding visual supervision. Thus, we introduce SimVTA, a simulation-grounded post-training framework that combines trajectory optimization with video supervision. First, we sample candidate trajectories for each observation and use a real-world simulator (e.g., World Engine) to render future videos for high-reward candidates in real-world scenes reconstructed with 3D Gaussian Splatting (3DGS). This provides trajectory-matched supervision independent of the model’s own predictions. Under a limited rendering budget, we prioritize video supervision for higher-error futures among these rendered candidates. Finally, we optimize trajectory planning with Group Relative Policy Optimization (GRPO) and use a flow-matching loss on the matched videos to update shared representations. At inference time, the model predicts trajectories directly, without simulator calls. On NAVSIM v1, applying SimVTA to a WAM initialization improves PDMS from 86.2 to 91.3 (+5.1). It achieves 88.2 EPDMS on NAVSIM v2 and an average HD-Score of 38.8 in closed-loop evaluation on HUGSIM. Ablations show that updating shared representations with video supervision improves planning, while prioritizing higher-error futures among high-reward trajectories further improves performance.

[80] READ: Reading the Selective Scan for Faithful Video Attribution cs.CVPDF

Magdalena Trędowicz, Piotr Kubaty, Arkadiusz Lewicki, Jacek Tabor, Łukasz Struski

TL;DR: READ 通过在分类器读出位置展开选择性状态空间递归，将最终预测贡献回溯到视频 token，仅需一次前向传播即可生成时空相关图，并以较低开销达到有竞争力的忠实度和定位表现。

Details

Motivation: 选择性状态空间模型适合长序列视频建模，但递归计算使人难以判断哪些视频 token 驱动预测。现有归因方法通常需要额外反向传播或多次模型运行，成本可能高于需要解释的前向推理。

Result: READ 是面向选择性状态空间模型的无参数归因方法，在分类器读取状态的位置展开递归，将累积到递归状态的贡献追溯至影响最终预测的视频 token。以分类器读出为锚点后，可从单个时空相关性图直接获得帧级和区域级相关度。方法仅需一次前向传播；实验报告其忠实度和定位表现与显著更昂贵的归因方法有竞争力，并避免既有方法中的系统性相关度偏差，在不同数据集和主干上恢复有意义的时间结构及类别特异性结构。摘要未列具体数值。

Insight: 选择性扫描的递归状态本身既是高效推理机制，也可作为预测证据回溯来源；将归因锚定在分类器实际读取位置避免额外的反向或反复推理。定量比较和具体基准未见于摘要。

Abstract: Selective state-space models are an efficient approach to long-sequence video modeling. However, their recurrent computation makes it difficult to determine which video tokens drive a prediction. Existing attribution methods often require additional backward passes or repeated model evaluations, making them substantially more expensive than the forward inference they aim to explain. In this work, we introduce READ, a parameter-free attribution method for selective state-space models that unrolls the recurrence at the position read by the classifier. READ traces the contribution accumulated in the recurrent state back to the video tokens that contribute to the final prediction. By anchoring attribution at the classifier’s readout, it produces a single spatiotemporal relevance map from which frame- and region-level relevance can be obtained directly. Despite requiring only one forward pass, READ achieves competitive faithfulness and localisation compared with substantially more expensive attribution methods. Experimental results show that READ avoids the systematic relevance biases of existing methods while recovering meaningful temporal and class-specific structure across datasets and backbones. More broadly, our results show that the recurrence underlying selective state-space models is not only an efficient mechanism for inference, but also a direct source of interpretable evidence for their predictions.

[81] SpatialASM: Internalizing Active Mentalization for Spatial Reasoning cs.CV | cs.AIPDF

Yuhong Liu, Shenxi Wu, Junyi Chi, Beichen Zhang, Xuanlang Dai

TL;DR: SpatialASM 通过空间模拟生成视角规划轨迹和自动视角转换任务，训练 LVLM 主动想象与规划任务相关视点；四种主干、七个基准上平均空间推理准确率提高，同时保持一般视觉能力。

Details

Motivation: 人在复杂空间推理时会主动换到与任务相关的视点，并从该视角重建空间布局；当前 LVLM 尚未充分具备这种主动空间心理模拟能力。

Result: SpatialASM 用 allocentric 新视角生成器将假设视点锚定于视觉证据，并产生两类训练监督：显式 ASM 轨迹教模型何时及如何自适应调用视点规划和想象；自动构建的视角转换任务进一步训练条件化场景想象。七个基准涵盖偏感知的空间理解，以及需要多图、跨视图和视点变换的复杂推理。对四种 LVLM 主干，SpatialASM 提高七项基准的平均准确率，同时保留原有一般视觉能力；摘要没有给出具体平均增益数值。

Insight: 显式训练模型主动规划并模拟新的观察视角，补足仅被动看图的空间推理方式，也为稀缺的空间 CoT 监督提供可规模化合成路径。摘要结论是四种主干上的平均准确率提升，未提供模型或基准级分数。

Abstract: When solving complex spatial reasoning tasks, ordinary humans naturally revisit the scenes from task-relevant viewpoints and mentally reconstruct the spatial layouts from those viewpoints. But can Large Vision-Language Models (LVLMs) proactively think in the same way? We term this ability Active Spatial Mentalization (ASM), an intrinsic component of visual intelligence that remains substantially underdeveloped in current LVLMs. To bridge this gap, we introduce SpatialASM, a scalable framework to internalize ASM into LVLMs through training-time spatial simulation. SpatialASM employs an allocentric novel-view generator to ground hypothetical viewpoints in visual evidence and produces two complementary forms of supervision: i) explicit ASM trajectories that teach LVLMs when and how to adaptively invoke view planning and imagination during spatial reasoning, and ii) automatically-constructed perspective-taking tasks that further strengthens viewpoint-conditioned scene imagination. On seven benchmarks spanning relatively perception-oriented spatial understanding to more challenging tasks requiring multi-image, cross-view and viewpoint-transformation reasoning, SpatialASM yields performance gain on LVLMs of four LVLM backbones in spatial reasoning while retaining their original general vision capabilities. The experimental results demonstrate that our approach improves average accuracy across the seven spatial benchmarks. And the synthesis of ASM trajectories provides a scalable pathway to alleviate the scarcity of spatial Chain-of-Thought (CoT) supervision for eliciting active viewpoint exploration and mental scene simulation.

[82] LapMerge: Differentiable Exact-Budget Token Merging in Linear Time cs.CVPDF

Magdalena Trędowicz, Aleksandra Nowak, Tomasz Steifer, Łukasz Struski, Szymon Płotka

TL;DR: LapMerge 用可学习质量分布把有序 token 切为精确等质量段，并用前缀/后缀扫描线性聚合，实现可微、精确预算且前后向均为 O(M+N) 的 token 合并。

Details

Motivation: 长 token 序列是视觉和语言模型推理成本的主要来源。筛选 token 会丢信息，而已有合并方法依赖两两 token 匹配或 M×N token—输出交互，难以同时保留信息、可微训练和高效率。

Result: LapMerge 根据 Laplace 核密度学习质量分布，将长度为 M 的有序序列划分为恰好 N 个等质量段，再通过前缀/后缀扫描聚合每段。前向和反向计算均为 O(M+N)，同时满足精确输出预算和端到端可微；运行时改变预算不需修改算子参数，学得的质量分布还能显示预算分配到哪些 token。视觉和视觉语言任务实验中，LapMerge 达到或超过强 token reducer，在长序列时最高快两个数量级；当 token 顺序体现空间或时间局部性时尤为有效，也可作为即插即用模块或可训练架构组件。

Insight: 利用有序结构和质量分段绕开全量两两相似度比较，兼顾聚合保留信息与计算复杂度。两数量级是长序列设置下最高加速，摘要未列具体任务、长度和绝对延迟。

Abstract: Modern vision and language models process ever longer token sequences, and reducing them is the main lever on downstream cost. Token compression, however, faces a fundamental trade-off: selecting tokens discards information, while existing merging methods preserve it only through pairwise token-to-token matching or $MN$ token-to-output interactions. We introduce LapMerge, a differentiable merging operator that resolves this trade-off for ordered sequences: a learned mass distribution partitions the sequence into exactly $N$ equal-mass segments under a Laplace-kernel density, and prefix/suffix scans aggregate each segment, so both the forward and the backward pass run in $\mathcal{O}(M+N)$ time. This combination - an exact output budget, end-to-end differentiability, and linear cost - is precisely what previous reducers trade off against one another. The budget can be changed without changing operator parameters, and the learned mass doubles as a token-level map of where the budget is allocated. Across vision and vision-language tasks, LapMerge matches or improves on strong token reducers while being up to two orders of magnitude faster at large sequence lengths; it is particularly effective when token order reflects spatial or temporal locality, and works both as a drop-in reduction module and as a trainable architectural component.

[83] Event-based Action Recognition by Pre-Training on Multi-Frame Representations cs.CVPDF

Emma Norrby, Tomas Wilkinson, Per Nyblom, David Gustafsson

TL;DR: 该研究提出多帧事件表示并用稀疏感知掩码自编码预训练 ViT，以改善长时复杂事件序列动作识别；在 THU-EACT-50 CHL 和 DailyDVS-200 上达到 SOTA。

Details

Motivation: 事件相机能捕捉快速运动并具有更好的隐私属性，但基于帧的事件表示在短序列上有效，面对更长、更复杂事件序列时区分能力显著下降。

Result: 作者设计多帧事件表示，相较单帧版本大幅提升识别表现。训练中采用掩码自编码预训练 Vision Transformer，结合稀疏感知掩码算法与 token 选择机制，以提高下游效果并控制计算复杂度；解码器另使用多个 mask token 和位置感知注意力，进一步改善性能。对具有挑战性的长时、复杂事件序列，方法在 THU-EACT-50 CHL 和 DailyDVS-200 上取得 SOTA；摘要未报告具体准确率。

Insight: 延长表示的时间覆盖范围为复杂动作提供更丰富动态线索，同时通过稀疏掩码和 token 选择控制计算成本。结果支持两项指定事件动作基准，尚无摘要级跨传感器或实时推理数据。

Abstract: Action recognition is a crucial task in domains like robotics, patient monitoring, or surveillance. Recently, event-based action recognition has attracted much attention due to the event camera’s ability to capture fast motions and its improved privacy over conventional vision cameras. While frame-based event representations work well for short event sequences, their discriminative ability declines sharply with longer and more complex event sequences. In this work, we introduce a multi-frame representation that greatly improves recognition performance over its single-frame counterpart. We adopt a masked auto-encoding framework to pre-train a Vision Transformer using a sparsity-aware masking algorithm and token selection mechanism to improve downstream performance and control computational complexity. We also introduce multiple mask tokens for the decoder with a position-aware attention mechanism, leading to further improved performance. Our proposed method shows impressive performance for challenging long-duration and complex event sequences, yielding state-of-the-art performance on THU-EACT-50 CHL and DailyDVS-200.

[84] Revisiting the Task of Building Damage Assessment by Satellite Imaging cs.CVPDF

Anthony Cioppa, Virgile Blua, Sébastien Piérard, Pietro Ceccato, Marc Van Droogenbroeck

TL;DR: 本章从数据、评估和方法三方面重审卫星图像建筑损伤评估，主张采用传感器无关、实例级任务定义及多分数排名式评估，并指出跨事件/地区泛化仍是难题。

Details

Motivation: 地震、风暴和洪水造成大量建筑损害，快速可靠的损伤地图对救援至关重要。尽管过去十年数据集与监督深度学习发展迅速，该领域仍缺少共享的任务基础和稳健评估方式。

Result: 本章按数据、评估、方法三条主线重新梳理建筑损伤评估（BDA）。任务定义方面，作者主张传感器无关、实例级定义，并允许缺少灾前影像；数据方面，按传感器模态、时间配置和地理覆盖梳理现有数据集。评估方面指出单一汇总分数在理论上脆弱，提出信息量更丰富的排名式多分数协议基础。方法综述覆盖专用深度网络和新近地球观测基础模型，发现对未见灾害事件和地区的泛化仍未解决。最后讨论如何用交叉验证、挑战赛和私有数据共享等组织方式建立开发者与使用者间的信任。

Insight: 文章重点是任务与评估框架的概念性重审，而不是提出单一新模型。其建议强调灾前影像缺失这一现实约束，并用多维排名减少单一分数带来的脆弱结论；具体实现应参考正文。

Abstract: Natural disasters such as earthquakes, tropical storms, and floods cause extensive damage to buildings, and rapid, reliable damage maps are essential to guide emergency response. Automating this task, referred to as building damage assessment (BDA), from satellite imagery, has become an active research topic at the intersection of remote sensing, computer vision, and machine learning, particularly since supervised deep learning methods were shown to outperform earlier handcrafted approaches. Yet, despite a decade of intense activity and the release of several large-scale datasets, the field lacks a shared foundation. This chapter revisits the task of BDA from first principles, organized around three pillars: data, evaluation, and methods. We first clarify the candidate task for- mulations and argue for a sensor-agnostic, instance-based definition that tolerates missing pre-event imagery. We then review existing datasets along the axes of sensing modality, temporal configuration, and geographic coverage. On the evaluation side, we show that prevailing practices, largely based on a single aggregate score, are theoretically fragile, and we lay the foundations of a more informative, ranking-based, multi-score protocol. We further review methods ranging from task-specific deep networks to recent Earth observation foundation models, noticing that generalization to unseen events and regions remains an open difficulty. Finally, we discuss how these elements can inform the organization of a BDA challenge, including cross-validation, challenge, and private data-sharing setups designed to build trust between developers and users.

[85] Can machines reason non-verbally? cs.CVPDF

Shaheer U. Saeed, Zion Tse, Gregory Slabaugh, Daniel C. Alexander, Yipeng Hu

TL;DR: GenVerOpt 将视觉非语言推理建模为逐样本候选生成、验证和优化流程；作者报告其在抽象 IQ 题、前列腺分割、肝血管重建和肿瘤边界对齐上达到或超过对应人类/专家/先进方法。

Details

Motivation: 机器在语言推理和方程求解上已有能力，但在抽象图案补全、模糊区域勾画等视觉非语言推理任务上仍有限。与可用逻辑规则或程序测试验证的语言中间步骤不同，视觉推理中间过程隐含，缺少清晰验证方式。

Result: 作者提出 GenVerOpt，将候选生成、正确性验证和迭代细化整合为逐样本优化流程，而不是只依赖训练阶段从数据集趋势中学到的能力。论文称该流程在多个领域超过现有系统：抽象 IQ 谜题超过人类，前列腺癌分割匹配临床医生，肝血管重建超过专家，肿瘤边界对齐优于先进方法。摘要未说明对应评测集、样本规模、评分指标或统计显著性。

Insight: 该工作把视觉推理能力归纳为对单个样本提出并核验候选方案，而不是只从语言化推理链入手。摘要提出跨领域强比较结论，但缺少具体评测细节，需依正文理解与人类/专家结果的比较条件。

Abstract: Modern machines can solve equations, follow logic and reason through language, yet they still struggle with problems that require visual non-verbal reasoning. This is evident even in advanced systems such as DeepSeek, ChatGPT and Gemini, which remain limited on visual tasks such as completing abstract patterns or delineating ambiguous regions-of-interest. Unlike explicit intermediate steps in verbal reasoning which can be verified through logic or automated tests, visual reasoning involves implicit intermediate steps with no clear methods for verification. Non-verbal reasoning is therefore challenging to model and, as a result, remains a fundamental limitation of current machine intelligence. Here we introduce GenVerOpt, a general framework that unifies generation, verification and optimisation into a reasoning pipeline for machines. By generating candidate solutions, verifying their correctness, and iteratively refining them, GenVerOpt enables per-sample optimisation rather than relying solely on dataset-level trends captured during model training. This process mirrors human problem-solving where multiple possibilities are imagined, evaluated, and refined until a correct solution emerges. Across diverse domains, GenVerOpt demonstrates capabilities beyond existing systems: it surpasses humans on abstract IQ puzzles, matches clinicians in prostate cancer segmentation, exceeds experts in liver vessel reconstruction and outperforms state-of-the-art approaches in tumour boundary alignment. These results show that machine reasoning can extend beyond language, establishing visual non-verbal reasoning as a foundation for more flexible and generalisable intelligence.

[86] Hide and Seek: HIDE Concepts to SEEK explanations for black box models cs.CV | cs.AI | cs.LGPDF

Bhanu Tokas, Rahul Nair, Rockwell Jackson, Hannah Kerner

TL;DR: Hide and Seek（HnS）无需黑盒视觉模型权重或概念标注集，通过检索含概念图像、遮挡局部并比较输出变化，提供可解释的图像级概念归因。

Details

Motivation: 概念归因用人类可理解的概念解释模型预测，但已有方法多限于分类/回归，依赖模型权重或大型概念标注数据集，且多数不能产生图像局部归因。

Result: 给定概念和图像集，HnS 先用视觉语言模型检索概念相关图像，再在每张图中定位该概念、遮挡对应区域，并以原图和遮挡图的黑盒模型输出变化测量归因。由于直接观察模型行为，该方法可扩展到多种视觉模型和任务，并支持局部贡献分析。在 CelebA 和 COCO-Stuff 上，HnS 相较既有方法与真实归因的一致性更高；作者还展示图像描述和卫星图像分割等现有概念归因方法不适用的任务。摘要未提供具体一致性分数。

Insight: 归因由黑盒模型对“概念区域被遮挡”的行为变化定义，因此不需访问内部权重；VLM 的角色是找图并定位概念。结论覆盖 CelebA、COCO-Stuff 及示例任务，未报告定量结果或概念定位误差。

Abstract: Interpreting machine learning model predictions is a central challenge, particularly for black-box vision models. Concept-based attribution methods interpret models using human-understandable concepts. Existing concept-based methods can only interpret classification and regression models. They require access to model weights or large concept-annotated datasets, and most methods cannot provide image-level attribution. We propose Hide and Seek (HnS), a new method for concept-level attribution that does not require access to model weights or labeled concept datasets. HnS can interpret a wide range of vision models. Given a concept and image set, HnS retrieves concept-aligned images using a vision-language model, localizes the concept within each image, masks the localized region, and measures attribution from the change in the black-box model’s output between the original and masked images. This enables faithful attribution by directly measuring the model’s behavior and supporting local attributions. We validated HnS on CelebA and COCO-Stuff. Compared to existing methods, HnS showed better agreement with ground-truth attributions. We demonstrated the applicability of HnS on diverse tasks, including image captioning and satellite image segmentation, where no existing concept attribution method can be used. We provided our anonymous code in the supplementary material.

[87] Images Talk Back: Guiding MMDiTs by Suppressing Image-to-Text Feedback cs.CVPDF

Yucheng Yang, Xiaoxiao Sun, Shusheng Yang, Jiakang Chen, Serena Yeung-Levy

TL;DR: SFG/iSFG 通过削弱多模态扩散 Transformer 的图像到文本反馈并加强文本到图像条件改善生成；FLUX 上 GenEval 从 0.6661 升至 0.7479，SD3.5M 的 iSFG 相对 CFG 提高 HPSv2.1 1.33 且不增加 NFE。

Details

Motivation: MMDiT 联合注意力使正在生成的图像不断更新内部文本表示，文本表示再影响后续图像。该反馈可能修正偏离提示的内容，也可能固化已经出现在图像中的错误；作者研究其作用并设计选择性干预。

Result: 实验发现图像到文本（I2T）反馈会保留当前图像中已有对象和属性，包含错误；移植反馈消息既可能挽救失败，也可能破坏成功。在匹配干预强度下，抑制 I2T 反馈可改善生成，反向控制则变差。Semantic Feedback Guidance（SFG）通过远离一个增强 I2T 反馈、削弱文本到图像条件的辅助分支来抑制反馈；原位变体 iSFG 直接减弱 I2T、增强文本到图像条件，不需额外模型评估。时间干预实验建议 SFG 只在采样前 20% 步运行，约需基线 1.2× NFE（无 CFG）。三个图像主干上对齐度和偏好分数提高：FLUX 加 CFG 后 GenEval 从 0.6661 到 0.7479；SD3.5M 上 iSFG 相较 CFG 多 1.33 HPSv2.1 且零额外 NFE。控制也迁移到文生视频和图生视频并提升 VBench。

Insight: 生成中的图像状态会经 I2T 路径反馈并固化已有内容，因此减少这种反馈可恢复文本条件的纠偏作用。不同变体成本不同：iSFG 无额外 NFE，而 SFG 约增加 1.2×；具体分数对应所列主干和指标。

Abstract: Multimodal diffusion transformers (MMDiTs) allow the evolving image to update internal text representations through joint attention. These representations then guide subsequent image updates, raising a question: does this feedback help correct deviations from the prompt, or preserve them? We find that image-to-text (I2T) feedback can preserve the objects and attributes already represented in the evolving image, including errors. Transplanting I2T messages can rescue failures or disrupt successes. At matched intervention strengths, suppressing the influence of I2T feedback improves generation, whereas opposite controls degrade it. These findings motivate Semantic Feedback Guidance (SFG), which suppresses the influence of I2T feedback by guiding away from an auxiliary branch that strengthens this feedback and weakens text-to-image conditioning. The in-place variant, iSFG, directly suppresses I2T feedback and strengthens text-to-image conditioning, requiring no extra model evaluations. Temporal interventions motivate running the SFG branch during the first 20% of image sampling steps, requiring about $1.2\times$ the base NFE without classifier-free guidance (CFG). Experiments across three image-generation backbones show gains in alignment and preference-model scores. On FLUX, adding SFG to CFG raises GenEval from $0.6661$ to $0.7479$; on SD3.5M, iSFG adds $+1.33$ HPSv2.1 over CFG at zero extra NFE. The control also transfers to text-to-video and image-to-video generation, improving VBench scores. Code is available at https://github.com/yyc1215lll-creator/SFG.

cs.CL [Back]

[88] Contextual Correction of Parallel Drafts for Speculative Decoding cs.CLPDF

Roy Eisenstadt, Harel Lidar, Tal Gonen, Omer Luxembourg, Itamar Zimerman

TL;DR: 提出 DCOCO，在保持扩散草稿并行生成的同时，为草稿块候选 token 进行邻位上下文兼容性评分，恢复自回归生成中可用的块内依赖。

Details

Motivation: 扩散草稿器可一次并行预测多个未来 token，避免逐 token 自回归开销；代价是块内 token 预测看不到前面草稿 token 的实际身份，丢失自然的局部依赖。

Result: DCOCO 不为每个位置只选 top-1，而保留多个 token 候选，并并行评估相邻草稿位置的上下文兼容性，以较低额外成本选取更合适组合。在四种 verifier 骨干、十个基准上，所有评测设置（贪心/随机解码、扩展推理开/关）平均吞吐均最高，较原始解码最高加速 6.6×。并发服务 4–32 个请求时较最强竞品高 6%–23%；其他顺序校正器在这些负载下甚至低于未经校正 DFlash。

Insight: 在并行块内保留多个候选并联合做上下文选择，可以恢复依赖而不放弃并行性；高并发下避免顺序校正延迟尤其重要。

Abstract: Speculative decoding accelerates large language model inference by using a lightweight drafter to propose multiple tokens that are subsequently verified in parallel by the target model. Recent diffusion-based drafters make this paradigm particularly attractive: deep attention-based neural backbones provide strong predictions, while drafting multiple future positions in parallel avoids the sequential cost of autoregressive generation. This parallelism, however, comes at a cost. Tokens within a draft block are predicted without access to the realized identities of preceding draft tokens, removing intra-block dependencies that would naturally be available under autoregressive generation. We introduce DCOCO (DFlash Contextual Corrector), a lightweight mechanism that restores these dependencies while preserving parallel drafting. Rather than committing to each position’s top prediction, DCOCO retains multiple candidate tokens and evaluates their contextual compatibility across adjacent draft positions in parallel, enabling contextually informed token selection at low additional cost. Across four verifier backbones and ten benchmarks, DCOCO achieves the highest average throughput in every evaluated configuration, spanning greedy and stochastic decoding with and without extended reasoning, with speedups of up to 6.6x over vanilla decoding. Its advantage persists under concurrent serving: DCOCO outperforms the strongest competing method by 6-23% across 4-32 concurrent requests, while other sequential correctors fall below uncorrected DFlash at these loads. These results demonstrate that recovering intra-block dependencies through parallel contextual scoring delivers consistent acceleration across decoding regimes and serving loads.

[89] SWE-Duel: Towards a Self-Scaling Arena for Coding Agents cs.CL | cs.SEPDF

Wei Minn, Zhensu Sun, Lwin Khin Shar, David Lo

TL;DR: 提出 SWE-Duel，一个评测时生成任务和 oracle 的自扩展编码代理竞技场，通过红蓝回合让代理互相出题和修复，避免静态基准泄漏及饱和。

Details

Motivation: 静态编码基准发布后任务会泄漏到训练数据，更强代理最终会饱和；基准难度固定且内容预先存在。作者主张任务和判定应在评估时生成，并让参与代理能力决定挑战难度。

Result: 每轮 Red 代理在真实仓库中跨三个上下文隔离会话实现新功能，加入细微 bug 和密封触发测试。PR 需通过功能测试、仓库现有测试且恰好失败 bug 测试；同代理的新会话还需盲修复成功，排除无解任务。Blue 不知存在 bug，只有修订通过三类测试才获胜，随后交换角色。11 种模型—harness 配置在 15 个仓库、五种语言进行 1,500 回合比赛。GPT-5.5+Codex CLI 解题能力最强，修复所审 bug 的 98.3%；Claude Opus 4.8+mini-swe-agent 出题能力最强，Red 胜率 27.3%。同一模型家族中，最新版所写任务击败固定参考解题器的比例为 42.9%，旧版任务为 4.0%，初步支持任务难度随出题能力扩展。

Insight: 基准能够评测出题和解题两种能力，并在评估时生成任务降低预泄漏。SWE-Duel 的可解性验证依赖同一 agent 后续盲修复。

Abstract: Static coding benchmarks are fixed at release. Over time their tasks leak into training data, and stronger agents eventually saturate them. We argue that a benchmark should instead aim to be self-scaling: its tasks and oracles are created at evaluation time, so no content exists in advance to leak, and its difficulty is set by the participating agents rather than fixed at release. We introduce SWE-Duel, an arena in which two coding agents evaluate each other over mirrored Red-Blue turns. In each turn, the Red agent works on a real repository across three context-isolated sessions. It proposes and implements a new feature with feature tests, then embeds a subtle bug in that feature along with sealed bug-triggering tests. The resulting pull request is admitted only if (1) it passes the feature tests and the repository’s existing tests while failing exactly the bug tests, and (2) a fresh session of the same agent can repair the bug blind, which rules out unsolvable tasks. The Blue agent then reviews the pull request without being told a bug exists. It wins only if its revision passes all three test suites, and then the two agents swap roles. We run a tournament among 11 model-harness participants on 15 repositories in five languages for 1,500 turns. The leaders win in different ways. GPT-5.5 with Codex CLI ranks first as the strongest solver, repairing 98.3% of the defects it reviews. Claude Opus 4.8 with mini-swe-agent ranks second as the strongest task author, with a 27.3% Red win rate. Finally, within one model family, tasks written by the newest version defeat a fixed-reference solver far more often than those of older versions (42.9% vs. 4.0%), giving preliminary evidence that task difficulty scales with task authoring capability.

[90] AutoIndexer: Flexible-Order Decoding by Training Causal Models on Chains of Edits cs.CL | cs.AI | cs.LGPDF

Shu Ishida, Aliasghar Khani, Tianyu Zhang, The Cong Luong, James Seale Smith

TL;DR: 提出 AutoIndexer，通过训练自回归语言模型执行可变长度的链式编辑，使模型能在生成后对任意上下文 token 插入、替换和删除。

Details

Motivation: 自回归模型不擅长跨引用或依赖未来内容等非因果顺序数据，生成后不能修订；扩散 LLM 虽部分缓解，也难灵活改变预生成上下文的 token 数量。

Result: AutoIndexer 训练模型预测编辑开启/关闭标记，并移动光标定位现有 token 序列，像文本编辑器一样进行后验修改。训练样本通过对真值执行逆链式编辑生成，模型学习撤销这些扰动；这种扰动训练使其适应错误上下文和代码纠错。作者展示后生成编辑能力，这是大多数自回归和扩散模型缺少的，同时标准 LLM 基准表现未受损。摘要未提供各任务具体分数。

Insight: 将编辑序列纳入因果模型训练，使其能够对已有生成结果做可变长度修订，兼有自回归效率和后编辑能力。

Abstract: Autoregressive decoding is less suited to non-causally ordered data, e.g., cross-references or future dependencies, since their outputs cannot be revised post hoc, unlike iterative human reasoning. Diffusion LLMs partially mitigate this limitation but still cannot flexibly insert or remove arbitrary numbers of tokens from a pre-generated context. We design AutoIndexer as a generative model with a novel training and decoding mechanism that simulates a Chain of Edits, allowing the model to flexibly modify its prior outputs in hindsight via token insertions, substitutions, and deletions. The model learns to predict marker tokens for opening and closing edits, simultaneously moving a cursor to positions in the existing token sequence, analogous to a text editor. Training sequences are obtained by perturbing ground-truth labels with inverse chained edit operations, and the model learns to edit by undoing those inverses. The perturbation training allows AutoIndexer to be robust to erroneous context and adaptable to editing tasks such as code correction. We demonstrate that our method exhibits post-generation context-editing capabilities that most autoregressive and diffusion models lack without compromising performance on standard LLM benchmarks. The code is available at https://github.com/AutodeskAILab/autoindexer.

[91] Reflective Prompt Optimization of a Deep-Research Agent: A Topic-Disjoint, Multi-Seed Protocol for Measuring Transferable Gains and Prompt-Level Overfitting cs.CLPDF

Elias Lumer, Sahil Sen, Vamse Kumar Subbiah, Kevin Paul

TL;DR: 研究对深度研究代理进行反思式提示优化，并用主题互斥、多随机种子和 verifier 消融区分可迁移收益、提示记忆与评分噪声。

Details

Motivation: 提示优化比 RL 便宜且产物可读，但事实任务中优化器可能把训练答案写进提示，使训练内提升变成记忆而非通用行为。

Result: 作者对多代理深度研究系统两个系统提示做 GEPA 进化，使用训练、验证、测试主题完全隔离的划分。留出引用奖励提高 0.079，从 0.702 到 0.781，bootstrap 95% 置信区间 [0.051,0.107]，三次随机种子复现均值增益 0.107。获胜提示近一半文本像记忆答案，但受控消融显示这些内容即使在其精确训练问题上也没有奖励；验证—留出差距更可能源于小样本和嘈杂评审器。分解式逐维反馈是因果有效因素，压成单一标量奖励则留出迁移为负。收益在不同家族评审器下保持，手写复现该策略也大体得到同样提升。

Insight: 可信提示优化评测需主题留出、多种子和 verifier 消融；表面出现训练答案并不必然产生记忆收益，奖励分解是迁移的关键。

Abstract: Prompt optimization is an attractive alternative to reinforcement learning for adapting language-model agents, since it is cheap and produces human-readable artifacts. On factual tasks, however, it carries a failure mode that scalar-reward reinforcement learning does not. An optimizer that reads the training examples can write their answers into the prompt, so an in-distribution gain may be memorization rather than transferable behaviour. We apply reflective prompt evolution (GEPA) to the two system prompts of a multi-agent deep-research agent and evaluate it under a topic-disjoint split in which no topic is shared across train, validation, and test. Held-out citation reward rises by 0.079, from 0.702 to 0.781, with a bootstrap 95% confidence interval of [0.051, 0.107], and the gain replicates across three seeds (mean 0.107). Nearly half of the winning prompt is a memorized answer key, yet a controlled ablation shows this content earns no reward even on the exact training questions it encodes. The large validation-minus-held-out gap is therefore small-sample selection under a noisy judge, not memorization. Varying the verifier isolates what makes the gain transfer. Decomposed per-dimension feedback is the causal ingredient, and collapsing it to a single scalar reward makes held-out transfer negative. The gain persists under an out-of-family judge and is largely reproduced by a hand-written version of the discovered recipe. Credible evaluation of prompt optimizers therefore requires held-out topics, multiple seeds, and verifier ablations. We release the candidate prompts, lineage diffs, figures, tables, and analysis.

[92] Unsupervised Multimodal Reward Modeling cs.CL | cs.AI | cs.CVPDF

Yueying Li, Jingxuan Fan, Kianté Brantley, Sham M. Kakade, Hanlin Zhang

TL;DR: 提出无需人类偏好标签的多模态奖励模型：在冻结 Qwen3-VL 中间层上训练线性头，判断网络字幕及其同图扰动版本的相对质量。

Details

Motivation: 视觉语言奖励模型通常需要昂贵且有分歧的人类偏好对，训练后又按基准准确率排名；但基准得分未必刻画模型真实奖励行为。

Result: 奖励头仅用网页 caption 与同图扰动版本训练，人类标注只用于挑选最佳中间层。中间层选择关键，较最后层提高 5.8 分；无需重调即可迁移的单一方案在三个基准上达到或超过 GPT-4o（32B），VL-RewardBench 高 6.6 分，参数仅数千、计算约为微调千分之一。同等配对预算下，扰动监督比精选 RLAIF-V 对冻结头高 3–5 分。冻结骨干下目标为凸优化，但结果由扰动采样器定义：两组不重叠样本训练的头基准得分相同，幻觉评估却相差 6.4 分。用策略自身 verifier 标注候选再训练可使 caption 幻觉下降 5.1 CHAIR 分、图像生成 pass rate 增 5.4%，尽管所有奖励基准分数下降。

Insight: 奖励模型不应仅由基准排名定义；训练偏好扰动规定了其奖励含义，和后续策略分布结合的 verifier bootstrap 可改善具体下游行为。

Abstract: Vision-language reward models are trained on annotated preference pairs, which are expensive to collect, can disagree, and are ranked by benchmark accuracy. We build one with no human preference label: a linear head on an intermediate layer of a frozen Qwen3-VL backbone, trained to score a web caption above a perturbed version of the same caption; labeled data enters only to select the layer. The layer is the decisive choice, worth 5.8 points over the last layer, and one recipe transferred without re-tuning beats or at least matches GPT-4o on three benchmarks at 32B, 6.6 points ahead on VL-RewardBench, from a few thousand parameters at about a thousandth of fine-tuning compute. At an equal pair budget, perturbations teach a frozen head 3 to 5 points more than curated RLAIF-V pairs. Because the backbone is frozen, the objective is convex, and the perturbation sampler specifies the reward, which the benchmark does not identify: two heads trained on disjoint halves of the same perturbations tie on the benchmark and differ by 6.4 points in hallucination judging. Retraining the head on the policy’s own verifier-labeled candidates cuts caption hallucination by 5.1 CHAIR points and lifts image-generation pass rate by 5.4, while scoring lower on every reward benchmark. Together, an intermediate-layer probe, free same-image perturbations, and a verifier-driven bootstrap turn give a recipe for multimodal reward modeling that needs no annotator, costs a fraction of fine-tuning, and is specified by the comparisons it is trained on rather than by a benchmark rank.

[93] GeoFitBench-LLM: A Benchmark for Assessing Large Language Models’ Capabilities in Geospatial Data Requirements Elicitation for Geo-Analytic Tasks cs.CL | cs.AIPDF

Amirhossein Vahdat, Thierry Badard, Luc Lamontagne

TL;DR: 提出 GeoFitBench-LLM，评估 LLM 能否从自然语言地理分析需求中识别所需数据资源、支持材料及属性级约束。

Details

Motivation: LLM 正成为 GeoAI 系统的重要组成，但评估很少覆盖地理数据需求 elicitation；检索型地理分析若未先确定所需数据集和约束，就无法可靠执行。

Result: 基准覆盖时空关系推理和语义 grounding 两个维度，用固定、独立于供应商的 schema 编码数据需求，以可复现实验评价资源识别和属性规格。七个模型在极简提示下评测时，识别所需资源通常可行；GPT-5.4 Thinking 在 66.67% 请求中找回完整资源集合，得分最高。随着推理要求增加，准确描述资源是否适用及满足哪些约束更困难。

Insight: 正确找出数据源不等于判断其是否适用于具体地理分析；固定 schema 有助于分开测资源识别和属性级规格。

Abstract: Large language models are becoming central to GeoAI systems, yet their evaluation rarely considers the elicitation of geospatial data requirements. This omission is critical as retrieval oriented geo-analytic tasks cannot be supported reliably without first identifying the necessary datasets and constraints. GeoFitBench-LLM is introduced as a benchmark for assessing whether LLMs can infer the datasets, the supporting resources and the constraints required by geo-analytic requests in natural language. The benchmark is structured around two reasoning dimensions, Spatio-Temporal Relational and Semantic Grounding, reflecting long-standing challenges in geospatial information retrieval and related natural language tasks. Ground truth requirements are encoded in a fixed, provider-independent schema for reproducible evaluation of resource identification and attribute-level specification. Experiments on seven models under minimal prompting indicate that identifying the necessary resources is often achievable, with GPT-5.4 Thinking achieving the best result by recovering the complete set of resources in 66.67% of benchmark requests. Results further indicate that accurate fitness-for-use specification remains more difficult as inferential demands increase.

[94] MADS: Multi-Agent Dialog Simulation for Robust Conversational Agents cs.CLPDF

Arkajyoti Chakraborty, Adam Zernik, Ishika Kulkarni, Mudit Arora, Hugo Lin

TL;DR: 提出 MADS 多智能体对话模拟数据流水线，并构建包含多类非合作用户轨迹的任务型对话鲁棒性基准 MADS-Bench。

Details

Motivation: 任务型对话代理在真实用户不合作时仍脆弱；现有函数调用基准对抗性对话轨迹不足，限制了训练鲁棒代理的数据。

Result: MADS 自动生成结构化、多样对话轨迹，并注入对抗交流以产生经验证的失败路径。基于此构建的 MADS-Bench 覆盖六个领域、55 种用户画像、1,095 段对话，其中约 66% 含易失败场景。作者采用监督微调加可验证奖励强化学习两阶段训练方案评估鲁棒性；摘要未提供模型表现数值。

Insight: 针对失败路径的合成对话可补足正常用户基准，便于评测系统面对不合作交流时的稳健性；该摘要主要介绍数据和训练协议。

Abstract: Task-oriented conversational agents remain fragile under realistic conditions, especially when users exhibit non-cooperative behavior. Existing function-calling benchmarks underrepresent adversarial conversation trajectories, thereby limiting the training resources available for developing robust agents. We present MADS (Multi-Agent Dialog Simulation), a synthetic data generation pipeline that produces structured, diverse dialogue trajectories. We inject adversarial conversation, producing validated conversation trajectories that capture realistic, unhappy paths. Using MADS, we construct MADS-Bench: a benchmark spanning six domains, 55 personas, and 1095 conversations, with approximately 66% of conversations containing failure-prone conversation scenarios. We evaluate the robustness of the trained models using a two-stage training approach that combines supervised fine-tuning (SFT) and reinforcement learning with verifiable rewards (RLVR).

[95] When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks cs.CLPDF

Yisheng Li, Dongming Han, Hongkun Pan, Bingcheng Mao, Zijian Wang

TL;DR: 提出 MisVisAgentBench，使用成对清晰/误导图表任务评估网页智能体将视觉误读传递到后续浏览与决策动作的风险。

Details

Motivation: 网页代理常将图表和仪表盘作为中间证据，误导性可视化即使没有明确恶意指令，也可能影响判断并传播到实际行动。与图表问答不同，这种执行级可靠性风险研究不足。

Result: 基准含 280 个清晰—误导配对任务，仅图表证据不同；诊断框架区分误导诱发错误与任务本身难度，并记录额外浏览步骤和决策犹豫等执行效应。13 个 VLM 网页代理评估中，用误导图表替换清晰图表使平均任务成功率降低超过 34 个百分点。失败主要沿被针对的误导行动分支发生，说明欺骗图表会系统性重定向决策，而非随机干扰。

Insight: 网页代理安全评估应测试图表误导如何影响真实执行动作，而不只看图表问答准确率；配对设计隔离图表内容影响。

Abstract: Web agents increasingly browse, interpret, and act on web content on behalf of users. In many realistic workflows, however, the visual evidence they consume is not neutral: charts and dashboards can be misleading, shaping judgments without issuing any explicit malicious instruction. Unlike chart question answering, Web Agents treat charts as intermediate evidence whose misinterpretation can propagate into concrete downstream actions — a reliability risk that remains underexplored. We introduce MisVisAgentBench, the first paired executable benchmark for evaluating how misleading visualizations affect Web Agent execution. It comprises 280 task instances in matched clean–misleading pairs that differ only in chart evidence. We further provide a diagnostic framework that isolates misleading-induced failures from baseline task difficulty (Zhu et al., 2025) and captures execution-level effects such as extra browsing steps and decision hesitation. Across thirteen vision-language Web Agents, replacing clean charts with misleading counterparts reduces the average task success rate by more than 34 percentage points. Moreover, these failures predominantly follow the targeted misleading action branch, suggesting that deceptive charts systematically redirect rather than randomly disrupt agent decisions. These results reveal that visualization robustness is a critical yet understudied dimension of Web Agent safety and reliability.

[96] COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering cs.CL | cs.AI | cs.LGPDF

Kavinda Kehelella, Sanghamitra Dutta

TL;DR: 提出 COFFEQA，用经上下文依赖度验证的事实—反事实样本对进行少样本问答蒸馏，避免选取教师决策边界附近的不确定样本造成退化。

Details

Motivation: 少样本蒸馏可降低生成式任务成本，但效果高度依赖训练样本选择；作者发现教师决策边界附近的不确定样本可能显著损害蒸馏。

Result: COFFEQA 在开卷问答中将反事实定义为最小修改原上下文、使教师改选另一答案的版本，并从几何角度分析事实—反事实对如何约束师生决策边界偏移。Context Following Difficulty（CFD）依据教师是否选择指定替代答案、以及是否依赖被修改上下文来验证反事实；蒸馏只使用 CFD 验证后的样本对。T5、Qwen2.5 系列在五个域内和三个域外基准、相同少样本预算下均优于仅事实样本蒸馏。TriviaQA 的 T5 设置用 32 对样本时，平均 EM 提升 8.77 分、F1 提升 9.98 分。

Insight: 反事实样本只有在教师确实依赖被修改上下文且响应按预期改变时才提供有效监督；CFD 过滤避免将模糊或无关反事实纳入蒸馏。

Abstract: Knowledge distillation aims to train a smaller student model to mimic a larger teacher model for resource-constrained environments. However, the process of distillation is typically data-intensive and computationally expensive, particularly for generative tasks. Few-shot distillation offers an alternative by transferring teacher knowledge using limited training samples. However, we observe that few-shot distillation performance is heavily dependent on the choice of these training samples. In fact, we demonstrate that using more uncertain samples near the teacher’s decision boundary can significantly deteriorate distillation performance. Motivated by this observation, we propose Counterfactual-guided Few-shot Distillation in Open-book Question Answering (COFFEQA), a novel strategy that aptly uses counterfactuals to provide additional supervision around challenging factual samples. In the generative QA setting, we define a counterfactual as a minimally modified context that induces the teacher to change its response to an alternative answer. We provide geometric insights on how factual-counterfactual pairs can constrain the deviation between the teacher’s and student’s decision boundaries. We further introduce a new metric, Context Following Difficulty (CFD) that further validates counterfactuals prior to distillation based on agreement with the intended alternative answer and dependence on the modified context. COFFEQA uses CFD-validated factual-counterfactual pairs for few-shot distillation. Experiments across five in-domain and three out-of-domain QA benchmarks using T5 and Qwen2.5 families show that COFFEQA outperforms factual-only distillation baselines under the same few-shot budget. For instance, on TriviaQA, COFFEQA improves over the factual-only baseline by 8.77 average EM points and 9.98 average F1 points under the T5 setting with 32 few-shot pairs.

[97] SEEDS: Preview-Guided Evidence Admission for Search Agents cs.CLPDF

Jiajin Liu, Chenxi Xu, Dongzhe Fan, Yuanfu Sun, Qiaoyu Tan

TL;DR: 提出 SEEDS，在搜索代理每步将候选证据预览后按当前推理状态决定哪些、多少内容可进入上下文，区别证据检索与证据采纳。

Details

Motivation: 搜索代理可多轮检索外部信息，但常按固定或排名策略自动消费文档，忽略证据价值依赖当前推理状态；低排名候选可能关键，高排名候选也可能冗余、无关或误导。

Result: SEEDS 先为检索候选提供轻量预览，再让代理共同决定完整查看哪些候选及数量。它可选任意子集和灵活基数，不限于固定/自适应前缀，并可直接部署到现有推理代理或进一步学习优化。在九个知识密集型 QA 基准、私有语料和实时网页搜索设置中，SEEDS 一致提升搜索效果，同时显著减少完整证据消费；分析显示可选到对应检索前缀之外的有用候选。摘要未提供具体分数。

Insight: 检索得到候选并不意味着它们都应进入推理上下文；显式证据采纳控制可减少冗余和误导信息，并扩展到非前缀候选。

Abstract: Search agents extend large reasoning models with multi-round access to external knowledge, yet most existing systems largely conflate retrieving evidence with consuming it. Retrieved documents are commonly incorporated according to fixed or rank-based policies, despite the fact that evidence utility is conditioned on the agent’s current reasoning state. Consequently, a lower-ranked candidate may be critical for the current step, while a higher-ranked candidate may provide redundant, irrelevant, or misleading information. We formulate this overlooked problem as evidence admission, which asks, at each search step, which retrieved candidates should be allowed to enter the agent’s evolving reasoning context. To enable such selective control, we introduce SEEDS (Selective Evidence Entry During Search), a preview-guided evidence admission framework for search agents. SEEDS first exposes lightweight previews of retrieved candidates and then lets the agent jointly determine which candidates and how many should be fully inspected, conditioned on its current reasoning state. Unlike fixed or adaptive prefix policies, SEEDS can select arbitrary subsets with flexible cardinality, and it can be instantiated directly with an existing reasoning agent or further optimized through learning. Across nine knowledge-intensive QA benchmarks under both local corpus and live web search, SEEDS consistently improves search effectiveness while substantially reducing full-evidence consumption. Experimental analyses show that SEEDS more effectively selects useful candidates beyond the corresponding retrieval prefix. These results establish evidence admission as a complementary dimension of agentic search, separating what information is retrieved from what information is ultimately allowed to shape reasoning.

[98] What Should SFT Learn? Conditional Information Gain for Generalizable Post-Training cs.CL | cs.AI | cs.LGPDF

Yuxuan Gu, Kequan Niu, Xiaocheng Feng, Yun Li, Yiqiao Yang

TL;DR: CIG-SFT 用任务输入对示范 token 的条件信息增益衡量其教学价值，并据此重加权 SFT，在数学推理和代码生成中改善困难分布上的泛化。

Details

Motivation: 标准 SFT 模仿固定示范轨迹，可能覆盖模型预训练已有的行为，损害分布外泛化。已有动态 SFT 常以模型兼容度调整监督，但模型不熟悉某个 token 既可能意味着示范不匹配，也可能正是任务需要教会模型的关键决策。

Result: CIG-SFT 在 teacher forcing 下比较冻结参考模型在有、无任务输入时对示范 token 的似然，同时固定正确解前缀，以任务带来的不确定性下降估计 token 的条件信息增益。作者据此构造 KL 正则化的策略投影，并推导出梯度与该投影目标完全一致的标量加权 SFT 损失。在数学推理和代码生成基准上，方法持续优于标准 SFT 与近期自适应微调基线，尤其在困难评测分布上泛化更好；无需额外训练数据或在线 rollout，摘要未列出具体分数。

Insight: 监督权重应反映示范决策对当前任务提供了多少信息，而不只是它与模型当前分布有多匹配。理论推导把策略投影转化为可实施的加权 SFT 目标，实验范围限于摘要提及的数学与代码任务。

Abstract: Supervised fine-tuning (SFT) remains a widely used approach for post-training large language models, because fixed demonstrations can directly introduce desired reasoning strategies and behavioral patterns. Yet forcing a model to imitate externally provided trajectories may also interfere with behaviors already supported by pretraining, limiting generalization beyond the training distribution. Recent dynamic SFT methods mitigate this issue by reweighting token-level supervision according to model-side signals such as predictive probability, prior support, or distributional compatibility. However, model compatibility is not equivalent to learning value: a token that is weakly supported by the current model may either be an undesirable mismatch or precisely the task-specific decision that the demonstration is intended to teach. We propose CIG-SFT, an information-theoretic framework that estimates the task-conditioned information carried by each demonstrated token. Under teacher forcing, we compare the token likelihood from a frozen reference model with and without access to the task input while keeping the gold solution prefix fixed. The resulting conditional information gain quantifies how much the task itself reduces uncertainty about the demonstrated decision. We then convert this information into a KL-regularized projection of the current policy and derive an equivalent scalar-weighted SFT objective whose logit gradient exactly matches that of the projected target. Across mathematical reasoning and code-generation benchmarks, CIG-SFT consistently outperforms standard SFT and recent adaptive fine-tuning baselines, with particularly strong improvements in generalization to challenging evaluation distributions, while requiring neither additional training data nor online rollouts.

[99] Evo$^2$: Evolving the Evolver through Weight-Harness Co-Evolution cs.CLPDF

Chejian Xu, Shujian Zhang, Wenxuan Zhou, John Lambert, Beck Chen

TL;DR: Evo² 联合进化智能体权重与工具使用 harness，通过同一策略的提案者—反思者双角色更新，在代码基准和跨任务迁移上超过单独优化权重或 harness 的方法。

Details

Motivation: 自进化智能体通常分别改进模型权重或提示、工具、上下文与执行反馈构成的 harness，忽略两者相互影响。作者希望让 harness 修改及执行结果同时指导策略训练，从而实现更连贯的联合进化。

Result: Evo² 使用单一策略承担 Proposer（编写 harness 修改）和 Reflector（诊断效果并指导修订）两个角色； harness 更新及执行结果也用于训练这两个角色。训练流水线 EvoTIDE 通过编辑提取和前缀续写恢复可用轨迹，并在两类角色间交替使用 SFT 与 GRPO。三个代码基准实验中，Polyglot 得分 82.1%，SWE-bench Verified 得分 48.3%，对应最强基线为 62.6% 和 41.0%；进化后的 harness 可迁移到其他任务，跨基准评测排名第一。双角色方法用于 GPT-5-mini 时，成绩由 24.4% 提升到 48.3%。

Insight: 把 harness 的修改轨迹和执行反馈纳入权重训练，使策略学习如何改进自身运行环境，而不仅是生成代码。报告数值对应文中所列代码基准与实验设置；摘要未提供第三个基准的具体数值。

Abstract: Self-evolving agents are increasingly used to improve language model systems without human intervention through either weight updates or harness improvements. Existing approaches typically pursue these directions separately: some methods update model weights using self-generated experience, while others rewrite the harness that defines how an agent uses prompts, tools, context, and execution feedback. However, these approaches overlook the relationship between model weights and the agent harness. To connect these processes and ensure effective and smooth agent self-evolving, we propose Evo$^2$, a framework for weight-harness co-evolution. For harness updates, we design a unified dual-role pipeline that a single policy serves as both a Proposer, which writes harness edits, and a Reflector, which diagnoses their effects and guides revision. For weight updates, harness modifications and their execution outcomes guide the training of both the Proposer and the Reflector. We further develop EvoTIDE, a training pipeline that recovers usable trajectories through edit extraction and prefix continuation, then combines SFT with interleaved GRPO across the two roles. Extensive experiments across three coding benchmarks demonstrate that Evo$^2$ significantly outperforms existing self-evolution methods. It achieves 82.1% on Polyglot and 48.3% on SWE-bench Verified, compared with 62.6% and 41.0% for the strongest baseline, respectively. We also show that the evolved harnesses transfer to different tasks without further evolution and rank first in cross-benchmark evaluations. Our dual-role harness improvement framework is also able to extend to self-evolution with proprietary models, improving a GPT-5-mini agent’s performance from 24.4% to 48.3%. These results demonstrate the applicability of the framework Evo$^2$ across domains and its broad transferability across models and tasks.

[100] RAMP: Recurrent Adaptive Mixed Precision for Efficient Prefill in Recurrent-Depth Language Models cs.CLPDF

Ke Wan, Chen Chen

TL;DR: RAMP 把混合精度计算安排在递归深度前段、末段恢复高精度，利用误差会被后续递归细化衰减的规律，在 H100 上实现最高 1.16 倍首轮 prefill 加速。

Details

Motivation: 递归深度语言模型反复运行共享网络进行推理，长上下文 prefill 因整段输入被多次处理而成本高。量化虽能加速，但数值误差会沿递归轨迹传播；需要找到低精度计算最适合放置的深度位置。

Result: 作者分析递归深度中的误差传播，发现较早引入的量化误差会受到更多后续递归步骤的衰减。等预算实验支持将低精度放在较早递归步、终端细化恢复高精度时保真度最好。RAMP 对前段递归使用低精度权重与激活计算，末段切回高精度。在最长 4K 上下文实验中，prefill 质量接近全精度；NVIDIA H100 上首轮 prefill 的端到端加速最高为 1.16 倍，对应延迟降低 13.9%。

Insight: 混合精度在递归模型中的收益取决于误差出现的位置：较早误差可由后续细化吸收，末段输出则需要高精度保护。报告的最高加速来自 H100、最长 4K 上下文范围内的实验；摘要未说明其他硬件或生成阶段性能。

Abstract: Recurrent-depth language models improve inference-time reasoning by repeatedly applying a shared network to refine internal representations, but the additional recurrent computation also increases inference cost. This overhead is particularly pronounced during long-context prefill, where the full input sequence is repeatedly processed across recurrent depth. Weight-and-activation quantization offers a natural way to accelerate this computation through lower-precision arithmetic, yet repeatedly applying quantized computation introduces numerical perturbations that accumulate along the recurrent trajectory. We systematically analyze how such errors propagate across recurrent depth and show that quantization errors introduced earlier are attenuated by more subsequent recurrent steps and therefore have a smaller effect on the final representation. Matched-budget experiments strongly support this prediction, showing that placing quantized computation earlier in recurrent depth consistently yields the best fidelity. Based on this insight, we introduce RAMP (Recurrent Adaptive Mixed Precision), which performs early recurrent refinement using low-precision weight-and-activation computation and restores high precision for terminal refinement. Across context lengths up to 4K, RAMP preserves near-full-precision prefill quality while achieving up to 1.16x end-to-end first-prefill speedup on an NVIDIA H100, corresponding to a 13.9% latency reduction.

[101] CoBe: A Benchmark For Conversational Counterfactual Text Editing cs.CL | cs.AI | cs.ET | cs.LGPDF

Arvind Raghavan, Inwoo Hwang, Shreyas Havaldar, Kai-Zhan Lee, Aurghya Maiti

TL;DR: CoBe 是包含 2,000 个自然对话式反事实文本编辑问题的基准，用于检验模型能否只修改假设变化造成的后果并保留其他事实；前沿模型平均得分为 58.05%。

Details

Motivation: 反事实编辑要求改变假设中的原因后，只改动受其因果影响的事件，同时保留原情境中不受影响的事实；关联式生成则可能输出听起来合理、但破坏原有因果结构的故事。既有数据集未能清楚区分这两种能力。

Result: CoBe 覆盖医疗、科学与工程、商业及日常情境，共 2,000 道问题，测试模型在自然对话提示下零样本编辑给定文本的能力。前沿系统平均得分为 58.05%。分析发现模型经常退化为关联式生成；表现也未随模型规模或输出 token 长度稳定增长，提示失败可能与训练目标有关，而非单纯容量不足。

Insight: 评测重点是因果变化的局部性与事实保留，而非生成一个统计上合理的新场景。平均分揭示了当前模型的普遍困难，但摘要未列出各模型分项成绩或类别级差异。

Abstract: Counterfactual text editing is the ability to revise a given text in light of a hypothetical change while preserving facts not causally affected by that change. When asked what would have happened if a doctor had not recommended surgery, the model output should retain the patient’s medical history and modify only the consequences of the decision. This requires causal understanding: a model must determine, without being explicitly instructed to, what events are affected by the hypothetical change and what should remain fixed. This skill is central to human reasoning, especially in safety-critical domains like healthcare or law. By contrast, the task of associational text generation merely generates text statistically associated with the altered condition. In the medical example, an associational response might make the patient’s symptoms less severe because milder cases correlate with no surgery. Such responses produce a plausible scenario, but not the counterfactual version of the given one. Prior counterfactual-text datasets do not clearly separate these modes of reasoning. We introduce the Counterfactual Benchmark (CoBe), a testbed for models’ zero-shot ability to counterfactually edit a given textual scenario when prompted to do so in a conversationally natural way. CoBe contains 2000 questions spanning healthcare, science and engineering, business, and everyday scenarios. We test a suite of frontier and smaller models, with frontier systems achieving an average score of $58.05%$. Our findings indicate that models frequently default to associational generation rather than preserving the causal structure of the original scenario. Moreover, performance does not scale consistently with either model size or output token length, suggesting that the failure may reflect model training objectives rather than insufficient model capacity.

[102] CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation cs.CLPDF

Chandravardhan Singh Raghaw, Shahid Shafi Dar, Arnav Nishith Sharma, Shrey Modi, Nagendra Kumar

TL;DR: CliQ-RRG 将疾病感知的影文对齐、多视图先验注意力和图检索证据结合，再生成简洁 QA 式胸片报告；在两个公开基准的词汇与临床指标上优于既有方法。

Details

Motivation: 放射学报告人工撰写耗时且认知负担大。现有自动生成方法常产生冗长、结构松散的叙述，也可能忽略诊断线索以及当前影像与既往检查之间的多视图关系。

Result: CliQ-RRG 分两阶段运行。第一阶段的疾病感知视觉—文本对齐模块借助预测疾病嵌入对齐影像和文本，先验引导注意力模块 PrAM 建模当前与既往扫描之间的多视图依赖。第二阶段通过 GraphRAG 检索补充图结构临床证据，再由大语言模型将中间文本整理成简洁、可解释的问答对和诊断摘要。在两个公开胸片基准上，作者报告其词汇指标和临床指标均持续超过既有方法；摘要未列出指标名称或具体分数。

Insight: 生成 QA 式结构可将影像发现与诊断摘要显式组织起来，GraphRAG 和跨检查先验分别补足临床知识与时间/视图关联。实验范围是两个公开胸片基准，摘要未支持更广泛影像类型上的结论。

Abstract: Radiology reports are essential for diagnostic reasoning and patient care, yet their manual preparation is time-consuming and cognitively demanding. Automatic radiology report generation (RRG) offers a scalable alternative, but existing models often produce lengthy, unstructured narratives that overlook diagnostic cues and multi-view information. We present Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation (CliQ-RRG), a unified two-stage framework for interpretable and clinically grounded reporting. In Stage 1, CliQ-RRG employs a Disease-aware Visual-Textual Alignment module that aligns image and text representations using predicted disease embeddings, reinforced by a Prior-Guided Attention Module (PrAM) to capture multi-view dependencies across current and prior scans. In Stage 2, GraphRAG-guided retrieval augments intermediate textual representations with graph-grounded clinical evidence, and a large language model restructures them into concise, interpretable question-answer (QA) pairs with diagnostic summaries. Experiments on two public chest X-ray benchmarks demonstrate that CliQ-RRG consistently outperforms prior methods across both lexical and clinical metrics, generating accurate and clinically coherent QA-style radiology reports. Code is available at: https://github.com/chandravardhan-singh-raghaw/CliQ-RRG.

[103] BenCoDiC: A Large-Scale Contextual Cyberbullying Corpus for Bengali Political News Discourse FULL VERSION cs.CL | cs.SIPDF

Md. Nesarul Hoque, Rudra Pratap Deb Nath, Umme Salma, Shima Chakraborty, Md. Hanif Seddiqui

TL;DR: BenCoDiC 发布包含 50,250 条孟加拉语政治新闻网络讨论文本的上下文网暴语料，保留评论回复关系并经双层人工标注达到 κ=0.86、α=0.86。

Details

Motivation: 现有孟加拉语网络欺凌语料在上下文信息、标注透明度、规模、可获取性及多维分析方面不足，限制了稳健检测以及对施害者行为与网络结构的研究。

Result: BenCoDiC 收录来自 100 个 YouTube 视频及相关讨论的 50,250 条文本，保留字幕、评论和回复关系，并用九维星型结构组织用户、视频、文本、上下文、时间、互动、政党、目标身份和语言类别等信息。五种 AI 聊天机器人未达到预先规定的标注可靠性标准，因此改用两阶段人工标注并由专家核验，Fleiss κ 与 Krippendorff α 均为 0.86。语料统计分析及 Transformer 实验显示，加入对话上下文相对孤立文本分类带来幅度不大但稳定的提升。

Insight: 此资源将文本分类、上下文链路和施害者行为/网络分析所需信息放在同一语料结构中，并明确报告自动标注未达标准、转为人工核验。分类提升仅被描述为小幅且稳定，摘要未提供具体指标；数据来源限于孟加拉语政治新闻讨论场景。

Abstract: Cyberbullying is a growing concern in online communities, yet existing Bengali corpora remain limited in contextual information, annotation transparency, scale, accessibility, and support for multidimensional analysis, thereby hindering robust detection and comprehensive study of harasser behaviors and networks. To address these gaps, we introduce the Bengali Contextual and Diverse Cyberbullying (\textit{BenCoDiC}) corpus, a publicly available contextual cyberbullying resource for Bengali political news discourse comprising 50,250 textual instances collected from 100 YouTube videos and their associated discussions. The corpus preserves caption–comment–reply relationships and is organized through a nine-dimensional star schema covering users, videos, textual content, context, time, engagement, political parties, target identities, and language categories. Five AI chatbots were initially evaluated for annotation but did not meet the predefined reliability criterion. Consequently, a two-tier human annotation process with expert verification was adopted, achieving Fleiss’ $κ=0.86$ and Krippendorff’s $α=0.86$. Statistical analyses characterize the corpus, while transformer-based experiments show that incorporating conversational context yields modest but consistent improvements over isolated-text classification. \textit{BenCoDiC} supports context-aware cyberbullying detection and perpetrator-oriented behavioral and network analysis. The corpus is available at https://github.com/bencodic/BenCoDiC-Corpus.

[104] KV-Repurpose: A Testbed for Evaluating Non-Prefix KV-Cache Reuse cs.CLPDF

Taiga Ikeda, Daisuke Miyashita, Jun Deguchi

TL;DR: KV-Repurpose 提供 vLLM 环境下的非前缀 KV 缓存复用评测系统；在指定 Zipf RAG 工作负载和 30 GB 缓存下，token 命中率从前缀缓存的 3.3% 提升至 63.9%，但跨文档推理仍有限。

Details

Motivation: 服务系统通常只复用完全相同的提示前缀，因此即使检索文档相同，只要系统提示、对话历史或动态元数据不同，文档对应 KV 状态也无法复用。需要评估按片段复用带来的性能收益和质量边界。

Result: 开源系统 KV-Repurpose 基于 vLLM，集成缓存感知的片段调度、提示构造、容量管理、工作负载生成和运行时监控。在长上下文实验中，朴素片段复用对单文档问答和摘要的输出质量影响较小，但跨文档推理暴露出明显局限。在 20% 请求共享固定前缀的 Zipf 型 RAG 工作负载中，同为 30 GB 缓存时，片段复用 token 命中率为 63.9%，前缀缓存为 3.3%，并降低 TTFT；即使将前缀缓存容量增至 1 TB，命中率也只有 17.9%。

Insight: 缓存复用机会受重复内容是否位于完全相同前缀限制，片段级复用能显著提高指定工作负载的命中率。质量结论只支持单文档 QA 与摘要；论文明确指出跨文档推理仍有局限，命中率数据也依赖给定请求分布。

Abstract: KV-cache reuse in large language model serving is commonly limited to exact prompt prefixes, preventing reuse when the same retrieved document appears after different system prompts, conversation histories, or dynamic metadata. We present KV-Repurpose, an open-source, vLLM-based system for developing and evaluating segment-wise KV-cache reuse beyond exact prefixes. The system combines cache-aware segment scheduling, prompt construction, capacity management, workload generation, and runtime monitoring. Experiments on long-context benchmarks show that naive segment reuse largely preserves output quality for single-document question answering and summarization, while exposing clear limitations in cross-document reasoning. Under a Zipfian RAG-style workload in which 20% of requests share a fixed prefix, KV-Repurpose achieves a substantially higher token-level cache hit rate than prefix caching at the same 30 GB cache capacity, 63.9% versus 3.3%, resulting in lower TTFT. Even with 1 TB of cache capacity, prefix caching reaches only a 17.9% hit rate in this workload. Source code is available under the Apache-2.0 license at https://github.com/taiga333/eval-kv-repurpose.

[105] SOAR: Source-Aware Reinforcement Learning with Precise Credit Assignment for Search Agents cs.CLPDF

Shengze Huang, Zihao Tang, Jinluan Yang, Xin Yu, Zhenghao Lin

TL;DR: SOAR 将外部检索证据与模型内部知识拆成可观察的并行轨迹，并用来源一致性奖励进行强化学习；在 3B/7B 模型上提升 7.3%/5.4%，证据编造减少 74.8%。

Details

Motivation: 搜索智能体的强化学习容易出现证据编造：智能体跳过外部资料，依赖不透明推理轨迹中的内部知识捷径，导致答案缺乏依据。混合的信息来源也使训练难以判断错误应归因于哪类知识。

Result: SOAR（Source-Aware Reinforcement Learning）把整体推理拆成来源显式的工作流，将外部证据 E_ext 与内部知识 E_int 分成并行、可观察的信息流，并通过 Source-Consistent Reward 奖励与来源相符的回答，从而对不同知识流进行更精确的信用分配。在知识密集型基准上，3B 和 7B 主干模型分别较基线提高 7.3% 和 5.4%，证据编造率降低 74.8%。

Insight: 将来源归因纳入轨迹与奖励，为何种证据支持答案提供了显式监督，既提升任务表现，也抑制绕过检索的虚构。摘要未说明具体基准及百分比是相对提升还是百分点，故保留原文口径。

Abstract: Reinforcement learning (RL) for search agents often suffers from evidence fabrication, a failure mode where agents bypass external information ($E_{ext}$) and fabricate an incorrect answer. We argue that this fabrication arises from an over-reliance on unreliable internal knowledge ($E_{int}$) as shortcuts due to the inherent opacity of reasoning trajectories. To address this, we propose SOAR (SOurce-Aware Reinforcement learning), a paradigm that transforms monolithic reasoning into source-explicit trajectories. SOAR (i) disentangles $E_{ext}$ and $E_{int}$ into parallel, observable streams via a Source-Aware Workflow, and (ii) incorporates Source-Consistent Reward to guide the policy evolution. By making information-source attribution explicit, SOAR enables precise credit assignment between different knowledge streams. Evaluations show that SOAR outperforms baselines on 3B and 7B backbones by 7.3% and 5.4%, while reducing evidence fabrication by 74.8%. These confirm that SOAR significantly improves performance on knowledge-intensive benchmarks while effectively mitigating evidence fabrication, fostering more faithful and grounded reasoning with enhanced robustness.

[106] Scaling Agentic Data for Long-Horizon Terminal Intelligence cs.CLPDF

Shun Zou, Ziyu Ma, Yi Zou, Yong Wang, Lin Chen

TL;DR: TerminalHorizon 自动构造包含阶段递进要求的长程终端任务，生成 1.5K 环境并用于训练 TerminalHorizon-27B；模型在覆盖代码、真实生产智能体任务及通用推理的 12 个基准上均有显著提升。

Details

Motivation: 短轨迹能展示单条命令或工具调用，却难以训练智能体在长期任务中持续探索、积累证据、依据反馈调整策略并交付结果。自动合成环境若预先完成或简化了关键工作，也会让本应由智能体执行的探索、实现和验证变得不必要。

Result: TerminalHorizon 从真实专业工作出发，通过独立执行识别构造过程中遗漏的关键工作，并以所得证据重建环境；随后在同一目标下逐步扩展任务，引入依赖先前结果的新要求，促使智能体继续探索和改进。该引擎构建 1.5K 任务环境，作者用其数据对 Qwen3.5-27B 进行监督微调，得到 TerminalHorizon-27B。模型在涵盖代码智能体、真实生产环境智能体和通用推理的 12 个基准上均取得显著提升。多个 12 小时研究预算的 RSI 案例还显示模型能在初步方案后继续实验、根据反馈改进方法，并将有效改进保留在最终交付中。

Insight: 长程数据合成的重点是保留真实工作中必须由智能体完成的依赖链与验证环节，并让后续要求建立在早期产物上。基准结果和研究案例支持长程持续改进能力；摘要未列出各基准分数或案例数量。

Abstract: Terminal agents are moving beyond local operations toward completing real-world professional tasks. Short trajectories can demonstrate commands and tool calls, but they do not fully show how agents accumulate evidence through exploration, use it to inform judgments, continually adjust strategies based on feedback, and turn intermediate results into final deliverables. High-quality long-horizon trajectories capture these agentic behavioral patterns and their connections within a single problem-solving process, providing richer experience for sustained autonomous work. However, environment synthesis may complete or simplify the key work underlying these patterns in advance and thus remove the need for exploration, implementation, and verification that the agent was meant to perform. To address this, we introduce TerminalHorizon, a fully automated data synthesis engine for long-horizon terminal agents. Starting from real-world professional work, it uses independent execution to identify key work omitted during construction and uses the resulting evidence to guide environment reconstruction. To extend these patterns across stages, it progressively expands tasks under the same goal, introducing new requirements that build on prior results and call for further exploration and improvement. Using this engine, we construct 1.5K task environments and perform supervised fine-tuning of Qwen3.5-27B on the resulting dataset to obtain TerminalHorizon-27B. We achieve substantial performance gains on all 12 benchmarks spanning coding-agent tasks, agentic tasks in real-world production settings, and general reasoning. Multiple RSI case studies, each with a 12-hour research budget, further demonstrate the model’s ability to continue experimenting beyond an initial solution, improve its methods based on feedback, and retain effective improvements in its final deliverables.

[107] PreSTO: Predictive Subtree Prefetching for Fast LLM Power Sampling cs.CLPDF

Nan Jiang, Panagiotis Theodoropoulos, Wei Deng

TL;DR: PreSTO 在不改变 Metropolis–Hastings 转移核的前提下，批量预取 PowerMH 的未来候选并预测遍历子树；七个数据集、五个基础模型上的中位加速最高为 2.33 倍。

Details

Motivation: Power sampling 从基础模型分布的锐化版本采样，能增强测试时推理，但 PowerMH 的接受/拒绝更新是串行的，每一步状态决定下一步候选，限制并行化。既有方案常通过替换采样器或修改模型来降低成本。

Result: PreSTO 将未来 MH 接受/拒绝结果表示成树，在一次模型调用中批量生成一个预取子树中的候选，随后仍按原始 MH 接受规则沿实际路径前进，因此转移核保持不变。考虑到实际采样通常只走子树中稀疏、近似单分支的路径，方法还加入预测遍历规则，以最大化预计完成的转移数。在七个数据集、五种基础 LLM 上，PowerMH、EntropyCut 和 MultiTryMH 的中位加速分别为 1.71×、1.91×、2.33×；前两者模型调用中位数减少 3.9×，单次调用时长为原来的 2.1×。在 LCB V6 的 Qwen3.5-9B 设置中，预测遍历相较默认广度优先遍历再快 1.25–1.37×。

Insight: 通过预取未来候选并保留原接受规则，可并行化采样计算而不近似改变目标转移过程；预测遍历进一步减少无用分支计算。加速数字针对指定算法、基准、模型和中位统计，不能直接外推到其他硬件或负载。

Abstract: Power sampling improves large language model (LLM) reasoning at test time by sampling from a sharpened version of the base model’s distribution. Its sampler, PowerMH, is slow because its Metropolis–Hastings (MH) updates are sequential: each accept/reject decision sets the state from which the next proposal is generated. Prior work reduces this cost by changing the sampler or the model (e.g., sequential Monte Carlo, approximate lookahead, distillation). We propose Predictive SubTree Prefetching (PreSTO), which accelerates PowerMH by prefetching future proposals and provably leaves its MH transition kernel unchanged. PreSTO views future MH outcomes as a tree of accept/reject decisions: in each model call, it generates the proposals of a \textit{prefetched subtree} of this tree in one batch, then follows the realized path with the original MH acceptance rule. We also observe that MH reaches only a sparse, nearly unary part of each prefetched subtree, we further design a \textit{predictive traversal rule} that chooses the subtree to maximize the predicted number of completed transitions. Across seven datasets and five base LLMs, PreSTO achieves median speedups of $1.71\times$, $1.91\times$, and $2.33\times$ on PowerMH and its follow-ups EntropyCut and MultiTryMH, respectively; on the first two, it makes a median of $3.9\times$ fewer model calls, each only $2.1\times$ longer. On LCB V6 with Qwen3.5-9B, the predictive traversal rule is a further $1.25\times$–$1.37\times$ faster than the default breadth-first traversal.

[108] Do Prompt Optimizers Break Requirements They Are Not Scored On? A Preregistered Study cs.CL | cs.LGPDF

Sangdo Han, Moonsoo Kim

TL;DR: 一项预注册研究发现，提示优化器会提高目标准确率，却可能因 200 token 上限导致输出未出现答案而违反格式等未评分要求；将上限增至 1,024 后此类失败消失。

Details

Motivation: 提示优化器会改写提示以提升某个目标指标，但提示中还可能包含目标指标不计分的格式、引用或拒答要求。若优化只顾目标分数，可能出现副作用；评估时也需区分真正的内容退化与输出截断造成的契约违反。

Result: 研究在 HotpotQA、SQuAD 2.0 和 IFEval 上预注册评估 GEPA、MIPROv2、TextGrad，并用确定性检查统计每题对未评分要求的违反。按预注册标准，三种优化器均导致退化；HotpotQA 上引用有效性的净退化为 10.7–41.6 个百分点，同时 exact match 提升 21–34 个百分点。事后拆解发现，优化提示诱发先推理、后输出 JSON；在统一使用的 200 token 上限下，13.9%–47.0% 的回答在任何答案出现前就结束。只看可解析输出时，净退化在 ±3 个百分点内。将上限调到 1,024 token 后，抽取失败消失、内容退化低于 1 个百分点，exact match 进一步上升；两个简单门控均未满足预注册判据。

Insight: 观察到的副作用主要是优化后输出超出紧张 token 预算、未能遵守显式格式契约，内容质量本身并未出现相同幅度退化；宽松目标指标没有体现这一成本。预注册结论与事后拆解需分开理解，研究范围限于三种优化器、三项任务和所设长度上限。

Abstract: Prompt optimizers rewrite a prompt to raise one target metric, but prompts also state requirements the metric does not score, such as an output format, citations, or abstention. In a preregistered study, we run GEPA, MIPROv2, and TextGrad on HotpotQA, SQuAD 2.0, and IFEval and count per-item violations of unscored requirements with deterministic checks. By the preregistered criterion, all three optimizers produce regressions, substantially on HotpotQA, where net regression in citation validity reaches 10.7 to 41.6 points while exact match rises by 21 to 34 points. A post-hoc decomposition changes this reading. The optimized prompts elicit reasoning before the required JSON object, and under the 200-token output cap used throughout, 13.9% to 47.0% of responses end before any answer appears. Among parseable outputs, net regression is within 3 points of zero. With a 1,024-token cap, extraction failures disappear, content regression stays below 1 point, and exact match rises further. Two simple gates fail the preregistered criterion. The side effect is narrower than hypothesized: optimized prompts are more accurate and break an explicit output contract, and a lenient target metric does not show the cost.

[109] Test-Time Memory Construction cs.CLPDF

Zijun Wang, Yifan Ji, Haidong Xin, Zhenghao Liu, Yukun Yan

TL;DR: T²Mem 将复杂记忆构建推迟到推理时，离线只保存轻量事件/时间元数据并链接原对话，随后按当前问题逐步检索组织；在 LoCoMo 和 LongMemEval 上优于强基线且降低构建开销。

Details

Motivation: 跨长交互历史问答需要整合散落在多个会话中的证据。传统记忆系统在用户提问前离线构建复杂记忆，开销较大，也难以针对具体问题选择要保留和组织的信息。

Result: T²Mem 离线仅提取轻量 episode 级元数据，记录关键事件及时间关联作为检索线索，并保留指向原始交互的链接，以便重建跨 episode 依赖。测试时，LLM 根据推理进展自适应检索并组织元数据和原始对话，逐步形成面向当前问题的记忆。在 LoCoMo 与 LongMemEval 上，跨不同主干模型持续超过强基线，同时显著降低记忆构建开销；进一步分析显示，推迟构建让记忆能够动态适配各查询的信息需求。

Insight: 系统把预先构造完整记忆改为按需生成查询特定记忆，以轻量元数据引导回溯原始记录。摘要报告跨主干模型的定性优势，但未列出具体分数和开销数值。

Abstract: Large Language Models (LLMs) struggle to answer questions over long interaction histories, where relevant evidence may be scattered across distant sessions. Existing memory systems typically construct and maintain sophisticated memory representations offline, before user queries are observed, incurring substantial overhead and limiting their ability to adapt memory construction to query-specific information needs. In this paper, we propose T$^2$Mem, a Test-Time Memory construction framework that defers memory construction to inference and progressively builds memory along the reasoning process. Specifically, T$^2$Mem extracts lightweight episode-level metadata offline to capture key events and temporal associations as retrieval cues, while retaining links to the original interactions to facilitate the reconstruction of dependencies across episodes. At test time, the LLM adaptively retrieves and organizes metadata and raw interactions, progressively constructing query-specific memory as reasoning unfolds. Experiments on LoCoMo and LongMemEval show the effectiveness of T$^2$Mem by consistently outperforming strong baselines across different backbone LLMs while substantially reducing the overhead of memory construction. Further analysis demonstrates that deferring memory construction to inference enables the memory construction process to dynamically adapt to the information needs of individual queries. All code is available at https://github.com/OpenBMB/T2Mem.

[110] MoPrO-SD: Modular Prompt Optimization for Stance Detection cs.CLPDF

Meysam Sabbaghan, Nikesh Gyawali, Arman Zareian Jahromi, Sebastian Loera-Lozano, Doina Caragea

TL;DR: MoPrO-SD 将立场检测提示拆成语义模块并依据类别条件错误逐步优化，还发布人工标注的 VaccineStance；在多个数据集和开源模型设置下，多数情况下优于人工基础提示。

Details

Motivation: 隐含观点、讽刺和语境依赖表达使大语言模型难以判断立场。通用结构化提示优化没有针对立场标签含义和类别特定歧义进行设计。

Result: MoPrO-SD 将提示分为功能语义模块，并用 LLM 反馈逐步细化；比较三种策略：只优化指令（I）、指令加推理（I+R）、指令加逐样本推理（I+R+E），并利用按立场类别条件化的错误进行修正。作者另建人工标注的疫苗立场基准 VaccineStance。在四个数据集、五种开源权重 LLM 上，方法在许多设置中超过人工撰写的 Base 提示。SemEval-2016 上，五个主干中有四个采用类别条件反馈时的平均 Macro-F1 高于汇总反馈；两种推理策略表现较强，但相对效果随模型和数据集变化，整体与近期提示优化方法有竞争力。

Insight: 按立场类别提供错误反馈有助于处理类别语义不对称，提示模块化也允许顺序调整不同功能部分。不同推理策略没有对所有模型和数据集形成统一胜者，结果应按具体设置解读。

Abstract: Stance detection remains challenging for large language models (LLMs) due to implicit opinions, sarcasm, and context-dependent expressions of stance. Although automatic prompt optimization offers an alternative to fine-tuning without updating model parameters, existing structured approaches are not specifically designed around stance-label semantics and class-specific ambiguities. We introduce MoPrO-SD, a stance-specific prompt optimization framework that decomposes prompts into functional semantic modules and refines them sequentially using LLM-based feedback. We study three refinement strategies: instruction-only optimization (I), instruction with reasoning (I+R), and instruction with per-example reasoning (I+R+E), using class-conditioned errors for stance-label refinement. We also introduce VaccineStance, a new human-annotated benchmark for vaccine stance detection. Experiments across four datasets and five open-weight LLMs show that MoPrO-SD improves upon the human-written Base prompt in many settings. On SemEval-2016, class-conditioned feedback achieves higher mean Macro-F1 than pooled feedback for four of five backbones. Both reasoning-based strategies, I+R and I+R+E, achieve strong performance, with their relative effectiveness varying across models and datasets, while remaining competitive with recent prompt optimization methods. The MoPrO-SD code and VaccineStance dataset are available on GitHub.

[111] Proactive Agentic Orchestration cs.CLPDF

Xueyang Feng, Chaozhuo Li, Xiaohe Bo, Jiakai Tang, Chenxi Li

TL;DR: POrchestra 允许子智能体在执行过程中主动请求调整 harness，并以回溯反馈训练编排策略；三个长程基准上任务成功率平均提高 9.1%，结合 OPOD 后小型编排器平均提高 10.0%。

Details

Motivation: 现有子智能体编排通常在创建时固定目标和执行环境，难以适应动态任务；编排策略训练又常只有稀疏、延迟的最终反馈，难以针对具体调度决策进行有效学习。

Result: POrchestra 让子智能体可在任意逻辑节点主动联系编排器，请求修改 harness，同时保持本地执行连续性。由此提出 On-Policy Orchestration Distillation（OPOD）：把子智能体事后提出的修订请求归因回此前的编排决策，提取定向过程监督，并与最终奖励一起训练编排策略。在深度研究、动态数字助理和软件工程三个长程智能体基准上，POrchestra 相对最强基线的任务成功率平均提升 9.1%；与 OPOD 结合后，小型编排器相对现有训练基线平均提升 10.0%，且成本—性能折衷更有利。

Insight: 执行时主动请求修订为静态编排提供适应动态环境的接口，而回溯请求可将远端最终结果转换为更局部的策略训练信号。摘要称成功率“提高”但未说明 9.1%/10.0% 是绝对百分点还是相对百分比，因此不改写为百分点。

Abstract: Agentic orchestration delegates tasks to sub-agents with independent contexts, providing a key path to extending the effective execution horizon of large language model agents. However, existing orchestration methods face two limitations: in execution, current methods fix sub-agents’ goals and harnesses at creation time, limiting their adaptability to dynamic real-world environments; in optimization, sparse and delayed feedback constrains effective learning of the orchestration policy. To address these limitations, we introduce POrchestra, an on-the-fly proactive agentic orchestration framework. It allows sub-agents to proactively communicate with the orchestrator at any logical point to request harness adjustments while maintaining continuity of local execution. This mechanism not only enables sub-agents to adapt seamlessly to dynamic environments but also naturally inspires On-Policy Orchestration Distillation (OPOD) based on hindsight feedback. OPOD attributes sub-agents’ proactive revision requests back to preceding orchestration decisions to derive targeted improvement signals, and leverages these signals as process supervision alongside the final reward to optimize the orchestration policy. We evaluate POrchestra on three long-horizon agent benchmarks spanning deep research, dynamic digital assistance, and software engineering. POrchestra improves task success by an average of 9.1% relative to the strongest baseline; combined with OPOD, it improves small-orchestrator success by an average of 10.0% relative to existing training baselines. POrchestra also achieves a more favorable cost-performance trade-off. Our code is publicly available at https://github.com/XueyangFeng/POrchestra.

[112] Towards Enriching Design-Time Models with Evidence from Simulation and Operational Activities cs.CLPDF

Barbara da Silva Oliveira, Julien Deantoni, Nicolas Ferry

TL;DR: 本文提出将仿真与运行证据系统性回流到设计时影响模型的工作流，并用循迹机器人案例展示证据可支持参与者剪枝、交互刻画、影响函数抽象和有效范围记录。

Details

Motivation: 信息物理系统经历建模、仿真、实验和运行等阶段。执行过程中出现的观察可能揭示设计知识缺失、不确定或无效，但如何将这些证据持久地反馈到设计时模型，往往缺少明确流程。

Result: 作者提出证据驱动工作流，把仿真及运行活动产生的知识系统性转移回设计时模型，并以循迹机器人案例中的 Influence Model 演示。该模型表示设计构件与环境因素如何共同影响系统响应属性。仿真证据被用于支持参与者剪枝决策、交互关系刻画、影响函数抽象以及有效范围信息补充。案例表明，工作流在仿真证据上的应用可行，并可能改善后续开发迭代中的设计时推理与反馈。

Insight: 贡献主要是把执行观察到设计模型的知识回流过程显式化，并展示不同证据如何改变模型内容与适用范围。证据来自一个循迹机器人用例；摘要只说明运行证据的潜在价值，没有报告量化效果。

Abstract: Cyber-Physical Systems are developed through multiple model based activities, comprising several stages of development. As the development progresses through simulation, experimentation, and operation, observations of system execution may reveal missing, uncertain, or invalid design knowledge. The path from execution results to persistent design-time enrichment, however, is often implicit. This paper addresses this challenge by proposing an evidence driven workflow for systematically transferring knowledge produced during simulation and operation back into design-time models. We demonstrate the workflow using an Influence Model, a design-time artefact used to represent how design artefacts and environmental factors jointly affect system response properties, using a sign-following robot use case. We show how simulation evidence can enrich Influence Models by supporting participant pruning decisions, interaction characterisation, influence-function abstraction, and validity-scope information. The application demonstrates the feasibility of the workflow for simulation-based evidence and its potential benefits to improve design-time reasoning and feedback in subsequent development iterations.

[113] zip2zip++: Towards Inference-Time Token Compression with Minimal Quality Loss cs.CLPDF

Saibo Geng, Andrea Gentilini, Xinxian Ma, Nathan Ranchin, Yunzhen Yao

TL;DR: zip2zip++ 通过输入/输出动态嵌入解耦、长度感知 RoPE 和可选择 LZW 合并缓解压缩词表的质量损失；四种模型上所有测试语料困惑度和数学推理准确率均改善，并在相近压缩率下弥合约一半质量差距。

Details

Motivation: LZW 动态词表能让模型用更少 token 表示同一文本，但以往工作发现推理能力和困惑度会退化。作者试图确认这一损失是否为压缩的必然代价，并定位压缩层和 codec 可改进的原因。

Result: 分析指出四类问题：LZW 造成输入与输出嵌入的隐式冲突，共享嵌入难以处理；合并 token 跨越多个原始 token，直接用常规 RoPE 会忽略其跨度；合并数字等特定 token 会明显伤害下游准确率；动态词表还引入分段歧义，影响标准评估。对应提出解耦输入/输出的动态嵌入层、按 token 长度调整的位置编码，以及支持选择性合并和多视角分段的修改版 LZW。四种模型实验中，所有评测语料上的困惑度和数学推理准确率都有改善；在通用文本相近压缩率下，约弥合 zip2zip 与未压缩基线之间一半的质量差距。

Insight: 质量损失并非只能由底层预训练模型改变来修复，动态词表接口、位置建模和合并策略自身也会影响推理。作者称向无损自适应词表压缩迈出重要一步，但摘要的量化结论是相对弥合约一半差距，并未说明已完全无损。

Abstract: Dynamic vocabularies built on-the-fly via Lempel-Ziv-Welch (LZW) compression let a language model represent the same text in fewer tokens, but prior work shows that this efficiency comes at a cost to reasoning and perplexity. We show that this quality gap is not a fundamental price of compression but can be substantially closed through targeted improvements to the compression layer and LZW codec, without modifying the underlying pretrained language model. Our analysis reveals four key issues: (1) LZW’s compression algorithm creates an implicit conflict between the input embedding and the output embedding, a tension that a single shared embedding cannot resolve; (2) naively applying RoPE to LZW-compressed sequences ignores that merged tokens can span multiple tokens; (3) merging certain tokens (notably digits) disproportionately hurts downstream accuracy; and (4) dynamic vocabularies introduce an inherent segmentation ambiguity that confounds standard evaluation. We address these through decoupled input/output dynamic embedding layer, size-aware RoPE positioning, and a modified LZW codec supporting selective merges and multi-view segmentations. Across four models, our recipe improves perplexity on every corpus we evaluated as well as mathematical reasoning accuracy, closing roughly half the quality gap between zip2zip and the uncompressed baseline at a similar compression ratio on general text. This represents a significant step toward lossless adaptive-vocabulary compression for language models.

[114] Training User Simulators with Latent Intrinsic Feedback cs.CLPDF

Tarek Naous, Craig Boutilier, Wei Xu, Ofer Meshi

TL;DR: 用户模拟器加入逐轮潜在内在反馈后，模拟和批评行为更真实，与人工判断相关性更高；用作多轮强化学习奖励时，可匹配外部裁判 LLM 设置并减少一半以上 RL 计算。

Details

Motivation: 用户模拟器可为多轮对话助手训练提供交互环境，但以往重点是生成真实用户话语，未利用模拟用户对助手回答的评价。评价信号可能存在于用户的内部反应和推理中，并不一定显式说出。

Result: 作者训练具备潜在评价状态的 LLM 用户模拟器，使其在每轮从第一人称用户角度生成内部想法、反应和标量评分。训练数据来自真实用户与助手交互日志。相较提示式模拟器，内在反馈提升模拟真实度和批评能力，并提供以往微调模拟器不具备的逐轮评价；同等规模下，模拟器生成的评价与人工判断相关性更高。将其评分用于多轮 RL 时，效果可匹配依赖外部裁判 LLM 奖励的设置，同时 RL 计算量减少一半以上。

Insight: 模拟器不仅可生成对话轨迹，也能提供细粒度的过程评价信号；这可能降低对单独裁判模型的依赖。摘要未提供具体相关系数、成功率或计算量绝对值，结论为其所测训练设置下的比较。

Abstract: User simulators are gaining attention as environments to train LLM assistants that can better cope with the nuances of multi-turn conversations with real users. Prior work on user simulation has emphasized generating realistic user utterances, leaving unexplored their potential as a source of direct feedback on the assistant’s responses. Such evaluation signals may not be explicitly communicated in language, but can instead reside in the latent reasoning of users. In this work, we introduce user simulators with intrinsic feedback, namely, models equipped with latent evaluation states: internal thoughts, reactions, and scalar ratings that evaluate the assistant from a first-person user perspective at each conversation turn. We train LLM-based simulators using interaction logs between real users and assistants and demonstrate that intrinsic feedback improves simulation realism and critiquing behaviors versus prompted simulator baselines, while also providing turn-level evaluations that existing fine-tuned simulators lack. Further, evaluations generated by our trained simulators correlate better with human judgments than those of prompted simulators of the same size. Lastly, our experiments reveal that simulators with intrinsic feedback provide effective reward signals for multi-turn RL training, matching setups that rely on external judge LLMs for rewards while cutting RL compute by more than half.

[115] Inject a Turn, Not a Token: Learning Where to Redirect LLM Reasoning for Self-Correction cs.CL | cs.AIPDF

Jiwon Jeon, Myungsik Cho, Jeonghye Kim, Youngchul Sung

TL;DR: UPTURN 学习推理失败轨迹中的最佳干预位置，并将纠错指令作为新用户轮次注入，而非插入生成文本；四种推理模型、六个数学基准上均超过 32 次采样基线，且无需微调 LLM。

Details

Motivation: 大语言模型难以稳定发现并纠正自身推理错误。以往训练式方法通常微调模型生成修订或反馈；本文转而学习失败轨迹中何时干预以及如何改变后续推理方向。

Result: 作者在冻结编码器上训练一个 130K 参数 MLP 头，只用最终答案是否正确来预测干预位置。对固定生成预算的实验发现，将纠错指令内联插入文本不能可靠转向推理；把同一指令放进新的用户轮次则能改变模型路线。由此提出 UPTURN（User-Prompt TURN injection at a learned position）：保留所选前缀，在新用户轮次插入指令，再重新生成后缀，无需微调 LLM。在四种推理模型、六个数学基准的所有设置中，平均准确率均高于 32-rollout 基线；在匹配纠错预算下超过自我纠错和反思 token 注入方法，并可迁移到不同推理模型和 GPQA-Diamond，无需重新训练，还可与 GRPO 及自我纠错互补。

Insight: 干预的消息结构可能决定纠错指令是否被模型当作新的控制信号；新用户轮次比在同一生成流中插入文字更有效。论文强调固定预算比较和零微调，但摘要未给各基准绝对准确率。

Abstract: Large language models struggle to reliably identify and correct errors in their own reasoning. Unlike prior training-based approaches that fine-tune an LLM to generate revisions or feedback, we learn where to intervene in failed rollouts and determine how to redirect them. To choose where to intervene, we train a 130K-parameter MLP head on a frozen encoder using only final-answer correctness. For redirection, we find that under a fixed generation budget, the tested inline injections fail to reliably redirect reasoning, whereas presenting the same instruction in a new user turn changes the model’s course. The resulting correction framework, UPTURN (User-Prompt TURN injection at a learned position), requires no LLM fine-tuning: it retains a selected prefix, injects an instruction as a new user turn, and regenerates the suffix. Across four reasoners and six math benchmarks, UPTURN improves average accuracy in every setting over a 32-rollout baseline. It outperforms self-correction and reflection-token injection baselines under matched correction budgets, transfers across reasoners and to GPQA-Diamond without retraining, and complements GRPO and self-correction methods.

[116] Enhancing Legal Reasoning in Pre-trained Language Models via Knowledge Graph-Guided Multi-Task Pre-training cs.CLPDF

Ibrahim Siddig, Munir Georges

TL;DR: 该方法把下一句预测、知识图谱引导聚类和图谱感知段落分类联合用于德国交通法规预训练；在合成问答、LexGLUE 七项任务中的四项及奥地利法规零样本迁移上报告提升。

Details

Motivation: 法律文本理解需要推理半结构化法规，但仅使用掩码语言模型的法律模型会把法规当作扁平 token 序列，忽视条款层级及约束关系。作者希望将结构知识编码到模型参数中，避免推理时必须遍历离散知识图。

Result: 研究针对德国交通法规 StVO 提出多任务预训练，联合 Next Sentence Prediction、知识图谱引导聚类（CLU）和图谱感知段落分类（CLS），将结构化法律知识写入模型权重，以支持零样本法律推理。实验覆盖九种 Transformer 编码器和 324 组设置。在合成 StVO 问答上，相对基线提升 10.3%–155.0%；相较既有 LexGLUE 结果，在七项法律基准中的四项取得更好表现；在奥地利交通法规上实现 3.4%–15.8% 的零样本迁移增益。

Insight: 预训练阶段利用法规层级和图关系，可使结构知识进入编码器参数，从而无需推理时执行显式图遍历。结果包括同域合成问答、LexGLUE 对比和奥地利法规跨域迁移，三类比较口径不同；摘要未说明各增幅是相对值还是百分点。

Abstract: Legal language understanding requires reasoning over semi-structured regulatory documents, yet standard pre-training objectives do not explicitly target this structural capability. Because current legal language models rely solely on masked language modeling, they treat statutory text as flat token sequences and ignore the underlying hierarchical constraints. To bridge this gap, we present a multi-task pre-training approach for German traffic law (StVO). Our approach combines three complementary objectives: Next Sentence Prediction (NSP), Knowledge Graph (KG) Guided Clustering (CLU), and Knowledge Graph (KG) Aware Paragraph Classification (CLS). This approach explicitly encodes structured legal knowledge directly into the model weights. This encoding enables zero-shot legal reasoning at inference time and removes the need for discrete graph traversal. We evaluate our approach across nine Transformer-based encoders and 324 experimental runs. On synthetic StVO question answering, our models demonstrate consistent relative improvements between 10.3% and 155.0% over baselines. Furthermore, relative to the established LexGLUE baselines (Chalkidis et al., 2022), our models improve over prior results on four of seven legal benchmarks. It also achieves consistent zero-shot transfer gains between 3.4% and 15.8% on Austrian driving regulations. These experimental results indicate that our training approach generalizes successfully beyond the initial training legal domain.

[117] Verifiable Retrieval for Legal Reasoning through Structure-driven Knowledge Graph cs.CLPDF

Ibrahim Siddig, Sviatoslav Tugeev, Munir Georges

TL;DR: 论文针对德国法典构建结构驱动知识图谱，并比较图谱辅助分块与检索策略，以提高法律引文检索的准确性和可核验性。

Details

Motivation: 法律等高可靠性场景要求自动化过程透明、可核验。RAG 可将生成依据连接到可解释文档，但来源规模和长度增加时，朴素检索可能遗漏关键上下文，进而影响引文准确性。

Result: 研究聚焦德国法律条文，利用结构驱动解析将源文档组织成知识图谱，用于导航和检索。作者比较多种图谱辅助的分块与检索策略，并评估其对检索引文准确性的影响。摘要介绍了研究目标和评测方向，但未给出策略名称、数据规模或实验数值，因此无法补充具体优劣排序。

Insight: 将法条结构显式编码为图，可望让检索利用法律文档层次和导航关系，而非只按文本相似度切块。当前摘要缺少结果细节，解析应保留这一边界，不能推断某类图检索已显著提升。

Abstract: Any automation within reliability-critical contexts such as medicine or law has to be transparent and verifiable. Despite their advantages, current LLM-based systems do not meet these requirements due to their inherent black-box nature. Retrieval Augmented Generation (RAG) attempts to ground the generative process in the relevant interpretable documents, thereby reducing the risk of AI ‘hallucinations’ and potentially enabling verification of the initial generation context. However, as the number and size of potential sources increases, naive retrieval approaches tend to perform worse, ignoring critical context elements. In this paper we aim to tackle this problem in the context of German Legal Code. Using structure-driven parsing to create a Knowledge Graph (KG) for the source document navigation and retrieval, we compare several KG-informed chunking and retrieval strategies and evaluate their effect on the accuracy of retrieved citations.

[118] Can Language Models Learn When to Abstain? Policy Learning and Calibrated Answer Selection cs.CLPDF

Juan Terven, Diana-Margarita Córdova-Esparza, Ruben Gomez, Carlos Miranda Rocha, Julio-Alejandro Romero-González

TL;DR: 在 Qwen3-14B 事实问答设置中，学习型答案选择器比校准置信度过滤提高阈值平均效用；TriviaQA 覆盖率由 20.2% 升至 30.9%，回答错误率由 23.0% 降至 14.5%，但 NQ-Open 上仍不如始终弃答。

Details

Motivation: 可靠的语言模型应能判断何时作答、何时说“不知道”。研究比较直接训练模型与训练独立答案核验/选择组件两种路径，并关注正确回答、答错惩罚和允许弃答共同构成的效用。

Result: 研究以 Qwen3-14B 的事实问答为对象，在三个训练随机种子和两个留出置信阈值下比较答案选择器与原模型校准置信度过滤器。学习型选择器在阈值平均效用上更高。TriviaQA 严格匹配评分下，覆盖率从 20.2% 提高至 30.9%，被评分答案中的汇总错误率从 23.0% 降至 14.5%；部分人工复核审计仍支持这一结果。测试的强化学习改动没有显示稳定增益。在 NQ-Open 上，选择器虽然优于过滤器，但仍逊于始终弃答。

Insight: 学习何时保留答案能在 TriviaQA 上改善覆盖率—错误率折衷，但可靠弃答尚未跨数据集解决；NQ-Open 的结果显示选择器仍可能没有足够效用。结论限于一个 Qwen3-14B 事实问答设置及所测阈值/评分协议。

Abstract: A useful language model should know when to answer and when to say “I don’t know.” Can we improve that decision by training the model itself or by training a separate component to check its answers? We study both approaches on Qwen3-14B for factual questions, using a score that rewards correct answers, penalizes mistakes, and allows abstention. Across three training seeds and two held-out confidence thresholds, a learned answer selector improves threshold-averaged utility over the original model’s calibrated confidence filter. On TriviaQA, mean coverage increases from 20.2% to 30.9%, while the pooled error rate among scored answers decreases from 23.0% to 14.5% under exact-match grading. The tested reinforcement-learning changes do not establish consistent gains. On NQ-Open, the selector improves threshold-averaged utility over the filter but still performs worse than always abstaining. A partial human-reviewed audit preserves the TriviaQA finding. Our results support learning to select answers in this setting while showing that reliable abstention across datasets remains unresolved.

[119] When VLMs Destroy What They Know: Spatial Representations Fall Below Lexical Priors cs.CLPDF

Shubh Garg, Chen Shani

TL;DR: EICS 与 CASP-VL 用受控空间扰动评估 VLM 表征稳定性；研究发现空间关系表征弱于词汇信息，且谓词 token 中可识别的关系在汇总为 EOS 或均值池化全局表示时会丢失。

Details

Motivation: VLM 即使在组合基准上明显高于随机水平，其内部表示是否忠实保留空间关系仍不清楚。仅凭最终答案评测可能掩盖关系信息在中间表征中丢失的问题。

Result: 作者提出 EICS（Evaluation-Invariant Concept Stability），在控制单概念干预下检验表征是否稳定编码概念；并构造基于 Visual Genome 场景图的因果受控空间扰动基准 CASP-VL。在多个 VLM 架构上，空间关系比词汇信息表征得更不忠实，即便模型在组合基准上的得分高于随机水平。进一步分析显示，关系仍能在谓词自身 token 的表征中识别，但将句子压缩为 EOS token 或均值池化全局表示时便丢失。由此揭示一种输出评测难以发现的失败：输入文本中存在的关系信息未保留在后续使用的全局表示里。

Insight: 模型可以生成正确答案或在基准上高于随机，却仍可能在下游依赖的句级表示中丢失空间关系。结论涉及谓词 token 与两种句级汇总方式；摘要未给具体模型分数或表示稳定性数值。

Abstract: Vision-Language Models (VLMs) increasingly analyze and reason about images, yet it remains unclear whether their internal representations faithfully encode the structured relations required for such reasoning. We introduce EICS (Evaluation-Invariant Concept Stability), a metric for testing whether representations consistently encode concepts under controlled one-concept interventions, and CASP-VL (Causally controlled Spatial Perturbations for Vision-Language models), a benchmark of causally controlled spatial perturbations derived from Visual Genome scene graphs. Across multiple VLM architectures, we find that spatial relations are represented substantially less faithfully than lexical information, even when the same models score well above chance on compositional benchmarks. Further analysis shows that the relation is identifiable at the predicate’s own tokens but is lost when the sentence is aggregated into a global representation, whether through the (EOS) token or by mean pooling. These findings reveal a systematic failure invisible to output-based evaluation: VLMs do not preserve, in the representation used downstream, relational information that is present in their own input.

cs.AI [Back]

[120] SpireBench: Evaluating Long-Horizon Strategic Play of Agentic Models with Slay the Spire cs.AI | cs.CL | cs.LGPDF

Scott C. Lowe, Sander W. Keemink

TL;DR: SpireBench 用完整《杀戮尖塔》高难度通关任务评测 20 个 LLM 的长程策略；前沿模型可匹敌普通玩家但远逊专家，且随战役延长逐渐落后，风险判断偏保守。

Details

Motivation: 许多智能体基准短小、一次性，难以衡量长时程策略；单看最终成绩也不易区分知识、推理和运气的作用。作者选择早期决策会影响后续战局的完整商业卡牌游戏作为长程评测环境。

Result: SpireBench 让模型在最高难度下完整游玩《Slay the Spire》，并通过对游戏术语进行一致、全面的重命名，检验模型是否依赖既有游戏知识。20 个 LLM 中，前沿模型超过启发式基线、达到平均人类玩家水平，但远低于专家；模型首幕胜率可与专家相当，随着运行时间延长差距扩大。强弱模型的主要区别在单场战斗策略；所有模型都会误判整局风险，倾向保留生命而非冒险变强。模型跨局写入的记忆常错误且过度保守，未能带来改进。作者称其 harness 首次提供完整原版游戏，并与既有 harness 比较。

Insight: 长时程表现差距会随决策累积而显现；对局风险规划和跨局经验质量是主要问题，单次战斗能力或基准总分不足以诊断。完整术语重命名实验还表明，部分成绩可能依赖预训练中的游戏先验。

Abstract: Agentic large language models now tackle complex tasks, yet strategic reasoning over long horizons is under-studied: most agentic benchmarks are short and episodic, and performance on long tasks is hard to dissect into stored knowledge, reasoning and luck. We introduce SpireBench, in which models play the complete commercial deck-builder Slay the Spire (StS), where early decisions decide long-term success. Across 20 large language models (LLMs) at the game’s highest difficulty, frontier models beat heuristic baselines and match the average human player but remain far behind experts. This gap widens as the run lengthens: the strongest models win the first act as often as experts, then fall behind. What separates strong models from weak is how well they play each fight; all of them misjudge risk over a run, preserving health rather than spending it to grow stronger. A comprehensive, self-consistent renaming of every game term shows that part of their performance rests on prior knowledge of the game, and models do not improve from the memories they write across runs, which are often wrong and overly cautious. Our harness is the first to give a model the complete original game, and we compare it with existing harnesses. Overall, SpireBench offers an unsaturated long-horizon benchmark with tools to locate where and why agents fail.

[121] Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA cs.AI | cs.CL | cs.IRPDF

Wenlin Lin, Fanzhe Wei

TL;DR: KnowForge 将开放域多模态文档问答拆分为搜索、桥接判定、证据汇集、深读和合成；在 M3DocVQA 上 Qwen3.6-35B-A3B 达 F1 47.5，较已发表系统高 11.0。

Details

Motivation: 大规模异构文档问答既要找到正确片段，也要读取文本、图片与表格。常见 RAG 智能体让同一模型同时用各种工具并自行安排步骤，可能过度搜索而不深入阅读，难以稳定完成多跳证据整合。

Result: KnowForge 采用分工流水线：混合检索知识点索引；只能搜索的 Locator；由代码调度、强制第二跳的桥接判定器；合并所有搜索排名且有类型和容量限制的证据池；只能读取文本、图像和表格的 Deep Reader；以及带格式检查器的答案合成器。自托管 Qwen3.6-35B-A3B（3B 激活参数）在完整 M3DocVQA（2,441 题、3,368 篇 PDF）上 F1 为 47.5，较已发表 M3DocRAG 高 11.0、较同索引同模型的一次检索回答高 7.1；DeepSeek-V4-Flash 得 53.5。MultiHop-RAG 准确率 73.5，高于最强发表 RAG/GraphRAG 的 71.2；MMLongBench-Doc 上同一模型由 34.8 升至 47.0，接近 GPT-4o 读取页面图像的 46.3。消融显示 Deep Reader 在三个语料上分别贡献 3.8、9.8、0 个点；把所有工具合并给一个智能体反而低 1.9 F1，因其倾向继续搜索而非阅读。

Insight: 任务分工和显式搜索—阅读切换能缓解单智能体工具使用中的过度搜索，且阅读器收益随语料视觉性变化。指标覆盖三个不同基准，F1 与准确率不可混为一谈；延迟随模型调用次数而非语料规模增长的结论来自其索引设置。

Abstract: Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-augmented agents give one model both kinds of tools and let it schedule itself. We present KnowForge, a pipeline separated by job: a hybrid-retrieval knowledge-point index; a Locator agent that can only search; a code-scheduled bridge judge that forces the missing second hop; a typed, size-bounded evidence pool that merges every search’s ranking; a Deep Reader agent that can only read text, images and tables; and a synthesizer with a format checker. With a self-hosted Qwen3.6-35B-A3B (3B active), KnowForge reaches F1 47.5 on the full open-domain M3DocVQA (2,441 questions, 3,368 PDFs), +11.0 over the published M3DocRAG system and +7.1 over one-shot retrieve-and-answer on the same index and model, and 53.5 with DeepSeek-V4-Flash. On MultiHop-RAG it reaches 73.5 accuracy, above the strongest published RAG and GraphRAG results (71.2); on the single-document MMLongBench-Doc it lifts the same model from 34.8 to 47.0, level with GPT-4o reading page images (46.3). Per-job ablations on the full benchmarks attribute the gain: the Deep Reader is worth 3.8, 9.8 and 0 points on the three corpora, tracking how visual each is; merging both agents into one with all tools and twice the rounds loses 1.9 F1 because it keeps searching instead of reading; a round-budget sweep shows a step at four Locator rounds and a plateau beyond; query latency scales with model calls rather than corpus size. We serve the three indexed benchmarks as read-only knowledge bases (free registration) and release all prompts and the runner code: https://github.com/metask-ai/knowforge-bench

[122] BoundaryEvo: Data-Model Co-Evolution at the Capability Boundary for Long-Chain Reasoning Distillation cs.AI | cs.CLPDF

Jiaming Su, Suorong Yang, Xudong Li, Tengchao Yang, Peng Ye

TL;DR: BoundaryEvo 先用少量教师长推理轨迹建立学生初始能力，再持续选择学生尚未掌握、专家可解的问题；仅用 1,000 样本就在 11 个推理基准上优于静态/动态选样基线。

Details

Motivation: 蒸馏长推理轨迹能提升小模型推理，但固定训练集忽视例题价值会随学生能力变化；已掌握样本监督不足，远超能力边界的样本又难学。样本预算很小时，能力变化与数据选择错配尤其昂贵，初始弱模型的可靠选样也困难。

Result: BoundaryEvo 分两阶段进行数据—模型共进化。Capability Priming 阶段直接蒸馏少量教师生成的长推理轨迹，不另训模型评判过滤，以先建立基础推理能力；Capability-Boundary Co-Evolution 阶段反复挑选当前学生尚未掌握、专家却能可靠求解的问题，并随学生进步更新训练集。仅使用 1,000 个训练样本，在 11 个推理基准上持续超过静态和动态选样基线；Qwen3.5-4B 在 IMO-AnswerBench 从 62.9 提高到 75.3，在 AMO-Bench 从 26.8 提高到 46.0。

Insight: 先让弱学生获得基本解题能力，再围绕动态能力边界选题，避免在尚不能诊断能力时做早期筛选。报告的两个具体增益是指定 Qwen3.5-4B 基准结果，其余九个基准摘要未列分数。

Abstract: Distilling long-chain reasoning trajectories from large teacher models provides an effective way to improve the reasoning ability of small language models. However, existing methods typically select a fixed training set before distillation, overlooking that the usefulness of a reasoning example changes as the student evolves. This mismatch becomes especially costly when only a small number of teacher trajectories can be used for training. Besides, examples already mastered provide little new supervision, while examples far beyond the capability of student may be difficult to learn from. Training data should therefore adapt as model capability evolves, yet reliable data selection is difficult when the student is initially weak. To address these challenges, our key idea is to first establish the basic reasoning capability and then adapt the training data to the evolving capability boundary of the student. We propose BoundaryEvo, a two-stage data–model co-evolution framework. In Capability Priming, we directly distill a small set of teacher-generated long reasoning trajectories without using a separate model to judge and filter them, allowing the student to acquire an initial reasoning capability before capability-aware data selection. In Capability-Boundary Co-Evolution, we repeatedly select questions that the current student has not mastered but the expert can reliably solve, and update the training data as the student evolves. With only 1,000 training examples, BoundaryEvo consistently outperforms static and dynamic data selection baselines across 11 reasoning benchmarks, raising the original Qwen3.5-4B accuracy from 62.9 to 75.3 on IMO-AnswerBench and from 26.8 to 46.0 on AMO-Bench. The code and data will be made publicly available.

[123] Retrieval-Augmented Multimodal Language Model with Heterogeneous Evidence Integration for Clinical Prognosis cs.AI | cs.CLPDF

Hamza Shafiq, Jialu Tang, Ting Dang, Jun Hu, Aaqib Saeed

TL;DR: PRISM 将数值 EHR token 化、纵向 ECG 和群体相似病例表示结合用于临床预后；MDS-ED 上报告四类 AUROC 为 86.2%–93.1%，但最高结果使用基线没有的 96 小时到院前数据。

Details

Motivation: 临床预后需要联合结构化测量、生理波形、纵向病史和群体信息。简单文本序列化或单一检索方式可能丢失数值/时间结构；同时，性能比较必须考虑不同方法可用的输入时间窗是否一致。

Result: PRISM 用逐特征数值 token 化、对纵向 ECG 作近期加权汇总，并维护双模态群体记忆库。检索在表示空间进行，模型接收相似训练队列就诊的均值池化嵌入，不将任何单个检索病历放入提示词。MDS-ED 的 1,443 项任务上，若使用到院前 96 小时数据，诊断、恶化、ICU 入院和死亡 AUROC 分别为 86.2%、93.1%、91.8%、92.8%；该窗口不可用于论文报告的基线。仅用基准时间窗输入时 PRISM AUROC 为 0.8895，UniPACT 为 0.8937，MDS-ED 为 0.8889。相同五种证据流和冻结编码器下，紧凑融合模型为 0.7652，PRISM 为 0.9092。将数值 EHR 改成文本序列化使 AUROC 降 3.66 点，移除到院前病史降 1.97，清零检索降 0.99。真实检索较随机邻居宏平均高 0.97 点，但配对任务级符号检验未证明显著普遍优势（p=0.067）。外部 MC-MED 上，监督微调 AUROC 0.8611，高于本地训练梯度提升模型 0.8227 和仅源数据 PRISM 0.7841。

Insight: 结构化数值表示和纵向病史对结果有明显贡献；主要高 AUROC 数字使用基线不可用的 96 小时到院前窗口，公平比较需优先看匹配窗口结果。检索消融提升虽为正，配对检验 p=0.067 未支持统一统计显著优势；外部结果包含监督微调。

Abstract: Clinical prognosis requires integrating structured measurements, physiological waveforms, longitudinal history, and population context. We introduce PRISM (Population-Retrieved Inference for Structured Multimodal Prognosis), a multimodal language model that combines per-feature numerical tokenization, recency-weighted aggregation of longitudinal ECGs, and a dual-modality population memory bank. Retrieval operates in representation space: the model receives mean-pooled embeddings of similar training-cohort encounters, while no individual retrieved record enters the prompt. On the 1,443-task MDS-ED benchmark, PRISM achieves AUROCs of 86.2% for diagnosis, 93.1% for deterioration, 91.8% for ICU admission, and 92.8% for mortality. These results use a 96-hour pre-arrival window unavailable to reported baselines. With benchmark-window inputs only, PRISM reaches 0.8895 AUROC, compared with 0.8937 for UniPACT and 0.8889 for MDS-ED. A matched-input compact fusion model using the same five evidence streams and frozen encoders reaches 0.7652 AUROC, versus 0.9092 for PRISM. Replacing numerical EHR encoding with text serialization reduces AUROC by 3.66 points; removing pre-arrival history reduces it by 1.97 points; and zeroing retrieval reduces it by 0.99 points. Genuine retrieval outperforms random-neighbor retrieval by 0.97 macro-average points, although a paired task-level sign test does not establish a uniform advantage (p=0.067). On the external MC-MED cohort, supervised fine-tuning reaches 0.8611 AUROC, compared with 0.8227 for locally trained gradient boosting and 0.7841 for source-only PRISM. These results support structure-aware multimodal integration and supervised external adaptation.

[124] A Privileged Teacher That Only Scores Cannot Search: Critique-Conditioned On-Policy Self-Distillation for Reasoning cs.AI | cs.CL | cs.LGPDF

Mayug Maniparambil, Ayush Rai, Ekansh Verma, Noel E. O’Connor, Fergal Reid

TL;DR: 研究发现仅靠特权答案条件下的打分教师做 on-policy 自蒸馏，既不能定位错误也不保证纠错；先生成 critique 再条件化打分可形成纠错信用，并用于推理重启和 cold-start GRPO。

Details

Motivation: OPD 试图用参考答案条件教师对学生 rollout 打分，替代稀疏 RL 结果奖励并提供 token 级信用。但关键在于这类分布差异信号是否真的指出推理错误并降低错误 token 概率。

Result: 作者用学生轨迹的金标准错误跨度测试自蒸馏目标中的全分布 KL 和 token 对数比，发现它们既不定位错误、也不将概率从错误 token 移开，并且不能可靠区分同一问题的正确/错误 rollout。作者认为这属于结构性问题：定位错误本身需要搜索，而打分教师并未被要求搜索。相同模型和特权信息若可生成 critique，则错误定位显著更好。据此提出 critique-conditioned self-distillation：先批评当前轨迹，再让打分教师以 critique 为条件。新信号能定位错误、在错误跨度内纠正，并提高触发回溯的 “Wait”“But”“Actually” 等 token 概率。Critique 还可在测试时用于从错误轨迹续跑，解决采样本身无法解决的数学题；也可用于 cold-start GRPO，在 verifiable reward 没有信号的提示上提供优势信号。

Insight: 教师获得正确答案并不自动意味着其分布分数包含可执行的定位/纠错信息；显式 critique 提供了缺失的搜索步骤。摘要提出的能力包括错误定位、回溯 token 信号和两个应用场景，但未给基准量化增益。

Abstract: On-policy self-distillation promises to replace the sparse outcome signal of verifiable-reward RL with dense token-level credit: a teacher conditioned on the reference solution scores the student’s own rollout, and the resulting distributional shift is distilled back into the policy. We investigate whether this scoring signal actually contains corrective credit. Using gold error spans in student rollouts, we test the two signals consumed by self-distillation objectives, the full-distribution KL and the token log-ratio, for two properties: whether they localize errors and whether they push probability away from erroneous student tokens. They exhibit neither of these properties nor can they reliably distinguish correct from incorrect rollouts within the same problem. We argue that this failure is structural: locating an error in a reasoning trace is itself a search problem, while a scoring teacher is never explicitly asked to perform that search. The same model, with the same privileged information, localizes errors substantially better when allowed to generate a critique. This forms the motivation for \emph{critique-conditioned self-distillation}: first generate a critique of the current rollout, then condition the scoring teacher on that critique. The resulting signal localizes errors, is corrective within error spans, and shifts probability toward tokens that initiate backtracking such as Wait'', But’’, and ``Actually’’. We further show that the critique is useful both at test time, where resuming a wrong rollout with the critique in context converts math problems the model cannot solve by sampling, and in cold-start GRPO, where it provides an advantage signal on prompts for which verifiable rewards alone provide none.

[125] UkrMeme: Multimodal Explainable Persuasion Detection in Ukrainian Memes cs.AI | cs.CL | cs.CVPDF

Nazar Andrushko, Vera Schmitt, Veronika Solopova

TL;DR: UkrMeme 发布 200 张乌克兰战时自然 meme 的说服技巧标注数据集，并翻译部分 Propaganda 950 为 PTM-UA；以图像、文字和多模态零样本 VLM 及分层 F1 评估，比较 LRP 与模型 token 归因解释。

Details

Motivation: meme 会结合图像和文字传达说服性信息，在政治冲突语境中尤其重要。单独分析文本或视觉线索可能无法识别其说服技巧，且解释方法需要说明模型依据哪些语义证据作出判断。

Result: 作者构建 UkrMeme，包含 200 张自然产生的乌克兰战时 meme，并标注说服技巧；另发布 PTM-UA，即保留原图像内容、翻译 meme 文字的 Propaganda 950 子集。研究以零样本提示评估 VLM 的图像输入、文本输入和多模态输入，采用分层 F1 指标。还比较 Layer-wise Relevance Propagation 与模型生成的 token 归因，并分析两类解释方法强调的语义证据类别。摘要未提供具体模型排名或 F1 分数。

Insight: 保持原图并翻译文字的配对数据有助于比较视觉、语言和多模态输入对说服检测的影响；解释比较则关注显著证据类型。数据集仅含 200 张乌克兰战时 meme，结果不能直接代表更广泛语言、文化或政治内容。

Abstract: Memes play a central role in modern online communication, especially in contexts of political conflict where visual and textual cues combine to convey persuasive messages. We study persuasive technique detection in Ukrainian memes using vision-language models (VLMs). We introduce UkrMeme, a dataset of 200 organically produced Ukrainian wartime memes annotated for persuasion techniques, and PTM-UA, a Ukrainian translation of a subset of the Propaganda 950 benchmark that preserves original visual content while translating meme text. We evaluate VLMs in a zero-shot prompting setup across image, text, and multimodal inputs using hierarchical F1 metrics. Finally, we compare Layer-wise Relevance Propagation (LRP) and model-generated token attributions and analyze the semantic categories of evidence emphasized by each explanation method.

[126] Studying Comics at Scale with Artificial Intelligence: The PAGE Framework and Three Studies of American Comics and Japanese Manga cs.AI | cs.CL | cs.CYPDF

Emilio Ferrara

TL;DR: PAGE 框架将 AI 用于大规模漫画研究：逐页解析分格/文字/书目信息、按人类 codebook 标注并用人工样本校准；在 3,929 本美国漫画和 87 卷日本漫画上开展三项研究。

Details

Motivation: 漫画是重要的视觉文化档案，但学术研究通常逐本进行，数十万页内容难以整体分析。作者主张生成式 AI 等方法可支持规模化研究、档案检索、无障碍访问和艺术家署名。

Result: PAGE 流程解析每张扫描页中的分格、文字和书目信息；用遵循书面编码手册的 VLM 对页面进行类似人工编码的注释；再以人工标注样本校准，并在控制出版社和类型后估计档案变化。框架应用于 1938–1956 年的 3,929 本美国漫画和 87 卷日本漫画，完成三项研究：结合文本搜索和视觉阅读分析大众媒介如何呈现政治权力；跨行业测量页面视觉形式并识别艺术家风格；在人工标注核验下追踪两种漫画传统中的说话者。作者还讨论将工具用于按图像内容检索、帮助视障读者和保护脆弱档案。

Insight: 该工作把页面解析、codebook 驱动的视觉标注、人工 grounding 与受控档案分析连成研究流程，强调 AI 作为漫画研究工具而非取代领域解释。摘要未给模型误差、人工标注规模或三项研究的量化结论。

Abstract: Comics are one of the great visual records of the twentieth century: hundreds of thousands of pages in which a mass readership saw its leaders, its wars and its heroes. Most of this record has never been studied as a whole; comics scholarship proceeds one book at a time. We argue that artificial intelligence, including generative models, can change this to the benefit of the medium itself. We propose PAGE, a framework that makes artificial intelligence an instrument for comics research. It parses every scan into panels, text and a bibliographic record; annotates each page with a vision-language model that follows a written codebook, as a human coder would; grounds samples of these readings in human annotation; and explains change across an archive, with estimates controlled for publisher and genre. We demonstrate the framework on 3,929 American comic books (1938–1956) and 87 volumes of Japanese manga, in three studies, each resting on a different capability. The first pairs text search with visual reading to recover how a mass medium portrayed political power. The second measures the page’s visual form across an industry and recovers the hand of individual artists. The third follows who speaks across two comics traditions, checked against human annotation. Beyond research, the same instruments can make archives searchable by what is drawn, open comics to blind and low-vision readers, and help preserve fragile collections and credit uncredited artists. We outline a research agenda in which artificial intelligence strengthens the study, preservation and reach of the medium.

cs.CR [Back]

[127] Cancerous Backdoor Attack: Gradual Activation via Invisible Tokens and A Stage Controller cs.CR | cs.AI | cs.CLPDF

Tahmid Imtiaz Imu, Emama Nahid, Prodipta Sen Amartya, Ahsanul Jobayer, Yutong Song

TL;DR: 本文研究用不可见 token 和阶段控制器逐步激活大语言模型后门，使推理损害在多轮交互中累积而非一次触发；摘要报告跨模型和推理数据集均能产生渐进破坏，但未提供量化结果。

Details

Motivation: 典型 LLM 后门满足触发条件后执行单一终端行为，未覆盖恶意行为在到达最终触发阶段前逐步改变推理过程的情形。渐进污染可能在最终答案明显异常之前就影响中间推理。

Result: Cancerous Backdoor Attack 通过不可见 token 给模型提供用户可见请求中没有的隐藏阶段，并由阶段控制器在推理过程中跟踪攻击进度，实现跨多轮交互的渐进激活。作者在多个推理数据集上评估，报告该攻击可在不同模型和任务上持续造成渐进式推理破坏，并与既有后门攻击基线比较取得更好结果。摘要没有说明具体模型、数据集、成功率或防御效果。

Insight: 只检查最终答案准确率可能无法发现尚未完全显现的推理污染，因此过程级监测也有必要。本文摘要仅支持攻击机制与定性实验结论，未提供足够细节量化风险或说明防御方式。

Abstract: Backdoor Attacks on Large Language Models (LLMs) typically follow a trigger-response pattern, where satisfying a trigger condition activates a single terminal behavior. However, this single-point backdoor activation does not explore attacks in which malicious behavior develops gradually through multiple intermediate stages before reaching the terminal activation stage. We present Cancerous Backdoor Attack, that gradually corrupts an LLM’s reasoning over a sequence of interactions by leveraging invisible tokens and a stage controller. Specifically, invisible tokens provide hidden stages to the model without appearing in the user’s visible request and the stage controller tracks the attack’s progression during inference to realize gradual activation. We evaluate Cancerous Backdoor Attack across several reasoning datasets. The attack consistently produces gradual reasoning corruption across models and tasks. We compare Cancerous Backdoor Attack with prior backdoor attack baselines to demonstrate our proposed attack outperforms the baselines. Our results indicate that reasoning corruption can develop gradually before it becomes visible, making answer accuracy alone insufficient for detecting backdoor attacks.

cs.IR [Back]

[128] Beyond the Final Embedding: Retrieving Memories from Token-Level Evidence cs.IR | cs.CLPDF

Han Luo, Zhan Zhuang, Xu He, Jujia Zhao, Yu Li

TL;DR: 该检索方法结合 query token 对记忆 token 的稀疏匹配与整段向量相似度，无需训练即可改善八个基准的检索；在 Qwen3-Embedding-4B 上增加查询适配后，Recall@10 和 NDCG@10 平均分别多 13.3/14.3 个百分点。

Details

Motivation: 记忆增强助手通常用单一向量比较查询与会话/文档，但相关信息可能只在记忆的一小段内容中。嵌入模型已计算出的上下文 token 表征可用于更局部的证据匹配，无需重新训练编码器。

Result: 方法让每个查询 token 从候选记忆中检索少量匹配 token，再按记忆聚合局部匹配分数，并与整段记忆相似度结合排序。可选的低秩 query adapter 可用监督信号训练，同时固定编码器及已存记忆表征。无额外训练的 token 匹配方法在八个基准和多个模型家族上提高检索表现；在 Qwen3-Embedding-4B 上，查询适配进一步使平均 Recall@10 和 NDCG@10 分别增加 13.3 和 14.3 个百分点。检索改善也转化为长期记忆问答准确率提升。

Insight: 稀疏局部证据匹配补足了单向量压缩导致的细节丢失，而整段相似度仍保留全局语境；查询适配不需重新编码存储记忆。摘要没有列各基准分数或 QA 提升值，13.3/14.3 是指定模型上的平均检索指标增幅。

Abstract: Memory-augmented assistants retrieve evidence from stored conversations and documents to answer queries. Most embedding-based retrievers compare single-vector representations of queries and memories, even when relevance depends on a small part of the content. Such local evidence can be matched to queries using the contextual token representations already computed by the same embedding models. Our method uses sparse token matching to improve retrieval without additional training. Each query token retrieves a small set of matching tokens across candidate memories. The matching scores are aggregated for each memory and combined with whole-memory similarity to rank memories. An optional low-rank query adapter can be trained with supervision while keeping the encoder and stored memory representations fixed. Our method improves retrieval across eight benchmarks and multiple model families without additional training. Query adaptation further increases the gains to 13.3 and 14.3 percentage points in average Recall@10 and NDCG@10 on Qwen3-Embedding-4B. These retrieval gains translate into higher question-answering accuracy on long-term memory benchmarks.

cs.LG [Back]

[129] Kairos: Toward a Byte-Level Foundation Model for Every Modality cs.LG | cs.AI | cs.CLPDF

Fabien Furfaro

TL;DR: Kairos 提出共享字节空间的多模态基础模型架构，但本文只做了小规模收敛健全性检查：证明组件能优化，不证明泛化、多模态能力或与现有模型相比更好。

Details

Motivation: 在单台本地机器训练小型语言模型时，架构试错预算有限。Kairos 将统一字节级表征与多种注意力、残差、MoE 和多模态 codec 组件结合；本文首先要回答的是实现是否能训练收敛，而非功能效果是否成立。

Result: 架构包含共享投影上的双向 gated-DeltaNet 线性注意力与滑窗注意力（LiZAttention2）、分块 Attention-Residual 聚合、稀疏 MoE 前馈层，以及面向文本、图像、音频、视频、激光雷达和控制流的多尺度字节 codec，并用共享字节空间上的均匀噪声去噪目标训练。作者逐组件给出算法，并进行收敛检查：以 1–15M 参数模型拟合一条 440 字节句子；codec 和注意力选项各用三个随机种子，另外七项因素为单次扫描。两种 3,000 步注意力设置的最低 loss 约为 10⁻³；600 步后不同 codec 的平均最低 loss 从 patch codec 的 0.018 到深度卷积 codec 的 0.354，三种子排序一致。共享注意力投影的早期优势随着训练步数或数据多样性增加而消失，冻结投影后甚至反转，说明是收敛速度差异而非容量优势。

Insight: 这些实验只证明当前实现能优化小样本拟合任务；作者明确指出它们不能说明泛化、多模态训练效果或相对已有模型的性能。200M 总参数/25M 激活参数目标及吞吐数字是分析性规划，非实测结果。

Abstract: Small language models trained on a single local machine leave little room for architectural trial and error. Kairos combines bidirectional gated-DeltaNet linear attention and sliding-window attention over shared projections (LiZAttention2), block-wise Attention-Residual aggregation, a sparse Mixture-of-Experts (MoE) feed-forward layer and a multi-scale byte-level codec, trained with a uniform-noise denoising objective over one byte space shared by text, image, audio, video, lidar and control streams; this report asks whether the combination optimizes at all before asking whether it is useful. We give code-derived algorithms for each component, including a cross-session recurrent-state memory gate, then run convergence sanity checks: overfittinga single 440-byte sentence at 1–15M parameters, text only, with three seeds for codec and attention choices and single-run sweeps for seven further factors. The two attention variants tested at 3,000 steps (LiZAttention2 and window attention alone) reach a minimum loss near $10^{-3}$. After 600 steps, the mean minimum loss ranges from 0.018 (patch codec) to 0.354 (depthwise convolutional codec) with an identical ranking on three seeds. An apparent advantage of shared over separate attention projections closes with more steps or more diverse data and reverses when the projections are frozen: it is a convergence-speed effect, not a capacity effect. These checks suggest that the implementation optimizes; they say nothing about generalization, multimodal training or comparison with existing models, which a planned pretraining run is meant to address. The Discussion sizes a 200M-total/25M-active target analytically; none of its throughput figures is measured. Code is available at https://github.com/fabienfrfr/Kairos . Python package at https://pypi.org/project/kairos-fm/ .

[130] REDaCT: Collapse-Free Unlearning in Large Reasoning Models cs.LG | cs.AI | cs.CLPDF

Joshua Maccoby, Wendy Hui Wang

TL;DR: REDaCT 在推理时检测思维链中的遗忘集泄漏，并注入离线学习的纠正嵌入继续生成；作者报告避免推理崩溃，同时完全忘记答案、近乎完全忘记思维链内容。

Details

Motivation: 大推理模型的遗忘不仅需删除最终答案中的遗忘集信息，也要清除推理过程中的泄漏。现有方法可能导致推理崩溃：模型无法生成连贯思维链或不能正常结束推理。

Result: REDaCT（REgenerate via Detection and Corrective Tuning）包含二元泄漏检测器，用于定位推理轨迹中泄露遗忘集信息的句子；另有离线学习的纠正嵌入，在推理时首次发现泄漏处注入，以引导后续轨迹避开相关内容。作者在多个数据集上评估，报告相较先进遗忘方法显著更好地保留推理连贯性、完全避免推理崩溃，同时保持答案遗忘率为完全遗忘、思维链遗忘率接近完全；摘要未提供具体数据集或分数。

Insight: 在首次泄漏处介入并重生成后缀，试图同时控制中间推理和最终答案，而不对整个推理模型做常规微调。遗忘效果和推理保留结论为摘要报告，具体度量及跨场景稳健性需看正文。

Abstract: Unlearning in large reasoning models (LRMs) requires removing forget-set information from both the reasoning trace and the final answer. Existing approaches achieve this objective at the cost of reasoning collapse, where the model fails to produce a coherent chain-of-thought (CoT) and does not properly terminate its reasoning process. To address this challenge, we propose REDaCT (REgenerate via Detection and Corrective Tuning), an inference-time unlearning framework for LRMs. REDaCT consists of two key components: (1) a binary leak detector that identifies sentences in the reasoning trace that leak forget-set information, and (2) an embedding optimization module that learns a corrective embedding offline, such that when injected at the first detected leak during inference, it guides subsequent reasoning towards sentences that do not leak forget-set information. Experimental results show that REDaCT completely avoids reasoning collapse, substantially improving reasoning preservation compared to state-of-the-art unlearning methods while maintaining perfect answer forgetting and near-perfect CoT forgetting. Our code is available at: https://github.com/jmaccoby/redact.

[131] Recurrent Harness for Agentic Continual Learning cs.LG | cs.AI | cs.CLPDF

Yuxin Xiao, Zhiyun Lu, Jianyu Wang, Yangtian Zhang, Yang Song

TL;DR: ReHarness 在严格在线流式持续学习中加入对 harness 文本状态的反向修订，用每个实例的执行轨迹更新此前检索的反思；三项基准、三种主干上优于多类基线。

Details

Motivation: 持续运行的语言模型智能体需要适应分布变化，但现有 harness 常只沿前向信息流读写状态，或依赖额外回放/验证数据优化 harness，限制了纯在线适应。

Result: ReHarness 在前向读取和写入之外加入反向修订：每个实例完成后，用该实例的轨迹作为反馈，修改当时检索到的反思文本，追溯性地更新 harness 状态，以回答哪些经验本可被记录得更适合当前实例。三个持续学习基准、三种语言模型主干上，方法持续优于原始上下文、记忆/反思方法和提示优化基线。进一步分析显示，修订有来源依据且有意义，能纠正分布变化下过度概括或过期经验，并同时改善持续学习的稳定性与可塑性。

Insight: 文本记忆不是只能追加；根据后续实例反馈回改先前反思，可纠正旧经验并支持在线适应，而不需要额外回放或验证集。摘要未列基准名称和数值，结论限于三项持续学习基准及三种主干。

Abstract: Language model agents increasingly operate over long interaction streams, requiring online adaptation to distribution shifts through continual learning. However, existing agent harnesses typically either evolve their states only through forward information flow or rely on additional replay or validation data for harness optimization. To address this, we propose ReHarness, a recurrent harness framework for agentic continual learning that complements forward read and write with backward revision under a strictly online streaming protocol. We ask what information could have been captured differently in the harness state to better inform the current instance in the stream. Specifically, after each instance, we leverage the resulting trajectory as feedback to revise the reflections retrieved for that instance, thereby propagating feedback backward through the textual harness state. Across three continual learning benchmarks and three language model backbones, ReHarness consistently outperforms strong raw-context baselines, memory- and reflection-based methods, and prompt optimization approaches. Further analysis shows that ReHarness produces source-grounded and meaningful revisions, corrects overgeneralized or outdated experience under distribution shifts, and improves both stability and plasticity during continual learning.

[132] S$^3$R: Fast and Faithful RL Rollouts via Self-Sparse Speculative Decoding cs.LG | cs.CLPDF

Yuhang He, Hongyu Ge, Zihan Lin, Siyi Liu, Yongqi Zhang

TL;DR: S³R 用同一策略的稀疏注意力提出 token，再通过全注意力精确 speculative 验证，使 RLVR rollout 组仍服从稠密策略分布，并用 KV 感知调度降低缓存反复换入换出。

Details

Motivation: 长上下文 RLVR rollout 的解码常受 KV 缓存流量限制，稀疏注意力能减少读取，但直接从稀疏策略采样会改变用于组相对优化的响应组分布。即使逐响应精确重加权，因每个响应的优势依赖同组其他回答奖励，通常也无法恢复稠密策略的期望更新。

Result: Self-Sparse Speculative Rollouts（S³R）由稀疏注意力提出 token，再用全注意力验证和精确 speculative sampling 生成响应；草拟和验证共享同一策略参数，不需训练独立草拟器，最终响应组服从稠密策略分布。作者分析了其加速条件以及草拟、验证成本，并指出稠密验证仍需完整历史 KV。KV 感知调度器在保持 rollout 并行度的同时减少 KV 缓存重复卸载/恢复。激进稀疏草拟消融中，S³R 训练保持稳定，而直接稀疏采样加训练侧修正不稳定。长上下文数学推理中，摘要报告相对 Qwen3 自回归 rollout 的端到端训练吞吐为“1.39×~1.35×”，该写法顺序和对应设置不明；任务表现相当。

Insight: 该方法通过全注意力精确验证保留稠密策略的采样分布，同时用稀疏草拟减少平均解码成本；因此没有直接将优化策略换成稀疏分布。吞吐倍率在摘要中存在格式/设置歧义，未自行归一为明确区间。

Abstract: Fast rollout generation for long-context reinforcement learning with verifiable rewards (RLVR) requires reducing KV-cache traffic without changing the response groups used for policy optimization. In our profiled RLVR workloads, attention accounts for 72–76% of autoregressive decoding kernel time. Sparse attention reduces these reads, but sampling directly from a sparse policy changes the response groups used for learning. For group-relative optimization, we show that even exact response-wise reweighting does not generally recover the expected dense-policy update because the advantage of each response depends on the rewards of other group members. We propose Self-Sparse Speculative Rollouts (S$^3$R). It uses sparse attention to propose tokens, then generates responses through full-attention verification and exact speculative sampling. Drafting and verification share the same policy parameter, eliminating the need to train or update a separate drafter. The resulting response groups follow the dense-policy distribution. Under S$^3$R, we characterize speedup conditions and the costs of drafting and verification. We found that dense verification still requires the complete historical KV cache. A KV-aware scheduler therefore limits KV-cache repeated offloading and restoration while maintaining rollout parallelism. % OR thrashing In a matched ablation with an aggressive sparse drafting budget, S$^3$R maintains stable training while direct sparse sampling with training-side correction becomes unstable. On long-context mathematical reasoning, S$^3$R achieves $1.39\times~1.35\times$ the end-to-end training throughput of autoregressive rollouts on Qwen3 model, with comparable task performance.

[133] CAST: Credit Alignment for Cross-Tokenizer On-Policy Distillation cs.LG | cs.CLPDF

Jingru Yang, Jinhang Wu, Minjing Shi, Shengfeng He, Xuyan Li

TL;DR: CAST 为跨 tokenizer on-policy 蒸馏增加 chunk 级信用分配和无对齐位置的选择性锚定；六项数学、科学与代码基准上，对 Qwen3→Mistral/Llama 转移平均提升 2.45/1.32 分。

Details

Motivation: 跨 tokenizer OPD 先需把教师与学生序列对齐。解码文本对齐可给出 chunk 对应关系，却无法确定 chunk 优势应如何分配到各学生 token，且没有教师对应的 token 不受约束。

Result: CAST 将 chunk 构造与信用分配分开。对已对齐 chunk，依据预测不确定性和局部教师信号平滑性，把 chunk 优势重新分配给学生 token，强调局部一致教师反馈支持的学习机会，同时保持 chunk 总优势不变；其权重精确求解一个 KL 正则信用分配问题。对未对齐位置，使用 KL 惩罚选择性锚定学生初始策略，限制缺乏教师监督处的漂移。由于两个环节解耦，同 tokenizer 时也可用于标点划分或固定长度 chunk。在六个数学、科学和代码基准上，跨 tokenizer 从 Qwen3-8B 转到 Mistral-7B、Llama-3.1-8B 时，相对最强评测基线平均提升 2.45、1.32 分；同 tokenizer 转到 Qwen3-1.7B 时提升 2.10 分。

Insight: chunk 级信号需同时解决内部 token 信用分配与无对应位置的策略漂移。CAST 分别用不确定性加平滑性分摊优势、用 KL 锚定未对齐 token；结果数字是跨六项基准的平均分提升。

Abstract: Cross-tokenizer on-policy distillation (OPD) requires aligning teacher and student sequences before their scores can be compared. Decoded-text alignment provides such correspondence at the chunk level, but leaves a distinct problem unresolved: credit alignment. A chunk-level signal specifies how much a span should change, but not how that signal should be distributed across student tokens, while tokens without teacher correspondence remain unconstrained. We propose CAST (Chunk-aware credit Assignment with Selective Token Anchoring), a shift-or-stay framework that addresses both issues. For aligned chunks, CAST redistributes each chunk’s advantage across student tokens using predictive uncertainty and local teacher-signal smoothness, emphasizing learning opportunities supported by locally consistent teacher feedback while preserving the chunk’s total advantage. The resulting weights exactly solve a KL-regularized credit-allocation problem. For unaligned positions, CAST selectively anchors the student to its initial policy through a KL penalty, limiting drift where teacher supervision is unavailable. Because credit assignment is separated from chunk construction, CAST also applies to punctuation-defined or fixed-length chunks under shared tokenization. Across six mathematics, science, and code benchmarks, CAST improves the average over the strongest evaluated baseline by $2.45$ and $1.32$ points for cross-tokenizer transfer from Qwen3-8B to Mistral-7B and Llama-3.1-8B, respectively, and by $2.10$ points for shared-tokenizer transfer to Qwen3-1.7B.

[134] Kernelized Parameter Sensitivity Atlases for Amortized Conditional Interpretability cs.LG | cs.CV | stat.MLPDF

Davide Wiest, Ahanaf Hasan Ariq, Abdul Monaf Chowdhury

TL;DR: KPSA 将经验神经切线核分块分解为参数敏感性图谱，用轻量核在新输入上估计输入条件化敏感度；相较反向传播 oracle 大幅降低计算与显存。

Details

Motivation: 梯度归因可揭示特定输入依赖哪些模型参数，但对大量样本逐一反向传播成本高；静态重要性分数更快，却丢失输入依赖性。

Result: Kernelized Parameter Sensitivity Atlas（KPSA）从经验神经切线核的块分解得到归一化参数组敏感度，将来源嵌入显式查询空间，并用轻量核估计未见输入的敏感度。理论部分给出区分有限来源误差与不可约表示误差的界，以及 margin 条件下 top-k 恢复保证。参数预算为 0.02%–0.1% 时，在视觉、预测和蛋白质建模设置中，选中参数组达到一阶反向传播 oracle 扰动敏感度的 39%–85%；视觉和预测中的稀疏敏感性回路跨层延伸并随输入改变。在 Transformer MLP 特征激活归因中，视觉任务保留 oracle 与恒定敏感度基线差距的 81%，批量查询吞吐由 551 提至 2,041 张/秒，峰值显存由 4.55 降至 0.44 GB；蛋白质任务保留该差距的 68%。

Insight: 核图谱可将输入依赖的参数敏感度以较低成本摊销到新样本上；消融还显示，在 KPSA 空间做近邻检索仍有竞争力。不同应用报告口径包括扰动敏感性占比和 oracle—基线差距保留率，应与吞吐/显存数据区分。

Abstract: Gradient-based attribution provides input-specific information about model parameters, but computing it via backpropagation for many samples is expensive, while static importance scores discard input dependence. We derive KPSA (Kernelized Parameter Sensitivity Atlas) from a block decomposition of the empirical neural tangent kernel. It measures normalized parameter-group sensitivity, embeds those sources in an explicit query space, and uses a lightweight kernel to estimate sensitivities for unseen inputs. We derive bounds that separate finite-source from irreducible representation error and give margin-based top-$k$ recovery. This paper studies two interpretability applications. Firstly, KPSA identifies parameter groups with high susceptibility to perturbations across vision, forecasting, and protein-modeling setups. Across a fivefold range of parameter budgets ($0.02$-$0.1%$), its selected groups attain $39$-$85%$ of the perturbation susceptibility of a first-order backpropagation oracle. In vision and forecasting, these parameter groups form sparse sensitivity circuits that extend across depth and vary systematically with the input. Secondly, we use KPSA on an activation-attribution problem for MLP features in transformers. It retains $81%$ of the gap between a backpropagation oracle and a constant-sensitivity baseline on vision while increasing batched query-time throughput from 551 to 2,041 images/s and reducing peak GPU memory from 4.55 to 0.44GB. On the protein-modeling task, it recovers $68%$ of this gap. An ablation of KPSA’s kernel aggregation shows that nearest-neighbor retrieval in KPSA space can remain competitive. The empirics show that compact kernel atlases can store useful input-dependent parameter sensitivity while amortizing repeated gradient attribution, a step toward scalable conditional interpretability. Code can be found at https://github.com/Axym-Labs/kpsa .

cs.RO [Back]

[135] CASTER: Formalizing Zero-Shot Manipulation from Synthetic Videos as Constrained Optimization cs.RO | cs.CVPDF

Yinlong Dai, Homanga Bharadhwaj, Dylan P. Losey

TL;DR: CASTER 将由生成视频到真实机器人轨迹的零样本操作形式化为带物理和语义约束的优化，并要求视频生成把初始轨迹放在可局部修正的语义吸引域中；任务成功率较最佳基线平均提高 34.1%。

Details

Motivation: 生成模型能按提示制作与机器人当前环境相关的任务视频，避免真人演示，但视频动作虽看似合理，却不满足物理一致性或机器人控制约束，无法直接执行。需要从生成视频提取运动初值，再转成可行的真实机器人轨迹。

Result: CASTER 将问题表述为约束优化：从合成视频提取的物体轨迹提供初始猜测，机器人在数字孪生等环境中优化轨迹，同时满足物理可行性与语义一致性。分析指出，视频生成必须以概率方式把搜索初始化在任务语义的吸引域内，使轨迹可局部修正而不丢失任务含义；作者还将现有先进方法解释为该统一框架的简化实例。实验取消这些简化以更贴近优化过程，得到更稳健的零样本轨迹，相较最佳基线平均任务成功率提高 34.1%。

Insight: 合成视频不需要直接等于可执行动作，但必须提供靠近正确语义解的良好初值，使优化能在不改任务意图的前提下满足机器人约束。34.1% 是平均成功率增益，摘要未说明相对百分比还是百分点及具体任务/机器人。

Abstract: Prior research on learning from humans often requires real human demonstrations. But advances in video generation models offer a new paradigm: we can now prompt these generators to make synthetic videos of the task. On the plus side, these synthetic videos take place in the robot’s current environment, and do not require actual human teaching. However, while the generated videos appear to show plausible motions, they lack both physical consistency and robot grounding, and thus the robot cannot directly roll out the trajectory shown by the video. In this paper we seek to formalize the process of going from synthetic video generation to real-world robot trajectories for zero-shot manipulation tasks. We recognize that this problem is an instance of constrained optimization. The object trajectories extracted from the synthetic video provide an initial guess at the correct motion, and the robot must refine these trajectories (for instance, within a digital twin) while enforcing physical feasibility and semantic consistency. Our optimization-based formalism provides insights into the video generation properties necessary for success. Specifically, we show that the video generation must probabilistically seed the search within a semantic basin of attraction where the trajectory can be locally modified without losing its task alignment. Our analysis further reveals that state-of-the-art approaches can be viewed as instances of our unified formalism with key simplifications. In our experiments we remove these simplifications to more closely match the underlying optimization, leading to more robust zero-shot trajectories from synthetic videos and improving average task success by 34.1% compared to the best-performing baseline. See videos at our project website: https://collab.me.vt.edu/CASTER

[136] Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedback cs.RO | cs.CV | cs.LGPDF

Jaewoo Lee, Jeongyeon Seo, Sihyun Cho, Gyeongrak Choe, Yutong Wang

TL;DR: Fly-by-Code 让具身编程智能体生成诊断程序，在仿真中主动观察不可见结果或用针对性物理交互检验失败原因；六项模拟任务上错误报完成从 25 次降至 5 次，最终成功率从 31.7% 升至 75%。

Details

Motivation: 具身编程智能体靠执行反馈修订程序，但空中操作受载荷限制，机载相机看不到关键结果；动力耦合强、控制余量小又使交互易失败，现有反馈可能无法区分原因。重看同一反馈不能恢复从未采集的观察或消除证据歧义。

Result: Active Feedback（AF）是主动 View and Probe 框架：当执行反馈留下未解决问题时，智能体生成独立诊断程序，在仿真中从有信息量的视角检查未见结果（View），或通过针对性物理交互检验失败原因假设（Probe）。六项模拟空中操作任务、每种条件 60 次试验中，相对同一编程智能体配置和执行上限下的终端反馈，AF 将错误完成声明从 25 次降至 5 次，最终任务成功率从 31.7% 提高至 75%。使用共享机器人 API，在仿真中经 AF 修订的任务程序无需修改源代码即可运行于实体空中操作机器人，并完成真实世界多阶段操作。

Insight: 改进不仅来自更多推理，而是通过执行诊断主动采集此前缺失或无法区分失败原因的证据。模拟统计覆盖六个任务，实体迁移展示程序无需改源码可执行；摘要未报告实体测试次数或成功率。

Abstract: Embodied coding agents construct robot policies from natural-language instructions by generating executable programs and refining them from execution feedback. This refinement assumes that execution feedback reveals whether the task succeeded and, after a failure, provides sufficient evidence to guide program revision. Aerial manipulation violates this assumption in two ways. Payload constraints restrict onboard camera coverage and leave task-critical outcomes outside the robot’s view (partial observability), while strong dynamic coupling and limited control margins make physical interactions fragile (limited interaction robustness) and leave failure causes unresolved. Re-examining the same feedback cannot recover observations that were never collected or separate failure causes that the available evidence does not distinguish. To acquire this missing evidence, we introduce Active Feedback (AF), an active “View and Probe” framework. When execution feedback leaves unresolved questions, the agent synthesizes a separate diagnostic program that runs in simulation to inspect unseen outcomes from informative viewpoints (View) or test hypotheses about failure causes through targeted physical interactions (Probe). Across six simulated aerial manipulation tasks with 60 trials per condition, AF reduces false completion declarations from 25 to 5 and raises final task success from 31.7% to 75% compared with terminal feedback under the same coding-agent configuration and task-execution limit. Using shared robot APIs, task programs refined with AF in simulation run on a physical aerial manipulator without task-program source-code modification and complete multi-stage manipulation tasks in the real world. These results show that executable diagnosis fills gaps in execution feedback for embodied coding agents, improving both completion assessment and program refinement in aerial manipulation.

[137] StereoEngine: Scaling Stereo Bimanual Robot Data without Stereo Cameras cs.RO | cs.CV | cs.LGPDF

Jason Chen, I-Chun Arthur Liu, Gaurav Sukhatme, Daniel Seita

TL;DR: StereoEngine 提供两种免真实双目输入的机器人立体数据合成方案：单目左视图加深度变形/视频扩散补全，或仿真双目渲染后联合生成左右视图；合成数据可改善双臂操作策略。

Details

Motivation: 立体视觉正进入 VLA 机器人操控模型，但大规模真实双目数据稀缺。已有单目转双目方法面向 VR 或自动驾驶，尚缺少适用于机器人操控、能提供稳定立体监督的高真实感合成数据。

Result: StereoEngine 采用两条互补路线。第一种估计深度，将单目左视图视频变形到右视角，再用视频扩散模型补全视差造成的遮挡区域，从单目演示提升为立体配对数据，不需真实双目训练数据。第二种先在仿真中渲染双目，再联合生成左右两幅逼真视图，完全不需要真实视频输入。方法在生成立体质量上超过既有基线；用合成数据进行策略中期训练或任务特定微调，都能显著提升下游双臂操控效果。摘要未提供具体质量指标或操作成功率。

Insight: 两条路径分别把真实单目视频和仿真几何作为基础，可扩展机器人立体数据来源；共同目标是左右视图一致且逼真。训练收益为定性描述，尚无摘要级提升数值或跨机器人结果。

Abstract: Stereo vision is increasingly used for robotic manipulation, with a growing body of work incorporating it into Vision-Language-Action (VLA) models. However, the scarcity of large-scale, real-world stereo datasets remains a fundamental bottleneck for scaling such policies. Recent generative monocular-to-stereo methods target settings such as VR content and autonomous driving. No prior work produces realistic synthetic stereo data for robotic manipulation, where stereo supervision has come predominantly from simulation. We propose StereoEngine, which introduces two complementary methods to synthesize stereo data for robotic manipulation. In the first, we warp a monocular (left) video into the right view using estimated depth and inpaint the disoccluded regions with a video diffusion model, lifting monocular demonstrations into stereo pairs without training on real stereo. In the second, we render a stereo pair in simulation and jointly generate both photorealistic views, producing consistent left-right data without any real video as input. StereoEngine outperforms existing baselines in generated stereo quality, and using its synthetic data for policy mid-training or task-specific fine-tuning substantially improves downstream bimanual manipulation. Project website: https://stereoengine.github.io

[138] Dual-Stream Memory for Vision-Language-Action Policies cs.RO | cs.CVPDF

Yang Wang, Ping Liu, Ruiyu Wang, Xuhua Chen, Lingfeng Zhang

TL;DR: 双流记忆 VLA 将执行历史压缩为一个时间 token，并按任务相关性检索保留关键帧；16 项 RoboMME 任务平均成功率 49.22%，四项真实机器人任务为 62.5%。

Details

Motivation: 依赖记忆的机器人操作既要跟踪任务执行状态，也要找回当前已不可观测的视觉证据。单一记忆形式难以同时保留长时间动作上下文和局部画面细节。

Result: 方法将两个需求分到互补流：任务无关 Gated DeltaNet 把历史压缩为一个时间 token，并通过进度预测和动作条件特征重建监督；任务条件检索器保留相关性超过固定阈值的帧，再以线性多尺度融合将每帧编码为 16 个空间 token。随后冻结时间压缩器，联合优化检索与策略。在 16 项 RoboMME 任务上，完整模型平均成功率 49.22%，高于已发表 FrameSamp+Modul 参考的 44.51%，在 14 项任务和四个套件均值上改善。四项真实机器人任务平均成功率为 62.5%，对照为 37.5%；最大收益出现在需区分执行阶段的重复动作。杯子交换时仍会失败，显示持续身份跟踪尚未解决。

Insight: 时间压缩提供执行阶段信息，检索流则恢复历史视觉细节，二者互补。数据表明整体提升但并非每项任务都提高，杯子身份交换仍暴露出对象追踪瓶颈；真实机器人结论基于四项任务。

Abstract: Memory-dependent manipulation requires a policy to track execution state and recover visual evidence that is no longer observable. We propose dual-stream memory for vision-language-action policies, assigning these requirements to complementary representations. A task-agnostic Gated DeltaNet compresses history into one temporal token, supervised by progress prediction and action-conditioned feature reconstruction. A task-conditioned retriever retains frames above a fixed relevance threshold; linear multi-scale fusion encodes each frame into sixteen spatial tokens. We then freeze the temporal compressor and jointly optimize retrieval and policy learning. Across sixteen RoboMME tasks, the complete model achieves 49.22% mean success versus 44.51% for the published FrameSamp+Modul reference, improving fourteen tasks and all four suite means. On four real-robot tasks, mean success reaches 62.5% versus 37.5%, with the largest gains on repeated actions requiring execution-stage discrimination. These results support combining execution context with selective visual access, while failures under cup swaps expose persistent identity tracking as an unresolved requirement.

[139] RARA: Robust Policy Fine-Tuning through Retrieval-Anchored Representation Alignment for Robotic Manipulation cs.RO | cs.CV | cs.LGPDF

Xuhui Kang, Sung-Wook Lee, Yan Zhuang, Tianle Zhong, Yen-Ling Kuo

TL;DR: RARA 用预训练演示检索锚定表示，再在微调时约束检索样本表征漂移；Diffusion Policy 与 GR00T 在 13 项任务上的平均成功率提升 9.5 个百分点（域内）和 13.6 个百分点（分布外）。

Details

Motivation: 预训练 VLA 策略可作为通用操作基础，但少量演示下适配新任务困难。直接微调虽能提升域内性能，却可能扭曲预训练表示并损害分布外泛化。

Result: RARA 分两阶段适配：首先从预训练数据中检索任务意图和动作相似的演示，将目标演示的策略表示与检索演示的预训练表示对齐；然后用目标演示微调策略，同时限制检索演示表示在微调中的变化。这样先降低表示错配，再在动作学习阶段保留预训练知识。在 RoboTwin、RoboCasa 的 13 项任务及真实机器人实验中，Diffusion Policy 和 GR00T 的微调平均成功率相较对照域内提升 9.5 个百分点、分布外提升 13.6 个百分点，并超过所比较基线。

Insight: 检索到的预训练相似演示既用于初始化对齐，也作为微调期间的稳定锚点，从而缓解少样本适配造成的表示漂移。报告提升按域内/分布外汇总，摘要未给各策略、任务或真实机器人单独数值。

Abstract: Pre-trained robot policies, such as Vision-Language-Action (VLA) models, provide a strong foundation for generalist robotic manipulation, but adapting them to new tasks with only a few demonstrations remains challenging. Directly fine-tuning a pre-trained policy often achieves strong in-distribution performance, yet it can distort the representations learned during pre-training and weaken the model’s generalization ability under out-of-distribution shifts. We propose Retrieval-Anchored Representation Alignment (RARA), a two-stage adaptation method, to address this issue. First, RARA retrieves representation features from pretraining with similar task intent and motion, and aligns the policy’s representations of the target demonstrations with the pre-trained representations of the retrieved demonstrations. Second, RARA fine-tunes the policy on the target demonstrations while limiting how much its representations of the retrieved demonstrations change during fine-tuning. By reducing the representation mismatch before action learning and preserving pre-trained knowledge during adaptation, RARA limits unnecessary representation drift during fine-tuning. Experiments with Diffusion Policy and GR00T on 13 tasks in RoboTwin, RoboCasa, and on a real robot show that RARA improves the average success of fine-tuning by 9.5 points in-distribution and 13.6 points out-of-distribution, and outperforms all compared baselines. Project page: https://shua-kang.github.io/RARA_robot/

[140] Beyond Successful Robot Demonstrations: Learning from Human Interactions and Modeling Failure Dynamics cs.RO | cs.CVPDF

Peiyan Tu, Cong Wang, Hanxin Zhu, Xin Jin, Zhibo Chen

TL;DR: HF-WM 用人类第一人称视频学习动作条件世界模型，并用受扰成功动作做 failure-aware GRPO 后训练，以捕捉失败动力学；作者报告视频生成达到 SOTA 且有助下游策略评估。

Details

Motivation: 机器人世界模型需要覆盖多样交互动力学，但机器人数据规模有限。人类第一人称视频补充丰富交互经验，却因手部与机械臂形态差距难直接迁移；成功演示占主导也使失败动力学代表不足。

Result: HF-WM 结合人类交互学习与失败感知后训练。为缩小 embodiment gap，双分支架构联合视频生成与辅助 pointflow 预测，以稳定点流作为人类和机器人交互的共同运动表示，同时抑制第一人称相机运动。为补足失败建模，作者对成功演示派生的受扰动作进行 GRPO 后训练，并用动作对齐和物理合理性奖励引导模型，无需配对失败真值视频即可学习可信失败动力学。实验报告 HF-WM 在动作条件视频生成上达到 SOTA，并在下游机器人策略评估中有较强效用；摘要未提供具体数据集或指标。

Insight: pointflow 表示将视觉运动与具身动作对齐，成功动作扰动则为无失败标签的数据补充失败轨迹信号。结果包含生成质量和策略评估两个方面，但摘要没有量化指标，不能判断各模块单独收益。

Abstract: Action-conditioned world models offer a promising foundation for generalist robotic intelligence by predicting the consequences of actions. However, existing robotic datasets provide limited coverage of the diverse interaction dynamics required for generalizable world modeling. Large-scale egocentric human videos offer complementary interaction experience, yet the embodiment gap between human hands and robotic manipulators hinders effective cross-embodiment learning. Meanwhile, the predominance of successful demonstrations leaves failure dynamics substantially underrepresented, limiting the ability of world models to anticipate unsuccessful executions. To address these limitations, we introduce HF-WM, an action-conditioned world model that combines Human interaction learning with Failure-aware post-training. To bridge the embodiment gap, we develop a dual-branch framework that couples video generation with auxiliary pointflow prediction, using stabilized pointflow as a unified motion representation across human and robot interactions while suppressing egocentric camera motion. To improve failure modeling, we further perform Group Relative Policy Optimization (GRPO) post-training on perturbed actions derived from successful demonstrations, guided by action alignment and physical plausibility rewards, enabling the model to learn plausible failure dynamics without paired ground-truth videos. Extensive experiments demonstrate that HF-WM achieves state-of-the-art performance in action-conditioned video generation and exhibits strong utility for policy evaluation in downstream robotic tasks.

[141] Dream to Remember: Continual Steering of Generalist Robot Policies with World Models cs.RO | cs.CV | cs.LGPDF

Bahey Tharwat, Iman Nematollahi, Marvin Alles, Xingyuan Zhang, Akshay L Chandra

TL;DR: D2R 用冻结世界模型想象回放旧任务，以持续训练一个小型 steering 模块而不改通用机器人策略；CALVIN 连续八任务平均成功率从 63.7% 升至 74.8%，LoRA 微调则降至 11.7%。

Details

Motivation: 通用机器人策略通过模仿学习获得，受示范质量和覆盖限制。强化学习可通过微调权重或训练小模块引导冻结生成策略拓展技能，但任务顺序到来时两者都可能灾难性遗忘：微调会损伤旧任务，只训练共享 steering 模块也会转移遗忘。

Result: Dream to Remember（D2R）持续训练 steering 模块，让冻结通用策略学习新任务，同时保留旧技能。世界模型冻结并对先前任务进行想象 rollout，作为无 replay buffer、无新数据的旧行为锚点。若世界模型足够准确，新任务可完全在想象中学习；若不够准确，则在真实环境学习新任务，只用世界模型复习旧任务。CALVIN 上连续学习八项任务全程在想象中完成，平均成功率由 63.7% 升至 74.8%，同序列 LoRA 微调降至 11.7%。用冻结现成 π₀ 和 A2World 学习未见 LIBERO-90 任务时，即便世界模型不足以用于策略优化，D2R 仍保留 π₀ 在原先微调 LIBERO 套件上的表现。真实 Franka 机器人上也完全通过想象连续改善三项任务并保留早先提升。

Insight: 世界模型可用于旧任务 rehearsal，而不必承担新任务优化；当其预测不够准确时仍可将其局限于旧技能保持。结果覆盖 CALVIN、LIBERO-90 与真实 Franka，模型保真度决定新任务能否完全在想象中训练。

Abstract: Generalist robot policies are trained with imitation learning and are bounded by the quality and coverage of their demonstrations. Reinforcement learning can improve and extend them, either by fine-tuning the policy weights or by training a small module to steer the input noise of a frozen generative policy. When tasks arrive sequentially, both approaches suffer from catastrophic forgetting. Fine-tuning on a task degrades prior tasks, and steering only shifts forgetting to the shared steering module. We propose Dream to Remember (D2R), which continually steers a frozen generalist policy toward new tasks, while retaining its earlier skills. As the steering module learns a new task, a frozen pretrained world model rehearses prior tasks through imagined rollouts, anchoring the module to its earlier behavior without a replay buffer or new data. When the world model is faithful enough, D2R learns the new task entirely in imagination. Otherwise, it learns the task in the environment while using the world model only to rehearse prior tasks. On CALVIN, D2R improves eight tasks in sequence entirely in imagination, raising average success from 63.7% to 74.8%, while LoRA fine-tuning on the same sequence drops it to 11.7%. With a frozen off-the-shelf generalist policy and world model, $π_0$ and A2World, D2R learns unseen LIBERO-90 tasks in the environment while keeping $π_0$’s performance on the LIBERO suites it was fine-tuned on, even though the world model is not accurate enough for policy optimization. Finally, on a real Franka robot, D2R improves three tasks in sequence entirely in imagination while retaining the earlier improvements.

[142] Splat2Act: From Captured Scenes to Personalized VLA Manipulation cs.RO | cs.CVPDF

Xiaomeng Ye, Krishna Jaganathan, Gyubeum Lim, Gunjan Chhablani, Muhammad Zubair Irshad

TL;DR: Splat2Act 用手机场景扫描和物体照片自动构建建筑级 3DGS 仿真环境，生成仿真 oracle 演示并两阶段个性化 π0.5；目标场景成功率 62.5%，Stretch 3 实机子集成功率 63.9%。

Details

Motivation: 用户希望通用操作机器人能处理自己家中或办公室的物品，但即使强通用策略 π0.5 在作者采集的部署场景中未适配时拿取成功率为 0%。为每个环境收集真实演示成本高，现有 real-to-sim 方法也多聚焦单张桌面而非整栋室内环境。

Result: Splat2Act 构建自动化 real-to-sim-to-real 流程，仅需人类用手机扫描场景并拍摄物品。系统用 3D Gaussian Splatting 和碰撞几何构建逼真数字孪生，自动发现桌面及非桌面置物点，构造可行拿取任务，并由特权仿真 oracle 生成成功演示。对 101 个扫描校园环境（可导航面积中位数 104.87 m²、每个 7 个置物点），生成 852 个置物点和超过 68,000 条演示。π0.5 两阶段微调：先适配公共物品资产，再适配用户自有物体和目标场景置物点。最佳个性化策略在目标场景聚合成功率 62.5%；部署到 Stretch 3 后，12 项任务子集实机成功率 63.9%，接近同任务仿真的 66.7%。

Insight: 建筑级自动建模和特权仿真演示让个性化从少量用户采集转为大规模模拟数据训练。实机结果来自 12 项任务子集，场景成功率与仿真 66.7% 的匹配只针对这些任务；未适配策略的 0% 是作者采集部署场景结果。

Abstract: A user who brings a generalist manipulation policy into their home or office wants it to pick up their objects from their shelves, counters, and tables. Yet even a strong generalist like $π_{0.5}$ achieves 0% pickup success in our captured deployment scenes without adaptation, and collecting real demonstrations in every user’s environment is prohibitively expensive. We present Splat2Act, an automated real-to-sim-to-real pipeline that personalizes a pretrained vision-language-action (VLA) policy to a specific scene and object set using only a handheld phone scan and images of the user’s objects. Unlike prior real-to-sim work that reconstructs individual tabletops, Splat2Act operates on building-scale indoor environments: it builds a photorealistic digital twin with 3D Gaussian Splatting and collision geometry, automatically discovers tabletop and non-tabletop receptacles, constructs feasible pickup tasks, and generates successful demonstrations with a privileged simulation oracle, with only scene and object capture required from a human. Applied to 101 scanned campus environments with a median navigable area of 104.87 m$^2$ and 7 receptacles, the pipeline yields 852 receptacles and over 68,000 pickup demonstrations. We fine-tune $π_{0.5}$ in two stages: Stage 1 adapts to hundreds of public object assets, drawn either from the deployment scene alone or from all 101 scenes; Stage 2 personalizes to the user’s own objects on the deployment scene’s receptacles. Our strongest personalized policy reaches 62.5% aggregate pickup success in the target scene. Deployed on a real Stretch 3, the same policy achieves 63.9% success on a 12-task subset, closely tracking its 66.7% simulated success on those tasks. These results suggest that automated real-to-sim-to-real training can personalize VLA manipulation policies using only simulation-oracle data.

cs.SD [Back]

[143] AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation cs.SD | cs.CV | eess.ASPDF

Shaohua Pan, Xiao Liu

TL;DR: AV-FlowEdit 利用源/目标流差异同时驱动音视频编辑方向与保留线索，并在采样时保护不支持修改的区域；免训练、免反演地支持视频单独、音频单独和联合编辑。

Details

Motivation: 联合音视频扩散模型能生成同步内容，但编辑已有片段时既要实现目标修改，又要保持非目标结构及跨模态对应。采样过程中的漂移可能破坏原有事件和音视频一致性。

Result: AV-FlowEdit 是无需训练、无需优化式反演的提示驱动音视频编辑框架。核心观察是源与目标的流差异既提供跨模态编辑方向，也提供内容保留线索；在共享扰动下同时更新视频和音频分支，使方法支持仅视频、仅音频和联合编辑，并保留预训练模型的跨模态交互。Cross-Modal Event-Aware Spectral Trajectory Preservation 结合流显著性、对齐音频活动、多尺度低频位移和扩散阶段调度，抑制采样累积漂移：保留缺少编辑支持的区域，同时允许预期音画事件变化。实验报告提示对齐和时间一致性较强，音频质量及跨模态连贯性有竞争力；摘要未列出量化分数。

Insight: 音频和视频共同提供编辑目标与保留约束，轨迹保留模块再按事件相关性区分应改动和应冻结内容。方法不需要额外训练、外部掩码或反演，但摘要未给具体主干、数据集或编辑成功率。

Abstract: Joint audio-video diffusion models generate synchronized content, but editing existing clips requires target changes without disrupting non-target structure or cross-modal correspondence. We present AV-FlowEdit, a training-free and inversion-free framework for prompt-driven audio-video editing. Our key insight is that source–target flow differences provide both cross-modal editing directions and preservation cues. Under shared perturbations, they jointly update the video and audio branches, supporting visual-only, audio-only, and joint edits while retaining pretrained cross-modal interactions. To suppress drift accumulated during sampling, Cross-Modal Event-Aware Spectral Trajectory Preservation combines flow saliency, aligned audio activity, multiscale low-frequency displacement, and diffusion-stage scheduling. This adaptively preserves unsupported regions while allowing intended audio-visual events. AV-FlowEdit requires no model training, external masks, or optimization-based inversion. Experiments show strong prompt alignment and temporal consistency, together with competitive audio quality and cross-modal coherence.

cs.SE [Back]

[144] ProgramGym: Scaling Training Environments for Long-Horizon Program Reproduction Agents cs.SE | cs.AI | cs.CLPDF

Chengyi Yang, Renxu Bao, Jue Hou, Zongpei Teng, Ziheng Wang

TL;DR: ProgramGym 自动从代码仓库构建可验证的长程程序复现环境，并配套分析—实现—审查智能体；对 Qwen3.8-27B 轨迹微调后 ProgramBench 表现从 34.87% 升至 42.84%。

Details

Motivation: 编码智能体正从修复现有仓库或按需求文档搭建项目，扩展到从零复现既有程序，但能够要求智能体自行发现需求和设计系统的可扩展、可验证训练环境仍很少。现有工作流也难以在探索参考程序后持续进行长时程实现。

Result: ProgramGym 包含 Program-Env 和 Program-Agent。Program-Env 用反馈循环从代码仓库构建可验证环境，修复运行沙箱构建问题并改善黑盒测试质量，生成 1,648 个覆盖 C、C++、Go、Rust 的训练环境。Program-Agent 将分析、实现和审查角色隔离，并用版本修订管理编译检查与失败恢复。在 ProgramBench 上，环境和智能体组件都提升程序复现表现；用构造环境轨迹微调后，Qwen3.8-27B 从 34.87% 升至 42.84%。Program-Agent 进一步使基础模型与 SFT 模型达到 55.71% 和 56.25%，超过部分旗舰模型。

Insight: 训练过程既需要可修复的构建/测试环境，也需要允许反复探索、实现和审查的长程 agent 工作流。数值均对应 ProgramBench；摘要未说明这些模型分数的具体测试划分及与哪些旗舰模型逐一比较。

Abstract: Coding agents are increasingly used to build programs from scratch as software engineers do rather than to resolve issues within a repository or to generate a repository from a given requirements document. However, scalable verifiable training environments that force agents to discover what is required and to decide how the system should be designed remain scarce. Moreover, existing agent workflows also cannot sustain long-horizon development in which the agent explores the reference program before implementation. To address these challenges, we introduce ProgramGym, a framework consisting of Program-Env and Program-Agent for scalable training environments of long-horizon program reproduction agents. Specifically, Program-Env constructs verifiable training environments from repositories through a feedback-driven loop that repairs runtime sandbox builds and the quality of black-box tests. Using this novel pipeline, we obtain 1,648 training environments spanning C, C++, Go, and Rust. Program-Agent combines a role-isolated workflow of analysis, implementation, and review with revision management for compilation checks and failure recovery. Experiments on ProgramBench show that both Program-Env and Program-Agent improve performance on program reproduction. Fine-tuning on trajectories with these constructed environments raises the performance of Qwen3.8-27B from 34.87% to 42.84%. Program-Agent further raises the base and SFT models to 55.71% and 56.25%, both exceeding some flagship models. We will release the ProgramGym to support further research on coding agents that build programs from scratch.

eess.IV [Back]

[145] Can Multimodal Decision Models Classify Breast Ultrasound Images? Benchmarking CLEF and CLEF-Flash Across Prompts and Datasets eess.IV | cs.CVPDF

Tran Cao Minh, Hai Tran, Ha Minh Tan

TL;DR: 对 2,818 张乳腺超声图的基准显示 CLEF/CLEF-Flash 表现依数据集和提示而变；临床提示下 CLEF-Flash 三个数据集准确率最高，但 BUS-BRA 所有配置都低于多数类基线。

Details

Motivation: 多模态决策模型可直接输出预定义选项概率，为图像分类提供结构化接口。该研究检验 CLEF 与 CLEF-Flash 在乳腺超声数据集上、不改变参数和不做用户预处理时，能否可靠完成良恶性等分类。

Result: 基准覆盖 Dataset B、BUSI、BUS-BRA 共 2,818 张图；前两类数据集做良性/恶性二分类，BUSI 另含正常类。测试三种提示：最简标签、明确分类任务、超声临床标准，报告准确率、macro-F1、平衡准确率、macro precision、吞吐和延迟。临床提示下 CLEF-Flash 在三个数据集准确率最高：Dataset B 74.85%、BUSI 66.28%、BUS-BRA 51.63%；但 BUSI 上 CLEF 的任务提示取得最高 macro-F1 64.51% 和平衡准确率 68.72%。所有配对比较中 CLEF-Flash 延迟更低。临床指导提高 CLEF-Flash 相对简短提示的准确率，却降低 CLEF 在所有数据集上的准确率。BUS-BRA 中良性误判为恶性的情况频繁，所有配置准确率都低于 67.63% 多数类预测基线。

Insight: 表现高度依赖数据集、提示和指标，单报准确率可能掩盖类别失衡；BUS-BRA 结果尤其说明模型配置甚至不如多数类策略。研究是不改参数的基准评估，不应据此推断临床诊断安全性或实际医疗效用。

Abstract: Multimodal decision models return probabilities over predefined alternatives, offering a structured interface for image classification. This study benchmarks inference with CLEF and CLEF-Flash on 2818 breast ultrasound images from Dataset B, BUSI, and BUS-BRA. Dataset B and BUS-BRA use binary benign-malignant classification, whereas BUSI includes normal, benign, and malignant categories. Model parameters remain unchanged, and original images are submitted without user-defined preprocessing. Three prompts provide minimal labels, an explicit classification task, or sonographic criteria. We report accuracy, macro F1, balanced accuracy, macro precision, throughput, and latency. CLEF-Flash with the clinical prompt achieves the highest accuracy on all three datasets: 74.85% on Dataset B, 66.28% on BUSI, and 51.63% on BUS-BRA. On BUSI, however, CLEF with the task-guided prompt achieves the highest macro F1 (64.51%) and balanced accuracy (68.72%). CLEF-Flash has lower latency in every matched comparison. Clinical instructions improve CLEF-Flash accuracy relative to the minimal prompt but reduce CLEF accuracy on all datasets. Confusion matrices reveal frequent benign-to-malignant errors, particularly on BUS-BRA, where all configurations fall below the 67.63% accuracy of a majority-class predictor. These findings demonstrate dataset-and prompt-dependent performance and motivate class-specific evaluation before applying multimodal decision models to breast ultrasound analysis.

q-bio.NC [Back]

[146] FlyHack: Stress-Testing Mechanistic Claims in a Connectome-Constrained Visual Model q-bio.NC | cs.CVPDF

Aashish Dhawan

TL;DR: 对 flyvis 果蝇运动视觉模型的压力测试表明，机制结论会依赖模型、干预、回路表示和训练解；连通组约束模型适合提出可检验假设，但不应将其机制结论泛化到真实果蝇。

Details

Motivation: 连通组约束网络允许直接干预生物结构，但据此得出的机制结论仍可能依赖比较模型、干预方法、回路表示及训练解。本文系统检验这些选择对果蝇运动视觉模型机制主张的影响。

Result: 研究在含 50 个模型的 flyvis 集合上比较任务匹配因果 CNN 控制，并重复干预。行为层面，三层 reverse-phi 反转强依赖周期和速度，任务匹配 CNN 也出现该现象；两类模型均未复现果蝇静止锯齿响应。对抗方向反转所需扰动在 flyvis 为刺激对比度的 0.21–0.27 倍、CNN 为 0.13–0.25 倍，但扩大 CNN 后与参数匹配控制的差距大幅缩小。机制归因需匹配干预：对 held-out mean 替换，一级边归因 patching 的 pooled AUROC/Spearman 为 0.970/0.872；若与同一真值比较零对齐分数则为 0.933/0.126。贪心细胞类型集仅在 50 个模型中的 25 个满足模型内 T4/T5 调谐标准；在 40 个模型中，T4/T5 输出静默使 8 个 optic-flow 片段中最多仅 2 个保留行为。进一步响应幅度检查后，六个首批成功模型中仅两个细胞类型集仍过阈值。

Insight: 模型可直接检验回路机制假设，但结论必须限定模型族、干预、表示和训练解；同一行为或机制指标可随这些因素变化。文章的重点是界定机制归因可靠范围，而不是证明所有模型现象都对应生物回路机制。

Abstract: Connectome-constrained neural networks make biological components directly accessible to intervention, but their mechanistic conclusions can still depend on the comparison model, intervention, circuit representation and trained solution. We stress-test these dependencies in flyvis, a \emph{Drosophila} motion-vision model, using its 50-model ensemble, task-matched causal CNN controls and replicated interventions. At the level of model behaviour, three-level reverse-phi reversal in flyvis is strongly period- and velocity-dependent and also appears in task-matched CNNs; neither family reproduces the fly’s stationary-sawtooth response. Adversarial direction reversal requires a perturbation bound of 0.21–0.27 times stimulus contrast in flyvis versus 0.13–0.25 in CNNs, but the gap over a parameter-matched CNN largely closes for larger CNNs. At the level of mechanism, matching attribution to the intervention matters: for held-out-mean replacement, first-order edge attribution patching reaches pooled AUROC 0.970 and Spearman 0.872, versus 0.933 and 0.126 when its zero-aligned score is evaluated against the same ground truth. Circuit conclusions also vary with representation and ensemble member. Greedy cell-type sets meet a model-relative T4/T5 tuning criterion in 25 of 50 models, while T4/T5 output silencing reduces the tested optic-flow behaviour to at most two of eight clips in 40. In six models where the cell-type search first succeeds, the corresponding connection sets can be pruned to 13–31 added classes; under an additional two-sided response-amplitude check, only two of those six first-success cell-type sets still meet the tuning threshold. These results support a narrower use of connectome-constrained models: they make mechanistic hypotheses directly testable, but the resulting claims must be scoped to the model family, intervention, representation and trained solution.

Table of Contents

cs.CV [Back]

[1] CORAL-KV: Compact Cross-Layer Prediction and Residual Coding for Autoregressive Video KV Caches cs.CV | cs.LGPDF

[2] MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Vision cs.CVPDF

[3] TerraAgent: Demonstration-Grounded Multi-Agent Reasoning for Long-Context Remote Sensing Visual Question Answering cs.CVPDF

[4] TraceICL: Thread-Resolved Demonstration Curation with Consistency Calibration for Robust Multimodal In-Context Learning cs.CVPDF

[5] ForcingBooster: Adaptive Patch-wise Denoising for Fast Autoregressive Video Diffusion cs.CVPDF

[6] Mind the Temporal Gap: Evaluating Video Models for Temporal Understanding in Driving cs.CV | cs.ROPDF

[7] Feature Competition and Its Representational Origins in Vision Language Models: Evidence from the Stroop Paradigm cs.CVPDF

[8] Bridging Human and Model Attention: Explainability Analysis of CNN, Mamba, and ViT Architectures with Gaze-Based Validation cs.CV | cs.HC | cs.LGPDF

[9] Zebra3D: Efficient Hybrid Foundation Models For Scalable 3D Reconstruction cs.CV | cs.LGPDF

[10] Shift-Aware Identity-Guided Latent Refinement for Referring Audio–Visual Segmentation cs.CVPDF

[11] Reference-Free Food Volume Estimation from Egocentric Stereo Video cs.CVPDF

[12] CaptchaAgent: Verifiable Visual Reasoning for CAPTCHA Solving cs.CVPDF

[13] Domain Adaptation of SAM 2.1 for Building-Component Segmentation in Image-Based 3D Reconstruction cs.CVPDF

[14] Selective Spatio-Temporal Fruit Inspector (S$^2$FI): A Mamba-based Framework for Rotational Fruit Quality Assessment cs.CVPDF

[15] AD-SRF: Attack-Defense Semantic Reinforcement for Multi-Modal Image Fusion cs.CVPDF

[16] Win-Win Fusion: Multi-Modal Image Fusion with Visual-Semantic Collaboration cs.CVPDF

[17] A Lightweight Velocity Correction Framework for Improving Instruction Following in Few-Step Text-to-Image Generation cs.CVPDF

[18] What Egocentric Video Embeddings Encode and How to Combine Them with Inertial Sensors for Human Activity Recognition cs.CVPDF

[19] BLEND: Balancing Personalization vs. Generalization in Federated Vision-Language Models cs.CV | cs.LGPDF

[20] UniDeblur: Unified Motion Deblurring via Fourier Convolution Learning cs.CVPDF

[21] In-Context Learning Can Help Vision-Language Models Overcome Training Priors cs.CVPDF

[22] MVGraph: Benchmarking LVLMs on Evidence Composition across Multi-View Visual Graph cs.CV | cs.CLPDF

[23] Video Codec-Guided Training-Free Token Compression for Video Large Language Models cs.CVPDF

[24] MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing cs.CV | cs.AI | cs.MMPDF

[25] The Evidence Anchoring Boundary: Where Visual Interventions Matter and When They Help in Multimodal LLMs cs.CV | cs.AIPDF

[26] Unified Generative Video Compression with Autoregressive and Bidirectional Video Diffusion cs.CVPDF

[27] What Visual Representations Do World Action Models Need? cs.CV | cs.ROPDF

[28] Learning Features, Not Layouts: Feature-Axis Attention as a Transfer Prior for Medical Imaging cs.CVPDF

[29] Redirecting Teacher Supervision: Temporal-Response-Guided Latent Distillation for Video-Language Models cs.CVPDF

[30] GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs cs.CV | cs.AI | cs.CLPDF

[31] Robust Vision-Language Navigation with Awareness of Instruction-Execution Progress cs.CVPDF

[32] Evolving Creatives with Clicks: CTR-Driven Advertising image Editing via Attribute Disentanglement and Preference Alignment cs.CV | cs.AIPDF

[33] A4-MR: Abnormality-aware Anatomical Alignment for MR cs.CVPDF

[34] What Do Visual-Head Discovery Scores Actually Find? Attention Source, Necessity, and Random-Control Pitfalls in Vision-Language Models cs.CVPDF

[35] Replaying the Movie in Your Mind Decoding Dynamic Visual Perception and Recall from EEG cs.CVPDF

[36] Measurable Semantic 3D Gaussian Splatting with Joint Region and Depth Supervision for Interactive Building Inspection cs.CVPDF

[37] GuidedNav: Shaping Vision-Language Navigation Representations through Pre-action Attention and Spatial Guidance cs.CVPDF

[38] From Glance to Focus: Mitigating Recognition Laziness in MLLMs for Fine-Grained Recognition cs.CVPDF

[39] PreCoG: Preview-Edit for Efficient Video Correction in Generation-Time cs.CVPDF

[40] High-Throughput Generative Video Super-Resolution on a Single Consumer GPU cs.CVPDF

[41] Destination-Conditioned Adaptation with Semantic-Geometric Alignment for Generative Inbetweening cs.CVPDF

[42] Golden Anchor for Video Generation cs.CV | cs.LGPDF

[43] FPD-Drive: Future Policy Distillation for End-to-End Autonomous Driving cs.CVPDF

[44] Multi-Modal Graph Neural Network-Inspired Vessel Identification and Tracking for UAV-Based Maritime Surveillance cs.CVPDF

[45] Jag: Direct Box Prediction for Efficient Visual Grounding cs.CVPDF

[46] Vision Transformers Learn Word Meaning from Images Alone cs.CV | cs.CLPDF

[47] Beyond a Single Crop: Contextualized Embeddings for Player Re-Identification cs.CVPDF

[48] Deep Learning Approach for RealTime Contraction Detection in Laboring Dairy Cattle cs.CVPDF

[49] SheafPrune: Sheaf-Guided Graph Propagation for Visual Token Pruning cs.CVPDF

[50] CV-OPD: Contrastive Vision On-policy Distillation cs.CV | cs.LG | cs.MMPDF

[51] OWLET: On-Policy Weighted Learning via Evidence Transfer for Video Large Language Model Post-Training cs.CVPDF

[52] Decoding Register Tokens Preserves Global Scene Details cs.CV | cs.LGPDF

[53] Sonic-AMG: Streaming Human Motion Generation from Spatial Audio cs.CV | cs.GR | cs.LG | cs.RO | cs.SDPDF

[54] PAGE: Parts-Aware Guidance for Co-Speech Gesture Portrait Video Generation cs.CVPDF

[55] NovaSplat: Model-Free 6D Object Pose Estimation via 3D Gaussian Splatting Onboarding and Refinement cs.CV | cs.ROPDF

[56] LETHE: Defending against Unauthorized Image-to-Video Generation via Value Diversity Collapse cs.CV | cs.CRPDF

[57] ThinkDrag: Semantic Drag-Based Image Editing with Visual Reasoning cs.CVPDF

[58] VideoAWR: Reinforcing Video Flow Models with Decoupled-Timestep Advantage-Weighted Rectification cs.CVPDF

[59] CoVA: Composing VAE Representations for Generative Learning cs.CVPDF

[60] Why DiT Models Underperform as Representation Learners without Long Skip Connections cs.CVPDF

[61] TextVBench: Evaluating Text Rendering and Preservation in Video Generation cs.CVPDF

[62] When MLLMs miss what humans read: diagnosing and learning to read squint text cs.CV | cs.AIPDF

[63] GraftOOD: Grafting Out-of-Distribution Exemplars into Advantage-Weighted Rectification for Video Reward Optimization cs.CVPDF

[64] S-Space: Exploring Spatial Workspace in Multimodal Language Models cs.CV | cs.CL | cs.LGPDF

[65] Stride: Scale-Aware Multi-Agent Evolutionary Refinement for Infographic Generation cs.CVPDF

[66] Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Grounding cs.CVPDF

[67] Auditing VLM Benchmarks from Existing Evaluation Runs cs.CVPDF

[68] ELMA: Benchmarking Anaphoric Compositions for Long-Term Text-to-Motion Generation cs.CVPDF

[69] Benchmarking Answer-Grounding Consistency in Remote Sensing Visual Question Answering cs.CVPDF

[70] PhysForge: Material-Controllable 3D Reconstruction with Separable Components cs.CVPDF

[71] GLIMPSE: Global-Local Indexing with Multi-Precision Spectral Encoding for Explorable Video World Models cs.CVPDF

[72] Improving Semantic Coverage in AI Test & Evaluation through Generative Augmentation cs.CVPDF

[73] KVeil: First-Place Solution to ECCV 2026 LifeGenIP Challenge on Unlearnable Videos cs.CVPDF

[74] State-Isolated Vision Mamba via Update-Tendency Routing for Underwater Image Enhancement cs.CVPDF

[75] LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos cs.CV | cs.AI | cs.ROPDF

[76] Gaussian Splatting with Reflections Guided by What is Seen cs.CVPDF

[77] OccludeBench: Can VLMs Find What’s Missing? cs.CV | cs.CLPDF

[78] Neurons++: A Unified Visual-Stream Framework for Image and Video Reconstruction from fMRI with Neural-to-Visual Interpretability cs.CVPDF