cs.CV [Total: 63]
cs.CL [Total: 28]
cs.AI [Total: 7]
cs.CY [Total: 1]
cs.DC [Total: 1]
cs.LG [Total: 11]
cs.MM [Total: 1]
cs.NE [Total: 1]
cs.RO [Total: 6]
eess.IV [Total: 5]
q-bio.QM [Total: 1]

cs.CV [Back]

[1] DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents cs.CV | cs.AI | cs.LGPDF

A. Said Gurbuz, Ahmed Nassar, Sunghwan Hong, Marc Pollefeys, Peter W. J. Staar

TL;DR: DeskForge用可控真实桌面应用组合生成密集GUI元素和动作结果监督，训练VLM代理定位控件并完成长程计算机任务。

Details

Motivation: 桌面代理需在多应用、重叠窗口和相似控件中准确定位目标，但现有训练数据缺少密集标注，也难系统改变桌面状态和布局。

Result: DeskForge-1M含120万标注观测和1.597亿元素实例，融合截图、无障碍树和窗口几何。四个VLM在20万定位样本微调后，五个外部基准均提升；Qwen3.5-4B在ScreenSpot-Pro提高11.51点、OSWorld-G提高10.11点。固定规划器下，WebArena-Infinity完成任务从31/119升至50/119，OpenApps从3/100升至15/100。

Insight: 可控组合真实桌面环境提供了可扩展的定位监督，收益能从坐标 grounding 延伸到长程任务完成。密集元素标注和动作结果记录有助于统一两类能力。

Abstract: Computer-use agents need to reliably ground action targets in complex desktop scenes, where multiple applications, overlapping windows, and visually similar controls compete for attention. Existing training data rarely pair such scenes with dense annotations or vary them in a controlled way. We introduce DeskForge, a controllable desktop environment that composes and explores real applications to generate large-scale supervision for computer-use agents. It varies application states, content, window layout, appearance, and resolution, and fuses screenshots, accessibility trees, and window geometry into dense element annotations while recording the outcome of each executed action. Using this environment, we construct DeskForge-1M, a corpus of 1.2M annotated desktop observations containing 159.7M element instances. We fine-tune four vision-language models on 200K grounding examples drawn from DeskForge-1M. All four improve across held-out desktop conditions and on all five external GUI grounding benchmarks; for Qwen3.5-4B, accuracy increases by 11.51 percentage points on ScreenSpot-Pro and 10.11 points on OSWorld-G. The gains also translate to long-horizon task completion: under a fixed planner, the fine-tuned action models solve more WebArena-Infinity and OpenApps tasks, with Qwen3.5-4B increasing from 31 to 50 of 119 tasks and from 3 to 15 of 100 tasks, respectively. These results show that controllable composition of real desktop environments provides a scalable source of supervision for improving both GUI grounding and long-horizon computer use. The framework code, the dataset, and the fine-tuned model are available from the project page: https://saidgurbuz.github.io/deskforge/

[2] EditHero: A Benchmark for Long-Horizon Part-Level 3D Editing and Vibe Modeling cs.CV | cs.AI | cs.GRPDF

Ruihan Yu, Yu-Ju Tsai, Muyao Niu, Runyi Li, Lian Fu

TL;DR: EditHero用确定性装配引擎为每次长序列3D编辑生成精确目标，评测模型能否完成局部修改并保持其余部分不变。

Details

Motivation: 3D资产通常经历多轮修改，但方法多只测一次编辑；连续指令需实现几何和纹理变化，同时避免破坏已正确部分。

Result: 人工审核的基准包含自然语言指令及几何、纹理目标，用于比较自上而下重生成方法和自下而上代码编辑代理。非代理方法常漏改或扰动应保持区域；多数LLM更忠实遵循要求且保留未编辑部分更好，但每次编辑仍需数分钟。

Insight: 迭代编辑评估需同时衡量目标变化和未修改区域保持，单次生成质量不足以反映真实工作流。代码代理的忠实度较好，但推理速度是实际瓶颈。

Abstract: 3D editing methods are usually tested on a single edit, yet an asset is built through a long sequence of revisions, each of which must implement the requested change while leaving everything else unchanged. We introduce EditHero, to our knowledge the first benchmark for long-horizon, part-level 3D editing, with natural-language instructions and target images for both geometry and texture. A deterministic assembly engine produces the exact target after every edit, and every sequence is reviewed by hand. We use EditHero to compare 2 opposite approaches to 3D editing. Non-agentic methods operate top down, regenerating the object from a learned 3D representation and inferring what to keep. In contrast, LLM/VLM agents operate bottom up, editing through code that inspects the mesh and rewrites only the parts required by instructions. The non-agentic methods often miss the requested change and disturb regions that should stay fixed. Most LLMs follow instructions more closely, and all of them preserve the unedited parts better, but each of their edits takes minutes. We will release the engine and the edit sequences to support research on reliable iterative 3D editing.

[3] SCOPE-4D: Endoscopic 4D Geometry Foundation Models cs.CVPDF

Chaoyi Zhou, Zhongpai Gao, Anwesa Choudhuri, Meng Zheng, Benjamin Planche

TL;DR: SCOPE-4D从单目内窥镜视频一次预测相机参数、稠密几何和组织三维轨迹，并以共同运动残差分解相机运动和组织变形。

Details

Motivation: 内窥镜几何有助于导航和机器人辅助，但几何标注稀少，且相机运动与组织形变容易混淆。

Result: 作者构建约5,000段真实和合成胃肠内窥镜及腹腔镜视频的SCOPE-5K，含幻体和真实结肠镜评测。几何监督改善相机与深度估计，共同—残差运动约束和轨迹监督进一步改善估计并支持稠密组织追踪。在公开及新采集基准上，模型表现出较强域内、域外几何和3D追踪能力，长序列结肠重建更稳定；盲法用户研究也支持真实临床视频的重建质量。

Insight: 大规模专科几何监督与运动分解约束可同时解决相机估计、组织形变跟踪和长序列重建。新的幻体与实景数据补足了内窥镜标注稀缺。

Abstract: Geometric understanding supports endoscopic navigation and robotic assistance, but learning reliable endoscopic geometry faces two challenges: scarce geometric annotations and ambiguity between camera motion and tissue deformation. We present SCOPE-4D, an endoscopic 4D geometry foundation model that jointly predicts camera parameters, dense geometry, and 3D tissue trajectories from monocular RGB video in a single forward pass. Our curation and annotation pipeline constructs SCOPE-5K, a collection of approximately 5,000 clips spanning real and synthetic gastrointestinal endoscopy and laparoscopy. The collection provides rich geometric supervision and includes newly collected phantom and real-colonoscopy evaluation sets. Geometric supervised fine-tuning on SCOPE-5K learns endoscopic priors that improve camera and depth estimation. Common–Residual Motion (CRM) further constrains local deformation relative to common tissue movement. Together with geometric supervision, CRM and trajectory supervision further improve camera and depth estimation over geometric fine-tuning alone while enabling dense 3D tissue tracking. Evaluations on public and newly collected benchmarks demonstrate strong in-domain and out-of-domain geometry, superior 3D tracking, and more stable long-sequence colon reconstruction. A blinded user study further supports the perceived reconstruction quality on real clinical video. Together, these results demonstrate the value of large-scale endoscopic supervision and motion constraints for joint geometry estimation and tissue tracking.

[4] EviDent-CBCT: Evidence-Bottlenecked Report Generation from Dental CBCT under Non-Exhaustive Report Supervision cs.CV | cs.AIPDF

Ruiyang Hao, Zhi Qin Tan, Yulan He, Owen Addison, Yunpeng Li

TL;DR: EviDent-CBCT先把锥形束CT转换为离散、可审计的牙齿及解剖证据记录，再由确定性渲染器和不看图像的语言模型生成报告。

Details

Motivation: 临床CBCT报告包含大量牙齿级和空间发现，但常规报告并非穷尽所有影像信息，未提及可能代表不存在，也可能只是未记录，造成监督歧义。

Result: 解剖感知网络预测牙齿级、全局和牙齿—下齿槽管证据，逻辑投影协调冲突标签；对可用未提及标签降权作为负例，其他未报告标签保留未知。三次验证平均证据集F1为0.666±0.006、RadFact-Lite-Dental逻辑F1为0.402±0.003，高于受控直接基线0.371±0.018。ODIN 2026隐藏测试自动评估第二、盲法临床Arena第三。

Insight: 显式证据瓶颈将有限临床监督的不确定性纳入训练，并使报告生成过程可追溯。把未报告标签视为未知或降权负例，避免误当成确定无病。

Abstract: Dento-maxillofacial cone-beam CT (CBCT) reports may contain dozens of tooth-specific, anatomical, and spatial findings from a single 3D scan. Learning to generate such reports from limited clinical data is challenging because routine reports may not exhaustively document image findings, and a non-mention may reflect either absence or non-reporting. We present EviDent-CBCT, an evidence-bottlenecked framework designed for this incomplete supervision. An anatomy-aware network maps each CBCT scan to a discrete record of tooth-level, global, and tooth-IAC evidence. A dental-logic consistency projection reconciles incompatible evidence before a deterministic renderer and an image-blind local language model generate the report using only this record. For tooth-level evidence, reliability-aware training uses eligible non-mentions as reduced-weight negatives, while unreported global and tooth-IAC labels remain unknown. A metal-sensitive input channel preserves intensity cues from dental materials. Across three validation runs, EviDent-CBCT achieves $0.666\pm0.006$ merged evidence set-F1 and $0.402\pm0.003$ RadFact-Lite-Dental logical-F1, versus $0.371\pm0.018$ for the strongest controlled direct baseline. In the ODIN 2026 challenge, it ranked second in automated evaluation and third in blinded clinical Arena comparison on the hidden test set. These results support the discrete evidence record as an effective and auditable interface for CBCT report generation.

[5] An AI-Based Multi-Stage Approach for Androgenetic Alopecia Assessment from Low-Magnification Scalp Images cs.CVPDF

Mahmoud Raslan, Nada Omar, Omar Khaled, Tarek Waleed, Mohamed Hazem

TL;DR: 该临床辅助系统从低倍头皮图像定位毛囊单位、估计可见发干数量和宽度，再按区域聚合并用可解释规则支持雄激素性脱发评估。

Details

Motivation: AGA表现为毛囊微型化、单发毛囊单位增加和发干直径变化，低倍图像定量测量可辅助临床，但需可靠检测、计数和区域分析流程。

Result: 临床队列243人（AGA 127、非AGA 116），计算机视觉数据含160名专家标注患者、2,400张毛发镜图和约15.8万个毛囊标注。患者隔离测试中YOLOv8m检测mAP@0.5为0.920、召回0.860；EfficientNet-B5计数准确率87.0%、macro F1 0.85。另在500图端到端评估中，毛囊检测和分类相对专家的MAE分别6.56和16.59。

Insight: 分阶段量化分析可把毛囊定位、计数和宽度映射到临床判读指标，并保留可解释规则层。系统定位为辅助医生，而非替代临床解释。

Abstract: Androgenetic alopecia (AGA) is characterized by patterned follicular miniaturization, increased single-hair follicular units, and altered hair-shaft diameter. We present an automated quantitative scalp-analysis and clinical decision-support framework combining FU localization, ordinal visible-shaft counting, calibrated shaft-width estimation, regional aggregation, and an interpretable rule layer. The clinical cohort comprised 243 patients (127 AGA, 116 non-AGA), while the computer-vision experiments used 160 expert-annotated patients, 2,400 trichoscopic images, and approximately 158,000 FU annotations. Under patientdisjoint evaluation, YOLOv8m achieved test mAP@0.5=0.920 and recall=0.860; EfficientNet-B5 with a support-map channel achieved 87.0% expert-box count accuracy (macro F1=0.85). A separate 500-image set was processed end-to-end with detector-generated boxes, yielding MAE of 6.56 for follicle detection and 16.59 for follicle classification relative to human-expert annotations. The system is intended to assist, rather than replace, dermatologist interpretation.

[6] A Simulation-Grounded Agentic VLM Framework for Wildfire Monitoring and Reporting cs.CV | cs.GRPDF

Duowen Chen, Yuchen Sun, Zhiqi Li, Yuxuan Liao, Sinan Wang

TL;DR: 该框架把二维野火模拟映射为低细节3D代理并生成多模态视频记忆，再让无需训练的多代理VLM检索案例、核对预测并生成结构化报告。

Details

Motivation: 野火监测需将视觉证据与物理火势联系，但同步标注真实视频稀缺，高保真三维仿真成本高。

Result: 固定Blender映射将地形、燃料、火势和风映射到3D代理，再由可控生成丰富外观；模拟标签与视频形成可复用记忆。留出生成片段上，视频记忆四标签精确率51.5%，高于直接VLM的22.6%和文本记忆的16%—17%；完整系统六类报告字段准确率77.3%。组件消融、跨生成器及三次真实无人机评估验证了检索、报告和可观察监测。

Insight: 低细节但状态对齐的3D代理可提供物理一致的中间监督，生成外观再扩展场景多样性；案例记忆帮助VLM推理，而非仅依靠一次视觉回答。

Abstract: Effective wildfire monitoring requires relating visual evidence to physical fire dynamics, yet real videos with synchronized physical annotations are scarce and high-fidelity 3D simulation is costly. We present a simulation-grounded vision-language model (VLM) framework that automatically converts 2D wildfire simulations into labeled video episodes. A fixed Blender mapping produces low-detail 3D proxies aligned with simulator terrain, fuel layout, fire activity, and wind cues; controllable video generation supplies richer appearance. The proxies are intermediate representations rather than finely rendered final scenes. Generated videos and simulator labels form reusable multimodal memory for a training-free multi-agent VLM system that retrieves reference episodes, reconciles visual and memory-based predictions, and produces structured wildfire reports. On held-out generated episodes, video memory achieves 51.5% exact four-tag accuracy, compared with 22.6% for direct VLM querying and 16-17% for text-only memory; the complete system achieves 77.3% accuracy on six simulator-derived report fields. Component ablations, cross-generator tests, and three real-UAV evaluations assess retrieval, reporting, generator changes, and observable monitoring tasks. The framework connects automatic simulation-to-proxy conversion with memory-based VLM reasoning under scarce real-world physical annotations.

[7] Octrees as an Explicit 3D Language cs.CVPDF

Ran Dan, Si-Tong Wei, Pengfei Xiong, Wei Zhang, Yadong Mu

TL;DR: OctLLM用显式八叉树占据词元表示3D结构，并以独立可训练分支加入三维能力，避免改动预训练语言和图像路径。

Details

Motivation: 现有3D LLM要么将形状压缩为码本或坐标文本、丢失空间结构，要么全量微调骨干而削弱通用语言能力。

Result: 稀疏八叉树随机省略保形的末层节点后代，缩短序列并保留位置、深度锚定信息；网格词元经独立分支与冻结语言—视觉路径在部分块共享注意力。OctLLM训练参数少于全量微调却达到统一多模态LLM新SOTA：图像到3D FID较ShapeLLM-Omni低17.4%，渲染 grounding 图注高28.7分，通用语言基准与骨干持平。

Insight: 显式空间词元有助于保留三维拓扑和坐标关系，而参数隔离让模型扩展3D模态时不破坏文本能力。稀疏八叉树兼顾表示长度与空间结构。

Abstract: Existing 3D large language models (LLMs) compromise on two fronts: they compress shapes into latent codebook indices or coordinate text, which removes spatial structure from what the model observes, and they acquire the 3D modality by fine-tuning the backbone, which overwrites its general language ability. We present OctLLM, which addresses both limitations. Geometry enters as an explicit 3D sequence of octree occupancy tokens. However, full octree sequences grow rapidly with depth; OctLLM therefore randomly empties penultimate-level nodes and omits descendants while preserving shape, yielding a shorter coordinate- and depth-anchored Sparse Octree (S-Octree) for position-aware mask-modeling generation and 3D understanding. On the other front, existing methods introduce a new modality with full fine-tuning or LoRA, but full fine-tuning is costly, LoRA limits 3D capacity, and both modify the language pathway. OctLLM instead adds 3D capacity in parameters separate from the pretrained ones: mesh tokens are routed through independent trainable branches in a subset of blocks while text and image tokens retain the frozen vision-language pathway, and the two streams interact through shared self-attention. It trains far fewer parameters than full fine-tuning, yet sets a new state of the art among unified multimodal LLMs, lowering image-to-3D FID by $17.4%$ and raising render-grounded captioning by $28.7$ points over ShapeLLM-Omni, while matching the backbone on general language benchmarks.

[8] MeshQuery: Agentic Seam Planning for UV Parametrization cs.CVPDF

Marco Schouten, Arthur Roullier, Elie Michel, Ruben Wiersma, Axel Paris

TL;DR: MeshQuery让VLM代理用网格查询表示和边选择工具规划UV缝线，再根据UV质量反馈迭代调整缝线程序。

Details

Motivation: 生产级四边形网格UV展开需沿合理边界切分，直接生成像素或缝线预测难融入艺术家偏好，也难在大型网格中有效查询结构。

Result: 代理以领域知识指令规划缝线，将决策表达为可组合边选择算子并调用拓扑、几何、语义属性，之后根据UV质量迭代修订。在Adobe Substance 3D和Toys4K网格上，相较最强基线，图表数分别少2.9倍和4.29倍，缝线长度短1.63倍和1.7倍；专业艺术家在80.9%比较中偏好其结果。

Insight: 将高层艺术意图规划与低层边选择分开，可使VLM使用结构化网格证据迭代控制几何操作。紧凑查询接口也支持扩展到大一个数量级网格。

Abstract: We present MeshQuery, a training-free agentic approach to automatic UV unwrapping of production-grade quad meshes. A Vision-Language Model (VLM) plans artist-aligned seams using a set of edge-selection tools, conditioned on domain-specific UV-unwrapping knowledge expressed in natural language and refined with a feedback loop. We design a queryable mesh representation together with a domain-specific language (DSL) that enables the agent to retrieve mesh information on demand, express a seam plan as a compact program of edge-selection operators over topological, geometric, and semantic mesh attributes, and iteratively refine it from UV quality feedback. On Adobe Substance 3D and Toys4K meshes, MeshQuery produces 2.9x/4.29x fewer charts and 1.63x/1.7x shorter seams than the strongest baseline, and professional artists prefer its results in 80.9% of comparisons. Ultimately, decoupling high-level intent planning from low-level edge selection and compact mesh representation lets MeshQuery run on different backend VLMs and scale to meshes an order of magnitude larger than autoregressive seam prediction

[9] DeepStratNet: A Context-Aware Coordinate Regression Framework for Seismic Horizon Tracking under Sparse Labels cs.CVPDF

Aniq Ahmad, Musham Ahmad Malik, Ahmad Mustafa, Heather Bedle

TL;DR: DeepStratNet将地震层位追踪建模为有界坐标回归，并用LSTM跨切片整合上下文、以地质连续性正则生成连续层面。

Details

Motivation: 常见分割法需把稀疏人工拾取转为稠密掩码，未拾取迹线被当作背景，可能阻碍训练；概率图后处理也会引入误差，二维模型缺跨切片信息而三维模型成本高。

Result: 轻量回归头可接任意预训练视觉骨干，直接预测每个横向位置的时间/深度坐标；L1/L2仅在有效拾取监督，地质正则约束相邻迹线连续。在新西兰地震体数据的受控比较中，四种骨干的回归版本均在RMSE、PCC及视觉质量上优于分割版本，并对训练拾取稀疏更鲁棒。跨迹线预测变化还可提示局部地质复杂度。

Insight: 把输出直接定义成物理坐标，避免分割掩码构造和后处理误差；稀疏监督可集中在真实拾取点，跨切片上下文则补足连续结构。

Abstract: Automatic horizon tracking is a foundational task in 3D seismic interpretation. Most existing deep learning approaches formulate it as dense semantic segmentation, typically using U-Net-based architectures. The model produces a probability map over all pixels that must be post-processed to extract precise horizon coordinates, while horizon picks in time/depth must be converted into dense masks for training. Unpicked seismic traces are consequently treated as background, which can hinder convergence, and both pre- and post-processing can introduce errors into the final interpretation. Moreover, 2D segmentation models do not inherently capture inter-slice context, while 3D models are often computationally prohibitive. We instead formulate horizon tracking as a bounded coordinate regression problem, where the model directly predicts the time/depth coordinate of the target horizon at each lateral position. We propose a lightweight regression head compatible with any pretrained vision backbone, coupled with an LSTM module to model inter-slice context and produce a continuous horizon surface across the volume. A combination of L1 and L2 losses supervises predictions at valid horizon picks, while a geology-informed regularization enforces lateral continuity between successive traces. Under controlled experimental conditions, we evaluate four pretrained vision backbones under both segmentation and regression configurations on a seismic volume from New Zealand. The proposed approach consistently outperforms its segmentation counterparts quantitatively, using metrics including RMSE and PCC, and qualitatively, while also demonstrating greater robustness to increasing sparsity of training picks. Finally, we show that prediction variation across successive traces captures local variations in geological complexity, providing an automated quality control measure for downstream seismic interpretation.

[10] GRAFT: Growing Agglomerative Foundation Models via Continual Teacher Distillation cs.CVPDF

Zhenghao Zhao, Chi Zhang, Qingshuang Chen, Yelin Kim

TL;DR: 提出GRAFT持续多教师蒸馏框架，使单一视觉骨干逐步吸收新增基础模型的能力。

Details

Motivation: 不同视觉基础模型因预训练目标不同而各有所长，现有联合蒸馏通常假定教师集合固定；加入教师时需对全部教师重新蒸馏，代价高。

Result: GRAFT让已蒸馏模型保留既有知识，并与新教师共同指导学生；教师专属读出token和几何无关关系损失分别处理异构表示与视觉语言对齐。所得单一骨干整合图像理解、二维密集预测、三维人体姿态、三维视觉及视觉语言五个领域，每加入一个新能力只需一次增量蒸馏。

Insight: 持续蒸馏把能力整合成本从反复全量训练降为逐教师增量更新；摘要强调跨领域表现较强，但未提供具体基准数值，无法据此判断各任务的量化差异。

Abstract: Vision foundation models such as DINOv2, SigLIP2, and MASt3R develop complementary capabilities from different pretraining objectives, yet their knowledge remains distributed across separate, specialized models. Multi-teacher knowledge distillation offers a path toward consolidating these capabilities into a single agglomerative backbone, but existing approaches assume a fixed set of teachers, and incorporating a new teacher requires repeating expensive joint distillation over the entire teacher set. We introduce GRAFT, a continual multi-teacher distillation framework that enables a unified backbone to progressively acquire capabilities from an open-ended sequence of foundation models. When a new teacher arrives, GRAFT treats the previously distilled model as a teacher for preserving learned capabilities, while the current student jointly learns from both the previous model and the incoming teacher. Furthermore, to reconcile the incompatible representation geometries of heterogeneous teachers, we introduce Teacher Specific Readout Tokens, which grant each teacher an independent read-out of the shared encoder, together with Geometry Agnostic Relational Loss that aligns a vision-language teacher by matching image-text similarity structures rather than raw feature values. We provide GRAFT model, which is a single, continually extensible backbone that unifies five domains, including image understanding, 2D dense prediction, 3D human pose estimation, 3D vision, and vision-language, delivering strong performance across all of them while acquiring each new capability at the cost of a single distillation rather than a full re-distillation.

[11] Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory cs.CVPDF

Ying Yang, Guiyu Zhang, Lianghua Huang, Chang Nie, Chenyang Si

TL;DR: SMI用多模态理解模型管理长视频世界模型的空间记忆，执行空间聚类、簇内稀疏化、动作感知检索和可靠性筛选。

Details

Motivation: 长视频生成和世界模型依赖历史记忆，但序列越长、结构越复杂，空间上下文管理越难，简单保存全部历史会带来效率和检索问题。

Result: SMI系统化将理解模型用于空间记忆选择与组织。在多个基线、基准和世界模型骨干上的实验显示，它改善记忆稀疏性、生成稳定性和空间一致性；摘要未报告具体量化指标。

Insight: 记忆管理不应只按时间保留片段，而需理解空间结构、当前动作关联和证据可信度。四种原子操作共同提升压缩和生成一致性。

Abstract: Long-video generation and world models have shown strong potential for interactive entertainment and embodied simulation by predicting future observations conditioned on user actions and historical memory. However, as memory sequences grow longer and their structures become increasingly complex, managing long-range spatial context becomes increasingly challenging, calling for a more intelligent and systematic memory-management strategy. Building on the advancing spatial reasoning capabilities of multimodal large language models (MLLMs) and the broader vision of unified models, we propose Spatial Memory Intelligence (SMI), the first framework to systematically employ an understanding model for spatial-memory management in long-video world models. SMI introduces four coordinated atomic operations: spatial clustering, within-cluster sparsification, action-aware retrieval, and reliability-aware filtering. Extensive experiments across multiple baselines, benchmarks, and world-model backbones demonstrate the effectiveness and generalizability of SMI, achieving comprehensive improvements in memory sparsity, generation stability, and spatial consistency.

[12] CHASE-VLA: Post-Training Quantization Framework for Vision-Language-Action Models with Chunk-Aware Scale Estimation cs.CVPDF

Jin Hyun, Jung Gyu Min, Gyuhyun Jung, Youngjoo Lee

TL;DR: 提出CHASE-VLA，根据动作块上下文和去噪阶段动态估计尺度，实现VLA动作专家的低比特后训练量化。

Details

Motivation: 扩散式动作专家会在多个去噪步骤与策略查询中重复调用，激活范围又随去噪进度和运动意图变化，静态校准尺度难以适配。

Result: 该方法利用已生成动作块（含尚未执行的后缀）和去噪步分组调节激活尺度，无需修改预训练策略即可将动作专家MLP与注意力投影量化为W4A4。在LIBERO上，π0.5平均成功率为97.3%，恢复到FP16水平；量化线性层权重存储减少73.4%，π0.5与GR00T N1.6单动作块内存流量分别减少70.9%和71.2%，预测器开销不超过所节省存储的1.26%。

Insight: 利用策略自身产生的动作块作为校准信号，有助于在低比特部署中保留控制表现；现有成功率证据主要来自LIBERO基准。

Abstract: Vision-Language-Action (VLA) models map visual observations and language instructions to continuous robot actions, but a diffusion-based action expert (AE) poses a key challenge for low-bit post-training quantization (PTQ). The AE is repeatedly invoked across denoising steps and policy queries, where fixed calibration scales can be mismatched with activation ranges that vary with denoising progress and intended motion. We propose CHASE-VLA, a chunk-aware PTQ method that exploits a VLA-specific signal readily available from the policy: the generated action chunk, including its unexecuted future suffix. Rather than relying only on static scale matching for AE layers, CHASE-VLA combines the previously generated chunk as causal action context with denoising step group information to adapt AE activation scales. This enables W4A4 quantization of both MLP and attention projections in the repeated AE without modifying the pretrained policy. On LIBERO, CHASE-VLA achieves 97.3% average success rate on $π_{0.5}$ when both MLP and attention projections in the AE are quantized to W4A4, restoring FP16-level performance. CHASE-VLA also reduces the weight storage of the quantized AE linear layers by 73.4% and their single-chunk memory traffic by 70.9% and 71.2% on $π_{0.5}$ and GR00T N1.6, respectively, with a predictor overhead of at most 1.26% of the saved storage.

[13] Imagine the Future, Internalize the Gist: Efficient VLA Reasoning via Internalized Spatiotemporal Imagination cs.CVPDF

Shenglan Li, Zhendong Mi, Hengyi Zhu, Jingwu Luo, Chun Kit Chan

TL;DR: 提出IG-VLA，在视觉表征中学习未来场景演化，并将推理压缩为场景摘要token以加速机器人动作预测。

Details

Motivation: 现有VLA中间推理主要依据已观察状态，缺少对未来演化的显式预判；逐步生成未来像素视频又会带来较大推理开销。

Result: IG-VLA通过潜在时空推理预测与任务相关的未来场景，并用Scene Gist Memory将场景—行为关联内化为紧凑token。在LIBERO-Plus语言套件上，推理策略和摘要策略的成功率均比最强基线高近6%；摘要策略在单张A6000上将每动作块延迟从1081毫秒降至169.5毫秒，最高加速6.38倍。

Insight: 把未来推演蒸馏进紧凑记忆可兼顾成功率和部署速度；证据来自LIBERO、LIBERO-Plus和VLABench等基准，真实机器人场景的泛化仍需另行验证。

Abstract: Vision-language-action (VLA) models increasingly incorporate intermediate reasoning to improve robotic manipulation, yet existing approaches primarily reason about observed states without explicitly anticipating future scene evolution. Extending such reasoning to explicit future rollouts at every inference step, however, introduces substantial computational overhead. We propose IG-VLA, a VLA reasoning framework that enables models to imagine the future and internalize the gist. Our Latent Spatiotemporal Reasoning learns to imagine task-relevant future scene evolution directly in visual representation space, guiding action prediction without costly pixel-level video generation. To further reduce inference overhead, we introduce Scene Gist Memory, which internalizes reasoning-derived scene-behavior associations into a compact Scene Gist Token, preserving the benefits of future reasoning while bypassing explicit future imagination at inference. Extensive experiments on LIBERO, LIBERO-Plus, and VLABench demonstrate the effectiveness and efficiency of IG-VLA. On the LIBERO-Plus Language suite, both the reasoning and gist policies outperform the strongest baseline by nearly 6% in success rate. The gist policy also achieves up to 6.38x speedup over baselines, reducing inference latency from 1081ms to 169.5ms per action chunk on a single NVIDIA A6000 GPU. These results demonstrate that future spatiotemporal reasoning can be effectively internalized for efficient VLA deployment.

[14] SymRegFlow: Symmetry-Regularized Flow Matching for Video World Models cs.CVPDF

Xi Ye, Yuzhu Wang, Xiaoyang Liu, Jiayi Wang, Yangyang Xu

TL;DR: 提出SymRegFlow，通过双锚点监督与跨锚点去噪一致性，实现连续视角下无需新视角真值RGB监督的多视角视频生成。

Details

Motivation: 现有基于流匹配的多视角世界模型多依赖固定相机；扩展到连续相机姿态需要密集覆盖的配对位姿—视频数据，采集成本高。

Result: SymRegFlow将源视图几何变形为目标姿态的噪声锚点，并结合掩码双锚点监督与跨锚点输出一致性来抑制锚点误差。仿射高斯替代模型分析证明，适当一致性正则在固定噪声水平下可恢复干净参考最优解，并严格优于单锚点和合并锚点基线。在Cosmos-Drive-Dreams及nuScenes实验中生成质量高且多视角一致；nuScenes上FVD比最佳基线降低逾31%，FVD、FVMD均为所评基线最低，源条件推理的FID与实例保持也最佳。

Insight: 跨锚点一致性可在缺少新视角RGB真值时约束生成结果；理论保证基于特定替代模型，实证则集中于自动驾驶场景。

Abstract: Flow-matching-based multi-view world models generate realistic videos, but are commonly restricted to fixed camera rigs. Extending them to continuously varying camera poses requires paired pose–video observations with dense pose coverage, which are costly to acquire. We introduce \emph{SymRegFlow}, a symmetry-regularized flow-matching framework for multi-view-consistent video generation across continuous viewpoints without ground-truth novel-view RGB supervision. For each target pose, SymRegFlow geometrically warps source views into noisy anchors and combines masked dual-anchor supervision with cross-anchor denoising-output consistency to mitigate anchor-specific errors. Under an affine Gaussian surrogate, we prove that suitable consistency regularization recovers the clean-reference optimum at fixed noise levels, strictly outperforming single- and merged-anchor baselines. Experiments on Cosmos-Drive-Dreams and nuScenes demonstrate high-quality, multi-view-consistent autonomous-driving video generation: on nuScenes, SymRegFlow achieves the lowest FVD and FVMD among the evaluated baselines, reducing FVD by over 31% relative to the best baseline, and source-conditioned inference also attains the best FID and instance preservation.

[15] FiberGeoText: A Vision-Language Model for Population- Level Organization of Superficial White Matter cs.CVPDF

Yuqian Chen, R. Jarrett Rushmore, Guikun Chen, Fan Zhang, Edward Yeterian

TL;DR: 提出FiberGeoText视觉语言模型，联合纤维轨迹、皮层解剖语境与形状，对浅表白质纤维进行群体级聚类。

Details

Motivation: 浅表白质短程纤维受个体皮层折叠差异影响，个体间空间位置变化大，单凭几何邻近难以确定解剖对应关系。

Result: FGT将多种脑区分区方案的端点解剖描述转成文本，经预训练LLM编码，并与三维轨迹和形状共同表示。在0.76毫米扩散MRI数据上，相比现有方法提升皮层分区一致性、簇内形状一致性、簇规模一致性及跨受试者对应性；对未见受试者平均恢复已学习5000个簇中的96.7%，训练与测试的簇结构也高度一致。

Insight: 把几何、解剖文本和形状纳入统一多模态嵌入，有助于应对个体解剖差异；摘要报告了聚类与泛化结果，但未提供各项指标的具体对照数值。

Abstract: The superficial white matter (SWM), a critical brain region for cognition across the lifespan and brain disease, contains abundant short-range association fibers whose organization remains incompletely characterized, in part because the short trajectories and highly variable cortical folding make correspondence across individuals challenging. Anatomically corresponding connections may vary in spatial location across individuals and therefore may not be adequately defined by geometric proximity alone. We introduce FiberGeoText (FGT), a vision-language model (VLM) for organizing short-range superficial white matter (SWM) streamlines reconstructed from ultra-high-resolution diffusion MRI into population-level clusters. FGT jointly represents three complementary properties of each streamline: its three-dimensional trajectory, its cortical anatomical context, and its shape. Cortical endpoint information from multiple parcellation schemes is expressed as text and encoded using a pretrained large language model (LLM), enabling heterogeneous anatomical descriptions to contribute to a common continuous representation. We evaluated FGT on acquired submillimeter 0.76 mm diffusion MRI data. Compared with state-of-the-art (SOTA) methods, FGT produced substantially greater cortical parcel coherence, within-cluster shape consistency, cluster-size consistency, and cross-subject correspondence. The trained model also generalizes well to unseen subjects with an average of 96.7% of the 5,000 learned clusters recovered, and high consistency of cluster structure between training and testing data. Together, these findings demonstrate that integrating geometric, anatomical, and shape information by learning multimodal deep embeddings with a VLM model enables robust learning of population-consistent SWM organization despite interindividual anatomical variability.

[16] Revisiting Visual Representation Enhancement of VLMs via Kernel Canonical Correlation Analysis cs.CV | cs.AI | cs.LGPDF

Peilin Yang, Xiaoyu Liu, Jian Sun, Qinghua Tao

TL;DR: 以核典型相关分析对齐CLIP视觉表征子空间，并扩展为联合图像、视觉教师与文本表征的三视图方法。

Details

Motivation: 既有方法通过逐元素匹配CLIP和DINOv2核矩阵增强细粒度视觉能力，但减弱对齐损失后性能未必下降，说明核矩阵差异未充分刻画表征子空间关系。

Result: 作者提出KCCA最大化投影相关性，并基于KKT条件推导避免特征值求解的端到端优化方案；3vKCCA进一步将预训练文本编码器纳入统一对齐。在CLIP ViT-L/14与ImageNet-1K设置下，MMVP-VLM准确率从17.8提高到25.9，同时保持零样本图文检索表现。

Insight: 子空间相关性对齐为增强细粒度视觉感知提供了不同于逐元素核匹配的目标，并兼顾图文语义；目前摘要给出的定量证据集中于特定CLIP规模和基准。

Abstract: Vision-language models such as CLIP exhibit strong semantic generalization, but remain limited in fine-grained visual perception. A recent work named KUEA presents a natural remedy by finetuning the image encoder under the supervision of the vision-centric DINOv2 to align their kernel matrices element-wisely, while regularizing the embeddings to remain close to the pretrained visual encoder for preserving image-text semantics in CLIP. However, we show that diminishing the role of the alignment loss to DINOv2 does not necessarily degrade its fine-grained visual performance, suggesting that the kernel-matrix discrepancy may be insufficient for further visual representation enhancement, motivating us to revisit the alignment formulation. In this work, we present a novel perspective to characterize representation alignment on feature subspaces through Kernel Canonical Correlation Analysis (KCCA), which maximizes the projection correlations. In optimization, we derive an efficient end-to-end training scheme upon KKT conditions, avoiding the eigenvalue problem in KCCA. Further, we extend our method into a 3-view formulation, i.e., 3vKCCA, in which the projections from the pretrained text encoder are also incorporated under a unified optimization framework for joint alignment. With CLIP ViT-L/14 on ImageNet-1K, our 3vKCCA improves the MMVP-VLM accuracy from 17.8 to 25.9, substantially outperforming the existing methods, and meanwhile maintains zero-shot image–text retrieval performance.

[17] TerrainForge: Physics-Grounded road geometry Editing for Counterfactual Autonomous Driving cs.CVPDF

Yang Chen, Yicheng Zhu, zhenning Li, Tao Li, Zilin Bian

TL;DR: 提出TerrainForge，用统一道路变形和四轮车辆动力学生成具有物理约束的自动驾驶道路反事实场景。

Details

Motivation: 改变道路坡顶、凹陷、减速带或路面摩擦会同时影响车辆运动、相机视角及车间距，单独修改场景几何无法真实反映这些联动。

Result: TerrainForge在重建的多车驾驶片段中联结道路变形与车辆动力学，并以CarSim校验动力学、以Waymo重建场景校验道路几何。在18个片段中，若周围车辆沿用记录轨迹而不重新响应，道路坡顶和凹陷情况下预测的自车—前车距离中位峰值差分别为1.52米和1.41米。作者还在983个制动片段中模拟15,758种道路编辑及相对原始回放的安全结果，用其训练预测终端间距变化的筛选代理；留出场景上其MAE比预测无变化低22%至40%。

Insight: 反事实道路编辑需要联动重算多车响应；学习到的代理可在完整多车仿真前筛选候选，但仍是针对终端间距变化的一级近似筛选器。

Abstract: Road geometry (e.g., crests, sags, and speed humps) and surface conditions (e.g., wet or icy pavement) affect how vehicles move, what drivers and onboard cameras observe, and how much clearance remains between vehicles. Editing these properties in a driving scene therefore requires corresponding changes in vehicle motion. Capturing these differences in a driving video requires a road edit to propagate to vehicle motion, camera viewpoint, and the clearance between vehicles. We present TerrainForge, a framework for generating road geometry-focused counterfactuals from reconstructed multi-vehicle driving episodes. A unified road model connects scene deformation with four-wheel vehicle dynamics, allowing crests, sags, speed humps, and friction changes to propagate through vehicle motion, camera viewpoint, and inter-vehicle clearance. Vehicle dynamics are evaluated against CarSim, and prescribed road geometry is verified in reconstructed Waymo scenes. Across 18 episodes, leaving surrounding vehicles on their recorded trajectories instead of recomputing their responses produces median peak differences in predicted ego-lead distance of 1.52 m for crests and 1.41 m for sags. We further simulate the ego response to 15,758 road edits across 983 braking episodes, pairing each edit with its safety outcomes relative to an unedited replay. These pairs train a first-stage screening surrogate that takes the original driving context and candidate road-edit parameters as input and predicts the resulting change in the ego’s terminal gap. On held-out scenes, this prediction achieves 22-40% lower mean absolute error than predicting no change, so candidates can be screened cheaply before the full multi-vehicle rollout.

[18] Seeing, Saying, but Not Using: From Reportable Spatial Facts to Usable States in Multimodal Large Language Models cs.CVPDF

Jinchang Zhang, Guoyu Lu

TL;DR: 提出SpaceConflict基准，区分多模态模型能否报告空间事实与能否将其转化为后续推理可用状态。

Details

Motivation: 模型正确说出空间关系，并不意味着后续变换推理会实际使用该信息；现有评测需要测量从观察、组合到跨情境状态运用的能力。

Result: 基准含23,196个输入，覆盖局部绑定、关系组合、跨观察一致性和变换后状态判断四级任务。对同一场景分别询问直接状态、完整变换及显式初始状态，发现模型可从图像恢复初态，却常在需要用它进行变换时失败。Qwen3.5-9B在100个初态恢复正确的序列中有50个无法完成完整变换；显式提供初态可修复全部50例。作者提出Operational State Supervision监督任务相关状态及变换轨迹、对齐跨情境事实，在成对判断上对依赖状态组织运用的L3、L4提升最大。

Insight: 评估空间推理应检验事实是否进入后续计算状态，而不只看能否描述；显式状态补足实验显示了利用缺口，但其修复效果并不能替代内生状态推理能力。

Abstract: A multimodal large language model that correctly reports a spatial fact does not necessarily use that fact in subsequent reasoning. To study this distinction, we introduce \textsc{SpaceConflict}, a benchmark of 23{,}196 inputs for the construction and use of spatial state. Under a unified Supported/Contradictory/Unknown judgment interface, it covers local fact binding (L1), relational composition (L2), cross-observation consistency (L3), and state judgment under transformation (L4). Posing a direct-state query, a full-transformation query, and an explicit-initial-state query on the same world reveals an availability–utilization gap: models recover the initial state from visual evidence yet fail when that state must drive a transformation. For Qwen3.5-9B, 50 of 100 sequences with a correctly recovered initial state fail the full transformation, and supplying the state explicitly repairs all 50; the gap narrows with scale but does not close. We therefore propose Operational State Supervision (OSS), which supervises task-relevant spatial states and their transformation trajectories and aligns shared facts across contexts. OSS improves paired accuracy on matched judgments most on L3 and L4, the levels that depend on organizing and using state. Evaluating multimodal spatial reasoning thus requires asking not only whether a model can see and state a spatial fact, but whether that fact becomes a usable state in subsequent computation.

[19] TRAC: Trajectory-aware Reuse and Adaptive Correction for Efficient Autoregressive Video Generation cs.CVPDF

Jiaxing Song, Weiqi Yan, You Huang, Mingte Qiu, Huazhong Liu

TL;DR: 提出免训练视频生成加速框架TRAC，按自回归轨迹误差调度缓存复用并纠正长程结构损失。

Details

Motivation: 现有加速方法多针对双向注意力下的单轨迹生成；自回归视频逐块连接去噪轨迹，近似误差会累积并传播。

Result: TRAC由累计误差调度RCS、自回归轨迹感知引导调度ATGS和频谱结构校正SSC组成，分别按跨块与提示变化选择缓存、协调全局轨迹上的CFG刷新，并恢复首块低频结构。在SkyReels-V2和FramePack-F1实验中，相比现有方法同时获得最高推理效率和最佳生成质量。

Insight: 加速自回归视频生成需要把跨块误差传播纳入调度，并单独修复长期结构；摘要未提供具体速度和质量指标，难以判断不同场景下增益幅度。

Abstract: In this paper, we present trajectory-aware reuse and adaptive correction (TRAC), a training-free framework for efficient autoregressive (AR) video generation. Existing acceleration methods mainly target single-trajectory generation with bidirectional attention. AR video generation, by contrast, sequentially couples chunk-level denoising trajectories. Consequently, approximation errors accumulate and propagate through the generation process. TRAC addresses this challenge with three components, including robust cumulative scheduling (RCS), autoregressive trajectory-aware guidance scheduling (ATGS), and spectral structure correction (SSC). RCS selects cache reuse schedules by cumulative rollout error and cross-chunk/prompt variation. ATGS coordinates CFG refreshes along the global AR trajectory. SSC restores low-frequency structure of the first chunk to correct long-term structural loss. Experiments on SkyReels-V2 and FramePack-F1 show that, compared with existing methods, TRAC achieves both the highest inference efficiency and the best generation quality for AR video generation.

[20] Revealing Epistemic Uncertainty in MLLMs via Causal-Invariant Masking cs.CV | cs.AIPDF

Haoyang Luo, Linwei Tao, Jie Gui, Xinghao Chen, Chang Xu

TL;DR: 提出因果不变掩码CIM，用原始预测与因果聚焦视图预测的语义偏移衡量多模态模型的认知不确定性。

Details

Motivation: 现有多模态不确定性方法较难发现由表面关联和模型能力局限引起的不确定性，容易偏重数据歧义造成的偶然不确定性。

Result: CIM以语义差异为不确定性核心指标，并给出理论分析，说明该指标收敛到模型对非因果相关性的敏感度方差。为加快评估，作者提出在超球面嵌入空间直接估计语义偏移的Expected Embedding Drift。实验中该方法在多个基准达到当时最佳表现，EED在性能相近时将评估加速近50%。

Insight: 区分数据歧义与模型自身局限有助于更全面地评估可靠性；摘要未列具体基准、任务和指标数值，结论的适用范围无法进一步核查。

Abstract: Multimodal Large Language Models (MLLMs) suffer from hallucinations, creating a critical need for Uncertainty Quantification (UQ) to ensure reliable deployment. However, existing approaches struggle to detect uncertainty caused by superficial associations, especially when the query-relevant signal is weak. We mainly attribute this issue to their bias toward aleatoric uncertainty arising from data ambiguity, overlooking epistemic uncertainty stemming from model limitations. To further decompose uncertainty types for a comprehensive UQ, we propose Causal-Invariant Masking (CIM), which measures the semantic shift between the original predictions and those conditioned on a causally-focused view. Based on this framework, we introduce Semantic Divergence as our core metric for UQ and provide theoretical evidence that it converges to the variance of model’s sensitivity to non-causal correlations, establishing its ability to capture MLLM’s limitation. To accelerate UQ in MLLMs, we further propose Expected Embedding Drift (EED), a fast geometric proxy metric that estimates semantic shift directly within the hyperspherical embedding space. Experiments show that our method achieves state-of-the-art performance on various benchmarks, while the proposed EED accelerates by nearly 50% with comparable performance.

[21] Found but Not Read: When Extracted Text Closes the Retrieval-Reading Gap in Document Vision-Language Models cs.CVPDF

Qingtao Xia, Siyao Cheng, Jiahua Bao, Jiaxing Du, Jie Liu

TL;DR: 通过配对评测区分检索到证据却未能读取利用的差距，发现OCR文本可显著提升文档VLM问答准确率。

Details

Motivation: 检索增强文档问答通常假设找到正确页面后，VLM即可读懂证据；作者发现模型可能检索成功却无法从页面图像中提取和利用文本。

Result: 在带可追溯证据的FoveDoc-Bench上，研究比较仅页面图像与图像加提取文本两种输入：加入CPU-OCR文本使严格准确率提高13至16个百分点，精确文本层的收益约为其两倍。收益在三个系列的六个VLM上均出现，模型规模增大时差距缩小但未消失。裁剪包含证据的区域可恢复大部分文本收益，而仅给页面证据框没有效果；文本对文字证据有益，对图表中性或有害，检索变差时收益也缩小。

Insight: 提取文本是有效检索的放大器，不能替代检索；多模态文档问答应分别评估证据定位与读取利用。

Abstract: Retrieval-augmented document question answering assumes that once the right page is found, a vision-language model (VLM) can read it. We show that this assumption often fails, leaving a retrieval-reading gap: evidence found but not used. A paired protocol isolates this gap by comparing answers from the retrieved page images alone with answers from the same images plus their extracted text. On FoveDoc-Bench, our benchmark with traceable evidence, retrieval finds nearly every evidence page, yet adding CPU-OCR text raises strict accuracy by 13 to 16 points. An exact text layer roughly doubles the gain, which appears across six VLMs from three families and, within one family, narrows with scale without closing. The reader can read this evidence but cannot find it: crops of it recover most of the text gain, boxes around it on the page none. The same protocol identifies two boundaries. Extracted text helps on textual evidence but is neutral or harmful on charts and figures. Its advantage shrinks as retrieval degrades, and unrelated text of the same form adds nothing detectable. Extracted text is an amplifier of retrieval that works, not a substitute for retrieval that does not. Our code is available at https://github.com/atoz03/fovedoc-sup.

[22] Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation cs.CVPDF

Yunseung Ok, Hyunsoo Kim, Minseo Kim, Suhyun Kim

TL;DR: 提出无需训练的Custom Forcing，将参考图像锚帧写入自回归视频模型KV缓存，并自适应控制身份保持。

Details

Motivation: 自回归视频模型能实时生成长视频，却倾向按文本生成通用主体；既有个性化方法要逐主体优化，或依赖不能因果流式处理的双向条件网络。

Result: Custom Forcing将参考锚帧存入冻结模型的持久KV缓存，并采用身份漂移自适应价值放大DVA与锚点对比引导ACG，分别随身份漂移调整参考影响、抑制文本提示的通用类别先验。在两分钟生成中，固定锚点的DINO-I从0.58降至0.42，而该方法保持在0.58至0.62且不损害运动；主体相似度高于双向定制方法，对比因果图像/参考视频基线时，30秒身份保持更好，逐帧生成快9.5至28.5倍。

Insight: 把参考帧融入持久缓存并根据身份漂移调节，可适配因果流式生成；长视频结果突出身份保持，但需结合具体主体和生成设置理解。

Abstract: Autoregressive video models can generate minute-long videos in real time, but they produce generic subjects from text rather than specific subjects from user-provided images. Existing customization methods either require costly per-subject optimization or use pretrained conditioning networks that jointly process all video frames with bidirectional attention. Neither approach is designed for causal streaming. We present Custom Forcing, a training-free method that stores reference-based anchor frames in the persistent KV cache of a frozen autoregressive video model. However, fixed anchors face two limitations: simple conditioning allows identity to drift, and the text prompt continues to favor a generic subject. To address these problems, drift-adaptive value amplification (DVA) scales reference influence with the degree of identity drift, while anchor contrast guidance (ACG) steers generation away from the generic class prior. Over two-minute rollouts, fixed anchors fall from 0.58 to 0.42 in DINO-I, while Custom Forcing keeps it between 0.58 and 0.62 without reducing motion. Custom Forcing also achieves higher subject similarity than bidirectional customization methods and better preserves identity over 30s than causal image-to-video and reference-to-video models, while generating each frame 9.5–28.5 times faster than these long-video baselines.

[23] TerraVis: Towards Evaluation of World-Grounded Visual Consistency in Text-to-Image Generation via MLLM Workflows cs.CVPDF

Shuai Fu, Jing Gu, Jian Zhou, Zicheng Duan, Gengze Zhou

TL;DR: 提出TerraVis框架，以对象、交互和场景层面的现实世界一致性违规分类评估文生图结果。

Details

Motivation: 文生图模型生成的图像即便写实、美观且符合文本，也可能包含畸形结构、违背物理的交互或错误空间关系，现有常用指标难以发现这些问题。

Result: TerraVis让多模态LLM先判断图像是否适合评测，再检测18类世界一致性违规、划分轻微或严重并汇总评分。在两个常用基准覆盖的多种开源与专有模型上，其评分与人类世界一致性判断的相关性高于既有指标；结果还显示传统指标成绩好的模型仍可能有大量现实合理性缺陷。

Insight: 世界一致性是图像保真、美学和文本对齐之外的独立评估维度；该框架依赖多阶段MLLM判断，摘要未说明其自动评分器与人类评价的绝对相关系数。

Abstract: Recent text-to-image models have made substantial progress in photorealism, aesthetics, and text-image alignment. Yet visually appealing images can still violate real-world plausibility, exhibiting malformed object structures, impossible anatomy, physically implausible interactions, or inconsistent spatial relationships. Such failures are not well captured by existing fidelity, aesthetics, preference, or alignment metrics. To address this gap, we introduce TerraVis, a framework for evaluating world-grounded visual consistency in generated images. TerraVis defines a structured taxonomy of world-consistency violations spanning object-, interaction-, and scene-level failures, and employs a multi-stage evaluation framework to identify and quantify them. Given an image, TerraVis first uses an MLLM to assess its eligibility for evaluation, then detects violations across 18 taxonomy-defined types and classifies them as minor or major to derive an overall world-consistency score. Across diverse open-source and proprietary text-to-image models on two widely used benchmarks, TerraVis achieves the strongest correlation with human judgments of world consistency among existing metrics. Our benchmark results further show that models that achieve strong performance on conventional metrics can still exhibit substantial world-consistency failures. These findings highlight world consistency as a complementary evaluation dimension and demonstrate that TerraVis enables systematic quantification, diagnosis, and comparison of such failures. Our code is publicly available at https://github.com/ShyFoo/TerraVis.

[24] Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy cs.CVPDF

Kaushik Bhargav Sivangi, Fani Deligianni

TL;DR: 提出结合运动学传感器融合、受试者级隐私审计和差分隐私训练的多模态三维人体姿态框架。

Details

Motivation: RGB、激光雷达和毫米波雷达提供互补姿态信息，但同一受试者的相关观测会带来记录级隐私审计难以发现的身份泄露风险。

Result: 框架对齐模态特定关节表征，注入骨架结构并自适应聚合传感器证据；另提出黑盒受试者成员推断攻击，并以逐点最大信息泄露分析刻画个体攻击分数对成员判断的影响。训练侧通过动作时间分层的受试者加权采样实施用户级差分隐私，以保证动作类别与时间覆盖。在MM-Fi数据集的三种实验协议上评估。

Insight: 将隐私分析单位提升到受试者层面，更贴近跨多条记录的身份泄露；摘要未报告姿态精度、隐私预算或攻击数值，也说明代码将在接收后发布，效果细节暂无法量化。

Abstract: Multimodal 3D Human Pose Estimation (3D HPE) combines complementary information from RGB, LiDAR, and mmWave radar, but models trained on correlated observations from the same individuals, raise privacy risks overlooked by record level analysis. We present a unified framework for multimodal 3D HPE that couples kinematics-induced sensor fusion with subject level privacy auditing and private training. First, our multimodal model aligns modality specific joint representation, injects skeletal structure and adaptively aggregates complementary sensor evidence for accurate pose prediction. Second, we formulate a black-box subject membership inference attack for 3D HPE, complemented by an empirical pointwise maximal leakage analysis, which characterizes how individual attack score outcomes change inference about the membership outcome. Third, we instantiate user-level differential privacy via Action Temporal Stratification, a population weighted within-subject sampling strategy that enforces action and temporal coverage. We evaluate our framework on the MM-Fi dataset across three diverse experimental protocols. Source-code will be released upon acceptance.

[25] When Predicting Nothing Beats SAM 3: Revisiting Evaluation in Video Object Segmentation cs.CVPDF

Jihwan Hong, Woohyeon Park, Jaeik Kim, Jaeyoung Do

TL;DR: 提出FaVOS低时间可见度视频目标分割基准，并指出常用J&F指标可能奖励空掩码，使空预测胜过强模型。

Details

Motivation: 长视频中的目标往往间歇出现，但现有VOS基准多聚焦全程可见的显著目标，难以反映低时间可见度场景；目标缺席帧上的奖励可能使标准指标失真。

Result: FaVOS系统评测低时间可见度分割，分析发现标准J&F在该设置下会退化为目标是否出现的分类，目标缺席时给空预测较高奖励，甚至让简单空掩码预测器超过SAM 3。作者提出Volumetric J&F，将掩码序列作为时空体评估，以减弱缺席帧奖励的主导，同时保留对分割质量与时间结构的敏感性。

Insight: VOS评测应避免空帧奖励掩盖实际分割质量；Volumetric J&F针对低可见度设置修正指标，摘要未报告该指标下各模型的具体排名与数值。

Abstract: Video Object Segmentation (VOS) in complex and long videos is increasingly important for real-world applications, where target objects often appear only intermittently within long temporal horizons. However, existing benchmarks largely focus on temporally salient objects that remain visible for most of the video. To address this gap, we introduce FaVOS (A Benchmark for Video Object Segmentation with Fractional Temporal Visibility), a benchmark designed to evaluate VOS methods under low temporal visibility. We show that, in this regime, the standard J&F metric can collapse VOS evaluation into absence classification, because empty predictions receive high rewards on target-absent frames. Consequently, even a trivial empty-mask predictor can outperform strong models such as SAM 3, revealing a fundamental mismatch between current metrics and practical VOS performance. To mitigate this issue, we propose Volumetric J&F, which evaluates mask sequences as spatio-temporal volumes and reduces the dominance of target-absence rewards while preserving sensitivity to segmentation quality and temporal structure. Project page: https://aidaslab.github.io/FaVOS.

[26] ReSCUE: Re-translation with Sentence Commitment for Unsegmented Long-Form Simultaneous Sign Language Translation cs.CV | cs.CLPDF

Sihan Ren, Gaozheng Li, Yuanshang Quan, Yiming Qin, Fuyi Yang

TL;DR: 提出ReSCUE，为未分段长视频流式手语翻译整合部分输入训练、稳定重译与在线句子提交。

Details

Motivation: 现有同步手语翻译多限于预先分句的离线句子级设置，难以直接处理含停顿和多句上下文的连续视频流。

Result: ReSCUE在训练中适配部分输入、非手语停顿和多句上下文；稳定重译支持低延迟且可修订的输出并减少闪烁；句子提交机制负责在线分段与记忆管理。在标准句子级基准上，低延迟设置下翻译质量最佳且延迟更低；在长视频未分段数据上，翻译质量接近使用真实句界的离线预言系统，同时延迟显著更低。

Insight: 训练与推理均按真实流式条件设计，有助于兼顾低延迟、可修订性和长上下文；摘要没有给出延迟或翻译分数的具体数值。

Abstract: Simultaneous Sign Language Translation (SLT) is critical for real-time communication, yet existing methods remain largely confined to sentence-level, offline settings that assume pre-segmented inputs. These assumptions hinder deployment in realistic scenarios involving continuous, unsegmented video streams. We present ReSCUE, a unified framework for simultaneous SLT on unsegmented long-form sign language videos that aligns training and inference with realistic streaming conditions. ReSCUE combines inference-aware training to handle partial inputs, non-signing pauses, and multi-sentence contexts, stabilized re-translation to enable low-latency yet revisable predictions with reduced output flicker, and a sentence commitment mechanism for online segmentation and memory management. Experiments on standard sentence-level benchmarks show that ReSCUE achieves lower latency and the best translation quality under low-latency settings. On long-form unsegmented datasets, ReSCUE approaches the translation quality of oracle offline systems that use ground-truth sentence boundaries, while operating at substantially lower latency, demonstrating its practicality for real-world streaming scenarios.

[27] OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection cs.CV | cs.AI | cs.ROPDF

Runtong Wu, Fei Teng, Di Wen, Guoqiang Zhao, Kunyu Peng

TL;DR: 提出OmniAct3D，将透视图预训练检测器适配至全景ERP图像，并结合球面几何、证据推理和高分辨率朝向估计。

Details

Motivation: 移动具身代理需要准确三维检测，但既有视觉基础模型检测器依赖窄视角单目图或离散透视图，无法连贯利用360度环境；ERP投影的几何组织又与透视图不同。

Result: OmniAct3D通过ERGA-Ray建模球面视线与周期空间结构，以VARC将全景证据锚定为结构化几何动作，并由AGHE重新编码目标区域以精细估计朝向。Spheriverse上比此前最佳三维检测器提高2.96 NDS分；PanoMMOcc上比未经适配的VFM基线高24.87 mAP分。特定几何适配下，VARC保留同配置mAP的95%至98%，表明目标级三维推理可复用于不同传感配置。

Insight: 显式建模ERP几何并回看局部外观，有助于保留全景场景上下文和检测细节；跨配置推理结果仍依赖目标特定几何适配。

Abstract: Accurate 3D detection is essential for mobile embodied agents, while Vision Foundation Models (VFMs) offer transferable visual and geometric priors. Yet existing VFM-based 3D detectors rely on narrow-view monocular images or discrete perspective views, limiting coherent surround perception; equirectangular projection (ERP) instead encodes a continuous 360 scene in a single image. Direct transfer remains difficult because ERP organizes geometry and visual information differently, making object-relevant cues hard to model, localize, and preserve. We propose OmniAct3D, a framework that adapts perspective-trained VFM detectors to ERP while preserving transferable VFM priors. To resolve geometric mismatch, the ERP-Ray Geometry Adapter (ERGA-Ray) models spherical viewing rays and periodic spatial structure. To localize evidence in scene-wide context, the Visual-Action Reasoning Chain (VARC) grounds each hypothesis in relevant panoramic evidence and converts it into a structured geometric action. To recover local cues lost under fixed token budgets, the Appearance-Guided Heading Expert (AGHE) re-encodes object regions at higher resolution for heading estimation. Experiments show that OmniAct3D improves over the previous best 3D detector by 2.96 NDS points on Spheriverse and over the unadapted VFM baseline by 24.87 mAP points on PanoMMOcc. With target-specific geometry adaptation, VARC retains 95–98% of the same-configuration mAP, indicating reusable object-level 3D reasoning across sensing configurations. The source code will be made publicly available at https://github.com/FeiT-FeiTeng/OmniAct3D.

[28] Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Model cs.CVPDF

Yunjiao Zhou, Junlang Qian, Lihua Xie, Jianfei Yang

TL;DR: 提出寄生协同去噪及PMD解码器，从冻结视频扩散模型的中间去噪表征同步解码三维人体动作。

Details

Motivation: 大规模文生视频扩散模型虽未受显式三维动作监督，却能生成逼真人体运动；作者希望把这种隐式动作知识转为三维动作生成，而不另训专用运动模型。

Result: 对冻结Wan2.1的探测显示，整个去噪过程的中间状态中都含可恢复运动信号。PMD作为流匹配解码器共享主模型噪声调度，通过σ自适应多层融合读取中间特征，主模型保持不变。其可训练参数远少于专用运动生成器，并在文本—动作对齐上领先这些模型；单次前向即可成对生成视频和动作，是仅生成动作的基线无法实现的能力。

Insight: 视频生成模型的去噪轨迹可复用为动作生成信号，免去独立生成器并实现视频动作配对；摘要未给出具体对齐指标及质量数值。

Abstract: Despite never being supervised on explicit 3D motion, large-scale text-to-video diffusion models synthesize realistic human motion in their generated videos. We ask whether this implicit knowledge can be turned into explicit 3D motion generation, without training a separate motion model. Probing a frozen Wan2.1 reveals that a recoverable motion signal is present in its intermediate states across the entire denoising schedule, not confined to the clean output. Motivated by this, we introduce parasitic co-denoising, a paradigm in which motion is decoded from the host model along its denoising schedule rather than produced by an independent generator. We instantiate it as the Parasitic Motion Decoder (PMD), an efficient flow-matching decoder that shares the host’s noise schedule and reads its intermediate features through a $σ$-adaptive multi-layer fusion, leaving the host unmodified. Drawing its coverage from the host rather than from motion data, PMD leads dedicated motion generators on text-motion alignment at a small fraction of their trainable parameters, while producing paired video and motion in a single pass that motion-only baselines cannot match.

[29] NegT2IBench: When Negation Changes the Picture. A Polarity Benchmark for Text-to-Image Models cs.CV | cs.AI | cs.LGPDF

Omar Elfatairy, Maria A. Bravo, Jessica Bader, Zeynep Akata

TL;DR: 提出NegT2IBench，独立评测文生图模型满足否定约束的能力，并分析否定与肯定要求的差异。

Details

Motivation: 现有文生图基准多看要求的内容是否出现，较少评估模型能否遵守“非红色杯子”这类需要排除某属性的约束；总体构图分数会混淆两种能力。

Result: 基准含4,800条提示，覆盖两种属性类型和四类关系，并独立控制需满足的肯定陈述与需拒绝的否定陈述数量（各0至2）。检测器评分可复现、可审计，并能指出失败条件；在600张三人标注图像上，其与人类判断的一致程度与大出最多30倍的视觉语言评审器相当，且显著节省显存。对11种模型、211,200张图像的评测中，9种模型面对单个否定陈述的得分低于单个肯定陈述；损失主要见于颜色约束，邻近关系几乎无损，41.5%的失败陈述将提示明确禁止的内容画出。

Insight: 满足正向要求与压制被禁止内容是不同能力，需分别评估；基准检测器能定位错误条件，有助于系统诊断否定理解缺陷。

Abstract: Text-to-image (T2I) models are judged by benchmarks that measure whether requested content appears, but these benchmarks largely overlook the complementary ability to satisfy negated constraints, for example, generating “a non-red cup.” Measuring negation raises challenges not faced by affirmation-based benchmarks and requires careful prompt and evaluation design. We introduce NegT2IBench, a benchmark of 4,800 prompts covering two attribute types and four relation categories. Prompts are organized by polarity: the number of positive statements that must hold and negated statements that must not, each ranging from 0 to 2. Varying the two independently separates the effect of negation from the effect of prompt complexity. Our detector-based scoring is reproducible, auditable, and pinpoints which requirement failed. On 600 images with three-annotator labels, it agrees with humans as closely as vision-language judges up to 30x larger, while using only a fraction of their GPU memory. Across eleven T2I models and 211,200 images, nine score lower on a single negated statement than on a single positive one. Per-statement scoring reveals that the loss is largest for color and near zero for proximity, and that 41.5% of failed statements render exactly what the prompt forbids. Rendering what a prompt asks for and withholding what it forbids are distinct capabilities that an aggregate compositional score cannot distinguish. NegT2IBench measures the latter directly, providing a controlled testbed for diagnosing negation failures and developing methods to overcome them.

[30] BeeWhere: Segmenting Bumble Bee Colonies to Quantify Behavioral Effects cs.CVPDF

Roberta Hunt, August Easton-Calabria, James Crall

TL;DR: 提出BeeWhere流程，将ArUco个体标记与实例分割结合，用蜂群图像和视频量化大黄蜂行为。

Details

Motivation: 密集且遮挡的蜂巢环境使个体和群体行为难以规模化测量；标记跟踪会在标记被遮住时失效，也难以描述身体范围、空间语境及未标记个体。

Result: 研究标注483帧中的8,443只Bombus impatiens实例，并标注花粉球、巢结构和隔室边界，训练YOLO实例分割模型。轮廓分割支持测量邻近距离、巢结构邻近性、巢内占用及随时间的检测数量。在新烟碱类农药暴露探索性验证中，BeeWhere比标记跟踪检出更多蜜蜂，尤其在部分遮挡或成像困难时，并发现标记跟踪未捕获的处理相关空间组织变化。

Insight: 实例分割能补充标记跟踪，恢复遮挡下具有行为意义的空间信号；农药暴露分析是探索性验证，尚不能据此作强因果推断。

Abstract: Social bees are important pollinators that support biodiversity and crop pollination globally and serve as important model systems for collective behavior, but scalable measurement of individual- and colony-level behavior remains difficult in dense, occluded nest environments. Existing monitoring workflows use fiducial tags (e.g., ArUco) to preserve individual identity, yet tag-based tracking can fail when markers are obscured and provide limited information about body extent, spatial context, and untagged individuals. We present BeeWhere, an AI-assisted annotation and analysis workflow that combines ArUco detections with deep-learnt instance segmentations to quantify bumble bee behavior from high-resolution colony images and videos. Using bumble bee (Bombus impatiens) microcolonies as a test case, we annotate 483 frames containing 8,443 bee instances. We additionally annotate pollen balls, nest structures, and chamber boundaries, and train YOLO instance segmentation models for downstream behavioral analysis. Instance segmentations enable quantification of important behavioral metrics based on body contours, including nearest-neighbor distance, proximity to nest structures, spatial occupancy within the nest, and detection counts over time. We apply the BeeWhere models to tag-based tracking in an exploratory validation study assessing the behavioral impacts of neonicotinoid pesticide exposure. BeeWhere increased detection rates compared to tag-based tracking, particularly when bees were partially obscured or under challenging imaging conditions, and also captured treatment-associated changes in bee spatial organization not captured using tag-based tracking alone. These results suggest that instance segmentation can complement fiducial-marker tracking by recovering behaviorally meaningful signals under challenging colony conditions.

[31] Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoning cs.CV | cs.AIPDF

Jinghan Zhao, Yiman Hu, Liang Wu, Jian Xu, Bo Zheng

TL;DR: 构建AdsCVR跨电商视频推理基准，并提出AdSeek通过主动选择视听工具收集跨视频证据。

Details

Motivation: 消费者和营销人员需要比较不同电商视频中的商品与策略，而现有多模态模型主要处理单个视频，难以从冗余片段中定位并整合细粒度视觉、语音和屏幕文字证据。

Result: AdsCVR含2,483个视频、6,110组问答和六类推理维度。AdSeek在多轮探索中动态选择视觉与音频工具，取代静态均匀采样；针对强化学习奖励稀疏，离线修正轨迹以定位推理错误和缺失证据，再用监督微调校正偏差并继续强化学习。在测试集上准确率为74.30%，比Qwen3-VL-8B-Instruct骨干高27.90个百分点，并能泛化到开放域CrossVid基准。

Insight: 跨视频推理需要主动找证据，并在强化学习后用可修正轨迹补足稀疏反馈；摘要未提供CrossVid上的具体分数。

Abstract: E-commerce videos are information-dense and frequently compared by consumers evaluating products and merchants assessing marketing strategies. However, existing multimodal models mainly focus on single-video understanding and have limited ability to compare information across videos. We introduce AdsCVR, the first e-commerce cross-video reasoning benchmark, containing 2,483 videos and 6,110 question-answer pairs across six reasoning dimensions. Cross- video reasoning requires models to locate fine-grained evidence among many redundant frames and integrate visual details, speech, and on-screen text. We therefore propose AdSeek, an agentic framework that dynamically selects visual and audio tools during multi-turn exploration, replacing static uniform sampling with active evidence acquisition. To address the sparse credit assignment of reinforcement learning, we develop an offline trajectory rectification mechanism that identifies reasoning errors and missing multimodal evidence in RL-generated trajectories. The corrected trajectories provide supervised fine-tuning signals that reduce biases learned during RL. This mechanism supports a rectified bootstrapping pipeline in which initial RL exposes reasoning bottlenecks, supervised fine-tuning corrects them, and a final RL stage further improves the policy. AdSeek achieves 74.30 percent accuracy on the AdsCVR test split, outperforming its Qwen3-VL-8B-Instruct backbone by 27.90 percentage points. It also generalizes to the open- domain CrossVid benchmark, demonstrating effective active evidence gathering.

[32] Foresight: planning future perception in streaming VLMs without retraining cs.CV | cs.AIPDF

Ashok Prasad Neupane, Dipan Bartaula, Ankit Belbase, Saugat Adhikari, Samip Ghimire

TL;DR: 提出免重训练的FORESIGHT双流架构，使流式VLM提前预测未来上下文并在线规划何时推理、检查什么及如何采样。

Details

Motivation: 现有流式视觉语言模型在推理时计算路径固定，无法依据视频事件动态调整未来感知；提前预测须可靠、与流处理并行且重配置开销很低。

Result: FORESIGHT由共享权重、输入编码器和KV缓存的孪生LLM构成：一支处理当前流，另一支超前预测上下文、规划计算并生成任务响应。计划在线执行，决定下一次推理时间、检查内容和采样密度，并用模式约束解码及轻量差异更新完成重配置。冻结Qwen3-VL-8B在OmniPro Online平均联合F1为23.0，比最强训练基线高9.5%；StreamingBench和OVO-Bench分别比骨干提高6.7和15.4分，证据越晚出现的视频流上最大提升18.7分。

Insight: 把未来感知规划与当前流推理并行，允许模型按证据到达时机分配计算；收益最大出现在延迟证据场景，摘要未量化运行时重配置开销。

Abstract: Existing streaming vision-language models (VLMs) continuously perceive and reason over visual streams, but their computational pathways remain fixed throughout inference. Consequently, they cannot adapt computation to evolving scene dynamics, where different future events demand different levels and forms of perception. We show that streaming VLMs inherently possess the ability to anticipate the immediate future, and leverage this capability to dynamically configure future computation in a training-free manner. Realizing such anticipatory computation, however, is very challenging: future anticipation must be sufficiently reliable to guide computation, planning must run concurrently with streaming inference, and online reconfiguration must incur negligible overhead. To address these challenges, we introduce FORESIGHT, a dual-stream architecture comprising two Siamese LLMs with shared weights, input encoders, and KV cache. The first LLM continuously processes incoming tokens, while the second runs ahead of the stream to anticipate future context, plan future computation, and generate task responses without interrupting streaming inference. Each plan decides when to reason next, what to check then, and how densely to sample, keeping transient evidence separate from persistent control. The resulting computation plan is executed online through an efficient reconfiguration protocol with schemaguided decoding and lightweight diff-based updates, enabling dynamic adaptation with low overhead. With a frozen Qwen3-VL-8B backbone, FORESIGHT achieves 23.0 mean joint F1 on OmniPro Online evaluation beating strongest trained baseline by 9.5%, while improving the backbone by 6.7 on StreamingBench and 15.4 on OVO-Bench, with the largest gain of 18.7 when evidence arrives later in the video stream. Our source code will be made publicly available.

[33] In-Distribution Forcing for Long Video Generation at Test Time cs.CVPDF

Jeongwoo Shin, Youngyoon Choi, Sangwoo Jo, Hyunmog Kim, Sungjoon Choi

TL;DR: 提出测试时框架ID-Forcing，通过自缓存让长视频自回归扩散模型滚动窗口保持训练分布内。

Details

Motivation: 自回归视频扩散模型擅长短视频，却会在长生成中发生颜色纹理漂移和动作衰减；仅调整KV缓存仍假定缓存条目保持分布内，而超出训练时长后缓存条目自身也会偏离分布。

Result: ID-Forcing使KV缓存构造和条件化都与训练配置对齐。其自缓存机制让每个视频块在不读取此前KV条目的条件下缓存，从源头避免分布外KV，使滚动窗口保持训练分布内。该测试时方法将短时模型扩展到分钟级视频；在标准视频基准上保持竞争力，并在漂移指标和用户研究中明显优于先前方法。

Insight: 长程漂移的来源不只在如何使用缓存，也在缓存本身逐渐偏离训练分布；自缓存直接约束缓存来源，但摘要未列基准和漂移幅度的量化结果。

Abstract: Modern autoregressive (AR) video diffusion models excel at short-horizon video generation, yet generating long videos remains challenging due to drifting, where colors and textures shift, and motion dynamics decay. Existing works primarily rely on KV conditioning, which selects or modifies cached key-value (KV) entries to mitigate drifting. However, we observe that KV conditioning alone is insufficient as it assumes cached KV entries remain in-distribution. This assumption fails beyond the training horizon: nothing constrains the construction of KV entries during rollout, giving rise to the KV-provenance problem where cached entries themselves become out-of-distribution (OOD). To address this, we propose In-Distribution Forcing (ID-Forcing), a test-time framework that aligns both KV caching and KV conditioning with training configurations. Its key mechanism, self-caching, prevents OOD KV entries at their source. Each chunk is cached without attending to prior KV entry, keeping the rolling window exactly in-distribution. Consequently, ID-Forcing seamlessly extends short-horizon models to minute-scale video generation. Extensive evaluations show that our method remains competitive on standard video generation benchmark while substantially outperforming prior work in mitigating drifting, as validated by both our drift metrics and a user study.

[34] Behavior Pack Optimization for Video MLLM Post-Training cs.CVPDF

Zhaolu Kang, Shiyu Liu, Tailong Luo, Wei Zhang, Yingjie He

TL;DR: 提出行为包优化BPO，在反事实视频视图集合上联合训练视频MLLM，使回答对无关干预稳定、对证据移除敏感并在无证据时弃答。

Details

Motivation: 视频问答模型在打乱帧、遮蔽答案证据片段或遮挡目标后预测几乎不变，说明其准确率可能依赖外观和语言先验，而非问题所需的时间证据；单一原始视频回答的训练奖励无法约束跨视图行为。

Result: BPO针对问题类型构建反事实视图行为包并联合评分，以原始视图回答作为锚点相对优势，避免小样本混合视图组均值造成不稳。在TempCompass、MVBench和NExT-QA上，相比同预算且同SFT起点的GRPO，Qwen2.5-VL-7B-Instruct宏平均准确率提高4.7个百分点、时间困难子集提高7.8个百分点、弃答F1提高20个百分点；增益迁移至Video-MME、LongVideoBench及LLaVA-Video-7B。消融显示收益来自视图集合而非采样次数。

Insight: 通过反事实视图联合奖励，训练目标能直接检查模型是否使用证据并在缺证时弃答；跨基准迁移初步支持该方法的泛化性。

Abstract: Video multimodal large language models (MLLMs) keep climbing video question answering benchmarks, yet shuffling the frames, masking the segment that supports the answer, or occluding the target object barely changes their predictions. The accuracy rests on appearance and language priors, not on the temporal evidence the question asks for. We trace this to the unit of post-training: rewards are computed on a single response to the original clip, so the model is never asked to behave consistently across views. We propose Behavior Pack Optimization (BPO), which replaces the single response with a behavior pack of outputs across counterfactual views chosen by question type, scored jointly. The pack reward asks for stability when the intervention is irrelevant, sensitivity when key evidence is removed, and abstention when no evidence remains. To keep this objective stable at small pack sizes, BPO uses an anchor-relative advantage: the response on the original view serves as a per-prompt reference instead of a group mean over mixed views. On TempCompass, MVBench, and NExT-QA, BPO improves the macro accuracy of Qwen2.5-VL-7B-Instruct by 4.7 pp, the temporal-hard subset by 7.8 pp, and abstention F1 by 20.0 pp over a budget-matched vanilla GRPO baseline from the same SFT checkpoint. The gains transfer to Video-MME, LongVideoBench, and to LLaVA-Video-7B; ablations confirm they follow the view sets, not the rollout count. We hope this pack-level perspective offers a useful starting point for the video MLLM and multimodal post-training community as the field moves toward evidence-grounded video reasoning.

[35] Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models cs.CV | cs.LGPDF

Jonas Kneifl, Jakub Skalski, Bartłomiej Twardowski, Kamil Deja

TL;DR: 探测视频扩散Transformer去噪激活，发现运动学和刚体动力学量可被早期线性读出，并可用于引导生成输出。

Details

Motivation: 视频生成模型常被视为世界模型，但基准暴露出明显物理推理短板；需要区分模型是否内部构建物理信息，还是仅复现熟悉运动模式。

Result: 作者以模拟器产生的运动学及重力、接触动力学真值探测DiT表征。物理量在去噪早期即可高精度线性解码，明显超过直接从模型自身加噪潜变量解码的基线；物体对应token携带相关信息，多帧定义的物理量也能从单个潜在帧读取。信息在token序列中局部存储、通过全局计算得到，并能部分泛化到训练外场景变化和物体配置。全分辨率激活拟合得到的探测方向还可用作steering vector改变生成结果。

Insight: 去噪过程似乎主动构建并局部编码物理量，而非仅继承输入线索；激活可读出不等于模型具备可靠物理因果推理，方向控制效果仍需结合具体任务评估。

Abstract: Video generation models produce strikingly realistic sequences and are increasingly proposed as world models, yet recent benchmarks reveal pronounced deficits in their physical reasoning. This raises the question of whether these models internalize physical principles or merely reproduce familiar motion patterns. We address this by probing internal representations of video Diffusion Transformers (DiTs) for simulator-derived ground-truth physical quantities spanning kinematic motion and rigid-body dynamics under gravity and contact. We find that these quantities are linearly decodable with high accuracy early in the denoising process, substantially outperforming a baseline decoded directly from the model’s own noised latents, indicating that the relevant physical information is actively constructed during denoising rather than already present in the input. Additionally, we show that activations at on-object tokens carry the relevant physical information and that quantities defined over multiple frames are readable from single latent frames. Hence, information is sharply localized within the token sequence and is computed globally but stored locally. The probes further show partial extrapolation, transferring to scene variations and object configurations outside their training regime, so what they read is not simply a correlate of the scenes they were fit on. When fitted directly in the full-resolution activation space, the probing directions can serve as steering vectors to change the model’s output.

[36] Bridging Research and Practice: A Systematic Evaluation of Generalist and Dermatology-Specific Models in Clinical Skin Lesion Classification cs.CVPDF

Emanoel dos Santos, Kelvin Cunha, Rodrigo Mota, Fabio Papais, Thales Bezerra

TL;DR: 系统评估通用视觉语言模型、基础模型及皮肤科专用分类器在皮肤病变分类中的跨域、跨模态和人口差异泛化。

Details

Motivation: 皮肤病变诊断存在模糊性和高度变异，采集设备、成像方式及患者人口特征差异会影响模型，妨碍安全公平的临床应用。

Result: 研究在近期皮肤科数据集上比较多类架构，覆盖皮肤镜图像与智能手机临床照片；评测通用及医学视觉语言模型、基础模型，以及嵌入式方案和卷积神经网络等任务专用分类器，并分析分布偏移、模态变化和人口差异下的表现，以量化当前模型与临床部署要求之间差距。摘要未提供具体基准成绩或差距数值。

Insight: 跨数据源与人口群体的系统评测是临床转化前提；由于摘要未给量化结果，无法判断各类模型相对优势或部署差距大小。

Abstract: The application of machine learning to dermatology has grown substantially in recent years, moving beyond proof-of-concept studies toward potential applications. However, clinical dermatology remains a challenging and still open problem. Diagnostic assessment is often ambiguous, and skin lesions exhibit high variability, compounded by differences in acquisition modality, device quality, and patient demographics. These factors hinder the development of robust models suitable for safe and equitable clinical use. To support translation into practice, it is essential to systematically evaluate how contemporary models generalize across heterogeneous data sources. In this work, we benchmark a diverse set of architectures on recent dermatology datasets, spanning dermoscopic images and smartphone-based clinical photographs. We assess the robustness of recent general-purpose and medical vision-language models, as well as foundation models, and compare them against task-specific dermatology classifiers, including embedding-based approaches and convolutional neural networks. Our study provides an evaluation of model performance under distribution shifts, modality changes, and demographic variability. By quantifying the gap between current state-of-the-art models and the requirements of clinical deployment, we aim to contribute to the development of reliable, accessible, and clinically applicable AI systems for dermatology.

[37] Contextual Flow Matching: Adaptive Step Selection in Flow Models for Efficient Visual Generation cs.CV | cs.AIPDF

Divya Jyoti Bajpai, Arun Verma, Manjesh Kumar Hanawal

TL;DR: 提出COFLOW，在推理时依据提示特征在线选择流匹配视觉生成的步数，提升效率并保持生成质量。

Details

Motivation: 流匹配通过连续时间动力学生成高质量图像或视频，但需要多次串行函数评估；现有加速方法可能增加训练开销、损害质量，或忽略不同输入所需计算量不同。

Result: COFLOW以无监督奖励在线训练上下文感知的步数选择器，平衡推理效率与生成保真度，无需重训底层生成模型，可即插即用地用于图像和视频生成。实验在保持感知与语义质量的同时实现超过2.5倍加速；理论分析在标准正则条件下证明前向Euler离散误差为O(1/K)。

Insight: 按输入动态分配函数评估次数可避免所有提示使用相同采样预算；理论误差界依赖常规正则条件，摘要未说明不同生成模型上的具体速度与质量指标。

Abstract: Flow Matching enables high-quality visual generation via continuous-time dynamics, but inference remains costly due to multiple sequential function evaluations. Existing acceleration methods reduce the number of function evaluations but often introduce additional training overhead, degrade quality, or fail to account for input-dependent variability. We propose COFLOW, an inference-time method that adaptively selects the step counts each generation based on the prompt features. Our context-aware COFLOW is trained online with an unsupervised reward that balances inference efficiency and generation fidelity. Our method is plug-and-play, requiring no retraining of the underlying generative model. It generalizes to image and video generation, achieving over 2.5x speedup while preserving perceptual and semantic quality. We further provide a theoretical analysis establishing an O(1/K) forward-Euler discretization error bound under standard regularity conditions.

[38] VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation cs.CVPDF

Yutong Wang, Xingtong Ge, Enhuai Liu, Yunke Wang, Tianfan Xue

TL;DR: 提出VDOT++，以非平衡最优传输蒸馏统一加速文生视频、图生视频及条件视频生成。

Details

Motivation: 视频扩散模型采样时需反复运行大型骨干；分布匹配蒸馏可能因师生分布重叠不足而提供不稳定或不完整指导，平衡最优传输又假定对应帧空间token全量匹配，不适应同一条件下存在多种有效视频的情况。

Result: VDOT++通过非对称非平衡传输降低不可靠学生token权重，同时覆盖教师token；L1代价以加权中位数聚合目标，减少远端传输目标影响。方法还顺序执行分布匹配与对抗细化，并利用解耦评分网络进行跨尺度蒸馏。UVCBench、VBench、VBench-I2V和VACE评测显示，统一训练得到的四步生成器在文生、图生及条件生成上可与多步教师和强少步基线竞争。

Insight: 非平衡传输同时决定匹配哪些token以及如何聚合多样目标，缓解条件生成中的空间对齐假设；摘要未提供具体质量分数或加速倍率。

Abstract: Video creation spans text-to-video (T2V), image-to-video (I2V), and condition-based generation, yet video diffusion models remain costly because they repeatedly evaluate large backbones during sampling. Distribution matching distillation (DMD) reduces this cost, but its reverse Kullback–Leibler (KL) objective can provide unstable or incomplete guidance when the student and teacher distributions have limited overlap. VDOT addressed this issue by adding optimal transport distillation (OTD), whose explicit coupling supplies geometric directions for condition-based generation. Balanced OTD, however, performs full-mass matching between the spatial tokens of each corresponding student–teacher frame pair. This assumption weakens for T2V and I2V, where one condition admits many valid outputs and spatial content need not align across different realizations. We present VDOT++, a unified distillation framework that applies the same training recipe separately to generators for the three task families. It makes OTD robust to output diversity through an asymmetric unbalanced formulation that allows unreliable student tokens to carry less mass while maintaining coverage of the teacher tokens. An $\ell_1$ ground cost further replaces mean-based aggregation with a more mode-preserving weighted median that limits the influence of distant transport targets. The two changes respectively determine whom to match and how the selected targets should be aggregated. We additionally combine distribution matching and adversarial refinement through sequential backward passes, and exploit the decoupled score networks for cross-scale distillation, where larger score networks improve a compact generator. Experiments on UVCBench, VBench, VBench-I2V, and the VACE benchmark show that the resulting four-step generators are competitive with many-step teachers and strong few-step baselines across all three task families.

[39] VisionMX: Unlocking Microscaling Post-Training Quantization for Vision Models cs.CVPDF

Elad Dror Cohen, Ofir Gordon, Lior Dikstein, Idan Achituve, Hai Victor Habi

TL;DR: 提出VisionMX后训练微缩格式量化方法，通过有界权重量化与可折叠激活仿射校正降低视觉模型MX转换误差。

Details

Motivation: MX格式结合低精度元素与共享块尺度，适合硬件支持的高效推理，但其对视觉模型的影响研究不足；直接转换会受块尺度表示、卷积权重网格不匹配及非负激活未充分利用有符号编码影响。

Result: VisionMX针对权重优化有界舍入，并对激活施加可折叠仿射校正。在图像分类、目标检测、语义分割和低照度增强任务及多种MX格式上的评测中，优于直接转换和所比较的后训练量化基线；对MX转换最敏感的架构性能恢复幅度最大。

Insight: 区分权重和激活的转换误差来源并分别校正，有助于扩大MX量化在视觉任务中的适用性；摘要未提供具体模型、位宽或精度提升数值。

Abstract: Microscaling (MX) formats are emerging as a hardware-supported approach to efficient training and inference. They combine low-precision elements with shared block scales, but their impact on vision models remains underexplored. We systematically investigate post-training MX quantization across vision models and tasks. An analysis of direct conversion identifies three sources of error: block-scale representation, the poor alignment of some small convolutional weight tensors with nonuniform element grids, and the underuse of signed codes by nonnegative activations. These findings motivate VisionMX, a post-training MX quantization method that optimizes bounded weight rounding and applies a foldable affine correction to activations. We evaluate VisionMX across image classification, object detection, semantic segmentation, and low-light image enhancement using several MX-style formats. It improves on direct conversion and the evaluated post-training quantization baselines, with the largest performance recoveries in architectures most sensitive to MX conversion

[40] Moving Forward with Video Saliency: A New Dataset and Benchmark where Motion Matters cs.CVPDF

Susmit Agrawal, Rebecca Wanner, Juliane Verwiebe, Matthias Tangemann, Matthias Bethge

TL;DR: 提出视频显著性基准SalTempto，通过高动态事件片段与注视记录检验模型是否真正利用时间信息。

Details

Motivation: 视频显著性理论上需利用帧间动态，但在常用LEDOV数据集上，静态基线已恢复大量可解释注视信息，最佳时序架构也仅略胜静态方法，无法区分模型局限和基准本身缺少时序模式。

Result: SalTempto含224段来自HACS-Segments的高动态视频，每段覆盖事件及其前后过程，最多16名受试者的注视记录，并提供训练划分。静态基线仅恢复中心偏置以上可提升空间的大约13%，而LEDOV超过一半；微调时序架构显著超过静态基线，说明它捕捉到额外时间信息。但最先进模型仍未解释SalTempto近一半的提升空间。

Insight: 新基准显示基准构造会决定是否能测出时间线索带来的收益；即使最佳时序模型仍留有显著提升空间。

Abstract: Video saliency prediction is inherently harder to model than static image saliency due to the additional temporal dimension. Video saliency benchmarks rest on the premise that predicting gaze on video requires utilizing temporal activity distributed across frames. Prior work has challenged this, showing that static baselines recover a significant fraction of the explainable gaze information on LEDOV, a popular video saliency dataset, and that video saliency models fail in the same places as this static baseline. We verify that this diagnosis still stands: under a more capable gold standard than the original analysis, and an updated panel of recent architectures, the strongest temporal architecture in the panel still does not substantially improve over a fine-tuned static baseline. However, it remains unclear whether the marginal gain reflects limitations of current temporal architectures or a lack of temporal patterns in the benchmark itself. We introduce SalTempto, a video saliency benchmark with greater dynamism: 224 clips of highly dynamic content, sourced from the HACS-Segments dataset so that each clip contains an event together with its lead-up and aftermath, with gaze recordings from up to 16 subjects and a training split for adapting pretrained models. On SalTempto, the static baseline recovers only about 13% of the headroom above the centerbias, against more than half on LEDOV. A fine-tuned temporal architecture shows a substantial gain in performance over the static baseline, indicating that it does capture meaningfully more temporal information, which LEDOV fails to measure. Yet, even this SoTA model still leaves nearly half of SalTempto’s headroom unexplained, indicating room for improvement in video saliency modelling. Examination of SalTempto also lets us describe human tendencies that models miss. SalTempto link: https://huggingface.co/datasets/bethgelab/video_saliency.

[41] EVEWorld: Physical Evolution Supervision for Embodied World Models cs.CVPDF

Kaiqi Wang, Songxin Zhang, Zejian Xie, Xiao Xiong, Zhuoyang Song

TL;DR: 提出EVEWorld物理演化监督框架，以实例恢复和跨帧实例对齐降低具身世界模型生成轨迹中的物理一致性缺陷。

Details

Motivation: 现有具身世界模型容易出现“模型偷懒”，追求视觉逼真却忽略物理推理，且缺乏对被操纵物体时间演化过程的监督。

Result: EVEWorld由实例引导恢复IGR和时间实例对齐TIA组成，分别通过恢复监督维护实例一致性、通过相邻帧目标对齐保障跨帧一致性，并提出模型偷懒率MLR衡量轨迹中持续违规。在DreamGenBench、EWMBench和PBench上验证有效，MLR较GigaWorld-0降低87.5%；WorldArena 2.0 Track 1排行榜中，JEPA相似度第6、总排名第17。

Insight: 显式监督物体身份与跨帧演化能改善物理一致性，MLR提供针对持续实例错误的度量；世界模型排行榜名次说明整体表现仍非领先。

Abstract: Embodied world models enable scalable simulation of embodied interactions for robot learning. However, existing models are prone to Model Laziness, as they focus on visual fidelity at the expense of physical reasoning and lack process-level supervision over the temporal dynamics of manipulated objects. In this work, we propose EVEWorld, a physical evolution-supervision framework for physically consistent target evolution. EVEWorld consists of two components: Instance-Guided Restoration (IGR) and Temporal Instance Alignment (TIA). First, IGR promotes instance consistency through restoration supervision. Second, TIA promotes cross-frame consistency by aligning target instances across adjacent frames. We further introduce the Model Laziness Rate (MLR), a metric that measures persistent violations of instance consistency in generated trajectories. Extensive experiments on DreamGenBench, EWMBench, and PBench demonstrate the effectiveness of EVEWorld, notably achieving an 87.5% reduction in MLR compared with GigaWorld-0. On the WorldArena 2.0 Track 1 leaderboard, our model ranks 6th in JEPA Similarity and 17th overall, which further validates the performance of our evolution supervision strategy.

[42] Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modeling cs.CVPDF

Chahira Benhama, Mohand Saïd Allili, Assia Hamadene

TL;DR: 提出可解释的视频深伪检测方法，将68维显式人脸取证特征输入LSTM建模时间不一致。

Details

Motivation: 伪造视频单帧可能视觉连贯，但跨帧存在细微时间异常；依赖隐式表示的端到端模型难以透明解释且跨数据集泛化受限。

Result: 流程将视频转为身份一致的人脸轨迹，分成固定长度窗口，每帧提取68项光度、纹理、几何和压缩特征，再以LSTM捕捉时间依赖。在FaceForensics++、Celeb-DF v2、DFDC精选子集和DeeperForensics四个基准上的F1分别为98.0%、91.0%、97.6%和96.2%，并报告良好的跨数据集泛化表现。

Insight: 结构化且具有物理依据的特征提供较透明的取证路径，并利用时序异常检测伪造；摘要未量化跨数据集转移的具体成绩。

Abstract: Deepfake detection in videos remains challenging, as manipulated content may appear visually consistent at the frame level while exhibiting subtle temporal inconsistencies. This paper introduces an interpretable deepfake detection framework that models spatially and temporally coherent facial features in video sequences. Unlike end-to-end deep models relying on implicit representations, the proposed approach explicitly encodes physically grounded forensic cues, enabling transparent analysis and improved multi-dataset generalization. The pipeline transforms videos into identity-consistent facial trajectories, segments them into fixed-length temporal windows, and represents each frame using 68 structured descriptors spanning four complementary domains: photometric, textural, geometric, and compression-based features. These descriptors provide a compact multi-domain representation of manipulation artifacts and are processed by a Long Short-Term Memory (LSTM) network to capture temporal dependencies and subtle irregularities. Evaluation on four benchmark datasets, FaceForensics++, Celeb-DF v2, a curated subset of the DeepFake Detection Challenge (DFDC), and DeeperForensics, yields strong and consistent F1-scores of 98.0%, 91.0%, 97.6%, and 96.2%, respectively. The approach also demonstrated a good cross-dataset generalization, providing a robust and interpretable solution for video deepfake detection.

[43] Native Action-Prior Learning from Videos for World Action Models cs.CV | cs.ROPDF

Zhaochong An, Fei Zhang, Menglin Jia, Duncan Frost, Zijian Zhou

TL;DR: 提出NAVA-WAM，直接用无动作标注视频预训练机器人动作策略，再以视频—动作演示进行控制后训练。

Details

Motivation: 世界动作模型联合预测视觉动态与机器人动作，但依赖动作标注轨迹，限制规模；已有无标注视频方法多先学视觉表征再迁移控制，或另训潜在动作模型。

Result: NAVA-WAM分两阶段训练：先以未来视频流匹配监督视觉状态转换，通过转移结构联合注意力优化Action-DiT以学习动作相关先验；再以带动作演示的联合视频—动作流匹配后训练控制策略，并用非对称注意力解耦视觉分支与迭代动作去噪，以支持高效动作单独推理。实验显示它在分布内与分布外设置均持续优于既有方法，具有较高动作标签效率，并能泛化到真实机器人。

Insight: 直接从观察视频学习策略的动作先验，减少对动作标注数据的依赖；摘要没有给具体基准成绩或真实机器人任务规模。

Abstract: World action models integrate future visual dynamics with robot action prediction, but their scalability remains limited by the need for action-annotated robot trajectories. Observation-only videos contain rich evidence about interaction dynamics, but existing approaches typically use them either to pretrain visual representations that must later be adapted for control, or to infer latent actions that are subsequently grounded to robot commands. We present NAVA-WAM, which introduces native action-prior learning by directly pretraining the action policy from observation-only videos, avoiding indirect representation-to-control transfer or a separate latent-action model. Our training consists of two stages. First, we pretrain on observation-only videos, where future-video flow-matching supervision over visual transitions is propagated through transition-structured joint attention to optimize the Action-DiT and learn action-relevant priors. Second, we use action-labeled demonstrations to post-train the Action-DiT for robot control through joint video–action flow matching, while asymmetric attention decouples the visual branch from iterative action denoising and enables efficient action-only inference. Extensive experiments show that NAVA-WAM consistently outperforms prior approaches under both in-distribution and out-of-distribution settings, while demonstrating strong action-label efficiency and effective real-robot generalization. These results establish native action-prior learning as an effective approach to directly pretrain action policies from observation-only videos, providing a scalable path beyond action-labeled robot data.

[44] From Patching to Pruning Visual Computation in Vision Language Models cs.CV | cs.LGPDF

Rahul Chowdhury, Timothy A Rupprecht, Xuan Shen, Shaoyi Huang, Pu Zhao

TL;DR: 提出免训练的Patch-to-Prune，通过以中性代理激活替换部分视觉投影计算来降低VLM推理开销，同时保留token序列。

Details

Motivation: VLM每层都处理所有视觉token的注意力和MLP投影，但视觉信息计算在不同深度可能并非都必需；传统token裁剪会改变序列和位置信息。

Result: P2P用验证集引导前向、反向层扫描，找出可在用户指定准确率容差内以固定中性代理激活替代视觉token投影的区域；不删除token、不改权重，也不改变序列长度、顺序、位置编码或注意力掩码。在Qwen2.5-VL和LLaVA四个模型、七个多模态基准上，3%容差时保留约94%的稠密推理准确率，同时减少55% FLOPs。分析显示早晚层常不需token特定视觉计算，中间层承担较多任务相关视觉整合。

Insight: 保留token而绕过部分计算，能在不破坏序列结构的情况下显著减算，并提供视觉信息沿层传递的因果分析视角；效果需依赖校准和验证分区。

Abstract: Vision language models (VLMs) incur substantial inference cost because every visual token is processed by the attention and MLP projections of every decoder layer, even when token-specific visual computation is unnecessary at many depths. We introduce Patch-to-Prune (P2P), inspired by Mechanistic Interpretability, a training-free framework that converts activation patching from a diagnostic tool into an inference-time computation bypass. P2P performs validation-guided forward and backward layer sweeps to identify decoder regions whose visual-token projection outputs can be replaced by fixed neutral proxy activation vectors within a user-specified accuracy tolerance. Unlike conventional token-pruning methods, P2P preserves the sequence length, token order, positional information, attention mask, and residual pathways, thereby pruning computation without removing tokens or modifying the pretrained model weights. We evaluate P2P on four VLMs from the Qwen2.5-VL and LLaVA families across seven multi-modal benchmarks using mutually disjoint calibration, validation, and test partitions. P2P at a 3% tolerance retains around 94% of dense accuracy while reducing FLOPs by 55%. Beyond these efficiency gains, our layer-wise analysis suggests that visual processing in VLMs is non-uniformly distributed across decoder depth: early and late layers often require little token-specific visual computation, whereas intermediate layers appear to perform most task-relevant visual integration, enabling later reasoning to rely largely on visual information already embedded in shared residual and textual representations. This makes P2P both an efficient inference framework and a causal lens into visual information processing in VLMs.

[45] Corrupted but Correct: Why Vision-Language Models Lie to Themselves Internally cs.CV | cs.AIPDF

Arun Josephraj Arokiaraj, Zekun Wu, Adriano Koshiyama

TL;DR: 分析视觉语言模型对抗扰动下训练损失与自由生成行为分离的机制，并将易感差异定位到语言解码器的先验调控。

Details

Motivation: 针对性扰动可令固定目标字幕的教师强制损失接近零，但同一模型自由生成时仍给出原本正确描述；作者称其为训练—推理差距，并希望解释其机制。

Result: 在Qwen2.5-VL-7B-Instruct和200张COCO留出图像的两阶段PGD实验中，像素统计几乎不能预测哪些图像被扰乱（最佳相关r=-0.050、p=0.484；岭回归R²=0.069）。Logit lens把差距定位到单个自回归步：在正确首token条件下，目标token在152,064词表中的排名对所有图像和条件都固定为3,488。追踪28层后发现视觉编码器对表征造成相近扰动，而解码器会对易感样例放大、对抗性稳健样例主动抑制受扰信号（p<0.001，秩二列相关r=0.579）。合并层线性探针区分两类结果的AUC为0.858，但作者指出该估计可能循环论证。

Insight: 该受控攻击结果显示，自回归VLM的对抗稳健性可能主要取决于解码器先验，而不只在视觉编码器；探针AUC存在循环性顾虑，结论依赖特定攻击和模型。

Abstract: A targeted adversarial perturbation can drive a vision-language model’s (VLM’s) teacher-forced training loss for a fixed target caption to near zero, yet the same model, allowed to generate freely, produces the original, correct description with no trace of the target. We call this dissociation the train/inference gap, and give it a precise mechanistic account on Qwen2.5-VL-7B-Instruct using a controlled two-stage PGD attack on 200 held-out COCO images. First, we show that image-level pixel statistics, including a correctly re-implemented, texture-based attackability measure from the CNN robustness literature, have essentially no predictive power over which images are corrupted (best predictor r=-0.050, p=0.484; ridge regression R^2=0.069). Second, using the logit lens, we localise the gap to a single autoregressive step: the rank of the target token, conditioned on the correct first token already being generated, is fixed at exactly 3,488 out of 152,064 vocabulary entries for every image and every condition, with zero variance. Third, tracking target-token rank across all 28 LLM decoder layers reveals that the visual encoder corrupts every image’s representation by a comparable margin regardless of eventual outcome, but the language model decoder then differentially arbitrates: amplifying the corrupted signal for susceptible images and actively suppressing it, past its clean-image baseline, for resistant ones (p<0.001, rank-biserial r=0.579). A linear probe on the merger hidden state separates these two outcomes with AUC=0.858, though we flag a circularity concern in this estimate. Together these results argue that adversarial robustness in autoregressive VLMs is substantially a property of the language decoder’s prior, not the visual encoder, with direct implications for where faithfulness evaluations and defenses for deployed VLM systems should be targeted.

[46] Beyond Entropy: Self-Diagnostic Multi-Role Token Optimization for Video Reasoning cs.CVPDF

Yudong Han, Yong Wang, Zaiquan Yang, Liang Lin, Chongyang Tao

TL;DR: 提出DyCPO，通过动态反事实干预和多角色token依赖度量改进视频推理强化学习的细粒度信用分配。

Details

Motivation: 可验证奖励强化学习的token级归因不明确；高熵启发式容易让视频推理过长、过度探索视觉信号，而固定反事实定位可能忽视决定答案的线索并被无关视觉细节干扰。

Result: DyCPO在token级对比学习中构造多角色依赖指标，平衡视觉探索与答案相关线索提取，抑制仅用于探索的填充token和伪视觉噪声；反事实信号由模型自身成功和失败轨迹动态产生，使优化目标随策略共同演化。在复杂视频推理和一般视频理解基准上，实验显示持续性能提升。

Insight: 联合优化token筛选和自诊断反事实，使信用分配能跟随当前策略错误变化；摘要未给出基准列表、具体模型或增益数字。

Abstract: Reinforcement learning with verifiable rewards has substantially advanced multimodal reasoning, yet it remains fundamentally limited by ambiguous token-level credit assignment. While high-entropy token heuristics encourage possibility exploration, naively extending them to video reasoning tends to induce lengthy reasoning, as the model becomes overly reliant on high-entropy visual activations. Alternative approaches that rely on counterfactual-based visual token localization for credit assignment also tend to over-prioritize visual exploration at the expense of decisive reasoning cues for answer derivation, thereby exacerbating the interference from spurious visual nuances. Moreover, these methods employ static counterfactual strategies that fail to co-evolve with the policy during training. In this paper, we introduce DyCPO, a co-evolutionary framework that jointly optimizes reliable token selection and adaptive counterfactual intervention. It constructs a multi-role dependence metric to balance visual exploration and answer-relevance mining in token-wise contrastive learning, while suppressing exploration-only filler tokens and spurious visual noise. Rather than relying on static counterfactual priors, DyCPO dynamically derives counterfactual signals from the model’s own successful and failed rollouts, enabling self-diagnostic analysis and co-evolution of the optimization objective with the policy. Extensive experiments on complex video reasoning and general video understanding benchmarks demonstrate consistent performance improvements, establishing DyCPO as a robust token-level credit assignment paradigm for multimodal reinforcement learning.

[47] OuroReward: Sequential Reward Scheduling for Reinforcement Learning in Text-to-3D Generation cs.CVPDF

Bingyang Cui, Yujie Zhang, Yiling Xu, Yunfeng Guan

TL;DR: 提出OuroReward，在文生3D强化学习中根据奖励维度间干扰关系顺序调度优化，并自适应选择训练提示。

Details

Motivation: 文生3D需要同时优化语义对齐、纹理清晰等指标，常见多奖励同步聚合未建模维度依赖，可能造成优化不平衡和持续相互干扰。

Result: OuroReward估计维度两两依赖并构建累计干扰较小的循环优化路径，纳入首尾维度的依赖以反映整体兼容性，再转换为从总干扰最低维度起步的一次性顺序。训练依据当前维度剩余优化空间自适应决定何时切换，而非固定预算；AdaSelect进一步选择符合当前模型能力且可靠、有信息量的提示。多个文生3D模型和强化学习算法实验显示，框架能持续改善多个质量维度。

Insight: 按维度关系排程可减少多奖励间的冲突，按当前能力选题则提高更新稳定性；摘要未提供具体质量提升数值与训练开销。

Abstract: Reinforcement learning (RL) for Text-to-3D (T23D) generation requires optimization across multiple quality dimensions such as semantic alignment and texture clarity. Existing methods typically optimize these dimensions simultaneously through multiple reward aggregation, without explicitly modeling inter-dimension dependencies. This can cause imbalanced optimization and persistent interference among conflicting dimensions. To address this limitation, we propose OuroReward, an interference-aware sequential reward scheduling strategy for T23D RL. OuroReward first estimates pairwise dependencies among dimensions and constructs a cyclic optimization path that minimizes cumulative interference. By incorporating the tail-to-head dependency, the cycle captures global compatibility across the entire schedule. Then, OuroReward converts the cycle into a one-pass sequence, and starts optimization from the dimension with the lowest aggregate interference. Rather than assigning a fixed optimization budget to each dimension-wise reward, training adaptively determines when to advance to the next reward according to the remaining optimization headroom of the current one. We further introduce AdaSelect, an adaptive prompt selection strategy that identifies reliable and informative prompts aligned with the model’s current capability. By focusing policy updates on these prompts, AdaSelect effectively improves training stability. Extensive experiments across different T23D models and RL algorithms demonstrate that our framework consistently improves generation quality across multiple dimensions.

[48] A Vision-Language Model (VLM)-based Pipeline for End-to-End Procedural Modeling of Field-Grown Maize from Point Clouds cs.CVPDF

Mozhgan Hadadi, Talukder Z. Jubery, Adarsh Krishnamurthy, Baskar Ganapathysubramanian

TL;DR: 提出从点云重建田间玉米可编辑NURBS程序模型的端到端自动化流程，以VLM标注叶片中心线并由几何算法校正。

Details

Motivation: 作物可编辑三维模型可支持高通量表型分析和模拟育种，但从点云构建器官级参数通常需逐株长时间人工调整或依赖物种专属标注训练的分割模型。

Result: VLM在正交投影视图标注叶片中线，确定性几何算法将标注反投影至点云、跨视图合并叶片，并在朝向加权表面图上延展成完整叶片；器官测量填入植物描述符后生成NURBS模型，再以可微NURBS拟合扫描点精修叶片曲面。在MaizeField3D中100株基因型多样的田间玉米上，全株Chamfer距离中位数为5.4毫米，优于早先半自动人工标注流程；无须将参考标签作为输入，即恢复1,023片整理参考叶中的1,017片（99.4%），IoU至少0.5。

Insight: 让下游几何步骤纠正VLM标注，使其可成为器官级测量并支持规模化可编辑资产生成；实验覆盖100株田间样本，跨作物适用性未验证。

Abstract: Editable 3D models of field-grown crops support high-throughput phenotyping and in silico breeding trials, but building them from scanned point clouds requires organ-level segmentation and fitting. Procedural generators can turn an organ-level parameter set into an analysis-suitable 3D model, but obtaining that set requires hours of manual tuning per plant or segmentation models trained on species-specific labels. We present an automated pipeline that reconstructs procedural maize models from raw 3D point clouds without manual tuning or species-specific training data. A multimodal vision-language model (VLM) annotates leaf midlines in rendered orthographic views. Deterministic geometric algorithms back-project the annotations onto the point cloud, merge them into 3D leaves by cross-view consensus, and grow the midlines to full blades on an orientation-weighted surface graph. Measured organ parameters populate a plant descriptor for a Non-Uniform Rational B-Spline (NURBS)-based procedural model generator. Each leaf surface is then refined against its scan points by differentiable NURBS fitting. The pipeline reached a median whole-plant Chamfer distance of 5.4 mm on 100 genotypically diverse field-grown maize plants from the MaizeField3D dataset. The reconstructions were closer to the scans than those of an earlier semi-automated pipeline based on manual annotations. The pipeline recovered 1,017 of 1,023 (99.4%) curated reference leaves at an intersection-over-union of at least 0.5 without using those labels as input. These results show that VLM annotations become usable organ-level measurements when downstream geometric stages can correct them. This makes automated generation of editable 3D plant assets feasible at the scale of modern phenotyping experiments.

[49] UniDynamics: Event-RGB Fusion for Unified Future 4D Dynamic Scene Generation cs.CVPDF

Daikun Liu, Xin Zhan, Teng Wang, Xiaoping Wang, Changyin Sun

TL;DR: 提出UniDynamics，融合单组事件流与RGB图像生成未来RGB、深度和光流四维动态场景。

Details

Motivation: 从单张RGB外推未来场景时运动先验不足，而既有方法通常需要长时间历史或控制先验；预测还需同时维持几何、运动和外观一致性。

Result: UniDynamics用事件潜变量增强ELE把事件信息对齐为可注入扩散的条件特征，提供初始运动先验及纹理结构线索；多尺度U-Net中的感知动力学空间PDS解耦并自适应交互深度与光流，并向外观特征持续反馈约束。在VKitti2和DSEC实验中，生成高质量、时间连贯且四维一致的未来预测，尤其适用于高速运动模糊场景；摘要称达到当时最佳性能但未给出具体指标数值。

Insight: 事件流为单帧未来外推提供运动线索，联合建模几何和运动可提高物理合理性；具体收益大小及对基准的提升数据未在摘要中报告。

Abstract: We propose UniDynamics, a diffusion-based framework for future 4D dynamic scenes (RGB, depth, and optical flow) generation from a single event-RGB pair, without requiring long histories or control priors as in existing methods, while explicitly modeling future motion fields. The core idea is to leverage event streams to offer an alternative motion prior for single-RGB extrapolation, and to enforce geometric and motion constraints throughout generation via multimodal modeling. Specifically, we design an Event Latent Enhancement (ELE) module to align and enhance event latents into diffusion-injectable conditioning features, providing robust initial motion priors and reliable texture/structure cues. We further introduce a Perceptual Dynamics Space (PDS) embedded in the multi-scale U-Net, which decouples and adaptively interacts depth and flow while continuously feeding back constraints to appearance features, improving geometric-motion consistency for physically plausible and spatiotemporally coherent prediction. Experiments on VKitti2 and DSEC demonstrate state-of-the-art performance, producing high-quality, temporally coherent, and 4D-consistent future predictions, especially under challenging high-speed motion blur.

[50] Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation cs.CV | cs.AIPDF

Ziyi Wang, Junchi Yao, Heqian Qiu, Wenbo Shi, Chengjiu Wang

TL;DR: 提出免训练的Weave Forcing，将长视频提示拆成角色与背景语义槽，并从不同历史片段路由互补记忆。

Details

Motivation: 自回归长视频生成虽有时间连贯性，但交互叙事的新镜头可能要组合不同历史镜头的角色与背景；整句检索会忽略组件差异，直接合并全部记忆又会引入无关内容。

Result: LLM先把提示分解为角色和背景描述并分别选取历史参考；掩码记忆编织利用语义槽条件注意力图构造精细语义掩码，从压缩KV记忆选择相关token指导当前镜头。覆盖自适应RoPE根据无、部分或完整参考覆盖调整时间偏移和保留策略，以处理不完整历史参考靠近当前生成时的伪影。实验显示其提升跨镜头主体与背景一致性，同时保持有竞争力的视觉质量和文本对齐。

Insight: 组件级记忆路由比整段检索更适合跨镜头组合叙事；摘要没有给出长视频质量或一致性提升的具体量值。

Abstract: Recent advances in autoregressive video generation have improved temporal consistency over extended durations, yet interactive storytelling requires more than continuous scene extension: a new shot may combine characters and backgrounds from different historical shots. Whole prompt retrieval can overlook the distinct reference needs of individual components, while directly combining all historical memories may introduce unrelated visual content. To address these problems, we present Weave Forcing, a training-free framework for compositional memory reuse in interactive long video generation. First, we use an LLM for semantic slot routing to decompose user prompts into character and background descriptions and explicitly select suitable historical references for each component. To isolate the required content, masked memory weaving uses contrasting attention maps conditioned on semantic slots to construct refined semantic masks, selectively exposing relevant tokens from compressed historical KV memories to guide the generation of the current shot. We further introduce coverage adaptive RoPE to adjust temporal offsets and memory retention according to no, partial, or full reference coverage, addressing visual artifacts observed when incomplete historical references are positioned close to the current generation. Extensive experiments demonstrate that Weave Forcing improves cross-shot subject and background consistency while maintaining competitive visual quality and text alignment.

[51] Feedforward Novel View Synthesis for Heterogeneous Cameras cs.CVPDF

Meng Wei, Cheng Zhang, Boying Li, Yihang Chen, Jianmin Zheng

TL;DR: 提出面向异构中心相机的前馈新视角合成表示，将各类投影视作对共享光线空间的标定采样。

Details

Motivation: 多数稀疏位姿图像新视角合成方法假设上下文和目标使用同一相机类型，难以处理透视、鱼眼和全景相机并存及训练中未见目标投影；patch token内部汇总的光线分布也未被现有相机编码充分表示。

Result: 方法组合token中心相对相机位置编码与局部raymap，显式描述每个token汇总的patch内光线分布；另用光线诱导角坐标的投影感知2D RoPE取代原始图像网格坐标。在ScanNet++异构相机系统上，该方法优于相机条件基线，并展示对全景视图的零样本泛化。

Insight: 显式表示patch内光线分布可缓解不同投影的token化歧义；摘要未报告具体提升幅度和相机配置数量。

Abstract: Feed-forward novel view synthesis has recently shown promising results from sparse posed images, but most existing methods assume that context and target views share a fixed camera family. This homogeneous-camera assumption breaks in practical multi-sensor systems, where perspective, fisheye, and panoramic cameras may coexist and where the target projection may be unseen during training. We study feed-forward NVS across heterogeneous central cameras and identify a key ambiguity introduced by tokenization: a visual token aggregates a projection-dependent bundle of pixel rays, while existing camera encodings mainly expose absolute rays or token-center relations. To address this, we combine token-center relative Camera Positional Encodings and proposed local raymaps, a token-level representation that explicitly describes the intra-patch ray distribution summarized by each token. We further propose projection-aware 2D RoPE, which replaces raw image-grid coordinates with ray-induced angular coordinates so that relative positional reasoning is aligned across camera projections. Together, these components treat diverse cameras as calibrated samplings of a shared ray space rather than separate visual domains. On ScanNet++ with heterogeneous-camera system, our method improves over camera-conditioned baselines under mixed-camera evaluation and demonstrates zero-shot generalization to panoramic views.

[52] Fed-ADApt: Federated Anytime Depth Adaptation for Resource-Aware Medical Image Segmentation cs.CVPDF

Abhijeet Parida, Zhifan Jiang, Pooneh Roshanitabrizi, Austin Tapp, Maria J. Ledesma-Carbayo

TL;DR: 提出Fed-ADApt深度自适应联邦分割框架，让算力不同的医疗机构按预算训练并在部署时动态选择网络深度。

Details

Motivation: 联邦学习可在不共享患者原始数据下协作训练医疗影像模型，但多数方法假设机构算力一致，限制资源受限站点参与。

Result: Fed-ADApt将多深度监督与分层深度聚合结合，支持各站点按本地预算训练，并让全局模型部署时动态选深度。在多站点二维眼底视盘分割与三维脑肿瘤分割中，联邦协作提升分布偏移下的稳健性；三维任务达到完整资源FedAvg性能，二维Dice平均降低4.7%；推理成本分别减少三维19.5%、二维34.5%，最受限站点训练成本降低98%。

Insight: 把训练和推理预算都纳入联邦设计，可让低资源机构参与并保持有竞争力的全局表现；二维任务存在4.7%平均Dice代价，适用性需按任务精度要求权衡。

Abstract: Federated learning (FL) enables collaborative training of medical image segmentation models without sharing raw patient data, yet existing approaches assume a homogeneous compute budget across institutions, limiting participation of low-resource sites. We propose Fed-ADApt, a depth-adaptive federated framework for UNet-based segmentation that jointly addresses low-compute training and inference. Fed-ADApt integrates multi-depth supervision with hierarchical depth-wise aggregation, allowing each site to train according to its local compute budget while contributing to a global model that supports dynamic depth selection at deployment. We evaluated Fed-ADApt on multi-site 2D retinal fundus disc segmentation and 3D brain tumor segmentation. Across both tasks, federated collaboration substantially improves robustness under domain shift. Fed-ADApt matched the full-resource FedAvg performance in 3D and achieved competitive 2D performance with a 4.7% average Dice reduction, while reducing average inference cost by 19.5% in 3D and 34.5% in 2D and substantially reducing training cost by 98% at the most constrained sites. Importantly, Fed-ADApt enables low-resource institutions that cannot train full-capacity models to participate in federations while maintaining competitive global performance under a favorable accuracy to efficiency trade-off. By considering training and inference compute budgets, Fed-ADApt provides a practical and equitable solution for federated medical image segmentation across heterogeneous clinical and edge-enabled imaging environments.

[53] ManifoldSplat: Language-Guided Semantic Shape Editing of 3D Gaussian Head Avatars cs.CVPDF

Antonio Canela, Jordi Sànchez-Riera

TL;DR: 提出ManifoldSplat，在FLAME结构化人脸流形上对单目视频重建的3D Gaussian头部头像进行语言引导的局部形状编辑。

Details

Motivation: 现有文本驱动头像编辑难以精细定位、常将特征纠缠或破坏几何一致性；直接优化无结构高斯点云需逐提示慢速优化，也可能损害身份和可驱动性。

Result: 该端到端框架在FLAME流形编辑以严格保持身份与动画，使用分区解耦条件VAE DeltaRegion前馈预测形状增量，并再优化以恢复跨视角细节。消费级GPU上约90秒重建并编辑头像，渲染约800 FPS；综合评估显示局部提示对齐、几何连贯和身份保持达到当时最佳水平。

Insight: 在结构化人脸参数流形而非无结构高斯云中编辑，可同时保留身份和动画；摘要未报告局部编辑准确率等具体量化结果。

Abstract: High-fidelity 3D head avatars have reached near-photorealistic quality. While recent methods enable text-driven manipulation, they struggle to provide fine-grained localized control, often entangling features or lacking geometric consistency. Modifying geometry through natural language currently requires slow per-prompt optimization or compromises identity and rigging. We present ManifoldSplat, the first end-toend framework for language-guided semantic shape editing of animatable 3D Gaussian Splatting avatars reconstructed from monocular videos. By performing edits within the structured FLAME manifold rather than directly optimizing an unstructured Gaussian cloud, we strictly preserve identity and animation. We introduce DeltaRegion, a per-region disentangled Conditional Variational Autoencoder (CVAE) delivering feedforward shape deltas, alongside a refining stage to recover view-consistent details. ManifoldSplat reconstructs and edits an avatar in ~90 seconds on a consumer GPU, rendering at ~800 FPS. Extensive evaluations demonstrate our approach sets a new state-of-the-art in localized prompt alignment, geometric coherence, and identity preservation. Project page and code: https://a-canela.github.io/manifoldsplat/

[54] Rethinking What to Cache in Few-Step Diffusion Transformers: Solver-Aware Target Selection cs.CV | cs.AIPDF

Shuo Yang, Lihao Fang, Yi Zhang, Haixiang Wang, Xincheng Ye

TL;DR: 提出AutoTarget，先测量候选张量缓存复用误差，再为具体扩散Transformer、求解器及复用计划选择缓存目标。

Details

Motivation: 蒸馏减少采样步数后，相邻步骤间隔增大，跨步复用张量误差上升；现有缓存法通常预先固定复用目标，未考虑模型和求解器差异。

Result: AutoTarget用少量不复用缓存的运行评估每个候选张量的误差并择优，同时分析单步误差对最终样本的影响；对Euler采样识别可保持相同轨迹的目标，并说明储存求解器更新未必如此。蒸馏图像和视频DiT实验显示最优缓存目标随模型、分辨率及求解器变化；方法减少DiT评估次数和缓存存储，画质接近不缓存运行，PixArt-LCM和FLUX.1-schnell校准排序与留出缓存运行一致。

Insight: 缓存目标需针对求解器及部署设置校准，不能假定某种张量普遍最佳；摘要未量化推理加速或存储减少幅度。

Abstract: Diffusion Transformers (DiTs) can generate high-quality images and videos, but generating each sample requires multiple costly DiT forward passes. Two common ways to accelerate DiT sampling are step distillation, which reduces the number of sampling steps, and caching, which skips some DiT evaluations by reusing a tensor computed at an earlier step. Most caching methods decide in advance which tensor to reuse. After distillation, adjacent sampling steps are farther apart. Reusing a tensor across this larger gap introduces more error, so choosing what to cache becomes especially important. We therefore introduce AutoTarget, a method that chooses the cached tensor for a given model, solver, and reuse schedule. AutoTarget uses a small set of runs without cache reuse to measure the error caused by reusing each candidate tensor, then selects the candidate with the lowest error. We also analyze how an error at one reuse step affects the final sample. For Euler sampling, we identify cache targets that produce the same trajectory and show why a stored solver update may not. Experiments on distilled image and video DiTs show that the best cache target changes with the model, image resolution, and solver. AutoTarget reduces DiT evaluations and retained cache storage. Generation quality remains close to the corresponding uncached run. On the tested PixArt-LCM and FLUX.1-schnell settings, its calibration ranking matches the ranking from held-out cached runs. To help others reproduce the method, we provide its core implementation on GitHub at https://github.com/wali1024-offical/AutoTarget.

[55] DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generation cs.CVPDF

Jiahao Zhan, Yan Wang, Yongrui Ma, Qunliang Xing, Ruchang Yao

TL;DR: 提出DuoMatching，以联合帧联合分布和帧边缘分布匹配蒸馏少步视频生成模型。

Details

Motivation: 分布匹配蒸馏可缓解自回归视频漂移，但视觉质量和语义对齐仍有限；仅匹配视频联合分布缺少来自图像生成器的独立逐帧监督。

Result: DuoMatching在联合匹配之外加入边缘匹配，使图像教师提供补充的视觉与语义先验；LatentBridge处理视频学生与图像教师的潜表示差异，Latent Variation Sampling将帧级监督分散到不同时间片以减少重复。实验提升视觉质量、构图和语义对齐，同时大体保留运动动态；人类评测相对所有所评基线偏好率均超过80%。

Insight: 将视频时序联合约束与图像逐帧先验结合，可补足语义和画面质量；偏好结果未给受试者规模和具体生成设置。

Abstract: Streaming video generation has benefited from distribution matching distillation (DMD), which matches the joint distribution of video frames to a video teacher’s approximation of the real video distribution. Although this joint matching mitigates drift during autoregressive rollouts, limitations remain in visual quality and semantic alignment. To address these limitations, we propose DuoMatching, a distribution matching framework that approximates the real video distribution through a unified joint-marginal formulation. On top of existing joint matching formulations, the additional marginal matching objective provides dedicated frame-level supervision from an image generator, transferring complementary visual and semantic priors from it. To apply this frame-level supervision in video generation, we introduce LatentBridge to resolve the latent representation mismatch between the video student and the image teacher. Latent Variation Sampling further distributes such frame-level supervision across distinct temporal segments, reducing redundancy. Experiments demonstrate that DuoMatching improves visual quality, composition, and semantic alignment while largely preserving motion dynamics. Human evaluations show overall preference rates above 80% against all evaluated baselines. The project page is available at https://johnzhan2023.github.io/DuoMatching/.

[56] DEPICT: Scoring Text-to-Image Alignment by Answer Agreement cs.CVPDF

Vasco Ramos, Sandra Godinho Silva, Joao Magalhaes, Ricardo Rei, Pedro Henrique Martins

TL;DR: 提出免训练的DEPICT，用图像问答与文本单独作答的一致性评估文图对齐，并按文本对问题的确定程度加权。

Details

Motivation: 文图对齐评估需识别对象缺失、属性互换、计数错误和否定词忽视；现有微调指标受骨干和数据分布限制，整体指标漏掉细节，而分解式指标固定预期答案会惩罚忠实图像。

Result: DEPICT以图像条件回答和仅文本条件回答的预期一致性替代固定参考答案，并按文本对问题答案的决定程度加权，再将一致性与整体评分融合以补回问题拆分丢失的上下文。否定词准确率由19%提升至88%。在五个基准、三个模型系列的11个骨干上，超过所有所比较免训练指标，并在三个人类相关性基准中的两个超过微调评估器。

Insight: 让评估参考图像和文本各自导出的答案一致性，可降低固定YES偏置并改善否定词检查；在人类相关性比较中仍未在全部基准超过微调指标。

Abstract: Image-text alignment is a core problem in computer vision with applications in caption evaluation, hallucination detection, data curation, and the benchmarking of text-to-image (T2I) generators. As T2I models improve, benchmarking has become demanding, requiring metrics capable of finding a series of issues like missing objects, swapped attributes, miscounts, and ignored negations. Recent work addresses this by fine-tuning evaluators on preference data or by prompting a vision-language model, either holistically with the caption or with decomposed verification questions. However, existing approaches fall short: fine-tuned metrics remain bound to one backbone and training distribution; holistic metrics miss fine-grained details; and decomposed metrics rely on a fixed-YES assumption that penalizes faithful images whenever that assumption fails. In contrast, we propose DEPICT, a training-free metric that replaces fixed reference answers with expected agreement between image-based and caption-only answers, weighting questions by how decisively the caption determines them. By replacing fixed references, our agreement rule increases negation accuracy from 19% to 88%. To recover the context lost during decomposition, DEPICT merges this agreement score with a holistic score. We evaluate DEPICT on five benchmarks and eleven backbones from three model families and find that it surpasses all training-free metrics and exceeds fine-tuned evaluators on two out of three human-correlation benchmarks.

[57] LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generation cs.CV | cs.AIPDF

Ziqi Ma, Shreya Sharma, Mohamed El Banani, Katja Schwarz, Chongjie Ye

TL;DR: 提出LoGo，将全局奖励和空间局部奖励结合，用于提升相机控制长视频生成中的三维一致性。

Details

Motivation: 相机控制视频模型走向更长时域和复杂镜头运动时，物体持续性与场景结构会漂移；对整段视频只给单一奖励，难以准确纠正长时域局部不一致。

Result: LoGo在三个基础模型上融合细粒度归因的局部奖励与保护镜头跟随和视频质量的全局奖励。DL3DV和新建TrajectoryBench评测显示明显优势；方法减少局部物体位移、伪影及全局场景变化。

Insight: 局部空间奖励负责定位三维一致性缺陷，全局奖励则维持整体镜头控制和质量；摘要没有给出具体基准分数与奖励设计细节。

Abstract: Camera-controlled video models are rapidly advancing toward long generation horizons and complex camera control. A key failure mode is 3D inconsistency: as the camera moves, objects lose permanence and scene structures shift. Existing post-training techniques, which assign a single scalar reward to the entire generation, are poorly suited to correcting these inconsistencies over long horizons. We introduce LoGo, which blends global and spatially localized rewards for camera-controlled video models. The local reward provides fine-grained credit assignment, which substantially improves 3D consistency, while the global reward preserves camera following and video quality. Across three base models, LoGo shows a clear advantage on DL3DV and TrajectoryBench, a new benchmark for long-horizon, complex-camera-control generation that current evaluations lack. LoGo effectively reduces local object shifts, artifacts, and global scene changes, illustrating the importance of credit assignment in post-training video models. Project website: https://ziqi-ma.github.io/logo-website/

[58] World Embedding Benchmark cs.CV | cs.CLPDF

Yiqi Liu, Ruifeng Yuan, Yang Wang, Long Li, Fengyu Cai

TL;DR: 提出世界嵌入基准，联合衡量视频表征的物理跨模态对齐与定量物理属性可恢复性。

Details

Motivation: 世界模型和视频生成研究越来越关注物理真实性，但视频嵌入如何编码物理信息及对齐文本仍不清楚。

Result: 基准包含80个类别、8,000个受控模拟案例，覆盖流体、固体、动力学、光学与电磁学，每个渲染视频配模拟器物理标注，用于文视频检索、物理属性回归和同家族视频描述多选配对。预训练全模态嵌入模型检索弱，同族配对接近随机，但冻结视频嵌入上的轻量探针能恢复有用物理信息。继续对比训练提升检索和配对分类，却损害物理属性回归，揭示对齐与数值可恢复性的权衡。用MiniMax-H3生成视频时检索参考可提高物理保真，检索模型越强收益越大。

Insight: 物理文本对齐与嵌入中物理量可恢复性应联合评估，因为优化其中之一可能损害另一项；检索参考提升生成的结果基于所述模拟案例。

Abstract: Physical fidelity has received increasing attention in world models and video generation, yet how video representations encode physical information remains less understood. We introduce the World Embedding Benchmark, comprising 8,000 controlled simulation cases from 80 families spanning fluid mechanics, solid mechanics, dynamics, and optics & electromagnetism. Each case pairs a rendered video with simulation-derived physical annotations, supporting three complementary tasks: text-video retrieval, physical-property regression, and multiple-choice video-description pair classification. We use these tasks to distinguish cross-modal physical alignment from the recoverability of quantitative physical information. Evaluated pre-trained omnimodal embedding models show weak retrieval and near-chance within-family pair classification, while lightweight probes recover useful physical information from frozen video embeddings. Continual contrastive training with physics-specific video-text pairs improves retrieval and pair classification but degrades physical-property regression, revealing a trade-off between alignment and quantitative information recoverability. Finally, we use the embeddings to retrieve reference videos for retrieval-augmented generation with MiniMax-H3. Retrieved references improve the physical fidelity of generated videos, with stronger retrieval models yielding larger gains in our experiments. Together, these findings highlight the need to evaluate physical alignment and property recoverability jointly, and demonstrate the utility of physical representations for improving video generation.

[59] FlowHMR: Physically Plausible Motion Capture from Video cs.CVPDF

Zhanke Wang, Chengfeng Zhao, Qing Shuai, Jingzhong Lin, Heng Li

TL;DR: 提出FlowHMR，把单目视频三维动作捕捉视为视频条件动作生成，并用视觉忠实度与物理可跟踪性奖励后训练。

Details

Motivation: 单目视频深度运动存在歧义，直接几何回归容易趋向平均姿态，也不保证物理合理，导致物理控制器难以跟踪。

Result: FlowHMR先用流匹配模型生成多样动作候选，再以GRPO后训练：忠实度奖励约束动作符合视频，跟踪奖励偏好物理控制器可成功跟踪的动作。作者提出约4,000条网络视频的Wild-4K用于野外动作恢复评估。在该数据集的定量和定性实验中，整体动作忠实度超过当时最先进方法，物理跟踪成功率为82.47%，高于最强基线GVHMR的62.82%。

Insight: 结合视觉条件与物理控制可在动作恢复中同时约束内容忠实和可执行性；摘要未给出忠实度提升的具体数值。

Abstract: We present FlowHMR, a framework for recovering physically plausible global 3D human motion from monocular video. Previous learning-based methods typically regress human motion directly from video and train the network with geometric supervision. However, recovering human motion from monocular video is inherently ambiguous in depth, and direct regression tends to collapse toward an averaged solution. Moreover, the recovered motions are not guaranteed to be physically plausible, so physics-based tracking of them often fails. To address these challenges, we formulate video motion capture as a video-conditioned motion generation problem and first pretrain a flow matching model for this task. Given an input video, the pretrained model generates diverse motion candidates, but not all of them are faithful to the video or physically trackable. We therefore post-train the model using Group Relative Policy Optimization (GRPO) with two rewards. A fidelity reward encourages consistency with the input video. A tracking reward favors motions that a physics-based controller can track successfully. Together, these rewards shift the model’s output preference, so the post-trained model stays faithful to the input video while producing more physically plausible motion. We further introduce Wild-4K, a large and diverse dataset of about 4K internet videos, for evaluating human motion recovery in the wild. Qualitative and quantitative experiments on Wild-4K show that our method outperforms state-of-the-art methods in overall motion fidelity and achieves a physical tracking success rate of 82.47%, compared with 62.82% for the strongest baseline, GVHMR.

[60] Decoding the Functional Roles of Register and High-Norm Patch Tokens in Vision Transformers cs.CVPDF

Neel Varma, Andrew Rufail, Dipika Khullar, Vasu Sharma

TL;DR: 通过稀疏自编码器分析DINOv2视觉Transformer的register token与高范数patch token特征，揭示两者功能分工。

Details

Motivation: register token被用于减少背景区域出现的高范数异常patch token，但两类token所编码的语义和功能尚未明确。

Result: 作者在DINOv2的register与异常token激活上训练稀疏自编码器，结合自动解释、UMAP聚类和CLIP空间交叉检查。register特征更常关联高层语义，异常token特征则偏向低层结构、背景和纹理模式。因果消融中，破坏高激活register特征使表征余弦相似度下降48.17%，破坏异常特征仅下降0.31%。

Insight: 结果支持自监督ViT中的token专门化，并表明register特征对整体表征更具功能性；解释标签依赖自动化分析及CLIP交叉检查。

Abstract: Self-supervised Vision Transformers (ViTs), such as DINOv2, learn rich visual representations, but the functions of their internal tokens remain poorly understood. Recent architectures introduce dedicated register tokens to reduce high-norm out- lier patch tokens that emerge in background re- gions, yet the semantic and functional roles of both token types have not been fully established. In this paper, we analyze these roles by training sparse autoencoders (SAEs) on register-token and outlier-token activations in DINOv2. Using an automated interpretability pipeline, UMAP clus- tering, and CLIP-space cross-checks, we find that register-token features are more strongly associ- ated with high-level semantic concepts. Outlier- token features, by contrast, are more often associ- ated with lower-level structural, background, and texture-dominant patterns. Causal ablations fur- ther reveal a substantial functional asymmetry: disrupting top-activating register-derived features produces a 48.17% drop in representation cosine similarity, whereas disrupting outlier-derived fea- tures produces only a 0.31% drop. Together, our results provide evidence for token specialization in self-supervised ViTs.

[61] 4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes cs.CV | cs.AI | cs.GRPDF

Ruihong Shen, Žiga Kovačič, Peter Kulits, Xingrui Wang, Zizhang Li

TL;DR: 提出4DCodeBench，评测代理能否通过生成可执行图形代码，从视频重建动态场景及其物理演化。

Details

Motivation: 动态场景逆图形要求代理从视觉中归纳紧凑场景结构和动力学，并通过物理模拟复现形变、流体流动、断裂等复杂行为；静态重建能力未必能转化为此类动态建模能力。

Result: 基准由真实视频及覆盖多种物理现象的合成场景构成，要求模型输出可执行图形程序。对前沿模型的全面评测发现，较强静态重建能力尚不能带来可靠的复杂动态场景重建。

Insight: 代码生成形式的4D逆图形可以检验代理是否理解世界动态，而非只拟合静态外观；摘要未列具体模型排名或指标数值。

Abstract: We introduce 4DCodeBench, a benchmark for 4D inverse graphics through code generation, in which agents reconstruct dynamic scenes from video as executable graphics programs. To accomplish this, agents must translate visual observations into compact representations of scene structure and dynamics, by implementing abstractions such as physical simulations to reproduce complex behavior. To evaluate this capability, we curate a set of real-world videos and construct synthetic scenes spanning diverse physical phenomena, including deformation, fluid flow, and fracture. We perform extensive benchmarking of frontier models, finding that strong static reconstruction capabilities do not yet translate into reliable reconstruction of complex dynamics. 4DCodeBench provides a testbed for tracking progress toward agents that can interpret the dynamics of the world through code. Our benchmark is available at https://github.com/4DCodeBench/4DCodeBench

[62] ProAR: Learning Prospective Reasoning with Autoregressive Video Models cs.CVPDF

Linghui Shen, Tinghui Zhu, Sheng Zhang, Muhao Chen

TL;DR: 提出ProAR，将自回归视频生成改造成目标导向推理：用目标帧引导中间状态，并让当前表征预先对齐未来动态。

Details

Motivation: 自回归视频模型以预测下一块为主，倾向短视反应；推理型生成需要达成长程目标并经过合理中间状态，而非只保证局部画面自然。

Result: ProAR用非对称注意力把目标帧预测纳入自回归循环，使目标帧能指导中间状态且不被中间生成干扰；未来表征自对齐则在训练时通过教师强制一次前向提取未来表征，借轻量预测器指导当前隐状态预期后续动态。两者结合稀疏显式目标监督和密集隐式逐步指导，在多种视觉推理基准持续改善；只用25%训练步数即超过完整训练的标准自回归基线，也展现具身推理应用潜力。

Insight: 长程目标监督和未来状态预期互补，可让视频生成沿连贯中间过程达成目标；具身任务应用目前在摘要中只是潜在方向。

Abstract: Autoregressive (AR) video models excel at causal generation, but their reliance on next-chunk prediction confines them to a short-sighted, reactive paradigm. This limitation is particularly consequential for reasoning-oriented generation, where achieving a target outcome through valid intermediate states matters more than local visual plausibility. To address this challenge, we propose Learning Prospective Reasoning with Autoregressive Video Models (ProAR), a novel framework that transforms autoregressive video generation into a goal-oriented reasoning process. ProAR introduces two key components: (1) To anchor generation to the long-range outcome, we integrate goal-frame prediction into the autoregressive loop via an asymmetric attention mask, enabling the predicted goal frame to guide the generation of intermediate states without being disrupted by them. (2) To guide short-range transitions, we introduce future representation self-alignment to encourage current hidden states to anticipate upcoming temporal dynamics. By leveraging teacher-forcing in AR training, we extract clean future representations in a single forward pass and align current representations with them using a lightweight, training-only predictor. Together, these two mechanisms seamlessly combine explicit, sparse target supervision with implicit, dense step-wise guidance, promoting coherent, goal-directed reasoning progress with modest computational cost. Experiments show that ProAR’s complementary components consistently improve performance across diverse visual reasoning benchmarks. The framework proves highly training-efficient, surpassing fully trained standard AR baselines using only 25% of the training steps. This paradigm also demonstrates promising applicability to embodied reasoning tasks.

[63] MoSE3: Learning World-Space SE(3) at Every Pixel cs.CVPDF

Jiahuan Cheng, Zhiyi Li, Tian Xia, Ruojin Cai, Yilun Du

TL;DR: 提出MoSE3，从单目RGB视频直接预测每像素世界坐标系下的完整六自由度刚体运动。

Details

Motivation: 稠密点跟踪只描述每像素三维平移，缺少部件旋转及哪些像素共同运动的信息；直接回归SE(3)又受旋转流形非欧几里得性和标注困难影响。

Result: MoSE3先联合预测三维点轨迹和刚性嵌入，再对软刚性簇可微拟合变换，端到端恢复每像素SE(3)。为弥补训练数据不足，作者构建含可动关节物体及丰富物理交互、具有稠密SE(3)和刚性标签的Art-Kubric合成数据集。模型在刚体和可动关节基准的像素、部件、物体级SE(3)估计上达到当时最佳，在三个数据集上三维点跟踪准确度也达到最佳；仅用合成运动训练仍能泛化到真实视频。

Insight: 将点轨迹与刚性分组组合可避免直接回归复杂旋转，并从平移追踪扩展到部件级刚体运动；真实世界泛化由合成训练结果支持。

Abstract: Dense 3D point tracking has been a prominent paradigm for modeling motion in dynamic scenes, but a point track is just a 3-DoF translation curve per pixel: it captures where pixels go, not the rotation of the underlying part, nor which pixels move together as one body. We propose MoSE3, the first feed-forward model that predicts dense SE(3) motion from monocular RGB video, producing full 6-DoF rigid transforms at every pixel in world space. Per-pixel SE(3) motion offers a richer view of how a scene moves: rotation, translation, and grouping all at once. Directly predicting SE(3) is challenging: rotations lie on a curved manifold that is ill-suited to Euclidean regression, and annotations for SE(3) are particularly difficult to acquire. To address these challenges, MoSE3 predicts per-pixel SE(3) through two jointly learned intermediates, 3D point tracks and rigidity embeddings, and recovers SE(3) by differentiably fitting transforms within each soft rigid cluster, enabling end-to-end prediction and supervision. To close the data gap, we introduce Art-Kubric, a large-scale synthetic dataset with dense SE(3) and rigidity labels for articulated objects with rich physical interactions. MoSE3 achieves state-of-the-art SE(3) estimation at pixel, part, and object levels on both rigid and articulated benchmarks, and state-of-the-art average 3D point tracking accuracy across three datasets, while showing strong generalization to real-world videos despite being trained solely on synthetic motion data.

cs.CL [Back]

[64] APDMem: Agent-Controlled Progressive Disclosure for Query-Adaptive Long-Term Memory cs.CL | cs.AIPDF

Chin-Lun Fu, Anagha Kulkarni, Hong Ni, Behrouz Madahian

TL;DR: APDMem将对话历史分成主题摘要、个性事实、轮次证据和原始消息四层，让控制器按问题难度逐级展开记忆。

Details

Motivation: 个性化助手需从长对话中找稀疏证据，平面存储或固定检索粒度难兼顾简单问题的低成本与复杂时间、多跳、精确证据问题的保真度。

Result: 控制器先读摘要，仅在需要时深入更细证据；证据综合器会按查询整理事实、排序事件并标记矛盾。在LongMemEval上，APDMem表现强，同时仅访问全部对话的8%。

Insight: 渐进披露让查询成本随所需证据深度变化，避免每次都读取完整历史。回答前的结构化证据合并还可降低时间顺序和矛盾处理错误。

Abstract: Personalized LLM assistants must recover sparse evidence from long conversation histories across queries of varying complexity. We introduce APDMem (Agent-controlled Progressive Disclosure Memory), a hierarchical long-term memory architecture that applies progressive disclosure to memory retrieval. Rather than relying on a flat memory store or fixed retrieval granularity, APDMem represents conversation history as four progressively detailed layers: thematic summaries, personalized key facts, turn-level evidence notes, and raw messages. At inference time, a controller applies progressive disclosure to the memory hierarchy: it first reads high-level summaries and drills into finer evidence only when needed. This creates an adaptive cost-fidelity trade-off: simple queries can terminate early, while complex temporal, multi-hop, or exact-evidence queries trigger deeper inspection. A note synthesizer converts retrieved evidence into a query-focused structure that consolidates facts, orders events, and flags contradictions before final answer generation. Experiments on LongMemEval show that APDMem achieves strong performance for long-context memory reasoning while accessing only 8% of the total conversations.

[65] Counterexample Generation via Per-Theorem Symbolic Verifiers: When Imitation Hurts and Reinforcement Repairs cs.CL | cs.AIPDF

Omar Farouk Zouak, Houssam Eddine Boukhalfa, Soumaya Lakehal, Shiv Katiyar, Samia Nefti-Meziani

TL;DR: SymCE把反例生成建模为对确定性定理验证器输出见证，并用验证结果作为可执行奖励训练模型识别并推翻错误猜想。

Details

Motivation: LLM常能正向证明定理却无法否定相邻的错误命题，SFT不仅难弥补这一证伪差距，还可能进一步削弱对真定理的识别。

Result: SymCE发布4,707个本科代数和实分析错误猜想及可执行验证器。Qwen3-4B先做反例SFT后，真定理识别率从0.27降至0；再用稀疏终局奖励GRPO则修复并提升至0.66，四个种子和Gemma-3-4B复现。稀疏与密集奖励域内成功无显著差异，但留出校准探针差33点。4B模型超过所有评估的7B开源数学专用模型，并迁移到GSM8K、MATH-500和大学数学MMLU；177个验证器判断人工审计准确率97.7%。

Insight: 模仿反例可能让模型把“找反例”泛化过度，强化学习验证奖励则帮助恢复正误区分。奖励密度还会影响校准迁移，不能只用训练内成功率选奖励。

Abstract: Large language models often solve a theorem forward yet fail to disprove a closely related false one: a falsification gap that supervised fine-tuning does not close and can actively worsen. We frame counterexample generation as constrained witness emission against a deterministic per-theorem Python verifier, and release SymCE, a corpus of 4,707 false undergraduate-algebra and real-analysis conjectures, each paired with executable verifiers. The verifier also serves as the reward function, making SymCE a training environment. Training Qwen3-4B with SFT followed by GRPO under this oracle reveals an imitation trap: counterexample-only SFT collapses true-theorem recognition from 0.27 to 0.00, while RLVR with a sparse outcome-only reward repairs this and exceeds the base, to 0.66. The collapse replicates across four seeds and on Gemma-3-4B. Sparse and dense rewards yield statistically indistinguishable in-domain success yet diverge by 33 points on a held-out calibration probe, a dissociation we trace to the partial-credit term. Our 4B model outperforms every evaluated 7B open-weights math specialist, remains competitive with six frontier commercial APIs, and transfers under unchanged prompting to GSM8K, MATH-500 and MMLU-college-math. A human audit of 177 verifier decisions finds 97.7% accuracy. Code, data, verifier modules and annotations: https://github.com/ce-rlvr/SymCE.

[66] Learning When to Commit from Partial Speech for End-to-End Simultaneous Speech Translation cs.CLPDF

Hieu Hoang, Amittai Axelrod

TL;DR: 研究用完整及部分波形的自生成翻译构造前缀监督，训练模型在源语音未结束时输出文本，并通过置信度控制质量—延迟取舍。

Details

Motivation: 同步语音翻译需在输入完整前输出有用文本并保持已提交词元不变；传统完整话语训练无法教会模型何时在不完整证据下提交。

Result: 在FLEURS和CoVoST2三个语言方向上，前缀适配改善未适配模型的质量—延迟前沿，置信度控制提供最广且稳定的工作区间，多轮追加式解码在低延迟下通常更强。多轮训练使提交校准误差整体下降63%—68%，早期前缀下降68%—80%；更密合成间隔有时降低延迟，但过大间隔损害翻译质量和校准。

Insight: 何时提交是可学习的决策，需把质量、延迟和前缀置信度共同优化。前缀密度收益非单调，多轮追加解码更适合低延迟场景。

Abstract: Simultaneous speech translation must emit useful target text before the source is complete while preserving every committed token. We adapt a full-utterance speech language model using prefix supervision derived from its own complete- and partial-waveform translations, requiring neither transcripts nor human translations. We compare single-turn forced-prefix and multi-turn append-only decoding, use a confidence threshold to control the inference-time quality–latency trade-off, and vary the density of training prefixes with a separate synthesis margin. On FLEURS and CoVoST2 in three language directions, prefix training improves quality–latency frontiers over the unadapted model, and confidence provides the broadest consistently competitive operating range. Multi-turn decoding is generally stronger at low latency; under multi-turn training, commit-calibration error falls by 63–68% overall and 68–80% at early prefixes, whereas single-turn training provides only modest overall calibration gains and no early-prefix improvement. A small synthesis margin sometimes extends the frontier to lower latency, particularly on shorter utterances, while a larger margin degrades translation quality and calibration. Prefix adaptation therefore improves simultaneous speech translation, especially under multi-turn append-only decoding, while synthesis density introduces a non-monotonic quality–latency trade-off.

[67] Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks cs.CLPDF

Fahmid Shahriar Iqbal, Ritam Dutt, Soumitra Das, Arnav Verma, Sagnik Ray Choudhury

TL;DR: 研究按任务能力迁移、域偏移、对抗扰动、组合性和长度变化五方面，系统评估LLM时间与事件表达抽取的跨维泛化。

Details

Motivation: 时间及事件表达抽取仍受标注歧义、领域依赖和模型行为不稳定影响；只报告同分布表现无法揭示部署时的可靠性。

Result: 比较多个模型家族、架构和推理策略后发现，基础任务表现较强通常对应更好泛化，但严重分布变化下这种关系减弱。归纳式提示在域偏移、对抗扰动、组合性和长度扩展上表现最一致；模型规模、架构及演绎或溯因提示带来的收益则依维度变化。

Insight: 时间抽取泛化无法由单一维度或同分布准确率预测，评估需覆盖多种变化并选择跨维稳健策略。

Abstract: Time and event expression extraction are fundamental temporal reasoning tasks, but the problem remains difficult due to annotation ambiguity, domain sensitivity, and unstable model behavior. Existing evaluations focus on in-domain performance, offering limited insight into reliability under distribution shifts. We evaluate multiple model configurations across families, architectures, and reasoning strategies over four dimensions of generalization, examining transfer from base performance, cross-dimensional correlations, and the effects of scale, architecture, and prompting. This provides a systematic study of how prompted LLMs generalize in time and event expression extraction tasks. We find that strong base-task performance generally predicts better generalization. However, this relationship weakens under substantial distribution shifts. Inductive prompting performs most consistently across domain shift, adversarial perturbations, compositionality, and length increase, while gains from scale, architecture, and deductive and abductive prompting strategies are uneven and dimension-specific. We conclude that LLM generalization in temporal extraction tasks cannot be predicted from any single dimension alone and cannot be reliably inferred from in-domain or single-dimension evaluations, highlighting the need for reasoning strategies that generalize across dimensions.

[68] Large Language Continuous Diffusion Models cs.CL | cs.AI | cs.LGPDF

Zhihan Yang, Wei Guo, Jean-Marie Lemercier, Simon Welker, Yonggan Fu

TL;DR: Sigma构建3B和8B连续扩散语言模型，在低维可引导ODE/SDE轨迹中联合去噪词元嵌入并学习嵌入几何。

Details

Motivation: 离散扩散可并行解码，但高维非平滑空间不利于推理轨迹控制和加速；连续状态有望实现可引导、低步数生成。

Result: Sigma以似然优化分块训练，从自回归权重热启动，并发现无分类器引导和分数温度对高保真推理、编码至关重要。在数学和代码评测上，预训练后于GSM8K、Minerva、HumanEval、MBPP等标准基准可与离散扩散及AR模型竞争；SFT后在MATH-500和AIME等难题上也具竞争力。潜空间引导可调质量—多样性，连续轨迹在低NFE下平滑退化并支持高效蒸馏。

Insight: 连续潜轨迹提供比离散词元链更易控制的推理空间，并可能改善低步数生成。当前性能达到竞争水平，摘要未声称全面超过离散或自回归基线。

Abstract: Despite the success of discrete diffusion language models (dLMs) for fast parallel decoding, their non-smooth, high-dimensional space hinders trajectory steering for reasoning and inference acceleration. To overcome this, we present Sigma, the first large-scale (3B/8B) continuous dLM built on steerable, low-dimensional ODE/SDE latent trajectories. Trained blockwise via likelihood optimization, Sigma jointly denoises Gaussian-corrupted token embeddings while learning an optimal embedding geometry. To accelerate training, Sigma leverages pre-trained weights from autoregressive (AR) models for warm-starting. During inference, we identify classifier-free guidance and score temperature as essential for high-fidelity reasoning and coding. Across comprehensive math reasoning and coding evaluations against state-of-the-art discrete counterparts (masked dLMs and AR baselines), Sigma achieves competitive performance with discrete models on standard benchmarks (e.g., GSM8K, Minerva, HumanEval, MBPP) after pre-training and on challenging reasoning tasks (e.g., MATH-500, AIME) after supervised fine-tuning. Beyond performance parity, we uncover key structural properties unique to continuous dLMs: (i) embedding-space steering effectively governs the quality-diversity trade-off, yielding strong pass@k performance and (ii) continuous trajectories enable graceful degradation for low NFEs and efficient distillation. These establish continuous dLMs as a promising paradigm for efficient language generation.

[69] EpiWorld: Grounding LLM Policy Agents in Epidemiological World Models cs.CLPDF

Zeeshan Memon, Yiqi Su, Kai Shu, Naren Ramakrishnan, Liang Zhao

TL;DR: EpiWorld把LLM政策代理接入动作条件流行病世界模型和公共卫生技能库，通过快速反事实模拟比较并修订干预方案。

Details

Motivation: 流行病干预政策需用自然语言解释、论证和修订，但普通LLM缺乏传播动力学、定量监测信号和制度约束，难判断政策后果及行动可行性。

Result: 框架从候选干预预测区域疫情演化，并把模拟结果和事后复盘提炼成可复用经验，同时保持协议限制固定。在回顾性COVID-19和流感数据上，世界模型的分布外Peak-MAE优于全部预测基线；闭环策略较RL和最优控制基线，跨数据集住院累计量最高降低59%，六个LLM骨干平均约降低16%。

Insight: LLM适合解释和选择政策，但量化后果应由动力学模型提供，技能库则固定制度约束并积累经验。反事实闭环可在可解释控制下提升干预效果。

Abstract: Epidemic intervention policies are textual artefacts that human decision-makers interpret, justify, and revise through natural language, making large language models a natural candidate for epidemic policy reasoning. A naive LLM, however, lacks the epidemic dynamics needed to project intervention consequences, the quantitative surveillance signals required to assess severity, and the institutional constraints that define admissible actions. We present EpiWorld, a closed-loop framework that grounds an LLM policy actor in a learned action-conditioned epidemiological world model and a tiered skill library of public-health protocols, surveillance tools, and adaptive lessons accumulated through after-action analysis. Given a candidate intervention, the world model predicts regional epidemic evolution and enables fast counterfactual rollouts that provide feedback for policy selection and refinement. Outcomes of simulated futures are distilled into reusable lessons while protocol constraints remain fixed, allowing the decision process to improve without sacrificing interpretability or controllability. We evaluate both the world model and the end-to-end framework on retrospective COVID-19 and Influenza datasets: the world model achieves the best out-of-distribution Peak-MAE among all forecasting baselines, and the closed-loop framework reduces cumulative hospitalisation by up to 59% across datasets and by an average of ~16% across six LLM backbones, outperforming reinforcement-learning and optimal-control policy baselines.

[70] Beyond Correctness: Resolving Underspecification in Agentic Text-to-SQL cs.CLPDF

Wen-Zhi Li, Yue Gong, Konstantinos Kanellis, Balakrishnan Murali Narayanaswamy

TL;DR: PlanPool把文本到SQL代理的澄清计划外化为可更新问题池，要求每个已计划问题在提交前明确询问或放弃。

Details

Motivation: 代理可能在复杂查询中默默假定未验证条件，即使偶然返回正确执行结果也未真正解决歧义；一味增加提问能提高准确率，却浪费交互，且代理常放弃已识别的重要澄清。

Result: PlanPool允许交互中追加新发现的歧义，并以明确问题池维持待解决事项。在三个源自BIRD-Interact和Spider的基准上，它持续提高歧义覆盖并减少静默失败，同时保持竞争性执行准确率，优于无约束和仅提示式方法；摘要未给具体数值。

Insight: 识别缺失信息并不够，代理还需可靠维护问题并在作答前逐项解决。外化计划可减少推理过程中的目标遗忘和提前结束。

Abstract: Agentic Text-to-SQL systems can interact with users to clarify underspecified queries before generating SQL. However, a correct execution result does not necessarily imply that the agent has adequately resolved the underlying underspecification: the agent may silently make unverified assumptions that happen to match the intended answer. We show that this behavior is driven in part by premature clarification termination. Although forcing an agent to ask more questions improves execution accuracy, ambiguities are concentrated in earlier interactions, making brute-force questioning inefficient. More importantly, even when explicitly prompted to plan its clarification process, the agent frequently abandons questions that it has already identified as relevant. To address this failure mode, we introduce PlanPool, which externalizes the clarification plan as a mutable question pool. Every planned question must be explicitly asked or dropped before submission, while newly discovered ambiguities can be added during interaction. Across three benchmarks derived from BIRD-Interact and Spider, PlanPool consistently improves ambiguity coverage and reduces silent failures over unconstrained and prompt-based alternatives, while maintaining competitive execution accuracy. Our results highlight an important distinction in agentic reasoning: identifying missing information is not sufficient, and the agent must also reliably maintain and resolve it before committing to an answer.

Ziyang Cheng, Yuhao Wang, Hongcheng Liu, Qimin Wu, Jingru Fan

TL;DR: 提出以纯文本训练为主、少量原生视听强化学习校准感知的全模态推理后训练方案。

Details

Motivation: 全模态推理数据构造和训练成本高；纯文本训练虽能提升多跳推理，却会损害感知能力。

Result: 在Qwen2.5-Omni-7B上，监督微调加强化学习使九项推理分数几何均值较基座提高25.83%，GPU耗时比完整视听训练少56.6%；纯文本合成数据方案提高21.01%。再用输入token约少90%的视听强化学习校准，可使感知恢复至基座以上，并保留纯文本方案推理增益的93.5%。

Insight: 结果表明推理与感知可采用不同训练阶段优化，降低多模态后训练成本；但纯文本阶段本身会造成感知退化，仍需视听数据校准。

Abstract: Improving joint audio-visual reasoning in Omni Large Language Models typically incurs substantial data construction and training costs. Our diagnostics reveal multi-hop reasoning difficulties despite correct answers to all corresponding single-hop questions and suggest partial decoupling in the local optimization of perception and reasoning objectives. This motivates post-training with different emphases on these capabilities. Text-only reasoning training yields gains across data sources, model scales, and families. With the best-performing text-only configuration, supervised fine-tuning followed by reinforcement learning (RL) raises Qwen2.5-Omni-7B’s geometric mean of nine reasoning scores by 25.83% over the base model, outperforming the complete native audio-visual route with 56.6% fewer GPU-hours. Training on data synthesized entirely by a text-only LLM raises this geometric mean by 21.01% without audio-visual data in construction or training. However, text-only training degrades perception. We therefore propose a text-centric post-training paradigm: text-only training provides the main reasoning optimization, and reduced-data native audio-visual RL then refines perception. Refinement uses about 90% fewer input tokens than full-data audio-visual RL, restores perception above the base level, and retains 93.5% of the best-performing text-only pipeline’s reasoning gain.

[72] Clinical Concept Centers in LLMs cs.CL | cs.LGPDF

Aishik Nagar, Abhishek Vaidyanathan, Arun-Kumar Kaliya-Perumal, Elijah Tzen Hsuen Boey, Stefan Winkler

TL;DR: 在11个开放权重语言模型中定位并验证能因果影响临床决策的临床概念中心。

Details

Motivation: 临床模型评估通常只看文本输出，而模型内部表征可能包含未被答案和显式推理表达、却实际驱动决策的信息；临床决策支持尚缺少潜在表征层面的评估。

Result: 研究在全部11个开放模型中发现可定位的临床概念中心，其激活与对应临床叙述相符，并在受限和开放任务中因果影响模型行为。对抗角色提示下模型仍使用相关中心；对齐提示和沿概念中心引导均改善下游临床表现，盲法临床医生验证还发现中心激活与使用可预测医生偏好。

Insight: 内部概念表征可补充输出层评估，并可能用于模型引导；医生偏好预测与模拟部署结果尚不等同于真实临床结局验证。

Abstract: Large language models are increasingly used in clinical settings. However, research into the reliability and performance of these models has focused almost entirely on the language substrate, scoring what the model says. Mechanistic interpretability has found that the latent space carries a higher fidelity of representation than the text: internal representations not only encode substantially more than the output verbalizes, but the stated reasoning also systematically omits features that causally drive the answer. An evaluation of model behavior in terms of mechanistic interpretability has not been explored in clinical decision support. In this work, we extend behavioral evaluation into the latent space and ask whether clinical concepts exist as locatable, causally used representations inside open-weight LLMs. We find dedicated clinical concept centers in the latent space of all eleven open models we test. These concept centers are interpretable, firing only on their aligned clinical narratives, and meaningfully and causally drive model behavior in both constrained and open-ended settings. They are not just analytical representations, but circuits that can be utilized in clinical practice, and we explore their use from the perspective of both evaluation and performance. From the evaluation standpoint, models stay internally coherent and keep using the relevant concept centers even under adversarial role-based priming, while aligned priming improves downstream clinical performance. From a performance perspective, we simulate realistic deployment settings and find that steering models along these centers leads to meaningful downstream improvements. Finally, we conduct a blinded clinician validation and find the activation and usage of these concept centers predicts clinicians preferences.

[73] Adaptive Mutual Distillation for Balanced Multi-Task Post-Training of Large Language Models cs.CLPDF

Baohang Li, Xiaocheng Feng, Yichong Huang, Chengpeng Fu, Wenshuai Huo

TL;DR: 提出自适应互蒸馏AMD，通过短训练探针按任务和迁移方向选择双模型间的蒸馏权重。

Details

Motivation: 多任务后训练需平衡数据量不均的任务；不同平衡策略会形成互补模型，但跨模型监督的效果随任务、迁移方向和训练阶段而变化。

Result: AMD联合训练采用不同任务平衡策略的两个模型，并用共享短探针和任务验证分数调整蒸馏权重。在六个基准、三种LLM骨干上，两模型平均成绩均高于对应监督微调基线和所比较的任务平衡方法；合并模型后，平均成绩较多任务监督微调高2.91分。

Insight: 基于验证表现动态决定知识迁移方向，比固定蒸馏更能利用模型互补性；探针训练及模型合并带来的实际成本未在摘要中量化。

Abstract: Multi-task post-training of large language models (LLMs) aims to improve performance across tasks with unequal amounts of training data. Existing methods focus primarily on balancing task contributions during single-model training. Different task-balancing strategies can produce models with complementary strengths, creating opportunities for mutual distillation. However, the usefulness of cross-model supervision can vary across tasks, transfer directions, and stages of training. We propose Adaptive Mutual Distillation (AMD), a collaborative post-training framework that jointly trains two models with different task-balancing strategies. AMD evaluates candidate adjustments to distillation weights through short training probes shared across tasks, then uses task-wise validation scores to select an adjustment for each task and transfer direction. Across six benchmarks and three LLM backbones, both AMD models achieve higher average benchmark scores than supervised fine-tuning (SFT) baselines trained with the same sampling strategies. They also outperform the task-balancing methods evaluated in our experiments. Merging the two trained models can further improve their average benchmark score while yielding a single model for inference. The merged models outperform multi-task SFT by an average of 2.91 points across the three backbones.

[74] How Robust Is Multimodal Claim Verification to LLM Rewriting? cs.CLPDF

Yun-Ang Wu, Xanh Ho, Andre Greiner-Petter, Sunisth Kumar, Tian Cheng Xia

TL;DR: 评测11个跨五个VLM系列的模型对学术文本改写和单词注入的多模态主张核验稳健性。

Details

Motivation: LLM常改变文本风格，但措辞变化是否会影响模型依据图像等证据核验主张，仍缺少系统研究。

Result: 实验覆盖2B至38B参数模型，采用模拟学术润色的自然改写和单词注入两种方式。多数模型准确率没有显著下降，整体核验比既有评审评分操纵任务更稳定；不过，弱化措辞会在几乎所有模型中造成显著概率偏移，强化措辞影响较弱，语法与流畅度润色影响很小。

Insight: 准确率稳定不代表判断置信度不受措辞影响；主张核验系统仍应关注概率校准，尤其是带保留语气的表达。

Abstract: LLMs are known to introduce stylistic changes into generated text, yet how these stylistic shifts affect model decisions on scientific tasks remains underexplored. In this paper, we focus on multimodal claim verification, where the goal is to determine whether a textual claim is grounded in a given piece of evidence. We apply two rewriting strategies: natural rewriting, which simulates how researchers routinely use LLMs to polish academic text, and controlled injection, which inserts a single LLM-associated word to isolate the effect of vocabulary choice. We evaluate 11 open-weight models spanning five VLM families and ranging from 2B to 38B parameters. We find that models are robust to these modifications: most show no significant drop in accuracy, and compared to prior work on review-score manipulation, verification appears far more stable. However, consistent probability shifts do occur. Hedging-oriented conditions produce significant shifts across nearly all models, while boosting conditions show a weaker effect and general polishing conditions (e.g., grammar correction, fluency improvement) have little effect.

[75] Evaluating VQA in Vision Language Models using Cooperative Principles cs.CLPDF

Monika Shah, Sudarshan Balaji, Somdeb Sarkhel, Sanorita Dey, Deepak Venugopal

TL;DR: 研究违反格赖斯会话准则的问题措辞对视觉问答模型表现的影响，并与人类的语用推理进行比较。

Details

Motivation: 真实提问可能包含多余、含糊或错误信息，而VLM能否像人一样识别并处理这些会话含意尚不清楚。

Result: 研究利用VLM生成违反准则的问题修饰语，评测ChatGPT、Claude、Gemini和Llava。违反准则时，受测模型表现下降；实验还发现模型处理人类生成与AI生成的违规问题时推理有差异。人类实验按任务耗时测得解决模型生成违规问题所需认知努力较低，但模型在此类问题上的准确率更低。

Insight: 模型的问答表现受对话语用条件影响，且与人类处理难度并不一致；摘要未报告具体准确率或样本量，比较强度无法进一步量化。

Abstract: We evaluate the performance of Vision Language Models in Visual Question Answering (VQA) when questions violate Grice’s maxims. To do this, we use VLMs to generate question modifiers that add non-essential, ambiguous or false information and show that in the presence of such violations, the VLMs that we evaluate (ChatGPT, Claude, Gemini and Llava) show diminished performance. Further, we empirically show the difference between how humans reason pragmatically compared to VLMs, and the difference in VLM reasoning when it resolves violations that are human-induced compared to those that are AI-generated. Finally, we show that human cognitive effort (measured through time-on-task in an experiment) is lower for resolving VLM-induced violations, but VLMs themselves perform less accurately in such cases.

[76] Enhancing Biomedical Named Entity Recognition via Multiple Programming Languages Instruction Tuning and Ensemble Method cs.CLPDF

Songtao Li, Yijia Zhang, Jianyuan Yuan, Shidi Zhang, Fengyu Zhang

TL;DR: 提出MITE，以多种编程语言格式进行生物医学实体抽取指令微调，并通过实体级投票集成提高稳健性。

Details

Motivation: 自然语言指令通常把BioNER标注序列化为扁平文本，结构约束有限；高质量标注稀缺，单一输出格式也限制结构多样性，而外部知识库构建成本高。

Result: MITE将指令和实体输出都表示为代码结构，并把每个训练实例转换为Python、C++和Java等语义一致的格式，产生多样监督而不需新增标注或外部知识。推理时按实体级投票合并各格式预测。在六个常用BioNER数据集上，MITE持续优于代表性BERT与LLM基线，并展现跨数据集泛化能力；消融与参数分析支持各组件有效且稳健。

Insight: 程序化结构表示可在固定标注数据下增加监督形式多样性，投票还能缓和格式相关预测波动；摘要没有给出具体分数或提升幅度。

Abstract: Instruction tuning has become a common paradigm for applying large language models (LLMs) to biomedical named entity recognition (BioNER). However, existing instruction-tuning approaches still face two key challenges. First, conventional natural-language instructions typically serialize BioNER annotations as flat textual outputs, providing limited structural constraints for typed entity extraction. Second, high-quality biomedical annotations are limited, and learning from a single serialized output form may restrict structural diversity and reduce model robustness. Although external biomedical knowledge can be introduced to alleviate data scarcity, it often requires costly resource construction. To address these challenges, we propose MITE, a Multiple Programming Languages Instruction Tuning and Ensemble method for BioNER. MITE reformulates BioNER as a structure-to-structure generation task by representing both instructions and entity outputs in code-formatted representations. Specifically, each training instance is transformed into multiple programming-language formats, including Python, C++, and Java, while preserving the same underlying entity semantics. These language-specific representations provide structurally diverse supervision without requiring external biomedical knowledge or additional annotations. During inference, MITE aggregates predictions from different code formats through an entity-level voting strategy, reducing language-specific prediction variance and improving robustness. Experiments on six widely used BioNER datasets demonstrate that MITE consistently outperforms representative BERT-based and LLM-based baselines and exhibits strong cross-dataset generalization. Ablation and parameter analyses further verify the effectiveness and robustness of the proposed components.

Huiqiang Rong, Haoran Luo, Hui Feng, Zhonghong Ou, Kaiwen Xue

TL;DR: 提出无需训练的OmniConfess，通过逐token干预各模态证据并重评分识别和缓解全模态模型幻觉。

Details

Motivation: 文本、图像、音频和视频统一输入的模型可能依据错误证据生成内容；既有推理时缓解方法通常不揭示具体答案由何种模态证据支撑。

Result: OmniConfess固定候选回答，在受控的逐通道证据干预下进行token级重评分，形成token—通道证据依赖报告，并据此保留有依据内容、纠正由无关或矛盾证据驱动的承诺。作者构建含3,540个样例的OmniHalluBench，覆盖六个数据集、文本图像音频视频场景及判断和自由生成任务；实验显示该方法可在异构模态与任务中缓解幻觉。

Insight: 证据归因报告让幻觉缓解更可检查，也提供了跨模态评测基准；摘要没有给出各任务上的具体改进幅度。

Abstract: Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sustains a generated commitment. We introduce OmniConfess, a training-free method for mitigating omni-modal hallucinations. It fixes a candidate response and re-scores it at token resolution under controlled channel-wise evidence interventions, producing a structured token-by-channel confession that reveals the response’s evidential dependence. OmniConfess uses this confession to preserve grounded content and correct commitments driven by irrelevant or contradictory evidence. To evaluate OmniConfess, we construct OmniHalluBench, a 3,540-example benchmark built from six datasets spanning text, image, audio, and video settings and both judgment and free-form generation. Experiments show that OmniConfess mitigates hallucinations across heterogeneous modality and task settings. Our code and benchmark are publicly available at https://github.com/RongHuiQiang/OmniConfess.

[78] Recursive Self-Improvement in Unified Multimodal Models cs.CL | cs.CVPDF

Huijuan Wang, Chufan Shi, Cheng Yang, Yaokang Wu, Taylor Berg-Kirkpatrick

TL;DR: 提出递归跨能力自改进RSI，让统一多模态模型通过可执行程序验证，自举改进图像生成与视觉理解。

Details

Motivation: 统一多模态模型可以生成自身训练数据，但已有自改进多让视觉理解监督图像生成，未充分利用文本与视觉能力互相提供监督。

Result: 每轮模型生成并检查图像、编写针对缺陷的程序，再执行程序并按规格验证；经验证的渲染用于训练图像生成，带标签渲染及正确程序用于训练视觉理解和程序编写。图表任务上，四轮RSI使不同措辞请求的得分从45.7%升至60.2%，而继续训练仅为46.3%；程序验证比例从48.9%升到95.2%，修改图表上的阅读准确率从55.6%升至87.4%。经验证构造贡献了大部分增益，针对失败改进另增加3.5%。

Insight: 把外部程序执行作为可核验信号，可限制自生成数据错误跨轮累积；验证与失败定向改进在图表任务上的结果尚不能直接代表其他视觉生成领域。

Abstract: Unified multimodal models (UMMs) understand and generate both text and images, which lets a model produce its own training data. Existing self-improvement in UMMs keeps supervision on the visual side, where image understanding judges image generation. We propose recursive cross-capability self-improvement (RSI), a training loop in which the text and visual abilities of a UMM supply training data for one another. In each round, the model generates images and reads them to find where it falls short. It then writes programs aimed at these shortcomings, and execution verifies every result against its specification. Verified renders train image generation, while labeled renders and the model’s own correct programs train visual understanding and program writing. Program execution thus acts as a source of truth outside the model, so errors do not accumulate across rounds. We study RSI on charts and build BasicChartBench to evaluate open models early in training. On requests worded differently from training, four rounds of RSI raise the score from 45.7% to 60.2%, while continued training stays at 46.3%. Verified construction carries most of the gain, and targeting the model’s failures adds 3.5%. Along the way, the share of verified programs rises from 48.9% to 95.2%, and the reader’s accuracy on edited renders rises from 55.6% to 87.4%.

[79] HyperThink: Text-to-Parameter Hypernetworks for Efficient Reasoning cs.CL | cs.LGPDF

Donggyun Kim, Jack Lu, Chanwoo Kim, Mengye Ren, Seunghoon Hong

TL;DR: 提出HyperThink，以问题条件化的超网络参数更新替代长思维链的逐token解码开销。

Details

Motivation: 长推理轨迹能提升LLM多步推理，但逐步生成带来高推理延迟。

Result: 轻量超网络读取问题并预测基座模型少量参数的更新，向量量化解码器把更新约束到有限且可复用的模式；训练使用基座模型自身生成的输出。推理时先执行一次超网络，再由适配模型生成简洁分步解答与最终答案，无需中间长轨迹且使用更少token。在数学和通用推理任务的准确率—延迟权衡低延迟区间，HyperThink改善表现，近乎不思考的设置增益最大。

Insight: 把部分推理计算摊销为条件化参数更新，可能降低低延迟推理成本；摘要未提供准确率、延迟具体数值或跨模型规模结果。

Abstract: Long-form thinking traces can substantially improve the multi-step reasoning performance of large language models (LLMs), but they introduce high inference-time overhead, with latency dominated by sequential decoding. We propose HyperThink, a text-to-parameter approach that amortizes this reasoning computation into a single query-conditioned parameter update: a lightweight hypernetwork reads the question and predicts updates to a small subset of the base LLM’s parameters, while a vector-quantized decoder constrains them to a finite set of reusable patterns to improve robustness and transfer. Trained end-to-end on outputs from the base model itself, HyperThink eliminates long thinking traces at test time: after one hypernetwork forward pass, the adapted model generates a concise step-by-step solution and final answer without an intermediate trace, using far fewer tokens while retaining strong reasoning performance. Empirically, HyperThink improves the low-latency region of the accuracy-latency trade-off on mathematical and general reasoning tasks, with its strongest gains in the near-non-thinking regime.

[80] The Geometry of Knowledge Accessibility in Large Language Models cs.CLPDF

Lihu Chen

TL;DR: 发现LLM对查询的内部表征存在知识可及性的中心几何，并据此提出生成前选择推理干预的依据。

Details

Motivation: 语言模型虽储存广泛知识，却不能稳定回忆回答查询所需的信息；需要预测知识能否被提取，而非只依据生成后的答案判断。

Result: 研究发现，仅根据查询在生成前的表征即可观察到简单几何：知识较可及的查询更靠近表征空间中心，不可及查询更远，并形成可及性边界；距离排序在中心不同的数据集间仍能迁移。控制实验显示该几何与知识可及性的关系强于与推理难度的关系。干预效果也随距离而异：改写对较可及查询更有帮助，链式思考对边界附近查询更有帮助，检索对越界查询增益更大。

Insight: 查询表征距离可作为自适应推理的生成前信号，帮助按知识可及性分配改写、推理或检索；摘要未给出模型和基准的详细范围。

Abstract: Large language models (LLMs) contain broad knowledge, but they cannot access all of it reliably. We study this problem through knowledge accessibility, which describes whether the knowledge needed for a query can be recalled from the model. We find that knowledge accessibility has a simple geometric structure in the model’s representation of the query alone, before any generation. More accessible queries are closer to a center in the representation space, while less accessible queries are farther away. This geometry reveals a knowledge boundary that separates more accessible queries from less accessible ones. Accessibility consistently decreases with distance from the center, and this distance-based ordering transfers across datasets even when the centers differ. Controlled experiments further show that the centered geometry is more closely related to knowledge accessibility than to reasoning difficulty. The geometry also reveals when different interventions are useful. Query rewriting helps more for accessible queries, chain-of-thought reasoning helps more near the boundary, and retrieval gives larger gains beyond the boundary. These findings not only provide a new geometric view of how knowledge is organized in language models, but also suggest a useful pre-generation signal for adaptive inference.

[81] HARPO: Hallucination-Aware Reinforcement Learning for Faithful and Creative Language Generation cs.CLPDF

Tiezheng Yu, Yuxin Jiang, Jinpeng Li, Shuning Sun, Fei Mi

TL;DR: 提出HARPO强化学习框架，用无幻觉条件下的写作奖励联合优化语言生成的事实忠实度与创造性。

Details

Motivation: LLM在知识密集任务中容易产生幻觉，而单纯压制幻觉可能损害生成文本的创造性和质量。

Result: HARPO使用可验证反馈训练同时评估忠实度和写作质量的HA-GRM；只有判定无幻觉时才启用写作奖励，并通过课程逐渐转向幻觉相关任务。在RAGTruth上，基于Qwen3-4B的奖励模型响应级F1为78.08%，高于监督微调基线的66.37%。对1.7B至8B的Qwen2.5及Qwen3模型，忠实度与写作质量均提升；Qwen3-4B在MultiHopRAG上的奖励模型判定幻觉率由3.29%降至1.02%，Arena-Hard-v2.0创意写作分数由16.95%升至27.54%。

Insight: 选择性激活写作奖励可避免奖励模型把创造性奖励施加给幻觉输出；核心幻觉率依赖奖励模型判断，外部真实性仍是评价边界。

Abstract: Large Language Models (LLMs) are prone to generating hallucinated content, which compromises their reliability in knowledge-intensive tasks. To address this challenge without sacrificing creativity, we propose HARPO, a reinforcement learning framework designed to jointly optimize faithfulness and creativity. HARPO incorporates a Hallucination-Aware Generative Reward Model (HA-GRM), trained via verifiable feedback, to assess both faithfulness and writing quality. A Selective Activation Mechanism (SAM) activates writing rewards only for outputs judged hallucination-free by HA-GRM, while a data curriculum progressively shifts training from creative writing to hallucination-centric tasks. On RAGTruth, our Qwen3-4B-based HA-GRM achieves a response-level F1 score of 78.08%, compared with 66.37% for the supervised fine-tuning baseline. Experiments on Qwen2.5 and Qwen3 models from 1.7B to 8B parameters show improvements in both faithful generation and writing quality. On Qwen3-4B, HARPO reduces the HA-GRM-judged hallucination rate on MultiHopRAG from 3.29% to 1.02%, while increasing the Arena-Hard-v2.0 creative-writing score from 16.95% to 27.54%.

[82] Ask, Relax, or Act? Evaluating Actionable Indeterminacy in LLM Preference Reasoning cs.CL | cs.AIPDF

Ang Li, Yue Lin, Feifei Kou, Zhan Su, Prayag Tiwari

TL;DR: 形式化LLM偏好推理中的可行动不确定性，评估模型是否应行动、澄清，或以最低成本修复不可行约束。

Details

Motivation: 模型可能意识到不确定，却仍选错下一步：已有可接受行动时仍追问，或面对约束冲突时只澄清而不提出必要调整。

Result: 作者在物品分配、会议安排、公寓选择和稳定匹配任务上构建求解器支持的基准，以配对样例评估决策正确性、配对可靠性和完整回复。结果显示，模型能识别需要澄清或修复的情形，却常在已有合理行动时多余干预；正确的决策标签也不保证后续行动、问题或修复方案可用。明确回复需包含的内容能显著提高完全正确率，并可能改变干预决策，即使输出本来已可解析。

Insight: 可靠代理不仅要识别不确定性，还要判断何时无须干预，并把选择变为可验证回复；输出格式要求会影响实际决策本身。

Abstract: An LLM agent can recognize uncertainty yet still choose the wrong next step: asking when action is already justified, or seeking clarification when the constraints must change. We formalize actionable indeterminacy: act when an accepted action is shared across all admissible preferences or objectives, clarify when each possibility is feasible but no action is shared, and propose a minimum-cost permitted constraint repair when the request is infeasible. We construct a solver-grounded benchmark spanning object allocation, meeting scheduling, apartment choice, and stable matching. Matched pairs retain the same source while changing whether intervention is necessary, and evaluation separates decision correctness, matched-pair reliability, and fully correct responses. Our findings reveal a recurring difficulty in recognizing when intervention is unnecessary: models can identify situations requiring clarification or repair yet still intervene when a justified action already exists. Correct decision labels also fail to guarantee usable actions, questions, or repairs. Crucially, response requirements shape not only how decisions are expressed but also which decisions are made. Making the required content explicit substantially improves fully correct responses and can change intervention decisions, even when outputs are already parseable. These findings highlight that reliable agency requires more than recognizing uncertainty: it requires intervening only when necessary and translating the chosen next step into a verifiable response.

[83] Hindsight-Guided Rationale Distillation for Rare Disease Diagnosis cs.CLPDF

Aarav Singh, Animesh Pathak, Navyansh Singh

TL;DR: 研究利用可见诊断标签生成的教师推理轨迹蒸馏罕见病诊断，并发现收益来自过滤标签污染。

Details

Motivation: 教师生成时看到正确诊断会把标签泄漏进思维链，学生微调可能学到这种捷径而非可迁移的诊断推理；该影响及过滤收益需要量化。

Result: 在ZebraMap上以8B教师轨迹微调1.5B学生。过滤版本StudentF相对教师有小幅但统计显著的准确率优势（p<0.001），且主要集中在样本较充分的疾病；未过滤学生无显著优势（p=0.129）。作者将标签可见导致的“GT幻觉”定位为思维链含“ground truth is X”等语句：未过滤学生推理时33.9%案例复现该语句，错误标签会严重损害准确率；正则过滤使污染近乎归零并带来上述小幅增益。研究还描述知识迁移随疾病频次变化及SFT未消除的校准差距。

Insight: 事后知识蒸馏可能把教师的标签泄漏复制给学生，过滤比单纯蒸馏更关键；绝对准确率仍低，增益小且集中于样本较充分疾病。

Abstract: We study hindsight-guided distillation for rare disease diagnosis on ZebraMap: a 1.5B student is fine-tuned on chain-of-thought traces from a 8B teacher that observes the ground-truth diagnosis during generation. Absolute accuracy remains low for all models - the task is hard at this scale - but within this ceiling a filtered variant (StudentF) achieves a small, statistically significant accuracy advantage over the teacher (p < 0.001), concentrated in better-represented diseases. The unfiltered student does not significantly outperform the teacher (p = 0.129), establishing that contamination filtering - not hindsight distillation alone - drives the gain. The gap traces to an artifact we term GT hallucination. Label-visible generation causes the teacher to embed “ground truth is X” phrases in its reasoning chain; SFT copies the pattern. At inference, the unfiltered student reproduces the phrase in 33.9% of cases, with severe accuracy degradation when the hallucinated label is wrong. A regex filter removing these slots reduces contamination to near-zero, producing the observed gain - though the effect remains small. We precisely quantify this gain-cost tradeoff, document frequency-dependent knowledge transfer absent from the RL-trained teacher, and characterize a calibration gap that SFT does not close - identifying both as directions for future work.

[84] Investigating the Role of Reasoning-Language Alignment in Monolingual Retrieval-Augmented Generation cs.CLPDF

Oliver Hauck, Mario Sanz-Guerrero, Katharina von der Wense

TL;DR: 在德语单语检索增强问答中研究推理语言与查询、检索文档语言对齐的作用。

Details

Motivation: LLM推理训练多以英语为主，强制使用其他语言推理曾在短提示任务中降低准确率；检索增强场景需要读取并整合大量目标语言证据，规律尚不清楚。

Result: 作者构建关于德语桌游《黑暗之眼》虚构世界的单语RAG测试集，使模型必须依赖德语检索而非记忆。将代理RAG系统的强制推理语言设为不同语言后，推理与查询及文档语言一致有益：强制德语优于强制法语，即使模型法语基准水平更高，说明收益来自语言对齐而非熟练度；检索上下文更丰富、结构化时优势增大。但强制德语仍只达到模型无约束的英语原生推理水平，未能超越。

Insight: RAG中的推理语言应考虑证据语言，尤其在丰富且结构化的检索上下文中；单一德语虚构领域测试也显示，强制目标语言尚不能替代原生多语言推理能力。

Abstract: Reasoning traces improve large language models (LLMs), but current models are trained to reason mostly in English. It has been shown that forcing a model to reason in another language degrades accuracy, even when the reasoning language matches the language of the prompt – but only for a setting where the model reasons over a short prompt. Here, we ask whether the same holds for retrieval-augmented generation (RAG), where the model must read and integrate a large amount of retrieved evidence in the target language. To study this, we build a fully monolingual German RAG question-answering testbed over the fictional world of the tabletop role-playing game The Dark Eye, a domain that is richly documented in German but too niche for the model to answer from memory, so that it has to rely on retrieval. Varying the forced reasoning language of an agentic RAG system on this testbed, we find that aligning the reasoning language with the language of the query and the retrieved documents helps. Forced German reasoning outperforms forced French, although the model benchmarks higher in French, so the benefit comes from alignment and not from language proficiency. The advantage grows when the retrieved context is richer and structure-aware. However, forced German only reaches the level of the model’s native, unconstrained English reasoning without surpassing it, showing that native multilingual reasoning is needed. We publicly release the testbed and QA benchmark.

[85] Not Until the Evidence Says So: Teaching LLM Investigators When to Close a Case cs.CL | cs.AI | cs.LGPDF

Tingzhu Bi, Ping Wang, Meng Ma

TL;DR: 构建事故调查基准Nautil并训练LLM调查员依据证据决定结案、保留未决或指出缺失信息。

Details

Motivation: 事故、缺陷和故障调查要求判断已有证据是否足以结案；模型即使找到正确原因，也可能夸大证据或在官方认定原因不明时错误结案，且不同来源本身会泄漏标签。

Result: Nautil含731个来自航空、铁路、海事、化学安全、车辆缺陷和生产服务器事件的审计案例，并含教师轨迹、分布外测试和反事实证据版本。评估结合结案准确率、证据依赖性测试以及结论与缺口质量清单。9B模型经轨迹微调后，移除结论依据使结案率相对匹配对照下降26个百分点，证据夸大率从97%降至35%，正确且不过度断言的结论从3%升至43%。之后仅奖励结案判断的强化学习将平衡准确率从69.2提高到83.3（与教师相当），同来源准确率从60.4升到74.1，但证据依赖性有所下降。

Insight: 应将是否结案与证据依赖、结论质量分别测量，避免来源捷径和正确原因判断掩盖过度断言；结案准确率提升伴随证据依赖性代价。

Abstract: Accident, defect and outage investigations end with a decision that ordinary question answering never faces: whether the evidence gathered so far is enough to close the case. We study this decision for LLM investigators, which request evidence from a case file, revise their hypotheses, and either close the case with a conclusion grounded in what they read or leave it open and name what is missing. This judgment does not come with capability: an untrained 9B model overstates its evidence in 97% of its answers, and a frontier model that identifies the right cause in 84% of cases still overstates in 91% and closes 17 of the 41 cases whose official finding is “cause undetermined”. Measuring it is also non-trivial: the source of a case largely predicts its label, and a rule that reads only the source reaches 83.0 balanced accuracy on our test cases. We therefore evaluate closure with three tests: closure accuracy, reported against this rule and within each source; evidence dependence, which removes the grounds of a conclusion and checks whether the model stops closing; and conclusion and gap quality, a judged checklist of what the model asserts and what it says is missing. We build Nautil, 731 audited cases from aviation, rail, maritime, chemical-safety and vehicle-defect reports and production server incidents, with teacher trajectories, an out-of-distribution test set and counterfactual evidence versions. Fine-tuning a 9B model on these trajectories makes its closures follow the evidence: removing the grounds lowers its closure rate by 26 points relative to a matched control, overstatement falls from 97% to 35%, and correct, non-overstated conclusions rise from 3% to 43%. Reinforcement learning that rewards only the closure decision then raises balanced accuracy from 69.2 to 83.3, on par with the teacher, and within-source accuracy from 60.4 to 74.1, at some cost in evidence dependence.

[86] SyntaxBench: A Statistical Diagnostic Framework for Character-Level Reasoning in Large Language Models cs.CL | cs.AI | cs.LGPDF

Mohsen Larni, Sobhan Ebrahimi Azar, Pouyan Nahed, Kazem Taghva

TL;DR: 提出SyntaxBench及统计诊断框架，评测LLM字符级推理并控制输入、推理模式与多重比较。

Details

Motivation: 字符计数、字母包含和编辑距离等小错误可能影响实际应用，但现有字符级评测多为孤立探针和总体准确率，难以揭示分词与推理设置的影响。

Result: 基准含字符计数、字母包含、回文、编辑距离、最长字符串选择五项核心任务，以及子串抽取压力测试index_to_span；核心任务使用配对英语及字符长度匹配随机字符串，全部任务设置零、一、四样例提示。八个2B至32B开放模型、11种推理配置的评测结合精确/宽松准确率、Cohen κ、配对McNemar检验、置信区间、Kendall τ、分词及校正后的多重比较。随机字符串每token可见字符更多（1.892对3.169），英语词占用token越多字符计数越差；思考模式收益不恒定，Qwen3.6-27B四样例回文准确率从不思考的0.952降至思考时0.886；index_to_span仍困难，最佳四样例精确匹配仅6.75%。

Insight: 字符推理需控制输入可见性并报告配对统计与推理模式，而不能只看总体准确率；分词差异会显著影响任务难度。

Abstract: Large language models are increasingly used where small syntactic errors matter, yet character-level reasoning is still evaluated mostly through isolated probes and aggregate accuracy. We introduce SyntaxBench, a diagnostic benchmark and statistical evaluation framework for character-level reasoning. It contains five core tasks, character counting, letter containment, palindrome detection, edit distance, and longest-string selection, plus index_to_span, a harder substring-extraction stress test. The five core tasks use paired English and character-length-matched random-string inputs. index_to_span documents share a 200-500 word band and are not character-length matched. All six tasks use zero-, one-, and four-shot prompts. We evaluate eight open-weight models from 2B to 32B parameters across 11 reasoning-mode configurations. The framework reports exact-match and relaxed accuracy, Cohen’s kappa, paired McNemar tests with odds ratios, bootstrap confidence intervals, Kendall’s tau, class-conditional metrics, tokenization analysis, and multiple-comparison-corrected tests. Three findings stand out. First, tokenization shapes accuracy: random strings are more character-visible than English strings (1.892 vs. 3.169 characters per token), and character-counting accuracy falls as English words occupy more tokens. Second, reasoning mode is not uniformly helpful: Gemma4-31B is nearly unchanged across modes on the near-saturated tasks, while Qwen3.6-27B is worse with thinking on palindrome detection (0.952 non-thinking vs. 0.886 thinking at four-shot). Third, index_to_span remains largely unsolved; the best four-shot exact-match accuracy is 6.75%. Character-level evaluation needs controlled inputs, paired tests, and analyses of tokenization and reasoning mode rather than aggregate accuracy alone.

[87] Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation cs.CLPDF

Chenglei Shen, Haoyang Yao, Weijie Yu, Song Jin, Xiao Zhang

TL;DR: 提出根因引导在线策略蒸馏RC-OPD，先定位学生推理最早实质性错误并局部修复，再按正确前缀和错误片段分别蒸馏。

Details

Motivation: 传统在线策略自蒸馏用参考解答指导学生轨迹，但参考推理可能解释正确答案却未指出学生为何出错；对全轨迹重复施加事后指导还可能约束原本合理的推理步骤。

Result: RC-OPD对每次失败尝试找出最早实质错误、构造局部修正并锚定有效前缀，再通过学生续写迭代诊断和修复，且修复次数受预算限制。成功修复链上，根因引导蒸馏用错误诊断和纠正目标监督错误片段，锚定引导蒸馏则用导向修正中间结果的推理链支持有效前缀。在多个数据集和模型规模的实验中，该方法缓解推理指导错配与蒸馏陷阱，并取得显著性能提升。

Insight: 把纠错信号对准学生自己的错误，可减少照搬标准解而忽略错误来源的问题；摘要未给出任务列表及具体提升数值。

Abstract: On-policy self-distillation (OPSD) uses reference solutions as privileged hindsight to supervise student-generated reasoning trajectories. However, reference-based guidance may explain a correct solution without addressing why the student’s own reasoning fails. This reasoning mismatch between the guidance provided and the correction needed can encourage the student to borrow correct conclusions while leaving its reasoning errors unresolved. Moreover, applying the same hindsight throughout the trajectory risks a distillation trap, where unnecessary constraints on valid reasoning compete with correction of substantive errors. To address these issues, we propose Root-Cause-Guided On-Policy Distillation (RC-OPD), which uses repairs of the student’s own reasoning to provide guidance that addresses its specific errors while building on valid progress. For each failed attempt, RC-OPD locates the earliest substantive error, develops a local correction, and uses the corrected intermediate result as an anchor for the valid prefix. An iterative diagnosis–repair–continuation process tests the repairs through student continuation, identifying further errors within a fixed repair budget. For repair chains that reach a correct answer, root–cause–guided distillation uses failure diagnoses and corrective goals to supervise the erroneous segments, while anchor-guided distillation supports the corresponding valid prefixes with reasoning chains leading to the repaired intermediate results. We evaluate RC-OPD across multiple datasets and model scales. Extensive experiments and analyses show that it mitigates reasoning mismatch and the distillation trap, yielding substantial performance gains.

[88] CLIMB: Confidence-Guided Complementary Evidence for Multimodal Retrieval-Augmented Generation cs.CLPDF

Hang Gao, Wujiang Xu, Zhixing Zhang, Kai Mei, Jingyi Yang

TL;DR: 提出免训练的多模态RAG框架CLIMB，先检索互补证据，再以置信度控制是否接受答案更新。

Details

Motivation: 多模态视觉问答常需图像和模型知识之外的文本证据；Top-K或重排检索容易返回重复段落，也缺少判断新增证据是否充分支持答案修订的机制。

Result: CLIMB先用类似MMR的目标构建兼顾相关性与去冗余的紧凑证据池，再由评估相关性、证据具体性及跨模态对齐的R/E/C评审器打分；只有证据支持的置信度提高才接受答案更新，形成停止条件且无需修改检索器或MLLM。在Encyclopedic-VQA和InfoSeek上持续优于多模态RAG基线；消融显示互补证据池、评审打分和迭代置信度控制均有贡献。

Insight: 减少冗余证据并要求更新获得置信度支持，可避免无效反复修订；摘要未提供基准上的具体提升幅度。

Abstract: Multimodal large language models (MLLMs) have shown strong visual reasoning abilities, but knowledge-intensive visual question answering often requires external textual evidence beyond the image and the model’s parametric knowledge. Existing multimodal RAG systems commonly rely on Top-$K$ retrieval or reranking, which may return redundant passages and provide limited control over whether an answer update is sufficiently supported by the retrieved evidence. We propose \textit{CLIMB}, a training-free inference-time framework for multimodal RAG. CLIMB first constructs a compact complementary evidence pool using an MMR-style objective that balances query relevance and passage-level redundancy. It then performs confidence-controlled refinement within this fixed pool: an R/E/C critic scores passages by relevance, evidence specificity, and cross-modal alignment, while an evidence-grounded confidence estimator accepts an updated answer only when the estimated confidence increases. This design provides a simple stopping criterion and reduces unnecessary refinement without modifying the underlying retriever or MLLM. Experiments on Encyclopedic-VQA and InfoSeek show that CLIMB consistently improves over retrieval-augmented multimodal baselines. Ablations further indicate that complementary pooling, critic-based scoring, and iterative confidence-controlled refinement each contribute to the final performance.

[89] Writerslogic at PAN 2026: Process over Content for Robust Detection under Domain Shift cs.CLPDF

David L. Condrey

TL;DR: 报告Writerslogic参加PAN 2026三项文本分析任务的系统，并以训练测试分布支持重叠解释域迁移下的特征稳健性。

Details

Motivation: 生成器专属特征在跨领域时容易失效，系统需区分仅适用于特定领域、可迁移及近似领域不变的文本过程特征。

Result: 作者提出特征稳健性取决于训练和测试支持集重叠的框架，并讨论唯一词比例、Yule’s K、Heaps指数、压缩指标及字符n元组等特征。在训练全为数学而84%测试来自未见领域的推理轨迹检测中，Opus-Sonnet一致检测来源获第一，宏F1为0.85；拒绝行为分解的安全分类获第三，宏F1为0.66。Voight-Kampff任务的校准堆叠集成测试成绩0.891，各评估维度平衡子分数为0.853至0.902。多作者风格系统组合频谱聚类、压缩距离和SmolLM-135M困惑度，但平台混淆导致未进入正式评测，因此只报告设计与先验预测。

Insight: 论文的跨域论点由特征分类和两个正式任务成绩支持，但第三项未参赛评分；“过程特征普遍优于内容特征”仍是基于框架的设计主张。

Abstract: We describe the Writerslogic systems for three PAN at CLEF 2026 shared tasks (Reasoning Trajectory Detection, Voight-Kampff Generative AI Detection, and Multi-Author Writing Style Analysis), unified by a shared analytical framework: feature robustness under distribution shift is governed by support overlap between training and test distributions, not by training-set effect size. This yields a taxonomy (domain-anchored, domain-portable, domain-invariant) that explains why generator-specific features die under domain shift while vocabulary fingerprints (hapax ratio, Yule’s K, Heaps’ exponent), compression measures, and character n-grams survive. On Reasoning Trajectory Detection, where training was entirely mathematics and 84 percent of test was unseen domains, the framework guided system design to 1st place in source detection (0.85 macro F1 via Opus-Sonnet agreement) and 3rd place in safety classification (0.66 macro F1 via query-refusal decomposition). For Voight-Kampff, we built a calibrated ensemble of DeBERTa-v2 (ONNX), multi-seed LightGBM with 44 domain-portable stylometric features, and SVM on n-gram TF-IDF, combined via learned stacking with isotonic calibration; the best configuration achieved 0.891 on the PAN 2026 test set with balanced sub-metrics (0.853 to 0.902 across all evaluation dimensions). For Multi-Author Writing Style Analysis, we describe a system fusing spectral clustering over character n-gram similarity graphs, normalized compression distance for local boundary detection, and SmolLM-135M perplexity for neural change-point detection; a platform mix-up meant our run never reached the official evaluation, so we report the design and its a priori predictions. Across all three tasks, features measuring generation process properties are designed to outperform features measuring generated content properties under domain shift.

[90] Author Representation Strategies for Zero-Shot Authorship Attribution: A Comparative Study of LLM-Based and Embedding-Based Approaches cs.CLPDF

Nudrat Habib, Tosin Adewumi, Sana Sabah Al-Azzawi, Marcus Liwicki, Elisa Barney

TL;DR: 比较零样本作者归属中的多种作者表征，发现作者特征表示优于仅标签提示，两阶段LISA嵌入方案总体最佳。

Details

Motivation: 零样本作者归属需要捕捉细粒度写作风格，却没有任务专属监督；不同作者表征方式对LLM提示和嵌入式相似度的作用尚需比较。

Result: 研究比较仅作者标签提示、代表性写作样本、LLM生成风格描述和LISA风格嵌入；前三种使用LLM提示，嵌入法以余弦相似度判别。作者提出先缩小候选集合、再选择嵌入维度的两阶段LISA。仅标签提示效果弱，加入作者特定表征均改善归属表现；两阶段LISA总体最佳，LLM生成的风格描述更紧凑但牺牲部分准确表现。

Insight: 无监督零样本归属的关键在作者风格表征；当前开源LLM单靠提示尚不足以实现稳健归属，摘要未报告数据集与数值成绩。

Abstract: Authorship Attribution (AA) requires capturing fine-grained stylistic characteristics, making it particularly challenging in zero-shot (ZS) settings where no task-specific supervision is available. In this work, we investigate the effect of author representations on ZS AA by evaluating a label-only prompting baseline together with three author representation strategies: representative writing samples, LLM-generated descriptions, and style embeddings (LISA). The first three approaches perform attribution using LLM prompting, while the embedding-based approach uses style embeddings with cosine similarity. We investigate the influence of prompt design and propose a two-stage embedding-based attribution framework that combines candidate space reduction with embedding-dimension selection. The results show that label-only ZS AA is ineffective, while incorporating author-specific representations consistently improves attribution performance. Among the evaluated approaches, the proposed two-stage LISA framework achieves the strongest overall performance, whereas LLM-generated style descriptions provide a substantially more compact representation of author style at the cost of some attribution performance. These findings demonstrate the importance of author representation in ZS AA, while indicating that current open-source LLMs remain insufficient for robust attribution without more effective representation learning.

[91] Language Models that Play Chess and Explain Their Moves cs.CLPDF

Adithya Bhaskar, Jeffrey Cheng, Danqi Chen

TL;DR: 提出4B参数棋类语言模型Queen，将专家棋力与自然语言解释结合，并通过迭代蒸馏共同提升对弈与解释能力。

Details

Motivation: 现代棋类引擎棋力超群却不解释；语言模型能生成看似合理的解释，但下棋能力弱，难以提供有用分析。

Result: Queen用编码器—解码器架构将无解释的专家棋类编码器与指令微调语言模型通过交叉注意力结合，并以问答课程学习提取棋类概念。随后迭代分析候选着法后的局面、汇总当前局面的解释并蒸馏回模型。七轮后Elo从1782升至2697，增幅超过900，且棋力和谜题准确率超过所比较的前沿模型，参数量少约三个数量级；模型评价认为解释流畅度和连贯性接近GPT-5.6-Sol（高）。

Insight: 专家表征与自然语言推理的迭代结合可让模型同时给出决策与解释；Elo提升依赖七轮反复蒸馏，解释质量主要由模型评估。

Abstract: Modern chess engines are silent experts: they play at a superhuman level, but do not offer explanations for their play. On the other hand, language models (LMs) can generate plausible-sounding explanations, but their weak playing strength limits the utility of their explanations. We introduce Queen, a 4B-parameter chess-language model that can explain its moves and plans while playing at the level of a typical Grandmaster. Our novel framework enables domain-specific reasoning through complementary components: an encoder-decoder architecture and an iterative distillation algorithm. This architecture integrates a silent expert chess encoder with an instruction-tuned LM through cross-attention, which we train via a question-answering curriculum to extract chess concepts from the encoder’s representations. Building on this domain-adapted model, we iteratively improve its explanations with a natural-language analog of the Bellman update: the model analyzes the positions after its top candidate moves and consolidates them into an explanation of the current position, which is then distilled back into the model. Over seven iterations, our model gains over 900 Elo points (1782 to 2697), substantially surpassing all frontier models on both playing strength and puzzle accuracy, despite containing three orders of magnitude fewer parameters. Furthermore, LM-based evaluations show that our explanations are fluent and approach GPT-5.6-Sol (high) in coherence. The generality of our architecture and training procedure suggests a recipe for applying language models to domains where silent expert encoders are available, like games, robotics, and computer use.

cs.AI [Back]

[92] Large language models exhibit unreliable updating of clinical judgment as patient evidence evolves cs.AI | cs.CLPDF

Min Zeng, Rui Zhang

TL;DR: 研究LLM在纵向ICU患者轨迹中随证据演变更新临床判断的可靠性，并发现既有判断和证据变化方向会系统影响更新。

Details

Motivation: LLM被用于临床推理，但患者证据随时间变化时能否恰当地修正先前判断尚未明确。

Result: 作者在匹配的电子病历ICU纵向轨迹上评估多种LLM，发现估计发生变化时，给模型先前判断比不给判断更常增加而非降低预测误差，第二个终点亦复现。控制实验显示，固定先前评估后，模型对恶化呼吸证据的反应强于匹配的改善证据，即使对可调整空间归一化仍存在；固定当前证据时，将先前风险从10%升至90%会使预测变化26.2个百分点。提示工程未恢复可靠更新。证据验证纵向更新EVLU能筛出更少但更可靠的修订，揭示可靠性—覆盖率权衡。

Insight: 纵向信念更新应作为LLM可靠性的独立维度评测；既有模型判断会因果性地影响新估计，提示不能简单将其当作中性上下文。

Abstract: Large language models (LLMs) are increasingly explored for clinical reasoning, but whether they appropriately revise judgments as patient evidence evolves remains unclear. We evaluated longitudinal belief updating using matched intensive-care trajectories from electronic health records. Across diverse LLMs, conditioning on a preceding judgment more often increased than reduced prediction error when estimates changed, replicated for a second endpoint. Controlled interventions revealed two failure modes. First, with preceding assessment fixed, models responded more strongly to worsening than matched improving respiratory evidence; this asymmetry persisted after headroom normalization at moderate and strong evidence levels. Second, with current evidence fixed, increasing prior risk from 10% to 90% shifted estimates by 26.2 percentage points, demonstrating causal influence of prior model beliefs. Prompting did not restore reliable updating. Evidence-Validated Longitudinal Update (EVLU) identified fewer, more reliable revisions, revealing a reliability-coverage trade-off. These findings establish longitudinal belief updating as a distinct dimension of LLM reliability.

[93] FSPO: Policy-Consistent Risk and Pareto-Feasible Control for Budgeted LLM RL Post-Training cs.AI | cs.CL | cs.LGPDF

Miaobo Hu, Shuhao Hu, Xiaobo Guo, Xin Wang, Bokun Wang

TL;DR: 提出FSPO反馈状态控制器，在语言模型RL后训练中联合校准风险、长期效用和多资源可行性，以预算内自适应调节训练动作。

Details

Motivation: 自适应RL训练会动态调整温度、组大小、裁剪、KL、验证器分配和更新预算；行为轨迹风险模型可能不适用于待部署控制器，基于日志校准的分数会受选择偏差影响，独立资源最低成本也无法保证多资源后续可行。

Result: FSPO训练与部署控制器一致的风险到达模型及效用模型，使用决策条件轨迹校准DCTC，并以Pareto资源延续证书PRCC仅批准剩余时域资源可行的动作。在匹配GRPO预算下，留出/分布外准确率为66.11%/59.43%，高于最强自适应基线PB2的64.47%/57.03%；三个配对种子较上下文bandit提高2.42/3.19个百分点。高分布不匹配时策略一致风险令所选决策ECE从0.108降至0.053，DCTC在相同接受率下从0.039降至0.022；PRCC将18动作目录的错误可行准入从0.197降至0；完整组件使轨迹失败率从0.181降至0.083。

Insight: 把控制器诱导风险、选择后校准和多资源可行性一起处理，能同时改善准确率与预算控制；实证依赖给定GRPO资源包络和训练环境。

Abstract: Adaptive LLM reinforcement-learning post-training changes multiple training actuators online, including rollout temperature, group size, clipping, KL regularization, verifier allocation, and update budget. Three coupled issues remain unresolved. A future-risk model trained from behavior trajectories need not estimate the risk induced by the controller that will be deployed; a score calibrated on logged state-action pairs can become miscalibrated after selective action choice; and independent per-resource minimum costs do not in general certify a feasible multi-resource continuation. We introduce FSPO, a feedback-state controller for budgeted LLM RL post-training that addresses these issues jointly. FSPO learns a policy-consistent risk-to-go model whose Bellman target follows the same frozen controller used for future decisions, together with a long-horizon utility model. Decision-conditioned trajectory calibration (DCTC) calibrates risk on cross-fitted trajectories generated by actions selected by provisional controllers. A Pareto resource continuation certificate (PRCC) admits an action only when a non-dominated cumulative reservation remains feasible over the residual horizon. Under a matched GRPO resource envelope, FSPO reaches 66.11% held-out and 59.43% OOD accuracy, compared with 64.47% and 57.03% for PB2, the strongest evaluated adaptive baseline. Three paired training seeds give gains of +2.42 and +3.19 percentage points over the contextual bandit on held-out and OOD evaluation. Under high behavior-deployment mismatch, policy-consistent risk lowers selected-decision ECE from 0.108 to 0.053; DCTC lowers it from 0.039 to 0.022 at matched acceptance; PRCC removes false-feasible admissions on an 18-action catalog ($0.197\rightarrow0.000$); and enabling all three components reduces trajectory failure from 0.181 to 0.083 in a factorial ablation.

[94] Gains and Collapse in On-Policy Distillation:A Reinforcement Learning Perspective cs.AI | cs.CLPDF

Han Cui, Jianhao Yan, Yun Luo, Hongbo Zhang, Zhizhang Fu

TL;DR: 从强化学习视角分析在线策略蒸馏的能力提升与崩溃，发现教师隐式奖励可能放大冗长重复的学生行为。

Details

Motivation: 在线策略蒸馏能提升语言模型表现，却有时陷入输出过长和重复；其分化机制尚不清楚。

Result: 研究将OPD解释为教师对学生行为隐式奖励。实验显示OPD可让正确回答更易采样，但不会扩展学生能力；当隐式奖励与质量不一致时，奖励投机会放大学生冗长重复轨迹，即便教师自身很少生成这类文本。训练时屏蔽不健康回答和使用SFT初始化均能有效缓解崩溃。

Insight: 应关注教师评价学生轨迹的可靠性，而不只看教师本身生成质量；屏蔽异常输出与SFT初始化是有效缓解方式，具体效果数值未在摘要中给出。

Abstract: On-policy distillation (OPD) has become an important approach to language model post-training. However, despite its performance gains, OPD can also collapse into excessively long and repetitive generation, and the mechanism underlying these divergent outcomes remains poorly understood. We explain these outcomes through a reinforcement learning perspective: the teacher implicitly rewards student behaviors, even those it rarely exhibits itself. From this perspective, our experiments show that OPD improves performance without expanding the student’s capabilities. When the implicit reward model is reliable, OPD makes correct responses easier to sample. In contrast, when the preference misaligns with quality, reward hacking happens: the implicit reward model amplifies overlong, repetitive student rollouts, even though it rarely generates such text itself. Guided by this diagnosis, we find that masking unhealthy responses during training and using SFT initialization can each effectively mitigate the collapse. Together, these findings show that OPD amplifies student behaviors favored by the teacher’s implicit feedback, shifting the focus from how well the teacher generates to how reliably it evaluates student rollouts. Our code is available at https://github.com/HancCui/opd_hacking.

[95] Multilingual GSM-Symbolic: What determines capability transfer across languages? cs.AI | cs.CLPDF

Kenneth Enevoldsen, Riley Herchert, Sofie Mosegaard, Dan Saattrup Smart, Simon Enni

TL;DR: 构建15种语言的Multilingual GSM-Symbolic数学基准，联合量化模型规模、资源水平、推理能力和语言类型距离对跨语言迁移的影响。

Details

Motivation: 现有跨语言能力评估数据集难以比较、易饱和，较少联合分析影响迁移的因素；预测迁移规律有助于减少逐语言对评测，并定位低资源语言瓶颈。

Result: 基准含30,000组问题答案配对，使用符号模板可扩展生成数百万变体以防记忆。联合估计中模型规模、语言资源、推理、类型学距离系数分别为1.77、0.77、0.67、-0.25；32B模型在马拉地语表现相当于10B英语模型。规模与推理缩小高低资源语言差距（系数-0.27、-0.20），但对类型学差异大语言作用弱或无。框架解释92%的语言间差异、23%的模型—语言交互差异；未见语言性能预测误差在6.0个百分点内，加入目标语言仅10个模板测量后缩至4.19个百分点（相关r=.96）。

Insight: 跨语言迁移同时受资源和语言类型影响，扩大模型或增强推理可缩小资源差距但未必解决类型学差异；少量目标语言测量可提高迁移预测。

Abstract: We understand little about how capabilities acquired in one language carry over to another, or what governs this transfer: evaluations rely on incomparable, saturation-prone datasets and rarely examine its determinants jointly. Identifying what predicts transfer would let us avoid exhaustive evaluation across all language pairs and let developers target the factors that limit performance in low-resource languages. To evaluate cross-lingual capability transfer, we introduce Multilingual GSM-Symbolic, an extensible multilingual mathematical dataset covering 30,000 item-matched question-answer pairs and spanning 15 languages. It utilises symbolic templates to prevent overfitting and ensure generalisation by allowing generation of millions of high-quality variations from a single sample. Using Multilingual GSM-Symbolic, we quantify the largest determinants of capability as model size ($β= 1.77$), language resource level ($β= 0.77$), reasoning ($β= 0.67$) and typological distance ($β= -0.25$). This joint estimation allows these determinants to be expressed in terms of one another: a 32B model evaluated in Marathi performs like a 10B model in English. Our findings have important implications for model developers, showing that model size and reasoning narrow the performance gap between low- and high-resource languages ($β= -0.27$ and $β= -0.20$, respectively), while similar levers have little or no effect on typologically distant languages. Overall, our analysis framework explains 92% of between-language variation, but only 23% of the model-by-language variation, and predicts a model’s performance on an unseen language within 6.0pp (r=.96). Incorporating measurements from just 10 templates in the target language reduces this to 4.19pp, enabling reasonable estimates of performance with little or no downstream dataset.

[96] A Near-Zero Monitor Readout Is Not Evidence of Behavioral Control cs.AI | cs.CLPDF

Zhe Zhou, Tianhua Tao

TL;DR: 通过受控代码生成实验指出，监控器读数接近零并不能证明训练时奖励黑客行为已被控制。

Details

Motivation: 可验证奖励后训练容易发生奖励投机，因而有研究把监控器加入训练目标；但一个低监控分数是否意味着行为受控仍不明确。

Result: 在主要漏洞从推理开头即可利用的代码环境中，作者训练三个通过相同离线门槛的监控器：域内激活探针和两种依赖模型提前承诺最终答案的惩罚。探针读数从首个记录步骤起就在数值下限；前缀训练各运行终点中位读数均为零，但同一配置下同为零读数的种子实际从低占比混合行为到近乎纯奖励投机不等。探针运行都达到投机状态，其下限读数源于训练读取位置与验证位置不匹配。文本分析发现通用计划和填充前缀会推迟漏洞出现而未从最终输出删除。

Insight: 离线可区分性和低监控读数都不足以证明行为控制，必须使用独立于监控的行为检查；结果报告终点而非训练过程的完整演化。

Abstract: Post-training with verifiable rewards can induce reward hacking, motivating the use of monitors within the training objective rather than solely for offline auditing. We show that a low monitor readout does not identify whether such an intervention controls behavior. In a code-generation environment whose dominant exploit is available at the start of the reasoning trace, we train policies against three monitors that pass the same offline gate: an in-domain activation probe and two penalties conditioned on how early the policy commits to its own final answer. The probe score is at its numerical floor from the first recorded training step, and the trained-score median is zero for every prefix-trained run at the endpoint. These readouts estimate different quantities, and we do not compare their scales; within each monitor family, however, low values do not establish behavioral control. Within one fixed configuration, prefix-trained runs with the same zero-median trained score range, by seed alone, from a mixed regime with a low hacking share to near-pure reward hacking. All probe runs reach the hacking regime, but their floor-level readout reflects a mismatch between the position where the probe was validated and the position where it was read during training, not a second instance of this ambiguity. Text-level analysis identifies a prefix failure mode: generic planning and filler shells postpone the exploit past the cut without eliminating it from the final output. Low measured commitment therefore does not distinguish a low hacking share from delayed commitment to the exploit. Offline discrimination and low monitor-aligned readouts are insufficient evidence of behavioral control; an out-of-band behavioral check is required. We characterize the endpoint readout, not its evolution. Code is available at https://github.com/zhezhou1106/spoof-cost.

[97] World Action Modeling with Progressive Visual Planning cs.AI | cs.CV | cs.ROPDF

Fei Zhang, Zhaochong An, Duncan Frost, Yikai Wang, Pengfei Liu

TL;DR: 提出渐进式世界动作模型ProWAM，联合预测机器人动作与有序稀疏视觉子目标以支持长程闭环控制。

Details

Motivation: 世界动作模型需联合预测未来视觉动态和动作，但生成密集视频推演成本高；仅预测一个未来帧虽省算，却缺少朝目标推进的过程指引。

Result: ProWAM预测稀疏有序子目标，为动作生成提供连续视觉锚点，并可用无动作标注视频学习，从而将视觉规划负担从动作策略转移给视频骨干。单次骨干前向缓存子目标特征，重规划时只需轻量动作去噪。在仿真LIBERO-Plus和随机化RoboTwin分别达到85.8%和75.7%，最高相对强基线提升35.9%；RoboCasa365成功率48.1%，困难Composite-Unseen为18.2%、总排名第4。零样本真实场景成功率70%，高于基线55%（相对提升27.3%）。

Insight: 进度索引的稀疏视觉前瞻可替代密集视频 rollout，同时为闭环动作提供阶段目标；真实场景结果为零样本实验。

Abstract: World action models (WAMs) have emerged as a promising paradigm for robotic control by jointly predicting future visual dynamics and actions from an initial observation and instruction. However, existing WAMs struggle with long-horizon prediction, as generating dense video rollouts is highly inefficient. Some recent WAMs address this by predicting a single future frame without generating the full video, but this approach neglects how to progress toward the goal. We present ProWAM, a progressive world action model that jointly predicts actions and an ordered sequence of sparse visual sub-goals, providing explicit visual guidance to anchor action generation throughout task execution. This design scales naturally, as sub-goal prediction can be learned from large-scale action-free videos, allowing the video backbone to offload complex visual planning from the action policy. For efficient action generation, ProWAM executes a single video-backbone forward pass to cache sparse sub-goal features, eliminating iterative full-video generation and requiring only lightweight action denoising during replanning. Across extensive evaluations, ProWAM achieves superior out-of-distribution robustness. On simulation benchmarks, it sets new state-of-the-art results on LIBERO-Plus (85.8%) and randomized RoboTwin (75.7%), outperforming the strongest baseline with relative gains of up to +35.9%. On RoboCasa365, ProWAM achieves a 48.1% success rate and 18.2% on the challenging Composite-Unseen split, ranking 4th overall. Crucially, in zero-shot real-world experiments, ProWAM achieves 70.0% success, outperforming the strongest baseline by +15.0 (from 55.0% to 70.0%, a +27.3% relative gain) in novel scenes. These results demonstrate the value of progress-indexed visual foresight for closed-loop control. Our program is in https://sii-ferenas.github.io/ProWAM-page.

[98] Low-Cost Video–Time Priors as a Strong Baseline for EEG–fNIRS Emotion Regression on Familiar Videos cs.AI | cs.CV | cs.MMPDF

Minghao Kong, Jiurun Chen, Ying Gao, Xiangbin Meng, Rongjie Wang

TL;DR: 比较熟悉视频情绪回归中的低成本视频时间先验与EEG—fNIRS融合，发现视频身份和时间信息可解释主要改善。

Details

Motivation: 连续情绪回归需在观看视频时估计效价和唤醒度；对于熟悉视频，低成本的视频身份与时间信号可能主导预测，需确认生理模态是否提供额外残差信息。

Result: 作者以24名受试者的留一受试者五折评估比较不同融合方式；摘要记录显示，视频时间先验在内部与外部评估中的MAE距融合方法分别不超过0.05和0.32。来源消融表明视频身份及视频内时间解释大部分误差降低，EEG—fNIRS带来的收益更小，并随受试者与视频变化。

Insight: 熟悉视频任务中，视频时间先验是强且低成本的基线，EEG—fNIRS更适合作为可选残差线索；原摘要存在明显文本损坏，MAE比较方向和部分数据描述不完整，结论按可读内容谨慎概括。

Abstract: Continuous emotion regression estimates moment-to-moment valence and arousal while a viewer watches a video. In familiar-video deployment, responses fron training participant-specific estimate, and prior-dominating fixed fusion tests whether physiology adds residual correction. In five-fold subject-held-out evaluation on 24was within 0.05 and 0.32 MAE of fusion in the internal and external evaluations, respectively. Source-explicit ablations showed that video identity and within-video tine accounted for most of the reduction, while EG-FNIRS gains were smaller and varied across participants and videos. These results identify the video-time prior as a strong, low-cost baseline and position EEG-fNIRS as an optional residual signal for familiar-video emotion regression.

cs.CY [Back]

Emilio Ferrara

TL;DR: 综述ChatGPT时代社交机器人检测面临的挑战与机会，并提出合成数据、多模态跨平台、低资源语言和隐私协作方向。

Details

Motivation: AI聊天机器人日益复杂，生成式对话和行为给传统社交机器人检测带来新挑战，实际检测技术和应用仍存在研究空缺。

Result: 文章梳理社交机器人检测研究现状及较突出的真实应用，聚焦AI生成对话与行为引发的问题，并提出四条方向：使用生成式代理合成数据、测试与评估；结合网络和行为协调及影响特征进行多模态跨平台检测；拓展非英语与低资源语言；发展保护用户隐私的协作式联邦检测模型。

Insight: 系统综述强调未来检测应关注跨平台行为与协同线索，并兼顾低资源语言和机构间隐私协作；摘要未描述独立实证实验或量化比较。

Abstract: We present a comprehensive overview of the challenges and opportunities in social bot detection in the context of the rise of sophisticated AI-based chatbots. By examining the state of the art in social bot detection techniques and the more salient real-world application to date, we identify gaps and emerging trends in the field, with a focus on addressing the unique challenges posed by AI-generated conversations and behaviors. We suggest potentially promising opportunities and research directions in social bot detection, including (i) the use of generative agents for synthetic data generation, testing and evaluation; (ii) the need for multimodal and cross-platform detection based on network and behavioral signatures of coordination and influence; (iii) the opportunity to extend bot detection to non-English and low-resource language settings; and, (iv) the room for development of collaborative, federated learning detection models that can help facilitate cooperation between different organizations and platforms while preserving user privacy.

cs.DC [Back]

[100] Lightweight and Resource-Efficient Perception for Robotic Guide Dogs cs.DC | cs.CVPDF

Jinse Kwon, Yoojin Lim, Choonghan Lee, Yongseung Yu, Yongin Kwon

TL;DR: 比较导盲机器人多摄像头流水线在共享GPU—NPU平台上的部署位置，指出争用与截止时间失约会改变最佳硬件分配。

Details

Motivation: 边缘设备常与其他负载共享异构加速器，但部署选择通常依据独立单流实验和平均流式精度，可能无法反映实际多流截止时间行为。

Result: 在单GPU—NPU平台的两个端到端流水线实验中，虽然孤立测试偏好GPU，但GPU局部争用造成检测过期，可在GPU未完全饱和前反转选择。NPU孤立时对小中物体精度较低、大物体接近GPU；四流场景中最优分配取决于哪条路径过期，增大GPU争用会令最优方案从全GPU转为全NPU。在GPU饱和的视觉语言共租负载下，全NPU的最差流sAP是全GPU的5.2倍。

Insight: 平均sAP可能掩盖严重的单流退化；建议同时报告争用扫描、两路径截止时间失约率及最差流sAP。

Abstract: Multi-camera streaming perception is increasingly deployed on heterogeneous edge platforms shared with co-resident workloads, yet accelerator placement is often evaluated using isolated single-stream experiments and mean streaming average precision (sAP). Using two end-to-end pipelines on a single GPU–NPU platform, we show that isolated evaluation can mis-rank deployment-time placement. Although the GPU pipeline is preferred in isolation, GPU-localized contention introduces deadline misses that make detections stale and can reverse the preferred placement before full GPU saturation. The NPU pipeline is less accurate than the GPU pipeline on small and medium objects in isolation, but nearly matches it on large objects. The largest absolute sAP losses in our latency and contention experiments occur for large objects. In our four-stream experiments, the preferred placement depends on which path becomes stale, and increasing GPU-side contention shifts the best placement from All-GPU to All-NPU. Under a GPU-saturating vision–language co-tenant, All-NPU achieves $5.2\times$ the worst-stream sAP of All-GPU. Because mean sAP can hide severe single-stream degradation, evaluation should report contention sweeps, deadline-miss rates on both paths, and worst-stream sAP alongside mean sAP.

cs.LG [Back]

[101] Lexicographic Multi-Objective On-Policy Distillation cs.LG | cs.AI | cs.CLPDF

Doseok Jang, Jon Ander Campos, Youran Qi

TL;DR: 提出字典序多目标在线策略蒸馏LMOPD，按明确优先级融合不同奖励专长的教师策略。

Details

Motivation: 可验证奖励强化学习通常只优化答案正确性，实际还需推理质量与简洁性；标量化奖励可能在权衡时牺牲高优先级能力，例如为简洁而损害正确性。

Result: 对每个学生采样，LMOPD选择第一个门控检测到能力不足的专长教师，并局部投影其中心化对数策略修正，去除与更高优先级教师相冲突的部分。在三个数学基准的30B-A3B模型上，两专家设置保留准确率与推理质量增益，并获得46.9%的简洁性增益；四专家设置保留约90%的准确率和推理正确性增益，高于下一基线的约57%。匹配消融显示字典序路由优于随机路由，投影进一步保护高优先级能力。

Insight: 显式优先级与局部投影能在融合多个专长时更好保护关键能力；结果基于数学基准和给出的模型规模，简洁性收益在两专家情形下未被完全保留。

Abstract: Reinforcement learning from verifiable rewards (RLVR) usually optimizes answer correctness, yet useful language-model behavior also requires high-quality reasoning and concise responses. Existing multi-reward post-training methods typically scalarize rewards or combine specialists without explicitly protecting a reward priority order. This is problematic when trade-offs are asymmetric: conciseness, for example, should not improve at the cost of correctness. We introduce Lexicographic Multi-Objective On-Policy Distillation (LMOPD), a multi-teacher method for integrating reward-specialized policies under explicit priorities. For each student rollout, LMOPD selects the specialist for the first objective whose gate detects a deficiency, then locally projects its centered log-policy correction to remove components that oppose higher-priority specialists. We evaluate 30B-A3B mixture-of-experts transformer models in two- and four-expert settings on three math benchmarks, measuring retained specialist gains. With two experts, LMOPD’s point estimates fully retain the accuracy and reasoning-quality gains while acquiring $46.9%$ of the conciseness gain. With four experts, it retains $\approx90%$ of both the accuracy gain and reasoning-correctness gain, compared to only $\approx57%$ by the next best evaluated baseline. Matched four-expertablations show that lexicographic routing outperforms random routing and that projection further strengthens both top-priority capabilities. Across both scales, LMOPD preserves the highest-priority capabilities more effectively than the existing baselines we evaluate, demonstrating the value of explicit priorities for specialist integration.

[102] Hesitation Has a Geometry: Entropy-Trained Hyperbolic Probes for Sparse Activation Steering cs.LG | cs.CLPDF

Zeyong Zhang, Tung Sum Thomas Kwok, Tengfei Ma, Mengjia Xu

TL;DR: 提出双曲熵引导稀疏激活转向HEST，只在模型对下一个token犹豫时沿Poincaré球探针方向调整隐状态。

Details

Motivation: 数学推理具有少数高熵分支的层级结构，双曲空间更适合表示树形结构；但常见激活转向在每个token加入固定欧氏向量，会干预大量已由上下文决定的token。

Result: HEST用模型自身下一个token熵作为唯一监督，以轻量探针将隐状态嵌入Poincaré球；超过阈值时沿探针读出最速下降测地线移动，再映回隐状态。对学得理想点的Busemann读出，作者证明固定步长在所有状态上带来相同幅度下降。在Qwen2.5-Math和Llama-3.1系列三个指令模型的六种设置中，HEST在MATH-500、GSM8K贪心准确率有五种设置提升，最多1.8个百分点；逐token加固定对比向量反而降低准确率。增益在模型常犹豫的题目上最大，其余题目准确率基本不变。

Insight: 以熵门控稀疏干预并按双曲几何调整方向，可避免对简单token过度转向；报告的准确率提升有限且覆盖六种模型—任务设置。

Abstract: When a large language model solves a mathematical problem, its reasoning is largely hierarchical, and the solution often branches at a few tokens where the next-token entropy is high. Such tree-like structure embeds in hyperbolic space with far lower distortion than in Euclidean space. Activation steering, however, usually edits the hidden states of a pretrained model by adding one fixed Euclidean vector at every token, even though most tokens of a solution are already determined by the context. We propose Hyperbolic Entropy Steering (HEST), which embeds the hidden states in the Poincaré ball with a lightweight probe whose only label is the model’s own next-token entropy. Where this entropy exceeds a threshold, HEST moves the embedded state along the geodesic of steepest descent of a readout of the probe and maps the change back to the hidden state. For the Busemann readout of a learned ideal point, we prove that a step of fixed length lowers it by the same amount at every state. On three instruction-tuned models from the Qwen2.5-Math and Llama-3.1 families, HEST with the Busemann readout improves greedy accuracy on MATH-500 and GSM8K in five of six settings, by up to 1.8 points, whereas a contrastive steering vector added at every token lowers accuracy. With a Euclidean probe trained in the same way, this gain disappears on Qwen2.5-Math-1.5B-Instruct. The gains are largest on problems where the model hesitates often, and accuracy on the remaining problems is almost unchanged.

[103] Are you Synthesizing or Recalling? Evaluating LLMs on Algorithmic Code Retrieval cs.LG | cs.AI | cs.CL | cs.PLPDF

Nickil Maveli, Antonio Vergari, Shay B. Cohen

TL;DR: 提出AlgoREval，独立评测LLM凭参数化知识检索并复现经典算法代码的能力。

Details

Motivation: 代码生成同时依赖算法知识回忆和应用推理，现有流程未明确区分二者；对训练语料广泛包含的经典算法，直接复现命名算法更适合作为参数化代码检索能力来评测。

Result: 基准含599道题，覆盖14个领域的77种经典算法、7种编程语言和4类图输入表示；作者以零样例方式评测15个7B至34B模型。不同语言及输入表示下的检索准确率差异显著。加入检索代码片段或结构化算法提示可提升复杂算法表现；监督微调带来更广泛的跨语言收益，GRPO则在个别语言取得更大提升。

Insight: 算法代码检索是可单独测量的能力，跨语言与表示差异提醒部署生成的算法代码前需系统验证。

Abstract: Large language models (LLMs) have demonstrated strong performance in code generation, where success depends on both recalling relevant algorithmic knowledge and reasoning about how to apply it. However, existing LLM pipelines are opaque, with no explicit separation between these two components. We argue that for well-known algorithms whose canonical implementations are widely accessible in pretraining corpora, code generation is better measured as \textit{parametric code retrieval}: reproducing a named algorithm from internalised knowledge rather than synthesizing a novel one. We introduce AlgoREval, a benchmark of 599 problems spanning classical 77 algorithms across 14 domains, 7 programming languages, and 4 graph-input representations to evaluate this capability in isolation, and assess 15 models (7B–34B parameters) in a zero-shot setting. We find substantial variation in retrieval accuracy across languages and input representations, even for widely documented algorithms and show that prompt augmentation with retrieved code snippets or structured algorithmic hints improve accuracy on complex algorithms, while SFT achieves broader language gains and GRPO achieves larger per-language gains on specific languages. Together, our results establish parametric code retrieval as a distinct, measurable capability and caution against deploying AI-generated algorithmic code without systematic validation.\footnote{Code and dataset are available at https://github.com/Nickil21/AlgoREval

[104] OPD Before RL: Warm-Starting Rubric-Based RL with On-Policy Distillation cs.LG | cs.AI | cs.CLPDF

Xinpeng Wang, Wei Shi, Yu-Chia Chen, Maria Zontak, Yun He

TL;DR: 提出先特权评分细则在线策略蒸馏、再评分细则强化学习的两阶段方法，以改善开放式任务的奖励优化。

Details

Motivation: 健康与科学等开放式任务难以用精确答案自动核验，评分细则RL虽能评估完整回答，却无法直接指出哪些token级选择带来得分。

Result: 第一阶段RP-OPD让学生在自身生成前缀上匹配可见评分细则教师的下一token分布，而学生不直接看细则；第二阶段RL再直接优化评分奖励并突破蒸馏平台期。开放模型在HealthBench、ResearchQA和RubricHub Science上的比较显示，两阶段方法得分最高。RubricHub Science上RP-OPD+RL只有有限奖励投机迹象；相较之下SFT+RL基线越来越常因声称遵从细则而获得高奖励，却未提供所需内容。

Insight: 先用评分细则提供密集监督再做奖励优化，可能减少只学会迎合奖励措辞的投机；摘要未报告具体模型分数或各任务提升幅度。

Abstract: Many useful language-model tasks cannot be evaluated by exact outcome verification. Rubric-based reinforcement learning (RL) addresses this issue by scoring open-ended responses against explicit criteria. However, because the reward is assigned after the complete response, the training signal does not directly identify which individual decisions contributed to the final score. We propose a two-stage training framework that uses rubrics first as privileged teacher context for dense token-level supervision, then as rewards for further RL. In the first stage, rubric-privileged on-policy distillation (RP-OPD), a student without access to the rubric matches a rubric-aware teacher’s next-token distributions at student-generated prefixes. In the second stage, RL directly optimizes the rubric reward and improves beyond the observed distillation plateau. We evaluate the framework on health and science tasks using open-weight models. Across HealthBench, ResearchQA, and RubricHub Science, we compare post-training methods and vary the amount of SFT or RP-OPD training before RL, finding that our two-stage framework achieves the highest scores among the methods evaluated. RP-OPD + RL shows limited signs of reward hacking on RubricHub Science, whereas the SFT + RL baseline increasingly receives high rewards for claims of rubric compliance without providing the required content. These findings support using rubrics to guide on-policy distillation before applying rubric-based RL.

[105] Learning from Evolving Errors: Adaptive Iterative Repair for On-Policy Distillation cs.LG | cs.CLPDF

Rui Li, Liyang He, Zheng Zhang, Zhenya Huang, Linbo Zhu

TL;DR: 提出AIR-OPD，在在线策略蒸馏中针对学生每次新暴露的错误迭代生成修复指导并监督对应错误区域。

Details

Motivation: 传统在线策略蒸馏借助包含完整参考解的教师提供密集token反馈，但参考答案只规定目标，不说明如何从学生当前错误走向正确答案，可能诱导解题捷径。

Result: 失败后指导生成器根据当前错误提供修复建议，学生按自身策略重试；若仍错，则针对新错误重新生成指导。固定教师以指导作为特权上下文，在最新失败轨迹的错误对齐片段上监督，阶段权重偏向早期修复，并奖励立即重试通过验证的阶段。模型在DAPO-Math-17K上训练，评测AIME24、AIME25、HMMT25及分布外MMLU-Pro、GPQA，覆盖学生自指导与更大模型外部指导。Qwen3-4B和Qwen3-8B均取得最佳数学推理平均成绩，比最强基线最多高3.6分，并保持分布外基座表现。

Insight: 随错误演变的局部修复指导可减少参考解导致的捷径风险；数学任务收益未以分布外性能下降为代价，但修复预算和计算开销未在摘要中量化。

Abstract: On-policy self-distillation (OPSD) supplies dense token-level feedback on trajectories sampled from the student’s own policy, a richer training signal than the outcome-level rewards of reinforcement learning. This feedback comes from a teacher conditioned on a full reference solution unavailable to the student. The reference solution specifies the target but not how to move from the student’s current error toward it, creating a solution-conditioned shortcut risk. We introduce AIR-OPD, an adaptive iterative repair framework for on-policy distillation that provides error-to-repair supervision. Given a failed response, a guidance generator synthesizes repair guidance for the current error. The student samples an on-policy retry with this guidance. If the retry remains incorrect, the generator produces new repair guidance for the newly observed error. At each round, a fixed teacher receives the guidance as privileged context and supervises the student on an error-aligned region of its latest failed response. Outcome-aware stage weighting favors early repair stages and credits stages whose immediate retry passes verification. We train AIR-OPD on the DAPO-Math-17K dataset and evaluate on AIME24, AIME25, and HMMT25, alongside out-of-distribution tests on MMLU-Pro and GPQA. We examine two guidance sources, self-guidance from the current student policy and external guidance from a larger model. For both Qwen3-4B and Qwen3-8B, AIR-OPD attains the best mathematical-reasoning averages, improving over the strongest baseline by up to 3.6 points, while preserving base-model performance on the out-of-distribution benchmarks.

[106] Sentry: Learning to Recover from LLM Agent Failures at Test Time cs.LG | cs.AI | cs.CLPDF

Changxiu Ji, Amy Lu, Qizheng Zhang, Kunle Olukotun

TL;DR: 提出Sentry代理失败管理层，仅在检测到工具调用或推理失败时从外部经验库取回对应经验并验证恢复。

Details

Motivation: LLM代理会因非法工具调用、重复动作或依据不足的推理中途失败；把所有失败经验常驻上下文会在不匹配情形误触发，而单纯运行时干预又无法从修复中学习。

Result: Sentry在失败发生时检索相关经验，随后不读取任务奖励地验证是否恢复成功，只有修复成功才写入外部经验库，且完整经验库不进入代理上下文。多个代理基准上，它较最强运行时干预基线平均高37%；在双方均评测的两个基准上较最强上下文演化基线高39%，与上下文演化结合可进一步提升。学习经验能迁移到留出任务；即使相关经验仍可按需检索，把完整经验库暴露给代理也会降低表现。

Insight: 失败知识应按条件检索和暴露，而非全部写进上下文；验证过程不依赖奖励，结果支持按需经验库设计。

Abstract: LLM agents often fail mid-task due to invalid tool calls, repeated actions, or poorly grounded reasoning, and learning from these failures is a path to reliability. We find that how failure knowledge reaches the agent matters as much as what it contains. Failure lessons are conditional: kept in the agent’s context, they misfire when their failure is absent, and removing them from an evolving playbook improves performance. Runtime interventions, in contrast, act only when a failure occurs but do not learn from their repairs. We argue that failure knowledge is conditional knowledge and should be conditionally exposed, and instantiate this principle in Sentry, a failure-management layer that runs alongside the agent. When Sentry detects a failure, it retrieves matching lessons from an external playbook to guide recovery, verifies without access to task rewards whether the agent recovered, and stores a new lesson only if it did; the full playbook never enters the agent’s context. Across multiple agentic benchmarks, Sentry outperforms the strongest runtime-intervention baseline on every benchmark, by 37% on average, and the strongest context-evolution baseline by 39% on the two benchmarks where both are evaluated; combining Sentry with context evolution yields further gains. Learned lessons transfer to held-out tasks, and controlled experiments show that exposing the full playbook to the agent lowers performance even when relevant lessons remain available on demand.

[107] Tailoring the Quantization Space for 1-Bit KV Cache Compression cs.LG | cs.AI | cs.CLPDF

Minsoo Cheong, Donghyun Son, Sungjoo Yoo

TL;DR: 提出TaSQ，为1比特键值缓存向量量化调整目标空间，结合查询引导通道加权、跨头归一化和协方差感知分组。

Details

Motivation: 长上下文LLM推理中的KV缓存占用大量内存与带宽；向量量化适合激进压缩，但在1比特极低精度下码本需覆盖更多通道而质心有限，现有方法性能退化明显。

Result: TaSQ按照误差敏感度与缓存激活统计结构调整VQ目标空间；变换兼容RoPE，可合并进投影权重和码本，保留常规查表且服务额外开销可忽略。在通用、长思维链推理及长上下文检索基准上持续优于既有低比特KV量化基线并保持推理稳定。单张RTX 6000 Ada GPU上，其SGLang实现相对BF16支持最高14倍批量并使峰值吞吐提高1.87倍。

Insight: 为KV缓存构造适配查询和激活统计的量化空间，可改善极低比特压缩并提升服务吞吐；最大批量倍率是特定GPU与实现设置下的上限。

Abstract: The key-value (KV) cache becomes a major memory bottleneck in long-context LLM inference, placing substantial pressure on memory capacity and bandwidth. To mitigate this bottleneck, vector quantization (VQ) has emerged as a promising approach for aggressive KV cache compression. However, existing VQ methods degrade substantially in the 1-bit regime. At such extreme compression, each codebook must represent a larger group of channels with a limited set of centroids, making effective use of its capacity increasingly challenging. To address this, we introduce $\textbf{TaSQ}$, which tailors the VQ target space by combining query-guided channel weighting, cross-head normalization, and covariance-aware channel grouping to better reflect the error sensitivity and statistical structure of cached activations. Since these transforms are RoPE-compatible and can be easily merged into projection weights and codebooks, TaSQ preserves the conventional VQ lookup structure and adds negligible serving overhead. Across general, long-chain-of-thought reasoning, and long-context retrieval benchmarks, TaSQ consistently outperforms existing low-bit KV cache VQ baselines while preserving reasoning stability. On a single RTX 6000 Ada GPU, its SGLang implementation supports up to $14\times$ larger batch sizes and achieves $1.87\times$ higher peak throughput compared to the BF16 baseline.

[108] AdaStep: Adaptive Step Credit Weighting for Agentic Reinforcement Learning cs.LG | cs.CLPDF

Xin Wang, Wenhao Wu, Menghao Zhang, Zhi Wang, Kun Shao

TL;DR: 提出AdaStep，自适应调整基于组优势的步骤级奖励在长时程代理轨迹回报中的权重。

Details

Motivation: 长时程LLM代理常只获得稀疏终局奖励，难区分各决策贡献；步骤级回报虽更细，却会混入后续动作、环境变化和轨迹长度造成的不可靠噪声。

Result: 作者把权重选择写成潜在步骤优势的均方误差估计问题，在明确条件采样假设下推导逐状态收缩系数。系数可解释为信号与总方差之比：回报变化由当前动作造成时保留局部归因，由下游随机性主导时抑制。AdaStep只需轻量标量计算，不用critic、额外采样或模型推理；三个骨干在ALFWorld、WebShop和ScienceWorld上均较基线稳定提升，额外计算成本低。

Insight: 按方差来源自适应混合局部与轨迹级奖励，可避免把后续随机性错误归给当前决策；理论系数依赖给定条件采样假设。

Abstract: Long-horizon LLM agents are typically trained with sparse outcome rewards, making trajectory-level objectives too coarse to distinguish the contribution of individual decisions. Step-level credit assignment provides finer-grained supervision, but its estimates can be unreliable because observed returns also depend on subsequent actions, environment transitions, and trajectory length. We propose AdaStep, an Adaptive Step-credit weighting method that controls how strongly each group-derived local advantage modifies the trajectory-level signal. We formulate this weighting as a mean-squared-error estimation problem for the latent step advantage and, under an explicit conditional sampling assumption, derive an optimal per-state shrinkage coefficient. The coefficient admits a signal-to-total-variance interpretation: it preserves local credit when return variation is attributable to the selected action and suppresses it when variation is dominated by downstream randomness. AdaStep requires only lightweight scalar computation, with no critic, additional rollouts, or extra model inference. Experiments with three model backbones on ALFWorld, WebShop, and ScienceWorld show consistent improvements over baselines at low computational cost.

[109] Pivot-SD: Efficient Self-Distillation for Masked Diffusion Language Models cs.LG | cs.CLPDF

Seo Hyun Kim, Sunwoo Hong, Younwoo Choi, Chen-Hao Chao, Se-Young Yun

TL;DR: 提出Pivot-SD，仅对掩码扩散语言模型轨迹中影响后续不确定性的关键承诺token进行离线自蒸馏。

Details

Motivation: 掩码扩散模型通过并行去噪推理，但少数提前提交的token会迅速降低其他位置不确定性并塑造输出；常规后训练只训练最终文本或整步奖励，未针对这些关键决策分配信用。

Result: Pivot-SD用剩余掩码位置的不确定性下降量选择高影响pivot。成功轨迹的pivot接受交叉熵监督；失败轨迹的pivot使用针对性反似然监督，其余失败轨迹不处理。仅用200个问题、每题四次采样，LLaDA-8B-Instruct在数学与代码基准上均优于全序列监督微调和匹配预算扩散RL基线。

Insight: 以信息增益定位少数关键决策，可降低扩散LM自蒸馏数据与训练预算需求；实验只用200道问题，广泛性尚需进一步验证。

Abstract: Masked diffusion language models (dLMs) offer a promising parallel alternative to autoregressive models for complex reasoning. However, they face a distinct credit-assignment challenge, since a few commitments during denoising sharply reduce the uncertainty over the remaining masked positions and shape much of the response. Most post-training recipes for dLMs do not use this signal to decide which tokens to train on: they typically train on the final text or assign rewards to whole denoising steps, rather than selecting the individual commitments that shape the response. We introduce Pivot-SD, an efficient offline self-distillation framework that supervises only these high-impact commitments (pivots). Pivot-SD selects pivots using an information-gain metric measuring uncertainty reduction over the remaining masked positions. Pivots from successful trajectories are trained with cross-entropy, and pivots from failed trajectories with targeted unlikelihood, leaving the rest of the failed trajectory untouched. Using only 200 questions and four rollouts each, Pivot-SD improves LLaDA-8B-Instruct over full-sequence SFT and budget-matched diffusion RL baselines across math and code benchmarks.

[110] WebFovea: When the Model Is Right but the Click Is Wrong – Reliable Round Trips for Vision-Based Web Agents on Live Websites cs.LG | cs.AI | cs.CVPDF

Jiangang Han

TL;DR: 提出视觉网页代理WebFovea，并将线上操作错误分解为动作解析、页面执行、结果回报和信息呈现四阶段。

Details

Motivation: 强多模态模型是网页代理必要条件但不足以保证任务完成；浏览器执行链路的坐标、控件和模板问题常使模型推理正确却点击失败。

Result: WebFovea在WebRetriever Challenge 2026获得第二名、总分57/100。真实网站观察到坐标空间不匹配使点击落在预期坐标的四分之三处，原生下拉菜单、iframe及文本框操作会静默失败，且自生成聊天模板token污染4.9%任务轮次。系统加固各阶段并设置规则及预算护栏；四次官方隐藏集成绩从31.0升至57.0，使用同一模型，因此增长反映harness变更（同时可能受线上运行波动影响），而非模型替换。

Insight: 端到端网页代理必须审计模型与浏览器之间的接口各环节，不能把点击失败都归因于模型推理；部分修复效果可能受真实网站运行随机性影响。

Abstract: We present WebFovea, a vision-based web agent that placed 2nd in the WebRetriever Challenge 2026 with a final score of 57.0 out of 100. The challenge evaluates agents end to end on Protocol III of the WebRetriever benchmark (arXiv:2607.06118): starting from an entry URL on a live website, the agent must operate the site’s own interface and return a verifiable answer. A capable multimodal large language model (LLM) is necessary for this, but not sufficient. The model’s decisions reach the browser through the harness, the code between the model and the page. At every step, four things must go right: the model’s reply must be parsed into the intended action, the action must take effect on the page, the result must be reported back accurately, and the model must be shown the information it needs. On real websites, many of the failures we observed occurred at one of these four stages rather than in the model’s reasoning. A coordinate-space mismatch placed every click at 3/4 of its intended coordinates; actions on native dropdowns, inside iframes, and in text boxes failed silently; and self-generated chat-template tokens contaminated 4.9% of task episodes. WebFovea hardens each stage and surrounds the loop with guardrails that keep the agent within the rules and its budget. The four-stage view does not depend on the model, although some individual fixes do. Because we used the same model in all four submissions, the rise of our official hidden-set score from 31.0 to 57.0 reflects changes to the harness, up to run-to-run variance on live sites. We describe the design, the evidence for each component (including negative results), a failure analysis, the limitations, and a roadmap that includes routing different steps to different models.

[111] What Should World Models Forget? Stratified Retention for Continual Adaptation cs.LG | cs.AI | cs.CV | eess.IV | eess.SPPDF

Nishit Anand, Ramani Duraiswami, Dinesh Manocha

TL;DR: 提出持续适应世界模型的分层保留评价原则，区分永久不变量与环境改变后应及时修订的实例事实。

Details

Motivation: 传统持续学习将旧数据性能下降视为失败，默认标签不变；世界模型预测目标是会变化的环境，因此旧知识有时过期而必须遗忘，同时物理等不变量又不能被修订。

Result: 论文指出标准遗忘指标无法区分正确更新过时知识与灾难性遗忘，反而会把冻结模型评为最佳；现有物理推理基准也只测冻结检查点。作者提出按不变时间尺度分层保留，将物理规律、物体恒存等不变量与应随环境改变修订的实例事实分开，并提出差异保留度指标：在适应流上联合报告不变量回归测试与修订延迟，不将两者聚合。

Insight: 持续世界模型应评估哪些知识需保持、哪些需修订及修订速度，而不能套用静态标签的统一遗忘分数；该文主要提出问题框架与指标，未报告模型实证。

Abstract: Continual learning treats degradation on previously seen data as evidence of failure, a convention inherited from settings with a stationary prediction target, where a correct label remains correct indefinitely. World models do not satisfy this condition. Their prediction target is the environment, which changes, so knowledge that was accurate when acquired may later become false, and discarding it is required behavior rather than a defect. Non-stationary ground truth is well studied in the concept drift literature and in the temporal factuality of language models, but has not been formulated for world models, which are distinctive in that they also encode knowledge that must never be revised. We argue that continual world models require retention stratified by invariance timescale, separating invariants such as physics and object permanence, which must never be revised, from instance-level facts that should be revised as soon as the environment changes. Standard forgetting metrics cannot distinguish a world model that has correctly revised outdated knowledge from one that has suffered catastrophic forgetting, and consequently rank a frozen model highest, while existing physical-reasoning benchmarks evaluate only frozen checkpoints. We propose differential retention, which reports invariant regression testing across the adaptation stream jointly with revision latency, without aggregation.

cs.MM [Back]

[112] From Expression to Reaction: Role-aware Visual Transfer and Stimulus-guided Reasoning for Interlocutor Emotion Recognition cs.MM | cs.CVPDF

Wei Wang, Zhaowu Li, Jianjie Luo, Fu Lee Wang, Lap-Kei Lee

TL;DR: 提出RASG说话者角色感知与刺激引导框架，从听者视频和说话者音频识别听者情绪。

Details

Motivation: 缺少听者侧标签造成监督不匹配；视觉相似的听者反应又需要借说话者语境区分，单靠表情容易混淆。

Result: 角色感知视觉迁移RVT先选择表情与情绪标签一致的说话者样本，筛选听者轨迹并使用可靠伪标签训练听者视觉专家。刺激引导边界推理SBR仅在视觉模型不确定时调用二分类语言推理器，把说话者音频和文本作为上下文而非直接情绪证据，以区分相似反应。MER-Cross上准确率76.25%，比基线提升超过17%；团队在ACM MM 2026 MER Grand Challenge Track 1获第二名。

Insight: 角色迁移补足听者标注不足，按不确定性触发语境推理可降低额外计算；上下文被明确限定为辨别线索而非听者情绪的直接标签。

Abstract: In this paper, we propose a Role-aware Stimulus-guided (RASG) framework for interlocutor emotion recognition, which predicts listener emotions from listener-only videos and speaker-only audios. RASG consists of Role-aware Visual Transfer (RVT) and Stimulus-guided Boundary Reasoning (SBR) modules, which address supervision mismatch due to the lack of labeled listener data and ambiguity among visually similar listener reactions whose interpretation depends on speaker context, respectively. More specifically, RVT selects speaker samples whose facial expressions support their emotion labels. It then filters listener tracks and uses reliable pseudo-labels to train a listener-centric visual expert. SBR uses a two-class language reasoner only when the visual model is uncertain. It treats speaker audio and text as context rather than direct emotion evidence to distinguish similar listener reactions. Experiments conducted on MER-Cross dataset shows that RASG achieves 76.25% on MER-Cross and improves the performance of the baseline over 17%. Our team ranks second in Track 1 (MER-Cross) of the MER Grand Challenge at ACM MM 2026.

cs.NE [Back]

[113] Evolving Hybrid Quantum-Classical Architectures for Image Classification cs.NE | cs.AI | cs.CV | cs.LG | quant-phPDF

Devroop Kar, Daniel Krutz, Travis Desell

TL;DR: 扩展EXAQC进化搜索框架，自动发现用于图像分类的混合量子经典网络中间量子电路。

Details

Motivation: 混合量子经典网络表现高度依赖量子电路结构，而电路门组成和量子比特连接通常手工指定；通用固定结构难同时满足图像特征变换能力与紧凑训练要求。

Result: EXAQC在保留经典特征提取与预测层的同时进化参数化量子电路。MNIST、Fashion-MNIST和CIFAR-10准确率分别达98.42%、90.62%、85.47%，门数量与其他量子架构搜索方法相近。相较经典网络，混合模型以显著更少参数取得相当准确度；CIFAR-10上85.68%准确率的模型参数量比10层CNN少逾25倍。编码选择重要：RX、RY、U3旋转编码在CIFAR-10上比振幅编码高22至25个百分点。

Insight: 自动电路搜索可发现紧凑且具竞争力的任务专用量子模块，编码方式对结果影响很大；准确率对比不等同于实际量子硬件优势，摘要未报告硬件执行成本。

Abstract: Hybrid quantum classical neural networks integrate parameterized quantum circuits (PQCs) with established deep learning architectures, but their performance depends strongly on the choice of quantum circuit architecture, a choice that remains largely manual. Most existing approaches rely on hand-designed or fixed circuit ansätze, requiring circuit structure, gate composition, and qubit connectivity to be specified in advance with no guarantee that they suit the task. This limitation is especially acute in image classification, where quantum circuits must transform features extracted by classical networks while remaining compact enough for practical training, requirements that generic, task-agnostic ansätze are unlikely to satisfy simultaneously. We extend EXAQC, an evolutionary framework for automated quantum circuit discovery, to image classification. EXAQC evolves PQCs as intermediate processing modules while retaining classical feature-extraction and prediction layers. On MNIST, Fashion-MNIST, and CIFAR-10, EXAQC achieves 98.42%, 90.62%, and 85.47% accuracy, respectively, while using comparable gate counts to other quantum architecture-search methods. Against classical networks, evolved hybrid models maintain comparable accuracy with substantially fewer trainable parameters, reaching 85.68% on CIFAR-10 with over 25$\times$ fewer parameters than a 10-layer CNN. Encoding choice also matters: rotation-based encodings (RX, RY, U3) outperform amplitude encoding by 22-25 points on CIFAR-10. These results demonstrate that automated circuit discovery yields compact quantum modules that can replace larger classical components in vision architectures while retaining competitive accuracy.

cs.RO [Back]

[114] World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models cs.RO | cs.CVPDF

Jie He, Wei Li, Junwen Tong, Rui Shao, Wei-Shi Zheng

TL;DR: 提出ProAct世界校准提议到动作框架，用近期动作和预测场景未来构造与任务匹配的动作生成分布。

Details

Motivation: 流式VLA常从与执行历史及未来演化无关的各向同性高斯生成动作块，丢失近期运动连续性；已有世界表征通常只调节传输过程，不能决定采样起点、偏离范围或动作扩展方向。

Result: ProAct以轻量提议专家从近期动作生成场景感知假设，通过单步运动锚定流匹配初始化于示范动作流形附近；前瞻世界专家将假设作为软运动先验预测任务一致的未来潜变量。两者兼容性用于校准提议中心的各向异性源，按有界每步范围控制偏移，并以迹归一低秩几何在平移、旋转和夹爪方向间分配细化。在仿真和真实任务中优于π0.5，去噪步数减少50%，推理延迟最多降低25.8%，吞吐提高最多34.8%。

Insight: 将世界预测用于定义动作初始分布及可偏离方向，可同时保留局部连续性和前瞻性；摘要未提供各任务的成功率明细。

Abstract: Flow-based Vision-Language-Action (VLA) policies generate action chunks by transporting samples from a task-agnostic isotropic Gaussian source. As this source is conditioned on neither recent execution nor predicted future evolution, (i) it discards the local continuity established by recently executed motion. (ii) Even when predictive world representations are introduced, they often only condition the transport dynamics rather than determine where generation starts, how far it may deviate, or along which action directions it may expand. Building on this observation, we introduce ProAct, a world-calibrated proposal-to-action framework that makes the generative source itself predictable. (i) To preserve motion continuity, a lightweight Proposal Expert converts recent actions into a scene-aware hypothesis via one motion-anchored endpoint flow-matching step, initializing generation near the demonstrated action manifold. (ii) To jointly capture intended scene evolution and proposal-future compatibility, a prospective World Expert treats the hypothesis as a soft motion prior while predicting the task-consistent latent future. (iii) From this compatibility, the model calibrates a proposal-centered anisotropic source, where a bounded per-step extent controls the allowed deviation and a trace-normalized low-rank geometry under a condition-number budget allocates refinement over coupled translation, rotation, and gripper directions. Compared with $π_{0.5}$, ProAct improves performance across simulation and real-world tasks while reducing denoising steps by 50%, inference latency by up to 25.8%, and increasing throughput by up to 34.8%.

Yixuan Jiang, Wentong Li, An Liu, Zihao Xin, Fulin Tang

TL;DR: 提出GeoScaffold，通过训练期几何重建监督将深度、连通性和可通行性压缩进视觉语言导航策略。

Details

Motivation: 流式视频LLM导航策略直接从第一视角RGB映射动作，但继承二维预训练中较弱的三维几何先验；现有几何增强方法在推理时需深度传感器、三维编码器或逐步调用感知工具。

Result: GeoScaffold先用训练轨迹的深度图训练并冻结紧凑深度tokenizer，再以少量可学习几何查询token微调策略，使其隐状态重建深度、连通性和可通行性等导航关键几何。共享权重还将几何内化到骨干表征。训练后丢弃tokenizer、目标生成器及重建头，保持原骨干与动作接口不变。在连续VLN基准上，方法持续优于领先纯视觉导航器，适合轻量边缘部署；摘要未给出具体成绩数字。

Insight: 把几何成本前置到训练阶段，推理时不需常驻深度模块或感知工具；效果仍取决于训练期深度与导航轨迹监督。

Abstract: Recent vision-and-language navigation (VLN) systems increasingly adopt streaming Video-LLM policies that map egocentric RGB observations and instructions directly to low-level actions. Yet these policies inherit weak 3D geometric priors from 2D pretraining. Existing geometry-aware extensions charge a persistent inference-time price: depth sensors, 3D encoders, or per-step perception tool calls. We propose GeoScaffold, a geometric supervision framework that pays this price once, at training time, by internalizing geometry into the policy itself. It first learns a compact depth tokenizer on depth maps from the training trajectories and freezes it. It then fine-tunes the policy with a handful of learnable geometry query tokens, training their hidden states to reconstruct navigation-critical geometry such as depth, connectivity, and traversability. This supervision turns the query states into compact geometric latents for action decoding, and through the shared weights also internalizes geometry into the backbone’s own representations. Like a scaffold, the tokenizer, target generators, and reconstruction heads are discarded after training, leaving the backbone and action interface unchanged. Extensive experiments show that GeoScaffold consistently outperforms leading vision-only navigators on continuous VLN benchmarks, offering a practical paradigm for lightweight edge deployment of spatially aware embodied navigation models.

[116] PointWAM: 3D World Action Modeling for Dexterous Robotic Manipulation cs.RO | cs.CVPDF

Chunghyun Park, Beomjun Kim, Seungcheol Park, Heeseung Kwon, Yashu Shukla

TL;DR: 提出PointWAM，将场景环境和手部动作表示为共享时空坐标系中的三维点轨迹，以预训练灵巧操控。

Details

Motivation: 既有世界动作模型多用RGB帧或潜变量表示环境、用末端位姿或关节角表示动作，难以充分捕捉灵巧操作关键的三维结构和接触几何。

Result: PointWAM分别预测场景与操作者手部的三维点轨迹，并用彩色点云和语言指令预测双方随时间共同演化，再将手部运动重定向为机器人动作；可直接利用大规模人类示范视频预训练，无需选定任务专用物体或关键点。人类视频预训练使DexJoCo平均成功率提升56.9个百分点；增加场景轨迹监督较只预测手部再提升10.9点。二者结合后在十项DexJoCo任务上超过此前最佳11.7点，并在真实机器人上胜过强VLA。

Insight: 共享三维表示将场景变化和操作动作纳入同一预测目标，接触和环境动态监督都提供额外收益；训练来源为人类视频，机器人重定向是关键迁移环节。

Abstract: World action models jointly learn to forecast world dynamics and predict robot actions, such that the learned internal world dynamics guide accurate actions. Existing approaches typically represent the world as RGB frames or latent counterparts while predicting actions as end-effector poses or joint angles, but they often struggle to capture the 3D spatial structure and contact geometry central to dexterous manipulation. We introduce Point World Action Model (PointWAM), a 3D world action model that decomposes the world into a scene (i.e., environment) and hands (i.e., actor), and jointly forecasts both as 3D point trajectories within a shared space-time coordinate frame. This explicit, disentangled representation enables effective pre-training on large-scale human demonstration videos without requiring any task-specific object or keypoint selection. Given a colored point cloud and a language instruction, PointWAM predicts how the scene and hands co-evolve in 3D space over time, then retargets the forecast hand motion to robot actions. Pre-training on human videos improves average DexJoCo success by 56.9 percentage points, and scene-trajectory supervision adds 10.9 points over forecasting the hands alone. With both, PointWAM surpasses the prior state of the art on ten DexJoCo tasks by 11.7 points and outperforms strong VLAs on a real robot.

[117] FastOPD: On-Policy Distillation for Lightweight VLA Deployment cs.RO | cs.AI | cs.CV | cs.LGPDF

Yoojin Oh, Jeongsol Kim, Yeonwoo Seo, Jangho Park, Seonghyun Jin

TL;DR: 提出FastOPD，以在线策略蒸馏把大型流匹配VLA教师压缩为少步推理轻量学生。

Details

Motivation: VLA基础模型提升操控能力和泛化，却计算成本高；缩小架构或减少扩散去噪步数未必能保留教师动态。

Result: FastOPD将流映射适配为单状态教师监督，并加入自一致性目标学习紧凑学生；理论上说明优化该目标可使学生恢复与理想少步教师相当的分布。LIBERO上学生仅需两步推理即保留π0.5的84%性能，延迟降低78.1%，平均成功率优于已有少步蒸馏方法。以LingBot-VLA为教师时，RoboTwin 2.0单步成功率比基础学生高15.9个百分点；还将方法用于WAM并把MolmoAct2蒸馏学生部署到真实机器人。

Insight: 在线策略蒸馏可在大幅降延迟时保留大部分操控效果；摘要中的真实机器人例子未报告详细任务成功率。

Abstract: Vision-Language-Action (VLA) foundation models have scaled rapidly to enhance manipulation performance and generalizability, but this scaling incurs high computational costs that render real-world deployment increasingly challenging. Existing approaches typically mitigate this issue by designing smaller architectures or reducing the iterative denoising steps in flow-based policies. In this work, we propose FastOPD, a foundation-to-lightweight VLA framework that enables the practical deployment of large-scale VLAs through efficient on-policy distillation. Specifically, FastOPD adapts a flow map for single-state teacher supervision and combines it with a self-consistency objective to construct a compact student that learns the teacher dynamics. Furthermore, we theoretically demonstrate that minimizing this objective allows the distilled student to recover a distribution on par with that induced by an ideal few-step teacher model. We evaluate FastOPD across diverse foundation policies in simulation and real-world experiments. On LIBERO, FastOPD retains 84% of the performance of $π_{0.5}$ with only two inference steps, reducing inference latency by 78.1% while outperforming existing few-step distillation baselines in average success rate. With LingBot-VLA as the teacher, FastOPD improves the single-step success rate over the base student by 15.9 percentage points on RoboTwin 2.0. We further demonstrate its applicability to a World Action Model (WAM) and deploy a compact student distilled from MolmoAct2 on a real robot.

[118] From Language Priors to Field Adaptation: Preference Learning for Traversability Estimation cs.RO | cs.CVPDF

Simon Schwaiger, David Seyser, Alessandro Scherl, Zlatan Ajanović, Wilfried Wöber

TL;DR: 提出基于语言先验与少量偏好标注的地面可通行性适配方法，以冻结VLM特征空间中的原型表达通行程度。

Details

Motivation: 图像通行性受机器人平台、部署区域和任务偏好影响，固定训练模型难以直接适应新域，目标域逐图标注代价高。

Result: 方法在冻结视觉语言特征空间中以von Mises–Fisher混合原型表示可通行性，使用相对自然语言规则提供常识先验，再以少量相对图像标注调整目标域原型方向与效用，进行计算和样本高效微调。WayFAST实验准确度与端到端训练估计器相当，同时支持样本高效图像适配；定性实验显示语言先验有零样本应用性，微调后语义地图密集预测改善。

Insight: 将相对语言规则和少量成对图像判断结合，可降低跨机器人/跨场景适配的标注需求；摘要没有给出数值成绩及具体适配样本量。

Abstract: Image-based traversability estimation is inherently dependent on the robot platform, deployment domain, and mission preferences, which limits the applicability of purpose-trained models. To facilitate domain adaptation, this work aims to reduce the number of required annotations in the target domain using sample-efficient preference learning. Our method represents traversability through von Mises-Fisher mixture prototypes in a frozen vision-language feature space. Relative natural-language rules provide a commonsense prior, while sparse relative image annotations adapt the prototype directions and utilities to a target domain through computationally and sample-efficient fine-tuning. Experiments on WayFAST demonstrate accuracy competitive with end-to-end trained estimators while enabling sample-efficient image-based adaptation. Qualitative experiments further demonstrate the language prior’s zero shot applicability and the fine-tuned estimator’s improved dense prediction on semantic maps. Evaluation is complemented via semantic interpretation of learned prototypes by dissecting semantically close natural language prompts. Code and trained estimators available at https://resireg.github.io

[119] XGenAct: Geometry-Enhanced World Action Models through Cross-Task Generation cs.RO | cs.CV | cs.LGPDF

Tingting Du, Ziyao Wang, Guoheng Sun, Ang Li

TL;DR: 提出XGenAct，将RGB、动作、深度、表面法向和功能角色分割编码为视频，以单一视频扩散模型统一学习世界动作与结构化感知。

Details

Motivation: 现有WAM预测RGB和动作，却未显式覆盖操控需要的空间理解；已有空间监督多由独立任务头或分支提供，造成监督范围与模型结构碎片化。

Result: XGenAct用确定性编解码将多种模态表示为RGB视频，在一个视频扩散Transformer和一个目标下采样感知、动作任务，学习跨空间时间预测，无需各模态专属学习头。RLBench留出任务上，结构化感知训练提高了相对仅RGB训练的闭环成功率；五任务外部比较中成功率52%，强基线为26%。其未来深度和分割预测也优于先生成RGB再运行冻结感知专家的流程。

Insight: 把几何与功能语义压入统一视频生成目标，有望避免为不同空间任务堆叠专用模块；摘要未给RLBench具体增幅及真实机器人结果。

Abstract: World action models (WAMs) have advanced robot control by predicting how observations and actions evolve over time. Despite this progress, RGB and action based future prediction does not explicitly address the spatial understanding needed for robot manipulation. Existing efforts often add a limited set of spatial prediction tasks through specialized heads or branches, leaving both the range of spatial supervision and the model architecture fragmented. We introduce XGenAct, a world action model that represents RGB observations, robot actions, metric depth, surface normals, and functional role segmentation as RGB videos through deterministic codecs. By sampling perception and action tasks during training, XGenAct uses one video diffusion transformer and one objective to learn temporal prediction across these spaces without modality specific learned heads. On held out RLBench tasks, structured perception training improves average closed loop success over RGB only training, and XGenAct achieves 52% success in the five task external comparison, versus 26% for the strongest evaluated baselines. It also predicts future depth and segmentation more accurately than the evaluated pipelines that generate RGB first and then apply a frozen perception expert.

eess.IV [Back]

[120] ZAGNet: Zone-Aware Graph Aggregation Network for Patient-Level Lung Ultrasound Diagnosis eess.IV | cs.CVPDF

Li Chen, Shubham Patil, Rashid Al Mukaddim, Jochen Kruecker, Balasundar Raju

TL;DR: 提出区域感知图网络ZAGNet，整合多肺区肺部超声视频的时序病灶发现，处理扫描区域缺失并进行患者级诊断。

Details

Motivation: 肺部超声检查常因协议不同而缺少解剖区域，患者级诊断需整合各区域信息；逐帧模型加最大/平均池化无法建模区域间关系。

Result: ZAGNet将时间跟踪的病灶发现作为节点，以解剖相邻关系连边，由图Transformer传播邻区语境并用虚拟全局节点汇总；由于图结构不要求固定输入规模，可处理缺失区域。多中心数据包含714名患者、20,256段视频环路，检查覆盖4至16个前、后、侧胸区。实变诊断AUC为0.803，高于最大池化0.677和平均池化0.674；胸腔积液AUC为0.893，高于0.804与0.815，分别最多提升19%和11%。

Insight: 区域图推理既利用解剖邻接，也适应可变扫描协议，提升患者级诊断；临床应用仍需结合实际中心与病种校验。

Abstract: Patient-level lung ultrasound (LUS) diagnosis requires integrating findings acquired across multiple anatomical zones, yet clinical examinations frequently involve variable and incomplete scanning protocols with missing zones. Existing diagnostic AI methods primarily analyze individual frames or video loops, relying on heuristic aggregation strategies such as max or mean pooling that ignore inter-zone relationships for patient-level inference. This paper presents ZAGNet, a Zone- Aware Graph Neural Network that represents temporally tracked pathology findings as graph nodes connected by anatomical zone adjacency. A graph transformer network propagates contextual information across neighboring lung regions, while a virtual global node aggregates graph-level features to predict patientlevel consolidation and pleural effusion using only patient-level supervision. ZAGNet accommodates missing zones by computing on a graph structure without fixed input format or size. We evaluate ZAGNet on a multicenter dataset of 714 subjects (20,256 LUS video loops) with exams varying from 4 to 16 zones across anterior, posterior, and lateral thoracic regions. For consolidation diagnosis, ZAGNet achieved an AUC of 0.803 compared to 0.677 (max pooling) and 0.674 (mean pooling). For pleural effusion, AUC increased to 0.893 from 0.804 (max pooling) and 0.815 (mean pooling). These represent improvements of up to 19% and 11% for consolidation and pleural effusion respectively. The results demonstrate that graph-based inter-zone reasoning provides an effective and clinically consistent framework for automated patient-level LUS assessment.

[121] Confidence-Gated Cloud-Edge Cascade Triage via Variational Risk Minimization for Medical Imaging eess.IV | cs.CV | cs.LGPDF

Xinye Yang, Zhusi Zhong, Scott Collins, Michael Bernstein, Grayson Baird

TL;DR: 提出变分风险最小化VRM，用LVLM报告变体代表潜在临床解释分布，为模态缺失的胸片急诊分诊提供不确定性感知蒸馏。

Details

Motivation: 急诊胸片分诊决策先于报告，而多模态基础模型需要图文输入；以单一教师报告目标蒸馏可能不稳定，并受缺失模态和幻觉监督影响。

Result: VRM把LVLM生成的报告变体视作潜在临床解释的蒙特卡洛样本，从边缘化教师分布学习，而不是蒸馏单一目标。在编码器匹配条件下，它优于直接微调基线、校准更好，并能较强恢复受幻觉监督影响的表现；边缘化监督降低报告选择不稳定。在紧凑边缘学生中，置信度门控级联达到AUC 0.941、平均延迟103毫秒、云端升级率20.3%，形成明确的可靠性—时延操作点。

Insight: 对报告不确定性进行边缘化，可减少单一文本目标带来的监督波动；具体临床部署效用取决于所报告的胸片任务和云端升级策略。

Abstract: Emergency chest X-ray (CXR) triage has a structural modality gap: reports arrive after triage decisions, yet multimodal foundation models require image-text inputs. We present Variational Risk Minimization (VRM), a distillation framework that treats LVLM-generated report variants as Monte Carlo samples of latent clinical interpretations. Rather than distilling from a single teacher target, VRM learns from a variationally marginalized teacher distribution, enabling uncertainty-aware supervision under missing-modality constraints. Under matched encoder families, VRM outperforms direct fine-tuning baselines and improves calibration with strong recovery from hallucinated supervision. Marginalized supervision reduces report-selection instability. In our compact edge-student instantiation, a confidence-gated cascade reaches AUC 0.941 at 103ms average latency with 20.3% cloud escalation, yielding an explicit reliability-latency operating point for cloud-edge clinical workflows.

[122] Event-guided Neural Video Compression eess.IV | cs.CV | cs.MMPDF

Jiyun Kong, Jungwoo Kim, Enes Eray Demirtas, Touradj Ebrahimi, Jong-Seok Lee

TL;DR: 提出事件引导神经视频编解码器ENVC，利用编码端与解码端共享的事件流提升RGB视频压缩效率。

Details

Motivation: 神经视频编解码主要从RGB帧提取运动和时序上下文，未利用记录帧间亮度变化的事件流这一互补时间信号。

Result: ENVC在运动编码中形成事件引导运动先验并编码剩余运动残差；在帧编码中以事件条件预测器生成多尺度特征，细化门控时序上下文。作者合成配对RGB—事件训练数据，并与真实事件比较其预测效用。在六个基准上，相对DCMVC，按RGB-PSNR计算的平均BD-rate节省39.13%，按LPIPS为67.63%；大运动序列仍有收益，模型能有效融合事件信息。

Insight: 将事件流作为共享辅助模态可显著减少RGB码率需求；训练数据由合成事件构造，但作者通过真实事件比较验证预测价值。

Abstract: Neural video codecs derive motion and temporal contexts mainly from RGB frames, leaving room for cross-modal guidance from complementary temporal observations. Event streams can provide such observations by recording brightness changes between frames. In this work, we propose an Event-guided Neural Video Codec (ENVC) that uses events shared by the encoder and decoder to improve RGB compression efficiency. For motion coding, ENVC forms an event-guided motion prior and codes the remaining motion residual. For frame coding, an event-conditioned predictor supplies multi-scale features for gated temporal context refinement. To support training and evaluation on standard video datasets, we synthesize paired RGB-event data and assess its predictive utility through comparisons with real events. Across six benchmarks, ENVC achieves average BD-rate savings of 39.13% using PSNR-RGB and 67.63% using LPIPS relative to DCMVC. Further analyses show that our gains persist on large-motion sequences and that ENVC effectively learns to integrate event information. These results demonstrate the potential of events as a complementary modality for reducing the RGB coding rate. Our model and code are available at https://github.com/kjungwoo03/ENVC.

[123] Reliability Stress Tests and Decision-Time Routing for Chest X-ray Vision-Language Models eess.IV | cs.CVPDF

Xinye Yang, Zhusi Zhong, Scott Collins, Grayson Baird, Xuyu Wang

TL;DR: 构建胸片视觉语言模型可靠性压力测试，并提出按决策时收益选择是否升级多代理推理的路由框架。

Details

Motivation: 医疗VLM结果会受工作流、提示策略和基准构造影响，但多数研究将它们分开考察；单看精确匹配还可能高估总是预测“正常”的保守模型。

Result: 研究在两个平衡数据集（私有报告数据集及整理的MIMIC子集）上测试CheXagent、MedGemma-4B和MedGemma-27B，组合三种提示风格与单模型/多代理两类流程，共36种配置。结果显示精确匹配可能高估保守预测者，多代理推理对不同模型配置有利有弊。决策时路由只在有益时升级多代理推理，相比固定工作流改善成本—质量权衡。

Insight: 医疗VLM评估需联合考虑提示敏感性、失败模式和工作流，而非只看单一准确率；摘要未给各配置或路由节省成本的具体数字。

Abstract: Medical vision-language model (VLM) evaluation is sensitive to workflow design, prompting strategy, and benchmark construction, yet most studies treat these factors in isolation. We introduce a reliability stress test for chest X-ray interpretation built on two balanced datasets (a private report-backed set and a curated MIMIC subset). Three medical VLMs (CheXagent, MedGemma-4B, and MedGemma-27B) are evaluated across three prompt styles and two workflows (single-VLM and multi-agent), producing 36 configurations. We show that exact-match accuracy alone can overstate the effectiveness of conservative models that default to “Normal” predictions. Diagnostic reliability also depends heavily on model family and scale: multi-agent reasoning helps some configurations but hurts others. Building on these observations, we propose a decision-time routing framework that selectively escalates to multi-agent inference only when beneficial, improving the cost-quality trade-off over fixed workflows. Our results highlight the need for evaluation protocols that jointly consider prompt sensitivity, failure-mode diversity, and workflow choice before clinical deployment.

[124] Wrong Organ, Right Physics: Transferring Echocardiography Pretraining to Lung Ultrasound for Tuberculosis Screening eess.IV | cs.CV | cs.LGPDF

Christiaan M. Geldenhuys, Joshua M. Jansen van Vüren, Véronique Suttels, Trevor Brokowski, Ablo P. Wachinou

TL;DR: 评估心脏超声预训练迁移到肺部超声结核筛查的效果，发现特征标准化比预训练来源更关键。

Details

Motivation: 肺部超声适合基层结核筛查但标注队列有限；超声心动图与肺超声共享成像物理机制，因而可能提供高资源预训练，但该迁移是否真正有益尚不确定。

Result: 比较三类架构的17个编码器，其中通用视频预训练V-JEPA2-L与心超预训练EchoJEPA-L仅训练语料不同。编码器选择对分类影响范围仅2.50个百分点，小于测量分辨率2.71点；在编码器与分类器间标准化特征使全部17个编码器平均提升1.23个百分点（p=1.5×10^-5）。留出测试中，所有开发折选出的编码器均比基线AUROC高，最高增加2.57点；90%敏感度时特异度79.3%，基线为60.3%。预先指定的EchoJEPA-L与V-JEPA2-L差异仅-0.16个百分点（p=0.926），无证据表明心超语料优于通用视频语料。

Insight: 该队列下标注数据而非编码器选择是主要限制，特征条件化对全部编码器有效；视频编码器使用复制静帧，无法区分预训练域差异与视频模型用于静态输入的影响。

Abstract: Lung ultrasound (LUS) is attractive for tuberculosis (TB) screening at primary-care level, but labelled cohorts are small. Echocardiography carries no such constraint, while sharing the same underlying ultrasound imaging physics, signal processing and B-mode appearance as LUS. We ask whether an encoder pretrained on that high-resource ultrasound domain carries representations that remain usable in the low-resource one. Only the encoder varies, across seventeen encoders spanning three architecture families. Among them, a latent-predictive video encoder pretrained on generic video (V-JEPA2-L) and its echocardiography counterpart (EchoJEPA-L) differ in pretraining corpus alone. The choice among these encoders does not resolve the classification, the whole family spanning 2.50 percentage points against a measurement resolution of 2.71. What moves the task instead is feature conditioning. Standardising the features between the encoder and the classifier improves all seventeen encoders by a mean of +1.23 percentage points at $p=1.5\times10^{-5}$. On the held-out test set every encoder selected on the development folds stands above the baseline system by up to +2.57 percentage points of area under the receiver operating characteristic curve (AUROC), and specificity at 90% sensitivity reaches 79.3% against 60.3%. The contrast specified in advance, EchoJEPA-L against V-JEPA2-L, measures -0.16 percentage points at $p=0.926$. We therefore find no evidence that shared ultrasonic physics alone makes echocardiography a more productive pretraining corpus than generic video, and any advantage, if present, is smaller than this cohort can resolve. The video encoders receive replicated still images, however, so whether this absence of an effect reflects the pretraining domain or a video encoder applied to static frames cannot be separated. The limiting factor is the labelled cohort rather than the encoder.

q-bio.QM [Back]

[125] Toward Controlling Biology with Language:Offline Learning of Prompt-Conditioned Interventions for Cells, Organoids, and Biobots q-bio.QM | cs.AI | cs.CV | cs.NE | cs.ROPDF

Nam H. Le, Douglas Blackiston, Michael Levin, Josh Bongard

TL;DR: 展示仅凭视觉语言模型对既有实验结果的判断，可离线学得自然语言到活体生物干预的映射。

Details

Motivation: 把自然语言接口扩展到活体系统困难，因为干预与结果之间没有封闭形式语义，配对语言—干预—结果数据又需要逐项湿实验，采集昂贵；使用历史数据加VLM评价是否可靠尚不确定。

Result: 作者以无神经系统的合成多细胞构造xenobot为例，将指令映射至档案中已产生对应行为的干预，完全离线训练，并将VLM自身判断作为唯一训练奖励，无需新实验或人工验证。对训练时留出的档案数据评估，新指令准确率为80.0%，高于66.7%的随机机会基线，并与直接用真实标签训练的网络相当。

Insight: 离线档案配合VLM评分可降低生物语言接口对新增湿实验的依赖；目前证据来自xenobot和档案留出评估，标签判断仍依赖VLM。

Abstract: Artificial intelligence increasingly serves as a natural-language interface to complex technical systems, letting people accomplish sophisticated tasks by describing what they want rather than specifying how to do it. Extending this interface to living systems is harder: unlike code or images, a biological intervention has no closed-form linguistic meaning, and the paired language-intervention-outcome data needed to learn such a mapping is expensive to collect, since each example requires its own wet-lab experiment. One way around this is to treat an existing archive of interventions and their already-observed outcomes as a fixed, offline dataset, and use a vision-language model to judge, without any new experiments, whether an archived outcome matches a natural-language description. But whether that judgment is reliable enough to train a language-to-intervention mapping on – without new experiments and without human validation – has remained unclear. Here we show that a natural-language interface for a living organism – a xenobot, a synthetic multicellular construct with no nervous system – can be learned entirely offline this way, using a vision-language model’s own judgment as the sole training reward: an instruction is mapped to the intervention already on record as producing the described behavior. This mapping generalizes to entirely new instructions, evaluated against archive data withheld from training (80.0% held-out accuracy vs a $66.7% chance baseline, matching a network trained directly on ground-truth labels).

Table of Contents

cs.CV [Back]

[1] DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents cs.CV | cs.AI | cs.LGPDF

[2] EditHero: A Benchmark for Long-Horizon Part-Level 3D Editing and Vibe Modeling cs.CV | cs.AI | cs.GRPDF

[3] SCOPE-4D: Endoscopic 4D Geometry Foundation Models cs.CVPDF

[4] EviDent-CBCT: Evidence-Bottlenecked Report Generation from Dental CBCT under Non-Exhaustive Report Supervision cs.CV | cs.AIPDF

[5] An AI-Based Multi-Stage Approach for Androgenetic Alopecia Assessment from Low-Magnification Scalp Images cs.CVPDF

[6] A Simulation-Grounded Agentic VLM Framework for Wildfire Monitoring and Reporting cs.CV | cs.GRPDF

[7] Octrees as an Explicit 3D Language cs.CVPDF

[8] MeshQuery: Agentic Seam Planning for UV Parametrization cs.CVPDF

[9] DeepStratNet: A Context-Aware Coordinate Regression Framework for Seismic Horizon Tracking under Sparse Labels cs.CVPDF

[10] GRAFT: Growing Agglomerative Foundation Models via Continual Teacher Distillation cs.CVPDF

[11] Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory cs.CVPDF

[12] CHASE-VLA: Post-Training Quantization Framework for Vision-Language-Action Models with Chunk-Aware Scale Estimation cs.CVPDF

[13] Imagine the Future, Internalize the Gist: Efficient VLA Reasoning via Internalized Spatiotemporal Imagination cs.CVPDF

[14] SymRegFlow: Symmetry-Regularized Flow Matching for Video World Models cs.CVPDF

[15] FiberGeoText: A Vision-Language Model for Population- Level Organization of Superficial White Matter cs.CVPDF

[16] Revisiting Visual Representation Enhancement of VLMs via Kernel Canonical Correlation Analysis cs.CV | cs.AI | cs.LGPDF

[17] TerrainForge: Physics-Grounded road geometry Editing for Counterfactual Autonomous Driving cs.CVPDF

[18] Seeing, Saying, but Not Using: From Reportable Spatial Facts to Usable States in Multimodal Large Language Models cs.CVPDF

[19] TRAC: Trajectory-aware Reuse and Adaptive Correction for Efficient Autoregressive Video Generation cs.CVPDF

[20] Revealing Epistemic Uncertainty in MLLMs via Causal-Invariant Masking cs.CV | cs.AIPDF

[21] Found but Not Read: When Extracted Text Closes the Retrieval-Reading Gap in Document Vision-Language Models cs.CVPDF

[22] Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation cs.CVPDF

[23] TerraVis: Towards Evaluation of World-Grounded Visual Consistency in Text-to-Image Generation via MLLM Workflows cs.CVPDF

[24] Kinematics-Induced Multimodal 3D Human Pose Estimation with Subject-Level Privacy cs.CVPDF

[25] When Predicting Nothing Beats SAM 3: Revisiting Evaluation in Video Object Segmentation cs.CVPDF

[26] ReSCUE: Re-translation with Sentence Commitment for Unsegmented Long-Form Simultaneous Sign Language Translation cs.CV | cs.CLPDF

[27] OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection cs.CV | cs.AI | cs.ROPDF

[28] Parasitic Co-Denoising: Unlocking 3D Human Motion Generation in a Frozen Video Diffusion Model cs.CVPDF

[29] NegT2IBench: When Negation Changes the Picture. A Polarity Benchmark for Text-to-Image Models cs.CV | cs.AI | cs.LGPDF

[30] BeeWhere: Segmenting Bumble Bee Colonies to Quantify Behavioral Effects cs.CVPDF

[31] Beyond Single Videos: Benchmarking and Active Evidence Seeking for E-Commerce Cross-Video Reasoning cs.CV | cs.AIPDF

[32] Foresight: planning future perception in streaming VLMs without retraining cs.CV | cs.AIPDF

[33] In-Distribution Forcing for Long Video Generation at Test Time cs.CVPDF

[34] Behavior Pack Optimization for Video MLLM Post-Training cs.CVPDF

[35] Does Physics Live in the Activations? Localizing Physical Quantities in Video Diffusion Models cs.CV | cs.LGPDF

[36] Bridging Research and Practice: A Systematic Evaluation of Generalist and Dermatology-Specific Models in Clinical Skin Lesion Classification cs.CVPDF

[37] Contextual Flow Matching: Adaptive Step Selection in Flow Models for Efficient Visual Generation cs.CV | cs.AIPDF

[38] VDOT++: Unified Few-Step Video Generation via Unbalanced Optimal Transport Distillation cs.CVPDF

[39] VisionMX: Unlocking Microscaling Post-Training Quantization for Vision Models cs.CVPDF

[40] Moving Forward with Video Saliency: A New Dataset and Benchmark where Motion Matters cs.CVPDF

[41] EVEWorld: Physical Evolution Supervision for Embodied World Models cs.CVPDF

[42] Interpretable Deepfake Detection in Videos via Explicit Forensic Features and Temporal Modeling cs.CVPDF

[43] Native Action-Prior Learning from Videos for World Action Models cs.CV | cs.ROPDF

[44] From Patching to Pruning Visual Computation in Vision Language Models cs.CV | cs.LGPDF

[45] Corrupted but Correct: Why Vision-Language Models Lie to Themselves Internally cs.CV | cs.AIPDF

[46] Beyond Entropy: Self-Diagnostic Multi-Role Token Optimization for Video Reasoning cs.CVPDF

[47] OuroReward: Sequential Reward Scheduling for Reinforcement Learning in Text-to-3D Generation cs.CVPDF

[48] A Vision-Language Model (VLM)-based Pipeline for End-to-End Procedural Modeling of Field-Grown Maize from Point Clouds cs.CVPDF

[49] UniDynamics: Event-RGB Fusion for Unified Future 4D Dynamic Scene Generation cs.CVPDF

[50] Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation cs.CV | cs.AIPDF

[51] Feedforward Novel View Synthesis for Heterogeneous Cameras cs.CVPDF

[52] Fed-ADApt: Federated Anytime Depth Adaptation for Resource-Aware Medical Image Segmentation cs.CVPDF

[53] ManifoldSplat: Language-Guided Semantic Shape Editing of 3D Gaussian Head Avatars cs.CVPDF

[54] Rethinking What to Cache in Few-Step Diffusion Transformers: Solver-Aware Target Selection cs.CV | cs.AIPDF

[55] DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generation cs.CVPDF

[56] DEPICT: Scoring Text-to-Image Alignment by Answer Agreement cs.CVPDF

[57] LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generation cs.CV | cs.AIPDF

[58] World Embedding Benchmark cs.CV | cs.CLPDF

[59] FlowHMR: Physically Plausible Motion Capture from Video cs.CVPDF

[60] Decoding the Functional Roles of Register and High-Norm Patch Tokens in Vision Transformers cs.CVPDF

[61] 4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes cs.CV | cs.AI | cs.GRPDF

[62] ProAR: Learning Prospective Reasoning with Autoregressive Video Models cs.CVPDF

[63] MoSE3: Learning World-Space SE(3) at Every Pixel cs.CVPDF

cs.CL [Back]

[64] APDMem: Agent-Controlled Progressive Disclosure for Query-Adaptive Long-Term Memory cs.CL | cs.AIPDF

[65] Counterexample Generation via Per-Theorem Symbolic Verifiers: When Imitation Hurts and Reinforcement Repairs cs.CL | cs.AIPDF

[66] Learning When to Commit from Partial Speech for End-to-End Simultaneous Speech Translation cs.CLPDF

[67] Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks cs.CLPDF

[68] Large Language Continuous Diffusion Models cs.CL | cs.AI | cs.LGPDF

[69] EpiWorld: Grounding LLM Policy Agents in Epidemiological World Models cs.CLPDF

[70] Beyond Correctness: Resolving Underspecification in Agentic Text-to-SQL cs.CLPDF

[71] Text-Centric Post-Training for Omni-Modal Reasoning cs.CLPDF

[72] Clinical Concept Centers in LLMs cs.CL | cs.LGPDF

[73] Adaptive Mutual Distillation for Balanced Multi-Task Post-Training of Large Language Models cs.CLPDF

[74] How Robust Is Multimodal Claim Verification to LLM Rewriting? cs.CLPDF

[75] Evaluating VQA in Vision Language Models using Cooperative Principles cs.CLPDF

[76] Enhancing Biomedical Named Entity Recognition via Multiple Programming Languages Instruction Tuning and Ensemble Method cs.CLPDF

[77] OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination cs.CLPDF