Table of Contents
cs.CV [Back]
[1] UltraBench 2: Towards Robust Evaluation of Vision Foundation Models on Ultrasound cs.CV | cs.LGPDF
Ashwath Radhachandran, Adam Tupper, Christian Gagné, William Speier
TL;DR: UltraBench 2建立覆盖多解剖部位和任务的标准化超声视觉基础模型评测基准。
Details
Motivation: 超声基础模型逐步增加,但评测设计滞后,导致模型比较分散、不一致,进展难以衡量。
Result: 基准对现有视觉基础模型的分析显示,超声专用预训练在分类上仍领先,而通用先进模型的分割表现已接近超声专用模型。
Insight: 通过强调广泛解剖与任务覆盖、标准化、可复现和易用性,为超声模型建立统一比较环境。
Abstract: Benchmarking is an increasingly critical part of research in machine learning and the domains where it is applied, including healthcare. Yet, despite the steady development of new ultrasound foundation models in recent years, the development of well-designed benchmarks to evaluate them has lagged behind. This deficiency has led to fragmented and inconsistent evaluations of competing models, making it difficult to measure progress. To address this issue, we introduce UltraBench 2, a comprehensive benchmark with wide anatomical and task coverage, and a focus on standardization, reproducibility, and ease-of-use. Using this benchmark, we compare existing vision foundation models for ultrasound image analysis. Our analyses demonstrate that ultrasound-specific pretraining still leads on classification, but that state-of-the-art general-purpose models have drawn level on segmentation.
[2] Token Clustering and Semantic Sequence Mamba for Hyperspectral Image Classification cs.CVPDF
Yimin Zhu, Mahmood Elahi, Lincoln Linlin Xu
TL;DR: STMamba按语义聚类组织高光谱图像稀疏token序列,并以空间、光谱双路Mamba建模长程依赖。
Details
Motivation: 高光谱分类需处理复杂空间结构和谱空异质性;常规视觉状态空间模型按预设邻域构造序列,忽略语义相似性与空间非平稳性。
Result: 在三个大规模基准上,STMamba的定量和定性结果均优于当时先进方法。
Insight: 密度感知聚类找代表中心并估计软成员关系,四叉树再从各簇保留空间分散token;跨尺度邻域注意力恢复稠密特征,同时减少冗余像素表示。
Abstract: Although hyperspectral images (HSIs) provide rich spectral-spatial information, accurate pixel-level classification remains challenging because of spectral-spatial heterogeneity and complex spatial structures. Existing vision state space models (Mamba) typically construct sequences according to predefined spatial neighborhoods, without explicitly accounting for semantic similarity or spatial non-stationarity. To address this limitation, we propose Token Clustering and Semantic Sequence Mamba (STMamba), which organizes sparse tokens into semantically coherent sequences for hyperspectral image classification with the following features. First, at the macro level, a hierarchical encoder decoder progressively selects semantic tokens with the Token Clustering Module (TCM) and restores dense features using a parameter-free Cross-scale Neighborhood Attention (CNA) Upsampler. Second, at the micro level, TCM first identifies representative cluster centers through density-aware clustering and estimates soft memberships based on feature similarity. A quadtree-based dynamic selection strategy then retains sparse and spatially distributed tokens from each semantic cluster, forming coherent semantic-token sequences while reducing redundant pixel-wise representations. Third, parallel Spatial and Spectral Semantic-wise Sequencing Mamba (SWSM) modules capture complementary long-range spatial and spectral dependencies within homogeneous semantic token sequences while suppressing irrelevant interactions across heterogeneous regions. Experimental results on three large-scale benchmark datasets demonstrate that STMamba outperforms the SOTA methods with respect to quantitative and qualitative results.
[3] $\unicode{x1F493}$Heartian: Physiology-Aware Relightable Gaussian Head Avatar cs.CV | cs.GRPDF
Xiaoyue Fan, Jose Echevarria, Akshay Paruchuri, Kaan Akşit
TL;DR: Heartian把心动周期引起的皮肤细微色变编码为可重照明高斯头像的材质属性,以保留远程光电容积脉搏信号。
Details
Motivation: 常规高斯头像通常假设面部固有外观随时间静态,忽略心跳造成的细微皮肤颜色变化。
Result: 在152段UBFC-rPPG、PURE和MMPD录制上,属性空间心率误差为0.29 bpm;渲染头像后最佳测试解码器在MMPD上误差0.97 bpm,平均PSNR仅下降0.005 dB。
Insight: 在接触式PPG监督下,用两项高斯函数表示目标心动波形,再由轻量MLP学习逐帧空间残差,使脉搏信号可恢复且不明显损伤重建质量。
Abstract: Gaussian head avatars typically model intrinsic facial appearance as temporally static, omitting subtle cardiac-induced skin-color variation. We propose $\unicode{x1F493}$Heartian, a physiology-aware modulation framework that learns cardiac-cycle-dependent per-frame albedo modulation of facial skin-region Gaussians within a relightable head avatar to encode remote photoplethysmography (rPPG) signals. Using synchronized contact PPG supervision, $\unicode{x1F493}$Heartian models the prescribed cardiac waveform as the sum of two Gaussian functions and learns per-frame spatial residuals via a lightweight MLP. Across 152 stationary recordings from UBFC-rPPG, PURE, and MMPD, attribute-space recovery of the supplied signal achieves a pooled recording-level heart-rate MAE of 0.29 bpm and MAPE of 0.38%. The signals remain detectable after rendering by benchmark rPPG methods, with the best tested configuration - a motion-augmented TS-CAN decoder pretrained on UBFC-rPPG - recovering heart rate from the rendered MMPD avatars at 0.97 bpm MAE and 1.21% MAPE. Meanwhile, $\unicode{x1F493}$Heartian maintains reconstruction quality comparable to the baseline, with negligible average PSNR degradation of 0.005 dB. Overall, our work embeds recoverable rPPG signals as controllable material attributes to subject-specific Gaussian head avatars while retaining the reconstruction quality.
[4] PePESeg3D: Perception Prior Enhances Multi-Scale Segmentation for 3D Gaussian Splatting cs.CVPDF
Sungjae Choi, Seunghee Koh, Junmo Kim
TL;DR: PePESeg3D将感知先验同时用于3D高斯场景几何重建和多尺度语义分割特征学习。
Details
Motivation: 现有3D高斯方法通常独立重建几何并学习分割特征,几何缺乏语义结构,特征又依赖不完整掩码监督。
Result: 在SPIn-NeRF、LERF-Mask和NVOS上,方法在多尺度分割和场景重建均达到先进水平。
Insight: 单目深度和掩码约束促成语义一致的对象几何;之后以稠密深度—颜色线索及跨视角一致质心监督,弥补二维基础模型生成掩码的不完整。
Abstract: Recent advancements in 3D Gaussian Splatting (3DGS) have extended its capabilities to multi-scale segmentation. Existing methods reconstruct a scene with Gaussian primitives and learn multi-scale segmentation features separately, which leaves the geometry unaware of semantic structure and the feature learning dependent on incomplete mask supervision. To address these limitations, we present PePESeg3D, a novel framework that injects perception priors into a multi-scale 3D Gaussian segmentation pipeline. To fully exploit perception priors, we integrate them not only into contrastive feature learning but also into the upstream geometry reconstruction. Specifically, PePE Reconstruction incorporates monocular depth and mask constraints to ensure semantically coherent object structures. Building on this aligned geometry, PePE Contrastive Learning leverages dense depth-color cues and view-consistent centroid supervision to compensate for the incompleteness of multi-scale masks obtained from a 2D foundation model. Extensive experiments on the SPIn-NeRF, LERF-Mask, and NVOS benchmarks demonstrate that PePESeg3D achieves state-of-the-art performance in both multi-scale segmentation and scene reconstruction, highlighting the importance of integrating perception priors into both geometry optimization and feature learning for accurate multi-scale 3D segmentation. Our code is available at https://github.com/BeCow5X5/PePESeg3D.
[5] M-plicits: Neural Implicit Surfaces via Nested Multiscale Residuals cs.CV | cs.GR | cs.LGPDF
Vinícius da Silva, Isabelle Melo, Matheus Bessa, Guilherme Schardong, Luiz Schirmer
TL;DR: M-plicits以嵌套邻域中的多尺度MLP残差建模隐式表面,在降噪、训练效率和实时渲染间取得平衡。
Details
Motivation: 单MLP推理开销大,网格表示可能限制平滑度并拟合噪声;既有多尺度方法也易因频谱截断产生伪影。
Result: 在Stanford和Thingi32上,粗配置平均Chamfer距离最佳,细配置中位Chamfer距离和IoU最佳;比网格基线少一个数量级参数且抗噪性更好。
Insight: 后续残差只在前一级零水平集附近窄带监督,粗网络先形成低通几何先验,再渐进细化;多尺度球面追踪与基于GEMM的解析法线计算支持实时渲染。
Abstract: Encoding input coordinates with sinusoidal functions into multi-layer perceptrons (MLPs) has proven effective for implicit neural representations (INRs) of surfaces defined as zero-level sets. However, existing methods often struggle to balance training efficiency, rendering speed, and noise robustness: single-MLP approaches are expensive at inference, grid-based representations are fast but can limit surface smoothness and overfit input noise, and previous multiscale approaches frequently capture noise and produce artifacts due to hard spectral truncation. To address these limitations, we propose M-plicits, a multiscale framework that models surfaces as a residual sum of MLPs trained via a sequence of nested neighborhoods. Unlike existing residual approaches that rely on standard domain-wide sampling and require costly mesh extraction for visualization, our method strictly localizes supervision to narrow bands around the previous zero-level sets. This nested design naturally provides robustness against noisy input data: the coarse network acts as a low-pass filter that establishes a clean geometric prior, while subsequent residuals progressively refine the geometry without fitting to high-frequency artifacts. We further introduce a multiscale sphere-tracing algorithm and a GEMM-based analytical normal computation that bypasses auto-differentiation entirely, yielding high-fidelity real-time rendering. On Stanford and Thingi32, M-plicits achieves the best mean Chamfer distance in the coarse configuration and the best median Chamfer distance and IoU in the fine configuration, with substantially better noise robustness than iNGP, BACON, and IDF, while using an order of magnitude fewer parameters than grid-based baselines. Code, models, and data will be released at https://github.com/dsilvavinicius/m-plicits.
[6] GeoNLI - A Natural Language Interpreter for Satellite Imagery cs.CVPDF
Ashutosh Gandhe, Anupam Rawat, Geet Sethi, Kabir Nasiruddin, Madhav Kotecha
TL;DR: GeoNLI以模块化视觉语言流水线统一完成卫星图像描述、问答和视觉定位。
Details
Motivation: 遥感多模态模型往往针对不同任务及异构数据训练,难以统一兼顾图像描述、VQA和目标定位。
Result: 在VRS Bench和NWPU-VHR-10评测中,描述准确率82%、VQA准确率83.32%、定位准确率64.94%;二元、数值和语义问题准确率分别为90.94%、52.04%和92.06%。
Insight: 以EarthMind承担描述和问答,定位阶段组合多种RemoteSAM/SAM及扩散分割结果,采用多数投票得到统一的多模型流程。
Abstract: Multi-modal multitasking models have shown strong performance on remote sensing datasets. However, because these models are trained on heterogeneous data and vary across tasks, designing a unified model that performs well in captioning, visual question answering (VQA), and visual grounding remains challenging. In this work, we evaluate several models on the VRS Bench and NWPU-VHR-10 datasets. The EarthMind model demonstrates strong results in both captioning and VQA. For grounding, we propose multiple pipelines - RemoteSAM-SAM-v1, RemoteSAM-SAM-v2, and DiffuSAM - and ultimately adopt a majority-voting ensemble across EarthMind, RemoteSAM, SAM3, Falcon, RemoteSAM-SAM3-v1, RemoteSAM-SAM3-v2, and DiffuSAM predictions. Our unified, modular pipeline integrates advanced SAM variants with multimodal LLMs to jointly perform captioning, VQA, and grounding. It achieves 82% accuracy on captioning and 83.32% on VQA, with 90.94%, 52.04%, and 92.06% for binary, numeric, and semantic question types respectively. For grounding, it attains 64.94% accuracy. By combining diverse VLMs with our custom RemoteSAM-SAM3 models through ensemble majority voting, the system delivers more accurate and consistent remote-sensing understanding than task-specific approaches.
[7] Small yet Assistive: Spatially-Aware Post-Training for Low Vision cs.CV | cs.CLPDF
Rishabh Choudhary, Shreyansh Raj, Umesh Goyal, Shubh Kashyap, Shrestha Kumar
TL;DR: Smol-VL-BLV以5亿参数模型和空间感知后训练,为低视力用户提供可在手机离线运行的细节化视觉辅助。
Details
Motivation: 大型VLM可生成高质量描述却不能在手机上运行,小模型响应较快但缺少方向、距离和危险提示,难用于安全导航。
Result: 相较基线,空间分数提升19.3%、社会场景分数提升14.8%,OCR-Bench提高101.5%、TextVQA提高44.2%;压缩后约450MB,可在中端Android设备离线运行。
Insight: 教师—学生蒸馏结合GRPO复合奖励,专门优化方向语言、距离和危险识别;最后轻量微调用于恢复通用描述能力并保留空间落地。
Abstract: An estimated 1 billion people worldwide live with vision impairment, yet current vision-language models (VLMs) produce descriptions too vague for safe navigation by blind and low-vision (BLV) users. Large VLMs can generate high-quality audio-description-compliant narrations but cannot run on mobile devices; small VLMs offer competitive latency but lack spatial detail, directional cues, and hazard awareness for navigational assistance. We present Smol-VL-BLV, a compact VLM for blind and low-vision users that closes this gap using a 500M decoder transformer model and two post-training mechanisms: (1) teacher-student distillation and (2) Group Relative Policy Optimization (GRPO) with a composite BLV reward targeting directional language, metric distances, and hazard detection. Because multi-stage post-training can induce catastrophic forgetting, we add a lightweight finetuning stage after the last stage GRPO finetuning to recover general descriptive quality while preserving BLV-specific spatial grounding. Our best model substantially outperforms the baseline across various benchmarks, including tasks: VQA, BLV captioning, OCR, and latency. Compared with the baseline for relative improvement, it improves the Spatial score gain of 19.3%, and the Social score gain of 14.8%. It also increases OCR-Bench by 101.5%, and raises TextVQA accuracy by 44.2%. These results show that BLV-focused post-training improves both accessibility-specific spatial grounding and general visual-text reasoning. Deployed on a mid-range Android smartphone via Mixed-Precision Quantization, the model remains approx. 450 MB and runs entirely on-device, offline and without network dependency, generating descriptions with latency dependent on host hardware capabilities. Our model, dataset, and code is publicly released at https://smol-vl-blv.github.io/Smol-VL-BLV-website/
[8] DrGait: Biomechanically Grounded Visual Reasoning for Interpretable Clinical Gait Analysis cs.CV | cs.AIPDF
Xiangyu Yin, Shiqi Wang, Abrar Alamri, Yasir Aljohani, Weichen Liu
TL;DR: DrGait让视觉语言模型作为临床规划器,调用确定性生物力学工具分析步态视频,减少几何测量幻觉。
Details
Motivation: 黑箱分类器难解释,直接让VLM观看步态原视频又难测量细微几何变化,容易产生不可靠判断。
Result: 锚定于可验证几何和时间测量后,DrGait取得有竞争力的诊断准确率并生成透明、可审计报告;摘要未给出具体数值。
Insight: 分诊—验证—综合流程先提出诊断假设,再基于三维网格轨迹、二维姿态和事件关键视频片段调用工具核验,并用反馈闭环更新推理上下文。
Abstract: Current automated gait analysis for clinical applications relies on uninterpretable black-box classifiers. Although Vision-Language Models (VLMs) offer strong reasoning capabilities, applying them directly to gait videos often leads to hallucinations, because they struggle to measure subtle geometric deviations from raw visual contexts. To address this, we introduce DrGait, a training-free agentic framework that shifts the VLM’s role from a direct visual reasoner to a clinical planner. DrGait decouples semantic reasoning from geometric perception through a structured Triage-Verification-Synthesis (TVS) workflow. Given an input video and a set of basic spatiotemporal metrics, the DrGait agent first performs a heuristic triage to propose diagnostic hypotheses, which are then verified by autonomously calling deterministic biomechanical tools that operate on reconstructed 3D mesh trajectories, segmented 2D pose tracks, and event-centered video evidence. Finally, a closed-loop mechanism recursively updates the agent’s reasoning context based on the feedback. By anchoring VLM’s reasoning in verifiable geometric and temporal measurements, DrGait reduces hallucinations, achieving competitive diagnostic accuracy while generating transparent and audit-ready clinical reports.
[9] DeltaWAM: Delta World Action Models for Bimanual Manipulation cs.CV | cs.ROPDF
Han Yan, Zishang Xiang, Haokai Jiang, Zeyu Zhang, Qilin Wang
TL;DR: DeltaWAM联合预测视觉状态变化和机器人动作,并以流式差分记忆降低双臂操作推理成本。
Details
Motivation: 传统WAM训练时重复预测大量不变画面,动作动力学易与无关外观变化耦合;推理时完整处理观察也会拖慢控制。
Result: RoboTwin干净环境成功率从Fast-WAM的81.3%升至85.4%,视觉随机化下从75.8%升至83.9%;架构减少17.78%至23.77%训练FLOPs,记忆机制使单步延迟及FLOPs分别降36.57%和31.55%。
Insight: 以密集锚点、稀疏视觉差分和动作流联合预测;Streaming Delta Memory用紧凑观测变化更新缓存场景上下文,避免重跑沉重视频专家。
Abstract: World-action models (WAMs) transfer visual and motion priors from pretrained video generators to robot control by jointly modeling visual dynamics and actions. Existing WAMs, however, predict dense future frames during training, repeatedly modeling largely unchanged content and coupling action-conditioned dynamics to nuisance appearance variations. At inference, processing each complete observation with the heavy video expert bottlenecks few-step action generation. Accordingly, we propose DeltaWAM, which jointly predicts visual deltas and actions using dense-anchor, sparse-delta, and action streams, with three architectures that differ in representation and computation sharing. We further develop Streaming Delta Memory (SDM), which updates cached anchor context with compact observed deltas, reducing heavy video-expert processing. On RoboTwin, DeltaWAM with SDM improves average success over Fast-WAM from 81.3% to 85.4% in the clean setting and from 75.8% to 83.9% under visual randomization. The three architectures reduce training FLOPs by 17.78-23.77%, while SDM reduces one-step inference latency and FLOPs by 36.57% and 31.55%, respectively; real-world evaluations further show the highest overall success rate and normalized progress among the evaluated policies. Code: https://github.com/AIGeeksGroup/DeltaWAM. Website: https://aigeeksgroup.github.io/DeltaWAM.
[10] CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models cs.CVPDF
Shuo Xing, Pooja Verlani, Balu Adsumilli, Zhengzhong Tu
TL;DR: CinematicVQA评测视觉语言模型能否理解电影摄影手法如何塑造观感与叙事,而非只识别画面技巧。
Details
Motivation: 现有视频问答基准偏重低层摄影手法识别,忽略电影语法对观众感知、情绪和叙事的作用。
Result: 模型对画面表层描述优于摄影技巧及其作用推断;思维链没有稳定帮助且多数模型退化,针对性微调则改善叙事功能和多跳推理。
Insight: Cinematic Scene Graph显式连接拍摄技巧、感知效果和叙事功能,可用作基准结构及训练数据,支持更懂电影语法的视频模型。
Abstract: Cinematography, the craft of visual storytelling through framing, lighting, and camera operation, fundamentally shapes how audiences perceive and emotionally engage with video content. While Large Vision Language Models (LVLMs) have made remarkable progress in video question answering, existing benchmarks primarily focus on identifying low-level techniques rather than understanding their storytelling impact. To address this, we introduce CinematicVQA, the first-of-its-kind benchmark for cinematic video understanding that goes beyond technique recognition to evaluate film-grammar reasoning, utilizing our introduced Cinematic Scene Graph (CSG), a structured representation that links filming techniques to their perceptual effects and narrative functions. Through comprehensive evaluation of state-of-the-art LVLMs, we reveal a striking semantic gap: models consistently perform higher on describing visual presentations than on identifying the underlying techniques. Surprisingly, Chain-of-Thought prompting fails to provide consistent gains and degrades performance for most models, suggesting that current LVLMs lack sufficient cinematic domain knowledge to benefit from step-by-step reasoning. Fine-tuning on \textsc{CinematicVQA-train} yields consistent improvements, particularly for narrative function and multi-hop reasoning. Overall, \textsc{CinematicVQA} serves both as a rigorous benchmark for cinematic evaluation in LVLMs and as a practical dataset for training more film-aware video models.
[11] M$^2$PFN: End-to-End Disentangled Alignment for Generalizable Multimodal In-Context Learning in Alzheimer’s Disease cs.CV | cs.AI | cs.LGPDF
Lujia Zhong, Shuo Huang, Jianwei Zhang, Xinyu Nie, Yonggang Shi
TL;DR: M²PFN把TabPFN表格基础模型扩展为图像—表格多模态阿尔茨海默症预测器,并保留其上下文学习机制。
Details
Motivation: 影像和表格结合的AD模型跨队列泛化受限;TabPFN擅长表格上下文学习,但合成表格先验与影像特征统计结构不匹配。
Result: ADNI三分类宏F1为65.55%、宏AUC为82.21%,优于多种基线;预测基线MMSE的测试MAE为1.743,且在OASIS-3和SCAN外部队列无重训时AUC最佳、MAE最低。
Insight: 对TabPFN Transformer做可微推理,把任务梯度反传至MRI与表格编码器;模态解耦对齐至其先验,并通过可学习门控融合冻结的纯表格预测。
Abstract: While various multimodal methods combining imaging and tabular data for Alzheimer’s disease (AD) diagnosis were proposed, they are often limited in generalization across cohorts. In-context learning (ICL) has demonstrated excellent generalization performances and high flexibility in foundational tabular models such as TabPFN. To extend TabPFN’s ICL to multimodal AD analysis, the main obstacle is that TabPFN is meta-trained on synthetic tabular priors that do not naturally match the statistical structure of image-derived features. We propose M$^2$PFN, an end-to-end framework that turns this tabular foundation model into a multimodal AD predictor. M$^2$PFN (i) performs differentiable inference through TabPFN’s transformer, back-propagating task gradients into 3D-MRI and tabular encoders; (ii) aligns the two modalities into a shared subspace, via disentanglement and a contrastive objective, matched to the ICL engine’s prior; and (iii) folds in a frozen tabular-only prediction through a learnable gated shortcut. Because the ICL engine stays frozen, its in-context mechanism is preserved for test-time generalization, while end-to-end training shapes the encoders into features it can exploit. On ADNI ($n=2240$, three-class CN/MCI/AD), M$^2$PFN attains $65.55%$ macro-F1 and $82.21%$ macro-AUC, surpassing a comprehensive set of unimodal and multimodal baselines. By swapping only the head for a TabPFN regressor, the same architecture regresses baseline MMSE on a $1250$-subject sub-cohort to test MAE $1.743$, outperforming every multimodal baseline. On two external cohorts (OASIS-3 and SCAN) with no retraining, M$^2$PFN achieves the best AUC and the lowest MMSE MAE across all baselines, and transfers even when the cognitive instrument changes.
[12] Looks the Same, Answers Differently: Flip-Direction Steering for Robust Vision-Language Reasoning cs.CVPDF
Yeonsung Jung, Joonhyun Jeong, Hoang Pham, Joowon Kim, Yoonsik Park
TL;DR: FlipDir用低秩隐藏激活方向识别并缓解视觉细微变化造成的VLM答案翻转,同时保留原本稳定的答案。
Details
Motivation: 日常拍摄和处理中的细小图像变化虽不显眼,仍可能改变长链视觉推理,且激活偏移会随解码累积。
Result: 在科学推理、机器人场景和医学VQA的18种设置中,FlipDir在联合衡量错误恢复与稳定保留的指标上持续优于既有方法。
Insight: 从原图与诱发翻转图的对比激活中估计低秩翻转子空间,只在不确定解码步骤由边际门控选择性引导;VisFlip分别评估恢复原预测与保留稳定预测。
Abstract: Vision-language models (VLMs) achieve strong visual reasoning performance, yet subtle changes from routine image capture and processing can alter their reasoning trajectories even when images appear nearly identical. In long-horizon generation, the resulting activation shifts may accumulate across decoding steps, progressively altering reasoning tokens and ultimately changing the final answer, a phenomenon referred to as answer flips. To address this instability, we propose FlipDir (Flip-Direction Steering), a training-free inference-time method that estimates a low-rank flip-inducing activation subspace from contrastive pairs of original and answer-flipping inputs and selectively steers hidden states during decoding. A margin-based gate limits subspace attenuation to uncertain decoding steps, recovering original predictions while preserving stable ones. To evaluate robustness beyond accuracy or consistency on fixed test sets, we introduce VisFlip, a benchmark framework that constructs evaluation groups for a target model and visual variation setting to separately assess recovery of original predictions and preservation of stable ones. VisFlip spans nine dataset-variation combinations across scientific reasoning, robot-scene understanding, and medical VQA, covering subtle visual variations common in each domain. Experiments across 18 settings demonstrate that FlipDir consistently outperforms existing methods on the combined recovery and preservation metric. We will make our code publicly available.
[13] MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting cs.CVPDF
Aman Anand, Partha Pratim Roy, Shivakumara Palaiahnakote
TL;DR: MEVL-STP以多种冻结视觉编码器定位任意形状文本,再让微调VLM识别裁剪文本区域。
Details
Motivation: 弯曲或多方向场景文字难识别,检测定位错误还会传导为识别失败。
Result: 不使用合成预训练数据时,CTW1500检测F值91.99%、端到端H均值85.86%,达到新的先进水平;在Total-Text和ICDAR 2015也表现强。
Insight: 融合六个视觉骨干互补的语义、空间与纹理特征,渐进扩张网络产生贴合文字轮廓的多边形掩码;裁剪后交给LoRA微调的Qwen3-VL-8B识读,减少邻字和背景干扰。
Abstract: Scene text spotting remains challenging for arbitrarily shaped text instances such as curved signs and dense multi-oriented characters in natural images, where tightly coupled architectures propagate localization errors directly into recognition failures. We present a two-stage pipeline that combines multi-encoder segmentation with vision-language model recognition to address this problem. In the detection stage, six frozen vision encoders (CLIP, DINOv2, SigLIP, EVA-CLIP, SAM, and ConvNeXt) extract complementary features spanning semantic, spatial, and texture spectra, which are fused through a trainable hierarchical Feature Pyramid Network with channel attention and decoded via a deep-supervision Progressive Scale Expansion network to generate precise instance-level text masks. By keeping the encoders frozen, their independently learned feature spaces remain orthogonal during fusion, preventing the feature homogenization that degrades boundary precision in single-backbone detectors. The detection stage produces tight polygon masks that conform to the actual shape of curved and arbitrarily oriented text, rather than axis-aligned rectangles that inevitably include background content. In the recognition stage, these polygon-masked crops isolate the target text from surrounding clutter, allowing a Qwen3-VL-8B-Instruct model, fine-tuned via Low-Rank Adaptation on polygon-cropped scene text, to focus purely on reading the text without interference from neighbouring words or background noise. Without any synthetic pretraining data, our method achieves 91.99% detection F-measure and 85.86% end-to-end H-mean on CTW1500, setting a new state of the art and achieving strong performance on Total-Text and ICDAR 2015 without any synthetic training data. Code is available at https://github.com/doubleblind-afk/MEVL-STP
[14] Multimodal Routing and Region Refinement for Language-Guided Medical Image Segmentation cs.CV | cs.LGPDF
Md Maklachur Rahman, Md Hasan Al Banna, Saraf Anjum, Assame Arnob, Tracy Hammond
TL;DR: MRSeg以图文联合路由轻量适配器和文本查询区域细化模块,进行语言引导的医学图像分割。
Details
Motivation: 文本能指出需要分割的发现及位置,但既有方法通常对所有图文对采用同一特征更新路径。
Result: QaTa-COV19 Dice/mIoU为90.90/83.32,MosMedData+为81.53/68.82;可训练参数7.11M,计算量7.60 GFLOPs。
Insight: 冻结ConvNeXt和PubMedBERT编码器,路由器按图文特征稀疏选择低秩适配器;Region Bridge用文本查询聚合稠密图像token、交叉注意力细化区域再回写特征图。
Abstract: Textual descriptions can reduce ambiguity in medical image segmentation by specifying the finding and location to be delineated. Existing text-guided methods mainly improve where image and language features interact but generally retain a single learned update pathway across all image-text pairs. We propose MRSeg, a parameter-efficient framework that uses each image-text pair to route the adaptation of visual and textual features before dense prediction. Frozen ConvNeXt-Tiny and PubMedBERT encoders provide multiscale visual features and clinical text tokens. A joint router uses the deepest visual feature and pooled text to predict a sparse mixture over low-rank adapter bases. The resulting route is shared across separate adapter banks for two visual scales and text, coordinating their adaptation while keeping the feature-specific parameters separate. Region Bridge uses text-derived queries to aggregate dense visual tokens into latent regions, refines these regions through self-attention and text cross-attention, and redistributes the refined information back to the feature maps. Finally, a multiscale decoder combines refined semantic features with shallow image evidence. On QaTa-COV19 and MosMedData+, MRSeg achieves 90.90/83.32 and 81.53/68.82 Dice/mIoU, respectively, with 7.11M trainable parameters and 7.60 GFLOPs. Code: https://github.com/maklachur/MRSeg.
[15] Direction-Scale Decomposition in Action Representation: Rethinking What to Tokenize for Vision-Language-Action Models cs.CV | cs.ROPDF
Yufei Duan, Hang Yin, Alberta Longhini, Chao Tang, Danica Kragic
TL;DR: DSD将动作位移拆成方向和尺度再量化,改善离散token视觉语言动作模型在数据混合下的控制表现。
Details
Motivation: 传统位姿增量token对执行速度和数据集归一化敏感,可能掩盖不同示范与数据集共享的几何结构。
Result: LIBERO上两种tokenizer均因DSD提高平均成功率;混合数据训练的SimplerEnv上DSD-BIN总体成功率比BIN高10.3个百分点,真实机器人实验也显示增益。
Insight: 平移和旋转增量分别分解为方向与尺度通道,再用均匀分箱或B样条tokenizer编码,可减少大规模多样数据混合时的性能损失。
Abstract: Action representation plays a central role in discrete-token vision-language-action (VLA) learning but remains underexamined. Under conventional pose-increment representations, action tokens are sensitive to execution speed and dataset-specific normalization, potentially obscuring geometric structure shared across demonstrations and datasets. We introduce Direction-Scale Decomposition (DSD), an action representation that decomposes translation and rotation increments into direction and scale components before tokenization. DSD isolates motion direction while retaining magnitudes in separate scale channels. We evaluate DSD with uniform binning (BIN) and BEAST, a B-spline-based tokenizer, in simulation and real-world manipulation under both single-dataset and mixed-dataset training. On LIBERO, DSD improves average success rates with both tokenizers. On SimplerEnv, DSD-BIN outperforms BIN by 10.3 percentage points in overall success rate under mixed-dataset training. Real-robot experiments further show gains both with and without robotics pretraining. These results support DSD as an effective action representation for discrete-token VLA models and suggest its potential to mitigate performance degradation when training on large and diverse dataset mixtures. Our project page with additional resources is available at https://vla-dsd.github.io/
[16] ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation cs.CVPDF
Zichong Meng, Chongjian Ge, Chun-Hao P. Huang, Yang Zhou, Huaizu Jiang
TL;DR: ViRDM仅对生成器做表示分布匹配后训练,免去少步因果视频扩散中的教师和在线评论器。
Details
Motivation: 常见分布匹配蒸馏依赖预训练教师与在线评论器,资源昂贵;直接迁移到视频还受显存、优化方式和时间动态欠约束影响。
Result: 只用20次生成器更新,在官方VBench得分84.87,比此前最佳少步因果基线高0.36;训练耗费16 A100 GPU小时。
Insight: 将表示匹配与随机截断的干净出口监督、轻量VAE解码及分阶段向量—雅可比积结合以节省显存,并增加轻量动态正则缓解时间维约束不足。
Abstract: Few-step autoregressive (AR) video diffusion enables low-latency streaming generation, but existing post-training methods predominantly rely on Distribution Matching Distillation (DMD), requiring both a large pretrained teacher and an online critic to estimate distributional discrepancies through diffusion scores. In this work, we ask whether this resource-intensive teacher–critic stack can be eliminated by post-training only the generator against a precomputed target distribution. Drawing inspiration from representation distribution matching (RDM) for one-step image generation, we systematically study its transfer to few-step causal video generation and identify three key barriers: a memory-intractable gradient path, a distinct video optimization regime, and representation distributions that underconstrain temporal dynamics. We introduce ViRDM, a teacher- and critic-free video post-training recipe that addresses these barriers sequentially. By coupling RDM with stochastically truncated clean-exit supervision, a lightweight VAE decoder, and staged vector–Jacobian products, ViRDM makes representation distribution matching memory-feasible for multi-step causal video rollouts. We further establish effective generated-population and initialization regimes for video RDM, and introduce lightweight dynamics regularization to compensate for the underconstrained temporal dynamics. ViRDM turns three-network distillation into generator-only post-training, reducing GPU memory use and training time while improving video quality. With only 20 generator updates, the recipe reaches 84.87 on the official VBench evaluation, outperforming the previous best few-step causal baseline by 0.36, while requiring 16 A100 GPU-hours. We additionally report exploratory results demonstrating the potential of the same recipe for lower causal sampling budget and for one-, two-, and four-step bidirectional generation.
[17] HelloWorld: Towards Practical Applications of Generative Driving World Models cs.CVPDF
Fan Lu, Hanshi Wang, Zijing Wang, Quan Feng, Zhi Wang
TL;DR: HelloWorld是2B驾驶世界模型,统一支持可控驾驶视频生成、多视角相机、条件激光雷达及高效推理。
Details
Motivation: 实用驾驶世界模型需跨多场景泛化、准确响应控制指令、生成一致的多传感器观察,并支持反复高效模拟。
Result: 评估覆盖画质、控制一致性、跨视角一致性、重复生成鲁棒性、推理效率和激光雷达合成;摘要未提供具体量化结果。
Insight: 从异构视频逐步适配视觉与运动先验,用自车位姿、高清地图和3D框控制生成;块因果接口及自生成上下文适配支持序列仿真,并蒸馏为少步推理。
Abstract: Driving world models provide a promising route toward scalable counterfactual data generation and interactive simulation beyond recorded driving logs. Realizing this potential requires a system that can generalize across diverse scenes, respond faithfully to prescribed controls, generate coherent multi-sensor observations, and operate efficiently under repeated inference. We present \textbf{HelloWorld}, a 2B driving world model system designed around these requirements. HelloWorld progressively specializes broad visual and motion priors from heterogeneous video data into controllable driving generation using ego pose, HD maps, and 3D boxes. A block-causal generation interface, together with adaptation to self-generated context, aligns the model with sequential simulation. The system further supports synchronized seven-camera RGB generation and conditional LiDAR synthesis, and is distilled toward few-step inference for efficient deployment. Experiments evaluate visual quality, control fidelity, cross-view consistency, robustness under repeated generation, inference efficiency, and LiDAR synthesis. Together, HelloWorld provides a unified framework for scalable driving data generation and interactive simulation.
[18] Exploiting Target Knowledge from MLLMs for Robust Few-Shot Segmentation cs.CVPDF
Yijun Hu, Heng Fan, Libo Zhang
TL;DR: MK-FSS利用多模态大模型从查询图像提取空间和语义线索,增强少样本分割对新类别与遮挡的适应性。
Details
Motivation: 传统少样本分割主要依赖支持图与查询图的外观匹配,遇到明显外观差异和遮挡时缺少目标知识。
Result: 在多项实验中,MK-FSS取得有前景的表现并大幅超过既有方法;摘要未提供具体量化指标。
Insight: 空间先验被编码为记忆并与支持引导记忆融合,文本语义则生成跨模态提示;双路共同形成更完整的目标表示。
Abstract: Few-shot segmentation (FSS) aims to segment unseen object categories with a few (e.g., one or five) labeled examples, enabling efficient adaptation to novel classes. Conventional models typically rely on appearance-based visual matching between support and query images for segmentation. While straightforward, these methods often struggle to handle significant appearance discrepancies and occlusions in the query image due to insufficient target knowledge. To mitigate this, we introduce a novel framework that mines target knowledge using the strong reasoning capacity of Multimodal Large Language Models (MLLMs) and employs it to enhance FSS. Specifically, building on SAM 2, our method, named MK-FSS, exploits two forms of complementary knowledge derived from a query image by an MLLM for FSS, including spatial knowledge, which provides a spatial prior indicating the potential target location, and semantic knowledge, which describes the target using text. The spatial knowledge is first encoded into a memory representation, and then resulting memory is integrated with the support-guided memory feature from query image through a carefully designed dual-memory debate-fusion (DMDF) module, yielding a more robust target memory feature. In parallel, the semantic knowledge is encoded into the textual feature, which is fused with multi-scale query features via a progressive cross-modal prompt generator (PCPG), producing a target-aware multimodal prompt for segmentation. Working together, the dual-memory feature and the multimodal prompt provide a comprehensive representation of the target, enabling more robust segmentation. In our extensive experiments, MK-FSS shows promising results and largely surpasses existing methods. Code will be released.
[19] MoVISA: Multi-Token Reasoning for Video Object Segmentation cs.CVPDF
Ruining Zhao, Ho Kei Cheng, Alexander G Schwing
TL;DR: MoVISA以多个分割词元表示视频不同帧中的目标,提高视频目标分割的时空定位粒度。
Details
Motivation: 以单个SEG词元预测所有视频帧掩码,难以精确定位多个随时间变化的目标。
Result: 在MeViS上的J与F提高13.2%,在ReVOS上提高8.4%;并在DAVIS17和Ref-Youtube-VOS等基准评估。
Insight: 使用SEG0、SEG1等多个词元表示对象跨帧信息,使语言提示与时空掩码对应更细致,也改善可解释性。
Abstract: Recent advances in video object segmentation with Multimodal Large Language Model (MLLM) reasoning have demonstrated the effectiveness of using a single textual token, such as SEG, to predict segmentation masks across images and videos. However, we observe that this single-token strategy lacks the granularity required to precisely localize multiple objects across time in video segmentation tasks. To address this limitation, we develop Multi-Token Reasoning for Video Object Segmentation, or MoVISA. MoVISA uses multiple segmentation tokens, such as SEG0 and SEG1, to represent an object across different frames. This design enables more fine-grained alignment between language prompts and spatio-temporal mask predictions, improving both performance and interpretability. On the challenging MeViS, DAVIS17, ReVOS, and Ref-Youtube-VOS benchmarks, our model achieves a 13.2 percent J and F improvement on MeViS and an 8.4 percent J and F improvement on ReVOS. Code and models will be released.
[20] Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models cs.CV | cs.AIPDF
Shuzhi Gong, Fengze Sun, Yuansan Liu
TL;DR: 通过阶段级因果干预分析视频智能体幻觉来源,发现错误时空定位比视觉观察受损影响更大。
Details
Motivation: 视频理解智能体将时序定位、视觉观察和推理分阶段完成,但这些环节常在不同基准评估,难追溯幻觉来源。
Result: 在三种架构、60,008次运行中,错误定位对下游失误的因果影响约为视觉观察错误的四倍;错误证据比缺少证据更有害。
Insight: 正确定位主要依赖找对区域而非精确时间重叠,因此常规mIoU难预测实际可靠性;已有基准分数不能稳定反映因果级错误传播。
Abstract: Video understanding is increasingly performed by multi-stage LLM agents that separate temporal grounding, visual observation, and reasoning. Yet these stages are typically evaluated on different benchmarks and distributions, making it difficult to determine where hallucinations originate. We first organize existing benchmarks around these stages and show that their scores provide inconsistent diagnostic signals: stronger stage-level performance does not reliably imply lower downstream hallucination, and even benchmarks targeting the same capability can disagree. We therefore introduce a causal stage-intervention protocol that overwrites individual stages while holding the downstream task fixed. Across 60,008 runs on three video-agent architectures, we find that grounding is the dominant source of downstream error, with roughly four times the causal impact of corrupting visual observations. Successful grounding depends primarily on locating the correct region rather than precise temporal overlap, explaining why standard mIoU metrics poorly predict downstream reliability. We further find that incorrect evidence is substantially more harmful than missing evidence. Finally, auditing existing benchmarks against these interventions reveals that their scores do not reliably predict causal cascade sensitivity and can fail under distribution shift. These results motivate intervention-based, stage-aware evaluation for trustworthy video agents.
[21] FluidRain: Incompressible Rain Flow as an Attention Bias for Loop-in-Loop Video Deraining cs.CVPDF
Pu Wang, Yongcong Wang, Wenhao Li, Xiang Chen, Guangwei Gao
TL;DR: FluidRain以不可压缩雨流作为跨尺度、跨帧注意力偏置,进行轻量视频去雨。
Details
Motivation: 显式运动对齐在密集雨中不可靠,隐式时空聚合又缺少雨滴方向和连续运动结构指导。
Result: 在四个基准上,0.80M参数的三帧模型表现可与大得多的复原模型竞争;还构建受控雨向变化数据和无参考真实雨评估指标。
Insight: 逐帧估计雨流并投影到无散度子空间,使窗口注意力沿雨丝聚合邻帧信息,无需显式帧对齐;同一注意力算子可跨尺度和时间复用。
Abstract: Existing video deraining methods typically exploit neighboring frames through either explicit alignment or implicit spatiotemporal aggregation. Explicit alignment relies on accurate motion estimation, which can become unreliable under dense rain, while implicit aggregation avoids alignment but lacks explicit guidance on the directional and temporally coherent structure of rain. This leaves a gap between reliable temporal aggregation and explicit modeling of rain motion. To address these limitations, we propose FluidRain, a lightweight video derainer that uses divergence-free rain flow to guide Loop-in-Loop attention across scales and neighboring frames. Motivated by fluid mechanics, we model rain motion as a divergence-free image-space flow and use it to organize multi-scale and temporal aggregation. Specifically, FluidRain first estimates a rain-flow field for each frame and projects it onto the divergence-free subspace. The resulting flow steers window attention along rain streaks, enabling neighboring frames to be aggregated without explicit alignment. Since rain-flow structure is preserved across scales and nearby frames, Loop-in-Loop reuses the same attention operator across both dimensions, resulting in a three-frame model with only 0.80M parameters. Experiments on four benchmarks show that FluidRain remains competitive with substantially larger restoration models. We further examine how temporal evidence scales with different input views. To evaluate whether the model remains reliable when rain motion changes across frames, we introduce RainSyn-Gust, which injects controlled changes in rain-streak direction into existing benchmarks. We also develop a physics-based no-reference metric that evaluates real-rain removal without requiring clean targets.
[22] RGBD20K: A Large-Scale Benchmark for RGB-D Semantic Segmentation cs.CVPDF
Shaohua Dong, Zexuan Meng, Haiyan Sun, Bing Fan, Cuicui Zhang
TL;DR: RGBD20K提供2万对RGB-D图像和160种细粒度语义类别,并提出分数净化融合分割方法。
Details
Motivation: 已有RGB-D语义分割基准类别少、数据有限,历史标注噪声也可能损害模型泛化。
Result: 数据集重新复核并修正标签;SPF在所有被评估基准上达到先进性能,显示高质量多模态信息融合的有效性。
Insight: 相较NYUv2的40类和SUN RGB-D的37类,RGBD20K扩展到160类且规模达20,000对,为训练更通用的RGB-D分割模型提供资源。
Abstract: In this paper, we propose RGBD20K, a novel dataset for facilitating the development of more robust and general RGB-D semantic segmentation by encompassing abundant categories and high-quality annotations. RGBD20K possesses several attractive properties: (1) Expanded Semantic Space. In particular, it covers 160 fine-grained categories, largely surpassing the category diversity of existing popular RGB-D benchmarks (e.g., NYUv2 with 40 classes and SUN RGB-D with 37 classes). With such enriched semantic coverage, we expect to promote the learning of more generalizable segmentation models. (2) Larger Scale. Compared with current benchmarks, RGBD20K offers 20,000 RGB-D image pairs, providing a substantially larger training resource that benefits the development of more powerful deep models. (3) High-Fidelity Annotation. We perform rigorous re-evaluation and correction of existing labels to resolve long-standing annotation noise, resulting in a clean and reliable ground-truth foundation. Furthermore, we propose a novel score-purified fusion (SPF) method, which achieves state-of-the-art performance across all evaluated benchmarks, demonstrating the effectiveness of our approach in leveraging high-quality multimodal information for RGB-D semantic segmentation. The dataset is here: https://github.com/ShaohuaDong2021/RGBD20K/.
[23] Exploiting answer-invariant redundancies in satellite imagery for efficient VLM inference on edge cs.CV | cs.LGPDF
Ishani Janveja, Davis Zhang, Seoyul Oh, Deepak Vasisht
TL;DR: Rift按查询剪除卫星图像中的答案无关图块和视觉token,降低边缘视觉语言模型推理能耗与时延。
Details
Motivation: 卫星端处理高分辨率图像需逐块推理,既缓慢又耗能。
Result: 在Jetson AGX Orin运行LLaVA-1.5 7B时,相对穷举图块推理能耗降低78%、延迟降低69%,准确率从45%提高至73%。
Insight: 利用答案不变冗余分两阶段处理:先按查询裁剪图像块,再弹性调整预填充token预算,避免对无关区域重复编码。
Abstract: Onboard vision-language models could enable satellites to answer queries directly, but exhaustive tiled inference over high-resolution imagery is slow and energy-intensive. We identify answer-invariant token redundancy (AITR): image tiles and vision tokens that can be removed without changing the final answer. We present Rift, a two-stage system that performs query-conditioned tile pruning followed by elastic prefill to reduce token budget. We evaluate it on LLaVA-1.5 7B running on Jetson AGX Orin. Compared with exhaustive tiled inference, Rift reduces energy by 78% and latency by 69%, while increasing accuracy from 45% to 73%.
[24] Where Hallucinations Live: A Cross-Architecture Circuit in VQ-Tokenized Vision-Language Models cs.CV | cs.LGPDF
Shamanthak Hegde, Xiangrui Liu, Maitreya Patel, Yezhou Yang
TL;DR: 定位向量量化图像token化VLM中的跨架构物体幻觉回路,并通过早层消融作针对性干预。
Details
Motivation: 统一VLM在有依据的是非题上常幻觉物体,传统解码修正视为通用校准问题,缺少架构层解释。
Result: 对25个、八类LLM骨干的模型激活分析显示,早层L0路由回路与VQ结构相关;只有L0消融降低开放式生成幻觉,CHAIR_i相对下降31%,调优VCD和DoLA未降低或反而恶化。
Insight: 单变量替换CLIP路径为VQ路径会引入回路,而同数据量MLP对照不会,指向向量量化是异常信号来源;故障利用骨干已有路由通道。
Abstract: Unified vision-language models (VLMs) that tokenize images through a vector-quantized (VQ) codebook routinely hallucinate objects on grounded yes/no benchmarks, yet existing decoding-time fixes treat this as generic miscalibration without an architectural account. Using activation patching across twenty-five models spanning eight LLM families, we identify an early-layer ($L_0$) attention routing circuit shared across VQ-tokenized VLMs and propose a three-gate diagnostic that distinguishes the models carrying it from those that do not. The diagnostic isolates ten positive models (five natural unified-VQ VLMs across three LLM families and five induced variants) and rejects the remaining fifteen. A single-variable architectural swap (LLaVA-1.6 CLIP+MLP $\rightarrow$ VQ+Linear) installs the circuit, while a matched-compute MLP control on identical data does not, isolating vector quantization as the source of the pathological signal; the routing pathway that carries it is one that the backbone already provides. Against tuned VCD and DoLA baselines, tuned DoLA wins on binary calibration, but \textbf{only $L_0$ ablation reduces object hallucination in open-ended generation} (CHAIR$_i$ reduces by $31,%$ relatively, whereas tuned DoLA and VCD leave it unchanged or worsen it). These results recast object hallucination in unified VQ VLMs as a property of architecture and pretraining, and yield a targeted intervention that mechanism-agnostic decoding cannot replicate.
[25] Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models cs.CVPDF
Kai Glantz, Clemens Grange
TL;DR: 用三维检测、米制深度和确定性几何求解器为小型VLM补充米制空间推理能力。
Details
Motivation: VLM能描述场景,却不擅长估计绝对距离、物体尺寸和自我中心方向。
Result: ReVSI-Bench四项任务中三项显著改善:绝对距离MRA从0.46升至0.74,相对距离准确率从39.1%升至67.4%,相对方向从25.9%升至73.4%。
Insight: 在各物体最佳视角检测,再用相机位姿投到共享世界坐标并交由确定性工具计算几何;用真值框替换检测器可区分感知与推理误差。物体尺寸仍受检测框质量限制。
Abstract: Vision-Language Models (VLMs) describe scenes well but reason poorly about metric 3D structure such as absolute distances, physical sizes, or egocentric directions. We present a modular, predictor agnostic, tool-augmented framework that equips a small VLM (Qwen3.5-4B) with geometric tools: 3D object detection, metric depth estimation, and deterministic solvers for distance, size and bearing. Each object is detected in the camera frame of its own best view, and the tools use that frame’s pose to lift every detection into one shared world frame. Moving metric computation out of the model’s weights and into explicit solvers yields large gains on three of four ReVSI-Bench tasks: with a strong monocular detector (WildDet3D), absolute distance rises from 0.46 to 0.74 Mean Relative Accuracy (MRA), relative distance from 39.1% to 67.4%, and relative direction from a below-chance 25.9% to 73.4%. Because any detector can be swapped in behind the tool interface, comparing real detectors against ground-truth boxes separates perception error from reasoning error: orchestration costs only 0.03 MRA. Object size is bounded by the detector: the tools are near-exact on groundtruth boxes (0.97) yet the best real detector barely beats the no-tool baseline (0.61 vs. 0.58), because size reads straight off a box extent monocular detectors get wrong. Without a predefined recipe, the model already sequences the tools correctly on its own, matching a scripted pipeline on three of four tasks.
[26] WildHSR: Metric Feed-Forward 4D People-Scene Reconstruction from a 3D Foundation Model cs.CV | cs.AI | cs.CGPDF
Jerrin Bright, John Zelek
TL;DR: WildHSR将三维基础模型的无尺度几何表示轻量适配为具有米制尺度和持久身份的前馈式人体—场景重建。
Details
Motivation: 三维基础模型能一次前向恢复相机与几何,却缺少真实尺度和跨帧人体身份,现成模型难直接用于联合重建。
Result: 在EMDB-2上,WildHSR是已发表比较中首个前馈方法同时超过最优优化式WA-MPJPE与RTE,并在三项世界坐标指标领先同类;RICH上也领先前馈方法,单GPU速度10.1帧/秒。
Insight: 利用网络视频中的人体姿态建立尺度伪标签,再用真实视频尺度监督轻量适配;中间层查询—键特征提供跨帧身份线索,结合骨盆运动及置信度做带空箱的Sinkhorn关联。
Abstract: 3D foundation models recover video cameras and geometry in one forward pass, but some of the strongest are up to scale. Joint people-scene reconstruction then requires two missing outputs: metric scale and persistent person identity. We ask whether one up-to-scale foundation representation can support both through lightweight adaptation. Exact metric labels are scarce, but unlabeled in-the-wild video is abundant. We use people in curated web video to initialise the solution: a posed metric body and 2D keypoints give an approximate, closed-form scale pseudo-label. These pseudo-labels pretrain a Scale Readout, which is then fine-tuned together with a lightweight adapter using exact metric supervision from standard real-video training splits. At inference the head predicts metric scale from foundation-model tokens, without the ruler or its teachers. For person identity, we probe the pretrained foundation model alone and find evidence that its intermediate query-key features encode person correspondence across frames. In most evaluated moving-person clips, a mid-layer token prefers that person over the vacated location and other people. A tiny projection reads this correspondence; together with metric pelvis motion and proposal confidence, it drives dustbin-aware Sinkhorn association of per-frame bodies. WildHSR combines both readouts to reconstruct metric cameras, scene and people from monocular video. Each window is predicted feed-forward; analytic association and Sim(3) composition connect windows. On EMDB-2, WildHSR is the first feed-forward method in the published comparison to beat the best optimization-based WA-MPJPE and RTE while leading feed-forward methods on all three world-frame metrics. On RICH, it leads feed-forward people-and-scene methods on WA-MPJPE and W-MPJPE. The complete pipeline runs at 10.1 fps on one GPU.
[27] Less is More: Encoder-only Audio-Visual Segmentation cs.CV | cs.AIPDF
Ilpo Viertola, Vladimir Iashin, Sophie Tötterström, Esa Rahtu
TL;DR: EASE采用仅编码器架构进行音视频语义分割,以精简模型获得高速和先进分割性能。
Details
Motivation: 现有Transformer分割架构可能包含对表现贡献不大的冗余模块,限制速度和训练成本。
Result: 最高运行速度365 FPS,约为同等精度先进音视频分割模型的三倍,训练不到11 GPU小时,并在不同骨干和分辨率下达到先进表现。
Insight: 移除不必要解码器等冗余组件,表明音视频分割可同时实现结构简化和实时推理。
Abstract: Audio-Visual Semantic Segmentation (AVSS) aims to identify, segment, and classify sound-emitting objects in video frames. Previous Transformer-based AVSS approaches largely inherit design principles from image segmentation models. Recent studies show that these image segmentation models contain redundant components that contribute little to the segmentation performance. Following this insight, we propose Encoder-only Audio-Visual Segmentation (EASE). EASE runs at up to 365 FPS, 3x faster than prior State-of-the-Art (SotA) AVS models at comparable accuracy, and trains in under 11 GPU-hours. Furthermore, we achieve SotA AVSS performance across different backbones and input resolutions. Our results demonstrate that AVSS can be both simpler and faster, providing a scalable foundation for future research and real-time applications. Code, model weights, and samples are available at https://ease-avs.notion.site
[28] FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection cs.CVPDF
Ben Liang, Chao Sui, Junqi Bai, Yuan Liu, Chunlai Li
TL;DR: FoCal按频率成分差异自适应融合航拍可见光与红外特征,兼顾共享结构信息和模态特有线索。
Details
Motivation: 已有RGB—红外检测多关注空间交互或频率增强,却很少区分不同频段的跨模态关系;频谱差异也可能包含噪声。
Result: 在DroneVehicle、ESCVehicle和ATR-UMOD上mAP50分别为83.5%、54.8%和64.6%;仅3.0M参数,速度113.6 FPS。
Insight: 低频共同形成结构共识,高频选择性交换并保留模态信息;置信加权的相对幅值差异经过有界符号门控,控制联合频谱的增强、保留或抑制。
Abstract: In aerial RGB–IR object detection, effectively exploiting complementary information across modalities is critical for robust perception under complex illumination and environmental conditions. Existing multimodal detectors mainly focus on spatial-domain interaction or frequency-specific feature enhancement, while the cross-modal interaction patterns of different frequency components remain insufficiently explored. Moreover, spectral discrepancy itself may contain both useful complementary cues and unreliable modality-specific responses, making indiscriminate frequency fusion suboptimal. To address these issues, we propose FoCal, a frequency-oriented framework for aerial RGB–IR object detection. First, a Frequency-Aware Dual-Domain Calibration (FADC) module is developed to explicitly model frequency-dependent cross-modal interaction. Low-frequency components are collaboratively consolidated into a shared structural consensus, whereas high-frequency components preserve modality-specific information through selective cross-modal exchange. The resulting frequency-aware cues are further transferred to the original feature domain to regulate cross-modal calibration. Second, we introduce a Discrepancy-Guided Spectral Modulation (DGSM) module, which characterizes cross-modal spectral imbalance using confidence-weighted relative amplitude discrepancy and transforms it into a bounded signed gate for adaptive enhancement, preservation, or attenuation of the joint multimodal spectrum. Extensive experiments on DroneVehicle, ESCVehicle, and ATR-UMOD demonstrate the effectiveness of FoCal, yielding $\mathrm{mAP}_{50}$ values of 83.5%, 54.8%, and 64.6%, respectively. Meanwhile, with only 3.0M parameters, FoCal achieves 113.6 FPS while preserving leading detection accuracy, highlighting a favorable accuracy–efficiency trade-off. Code is available at {https://github.com/universeliang/FoCal.
[29] Med-AR: Autoregressive Vision-Language Pretraining for Long-Tailed Chest X-Ray Classification and Uncertainty-Aware Evaluation cs.CV | cs.AIPDF
Janhavi Prabhu, Sahil, Akshay V, Shivam Shukla, Manoj Tadepalli
TL;DR: Med-AR提供2B和8B放射学原生自回归视觉语言模型,面向长尾胸片分类和不确定性评估。
Details
Motivation: 胸片分类需兼顾常见异常和罕见细微发现,长尾分布会使一般视觉表征难以识别低频标签。
Result: 公开数据集PadChest、MIMIC-CXR和CheXpert上,Med-AR变体在各患病率组的平均AUROC及AUPRC整体领先比较编码器;MIMIC-CXR尾部标签AUPRC从0.1033升至0.1441。内部评测仍有指标相关的例外。
Insight: 以结构化报告、异常聚焦文本及区域标注预训练视觉语言模型;同时报告区分能力和风险—覆盖曲线,发现公开队列上选择性预测优于Med-CLIP。
Abstract: Long-tailed chest X-ray classification requires visual representations that capture both common abnormalities and subtle, infrequent findings. We propose Med-AR-8B and Med-AR-2B, two radiology-native autoregressive vision-language models pretrained with structured reports, abnormality-focused text, and region annotations. We evaluate the transfer of their visual encoders to multi-label classification against contrastive, self-supervised, and supervised pretrained encoders, including Med-CLIP, CheXFound, EVA-Base, ARK, and BioViL-T, using a common ML-Decoder classification head. To assess fine-grained recognition, we also construct LLM-expanded, report-derived label sets for MIMIC-CXR and CheXpert. Across PadChest, MIMIC-CXR, and CheXpert, Med-AR-8B outperforms Med-CLIP in mean AUROC and AUPRC for head, medium, and tail findings. On MIMIC-CXR, it increases tail-label mean AUPRC from 0.1033 to 0.1441. Med-AR-2B achieves the strongest discrimination results on PadChest. Across the broader encoder comparison, a Med-AR variant achieves the highest mean AUROC and AUPRC in every reported prevalence group on each public dataset. Both Med-AR variants also achieve lower excess area under the risk-coverage curve than Med-CLIP on all three public datasets, indicating improved selective-prediction performance under the evaluated protocol. Internal results are metric-dependent, with Med-CLIP retaining advantages in overall and tail AUPRC and in selective prediction. These findings establish Med-AR as a strong pretraining recipe for long-tailed chest X-ray classification on the evaluated public benchmarks and demonstrate the value of assessing discrimination and selective prediction together.
[30] ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding cs.CVPDF
Yusung Choi
TL;DR: ImCorr用可在连续坐标查询的隐式特征场,突破视觉Transformer patch网格对亚像素语义对应的限制。
Details
Motivation: 语义对应方法在常规阈值表现提升已停滞,固定patch网格无法精确表示源关键点和目标关键点位置。
Result: SPair-71k中,448分辨率、patch-14时84.9%的真值点在PCK@0.01下没有对应精确网格特征;ImCorr在SPair-71k该阈值较先前最佳提高6.2个百分点,并在AP-10K多个跨物种设置改善细粒度表现。
Insight: FiLM条件解码器把亚像素位置信息写入连续特征场,查询源图真值点以消除源端网格误差,目标侧则解码到更密网格以降低量化误差。
Abstract: The strong performance that modern semantic correspondence methods achieve at standard thresholds plateaus sharply at fine-grained thresholds. We argue that this plateau stems not from the representational capacity of backbone features, but from a grid-tied readout. Patch-based vision transformers tokenize images onto discrete grids, introducing two forms of quantization error: querying nearest patch features instead of exact keypoints on the source side, and the absence of grid features representing precise ground-truth locations on the target side. We quantify this quantization ceiling across all 499,188 keypoints in SPair-71k: under the standard 448x448, patch-14 setting, 84.9% of ground-truth keypoints have no grid feature representing their precise location at PCK@0.01. This is a structural limitation at the representation level, independent of the matching strategy. We address this with ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding, which formulates correspondence estimation over a continuous feature field queryable at arbitrary continuous coordinates. A FiLM-conditioned decoder is trained to embed sub-pixel positional information into the feature field. Querying the field directly at exact keypoint coordinates theoretically eliminates representation-level quantization error on the source side, while decoding onto a grid denser than the backbone grid substantially reduces quantization error on the target side. On SPair-71k and AP-10K (intra-species, cross-species, and cross-family), ImCorr improves performance at fine-grained thresholds (PCK@0.01-0.05), achieving a 6.2 percentage point gain over the prior state of the art at PCK@0.01 on SPair-71k. These results demonstrate that representational continuity is an effective solution for precise semantic correspondence. Code is available at https://github.com/YusungChoi/ImCorr.
[31] SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection cs.CV | cs.AIPDF
Yuting Zhao, Ziyi Zheng, Shuxiao Li
TL;DR: SARFusion把相机—激光雷达融合检测改写为场景可靠性指导的目标查询分支路由问题。
Details
Motivation: 传感器受损时紧耦合多模态表征会让不可靠观测干扰另一模态,且不同驾驶场景和物体的模态可信度各异。
Result: nuScenes测试集mAP为72.5、NDS为74.4;分析显示其在传感器损坏和环境变化等困难条件下有鲁棒性。
Insight: 分别解码相机、激光雷达和融合三路目标查询,再根据全局场景可靠性先验及对象级证据逐查询选择分支;互补信号可信时仍可利用联合融合。
Abstract: Camera-LiDAR fusion has become a prevailing paradigm for 3D object detection in autonomous driving. However, existing fusion detectors often establish strong inter-modality dependencies by decoding object queries from tightly coupled multimodal representations. Under corrupted driving conditions, such dependencies make the detector vulnerable to unreliable modalities, where degraded observations may interfere with reliable modality-specific evidence and lead to suboptimal predictions. Moreover, modality reliability can vary across both global driving scenes and individual object queries, requiring adaptive fusion decisions at a finer granularity. To bridge this gap, we reformulate robust camera-LiDAR fusion as a scene-aware branch routing problem and propose SARFusion, a robust 3D object detector. Instead of producing detections from a single fused representation, SARFusion decouples object-query decoding into three parallel reasoning branches: a camera branch, a LiDAR branch, and a camera-LiDAR fusion branch. Guided by a Scene Reliability Prior estimated from the global driving context, SARFusion further incorporates object-level evidence to route each query to the most suitable branch. This query-wise routing strategy alleviates harmful cross-modal interference while preserving the benefits of multimodal fusion when complementary cues are trustworthy. On the nuScenes test set, SARFusion achieves strong performance with 72.5 mAP and 74.4 NDS. Extensive analyses demonstrate its robustness under challenging conditions, including sensor corruptions and environmental changes.
[32] ComplexSync: High-Fidelity and Real-Time Lip Sync in Complex Scenarios cs.CVPDF
Jiaran Cai, Xingpei Ma, Shenneng Huang
TL;DR: ComplexSync用单步扩散蒸馏和视觉结构先验,实现复杂场景下实时高保真音频驱动唇形同步。
Details
Motivation: 扩散模型生成质量高,但复杂场景下同步效果易退化,迭代推理延迟也限制实际部署。
Result: 吞吐超过70 FPS;在标准和复杂场景实验中均达到先进性能,并建立含200余段挑战视频和专用指标的新基准。
Insight: 双流联合训练减少参考帧信息泄漏并保留自然动态,单步蒸馏加速生成,视觉基础模型提供的结构先验通过关系对齐损失提升复杂因素下的稳健性。
Abstract: Lip synchronization aims to generate visual lip dynamics that align precisely with speech audio. Despite the high generation quality of diffusion models, they often struggle in complex scenarios and suffer from prohibitive inference latency, limiting real-world deployment. We present ComplexSync, a unified diffusion-based framework that enables real-time, high-fidelity lip sync under complex conditions. First, we introduce a dual-stream joint training strategy to mitigate information leakage from reference frames while preserving natural dynamics. Second, we develop a distillation-based acceleration scheme for single-step denoising, achieving a throughput of over 70 FPS. Third, we propose a relational alignment loss that leverages structural priors from Vision Foundation Models (VFMs) to enhance robustness against complex scene factors. Furthermore, we present the first benchmark specifically designed for complex lip synchronization, comprising over 200 challenging video sequences and specialized metrics. Extensive experiments demonstrate that ComplexSync achieves state-of-the-art performance across both standard and complex scenarios while enabling real-time inference.
[33] IronViT: Toward Efficient Generalist Visual Representation Learning cs.CVPDF
Jiaxi Huang, Yueqi Hu, Xin Zhu, Xiaopeng Zhang, Huiting Qiao
TL;DR: IronViT先整合多个视觉专家能力,再逐步迁移到混合softmax—线性注意力架构以获得高分辨率效率。
Details
Motivation: 通用视觉编码器须同时表征语义、空间、语言对齐及动作线索,但高分辨率softmax注意力成本过高;直接在高效架构上蒸馏多专家又会混淆目标。
Result: 在识别、检索、稠密预测、多模态理解和机器人学习上具竞争力;softmax桥接模型在多模态理解与机器人学习聚合表现最强,混合编码器随输入分辨率提高显示更大效率优势。
Insight: 先把互补专家蒸馏到softmax能力桥,再渐进迁移至混合注意力编码器,并通过高信息密度、多领域蒸馏数据增强表征。
Abstract: A generalist vision encoder must capture semantic, spatial, language-aligned, and action-relevant cues within a unified representation, yet softmax attention underlying today’s most capable visual backbones becomes prohibitively expensive at high resolution. A natural attempt to address both challenges is to distill multiple specialist teachers directly into an efficient architecture. We find that directly coupling these objectives degrades representation quality, as the student must simultaneously reconcile heterogeneous capabilities and adapt them to a different token-mixing architecture. We introduce IronViT, built on a simple principle: consolidate capabilities before constraining computation. IronViT first distills complementary specialists into a softmax attention capability bridge, then progressively transfers the consolidated representation to a hybrid softmax-linear attention encoder. A purpose-built data pipeline further curates the distillation corpus for higher information density and broader domain coverage. Across recognition, retrieval, dense prediction, multimodal understanding, and robotic learning, IronViT is competitive with leading specialist and generalist vision encoders. The softmax bridge achieves the strongest aggregate performance in multimodal understanding and robotic learning among the evaluated backbones, while the hybrid encoder retains broad transfer performance with an efficiency advantage that grows with input resolution. Together, these results show that consolidating capabilities before architectural conversion can yield a generalist visual encoder without inheriting the prohibitive high-resolution cost of conventional softmax attention.
[34] TOLA: Text-aware One-Step Latent Adaptation for Diffusion-based Text Image Super-Resolution cs.CV | cs.AIPDF
Yike Xu, Yue Shi, Yong Guo, Jiezhang Cao
TL;DR: TOLA以一次文本条件和轻量潜变量残差修正,进行无需迭代图文扩散的文本图像超分辨率。
Details
Motivation: 多步扩散式文本图像超分辨率推理昂贵;错误OCR先验还可能反复注入并放大成清晰但语义错误的字符。
Result: 在CTR-TSR-Test及RealCE-200所有评价指标上达到先进水平;CTR-TSR-Test的PSNR至少比既有扩散方法高2.72 dB。
Insight: 置信度加权的文本条件只构造一次并抑制不可靠OCR结果,之后由轻量潜残差模块显式恢复缺失或扭曲的笔画。
Abstract: Text image super-resolution (TSR) aims to recover visually faithful and readable text under unknown degradations. Existing diffusion-based methods typically rely on multi-step prediction of either the high-resolution image or its text prior, resulting in prohibitive computational cost and inference latency. More critically, an erroneous text prior may be repeatedly injected into the denoising process, causing image and text predictions to reinforce each other and progressively amplify an early recognition error into a sharp yet semantically incorrect character. To address these limitations, we propose TOLA, a Text-aware One-step Latent Adaptation framework without iterative image-text diffusion. TOLA consists of two key modules. First, a confidence-weighted text conditioning module constructs the semantic condition only once and suppresses unreliable OCR predictions before they contaminate image reconstruction. Second, a lightweight latent residual correction module explicitly estimates and corrects the structured residual errors to recover missing or distorted stroke details. Extensive experiments demonstrate our state-of-the-art performance across all evaluation metrics on both CTR-TSR-Test ($\times 4$) and RealCE-200 benchmarks. It is worth noting that our TOLA consistently surpasses existing diffusion-based TSR methods by at least 2.72 dB in PSNR on CTR-TSR-Test.
cs.CL [Back]
[35] Framing by Wording, Framing by Selection: A Large-Scale Two-Dimensional Audit of French News Headlines, 2022-2025 cs.CLPDF
Amr Sobhy
TL;DR: 以显著性措辞和选题选择两个维度审计2022至2025年法国新闻标题的框架偏差。
Details
Motivation: 计算新闻框架研究常把标题“如何措辞”和“选择报道什么”混成单一分数,难区分其不同影响。
Result: 建立1万条监督集并分析25家媒体的902,111条去重标题;两类偏差正相关但近半媒体差异无法由另一维解释,默认阈值会高估显著性,校准后可修正。
Insight: 四种措辞手段测显著性框架,媒体层面的报道类型与高强度主题分布测选择框架;群体提及分析为描述性关联,不能解释为同事件因果效应。
Abstract: News headlines frame public issues both by what they select and by how they word it, yet computational framing work typically collapses these operations into a single score. We introduce a two-dimensional framework that separates salience framing, measured through four wording devices (loaded vocabulary, blame attribution, threat framing, rhetorical question), from selection framing, measured through outlet-level story-form and high-charge distributions. We build a 10,000-headline French supervision set using three LLM annotators with majority-vote resolution and human arbitration, validate the labels against two annotator-independent blind human studies, and apply the strongest classifier to 902,111 deduplicated headlines from 25 French outlets (2022-2025). Three main findings emerge. First, salience and selection divergence are positively correlated yet leave nearly half of outlet-level variance unexplained, populating interpretively distinct off-diagonal cells in a four-cell outlet typology. Second, default classification thresholds systematically inflate corpus-level salience estimates; a precision-floor recalibration protocol corrects this distortion. Third, group-mention analysis reveals sharply unequal salience contexts: headlines mentioning Jews, the Far-right, and Muslims carry the highest detected salience rates, which broad event-context composition does not fully explain (residuals are descriptive, not same-event causal estimates; per-group lexicon precision is reported alongside). To our knowledge, this is the largest framing-focused French headline audit to date; we release the supervision set, lexicons, and analysis code.
[36] COILD: An Indic-Centric Parallel Corpus and Benchmark for Machine Translation Across Indian Languages cs.CLPDF
Kshetrimayum Boynao Singh, Nitin Kumar Mishra, Palash Pratim Dutta, Atai Waris Khan, Aparna Kaushik
TL;DR: COILD构建覆盖20种印度语言配对、八个领域的高质量平行语料和专家验证机器翻译基准。
Details
Motivation: 印度语言机器翻译缺乏高质量本土平行语料,许多现有资源以英语为枢轴,难体现语言、文化及领域多样性。
Result: 语料包含116万余条人工翻译与验证句对,另有2,000句专家基准;微调IndicTrans2-Distilled和NLLB-200后,各语言对、领域及自动和人工指标均持续改善。
Insight: 数据完全源自印度语言原文,覆盖印欧、达罗毗荼、藏缅和南亚诸语系,为多语翻译及语言模型提供本土监督。
Abstract: Machine translation (MT) for Indian languages remains constrained by the limited availability of high-quality, Indic-centric parallel corpora and evaluation benchmarks. Existing multilingual resources are largely constructed from English-pivot content and often fail to capture the linguistic diversity, cultural complexity, and domain-specific characteristics of Indian languages. We present COILD, an Indic-centric parallel corpus comprising over 1.16 million human-translated and human-verified sentence pairs, covering 20 Indian language pairs across the Indo-Aryan, Dravidian, Tibeto-Burman, and Austro-Asiatic language families. The corpus is built entirely from original Indian language sources collected from licensed repositories spanning eight domains with direct real-world applicability. Furthermore, we introduce a domain-centric benchmark comprising 2,000 expert-verified sentences to enable consistent multilingual and cross-lingual evaluation across Indian language pairs. To validate the effectiveness of COILD, we fine-tune two representative multilingual neural machine translation models, IndicTrans2-Distilled and NLLB-200. Experimental results demonstrate consistent improvements across language pairs, domains, automatic evaluation metrics, and human evaluation, highlighting the effectiveness of high-quality Indic-centric supervision. COILD provides a valuable training and evaluation resource for advancing multilingual machine translation and future multilingual language models for Indian languages.
[37] Persuaded, Not Informed: Incentive-Misaligned Witnesses Defeat In-Context Grounding cs.CL | cs.AIPDF
Rahul Balakavi
TL;DR: 研究带有乐观利益倾向的CRM证人陈述如何误导模型,并提出区分说服与信息缺失的评测诊断。
Details
Motivation: 即使上下文已有真实政策记录,模型也可能把销售代表等有利益关系者的乐观说法当作证据。
Result: 100项线索判断中,31项陈述与公司政策冲突,只看转录的模型有29项仍判为合格;七个模型均有87%至97%被误导,规模和显式推理未带来抵抗。
Insight: 供给记录反而会让部分设置严格准确率从41%降至18%,主要暴露精确率崩溃而非单纯缺信息;论文将结果定位为评测诊断,并说明并未证明最强模型存在性能下限。
Abstract: Language-model agents increasingly answer questions over customer-relationship management (CRM) records, such as whether to qualify a sales lead. We identify a failure mode not addressed by a stronger model: when the context contains an assertion by a party with an incentive toward optimism - here the sales representative, a witness recorded in the CRM - the model treats the assertion as evidence and clears deals the company’s own records deem unacceptable. Across 100 lead-qualification tasks from CRMArena-Pro, the representative asserts an acceptable timeline in every call and an acceptable budget in 76; on the 31 tasks where such an assertion contradicts the price list and installation policy, a model reading only the transcript clears the deal in 29 of 31 cases. The signature is consistent across seven models from four providers (misled on 87-97%); scale and explicit reasoning confer no resistance. Only 3 of 35 genuine failures involve no assertion: the failure is persuasion, not missing information. We contribute a diagnostic method rather than an architecture: (i) a bucket analysis that separates persuasion from information gaps, (ii) a same-information control showing that supplying the records to the model lowers strict accuracy from 41 to 18 while raising recall - precision collapses - and (iii) a compute-step control that holds extraction fixed and varies only who computes Budget and Timeline. The margin ranges from 42 points on an inexpensive model to 2-5 points on models that already compute correctly; on the strongest models the arms are within confidence intervals, so the pattern is a consistent direction and a soundness property, not a proved performance floor. We pre-specify a generalization test that returns a negative result, characterize the precondition (a policy exactly specified in the inputs), and release all evaluation artifacts.
[38] ELF-REG: Scaling Continuous Diffusion Language Models to Reasoning Tasks cs.CL | cs.LGPDF
Zeyu Michael Li, William Xingxu Chen, Bingshuo Qian, Jiayin Liu, Xiang Cheng
TL;DR: ELF-REG通过表示对齐和联合去噪教师表征,提升连续扩散语言模型的数学推理及代码生成。
Details
Motivation: 连续扩散语言模型可并行解码完整回答,但在难推理任务上的能力尚不及自回归及掩码扩散模型明确。
Result: ELF-REG-L在GSM8K达到55.96% pass@1,在MATH-500为13.39%、HumanEval为22.56%;GSM8K和代码超越同规模所测扩散模型,MATH-500优于基础ELF-L的10.55%。
Insight: 冻结自回归教师监督去噪器中间表示,并让一个全局表示与响应共同去噪;即使不做少步训练,早停也能以16次网络评估在HumanEval达到41.21% pass@10。
Abstract: Fully continuous diffusion language models (dLMs) denoise continuous representations without intermediate discretization, then decode all response tokens in parallel at the final step. Their performance on challenging reasoning tasks remains less established than that of autoregressive (AR) LLMs and masked dLMs. We scale Embedded Language Flows (ELF) to mathematical reasoning and code generation on GSM8K, MATH-500, HumanEval, and MBPP. We introduce ELF-REG, which improves learning with representation alignment and entanglement (REPA+REG), where a frozen AR teacher supervises intermediate denoiser features and supplies a global representation that is jointly denoised with the response. ELF-REG-L achieves 55.96% pass@1 on GSM8K at 64 network function evaluations (NFE), and 13.39% on MATH-500 and 22.56% on HumanEval at 128 NFE. It outperforms the evaluated comparable-scale dLMs in pass@1 on GSM8K and code, and improves MATH-500 pass@1 from 10.55% for the ELF-L baseline to 13.39% with ELF-REG-L. Without few-step training, the same task-specific checkpoints support strong low-NFE performance through early-stop, which decodes an intermediate clean prediction without completing the denoising trajectory. At 16 NFE, ELF-REG-L reaches 41.21% HumanEval pass@10, outperforming recent continuous dLMs of comparable scale.
[39] Predicting Emerging Topics from Outliers: A Prospective Study of Weak Signals in Embedding Space cs.CLPDF
Evangelia Zve, Gauvain Bourgne, Jean-Gabriel Ganascia
TL;DR: 研究能否在信息首次出现时,仅凭嵌入空间位置预测看似噪声但将成为新话题核心的文档。
Details
Motivation: 主题模型初期常把新兴话题的早期文档视作离群点,但不能依赖未来信息做实时识别。
Result: 在两个法语新闻语料中,高共识样本F1从全体约0.77提高到0.90以上;严格按时间评估仍保持0.76至0.80。
Insight: 依据离群文档后续轨迹定义新主题先导、既有主题补充或孤立类别,并用多个嵌入模型间的一致性估计标签可信度;预测主要依赖嵌入空间几何特征。
Abstract: Some documents that embedding-based topic models initially classify as noise later become founding members of emerging topics. At publication time, however, they appear as scattered points in embedding space and are difficult to distinguish from ordinary noise without the benefit of hindsight. We study whether such anticipatory outliers can be predicted prospectively, using only information available when a document first appears. We derive labels from the subsequent trajectories of outlier documents, distinguishing those that anticipate new topics from those that reinforce existing topics or remain isolated, and estimate label confidence through agreement across multiple embedding models. On two French news corpora, anticipatory outliers prove predictable at publication time. Under cross-validation, $F_1$ rises from about 0.77 over the full eligible population to above 0.90 on high-consensus subsets, and remains at 0.76-0.80 under a strictly chronological evaluation. Predictive performance is driven mainly by geometric features capturing each outlier’s position in embedding space.
[40] EAGER: Enhancing Generative Event Extraction via Reinforcement Learning with Verifiable Rewards cs.CLPDF
Omar Adjali, Siting Liang, Omair Shahzad Bhatti, Daniel Sonntag
TL;DR: EAGER用细粒度可验证奖励和模式对比优势估计训练生成式事件抽取模型。
Details
Motivation: 端到端事件抽取需同时识别触发词、事件类别并依据模式提取论元跨度,稀疏二元奖励容易造成优势信号塌缩。
Result: 在七个基准上持续超过提示、监督微调和既有强化学习基线;摘要报告相较最强先前方法有显著提升但未列具体分数。
Insight: 奖励分别覆盖结构合法性、抽取准确性、依据性、覆盖率、过度生成和跨度精度;Schema-Contrastive Advantage Estimation用对比信号缓解稀疏奖励问题。
Abstract: End-to-end event extraction remains challenging for large language models as it requires simultaneous identification of event triggers, classification of event types, and extraction of schema-grounded argument spans. We present EAGER, a reinforcement learning framework for generative event extraction that combines fine-grained verifiable rewards with Schema-Contrastive Advantage Estimation to alleviate advantage collapse under sparse binary rewards. Our reward design explicitly targets structural validity, extraction accuracy, groundedness, coverage, over-generation, and span precision. Experiments across seven benchmark datasets show that EAGER consistently outperforms prompting, supervised fine-tuning, and prior reinforcement learning baselines, achieving a substantial improvement over the strongest prior method. Results demonstrate that task-aligned verifiable rewards and contrastive advantage estimation substantially improve structured extraction.
[41] Post-Training Leaves Behavioral Shadows on Unrelated Decisions cs.CL | cs.AI | cs.LGPDF
Ziyang Zhang, Yubin Jing, Yuanhao Zeng, Yuyao Li, Haofan Wang
TL;DR: ATD仅用教师在提示上选择的单个普通词语,探索后训练能力能否通过无关文本传递给学生模型。
Details
Motivation: 既有潜意识学习多研究偏好或特征,且需要大量教师生成文本;作者检验极少、任务无关信号能否传递具体能力。
Result: Qwen2.5-1.5B代码实验中,5,664条提示—单词样本较严格匹配的干扰对照在HumanEval+提高5.34个百分点;摘要还报告科学知识、常识和阅读理解等方向有迁移。
Insight: 挑选共享预训练祖先对两个普通词概率近乎无差异的提示,让学生只学习教师选择的一个词;不使用目标任务样本、教师logit或参数,功能分析显示所得能力可组合且强度随教师更新幅度变化。
Abstract: We find that language models can transfer capabilities through task-unrelated text. Post-training typically improves language models using task-specific data. Prior work on subliminal learning shows that information about these updates can pass through unrelated generations, but has largely focused on traits or preferences using extensive teacher outputs. We introduce Active Taskless Distillation (ATD), which achieves capability transfer using only a single word from the teacher per prompt. ATD probes the behavioral shadow of post-training by selecting prompts where the teacher and student’s shared public ancestor is nearly indifferent between two ordinary words. A student initialized from this ancestor learns solely from the resulting prompt-word pairs, without target-task examples, teacher logits, or teacher parameters. In the primary coding experiment with Qwen2.5-1.5B, 5,664nses yield a 5.34 pp gain on HumanEval+ over an exact nuisance-matched control thadisrupts prompt-resperiments showtransfer in scientific knowledge, commonsense reasoning, and reading comprehensins across additional model generations, sizes, and families. Functional analyses show that the learned sid composable, andthat its strength tracks the teacher’s update strength.
[42] No More Free Lunch: Corpus Task Complexity Matters as Corpora Grow cs.CL | cs.AIPDF
Prasann Singhal, Amanda Bertsch, Jacob Steinhardt, Sewon Min
TL;DR: 提出语料任务复杂度CTC,按任务难度随文档规模增长的速度,重新评估长上下文推理方法。
Details
Motivation: 大语料评测多采用复杂度随语料线性增长的检索任务,无法代表核查矛盾等更难、复杂度可能超线性增长的问题。
Result: 新增10项高CTC任务后发现,长上下文模型在语料扩大时难度显著上升;块稀疏和混合注意力在低CTC任务上接近全注意力,在高CTC任务上退化更多。
Insight: CTC-Bench共含22项任务,区分线性与二次或更快增长难度;全注意力难扩展时,高复杂度大语料推理仍是开放挑战。
Abstract: Given a large corpus, the questions one might ask can vary – from “When was the first human heart transplant?” to “What are all the contradictory claims in this literature?” – but what makes some questions more challenging than others? In this work, we define a notion of Corpus Task Complexity (CTC) that characterizes tasks by how their difficulty grows with corpus size; for instance, a retrieval query only requires a single linear pass over a corpus, while finding contradictions requires checking a quadratically growing set of claim pairs. Observing that prior work has largely only studied tasks whose difficulty grows linearly with corpus size, which we call low CTC tasks, we introduce 10 new tasks belonging to a class of high CTC whose difficulty grows quadratically or more in corpus size. We find that high-CTC tasks not only grow much more challenging on average at longer contexts for LCLMs, they reverse many modeling conclusions drawn solely from low-CTC evaluations. For instance, efficient block-sparse and hybrid attention approaches consistently match full attention performance on low-CTC tasks, but degrade much more on high-CTC tasks. Large-corpus high-CTC reasoning thus remains an open challenge as full attention is too costly to scale, motivating future research on these tasks. We release our code, data, and 22-task suite (CTC-Bench), to facilitate future research in this area.
[43] Reasoning Instructions Can Break Answer Decoding in Vision–Language Models cs.CL | cs.AIPDF
Zeyan Li, Siyuan Qiu, Jianfeng Xu
TL;DR: 指出多选VLM评测中“先要求思维链、再读取选项logit”的前缀评分可能造成严重解码接口失配。
Details
Motivation: 某些评测器添加推理提示后,在模型尚未生成推理文本时就读取答案标签logit,可能把格式与续写偏好误当模型知识。
Result: ScienceQA上Qwen2.5-VL-7B得分从80.76%降至45.48%,五种选项排列中93.54%的前缀评分预测选首项;同一隐藏状态的线性探针恢复78.94%,自由生成恢复75.24%。
Insight: 概率质量会转向适合作为续写的词元,但晚层仍保留答案信息;除非请求输出事件与评分事件一致,否则应避免CoT前缀评分,以免混淆知识与评测接口问题。
Abstract: Chain-of-thought (CoT) instructions can distort multiple-choice VLM evaluation when a scorer appends a reasoning cue but reads answer-label logits before the model generates any rationale. We call this CoT-prefix scoring. On ScienceQA, Qwen2.5-VL-7B drops from 80.76% to 45.48%, and across five option-content permutations 93.54% of CoT-prefix predictions select the first slot. Condition-matched linear probes recover 78.94% from the same hidden states, while free generation restores 75.24%, showing that the answer often survives the prefix and the immediate readout fails. Vocabulary and layer diagnostics explain the mismatch: probability mass moves toward continuation tokens, while answer information remains linearly accessible in late layers. The effect recurs with varying severity across datasets and models, though not universally. These results show that CoT-prefix scoring can confound model knowledge with an evaluation-interface mismatch and should be avoided unless the requested and scored output events are aligned.
[44] Where LLM Graders Succeed and Break: Evidence from Two Computer-Science Exams cs.CL | cs.AI | cs.CYPDF
Ali Habibullah, Yazan Alshoibi, Mohammad Alshiekh, Salman Khan, Naeemullah Khan
TL;DR: 跨两门计算机科学考试测试LLM阅卷提示的稳健性,并发现少量“严格评分”措辞能使多种模型拒绝正常给分。
Details
Motivation: 长答题阅卷耗费大量人力,LLM评分有潜力,但提示中的细微措辞是否会导致系统性偏差尚不清楚。
Result: 计算机视觉考试570名学生的171种配置中,最佳模型MAE为1.64/35,优于两名人工阅卷者彼此比较的2.61;但简短严格提示使17种开源模型中14种评分失常。另一门考试显示效应方向依试卷而异。
Insight: 伤害来自扣分提示中的具体句子而非语气或规模;合并约3,900条双考试评分样本微调LoRA可修复五个小模型,并大幅降低对严苛角色提示的敏感性。
Abstract: One long-form exam in a large course costs hundreds of grader-hours, and qualified graders are scarce; LLM graders are a tempting alternative. To show its pitfalls we grade a practical Computer Vision exam ($570$ dual-graded students) under $171$ configurations spanning closed and open-weights models; the best reaches mean absolute error $1.64/35$, below the $2.61/35$ two human graders achieve against each other. The catch is the prompt: a short ‘’strict grader’’ preamble drives $14$ of $17$ open-weights models out of the graded band ($\text{MAE} \ge 8$), three stopping grading altogether. The damage traces to the preamble’s two credit-withholding sentences, not to tone or model scale; one of them, ‘’never give partial credit’’, alone makes two of three probed models stop grading. The closed flagships of three vendors shift calibration under it but stay in the band. In $162$ further configurations on a second, independent Machine Learning exam from another course ($1{,}038$ dual-graded students), the preamble worsens ten models, moving three out of the band into collapse and one into refusal, yet improves seven whose neutral prompts over-mark: the vulnerability replicates, but its direction is exam-specific. Light LoRA fine-tuning repairs it: one adapter on the two exams’ pooled $\sim 3{,}900$ graded examples brings five small open models to parity or better with a human grader in agreement with the grader pair, and sensitivity to the three harsh personas nearly vanishes ($\le 0.32$ MAE). We release the anonymised dataset, full ablation grid, and grading, fine-tuning and analysis pipelines.
[45] ArGuard Shared Task: Harmful Content Detection in Arabic Memes and LLM Prompts cs.CL | cs.AIPDF
Firoj Alam, Md. Rafiul Biswas, Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Hamdy Mubarak
TL;DR: ArGuard共享任务评测阿拉伯语梗图多模态仇恨检测及用于LLM安全评估的有害提示检测。
Details
Motivation: 阿拉伯语多模态有害内容检测需要统一比较系统,尤其细粒度梗图类别及提示安全的能力。
Result: 58队注册、35队参加最终评测、27队提交系统论文;最佳宏F1依次为A1 0.823、A2 0.419、B1 0.984、B2 0.790,细粒度梗图分类最困难。
Insight: 两个赛道分别覆盖阿拉伯语梗图仇恨检测和阿拉伯语LLM有害提示识别;稀疏标签及训练测试分布偏移是困难原因之一。
Abstract: ArGuard is a shared task on harmful content detection in Arabic memes and LLM prompts. It includes two tracks: Track A focuses on multimodal hate detection in Arabic memes, while Track B addresses harmful prompt detection for Arabic LLM safety evaluation. In total, 58 teams registered, 35 participated in the final evaluation, and 27 submitted system-description papers. Participating teams explored models such as AraBERT, Jais, and Qwen3-VL. The best systems achieved macro-F1 scores of 0.823 on A1, 0.419 on A2, 0.984 on B1, and 0.790 on B2. Fine-grained meme classification in A2 was the most challenging setting, partly due to sparse labels and train-test distribution shifts.
[46] Rufus-Air: An Open LLM Post-Training Recipe cs.CL | cs.AI | cs.LGPDF
Chia-Yuan Chang, Renyuan Cheng, Rui Feng, Xiaotian Han, Yuan He
TL;DR: Rufus-Air公开记录GLM-4.5-Air-Base的八阶段后训练流程,提供可复现的大模型训练配方。
Details
Motivation: 完整复现复杂模型后训练,需要知道数据、奖励设计、训练设施和阶段顺序等细节。
Result: 该流程包含SFT、推理/编码/指令强化学习、通用及专用智能体训练和RLHF;作者报告改进了官方后训练版本,并与同规模开源模型有竞争力。
Insight: 从基础能力逐渐过渡到高级能力,从可验证奖励转向软评审信号;高质量多样SFT、难度筛选、奖励可靠性排序以及工程设施都属于配方核心。
Abstract: Rufus-Air is an open and reproducible post-training recipe on GLM-4.5-Air-Base (106B-A12B), organized as a serial pipeline of eight stages: SFT, Reasoning RL, Coding RL, Instruction-Following RL, General Agent, Coding Agent, Search Agent, and RLHF. We document the data, reward design, infrastructure, stage order, and stagewise results needed to reproduce the recipe. Stages progress from basic to advanced capabilities and from hard, verifiable rewards to softer judge-based signals. Training builds on open-source components and public data, much of it used as released, without new human annotation or an in-house distillation teacher. Our main findings are that (i) diverse, high-quality SFT establishes a strong capability floor; (ii) difficulty filtering keeps RL prompts within a productive learning range; (iii) reward reliability provides a practical principle for ordering stages; and (iv) infrastructure and engineering choices are part of the recipe, not just an implementation detail. Rufus-Air improves over the official GLM-4.5-Air post-trained release and is competitive with similarly sized open models.
[47] IterSynth: Rethinking Deep Search Agents via Role-Decoupled Iterative Synthesis cs.CL | cs.AIPDF
Xingyu Wu, Yuchen Yan, Zhengxi Lu, Siqi Chen, Xin ZHANG
TL;DR: IterSynth让规划器和证据综合器轮流工作,并以不断更新的摘要作为搜索状态,改善长程深度检索。
Details
Motivation: ReAct式智能体让同一策略负责规划、取证和综合,且不断堆积搜索历史会带来噪声并掩盖有用证据。
Result: 在BrowseComp、Xbench-DS等五项基准上,IterSynth-8B平均得分50.7,比最强8B及以下先前智能体高4.2%;在前沿专有模型上也优于ReAct类提示。
Insight: 把信息需求规划与证据综合分工,摘要作为持久搜索状态;RDPO结合最终奖励和轮次量规评价,并按角色分别计算优势以精确分配信用。
Abstract: Deep search requires LLM agents to decompose complex queries, search for evidence, and synthesize grounded answers, yet existing ReAct-style agents suffer from two limitations: role coupling, where one policy must handle planning, evidence use, and synthesis; and context accumulation, where growing search histories introduce noise and obscure useful information. To address these issues, we propose IterSynth, a role-decoupled and summary-based paradigm that alternates between a Planner for identifying information needs and a Synthesizer for integrating evidence into an evolving summary state. This design separates planning from synthesis while using the summary as the persistent state of search, reducing both capability coupling and context noise. To train IterSynth effectively, we further introduce Role-Decoupled Policy Optimization (RDPO) for reinforcement learning, which combines terminal outcome rewards with turn-level rubric evaluations and computes role-specific advantages for more precise credit assignment. Experiments on five long-horizon deep-search benchmarks such as BrowseComp and Xbench-DS show that IterSynth-8B achieves an average score of 50.7, surpassing the strongest prior $\leq$8B agent by +4.2%. Moreover, IterSynth serves as a model-agnostic prompting paradigm, delivering substantial zero-shot gains over ReAct and similar prompting paradigms on frontier proprietary models.
[48] Evaluating Explanation-Driven Vision-Language Reasoning via Generation Order Interventions cs.CLPDF
Siting Liang, Luca Rippe, Omar Adjali, Daniel Sonntag
TL;DR: 通过控制生成顺序的实验,检验视觉语言模型的解释是否因果性地参与答案形成。
Details
Motivation: 多数解释驱动VLM采用先答后解释,隐含假设监督解释能反映推理;现代模型则越来越常先生成理由再作答。
Result: 实验显示,大模型规模是可靠支持先解释后回答的条件;先回答格式错误更少。答案准确率和解释忠实度还共同受任务结构、预训练知识及微调影响。
Insight: 在知识问答、视觉蕴含和组合定位中,控制生成顺序并排除额外思维链等混杂因素,可以更直接检验单次生成中的解释—预测因果联系。
Abstract: Natural language explanation generation serves as a key mechanism for exposing and evaluating vision-language reasoning. Prior work on explanation-driven vision-language models predominantly follows a post-hoc (answer-first) paradigm, implicitly suggesting that supervised rationales can reflect underlying reasoning processes. In contrast, modern large vision-language models increasingly exhibit a rationale-first generation tendency, which more closely aligns with structured, stepwise reasoning. In this work, we systematically evaluate whether explanations are causally tied to model predictions within a single generation step under a controlled experimental setup, explicitly eliminating unnecessary chain-of-thought or other intermediate reasoning processes across knowledge-intensive QA, visual entailment, and compositional grounding benchmarks. We find that larger models emerge as a prerequisite for reliably supporting rationale-first reasoning at scale. However, answer-first generation is less prone to format-related errors in structured output. Overall, explanation ordering, model scale and pre-training knowledge, task-specific fine-tuning, and task structure jointly influence both prediction accuracy and reasoning faithfulness.
[49] PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides cs.CL | cs.AIPDF
Xiaoqiu Wang, Yizhe Chi, Wenyi Li, Deyao Hong, Zhihan Shan
TL;DR: PPTBench评测编码智能体能否把真实论文中的流程图重建为结构化、可编辑的演示文稿。
Details
Motivation: 视觉编码既需理解图像布局又需用代码表达,而现有基准偏主观、输出不可编辑或只测局部修改。
Result: 基准包含500项真实arXiv流程图重建任务;31种模型与工具配置中最佳得分67.80,中位数仅19.47。智能体能生成有效PPTX,但语义和视觉细节仍困难。
Insight: 四阶段智能体评审分别检查文件有效性、语义正确性、渲染质量和细节;更多推理主要帮助通过硬性门槛,强验证与整体质量关系更稳定。
Abstract: Coding agents are beginning to act in the visual world. They now build webpages, GUIs, games, 3D scenes, diagrams, and documents. Success in such visual coding requires bridging two spaces: inferring visual structure and expressing it programmatically. Slides are a core medium of knowledge work, widely used to communicate ideas and collaborate in a form that people can directly inspect and edit. Therefore, they provide an ideal testbed for visual coding, as they require agents to recover visual structure and realize it as editable objects. However, existing benchmarks either rely on subjective open-ended evaluation, produce non-editable code outputs, or focus only on local editing rather than end-to-end visual reconstruction. We introduce PPTBench, which benchmarks visual coding through editable slide reconstruction. It contains 500 tasks, each based on a scientific flow diagram from a real arXiv paper and requiring agents to reconstruct it as a single PPTX page composed of native, editable objects. A four-stage Agentic Judge evaluates artifact validity, semantic correctness, rendering quality, and fine-grained visual quality. Across 31 configurations spanning model families, effort levels, and harnesses, the best configuration, Kimi K3, reaches only 67.80, while the median scores 19.47. We find that agents can reliably produce valid PPTX files but still struggle with semantic and visual correctness, especially text details. More reasoning mainly helps agents pass hard gates, while stronger verification is more consistently associated with higher quality. PPTBench advances the vision of coding agents that can understand and reconstruct the visual world through structured, editable code.
[50] LLMersion: A Local-First AI Agent Framework for Low-Cost Home Language Learning toward Educational Equity cs.CL | cs.CY | cs.HCPDF
Qiming Guo, Jinwen Tang, Xingran Huang, Hung-Yu Lin, Yafu Zhong
TL;DR: LLMersion提出完全本地运行的AI语言学习方案,让低成本笔记本为学习者提供听说读写练习。
Details
Motivation: 全球教师短缺、家教费用高和网络不可及限制语言学习;单纯提供硬件并不能替代教师的语音与互动支持。
Result: 作者指出开放小模型已可在约200美元级笔记本运行完整四技能系统,社区实测速度接近语音播放速度,电力成本约每学习小时一美分;发布了开源原型。
Insight: 系统在学习者家庭本地运行并使用个人文档,目标是隐私优先、无需网络且可由用户定制的学习智能体;文中亦强调硬件本身不足以保证教育效果。
Abstract: Artificial intelligence helps education most where an essential provision has been rationed by cost. For language learners that provision is a teacher’s voice, which binds listening, reading, speaking, and writing into one act. Published evidence shows why most learners lack it, from a global shortage of 44 million teachers to heavy household tutoring bills, and why technology has not substituted for it: computer-assisted language learning proved effective but narrow, applications presuppose connectivity 2.6 billion people lack, and One Laptop per Child’s randomized evaluation found that hardware without capable software teaches nothing. We distill eight difficulties and four binding constraints, and argue that small open-weight models dissolve the last: a complete four-skill stack now fits a $200-class laptop and, on community measurements, generates at the pace speech is consumed, for about one US cent of electricity per study hour. We therefore propose LLMersion, a scheme for AI for education that runs entirely at home, over the learner’s own documents, with an AI-written, AI-understood, AI-updated codebase anyone can customize; present LLMersion-1, a released open-source prototype (https://github.com/QM378/LLMersion); and outline the vision of a private learning agent.
[51] TimeBraid: Unifying Time Series and Language for Understanding and Forecasting cs.CL | cs.AI | cs.CEPDF
Xinyue Wang, Jiacheng Pang, Kun Zhou, Kexin Zhang, Defu Cao
TL;DR: TimeBraid通过交错的全局残差注意力对齐预训练语言模型和时序基础模型,统一时序理解与预测。
Details
Motivation: 时序模型能感知连续信号,语言模型则有知识、指令遵循和推理能力,如何有效结合两者并稳定联合训练尚需研究。
Result: 以220万组精选序列—文本对和490万条指令样例训练后,在时序感知、理解、推理及上下文辅助和单模态预测任务上,与大得多的通用模型及专用模型具竞争力。
Insight: 系统研究两类表示的对齐位置、语言对时序结构的落地方式、理解与生成的平衡及优化稳定性;统一提示和全局残差交互融合两侧能力。
Abstract: We present TimeBraid, a series of unified time-series and language models that align pretrained language models and pretrained time-series foundation models through interleaved global residual attention layers. Each model inherits knowledge, instruction following, and reasoning from one side, continuous-signal perception and zero-shot forecasting from the other, and fuses the two in a shared representation space where both modalities are understood and generated. We study the design choices that make such unified modeling work: where to align the two representation spaces, how to ground language in temporal structure, how to balance understanding with generation, and how to keep joint optimization stable. The resulting recipe combines a unified prompting scheme for diverse time-series and text tasks, stabilized joint training, and supervision from 2.2M curated series–text pairs and 4.9M instruction-tuning samples. Across benchmarks spanning time-series perception, understanding, reasoning, and both context-aided and unimodal forecasting, TimeBraid remains competitive with far larger general-purpose models and task-specific counterparts.
[52] Benchmarking and Domain Adaptation of Automatic Speech Recognition (ASR) for Adolescent Health Communication in Ghanaian Languages cs.CL | cs.AIPDF
Stephen E. Moore, Akwasi Asare, Mich-Seth Owusu, Paul Azunre, Joel Budu
TL;DR: 评测并适配Twi、Dagbani和Ewe三种加纳语言的青少年健康沟通语音识别系统。
Details
Motivation: 低资源语言缺少健康领域语音识别资源,直接使用通用语音模型难以可靠服务青少年性与生殖健康交流。
Result: 以约9万条圣经语料微调Qwen3-ASR-0.6B后,三种语言WER均下降;Ewe从109.3%降至64.8%,CER从65.1%降至24.9%。50名社区用户试用KasaHealth时,100%认可聊天、72%认为翻译良好或优秀、92%愿意推荐。
Insight: 三阶段证据显示,核心瓶颈是经验证的领域内数据,而非模型能力或算力;研究还通过实际语音应用检验了技术与社区使用的结合。
Abstract: This paper presents an end-to-end study of automatic speech recognition (ASR) for adolescent health communication in three Ghanaian languages (Twi, Dagbani, and Ewe). The work proceeds in three connected stages; First, we benchmark five ASR systems (three language-specific Wav2Vec2 models and two multimodal LLMs, Gemma 3n and Gemma 4) on a general-domain Bible corpus and a Youth Adolescent Sexual and Reproductive Health (ASRH) Domain ASR dataset, using Character and Word Error Rate (CER, WER). Second, guided by the benchmark, we perform supervised domain adaptation: although Gemma 4 was the strongest zero-shot candidate, fine-tuning it proved computationally infeasible, so we pivoted to the compact Qwen3-ASR-0.6B, fine-tuned on a large Ghana Bible corpus (~90k samples) and evaluated strictly on held-out human-collected in-domain audio. Fine-tuning reduced WER on every language, most dramatically for Ewe (WER from 109.3% to 64.8%, a drop of 44.5 pp; CER from 65.1% to 24.9%). Third, we validate the work through KasaHealth, a live voice-first ASRH application deployed in all three languages, complemented by Senti-Check, a technical evaluation harness. KasaHealth was tested by 50 community respondents and achieved a 100% chat-approval rate, a 72% Good-or-Excellent translation rating, and a 92% would-recommend rate, while surfacing the domain gaps that most constrain real-world use. Across all three stages the evidence converges: for these languages the binding constraint is validated in-domain data, not model capability or computation.
[53] MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression cs.CLPDF
Youpeng Zhao, Tian Tan, Liqian Peng, Jun Wang, Alec Go
TL;DR: MILO按块进行低秩KV缓存压缩,并按信息熵动态分配秩预算,以提升多样本上下文学习效率。
Details
Motivation: 成千上万条示例可增强复杂任务上下文学习,但KV缓存随示例数线性增加,限制在线服务和端侧部署。
Result: Qwen2.5实验中缓存内存最多减少50%,吞吐提升1.8倍;分类和推理任务表现仅有可忽略退化,优于先前基线。
Insight: 按包含多条示例的块压缩低秩冗余,再将更多秩分配给信息熵高的关键块、强压缩冗余块,以适配上下文密度差异。
Abstract: Many-shot in-context learning (ICL) enables large language models (LLMs) to adapt to complex tasks by conditioning on thousands of demonstration examples, but this paradigm shifts the inference efficiency bottleneck to the key-value (KV) cache memory. Due to the linear scaling behavior of the KV cache, storing these intermediate tensors has become a paramount challenge for both online serving and on-device deployment. To address this issue, we propose a novel compression framework, termed MILO, that exploits the low-rank redundancy inherent in many-shot contexts. Specifically, MILO features a block-wise low-rank compression strategy that compresses the KV cache at the block granularity, where each block contains multiple many-shot examples. Furthermore, to handle the heterogeneous context density across different blocks, MILO dynamically allocates rank budgets based on the information entropy, preserving the fidelity of critical blocks while aggressively compressing redundant ones. Experimental results on Qwen2.5 models demonstrate that our method achieves up to 50% reduction in KV cache memory and 1.8x throughput improvement, with negligible performance degradation on classification and reasoning benchmarks, significantly outperforming prior baselines.
[54] An Empirical Study of VLM Pipelines for Long-Document QA cs.CL | cs.AI | cs.CV | cs.IRPDF
Kenan E. Ak, Jay Mohta, Gwang Gook Lee, Yan Xu, Dimitrios Dimitriadis
TL;DR: 系统比较多模态VLM长文档问答的页面输入、检索模态和智能体流水线选择。
Details
Motivation: 长文档包含文字、图表、表格和复杂版面,部署需决定读入哪些页面、用何种检索及是否采用智能体。
Result: 智能体在MMLongBench-Doc上只有读者模型足够大时才胜过静态页面输入,在LongDocURL上各读者至少持平;图像检索优于最强文本管线,top-k图像检索仅耗全页输入约七分之一至四分之一token。逐问题选择三种强管线的预言机还能提高约13个百分点。
Insight: 检索模态比检索器具体选择更重要;一次交叉编码器重排已接近复杂多阶段LLM文本管线,按证据类型路由则几乎未恢复预言机收益。
Abstract: Vision-Language Models (VLMs) are increasingly used for long-document processing, where the inputs combine text with charts, tables, figures, and complex layouts. Deploying them means choosing how to feed the document to the model, which retriever to use when only a subset of pages is sent, and whether to run the model agentically or as a static pipeline. We study these choices on two long-document QA benchmarks with both frontier API and open-weight VLMs. First, on MMLongBench-Doc our six-tool agent with page, table, figure, and search calls pays off only once the answering VLM is large enough: with Qwen3.5-4B and 9B it trails static page input, with Qwen3.5-27B it draws level, and with Sonnet 4.5 it leads. On LongDocURL it is level with or ahead of static input at every reader. Its lead over the strongest static pipeline is clearest with the frontier reader on MMLongBench-Doc and narrows to within noise on LongDocURL. Second, retrieval modality matters more than the specific retriever: the strongest image retriever leads the strongest text pipeline, and on the text side a single off-the-shelf cross-encoder rerank essentially matches a much heavier multi-stage LLM pipeline. Top-k image retrieval is also the most token-efficient input at every reader we paired it with, at roughly a seventh to a quarter of the tokens of sending every page. Third, cutting across all three choices, three of our strongest pipelines succeed on different questions, and an oracle that picks the best pipeline per question gains roughly thirteen points over the best single pipeline, though evidence-type routing recovers almost none of it.
[55] Return or Revise? Learning When Revision Helps Retrieval-Augmented QA cs.CL | cs.IR | cs.LGPDF
Nicholas Kashani Motlagh, Tim Anderson, Jeremy Gwinnup, Grant Erdmann
TL;DR: 提出可恢复性指标,预测检索证据修订当前草稿究竟会纠正还是损害检索增强问答答案。
Details
Motivation: 草稿置信度只反映当前答案是否正确,无法判断基于给定证据执行某种修订后的净效果。
Result: 25,870个留出问题、三种修订设置中,配对修订结果训练的策略在全部九个Llama设置下比草稿正确性评分器有更高准确率—修订率曲线;平均阈值收益0.23至0.68个百分点,超过三分之一预言机差距,但仍有38%至46%的有害修订。
Insight: 同时评估原草稿和候选修订可观察修复、损害及可恢复性;若可用标准RAG答案,直接在草稿与该答案间选择更强,加入第三种修订选项未显著增益。
Abstract: We consider the decision of whether to return an existing draft answer or revise it using retrieved evidence, as in answer-revision systems. Draft confidence estimates whether the current answer is correct, but the decision requires estimating the effect of a specified revision. For offline training and evaluation, we grade both the returned draft and its candidate revision under the same correctness judge, which makes repair, harm, and the gap to an oracle observable. We call this paired effect its recoverability, and we train policies to predict it before revision. On 25,870 held-out open-domain questions across three revision setups, a scorer trained on the paired outcome has greater area under the accuracy–revision-rate curve than a matched draft-correctness scorer in all nine Llama setup–seed fits, and gains 0.23–0.68 accuracy points on average at development-selected thresholds, a difference significant across training runs only for dense retrieval. The resulting policy improves on always revising and on average closes more than a third of the oracle gap, although it still applies 38–46% of the harmful revisions. When a draft-free standard-RAG answer is also available, however, choosing between the draft and that answer is stronger by about two points for Llama and four for OLMo, and adding candidate revision as a third option yields no significant gain. Recoverability describes one revision; its value as an available action also depends on the alternatives.
[56] VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switching cs.CL | cs.SDPDF
Minh Hoang, Thai Le
TL;DR: VietPrism提供覆盖越南语方言、语码转换及真假语音配对的多域语料,用于ASR和音频深伪检测。
Details
Motivation: 越南语研究资源常把识别、说话人、方言、语码转换和深伪检测分开,难以共同评估真实语言多样性与伪造风险。
Result: 真实语料含993.4小时、403,941条语句和1,262名说话人,另生成3,100余小时配对伪造语音;多语种检测器错误率强烈依赖生成器,说话人相似度升高时DFA-1B的错误率从16.3%升至33.6%。
Insight: 伪造样本均使用经验证说话人参考并与文本、身份匹配的真语音配对,减少词汇和身份混淆;方言分组结果也暴露检测器差异。
Abstract: Vietnamese speech research is constrained by resources that isolate automatic speech recognition from speaker, dialect, code-switching, and deepfake analysis. We introduce VietPrism, an open, multi-domain corpus that brings these dimensions together at scale: 993.4 hours and 403,941 bona fide utterances from 1,262 verified speakers across 8,388 real-world videos. To our knowledge, it is the first large-scale Vietnamese corpus to jointly provide transcripts, consistent speaker identities, five dialect groups, and naturally occurring Vietnamese–English code-switching, which constitutes nearly half of the corpus by duration. We further create over 3.1K hours of spoof speech with four open-source and commercial synthesis systems. Every spoof is conditioned on a verified speaker reference and paired with a transcript- and speaker-matched bona fide utterance, enabling unique controlled evaluation with reduced lexical and identity confounds. Zero-shot evaluation of five pretrained multilingual detectors reveals striking brittleness: EER greatly varies across detector–generator pairings, while recent multilingual detector DFA-1B degrades from 16.3% to 33.6% as speaker similarity increases. Dialect-stratified results expose further model-dependent disparities. By unifying natural linguistic diversity with controlled spoof generation, VietPrism provides a challenging foundation for Vietnamese speech modeling and trustworthy audio-deepfake detection.
[57] R-DEIM Net: An Efficient Rationale-Augmented Dual-Expert Interaction Model for Paraphrase Detection cs.CL | cs.AIPDF
Pushp, Vaibhav Prajapati, Himangshu Sarma
TL;DR: R-DEIM Net以双专家架构联合判定问题改写关系并生成可读理由,兼顾效率与解释。
Details
Motivation: 大型模型改写检测准确但计算昂贵,Siamese-BERT部署更轻,却较难生成透明的解释。
Result: Quora Question Pairs十折交叉验证准确率90.07%、F1为90.16%,接近更大的Transformer和LLM基线,但参数量仅7,600万。
Insight: 交互专家用多尺度二维卷积及注意力捕获词元相似模式;Flan-T5-small推理专家生成辅助理由,并把解码器隐藏状态池化作为分类特征而不重新编码生成文本。
Abstract: Recent advances in paraphrase detection reveal a fundamental trade-off: large language models achieve high accuracy but require high computation, while efficient Siamese-BERT variants offer practical scalability with reduced transparency in rationale generation. We present R-DEIM Net, a 76M-parameter dual-expert architecture exploring whether moderate-scale models can achieve competitive accuracy on paraphrase detection while enabling human-readable rationale generation. The architecture combines two specialized components: an Interaction Expert that captures token-level similarity patterns through multi-scale 2D convolutions and attention head allowing variable input length, and a Reasoning Expert that uses a Flan-T5-small decoder to generate rationales as auxiliary supervision. Rather than re-encoding generated text, we extract and pool decoder hidden states as complementary features for classification. On the Quora Question Pairs dataset, R-DEIM Net achieves 90.07% accuracy and 90.16% F1-score via 10-fold cross-validation. This represents competitive performance with strong transformer-based baselines (e.g., MFAE BERT: 90.54% accuracy) and recent large language model based approaches (LLaMA-70B) while using a substantially smaller parameter budget. The model generates rationales alongside predictions, providing potential for auxiliary human-readable descriptions.
[58] What, When, and How: Audio Description as Constrained Global Optimization cs.CL | cs.CVPDF
Igor Sterner, Mirella Lapata, Alex Lascarides, Frank Keller
TL;DR: 把电影音频描述建模为“描述什么、何时说、如何压缩表达”的联合受约束优化问题。
Details
Motivation: 既有自动描述通常假定待讲视觉内容及其时间已给定,而真实无障碍音频描述还需避开对白并适应空隙长度。
Result: 在REFRAMED电影基准上,系统在描述选择和时机判断方面优于提示式LLM,并在叙事问答及时间定位指标上达到新最佳;与专业描述者仍有明显差距。
Insight: LLM提出、定位并估计叙事重要性,再生成压缩描述;混合整数线性规划在场景范围内联合选择与排程,消融显示时序约束改善插入位置,显著性估计控制保留信息量。
Abstract: Audio Description (AD) makes movies accessible to blind and visually impaired audiences by narrating visual information in gaps between dialogue. Existing automatic AD systems largely treat generation as a local video-to-text problem, assuming that the content to describe and its temporal location are already provided. Realistic AD instead requires coupled decisions about what visual information is narratively important, when it can be spoken without interfering with dialogue, and how it should be formulated to fit within the available time. We formalize AD generation as a constrained optimization problem over these three decisions. Our hybrid system uses large language models to propose and ground visual elements, estimate their salience to the narrative, and generate compressed realizations. A mixed-integer linear program then jointly selects and schedules descriptions across a scene subject to temporal constraints. When evaluated on REFRAMED, a benchmark for realistic AD of movies, our approach makes better decisions than prompted LLMs about what to describe and when to describe it, establishing a new SOTA on narrative QA and temporally grounded metrics. Ablations show that explicit temporal constraints drive gains in placement, while salience estimation controls how much narratively useful content is retained. Improvements are concentrated on temporal and narrative measures rather than n-gram overlap, although a significant gap to professional describers remains.
[59] ARGUS: Role-Aware Event Knowledge Graphs for U.S. Employment-Discrimination Complaints cs.CLPDF
Sriram Kannan, Swetha Saseendran, Vishnu Vardhan Reddy Kandi, Leslie Barrett, Madhavan Seshadri
TL;DR: ARGUS从美国就业歧视诉状构建包含参与者、时间和因果关系的文档级事件知识图。
Details
Motivation: 诉状叙述常涉及复杂事件序列,仅靠词面和嵌入表示难以显式表达事件关系。
Result: 图结构分类器在留出集上优于原始文本和线性化基线;只用事件图检索能改善文档内问答,但开放检索受第一阶段候选召回率低限制。
Insight: 管线结合5W1H模式、法律模型和结构化生成,先提取事实陈述形成片段图,再合并为文档图;图更适合在相关材料已检索后组织和推理证据。
Abstract: U.S. employment-discrimination complaints describe complex event sequences that are not explicitly captured by lexical or embedding-based representations alone. We present ARGUS, a source-grounded pipeline that combines a 5W1H-inspired schema, legal-domain models, and LLM-based structured generation to construct document-level Event Knowledge Graphs (EKGs) from CourtListener complaints. ARGUS extracts fact-bearing statements, builds chunk-level event graphs with participant, temporal, and causal structure, and merges them into document-level representations. We evaluate graph quality through human and multi-model assessment and test downstream utility on claim classification and legal QA. The graph-structured classifier outperforms raw and linearized baselines on the held-out set, and EKG-only retrieval improves document-scoped QA, while open-retrieval gains remain limited by low first-stage candidate recall. These results suggest that EKGs are most useful for organizing and reasoning over evidence once relevant material has been retrieved.
[60] A Training Criterion with Token-Level Tolerance to Transcription Ambiguity for Automatic Speech Recognition cs.CL | eess.ASPDF
Saurabh Kumar, Diptiman Mohanta, Prasanta Kumar Ghosh
TL;DR: 将CTC中的通配符容错从整词粒度细化至词元粒度,适应语音与参考转录之间的局部歧义。
Details
Motivation: 参考转录并非唯一合理标注,发音、拼写或词汇实现可能局部不同;整词跳过路径会连带丢失词内其他词元监督。
Result: 跨19种语言、三个语料库的25项任务中,词元级OTC均优于CTC;与熵驱动权重调度结合后,各语料库平均WER相对降低9.45%。
Insight: 将词元和词级通配符路径组合,使不确定词元可跳过而词中其余部分保留监督;以预测熵调节容错权重也减少对训练轮数的依赖。
Abstract: Automatic speech recognition is typically trained assuming that the reference transcript is the only valid labeling of an utterance, yet even nominally verbatim transcripts contain localized differences in pronunciation, spelling, or lexical realization that the acoustics do not uniquely determine. Omni-temporal Classification (OTC) tolerates such noise by adding wildcard paths to the connectionist temporal classification (CTC) alignment graph, but its word-level arcs are too coarse, since bypassing one unsupported token discards supervision for the whole word. We move wildcard arcs to token granularity so unsupported tokens can be bypassed while the rest of the word stays supervised, and we combine token- and word-level arcs as complementary escape paths. Across 19 languages and three corpora, token-level OTC improves over CTC on all 25 tasks. We also replace epoch-indexed relaxation of the wildcard weights with a predictive-entropy-indexed schedule, which performs comparably while reducing dependence on training length. Combining this schedule with the hybrid graph gives the lowest mean word error rate (WER) on every corpus and a 9.45% average relative WER reduction over CTC. Independent validator transcriptions show that token-level models place significantly more wildcard-bypass probability than CTC on disputed characters, indicating that token-level tolerance targets localized transcript ambiguity.
[61] SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data cs.CL | cs.CV | cs.MMPDF
Wenhao Li, Zhibin Wu, Chong Xiao, Qiangchang Wang
TL;DR: SemMSA利用潜在情感语义和无锚点谱对齐,在模态不完整时改善多模态情感分析。
Details
Motivation: 常见缺失模态方法重建特征或用复杂融合,但在部分观察下缺少高层语义依据,容易带来虚假生成和噪声指导。
Result: 在SIMS、MOSI和MOSEI基准上达到先进性能;摘要未报告具体量化结果。
Insight: 跨模态细化模块在冻结LLM空间中逐步产生判别性潜在语义而不生成显式文本;谱对齐以核矩阵主导成分连接各模态,并用实例级约束保留样本区分度。
Abstract: Recent research on Multimodal Sentiment Analysis (MSA) has focused on learning from language, visual, and acoustic modalities with incomplete data to infer human sentiment. Most studies typically compensate for missing information by reconstructing modality features or designing complicated fusion mechanisms. However, these methods still suffer from spurious generation and noisy guidance due to the lack of high-level semantic grounding in partially observed multimodal evidence. To address these issues, we propose SemMSA, a latent semantic-aided framework that constructs rich sentiment-relevant semantics with LLMs, fully integrating with all modalities via anchor-free spectral alignment. It mainly consists of Cross-modal Semantic Refinement (CSR) and Cross-modal Spectral Alignment (CSA). Specifically, CSR first adaptively extracts visual and acoustic representations by corresponding adapters to form a unified multimodal prefix with language in the frozen LLM embedding space. It then iteratively produces continuous discriminative semantic states through a token-efficient latent refinement process without decoding explicit text. Next, CSA simultaneously aligns the refined semantics with all modalities by enhancing the dominant spectral component of their kernel Gram matrix. This captures global nonlinear dependencies among all representations without relying on a predefined anchor modality. In addition, an instance-level spectral separation constraint preserves cross-sample discriminability and mitigates representation collapse. Extensive experiments on SIMS, MOSI, and MOSEI benchmarks demonstrate that SemMSA achieves state-of-the-art performance.
[62] Agentic Detection of Online Conspiracies cs.CL | cs.LGPDF
Lior Biton, Oren Tsur
TL;DR: 用工具增强的智能体结合社交语境识别阴谋论言论的真实意图,而非仅根据关键词分类。
Details
Motivation: 相同阴谋论相关内容可能表达支持、合理质疑、批评或讽刺;判断关键在于话语意图及社会背景。
Result: 在覆盖四年大部分公开希伯来语推文的数据上,人工标注对抗评测显示情境感知方法优于纯文本分类,智能体也优于获取同等语境的非智能体方案。
Insight: 让智能体针对每个案例自适应调用社交查询,只补充当前推理步骤所需证据;结果支持将检测视为嵌入社会语境的解释任务。
Abstract: Conspiratorial discourse on social media is not always expressed through explicit claims or stable lexical markers. The same surface content may express endorsement, legitimate concerns, criticism, satire, or mockery. The main challenge is therefore not only recognizing conspiracy-related claims, but inferring the speaker’s intent – the utterance’s illocutionary force. We argue that this can be achieved through the use of relevant social contexts and propose an agentic framework, equipped with a set of tools supporting social queries. We demonstrate the benefits of our approach on a unique dataset of Hebrew tweets, covering 80%–90% of the public Hebrew tweets published over a four-year span (late 2018– early 2023), encompassing several election cycles as well as the COVID pandemic years and related vaccination campaigns. This extensive coverage can be used in recovering different social contexts. Evaluating our framework on a manually-annotated adversarial dataset, we find that context-aware workflows consistently outperform text-only classification and that the agentic framework performs significantly better than other frameworks and settings, including a non-agentic model exposed to the same contexts available to the agent. We further provide an analysis of the results, the errors and efficiency (token economy) tradeoffs. These findings support viewing the task of conspiracy detection as a socially embedded interpretation task, in which effective classification depends not only on access to contexts, but also on adaptive reasoning in which the agent uses tools on a per-case basis, asking only for evidence relevant to its current reasoning step.
cs.AI [Back]
[63] When Should Forecasting Agents Reason? Behavioral Stress Tests for Reliability Routing cs.AI | cs.CLPDF
Yufeng Wang
TL;DR: ReliabilityRoute通过行为压力测试研究预测智能体何时应检索、推理、依赖市场先验或参考历史类比。
Details
Motivation: 预测智能体结合推理、检索、集成和校准,但不同信息源何时可靠、何时应主导判断仍不清楚。
Result: 固定2024年拟合规则能匹配人工来源分类;按已揭示历史逐步调整阈值的方案在后续16个LLM批次中取得确定性系统最佳平均Brier分数,但收益有限,历史和搜索基线仍具竞争力。
Insight: 可靠性信号包括历史覆盖、市场先验、来源尖锐度、证据强弱与冲突及预测跨度;研究核心结论是更多推理并非总有帮助,路由策略也需可审计地适应。
Abstract: Forecasting agents increasingly combine language-model reasoning, retrieval, ensembling, and calibration, but it remains unclear when each behavior should be trusted. We study this question on ForecastBench-style binary forecasting tasks, treating the choice to retrieve, reason, defer to a market prior, or use a historical analog as an observable agent behavior rather than a hidden implementation detail. Our central finding is that mechanism choice is source-dependent: structured analogs dominate for some data-generating processes, while market/crowd-style and conservative baselines are better for others. We introduce ReliabilityRoute, a structural intervention that steers forecasting-agent behavior using reliability features such as historical coverage, market-prior availability, source-prior sharpness, evidence strength, evidence disagreement, and horizon. A fixed 2024-fitted rule closely matches a hand taxonomy without hard-coded source-name decisions, while a walk-forward self-adjusting rule refits thresholds from previously resolved vintages and obtains the best mean Brier score among our deterministic systems across 16 later LLM vintages. The gain is modest and historical/search baselines remain highly competitive. The main contribution is therefore a behavioral stress test showing that more reasoning is not always better; forecasting agents should first estimate which evidence source deserves control, routing policies should themselves adapt under auditable constraints, and reproducibility artifacts are available at https://github.com/louiswang524/forcastagent
[64] Policy as Code: A Coroutine-Bridge Harness for Fast-Reasoning Reliability on CAR-bench cs.AI | cs.CLPDF
Ivan Matveev
TL;DR: 为工具智能体构造协程桥接运行环境,把依赖型工具调用等待与模型调用解耦,并将确定性规则编码成代码策略。
Details
Motivation: 评测器每次工具交互都会开启新智能体轮次,依赖链长时普通下一步策略需要多次模型调用,延迟和成本偏高。
Result: 公开测试中每任务中位数只调用模型两次、但经历七个智能体轮次;官方隐藏Track 2获60.0% Pass³,是组织方基线的4.5倍,延迟和估算成本也最低之一;相同运行环境在GPT-5.5上复现60.0%。
Insight: 模型只输出一个可阻塞并恢复的Python程序,代码在评测器工具往返期间保持执行;把确定性策略直接写入工具层,可零推理成本执行合规规则。
Abstract: CAR-bench evaluates whether tool-using agents stay reliable under real-world uncertainty, executing every tool inside the evaluator so that each tool-result exchange is a separate agent round-trip. A conventional next-action agent can batch parallel tool calls, but a chain of dependent calls costs it one model call per round of results. We present a coroutine-bridge harness in which the model’s only action is to emit a Python program that blocks and resumes in place across evaluator tool exchanges. This decouples model invocation from tool round-trips: on the public test split the agent uses a median of two model calls against seven agent turns per task, resolving a full multi-turn task in a median of 1.8 s of model latency on Cerebras gpt-oss-120b. Because the action surface is executable code, deterministic CAR-bench policies are encoded directly as logic in the tool layer rather than as prompt rules, enforcing compliance at zero reasoning cost. On the official hidden evaluation the harness won Track 2 with 60.0% Pass^3, 4.5x the organizer baseline, at the lowest estimated cost and the fastest median task latency (3.14 s) of any entry scoring above that baseline; the same unchanged harness reproduced an identical 60.0% Pass^3 on GPT-5.5 in the Open track, matching frontier-model agents. A single static prompt, appended with per-task state at the tail, stays byte-identical across calls and across tasks: the frozen submission prompt served 78% of input tokens from cache (86.6% across its warm tail), against 73% over a three-week development corpus in which prompt edits repeatedly reset the cache. This compounds the few-call design into a small fraction of nominal input compute.
[65] Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures cs.AI | cs.CL | cs.CRPDF
Ruoqi Guo, Yi Liu, Gelei Deng, Yuekang Li, Lida Zhao
TL;DR: 用经强化学习校准的Jev模型单次回答多个结构化问题,免训练评估十类LLM对齐失败。
Details
Motivation: 生成式裁判通常每个标准都要额外解码,分类器一次只评固定标签;同时许多安全问题依赖对照参照而非仅看回答。
Result: RLCDAlignBench覆盖44个基准和五种目标模型;单一通用问题零样本中位AUROC为0.886,多数基准超过监督基线,且成本比LLM裁判低63倍。
Insight: 分别改变问题措辞和可见输入字段,发现措辞影响较小,字段影响较大且主要来自与标签定义直接相关的信息;系统还能暴露既有基准标签缺陷。
Abstract: Detectors of alignment failures screen deployed language models and score alignment benchmarks. Most are generative judges that spend a decoding pass on every criterion, and classifiers that read token probabilities, such as Llama Guard, still score one fixed label per call. Jev, a model trained with reinforcement learning for calibrated decisions (RLCD), answers many typed questions about one input with calibrated probabilities in a single call. Whether it detects alignment failures has not been measured. We present RLCDAlignBench, which benchmarks Jev on ten alignment failures: sycophancy, jailbreaks, deception, prompt injection, hallucination, privacy violation, social bias, reward hacking, concealing uncertainty, and power seeking. It spans 44 benchmarks and five target models, labelled by each benchmark’s scorer and, on two, by humans. Many of these failures are relational, defined against a reference, such as the user’s belief or an injected instruction, that the response alone does not reveal. Our key idea is therefore to vary what Jev is asked separately from what it sees: the question’s wording and answer type on one side, the fields of the input on the other. A single generic question reaches a median AUROC of 0.886 zero-shot and beats supervised baselines on most benchmarks. Question wording matters little, while context matters more, mostly through fields that encode the label. Jev matches the reference scorer’s agreement with human labels, surfaces label defects in existing benchmarks, and costs 63x less than LLM-judge scorers. Code and data: https://github.com/sumleo/RLCDAlignBench.
[66] Evaluation of Multi-Turn Consistency in LLM Agents: Survival Analysis and Failure-Rationale Taxonomy cs.AI | cs.CL | cs.LG | cs.MAPDF
Igor Bogdanov, Olga Manakina, Chung-Horng Lung
TL;DR: 用生存分析和理由分类法评估多智能体在20步奖励延迟任务中的跨轮一致性与失效时间。
Details
Motivation: LLM智能体可能单次任务表现良好,却在长交互中逐渐改变策略、提前领取奖励并终止任务。
Result: 在八类模型、84,540条轨迹中,早期失败理由更偏冲动,晚期更常诉诸疲劳和成本收益,公开场景增加规范性解释;失败轨迹中更长推理与理由内部矛盾率更高。
Insight: 把首次领取奖励作为事件时间,用Kaplan–Meier曲线和离散风险回归衡量不同条件下失败风险;对13,780条理由建立七类体系并经人工核验,κ=0.83。
Abstract: Large language model (LLM) agents may perform well on isolated tasks yet drift into inconsistency over extended interaction. We evaluate temporal consistency in a controlled 20-step multi-agent setting inspired by delayed-gratification studies. At each step, an agent chooses between continuing to delay a reward or claiming it immediately (terminating the episode). Across a full-factorial manipulation of social visibility (private vs public), persona stressors, and deliberation policy, we run 84,540 trajectories spanning 8 model families. Treating the first reward-claim as a time-to-event outcome, we estimate Kaplan-Meier survival curves and fit discrete-time hazard regression to quantify how experimental factors shift failure risk over time. Then, to analyze rationales and language patterns associated with failure, we build a seven-category taxonomy from 13,780 deliberation traces from agents who choose to terminate the episode, using an LLM-assisted labeling paired with human audit ($κ=0.83$). Rationale profiles change systematically with time and context: early failures are more impulse-driven, later failures more fatigue- and cost-benefit-framed, while public settings increase norm-oriented justifications. We also find a deliberation-inconsistency association: among failures, longer deliberation correlates with higher rates of intra-rationale contradiction (simultaneous pro-delay and pro-claim statements), challenging the assumption that more reasoning text implies greater consistency. Together, the survival and rationale analyses reveal distinct temporal reliability regimes and model-specific “failure fingerprints”, offering an evaluation lens for diagnosing inconsistency in multi-turn agent behavior.
[67] iCoder-27B: Recursive AI-Led Development of Frontier Industrial Coding Model cs.AI | cs.CL | cs.SEPDF
Cheng Yang, Jiayang Lyu, Shangyuan Liu, Guibin Zhang, Jiong Lin
TL;DR: 让智能体在有限高密度人工指导下自主规划和执行工业代码模型训练,产出27B RTL与GPU内核模型iCoder。
Details
Motivation: 小模型和限定任务上的递归自改进已有进展,但几乎自主构建可发布、具前沿竞争力的工业代码模型仍很困难。
Result: iCoder在七个基准中领先RTLLM,超过GPT-5.5和Claude Opus 4.8;CVDP及KernelBench L2列第二并超过GPT-5.5 16个百分点,在TritonBench与Claude Opus 4.8并列最佳。
Insight: 专家将目标、阶段支架、权限边界和操作流程沉淀为可复用研究技能,智能体据此选择实验、诊断结果并调整训练策略,协调数据、SFT、在策略自蒸馏及可验证奖励RL。
Abstract: Recursive AI, the prospect of AI taking an increasingly complete role in building and improving AI, is a crown jewel of AI for AI. Although recursive self-development has become practical for small models, bounded tasks, and fixed time budgets, a more consequential realization of this ambition, i.e., developing a release-ready, frontier-competitive model, remains far more challenging. In this work, we ask how little human involvement is sufficient for an agent to develop a frontier model. We concentrate human input into a high-density, low-frequency interface: experts encode objectives, stage scaffolds, permission boundaries, and operating procedures as reusable research skills, while the agent instantiates these priors, selects experiments, diagnoses outcomes, and revises the training strategy. In the challenging domain of industrial coding, the agent evolves data and coordinates SFT, on-policy self-distillation, and reinforcement learning with verifiable rewards, ultimately producing iCoder, a 27B model for RTL design and GPU kernel optimization. Across seven benchmarks, iCoder leads RTLLM, outperforming GPT-5.5 and Claude-Opus-4.8; ranks second on CVDP and KernelBench L2, exceeding GPT-5.5 by 16 points; and ties Claude-Opus-4.8 for the best TritonBench result. Exploratory case studies further show iCoder’s competitive iterative RTL and GPU-kernel optimization with substantially fewer tokens. These results chart an engineering path toward recursive self-improvement, in which humans distill the principles of model building, agents operationalize them through evidence-driven experimentation, and each generation of AI becomes a more capable architect of the next.
[68] C3M: Cross-Session Multimodal Memory Maintenance for Long-Horizon Tasks cs.AI | cs.CL | cs.CV | cs.IRPDF
Xueshu Chen, Yan Wang, Zihao Xue, Jiefu Li, Zhenfang Liu
TL;DR: C3M以关系感知更新维护有界的跨会话图文记忆索引,保留长期任务需要的来源和时间信息。
Details
Motivation: 长期任务需在有限、无法预知问题的记忆预算下跨会话保留证据;常规压缩会丢失视觉细节或混淆相似但不兼容观察。
Result: 提出紧凑、保留来源的多模态记忆组织机制,用于跨会话长程任务;摘要未提供具体评测数值。
Insight: 安全冗余会被合并,互补或冲突记录则保留;查询时按预算选择索引页并展开关联原始证据,使回答仍能追溯来源和时间。
Abstract: Long-horizon tasks require preserving and later recovering cross-session evidence under a bounded, query-blind memory budget. Existing compression can discard fine-grained visual cues or conflate semantically similar but incompatible observations. We present C3M, a cross-session multimodal memory organization that maintains a bounded active index over persistent source text-image evidence. Relation-aware updates consolidate safe redundancy while preserving complementary and incompatible records. At query time, budgeted routing selects useful index pages and expands their associated source evidence under a fixed reader budget. Together, these mechanisms establish a compact, provenance-preserving multimodal memory organization for cross-session long-horizon tasks, retaining temporal distinctions and source links required for reliable downstream reasoning. Code is available at https://github.com/HuzhouNLP/C3M.
[69] Learning to Ideate for Scientific Impact cs.AI | cs.CLPDF
Shubham Kale, Aniketh Garikaparthi, Manasi Patwardhan
TL;DR: 以引用归一化影响力作为延迟反馈训练科研创意生成模型,探索更有潜在学术影响的研究方向。
Details
Motivation: 现有科学构思系统多针对新颖性、清晰度和可行性等即时裁判指标优化,难以判断能否导向后续学术影响。
Result: 基于10万余篇计算机科学论文构造目标条件创意和年度归一化引用标签;强化学习调整的模型持续生成比基础模型和仅SFT模型影响力估计更高的创意。
Insight: 训练奖励模型预测研究目标—创意对的引用等级,再以留出、参考文献锚定协议评估并按参考创意引用影响力加权,减少训练评估循环论证。
Abstract: Scientific ideation is increasingly mediated by large language models, but current ideation systems are usually trained and evaluated on immediately judgeable proxies such as novelty, clarity, and feasibility. This leaves open whether delayed signals of scientific uptake can be used as feedback for steering models toward research directions with higher expected \emph{impact}. We study this question using citation-normalized impact as a noisy but scalable proxy for scholarly uptake. We construct a large-scale dataset from over 100K computer science papers by extracting goal-conditioned idea descriptions and assigning each paper an ordinal, year-normalized citation label. We then train a goal-conditioned reward model to predict citation-impact labels from research goal and idea pairs, and use this reward to align an idea generator through supervised fine-tuning followed by reinforcement learning. To reduce circularity, we evaluate generated ideas with a held-out, reference-grounded protocol that compares model outputs against historical ideas under the same research goal and weights judgments by the reference idea’s citation-impact label. Experiments show that our RL-tuned model consistently produces ideas with higher estimated impact than both the base model and supervised fine-tuning baselines. Our findings position scientific impact as a practical, outcome-grounded feedback signal for aligning LLMs in open-ended scientific discovery.
[70] Pistis Technical Report cs.AI | cs.CVPDF
Heyun Chen, Xiaohan Lan, Jiaxi Li, Zhilin Lu, Qi She
TL;DR: 介绍Pistis 27B和9B多模态模型家族,采用交替在策略蒸馏与强化学习的可扩展后训练框架。
Details
Motivation: 长程智能体轨迹需要稳定知识迁移、准确信用分配及多模态推理能力,同时避免后训练各阶段造成能力权衡。
Result: Thinking变体侧重深度多模态推理,Agentic变体整合长程规划、迭代推理和工具使用,在多模态搜索尤其突出;两种规模均超过各自基础模型。自动推理框架优化还能在不更新参数、不增加交互预算时提升表现。
Insight: IDRL在单一训练循环中交替进行在策略蒸馏和强化学习,而非静态联合损失;PAH进一步自动迭代优化模型推理时所用的运行框架。
Abstract: We introduce the Pistis model family, comprising 27B- and 9B-parameter multimodal large language models built on Qwen3.6 and Qwen3.5, respectively, and developed through a general and scalable post-training framework. The framework first establishes a strong foundation through large-scale multimodal supervised fine-tuning (SFT). Building on this SFT foundation, we propose Interleaved Distillation and Reinforcement Learning (IDRL), a novel post-training paradigm that tightly integrates on-policy distillation and reinforcement learning within a single training loop. By alternating between the two objectives, rather than optimizing either in isolation or combining them in a static joint loss, IDRL enables more effective knowledge transfer, greater optimization stability, and more precise credit assignment for long-horizon agentic trajectories, leading to stronger performance while mitigating common capability trade-offs. At both model scales, the framework produces two specialized variants: Pistis-Thinking, designed to strengthen deep multimodal reasoning, and Pistis-Agentic, which additionally incorporates agentic trajectory data to support long-horizon planning, iterative reasoning, and tool use. Pistis-Agentic is particularly strong in multimodal search. Both scales outperform their corresponding base models. Beyond model-parameter optimization, we further introduce Pistis-Auto-Harnessing (PAH), a system-level method that automatically improves the agent’s inference harness through iterative optimization. Experiments demonstrate that PAH enhances the model performance without updating the model parameters or increasing the interaction budget.
[71] Self-Play Pretraining with Zero Data cs.AI | cs.CLPDF
Aditya Cowsik, Kfir Dolev, Michael Y. Li, G. Bruno De Luca, Nourya Cohen
TL;DR: 以零人工语料自博弈预训练,让生成器搜索可计算程序产生训练数据并为语言模型自适应安排课程。
Details
Motivation: 语言模型预训练依赖人类整理数据,作者探索能否由模型自己生成有助于学习的、理论上由算力限制的训练来源。
Result: 从随机初始化训练时,多个自然数据集上的零样本损失随自博弈算力可预测扩展;模型还表现出上下文学习并发现可辨识数学序列。
Insight: 生成器提出程序交由通用图灵机执行产生字节序列,学习器用交叉熵预测,生成器则通过RL寻找接近学习器能力前沿的样本;两者均未用自然语料训练,使迁移检验更直接。
Abstract: Advances in language modeling have been driven by scaling pretraining on ever more data. Yet, the training data is still largely curated on the model’s behalf. A more general approach to pretraining would let the model learn to generate the data most useful for its own improvement. This would provide an effectively unbounded source of training data, limited by compute rather than human knowledge. We introduce Self-Play Pretraining with Zero Data, an initial proof-of-concept towards realizing this vision. Our procedure casts synthetic data generation as a search over the space of all computable structure, taking inspiration from Solomonoff induction. Starting from random initialization, two models learn in tandem: a generator proposes programs interpreted by a universal Turing machine, generating byte sequences, while a learner autoregressively predicts these byte sequences. The learner is trained with standard cross-entropy, while the generator is trained with reinforcement learning to produce sequences at the frontier of the learner’s capabilities, yielding an adaptive curriculum. A universal Turing machine gives us a search space over all computable data-generating processes, imposing little domain-specific structure, and self-play searches over this space for useful training data. We test whether zero-shot performance on natural data improves predictably with self-play compute; this is a clean test of transfer since neither generator nor learner is trained on natural data. Across several natural datasets, zero-shot loss exhibits predictable scaling in compute. The models also exhibit in-context learning, and discover recognizable mathematical sequences during training.
[72] Training Object Permanence in World Models cs.AI | cs.CVPDF
Haotian Zhang, Fengyuan Yu, Dezhi Luo, Haoran Sun, Zehong Zhao
TL;DR: 以认知科学启发任务数据训练世界模型的物体恒存能力,评测其在遮挡和物体消失情境中的物理推理。
Details
Motivation: 视频生成世界模型可能出现涌现推理,但是否具备人类认知中的物体恒存和实体性尚未明确。
Result: WROP含150项任务、六类认知能力、每项超过1万样例,并发布150万样本训练语料和300题测验;16B的PWM-WROP在盲测Elo比较中续写模型排名第一、总体第三。
Insight: Blender生成器随机化速度、光照、视角等干扰因素但保留任务认知结构;项目公开数据、测验、模型输出、权重及原生PyTorch训练栈。
Abstract: Object permanence and solidity are hallmarks of human cognitive priors. Recent studies show that video generation models, a paradigmatic class of current world models, have begun to show emerged reasoning abilities, making them ideal candidates for building human-like physical intelligence. Do video models have emerged object permanence in them? If not, could we train them with a core-cognition inspired dataset? We introduce WROP (World Reasoning with Object Permanence), a data infrastructure of 150 hand-designed cognitive science inspired tasks, divided into six cognitive categories. We build Blender generators that randomize speed, lighting, camera angle, and other nuisance parameters while preserving each task’s cognitive structure, yielding 10,000+ samples per task. We release a 1.5M-sample training corpus and a 300-question exam. On this exam we evaluate 14 video models: 3 reference-to-video, 7 edit, and 4 continuation, among which PWM-WROP, our 16B world model. In a blind pairwise Elo study, PWM-WROP ranks first among continuation models and third overall, behind only a statistical tie between two reference-to-video models. We release the data, exam, model answers, scores, weights, and PWM, our native-PyTorch training stack on AWS Trainium2.
[73] Screen Before You Serve: Simulation for Production Customer Experience AI Agents at 140M Scale cs.AI | cs.CLPDF
Edesio Alcoba, Kevin Rossell, Aman Gupta, Shao Tang, Jiwoo Hong
TL;DR: 提出生产前假设驱动模拟流程,用合成顾客和工具结果筛选大规模客户体验智能体。
Details
Motivation: 受监管行业客服智能体需识别意图、遵守复杂政策并可靠调用工具;人工覆盖有限,直接线上试验会让客户承担失败风险。
Result: 模拟器分数与四个生产版本的二元评审分数高度相关;模拟指导迭代使实时A/B测试交易型NPS提高36.69分。另一次部署把自助解决率提升8.82个百分点至历史最高,tNPS无统计显著变化。
Insight: 在不触发生产后端的条件下模拟多轮客户反应和工具结果,先广泛比较模型、推理设置和提示,再将筛选结果带入线上实验。
Abstract: Customer experience (CX) agents use tools and large language models to address customer requests and guide conversational interactions with an organization’s products. Improving these agents, especially in regulated industries, is difficult: they must detect intent, follow complex operational policies and use tools reliably. Manual end-to-end testing offers limited coverage, while live experiments expose customers to failures that can erode trust. We present a hypothesis-driven simulation workflow for screening candidate CX agents before deployment. Synthetic customers react to agent responses and simulated tool outputs enable multi-step agentic workflows without invoking production backends. We use the Snowglobe simulator on Nubank’s Card Delivery agent and its expanded successor, Card Management - Nubank’s highest-volume chat-support agent in Brazil. Across 4 deployed versions, simulated and production version-level binary evaluator scores show high correlation. Simulation-guided iteration increased transactional net promoter score (tNPS) by 36.69 points in a live A/B test. We also screened open-weight configurations in over 16,000 simulated conversations. In a subsequent live A/B test, the selected model increased self-service rate (SSR) by 8.82 percentage points to the highest level observed at Nubank, with no statistically significant change in tNPS. Simulation made broad exploration of models, reasoning settings, and prompts feasible without customer exposure, enabling production improvements that would have been impractical to pursue through live experimentation alone.
[74] GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AI cs.AI | cs.CL | cs.LG | cs.MAPDF
Arunabh Srivastava, Mohammad A., Khojastepour, Srimat Chakradhar, Sennur Ulukus
TL;DR: GRASP用规划生成、局部策略修订和独立轨迹评估构成多阶段策略感知规划框架。
Details
Motivation: 任务复杂度增加时LLM可靠性下降,直接规划器在多任务和交错任务环境中容易性能崩溃。
Result: Natural Plan日历安排准确率提升约12.4%,ZebraLogic提升约30.8%;交错双任务准确率最多绝对提升16.7%,并比GPT-5-mini高14.5%。
Insight: GenPlan预编译全局宏策略,RevPlan在隔离上下文探索局部候选,VerPlan再多指标评估轨迹;隔离推理与宏策略约束降低多任务退化。
Abstract: Large Language Models (LLMs) typically exhibit a performance profile where reliability degrades as task complexity increases. We address the challenge of generating high-quality natural language executable plans for complex tasks by introducing $\textbf{GRASP}$, a strategy-aware, multi-stage planning framework. GRASP decouples the planning pipeline across specialized, context-isolated modules: it pre-compiles global macro-guidelines (GenPlan), explores alternative localized strategies within isolated context windows (RevPlan), and independently evaluates trajectories using a multi-criteria discriminator (VerPlan). Empirical evaluations show that GRASP consistently establishes a new state-of-the-art frontier across diverse datasets, yielding substantial accuracy gains over direct LLM planners on Natural Plan Calendar Scheduling ($\sim$12.4$%$$\uparrow$), ZebraLogic ($\sim$30.8$%$$\uparrow$), and SciBench Math. Crucially, under multi-task scaling-where standard planners suffer immediate performance collapse-GRASP completely flattens the multi-task degradation penalty. In interleaved dual-task environments, GRASP achieves an absolute accuracy gain of up to 16.7$%$ over direct LLM planners. Furthermore, by isolating context and enforcing strict macro-regularization, GRASP outperforms frontier reasoning models (such as GPT-5-mini) by a margin of 14.5$%$.
[75] Clinical Knowledge Graphs for Chest X-Ray Device Reasoning cs.AI | cs.CVPDF
Harshil Lodhiya
TL;DR: 构建不确定性感知的胸片临床知识图,将设备实例、尖端位置估计、放置判断和报告事件组织为可追溯证据。
Details
Motivation: 现有图像模型常只输出标签或分割,报告处理系统又无法访问图像几何,两者难形成完整设备评估依据。
Result: 在30,083项检查的RANZCR CLiP测试归档上构建91万余证据节点和88万余关系;较直接基线保留尖端协方差、放置概率、片段来源及数量等信息。
Insight: 图层提供类型化数据契约、不确定性表达、拒答、报告—图像关联及纵向查询接口;当前结果是事后描述性材料,尚未证明报告依据、纵向表现或临床效用。
Abstract: Chest radiographs are routinely used to verify the position of catheters, tubes, and other support devices. Existing image models often return labels or segmentations, while report-processing systems structure text without access to image geometry. We present an uncertainty-aware clinical knowledge graph that represents device instances, tip estimates, placement assessments, provenance, report events, and temporal links as separate but connected evidence. We evaluate the implemented visual graph layer using saved predictions from the complete RANZCR CLiP test archive, comprising 30,083 studies from 3,255 patients across five non-overlapping outer folds. The graph builder materializes 914,632 B7 evidence nodes and 884,549 typed relationships. All 118,647 B7 predicted-device nodes retain tip covariance, placement probabilities, fragment provenance, and fragment counts, whereas the direct B2 baseline retains none of these fields. We further define typed data contracts, uncertainty representations, abstention rules, report-image grounding, and longitudinal query mechanisms for extending the graph to report-bearing cohorts. The reported graph-materialization analysis is post-hoc descriptive and does not establish report grounding, longitudinal performance, or clinical utility. It demonstrates a reproducible foundation for evidence-preserving AI reasoning over chest X-ray device assessments.
[76] When Can Agents Forget Their Reasoning? ICLR for Long-Horizon Agent Context Compression cs.AI | cs.CVPDF
Mingxuan Wang, Fei Luo, Bo Wang, Guorun Yao, Yinglong Guo
TL;DR: ICLR在不训练的前提下,用冻结代理熵排序并删除可替代历史推理块,压缩长程智能体上下文。
Details
Motivation: 长程智能体持续积累已执行决策的历史,增加上下文和推理成本;删除历史推理可能改变未来行动轨迹。
Result: 260项WorkBuddyBench任务上,平均奖励由0.699升至0.718;输入、输出和缓存读取token分别减少25.5%、14.4%和33.3%。
Insight: 压缩时保留行动、工具调用和观察,并发现任务相关状态已可靠外部化到代码、文件、工具输出或环境反馈后,历史推理通常更可替代;局部删除可能通过改变后续互动放大计算变化。
Abstract: Long horizon language model agents continually accumulate reasoning history, increasing context length and inference cost even after earlier decisions have been executed and observed. Unlike static Chain of Thought compression, removing historical reasoning can change future actions and the resulting interaction trajectory. We study when such reasoning can be safely forgotten. We propose Interaction Aware Compression for Long Horizon Reasoning (ICLR), a training free online method that ranks reasoning blocks using frozen proxy entropy while preserving actions, tool calls, and observations. On 260 WorkBuddyBench tasks, ICLR improves average reward from 0.699 to 0.718, while reducing input, output, and cache read tokens by 25.5%, 14.4%, and 33.3%, respectively. Ablations reveal trajectory amplification, where local reasoning deletion produces nonlinear changes in total computation by altering subsequent interaction. Representation probing, activation patching, and controlled trajectory analyses further suggest that historical reasoning becomes more replaceable once task relevant derived state has been reliably externalized into code, files, tool outputs, or environmental feedback. These results characterize agent reasoning as dynamic working state rather than permanent interaction history.