cs.CL [Total: 52]
cs.CV [Total: 197]
cs.AI [Total: 15]
cs.CR [Total: 1]
cs.CY [Total: 1]
cs.HC [Total: 4]
cs.LG [Total: 12]
cs.PF [Total: 1]
cs.RO [Total: 9]
eess.AS [Total: 1]
eess.IV [Total: 6]
eess.SY [Total: 1]
q-bio.NC [Total: 1]

cs.CL [Back]

[1] MEMENTO: Learning Context Management for Long Context Processing Agents cs.CL | cs.IRPDF

Yunfan Zhang, Taehoon Hwang, Kathleen McKeown, Smaranda Muresan

TL;DR: 论文提出 MEMENTO，一个基于 Qwen3-8B 的长上下文 agent，通过压缩式上下文管理决定在固定窗口内保留什么。它先用带事后注释笔记的合成轨迹做微调以引导记笔记能力，再用结合答案正确性、笔记质量启发式和置信度校准的强化学习进行训练。尽管训练时只学习压缩到新窗口，测试时可扩展到上下文折叠和基于置信度的回溯。

Details

Motivation: 长输入场景下 LLM agent 必须在固定大小上下文窗口中做上下文管理，常见压缩方法依赖模型自生成笔记，但现成 agent 模型往往笔记无效，仅靠强化学习也难以发现有效记笔记行为。

Result: 在四个书籍级问答 benchmark、书籍长度达 2.5M token 的设置下，MEMENTO 将 Qwen3-8B 准确率从 36.9% 提升到 67.8%，且上下文始终不超过 20K token；优于同框架 GPT-5.5 agent 的 13.1% 和全书上下文 56.7%，成本不到 1/50；接近约 100 倍大的 GLM-5.3 agent 的 69.3%，成本约 1/9，并距 GLM-5.3 全书上下文低 6.4 个点，成本约 1/26。

Insight: 创新点在于用事后生成笔记注释的合成轨迹引导模型学会记笔记，并用融合答案正确性、笔记质量和置信度校准的奖励进行 RL；训练仅覆盖压缩策略，却能在测试时泛化到上下文折叠和置信度回溯。客观看，其价值在于把上下文管理转化为可监督、可奖励塑形的学习问题，并以小模型实现高成本效益的长上下文处理。

Abstract: LLM agents that operate over long inputs must perform context management: deciding what to retain in a fixed-size context window. A common approach is compaction, where the model replaces its history with a self-generated note. Yet off-the-shelf agentic models, including GPT-5.5 and GLM-5.3, often write ineffective notes, and reinforcement learning (RL) alone rarely discovers useful note-taking behavior. We present MEMENTO, a long-context agent built on Qwen3-8B and trained to manage its context through compaction. We first bootstrap note-taking by fine-tuning on synthetic trajectories annotated with notes generated in hindsight, then reinforce it with RL using a reward that combines answer correctness, note-quality heuristics, and confidence calibration. Although trained only to compact into a fresh window, MEMENTO extends at test time to strategies such as context folding and confidence-based backtracking. On book-level question answering across four benchmarks, with books of up to 2.5M tokens, MEMENTO raises Qwen3-8B’s accuracy from 36.9% to 67.8% while never holding more than 20K tokens in context. It outperforms GPT-5.5 agent in the same harness (13.1%) and full book context (56.7%) at less than 1/50 the cost. It also nearly matches a ~100x larger GLM-5.3 agent (69.3%) at 1/9 the cost, and comes within 6.4 points of GLM-5.3 full context at 1/26 the cost.

[2] GAVAGAI: Referential Alignment for Infant-Scale Vision-Language Models via Balanced Optimal Transport cs.CLPDF

Rajdeep Pal, Jotiraditya Banerjee, Saptarshi Pani

TL;DR: 论文针对婴儿规模视觉-语言模型中词-指称对齐不可靠的问题，提出在下一词描述目标中加入词与图像区域之间的指称对齐变量，将每个场景建模为听到的内容词与看到区域之间的小型分配问题，并用带约束的熵正则最优传输求解。约束包括允许词分配到 NOTHING 列以处理护理者语音中大量非指称词，以及限制单个区域获得的分配质量以编码互斥性。方法仅需约 8 次 Sinkhorn 迭代，并在模拟和 SAYCam 婴儿视频语料上验证能提升描述模型的词-图对齐与定位能力。

Details

Motivation: 论文指出，儿童可从约 1 亿词输入中学会词指代何物，而同等规模训练的视觉-语言模型词-指称绑定明显更差。作者认为部分差距是结构性的：常规下一词描述目标没有显式变量表示“这个词指代那个区域”，因此训练缺乏直接 grounding 词的压力。

Result: 在受控模拟中，朴素逐行 softmax 强制每个词对应区域，在现实非指称率下词-图准确率崩塌到 0.000，低于仅描述模型的 0.058；加入 NOTHING 列与容量约束后达到 0.075，干净输入下为 0.700。单参数版本在三种歧义条件下复现成人跨情境学习准确率，RMSE 为 0.024。在 SAYCam 婴儿视频语料上，将对齐损失加入下一词描述模型，词-图准确率从 32.4% 提升到 48.7%，定位 IoU 从 0.18 提升到 0.38；但同数据训练的对比模型在其自身 benchmark 上仍更强，因此作者声明该方法改善的是高非指称率下的描述目标，而非取得新 SOTA。

Insight: 创新点在于把词-区域指称对齐显式建模为带约束的熵正则最优传输分配问题，并用 NOTHING 列处理非指称词、用区域容量约束编码互斥性。客观看，其可借鉴之处是将语言 grounding 作为描述目标的轻量辅助分配模块，以极少 Sinkhorn 迭代提供直接词-区域监督，同时显式建模真实护理者语音中词并不总指称可见物体的统计特性。

Abstract: A child learns which words name which things from roughly 100 million words of input. Vision-language models trained at a comparable scale bind words to referents far less reliably, and we argue that part of the gap is structural: the usual next-token captioning objective has no variable standing for “this word refers to that region,” so training applies no direct pressure to ground words. We add such a variable by treating each scene as a small assignment problem between the content words heard and the regions seen, solved as entropic optimal transport under two constraints. First, a word may be assigned to a special NOTHING column instead of any region, which matters because most content words in caregiver speech do not name anything visible. Second, no region may receive more than a bounded share of the assignment mass, a capacity constraint that encodes mutual exclusivity. The alignment step costs about eight Sinkhorn iterations, small next to the vision encoder. In controlled simulation, the naive version of the idea, a row-wise softmax that forces every word onto some region, collapses to 0.000 word-to-picture accuracy under realistic non-reference rates, below the 0.058 of captioning alone, while our two constraints reach 0.075 in that regime and 0.700 on clean input. A one-parameter version of the model reproduces adult cross-situational learning accuracy across three ambiguity conditions (RMSE 0.024). On the SAYCam infant video corpus, adding the alignment loss to a next-token captioning model raises word-to-picture accuracy from 32.4% to 48.7% and localization IoU from 0.18 to 0.38. A contrastive model trained on the same child’s data remains stronger on its own benchmark, so our claim is that the loss improves a captioning objective under high non-reference rates, not that it sets a new best.

[3] Dual-Axis Policy Entailment: A Benchmark for Policy-Change Reasoning cs.CL | cs.CYPDF

Charles Chang, Yuen Yuen Ang, Bolun Sun

TL;DR: 论文提出双轴政策蕴含任务DAPE及基准，对成对政策指令同时判断是否属于同一政策领域，以及后续指令是延续、扩展、收窄、逆转先前政策还是转向不同领域，并形成五类主指标。作者构建了1000对中文政府政策指令的专家标注基准和标注校准协议，评估多种模型并微调Qwen3-14B，最后将该方法应用于中国1980—2024年AI政策变迁分析。

Details

Motivation: 政策是否发生领域转移及其延续、扩展、收窄或逆转对公共政策研究十分重要。论文希望更细粒度、可核查地评估政策变化推理，避免把两个维度的错误混入笼统的“无关”标签，并提升标注严谨性。

Result: 14个开放权重模型和4个前沿API旗舰模型零样本均表现不佳，最佳前沿模型与专家标签的Cohen’s κ约为0.29，远低于人类上限约0.53；LoRA微调Qwen3-14B经五折交叉验证达到κ=0.524，接近标注者互评人类上限κ=0.527。论文还将方法用于中国AI政策1980—2024年的政策变化方向分析。

Insight: 创新点在于双轴政策蕴含设计：将领域一致性与政策变化方向解耦，并组合为五分类标签；同时贡献专家标注基准、带前后一致性测量的标注校准协议，以及可达到人类标注上限的微调模型。客观看，其价值主要在于任务形式化、严格标注流程和中文政策变迁实证应用。

Abstract: Whether a policy shifts domains and, by extension, continues, broadens, narrows, or reverses previous policy is of paramount importance to the study of public policy. We propose Dual-Axis Policy Entailment (DAPE), which evaluates an ordered pair of policy directives on both dimensions at once: a binary judgment determines whether the two directives govern the same policy domain, and a five-way judgment determines whether the later directive continues, broadens, narrows, or reverses the earlier policy, or governs a different domain altogether. Read together, the two judgments form one five-category label, our primary metric. The two-axis design captures two central dimensions of policy change without conflating errors on either dimension into a generic “irrelevant” label, and it makes annotation more rigorous: a coder cannot dismiss a difficult pair as domain-irrelevant without an explicit, checkable decision. We introduce an expert-annotated benchmark of 1,000 ordered directive pairs drawn from a large corpus of Chinese government policy, together with an annotation-calibration protocol (an adjudication packet with pre/post agreement measurement) that we contribute as a methodological artifact. Fourteen open-weight models and four frontier API flagships fail the task zero-shot: even the best frontier flagship’s chance-corrected agreement with expert labels is far below the human ceiling (Cohen’s $κ\approx 0.29$ vs. $0.53$). A fine-tuned open-weight model (LoRA SFT of Qwen3-14B, five-fold cross-validation) closes this gap, reaching the coder-mutual human ceiling ($κ= 0.524$ vs. $0.527$). Finally, we apply our method to China’s AI policy (1980-2024) and map the direction of policy change across eras.

[4] Distinguishing among reasoning levels of GPT 5.5 Pro via a grammar lens benchmark cs.CLPDF

Emma Graham, Richard Granger

TL;DR: 论文提出一种基于形式语法与计算理论视角的基准，用逐级增强计算能力的新数据测试语言模型在测试时推理水平上的差异。作者比较 GPT-5.5 及 GPT-5.5-Pro 的 Medium、High、XHigh 推理档位，发现测试数据接受率随推理档位提升而递增，并观察到测试时计算投入越高，模型回答越偏离人类回答。

Details

Motivation: 论文关注测试时处理努力/推理水平是否真正影响语言模型的计算能力，并试图用细粒度基准区分同一模型不同推理档位的能力差异。

Result: 不同推理档位的测试数据接受率分别为 16%、40%、43%、52%，显示基准能区分 Medium、High、XHigh 等档位；同时测试时计算投入增加会加大模型与人类回答的分歧。

Insight: 创新点在于从计算理论出发构造形式语法透镜基准，生成逐级计算能力更强的新数据来探测模型推理水平；客观看，其价值还在于提示更高能力模型可能与人类判断产生系统性偏离，引出能力与对齐之间的潜在冲突。

Abstract: Does the level of test-time processing effort affect a language model’s computational capability? A formal grammar-lens benchmark method, derived from the theory of computation, generates novel data at specified levels, each successively more computationally powerful than the levels below. Using this data, we tested GPT-5.5, and GPT-5.5-Pro-Medium, -High, and -XHigh, showing incrementally increased acceptance of test data: 16, 40, 43, and 52%, respectively, illustrating the benchmark’s ability to discern fine-grained differences among models’ added test-time reasoning levels. Additionally, as test-time compute effort increases, model responses diverge from human responses to the same data. This increasing disagreement may turn out to be broadly characteristic of more capable language models, introducing the potential of a general capability-versus-alignment conflict.

[5] Multi-Estimate Elicitation Does Not Uniformly Debias Language Model Judgments cs.CL | cs.AIPDF

An-Sheng Jhang

TL;DR: 论文检验在单次回答中要求语言模型给出五个加权估计，是否能改变其判断并减少偏差。研究覆盖锚定、后见、基率、合取、现状/默认等任务，比较直接数值回答与多估计回答格式，并考察来源框架、显式随机线索和概率一致性约束。评估 gpt-6.1-sol、claude-sonnet-5.5 和 Qwen3-8B 后，作者发现多估计 elicitation 并未在不同任务和模型上产生一致的祛偏或反应衰减。

Details

Motivation: 论文关注语言模型判断易受无关锚点、后见信息、基率、合取谬误和现状/默认选项影响的问题，试图验证“多估计 elicitation”能否作为一种通用祛偏手段。

Result: 在 23 个预注册确认性检验中，经 Holm 校正后有 6 个被拒绝，但其绝对点估计均低于预设最小关注效应，且未建立等效性；前两个配置中直接 elicitation 的无关锚定指数和现状效应接近零，同时仍对信息性来源和建议敏感。分离式与联合式 elicitation 会改变合取判断，但受调用间噪声限制；总体未实现一致祛偏或反应衰减。

Insight: 论文的创新在于跨多种判断偏差任务和多个模型系统比较直接数值回答与多估计回答格式，并引入来源框架、随机线索、概率一致性约束及预注册确认检验。其可借鉴之处是强调统计显著不等于实际效应，并指出候选估计离散度与锚定误差的事后相关值得独立预测验证。

Abstract: Does eliciting five weighted estimates within a single response change how a language model responds to information? Across anchoring, hindsight, base-rate, conjunction, and status-quo/default tasks, we compare direct numerical answers with a multi-estimate response format, contrasting source framings, explicitly random cues, and probability-consistency constraints. We evaluate three completed configurations–gpt-6.1-sol, claude-sonnet-5.5, and Qwen3-8B (reasoning disabled, analyzed descriptively). In the first two configurations, direct elicitation yielded near-zero irrelevant-anchor indices and status-quo effects, while remaining responsive to informative sources and informed advice. Of 23 preregistered confirmatory tests, six rejected after Holm adjustment; however, all six absolute point estimates fell below their prespecified smallest effect sizes of interest without establishing equivalence. Moreover, while separate versus joint elicitation shifted conjunction judgments, interpretation is constrained by between-call noise. Ultimately, multi-estimate elicitation failed to produce uniform debiasing or response attenuation across tasks and models, though post hoc correlations between candidate spread and anchoring error motivate independent predictive validation. Materials: https://github.com/asj252/llm-judgment-studies

[6] Enhancing Language Model Reasoning with Structured Multi-Level Modeling cs.CLPDF

Siheng Xiong, Ali Payani, Faramarz Fekri

TL;DR: 论文提出多级推理框架MLR，将长链思维（CoT）生成分解为高层规划器与低层执行器交替循环：高层生成包含推理模式和语义子目标的结构化步骤描述符，低层据此生成详细推理。训练上提出迭代式Step-DPO，利用Twisted Sequential Monte Carlo提供逐步偏好监督，缓解长轨迹结果奖励稀疏和信用分配困难。实验表明在有限数据预算下，MLR在数学、科学和逻辑推理基准上优于SFT蒸馏及强RL/偏好优化基线。

Details

Motivation: 现有推理时扩展方法多依赖单一策略和结果奖励强化学习，长程规划容易漂移并导致计划失败，尤其对容量有限的小语言模型不友好；同时长轨迹的结果奖励稀疏且延迟，难以进行有效信用分配。

Result: 在数学、科学和逻辑推理基准上，于相对DeepSeek-R1蒸馏设置仅10% SFT和5%偏好数据预算下，MLR在多个基座模型和任务上优于SFT蒸馏及强RL/偏好优化基线；并在更长CoT生成下表现出更慢的性能退化，长程推理鲁棒性更强。

Insight: 宣称创新点是将长CoT生成重构为高层规划与低层执行的两级随机过程，并以轻量LoRA实现高层策略以保持可扩展性；同时用TSMC驱动的迭代Step-DPO提供可扩展的过程级监督。客观来看，其可借鉴之处在于分层结构化规划与执行分解，以及将过程偏好优化用于长推理轨迹的稳定训练。

Abstract: Inference-time scaling enhances a model’s reasoning by extending its chain-of-thought (CoT). However, existing approaches typically rely on a single policy trained with outcome-reward reinforcement learning (RL), which often suffers from long-horizon plan failures where the implicit plan drifts from valid strategies, especially for small LMs with limited capacity. To address this, we propose Multi-Level Reasoning (MLR), which reformulates long-CoT generation as a two-level stochastic process. A high-level planner generates structured step descriptors specifying both the reasoning mode and the semantic subgoal. The low-level executor then produces detailed reasoning conditioned on these descriptors, forming an alternating plan–execute loop. To maintain scalability, we adopt a minimal design where the base model serves as the low-level policy and a lightweight LoRA module implements the high-level policy. For training, we observe that outcome-reward RL provides sparse and delayed feedback for long trajectories (e.g., several thousand tokens), hindering credit assignment. We therefore introduce iterative Step-DPO, a process-level preference optimization scheme that leverages Twisted Sequential Monte Carlo (TSMC) to provide scalable stepwise supervision. This yields more effective training, improved stability, and higher accuracy. Extensive experiments on challenging math, science, and logical reasoning benchmarks show that, under the same reduced data budget (10% SFT and 5% preference relative to the DeepSeek-R1 distillation setup), MLR outperforms both SFT-based distillation and strong RL/preference-optimization baselines across multiple base models and tasks. Moreover, MLR exhibits slower performance degradation on long-horizon reasoning, demonstrating stronger robustness under extended CoT generation.

[7] ElectroChemLLM: A Multimodal LLM Pipeline for High-Fidelity Electrochemical Informatics cs.CL | cs.DB | cs.IR | cs.LGPDF

Dikshya Mohanty, Manoj Praveen Nandigama, Kuldeepsinh Raj, Sourav Kanti Maiti, Jiannan Yang

TL;DR: 论文提出 ElectroChemLLM，一个面向电化学领域的多模态信息抽取流水线，可从大规模非结构化科学 PDF 中联合抽取电解液组成、电极材料、电池构型及其物化性质等结构化记录，并构建 ElectroChemDB 数据库，进而用于训练电解质性质预测模型，打通从文献到材料发现的路径。

Details

Motivation: 现有自动化流水线多为纯文本架构，存在上下文碎片化和数值幻觉等问题，难以准确、大规模地构建电化学性质数据库，限制了电化学研究的进展。

Result: 在包含232篇论文的人工标注基准的电池-电解质子集上，ElectroChemLLM 取得 F-1 分数0.97；已用于整理覆盖15,000篇电化学研究文章的结构化数据库 ElectroChemDB，并基于该资源训练电解质性质预测模型。

Insight: 创新点在于结合混合文档解析与具备视觉能力的 LLM 编排，跨文本、表格和图像抽取可验证的结构化数据；客观上其价值在于将多模态信息抽取、数据库构建与下游材料性质预测形成完整闭环，缓解纯文本流水线的上下文碎片化和数值幻觉问题。

Abstract: Electrochemistry is central to solving many modern-day challenges, including energy storage systems for a sustainable future, and its advancement relies heavily on the data from past findings. Existing automated pipelines are limited by text-only architectures, context fragmentation, and numerical hallucinations - collectively preventing accurate, large-scale curation of property databases. We introduce ElectrochemLLM, a multimodal information extraction pipeline that jointly identifies structured electrochemical records encompassing electrolyte compositions, electrode materials, cell configurations, and their measured physicochemical properties from unstructured scientific PDFs at scale. By combining hybrid document parsing with vision-capable LLM orchestration, the pipeline extracts verifiable, structured data across text, tables, and figures. Evaluated on the battery-electrolyte subset of our manually annotated benchmark of 232 papers, ElectrochemLLM achieves an F-1 score of 0.97, and has been applied to curate ElectroChemDB, a structured database spanning 15,000 electrochemical research articles. We demonstrate the utility of this resource by training machine learning models for electrolyte property prediction, illustrating a complete pathway from unstructured literature to predictive materials discovery.

[8] DuSE-Bench: Benchmarking Joint Reasoning over Evolving Dialogue and Documents cs.CL | cs.IRPDF

Guanjie Cheng, Jianfeng Gao, Yufei Tong, Xinkui Zhao, Shuiguang Deng

TL;DR: 论文提出 DuSE-Bench，一个用于评估对话与文档双源信息随时间演化时联合推理能力的基准。它包含 5 类场景共 1000 个任务，其中 700 个任务的必要前提同时来自对话和文档；基准通过演化支持图记录更新事实、复用结论与原始对话轮次和文档段落之间的关联，并分别评估回答内容、回答类型和来源归因。

Details

Motivation: 持久化 Web 信息助手需要同时利用不断演化的文档事实和跨会话建立、修订的用户需求，但目前缺乏对双源变化如何影响响应要求与证据归因的系统评估。

Result: 在 11 种基线配置上，联合 grounded 任务的内容准确率最高仅 56.7%；内容准确率提升可能伴随回答类型选择变差，且内容正确的回答常缺乏对原始证据的完整归因；匹配证据替换实验还表明，替换一个来源证据的效果取决于另一来源的支持。

Insight: 创新点在于构建带演化支持图的双源演化基准，区分 grounding source 与 state dependence，并分离评估内容、响应类型和来源归因；其启示是需要协同对话记忆与文档检索，在保留原始证据支持的同时联合应用当前用户需求和文档事实。

Abstract: Persistent Web information assistants must combine evolving document facts with user requirements established and revised across sessions. Yet systematic evaluation of how changes in both sources affect response requirements and evidence attribution remains limited. To address this gap, we introduce Dual-Source Evolution Benchmark (DuSE-Bench), a benchmark comprising 1,000 tasks across five scenarios, including 700 whose required premises originate in both dialogue and documents. An evolving Support Graph guides task construction and preserves links from updated facts and reused conclusions to original turns and passages. Task annotations distinguish grounding source from state dependence and enable separate evaluation of response content, response type, and source attribution. Experiments across 11 baseline configurations reveal persistent challenges in joint reasoning over evolving dialogue and documents, with content accuracy on jointly grounded tasks reaching at most 56.7%. Moreover, improvements in content accuracy can coincide with poorer response choice, while content-correct responses frequently lack complete attribution to original evidence. Matched evidence substitutions further show that the effect of replacing one source’s evidence depends on support from the other. These findings motivate coordinating dialogue memory and document retrieval to apply current user requirements and document facts together while preserving their original support. The data are available at https://github.com/JianfengGao7/DuSE-Bench.

[9] CheXPoT: Post-Hoc Visual Verification and Correction of VLM-Generated Radiology Reports cs.CL | cs.CVPDF

Joey Guo, Rayan Ansari, Alaa Youssef

TL;DR: 论文提出 CheXPoT，一个基于程序化思维链（PoT）的后处理框架，用于对视觉语言模型生成的胸片报告进行视觉验证与纠错。它先用 RadGraph 和 LLM 将报告分解为谓词，再借助 DenseNet-121 与 Grad-CAM 构建的视觉证据表对谓词进行 grounding，执行 PoT 验证代码并删除无法被图像支持的发现后重写报告。实验表明该方法无需重新训练模型即可显著提升多个 VLM 报告生成器的精确率和 F1。

Details

Motivation: VLM 在胸片报告生成中存在图像不支持的幻觉发现，限制临床采用；现有强化学习、偏好优化或思维链监督方法计算成本较高，因此需要一种低成本的后处理验证与纠错方案。

Result: 在 4,145 张图像的留出集上，CheXPoT 在 14 个 CheXpert 类别中 8 类显著提升精确率、5 类显著提升 F1，且两项指标均无显著下降；MedGemma-4B 的微平均精确率从 19.2% 提升到 46.8%，F1 从 23.0% 提升到 49.4%。在 LLaVA-Med 和 MAIRA-2 上也分别带来显著提升。

Insight: 论文宣称的创新点是提出无需重训的 PoT 后处理验证框架，逐条验证生成发现并删除无法 grounding 的谓词。客观上，其创新在于将报告谓词化、RadGraph/LLM 分解、DenseNet-121+Grad-CAM 视觉证据表与可执行验证代码结合，形成可解释且较低成本的 VLM 报告纠错流程。

Abstract: Vision-language models (VLMs) have shown promise for chest radiograph report generation, but adoption remains limited because of hallucinated findings that are not grounded in the image. Correcting these hallucinations and improving overall report quality remains a significant challenge. Prior work has addressed this problem by refining models with reinforcement learning, preference optimization, or chain-of-thought supervision, often at substantial compute cost. To address this gap, we introduce CheXPoT, a program-of-thought (PoT) framework that verifies each generated finding against image features and removes those it cannot ground. CheXPoT decomposes generated reports into predicates with RadGraph and an LLM, grounds these predicates against a DenseNet-121 and Grad-CAM visual evidence table, executes PoT verification code, and rewrites reports after removing unsupported predicates. On a 4,145-image held-out split, CheXPoT yields statistically significant precision gains on 8 of 14 CheXpert classes and F1 gains on 5, with no significant decreases in either metric. CheXPoT lifts micro-average precision from 19.2% (MedGemma-4B) to 46.8% (MedGemma-4B + CheXPoT) and micro-average F1 from 23.0% to 49.4%, absolute gains of 27.6% and 26.4% respectively. We also tested CheXPoT on other VLM report generators. On LLaVA-Med, CheXPoT lifts micro-average precision from 4.5% to 17.7% and micro-average F1 from 6.3% to 19.4%. On MAIRA-2, CheXPoT lifts micro-average precision from 15.6% to 42.1% and micro-average F1 from 21.0% to 45.3%. Our results suggest that inexpensive post-hoc visual verification may improve VLM trustworthiness by correcting unsupported findings from generated reports. CheXPoT lays a foundation for tools that help validate VLM-generated radiology reports and reduce unsupported findings. These innovations may subsequently help increase trust and adoption of VLM tools in Medicine.

[10] Steer, Don’t Tell: Breaking Reasoning Plateaus with Reachability-Aligned Self-Distillation cs.CLPDF

Zijian Wu, Lingkai Kong, Lin Yang, Haiteng Zhao, Kuikun Liu

TL;DR: 论文针对大型推理模型自蒸馏中特权教师产生的正确轨迹学生不可达的问题，提出Self-Steered Reasoner (SSR)。SSR通过学生支持投影将特权教师分布转化为学生局部可达的推理动作方向信号，并结合验证保留正确轨迹，从而生成可学习的自监督数据。在即使广泛强化学习后pass@64仍为0的困难问题上，SSR无需参数更新即可恢复74.6%的正确可学习轨迹；微调后继续强化学习，在AIME25/26和HMMT26上聚合准确率提升4.9个百分点。

Details

Motivation: 现有自改进方法使用参考解构建特权自教师，但教师正确性不保证学生可达性，导致解决方案条件使教师分布偏向学生不太可能的动作，产生看似正确却不可达或畸形的学习目标。因此，论文将可达性对齐视为自构建监督的关键出发点。

Result: 在pass@64=0的困难问题上，SSR无需参数更新即可为74.6%的问题恢复正确且可学习的轨迹；对恢复轨迹微调后继续强化学习，在AIME25/26和HMMT26基准上聚合准确率提升4.9个百分点。

Insight: 论文宣称的创新点是提出可达性对齐原则，并通过学生支持投影将特权教师分布转化为仅覆盖学生局部可达动作的方向信号，避免不可达学习目标；结合迭代细化框架提升采样效率。客观分析，其创新在于将自蒸馏数据构造从“教师正确性”转向“学生可达性”，从而在困难问题上更有效地利用特权信息进行自改进。

Abstract: Post training for large reasoning models remains insufficient on challenging problems, whose correct trajectories are hard to sample. Though prior works address this difficulty by integrating supervised fine tuning on expert trajectories with reinforcement learning, such external experts are not always available. Existing self improvement methods instead use reference solutions to create a privileged self-teacher. Yet privileged teacher correctness does not imply student reachability. Solution conditioning shifts the teacher distribution toward actions unlikely under the unprivileged student, producing seemingly “correct” trajectories that are unreachable or even mal-formed learning targets. Accordingly, we identify reachability alignment as the key to self constructed supervision and propose Self-Steered Reasoner (SSR). SSR realizes this principle through student support projection, which transforms the privileged teacher distribution into a directional signal only over reasoning actions locally reachable under the unguided student. Verification then retains correct trajectories sampled from this reachable space. To further boost the sampling efficiency, an iterative refinement framework is adopted, using diagnostic guidance based on current trajectories. On problems with pass@64 = 0 even after extensive RL, SSR recovers correct and learnable trajectories for 74.6% without parameter updates. Fine tuning on these trajectories followed by resumed reinforcement learning improves aggregate accuracy by 4.9 percentage points on AIME25/26 and HMMT26. These results show that privileged guidance becomes effective self-improvement data when aligned with the reasoning actions the student can reach.

[11] Adaptive-Policy Distillation: Knowledge Injection under Information Asymmetry cs.CL | cs.LGPDF

Hojun Cho, Kang Eun Jeon, Jaegul Choo

TL;DR: 论文研究在线策略蒸馏（OPD）在知识注入任务上的失效问题：作者发现，虽然OPD在行为迁移上表现良好，但在两个文档问答基准上注入文档知识的效率远低于简单的离线策略蒸馏，并将其归因于两个结构性失败：逆KL以学生分布加权梯度，导致学生认为不太可能的文档专属token几乎得不到提升；并且学生rollout的覆盖率随目标长度增加而下降。为此作者提出自适应策略蒸馏（APD），用逐token门控在需要的位置同时将rollout推向教师模型、将目标函数转向前向KL，并随学生学习自动撤销干预。

Details

Motivation: OPD通过逆KL监督学生rollout，将上下文条件模型的行为迁移到学生参数中，以实现闭卷推理；但作者发现该方法在知识注入场景下效率远不如离线策略蒸馏，因此希望解决如何高效地将文档知识注入学生模型参数的问题。

Result: 在两个文档问答基准上，APD无需标签或验证器即比OPD最高提升54.6%，在QASPER上取得0.558 F1，在BioASQ上取得0.486 MRR，均为最佳结果。

Insight: 创新点在于识别出OPD知识注入的两个结构性失败，即逆KL对学生低概率token的梯度信号微弱，以及rollout覆盖率随目标序列长度衰减；并基于师生散度集中在难位置这一观察，设计逐token门控，联合调整rollout分布与蒸馏目标（从逆KL转向前向KL），且随学生学习自动退出干预。

Abstract: On-policy distillation (OPD), which uses reverse-KL supervision on student rollouts to transfer a context-conditioned model’s behavior into student model parameters for closed-book inference, has shown strong results. However, we find that this success does not translate to knowledge injection: across two document-QA benchmarks, OPD injects document knowledge far less efficiently than simple off-policy distillation. We trace this reversal to two failures that are structural, yet sparse across token positions. Reverse KL weights its gradient by the student distribution and therefore barely lifts document-specific tokens the student considers unlikely; after forward KL restores this signal, student rollouts expose later positions on the target trajectory only after generating the preceding tokens correctly, so coverage deteriorates with target length. Motivated by the concentration of teacher-student divergence at these hard positions, we propose Adaptive-Policy Distillation (APD), whose per-token gate jointly shifts the rollout toward the teacher and the objective toward forward KL where needed, withdrawing both interventions as the student learns. Without labels or a verifier, APD improves over OPD by up to 54.6%, achieving the best scores of 0.558 F1 on QASPER and 0.486 MRR on BioASQ.

[12] ShiftRAG: Bypassing the Textual Bottleneck via Decoupled Learning and Continuous Soft Tokens cs.CL | cs.AIPDF

Youmin Ko, Jihong Jeong, Hyunjoon Kim

TL;DR: 论文提出ShiftRAG，一种解耦式RAG框架：使用单一LLM骨干，但将判别式检索学习与自回归生成隔离，并通过将检索对齐投影为连续软token来构建高带宽接口，把检索侧信号注入生成器。方法还引入软正交目标缓解rank collapse，并利用逐层相关性动态保留细粒度证据分离所需潜空间。实验显示其在检索和问答任务上显著优于SOTA基线，并保持基础模型能力与效率-性能权衡。

Details

Motivation: 现有RAG仅向生成器传递原始文本，存在文本瓶颈，丢失检索器的判别信号；而将检索与生成统一到单个LLM中会引发严重目标冲突，并加剧decoder-only架构的rank collapse，导致检索和生成性能下降。

Result: 广泛评估表明，ShiftRAG在检索和问答性能上显著优于当前SOTA基线；同时保留骨干模型的基础能力，并在通用文本编码和生成任务上维持较好的效率-性能权衡。

Insight: 论文的核心创新在于解耦检索判别学习与自回归生成，并用连续软token作为检索到生成的高带宽接口；软正交目标缓解rank collapse，逐层相关性动态保留细粒度潜空间。客观来看，该设计试图同时规避文本瓶颈和联合优化冲突，在单一LLM骨干下兼顾检索信号注入与生成效率。

Abstract: Despite advances in retrieval-augmented generation (RAG), suppressing hallucinations during complex reasoning remains a persistent challenge. We identify that existing RAG pipelines suffer from a textual bottleneck: by passing only raw text to the generator, they discard discriminative signals of the retriever. Furthermore, recent attempts to unify retrieval and generation within a single LLM induce severe objective conflict and exacerbate the rank collapse of decoder-only architectures, degrading performance on both tasks. To address these limitations, we introduce ShiftRAG, a decoupled RAG framework that employs a single LLM backbone but isolates discriminative retrieval learning from autoregressive generation. To bridge these decoupled modes, we project retrieval alignments into continuous soft tokens, establishing a high-bandwidth interface that infuses the generator with retrieval-side signals. Concurrently, our soft orthogonality objective mitigates rank collapse, while layer-wise relevance dynamics preserve the fine-grained latent space required for highly discriminative evidence separation. Extensive evaluations demonstrate that ShiftRAG significantly improves retrieval and question answering performance over state-of-the-art baselines. ShiftRAG preserves foundational capabilities of the backbone while maintaining a favorable efficiency-performance trade-off on general text encoding and generative tasks.

[13] What Breaks and What Comes Back: Capability Damage and Recovery in Depth-Pruned Small Language Models cs.CL | cs.LGPDF

Piyush Dhoka, Vedant Pandhare, Varun Inamdar, Aadarsh Pathre, Pavitha Nooji

TL;DR: 论文系统研究了深度剪枝（直接删除 Transformer 块）对小语言模型作为智能体所需能力的影响，以及短时间微调“healing”后的恢复情况。作者在四个 1.2-1.7B 指令微调模型上追踪六类能力，发现函数调用和数学推理几乎完全崩溃，能力受损顺序在不同模型间高度一致；同时比较了不同参数更新范围和基于 pilot 的恢复预算分配策略，发现更长的均匀 healing 是规划式恢复难以超越的强基线。

Details

Motivation: 深度剪枝能让小语言模型更小更快，但其对不同能力的损害并不均匀，且短微调能恢复哪些能力尚不清楚。论文关注小模型作为智能体时，剪枝后哪些能力先坏、如何用有限 healing 预算恢复，并检验规划式恢复是否优于简单基线。

Result: 在 Llama-3.2-1B、Qwen2.5-1.5B、SmolLM2-1.7B 和 OLMo-2-1B 上，函数调用与数学推理在剪枝后保留率仅 0.00-0.07，能力崩溃顺序跨模型一致性高（Kendall’s W=0.92，校正机会下限后为 0.62）。训练参数范围与数据同样重要；在计入 pilot token 后，相同总训练 token 的均匀 healing 在所有模型家族上匹配或超过规划式恢复，并在三个家族上显著更好保留数学能力（重采样种子后为一个）。

Insight: 创新点在于对深度剪枝后多能力损伤与恢复进行跨模型家族的细粒度实证分析，揭示能力崩溃顺序的稳定性和参数更新范围的重要性。客观看，其价值还在于指出基于短 pilot 的恢复规划未必能战胜“训练更久、均匀 healing”的简单强基线，并强调评估时应计入 pilot 成本与种子方差。

Abstract: Depth pruning removes whole Transformer blocks to make a language model smaller and faster, but the damage is not spread evenly across what the model can do, and a short fine-tuning run, called healing, decides what comes back. We measure this for small models used as agents. Four instruction-tuned models of 1.2-1.7B parameters (Llama-3.2-1B, Qwen2.5-1.5B, SmolLM2-1.7B and OLMo-2-1B) are pruned and healed, and six capabilities are tracked: structured output, function calling, instruction following, mathematical reasoning, safety refusal and knowledge. Three results hold across the families. First, function calling and math collapse in every model (retention 0.00-0.07 of the unpruned score), and the order in which capabilities break agrees closely across the four (Kendall’s W = 0.92; 0.62 after correcting for chance floors). Second, which parameters are trained matters as much as which data: fully tuning the last three blocks instead of adding low-rank adapters to all blocks costs up to 0.18 in capped mean retention on three families, and one 300k-token pilot per scope detects this. Third, we test a planner that allocates a 1M-token healing budget from 21 short pilot heals. At a fixed budget it raises the weakest capability on two families, although only one of these gains survives a test that also resamples training seeds. Once its 3.48M pilot tokens are counted, uniform healing with the same total number of training tokens matches or beats every planned variant on every family and retains math significantly better on three of them in an item-level test (on one when seeds are also resampled). Healing longer is a strong and simple baseline that planned recovery must beat. Code, per-item predictions and every result are public.

[14] Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRand cs.CLPDF

George Ling, Shanshan Zhong, Lijin Yang, Hao Yang, Nanxiang Li

TL;DR: 论文研究基准压缩，即用小型基准子集近似全基准评估以降低模型评测成本。作者推导了子集估计误差分布，发现随机采样多数情况下误差很小，但存在稀有且固有的大误差长尾，导致评估不稳定；据此提出BestRand，在保留随机采样低成本效率的同时显著压缩高误差尾部，并在70+文本、多模态、智能体基准及VLA评估上实现更稳定、更准确的压缩。

Details

Motivation: 全基准评估模型耗时且昂贵，基准压缩需要用少量样本逼近全基准结果；随机采样虽然高效，但存在稀有且随现代基础模型固有的大误差，导致评估不稳定，因此需要在低成本下降低高误差风险。

Result: 在70+文本、多模态和智能体基准上验证，并扩展到VLA评估；相比竞争方法，高误差风险降低50.2%，平均估计误差降低16.4%，构建成本仅为51.3%；在分数范围、模型家族和时间偏移下的OOD估计误差平均降低21.8%。

Insight: 创新点在于解析刻画基准压缩误差分布的长尾特性，揭示随机采样“几乎够用但不稳定”的来源，并据此设计BestRand以保留随机采样效率同时抑制高误差尾部；客观来看，其价值在于将误差尾部风险纳入压缩方法设计，并为理解和预测基准压缩的准确性与可靠性提供理论指导。

Abstract: Benchmark compression reduces the often prohibitive time and cost of model evaluation by evaluating models on a small benchmark subset that closely matches full-benchmark results. To quantify estimation error, we derive an accurate analytical approximation to the error distribution when estimating full-benchmark scores from a subset, showing that most subsets yield small errors, while a few produce much larger errors, resulting in a long-tailed distribution. This means random sampling alone can achieve surprisingly strong performance with high probability, but remains unstable due to rare large errors. We further show that this instability is inherent to modern foundation models and persists even as more models are evaluated. Based on these findings, we introduce BestRand, a stable and low-cost benchmark compression method that preserves the efficiency of random sampling while substantially reducing its high-error tail. We validate BestRand on 70+ text, multimodal, and agent benchmarks, and further extend it to VLA evaluation. Compared with competitive methods, BestRand reduces high-error risk by 50.2% and estimation error by 16.4% on average, while requiring only 51.3% of the construction cost. It further reduces OOD estimation error by 21.8% on average across score-range, model-family, and temporal shifts. Together, our theory provides practical guidance for understanding and predicting the accuracy and reliability of benchmark compression, while BestRand enables stable and accurate compression at low cost. The code and data are publicly available onhttps://github.com/George-Ling3/BestRand.

[15] S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments cs.CL | cs.AI | q-bio.NCPDF

Dengzhe Hou, Kazunori D Yamada

TL;DR: 论文提出 S1CogBench，用于评估 System One 决策模型（也称类型化决策模型，如 Jev、Laya）在 24 个认知实验任务上的能力与局限。它评估五个开放模型和 Jev，并区分实验条件、评分与模型披露的适配。研究发现这类模型可靠性差异大，行为表现好不等于能预测人类，聚合分数会掩盖条件响应差异，速度主要来自不生成文本。

Details

Motivation: 软件正将语言模型用于路由、护栏和自动门控等快速决策场景，但类型化决策模型只返回合法选项，没有可检查文本，快速且格式正确的决策不能证明模型真正利用了证据。现有认知基准主要评估语言和多模态模型，缺少针对此类决策模型的系统测试。

Result: 在 24 个认知任务上评估五个开放模型和 Jev，发现决策模型可靠性差异显著；表现良好并不意味着能预测人类行为；聚合分数会隐藏决策对不同条件的响应；速度优势主要来自不进行生成式回答。摘要未给出具体数值或 SOTA 结论。

Insight: 创新点在于提出首个面向 System One 决策模型在既定认知实验上的基准，覆盖证据、反馈、记忆负荷和未来机会等响应维度，并将实验条件与评分同模型披露适配分开。客观看，其价值在于把评测从文本生成转向无文本快速决策的认知行为可靠性，为软件依赖前的验证提供共享测试。

Abstract: Language models are no longer used only to generate text. Software also asks them for decisions, in routing, guardrails, and automated gates. System One decision models, also called typed decision models, such as Jev and Laya, return one fast decision over the legal options, leaving no text to inspect. However, a fast, well-formed decision does not show that the model used the evidence. Cognitive experiments can test this, because they vary task demands and measure how behavior changes, yet existing cognitive benchmarks evaluate language and multimodal models. We introduce S1CogBench to ask what these models can and cannot do on 24 cognitive tasks, evaluating five open models and Jev and keeping conditions and scoring apart from disclosed adaptations. We find that decision models vary widely in reliability, acting well does not imply predicting humans, aggregate scores hide how decisions respond to conditions, and speed comes mainly from answering without generation. To our knowledge, S1CogBench is the first benchmark of System One decision models on established cognitive experiments, and it gives a shared test of whether their decisions respond to evidence, feedback, memory load, and future opportunities before software relies on them.

[16] HALO: Hierarchical Evidence Selection and Reinforcement Learning for Allocating Budgeted Label Optimization from Longitudinal Clinical Records cs.CL | cs.LG | stat.MLPDF

Huaiyuan Ying, Feiqing Huang, Ryumei Nakada, Katherine P. Liao, Tianxi Cai

TL;DR: 论文提出HALO，面向纵向临床记录在有限标注预算下联合解决“保留哪些证据”和“获取何种保真度标签”两个耦合问题。方法先分层选择信息量高的证据，再用预算感知强化学习策略分配免费、silver和gold标签源，并在心衰案例中验证。

Details

Motivation: 纵向临床记录跨度长、重复就诊多、文档异构，在有限标注预算下需要同时决定读取哪些证据以及给哪些患者更高保真标签；已有主动学习和多保真标签获取工作多聚焦标签分配，而将呈现给策略的证据视为固定。

Result: 心衰案例中，HALO在8个目标预算中的6个取得最高MedAlign acquired-label F1；基于其获取标签训练的下游分类器在预算15-60取得最高外部MGB F1，在75-120与最佳比较器差距不超过0.01。论文还为冻结策略给出预算约束下的有限样本gold-risk界。

Insight: 创新点在于将分层证据选择与预算感知强化学习结合，联合优化“读什么”和“获取什么标签源”，并理论刻画非对称获取标签通道及gold-risk界；客观看，其价值在于把证据选择纳入主动/多保真标签获取闭环，适配长病历和预算受限场景。

Abstract: Learning from extensive longitudinal clinical records–spanning repeated encounters, evolving conditions, and heterogeneous documentation–under a finite labeling budget requires solving two coupled problems: deciding what evidence to keep and deciding which patients deserve higher-fidelity labels. Prior work on active learning and multi-fidelity label acquisition mainly addresses the second problem, while treating the evidence presented to the acquisition policy as fixed. We present HALO, a Hierarchical Evidence Selection and Reinforcement Learning pipeline for Allocating Budgeted Label Optimization from Longitudinal Clinical Records. This framework jointly learns what to read and what label source to acquire under budget. HALO first selects informative evidence from longitudinal records and then uses a budget-aware policy to allocate free-, silver-, and gold-fidelity label sources. For frozen policies, our theory characterizes asymmetric acquired-label channels and gives a budget-constrained finite-sample gold-risk bound for a common downstream logistic model. In a heart-failure case study, HALO attained the highest MedAlign acquired-label F1 at six of eight target budgets. A downstream classifier trained on HALO-acquired labels attained the highest external MGB F1 at budgets 15-60 and remained within 0.01 of the best comparator at budgets 75-120.

[17] CogRSI: Evolving and Auditing Cognitive Reasoning Strategies cs.CLPDF

Yandan zheng, Haoran Luo, Xinliang Zhou, Anhtuan Luu

TL;DR: 论文提出 CogRSI 框架，让语言模型通过自改进循环生成并优化用于他人心理状态推理的简短书面原则，并用这些原则辅助 grounded reader 解决多解读冲突。实验显示学习到的原则在未见 BigToM 数据上优于专家原则，但将规则转成代码审计后发现，多数规则在声称覆盖的某些情境下会给出错误答案。

Details

Motivation: 论文关注语言模型能否通过改进自身策略来更好地进行他心/心理理论推理，以及这些学到的策略作为规则是否真的正确；作者指出仅看准确率无法揭示策略规则本身的错误。

Result: 专家原则在相同 token 成本下超过 self-consistency；自改进得到的原则在 800 个未见 BigToM 对上均高于专家原则。但规则代码审计显示，多数学习规则至少在一种声称覆盖的情境中答错，反事实测试也未能修复这一问题。

Insight: 创新点在于将推理策略写成简短原则并自改进筛选，同时强调实践有效性与规则正确性的分离，提出对学习策略进行代码化审计。客观上看，grounded reader 加原则解决多解读冲突、自生成策略的可迁移性，以及准确率之外的规则审计视角，是该工作较有价值的贡献。

Abstract: Can a language model learn better ways to reason about other people’s minds by improving its own strategies, and are the strategies it learns actually right? We study this with cogrsi. A grounded reader marks who saw each event in a story and uses a short written principle to settle disagreements between its readings. With a principle written by experts, it beats self-consistency at the same token cost. A self-improvement loop then writes the principle itself. It keeps an update only if accuracy rises by a calibrated margin, and in one variant only if it also passes counterfactual test pairs. The learned principles transfer: on 800 BigToM pairs that no system had seen, each of them scores higher than the expert principle. We then check what the learned rules actually say. Each rule is translated into code and run on thousands of small stories with known answers. Most of them give a wrong answer in at least one situation they claim to cover, for example by treating a character who is in the room as knowing what happened even while asleep. Accuracy does not reveal which rules are wrong, and the counterfactual test does not fix this. A strategy can help in practice and still be wrong as a rule, so both need checking. Our code and data are publicly available.

[18] Rethinking LLM Pruning via Test-Time Scaling cs.CLPDF

Mingyang Song, Mao Zheng

TL;DR: 论文从测试时扩展（Test-Time Scaling）视角重新审视大语言模型结构化剪枝，在四个数学与代码基准上比较专家、FFN和层剪枝模型与原模型的pass@k表现。研究发现剪枝后pass@1虽下降，但在匹配采样预算下部分模型仍可匹配甚至超过原模型的推理覆盖范围；然而严重剪枝会使正确解更难被采样，增加重复生成和总token开销。论文据此主张剪枝评估应同时考虑可解问题覆盖范围和获得正确解的采样成本。

Details

Motivation: 结构化剪枝常导致LLM准确率下降，但尚不清楚这是推理能力真的减弱，还是正确解变得更难被采样。论文希望区分剪枝对“推理覆盖能力”和“采样效率”的影响，并重新定义剪枝评估方式。

Result: 在四个数学和代码基准上，通过匹配采样预算的pass@k比较发现：大幅剪枝后部分模型虽pass@1较低，却能匹配或超过原模型的推理覆盖，并解决原样本未解决的问题；但严重剪枝下正确解更难采样，额外尝试会显著增加总token消耗。

Insight: 创新点在于用测试时扩展和pass@k覆盖视角重新审视LLM剪枝，揭示“能解什么问题”与“多容易采样到正确解”之间的分离，并指出专家选择增益也需结合覆盖目标和采样成本理解；这为剪枝评估提供了兼顾覆盖范围与采样效率的新框架。

Abstract: Structured pruning reduces the size of large language models, often at the cost of lower accuracy. Whether this decline reflects diminished reasoning capacity or greater difficulty in sampling correct solutions is less clear. We examine this question across expert, FFN and layer pruning on four mathematical and coding benchmarks, comparing original and pruned models through pass@k at matched sampling budgets. Even after substantial pruning, some models match or exceed the original model’s reasoning coverage despite lower pass@1, and solve problems left unsolved in the original samples. Retaining broad coverage, however, does not mean that correct solutions remain easy to obtain. Under severe pruning, diverse generated chain-of-thought (CoT) traces can coexist with increased repetition and less reliable generation. As correct answers become harder to sample, the additional attempts can sharply increase total token use even when individual responses become shorter. This separation between coverage and sampling efficiency also clarifies expert-selection gains, as methods with markedly different pass@1 can solve the same problems at large budgets yet require different numbers of attempts to reach a common coverage target. Pruning should therefore be assessed by both the range of problems a model can still solve and the sampling cost of obtaining correct solutions.

[19] MedAstra: ASR-less Speech Retrieval with Diagnostic Grounding for Medical QA cs.CLPDF

Elahe Khatibi, Ziyu Wang, Amir M. Rahmani

TL;DR: 论文提出 MedAstra，一个面向医学问答的免 ASR 语音检索框架：将冻结 WavLM 的语音表示经轻量适配器映射到冻结 E5 文本嵌入空间，使系统可直接以语音波形进行密集检索，避免 ASR 转写错误破坏临床关键术语；检索结果结合语音链接文本元数据和诊断接地信息支持答案生成。作者报告语音检索 Recall@10 为 87.6，混合配置为 90.4，高于 transcript-first dense retrieval 的 81.0，但同时明确系统并非完整免文本语音问答，且存在声学不确定性建模和临床泛化评估限制。

Details

Motivation: 语音医学问答中，ASR 可能在检索前错误转写临床重要术语，导致检索和后续问答失败。论文希望绕过初始查询转写环节，直接用语音表示检索医学文本知识，以减少 ASR 级联错误。

Result: 报告检索结果中，纯语音检索器达到 87.6 Recall@10，混合配置达到 90.4，对比 transcript-first dense retrieval 的 81.0。医学 QA 和消融实验主要为描述性系统比较，作者也明确说明了输入来源、合成声学测试与真实临床语音之间的差异及评估限制。

Insight: 主要创新是将冻结语音模型表示通过轻量适配器对齐到冻结文本嵌入空间，实现免查询转写的医学密集检索，并结合实体替代、诊断对比和关系启发式等诊断接地信息增强答案生成。客观看，其价值在于减少 ASR 前端错误对医学检索的影响，但当前更偏向语音检索接口创新，而非完整端到端语音问答，且临床泛化和不确定性校准仍需进一步验证。

Abstract: Spoken medical question answering can fail when automatic speech recognition (ASR) corrupts a clinically important term before retrieval. We present MedAstra, a framework that maps frozen WavLM speech representations through a lightweight adapter into a frozen E5 text embedding space. This enables a dense retrieval path that accepts a waveform without a query transcript. Retrieved passages and speech-linked textual metadata support answer generation with entity alternatives, diagnostic contrasts, relation heuristics, and bounded retrieval refinement. ASR-less refers to the initial speech retrieval interface; lexical retrieval, string-based entity correction, and the text generator require textual inputs. The deterministic speech embedding does not constitute a calibrated model of acoustic uncertainty. Reported retrieval results reach 87.6 Recall@10 for the speech-only retriever and 90.4 for the hybrid configuration, compared with 81.0 for transcript-first dense retrieval. Medical QA and ablations provide descriptive system comparisons, with input-provenance and evaluation limitations stated explicitly. We distinguish controlled synthetic acoustic tests from real clinical speech, qualify component attribution, and specify the remaining comparisons needed to assess speech-only QA and clinical generalization.

[20] CuriousTogether: Implications of Curiosity and Cultural Grounding in Multi-Agent LLM Interactions cs.CL | cs.AIPDF

Angana Borah, Zoha Hayat Bhatti, Zhijing Jin, Rada Mihalcea

TL;DR: 论文提出 CuriousTogether 框架，从新颖性寻求、认知好奇和社会好奇三个维度评估好奇心驱动的多智能体 LLM 交互。作者在推理、创意生成和社会偏见缓解等八项任务上实验，发现好奇心引导的多智能体在多数任务上优于非好奇心设置，并分析了国家条件文化接地的利弊及推理时质量-token 权衡。

Details

Motivation: LLM 越来越多用于多智能体场景并展现涌现集体行为，但好奇心作为多智能体动态驱动因素的研究仍不足。论文旨在系统评估好奇心如何影响多智能体 LLM 协作及其在推理、创意和社会任务中的表现。

Result: 好奇心引导的多智能体在 8 项任务中的 7 项取得提升，故事生成语义多样性最高提升 20.6%，刻板印象率降低 14.9 个百分点。国家条件文化接地对故事生成和社会任务有益，但可能损害精度导向推理；基于好奇心的推理时多智能体方法相较单智能体基线具有更好的质量-token 权衡。

Insight: 摘要宣称的创新点在于提出三互补维度的好奇心驱动多智能体 LLM 评估框架，并跨推理、创意和社会偏见任务进行系统分析。客观来看，其创新在于将好奇心操作化为新颖性、认知和社会维度，揭示文化接地的条件化收益与效率权衡，为多智能体协作机制设计提供实证依据。

Abstract: Large Language Models (LLMs) are increasingly deployed in multi-agent settings, exhibiting emergent collective behaviors, yet the role of curiosity as a driver of such dynamics remains understudied. We introduce CuriousTogether, a framework evaluating curiosity-driven multi-agent LLM interactions across three complementary dimensions: novelty-seeking, epistemic and social curiosity. Across eight tasks spanning reasoning, creative generation, and social bias mitigation, curiosity-guided multi-agent settings yield improvements over non-curious ones on seven out of eight tasks, with gains of up to 20.6% in story generation (semantic diversity) and a 14.9 pp reduction in stereotype rates. Furthermore, country-conditioned cultural grounding show benefits for story generation and social tasks, but can hurt precision-oriented reasoning. Finally, we show that inference-time multi-agent curiosity-based approach offers favorable quality-token trade-offs, compared with single-agent baselines. Together, these findings support curiosity-guided interaction as a practical mechanism for improving multi-agent collaboration, with downstream benefits for reasoning, creative, and societal tasks.

[21] Accounting for Irregular State Transitions through Belief Estimation in Online Medical Consultation cs.CLPDF

Mingzhe Lu, Xiangru Chen, Jian Qin, Yunpeng Li, Xihan Gao

TL;DR: 论文针对在线医疗咨询中患者主动披露和话题转移导致临床状态逐步揭示、交互不规律的问题，通过16个医疗对话数据集实证分析发现真实在线交互上下文连续性更低、不可预测性更高，提出PRISM框架，受部分可观察马尔可夫决策过程启发，将临床分诊分解为信念估计、策略优化和响应实现，维护后验信念并基于最大后验状态选择动作，从而适应患者发起的转移。实验表明PRISM在临床决策准确性和响应生成上显著优于前沿LLM和临床代理。

Details

Motivation: 在线医疗咨询中患者非提示性披露和话题转移扰乱临床询问，临床状态逐步揭示，真实在线交互相比线下和模拟基准上下文连续性更低、不可预测性更高，现有方法难以有效应对这种不规律状态转移。

Result: 在16个医疗对话数据集上实证研究，PRISM临床决策准确性提升22.40个百分点，BERTScore_F1超过最强基线5.51分；消融实验表明提供oracle咨询状态能平均提升BERTScore_F1 5.58分。

Insight: 创新点在于将信念估计与动作选择解耦，维护动态后验信念并基于最大后验状态选择动作，以POMDP框架应对不规律状态转移；客观分析，通过信念估计显式建模临床状态不确定性，并利用消融验证状态信息对响应生成的指导作用，为在线医疗对话提供可借鉴的分层决策思路。

Abstract: While online medical consultation broadens access, unprompted patient disclosures and topic shifts frequently disrupt clinician inquiry, leaving clinical states progressively revealed. We characterize these dynamics using both existing evaluation metrics and task-specific interaction metrics designed in this work. Through an empirical study across 16 medical dialogue datasets, we show that authentic online interactions exhibit substantially lower contextual continuity and higher unpredictability than offline and simulated benchmarks. We propose PRISM (Policy Reasoning with Inferred States for Medicine), a framework inspired by partially observable Markov decision processes that decouples latent state estimation from action selection to address drifting dialogue trajectories. Specifically, PRISM factorizes clinical triage into belief estimation, policy optimization, and response realization. By maintaining an evolving posterior belief over consultation states and conditioning action selection on the maximum a posteriori state, PRISM advances clinical goals while accommodating patient-initiated shifts. Extensive evaluations show that PRISM substantially outperforms frontier LLMs and clinical agents, achieving a 22.40 percentage point gain in clinical decision accuracy alongside decisive improvements in response generation, surpassing the strongest baseline by 5.51 points in BERTScore_F1. Furthermore, ablation studies show that providing oracle consultation states consistently boosts response quality across all evaluated baselines by guiding their action reasoning, yielding average gains of 5.58 points in BERTScore_F1.

[22] Write Facts the Way Models Read Them: Lifting the Two-Hop Curse cs.CL | cs.LGPDF

Zhiyun Shi

TL;DR: 论文研究了语言模型微调学习新事实后无法进行两跳推理的“两跳诅咒”问题，指出推理能力本身完好，问题出在事实的“书写方式”上：微调把新事实写成待复述的答案，而第二跳将桥接短语当作实体从中层开始读取。为此提出Legible方法，通过一个损失项让桥接短语在第二跳完成读取的层上与模型对新实体的自身表示对齐，且不改变同关系的其他主语，无需多跳训练数据。

Details

Motivation: 解决微调注入新知识后模型能复述却无法进行多跳推理（两跳诅咒）的问题，并纠正将其归因于推理缺陷、依赖合成推理数据的主流做法。

Result: 在Qwen2.5、Llama-3、Qwen3上，Legible在MQuAKE两跳诅咒问题上的事实组合频率超过模型对自身知识的组合；桥接准确率是CaKE的1.8-2.6倍，在组合性、准确性与局部性上的平均表现优于四类写入方法；并在命名该诅咒的Balesni等人基准RippleEdits上、14B规模下解除诅咒。

Insight: 创新点在于重新定位问题根源为“写入表示与读取方式不匹配”而非推理缺陷，并提出读等价写入（Legible）：以模型自身表示为目标、在第二跳读取完成的特定层对齐桥接短语，且短语与目标均来自被编辑模型本身、无需多跳训练数据，提供了一种轻量且可迁移的知识编辑思路。

Abstract: A language model that learns a new fact by fine-tuning can repeat it but cannot reason with it: taught that a person is a citizen of a new country, it still cannot say, without chain-of-thought, who the head of state of that person’s country is. This two-hop curse is widely treated as a reasoning deficit, and the strongest knowledge editors answer it with synthesized reasoning data. We show that the reasoning is intact and the writing is wrong. Fine-tuning writes a new fact as an answer to be said, whereas the second hop reads the bridge (“that person’s country”) as an entity, from the middle layers on: patching the model’s own representation of the entity into the bridge at those layers largely restores the second hop, yet after fine-tuning the bridge there is no closer to the new entity than before the edit. We therefore propose read-equivalent writing (Legible): one loss term makes the bridge phrase, at the layer where the second hop finishes reading it, match the model’s own reading of the new entity, and keeps the same relation’s other subjects unchanged. Phrases and targets come from the edited model itself, and no multi-hop training data is used. Across Qwen2.5, Llama-3 and Qwen3, Legible (I) composes learned facts more often than the model composes its own knowledge, on MQuAKE’s two-hop-curse questions; (II) reaches 1.8-2.6x the bridge accuracy of CaKE, whose reasoning data composes no better than plain fine-tuning, and has the best average over composition, accuracy and locality against four families of writers; and (III) lifts the curse on RippleEdits, on the benchmark of Balesni et al., who named the curse, and at 14B.

[23] Can Large Language Models Extend Their Agentic Capabilities to Goal Pursuit in Open-Ended Multi-Turn Interaction? cs.CLPDF

Mingyu Chen, Jingkai Lin, Xiaofen Xing, Liankai Huang, Ruiqi Xiong

TL;DR: 论文研究多步工具使用中形成的智能体能力能否迁移到开放式多轮对话的目标追求，并提出无需训练的Tool-Mediated Interaction（TMI）协议：把对话动作表示为工具调用、对方回应表示为工具结果，维持推理-行动-观察循环并保留推理与交互历史。作者在社交互动、情感支持、说服和价格谈判等任务上评估该协议，分析其对目标达成、交互行为和推理效率的影响。

Details

Motivation: 开放式对话中的目标追求要求智能体根据多轮交互反馈持续调整行动；论文关注现有面向多步工具使用的智能体能力能否直接迁移到通过原生工具接口组织的对话，并解决普通对话在多轮目标导向交互中组织和反馈利用不足的问题。

Result: 在两个模型、15,678个主实验episode上，TMI相较有/无thinking的对话基线提升了社交目标达成、情感支持偏好、捐赠金额和买方谈判利润；Qwen消融中在四个主要结果上均优于保留推理的普通对话。TMI还将每次决策的平均推理token较thinking基线降低42.0%–81.5%，并降低全部八个模型-环境对的跨轮短语复用。

Insight: 创新点在于提出训练无关的TMI，将对话交互统一为工具调用-工具结果形式，从而复用智能体的推理-行动-观察循环；客观看，其价值还在于跨社交、情感、说服和谈判场景的系统验证，以及揭示交互组织方式能同时影响目标达成、行为模式和推理效率。

Abstract: Goal pursuit in open-ended dialogue requires agents to adapt their actions to interaction feedback across successive exchanges. We investigate whether agentic capabilities developed for multi-step tool use carry over to dialogue organized through the model’s native tool interface, and how this changes interaction behavior. We define Tool-Mediated Interaction (TMI) as a training-free protocol that represents dialogue actions as tool calls and counterpart responses as tool results, maintaining a continuous reasoning-action-observation loop with retained reasoning and interaction history. We evaluate TMI across social interaction, emotional support, persuasion, and price negotiation using two models and 15,678 main-experiment episodes. Across both models, TMI improves social goal attainment, emotional-support preference, donation amounts, and buyer negotiation margins over conversational baselines with and without thinking. A Qwen ablation further shows that TMI outperforms ordinary conversation with retained reasoning on all four primary outcomes. Behavioral analyses associate the improvements with task-specific patterns in initial proposals and responses to interaction feedback. Alongside these gains, TMI reduces mean reasoning tokens per decision by 42.0-81.5% relative to the thinking baseline and lowers mean cross-turn phrase reuse across all eight model-environment pairs. These findings show that interaction organization shapes both goal attainment and reasoning across dialogue turns.

[24] FinForesight: A Diagnostic Backtesting Benchmark for Deep Research Systems in Financial Forecasting cs.CL | cs.LGPDF

Fengyuan Liu, Mukai Li, Jieshun You, Yilin Zheng, Chenjia Min

TL;DR: 论文提出 FinForesight，一个面向金融深度研究系统的诊断性回测基准，覆盖中国、美国和中国香港市场，包含估值、收益排名、事件方向和未来财务基本面四项预测任务，以及反事实推理和财务计算两项独立诊断任务。框架限制检索证据只能使用预测日期前可得的信息，并对比预训练时代、截止后已解决和实时评估，以检验受控回测能否近似未来表现；同时进行预测归因和鲁棒性分析。

Details

Motivation: 金融预测需要综合动态证据并在不确定性下推理，但现有评估中历史回测可能奖励记忆结果或使用预测日期之后的信息，而实时预测又只能等待事件解决后才能获得反馈。论文旨在提供及时反馈且可评估历史分数的诊断性回测基准。

Result: 论文构建了跨中、美、港市场的基准，包含四项预测任务和两项能力诊断任务；实验发现多数时间比较中预训练时代分数高于截止后分数，更强的检索控制可缩小截止后回测与实时结果的差距，并给出了检索策略、提示重写和数值扰动下的归因与鲁棒性分析。

Insight: 主要创新在于将诊断性回测、预测日期约束检索、预训练时代/截止后/实时三类评估对比结合，并把反事实推理与财务计算能力从预测性能中分离评分。客观看，其价值在于为金融深度研究系统提供更可控、可归因且关注时间泄漏和鲁棒性的评估框架。

Abstract: Anticipating financial outcomes requires synthesizing evolving evidence and reasoning under uncertainty, making deep research systems promising tools for forecasting. Yet evaluating forecasting ability is challenging because historical backtests may reward memorized outcomes or information retrieved after the forecast date. Live forecasting avoids direct access to realized outcomes, but feedback arrives only after events resolve. To obtain timely feedback and assess historical scores, we introduce FinForesight, a diagnostic backtesting benchmark for financial deep research systems. Across the Chinese, U.S., and Hong Kong markets, the benchmark evaluates four forecasting tasks: valuation, return ranking, event direction, and future financial fundamentals. Two capability diagnostic tasks assess counterfactual reasoning and financial calculation, scored separately from forecasting performance. Our harness-compatible framework restricts retrieved evidence to information available at the forecast date. We compare pretraining-era, resolved post-cutoff, and live evaluations to test whether controlled backtests approximate future performance. Pretraining-era scores exceed post-cutoff scores in most temporal comparisons, and stronger retrieval controls narrow the gap between post-cutoff backtests and live results. Forecasting attribution and robustness analyses reveal how scores respond to retrieval policy and how predictions respond to prompt rewrites and numerical perturbations. The code and benchmark data are publicly available.

[25] MemRole: From Memories to Decisions for Long-Horizon Reasoning in Role-Playing Agents cs.CL | cs.AIPDF

Mengting Li, Xilong Cheng, Zhihao Xiao, Zhenhua Xu, Jingyuan Zhou

TL;DR: 论文提出 MemRole 框架，用于提升 LLM 角色扮演智能体在长叙事跨度下的角色一致性决策能力。它将“记忆到决策”过程显式化：通过长程记忆思考（LHMT）将推理分解为上下文理解、记忆激活和回应策略规划，并结合角色可知性约束的记忆池训练；进一步提出自反思的在线策略自蒸馏（SR-OPSD）优化模型。

Details

Motivation: 现有角色扮演智能体擅长模仿角色风格，但在长叙事中难以基于跨场景、部分甚至冲突的历史经验做出符合角色动机的决策；已有方法只注入记忆上下文，未显式推理过去事件如何影响当前动机与行为。

Result: MemRole-32B 在记忆驱动的角色扮演任务上较 backbone 提升 15.2 分，性能与 GPT-5.4 等前沿 LLM 相当，并在 CroSS-MR 上取得最佳角色动机识别准确率。

Insight: 创新点在于显式建模记忆到决策的推理链，并用时间线约束和角色可知性限制记忆池；同时提出基于数据驱动评分标准的自反思在线策略自蒸馏，让同一模型以带批评条件的教师视角提供 token 级指导。客观看，其可借鉴之处是将长程记忆选择、动机推理与策略规划结构化，并通过自蒸馏增强推理行为对齐。

Abstract: LLM-based role-playing agents are fluent at imitating a character’s style, yet struggle to make role-consistent decisions over long narrative horizons. Such decisions are shaped by experiences spanning many prior scenes, which are often partial and may point in different directions. Existing methods inject cross-scene memories as context, but do not reason about how past events shape a character’s current motivations and behavior. We propose MemRole, a framework that makes this memory-to-decision process explicit. It introduces Long-Horizon Memory Thinking (LHMT), a reasoning schema that decomposes hidden reasoning into context understanding, memory activation, and response strategy planning, trained on a novel-derived dataset whose character-grounded, timeline-constrained memory pools limit each character to what it could plausibly know at the current narrative point. Beyond supervised fine-tuning, we propose Self-Refining On-Policy Self-Distillation (SR-OPSD): the model critiques its own rollouts against the reference under a data-driven rubric, and a critique-conditioned teacher view of the same model distills token-level guidance back into the policy. MemRole-32B improves over its backbone by 15.2 points on memory-grounded role-playing, performs on par with frontier LLMs such as GPT-5.4, and achieves the best character-motivation recognition accuracy on CroSS-MR.

[26] Don’t Guess, Ask Wisely: Benchmarking and Training Proactive Elicitation in Open-Domain LLM Conversations cs.CLPDF

Rongyu Zhang, Mutian Bao, Jinjian Zhang, Yuetian Du, He Xu

TL;DR: 论文研究开放域LLM对话中用户查询不完整时的主动提问能力，指出现有模型很少追问；构建VagueBench基准，通过受控删除语言线索生成意图模糊/完全模糊查询并标注隐藏信息；提出离线强化学习方法DialogGRPO，将多轮提问建模为对话状态DAG并设计密集回合奖励；实验显示其显著提升缺失信息获取与答案覆盖，并能零样本泛化。

Details

Motivation: 当用户查询欠明确时，LLM应主动提出针对性问题而非直接猜测回答；但评估显示少于11%的欠明确查询会触发追问，因此需要基准和训练方法来评估并提升“何时问、问什么”的主动澄清能力。

Result: DialogGRPO在超过88%的模糊查询上成功获取缺失信息，在恢复效率和答案覆盖上显著提升，且不会对完整查询过度提问；性能优于提示和测试时扩展基线，并零样本泛化到MultiWOZ 2.4和AmbigQA。

Insight: 创新点在于VagueBench通过受控降级构造已知隐藏信息集，可同时评估追问时机和内容；DialogGRPO将多轮提问组织为对话状态DAG，并用组相对比较结合即时信息增益与前瞻价值的密集回合奖励，实现无需运行时模拟的细粒度信用分配。

Abstract: When user queries are incomplete, large language models should ask targeted questions before committing to an answer, a capability we call proactive elicitation, yet evaluation on real user-assistant queries across seven LLMs (8B to frontier) shows that fewer than 11% of underspecified queries trigger a follow-up question. To benchmark and train this capability, we introduce VagueBench, where each seed query is annotated with structured intent and detail units then degraded into intent-vague and fully-vague variants via controlled removal of linguistic cues, yielding known hidden information sets for evaluating both when and what to ask. We propose DialogGRPO, an offline reinforcement learning method that organizes multi-turn elicitation as a dialogue-state directed acyclic graph, where candidate questions at each node receive dense turn-level rewards combining immediate information gain with lookahead value through group-relative comparison, enabling fine-grained credit assignment without runtime simulation. DialogGRPO elicits missing information on over 88% of vague queries with substantial gains in both recovery efficiency and answer coverage, without over-asking on complete queries, outperforms prompting and test-time-scaling baselines, and generalizes zero-shot to MultiWOZ 2.4 and AmbigQA.

[27] TAC-CoT: Tool-Empowered Implicit Chain-of-Thought via Interleaving Explicit Tokens cs.CLPDF

Juseon Do, Sangmin Bae, Jeesu Jung, Hwanjun Song

TL;DR: 论文提出TAC-CoT，一种工具赋能的隐式思维链框架。它将显式推理轨迹替换为紧凑的潜在推理段，仅在工具调用、工具观察和最终答案处保留文本token，从而以交错方式支持LLM智能体的工具使用。该方法旨在兼顾隐式CoT的生成效率与智能体工具调用所需的显式通信接口。

Details

Motivation: 显式CoT在智能体系统中会产生较大的生成开销，而隐式CoT虽能以连续token压缩推理过程，却缺乏工具调用所需的显式通信接口，难以自然支持agentic tool-use。论文试图解决高效推理与工具交互接口之间的矛盾。

Result: 在agentic数学和问答基准上，TAC-CoT将准确率最高提升8.8个点，同时将模型前向传递次数最多减少6.8倍；分析还表明其在单工具和多工具设置下均提升了工具使用质量。

Insight: 核心创新在于将隐式潜推理段与显式文本token交错组织，仅在工具调用、观察和答案处使用文本，从而避免逐步口述中间推理。客观来看，其可取之处是把隐式CoT的效率优势嵌入智能体工具使用流程，并兼顾工具通信接口的可操作性。

Abstract: LLM-based agentic systems are increasingly combined with CoT reasoning to solve tasks that require accurate reasoning, external knowledge, and multi-step deliberation. Yet, explicit CoT incurs substantial generation overhead, while implicit CoT, which replaces textual rationales with compact continuous tokens, does not naturally support the explicit communication interface required for agentic tool-use. We propose TAC-CoT, a tool-empowered adaptive implicit CoT framework that replaces explicit reasoning traces with compact latent reasoning segments while retaining textual tokens only for tool calls, observations, and final answers. This interleaved design enables agentic tool-use without verbalizing every intermediate reasoning step. Experiments on agentic math and QA benchmarks show that TAC-CoT improves accuracy by up to 8.8 points while reducing model forward passes by up to 6.8x. Furthermore, analyses show that TAC-CoT improves tool-use quality in both single- and multi-tool settings.

[28] Better Answers, Weaker Evidence Control: Evidence Bypass in On-Policy Distillation cs.CL | cs.AIPDF

Ruoran Xu, Yilun Zhao, Ziyu Chen, Xiaoqiang kang, Arman Cohan

TL;DR: 论文研究在策略蒸馏（On-Policy Distillation, OPD）中的一个副作用：学生模型回答准确率提升，但对文档中支撑证据的响应能力反而下降。作者在科学文档问答任务中通过匹配文档干预（改变文档使其支持不同答案而保持问题不变）定义了“证据绕过”现象，即文档改变后学生仍保留原答案。作者据此提出证据配对的EP-OPD方法，在保持原文档准确率增益的同时显著恢复反事实准确率。

Details

Motivation: 现有OPD往往只关注答案准确率这一目标，作者想探究蒸馏是否损害了模型对证据的忠实响应能力，并解决“答案对了但不再看证据”这一隐患。

Result: 在QASPER上用Qwen3-4B学生模型，标准OPD使原文档准确率提升3.4个百分点、反事实准确率下降5.3个百分点、证据绕过上升15.7个百分点，PeerQA上呈相同趋势；EP-OPD在两个数据集和两种学生规模下恢复了标准OPD反事实准确率损失的54-66%，同时保留其原文档准确率增益的80-85%。

Insight: 论文的贡献在于揭示并量化了准确率与证据响应性之间的分离（证据绕过），提出将证据响应性作为独立的训练与评估目标，并通过证据配对监督加答案级margin的EP-OPD进行缓解；此外发现向教师显式提供答案关键span能带来最佳联合改善，这一分析视角对蒸馏训练设计有借鉴意义。

Abstract: On-policy distillation (OPD) can improve answer accuracy while weakening responsiveness to supporting evidence. We investigate this separation in scientific-document question answering through matched document interventions that change the supported answer while preserving the question and unrelated context. We identify evidence bypass: a student retains an originally correct answer after the document changes to support a different one. On QASPER with a Qwen3-4B student, standard OPD raises original-document accuracy by 3.4 percentage points, lowers counterfactual accuracy by 5.3 points, and increases bypass by 15.7 points; the same directional pattern appears on PeerQA. Controlled perturbations localize the shift to answer-critical evidence, and bypass grows with the student’s pre-distillation closed-book preference for the original answer. A factorized study of teacher targets, privileged information, divergence, and supervision density finds that explicitly supplying the teacher with annotated answer-critical spans yields the largest joint improvement in evidence response and claim support. These findings motivate Evidence-Paired OPD (EP-OPD), which combines on-policy supervision on matched documents supporting different answers to the same question with an answer-level margin that favors each document’s supported answer over its paired alternative. Across both datasets and two student sizes, EP-OPD recovers 54-66% of standard OPD’s counterfactual-accuracy loss while preserving 80-85% of its original-document accuracy gain. Our results establish evidence responsiveness as a distinct training and evaluation target alongside answer accuracy. Our code is publicly available at: https://github.com/RuoranXu/EP-OPD.

Linjuan Wu, Yiwen Qiu, Xinze Lyu, Dingming Li, Hui Yao

TL;DR: 论文提出检索增强的文化评估方法，用于训练社交媒体翻译模型 CUE-MT。该方法先用校准的领域特定 Judger 指导监督数据精炼，再通过 Agent 按需检索外部证据并蒸馏为简短提示，辅助硬样本挖掘和强化学习奖励分配。作者在 9B、27B、35B-A3B 三种骨干上验证 CUE-MT 在文化相关社交媒体翻译上的有效性。

Details

Motivation: 社交媒体翻译需要保留语义并处理用户生成内容中的文化细微差异，但基于 LLM 的评估器文化知识不足，会导致评估不准确和训练奖励不可靠。论文旨在提升评估信号质量，从而改进社交媒体翻译模型的训练。

Result: CUE-MT 在 CUE-MT-Bench 和三个公开基准上优于同规模开源基线；CUE-MT-Bench 人工评估显示文化有效性比各规模组最强外部基线提升 7.44-15.12 个百分点。检索使 Judger 的四分类准确率相比仅用 LLM 生成提示的无检索基线提升 8.07 个百分点，消融实验也支持硬样本挖掘与 Agent 增强奖励的组合。

Insight: 创新点在于将检索增强的文化评估器同时用于数据精炼、硬样本挖掘和强化学习奖励，通过领域特定 Judger 与可检索证据的 Agent 形成评估-训练闭环。可借鉴之处是把外部文化证据蒸馏为评估提示来提升奖励可靠性，并结合硬样本挖掘与强化学习优化翻译模型。

Abstract: Social media translation requires preserving meaning while capturing the cultural nuances of user-generated content (UGC). However, gaps in the cultural knowledge of LLM-based evaluators can lead to inaccurate assessments and unreliable training rewards. To improve these signals, we use retrieval-enhanced cultural evaluation to train CUE-MT, a family of social media translation models. A calibrated, domain-specific Judger guides supervised data refinement and is augmented by an Agent for hard-example mining and reinforcement learning. The Agent retrieves relevant external evidence as needed and distills it into concise hints that the Judger uses to score translations and assign rewards. Across 9B, 27B, and 35B-A3B backbones, CUE-MT outperforms the evaluated open-source baselines of comparable size on CUE-MT-Bench and three public benchmarks. Human evaluation on CUE-MT-Bench shows cultural effectiveness gains of 7.44-15.12 percentage points over the strongest external baseline in each size group. Retrieval improves the Judger’s four-way classification accuracy by 8.07 percentage points over a matched no-retrieval baseline that uses LLM-generated hints alone. Training ablations further support the combination of hard-example mining and Agent-enhanced rewards.

[30] MedPsy: State-of-the-Art Small Medical Language Models for Efficient Edge Deployment cs.CLPDF

Davide Vitabile, Alexandro Buffa, Akshay Nambiar, Amril Nazir

TL;DR: 论文提出 MedPsy 系列面向边缘部署的纯文本医疗语言模型（1.7B 和 4B），通过合成医疗数据、235B 医疗教师模型的思维链目标、四阶段后训练课程（两阶段 SFT 加两阶段 RL 与难样本挖掘），以及 GGUF 量化和真机评测，在精度、生成长度和部署效率之间取得平衡。

Details

Motivation: 强开源 LLM 过大，难以私有化边缘部署，而紧凑医疗模型在知识密集和真实医疗任务上仍明显落后；可部署的推理模型又常产生长推理链，增加解码延迟、能耗和 KV-cache 压力。论文旨在解决医疗小模型的准确性、生成效率与边缘部署效率之间的权衡。

Result: 在七个封闭式医疗基准上，MedPsy-4B 比 MedGemma-1.5-4B 高 19.34 分，并匹配 MedGemma-27B 且小 6.75 倍；MedPsy-1.7B 比 MedGemma-1.5-4B 高 11.42 分且不到其一半大小。HealthBench-Hard 上，MedPsy-4B 超 MedGemma-27B 15.33 分，1.7B 超 11.66 分且约小 16 倍；响应长度较 Qwen3 骨干分别降 1.7 倍和 3.2 倍，Q4_K_M 量化总分与 BF16 相差 1 分内且磁盘占用降约 69%，真机 4B 中位端到端延迟和估计能耗降 75%，峰值 RAM 低于 5GB。

Insight: 论文宣称的创新点包括面向边缘的小型医疗模型配方、医疗 CoT 蒸馏、四阶段 SFT/RL 后训练课程，以及覆盖量化和真机推理的部署评测。客观看，其创新更在于系统化协同设计数据、后训练与部署，通过缩短生成和量化实现医疗小模型精度与边缘效率的实用平衡。

Abstract: Medical language models promise expert clinical support, but the strongest open-source LLMs remain too large for private edge-device deployment, while compact medical models still trail substantially on knowledge-intensive and real-world healthcare tasks. Reasoning models that fit edge memory budgets can produce long reasoning traces, increasing sequential decoding, end-to-end latency, energy consumption, and KV-cache memory pressure. We present MedPsy, a family of text-only 1.7B and 4B medical language models designed for edge deployment, targeting this accuracy-generation-efficiency trade-off. Our recipe combines a synthetic medical data pipeline over biology, medicine, and health seeds with chain-of-thought targets from a 235B medical-focused LLM teacher; a four-stage post-training curriculum comprising two SFT stages followed by two RL stages with hard-sample mining; and an edge deployment evaluation spanning multiple GGUF quantization variants and real-device inference on laptop and smartphone hardware. On seven closed-ended medical benchmarks, MedPsy-4B surpasses MedGemma-1.5-4B by 19.34 points and matches MedGemma-27B while being 6.75x smaller; MedPsy-1.7B outperforms MedGemma-1.5-4B by 11.42 points despite being less than half its size. On HealthBench-Hard, MedPsy-4B surpasses MedGemma-27B by 15.33 points, while MedPsy-1.7B surpasses it by 11.66 points despite being ~16x smaller. Beyond accuracy, MedPsy reduces average response length by 1.7x (1.7B) and 3.2x (4B) versus its Qwen3 backbones, while Q4_K_M quantization preserves the aggregate score within 1 point of BF16 with ~69% lower disk footprint. In real-device inference, MedPsy-4B’s shorter generations translate into 75% lower median end-to-end latency and estimated energy per answer than its Qwen3 backbone at matched quantization, while peak RAM remains below 5 GB across our tested laptop and smartphone configurations.

Linjuan Wu, Dingming Li, Yiwen Qiu, Xinze Lyu, Ye Guo

TL;DR: 论文提出中英社交媒体评论情境化翻译基准 CULTURE-CMT，包含572个人工验证样例，按 Slang、Context、Both 组织，并恢复帖子与对话上下文用于诊断式评估。作者还提出检索增强的文化有效性 Judger，结合校准评分模型与动态检索文化知识，以支持可扩展评估。

Details

Motivation: 社交媒体评论本质上是互动，但现有翻译与评估常将其视为孤立文本，忽略 surrounding discussion、社区俚语和文化情境表达，导致意义判断偏差；因此需要一个情境化、可诊断且可扩展评估的基准。

Result: 实验发现提供互动上下文能改善多数模型配置，但不能消除文化无效翻译；同时需要上下文和文化情境语言的 Both 类样例显著更难。更大模型不一定更好，thinking 的收益高度依赖模型甚至可能退化；一个在 benchmark-disjoint 社媒数据上适配的27B模型在带上下文 thinking 推理下取得所评估配置中最低的 invalidity rate。

Insight: 创新点在于构建情境化社媒翻译诊断基准，将俚语、上下文及二者交互区分开，并提出检索增强文化有效性 Judger 支持规模化评估。客观来看，该工作强调现实社媒翻译不只是扩大模型或延长推理，而需要学习在动态在线互动中翻译被建构的意义。

Abstract: Social-media comments are interactions, yet they are often translated and evaluated as isolated text. This mismatch is especially problematic when meaning depends on surrounding discussion, community-specific slang, or culturally situated expressions. We introduce CULTURE-CMT, a Chinese-English benchmark for contextualized social-media comment translation that restores the post and conversational context naturally available to users. Its 572 manually verified examples are organized into Slang, Context, and Both, enabling diagnostic analysis of distinct and interacting sources of translation difficulty. To support scalable evaluation, we further develop a retrieval-augmented cultural-effectiveness Judger that combines a calibrated scoring model with dynamically retrieved cultural knowledge. CULTURE-CMT reveals several non-trivial patterns. Providing interaction context improves most model configurations, but does not eliminate culturally ineffective translations. Examples requiring both contextual grounding and culturally situated language remain substantially more difficult than either source of difficulty alone. Moreover, larger models are not consistently better, and thinking produces highly model-dependent gains, including occasional degradation. In contrast, a 27B model adapted on benchmark-disjoint social-media data achieves the lowest observed invalidity rate among the evaluated configurations under thinking inference with context. Together, these results suggest that realistic social-media translation is not simply a matter of scaling models or reasoning longer, but of learning to translate meaning as it is constructed within evolving online interactions.

[32] Consolidating Reasoning with Test-Time Training cs.CL | cs.AIPDF

Haotian Wu, Zeming Chen, Hao Zhao, Antoine Bosselut

TL;DR: 论文提出 TTT-Consolidate 框架，将多个智能体产生的推理轨迹作为测试时训练的自适应数据，通过双层优化元学习把轨迹固化到轻量 LoRA 参数中，再基于整合后的信息生成最终解。作者还构建了 OpenParallelThinking 语料库，并在数学与 STEM 基准上验证该方法显著优于现有推理聚合基线。

Details

Motivation: 多智能体协作若仅对最终答案投票，或把冗长噪声轨迹直接放入上下文，会浪费有价值的中间推理。论文旨在更有效地整合分布式推理轨迹，提升模型后续解题能力。

Result: 在具有挑战性的数学和 STEM 基准上，TTT-Consolidate 在计算与运行时间匹配的设置下，比最佳聚合基线最高提升 20 个百分点，且模型规模越大差距越明显；它还能更稳健地从失败轨迹中恢复，并兼容 SFT 与 RL 的外层目标。

Insight: 创新点在于将多智能体推理轨迹通过测试时训练整合为参数化表示，并用双层优化元学习“如何整合”，使整合过程直接服务于最终解答生成；同时构建了用于训练推理聚合方法的大规模平行推理轨迹语料库。

Abstract: Effective multi-agent collaboration requires finalizing solutions from reasoning that is distributed across the individual attempts of many agents. However, useful intermediate reasoning can remain unexploited when collaboration is limited to voting on conclusions reached among individual agents, or aggregating long, noisy collections of reasoning trajectories in context. In this work, we propose TTT-Consolidate, a framework that uses multi-agent reasoning trajectories as adaptation data to improve a model’s subsequent reasoning. TTT-Consolidate jointly consolidates trajectories into parametric representations through test-time training, then generates a new solution by conditioning on the consolidated information. We meta-learn how to consolidate using bi-level optimization at training time, where an inner loop encodes reasoning trajectories into a lightweight LoRA adapter, and an outer loop learns meta-parameters for the inner loop such that the consolidation is helpful for the model to synthesize a final solution. As no large-scale corpus of diverse reasoning trajectories exists for training aggregation methods, we construct the OpenParallelThinking corpus composed of 12,810 math problems paired with a mixture of trajectories from six LLMs. Evaluated on challenging math and STEM benchmarks, TTT-Consolidate outperforms the best aggregation baselines by up to 20 percentage points, even under matched compute and runtime settings, with the gap widening at larger model scales. TTT-Consolidate also recovers from unsuccessful individual trajectories more robustly, an ability that improves as the number of available (even incorrect) trajectories increases. Finally, we demonstrate that TTT-Consolidate benefits from both SFT and RL-based outer loop objectives. We will release TTT-Consolidate and OpenParallelThinking for use in future work on reasoning aggregation.

[33] FOLLIE: Automated Reasoning over the First Dataset of Sentences with their First-Order Logical Representation for French cs.CLPDF

Maximos Skandalis

TL;DR: 论文构建了FOLLIE，这是首个面向法语的、可用于自然语言推理的句子到一阶逻辑（NL-to-FOL）资源，包含19,983条推理记录和36,987个句子槽位-公式映射。作者通过神经-符号流水线生成银标注，并开发结合Prover9/Mace4和输入相关背景理论的自动推理引擎，在多个法语NLI数据集上评估蕴涵、矛盾与中性三分类。

Details

Motivation: 法语缺乏将句子组成性一阶逻辑表示与自动自然语言推理连接起来的NLI-ready资源，论文旨在为法语提供可实验、可推理的NL-to-FOL数据基础，并研究句子解释所需表示与假设如何支撑演绎推理。

Result: 在FraCaS-FR、GQNLI-FR和SICK-FR上三分类准确率分别为65.37%、70.33%和71.35%；在作出明确判定的样本中与参考标签一致率为93.53%、100.00%和98.66%，对应承诺覆盖率为41.49%、37.00%和15.05%。

Insight: 主要创新在于首个法语NLI-ready NL-to-FOL资源、结合形态句法分析/范畴多标签/语法证明搜索/话语表示与一阶语义构造的神经-符号构建流程，以及带输入相关背景理论和定理证明/模型检验的自动推理引擎；其客观价值在于把逻辑表示、背景知识和可解释证明分析统一到法语NLI实验框架中。

Abstract: FOLLIE (for First-Order Logic for Language Inference and Entailment for French) connects French sentences, compositional first-order representations and automated natural language inference (NLI). The first French NLI-ready, NL-to-FOL resource, it contains 19,983 inference records and 36,987 non-empty sentence-slot–formula mappings from six heterogeneous NLI sources, retaining French lexical material and source problem structure. Its silver annotations are produced by a neural–symbolic pipeline, with 111 separately identified LLM-assisted additions. The construction combines morphosyntactic analysis, probability-conditioned categorial multitagging, grammatical proof search, discourse representation and first-order semantic construction. Stage-wise experiments show substantial gains in derivation coverage; analyses of conjunction distributions, logical-operator incidence and scope alternation characterise the resulting resource. We then develop an automatic inference engine whose input-conditioned background theories address lexical relations, quantification, quantities, event structure and temporal dependencies. Prover9 supplies proofs for entailment and contradiction, while Mace4 supports bounded consistency checks. Three-way accuracies are 65.37% on all 335 FraCaS-FR problems, 70.33% on 300 GQNLI-FR problems and 71.35% on 9,399 eligible SICK-FR records pooled across splits. Agreement with reference labels among committed decisions is 93.53%, 100.00% and 98.66%, at commitment coverage of 41.49%, 37.00% and 15.05%, respectively. Worked constructions, axiom schemas and proof analyses explain these outcomes and identify the contributions of scope, reference, lexical knowledge and numerical structure. FOLLIE provides a French experimental basis for studying the representations and assumptions that connect sentence interpretation to deductive inference.

[34] Can AI Reviewers See Your Efforts to Improve Your Paper? A Large-Scale Study of Paper Revision Trajectories cs.CLPDF

Yaochen Wang, Chenguang Wang, Ming Li, Haomin Zhuang, Xinyue Zeng

TL;DR: 论文探究AI审稿人能否识别作者在修改中做出的实质改进。作者使用PaperTrajectory-2026数据集（涵盖5个AI会议、6959条论文修改轨迹、14个维度的自动标注），并让8个AI审稿人独立评估不同版本。结果发现：多数重大改进并未使评分变化，不同审稿人对评分变化方向的一致性很弱，修改维度与分数的关联因审稿人而异且预测力有限；即使某次修改获得更高评分，一条简短的负面用户意见也能抹除甚至反转这一优势。

Details

Motivation: AI审稿人正被日益广泛地用于评估科学稿件，但其评分是否能反映作者通过修改所做的改进仍不清楚，论文旨在系统检验这一问题。

Result: 在PaperTrajectory-2026（6959条轨迹、5个AI会议）上，8个AI审稿人对大多数重大改进保持分数不变，评分变化方向一致性弱；修改维度与分数提升的关联具有审稿人特异性、预测区分度有限且无跨审稿人一致规律；负面用户意见可抹除或反转改进带来的评分优势。

Insight: 创新点在于构建带14维修改标注的大规模论文修改轨迹数据集，并系统揭示AI审稿评分与稿件实质证据脱节、易受用户意见framing影响的脆弱性，为设计证据驱动、抗干扰且稳定的评审评估机制提供依据。

Abstract: AI reviewers are increasingly used to assess scientific manuscripts, yet it remains unclear whether their judgments reflect the improvements authors make through revision. We investigate this question using PaperTrajectory-2026, the 2026 release of PaperTrajectory, a dataset of 6,959 paper trajectories across five AI conferences, with automatic annotations of changes along 14 dimensions and separate judgments of overall quality. The annotations show that major improvements emphasize empirical evidence and framing, while later revisions tend toward incremental improvement. Using independent assessments of manuscript versions from eight AI reviewers, we examine whether annotated major improvements receive higher scores, which revision dimensions are associated with score changes, and whether user opinions can outweigh observed revision gains. Every reviewer leaves scores unchanged on most major improvements, and agreement on the direction of score changes is weak. Revision dimensions show some reviewer-specific associations with score increases, but provide limited predictive discrimination and no consistent guide across reviewers. Even when a revision earns a higher neutral score, a brief negative user opinion can erase or reverse that advantage, with substantial variation across reviewers. These findings show that substantive revisions are not consistently reflected in review scores and that observed scoring gains can be vulnerable to user framing, motivating assessments that connect manuscript evidence to overall judgments and remain stable when no scientific evidence changes.

[35] MemShift: Separating Detection from Repair in LLM-Derived Personal Memory cs.CL | cs.AI | cs.LGPDF

Zichuan Xu, Haochen Zhang, Yuyang Dong, Makoto Onizuka, Chuan Xiao

TL;DR: 论文提出 MemShift，一个用于评估 LLM 推导的个人记忆是否正确的基准，将记忆更新拆分为“检测变化”和“修复值”两步。它设计五种变化（源修订、删除、重定义、写作者切换、导出），并通过分支合成世界、预先固定金标准值和确定性评分器，分别衡量记忆是否发现变化以及修复是否正确。作者还构建参考记忆验证度量，并评估四个开放权重 LLM。

Details

Motivation: 现有基准只评最终答案，无法判断失败发生在检测还是修复阶段，且通常把变化直接表述为新文本，掩盖了真实记忆更新中的检测难题。论文希望分离检测与修复，以更细粒度诊断 LLM 个人记忆系统的能力。

Result: 在四个开放权重 LLM 上的评估发现，检测的收益受修复能力限制：LLM 按个人定义正确重新推导出的值很少；而让 LLM 针对带类型记录编写程序，可弥合与精确重计算之间的大部分差距。论文未报告传统 benchmark 上的 SOTA 数值。

Insight: 主要创新在于将 LLM 个人记忆的正确性拆成检测与修复两个可分别评估的维度，并用仅在某类 shift 上不同的合成分支提供可控诊断。确定性评分器和带已知检测/修复的参考记忆增强了度量可信度；用 LLM 生成程序操作带类型记录来修复记忆也是值得借鉴的思路。

Abstract: AI assistants store values that a language model derived from a person’s records under the person’s own definitions, such as their important contacts. Keeping such a value correct takes two steps: detection, noticing that an input changed, and repair, producing the correct new value. Benchmarks that score only the final answer cannot tell which step failed, and they state every change as new text. Seeing this limitation, we present MemShift, a benchmark of five shifts: source revision, deletion, redefinition, writer switch, and export. The first three fork a synthetic world into branches that differ only in the shift. Gold values and dependencies are fixed before any text, and a deterministic scorer replaces an LLM judge. For a memory that reports its invalidations, MemShift shows for each changed item whether the memory noticed the change and whether its repair was right. Moreover, we build a reference memory with known detection and repair to validate the measure. By evaluating four open-weight LLMs, we find that detection helps only as much as repair allows: the LLMs re-derive few values computed by the person’s definitions correctly, and programs that the LLM writes over typed records close most of the gap to exact recomputation. Code and data are available at https://github.com/zichuanxu/memshift.

[36] Solver-Like Behavior in Large Language Models as Formalizers cs.CL | cs.AIPDF

Rikhil Amonkar, Stuti Mohan, Kevin Nguyen, Ceyhun Efe Kayan, Ronan Le Bras

TL;DR: 论文研究LLM作为形式化器时，在生成形式程序前的长推理轨迹中普遍出现“求解器式行为”：模型自行枚举、测试和排除取值，甚至得到完整答案，导致后续程序重复求解。作者定义该行为的分类体系，并用经人工标签校验的LLM裁判在3个推理模型、4个约束满足数据集及声明式/命令式形式语言上的2000条生成中进行标注。

Details

Motivation: 现有LLM-as-formalizer范式只按程序输出评估形式化器，忽略了推理轨迹可能已经代替求解器完成搜索这一问题；论文希望揭示这种冗余/错误继承现象，并主张评估应关注程序是如何被得到的。

Result: SLB出现在85%的轨迹中并占24%的推理token，但程序通常重新计算答案；9%的程序继承轨迹答案并继承其错误。SLB数量与准确率无关，且在命令式Python中比声明式Z3/PDDL更常见；警示提示仅降低约四分之一，而将问题数值隐藏在运行时占位符中可消除97%的SLB且不损失准确率。

Insight: 创新点在于提出并量化“求解器式行为”，建立覆盖轨迹、程序和输出的本体及标注流程；客观上有助于揭示LLM形式化器评估漏洞，并提供运行时隐藏数值这一简单有效的抑制干预。

Abstract: In the LLM-as-formalizer paradigm, a large language model translates a problem into a formal program and leaves the search to a solver, gaining the solver’s guarantees. Formalizers are now often reasoning models that write a long reasoning trace before the program, yet they are judged only by the program’s output. We find that the trace routinely does the solver’s job, assigning, testing and ruling out values until it often reaches the full answer; we call this solver-like behavior (SLB). We define an ontology of SLB over the trace, the program and its output, and use LLM judges, checked against human labels, to label 2,000 generations from three reasoning models on four constraint satisfaction datasets, each formalized in a declarative and an imperative formal language. SLB appears in 85% of traces and takes 24% of reasoning tokens, yet the program usually recomputes the answer, so the effort is redundant. The 9% of programs that inherit the trace’s answer also inherit its errors, and pass output-based evaluation whenever that answer is correct. The amount of SLB is not associated with accuracy, and SLB is more common in imperative Python than in declarative Z3 or PDDL. Cautionary prompts reduce it by only a quarter, but hiding the problem’s values behind placeholders, which the program receives only at run time, removes 97% of it without loss of accuracy. Formalizers should therefore be evaluated by how their programs are reached, not only by what they output.

[37] As Expected? Efficient LLM Planning via Expectation-Observation Consistency Verification cs.CLPDF

Qingfu Zhu, Huanyang Zheng, Ting Liu, Wanxiang Che

TL;DR: 论文提出一种面向LLM规划中批处理执行器的期望-观测一致性验证机制EOCV。该方法让模型在执行动作时生成对动作结果的期望，并与实际观测比较：一致则继续批量执行，不一致则提前终止并从当前观测重新规划。实验表明该方法在保持与反应式执行器相近任务表现的同时显著降低token消耗。

Details

Motivation: 现有LLM规划常依赖ReAct等反应式执行器，每步只生成一个动作以贴合最新观测，但推理成本高；批处理执行器虽能一次预测多个动作以降低成本，却因忽略中间观测而容易产生复合错误。论文旨在兼顾 grounding 与效率。

Result: 在文本和多模态基准、多个骨干模型上的实验显示，EOCV与反应式执行器的平均任务性能大体相当，同时平均加权token使用量降低29-35%；该方法与模型无关，集成到先进规划器后仍有效。

Insight: 创新点在于为批处理执行器引入期望-观测一致性验证，通过预生成动作结果期望并与真实观测比对来决定继续执行或提前终止重规划，从而在批量执行中恢复对中间观测的 grounding；其价值在于模型无关、可插拔，并可平衡效率与可靠性。

Abstract: LLM planning often relies on reactive executors (e.g., ReAct) that generate a single action at each step to remain grounded in the latest observations, incurring substantial inference cost. Batched executors reduce this cost by predicting multiple actions in a single model invocation, yet they are prone to compounding errors, as intermediate observations are ignored. We propose an expectation-observation consistency verification (EOCV) mechanism for batched executors, preserving grounding while improving efficiency. The mechanism generates expectations of action outcomes and compares them with the resulting observations. Consistency permits continued execution, whereas mismatches trigger early termination and replanning from the current observation. Experiments on text-based and multimodal benchmarks across multiple backbones show broadly comparable average task performance between EOCV and reactive executors, with a 29-35% reduction in average weighted token usage. Moreover, the mechanism is model-agnostic and remains effective when integrated into state-of-the-art planners.

[38] FindLink: Learning to Assess Scientific Connections from Source-Grounded Premises cs.CLPDF

Jingxuan Wei, Song Tan, Xiaohan Liu, Chao Sang, Changwei Wang

TL;DR: 论文面向文献驱动的科学发现，提出GI-TraceBench基准和FindLink两阶段框架，用于评估不同研究条件下发现之间的科学联系。FindLink先构建带研究背景与支持状态的源绑定前提，再通过结构化推理形成支持计划并生成证据条件答案。实验表明，显式评估前提之间支持何种联系对科学推理至关重要。

Details

Motivation: 单个发现可追溯并不等于能判断多个发现共同支持什么结论；论文旨在解决基于来源前提的科学联系评估与假设判断问题。

Result: 在1,545题固定证据测试集上，FindLink将balanced family macro score从同骨干直接监督微调的67.95提升到87.25；去掉Structured Reasoning的变体虽略高premise-identifier F1，但关系与证据充分性F1显著下降。

Insight: 创新点在于构建统一Paper、Claim、Evidence Span记录的GI-TraceBench，并用显式支持计划和未解决条件组织源绑定前提；其核心洞见是科学推理不仅需识别有根据前提，还需评估这些前提支持的联系，而编译器仅校验结构与来源绑定一致性，不评估科学蕴涵。

Abstract: Scientific discovery from the literature requires assessing connections among findings obtained under different study conditions. Source attribution makes individual findings traceable, but does not determine what they jointly support. We introduce GI-TraceBench, a benchmark of 10,282 questions in gastrointestinal oncology that unifies provenance question answering, knowledge discovery, and hypothesis evaluation through shared Paper, Claim, and Evidence Span records. We further propose FindLink, a two-stage framework for provenance-grounded scientific reasoning. Premise Grounding constructs source-bound premises with explicit study context and support status. Structured Reasoning organizes these premises into support plans that represent both supported relations and unresolved conditions, then generates evidence-conditioned answers using deterministic compiler feedback. The compiler verifies structural and source-binding consistency, but does not assess scientific entailment. On the 1,545-question fixed-evidence test set, FindLink improves the balanced family macro score from 67.95 to 87.25 over direct supervised fine-tuning of the same backbone. A retrained variant without Structured Reasoning achieves slightly higher premise-identifier F1, but substantially lower relation and evidence-sufficiency F1. These results indicate that scientific reasoning requires not only identifying grounded premises, but also assessing what connections those premises support.

[39] Re$^3$Rank: Listwise Reranking with Reasoning-Conditioned Retrieval Heads cs.CLPDF

Ruiyi Yan, Zhuoyuan Mao, Yugo Murawaki, Yiwen Guo

TL;DR: 论文提出 Re$^3$Rank，一种基于推理条件检索头（RRHeads）的 listwise 重排序器。它先由生成器针对问题和候选文档生成推理轨迹，再用轨迹 token 作为少量选定检索头的注意力查询，输出候选的相关性连续分数；并通过直通估计器将排序损失传过离散轨迹，实现生成器与打分器联合训练。

Details

Motivation: 现有基于注意力的重排序器把问题作为固定查询，利用检索头分配给候选的注意力质量打分，但固定问题所携带的信息有限，不利于定位相关证据。

Result: 在 9 个基准上平均超过 11 个基线重排序器：4B 变体平均比最强基线高 3.11 个 NDCG@10 点，0.6B 变体也能超过参数量最高达 32B 的重排序器。

Insight: 创新点在于用推理轨迹替代固定问题作为检索头的注意力查询，并选定 RRHeads 读取相关性；同时用直通估计器让排序损失穿过离散推理轨迹，联合优化生成器与打分器。

Abstract: Attention-based rerankers score each candidate by the attention mass that retrieval heads route to it from the question, but the question, serving as a fixed query, carries limited information for locating relevant evidence. We propose Re$^3$Rank, a listwise reranker built on reasoning-conditioned retrieval heads (RRHeads). A generator first writes a reasoning trace over the question and the candidates, and a scorer then uses the trace tokens as the attention query of a few selected RRHeads, reading relevance as continuous scores. We present a straight-through estimator to propagate the ranking loss through the discrete trace, so that the generator and the scorer can be trained jointly for ranking. Averaged over 9 benchmarks, Re$^3$Rank outperforms 11 baseline rerankers: our 4B variant exceeds the strongest baseline by 3.11 NDCG@10 points on average, and even our 0.6B variant surpasses rerankers with up to 32B parameters.

[40] ICJ-Graph: A Citation Graph and a Layered Document Corpus of the International Court of Justice cs.CLPDF

Jirameth Wannasiwaporn, Pawitsapak Akarajaradwong, Chompakorn Chaksangchaichot

TL;DR: 论文构建了ICJ-Graph，一个面向国际法院（ICJ）的机器可读引用图与分层文档语料库，将ICJ判决、书面诉状和口头记录与引用案例、法律条款及联合国决议相连接。资源包含6,396份ICJ文档、505份其他法院/法律机构文档、12,375条法律条款和20,291条联合国决议，并提供文本、元数据和嵌入以及加载图与生成嵌入的流水线。论文还在199个判决的引用预测任务上评估了五个模型。

Details

Motivation: 现有ICJ文档缺乏机器可读的结构化关联，难以支持法律检索与引用研究；论文旨在保留法院推理与当事方提交材料区别的同时，构建可复用的引用图和分层法律语料资源。

Result: 在199个判决的引用预测评估中，面向引用研究的工具使五个模型在案例、条款和决议引用上的F1均优于不使用工具的问答方式。

Insight: 创新点在于将ICJ文档按判决、书面诉状、口头记录分层组织，并与案例、法律条款和联合国决议建立引用图，同时提供文本、元数据、嵌入及可复用流水线，兼顾法律语义区分与检索系统应用。

Abstract: We present ICJ-Graph, a machine-readable resource connecting documents of the International Court of Justice (ICJ) to cited cases, legal provisions and United Nations resolutions. Court decisions, written pleadings and oral records form distinct document layers, preserving the distinction between the Court’s reasoning and the parties’ submissions. The collection contains 6,396 ICJ documents and 505 documents from other courts and legal bodies, together with 12,375 provisions and 20,291 UN resolutions. The data files contain text, metadata and embeddings. The accompanying pipeline lets users load the graph and generate embeddings for use in their own retrieval systems. To illustrate the resource’s use, we evaluate five models on citation prediction for 199 decisions using documents available before each decision. Tools designed for citation research improve citation-prediction F1 over answering without tools for all five models across case, provision and resolution citations.

[41] MicroMouse: Masking Harmful Supervision in Long CoT via Relative Potential cs.CLPDF

Xiaowei Zhu, Hengzhu Tang, Zhenyu Zhang, Shuohuan Wang, Yubing Ren

TL;DR: 论文提出 MicroMouse，一种用于长思维链监督微调的选择性 SFT 框架，可自动识别并屏蔽长 CoT 中的有害监督信号。该方法将长 CoT 视为从问题到答案的搜索轨迹，引入相对潜力（REP）衡量每个推理状态对标准答案的支持程度，并跟踪 REP 轨迹识别错误探索和冗余徘徊，在 SFT 中屏蔽对应片段。

Details

Motivation: 即使成功的长 CoT 也可能包含有害监督，直接全量 SFT 会学习错误或冗余推理；论文希望自动识别并屏蔽这些信号，提升长 CoT 监督微调的效果与效率。

Result: 在多种学生模型规模和推理基准上，MicroMouse 一致优于 Full-CoT SFT 和现有选择性 SFT 基线；相对 Full-CoT SFT 平均获得 5.5% 的贪心准确率相对提升和 2.6% 的 Pass@1 相对提升，同时平均输出长度减少 8.8%，每条长 CoT 的有害监督识别平均仅需 1.7 秒。

Insight: 创新点在于借鉴 MicroMouse 迷宫搜索，将长 CoT 建模为带目标相对度量的搜索轨迹；REP 通过对比标准答案与匹配干扰答案，抵消二者共享的似然波动，得到更稳定的进展信号。客观看，其可借鉴之处是跟踪 REP 轨迹来判别连续下降的错误探索和峰值后的冗余徘徊，并据此进行选择性监督屏蔽。

Abstract: Even successful long CoTs may contain harmful supervision, motivating the need for methods that can automatically identify and mask such signals during SFT. Inspired by the MicroMouse maze-solving process, we view a long CoT as a search trajectory from the input problem toward the target answer. This perspective motivates maintaining a goal-relative measure, analogous to a MicroMouse’s spatial coordinates, to quantify how close the current reasoning state is to the target answer. Building on this perspective, we propose MicroMouse, an automated selective-SFT framework for masking harmful supervision in long CoTs. In MicroMouse we introduce a Relative Potential (REP) to measure how closely each reasoning state supports the gold answer. Unlike the perplexity of the gold answer alone, REP measures relative support by contrasting the gold answer with a matched foil. This contrast cancels likelihood variations shared by the pair, yielding a more stable signal of progress toward the target answer. By tracking the REP trajectory, MicroMouse identifies consecutive potential decreases as erroneous exploration and post-peak reasoning as redundant wandering, and masks these harmful supervision during SFT. Extensive experiments across multiple student model scales and reasoning benchmarks show that MicroMouse consistently outperforms Full-CoT SFT and existing selective-SFT baselines, yielding average relative gains of 5.5% in greedy accuracy and 2.6% in Pass@1 relative to Full-CoT SFT. Meanwhile, MicroMouse improves reasoning efficiency by reducing average output length by 8.8%, while identifying harmful supervision in only 1.7 seconds per long CoT on average.

[42] EffComp: Efficient Prompt Compression via Hybrid Reinforcement & Supervised Learning cs.CLPDF

Romtham Tungsununtham, Piyawat Lertvittayakumjorn, Atiwong Suchato, Peerapon Vateekul

TL;DR: 论文提出EffComp，一种面向RAG问答的高效提示压缩框架。它使用BERT式文档重排序器和句子选择器在句子级进行快速抽取式压缩，并通过混合强化学习与监督学习训练，以在保持LLM问答准确率的同时提高压缩率。实验表明其在多个QA数据集上优于现有提示压缩方法，实现压缩率与准确率的最佳权衡且延迟最小。

Details

Motivation: 现有提示压缩方法存在压缩增益有限、可能引入幻觉以及压缩延迟高等问题，难以兼顾效率与可靠性。论文旨在为RAG问答场景提供低延迟、无幻觉且高压缩率的提示压缩方案。

Result: 在多个问答数据集上的实验表明，EffComp优于当前最先进的提示压缩方法，在压缩率与准确率之间取得最佳权衡，并具有最小延迟。

Insight: 创新点包括：采用BERT式重排序器与句子选择器实现句子级抽取式压缩，从机制上避免压缩提示中的幻觉；设计混合强化学习与监督学习训练目标，在优化压缩率的同时保持LLM准确率。客观来看，将抽取式压缩与混合训练结合以平衡压缩效率、可靠性和下游任务性能，是值得借鉴的思路。

Abstract: Prompt compression is aimed at reducing input prompt lengths to enable cheaper, faster, and potentially higher-quality LLM predictions. However, existing prompt compression methods are often limited by modest compression gains, a risk of hallucination, and/or high compression latency. We propose EffComp, an Efficient prompt Compression framework for RAG-based question answering (QA). EffComp employs BERT-style document reranker and sentence selector models to allow fast extractive prompt compression at the sentence level. Its extractive nature prevents hallucinations in the compressed prompts. Additionally, the training process using a hybrid reinforcement and supervised learning approach is designed to optimize the compression ratio while preserving LLM accuracy. Experiments on various QA datasets demonstrate that EffComp outperforms state-of-the-art prompt compression methods achieving the best trade-off between compression ratio and accuracy with minimal latency. This makes it practical for real-world applications.

[43] PGuard: A Native, Streaming, and Plug-in Guardrail for Multimodal Large Language Models cs.CLPDF

Junyu Lin, Mengjie Wu, Yonghao Dong, Yuchuan Fu, Jinfeng Li

TL;DR: 论文提出 PGuard，一种面向多模态大语言模型的原生、流式、插件式安全护栏。它直接利用骨干模型的中间层表示进行 token 级安全检测，在不改变原推理路径和生成行为的情况下，实现预填充和自回归解码过程中的实时安全监控。PGuard 支持动态层门控、轻量无状态与序列感知等多种表示建模结构，并针对 SGLang 等 LLM 服务框架优化执行开销。

Details

Motivation: 流式生成已成为纯文本和多模态大模型的主流服务范式，生成全过程的安全保障十分关键。现有外部安全护栏会引入服务依赖、额外开销和集成复杂度，因此论文希望将安全监控从外部依赖转变为骨干模型的原生集成能力。

Result: 在由 SGLang 服务的千亿参数骨干 Qwen3.5-122B-A10B 上，PGuard 仅带来 0.82%-2.26% 的端到端额外开销。论文在 30 多个覆盖文本与多模态安全、越狱、网络与 CBRN 风险、多语言和真实流量的基准上评估，取得原生护栏中的 SOTA；在 Qwen3.5-9B 的文本查询上平均 F1 为 0.836，接近专用外部护栏，并支持部署时配置类别阈值和执行动作。

Insight: 创新点在于将安全检测内嵌到骨干模型推理过程中，利用残差流中间表示和动态层门控进行 token 级流式检测，同时保持原生成路径不变。论文还设计了轻量无状态和基于多尺度因果 EMA-attention、GRU 的序列感知变体，并考虑 LLM 服务框架的执行特性以降低运行时和同步开销，体现了原生集成、流式检测与服务系统协同优化的思路。

Abstract: As streaming generation becomes the dominant serving paradigm for both text-only and multimodal large language models, ensuring safety throughout the generation process has become a critical challenge. We introduce PGuard, a native, streaming, and plug-in guardrail that transforms safety monitoring from an external serving dependency into an integrated capability of the backbone model. PGuard directly leverages the backbone’s intermediate representations for token-level safety detection, without altering its original inference pathway or generation behavior. Specifically, dynamic layer gating selectively aggregates residual-stream representations across layers to extract safety-relevant signals during both prefill and autoregressive decoding. To balance detection accuracy and computational efficiency, PGuard supports multiple representation-modeling architectures, including a lightweight stateless variant and sequence-aware variants built on multi-scale causal EMA-attention and GRU-based recurrent modules. Its design also accounts for the execution characteristics of LLM serving frameworks, such as SGLang, optimizing computation and data access to minimize additional runtime and synchronization overhead. As a result, PGuard incurs only 0.82-2.26% end-to-end overhead on the hundred-billion-parameter backbone Qwen3.5-122B-A10B served by SGLang. Extensive evaluations across more than 30 benchmarks spanning text and multimodal safety, jailbreaks, cyber and CBRN risks, multilingual scenarios, and real-world traffic demonstrate state-of-the-art performance among native guardrails. On text queries with Qwen3.5-9B, PGuard achieves an average F1 score of 0.836, approaching dedicated external guardrails, while supporting deployment-time configuration of category-specific thresholds and enforcement actions.

[44] Omni-Life: Benchmarking Omnimodal Real-Time AI Assistants in People’s Daily Lives cs.CLPDF

Mengze Hong, Ziwei Shang, Di Liang, Zijian Li, Liang Zhu

TL;DR: 论文提出 Omni-Life，一个面向日常生活实时全模态 AI 助手的基准，基于真实用户需求、部署场景和设备相关观察，结合受控合成视频与标注真实视频，并采用统一时间协议。基准包含 400 个视频，其中 290 个需要帮助、含 555 个必要干预事件，110 个全程应保持沉默。论文评估 12 种主流实时全模态模型配置，联合考察事件覆盖、响应内容、响应时机和不必要输出，并分析任务提醒与响应延迟容忍等部署策略。

Details

Motivation: 现有实时全模态助手仅具备视听理解并不足以保证能在真实生活中及时、恰当地提供帮助。论文旨在系统评估模型能否在需要时主动干预、在不需要时保持沉默，从而反映实际部署中的可靠性。

Result: 在 Omni-Life 上评估 12 种配置后，最多仅 4.48% 的需要帮助视频被完全正确处理。任务提醒可提升召回 17.12 个百分点，但每分钟参考沉默会增加约 4.6 次不必要响应；将延迟容忍增加 10 秒最多提升召回 5.95 个百分点，表明现有模型仍不足以提供可靠日常帮助。

Insight: 论文的创新点在于构建面向真实生活部署的实时全模态助手基准，结合合成危险/边缘案例与真实视频，并用统一时间协议同时评估事件覆盖、响应内容、时机及沉默抑制能力。其可借鉴之处是将“及时主动干预”和“无需帮助时抑制响应”纳入统一评测，并进一步分析提醒与延迟容忍等实际部署策略的影响。

Abstract: Real-time omnimodal assistants are expected to support people in everyday life, but audiovisual understanding alone does not establish whether they can provide timely and appropriate help. We introduce Omni-Life, a benchmark grounded in real-world user needs, deployment scenarios, and device-dependent observations. It combines controlled video synthesis for hazardous situations and edge cases with annotated real-world videos under a shared temporal protocol. The benchmark contains 400 videos: 290 requiring assistance, with 555 required intervention events, and 110 requiring silence throughout to test whether models can withhold unnecessary responses when no assistance is needed. We evaluate twelve configurations featuring mainstream real-time omnimodal models, jointly assessing event coverage, response content, timing, and unwanted output. At most 4.48% of videos requiring assistance are handled completely correctly. To examine practical deployment strategies, we study task reminders and response-latency tolerance. Reminders can improve recall by 17.12 percentage points but add approximately 4.6 unwanted responses per minute of reference silence. Increasing latency tolerance by 10s improves recall by at most 5.95 percentage points. These results show that existing models remain insufficient to deliver reliable assistance in real-life applications, calling for tailored model optimization in instruction following, timely proactive intervention, and withholding responses when assistance is not needed.

[45] Maswao: An automatically collected, prepared, and benchmarked dataset for the South African Sign language cs.CL | cs.AIPDF

Thapelo Sindane, Unarine Netshifhefhe, Vukosi Marivate, Abiodun Modupe, Herkulaas Combrink

TL;DR: 论文针对南非手语（SASL）等低资源手语缺乏大规模数据的问题，提出一个低人工干预的自动数据集收集与准备框架：从新闻广播等公共资源收集SASL视频，利用ASR将音频转为文本，裁剪手语区域，并通过梯度下降定位非运动谷以切分长视频，构建弱句子对齐平行语料Maswao。随后在Sign-to-text翻译任务上使用RNN和Transformer进行基准评测。

Details

Motivation: 当前手语处理进展主要惠及美、英、德等少数手语，全球200多种手语中多数仍缺乏数据和算法支持。论文旨在通过自动化流程降低数据集构建成本，缓解低资源手语的技术不平等。

Result: 在Maswao弱对齐数据集上的Sign-to-text翻译实验中，Transformer模型优于循环神经网络基线；最佳Transformer取得BLEU-1至BLEU-4分别为13.78、5.21、2.52、1.54，ChrF=18.09，ROUGE-L=10.51，表明任务可行但仍需进一步研究。

Insight: 创新点在于以SASL为测试平台，将公共视频采集、ASR文本生成、手语区域裁剪和非运动谷切分结合，实现低人工的弱句子对齐语料构建并建立翻译基准。客观来看，其价值主要在于低资源手语数据自动化流水线和弱对齐基准设计，而非翻译性能本身达到很高水平。

Abstract: Recent advancements in sign language processing can be attributed to developments in both large-scale dataset collection and algorithmic complexity in areas such as pose estimation techniques, signal processing through Transformer models, and model optimization. However, only a handful of sign languages, such as the American, British, and German, from over 200 globally recognized sign languages, reap the benefits of such advancements, while the rest lag behind. In this study, we aim to address this technological disparity by proposing a framework for the automatic collection and preparation of sign language datasets, with very minimal human-labour intervention, using the South African Sign Language (SASL) as a testbed. Specifically, we automatically collect SASL video content using public resources such as news broadcasts. Additionally, we convert their accompanying audio streams into text using available Automatic Speech Recognition (ASR) tools. Furthermore, we crop the sign language area in the videos and use gradient descent to locate valleys of non-motion to determine end-of-sentence points within long videos to create our weakly sentence-aligned parallel corpora – the Maswao (Signs) dataset. Finally, we benchmark the weakly aligned dataset on the task of Sign-to-text Translation using Recurrent Neural Networks and Transformer models to compare their individual intricacies. Our results show that Transformer models proposed in the literature outperform recurrent baselines, with the best-performing Transformer achieving BLEU-1 to BLEU-4 scores of 13.78, 5.21, 2.52, and 1.54, respectively, as well as ChrF = 18.09 and ROUGE-L = 10.51. These results indicate that the task remains promising and warrants further investigations.

[46] A State Change Is Local, Its Consequences Are Not: Dependency-Aware State Revision for Long-Term Agent Memory cs.CLPDF

Yiqi Wang, Tongyuan Zhao, Jiaqi Zhang, Yiqun Duan, Zhangkai Wu

TL;DR: 论文研究长期智能体记忆在外部事实变化时的一致性问题，提出“依赖感知状态修正”：不仅更新被矛盾的事实，还识别并撤销失去支撑的派生信念、计划和动作。方法 StateGraph 从交互历史构建状态依赖图，并用反事实验证区分“支撑依赖”与“语义相关”，仅当严格依赖失败且无独立支撑路径时使依赖状态失效。作者还构建 StateChangeBench，并在其上及公开长期记忆基准上评估。

Details

Motivation: 现有记忆系统往往只修正直接矛盾项，忽略由上游事实派生的信念、计划和动作仍被接受，导致记忆失去依据却不一致；因此需要判断变化影响的依赖状态范围。

Result: 在自建 StateChangeBench 上，Impact-F1 比 CUPMem 重实现高 6.9 个百分点（深度1）和 26.0 个百分点（深度3+）；在公开长期记忆基准上，多数数据集的点估计与基线相当或更高。

Insight: 创新在于把状态修正扩展为依赖传播问题，用从交互历史恢复的演化依赖图和反事实验证实现选择性失效；客观看，将“语义相关”与“真实支撑依赖”分离，并以独立支撑路径作为保守撤销条件，是较有借鉴价值的设计。

Abstract: Long-lived agents rely on persistent memory of users, tasks and decisions, and this memory must stay consistent with a world that keeps changing. When an upstream fact changes, however, memory systems can revise the contradicted memory itself while the beliefs, plans and actions derived from it remain accepted, even though they have lost their support. We therefore formulate dependency-aware state revision, which asks not only what changed but also which dependent states should no longer be trusted. To address it, StateGraph maintains an evolving state dependency graph whose edges are recovered from interaction histories. Its core design is counterfactual verification: each candidate edge is tested by asking whether the dependent state would survive the loss of its premise, which separates support dependence from semantic relatedness, and revision then invalidates a dependent state only when a strict dependency fails and no independent support path survives. To test this design, we introduce StateChangeBench, a controlled benchmark of 50 author-constructed cases annotated with cascade depth, hard negatives and action consequences. On it, StateGraph’s Impact-F1 margin over a CUPMem reimplementation is 6.9 percentage points at depth 1 and 26.0 at depth 3+. On public long-term memory benchmarks, its point estimates are comparable to or higher than those of the evaluated baselines on most datasets. These results provide initial evidence that explicit dependency tracking can improve selective memory revision under changing conditions.

[47] Distilling Literary Sentiment from LLM Annotations into an Ordinal BERT Model cs.CLPDF

Artem Suslov, Takehiro Hashimoto

TL;DR: 论文研究能否用大语言模型生成的标注来监督小型模型进行文学情感分析。作者用Gemma 4 31B为10,889个文学句子打十分制情感标签，并以序数回归微调五个BERT模型，在海明威《老人与海》的1,923个人工标注句子上评估。结果显示小型BERT可接近教师模型，并在非中性句上超过教师，同时揭示整体MAE在大量中性数据上的评估局限。

Details

Motivation: 文学领域人工标注情感语料稀缺，限制了领域专用情感分析模型的发展；论文希望验证LLM生成标注能否作为低成本监督信号，蒸馏到更小的BERT模型中。

Result: BERT-large取得Kendall τ=0.589，接近教师模型Gemma 4 31B的0.604；在非中性句上BERT-base的MAE为0.726，优于教师的1.116。但恒定中性预测器取得最低整体MAE，说明该数据集以中性句为主时整体误差指标存在局限。

Insight: 创新点在于将LLM生成的十分制情感标注用于小型BERT的序数回归训练，并在文学文本人工标注集上系统评估蒸馏效果；同时指出需区分中性/非中性样本并使用更细粒度指标，避免聚合MAE掩盖模型真实能力。

Abstract: The scarcity of human-annotated literary corpora limits the development of domain-specific sentiment analysis models. This study investigates whether LLM-generated annotations can supervise smaller models for literary sentiment analysis. We fine-tune five BERT models using ordinal regression on 10,889 literary sentences annotated by Gemma 4 31B on a ten-point sentiment scale. The models are evaluated against 1,923 human-annotated sentences from Hemingway’s “The Old Man and the Sea”, alongside the teacher model and conventional baselines. BERT-large achieves a Kendall’s $τ$ of 0.589, approaching the teacher’s 0.604. Although a constant-neutral predictor achieves the lowest overall mean absolute error (MAE), BERT-base outperforms the teacher on non-neutral sentences, achieving an MAE of 0.726 versus 1.116. These findings demonstrate the potential of LLM-generated supervision for developing smaller literary sentiment models, while highlighting the limitations of aggregate error metrics on predominantly neutral datasets.

[48] VERS: Steering Reasoning Models by Editing Their Activation Explanations cs.CL | cs.LGPDF

Ihor Vitenko

TL;DR: 论文提出VERS框架，利用自然语言自编码器对推理模型激活进行文本解释与重建，并将推理轨迹中“怀疑点”处的解释编辑转化为一个固定方向，在段落断点处注入以引导模型推理。方法在GSM8K和MATH-500上显著减少生成token，但会带来一定准确率下降，并可迁移到更大Qwen3模型；在竞赛题上准确率损失更明显，且固定方向难以区分必要与冗余检查。

Details

Motivation: 推理语言模型在回答前会生成思维链，其中许多检查并不改变最终答案，造成冗余计算。论文关注能否通过编辑激活解释来引导模型推理过程，从而减少不必要推理步骤。

Result: 在完整GSM8K测试集上，VERS减少45.8%生成token，准确率变化-0.82个百分点；MATH-500上节省31.3% token，准确率变化-3.05个百分点。半强度下其token与准确率权衡介于SEAL和DEER之间；经仿射映射和强度调优后可迁移到更大Qwen3模型（至235B-A22B），节省30-35% token；但在竞赛题上各模型规模均损失3-7个百分点，固定方向未能区分必要检查与不必要检查。

Insight: 创新点在于将单token的激活解释编辑推广到推理过程控制，并把多个怀疑点的解释编辑聚合成固定方向，在段落边界施加以压缩推理长度。客观来看，该工作展示了激活解释可用于推理引导和token节省，但也暴露了固定方向在复杂问题上区分必要/冗余推理的局限与准确率权衡。

Abstract: Reasoning language models write a chain of thought before they answer, and many checks in it do not change the final answer. Natural language autoencoders (NLAs) explain a model’s activations in text and rebuild activations from text, and editing an explanation can steer a model at a single token. We study whether such edits can also steer how a model reasons. We build VERS (Verbalize, Edit, Reconstruct, Steer): it turns explanation edits at the doubt points of one reasoning trace into one fixed direction, and adds this direction at paragraph breaks. On the full GSM8K test, VERS cuts generated tokens by 45.8% at an accuracy change of -0.82 percentage points (pp); on MATH-500 it saves 31.3% at -3.05 pp. At half strength, its trade-off between tokens and accuracy lies between those of the published methods SEAL and DEER. With fitted affine maps and a strength tuned for each model, the direction transfers to larger Qwen3 models, up to 235B-A22B, and saves 30-35% of tokens. On competition problems, however, VERS loses 3-7 pp at every model size, and a fixed direction did not separate necessary checks from unneeded ones.

[49] Meet Students Where They Are: Student-Prefix Teacher Adaptation for On-Policy Distillation cs.CLPDF

Xue Zhang, Songming Zhang, Yunlong Liang, Fandong Meng, Yufeng Chen

TL;DR: 论文关注在线策略蒸馏（OPD）中教师模型在学生生成前缀上的分布不匹配问题，提出学生前缀教师适配（SPTA）：先用随机长度的学生 rollout 前缀和RLVR持续训练教师，使其能从学生诱导的错误或陌生推理状态中恢复，再将适配后的教师用于标准OPD。实验表明该方法在数学推理基准上提升了学生平均表现。

Details

Motivation: 标准OPD虽能缓解学生曝光偏差，但学生生成的前缀可能含推理错误或不符合教师熟悉模式，导致教师逐token监督不可靠，且前缀越长问题越严重。论文旨在解决蒸馏过程中教师侧的状态分布不匹配。

Result: 在数学推理基准上，SPTA相比标准OPD以及使用任务级RLVR适配教师的OPD，均提升了学生平均性能；摘要未给出具体数值。

Insight: 创新点在于不修改蒸馏目标，而是在OPD前将教师适配到学生实际访问的前缀状态，并用RLVR奖励最终答案正确性来训练教师“恢复”而非模仿学生推理。客观看，其可取之处是把教师适配问题从独立解题能力转向蒸馏查询分布，强调教师需在学生真实状态上提供可靠指导。

Abstract: On-policy distillation (OPD) mitigates the student’s exposure bias by optimizing on student-generated trajectories. However, student-generated prefixes may contain reasoning errors or follow patterns unfamiliar to the teacher, undermining the reliability of its token-level supervision. This degradation becomes more pronounced as prefixes grow longer. To address this teacher-side distribution mismatch, we propose Student-Prefix Teacher Adaptation (SPTA), which adapts the teacher to the states on which it is queried during distillation. Specifically, before OPD starts, we collect student rollout prefixes with random lengths and continually train the teacher to continue from the prefixes using reinforcement learning with verifiable rewards (RLVR). By treating each prefix as context and rewarding correct final answers, the teacher learns to recover from student-induced states rather than imitate the student’s reasoning. Then, the adapted teacher is used for standard OPD, with no changes to the distillation objective. Experiments on mathematical reasoning benchmarks show that our SPTA improves average student performance over standard OPD and OPD with task-level RLVR-adapted teachers. These results highlight the importance of adapting teachers not only to solve problems independently, but also to provide reliable guidance on the states their students actually visit.

[50] ACTOR: Action-Centered Temporal Organization for Literary Role-Playing Agents cs.CLPDF

Yuxiang Gao, Tianjie Ju, Zheng Wu, Zongru Wu, Hao Fei

TL;DR: 论文提出 ACTOR，一个从原始小说文本自动构建文学角色非对话行为轨迹的框架。它抽取对话与角色相关的非对话行为，用 Thought-Action-Observation 结构表示行为，并按故事内部时间顺序组织轨迹；同时构建含反事实行为对的数据集，并用 Regularized Preference Optimization（RPO）训练模型，以提升角色一致行为推断能力。

Details

Motivation: 现有文学角色扮演智能体主要围绕对话生成建模，忽视角色的非对话行为及其在故事时间中的动态演变，导致模型难以根据历史行为和角色状态推断符合人设的后续行动。

Result: 论文从 143 部文学作品中构建行为数据集，并在 17,560 个四选一“下一行为选择”评测实例上验证；基于 ACTOR 偏好对训练的模型在准确率上取得显著提升，表明结构化、时间组织化的监督能增强模型利用角色档案和先前行为推断后续行动的能力。

Insight: 创新点在于将角色行为轨迹显式建模为 Thought-Action-Observation 结构并按故事内在时序组织，同时生成上下文合理但不符合角色人设的反事实行为对，并提出 RPO 在 DPO 基础上加入源行为负对数似然损失，联合优化行为偏好与生成。

Abstract: Large language agents for literary role-playing are typically modeled around dialogue generation, leaving characters’ non-dialogue behaviors and their dynamic evolution over story time underrepresented. In this paper, we propose ACTOR (Action-Centered Temporal Organization for Literary Role-Playing Agents), an automated framework for constructing such behavior trajectories from raw novel texts. ACTOR extracts dialogue and persona-relevant non-dialogue behaviors, represents each behavior using a Thought-Action-Observation structure, and organizes behavior trajectories according to the internal temporal order of the story. We build a behavior dataset from 143 diverse literary works. For each source behavior, we generate counterfactual behaviors that are contextually plausible yet inconsistent with the character’s persona. We find that existing models struggle to reliably infer character-consistent actions from historical behaviors and evolving character states. Using these behavior pairs, we train models with Regularized Preference Optimization (RPO), which augments DPO with a negative log-likelihood loss on the source behavior to jointly optimize behavior preference and generation. We further design a four-way next-behavior selection task to evaluate the model’s ability to faithfully mimic character actions. Across 17,560 evaluation instances, the model trained on ACTOR’s preference pairs achieves substantially improved accuracy. This result demonstrates that structured, temporally organized supervision enables models to leverage character profiles and prior behaviors to infer subsequent actions, greatly advancing literary role-playing beyond mere dialogue imitation. Code and data are available at https://github.com/SilentStar233/ACTOR.

[51] MultiInpaintCOCO: Fine-Grained Visual Understanding in Multiple Languages cs.CLPDF

Andrei-Alexandru Manea, Jindřich Libovický, Philipp J. Rösch

TL;DR: 论文将聚焦细粒度视觉细节的英文数据集 InpaintCOCO 扩展为覆盖 5 个语系、13 种类型学多样语言的多语言基准 MultiInpaintCOCO，包含 953 个最小对比样例。作者评测了多语言多模态检索中的轻量 VL CLIP 类编码器和大型语言模型，发现低资源语言性能显著下降，且模型在跨语言检索中普遍偏向英文。

Details

Motivation: 现有视觉语言模型难以理解细粒度图像细节，且英文能力不足会在多语言场景中被放大；因此需要一个多语言细粒度视觉理解基准来系统评估模型的跨语言表现和偏差。

Result: 在 MultiInpaintCOCO 上，低资源语言性能明显下降，语言可用数据资源比与英语的类型学相似性更能预测性能；跨语言检索中多数模型系统性偏好英文，Gemma 3 英文偏好最强，Qwen 3 偏差最小，但二者多语言单语准确率相近。

Insight: 创新点在于构建多语言细粒度最小对比基准，并同时评测 CLIP 类编码器与 LLM 的多语言多模态检索能力；其价值在于揭示资源量而非语言相似性是主要影响因素，并量化了跨语言检索中的英文偏好及架构差异。

Abstract: Previous research shows that vision-language (VL) models struggle to understand fine-grained image details and tend to focus on the overall layout. Moreover, any weakness in English tends to be further amplified in the multilingual setting. To study that, we extend InpaintCOCO, an English dataset focused on fine-grained visual details, to 13 typologically diverse languages across five language families, creating MultiInpaintCOCO - a new multilingual benchmark of 953 minimal-pair examples. We further test several state-of-the-art models in multilingual multimodal retrieval, considering both light VL CLIP-like encoders and large language models. Our results show that performance degrades substantially for lower-resource languages, with the strongest predictor being the data resources available for the languages rather than typological similarity to English. In cross-lingual retrieval, most models exhibit a systematic bias toward English: when given a correct caption in a non-English language and an incorrect one in English, models preferentially select the English caption. This bias varies considerably across architectures. Among the tested models, Gemma 3 shows the strongest English preference while Qwen 3 is the least biased, despite both reaching similar monolingual accuracy across languages. The code is available at https://github.com/ufal/multi-inpaint-coco.

[52] Tracing the Scientific Discovery Capacity of LLMs to Their Training Data cs.CL | cs.AIPDF

Arda Uzunoglu, Mahler Revsine, Michael Schatz, Benjamin Van Durme, Mehrdad Farajtabar

TL;DR: 论文研究LLM科学发现能力如何追溯到训练数据，提出以“缺失概率质量”为视角的理论解释，认为训练集中只出现一次的“monofact”决定发现能力。作者在材料科学和监管基因组学中直接操纵训练集的monofact比例，发现更多monofact能稳定带来更多科学发现，并验证该关系跨模型家族、采样策略和推理预算成立。

Details

Motivation: 论文关注LLM可靠科学发现能力究竟由训练数据中的什么因素支撑，试图回答如何将科学发现能力追溯到训练数据，并解决发现能力来源缺乏可解释刻画的问题。

Result: 在材料科学和监管基因组学中，提高训练集monofact比例会一致增加发现数量，结果跨两个开放权重模型家族、采样策略和推理预算成立；该关系不能仅由训练集多样性解释，并可在搭配域内数据时跨科学领域迁移。

Insight: 论文提出monofact（训练中仅出现一次的事实）和缺失概率质量视角，将LLM科学发现能力与训练数据中的monofact率直接关联；创新在于通过直接操纵训练数据验证该因素，并排除多样性单一解释，提供数据层面的可解释发现能力指标。

Abstract: Large language models (LLMs) show growing promise for scientific discovery, yet basic questions remain about what enables reliable discovery. How can we trace the scientific discovery capacity of LLMs to their training data? We study this question as one of missing probability mass and develop a theoretical account in which monofacts-the facts observed once during training-set the discovery capacity. In materials science and regulatory genomics, we directly manipulate monofact rates in training sets and find that more monofacts consistently yield more discoveries across two open-weight model families, sampling strategies, and reasoning budgets. Further experiments show the relationship cannot be explained by training-set diversity alone and can transfer across scientific domains when paired with in-domain data. Together, our results identify monofact rate in training data as a key factor governing discoveries in language models.

cs.CV [Back]

[53] Beyond the Last Layer: Global Inter-Layer Aggregation for AI-Generated Image Detection cs.CV | cs.AIPDF

Wenbin Shen, Zhichao Lian

TL;DR: 论文提出Global Inter-Layer Aggregation（GILA）用于AI生成图像检测。该方法从冻结预训练视觉编码器的不同深度提取全局表示，通过层间自注意力建模各层表示交互，并自适应聚合上下文表示，从而更充分地利用多层信息。

Details

Motivation: 现有基于预训练视觉编码器的AI生成图像检测方法主要依赖最后一层全局表示，可能忽略中间层有用信息；同时检测器还面临生成器快速更新、数据分布变化和跨数据集泛化有限等挑战。

Result: 论文在三种不同预训练目标的视觉backbone、十个已见生成器和三个外部数据集上评估GILA；结果表明其更好利用预训练编码器多层信息，并提升检测性能和跨数据集泛化能力，摘要未给出具体数值。

Insight: 创新点在于提出跨层全局表示聚合框架，利用层间自注意力建模不同深度表示交互并自适应聚合，且不绑定单一预训练目标、无需微调预训练编码器；客观看，其价值在于将多层全局特征融合系统化用于AI生成图像检测并强调免微调与跨数据集泛化。

Abstract: The rapid development of generative models has made AI-generated images increasingly close to real images. It has also brought several challenges to detectors, including rapid generator updates, large changes in data distribution, and limited cross-dataset generalization. Many existing methods based on pretrained vision encoders primarily use the global representation from the last layer, potentially leaving useful information from intermediate layers underexplored. To address this issue, we propose Global Inter-Layer Aggregation (GILA). GILA extracts global representations from different depths of a frozen encoder, models interactions among layer representations through inter-layer self-attention, and adaptively aggregates the resulting contextualized representations. The method is not tied to a single pretraining objective and does not require fine-tuning the pretrained encoder. We evaluated GILA on three vision backbones with different pretraining objectives, ten seen generators, and three external datasets. The experimental results show that GILA makes better use of multi-layer information in pretrained encoders and improves detection performance and cross-dataset generalization.

[54] Intervenable Concept Dynamics for Video Activity Forecasting cs.CV | cs.AIPDF

Patrick Knab, David Steinmann, Giovanni De Felice, Felix Divo, Udo Schlegel

TL;DR: 论文将概念瓶颈模型扩展到视频活动预测，提出TRACE-CBM，用稀疏时空图细化观测概念激活，并递归预测未来概念状态，再以共享活动分类器解码观测与预测状态。模型在推理时支持编辑概念值、活动激活和学习边而无需参数更新，从而暴露可干预的时空关系依赖。

Details

Motivation: 现有概念瓶颈模型只将概念 grounding 在已观测输入上，不能建模对象、动作及交互变化下概念激活的未来演化，因此难以用于视频活动预测。

Result: 在多个数据集上，TRACE 的观测活动 Top-1 准确率较基于概念的方法提升1.2-8.5个百分点，H3预测 Top-1 与匹配黑盒预测器差距在1.9-2.2个百分点内。干预实验中，概念节点编辑可纠正25.6-34.4%的初始错误H3预测且不翻转初始正确预测，概念引导最高在90.0%情况下达到目标活动。

Insight: 创新点在于将可检查、可编辑的概念瓶颈状态扩展到时间维度，用稀疏时空图和递归概念状态预测建模活动演化，并通过共享分类器统一解码观测与预测状态。客观看，其可借鉴之处是推理阶段无需参数更新即可干预概念、活动激活和关系边，为可解释视频预测提供了可操控的接口。

Abstract: Concept bottleneck models route predictions through human-understandable concepts, making their intermediate states inspectable and editable. Extending this model family to forecasting requires modeling how concept activations evolve over time as objects, actions, and their interactions change, yet existing CBMs ground concepts only in observed inputs and do not forecast their future evolution. We study this problem using videos of ongoing activities and forecast future activities through a named-concept state. We propose TRACE-CBM (Temporal Relational Activity Concept Evolution), which first refines observed concept activations with sparse spatio-temporal graphs. It then recursively predicts future concept states, conditioning each transition on the prior activity distribution, and decodes both observed and predicted states with a shared activity classifier. At inference time, the model supports editing concept values, activity activations, and learned edges without parameter updates, exposing the relational spatio-temporal dependencies used for forecasting. Across multiple datasets, TRACE improves observed-activity Top-1 accuracy over concept-based methods by 1.2-8.5 percentage points and attains H3 forecast Top-1 accuracy within 1.9-2.2 points of matched black-box forecasters. Intervention experiments show concept-node edits correct 25.6-34.4% of initially incorrect H3 forecasts without flipping initially correct ones, and concept steering achieves the requested target activity in up to 90.0% of cases.

[55] FORCE: Factorized Object Relations for Counterfactual Editing in Video World Models cs.CVPDF

Suraj K. Sood, Yugyung Lee

TL;DR: 论文提出 FORCE，一种面向视频世界模型的反事实编辑方法：它通过无监督方式从原始视频中推断物体两两之间的交互关系，并为每个物体对学习一个显式的隐变量表示，使该关系可被直接删除、替换、迁移或新增。模型用 slot attention 在冻结的自监督特征上提取物体，关系编码器从短时间窗口推断物体对的隐变量，再由交互头将其转化为力；隐变量在视频推演过程中保持固定，因此编辑会持续生效，而不会被重新计算。

Details

Motivation: 世界模型能预测场景演化，却难以被“审问”：给定一个可预测视频的模型，用户无法方便地询问“若两个物体间的某个交互不同，结果会怎样”。现有方法通常需要把编辑映射到模拟器参数，FORCE 希望直接在模型自身的量上实现无监督的反事实关系编辑。

Result: 在可获知编辑真实结果的仿真环境中，用基于效果的分数衡量编辑引发的模型变化与模拟器在同一操作下产生变化的一致性：在留出片段上，从视频做编辑的一致度为 0.19–0.37；若改用精确物体位置训练与评分，同一架构可达 0.57–0.85。差距表明瓶颈在于感知精度，而不在学到的关系动力学。

Insight: 创新在于将成对交互显式分解为每个物体对的隐变量，并在推演中保持固定，使编辑持久有效且无需映射到模拟器参数；同时通过视频与精确位置两种设定的对照，定量定位出当前物体中心感知的定位精度是反事实视频世界模型的现实瓶颈，为后续研究给出明确目标。

Abstract: World models predict how scenes evolve, but they are difficult to interrogate: given a model that forecasts a video, one cannot easily ask what would have happened had a particular interaction between two objects been different. We present Factorized Object Relations for Counterfactual Editing (FORCE), a world model that infers pairwise interactions from raw video without supervision and represents each as an explicit latent per object pair, so that a relation can be removed, changed, transferred or introduced directly. Objects are extracted by slot attention over frozen self-supervised features; a relation encoder infers each pair latent from a short observation window, and an interaction head turns it into a force. The latent is held fixed across the rollout, so an edit persists rather than being recomputed, and every edit acts on the model’s own quantities with no mapping to simulator parameters. We evaluate in a simulated environment where the true outcome of an edit is available, scoring the change each edit induces against the change the simulator produces under the same operation. On held-out clips, FORCE’s edits made from video agree with the simulator’s response at 0.19 to 0.37 on our effect-based score; trained and scored on exact object positions instead, the same architecture reaches 0.57 to 0.85. The gap therefore lies not in the learned relational dynamics but in perception: what bounds an edit is how precisely objects can be located from video, and the precision editing needs lies just beyond what current object-centric perception delivers. Closing that gap is a concrete target for making counterfactual world models work from video.

[56] Covariance-aware Scoring: A Geometric Correction for Vision-Language Test-Time Adaptation cs.CV | cs.LGPDF

Lakpa Tamang, Saman Forouzandeh, Kamal Berahmand, Wei Shao, Hamid Beigy

TL;DR: 论文关注CLIP等视觉-语言模型在无标签、无源数据条件下的测试时自适应（TTA）。作者指出现有方法通常在环境嵌入空间中以余弦相似度对测试特征和类代表进行评分，但在各向异性特征分布下，评分会被高方差但未必判别性强的方向主导。为此提出CARe，用目标特征二阶矩诱导的Mahalanobis几何替代环境几何进行协方差感知评分。理论表明在共享协方差高斯模型下，该决策方向与Bayes最优线性判别方向一致，且收益随特征各向异性增强。实验显示CARe在标准和细粒度分布偏移benchmark上、两个backbone下均优于基础余弦评分，且各向异性越强提升越明显。

Details

Motivation: 现有视觉-语言TTA方法多依赖特征缓存、原型估计或在线特征统计，但最终仍常在环境嵌入空间用余弦相似度评分。论文指出该共享决策规则在各向异性特征分布下存在局限：高方差方向可能主导评分，而这些方向不一定具有判别性。

Result: 实验表明，CARe在标准和细粒度分布偏移benchmark上、两个backbone下均比基础余弦评分获得更高的自适应准确率；与理论分析一致，特征各向异性越强的数据集上提升越大，特征接近各向同性时提升消失。摘要未给出具体数值或SOTA声明。

Insight: 论文的创新点在于将TTA评分从环境欧氏几何推广到由目标特征二阶矩诱导的Mahalanobis几何，提出协方差感知评分；理论上证明其在共享协方差高斯模型下与Bayes最优线性判别方向一致，并将环境空间评分视为各向同性特例，同时揭示收益随特征各向异性增强的规律。

Abstract: Test-time adaptation (TTA) enables vision–language models such as CLIP to adapt to distribution shifts without labels or access to source data. Existing methods adapt through feature caching, prototype estimation, or the online accumulation of feature statistics, but most ultimately score a test feature against a class representative in the ambient embedding space, typically through cosine similarity. We identify this shared decision rule as a limitation under anisotropic feature distributions, which means when a small number of directions account for a large fraction of feature variance, the score can be dominated by high-variance directions that are not necessarily discriminative. In light of this, we propose CARe, a covariance-aware scoring for TTA that replaces the ambient geometry with a Mahalanobis geometry induced by the target feature second moment. Theoretically, we show that under a shared-covariance Gaussian model the covariance-aware decision direction coincides with that of the Bayes-optimal linear discriminant, with ambient-space scoring as the isotropic special case, and establish that the potential benefit of covariance-aware scoring grows with feature anisotropy. Empirically, we show that CARe improves adaptation accuracy over its base cosine scoring on both standard and fine-grained distribution-shift benchmarks across two backbones. Consistent with our analysis, the gains are largest on datasets whose features are most anisotropic and vanish as the features approach isotropy.

[57] The Margin Knows the Background: Uneven Abstention in Frozen Vision-Language Models cs.CVPDF

Satwik Sai Prakash Sahoo, Bibhor Puhan, Shubhankar Mahanta

TL;DR: 论文研究冻结视觉语言模型（如 CLIP、LAION CLIP、SigLIP）在选择性预测中出现的群体不公平弃权问题，将 margin、最大 logit 等置信分数表示为最高两类 logit 的平均值与差值，并分析哪一部分携带群体信息。实验在 Waterbirds 和 NICO++ 上表明，分数选择对覆盖差异的影响依赖数据集：margin 在 Waterbirds 上造成更大覆盖差距，而最大 logit 在 NICO++ 上提高最差上下文错误。作者主张结合随机基线同时评估群体覆盖与选择性风险。

Details

Motivation: 单一置信阈值可能在选择性预测中不成比例地拒绝某些群体样本，论文关注冻结视觉语言模型中置信分数如何导致这种弃权不平衡，并试图解释不同分数在不同数据集上效果不一致的原因。

Result: 在 Waterbirds 上，80% 覆盖率下 margin 的覆盖差距是最大 logit 的 2.5 到 5.5 倍，且群体信号来自差值分量；在 NICO++ 上，最大 logit 使最差上下文错误增加 5.4 到 6.6 个百分点，对 OpenAI CLIP 未优于随机 margin 基线。覆盖差距与分数将群体沿排名下推的程度相关性（Spearman 0.88、0.92）高于群体可识别性（0.61、0.65）。

Insight: 创新在于把常用置信分数统一分解为最高两类 logit 的均值与差值，并用随机 margin 基线、配对背景交换和排名下推程度分析群体信号来源；客观启发是评估选择性预测时应同时看群体覆盖和选择性风险，并与随机基线比较，而非只看单一数据集上的弃权均匀性。

Abstract: Selective prediction allows a model to abstain on uncertain inputs, but a single confidence threshold can disproportionately reject examples from particular groups. We study how confidence scores produce this imbalance in frozen vision-language models (OpenAI CLIP, LAION CLIP, SigLIP). We express a family of scores, including the margin and maximum logit, through the average and the difference of the two highest class logits, and ask which carries group information. We show that equal group coverage at every threshold is equivalent to independence between the score and group membership. A randomized margin baseline tests whether a reduction in coverage disparity beats what adding noise achieves. With score choices fixed before testing, the effect of choice depends on the dataset. On Waterbirds, the margin creates coverage gaps 2.5 to 5.5 times larger than maximum logit at 80% coverage, its group signal is in the difference component, and paired background swaps show the background moves it, although maximum logit increases overall error. On NICO++, maximum logit instead increases worst-context error by 5.4 to 6.6 points and offers no improvement over the randomized baseline for OpenAI CLIP. Across both datasets, how far a score pushes a group down its ranking tracks the coverage gap (Spearman 0.88, 0.92) better than plain group identifiability (0.61, 0.65). These results explain why a score that abstains more evenly on one dataset may be less effective on another and motivate judging group coverage and selective risk together against randomized baselines.

[58] A Systematic Analysis of Live Intraoperative Surgical Expert Narrations cs.CV | cs.CLPDF

Arda Mamur, Matthias Seibold, Christoph Laux, Florian Wanivenhaus, Philipp Fürnstahl

TL;DR: 论文系统分析了手术医生现场术中叙述作为手术视频理解的无标注监督信号。作者处理13例内镜腰椎减压手术共13.2小时德语近场音频，构建语音识别、术语纠错、话语融合、LLM翻译和相关性过滤流水线，将3171条话语转换为带时间戳的手术线索并标注实体与言语行为。结果显示约37.9%话语为有效手术线索，富含器械、解剖和动作信息，但存在噪声和时间偏移。

Details

Motivation: 手术视频理解依赖人工标注，构成主要瓶颈；现场叙述无需人工标注、可扩展，但其包含的信息内容和可用性尚未被系统表征。

Result: 在13例、13.2小时数据中，1201/3171（37.9%）话语被保留为手术线索，98.5%至少涉及器械、解剖或动作之一；39%为指令，467个器械请求均先于器械入镜，中位提前8.2秒；但18.0%保留线索受领域术语转录损坏影响。

Insight: 创新在于系统刻画现场手术叙述作为密集、无标注、多实体和团队协调监督信号的价值，并揭示其噪声及时间位移问题；客观看，其提出的无标注流水线与实体/言语行为标注框架为利用术中语音提供了可借鉴范式，但下游安全使用需显式建模时间偏移。

Abstract: Manual annotation remains the principal bottleneck in surgical video understanding. Live intraoperative narration by the operating surgeon is a scalable alternative that requires no manual annotation, but the information it contains has not been characterized. We analyzed 13 endoscopic lumbar spine decompression procedures (13.2 h) by two senior spine surgeons, using time-synchronized close-mic German audio. An annotation-free pipeline (word-level speech recognition, deterministic correction of surgical-term errors, utterance fusion, LLM-based translation to English, and relevance filtering) converted speech into time-stamped procedural cues labelled with the surgical entities they reference and their speech act. Of 3,171 utterances, 1,201 (37.9%) were retained as procedural cues, while 57.6% were non-procedural and removed. Retained cues referenced instruments (60.7%), anatomy (48.0%) and surgical actions (57.1%), and 98.5% carried at least one of these. 39% of cues (472 of 1,201) were directives, mainly instrument requests and commands. All 467 manually verified instrument requests preceded the instrument’s appearance in the field, by a median of 8.2 s. Domain-term transcription corruption affected 18.0% of retained cues. Live narration is thus a dense, annotation-free supervisory signal describing instruments, anatomy, actions and team coordination, but it is noisy and temporally displaced from the events it names, and this displacement must be modelled before safe downstream use.

[59] DiA: Directional Adapter cs.CVPDF

Ashish Kumar Singh, Prakash Chandra Chhipa

TL;DR: 论文提出 Directional Adapter（DiA），一种构建在 CLIP 之上的参数高效适配器，用于细粒度视频动作识别。DiA 将时序建模拆分为因果与反因果两个方向，分别建模过去到当前、未来到当前的线索，并通过可学习融合结合二者。方法仅使用视频单模态输入，在七个公开基准上取得单视频模态方法中的 SOTA，同时具有较高推理吞吐和较低延迟。

Details

Motivation: 细粒度动作识别不仅依赖外观，还依赖动作在时间上的展开过程；视觉相似类别可能在准备、执行或完成阶段不同，统一聚合时序上下文并非最优。论文希望在可调参数少、计算高效且仅使用易获取视频模态的条件下提升识别性能。

Result: DiA 在七个公开基准上取得单视频输入模态方法中的 state-of-the-art 性能，仅有约 3.6M 可调参数，并相比先前方法具有更高吞吐量和更低推理延迟。

Insight: 创新点在于将时序特化显式分解为因果和反因果方向，使过去到当前与未来到当前的线索以不同方式建模；同时通过紧凑瓶颈空间中的深度可分离时序卷积和可学习融合，实现参数与计算高效的方向性时序适配。客观来看，其可借鉴之处是将方向性时序建模引入 CLIP 适配器，并在单模态约束下兼顾性能、参数量和推理效率。

Abstract: Fine-grained action recognition often depends on how an action unfolds over time rather than on appearance alone. Visually similar classes may differ in preparation, execution, or completion phases, making uniformly aggregated temporal context suboptimal. We study this problem under a practical objective: i) improving recognition performance with few tunable parameters, ii) being compute efficient, and iii) using only the readily available video modality. Motivated by this missing temporal observation and the accuracy–compute efficiency–unimodality objective, we propose Directional Adapter (DiA), a parameter-efficient adapter on top of CLIP. DiA formulates temporal specialization into causal and anti-causal directions, allowing past-to-present and future-to-present cues to be modeled differently. To keep this directional modeling parameter- and compute-efficient, both directions use depth-wise temporal convolutions in a compact bottleneck space and are combined through a learnable fusion. DiA achieves state-of-the-art performance among methods using a single video input modality across seven public benchmarks, with only $\sim$3.6M tunable parameters, while also delivering higher throughput and lower inference latency than prior methods. Code is available at https://github.com/prakashchhipa/DiA-Directional-Adapter.

[60] Monocular Badminton Speed Estimation with Air Drag and Court Geometry cs.CV | cs.MMPDF

Diwen Huang, Sarvesh Madullapalli, Ishan Pendyala, Oliver Chen, Kevin Li

TL;DR: 论文提出了一种仅用单目智能手机视频估计羽毛球飞行速度的方法：先利用球场线完成相机标定，再对观测到的球位置和帧时间戳，用鲁棒非线性最小二乘拟合一条同时包含重力和空气阻力的飞行轨迹；并在拟合中加入“轨迹必须穿过球网平面”这一球场几何约束，从而缓解单目视觉中远近与快慢难以区分的问题。

Details

Motivation: 单目相机缺少深度信息，无法区分“近处慢速物体”和“远处快速物体”，导致速度估计存在尺度歧义；羽毛球受空气阻力影响有明显减速特征，再结合已知的球场几何，可以提供额外的约束信息。

Result: 在两次录制共 51 次击球（吊球、平抽、半扣杀、扣杀）上评测：以基于阻力模型的双目结果为参考时，引入球网平面约束后，速度差的中位数绝对值从 13.3% 降至 8.6%；以不使用阻力模型、对三角化位置求导得到的第二种参考结果衡量时，误差也更小。

Insight: 创新点在于把飞行动力学（重力+空气阻力模型）与球场几何（网平面约束）结合，作为先验约束来消除单目速度估计的歧义，并用球场线自动标定、鲁棒非线性最小二乘完成轨迹拟合；这种“物理模型+场景几何”约束单目歧义的思路可迁移到其他小球类运动分析。

Abstract: A single camera cannot distinguish between a slowly moving object nearby and a rapidly moving object in the distance without additional information. For a shuttlecock, air drag provides a strong deceleration cue that can be combined with known court geometry. We fit a gravity-and-drag trajectory to smartphone video and compare a free monocular fit with a fit constrained to cross the net plane. Camera calibration uses court lines, and the trajectory is fitted to observed shuttle positions and frame timestamps by robust nonlinear least squares. We evaluated 51 badminton shots from two recording sessions, spanning drop shots, drives, half-smashes and smashes. The net-plane fit reduced the median absolute speed difference from a drag-based stereo reference from 13.3% to 8.6%. A second reference, obtained by differentiating triangulated positions without a drag model, also gave a smaller median difference for the net-plane fit. The results support combining court geometry with flight dynamics for badminton speed estimation from a single camera.

[61] Multimodal Cross-Condition Learning for Temporal Sentence Grounding in Videos cs.CVPDF

Allen He

TL;DR: 论文面向视频时序句子定位（Temporal Sentence Grounding），提出多模态交叉条件学习框架MCCL。其Video Prefix Adapter将池化视觉上下文转换为连续token，用于条件化冻结的DistilBERT编码器，并与Sentence Conditioned Adapter配合实现视觉到语言再回到视觉的有序双向条件交换。论文在Charades-STA和ActivityNet Captions上系统比较了两种视频骨干、LSTM/Mamba时序模块及四种条件模式。

Details

Motivation: 现有端到端方法主要通过句子条件化视觉表示来保留查询相关证据，但语言表示仍独立于视频，未反映句子被解释时的视觉上下文。论文希望让视觉与语言表示相互条件化，从而同时获得查询相关视频证据和视觉感知的句子表示。

Result: 在Charades-STA的四组设置中，双向条件化均比更强的单向模式提升1.6–2.3 mIoU点；ActivityNet Captions上模式不同：双向条件化对I3D–Mamba有帮助，而C3D下视频到文本条件化更强。整体报告的是相对对应基线的描述性增益，未明确宣称绝对SOTA。

Insight: 创新点在于将单向视觉适配扩展为可配置的多模态交叉条件框架，通过视频前缀适配器条件化冻结语言模型，并系统分析双向条件交换、视频骨干和时序模块的影响。可借鉴之处是轻量适配器实现视觉到语言的条件注入，以及用多模式消融揭示不同数据集/骨干下条件方向的有效性差异。

Abstract: Temporal sentence grounding requires a video representation that preserves query-relevant evidence and a sentence representation that reflects the visual context in which it is interpreted. Prior end-to-end grounding addresses the first requirement through sentence-conditioned visual adaptation, but leaves the language representation independent of the video. This work proposes Multimodal Cross-Condition Learning (MCCL). Its Video Prefix Adapter (VPA) converts pooled visual context into a sequence of continuous tokens that condition a frozen DistilBERT encoder. Combined with the Sentence Conditioned Adapter (SCADA), VPA supports an ordered exchange from vision to language and back to vision. A comprehensive study examines two video backbones, LSTM and Mamba temporal modules, and four conditioning modes on two datasets. Bidirectional conditioning exceeds the stronger one-way mode by 1.6–2.3 mIoU points in all four Charades-STA settings. ActivityNet Captions exhibits a different pattern: bidirectionality helps I3D–Mamba, whereas video-to-text conditioning is stronger with C3D. The study extends one-way visual adaptation into a configurable multimodal framework and reports descriptive gains over the corresponding baselines.

[62] Selective Positional Allocation for Noise-Robust Query Retrieval in Small-Object Detection cs.CVPDF

Yangchen Zeng

TL;DR: 论文提出SPAR小目标检测框架，将位置先验视为可分配资源，在语义有意义的位置增强、在背景杂波处衰减。SPAR包含可解释的选择性位置嵌入SPE、融合热图调制位置信号与类别/框证据的MOHFE编码器、带前景门控的HIDQ解码器，以及DPSConv双路径采样卷积。热图监督来自现有检测目标且仅训练时使用，不增加推理开销。

Details

Motivation: 航空和遥感图像中小目标检测常受限于位置先验在模糊前景/背景区域分布不当，而非骨干网络表征能力不足；论文旨在抑制背景杂波引发的位置响应并增强有意义位置的小目标证据。

Result: 在DOTA、DIOR、VisDrone、PASCAL VOC、NWPU VHR-10和AITOD上验证有效；相较基线最高提升9.1个百分点，解码器由8层缩短为3层，参数量减少59.4%（66.3M vs 163M）。

Insight: 创新在于将位置线索重新概念化为可分配资源，并通过可解释SPE、前景门控查询解码和DPSConv双路径采样提升小目标检索的噪声鲁棒性；利用现有检测目标生成训练期热图监督，无需额外标注且不增加推理成本，兼具可解释性与轻量化设计。

Abstract: In aerial and remote-sensing imagery, detecting tiny targets is frequently hampered less by the representational capacity of the backbone network than by the manner in which positional priors are distributed across ill-defined foreground and background regions. We introduce SPAR (Selective Positional Allocation and Retrieval), a detection framework that re-conceptualizes positional cues as an allocatable resource: they are intensified at semantically meaningful locations while responses driven by scene clutter are actively attenuated. At the heart of SPAR lies Selective Positional Embedding (SPE), an interpretable embedding mechanism paired with an activation-bar visualization that facilitates direct inspection and hyper-parameter tuning. The encoder branch, termed MOHFE, fuses heatmap-modulated positional signals with category-specific and box-level evidence to yield more compact multi-scale features; the decoder branch, termed HIDQ, employs a foreground gating operation to discard background-dominated candidates prior to query decoding. To cope with the extreme sparsity of small-object evidence, we additionally design DPSConv (Dual-Path Sampling Convolution), which augments retrieval-oriented representations through two geometrically complementary sampling routes. Notably, all heatmap supervision is derived from existing detection objectives and consumed exclusively during training, requiring no auxiliary heatmap annotations and leaving inference as an ordinary forward pass with no additional gradient overhead. Comprehensive evaluations on DOTA, DIOR, VisDrone, PASCAL VOC, NWPU VHR-10, and AITOD demonstrate the effectiveness of the proposed design: relative to the baseline, SPAR attains an improvement of up to 9.1 percentage points, shortens the decoder from eight layers to three, and reduces model parameters by 59.4% (66.3M versus 163M).

[63] From Single-Shot QA to Continuous Perception: Revisiting the Energy Composition and Optimization Boundary of Edge VLMs cs.CV | cs.AIPDF

Yiting Duan, Miaoxin Wang, Aoqing Guo, Bo Peng

TL;DR: 论文重新审视边缘视觉语言模型（VLM）的能耗组成，指出以往关于视觉预填充能耗的结论多基于单次问答负载，而在连续感知场景下结论会显著变化。作者在Jetson AGX Thor和Orin上对三类架构家族的9个VLM进行剖析，发现解码成本与视觉预填充成本遵循两条相互独立的能耗规律，并提出面向边缘VLM部署的优化策略。

Details

Motivation: 现有边缘VLM的视觉预填充能耗结论主要来自单次问答负载，难以反映连续感知场景的真实开销；论文旨在揭示连续感知下VLM能耗组成的变化及优化边界。

Result: 基于4,508条记录并用纯文本任务校准的分析表明：每输出token的解码成本随模型规模单调增长，而视觉预填充成本主要由视觉编码器架构效率决定而非模型规模；在N=10的连续感知且输出稀疏时，视觉预填充能耗占总能耗的92%–97%。

Insight: 创新点在于从单次QA转向连续感知重新刻画边缘VLM能耗规律，分离出解码成本与视觉预填充成本两条独立规律，并指出视觉编码器效率是预填充能耗的关键因素；据此提出视觉帧复用、自适应输出截断、任务感知路由和编码器吞吐优化等部署策略。

Abstract: Visual-prefill energy conclusions for edge vision-language models (VLMs) are commonly drawn under single-shot workloads; we revisit them under continuous perception. Profiling nine VLMs across three architecture families on Jetson AGX Thor and Orin (4,508 records, calibrated with a pure-text task), we find two mutually independent energy laws: the per-output-token decode cost grows monotonically with model scale, whereas the visual-prefill (image-encoding) cost is dominated by visual-encoder architectural efficiency, not scale. Under continuous perception ($N{=}10$) with sparse output, visual-prefill energy reaches 92–97% of total. We derive optimization strategies—visual frame reuse, adaptive output truncation, task-aware routing, and encoder throughput optimization—for edge VLM deployment.

[64] Beyond Black Boxes: An Ontology Based Vision Framework for Transparent Fruit Disease Detection cs.CV | cs.AIPDF

M. J. Marapperuma, B. V. K. I. Vidanage

TL;DR: 论文提出一种基于本体的可解释水果病害检测框架，用OWL构建包含症状表型、HSV光谱表型和形态表型的病害知识库，并以此知识引导图像处理与专家规则诊断，从而避免依赖大规模标注数据和黑箱深度学习。

Details

Motivation: 现有深度学习水果病害检测方法虽然准确，但依赖大量标注数据且缺乏透明性和灵活性，论文希望解决黑箱模型难以解释、难以复用专家知识的问题。

Result: 在MangoFruitDDS公开数据集上取得F1 85.00%、精确率85.00%、召回率85.23%，与VGG16等已知深度学习模型相当；本体结构合理性与实用性评估总体得分为7.4/10。

Insight: 创新点在于将植物病理学知识形式化为本体，并用语义知识库指导视觉检测流程，实现少标注、可解释、专家规则可介入的水果病害诊断；客观看，其价值主要在于知识驱动与透明性，而非单纯追求更高精度。

Abstract: Efficiency and reliability in the timely identification of phytopathogens would help minimize crop loss in agricultural sectors but existing deep learning based methods, although accurate, would require a large annotated dataset and are black-boxed in their operation, thus, restricting flexibility and transparency. The current paper presents a hybrid detection framework that is able to overcome these drawbacks through the unified real-time vision with a semantic knowledge base. Web Ontology Language (OWL) was used to develop a comprehensive ontology of the disease of fruits that formally codifies phytopathological knowledge, such as symptom phenotype, spectral phenotype (HSV), and morphological phenotype. Such knowledge-guided configuration guides the image processing pipeline, making it possible to diagnose using this knowledge under expert specified rules without a large training dataset. The ontology underwent a computationally verified test of its structural soundness and commonsensical practical usefulness and scored an overall of 7.4/10. On the public set of MangoFruitDDS, the diagnostic performance was an F1 Score of 85.00%, precision of 85.00%, and a recall of 85.23%. These findings are very competitive and similar to other known deep learning models like the VGG16 that prove that the knowledge-driven approach provides an accurate, transparent, and scalable solution on automated fruit disease diagnosis.

[65] Real-Time Obstacle Detection and Distance Estimation on Smartphones for Visually Impaired and Distracted Pedestrians cs.CV | cs.AI | cs.PF | cs.SEPDF

Abtin Zandi, Sarvin Nami, Roza Ganjipour, Bardia Sabagh Kermani, Amirreza Tarabkhah

TL;DR: 论文提出了一款基于 Kotlin 的 Android 应用，使用经过剪枝、量化和早退（early-exit）优化的 YOLOv8 检测器，识别 18 类常见城市障碍物，并通过 Android NNAPI 将推理分派到 GPU/NPU/DSP 加速；在此基础上结合 ARCore 或单目焦距进行距离估计，用 TTS（文本转语音）和振动为视障者与低头分心行人提供实时避障提醒。

Details

Motivation: 全球约有 22 亿视障人士，白手杖、导盲犬等传统辅具昂贵、能力有限且可及性差；同时，行人因看手机分心导致碰撞、绊倒和跌倒风险上升。论文希望用低成本、低延迟的手机端方案同时服务这两类人群。

Result: 在中等配置手机上，推理延迟从原生 YOLOv8n 的约 3.2 秒降至 0.39–0.48 秒；推荐配置（INT8 量化 + 早退）为 0.42–0.48 秒，召回率保持在 0.81；仅需单目摄像头，无需 LiDAR、深度相机等专用传感器。

Insight: 创新点在于将模型剪枝、量化、早退分支与 NNAPI 硬件加速调度组合成完整的移动端流水线，并针对 18 类城市障碍重新训练检测器；同时把无专用传感器的单目/ARCore 距离估计与面向两类用户的多模态反馈集成到同一应用中，兼顾视障辅助与分心行人提醒。

Abstract: According to the World Health Organization, at least 2.2 billion people worldwide live with visual impairment, including tens of millions with severe vision loss. Traditional aids such as white canes or guide dogs remain costly, limited in capability, and inaccessible to many. At the same time, smartphone distraction in public spaces has been linked to elevated risks of collisions with vehicles, trips, and falls. These dual challenges motivate lightweight, smartphone-based solutions that combine accessibility with low latency. We present a Kotlin-based Android application that uses a YOLOv8 detector, retrained to recognize eighteen common urban obstacle classes, to deliver real-time obstacle alerts for both user groups. The detector was optimized with pruning, quantization, and early-exit branches, and deployed through the Android Neural Networks API (NNAPI), which can dispatch inference to GPU, NPU, or DSP accelerators when available. On a mid-range smartphone, these optimizations reduced average inference latency from about 3.2 s for the off-the-shelf YOLOv8n to 0.39-0.48 s; the recommended configuration (INT8 quantization with early exit) runs in 0.42-0.48 s while retaining a recall of 0.81. The application combines the optimized detector with ARCore-based or monocular focal-length distance estimation, so it works with a single smartphone camera and requires no LiDAR, depth camera, or other specialized sensor. Multimodal feedback, including Text-to-Speech guidance for visually impaired users and vibration alerts for distracted pedestrians, supports use across different contexts.

[66] Think Before You Locate: Clinical Chain-of-Though Supervision for Sequential Medical Image Grounding cs.CV | cs.AIPDF

Adinath Madhavrao Dukre, Govinda Kolli, Yifan Lu, Ziyun Zou, Azmine Toushik Wasi

TL;DR: 论文提出面向序列医学图像定位的临床思维链监督方法 dCoT-SFT，并构建包含 182,573 条过滤理由、覆盖 8 类序列定位任务和 10 种影像模态的 MedChain 语料。方法先由医学 VLM 生成初稿理由，再由多模态精炼器结合图像、问题和标注框重写为带跨图像推理的框条件解释，并用这些理由对 Qwen3.5 进行 deliberative chain-of-thought 微调。实验表明该监督能提升医学图像序列定位，尤其利于变化检测和目标跟踪。

Details

Motivation: 现有面向序列医学定位的视觉语言模型通常仅用边界框监督，框只告诉目标在哪里，却不能解释为何该图像区域能回答当前问题；论文关注显式、基于图像的推理能否改善定位以及哪些任务受益。

Result: 在 MedSG-Bench 上，dCoT-SFT 在 4B/9B/27B 模型上取得新 SOTA；27B 达 77.24 mIoU 和 85.20 Acc@0.5，比最强先前模型提升 4.69 和 5.49 点；固定 4B 检查点配对比较较 answer-only SFT 提升 3.56 mIoU。增益主要来自变化检测和目标跟踪，三个外观匹配任务下降；替换为其他任务的推理理由会使 mIoU 降 12.2 点；dCoT-SFT 后加 IoU 奖励的 GRPO 仅带来较小且依赖任务的增益。

Insight: 创新在于将临床式跨图像/跨切片推理显式引入序列医学图像定位监督，构建大规模框条件理由语料，并通过“初稿-精炼”生成高质量解释进行 dCoT-SFT。客观看，其价值还包括系统分析不同任务对推理监督的敏感性、推理上下文对定位的关键作用，以及 GRPO 在此设定下的有限收益。

Abstract: Clinicians rarely localize a finding from one image alone. They compare current and prior scans, follow structures across slices, and match regions across views or modalities. Yet vision-language models for sequential medical grounding usually learn only from bounding boxes. Boxes show where the target is, but they do not explain why that region in that image answers the question. We study whether explicit, image-grounded reasoning can improve localization, and which tasks benefit from it. We introduce method, whose core is MedChain, a corpus of 182,573 filtered rationales spanning eight sequential grounding tasks and ten imaging modalities. A medical VLM (FlemingVL-38B) first drafts a caption-like rationale, and a multimodal refiner (Qwen3.5-397B-A17B) then re-examines the images, question and annotated box to write a box-conditioned explanation with explicit cross-image reasoning. We fine-tune Qwen3.5 on these rationales with deliberative chain-of-thought supervision (dCoT-SFT). Across 4B, 9B, and 27B models, dCoT-SFT sets a new state of the art on MedSG-Bench. The 27B model reaches 77.24 mIoU and 85.20 Acc@0.5, improving over the strongest prior model by 4.69 and 5.49 points. In a paired comparison using fixed 4B checkpoints, dCoT-SFT improves over answer-only SFT by 3.56 mIoU (95% CI 3.13–4.00). The gains mainly come from change detection and object tracking, while performance drops on three appearance-matching tasks. Replacing a model’s own rationale with a rationale from another task reduces mIoU by 12.2 points, showing that localization depends strongly on the reasoning context. Finally, adding GRPO with an IoU reward after dCoT-SFT gives only small and task-dependent gains, which we analyze through controlled multi-seed development experiments.

[67] SparseWAM: Driving World-Action Models are Worth 16 Register Tokens cs.CVPDF

Yixiang Yang, Lizhong Zhang, Xingyu Zhang, Zhiwen Chen, Jie Ling

TL;DR: 论文提出 SparseWAM，一种面向自动驾驶规划的稀疏世界-动作模型。它将冻结 DINOv2 特征压缩为每帧仅 16 个 register token 的稀疏空间，并通过联合规划与打分预训练聚焦决策相关信息，从而在部署时保留“先想象未来、再行动”的能力，同时显著降低计算延迟。

Details

Motivation: 现有基于视频生成的世界-动作模型推理时需生成稠密未来视频，延迟高；高效变体又常在部署时丢弃世界分支，失去测试时想象能力。即使使用 patch 级 DINO/JEPA 特征，仍存在序列长和决策无关信息多的问题。

Result: 在 NAVSIM v1 上达到 92.6 PDMS，在 NAVSIM v2 上达到 90.1 EPDMS，在 NavHard 上达到 39.6，延迟仅 164 ms，约为 DriveVA 的 1/5，体现了稀疏 register 空间的高效性。

Insight: 核心创新是用极稀疏的每帧 16 个 register token 表示未来场景，并通过联合规划-打分预训练将决策相关信息压缩到该空间中；配合模态解耦的 Mixture-of-Transformers 和因果注意力掩码，使动作 token 能基于想象出的未来 register 条件化，在保持 imagine-then-act 推理的同时实现低延迟和低成本多模态采样。

Abstract: World Action Models (WAMs) transfer scene-dynamics priors to planning by jointly forecasting future scenes and ego trajectories. However, WAMs built on video generators must generate dense future videos at inference, incurring prohibitive latency, while efficient variants discard the world branch at deployment and thus forgo test-time imagination. Even when dense video latents are replaced with patch-level DINO or JEPA features, these representations still involve long token sequences and encode decision-irrelevant information. We therefore propose SparseWAM, which forecasts in a sparse register space of only 16 tokens per frame, compressed from frozen DINOv2 features and shaped by joint planning-and-scoring pretraining to concentrate decision-relevant information. Within this space, SparseWAM employs a modality-decoupled Mixture-of-Transformers with a causal attention mask that lets action tokens condition on imagined future registers, retaining explicit imagine-then-act reasoning at deployment. Its compactness further enables low-cost multimodal sampling. As a result, our SparseWAM achieves 92.6 PDMS on NAVSIM v1, 90.1 EPDMS on NAVSIM v2, and 39.6 on NavHard at only 164 ms latency, roughly 1/5 that of DriveVA, demonstrating the efficiency of the sparse register space. Code will be released upon acceptance.

[68] Circumpolar Wall-to-Wall Detection of Retrogressive Thaw Slumps with Scarce Labels and Extreme Class Imbalance cs.CVPDF

Yili Yang, Heidi Rodenhizer, Robb Young, Brendan M. Rogers, Marlena Bartkus

TL;DR: 论文面向环极永久冻土区后退融化滑塌（RTS）的稀有目标检测问题，利用4.8米PlanetScope影像和稀缺标签构建深度学习检测系统，完成20.68百万平方公里、41.6百万瓦片的环极制图。作者通过172组受控实验比较卷积网络、多模态融合、基础模型编码器和MAE预训练，并在真实低 Prevalence 下评测，最终生成19,068个高置信RTS检测。

Details

Motivation: RTS是永久冻土突然融化的重要形变过程，但仅占影像瓦片的0.1-0.5%，标签昂贵且类别极端不平衡，现有环极清单覆盖不全。论文希望将RTS检测明确建模为稀有目标问题，并回答稀缺标签和极端不平衡下什么因素决定检测精度。

Result: 在留出生态区、真实 Prevalence 0.1-0.5% 下，最终模型取得AUPRC 0.812-0.855、目标精度0.854和F1 0.644；壁到壁部署得到19,068个高置信检测，按尺寸类采样精度为0.54-0.90。实验表明卷积网络不逊于多模态融合、基础模型编码器和MAE预训练等更耗算力方案。

Insight: 创新点在于面向稀有目标的评估协议、对稀缺标签和极端类别不平衡下精度驱动因素的受控分析，以及可部署的环极RTS制图。客观看，论文价值更偏向系统级实证：标签数据对性能影响最大，基础模型优势仅在标签稀缺时显现，简单CNN在該任务上已足够强。

Abstract: Retrogressive thaw slumps (RTS) are among the most dynamic ground deformations caused by permafrost thaw. Abrupt thaw processes such as RTS could roughly double the contribution of permafrost thaw to climate warming, and already threaten a third of Arctic infrastructure. Circumpolar RTS mapping has advanced quickly, yet released inventories together cover only part of the permafrost region. RTS occupy only 0.1-0.5% of image tiles and labels are costly, so a detector must be designed and evaluated as a rare-target problem. We therefore developed a deep learning system and mapped 20.68 M square kilometres of circumpolar permafrost using 41.6 M tiles of 4.8 m PlanetScope imagery. Training used 22,259 tiles with 2,609 RTS instances in 1,718 of them, and the model was tuned through 172 controlled experiments. A convolutional network matched every alternative tested, including multimodal fusion, foundation-model encoders and masked-autoencoder pretraining, each at far more compute for similar or worse results. Labelled data moved performance most, and a foundation model’s advantage appeared only when labels were scarce. Tested once on held-out ecoregions at the real-world prevalence of 0.1-0.5%, the final model achieved an area under the precision-recall curve of 0.812-0.855, an object precision of 0.854 and F1 of 0.644. Deployed wall-to-wall, the model produced a circumpolar map of 19,068 high-confidence detections whose sampled precision ranges from 0.54 to 0.90 by size class. We present an evaluation protocol for rare targets, a controlled account of what governs accuracy under scarce labels, and the circumpolar RTS map the validated model produced.

[69] Keyframes First, Motion Second: Revisiting Compressed-Domain Video Captioning under Limited Supervision cs.CVPDF

Asok B K, Ashim Nepal, Loknath Regmi

TL;DR: 论文重新审视压缩域视频描述在有限监督下是否值得引入运动/残差分支。作者在VATEX和MSVD上做受控实验，发现从零训练的运动编码器几乎无收益，而改进I帧关键帧的读取（微调SigLIP 2注意力池化头）显著提升CIDEr并大幅降低解码耗时，主张“关键帧优先、运动其次”。

Details

Motivation: CoCap类方法需额外训练运动/残差编码器并解码运动信息，在边缘设备上带来监督与计算开销；论文探究有限监督下运动分支何时真正有用。

Result: VATEX受控实验中，CoCap式action tokens使CIDEr变化-0.55（95% CI [-2.3,+1.2]），其他运动用法也无帮助；微调SigLIP 2池化头+5.4 CIDEr，1–8个关键帧token在各seed优于16个CoCap token，解码7.3ms vs 44–114ms。MSVD全split上关键帧readout领先14.2 CIDEr，action tokens无可靠增益。

Insight: 创新在于系统消融压缩域视频描述中的视觉token来源，揭示有限监督下运动分支收益不稳定；更值得借鉴的是优先增强关键帧表征/轻量微调readout，以更低成本获得更优性能。

Abstract: Compressed-domain video captioners such as CoCap read the H.264 bitstream directly: a pretrained encoder reads the keyframes (I-frames), while motion and residual encoders, trained from scratch, turn the codec’s motion vectors and residuals into action tokens. This motion branch costs decoding time and supervision, both scarce on edge devices. We ask when it pays off under limited supervision. In a controlled study on 2,500 VATEX training clips, we fix a frozen SigLIP 2 keyframe encoder, a GPT-2 caption decoder and the training schedule, vary only the visual tokens the decoder receives (34 configurations), and report held-out test CIDEr with paired bootstrap intervals and three seeds. Motion encoders trained from scratch bring no measurable benefit: CoCap-style action tokens change CIDEr by -0.55 (95% CI [-2.3, +1.2]), and six other uses of motion do not help. Warm-started from a model trained on 48x the caption samples, they add +1.3 CIDEr on average, though not significantly across seeds, and only while the keyframe tokens stay frozen. Reading the keyframes better matters more: fine-tuning SigLIP 2’s own attention-pooling head adds 5.4 CIDEr, and one to eight such tokens beat the 16 CoCap-style tokens on every seed while decoding only I-frames (7.3 ms instead of 44-114 ms per clip). The same holds on MSVD’s full split in CoCap’s own video encoding, where the readout leads by 14.2 CIDEr and action tokens bring no reliable gain, also with clean single-reference motion vectors. Under limited supervision, keyframes come first and motion second.

[70] ReactionBench: A Human-Anchored Benchmark for Modeling Reactions to Video cs.CV | cs.AIPDF

Yibo Zhao, Ao Qu, Xuan Jiang, Jiahao Xu, Keane Ong

TL;DR: 论文提出 ReactionBench，一个以人类反应为中心的视频理解基准，用于评估多模态模型能否将观察到的观众反应与其对应的视频刺激上下文进行关联。该基准包含同步的刺激-反应视频片段，并设计了反应强度排序、反应与时间对齐刺激匹配、以及解释相关刺激线索三项任务。实验显示现有七种多模态模型在反应特异性 grounding 上仍表现不佳。

Details

Motivation: 现有视频基准多关注事件、时序推理或视频中人物，情感/观众反应数据集又常局限于情绪标签、聚合反应或仅从刺激预测反应，缺少对“观察者反应能否被 grounding 到对应刺激上下文”的系统评估。

Result: ReactionBench 覆盖 31,834 个候选同步片段、433 小时和八个领域，冻结评估含 250 个强度档案、112 个匹配项和 200 个理由项。七种多模态模型中，最佳模型在四选一刺激-反应匹配上仅达 50.9% 准确率，GPT-5 在反应替换下无明显性能损失，且结果对评估协议敏感。

Insight: 创新点在于构建人类标注锚定的反应特异性视频理解基准，将观众反应与时间对齐的刺激上下文关联，并同时评估强度排序、匹配和解释能力；其价值在于揭示多模态模型在反应 grounding 上的不足及评估协议敏感性。

Abstract: Understanding what happens in a video is not sufficient for socially responsive multimodal systems: such systems also aim to relate what a person observes to how that person responds. Existing video benchmarks largely evaluate events, temporal reasoning, or people depicted in the video, while affective and viewer-response datasets often focus on emotion labels, aggregate responses, or prediction from the stimulus alone. This leaves an underexplored question: can current multimodal models ground an observed viewer reaction in the stimulus context associated with it? We introduce ReactionBench, a human-anchored benchmark for reaction-specific video understanding. Built from a candidate pool of 31,834 synchronized stimulus-reaction clips spanning 433 hours and eight domains, ReactionBench evaluates three complementary abilities: ranking the intensity of a viewer’s reactions within a video, matching a reaction to its temporally aligned stimulus, and explaining the concrete stimulus cues linked to that reaction. Human annotation provides 14,894 ratings over 3,257 moments, and the frozen evaluation comprises 250 intensity profiles, 112 matching items, and 200 rationale items with 447 blind-written human references. Across seven multimodal models, reaction-specific grounding remains challenging: the best model reaches 50.9% accuracy on four-way stimulus-reaction matching, while GPT-5 shows no detectable loss under reaction substitution. Performance is also sensitive to evaluation protocol. Project page: https://yibozh.github.io/ReactionBench-page/

[71] SIMIT: Self-Improving Vision-Language Models via Imagination at Test-Time cs.CV | cs.LGPDF

Mehmet Onurcan Kaya, Desmond Elliott, Dim P. Papadopoulos

TL;DR: 论文提出 SIMIT，一种测试时自我提升框架：视觉语言模型在回答无标注测试查询前，先围绕该查询自生成可控的（问题、答案、图像）训练样本，再通过上下文学习或权重微调提升自身表现。SIMIT 结合原生图像生成与结构化视觉技能库，并利用多阶段验证、难度过滤和自适应预算保证练习数据质量与针对性。

Details

Motivation: 现有测试时方法要么仅增加推理长度或重复采样而不改变模型，要么依赖多数投票或模型自判正确性来更新模型，容易强化已有错误。论文希望在无标注、无外部模型的条件下，为给定目标测试集构造更可靠的自我提升数据。

Result: 在17个多样化基准上，SIMIT 优于现有自我提升方法；最佳配置相较 BAGEL-7B 取得 +7.20% 的平均相对增益，免训练的 SIMIT-ICL 也达到 +6.98%。

Insight: 核心创新是先指定答案再生成对应图像，从而构造答案可控的相似练习题，不要求模型先正确解决目标查询；同时引入可扩展技能库生成文档、图表、示意图等结构化视觉数据，并用多阶段验证、难度过滤和自适应预算提升练习数据的可靠性与针对性。

Abstract: We introduce SIMIT, a test-time self-improvement framework in which a vision-language model creates its own query-specific training data before answering an unlabeled test query. Our goal is to improve performance on a given target test set without annotations or external models. To pursue this goal, some test-time methods improve answers through longer reasoning or repeated sampling but leave the model unchanged. Others update the model using rewards based on majority agreement among multiple candidate answers or the model’s own judgments of correctness, but such rewards can reinforce existing mistakes. SIMIT instead imagines similar problems whose solutions it controls: a model need not correctly solve the target query to construct useful practice examples. It synthesizes diverse (question, answer, image) triplets by specifying each answer before realizing its image. To support diverse multimodal tasks, SIMIT combines native image generation with an extensible skill library for structured visuals, including documents, charts, and diagrams. Within this pipeline, multi-stage verification checks that images support their assigned answers, while difficulty filtering retains informative examples. Adaptive budgeting further targets this practice by allocating more samples to queries the model is less confident in answering. The resulting data can improve the model in-context (SIMIT-ICL) or in-weight (SIMIT-FT). Across 17 diverse benchmarks, SIMIT outperforms existing self-improvement methods. Its best configuration achieves a +7.20% mean relative gain over BAGEL-7B, while training-free SIMIT-ICL achieves +6.98%.

[72] From Clips to Streams: A Unified Framework for Streaming Sign Language Translation cs.CVPDF

Hoang Quan Dang, Xin Shen, Yanbin Liu, Xin Yu, Ling Chen

TL;DR: 论文将手语翻译从预分割片段扩展到连续视频流，正式定义Streaming SLT任务，即从连续未裁剪视频中联合发现语言事件并进行翻译。作者提出首个端到端框架StreamSLST，基于Deformable Transformer并行解码，同时优化时间分割与翻译，并结合句子感知滑动窗口采样和三模态视觉-语言预训练。实验在真实与合成流式数据集上验证其优于级联方案。

Details

Motivation: 现有手语翻译研究多依赖预分割片段，与现实连续交流脱节，且级联式“先分割再翻译”会带来误差传播。论文旨在弥合从片段到视频流的差距，实现连续未裁剪手语视频中的事件发现与翻译一体化。

Result: 在BOBSL、How2Sign以及新构建的Streaming-Phoenix-2014T和Streaming-CSL-Daily上，StreamSLST一致优于匹配的级联分割-翻译流水线。分析表明联合优化能学习更宽且对翻译有效的时间支持，简单扩展或重新缩放标注片段无法复现该效果。

Insight: 主要创新包括：首次定义Streaming SLT任务并构建连续手语理解基准；提出首个端到端流式手语分割与翻译框架，用并行解码联合优化以避免级联误差传播；设计句子感知滑动窗口采样支持长视频可扩展训练，并引入三模态视觉-语言预训练对齐姿态动态与文本语义。客观来看，其价值在于任务定义、端到端联合建模和流式评测基准的系统性推进。

Abstract: Sign Language Translation (SLT) research has typically focused on pre-segmented clips, a constraint that disconnects models from the continuous reality of real-world communication. To bridge the gap from clips to streams, we formally define Streaming SLT, a realistic task demanding the joint discovery and translation of linguistic events from continuous, untrimmed video inputs. To address this challenge, we propose StreamSLST, the first end-to-end framework for Streaming Sign Language Segmentation and Translation via Deformable Transformer architecture. Unlike cascaded approaches that suffer from error propagation, StreamSLST employs a parallel decoding strategy to jointly optimize temporal segmentation and translation in a single pass. To enable scalable training on long-form videos, we incorporate a Sentence-aware Sliding Window Sampler that crops continuous streams into trainable units. We further design a Tri-modal Visual-Language Pretraining stage that aligns pose dynamics with textual semantics before joint optimization. To support comprehensive evaluation, we conduct experiments on two real-world streaming datasets, BOBSL and How2Sign, together with two newly constructed synthetic streaming benchmarks, Streaming-Phoenix-2014T and Streaming-CSL-Daily. The results demonstrate that StreamSLST consistently outperforms a matched cascaded segmentation-then-translation pipeline. Interestingly, our analysis reveals that joint optimization learns wider, translation-effective temporal support that simple expansion or rescaling of the annotated spans fails to reproduce. Our work establishes the first robust benchmark for continuous sign language understanding and paves the way for accessible real-world communication interfaces. The source code and data are available at https://github.com/streamsl/StreamSLST.

[73] CausalPrune: Counterfactual Causal Token Pruning for Efficient Large Vision-Language Models cs.CVPDF

Pengcheng Zheng, Chaoning Zhang, Ya Wen, Jiaxin Huang, Jiaquan Zhang

TL;DR: 论文提出CausalPrune，一种基于反事实因果的视觉token剪枝框架，用于高效大型视觉语言模型。该方法将LVLM推理建模为结构因果模型，引入因果token重要性分数（CTIS）来估计干预每个视觉token的平均处理效应，并通过一阶近似、后门调整和分层因果中介实现渐进剪枝。实验表明，该方法在多种LVLM架构上能在保持或提升多模态性能的同时显著降低计算量和延迟。

Details

Motivation: 现有视觉token剪枝方法通常基于相关性统计估计token重要性，无法区分真正因果影响模型输出的token与仅伪相关的token，导致剪枝不够准确、可能损害模型性能。

Result: 在LLaVA-1.5、Qwen2.5-VL等多种LVLM架构上的实验表明，CausalPrune在保持可比甚至更优的多模态性能的同时，显著降低了FLOPs和prefill延迟，并一致优于现有剪枝方法；摘要未给出具体定量数字和基准名称。

Insight: 论文的创新点在于将LVLM推理表述为结构因果模型，用平均处理效应定义token重要性（CTIS），并提出CTIS的一阶近似与后门调整以实用化，同时利用分层因果中介将token重要性分解为直接和间接效应，实现原理性的渐进剪枝。客观来看，将因果推断引入视觉token剪枝、从相关性转向因果性是核心创新，但实际效果依赖近似与混杂假设，摘要未提供具体定量和复杂度分析。

Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal understanding, but their practical deployment is still limited by the substantial computation introduced by excessive visual tokens. Visual token pruning offers an effective solution by removing redundant visual tokens during inference. However, existing methods typically estimate token importance from correlational statistics, which cannot distinguish tokens that causally determine the model output from those spuriously associated with it. To address this issue, we propose \textbf{CausalPrune}, a counterfactual causal token pruning framework for efficient LVLMs. We formulate LVLM inference as a Structural Causal Model and introduce the Causal Token Importance Score (CTIS), which estimates the Average Treatment Effect of intervening on each visual token. To make causal estimation practical, we derive an efficient first-order approximation of CTIS and incorporate backdoor adjustment to mitigate latent cross-modal confounding. Within this causal formulation, layer-wise causal mediation decomposes token importance into direct and indirect effects through intermediate hidden states, enabling progressive pruning across transformer layers in a principled manner. Extensive experiments on various LVLM architectures, such as LLaVA-1.5 and Qwen2.5-VL, demonstrate that CausalPrune maintains comparable or even superior multimodal performance while achieving substantial reductions in FLOPs and prefill latency, consistently outperforming existing pruning methods.

[74] CarDiff: Anatomically Aware Dental Caries Synthesis using Diffusion cs.CV | cs.LGPDF

Sanyam Jain, Bruna Neves de Freitas, Alexandros Iosifidis, Ruben Pauwels

TL;DR: 论文提出 CarDiff，一个用于全景牙科放射片中牙龋合成的半监督扩散框架。该方法结合配对掩码-图像学习与基于增强掩码的自监督生成，并引入病变区域与周围结构的解剖感知条件，通过分割引导监督和对抗解剖对齐保证语义一致性。实验表明其在合成质量和下游分割数据增强方面均有效。

Details

Motivation: 牙科影像中标注数据有限，且某些牙龋类别样本不足，影响模型训练。论文旨在通过解剖一致、语义可控的合成影像生成来缓解数据稀缺问题。

Result: 在 MLUA-DC1000 数据集上，CarDiff 取得所评估方法中最佳 FID 90.76 和 LPIPS 0.48，合成质量优于现有语义合成基线。下游七个分割架构的增强实验中，使用 5 倍增强训练集可使平均 Dice 最高提升 6.5%，中等和组合病变类别增益更明显。

Insight: 创新点在于将配对掩码-图像学习与增强掩码自监督生成结合，并显式建模病变区域与周围解剖结构的关系；同时用分割引导监督和对抗解剖对齐提升合成语义一致性，为有限监督下的牙科影像增强提供了可借鉴方案。

Abstract: Synthetic medical image generation can help address limited annotated data in dental imaging, particularly for under-represented caries classes. In this work, we present CarDiff, a semi-supervised framework for dental caries synthesis in panoramic radiographs. The method combines paired mask-image learning with self-supervised generation from augmented masks, while incorporating anatomy-aware conditioning between lesion regions and surrounding structures. Semantic consistency is enforced through segmentation-guided supervision and adversarial anatomical alignment. Experiments on the MLUA-DC1000 dataset show that CarDiff achieves improved synthesis quality compared with existing semantic synthesis baselines, obtaining the best Fréchet Inception Distance (FID) (90.76) and Learned Perceptual Image Patch Similarity (LPIPS) (0.48) scores among evaluated methods. We further assess the generated radiographs for downstream segmentation augmentation across seven architectures. Using a 5x augmented training set improves average Dice score by up to 6.5%, with larger gains observed for medium and combined lesion classes. These results suggest that anatomically consistent diffusion synthesis may be useful for dental radiograph augmentation under limited supervision. The code is available at https://github.com/s4nyam/CarDiff.

[75] MedICL: Modality-Anatomy-Aware Visual In-Context Learning for Medical Visual Question Answering cs.CVPDF

Ji-jun Park, Soo-joon Choi, Seungmin Han, Haeun Kwon, Jiwon Jeong

TL;DR: 论文提出 MedICL，一种无需训练的医学视觉问答（VQA）视觉上下文学习框架。它不重新训练模型，而是通过筛选模态-解剖对齐的示例、用弱检索信号加强验证投票构建可靠示例集，并采用异常感知聚合与冲突重答策略，使冻结的医学 LVLM 获得更合适的回答风格。

Details

Motivation: 医学 LVLM 的免训练部署是实际需求，但普通视觉 ICL 会把模态和风格不匹配的示例注入医学上下文，导致冻结模型学到错误的回答风格。

Result: 在 VQA-RAD、SLAKE、PathVQA 上，基于 LLaVA-Med 零样本协议，MedICL 将最强零样本基线在开放题上提升 11-14 点、封闭题上提升 7-14 点；在 VQA-RAD 上以零训练成本恢复 71% 的微调开放题性能，并对示例库偏移或损坏保持鲁棒。

Insight: 论文宣称的创新点是示例策展而非模型重训练：MADS 选择模态-解剖对齐且覆盖互补解释维度的示例，W2C 用弱检索加强验证投票检查示例而非模型输出，ECC 用异常感知签名聚合并在冲突时重答。客观看，其价值在于把示例选择与验证机制引入医学 ICL，强调示范质量与可靠性对冻结模型适配的关键作用。

Abstract: Training-free adaptation of medical vision-language models (LVLMs) is a deployment requirement, yet visual in-context learning (ICL) injects modality- and style-mismatched demonstrations into medical contexts, teaching a frozen model the wrong answering style. We present MedICL, which curates demonstrations instead of retraining the model. MADS selects modality-anatomy aligned demonstrations that cover complementary interpretation dimensions; W2C curates them with weak retrieval signals and a strong verification vote that checks demonstrations rather than the model’s own outputs; ECC answers with W anchored demonstration sets, aggregates by abnormality-aware signatures, and re-answers once on conflict. On VQA-RAD, SLAKE, and PathVQA under the LLaVA-Med zero-shot protocol, MedICL improves the strongest zero-shot baseline by +11 - +14 points on open-ended and +7 - +14 on closed questions, recovers 71% of fine-tuned open-ended performance on VQA-RAD at zero training cost, and stays robust to shifted or corrupted demonstration banks.

[76] SAMP: Self-Adaptive Margin Prioritization For Robust Diffusion Watermarking cs.CV | cs.AI | cs.MMPDF

Yuhao Xue, Jiuan Zhou, Yu Cheng, Zhaoxia Yin

TL;DR: 论文提出 SAMP，一种面向扩散模型鲁棒水印的自适应框架，通过全局 margin 调节和脆弱性敏感分配，在去噪过程中动态调整水印嵌入强度，并对更易受扰动影响的水印维度给予更高优化优先级，以兼顾水印鲁棒性和生成质量。

Details

Motivation: 现有扩散水印方法通常在去噪中采用固定嵌入强度，并同等对待所有水印维度，导致可靠维度上产生不必要失真，而脆弱维度又强化不足，因此需要同时自适应嵌入强度和水印维度优化优先级。

Result: 实验结果显示 SAMP 的平均信息恢复准确率达到 0.993；相比 state-of-the-art 方法，PSNR 提升 16.8%，LPIPS 降低 47.1%，验证了其在可靠且高质量扩散水印上的有效性。

Insight: 论文宣称的创新点在于全局 margin 调节与脆弱性敏感分配相结合：根据目标码字与竞争码字的间隔及常见攻击影响调整嵌入强度，并优先优化易被局部扰动削弱的水印维度；从客观角度看，其可借鉴之处是对水印维度和去噪阶段进行细粒度鲁棒性建模与自适应资源分配。

Abstract: Diffusion models have made high-fidelity visual generation widely accessible, while also lowering the barrier to producing convincing visual forgeries and complicating content provenance. Existing watermarking methods typically use a fixed embedding strength throughout denoising or treat all watermark dimensions equally. As a result, they may introduce unnecessary distortion when some watermark dimensions are already reliable, while failing to sufficiently reinforce those that are more vulnerable to subsequent perturbations. Therefore, robust watermarking requires adapting both the embedding strength during denoising and the optimization priority across watermark dimensions. To address this problem, we present SAMP, a self-adaptive framework consisting of global margin regulation and vulnerability-sensitive allocation. Global margin regulation adjusts the embedding strength according to the separation between the target codeword and competing codewords, together with the estimated effects of common attacks. Vulnerability-sensitive allocation identifies watermark dimensions that are more easily weakened by local perturbations and gives them higher optimization priority. Experimental results demonstrate that SAMP achieves an average information recovery accuracy of 0.993. Compared with state-of-the-art methods, SAMP improves PSNR by 16.8% and reduces LPIPS by 47.1%. These results validate the effectiveness of SAMP for reliable and high-quality diffusion watermarking.

[77] CRaFT-XDet: Causal and Robust Fusion Transformer for Dual-Energy X-ray Prohibited Item Detection cs.CV | cs.AI | cs.LGPDF

Moinul Hossain, Munshaibur Rahman Mahin, Taskin Khaleque, Mohammad Sakib Mahmood, M. F. Mridha

TL;DR: 论文提出 CRaFT-XDet，一个面向双能 X 射线违禁品检测的因果鲁棒融合 Transformer 框架，将检测建模为衰减驱动模态变化下的不变表示学习。方法结合因果特征解耦、物理启发的材料一致性正则化以及跨能量 Transformer 交互建模，以提升重叠、杂乱背景和跨扫描仪场景下的检测鲁棒性。

Details

Motivation: 现有 X 射线违禁品检测器多依赖外观监督，易受严重物体重叠、扫描仪相关域偏移以及杂乱行李构成带来的虚假相关影响，导致跨扫描仪泛化和可靠性不足。论文旨在从因果视角抑制上下文捷径，学习扫描仪不变且材料一致的威胁表示。

Result: 模型仅 29.2M 参数、89.5 GFLOPs，达到 345 FPS（1.7 ms 推理），具备实时部署能力。在 SIXray 五折交叉验证上取得 0.9389 mAP@0.5 和 0.8021 mAP@0.5:0.95，并在 OPIXray、HiXray 上无域适应保持较强跨数据集泛化；二分类威胁检测召回率 93.92%，平均 IoU 0.9031。

Insight: 创新点在于提出 Scanner-Invariant Causal Detection 形式化与因果不变正则化 CIR，理论上近似干预分布 P(Y | do(Xobj))；并通过因果特征解耦抑制上下文虚假捷径、物理正则约束材料一致嵌入、Transformer 建模跨能量交互，为双能 X 射线检测提供因果化与物理启发的融合思路。

Abstract: Automated prohibited item detection in X-ray security imagery is fundamentally constrained by severe object overlap, scanner-dependent domain shifts, and spurious correlations induced by cluttered baggage composition. Existing detectors largely rely on appearance-driven supervision, limiting their robustness and cross-scanner generalisation. We introduce CRaFT-XDet, a causality-grounded and physics- motivated detection framework that reformulates X-ray threat detection as invariant representation learning under attenuation-driven modality variation. Our approach is grounded in a Scanner-Invariant Causal Detection formalisation (Theorem 1), which establishes that minimising the proposed Causal Invariance Regularisation (CIR) objective across partitioned scanner environments approximates the interventional distribution P (Y | do(Xobj)) under standard identifiability assumptions, providing a principled causal formulation for dual-energy X-ray detection. CRaFT-XDet integrates: (i) causal feature disentanglement to suppress context-induced shortcuts; (ii) physics-motivated regularisation to enforce material-consistent embeddings; and (iii) transformer-based cross-energy interaction modelling for structured reasoning in cluttered scenes. With 29.2 M parameters, 89.5 GFLOPs, and 345 FPS (1.7 ms inference), CRaFT-XDet is real-time deployable. Trained on SIXray with five-fold cross-validation, the framework achieves 0.9389 mAP@0.5 and 0.8021 mAP@0.5:0.95. Without domain adaptation, CRaFT-XDet maintains strong cross- dataset performance on OPIXray and HiXray, indicating robust generalization across heterogeneous scanner distributions. In category-agnostic binary threat detection, the model attains 93.92% recall and 0.9031 mean IoU, highlighting reliability in safety-critical screening where missed detections are costly.

[78] When frequency domain classification is superior to spatial cs.CV | cs.CLPDF

Yanir Harel, Shalom Rosner, Ronit D. Gross, Tal Halevi, Shilo Glam

TL;DR: 论文研究图像分类在频域与空间域表现差异的原因，指出频域分类精度下降主要源于缺乏局部特征。通过频域局部交换实验和含全局特征数据集的验证，作者构建了结合频域模型与空间域模型的混合模型，并在多个数据集上评估VGG和ViT架构，取得更高分类准确率。

Details

Motivation: 现代图像分类模型依赖局部特征，在空间域表现良好，但频域虽包含相同信息却分类表现较差；论文旨在解释这一差距并利用频域与空间域互补性提升分类性能。

Result: 论文在ImageNet-100、WikiArt、DTD、FMD、PSVRT和KTH-TIPS2-b等数据集上训练并评估所提出的VGG和ViT混合模型，宣称相比单一域模型获得更高分类准确率；摘要未给出具体数值或SOTA结论。

Insight: 创新点在于诊断频域精度下降源于局部特征缺失，并通过频域局部交换实验及全局特征数据集验证该解释；进一步提出融合仅频域训练模型与仅空间域训练模型的混合架构，客观上有助于理解不同表示域的归纳偏置并利用域间互补性。

Abstract: Modern image classification models largely rely on local characteristics and feature extraction for their predictions. This focused approach works well in the spatial domain, but reportedly falls short in the frequency domain, even though both representations contain the same information. This study demonstrates that the significant reduction in accuracy in the frequency domain stems from the lack of local features. Locally swapping data in the frequency domain significantly decreases its inverse spatial domain accuracy, even below that of the frequency domain; however, the frequency domain accuracy remains relatively constant. Moreover, the use of datasets containing global features in the spatial domain yields higher accuracy in the frequency domain. Using these results, a hybrid model is constructed, combining one model trained only in the frequency domain and another trained only in the spatial domain to achieve higher classification accuracy. The proposed visual geometry group (VGG) and vision transformer (ViT) architectures are trained on the ImageNet-100, WikiArt, DTD, FMD, PSVRT, and KTH-TIPS2-b datasets and evaluated.

[79] Faithful Where You Look: Anchor-Based Evaluation Hides Text Fabrication in Image-Conditioned Video Generation cs.CVPDF

Yujia Wang

TL;DR: 论文研究图像条件视频生成模型在展示真实地点时是否忠实于参考图像中的文本。作者发现现有基于标注锚点区域的文本保真度评测会掩盖大部分失败：模型在锚点处接近无模型控制，但在外围区域大量生成参考中不存在的可读文本。论文通过东京店铺街景实验、盲评和预注册复现揭示该评估盲区，并强调需要超越锚点、覆盖外围文本的评测方法。

Details

Motivation: 图像条件视频模型常用于展示真实地点，因此输出是否忠实于参考地点是实际问题；但现有文本基准只在标注锚点区域检查保真度，可能隐藏外围区域的文本伪造失败。

Result: 在48个东京店铺街景参考、四个来自三家厂商的模型上，锚点文本保真度为0.90-0.94，接近无模型控制0.996且模型间难以可靠区分；外围区域36-54%的生成文本区域在参考中无对应，而控制仅1.6%。盲评一致性kappa为0.83-0.96，预注册复现中两供应商分别达42%和56%，VBench-I2V参考一致性分数未显示追踪到该问题；伦敦拉丁字母复现第一轮未达标、独立第二轮达标。

Insight: 论文的核心创新是指出anchor-based评估会系统性隐藏文本伪造，并将评测范围扩展到外围文本区域；其客观价值在于用多模型、盲评、预注册复现和公开代码数据系统验证评估盲区，提示未来文本保真度基准应覆盖非锚点区域并关注参考中无文本或不可读处的伪造成本。

Abstract: Image-conditioned video models are used to show real places, so whether their output stays faithful to the place they were shown is a practical question. The text benchmarks we found that check fidelity against a reference do so at an anchor - an annotated region, typically the sign the task is about. We show that this choice hides most of the failure. We conditioned four models from three vendors on 48 street-level references of Tokyo storefronts and measured text fidelity at the annotated sign and in the periphery, the other text the reference covers. At the anchor, all four models are close to a no-model control (anchor text fidelity 0.90-0.94 against 0.996) and are not reliably separated from one another. In the periphery, 36-54% of generated text regions have no counterpart in the reference, against 1.6% for the control, although every prompt forbade new readable text. Two blinded raters agree on which regions are fabricated (kappa = 0.83-0.96), the result held in preregistered rounds on two vendors whose videos the measure had never seen (42% and 56%), and VBench-I2V’s reference-based consistency scores show no evidence of tracking it in our sample. Most fabricated text is legible-looking text where the reference shows none or cannot be read - a form that string-matching metrics discard, which is why our own first measure missed it. A preregistered Latin-script replication in London missed its bar in a first round and met it in an independent second round. We release code, annotations, per-video scores, ratings and every preregistration. Code and data: https://github.com/geoywang/refanchor-bench

[80] HistGramBench: Measuring Structural Recovery When Multimodal Models Redraw Historical Mathematical Diagrams as TikZ cs.CV | cs.CL | cs.DLPDF

Minh Quang Tran, Carter He, Cameron Bloch, Zitai Huang, Thien Truong Vo

TL;DR: 论文提出 HistGramBench，一个包含 2507 幅历史数学图表的数据集，这些图表来自 1551 至 1933 年间、8 种语言的 95 部著作。任务要求多模态模型将扫描图表重绘为 TikZ 绘图程序，并通过图中应恢复的几何事实来评估结构还原能力。作者评测了 6 个低成本 AI 模型，发现最佳模型仅能恢复约五分之三的事实，且多数错误来自模型未生成任何绘图。

Details

Motivation: 历史数学书籍中的字母标注图多以扫描图像保存，内容不可检索；将图重绘为 TikZ 可记录点、线、圆等结构关系，但历史印刷图缺少可用于校验重绘结果的源程序或真值，因此需要构建可评测基准。

Result: 在 HistGramBench 上评测 6 个低成本 AI 模型，最佳模型约恢复 60% 的图表事实；多数漏检来自模型未成功生成绘图，平行关系和相切关系最难复现。

Insight: 创新点在于构建跨年代、多语言的历史数学图表基准，并利用不同提供商的 AI 模型对读者可从图中获得的事实达成一致，再在模型自身生成的绘图上核对这些事实，从而在无源程序条件下衡量图像到 TikZ 的结构恢复能力。

Abstract: Digital libraries preserve mathematical books printed from the sixteenth to the twentieth century, but the lettered diagrams in them, the figures on which Euclidean proofs depend, remain scanned images whose content cannot be searched. Redrawing such a diagram as a short drawing program would record which points lie on which lines and circles. But a printed plate offers no source code against which the redrawing could be checked. We introduce HistGramBench, a benchmark of 2,507 diagrams from 95 works printed between 1551 and 1933 in eight languages. For each diagram, two AI models from different providers agree on the facts a reader takes from the figure, such as which lines are parallel or where two lines meet, and every redrawing is checked against those facts on the model’s own drawing. We evaluate six affordable AI models. The best recovers about three fifths of these facts, and most of what the models miss comes from programs that never produce a drawing. Parallels and tangencies are the hardest relations to reproduce. HistGramBench gives historians and librarians a way to measure when such tools can make old mathematical diagrams searchable.

[81] OCRia-1 Technical Report cs.CVPDF

Aman Rangapur, Antonio Jimeno Yepes, Daniel Bustamante, Nutchapol Dendumrongsup, Sebastián G. Acosta

TL;DR: OCRia-1 是一个 4B 的视觉语言模型，专注于文档解析，尤其擅长保留表格结构、提取图表数据以及保留文本格式。它面向合并单元格、跨页表头、超大型表格、图表数据以及粗体/斜体/上下标等复杂排版内容。论文强调高质量数据构建与多维奖励设计，并通过 SFT 与 RLVR 训练提升解析精度，同时采用推测解码、量化和自定义内核实现高速推理。

Details

Motivation: 传统文档解析在复杂表格结构、图表数据提取和文本格式保真方面仍具挑战，尤其是合并单元格、跨页表头、数千单元格大表格及 meaningful formatting。论文旨在构建一个中小规模但高精度、高效率的文档解析 VLM，保留商业文档分析所需的关键细节。

Result: 在评估的表格、图表和文本格式等维度上取得最高分，超过包括 35B 模型和 Mistral OCR 4.1 在内的系统；四维 ParseBench 平均分为 0.87，次优系统为 0.75。推理速度约 4700 tokens/s（单 B200 单请求），约为基座模型在 stock vLLM 上的 9 倍，宣称是同类已发布文档解析 VLM 中最快的。

Insight: 创新点主要在于强调数据质量与多样性优先于数量：合成页面提供长表格和复杂格式的精确真值，真实页面通过基于 PDF 文本层的流程转写；同时设计针对表格重建、图表数据提取和文本格式保真的维度特定可验证奖励，结合 SFT 与 RLVR 优化。工程上通过 block-diffusion speculator、量化和自定义内核显著提升解码速度。

Abstract: We introduce OCRia-1, a 4B vision-language model (VLM) for document parsing that excels at preserving table structure, extracting chart data and retaining text formatting. OCRia-1 handles content that has traditionally been challenging in document parsing: merged cells and spanning headers, tables with thousands of cells, chart data, and meaningful text formatting such as bold, italics, subscripts and superscripts, preserving details needed for business-critical document analysis. At the time of this report, it achieves the highest scores on tables, charts and text formatting among the systems evaluated, including a 35B model and Mistral OCR 4.1. Its mean ParseBench score over the four dimensions we evaluate is 0.87, against 0.75 for the next-best system. We emphasize data quality and reward design in training OCRia-1. Synthetic pages provide exact ground truth for long tables and rich formatting, while real pages are transcribed using a pipeline grounded in the PDF text layer. We attribute OCRia-1’s performance primarily to careful data curation that prioritizes quality and diversity over quantity. Dimension-specific rewards evaluate table reconstruction, chart-data extraction and text-formatting fidelity. We train the model on the curated data using supervised fine-tuning (SFT), then refine it through reinforcement learning with verifiable rewards (RLVR). To our knowledge, OCRia-1 is the fastest published document-parsing VLM in its class, decoding at about 4,700 tokens per second with a single request on one B200 GPU, about nine times faster than the base model on stock vLLM. This is achieved through a block-diffusion speculator, quantization and custom kernels.

[82] Pano2BIM: A Geometry-Constrained Vision-Language Agent for As-Built BIM Generation from a Floor Plan and a Single 360$^\circ$ Image cs.CV | cs.AIPDF

Juan Diego Castaño Molina, Borja García de Soto

TL;DR: 论文提出Pano2BIM，一种几何约束的视觉语言模型智能体，从平面图和单张360度图像生成LOD200的IFC4竣工BIM模型。该方法利用VLM识别地标和物体，结合确定性工具估计相机姿态、射线投射计算度量位置并检查空间约束，可选第二阶段通过渲染比较反馈丰富模型。

Details

Motivation: 数字孪生需要准确反映物理条件的竣工BIM，但传统生成和维护成本高昂。现有图像方法缺乏结构化BIM信息，而视觉语言模型难以可靠地完成度量级物体放置。

Result: 在单个实验室的初步评估中，Measure工作流平均家具足迹IoU为0.53（单响应基线0.44），7个固定家具元素平均匹配4.0个（基线2.3）。测量阶段平均3.8分钟、API成本1.63美元，完整演示流程约42分钟、11美元。

Insight: 创新点在于将VLM识别与确定性几何工具（相机姿态估计、射线投射、空间约束检查）结合，生成结构化IFC模型，并通过渲染比较反馈增强而不修改主要家具几何。客观分析：混合架构有效弥补了VLM度量不可靠的缺陷，且验证了快速低成本竣工BIM生成的可行性。

Abstract: Digital twins require accurate, up-to-date building information models (BIM) that reflect physical conditions, yet generating and maintaining as-built models remains costly and labor-intensive. Emerging image-based methods can capture visual appearance without inherently producing structured BIM information, while vision-language models (VLMs) struggle with reliable metric object placement. This paper presents Pano2BIM, a geometry-constrained VLM agent that generates approximate IFC4 models at Level of Development (LOD) 200 from a floor plan with known room dimensions and a single 360-degree photograph. The VLM identifies landmarks and objects, while deterministic tools estimate camera pose, compute metric positions through ray casting, and check spatial constraints. An optional second stage enriches the presentation model through render-and-compare feedback without modifying the primary furniture geometry. In a preliminary evaluation on one laboratory, the proposed Measure workflow achieved a mean furniture-footprint intersection over union (IoU) of 0.53, compared with 0.44 for a single-response baseline using identical modeling instructions, and matched an average of 4.0 versus 2.3 of seven fixed furniture elements across three runs. Centroid disagreements were similar for the four elements consistently identified by both approaches. The measurement stage averaged 3.8 minutes and USD 1.63 in API costs per run, while the complete demonstrated workflow required approximately 42 minutes and USD 11. These findings demonstrate the feasibility of rapid, low-cost as-built BIM generation, with potential applications in maintaining digital twins that reflect changing physical conditions.

[83] Demystifying Prompt Stealing Attacks against Synthetic Video cs.CV | cs.AI | cs.CRPDF

Junyan Huang, Sanskar Agmain, Chen Gong, Yan Pang, FNU Suya

TL;DR: 论文研究针对合成视频的提示窃取攻击，发现仅恢复提示词难以高保真重建视频。作者提出 V-PSA：利用恢复的 caption 和 DDIM inversion 在独立生成器下构造参考轨迹，并用 Null-Text Inversion 优化每步无条件嵌入以减小重建偏差，同时支持修改 caption 进行受控编辑。论文构建了含 12,000 个视频-提示对的 benchmark，V-PSA 的视频间相似度约 0.9，显著优于仅提示词基线的约 0.6。

Details

Motivation: 创作者公开生成的合成视频可能被攻击者用于未授权复现和定制。论文关注：攻击者能否仅凭单个公开视频、在无法访问原始 prompt 或生成器的情况下，推导出可复用输入以实现忠实重建和受控编辑。

Result: 在包含 3 个受害生成器和 4 个提示源、共 12,000 个视频-提示对的 benchmark 上，V-PSA 达到约 0.9 的视频到视频相似度，显著超过仅提示词基线的约 0.6，并支持保留目标布局和运动结构的多种受控变化；将 inversion 得到的输入增强到已有图像 PSA 中也能提升重建效果。

Insight: 创新点在于指出仅评估 prompt recovery 会低估攻击者的重建能力，并提出用 DDIM inversion 和 Null-Text Inversion 构造并逼近参考轨迹，使恢复输入在独立生成器下也能高保真重建和编辑。客观上看，其可借鉴之处是将 inversion-derived inputs 作为攻击/重建信号，而非只依赖文本提示恢复。

Abstract: Creators publicly showcase generated content to advertise and sell their work, but these examples may also enable unauthorized reproduction and customization. We study whether an adversary can derive reusable inputs from a single public video for faithful reconstruction and controlled editing, without access to the original prompt or generator. We adapt captioning and prompt optimization approaches to video prompt stealing attacks (PSAs) and find that prompt recovery alone provides limited reconstruction fidelity. Even the original prompt produces different spatial and temporal realizations when the initial noise changes. Using an independent generator enlarges the reconstruction gap, as reusing the original prompt and seed can still produce substantially different videos. We propose V-PSA, which uses a recovered caption and DDIM inversion to construct a reference trajectory under an independent generator. Null-Text Inversion then optimizes per-step unconditional embeddings to reduce deviations from this trajectory during reconstruction. The resulting inputs also guide generation when the caption is modified, supporting edits that change selected content while preserving the target’s layout and motion. We construct a benchmark containing 12,000 video-prompt pairs from three victim generators and four prompt sources. V-PSA achieves video-to-video similarity around 0.9 between target and reconstructed videos, substantially improving over prompt-only baselines with similarity score of 0.6, and supports multiple controlled variations that preserve the target’s structure. Additional experiments show that augmenting prior image PSAs with inversion-derived inputs also improves reconstruction. Our results show that evaluations restricted to prompt recovery can underestimate an attacker’s ability to reconstruct public generative outputs.

[84] Dynamic Merging Mutually-Distilled Multi-View Networks for RGB-Event-based Representation Learning cs.CV | cs.LGPDF

Futian Wang, Fan Zhang, Xiao Wang, Yuhe Ding, Shiao Wang

TL;DR: 论文面向RGB-Event多模态表示学习，提出一种动态合并的互蒸馏多视图网络框架。方法先用多个编码器提取不同类型的事件表示，并在特征级和logit级进行互知识蒸馏，再对第一阶段得到的模型参数执行动态层次化模型合并，最终形成统一的RGB-Event多模态表示模型。实验表明该框架在多个事件相机数据集上取得显著性能提升。

Details

Motivation: 现有RGB-Event融合方法通常先将事件流转换为帧、体素或张量，再从这些转换表示中学习时空信息，难以充分利用事件数据的表示能力；同时标准训练流程也未充分挖掘学习过程中产生的多样模型参数。

Result: 摘要在多个基于事件的数据集上验证了所提框架，并报告取得显著性能提升，但未给出具体数值、具体benchmark名称或明确的SOTA对比结论。

Insight: 创新点在于将多视图事件表示学习、特征级与logit级互蒸馏，以及动态层次化模型参数合并结合，实现参数级RGB-Event多模态融合；其可借鉴之处是利用多编码器蒸馏与模型合并来整合多种事件表示，而不仅依赖单一转换后的事件表示。

Abstract: Multi-modal fusion algorithms combining conventional frame-based cameras and event cameras have recently attracted substantial research attention. Typically, existing approaches convert event streams into frames, voxels, or tensors, and then learn the required spatiotemporal information from these transformed event representations for fusion with conventional frame-camera data. Obviously, such paradigms only exploit the limited representational capacity of event data. Moreover, standard training pipelines fail to fully leverage diverse model parameters obtained throughout the learning process. In this paper, we propose a novel mutual distillation method leveraging multi-view teacher network weights to better integrate multiple event representations and achieve model-parameter level fusion. Specifically, we employ multiple encoders to extract different types of event representations and perform mutual knowledge distillation at both the feature-level and logit-level in this process. Afterwards, we perform a dynamic hierarchical model merge strategy on the model parameters from the first stage to yield a unified multi-modal RGB-Event representation model. Experimental results across multiple event-based datasets demonstrate that our proposed framework achieves significant performance improvements.

[85] A New Formulation of the Elastica Model with Application to Image Inpainting cs.CV | math.OCPDF

Zuoqiang Shi, Xue-Cheng Tai

TL;DR: 论文针对Euler elastica能量在曲线建模中因曲率项导致非线性、非凸且（level-set下）不可微、难以最小化的问题，提出基于曲线二值表示的新Elastica模型。其核心是用径向核卷积估计曲率，避免对二值函数求导，并用FFT计算卷积，使能量转化为加权全变差，形式上推广ROF模型。结合FFT与分裂Bregman/增广拉格朗日方法设计高效算法，并在二值图像修复实验中验证有效性。

Details

Motivation: 传统Elastica模型通常依赖level-set或phase-field表示，曲率项使能量非线性、非凸甚至不可微，最小化困难。论文希望借助曲线的二值表示和简单曲率公式，降低模型优化难度并用于图像修复。

Result: 摘要未给出具体定量指标或benchmark对比，仅报告了在二值图像修复上的数值实验，说明所提算法有效；未宣称达到SOTA或与特定模型相当。

Insight: 创新点在于提出二值曲线下由径向核卷积近似曲率的简单公式，避免导数计算并用FFT加速；由此得到加权全变差型能量并推广ROF模型，同时结合分裂Bregman/ALM形成子问题易求解的高效算法。客观上看，其可借鉴之处是将非局部卷积曲率估计嵌入变分模型，以简化优化并保持与经典弹性模型的联系。

Abstract: Curves and interfaces play a central role in computer vision and image processing, and Euler’s elastica energy is one of the most successful tools to model and manipulate them. The elastica energy is usually computed through a level-set or a phase field representation of the curve, in which the curvature term makes the energy nonlinear, non-convex and, in the level-set case, non-differentiable, so that its minimization is notoriously difficult. In this paper, we propose a new formulation of the elastica model based on a binary representation of curves. The key ingredient is a very simple formula for the curvature: if $φ$ is the $\pm1$ binary function associated with a curve $Γ$, then along $Γ$ the curvature is given by $-\frac{1}{C_0ε}\left(R_ε*φ\right)+O(ε)$, where $R_ε$ is a radial kernel supported in a ball of radius $ε$ and $C_0$ is an explicit constant. No derivative of $φ$ is involved and the convolution is evaluated by FFT. The resulting energy is a weighted total variation, so that formally the new formulation is a generalization of the well-known ROF model; a phase field type model is obtained from the same curvature formula. Combining FFT with the split Bregman iteration, which for the present problem coincides with an augmented Lagrangian method (ALM), we obtain efficient algorithms whose subproblems are either linear systems solved by conjugate gradient or explicit pointwise formulas. Numerical experiments on the inpainting of binary images are presented to demonstrate the effectiveness of the proposed algorithms.

[86] SpatialVec: A Unified Representation Learning Framework for Geospatial Objects with Boundary-Aware Sampling cs.CV | cs.DB | cs.IR | cs.LGPDF

Samya Acharja, Kanchan Chowdhury

TL;DR: 论文提出 SpatialVec，一个面向地理空间对象（点、折线、多边形）的统一空间表示学习框架。该方法通过边界感知自适应采样几何边界及其周边区域，并利用基于 Transformer 的编码器-解码器以几何重建任务训练，从而生成紧凑、几何感知且统一的表示。实验表明其在保留复杂多边形交互相关拓扑关系方面优于现有方法，并在下游预测与分类任务上显著超越 SOTA 基线。

Details

Motivation: 现有空间编码方法难以保留细粒度拓扑信息，尤其对折线和多边形等复杂几何的交互，边界结构与局部空间上下文建模不足，导致边界附近拓扑敏感关系在嵌入空间中表示不充分，影响下游空间推理。

Result: 在两个真实世界数据集上，SpatialVec 显著提升了涉及多边形交互的挑战性拓扑关系保持能力，并在下游预测和分类任务上显著优于当前最优基线。

Insight: 论文的创新点在于边界感知的自适应采样策略与几何重建驱动的统一表示学习，将点、折线、多边形纳入同一编码框架。客观来看，其可借鉴之处是利用边界及邻域采样强化细粒度拓扑结构，并通过重建式自监督训练获得几何感知的统一空间嵌入。

Abstract: Spatial representation learning is essential for Geospatial Artificial Intelligence (GeoAI) applications, enabling machine learning models to capture the geometry, location, and spatial relationships of geographic entities such as points, polylines, and polygons. Existing spatial encoding methods often struggle to preserve fine-grained topological information, particularly for interactions involving complex geometries such as polylines and polygons. These approaches inadequately capture boundary structure and local spatial context, causing topology-sensitive relationships near geometry boundaries to be underrepresented in the learned embedding space. Consequently, accurately modeling complex spatial interactions remains a significant challenge for downstream spatial reasoning tasks. To fill the gap, we introduce SpatialVec, a boundary-aware spatial representation learning framework that adaptively samples geometry boundaries and their surrounding regions, capturing fine-grained geometric structures critical for topology-aware spatial reasoning. A transformer-based encoder-decoder trained through geometry reconstruction produces compact, geometry-aware, and unified representations for points, polylines, and polygons. Empirical evaluation on two real-world datasets shows that SpatialVec substantially improves the preservation of challenging topological relationships involving polygonal interactions and outperforms state-of-the-art baselines significantly on downstream prediction and classification tasks.

[87] Brain-Behavior Modeling from Multimodal MRI using Opportunistic Pretraining and Common-Cohort Adaptation cs.CVPDF

Md. Tanvir Rahman, Taslima Ferdaus Shuva, Nabil Anan Orka, Asaduzzaman Khan, Mohammad Ali Moni

TL;DR: 论文利用ABCD基线数据，提出一种两阶段机会性预训练与共同队列适配的多模态MRI深度集成方法，分别对结构/弥散、静息态和任务态MRI建模并融合，用于预测流体、晶体和总体认知能力。方法先在部分模态可用的较大队列上预训练，再适配到共同训练队列，并用Ridge回归融合多模态模型。实验显示两阶段训练和多模态融合带来小幅但一致的性能提升。

Details

Motivation: 多模态认知预测常受限于样本中影像模态覆盖不完整，导致可用样本量减少；论文希望利用部分观测队列进行模型开发，并评估多模态融合对认知预测的价值。

Result: 两阶段训练在27项比较中的24项提升平均测试R^2（中位增益0.0081）；融合较最强单模态模型提升平均R^2约0.0051-0.0333，并降低MAE约0.0067-0.0976。任务态+静息态融合在流体认知（R^2=0.2222）和总体认知（0.3665）最高，结构+静息态在晶体认知最高（0.3706），相对仅协变量模型分别提升0.0805、0.1180和0.0890。

Insight: 创新点在于面向模态不完整数据的“机会性预训练+共同队列适配”两阶段策略，以及按模态分别建模后用Ridge回归融合的深度集成框架；消融表明扩大预训练是主要增益来源，梯度归因揭示目标依赖的输入模式。客观看，其价值在于验证了利用部分观测大队列进行多模态认知建模的可行性和小幅融合收益。

Abstract: Incomplete imaging coverage limits sample sizes for multimodal cognitive prediction. We evaluated a two-stage opportunistic deep ensemble using baseline Adolescent Brain Cognitive Development Study data to predict fluid, crystallized, and total cognition. Separate neural models processed structural/diffusion, resting-state, and task-based MRI data with covariates. Models were pretrained on eligible modality cohorts (up to 9,686 participants), adapted to common training cohorts, and fused via Ridge regression (trimodal cohort: 4,216 participants). Five-fold family-aware cross-validation compared this approach against constituent and covariate-only models. Two-stage training increased mean test coefficient of determination (R^2) in 24 of 27 comparisons (median gain: 0.0081). Fusion increased mean R^2 by 0.0051-0.0333 over the strongest constituent and reduced mean absolute error by 0.0067-0.0976. Task-plus-resting-state and trimodal ensembles reduced absolute error across all targets (nominal p <= 0.0108). Task-plus-resting-state fusion achieved the highest mean R^2 for fluid (0.2222) and total cognition (0.3665), while structural-plus-resting-state led for crystallized cognition (0.3706), yielding R^2 gains of 0.0805, 0.1180, and 0.0890 over covariate-only references. Ablations showed expanded pretraining drove most improvements. Gradient-based attribution identified target-dependent input patterns. These findings support using partially observed cohorts for model development to achieve modest fusion gains. Pending external validation, this approach may support MRI-informed cognitive phenotyping.

[88] DTP-OPSD: Reinforcement Learning with Distractor-Aware Temporal-Privilege On-Policy Self-Distillation for Temporal Video Grounding cs.CV | cs.AI | cs.LGPDF

Zhaoyu Chen, Yongwei Nie

TL;DR: 论文提出 DTP-OPSD，一种面向时序视频定位（TVG）的强化学习框架，结合干扰感知的时间特权同策略自蒸馏。学生模型看原始视频并在线生成响应，共享权重教师模型看带有目标窗口红色边框和同视频干扰窗口蓝色边框的特权视频，并对学生生成前缀提供 token 级 Jensen-Shannon 散度稠密监督。该方法在 GRPO 因硬样本全零 tIoU 而缺乏策略梯度时仍能提供学习信号，并通过 VLM 筛选与人工验证构建小型难干扰训练集。

Details

Motivation: TVG 在视频中存在多个重复、相似或相反事件时很难定位正确片段；GRPO 采样响应可能全部错过目标并得到零 tIoU，导致组相对优势全为零、无有效策略梯度。论文旨在为这类硬样本提供额外且稠密的学习信号。

Result: 仅增加 300 个后训练样本，DTP-OPSD 在 Charades-TimeLens、ActivityNet-TimeLens、QVHighlights-TimeLens 上分别达到 55.93、54.77、66.71 mIoU，为对比的开源 8B 模型中最高。相比同数据训练的 Pure GRPO，报告的全部 12 项指标均提升，三个基准上 R1@0.7 分别提升 1.28、1.62、1.78 点。

Insight: 创新点在于用带目标和干扰窗口标记的特权视频作为教师输入，以 token 级 JS 散度提供稠密自蒸馏监督，缓解 GRPO 零优势问题；同时根据教师是否优于学生及学生是否全零 tIoU 自适应抑制或增强蒸馏，并结合 VLM 筛选和人工验证构造难干扰训练集。

Abstract: Temporal Video Grounding (TVG) aims to localize the start and end times of an event described by a language query in a video. The task becomes particularly challenging when the same video contains multiple repeated, similar, or opposite events. On these hard examples, all responses sampled by Group Relative Policy Optimization (GRPO) may miss the target and receive zero temporal Intersection-over-Union (tIoU). Their group-relative advantages are then all zero, leaving no useful policy gradient signal. To address this, we propose DTP-OPSD, a reinforcement learning framework with distractor-aware temporal-privilege on-policy self-distillation. The student observes the clean video and generates responses on-policy, while a shared-weight teacher observes a privileged video in which the target window is marked by red full-frame borders and same-video distractor windows by blue full-frame borders. For the distillation loss, the teacher evaluates student-generated prefixes and provides dense token-level Jensen-Shannon divergence supervision. This supervision remains informative even when GRPO provides no policy gradient signal. We suppress distillation when the teacher does not outperform the student and strengthen it for groups where the teacher performs better but all student rollouts receive zero tIoU. We also construct a compact hard-interference training set through VLM screening and human verification. With only 300 additional post-training examples, DTP-OPSD achieves the highest mIoU among the compared open-source 8B models on Charades-TimeLens, ActivityNet-TimeLens, and QVHighlights-TimeLens, reaching 55.93, 54.77, and 66.71, respectively. Compared with Pure GRPO trained on the same data, DTP-OPSD improves all 12 reported metrics, with R1@0.7 gains of 1.28, 1.62, and 1.78 points on the three benchmarks. Code will be released at https://github.com/nian1125/DTP-OPSD

[89] Seeing the Unseen: Unified Visible–Invisible Motion for Physically Consistent Video Generation cs.CVPDF

Mingyang Bao, Fangda Ye, Xihao Chen, Bobo Li, Jason Li

TL;DR: 论文提出一种面向物理一致视频生成的统一框架，将问题分解为物理动力学学习与运动引导注入两个阶段。方法先用轻量级基于粒子的图动力学模拟器（PGDS）从数据中学习可泛化的物理交互并预测3D运动轨迹，再构建可见—不可见运动场（VIMF）同时表征输入帧中可见的运动和随时间演化出现的不可见运动，并将该结构化运动引导注入扩散式视频生成器，从而生成视觉连贯且物理一致的视频。

Details

Motivation: 现有视频生成方法虽然视觉质量较高，但缺乏对底层物理过程的显式建模，导致生成动态物理不一致；已有方法依赖强假设模拟器或粗粒度语义引导，难以有效将物理先验注入生成模型。

Result: 摘要未给出具体定量指标或benchmark数值；实验表明，与强基线相比，该方法在运动准确性、交互一致性方面有所提升，并减少了物理伪影。

Insight: 创新点在于两阶段框架：用基于粒子的图动力学模拟器学习可泛化物理交互并预测3D轨迹，以及提出可见—不可见运动场作为更完整、结构化的运动表示来引导扩散生成。客观来看，其可借鉴之处是将显式物理动力学预测与生成模型中的结构化运动条件相结合。

Abstract: Recent advances in video generation have achieved impressive visual quality, yet they often fail to produce physically consistent dynamics due to the lack of explicit modeling of underlying physical processes. Existing approaches either rely on simulators with strong assumptions or use coarse semantic guidance, and further struggle to effectively inject physical priors into generation models. In this work, we propose Seeing the Unseen, a unified framework for physics-grounded video generation. Our approach decomposes the problem into two stages: learning physical dynamics and injecting them into video synthesis. First, we introduce a lightweight Particle-based Graph Dynamics Simulator (PGDS) that learns generalizable physical interactions from data and predicts plausible 3D motion trajectories. Second, we propose a Visible–Invisible Motion Field (VIMF) that captures both motion observable in the input frame and motion that emerges over time due to object dynamics. This representation enables more complete and structured motion guidance compared to conventional physical signals. By integrating these trajectories into a diffusion-based generator, our method produces videos that are both visually coherent and physically consistent. Extensive experiments demonstrate improved motion accuracy, interaction consistency, and reduced physical artifacts compared to strong baselines.

[90] Déjà Vu: Cycle-Consistent Re-ranking for Semantic Correspondence cs.CVPDF

Xiaoran Zhang, Huidong Liu, Yang Liu, Chien-Chih Wang, Jinfa Huang

TL;DR: 论文提出 Déjà Vu，一个用于语义对应（semantic correspondence）的测试时解码模块。作者指出现有方法将匹配简化为贪心 top-1 最近邻存在解码瓶颈，因此将语义对应重构为“先召回再重排”问题：先根据相似度分布自适应选择候选集，再用分级循环一致性分数重排候选。该方法仅利用基础方法已计算的相似度矩阵，可即插即用地提升多个基线。

Details

Motivation: 语义对应需跨同类别图像匹配语义等价关键点，受外观、视角和尺度变化影响。预训练视觉模型特征本身具有较强零样本对应能力，但现有流程常直接取 top-1 最近邻，导致正确匹配未进入最终结果。作者发现 top-30 候选中包含正确对应的频率远高于 top-1 精度，说明瓶颈在解码而非表征。

Result: 在 SPair-71k、其几何子集和 PF-Pascal 上，在无监督与弱监督设置下持续提升三个代表性基线。最高增益包括 SPair-71k 上 +1.8 PCK@0.10、PF-Pascal 上 +3.4 PCK@0.15，以及 Keypoint Average Precision 上 +4.9。

Insight: 创新点在于识别并形式化语义对应中的“解码瓶颈”，提出 recall-then-rerank 范式；自适应候选集根据相似度置信度调节规模；引入分级循环一致性分数，将候选反向匹配回源图并用回匹配偏离程度惩罚。模块仅作用于已有相似度矩阵，具有即插即用和测试时增强的特点。

Abstract: We propose \emph{Déjà Vu}, a test-time decoding module for semantic correspondence. Matching semantically equivalent keypoints across images of the same object category is challenging due to variations in appearance, viewpoint, and scale. While features from large pretrained vision models carry strong zero-shot correspondence ability, existing methods reduce final matching to greedy top-$1$ nearest-neighbor selection. We show that the correct correspondence appears among the top-ranked candidates far more often than top-$1$ matching achieves: with $30$ candidates, zero-shot features exceed the top-$1$ accuracy of a supervised model. This reveals a \textit{decoding bottleneck} rather than a limit of the representation. Motivated by this observation, we formulate semantic correspondence as a \textit{recall-then-rerank} problem. Our method first nominates an adaptive candidate set, larger when the similarity distribution is ambiguous and smaller when it is confident, then re-ranks the candidates with a graded cycle-consistency score: each candidate is matched back to the source image and penalized by how far its reverse match lands from the original keypoint. The module operates entirely on the similarity matrix already computed by the base method. It consistently improves three representative baselines on SPair-71k, its geometric subset, and PF-Pascal under both unsupervised and weakly supervised settings, with gains of up to $+1.8$ PCK@0.10 on SPair-71k and $+3.4$ PCK@0.15 on PF-Pascal, and $+4.9$ under Keypoint Average Precision.

[91] SIEVE: Preserving Cross-Image Evidence via Depth-Aware Token Compression cs.CVPDF

Nitish Shukla, Surgan Jandial, Nhat-Tan Bui, Arun Ross

TL;DR: 论文提出 SIEVE，一种无需训练、单次前向的视觉 token 压缩框架，用于多图像视觉语言模型。它联合在图像之间和解码器深度上分配视觉 token：先在每张图像内做紧凑空间池化，再基于 prompt attention 在每图等额配额下逐步选择代表 token，并把未选 token 聚合到同图相似代表上。方法旨在保留跨图像互补证据并隔离不同图像的 token，同时用闭式调度控制各解码层的平均 token 预算。

Details

Motivation: 多图像 VLM 处理长视觉序列计算开销大，压缩时既要保留跨图像互补证据，又要避免不同图像 token 混淆。全局选择可能低估与问题相关的图像，过早剪枝会在多模态处理充分前丢失相关信息，而现有方法往往把大部分预算花在早期解码层。

Result: 在四个 VLM 骨干上，SIEVE 在 6.25% 预算下于五个多图像和四个单图像 benchmark 取得最高平均成绩，并在两个视频 benchmark 取得最高均值。LLaVA-OneVision-7B 上，6.25% 和 12.5% 预算下分别比最强基线高 9.96 和 9.03 分；12.5% 时比未压缩模型高 2.01 分，且 prefill FLOPs 减少 6.6 倍。

Insight: 创新点在于无需训练的单次 token 压缩，联合建模跨图像分配与解码器深度分配；通过每图等额配额、prompt attention 渐进选择和同图聚合，兼顾图像覆盖与 token 隔离。闭式预算调度按层设置保留数量，避免早期层过度占用预算，是可借鉴的深度感知压缩设计。

Abstract: Multi-image vision-language models (VLMs) incur substantial computation when processing long visual sequences. Compressing these sequences must preserve complementary evidence across images and keep tokens from different images separate. Global selection can underrepresent question-relevant images, and pruning in early decoder layers risks removing relevant content before sufficient multimodal processing, yet existing methods spend most of the budget on these early layers. We propose SIEVE, a training-free, single-pass framework that jointly allocates visual tokens across images and decoder depth. SIEVE first pools each image into a compact spatial grid to reduce early processing cost. It then progressively selects representatives using prompt attention under equal per-image quotas and aggregates unselected tokens into similar representatives from the same image. These operations keep every image represented and its tokens separate from other images, while refining the retained representations. A closed-form schedule sets retention counts to target a prescribed average token budget across decoder layers. Across four VLM backbones, SIEVE achieves the highest average at a 6.25% budget on five multi-image benchmarks and four single-image benchmarks, and the highest mean on two video benchmarks. On LLaVA-OneVision-7B, it outperforms the strongest baseline by 9.96 and 9.03 points at 6.25% and 12.5% budgets, and at 12.5% it exceeds the uncompressed model by 2.01 points with 6.6x fewer prefill FLOPs.

[92] MoRE-GS: Motion-Regime Experts for Future Gaussian Splatting cs.CVPDF

Shima Salehi, Joshua Peeples

TL;DR: 论文提出 MoRE-GS，一个因果且渲染感知的动态 3D 高斯场景预测框架。它冻结由观测时间前缀重建的高斯表示，并通过四个互补运动专家预测控制关键点运动，以应对同一场景中多种运动机制的外推。实验在 D-NeRF 和 HyperNeRF 场景上验证了其动态新视角合成性能。

Details

Motivation: 未来动态新视角合成需要在同一场景中同时外推静止、协调运动、局部交互和关节轨迹等多类运动机制，而单一动力学模型难以同时表征这些异构运动。

Result: 在 D-NeRF 和 HyperNeRF 场景上，MoRE-GS 相比其他方法取得更优性能，表明互补运动预测器的渲染器校准组合能改善异构运动机制下的因果动态高斯预测。

Insight: 创新点在于将运动预测分解为 persistence、系数空间 Transformer、图卷积网络和带刚/非刚约束的结构化 Transformer 四个专家，并用软运动组与预测时域分箱的紧凑路由表进行专家混合，同时引入 persistence gate 抑制不可靠外推。

Abstract: Future dynamic novel-view synthesis requires extrapolating multiple motion regimes within the same scene. A single dynamics model may not simultaneously represent stationary regions, coordinated motion, local interactions, and articulated trajectories. We introduce Motion Regime Expert Routing for Gaussian Splatting (MoRE-GS), a causal, render-aware framework for forecasting dynamic 3D Gaussian scenes. MoRE-GS freezes a Gaussian representation reconstructed exclusively from the observed temporal prefix and forecasts its control-keypoint motion using four complementary experts: persistence, a coefficient-space Transformer, a graph convolutional network, and a structured Transformer with rigid and non-rigid motion constraints. A compact routing table assigns expert mixtures across soft motion groups and forecast-horizon bins, while a persistence gate suppresses unreliable extrapolation. Across D-NeRF and HyperNeRF scenes, MoRE-GS achieves improved performance against other methods, and these results demonstrate that renderer-calibrated composition of complementary motion predictors improves causal dynamic Gaussian forecasting across heterogeneous motion regimes. Project page: https://advanced-vision-and-learning-lab.github.io/MoRE-GS-website/

[93] LF-VideoQA: Evaluating Long-Video Understanding with Long-Form Theory-of-Mind Questions cs.CV | cs.AI | cs.CLPDF

Shaden Shaar, Bradon Thymes, Majd Aldaye, Claire Cardie, Bharath Hariharan

TL;DR: 论文提出 LF-VideoQA，一个面向长叙事视频的长格式开放式问答数据集，基于心理理论（ToM）问题要求模型综合分布在视频各处的证据进行推理。数据集包含 94 部近期电影上的 6300 多个问题，平均每个问题需跨约 23 分钟场景推理，并提供问题特定的评分标准。作者通过剧本自动标注角色信念并利用 LLM 生成和验证问答三元组，再经人类研究验证质量，并系统评测多种开源视觉语言模型。

Details

Motivation: 现有长视频问答数据集多要求短答案或多选，容易把长视频理解简化为片段检索，无法评估跨长时间内容综合与推理能力。论文希望用角色信念依赖其全部所见所闻的心理理论问题，迫使模型组装并推理分布在整个视频中的证据。

Result: 实验评估四类先进开源 VLM 在三种设置下表现，发现任务极具挑战：即使可访问剧本的 oracle 也远未给出完整答案；最佳非 oracle 模型召回率仅约为 oracle 的一半；字幕和副标题效果不如视频本身，说明问题需要视觉证据；召回是主要瓶颈，答案遗漏许多评分标准要求的要点。

Insight: 创新点在于构建长格式、开放式、基于 ToM 的长视频 QA 数据集，并用问题特定 rubric 同时评估召回和精确率；数据构建上自动标注剧本中的场景事件与角色一阶/元信念，再借助 LLM 生成验证并由人类研究把关。客观看，其价值还在于揭示了长视频理解中跨时间证据综合、视觉证据必要性和召回瓶颈等关键挑战。

Abstract: The hardest part of understanding a long video is not pinpointing any one moment but synthesizing many, e.g., answering a question that requires tracking what develops across hours of content and articulating how the pieces fit together. To date, most long-video QA datasets require only a short answer or a multiple-choice selection, oversimplifying the long-video understanding task to retrieval. We introduce LF-VideoQA, a dataset for long-form, open-ended question answering over long narrative videos built on theory-of-mind questions: a character’s belief depends on everything they have seen or been told, so each question demands assembling and reasoning from evidence distributed across the video. The dataset contains more than 6,300 questions on 94 recent films; each requires reasoning over scenes spanning an average of 23 minutes and comes with a question-specific rubric for recall and precision scoring. The dataset is created entirely automatically by annotating screenplays with scene events and each character’s first-order beliefs and meta-beliefs, then generating (question, answer, rubric) triples through LLM-based question generation and verification; human studies validate their quality. We evaluate four families of state-of-the-art open-source VLMs across three settings and find the task highly challenging: (i) even an oracle with access to the screenplay falls well short of complete answers; (ii) the best non-oracle model attains barely half of the recall level of the oracle; (iii) unlike on prior long-video benchmarks, captions and subtitles underperform the video itself, indicating that the questions need visual evidence; and (iv) recall is the predominant bottleneck, with answers omitting many required rubric claims.

[94] Evaluating SAM-based and Convolutional Architectures in Thin Retinal Vessel Segmentation: Model Capacity, Computational Cost and Foundation Pre-training cs.CVPDF

Carlos Eduardo Fontaneli, Cesar Henrique Comin

TL;DR: 论文系统比较了基于SAM的plain ViT编码器（MedSAM）、混合Transformer（LiteMedSAM）与三种不同规模CNN在视网膜细血管分割中的表现，并在DRIVE、HRF、FIVES及VessMap数据集上评估细血管中心线召回率、精确率、计算成本和训练轮数。结果显示，预训练MedSAM的细血管中心线召回率与最佳CNN无显著差异，但从零训练的紧凑plain ViT未能保持该性能。

Details

Motivation: 文献中常认为plain ViT因粗粒度patch tokenization、弱局部性偏置和依赖大训练集而在细血管上不如CNN，但这一预期缺乏系统量化；论文旨在验证预训练plain ViT是否真的会漏检细血管。

Result: 在四个数据集上，预训练MedSAM与最佳CNN的细血管中心线召回率差异为-0.6至+2.5个百分点，且无显著差异；通过架构搜索得到的小型plain ViT从零训练后未保留该性能。结果不支持预训练plain ViT必然漏检细血管的预期，但类似细血管性能也可由更小模型取得。

Insight: 创新点在于针对细血管中心线召回/精确率进行系统跨数据集比较，并同时考虑计算成本与训练轮数；客观看，其价值在于揭示预训练对plain ViT细血管分割性能的关键作用，以及大模型与轻量CNN之间的性能-成本权衡。

Abstract: In retinal vessel segmentation, plain Vision Transformers (ViTs) are commonly expected to perform worse than convolutional neural networks (CNNs) on thin vessels, for reasons such as their coarse patch tokenization, their weak locality bias and their need for large training sets. Although this expectation is widely shared in the literature, how plain ViTs actually compare with CNNs on thin vessels has not been systematically quantified. We address this question by comparing a model with a plain ViT encoder (MedSAM), a hybrid Transformer (LiteMedSAM) and three CNNs of different sizes on three retinal datasets (DRIVE, HRF, FIVES) and, as a second-domain check, a microscopy dataset (VessMap). We measured the centerline recall and precision of thin vessels and compared the models while also considering their computational cost and how many epochs they needed to train. We found that the pre-trained MedSAM had a centerline recall of thin vessels that was not significantly different from that of the best CNN on all four datasets (-0.6 to +2.5 percentage points). A compact plain ViT obtained through architecture search but trained from scratch did not retain this performance. For pre-trained plain ViTs, our results do not support the expectation that they miss thin vessels, although similar thin-vessel performance can be obtained with much smaller models.

[95] TAP-Out: Tracking Any Point in 360° via Outpainting cs.CVPDF

Finlay G. C. Hudson, James A. D. Gardner, William A. P. Smith

TL;DR: 论文提出 TAP-Out，一种离线任意点跟踪方法，针对目标离开相机视野后的 OOV 跟踪问题。它先用生成式视频外扩把窄视场视频补全为 360° 等距柱状全景视频，再通过视频目标分割定位目标并生成以目标为中心的透视裁剪，交给现成的帧内跟踪器处理。该解耦流程组合基础模型，在 TAPVid360 上取得 SOTA，并将 OOV 跟踪精度约提升 3 倍。

Details

Motivation: 传统点跟踪假设对应关系可见，目标离开视野后需要推断未观测场景动态，是本质不同的问题。论文希望把这种视野外推理显式化，借助生成式外扩作为世界模型先验来解决 OOV 跟踪。

Result: 在 TAPVid360 benchmark 上达到 SOTA，OOV 跟踪精度相对此前最佳方法约提升 3 倍；还展示了在画幅外目标分割与检测上的灵活性，并给出多运动模式、静态/动态内容和幻觉质量的诊断分析。

Insight: 创新点在于将 OOV 跟踪转化为“视频外扩补全全景 + 目标定位/透视裁剪 + 现成跟踪器”的解耦流程，把生成式外扩显式用作世界模型先验，且无需任务特定架构修改。客观看，其价值在于用基础模型组合降低专门设计成本，并通过诊断分析刻画方法适用边界。

Abstract: Tracking points that leave the camera’s field of view (FoV) requires reasoning about unobserved scene dynamics, a fundamentally different problem from tracking visible correspondences. We present TAP-Out, an offline method that makes this out-of-view (OOV) reasoning explicit by leveraging generative video outpainting as a world-model prior. Given a narrow-FoV input video, TAP-Out outpaints a complete 360° equirectangular video, locates target objects within the panoramic scene via video object segmentation, and synthesises object-centred perspective crops on which standard in-frame trackers operate. This decoupled design composes off-the-shelf foundation models without requiring task-specific architectural modifications. On the TAPVid360 benchmark, TAP-Out achieves state-of-the-art performance, improving OOV tracking accuracy by approximately 3x over the best prior method. We demonstrate its flexibility on out-of-frame object segmentation and detection and we provide detailed diagnostic analyses across motion regimes, static versus dynamic content, and hallucination quality, characterising when and why the approach succeeds or fails.

[96] PAM-Mamba - Efficient Dense Action Detection using Mamba cs.CVPDF

Dhruvraj Singh Rawat, Faegheh Sardari, Armin Mustafa

TL;DR: 论文提出PAM-Mamba，一种基于Mamba的线性时间O(T)架构用于密集动作检测，包含多分支时间编码器、门控可学习位置编码（GLPE）、中心辐射漏斗结构、双向时间Mamba（Bi-TemBa）和基于不确定性的Mixup。在Charades和MultiTHUMOS数据集上取得有竞争力的结果，同时参数量比PAT减少61-63%。

Details

Motivation: 密集动作检测需要精确定位长视频中的多个重叠动作，Transformer方法精度高但自注意力二次复杂度O(T^2)限制可扩展性。论文旨在设计线性时间架构以高效处理长视频，同时保持高精度。

Result: 在Charades I3D上mAP 26.82，Charades CLIP上34.59，MultiTHUMOS I3D上46.56，MultiTHUMOS CLIP上46.92 mAP。参数量26.1-27.9M，比PAT少61-63%。在相同评估实现下，结果与PAT相当或更优，且更高效。

Insight: 创新点包括：基于Mamba的线性时间架构避免二次自注意力；GLPE通过零初始化门控控制位置信号注入；Hub-and-Spoke Funnel通过直接残差连接增强多尺度特征；Bi-TemBa结合时间卷积和双向Mamba扫描以线性时间获取双向上下文；基于不确定性的Mixup使用预测熵选择mixup伙伴。客观分析：这些创新从效率、位置编码、多尺度连接、双向上下文建模和数据增强角度改进了密集动作检测，尤其是将Mamba引入该任务并设计相应组件，具有借鉴意义。

Abstract: Dense action detection requires precisely localising multiple overlapping actions in long untrimmed videos. Transformer-based methods achieve strong accuracy but their $O(T^2)$ self-attention cost limits scalability. We present PAM-Mamba, a linear-time $O(T)$ architecture built on Mamba with a multi-branch temporal encoder. Gated Learnable Positional Encoding (GLPE) controls positional signal injection via a scalar gate initialised to zero, starting training without added positional signal. A Hub-and-Spoke Funnel extends the non-hierarchical multi-scale design of PAT with a direct residual from the original full-resolution input to each coarse branch, providing each coarse branch with a projection of the input features. Bi-TemBa (Bidirectional Temporal Mamba) first extracts local motion cues with a shallow Temporal Convolution Module, then applies a cascaded bidirectional Mamba scan; the backward pass refines the forward-scanned representation from the opposite direction, giving each temporal position access to context from both directions in linear time. Uncertainty-Based Mixup uses prediction entropy to guide the selection of mixup partners. Using the PAT evaluation implementation, we obtain 26.82 (Charades I3D), 34.59 (Charades CLIP), 46.56 (MultiTHUMOS I3D), and 46.92 mAP (MultiTHUMOS CLIP), with 26.1-27.9M parameters, 61-63% fewer than PAT.

[97] Real-VAS: a Real-World Video Amodal Segmentation Dataset cs.CVPDF

Finlay G. C. Hudson, William A. P. Smith

TL;DR: 论文提出Real-VAS，一个基于真实图像视频合成的大规模零样本评估数据集，用于非模态视频目标分割。该数据集通过程序化生成与真实复杂场景一致的amodal真值，涵盖动态遮挡和多种容器交互场景，为评估模型在真实视频中的非模态分割能力提供精确基准。

Details

Motivation: 非模态视频目标分割缺乏同时具备真实世界复杂性和精确真值标注的数据集，现有数据难以支撑可靠评估。

Result: 摘要未给出具体定量结果，主要贡献是构建多样化且具挑战性的Real-VAS基准，用于零样本评估非模态分割模型，并宣称其兼具真实视频复杂性与合成数据精度。

Insight: 创新点在于提出无需人工估计或昂贵3D重建的数据生成流程，使掩码、遮挡边界和合成图像均源自单一未遮挡源；并通过容器跟踪变换模拟物体运动，生成动态遮挡及复杂容器交互场景的精确amodal真值。

Abstract: Amodal video object segmentation is fundamentally limited by the absence of datasets that combine real-world complexity with precise ground-truth annotations. To address this, we present Real Video Amodal Segmentation (Real-VAS), a new large-scale, zero-shot evaluation dataset built from composited real-image video. We introduce a novel data generation pipeline that enables the creation of programmatically consistent amodal ground truth for real-world footage, in which the object mask, occlusion boundary, and composited image are all derived from a single unoccluded source, without relying on human estimation or expensive 3D reconstruction. Our dataset is structured into two challenging scenarios: dynamic Occlusion, created by compositing two clips of moving objects, and a unique Container category featuring complex, physically constrained interactions. These container scenarios–On Surface Containment, Articulated Containment, and Mobile Containment–allow us to generate precise ground truth by simulating an object’s motion based on its container’s tracked transformation. As a result, Real-VAS provides a diverse and challenging benchmark for evaluating amodal segmentation models on realistic video with the precision of synthetic data. The dataset and our generation code will be made publicly available.

[98] PRISM-Net: Dynamic Routing Network with VLM-Guided Disentangled Attribute Distillation for Explainable Fine-Grained Product Retrieval cs.CVPDF

Chung-Ming Lo, Che-Wei Chang

TL;DR: 论文提出PRISM-Net，一种面向可解释细粒度商品检索的动态路由多专家网络。该方法通过将整体视觉特征解耦为线条和颜色专家路径，并利用VLM零样本文本提示进行语义蒸馏监督，再以元路由器自适应融合宏观类别特征，从而同时建模类目语义与微观视觉属性。

Details

Motivation: 大规模电商细粒度商品检索需要同时区分宏观类目和线条、颜色等微观属性，但CNN和ViT等常规骨干存在特征纠缠与捷径学习问题，且人工属性标注成本高。论文旨在无人工属性标注条件下学习解耦且可解释的细粒度商品表示。

Result: 在275,454张电商图像、18个类目及55,091查询对220,363图库的全规模检索基准上，PRISM-Net在SwinV2、ConvNeXt-V2和DINOv3上均取得显著提升。以SwinV2为例，全折产品mAP@10从80.98%提升至83.90%（+2.92%），线条mAP@10提升5.74%，颜色mAP@10提升9.12%。

Insight: 创新点在于用VLM零样本提示和梯度分离路由门实现无属性标注的结构/颜色专家蒸馏，并以条件元路由器融合解耦专家与宏观基础特征。客观来看，其可解释性来自路由权重涌现分配，如刚性家电和硬件获得更高线条权重、服装获得超过96%颜色权重，为细粒度检索提供了属性解耦与可解释路由结合的思路。

Abstract: Fine-grained visual product retrieval in large-scale e-commerce multimedia systems demands discriminative representations capable of simultaneously resolving macro-level category semantics and micro-level visual attributes such as structural contour (line) and chromatic appearance (color). However, conventional backbones including convolutional neural networks (CNNs) and vision Transformers (ViTs) inherently suffer from feature entanglement and shortcut learning. To learn the micro-level visual attributes without costly manual attribute annotations, we propose phase-routed interpretable semantic mixture-of-experts network (PRISM-Net), an explainable multi-expert architecture that disentangles holistic visual features into disentangled line and color expert pathways governed by a conditional meta-router. In phase 1, we introduce an external VLM-Guided sigmoid semantic distillation mechanism with gradient-detached routing gates, utilizing zero-shot text prompts from SigLIP to supervise specialized structural and chromatic experts. In phase 2, the disentangled expert embeddings are adaptively fused with macro base features via a learned meta-router gate to calibrate category boundaries. Extensive 5-fold cross-validation across 275,454 e-commerce images (18 categories) and full-scale retrieval benchmarks (55,091 queries against a 220,363-image gallery) across SwinV2, ConvNeXt-V2, and DINOv3 demonstrate substantial gains. On SwinV2, PRISM-Net boosts full-fold product mAP@10 from 80.98% to 83.90% (+2.92%), line mAP@10 by +5.74%, and color mAP@10 by +9.12%. Furthermore, unsupervised distribution analysis of the meta-router gate reveals that both ViT and CNN backbones emergently allocate up to 6.8x higher structural line weights to rigid appliances and hardware while dedicating >96% chromatic weight to clothing.

[99] Selecting or Solving? What Best-of-N Verification Delivers in Video Reasoning cs.CVPDF

Martin Q. Ma, Yuxiao Qu, Ruslan Salakhutdinov, Louis-Philippe Morency, Paden Tomasello

TL;DR: 论文研究长视频推理中best-of-N验证的实际收益，指出常用的“相对多数投票的领先幅度”会混淆两种效应：验证器从候选答案中选择的能力，以及验证器本身直接解题的能力。作者提出Selection Increment（SI）来分离选择增益，并在五个长视频基准上评估多种验证器，发现弱验证器从候选中获益最大却未必超过多数投票，强验证器增益较小但更可能超过投票；同时揭示弱验证器在EgoSchema上存在按选项位置选择的失败模式。

Details

Motivation: 长视频问答依赖少量关键帧证据，现有视觉语言模型定位证据能力不足；best-of-N选择被广泛用于增加测试时计算，但单一领先指标无法说明收益来自“会选择”还是“会解题”，可能导致部署判断错误。

Result: 在五个长视频基准上测量SI及相对self-consistency的margin：SI对最弱验证器最大；多数投票接近上限时无验证器能超过，低于上限时仅最强验证器可超过。Video-Holmes上弱验证器从候选中获得+19.3分但仍低于投票7.1分，前沿验证器增益最小却超过投票；EgoSchema上最弱验证器表现出按选项位置而非视频内容选择的偏差。

Insight: 创新点在于将best-of-N验证的headline收益拆分为选择增益SI与验证器自身解题能力，提出可审计的评估视角，揭示“选择”和“解题”两种效应在验证器强弱上的相反规律，并暴露弱验证器的位置偏置问题。客观看，该工作为测试时计算分配和验证器选择提供了更细粒度的诊断指标，而非单纯提出新模型。

Abstract: Answering a complex question about a long video is a grounding problem: the answer turns on a few seconds of evidence, and vision-language models remain well below human accuracy at finding them. The standard way to spend extra test-time compute on this kind of video reasoning is best-of-N selection: sample several chain-of-thought answers from a fixed model, then let a second model re-watch the video and pick one. Such pipelines are reported by a single headline number, their margin over a majority vote. That number conflates two effects with opposite deployment consequences: the benefit the second model adds by selecting among candidates, and the benefit it would have supplied by solving the question itself. We separate them, measuring the Selection Increment (SI) – selection accuracy minus the same verifier’s accuracy with the candidates withheld – alongside the margin over self-consistency, across five long-video benchmarks. The Selection Increment is largest for the weakest verifiers: a verifier that solves poorly on its own leaves the candidates the most room to help. Beating the majority vote follows the opposite profile: where the vote already sits near its ceiling no verifier we test improves on it; below that ceiling only the strongest do. On Video-Holmes, the two come apart on a single pool of candidates – a weak verifier gains +19.3 points from the candidates yet lands 7.1 points below the vote, while the frontier verifier gains the least and beats the vote. The weakest verifier also shows a failure mode: on EgoSchema it picks by where an option sits in the list rather than by what the video shows. Read as a merit score, SI puts a verifier that fails to beat a majority vote at the top of its ranking; read as an audit, it says which of the two effects a headline number delivers. Code is available at https://github.com/facebookresearch/best-n-selection-video-reasoning.

[100] Spatial-Spectral Interactive POCS Network for Large-Gap Seismic Data Interpolation cs.CVPDF

Baisong Jiang, Chunxia Zhang, Anxiang Di, Xiaoli Wei, Xiangyu Zhao

TL;DR: 论文提出一种用于大间隔地震数据插值的空间-谱交互POCS网络SSI-POCS，通过展开经典POCS迭代求解器，将物理一致性与双域深度先验结合。网络利用空间Restormer分支和快速傅里叶卷积分支分别捕获局部波形结构与全局上下文，并通过双域融合模块交互互补特征。实验表明该方法能显著提升大间隔下反射同相轴连续性和谱能量集中度，并降低伪影。

Details

Motivation: 地震采集中的大间隔会破坏反射事件并阻碍频谱恢复，现有深度展开插值网络主要依赖局部空间先验，难以聚合重建大范围缺失区域所需的全局上下文，因此需要解决这一严重病态问题。

Result: 在合成盐丘数据和北海实际数据集上，于50%随机与连续道剔除条件下验证有效；相比最佳对比方法，SNR提升3.285 dB，同时参数量减少75.66%。

Insight: 创新点在于展开POCS迭代求解器，将物理一致性、学习变换、软阈值和精确数据回插结合；利用Restormer与FFC分支实现空间-谱双域先验交互，并引入SSIM监督、 focal frequency loss和变换一致性约束以增强大间隔结构连续性和抑制非相干高频成分。

Abstract: Large gaps in seismic acquisition disrupt reflection events and hinder spectral recovery. Existing seismic interpolation deep unfolding networks primarily rely on localized spatial priors, limiting their ability to aggregate the global context necessary for reconstructing these extensive missing regions. We propose a spatial-spectral interactive projection-onto-convex-sets network (SSI-POCS) to tackle this severely ill-posed problem. By unfolding the classical iterative solver, our network integrates physical consistency with dual-domain deep priors via learned transforms, soft thresholding, and exact data reinsertion. Within the learned prior, a spatial Restormer branch captures local waveform structures, while a fast Fourier convolution (FFC) branch extracts global context, effectively suppressing incoherent components and enhancing spectral energy concentration in the $f-k$ domain. A dual-domain fusion module exchanges these complementary features via bidirectional channel attention and gated modulation, yielding substantial interpolation improvements. To overcome the severe loss of lateral continuity caused by large gaps, we introduce structural similarity (SSIM) supervision, complemented by focal frequency loss (FFL) and transform consistency constraints to suppress incoherent high-frequency components and regularize training. Experiments on a synthetic salt dome and a North Sea field dataset under 50% random and consecutive trace removal demonstrate the effectiveness of SSI-POCS. It significantly enhances event continuity across large gaps and mitigates artifacts, achieving a 3.285~dB SNR improvement over the best competing method while reducing parameters by 75.66%.

[101] Words Before Pixels: Selective Modality Routing for Vision-Language Model Unlearning cs.CV | cs.AIPDF

Laura Yao, Haochen Zhang, Jinhao Duan, Sijia Liu, Tianlong Chen

TL;DR: 论文研究视觉语言模型（VLM）遗忘问题，指出除目标函数设计外，遗忘样本的模态表示同样关键。作者构建模态分解基准，发现文本表示比图像更有效抑制不安全指令跟随，但纯文本遗忘会削弱视觉 grounding。为此提出 ModRoute：基于梯度引导的逐样本模态路由，将高视觉压力样本转为纯文本，其余保持多模态。实验表明该方法在遗忘与效用权衡上优于纯多模态、纯文本和随机切换。

Details

Motivation: 现有 VLM 遗忘方法通常只关注优化损失函数，默认保留图像-文本形式作为遗忘样本表示，忽略了每个样本应以何种模态（图像、文本或多模态）进行遗忘更有效的问题。论文旨在探究数据表示层面的模态路由对遗忘效果的影响。

Result: 在 VLGuard 基准和 LLaVA-1.5-7B 模型上，ModRoute 在 γ=0.5 时取得 0.847 的综合遗忘-效用分数，比最佳随机切换策略提升 2.5%，比纯多模态或纯文本遗忘提升至少 46%。

Insight: 创新点包括：构建模态分解的 VLM 基准以控制比较不同模态表示；发现文本表示对抑制不安全指令跟随更有效但纯文本会削弱视觉 grounding 的权衡；提出梯度引导的逐样本模态路由策略。客观来看，论文将 VLM 遗忘从目标设计问题拓展到数据表示与模态路由问题，提供了新的数据侧视角。

Abstract: Vision-language model (VLM) unlearning is often treated as an objective-design problem: given multimodal forget data, the goal is to optimize a loss that removes undesirable behavior while preserving retained capabilities. We argue that this view overlooks an equally important data-centric question: how should each forget example be represented before optimization? Existing methods typically keep image-conditioned failures in their original image-text form, implicitly assuming that pixels are the right route for unlearning whenever pixels appear in the input. We challenge this assumption by constructing modality-decomposed versions of VLM benchmarks, enabling controlled comparisons among image-only, text-only, and multimodal representations of the same examples. Our modality-mixing experiments show that unsafe instruction-following behavior is more effectively suppressed through textual representations than through images alone, while purely text-only unlearning can still weaken visual grounding when the target behavior depends on visual evidence. Motivated by this trade-off, we introduce ModRoute, a gradient-guided per-sample modality routing strategy that selectively converts high visual-pressure examples to text-only form while keeping the remaining examples multimodal. Notably, on VLGuard with LLaVA-1.5-7B, ModRoute has the strongest composite unlearning-utility score of 0.847 at $γ=0.5$, a 2.5% improvement over the best random-switching score and $\geq$46% better than pure multimodal or text unlearning. Overall, our results show that effective VLM unlearning depends not only on the objective, but also on the composition and per-sample modality routing of the unlearning data.

[102] SE-Mem: Semantic-Episodic Memory for Scene-Consistent Generative View Synthesis cs.CVPDF

Changsong Lei, Yihan Li, Yu-Hui Wen, Huankun Sheng, Ming Li

TL;DR: 论文提出SE-Mem，一种受人类语义记忆和情景记忆启发的语义-情景记忆框架，用于生成式视图合成中的场景一致性。该框架将历史观察组织为结构化3D表示并附加语义重要性分数，通过两阶段记忆检索策略选择信息量最大的帧作为上下文指导，兼顾语义显著性和几何可见性，从而在新视角合成中保持语义连贯和细粒度视觉细节。实验表明，该方法在多个基准上提升了视觉质量并取得了有竞争力的几何一致性。

Details

Motivation: 现有方法仅根据相机姿态选择参考帧，忽略了内容是否语义相关或可见，导致相机条件交互式视频生成器中全局场景一致性难以维持。受人类语义记忆（概括知识）和情景记忆（特定事件上下文）互补作用的启发，论文旨在通过结构化记忆机制更有效地选择和利用历史观察。

Result: 在多个基准上的大量评估表明，该方法提升了视觉质量，并取得了有竞争力的几何一致性。

Insight: 论文的创新点在于将认知记忆机制引入生成式视图合成：用结构化3D表示组织历史观察并附加语义重要性分数，设计两阶段记忆检索策略同时考虑语义显著性和几何可见性来选择参考帧，而非仅依赖相机姿态。这为保持场景一致性提供了一种新颖的记忆驱动方法。

Abstract: Generative view synthesis aims to synthesize novel-view videos from reference observations along user-defined camera trajectories. Maintaining global scene consistency throughout this process remains challenging for camera-conditioned interactive video generators. Existing approaches typically select reference frames based solely on camera poses, overlooking whether the content remains semantically relevant or even visible. To address these limitations, we draw inspiration from semantic and episodic memory in human cognition, in which semantic memory captures generalized knowledge across experiences, whereas episodic memory preserves information tied to specific past events and contexts. Motivated by the complementary roles of semantic and episodic memory, we introduce SE-Mem, a Semantic-Episodic Memory framework that organizes historical observations in a structured 3D representation and augments its elements with semantic importance scores. A two-stage memory retrieval strategy is designed to identify the most informative frames to provide contextual guidance. Taking into account both semantic significance and geometric visibility, SE-Mem preserves semantic coherence and fine-grained visual details during novel view synthesis. Extensive evaluations show that our approach improves visual quality and achieves competitive geometric consistency across multiple benchmarks.

[103] ROD-Dataset: A Pedestrian-Perspective Benchmark of Urban Obstacle Classes for YOLO-Based Detection cs.CV | cs.CYPDF

Abtin Zandi, Ariyan Azami, Bardia Sabagh Kermani, Parsa Abbasian, Roza Ganjipour

TL;DR: 论文提出了ROD数据集，一个面向行人的城市障碍物检测基准，包含超过24000张图像和40000个标注障碍物，覆盖25个类别。该数据集统一了29个公开数据集并增加了德黑兰和多伦多两个城市的视线高度图像，并基准测试了六个轻量YOLO检测器。

Details

Motivation: 现有公开基准多从车辆、空中平台或固定设备采集，通用检测器忽略导致绊倒的街道设施，而行人聚焦数据集局限于单一区域且类别不兼容，无法满足视障和分心行人预警系统的训练需求。

Result: 六个轻量YOLO检测器在ROD上召回率均超过0.86；YOLO12n召回率最高（0.889），YOLO26n精确率最高（0.925），YOLOv9t的mAP@0.50最佳（0.882）且参数最少。召回率和mAP排名不一致，按mAP选模型不能最小化漏检。

Insight: 创新点在于构建了多类别、多城市、人工验证的行人视角障碍物数据集，统一了29个公开数据集的分类体系，并强调按每类召回率而非仅mAP评估模型以降低漏检风险。

Abstract: Two groups of pedestrians face avoidable risk on the city sidewalk: people living with visual impairment, who reach an obstacle before anything warns them, and people walking with divided attention, who register a hazard late or not at all. A vision system can warn them only about obstacles it has learned to recognize, so its training data limits the protection it offers. No suitable training set exists: public benchmarks are recorded from vehicles, aerial platforms, or fixed rigs, general-purpose detectors omit the street furniture that causes trips, and pedestrian-focused collections are confined to single regions with incompatible class schemes. This paper introduces the Real-time Obstacle Detection (ROD) dataset: more than 24,000 images and 40,000 annotated obstacles across 25 classes, from vehicles and people to the stairs, manholes, traffic cones, and benches that general-purpose detectors overlook. Because street furniture differs between cities, ROD unifies twenty-nine public collections onto one taxonomy and adds eye-level imagery from two contrasting cities on two continents, Tehran and Toronto. Every label is human-verified, and each capture campaign is admitted only after a compact detector shows it can learn the class. Six lightweight YOLO detectors (nano and tiny variants) benchmarked on ROD all exceed 0.86 recall; YOLO12n attains the highest recall (0.889), YOLO26n the highest precision (0.925), and YOLOv9t the best mAP@0.50 (0.882) with the fewest parameters. Because the recall and mAP rankings disagree, selecting a model by mAP does not minimize missed obstacles, so per-class recall is reported for all 25 classes.

[104] Density-Aware Calibration for Resource-Efficient Medical Vision-Language Models cs.CVPDF

Tien-Dat Dam, Huu-Thuan Huynh, Minh-Triet Tran, Trung-Nghia Le

TL;DR: 论文提出 CoreCalib，一种无需训练且与量化器无关的医学视觉语言模型校准集构建框架。它按临床问题类别分层，利用冻结 DINOv2 特征、UMAP 和 HDBSCAN 选择代表性视觉模式，并将图像扩展为类别均衡的问答对，以在紧凑校准预算下保持医学 VQA 数据分布，从而提升训练后量化的部署效率。

Details

Motivation: 医学视觉语言模型计算和内存需求高，难以部署在资源受限临床硬件上；训练后量化虽可免重训练压缩，但其效果高度依赖校准数据，因此需要构建更能代表目标医学 VQA 分布的紧凑校准集。

Result: 在 Kvasir-VQA-x1 上以固定 128 对校准预算评估 MASQuant、GPTQ 和 QIG。CoreCalib 在三种量化器下均取得最佳 METEOR，并在 MASQuant 与 GPTQ 下取得最佳 ROUGE-L；W4A8 MASQuant 下 METEOR 从 COCO 校准的 0.5672 提升至 0.6234，恢复约 41% 相对 BF16 的退化。

Insight: 创新点在于面向医学 VQA 的训练无关、量化器无关校准集构建：按临床问题类别分层，结合密度聚类选择代表性视觉模式，并类别均衡扩展问答对。客观看，其价值主要是数据中心的校准优化，可低成本提升多种 PTQ 方法在医学 VLM 上的表现。

Abstract: Medical vision-language models (VLMs) show promise for clinical image understanding, but their computational and memory requirements hinder deployment on resource-constrained clinical hardware. Post-training quantization (PTQ) offers a practical compression strategy without retraining, yet its effectiveness depends strongly on the calibration data. We propose CoreCalib, a training-free and quantizer-agnostic framework for constructing compact calibration sets that preserve the target medical VQA distribution. CoreCalib stratifies data by clinical question class, identifies representative visual modes using frozen DINOv2 features with UMAP and HDBSCAN, and expands selected images into class-balanced question-answer pairs. On Kvasir-VQA-x1, we evaluate CoreCalib with MASQuant, GPTQ, and QIG using a fixed 128-pair budget. CoreCalib achieves the best METEOR with all three quantizers and the best ROUGE-L with MASQuant and GPTQ. With W4A8 MASQuant, it improves METEOR from 0.5672 with COCO calibration to 0.6234, recovering approximately 41% of the degradation relative to BF16. These results support CoreCalib as a data-centric component for resource-efficient medical VLM deployment. Project page: https://magnusdtd.github.io/CoreCalib/ .

[105] Adversarial robustness does not entail human-aligned categorization cs.CV | cs.LG | q-bio.NCPDF

Itay Reznik, Raz Lapid, Moshe Sipper, Tal Golan

TL;DR: 论文通过GAN优化生成1,008个能引发鲁棒ImageNet分类器高置信度分歧的争议刺激，并将ResNet-101、ViT-B、ConvNeXt-L、Swin-L等对抗鲁棒模型与60名参与者的二选一类别判断进行比较。结果显示，这些鲁棒分类器预测个体单次选择的准确率接近随机，且整体模型-人类一致性明显低于人类观察者之间的一致性。作者据此认为，对抗鲁棒性本身并不保证人类对齐的分类行为，二者应作为视觉识别系统的不同属性分别评估。

Details

Motivation: 论文关注对抗鲁棒分类器是否真正习得与人类一致的分类行为，而非仅在某些视觉对应关系上接近生物视觉。其出发点是澄清对抗鲁棒性与人类对齐分类之间的关系。

Result: 在个体单试次预测上，四个鲁棒分类器准确率仅48.6%至51.3%，接近随机，而其他参与者多数判断可达85.0%至86.8%；在17个额外RobustBench模型上，平均模型-参与者一致性为67.3%，低于参与者-参与者一致性81.3%。四个模型在争议刺激上虽高于随机预测人类反应，但均不如人类多数判断准确。

Insight: 论文宣称的创新在于用GAN优化的争议刺激系统比较多种对抗鲁棒模型与人类二选一判断，并覆盖多个模型和参与者。客观来看，其有价值的洞见是将对抗鲁棒性与人类对齐分类明确区分，并指出模型-人类不匹配跨鲁棒分类器持续存在且显著超过人类观察者间分歧。

Abstract: Adversarial training can improve some forms of correspondence between artificial and biological vision, but whether robust classifiers acquire human-aligned classification behavior remains unclear. We generated 1,008 controversial stimuli by optimizing latent inputs to a pretrained GAN to elicit high-confidence disagreements between pairs of robust ImageNet classifiers. We compared four adversarially robust ImageNet classifiers - ResNet-101, ViT-B, ConvNeXt-L, and Swin-L - with two-alternative category judgments from 60 participants. We first evaluated each classifier on stimuli optimized to elicit disagreement with another model. Across classifiers, accuracy in predicting individual participants’ single-trial category choices was near chance (48.6-51.3%), whereas majority judgments from other participants predicted responses with 85.0-86.8% accuracy. An analysis incorporating model prediction strength and participants’ reported confidence found weak positive model-human correspondence for the two convolutional models. On stimuli optimized for disagreement between other model pairs, all four robust classifiers predicted human responses above chance but less accurately than predictions based on other participants’ majority judgments; the same pattern held for 17 additional RobustBench models not used in stimulus generation. Across these 17 models, mean model-participant agreement was 67.3%, versus 81.3% mean participant-participant agreement on the same images. These results identify model-specific failures of human alignment and a model-human mismatch that persists across robust classifiers and substantially exceeds disagreement among human observers. Our findings show that adversarial robustness alone does not guarantee human-aligned categorization and suggest that robustness and human alignment should be evaluated as distinct properties of visual recognition systems.

[106] SceneBound: How Much Should a Streaming 3D Reconstruction Model Remember? cs.CV | cs.ROPDF

Ziming Wang, Chuyue Gong, Chutian Wang, Jingmin Zhu, Hongliang Cao

TL;DR: 论文研究流式3D重建模型应记住多少历史帧，指出无训练写入规则的效果主要受写入预算而非选择信号影响。作者提出SceneBound：仅当预测相机位姿与所有已存关键帧的距离超过固定半径时才写入新帧，并在大场景中通过子图机制控制漂移。该方法无需训练，可统一用于多种模型和记忆类型。

Details

Motivation: 流式3D重建中，写入历史帧会改变后续相机坐标系或占用GPU内存；现有无训练规则依赖当前帧信号决定写什么，但忽略了写多少对精度和状态漂移的影响。论文旨在用几何覆盖原则决定关键帧写入，减少冗余记忆并控制漂移。

Result: 在CUT3R的循环状态和StreamVGGT的KV缓存上，SceneBound在评估的无训练规则中取得最低平均轨迹误差，且在单遍和九遍场景遍历下均有效；关键帧数量仅增长3%到6%，并使用同一半径适配四个模型和三种记忆类型。

Insight: 创新点在于将关键帧写入建模为相机位姿覆盖问题，使关键帧数受覆盖数常数倍约束：访问新区域时增长，相机返回时保持平稳；并结合子图关闭机制在解码首帧再次暴露漂移时限制大场景误差。客观看，其价值在于揭示写入预算对性能的主导作用，并给出简单、无需训练且跨模型通用的几何写入准则。

Abstract: Streaming 3D reconstruction models keep past video frames in a recurrent state, fast weights from test-time training, or a key-value (KV) cache. Each written frame shifts the coordinate frame of later cameras or occupies GPU memory. Training-free rules decide what to write from a signal of the current frame. How much they write accounts for their mean accuracy: spending the update budget of a gate at uniformly spaced frames, with no signal, matches nine published gates, and the budget bounds the drift of the state wherever the writes fall. We propose SceneBound, a training-free rule that writes a frame only when its predicted camera pose lies at least a fixed radius from every stored keyframe. Its keyframe count stays within a constant factor of the covering number of the visited poses, the fewest views that keep a keyframe near every camera, so the count grows with the places visited and stays flat when the camera returns. In large scenes, SceneBound closes a submap once decoding its first frame again reveals drift. SceneBound uses one radius across four released models and three memory types. In the recurrent state of CUT3R and the KV cache of StreamVGGT, it achieves the lowest mean trajectory error among the published training-free rules we evaluate, in one pass and over nine passes of a scene, where its keyframes grow by 3% to 6%.

[107] Old Is Not False: Valid-Time Memory for Interactive Video World Models cs.CV | cs.AI | cs.LGPDF

Ziming Wang, Chuyue Gong, Hongliang Cao, Jingmin Zhu, Chutian Wang

TL;DR: 论文研究交互视频世界模型在智能体撤销动作后的记忆时间戳误读问题，提出ReDate有效时间记忆机制：保留所有历史帧，并依据动作日志为检索到的token标注其内容有效时间，使冻结生成器无需训练即可在回退后正确生成当前状态；同时给出理论分析和校准状态指标。

Details

Motivation: 现有记忆库把最新捕获时间戳当作真实当前状态，默认状态不会返回；但智能体撤销动作后，最新视图已过时，较旧视图才代表当前。删除旧视图会丢失变化世界的信息，保留旧视图又会把过去交给生成器。

Result: 撤销动作后，ReDate将FAR中显示当前状态的步骤占比从0.36提升到0.62，将HY-WorldPlay从0.003提升到0.19；论文还提出校准状态度量用于测试任意记忆在撤销后的表现。

Insight: 创新点在于将时间数据库中的有效时间引入视频世界模型记忆，用动作日志重定检索token的时间而非删除旧帧，且无需训练、可插拔；理论上证明了信任最新时间戳成立的条件，以及重定日期优于删除的情形。客观看，存储时间与内容有效时间解耦是简洁且低成本的关键思路。

Abstract: Interactive video world models draw each frame from a memory bank of earlier frames stamped with their capture times. With frames, weights and noise fixed, reversing the timestamps of two views flips the state that generators of two families draw: they take the newest timestamp as the truth. That reading is right as long as states never return. After an agent undoes an action, the newest view of a region is outdated and the only view of the present is older; memories for changing worlds delete that older view, and memories that keep it hand the generator the past. Temporal databases separate when a record is stored from when its content holds, its valid time. ReDate keeps every frame and dates each retrieved token by its valid time, read from the agent’s action log. The frozen generator then reads a reverted region as one that has just reached a new state, so ReDate needs no training. We prove that trusting the newest timestamp is right exactly when every current view is dated after every outdated one, that without a view taken after the return only the action log tells a reverted region from an up-to-date one, and that a generator able to draw from its own prediction gains more from re-dating than from deletion when the moved tokens keep little weight. After an undo, ReDate raises the share of FAR’s steps showing the current state from 0.36 to 0.62 and HY-WorldPlay’s from 0.003 to 0.19. We also propose a calibrated state metric to test any memory after undos.

[108] DramaVQA: Probing Detailed Understanding of Ultra-Long TV Dramas cs.CVPDF

Xinyue Huo, Pengfei Chen, Jiannan Ge, Kaiwen Duan, Jiacheng Shao

TL;DR: 论文提出 DramaVQA，一个基于超长电视剧的大规模长视频理解基准，包含约 2 万条 QA 对，规模比 Video-MME、LVBench 等此前长视频数据集高一个数量级。该基准采用 LLM 辅助生成复杂问题并进行严格人工校验，同时引入多级时间结构，要求模型理解不同长度的视频片段，最难问题甚至需要整部剧级别的整体理解。实验表明，当前最先进的多模态大模型在超长视频理解上仍面临显著挑战。

Details

Motivation: 现有长视频理解基准多集中于短片段或小时级视频，难以评估持续数十小时的超长视频理解能力，因此需要构建更大规模、更贴近真实超长视频场景的评测基准。

Result: DramaVQA 包含约 20K 个 QA 对，规模超过 Video-MME 和 LVBench 一个数量级；实验显示 SOTA MLLM 在该基准上表现面临重大挑战，说明超长视频理解仍远未解决。

Insight: 创新点在于基于长篇电视剧构建超长视频 QA 基准，提出可扩展的 LLM/MLLM 辅助标注与人工严格校验流程，并设计多级时间结构查询，尤其强调跨整部剧的整体理解和长期记忆管理需求。

Abstract: Despite recent progress in long-form video understanding, current benchmarks mostly focus on short clips or hour-scale videos. This leaves a major gap in evaluating ultra-long video understanding, where videos often last tens of hours. To bridge this gap, we introduce DramaVQA, a large-scale benchmark built upon long-form TV dramas. Containing approximately 20K question-answering (QA) pairs, the scale of DramaVQA exceeds previous long-video datasets, such as Video-MME and LVBench, by an order of magnitude. Our benchmark has two main features that make it stand out from existing datasets. First, we establish a scalable, LLM-assisted annotation pipeline that uses multimodal large language models (MLLMs) to generate complex questions, followed by strict human checking to ensure high data quality. Second, DramaVQA introduces a multi-level time structure; queries are designed across different video lengths, with the hardest questions requiring overall understanding across the entire drama. Extensive evaluations show that state-of-the-art MLLMs face major challenges when tested on these very long videos, highlighting the need for agentic AI algorithms capable of managing long-term memory. The project is available at https://github.com/xinyuehuo/DramaVQA

[109] ConstraintMatch: Compositional Image-Text Matching through Constrained Regional Evidence Selection cs.CV | cs.CLPDF

Yuhong Zhou, Yubo Gao, Xiangbo Shu

TL;DR: 论文提出 ConstraintMatch，一种无需训练的推理方法，用于组合式图像-文本匹配。它将实体级区域一致性转化为显式匹配代价：在冻结的 condition-region 相似度矩阵上，比较每类类别/属性独立选择裁剪区域与同一实体内共享裁剪区域的得分差，并用空间参考校准、逐实体裁剪后从全局相似度中减去该代价。

Details

Motivation: 局部图像-文本匹配虽能为单个概念找到强证据，却可能偏好属性-实体绑定错误的描述；论文希望解决组合式匹配中实体级区域证据选择不一致的问题。

Result: 在 ARO Attribute 全集和 SugarCrepe++ held-out 属性交换上，Qwen2B 与 CORE2B 平均而言，ConstraintMatch 比全局匹配分别提升 7.70 和 5.63 个百分点；在相同 13-crop 预算下，相比适配的 SGI 分别提升 4.85 和 3.51 个百分点。

Insight: 创新点在于将实体级共享区域约束显式建模为匹配代价，并用同图空间参考校准该代价、逐实体裁剪避免残差抵消；方法无需训练、仅用池化嵌入且不增加编码器调用，为组合多模态检索提供了可实用的评分原则。

Abstract: Local image–text matching can find strong evidence for individual concepts yet favor captions with incorrect attribute–entity bindings. We introduce ConstraintMatch, a training-free inference method that turns entity-level regional consistency into an explicit matching cost. On the same frozen condition–region similarity matrix, it compares independent crop selection for each category and attribute with a shared crop choice within each entity. Their gap quantifies the score advantage obtained by relaxing the shared-region constraint. Spatial references from the same image calibrate this gap by keeping category evidence fixed while jointly shifting an entity’s attribute maps. Per-entity clipping prevents cancellation across residuals, and the scaled mean cost is subtracted from global similarity. ConstraintMatch uses pooled embeddings, and spatial calibration requires no additional encoder calls. With parameters fixed per backbone across tasks, ConstraintMatch improves over global matching by 7.70 percentage points on full ARO Attribute and 5.63 points on held-out SugarCrepe++ attribute swaps, averaged across Qwen~~2B and CORE~~2B. Against SGI adapted to the same 13-crop budget, the respective gains are 4.85 and 3.51 points. Controlled analyses distinguish the effects of shared-region matching and candidate score calibration. The results establish entity-level evidence selection as a practical scoring principle for compositional multimodal retrieval.

[110] PhoneValue-Bench: A Multimodal Benchmark and Datasets for Consumer Smartphone Recommerce Valuation cs.CV | cs.AIPDF

Zihan Deng, Jun Gao

TL;DR: 论文面向消费级智能手机二手回收远程估价场景，提出 PhoneValue-Bench 双真值评测基准与分级评分卡，并构建 PhoneValue-Corpus 弱标注训练集（超过2万订单、数十万带描述图像）。同时提出与产线检测流程对齐的分阶段感知-融合-估价参考流水线 ValueAgent，并提供可执行公开评分器与提交格式。

Details

Motivation: 二手手机远程报价需要融合多视角外观照片与诊断截图中的身份、电池、锁定和渠道风险等信息，任一模态出错都会影响成色等级和回收价。现有 multimodal 资源多关注通用 VLM、屏幕理解或工厂缺陷检测，缺少与回收员工对齐的 trade-in 字段、外观/员工双真值以及可执行估价评分卡。

Result: ValueAgent 在 Bench-Full 上取得 84.1/100，外观字段填充率为 97.0，员工字段填充率为 54.1，建立了面向多模态二手回收估价的实用双真值基准。

Insight: 创新点在于双真值评测套件与分级门控评分卡、与训练标签分离的紧凑排序基准、匹配的弱标注大规模语料，以及贴近生产检测流程的分阶段感知-融合-估价流水线和可执行公开评分器/提交规范。

Abstract: As consumer smartphone recommerce scales, buyers must quote binding repurchase prices from seller-uploaded multi-view photos and diagnostic screenshots before devices reach the warehouse. Accurate remote valuation requires fusing noisy cosmetic evidence with identity, battery, lock, and channel risk from screenshots and staff forms, since an error in any modality changes both grade and payout. However, existing multimodal resources mainly target general VLM competence, screen reading, or factory defect detection, and largely overlook staff-aligned trade-in fields, dual appearance/staff ground truth, and executable valuation scorecards. This gap stems from two challenges: (1) the lack of large-scale real trade-in data with audited dual annotations and a compact ranking benchmark kept separate from training labels, and (2) the need to jointly reason over unordered multi-view cosmetics and diagnostic screens under operational deduction rules. To address these challenges, we propose PhoneValue-Bench, a dual-GT evaluation suite with tier-gated scorecards, together with PhoneValue-Corpus, a matched weakly labeled training set of over twenty thousand orders and hundreds of thousands of captioned images. We further present ValueAgent, a staged perception-fusion-valuation reference pipeline aligned with production inspection, plus an executable public scorer and submission schema. Experiments show that ValueAgent reaches a measured 84.1/100 on Bench-Full, with 97.0 appearance fill and 54.1 staff-field fill, establishing a practical dual-GT benchmark for multimodal recommerce valuation.

[111] UniCaMo: Unified Camera and Motion Control for Video Diffusion Models cs.CV | cs.GRPDF

Long Vu, Tan Ngo, Animesh Karnewar, Amir Habibian, Binh-Son Hua

TL;DR: 论文提出 UniCaMo，一个用于图像+文本到视频扩散模型的统一相机与物体运动控制框架。给定参考图像、文本提示、稀疏3D物体轨迹和3D相机轨迹，UniCaMo 构建直接编码目标运动的运动一致输入噪声，从而联合控制相机和物体运动。方法无需修改模型架构或引入专用控制模块，仅需低数据量 LoRA 微调即可适配。

Details

Motivation: 现有可控视频生成通常分别处理相机控制与物体运动控制，且往往依赖额外控制模块或场景几何重建。论文希望统一控制相机与物体运动，并避免重建未见场景几何，以简单有效的方式为扩散模型提供运动先验。

Result: 在标准可控视频生成基准上，实验表明 UniCaMo 达到最先进的运动可控性，同时保持高视觉质量，并且推理开销很小。

Insight: 摘要宣称的创新点在于将相机与物体运动统一编码为运动一致的输入噪声，并结合参考图像噪声传播与球面高斯噪声表示新揭示区域，无需重建未见几何。客观来看，其可借鉴之处是把运动控制前移到噪声构建阶段，配合轻量 LoRA 适配，减少专用控制模块和训练数据需求。

Abstract: We present \textbf{UniCaMo}, an unified framework for joint control of camera and object motion in image-and-text-to-video diffusion models. Given a reference image, text prompt, sparse 3D object trajectories, and a 3D camera trajectory, UniCaMo constructs motion-consistent input noise that directly encodes the desired motion. Our 3D-grounded noise construction combines reference-derived noise propagation with a spherical Gaussian noise representation for newly revealed regions, providing a simple and effective motion prior without requiring reconstruction of unseen scene geometry. UniCaMo requires no architectural modifications or dedicated control modules and can be adapted using lightweight LoRA fine-tuning with low training data volume. Experiments on standard controllable video generation benchmarks demonstrate state-of-the-art motion controllability and high visual quality with minimal inference overhead.

[112] ODC: Orthogonal Drift Correction for Improved Text-to-Image Semantic Alignment at Inference cs.CV | cs.CL | cs.LGPDF

Kasra Kamali, Basim Azam, Tuan Duong Trinh, Jean Honorio, Naveed Akhtar

TL;DR: 论文提出一种推理时引导方法ODC，用于缓解文本到图像生成中的语义漂移。它先在同一视觉-语言嵌入空间比较初始图像与用户提示，识别漂移并提取与提示方向正交的分量，再通过词汇表替代机制转回文本；随后结合初始文本嵌入与重嵌入的漂移表示，经自适应秩缩减概念移除模块生成精炼文本条件，进行第二次生成。方法无需重训练或额外用户输入，可作为即插即用模块提升提示-图像语义对齐。

Details

Motivation: 现有文本到图像模型在复杂或细微提示下常出现语义漂移，已有方法多聚焦属性绑定或对象存在问题，缺少直接精炼初始用户提示文本嵌入的整体性推理时方案。

Result: 在COALBench-300和PartiPrompts上，ODC相比基线最高提升CLIP分数5.4%；在T2I-CompBench复杂子集上，平均3-in-1分数相比竞争方法提升4.5%。

Insight: 创新点在于推理阶段的两阶段正交漂移校正：利用共享视觉-语言空间诊断语义漂移，隔离与提示方向正交的漂移分量并映射回文本，再通过自适应秩缩减概念移除模块精炼文本条件。其可借鉴之处是无需重训练和额外输入，以即插即用方式直接修正文本嵌入并二次生成。

Abstract: Text-to-image models have achieved remarkable success in generating high-quality images from textual descriptions. However, they often struggle with “semantic drift,” where the generated output fails to precisely align with complex or nuanced text prompts. While recent approaches have attempted to address semantic errors regarding attribute binding or object presence, there remains a gap for a more holistic method that addresses these issues by directly refining the text embeddings of the initial user prompt. In this work, we introduce Orthogonal Drift Correction (ODC), an inference-time guidance method designed to mitigate semantic drift without requiring model retraining or additional user inputs. ODC guides image generation through a two-stage process. In the first stage, it identifies the semantic drift by evaluating the initially generated image against the user prompt in a shared vision-language embedding space. It then isolates the component of this drift vector that is orthogonal to the prompt’s direction and translates it back into text via a vocabulary-based surrogate mechanism. In the second stage, it produces refined text conditioning for a second generation pass by feeding both the initial text embedding and the re-embedded drift representation into an adaptive rank-reduced concept removal module. Our experiments demonstrate that ODC consistently improves prompt-image alignment, increasing CLIP scores by up to 5.4% over the baseline on the COALBench-300 and PartiPrompts benchmarks. Furthermore, on the T2I-CompBench complex subset, ODC improves the average 3-in-1 score by 4.5% over the competing methods. As a plug-and-play module, ODC offers a practical and efficient method for improving the reliability of text-to-image models. Code is available at https://github.com/kasrakamali/ODC.

[113] Answer Correction with Verifiable Rewards: A Gemma-Family Study of Multi-View Driving QA cs.CV | cs.LGPDF

T N Rickesh, Pranav Vinodh, Sowmya Kamath S

TL;DR: 论文在 Gemma 模型族和多视角驾驶问答数据集 WaymoQA 上研究后训练带来的性能提升究竟来自“答案选择/纠正”还是“答案抽取能力提升”。通过匹配评测框架比较 Gemma-4-12B 基线与 GRPO 版本，发现准确率有小幅提升，且提升主要来自将原本可抽取但错误的答案纠正为正确，而非恢复不可抽取答案；同时揭示聚合准确率提升可能掩盖安全关键类别的性能下降。

Details

Motivation: 多摄像头驾驶问答可作为视觉语言模型的离散测试，但后训练后的准确率提升可能混合了答案选择变化与答案抽取改善，论文希望区分二者并给出可复现的诊断性评估。

Result: 在匹配框架下，Gemma-4-12B 经 GRPO 后准确率从 73.78% 提升到 75.43%，提升 1.65 个百分点，bootstrap 区间为 [+0.84, +2.41]；215 个改进中 213 个来自可抽取但错误的基座答案被纠正。类别分析显示常规感知提升 +5.93 个百分点，但安全关键危险预测下降 1.82 个百分点；另一 Gemma-31B thinking 对比未检测到平均提升。

Insight: 创新点在于用“正确性×可抽取性”的诊断性记账区分答案纠正与答案抽取改善，并揭示无权重结果奖励可能以牺牲稀有安全关键场景换取总体准确率；其可借鉴之处是更细粒度的后训练评测与安全不对称分析，而非声称特定 grounding 机制或优于匹配监督调优。

Abstract: Multi-camera driving question answering provides a discrete test of vision-language models, but post-training gains can reflect changed selected answers or improved answer extraction. We investigate this distinction within the Gemma model family using archived, task-linked WaymoQA evaluations. A zero-shot diagnostic on 5,519 test questions spans effective-small, mixture-of-experts, unified, and dense checkpoints, with serving differences disclosed rather than interpreted as architecture effects. The strongest controlled evidence is a matched-harness Gemma-4-12B base/GRPO pair: accuracy rises from 73.78% to 75.43%, a gain of 1.65 percentage points with a scene-cluster bootstrap interval of [+0.84, +2.41]. There are 215 improvements and 124 regressions; 213 improvements start from an extractable but incorrect base answer, and only two recover previously unextractable responses. Crossing correctness with extraction state shows why correct noncompliant outputs cannot be counted as prediction errors. Category counts reveal a critical safety asymmetry: routine perception gains (+5.93 pp) mask a regression in safety-critical hazard prediction (-1.82 pp), demonstrating that unweighted outcome rewards can trade off rare edge cases for aggregate accuracy. Reward saturation describes sampled training dynamics rather than an architectural ceiling. A separate archived Gemma-31B thinking comparison yields no detected average improvement, with uncertainty that does not establish equivalence. These results support a modest answer-selection gain for the recorded tuning configuration and a reproducible diagnostic accounting, without attributing corrected labels to specific grounding mechanisms or claiming superiority over matched supervised tuning.

[114] Fewer Tokens, More Answers: Verifiable-Reward Tuning of an Ornith-Style VLM for Multi-View Driving QA cs.CV | cs.CL | cs.LGPDF

T N Rickesh, Pranav Vinodh, Sowmya Kamath S

TL;DR: 论文在多视角驾驶问答任务上，对 Ornith 风格 VLM 使用可验证奖励（GRPO）进行微调，目标是让模型在有限 token 预算内把中间推理转化为可提取、可用的答案。实验显示在 400 题开发集且 256 token 上限下，答案可提取率从 78.25% 提升到 90.25%，准确率从 55.50% 提升到 63.75%；完整 2511 题开发集上平均生成 token 从 108.6 降至 47.1，但准确率提升不显著。

Details

Motivation: 关注推理型 VLM 在部署 token 预算下经常生成冗长推理却无法得到可用答案的问题，尤其是多相机驾驶问答场景中答案提取失败和截断问题。

Result: 在选定 400 题、256 token 上限下，GRPO 将答案提取率提升 12 个百分点、准确率提升 8.25 个百分点；相同题目 512 token 下首轮准确率仅提升 0.75 个百分点。完整 2511 题开发集上平均 token 从 108.6 降至 47.1，但配对准确率区间包含 0，未证明显著增益。

Insight: 创新点在于用可验证奖励调优来优化“答案交付”而非单纯推理能力，并结合答案可提取性、截断和错误到正确转变分析 token 预算效应；但结论仅限 Ornith 模型，未证明跨模型迁移或共享架构机制。

Abstract: Reasoning-enabled model derivatives must turn intermediate deliberation into a usable answer within a deployment budget. We study that transition in an Ornith checkpoint adapted to multi-camera driving question answering with verifiable rewards. Paired archived outputs show that, on a selected 400-question development screen with a 256-token cap, GRPO increases answer extraction from 78.25% to 90.25% and accuracy from 55.50% to 63.75%. Of 39 wrong-to-correct transitions, 33 begin with an unextractable base response. The base’s 87 unextractable responses all reach the token cap. Checkpoint-verified reconstruction on those same questions gives a much smaller first-pass accuracy gain at 512 tokens: +0.75 percentage points, versus +8.25 at 256. A later answer-cued continuation is analyzed separately; it helps the base more and narrows the adapter difference. On the full 2,511-question development set, this recovery-enabled pipeline reduces mean generated tokens from 108.6 to 47.1, while the paired accuracy interval includes zero gain. We frame these findings as adaptation of answer delivery under finite budgets, with explicit selection and provenance limits. Ornith’s self-scaffolding lineage and newer reasoning-enabled derivatives such as Bonsai motivate the problem, but our measured results concern Ornith alone and do not establish a shared architectural mechanism or cross-model transfer.

[115] Running a 20B Video Diffusion Transformer on Consumer Hardware: A Deployment and Measurement Report for MiniMax H3 on Apple Silicon cs.CV | cs.DCPDF

Luke Shi, Steven Shi

TL;DR: 论文是一份系统部署与测量报告，将 20.38B 参数的 MiniMax H3 视频扩散 Transformer 通过本地 bf16-to-Q8（8-bit，group size 64）量化完整部署在 Apple Mac mini M5 Pro（64 GiB 统一内存）上，构建无云依赖的文本到视频管线。作者记录了完整部署流程、两个关键阻塞及修复方法，并测量构建时间、峰值内存和四档分辨率下的渲染延迟；还将系统作为无人值守生产管线运行，完成 17 个视频片段、零渲染失败，并给出盲人评审结果。

Details

Motivation: 动机是在消费级 Apple Silicon 硬件上本地运行超大规模视频扩散 Transformer，验证无云依赖部署的可行性、资源开销与生产稳定性。论文关注工程落地中的阻塞问题和实测性能，而非模型算法创新。

Result: 实测中，15.08 秒 576x1024 片段渲染耗时 4838.49 秒，MLX 峰值内存 27.467 GiB；无人值守管线 26.49 小时完成 17 个片段且零失败。17 个生产片段盲评在结构完整性、时序一致性、可见伪影上平均为 3.12、3.18、2.94（满分 5）。

Insight: 创新点主要在工程部署与实证测量：在 Apple Silicon/MLX 上完成 20B 级视频 DiT 的 Q8 量化本地部署，公开部署流程、关键阻塞修复、四档分辨率性能数据和长时间生产运行可靠性。客观看，论文明确不声称模型创新，其价值在于为消费级硬件部署大视频生成模型提供可复现的实测基准与实践经验。

Abstract: We report the end-to-end deployment and measurement of MiniMax H3, a 20.38-billion-parameter video diffusion transformer (DiT) - the count measured from the safetensors headers of the Q8 checkpoint as deployed locally (Section 3.2) - running entirely on consumer Apple Silicon hardware: an Apple Mac mini with M5 Pro chip and 64 GiB of unified memory. Using the official bf16-to-Q8 (8-bit, group size 64) quantization path executed locally on the machine, we produced a working text-to-video pipeline with no cloud dependency. We document the full deployment procedure, including two non-trivial blockers and their fixes, and report measured figures for build time, peak memory, and per-clip render latency across four resolution tiers (Draft 384x640 through Native 768x1344). A 15.08-second 576x1024 clip rendered in 4838.49 seconds with a measured MLX peak of 27.467 GiB. We further operated the system as an unattended production pipeline, completing 17 clips in 26.49 hours with zero render failures. A blind human review of the 17 production clips (generation prompts withheld) averaged 3.12, 3.18, and 2.94 out of 5 for structural integrity, temporal consistency, and visible artifacts. All figures in this report are our own measurements except where explicitly labeled as third-party data. This is a systems/empirical report; we make no claim of model innovation.

[116] Toward Counterfactual Learning for Selective Re-Examination in Agentic Visual Search cs.CVPDF

Ao Chen, Shengchao Chen, Yan Luximon

TL;DR: 论文研究高分辨率图像视觉搜索中VLM是否应继续观察还是直接作答的选择性复审问题，构建了包含3,227条搜索轨迹和8,827个显式commit-or-re-examine决策的ReSee基准，并提出CARE方法。CARE通过比较同一搜索状态下commit与re-examine两种配对后续的反事实收益差，对是否继续搜索进行决策级强化学习监督。

Details

Motivation: 现有提示、示例和结果型强化学习虽能鼓励模型复审，但无法直接监督某一搜索状态下额外观察是否真的有益，导致VLM缺乏选择性复审能力。

Result: 实验表明现有VLM的复审选择性有限；CARE在两个骨干模型上相比GRPO显著提升准确率和决策选择性，并在六个未见OOD基准上实现更高准确率且更少视觉请求。

Insight: 创新点在于将选择性复审建模为决策级反事实价值估计，并构建带反事实裁决的ReSee基准区分应复审与应提交状态；CARE仅对决策token分配成本感知的反事实优势，实现局部信用分配。

Abstract: Visual search over high-resolution images requires a vision-language model (VLM) not only to determine where to inspect, but also whether another observation is warranted before committing to an answer. Existing prompting, demonstrations, and outcome-based reinforcement learning can encourage re-examination, yet do not directly supervise whether it is beneficial at a particular search state. We introduce ReSee, a benchmark of re-examination decisions comprising 3,227 visual-search trajectories and 8,827 explicit commit-or-re-examine decisions, with counterfactual adjudication that distinguishes states where additional inspection is warranted from those where commitment is preferable. Building on this formulation, we propose CARE (Counterfactual Advantage for Re-Examination), a decision-level reinforcement learning method that compares paired continuations under commit and re-examine verdicts from the same search state. Their cost-aware return difference estimates the counterfactual value of an additional observation and is assigned only to the corresponding verdict tokens, providing localized credit for whether search should continue. Experiments expose limited re-examination selectivity in existing VLMs and show that CARE significantly improves accuracy and decision selectivity over GRPO across two backbones, with higher accuracy and fewer visual requests on six unseen OOD benchmarks.

[117] Wave Forcing: Towards Speed-of-Light Streaming Video Generation cs.CV | cs.DCPDF

Yijie Jin, Yuxuan Liu, Jiajun Xu, Ye Huang, Chuzhi Wang

TL;DR: 论文提出 Wave Forcing（WF），面向实时长视频流式生成，协同设计生成、训练与执行流程。WF 通过 chunk-wise 因果注意力访问尚未完全去噪但更早、更干净的 chunk，并在多个全模型副本间错峰分布去噪与缓存刷新，实现 pipeline fill 后每轮并发前向输出一个 chunk（1F1C）。同时设计三阶段训练和 Wave Runtime（WaveRT/Wave Parallelism）以支持连续多步去噪生成并提升系统吞吐。

Details

Motivation: 现有 chunk-wise 自回归视频生成方法效率低：串行去噪和历史缓存刷新即使一步去噪也需两次前向；长 rollout 还会导致质量下降和相机漂移。论文旨在实现外观一致、运动自然且高吞吐的连续长视频生成。

Result: 在 Wan2.1-T2V-1.3B 上，5 步 WF 整体质量与 Rolling Forcing 相当，并在短视频和长视频上取得更高 Dynamic Degree；4 步 WF 在 8 张 H200 上达到 147.6 DiT FPS 和 134.8 端到端 FPS，端到端吞吐为单 GPU 的 7.07 倍。DiT-only 对比中，在匹配 SageAttention+W8A8、去噪步数和 GPU 数的条件下，WP 在 1.3B–14B 六个模型规模上最高达到 Ulysses 与 Ring 上下文并行基线中较优者的 2.53 倍吞吐。

Insight: 论文宣称的创新是生成、训练、执行协同设计：用因果 chunk 注意力和错峰去噪/缓存刷新实现多步去噪下的 1F1C 连续输出，并用三阶段训练使模型适应混合噪声与自生成历史。客观看，其创新在于将流式视频生成中的多步去噪流水线并行、历史缓存管理和专用运行时（早 K/V 交付、通信计算重叠、流水线 VAE 解码）结合，针对长视频自回归生成的质量退化与吞吐瓶颈提出系统级方案。

Abstract: Real-time long-video generation requires continuous output with consistent appearance and natural motion. Existing chunk-wise autoregressive methods face challenges in both generation efficiency and long-video quality: serialized denoising and history-cache refresh require two forward passes even with one-step denoising, and longer rollouts can degrade quality and cause camera drift. We propose Wave Forcing (WF), which co-designs generation, training, and execution for continuous video output with multi-step denoising. WF uses chunk-wise causal attention to access earlier, cleaner chunks before their denoising is complete, and distributes staggered denoising and cache-refresh stages across full-model replicas to achieve 1F1C: one output chunk per concurrent forward round after pipeline fill. To adapt the model to this continuous generation process, we develop a three-stage training procedure that successively introduces mixed-noise denoising, motion supervision, and causal adaptation using self-generated history. To execute this process efficiently, Wave Runtime (WaveRT) uses Wave Parallelism (WP) for early K/V delivery and communication-computation overlap, together with optimized kernels and pipelined VAE decoding. Experiments on Wan2.1-T2V-1.3B show that 5-step WF maintains overall quality comparable to Rolling Forcing while achieving higher Dynamic Degree on both short and long videos. Our system efficiency experiments show that 4-step WF achieves 147.6 DiT FPS and 134.8 end-to-end FPS on eight H200 GPUs, yielding 7.07x the single-GPU end-to-end throughput. In DiT-only tests with matched SageAttention+W8A8 backends, denoising steps, and GPU counts, WP delivers up to 2.53x the throughput of the faster of the Ulysses and Ring context-parallel baselines across six model scales (1.3B-14B).

[118] Learning to Group and Order: Cross-Instance Self-Supervised RL for Vision-Centric MLLMs cs.CVPDF

Songming Yang, Hong-Tao Yu, Xiu-Shen Wei

TL;DR: 论文提出 GO-SSL，一种面向以视觉为中心的多模态大语言模型（MLLM）的跨实例自监督强化学习后训练框架。该方法将两个视觉实例的局部元素混合，要求模型按来源分组并恢复各组内部顺序，从而把实例级比较与空间、时间或几何结构恢复结合起来。作者主要在跨图像拼图任务上实例化该方法，并扩展到 3D 深度和视频时序排序。

Details

Motivation: 现有自监督视觉 pretext 任务主要利用实例内部结构，对跨实例判别和细粒度比较提供的监督有限。论文希望利用无标注视觉数据构造可自动验证的强化学习奖励，增强 MLLM 的细粒度感知和空间理解能力。

Result: 在多个基准上，GO-SSL 稳定优于基座 MLLM 和先前自监督后训练基线，并在细粒度感知与空间理解方面取得明显提升。跨模型规模和模型系列的进一步评测支持其泛化性；摘要未给出具体定量数值。

Insight: 创新点在于将跨实例分组与组内顺序恢复配对成自监督 RL 任务，通过多样配对、打乱和从随机到困难的课程设计，把同一无标注数据转化为更丰富的可验证监督。客观来看，其可借鉴之处是把跨实例比较信号与空间/时间/几何结构恢复耦合，并扩展到深度和视频时序任务。

Abstract: Reinforcement learning (RL) post-training has become an important paradigm for improving multimodal large language models (MLLMs), especially with automatically verifiable rewards. Self-supervised visual pretext tasks provide such rewards without human annotations. However, existing methods mainly exploit within-instance structure, offering limited supervision for cross-instance discrimination and fine-grained comparison. We introduce Group-and-Order Self-Supervised Reinforcement Learning (GO-SSL), a cross-instance jigsaw framework for vision-centric MLLM post-training. Given two visual instances, GO-SSL mixes their local elements and trains the model to group them by instance of origin while recovering the order within each group, coupling instance-level comparison with spatial, temporal, or geometric structure recovery. This paired formulation turns the same unlabeled data into richer verifiable supervision through diverse pairings, shuffles, and a random-to-hard curriculum. We instantiate GO-SSL mainly on cross-image jigsaw tasks and further extend it to 3D depth and video temporal ordering. Across diverse benchmarks, GO-SSL consistently improves over the base MLLM and prior self-supervised post-training baselines, with clear gains in fine-grained perception and spatial understanding. Further evaluations across model scales and families support its generality. These results suggest that cross-instance comparison provides a useful self-supervised RL signal for improving transferable visual understanding in MLLMs. Code is available at https://github.com/SEU-VIPGroup/GO-SSL.

[119] FilmTogether: Cinematic Video Generation from Low-Cost Inputs cs.CVPDF

Shiying Zhang, Xiaobin Hu, Qianchi Zhang, Jiaqi Zhao, Xiaoda Yang

TL;DR: 论文面向低成本随手拍视频到高成本电影感视频的生成/编辑任务，提出大规模配对数据集 CineCraft-120K，包含对齐的低成本与高成本视频对、元素级映射和配对感知编辑提示；同时设计双记忆特征适配器，在不改变原始布局、身份和时序运动的前提下增强光照、服装、材质等电影化元素。

Details

Motivation: 移动设备普及使视频录制门槛降低，但随手拍与电影级制作之间仍存在明显审美差距；核心问题是在保持原始视频核心布局、主体身份和时间运动不变的情况下，升级异构的低成本制作元素。

Result: 摘要称大量实验和消融研究表明 CineCraft-120K 在低成本到高成本视频编辑上具有优越性，并验证了双记忆适配器的有效性；但未给出具体 benchmark 数值或明确 SOTA 对比结论。

Insight: 创新点在于构建带配对感知编辑提示和元素级低/高成本映射的大规模电影化视频数据集，并提出双记忆适配器：文本记忆扩展低到高外观变化的语义能力，提示记忆在上下文注入前提供逐层高成本元素视觉特征校正。客观看，其价值主要在于同时缓解配对训练数据缺失和现有视频编辑模型对多类低成本元素增强感知不足的问题。

Abstract: The widespread adoption of mobile devices has democratized video recording, but a stark aesthetic divide persists between casual, low-cost captures and high-cost cinematic productions. Bridging this gap requires upgrading heterogeneous production elements, such as lighting, specialized costumes, and materials, without altering the core layout, identity, and temporal motion of the original footage. However, this task is heavily bottlenecked by two important challenges: 1) Lacking a high-quality paired training data specifically designed to handle complex low-to-high appearance shifts. 2) Ignoring the capacity of current video editing models to perceive and enhance the multiple low-cost compositions. To address these issues, we present CineCraft-120K, a large-scale dataset of aligned low- and high-cost video pairs annotated with pair-aware editing prompts. CineCraft-120K features a diverse, high-resolution and high-cost Cinematic Crafting bank spanning decades of media production, meticulously taxonomized into 5 broad domains and 23 fine-grained sub-categories. It also provides element-level mapping between low- and high-cost counterparts, offering pair-aware rich textual prompts that precisely detail the required aesthetic transformations while anchoring structural layout. Architecturally, we propose a simple yet effective dual-memory feature adapter, where a text-memory expands semantic capacity for low2high appearance changes, and a hint memory supplies layer-wise visual feature corrections of high-cost element before context injection. Extensive experiments and ablation studies demonstrate the superiority of CineCraft-120K for low-to-high-cost video editing, alongside the effectiveness of our dual-memory adapter.

[120] UI-UG 2: Advancing Mobile UI Understanding and Generation with Fine-Grained Supervision and Reinforcement Learning cs.CV | cs.AI | cs.HCPDF

Hao Yang, Shuoyang Liu, Xiaoyu Lin, Zhou Fang, Maji Huang

TL;DR: 论文提出 UI-UG 2，一个 4B 参数的多模态大模型，用于移动端 UI 理解与生成。它构建了前端语义对齐的 80 类两级 UI 分类体系和多源理解语料，并结合 5000+ 需求-截图-JSON 三元组与 DSL 进行结构化 UI 生成。方法上引入细粒度分解奖励，并用基于 Playwright 渲染、LLM-as-a-Judge 和对比偏好排序的在线 GRPO 优化生成。实验显示其在 80 类基准的 referring/dense grounding 和 4B 规模复合生成评分上表现突出，并发现理解监督可迁移提升生成质量。

Details

Motivation: 移动 UI 理解与生成需要细粒度组件感知和可靠的结构化合成，现有方法在任务覆盖、前端语义对齐和生成优化上仍不足。论文希望沿 UI-UG 的统一方向，提升细粒度监督与渲染感知强化学习能力。

Result: 在自建 80 类基准上，UI-UG 2 在 referring 和 dense grounding 上取得所评估模型中的最强结果；在 4B 紧凑规模下取得所比较模型中的最佳复合生成得分。研究还观察到理解到生成的稳定迁移：固定训练预算下加入细粒度 UI 感知监督可提升生成质量。

Insight: 创新点包括前端对齐的 80 类两级 UI 分类体系、多源理解语料与需求-截图-JSON 生成数据、基于 DSL 的渐进式结构化生成、面向理解任务的分解奖励，以及用 Playwright 渲染和 LLM-as-a-Judge/对比偏好排序实现的端到端在线 GRPO。客观来看，将细粒度 UI 感知监督与渲染感知强化学习结合，并验证理解对生成的迁移，是较有借鉴价值的统一建模思路。

Abstract: Mobile UI understanding and generation require both fine-grained component perception and reliable structured synthesis. Inspired by the unified direction introduced by UI-UG, we present UI-UG 2, a compact 4B-parameter multimodal large language model (MLLM) that advances mobile UI Understanding and Generation with broader task coverage, a front-end-aligned taxonomy, and online render-aware reinforcement learning. UI-UG 2 constructs a multi-source understanding corpus from RICO, VINS, Android in the Wild, and Android Control, annotated with an 80-category two-level UI taxonomy aligned with front-end component semantics, and pairs it with over 5,000 requirement-screenshot-JSON tuples for progressive structured UI generation through a domain-specific language (DSL). For understanding, UI-UG 2 introduces decomposed rewards for category prediction, OCR fidelity, color recognition, dense grounding, and GUI grounding. Unlike the offline Direct Preference Optimization (DPO)-style generation optimization in UI-UG, UI-UG 2 optimizes generation through end-to-end online Group Relative Policy Optimization (GRPO): sampled DSL outputs are rendered with a Playwright-based server-side pipeline and evaluated using LLM-as-a-Judge and contrastive preference ranking. Experiments show that UI-UG 2 achieves the strongest referring and dense-grounding results among the evaluated models on our 80-category benchmark, and achieves the best composite generation score among compared models at a compact scale (4B). More importantly, we observe a consistent understanding-to-generation transfer: adding fine-grained UI perception supervision improves generation quality under a fixed training budget, suggesting that component-level semantics provide a shared representational foundation for both tasks.

[121] What Helps Denoising Can Hurt Memory: Rethinking History in Long Video Generation cs.CVPDF

Yubin Jing, Ziyang Zhang, Meng Chen, Yuyao Li, Haofan Wang

TL;DR: 论文重新审视自回归长视频生成中历史上下文的作用，将其区分为去噪条件和KV提交输入，发现有利于去噪的旧历史上下文在提交阶段可能损害后续生成的一致性。为此提出免训练的Commit Forcing，将提交过程组织为链式结构，每个块在提交时只读取前一个块的KV，使旧历史仅通过链间接影响新条目。

Details

Motivation: 现有自回归视频生成器依赖历史上下文保持时序一致性，但同一干净块会因读取的历史不同而被编码成不同KV；论文指出不能只把历史当作去噪条件，还要研究其作为提交输入的影响，因为旧历史可能帮助去噪却伤害记忆。

Result: 在6个预训练生成器上，60秒VBench的Quality和Total均提升，最高提升1.27 Quality和1.10 Total；长程一致性增益可扩展到240秒视频；在120秒LongLive视频盲测中，对基础生成器的Subject/Scene Consistency胜率达83.5%，Overall Preference胜率达82.9%（不计平局）。

Insight: 创新点在于区分历史上下文在去噪与KV提交中的双重角色，揭示提交上下文扩大时一致性先升后降的现象，并提出无需训练的链式提交规则，限制旧历史对新KV的直接干扰、仅通过链式传递间接影响。

Abstract: Autoregressive video generators produce long videos block by block, using historical context to maintain temporal consistency. After denoising, a committing pass encodes each clean block into keys and values (KV) that later blocks read, and the same clean block can be encoded into different KV depending on the history it reads. We therefore study historical context not only as a condition for denoising but also as an input to committing. Older historical context that supports denoising can harm subsequent generation when read during committing. At fixed context size and temporal positions, older historical context lowers mean clip-to-clip Subject Consistency. Across 5 generator configurations supporting longer contexts, consistency rises, plateaus, and then declines as committing context expands. Motivated by these findings, we propose Commit Forcing, a training-free rule that organizes committing into a chain. During committing, each block reads only the preceding block’s stored KV, so older historical context reaches new entries only through the chain. We apply this rule to 6 pretrained generators. On 60-second VBench, Commit Forcing improves Quality and Total on all 6 generators, by up to 1.27 Quality points and 1.10 Total points. Long-range consistency gains extend to 240-second videos. In a blinded comparison on 120-second LongLive videos, Commit Forcing achieves win rates of 83.5% for subject and scene consistency and 82.9% for overall preference against the base generator, excluding ties.

[122] Grounding Across Views: Cross-View Referring Reasoning for Visual Grounding cs.CVPDF

Hao Gan, Liuqian Wang, Shuang Li, Yufei Gao, Wentao Chao

TL;DR: 论文研究跨视角视觉定位，将传统依赖点击点或边界框的跨视角目标地理定位扩展为由指代表达和视觉样例共同引导的实例定位任务CVVG，并提出视图感知框架GAV，通过跨视角指代推理、样例提示、跨视角对齐和场景级判别，将查询视图中的视觉与语言证据迁移到卫星图像中定位目标。作者还构建了从街景和无人机视角到卫星图像的文本引导定位基准CVOGL-Text。

Details

Motivation: 现有CVOGL方法多用点击点或边界框指定目标，未充分利用自然语言的语义属性和关系；同时指代表达常依赖查询视角，难以直接定位到卫星图像。论文旨在解决跨视角语义证据迁移与实例定位问题。

Result: GAV在MoP-UAV上达到62.55% Acc@0.5的新SOTA；在新提出的CVOGL-Text基准上，于街景和无人机视角划分分别比点击点基线高7.09和6.79 Acc@0.25，显示对较大视角差异的鲁棒性。

Insight: 创新点在于提出联合指代表达与视觉样例的跨视角视觉定位任务CVVG，并设计视图感知的跨视角指代推理，包括目标中心描述、类别一致性检查和方向无关角色线索，再结合样例提示与跨视角对齐完成卫星实例定位。客观看，其可借鉴之处是将语言语义与视觉样例互补用于跨视角证据选择，并构建文本引导的跨视角定位基准。

Abstract: Cross-view object geo-localization (CVOGL) aims to localize a target in a satellite image from an observation captured under another viewpoint. Existing methods typically specify the query with a click point or bounding box, marking the target region but underusing the semantic attributes and relations conveyed by natural language. Moreover, referring expressions are often viewpoint-dependent, making query-view descriptions difficult to ground directly in the satellite image. In this paper, we formulate cross-view visual grounding (CVVG), extending conventional point- or box-prompted CVOGL to instance grounding jointly guided by a referring expression and a visual exemplar. We present GAV (Grounding Across Views), a view-aware framework for selectively transferring visual and linguistic evidence across views. Its core is view-aware referring reasoning: target-centered descriptions are derived from the marked query image, checked for target-category consistency, and augmented with a direction-free role cue. Exemplar prompting, cross-view alignment, and scene-level discrimination ground this semantic evidence in a satellite instance. GAV achieves a new state of the art on MoP-UAV with 62.55% Acc@0.5. We also introduce CVOGL-Text, a benchmark for text-guided grounding from street- and drone-view queries to satellite images. GAV outperforms the click-point baseline by 7.09 and 6.79 Acc@0.25 points on the street- and drone-view splits, respectively, demonstrating robustness to larger viewpoint gaps. The code and annotations will be publicly released.

[123] QVR3D: Query-Guided Visual Reasoning for Training-Free 3D Grounding cs.CVPDF

Jung-Hao Kao, Jing-En Huang, Jia-Wei Liao, Tzuhsuan Huang, Yu-Lun Liu

TL;DR: 论文提出免训练的3D视觉定位框架QVR3D，利用现成基础模型在RGB-D观测上进行查询引导的视觉推理。方法通过查询引导最大覆盖选择与查询相关的互补视角，并用定位概率估计融合实例置信度、属性一致性和关系一致性，从而支持单目标和多目标3D定位。

Details

Motivation: 现有免训练3D视觉定位方法常依赖显式场景变换或场景级帧选择，容易把有限视觉能力浪费在与查询无关的区域。论文认为有效定位应优先选择能为查询提供证据的观测，而非均匀表示整个场景。

Result: 在ScanRefer和Nr3D上取得最先进的零样本3D定位性能；QGMC还能提升多个3D视觉语言任务中的帧效率。

Insight: 创新点在于以查询相关证据为中心进行视角选择，而非均匀场景表示；结合最大覆盖视角选择与多一致性概率估计，并统一支持单/多目标定位且无需任务特定适配。其思路对免训练3D视觉语言推理中的观测选择和证据融合具有借鉴意义。

Abstract: 3D visual grounding localizes objects in 3D scenes from natural language descriptions, requiring reasoning over semantics, spatial relationships, and multi-view observations. Training-free approaches avoid costly annotations but often rely on explicit scene transformation or scene-level frame selection, which may waste limited visual capacity on query-irrelevant regions. We observe that effective grounding should prioritize observations that provide evidence for the query rather than uniformly represent the entire scene. Based on this insight, we introduce QVR3D, a query-guided visual reasoning framework that operates on RGB-D observations using off-the-shelf foundation models. QVR3D combines Query-Guided Maximum Coverage (QGMC) for selecting complementary query-relevant views with Grounding Probability Estimation (GPE) that integrates instance confidence, attribute consistency, and relationship consistency. The framework supports both single- and multi-object grounding without task-specific adaptation. Experiments on ScanRefer and Nr3D achieve state-of-the-art zero-shot performance, while QGMC also improves frame efficiency across multiple 3D vision-language tasks. Our code is available at https://github.com/jwliao1209/QVR3D.

[124] StreamDuo: A Live Commentator and a Research Agent for Unseen Games cs.CVPDF

Zixian Gao, Penghao Luo, Xiangcheng Cao, Lixin Xiu, Ziqi Cai

TL;DR: 论文研究跨游戏实时解说：模型在单个游戏上训练，却要对未见过的游戏进行直播解说。作者发现现有流式视频LLM能迁移解说时机，但缺乏新游戏的世界知识。为此提出StreamDuo，将可训练解说器与冻结的“研究代理”结合，后者按需读取当前游戏Wiki并返回条目。仅训练解说器，在BG3上训练并在10个未见游戏上测试，提升实体召回、降低源游戏泄漏，并取得最佳时机与综合质量。

Details

Motivation: 现有直播解说LLM通常在相同游戏上训练和测试，跨游戏时虽能把握解说时机，却无法识别新游戏中的实体和背景知识。论文旨在解决未见游戏场景下的实时解说知识缺失问题，同时保持直播连续性与低延迟。

Result: 在Baldur’s Gate 3上训练并测试10个未见游戏，StreamDuo将实体召回从Proact-VL的0.082提升到0.116，源游戏泄漏从9.9%降至1.0%，并在流式模型中取得最佳解说时机、最高 liveliness 与整体质量评价。

Insight: 创新点在于将解说器与冻结的Wiki研究代理解耦：解说器遇到无法命名内容时主动发帧查询，代理约2秒后返回少量Wiki条目。训练上仅更新解说器，利用信息增益标签学习“何时提问有帮助”，并用可见理想答案的自策略蒸馏提升对噪声检索结果的利用能力。

Abstract: Streaming video LLMs can now commentate live gameplay, but they are trained and tested on the same games. We study cross-game streaming commentary, in which a model trained on one game commentates games it has never seen, and find that current commentators transfer their timing but not their knowledge of the game world. We propose StreamDuo, which pairs a trainable commentator with a frozen research agent that reads the wiki of the game being played. When the commentator sees something it cannot name, it sends the current frames, and the research agent returns a few wiki entries two seconds later while the stream continues. We train only the commentator, on a single game, in two stages. Information-gain labels teach it to ask only where an answer would help it say what the human caster said, and on-policy self-distillation from a copy of itself that sees the ideal answer teaches it to use noisy answers. Trained on Baldur’s Gate 3 and tested on ten unseen games, StreamDuo raises entity recall from 0.082 to 0.116 over Proact-VL trained on the same data, cuts source-game leakage from 9.9% to 1.0%, and achieves the best timing and the highest judged liveliness and overall quality among streaming models.

[125] What Does a Safety Label Measure? Auditing Situational-Safety Benchmarks for Multimodal LLMs cs.CV | cs.AI | cs.LG | cs.MAPDF

Wayner Barrios, Kenneth Barrios

TL;DR: 论文审计多模态大模型的情境安全基准中 SAFE/UNSAFE 标签究竟测量了什么，提出包含七个测量字段的 Benchmark Card，并对六个基准进行审计。研究发现部分基准存在图像文件泄漏、条目划分或请求文本决定标签等问题；进一步提出 Spot-Stop 分解，将排序能力与标签化能力之间的差距拆成阈值、分数重叠和配对内顺序三部分，并给出无标签重中心化等校正策略。

Details

Motivation: 现有情境安全基准通常用场景级 SAFE/UNSAFE 标签和模型自由回答评分来指导 MLLM 部署，但标签分数可能来自场景本身、用户请求或基准文件/设计偏差，导致评分未必真实反映模型的情境安全能力。论文旨在审计这些标签的有效性并区分不同信号来源。

Result: 在六个基准的审计中，仅 MSSBench chat 被证实通过图像文件泄漏标签，仅用图像尺寸即可达到 82.3% 准确率，匹配或超过七个商业模型中的六个；修正后的 chat split 上该规则降至随机水平。Spot-Stop 分析显示 14 个开源 MLLM 中多数排序能力优于标签能力，且超出 AUROC 预期；共享阈值可修复 chat 上三分之一到一半的过量差距，无标签重中心化在 VSCBench 上改善 13/14 个模型的排序。

Insight: 论文的创新点在于提出 Benchmark Card 系统审计安全标签的信号来源，并用 Spot-Stop 分解细粒度区分模型排序与标签化表现；客观来看，其价值在于揭示基准泄漏和设计偏差，并提供无需标签的重中心化校正思路，对安全基准构建和模型评估具有诊断与改进意义。

Abstract: Situational-safety benchmarks label each scene SAFE or UNSAFE and score a multimodal large language model (MLLM) against that label, usually by judging its free-form answer, and these scores guide deployment. We ask what such a label measures. A label score can come from the scene, the request or the benchmark’s own files. We propose the Benchmark Card, seven measured fields that tell them apart, and fill it for six benchmarks. Only MSSBench chat leaks the label through its image files: image size alone reaches 82.3% accuracy, matching or beating six of seven commercial models. Elsewhere the signal outside the scene comes from design. In MOSSBench the item partition fixes the label, and on HoliSafe the request alone ranks pairs about as well as the scene. On our corrected chat split, the size rule falls to chance. We then introduce the Spot-Stop decomposition, which compares ranking with labelling on pairs of a safe and an unsafe scene. It splits the gap above a label-swap null into three parts: a threshold part, overlap between safe and unsafe scores, and order that holds only within a pair. Most of fourteen open MLLMs rank better than they label, beyond what their AUROC predicts. On chat, one shared threshold repairs a third to a half of the excess, and label-free recentering recovers it on balanced batches. Recentering on unlabelled scenes of the same situation improves ranking on VSCBench for 13 of 14 models.

[126] SHield: Watermarking 4D Gaussian Splatting via Spherical Harmonic Coefficient Perturbation cs.CV | cs.CR | cs.GR | cs.MMPDF

Kunal Bhosikar, Prajas Wadekar, Venkata Sai Pranav Bachina, Ankit Gangwal, Charu Sharma

TL;DR: 论文提出SHield，一种面向4D Gaussian Splatting（4DGS）参数文件的非盲、无解码器水印方法。它将全分辨率RGB图像作为payload嵌入密钥选择的Gaussian子集球谐系数中，并通过闭式算术恢复所有权信息。方法在多个动态场景数据集上实现近完美payload恢复且渲染保真损失极低，并给出量化、剪枝和SH截断下的鲁棒性边界。

Details

Motivation: 4DGS训练成本高但参数文件易被复制分发，现有水印依赖对渲染视频做神经解码，流程重且受动态场景时间变化影响。论文关注直接保护重新分发的4DGS文件本身，利用其规范SH系数时间与视角不变的特性简化验证。

Result: 在D-NeRF、HyperNeRF、DyNeRF共30个场景、150个模型上，payload恢复Pearson r≥0.991，平均渲染惩罚≤0.13 dB；400次真实试验完美检测，1600次错误子集零假阳性。方法可承受INT8量化和30% opacity pruning，并在激进SH-degree-1截断下仍可解码bit payload。

Insight: 宣称创新是首个非盲、无解码器的4DGS水印，将水印从渲染视频域转到参数域，利用SH系数不变性实现闭式恢复，并用规范Gaussian中心几何重关联抵抗文件篡改。客观看，其创新在于结合4DGS结构先验、密钥选择子集和锚定优化，在嵌入容量、视觉保真与验证效率之间取得平衡，并明确刻画鲁棒性边界。

Abstract: 4D Gaussian Splatting (4DGS) models are computationally expensive to train but distributed as easily copied parameter files. Existing watermarks protect these assets by fine-tuning the scene against a neural decoder to extract bit strings from rendered video, a heavy process vulnerable to the temporal dynamics of dynamic scenes. However, if the threat model targets the redistributed file itself, verification can be vastly simplified. Because the canonical Spherical-Harmonic (SH) coefficients of 4DGS are time- and view-invariant, parameter-space perturbations can be recovered via deterministic arithmetic. We propose SHield, the first non-blind, decoder-free watermarking approach that natively embeds full-resolution RGB images into 4DGS files. SHield tiles a zero-mean payload across the SH coefficients of a key-selected Gaussian subset, applying a brief anchored optimization to preserve visual fidelity. To verify ownership, it geometrically re-associates the key using canonical Gaussian centres to survive file tampering and recovers the payload in closed form. Across 30 scenes (D-NeRF, HyperNeRF, DyNeRF), SHield guarantees near-perfect payload recovery (Pearson $r \geq 0.991$) on all 150 tested models with a mean rendering penalty of $\leq 0.13$~dB. Held-out evaluation yields perfect detection on 400 true trials and zero false positives across $1{,}600$ wrong-subset null trials. We also strictly bound the method’s robustness: SHield survives INT8 quantization and $30%$ opacity pruning for the image payload, and on aggressive SH-degree-1 truncation bit payloads are still decodable.

[127] Context-Shielded Backdoor Attack against Large Vision-Language Models cs.CVPDF

Zhifang Zhang, Qiang Huang, Chenpeng Wang, Weitong Chen, Olaf Maennel

TL;DR: 论文提出一种面向大型视觉语言模型（LVLM）的上下文屏蔽后门攻击 StripWake：在完整视觉 token 推理与预部署审计时保持休眠，而在推理时视觉 token 压缩/剪枝后激活。该方法通过仅修改投影器、结合干净监督的全 token 视图与目标监督的随机压缩视图，并利用冻结良性教师对齐早期视觉注意力，实现隐蔽且可跨未见压缩器触发的后门。

Details

Motivation: 现有 LVLM 后门在触发图像出现时即激活，在全 token 推理下攻击成功率接近 100%，容易在预部署审计中暴露；论文希望解决如何构造仅在视觉 token 压缩场景下激活、在全 token 审计下休眠的后门。

Result: 在 LLaVA-1.5-7B 上，StripWake 在九个未见压缩器设置下全 token ASR 仅 0.4%，在五个主要压缩器上压缩后 ASR 达 94.0%-99.7%，且无 CIDEr 损失。

Insight: 论文揭示 context stripping 现象：周围干净视觉 token 会在完整长度下抑制嵌入触发器，而 token 剪枝移除上下文后激活后门。创新点在于仅修改投影器、利用全 token 干净监督与随机压缩目标监督相结合，并通过冻结良性教师对齐早期视觉注意力，从而兼顾审计隐蔽性、压缩后激活和干净效用保持。

Abstract: Large vision-language models (LVLMs) routinely use inference-time visual-token compression to prune hundreds of patch tokens down to a compact budget. Existing LVLM backdoors fire whenever a triggered image appears, whereas prior deployment-triggered attacks activate only when model weights are quantized or pruned. However, conventional LVLM backdoors exhibit nearly 100% attack success rate (ASR) under full-token inference, immediately exposing compromised checkpoints during pre-deployment auditing. We reveal context stripping: surrounding clean visual tokens suppress an embedded trigger at full length, whereas token pruning strips this context away and activates the backdoor. Motivated by this finding, we propose StripWake, a projector-only backdoor that remains dormant under full-token auditing yet activates across unseen compressors. Specifically, StripWake pairs clean-supervised full-token views with target-supervised randomized compressed views, and aligns early visual attention with a frozen benign teacher to preserve clean utility. On LLaVA-1.5-7B across nine unseen compressors, StripWake stays dormant at 0.4% full-token ASR yet achieves 94.0%-99.7% compressed ASR across five primary compressors without CIDEr loss.

[128] StreamClarify: Proactive Clarification for Grounded Streaming Video Question Answering cs.CVPDF

Zhuchen Shao, Bo Chen, Klara Nahrstedt

TL;DR: 论文提出 StreamClarify，一个无需训练的流式视频问答框架，在回答前用轻量不确定性检测决定直接回答还是主动请求澄清，并结合时间金字塔 KV 缓存与 CPU 端语义检索归档支持重答。作者还构建了 StreamClarify-QA 诊断基准，覆盖标准、指代歧义和不可回答场景，并在多个 VLM 主干上验证有效性。

Details

Motivation: 流式视频问答需在严格时延和有限活跃上下文预算下实时推理；现有流式 VLM 在查询歧义、错误前提或相关视觉证据已离开活跃上下文时，容易给出自信但缺乏依据的答案。主动澄清虽有帮助，但必须满足同样的时延和内存约束。

Result: 在三个 VLM 主干上，StreamClarify 相比同主干基线最高提升 8.2 个 Macro 准确率点；在相近触发率下，基于熵的选择识别初始错误答案的精确率比随机选择高 18 点以上；在 oracle 用户引导下澄清最高提升 3.5 点；Qwen3-VL 歧义 QA 模拟中熵门控条件提升 8.3 点。

Insight: 创新点在于将预回答二值判断的熵作为轻量不确定性分数来触发主动澄清，并以时间金字塔 KV 缓存维持有界活跃视觉上下文、用 CPU 端语义检索归档访问历史帧，从而在无需训练的情况下支持流式重答；同时构建了面向澄清与歧义/不可回答场景的诊断基准。

Abstract: Streaming video question answering (QA) requires real-time reasoning over continuous video streams under strict latency and active-context budgets. Current streaming vision-language models (VLMs) often give confident yet ungrounded answers when queries are ambiguous or have false premises, or when relevant visual evidence is no longer in the active context. Proactive clarification can help, but must satisfy the same latency and memory constraints. We present StreamClarify, a training-free framework for grounded streaming QA that combines a pre-answer uncertainty check with hierarchical memory. The check uses the entropy of a binary pre-answer judgment as a lightweight uncertainty score to decide whether to answer directly or request clarification. To support re-answering, a temporal-pyramid KV cache maintains a bounded active visual context, while a CPU-side semantic retrieval archive provides access to historical frames. We further construct StreamClarify-QA, a diagnostic benchmark of 1,837 QA pairs from StreamBench and OVO-Bench, spanning standard, referential ambiguity, and unanswerable scenarios. Across three VLM backbones, StreamClarify improves Macro accuracy by up to 8.2 points over backbone-matched baselines. At comparable trigger rates, entropy-based selection achieves more than 18 points higher precision than random selection in identifying initially incorrect answers. Under oracle user guidance, clarification improves Macro accuracy by up to 3.5 points. We also report a controlled, oracle-assisted Qwen3-VL simulation on Ambiguous QA with generated questions and referent-only user replies, where the entropy-gated condition improves accuracy by 8.3 points.

[129] IMPACT: Image-Conditioned Motion with Physics-Aware Collision and Trajectory Guidance for Video Generation cs.CVPDF

Shiwei Yang, Yunlong Yu, Zhao Wang, Jungong Han

TL;DR: 论文提出IMPACT，一个物理状态驱动的图像到视频生成框架，通过显式动力学预测和稀疏-密集物理引导来解决生成视频中物理不一致的问题。它使用可学习校准的物理状态生成器统一连续自由飞行和离散碰撞响应，并从同一物理rollout导出稀疏轨迹和密集区域运动先验来约束扩散采样。实验表明在球-平面碰撞场景中物理合理性优于基线。

Details

Motivation: 视觉逼真的视频生成不保证物理一致的运动，生成物体可能出现不合理的碰撞响应或无能量耗散的反弹，即使物理有效的运动预测在合成中也可能未被忠实实现。

Result: 在100个覆盖不同材料组合和视觉环境的受控球-平面碰撞场景上，IMPACT的物理合理性优于代表性通用、物理基础和运动可控的基线方法。

Insight: 创新点在于将物理状态生成与生成约束耦合：可学习校准的物理状态生成器统一连续和离散动力学，并从同一物理rollout导出稀疏全局轨迹和密集区域运动先验，共享物理基础以减少预测-生成不匹配。客观分析：结合显式物理状态预测与扩散模型引导的思路有借鉴价值。

Abstract: Visually realistic video generation does not guarantee physically consistent motion. Generated objects may exhibit implausible collision responses or rebounds without energy dissipation, while even physically valid motion predictions may not be faithfully realized during synthesis. We propose \textbf{IMPACT}, a physics-state-driven image-to-video framework that addresses these challenges by coupling explicit dynamics prediction with complementary sparse–dense physical guidance. A learnably calibrated Physics State Generator unifies continuous free-flight dynamics with discrete collision responses, linking impact timing, post-impact velocity, rebound attenuation, and eventual settling within a coherent physical-state sequence. To translate this evolution into effective generative constraints, IMPACT derives sparse trajectories and dense region-level motion priors from the same physical rollout. Sparse trajectories constrain global object displacement, while dense priors guide diffusion sampling to encourage coherent object-region motion and suppress unwanted background changes. Their shared physical basis coordinates global and local motion guidance to reduce prediction–generation mismatch. Experiments on 100 controlled sphere–plane collision scenes spanning different material combinations and visual environments demonstrate improved physical plausibility over representative general-purpose, physics-grounded, and motion-controllable baselines. The project repository is available at https://weiweiwiewei.github.io/impact

[130] Vocabulary Aligned Explanations for Computer Vision Models cs.CV | cs.AIPDF

Erfan Mirhaji, Nikhil Krishnaswamy, Jill Zarestky, Lisa Mason, Nathaniel Blanchard

TL;DR: 论文提出FLUENT，一个用于计算机视觉模型的事后解释框架，用应用领域的专家术语和逻辑规则解释图像分类。它综合必须、替代和缺失概念对专家规则排序，并结合预测标签、概念状态、经验似然与概念先验来处理预测错误。最终通过遮挡高亮正概念和检索参考图像中的负概念示例，向用户展示规则置信度与视觉证据。

Details

Motivation: 优化视觉模型准确率并不保证模型学习并使用人类可理解、领域特定的概念和规则，因此需要以领域词汇和专家知识解释图像分类。

Result: 摘要未给出定量实验结果、benchmark或SOTA比较，主要说明框架能输出视觉概念高亮和显式规则置信度来解释图像。

Insight: 创新点在于将专家撰写的逻辑规则与视觉概念证据对齐，联合建模必须、替代和缺失概念，并在解释排序中结合预测错误、似然和概念先验；客观上看，其可借鉴之处是把规则置信度、不确定性感知和面向终端用户的视觉示例整合为领域词汇解释。

Abstract: Optimizing vision models for accuracy does not force the model to learn and utilize human-understandable and domain-specific concepts and rules. We propose explaining image classifications through domain-specific concepts, visual evidence, and expert knowledge expressed as logical rules. We introduce FLUENT (Framework for Localized, Uncertainty-Aware Explanations in Normative Terminology), a post-hoc framework that ranks expert-authored rules combining jointly required, alternative, and absent concepts. To account for prediction errors, FLUENT combines predicted labels and concept states with empirically estimated likelihoods and concept priors. It scores each rule by calculating support over satisfying assignments to the concepts mentioned in that rule, then normalizes these scores to express relative confidence among candidate explanations. The selected rule is illustrated through occlusion-based highlights for positive concept mentions in the query image and localized examples in retrieved reference images for negative mentions. These illustrations are intended to show end users unfamiliar with the domain what the concepts named in an explanation look like. FLUENT combines domain knowledge and model accuracy, and delivers visual concept highlights and explicit rule confidence to explain an image in the vocabulary of an application domain.

[131] See, Think, Use: Diagnosing Perception and Reasoning Failures in VLMs cs.CV | cs.AI | cs.CLPDF

Jiacheng Ding, Yanliang Qi, Cong Guo, Peihua Mai

TL;DR: 论文提出 See, Think, Use 诊断协议，将视觉语言模型（VLM）的每个答案归因于感知、推理或对感知结果的使用三个环节。该方法通过定位探针衡量“看见”、文本替换探针衡量“思考”，并用反事实图像对衡量答案是否真正跟随模型自身感知。作者在两个模型家族、六个数据集上验证，并据此将测试时计算分配到失败阶段。

Details

Motivation: 现有基准只评分最终答案，无法区分模型是真正看懂了图像、进行了推理，还是依赖猜测或记忆先验，因此开发者难以定位应改进感知还是推理阶段。

Result: 在两类模型和六个数据集上，论文发现有效的调控手段随任务类型而变化；答案通常跟随模型感知，但在图像与常见先验矛盾时会失败，先要求模型定位可在框正确时修复该问题；按测量阶段分配计算接近最佳统一策略且成本更低，并在调控能提升短板阶段时优于同等计算的随机分配。

Insight: 创新点在于无需访问模型权重，仅用每项两个额外问题即可将答案分解为感知、推理和感知使用，并用反事实图像对设计无需答案标签的“使用率”指标；其可借鉴之处是将细粒度诊断与测试时计算分配直接结合。

Abstract: We present See, Think, Use, a protocol that traces each answer of a vision-language model to perception, reasoning or the use of perception. The diagnosis shows a developer which stage to improve and directs test-time compute to the stage that fails. Benchmarks score the final answer, and an answer that rests on the image earns the same credit as a guess or a memorized prior. The protocol asks the model two extra questions per item and needs no access to its weights. A localization probe asks for a box around every instance and measures seeing, and a text-replacement probe answers from a description and measures thinking. Use is the rate at which the answer follows the model’s own perception across counterfactual image pairs. The rate needs no answer labels, because the question and its prior are the same on both images. On two model families and six datasets the protocol shows that the knob that helps follows the task family. Answers follow the model’s perception except on images that contradict a common prior, and asking the model to localize first repairs this failure when its boxes are right. Allocating compute by the measured stages comes close to the best uniform policy at lower cost and beats a random allocation of the same compute wherever a knob raises the short stage. We will release the code, the prompts and the per-question outputs.

[132] Label-Free Localization and Test-Time Suppression of CLIP’s Typographic Circuits cs.CVPDF

Bohan Liu, Wenqian Ye, Guangzhi Xiong, Zhenghao He, Sanchit Sinha

TL;DR: 论文研究CLIP视觉编码器中“看物体”和“读文字”能力纠缠导致的排版攻击脆弱性，提出基于头分解稀疏字典学习的无标签方法定位携带文字信息的注意力头，并在测试时通过机制性干预抑制这些“文字回路”，从而恢复被排版攻击干扰的物体分类。论文还提出测试时自适应注意力头路由，以在鲁棒性与通用感知性能之间取得更优权衡。

Details

Motivation: CLIP类视觉语言模型在跨模态对比学习下同时具备物体识别和文字读取能力，二者纠缠使其易受排版攻击影响，即图像中的文字会覆盖其语义内容；而CLIP编码器的黑盒性阻碍了对该纠缠机制的机理解释和针对性防御。

Result: 实验在五个CLIP变体和四个排版攻击基准上进行，测试时干预可有效恢复受攻击下的物体分类，最高提升46.9%，同时在通用图像感知上最多仅损失约1%准确率，优于先前有监督和无训练方法；自适应注意力头路由进一步在相同鲁棒性下降低性能影响，突破现有鲁棒性-感知权衡的Pareto前沿。

Insight: 创新点在于用头分解稀疏字典学习将注意力头分解为可解释的头部特定隐变量，并提出无标签的Clarity Score和归一化Text Attribution Score定位文字信息头；客观看，其可借鉴之处是将机制可解释性分析与测试时因果干预结合，实现无需训练的排版攻击抑制和自适应路由。

Abstract: CLIP-based Vision-Language Models have become cornerstones of modern multimodal systems. The cross-modal contrastive objective equips the CLIP vision encoder to both see objects and read text. These two abilities induce an entanglement between the encoding of lexical and semantic shapes, creating a distinctive vulnerability to typographic attacks, in which rendered text overrides an image’s semantic content with its literal meaning. The black-box nature of these encoders has prevented a mechanistic interpretation of such entanglement. We introduce a head-decomposed Sparse Dictionary Learning (SDL) architecture that, by design, decomposes individual attention heads into interpretable, head-specific latents. Based on this inductive disentanglement, we re-purpose Clarity Score and propose normalized Text Attribution Score, which are both label-free, to identify attention heads that carry typographic information. As a causal validation of successful circuit separation, we perform a mechanistic intervention that reweighs attention away from the patch tokens in the identified lexical heads at test-time. Experiments show that the intervention effectively recovers object classification under typographic attack and, across five CLIP variants and four typographic benchmarks, achieves up to 46.9% improvement while incurring up to 1% accuracy loss in general image perception, outperforming prior supervised and training-free methods. Expanding on the mechanistic intervention, we propose a test-time adaptive attention head routing to further reduce the impact on performance at matched robustness, pushing beyond the Pareto frontier of current robustness-perception tradeoff.

[133] VLMs Read Aloud: The Gap Between Recognizing and Using Visual Text cs.CV | cs.CLPDF

Zhiyun Shi

TL;DR: 论文研究视觉文本压缩中 VLM 的“能识别但不会用”问题：模型可以逐字转写图像中的文字，却仍无法据此回答问题；若把它自己的转写文本喂回，回答效果接近原文。作者提出 ALOUD，将视觉分辨率用于定位和识别证据，将语言 token 用于利用证据，从而在长文档压缩场景中显著提升准确率。

Details

Motivation: 现有视觉文本压缩主要按“能恢复多少文本”来设计，但恢复出的文字不等于可用的文字；论文旨在解决识别与使用之间的 read-use gap，即 VLM 能读出视觉文本却不能用它答题的问题。

Result: 在长文档 5x 和 10x 压缩下，ALOUD 将冻结 Qwen3-VL-8B 的准确率在 5x 时从 27.7% 提升到 54.8%，接近原文的 58.5%，且上下文小于压缩页面本身；同等预算下优于不使用原文的方法以及 AGAR、VERA，5x 时还超过 LensVLM-9B。预注册测试中，read-use gap 能预测 8 个 VLM 从自身转写中获得的收益排名（Spearman ρ=0.86）。

Insight: 创新点在于将视觉文本压缩的瓶颈从“识别率”转向“可用性”，量化 read-use gap，并提出按资源分工的 ALOUD：视觉分辨率负责找证据和识别，语言 token 负责推理使用，同时用自生成转写弥合差距。客观来看，该 gap 的度量方式和资源分配思路对长上下文视觉压缩与 VLM 推理具有借鉴价值。

Abstract: Visual-text compression renders long contexts as images and is engineered around how much of the text a vision-language model (VLM) can recover. Yet recovered text is not usable text. VLMs can transcribe the text in an image word for word and still fail to answer from it; given back their own transcript, they answer nearly as well as from the original text. We call this difference the read-use gap. Recognizing and using visual text have different resolution requirements: Qwen3-VL-8B’s recognition saturates at 15-pixel characters while use catches up only at 24 pixels, and scaling from 2B to 32B raises recognition without narrowing the gap. Putting the evidence into words closes it: thinking VLMs recite the evidence in their thinking, and their own transcript, written without seeing the question, recovers most of what thinking adds. In a preregistered held-out test, the gap ranks how much eight VLMs gain from their own words over pixels (Spearman $ρ$ = 0.86), which recognition rates do not. We propose ALOUD, which spends visual resolution on finding and recognizing evidence and language tokens on using it. Without keeping the source text, it doubles the accuracy of a frozen Qwen3-VL-8B on long documents compressed 5x and 10x: at 5x, from 27.7% to 54.8%, near the original text’s 58.5%, with a context smaller than the compressed pages themselves. For less than the cost of reading the original text, it leads at equal budget every method that does without it, at every level, and beats AGAR and VERA, which paste the original text back; at 5x it also beats LensVLM-9B, which is trained and keeps the original text. Visual-text compression is limited not by how much text a model can recover, but by how much it can use.

[134] AR-RRG: Anatomy-Guided Retrieval-Driven Radiology Report Generation cs.CVPDF

Xiang Zhang, Shijie Song, Wanqing Zhao, Wei Zhou, Rui Cao

TL;DR: 论文提出 AR-RRG，一种解剖引导的检索驱动放射报告生成方法，通过病灶检测网络 ASLDNet 提供精确病灶定位，并结合双粒度检索、邻域共识机制、连续视觉感知流和 LoRA 微调的大语言模型生成临床一致且视觉可溯源的报告。

Details

Motivation: 标准视觉语言模型缺乏解剖区域与诊断文本的细粒度对齐，而现有检索增强方法常检索完整历史报告，带来冗余噪声和视觉-文本错配，易引发临床幻觉和漏诊。

Result: 在 MS-CXR、MIMIC-CXR 和 IU X-Ray 上评估，AR-RRG 在主流指标上持续优于现有最先进方法；摘要未给出具体定量数值。

Insight: 创新点在于解剖感知自训练病灶检测与生成分支结合，采用双粒度检索减少幻觉、邻域共识补全缺失病灶，并通过固定医学编码、重采样和 LoRA 高效调优实现多尺度文本-视觉特征融合。客观看，其价值在于细粒度解剖对齐与检索粒度控制，降低检索噪声和临床幻觉风险。

Abstract: Radiology report generation (RRG) streamlines clinical workflows and alleviates the burden of radiologists’ documentation. Standard vision-language models capture global visual cues and lack fine-grained alignment between anatomical regions and diagnostic text. Most retrieval-augmented methods retrieve complete historical reports, introducing redundant noise and severe vision-text mismatches that trigger clinically risky hallucinations and missed lesions. In this paper, we introduce AR-RRG, an anatomy-guided retrieval-driven method for the generation of radiology reports. AR-RRG consists of two core modules: the anatomy-aware self-training lesion detection network (ASLDNet) and the retrieval-driven radiology report generation (RRRG). ASLDNet leverages anatomy-aware spatial verification (ASV) and class-adaptive dynamic thresholding (CDT) via self-training, delivering accurate lesion localization to support subsequent generation. As the generative branch of AR-RRG, RRRG eliminates clinical hallucinations through dual-granularity retrieval (DR) and complements missing lesions with a neighborhood consensus (NC) mechanism. A parallel continuous visual perception (PCVP) stream converts radiographs into visual tokens through fixed medical encoding and resampling. Multi-scale text and visual features are fused, followed by LoRA-efficient large language model tuning to generate clinically consistent, visually grounded radiology reports. Extensive evaluations on MS-CXR, MIMIC-CXR, and IU X-Ray demonstrate that AR-RRG consistently outperforms state-of-the-art methods across mainstream metrics. Our code will be made publicly available.

[135] MoPort: A View-Aware 2D Interface for Motion Language Models cs.CVPDF

Lixing Tan, Qing Xia, Yuting Guo, Shuai Li, Aimin Hao

TL;DR: 论文提出MoPort，一个视角感知的2D接口，使原本以3D人体动作为输入的motion language models（MoLM）能直接处理单目视频中的2D姿态序列。方法包含两部分：Paired View Alignment（PVA）让同一动作的两个视角共享3D教师目标并约束其隐表示一致，Camera-Modulated Encoding（CME）从2D序列估计相机外参并用于调制编码以注入视角几何信息。在HumanML3D、KIT-ML及真实视频数据集Fit3D上验证了效果与可移植性。

Details

Motivation: 将动作语言模型部署到单目视频时存在两个问题：姿态检测只给出2D关节序列，与训练所用3D动作存在维度鸿沟；且2D观测随相机视角变化，投影丢失深度导致跨视角的2D姿态具有歧义性。

Result: 在HumanML3D上R@1达0.5674，在KIT-ML上达0.3286，优于所有对比基线；在HumanML3D上，分布外视角的R@1仅从分布内的0.5763降到0.5585，视角鲁棒性较强；在三个下游MoLM上验证了可移植性；在真实RGB视频数据集Fit3D上达到80.36%准确率。

Insight: 创新点在于用共享3D教师目标对齐多视角2D隐表示，从而在潜空间中消除视角歧义并弥合2D-3D维度鸿沟，同时显式估计相机外参来调制编码以保留视角几何信息；这种“2D接口+3D教师+相机调制”的轻量适配思路，为将3D预训练模型迁移到2D观测提供了可借鉴的范式。

Abstract: Motion language models (MoLMs) encode 3D human motion as discrete tokens for language-based understanding. Deploying them on monocular video raises two problems. Pose detection yields 2D joint sequences, leaving a dimensional gap from the 3D motion used in training. Moreover, the 2D observation changes with the camera viewpoint, while the depth lost in projection makes the 2D pose ambiguous across viewpoints. We propose MoPort, a view-aware 2D interface that enables MoLMs to take 2D observations as input. We introduce Paired View Alignment (PVA), which gives two views of the same motion a shared 3D teacher target and directly constrains the consistency of their latents, so that 2D observations from different viewpoints are mapped to a consistent semantic representation. Camera-Modulated Encoding (CME) estimates the camera extrinsics from the 2D sequence and uses them to modulate encoding, providing the 2D latents with geometric information about the viewpoint. MoPort achieves R@1 of 0.5674 on HumanML3D and 0.3286 on KIT-ML, outperforming all evaluated baselines. On HumanML3D, its R@1 decreases only from 0.5763 on in-distribution viewpoints to 0.5585 on out-of-distribution viewpoints. We validate portability on three downstream MoLMs. Furthermore, on the real-world RGB video dataset Fit3D, MoPort achieves 80.36% accuracy. Code will be released upon acceptance.

[136] GSExplorer: Interactive World Generation with a Persistent 3D Gaussian World State cs.CV | cs.AIPDF

Sicheng Yu, Liu Liu, Xinjie Wang, Xinjiang Wang, Taojun Ding

TL;DR: 论文提出了 GSExplorer，一种以持久化 3D 高斯（3DGS）世界状态为核心的“生成—重建”框架，用于交互式世界生成。每一步中，当前 3DGS 场景为条件驱动的视频生成器提供多模态渲染条件，相机几何则通过独立的相对射线编码（Relative Ray Encoding）分支注入。生成的视频再反馈给基于 SLAM 的重建后端；该后端通过不一致性过滤防止冲突内容破坏场景，并通过跨块光束法平差（bundle adjustment）提升各生成步骤之间的空间对齐。作者还设计了数据构造流程，模拟场景外推时的真实 3DGS 退化，构建了 293K 训练对。

Details

Motivation: 交互式世界生成需要同时兼顾局部精确控制和长序列展开（long rollout）中的场景一致性；现有方法在长时程探索中，目标视角引导会变得不完整，而且反复更新场景会累积不一致。论文试图通过维护一个可靠、持久的 3D 世界状态来支撑持续探索。

Result: 在 WorldScore 的单步与三步评测中，GSExplorer 均取得对比方法中最佳的整体表现，相机控制与一致性较强，单步外推的 Camera Control 得分为 99.07；在 481 帧“离开—返回”（leave-and-return）长序列 rollout 上也展现出较强的重访一致性。

Insight: 创新点在于将 3DGS 场景作为可持久维护的世界状态，形成生成与重建的闭环：用多模态渲染条件结合独立射线编码分支增强相机控制，用 SLAM 后端配合不一致性过滤与跨块光束法平差抑制误差累积，并通过模拟 3DGS 退化的数据构造流程缩小训练与推理的差距。

Abstract: Interactive world generation requires both accurate local control and stable scene consistency over long rollouts. Existing methods improve local generation through camera or geometry conditioning and extend historical context with memory mechanisms. However, long-horizon exploration remains challenging as target-view guidance becomes incomplete and inconsistencies accumulate across repeated scene updates. We present \textbf{GSExplorer}, a generation–reconstruction framework built around a persistent 3D Gaussian world state. At each step, the current 3DGS scene provides multimodal rendering conditions for a condition-driven video generator, while camera geometry is injected through a separate Relative Ray Encoding branch. Generated videos are then fed back to a SLAM-based reconstruction backend, where inconsistency filtering prevents conflicting content from corrupting the scene and cross-chunk bundle adjustment improves spatial alignment across generation steps. We further design a data-construction pipeline that reproduces realistic 3DGS degradation during scene extrapolation, yielding 293K training pairs of degraded multimodal renderings and real target videos. GSExplorer achieves the best overall performance among the compared methods on both single-step and three-step WorldScore evaluation, with strong camera control and consistency across both settings, including a Camera Control score of 99.07 in single-step extrapolation. On 481-frame leave-and-return rollouts, it also shows strong revisit consistency, demonstrating the value of maintaining a reliable 3D world state for continued exploration.

[137] TopoDPO: Dense Preference Alignment for Structure-Sensitive Aerial Referring Segmentation cs.CV | cs.AIPDF

Huaiyuan Peng, Jisheng Dang, Wencan Zhang, Jingwen Zhao, Hong Peng

TL;DR: 论文提出TopoDPO，一个面向结构敏感航空指代分割的拓扑感知稠密偏好对齐框架。它针对多模态分割中稠密掩码偏好信号与图像级DPO共享权重之间的粒度不匹配，通过拓扑先验挖掘偏好对，并在空间聚合前对每个局部边界施加偏好惩罚。

Details

Motivation: 现有偏好优化多为图像级目标，对稠密掩码的所有空间边界分配同一非线性权重，难以处理航空指代分割中空间异质且结构敏感的分割误差。论文旨在解决稠密掩码偏好信号与图像级偏好对齐之间的粒度不匹配问题。

Result: 在4590个实例的Topo-RS-Hard结构压力集上，TopoDPO相比图像级DPO将IoU从50.91%提升至51.24%，并将Betti-0误差从1.34降至0.90；五个报告指标的配对图像簇bootstrap区间均排除零。在全部39,244条验证记录上的未过滤分层分析显示，在预对齐阶段组件数误差中等或严重的样本上结构增益最明显。

Insight: 创新点在于利用连通组件差异和宏角点召回挖掘信息量更高的偏好对，并将偏好惩罚施加到每个局部边界后再进行空间聚合，同时以冻结的监督参考模型为对照。论文还通过匹配监督控制和完整因子分析分离拓扑感知偏好对挖掘、局部校正与稠密参考相对偏好加权的作用。

Abstract: Preference optimization for multimodal segmentation faces a granularity mismatch: dense masks contain spatially heterogeneous preference signals, whereas image-level objectives assign one shared nonlinear weight to all spatial margins. We introduce TopoDPO, a topology-aware dense preference alignment framework for structure-sensitive aerial referring segmentation. Topo-Prior mines informative preference pairs using connected-component discrepancy and macro-corner recall, while the dense objective applies the preference penalty to each local margin before spatial aggregation against a frozen supervised reference. On Topo-RS-Hard, a 4590-instance structural stress set, TopoDPO improves intersection over union (IoU) from 50.91% to 51.24% over image-level direct preference optimization (DPO) and reduces Betti-0 error from 1.34 to 0.90; paired image-cluster bootstrap intervals against image-level DPO exclude zero for all five reported metrics. Matched supervised controls and a complete factorial analysis separate the effects of topology-aware pair mining, localized correction, and dense reference-relative preference weighting. An unfiltered stratification over all 39,244 validation records further shows the clearest structural gains on samples with moderate or severe pre-alignment component-count errors. The code is publicly available at: https://github.com/phy709/TopoDPO.

[138] Spend the Bits Where the Tiny Objects Are: Rate-Utility Region Coding for Aerial Detection cs.CVPDF

Yanliang Qi, Jiacheng Ding, Cong Guo, Peihua Mai

TL;DR: 论文针对带宽受限航拍图像中的小目标检测，提出面向率-效用区域的编码方法RUO。该方法不按检测置信度阈值筛选ROI，而是根据区域期望检测效用与实测字节成本决定丢弃、低质量或高质量发送，并使用跨图像共享的单一乘数。RUO无需训练模型，采用标准图像编解码器，解码仅需几毫秒。

Details

Motivation: 传统阈值式ROI编码只发送高置信检测区域，但小目标视觉证据少、检测分数常偏低，容易在压缩阶段被丢弃。论文旨在解决带宽受限航拍检测中，压缩策略与小目标检测效用不匹配的问题。

Result: 在VisDrone-DET test-dev全部1,610张图像上，RUO在共享小目标AP范围内平均比调优阈值ROI编码少42.4%比特；小目标所需比特也少于AVIF、HEVC和三种已发表学习编解码器，且收发端使用不同检测器时优势仍保持。对全尺寸AP，RUO比调优ROI多25.4%比特，因其低码率下优先丢弃大区域，更适合小目标任务。

Insight: 创新点在于提出率-效用区域编码，用期望检测效用与实测字节成本共同决定区域是否发送及质量等级，并以单一乘数跨图像分配码率；无需训练、兼容标准编解码器且低延迟。客观看，其价值在于将任务感知压缩从置信度阈值转向检测效用，缓解小目标低分偏差，并明确面向小目标而非全尺寸目标的码率分配策略。

Abstract: Bandwidth-limited aerial cameras must compress their images before a remote detector can find the many tiny objects in them. Threshold-based region-of-interest (ROI) coding sends only confidently detected regions, and because tiny objects provide limited visual evidence and often score low, it can discard the regions that contain them. We propose rate-utility region coding (RUO), which sends a region when its expected detection utility justifies its measured byte cost, choosing to drop it or to send it at low or high quality with one multiplier shared across images. RUO trains no model, uses a standard image codec and decodes in a few milliseconds. On all 1,610 VisDrone-DET test-dev images, RUO uses 42.4% fewer bits than a tuned threshold-based ROI coder, averaged over their shared tiny-object average precision (AP) range. RUO also needs fewer bits for tiny objects than the AV1 Image File Format (AVIF), High Efficiency Video Coding (HEVC) and three published learned codecs, and its advantage over threshold-based ROI coding persists when the sender and receiver use different detectors. For AP over all object sizes RUO needs 25.4% more bits than the tuned ROI coder, because its allocation drops large regions first at low rates, so it suits tasks that target tiny objects. We plan to release the code.

[139] Recoverability-Aware Evaluation of Diffusion Video Inpainting and Object Removal cs.CVPDF

Yanliang Qi, Jiacheng Ding, Cong Guo, Peihua Mai

TL;DR: 论文提出可恢复性分层评估方法，将物体移除视频修复中的孔洞像素按是否能在其他帧观察到以及距离远近进行分层，从而区分“复制可见内容”和“生成不可见内容”。同时提出无需训练的 evidence-guided sampling（EGS），把跟踪得到的颜色融合进视频扩散修复器的 clean-latent 预测中。实验表明扩散修复器在 DAVIS 上未充分利用可观测内容，EGS 在干净视频轨迹颜色下能缩小与复制参考的差距，但使用掩码输入轨迹时收益不稳定。

Details

Motivation: 现有视频物体移除修复通常对整个孔洞统一评分，但孔洞中部分像素在镜头其他帧可见、部分从不可见，统一评分会混合复制与生成能力，无法判断修复器究竟擅长哪一类。论文希望分离可恢复与不可恢复内容，分别评价保真度和时序稳定性。

Result: 在 DAVIS 上，三个扩散修复器相对光流传播的感知优势在内容仅几帧外可见的区域缩小（相对 E2FGVI-HQ 的 LPIPS difference-in-differences 为 +0.046 至 +0.056）；其孔洞 warping 误差是 ProPainter 的 2 至 4 倍，沿干净视频轨迹复制可使可恢复 LPIPS 降低四分之一到五分之二。EGS 在 held-out DAVIS 上使用干净视频轨迹颜色时缩小了与复制参考差距的 43% 和 56%，但使用掩码输入跟踪颜色时，MiniMax-Remover 无增益、ROSE 有损失。

Insight: 论文宣称的创新点在于可恢复性分层评估和训练无关的证据引导采样。客观看，其核心贡献是诊断性评价框架，揭示了扩散修复器对已观测内容的复用不足；EGS 提供了轻量重用轨迹证据的思路，但依赖干净轨迹，实际部署中证据来源受限。

Abstract: Video inpainting for object removal is scored over the whole hole, although the background behind the object is visible in other frames of the shot for some hole pixels and in no frame for others. A whole-hole score therefore mixes copying with generation and cannot show which of the two a remover does well. To separate the two, we propose recoverability-stratified evaluation, in which a point tracker run on the clean video labels each hole pixel by whether and how far away it is observed, so that fidelity and temporal stability can be reported per stratum against a copy reference. To reuse the observed content, we also propose evidence-guided sampling (EGS), which blends tracked colors into the clean-latent prediction of a video diffusion remover without training. On DAVIS, the perceptual advantage of three diffusion removers over flow propagation shrinks where the content is visible a few frames away (LPIPS difference-in-differences +0.046 to +0.056 against E2FGVI-HQ), and real paired captures show the same pattern for two of them. Their DAVIS hole warping error is two to four times that of ProPainter, and copying along clean-video tracks lowers their recoverable LPIPS by a quarter to two fifths. EGS closes 43% and 56% of the gap to this copy reference on held-out DAVIS when its colors come from clean-video tracks. With colors tracked on the masked input, a pre-registered confirmation finds no gain on MiniMax-Remover and a loss on ROSE. Diffusion removers thus leave observed content unused on DAVIS, and training-free reuse does not yet hold with tracked evidence.

[140] MedNet and U$^2$-ViT: A Nested Vision Transformer Diffusion Framework for Diverse Medical Images Generation cs.CVPDF

Lakshmikar R. Polamreddy, Jialu Li, Youshan Zhang

TL;DR: 论文针对医学图像数据稀缺、类别不平衡等问题，构建了大规模多模态文本-图像数据集MedNet（涵盖61种疾病、160个类，包括人类和动物），并提出一种基于扩散的文本到图像生成架构U^2-ViT，将Vision Transformer排列成嵌套U-Net结构以生成多样且高保真的医学图像。实验表明该方法在FID指标上优于现有最优模型。

Details

Motivation: 传统医学图像数据集存在类别不平衡、疾病覆盖有限、成像条件变化不足等问题，阻碍了鲁棒且可泛化的AI医疗诊断模型的发展，因此需要构建多样、高质量的数据集并提升生成模型的能力。

Result: 在实验中，所提模型取得了最优的FID分数，优于当前最先进的模型。

Insight: 创新点包括：构建了大规模、多模态、涵盖人类与动物多种疾病类别的医学文本-图像数据集MedNet；设计了U^2-ViT，将ViT以嵌套U-Net结构组织，用于扩散式文本到图像生成，以增强医学图像的多样性和保真度。

Abstract: The scarcity of diverse, high-quality medical images remains a significant bottleneck in advancing AI-driven medical diagnostics and treatment planning. Traditional datasets often suffer from class imbalances, limited disease coverage, and insufficient variations in imaging conditions - challenges that hinder the development of robust, generalizable models. To address this, we introduce MedNet, a large-scale, multi-modal text-to-image dataset spanning 61 disease categories with 160 classes, covering both humans and animals. We built this with images from trusted public repositories, ensuring data diversity, quality, and ethical compliance. Additionally, we propose U$^2$-ViT, a novel diffusion-based text-to-image generation architecture arranging Vision Transformers (ViTs) in a nested U-Net structure to enhance the generation of diverse, and high-fidelity medical images. Through extensive experiments, we demonstrate that our model achieves the best Fr’echet Inception Distance (FID) score compared to state-of-the-art models. The source code is available at https://github.com/LakshmikarPolamreddy/MedNet-U2-ViT.

[141] NatureFusion: Rethinking Infrared and Visible Image Fusion as Natural Complementary Enhancement cs.CVPDF

Jianfeng Ding, Linfeng Tang, Hao Zhang, Han Xu, Xunpeng Yi

TL;DR: 论文将红外与可见光图像融合重新定义为“自然互补增强”，不再追求对源图像的保真叠加，而是从低质量可见光和红外图像对推断清晰、自然、可见光风格的融合图像。方法使用生成基础模型作为教师提供无真值监督，并通过轻量融合适配器和条件流匹配微调预训练生成模型；同时引入检测器监督的任务适配器以增强红外信息对下游任务的贡献。

Details

Motivation: 现有融合方法在无真值条件下过度追求源图像保真，直接把红外热辐射亮斑叠加到可见光场景中，导致融合图像颜色纹理被遮挡、视觉不自然，并偏离可见光预训练视觉模型的数据分布。

Result: 与7种多模态融合方法和7种单模态增强方法相比，NatureFusion生成的融合图像具有最佳感知质量；在可见光预训练检测和分割模型上，其融合图像的准确率显著高于所有对比方法。

Insight: 创新点在于将红外可见光融合目标从源保真转向自然互补增强，利用生成基础模型教师解决无真值监督问题，并通过条件流匹配和轻量融合适配器降低微调成本；进一步用检测器监督的任务适配器兼顾自然外观和下游性能。客观看，其可借鉴之处是面向预训练视觉模型分布设计融合结果，并将生成式先验与任务监督解耦结合。

Abstract: In the absence of ground truth, most existing infrared and visible image fusion methods pursue fidelity to the source images and directly superimpose two physically distinct modalities. As a result, salient infrared targets appear as bright patches of thermal radiation pasted onto the scene. These patches obscure the original color and texture of the targets, so the fused images look unnatural to human observers and deviate from the data distribution learned by vision models pretrained on visible images. Therefore, we redefine infrared and visible image fusion as natural complementary enhancement rather than source fidelity, and propose NatureFusion, which exploits cross-modal complementary cues to infer a clear and natural visible-style image from low-quality visible and infrared image pairs. Specifically, to address the lack of ground truth, we employ a generative foundation model as the teacher to directly generate visually natural fused images for supervision. Furthermore, to fully distill the teacher’s generative capability while reducing computational cost, we fine-tune a pretrained generative model with conditional flow matching through a light-weight fusion adapter. Last but not least, to further improve downstream performance without sacrificing natural appearance, we freeze the fusion adapter and introduce a detector-supervised task adapter that strengthens the complementary contribution of infrared. Extensive comparisons with seven multi-modal fusion and seven single-modality enhancement methods demonstrate that NatureFusion generates visually natural fused images with the best perceptual quality. Detection and segmentation models pretrained on visible images achieve substantially higher accuracy on our fused images than on those of any competing method.

[142] EgoMo3R: Joint Egocentric Motion and Scene Reconstruction cs.CV | cs.AIPDF

Chaitanya Patel, Yusuke Kato, Rin Takahira, Kazuki Kozuka, Juan Carlos Niebles

TL;DR: EgoMo3R 提出一个联合优化框架，从随意的第一人称视频中同时重建整体3D人体运动和周围场景几何。方法结合单目深度、光流、点轨迹等低层视觉几何基元与基于扩散的人体运动先验，并通过交替优化让场景重建与运动先验相互约束。实验在 EgoExo4D 和 Nymeria 的高动态序列上验证，在3D场景重建和第一人称运动估计上均优于专用基线。

Details

Motivation: 现有方法将第一人称人体运动重建与场景重建分开处理，且运动重建通常依赖专用惯性传感器提供的度量、重力对齐相机轨迹。仅从单目第一人称视频恢复此类轨迹仍很困难，尤其面对快速头部运动和运动模糊。

Result: 论文在 EgoExo4D 和 Nymeria 的高动态序列上评估 EgoMo3R，结果显示其在3D场景重建和第一人称运动估计两个任务上均优于专用基线方法。

Insight: 核心创新是联合优化人体运动与场景几何，并设计交替优化形成协同反馈：场景重建为运动先验提供物理约束和轨迹条件，运动先验反过来正则化相机轨迹并将场景锚定到度量、重力对齐的世界坐标系。客观上看，其可借鉴点在于利用低层视觉几何基元的鲁棒性，并以扩散运动先验弥补单目第一人称视频中轨迹估计的不稳定。

Abstract: Understanding holistic 3D human motion and the surrounding environment from egocentric video is fundamental for applications in AR/VR and robotics. Although these tasks are inherently coupled, existing methods treat them separately. In particular, egocentric motion reconstruction methods typically assume access to metric, gravity-aligned camera trajectories from specialized inertial sensors. Recovering such trajectories from monocular egocentric video remains a significant challenge due to rapid head movements and motion blur. We present EgoMo3R, a joint optimization framework that simultaneously reconstructs 3D human motion and scene geometry from casual egocentric video. It leverages the robustness of low-level visuo-geometric primitives, including monocular depth, optical flow, and point tracks, integrated with a diffusion-based human motion prior via first-order optimization. We propose an alternating optimization scheme that establishes a synergistic feedback loop: scene reconstruction provides physical grounding and trajectory conditioning for the motion prior, while the motion prior regularizes the camera trajectory and anchors the scene in a metric, gravity-aligned world frame. We evaluate EgoMo3R on the highly dynamic sequences of the EgoExo4D and Nymeria datasets and show that it outperforms specialized baselines in both 3D scene reconstruction and egocentric motion estimation.

[143] Zero-shot evaluation of open vision-language models as System 1 decision models on radiology tasks cs.CV | cs.AIPDF

Bradley J Erickson, Sara Salehi

TL;DR: 论文在七个放射学任务（报告文本、X线、CT、MRI）上零样本评估两个多模态System 1决策模型Clef 27B、d1 3B与传统LLM Qwen 3.8-27B，比较AUROC、速度与能耗。结果显示报告文本类任务各模型近乎完美，图像任务差异明显，3B模型在文本上接近27B但在图像上不足，且没有模型在运动伪影严重度上表现良好。

Details

Motivation: 论文关注常规LLM在放射学多任务/多问题场景下计算成本高的问题，探索开放视觉语言模型作为System 1决策模型能否在无需微调下高准确度完成临床相关任务，并比较其准确性、延迟和能耗。

Result: 所有模型均完成测试且报告发现检索AUROC>0.95；Clef在CT-RATE 3D体积和RANZCR上高于Qwen骨干、在MR-ART上更低，d1在七项任务中六项低于Clef；d1每请求能耗比Clef低3至9倍，Clef在多问题输入任务上更快；没有模型在运动伪影严重度上表现良好。

Insight: 创新点在于系统化零样本比较多模态System 1模型与传统LLM在多项放射学任务上的性能、成本和能耗，并揭示文本报告任务易、图像任务难及模型规模影响。客观看，其价值更多在基准评估与效率分析而非新架构，可借鉴按任务模态选择模型、用约束输出降低多问题场景成本，并将能耗纳入临床AI评估。

Abstract: Purpose: We compared two multimodal System 1 decision models, Clef 27B and d1 3B, with a traditional LLM (Qwen 3.8-27B) on seven radiology tasks covering text, radiographs, CT and MRI. Methods: Three models were compared: Clef, Qwen3.8-27B and d1. Three tasks were interpretation of text and 4 were detection of finding in images. The tasks were: 1. finding presence of finding in CT-RATE chest CT reports; 2. Presence of finding in PadChest chest radiograph reports; 3. the same 18 findings on CT-RATE chest CT but 3D volumes; 4. MR safety status of devices from AccessGUDID device records; 5. line and tube position on RANZCR CLiP chest radiographs; 6. motion-artifact severity on MR-ART T1-weighted brain MRI and 7. sequence identification on BraTS 2021 brain MRI. The primary endpoint was AUROC. There was no fine-tuning of the models on the tasks. Results: All models completed all tests without a failed request. All retrieved findings from reports almost perfectly (AUROC >0.95). Clef ranked higher than its Qwen backbone on CT-RATE volumes and RANZCR lower on MR-ART. The two did not differ on BraTS, GUDID or PadChest, and differed by 0.002 on CT-RATE reports. On BraTS, Clef correctly identified 90 of 100 FLAIR volumes while Qwen never chose it. d1 ranked lower than Clef on six of seven tasks. No model performed well on motion severity. Clef was faster per request than Qwen on tasks with many questions per input. d1 used 3 to 9 times less energy per request than Clef. Conclusions: System 1 models can perform important tasks in radiology with high accuracy, at lower compute cost than LLMs used in the usual way. When an LLM is constrained to a single answer token, its cost and performance is similar to System 1 models unless multiple questions are asked. A 3B System 1 model was close to the 27B models on report text but not on images. No model performed well on motion severity.

[144] Benchmarking Vision-Language Models for Urdu Nastaliq Handwriting Recognition cs.CV | cs.AIPDF

Haseeb Yaqoob, Fatima Azfar, Emaan Arif Khan

TL;DR: 论文对乌尔都语 Nastaliq 手写体识别进行了基准评测：在 UNHD 数据集的 2465 张单行图像上，零样本比较了六种系统，包括 Tesseract、印刷体乌尔都语识别器 UTRNet-Large、两个开源 VLM 和两个商用 VLM（Claude 等）。论文还开展了第二项研究，让 VLM 结合原图和带噪文本去纠错另一 OCR 系统的输出，并分析了排序系统的三类失败模式。

Details

Motivation: Nastaliq 草书没有固定基线和清晰字符边界，手写乌尔都语识别困难；作者希望以零样本方式考察现有 VLM 在此任务上的实际表现与失败模式，而非追求 SOTA。

Result: 两个商用 VLM 的错误率低于印刷体识别器和开源 VLM，但作者明确未与手写训练的识别器比较，仅刻画零样本行为。纠错实验中，商用模型纠正 Tesseract 输出仅带来 0.7%~7.4% 提升，而在 UTRNet 文本上可达 17.9% 和 21.9%，且较弱纠错器可能使较清晰文本变差。

Insight: 创新点在于系统性零样本基准、识别三类失败模式（含商用模型对极难样本明确拒答而非猜测），以及将 VLM 自身识别能力与外部文本纠错收益解耦分析，揭示纠错增益依赖于输入文本本身的可读性。

Abstract: Handwritten Urdu is hard to recognize because the cursive Nastaliq script has no fixed baseline and no clear character boundaries. We benchmark six systems on the Urdu Nastaliq Handwritten Dataset (UNHD): Tesseract (default configuration), a script-specific recognizer trained on printed Urdu (UTRNet-Large), two open-source vision-language models (VLMs), and two commercial VLMs. All six systems are evaluated without fine-tuning on 2,465 single-line images (Part A), and the four VLMs receive the same fixed prompt (decoding uses temperature 0 where configurable, except for Claude Sonnet 5, whose decoding cannot be configured). Both commercial VLMs reach lower error than the printed-Urdu recognizer and the open-source VLMs. We do not compare against handwriting-trained recognizers, which would likely do better in-domain; we characterize zero-shot behavior, not state of the art. We also describe three distinct failure modes among the ranked systems. In one of them, a commercial model explicitly declines to transcribe a few very hard-to-read images instead of guessing. In a second study (Part B), VLMs correct the output of a separate OCR system using both the source image and the noisy text. Once separated from each model’s own reading ability, the benefit is small on Tesseract’s output (0.7% to 7.4%) and larger (17.9% and 21.9%) only for the two commercial correctors given UTRNet’s text. It appears to depend on how legible the supplied text already is, and a weaker corrector can make a more legible text worse.

[145] dKV Forcing: Separating Generation and Memory Representations through a Differentiable KV Cache cs.CV | cs.AIPDF

Zhiqi Li, Bo Zhu

TL;DR: 论文发现因果视频生成器在去噪时使用的KV（生成KV）与写入缓存供后续片段读取的KV（记忆KV）本质不同，后者无法用前者替代。为此提出dKV Forcing：在共享骨干上为写入端增加低秩残差，将记忆写入与生成分离，并让记忆表征通过未来片段对其的读取来学习；为使梯度能穿过缓存，用持久化可微页与局部重算替代可变缓存，单次时间遍历即可精确计算原本需两遍重建的梯度。

Details

Motivation: 现有视频生成模型把生成用的KV直接当作记忆写入缓存，但二者在预训练模型中已显著不同，后续片段对它们的依赖方式也不同，混用会损害长视频续写质量。论文希望让记忆表征根据其未来被读取的用途来专门学习，而这一目标需要对缓存求梯度，常规可变缓存无法支持。

Result: 相比分离写入（detached-write）训练仅增加7%的生成器更新开销，常驻内存减少28%，训练周期比两遍重建缩短20.8%；在VBench-Long上，相比同样遍历与目标的SGF，60秒美学质量提升6.6分、240秒提升8.5分，并获得最高的主体与背景一致性；对残差做rollout dropout可保留大部分收益，同时恢复无写梯度的运动表现。

Insight: 创新点在于明确区分生成KV与记忆KV，并用“从未来读取中学习写入”的方式训练专用的低秩写记忆残差；工程上以持久化可微页和局部重算实现单遍精确梯度，避免了可变缓存不可微与两遍重建的高开销，为长视频生成的记忆机制设计提供了可借鉴的训练范式。

Abstract: A causal video generator produces two key–value (KV) states for every segment: the KV it uses while denoising that segment, and the KV it writes into the cache for later segments to read. In a pretrained generator the two already differ substantially, later segments attend to them differently, and replacing the written KV with the generation KV degrades the continuation. We propose dKV Forcing (dKV denotes differentiable KV) to learn a dedicated memory representation from its future use: a writer-specific low-rank residual on the shared backbone separates memory writing from generation and is trained through the future reads of what it writes. Learning a write from its future use needs gradients through the cache, which the mutable cache in common use cannot provide. dKV Forcing replaces the training-time cache by persistent differentiable pages with local rematerialization and, in one temporal traversal, computes exactly the gradient that a two-pass reconstruction of the same objective computes. One traversal computes the full memory gradient at $7%$ generator-update overhead over detached-write training, with $28%$ less resident memory and $20.8%$ shorter training cycles than the two-pass reconstruction. Over Self Gradient Forcing (SGF), the same objective trained with the same traversal, writer adaptation raises VBench-Long aesthetic quality by $6.6$ points at 60,s and $8.5$ points at 240,s with the highest subject and background consistency, and rollout dropout of the residual keeps most of this gain while restoring the motion of training without write gradients.

[146] GatedVLA with Camera-Based Emergency Braking: AlpaSim E2E Closed Loop Challenge Technical Report cs.CV | cs.ROPDF

Kaneyoshi Hiratsuka, Naoki Takada, Makoto Kawano

TL;DR: 本文是AlpaSim端到端闭环挑战赛PAI-AV赛道的技术报告，提出GatedVLA：以驾驶预训练的Qwen-Drive-1.0-4B视觉语言模型为骨干，结合分层流匹配动作专家预测未来2.5秒的加速度与曲率控制，并在动作专家交叉注意力上加入软视觉掩码；部署时再叠加基于摄像头的规则式自动紧急制动（AEB）。

Details

Motivation: 面向自动驾驶端到端闭环评测，探索如何利用预训练VLA模型生成连续控制，并通过视觉注意力掩码改善转向（尤其左转）表现，同时用AEB降低碰撞风险。

Result: 在相同150个场景、每场景两次rollout的本地闭环评测中，软视觉掩码将平均场景得分从0.479提升至0.517（配对差+0.038，95% CI [-0.018,+0.093]，胜负37/26，符号检验p=0.21），提升不显著；加入规则式AEB后得分升至0.599（+0.082，CI [+0.023,+0.143]），并将平均有责碰撞场景数从34.0降至11.0。开环误差与基线总体相当，但左转误差降低。

Insight: 创新点在于将驾驶预训练VLM、分层流匹配动作专家和软视觉掩码结合为VLA策略，并把规则式AEB作为部署期安全兜底；客观看，视觉掩码带来左转收益但闭环总体提升证据较弱，AEB则显著提升安全性与得分，体现“学习策略+规则安全模块”的工程集成价值。

Abstract: This report presents GatedVLA, our entry for the Physical AI AV (PAI-AV) track. Our learned vision-language-action (VLA) policy pairs the driving-pretrained Qwen-Drive-1.0-4B vision-language model with a layer-wise flow-matching action expert that outputs a 2.5 s horizon of acceleration and curvature controls, augmented with a soft visual mask applied to the expert’s cross-attention. Compared to an identically trained baseline, the masked policy achieves comparable overall open-loop error while reducing error on left turns. In local closed-loop evaluation across the same 150 scenes (two rollouts per scene), the visual mask increases the mean scene score from 0.479 to 0.517 (paired difference +0.038, 95% bootstrap CI [-0.018, +0.093], wins/losses 37/26, sign test p = 0.21). Incorporating a rule-based automatic emergency braking (AEB) module at deployment further increases the mean score to 0.599 (+0.082, CI [+0.023, +0.143]) and reduces the mean number of scenes with at-fault collisions from 34.0 to 11.0.

Yongqi Shan, Yifan Wang, Yunzhi Zhuge, Lijun Wang, Huchuan Lu

TL;DR: 论文提出 MMCoT^3，一个面向 3D 场景理解的 3D-文本交错思维链推理框架，通过将文本推理与任务相关的 3D 视觉证据显式交错，使模型在推理过程中持续查询场景观测。为处理 3D 场景中同一文本提及对应多个候选物体带来的歧义，设计了歧义感知证据聚合机制，并构建了约 176.2K 实例的 3D 思维链指令微调数据集 PointCoT。

Details

Motivation: 现有 3D 大语言模型在复杂 3D 场景中缺乏基于视觉证据的多步推理能力，且以文本为中心的推理范式缺少文本推理与视觉证据的有效交互，容易导致中间推理无法验证、相似物体实例难以消歧以及幻觉问题。

Result: 论文在六个基准上进行了实验，结果表明该方法能够持续提升性能，并取得 state-of-the-art 结果，验证了歧义感知的 3D-文本交错推理在 3D 场景理解中的有效性。

Insight: 创新点在于提出首个 3D-文本交错思维链框架，将文本推理与 3D 证据动态结合；同时设计基于查询引导交叉注意力的歧义感知证据聚合机制，并构建大规模 3D 专用 CoT 指令微调数据集 PointCoT，覆盖描述、问答、对话和规划等任务。

Abstract: Understanding and reasoning over 3D scenes from point clouds is essential for a broad range of AI applications. Recent 3D large language models have shown promising results, yet they still face two fundamental limitations: (i) insufficient capability for grounded multi-step reasoning in complex 3D scenes, and (ii) a text-centric inference paradigm that lacks effective interaction between textual reasoning and visual evidence. As a result, these models often fail to verify intermediate inferences, disambiguate similar object instances, and avoid hallucinations. To address these limitations, we propose MMCoT$^3$, the first 3D-Text Interleaved Chain-of-Thought (CoT) framework for 3D scene understanding. The core idea is to explicitly interleave textual reasoning with task-relevant 3D evidence, enabling the model to consult scene observations throughout the reasoning process. In addition, since a textual mention in 3D scenes may correspond to multiple candidate objects, naive object-mention alignment can inject incorrect evidence and mislead subsequent reasoning. To mitigate this multi-instance ambiguity, we design an ambiguity-aware evidence aggregation mechanism that uses query-guided cross-attention to fuse candidate object tokens and inject both evidence and ambiguity cues into the reasoning process. To better equip the model with multi-step reasoning capability, we further develop PointCoT, a large-scale 3D-specific CoT instruction tuning dataset with approximately 176.2K instances spanning captioning, question answering, dialogue, and planning tasks. Extensive experiments on six benchmarks show that our method consistently improves performance and achieves state-of-the-art results, validating the effectiveness of our proposed ambiguity-aware 3D-text interleaved reasoning for 3D scene understanding.

[148] Leveraging 2D Foundation Priors for Generalized Category Discovery under Test-Time Adaptation in 3D LiDAR Segmentation cs.CV | cs.LGPDF

Hanqi Chen, Chaoqi Chen, Tian Ji, Hui Huang

TL;DR: 论文研究3D LiDAR语义分割中测试时自适应下的广义类别发现（GCD-TTA），提出两阶段框架：第一阶段基于几何密度自适应聚合局部3D特征，并在全局类原型一致性约束下生成可靠伪标签；第二阶段将新类别发现建模为最优传输分配以实现全局一致分组，同时融合2D视觉基础模型语义特征增强3D表示。

Details

Motivation: 现有工作通常将广义类别发现（GCD）和测试时自适应（TTA）分开处理，而3D点云语义信息有限，在域偏移下直接结合GCD与TTA容易导致特征坍缩；因此需要一个统一且稳健的GCD-TTA框架。

Result: 在Synth4D到SemanticKITTI、SynLiDAR到SemanticKITTI、Synth4D到nuScenes等实验中，该方法在10个benchmark划分中的9个取得最佳整体mIoU，相比最强复现baseline最高提升12.21个点。

Insight: 创新点在于用2D基础模型先验弥补3D点云语义不足，并以密度自适应局部特征聚合、类原型一致性伪标签和最优传输类别分配共同缓解域偏移下的特征坍缩与类别发现不稳定问题。

Abstract: In autonomous driving, 3D LiDAR semantic segmentation is expected to adapt to evolving environments and recognize previously unseen categories, making generalized category discovery under test-time adaptation (GCD-TTA) an important problem. However, existing works treat GCD and TTA separately, while the limited semantic information in 3D point clouds makes GCD-TTA under domain shift more prone to feature collapse when combining GCD with TTA. To address this issue, we propose a two-stage framework for GCD-TTA in 3D LiDAR semantic segmentation. Specifically, in the first stage, we adaptively aggregate local 3D features according to geometric density variations and obtain reliable pseudo labels under a global class-wise prototype consistency constraint. In the second stage, we cast category discovery as an optimal transport assignment process for globally consistent grouping of novel categories. Meanwhile, semantic features from 2D vision foundation models are fused with 3D point cloud features to enrich 3D semantic information and promote a more separable feature space. Extensive experiments on Synth4D to SemanticKITTI, SynLiDAR to SemanticKITTI, and Synth4D to nuScenes demonstrate the effectiveness of our framework. Under a unified evaluation protocol, our method achieves the best overall mIoU on 9 out of 10 benchmark splits and improves the overall mIoU by up to 12.21 points over the strongest re-implemented baseline.

Yize Cai, Zhiqing Hong

TL;DR: 论文提出GaitFM，一个用于可穿戴IMU步态评估的跨模态基础模型。它通过从大型视觉模型迁移知识，并在约4000名参与者、123万个步态窗口的大规模未标注IMU数据上预训练，以提升步态评估的鲁棒性和泛化性。模型在18个步态相关任务上验证，包括步态参数估计、疾病与步态异常检测和临床结果预测，并能泛化到不同传感器配置和身体位置。

Details

Motivation: 现有基于IMU的深度学习步态评估模型多依赖小规模、同质化数据集，且IMU测量受个体、佩戴位置和设备配置影响大，导致真实场景下鲁棒性和泛化性不足。论文希望利用跨模态知识迁移和未标注传感器数据预训练来缓解传感器与医学领域的数据稀缺问题。

Result: GaitFM在18个步态相关任务上表现强劲，涵盖3个步态参数估计、14个疾病与步态异常检测和1个临床结果预测任务。摘要还表明其能跨不同传感器配置和身体位置泛化，包括临床常用和日常可穿戴设备场景。

Insight: 论文宣称的创新点在于将大型视觉模型知识迁移到IMU步态评估，并结合大规模未标注IMU数据进行跨模态基础模型预训练。客观来看，其可借鉴之处是用视觉基础模型弥补传感器数据稀缺，并通过统一模型覆盖多任务、多模态和多佩戴位置，提升临床与日常场景的泛化能力。

Abstract: Gait assessment supports the diagnosis, monitoring, and prognosis of diverse movement-related conditions, such as neurological and musculoskeletal disorders. Recent advances in deep learning using everyday wearable inertial measurement units (IMUs) offer an accessible and low-cost approach to automated gait assessment. However, IMU measurements vary substantially across individuals, body locations, and device configurations, while existing deep learning models are typically developed using small, homogeneous datasets for specific clinical tasks, limiting their robustness and generalizability in diverse real-world contexts. Here we present GaitFM, a cross-modal foundation model for gait assessment using IMU sensors. GaitFM improves the generalizability of gait assessment by transferring knowledge from large vision models and pretraining on unlabeled IMU sensor data. We pretrain GaitFM on a large curated dataset comprising about 4,000 participants and 1.23 million gait windows across diverse clinical and daily conditions, sensor modalities, and body locations. GaitFM demonstrates strong performance across 18 gait-related tasks, including 3 gait parameter estimation tasks, 14 disease and gait abnormality detection tasks, and 1 clinical outcome prediction task. Furthermore, GaitFM generalizes across different sensor configurations and body locations, including those commonly used in clinical settings and everyday wearable devices. These findings demonstrate the effectiveness of transferring visual knowledge in improving sensor-based gait assessment performance, offering a new promising pathway for addressing data scarcity in the sensor and medical domains.

[150] Deep Learning for Cervical Cytology Screening: Methods, Algorithms, Challenges and Prospects cs.CVPDF

Jiang Yangbo, Zheng Nenggan

TL;DR: 本文是一篇关于深度学习用于宫颈细胞学筛查的综述，系统梳理了该领域在数据规模、功能任务和监督方式三个维度上的研究进展，区分了全切片图像置信度聚合与细胞级检测结合Bethesda分类两种临床路线，比较了16个公开数据集及CAISHI组织病理数据集的性能，并指出单细胞基准已饱和但临床就绪不足，最后归纳出五大挑战领域并提供证据到议程映射和部署决策矩阵。

Details

Motivation: 宫颈癌在低收入和中等收入国家致死率高，细胞病理学家短缺限制了细胞学筛查的普及，深度学习有望实现自动化筛查，但现有文献分散在不同尺度、任务和监督方式上，缺乏可比性，阻碍了临床转化。

Result: 单细胞准确率在Herlev和SIPaKMeD数据集上已趋于饱和，但这反映的是基准饱和而非临床就绪；综述比较了定量性能并揭示了指标不可比和数据泄漏问题，展望性及随机化证据仍有限。

Insight: 论文的创新点在于提出数据规模、功能任务和监督方式的三维组织框架，区分两种临床路线，并构建证据到议程映射及部署决策矩阵，强调未来进步依赖于多中心基准、外部验证的标签高效方法、校准公平预测及务实临床试验，而非在饱和单细胞基准上继续追求增益。

Abstract: Cervical cancer remains a leading cause of cancer death among women, with more than 90% of deaths occurring in low- and middle-income countries, where cytology screening is constrained by a shortage of trained cytopathologists. Deep learning has made automated cytology screening increasingly feasible, but the literature is fragmented across cell, patch and whole-slide-image scales, task formulations and supervision regimes, hindering comparison and clinical translation. This Review synthesizes the deep learning literature for cervical cytology screening, organizing the field along three axes—data scale, functional task and supervision—and distinguishing two clinical roadmaps: whole-slide-image confidence aggregation and cell-level detection with Bethesda classification. We examine 16 publicly available or publicly documented cytology datasets alongside the CAISHI histopathology dataset, compare quantitative performance while exposing incomparable metrics and data leakage, and assess commercial systems, regulatory status, HPV-era screening pathways and low-resource deployment. Single-cell accuracy on Herlev and SIPaKMeD has plateaued, but this reflects benchmark saturation rather than clinical readiness; prospective and randomized evidence is emerging but remains limited. We consolidate the evidence into five challenge areas—data and benchmarks, architecture and label-efficient learning, trustworthy AI, clinical translation and health economics, and evaluation and reproducibility—and provide an evidence-to-agenda map and a deployment decision matrix. Progress now depends on multi-center benchmarks, externally validated label-efficient methods, calibrated and fair predictions, and pragmatic clinical trials rather than further gains on saturated single-cell benchmarks.

[151] RSI-Env: An Open-Ended Environment for Recursive Self-Improvement of Agents cs.CVPDF

Wanying Qu, Zhiyuan Fan, Jiyao Liu, Jiang Zhou, Jianghan Shen

TL;DR: 论文提出 RSI-Env，一个面向智能体递归自我改进（RSI）的持久化开放环境：它允许模型与其 harness 协同优化，支持自主训练、harness 修改与研究状态留存，并由独立的 Host Controller 统一管理服务、评估与版本管理；每个被接受的模型-harness 版本（Self）接管下一轮改进。作者划分 Open-General、Capability-Directed、Benchmark-Guided 三种目标具体性与反馈获取程度不同的设置，在七个任务上比较 Self 与两个固定的外部 Teacher。

Details

Motivation: 现有 RSI 方法往往限制优化目标、可编辑组件或评估流程，导致探索不够开放、代际之间难以延续；论文希望构建一个持久化环境，使智能体能够持续、开放地自我改进模型与 harness。

Result: 从 Qwen3-27B 与最小 harness 出发：无 benchmark 反馈的 Open-General Self 将 GPQA Diamond 从 65.2% 提升至 73.2%，AIME 2026 从 53.3% 提升至 56.7%；三个 Capability-Directed Self 均取得目标对齐的增益；Knowledge Self 在多次系统更新中持续进步，SimpleQA 由 82.0% 升至 85.0%，再升至 88.0%。Benchmark 引导与外部 Teacher 的收益因任务而异。

Insight: 创新在于将 RSI 建模为持久化、版本化的“模型 + harness”协同演化闭环：由 Host Controller 解耦服务、评估与版本管理，让被接受版本自我接管下一轮迭代，并以三种设置系统考察目标具体性与 benchmark 反馈的作用；客观上其价值在于验证了开放式跨代递归改进的可行性，同时揭示了不同能力间增益难以保持这一核心挑战。

Abstract: Recursive self-improvement (RSI) envisions agent systems that autonomously improve their own models and harnesses, with each updated system continuing to improve itself. Existing approaches typically restrict optimization objectives, editable components, or evaluation procedures, limiting open-ended exploration and continuity across generations. We introduce RSI-Env, a persistent environment for coordinated model-harness improvement, supporting autonomous training, harness modification, and retention of research state. An independent Host Controller manages services, evaluation, and versioning. Under Self, each accepted model-harness version takes over the next improvement round. We define three settings that vary goal specificity and access to benchmark feedback: Open-General, Capability-Directed, and Benchmark-Guided. Across these three settings, we compare Self with two fixed external Teachers on seven tasks, starting from Qwen3.8-27B with a minimal harness. Without benchmark feedback, Open-General Self raises GPQA Diamond accuracy from 65.2% to 73.2% and AIME 2026 accuracy from 53.3% to 56.7%. All three Capability-Directed Self runs achieve target-aligned gains. Knowledge Self demonstrates continued improvement across system updates, with SimpleQA accuracy rising from 82.0% to 85.0% and then 88.0%. Benchmark guidance and Teacher benefits vary by task. These results demonstrate RSI-Env’s support for open-ended exploration and sustained recursive improvement within the studied runs, while highlighting challenges in preserving gains across capabilities.

[152] FinishStrong: Learning to End Well after Imperfect Start in Video Temporal Grounding cs.CVPDF

Yuda Zou, Boxiang Zhou, Xin Zhou, Yibo Chen, Dejia Song

TL;DR: 论文关注自回归视频时序定位中“起点预测较好、终点预测显著更差”的端点性能不对称问题，提出两阶段后训练框架 FinishStrong，使模型在已有不完美起点条件下仍能生成更优的结束时间。方法包括 Online-start SFT 和 Conditional-tree GRPO，分别缓解前缀暴露偏差并隔离起点惩罚对终点奖励的影响。

Details

Motivation: 自回归视频时序定位模型常出现终点预测明显弱于起点的问题，而糟糕起点会不可逆地限制最终重叠度。论文希望模型在起点已定的条件下最小化剩余条件遗憾，但标准教师强制 SFT 和 GRPO 难以有效训练这种“差起点后仍好好结束”的能力。

Result: FinishStrong-9B 在 TimeLens-Bench 上取得 61.7% 总体 IoU 的 SOTA 结果，超过 Gemini-3.8-Flash 和 Qwen3.8-Max 等旗舰闭源模型；在强制从不完美起点继续时，后续终点预测误差降低 36.5%。

Insight: 创新点在于将问题重新表述为给定不完美起点后的条件终点优化，并通过 Online-start SFT 让终点预测暴露于模型自生成上下文，再用 Conditional-tree GRPO 重构采样拓扑，将终点奖励限制在同起点分支内，从机制上隔离继承的起点惩罚。

Abstract: A poor start lowers the ceiling, but does not negate the value of finishing well. In autoregressive video temporal grounding, models systematically exhibit an endpoint performance asymmetry, predicting ends significantly worse than starts. A committed flawed start acts as an immutable physical constraint, irreversibly capping the attainable overlap as a sunk loss. While models should minimize the remaining conditional regret, standard post-training paradigms fail to teach this adaptation. Specifically, teacher-forced SFT suffers from strict prefix exposure bias, and holistic trajectory evaluation in standard GRPO inadvertently penalizes conditionally optimal ends if they follow a poor start. To address this, we introduce FinishStrong, a novel two-stage post-training framework explicitly designed to teach optimal continuations. First, Online-start SFT exposes the end prediction to the model’s own generated contexts. Second, Conditional-tree GRPO restructures the sampling topology, centering end rewards exclusively within the same-start branch to mathematically isolate the conditional end quality from the inherited start penalty. FinishStrong-9B achieves a state-of-the-art 61.7% overall IoU on TimeLens-Bench, remarkably outperforming flagship closed-source models like Gemini-3.8-Flash and Qwen3.8-Max. Crucially, when forced to continue from imperfect starts, it reduces the subsequent end prediction error by 36.5%, proving its exceptional ability to end well after flawed starts. Code will be open.

[153] OCBI: Order-Sensitive Cross-Branch Interaction for Image Manipulation Localization cs.CVPDF

Zhouli Yu

TL;DR: 论文提出OCBI，将Co-Transformers扩展到图像篡改定位任务中，通过建模RGB引导跨分支注意力与取证自注意力在相反组合顺序下的非交换差异，并引入可学习的符号校正与像素级自适应多尺度聚合来提升定位性能。

Details

Motivation: 图像篡改定位需要同时利用语义结构与取证痕迹，而分支内空间混合和跨分支混合的不同组合顺序会产生不同信息，现有方法未显式建模这种顺序敏感性。

Result: 在CASIA-only训练、50 epoch和最终epoch评估设置下，OCBI在五个干净测试集上取得0.5773的macro PixelF1，较重训练Co-Transformers基线提升0.43个百分点；在JPEG压缩、高斯模糊和缩放共21种数据集-变换条件下，平均PixelF1较基线提升0.95个百分点。

Insight: 创新点在于用交换子刻画RGB引导交叉注意力与取证自注意力的顺序差异，并对特征传递施加可学习符号校正，同时结合像素自适应多尺度聚合，为跨分支交互建模提供了可借鉴的思路。

Abstract: Image manipulation localization combines semantic structure with forensic traces to identify modified pixels. Within-branch spatial mixing and RGB-guided cross-branch mixing can produce different messages when composed in opposite orders. We propose OCBI, an extension of Co-Transformers that models the discrepancy between these two composition orders for localization. A local cross-branch fusion module uses the commutator of RGB-guided cross-attention and forensic self-attention to add a learnable signed correction to feature transfer. Pixelwise adaptive multiscale aggregation then combines spatial contexts before prediction. OCBI uses the Co-Transformers backbone and supervision. We compare OCBI with retrained Co-Transformers using CASIA-only task training, a 50-epoch budget, and final-epoch evaluation. Across five clean test datasets, OCBI achieves a macro PixelF1 of 0.5773, exceeding the baseline by 0.43 percentage points. Under JPEG compression, Gaussian blur, and resizing on three datasets, its average PixelF1 over 21 dataset-transformation conditions exceeds the baseline by 0.95 percentage points.

[154] RIFT: Residual-Informed Flow Transfer for One-Step Generative Video Compression cs.CVPDF

Qizhe Wang, Jiaye Fu, Feng Ye, Haocheng Tang, Zetian Song

TL;DR: 论文提出 RIFT，一种面向单步生成式视频压缩的残差感知流迁移框架。它针对压缩退化与流匹配模型扰动轨迹之间的方向不匹配，利用解码器可见的编解码线索，将预训练流预测转化为内容自适应的恢复更新，从而在单步生成中重建压缩丢失的细节。

Details

Motivation: 现有生成式视频压缩依赖预训练时空先验恢复细节，但压缩退化与流匹配模型学习的扰动轨迹存在显著方向偏差，仅按退化强度校准时间步无法解决该问题。

Result: 在三个公开视频压缩基准上，RIFT 优于现有竞争性生成式视频压缩方法；摘要未给出具体指标数值或明确 SOTA 表述。

Insight: 创新点在于识别出压缩相关的方向性不匹配，并提出 Residual Geometry Inducer，将流预测与学习到的全频带残差强度估计及内容条件的方向/增益调制结合，使恢复更新的方向和幅度匹配压缩残差几何。客观看，其可借鉴之处是利用编解码器可见线索实现单步、内容自适应的生成式恢复。

Abstract: Recent advances in video generation have enabled generative video compression to reconstruct details lost during coding using pretrained spatiotemporal priors. However, a substantial gap remains between codec-induced degradation and the perturbation trajectories learned by flow-matching models. In this paper, we identify a compression-dependent directional mismatch that degradation-strength-based timestep calibration alone cannot resolve. Compressed latents remain strongly aligned across codec operating points, while their reconstruction residuals vary substantially in magnitude and direction. To bridge this gap, we propose RIFT, a Residual-Informed Flow Transfer framework for one-step generative video compression. At its core, RIFT introduces a Residual Geometry Inducer (RGI) that converts the pretrained flow prediction into a content-adaptive restoration update using decoder-visible codec cues. RGI integrates flow-timestep conditioning with a learned full-band residual-strength estimate and content-conditioned direction and gain modulation, aligning the orientation and magnitude of the update with the compression-dependent residual geometry. Extensive experiments on three public video compression benchmarks show that RIFT outperforms competing generative video compression methods. The code is publicly available on RIFT.

[155] When Does Latent Prediction Error Support Physical Surprise Claims in Video World Models? cs.CV | cs.LGPDF

Anton Hristov, Aleksandar Slavov, Vasil Vasilev

TL;DR: 论文提出一个评估框架，用于检验视频世界模型的潜在预测误差是否能作为物理惊奇信号。研究在IntPhys2、Physion++和Kubric上分析冻结表示、潜在几何与模型预测误差，发现预测误差会受外观、颜色、重复帧和普通预测难度影响，不能可靠反映物理不可能性。

Details

Motivation: 视频世界模型的预测误差常被直接解释为物理惊奇，但误差也可能来自外观、静态内容、运动或一般预测难度，因此需要区分表示中是否包含物理信息与模型误差是否真正度量物理惊奇。

Result: 在IntPhys2上，V-JEPA2仅暴露少量事件可能性信息；在Physion++中重复单帧可提高误差而改变颜色可降低误差；在Kubric中不可能事件甚至可能产生更低误差，固定误差阈值会误判许多可能事件。

Insight: 创新点在于提出分离“冻结表示内容、潜在几何组织、模型误差响应”的评估框架，并实证表明模型可表示物理信息且对错误动作有响应，但其原生预测误差不能可靠作为物理惊奇指标。

Abstract: Prediction errors from video world models are often treated as physical surprise, but they can also reflect appearance, static content, motion, or ordinary prediction difficulty. We present an evaluation framework that separates what frozen representations contain, how they organize appearance and physical differences, and what changes a model’s own prediction error. On IntPhys2, a benchmark of physically possible and impossible events, we compare representations from latent prediction, masked pixel reconstruction, and simple visual statistics. Appearance remains easy to decode, while V-JEPA2 exposes modest information about whether events are possible or impossible. Looking at the latent geometry, appearance changes become smaller compared with differences between videos, their directions line up more consistently across scenes, and their overlap with physical changes decreases in deeper layers. Across action-conditioned models, incorrect actions raise prediction error, while appearance changes also produce substantial responses. In Physion++ video clips, repeating a single frame can produce higher error than the original clip, while changing color throughout the clip can lower it. Using Kubric, a simulation and rendering framework, we find that impossible events can produce lower error than possible events. A fixed error threshold also incorrectly flags many possible events as impossible. A model can therefore represent physical information and respond to incorrect actions without its native prediction error reliably measuring physical surprise.

[156] LUMEN: Geometry-Guided Diffusion Model for Spatially-Varying HDR Illumination Estimation cs.CVPDF

Hongze Chen, Fangyu Lin, Runze Zhang, Lingting Zhu, Weikai Chen

TL;DR: LUMEN 提出一种几何条件扩散框架，用于从单视图或多视图图像在任意空间位置合成高动态范围（HDR）环境光照图。方法先重建粗略 3D 场景并在任意位置渲染部分环境图以编码可见性与空间结构，再与多视图图像特征融合后输入扩散 Transformer 生成完整 HDR 环境图，并构建了带密集空间监督的合成室内场景数据集用于训练。

Details

Motivation: 现有空间变化光照估计方法依赖局部环境图或探针表示，且多采用回归或参数模型，容易导致光照过度平滑、真实感不足；论文希望从生成式角度更真实地建模空间变化光照。

Result: 摘要称大量实验表明 LUMEN 相比已有方法显著提升视觉保真度和空间一致性，但未给出具体定量指标或 benchmark 名称。

Insight: 核心创新在于将空间变化 HDR 光照估计转化为几何引导的生成任务，通过任意位置的部分环境图渲染注入可见性与空间结构，并结合多视图特征与扩散 Transformer 生成完整 HDR 环境图；配套的 700 个合成室内场景密集空间监督数据集也具有借鉴价值。

Abstract: Estimating scene illumination from images is challenging as lighting is inherently spatially varying, depending on geometry, occlusion, and light sources. Existing methods incorporate geometric cues by deriving local environment maps or probe-based representations, but largely rely on regression or parametric models, resulting in over-smoothed lighting and limited realism. We revisit spatially-varying illumination estimation from a generative perspective and introduce LUMEN, a geometry-conditioned diffusion framework for synthesizing high-dynamic-range (HDR) environment maps at arbitrary spatial locations from single or multi-view images. Specifically, we reconstruct a coarse 3D scene from input images and render partial environment maps at arbitrary locations to encode visibility and spatial structure. These signals are fused with multi-view image features and fed into a diffusion transformer to generate full HDR environment maps. To train the model, we build a synthetic dataset of 700 indoor scenes with dense spatial supervision, including multi-view RGB images, depth, and HDR illumination at multiple sampled locations. This dataset enables the model to learn spatially consistent lighting distributions across diverse scenes. Extensive experiments demonstrate that LUMEN significantly improves visual fidelity and spatial coherence compared to prior approaches.

[157] Learning-to-Memorize: Dynamic Context Management for Long-Horizon Autoregressive Video Generation cs.CVPDF

Haowei Zhu, Qijie Wang, Jia Li, Xing Wang, Tianyu Zhao

TL;DR: 论文针对自回归视频生成长视频时误差累积和上下文管理困难的问题，提出Learning to Memorize（L2M）框架，用可学习的重要性预测动态保留、驱逐和演化历史帧。方法包含重要性预测路由器、退化感知训练、基于EMA的动态记忆初始化与演化机制，并结合教师-学生蒸馏和稀疏正则，在固定KV-cache预算下保留最有信息量的上下文，从而提升长时视频生成质量与时序一致性。

Details

Motivation: 现有自回归视频生成多用静态上下文管理，如滑动窗口会丢弃早期帧、固定sink帧会永久保留初始内容，导致长程上下文丢失或生成被过时信息锚定，进而出现保真度下降、运动停滞和多样性降低。论文希望将上下文记忆管理从静态规则转变为可学习的动态策略。

Result: 摘要未给出具体数值或benchmark名称，仅声称大量实验表明L2M在长时视频生成质量和时序一致性上优于现有基线；因此可视为在长时自回归视频生成任务上取得相对提升，但未明确说明是否达到SOTA。

Insight: 论文宣称的创新点在于动态记忆管理：用重要性路由器预测历史帧相关性，用退化感知训练增强对噪声上下文的鲁棒性，并用EMA重要性分数演化长期记忆以替换陈旧锚点。客观来看，其可借鉴之处是将KV-cache/上下文选择建模为可学习、可演化的记忆机制，在固定缓存预算下兼顾长程信息保留与场景演化适应。

Abstract: Autoregressive video generation has achieved impressive results on short clips, yet generating long videos remains challenging due to error accumulation over extended horizons, where each predicted frame depends on potentially imperfect previous frames. Existing approaches typically rely on static context management strategies, such as sliding-window caches that discard early frames or fixed sink frames that permanently preserve initial content. These designs either lose critical long-range context or anchor generation to outdated information, which can lead to degraded fidelity, motion stagnation, and reduced diversity. In this paper, we propose Learning to Memorize (L2M), a learned context memory management framework that dynamically retains, evicts, and evolves historical frames according to predicted importance. The framework consists of an importance prediction router that estimates the relevance of each historical frame, degradation-aware training that improves robustness to noisy or corrupted context, and a dynamic memory initialization and evolution mechanism that updates long-term memory using exponential moving average (EMA) importance scores. This allows high-quality frames to replace stale anchors and enables memory to adapt naturally to scene evolution. Trained with a teacher-student distillation objective and sparsity regularization, L2M makes efficient use of a fixed KV-cache budget while preserving the most informative contextual information. Extensive experiments demonstrate that L2M improves long-horizon video generation quality and temporal consistency over existing baselines, providing a learned strategy for context memory management in long autoregressive video generation.

[158] Training-Free Motion-Corrected 3D Brain MRI Reconstruction via Event-Guided References cs.CVPDF

Wei Jiang, Hongli Chen, Tianyi Ding, Feng Liu, Nan Ye

TL;DR: 论文提出 EventMC，一种面向交错笛卡尔采集的三维脑 MRI 的无训练运动校正重建方法。该方法迭代检测运动事件，并利用稳定区间重建的参考图像估计运动，再从低到高空间频率联合细化图像与运动估计。

Details

Motivation: 头部运动会在三维脑 MRI 中产生伪影并影响结构测量；现有模型式校正可能因参考图像伪影强化运动误差，而学习先验方法需要预训练并增加测试时计算。

Result: 在仿真公平比较中，EventMC 的运动估计使平均 PSNR 相比学习型 MotionTTT 最多提升 4.0 dB；单次运行最多快 7.5 倍且 GPU 显存不到一半。在体运动损坏扫描上，无需训练即可达到与 MotionTTT 相近的平均图像质量。

Insight: 创新点在于无需训练，利用运动事件检测和稳定区间参考图像避免参考伪影强化运动误差，并按低到高空间频率迭代细化图像与运动估计，兼顾校正质量与计算效率。

Abstract: Head motion causes artefacts in 3D brain MRI and can bias structural measurements. Model-based correction alternates between image and motion estimation, but artefacts in the reconstructed reference can reinforce motion errors. Learned priors can reduce these artefacts but require pretraining and may add test-time computation. We propose EventMC (event-guided motion correction), a training-free method for interleaved Cartesian acquisitions. It iteratively detects motion events and estimates motion using reference images reconstructed from stable intervals. It then refines the image and motion from low to high spatial frequencies. In a fair comparison in simulation (same reconstruction), EventMC’s motion estimates improve mean PSNR by up to 4.0 dB over those of the learning-based MotionTTT. A single run of EventMC is up to 7.5 times faster than MotionTTT with less than half the GPU memory. On in vivo motion-corrupted scans, EventMC achieves similar mean image quality to MotionTTT without any training. Code is available at https://github.com/bayesbreeze/EventMC.

[159] SurgQ-VLM: Question-Conditioned Dual-Stream Compression and Answer-Type-Aware Reinforcement for Surgical Video Question Answering cs.CVPDF

Dhruv Makwana, Ananya Mantravadi

TL;DR: 论文提出 SurgQ-VLM，一个用于手术视频问答的两阶段模型：第一阶段为 LoRA 适配的 Qwen2.5-VL-7B 训练问题条件化的双流（慢/快）压缩器，以大幅压缩视觉 token；第二阶段用 GRPO 和答案类型感知奖励进行后训练，以统一处理二值、分类、多标签、计数和句子-时序等异构答案结构。

Details

Motivation: 现有手术视频问答多基于单帧和封闭标签，难以表达时长、顺序或计数；视频模型通常对所有片段采用与问题无关的相同压缩方式，容易丢弃回答所需的时间证据，且异构答案结构缺乏统一训练信号。

Result: 在 Cholec80 和 CholecT50 的 21,840 题密封测试集上达到 0.779 关键词准确率，BLEU-4 相比零样本提升约 10 倍；GRPO 带来 2.5 个百分点 K-Acc 提升，其中 2.0 个百分点归因于答案类型感知奖励，提升集中在结构困难类型，且答案格式（ROUGE-L）保持不变。

Insight: 创新点在于问题条件化的慢/快双流压缩，通过交叉注意力让两路视觉编码均依赖问题，并将每段视觉 token 从原始 ViT patch 压缩 49 倍（相对 post-merge backbone token 压缩 11 倍）；同时针对异构答案结构设计答案类型感知奖励，使 GRPO 按答案结构匹配评价指标进行后训练。

Abstract: Reasoning about surgical video – which phase is underway, which instruments act, and when events occur – underpins operative documentation, workflow analysis, and skill assessment. Yet surgical visual question answering is still largely built on single frames and closed labels that cannot express a duration, an ordering, or a count, and the video models that lift the frame limit typically compress every clip the same way regardless of the question, discarding the temporal evidence the answer needs. Worse, the answers are structurally heterogeneous, spanning five incompatible structures – binary, classification, multi-label, counting, and sentence-temporal – that no single training signal scores uniformly well. We propose SurgQ-VLM, a two-stage model for surgical video question answering. Stage 1 trains a question-conditioned dual-stream (slow/fast) compressor for a LoRA-adapted Qwen2.5-VL-7B: cross-attention conditions both streams on the question, and each clip’s visual tokens shrink 49x from the raw ViT patches (11x vs. post-merge backbone tokens). Stage 2 post-trains with GRPO under an answer-type-aware reward that scores each question on the metric matching its answer structure (micro-F1 for label sets, normalised error for counts, a content-timing blend for temporal windows). On a sealed 21,840-question test split over Cholec80 and CholecT50, SurgQ-VLM reaches 0.779 keyword accuracy and a 10x BLEU-4 gain over zero-shot; GRPO adds 2.5 pp K-Acc (2.0 pp attributable to the answer-type-aware reward), concentrated in the structurally hard types, with answer format unchanged (ROUGE-L). Code is available at https://github.com/DhruvMakwana/SurgQ-VLM.

[160] Vision-language classification of Torsades de Pointes risk from pseudo-coloured ECG images: do T-wave morphology and colour context help or hinder? cs.CVPDF

Dario Labrador Alonso, Alaa Alahmadi

TL;DR: 论文研究视觉语言模型在伪彩色心电图图像上分类尖端扭转型室速（TdP）风险时，颜色和T波形态等上下文提示是否真正有帮助。作者用BiomedCLIP在9,789张图像上交叉比较四种上下文策略与四种T波形态标签集，并采用零样本和类别平衡线性探针评估。结果表明零样本不可用；训练后伪彩色图像显著优于无色图像，而提示中是否命名颜色几乎不影响性能，说明关键在信号如何被绘制而非如何被描述。

Details

Motivation: 上下文提示常被认为能低成本提升视觉模型性能，但既有证据多来自提示属性也出现在图像中的基准，混淆了图像与文本两个通道。论文希望在语义复杂的生物医学信号分类任务中厘清上下文提示的真实作用。

Result: 零样本推理不可用。训练后伪彩色图像在所有指标上优于无色图像：平衡准确率0.903 vs 0.825、敏感度0.914 vs 0.827、特异度0.892 vs 0.823、ROC-AUC 0.955 vs 0.888、MCC 0.437 vs 0.311。交叉实验显示图像中的颜色带来+0.126 MCC等提升，而提示中命名颜色无显著影响；最佳提示集仅小幅增益，最差提示集反而造成损失。

Insight: 创新点在于用图像颜色与提示颜色交叉设计解耦混淆通道，并系统评估T波形态标签集在伪彩色ECG分类中的作用。客观看，其价值在于揭示：对以图像呈现的信号，性能提升主要来自信号渲染方式而非文本描述；当终点是间期测量时，命名T波形态的提示可能描述错误量。

Abstract: Contextual prompting is widely presented as a cheap route to better performance from vision models, but the evidence comes largely from benchmarks in which an attribute named in a prompt is also present in the image, confounding the two channels. We investigate the significance of context for a semantically complex biomedical signal classification task using a domain-adapted vision-language model, BiomedCLIP. Building on our previous work that renders electrocardiogram (ECG) signals as colour-enhanced images to flag Torsades de Pointes risk using the QT-nomogram and pseudo-colouring technique, we cross four context strategies with four T-wave morphology label sets, evaluated zero-shot and with a class-balanced linear probe, under five-fold stratified cross-validation on 9,789 images. Zero-shot inference is unusable. Once trained, the colour-enhanced images outperform the colourless ones on every metric: balanced accuracy 0.903 versus 0.825, sensitivity 0.914 versus 0.827, specificity 0.892 versus 0.823, ROC-AUC 0.955 versus 0.888 and Matthews correlation coefficient (MCC) 0.437 versus 0.311. Crossing colour-in-image with colour-in-prompt separates the confounded channels: the image contributes +0.126 MCC (+0.078 balanced accuracy, +0.067 ROC-AUC) whether or not the prompt names colour, whereas naming it changes nothing under any metric. Context is two-sided: the best prompt set gains 0.008 MCC where colour is present and 0.016 where it is not, while the worst loses 0.017 and 0.013. For a signal rendered as an image, the leverage lies in how the signal is drawn rather than in how it is described - and where the endpoint is an interval measurement, prompts naming T-wave morphology describe the wrong quantity.

[161] Spade-SLAM: Sparse Correspondence Anchors for Dense Self-Supervised Visual SLAM cs.CVPDF

Julian Philipp Schmitt, Weirong Chen, Ganlin Zhang, Felix Wimbauer, Daniel Cremers

TL;DR: 论文提出 Spade-SLAM，一个自监督稠密视觉 SLAM 框架，旨在零样本设置下缩小与监督方法之间的性能差距。其核心是稀疏到稠密的互补训练机制：用基于 warping 的光度损失提供稠密训练信号，同时用来自图像特征匹配的稀疏对应损失稳定优化并抑制歧义区域漂移。方法无需显式真值位姿和深度标签即可实现高保真跟踪。

Details

Motivation: 现有稠密视觉 SLAM 若追求高精度通常依赖监督预训练或显式位姿、深度标签，而自监督方法在零样本场景下与监督方法仍有明显性能差距。论文希望在不使用真值位姿和深度标签的情况下，实现高保真且标签高效的稠密 SLAM。

Result: 实验表明，Spade-SLAM 相比现有自监督基线显著提升了鲁棒性和精度，并接近使用显式位姿与深度监督训练的 SLAM 系统；摘要未给出具体 benchmark 数值。

Insight: 创新点在于提出稀疏到稠密的互补训练范式，将图像特征匹配得到的稀疏对应作为锚点引入稠密自监督 SLAM 训练，以稀疏对应损失约束优化、抑制歧义区域漂移。客观来看，其可借鉴之处是用稀疏特征匹配为稠密光度学习提供稳定结构约束，从而在无真值标签下提升稠密 SLAM 的跟踪可靠性。

Abstract: We introduce Spade-SLAM, a self-supervised dense visual SLAM framework that substantially narrows the long-standing performance gap to supervised methods in a zero-shot setting. By demonstrating that high-fidelity tracking can be achieved without explicit ground-truth pose and depth labels, our approach offers a highly effective and label-efficient alternative to fully supervised pretraining. Our core contribution is a complementary sparse-to-dense training regime: While a warping-based photometric loss provides a dense training signal, we stabilize the optimization and suppress drift in ambiguous regions using a sparse correspondence loss derived from image feature matches. Extensive experiments demonstrate that Spade-SLAM significantly improves robustness and accuracy compared to existing self-supervised baselines, closely rivaling SLAM systems trained with explicit pose and depth supervision. The code will be made publicly available at https://github.com/JulianPSchmitt/Spade-SLAM.

[162] VLSplat: Vision-Language Guided Object-Centric 3D Gaussian Splatting via Scene Graph cs.CV | cs.AIPDF

Yuntae Jeon, Younho Jeon, Sujin Jin, Sungho Jo, Seunghee Park

TL;DR: 论文提出VLSplat，一种视觉语言引导的以对象为中心的3D高斯泼溅语义提升方法。它利用视觉语言模型的对象级语义先验增强基于掩码的提升，并通过对象组场景图细化高斯表示，包含组内细化和组间获取两个模块。在室内场景数据集上实验表明，该方法提升了对象级语义一致性和结构完整性。

Details

Motivation: 现有2D到3D语义提升方法主要依赖2D分割监督，缺乏对象级先验，导致学习的表示由局部掩码证据驱动而非整体对象结构。论文旨在通过引入视觉语言模型的对象级语义先验和场景图细化来解决这一问题。

Result: 在室内场景数据集上的实验表明，VLSplat提高了对象级类别的语义一致性和结构完整性。摘要未提供具体定量结果或与SOTA的对比。

Insight: 创新点在于将视觉语言模型的对象级语义先验与对象组场景图结合，通过组内细化抑制语义噪声、组间获取扩展对象支持区域。客观分析，利用视觉语言模型弥补2D分割的不足，并通过场景图结构细化表示，是一种新颖的以对象为中心的语义提升思路。

Abstract: Learning semantic representations for 3D Gaussian Splatting has recently emerged as a promising direction for 3D scene understanding. However, existing 2D-to-3D semantic lifting approaches rely primarily on 2D segmentation supervision and lack object-level priors, causing the learned representation to be driven by local mask evidence rather than holistic object structure. In this paper, we present VLSplat, a vision-language guided approach for object-centric semantic lifting in 3D Gaussian Splatting. Our method augments mask-based lifting with object-level semantic priors derived from vision-language models and refines Gaussian representations using an object-group scene graph. The refinement is performed through two language-guided modules: intra-group refinement suppresses semantic noise within object groups, while inter-group acquisition expands object support regions by incorporating structurally relevant candidates from neighboring groups. Extensive experiments on indoor scene datasets demonstrate that VLSplat improves the semantic consistency and structural completeness of object-level categories. Our code and models are available at https://vlsplat.github.io/.

[163] Knowledge-Guided Floodwater Level Reasoning for Cloud-Edge Collaborative Monitoring cs.CV | cs.AIPDF

Zhengshu Zhou, Shaoyu Wang, Ziyi Geng, Lu Tao, Qian Long

TL;DR: 论文面向城市内涝场景的洪水水位监测，将水位检测重构为显式视觉推理任务，提出基于Qwen2.5-VL和GRPO训练的HydroReasoner云边协同框架。方法构建洪水领域知识图谱HydroKG并设计KG路径奖励，以细粒度监督推理过程，同时结合4-bit量化边缘部署和置信度云边路由机制，并发布HydroLevel基准数据集。

Details

Motivation: 现有基于视觉的洪水水位检测缺乏显式推理，导致检测性能差、可解释性弱，且难以泛化到不同视角和复杂道路场景。论文旨在通过知识引导的视觉推理提升检测准确性、可解释性和跨域泛化能力，并满足云边协同部署需求。

Result: 实验表明HydroReasoner在域内和域外检测准确率分别比传统视觉基线高4.0和13.6个百分点，域外性能仅下降4.4个百分点。边缘4-bit量化使GPU内存降低57%、推理延迟降低43%，域外准确率仅下降0.2个百分点。

Insight: 论文的创新点在于将洪水水位检测转化为显式视觉推理问题，利用领域知识图谱路径奖励对推理过程进行细粒度监督，并结合量化边缘部署与置信度云边路由实现协同监测。客观来看，知识图谱奖励与云边协同机制的结合是其可借鉴之处，有助于在缺乏推理标注时提升泛化与部署效率。

Abstract: Frequent urban floodwater poses a serious threat to the safety and efficiency of intelligent transportation systems. Existing vision-based methods for floodwater level detection face two main limitations. First, the lack of explicit reasoning leads to poor detection performance and little interpretability. Second, these methods struggle to generalize to the complex and varied real-world road scenes seen from different viewpoints. To address this, we reformulate the task as an explicit visual reasoning problem and propose HydroReasoner, a floodwater level reasoning framework designed for cloud-edge collaboration. HydroReasoner builds on Qwen2.5-VL and is trained with Group Relative Policy Optimization. To address the scarcity of reasoning process annotations, we build a floodwater domain knowledge graph HydroKG and design a novel KG path reward. Through deterministic graph traversal over HydroKG, this reward supervises the model’s reasoning process at a fine granularity, which improves both reasoning and generalization. For edge deployment, we apply 4-bit quantization to the model, cutting GPU memory usage by 57% and inference latency by 43% while out-of-domain accuracy drops by only 0.2 percentage points. We also propose a confidence-based cloud-edge routing mechanism, which improves system safety and eases the computational load on the cloud. In addition, we build HydroLevel, a floodwater benchmark dataset of 3,000 images, for training and evaluating the model. Experimental results show that HydroReasoner achieves detection accuracy 4.0 and 13.6 percentage points higher than conventional vision baselines in the in-domain and out-of-domain evaluations respectively, with performance dropping by only 4.4 percentage points out of domain.

[164] MUPA${}^2$S: Multimodal Unified Perception with Asymmetric Attention for Stress Assessment cs.CV | cs.AIPDF

Stefanos Gkikas, Thomas Kassiotis, Yu Fang, Christian Arzate Cruz, Miao Cheng

TL;DR: 论文提出MUPA${}^2$S统一多模态压力评估框架，将面部视频和ECG映射为共享token表示，不依赖模态特定组件，并通过包含片段局部交叉注意力和跨片段状态全局自注意力的非对称注意力进行处理。在新收集的58名受试者压力数据集上按受试者级分层协议评估，视频单模态测试准确率为69.44%，视频-ECG统一融合达到69.58%，且参数量约为特征级融合的一半。

Details

Motivation: 压力自动评估有助于持续监测健康状态并减少人为偏差，但生理信号和行为信号异质性强，导致自动压力评估系统难以构建。论文试图用统一表示和注意力机制更参数高效地融合面部视频与ECG。

Result: 在58人新数据集上，面部视频测试准确率为69.44%，ECG单模态在该表示下接近随机水平；统一视频-ECG融合达到69.58%，参数量约为特征级融合的一半，额外计算开销可忽略；特征级融合未超过视频单模态基线。

Insight: 论文宣称的创新在于无模态特定组件的共享token表示，以及段局部跨注意力加全局自注意力的非对称注意力架构。客观来看，统一输入级融合较参数高效，但融合相对视频仅微增且ECG单独近随机，说明主要收益仍来自视频模态，可借鉴其参数高效多模态统一建模与受试者级评估设计。

Abstract: Stress is a leading contributor to long-term physical and mental health decline. The automatic assessment of stress is a promising approach for continuous monitoring and mitigating human biases. However, the development of automated systems remains challenging due to the heterogeneity of physiological and behavioral signals. This paper presents MUPA${}^2$S, a multimodal framework for automatic stress assessment that combines facial video and ECG signals within a unified perception architecture. Both modalities are mapped into a shared token representation without modality-specific components, and processed through asymmetric attention comprising segment-local cross-attention and global self-attention across segment states. Experiments on a newly collected 58-subject stress dataset, evaluated under a stratified subject-level protocol, show that facial video achieves 69.44% test accuracy, while ECG-only performance remains close to chance under the proposed representation. Unified Video-ECG fusion achieves a test accuracy of 69.58% at approximately half the number of parameters of feature-level fusion, with negligible additional computational cost. Feature-level fusion does not exceed the video-only baseline, while unified input-level integration provides a parameter-efficient mechanism for jointly processing the two modalities.

[165] Multimodal BVP and Respiration for Automated Pain Recognition with Hankel-FCN cs.CVPDF

Valentina Becchetti, Muhammad Umar Khan, Stefanos Gkikas, Alessandro Giuseppi, Raul Fernandez Rojas

TL;DR: 论文提出一种基于多模态生理信号的自动疼痛识别框架，利用AI4Pain数据集中的血容量脉搏（BVP）和呼吸（RESP）信号。方法先将信号通过Hankel矩阵嵌入转换为结构化轨迹表示，以建模时间动态，再由各模态专用的全卷积网络（FCN）处理，并通过晚期融合完成无痛、低痛、高痛三分类。

Details

Motivation: 疼痛具有主观性和动态性，自动疼痛识别对临床护理和人机共情交互很重要。论文希望基于BVP和RESP这两种互补的自主神经反应信号，实现无需手工特征工程的客观疼痛评估。

Result: 在AI4Pain数据集上取得67.09%准确率和66.41% F1分数，与现有方法相比具有竞争力；多模态融合显著优于单模态，Hankel嵌入呈现进一步提升趋势，但泛化性仍需验证。

Insight: 创新点在于用Hankel矩阵嵌入显式建模生理信号的时间动态轨迹，并结合模态专用FCN和晚期融合进行疼痛三分类；客观看，其可借鉴之处是无需手工特征工程的多模态时序表示与融合策略。

Abstract: Automated pain recognition is a fundamental challenge for the advancement of clinical care and empathetic human-computer interaction, due to the subjective and dynamic nature of pain. In this study, we propose a deep learning framework for objective pain assessment based on multimodal physiological signals from the AI4Pain dataset. The approach focuses on Blood Volume Pulse (BVP) and Respiration (RESP), capturing complementary aspects of autonomic responses to nociceptive stimulation. To explicitly model their temporal dynamics, the signals are transformed into structured trajectory representations using Hankel matrix embeddings, enabling the learning of dynamical patterns beyond conventional time-series representations. These embeddings are processed by modality-specific Fully Convolutional Networks, and their outputs are integrated through a late fusion strategy for three-class classification (No Pain, Low Pain, High Pain). Experimental results demonstrate that the proposed method achieves an accuracy of 67.09% and an F1-score of 66.41%, providing competitive performance compared to existing approaches, while relying on no handcrafted feature engineering. Multimodal fusion significantly outperformed either modality alone, and the Hankel embedding showed a trend towards further improvement. Further validation is required to establish generalisability to broader populations and clinical settings.

[166] SurgStream: A Workflow-Anchored Proactive Streaming Framework and Benchmark for Real-Time Surgical Video Understanding cs.CV | cs.AIPDF

Ruipeng Ma, Qing Xu, Jie Liang, Zhen Chen

TL;DR: 论文提出SurgStream，一个面向实时手术视频理解的流程锚定主动流式框架，包含结构化手术记忆模块WAM、时限感知的转场学习DTL，以及包含11.7K流式交互的SurgStream-Bench基准。该框架旨在联合感知当前场景、记忆历史手术事件，并在临床相关时刻前主动响应。

Details

Motivation: 现有方法难以同时保留手术过程证据并决定何时响应，因此需要面向流式手术视频的实时理解与主动响应框架。

Result: 在SurgStream-Bench上的实验表明，该方法优于现有最先进方法，尤其在记忆查询和前向主动问答任务上提升明显。

Insight: 创新点在于将器械-动作-目标观察组织为阶段级可查询记忆，并通过临床窗口内的响应状态监督实现及时主动响应；同时构建了覆盖实时感知、记忆查询、主动问答与警报等多任务的流式基准。

Abstract: Surgical video understanding is essential for intraoperative assistance such as workflow monitoring, instrument preparation and procedural documentation. Delivering such assistance in real time requires a model to jointly perceive the ongoing scene, remember past surgical events, and respond before clinically relevant moments pass. Existing approaches provide limited support for jointly retaining procedural evidence and deciding when to respond in streaming surgical video. In this work, we propose SurgStream, a workflow-anchored proactive streaming framework for real-time surgical video understanding. We first introduce Workflow-Anchored Memory (WAM) to record structured instrument-action-target observations and fold them into phase-level summaries, providing compact and queryable surgical memory. Deadline-aware Transition Learning (DTL) is then devised to supervise response states within clinical windows, enabling timely responses before procedural deadlines. We further introduce SurgStream-Bench, comprising 11.7K streaming interactions across various tasks covering real-time perception, backward memory queries, forward proactive QA, proactive alerts and caption memory. Experiments on SurgStream-Bench show gains over state-of-the-art methods, especially in memory and forward proactive QA. The source code will be available.

[167] Synthetic Realities: Evaluating Human Ability to Distinguish AIGenerated Videos from Real Footage cs.CV | cs.HCPDF

Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim

TL;DR: 论文构建了一个包含真实视频和AI生成视频的平衡刺激集，覆盖文本到视频、图像到视频动画、视频外扩三类生成方式，以及历史影像、影视媒体、自然环境三类主题，并让87名未训练参与者进行“真实 vs. AI生成”二选一判断。结果显示人类平均识别正确率为60%，且检测准确率同时受生成技术和内容主题影响。

Details

Motivation: 近期AI视频合成在多种路径上达到高保真，但缺乏针对未训练观众如何并排感知并区分这些AI视频与真实素材的系统评估。论文旨在比较不同生成技术和主题语境下的人类检测能力及其影响因素。

Result: 87名参与者平均正确识别率为60%；图像到视频最易识别（79%），真实素材为64%，视频外扩为49%，文本到视频最低（43%）。主题也显著影响判断，影视和历史场景检测率高于环境片段，环境视频常被误认为AI；逻辑回归显示生成技术、主题及其交互作用均显著（p < 0.001）。

Insight: 论文的创新在于系统比较三种AI视频生成路径与三类主题语境，并通过平衡刺激集和ComfyUI标准化流程控制质量与时长。其客观启示是：AI视频的感知真实感更多受内容上下文影响，而非单纯由模型类型决定，并存在偏向假定视频为合成的判断偏差，对媒体素养和上下文感知评估工具设计有参考价值。

Abstract: Recent advances in generative AI have enabled multiple pathways for high-fidelity video synthesis: text-to-video, image-to-video animation, and video outpainting. Empirical side-by-side evaluations of how untrained viewers perceive and distinguish these outputs from real footage remain scarce. In this study, we systematically compare human detection accuracy across these three AI generation techniques within three thematic contexts: historical footage, film and media content, and natural environments. We constructed a balanced stimulus set comprising equal amounts of real and AI-generated videos (18 each). The AI clips were evenly distributed across the three generation methods using Google’s Veo 3, Lightricks LTX Video, and Wan VACE. All videos were produced and standardized within the ComfyUI framework to ensure consistent quality and duration. 87 participants judged every clip in a binary forced-choice task (“real” vs. “AI-generated”). Participants correctly identified videos 60% of the time on average. Image-to-video clips were recognized most accurately (79%), followed by real footage (64%), outpainting (49%), and text-to-video (43%). Accuracy also varied by theme: film and historical scenes yielded higher detection rates than environmental clips, which were frequently mistaken for AI. Logistic regression confirmed significant effects of both technique and theme as well as their interaction (p < 0.001), indicating that detection success depends jointly on how the content was generated and what it depicts. Findings reveal a consistent bias toward assuming synthetic origins and highlight that perceptual realism in AI video is shaped more by context than by model type, underscoring the importance of media-literacy approaches and context-aware evaluation tools for navigating increasingly synthetic visual media.

[168] NAS-PO: Native Attention-Strategy Policy Optimization for Vision-Language Models cs.CVPDF

Ke An, Shizhe Xiang, Yue Liu, Liang Chen, Pei Fu

TL;DR: 论文提出NAS-PO框架，将视觉语言模型的原生注意力机制作为奖励锚定的、与token对齐的路由信号来塑造模型感知，而非将其视作事后解释。NAS-PO将注意力分解为量化视觉资源分配的visual mass policy和刻画视觉token空间路由的conditional visual policy，并据此设计了NAS-AS优势塑形（对视觉参与度高的rollout重新分配带符号的策略梯度信用）和AAC自适应注意力耦合损失（在所有响应token上对齐visual-mass策略、在视觉活跃token上对齐conditional visual策略），用于RLVR后训练。

Details

Motivation: 标准RLVR对所有生成token赋予相同的结果信用，忽略其感知相关性；而现有感知感知方法依赖图像扰动或掩码来间接估计视觉依赖，需要额外扰动分支，且对损坏的敏感度未必能反映推理实际使用的视觉证据。

Result: 在7个域外推理与感知基准上显著超越领先的RL微调VLM，并在8B和32B规模上一致验证有效；Visual-Routing Sensitivity分析表明优化后的注意力更集中于视觉承载区域。

Insight: 创新在于把原生注意力这一模型内在信号转化为奖励锚定的token级路由信号，并通过visual-mass与conditional visual策略的分解使优化问题良定义；相比扰动类代理信号更直接、无需额外分支，其优势塑形与注意力耦合损失的设计具有可借鉴性。

Abstract: Reinforcement learning with verifiable rewards (RLVR) has become an effective post-training paradigm for vision-language models (VLMs). Standard RLVR, however, assigns identical outcome-derived credit to all generated tokens regardless of their perceptual relevance. Recent perception-aware methods estimate visual reliance through image perturbation or masking. These indirect proxies require perturbation branches, while corruption sensitivity does not necessarily identify the visual evidence used for reasoning. We instead shape model perception through native attention, an intrinsic model signal. Rather than treating attention as a post-hoc explanation, we formulate it as a reward-anchored, token-aligned routing signal that encourages attention patterns supporting visually grounded reasoning. To this end, we propose NAS-PO, a Native Attention-Strategy Policy Optimization framework. NAS-PO analyzes native attention with a visual mass policy that quantifies visual allocation and a conditional visual policy that captures spatial routing over visual tokens, making the optimization well-posed. Based on this, Native Attention-Strategy Advantage Shaping (NAS-AS) draws on the visual-mass policy to redistribute signed policy-gradient credit for visually engaged rollouts. The Adaptive Attention-Coupled (AAC) loss then aligns the visual-mass policy on all response tokens and the conditional visual policy on visually active ones, consolidating the visual-routing patterns that drive successful trajectories. Experiments demonstrate that NAS-PO substantially surpasses leading RL-tuned VLMs across 7 out-of-domain reasoning and perception benchmarks, with its effectiveness consistently validated across 8B and 32B. Visual-Routing Sensitivity (VRS) analysis further indicates that the optimized attention prioritizes visually load-bearing regions.

[169] Reconstruction as Spatial Evaluation: Diagnosing Cross-View Spatial Intelligence in Large Vision-Language Models cs.CV | cs.AIPDF

Junfei Wu, Qiuyue Wang, Xuhong Huang, Qihang Peng, Mingsheng Li

TL;DR: 论文提出 RECONSPATIAL 基准，用多视角 3D 场景重建来诊断大视觉语言模型（LVLMs）的跨视角空间智能。模型需根据真实多视角图像和目标物体查询，在统一的相机锚定度量坐标系中预测带方向的 3D 边界框。基准从结构（相对布局）和度量（物理尺度与相机锚定位置）两个维度评估，并包含九个原子空间 QA 任务与离线导航路径规划评测。

Details

Motivation: 现有静态基准多评估孤立的空间判断，交互式具身评测又混合了感知、探索、规划、控制和模拟器执行等因素，难以单独衡量跨视角空间理解。论文希望用一个更聚焦的重建式评测桥接这一空白，诊断 LVLMs 将局部视觉观察组合成几何一致世界表示的能力。

Result: 在 18 个前沿 LVLMs 上的评测显示，相对场景结构与度量重建之间存在稳定差距：即使 GPT-6-Astra 在 Structure 上达到 81.4%，在 Metric 上仅 58.7%。诊断分析表明关系一致性并不保证度量精度，3D 地图注入实验进一步揭示几何误差会限制导航成功，而空间微调可在空间和通用视觉语言基准上带来广泛迁移。

Insight: 创新点在于将多视角 3D 重建作为空间智能评测载体，并用 Structure/Metric 双轴和九个原子空间任务进行细粒度诊断。其可借鉴之处包括：用统一相机锚定度量坐标系约束跨视角一致性、通过 3D 地图注入分离场景构建与路径规划、以及验证空间微调的跨任务迁移价值。

Abstract: The spatial intelligence of large vision-language models (LVLMs) requires the ability to combine local visual observations into a geometrically consistent representation of the physical world. Many static benchmarks assess isolated spatial judgments, such as relative direction or distance, while interactive embodied evaluations combine perception with exploration, planning, control, and simulator-specific execution. To bridge this gap, we introduce RECONSPATIAL, a benchmark centered on multi-view 3D scene reconstruction across indoor, tabletop, and outdoor environments. Given real multi-view images and target-object queries, LVLMs are required to jointly predict oriented 3D bounding boxes in a shared, camera-anchored metric coordinate frame. Reconstructions are evaluated along two complementary axes: Structure for relative layout and Metric for physical scale and camera-anchored placement. Nine atomic spatial QA tasks, grouped into Geometric Perception and Spatial Relations, probe spatial capabilities involved in joint reconstruction. Offline navigation extends evaluation to path planning. Evaluation of 18 frontier LVLMs reveals a consistent gap between relative scene structure and metric reconstruction; even GPT-6-Astra scores 81.4% on Structure but only 58.7% on Metric. Tracing this gap, diagnostic analyses link atomic spatial capabilities to reconstruction quality and show that relational consistency alone does not ensure metric accuracy. Experiments with 3D map injection further separate scene construction from path planning, revealing how these geometric errors limit navigation success. Finally, spatial fine-tuning yields broad transfer across both spatial and general vision-language benchmarks.

[170] 4D Triangle Splatting Reconstruction of Dynamic Endoscopic Scenes from Monocular Videos cs.CV | cs.ROPDF

Laura Salort-Benejam, Stamatia Giannarou, Antonio Agudo

TL;DR: 论文提出 SurgicalTS，一种面向单目内窥镜视频的动态场景 4D 重建框架，采用自监督三角泼溅表示，将规范三角面片与形变网络联合优化。方法引入基于四元数的形变建模、改进颜色参数化、时空先验和重定义初始化策略，以应对软组织形变、遮挡和光照变化等问题。实验表明其能建模软组织形变与工具-组织交互，并优于现有方法且减少训练时间。

Details

Motivation: 单目内窥镜视频的动态 4D 重建面临非刚性组织形变、光照变化、遮挡和未知相机轨迹等挑战；可靠重建有助于提升微创手术的可视化、诊断准确性和术中引导。

Result: 在多种手术的挑战性活体内窥镜视频上，SurgicalTS 成功建模随时间变化的软组织形变和工具-组织交互，持续优于当前最先进方法，同时减少训练时间并保持有竞争力的几何与光度精度。

Insight: 论文宣称的创新包括自监督三角泼溅框架、规范三角面片与形变网络联合优化、基于四元数的形变模型、改进颜色参数化、时空先验以及提升遮挡下完整性的初始化策略。客观看，其创新在于将三角泼溅表示与物理一致的四元数形变建模结合，用于单目动态内窥镜 4D 重建，并兼顾鲁棒性与训练效率。

Abstract: Robust 4D reconstruction of deformable endoscopic scenes from monocular videos remains challenging due to non-rigid tissue deformation, illumination changes, occlusions, and unknown camera trajectories. Reliable dynamic reconstruction of endoscopies could significantly enhance visualization, diagnostic accuracy and intraoperative guidance of minimally invasive procedures. We propose SurgicalTS, a self-supervised triangle-splatting framework for dynamic endoscopic scene reconstruction from static monocular cameras. The scene is represented by a canonical set of triangles jointly optimized with a deformation network. We introduce a quaternion-based deformation model, an improved color parametrization, spatio-temporal priors, and a redefined initialization strategy that improves completeness under occlusions. Extensive evaluation on challenging in-vivo endoscopy videos from diverse procedures shows that SurgicalTS successfully models soft-tissue deformations and tool-tissue interactions over time, while consistently outperforming state-of-the-art methods. Our method also reduces training times while maintaining competitive geometric and photometric accuracy results, highlighting the effectiveness of quaternion-based deformation modelling with physical consistency for robust and efficient 4D reconstruction of endoscopic scenes.

[171] Learning to Look: A Foundation for Visual Understanding cs.CVPDF

Wenshuai Zhao, Yihao Wang, Benjamin Robson, Juho Kannala, Arno Solin

TL;DR: 论文关注视觉语言模型（VLM）的视觉幻觉问题，提出一个更基础的问题：模型在理解图像语义之前，是否知道自己当前“看”到了图像的哪些部分。作者将这一问题形式化为LOOK任务，即识别视觉输入中哪些区域对模型可用，并以自监督方式构建该任务而无需人工标注可见区域。实验表明现有VLM难以定位可见区域，而在LOOK任务上微调可提升模型对视觉输入的感知能力。

Details

Motivation: VLM常出现视觉幻觉，例如声称图像中存在并不存在的物体。论文希望从更基础的层面探究模型是否具备对可用视觉输入区域的感知，从而为视觉理解提供基础。

Result: 实验显示现有VLM无法成功定位可见区域；进一步在提出的LOOK任务上微调后，模型对视觉输入的感知能力得到提升。摘要未提及具体定量指标或benchmark。

Insight: 创新点在于将视觉幻觉与“模型是否知道自己在看哪里”联系起来，并提出无需人工标注、可自监督构建的LOOK任务。客观来看，该工作为VLM的视觉输入感知提供了新的预训练/微调信号，有望作为提升视觉理解可靠性的基础任务。

Abstract: Vision-language models (VLMs) suffer from visual hallucination, such as saying an object that is not present in an image. We ask a more fundamental question: whether a VLM is even aware of where it is looking before understanding the semantic meaning in the image. We formulate this question as a LOOK task: identifying which parts of its visual input were available to the model. We construct the task in a self-supervised way without manually labeling the available region to the model. Our experiments show that existing VLMs fail to localize the visible region. We further show that fine-tuning VLMs on the proposed LOOK task improves a model’s awareness of visual input.

[172] Scene-Adaptive Readout and Decoding in Diffusion Driving VLAs cs.CV | cs.AI | cs.ROPDF

Seungjun Yu, Jiho Choi, Inha Kang, Hojun Choi, Seungwook Kim

TL;DR: 论文针对扩散式驾驶视觉-语言-动作模型（VLA）在每一步去噪都需重复执行骨干网络、造成巨大推理开销的问题，分析了轨迹读出在网络深度与解码进度上的差异，发现存在“深度-解码解耦”现象（后层表征在首次前向传播后即可支持有效轨迹读出，而前层表征更受益于继续解码），且最优读出层与解码深度因场景而异。基于此提出场景自适应读出与解码框架：用场景条件读出MoE在单次骨干前向传播后自适应加权组合后层轨迹预测，并仅在场景需要时执行额外原生精化。

Details

Motivation: 扩散驾驶VLA在每一去噪阶段重复运行骨干网络带来高推理成本，而并非所有场景都需要相同的解码计算量，论文试图区分轨迹何时“可读”与还需多少精化，从而避免不必要的解码计算。

Result: 在两个扩散驾驶VLA上于Waymo E2E和nuScenes基准评测，验证集RFS最高提升0.56，测试性能也有提升，Waymo E2E上端到端加速最高达6.0倍，nuScenes上持续降低轨迹误差。

Insight: 创新点在于揭示深度-解码解耦现象及场景间读出层/解码深度的差异，并据此设计场景条件读出MoE与按需自适应解码策略，以场景级计算分配替代固定全量去噪，在保持或提升规划质量的同时显著降低推理开销。

Abstract: Diffusion driving vision-language-action models repeatedly execute the backbone at every denoising stage, incurring substantial inference cost, while it remains unclear whether all scenes require the same decoding computation. To distinguish when a trajectory becomes readable from how much further refinement it requires, we analyze trajectory readout across network depth and decoding progress. We identify a depth-decoding dissociation in which late-layer representations already support useful trajectory readout after the first forward sweep, whereas early-layer representations benefit more from continued decoding. We further find that both the preferred readout layer and decoding depth vary across scenes. Based on these observations, we propose a scene-adaptive readout and decoding framework. A scene-conditioned readout MoE adaptively weights and combines trajectory predictions from layer-specific late-layer representations after a single backbone sweep, while an adaptive decoding policy applies additional native refinement only when required by the scene. We evaluate our framework on two diffusion driving VLAs across the Waymo E2E and nuScenes benchmarks. Our method improves validation RFS by up to 0.56 while also improving test performance, and achieves an end-to-end speedup of up to $6.0\times$ on Waymo E2E, while consistently reducing trajectory error on nuScenes. These results demonstrate that scene-level readout and decoding allocation improves planning quality while avoiding unnecessary decoding. Our code is available at https://github.com/sjyu001/SARD

[173] EarthJev: Calibrated, Non-Generative Answers to Natural-Language Questions about Sentinel-2 Land Cover cs.CV | cs.AIPDF

Domenico Benfenati, Antonio Maria Rinaldi, Cristian Tommasino

TL;DR: 论文提出 EarthJev，一个 0.8B 参数的多光谱遥感视觉语言模型。它不做文本生成，而是把 12 个 Sentinel-2 波段送入 Qwen3.5-0.8B 的视觉编码器，并把输入层加宽、用 RGB 卷积核初始化；回答时，它在单个位置上读取选项字母的 logits，从而直接得到带概率的答案。作者用交叉熵损失和 Brier 分数训练该模型，并在 BigEarthNet v2.0 的 70,890 个问题上与生成式基线和其他多模态大模型进行了对比。

Details

Motivation: 现有遥感视觉语言模型通过生成文本回答问题，每次回答都要跑一遍解码循环，需要把文本解析回选项，而且得不到可用的概率。论文的目标是让模型对多光谱图像的类型化问题给出快速、免生成、且概率经过校准的答案。

Result: 在 36,028 个测试问题上，EarthJev 的准确率达到 86.0%，比两个 2B 多模态模型分别低 0.6 和 1.2 个百分点，比遥感模型 EarthDial-4B 低 3.5 个百分点，但概率校准更好（ECE 0.006），且答案在构造上合法；单题耗时 19.9 ms，比多模态语言模型快 4.3–8.7 倍，比同一骨干网络以生成方式回答快 6.8 倍；批量回答一张图像的所有问题时，耗时 42.8 ms，比批量生成模型快 3.7–10.1 倍。消融实验显示，将非 RGB 波段替换为均值会损失 4.5 个百分点，说明模型确实利用了多光谱输入；训练整个视觉编码器后，准确率提升到 88.4%。

Insight: 创新在于把视觉问答重构为对固定选项词表的判别式读取：不生成 token，而是从选项字母所在位置的 logits 直接获得答案及可校准概率，同时用交叉熵和 Brier 分数联合训练。工程上，它把 12 波段输入层加宽，并用 RGB 卷积核初始化，使模型能复用预训练权重、接入多光谱输入。这种设计在精度与生成式大模型接近的同时，显著降低了推理成本，并让输出天然合法且可校准。

Abstract: Vision-language models for remote sensing answer questions about satellite images by generating text: every answer costs a decoding loop, has to be parsed back to an option, and comes without a usable probability. We present EarthJev, a 0.8B-parameter model that answers typed questions about multispectral Sentinel-2 patches without generating any token. All 12 bands enter the vision encoder of Qwen3.5-0.8B through a widened input layer initialised from the RGB kernels, and, following the open OneJev recipe, the answer is read from the logits of the option letters at a single position and trained with cross-entropy plus Brier score. Under a pre-specified analysis plan, we compare it with the same backbone fine-tuned to generate the answer and with three multimodal language models fine-tuned with LoRA, all trained on the same 70,890 questions from 5% of BigEarthNet v2.0 and timed in one job on the same GPU; VQA models that classify over a fixed answer vocabulary are reported as a reference for the cost of answering only the questions seen in training. EarthJev answers a question in 19.9 ms, 4.3 to 8.7 times faster than the multimodal language models and 6.8 times faster than its own backbone used generatively; when all the questions about an image are asked together, it answers them in 42.8 ms, 3.7 to 10.1 times faster than the batched generative models. On 36,028 test questions it reaches 86.0% accuracy (three seeds), 0.6 and 1.2 points below the two 2B multimodal models and 3.5 points below the remote-sensing EarthDial-4B, with answers that are valid by construction and calibrated probabilities (ECE 0.006). Replacing the nine non-RGB bands with their mean costs 4.5 points, so the model uses the multispectral input, and in an ablation training the whole vision encoder raises accuracy to 88.4% at the same cost. Code and model: https://github.com/CosmoIknosLab/EarthJev

[174] Depth Anyviewpoint? Evaluating Monocular Depth Over Viewpoint Sequences cs.CVPDF

Theo Rode, Rui Zhang, Ryan Aubrey, Olivia Li, Jessica Huang

TL;DR: 论文关注单目深度基础模型在真实视频、相机移动场景下是否能够保持跨视角一致的三维结构。作者提出一种基于视角序列的新评估协议，利用运动恢复结构（SfM）将模型输出的仿射不变深度锚定到度量深度，并在多样真实视频上评估现有方法。研究发现，单目深度模型在长时序视角变化下的空间一致性仍存在明显开放挑战，同时直接使用SfM进行度量锚定也有局限。

Details

Motivation: 现有单目深度模型在单图基准上表现优异，但真实应用如视频流输入需要跨视角和长时序一致的三维结构；仿射不变深度还难以稳定锚定到场景的度量深度，因此需要系统评估其在视角序列上的空间一致性与度量接地能力。

Result: 论文未报告单一benchmark上的数值SOTA，而是通过真实视频序列的评估协议展示现有单目深度模型在跨视角一致性和长期时序一致性方面仍存在挑战，并指出将SfM直接作为度量深度锚定工具用于单目深度评估也存在问题。

Insight: 创新点在于从单图评估转向移动相机视角序列评估，强调跨视角空间结构和长时序一致性，并尝试用SfM提供度量深度锚定。客观看，其价值主要在于揭示单目深度基础模型在真实视频应用中的一致性短板及评估方法学问题。

Abstract: Monocular depth estimation aims to predict depth maps from single RGB images (forgoing the need for stereo camera pairs) and has seen impressive leaps in performance in recent work due to the introduction of affine-invariant losses and the use of foundation model features. These monocular depth models predict affine-invariant depth, which describes the relative positions of objects in the scene instead of absolute depth. While these models demonstrate strong performance on single image benchmarks and qualitatively consistent predictions in video, their effectiveness at preserving consistent spatial structure has been less thoroughly explored. Many potential real-world applications, such as handling video streams as input, rely on coherent three dimensional consistency in scenes. Further, anchoring relative depth predictions to a metric reference for a given scene is a key challenge for applying monocular depth models to real-world situations. We develop a novel evaluation protocol for monocular depth models using video sequences with moving camera positions to test the consistency of prediction across variation in viewpoint. We demonstrate this methodology over diverse, real-world video sequences where we are able to anchor depth model output to metric depth values using structure from motion. Our work demonstrates open challenges in the development of broadly applicable monocular depth foundation models, particularly with their ability to provide temporal consistency over long time frames. We also identify challenges in the straightforward adoption of structure-from-motion as a metric grounding tool for monocular depth estimation models.

[175] Learning from high-resolution 2D images to reconstruct 3D microstructures cs.CVPDF

Wenbo Sui, Lars P. Mikkelsen, Jens W. Andreasen, Daniel Lichau, Harold Phelippeau

TL;DR: 论文提出 Privileged Cross-modal Relational Distillation（PCRD）框架，在训练阶段利用高分辨率二维图像作为特权模态，提升仅依赖低分辨率体积成像进行样本特定三维微结构重建的效果。方法通过匹配教师与学生表征中对应空间锚点周围的相似度分布来迁移空间组织关系，而不直接对齐异质特征向量。作者在拉挤碳纤维增强聚合物复合材料上验证了该框架。

Details

Motivation: 高分辨率三维微结构成像在大规模应用中成本高、耗时长甚至具有破坏性，而高分辨率二维图像和低分辨率体积测量通常更易获得，因此需要利用二者提升三维重建。

Result: 在二维截面重建中，PCRD 相比直接使用 micro-CT 训练将 mAP 提升 1.66 个百分点；独立三维验证与高分辨率同步辐射 X 射线 CT 数据在纤维体积分数、直径和局部间距上接近，重建匹配 89.97% 的参考纤维中心线长度，优于低分辨率体积插值的 75.08%。

Insight: 创新点在于将高分辨率 2D 作为训练期特权模态，通过跨模态关系蒸馏迁移空间组织信息，避免异质特征向量的直接对齐。客观上看，该方法为利用易得高分辨率 2D 数据增强低分辨率 3D 重建提供了可借鉴范式。

Abstract: High-resolution three-dimensional (3D) microstructure characterization remains difficult to undertake at scale because volumetric imaging at the required spatial resolution is expensive, time-consuming or destructive. In many settings, however, fine-resolution two-dimensional (2D) imaging and lower-resolution volumetric measurements are both readily available. We introduce a Privileged Cross-modal Relational Distillation (PCRD) framework that leverages fine-resolution 2D observations during training to improve specimen-specific 3D reconstruction from lower-resolution volumetric imaging alone. We demonstrate PCRD on pultruded carbon fiber-reinforced polymer composites, using scanning electron microscopy as the privileged modality and micro-CT as the inference input. The framework transfers spatial organization by matching similarity distributions defined around corresponding spatial anchors in the teacher and student representations, avoiding direct alignment of heterogeneous feature vectors. In 2D cross-sectional reconstruction, PCRD improves mAP by 1.66 percentage points over direct micro-CT training. Independent 3D validation against high-resolution synchrotron X-ray CT data shows close agreement in fiber volume fraction, diameter and local spacing. The PCRD reconstruction matches 89.97% of the reference fiber centerline length, compared with 75.08% for the interpolated low-resolution volume.

[176] SVD-Prune: Spectral Vision Token Pruning under Extreme Compression cs.CVPDF

Yvon Apedo, Martyna Poreba, Michal Szczepanski, Samia Bouchafa

TL;DR: 论文提出 SVD-Prune，一种无需训练的视觉 token 剪枝框架。该方法不逐个判断 token 重要性，而是将剪枝建模为保留视觉表示的主导低秩谱结构，利用 SVD 和统计杠杆分数进行全局 token 选择。框架与架构无关，可用于 VLM/VLA 的编码器侧、解码器侧和混合配置，并在极端压缩下验证鲁棒性。

Details

Motivation: VLM 和 VLA 模型需要处理数百个视觉 token，视觉表示成为主要计算瓶颈。论文认为视觉 token 剪枝应关注保留视觉表示的主导低秩谱结构，而非单独评估每个 token 的重要性。

Result: 在 VLM 和 VLA 基准上，方法在极端压缩下表现出强鲁棒性；最高可削减 99.3% 的视觉 token 预算。在 16 token 预算下，编码器侧剪枝降低 82.4% 推理 FLOPs，并实现 4.18 倍端到端加速（包含剪枝开销）。

Insight: 创新点在于从低秩谱结构保持的角度重新定义视觉 token 剪枝，并结合 SVD 与统计杠杆分数进行全局选择。其无需训练、架构无关且支持编码器/解码器/混合多阶段部署，具有较好的通用性和工程可集成性。

Abstract: Vision-Language Models (VLMs) and Vision-Language-Action (VLA) models process hundreds of visual tokens, making visual representations a major computational bottleneck. We argue that visual token pruning should be formulated not as identifying individually important tokens, but as preserving the dominant low-rank spectral structure of the visual representation. Based on this formulation, we introduce SVD-Prune, a training-free framework that leverages Singular Value Decomposition (SVD) and statistical leverage scores for globally informed token selection. SVD-Prune is architecture-agnostic and can be applied at different stages of the multimodal pipeline, including encoder-side, decoder-side, and hybrid configurations Extensive experiments across VLM and VLA benchmarks demonstrate strong robustness under extreme compression. SVD-Prune reduces the visual token. SVD-Prune cuts the visual token budget by up to 99.3%, while, at a 16-token budget, encoder-side pruning lowers inference FLOPs by 82.4% and achieves a 4.18x end-to-end speedup, including pruning overhead.

[177] Lie Routing Vision Language Models for View-Robust 3D Understanding cs.CV | cs.LGPDF

Jingjun Yi, Chen Hu, Qi Bi, Hao Zheng, Huimin Huang

TL;DR: 论文提出 LieVLM，一个用于视角鲁棒 3D 理解的 Lie routing 框架。它针对多视角 RGB 下 MLLM 出现的视角诱导语义漂移，在学习到的三维子空间中对投影视觉特征施加局部 SO(3) 变换，并由 VGGT 提取的几何 token 预测旋转参数和通道级路由系数，通过 Padé–Cayley 映射生成恒等相对修正后门控回原视觉与几何特征。

Details

Motivation: 多模态大模型在 3D 场景理解中虽已取得进展，但同一物体和查询在不同相机视角下会产生不一致响应，即视角诱导语义漂移；论文希望利用视角变化中的旋转成分来增强表示的视角鲁棒性。

Result: 在 3D captioning、grounding、detection 和 spatial reasoning 任务上，LieVLM 相较加性融合基线在不同训练规模和骨干网络上均取得一致提升；消融实验分析了几何条件与变换结构的作用，视角分析显示预测路由状态随视角系统性变化，目标响应更局部且跨视角任务性能更强。

Insight: 创新点在于将视角变化建模为学习三维子空间中的局部 SO(3) 特征变换，并用几何 token 预测旋转与路由系数，通过闭式 Padé–Cayley 映射和门控保留预训练语义与空间上下文，同时引入视角自适应调整；客观上看，其可借鉴之处是以李群/旋转结构进行特征路由，而非简单加性融合。

Abstract: Multimodal Large Language Models (MLLMs) have made substantial progress in 3D scene understanding from multi-view RGB observations. Yet a fixed object and query can elicit inconsistent target-related responses across camera viewpoints, a phenomenon we characterize as viewpoint-induced semantic drift. We introduce LieVLM, a Lie routing framework for view-robust 3D understanding. Motivated by the rotational component of viewpoint change, Lie routing adapts visual representations by applying local $\mathrm{SO}(3)$ transformations to projected features within learned three-dimensional subspaces. Geometry tokens extracted by VGGT predict local rotation parameters and channel-wise routing coefficients. A closed-form Padé–Cayley map transforms projected visual features, whose identity-relative corrections are projected back and gated into the original visual and geometry features. This design retains the pretrained semantic and direct spatial context while learning view-dependent feature adjustments. Experiments on 3D captioning, grounding, detection, and spatial reasoning show consistent improvements over additive fusion across training scales and backbones. Controlled ablations examine the roles of geometric conditioning and transformation structure. Viewpoint analyses further reveal systematic variation in the predicted routing states alongside more localized target responses and stronger task performance across viewpoint changes.

[178] Findings-aware Language-Image Pretraining for CT Volume Interpretation cs.CV | physics.med-phPDF

Takuro Shimaya, Junya Inoh, Masahiro Saiko

TL;DR: 论文针对CT体数据与放射报告的多模态预训练，指出传统CLIP式方法将不同病例视为负对在医学影像中并不总合理。作者提出FiLIP框架，利用大语言模型从报告中抽取异常发现短语，并用生物医学文本嵌入模型生成语义目标特征，监督图像编码器学习发现感知表示。该方法在多标签零样本发现分类的域内和外部评估中优于弱监督方法，并在放射报告生成微调任务上验证有效。

Details

Motivation: 现有CT视觉-语言预训练多采用CLIP式对比学习，将不同病例作为负对，但医学场景中不同病例可能存在临床相似性，强行拉开表示并不合适。论文希望引入更可靠的临床知识监督，避免弱监督负对假设带来的问题。

Result: FiLIP在多标签零样本发现分类的域内和外部评估中均优于弱监督方法，并在放射报告生成的下游微调任务中表现有效；摘要未给出具体数据集名称和定量指标。

Insight: 创新点在于用LLM从放射报告抽取异常发现短语，再借助生物医学文本嵌入模型构造图像编码器的显式语义目标，实现发现级监督而非病例级对比弱监督。客观来看，其可借鉴之处是将临床发现语义作为多模态预训练的结构化监督信号，缓解医学影像中负对定义不准确的问题。

Abstract: Computed tomography (CT) provides diverse patient information and various clinical tasks, for which numerous deep learning models have been investigated. Recent years have seen the development of vision-language foundation models that can comprehensively extract clinical features, driven by representation learning that combines CT volumes with radiology reports. Existing approaches typically adopt Contrastive Language-Image Pre-training (CLIP)-based representation learning, where pairs from different cases are, in principle, treated as negative pairs such that the volume and report embeddings are pushed apart. In the biomedical imaging, however, treating different cases as negative pairs is not always appropriate, particularly when clinical similarity exists. In this study, we propose a supervised representation learning framework grounded in clinical knowledge from language foundation models, rather than the weak supervision used in CLIP. Specifically, we utilized a large language model to extract abnormal finding phrases from reports. We then explicitly constructed the target features that the image encoder should output, as the semantic representation of the extracted findings using a biomedical text embedding model. Our Findings-aware Language-Image Pre-training (FiLIP) outperformed weakly supervised approaches in multi-label zero-shot finding classification in both in-domain and external-domain evaluations, and also proved effective when fine-tuned for the downstream task of radiology report generation.

[179] AgiWorld: An Agentic Video World Model for Building Persistent Worlds cs.CV | cs.AIPDF

Shaoheng Fang, Yiqun Mei, Hanwen Jiang, Xin Sun, Haitian Zheng

TL;DR: 论文提出 AgiWorld，一个面向持久世界构建的智能体式视频世界模型。它从单张图像和自由形式指令出发，由高层智能体规划世界与探索路径，低层视频世界模型逐块生成视频并将几何信息存入空间记忆，通过闭环让智能体世界状态与生成内容保持一致。

Details

Motivation: 现有交互式视频世界模型依赖用户提供相机运动和文本提示等低层控制，难以实现高层意图，且长时间探索中生成世界难以保持持久一致。论文希望降低控制成本并构建可持久探索的世界。

Result: AgiWorld-WM 在世界重访与探索基准上取得整体 SOTA 表现；定性结果和消融表明其能根据自由形式指令在分钟级旅程中构建持久世界。

Insight: 创新在于将高层智能体规划与低层视频生成通过共享空间记忆闭环耦合，并设计度量相机轨迹与结构化提示接口；同时提出遮挡感知历史选择和基于可靠性的记忆维护以缓解长时生成中的遮挡与几何误差累积。

Abstract: Recent interactive video world models generate visually compelling videos from a single image, following user-provided camera motion and text prompts. However, such low-level control demands substantial user effort to realize a high-level intent, and the generated world struggles to remain persistent as the exploration proceeds. In this work, we present AgiWorld, an agentic video world model that explores and builds a persistent world from a single image and a free-form instruction. For high-level planning, our agent AgiWorld-Agent designs the world and the journey through it in a world state and directs the exploration. For low-level realization, our video world model AgiWorld-WM generates the video chunk by chunk and stores it with its geometry in a spatial memory, from which the agent updates its world state. This closed loop keeps the world faithful to the user’s intent and keeps the agent’s world state consistent with the generated content throughout the exploration. We co-design the two levels around the shared spatial memory and an interface of metric camera trajectories and structured prompts. In AgiWorld-WM, to handle occlusion and accumulated geometric errors in the spatial memory over long rollouts, we propose occlusion-aware history selection, which retrieves past views by surface visibility, and reliability-based memory maintenance, which prefers reliable geometry and earlier observations. AgiWorld-WM achieves state-of-the-art overall performance on world revisiting and exploration benchmarks, and qualitative results and ablations show that AgiWorld builds persistent worlds from free-form instructions over minute-long journeys. Persistence thus arises not from the video model alone but from its closed loop with the agent.

[180] Exploiting Textual Semantics for Robust Cross-View Object Correspondence cs.CV | cs.AIPDF

Bing Fan, Yunhe Feng, Yan Huang, Heng Fan

TL;DR: 论文研究跨视角物体对应（CVOC），针对现有仅依赖视觉线索的方法在大视角变化和外观变化场景中目标信息不足的问题，提出TeSCo框架，利用视觉语言模型生成目标文本描述，并将其文本语义与视觉特征融合以增强跨视角对应鲁棒性。方法包含文本条件跨模态融合（TCF）和迭代文本特征精炼（ITFR）模块，在Ego-Exo4D和HANDAL-X上取得SOTA。

Details

Motivation: 现有CVOC方法主要依赖视觉线索，在复杂场景中面对显著视角变化和外观变化时缺乏足够目标信息，导致对应鲁棒性不足。论文希望引入文本描述提供的视角与外观不变语义，作为视觉线索的互补信息。

Result: 在Ego-Exo4D和HANDAL-X两个基准上进行大量实验，TeSCo取得state-of-the-art结果，并大幅优于其他模型，验证了方法的有效性。

Insight: 论文宣称的创新点在于利用目标文本语义增强CVOC，并通过TCF进行文本引导的跨模态融合，以及用ITFR基于搜索视图信息迭代精炼文本特征。客观来看，将VLM生成的目标描述作为视角/外观不变先验，并让文本语义感知搜索视图后与视觉特征融合，是提升复杂跨视角对应鲁棒性的有效思路。

Abstract: Cross-view object correspondence (CVOC) aims to establish associations of the same target between query and search videos captured from different viewpoints. Existing methods often rely on visual cues for CVOC. Despite recent progress, these methods struggle in complicated scenarios with substantial viewpoint changes and appearance variations, due to lacking sufficient target information. Addressing this, we introduce TeSCo, a framework that exploits rich Textual Semantics of an object, in addition to its visual cues, for cross-view object Correspondence. Our key insight is, textual description of a target, by capturing diverse attributes such as category, texture, and color, provides viewpoint- and appearance-invariant semantics, which are complementary to visual cues and can hence enhance correspondence robustness in complicated scenes. Inspired by this, TeSCo first generates a textual expression of the target from the given query view using a vision-language model, and then extracts textual feature to enhance visual features for localization in the search view. To realize this, we introduce a text-conditioned cross-modal fusion (TCF) module that incorporates the textual feature into visual features with text-guided modulation, producing more robust multimodal target representation for object correspondence. Since not all textual cues are equally compatible with the target in current search-view frame, we propose an iterative textual feature refinement (ITFR) module that progressively adjusts textual feature using search-view information before the TCF module, enabling search-view-aware textual semantics to be fused into visual features and leading to better performance. In extensive experiments on Ego-Exo4D and HANDAL-X, TeSCo demonstrates state-of-the-art results and largely outperforms other models, validating its efficacy. Our code is released at https://github.com/VAIL-Fan/TeSCo.

[181] GEAR: Generative Editing for Scene-Conditioned Outfit Retrieval for VR Travel cs.CVPDF

Gia-Huy Dinh, Thinh-Phuc Nguyen, Thanh-Hai Nguyen, Lam-Huy Nguyen-Ngoc, Hoang-Bach Nguyen-Phan

TL;DR: 论文研究面向VR旅行等交互式3D环境的场景条件服装检索，用户自我中心视图作为查询信号。提出GEAR框架，不直接预测服装与场景的兼容性，而是用VLM描述适合服装、指令引导扩散模型在标准参考角色上渲染概念、裁剪服装区域后通过嵌入相似度检索已有2D服装资产，并实现Unity实时原型。

Details

Motivation: 虚拟环境中选衣需与周围场景协调，但3D环境视图与服装目录资产之间存在跨域视觉鸿沟，直接视觉匹配难以桥接。论文旨在利用场景上下文完成更合适的服装资产检索。

Result: 在受控数据集上采用自动瑞士制成对评判，GEAR取得有竞争力的排名表现：mean Elo@5为1012.75、top-10 overlap为0.180、成对一致率0.539。20个虚拟旅行场景的用户研究中，GEAR在视觉吸引力和情境适合性上均获最高整体偏好（各34.5%）。

Insight: 创新点在于用生成式编辑合成中间视觉查询来桥接场景与服装目录的跨域差距，而非直接预测兼容性；结合VLM语义描述、扩散渲染到标准化参考角色和嵌入检索。客观看，其可借鉴之处是将生成模型作为检索前的跨域语义对齐与查询构造器，并落地到实时3D交互原型。

Abstract: In virtual environments, choosing appropriate outfits requires contextual harmony with surrounding scenes, yet bridging the visual gap between 3D ambient views and catalog garment assets remains challenging. This paper investigates scene-conditioned outfit retrieval for interactive 3D environments, where a user’s egocentric view serves as the retrieval signal. We present GEAR (Generative Editing for Asset Retrieval), a framework that bridges the cross-domain gap by synthesizing intermediate visual queries rather than predicting direct compatibility. GEAR uses a vision-language model to describe suitable clothing from a captured scene, employs an instruction-guided diffusion model to render the concept onto a standardized reference character, and utilizes the cropped clothing region to retrieve existing 2D outfit assets via embedding similarity. An interactive Unity prototype demonstrates real-time scene capture, asset retrieval, and in-engine 3D avatar fitting. We benchmark GEAR against direct visual similarity, aesthetic scoring, and VLM-based reranking on a controlled dataset using automated Swiss-system pairwise judgments, where GEAR achieves competitive top-ranked performance (mean Elo@5 of 1012.75 and top-10 overlap of 0.180) alongside 0.539 pairwise agreement. Furthermore, a user study across 20 virtual travel scenes demonstrates that GEAR achieves the highest overall participant preference in both visual appeal (34.5%) and contextual suitability (34.5%).

[182] IMUdrape: Generating Garment-Mounted Virtual IMU Data from Text through Physics-Based Cloth Simulation cs.CV | cs.HCPDF

Zikang Leng, Thomas Plötz

TL;DR: 论文提出 IMUdrape，从文本描述生成人体运动，并通过基于物理的布料仿真生成安装在服装上的虚拟 IMU 数据。该方法将目标服装从照片重建为缝纫版型，在真实部署的传感器位置放置虚拟 IMU，并利用无穿透接触求解器仿真服装运动，从而同时得到配对的服装信号与身体信号。

Details

Motivation: 惯性传感器逐渐被集成到服装中，但服装上的传感器会随布料滑动、扭转和摆动，不再刚性跟随身体运动，且不同服装差异明显。此类模型需要与部署服装匹配的标注训练数据，而真实数据稀缺；现有虚拟 IMU 生成方法通常将传感器刚性附着于身体，无法模拟服装安装传感器的额外运动。

Result: 在四个带服装安装传感器的真实数据集上，IMUdrape 在活动识别和全身姿态估计上优于现有虚拟数据方法。仅使用一个真实受试者时，其数据使识别 macro-F1 相比仅真实数据提升 7% 至 46%，相比同一动作的身体安装虚拟数据提升 2% 至 11%；在记录运动上仿真服装时，无真实训练数据的姿态误差相比生成运动降低 30% 至 33%，且服装数据比身体数据准确率仍高 12%。

Insight: 创新点在于将文本到运动生成、基于物理的服装仿真、从照片重建缝纫版型以及真实传感器位置放置结合起来，生成服装安装虚拟 IMU 数据，并提供配对的服装与身体信号。客观来看，其可借鉴之处是用物理布料仿真显式建模服装与身体的非刚性耦合，并通过无穿透接触求解提升虚拟传感器数据的真实性，从而减少服装传感应用对真实标注数据的依赖。

Abstract: Inertial sensors are moving into clothing, from sensorized sportswear to garments instrumented with hundreds of IMUs. Sewn into clothing, a sensor no longer moves rigidly with the body: loose fabric slides, twists and swings, so a garment-mounted sensor records the motion of the fabric as well as that of the body, and this extra motion differs from one garment to the next. Models for such sensors need training data recorded with the deployed garment, yet labeled data are scarce. Virtual IMU data generated from videos or text have eased this scarcity for body-attached sensors, but existing generators attach their virtual sensors rigidly to the body. We present IMUdrape, which generates garment-mounted virtual IMU data from text through physics-based cloth simulation. IMUdrape synthesizes motion from activity descriptions, reconstructs the target garment as a sewing pattern from photographs, places virtual IMUs at the deployment’s real sensor positions, and simulates the garment with an intersection-free contact solver, so that every simulation yields paired garment and body signals. On four real datasets with clothing-mounted sensors, IMUdrape improves on existing virtual-data approaches for both activity recognition and full-body pose estimation. With one real subject, its data improve recognition macro-F1 by 7% to 46% over real data alone and by 2% to 11% over body-mounted virtual data from the same motion. When the garment is simulated on recorded motion, the pose error without any real training data falls by 30% to 33% relative to generated motion, and garment data remain 12% more accurate than body data. IMUdrape thus reduces the amount of real data that garment-mounted sensing requires.

[183] Blueprint2CAD: Benchmarking Foundation Models on Engineering Drawing-to-CAD Render Correspondence cs.CVPDF

Alexander Valverde, Danny Xie-Li, Zhichao Wang, Marcos V. Conde

TL;DR: 论文提出 Blueprint2CAD，一个用于工程图纸到 CAD 渲染对应关系的基准，任务是在给定正交线图和通常来自不同视角的着色渲染时，判断二者是否表示同一零件。作者构建了 BlueCAD-30K 数据集，包含 29,925 个 Zero-to-CAD 模型的多视角渲染、干净/带尺寸图纸及表面类型元数据，并评测冻结编码器检索和零样本视觉语言模型验证能力。

Details

Motivation: 工程图纸是机械零件的重要表达形式，识别图纸对应零件对零件搜索、设计复用和数字化很关键，但此前缺少公开基准来衡量视觉模型是否具备这种图纸-渲染对应能力。

Result: 冻结编码器在 10,000 模型库中检索，已知视角时 Recall@1 最高约 65%，未知视角时约 43%，四个编码器差距在 6 个百分点内；六个零样本视觉语言模型验证准确率仅 0.52-0.67，且存在 Yes/No 偏差，LoRA 微调仅提升几个点但会加剧偏差且未解决视角失败问题。

Insight: 主要创新是构建公开的图纸到 CAD 渲染对应基准及大规模数据层，并系统评测基础模型；客观看，其价值更在于揭示视角是主要瓶颈、VLM 存在验证偏差等诊断性发现，而非提出强性能方法。

Abstract: Engineering drawings specify mechanical parts through orthographic projections. Recognizing which part a drawing depicts underlies part search, design reuse, and digitization, yet no public benchmark measures whether vision models can do it. We introduce Blueprint2CAD, a benchmark for drawing-to-render correspondence: given an orthographic line drawing and a shaded render, usually from another viewpoint, decide whether they show the same part. Its data layer, BlueCAD-30K, applies an open drafting pipeline to 29,925 Zero-to-CAD models, adding view-aligned renders, clean and dimensioned drawings from six viewpoints, and surface-type metadata. Frozen encoders retrieve the matching part from a 10,000-model gallery with up to 65% Recall@1 when viewpoints are known but 43% when they are not, and the four encoders we test lie within six points of each other: viewpoint, not backbone, is the bottleneck. Six zero-shot vision-language models reach only 0.52-0.67 verification accuracy, with model-specific Yes/No biases that chain-of-thought shifts but does not remove; a quick LoRA fine-tuning on in-domain pairs improves verification accuracy by a few points but sharpens these biases and leaves the viewpoint failure intact.

[184] Gnomon4D: Learning Where and When to Focus for Geometric Motion-Grounded World-Action Modeling cs.CVPDF

Lingwei Dang, Yan Zhou, Juntong Li, Zhenhao Zhang, Yiteng Chen

TL;DR: 论文提出Gnomon4D，一种世界-动作模型（WAM），联合生成未来视频、机器人动作和视频对齐的4D几何运动场（GeoDelta），编码实体与物体点的跨帧图像平面位移和深度变化。引入交互显著注意力（InSAttn）和转移锚定聚合（TransAgg）来聚焦任务相关交互区域和运动变化。将GeoDelta作为共享的人-机器人准动作进行无动作预训练，随后机器人中期训练，在多个基准上超越基线。

Details

Motivation: 现有WAM中RGB未来纠缠外观与物理状态，逐帧深度/点图缺乏时间对应，现有4D方法运动隐含或需单独接口转动作。需要一种能显式表示与动作相关的几何运动关系的方法。

Result: 在RoboTwin 2.0、VLABench、RoboDojo上领先，分布内和分布外分别比最强真实机器人基线高7.0和16.0个百分点。

Insight: 创新点：GeoDelta作为视频对齐的4D几何运动场，将实体运动与物体响应置于共享空间；InSAttn和TransAgg利用运动关系聚焦交互区域和变化时刻；GeoDelta提供共享人-机器人准动作用于无动作预训练。客观分析：通过显式几何运动场连接视觉预测与动作，解决RGB纠缠和深度缺乏时序对应问题，且利用人类数据预训练增强泛化。

Abstract: World-action models (WAMs) use video-generation priors to jointly predict future observations and robot actions. Yet RGB futures entangle physical state changes with appearance, while frame-wise depth and point maps lack temporal correspondence. Existing 4D approaches either keep motion implicit in visual features or translate predicted traces into actions through a separate interface. We present Gnomon4D, a WAM that jointly generates future video, robot actions, and GeoDelta, a video-aligned 4D geometric motion field encoding the cross-frame image-plane displacement and depth change of embodiment and object points. By placing embodiment motion and object responses in a shared space, GeoDelta exposes their motion relations to the action expert at inference. Interaction-Salient Attention (InSAttn) uses these relations to focus spatial readout on task-relevant interaction regions, while Transition-Anchored Aggregation (TransAgg) aggregates evidence around changes in their relative motion, such as grasp and release. GeoDelta describes surface motion independently of embodiment-specific controls, providing a shared human–robot quasi-action for action-free pretraining on EgoManip-5000H followed by robot mid-training on Robot-30H. Gnomon4D leads on RoboTwin~2.0, VLABench, and RoboDojo, and outperforms the strongest real-robot baseline by 7.0 and 16.0 percentage points under in-distribution and out-of-distribution settings, respectively.

[185] QFacePlacement: From Arbitrary Tensorization to Semantic Spatial Correspondence in Modern Face Verification cs.CV | cs.LGPDF

Krishna Bhatia, Kavita Choudhary, Pruthwik Mishra, Praveen Kumar Chandaliya

TL;DR: 论文研究量子启发的张量化方法在现代人脸验证中的有效性，通过两个控制接口（跨模型嵌入对齐和局部描述子对应张量）实验表明，张量网络压缩在特定结构下可减少参数但未必提升低误接受性能，需同时关注聚合AUC和低FAR指标。

Details

Motivation: 现代人脸验证嵌入优化为余弦相似度，单纯张量化不能建立张量列或MPO所需的低秩结构，论文旨在探究量子启发因子分解在何种接口下可信。

Result: 在64K参数预算下，密集Ridge方向AUC为0.9297，优于低秩MPO的0.8685；局部张量列用122参数达LFW AUC 0.9802，但低FAR性能差（CFP-FP上TAR=0.0102 vs 全局余弦0.1734）。

Insight: 创新点在于系统评估张量化接口，指出任务对齐轴和可压缩结构是关键，并强调聚合AUC必须与操作低FAR指标并重评估。

Abstract: Quantum-inspired computer vision often reshapes high-dimensional features into tensors and applies tensor-network models. In face verification, this can be misleading: modern embeddings are optimized for cosine similarity, and tensorization alone does not establish the low-rank structure needed for tensor trains or matrix-product operators (MPOs). We study model placement through two controlled interfaces. First, cross-model embedding alignment requires a 512 x 512 operator to map AdaFace embeddings into ArcFace space. Dense Ridge and Procrustes mappings remain strong, while deterministic TT-SVD and MPO compression underperform even with basis changes and low-rank residuals. At a 64K-parameter storage budget, mean directional AUC is 0.9297 for dense Ridge, 0.8952 for rank-64 SVD, 0.8685 for the best low-rank-MPO hybrid, and approximately 0.649 for raw MPO. Second, before global pooling, we construct a 7 x 7 x 7 x 7 probe-gallery correspondence tensor from local AdaFace descriptors. A geometry-aware symmetric tensor train with bond dimension 2 uses 122 trainable parameters, compared with 2,403 for a dense linear matcher, while attaining an LFW AUC of 0.9802. Yet compression does not translate into better low-false-acceptance performance: on CFP-FP, TAR at FAR = 0.001 is 0.0102 versus 0.1734 for global cosine matching, and on CPLFW it is 0.7805 versus 0.8737. These results suggest that quantum-inspired factorization is most credible when the chosen interface provides task-aligned axes and compressible structure. They also show why aggregate AUC must be assessed alongside operational low-FAR metrics.

[186] Latent Spectral Prompting for Multimodal Hyperspectral Object Tracking cs.CV | cs.AIPDF

Wangshu Cai, Jun Zhou, Lei Wang, Mohammad Aminul Islam, Xu Han

TL;DR: 论文提出 SProTrack，一个面向高光谱视频目标跟踪的多模态框架。它通过潜在光谱提示（latent spectral prompting）将预训练 RGB 跟踪器中的时序建模能力迁移到高光谱域，并利用自监督方式从无标签高光谱数据中学习光谱信息。方法将时序建模与光谱适应解耦，以全局场景级光谱表示指导光谱提示提取，从而在无需大量重训练和密集标注的情况下桥接 RGB 与高光谱模态差距。

Details

Motivation: 高光谱视频在伪装、低照度等复杂场景下具有鲁棒跟踪潜力，但高光谱标注有限且 RGB-高光谱域差距大，导致现代时序预训练 RGB 跟踪器难以直接使用。论文旨在解决如何复用 RGB 基础模型的时序知识，同时有效利用高光谱光谱信息的问题。

Result: 在 HOT2020 和 HOT2023 数据集上的实验表明，SProTrack 取得最佳整体性能，并在所有光谱域上均有较强结果。

Insight: 主要创新在于解耦时序建模与光谱适应：时序动态继承自预训练 RGB 跟踪器，光谱适应通过自监督学习全局场景级潜在表示完成。相比丢弃大部分光谱信息的波段选择方法或依赖局部搜索裁剪的提示方法，SProTrack 用自编码器从全高光谱帧学习紧凑潜在光谱提示，以较低监督和重训练成本桥接模态差距。

Abstract: Hyperspectral videos provide rich spectral signatures for robust tracking under challenging conditions such as camouflage and low illumination. However, limited hyperspectral annotations and the large RGB-hyperspectral domain gap hinder the direct use of modern temporally pretrained RGB trackers. We propose SProTrack, a multimodal framework that transfers temporal knowledge from pretrained RGB trackers to the hyperspectral domain through latent spectral prompting. The key idea is to decouple temporal modeling from spectral adaptation, allowing temporal dynamics to be inherited from RGB foundation models while hyperspectral information is learned from unlabeled data in a self-supervised manner. Unlike band-selection methods that discard most spectral information or prompt-based approaches that rely on local-search crops, SProTrack learns a global, scene-level spectral representation from the full hyperspectral frame using an autoencoder. This latent representation is used to guide spectral prompt extraction while a pretrained RGB tracker preserves strong temporal modeling on RGB-compatible inputs. By encoding spectral-spatial structure into compact latent prompts, SProTrack bridges the RGB-hyperspectral modality gap without extensive retraining or dense supervision. Experiments on HOT2020 and HOT2023 demonstrate that SProTrack achieves the best overall performance, with strong results across all spectral domains.

[187] MedHEB: Benchmarking Medical Embeddings Across Heterogeneous Clinical Evidence cs.CVPDF

Yingshu Li, Shaoyang Zhou, Zhanyu Wang, Yunyi Liu, Xinyu Liang

TL;DR: 论文提出 MedHEB，一个面向医学嵌入的统一检索基准，包含来自54个数据集的107个检索任务，覆盖2D图像、3D体数据和文本三种证据形式，以及图像-图像、图像-文本、文本-文本和跨模态视觉匹配等配对类型，并区分全局、问题条件和区域级相关性粒度。作者在统一排序协议下评测代表性模型，并提供基于MLLM的参考嵌入模型MedEmb作为可复现基线。

Details

Motivation: 临床证据本质上是关系型的，医学图像常需结合既往检查、跨模态检查、报告和局部发现来检索相关证据；现有嵌入评测多关注孤立匹配，难以判断模型能否跨模态、外观和粒度变化检索到有临床意义的证据。

Result: 在MedHEB上，代表性模型在不同检索任务族之间表现不均衡：在传统图像-文本或文本-文本检索上较强的模型，在跨模态视觉匹配和区域级任务上可靠性较低；当前嵌入空间尚未实现跨异质证据的均衡检索。

Insight: 创新点在于构建覆盖多证据形式、多配对类型和多相关性粒度的统一医学检索基准，并引入留出来源评测和区域级文本到区域检索；同时提供MedEmb作为统一2D-3D-文本医学检索的可复现基线，推动临床有意义医学嵌入研究。

Abstract: Clinical evidence is inherently relational: medical images are interpreted with prior studies, cross-modal examinations, reports, and localized findings, and retrieving relevant evidence is therefore central to clinical interpretation. Recent foundation models increasingly encode these heterogeneous sources into shared embedding spaces, yet existing embedding evaluation often focuses on isolated matches, leaving unclear whether current models retrieve relevant evidence across changes in modality, appearance, and granularity. We introduce MedHEB, a unified benchmark with 107 retrieval tasks from 54 datasets, including both in-distribution and held-out-source evaluation, across three axes: evidence form (2D images, 3D volumes, text), pairing type (image–image, image–text, text–text, and modality-bridging visual matching), and relevance granularity (global, question-conditioned, region-level). Under a single ranking protocol, MedHEB varies clinically relevant evidence definitions to test whether embedding proximity remains meaningful across heterogeneous evidence, including modality-bridging visual retrieval and region-level text-to-region retrieval. Across representative models, performance is uneven across retrieval families: models strong on conventional image–text or text–text retrieval are less reliable on modality-bridging and region-level tasks. Current embedding spaces capture some clinical relationships well but do not yet provide balanced retrieval across heterogeneous evidence. We further provide MedEmb, an MLLM-based reference embedding model trained on the MedHEB ID split, as a reproducible baseline for unified 2D–3D–text medical retrieval. We release MedHEB with preprocessing scripts, evaluation code, access manifests, and MedEmb to support research on clinically meaningful medical embeddings.

[188] INTERACT: Learning Interaction-Aware World Dynamics from Driving Videos for Autonomous Driving cs.CVPDF

Zhan Chen, Songyan Zhang, Wenhui Huang, Zirui Li, Zhidong Wang

TL;DR: 论文提出INTERACT三阶段框架，从无标注驾驶视频中学习基于slot的对象中心世界模型，并将其迁移到自动驾驶轨迹规划。该方法先无监督学习时序场景实体表示，再推断潜在自车动作并预测未来实体演化，最后蒸馏到轨迹规划器指导轨迹生成与选择。

Details

Motivation: 现有端到端驾驶模型多将场景编码为密集视觉或BEV特征，使对象级交互隐式化；而安全自动驾驶需要预测周围交通参与者在自车运动下如何演化。

Result: 在NAVSIM和nuScenes上的大量实验验证了有效性，尤其在NAVSIM上达到SOTA，并在安全关键碰撞指标上取得提升。

Insight: 创新点在于无对象标注学习slot级对象中心世界模型、从视频转移中推断潜在自车动作并以动作条件预测未来slot，再将世界模型知识蒸馏到规划器；客观看，其价值在于显式建模对象交互与动作条件动力学，并实现无标注视频到规划的有效迁移。

Abstract: Safe autonomous driving requires more than recognizing the current scene: the ego vehicle must anticipate how surrounding traffic participants will evolve under its own motion. However, existing end-to-end driving models typically encode scenes into dense visual or BEV features, leaving object-level interactions implicit. We propose (INTERACT INTERaction-aware Action-Conditioned Trajectory learning), a three-stage framework that learns a slot-based object-centric world model from unlabeled driving videos and transfers it to trajectory planning. INTERACT first learns recurrent slots that group dense visual features into temporally structured scene-entity representations without object annotations. It then infers latent ego actions from slot context and video transitions, and uses them to condition future slot prediction, capturing how ego motion and surrounding entities co-evolve. Finally, the learned slots, latent actions, and future slot predictions are distilled into a trajectory planner to guide trajectory generation and selection. Extensive experiments on NAVSIM and nuScenes validate the effectiveness of INTERACT. In particular, it achieves state-of-the-art performance on NAVSIM, with improvements in safety-critical collision metrics.

[189] PixelBench: Can LLMs Understand and Generate Images Pixel by Pixel? cs.CV | cs.CL | cs.LGPDF

Haoquan Zhang, Feiyang Liu, Juanxi Tian, Wanhua Li, Haodong Duan

TL;DR: 论文提出 PixelBench，用于评估 LLM 能否不依赖学习的图像 tokenizer/decoder，直接通过现有词表按像素生成图像，并同时评测像素级理解能力。基准涵盖多分辨率下的文本到像素（T2P）和图像到像素（I2P）生成，模型需先输出 RGB 调色板，再输出每个像素对应调色板索引的网格。论文还提出 Pixel Reconstruction Tuning（PRT），将 caption-palette-grid 轨迹加入视觉指令微调，并在 Molmo2-4B 上验证其作为辅助监督的有效性。

Details

Motivation: 现有 LLM 可通过 SVG、CAD 等符号格式生成视觉内容，但这些表示依赖高层图元而非显式栅格像素值。论文关注 LLM 是否能利用已有词表直接生成像素图像，从而避免额外学习图像 tokenizer 或解码器。

Result: 最强模型在 T2P 中可直接从文本生成可识别图像；在 I2P 低分辨率下优于调色板匹配下采样和专用像素化算法。像素理解性能与生成性能强相关，分辨率缩放研究显示生成性能常先提升、在高分辨率下下降。PRT 后训练的 Molmo2-4B 在 16 个视觉中心基准上均有提升。

Insight: 创新点在于提出无需学习图像 tokenizer/decoder 的像素级生成与理解基准，并采用“RGB 调色板+索引网格”的显式像素表示。客观看，其可借鉴之处是将显式像素重建作为视觉指令微调的辅助监督，并通过多分辨率评测揭示 LLM 直接像素生成的能力边界与分辨率缩放规律。

Abstract: Large language models (LLMs) can generate visual assets through text-based formats such as SVG and CAD, but these symbolic representations describe images using high-level primitives rather than explicit raster values. We ask whether LLMs can instead generate pixel images directly through their existing vocabulary, without a learned image tokenizer or decoder. We introduce PixelBench, a benchmark for text-to-pixel (T2P) and image-to-pixel (I2P) generation across multiple resolutions, together with a complementary pixel-understanding evaluation. Models generate an RGB color palette followed by a grid of indices specifying the palette color of each output pixel. In T2P, the strongest models produce recognizable images directly from text. In I2P, the strongest models outperform palette-matched downsampling and specialized pixelization algorithms at low resolutions. Pixel-understanding performance correlates strongly with generation performance. A resolution-scaling study shows that pixel-generation performance often improves initially before declining at high resolutions. Finally, we introduce Pixel Reconstruction Tuning (PRT), which augments visual instruction tuning with caption-palette-grid trajectories. We post-train Molmo2-4B from its pretraining checkpoint by mixing general instruction data with our curated PRT data, improving performance across 16 visual-centric benchmarks, indicating that explicit pixel reconstruction can provide useful auxiliary supervision.

[190] SeMo3D: Unifying 3D Generation, Editing, and Completion via Selective Modeling cs.CVPDF

Xiaokun Sun, Jian Yang, Zhenyu Zhang

TL;DR: 论文提出 SeMo3D，将 3D 生成、编辑和补全统一为“选择性建模”范式：三者的共同点都是合成指定区域并保持其余内容不变。方法通过区域选择性去噪训练和多条件 3D 扩散 Transformer Omni3DiT，实现无需成对编辑/补全数据的联合学习，并支持图像、文本、点云等多模态控制。

Details

Motivation: 现有方法通常把 3D 生成、编辑和补全分别处理，即使只需修改局部区域也会重建完整资产，导致任务割裂、未修改内容不一致以及对任务专属成对数据的依赖。论文希望用一个统一框架解决这三类任务并保持非目标区域不变。

Result: 在三个基准上的实验表明，SeMo3D 在所有任务上均超过现有 SOTA 方法；生成任务具备多模态可控性，编辑和补全任务表现出较强的一致性与准确性，并可作为智能体的统一 3D 建模工具。

Insight: 创新点在于将三类任务统一为“选定区域合成+上下文保持”的选择性建模，并通过区域选择性去噪仅对随机选中的区域加噪和计算损失，从而无需成对编辑/补全数据即可联合训练；Omni3DiT 通过区分待生成与待保留区域并融合图像、文本、点云引导，实现细粒度多条件控制。

Abstract: 3D generation, editing, and completion are typically treated as regenerating the complete 3D asset under task-specific constraints, even when only a local region needs modification. This leads to task isolation, inconsistency in content that should remain unchanged, and dependence on task-specific paired data. We address these issues with a key observation: the three tasks all synthesize a designated region while keeping the rest intact—the full region for generation, the target region for editing, and the missing region for completion. We term this paradigm Selective Modeling and build SeMo3D upon it; it naturally unifies the three tasks, preserves unchanged content by construction, and enables training without paired editing or completion data, since any 3D asset can be partitioned into a selected region and its context. For training, we propose region-selective denoising, which randomly selects regions of varying sizes on standard 3D assets and applies noise and loss only to them, jointly learning all three tasks. For architecture, we propose Omni3DiT, a multi-condition 3D diffusion transformer that distinguishes regions to create from those to retain and fuses image, text, and point guidance for fine-grained control. Experiments across three benchmarks show SeMo3D surpasses state-of-the-art methods on all tasks, delivering multimodal controllability in generation and strong consistency and accuracy in editing and completion. SeMo3D further serves as a unified modeling tool for agents, enabling efficient 3D creation through natural-language interaction. Project page: https://xiaokunsun.github.io/SeMo3D.github.io/.

[191] SMILE: A Structured Multi-Agent Clinical Reasoning for Liver Ultrasound Understanding cs.CV | cs.CL | cs.LGPDF

Haris Ghafoor, Minjee Seo, Seonaeng cho, Keungmo Yang, Jaejun Lee

TL;DR: 论文提出SMILE，一个面向肝脏超声理解的结构化多智能体临床推理框架，用于自动生成临床结构化的肝脏超声报告。该方法让图像解释、临床阶段推理和VQA三个专门智能体分别分析超声图像，再由裁判VLM通过共识过滤机制汇总为统一且临床连贯的输出。

Details

Motivation: 现有生成式视觉语言模型通常采用单一推理路径，将超声表现直接映射为文本描述，难以应对视觉语言模态差距、细微视觉证据、疾病模式异质以及配对监督有限等问题。

Result: 在公开肝脏超声数据集和内部临床数据集上，SMILE均优于现有SOTA VLMs，ROUGE-1最高提升19.0%，临床F1最高提升18.8%，VQA F1分别达到0.82和0.65。

Insight: 创新点在于用多个互补专家智能体分别负责形态描述、临床阶段推理和定向VQA，并通过裁判VLM的共识过滤机制整合与审查输出；客观上看，其价值在于将结构化多智能体推理和共识机制引入数据稀缺、监督有限的临床超声报告生成场景。

Abstract: Automated liver ultrasound report generation improves the diagnosis of liver diseases by producing clinically structured descriptions of anatomical and disease-related findings. However, current generative vision-language models (VLMs) often rely on a single reasoning pathway that maps ultrasound appearance directly to textual descriptions. In addition to the inherent vision-language modality gap, this design is limited for liver ultrasound because disease interpretation is constrained by subtle visual evidence, heterogeneous disease patterns, and limited paired supervision. To address these limitations, we propose SMILE, a Structured Multi-agent clInicaL rEasoning framework that uses multiple complementary specialist agents to interpret ultrasound images and consolidates their outputs through a judge-guided consensus mechanism. Our approach employs three specialized agents: an image interpretation agent for morphological descriptions, a clinical-stage reasoning agent, and a visual question answering (VQA) agent for targeted queries. These agent responses are then aggregated and scrutinized by a judge VLM using a consensus filtering prompt to produce a unified, clinically coherent output. Across a public liver ultrasound dataset and an internal clinical dataset, SMILE consistently outperforms state-of-the-art VLMs, achieving up to 19.0% improvement in ROUGE-1 and 18.8% improvement in clinical F1-score, while reaching VQA F1-scores of 0.82 and 0.65 on public and internal datasets, respectively. These results demonstrate the potential of SMILE for data-scarce and limited-supervision clinical settings. Our models, datasets, and code are available \href{https://github.com/CMME-Lab/SMILE}{here}.

Haifa Zhang, Yijing Wang, Zhiqiang Zuo

TL;DR: 论文提出 ReinSeg，一种面向3-D道路异常分割的检索引导有界多模态细化框架。它利用LiDAR鸟瞰图占用单元从8张环视图像共享记忆中检索场景特定上下文，并通过相对范数有界残差将视觉上下文注入LiDAR点特征，在保持冻结LIDO异常评分接口的同时仅用分布内语义标签优化。

Details

Motivation: 3-D道路异常分割需将稀疏观测的危险排在大量正常道路结构之前，并保持点级度量定位；LiDAR提供准确3-D点支撑，环视图像提供互补语义上下文，用于区分意外危险与困难正常结构。

Result: 在STU基准上，验证集平均精度从27.54%提升至35.67%，95%异常召回下误报率从34.85%降至10.61%，高召回筛选点从6754万降至2055万；相对REL，AP高24.99个百分点，FPR95低0.99个百分点，运行速度21.8 FPS，并在相机缺失、损坏或错位时仍高于仅LiDAR性能。

Insight: 摘要宣称的创新点是检索引导的多模态细化、无需向检索模块提供标定变量、相对范数有界残差以保留冻结异常评分接口，以及仅用分布内语义标签优化。客观看，其可借鉴之处在于用有界残差安全融合场景特定视觉证据，并在多模态输入退化时保持LiDAR基线鲁棒性。

Abstract: 3-D road anomaly segmentation is essential for risk-aware perception in autonomous driving. Its central challenge is to rank sparsely observed hazards ahead of abundant normal road structures while preserving point-wise metric localization. LiDAR provides accurate 3-D point support, whereas surround-view imagery offers complementary semantic context for separating unexpected hazards from challenging normal structures. We propose ReinSeg, a retrieval-guided bounded multimodal refinement framework for point-wise road anomaly segmentation. Occupied LiDAR bird’s-eye-view cells retrieve scene-specific context from a shared memory of eight surround-view images without supplying calibration variables to the retrieval module. A relative-norm-bounded residual returns this context to the LiDAR point features, so the frozen LIDO anomaly-scoring interface is preserved, and the refinement is optimized with in-distribution semantic labels only. On the Spotting the Unexpected (STU) benchmark, ReinSeg improves validation average precision from 27.54% to 35.67% and reduces the false-positive rate at 95% anomaly recall from 34.85% to 10.61%, shrinking the high-recall screening set from 67.54 to 20.55 million points. Relative to REL, AP is 24.99 percentage points higher and FPR95 is 0.99 points lower. Matched interfaces and component isolation show that retrieved scene imagery and the relative-norm bound are both essential, and ReinSeg stays above LiDAR-only performance under missing, corrupted, or misaligned camera inputs while running at 21.8 frames per second. These results establish bounded retrieval of scene-specific visual evidence as an effective route to reliable 3-D road-hazard perception.

[193] Computer Vision Applications for Art History: Reflections and paradigms for future research cs.CV | cs.CY | cs.DLPDF

Amalia Foka

TL;DR: 论文反思艺术史与计算机视觉交叉研究中方法使用与艺术史核心问题脱节的问题，提出一种从计算机科学视角分析艺术史期刊文章的方法，以识别艺术史学家使用的图像特征，并用计算机视觉社区可理解的术语描述，最后给出面向未来研究的范式建议。

Details

Motivation: 艺术史学家对计算方法存在争议，部分原因是计算研究未触及当今艺术史研究的核心问题；两个研究群体缺乏紧密合作，使得将当代艺术史方法定义为明确的计算机视觉问题十分困难。

Result: 摘要未报告定量实验结果或基准评测，主要贡献是方法论反思、图像特征识别框架以及未来研究范式的提出。

Insight: 论文的创新点在于跨学科方法论：系统分析艺术史期刊文章以提取艺术史学家关注的图像特征，并在艺术史与计算机视觉之间建立术语和问题定义的桥梁；客观来看，其价值更偏向研究议程与跨学科框架设计，而非具体算法模型。

Abstract: One of the contributing factors to the continuing debate among art historians over the use of computational methods in art history research is that they do not consider the core of today’s art history research questions. The lack of close collaboration between the two involved research communities makes the definition of contemporary art-historical methods as well-defined computer vision problems extremely difficult. For that purpose, it is devised as a methodology to study articles in art history journals from a computer science perspective. The objective is to identify which image features art historians utilise within their research and describe them in immediate and meaningful terms to the computer vision research community. Finally, some paradigms that could serve as a new starting point for exploring how computer vision applications for art history can address the core of today’s art history research are given.

[194] Probe-Guided Gradient Balancing for Multimodal Learning cs.CV | cs.AIPDF

Vu Vo, Haytham M. Fayek, Thuy Nguyen

TL;DR: 论文提出 Probe-Guided Gradient Boosting（PGGB），用于缓解多模态联合训练中强模态主导、弱模态利用不足的问题。PGGB 通过在各模态 stop-gradient 特征上附加轻量线性分类器，独立估计表示质量，并以利用率差距作为不平衡信号，对弱模态梯度进行有界且平滑的调制。方法不改变损失函数和融合结构，可与现有抑制强模态的方法组合。

Details

Motivation: 多模态联合训练中，学习较快的强模态会主导共享融合目标并抑制弱模态梯度，导致弱模态利用不足。现有方法多通过抑制强模态来平衡，但直接增强弱模态往往失败，因为基于联合损失的监测信号仍被强模态主导。

Result: 在覆盖 4 个领域、2 至 4 个模态的 8 个 benchmark 上，PGGB 在高度不平衡多模态数据集上优于 SOTA 方法，在低不平衡或可忽略不平衡场景下保持竞争力；论文还给出了有界缩放、自衰减及标准 SGD 下降界等理论分析。

Insight: 论文宣称的创新点是用探针分类器独立估计各模态表示质量，以利用率差距指导弱模态梯度增强，而非单纯抑制强模态。客观来看，其创新在于将不平衡监测信号与联合损失解耦，并通过有界平滑的梯度调制实现可组合的多模态优化，同时提供理论保证。

Abstract: Jointly trained multimodal networks frequently underutilize weaker modalities, as faster-learning modalities dominate the shared fusion objective and suppress gradients reaching slower ones. Most existing approaches throttle dominant modalities, whereas directly boosting weaker modalities often fails because monitoring signals derived from the joint loss remain dominated by stronger modalities. We propose Probe-Guided Gradient Boosting (PGGB), a gradient modulation approach that boosts weaker modalities while preserving the strength of dominant ones. PGGB attaches lightweight linear classifiers to stop-gradient features from each modality to estimate representation quality independently. The gap between these scores, termed the utilization gap, provides an imbalance signal used to adaptively scale weaker-modality gradients through bounded and smoothed modulation. PGGB is composable with throttling methods, as it leaves the loss function and fusion architecture unchanged. Experiments across eight benchmarks spanning four domains and 2-4 modalities demonstrate that PGGB outperforms state-of-the-art methods on highly imbalanced multimodal datasets while remaining competitive under low or negligible imbalance. We further establish bounded scaling, self-attenuation, and a descent bound for standard SGD under smoothness and bounded-variance assumptions. Code is available at https://github.com/VuVoCodes/PGGB.

[195] OctreeSplat: Hierarchical Octree-Guided Feed-Forward Gaussian Splatting cs.CVPDF

Yibin Zhao, Yihan Pan, Wenli Yang, Jun Nan, Jianjun Yi

TL;DR: 论文提出OctreeSplat，一种分层八叉树引导的前馈高斯泼溅方法，用于新视角合成与3D重建。它从冻结视觉基础模型提取多视图特征和几何先验，构建分层八叉树并预测致密化分数，从而按局部复杂度以空间变化密度分配高斯基元。方法还引入随机实体体积渲染和可选测试时优化，在多个数据集上实现有竞争力的RGB视图合成、深度合成和表面重建。

Details

Motivation: 前馈3DGS方法虽避免逐场景优化，但固定图像或空间分辨率限制了根据局部复杂度分配高斯基元的能力。论文旨在实现空间自适应的前馈高斯基元分配，提高重建质量并减少冗余。

Result: 在Replica、TUM、Tanks and Temples和DTU上，OctreeSplat在RGB视图合成、深度合成和表面重建方面取得有竞争力的结果，同时减少高斯基元数量并保持高质量重建。训练仅更新7600万额外参数，耗时35 GPU小时。

Insight: 创新点在于将分层八叉树引导引入前馈高斯泼溅，利用冻结VFM的多视图特征和几何先验预测致密化分数，实现按局部复杂度动态分配基元；随机实体体积渲染增强深度渲染和几何监督，可选TTO提升相机参数一致性。客观来看，其核心创新是层次化空间自适应基元分配，有助于降低前馈3DGS的冗余。

Abstract: 3D Gaussian Splatting (3DGS) has shown considerable potential for novel view synthesis (NVS) and 3D reconstruction. Feed-forward methods avoid costly per-scene optimization, but fixed image or spatial resolutions limit their ability to allocate primitives according to local complexity. We present OctreeSplat, a hierarchical octree-guided feed-forward Gaussian splatting. OctreeSplat extracts multi-view features and geometric priors from a frozen visual foundation model (VFM), constructs a hierarchical octree, and predicts densification scores. The resulting representation allocates Gaussian primitives at spatially varying densities according to local complexity. Stochastic solids volume rendering improves depth rendering, strengthens geometric supervision, and supports surface reconstruction. When camera parameters are available, an optional test-time optimization (TTO) module improves agreement between predicted and ground-truth parameters. Training updates only 76 million additional parameters and requires 35 GPU-hours. Experiments on Replica, TUM, Tanks and Temples, and DTU demonstrate competitive RGB view synthesis, depth synthesis, and surface reconstruction. OctreeSplat reduces the number of Gaussian primitives while maintaining high reconstruction quality.

[196] PriCBMs: Multi-granular Concept Bottleneck Vision-Language Models for Visual Privacy Recognition cs.CVPDF

Shenglei Pei, Haotian Sun, Pengfei Li, Bingxu Lu, Wenlong Yu

TL;DR: 论文面向多标签视觉隐私识别，提出PriCBMs，将隐私相关概念作为中间语义表示，通过视觉-概念匹配识别类别相关隐私线索，并基于概念响应进行隐私类别预测。为提升概念质量，设计了基于目标类别相关性、跨类别判别性和语义多样性的概念选择策略，并引入全局-区域建模模块兼顾局部隐私证据与全局上下文。

Details

Motivation: 社交媒体图像分享使视觉隐私识别需求增加，但多标签隐私识别存在两个问题：隐私类别与视觉对象并非一一对应，直接预测缺乏显式隐私线索指导；隐私线索常分散在局部区域，整图特征难以充分表达。

Result: 在VISPR和FineViP两个数据集上，PriCBMs在所有四个多标签评价指标上均优于所评估的对比方法；消融实验和概念质量分析验证了所提设计的有效性。

Insight: 创新点在于将概念瓶颈模型引入视觉隐私识别，以隐私概念作为可解释中间表示连接视觉线索与隐私标签；同时结合目标相关性、跨类别判别性和语义多样性进行概念选择，并通过全局-区域建模捕捉局部隐私证据，提升多标签隐私识别的可解释性与特征表达能力。

Abstract: Widespread image sharing on social media has increased the need for visual privacy recognition to identify inadvertently exposed privacy information. However, multi-label visual privacy recognition presents two challenges. First, privacy categories represent high-level semantic attributes and do not have a one-to-one correspondence with visual objects. Different visual objects may involve the same privacy category, while the same type of object may contain different types of privacy-sensitive information. In this setting, direct prediction methods generally lack explicit guidance for identifying category-relevant privacy cues, leaving this process implicit in the learned image-to-label mapping and potentially limiting classification performance. Second, privacy cues are often distributed across image regions and may not be adequately represented by whole-image features. To address these challenges, we propose Privacy Concept Bottleneck Models (PriCBMs). By introducing privacy-related concepts as intermediate semantic representations, PriCBMs first identify category-relevant privacy cues through visual-concept matching and then predict privacy categories based on concept responses. This process makes privacy predictions more interpretable. To improve the quality of these concepts, we design a concept selection strategy based on target-category relevance, cross-category discriminability, and semantic diversity. Meanwhile, we introduce a global-region modeling module to capture localized privacy evidence while retaining global context. Experiments on VISPR and FineViP show that PriCBMs outperform evaluated competitors across all four multi-label metrics. Ablation studies and concept-quality analyses support the effectiveness of the proposed design. Code is available at https://github.com/sun2293674491-dotcom/PriCBMs.

[197] TME-ContextNet: Class-Conditioned Spatial Supervision and Grouped Decoding for Joint Nuclei Instance Segmentation and Classification cs.CVPDF

Rukang Ma, Bingxue Wang, Liwen Zou, Yingying Cao, Zhenghua Cai

TL;DR: 论文提出TME-ContextNet，一个用于细胞核实例分割与分类联合任务的多任务框架。该方法利用类别条件空间监督从现有细胞核标注中学习密集空间上下文，并将解码器按几何相关任务和语义任务分组，以减少冗余计算。模型在PanMix、CoNSeP和PanNuke上验证了分割与分类性能，并以较少参数量取得有竞争力的结果。

Details

Motivation: 联合细胞核实例分割与分类需要精确边界和邻域信息来区分形态相似的细胞类型，同时希望减少额外组织区域标注需求和冗余计算。

Result: 在PanMix、CoNSeP、PanNuke上Dice分别为80.23%、65.32%、79.13%，mPQ+分别为67.62%、35.50%、43.74%，其中PanNuke为三个测试折平均；模型参数量36.40M，低于HoVer-Net的54.74M。

Insight: 创新点包括用欧氏距离变换将细胞核标签扩展为类别条件密集空间监督且无需额外组织标注，引入膨胀卷积与自注意力结合的局部-全局上下文模块，以及按几何/语义任务分组的解码器降低冗余计算；空间头仅训练时使用、推理时省略，形成紧凑且上下文感知的联合分析框架。

Abstract: Joint nuclei instance segmentation and classification requires precise boundaries and neighborhood information that helps distinguish morphologically similar cell types. We present TME-ContextNet, a multi-task framework that learns class-conditioned spatial context from existing nuclear annotations and organizes decoding into geometry-related and semantic task groups. Class-conditioned spatial supervision extends nuclear labels into a dense target using Euclidean distance transforms, requiring no additional tissue-region annotation. We derive its nearest-region interpretation and characterize its stability to small annotation perturbations. A local–global context module combines dilated convolution and self-attention, while a grouped task decoder reduces redundant computation. The spatial head supplies training supervision and is omitted during inference. Experiments on PanMix, CoNSeP, and PanNuke yield Dice scores of 80.23%, 65.32%, and 79.13%, and mean multi-class panoptic quality (mPQ+) scores of 67.62%, 35.50%, and 43.74%, respectively. PanNuke results are averaged across three test folds. Target and decoder controls support the combination of distance-based supervision and grouped decoding while identifying their dependence on task configuration. The framework uses 36.40 million parameters, compared with 54.74 million for HoVer-Net. These findings support a compact, context-aware formulation for joint nuclei analysis in computational pathology.

Minh Ta Tran Nhat, Yuning Ye, Yuseok Ban

TL;DR: 论文提出DyGCN，一种面向骨架动作识别的几何约束动态超图卷积网络。其核心DyGCT模块包含GeoHC和CSR：GeoHC利用几何约束的二阶兼容性动态构建动作特定超边，CSR通过原型对比学习细化成对兼容性分数，且仅在训练阶段使用。实验在NTU RGB+D、NTU RGB+D 120和Northwestern-UCLA上验证有效性并达到SOTA。

Details

Motivation: 传统GCN受限于成对关节建模，难以捕获人体运动中的高阶关节交互；现有超图方法多依赖解剖先验的静态结构，缺乏对动态、动作特定关节相关性的建模灵活性。

Result: 论文在NTU RGB+D、NTU RGB+D 120和Northwestern-UCLA三个常用骨架动作识别基准上进行了实验，摘要称其达到state-of-the-art性能，但未给出具体数值。

Insight: 创新点在于用几何约束的二阶兼容性动态构建动作特定超边，并以原型对比学习在训练阶段细化兼容性分数，从而获得更具判别性的超边且不增加推理开销；客观上可借鉴的是将动态超图构建与训练期对比分数精炼相结合。

Abstract: Skeleton-based action recognition is a pivotal task in computer vision; however, conventional Graph Convolutional Networks (GCNs) are often constrained by pairwise joint modeling, which fails to capture the intricate high-order interactions inherent in human movement. While recent hypergraph-based methods attempt to address this limitation, they typically rely on static structures derived from anatomical priors, lacking the flexibility to capture dynamic, action-specific joint correlations. To this end, we propose DyGCN, a Geometry-Constrained Dynamic Hypergraph Convolutional Network for skeleton-based action recognition. At the core of DyGCN is the Dynamic Hypergraph Construction Network with Contrastive Score Refinement (DyGCT) block, which comprises two novel components: the Geometry-Constrained Dynamic Hypergraph Construction (GeoHC) module and the Contrastive Score Refinement (CSR) module. Specifically, GeoHC dynamically constructs action-specific hyperedges by leveraging geometry-constrained second-order compatibility, transcending the limitations of static hyperedge structures. Furthermore, CSR explicitly refines the pairwise compatibility scores during hypergraph construction through prototype-based contrastive learning, fostering more discriminative action-specific hyperedges, with zero inference-time overhead as CSR operates only during training. Extensive experiments on NTU RGB+D, NTU RGB+D 120, and Northwestern-UCLA validate the effectiveness of DyGCN, achieving state-of-the-art performance on widely used benchmarks. The source code is available at https://github.com/marvineta0405/DyGCN.

[199] Discovering Semantic Granularity in Images through Clustering of Pretrained Visual Representations cs.CVPDF

Ying Dai

TL;DR: 论文提出一种无需语义监督的方法，通过聚类预训练视觉表征发现图像中不同粒度的语义区域。方法包括从预训练模型提取特征图并拼接，利用SVD投影得到像素级主表征图（PRMs），并引入语义连续性率（SCR）和信噪比（SNR）来评估表征的多粒度语义发现能力。在COCO-2017和VOC-2012验证集上取得了有竞争力的分割性能。

Details

Motivation: 探究预训练视觉表征是否内在编码了多粒度语义结构，以及如何无需语义监督地发现这些语义粒度，弥补现有理解不足。

Result: 在COCO-2017和VOC-2012验证集上，使用匈牙利匹配的交并比（HIoU）评估，所提方法在比较方法中取得了有竞争力的分割性能，证明了通过聚类PRMs发现有用语义粒度的可行性。

Insight: 创新点在于提出PRMs（通过SVD投影提取像素级主表征）以及SCR和SNR分析来量化语义粒度。客观分析认为，利用预训练表征的隐含语义结构进行无监督语义分割，并提供评估表征多粒度语义能力的新指标，具有借鉴意义。

Abstract: Semantic granularity, which refers to the levels at which visual representations organize image content into meaningful entities, is fundamental to image understanding. However, whether pretrained visual representations inherently encode semantic structures at multiple granularities remains poorly understood. This paper presents a representation-driven approach for discovering semantically meaningful image regions at different granularities through clustering of pretrained visual representations without semantic supervision. Specifically, we concatenate selected feature maps extracted from a pretrained visual model and apply a singular value decomposition (SVD)-based projection to derive pixel-wise principal representation maps (PRMs). The resulting PRMs capture implicit semantic structures embedded in pretrained visual representations, making them accessible to subsequent semantic clustering. We then introduce the semantic continuity rate (SCR), based on the silhouette principle, to quantify the coherence of pixel-wise representations within and between clusters at different candidate granularities. Furthermore, we analyze the signal-to-noise ratio (SNR) of SCR profiles to assess representation suitability for discovering semantic regions at multiple granularities. Our results indicate that PRMs exhibiting higher SNR values over an initial range of cluster numbers tend to yield more semantically meaningful regions across multiple granularities. We evaluate the proposed approach on the COCO-2017 and VOC-2012 validation datasets using Hungarian-matched intersection over union (HIoU). The results demonstrate competitive segmentation performance among the compared methods, supporting the feasibility of discovering useful semantic granularities through clustering PRMs without semantic supervision.

[200] 3L-D: A Low-Light Level Dataset from a Sensor-Agnostic, Alignment-Preserving Acquisition Framework cs.CV | cs.DBPDF

Léo Rueff, Maurgène Ghezal, Valentin Gorse, Astrid Dufaure, Esteban Monsalvo

TL;DR: 论文提出了3L-Dataset，一个基于传感器无关、对齐保持采集框架的低光照图像和视频数据集。该数据集通过物理校准模拟从满月（约1000 mlx）到无月阴天（约0.1 mlx）的标准夜晚亮度等级，覆盖可见光到近红外光谱，并保证同步六元组的亚像素对齐。论文还评估了多个深度学习基线，揭示了在严重光子饥饿下重建保真度、感知质量与推理延迟之间的权衡。

Details

Motivation: 现有低光照增强数据集依赖不受控环境、相机参数调整或中性密度滤镜，无法复现真实的夜空近红外光谱和低光子噪声分布；动态配对序列采集存在扭曲伪影和传感器偏差。因此需要新的采集框架和数据集。

Result: 构建了3L-Dataset，覆盖多个夜晚亮度等级和多样环境，使用高精度机械 actuation 实现亚像素对齐。评估多个深度学习基线，揭示了在极端低光下保真度、感知质量和延迟的权衡。未提及具体SOTA，但提供了基准测试结果。

Insight: 创新点包括模块化、传感器无关的采集框架，物理校准复现标准夜晚亮度，保证亚像素对齐无需后处理，以及可扩展性。客观分析，该数据集提供了更真实的低光照条件和精确对齐，可能推动低光照增强特别是视频的研究。

Abstract: Supervised low-light image and video enhancement has achieved remarkable progress, yet current models remain fundamentally constrained by the limitations of existing datasets. Prevailing methods typically rely on uncontrolled ambient captures, camera parameter manipulation (e.g., exposure or ISO adjustments), or neutral density filters, failing to replicate authentic night-sky near-infrared spectral content and genuine low-photon noise distributions. Furthermore, capturing dynamic paired sequences without introducing warping artifacts or sensor-specific biases remains an open challenge. In this paper, we introduce 3L-Dataset, a physically calibrated low-light image and video dataset generated using a modular, sensor-agnostic acquisition framework. Our test bench faithfully reproduces the standardized Midavaine night level scale from Level 1 (full moon, approximately 1000 mlx) down to Level 5 (overcast moonless night, approximately 0.1 mlx), spanning the visible to near-infrared spectrum across diverse realistic environments, including countryside, forest, urban, and desert scale models. Using high-precision programmable mechanical actuation, our acquisition framework guarantees sub-pixel spatial alignment across synchronized sextuplets, each composed of one reference image and five corresponding images acquired at the five standardized night levels, without post-processing image warping. We evaluate multiple representative deep learning baselines across varying night levels, revealing critical trade-offs between reconstruction fidelity, perceptual quality, and inference latency under severe photon starvation. The modular acquisition framework can be adapted to different cameras, optical systems, sensor technologies, and resolutions, enabling the dataset to be continuously expanded.

[201] MoviEdit: Long-form Multi-Shot Video Editing Made Easy cs.CV | cs.AI | cs.LGPDF

Suhyeon Lee, Zhengang Li, Soo Ye Kim, Peihao Zhu, Jong Chul Ye

TL;DR: 论文提出 MoviEdit，一个面向长时长多镜头视频编辑的端到端框架，联合解决跨镜头一致性、长视觉上下文处理、训练数据与评测问题。方法先用轻量双向阶段在压缩时空表示上生成全局连贯草稿，再自回归传播并细化到完整视频，同时构建自动数据生成流程和专门 benchmark。

Details

Motivation: 长视频多镜头编辑中，场景、视角和主体外观会突变，但仍需保持编辑意图跨镜头一致，且视觉上下文远长于单镜头编辑；现有方法在数据、建模和评测上都不足。

Result: 论文构建了 87K 对无人工标注的配对编辑视频，并推出 MoviEdit-Bench。实验表明 MoviEdit 在文本引导和图像引导编辑上显著优于现有开源模型，并与工业前沿模型表现相当。

Insight: 创新点在于数据、模型和评测一体化：自动生成多视角/真实多镜头/生成式多镜头监督数据；采用级联双向-自回归架构兼顾全局一致性与长视频细化；并提出多镜头长视频编辑 benchmark。客观看，其跨镜头一致性与可扩展长上下文建模思路较有借鉴价值。

Abstract: Long-form multi-shot video editing requires an intended edit to remain coherent across abrupt changes in scene, viewpoint, and subject appearance, while processing substantially longer visual context than conventional single-shot editors. We introduce MoviEdit, an end-to-end framework for scalable long-form multi-shot video editing that jointly addresses the challenges of data, modeling, and evaluation. To provide cross-shot supervision data at scale, we develop automatic data-generation pipelines spanning synchronized multi-view footage, real-world multi-shot videos, and generated multi-shot content, yielding 87K paired editing videos without manual annotation. Architecturally, MoviEdit employs a cascaded bidirectional-autoregressive design: a lightweight bidirectional stage first establishes a globally coherent editing draft over a spatiotemporally compressed representation, which is then autoregressively propagated and refined over the full video. We further introduce MoviEdit-Bench, a dedicated benchmark for systematic evaluation of long-form multi-shot video editing. Extensive experiments show that MoviEdit substantially outperforms existing open-source models and performs on par with industry frontier models across text-guided and image-guided editing. Visit our project page for complete results and to access the benchmark: https://multi-shot-edit.github.io/

[202] DINOFAS: Bonafide-Centric Representation Learning for Face Anti-Spoofing cs.CV | cs.AI | eess.IVPDF

Shakeel Muhammad Ibrahim, Muhammad Sohail Ibrahim, Muhammad Shahid Jabbar, Shujaat Khan

TL;DR: 论文提出DINOFAS，将人脸活体检测（FAS）建模为以真实人脸为中心的表征学习框架。方法基于DINOv3，结合LoRA参数高效适配、注意力风格-内容解耦模块（ASCD）以及分离原型活体学习与攻击语义监督的双分支架构，并通过原型目标、攻击语义分类损失和正交正则联合优化。

Details

Motivation: 现有FAS模型容易学习与攻击类型和数据集相关的线索，导致在未见采集条件和呈现攻击下泛化性能下降；论文希望学习更本质的真实人脸表征以提升跨域和跨攻击泛化能力。

Result: 在OCIM留一域协议下平均HTER为9.09%；仅在SynthASpoof训练并测试四个真实数据集时，取得最低平均HTER 21.41%和最高平均AUC 86.14%；在OULU-NPU和SiW-Mv2上也表现出对采集条件、设备和未见攻击的鲁棒性。

Insight: 创新点包括以真实人脸为中心的任务建模、DINOv3的LoRA高效适配、ASCD解耦风格与内容以减少域外观变化，以及双分支结构将原型活体学习与攻击语义监督分离并进行联合优化。客观上，其可借鉴之处在于利用强预训练视觉表征并结合域解耦和原型学习提升FAS泛化性。

Abstract: Face anti-spoofing (FAS) models often learn attack- and dataset-specific cues that degrade performance under unseen acquisition conditions and presentation attacks. We present DINOFAS, a DINOv3-based framework that formulates FAS as bonafide-centric representation learning. The proposed framework combines parameter-efficient DINOv3 adaptation using low-rank adaptation (LoRA), an attention style-content disentanglement (ASCD) module for reducing domain-specific appearance variations, and a dual-branch architecture that separates prototype-based liveness learning from attack-semantic supervision. The model is jointly optimized using a bonafide-centric prototype objective, an attack-semantic classification loss applied to detached features, and orthogonality regularization. DINOFAS achieves an average HTER of 9.09% under the standard OCIM leave-one-domain-out protocol, where training is performed on three source datasets and evaluation is conducted on the held-out unseen domain. We further evaluate synthetic-to-real generalization by training exclusively on SynthASpoof and testing on four unseen real-world datasets, where DINOFAS achieves the lowest average HTER of 21.41% and the highest average AUC of 86.14% among the compared methods. Evaluations on OULU-NPU and SiW-Mv2 additionally demonstrate robustness to variations in acquisition conditions, devices, and unseen presentation attacks.

[203] Trace4D: Grounded Spatiotemporal Reasoning via 4D State Sequences cs.CVPDF

Wooseok Jang, Seungryong Kim, Yan Lu, Lei Ji

TL;DR: 论文提出Trace4D，训练视觉语言模型直接从视频预测按时间排序的4D状态序列，并对其相邻时间步变化与视觉观察进行联合推理，形成4D接地的思维链。模型在推理时无需参考标注或外部几何模型，并在Trace4D-Bench和VLM4D上提升了问答准确率。

Details

Motivation: 现有VLM在视角变化下难以理解物体及其空间关系如何随时间在3D空间中演化；已有方法虽引入几何信息，但缺乏对时序4D状态演化及其作为中间证据的显式监督。

Result: 在Trace4D-Bench和VLM4D上，Trace4D相比基座VLM取得更高的问答准确率，并表明对4D状态变化和时间视觉观察进行推理能带来收益；摘要未给出具体数值或SOTA声明。

Insight: 创新点在于用4D状态序列作为显式中间表示构建4D接地CoT，并将时间步间变化与视觉上下文连接为答案证据；同时构建约60万4D感知和约7万接地QA样本，采用监督微调加几何感知GRPO训练，且推理阶段不依赖参考标注或外部几何模型。

Abstract: Understanding how objects and their spatial relationships evolve in 3D space over time remains challenging for vision-language models (VLMs), particularly under changing viewpoints. Recent approaches incorporate geometric information into reasoning, but explicit supervision for temporally ordered 4D state evolution and its use as intermediate evidence remains limited. We introduce \textbf{Trace4D}, which trains VLMs to predict 4D state sequences and reason over their inter-timestep changes alongside temporal visual observations. Its 4D-grounded chain-of-thought (CoT) explicitly represents 4D states, analyzes temporal visual context, and connects both as evidence for the answer. We construct Trace4D-Train from in-the-wild videos with 600K 4D perception examples and approximately 70K grounded QA examples, and train with joint supervised fine-tuning followed by geometry-aware GRPO. At inference, Trace4D predicts 4D states and reasoning directly from video without reference annotations or an external geometric model. Experiments on Trace4D-Bench and VLM4D show improved QA accuracy over the base VLMs and benefits from reasoning over 4D state changes and temporal visual observations.

[204] Unlocking the Potential of Vision Foundation Models for Multi-Task Dense Prediction via Mixture of Task Adapters cs.CVPDF

Yunzhi Zhuge, Xinzhuo Yu, Sitong Gong, Lu Zhang, Pingping Zhang

TL;DR: 论文针对视觉基础模型在多任务密集预测中因语义先验与密集任务偏差冲突导致的负迁移问题，提出D2MoE框架，在冻结的DINOv3主干上通过任务通用低秩适配与任务自适应专家混合实现两级适配，并引入语义先验注入器增强多任务特征一致性。

Details

Motivation: 现有联合微调或单路径适配器会把多任务竞争梯度压入同一更新通道，造成负迁移和跨任务一致性不稳定，因此需要同时保留基础模型先验并实现任务相关特化。

Result: 摘要称在多种benchmark上取得稳健的多任务性能提升，且可训练参数开销较小；但未给出具体数值或SOTA对比。

Insight: 创新点在于将适配解耦为任务通用共享通道与仅在每阶段最后注意力块注入的稀疏任务条件专家，并用语义先验注入器耦合多级任务特征与冻结基础先验，实现保先验的多任务密集感知。

Abstract: Multi-task dense prediction seeks a single, coherent representation that supports simultaneously discriminative semantic recognition and regularized geometric/structural inference. For vision foundation models, pretrained semantic invariances conflict with the frequency and smoothness biases of dense objectives; joint fine-tuning and single-route adapters therefore compress competing gradients into one update channel, causing negative transfer and unstable cross-task agreement. We frame this as two-level adaptation: task-generic alignment that preserves priors, and task-aware specialization that resolves late-stage conflicts. Based on this principle, we propose D2MoE , a Mixture of Task Adapters that explicitly factorizes these roles within a frozen DINOv3 backbone. D2MoE introduces Task-Generic Low-Rank Adaptation (TG-LoRA) in attention projections throughout the network to provide a stable, shared adaptation channel, and a Task-Adaptive Mixture of Experts (TA-MoE) injected only at the final attention block of each stage to enact sparse, task-conditioned perturbations of token mixing in a single forward pass. A Semantic Prior Injector further couples multi-level task features with frozen foundation priors to reinforce semantic coherence while preserving boundary and structural fidelity. Experiments across diverse benchmarks substantiate that this structured factorization yields robust multi-task improvements with a small trainable footprint, establishing a principled and scalable route to prior-preserving, foundation-centric multi-task dense perception.

[205] Lookahead Prediction-Guided Adaptive Visual Refocusing for Interleaved Multimodal Reasoning cs.CVPDF

Mengzhao Wang, Yanli Ji, Peng Ye

TL;DR: 论文关注交错多模态思维链推理中视觉证据选择滞后的问题，提出无需训练的测试时框架 LPAVR。该方法利用多令牌预测（MTP）解码时目标模型验证得到的最长一致前缀作为前瞻信号，预测下一步推理意图并构建前瞻视觉证据；当历史视觉证据覆盖不足时自适应切换，从而让视觉上下文更好对齐后续推理。

Details

Motivation: 现有交错多模态推理方法主要从历史上下文中选择视觉证据，当推理焦点转移时，历史证据可能仍停留在旧区域，无法覆盖下一步所需视觉信息，论文将这一滞后称为 Temporal Evidence Myopia。

Result: 在多个多模态推理基准上，LPAVR 同时提升了推理准确率和 MTP 投机令牌的接受率；摘要未给出具体数值或明确 SOTA 表述，但声称可联合增强视觉推理与投机解码效率。

Insight: 创新点在于将 MTP 从解码加速机制转化为推理意图的前瞻信号，并利用目标模型验证的一致前缀构造前瞻视觉证据；通过判断历史证据覆盖是否充分来自适应重聚焦，且整体为无需训练的测试时框架，兼具较低落地成本和较好的通用性。

Abstract: Interleaved multimodal chain-of-thought reasoning improves the visual reasoning capabilities of multimodal large language models by dynamically incorporating visual evidence during reasoning. However, existing methods primarily select evidence from historical context. When the reasoning focus shifts, history-guided evidence may remain focused on prior regions and fail to cover the visual information required by the next step. We refer to this lag between visual evidence and subsequent reasoning demands as Temporal Evidence Myopia. To address this issue, we propose Lookahead Prediction-guided Adaptive Visual Refocusing (LPAVR), a training-free test-time framework. LPAVR transforms Multi-Token Prediction (MTP) from a decoding acceleration mechanism into a lookahead signal for anticipating upcoming reasoning intent. During MTP decoding, the draft head generates multiple future tokens, while the target model verifies them in parallel and retains the longest prefix consistent with its decoding trajectory. This target-verified prefix contains near-future semantics, which LPAVR uses to construct lookahead-guided visual evidence and assess whether history-guided evidence covers the indicated regions. If the coverage is sufficient, the history-guided evidence is retained; otherwise, LPAVR switches to the lookahead-guided evidence. This better aligns the visual context with upcoming reasoning and improves consistency between draft predictions and target-model decoding. Experiments on multiple multimodal reasoning benchmarks show that LPAVR improves both reasoning accuracy and the acceptance rates of MTP speculative tokens, jointly enhancing visual reasoning and speculative decoding efficiency.

[206] History Forcing: Distilling History-Dependent Continuations for Long-Horizon Video World Models cs.CVPDF

Hangyi Kuang, Chengzhi Wang, Yefei He, Weijie Wang, Yuke Zhao

TL;DR: 论文提出 History Forcing，一种面向少步自回归视频生成/世界模型的同策略蒸馏框架，通过利用历史上下文校正教师监督目标，增强长时推演中的历史一致性与场景记忆。方法将含历史上下文与不含历史上下文的教师预测残差加权注入分数或速度预测，引导学生对齐校正目标，从而在主体或场景离开视野后重新出现时保持状态一致。

Details

Motivation: 少步自回归视频扩散虽高效，但长时滚动生成中主体或场景离开视野再出现时容易失去一致性；现有蒸馏方法未充分利用更丰富的历史信息来约束学生当前预测。

Result: 在1.3B模型上达到SOTA：15秒视频生成VBench质量分85.07，60秒生成VBench-Long综合分79.82；PlayWorld演化质量从2.35提升至2.70，MemoBench物体一致性从58.43提升至62.18。

Insight: 创新点在于用含/不含信息性历史上下文的教师预测残差解耦历史监督，并构造加权校正的蒸馏目标；历史上下文可来自低漂移的早期生成块或固定视角教师推演，从而将长程历史约束显式融入少步自回归生成。

Abstract: Few-step autoregressive video diffusion enables efficient generation, yet maintaining consistency over long rollouts remains challenging, especially when subjects or scenes reappear after going out of sight. Despite progress in fidelity and rollout robustness, existing distillation methods do not fully exploit richer historical information to constrain the student’s current prediction. To address this gap, we introduce \textbf{History Forcing}, a unified on-policy distillation framework that strengthens historical supervision for few-step autoregressive video generators. The framework uses the residual between teacher predictions with and without informative historical context to decouple this supervision. Such a historical context can be obtained using earlier generated chunks with less accumulated drift or a fixed-view teacher rollout that keeps the scene visible while the student looks away. The residual is then weighted and added to the score or velocity prediction used for distillation, forming a corrected target. By aligning the student with this corrected target through distillation, History Forcing incorporates long-range historical constraints into autoregressive generation. Our method achieves state-of-the-art performance among 1.3B models, with a VBench quality score of 85.07 for 15s video generation and a VBench-Long aggregate score of 79.82 for 60s generation. For out-of-sight world modeling, evaluations further demonstrate more plausible scene evolution and more consistent states when the camera returns, with Evolution Quality improving from 2.35 to 2.70 on PlayWorld and Object Consistency from 58.43 to 62.18 on MemoBench.

[207] OmniOPD: Stable On-Policy Distillation for Joint Audio-Video Generation cs.CV | cs.AI | cs.SDPDF

Zihao Fan, Xin Lu, Jie Huang, Hexin Zhang, Xueyang Fu

TL;DR: 论文提出OmniOPD，一个面向联合音视频生成的模态级在线策略蒸馏框架，用于将专门的音频和视频RL教师能力稳定迁移到统一学生模型。针对跨模态token数量不平衡导致音频监督稀疏、蒸馏不稳定的问题，方法通过非对称噪声调度、分组多噪声采样和时间步重要性加权来平衡并稳定音视频联合蒸馏。

Details

Motivation: 联合音视频生成中，音频与视频奖励异构且模态特定，直接RL优化易产生跨模态干扰；现有OPD虽可缓解该问题，但音频token远少于视频token，导致音频监督稀疏和训练不稳定。简单提高音频损失权重无效，因为音频学习依赖视觉上下文。

Result: 在JavisBench和VBench上评估，OmniOPD在保持音频质量的同时显著提升视频生成，实现了有效的联合蒸馏；摘要未给出具体定量数值或明确SOTA对比。

Insight: 创新点在于从模态不平衡和视觉上下文依赖出发设计稳定OPD：用非对称噪声调度为音频教师提供更干净的视频上下文以生成更 informative 的目标，用分组多噪声采样扩大音频监督覆盖，并用基于教师-学生转移散度的时间步重要性加权抑制不可靠监督。可借鉴之处是联合模态蒸馏中应利用强模态上下文补偿弱模态稀疏监督，并对教师信号进行动态可靠性加权。

Abstract: Reinforcement learning (RL) elevates joint audio-video generation, but optimizing heterogeneous, modality-specific audio and video rewards often introduces cross-modal interference. On-policy distillation (OPD) alleviates this issue by transferring the capabilities of specialized audio and video RL teachers into a single student model. However, a significant imbalance in cross-modal token counts leaves audio with sparse supervision, causing unstable distillation. We observe that naively increasing the audio loss weight fails to solve this problem since audio learning relies heavily on visual context, indicating richer visual cues are crucial to offset sparse audio signals. To address this, we propose OmniOPD, a modality-wise on-policy distillation framework designed for balanced and stable audio-video generation. First, we construct privileged visual information using asymmetric noise scheduling, allowing the audio teacher to generate more informative targets from cleaner video context. Second, we introduce grouped multi-noise sampling to expand audio supervision coverage and stabilize training. Third, we introduce timestep-wise importance weighting based on teacher-student transition divergence, preserving reliable supervision while down-weighting unreliable learning signals, to stabilize fluctuations in audio learning. Evaluated on JavisBench and VBench demonstrate OmniOPD preserves audio quality while significantly enhancing video generation, achieving effective joint distillation.

[208] Disen-Forcing: Disentangling Semantic Anchoring from Motion for Autoregressive Video Diffusion cs.CV | cs.LGPDF

Zhengyang Yu, Akio Hayakawa, Masato Ishii, Qingtao Yu, Xuesong Li

TL;DR: 论文研究自回归视频扩散模型在长时程生成中因暴露偏差导致性能退化的问题，重新审视现有frame sink策略后发现长程一致性并非由LLM式attention sink维持，而是由稀疏注意力头负责语义锚定、多数头关注局部时序动态。为此提出Disen-Forcing，一种蒸馏阶段插件，通过解耦上下文路由和运动解耦正则强化注意力头分工，从而同时改善长视频生成的一致性与运动动态。

Details

Motivation: 现有AR-VDMs在推理时程超过训练时程后性能快速下降，常用frame sink保留初始帧作为上下文来稳定长时程生成，但该策略会过度条件化所有注意力头，导致蒸馏时运动向教师的低动态模式塌缩。

Result: 在长时程视频生成benchmark上，Disen-Forcing可同时提升基础AR-VDMs的长程一致性和运动动态，缓解了sink类方法难以平衡的trade-off；摘要未给出具体定量指标。

Insight: 核心创新在于揭示frame sink的作用机制并非LLM式attention sink，而是注意力头的稀疏语义锚定与局部时序分工，并据此提出解耦上下文路由与运动解耦正则，以蒸馏插件形式强化头 specialization，兼顾长程一致性与运动动态。

Abstract: Autoregressive video diffusion models (AR-VDMs) enable real-time, long-horizon video generation but degrade rapidly once the inference horizon outruns the training horizon, due to compounding exposure bias. To stabilize long rollouts, recent methods heuristically adopt frame sink, keeping initial frames as a persistent model context, inspired by attention sinks in LLMs. We revisit this design and find that the mechanism by which initial frames stabilize long-range consistency in AR-VDMs is not an LLM-style attention sink; instead, long-range consistency is anchored through a sparse subset of attention heads, while the majority of heads predominantly capture local temporal dynamics. This observation reveals an over-conditioning pathology in existing frame-sink strategies: by universally exposing every head to the pinned initial-frame context, the model becomes prone to collapsing motion toward the low-dynamic modes of the teacher during model distillation. We propose Disen-Forcing, a distillation-time plug-in for AR-VDMs that disentangles and reinforces this head specialization through disentangled context routing and motion-disentangling regularization. On long-horizon video generation benchmarks, Disen-Forcing simultaneously improves long-range consistency and motion dynamics of base AR-VDMs, a trade-off that sink-based methods fail to balance.

[209] Scaling Action-Free Video Latent Prediction for Transferable Representations in End-to-End Autonomous Driving cs.CVPDF

Xingtai Gui, Xubin Zhou, Yucheng Zhou, Dongqian Guo, Jiahao Gong

TL;DR: 论文研究无动作视频潜变量预测作为端到端自动驾驶的可扩展预训练目标，提出ScaleDrive框架，仅利用大规模互联网开放世界驾驶视频进行预训练，不依赖动作标注或基准特定数据。下游规划训练时冻结预训练视频编码器，以隔离并评估所学表示的可迁移性。实验表明，扩大无动作视频预训练能增强表示中的时序与几何信息，并在多种端到端驾驶策略和闭环基准上持续提升性能。

Details

Motivation: 端到端自动驾驶策略需要同时捕捉空间场景结构和时序动态的有效视觉表示；视频潜变量预测虽有效，但能否通过无动作驾驶视频扩展该目标并真正有利于端到端规划尚不明确。

Result: 摘要未给出具体数值或SOTA结论，但声称ScaleDrive在不同端到端驾驶策略和闭环基准上持续提升下游性能；ego-motion与depth探针显示，扩大无动作视频预训练会逐步增强冻结表示中的时序和几何信息。

Insight: 创新点在于将无动作视频潜变量预测作为可扩展的驾驶表示预训练目标，仅用互联网开放世界驾驶视频且无需动作标注或基准特定数据；下游冻结编码器以隔离表示迁移性，并系统评估跨规划策略架构和闭环评估场景/协议的泛化能力。

Abstract: End-to-end autonomous driving policies require effective visual representations that capture both spatial scene structure and temporal dynamics. Video latent prediction has emerged as an effective paradigm for learning spatiotemporal visual representations, yet it remains unclear whether scaling this objective with action-free driving videos can yield representations that benefit end-to-end planning. We study action-free video latent prediction as a scalable pretraining objective and introduce ScaleDrive, a driving-oriented framework pretrained exclusively on large-scale internet open-world driving videos, without action annotations or benchmark-specific data. We keep the pretrained video encoder frozen during downstream end-to-end planning training to isolate the transferability of representations learned from internet driving videos. Ego-motion and depth probes show that scaling action-free video pretraining progressively strengthens the temporal and geometric information encoded in the frozen representation. We systematically study the visual representation transfer across different end-to-end driving policies and closed-loop benchmarks, where ScaleDrive consistently improves downstream performance and demonstrates that scaling action-free video latent prediction yields representations that generalize across both planning policy architectures and evaluation scenarios and protocols.

[210] Solv3R: 3D Looped Transformer as a Multi-view Solver cs.CVPDF

Jeong-gi Kwak, Andrea Tagliasacchi, Sho Kagami, Yuki Ono, Kwang Moo Yi

TL;DR: 论文提出Solv3R，一个循环Transformer作为多视图几何求解器，能够从当前状态继续迭代求解多视图几何，支持离线重建、增量重建、重定位和流式传输，无需任务特定训练或模块。

Details

Motivation: 经典SfM通过迭代优化逐步细化相机位姿和场景几何，便于扩展和细化；但多数几何基础模型单次前向预测或顺序更新递归状态，难以灵活扩展和细化。

Result: 实验表明，单个学习求解器在离线重建、增量重建、重定位和流式传输等任务上有效，与最先进方法相比具有竞争力，无需任务特定训练或模块。

Insight: 创新点包括：循环Transformer从当前状态继续求解；更新算子独立于迭代次数，可联合更新新旧视图；可缓存已解决视图表示实现高效键值缓存；统一支持多种重建任务。

Abstract: Classical structure-from-motion reconstruction proceeds iteratively, refining camera poses and scene geometry from a current estimate. This allows maps to easily expand without recomputing already computed views, or geometry estimates to improve as more observations are provided. Most geometric foundation models, however, predict entire geometry in a single forward pass or update a recurrent state as frames arrive sequentially, making this expansion and refinement non-trivial. We introduce Solv3R, a looped transformer that learns to continue solving multi-view geometry from its current state. Importantly, its update operator is independent of the iteration count, allowing previously refined and newly introduced views to be jointly updated regardless of how ``solved’’ they are. We train the operator to preserve accurate reconstructions under continued iteration and correct inaccurate states, enabling refinement of fixed image collections and integration of new observations. Representations of solved views can also be cached once and reused as geometric context across iterations, enabling compact and efficient key-value caching. We analyze the solver dynamics and compare it with the state-of-the-art, demonstrating that a single learned solver supports offline reconstruction, incremental reconstruction, relocalization, and streaming without task-specific training or modules. The code and models will be made publicly available at https://ubc-vision.github.io/solv3r/.

Pengwei Liang, Junjun Jiang, Junhui Hou

TL;DR: 论文提出 ProtoFusion，一种协议引导的生成式红外与可见光图像融合框架。它将融合任务建模为协议约束下的生成过程，通过结构化协议明确应保留或抑制的证据及融合结果属性，并利用闭环的协议引导提示精炼学习优化协议。推理时固定优化后的协议直接指导生成，并结合结构化信念构建对残余源不一致进行生成后保守校正。

Details

Motivation: 现有红外与可见光图像融合方法常依赖固定融合算子、手工设计目标或一次性人工提示，难以灵活表达融合意图并处理跨模态冲突。论文希望用结构化协议显式约束融合生成，并通过闭环学习自动精炼提示。

Result: 在标准 benchmark 上，ProtoFusion 提升了定量性能，在美学评价中取得较好结果，并生成视觉连贯的融合输出。摘要未给出具体数据集名称和数值指标。

Insight: 创新点在于将融合意图表示为包含环境状态卡、接地原则和风格配置的结构化协议，并以生成-评估-修正的闭环方式学习提示精炼；同时引入结构化信念构建组织模态可靠性、场景证据和跨模态冲突，用于生成后的保守校正。客观看，其可借鉴之处是把提示/协议从一次性输入转为可学习、可评估和可修正的约束机制。

Abstract: Infrared and visible image fusion integrates complementary information from both modalities to provide a more comprehensive representation of the scene. We propose ProtoFusion, a protocol-guided generative framework for infrared and visible image fusion. Instead of relying on fixed fusion operators, hand-crafted objectives, or manually specified one-shot prompts, ProtoFusion formulates fusion as protocol-constrained generation. It represents fusion intent with a structured protocol, consisting of environment state cards, grounding principles, and a style profile, which explicitly specifies which evidence should be preserved or suppressed and which properties the fused result should satisfy. To optimize this protocol, we introduce protocol-guided prompt refinement, a closed-loop learning framework that iteratively performs generation, evaluation, and revision under multimodal evidence. Once learned, the optimized protocol is fixed at inference time and directly guides fusion generation. To address residual source inconsistencies, we further incorporate structured belief construction, which organizes modality reliability, scene evidence, and cross-modal conflicts into a structured representation for conservative correction after generation. Extensive experiments on standard benchmarks show that ProtoFusion improves quantitative performance, achieves favorable results in aesthetic evaluation, and produces visually coherent fusion outputs. Project Page: {https://erfect2020.github.io/ProtoFusion/}.

[212] PhotoGuider: Composition-Aware Cropping and 360$^{\circ}$ View Framing with Explainable Photographic Assessments cs.CVPDF

Yuan-Kang Lee, Kuan-Lin Chen, Chia-Che Chang, Yu-Lun Liu

TL;DR: 论文提出 PhotoGuider，一种“先度量后取景”的方法，用于 360° 全景场景中的构图感知取景：先用共享的构图特征和轻量学习评分器选择观看方向并裁剪，再输出相机参数以支持原生重渲染，同时由微调 MLLM 生成构图解释。方法在 2D 裁剪基准上取得最高平均 mIoU，并在全景盲评中显著优于两个强基线。

Details

Motivation: 传统图像裁剪默认照片中已有值得保留的构图，只需决定裁剪位置；但 360° 全景中没有保证，必须先发现合适的观看方向，才能进行取景和裁剪。

Result: 在两个标准 2D 裁剪基准上，PhotoGuider 相对真值裁剪取得最高平均 mIoU；在 Poly Haven HDRI 的 100 个全景场景盲评中，120 名参与者将其取景结果排名第一的比例为 53.2%，高于两个强基线的 27.3% 和 19.5%。

Insight: 创新点在于用 Subject、Composition、Aesthetics、Integrity 四类摄影 token 组织共享构图特征，并以紧凑评分器统一完成 360° 方向选择与精细取景；同时结合相机参数输出和测量条件驱动的 MLLM 解释，是首个将全景显式构图方向选择、精细框取和可解释评估结合的方法。

Abstract: Traditional image cropping assumes the photograph already contains the composition worth keeping, and asks only where to crop. A full 360$^{\circ}$ scene offers no such guarantee: the viewing direction in a scene has to be discovered before anything can be framed. We present PhotoGuider, a measure-then-frame method that answers both questions with compact learned scorers over one shared set of composition-aware features. The designed features are extracted using foundation and task-specific vision models and structured into four photographic tokens: Subject, Composition, Aesthetics, and Integrity. Our MLLM explainer is fine-tuned to generate composition-related explanations conditioned on images and measured token assessments. To our knowledge, PhotoGuider is the first method to combine explicit composition-based direction selection in 360$^{\circ}$ panoramas with refined framing, camera-parameter output for native re-rendering, and measurement-conditioned explanations. On two standard 2D cropping benchmarks, PhotoGuider achieves the highest average mIoU performance against ground-truth crops. In a blind ranking study, 120 participants ranked three cropping methods over 100 panoramic scenes from the public Poly Haven HDRI library, placing our framings first in 53.2% of cases, against 27.3% and 19.5% for two strong alternatives. Project page: https://ntuneillee.github.io/research/photoguider/

[213] Comprehensive Evaluation of Monocular and Multi-view 3D Human Pose Estimation Models for Fitness Exercise Analysis cs.CVPDF

Néstor Ortega, Agustín Salgado, Javier Sánchez

TL;DR: 论文在Fit3D健身锻炼数据集上系统评估了单目3D人体姿态估计方法（TCPFormer、PoseMamba-L）和多视角模型（MVGFormer），使用真实关键点及RTMPose、YOLO-Pose生成的2D检测作为输入，并分析三种时间滤波器对预测抖动和运动动态的影响。实验从精度、时间一致性和对不完美2D检测的鲁棒性等维度进行比较，强调在健身动作分析中需联合考虑2D检测质量、时间建模和后处理。

Details

Motivation: 现有3D人体姿态估计方法在标准基准上精度高，但在真实健身锻炼场景下的性能研究不足，且单目与多视角方法的权衡以及时间后处理对时序一致性的改进效果缺乏系统评估。

Result: 在Fit3D数据集上提供了各方法在精度、时间一致性和鲁棒性上的详细对比，揭示了2D检测质量对提升类方法的影响，并比较了Transformer与状态空间时序架构的表现，但未明确给出具体数值或SOTA声明。

Insight: 创新点在于针对健身场景系统评估近期单目与多视角3D姿态估计模型，并联合分析2D检测器质量、时序建模与后处理的影响；客观上为运动分析场景下的姿态估计流程选型提供了实证参考。

Abstract: Three-dimensional human pose estimation has become a fundamental component of computer vision systems for sports analytics, rehabilitation, and motion understanding. Although recent deep learning approaches have achieved remarkable accuracy on standard benchmarks, their performance under realistic sports scenarios remains insufficiently studied. Furthermore, the trade-offs between recent monocular and multi-view approaches, as well as the benefits of post-processing techniques for improving temporal consistency, have not been systematically evaluated on fitness-oriented datasets. This paper evaluates recent state-of-the-art 3D human pose estimation methods on Fit3D, a dataset of synchronized multi-view recordings of a wide variety of fitness exercises with accurate ground-truth annotations. We study two recent monocular lifting approaches, TCPFormer and PoseMamba-L, and a multi-view model, MVGFormer, under a unified evaluation protocol. To investigate the influence of the input data, monocular methods are evaluated using ground-truth keypoints and detections generated by recent 2D pose estimators, RTMPose and YOLO-Pose. Additionally, we analyze the effectiveness of three temporal filters for reducing prediction jitter while preserving motion dynamics. Experimental results provide a detailed comparison of accuracy, temporal consistency, and robustness to imperfect 2D detections across the evaluated methods. Our analysis highlights the impact of detector quality on lifting-based approaches, compares transformer- and state-space-based temporal architectures, and discusses the practical trade-offs between monocular and multi-view systems for fitness motion analysis. Our results show that 2D detection quality, temporal modeling, and post-processing must be considered jointly in pose estimation pipelines for exercise analysis.

[214] One Image Is Enough: Self-Generated Supervision for Personalizing Human Video Diffusion at Test Time cs.CV | cs.GR | cs.LGPDF

Sadman Rakib Pinon, Adamo Orsini, Yanis Falaki, Linlian Jiang, Jacob Kingi

TL;DR: 论文提出一种测试时个性化方法，仅用单张参考图像为姿态驱动的人体视频扩散模型生成缺失的监督信号：先由领域微调的姿态条件生成器在关键姿态合成伪真值帧，再用推理时参考图像采样器筛选身份一致的候选，最后用逐主体低秩适配器在静态片段上训练。无需主体视频、真值或标签。

Details

Motivation: 姿态驱动的人体视频扩散在姿态偏离参考图时难以保持身份，人脸和衣物失真；现有测试时个性化方法需要多姿态主体视频提供监督，但实际中往往只有单张图像可用，因此论文旨在解决单图条件下个性化监督缺失的问题。

Result: 在TikTok和UBC Fashion上，适配后的模型在所有指标上均优于基座模型，逆转了身份保持与运动保真之间的权衡，且仅用单张参考图像就达到或超过使用五张真实帧进行适配的效果。

Insight: 创新点在于用合成的静态关键姿态帧替代真实视频帧提供更有效的个性化监督，并设计推理时参考采样与逐主体低秩适配实现测试时单图个性化；客观看，其将监督生成与适配解耦、利用静态片段传递外观而非运动先验的思路具有借鉴意义。

Abstract: Pose-driven human video diffusion animates a person from a single reference image and a target pose sequence, yet it struggles to preserve identity, rendering the face and garments unfaithfully as the pose departs from it. Personalization is the standard remedy, but its supervision is missing: one image fixes identity at a single pose, while a multi-pose subject video cannot be assumed in practice. Instead, we synthesize the missing supervision. A domain-tuned, pose-conditioned generator produces pseudo-ground-truth frames at selected key poses. An inference-time reference-only sampler steers these candidates toward the subject and keeps the most identity-consistent. A per-subject low-rank adapter then trains on static clips of them, configured from the reference alone, with no subject video, ground truth, or labels. Although lower in fidelity, these synthetic frames supervise more effectively than real ones. Real frames as captured carry motion that erodes the temporal prior, while a static clip conveys appearance alone. On TikTok and UBC Fashion, the adapted model improves the base on every metric, inverts the identity-versus-motion trade-off, and matches or surpasses adaptation on five real frames despite using none. Code and weights are available at https://github.com/SadmanPinon/one-image-is-enough.

[215] Q-CamTuning: A Multimodal Large Language Model for Fine-Grained Quality Reasoning in Livestreaming Camera Tuning cs.CV | cs.AIPDF

Yanchao Bi, Pengfei Chen, Yulong Yan, Qian Zhang, Biao Wang

TL;DR: 论文面向直播摄像头自动调优场景，指出现有图像质量评估（IQA）方法难以区分细微质量差异，且缺乏细粒度解释与调优建议能力。作者构建了FGLive-Comments指令调优数据集，并基于此提出多模态大语言模型Q-CamTuning，通过渐进式感知-证据-引导框架实现质量评分、细粒度图像对排序以及摄像头参数调整建议。

Details

Motivation: 直播摄像头调优需要自动识别图像间细微质量差异，并解释差异、给出可执行的参数调整建议；现有IQA方法在这两方面能力不足。

Result: 实验表明Q-CamTuning在质量评分和细粒度图像对排序上优于现有IQA模型，用户研究也验证了其推荐摄像头调优建议的能力。

Insight: 创新点在于构建包含细粒度图像对偏好、全局/局部视觉证据和参数调整建议标注的指令调优数据集，并提出感知-证据-引导框架将质量推理映射到摄像头参数调整方向；客观上把IQA从单一打分扩展到可解释的细粒度诊断与调优建议生成。

Abstract: With the popularization of livestreaming applications, automatic camera tuning has become indispensable for ordinary users to enjoy high Quality of Experience (QoE). However, the existing Image Quality Assessment (IQA) methods face two challenges in camera tuning. First, they struggle to identify subtle quality difference between images, which is common in camera tuning. Second, the ability to explain fine-grained differences and to provide suggestions for camera tuning are even more lacking. To address these challenges, we first construct FGLive-Comments, an instruction tuning dataset with rich annotations of both preferences for fine-grained image pairs and quality reasoning from global and local visual evidence, which supports selective adjustment recommendations of camera parameters. Based on FGLive-Comments, we develop Q-CamTuning, a multimodal large language model for livestreaming camera tuning. Its progressive perception-evidence-guidance framework learns quality-aware visual representations, enhances fine-grained reasoning with global-local evidence, and maps quality issues to camera-parameter adjustment directions. Extensive experimental results demonstrate that Q-CamTuning outperforms existing IQA models in both quality scoring and fine-grained image pair ranking. User study also validates its ability to recommend camera tuning suggestions.

[216] Efficient Hybrid Distillation: Synergizing Score and Adversarial Objectives for One-Step Diffusion cs.CVPDF

Fei Peng, Junqiang Wu, Haoxian Tan, Jun Zhou, Jie Hu

TL;DR: 论文研究一步扩散模型蒸馏中Score Distillation与Adversarial Distillation的有效协同问题，指出二者分别在高噪声和低噪声区间更有效且互补，进而提出EASD框架，通过区间自适应采样策略让不同目标聚焦各自有效噪声区间，并扩展到基于DiT的Flow Matching模型。

Details

Motivation: 现有混合蒸馏方法多是将不同目标简单组合，尚未充分探索如何有效协同Score Distillation与Adversarial Distillation；论文旨在解决一步扩散蒸馏中不同噪声区间监督不匹配、单一目标存在局限的问题。

Result: 在ImageNet 256×256上，使用SiT-XL/2+REPA模型实现一步生成FID 1.39，摘要称该结果具有前景，并为最大化混合蒸馏潜力提供具体指导。

Insight: 创新点在于揭示Score Distillation与Adversarial Distillation在不同噪声区间的互补性，并提出regime-adaptive sampling策略按区间分配蒸馏目标，从而兼顾全局分布学习与低噪声细节监督，同时缓解对抗蒸馏在高噪声区间的不稳定问题，并将其应用于DiT-based Flow Matching模型。

Abstract: Numerous distillation methods have been developed to accelerate diffusion models. Recent research indicates that hybrid strategies—blending different paradigms—yield superior results compared to single-method approaches. However, current works predominantly rely on a simple combination of objectives, leaving the question of how to effectively synergize them largely underexplored. In this paper, we specifically investigate the synergy between Score Distillation and Adversarial Distillation. We reveal that their operating zones are distinct and complementary: Score Distillation is effective in high-noise regimes for capturing the global distribution yet lacks fine-grained supervision in low-noise regions. Conversely, Adversarial Distillation is effective in low-noise regions but is prone to instability and suffers from discriminator failure when applied to high-noise intervals. Leveraging this insight, we propose Efficient Adversarial Score Distillation (EASD), a framework that synergizes these objectives via a regime-adaptive sampling strategy, directing each objective to focus on its effective interval. We further apply this paradigm to DiT-based Flow Matching models. Empirically, our method achieves a promising one-step FID of 1.39 on ImageNet 256$\times$256 using the SiT-XL/2+REPA model. This work provides a concrete guideline for maximizing the potential of hybrid distillation. Our code and model are available at https://github.com/pf0607/EASD .

[217] VizDAGuide: Misleading Chart Question Answering in Compact Vision Language Models via DAG-Structured Supervision cs.CV | cs.HCPDF

Haiyang Zhang, Sicheng Song, Zixin Chen, Jie Gu, Huiya Ou

TL;DR: 论文提出 VizDAGuide，一种面向误导性图表问答的 DAG 结构监督方法。它将中间推理状态及其依赖关系建模为有向无环图，按角色分配监督权重，并序列化为统一训练目标，支持开放式和多项选择问答的单次推理。实验表明该方法在 Qwen3-VL 和 InternVL3.5 上优于内容与权重匹配的 Linear CoT-SFT 基线。

Details

Motivation: 误导性图表会让视觉语言模型得出与底层数据冲突的结论；现有工作多关注推理时策略，训练时监督仍较少探索，论文旨在补充这一方向。

Result: 在两个 benchmark 上，基于 Qwen3-VL 和 InternVL3.5 的实验均在开放式和多项选择格式上优于内容与权重匹配的 Linear CoT-SFT 基线；过程级评估显示 grounding 和操作执行有提升，消融表明依赖结构与加权监督结合最有效。

Insight: 创新点在于用 DAG 表示中间推理状态及其依赖，并按角色加权监督，再序列化为统一训练目标以实现单次推理；客观看，其价值在于将结构化过程监督引入误导性图表问答，并兼顾多种答案格式。

Abstract: Misleading charts can lead vision-language models to conclusions that conflict with underlying data. Existing work focuses on inference-time strategies, while training-time supervision remains less explored. We present VizDAGuide, a DAG-structured supervision method for misleading-chart question answering. The method represents intermediate reasoning states and their dependencies as a directed acyclic graph, assigns supervision weights according to their roles, and serializes the graph into a unified training target for open-ended and multiple-choice QA with single-pass inference. Experiments on two benchmarks across Qwen3-VL and InternVL3.5 models show improvements over a content- and weight-matched Linear CoT-SFT baseline on both answer formats. Process-level evaluation shows gains in grounding and operation execution, while ablations indicate that dependency structure and weighted supervision are most effective when combined. These results support DAG-structured weighted supervision for misleading-chart question answering.

[218] VLM-as-a-Judge for Person Re-Identification cs.CVPDF

Bessie Dominguez-Dager, Miguel Cazorla, Vincent Lepetit

TL;DR: 论文提出将通用视觉语言模型（VLM）作为“裁判”，以零样本方式对服装变化行人重识别（CC-ReID）中两个专家模型召回的短候选列表进行重排序；并在 CHIRLA 基准的四个场景上验证：冻结的 VLM 重排序能大幅提升 rank-1，且通过仅在两个专家 rank-1 不一致时调用 VLM 的无阈值门控来显著降低计算成本。

Details

Motivation: 服装变化行人重识别任务仍很困难，现有专家方法各有侧重、依赖不同的身份线索，导致在一个基准上领先的方法在另一个基准上失效，缺少稳定占优的方案；作者希望借助通用 VLM 的零样本身份判断能力来弥补专用模型的不足。

Result: 在未参与训练的 CHIRLA 长期 CC-ReID 基准的四个场景上，对两个冻结专家的候选重排序使每个场景 rank-1 均提升，平均比最佳专家高 12.9 个点、比两者最佳朴素集成高 9.4 个点，且无需任何目标数据微调；合并两个专家短列表可匹配或优于仅重排更强专家，成本更低；门控策略减少约 40% 的 VLM 调用与相应算力，rank-1 无显著下降，仅牺牲 1.8–3.8 个点 mAP。

Insight: 创新点在于把通用 VLM 零样本用作身份判别裁判进行重排序，而非微调专用 Re-ID 模型；并从集成学习借用“专家分歧”准则设计无阈值门控，只在 rank-1 不一致时调用 VLM，在保持精度的同时大幅降低 FLOPs 开销。

Abstract: Cloth-changing person re-identification (CC-ReID) is still very challenging, and no method clearly dominates: methods that lead on one benchmark collapse on the others, because they rest on different identity cues. We show that a general-purpose vision-language model (VLM), used zero-shot as a judge for reranking a short candidate list, beats the expert retrieval models it reranks by a wide and consistent margin. On the four scenarios of CHIRLA, a long-term CC-ReID benchmark that no publicly released Re-ID model is trained on, reranking the candidates of two frozen experts raises rank-1 on every scenario, by 12.9 points on average over the best expert and 9.4 over the best naive ensemble of the two, with no component fine-tuned on the target data. Merging both experts’ shortlists matches or beats reranking the stronger expert’s shortlist alone, at lower cost. Introducing a VLM does, however, come at a cost: almost all of the pipeline’s FLOPs are spent on it. We therefore borrow a criterion from ensembling and invoke the VLM judge only where the two experts disagree at rank 1. This threshold-free gate removes 40% of the calls, and a comparable share of total compute, with no significant drop in rank-1, trading 1.8 to 3.8 points of mAP. Judging remains the dominant cost, but on a benchmark where dedicated experts stall, we find a frozen general-purpose model to be the strongest judge of identity. The code is available at https://github.com/bdager/JudgeReID.

[219] GPU-Native Real-Time Textured Mesh Reconstruction with Seam-Aware Multi-View Radiometric Correction cs.CV | cs.GRPDF

Hiroyuki Sato

TL;DR: 论文提出一种GPU原生的实时体视频系统，可从多台RGB-D传感器重建图形兼容的带纹理三角网格。系统将TSDF融合、Marching Cubes、噪声去除、纹理映射、修补和辐射接缝校正等阶段全部驻留GPU，避免中间网格或图像数据回传主机。同时利用固定大小数组表示网格拓扑以支持GPU常数时间邻接访问，并通过每相机低频增益场校正多视角纹理接缝。

Details

Motivation: 现有TSDF系统虽加速了融合和网格提取，但扩展到逐帧带纹理网格时仍会引入CPU网格处理、CPU纹理计算或CPU-GPU阶段间传输，成为实时重建瓶颈；此外多相机纹理映射会带来曝光接缝问题。

Result: 在CMU Panoptic数据集上，该方法在所有测试的体素分辨率和传感器数量下均快于基线，相对CUDA加速的nvblox和CPU版Open3D取得超过一个数量级的峰值加速，并在感知重渲染质量上接近离线带纹理网格基线。

Insight: 创新点在于全GPU常驻的实时带纹理网格重建流水线、固定大小数组的网格拓扑表示以实现GPU常数时间邻接访问和并行网格级操作，以及基于每相机低频增益场并烘焙到纹理图集的接缝感知辐射校正。客观来看，其核心贡献是系统级GPU流水线设计与工程优化，减少主机往返并统一重建与纹理阶段。

Abstract: We present a GPU-native volumetric-video system for real-time reconstruction of graphics-compatible textured triangle meshes from multiple RGB-D sensors. Existing TSDF systems accelerate fusion and mesh extraction, but extending them to per-frame textured meshing adds CPU mesh processing, CPU-side texturing work, or extra CPU-GPU transfers between stages. After input staging, our method keeps the reconstruction and texturing stages (TSDF fusion, Marching Cubes, connected-component noise removal, view-based texture mapping, inpainting, and radiometric seam correction) resident on the GPU; no intermediate mesh or image data returns to the host between these stages. A fixed-size-array representation of mesh topology gives constant-time neighbor access on the GPU and makes the downstream mesh-level operations data-parallel. Because we texture each face from a single camera, exposure seams that vary smoothly across each image remain; we estimate a per-camera low-frequency gain field and bake it into the atlas on the GPU. On the CMU Panoptic dataset, our method is faster than the baselines at every tested voxel resolution and number of sensors, achieves peak speedups of more than an order of magnitude over CUDA-accelerated nvblox and CPU-based Open3D, and approaches an offline textured-meshing baseline in perceptual re-rendering quality.

[220] Bayesian Sequential Optimal Experimental Design for Single-Pixel Imaging using Reinforcement Learning cs.CV | cs.LGPDF

Marcos Antonio Obando, Tianyuan Wang, Tanja Tarvainen, Tristan van Leeuwen, Felix Lucka

TL;DR: 论文研究单像素成像中的自适应压缩感知测量选择问题，将其建模为贝叶斯序贯最优实验设计（sOED），并进一步重构为强化学习问题。智能体以期望信息增益为奖励学习策略，直接将当前图像后验信念映射为下一个最优二值照明模式，从而避免在巨大二值模式空间中直接优化复杂信息论目标。实验评估了不同策略参数化下的可扩展性，以及近似后验和噪声下的鲁棒性，并提出若干面向生物医学应用的设计约束策略。

Details

Motivation: 单像素成像需要在所有可能的二值照明模式中序贯选择最有信息量的测量，但设计空间巨大，直接优化贝叶斯sOED目标通常很困难。论文旨在用强化学习避免直接求解复杂信息论优化，并实现计算高效的自适应测量选择。

Result: 数值实验表明所提出的贝叶斯sOED-RL框架保持鲁棒，并可扩展到更复杂、更大规模的单像素成像场景；论文还评估了两种策略参数化下的可扩展性，以及仅用近似后验或测量受噪声影响时的性能退化，并提出额外设计约束策略。摘要未给出具体benchmark数值或SOTA对比。

Insight: 创新点在于将单像素成像的贝叶斯sOED重构为强化学习问题，以期望信息增益为奖励学习从后验信念到下一二值测量模式的策略函数，从而绕过直接优化巨大离散设计空间。客观来看，其可借鉴之处是学习式策略直接映射后验到测量设计，并系统考虑近似后验、噪声和实际设计约束下的鲁棒性与可扩展性。

Abstract: Adaptive compressed sensing (CS) aims to select the most informative measurements sequentially, which is crucial for many modern imaging systems. This task can be formulated as a Bayesian sequential optimal experimental design (sOED) problem, where each new acquisition is chosen to maximally reduce uncertainty about the unknown image given prior information and subsequent data provided by acquisitions. However, in single-pixel imaging (SPI), the large design space consists of all possible binary illumination patterns. Directly optimizing the Bayesian sOED objective over this space using conventional methods is generally challenging. In this work, we reformulate sOED for SPI as a reinforcement learning (RL) problem. In RL, an agent learns a policy through repeated experimental trials to maximize a reward, here given as the expected information gain, the most complete measure of uncertainty reduction in Bayesian OED. This avoids the need to directly optimize complex information-theoretic objectives during a measurement to obtain the next design. Instead, the result is a learned policy function that directly maps the current posterior belief about the image to the next optimal binary measurement pattern, in a computationally efficient way. Using a simple yet representative SPI imaging scenario, this work evaluates the scalability of the learned policy under two different policy parameterizations. Furthermore, we investigate how performance deteriorates when only approximate posterior information is available or the measurements are impaired by noise, and propose several strategies to introduce additional design constraints motivated by biomedical applications. The numerical experiments demonstrate that the proposed Bayesian sOED-RL framework remains robust and can be extended to more complex, large-scale SPI scenarios.

[221] VideoEditor-MoE: Scaling Complex Video Editing with Mixture of Experts cs.CV | cs.AIPDF

Xiao Cao, Fuchen Long, Yansong Qu, Wen Xiao, Xin Zhang

TL;DR: 论文提出VideoEditor-MoE，首个开源的视频编辑混合专家框架。它结合MoE-Attention和稀疏MLP-MoE层，从5B模型扩展到14B和56B参数，每token仅激活约8B参数，以高效处理复杂视频编辑指令。实验与现有方法及基线比较，并分析路由行为，表明专家均活跃且路由对内容与噪声水平更敏感。

Details

Motivation: 复杂视频编辑需要理解复杂指令并同时满足多个编辑请求，而通过密集模型缩放来提升能力会显著增加计算成本。因此，需要一种高效扩展模型容量的方法。

Result: 论文与现有方法和两个基线（Explicit-MoE和MLP-MoE）进行了比较，评估了所提方法的优势，但摘要未提供具体量化结果。分析表明所有专家保持活跃，路由对样本内容和扩散噪声水平的响应强于对人类定义的编辑类别，空间分析显示对对象级语义特征敏感。

Insight: 创新点包括：首个开源的视频编辑MoE框架；提出MoE-Attention，通过路由键值专家扩展注意力容量并保持全局交互；实现参数高效扩展（14B/56B总参数，每token激活约8B）；路由分析揭示模型对内容与噪声的敏感性；提出分离权重衰减策略稳定专家扩展。

Abstract: Complex video editing requires understanding complex instructions while jointly fulfilling multiple editing requests. Meeting these demands through dense model scaling substantially increases computational cost. We introduce VideoEditor-MoE, the first open-source mixture-of-experts framework for video editing. Beyond sparse MLP-MoE layers, MoE-Attention expands attention capacity through routed key–value experts while preserving global interactions among video tokens. Initialized from a 5B video editing model, VideoEditor-MoE scales to 14B and 56B parameters, with approximately 8B parameters activated per token in both variants. Comparisons with existing methods and two complementary baselines, Explicit-MoE and MLP-MoE, assess its benefits over explicit expert guidance and MLP-only expert architectures. Further analyses demonstrate that all experts remain active and reveal that learned routing responds more strongly to sample content and diffusion noise levels than to human-defined editing categories. Spatial analysis further indicates sensitivity to object-level semantic features. We also identify decoupled weight decay as a strategy for stabilizing expert scaling.

[222] VL-Dedup: Graded Multimodal Entity Resolution for Image-Text Data Deduplication cs.CVPDF

Zhenxi Liu, Guanze Chen, Dehui Yu, Xingyu Wang, Bingxu Hou

TL;DR: 论文将图像-文本数据去重表述为分级多模态实体解析，不仅判断记录是否属于同一视觉实体，还决定标题保留/标记及图文不匹配处理；提出 VL-Dedup，先按视觉实体聚类并限制簇大小，再用 VLM 与 CLIPScore 在簇内筛选标题，并构建 VL-DedupBench 从 pair、cluster 和保留集三个层面评估。

Details

Motivation: 现有去重和多模态实体解析通常只做记录对的二分类，且仅在标注对上评估，无法反映最终聚类质量和哪些有用标题被误删；图像-文本语料中重复图、同图多标题、跨图复用标题、图文不匹配等需要不同处理。

Result: 作者构建 VL-DedupBench（50,000 条 COCO/SOP 记录、66,788 对标注对）。实验表明仅在标注对上无假边的分类器仍可能把数百万跨实体记录对连在一起；将 VLM 调用用于簇内配对比用于分数不确定配对能带来更好的标题决策；相比每簇只留一条记录，VL-Dedup 的删除造成的信息损失小得多。

Insight: 创新在于把去重从成对同异判断提升为分级多模态实体解析，并提出 pair/cluster/retained set 三层评估；方法上用视觉实体聚类加簇大小上限，并在簇内用 VLM+CLIPScore 做标题取舍，同时把有限 VLM 调用集中在簇内以提高决策质量。

Abstract: Image-text corpora contain copies of one image, captions that describe one image in different ways, captions reused for different images, and captions that do not match their images. Each case calls for a different curation action. Deduplication and multimodal entity resolution (ER) only decide whether records are the same, and they are evaluated on labeled pairs. Yet pair scores do not tell which records end up in the same cluster or which useful captions get deleted. We therefore formulate image-text deduplication as graded multimodal ER, which decides visual identity, caption handling, and mismatches for each pair, and we evaluate it at three levels: pairs, clusters, and the retained set. Our method, VL-Dedup, groups records of the same visual entity into clusters and caps the size of each cluster. Within each cluster, a vision-language model (VLM) and CLIPScore decide which captions to keep and which to flag. We also build VL-DedupBench, with 50,000 COCO and SOP records and 66,788 labeled pairs. On it, a classifier that selects no false edge among the labeled pairs still joins millions of record pairs from different entities. Spending VLM calls on the pairs inside clusters, rather than on pairs with uncertain scores, gives better caption decisions from the same model. Even when almost all clusters are correct, keeping one record per cluster loses facts in many deletions, while the deletions of VL-Dedup lose much less information.

[223] MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation cs.CV | cs.AIPDF

Zhihan Yin, Jianxin Liang, Yifeng Yao, Nonghai Zhang, and Bingyue Peng

TL;DR: 论文提出 MIRA，一个面向多模态推理的 RLVR 训练框架，通过注入经过过滤的欺骗性视觉上下文构造“硬陷阱”，并引入组内反思触发机制，使模型自主检测和纠正视觉线索与逻辑约束之间的不一致。该方法不依赖人工标注，旨在缓解多模态推理中的感知-推理鸿沟和复合幻觉问题。

Details

Motivation: 现有基于可验证奖励强化学习（RLVR）的多模态推理框架过度依赖看似相关的视觉 token，轻微感知扰动会在推理链中传播并导致复合幻觉，形成感知-推理鸿沟。论文希望提升模型对错误视觉上下文的鲁棒性，同时增强逻辑推理能力。

Result: 在多个推理和感知 benchmark 上，MIRA 在域内 benchmark 平均提升约 7%，并在以视觉为中心的 benchmark 上取得持续提升；消融实验和分析进一步验证了方法有效性。

Insight: 创新点在于用过滤后的欺骗性视觉上下文构造 hard traps 进行压力测试，并通过 group-wise reflection-triggering 机制让模型自主发现和纠正视觉与逻辑不一致，且无需人工标注。客观来看，其可借鉴之处是将错误恢复能力作为训练目标内化为策略行为，而非仅提升感知或推理单一环节。

Abstract: While Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced multimodal reasoning, existing frameworks suffer from a critical “perception-reasoning gap.” Due to an over-reliance on seemingly relevant visual tokens, even minor perceptual perturbations can propagate through the reasoning process, leading to compounding hallucinations. To address this issue, we propose MIRA, a training framework that improves robustness to erroneous visual contexts while enhancing logical reasoning ability. By injecting filtered, deceptive visual contexts during training, we construct challenging “hard traps” that stress-test the model’s robustness to misleading information. Furthermore, we introduce a group-wise reflection-triggering mechanism that enables the model to autonomously detect and rectify inconsistencies between visual cues and logical constraints, which is ultimately internalized as an intrinsic policy behavior. Importantly, MIRA does not rely on human annotations. Experimental results across multiple reasoning and perception benchmarks show that MIRA yields an average 7% improvement on in-domain benchmarks, with consistent improvements on vision-centric benchmarks. These findings highlight that active error recovery is essential for robust multimodal reasoning. Comprehensive ablation studies and analyses further provide insights into why MIRA is effective.

[224] DR Pixel: Page-Native Deep Research with Vision-Language Models cs.CV | cs.CL | cs.IRPDF

Tiansheng Hu, Yichuan Wang, James V. Talwar, Nicholas Tomlin, Chen Zhao

TL;DR: 论文提出 DR Pixel，这是首个开源端到端多模态深度研究（DR）智能体，直接以渲染后的文档页面图像作为唯一检索与推理单元，并在 106 万页语料上运行。作者构建了需要跨文本、图表、表格和公式推理的 DRPixelBench，发现页面原生 DR 无需训练即可优于基于 OCR 的基线，且工具调用更少；进一步提出反事实信用重加权来训练智能体，显著提升检索召回和最终准确率，并在多个现有基准及 OOD 的 ViDoRe-V3 上取得有竞争力结果。

Details

Motivation: 现有深度研究智能体通常先把论文压缩为 OCR 提取文本，会丢失表格、图和公式等复杂文档中的丰富信息。论文希望验证视觉语言模型能否直接检索并推理渲染页面图像，从而避免“先 OCR 再检索”的次优流程。

Result: 无需训练的页面原生 DR 在 GPT-5.4、Gemini-3.5-Flash、Qwen3.6-27B 等模型上均优于 OCR 基线，且工具调用更少。训练后在 DRPixelBench 上检索召回提升约 15 点、最终准确率提升超 10 点，并在四个现有基准上优于未训练基线；在 OOD 的 ViDoRe-V3 上距直接给定金页面的 oracle 仅差 1.8 点。

Insight: 论文的核心创新是以页面图像作为 DR 的唯一检索和推理单元，构建端到端多模态页面原生智能体及配套基准 DRPixelBench。方法上提出反事实信用重加权，按各推理/动作步骤对最终答案的反事实贡献进行细粒度信用分配，缓解教师轨迹噪声问题；客观看，这为复杂文档深度研究提供了替代 OCR 流水线的新范式，也对智能体监督微调中的步骤信用分配有借鉴意义。

Abstract: Complex documents such as scientific papers contain rich information in tables, figures, and equations; however, existing deep research (DR) agents typically reduce papers to OCR-extracted text. We instead ask whether vision-language models (VLMs) can enable page-native deep research: directly retrieving and reasoning over rendered document page images. We introduce DR Pixel, the first open-source end-to-end multimodal DR agent that uses rendered page images as its sole retrieval and reasoning unit, operating over a corpus of 1.06M pages. To evaluate this setting, we construct DRPixelBench, a benchmark on scientific papers requiring reasoning over text, figures, tables, and equations. Surprisingly, page-native DR already works well without training, outperforming OCR-based baselines across state-of-the-art models like GPT-5.4, Gemini-3.5-Flash, and Qwen3.6-27B, while requiring fewer tool calls. We next turn to DR training. A key challenge is that teacher trajectories for agentic supervised finetuning are noisy, mixing critical reasoning and action steps with redundant or failed attempts. To address this, we introduce counterfactual credit reweighting, a fine-grained credit assignment method that weights individual reasoning and action steps by their counterfactual contribution to the final answer. Our training improves retrieval recall by about 15 points and final accuracy by over 10 points on DRPixelBench, and likewise outperforms the untrained baseline on four existing benchmarks. On out-of-distribution ViDoRe-V3, DR Pixel comes within 1.8 points of an oracle that is given the gold pages directly. Our results suggest that the conventional OCR-then-retrieve pipeline is not only unnecessary but suboptimal: directly retrieving and reasoning over visual document pages makes complex DR both more effective and more efficient.

[225] Ray-SCR: Generalizing Scene Coordinate Regression Across Camera Models cs.CVPDF

Jaemin Cho, Oleksii Nasypanyi, Francois Rameau

TL;DR: 论文提出 Ray-SCR，一种可轻量集成到现有场景坐标回归（SCR）架构的扩展方法。它用标定视线（viewing rays）对局部视觉特征进行条件化，并用浅层局部 Transformer 融合相邻射线条件特征；同时直接在射线空间构建监督，并以稀疏 SfM 点作为跨视角、跨相机模型的度量锚点。这样可由全景建图序列构建单一场景表示，并对针孔、鱼眼和全向相机拍摄的查询图像进行定位。

Details

Motivation: 现有 SCR 方法虽然紧凑、准确且快速，但在不同相机模型间泛化较差，如全向或强矫正图像。视场、镜头畸变或矫正重采样会使同一场景内容因像素位置不同而外观变化，从而降低定位精度。

Result: 作者在多种 SCR 架构以及包含针孔、鱼眼和全向相机的数据集上评估 Ray-SCR。射线条件化显著提升跨相机泛化能力，并在这些挑战性跨相机设置下取得 state-of-the-art 定位性能。

Insight: 创新点在于将标定视线作为特征条件、用浅层局部 Transformer 聚合邻域射线特征，并在射线空间监督，同时利用稀疏 SfM 点作为跨视角和跨相机模型的度量锚点，从而实现单一场景表示对异构相机查询图像的准确定位。

Abstract: Among visual localization strategies, scene coordinate regression (SCR) has emerged as an attractive approach for its compactness, accuracy, and speed. Despite these advantages, SCR models generalize poorly across substantially different camera models, such as omnidirectional or strongly rectified imagery. This limitation arises because, changes in field of view, lens distortion, or rectification-induced resampling can make the same scene content appear differently depending on its pixel position, degrading localization accuracy. To cope with this limitation, we introduce Ray-SCR, a lightweight extension to existing SCR architectures that conditions local visual features on their calibrated viewing rays and refines neighboring ray-conditioned features with a shallow local Transformer. We further formulate supervision directly in ray space and use sparse SfM points as metric anchors that link observations across views and camera models. Taken together, these components enable a single scene representation built from a panoramic mapping sequence to accurately localize query images captured with very different cameras, including pinhole, fisheye, and omnidirectional cameras. We evaluate Ray-SCR across multiple SCR architectures and on datasets with pinhole, fisheye, and omnidirectional cameras. The proposed ray conditioning substantially improves generalization across cameras and leads to state-of-the-art localization performance in these challenging cross-camera settings. The project page is available at https://jaeminch0.github.io/ray-scr-generalizing-scene-coordinate-regression-across-camera-models/.

[226] Multimodal Prompt Learning with Dual-Granularity Contrastive Alignment for Preoperative Prediction of Lung Adenocarcinoma Invasiveness Using 3D CT cs.CV | cs.AIPDF

Qing Huang, Xiaotong Tan, Lintong Yao, Wufeng Xue, Ruobing Huang

TL;DR: 论文提出一种面向3D CT肺腺癌侵袭性术前预测的多模态提示学习框架，通过报告级与关键词级的双粒度图像-文本对齐，将临床报告语义监督引入CT分类。模型在推理阶段仅需CT图像，实现对浸润性腺癌（IAD）与Pre-IAD病变的区分。

Details

Motivation: 肺腺癌侵袭性术前准确判断对手术规划和个体化治疗很重要，但IAD与Pre-IAD在CT表现上存在重叠，仅靠图像难以区分，因此需要利用放射报告语义增强CT表征学习。

Result: 在1593个病理确认结节上测试，准确率87.92%、F1为87.78%、AUC为0.9499；AUC显著优于同视觉主干的仅图像Res-CBAM基线（0.9297，DeLong检验p=0.0078），消融实验支持全局/局部对齐及报告提示初始化的贡献。

Insight: 创新点在于双粒度图像-文本对齐：全局对比对齐提供整体语义监督，基于多实例学习的局部对齐关联空间CT特征与血管相关放射关键词；同时用真实临床报告语义初始化可学习提示，并保持CT-only推理流程。

Abstract: Accurate preoperative prediction of lung adenocarcinoma invasiveness is important for surgical planning and individualized treatment. However, overlapping CT appearances make it challenging to distinguish invasive adenocarcinoma (IAD) from Pre-IAD lesions. We propose a multimodal prompt-learning framework with dual-granularity image-text alignment for 3D CT-based IAD classification. A 3D ResNet-CBAM encoder extracts global and spatial visual features. A frozen RadBERT backbone is adapted with separate learnable prompts for report-level and keyword-level text encoding. These prompts are initialized using semantic representations derived from real-world clinical reports. Global contrastive alignment connects whole-volume CT representations with reports generated from clinician-annotated radiological attributes to provide overall semantic supervision. A multiple instance learning-based local alignment module associates spatial CT features with vascular-focused radiological keywords, to capture local imaging characteristics potentially associated with tumor invasion. The framework jointly optimizes classification and alignment objectives, while inference requires only CT images. Experiments included 1,593 pathologically confirmed nodules. On the test set, the proposed method achieved an accuracy of 87.92%, F1-score of 87.78%, and AUC of 0.9499. Its AUC significantly exceeded that of the image-only Res-CBAM baseline with the same visual backbone (0.9297; DeLong test, p = 0.0078). Ablation analyses supported the complementary contributions of global and local alignment and the benefit of report-based prompt initialization. Qualitative visualizations showed activation within nodules and adjacent vascular structures. These findings suggest that dual-granularity radiological supervision can enhance CT-based invasiveness prediction while preserving a CT-only inference workflow.

[227] SurgPace: Complexity-Aware Progressive Distillation for Surgical Multimodal Large Language Models cs.CVPDF

Zhicheng He, Xiaohan Xing, Hongqiu Wang, Kun Yuan, Guankun Wang

TL;DR: 论文提出SurgPace，一种面向手术多模态大语言模型（MLLM）的复杂度感知连续课程渐进蒸馏框架。它利用预测置信度和Lorentz几何一致性估计样本复杂度，引导由易到难的连续蒸馏训练，并通过特征、logit和概率层面的层次表示对齐，逐步从教师模仿转向任务监督。实验表明该方法能在Surg-396K上构建更紧凑、内存高效且解码更快的手术MLLM。

Details

Motivation: 手术MLLM计算成本高，限制临床部署；而直接知识蒸馏不适合手术数据，因为样本在难度、视觉模糊性和所需临床上下文上差异很大，统一教师-学生迁移不稳定，且训练不同阶段对教师监督和任务监督的依赖会变化。

Result: 在基于四个公开手术数据集构建、覆盖五种对话范式的Surg-396K基准上，SurgPace一致优于强MLLM蒸馏基线，证明其能构建紧凑、内存高效且解码更快的手术MLLM；摘要未给出具体定量数值或明确SOTA表述。

Insight: 主要创新是复杂度感知的连续课程蒸馏，将预测置信度与Lorentz几何一致性融合用于样本难度估计，并引入特征、logit、概率三级层次表示对齐。其可借鉴之处在于分离样本级课程与目标级调度，动态平衡教师模仿和任务监督，提升异构手术数据蒸馏的稳定性。

Abstract: Multimodal large language models (MLLMs) have shown strong potential in robotic surgery for question answering, scene understanding, and grounded assistance, but their high computational cost limits real clinical deployment. Knowledge distillation provides a practical way to build compact surgical MLLMs, yet direct distillation is not well suited to surgical data because surgical samples vary greatly in difficulty, visual ambiguity, and required clinical context, making uniform teacher-student transfer unstable. In addition, the role of supervision changes during training: early stages require stronger teacher guidance for multimodal alignment, while later stages rely more on task supervision for effective optimization. To address these challenges, we propose SurgPace, a complexity-aware continuous curriculum framework for progressive distillation of surgical vision-language models. SurgPace estimates sample complexity using predictive confidence and Lorentz geometric consistency, and uses the fused score to guide a continuous easy-to-hard training process. We further introduce hierarchical representation alignment, which aligns the student with the teacher at the feature, logit, and probability levels, while gradually shifting the training focus from teacher imitation to task supervision. This design separates sample-level curriculum from objective-level scheduling, leading to more stable and effective distillation. We evaluate SurgPace on Surg-396K, a benchmark built from four public surgical datasets and covering five dialogue paradigms. SurgPace consistently outperforms strong MLLM distillation baselines, demonstrating its effectiveness for building compact, memory-efficient surgical MLLMs with faster decoding under controlled benchmarks. Code is available at https://github.com/hezhicheng2002/SurgPace.

[228] Behavioral Affinity Transduction for Zero-Shot Vision-Language Classification cs.CVPDF

Junxi Huang, Wenshuo Chen, Xiucheng Wang, Meitong Shen, Shaofeng Liang

TL;DR: 论文提出行为亲和力传导（BAT），利用无标注查询批次中每张图像对类别词表的响应分布构建稀疏近邻图，在冻结视觉语言模型预测时引入邻居证据，并可结合 EM-Dirichlet 进行候选类筛选与分配初始化，从而提升零样本视觉-语言分类性能。

Details

Motivation: 现有零样本视觉语言模型对图像独立打分，未利用同一无标注批次中可能存在的有用邻居；而仅依赖视觉相似度又可能受姿态、背景等因素干扰，导致不同类别图像被错误连接。

Result: 在多个数据集上，BAT 提升了所有测试读出方式的平均准确率；主实验 RN50 上，soft 和 hard EM-Dirichlet 分别取得 4.22 和 2.72 个百分点的提升。

Insight: 创新点在于用类别响应画像而非仅视觉特征选择邻居，并构建稀疏图进行直推式证据传播；该方法可即插即用于冻结 VLM 的直接与迭代读出，并用 EM-Dirichlet 辅助候选类筛选和初始化。客观来看，其价值在于把模型行为相似性作为轻量补充信号，增强现有零样本分类流程。

Abstract: An image that is hard to classify on its own may have a helpful neighbor in the same unlabeled batch. Zero-shot vision-language models (VLMs) score images independently and leave this evidence unused. We study small unlabeled query batches with no labeled examples. Visual similarity can reflect pose or background, so it may connect images from different classes. Each image’s scores over the class vocabulary offer another way to choose neighbors. We introduce Behavioral Affinity Transduction (BAT), which builds a sparse graph from these class-response profiles. The graph supplies neighbor evidence during prediction. For EM-Dirichlet, it also screens candidate classes and initializes assignments. BAT plugs into direct and iterative readouts of a frozen VLM. Across diverse datasets, BAT improves the mean accuracy of every tested readout. In the main RN50 comparison, soft and hard EM-Dirichlet gain $4.22$ and $2.72$ percentage points.

[229] Znaki: A Russian Fingerspelling Recognition Dataset cs.CVPDF

Petr Surovtsev, Pavel Korotaev, Alexander Nagaev, Alexander Kapitanov

TL;DR: 论文发布了首个公开的俄语手语手指拼写数据集 Znaki，包含 37,252 段视频（35.4 小时）、1,593 个唯一序列，由 68 名母语级俄语手语者通过众包流程录制，并经过两阶段资格筛选和专家校验。数据集覆盖全部 33 个西里尔字母手形，字母频率与俄罗斯国家语料库匹配，并提供两个改编自美国手语手指拼写识别的基线模型。

Details

Motivation: 俄语手语有超过 15 万名母语使用者，但此前缺乏公开的俄语手语手指拼写数据集，而美国、英国、德国等手语已有相关资源。论文旨在填补这一空白，为俄语手语手指拼写识别研究提供开放数据与参考基线。

Result: 数据集包含 37,252 段视频、35.4 小时、1,593 个唯一序列，覆盖 33 个西里尔字母手形。两个基线中，基于 Squeezeformer 的编码器-解码器达到字符级准确率 0.932、序列准确率 0.596；Fingerspelling-PoseNet 分别达到 0.886 和 0.545。

Insight: 主要创新在于构建首个公开的俄语手语手指拼写数据集，并采用众包采集、两阶段手语者资格筛选和专家验证来保证数据质量；同时提供可复现的基线，为后续俄语手语手指拼写识别研究建立参考。客观来看，其贡献更偏向数据资源与基准建设，方法本身主要借鉴美国手语手指拼写识别模型。

Abstract: Fingerspelling - the sequential signing of letters that compose proper names, technical terms, and out-of-vocabulary words - is an integral component of any sign language. Despite Russian Sign Language (RSL) being used by more than 150,000 native signers, no public fingerspelling dataset for RSL exists, in contrast to American, British, German, and several other sign languages. We introduce Znaki the first open RSL fingerspelling dataset: 37,252 video recordings (35.4 hours) of 1,593 unique sequences - proper names sampled from 16 domain categories - recorded by 68 native RSL signers (37 Deaf, 29 hard-of-hearing, and 2 certified interpreters) through a crowdsourcing pipeline with a two-stage signer qualification procedure and expert validation. The dataset covers all 33 Cyrillic handshapes, and its letter-frequency distribution matches the Russian National Corpus. As reference points for future research, we establish two baselines adapted from American Sign Language fingerspelling recognition: a Squeezeformer-based encoder-decoder, reaching a character-level accuracy ($1-\mathrm{CER}$) of 0.932 and a sequence accuracy of 0.596, and Fingerspelling-PoseNet, reaching 0.886 and 0.545, respectively.

[230] CL3DOD: Understanding the Stability-Plasticity Dilemma in Outdoor Class-Incremental 3D Object Detection cs.CVPDF

Muhammad Ahmed Ullah Khan, Khalil Ahmed, Didier Stricker, Muhammad Zeshan Afzal

TL;DR: 论文首次对户外类增量3D目标检测进行跨自动驾驶基准的统一分析，覆盖KITTI和nuScenes上的两任务与多阶段增量设置，系统研究旧类遗忘、稳定性-可塑性困境及有效监督形式。作者提出CL3DOD框架，通过上一阶段检测器预测恢复旧类监督、query-wise知识蒸馏和EMA时序一致性正则来平衡旧知识保留与新类学习。

Details

Motivation: 户外类增量3D目标检测研究仍不充分，现有工作多局限于单一基准和不同增量设置，难以判断持续学习行为是否能跨自动驾驶基准泛化。论文旨在统一分析遗忘严重性和稳定性-可塑性困境，并寻找更有效的监督方式来平衡旧类保持与新类获取。

Result: 在KITTI和nuScenes上的两任务和多阶段实验均显示存在一致的稳定性-可塑性困境。CL3DOD通常比受控增量基线取得更优的稳定性-可塑性平衡，并在报告基准比较中优于已发表先前方法，且优势可延续到多个增量阶段，表现出较强的旧知识保留和新类学习能力。

Insight: 论文宣称的创新点包括首个跨多个自动驾驶基准的户外类增量3D检测统一分析，以及CL3DOD中利用上一阶段预测恢复旧类监督、query-wise知识蒸馏和EMA时序一致性正则的组合。客观来看，其价值在于统一评估揭示稳定性-可塑性困境，并针对旧类监督缺失设计互补的蒸馏与一致性约束。

Abstract: Class-incremental learning (CIL) for outdoor 3D object detection remains largely underexplored. Existing outdoor studies are limited to single-benchmark evaluations, with SDCoT++ considering KITTI and CL2OD considering nuScenes under different incremental settings. This makes it difficult to assess whether observed continual-learning behavior generalizes across autonomous-driving benchmarks. To the best of our knowledge, we provide the first unified cross-benchmark analysis of outdoor class-incremental 3D object detection across multiple autonomous-driving benchmarks, covering both two-task and multi-stage settings. We investigate: (1) how severely existing 3D detectors forget previously learned classes, (2) how incremental training exposes the stability-plasticity dilemma between knowledge retention and new-class acquisition, and (3) which forms of supervision are most effective for balancing these objectives. We introduce CL3DOD, a class-incremental 3D detection framework that restores missing supervision for previous classes using predictions from the previous-stage detector, preserves old-class responses through query-wise knowledge distillation, and employs EMA-based temporal consistency regularization. Experiments on KITTI and nuScenes reveal a consistent stability-plasticity dilemma across both benchmarks. CL3DOD generally achieves a more favorable stability-plasticity balance than controlled incremental baselines and improves upon published prior methods in the reported benchmark comparisons. This advantage persists across multiple incremental stages, demonstrating strong retention of previously learned knowledge while maintaining effective new-class acquisition. Our code, evaluation setup, and incremental task splits will be publicly released.

[231] Calibrating Multimodal Test-Time Adaptation under Reliability and Availability Modality Shifts cs.CVPDF

Jiangmeng Li, Jinglin Xu, Yi Li, Yumeng Liu, Jiahuan Zhou

TL;DR: 论文提出自适应概率高斯校准（AdaPGC）方法，用于多模态测试时适应场景下的分布偏移问题。该方法将类别条件高斯建模扩展到模态特定表示和融合表示，通过持续更新高斯模型进行概率校准，以应对模态可靠性偏移（信息质量下降但模态可用）和模态可用性偏移（模态完全缺失）两种情况，并利用联合分布恢复不可用的融合表示。

Details

Motivation: 多模态测试时适应比单模态更复杂，因为多种表示视角共存且交互，尤其在模态可靠性偏移和可用性偏移下。现有单模态TTA中有效的类别条件高斯建模难以直接扩展到多模态，需要更精细的公式化设计。

Result: 在多种模态损坏和缺失条件下的大量实验表明，AdaPGC能有效提升模型在模态可靠性和可用性偏移下的鲁棒性。摘要未提及具体基准或数值结果。

Insight: 创新点在于将类别条件高斯建模系统性地扩展到多模态TTA，覆盖模态特定表示和融合表示，并利用概率预测校准源模型、指导基于可靠性的校正，以及通过联合分布恢复不可用的融合表示。

Abstract: Multimodal test-time adaptation (TTA) enables pretrained multimodal models to accommodate distribution shifts during inference using only unlabeled test data, without recourse to the original training data. Compared with unimodal adaptation, multimodal adaptation is further complicated by the coexistence and interaction of multiple representation perspectives. This complexity is particularly pronounced under modality reliability shifts, which preserve modality availability but degrade information quality, and modality availability shifts, which render the corresponding modality entirely inaccessible. Category-conditional Gaussian modeling offers a natural starting point for handling such distributional variations, having proven effective in unimodal test-time adaptation for characterizing representation distributions, yet its extension to multimodal settings requires a more elaborate formulation. To this end, we propose Adaptive Probabilistic Gaussian Calibration (AdaPGC), which extends category-conditional Gaussian modeling across modality-specific and multimodal fusion representations for probabilistic calibration under multimodal distribution shifts. AdaPGC continuously updates category-conditional Gaussian models over modality-specific and fusion representations, using the resulting probabilistic predictions to calibrate source model predictions and guide reliability based rectification, while exploiting their joint distributions to recover unavailable fusion representations. Extensive experiments under diverse modality corruption and missingness conditions demonstrate that AdaPGC effectively improves robustness under both modality reliability and availability shifts. Our source code will be released at https://github.com/XuJinglinn/AdaPGC-plus.

[232] R$^2$-Omni: Reducing Structural and Precision Redundancy in Omni-LLMs for Long-Form Generation cs.CVPDF

Bolong Feng, Pengfei Zhou, Zhenglin Wan, Wei Wang, Wangbo Zhao

TL;DR: 论文针对Omni-LLM处理音视频多模态输入时KV cache内存和计算开销大的问题，指出激进token剪枝在多选题上有效但会损害长文本开放式生成质量。作者提出免训练框架R$^2$-Omni，联合减少token表示中的结构冗余和精度冗余：STC利用视频时空相似性和音频局部连续性合并冗余表示，SSPA按量化键下注意力输出误差估计为保留表示分配数值精度。

Details

Motivation: Omni-LLM处理大量音视频token导致高昂计算和KV cache内存开销；现有query-guided token剪枝虽能保留多选题所需证据，却丢弃长文本生成所需细节，因此需要在保留多样内容的同时减少token间重叠信息及缓存数值精度冗余。

Result: 在长文本生成基准上，R$^2$-Omni平均降低5.0倍内存占用，保持97.98%的基线生成质量，并实现1.48倍端到端加速，表明联合降低结构冗余和精度冗余有效。

Insight: 创新点在于提出免训练的R$^2$-Omni框架，从结构和精度两个层面压缩Omni-LLM的token表示：STC利用音视频模态先验合并冗余表示，SSPA根据注意力输出误差和语义先验分配缓存值精度。客观来看，其价值在于针对长文本生成场景重新审视token剪枝，并将KV cache压缩从单一结构维度拓展到结构-精度联合优化。

Abstract: Omni-modal large language models (Omni-LLMs) typically process large numbers of multimodal tokens from audio-visual inputs, incurring substantial computational costs and a large memory footprint for the key-value (KV) cache. Aggressive token pruning can alleviate this problem while maintaining competitive performance on multiple-choice tasks, which require only a single option as output. However, we observe substantial quality degradation when generating long-form, open-ended responses. We attribute this gap to query-guided selection, which can retain sufficient evidence for answer selection while discarding details needed for comprehensive generation. This motivates reducing overlapping information across tokens, termed structural redundancy, while preserving diverse content. However, the retained representations may still contain precision redundancy due to unnecessarily high numerical precision in their cached values. To address these two levels of redundancy in token representations, we introduce a training-free framework named R$^2$-Omni. First, Structure-Aware Token Consolidation (STC) consolidates redundant representations using spatiotemporal similarity in video and local continuity in audio. Then, Semantic-Sensitivity Guided Precision Allocation (SSPA) allocates value precision to the retained representations according to the estimated reduction in attention-output error under quantized keys, with query attention and audio-visual alignment providing a semantic prior. Extensive experiments on long-form generation benchmarks demonstrate an average 5.0$\times$ reduction in the memory footprint while preserving 97.98% of baseline generation quality and achieving a 1.48$\times$ end-to-end speedup, highlighting the benefits of jointly reducing structural and precision redundancy.

[233] ReVA-HPE: Relative 6DoF Head Pose Estimation with Synthetic Pose Supervision and Personalized Virtual Anchors cs.CVPDF

Vasiliki Vasileiou, Panagiotis P. Filntisis, Petros Maragos, Kostas Daniilidis

TL;DR: 论文提出 ReVA-HPE，将单目头部姿态估计从绝对回归和传统相对估计推进到完整 6DoF 相对估计：预测深度归一化的相对平移，并与 anchor 组合恢复查询图像在相机坐标系下的 metric 姿态。为摆脱推理时对 anchor 真实姿态的依赖，方法从单张未标注 enrollment 图像重建个性化 avatar，渲染已知姿态的虚拟 anchor bank，并通过多 anchor 共识获得鲁棒旋转假设；平移分支则用真实 enrollment 图像和 landmark PnP。论文还提出高效变体，在 enrollment 时一次性摊销虚拟 anchor bank 成本，后续查询只需一次 real-to-real 相对预测。

Details

Motivation: 现有相对头部姿态估计仍需在推理时已知 anchor 图像的真实姿态，限制了实际应用；同时，单张 face crop 的绝对回归难以利用同一人随时间观察可提供的 anchor 信息。论文希望消除对 ground-truth anchor pose 的依赖，并将相对估计扩展到完整 6DoF metric 查询姿态恢复。

Result: 在真实 6DoF benchmark 上，ReVA-HPE 在 BIWI 上取得 state-of-the-art 旋转精度，在给定近正面 enrollment 图像的 FaMoS 上也达到 SOTA；metric translation 具有竞争力。值得注意的是，相对姿态估计器仅用合成人脸渲染训练，不使用真实姿态监督、伪标签、域适应或评测集微调。

Insight: 创新点包括：将相对头部姿态估计扩展到完整 6DoF，并引入深度归一化相对平移；利用单张未标注 enrollment 图像重建个性化 avatar，生成已知姿态的虚拟 anchor bank，通过多 anchor 共识避免真实 anchor pose 标注；平移分支结合真实 enrollment 图像与 landmark PnP；以及 enrollment 时摊销虚拟 anchor 成本的高效变体。客观来看，其核心创新在于将个性化虚拟 anchor 与相对 6DoF 估计结合，并以纯合成姿态监督实现真实 benchmark 上的强性能。

Abstract: Monocular head pose estimation is usually formulated as absolute regression from a single face crop, yet many applications observe the same person over time and can supply an explicit anchor image. Recently, relative head pose estimation was proposed, which casts the problem as estimation of the relative geometric change between an anchor and a query image. However, existing methods still require the anchor image pose to be known at inference, significantly limiting their practical use. We first extend relative head pose estimation to full 6DoF by additionally predicting a depth-normalized relative translation, which composes with the anchor to recover metric query pose in the camera frame. To eliminate the need for a ground-truth anchor pose, we reconstruct a personalized avatar from a single unlabeled enrollment image and render a bank of virtual anchors with known poses. The bank provides robust rotation hypotheses through multi-anchor consensus, while the real enrollment image serves as the real anchor in the translation branch via landmark PnP. We also introduce an efficient variant that amortizes the bank cost once at enrollment, after which each query requires a single real-to-real relative prediction, with limited accuracy sacrifice. The relative pose estimator is trained exclusively on synthetic face renderings, without real pose supervision, pseudo-labels, domain adaptation, or fine-tuning on the evaluation sets. On real 6DoF benchmarks, ReVA-HPE achieves state-of-the-art rotation accuracy on BIWI and, given a near-frontal enrollment image, on FaMoS, while remaining competitive in metric translation despite relying solely on synthetic pose supervision. Project page and code: https://vasilikivas.github.io/ReVA-HPE/

[234] ArabGeoText: Tool-Augmented Vision-Language Models for Arabic Geospatial Text Spotting cs.CVPDF

Yakoub Bazi, Sarah Alsaleh, Mohamad M. Al Rahhal, Mohamed A. Mekhtiche, Mansour Zuair

TL;DR: 论文构建了面向阿拉伯语地理空间文本的 ARABGEOTEXT 基准，包含利雅得和吉达 970 个地点，每类视图 17,875 个人工标注文本实例，并提供 OSM 渲染与遥感影像叠加的成对视图及城市内/跨城市评测划分。针对直接使用 Qwen3.5-4B 难以恢复图块内全部标签的问题，提出工具增强视觉语言框架：YOLO26 定位与裁剪矫正，结合 LoRA 适配的 Qwen3.5-4B 识别。

Details

Motivation: 阿拉伯语地理空间文本定位与转录在栅格地图中尚未充分研究，标签通常小、密集且方向任意，直接 VLM 识别困难。论文旨在建立基准并提升复杂地图背景下的检测、识别与端到端定位性能。

Result: 实验表明该工具增强框架在两种图像视图和测试城市上均优于直接 LoRA 适配的 Qwen3.5-4B spotting；在固定定位结果时，识别器适配相较预训练零样本识别器进一步提升识别效果。摘要未给出具体数值。

Insight: 创新点在于构建成对 OSM/遥感视图且保持标签内容与像素几何一致的阿拉伯语地理空间文本基准，并设计定位、矫正、识别解耦的工具增强 VLM 流程。客观看，其价值在于诊断现有 VLM 短板、提供跨背景和跨城市评测，以及用模块化工具链弥补端到端模型能力不足。

Abstract: Geospatial text spotting involves locating and transcribing geographic labels, such as road names, district names, and landmarks, in raster maps. These labels are often small, densely arranged, and arbitrarily oriented. Although Arabic text recognition has been studied extensively in documents and natural scenes, Arabic geospatial text spotting remains underexplored. We introduce ARABGEOTEXT, an Arabic-centric benchmark covering 970 geographic locations in Riyadh and Jeddah, with 17,875 manually annotated text instances per view type. For each location, we pair an OpenStreetMap (OSM) rendering with a composite created by overlaying that rendering on the corresponding remote sensing (RS) imagery. The paired views preserve label content and pixel geometry, allowing evaluation across different backgrounds. Geographic partitions support in-city and city-disjoint evaluation of detection, recognition, and end-to-end spotting. Experiments with direct Qwen3.5-4B spotting show difficulties in recovering all labels within a tile. We therefore propose a tool-augmented vision-language framework that combines YOLO26 localization and crop rectification with Qwen3.5-4B recognition adapted through low-rank adaptation (LoRA). The framework outperforms direct LoRA-adapted Qwen3.5-4B spotting across both image views and test cities. With localization held fixed, reader adaptation further improves recognition over the pretrained zero-shot reader. The dataset and code will be made publicly available at https://github.com/yakoubbazi/ArabGeoText.

[235] Every Pixel Is an Option: A System One Model for Medical Ultrasound Biometry cs.CV | cs.LGPDF

Moein Heidari, Junbo Rao, Yudan Chen, Yasamin Medghalchi, River Jiang

TL;DR: 论文提出Kev-Bio，一种视觉语言模型，利用临床测量问题引导超声标志点检测。受System One决策模型启发，模型用语言模型的决策表示生成每个卡尺端点的查询，并与共享的密集超声特征匹配，生成空间概率图，从中导出标志点坐标和临床测量。模型以标志点定位损失和临床测量损失端到端训练。

Details

Motivation: 超声生物测量依赖手动放置卡尺，存在操作者间差异；传统方法针对不同任务使用专用预测头，而视觉语言模型虽可通过文本指令提供灵活性，但直接坐标预测未显式建模空间似然分布，难以表示定位歧义。

Result: 在九视图FU/GU Biometry 2026数据集上，Kev-Bio取得平均径向误差（MRE）22.50像素和临床测量平均绝对误差（MAE）15.38，总体性能优于对比基线。

Insight: 创新点在于用语言模型决策表示生成卡尺端点查询，并与共享密集超声特征匹配以产生空间概率图，从而显式建模定位不确定性和空间似然；同时以临床测量问题统一引导多视图超声标志点检测与测量，并端到端联合优化定位和测量损失。

Abstract: Purpose: Ultrasound biometry is widely used across various clinical applications, including prenatal and cardiac examinations, to obtain quantitative measurements by placing calipers at anatomical landmarks. However, these measurements remain subject to interoperator variability as they rely largely on manual caliper placement. Conventional methods often use specialized prediction heads for different ultrasound tasks, whereas vision-language models offer flexibility through text instructions. However, direct coordinate prediction does not explicitly model spatial likelihood distributions, limiting the representation of localization ambiguity. Methods: We propose Kev-Bio, a vision-language model that uses clinical measurement questions to guide ultrasound landmark detection. Inspired by System One decision models, Kev-Bio uses decision representations of the language model to generate queries for each caliper endpoint. These queries are matched against shared dense ultrasound features to produce spatial probability maps, from which landmark coordinates and clinical measurements are derived. The model is trained end-to-end using both landmark localization and clinical measurement losses. Results: On the nine-view FU/GU Biometry 2026 dataset, Kev-Bio achieves a mean radial error (MRE) of 22.50 pixels and a clinical measurement mean absolute error (MAE) of 15.38, outperforming the compared baselines in overall performance. Conclusion: These results demonstrate the effectiveness of Kev-Bio for ultrasound landmark detection and clinical measurement across different anatomical views. Our code and models are available at https://github.com/moeinheidari7829/Kev-Bio.

[236] Fuse To Align: Multimodal Representation Learning for Retrieval via Hypergraph Regularization cs.CVPDF

Anindya Nag, Ambuj Mehrish, Sebastiano Vascon

TL;DR: 论文提出一种训练时超图融合框架，用于多模态检索中的表示学习。该方法通过超图连接样本内观测模态与语义相关样本间的模态，使表示学习能利用单样本之外的信息，同时推理阶段保持原检索流程不变。框架将HyVol作为特例，并给出wHyVol和wRHG两种配置。实验在零样本视频-文本和音频-文本检索任务上验证了有效性。

Details

Motivation: 多模态检索需要整合可能缺失、噪声大或信息量不等的多视角证据；仅从单样本视角学习难以获得有效检索表示。现有基于volume的目标通常在样本内联合对齐模态，未显式支持语义相关样本间的信息交换。

Result: 在11个零样本视频-文本和音频-文本检索benchmark上，GRAM和HyperGRAM均取得广泛提升。17个视频benchmark-modality设置的双向检索中，wRHG在34项比较中全部优于GRAM，并在33/34项优于HyperGRAM；平均文本到视频R@1由63.4提升至68.2（GRAM）和64.8提升至68.4（HyperGRAM），ActivityNet上视频到文本最大提升13.3个百分点。缺失模态评估中，在7个benchmark的各缺失率下均保持正向增益，即使90%片段缺失一种模态。

Insight: 创新点在于用超图在训练时同时建模样本内和跨语义相关样本的模态连接，并以正则化方式增强多模态对齐；缺失模态直接省略而非插补，训练后丢弃超图，因而不增加推理成本。客观看，其可借鉴之处是将跨样本语义关系引入多模态表示学习，并通过wRHG的关系传播建模类型交互与参与者角色。

Abstract: Multimodal retrieval must integrate complementary evidence from views that may be missing, noisy, or unequally informative. When a sample provides limited reliable evidence, learning from its views alone can hinder the acquisition of useful retrieval representations. Semantically related training samples may provide complementary observations, yet existing volume-based objectives jointly align modalities within each sample without explicitly enabling information exchange across samples. We therefore propose a training-time hypergraph fusion framework that connects observed modalities both within samples and across semantically related samples, allowing representation learning to draw on evidence beyond an individual sample while leaving the retrieval pipeline unchanged at inference. The framework includes HyVol as a special case and introduces two configurations: wHyVol learns view contribution weights and symmetric semantic affinities, whereas wRHG additionally models typed interactions and participant roles through relational propagation. Missing modalities are omitted rather than imputed, and the hypergraph is discarded after training, incurring no additional inference cost. Experiments on eleven zero-shot video-text and audio-text retrieval benchmarks demonstrate broad improvements with both GRAM and HyperGRAM. Across 17 video benchmark-modality settings evaluated in both retrieval directions, wRHG outperforms GRAM in all 34 comparisons and HyperGRAM in 33 of 34. Mean text-to-video R@1 increases from 63.4 to 68.2 with GRAM and from 64.8 to 68.4 with HyperGRAM, while the largest video-to-text gain reaches 13.3 percentage points on ActivityNet. Under missing-modality evaluation, both weighted configurations retain positive text-to-video gains over GRAM across seven benchmarks at every evaluated missingness rate, even when 90% of clips lack one modality.

[237] EO-Jev: Decision Model for Earth Observation cs.CVPDF

Mohamed Atef Abouelhadid, Diaa Addeen Abuhani, Muhammad Akhtar Munir, Fahad Shahbaz Khan, Salman Khan

TL;DR: 论文研究面向地球观测（EO）的决策模型，先对8.4B参数的d3-flash在23个公开EO基准的30个设置上进行诊断分析，发现组合推理迁移较好、校准优于Qwen3.5-9B骨干，但在计数、变化量化、损毁分级和缺失目标识别上仍具挑战；随后通过低秩微调公开EO训练集得到EO-Jev，使其成为有竞争力的EO通用模型。

Details

Motivation: EO工作流需要在已知结果中选择答案、估计置信度并处理大量影像；生成式视觉语言模型自回归解码计算昂贵且置信度不可靠，而决策模型可单次前向输出候选答案概率，但其在EO任务上的准确性、校准和跨任务迁移尚不清楚。

Result: 诊断发现d3-flash在24个设置上校准优于Qwen3.5-9B骨干；EO-Jev在30个设置中的26个上显著优于d3-flash，在28个中的20个上匹配或超过专家参考，12个留出设置平均提升8.0分，并在28个中的21个上具有更低期望校准误差，代价是通用决策性能小幅下降1.8分。

Insight: 创新点在于系统诊断通用决策模型在多样EO任务上的能力与缺陷，并用低秩微调将其适配为有竞争力的EO通用决策模型；客观看，贡献更偏向诊断分析、轻量适配与校准评估，定量感知、选项顺序一致性和分布偏移下校准仍是待解决问题。

Abstract: Earth observation (EO) workflows require selecting among known outcomes, estimating confidence, and processing large volumes of imagery. Generative vision-language models can address these tasks, but autoregressive decoding is computationally costly and their confidence estimates are unreliable. Decision models offer an alternative, returning probabilities over candidate answers in a single forward pass. However, their accuracy, calibration, and transfer across EO tasks remain insufficiently understood. We investigate these properties through a diagnostic study of d3-flash (8.4B parameters) across 30 settings from 23 public EO benchmarks. We find that compositional reasoning transfers well and calibration improves over its Qwen3.5-9B backbone on 24 settings, while counting, change quantification, damage grading, and absent-object recognition remain challenging. To address these limitations, we adapt d3-flash through low-rank fine-tuning on public EO training splits, producing EO-Jev. EO-Jev improves significantly over d3-flash on 26 of 30 settings and matches or exceeds specialist references on 20 of 28. It also achieves an average gain of 8.0 points across 12 held-out settings and lower expected calibration error than specialists on 21 of 28 settings. These improvements come at a modest cost of 1.8 points in general decision performance. Our results demonstrate the potential of adapting general decision models into competitive EO generalists while highlighting persistent challenges in quantitative perception, option-order consistency, and calibration under distribution shift.

[238] ASCoR: Asymmetric Semantic-Spatial Learning for Remote Sensing Domain Generalization cs.CVPDF

Zitong Wang, Shuchang Lyu, Meng Li, Qiang Wang, Guangliang Cheng

TL;DR: 论文提出ASCoR，一种基于SAM3的非对称语义-空间遥感域泛化语义分割框架。该方法结合文本条件语义分支、Probe-Once动态自适应LoRA、冻结图像编码器的任务特定密集分支以及可靠性路由器，在仅使用源域监督训练的条件下提升未见域分割性能，并在多个遥感跨域基准上取得领先结果。

Details

Motivation: 遥感语义分割在无目标域数据的源域泛化场景下需要可靠预测；现有视觉基础模型虽具迁移性，但类别识别易受源域特定视觉线索影响，而任务特定适配可能削弱预训练模型的可迁移性。

Result: 在ISPRS、LoveDA和OpenEarthMap共九个跨域迁移上评估，ASCoR在六个ISPRS迁移上取得68.61%平均mIoU，较此前最佳方法提升2.69个百分点；在三个LoveDA/OpenEarthMap迁移上均获最佳，mIoU分别为59.07%、47.95%和49.38%。

Insight: 创新点在于非对称语义-空间双分支设计：用类名提示提供显式类别引导，以固定预算的动态自适应LoRA限制源域特化，并通过冻结图像编码器保留空间表示，最后由轻量可靠性路由器进行有界空间校正。客观上看，其核心价值是将语义先验、参数高效适配与可靠性驱动融合结合，以缓解域泛化中的源域过拟合和迁移性退化问题。

Abstract: Source-only domain generalization (DG) for remote sensing semantic segmentation seeks reliable predictions in unseen domains without target-domain data during training. Although vision foundation models offer transferable knowledge, category recognition remains sensitive to source-specific visual cues, while task-specific adaptation may weaken pretrained transferability. We propose ASCoR, an asymmetric semantic-spatial framework built on SAM3. Its text-conditioned semantic branch uses class-name prompts to provide explicit category guidance. Probe-Once Dynamic Adaptive LoRA distributes a fixed adaptation budget across encoder blocks to limit source-specific specialization. A complementary task-specific dense branch learns multi-scale spatial representations using a separate frozen SAM3 image encoder. A lightweight reliability router integrates the two branches through bounded spatial correction based on local prediction reliability. All components are trained using source-domain supervision only. Experiments on the ISPRS, LoveDA, and OpenEarthMap benchmarks cover nine cross-domain transfers. ASCoR achieves a state-of-the-art mean IoU of 68.61% across six ISPRS transfers, outperforming the previous best method by 2.69 percentage points. It also achieves the best results on all three LoveDA/OpenEarthMap transfers, with 59.07%, 47.95%, and 49.38% mIoU on Rural-to-Urban, Urban-to-Rural, and Urban-to-OpenEarthMap, respectively. Ablation studies, feature visualizations, and spatial reliability analyses support the effectiveness and complementarity of the proposed components. Code: https://github.com/WangZitong42/ASCoR.

[239] TaoMate-FVSR:Audio-Guided Facial Video Restoration cs.CVPDF

Xinyang Li, Zeran Xu, Qijun Gan, Chenwei Zhang, Meiguang Jin

TL;DR: 论文提出 TaoMate-FVSR，一种音频引导的面部视频恢复框架，基于参考引导的视频流模型，结合源-噪声混合初始化与结构化参考注入，从低分辨率 AI 生成视频中恢复面部细节，并在音频替换时保持唇齿与语音同步。训练同时包含退化图像/视频恢复和目标音频下的退化配音源校正，以兼顾视觉质量与音画同步。

Details

Motivation: AI 生成视频中人物面部区域分辨率低，传统超分辨率只能提升清晰度，无法判断恢复的嘴唇和牙齿是否与语音一致；论文旨在解决面部细节恢复与音频同步之间的歧义。

Result: 在 talking-head 恢复基准上，该方法在成对感知相似度和同步分数上优于所比较的恢复方法；组件实验验证了音频条件、重建形式和参考注入的作用，AIGC 样例展示了对唇轮廓、牙齿结构和面部纹理的恢复。

Insight: 创新点在于将音频引导引入参考引导视频流恢复，通过源-噪声混合初始化保留部分观测信息，并用结构化参考注入分离外观锚点与连续运动上下文；同时联合恢复训练与目标音频下的配音校正监督，使模型在恢复细节的同时支持视觉配音。

Abstract: AI-generated videos often depict people within detailed scenes while leaving their small facial regions poorly resolved. Visual super-resolution can sharpen these regions without resolving whether the recovered lips and teeth agree with the spoken audio. We present an audio-guided facial video restoration framework that addresses this ambiguity within a reference-guided video flow model. Source–noise mixing initializes reconstruction from a partially preserved observation, and structured reference injection separates appearance anchors from continuous motion context. Training combines restoration of degraded images and videos with correction of degraded dubbed sources under target audio. Appearance and synchronization supervision allow the model to recover facial detail and support visual dubbing when the audio is replaced. On talking-head restoration benchmarks, our method achieves the best paired perceptual similarity and synchronization scores among the compared restoration methods. Component comparisons examine audio conditioning, the reconstruction formulation, and reference injection. Native AIGC examples further illustrate the recovery of lip contours, dental structure, and surrounding facial texture in scene-level footage. injection. Native AIGC examples further illustrate the recovery of lip contours, dental structure, and surrounding facial texture in scene-level footage.

[240] TaoMate-HD: Progressive-Resolution Autoregressive Audio-Video Generation cs.CVPDF

Qijun Gan, Chenwei Zhang, Xinyang Li, Meiguang Jin, Junfeng Ma

TL;DR: 论文提出 TaoMate-HD，一个面向高分辨率音视频流式生成的自回归模型。它按短片段生成，每片段先用两步低分辨率去噪建立粗视频结构，再用一步精炼到高分辨率，并同步生成音频；各阶段将视听预测作为下一片段同阶段的历史，从而支持文本更新下的连续语音与小时级音视频生成。

Details

Motivation: 流式数字人需要边接收新文本边持续说话并生成细节视频，但高分辨率去噪成本高，文本更新还容易导致语音重复或中断。

Result: 实验显示，相比同模型同硬件直接高分辨率生成获得1.6倍加速；优化的阶段并行部署相比串行渐进生成再获得1.9倍整体加速；延续训练使字符错误率相对基线降低11.18个百分点，并支持小时级音视频生成。

Insight: 创新点在于渐进分辨率的分块自回归去噪、跨片段同阶段历史传递以保持跨文本更新的语音连续性，以及生成与蒸馏使用不同文本窗口的非对称文本条件延续训练。

Abstract: Streaming digital humans produce detailed video while continuing speech as new text arrives. High-resolution denoising is costly, and text updates can cause repeated or interrupted speech. We present TaoMate-HD, an autoregressive model for high-resolution audio-video streaming. For each short segment, or chunk, two denoising steps establish coarse video structure at low resolution. A final step refines the video to high resolution, with audio generated throughout the same trajectory. Each stage passes its audiovisual predictions to the same stage of the next chunk as history. Across text updates, the model retains this history to infer what has already been spoken. Continuation training utilizes asymmetric text conditioning, with separate text windows for generation and distillation. Experiments show a 1.6x speedup over direct high-resolution generation with the same model and hardware. Optimized stage-parallel deployment provides a further 1.9x overall speedup over serial progressive generation. Our continuation training reduces character error rate by 11.18 percentage points relative to the baseline. The model also supports hour-long audiovisual generation. Our project page is https://taoliveaigc.github.io/TaoMate-HD.

[241] VidDub: Replacement-Aware Distillation for Two-Step Video Dubbing cs.CVPDF

Yexin Liu, Yunlong Lin, Zehan Wang, Guangxin He, Xinli Xu

TL;DR: 论文面向视频配音任务，提出替换感知的跨音频监督：配对音频样本做全帧重建，替换音频样本屏蔽源嘴区域的重建损失，仅通过音视频同步监督嘴部，同时保留面部其他区域和背景。作者提出VidDub全上下文扩散编辑器，先训练替换感知教师模型获得准确唇同步，再通过匹配轨迹回归和分布匹配蒸馏压缩为两步去噪学生模型，并发布VidDub-Bench等评测资源。

Details

Motivation: 现有视频配音编辑器多在原始配对音频下做自重建训练，但当驱动语音被替换时，源视频中的嘴部会成为冲突的重建目标，导致唇形同步学习受干扰。论文旨在解决替换音频场景下源嘴重建目标与目标语音唇形同步之间的矛盾，同时保持说话人身份、头部姿态和背景。

Result: 在三个训练种子下，屏蔽冲突的源嘴重建使跨音频Sync-C提升0.833；最终两步模型在四个基准上结合了较强唇同步、更优视觉质量、身份保持和视觉语音识别表现。摘要未明确宣称总体SOTA。

Insight: 创新点在于识别源嘴重建与替换语音之间的目标冲突，并设计替换感知的跨音频掩码监督；同时利用离线配音可预先获得完整源视频和目标语音的特点，将全上下文扩散教师蒸馏为2 NFE学生，并用轨迹回归与分布匹配兼顾同步和视觉质量。

Abstract: Video dubbing aims to synthesize lip movements that match target speech while preserving the speaker identity, head pose, and background of a source video. Existing editors are predominantly trained via self-reconstruction under original paired audio, even though the source mouth becomes a conflicting target when driving speech is replaced. We introduce replacement-aware cross-audio supervision: paired-audio samples use full-frame reconstruction, whereas unpaired replacement-audio samples mask out source-mouth reconstruction losses and supervise the mouth solely through audio-visual synchronization while preserving unmasked facial regions and background. Because offline dubbing provides the complete source video and target speech beforehand, we present VidDub, a full-context diffusion editor distilled into two denoising steps (2 NFE). Our replacement-aware teacher first learns accurate lip synchronization without regressing toward conflicting source mouth movements. Matched trajectory regression then transfers the teacher’s CFG-guided trajectories to a two-step student, and distribution matching distillation recovers visual quality after step compression. We will release the curated training dataset, VidDub-Bench, fixed paired- and cross-audio evaluation manifests, preprocessing outputs, and unified evaluation code. Across three training seeds, masking out conflicting source-mouth reconstruction improves cross-audio Sync-C by 0.833; the final two-step model combines strong lip synchronization with superior visual quality, identity preservation, and visual speech recognition across four benchmarks.

[242] Evaluating Depth-Augmented Visual Features for Cross-Dataset Lunar Traversability Estimation cs.CV | cs.ROPDF

Jan Baturo, Bartosz Ptak

TL;DR: 论文面向月球表面自主通行性估计，构建基于稀疏成对标注的弱监督框架，并系统评估在视觉特征中加入深度、表面法向量及组合几何描述子是否能提升跨数据集泛化。作者在两个地球类比数据集和真实嫦娥PCAM月球数据集上进行域内与跨域测试，发现简单几何增强相比强视觉基线并无稳定提升。

Details

Motivation: 月球通信延迟和视线遮挡使连续遥操作受限，自主移动至关重要；但地球类比环境与真实月球地形存在域差距，真实月球通行性标签稀缺，完全监督训练困难。

Result: 实验表明，简单的深度/几何特征增强在域内和跨域设置下均未稳定优于纯视觉强基线，提升幅度相对随机种子间方差较小；训练数据源对迁移质量影响最大，领域相关数据训练出的模型迁移到真实月球影像的效果提升更显著。评估在资源受限边缘设备上运行。

Insight: 主要创新在于用稀疏成对标注弱监督研究月球通行性，并系统评测深度衍生几何特征与跨数据集迁移；客观看，其价值还包括给出受控负结果：朴素几何融合不如选择领域相关训练源重要，为未来更表达力的多模态融合架构提供基线。

Abstract: Autonomous mobility is essential for sustained lunar surface operations, as communication delays and line-of-sight occlusions limit continuous teleoperation. Although recent traversability estimation methods increasingly rely on deep learning, the domain gap between terrestrial analogue environments and real lunar terrain can limit their generalisation, and real lunar traversability labels are scarce, making fully supervised training difficult. To address these challenges, we build a weakly supervised framework trained on sparse pairwise annotations and study whether augmenting visual features with depth-derived geometric information: depth, surface normals, and combined geometric descriptors. We evaluate the models in both in-domain and cross-domain settings using two terrestrial analogue datasets and the real lunar Chang’E PCAM dataset. Contrary to expectations, we find that naive geometric augmentation yields no consistent improvement over a strong visual-only baseline in either setting, with effects small relative to seed-to-seed variance. Instead, the choice of training source emerges as the dominant factor in transfer quality: models trained on domain-relevant sources transfer substantially better to real lunar imagery than the geometric fusion strategy improves any single model. Our evaluation runs onboard a resource-constrained edge device and provides a controlled baseline for designing more expressive multimodal fusion architectures in future lunar perception systems.

[243] Align Once to Explain: Feature Alignment for Scalable B-cosification of Foundational Vision Transformers cs.CVPDF

Raphael Maser, Siddhartha Gairola, Sukrut Rao, Bernt Schiele

TL;DR: 论文提出ALOE，一种一次性、无标签的特征对齐方法，可将基础视觉模型高效转换为内在可解释的B-cos变体。对齐后的B-cos骨干可作为下游任务的直接替代，摊销可解释性成本。该方法适用于监督、自监督和视觉-语言预训练，仅需少量数据即可保持教师模型的泛化能力。

Details

Motivation: 基础视觉模型性能强但黑箱难解释，现有可解释性方法成本高或需重新训练。论文旨在通过一次性特征对齐实现可扩展的B-cos化，兼顾可解释性与性能。

Result: 在ImageNet分类上，DINOv3 ViT-B/16的top-1比普通B-cosification提升10.5个百分点；保留强线性探测、k-NN和零样本迁移，与DINOv3、SigLIP2等基础骨干竞争；保留密集预测所需空间特征，并产生良好定位和人类可解释的解释。

Insight: 摘要宣称的创新点是一次性无标签特征对齐，将任意预训练ViT高效转为B-cos可解释模型并摊销成本。客观看，关键创新是跨预训练范式的特征对齐策略，实现可扩展的可解释性转换而不牺牲下游性能。

Abstract: Foundational vision models have become the de facto standard for many vision tasks due to their strong performance. However, they are notoriously opaque and remain hard to interpret. We present ALOE (ALign Once to Explain), a one-time, label-free feature alignment approach that efficiently converts foundational vision models into inherently interpretable B-cos variants. Once aligned, the B-cos backbone is used as a drop-in replacement across several downstream tasks-amortizing the cost of interpretability. ALOE is robust across pre-training paradigms (supervised, self-supervised, vision-language) and can preserve teacher-level generalization with orders of magnitude less data than training from scratch. On classification, it strongly outperforms vanilla B-cosification (e.g., +10.5 p.p. top-1 on ImageNet for DINOv3 ViT-B/16), retains strong linear probing, k-NN, and zero-shot transfer competitive with foundational backbones (DINOv3, SigLIP2) across diverse downstream datasets. It also preserves spatially structured features useful for dense prediction, while yielding well-localized and highly human-interpretable explanations by design.

[244] Intent2CAD: How Semantic-Parametric Supervision Shapes Text-to-CAD Generation cs.CVPDF

Jinbo Yang, Mingyue Yuan, Shikai Jing

TL;DR: 论文研究文本到CAD生成中的意图导向监督表示问题，提出不改变模型架构或解码流程，而是通过语义提升和参数提升两阶段，将CAD程序中的设计意图显式化为语义特征、可复用参数和轻量参数关系。作者构建IntentCAD-100K文本-CAD代码数据集及IntentCAD-Edit-1K零样本意图保持编辑评测集，并分析不同监督粒度对生成可靠性与可编辑性的影响。

Details

Motivation: 现有文本到CAD生成多关注生成可执行几何程序，但实际CAD工作流还要求生成结果具有可复用结构并支持后续修改。论文希望将设计意图编码为可恢复的代码级信号，从而提升生成程序的可维护性和零样本编辑能力。

Result: 在受控微调下，语义提升主要提升生成可靠性和特征恢复，将IR从2.39%降至0.22%，并达到99.96%的API Recovery；参数提升显式建模可复用关系结构，并进一步改善关系感知的零样本编辑表现。

Insight: 创新点在于从监督表示粒度而非模型结构入手研究文本到CAD生成，将设计意图转化为语义特征、可复用参数和轻量参数关系，并提出保守的两阶段提升流程及配套数据集。客观看，其可借鉴之处是强调生成程序的结构可复用性与意图保持编辑，并通过数据集和评测设计系统分析监督粒度的影响。

Abstract: Text-to-CAD generation aims to make CAD modeling more accessible by generating executable CAD programs from natural-language descriptions. However, practical CAD workflows require more than executable geometry: generated programs should also expose reusable structure that supports later modification. We introduce intent-oriented text-to-CAD generation, where design intent is expressed as recoverable code-level signals: semantic features, reusable parameters, and lightweight parametric relations. Rather than changing the model architecture or decoding procedure, we investigate how supervision representation granularity affects both CAD generation and zero-shot intent-preserving editing. To enable this study, we construct IntentCAD-100K, a 100K paired text–code dataset built by converting low-level CAD construction traces into executable CadQuery programs. We further construct IntentCAD-Edit-1K to evaluate zero-shot intent-preserving editing from the same representation perspective. Intent2CAD uses a two-stage conservative lifting pipeline: semantic lifting rewrites reliable primitive groups into feature-level operations, while parametric lifting exposes lightweight parametric relations. Under controlled fine-tuning, semantic lifting mainly improves generation reliability and feature recovery, reducing IR from 2.39% to 0.22% and achieving 99.96% API Recovery, while parametric lifting makes reusable relation structure explicit and further improves relation-aware zero-shot editing. Datasets and code are available at https://github.com/JinboYang94/Intent2CAD.

[245] Contrastive Adapter Training and Consensus Knowledge Distillation for Multi-Source-Free Domain Adaptation in Skin Cancer Diagnosis cs.CV | cs.AIPDF

Ali Abedi, Q. M. Jonathan Wu, Ning Zhang, Farhad Pourpanah

TL;DR: 论文针对皮肤癌诊断中的多源无源无监督域适应（MSFDA）问题，提出 CAT-CKD 方法：先在冻结的 ViT 主干中训练轻量 ConvPass 适配器，并用监督对比学习建立共享的域不变特征空间；再通过共识知识蒸馏，将多个源模型 logits 聚合为共识监督信号，在无标签目标域上以 KL 散度适配学生模型。

Details

Motivation: 皮肤癌病灶视觉相似且临床数据来源异质，常规域适应需访问源数据，受隐私限制往往不可行；现有 MSFDA 方法依赖全主干微调，易在小临床数据上灾难性遗忘和过拟合，且仅在聚合阶段处理域偏移、缺乏共享域不变特征空间，并受噪声伪标签影响。

Result: 在五个公开皮肤病灶数据集上平均 AUROC 达 86.1%，优于现有 MSFDA 方法，且仅需 4.3M 可训练参数。

Insight: 创新点在于用冻结 ViT 上的轻量 ConvPass 适配器结合监督对比学习，在源模型训练前建立共享域不变特征空间；同时用多源模型 logits 的共识知识蒸馏替代硬伪标签或置信度加权聚合，以降低域偏移下的噪声监督。客观看，其价值在于以低参数适配和共识蒸馏兼顾隐私约束、小数据泛化与跨源知识聚合。

Abstract: Skin cancer diagnosis, particularly differentiating melanoma from benign nevi, is challenging due to the visual similarity between lesions. Although convolutional neural networks (CNNs) and vision transformers (ViTs) have shown promising performance, their effectiveness often deteriorates on data from heterogeneous clinical sources. Conventional domain adaptation methods address domain shift but require access to source data during adaptation, which is often infeasible due to privacy regulations. Multi-source-free unsupervised domain adaptation (MSFDA) addresses this limitation by leveraging multiple labeled source domains to generalize to an unlabeled target domain without requiring access to source data. However, existing MSFDA methods rely on full backbone fine-tuning, leading to catastrophic forgetting and overfitting on small clinical datasets, and address domain shift at the aggregation stage without establishing a shared domain-invariant feature space. Furthermore, their reliance on hard pseudo-labels or confidence-weighted aggregation introduces noisy supervision signals under domain shift. To address these limitations, we propose CAT-CKD, consisting of two components: (1) contrastive adapter training (CAT), which trains lightweight ConvPass adapters within a frozen ViT backbone using supervised contrastive learning (SCL) to establish a shared domain-invariant feature space before source-specific model training, and (2) consensus knowledge distillation (CKD), which aggregates logits from multiple source models into a consensus supervisory signal and adapts a student model on unlabeled target data using KL divergence. Experiments on five publicly available skin lesion datasets show that CAT-CKD achieves an average AUROC of 86.1%, outperforming existing MSFDA methods while requiring only 4.3M trainable parameters. The code is available at https://github.com/A-Abedi/CAT_CKD.

[246] PlantVLM-Edge: Quantized Vision-Language Models for On-Device Crop Health Diagnosis cs.CV | cs.AIPDF

Gaurab Wagle, Bishal Adhikari, Jiajia Li, Xiaolei Huang, Dong Chen

TL;DR: 论文提出PlantVLM-Edge，一个面向资源受限边缘设备的量化视觉语言模型框架，用于对话式作物健康诊断。该框架结合农业领域适应、训练后量化和离线聊天界面，在NVIDIA Jetson AGX Orin上验证了两种VLM骨干（Qwen3-VL-2B和LLaVA-1.5-7B）、四种量化方案和两个诊断领域，实现了低内存占用和快速响应。

Details

Motivation: 作物健康诊断需要专家知识但难以随时获取，视觉语言模型虽具备视觉理解与推理能力，但其计算和内存需求大，难以部署在资源受限的边缘设备上，因此需要一种能在设备端离线运行的轻量化诊断方案。

Result: 8-bit量化对答案质量影响极小；4-bit AWQ在植物病害和虫害两个领域保留98.6%的全精度答案质量，并将2B骨干的权重内存减少49%。最紧凑形式下权重内存仅2.01 GiB，首token返回约0.12秒，完成64token诊断响应约0.78秒。

Insight: 创新点在于将农业领域适应、后训练量化和设备端离线服务相结合，构建骨干无关的量化VLM框架，并系统验证了多种VLM架构和量化方案在边缘设备上的可行性，为下一代作物监测与决策支持系统提供了可落地的基础。

Abstract: Timely and accurate crop health diagnosis is essential for sustainable agricultural production, yet accurate diagnosis often requires expert knowledge that is not readily available. Recent vision-language models (VLMs) have demonstrated remarkable capabilities in visual understanding, reasoning, and natural-language interaction, creating new opportunities for intelligent crop health assessment. However, deploying VLMs on resource-constrained devices remains challenging due to their substantial computational and memory requirements. This paper presents PlantVLM-Edge, a quantized vision-language framework for conversational crop health diagnosis that can run entirely on resource-constrained edge devices. PlantVLM-Edge combines agricultural domain adaptation, post-training quantization, and on-device serving with an offline chat interface, allowing growers to ask open-ended questions and receive diagnoses, symptom explanations, and management guidance without cloud connectivity. The framework is backbone-agnostic: we validate it with two different VLM types with varying scale and architecture (Qwen3-VL-2B and LLaVA-1.5-7B), four quantization schemes, and two diagnostic domains (plant diseases and insect pests), and we deploy all variants on an NVIDIA Jetson AGX Orin. Eight-bit quantization affects answer quality minimally relative to the full-precision model, and 4-bit activation-aware weight quantization (AWQ) retains 98.6% of full-precision answer quality on both domains while reducing the weight memory of the 2B backbone by 49%. In its most compact form, PlantVLM-Edge requires 2.01 GiB of weight memory, returns its first token in about 0.12 s, and completes a 64-token diagnostic response in 0.78 s. These results demonstrate that timely and accurate crop health diagnosis is practical on edge devices, providing a foundation for next-generation crop monitoring and decision support systems.

[247] Reviso: Not All Visual Evidence Deserves Equal Attention in Video Captioning cs.CVPDF

Tengfei Liu, Yang Shi, Yuran Wang, Yuqi Tang, Yizhuo Jia

TL;DR: 论文提出Reviso，一个智能体视频描述框架，通过分层观察计划（上下文-焦点-要点）主动选择性地关注重要视觉证据，并利用验证引导的流程构建训练数据，结合组相对策略优化（GRPO）训练模型。在四个视频描述基准上，Reviso优于评估的开源基线，且生成的描述更好地支持下游视频问答。

Details

Motivation: 多模态大语言模型生成的视频描述常过度强调次要细节而忽略关键上下文和事件。作者认为视觉证据的重要性因视频内容而异，并非所有证据都值得同等关注，因此需要学习观察什么以及如何收集相关视觉证据。

Result: 在四个视频描述基准上的实验表明，Reviso优于评估的开源基线，并且其生成的描述在下游视频问答任务中表现更好，验证了优先级引导主动观察的有效性。

Insight: 论文的创新点包括：提出智能体视频描述框架，通过分层观察计划（上下文-焦点-要点）实现目标导向的主动感知；设计验证引导的训练轨迹构建流程；在GRPO训练中引入关键事实奖励、计划对齐奖励和无效工具调用惩罚。客观分析认为，其核心创新在于动态选择性地重访关键片段并整合全局与局部信息，而非均匀处理所有视觉证据，从而提升描述质量。

Abstract: Multimodal large language models (MLLMs) can generate detailed video captions, yet they may overemphasize minor details while overlooking essential context and key events. We argue that not all visual evidence deserves equal attention, as the importance of visual information depends on the content of each video. Motivated by this observation, we propose Reviso, an agentic video captioning framework that learns what to observe and how to gather relevant visual evidence. From a low-frame-rate global preview, Reviso constructs a hierarchical Context–Focus–Points (CFP) observation plan that identifies the video context, prioritizes key aspects, and defines concrete observation targets and corresponding tools. Guided by this plan, Reviso performs goal-directed active perception by selectively revisiting temporal segments and combining tools for fine-grained inspection. It interprets the acquired evidence, updates its plan as needed, and integrates global and local information to generate the final caption. To learn this observation strategy, we develop a verification-guided pipeline that constructs high-quality training trajectories through factual verification and teacher-guided refinement. We further train Reviso using Group Relative Policy Optimization (GRPO), incorporating a key-fact reward for caption quality, a Plan Alignment Reward (PAR) for identifying important observation targets, and an Unproductive Tool-Call Penalty (UTCP) that adjusts observation-cost penalties based on caption quality. Experiments across four video captioning benchmarks show that Reviso outperforms the evaluated open-source baselines, while its generated captions better support downstream video question answering. These findings highlight the effectiveness and potential of priority-guided active observation for video captioning.

[248] Isekai3D SDG: A Platform for Diverse Synthetic Gameplay Visual Data cs.CVPDF

Rafal Karp, Gene Liu, Shih-Hsin Li, Eric Courtemanche, Shengze Wang

TL;DR: 论文提出了 Isekai3D SDG，一个基于 Unreal Engine 的合成 3D 游戏视觉数据生成平台，用于视觉模型、世界模型、神经图形和游戏智能体等研究。平台采用“先仿真、后采集”的两阶段流程：先记录游戏过程的世界状态、角色动作和相机轨迹，再回放并按不同渲染与相机配置生成视频、图像、深度图等数据。生成数据带有逐帧对齐的相机、角色和动作元数据，并可直接以训练友好格式上传。

Details

Motivation: 面向视觉、世界模型、神经图形和游戏智能体等研究，需要多样化且可控的合成 3D 游戏视觉数据；论文希望降低数据生成、存储、预处理和人工处理成本。

Result: 论文主要介绍平台系统设计、资产、插件及其协作方式，未提及定量实验结果或 benchmark 对比，因此没有 SOTA 等性能结论。

Insight: 创新点在于将世界仿真与视觉采集解耦：同一段记录的游戏过程可回放生成多种输出变体而无需重复仿真；结合可复用环境/角色资产与 Unreal Engine 插件，并附带帧对齐元数据和训练友好格式，提升合成数据生成的灵活性与效率。

Abstract: We present Isekai3D Synthetic Data Generation (SDG), a platform for simulating and capturing synthetic 3D gameplay for research in vision and world models, neural graphics, gameplay agents, and other applications. The platform combines reusable environment and character assets with Unreal Engine plugins in a two-stage workflow. First, world simulation generates gameplay while recording the world state, character movements, actions, and camera tracks needed for replay. Second, the recorded simulation is replayed to capture selected outputs, such as rendered video, images, and depth maps, at a specified resolution and frame rate under selected rendering and camera configurations. Separating simulation from capture allows the same recorded gameplay to produce multiple output variants without repeating the original simulation. Visual outputs are accompanied by frame-aligned camera, character, and action metadata. The platform uploads generated data directly in a training-friendly format, reducing intermediate storage, preparation time, and manual processing. This report describes the design of our overall system, including the platform’s assets, plugins, and their functionality, explaining how they work together to generate diverse synthetic gameplay data.

[249] EgoActionBench: Benchmarking Dense Action Captioning for Egocentric Human Videos cs.CVPDF

Yujiao Shen, Jiahe Song, Haitian Li, Jingkang Yang, Ziwei Liu

TL;DR: 论文提出 EgoActionBench，一个面向第一视角人类视频的密集动作描述基准，将连续操作表示为与左手、右手或双手关联的时间局部原子动作。该基准包含 1,407 个片段和 41,132 条人工精修动作标注，并提出联合评估语义保真度、时间重叠、动作精确率/召回率以及手部关联的评测协议。论文评测了 20 个基线模型，并通过监督微调加强化学习适配 Qwen3-VL-4B 和 LLaVA-OneVision-2-8B。

Details

Motivation: 现有基准在动作原子性、时间精度和手-动作关联方面存在不足，而具身智能需要模型从第一视角观测中准确理解细粒度人类动作。论文旨在填补通用视频理解与具身智能所需动作理解之间的评测空白。

Result: EgoAction 方法在两个骨干模型上分别将 EgoActionScore 提升 15.9 和 23.2 分，且两个适配模型均优于所有开源基线。实验还揭示当前模型在动作原子性、时间精度和手-动作关联上仍有明显局限。

Insight: 创新点在于将连续人类操作建模为带手部归属的时间局部原子动作，并设计同时评估“发生了什么、何时发生、哪只手执行”的密集预测评测协议。客观来看，其基准构建、细粒度评测以及 SFT+RL 的适配流程对具身动作理解研究具有借鉴价值。

Abstract: Learning from human data offers a scalable path toward embodied intelligence, yet it requires models to accurately understand fine-grained human actions from egocentric observations. However, existing benchmarks remain limited in action atomicity, temporal precision, and hand-action association. We introduce EgoActionBench, a benchmark that represents continuous human manipulation as temporally localized atomic actions associated with the left hand, right hand, or both hands. EgoActionBench contains 1,407 episodes with 41,132 human-refined action annotations. To evaluate such dense predictions, we propose an evaluation protocol that retrieves temporally eligible candidates, selects a prediction by content agreement, and scores semantic fidelity and temporal overlap alongside action precision and recall, jointly capturing what happens, when it happens, and which hand performs it. We benchmark 20 baseline models and systems on EgoActionBench and further adapt two backbones, Qwen3-VL-4B and LLaVA-OneVision-2-8B, through supervised fine-tuning followed by reinforcement learning on automatically annotated training episodes. EgoAction improves EgoActionScore by 15.9 and 23.2 points on the two backbones, and both adapted models outperform all open-source baselines. Our experiments reveal substantial limitations of current models in action atomicity, temporal precision, and hand-action association, highlighting the gap between general video understanding and the action understanding required for embodied intelligence.

cs.AI [Back]

[250] AuroraWorld: Structured 4D World Modeling for Exo-to-Ego Video Generation in Robot Manipulation cs.AI | cs.CVPDF

Hao Xue, Peng-Fei Zhang, Ying Cheng, Lanyun Zhu, Lei Zhu

TL;DR: 论文提出 AuroraWorld，面向机器人操作中的外中心到自中心（Exo-to-Ego）视频生成任务，利用结构化 4D 世界建模从大规模外中心操作视频合成自中心观测，以缓解自中心操作数据采集昂贵的问题，并强调生成视频需具备物理一致性和策略相关性。

Details

Motivation: 自中心观测对视觉运动策略学习很重要，但大规模采集成本高；现有外中心到自中心合成方法在大视角变换、严重遮挡、复杂物体交互和外中心观测稀疏等条件下难以生成物理一致且策略相关的自中心视频。

Result: 摘要中未提及具体定性/定量结果、benchmark 或 SOTA 水平。

Insight: 摘要宣称的创新点在于采用结构化 4D 世界建模完成外中心到自中心视频生成，以应对大视角变化、遮挡、复杂交互和稀疏观测。客观看，其可借鉴之处是将 4D 结构化世界表示引入跨视角机器人视频合成，以提升生成视频的物理一致性和对策略学习的相关性。

Abstract: Egocentric observations provide a robot-centric view of manipulation processes, capturing contact interactions and object-state changes that are important for visuomotor policy learning but difficult to observe from external cameras. However, collecting such data at scale remains expensive due to additional hardware requirements and platform-specific deployment costs. Synthesizing egocentric observations from large-scale exocentric manipulation videos provides a scalable alternative. However, existing methods struggle to synthesize physically consistent and policy-relevant egocentric videos under substantial viewpoint transformations, severe occlusions, complex object interactions, and inherently sparse observations from available exocentric viewpoints.

[251] From Small to Large: Assessing Medical Reasoning, Benchmark Contamination, and Model Size in Language Models cs.AI | cs.CLPDF

Navapat Nananukul, Mayank Kejriwal

TL;DR: 该论文系统评估14个语言模型在四个医学基准上的医疗问答能力，比较标准多选、隐藏选项和仅由选项重建问题三种设置，考察模型规模、基准记忆/污染、推理成本及模型集成的影响。研究发现大模型在标准多选上可超越人类专家基线，但小模型明显落后；隐藏选项后性能大幅下降，且医学专门模型下降最大；强模型能重建部分题目但未明显影响不可重建题目的准确率。

Details

Motivation: 现有LLM在医学考试题上达到或超过专家水平，但尚不清楚这些分数是否反映临床能力，还是受题型格式、基准公开导致的记忆/污染和题目难度影响；同时需评估可在医院本地部署的小模型是否达到人类水平。

Result: 在MedQA-USMLE和PubMedQA标准多选设置中，最强模型超过人类专家基线；但小模型较大模型平均低8.7个百分点，六个provider中仅两个通过执照考试人类专家线。隐藏选项后平均准确率从82.3%降至50.9%，医学专门模型下降最大；最强模型可从选项重建约四分之一问题，但在不可重建问题上准确率保持。

Insight: 创新点在于联合评估医学推理、基准污染和模型规模，并设计隐藏选项与从选项反推问题来探测记忆；同时将准确率与推理成本、模型集成效果结合分析。客观看，其价值主要是对医学LLM评测有效性和小模型临床部署可行性的系统诊断。

Abstract: Large language models (LLMs) now answer medical exam questions at or above expert level, but it is unclear whether such scores reflect clinical competence, or are instead affected by the format of the questions being asked (e.g., multiple-choice versus open-ended), prior exposure to the benchmarks, and the difficulty of the questions. These benchmarks are also public and widely used online, which may be resulting in LLM memorization. Models may perform better on questions that they have seen before. It is also not evident whether smaller models, which are more locally deployable in HIPAA-compliant hospital settings, have achieved human performance. In this study, we evaluate fourteen current models from six leading providers, one smaller and one larger model from each provider with two additional open-weight models, on 3,076 questions from four medical benchmarks (MedQA-USMLE, MedMCQA, PubMedQA, and MedBullets) under standard multiple choice, the same questions with the answer choices withheld, and reconstruction of a hidden question from its choices alone. In the standard multiple-choice setting, the strongest models exceed the human-expert baseline on MedQA-USMLE and PubMedQA, but the smaller models trail their larger models by 8.7 percentage points and only two of the six pass the human-expert bar on the licensing examination. Withholding the answer choices, however, makes every model struggle: mean accuracy falls from 82.3% to 50.9%, and the two largest drops belong to the medically specialised models. On memorization, the strongest models reconstruct one question in four from the answer choices alone, yet accuracy holds on the questions they cannot reconstruct. We further weigh accuracy against inference cost and test whether ensembling several models improves medical question answering.

[252] Agentic Context Management for Multi-Turn Human-AI Conversations cs.AI | cs.CLPDF

Matthew Ho, Chenglong Wang, Baolin Peng, Nebojsa Jojic, Philippe Laban

TL;DR: 论文研究多轮人机对话中LLM因上下文污染而性能下降的问题：模型早期助手输出留在上下文中会锚定后续回答，即使被用户纠正也可能持续误解意图。作者提出无需训练的Agentic Conversation Context Curation（AC3），用独立分析器仅从用户消息整合任务规范、审计助手历史输出，并通过追加分析或丢弃助手侧并从规范重建上下文来整理对话。论文还发现污染具有传染性，分析器若看到助手推理会受影响，因此需结构性排除助手轮次。

Details

Motivation: 多轮对话中，助手历史输出会造成上下文污染，使早期误读用户意图在后续轮次持续存在；简单丢弃所有助手消息（AO）虽能去污，但会破坏对草稿、决策和工具调用结果的指代性依赖。论文旨在在保留必要交互信息的同时去除助手侧污染。

Result: 在Lost in Conversation上，AC3在四个任务中的三个缩小了全上下文与AO之间55-84%的差距，并在第四个任务上超过AO；忠实摘要历史的LLM即使增加计算也不能复现该收益。在WildChat上，GPT-5-mini评判器在主表所有配置中更偏好AC3的下一轮回答，但该偏好依赖评判器；CollabLLM结果混合。在tau2-bench有状态工具使用中，AO在所有模型上崩溃至0%，AC3不崩溃但略逊于全上下文。

Insight: 论文的创新点在于将多轮上下文管理建模为独立的分析器流程：从用户消息重建任务规范、审计助手历史输出并编辑上下文，且无需训练。客观上有借鉴意义的是其发现“污染传染”并采用结构性排除助手轮次而非仅靠指令忽略，同时表明收益主要来自从规范重建上下文，而非简单删除污染片段或做普通历史摘要。

Abstract: LLMs degrade in multi-turn conversation partly because of context pollution: the model’s own earlier outputs stay in context and anchor later turns, so an early misreading of the user’s intent can persist after the user corrects it. Assistant omission (AO), dropping every assistant message, removes this pollution but fails when interaction is referential: later turns refer back to drafts, decisions, and tool-call results that exist only in assistant turns. We propose Agentic Conversation Context Curation (AC3), a training-free method in which a separate analyzer (1) consolidates the task specification from the user’s messages alone, (2) audits the assistant’s prior outputs against it, and (3) edits the context, either appending the analysis or discarding the assistant side and rebuilding the context from the specification. A second finding: pollution is contagious. An analyzer that sees the assistant’s reasoning while extracting the specification can do worse than no intervention, and instructing it to ignore them did not close the gap, so we exclude assistant turns structurally. On Lost in Conversation (replaying difficulty-selected instances), where AO is an oracle by construction, AC3 closes 55-84% of the gap between full context and AO on three of four tasks and exceeds AO on the fourth, and an LLM that faithfully summarizes the history does not reproduce the gain even with more compute. On real WildChat conversations, a GPT-5-mini judge prefers AC3’s next turn over both full context and AO in every configuration of our main table, though this preference depends on the judge; on CollabLLM results are mixed. In stateful tool use (tau2-bench), AO collapses to 0% on every model; AC3 does not collapse, though it falls slightly behind full context. Detector studies show that Reset removes injected pollution but is not span-selective: the gain comes from rebuilding the specification.

[253] Learning by Doing: Autonomously Compiling and Curating Agent Skills from Verified Traces cs.AI | cs.CLPDF

Daniel Chalef, Peter Evans, Pavlo Paliychuk, Mehul Patel, Preston Rasmussen

TL;DR: 论文介绍 Zep Agent Skills，一个面向生产环境 LLM Agent 的程序性记忆服务：将已验证的任务尝试记录为 Trace，通过 Reflector 与 Curator 编译成带版本、可引用证据的 Skill，并通过准入、分发和检索机制供 Agent 使用。系统强调仅使用验证过的尝试、字段级证据引用和 Skill 版本治理，并支持开放 Agent Skills 格式及 API/MCP 检索。

Details

Motivation: 现有 Agent 记忆多存储语义记忆或情节记忆，研究系统虽能从运行中学习流程但缺乏生产级服务。论文旨在为已部署 Agent 提供可自动编译、验证、治理和分发的程序性记忆，解决 Skill 学习与可靠复用问题。

Result: 在 τ³-bench banking、AppWorld 和 EnterpriseOps-Gym 上，由教师模型 Trace 编译的 Skill 使三个较弱执行器模型在各推理强度下通过率提升 4.5 至 18.8 个百分点，增益主要来自教师已解决任务；在 ALFWorld 上，小模型运行编译的 Skill 取得与或优于先前连续微调的增益，且无需训练。

Insight: 创新点在于生产级程序记忆闭环：仅用验证成功证据、每个 Skill 字段引用支持事件、Reflector/Curator 分离编译、准入门控与版本治理，并用验证使用结果调整 Skill 搜索排名。客观看，其可借鉴处是以验证驱动和版本化治理提升 Skill 可靠性，并以开放格式和渐进披露检索实现跨宿主复用，无需训练即可增强弱模型。

Abstract: Memory systems for production LLM agents mostly store semantic memory (facts about users and domains) or episodic memory (earlier interactions). Research systems such as Trace2Skill, WikiSkill, and SkillRevise learn procedures from agent runs, package them as Skills, and evaluate them on benchmarks. We describe Zep Agent Skills, a production service that gives deployed agents this procedural memory. The service uses only verified attempts as evidence, cites the supporting events for each field of a Skill, and governs the admission and distribution of each Skill version. The service records each task attempt as a Trace with ordered events, an outcome, and a verification strength. A compiler with separate Reflector and Curator roles turns verified Traces into versioned Skills. Scans and admission gates control which candidates become active, and verified use outcomes change the search rank of each Skill. The Agent Skills format is an open standard that Anthropic originated and donated to the Agentic AI Foundation, so any host of the format can load a compiled Skill. Agents retrieve Skills through lexical search with progressive disclosure, over an API or MCP. We evaluate Zep Agent Skills on $τ^3$-bench banking, AppWorld, and EnterpriseOps-Gym. Skills compiled from the Traces of a teacher model increase the pass rate of three weaker executor models on the same tasks, at every reasoning effort, by 4.5 to 18.8 points. Most of the gain is on the tasks that the teacher solved. On ALFWorld, Skills compiled from the runs of a small model give a gain similar to or larger than the gain that prior work reports for continuous fine-tuning, with no training.

[254] FOCUS: Closed-Loop Attention Feedback for Efficient Vision-Language Understanding cs.AI | cs.CVPDF

Akul Santhosh, Aastha Jhunjhunwala

TL;DR: 论文提出 FOCUS，一个免训练的三层闭环框架，用于高效流式视频视觉语言理解。它通过时序门控只在场景发生语义变化时触发突发采样，减少 VLM 调用次数；再利用块级差异与自顶向下注意力先验融合成空间焦点图，校准 VLM 的 value cache，引导模型关注任务相关区域；最后将解码器的文本到视觉交叉注意力反馈为下一轮先验，形成闭环。

Details

Motivation: 逐帧处理视频会带来高昂推理成本并限制实时理解；现有方法要么均匀采样忽略内容、漏掉重要事件，要么剪枝视觉 token 降低单次成本但仍对每个采样帧调用模型。论文旨在同时减少 VLM 调用次数，并让每次调用聚焦真正重要的内容。

Result: 在 EgoSchema 500 个视频的流式评测中，使用 Qwen3-VL-8B，FOCUS 以每片段 25.4 次 VLM 调用达到 74.8% 准确率，优于均匀采样 55 次调用的 74.6% 和 BOLT 55 次调用的 74.2%。在四个领域的第一视角视频描述任务上，其质量匹配最佳基线，同时比均匀采样少 57% 的 VLM 调用。

Insight: 论文宣称的创新在于免训练的三层闭环注意力反馈机制：时序门控触发突发采样、空间焦点图校准 value cache 而不删除 token、以及将解码器交叉注意力反馈为下一轮先验。客观来看，其创新点在于把稀疏采样与模型内部注意力调制结合成闭环系统，在不训练模型的情况下实现调用成本和关注区域的协同优化。

Abstract: Processing every video frame through Vision-Language Models (VLMs) adds significant inference cost and limits their ability to comprehend real-time video. Existing approaches either sub-sample frames uniformly, ignoring content and missing important events, or prune visual tokens inside the VLM to cut per-call cost while still invoking the model on every sampled frame. We introduce FOCUS, a training-free three-layer framework that reduces the number of invocations and steers each one towards what matters. Temporal gating measures inter-frame dissimilarity in the patch-embedding space of a smaller VLM from the same family, triggering burst captures only when the scene changes in a semantically meaningful way. Patch-level dissimilarity is then accumulated across the burst and fused with a top-down attention prior into a spatial focus map that encodes where motion and semantic relevance coincide. That map calibrates the VLM’s value cache during generation, progressively amplifying vision tokens in task-relevant regions and attenuating off-target ones, without removing any token from the context. The loop closes after each response: text-to-vision cross-attention is extracted from the decoder and fed back as the prior for the next burst, letting the system converge on semantically important regions over successive observations. We evaluate FOCUS on the 500-video EgoSchema subset in streaming mode, with a single Qwen3-VL-8B backbone shared by every method. It reaches 74.8% accuracy using 25.4 VLM calls per clip, against 74.6% with 55 calls for uniform sampling and 74.2% with 55 calls for BOLT. On egocentric video captioning across four domains, it matches the best baseline’s quality while issuing 57% fewer VLM invocations than uniform sampling.

[255] Seeing What Matters, Verifying What Pays: Load-Adaptive Speculative Decoding for Vision-Language Models cs.AI | cs.CVPDF

Hong Nie, Zhangchi Gao, Yuqian Liang, Jun Yu, Bo Wang

TL;DR: 论文提出 Uni-LaSpec，一种面向视觉语言模型（VLM）的块并行推测解码框架，同时解决草稿质量与验证开销分配两个问题。在草稿端，它复用验证器自身的注意力，从缓存的 int8 量化视觉键中挑选少量关键视觉 token，通过门控交叉注意力注入草稿模型，并用接受感知训练加权草稿位置；在验证端，它以边际成本准则为每个请求、每轮动态选择验证结构：轻负载时用草稿树利用空闲算力，重负载时用动态头部截断线性草稿。

Details

Motivation: 推测解码可无损加速 VLM 推理，但现有草稿模型要么缺乏视觉落地 token 所需的图像证据，要么为每个视觉 token 付出条件化成本，而实际上短草稿块仅依赖少量图像区域；同时，额外候选验证的价值随 GPU 负载变化，不存在跨服务场景都高效的固定验证结构。

Result: 在 3 个模型家族共 6 个 VLM、17 个文本与多模态基准上，仅选 8 个视觉 token 即以亚毫秒级选择开销保留全图至少 98.6% 的接受率；并发为 1 的贪心解码下，文本与多模态吞吐分别最高达自回归解码的 5.11 倍和 3.24 倍；在 6 种负载水平和 3 种 GPU 上均优于自回归解码，并在 144 种设置中的 123 种达到或超过最佳固定验证策略；突发到达场景下端到端平均时延较线性验证降低 47.6%。

Insight: 创新点在于：复用验证器已有注意力与缓存量化视觉键做轻量视觉 token 选择，避免重复编码全图；以跨层投票与门控交叉注意力融合少量视觉证据，并用接受感知训练对齐草稿位置贡献；将验证结构选择建模为按请求、按轮次的边际成本决策，实现负载自适应的树/线性草稿切换。客观来看，把“看什么”与“验多少”解耦并分别做稀疏化与代价感知调度，是较为实用且通用的系统级思路。

Abstract: Speculative decoding accelerates vision-language model (VLM) inference without altering the output distribution, yet two factors limit its gains. Existing drafters either lack the image evidence required for visually grounded tokens or pay to condition on every visual token, although a short draft block typically depends on only a few image regions. Moreover, the value of verifying additional candidates varies with GPU load, so no fixed verification structure is efficient across serving conditions. We present Uni-LaSpec, a block-parallel speculative decoding framework that addresses both factors. To improve draft quality, Uni-LaSpec reuses the verifier’s own attention: the query retained from the preceding verification ranks the cached, int8-quantized visual keys, and a cross-layer vote selects a few visual tokens that the drafter fuses through gated cross-attention. Acceptance-aware training further weights each draft position by its contribution to the accepted prefix. To allocate verification, a marginal-cost criterion selects the structure per request and per round: draft trees exploit idle verifier capacity under light load, whereas a dynamic head truncates linear drafts under heavy load. Across six VLMs from three model families and 17 text and multimodal benchmarks, selecting eight visual tokens retains at least 98.6% of the acceptance obtained from the full image at sub-millisecond selection cost. With greedy decoding at concurrency one, Uni-LaSpec achieves up to 5.11x text and 3.24x multimodal throughput over autoregressive decoding. Across six load levels and three GPU types, it outperforms autoregressive decoding in every setting and matches or exceeds the best fixed verification strategy in 123 of 144 settings; under bursty arrivals, it reduces mean end-to-end latency by 47.6% relative to linear verification.

[256] TriPhysBench: Evaluating Physical Intelligence for Embodied Agents cs.AI | cs.CVPDF

Zhongxiang Sun, Chenghao Yang, Haojie Ding, Boheng Zhang, Fan Yang

TL;DR: 论文提出 TriPhysBench，一个包含 200 个视频、410 道问题的具身智能物理智能评测基准，统一考察物理感知、物理知识检索和物理推理能力；并进一步提出 TriPhys 框架，从完整工具集成轨迹中学习统一策略，以提升视觉语言模型在物理场景中的定量推理表现。

Details

Motivation: 现有基准多关注物理理解或通用工具使用，但具身智能体在物理场景中协同运用物理感知、知识检索与推理的能力仍缺乏系统评测，论文旨在填补这一空白并探索相应学习路径。

Result: 在六个代表性视觉语言模型中，TriPhysBench 上最佳答案准确率仅 50.38%；TriPhys 在 110 道未见视频问题上使三种 Qwen 配置的答案与解答得分均提升，其中 TriPhys-27B 相比 Qwen3.6-27B 主干答案准确率相对提升 17.7%。

Insight: 创新点在于受 Popper 三世界启发构建共享评测框架，并以测量型和知识型子任务互补考察观察获取与外部规范应用；方法上通过工具集成轨迹学习统一策略，利用中间推理引导检索与计算，并将工具反馈融入后续物理推断。

Abstract: Embodied agents need physical intelligence to understand their surroundings through physical perception, physical knowledge retrieval, and physical reasoning. These capabilities must work together to interpret events and make quantitative judgments. Existing benchmarks advance physical understanding and general-purpose tool use, yet the coordination of these capabilities in physical scenarios remains insufficiently characterized. Inspired by Popper’s Three Worlds, we introduce TriPhysBench, a benchmark of 410 questions from 200 videos that brings physical perception, physical knowledge retrieval, and physical reasoning into a shared evaluation setting. Its measurement-grounded and knowledge-grounded subtasks impose complementary demands on obtaining observations and acquiring external specifications, then applying them to quantitative problems. Among six representative vision-language models, the best achieves an answer accuracy of only 50.38%, revealing limited performance on tasks that require these capabilities to work together. We further introduce TriPhys, a framework that learns a unified policy for physical perception, knowledge retrieval, and quantitative reasoning from complete tool-integrated trajectories. The policy uses intermediate reasoning to guide retrieval and computation, then incorporates tool feedback into subsequent physical inference. On 110 questions from videos excluded from training, TriPhys improves answer and solution scores across three Qwen configurations, with a 17.7% relative gain in answer accuracy for TriPhys-27B over its Qwen3.6-27B backbone. This work provides a benchmark and a learning pathway toward embodied agents that move beyond recognizing events to understanding and reasoning about the physical processes behind them.

[257] To Align Long, Plan Short: Simulating Diverse Profile-Aligned Students by Realizing Short-Term Plans in Long-Horizon Learning Environments cs.AI | cs.CL | cs.CYPDF

Bahar Radmehr, Jiaxu Zhao, Fatma Betül Güreş, Adish Singla, Tanja Käser

TL;DR: 论文提出 ALPS，一种面向开放式长时程学习环境的分层模拟学生方法。它以可观测、环境相关的行为画像为条件，交替进行符合画像的任务片段规划与具体动作生成，从而避免逐回合提示导致行为漂移。作者在探究式物理游戏和药房模拟中，用真实学生轨迹或教师 LLM 监督，比较 ICL、SFT、RAFT 及其组合，验证 ALPS 在长时程交互中更能保持画像一致性。

Details

Motivation: 现有基于 LLM 的模拟学生多针对短时、语言中心交互，而开放式学习环境中的学生行为体现在长时程轨迹中，逐回合生成容易偏离指定行为画像。论文旨在实现可扩展、忠实于行为画像的长时程学生模拟。

Result: 在探究式物理游戏和药房模拟两个环境中，ALPS 在数据充足与数据稀缺设置下均优于逐回合生成；在稀缺监督下，其行为密度和 LLM 裁判通过率与对比方法相当，但行为覆盖率仍较低。

Insight: 核心创新是将长时程行为对齐转化为短时任务片段规划，并交替执行“规划画像对齐片段”和“生成对应动作”，从而在有限真实学生数据下保持长时程画像一致性。客观看，分层规划与行为画像条件是主要可借鉴点。

Abstract: Simulated students offer a scalable way to test learning platforms and AI tutors before deployment with real students and to augment scarce data for studying learning at scale. Existing LLM-based simulators primarily target short, language-centered interactions. In open-ended learning environments, however, student behavior emerges from patterns across long-horizon interaction trajectories, where turn-level prompting can drift from an assigned behavior profile. We introduce ALPS (Align Long-term by Planning Short-term), a hierarchical simulated student conditioned on observable, environment-specific behavior profiles. Rather than selecting every action independently, ALPS alternates between planning profile-aligned task segments and generating the corresponding actions. We evaluate ALPS in both data-sufficient and data-scarce settings, where supervision comes either from real student trajectories or from a teacher LLM. Across both settings, we compare in-context learning (ICL), supervised fine-tuning (SFT), reward-ranked fine-tuning (RAFT), and their sequential combination (SFT followed by RAFT). Experiments in an inquiry-based physics game and a pharmacy simulation evaluate behavioral density and coverage against held-out real data, and profile consistency using a human-aligned LLM judge. Across both settings, ALPS consistently outperforms turn-level generation, achieving comparable density and judge pass rates under scarce supervision, although coverage remains lower. These results show that hierarchical planning enables faithful, profile-aligned simulation over long interaction horizons, even with limited real student data.

[258] ClickSight: An LLM Framework for Interpreting Student Clickstreams Through Learning Strategies cs.AI | cs.CL | cs.CYPDF

Bahar Radmehr, Lan Tran, Ekaterina Shved, Fatma Bet{ü}l G{ü}reş, Adish Singla

TL;DR: 论文提出ClickSight框架，利用分阶段LLM流程将学生点击流与文献定义的学习策略关联，识别策略相关证据、评估策略遵循度并生成基于证据的行为解释。在两个学习环境、365名学生和12个模型骨干上评估，表明其能跨模型和环境生成高质量策略解释，推理模型表现更一致，且外部点击流提取指导可提升需精确定量信息的策略解释质量。

Details

Motivation: 数字学习环境产生的细粒度点击流数据能揭示学生学习方式，但解释这些轨迹通常需要大量专家投入，缺乏自动化方法将点击流与理论定义的学习策略有效结合。

Result: 在两个学习环境、365名学生和12个模型骨干上，使用专家基础质量评分和经人类专家评级校准的LLM评判进行评估；ClickSight能跨模型和环境生成高质量策略解释，推理模型比指令调优模型表现更稳定，提供外部点击流提取指导可改善需精确定量信息的策略解释质量。

Insight: 创新点在于将细粒度点击流与文献定义的学习策略连接，采用分阶段LLM流程保留每个判断的证据以生成可解释的解释；客观可借鉴之处包括分阶段证据识别与策略对齐机制、证据保留设计，以及通过校准LLM评判进行可扩展评估的方法。

Abstract: Digital learning environments produce rich clickstream data that can reveal how students approach learning tasks, yet interpreting these fine-grained traces often requires substantial expert effort. We introduce ClickSight, a framework for interpreting student clickstreams through learning strategies defined in the literature. Given a student clickstream and a predefined set of learning strategies, ClickSight uses a staged LLM-based pipeline to identify strategy-relevant evidence, assess adherence to each strategy, and generate an evidence-grounded interpretation of the student’s behavior. We evaluate ClickSight across two learning environments, 365 students, and 12 model backbones using an expert-grounded quality rubric and an LLM judge calibrated with human-expert ratings. Our results show that ClickSight can generate high-quality strategy-based interpretations across different models and environments, with reasoning models performing more consistently than instruction-tuned counterparts. We further find that providing external clickstream-extracted guidance can improve interpretation quality for strategies that require precise quantitative information from the trace. By connecting fine-grained clickstreams with theoretically defined learning strategies and preserving the evidence underlying each judgment, ClickSight provides a flexible approach for studying student behavior in digital learning environments.

[259] Variable names provide priors: semantic grounding enables data-efficient numerical prediction by large language models cs.AI | cs.CL | cs.LGPDF

Xin-Rui Ma, Shi-Zhi Chen, Hai-Yan Jiang, De-Cheng Feng, Michael Beer

TL;DR: 论文研究大语言模型在表格数据数值预测中如何利用变量名和上下文示例，发现变量名与数值之间的语义接地能让LLM调用预训练领域知识，从而在少样本场景下实现数据高效预测，并以贝叶斯更新方式整合领域先验与上下文示例。

Details

Motivation: 现有研究已知LLM可通过上下文学习进行表格数值预测，但尚不清楚变量名和上下文示例在何种条件下、以何种机制发挥作用，尤其缺乏对语义接地作用的系统分析。

Result: 五个未经任务特定训练的LLM在来自九个科学领域的20个数据集上匹配或超越七个监督机器学习模型，尤其在示例稀缺时表现突出；基于物理公式的受控实验显示其预测与贝叶斯更新一致。

Insight: 创新点在于揭示变量名可作为语义先验，使LLM调用预训练领域知识，并以先验-似然方式与上下文示例动态整合；客观上看，该工作将语义接地和数据高效数值预测联系起来，为数据稀缺科学领域提供了可解释的LLM预测机制。

Abstract: Large language models (LLMs) have achieved strong performance across diverse tasks, from question answering to code generation. Recent studies have found that LLMs can perform numerical prediction on tabular datasets via in-context learning. However, it remains unclear under what conditions and how LLMs use variable names and in-context examples for numerical prediction. Here we show that semantic grounding, the match between variable names and the values they describe, allows five LLMs without task-specific training to match or outperform seven supervised machine learning (ML) models across 20 datasets from nine scientific domains, particularly when examples are scarce. Reasoning traces indicate that variable names allow LLMs to draw on domain-specific knowledge acquired during pretraining. Using controlled tasks based on physical formulas, we further show that LLMs integrate domain-specific knowledge with in-context examples in a way consistent with Bayesian updating. Specifically, when the relationship between the inputs and the target cannot be inferred from the examples alone, LLMs rely on domain-specific knowledge as the prior. Conversely, as contradicting examples accumulate, LLM predictions shift progressively towards these examples, which act as the likelihood. Our work reveals how LLMs use domain-specific knowledge in numerical prediction and positions them as data-efficient predictors for data-scarce scientific domains.

[260] SelfImprove-Bench: Evaluating Generalization in Self-Improving Agents cs.AI | cs.CL | cs.LG | cs.MAPDF

Bangrui Xu, Jie Yang, Sidi Chen, Xuanhe Zhou, Jiantao Qiu

TL;DR: 论文提出 SelfImprove-Bench，一个用于评估递归自我改进（RSI）智能体泛化能力的基准框架。它将任务组织为探索、规划、推理三类能力场景，并基于游戏构建可控可复现任务，配合任务模板和难度系数实现可扩展生成。评估不仅关注任务分数，还通过 G0 到 G4 的泛化阶梯衡量能力提升从训练条件迁移到未见场景的程度。

Details

Motivation: 现有 RSI 评估缺乏可靠指标区分真实能力提升与场景拟合，也缺少面向未见任务和难度的可持续、可扩展评估协议，以及将改进归因到演化轨迹的细粒度分析。

Result: 实验表明，现有 RSI 方法在不同泛化层级上的进化收益并不一致，说明其自我改进效果在迁移到训练条件之外时仍不稳定。

Insight: 主要创新在于用泛化阶梯 G0-G4 系统衡量 RSI 收益的迁移程度，并通过游戏任务保证可控性和可复现性，结合任务模板与难度系数实现可扩展评估。客观上看，该工作把“是否真正泛化”作为自我改进评估核心，有助于避免将场景拟合误判为能力提升。

Abstract: Recursively self-improving (RSI) systems are increasingly viewed as a promising means of accelerating progress toward artificial general intelligence. They aim to autonomously improve their capabilities by refining their working pipelines and recursively improving the strategies that guide subsequent refinements, with gains generalizing to unseen scenarios.However, existing evaluations lack reliable metrics to distinguish capability gains from scenario fitting, sustainable and extensible protocols for unseen tasks and difficulties, and fine-grained attribution of improvement to evolution traces. To this end, we propose SelfImprove-Bench,an RSI evaluation framework that organizes tasks into three primary capabilities (i.e., Exploring, Planning, Reasoning) as scenarios for guiding model evolution. We instantiated the tasks on games for controllability and reproducibility, and pairs them with scalable generation and orchestration driven by task templates and difficulty coefficients. Beyond task-level scores, SelfImprove-Bench organizes evaluation into generalization ladder levels G0 to G4 that measure how far gains transfer from training conditions. Experiments reveal that the evolutionary gains of existing RSI methods are inconsistent across generalization levels.

[261] Avatar Intelligence: Amplifying Human Agency Through Persistent Personal Agents cs.AI | cs.CLPDF

Zheng Wu, Xinbei Ma, Yao Yao, Zhaoyuan Huang, Haowen Hu

TL;DR: 论文提出“Avatar Intelligence”范式，主张构建持久化个人AI代理，通过跨应用、跨时间和跨情境的持续决策委托来代表用户的目标、价值观与约束，从而放大而非替代人的能动性。作者给出从人类指导执行到委托领域内自主运行的成熟度路线图，并提出Agentic Oversight Index（AOI）来衡量代理交付价值、运营成本与人类监督负担之间的平衡，最后列出身份连续个性化、基于Rehearsal Engineering的用户情境演化和安全问责机制三个核心挑战。

Details

Motivation: 当前个人AI代理虽能处理长时任务，但用户仍需投入大量精力指定目标、消解歧义并验证结果，常规监督负担过重。论文希望代理有效放大人类能动性，让用户减少例行监督，同时保留对重要决策的控制。

Result: 摘要未给出定量实验结果或基准评测结果；论文属于观点与研究议程型工作，提出成熟度路线图和AOI评估框架，用于比较代理交付价值、代理侧运营成本与人类监督负担。

Insight: 创新点在于提出持久个人代理的Avatar Intelligence范式，将“持续决策委托”作为核心，并引入AOI从价值-成本-监督负担角度评估代理；同时系统化提出身份连续个性化、Rehearsal Engineering驱动的用户情境演化和技术控制与问责救济结合的安全机制。客观看，其贡献更多是概念框架、评估指标和研究议程，而非具体算法或实验验证。

Abstract: Personal AI agents are increasingly capable of handling long-horizon tasks across applications, yet users often need to invest substantial effort in specifying goals, resolving ambiguity, and verifying outcomes. We argue that progress should be measured by how effectively agents amplify human agency: enabling people to pursue their goals with less routine supervision while retaining control over consequential decisions. We advocate Avatar Intelligence, a paradigm of persistent personal agents that represent users’ goals, values, and constraints through sustained decision delegation across contexts and time. We describe a maturity roadmap from human-directed execution to autonomous operation within delegated domains, and introduce the Agentic Oversight Index (AOI) as a framework for evaluating delivered value against agent-side operational cost and human oversight burden. We identify three core research challenges: identity-continuous personalization that carries user preferences across tasks, user-situated evolution through Rehearsal Engineering, and safety mechanisms that combine technical control with accountability and recourse. These directions define a research agenda for reliable decision delegation to personal agents across tasks and over time.

[262] Same Outputs, Different Scores: Auditing the Unchecked Graders of Multimodal LLM Benchmarks cs.AI | cs.CL | cs.CVPDF

Ahmad Jarjis Hasan, Jonathan Lwowski

TL;DR: 论文审计多模态LLM多选题基准中隐藏在代码里的评分规则，复现8个基准的官方scorer并在5个开源VLM上比较。作者用盲审人类加LLM裁判恢复模型真实答案，发现同一输出仅因评分规则不同可使准确率最多变化22个百分点，且问题主要来自fallback、正则匹配、弃权和似然评分等不可靠规则。论文呼吁基准报告非合规率并采用至少两种评分规则。

Details

Motivation: 多模态LLM基准的评分规则常被随意选择且未经审视，却直接决定排行榜数字；论文旨在揭示评分器对评测结果的潜在影响并审计其可靠性。

Result: 在8个同行评审基准和5个开源VLM上复现官方评分器，评分规则单独可造成最多22个百分点准确率差异；干净选项字母输出时差异为0，最强非合规基准的评分伪影为0，非合规为0.000的推理模型仍可因正则匹配不同摆动9.5个百分点；人工与LLM裁判一致性Cohen’s kappa=0.956。

Insight: 创新点在于将评分规则作为受控变量系统审计，结合盲审裁决恢复真实答案，揭示fallback、最近选项吸附、弃权和似然评分会混淆能力与运气；客观看，其价值在于把评测可信度问题从数据集扩展到评分协议，并提出报告非合规率和至少两种规则的实践建议。

Abstract: Every multimodal-LLM multiple-choice benchmark ends with a scoring rule that converts a model’s response, often free-form text rather than a clean option letter, into a right/wrong verdict, buried in its code. Unlike the dataset, this rule is chosen without justification and left unexamined, yet it sets the published number. We reproduce the official scorers of eight peer-reviewed benchmarks on five open vision-language models (VLMs) that fit a single 16 GB GPU, and introduce a blinded human-plus-LLM-judge adjudication (Cohen’s kappa=0.956) that recovers what the model actually answered. The scoring rule alone moves accuracy by up to 22 points on identical outputs, yet exactly 0 wherever a model emits clean option letters, so it hides on strong-model leaderboards. It is the fallback and not the rambling that does the damage: the benchmark with the highest non-compliance we measure has an artifact of exactly zero, because its scorer abstains instead of guessing; a reasoning model with non-compliance 0.000 still swings 9.5 points with which regex match of its trace the parser keeps. No standard rule is reliable: snapping a non-answer to its closest option credits answers never given yet buries correct ones, abstention discards answers stated in words, and likelihood scoring follows answer-token priors, so a single grade conflates capability with luck rather than measuring either. We release all code, labels, and the protocol, and argue benchmarks should report a non-compliance rate and at least two rules, not one unexamined grade.

[263] Strategist: Evolving Reasoning with Agents cs.AI | cs.CLPDF

Taiming Lu, Qi Xu, Zhigang Hua, Zhuang Liu

TL;DR: 论文提出 Strategist，一个用于自动演化推理策略的元智能体。它将推理策略写成可执行、可复用的 blueprint，并构建跨任务策略库；给定新任务和小规模开发集后，它会检索相关蓝图、生成候选策略、在真实样本上测试并根据结果迭代修正。实验在 30 个基准上验证了该方法能提升准确率并降低推理成本，且策略可迁移到未见任务和其他模型。

Details

Motivation: 当前 AI agent 系统中模型之外的推理策略多由人工编写，且不同任务间难以复用和积累经验，论文希望自动演化并复用推理策略，让 agent 的“另一半”也能自我改进。

Result: 在 30 个 benchmark 上，Strategist 在 24 个上超过最强基线，平均准确率达到 74.7%（基线 74.0%），同时推理成本降低 39%；其策略还能在无需进一步搜索的情况下迁移到未见任务和其他模型。

Insight: 创新点在于将推理策略抽象为可执行、可复用的 blueprint 并形成跨任务策略库，通过元智能体进行检索、生成、真实样本测试和迭代修正。客观看，其价值在于把 agent 的推理流程从手工设计转为可积累、可迁移的自动优化对象，并兼顾准确率与推理成本。

Abstract: A model is only half of an AI agent system. The other half is the inference strategy: the reasoning procedure that turns model calls into a response. Today that second half is written by hand, and the experience of building one strategy never carries to the next. We introduce Strategist, a meta-agent that evolves inference strategies across tasks. Each strategy is written as a blueprint,executable code that other strategies can reuse, and together the blueprints form a library. Given a task and a small development set, Strategist retrieves related blueprints, writes candidate strategies, tests them on real samples, and revises them from the results. Every candidate then enters the library, so later tasks build on earlier discoveries. On 30 benchmarks, Strategist beats the strongest baseline on 24 and matches its average accuracy (74.7% vs.74.0%) at 39% lower inference cost. Its strategies also transfer to unseen tasks and other models without further search. The part of an AI system that is not improved on its own now does.

[264] WebHarbor: Docking Real Websites for Evolving GUI Agent Environments cs.AI | cs.CL | cs.LGPDF

Zhaoyang Wang, Qianhui Wu, Boyu Gou, Demi Wang, Jiacheng Zhang

TL;DR: 论文提出 WebHarbor，一个包含 153 个可执行、Docker 化网站环境的套件，用于构建稳定可控的 GUI Web Agent 评测与训练平台。这些环境重建真实网站的视觉界面、内容与功能流程，并包含 3,518 个覆盖多步骤和登录后工作流的任务。作者还展示了在该环境中通过强化学习训练的 Qwen 4B 级 GUI Agent 可泛化到未见任务，并在四个基准上与领先开源 GUI Web Agent 竞争力相当。

Details

Motivation: 真实网站在评测和训练中常受内容变化、访问限制和认证流程覆盖不足影响，而现有合成环境又缺乏功能深度和视觉保真度，因此需要一个稳定、真实、可控制且支持复杂 Web 工作流的 GUI Agent 环境。

Result: WebHarbor 包含 153 个 Docker 化网站环境和 3,518 个任务，覆盖多步骤及登录后流程；在其上进行 RL 训练的 Qwen 4B 级 GUI Agent 能泛化到未见任务，并在四个基准上与领先开源 GUI Web Agent 表现相当。

Insight: 创新点在于通过任务驱动的人机协作构建可演化网站环境：新任务扩展功能范围，编码智能体实现变更，人类审核视觉保真度、功能正确性与任务有效性；同时将高保真合成环境同时用于可靠评测和低成本 RL 训练。

Abstract: GUI web agents require realistic and interactive environments that remain stable during both evaluation and training. Live website evaluation suffers from changing content, access restrictions, and limited coverage of authenticated workflows, while existing synthetic environments for training often lack functional depth and visual fidelity. We propose WebHarbor, a suite of 153 executable and dockerized website environments that faithfully reconstruct the visual interfaces, content, and functional workflows of real-world web services under deterministic control. We build WebHarbor through task-driven human-agent collaboration, where environments evolve as new tasks expand their functional scope, coding agents implement the required changes, and human contributors audit visual fidelity, functional correctness, and task validity. The resulting suite comprises 3,518 tasks spanning multi-step and post-authentication workflows, where existing works often fail to cover. Beyond reliable evaluation, WebHarbor provides high-fidelity synthetic web environments for cost-efficient reinforcement learning (RL). We demonstrate that a Qwen 4B-level GUI agent trained with RL in WebHarbor generalizes to unseen tasks and performs competitively with leading open-source GUI web agents across four benchmarks. The code and data are publicly available at https://github.com/aiming-lab/WebHarbor.

cs.CR [Back]

[265] When appearance and motion disagree: evaluating class–motion consistency against disguised uncrewed surface vessels cs.CR | cs.CV | cs.ROPDF

Jon Reifschneider

TL;DR: 论文研究海上防御场景中如何识别伪装或对抗性攻击的无人水面艇（USV），指出仅靠外观检测可能被船体补丁或物理伪装绕过。作者构建了基于AIS轨迹的混合重放评估协议，将良性运动记录与直接/离轴攻击航迹结合，比较外观检测与运动一致性检查。结果显示物理伪装可同时绕过摄像头和雷达存在检查，而资产相对闭合率检查能显著提升对直接突入攻击的预警能力。

Details

Motivation: 岸基计算机视觉可区分敌船与良性船只，但对抗性船体补丁和物理伪装会使外观与运动信息不一致，导致检测被抑制或绕过。论文关注如何评估并防御伪装USV，尤其是外观检测失效时的补充判别手段。

Result: 对抗性船体补丁最多在29%的尝试中抑制检测，但未造成误分类为良性；物理伪装则可绕过摄像头检查和雷达存在检查。对于娱乐标签船只4海里内直接突入攻击，资产相对闭合率检查在15-20节下标记94-95%，而仅轨迹速度检查仅12%；总体留出误报率4.9%，娱乐交通误报率12.3%。

Insight: 创新点在于提出类别-运动一致性评估思路和基于AIS轨迹的混合重放协议，将外观分类与运动线索（闭合率、速度）结合进行防御测试。客观上，利用物理伪装下外观与运动不一致来设计互补检查，并以重放协议支持防御方法的可比较评测，具有较强的方法论和评估价值。

Abstract: Defense systems for maritime assets must distinguish approaching benign craft from uncrewed surface vessels (USVs) with sufficient warning to act. Shore cameras using computer vision can separate hostile vessels from benign traffic, but these systems may be attacked using an adversarial hull patch or physical disguise. We evaluate adversarial hull patches and find they suppress detection in up to 29% of attempts but never cause misclassification as benign. Physical disguise, however, can bypass both a camera check and a radar presence check. To evaluate defenses, we develop a hybrid replay protocol from automatic identification system (AIS) tracks that combines recorded benign motion with direct or off-axis attack run-ins. We find that for recreational-labeled vessels attacking via direct run-in within 4 nautical miles, an asset-relative closing-rate check flags 94-95% at 15-20 knots, compared with 12% for a track-only speed check. The checks are complementary on off-axis approaches, constraining the attacker to remain below both thresholds and extending the time required to reach the asset. Flagging on either check has a 4.9% held-out false-alarm rate overall and 12.3% on recreational traffic. The replay-based evaluation protocol supports comparative test and evaluation of defense methods.

cs.CY [Back]

[266] Rubric-Based Assessment of Student Reports Using Small Language Models cs.CY | cs.CL | cs.CRPDF

Sandesh Kumar Kafle, Jan Vykopal, Valdemar Švábenský

TL;DR: 论文面向网络安全教育中学生事故响应报告的量规评分任务，提出并评估了一个可在低资源、隐私敏感环境下本地部署的自动评估流程。该流程结合轻量语言模型进行文本评分，并使用视觉语言模型处理含图报告。基于105名本科生两个学期的数据，实验表明小模型在廉价硬件上即可达到接近甚至超过大模型的表现。

Details

Motivation: 现有基于语言模型的自动评分方案多依赖外部云服务，存在资源消耗大、成本高和隐私风险等问题，难以用于资源受限或隐私敏感的教学环境。论文希望为网络安全教育等场景提供低资源、本地化、隐私友好的评分辅助工具，同时不替代人工监督。

Result: 在105名学生两个学期的网络安全事件响应报告上，纯文本评估准确率最高可达97%，富文本评估最高可达94%；小模型在低资源硬件上的表现可与大模型相当甚至更优，并具备本地部署带来的隐私和成本优势。

Insight: 创新点在于将轻量语言模型与视觉语言模型组合成开源、可本地部署的AI辅助评分流水线，面向低资源环境和含图学生报告评分，并强调隐私保护与人工监督并存。其可扩展到计算教育中多种学生报告类型，降低了自动评分的部署门槛。

Abstract: Language models can analyze and assess student texts using predefined rubrics and deliver structured feedback, reducing instructors’ workload. However, existing solutions often rely on external services that are resource-intensive, costly, and raise privacy concerns, making them unsuitable for constrained environments. This study evaluates an automated assessment pipeline with three key aims: design for low-resource environments, privacy, and focus on a novel context in cybersecurity education. The pipeline integrates lightweight language models for textual evaluation and a vision-language model for image interpretation. Responses from 105 students were collected over two semesters of an undergraduate course during a cybersecurity exercise on incident response. Results across different hardware configurations show that small models in low-resource environments can achieve up to 97% accuracy in text-only and up to 94% in rich-text assessments. This rivals or even outperforms a large model while adding the benefits of locally hosted assessment. Our solution can help educators and practitioners who need grading assistance without replacing human oversight, especially in environments where cloud-based solutions may be impractical. This study contributes an open-source, locally deployable AI-assisted scoring pipeline that runs on affordable hardware and can be extended to various types of student reports in computing education. As a result, it makes automated assessment accessible to a broad range of educators and institutions.

cs.HC [Back]

[267] Do the Numbers Match the Plot? Statistical-Visual Verification for Automated Exploratory Data Analysis cs.HC | cs.CVPDF

Zixun Fu, Jian Huang, Maojun Sun, Yancheng Yuan

TL;DR: 论文提出EDAgent，一个在报告生成前进行针对性视觉验证的顺序式自动探索性数据分析框架。它对每个统计发现记录结果、生成可视化请求与图表，并依据观察到的分布模式保留、限定或重新考虑解释，称为统计-视觉验证；同时提出8B参数的VisPlan模型将可视化理由转化为详细图表计划。

Details

Motivation: 自动EDA系统可能统计计算正确却给出误导性解释，例如相关性受强影响点驱动，均值差异可能来自偏态、分布重叠或稀疏子组而非整体分布变化，因此需要在报告合成前用可视化核验统计结论。

Result: 在EDA-Bench的87份端到端报告上，用六维评分和GPT-5.1多模态评估，事实性与视觉一致性最高分比例87.4%，统计-视觉交叉验证93.1%，分析叙事96.6%；在166个VisEval开放式任务上，VisPlan将平均总分从Qwen3-8B的4.55提升至4.62，美学提升最大。

Insight: 创新点在于将可视化从展示工具提升为统计解释的验证环节，通过统计-视觉验证流程对发现进行保留、限定或重审，并用VisPlan把可视化理由落地为图表计划；客观看，其可借鉴之处是面向分布特征做定向图表核验，以增强自动EDA报告的透明度与统计-视觉一致性。

Abstract: Automated exploratory data analysis (EDA) systems can execute statistics correctly while producing misleading interpretations. For example, correlations may be driven by influential observations, and mean differences may arise from skewness, overlap, or sparse subgroups rather than broad distributional shifts. We present EDAgent, a sequential framework that performs targeted visual verification before report synthesis. For each finding, the system records the statistical result, generates a visualization request identifying relevant distributional features, creates the corresponding chart, and uses the observed pattern to retain, qualify, or reconsider the interpretation. We call this process statistical-visual verification. EDAgent includes VisPlan, an 8B-parameter model that converts visualization rationales into detailed chart plans. We evaluate 87 end-to-end reports on EDA-Bench using a six-dimension rubric and GPT-5.1 multimodal evaluation. Maximum-score proportions reached 87.4% for factuality and visual consistency, 93.1% for statistical-visual cross-validation, and 96.6% for analytical narrative. On 166 open-ended VisEval tasks, VisPlan improved the mean overall score from 4.55 (Qwen3-8B) to 4.62, with the largest gain in aesthetics. These descriptive results indicate that visual verification can make automated EDA reports more transparent about how statistical findings relate to underlying data structure.

[268] “I Wrote, I Paused, I Rewrote”: A Mixed-Methods Study of Learner Perceptions of Process-Aware LLM Feedback cs.HC | cs.CLPDF

Samra Zafar, Shifa Yousaf

TL;DR: 论文通过 convergent mixed-method 后任务评估，研究43名本科英语学习者对基于最终作文、中间草稿快照和击键记录生成的 process-aware LLM 写作反馈的感知。结果显示学习者总体评价积极，且感知到的修订分析与自身思维过程对应性与总体有用性正相关；定性分析还揭示了反馈准确性与少数误读并存。

Details

Motivation: 多数 LLM 写作反馈系统只评估最终提交文本，而 process-aware 系统虽可纳入中间草稿和交互记录，但尚不清楚学习者是否认为这些反馈有用、公平且符合自身修订体验。

Result: 43名参与者中，六项 Likert 评分均集中在中点以上，74.4%至95.3%选择4或5分，六项单侧精确符号检验经 Holm 校正后仍显著；感知对应性与总体有用性正相关，Spearman ρs=.327，95% bootstrap CI [.009,.609]，p=.032。定性结果显示多数人认为产品反馈和修订理由准确，少数人报告表面修正、时间限制或修辞意图被误读；该研究不涉及 benchmark/SOTA 比较。

Insight: 创新点在于将最终文本、中间快照和击键过程记录结合为 process-aware LLM 反馈，并用混合方法评估学习者主观感知；其可借鉴之处是区分“感知到修订活动被检测”与“感知到修订原因被解释”，并联合过程数据与学习者体验进行评价。

Abstract: Large language models increasingly provide formative writing feedback, but most systems evaluate only the submitted text. Process-aware systems can additionally incorporate intermediate drafts and interaction records, yet access to these traces does not establish whether learners perceive the resulting feedback as useful, fair, or aligned with their own revision experience. We conducted a convergent mixed-method post-task evaluation with 43 undergraduate English-language learners. Participants completed a timed essay, received LLM-generated feedback based on the final essay, intermediate snapshots, and keystroke-derived records, and then answered six five-point Likert items and four open-ended questions. Ratings were concentrated above the neutral midpoint across all six items. Between 74.4% and 95.3% of participants selected ratings of 4 or 5, and all six one-sided exact sign tests remained significant after Holm correction. Perceived correspondence between the revision analysis and the participant’s reported thought process was positively associated with overall perceived usefulness, Spearman’s $ρ_s=.327$, 95% bootstrap CI $[.009,.609]$, $p=.032$, $n=43$. Qualitative responses were analysed through an LLM-assisted codebook development procedure followed by independent human coding of 14 binary codes. Participants frequently described the product feedback and revision rationale as accurate, while a smaller set reported misinterpretation of surface corrections, time constraints, or rhetorical intention. The findings distinguish perceived detection of revision activity from perceived interpretation of why revision occurred.

Abtin Zandi, Arian Ashrafi, Sarvin Nami, Seyed Sina Negahban, Amirabbas Entezari

TL;DR: 该综述系统回顾2008至2026年间108项同行评审研究，将盲人和低视力辅助导航技术划分为机械辅助、电子旅行辅助、深度学习和边缘原生四个时代，分析各时代的代表系统、传感模态、计算架构与报告性能，并整合四类检测器和十二种模型压缩策略。文章指出算法快速进步与现实采用缓慢之间存在持续错配，并提出开放挑战与路线图。

Details

Motivation: 支持盲人和低视力个体独立出行的辅助技术长期发展缓慢，从白手杖、导盲犬到电子旅行辅助、深度学习和边缘AI不断演进，但快速算法进展尚未充分转化为现实采用。综述旨在梳理领域技术演进、系统架构和评估问题，为以用户为中心、社会可接受的辅助导航提供路线图。

Result: 综述覆盖108项研究并归纳四个技术时代，以及四类检测器和十二种压缩策略；未报告统一基准上的定量SOTA结果。其结论性发现是实际采用受界面认知过载、评估协议碎片化和盲人和低视力参与者研究稀缺制约，并总结了室内外无缝切换、标准化基准、隐私感知和多模态基础模型等开放挑战。

Insight: 创新点在于以技术时代划分辅助导航领域，并将模型优化技术整合为统一技术参考，涵盖四类检测器和十二种压缩策略。客观来看，其价值在于揭示算法性能与真实用户采用之间的鸿沟，强调标准化评估、盲人和低视力用户参与以及隐私保护感知，为边缘AI辅助导航研究提供结构化视角。

Abstract: Independent mobility is a foundational requirement for the autonomy of blind and low-vision (BLV) individuals, yet the assistive technologies that support it have historically evolved slowly. This survey systematically reviews 108 peer-reviewed studies published between 2008 and 2026, organizing the field into four technological eras: (i) a foundational era of passive mechanical aids, namely the white cane and the guide dog; (ii) a hardware era of electronic travel aids built on ultrasonic, infrared, and satellite positioning sensors that alert users to proximity but lack semantic understanding; (iii) a deep learning era in which convolutional and transformer-based detectors introduced context-aware scene understanding, initially tethered to cloud infrastructure; and (iv) a contemporary edge-native era defined by model compression, quantization, hardware acceleration, and multi-sensor fusion that relocate intelligence onto resource-constrained wearable and mobile devices. For each era we analyze representative systems, sensing modalities, computational architectures, and reported performance, and we consolidate the field’s model-optimization techniques into a single technical reference spanning four detector families and twelve compression strategies. Across the corpus, we find a persistent mismatch between rapid algorithmic progress and slow real-world adoption, driven by cognitive overload in user interfaces, fragmented evaluation protocols, and the scarcity of studies involving BLV participants. We conclude with open challenges, including seamless indoor-outdoor transition, standardized benchmarks, privacy-preserving perception, and the emerging role of multimodal foundation models, and outline a roadmap for socially acceptable, user-centered assistive navigation.

[270] Camera-Free Object Discovery and Interaction with GazeTags cs.HC | cs.CV | cs.GR | cs.MMPDF

Vimal Mollyn, Chris Harrison

TL;DR: 论文提出 GazeTags，一种无需摄像头和计算机视觉的头戴式视线物体感知方案。系统由约 2 美元、纽扣电池可运行一年以上的小型电子标签，以及用户佩戴设备组成；佩戴设备周期性发射与头部朝向对齐的聚焦红外信号，仅处于窄波束内的 GazeTags 被唤醒并返回身份及可选负载（如物体状态或传感器读数）。该方案面向电池受限可穿戴设备，强调低功耗、可连续运行并规避摄像头带来的隐私问题。

Details

Motivation: 传统视线/物体感知通常依赖摄像头与计算机视觉流水线，在可穿戴设备上面临功耗高、难以持续运行和隐私敏感等问题。论文希望用低成本、低功耗、无摄像头的标签方案实现头戴式视线范围内的物体发现与交互。

Result: 摘要未给出具体定量 benchmark 或 SOTA 对比；作者主要描述硬件设计、系统性能与运行权衡的表征，并演示 GazeTags 可支持实际的视线感知环境。

Insight: 创新点在于用方向性红外波束实现“按头朝向选择性唤醒”的免摄像头物体发现与交互，结合低成本长续航标签，兼顾低功耗、持续运行和隐私保护；客观看，其可借鉴之处是将空间方向约束转化为唤醒/通信机制，从而避免持续视觉感知开销。

Abstract: We present GazeTags, a camera- and computer-vision-free approach for worn head-gaze object awareness. Our small electronic tags cost roughly $2 each and can operate for more than a year on a coin cell battery. They work in concert with a user-worn device (smartglasses, hearables, etc.) that periodically emits a focused infrared signal aligned with the user’s head direction. Only GazeTags within that narrow head-oriented beam wake and respond, providing their identity and optional payloads such as object state or live sensor readings. By avoiding cameras and computer vision pipelines, our approach is very energy efficient, able to operate continuously even in battery-constrained wearables, and sidesteps non-trivial privacy issues. We describe our hardware design, characterize our system performance and operating tradeoffs, and demonstrate how GazeTags can enable practical gaze-aware environments.

cs.LG [Back]

[271] Do Multimodal Models Decide Consistently on Equivalent Optical Spectra? cs.LG | cs.CL | physics.opticsPDF

Ziyuan Wang, Genliang Zhu, Xiaobo Chen

TL;DR: 论文研究多模态模型对等效光学光谱表示的决策一致性，以及数据缺失时能否正确弃答。作者将硅超表面和金纳米颗粒的实测光谱分别表示为四种表格和两种图，并构造部分光谱缺失任务，评测 d3-nano、Jev 1.13、GPT-6 Luna 配置和 Qwen3.5-2B。结果显示模型决策对表示方式高度敏感，且未适配模型在证据缺失时很少回答“无法确定”，LoRA 微调还可能学到“输入被截断就弃答”的捷径。

Details

Motivation: 论文关注科学决策中同一光谱以不同单位、格式或图表呈现时应得到一致结论，并在所需数据缺失时应明确弃答。现有评测多只看平均准确率，忽视表示不变性和缺失证据下的可靠性。

Result: 仅改变表示即可使同一模型准确率变化最多 41 个百分点，主要出现在光子能量表格和图；同一证据下改用光子能量提问，对部分模型-视图组合提升 16-50 点，对其他组合最多伤害 25 点。移除相关极值后，未适配模型很少回答“undetermined”；LoRA 微调 d3-nano 虽改善训练表格格式比较，但其不可答问题增益部分来自截断捷径，采用可答截断训练可在六个种子中避免该捷径，并在留出结构上形成 90-100 点的内外切割弃答差距。

Insight: 创新点在于系统评测多模态模型的光谱表示不变性与弃答能力，并揭示微调模型可能利用输入截断作为弃答捷径。客观看，论文的可借鉴之处是不仅报告平均准确率，还设计等效表示和缺失证据对照任务，并用可答截断训练检验捷径，从而更全面地评估科学决策模型的可靠性。

Abstract: A spectrum can be given to a model as a table in nanometers or as a plot in photon energy, and the decision should not depend on which one it sees. When the data needed for an answer are missing, the model should say so. We test representation invariance and abstention on measured optical spectra of silicon metasurfaces (MOCLIP) and gold nanoparticles, with labels computed from the data. Each spectrum is shown as four tables (nm, $μ$m, scientific notation, eV) and two plots (nm, eV), and partial spectra remove data inside or outside the queried range. We evaluate the decision models d3-nano and Jev 1.13, three GPT-6 Luna configurations and the Qwen3.5-2B base model. Changing only the representation moves accuracy by up to 41 percentage points within one model, mostly on photon-energy tables and plots. With the same evidence, asking in photon energy instead of wavelength helps some model-view pairs by 16-50 points and hurts others by up to 25. When the relevant extremum is removed, unadapted models rarely answer “undetermined”. LoRA fine-tuning of d3-nano improves comparisons on the trained table formats, but much of its gain on unanswerable questions comes from a shortcut: it abstains whenever the input is truncated. Training with answerable truncations avoids the shortcut in all six seeds, with a 90-100 point gap between abstention after inside and outside cuts on held-out structures; with the same amount of extra original-task data, five of six seeds keep the shortcut. On gold spectra the two training sets perform similarly. Multimodal language models used for scientific decisions should be tested on equivalent representations and on missing evidence, not only on average accuracy. We release the tasks, per-response results and analysis code.

[272] When Should an Agent Refresh? Adaptive Index Reuse for Efficient Long-Horizon Reasoning cs.LG | cs.CLPDF

Guangyuan Wang, Yifan Zhang, Shilong Liu

TL;DR: 论文提出自适应索引复用方法 AIR，用于语言智能体长程推理中的动态稀疏注意力。它保留 IndexCache 的执行方式，但通过一个小型控制器按智能体片段自适应决定多少层刷新 token 选择，从而在计算预算内兼顾推理效果与效率。

Details

Motivation: 现有 IndexCache 等跨层复用方法对所有输入使用固定的索引刷新模式，难以适应智能体执行中因工具输出、测试结果或回溯导致的相关证据突变；因此需要按步骤动态决定索引刷新频率。

Result: 在 Qwen3-4B-Instruct-2507、128K 上下文下，AIR 在同等成本下将 SWE-bench Verified 成功率从 27.0% 提升到 32.4%，并在 Terminal-Bench 2.0 与三个 τ^2-bench 域上提升成功率、降低每个成功任务耗时；在 50 个骨干、上下文和基准设置中，44 个设置匹配或超过最强静态调度。

Insight: 创新点在于将跨层索引刷新从固定层模式变为按智能体片段自适应选择嵌套模式库中的刷新层数；控制器利用已完成计算和最新工具事件信号，并以终端任务奖励在预期计算预算约束下学习。客观看，其价值在于把动态稀疏注意力的计算分配与智能体事件驱动的证据变化对齐，实现预算感知的推理时自适应。

Abstract: Language agents read code, tool output, and dialogue in contexts that grow at every step. Dynamic sparse attention lets a small indexer choose the earlier tokens each query attends to, but the indexer still scores the whole prefix at every layer. Cross-layer reuse methods such as IndexCache rerun the indexer at only some layers, with one fixed pattern for every input. In an agent, the relevant evidence can change abruptly when a traceback or test result arrives, so fresh selections matter more at some steps than at others. We propose Adaptive Index Reuse (AIR), which keeps IndexCache’s execution and learns, for each segment of an agent episode, how many layers refresh their selection. A small controller reads signals from completed computation and the latest tool event, chooses a pattern from a nested library, and learns from terminal task reward under an expected compute budget. On Qwen3-4B-Instruct-2507 with a 128K context, AIR improves success over the strongest static schedule at matched cost on SWE-bench Verified (27.0% to 32.4%), Terminal-Bench 2.0, and three $τ^2$-bench domains, and it lowers time per successful task on all five. Across 50 backbone, context, and benchmark settings, it matches or exceeds that schedule in 44.

[273] Can Large Language Model Agents Learn by Watching Tutorial Videos? cs.LG | cs.AI | cs.CL | cs.CVPDF

Haoyu Zhao, Zafeirios Fountas, Jun Wang

TL;DR: 论文研究LLM智能体能否在不更新参数的情况下，通过观看教学视频持续学习。作者提出Tutorial Agentic Learning（TAL），将教程视频整理为持久的结构化tutorialbook记忆，并通过两阶段对抗式过程挖掘视频相关问题来精炼记忆；推理时利用目录树（TOC）检索，使检索与模型推理直接关联。论文还构建了基于72个国际象棋教程视频的VidLearn多模态QA基准，并验证TAL在国际象棋及第二领域中的有效性。

Details

Motivation: 人类能从书籍和教学视频中持续获取知识并迁移到未来任务，而LLM智能体在训练后能力被冻结，大规模参数更新成本高昂，难以利用互联网上不断增长的教学视频资源。论文旨在探索LLM智能体能否在无参数更新的条件下，从海量教学视频中进行持续学习。

Result: 在VidLearn基准上，TAL优于所有评估基线，并随着视频数量增加单调提升，在训练集和测试集上相对对应vanilla MLLM分别取得最高113%和91%的相对提升；实际对局中，TAL在69%的一对一对局中取得比vanilla版本更强的开局阶段局面。第二领域的评估进一步表明TAL具有泛化性。

Insight: 论文的主要创新在于提出无参数更新的非参数持续学习范式，将教学视频固化为结构化、可检索的tutorialbook记忆，并通过两阶段对抗过程生成困难视频 grounded 问题以精炼记忆；同时用TOC树将检索与模型推理过程绑定，而非依赖嵌入相似度。客观来看，结合视频知识结构化、对抗式记忆精炼和推理驱动检索是其可借鉴之处。

Abstract: Humans continuously acquire knowledge from carefully crafted materials such as books and tutorial videos, carrying that understanding into future tasks. Millions of such instructional videos are uploaded online every day, yet LLM agents remain unable to exploit this ever-expanding wealth of human teaching. Their capabilities are frozen after training, while parameter updates at scale remain prohibitively expensive. This raises the central question: can LLM agents learn from this vast instructional resource without parameter updates? We introduce Tutorial Agentic Learning (TAL), a nonparametric continual-learning paradigm that consolidates tutorial videos into a persistent, structured tutorialbook memory through a two-stage adversarial process that harvests hard, video-grounded questions and uses them to refine the memory. At inference time, TAL retrieves through a Table-of-Contents (TOC) tree, tying retrieval directly to the model’s reasoning rather than to embedding similarity. To study this setting, we introduce VidLearn, a multimodal QA benchmark built from 72 chess tutorial videos spanning 12 openings. On VidLearn, TAL outperforms all evaluated baselines and improves monotonically as more videos are consumed, achieving up to 113% and 91% relative gains over the corresponding vanilla MLLMs on the training and test splits, respectively. In actual gameplay, TAL reaches a stronger opening-phase position than its vanilla counterpart in 69% of head-to-head games. Evaluation in a second domain further demonstrates the generality of TAL. Together, these results highlight instructional videos as a scalable resource for parameter-update-free agent continual learning.

[274] LLM-Enhanced Multimodal House Price Prediction using Structured, Textual, and Visual Features cs.LG | cs.CL | cs.CV | cs.IRPDF

Khandokar Md. Rahat Hossain, Souvik Das, Tahsina Hashem, Mohammed Eunus Ali, Tanzima Hashem

TL;DR: 论文提出一种融合结构化属性、文本描述和房产图片的多模态房价预测框架。方法利用大语言模型从文本中提取领域相关的时空与上下文特征，并用无监督视觉-语言方法将图片自动分组为室内、室外、混合或户型图等类别，最终融合统一表示并用优化回归器预测房价。

Details

Motivation: 传统房价预测主要依赖卧室数、浴室数、停车位等结构化数据，忽略了文本描述和房产照片中的丰富上下文与语义视觉信息；已有深度多模态方法也未能充分提取文本中的时空上下文特征和图像中的语义视觉信息。

Result: 在大型真实房产数据集上的实验表明，该方法优于传统方法和现有多模态基线；消融研究证实，新颖的文本特征提取和分类视觉嵌入对更准确、可靠的价格预测有显著贡献。

Insight: 创新点在于系统整合结构化、文本和视觉信息，并用LLM提取领域特定时空与上下文特征；同时以无监督视觉-语言对齐方式，通过伪文本提示将房产图片自动聚类为有语义的类别，兼顾预测精度与可解释性。

Abstract: Accurate house price prediction is essential for real estate buyers, sellers, agents, and financial institutions. Traditional methods rely primarily on structured data, e.g., number of bedrooms, bathrooms, parkings, but they overlook rich contextual information embedded in textual descriptions and property photos. Previous deep learning approaches for house price prediction have fused multimodal data but they fall short to extract structured spatio-temporal and contextual features from texts and semantic visual information from images. In this paper, we introduce a novel multimodal framework that addresses these limitations by systematically integrating structured attributes, textual descriptions, and visual images of properties to achieve higher prediction accuracy while maintaining interpretability. We use a large language model to derive domain-specific spatio-temporal and contextual features from text, and an unsupervised vision-language approach to automatically group photos into meaningful classes like indoor, outdoor, mixed, or floorplan, that are commonly present in real-world house listings. These categories are created without manual labeling by aligning image clusters with carefully designed pseudo text prompts. We fuse all features into a unified representation and use an optimized regressor to predict prices. Experiments on a large real-world property dataset demonstrate that our method outperforms traditional methods and existing multimodal baselines. Ablation studies confirm that the novel textual feature extraction and categorized visual embeddings substantially contribute to more accurate and reliable price predictions.

[275] CREDO: Evidence-Conditioned Credit Assignment for Temporal Reasoning Agents cs.LG | cs.AI | cs.CL | cs.IRPDF

Yue Leng, Shengtao Wen, Xiang Chen, Xinyi Zeng, Yu Tian

TL;DR: 论文针对时序知识图谱问答（TKGQA）中语言模型智能体多步推理的信用分配问题，提出CREDO框架。该方法利用中间证据恢复局部监督，在同题多次采样轨迹间比较分配阶段级正信用，并用保留答案重叠作为机会代理重新分配部分结果策略权重，从而缓解GRPO轨迹级奖励无法区分中间决策质量及全失败组无相对信号的问题。

Details

Motivation: 现有GRPO式轨迹级结果信号不能细粒度评价中间证据检索与推理步骤，下游失败可能误罚有用证据获取；全失败组奖励相同也会丢失相对结果信号。论文旨在为多步时序推理智能体提供更合理的中间信用分配。

Result: 在MultiTQ上，相较对比中最强公开基线，Overall准确率由78.0%提升至82.4%，Multiple准确率由55.0%提升至65.6%；在TimelineKGQA上，通过直接迁移到ICEWS Actor且训练评估设置匹配，cross-KG准确率由复现基线30.9%提升至36.4%。

Insight: 创新点在于用中间证据条件化信用分配，在包括全失败组的采样轨迹中恢复局部监督，并通过阶段级正信用与答案重叠机会代理将部分结果监督权重转向推理和回答，同时保持终端奖励和轨迹级优势及总策略权重守恒。

Abstract: Temporal Knowledge Graph Question Answering (TKGQA) requires language model agents to retrieve evidence, select relevant facts, and perform multi-step temporal reasoning. However, the trajectory-level outcome signal in GRPO does not explicitly distinguish the quality of intermediate decisions: downstream failures can penalize useful evidence acquisition, while identical rewards in all-failed groups eliminate the relative outcome signal despite differences in intermediate progress. We propose Credit Redistribution with Evidence-Driven Opportunities (CREDO), which uses intermediate evidence to recover local supervision, including in all-failed groups, and determine where outcome supervision acts. CREDO assigns positive stage-level credit through comparisons among rollouts of the same question and uses retained answer overlap as an opportunity proxy to shift part of the outcome-policy weight toward reasoning and answering. The framework preserves terminal rewards and trajectory-level advantages, while redistribution conserves total outcome-policy weight per trajectory. Following the public evaluation protocol of prior work, CREDO raises Overall accuracy from 78.0% to 82.4% and Multiple accuracy from 55.0% to 65.6% on MultiTQ relative to the strongest published baseline in our comparison. On TimelineKGQA, it raises cross-KG accuracy from 30.9% to 36.4% relative to our reproduced baseline via direct transfer to ICEWS Actor under matched training and evaluation settings.

[276] Order-Only On-Policy Distillation cs.LG | cs.CLPDF

Guangzeng Han, Yu Wu, Xiaolei Huang

TL;DR: 论文提出仅顺序同策略蒸馏（O$^{3}$PD）：在学生模型自己生成的每个前缀上，不再拟合教师模型的token概率值，而是让学生的前K个token排序与教师一致。该方法对教师温度不敏感、无需调温，并在多个师生模型对上优于传统同策略蒸馏（OPD）。

Details

Motivation: 传统OPD通过匹配教师token概率来蒸馏，但概率值同时包含教师偏好和置信度，置信度受教师容量与校准影响，小模型难以复现，且会随教师温度变化而导致OPD对温度敏感。论文因此探究：仅保留教师候选token的排序是否已足够。

Result: 在六个师生模型对上，O$^{3}$PD在HMMT25、AIME24、AIME25的平均结果均优于OPD，最高提升2.9分，AIME25上最高提升5.6分；其他排序损失也带来类似增益，表明收益来自序数监督本身。

Insight: 创新点在于用教师top-K token的排序而非概率值作为同策略蒸馏监督，使目标对教师温度不变并免去温度调参；客观上看，该工作将蒸馏知识从概率幅值解耦为序数关系，说明排序信息比概率值更关键。

Abstract: On-policy distillation (OPD) trains a student on its own generations by matching the teacher’s token probabilities. These probabilities entangle two kinds of information: which tokens the teacher prefers, and how confident it is. The latter reflects the teacher’s own capacity and calibration, which a smaller student may be unable to reproduce. Because the teacher temperature changes these values without changing the ordering, OPD is also sensitive to the temperature choice. We ask whether the teacher’s ordering of candidate tokens is enough, and propose Order-Only On-Policy Distillation (O$^{3}$PD). At each student-generated prefix, O$^{3}$PD trains the student to reproduce the order of the teacher’s top-$K$ tokens, without fitting their probability values. The objective is therefore invariant to the teacher temperature and needs no temperature tuning. Across six teacher–student pairs, O$^{3}$PD outperforms OPD on the average over HMMT25, AIME24, and AIME25 in every pair, by up to 2.9 points, with gains of up to 5.6 points on AIME25. Other ranking losses yield similar gains, so the benefit comes from ordinal supervision itself. Analysis shows that O$^{3}$PD departs further from the teacher’s probabilities than OPD, yet reproduces its ranking more faithfully and yields a stronger student. The ranking, not the probability values, thus carries the knowledge that on-policy distillation needs to transfer.

[277] Test-Time Scaling for Open-Ended Reasoning at Small Model Scale cs.LG | cs.AI | cs.CLPDF

Adam Y. Ahmed, Abdullah G. Elafifi

TL;DR: 论文研究小模型在开放式推理任务上的测试时扩展问题，提出一种无需奖励模型或自评判的语义聚类投票方法：按语义对模型多样本分组，并返回最大簇代表。实验发现该方法在数学等可验证任务上能显著提升准确率，但在开放式文本生成上几乎无效，原因是大模型/指令模型的开放式样本高度同质化，几乎都落入同一语义簇，缺少可供投票选择的多样性。

Details

Motivation: 投票聚合只有在样本存在分歧时才有价值，因此论文关注开放式生成中模型是否会产生“值得组合”的多样样本，而此前测试时扩展主要在数学任务上有效，对自由文本开放式推理仍缺乏系统研究。

Result: 在250个提示、三级答案可验证性基准上，三个小模型家族和两个随机种子下，语义聚类投票在数学控制任务上提升+10到+29分，但在开放式文本上最多仅提升+0.30 judge分；在主模型200题MATH-500上提升+8.5分（95% CI [+4.0, +13.0]）。开放式样本几乎都塌缩到单一语义簇，提高解码温度也无法恢复有效多样性，且净损失-0.64 judge分（95% CI [-0.93, -0.37]）。

Insight: 创新点在于提出无评判器的语义聚类投票聚合器，并系统评估小模型在开放式推理中的测试时扩展瓶颈。客观来看，论文的重要发现是：限制投票收益的关键不是聚合策略，而是小指令模型缺乏可用语义多样性；该同质化更可能与指令微调有关，而非模型规模，且简单提高温度不能解决。

Abstract: A vote over a model’s samples can only help when the samples disagree. For open-ended generation the binding question is therefore not how to combine samples but whether a model produces samples worth combining, a question test-time scaling has answered for math but not for free-form text. We study it at small scale with semantic cluster voting, a judge-free aggregator that groups a small instruct model’s samples by meaning and returns the largest cluster’s representative, with no reward model or self-judging. On a 250-prompt benchmark with three tiers of answer checkability, the same pattern holds across three model families (Qwen2.5-3B, Llama-3.2-3B, Gemma-2-2B) and two generation seeds: voting raises accuracy on the math control, where samples vary but stay checkable (a gain of +10 to +29 points across the three models), yet adds at most +0.30 judge points on open-ended text. On a larger 200-problem MATH-500 run with the primary model, the math gain is +8.5 points (95% CI [+4.0, +13.0]). Almost every open-ended sample falls into one meaning cluster, so there is little to select over. The collapse is consistent with instruction-tuning rather than model size, and raising decoding temperature does not recover usable diversity, because it costs more quality than it adds (net -0.64 judge points, 95% CI [-0.93, -0.37]).

[278] Concise-9B: Removing the Slack from a Reasoning Model’s Thinking cs.LG | cs.CLPDF

Alexander Boesgaard Lorup

TL;DR: 论文研究推理模型在答案已形成后仍继续生成冗余思考（slack）的问题，并在 Qwen3.5-9B 上提出两轮 on-policy 拒绝采样微调：保留最短正确样本并混入少量答案合成目标，得到 Concise-9B。该方法在多个基准上以约 0.66x token 达到与基座模型相当的准确率，同时分析了冗余思考的位置，并给出用于自适应采样的低成本 commit signal，但在超长思考的困难数学题上有轻微性能损失。

Details

Motivation: 推理模型思考更长通常答案更好，但大量思考发生在答案已经确定之后，造成推理成本浪费。论文希望在不牺牲准确率的情况下压缩这部分冗余思考，并定量刻画其占比和可利用信号。

Result: 在 8,983 道留出题（竞赛与困难数学、SuperGPQA、五领域确认集、MMLU-Pro）上，Concise-9B 在 32K thinking budget 下仅用 Qwen3.5-9B 的 0.66x token，准确率差异为 -0.20 [-0.77, +0.36] 点，在 ±1 点内等价。强制每 2,048 token 作答的分析显示，基座模型 54-64% 的思考 token 发生在答案形成后，Concise-9B 为 41-48%；其节省 token 中 86% 来自答案形成后。局限是延长到 80K token 时，在 1,276 道困难题上少解 25 题，主要集中于竞赛数学；自适应采样 commit signal 在预注册测试中以 0.67x token 匹配 two-sample escalation 的 ±1 点效果。

Insight: 论文的创新点在于显式度量“答案已形成后的冗余思考”，并用最短正确样本的 on-policy 拒绝采样自训练来压缩冗余，同时利用强制作答一致性构造廉价 commit signal 用于自适应采样。客观上看，其价值在于把推理长度优化从单纯蒸馏或 RL 转向冗余度量与数据筛选，并指出压缩收益依赖基座模型的冗长程度，但在超长思考硬题上存在性能边界。

Abstract: Reasoning models answer better when they think longer, but a thinking trace keeps going well after its answer has formed. We measure this slack in Qwen3.5-9B and remove most of it with concise self-training: two rounds of on-policy rejection-sampling fine-tuning that keep the shortest correct samples, plus a small share of answer-synthesis targets, giving Concise-9B. On 8,983 held-out problems (competition and hard mathematics, SuperGPQA, a five-area confirmation set and MMLU-Pro), Concise-9B generates 0.66x the tokens of Qwen3.5-9B at a 32K thinking budget, with accuracy equivalent within +/-1 point (-0.20 [-0.77, +0.36] points). Forcing each trace on the hard and confirmation sets to answer every 2,048 thinking tokens, we find that 54-64% of Qwen3.5-9B’s thinking tokens come after the point from which every forced answer equals the final one (41-48% for Concise-9B). Stopping there would keep every answer at 0.35-0.44x the base model’s tokens, but finding that point takes hindsight: stopping when three consecutive forced answers agree costs the base model 2.4-9.2 points. Concise self-training removes slack without that cost: 86% [83, 90] of the thinking tokens it saves come after the answer has formed. It has a limit: with traces continued to 80K tokens, Concise-9B solves 25 fewer of 1,276 hard problems (-25 [-49, -1]), mostly in competition mathematics. The measurement also yields a cheap commit signal for adaptive sampling that matched two-sample escalation within +/-1 point at 0.67x its tokens in a pre-registered test. Results on Qwen3.5-4B, on which the recipe was developed, and a replication on Olmo-3-7B-Think suggest that the saving depends on how verbose the base model is.

[279] Do Visual RL Gains Scale at Test Time? A Quantile View of Post-Training cs.LG | cs.CVPDF

Austin Wang, Lexing Ying

TL;DR: 论文系统研究视觉生成模型在RL后训练后，其收益能否在Best-of-N等测试时推理扩展下保持。作者发现更高单样本奖励不一定带来更好的质量-计算前沿，RL收益在大采样预算下可能衰减、饱和甚至反转。论文用分位数迁移框架解释该现象，并提出QUPO，通过优化不同推理预算对应的分位数效用混合来保留高质量上尾样本。

Details

Motivation: 视觉生成模型常用RL后训练提升单样本质量，但实际部署可通过Best-of-N增加推理计算；现有理解不足的是RL收益在测试时扩展下、尤其在困难留出任务上是否仍然有效。

Result: 在SD3.5-M和BAGEL上，覆盖组合生成、文本渲染和偏好对齐等评估，QUPO相较标准RL后训练更好地保留上尾质量，并显著改善困难留出提示下的缩放表现；摘要未给出具体数值。

Insight: 核心创新是识别并刻画视觉RL在测试时缩放中的收益迁移失败模式，并用分位数迁移解释Best-of-N对大采样预算下reward分布上尾的依赖；QUPO将不同推理预算对应的分位数效用混合优化，提示应以后训练对完整reward分布和质量-计算前沿的影响来评价与优化生成模型。

Abstract: Reinforcement learning (RL) post-training improves the single-sample quality of visual generative models, but deployment often provides additional inference compute through Best-of-N sampling. Whether RL gains transfer under such test-time scaling, particularly on difficult held-out tasks, remains poorly understood in the visual domain. Our central contribution is to systematically identify and characterize a failure mode of scaling transfer in visual RL: across multiple RL methods, model backbones, and evaluations spanning compositional generation, text rendering, and preference alignment, higher single-sample reward does not necessarily imply a better quality-compute frontier. RL gains may attenuate, saturate, or even reverse at large sampling budgets, with the base model eventually outperforming its post-trained counterpart. We explain these regimes through a quantile-transfer framework, showing that Best-of-N places increasing weight on the upper tail of the reward distribution as N grows. Consequently, RL can improve typical samples while compressing or degrading the rare high-quality outcomes that test-time scaling exploits. As a simple intervention motivated by this analysis, we introduce Quantile Utility Policy Optimization (QUPO), which optimizes a controllable mixture of quantile utilities corresponding to different inference budgets. Experiments on SD3.5-M and BAGEL show that QUPO better preserves upper-tail quality and substantially improves scaling on challenging held-out prompts relative to standard RL post-training. Our results suggest that visual generative models should be evaluated and optimized not only for single-sample quality, but for how post-training reshapes the full reward distribution that inference-time scaling exploits.

[280] ViAdminShift: A Vietnamese Benchmark for Event-Level Knowledge Updates Built from the 2025 Administrative Reform cs.LG | cs.CLPDF

Phan Binh Nguyen Lam, Nguyen Thai Anh

TL;DR: ViAdminShift 是一个越南语事件级知识更新基准，基于2025年越南行政区划改革构建，包含7,995个评测项、2,281个改革前后维基百科修订检索段落及新旧地址映射表，并设计探测赛道和基准赛道来评估模型是否掌握改革后知识。论文还系统分析了模型对旧地址的过时回答、日期提示和推理设置的影响。

Details

Motivation: 大模型的知识可能随真实世界事件而过时，尤其越南2025年省级和基层行政区划大规模调整会造成大量地址映射变化，现有基准缺乏针对该事件级知识更新的越南语评测资源。

Result: 探测赛道中至少20/67个模型知道该改革；对旧地址的普通问题，14个模型最多仅11%单独给出新省，而单独给出旧省的比例为14-100%，仅给日期可使比例最高达100%；在1,262项基准子集中，不知改革的小模型产生14-30%过时答案，五个知道改革的模型为0-5%。映射表与独立谱系在10,564/10,565对官方配对一致，评分者与作者盲标一致性κ为0.91和0.89。

Insight: 创新点在于用真实官方改革事件构建事件级知识更新基准，结合改革前后同源维基检索段落、未变单位对照的2×2设计和无变音符号地址等扰动，并同时评测模型知识掌握、旧答案残留及日期/推理提示下的行为偏差；数据、脚本和datasheet的发布也增强了可复现性。

Abstract: On July 1, 2025, Vietnam reduced its 63 provinces to 34, abolished its 696 districts, and replaced its 10,035 commune-level units (wards) with 3,321. ViAdminShift, a Vietnamese language resource about this event, consists of 7,995 benchmark items, 2,281 retrieval passages from pre- and post-reform Wikipedia revisions and dated templates, and old-to-new tables that a released script rebuilds from the official conversion table (not redistributed). Changed items store the pre-reform answer (except 121 address items), a $2\times2$ design uses untouched units as controls, and 400 addresses appear without diacritics. The tables agree with an independent lineage on 10,564 of 10,565 official pairs, disagreements were settled against the resolutions, and the probing-track scorer agrees with both authors’ blind labels (Cohen’s $κ=0.91$ and $0.89$). Data, outputs, code, and a datasheet are released. In the probing track, at least 20 of 67 models know the reform. Fourteen of them give the new province alone for at most 11% of plain questions about old addresses (old province only: 14-100%); a bare date recovers up to 100%. Post hoc (80 province-free addresses, single runs), with reasoning off, today’s date in the system prompt leaves 68-100% old-province-only answers for 10 of 12 models; with reasoning, an “as of” prefix in the question leaves none for seven of eight. On the 1,262-item benchmark subset, with same-source old and new passages, small models unaware of the reform give 14-30% outdated answers and the five benchmark-track knowers (also differing in size or provider) 0-5%.

[281] LLMs Depend on Specialist Tools for Out-of-Distribution Generalization in MS/MS Structural Elucidation cs.LG | cs.AI | cs.CL | stat.MLPDF

Gabriel Asher, Cailum M. K. Stienstra, Tomo Oga, Devesh Shah Antonio H. de O. Fonseca, Niall O’Connor

TL;DR: 论文考察前沿大语言模型能否在无候选列表和参考库的串联质谱MS/MS从头结构解析中直接由谱图提出结构，并区分推理与记忆。作者基于MassSpecGym构建100个分析物的基准，按文献文本覆盖度划分为分布内和分布外，在固定模型、框架和输出格式下仅改变LLM可用的领域专用工具。结果显示LLM单独在分布外几乎无效，而接入从头结构生成器后可显著提升，并超过独立生成模型。

Details

Motivation: 动机是检验近期前沿LLM在无工具条件下解析1D NMR结构的能力是否能迁移到MS/MS的de novo结构解析场景，并重点解决模型在缺乏文献记录的新分子上能否泛化、而非依赖记忆召回的问题。

Result: 无工具时前沿LLM在分布内达到52% Top-1准确率，但分布外仅2%；仅当接入de novo结构生成器后，分布外Top-1最高提升至38%，且形成的工具增强agent在分布内和分布外均优于独立的de novo模型。

Insight: 创新点在于构建按分析物文本足迹划分分布内/分布外的100分析物MS/MS基准，并通过仅改变工具访问权限来隔离LLM推理能力与工具贡献。客观来看，论文揭示了LLM在MS/MS de novo解析中主要依赖专用结构生成工具，工具增强agent是提升分布外泛化的关键，而非LLM本身能力。

Abstract: A frontier language model was recently reported to solve 1D NMR structural elucidation without tools. We ask whether this capability transfers to tandem mass spectrometry (MS/MS) in the de novo setting, where the model must propose a structure directly from the spectrum without a candidate list or reference library. To separate reasoning from recall, we build a 100-analyte benchmark from MassSpecGym, split by each analyte’s textual footprint into in-distribution (well documented in literature) and out-of-distribution (essentially undocumented) arms. We hold the model, harness, and output format fixed and vary only the LLM’s access to domain-specific tools. Without tools, a frontier LLM reaches 52% Top-1 accuracy in-distribution but only 2% out-of-distribution. Only access to de novo structure generators improves out-of-distribution accuracy, raising it to as much as 38% Top-1, and the resulting agent outperforms the standalone de novo models both in and out of distribution. These results suggest that LLMs are not effective at de novo MS/MS structural elucidation on their own, and that further gains depend on the specialist tools available to the agent rather than on the LLM itself.

[282] Library of Layers (LoL): Adaptively Ordering Transformer Layers at Runtime cs.LG | cs.AI | cs.CLPDF

Abdellah Rahmani, Sean McLeish, Ang Li, Sanae Lotfi, Pascal Frossard

TL;DR: 论文提出Library of Layers (LoL)架构，在推理时动态排序Transformer层以解决当前任务，通过一个全局Transformer块库的超参数统一了参数重用与稀疏性，并泛化了密集、深度循环和专家混合架构的权衡。在文本预训练上达到竞争性能，在数独和迷宫任务中观察到不同层排序对应不同策略，在多语言和安全数据上也表现出可解释性和可控性。

Details

Motivation: 现有语言模型架构总是以固定顺序执行层，而人类程序员可以按不同顺序组合可重用计算原语实现不同算法。论文旨在让模型在推理时动态组合自己的计算图，以实现更高效和可控的推理。

Result: 在文本数据预训练上，LoL与密集、深度循环和专家混合基线相比具有竞争性能。在合成数独和迷宫数据上，模型采用不同层排序实现不同策略，且可通过干预路由强制特定策略；多语言设置中不同语言和脚本选择不同层序模式；安全数据上路由器输出的探针以高AUROC区分安全与不安全文本。

Insight: 创新点在于将层顺序作为推理时的动态决策，通过单一超参数（全局块库大小）实现参数重用与稀疏性的统一，并增强了模型的可解释性与可控性，为动态计算图组合提供了新路径。

Abstract: Computer programmers chain together the same reusable computational primitives, for example, conditional statements or loops, but in different orders to implement different algorithms. In contrast, existing language model architectures always execute their layers in the same order. We introduce Library of Layers (LoL), an architecture that dynamically orders its layers during inference to solve the problem at hand. LoL has a single hyperparameter, the size of its global library of transformer blocks, that allows it to transition seamlessly between parameter reuse and sparsity, generalizing the parameter-efficiency and FLOPs-efficiency tradeoffs of dense, depth-recurrent, and mixture of experts architectures in one unified family. We show that LoL achieves competitive performance with all three above baselines when pretrained on text data. On synthetic sudoku and maze data, we observe that the model employs distinct layer orderings to implement different solution strategies, and we can intervene on routing to force a model to apply a specific solution strategy to a problem instance. In a multilingual natural language setting, we find that LoL chooses different layer order patterns based on language and script. Similarly, we train LoL on safety data and fit probes to its router outputs, finding that these probes distinguish safe from unsafe text with high AUROC. LoL provides a path toward a future in which models dynamically compose their own computational graph, enabling more efficient and controllable reasoning.

cs.PF [Back]

[283] DIMWIT: Directly Invoking Models Without Intensive Tuning cs.PF | cs.AI | cs.CV | cs.DC | cs.OSPDF

Saarth Deshpande, Neeraja J. Yadwadkar, Venkat Arun

TL;DR: 论文提出DIMWIT，绕过传统任务特定资源管理策略的开发，直接让预训练模型根据当前系统状态、期望结果和可用选项做出资源管理决策。作者在微服务自动扩缩容、DRAM容量配置和视频编码三个场景中，用前沿LLM和两个小型决策模型进行验证，表明直接调用模型即可完成资源管理决策，且小模型在多个场景中表现良好。

Details

Motivation: 传统资源管理器需要预先开发任务特定策略，如启发式、优化过程或训练模型，并且可能随负载或系统变化而修改，开发与维护成本较高。论文希望跳过策略开发，直接利用预训练模型进行资源管理决策。

Result: 在两个微服务应用中，小型决策模型满足延迟目标，副本使用量在基于策略的自动扩缩容器10%以内、在前沿LLM的13%以内；DRAM容量配置中，相比静态供给最多降低27.5%的DRAM使用量，同时保持至少95%的基线性能；视频编码中，比前沿LLM最多快4.3倍，VMAF仅下降1.1点且不可感知。

Insight: 论文宣称的创新点是无需密集调参或策略开发，直接调用预训练模型做单次资源管理决策。客观来看，其创新在于将资源管理决策表述为给定系统状态、目标和候选选项的模型推理问题，并验证小型决策模型可在多个系统场景中接近策略方法或前沿LLM的效果。

Abstract: Resource managers typically encode what to do in a task-specific policy—a heuristic, an optimization procedure, or a model trained for the task—that must be developed before use and may need revision as the workload or system changes. We propose bypassing policy development and instead asking pretrained models to make resource-management decisions directly, given the current system state, desired outcome, and available choices. We evaluate this approach on microservice autoscaling, DRAM sizing, and video encoding, using a frontier LLM and two small decision models. On two microservice applications, a small decision model meets latency targets while using within 10% of the replicas allocated by policy-based autoscalers and within 13% of the frontier LLM. In DRAM sizing, a small decision model reduces DRAM usage by up to 27.5% relative to static provisioning while maintaining at least 95% of baseline performance. In video encoding, it completes encodes up to 4.3$\times$ faster than the frontier LLM, with an imperceptible 1.1-point decrease in Video Multi-Method Assessment Fusion (VMAF), a metric of perceptual video quality. Making individual resource-management decisions may be considerably simpler than developing a general strategy for making them.

cs.RO [Back]

[284] Learning to Live: A Step Toward Lifelong Embodied Intelligence cs.RO | cs.CVPDF

Lirong Che, Peidong Wang, Yimeng Su, Jiong Wang, Yang Chen

TL;DR: 论文提出面向具身智能体的终身学习框架 LIFE，使机器人能够持续观察环境、选择性记忆并将经验转化为新能力。系统包含用于事件检测与记忆写入决策的轻量流式门控 RoboBeats、保留原始证据且可扩展字段的 Plastic Memory，以及将问题求解过程提炼为可复用工具/技能的 Explore-Distill-Mount（EDM）。

Details

Motivation: 传统具身智能体通常围绕单个任务设计，难以应对任务之间及执行过程中不断变化的物理世界；论文希望机器人通过持续经验积累变得更熟悉环境、更具能力，而不仅是完成预设任务。

Result: 在匹配协议下，RoboBeats 在条件跟踪上显著优于其基座模型；在相同记忆写入预算下，相比均匀采样能为记忆问答保留更多有用证据。论文还通过回放真实机器人 24 小时连续视频的小规模案例，展示了系统从一天经验中构建记忆并回答日常问题。

Insight: 创新点在于将持续观察、事件触发式选择性记忆、保留源证据的可扩展记忆存储，以及从问题求解中蒸馏可复用工具/技能整合为终身具身学习闭环；其中流式门控决定何时响应或写入记忆、以及经验到技能的验证与复用机制较有借鉴价值。

Abstract: Embodied agents are usually organized around individual tasks, yet the physical world keeps changing between tasks and during execution. We introduce LIFE (Lifelong Intelligence from Experience), a framework in which a robot observes continuously, remembers selectively, and turns experience into new capabilities. RoboBeats, a family of lightweight streaming gates, tracks conditions set by the agent and discovers new events, deciding when an observation warrants a response or a memory write. Selected observations enter Plastic Memory, a flat store of images and structured records that keeps the source evidence, so new fields and indexes can be added when later questions need them. When existing tools fall short, Explore-Distill-Mount (EDM) turns solutions found during problem solving into validated, reusable tools and skills. Under matched protocols, RoboBeats substantially improves condition tracking over its base models and, at the same writing budget, retains more useful evidence for memory question answering than uniform sampling. A case study of limited scale, replaying 24 hours of continuous video recorded by a real robot, illustrates how the integrated system builds memory from a day of experience and uses it to answer everyday questions. LIFE takes a step toward robots that become more familiar with their surroundings and more capable through experience: learning not only to complete tasks, but to live in the world.

[285] PREM: Prediction-Regulated Memory for Robot Manipulation cs.RO | cs.CVPDF

Xiao Huang, Ya Zhang, Weidi Xie

TL;DR: 论文提出 Prediction-Regulated Memory（PREM），一种用于视觉-语言-动作策略的预测调控记忆框架。它利用动作条件化的未来视觉预测，在训练中为记忆学习提供时序监督，在执行中根据当前观测与前一决策预测之间的空间归一化差异来调控视觉状态更新。更新后的视觉记忆与当前观测共同为动作生成提供时序上下文，并在多个机器人操作基准上验证有效性。

Details

Motivation: 机器人下一步动作可能依赖近期运动或当前观测中缺失的早期视觉证据，而循环视觉记忆是否有效取决于记忆状态表示什么以及如何随新观测更新。论文旨在让视觉记忆的学习和更新更有针对性，从而提升动态操作和记忆依赖任务中的表现。

Result: 在 DOMINO 动态操作任务上，平均成功率从 9.63% 提升到 20.74%；在 RMBench M(1) 记忆依赖设置上从 14.4% 提升到 83.8%。在 LIBERO 和 LIBERO-Pro 上也提升了通用操作能力和对空间扰动的鲁棒性，单张 NVIDIA H800 GPU 上平均推理开销为 7.7 ms。

Insight: 创新点在于用动作条件化的未来视觉预测同时指导记忆学习和记忆更新，并以空间归一化的预测差异调节每个空间位置的视觉状态更新。客观来看，这种“预测误差驱动记忆写入”的机制能让模型更关注与未来动作相关且未被预测覆盖的视觉信息，兼顾记忆有效性、空间选择性和较低推理开销。

Abstract: A robot’s next action can depend on recent motion or earlier visual evidence absent from its current observation. A recurrent visual-memory architecture can retain this history in a visual state, but its usefulness depends on what the state represents and how it is updated with new observations. We introduce Prediction-Regulated Memory (PREM), a framework that uses action-conditioned future prediction to guide both memory learning and updating in vision-language-action policies. During training, predicting future visual features provides temporal supervision for memory learning. During execution, PREM compares current visual features with the prediction made at the preceding decision and uses the spatially normalized prediction discrepancy to regulate updates to the visual state at each spatial location. The updated visual state supplies temporal context for action generation alongside current observations. Built on $π_{0.5}$, PREM improves average success rate from 9.63% to 20.74% on DOMINO dynamic manipulation tasks and from 14.4% to 83.8% on the RMBench M(1) memory-dependent setting. Further evaluations on LIBERO and LIBERO-Pro show improvements in general manipulation and robustness to spatial perturbations. PREM incurs a mean inference overhead of 7.7 ms on a single NVIDIA H800 GPU.

[286] Vision-Language Models Are Joint Denoisers in Robotic Action Generation cs.RO | cs.AI | cs.CVPDF

Xicheng Gong, Wenxuan Song, Chengze Liu, Qiwei Li, Qize Yu

TL;DR: 论文提出JADE（联合动作去噪器），在扩散式视觉-语言-动作（VLA）模型中，让视觉语言模型（VLM）和动作专家在每个去噪步骤联合精炼动作，而非仅提供静态条件。VLM读取噪声动作、视觉观察和语言指令，通过门控交叉注意力引导动作专家，并监督VLM从噪声恢复干净动作潜变量。JADE在RoboDojo上平均成功率12.67%，为基于π0.5方法中最高，与大规模预训练VLA和WAM模型竞争；在RoboTwin 2.0上提升，真实双臂任务平均成功率比π0.5提高20.8个百分点。

Details

Motivation: 现有扩散VLA模型将VLM限制为静态条件，分离了预训练感知推理与动作生成，尤其在分布外场景下限制了VLM对动作生成的指导。论文旨在让VLM更深入地参与动作去噪过程，以充分利用其预训练知识。

Result: 在RoboDojo基准上，JADE平均成功率达12.67%，是评估的基于π0.5方法中最高的，并与近期大规模预训练的VLA和WAM基础模型具有竞争力；在RoboTwin 2.0上性能提升；在四个真实双臂任务上，平均成功率比π0.5提高20.8个百分点。

Insight: 创新点包括：让VLM和动作专家联合去噪，VLM读取当前噪声动作并通过门控交叉注意力提供动态指导；监督VLM从噪声动作恢复干净潜变量，赋予其直接动作学习信号并耦合感知与控制；联合去噪允许更少采样步数，配合自适应步长调度平衡性能与延迟。客观来看，该设计将VLM从静态条件提升为主动去噪参与者，增强了预训练知识对动作生成的引导。

Abstract: Diffusion-based vision-language-action (VLA) models cascade pretrained vision-language models (VLMs) with diffusion action experts, but typically restrict the VLM to providing static conditioning. This separation limits how much pretrained perception and reasoning can guide action generation, especially in out-of-distribution settings. We introduce JADE, a Joint Action DEnoiser that enables the VLM and action expert to jointly refine actions. Our key insight is that structured action latents allow the VLM to read the current noisy action together with visual observations and language instructions. At every denoising step, the VLM contextualizes the noisy action and guides the action expert through gated cross-attention, so that its guidance evolves with the action being generated. We further supervise the VLM to recover clean action latents from noisy ones, which gives it a direct action-learning signal and couples perception with control. Additionally, joint denoising enables JADE to generate actions with fewer sampling steps, helping offset the additional cost of VLM participation. An adaptive step-size schedule further balances task performance and inference latency. On RoboDojo, JADE achieves an average success rate of 12.67%, the highest among the evaluated $π_{0.5}$-based methods, and is competitive with recent VLA and WAM foundation models pretrained at scale. It also improves performance on RoboTwin 2.0 and raises the average success rate across four real-world bimanual tasks by 20.8 percentage points compared with $π_{0.5}$.

[287] SCOUT: Planning under Occlusion via Object-Centric World Model Rollouts cs.RO | cs.AI | cs.CVPDF

Amir Hossain Raj, Xuesu Xiao

TL;DR: 论文提出SCOUT，一个面向杂乱环境中遮挡问题的机器人规划框架。它利用物体中心场景表示重建隐藏几何，并构建捕捉遮挡层级与可通行走廊的关系规划状态；由LLM提出结构化候选动作，再通过学习到的动作条件世界模型和MCTS进行rollout评估。在Reveal和Placement任务上优于VLA策略、具身智能体和3D世界模型，并在真实杂乱货架操作中验证鲁棒性。

Details

Motivation: 机器人在杂乱空间操作时常只能获得部分视图，目标、周围几何和可用自由空间可能被前景物体遮挡；反应式策略容易忽略隐藏约束，而穷举搜索在密集杂乱中计算代价过高。因此需要一种兼顾高层推理与物理可行rollout的遮挡感知规划方法。

Result: 在Reveal和Placement任务上，SCOUT优于Vision-Language-Action策略、具身智能体和3D世界模型，尤其在需要推理被遮挡几何的长时程任务中提升显著；并通过真实杂乱货架环境中的机器人操作验证了鲁棒性。

Insight: 摘要宣称的创新点在于结合物体中心表示、关系规划状态、LLM候选动作生成、学习式动作条件世界模型和MCTS评估。客观来看，其可借鉴之处是将语义先验用于缩小杂乱环境中的动作搜索空间，同时用世界模型rollout保持物理接地，并以物体中心关系抽象显式建模遮挡与可达性。

Abstract: Robots manipulating in cluttered spaces must often plan from partial views where foreground objects occlude the target, surrounding geometry, and usable free space. Reactive policies often miss these hidden constraints, while exhaustive search becomes computationally prohibitive in dense clutter. We present SCOUT, an occlusion-aware planning framework that bridges high-level deliberation with grounded physical rollouts. SCOUT leverages an object-centric scene representation to reconstruct hidden geometry and derive a relational planning state capturing blocker hierarchies and accessibility corridors. To navigate the vast action space in clutter, an LLM proposes structured action candidates which are then rigorously evaluated via Monte Carlo Tree Search (MCTS) using a learned action-conditioned world model. Evaluations on ‘Reveal’ and ‘Placement’ tasks show that SCOUT outperforms Vision-Language-Action (VLA) policies, embodied agents, and 3D world models, with significant gains in long-horizon tasks requiring reasoning over occluded geometry. We further validate the framework’s robustness through real-world robotic manipulation in a cluttered shelf environment.

[288] Answering Without Arriving: An Evidence Audit for Embodied Question Answering cs.RO | cs.CVPDF

Shubh Garg, Divyansh Pandey, Niyati Rawal, Vedant Khandelwal, Amit Sheth

TL;DR: 论文针对具身问答（EQA）中仅看答案准确率无法判断智能体是否真的导航并观察到证据的问题，构建了一个包含200个测试回合、800个问题的多房间基准，并提出逐级控制证据供给的评估阶梯。实验发现闭环视觉语言智能体在200个回合中未到达任何目标却仍能答对45.5%的问题，与不给图像时几乎相同；重放参考轨迹可将同一模型提升到57.4%，说明证据存在于路线中但未被采集。

Details

Motivation: 现有EQA评测只关注最终答案正确率，而合理或正确的答案可能来自问题文本、房间标签或选项等捷径，不能证明支撑答案的观察确实发生过。论文希望审计答案是否真正依赖证据获取，并区分证据可访问性与证据使用。

Result: 在200个测试回合、800个问题的多房间基准上，闭环VLM智能体未到达任何目标但答对45.5%，与无图像条件仅差0.1个百分点；重放参考轨迹后同一模型达到57.4%，oracle条件在Rooms-visited上达到59.5%。问题家族审计还显示8个家族中4个主要可从文本回答，1个引用的帧无法支撑其答案。

Insight: 创新点在于用固定问题、逐级改变证据供给的评估阶梯，以及由房间、可见物体和帧的符号记录生成可溯源问题，系统审计EQA中的证据获取、答案覆盖与捷径敏感性。客观来看，其价值在于揭示高答案准确率可能并不对应真实具身观察，强调在将性能提升归因于记忆或推理前必须先验证证据链。

Abstract: Embodied question answering asks an agent to navigate, observe, and then answer questions about what it saw, yet answer accuracy alone cannot tell whether any of this happened. A plausible answer can come from the question, the room label, or the answer choices, and a correct answer does not show that the supporting observation was ever made. We present a multi-room benchmark whose 200 test episodes and 800 questions are stratified by route extent, with an evaluation ladder that holds the questions fixed while varying only the evidence supplied to the answerer, from text-only probes through closed-loop agents to replay of the reference trajectory. Questions are generated from symbolic records of rooms, visible objects, and frames, so every answer can be traced to the observations that support it. A closed-loop vision-language agent reaches no target in 200 episodes yet answers 45.5% of questions, within 0.1 points of the same model given no images; replaying the reference trajectory raises the same model to 57.4%, so the evidence exists along the route but is not gathered. A family-level audit then shows that access to evidence is not the same as use of it. Four of eight families are largely answerable from text, one cites frames that cannot establish its own answer, and the oracle conditions reach 59.5% on Rooms-visited by counting the supplied images. Evidence acquisition, answer coverage, and shortcut sensitivity must therefore be established before an accuracy gain can be credited to memory.

[289] Do Embodied VLMs Actually Use Their Scene-Graph Memory? cs.RO | cs.AI | cs.CVPDF

Shubh Garg, Divyansh Pandey, Vedant Khandelwal, Niyati Rawal, Amit Sheth

TL;DR: 论文提出一种图交换诊断测试，用来判断具身视觉语言模型是否真正依赖场景图记忆，而不仅是答案准确。作者在含2至7个房间路线的具身问答基准上比较不同场景图记忆注入方式，发现以文本形式提供时模型强烈使用记忆，路线问题提升30分；以图结构输入时标准池化和晚融合会丢弃信息，按节点逐token输入可恢复部分收益，路线问题提升8.3分。

Details

Motivation: 现有评测只看答案准确率，无法确认场景图是否包含经历事实、是否到达模型以及模型是否真正依赖它；论文希望诊断具身VLM是否实际使用其场景图记忆，并找出更有效的记忆注入方式。

Result: 在2至7个房间路线的具身问答基准上，文本形式场景图记忆使路线问题提升30分；图编码器虽保留信息，但池化和晚融合导致模型不利用，逐节点token输入带来8.3分提升且经交换测试确认来自图记忆。交换测试还揭示捷径：当相同事实出现在文本中时模型会忽略图。

Insight: 创新点在于用图交换测试直接衡量模型对场景图记忆的依赖，而非仅看准确率；客观上看，该诊断方法低成本且能暴露准确率掩盖的捷径，并指出场景图记忆应按节点保留细粒度信息、避免过早池化或晚融合。

Abstract: Embodied agents that answer questions about their route need a memory of what they saw, and scene graphs are a natural form for it. A vision-language model (VLM) can receive such a graph as text or through a graph encoder, but accuracy alone cannot show whether the graph holds the episode’s facts, reaches the model, or is actually relied on. In this diagnostic study, we introduce a graph-swap test for the last of these: each episode is given another episode’s graph, and we count how many answers change. On an embodied question-answering benchmark with routes through two to seven rooms, we use it to compare ways of delivering scene-graph memory to a fine-tuned VLM. As text, the memory is used strongly, adding 30 points on route questions. As a graph, it is not, and we trace why: the encoder preserves the information, but standard pooled and late fusion discard it. Giving each node its own input token recovers part of it, a gain of 8.3 points on route questions that the swap test confirms comes from the graph. The test also exposes a shortcut that accuracy hides: when the same facts appear in the text, the model ignores its graph. The test thus offers a cheap check of whether a VLM uses its scene-graph memory, and our analysis points to how that memory should be delivered.

[290] When Delay Meets Drift: Physical Safety of Robot Foundation Models Is a Cross-Layer Problem cs.RO | cs.CV | cs.ETPDF

Liangkai Liu, Bimal Thapa Magar

TL;DR: 论文指出机器人基础模型的物理安全不是单一模型属性，而是环境、模型、计算平台与执行在闭环中跨层交互的结果。作者在 LIBERO 上用 pi0.5 视觉-语言-动作模型进行 4000 个配对闭环实验，发现推理延迟与相机视角偏移联合造成的安全违规风险远大于二者单独影响之和，并呼吁面向可预测物理智能，预测变异何时转化为风险并自适应调整计算、功耗与控制。

Details

Motivation: 现有机器人基础模型安全评估通常一次只扰动一个因素：鲁棒性基准扰动场景但假设即时推理，实时执行方法只在常规场景研究延迟，因而低估了闭环系统中多源变异联合作用带来的物理安全风险。

Result: 在 LIBERO 上 4000 个配对闭环 episodes 中，400 ms 推理延迟在训练视角下使安全违规率提高 3.5 个百分点，但在 60 度相机偏移下提高 37 个百分点；联合交互效应比两个单独效应之和多 33.5 个百分点（95% CI：25-43）。

Insight: 论文宣称的创新点是形式化跨层变异传播，并提出交互对比度量联合变异何时产生超过各部分之和的风险；客观来看，可借鉴之处在于将环境扰动、模型推理延迟、计算平台和执行控制纳入统一闭环安全评估，并用配对实验量化非线性交互风险。

Abstract: Robot foundation models now act in a closed loop, yet their safety is evaluated one variation at a time: robustness benchmarks perturb the scene while assuming instantaneous inference, and real-time execution methods study inference delay in nominal scenes. We argue that physical safety is not a property of the model alone, but emerges from how variations in the physical environment, the model, the computing platform, and execution interact in closed loop. We formalize this as cross-layer variation propagation across these system layers and use an interaction contrast to measure when joint variation creates more risk than the sum of its parts. In 4,000 paired closed-loop episodes of the pi0.5 vision-language-action model on LIBERO, a 400 ms inference delay raises the safety-violation rate by 3.5 percentage points under the training viewpoint but by 37 percentage points under a 60-degree camera shift: 33.5 percentage points (95% CI: 25-43) more than the two effects combined. We close with a research agenda toward predictable physical intelligence: predicting when variation becomes risk, and adapting compute, power, and control accordingly.

[291] D&A: Decoupling Description and Assessment Enables VLMs as Zero-Shot Robotic Reward Models cs.RO | cs.AI | cs.CL | cs.LG | eess.SYPDF

Marius Memmel, Shawn Yin, Urvi Rutia, Angad Wadhwa, Eldon Li

TL;DR: 论文提出 D&A（Describe & Assess），将视觉语言模型（VLM）的零样本机器人任务进度估计解耦为“客观场景动态文本描述”和“基于显式评分标准的评估”两个阶段。该方法先让 VLM 生成任务相关的绝对成功定义，再据此评分，从而避免确认偏差和相对时间排序带来的失败执行进度幻觉。实验表明其能校准零样本估计、提供细粒度部分进度，并在无需训练的情况下匹配或超过后训练奖励模型。

Details

Motivation: 现有 VLM 零样本视频任务进度估计常因隐式成功假设或相对时间排序产生确认偏差，把失败执行误判为有进度；朴素提示又容易退化为二分类成功检测，难以刻画非线性的部分进度和失败。后训练虽可缓解，但需要昂贵真实机器人数据，且对每个基模型都需计算密集的后训练。

Result: 实证结果表明 D&A 能校准零样本估计并缓解确认偏差，给出细粒度的部分进度指标，准确惩罚失败执行并正确插值成功运行。作为纯提示方法，它可跨任务、具身和 benchmark 泛化，匹配或超过后训练奖励模型，其奖励估计还能支持高效的下游强化学习。

Insight: 创新点在于将进度估计解耦为任务 grounding 的客观文本描述与基于显式 rubrics 的评估，并在评分前强制 VLM 合成绝对成功的文本定义，使评估锚定外部全局标准而非视频内部时间线。客观来看，该工作以“描述—评估”解耦和绝对成功锚点缓解确认偏差，同时保持 prompt-only 的低成本与跨模型泛化能力。

Abstract: Vision-Language Models (VLMs) hold promise for zero-shot video task-progress estimation in robot learning, yet existing frameworks frequently suffer from confirmation bias, hallucinating progress in failed executions due to implicit success assumptions or relative temporal ranking designs. Naive prompting of frontier models collapses into a binary success detector that fails to capture nuanced, non-linear progress and failures. While post-training approaches can mitigate this through explicit training, they demand expensive real-world robotics data and require computationally intensive post-training for every individual base model. To resolve these limitations, we introduce D&A (Describe & Assess): our approach decouples progress estimation into an objective, task-grounded textual description of scene dynamics followed by an assessment phase using explicit rubrics. By compelling the VLM to synthesize an explicit, text-based definition of absolute success before scoring, the framework anchors evaluations to an external, global criterion rather than the video’s internal timeline. Empirical results demonstrate that our method calibrates zero-shot estimates and mitigates confirmation bias, providing fine-grained, partial progress metrics that accurately penalize failed executions while correctly interpolating successful runs. Being purely prompt-based, D&A generalizes across tasks, embodiments, and benchmarks—matching or surpassing post-trained reward models—and its reward estimates enable efficient downstream reinforcement learning.

[292] Pixel-UMI: Learning Environment-Aware Whole-Body Manipulation from Sensorized Human Demonstrations cs.RO | cs.AI | cs.CV | cs.LG | eess.SYPDF

Jason Jingzhou Liu, Tony Tao, Deepak Pathak, Ruslan Salakhutdinov

TL;DR: 论文提出 Pixel-UMI，一个从带传感器的人类演示中学习环境感知全身移动操作策略的流程。方法包括环境感知重定向 EAR、延迟校准动作分配、重定向误差感知掩码 REAM，以及通过 DAgger 收集在线人类纠正。最终在五类挑战性操作任务上取得平均 87.0% 的任务进度。

Details

Motivation: 带传感器的人类演示可提供可扩展的移动操作数据，但人机具身差异会导致策略学习困难；重定向残差还会造成人类演示与机器人观测的视角不匹配，且估计动作难以充分覆盖富接触交互。

Result: 在涵盖铰接物体操作、可变形物体处理、受限空间到达、全身避障和富接触双臂协调的五项挑战任务上，平均任务进度达到 87.0%；摘要未明确说明与具体 SOTA 的对比。

Insight: 创新点在于将场景几何与演示轨迹结合进行碰撞感知的全身重定向，并利用重定向误差训练掩码以缓解部署时视角不匹配，同时用 DAgger 在线人类纠正补足富接触交互能力。

Abstract: Sensorized human demonstrations offer scalable data for mobile manipulation, but embodiment differences complicate policy learning. We present Pixel-UMI, a pipeline for learning environment-aware whole-body policies from human data. We first introduce Environment-Aware Retargeting (EAR), which combines reconstructed scene geometry with demonstrated head and gripper trajectories to determine robot posture and generate collision-aware joint and base targets. Delay-calibrated action assignment converts these trajectories into actions. However, kinematic differences can leave residual pose errors, creating viewpoint mismatches between human demonstrations and robot observations. We therefore introduce Retargeting-Error-Aware Masking (REAM), which uses these errors during training to reduce reliance on mismatched views at deployment. Finally, because estimated actions cannot fully capture contact-rich interactions, we collect on-policy human corrections through DAgger to improve performance. We evaluate Pixel-UMI on five challenging tasks spanning articulated-object manipulation, deformable-object handling, constrained-space reaching, whole-body collision avoidance, and contact-rich bimanual coordination, achieving 87.0% average task progress. Video results are available at https://pixel-robot.com/pixel-umi

eess.AS [Back]

[293] Learning Timeline-Preserving Speech-to-Speech Translation eess.AS | cs.CL | cs.SDPDF

Zhisheng Zheng, David Harwath

TL;DR: 论文提出“时间线保持的语音到语音翻译”（timeline-preserving S2ST），要求翻译语音不仅内容与音色相近，还要在共享绝对时间线上保持源语音的端点与显著内部停顿。作者提出端到端自回归系统TransDubber，通过构建642K精确时长匹配的英中语音对，并结合渐进监督课程与验证器引导强化学习，从对齐目标波形中直接学习时间结构，无需推理时帧级时间控制或后处理校正。

Details

Motivation: 现有S2ST越来越能保留“说了什么”和“听起来如何”，但未必保留语音与静音“何时发生”。对于配音等时间敏感应用，仅匹配总时长不够，语音和停顿也需在对应时刻出现，因此需要研究时间线保持的S2ST。

Result: 在涵盖朗读与自发语音的4,353句测试集上，相比UniSS，TransDubber将翻译时长在源时长2%以内的比例从25.6%提升到61.5%，停顿对齐F1从0.118提升到0.550，同时保持有竞争力的翻译质量。

Insight: 论文的创新点包括明确形式化时间线保持S2ST任务，提出无需推理时帧级控制或后处理校正的端到端自回归框架，构建精确时长匹配的监督数据，并用渐进监督课程加验证器引导强化学习平衡翻译质量与时间对齐。可借鉴之处在于用对齐波形监督建立时间线跟随，再以强化学习细化时间精度并缓解严格同步带来的翻译质量损失。

Abstract: Speech-to-speech translation (S2ST) increasingly preserves what is said and how it sounds, but not necessarily when speech and silence occur. For dubbing and other temporally grounded applications, matching total duration is not enough: speech and pauses must also occur at corresponding moments. We formulate timeline-preserving S2ST, which aims to preserve the source endpoint and salient internal pauses on a shared absolute timeline. We present TransDubber, an end-to-end autoregressive system that learns this temporal structure directly from aligned target waveforms, without inference-time frame-level timing control or post-hoc temporal correction. To provide this supervision, we construct 642K exactly duration-matched English-Chinese speech pairs by translating and synthesizing target speech on source-defined temporal scaffolds. Training combines a progressive supervised curriculum with verifier-guided reinforcement learning to balance translation quality and temporal alignment. On a 4,353-utterance test set spanning read and spontaneous speech, TransDubber increases the proportion of translations within 2% of the source duration from 25.6% to 61.5% and pause-alignment F1 from 0.118 to 0.550 compared with UniSS, while maintaining competitive translation quality. Our analysis shows that aligned supervision establishes timeline following, while reinforcement learning refines temporal precision and partially offsets the translation-quality cost of strict synchronization. Together, these results demonstrate the effectiveness of our data and training framework for timeline-preserving S2ST. Audio samples, code, datasets, and pretrained models are available at https://zhishengzheng.com/transdubber/.

eess.IV [Back]

[294] A Rate-Distortion Optimized Skip Mode Coding Framework for Neural Video Compression in AVS eess.IV | cs.CVPDF

Yuntian Jiang, Shuai Li, Yanbo Gao, Jinglin Zhang, Hui Yuan

TL;DR: 论文针对AVS神经视频压缩（NVC）中的跳过模式编码（skip mode coding），系统分析了其率失真分布随空间和时间参考质量变化的特点，提出率失真优化的RDOSkip框架。该方法利用超先验预测统计分布并结合贝叶斯定理建模率与失真，设计基于时空联合率失真优化的自适应跳过模式决策，用于GOP内通道间和帧间编码。时间跳过模式决策已被AVS NVC标准采纳并集成到参考软件，且无需训练即可推理。

Details

Motivation: 传统视频压缩中的跳过模式在AVS NVC中占据较大编码比例，但现有方法对其率失真性能缺乏研究，且依赖固定跳过阈值和刚性固定失真分布假设，难以适应失真分布的时空变化。

Result: 实验表明RDOSkip在AVS和HEVC数据集上分别取得0.90%和1.29%的BD-rate节省；其时间跳过模式决策已被正在制定的AVS NVC标准采纳并集成到参考软件，推理无需训练且复杂度增加可忽略。

Insight: 创新点在于首次系统分析跳过模式编码的率失真分布时空变化，基于超先验预测统计分布和贝叶斯定理进行率失真建模，并提出时空联合RD优化的自适应跳过模式决策以替代固定阈值。该方法无需训练、即插即用，并已进入AVS NVC标准参考软件，具有较强标准化和工程落地价值。

Abstract: With the development of deep learning, neural video compression (NVC) is gaining increasing interest and is currently under standardization in the AVS (Audio Video Coding Standard). Skip mode coding, a crucial component in the traditional video compression, is also adopted in AVS NVC. Although the skip mode takes a large portion in encoding the motion and residual features in the NVC, there is a lack of investigation on the rate distortion performance of the skip mode coding. In this paper, we first thoroughly investigate the rate and distortion distribution in the skip mode coding within a spatial frame and under different temporal reference qualities, and demonstrate that distortion distribution changes spatially and temporally. Therefore, a rate-distortion optimized skip mode coding (RDOSkip) framework is proposed, where the rate and distortion in the skip mode coding is formulated based on a statistical distribution predicted by the hyperprior and the Bayes’ theorem. An adaptive skip mode decision method based on spatial-temporal joint RD optimization is developed for the skip mode coding among channels and frames in a group of pictures. It addresses the limitation of the rigid fixed-distortion distribution assumption in skip mode coding within the existing methods that rely on a fixed skip threshold. The temporal skip mode decision method has been adopted in the ongoing AVS NVC standard and incorporated into the reference software. The proposed RDOSkip can be directly used in the inference without any training and with negligible complexity increase. Experimental results further demonstrate that the proposed RDOSkip can improve the performance by 0.90% and 1.29% on AVS and HEVC datasets, respectively, in terms of BD-rate saving.

[295] VC-1K: A Diverse Video Test Set for Real-Time Communication eess.IV | cs.CV | cs.MMPDF

Yu-Chen Sun, Jie Dong, Sergey Sablin, Hassene Tmar, Sriram Srinivasan

TL;DR: 论文介绍了VC-1K，一个约1000个视频序列的开源测试集，专为实时通信（RTC）场景下的视频处理和编码评估设计。数据集包含用户生成的视频通话内容，涵盖多种真实条件（设备、光照、运动等），并配有同步音频。论文还通过编码器对比和超分辨率方法评估展示了其效用。

Details

Motivation: 现有测试集多依赖工作室制作或屏幕内容，缺乏真实RTC场景下的用户生成视频数据。VC-1K旨在填补这一空白，提供多样化的真实世界视频通话序列，以更准确地评估RTC中的视频处理和编码流水线。

Result: 论文通过对比OpenH264、SVT-AV1和libaom在恒定比特率下的编码性能，以及评估RealESRGAN和GFPGAN两种超分辨率方法，展示了VC-1K作为基准的实用性，但未报告具体定量结果。

Insight: 创新点包括：针对RTC场景的专用测试集，聚焦移动设备用户生成内容；涵盖设备、光照、运动、环境、人口等多维度多样性；提供同步音频支持多模态研究；公开可用促进RTC研究。客观分析认为，该数据集填补了真实用户生成测试集的空白，其多样性有助于全面评估算法鲁棒性。

Abstract: We introduce Video Conferencing 1000 (VC-1K), an open-source test set comprising approximately 1,000 video sequences specifically designed for evaluating video processing and encoding pipelines in real-time communication (RTC) scenarios. Unlike existing test sets that primarily rely on studio-produced or screen content, VC-1K consists of user-generated video call content captured on consumer mobile devices under a wide variety of conditions. The dataset predominantly features talking-head sequences with distinct faces, but also includes a small subset of outward-facing, rear-camera videos without faces to reflect additional common RTC use cases. It spans a wide range of real-world variables including device type, lighting conditions, motion levels, indoor/outdoor environments, and demographic diversity. All video sequences are accompanied by synchronous audio to facilitate multimodal research. We detail the dataset’s design methodology and statistical distribution, and demonstrate its utility through a comparative encoder evaluation of OpenH264, SVT-AV1, and libaom under constant bitrate (CBR) encoding at resolutions typical of RTC deployments. Furthermore, two super-resolution approaches, RealESRGAN and GFPGAN, are evaluated on VC-1K, highlighting the dataset as a useful benchmark for pre- and post-processing research. VC-1K is intended to serve as a publicly available dataset for the video RTC research community.

[296] Directional Dual-Head Supervision for Real-Time Source-Free Polyp Segmentation eess.IV | cs.CVPDF

Hai-Dang Nguyen, Nhat-Khoi Le, Huu-Thuan Huynh, Minh-Triet Tran, Trung-Nghia Le

TL;DR: 论文提出MedRT-SFSeg，一个面向息肉分割的实时无源域自适应框架。该方法基于双头一对一/一对多YOLO分割架构，通过Mask-DHF融合精度与召回导向预测生成稳定伪实例，利用DURR将双头像素级分歧转化为扩张/收缩掩码的方向线索并恢复漏检、抑制幻觉，再用Seg-MARD进行特征正则化。

Details

Motivation: 无源域自适应医学图像分割无需访问源数据即可适配无标签目标域，但自训练存在确认偏差，容易漏检小息肉、虚假预测前景并产生不精确轮廓，同时临床场景需要实时推理。

Result: 在Kvasir-SEG与CVC-ClinicDB双向适配实验中，方法取得80.43%/80.77% Dice和5.53/8.44 mm ASD，较非适配基线提升7.7和9.8个Dice点，端到端运行速度超过62 FPS。

Insight: 创新点在于利用一对一/一对多双头预测的精度-召回互补性生成稳定伪标签，并将双头像素级分歧作为方向性监督信号修正掩码，同时结合掩码引导的区域分层采样正则化特征表示；客观上看，其价值在于以分割感知的双头监督提升无源域伪标签质量，并兼顾实时推理。

Abstract: Source-free domain adaptation (SFDA) is critical for medical image segmentation as it adapts a model to an unlabeled target domain without accessing source data, thereby preserving data privacy. However, its effectiveness is often limited by confirmation bias: self-training models tend to miss small polyps, hallucinate foreground, and produce imprecise contours. We propose MedRT-SFSeg, a real-time SFDA framework built on a dual-head one-to-one/one-to-many YOLO segmentation architecture. Mask-DHF fuses precision- and recall-oriented predictions into stable pseudo-instances, while DURR uses the sign of pixel-level dual-head disagreement as a directional cue to expand or shrink masks, and additionally recovers missed instances and suppresses hallucinations. Seg-MARD further regularizes feature representations through mask-guided, region-stratified sampling. Experiments on bidirectional adaptation between Kvasir-SEG and CVC-ClinicDB show that MedRT-SFSeg achieves 80.43%/80.77% Dice and 5.53/8.44 mm ASD, improving the non-adapted baseline by 7.7 and 9.8 Dice points while running at more than 62 FPS end-to-end. These results suggest that segmentation-aware dual-head supervision can improve pseudo-label quality without sacrificing real-time inference. Project page: https://danielnguyen-05.github.io/MedRT-SFSeg

[297] The MASSIMAL Dataset: UAV Hyperspectral Images and Ground Truth Observations for Coastal Habitat Mapping in Norway eess.IV | cs.CVPDF

Martin Hansen Skjelvareid, Eli Rinde, Kasper Hancke, Katalin Blix, Galice Guillaume Hoarau

TL;DR: 论文介绍了面向挪威浅海沿岸生境制图的多模态遥感数据集 MASSIMAL，核心是 UAV 高光谱影像及配套标注、RGB/多光谱影像、影像镶嵌和多种水下/声呐地面真值数据。数据集覆盖挪威海岸 4 个区域、45 次飞行，高光谱影像空间分辨率 3.5 cm、400-1000 nm 共 300 个波段，约 1000 幅高光谱影像中 221 幅带分割掩码和层级分类标注，并提供开源反射率与耀斑校正处理流程。

Details

Motivation: 论文旨在为海带林、海草床和 maerl 床等浅水沿岸生境制图提供新的遥感方法基础数据，支持生境分布评估、变化监测和生态系统服务评价，从而服务于挪威沿岸环境的循证管理。

Result: 论文主要贡献是数据集构建而非方法性能评测；摘要给出了数据规模与规格：45 次 UAV 飞行、4 个区域、纬度 59°-67°N、3.5 cm 地面采样距离、400-1000 nm/300 波段、约 1000 幅高光谱影像中 221 幅已标注，并包含 RGB、多光谱、镶嵌图及水下视频、图像和单波束声呐等地面真值。未提及在具体 benchmark 上达到 SOTA 或与某模型对比的定量结果。

Insight: 创新点在于构建面向沿岸生境制图的 UAV 高光谱多模态数据集，提供层级分类体系下的分割标注、耀斑校正与反射率生成的开源处理流程，并融合水下视频、图像和声呐等多源地面真值，为遥感生境制图与变化监测提供可复用数据基础。

Abstract: The MASSIMAL dataset was collected in an effort to develop new remote sensing methods for mapping shallow water coastal habitats, such as kelp forests, seagrass meadows and maerl beds. The main component of the dataset is a set of hyperspectral images collected using a unmanned aerial vehicle (UAV). Images were collected during 45 UAV flights performed at 4 main areas along the Norwegian coast, spanning across a wide latitude range, from 59 to 67 degrees north. The ground sampling distance of the hyperspectral images is 3.5 cm, and the spectral range is 400-1000 nm, sampled across 300 spectral bands. During acquisition, push-broom imagery was automatically split into images with a maximum along-track length of 2000 lines. Out of approximately 1000 hyperspectral images, 221 have been annotated, using segmentation masks and a hierarchical taxonomy. An open source image processing pipeline has been developed as part of the dataset preparation, enabling efficient generation of reflectance images and glint-corrected images based on published radiance images. The dataset also includes color images (RGB) and multispectral images collected using UAV, and georeferenced image mosaics constructed from these. Ground truth data supporting the remote sensing images include hours of underwater video, thousands of geotagged underwater images, and tens of kilometers of single-beam sonar data. The data provide a foundation for assessing habitat distribution, tracking changes, and evaluating ecosystem services, thus supporting evidence-based management in Norwegian coastal environments.

[298] Spectral-spatial vision test-time training for hyperspectral image classification eess.IV | cs.CVPDF

Xiang Zhao

TL;DR: 论文提出ViTTT-HSI，将视觉测试时训练（ViT3）架构适配到高光谱图像分类：用光谱感知嵌入stem提取有序波段信息并保持空间分辨率，通过两个ViT3 TTT编码器块进行patch-conditioned token mixing，并融合中心像素与邻域平均特征进行分类。方法在四个高光谱数据集上验证，取得较高总体精度，并通过消融分析TTT内更新、光谱stem和特征融合的贡献。

Details

Motivation: 高光谱图像分类依赖有限标注下的连续光谱签名与空间上下文表示；视觉TTT虽能通过自监督内模型更新替代固定权重token mixing，但其在中心像素高光谱分类中的应用尚未被充分刻画。

Result: 在Indian Pines、Pavia University、Salinas和Houston 2013上，使用10个随机种子及1%或5%训练比例，平均总体精度分别为97.6390%、98.8753%、99.3292%和98.4283%；消融显示TTT内更新在Indian Pines贡献显著，在Pavia University为较小正贡献，光谱stem与特征融合的收益依数据集而异。

Insight: 创新点在于将ViT3式视觉测试时训练适配到高光谱光谱-空间分类，设计光谱感知嵌入stem保持空间分辨率，并采用patch-conditioned token mixing及中心像素与邻域特征融合。客观看，其价值主要在系统验证内适应机制对HSI分类的可行性和数据集依赖性。

Abstract: Hyperspectral image (HSI) classification requires the representation of contiguous spectral signatures and spatial context under limited labeled supervision. Vision test-time training (TTT) offers an alternative to fixed-weight token mixing by performing self-supervised inner-model updates on the input sequence, but its application to center-pixel HSI classification remains insufficiently characterized. We present ViTTT-HSI, a spectral-spatial adaptation of the vision test-time training (ViT3) architecture. A spectral-aware embedding stem extracts ordered-band information using spectral convolution and forms spatial tokens without reducing their spatial resolution. Two ViT3-based TTT encoder blocks perform patch-conditioned token mixing, followed by the fusion of center-pixel and neighborhood-average features for classification. We evaluate the framework on Indian Pines, Pavia University, Salinas, and Houston 2013 using ten random seeds and dataset-specific training fractions of 1% or 5%. The mean overall accuracies are 97.6390%, 98.8753%, 99.3292%, and 98.4283%, respectively. Ablations reveal a substantial contribution from the TTT inner update on Indian Pines and a smaller positive contribution on Pavia University, while the relative benefits of the spectral stem and feature fusion depend on the dataset. The results demonstrate the feasibility of using patch-conditioned vision TTT for spectral–spatial HSI classification and highlight the role of the inner adaptation mechanism.

[299] HIVE-Diff: High Frame Rate HDR Video Reconstruction from a Single LDR Frame and Events eess.IV | cs.CVPDF

Caixin Wang, Qingrui Wang, Jie Zhang, Ralph Etienne-Cummings

TL;DR: 论文研究从单帧LDR参考和事件流重建高帧率HDR视频，提出HIVE-Diff事件条件视频扩散框架，将任务分解为事件引导的时间生成与HDR内容补全，并利用合成数据训练及教师-学生蒸馏适配真实事件域。

Details

Motivation: 传统帧相机在时间分辨率与动态范围之间存在权衡，事件相机可提供高速、宽动态的亮度变化信息；但纯事件HDR重建存在亮度与颜色漂移，现有事件-帧混合方法多只在LDR时间戳做一对一重建，缺少单参考下的HDR时间扩展。

Result: 在合成数据集和多个真实世界数据集上实验表明方法具有较强重建质量和鲁棒的真实数据适配能力；摘要未给出具体定量指标或明确SOTA结论。

Insight: 创新点在于提出单LDR参考加事件的HDR时序扩展设定，用事件条件视频扩散分解时间生成与HDR补全，并通过合成训练加LDR-事件代理监督蒸馏缓解真实HDR-事件配对数据稀缺问题。

Abstract: High frame rate HDR video is important in applications such as autonomous driving and scientific imaging, where rapid motion and extreme illumination often occur simultaneously. Conventional frame cameras face a trade-off between temporal resolution and dynamic range, while event cameras provide complementary high-speed brightness-change measurements over a wide illumination range. These properties have motivated event-based HDR reconstruction, with existing methods broadly following event-only and hybrid event-frame paradigms. Event-only HDR reconstruction, however, suffers from brightness and color drift due to the lack of absolute intensity references. Hybrid event-frame methods alleviate this ambiguity using low-dynamic-range (LDR) frames as anchors, but most perform one-to-one HDR reconstruction at available LDR timestamps. In this work, we investigate single-reference HDR temporal expansion, reconstructing N HDR frames from one LDR reference and events instead of N aligned LDR observations. We develop HIVE-Diff, an event-conditioned video diffusion framework that decomposes the task into event-guided temporal generation and HDR content completion. Because paired real HDR-event data are scarce, we train on synthetic data and adapt the model to real event domains using LDR-event sequences as proxy supervision with teacher-student distillation. Experiments on synthetic and multiple real-world datasets demonstrate strong reconstruction quality and robust real-data adaptation.

eess.SY [Back]

[300] Vision-based Sensing of Urban Environment using Hardware-Software co-design at Scale eess.SY | cs.CVPDF

Akshit Gupta, R Venkatesha Prasad

TL;DR: 论文提出 UrbanScapes，一个面向大规模城市环境视觉感知的软硬件协同设计平台。该平台采用模块化架构，集成 RGB、近红外和热成像等多光谱成像通道，支持在自行车、车辆、行人或市政车队上灵活部署，以采集街道级多光谱图像；同时利用边缘端深度学习自动去除个人可识别信息，并将街道级多光谱数据与高空遥感多光谱数据结合，用于可扩展地计算物理环境指数。

Details

Motivation: 现有城市环境监测主要依赖人工巡检、高空遥感和有限的地面 RGB 图像，缺乏街道级综合多光谱视角，且街道级数据采集面临隐私和大规模部署难题。论文旨在构建可扩展、无需硬件重设计的软硬件协同平台来弥补这一空白。

Result: 摘要未报告具体定量结果、基准测试或 SOTA 对比，主要介绍了平台的多光谱采集、灵活部署、边缘隐私保护和与遥感数据融合的能力。

Insight: 论文宣称的创新点在于多光谱街道级感知的软硬件协同与模块化设计、支持机会式和定向式大规模部署、边缘端 PII 自动去除，以及融合地面多光谱与高空遥感数据计算环境指数。客观来看，其创新更偏向系统集成与可扩展部署框架，而非单一算法突破。

Abstract: Urban environmental monitoring is crucial for climate-adaptive cities, yet current approaches rely heavily on human inspection, overhead remote sensing, or limited terrestrial RGB imagery, thereby lacking comprehensive multispectral perspectives at street level. To bridge this gap, this paper introduces UrbanScapes, an adaptable and flexible hardware-software co-design platform for large-scale, vision-based sensing of urban environments. Built on a modular architecture, UrbanScapes seamlessly integrates multispectral imaging channels, including Red, Green, Blue (RGB), Near-Infrared, and Thermal, to capture multispectral street-level imagery. The system is designed for both opportunistic deployment on bicycles, vehicles, or pedestrians and targeted deployments on municipal fleets, ensuring high spatio-temporal scalability without requiring hardware redesigns. Crucially, the platform utilizes on-device deep learning models to automatically remove personally identifiable information (PII) at the edge, addressing privacy concerns inherent in street-level data collection. By combining this multispectral street-level imagery with overhead multispectral remote sensing imagery, UrbanScapes enables scalable calculation of physics-based environmental indices, providing a foundational tool for advanced citywide analysis.

q-bio.NC [Back]

[301] Geometric and algebraic inference in humans and neural networks q-bio.NC | cs.AI | cs.CL | cs.LGPDF

Jacob Russin, Joonhwa Kim, Ellie Pavlick, Michael J. Frank

TL;DR: 论文提出将有限数据下的推断形式化为几何推断与代数推断两种策略：前者通过逐步塑造表征几何来编码关系结构，使后续推断更省计算；后者在推理时灵活关注并处理上下文中的新关系，但计算成本更高。作者在传递性推断任务中识别二者的相反特征，并在人类、从头训练的神经网络和大型语言模型中验证，还通过因果干预揭示其分别依赖表征几何和选择性注意机制。

Details

Motivation: 论文关注人类如何从有限数据中进行推断，以及直觉性经验推断与基于上下文新信息的在线推理之间的计算权衡；目标是形式化几何与代数两种策略，并解释人类和神经网络在不同条件下表现出的推理行为。

Result: 摘要未给出具体数值或benchmark/SOTA结果；作者通过多个实验在人类、从头训练神经网络和LLM中观察到两类策略的相反特征，并用神经网络因果干预表明几何策略依赖表征几何、代数策略依赖选择性注意，且可复现人类类似神经生物学干扰效应。

Insight: 创新点在于提出几何/代数推断的统一框架，将认知灵活性中“表征几何”与“代数操作”两种观点联系起来，并用因果干预把策略差异映射到表征几何和选择性注意机制；该框架还能统一人类与LLM推理中的内容效应及机器学习中的数据分布效应。

Abstract: Humans possess a remarkable ability to draw inferences from limited data. While some inferences are made intuitively from past experience, others require online reasoning based on novel information given in context. Here, we formalize these strategies, which we term geometric and algebraic inference, and study their computational tradeoffs in humans and neural networks. The geometric strategy gradually shapes representational geometry to reflect underlying relational structure, making subsequent inference cheap. The algebraic strategy flexibly attends to and reasons over novel relations given in context, but costs additional computation at inference time. We identify opposing signatures of these two strategies in transitive inference, a domain widely studied across species, and characterize the conditions under which each is observed. Our framework predicts that the geometric strategy should be dominant when relations are familiar, whereas the algebraic should emerge to support de novo inferences drawn in context. Multiple experiments demonstrate these opposing signatures in humans, neural networks trained from scratch, and large language models (LLMs). Causal interventions in the neural networks reveal that the geometric and algebraic strategies depend on representational geometry and selective attention mechanisms, respectively, and reproduce the effects of analogous neurobiological disruptions in humans. Our framework unifies these effects with disparate phenomena, including content effects observed in human and LLM reasoning and data-distribution effects observed in machine learning. Our findings reconcile competing views of cognitive flexibility that emphasize either representational geometry or algebraic manipulation by showing that each can have unique strengths, and can characterize different aspects of both human and neural network behavior.

Table of Contents

cs.CL [Back]

[1] MEMENTO: Learning Context Management for Long Context Processing Agents cs.CL | cs.IRPDF

[2] GAVAGAI: Referential Alignment for Infant-Scale Vision-Language Models via Balanced Optimal Transport cs.CLPDF

[3] Dual-Axis Policy Entailment: A Benchmark for Policy-Change Reasoning cs.CL | cs.CYPDF

[4] Distinguishing among reasoning levels of GPT 5.5 Pro via a grammar lens benchmark cs.CLPDF

[5] Multi-Estimate Elicitation Does Not Uniformly Debias Language Model Judgments cs.CL | cs.AIPDF

[6] Enhancing Language Model Reasoning with Structured Multi-Level Modeling cs.CLPDF

[7] ElectroChemLLM: A Multimodal LLM Pipeline for High-Fidelity Electrochemical Informatics cs.CL | cs.DB | cs.IR | cs.LGPDF

[8] DuSE-Bench: Benchmarking Joint Reasoning over Evolving Dialogue and Documents cs.CL | cs.IRPDF

[9] CheXPoT: Post-Hoc Visual Verification and Correction of VLM-Generated Radiology Reports cs.CL | cs.CVPDF

[10] Steer, Don’t Tell: Breaking Reasoning Plateaus with Reachability-Aligned Self-Distillation cs.CLPDF

[11] Adaptive-Policy Distillation: Knowledge Injection under Information Asymmetry cs.CL | cs.LGPDF

[12] ShiftRAG: Bypassing the Textual Bottleneck via Decoupled Learning and Continuous Soft Tokens cs.CL | cs.AIPDF

[13] What Breaks and What Comes Back: Capability Damage and Recovery in Depth-Pruned Small Language Models cs.CL | cs.LGPDF

[14] Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRand cs.CLPDF

[15] S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments cs.CL | cs.AI | q-bio.NCPDF

[16] HALO: Hierarchical Evidence Selection and Reinforcement Learning for Allocating Budgeted Label Optimization from Longitudinal Clinical Records cs.CL | cs.LG | stat.MLPDF

[17] CogRSI: Evolving and Auditing Cognitive Reasoning Strategies cs.CLPDF

[18] Rethinking LLM Pruning via Test-Time Scaling cs.CLPDF

[19] MedAstra: ASR-less Speech Retrieval with Diagnostic Grounding for Medical QA cs.CLPDF

[20] CuriousTogether: Implications of Curiosity and Cultural Grounding in Multi-Agent LLM Interactions cs.CL | cs.AIPDF

[21] Accounting for Irregular State Transitions through Belief Estimation in Online Medical Consultation cs.CLPDF

[22] Write Facts the Way Models Read Them: Lifting the Two-Hop Curse cs.CL | cs.LGPDF

[23] Can Large Language Models Extend Their Agentic Capabilities to Goal Pursuit in Open-Ended Multi-Turn Interaction? cs.CLPDF

[24] FinForesight: A Diagnostic Backtesting Benchmark for Deep Research Systems in Financial Forecasting cs.CL | cs.LGPDF

[25] MemRole: From Memories to Decisions for Long-Horizon Reasoning in Role-Playing Agents cs.CL | cs.AIPDF

[26] Don’t Guess, Ask Wisely: Benchmarking and Training Proactive Elicitation in Open-Domain LLM Conversations cs.CLPDF

[27] TAC-CoT: Tool-Empowered Implicit Chain-of-Thought via Interleaving Explicit Tokens cs.CLPDF

[28] Better Answers, Weaker Evidence Control: Evidence Bypass in On-Policy Distillation cs.CL | cs.AIPDF

[29] Retrieval-Enhanced Cultural Evaluation for Social Media Translation Training cs.CLPDF

[30] MedPsy: State-of-the-Art Small Medical Language Models for Efficient Edge Deployment cs.CLPDF

[31] CULTURE-CMT: Benchmarking Contextualized Social Media Translation cs.CLPDF

[32] Consolidating Reasoning with Test-Time Training cs.CL | cs.AIPDF

[33] FOLLIE: Automated Reasoning over the First Dataset of Sentences with their First-Order Logical Representation for French cs.CLPDF

[34] Can AI Reviewers See Your Efforts to Improve Your Paper? A Large-Scale Study of Paper Revision Trajectories cs.CLPDF

[35] MemShift: Separating Detection from Repair in LLM-Derived Personal Memory cs.CL | cs.AI | cs.LGPDF

[36] Solver-Like Behavior in Large Language Models as Formalizers cs.CL | cs.AIPDF

[37] As Expected? Efficient LLM Planning via Expectation-Observation Consistency Verification cs.CLPDF

[38] FindLink: Learning to Assess Scientific Connections from Source-Grounded Premises cs.CLPDF

[39] Re$^3$Rank: Listwise Reranking with Reasoning-Conditioned Retrieval Heads cs.CLPDF

[40] ICJ-Graph: A Citation Graph and a Layered Document Corpus of the International Court of Justice cs.CLPDF

[41] MicroMouse: Masking Harmful Supervision in Long CoT via Relative Potential cs.CLPDF

[42] EffComp: Efficient Prompt Compression via Hybrid Reinforcement & Supervised Learning cs.CLPDF

[43] PGuard: A Native, Streaming, and Plug-in Guardrail for Multimodal Large Language Models cs.CLPDF

[44] Omni-Life: Benchmarking Omnimodal Real-Time AI Assistants in People’s Daily Lives cs.CLPDF

[45] Maswao: An automatically collected, prepared, and benchmarked dataset for the South African Sign language cs.CL | cs.AIPDF

[46] A State Change Is Local, Its Consequences Are Not: Dependency-Aware State Revision for Long-Term Agent Memory cs.CLPDF

[47] Distilling Literary Sentiment from LLM Annotations into an Ordinal BERT Model cs.CLPDF

[48] VERS: Steering Reasoning Models by Editing Their Activation Explanations cs.CL | cs.LGPDF

[49] Meet Students Where They Are: Student-Prefix Teacher Adaptation for On-Policy Distillation cs.CLPDF

[50] ACTOR: Action-Centered Temporal Organization for Literary Role-Playing Agents cs.CLPDF

[51] MultiInpaintCOCO: Fine-Grained Visual Understanding in Multiple Languages cs.CLPDF

[52] Tracing the Scientific Discovery Capacity of LLMs to Their Training Data cs.CL | cs.AIPDF

cs.CV [Back]

[53] Beyond the Last Layer: Global Inter-Layer Aggregation for AI-Generated Image Detection cs.CV | cs.AIPDF

[54] Intervenable Concept Dynamics for Video Activity Forecasting cs.CV | cs.AIPDF

[55] FORCE: Factorized Object Relations for Counterfactual Editing in Video World Models cs.CVPDF

[56] Covariance-aware Scoring: A Geometric Correction for Vision-Language Test-Time Adaptation cs.CV | cs.LGPDF

[57] The Margin Knows the Background: Uneven Abstention in Frozen Vision-Language Models cs.CVPDF

[58] A Systematic Analysis of Live Intraoperative Surgical Expert Narrations cs.CV | cs.CLPDF

[59] DiA: Directional Adapter cs.CVPDF

[60] Monocular Badminton Speed Estimation with Air Drag and Court Geometry cs.CV | cs.MMPDF

[61] Multimodal Cross-Condition Learning for Temporal Sentence Grounding in Videos cs.CVPDF

[62] Selective Positional Allocation for Noise-Robust Query Retrieval in Small-Object Detection cs.CVPDF

[63] From Single-Shot QA to Continuous Perception: Revisiting the Energy Composition and Optimization Boundary of Edge VLMs cs.CV | cs.AIPDF

[64] Beyond Black Boxes: An Ontology Based Vision Framework for Transparent Fruit Disease Detection cs.CV | cs.AIPDF

[65] Real-Time Obstacle Detection and Distance Estimation on Smartphones for Visually Impaired and Distracted Pedestrians cs.CV | cs.AI | cs.PF | cs.SEPDF

[66] Think Before You Locate: Clinical Chain-of-Though Supervision for Sequential Medical Image Grounding cs.CV | cs.AIPDF

[67] SparseWAM: Driving World-Action Models are Worth 16 Register Tokens cs.CVPDF

[68] Circumpolar Wall-to-Wall Detection of Retrogressive Thaw Slumps with Scarce Labels and Extreme Class Imbalance cs.CVPDF

[69] Keyframes First, Motion Second: Revisiting Compressed-Domain Video Captioning under Limited Supervision cs.CVPDF

[70] ReactionBench: A Human-Anchored Benchmark for Modeling Reactions to Video cs.CV | cs.AIPDF

[71] SIMIT: Self-Improving Vision-Language Models via Imagination at Test-Time cs.CV | cs.LGPDF

[72] From Clips to Streams: A Unified Framework for Streaming Sign Language Translation cs.CVPDF

[73] CausalPrune: Counterfactual Causal Token Pruning for Efficient Large Vision-Language Models cs.CVPDF

[74] CarDiff: Anatomically Aware Dental Caries Synthesis using Diffusion cs.CV | cs.LGPDF

[75] MedICL: Modality-Anatomy-Aware Visual In-Context Learning for Medical Visual Question Answering cs.CVPDF

[76] SAMP: Self-Adaptive Margin Prioritization For Robust Diffusion Watermarking cs.CV | cs.AI | cs.MMPDF

[77] CRaFT-XDet: Causal and Robust Fusion Transformer for Dual-Energy X-ray Prohibited Item Detection cs.CV | cs.AI | cs.LGPDF