cs.CL [Total: 42]
cs.CV [Total: 100]
cs.AI [Total: 12]
cs.CR [Total: 1]
cs.GR [Total: 1]
cs.LG [Total: 6]
cs.RO [Total: 7]
cs.SI [Total: 1]
eess.IV [Total: 2]
eess.SY [Total: 1]

cs.CL [Back]

[1] Multimodal Ambivalence and Hesitancy Recognition with Bidirectional Audio–Text Cross-Attention cs.CL | cs.SD | eess.ASPDF

TingTing Gu, JinCheng Luo, WenQiu Guo

TL;DR: 该音频—文本双向交叉注意模型联合表示多语言转写与语音波形，进行视频级矛盾/犹豫状态二分类；在 BAH 数据集 subject-independent 测试集上准确率 72.19%、A/H F1 77.95%、Macro-F1 70.16%。

Details

Motivation: 矛盾与犹豫是细微行为状态，既可通过说话内容表达，也体现在语气和声学方式中；仅用转写文本或语音单一模态可能漏掉互补线索。

Result: 模型分别用预训练多语言 BERT 和 wav2vec 2.0 编码完整视频转写与语音波形，并映射到共享表示空间。两层双向交叉注意力让语言 token 关注声学帧、声学帧也结合语言上下文，而无需显式时间对齐。随后通过掩码均值池化汇总序列，并结合拼接、逐元素乘积和绝对差进行二分类。在 BAH 数据集的受试者独立测试划分上，准确率为 72.19%、精确率 75.00%、召回率 81.13%、A/H F1 77.95%、Macro-F1 70.16%。

Insight: 显式双向跨模态注意可在不要求文本与音频帧精确对齐的情况下，联合利用语言语义和声学行为线索。摘要未提供单模态基线和不同说话人群体的分项表现。

Abstract: Ambivalence and hesitancy (A/H) are subtle behavioural states that can be expressed through both what a person says and how it is spoken. This paper presents an audio–text framework for video-level A/H recognition. Full-video transcripts and speech waveforms are encoded using pre-trained multilingual BERT and wav2vec~2.0, respectively, and projected into a shared representation space. Two stacked bidirectional cross-attention blocks allow linguistic tokens to attend to acoustic frames and acoustic frames to attend to linguistic context without requiring explicit temporal alignment. The resulting sequences are aggregated through masked mean pooling and combined using concatenation, element-wise products, and absolute differences for binary classification. We evaluate the model on the subject-independent split of the Behavioural Ambivalence/Hesitancy (BAH) dataset. The proposed system achieves 72.19% accuracy, 75.00% precision, 81.13% recall, 77.95% A/H F1-score, and 70.16% Macro-F1 on the test set. These results demonstrate the potential of jointly modelling linguistic and acoustic information for automatic A/H recognition.code at:https://github.com/DorriG/ECCV.

[2] Mixture of Phonetic Experts Based Low-Rank Adaptation of Conformer Models for Accented English Speech Recognition cs.CL | cs.SD | eess.ASPDF

Santosh Dahal, Anmol Guragain, Tianchi Liu, Luis Fernando D’Haro, Kiran Chandra Dahal

TL;DR: MoPE-LoRA 按发音方式而非口音身份组织六个共享低秩专家，并以音素监督与声学门控逐帧路由，适配带口音英语识别且不需口音专属模块；L2-ARCTIC 留一口音零样本测试中，比单一 LoRA 相对提高 12.3%。

Details

Motivation: 传统语音 MoE 通常按口音分配专家，默认口音是主要差异轴，因而新口音缺少专属模块时难迁移。论文认为口音差异往往表现为音素实现方式的系统性变化。

Result: Mixture of Phonetic Experts LoRA（MoPE-LoRA）使用六个固定低秩专家，对齐不同发音方式类别；混合路由结合音素监督和学习得到的声学门控，在帧级选择专家。专家集合跨口音共享，无需为每种口音单独建模块，因此可扩展到训练未见口音。L2-ARCTIC 实验中，MoPE-LoRA 持续超过单一 LoRA 和全量微调；留出一个口音进行零样本评测时，相比单一 LoRA 相对提升 12.3%。

Insight: 将适配单元对齐到发音类别而非口音标签，可能捕捉跨口音共享的音素变体规律，从而提高迁移性。摘要未给出各留出口音的绝对错误率或参数、计算节省量。

Abstract: We present Mixture of Phonetic Experts based Low-Rank Adaptation (MoPE-LoRA), a parameter-efficient adaptation framework for accented English speech recognition. Recent mixture-of-experts approaches typically allocate experts per accent, implicitly treating accent identity as the primary axis of variation. In contrast, we organize adaptation along phonetic categories, motivated by the observation that accent differences are often expressed as systematic distortions of phoneme realization. MoPE-LoRA introduces a fixed set of six low-rank experts aligned with manner-of-articulation classes and performs frame-level routing through a hybrid mechanism that combines phoneme supervision with learned acoustic gating. Because the expert set is shared across accents, the model does not require accent-specific modules and naturally extends to previously unseen accents. Experiments on L2-ARCTIC show that MoPE-LoRA consistently improves over single LoRA and full fine-tuning. In zero-shot evaluation where one accent is held out during training, the proposed method yields a 12.3% relative improvement over single LoRA. These results indicate that phonetic-category-based decomposition offers a scalable and transferable alternative to accent-level adaptation.

[3] AtomSD: Procedural Atom-Guided Self-Distillation for LLM Agents cs.CLPDF

Bohan Yu, Pengfei Cao, Kai Tian, Chen Han, Shi-Yang Li

TL;DR: AtomSD 把智能体过程知识拆为可独立复用的 Intent、When、Do、Avoid 四类程序原子，并从自身成功轨迹持续抽取、通过条件化监督和任务奖励蒸馏回策略；实验平均表现最高比已有先进基线高 9.31 分。

Details

Motivation: 复杂任务不仅需要事实与推理能力，也需掌握如何行动的程序知识。轨迹和打包技能通常绑定较长上下文或多项操作，难以在不同交互历史中灵活复用。

Result: Procedural Atoms 是细粒度、可独立应用的指导单元，分别描述意图、适用时机、执行动作和应避免事项。AtomSD 让学习者持续从自身成功轨迹中抽取这些原子，再通过原子条件化监督和任务奖励优化蒸馏到不断演进的策略。综合实验显示，AtomSD 一贯超过强奖励训练和蒸馏方法，平均表现最高比所报告的先进基线高 9.31 分。

Insight: 将过程性技能拆为可组合的意图、时机、动作和禁忌单元，可以比整段轨迹或打包技能更灵活地迁移。摘要未给出基准列表、分数范围或抽取原子的质量控制方式。

Abstract: Large language models (LLMs) possess broad factual knowledge and strong reasoning capabilities, but solving complex tasks also requires procedural knowledge about how to act. Existing approaches often represent procedural knowledge through trajectories or bundled skills, limiting flexible reuse across interaction histories. This paper introduces Procedural Atoms, fine-grained and independently applicable units that represent Intent, When, Do, and Avoid guidance. Building on this representation, we propose AtomSD, an Atom-guided Self-Distillation framework in which the learner continually extracts Procedural Atoms from its own successful trajectories and distills them into the evolving policy through Atom-conditioned supervision and task-reward optimization. Comprehensive experiments show that AtomSD consistently outperforms strong reward-based and distillation methods, exceeding the state-of-the-art baseline by up to 9.31 points in average performance. Further analyses demonstrate that the proposed Procedural Atoms provide effective guidance, highlighting the value of atom-level procedural knowledge for policy learning.

[4] Think Before You Transcribe: Context-Steered Reasoning for Hotword-Aware Speech Recognition cs.CLPDF

Qihao Wang, Hang Su, Fan Cui, Lichun Fan, Jian Luan

TL;DR: 该框架先生成有音频依据的短字幕，再判断候选 hotword 是否相关后进行转写，以避免不完整或错误候选词覆盖声学证据；监督微调建立字幕到转写行为，难例轨迹注入补强 GRPO，实验显示转写质量和热词识别均改善且对无关候选更稳健。

Details

Motivation: 上下文自动语音识别可通过候选热词提高罕见实体识别，但检索候选可能不完整或错误。系统需要利用真正相关的候选，同时不让无声学依据的备选覆盖音频内容。

Result: Think Before You Transcribe 提出上下文引导的推理流程，先基于音频生成短而有声学依据的字幕，再用该任务表示判断候选热词的相关性，最后确定词汇转写。监督微调先建立结构化的“字幕—转写”行为；针对难语句常出现组内所有 rollout 均失败的问题，方法再用定向轨迹注入强化组相对策略优化。多种上下文条件实验显示，方法持续改善转写质量与热词识别，并能抵御无关候选词。

Insight: 候选实体应先经过声学证据核验，再影响最终词汇决策；将“描述听到什么”与“从候选中选词”分开可降低上下文偏置。摘要未给出具体数据集、模型配置及量化增益。

Abstract: Contextual automatic speech recognition (ASR) improves rare-entity recognition by supplying candidate hotwords, but retrieved candidates may be incomplete or incorrect. A reliable system must therefore exploit a relevant candidate without allowing unsupported alternatives to override the acoustic evidence. We propose a context-steered reasoning framework that generates a short, audio-grounded caption before transcription. This task-specific representation lets the model assess candidate relevance before making a lexical decision. Supervised fine-tuning establishes the structured caption-to-transcription behavior, while targeted trajectory injection strengthens group relative policy optimization when difficult utterances yield only unsuccessful rollouts. Experiments across diverse context conditions show that the proposed method consistently improves both transcription quality and hotword recognition while remaining robust to irrelevant candidates.

[5] TRACE: Training-aware Robustness and Challenge Evaluation for Text-Vision Embedding Models cs.CLPDF

Pume Tuchinda, Tinnakit Udsa, Peerat Limkonchotiwat

TL;DR: TRACE 将 168 项文本—视觉嵌入任务拆为通用、可适配和挑战三类，揭示数据适配能提升可适配任务却难解决困难域：两个模型中适配分数分别提高 7.67 和 7.09 分，但 Challenge 仍低于 5 分，多语和视觉文档是主要短板。

Details

Motivation: 文本—视觉嵌入基准的总分常混合通用能力、任务专属适配收益和困难任务鲁棒性，无法看出模型究竟在哪类能力上不足。

Result: TRACE（Training-aware Robustness and Challenge Evaluation）从不同来源数据集中整理 168 项任务，划分为 General、Adaptability 和 Challenge 三组。对两个文本—视觉嵌入模型的控制实验显示，联合通用数据和适配数据使可适配组分别提升 7.67 和 7.09 分，同时大体保持通用组表现；但挑战组得分仍低于 5，增加训练数据带来的改善有限。进一步分析识别出多语言和视觉文档任务是主要弱项。

Insight: 训练数据扩充可以针对性改善常规适配，却不能替代解决多语言和视觉文档等挑战任务的方法创新；单一汇总分数会掩盖这种差异。摘要未提供各子任务具体分数或模型名称。

Abstract: Existing benchmarks for text-vision embedding models report aggregate scores that obscure whether performance comes from general capabilities, task-specific adaptation, or robustness to challenging tasks. We introduce TRACE, a Training-aware Robustness and Challenge Evaluation framework that reorganizes 168 tasks from various sources of datasets into three categories: General, Adaptability, and Challenge. Through controlled experiments on two text-vision embedding models, we show that combining general and adaptation data improves Adaptability performance by 7.67 and 7.09 points, respectively, while largely preserving General performance. However, Challenge performance remains below 5.0, with limited improvements from additional training data. Further analysis identifies multilingual and visual-document tasks as major weaknesses. Our findings demonstrate that data adaptation alone is insufficient to address these challenges, highlighting the need for methodological advances beyond data-centric improvements.

[6] Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models cs.CLPDF

Osama Shabih, Dayam Nadeem, Shahab Saquib Sohail, Mohammad Nadeem

TL;DR: 一项针对 10 个特定版本 LLM、70 条学术提示的人工评测显示，模型存在回答完整性与事实可靠性权衡：Perplexity 和 DeepSeek V3 总体准确率最高，Gemini 召回较强，而 Falcon 零幻觉但召回最低、回答偏离最大。

Details

Motivation: 大语言模型虽提升推理、文本生成与知识检索，仍可能产生虚构事实或系统性偏离标准答案，影响学术研究可靠性。论文比较模型在不同复杂度学术问题上的准确、完整及幻觉表现。

Result: 研究评测十个模型，包括 ChatGPT、Gemini、Claude 3.5 Sonnet、LLaMA 3、Mistral、Grok、Perplexity、DeepSeek V3、Falcon 和 Gemma。基准含 70 条精心设计学术提示，分基础、解释、高级和陷阱四个复杂度层级；每个回答由三位评审独立按准确率、精确率、召回率、回答偏离指数和幻觉指数评分。Perplexity 与 DeepSeek V3 总体准确率最高；Gemini 召回强，五项指标较均衡；LLaMA 3 以较保守生成降低幻觉。高级题对所有模型最难，结构为二元真伪的陷阱题更易处理。Falcon 达到完美精确率和零幻觉，但代价是召回最低、回答偏离最高。

Insight: 降低幻觉可能以遗漏信息和回答不完整为代价，模型可靠性需同时看准确、召回与偏离；陷阱题的二元结构也限制其代表性。评测基于 2025 年 2 月特定版本，不能直接视为当前版本排名。

Abstract: Large Language Models (LLMs) have significantly advanced natural language processing and artificial intelligence applications through their capabilities in reasoning, text generation and knowledge retrieval. However, LLMs are still vulnerable to two important challenges: hallucination, generating factually incorrect or fabricated content, and response deviation, meaning systematic deviations from ground-truth responses. These limitations raise serious concerns regarding reliability and trustworthiness in academic and research environments. This study offers a thorough comparative analysis using a variety of metrics of ten advanced LLMs ChatGPT, Gemini, Claude~~3.5~~Sonnet, LLaMA~~3, Mistral, Grok, Perplexity, DeepSeek~~V3, Falcon, and Gemma based on a benchmark consisting of 70 carefully designed academic prompts across four complexity levels: Basic, Explanation, Advanced, and Tricky, evaluated in February 2025 on specific model versions. Each response was independently evaluated by three reviewers using five metrics: Accuracy, Precision, Recall, Response Deviation Index, and Hallucination Index. Perplexity and DeepSeek~~V3 achieved the highest overall accuracy, while Gemini demonstrated strong recall and a well-balanced performance profile across all five metrics. LLaMA~~3 showed strong resistance against hallucinations through a conservative method of generation. Advanced-level prompts proved most challenging across all models, while Tricky prompts were handled more reliably owing to their binary true/false structure. Falcon achieved perfect precision and zero hallucinations, but at the cost of the lowest recall and the highest response deviation. The results show a fundamental trade-off between response completeness and factual reliability, intensified by prompt complexity.

[7] Cross-Lingual Reusability of LLM Pipelines: Financial Extraction, Multilingual Reasoning, and Semantic Screening cs.CL | cs.AIPDF

Joong Ho, Choi, Sherine George, Jiayang Zhao, Jayesh Rathi

TL;DR: 跨语言管线研究用支票抽取、九语言 Mintaka 问答和多语言 SEC 文件 FinanceBench 检验英文 LLM 流程的复用性；Gemini 3.5 Flash 抽取准确率为 95.2–97.6%，但推理预算收益依领域而异，引用集合与英文重叠率约 77–79%。

Details

Motivation: 金融机构在多语言市场部署 LLM 时，需判断英语开发验证过的管线能否跨语言复用，还是必须为每个地区重建。论文从准确率、推理努力迁移和行为稳定性三个方面进行评估。

Result: 研究设置三项任务：支票信息抽取；包含固定证据的 Mintaka 问答，覆盖九种语言和九种模型推理预算；以及在四种语言 SEC 10-K 文件上进行 50 项 FinanceBench 试点。Gemini 3.5 Flash 在不同提示语言下的抽取准确率为 95.2–97.6%；FinanceBench 各语言均值范围为 77.1–82.9%，跨度 5.8 个百分点，但语言难度排序跨领域反转（Hindi 在 Mintaka 最难，在 FinanceBench 最易，为 82.9%）。提高推理预算对一般知识问答仅有边际收益，对金融内容最多提升 8 个百分点，且英语中有效的预算配置在其他语言呈比例收益。与英文的引用集合 Jaccard 重叠平均为 77–79%，没有某种语言始终更差。

Insight: 英语管线具有一定跨语言可复用性，但准确率、推理预算收益和行为稳定性随领域变化；语义相似或模型自报置信度不能替代逐领域逐语言验证。金融基准仅 50 项试点，结论仍有限。

Abstract: Financial institutions increasingly deploy large language models (LLMs) in multilingual markets, raising a practical question: can pipelines developed and validated in English be reused across languages, or must they be rebuilt per locale? We test cross-lingual reusability along three dimensions–accuracy, reasoning-effort transfer, and behavioural stability–through three complementary tasks. Task 1 (cheque extraction) and Task 2 (Mintaka QA with pinned evidence across nine languages and nine model-effort configurations) test whether accuracy and effort settings transfer; Task 3 (FinanceBench pilot, 50 items over SEC 10-K filings in four languages) validates whether these patterns generalise to financial content. Accuracy reusability is broadly confirmed: Gemini 3.5 Flash achieves 95.2-97.6% extraction accuracy across prompt languages, and FinanceBench per-language means span 5.8pp (77.1-82.9%), though the language-difficulty ranking reverses between domains (Hindi is worst on Mintaka, best on FinanceBench at 82.9%). Effort reusability is domain-dependent: higher reasoning effort yields marginal gains on general-knowledge QA but up to 8pp on financial content, and effort configurations that help in English help proportionally in other languages. Behavioural reusability holds: citation-set overlap with English averages 77-79% Jaccard, with no single language consistently worse. Together, these results support qualified reuse of English-built pipelines, but per-domain, per-language validation remains necessary–neither semantic similarity nor self-reported confidence reliably predicts cross-lingual accuracy.

[8] Discrete Neural Interlingua for Ontology-Agnostic EHR Modeling cs.CL | cs.AI | cs.LGPDF

Tong Ding, Caiwei Tian, Dongmin Bang, Ming Y. Lu, Sophia J. Wagner

TL;DR: MEDIATOR 将病历中的代码、别名和自由文本映射为共享离散语义码，缓解跨医院 EHR 词表不一致；在 MIMIC-III 及零样本 eICU 迁移任务上提升预测效果。

Details

Motivation: 电子病历基础模型常被封闭词表限制：同一临床概念在不同医院可能表现为不同本体代码、本地编号、同义词或自由文本。用 MIMIC-III 词表训练的模型只能覆盖 eICU 约 13% 的事件，导致跨系统迁移时信息大量丢失。

Result: 作者提出 MEDIATOR，以同义词监督及概念描述、代码共现和关系图为依据，将临床文本映射到共享的向量量化离散码本，无需人工映射或预先固定词表。作为 EHR Transformer 的输入接口，它在 MIMIC-III 20 项任务上的平均 AUPRC 较此前最强 tokenizer 高 4.0 点（相对提升 8%）；迁移到 eICU 14 项任务时高 8.6 点（相对提升 29%），且可使用全部事件。相同输入控制实验仍有 1.0 和 1.9 点优势；研究还报告跨医院归因可迁移。

Insight: 迁移收益同时来自事件覆盖率提升和概念表示改进。控制实验显示，文本编码器主要贡献域内准确率，而 MEDIATOR 的学习目标更能支撑迁移稳健性与实体链接质量。核心价值是把临床概念对齐变成开放词表 tokenization，而不是依赖逐院维护映射表。

Abstract: EHR foundation models promise scalable clinical prediction across health systems, yet their deployment is constrained by a tokenization bottleneck. The same clinical concept can appear as different ontology codes, local identifiers, synonyms, or free-text descriptions, which standard EHR tokenizers treat as unrelated symbols. A model trained on MIMIC-III with a closed-vocabulary tokenizer can use only 13% of eICU events. We introduce MEDIATOR, a discrete ontology-agnostic tokenizer that maps any clinical concept expressed as text into a shared vector-quantized codebook, turning EHR harmonization into open-vocabulary tokenization without manual mappings or a fixed vocabulary. Trained with synonym supervision and guided by enriched concept descriptions, code co-occurrence, and relation graphs, MEDIATOR collapses equivalent expressions while organizing distinct concepts in a medically meaningful discrete space. Used as the token interface of an EHR Transformer, MEDIATOR improves mean AUPRC over the strongest prior tokenizer by 4.0 points (8% relative) on 20 MIMIC-III tasks and by 8.6 points (29% relative) in zero-shot transfer to 14 eICU tasks, where it uses all events. The transfer gain combines coverage and representation, as MEDIATOR remains the best tokenizer under identical inputs (+1.0 and +1.9 points on operational and subcohort-mortality tasks). Same-encoder controls show that the text encoder drives in-domain accuracy, while the learned objectives of MEDIATOR drive transfer robustness and entity-linking quality. MEDIATOR also enables transferable attribution across hospitals.

[9] ICLHerd: Herding-Based Data Selection for LLMs with In-Context Learning as a Proxy cs.CL | cs.AI | cs.LGPDF

Yuqiao Wen, Lili Mou

TL;DR: ICLHerd 用冯·米塞斯–费舍尔核平衡数据选择中的“贴近开发样本”与“覆盖多样模式”，并以上下文学习表现作为高效验证代理。

Details

Motivation: 大模型训练数据筛选常按开发样本的隐藏状态或梯度余弦相似度选取最相近数据。作者发现，这种最大相似度策略容易产生模式寻求偏差，使选出的样本紧密聚集在少数开发样本附近，不能覆盖目标能力的多样变化。

Result: ICLHerd 使用冯·米塞斯–费舍尔核设计数据选择框架，在模式寻求与模式平均之间调节；同时提出以模型的上下文学习效果作为验证代理，从而更高效地搜索这一平衡超参数。实验中，ICLHerd 优于已有大语言模型数据选择算法。摘要未给出具体数据集或提升幅度。

Insight: 好的训练数据既要与目标能力相关，也要覆盖其不同表现形态。把相似样本选择从单纯追求最近邻改为可调的集中与分散折中，可以缓解开发集过拟合式的样本聚集；上下文学习代理则减少了调参时对昂贵完整训练评估的依赖。

Abstract: Data selection plays a central role in modern large language model training, as the quality of training data strongly influences downstream performance. A common approach is to curate a development set that encodes the desired skills (e.g., reasoning or multilinguality) and select data that are similar to them. Existing methods compute similarity using cosine distance over either the model’s hidden states or gradients. However, we observe that this max-similarity strategy induces a mode-seeking bias: the selected data clusters tightly around the development samples. To address this, we propose ICLHerd, a data selection framework that leverages the von Mises-Fisher kernel to balance mode-seeking with mode-averaging. We further introduce in-context learning as a validation proxy, enabling efficient hyperparameter search over the balance trade-off. Results show that ICLHerd outperforms existing LLM data selection algorithms, highlighting the importance of balancing mode-seeking and mode-averaging.

[10] GRID: Modeling Health Influencer Discourse as Argument Networks for Credibility Assessment cs.CLPDF

Nishanth Sridhar Nakshatri, Eylon Caplan, Dan Goldwasser

TL;DR: GRID 将健康网红视频中的论点、结论和科学证据组织成跨视频论证网络，在 569 条专家评估视频上验证了利用整体话语关系评估可信度的价值。

Details

Motivation: 社交媒体健康内容通常被孤立地逐条判断，忽略不同创作者围绕同一议题提出的相互支持或冲突观点。单条内容的论据、核心结论及其科学证据关系，可能影响其整体可信度判断。

Result: GRID（基于互联话语的扎根推理）把每条视频建模为连接具体主张与中心结论的论证图，再跨视频关联相关主张和结论，以科学证据为依据联合推断可信度。端到端评估使用 569 条由专家给出评估的健康网红视频。结果表明，考虑更广泛的话语网络能提升内容验证；作者还用推断的可信度分析了高、低可信内容在论证策略与道德框架上的差异。

Insight: 健康信息核验可以从单条视频分类扩展到跨内容的集体推断：论点之间的呼应、冲突以及证据支撑共同构成判断依据。该方法把可解释的论证结构用于可信度分析，但摘要未报告具体准确率或提升数值。

Abstract: Health-related discussions on social media are increasingly shaped by influencers who offer diverse, and often competing perspectives on the same issue. Yet, such content is typically evaluated in isolation, without considering the broader discourse in which it appears. We introduce GRID (Grounded Reasoning over Interconnected Discourse), a framework for evaluating influencer content through collective inference over the surrounding discourse. GRID represents each video as an argumentation graph connecting claims to its central message, or takeaway, links related claims and takeaways across videos, grounds claims in scientific evidence, and jointly infers credibility over the resulting network. We evaluate GRID on an end-to-end health-related content validation task using 569 influencer videos grounded in expert assessments. Our results show that accounting for the broader discourse improves influencer content validation. Finally, we use GRID-inferred credibility to demonstrate how argumentative strategies and moral framing differ between low- and high-credibility content.

[11] On the Fragility of Tasks under Composition: Implicit Budgeting in Language Models cs.CL | cs.AI | cs.LGPDF

Chenpan Li, Thies Brockmoeller, Stefanie Jegelka, Sharut Gupta, Nikolaos Karalias

TL;DR: 语言模型把多个任务放进同一提示时会隐式压缩每项任务的思考预算，较长推理任务更脆弱；按脆弱性分组可节省 43% token 并保持准确率。

Details

Motivation: 模型常被要求在一条提示中完成多个子任务并整合答案。研究发现，即便每个任务单独都能可靠完成，组合后错误也显著增加，且不能仅用各任务独立错误累加来解释。

Result: 作者在多种开放权重模型及 Claude Opus 5 上观察到组合任务的隐式思考预算效应：任务组合时每项任务获得的 token 明显少于单独求解，即使总序列远未达到上下文窗口上限。单独求解时需要较长推理过程的任务，在组合情形下更易出错。按脆弱性分组后，模型可在数学和语言任务上减少 43% token，同时保持准确率。

Insight: 组合提示会改变模型分配给各子任务的推理资源；任务间干扰不只是错误概率相加，而与隐式预算压缩有关。统一削减推理可能伤害需要长推理的任务，因此根据任务脆弱性分组，有机会同时减少冗余计算并保住准确性。

Abstract: Modern language models are increasingly asked to handle several tasks within a single prompt. Doing so requires solving each task correctly while integrating the resulting answers into a coherent response. In this paper, we identify a fundamental limitation in this process, where models make substantially more errors when tasks are composed, even when they can solve every constituent task reliably in isolation. This degradation cannot be fully explained by the accumulation of independent errors. Across both open-weight models and the frontier model Claude Opus 5, our findings instead point to an implicit thinking budget underlying this effect. In particular, under composition, models use substantially fewer tokens per task than in isolation, even when the full sequence remains well within the context window. Tasks that require longer solution traces in isolation are consequently more $\textit{fragile}$ under composition, i.e., models make more errors on prompts containing these tasks. In isolation, non-fragile tasks receive more reasoning than they need and waste compute. However, by grouping tasks according to their fragility, the implicit budgeting can be manipulated to reduce token usage by $43$% across a range of math and linguistic tasks while also preserving accuracy.

[12] The Culture Within: Towards Mechanistic Understanding of Cultural Reasoning in LLMs cs.CLPDF

Samee Arif, Furkan Danisman, Angana Borah, Honglak Lee, Dehan Kong

TL;DR: CultureLens 显示模型在缺乏明确国家信息时倾向默认英语文化规范，也会轻信检索到的错误规范；用反事实规范样例微调可将对齐率提升到 85–93%。

Details

Motivation: 现有文化能力评测多关注模型最终输出，较难辨析模型如何使用国家、价值观及规范证据。研究希望区分文化知识缺失与模型处理相互矛盾规范信息时的机制性错误，并考察检索内容可能带来的风险。

Result: CultureLens 包含来自 75 个国家的 9,261 个场景，系统改变国家、价值观、真实规范及矛盾规范证据。在 Llama-3.1-8B、Gemma-3-12B 和 Qwen-3.5-27B 上，加入矛盾规范会使符合文化规范的回答下降 32–47 个百分点，即使模型仅凭国家信息原本答对。无国家提示时模型倾向英语文化规范；阻断模型内部的规范信息后，多数情况下可恢复正确答案。监督微调加入矛盾规范样例后，在矛盾规范情境中的对齐率升至 85–93%，并能泛化到未见国家，但真实规范场景有小幅代价。

Insight: 模型受错误规范影响并非单纯因为缺少文化知识：它会按规范信息的呈现方式接受内容，而不核实其真实性，因此检索到的文化信息可能诱发错误。评估和训练需区分国家先验、证据可信度与矛盾信息处理，并关注纠错能力在真实规范情境中的权衡。

Abstract: Large Language Models (LLMs) increasingly operate across culturally diverse settings, yet existing evaluations largely measure cultural behavior at the output level. We introduce CultureLens, a reference-grounded benchmark and mechanistic study of how LLMs use cultural information. CultureLens contains 9,261 scenarios across 75 countries and systematically varies country, value, true-norm, and contradictory-norm evidence. Across Llama-3.1-8B, Gemma-3-12B, and Qwen-3.5-27B, stating a contradictory norm lowers aligned answers by 32-47 percentage points, even when the model answers correctly from the country alone. Mechanistically, models default to Anglophone norms when no country is given. The failure under a contradictory norm is not one of missing knowledge, as blocking the norm inside the model restores the correct answer in most cases. Models accept a stated norm according to how it is presented and not whether it is true, which leaves them most exposed to errors in retrieved content. Supervised fine-tuning with contradictory-norm examples raises aligned answers under a contradictory norm to 85-93%, including on unseen countries, at a small cost under a true norm.

[13] MMedAgent-Plus: Scaling Multimodal Medical Agents across Modalities, Tasks and Workflows cs.CL | cs.AIPDF

Ruoxin Wang, Yuanting Pan, Binxu Li, Ruiyang Ji, Yaqian Chen

TL;DR: MMedAgent-Plus 将 VLM 规划器与覆盖 12 项任务、8 种模态的 18 个医学专家模型组合，以工具调用完成多步骤医疗工作流；端到端测试中 350 例的最终答案准确率为 0.98。

Details

Motivation: 医疗工作流通常需要多个相互依赖的分析，单一专科模型和通用模型都不擅长协调这些步骤。系统需要能选择不同专科工具、按序执行并把结果整合为有依据的答复。

Result: MMedAgent-Plus 以视觉语言规划器协调 18 个专科模型，覆盖 12 项任务和 8 种模态；规划器在 32 个公开医学基准的 208,928 个样本上指令微调。留出评测中，单工具多轮、多工具多轮、多工具单轮的调用准确率分别为 91.0%、98.1%、80.7%。给定正确工具输出时，600 个样本的忠实度、完整性和简洁性评分为 14.4–14.8/15。端到端 350 例、七项任务中，90.6% 正确调用所需专家，最终答案准确率为 0.98，匹配专科领先模型并高于最强基线 0.28。

Insight: 系统把工具编排、输出综合和端到端执行分开评估，显示多模态医学智能体的关键不只是模型知识，还包括何时调用专家以及如何忠实整合其结果。接近专科模型的端到端准确率建立在所测七项任务范围内。

Abstract: Medical workflows often require multiple interdependent analyses, but existing specialist and generalist AI models are not designed to coordinate them. We introduce MMedAgent-Plus, a multimodal medical tool-use agent that combines a vision-language planner with 18 leading specialist models spanning 12 tasks and 8 modalities. Through a unified tool interface, the planner selects specialists, executes them in sequence, and synthesizes responses grounded in their outputs. The planner is instruction-tuned on 208,928 samples from 32 public medical benchmarks, covering single- and multi-tool interactions across single and multiple rounds. We separately evaluate tool orchestration, response synthesis, and end-to-end execution on held-out samples. MMedAgent-Plus achieves tool-call accuracies of 91.0%, 98.1%, and 80.7% in single-tool multi-round, multi-tool multi-round, and multi-tool single-round settings, respectively. Given correct tool outputs, MMedAgent-Plus achieves scores of 14.4-14.8 out of 15 for faithfulness, completeness, and conciseness across 600 evaluation samples. In end-to-end execution without pre-supplied tool outputs, MMedAgent-Plus correctly invokes the required specialist in 90.6% of 350 evaluation cases spanning seven tasks. Its final-answer accuracy reaches 0.98, matching the dedicated leading specialist and exceeding the strongest baseline (0.28).

[14] CEFR-oriented Russian Text Simplification Using Reinforcement Learning cs.CLPDF

Kristina Mustakova, Alexey Sorokin

TL;DR: 研究用拒绝采样和 DPO 微调 YandexGPT，将俄语文本简化到 CEFR A1–B1；最佳模型目标等级准确率 87.15%，平均绝对误差 0.35 个等级。

Details

Motivation: 俄语文本简化需要按目标语言水平控制词汇、形态和句法难度，同时尽量保持语义。研究聚焦 A1、A2、B1 三个 CEFR 等级，比较偏好优化配置如何影响难度控制和文本质量。

Result: 作者以拒绝采样和直接偏好优化（DPO）微调 YandexGPT，比较不同数据组成、文本类型及偏好对构造策略。自动评估使用 ruRoBERTa-large 回归预测连续 CEFR 难度分，并考察语义相似度、词汇覆盖和可读性；人工评估简易度、流畅度和恰当性。最佳模型目标等级准确率为 87.15%，等级 MAE 为 0.35，目标区间 MAE 为 0.11。人工评估中，75% 简化文本符合目标形态句法水平；A2、B1 的流畅度和恰当性较高。A1 仍最困难，但模型减少了超出目标级别的词汇与语法结构，同时总体保留原意。

Insight: 控制式简化不仅需要测总体可读性，还要检验文本是否落在指定等级区间及是否保留含义。模型对 A1 的控制仍较难，而 A2、B1 的流畅和恰当度较好，说明不同水平的难度控制能力并不均衡。

Abstract: We present a study on controlled automatic simplification of Russian texts using preference-based optimization algorithms with a focus on adapting texts to the A1, A2 and B1 proficiency levels. We fine-tune YandexGPT using Rejection Sampling and Direct Preference Optimization (DPO) methods to improve control over the complexity of the generated text. We compare several training configurations that differ in dataset composition, text type and the strategy used to construct preference pairs for DPO. For automatic evaluation we train a regression model based on ruRoBERTa-large to predict continuous complexity scores corresponding to CEFR levels. We also consider semantic similarity, lexical coverage and quantitative readability metrics. Human evaluation assesses simplicity, fluency and adequacy. Our best model achieves 87.15% target level accuracy, an MAE of 0.35 CEFR levels and a target interval MAE of 0.11. Manual assessment shows that 75% of the evaluated simplifications match the target morphological and syntactic level, and fluency and adequacy scores are especially high for A2 and B1. Although A1 remains the most challenging level, the model significantly reduces the proportion of vocabulary and grammatical constructions beyond the target level while generally preserving meaning. Our model is freely available on $\href{https://huggingface.co/kmustakova/RuSimplifier_DPO}{HuggingFace}$.

[15] Diagnostic Analysis for Large Language Model Reasoning cs.CLPDF

Xinyu Liu, Dongqi Fu, Jun Wu

TL;DR: 该研究直接诊断 LLM 推理图的结构可靠性：图质量随拓扑、提示和模型家族变化；上游图错误会损害不确定性估计，而真值图可改善置信度区分和节点级诊断。

Details

Motivation: 推理链和推理图被用于概率推断、事实核查和不确定性估计，但这些结构本身是否可靠很少被直接评估。若推理图的节点或边构造错误，下游基于图的判断可能受到影响。

Result: 作者在开放式多跳问答中设计两阶段诊断。第一阶段检验构造推理图所需能力，发现图可靠性取决于图拓扑、提示设计和模型家族。第二阶段以不确定性估计作为下游任务：使用模型生成边时，图计算对上游图错误敏感，相较真值图设置性能下降；使用真值图时，仅把图作为提示上下文带来的收益有限，但它能改善置信度对正确与错误答案的区分，并支持节点级诊断。

Insight: 基于推理图的下游表现不能替代对图结构本身的验证；生成边的误差会传播到后续计算。真值图的价值主要体现在置信度校准式区分和定位问题节点，而非仅作为上下文就普遍提升答案能力。

Abstract: Reasoning structures (e.g., chains and graphs) are increasingly used for probabilistic inference, factuality verification, and uncertainty estimation, but their structural reliability is rarely evaluated directly. We test whether this reliability holds through a proposed two-stage diagnostic evaluation in open-ended multi-hop QA. Stage 1 tests different capabilities required to construct reasoning graphs, showing that graph reliability varies with topology, prompt design, and model family. Stage 2 uses uncertainty estimation as a downstream test case. Generated-edge experiments show that graph-based computation is sensitive to upstream graph errors, with performance dropping relative to the gold-graph setting. Gold-graph experiments further show that graph structure provides little benefit when used only as prompt context, but improves the separation of correct from incorrect answers by confidence score and enables node-level diagnostics.

[16] Auditing Safety Preference Supervision with Recorded Derivations cs.CL | cs.AI | cs.LG | cs.SCPDF

Chenhan Lyu, Amir Rahmani

TL;DR: 符号化偏好标注把提示属性、显式规则和固定裁决顺序记录成可重算的偏好推导；研究区分了标签可复现性与属性判断正确性，并报告有害提示上的结构化输出失败。

Details

Motivation: 偏好标签用于对齐模型训练，但其背后的判断过程通常不易检查或复核。若记录构造偏好的中间决策，就能重算最终标签；不过这仍不能自动保证模型分类的属性正确或语义安全。

Result: 符号化偏好标注让预训练语言模型分类提示和回答的预定义属性，再由显式规则给出回答裁决，并按固定裁决排序生成偏好标签。保存的属性赋值、规则和排序足以重新计算裁决和标签，无需再次调用模型。200 条人工标注提示中，模型对 192 条生成有效结构化输出；8 条解析失败全部出现在标记为有害的自伤提示子集中。研究以 465 对偏好数据、五个训练随机种子进行 DPO；在 1,319 条类似不安全请求的良性提示上，平均测得良性拒绝率为 40.82%，在 655 条有害提示上，平均毒性拒绝率为 84.98%。

Insight: 记录完整推导可让偏好标签可检查、可复算，但可复现性不等于属性判断正确，更不能替代语义安全验证。失败集中出现在自伤类有害提示，也说明结构化解析问题可能与提示类别相关，应与标签推导机制分别审计。

Abstract: Preference labels align model training, but the judgments behind them are difficult to inspect or verify. In this paper, we examine how preference construction can be checked when intermediate decisions are recorded, and which of them remain uncertain. We present Symbolic Preference Labeling, a method in which a pretrained language model classifies predefined attributes of prompts and responses. Explicit rules assign response verdicts, and a fixed verdict ranking determines the preference label. Each preference label has a recorded derivation: the response verdicts and preference label can be recomputed from the stored attribute assignments, rules, and verdict ranking without rerunning the language model. On 200 prompts annotated by human raters, the language model produces valid structured outputs for 192 prompts. All eight parsing failures occur in the subset of self-harm prompts marked as harmful. Using 465 preference pairs, we train one policy model with direct preference optimization across five training seeds. Mean measured benign refusal is 40.82 percent on 1,319 benign prompts that resemble unsafe ones, and mean measured toxic refusal is 84.98 percent on 655 toxic prompts. This study distinguishes the reproducibility of preference labels from attribute correctness. The recorded derivations make preference construction open to inspection, while attribute correctness and semantic safety require separate validation.

[17] RealControlBench: A Benchmark for Interpretability-Informed Fine-Grained Control of LLMs and Agents cs.CLPDF

Xinying Cai, Bin Hu, Mingyu Jin, Qiming Zhang, Yang Ouyang

TL;DR: RealControlBench 将 LLM 和智能体控制评测扩展到真实执行、多轮交互及五类行为目标；评测显示现有 steering 方法在真实目标上仍不可靠，且可能损害任务能力。

Details

Motivation: 现有 steering 基准多使用简化、孤立的生成任务，只测单一行为属性，与真实部署中的复杂性和多样性交互不符。因此在这些基准上的效果难以说明控制方法在实际场景中能否稳定工作。

Result: RealControlBench 评测 LLM 和 LLM 智能体的细粒度控制，覆盖指令遵循、工具使用决策、推理表现、推理长度和轨迹条件化安全意识五个维度，并包含执行落地的多轮智能体交互。它同时测量目标可控性与能力保留，包括指令遵循、推理、下游工具效用和安全性，还考察效果对提示变化、领域和架构是否稳健。实验发现，现有方法难以稳定诱导目标行为，且可能显著损害底层任务表现。

Insight: 在简单单轮文本生成中观察到强 steering 效果，不代表复杂交互中能精准、稳定地控制行为。控制评估需要同时追踪目标是否达成和模型原有能力是否保留，并覆盖提示、领域、架构变化及执行结果。

Abstract: Existing steering benchmarks are built around simplified, isolated generation tasks and evaluate a single behavioral attribute under controlled settings that do not reflect the diversity and complexity of practical deployment. As a result, performance on these benchmarks provides only a limited picture of how steering methods perform in the real world. We therefore introduce RealControlBench, a comprehensive benchmark for evaluating fine-grained steering of LLMs and LLM agents across diverse behavioral targets and interaction settings. RealControlBench extends steering evaluation beyond isolated generations to complex, execution-grounded, multi-turn agent interactions, covering five complementary dimensions: instruction-following control, agentic tool-use decision control, reasoning-performance steering, reasoning-length control, and trajectory-conditioned safety awareness. Rather than measuring steering success alone, the benchmark jointly evaluates target controllability and capability preservation, including instruction following, reasoning performance, and downstream agent utility and safety. It further examines whether steering effects remain specific and robust across prompt variations, domains, and model architectures. Our evaluation shows that existing steering methods remain unreliable across realistic control objectives: they often fail to consistently induce the intended behavior and can substantially degrade the model’s underlying task performance. These results suggest that strong steering effects in controlled settings do not necessarily translate into reliable control in more realistic evaluations. By providing a unified, model-agnostic steering evaluation framework, RealControlBench aims to support the development of steering methods that are not only effective but also precise, robust, and useful in realistic AI deployments.

[18] Explore More, Validate Less: Efficient Reflective Prompt Optimization cs.CLPDF

Xiaofan Zhou, Lu Cheng

TL;DR: 该提示优化框架把反思候选生成与完整验证预算分开：先用小批量筛选并行构造候选，再按固定预算选优；五个基准上最高提升 11.22 个百分点。

Details

Motivation: 反思式提示优化利用任务反馈改写指令，但若候选生成和筛选都依赖完整验证集，会使搜索成本高且流程串行。候选池规模与验证预算也因此难以独立调节。

Result: 两阶段方法先从多个父提示并行展开反思分支，重复利用父提示的训练响应，并仅在小训练批次上与父提示比较筛选局部改进候选；候选池冻结后，再由探索策略在固定的完整验证预算内选择得分最高的提示。作者在五个基准、Qwen3.5-9B 和 Llama-3.1-8B-Instruct 上评估；保留 100 个候选并进行 20 次完整验证时，相较初始求解器最高提升 11.22 个百分点。学习式选择在十组比较中均超过初始求解器，但随机选择与学习式选择之间没有一种始终占优。

Insight: 将候选探索和昂贵的完整验证分离，可独立设置搜索广度与验证次数，并利用低成本局部筛选扩展候选池。实验支持这一预算拆分思路，但候选如何排序仍有改进空间，不同选择策略并无稳定赢家。

Abstract: Reflective prompt optimization improves instructions using task feedback, but coupling candidate generation with full-validation-based selection can make search costly and sequential. We propose a two-stage framework that decouples reflective candidate-pool construction from validation allocation. During construction, we sample multiple parents and reuse each parent’s training responses across parallel reflection branches. Each revision is screened against its parent on a small training minibatch, allowing locally improved candidates to support further revisions without full validation. After construction, an exploration policy selects candidates from the frozen pool under a fixed full-validation budget, and the prompt with the highest measured validation score is returned. This separation allows candidate-pool size and validation budget to be set independently. We evaluate random selection and learned score prediction with similarity-based exploration on five benchmarks using Qwen3.5-9B and Llama-3.1-8B-Instruct. With 100 retained candidates and 20 full validations, our framework improves over the initial solver by up to 11.22 percentage points. Learned selection improves over the initial solver in all ten comparisons, although neither selection policy consistently outperforms the other. These results support separating reflective search from budgeted validation while leaving room for stronger candidate-selection policies.

[19] SHAM-Bench: A Span-level Hallucination Benchmark Across Multiple Tasks cs.CLPDF

Sicong Huang, Ian Lane

TL;DR: SHAM-Bench 汇总六类文本生成任务的 6,461 个样本，统一评估跨度级幻觉检测；微调检测器域内表现较好但遇分布变化会退化，带推理的提示法跨任务更稳健。

Details

Motivation: 跨度级幻觉检测要定位输出中缺少依据的具体片段，便于提供可执行反馈。但现有评估在任务、标注格式和指标上彼此割裂，多数数据集只覆盖一种文本生成领域，难以判断检测方法能否跨任务泛化。

Result: SHAM-Bench 将现有人类标注数据按统一模式和评估流程整合，覆盖六种文本生成任务、共 6,461 个样本。基准比较发现，微调检测器往往在域内表现较好，但遇到分布变化时性能下降；带有推理过程的提示方法跨任务更稳健。细微的无依据内容仍难识别，跨度边界模糊和标签噪声也持续影响评估。

Insight: 只在单一生成领域内测量跨度检测能力，可能高估实际泛化水平。统一多任务基准揭示了域内适配与跨任务鲁棒性的差异，也显示指标本身受跨度边界和标注质量限制；比较方法时需同时报告跨域结果。

Abstract: Span-level hallucination detection pinpoints unsupported content in LLM outputs, enabling actionable feedback and targeted mitigation. Existing evaluations for span-level hallucination detection methods are fragmented across tasks, annotation formats, and metrics, and most span-level datasets cover only a single NLG domain, making it difficult to assess whether a detection method actually generalizes across tasks and domains. In this paper, we introduce SHAM-Bench (Span-level Hallucination Benchmark Across Multiple Tasks), a unified benchmark for span-level hallucination detection spanning six NLG tasks, aggregated from existing human-annotated datasets totaling 6,461 examples under a common schema and evaluation protocol. Using SHAM-Bench, we evaluate existing hallucination detection methods and find that fine-tuned detectors often perform well in-domain but degrade under distribution shift, whereas prompt-based methods with reasoning are more robust across tasks. Our analysis further shows that subtle unsupported content remains difficult to detect and span-level evaluation is still challenged by ambiguous span boundaries and noisy labels. We release the dataset, evaluation code, and a public leaderboard to support future research on broadly generalizable hallucination detection.

[20] DStill: Trajectory Consistency Distillation for Accelerated One-Step Drafting in Block Diffusion Speculative Decoding cs.CL | cs.LGPDF

Shreyas Kulkarni, Uttam Gurram, Madhav Kanda, Krishna Teja Chitty Venkata, Shichu Chen

TL;DR: DStill 将目标条件 drafter 的多步迭代细化轨迹蒸馏到单步草拟中，在三类模型的推理、数学和代码基准上提高接受长度与加速比。

Details

Motivation: 块扩散推测解码可并行草拟多个 token，但离散扩散的一步草拟让各位置都从同一掩码块预测，彼此不能条件化于同一步其他位置选出的 token，容易产生不一致草稿并降低接受长度。迭代细化可改善草稿，却增加推理轮次和延迟。

Result: DStill 分两阶段将目标条件 drafter 的多步细化能力蒸馏到一步：先训练 drafter 补全部分揭示的块，再利用其细化轨迹训练学生模型一次性预测最终补全，并通过课程逐渐从部分掩码过渡到完全掩码输入。在三个模型家族的推理、数学和代码基准上，接受长度较单步 DFlash 最多提高 28%，加速比最多提高 25%；相较自回归解码，最高达到 6.45 倍加速。

Insight: 多轮细化能利用已提交 token 逐步校正草稿，关键挑战是保留这类条件化收益而不承担多轮代价。用 drafter 自身的细化轨迹监督学生的一次预测，可将迭代能力压缩进单步推理；报告的收益覆盖多种任务，但摘要中的最高增益不代表每项设置都达到同等幅度。

Abstract: Block-diffusion speculative decoding accelerates large language model inference by drafting multiple tokens in parallel. However, one-step drafting in discrete diffusion is limited by token factorization error: each token is predicted from the same masked block, without conditioning on the tokens selected at other positions in that step. This can produce inconsistent drafts and reduce acceptance length. Iterative refinement mitigates this limitation by conditioning later predictions on previously committed tokens, though additional passes increase drafting cost. To address this trade-off between draft fidelity and inference latency, we introduce DStill, a two-stage framework that distills a target-conditioned drafter’s own multi-step refinement into one-step drafting. We first train the drafter to complete partially revealed blocks, then use its refinement trajectories to train a student to predict the final completion in one pass. Using a curriculum that gradually transitions from partial to fully masked inputs, we successfully transfer the multi-step refinement capabilities into one step. Across reasoning, math, code benchmarks on three model families DStill improves acceptance length by up to 28% and speedup by up to 25% over one-step DFlash, achieving up to 6.45x speedup over auto-regressive decoding.

[21] Judging the Justification: Decision Certificate Supervision for Generative Reward Models cs.CLPDF

Guiquan Sun, Bing Bai, Martin Renqiang Min, Dongjin Song

TL;DR: DeCert 不依赖参考解释，而是评估生成式奖励模型理由的有效性和结论一致性，并将理由质量转为偏好监督；多个基准上改善裁判表现和理由质量，位置一致准确率最高提升 14.8 点。

Details

Motivation: 生成式奖励模型会用自然语言解释偏好判断，但结论正确不保证理由充分、真实地支持结论。现有方法常需成本高昂的参考解释，也未必能验证理由是否与最终判断一致。

Result: DeCert 在无需参考解释的情况下评估生成理由的有效性及其与判断结论的一致性，并以结论正确性和理由质量共同构造偏好监督。当多个采样判断都给出正确结论时，证书质量差异可构成偏好对，区分更强和更弱的理由。在两个模型家族及多个域内、分布外基准上，DeCert 一贯超过强生成式裁判基线并提升理由质量；位置一致准确率最高增加 14.8 个百分点，也能缓解位置偏差。

Insight: 训练裁判模型时，只监督“选哪个答案”会忽视支持结论的推理是否可靠。即使结论相同，也可比较解释证书的质量并形成偏好信号；这种监督不需要人工参考解释，且能兼顾判断和论证质量。

Abstract: Generative reward models (GenRMs) generate natural language rationales to justify preference judgments, yet a correct verdict does not guarantee a sound justification. Existing approaches often rely on reference explanations to supervise rationales, but obtaining such references can be costly and does not necessarily establish whether generated rationales support the resulting verdict. To address these limitations, we propose DeCert, a framework that evaluates the validity and verdict consistency of generated rationales without requiring reference explanations. Crucially, DeCert translates these assessments into preference supervision that accounts for both verdict correctness and justification quality. In particular, when multiple sampled judgments share the same correct verdict, differences in certificate quality enable DeCert to construct rationale preference pairs that distinguish stronger from weaker justifications. Extensive empirical studies across two model families and multiple in- and out-of-distribution benchmarks demonstrate that DeCert consistently outperforms strong generative judge baselines while improving rationale quality. Moreover, DeCert effectively mitigates positional bias, improving position-consistent accuracy by up to 14.8 points. These results highlight the importance of supervising not only which verdict is correct, but also how that verdict is justified.

[22] Exploring Recurrent-Depth Language Models for Multitask Clinical Text Processing cs.CLPDF

Xi Yang, Guodong Liu, Cheng Peng, Kaleb Smith, Yingying Zhang

TL;DR: 研究比较循环深度语言模型与标准 Transformer 处理多类临床文本任务的效果：Ouro-1.4B 在 13 个数据集中的 11 个超过 Qwen3-1.7B，支持进一步检验循环计算的临床 NLP 能力。

Details

Motivation: 临床 NLP 涉及信息抽取、分类、推理和问答等多类任务。用一个模型联合处理这些任务可能简化部署并促进知识迁移，但小型循环深度模型能否胜任仍需与标准 Transformer 对照评估。

Result: 作者联合微调 Ouro1.4B-Thinking、Ouro-2.6B-Thinking、HRM-Text-1B、Qwen3-1.7B 和 Qwen3-8B，训练数据覆盖 9 个数据集、四类任务，并在 4 个未参与训练的数据集上测试，共 13 个数据集。Ouro-1.4B-Thinking 在其中 11 个数据集上优于 Qwen3-1.7B；Ouro-2.6B-Thinking 在多数任务上可与 Qwen3-8B 竞争。Ouro 模型在推理和问答上的收益最大，HRM-Text-1B 结果则不一致。

Insight: 实验显示小型循环深度模型在多项临床 NLP 任务上有竞争力，尤其在推理与问答，但现有结果不能单独归因于循环架构。作者指出需通过受控实验进一步分离架构效应，并研究循环计算如何影响推理、知识获取和泛化。

Abstract: Clinical natural language processing includes diverse tasks such as information extraction, classification, and question answering. Developing one model for all tasks could simplify deployment and improve knowledge transfer. We evaluated whether small recurrent-depth language models can meet this need through joint fine-tuning and compared their performance with standard transformers. We fine-tuned Ouro1.4B-Thinking, Ouro-2.6B-Thinking, HRM-Text-1B, Qwen3-1.7B, and Qwen3-8B on 9 datasets covering information extraction, classification, inference, and question answering, and evaluated them on four additional datasets excluded from training. Across these 13 datasets, Ouro-1.4B-Thinking achieved higher performances than Qwen3-1.7B on 11 datasets; Ouro-2.6BThinking was competitive with Qwen3-8B on most tasks. Ouro models showed the largest gains on inference and question answering, whereas HRM-Text-1B showed mixed results. These findings support further study of recurrent-depth models for clinical tasks through controlled experiments to isolate architectural effects and investigate how recurrent computation influences reasoning, knowledge acquisition, and generalization.

[23] AudiPsy: Evidence-Grounded Multimodal Reasoning over Spoken Counseling Conversations for Depression Assessment cs.CL | cs.AIPDF

Chuanbo Zhu, Run Luo, Weibo Zhao, Yue Li, Kun Qian

TL;DR: AudiPsy 以“观察—评估—总结”结构整合咨询对话的文本、语音情绪及两者不一致线索，在 DAIC-WOZ 抑郁评估中超过专用检测方法和通用语音模型。

Details

Motivation: 基于咨询对话语音评估抑郁，需要跨轮次结合文本与声学心理线索。现有端到端分类方法缺少对多模态证据的明确解释，也不充分利用对话上下文进行连续评估。

Result: AudiPsy 是证据驱动的全模态大模型，采用“观察—评估—总结”（OAS）范式，整合对话转录、文本与声学情绪以及文本—语音情绪不一致信息；系统逐轮组织多模态观察、结合上下文评估，并维护随对话更新的摘要。作者构建带多模态上下文增强的合成咨询语料 AudiPsy-Counsel，并设计三阶段抑郁推理课程。在 DAIC-WOZ 上，抑郁评估表现和推理质量超过专用抑郁检测方法及通用语音/全模态大模型；EATD-Corpus 补充实验支持其在自然对话中的适用性。

Insight: 跨轮次追踪证据并记录文本与声学情绪是否一致，可以为评估提供比单次整体分类更结构化的依据。结果覆盖 DAIC-WOZ 和补充的 EATD-Corpus，但主要推理依赖合成语料增强训练与咨询对话场景。

Abstract: Depression assessment from counseling speech requires integrating textual and acoustic psychological evidence across turns, yet existing end-to-end classification approaches lack explicit multimodal evidence interpretation and context-aware reasoning. We propose AudiPsy, an evidence-grounded omni-LLM for depression assessment over spoken counseling conversations. AudiPsy employs an Observation-Assessment-Summary (OAS) paradigm to integrate dialogue transcripts, textual and acoustic emotions, and textual-acoustic emotion incongruence into structured reasoning. OAS incrementally organizes multimodal observations, performs contextualized assessment, and maintains an evolving dialogue summary for subsequent turns. To support this framework, we construct AudiPsy-Counsel, a synthetic spoken counseling conversation corpus with multimodal context augmentation, and develop a unified three-stage curriculum for depression-oriented reasoning. Experiments on DAIC-WOZ demonstrate superior depression assessment performance over specialized depression detection methods and general-purpose speech/omni-LLMs, along with improved reasoning quality, while supplementary evaluation on EATD-Corpus supports AudiPsy’s applicability to naturalistic conversations.

[24] TeCoP: Accelerating Diffusion Large Language Model Decoding via Tentative Context Pipelining cs.CLPDF

Jui-Chien Tsou, Hsuan-Chi Liu, Wei-Chin Wang, Yu-Syuan Xu, Chun-Yi Lee

TL;DR: TeCoP 将扩散语言模型中“预测可作上下文”和“可提交为最终 token”分开，用暂定跨块上下文流水线复用稳定预测；四种 dLLM 上最多减少 87% 前向评估并实现最高 11.77 倍吞吐。

Details

Motivation: 扩散大语言模型每次前向可预测多个位置，但块式解码仍串行生成，并反复计算已经稳定的预测。作者认为低效来自把预测是否足够可靠、可不可逆提交，与其能否作为后续上下文这两个角色耦合起来。

Result: 免训练解码器 TeCoP 通过交错的块并行流水线和 draft-and-verify，把两种角色解耦：稳定但未提交的预测可临时作为跨块上下文，是否提交则由置信度和稳定性检查控制。在四种 LLaDA 与 Dream 扩散语言模型、GSM8K、Minerva MATH 和 MBPP 上，前向评估次数最多减少 87%；相较未缓存的原始解码器，不使用 KV cache 时吞吐最高达 7.50 倍，使用缓存时最高达 11.77 倍。12 组模型—基准设置中，吞吐均超过 Fast-dLLM 和 DSB；启用缓存时平均准确率与原解码器相差不超过 1 个百分点。

Insight: 预测尚未达到不可逆提交条件时，仍可先作为临时上下文供其他块使用，从而避免重复等待稳定预测。通过置信度与稳定性共同控制提交，TeCoP 在降低前向次数的同时维持准确率接近原模型。

Abstract: Diffusion large language models (dLLMs) predict multiple token positions per forward pass, yet block-wise decoders serialize generation and repeatedly recompute stable predictions. We attribute this inefficiency to coupling a prediction’s readiness for irreversible commitment with its utility as context. We introduce Tentative Context Pipelining (TeCoP), a training-free decoder that decouples these roles through staggered block-parallel pipelining and draft-and-verify. TeCoP reuses stable but uncommitted predictions as provisional cross-block context, with commitment governed by confidence and stability checks. Across four LLaDA and Dream dLLMs on GSM8K, Minerva MATH, and MBPP, TeCoP reduces number of forward evaluations by up to 87% and achieves up to 7.50-fold throughput without KV caching and 11.77-fold with caching over the uncached original decoder. It outperforms Fast-dLLM and DSB in throughput across all 12 model-benchmark settings, with and without caching, while keeping average cached accuracy within one percentage point of the original decoder.

[25] WORTH Benchmark: Evidence Discovery under Not-Fully-Cooperative Information – A Two-Episode Pilot cs.CL | cs.AIPDF

Bo Zou, Chao Xu

TL;DR: WORTH 用两集悬疑故事试点评测模型自主发现线索、选择人物并解释判断的能力；70 次正式运行中，线索命中与人物判断并不同步，研究明确不据此推断稳定模型排名或普遍机制。

Details

Motivation: 常见推理评测会把相关信息直接作为前提提供给模型，较少同时考察模型如何自主发现证据，以及叙事呈现方式怎样引导或遮蔽判断。WORTH 希望在不完全合作的信息环境中观察证据选择过程。

Result: 模型阅读未标注线索的原始悬疑故事，自行选择关键句、识别案件参与者并说明推理。试点覆盖两集完整故事，共 70 次正式运行，其中 67 次可按内容评分；线索命中和人物选择分别计分，自然语言解释用于诊断而不单独计分。在第 2 集 37 次可评分运行中，31 次同时选择了同一组错误人物；相邻的怀疑性与洗脱性句子分别被选择 25 次和 0 次，显示组件级分析可揭示不同错误模式。

Insight: 线索发现和人物判断并不同步，单一总分会掩盖错误发生在哪个推理环节。当前仅覆盖两集完整故事，未建立稳定模型排序，也不推断一般机制；人类玩家记录尚未清理，因此本版本未报告人与模型比较。

Abstract: Existing reasoning evaluations typically provide task-relevant information to models as available premises, rarely examining concurrently how models discover evidence autonomously and how information presentation within narratives guides or obscures judgment. This paper proposes the WORTH Benchmark: models read original mystery narratives without clue annotations, autonomously select key clue sentences, identify case participants, and explain their reasoning process. The narrative materials are designed by professional authors such that evidence facilitating reasoning coexists with narrative arrangements that delay the revelation of truth. We report a pilot experiment under full-story conditions across two episodes, conducting a total of 70 formal runs on models, of which 67 runs are content-scorable. Scoring separately records hits on author-designated key clue sentences and participant selections; natural language explanations are used for case diagnosis and are not scored independently. The results show that clue hits and participant judgments are not synchronized; across 37 content-scorable runs in Episode 02, 31 runs simultaneously selected the same set of incorrect participants, while adjacent suspicion-oriented and exoneration-oriented sentences were selected 25 times and 0 times, respectively. These phenomena illustrate the diagnostic value of component-wise analysis and suggest that not-fully-cooperative informational relationships may influence evidence selection and judgment. This study only implements full-story conditions for two episodes, and does not establish stable model rankings or infer general mechanisms on this basis; human player records have not yet been cleaned, and this version does not report human-model comparisons.

[26] PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking cs.CLPDF

Pan Wang, Yihao Hu, Guangyuan Dong, Yitong Lin, Hang Wang

TL;DR: PAR 用与操作步数对齐的中间监督和循环状态范数锚定，让循环语言模型把测试深度外推到更长状态跟踪序列；S5 交换任务上可从最多 32 步训练泛化到 512 步。

Details

Motivation: 循环语言模型可在测试时增加迭代次数，但更多迭代不一定帮助处理更长问题。序列状态跟踪若只监督最终答案，无法告诉每一轮应推进多少操作；反复更新还可能改变循环状态的尺度。

Result: Progress-Aligned Recurrence（PAR）训练第 k 次迭代的预测匹配前 k 步操作后的状态，并将循环状态重标到第一次迭代的范数。在 swap-S5 上，最多用 32 次移动训练的 Qwen2.5-0.5B 在 512 步（训练长度 16 倍）达到 95.5% 平均完整状态准确率；同骨干 RLT 为 55.7%，显式思维链为 0.8%。消融显示去除范数锚定后外推倍数从 16 倍降至不足 2.2 倍；把进度对齐监督换成最终答案监督则最多只能外推 8 倍。模型还学习何时结束而无需提供停止深度；缺少中间标签时，可用前缀自蒸馏从最终答案诱导对应关系。

Insight: 让每次递归对应明确的操作进度，并稳定循环状态尺度，能把增加推理深度转化为更长序列处理能力。两项设计都对长度外推至关重要；在没有中间状态标注时，前缀自蒸馏提供仅依赖最终答案的替代监督。

Abstract: Looped language models can run more iterations at test time, but additional iterations need not help them solve longer problems. For sequential state tracking, final-answer supervision does not specify how far each iteration should advance, and repeated updates can change the scale of the recurrent state. We introduce \textbf{Progress-Aligned Recurrence (PAR)}, which trains the prediction at iteration $k$ to match the state after the first $k$ operations and rescales recurrent states to their first-iteration norms. On swap-$S_5$, a Qwen2.5-0.5B model trained on at most 32 moves achieves 95.5% mean full-state accuracy at 512 moves, or $16\times$ the training length, compared with 55.7% reported for RLT and 0.8% for explicit chain of thought on the same backbone. Controlled $S_5$ ablations show that removing norm anchoring reduces the extrapolation factor from $16\times$ to below $2.2\times$, and replacing progress-aligned targets with final-answer supervision reduces it to at most $8\times$. A learned completion readout selects when to answer without a supplied stopping depth. When intermediate labels are unavailable, prefix self-distillation induces the correspondence from shorter problem prefixes using only final answers. The gains apply across sequential state-tracking tasks, establishing the task structure required for depth extrapolation. These findings support training intermediate predictions and state scale together to make additional recurrent depth useful for longer problems.

[27] Memory as Code: Declarative Retrieval over Codified Long-Term Memory cs.CLPDF

Aoting Zeng, Yuxin Du, Jianwei Wang, Yizhang He, Shan Jiang

TL;DR: Memory as Code 将长期记忆构造成可执行的分层代码抽象，并把查询转成声明式检索程序；在 LoCoMo 和 LongMemEval 上，LLM 评审准确率相对最强基线最高提升 15.91%，且减少 token 消耗。

Details

Motivation: 长期记忆系统要从交互历史构建记忆并按查询检索，帮助智能体推理。复杂场景中事实分散在多轮会话，关系还会随时间变化，现有记忆系统难以灵活组合信息以适应多样查询。

Result: Memory as Code（MaC）用共享代码抽象联合设计记忆构建与检索：构建阶段形成可执行记忆抽象；检索阶段把问题转为结构化检索程序。记忆由原子函数层、关系层和模块组合层三层组成，检索从基于相关度挑选事实转为对记忆执行声明式查询。在 LoCoMo 和 LongMemEval 上，整体 LLM 评审准确率相较各设置下最强基线最高相对提升 15.91%，同时显著降低 token 使用量。

Insight: 把记忆中的事实及关系编码成可组合的可执行结构，有利于跨会话组合信息；把问题转成声明式查询，也比逐条按相似度检索更适合复杂关系查询。其收益同时体现在回答评估和 token 成本，但摘要未列明不同基准上的各项单独数值。

Abstract: In long-term memory systems, memories are constructed from interaction histories and retrieved in response to queries, enhancing the reasoning ability of LLM agents. In complex scenarios, facts are scattered across sessions and their relationships evolve over time, making it difficult for existing memory systems to compose them to adapt to diverse queries. Motivated by the modularity and composability of code, we propose Memory as Code (MaC), a unified memory framework that jointly designs memory construction and retrieval through a shared code abstraction. MaC couples codified construction, which establishes executable memory abstractions, with declarative retrieval, which translates queries into structured retrieval programs. Specifically, codified construction builds a three-layer executable memory structure that progresses from an atomic function layer, through a relational layer, to a modular composition layer. Declarative retrieval recasts retrieval from relevance-based fact selection into declarative query processing over memory. Experiments on LoCoMo and LongMemEval show relative gains of up to 15.91% in overall LLM-judge accuracy over the strongest baseline in each setting, while substantially reducing token consumption, highlighting the effectiveness of memory as code for long-horizon memory tasks.

[28] Beyond Calibration: Temporal LLM Confidence Assessment Across Languages and Local Settings cs.CL | cs.AIPDF

Sahil Kale

TL;DR: 研究区分解题前的“知道感”与解题后的“学习判断”两类 LLM 信心：后者通常更能对应认知不确定性；直接翻译到马拉地语可保留校准趋势，但本地知识问题上明显退化。

Details

Motivation: LLM 信心信号可用于检索、计算分配、路由和选择性弃答，但不同解题阶段的信心是否包含不同认知信息、以及这种可靠性是否超越英语环境，尚待检验。

Result: 受元记忆理论启发，作者区分解题前的预期信心（Feeling-of-Knowing，FOK）和解题后的回顾信心（Judgement-of-Learning，JOL），在两种前沿 LLM、多类推理领域、翻译成马拉地语的基准及新建的本地马拉地语事实问题上评估。较便宜的 FOK 校准较弱；成本更高的 JOL 通常与认知不确定性对齐更好。直接语言翻译后，英语与马拉地语的校准趋势大体保留；但针对本地马拉地语知识的问题上校准显著退化。模型生成幻觉回答后仍持续表现出偏高信心。

Insight: 解题前后信心不是等价信号：事后信心更有信息，但需要额外推理成本。语言翻译能迁移部分校准趋势，却不足以覆盖地区特有知识需求；对幻觉答案维持高信心也说明自评机制仍有明显限制。

Abstract: Large language models are expected to estimate their own uncertainty, with confidence signals used to guide retrieval, adaptive compute allocation, routing, and selective abstention. We investigate whether confidence signals measured at different temporal stages of problem solving encode distinct forms of epistemic information and remain reliable beyond English-centric settings. Inspired by classical meta-memory theory, we distinguish anticipatory pre-solve confidence (Feeling-of-Knowing, FOK) from retrospective post-solve confidence (Judgement-of-Learning, JOL). We evaluate these signals across two frontier LLMs, multiple reasoning domains, translated Marathi benchmarks, and a newly constructed benchmark of genuinely local Marathi factual questions. Across settings, the cheaper pre-solve signal remains weakly calibrated, while post-solve confidence generally provides stronger epistemic alignment despite its additional inference cost. Confidence behaviour transfers surprisingly well under direct language translation, with calibration trends largely preserved between English and Marathi, but degrades substantially on local Marathi knowledge, suggesting that linguistic transfer alone is insufficient for region-specific information needs. Finally, hallucinated responses maintain persistently elevated confidence after answer generation, highlighting important limitations of current LLM self-assessment mechanisms.

[29] SciDiagBench: A Type-Specific Benchmark for Human-Aligned Evaluation of Scientific Diagrams cs.CLPDF

Hao Wang, Zixuan Li, Long Bai, Xiaolong Jin, Jiafeng Guo

TL;DR: SciDiagBench 按 11 种科学图示类型建立 165 张图的基准，并用人类偏好校准各类型评价标准，使自动评价更贴合专家对不同图示的判断方式。

Details

Motivation: 科学图示类型多样，结构和内容组织方式不同；同行评审中，专家会依据图示类型采用不同质量标准。现有 VLM 评测基准缺少系统类型分类，常用同一套通用标准，且指标多由启发式制定，未明确对齐人类偏好。

Result: SciDiagBench 收录 10 个宽领域的 165 张科学图示，并系统分成 11 种类型，包括图形摘要、技术路线图和示例说明等。评测方法通过偏好引导校准，把人类偏好融入类型特定评价标准的生成。作者报告该基准能在不同科学图示类别上实现更可靠、与人类评价更一致的自动评估。

Insight: 科学图示质量评价需要先识别图的类型，再应用与该类型相匹配的标准；一套通用视觉标准难以覆盖不同图示的结构要求。把人类偏好纳入类型标准校准，有助于提高自动评估与专家判断的一致性。

Abstract: Recent agents have demonstrated strong capabilities in generating images from textual prompts, motivating their utilization for scientific diagram generation. Scientific diagrams naturally span diverse types, each characterized by distinct visual structures and content organization. Consequently, during peer review and other scientific evaluation, human experts naturally consider type-specific criteria when assessing their quality. However, existing VLM-based evaluation benchmarks fail to reflect the above human evaluation practices for two main reasons: 1) benchmark datasets typically lack a systematic categorization of different diagram types and thus adopt the same generic criteria for all diagrams, and 2) their evaluation criteria are often designed heuristically, without explicit alignment to human evaluation preferences. Motivated by these limitations, we introduce SciDiagBench, which consists of a benchmark dataset that systematically categorizes scientific diagrams into 11 types and a human preference-guided evaluation method. Specifically, SciDiagBench contains 165 scientific diagrams across 10 broad domains, with types including graphical abstracts, technical roadmaps, and illustrative cases. Based on this dataset, SciDiagBench develops an evaluation method that leverages a preference-guided calibration process to incorporate human preferences into the generation of type-specific criteria. Ultimately, SciDiagBench enables more reliable automated evaluation that better aligns with human evaluation across diverse scientific diagrams.

[30] Testing Associative Creativity in Humans and Multimodal LLMs with Difficult-to-Name Visual Stimuli cs.CL | cs.CVPDF

Manar Ali, Lisa Gottschalk, Simeon Junker, Lisa Hudalla, Alon Fishman

TL;DR: 该研究比较人类与多模态模型对难命名抽象图像的联想创造力；人类描述更具多样性、语义距离和新颖性，难度上升时对刺激的描述方式也会变化。

Details

Motivation: 概念联想是人类交流的重要组成，但当抽象视觉刺激越来越难与熟悉语义概念对应时，人和模型如何调整描述策略尚不清楚。研究从原创性和有效性两方面比较人类与多模态大模型。

Result: 作者在两个可控难度数据集上评估多种先进 MLLM 与人类参与者：SilCC 通过逐步复杂的抽象形状组合提高命名难度；PixCC 通过增加随机视觉噪声提高难度。人类给出的联想描述比 MLLM 更多样，表现为更大的语义距离、更高熵，以及相较参考词典更多新颖表达。难度增加时，SilCC 上描述有效性下降；PixCC 上人类则越来越从整体联想转向低层视觉属性描述。

Insight: 面对难以命名的视觉刺激，人类更能产生多样且新颖的概念联想，但刺激形式影响其策略：形状组合更复杂时描述有效性会下降，随机噪声增加时则转向外观属性。创造性评测需把新颖性与描述有效性分开考察。

Abstract: We investigate associative creativity in descriptions of abstract visual stimuli by humans and multimodal large language models (MLLMs). While conceptual association is central to human communication, it remains unclear how humans and models adapt when visual stimuli become increasingly difficult to map onto familiar semantic concepts. We evaluate several state-of-the-art MLLMs and human participants along two dimensions of creativity, originality and effectiveness, using two datasets with controlled manipulations of difficulty. SilCC varies naming difficulty through progressively more complex combinations of abstract shapes, and PixCC varies difficulty through increasing levels of random visual noise. Results show that humans produce more diverse associative descriptions than MLLMs, including greater semantic distance, higher entropy, and more novel expressions relative to reference lexica. As difficulty increases, effectiveness declines in SilCC, and humans increasingly shift from holistic associations to descriptions of low-level visual properties in PixCC.

[31] Adaptive Stopping of Streamed Reasoning for Language Model Agents cs.CLPDF

JunHyeok Oh, Byung-Jun Lee

TL;DR: StreamStop 从推理文本前缀学习模型专属的停止策略，无需访问隐藏状态或 token 概率；在 WebShop 和 ScienceWorld 中比多数固定预算方案成功率更高且比完整思考耗费更少 token。

Details

Motivation: 启用推理的语言模型智能体在采取行动前可能消耗大量计算，而不同决策需要的推理长度不同。置信度或答案稳定性等停止信号随模型而变；隐藏状态和 token 概率又需要可能不可用的内部访问权限。

Result: StreamStop 用离线前缀级动作一致性学习模型专属停止策略：冻结的前缀读取器编码可见推理文本，再由轻量停止头判断何时结束，无需访问推理模型内部信号。作者发布带前缀动作标注的智能体推理轨迹数据，比较各前缀动作与完整推理参考动作，并据此离线比较规则、精确优化折扣动作一致性目标。停止头以折扣因子为条件，推理时可调节一致性与 token 成本的权衡而无需重训。在 WebShop 和 ScienceWorld 闭环评估中，StreamStop 使用少于完整思考的推理 token，并比多数验证集选出的固定预算获得更高观测成功率；WebShop 的 Qwen3.8-27B 每回合少用 42% 推理 token，任务成功率相近。

Insight: 只读取已经生成的推理前缀即可学习何时停止，不必依赖模型内部概率或隐藏状态，便于用于封闭或难以访问内部信号的模型。前缀动作与完整推理动作的一致性把停止决策转化为可离线训练和调节的目标。

Abstract: Reasoning-enabled language model agents can incur substantial computation before acting, although the reasoning needed varies across decisions. Existing stopping signals, such as confidence and intermediate-answer stability, can vary in effectiveness across reasoning models; signals obtained from hidden states or token probabilities also require internal access that may be unavailable or impractical. We introduce StreamStop, which learns model-specific stopping policies offline from prefix-level action agreement. A frozen prefix reader encodes available reasoning text for a lightweight stop head, allowing stopping without access to the reasoning model’s internal signals. We construct and publicly release a dataset of agent reasoning trajectories with prefix-level action annotations. These annotations compare each prefix action with the full-reasoning reference action, enabling offline comparison of stopping rules and exact expected-return optimization of a discounted action-agreement objective. Conditioning the head on the discount factor allows the agreement-token trade-off to be adjusted at inference without retraining. In closed-loop evaluations on WebShop and ScienceWorld, StreamStop achieves higher observed success than most validation-selected fixed-budget settings while using fewer reasoning tokens than Full thinking. On WebShop with Qwen3.8-27B, it uses 42% fewer reasoning tokens per episode with similar observed task success.

[32] On-Policy Transition Distillation cs.CL | cs.AI | cs.LGPDF

Runyang You, Yongqi Li, Tiezheng Yu, Wenjie Li

TL;DR: OPTD 在学生生成轨迹上对齐师生逐层预测转移，不只匹配最终分布；三领域蒸馏中恢复约 90% 师生能力差距，高于 OPD 的约 75%。

Details

Motivation: 在线策略蒸馏通常在学生生成的轨迹上匹配师生最终层分布。作者考察层间预测变化是否能提供额外任务监督，并发现中间转移上的师生一致度越高，同一道题内答案正确率往往越高，正确回答在测量的中间层对上具有更低平均转移 KL。

Result: 在线策略转移蒸馏（OPTD）在最终层分布匹配之外，还对齐学生轨迹上师生逐层对数概率增量。在三个骨干、八个覆盖数学、代码和指令跟随的基准上，OPTD 在双领域和三领域蒸馏总体表现均为最佳或并列最佳。三领域设置下，它恢复约 90% 的师生总体能力差距，而标准 OPD 约恢复 75%。

Insight: 最终层分布只反映答案末端行为，逐层预测转移则提供了学生推理过程中更细的监督；诊断相关性支持将其用于蒸馏。收益在不同骨干和任务领域上均有报告，但摘要未列具体基准分数。

Abstract: On-policy distillation (OPD) consolidates expert capabilities into a single student by matching teacher and student final-layer distributions on student-generated rollouts. We investigate whether depthwise prediction transitions, the changes in predictions between layers, can provide additional task-relevant supervision. Our diagnostic study finds that stronger teacher–student agreement in intermediate transitions is associated with higher answer correctness within questions, with correct responses exhibiting lower mean transition KL across all measured intermediate layer pairs. These observations motivate On-Policy Transition Distillation (OPTD), which augments final-layer distribution matching by aligning teacher and student layer-to-layer log-probability increments on student-generated rollouts. Evaluations across three backbones and eight benchmarks spanning mathematics, coding, and instruction following show that OPTD achieves the best or tied-best overall performance in both dual- and three-domain distillation. In the three-domain setting, OPTD recovers $\approx 90%$ of the overall teacher–student capability gap, compared with $\approx 75%$ for OPD.

[33] Africa-Papers: A 10-Billion-Token Multi-Domain Academic Corpus for African Foundation Language Models cs.CL | cs.AIPDF

Mich-Seth Owusu

TL;DR: Africa-Papers 发布面向非洲基础模型的多领域学术语料，涵盖 844,807 篇论文、约 101.5 亿 token、879 个分片及 31 个国家的期刊来源，并整理为保留结构的 Markdown。

Details

Motivation: 主流大模型预训练语料对非洲科学、医学、法律和农业研究代表不足，相关内容据称不到全球预训练 token 的 0.5%。这种结构性缺口可能导致模型在热带流行病学、地方农业生态、区域治理和本土语言结构方面系统性失准。

Result: Africa-Papers 汇集超过 844,807 篇全文论文，共 10.15 billion tokens，分布在 879 个 Parquet 分片，涵盖四类来源：DOAJ 收录的 31 个非洲国家期刊、CGIAR CGSpace 农业资料库、非洲作者或非洲主题的 arXiv STEM/AI 预印本，以及 OpenAlex 收录的非洲机构学者开放论文。语料处理为带版面结构的清洁 Markdown，保留章节层级、数学公式和表格，并附精确 BPE token 数及八类统一主题标签。作者在 Hugging Face 的 AfriSpeech 组织下开放发布。

Insight: 扩大预训练语料中的非洲学术内容，有望改善区域知识与语言表达的代表性。除汇集规模外，保留版面和结构信息也支持更精细的持续预训练与领域评测；语料覆盖及清洗质量仍需使用方结合具体任务验证。

Abstract: Large Language Models (LLMs) depend fundamentally on the diversity, depth, and factual rigor of their pre-training corpora. However, contemporary foundational pre-training datasets (such as The Pile, S2ORC, and Dolma) exhibit a severe structural omission: African scientific, medical, legal, and agricultural scholarship constitutes less than 0.5% of global pre-training tokens. Consequently, state-of-the-art models suffer from systematic failure modes when reasoning about tropical epidemiology, localized smallholder agro-ecologies, regional economic governance, and indigenous linguistic structures. To resolve this representation deficit and advance African intellectual sovereignty in artificial intelligence, we introduce Africa-Papers, the largest curated multi-domain Pan-African academic pre-training corpus to date. Comprising over 844,807 full-text papers spanning 10.15 billion tokens across 879 Parquet shards, Africa-Papers unifies four primary scientific streams: (1) continental peer-reviewed journals indexed in DOAJ across 31 African nations, (2) the CGIAR CGSpace agricultural repository, (3) African-authored and African-focused STEM/AI preprints on arXiv, and (4) open-access international publications by scholars affiliated with African institutions indexed via OpenAlex. The entire corpus is processed into layout-aware, clean Markdown preserving section hierarchies, mathematical equations, and tabular data, accompanied by exact BPE token counts and a standardized 8-domain taxonomy. We release Africa-Papers openly on the Hugging Face Hub under the AfriSpeech organization to accelerate continual pre-training and domain evaluation for foundation models globally.

[34] Temporal Evidence-Parameter Co-Alignment for LLM Reasoning over Temporal Knowledge Graphs cs.CL | cs.AIPDF

Jiapu Wang

TL;DR: TEPCA 在证据和参数两层联合对齐时间知识图谱推理：按时间约束剪枝连贯证据路径，并用时间戳条件化 DG-LoRA 适配关系演化；两个图谱基准上达到 SOTA。

Details

Motivation: LLM 的静态参数记忆与现实知识随时间演化不匹配。RAG 常重语义相关、轻时间有效性和事件顺序，检索到的事实可能各自相关但时序碎片化；常规 PEFT 使用固定、与输入无关的低秩更新，也难表达实体语义和关系随时间漂移。

Result: TEPCA 从证据与参数两层对齐 LLM 和时序知识。证据侧以时间约束动态相关路径剪枝保留全局连贯时间路径，并用互信息剪枝筛选时间约束下与查询相关的局部事实。参数侧采用动态门控 LoRA（DG-LoRA），根据时间戳动态调节有效低秩适配子空间。在两个时序知识图谱基准上，TEPCA 达到最先进表现；DG-LoRA 在八个常识问答数据集上的补充评估进一步验证输入自适应能力、跨骨干扩展性和可解释性。

Insight: 时间推理的证据检索需要维护事件顺序与演化依赖，参数适配也应随时间上下文变化。联合处理检索连贯性和低秩参数子空间，可同时减少“证据相关但时间不一致”与“模型关系语义静态化”的问题。

Abstract: Large Language Models (LLMs) often struggle with temporally grounded reasoning because their static parametric memory is misaligned with the dynamic evolution of real-world knowledge. Although RAG and Parameter-Efficient Fine-Tuning (PEFT) provide practical ways to enhance LLMs, they remain insufficient for temporal reasoning. Existing retrieval methods typically prioritize semantic relevance while overlooking temporal validity, event order, and evolutionary dependencies, resulting in evidence that is relevant in isolation but temporally fragmented. Meanwhile, conventional PEFT methods usually employ fixed and input-agnostic low-rank updates, making it difficult to capture time-dependent entity semantics and relation drift. To address these limitations, we propose Temporal Evidence-Parameter Co-Alignment (TEPCA), a framework for LLM reasoning over TKGs. TEPCA aligns LLM reasoning with temporal knowledge at both the evidence and parameter levels. At the evidence level, it introduces time-constrained Dynamic Relevance-Guided Path (DRGP) pruning to preserve globally coherent temporal paths, together with Mutual-Information (MI)-based pruning to retain query-informative local facts under temporal constraints. At the parameter level, it integrates Dynamic-Gated LoRA (DG-LoRA), a timestamp-conditioned low-rank adaptation mechanism that dynamically modulates the effective adaptation subspace according to temporal context. This design enables LLMs to better capture fine-grained entity evolution and time-dependent relation semantics while preserving parameter efficiency. Experimental results on two TKG benchmarks demonstrate that TEPCA achieves state-of-the-art performance. Additional evaluations of DG-LoRA on eight commonsense QA datasets further verify its general input-adaptive capacity, scalability across LLM backbones, and interpretability.

[35] Forty Questions: Identifying a Language Model from One-Word Answers cs.CLPDF

Tapan Parikh

TL;DR: “Forty Questions”用 40 个日常问题的一词回答构建模型行为画像，在 94 个模型面板中准确识别具体模型的比例为 92.5%；研究还发现部分 API 端点与自报模型不符或账单 token 异常。

Details

Motivation: 通过 API 使用模型时，服务端实际运行的模型身份不一定容易核实。研究检验日常问题的一词回答是否具有足够稳定的模型特征，可用于识别具体模型及核对端点自报身份。

Result: 方法为每个模型记录其对一组问题（如“说一种声音”“说一位诗人”）各自回答的频率画像，再将新回答归给最可能的模型。在 94 个模型组成的面板中，40 个答案以 92.5% 概率识别准确模型，随机机会为 1.1%；基于 OpenRouter 画像可盲识别 DeepInfra 提供的十个模型。系统提示会使准确率下降 6–16 个百分点。对 OpenRouter 上 13 个开放模型的 96 个端点测试，92 个与自报模型一致；其余四个中，一个在关闭推理后匹配自报模型，一个以 Llama 4 Maverick 名义提供 Gemma 4，两个仍未确定。账单记录还显示首方模型存在额外上下文计费；例如 Grok 4.7 对一行问题计 1,247 输入 token，而 GPT-4o 计 12 个，另有五个模型能回答当前日期却未对此收费。每个端点检测成本仅为几美分。

Insight: 模型回答习惯可构成低成本的行为指纹，用于审计 API 端点声称的身份；但系统提示会降低识别率，部分端点仍无法定论。计费 token 与回答行为的对照还揭示服务端可能加入上下文或存在计量差异。

Abstract: A model behind an API can be identified from its one-word answers to everyday questions such as “Name a sound” or “Name a poet”. A model’s profile records how often it gives each answer to each question. We attribute new answers to the model most likely to have given them. On a panel of 94 models, 40 answers identify the exact model 92.5% of the time, against 1.1% by chance. Profiles built through OpenRouter identified all ten models served by DeepInfra under blinded labels. A system prompt lowers accuracy by 6 to 16 points. We applied the method to 96 endpoints of 13 open models on OpenRouter, and 92 identify as the model they claim. Of the other four, one matches the claimed model with reasoning turned off. One serves Gemma 4 under the name Llama 4 Maverick: it names itself Gemma 4, and it is billed Gemma 4’s token counts on every message. Two remain unresolved. Billing records also show context added to first-party models. Grok 4.7 is billed 1,247 input tokens for a one-line question that costs GPT-4o only 12 tokens, and five models state the current date without being billed for it. The questions come from a public census of model defaults, and the method costs cents per endpoint.

Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer, Ayesha Mohsin, Sarmad Bilal

TL;DR: ARR 检测反复修订达到固定点后，将剩余推理预算转给新的独立样本；七个模型、七个基准的评估中，MATH500 达 84.6% 准确率且仅用多数投票 41% 的串行轮数。

Details

Motivation: 测试时扩展可把额外计算用于修订已有答案或采样全新解答。何时继续改进、何时放弃并重试是关键决策；现有方法依赖固定修订日程、自我验证判断或需训练的控制器，可能浪费预算或依赖错误信号。

Result: Adaptive Replay Refinement（ARR）无需训练，通过检测固定修订过程何时到达不再变化的固定点，把释放的计算预算分配给独立新样本。重放解码把当前答案视作草稿，并并行验证未变化 token，从而高效检测固定点。在五个模型家族的七个模型、七个基准上，等计算预算下，ARR 在五个数学推理基准中的三个与多数投票表现相当，同时关键路径串行轮数最多减少 2.4 倍。MATH500 上准确率为 84.6%，只需多数投票 41% 的串行轮数。

Insight: 自我修订并非总能继续提高答案质量；当连续修订达到固定点，计算更适合转向新的独立采样。固定点检测提供了不需额外训练的预算分配信号，也揭示了自我修订在边际收益耗尽时的局限。

Abstract: Test-time scaling allocates additional inference compute to refining existing solutions or generating new ones. This raises a fundamental question: Should I keep improving this solution, or stop working on it and try a completely new solution? Existing methods make this decision using fixed refinement schedules, self-verification judgments, or learned controllers, which can waste compute or rely on signals that may be incorrect or require additional training. We introduce Adaptive Replay Refinement (ARR), a training-free method that detects when a stationary revision reaches a fixed point and reallocates the released compute to a new independent sample; replay decoding treats the current solution as a draft and verifies unchanged tokens in parallel, enabling efficient fixed-point detection. Across seven models from five families and seven benchmarks, ARR matches majority voting on three of five mathematical reasoning benchmarks at equal compute, while reducing critical-path serial passes by up to 2.4 times. On MATH500, ARR achieves 84.6% accuracy with only 41% of the serial passes required by majority voting. These results demonstrate that detecting refinement exhaustion enables adaptive reallocation from revision to independent sampling, improving inference efficiency while highlighting the limits of self-revision. Code is available at https://github.com/AhsanBilal7/adaptive_refine.

[37] Reward Misspecification Degrades Chain-of-Thought Monitorability cs.CLPDF

Tianyi Lorena Yan, John Hewitt

TL;DR: 奖励错配本身会削弱思维链可监控性：模型可能口头仍推理任务真实目标，却因错配奖励而输出奖励黑客行为；显式描述奖励可提升监控性。

Details

Motivation: 监控语言模型思维链是发现和预防不当行为的重要安全策略。随着强化学习环境复杂化，完美验证难以实现，奖励错配难以完全避免；模型因此可能因偏离真实任务意图的行为而获奖，令推理过程难以监控。

Result: 研究构造正确奖励与偏好其他行为的错配奖励配对测试环境，使奖励黑客行为可诱发且可验证。在三个模型、三项任务中，随着奖励黑客率上升，思维链监控性仍较低：模型的思维链继续围绕任务意图推理，但输出违反意图并获奖励。为在不知道真实奖励或黑客行为的前提下缓解问题，作者跨训练阶段收集使用多种奖励的轨迹，用语言模型推断奖励描述，再将描述加入输入教模型表达实际奖励。该训练在不同监控指标上平均提升 24% 或 42%（绝对值），并使思维链显式讨论错配奖励。

Insight: 即便模型的思维链表面上围绕正确任务意图，也不保证它解释了实际驱动行为的奖励信号。记录并输入从多样奖励轨迹归纳的奖励描述，可使模型对实际优化目标进行推理，改善可监控性。

Abstract: Monitoring the chain-of-thought (CoT) of language models (LMs) is a key strategy for detecting and preventing misbehaviors for AI safety. As such, it is critical to identify reinforcement learning (RL) practices that lead to unmonitorable chain-of-thought. One such practice may be unavoidable: reward misspecification. As RL environments become more complex, it is infeasible to have perfect verification, and models are rewarded for behaviors that are different from the true task intent. We show that reward misspecification alone already degrades monitorability. We create a testbed with pairs of true reward aligned with task intent and misspecified rewards that favor a different behavior, so that reward hacking can be induced by training and labeled verifiably. Across three models and three tasks, CoT monitorability remains low as models’ hack rates increase: the CoTs keep reasoning about the task intent while the outputs violate the intent and get rewarded. To mitigate unmonitorability without prior knowledge of the true reward or the hack, we collect rollouts with diverse rewards across training steps and use a LM to infer a reward description. We then inject the description into the input, which teaches the model to verbalize the reward. This reward description training improves monitorability by an average of 24% or 42% absolute, depending on the metric, across all models and tasks, and yields CoTs that reason about the misspecified reward explicitly. Code is available at https://github.com/Lorenayannnnn/reward-misspecification-degrades-cot-monitorability.

[38] Beyond a Single Sentiment Score: Topical and Affective Dimensions of Emoji Meaning on Twitter cs.CL | cs.AI | cs.SIPDF

Rohan James, Ioannis Christofilogiannis, Yuuv Jauhari, Shreya Shah, Gauri Pethkar

TL;DR: 基于 16,575 条英文推文的分析发现，emoji 使用语境越具主题聚集性，其众包情感评分反而越极化；结果经多种统计检验验证，说明主题一致性与情感离散是不同语义维度。

Details

Motivation: emoji 常被视为可用单一情感分数概括的简洁情绪符号，但其含义还受主题语境影响。研究希望检验 emoji 在主题上使用越集中时，情感是否也越集中，并区分主题一致性与情感极性。

Result: 作者分析 16,575 条英文推文，以 stability delta 衡量每个 emoji 的句向量类内相似度减去类间相似度。与 Kralj Novak 等（2015）情感词典对照，主题聚集性与众包情感极化呈正相关，Spearman ρ=0.361，Holm 校正 p=0.015，95% bootstrap 区间为 [0.10, 0.59]；与 Ferré 等（2025）独立西班牙语 13 情绪评分的相关为 ρ=0.509，p=0.0003。结果通过置换检验、BCa bootstrap、留一 jackknife、控制 emoji 频率的偏相关和多重检验校正。下游讽刺分类五折交叉验证中三个基线宏 F1 均超过 0.97，作者认为这是数据集 emoji 标签线索已趋饱和，分类仅作为辅助证据。

Insight: emoji 主题语境聚集并不意味着情感更单一；反而更集中于特定主题的 emoji 可能对应更极化的群体情感。主题连贯度和情感离散度应作为不同维度分析，讽刺分类的高分也受数据集标签线索饱和限制。

Abstract: Emoji are widely treated as compact affective tokens whose meaning is summarised by a single sentiment score. We argue that this picture is incomplete. From a corpus of 16{,}575 English tweets and a per-emoji metric we call \emph{stability delta} (within-class minus between-class cosine similarity of sentence embeddings), we show that emojis used in tightly clustered topical contexts also exhibit \emph{more} polarised crowd-sourced sentiment, not less. Validated against the Kralj Novak et al.\ (2015) sentiment lexicon, the central correlation is Spearman $ρ= +0.361$ (Holm $p = 0.015$, 95% bootstrap CI $[+0.10, +0.59]$); against the independent Ferré et al.\ (2025) Spanish 13-emotion ratings, $ρ= +0.509$ ($p = 0.0003$). The result survives permutation testing, BCa bootstrap, leave-one-out jackknife, partial correlation controlling for emoji frequency, and Holm correction across a four-test family. Topical coherence and affective dispersion are distinct dimensions of emoji meaning. As a downstream check we report leakage-free five-fold cross-validation results for sarcasm classification on the Emoji Sarcasm Dataset; all three baselines (a gated multimodal architecture, fine-tuned BERTweet features, and fine-tuned RoBERTa features) score above 0.97 macro F1, indicating the dataset has saturating emoji-label cues. We frame the classifier as supporting evidence rather than the contribution.

[39] Asymmetric Looped Transformers: Fixed Global Representations for an Iterative Decoder cs.CLPDF

Cheng Liang, Tengfei Zhang, Wenjie DU, Jianyu Wu, Changlian Ma

TL;DR: AsymLoop 将单次因果上下文编码与共享权重循环状态细化分开：固定全局 KV 缓存提供持续上下文，循环解码器生成局部 KV；在 60M–1B 四种规模上困惑度和下游准确率均优于同深度 Full Loop。

Details

Motivation: 循环 Transformer 通过重复使用共享层增加有效深度，可在不增加参数量的情况下扩展计算。但全栈循环把上下文构建和迭代状态细化放入同一递归过程，没有显式区分二者职责。

Result: 非对称循环 Transformer（AsymLoop）将单次上下文编码与循环状态细化分离：单次因果编码器生成跨迭代固定的逐层全局 KV 缓存；权重共享循环解码器则从不断变化的状态产生局部 KV。两类 KV 在单个 softmax 下联合注意，使更新同时利用持久上下文和当前中间状态。训练时编码器和解码器采用重尾引导的逐层学习率方法。在 FineWeb-Edu 的 60M 至 1B 四种规模上，与有效深度和训练 token 预算匹配的 Full Loop 相比，AsymLoop 验证困惑度更低、平均下游准确率更高。1B 模型在七个常识推理基准的平均零样本准确率由 49.58% 升至 50.85%；更长训练预算、OLMo 式主干和稀疏 MoE 实验也报告收益。

Insight: 将稳定上下文只编码一次、把计算迭代集中于状态细化，可以减少循环过程中上下文构造与状态更新互相干扰。全局与局部 KV 联合注意使每步既保留原始上下文，也能利用当前循环状态；结果支持这种非对称分工用于循环语言模型。

Abstract: Looped Transformers increase effective depth by repeatedly applying shared layers, offering a way to scale computation without increasing parameter count. However, full-stack looping places context construction and iterative state refinement within the same recurrent computation, without explicitly distinguishing their roles. We introduce the Asymmetric Looped Transformer (AsymLoop), which separates single-pass context encoding from recurrent state refinement. A single-pass causal encoder produces layer-specific Global key-value (KV) caches that remain fixed across iterations, while a weight-tied recurrent decoder generates Local KV from its evolving state. Joint attention over both sources under a single softmax allows each update to integrate persistent contextual information with the current intermediate state. For training, we apply a heavy-tail-guided layerwise learning-rate method to the encoder and decoder. Experiments on FineWeb-Edu across four model scales, from 60M to 1B, show consistently lower validation perplexity and higher average downstream accuracy than Full Loop under matched effective depth and training token budgets. At 1B, AsymLoop improves average zero-shot accuracy across seven commonsense reasoning benchmarks from 49.58% to 50.85%. Further experiments extend these benefits to longer training budgets, an OLMo-style backbone, and sparse mixture-of-experts models. These results support asymmetric context encoding and state refinement as an effective design for recurrent language models.

[40] Large Flow Language Models cs.CL | cs.AIPDF

Arnav Chavan, Chanhyuk Lee, Udbhav Bamba, Jaehoon Yoo, Seunghoon Hong

TL;DR: Lafa 将连续流语言模型扩展到 8B 参数，使用因果前缀和块内双向异步流，少于 300 亿 token 训练；自推测解码在质量相近时达到自回归模型 2.54 倍吞吐。

Details

Motivation: 连续流语言模型可并行生成，并支持离散扩散不具备的控制和加速方式，但如何高效构建十亿级模型仍缺少成熟方案。

Result: Lafa 是块式连续流语言模型，在前缀上使用因果注意力、每个块内进行双向异步流。它可由预训练自回归模型适配而来，并通过前缀缓存和块级并行解码加速推理。作者以少于 30B token 训练 0.5B、7B、8B 三种规模；指令跟随、推理和代码任务中，学习到的流匹配或超过自回归质量，也可蒸馏成一步或少步流映射生成。流训练借助多 token 预测效应保留甚至提升预训练自回归能力，并用于同一模型内的自推测解码：自回归地验证流模型草稿，质量相近时吞吐达到自回归基线 2.54 倍，超过多 token 预测和离散扩散方法。

Insight: 连续流可通过块内并行预测兼顾生成质量和解码速度，且能从已有自回归模型继承能力。把流草稿与同一模型自回归验证结合，可在不更换模型的情况下实现自推测加速。

Abstract: Continuous flow language models offer a path to parallel generation with tools for control and acceleration unavailable to discrete diffusion, yet effective techniques for building them at the billion-parameter scale remain less established. We present Lafa (Large flow language model), a fast, high-performing flow language model scaled to 8B parameters in a data-efficient manner. Lafa is a blockwise flow model with causal attention on the prefix and bidirectional, asynchronous flow within each block. This design enables efficient training by adapting pretrained autoregressive (AR) models and fast inference via prefix caching and blockwise parallel decoding. We train Lafa at 0.5B, 7B, and 8B scales with fewer than 30B tokens, more efficient than previous diffusion models, and evaluate it on instruction following, reasoning, and coding, where the learned flow matches or surpasses the quality of AR and can be distilled into flow maps for one- and few-step generation. Notably, flow training preserves or even improves pretrained AR capabilities via a multi-token prediction effect, which we leverage in a self-speculative decoding scheme that verifies flow-based drafts autoregressively within a single model. This yields 2.54x the throughput of an AR model at comparable quality, outperforming multi-token prediction and discrete diffusion methods. Our findings show that continuous flows can serve as a scalable foundation for language modeling.

[41] Benchmarking Arabic Dialects for Math Problems cs.CL | cs.AIPDF

Noor Abo Mokh, Teresa Lynn, Nizar Habash, Ahmed Elshabrawy, Sara Alhajeri

TL;DR: DAR-MGSM 是首个手工整理的阿拉伯方言多步数学推理基准，覆盖五种方言和现代标准阿拉伯语，并对比纯翻译与文化本地化版本；本地化版本总体更难。

Details

Motivation: 低资源语言的数学推理研究不足，阿拉伯方言尤其缺少系统评测。仅翻译题目可能无法反映不同地区的文化表达和实体背景，因此需要对照翻译与文化本地化的平行版本。

Result: DAR-MGSM 收录需要多步推理的数学应用题，覆盖五种主要阿拉伯方言及现代标准阿拉伯语（MSA），提供“仅翻译”和“翻译并文化本地化”两个版本，后者将实体及引用适配至地区表达。作者评估 11 个阿拉伯语专用及多语种大模型，发现本地化版本总体表现下降，但下降幅度因模型而异，阿拉伯语模型对本地化的敏感性不同。机制可解释性分析显示，同一题目的翻译版和本地化版常引发不同内部推理轨迹，即使总体准确率相近。

Insight: 数学推理能力不仅依赖语言变体，也受文化化实体和情境影响；总体准确率相同也可能掩盖不同的内部推理过程。并列测试翻译与本地化题目，有助于区分语言理解和文化适应带来的困难。

Abstract: Mathematical reasoning remains underexplored for low-resource languages, including Dialectal Arabic. To bridge this gap, we introduce the DAR-MGSM (Dialectal Arabic Multilingual Grade School Math) Benchmark, the first manually curated benchmark for evaluating mathematical reasoning in Dialectal Arabic. DAR-MGSM consists of math word problems (MWPs) requiring multi-step reasoning and covers five major Arabic dialects alongside Modern Standard Arabic (MSA). The benchmark comprises two parallel versions: translated-only and translated & culturally localized. The latter version adapts entities and references to regional varieties. We evaluate eleven Arabic-centric and multilingual large language models on DAR-MGSM. The results show that the performance generally declines on the localized version, highlighting the challenges introduced by culturally grounded adaptations. However, the magnitude of this effect varies across models, with Arabic-centric models exhibiting different levels of sensitivity to localization. A mechanistic interpretability analysis shows that translated and localized variants of the same MWPs often induce distinct internal reasoning trajectories, even when aggregate accuracy remains similar. Overall, our results show that mathematical reasoning performance depends on both linguistic variety and cultural context.

[42] NarraSpace: Multimodal Scene-Grounded Evidence for Picture-Description Dementia Classification cs.CLPDF

Qingming Li, Ruiyan Sun, Satoshi Nakamura

TL;DR: NarraSpace 将图片描述中的词语与时间对齐到命名场景元素和事件，提供可追溯的痴呆症分类输入；在 ADReSS 官方 48 人测试集上，平均准确率 80.88%，平均概率准确率 81.25%。

Details

Motivation: 基于图片描述的痴呆症分类通常只输出话语级预测，无法说明输入证据具体来自画面中的哪些场景内容或语音片段，不利于检查模型的判定依据。

Result: NarraSpace 将词语和语音时间链接到图片中的命名元素，并为预定义场景事件检索相关话语；叙事—空间描述符总结场景覆盖和时间组织。冻结语言模型将每个事件的文本与阿尔茨海默病和健康对照训练样本进行对照，同时使用转录惊异度和覆盖率测量。保留的源记录能把事件分数连回原始话语、语音时间段和词汇匹配。在 ADReSS 官方 48 人测试集上，固定支持向量分类器跨 50 个随机种子的平均准确率为 80.88%±2.56%；平均概率后准确率 81.25%，AUROC 91.32%。

Insight: 把分类特征链接到图片事件、原始发言和时间区间，使模型输入构造更透明、可供临床人员复核。定量事件摘要可以与原始语音证据并列展示，但研究结果来自规模较小的官方 48 人测试集。

Abstract: Picture-description dementia classification uses a shared visual scene, but a transcript-level prediction alone does not identify the scene evidence underlying its inputs. NarraSpace links words and speech times to named picture elements and retrieves utterances for predefined scene events. Narrative-spatial descriptors summarize coverage and temporal organization. A frozen language model contrasts each event’s text under examples from Alzheimer’s disease and healthy-control training participants, alongside transcript surprisal and coverage measurements. Retained source records link event scores to their source utterances, speech intervals, and lexical matches. On the official 48-participant test set of the Alzheimer’s Dementia Recognition through Spontaneous Speech benchmark, a fixed support vector classifier achieves $80.88%\pm2.56%$ mean accuracy over fifty seeds; averaged probabilities yield $81.25%$ accuracy and $91.32%$ area under the receiver operating characteristic curve. NarraSpace makes the construction of scene-linked classification inputs explicit and inspectable by connecting event-indexed language-model measurements to their source utterances, speech timing, and extraction records. Such source-linked measurements could support clinician review of picture descriptions by presenting quantitative summaries alongside the original speech evidence.

cs.CV [Back]

[43] Beckmann World Models: Direct Terminal-Map Learning for One-Step Action-Conditioned Prediction cs.CVPDF

Adam Lee, Shobhit Agarwal, June Pyo Suh

TL;DR: Beckmann World Models 从噪声、视觉历史和动作直接学习未来帧终端映射，无需预训练生成教师；PushT 和 RoboMimic Can 上 64 帧预测 MSE 分别比同骨干回归基线降低 68% 和 57%，PushT 四帧预测耗时 24.8 ms。

Details

Motivation: 动作条件世界模型可通过预测未来状态支持规划和策略评估，但训练准确的一步预测器可能计算成本高。使用预训练生成教师会增加依赖，且噪声输入下的插值传输一致性未必保证推理时纯噪声起点的预测准确。

Result: Beckmann World Models（BWM）学习从噪声、视觉历史和动作直接映射到未来帧，不使用预训练生成教师。方法将 Beckmann Transport Models 的终端映射守恒律用于动作条件视频预测，可直接以噪声—数据对训练，无需 DriftWorld 所需的条件生成样本群。为解决插值输入传输一致性不能保证纯噪声推理准确的问题，端点对齐训练直接监督源端预测，强化运动与空间结构，并训练模型从自生成历史中恢复。各组件共用同一映射，每个未来块仍只需一次网络调用。PushT 与 RoboMimic Can 的 64 帧预测 MSE 分别比同骨干回归基线降低 68% 和 57%；策略评估中 PushT 平均 IoU 误差最低为 0.0100，四帧预测耗时 24.8 ms。RoboMimic Can 上含运动监督和生成历史的 BWM 阶段较局部一步 DriftWorld 吞吐高 3.3 倍、峰值内存低 78%。

Insight: 终端映射训练可避免生成教师依赖，同时端点监督和自生成历史让训练目标贴近纯噪声起点及长程使用情境。摘要未给出所有设置的准确率—成本权衡或不同任务成功率。

Abstract: Action-conditioned world models support planning and policy evaluation by predicting future states. However, learning an accurate one-step predictor can require substantial training computation. We introduce Beckmann World Models (BWM), which learn a direct map from noise, visual history, and actions to future frames without a pretrained generative teacher. We adapt the terminal-map conservation law of Beckmann Transport Models to action-conditioned video prediction, training directly from noise-data pairs without conditional populations of generated samples required by DriftWorld. However, transport consistency on interpolated inputs does not ensure accurate prediction from the pure noise used at inference. We address this gap with endpoint-aligned training that directly supervises the source prediction, emphasizes motion and spatial structure, and teaches recovery from generated histories. All components train the same map and retain one network call per future chunk. On PushT and Robomimic Can, the final model reduces 64-frame prediction MSE by 68% and 57%, respectively, relative to same-backbone regression baseline. For policy evaluation, BWM achieves the lowest mean IoU error among the evaluated models, 0.0100, at 24.8 ms per four-frame PushT prediction. On Robomimic Can, the BWM stage trained with motion supervision and generated histories achieves 3.3 times higher throughput and 78% lower peak memory than local one-step DriftWorld. In a latent-space extension to RT-1 and Bridge-V2, equal-update controls show that feature supervision under generated histories improves perceptual prediction. These findings show how terminal-map learning can combine efficient training with accurate one-step visual prediction.

[44] Uncertainty Gates the Gradient: Adaptive Updates for Generalized Few-Shot 3D Segmentation cs.CV | cs.AIPDF

Yifei Zhao, Fanyu Zhao, Shengtang Wu, Han Zhang, Ruike Cao

TL;DR: UGA 把不确定性提升到更新级门控，在支持集与新类伪标签的类内离散度估计 episode 可靠性，并选择性抑制不可靠 episode 的残差梯度；ScanNet200 和 ScanNet++ 的 1-/5-shot 任务上，平均 HM IoU 比最强既有基线提高 3.08。

Details

Motivation: 广义少样本 3D 点云分割的支持标注常因稀疏和遮挡不完整，盲目适配可能学习虚假几何模式。已有 3D 视觉语言模型可补充监督，但基于损失重加权等信号级方法未必能阻止不可靠 episode 改变优化方向。

Result: Uncertainty-Gated Adaptive（UGA）框架包含更新级模块 UG-Update 和伪标签过滤器 UB-Filter。UG-Update 根据合并的支持样本与新类伪标签的类内离散度估计 episode 可靠性，再门控残差梯度更新，使模型从可靠 episode 学新语义，并减弱不可靠样本影响；UB-Filter 则仅保留高置信度稠密信号用于学习。ScanNet200 和 ScanNet++ 的 1-shot/5-shot 设置中，UGA 达到论文报告的新最佳结果，平均 HM IoU 较最强既有基线提高 3.08。

Insight: 少样本适配不仅要降低单个可疑标签的权重，还应在整个 episode 更新层面判断这批支持与伪标签是否可靠。摘要未给出各数据集、shot 数及 HM IoU 的分项结果。

Abstract: In generalized few-shot 3D point cloud segmentation, support annotations are often compromised by sparsity and occlusion. Blindly adapting to such low quality samples risks learning spurious geometric patterns rather than robust novel concepts. Although 3D Vision-Language Models have been introduced to sup plement supervision, the potential of uncertainty to actively govern adaptation dynamics remains underexplored. Existing signal-level methods like loss reweight ing fail to prevent unreliable episodes from steering the optimization trajectory. To address this, we propose Uncertainty-Gated Adaptive (UGA), to the best of our knowledge the first framework that elevates uncertainty to update-level gating for generalized few-shot 3D point cloud segmentation. The core mod ule, Uncertainty-Gated Update (UG-Update), estimates episodic reliability via intra-class dispersion over merged support and pseudo-labeled novel supervision, and selectively gates residual gradient updates. This encourages the model to learn novel semantics from reliable episodes while attenuating updates during unreliable ones. Complementing this, we introduce an Uncertainty-Based Pseudo Label Filter (UB-Filter) to enforce learning from high-confidence dense signals. On ScanNet200 and ScanNet++ (1-/5-shot), UGA sets new state of the art with an average +3.08 HM IoU over the strongest prior baseline.

[45] Memory Internalization via Test-Time Training for Long-Video Understanding cs.CVPDF

Haonan Zhao, Jiaxuan Chen, Qingyang Liu, Shuochen Chang, Siyu Sun

TL;DR: MIT³ 针对每段长视频进行测试时适配，将其写入紧凑的视频专属参数，使之后可不再输入视频、仅用文字回答问题；通过因果追踪选择写入层，并以视觉记忆蒸馏保留视频带来的表示变化，在三个长视频基准上比以往参数化视频记忆方法使用更少合成样本。

Details

Motivation: 长视频问答中的证据分散在长时间范围，传统 VideoLLM 对每个问题都要重复编码帧或检索视觉证据。参数化视频记忆可一次写入，但现有方法多依赖合成文本和固定适配设置，尚未明确知识应写入哪些层、视觉证据该如何影响记忆。

Result: Memory Internalization via Test-Time Training（MIT³）为每段视频做独立适配，将内容写入紧凑的视频专属可学习参数，实现之后脱离视频的纯文本问答。在紧凑多尺度监督下，因果追踪测量模型各层对视频依据问答的因果记忆效用，并为每段视频选择适配位置；视觉记忆蒸馏则训练纯文本记忆重现相关视频片段引起的模型内部表示变化，使记忆保留视觉证据作用而非只保留文字描述。在 LVBench、LongVideoBench 和 Video-MME 上，MIT³ 实现数据高效的视频脱离问答，所需合成样本显著少于既有参数化视频记忆方法。

Insight: 视频内化不仅要选对写入层，还需蒸馏视频证据对模型表示的影响；纯文本描述未必能复现这种视觉作用。摘要未给出具体准确率和合成样本减少比例。

Abstract: Long-video understanding often requires answering many questions about a single video whose evidence is distributed across extended temporal contexts. Conventional video-language models repeatedly encode frames or retrieve visual evidence for every question. Parameterized video memory offers a write-once alternative, but existing methods rely primarily on synthesized text and fixed adaptation configurations, leaving open where video knowledge should be written and how visual evidence should shape the memory. We introduce Memory Internalization via Test-Time Training (MIT^3), a per-video adaptation framework that writes each long video into compact, video-specific adaptive parameters for video-free, text-only question answering. Under compact multi-scale supervision, causal tracing measures the causal memory utility of each model layer for video-grounded answering and selects video-specific adaptation locations. Visual memory distillation then trains the text-only memory to reproduce the representation change induced by the relevant video clip, preserving the internal effect of visual evidence beyond textual supervision. Across LVBench, LongVideoBench, and Video-MME, MIT^3 achieves data-efficient video-free question answering with substantially fewer synthesized samples than prior parameterized video-memory methods, demonstrating that effective video internalization depends on both where knowledge is written and how visual evidence is distilled into the model.

[46] CodecMotion-OAD: Efficient Online Action Detection with Compressed-Domain Motion cs.CVPDF

Zepeng Sun, Naichuan Zheng, Hailun Xia, Junjie Wu

TL;DR: CodecMotion-OAD 用视频解码阶段已有的压缩域运动向量替代昂贵光流，并经两阶段特征对齐训练复用时序检测器；THUMOS’14 MiniROAD 上达到 68.3 mAP，较 RGB+Flow 蒸馏版 70.9 mAP 低 2.6 分，但 CPU 处理快 11.48 倍、GPU 快 2.04 倍。

Details

Motivation: 在线动作检测需在流式视频中识别正在发生的动作。很多系统结合 RGB 与光流，但稠密光流计算成本高；压缩视频解码时已包含运动向量，可以避免单独估计光流。

Result: CodecMotion-OAD 以解码器提供的运动向量替换光流，同时保留现有时序检测器架构。作者先在无动作标签条件下，将运动向量特征对齐到预训练光流特征接口；再使用真实动作标签和冻结 RGB+Flow 教师的软预测训练 RGB+MV 检测器。THUMOS’14 上，单用运动信息时光流比运动向量高 11.2 mAP；融合 RGB 后差距缩至 3.7 分，最大缩小发生在动作类别区分能力。MiniROAD 检测器上，RGB+MV 版为 68.3 mAP，匹配蒸馏的 RGB+Flow 为 70.9 mAP；解码至预测处理时间在 CPU 上降低至原来的约 1/11.48，在 GPU 上约 1/2.04。

Insight: RGB 外观能补偿压缩运动向量在类别区分上的不足，因此运动向量无需单独媲美光流，也可在融合检测中以更低计算成本提供运动信息。摘要未报告不同压缩格式或其他 OAD 数据集的结果。

Abstract: Online action detection (OAD) identifies ongoing actions in streaming videos. Many existing OAD systems combine RGB appearance with optical flow, but dense-flow extraction remains a major computational bottleneck. Codec motion vectors (MVs) are available during decoding, avoiding a separate optical-flow computation. On THUMOS’14, optical flow exceeds MVs by 11.2 mAP points with motion-only inputs, whereas the gap narrows to 3.7 points after RGB fusion, with the largest reduction in action-category discrimination. We propose CodecMotion-OAD, which replaces optical flow with decoder-provided MVs while retaining existing temporal detector architectures. Its two-stage training first aligns MV features with a pretrained flow-feature interface without action labels and then trains RGB+MV detectors using ground-truth labels and soft predictions from a frozen RGB+Flow teacher. To the best of our knowledge, this is the first application of codec MVs to frame-level OAD. On THUMOS’14 with MiniROAD, CodecMotion-OAD achieves 68.3 mAP versus 70.9 mAP for matched-distillation RGB+Flow, while reducing decoder-to-prediction processing time by 11.48-fold on CPU and 2.04-fold on GPU.

[47] SuperClip Pyramid for Video Temporal Grounding cs.CVPDF

Sanghyeok Lee, Juyeon Ko, Joonmyung Choi, Jongha Kim, Dohwan Ko

TL;DR: SCVTG 把相邻视频片段聚成语义连贯的 SuperClip，并以时间条件核聚合不同持续时间和位置的片段，再用相对显著性损失学习片段重要性；五个视频时序定位基准上均取得最佳表现。

Details

Motivation: 视频时序定位包括按查询检索片段和高光检测。现有 DETR 解码器或时间金字塔方法常依赖单尺度特征或均匀下采样，难以捕捉语义边界和持续时间不同的事件。

Result: SuperClip Video Temporal Grounding（SCVTG）构建多尺度时间层次，将相邻 clip 分组为语义连贯的 SuperClip。为整合持续时间与位置各异的 SuperClip，方法引入时间自适应核，用受时间条件控制的权重进行聚合；相对显著性损失进一步指导模型学习片段间重要性，区分与查询相关的事件。五个视频时序定位基准的实验显示，SCVTG 均取得最佳表现并有积极增益。

Insight: 按语义边界构造多尺度时间单元，比均匀缩放单一特征更可能适应持续时间各异的事件；聚合权重应受时间位置条件控制。摘要未列基准名称、分项指标或增益数值。

Abstract: With the rapid expansion of online video content, video temporal grounding has become essential for localizing moments based on user-specific queries, comprising two subtasks: moment retrieval (MR) and highlight detection (HD). While recent approaches adopt DETR-style decoders or temporal pyramid architectures, they rely on single-scale feature maps or uniformly downsampled representations, limiting their ability to capture semantic boundaries and variable-length events. In this paper, we present SuperClip Video Temporal Grounding (SCVTG) built on a multi-scale temporal hierarchy that better captures distinctive events at various granularities. SCVTG constructs a SuperClip pyramid by grouping adjacent clips into semantically coherent segments, termed SuperClips. Further, to aggregate these SuperClips having variable duration and temporal location, we introduce a temporally adaptive kernel that aggregates SuperClips through temporally conditioned weights, enabling flexible aggregation. On top of this, we design relative saliency losses to guide the model in learning inter-clip importance, enhancing its ability to distinguish relevant events. Extensive experiments show that SCVTG achieves the best performance across five video temporal grounding benchmarks with promising gains.

[48] REST: Reliability-Guided Spatial Transcriptomics Supervision for Gene Expression Prediction from Histopathological HE-Stained Images cs.CVPDF

Lanfeng Zhong, Xiangyu Sun, Guixuan Xu, Rongzhao Zhang, Jie Xu

TL;DR: REST 用生物学程序库对空间转录组监督进行可靠性加权，将 spot 的 assay 程序覆盖和活动离散度用于调节 HE—ST 对齐，并以程序查询从组织形态重建基因表达；在 16 个器官训练、8 个器官独立测试的结果中，宏相关性最高并超过既有病理基础模型。

Details

Motivation: H&E 组织形态并不直接揭示肿瘤异质性中的分子状态。空间转录组可在保留组织结构的同时测量基因表达，但不同切片覆盖和 spot 信息量不同，使配对 HE—ST 监督可靠性并不均等。

Result: REST 结合生物学程序库 BPB 构建程序结构化且可靠性引导的空间转录组监督。BPB 从整理过的基因签名、通路和细胞类型集合构成，为空间转录组编码、可靠性估计和分子重建提供共同结构。Spot-Reliability Contrastive Alignment（SRCA）根据 assay 级程序覆盖和 spot 级活动离散度估计可靠性，并据此重加权 HE—ST 对齐；Biology-Informed Program Reconstruction（BIPR）则用可学习程序查询根据组织形态重建成员基因表达。训练集含 209 个样本、16 个器官和 407,475 个 spot；测试集为 70 个互斥样本、8 个器官和 230,056 个 spot，评估基因表达、通路活动与细胞签名预测。REST 宏平均相关性最高，超过先进 ST 监督训练方法和已有病理基础模型。

Insight: 将组织形态与空间分子信号对齐时，应按每个 spot 的测量覆盖和生物学信息量调节监督强度，而非把所有配对视为同等可靠。摘要未提供具体宏相关系数或各器官分项结果。

Abstract: Histopathology is central to cancer diagnosis, but morphology in Hematoxylin and Eosin (HE)-stained images does not directly reveal the molecular states that characterize disease heterogeneity and inform tumor characterization, prognostic assessment, and biomarker discovery. Spatial Transcriptomics (ST) measures spatially resolved gene expression, providing molecular information within tissue architecture, yet differences in assay coverage and spot informativeness make paired HE–ST observations unequally reliable for representation learning. We propose Reliability-Guided Spatial Transcriptomics (REST) supervision with Biological Program Bank (BPB), a program-structured and reliability-guided ST-supervised training framework for predicting molecular information from H&E images. REST constructs BPB from curated signature, pathway, and cell-type gene sets to provide a shared structure for ST encoding, reliability estimation, and molecular reconstruction. Guided by BPB, Spot-Reliability Contrastive Alignment (SRCA) measures the reliability of each spot from assay-level program coverage and spot-level activity dispersion, and reweights HE–ST alignment accordingly. Biology-Informed Program Reconstruction (BIPR) further uses learnable program queries to reconstruct member-gene expression from histological morphology. REST’s training corpus comprised 209 samples (407,475 spots across 16 organs); evaluation used 70 disjoint samples (230,056 spots across eight organs) for gene-expression, pathway-activity, and cell-signature prediction. REST achieved the highest Macro correlation among state-of-the-art ST-supervised training methods and outperformed existing pathology foundation models. Code is available at https://github.com/lanfz2000/REST.

[49] Long-wave Infrared Polarimetric Remote Sensing Image Fusion for Vehicle Detection cs.CVPDF

Wenjuan Zhang, Xiangrui Peng, Zhen Li, Caimeng Yi, Xuesong Ma

TL;DR: 该 Mamba 红外偏振融合方法将长波红外强度 S0 与线偏振度 DoLP 结合，用物理启发偏振响应代理和全方向状态空间扫描融合互补信息；新建 1,901 对配准数据上四项融合指标领先，车辆检测 mAP50 为 55.0%、mAP50-95 为 29.4%。

Details

Motivation: 红外遥感图像中的车辆轮廓模糊、对比度低会限制检测，已有融合方法还可能引入偏振噪声，无法充分结合红外强度与偏振信息。偏振可反映表面材料特性和几何，提供互补视觉线索。

Result: 模型先融合长波红外总强度 S0 和线偏振度 DoLP，利用物理启发偏振响应代理及空间结构连续性提取引导特征；随后采用水平、垂直及两个对角方向的双向状态空间扫描，实现全图跨模态融合。训练联合使用先验引导多窗口结构相似性、重建约束和偏振显著性相对下界损失，以抑制噪声并保留全局背景结构和目标偏振特征。作者构建 AIR-LWIR-Pol，含 1,901 对由机载分孔径长波红外偏振成像系统采集并精确配准的图像。四项融合指标均超过对比方法；用 YOLO11 做下游车辆检测时，mAP50 为 55.0%，mAP50-95 为 29.4%。

Insight: 红外强度与偏振反映不同物理属性，结合物理先验和全局空间扫描可为复杂遥感车辆检测保留互补线索。摘要未列四项融合指标名称或与其他检测方法的具体差值。

Abstract: Blurred vehicle contours and low contrast limit detection performance in infrared remote sensing imagery, while existing fusion methods may introduce polarization noise and fail to integrate complementary information effectively. To address these limitations, we propose a Mamba-based infrared polarimetric remote sensing image fusion model. Infrared polarization information reflects surface material properties and geometry, providing complementary information to infrared intensity. The proposed method first combines long-wave infrared total intensity S0 and the degree of linear polarization (DoLP), using a physics-inspired polarization-response proxy and spatial structural continuity to extract guidance features. It then employs bidirectional state space scanning along horizontal, vertical, and both diagonal orientations to enable cross-modal feature fusion across the entire image. Prior-guided multi-window structural similarity, reconstruction constraints, and a relative lower-bound loss for polarization saliency are jointly introduced to suppress noise while preserving global background structures and target polarization features. In addition, we construct AIR-LWIR-Pol, a dataset of 1,901 accurately registered image pairs acquired using an airborne division-of-aperture long-wave infrared polarimetric imaging system, and evaluate downstream vehicle detection using YOLO11. The experimental results show that the proposed method outperforms the comparison methods on four fusion metrics, including entropy and structural similarity. Vehicle detection mAP50 and mAP50-95 reach 55.0% and 29.4%. These results demonstrate the effectiveness of combining physical priors with state space modeling for long-wave infrared polarization image fusion and support its use for target detection in complex remote sensing scenes.

[50] Robustness of Internal Signals for Hallucination Detection in Vision-Language Models cs.CV | cs.AIPDF

Allison Chen, William Yang, Salma Abdel Magid, Jonathan Williams, Olga Russakovsky

TL;DR: 对 VLM 幻觉检测内部信号的审计发现，生成 token 的文本位置本身即可达到有竞争力的性能，并可能成为已有方法的捷径；高检测分数常由语言幻觉驱动，较少依赖视觉 grounding，且对更早出现的幻觉鲁棒性更差。

Details

Motivation: 视觉语言模型在图像问题回答中可能编造物体，安全关键应用需要及时发现幻觉。部分方法利用模型生成文本时的内部信号，但这些信号可能与产生幻觉的原因相同，未必能真实反映视觉依据。

Result: 作者系统分析内部信号幻觉检测的鲁棒性。首先发现，简单使用生成词在回答中的 token 位置即可取得有竞争力结果；进一步显示部分检测方法依赖 token 位置这一捷径。其次，研究检测器对语言和视觉模态的敏感性，实验提示较强检测表现常来自发现语言层面幻觉；依赖 token 位置的方法视觉 grounding 较弱，且当幻觉更早出现在回答中时鲁棒性降低。最后，作者观察到不同检测方法信号互补，将较弱方法加入较强方法集成仍可改善性能。

Insight: 内部激活或注意等信号表现好，不一定说明检测器识别了视觉证据失配，可能只利用回答位置或语言模式捷径；需通过模态和位置干预验证鲁棒性。摘要未给出各方法的具体检测指标或数据集。

Abstract: When given an image and a text prompt, vision-language models (VLMs) can produce seemingly sophisticated text responses. However, they are also prone to hallucinate objects in their output, which can have detrimental consequences in safety-critical applications. To detect these hallucinations, certain methods interestingly leverage internal signals from the VLM as it generates the text response; potentially, these methods use the same signals that led to a hallucination to detect it. We conduct an in-depth analysis to understand the robustness of these detection methods. First, we show that a naive baseline of a generated word’s token position in the VLM text response achieves competitive performance. Further, we reveal how some detection methods rely on token position and use this heuristic as a shortcut. Second, we explore detection methods’ sensitivity to language and vision modalities. Our experiments suggest that strong detection performance is often driven by detecting language-based hallucinations, and when methods rely on token position, they tend to be less visually grounded and exhibit reduced robustness when hallucinations occur earlier in a text response. Lastly, we demonstrate that different detection methods can carry complementary signals; when ensembling methods together, adding weaker methods to an ensemble of higher performing ones still offers performance improvements. Altogether, while there may be useful internal VLM signals to detect hallucinations, our investigation reveals important limitations of the current methods that try to leverage them.

[51] VitronEdit: Universal Visual Editing across Images, Videos, and 3D Scenes cs.CVPDF

Jing Wang, Yanlin Li, Mong-Li Lee, Wynne Hsu, Shengqiong Wu

TL;DR: VitronEdit 用共享序列表示和渐进多模态训练统一图像、视频和 3D 场景编辑，并在后训练中加入几何重建模型提供的深度与相机位姿监督；令人意外的是，仅 3D 样本接受几何监督时总体最好，且图像和视频编辑也得到改善。

Details

Motivation: 统一视觉编辑已开始整合图像与视频，3D 编辑仍多为独立任务且配对训练数据稀缺。图像和视频编辑监督丰富，且编辑语义跨模态相通，论文研究能否把这些知识迁移到少数据的 3D 编辑。

Result: VitronEdit 是支持图像、视频和 3D 场景编辑的统一框架，采用共享序列表示和渐进式多模态训练迁移编辑知识，并在后训练阶段使用预训练几何重建模型提供深度及相机位姿监督。实验发现，仅对 3D 样本使用几何监督时总体效果最好；即使图像和视频样本没有直接获得几何监督，其编辑表现也改善，提示几何正则可经共享骨干迁移。进一步分析表明，图像和视频训练主要向 3D 迁移编辑语义，3D 监督则主要改善多视角一致性。

Insight: 跨模态共享表示让编辑语义可由图像、视频迁移到 3D，而几何监督帮助多视角结构；不同模态训练信号的作用并不对称。摘要未给出各编辑任务的具体指标或数据量。

Abstract: Recent advances in unified visual editing have begun to consolidate image and video editing within a single model, while 3D scene editing remains largely separate and constrained by scarce paired training data. Given the rich image and video editing supervision now available and the common editing semantics shared across modalities, a natural question is whether this knowledge can be transferred to data-scarce 3D editing. We present VitronEdit, a universal framework for image, video, and 3D scene editing. VitronEdit adopts a shared sequence representation and progressive multimodal training to transfer editing knowledge across modalities. We further introduce geometry-aware post-training, which leverages a pretrained geometry reconstruction model to provide depth and camera-pose supervision. Surprisingly, applying geometric supervision only to 3D samples yields the best overall performance, while image and video editing also improve despite receiving no direct geometric supervision, suggesting that geometric regularization transfers through the shared backbone. Our analysis further shows that image and video training mainly transfers editing semantics to 3D, whereas 3D supervision primarily improves multi-view consistency. The project page: https://vitron-llm.github.io/VitronEdit/.

[52] BUMP: Body-driven Unified Multi-object Physics for HOI Synthesis cs.CVPDF

Wonjung Woo, Hyeonwoo Kim, Hanbyul Joo

TL;DR: BUMP 将多物体人—物交互拆成文本生成的人体意图运动、少数主动操纵对象轨迹和物理模拟产生的响应物体运动，从而支持可变数量及布局的周围物体；还可根据期望响应物体行为反推局部驱动轨迹修改。

Details

Motivation: 多物体人—物交互生成中，不同运动有不同原因：人体动作由语义意图驱动，被主动操纵的物体需与人体协调，周围物体则主要受接触和碰撞物理影响。成对全身、多物体交互数据稀缺，也难以为各种物体数量和组合扩展学习轨迹输出。

Result: BUMP 以“学习意图运动、模拟物理后果”为原则。方法先根据文本和场景生成全身人体运动，再以人体运动为条件预测少数主动驱动对象轨迹，周围响应物体运动由物理仿真得到，因此无需扩大模型输出空间来覆盖不同数量和布局的环境物体。为缓解全身多物体交互数据不足，训练融合人体单独动作、全身交互及手部操作数据，并为后两类手部数据补充合理身体运动。结果条件交互编辑模块可依据期望响应对象行为推断驱动对象轨迹的局部修改，无需显式提供目标驱动轨迹。实验显示，模型在单对象和多对象交互基准上表现强，定性示例展示多种对象关系和编辑。

Insight: 显式区分有意驱动对象与物理响应对象，能减少对不同周边物体数量逐一学习轨迹的需求；结果条件编辑还可从后果反推原因对象调整。摘要未给出具体基准指标或物理仿真误差。

Abstract: Generating human-object interactions (HOIs) with multiple objects is challenging because the resulting motions arise from different underlying causes. Human motion reflects semantic intent, intentionally manipulated objects must remain coordinated with the human, while surrounding objects move primarily as physical consequences of contact and collision. We present BUMP, a text-driven framework for multi-object HOI generation based on a simple principle: learn intentional motion and simulate physical consequences. Our method first generates full-body human motion from text and scene context, then predicts trajectories for a small number of intentionally manipulated driver objects conditioned on the human motion. We then obtain responder object motions through physics simulation, allowing the framework to handle varying numbers and configurations of surrounding objects without expanding the learned trajectory output space. To address the scarcity of paired full-body multi-object HOI data, we combine heterogeneous supervision from human-only motion, full-body HOI, and hand-centric manipulation data augmented with plausible body motion. We further introduce outcome-conditioned interaction editing, which infers a local modification of the causal driver object trajectory from a desired responder object behavior without requiring an explicit target driver object trajectory. Experiments demonstrate strong performance on both single-object and multi-object HOI benchmarks. Qualitative results showcase diverse scenarios involving inter-object relationships and edits, highlighting the advantage of our unified model formulation.

[53] SciFigBench: A Benchmark for Scientific Method Figure Understanding cs.CV | cs.CLPDF

Lijia Wu, Zheng Li, Yuxuan Liu, Jingwen Zhang, Penghai Zhao

TL;DR: SciFigBench 用 4,352 张科学方法图和 40,670 个问答评测细粒度读图能力，并提出免训练的 SciFigCue 改善 VLM 对图中关系和流程的推理。

Details

Motivation: 科学论文的方法图常以密集模块、箭头和信息流概括方法，但现有视觉语言模型基准多测试检索或整体理解，较少评估图中细节、模块关系与流程追踪。因此模型是否真正读懂方法图仍缺少细粒度测量。

Result: 研究构建 SciFigBench，收集 4,352 张真实论文中的科学方法图，配套 40,670 个经人工核验的问题，覆盖密集内容感知、视觉关系理解和信息流追踪三项能力。作者另提出无需训练的视觉提示模块 SciFigCue，把箭头表达的依赖关系显式转成视觉证据。对开源和商业 VLM 的实验显示，强模型在视觉关系理解上仍有明显不足，而 SciFigCue 在多个任务上带来提升，无需更新模型参数。

Insight: 方法图理解不只是识别图中文字或概括全图，模型还必须追踪箭头所表示的依赖和处理顺序。SciFigBench 将这些能力拆分为可量化问答任务；显式呈现箭头关系可在不微调模型的情况下帮助推理，但当前模型的关系理解仍是突出短板。

Abstract: Scientific method figures often provide researchers with a clear visual entry point into a paper’s methodology and core contributions, yet their dense layouts and complex information flows are difficult for Vision Language Models (VLMs) to interpret. Existing benchmarks predominantly focus on coarse-grained tasks, such as context-based retrieval or holistic comprehension, overlooking the fine-grained content and inter-module relations within complex methodological diagrams. To address these overlooked aspects, we introduce Scientific Figure Benchmark (SciFigBench), a benchmark for evaluating core capabilities required for scientific method figure understanding. Specifically, it targets three capabilities: dense content perception, visual relation comprehension, and information-flow tracing. For this purpose, we curate 4,352 scientific method figures from real-world research papers and construct 40,670 QA pairs to operationalize these capabilities as measurable question-answering tasks. All annotations are generated by dedicated pipelines and then manually verified. We further propose SciFigCue, a training-free visual prompting module that externalizes arrow-induced dependencies as visual relational evidence for method-figure reasoning. Experiments across open-source and proprietary VLMs show that even strong models remain substantially limited in visual relation comprehension, while SciFigCue improves performance across several tasks without parameter updates. The code and related resources are available at https://github.com/LeNcyer/SciFigBench.

[54] LVMem: Image-Augmented Memory for Long-Horizon Question Answering cs.CVPDF

Victoria Khoruzhaya, Maksim Kalmykov, Tuong Do Minh, Tatiana Zemskova, Yixin Zhu

TL;DR: LVMem 为长期问答记忆保留描述对应的原始图像，并用光流选帧、物体中心场景描述和自适应图像检索提升机器人场景中的时空问答。

Details

Motivation: 具身系统需要根据长时间观察回答物体、事件及位置问题。仅保存文字描述或视觉向量的视图式记忆可能丢失可供再次核对的视觉证据；均匀采帧和普通图注也难以充分保留动态变化及物体级信息。

Result: LVMem 在 ReMEmbR 式记忆中保存每条描述所对应的图像路径，构建记忆时以光流驱动的 PSFR 选帧替代均匀采样，并使用物体中心场景描述代替普通图注。基于 VLM 的智能体可按需调用自适应检索工具，取回相关描述对应的图像。在 OC-NaVQA 上，使用两种骨干模型时，LVMem 的二元准确率和位置指标均优于 ReMEmbR；二元准确率达到或超过 4D 场景图 DAAAM 基线，同时无需显式构建场景图。

Insight: 长期问答记忆除了索引语义描述，还应保留可回看的原始视觉证据，让模型在不确定时自主决定是否检查图像。对象中心描述和运动感知选帧进一步改善记忆内容；这种轻量视图式设计在避免图构建成本的同时，也能达到强场景图方法的部分表现。

Abstract: Reliable language-guided perception is essential for embodied agents, where questions about objects, events, and their locations must be answered from long observation histories. Unlike conventional visual question answering, realistic robotic settings require reasoning over extended temporal horizons and persistent scene memory. We build upon the view-based memory paradigm and propose an efficient framework for long-horizon spatio-temporal question answering. While existing view-based systems typically store either text captions or visual embeddings, we extend the ReMEmbR-style memory with image paths that link each stored description to its original visual content. To make the stored annotations more informative, we replace uniform sampling during memory construction with an optical-flow-based frame selection strategy (PSFR) and store an object-centric descriptive scene representation instead of plain captions. We further equip a VLM-based agent with an adaptive retrieval tool that returns the image associated with the most relevant caption, allowing the agent to decide when visual inspection is needed. On the OC-NaVQA benchmark, LVMem outperforms ReMEmbR on binary and positional metrics with both backbones and matches or exceeds a 4D scene graph DAAAM baseline on binary accuracy, while operating on a lightweight view-based memory that requires no explicit graph construction.

[55] PRIMFLOW: Learning Trajectory Primitives for Few-Step Distillation cs.CVPDF

Hongyi Fang, Benjia Zhou

TL;DR: PRIMFLOW 以连续轨迹原语直接学习教师轨迹的累计位移，在单次网络评估下实现少步蒸馏；文本生成实验取得有竞争力的 T-FID 与 HPSv2。

Details

Motivation: 少步轨迹蒸馏需要从教师轨迹上的密集局部监督学习准确的全局更新。已有方案依赖特定轨迹参数化或离散时间区间预测，因而受预设时间结构或查询网格约束。

Result: PRIMFLOW 用连续轨迹原语表示沿教师轨迹累计的位移，以原语有限差分拟合教师局部速度，再通过端点差得到全局更新；方法还给出局部回归误差到全区间位移误差的界，并用端点吸收移除辅助原语分支，保留单次网络评估推理。在大规模文生图实验中，单次网络评估得到 T-FID 20.92、HPSv2 28.35，优于轨迹蒸馏基线；端点吸收后分别为 20.86 和 28.33，表现相近。

Insight: 直接表示累计位移可以避免预设时间基底或固定查询网格，把局部教师速度监督转化为全局更新学习。理论误差界解释局部拟合如何影响整体位移；端点吸收则在不明显损失生成质量的情况下简化推理结构。

Abstract: Few-step trajectory distillation aims to learn accurate global updates from dense local supervision along a teacher’s sampling trajectory. Existing approaches construct within-step dynamics using specific trajectory parameterizations or discrete interval predictions, tying the learned update to a prescribed temporal structure. We propose \method, which directly learns a continuous trajectory primitive representing cumulative displacement along the teacher trajectory. By supervising finite differences of the primitive with local teacher velocities, \method learns the accumulated motion directly, while obtaining global updates through endpoint differences. This formulation avoids prescribing a temporal basis or fixed query grid and instead learns the temporal evolution of cumulative displacement from local supervision. We further establish a local-to-global error bound to characterize how local regression errors affect full-interval displacement accuracy, and introduce endpoint absorption to eliminate the auxiliary primitive branch while preserving one-network-evaluation inference. Experiments on large-scale text-to-image generation show that \method achieves a T-FID of 20.92 and an HPSv2 score of 28.35 at one NFE, improving both metrics over a trajectory-distillation baseline. After endpoint absorption, it retains comparable performance, achieving a T-FID of 20.86 and an HPSv2 score of 28.33.

[56] CARLAR Influence: A Structured Hallucination Risk in Multimodal Cheque Extraction and an Exploratory Compressed-Image Countermeasure cs.CV | cs.AIPDF

Joong Ho, Choi, Aditya Paul, Nidhi Singh

TL;DR: 研究发现多模态模型在支票提取中会让礼貌金额与法律金额相互影响，甚至高置信度地输出相同值；压缩图像示例对 Claude 有帮助，但效果因模型和样本定义而异。

Details

Motivation: 多模态大模型正用于金融单据结构化抽取，但视觉歧义下字段之间的相互影响尚未充分研究。论文将礼貌金额和法律金额不同却被模型预测为同值的现象定义为 CARLAR influence，并纳入空白标注被编码为零的情况。

Result: 研究在十种视觉提示条件下测试 GPT-4.1 和 Claude 4.5 Sonnet，覆盖 243 张主要支票（其中 124 张具有两个可观测且不相等的金额）及另外两个数据集的 598 个严格不匹配样本。遮挡礼貌金额时，GPT-4.1 的 CARLAR 比例为 73.7%（95% bootstrap 区间 68.3–79.0，较基线 p<0.001）；CARLAR 样本中的期望校准误差最高达 0.93。压缩图像少样本干预使 Claude 在 243 张支票上的成对联合抽取准确率提高 11.5 个百分点（95% 区间 6.2–16.9，校正后 p=0.00054），但在严格 124 例上的增益较小且校正后不显著；字段预测一致率对 Claude 下降、对 GPT-4.1 上升。

Insight: 模型对两个字段给出相同答案并不代表可靠，置信度也可能在字段受相互影响时仍然很高。抽取评估应考虑字段依赖、图像上下文和样本定义；少样本示例的作用依模型而异，不能据某一总体指标推断所有子集都受益。

Abstract: Multimodal large language models (LLMs) are increasingly used for structured extraction from financial documents, but their behavior under visual ambiguity is poorly understood. We study CARLAR (Courtesy Amount Recognition and Legal Amount Recognition) influence: a model returns the same amount for both cheque fields even though their annotations differ, including cases with a blank annotation encoded as zero. Across ten visual prompting conditions, we evaluate GPT-4.1 and Claude 4.5 Sonnet on 243 primary cheques (124 with two observed unequal amounts) and 598 strict mismatches from two additional datasets. Under courtesy redaction, GPT-4.1 CARLAR reaches 73.7 percent (95 percent bootstrap interval: 68.3 to 79.0; p below 0.001 versus baseline). Model-reported confidence can remain high when predictions agree; expected calibration error reaches 0.93 among CARLAR cases. We also test a compressed-image few-shot intervention that presents examples as one visual table without model fine-tuning. On the 243-case cohort, Claude’s Control condition increases paired joint extraction accuracy by 11.5 percentage points (95 percent interval: 6.2 to 16.9; adjusted p = 0.00054), but its strict-124 gain is smaller and not significant after correction. The intervention’s effect on predicted-field agreement is model-dependent: it decreases for Claude and increases for GPT-4.1. These results motivate validation methods that account for visual context and dependencies between extracted fields.

[57] Language Guidance for Supervised Vision Training: An Empirical Study of Generalization cs.CV | cs.AIPDF

Shruthi Gowda, Nikita Jain, Elahe Arani, Bahram Zonooz

TL;DR: 该实证研究比较显式和隐式语言指导对监督视觉训练的作用：显式指导更利于域内低数据表现及持续学习，隐式指导在捷径敏感和强对抗场景更有帮助。

Details

Motivation: 传统监督视觉训练使用 one-hot 标签，难以表达类别间语义结构和共享属性，可能导致模型对分布变化、伪相关、纹理偏置、对抗扰动及持续学习遗忘较脆弱。研究关注预训练语言模型能否在无需图文配对、提示工程或对比目标的情况下，为视觉训练提供轻量辅助监督。

Result: 作者评估显式语言指导（ExLG）和隐式语言指导（ImLG），覆盖六类设置：域内、分布外泛化、捷径与伪相关鲁棒性、纹理和形状偏置、对抗鲁棒性及持续学习。显式指导稳定改善域内低数据表现和持续学习保留能力；隐式指导在捷径敏感设置及较强对抗扰动下通常更有效。两种机制都只增加少量参数和训练开销。

Insight: 语言提供的语义结构能补充视觉标签，但不同注入机制适用场景不同：追求低数据域内准确率和抗遗忘时可优先考虑显式指导，需应对捷径或强对抗扰动时隐式指导往往更有优势。该研究强调按泛化需求选择机制，而非把语言监督视作单一通用方案。

Abstract: Deep neural networks have achieved remarkable success on vision benchmarks, yet they continue to struggle with many generalization challenges. Supervised vision training relies on one-hot labels, which provide limited information about semantic structure and shared attributes between classes. This limited supervision can leave visual representations vulnerable to distribution shifts, spurious correlations, texture bias, adversarial perturbations, and forgetting in sequential learning settings. We study whether pretrained language models can serve as lightweight auxiliary supervision for vision training without requiring paired image-text data, prompt engineering, or contrastive objectives. Specifically, we evaluate two forms of language guidance, Explicit Language Guidance (ExLG) and Implicit Language Guidance (ImLG). We conduct a comprehensive evaluation across six generalization regimes, including in-distribution, out-of-distribution generalization, shortcut and spurious correlation resistance, texture and shape bias, adversarial robustness, and continual learning. Our analyses show that the two mechanisms have complementary strengths, with explicit guidance consistently benefiting in-distribution, low-data performance, and continual learning retention, while implicit guidance is often more useful in shortcut-sensitive settings and under stronger adversarial perturbations. Importantly, both are lightweight and add minimal parameters and training overhead. The analyses characterize when language-derived structure helps supervised vision training and provides a practical roadmap for using off-the-shelf pretrained models from another modality as auxiliary supervision.

[58] Generalizing Multimodal Foundational Models in Context-Driven Class Incremental Learning cs.CV | cs.AIPDF

Avi Gupta, Nilotpal Sinha, Vishnu Raj, Sambuddha Saha, Pratik Joshi

TL;DR: 该方法用音频表征为冻结的多模态基础模型提供稳定上下文，引导视觉表征进行音视频类增量学习，并通过特征与 logits 蒸馏缓解遗忘。

Details

Motivation: 类增量学习要求模型持续学习新类别并保留旧类别知识。多模态基础模型包含丰富静态先验，但初步分析显示这些表征直接用于音视频增量学习时仍然不足，且音视频模态交叉下的问题研究较少。

Result: 作者提出面向音视频类增量学习的冻结多模态基础模型泛化框架，利用模型稠密的音频和视觉表示，并以注意力式上下文引导模块让音频表示为视觉表示提供跨任务稳定的上下文。方法还在特征层和 logits 层进行蒸馏，以降低灾难性遗忘并保持任务间稳定性。多个音视频增量学习基准上的实验显示，该方法持续优于现有最先进方法；摘要未提供具体指标数值。

Insight: 音频模态可在增量任务间充当较稳定的上下文，帮助视觉表示识别不断扩展的类别；稳定性主要由特征与输出层蒸馏维护。该结果说明冻结的多模态基础模型仍可通过跨模态引导适配增量设置，而不必直接微调整个基础模型。

Abstract: Class-Incremental Learning (CIL) aims to learn new classes continuously without forgetting the previously learned ones. Recent works in CIL have significantly advanced across various modalities; however, at the intersection of audio-visual modality, this problem remains underexplored. While representations from multimodal foundational models (MFMs) encapsulate rich static priors, our preliminary analysis shows that these representations struggle in incremental settings. Motivated by this, we propose a framework that generalizes frozen MFMs to audio-visual CIL. Specifically, we leverage their dense audio and visual representations and employ an attention-based contextual guidance module, in which the audio representations serve as task-stable contextual guidance for the visual representations, enabling effective class recognition in the incremental setting. To further mitigate catastrophic forgetting and preserve stability across tasks, we employ feature- and logit-level distillation, which are primarily responsible for the reduced forgetting. Extensive evaluations across various audio-visual CIL benchmarks demonstrate that our approach consistently outperforms state-of-the-art methods. Code is available at https://github.com/avigupta2798/MFM-CIL.

[59] Steering Vision-Language Models for Visual-Contextual Privacy in Location Disclosure cs.CV | cs.AIPDF

Wenyue Chen, Yuhan Cheng, Ruixin Yang, Ethan Mendes, Alan Ritter

TL;DR: 该方法从 VLM 生成前的隐藏状态估计图像适合披露的位置粒度，再按披露级别路由并干预解码；在四种骨干模型上改善隐私披露与视觉上下文的一致性。

Details

Motivation: VLM 可从细微视觉线索推断地理位置，可能给出超出图像上下文所允许精度的敏感信息。理想系统应按图像提供的证据粒度披露位置，避免过度具体或过度模糊。

Result: 研究发现，生成前隐藏状态包含可恢复的视觉上下文适当披露粒度，即使最终回答与之不一致，不同披露级别在共同隐藏状态方向上呈有序结构。基于此，作者设计推理时“路由并引导”框架：序数粒度路由器选择披露级别，条件化引导模块在解码过程中施加对应隐藏状态干预。四种 VLM 骨干上的实验改善了披露与视觉上下文的对齐，并平衡过度和不足披露；通用能力基准仅有适度变化，且方法可迁移到分布和隐私风险分类不同的数据集。

Insight: 隐私控制不必只依赖生成后的文本过滤；模型内部已编码图像证据支持的披露粒度，可在解码时据此调节输出。按序数级别显式路由有助于同时避免泄露过多位置细节和无端压低精度，但仍需关注跨数据集和通用能力上的迁移表现。

Abstract: Vision-language models (VLMs) can infer sensitive information such as geolocation from subtle visual cues, creating privacy risks when responses disclose more detail than the visual context warrants. We study visual-contextual privacy in geolocation disclosure, where a VLM should reveal location information only at the granularity appropriate to the visual context depicted in the image. We first show that this contextually appropriate granularity is recoverable from pre-generation hidden states, even when generated responses are misaligned, with disclosure levels exhibiting an ordered structure along a common hidden-state direction. Motivated by this, we propose an inference-time route-and-steer framework: an ordinal granularity router maps visual-contextual privacy representations to a disclosure route, and a disclosure-level-conditioned steering module applies route-specific hidden-state interventions during decoding. Across four VLM backbones, our method improves visual-context-aware disclosure alignment, better balances over- and under-disclosure, and incurs only modest changes on general capability benchmarks. It further transfers to another dataset with a distinct data distribution and privacy-risk taxonomy.

[60] Look Before You Reason: Implicit Visual Thinking for Efficient Multimodal Reasoning cs.CVPDF

Zerui Chen, Changrui Chen, Fei Ni, Jiankang Deng

TL;DR: LoRe 在单轮 VLM 推理前隐式定位关键图像区域、强化对应 patch 的 KV cache，再结合强化学习教模型利用视觉线索；多个多模态基准上提升推理且额外开销较低。

Details

Motivation: 视觉语言模型在需要细看小区域或容易忽略区域的任务上仍受限。缩放、裁剪或代码调用等显式图像思考虽有效，但多轮交互造成重复 token 计算、推理变慢，也把区域检查与依赖该区域的推理拆开。

Result: Look Before You Reason（LoRe）在单轮交互中预测与问题相关的图像区域，将区域与相应 patch 特征对齐，并增强相关键值缓存条目，使后续解码直接使用这些线索，无需额外图像输入或显式工具调用。强化学习进一步引导模型寻找有信息量的区域并在推理中利用它们。作者还提出物体中心多模态推理基准 COCO-ObjQA；在三个具挑战性的多模态基准上，LoRe 持续提升 VLM 推理表现，额外推理开销较低。

Insight: 细粒度视觉推理可以通过选择性强化模型内部已有的图像 patch 表征来完成，不一定需要反复裁剪并重新发起多轮调用。关键是让模型选择相关区域并在后续推理中实际使用，而不仅仅是生成一个区域定位结果。

Abstract: Vision-language models (VLMs) have advanced rapidly in multimodal reasoning, yet they remain limited on tasks requiring fine-grained understanding of small or easily overlooked image regions. Recent thinking with images approaches mitigate this limitation by allowing models to inspect images through operations such as zooming, cropping, or code execution. While effective, their multi-turn interactions with VLMs introduce redundant token computation and slow inference, and separate region inspection from the reasoning step that depends on it. To address these issues, we propose Look Before You Reason (LoRe), an implicit visual thinking framework for efficient visual reasoning within a single-turn VLM interaction. Given an image and a question, LoRe predicts the most relevant image region, aligns it with the corresponding image patch features, and strengthens the associated key-value (KV) cache entries, enabling subsequent decoding to directly exploit the selected visual cues without additional visual inputs or explicit tool calls. We further employ reinforcement learning to guide the VLM toward identifying informative image regions and leveraging them during reasoning. To support fine-grained evaluation of multimodal reasoning, we introduce COCO-ObjQA, a large-scale benchmark for object-centric multimodal reasoning. Experiments on three challenging multimodal benchmarks demonstrate that LoRe consistently improves VLM reasoning performance with low additional inference overhead.

[61] On the Limits of Scale: Inverse Scaling in Vision-Language Models cs.CV | cs.AIPDF

Rohit Saxena, Alessandro Suglia, Marek Rei, Pasquale Minervini

TL;DR: 对 19 个 VLM、8 个基准的系统分析发现，模型变大并不保证所有子任务变好：375 组子任务—模型对呈逆向缩放，影响多图空间推理、视觉感知和 STEM 等领域。

Details

Motivation: 总体尺度规律通常认为增加模型规模、数据和算力会带来性能提升，但总平均可能掩盖特定问题类别上大模型反而不如同系列小模型的现象。研究系统检验视觉语言模型是否存在这种子任务级逆向缩放。

Result: 研究评估四个家族的 19 个 VLM，在八个多模态基准（九个评测拆分）上每模型回答 29,386 道问题，共 558,334 次模型—问题评估。跨家族模型两两逐题比较后，发现 375 组子任务—模型对存在逆向缩放，涉及 4,342 个小模型答对而大模型答错的独特查询；该模式也在独立开发的架构间复现。13 组子任务—数据集在多个家族中持续出现，较符合任务驱动而非单一模型特性。多图空间推理、视觉感知和大学 STEM 受影响突出，部分准确率差距超过 20 个百分点；图表理解相对不易出现该现象。

Insight: 按整体平均判断模型规模收益会掩盖能力局部退化；模型选择应根据具体任务类别，而不能默认更大的 VLM 对每项能力都更强。多家族复现及跨家族持续的子任务现象，支持逆向缩放与任务特性有关。

Abstract: Scaling laws suggest that increasing model size, training data, and compute generally yields monotonic performance improvements. While this often holds at the aggregate level, we present systematic evidence that vision-language models (VLMs) exhibit inverse scaling at the subtask level: specific question categories on which larger models perform worse than smaller counterparts within the same model family. We evaluate 19 models from four distinct model families across eight multimodal benchmarks (nine evaluation splits), answering 29,386 questions per model, 558,334 model-question evaluations in total. Using per-question pairwise analysis across all model pairs in each family, we identify 375 subtask-model-pair combinations exhibiting inverse scaling, spanning 4,342 unique queries where a smaller model answers correctly but a larger model fails, and we find that these patterns replicate across independently developed architectures. We identify 13 subtask-dataset pairs that show inverse scaling across multiple families, consistent with the phenomenon being task-driven rather than model-specific. The most affected domains in our study include multi-image spatial reasoning, visual perception, and university-level STEM knowledge, with accuracy gaps exceeding 20 percentage points in several cases, while diagram understanding appears comparatively resistant. These findings challenge the assumption that increasing model size uniformly improves multimodal capabilities and suggest that model selection should be task-aware.

[62] Test-time Adaptation for Point Cloud Denoising under Unseen Noise cs.CV | cs.GRPDF

Kun Jiang, Shida Fu, Fanhao Yi, Weiqing Li, Zhiyong Su

TL;DR: TTAD 根据每个测试点云的残差估计未知噪声，再构造噪声感知对比样本进行少步测试时适配；也扩展为连续样本设置，在合成和真实数据上改善未见噪声泛化。

Details

Motivation: 点云去噪模型通常假设测试噪声与训练分布相近；现实中噪声分布偏移时，性能往往明显下降。希望在不访问源训练数据、不增加监督或重新训练的前提下，利用当前测试样本适配未知噪声。

Result: TTAD 输入预训练去噪模型和带噪测试点云。残差驱动噪声建模模块分析输入与初始去噪伪干净结果的差异，估计样本特有噪声分布；噪声感知对比适配模块再由去噪点云构造“噪声—更强噪声”测试训练对，通过少量测试时更新调整模型。方法还扩展到连续 TTAD（CTTAD），可针对噪声分布一致的序列测试样本渐进细化，并降低单样本计算成本。合成与真实数据实验显示，对多种未见噪声评测指标均提升现有去噪方法的泛化表现。

Insight: 适配信号可从当前样本的去噪残差中估计，而不必回到源数据或获取额外标注。先估计样本级噪声，再构造对比训练对，有助于针对分布偏移更新模型；连续样本共享噪声特性时还可逐步复用适配。

Abstract: Although deep learning-based point cloud denoising methods have demonstrated impressive results in recent years, their effectiveness usually degrades substantially in real-world scenarios where the noise distribution of test point clouds deviates from that of the training set. To address this challenge, we propose a test-time adaptive denoising (TTAD) framework that enables existing denoising approaches to adapt to unknown noise patterns at test time without relying on additional supervision or retraining from source data. Taking a pre-trained denoising model and a test noisy point cloud as input, TTAD first employs a residual-driven noise modeling (RDNM) module to estimate the sample-specific noise distribution through analyzing the deviation between the noisy input and its pseudo-clean version denoised by the initial model. Then, a noise-aware contrastive adaptation (NACA) module is designed to build sample-specific noisy-noisier test-time training pair from the denoised point cloud, and update the model parameters over a few adaptation steps per sample at test time through contrastive learning. Furthermore, TTAD naturally extends to a continual TTAD (CTTAD) setting, facilitating efficient progressive refinement across sequential test samples with consistent noise distributions, while reducing the computational cost per sample. Extensive experiments on both synthetic and real-world datasets demonstrate that our approach significantly improves the generalization ability of existing denoising models under unseen noise, achieving superior performance across multiple evaluation metrics.

[63] FocusOVD: Geometric and Contextual Feature Refinement for Open-Vocabulary Small-Object Detection cs.CVPDF

Hanlin Kou, Beiqi Bai, Li Chen, Youjia Jing, Shupan Li

TL;DR: FocusOVD 在冻结 VLM 主干的条件下，通过跨尺度加权融合、几何卷积和 RoI 门控增强小目标开放词汇检测；COCO-OVD 新类别 AP 为 36.3%，LVIS-OVD 总 AP 为 33.7%。

Details

Motivation: 开放词汇目标检测借助视觉语言模型语义知识检测已见和未见类别，但小目标往往因高分辨率细节保留不足、跨层信息聚合不佳及区域判别性有限而难以检出。

Result: FocusOVD 不修改冻结的 VLM 主干，包含三个模块：重加权跨尺度特征融合以归一化层级权重平衡浅层外观细节与深层语义；残差风车形门控卷积增强高分辨率局部几何响应；残差卷积门控线性单元抑制背景激活并强化预测前的 RoI 判别能力。在 COCO-OVD 上新类别 AP 为 36.3%，比 CORA、UniDetector、SAMP 分别高 1.3、1.1、1.5 个百分点；在 LVIS-OVD 上总体 AP 为 33.7%，比最强对比方法高 0.6 个百分点。

Insight: 小目标开放词汇检测同时需要保留细节、融合不同层级特征并提高候选区域判别性，单靠冻结 VLM 的类别语义不足以解决问题。把几何细节与语义上下文分别补强，可在不改动预训练主干的情况下改善未见类别检测。

Abstract: Open-vocabulary object detection aims to detect both seen and unseen categories by leveraging the semantic knowledge of vision-language models. However, existing methods often struggle with small objects due to insufficient preservation of high-resolution details, ineffective information aggregation across feature levels, and limited region-level discriminability. To address these challenges, we propose FocusOVD, an open-vocabulary object detector that enhances small-object representations without modifying the frozen VLM backbone. FocusOVD introduces three complementary components: a Reweighted Cross-scale Feature Fusion module, which learns normalized level-wise weights to adaptively balance shallow appearance details and deep semantic cues during feature pyramid aggregation; a Residual Pinwheel-shaped Gated Convolution module, which strengthens local geometric responses in high-resolution features; and a Residual Convolutional Gated Linear Unit module, which suppresses background-dominated activations and enhances RoI discriminability before prediction. Extensive experiments on COCO-OVD and LVIS-OVD demonstrate the effectiveness of FocusOVD. On COCO-OVD, FocusOVD achieves a novel-category AP of 36.3%, outperforming CORA, UniDetector, and SAMP by 1.3%, 1.1%, and 1.5%, respectively; on LVIS-OVD, it achieves an overall AP of 33.7%, surpassing the strongest competing method by 0.6%. These results demonstrate the strong generalization ability of FocusOVD for open-vocabulary small-object detection.

[64] Cross-Visibility-Gap Identity Persistence for 4D Scene Graphs cs.CV | cs.AIPDF

Jiahui Hu, Li Gao, Yu Liu, Pengzhan Zhou

TL;DR: CVG-SGM 用目标—载体关系记忆恢复物体被不透明载体遮挡后的 4D 场景图身份：受控设置重链接准确率 1.000，真实 RGB-D/SAM2 留出样本为 36/36。

Details

Motivation: 4D 场景图要求目标暂时消失后仍保持身份一致，例如物体进入不透明载体再出现时成为新检测。若缺少外观线索和目标自身运动信息，身份恢复只能依赖历史关系信息。

Result: 作者将跨可见性间隔身份持续性表述为基于历史目标—载体绑定的节点恢复，并提出 CVG-SGM“传递—维持—读取”记忆模块：几何加权跨节点交互把目标证据写入载体状态，共享 GRU 在运输过程中维护信息，双时刻读出结合已存载体—身份兼容性和当前检测—载体几何恢复历史身份。在每载体单一身份的受控设置中，重链接准确率为 1.000，而无记忆和参数量匹配的无写入控制均为 0.570；对场景不重叠及更长未见遮挡间隔也能泛化。真实 RGB-D/SAM2 特征级留出样本正确重链接 36/36，最强固定载体—身份控制为 28/36。反事实交换载体记忆会按交换后的绑定改变预测。

Insight: 当目标外观与自身运动不可用时，历史关系可以作为可传递的身份线索；载体充当遮挡期间保存目标关系状态的中介。证据支持关系记忆对身份恢复的作用，但目前方法依赖每载体单一身份假设，尚未实现原始视频端到端重识别。

Abstract: 4D scene graphs require persistent object identity when an object disappears inside an opaque carrier and later reappears as a fresh detection. When appearance and target-centric motion are unavailable, identity recovery must rely on relational history. We formulate cross-visibility-gap identity persistence as historical-node recovery through a remembered target–carrier binding. We introduce CVG-SGM, a perception-frontend-compatible transfer–maintain–read memory. Geometry-weighted cross-node interaction transfers target-specific evidence into carrier states, a shared per-node GRU maintains this information during transport, and a two-time readout combines stored carrier–identity compatibility with current detection–carrier geometry to recover the historical identity. In the controlled one-identity-per-carrier setting, CVG-SGM achieves 1.000 re-link accuracy, compared with 0.570 for both no-memory and parameter-count-matched no-write controls. It also generalizes to scene-disjoint, unseen longer visibility gaps. On real RGB-D/SAM2 feature-level episodes, it correctly re-links 36/36 held-out detections, compared with 28/36 for the strongest fixed carrier–identity control. Counterfactual carrier-memory swaps redirect predictions according to the swapped bindings, supporting the role of stored relational information in identity recovery. The current approach remains limited by shared-carrier identity ambiguity and does not provide end-to-end raw-video re-identification.

[65] Progressive Subset Selection and Cascaded Consistency for Unsupervised Vision-Language Model Adaptation cs.CV | cs.AIPDF

Hao Yan, Guanghui Wang

TL;DR: 该无监督 PVLM 适配方法先逐步扩展高置信度、类别平衡的伪标签子集，再用教师—学生级联一致性利用未标注数据；在 CLIP 和 SigLIP 多个基准上稳定超过零样本基线。

Details

Motivation: 预训练视觉语言模型零样本识别能力强，但遇到目标域偏移会退化。无监督适配没有目标标签可用，模型生成的伪标签可能不可靠，也缺少有标签验证集用于选模型和早停。

Result: 框架结合基于预测间隔的渐进子集选择和级联一致性学习。先构造类别平衡的伪标签集合，并逐步纳入更多目标域数据，使适配从可靠监督锚点开始；再用弱增强样本的时间平滑教师预测监督强增强学生预测，并以置信度过滤降低错误伪标签影响。为保留预训练嵌入结构，仅更新视觉编码器的归一化参数及由文本提示初始化的类别原型。在多个识别基准和 CLIP、SigLIP 主干上，方法持续改善零样本基线，且与近期无监督适配方法相比有竞争力。

Insight: 无标签目标域适配的核心是控制伪标签噪声：先从可靠样本建立锚点再逐步扩展，并通过教师预测的一致性利用其余数据。只更新归一化参数和类别原型，能在适配目标域时尽量保留原有跨模态嵌入空间。

Abstract: Pretrained Vision-Language Models (PVLMs) achieve strong zero-shot recognition but often suffer performance degradation under target-domain shift. Unsupervised adaptation provides a practical way to improve target-domain performance without labeled data, but it remains challenging because pseudo-labels generated by the model can be unreliable and no labeled validation set is available for model selection or early stopping. We propose a simple framework for unsupervised PVLM adaptation that combines progressive margin-based subset selection with cascaded consistency learning. The subset selection strategy constructs a class-balanced pseudo-labeled set using prediction margins and gradually expands it during training, enabling adaptation to start from reliable supervision anchors before incorporating broader target-domain data. Cascaded consistency learning further exploits unlabeled samples by using temporally smoothed teacher predictions on weakly augmented views to supervise student predictions on strongly augmented views, with confidence filtering to reduce the influence of uncertain pseudo-labels. To preserve the pretrained embedding structure, the framework updates only normalization parameters in the visual encoder and class prototypes initialized from text prompts. Experiments across multiple recognition benchmarks with both CLIP and SigLIP backbones show consistent improvements over zero-shot baselines and competitive performance against recent unsupervised PVLM adaptation methods. These results suggest that progressive pseudo-label selection and teacher-guided consistency provide an effective and lightweight strategy for adapting PVLM classifiers without labeled target data.

[66] HealBench: A Fine-Grained Benchmark for Evaluating Psychological Comfort in Text-to-Image Generation cs.CV | cs.AIPDF

Junjie Xu, Yuzhe Yang, Rui Yang, Luwei Xiao, Wenxin Wu

TL;DR: HealBench 将心理舒适感作为文生图的独立评价维度，提供 3 万组图文训练样本和 1,095 条评测实例；实验显示审美和语义对齐不保证图像令人舒适。

Details

Motivation: 图像生成和编辑的研究通常关注写实度、语义忠实度和美学效果，但较少考察输出是否让人感到心理舒适。作者将舒适定义为观者对图像中恢复性、情绪支持线索进行评价后形成的情感反应。

Result: HealBench 含 30,000 组高质量图像—文本对，覆盖 19 类、92 个子类；数据从 100,000 个候选经视觉语言匹配、人类偏好模型、专家筛选和示例引导增强等人机协同流程筛选。作者另构建按特征聚类的 HealBench-Eval，含 1,095 个实例，并对 14 种代表性图像生成模型和提示改写策略进行客观与主观评估。结果发现，常规视觉质量与感知舒适度之间存在差距：语义对齐和美学优秀不必然产生具有情绪恢复作用的图像。强化学习实验还表明 HealScorer 可作为奖励信号评估和改善生成图像的情绪及恢复性质量。

Insight: 心理舒适感是以人为中心的生成质量维度，不能由画面美观或文本语义匹配代替。基准和奖励模型为该维度提供测量与优化工具，但评估仍依赖人类对情绪支持线索的感知。

Abstract: Despite advances in photorealism, semantic fidelity, and aesthetics, text-to-image generation and image editing remain understudied in a human-centered dimension: whether their outputs feel psychologically comforting. Grounded in cognitive evaluation theory, we define psychological comfort as an affective response shaped by viewers’ appraisal of restorative and emotionally supportive visual cues. We introduce HealBench, a fine-grained benchmark of 30,000 high-quality image-text pairs spanning 19 categories and 92 subcategories, selected from 100,000 candidates through a human- and expert-in-the-loop pipeline combining vision-language model matching, human preference models, expert filtering, and exemplar-guided augmentation. We also construct HealBench-Eval, a feature-clustered evaluation set of 1,095 instances. Using HealBench-Eval, we conduct objective and subjective evaluations of 14 representative image generation models and prompt-rewriting strategies. Results reveal a gap between conventional visual quality and perceived comfort: strong semantic alignment and aesthetics do not guarantee emotionally restorative images. Reinforcement learning experiments further show that HealScorer can serve as a reward signal for assessing and improving the emotional and restorative quality of generated images. These findings establish psychological comfort as a distinct dimension of human-centered image generation and position HealBench as a foundation for affect-aware generative models.

[67] Multiscale Temporal-Spectral-Spatial EEG Learning With Modality-Specific and Modality-Invariant Representations for Emotion Recognition cs.CVPDF

Jian Zhang, Manrong Liu, Yilei Huang, Wenhua Liu, Xiaohui Yang

TL;DR: GMSI-Net 联合建模 EEG 的多尺度时空频特征，并分离模态特有与共享情绪表示；在 DEAP 和 MAHNOB-HCI 的被试内十折评估中取得较高效价、唤醒识别结果。

Details

Motivation: 情绪相关 EEG 模式会随时间、频段、电极和脑区变化；多种生理信号又同时包含各自特有和跨模态共享的情感信息。如何保留各模态线索并利用互补信息，是多模态情绪识别的两个相关挑战。

Result: GMSI-Net 是以 EEG 为中心的多模态框架。TSSR 编码器建模多尺度时空通道模式、微分熵特征及脑区局部到全局关系；MSR 分支通过双向跨模态注意力与可学习门控控制信息交换并保留模态特征；MIR 分支以自适应加权对比损失对齐共享情感表示，外围生理信号由多尺度 Conv-Transformer 编码。在 DEAP 被试内随机十折中，效价和唤醒指标为 96.21（1.47）与 96.41（1.60）；MAHNOB-HCI 上为 94.10（2.86）与 94.48（3.77）。

Insight: 该设计把跨模态共享情绪信息与每种模态的独有线索分开处理，避免融合时一味对齐而抹去互补信号。摘要报告的结果来自被试内随机十折，不能据此直接推断跨被试泛化表现。

Abstract: Multimodal physiological signals provide complementary cues for emotion recognition. They also raise two related challenges. Emotion-related EEG patterns vary across time, frequency bands, electrodes, and brain regions. Different physiological modalities also contain both modality-specific and shared affective information. This paper presents GMSI-Net, an EEG-centered multimodal emotion recognition framework. It has three key components. The temporal-spatial-spectral-region (TSSR) encoder models multiscale temporal-channel patterns, differential entropy features, and local-to-global brain-region relations. The modality-specific representation (MSR) branch uses bidirectional cross-modal attention and learnable gates. It controls information transfer while retaining modality-specific cues. The modality-invariant representation (MIR) branch learns a shared affective representation. An adaptively weighted contrastive loss aligns this representation across modalities. Independent multiscale Conv-Transformer encoders process the peripheral physiological signals. GMSI-Net is evaluated on DEAP and MAHNOB-HCI using within-subject random ten-fold cross-validation. The model reaches 96.21 (1.47) and 96.41 (1.60) for valence and arousal on DEAP. It reaches 94.10 (2.86) and 94.48 (3.77) on MAHNOB-HCI. These results indicate that combining EEG features with complementary physiological information can improve emotion recognition.

[68] Less is More: Concise Retrieval and Critic-based Re-ranking for Composed Image Retrieval cs.CV | cs.AIPDF

Yuqian Zheng, Hyoju Ahn, Hyeongjin Ahn, Eunil Park

TL;DR: Less-is-More CIR 先生成只保留判别性修改语义的简洁目标描述，再以修改一致性和参考图保留度重排候选；该免训练两阶段方法用于零样本组合图像检索。

Details

Motivation: 零样本组合图像检索要根据参考图像和修改文本找到目标图像。现有方法常用大型视觉语言模型生成目标图像描述，但冗余语义可能带来噪声，反而影响检索；候选也需要同时符合修改要求并保留参考图未修改的内容。

Result: 作者提出无需训练的 Less-is-More CIR，分为简洁检索与评论式重排两阶段。第一阶段生成面向目标且只保留最具区分性的修改语义的描述，以减少语义噪声；第二阶段从修改一致性和参考内容保留两个方面评估候选并重新排序。摘要报告在零样本组合图像检索基准上的广泛实验显示方法有效且稳健，但未给出具体数据集名称或数值增益。

Insight: 组合检索描述不宜越详细越好；保留真正改变目标图的判别性语义，可以减少无关信息干扰。最终排序还要同时检查“改对了什么”和“参考图中什么应保持不变”，让检索目标兼顾编辑与保留。

Abstract: Zero-shot composed image retrieval (ZS-CIR) aims to retrieve a target image based on a reference image and modification text. Recent approaches commonly rely on large vision-language models to generate target image captions for retrieval. However, these captions may include redundant semantic details, introducing noise when retrieving the target image and leading to suboptimal retrieval results. To address this issue, we propose Less-is-More CIR, a two-stage training-free framework that combines Concise Retrieval and Critic Re-ranking. In the first stage, concise target-oriented captions are generated that preserve only the most discriminative modification semantics, thereby reducing semantic noise in the retrieval. In the second stage, a critic re-rank module further evaluates the retrieved candidates from the perspectives of modification consistency and reference preservation. Extensive experiments demonstrate the effectiveness and robustness of the proposed framework for the ZS-CIR. Our code is available at: https://github.com/dxlabskku/LM-CIR.

[69] SynCalib: Breaking Dataset Shortcuts in LiDAR-Camera Calibration via Extrinsic-Controllable Synthesis cs.CV | cs.ROPDF

Huihua Zhu, Shuyang Zhang, Dongqing Chen, Zhuo Yu, Jianhao Jiao

TL;DR: SynCalib 通过可控外参合成 LiDAR–相机标定训练数据，减少网络对固定标称外参的捷径依赖，并报告合成数据训练模型在真实设备配置上的零样本迁移。

Details

Motivation: 在线 LiDAR–相机标定对于机器人很重要，数据驱动方法虽可实现高精度无靶标标定，却常因训练数据中的外参变化不足而学到固定标称配置这一捷径，导致真实部署时性能下降、泛化不佳。

Result: SynCalib 利用带深度真值的既有全景图像数据集，在严格外参约束下合成多模态标定数据，用于训练标定网络。实验显示，生成数据可增强典型学习式标定网络的泛化性与鲁棒性；作者还在多种真实相机与 LiDAR 配置上进行评估，报告仅用合成数据训练的模型具有零样本迁移能力。摘要未提供具体误差或提升幅度。

Insight: 标定模型可能学到数据集固有的标称外参，而不是真正的跨传感器几何关系。通过系统控制合成外参来扩大训练变化，为打破这一数据捷径提供了路径；真实配置上的验证是关键证据，但摘要未列明各配置与定量结果。

Abstract: Online LiDAR-camera calibration remains a fundamental yet challenging task in the field of robotics. Recently, deep learning-based data-driven approaches have emerged, offering high-precision, targetless calibration capabilities. However, existing methods often suffer from a critical dataset shortcut phenomenon due to the lack of extrinsic diversity in their training data. Networks tend to overfit to fixed nominal extrinsic configurations, leading to severe performance degradation and poor generalization in real-world deployments. To address this limitation, we propose a highly generalizable data generation framework tailored for training LiDAR-camera calibration networks. Our framework leverages existing omnidirectional image datasets annotated with depth ground truth to synthesize multi-modal calibration data under rigorous extrinsic constraints. Extensive experiments demonstrate that the data generated by our pipeline significantly enhances the generalization and robustness of typical learning-based calibration networks. Furthermore, we conduct comprehensive real-world evaluations across various camera-LiDAR configurations, validating the zero-shot transfer capability of models trained exclusively on our synthetic data. To facilitate future research and community use, the code for data generation, the pre-trained models, and online benchmark datasets will be made publicly available.

[70] AnomalyJev: Towards Evaluating Image Anomaly Explanations via Claim-Level Verification cs.CV | cs.AI | cs.CLPDF

Qizhou Wang, Jiawen Zhu, Guansong Pang, Christopher Leckie

TL;DR: AnomalyJev 将多模态模型生成的异常解释拆成可核验主张，再与标注真值对照评估忠实度和完整性；在人类标注的 640 条解释上，以较低资源达到接近强 MLLM 评审的人工一致性。

Details

Motivation: 多模态大模型可为图像异常检测给出文字解释，但可靠、可扩展地评价解释仍困难。LLM 评审虽可按结构化标准打分，却需要大量生成 token、成本较高；同时，结论正确不代表解释中的每个主张都有依据。

Result: AnomalyJev 从上下文化表示中提取可验证主张，利用由真值定义的查询和指针式预测头完成抽取，不需要生成文本；再将主张与真值核验以评分解释的忠实度和完整性。评估集含 640 条人工标注解释及超过 1,600 个人类专家评分，覆盖域内和跨数据集设置。尽管设计紧凑，AnomalyJev 与人工标注者的一致性超过多数开源 MLLM 评审，并接近旗舰 MLLM 评审，同时运行时间和资源消耗更低。

Insight: 解释评估可落到可验证的具体主张，不必再调用大型生成模型逐条撰写判断理由。将忠实度与完整性拆开检查，能避免只看整体流畅度或异常结论；人工评分对照也表明轻量核验框架可达到有竞争力的一致性。

Abstract: Recent multimodal LLM (MLLM)-based anomaly detection (AD) methods can generate textual explanations that help interpret their predictions. However, reliably and efficiently evaluating these explanations remains challenging. While LLM judges can assess explanations through structured rubrics, they often require substantial token generation, making evaluation costly and difficult to scale. We instead propose to anchor evaluation in the available ground truth by extracting verifiable claims from each explanation and verifying them against the corresponding annotations. We instantiate this idea as AnomalyJev, a lightweight framework that extracts verifiable claims from contextualised representations using ground-truth-defined queries and pointer based heads, without token generation. The claims are then verified against the ground truth to score faithfulness and completeness. For evaluation, we construct a human-annotated set of 640 explanations with over 1,600 expert ratings across in-domain and cross-dataset settings. Despite its compact design, AnomalyJev achieves stronger agreement with human annotators than most open MLLM judges and approaches that of flagship MLLM judges, at a fraction of their runtime and resources.

[71] Text-Anchored Modality Experts with Uncertainty-Guided Routing for Multimodal Sentiment Analysis cs.CVPDF

Xiaohua Huang, Bingrui Lei, Xiuyan hao, Ling Zhou, Yuan Zong

TL;DR: TAME 把文本作为常驻情感专家，再依据各模态预测不确定性动态调用音频和视频专家；在三个情感数据集的多数指标上达 SOTA，同时相对 MoE 基线最多减少 78.7% 参数和 41.2% FLOPs。

Details

Motivation: 多模态情感分析需融合用户视频中的文本、音频和视觉信号。常见方法把各模态视作对等，但语言通常提供主要语义先验，非语言信息则互补且更易含噪；不加区分地融合可能让不可靠信号干扰判断。

Result: TAME 采用不对称模态专家结构：文本特征作为固定且始终启用的共享专家，音频—文本和视频—文本分支作为按需路由的辅助专家。轻量 Prophet Heads 估计每种模态在单个样本上的预测不确定性，路由器据此进行可靠性加权融合。在 CMU-MOSI、CMU-MOSEI 和 CH-SIMS 上，多数指标达到最先进表现；相较混合专家基线，参数量最多减少 78.7%，FLOPs 最多降低 41.2%。

Insight: 融合时不应默认每种模态同等可靠：将文本作为稳定语义锚点，并只在音频或视频证据可信时动态补充，有助于控制噪声。样本级不确定性驱动路由同时带来较高准确度和较低计算开销，符合各模态信息贡献不对称的特点。

Abstract: Multimodal sentiment analysis (MSA) aims to understand user-generated videos by integrating multiple modalities. Existing methods often treat modalities as symmetric, overlooking the fact that language provides a dominant semantic prior while nonverbal signals are complementary and noise-prone. To address this, we propose a Text-Anchored Modality Experts with Uncertainty-Guided Routing, termed TAME, that reformulates MSA as an uncertainty-guided refinement paradigm, where the language prior is calibrated and enhanced by selectively trusted nonverbal evidence. Specifically, TAME adopts an asymmetric Mixture-of-Modality-Experts framework, in which textual features act as a fixed and always-activated shared expert, while audio-textual and video-textual cross-modal branches serve as dynamically routed auxiliary experts. Furthermore, we introduce lightweight Prophet Heads to quantify the sample-level predictive uncertainty of each individual modality, and this uncertainty metric is further incorporated into the modality router to realize reliability-aware expert aggregation and fusion. Experiments on CMU-MOSI, CMU-MOSEI, and CH-SIMS datasets demonstrate that TAME achieves state-of-the-art performance on the majority of metrics while reducing parameter count by up to 78.7% and FLOPs by up to 41.2% over the mixture-of-expert baseline. %These results confirm that asymmetric expert construction with uncertainty-guided routing is an effective paradigm for MSA.

[72] Real In, Real Out: What If We Only Use Real Data for Scene Text Editing? cs.CVPDF

Xingsong Ye, Yongkun Du, Jiaxin Zhang, Chong Sun, Zhineng Chen

TL;DR: TextRIRO 从真实场景文字图像自构造配对监督，用字符列打乱加裁剪破坏文本语义并保留风格线索；在真实编辑基准上兼顾准确性与视觉真实感，还生成 TextRIRO-3M 助力长文本识别。

Details

Motivation: 场景文字编辑要替换图中文字同时保持原有风格，通常依赖编辑前后成对图像训练。近期方法大量使用合成配对数据和复杂解耦策略，难以覆盖自然场景的多样性与复杂性，容易出现伪影或幻觉。

Result: TextRIRO 探索将每张真实样本转成自身的配对监督，使用条件扩散架构，并比较裁剪、打乱、遮挡等破坏方式。字符列打乱结合图像裁剪能破坏文本语义而保留关键风格线索，使模型直接从真实文字图学习编辑行为；在真实基准上取得有竞争力的编辑准确性和视觉真实感，缓解合成到真实的域差。作者进一步构建 TextRIRO-3M，将编辑后和原图拼接用于长文本识别；用该数据训练识别模型可显著提升识别准确率。

Insight: 真实样本可通过自配对构造训练监督，不必完全依赖合成编辑前后图像。关键在于破坏文字内容而尽量保留版式和视觉风格，使模型学会“改字但保留外观”；同一编辑流程还能扩展出下游长文本识别资源。

Abstract: Aiming to modify textual content while preserving the original style, Scene Text Editing (STE) has significant practical value in many applications. STE typically requires paired images before and after editing for training. However, recent approaches rely heavily on synthetic paired data and complex disentanglement strategies. They struggle to faithfully capture the diversity and complexity of natural scenes, often producing artifacts or hallucinations. In this work, we challenge the common practice and investigate whether STE can be driven by turning each real sample into its own paired supervision. Concretely, we explore multiple ways to disrupt the original image (e.g., Crop, Shuffle, Mask) to construct self-paired training data, and build a strong baseline (TextRIRO}) upon a conditional diffusion architecture. Our experiments show that combining character-column shuffling with image cropping (Shuffle&Crop) effectively destroys text semantics while preserving key style cues, enabling the model to learn editing behaviors directly from the real text image. With this concise yet real-oriented design, TextRIRO achieves promising performance in both accuracy and visual realism across real-world benchmarks, substantially mitigating the synthetic-to-real domain gap. Furthermore, we leverage TextRIRO to build TextRIRO-3M, a large-scale realistic dataset for long-text recognition by concatenating edited and original images. Experimental results show that training recognition models with TextRIRO-3M significantly improves recognition accuracy, demonstrating that TextRIRO provides highly useful training resources for downstream tasks. Overall, TextRIRO lifts STE to realistic, reliable, and widely applicable new levels. Code is available at https://github.com/YesianRohn/TextRIRO.

[73] Causal Spatiotemporal State Evolution for Monocular 4D Reconstruction cs.CVPDF

Qiaowei Miao, Yijing Guo, Lipei Zhang, Qifeng Cheng, Yuru Xiao

TL;DR: 该单目 4D 重建框架以因果时空 Mamba 定向传播跨帧几何状态，并用统一运动监督把几何与运动耦合；在视频深度、相机位姿和光流任务上达到 SOTA，减少时间漂移。

Details

Motivation: 前馈模型擅长静态三维几何估计，但动态 4D 场景要求表示随时间因果演化。现有方法常无序聚合时间信息，缺少物理时间方向；同时把几何与运动分开监督，难以一致约束跨帧状态变化，造成 4D 表示不稳定。

Result: 方法以 Causal Spatiotemporal Mamba（CSM）为核心，通过互补的时间—空间及空间—时间扫描，在帧间持续传播几何感知状态。统一运动监督（UMS）利用相机和深度预测构造与三维结构一致的前向运动场，显式约束帧间状态转移。动态基准实验中，方法在视频深度、相机位姿和光流估计上达到最先进表现，并减少时间漂移、增强时空一致性。

Insight: 将时间处理改为有方向的状态传播，并以几何一致的运动场联合监督，可以让动态重建遵循场景连续演化，而不只是汇总多帧特征。几何和运动的耦合约束是稳定跨帧状态、降低漂移的关键。

Abstract: While feed-forward models excel in static 3D geometry estimation, extending them to dynamic 4D scenes requires modeling visual geometry as a causally evolving state. Current methods typically rely on unordered temporal aggregation, which lacks the directional structure of physical time. Furthermore, existing supervision often treats geometry and motion as disjoint objectives, failing to exploit their inherent physical coupling. Consequently, they lack a unified constraint to effectively supervise temporal state transitions, leading to inconsistent 4D scene representations. To address this, we propose a feed-forward framework for causal 4D visual geometry learning from monocular videos. At its core, Causal Spatiotemporal Mamba augments temporal aggregation with directional state propagation. Through complementary Temporal-Spatial and Spatial-Temporal Scans, CSM continuously propagates geometry-aware states across frames to model spatiotemporal evolution. To align this causal state evolution with observable dynamics, we introduce Unified Motion Supervision. Rather than treating motion as an independent objective, UMS leverages geometry-aware predictions from the camera and depth heads to construct a unified forward motion field that is consistent with the underlying 3D structure. This geometry-grounded supervision explicitly constrains inter-frame state transitions, enabling stable states propagation across frames. Extensive evaluations on dynamic benchmarks demonstrate state-of-the-art performance across video depth, camera pose, and optical flow estimation. These results validate that the synergy between the directional state propagation of Causal Spatiotemporal Mamba and Unified Motion Supervision effectively captures continuous scene evolution, significantly reducing temporal drift and reinforcing spatial-temporal consistency in 4D representation learning.

[74] HiQGS: Hierarchical Spatiotemporal Querying for Feed-Forward Gaussian Reconstruction cs.CVPDF

Qiaowei Miao, Qifeng Cheng, Yijing Guo, Yuru Xiao, Ziqian Ni

TL;DR: HiQGS 以分层时空编码器组织稀疏单目观测的多尺度几何外观、时间和位姿，再由目标时刻查询解码高斯场景状态；静态和动态重建实验显示较强渲染质量与几何精度。

Details

Motivation: 从稀疏且有位姿的单目帧前馈重建高斯场景，需要联合处理视角和时间变化。按帧预测高斯会把分配绑定到单帧，潜变量聚合又常未按观测与目标时刻的时间关系组织证据，导致不同尺度、视角和时刻的信息难以对齐融合。

Result: HiQGS 是查询式分层重建框架。分层时空编码器按图像位置、观测时间和相机位姿组织多分辨率几何—外观特征，保留互补的外观与结构线索；时间自适应解码器以目标时间戳为查询，从分层表征检索相关时空证据并预测对应的高斯场景状态。静态和动态场景重建基准显示方法具有较强的渲染质量和几何精度。

Insight: 重建目标时刻时，应根据查询时间有选择地检索相关观测，而不是把多帧证据无差别压缩。显式编码空间位置、时间及相机位姿，再用目标时刻自适应查询，有助于对齐稀疏观测中的几何与外观信息。

Abstract: Feed-forward Gaussian reconstruction from sparse posed monocular frames requires reasoning over observations that vary jointly in viewpoint and time. Existing methods either predict Gaussian primitives from observation-aligned features or aggregate multi-frame information through compact latent queries. However, the former tightly couples Gaussian allocation to individual frames, while the latter does not explicitly structure observed evidence according to its temporal relation to the requested timestamp. Consequently, evidence across spatial scales, viewpoints, and timestamps can be difficult to align and integrate. We present \textbf{HiQGS}, a query-based hierarchical framework for feed-forward Gaussian scene reconstruction from sparse monocular frames. HiQGS introduces a \textbf{Hierarchical Spatiotemporal Encoder} that organizes multi-resolution geometry-appearance visual features according to image location, observation time, and camera pose, thereby preserving complementary appearance and structural cues. Our \textbf{Time-Adaptive Decoder} use target timestamp queries the resulting hierarchical representation to retrieve relevant spatiotemporal evidence and predicts the corresponding Gaussian scene state. Experiments on static and dynamic scene reconstruction benchmarks demonstrate strong rendering quality and geometric accuracy, validating the effectiveness of hierarchical visual encoding and target-time-aware Gaussian querying.

[75] Provisioning Robust and Efficient LiDAR Perception for Autonomous Driving cs.CVPDF

Tingxu Han, Zijie Shen, An Guo, Lyuke Wang, Chunrong Fang

TL;DR: 该 LiDAR 部署方案联合优化点云污染鲁棒性、推理延迟和显存：KITTI 上污染条件 Moderate AP 提升 3.32 点，同时平均延迟降低 19.8%、峰值显存降低 53.9%。

Details

Motivation: 自动驾驶 LiDAR 目标检测既要能应对恶劣天气等点云污染，也要满足延迟和显存约束。已有研究通常分别处理鲁棒性和资源效率，导致轻量模型遇污染易失效，鲁棒模型又难以部署。

Result: 方法先构造模拟极端天气的污染样本，再依据扰动敏感性排列干净与受污染样本，优先学习困难污染例；敏感度由七种异构 3D 检测器对置信度、鸟瞰框重叠和未匹配检测的变化估计。效率方面缩窄网络，并用离线邻域密度测量决定各采样阶段处理的点数和邻居数。在 KITTI 的 PointRCNN 汽车检测上，污染条件 Moderate AP 较原模型提升 3.32 点，平均延迟降低 19.8%，峰值 GPU 显存降低 53.9%。跨两个数据集、两种架构和三类目标，污染条件 AP 平均提升 4.03 点，平均延迟和峰值显存分别降低 14.4% 与 38.0%。

Insight: 鲁棒性与部署效率可以通过样本难度排序和结构缩减联合优化，而非分别设计模型。该方案报告在多数据集、多架构和类别上同时改善污染表现与资源占用；其中 KITTI/PointRCNN 的具体数字展示了单一设置下的收益。

Abstract: LiDAR-based 3D object detection is a core perception service for autonomous driving, but deployment requires robustness to point-cloud corruption while meeting latency and memory requirements. Existing approaches address robustness and resource efficiency separately, resulting in compact detectors that are fragile under corruption or robust detectors that remain costly to deploy. We therefore formulate LiDAR perception provisioning as constructing a detector that remains accurate under point-cloud corruptions while meeting constraints on inference latency and peak GPU memory. To achieve robustness, we first craft corrupted samples that mimic extreme weather conditions. Then we train candidate detectors offline by ordering clean and corrupted samples by perturbation sensitivity, through which detectors learn more from hard corrupted samples. We estimate perturbation sensitivity using an ensemble of seven heterogeneous 3D detectors by tracking changes in confidence, BEV overlap, and unmatched detections. To improve efficiency, we narrow the network and use offline neighborhood-density measurements to determine how many points and neighbors each sampling stage processes. We evaluate our method using AP (Average Precision) under clean and corrupted conditions, inference latency, and peak allocated GPU memory. On KITTI for Car detection with PointRCNN, our method improves Moderate AP under corruption by 3.32 points over the original detector while reducing mean latency by 19.8% and peak allocated GPU memory by 53.9%. Across two datasets, two detector architectures, and three object classes, our method improves AP under corruption by 4.03 points on average over the corresponding original detectors, while reducing mean inference latency and peak allocated GPU memory by 14.4% and 38.0%, respectively. Our code is available at https://github.com/drunklibai/robust-efficient-lidar-perception.

[76] NeoWorld-3: From Pixels to Code-Defined Physical Worlds cs.CVPDF

Eachen Soong, Zijian Niu, Haoran Xu, Yihong Dong, Yunbo Wang

TL;DR: NeoWorld-3 以可执行程序从视觉观察重建可交互物理世界，支持从单个可动对象扩展到组合场景；重建的数字孪生还在双臂机器人上实现零样本真实操作。

Details

Motivation: 可用于仿真的世界重建不仅要视觉逼真，还要能与物理对象交互；现有黑盒 3D 生成方法往往无法提供这种可执行物理能力。

Result: NeoWorld-3 是代码智能体框架，将视觉观察转化为可调、可执行的世界程序。底层 NeoSDK 支持几何体、部件组合、可微参数细化和物理验证；NeoMCP 则以结构化工具 API 让视觉语言智能体查看场景、编辑代码并迭代程序。分层协调者—工作者架构支持从独立关节物体扩展到复杂组合场景。物体级和场景级重建基准显示几何保真度与物理可用性达到最先进水平；基于重建数字孪生规划的操作轨迹还在真实双臂机器人上零样本执行成功，完成 Real-Sim-Real 闭环。

Insight: 以代码定义重建结果，可让模型不仅生成外观，还能迭代修改可执行几何和物理结构。真实机器人上的零样本操作验证了从视觉观察、仿真孪生到真实执行的链路，但摘要未提供各基准的具体分数或成功率。

Abstract: Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver. We present NeoWorld-3, a coding-agent framework that reconstructs interactive 3D worlds from visual observations via tunable, executable programs. At its core, NeoSDK provides the underlying computational engine for low-level geometries, part composition, differentiable parameter refinement, and physics validation. At the same time, NeoMCP exposes these capabilities as structured, tool-callable APIs for vision-language agents to visually inspect, edit code, and iteratively refine programs. Through a hierarchical coordinator-worker architecture, the framework scales seamlessly from standalone articulated objects to complex compositional scenes. Evaluations across object-level and scene-level reconstruction benchmarks demonstrate that NeoWorld-3 achieves state-of-the-art geometric fidelity and physical readiness. Crucially, manipulation trajectories planned within our reconstructed twins achieve successful zero-shot execution on a physical dual-arm robot, completing the Real-Sim-Real loop.

[77] A Principled Optimal Transport Framework for Frame Selection in Long Video Understanding cs.CVPDF

Ziwei Zhao, Yuhang Liu

TL;DR: OTFS 将长视频帧选择建模为多源证据到帧的半非平衡熵最优传输，再用覆盖感知动态规划提取子集；三个长视频基准上超过强免训练基线。

Details

Motivation: 长视频理解受限于视频长度与多模态模型视觉上下文预算不匹配，因此帧选择至关重要。现有查询感知方法多用启发式帧分数再采样或排序，缺少明确优化目标，也难以分配复杂推理所需的异质证据。

Result: OTFS 将帧选择表述为结构化证据分配问题，把多个证据源映射到视频帧；为体现重要证据应保留、冗余帧无需吸收质量的不对称性，使用半非平衡熵最优传输目标，并设计 OTFS-Sinkhorn 高效求解器。之后通过精确动态规划，以覆盖为目标提取帧子集，构成免训练两阶段流程。单证据源情形下，方法诱导出 Gibbs 型帧分布，使 Q-Frame 的温度缩放分布成为其特例。三个长视频理解基准实验中，OTFS 持续超过强免训练基线。

Insight: 帧选择可视为多类推理证据如何分配到有限视觉预算的优化问题，而不只是给每帧打一个相关度分数。半非平衡传输允许重要证据被保留而冗余帧不必获得同等关注，覆盖感知子集抽取再把分配转成可用帧集。

Abstract: Long-video understanding with multimodal LLMs is fundamentally constrained by the mismatch between video length and the model’s limited visual context budget, making frame selection essential for practical reasoning. Existing query-aware methods typically rely on heuristic pipelines: they assign one-dimensional query-conditioned scores to frames and then apply sampling, ranking, or extraction rules to form the final subset. While effective in practice, such methods are generally not derived from an explicit optimization objective and struggle to capture the heterogeneous evidence required for complex reasoning. In this paper, we revisit long-video frame selection from a principled optimization perspective. We formulate it as a structured evidence-allocation problem and propose OTFS, an optimal transport framework that maps multiple evidence sources onto video frames. To reflect the asymmetry of this problem—important evidence should be preserved, whereas redundant frames need not absorb mass—we instantiate this view with a semi-unbalanced entropic optimal transport objective and an efficient solver, OTFS-Sinkhorn. Combined with an exact dynamic program for coverage-aware subset extraction, OTFS yields a practical two-stage training-free pipeline. We further show that, in the single-source case, our formulation induces a Gibbs-type distribution over frames, making Q-Frame’s temperature-scaled distribution a special case of our framework while also providing a broader perspective for understanding related prior methods. Experiments on three long-video understanding benchmarks show that OTFS consistently outperforms strong training-free baselines. Codes are available at https://github.com/barry664/OTFS.

[78] VLA-Retain: Benchmarking Cross-Dimension Effects of Vision Tuning in VLAs cs.CV | cs.AIPDF

Borui Xu, Han Chen, Bingsheng He, Ming Wu, Jason Zeng

TL;DR: VLA-Retain 检查五种 VLA 视觉微调在七类扰动上的跨维度保留效果，发现目标域收益常不能预测其他条件表现，10 组模型—域配置中有 8 组平均非目标收益为负。

Details

Motivation: 视觉语言动作模型常通过在目标域数据上微调视觉模块改善机器人操作，但这种适配对其他观察条件的鲁棒性影响不清楚。已有基准只测未微调模型，适配研究又通常只报告目标域增益，无法分离迁移、遗忘及模型架构差异。

Result: VLA-Retain 比较五种开放 VLA 模型及其在 Camera-view 或 Sensor-noise 数据上微调后的检查点，在 LIBERO-Plus 七个扰动维度上评测。目标视觉微调并非局部作用：10 个模型—领域配置中，8 个平均非目标增益为负。例如 Camera-view 微调下，X-VLA 目标提升 69.4 个百分点、其他维度平均下降 4.6 点；OpenVLA-OFT 分别提升 39.3 点和 1.4 点。回退不能仅由无扰动任务性能下降解释；更广训练覆盖提高总体收益但未消除维度回退。DELTA 式特征保持使 X-VLA 非目标均值升至 +1.2 点，却使 OpenVLA-OFT 降至 −23.1 点，显示策略依模型而异。

Insight: 目标域单点成功不能代表视觉适配后的整体鲁棒性；必须同时量化目标收益与各非目标扰动维度的保留情况。即使采用更广数据或特征保持策略，不同模型的跨维度响应也可能相反，因此微调策略需要按模型和扰动维度评估。

Abstract: Vision-language-action (VLA) models transfer knowledge from large-scale pretraining into robot control, but their manipulation performance remains sensitive to changes in observation conditions, which recent work addresses by fine-tuning the visual module on target-domain data. However, it remains unclear how such adaptation affects robustness beyond the target condition, as existing robustness benchmarks only evaluate models without fine-tuning and adaptation studies only report the target gain. Measuring this cross-dimension effect requires separating target gains from off-target changes, isolating adaptation effects from architectural differences, ruling out generic forgetting, and comparing tuning choices. Therefore, we introduce VLA-Retain, a benchmark that compares five open VLA models, tuned on Camera-view or Sensor-noise data, with their own base checkpoints on LIBERO-Plus dataset spanning seven perturbation dimensions. Our study reveals four findings. First, targeted vision tuning is not local, and its target gain does not predict retention. Mean off-target gain is negative in 8 of 10 model–domain configurations. Under Camera-view tuning, X-VLA gains $69.4$ percentage points on the target but loses $4.6$ points on average elsewhere, whereas OpenVLA-OFT gains $39.3$ and $1.4$ points, respectively. Second, these regressions are not explained only by performance loss on the same tasks without perturbations. Third, broader training coverage raises overall gain over target-specific training but does not eliminate dimension-level regressions. Fourth, tuning strategies are model-dependent, as DELTA-style feature preservation raises X-VLA’s mean off-target gain to $+1.2$ points but lowers OpenVLA-OFT’s to $-23.1$. Overall, these findings show that target-domain success alone is insufficient and highlight cross-dimensional retention as a key criterion for targeted VLA adaptation.

[79] Geometry Regularization for Vanilla NeRF via Self-Supervised Cross-Ray Consistency cs.CV | cs.GRPDF

Zongji Wang

TL;DR: 该方法在 vanilla NeRF 上增加基于跨射线一致性的自监督几何优化分支，不依赖深度或法线真值；在 Replica 八个场景上将平均 Chamfer 距离降低 30.8%。

Details

Motivation: NeRF 用连续体辐射场实现高质量新视角合成，但密度场所隐含的几何可能有噪声或不准确，因为不同形状与辐射组合都能解释相同输入图像。

Result: 作者为标准 NeRF 增加自监督跨射线一致性几何分支：从密度场采样候选表面点，从不同方向生成相交于该点的虚拟射线，并用 NeRF 渲染其外观；依据可见性加权的跨射线颜色一致性约束隐式几何。方法还惩罚外观预测不一致候选点的 opacity，并鼓励局部法线平滑。约束由 NeRF 自身预测得到，不需要深度或表面法线真值。在 Replica 八个场景上，平均 Chamfer 距离较 vanilla NeRF 降低 30.8%。

Insight: 多视线观测对同一表面位置的外观应保持一致，可作为无需几何标注的自监督约束。颜色一致性、透明度惩罚和局部法线平滑共同减少密度场的几何歧义，且在八个 Replica 场景上改善了几何距离指标。

Abstract: Neural Radiance Fields (NeRF) achieve high-quality novel-view synthesis by representing a scene as a continuous volumetric radiance field. However, the geometry encoded by the density field of vanilla NeRF can be noisy and inaccurate, since different combinations of shape and radiance may explain the same input images. To reduce this ambiguity, we augment vanilla NeRF with a geometry-optimization branch based on self-supervised cross-ray consistency. Specifically, this branch samples candidate surface points from the density field, generates virtual rays that intersect at each point from different directions, and renders their appearance using the NeRF network. Based on the visibility-weighted color consistency across these rays, we constrain the implicit geometry. We further regularize the implicit geometry by penalizing opacity at candidates with inconsistent appearance predictions and encouraging local normal smoothness. These geometric constraints are derived from the NeRF predictions and require no ground-truth depth or surface-normal supervision. Experiments on eight Replica scenes show that the proposed method reduces the mean Chamfer distance by 30.8% compared with vanilla NeRF.

[80] RoboJudge: Multimodal Language Models as Judges for Embodied Video Generation cs.CV | cs.ROPDF

Siyuan Ma, Yu Qi, Cheng Ye, Ruotian Peng, Xinyi Xu

TL;DR: RoboJudge-Bench 评测多模态模型对具身视频生成的物理合理性和指令对齐判断；基于 1.2 万条训练视频微调的 RoboJudge-9B 与人工评分相关性达 0.719。

Details

Motivation: 具身视频生成模型要成为可靠世界模型，生成轨迹必须符合物理规律并遵循任务指令。多模态大模型虽常用于评判这些性质，但其判断与人类评价的一致性此前缺少系统评估。

Result: RoboJudge-Bench 以 8 个来源语料、10 个视频生成器的 800 段人工标注视频，评测物理遵循度和指令对齐，涵盖夹爪、人手和灵巧手。通用 MLLM 对物理遵循度的人类一致性较低，为通用物理推理设计的视频评审也不能稳定迁移到具身场景。作者构建 RoboJudge-Train，含 12,000 段视频、25,000 个经人工核验的分数及模型辅助理由；对 9B MLLM 先监督微调再强化学习。RoboJudge-9B 在基准评审模型中总体一致性最高，与人类 Pearson 相关系数为 0.719，较评测中最佳专有基线 Gemini-3.7-Flash 显著高 0.089；在 VideoPhy2、Physion-Eval 等外部基准也有提升。

Insight: 物理遵循和指令对齐是具身视频评估的不同维度，通用视频评审分数不能直接替代人类判断。针对具身视频标注训练后，评审器可改善与人工评价的一致性，并用于比较视频生成模型在这两类属性上的表现。

Abstract: Video generation models are promising foundations for embodied world models, but only if their generated rollouts are physically valid and faithful to task instructions. Multimodal large language models (MLLMs) are increasingly used to judge these properties, yet their agreement with human judgments on embodied videos has not been systematically evaluated. To address this gap, we introduce RoboJudge-Bench, a benchmark for evaluating MLLMs as judges of embodied video generation. The benchmark measures two fundamental dimensions, Physical Adherence and Instruction Alignment, across 800 human-annotated videos from 8 source corpora and 10 video generators, spanning grippers, human hands, and dexterous hands. Experiments reveal uneven alignment between existing judges and human ratings: general-purpose MLLMs show lower agreement on physical adherence, while specialized video judges designed for general-domain physical reasoning do not consistently transfer to embodied scenarios. Motivated by these findings, we construct RoboJudge-Train, comprising 12K videos annotated with 25K human-verified scores and model-assisted rationales for Physical Adherence and Instruction Alignment. We fine-tune a 9B MLLM on this dataset with supervised learning followed by reinforcement learning, yielding RoboJudge-9B. Among the model judges evaluated on RoboJudge-Bench, RoboJudge-9B achieves the highest overall agreement, reaching a Pearson correlation of 0.719 with a statistically significant 0.089 gain over Gemini-3.7-Flash, the best-performing proprietary baseline in our evaluation. Training on RoboJudge-Train also yields gains on external benchmarks, including VideoPhy2 and Physion-Eval. We further use RoboJudge-9B as a downstream evaluator to benchmark video generation models according to Physical Adherence and Instruction Alignment.

[81] Decoupled Representation Learning for Face Presentation Attack Detection under Smart Glass Capture cs.CVPDF

Raghavendra Ramachandra, Narayan Vetrekar, Neha Naik, Rajendra Gad

TL;DR: SmaGla-FPAD 建立 29.7 万张智能眼镜采集的人脸呈现攻击数据集，并提出解耦攻击证据与采集风格的 DeCoupPAD-FAS++，在域内及跨场景测试中平衡攻击拒绝和真人接受。

Details

Motivation: 人脸呈现攻击检测通常在固定摄像头或手持设备下研究。智能眼镜采集带来明显自运动、视角变化、背景干扰、距离变化和不受控光照，使采集变化与攻击证据更难区分。

Result: 研究使用 Ray-Ban Meta Wayfarer 智能眼镜构建 SmaGla-FPAD，覆盖室内、室外和车内，包含 297,000 张真人与硅胶面具攻击图像。DeCoupPAD-FAS++ 通过互补的攻击分支与风格分支、伪域监督、对抗抑制和提示引导语义对齐，将欺骗相关证据与对采集变化敏感的因素分离。在该数据集的域内和跨场景评测中，方法在攻击拒绝与真人接受之间取得最佳平衡；消融实验支持解耦、伪域监督和提示正则化在智能眼镜场景中的作用。

Insight: 智能眼镜的视角、背景和光照变化容易成为攻击检测的干扰因素；将攻击特征与采集风格解耦有助于跨场景稳健性。数据集覆盖三类环境和两类身份状态，但摘要未给出具体错误率或分数。

Abstract: Face presentation attack detection is typically studied under fixed camera or handheld acquisition, whereas smart glass capture introduces a more challenging setting with ego motion, changing viewpoint, background clutter, distance variation, and less controlled illumination. To address this challenge, we present \emph{SmaGla-FPAD}, a smart glass based face presentation attack database acquired using Ray-Ban Meta Wayfarer Smart Glasses across indoor, outdoor, and in-car settings. The database contains 297,000 sample images with both bona fide and silicone mask based attacks. We further propose \emph{DeCoupPAD-FAS++}, a decoupled representation learning framework that separates spoof related evidence from nuisance sensitive capture variation through complementary attack and style branches, pseudo-domain supervision, adversarial suppression, and prompt guided semantic alignment. Experiments on SmaGla-FPAD show that the proposed method achieves the best balance between attack rejection and bona fide acceptance in both in domain and cross scenario evaluation. Ablation results further confirm the contribution of disentanglement, pseudo-domain supervision, and prompt based regularisation under smart glass capture.

[82] GARRET: Generative Feedback for Region Retrieval in Visual Documents cs.CV | cs.IRPDF

Weijian Jian, Siyang Chen, Yuguang Yang, Yajun Zhang, Chunyu Xie

TL;DR: GARRET 用可微生成反馈从页面—问题—答案三元组学习细粒度视觉文档区域检索，无需查询—区域标注；在 200,682 区域基准上 macro nDCG@10 达 0.4126。

Details

Motivation: 视觉文档检索增强生成需要定位到页内证据区域，而非只返回整页。现有检索器多索引或返回整页；训练区域级检索器则常需昂贵的查询—区域人工标注，或依赖噪声较大的模型生成标签。

Result: GARRET 仅用页面、问题、答案三元组，通过可微生成反馈训练区域检索。共享且保留上下文的检索器生成页面和区域多向量表示；区域分数形成候选裁剪图的软路由分布。辅助 VLM 分别读取各裁剪区域，按路由权重聚合上下文，再以逐 token 目标预测问题和答案；梯度由此把查询条件化的信用分配给区域表示，无需查询—区域标注。推理时移除辅助模型，并结合上下文化区域表示与页面摘要 token 构造紧凑页面表示。作者提出 ViDoRe-V3-Region，含八个领域、200,682 个固定候选区域；GARRET macro nDCG@10 为 0.4126，比最强视觉基线高 2.94 点。页面检索上与 ColQwen2.5-v0.2 相当，每页索引向量少 47.8%。

Insight: 生成答案的可微反馈可以作为区域相关性监督，让模型从页面—问题—答案数据中学会定位证据，而不需人工标注具体区域。辅助生成器只用于训练，推理时可移除；同一上下文区域表征还能支持页面级检索并降低索引量。

Abstract: Multimodal retrieval-augmented generation over visually rich documents requires evidence at a finer granularity than entire pages. Existing visual retrievers typically index or return full pages, whereas training region-level retrievers often requires costly query-to-region annotations or noisy model-generated labels. We introduce GARRET, a region-retrieval framework trained from (page, question, answer) triplets through differentiable generative feedback. A shared context-preserving retriever produces page and region multi-vector representations. During training, their retrieval scores define a soft routing distribution over candidate region crops. An auxiliary vision-language model attends to each crop separately, aggregates crop-specific contexts using the routing weights, and predicts the question followed by the answer under a next-token prediction objective. Gradients through the routing distribution assign query-conditioned credit to the indexed region representations, without requiring query-to-region annotations. At inference, the auxiliary model is removed. GARRET also reuses the contextualized region representations, together with page summary tokens, to construct a compact page representation. We introduce ViDoRe-V3-Region, a corpus-wide benchmark containing 200,682 fixed candidate regions across eight domains. GARRET achieves a macro nDCG@10 of 0.4126, outperforming the strongest visual baseline by 2.94 points. On page retrieval, it remains comparable to ColQwen2.5-v0.2 while indexing 47.8% fewer vectors per page.

[83] LaLa-World: Scaling Latent World Models with Natural Language Actions cs.CV | cs.LGPDF

Junha Song, Geonmo Gu, Jeongeun Park, Heejeong Nam, Lucas Maes

TL;DR: LaLa-World 用自然语言统一描述数值动作和视觉变化，在仿真、机器人轨迹及图像视频数据上训练共享潜在世界模型；匹配视频生成基线时训练成本低 6 倍、规划快 13.9 倍。

Details

Motivation: JEPA 式潜在世界模型希望在想象中预测未来并辅助规划，但跨领域训练往往各自为不同任务训练模型。视频生成模型的语言条件接口为统一异构动作与视觉数据提供了可能。

Result: LaLa-World 是语言条件潜在世界模型，将数值动作和视觉变化都转成语言描述，使单一未来状态预测器能联合利用仿真与机器人轨迹以及更广泛的图像、视频数据；预测器基于语言模型构建，以理解语言条件并预测未来潜在状态。它的平均 MPC 规划性能高于按域或任务分别训练的现有潜在世界模型；加入图像和视频数据还能提升平均规划表现及对动作措辞变化的鲁棒性。与训练条件匹配的 RAEv2 视频生成基线相比，规划表现相当，但训练成本低 6 倍、规划速度快 13.9 倍。预训练模型初始化的 LaLa-Policy 在 LIBERO 和 RoboCasa 上可与 Cosmos Policy 竞争，推理最高快 5.5 倍。

Insight: 语言条件接口让来自仿真、机器人、图像和视频的异构数据能共同训练世界模型；更多视觉数据也有助于抵抗动作表达差异。该表示还可迁移为联合预测动作和未来视觉状态的策略，兼顾规划质量与速度。

Abstract: This paper shows that JEPA-style latent world models (LWMs) can learn across diverse domains and data sources by adopting the language-conditioned interface of video generation models. We establish this approach as an effective and efficient basis for planning with imagination and downstream policy fine-tuning. To this end, we introduce LaLa-World, a Language-conditioned Latent World model that learns from simulation and robot trajectories together with broader image and video data. Two designs make this work. First, we describe both numerical actions and visual changes in language, enabling joint training of a single future predictor across heterogeneous datasets. Second, we build the predictor on a language model, allowing it to interpret language conditions while predicting future latent states. The resulting predictor achieves higher average MPC planning performance than existing LWMs trained separately for each domain or task. Adding image and video data further improves average planning performance and robustness to action phrasing. In a matched comparison with an RAEv2-based video generation model baseline, LaLa-World reaches comparable planning performance with $6\times$ less training cost and $13.9\times$ faster planning. Beyond planning, the pretrained LaLa-World serves as an initialization for LaLa-Policy, which jointly predicts actions and future visual representations. LaLa-Policy performs competitively with Cosmos Policy on LIBERO and RoboCasa, with up to $5.5\times$ faster inference.

[84] Gaze2HOI: Gaze-Aware Intention Disambiguation for Egocentric Hand-Object Interaction Forecasting cs.CVPDF

Chuanyang Ma, Chenye Wang, Yixuan Wang, Huiling Zhou, Xingqun Qi

TL;DR: Gaze2HOI 将第一人称手物交互预测分解为意图识别、接触定位和手物联合运动生成，用注视线索消歧并显式建模接触几何；在 EgoAIM 上达到最先进意图和运动预测表现。

Details

Motivation: AR、VR 和具身系统希望预判用户下一步如何与环境交互，但相似的历史观察可能对应语义或几何上不同的未来。既有方法通常直接从观察预测手物交互，把意图和接触几何留作隐变量；注视行为可提供较早的意图线索。

Result: Gaze2HOI 按层次处理交互预测：先按注视强度和近期性加权 gaze 线索，通过时间注视显著性调制模块影响 VLM 视觉表示，降低意图歧义；再由预期接触定位模块将意图转为接触、支撑和放置场；最后用扩散模型在这些条件下联合生成物体六自由度轨迹及双手未来关节运动。作者提出 EgoAIM 阶段感知基准，依据手物关系变化分为四个阶段并提供细粒度意图标注。实验中意图推断和运动预测均达最先进表现，特定交互阶段的端到端效果接近 oracle。

Insight: 显式利用注视可提前消除“想做什么”的语义歧义，再将意图落到接触、支撑和放置几何，减少后续运动生成的不确定性。分层建模把意图推断与几何接触条件结合，阶段化基准也能揭示不同交互阶段的预测难点。

Abstract: Anticipating how users will interact with their surroundings is essential for proactive systems that provide timely assistance in AR, VR, and embodied applications. Prior work typically forecasts hand-object interactions directly from historical observations, leaving intention and contact geometry implicit. However, similar observation histories can precede semantically or geometrically distinct futures. Inspired by behavioral evidence that gaze can provide early cues for underlying intention, we propose Gaze2HOI, a gaze-aware framework that formulates hand-object interaction forecasting as a hierarchical problem comprising intention inference, contact grounding, and coupled hand-object motion generation. Specifically, Gaze2HOI first weights gaze cues by fixation strength and recency, and uses them to modulate the visual representations of a vision-language model (VLM) through Temporal Gaze Saliency Modulation (TGSM), thereby reducing semantic ambiguity in intention inference. Subsequently, an Anticipatory Contact Grounding (ACG) module maps these structured intentions into explicit contact, support, and placement fields, effectively mitigating geometric ambiguity. Driven by these explicit conditions, a diffusion-based model jointly generates the 6-DoF object trajectories and future articulated motion of both hands. To evaluate Gaze2HOI, we further introduce EgoAIM, a phase-aware benchmark that organizes egocentric hand-object interactions into four phases defined by evolving hand-object relations and provides fine-grained intention annotations. Extensive experiments demonstrate that Gaze2HOI achieves state-of-the-art performance in both intention inference and motion forecasting, even approaching oracle-level end-to-end performance in specific interaction phases. Project page: https://gaze2hoi.github.io/.

[85] SGLDet: Spectral-aware Global-Local Dynamic Modeling for Multispectral Aerial Object Detection cs.CVPDF

Peng Zhang, Shuaihao Han, Tingfa Xu, Jianan Li

TL;DR: SGLDet 以光谱相似性建模全局特征、构建场景上下文记忆，并按输入光谱与空间属性动态调制局部特征；在 MODA、HOD3K、DroneVehicle 上实现有竞争力的多光谱航拍检测。

Details

Motivation: 多光谱航拍检测可利用光谱和空间线索，但大范围场景造成前景—背景严重不平衡，影响目标识别；航拍目标的尺度、朝向和结构变化也使定位困难。

Result: SGLDet 包含三个协同组件：光谱驱动全局动态建模以相似度引导稀疏匹配，在全场景聚合光谱相关特征；多尺度全局上下文整合模块构建紧凑场景记忆，支持上下文推理；光谱感知输入依赖校准聚合模块则执行专家核聚合，并通过场景引导的光谱—空间校准动态调制局部特征。在 MODA、HOD3K 和 DroneVehicle 上的实验显示检测表现优于对比方法，同时保持有竞争力的计算成本；摘要未给出具体指标数值。

Insight: 多光谱目标语义依赖全局光谱一致性和场景上下文，而精确定位还需要按当前局部光谱、空间特征动态调整。全局场景记忆与输入条件化局部专家调制分别应对类别辨识和几何变化，形成互补。

Abstract: Multispectral aerial object detection aims to exploit spectral-spatial cues to address object detection challenges in complex aerial scenes. Existing methods mainly focus on spectral-spatial decoupling and object-aware spectral-spatial fusion to improve spectral utilization. However, two critical issues remain underexplored: 1) severe foreground-background imbalance caused by large scene coverage hinders reliable object recognition; 2) aerial objects exhibit substantial local variations in scale, orientation, and structure, which hinder accurate localization. To address these issues, we propose SGLDet, a spectral-aware global-local dynamic modeling framework for multispectral aerial object detection, which is motivated by the observation that object semantics are jointly determined by global spectral consistency and scene context, while precise localization requires dynamic feature modulation conditioned on the input spectral and spatial properties. To realize these properties, SGLDet consists of three coordinated components: a Spectral-driven Global Dynamic Modeling module that aggregates spectrally related features across the scene via similarity-guided sparse matching; a Multi-scale Global Context Integration module that constructs a compact scene memory for scene-guided contextual reasoning; and a Spectral-aware Input-dependent Calibration Aggregation module that performs expert-kernel aggregation with scene-guided spectral-spatial calibration to enable adaptive local feature modulation. Extensive experiments on MODA, HOD3K, and DroneVehicle demonstrate that SGLDet achieves superior performance with competitive computational cost. Code is available at https://github.com/Riiluo/SGLDet.

[86] EndoWorld-JEPA: Motion-Guided Global-Local Latent World Modeling for Endoscopic Video Representation Learning cs.CVPDF

Jie Wang, Shilong Yang, Tao Zhou, Juan Yu, Rong Qu

TL;DR: EndoWorld-JEPA 用当前视频中观测到的光流而非动作标签或机器人位姿，指导内窥镜视频的全局—局部潜在状态预测；同一预训练检查点在四个下游基准上展现迁移能力。

Details

Motivation: 内窥镜视频中的状态变化来自相机移动、可变形组织和器械交互，但现有预训练方法往往隐式处理动态。光流同时含有共享的图像平面位移和局部残差运动，可作为被动视频预训练的因果运动条件。

Result: EndoWorld-JEPA 将被动内窥镜预训练重新表述为因果、运动引导的潜在状态预测，无需记录动作、标定位姿或机器人运动学，而是用截至当前时刻观察到的运动条件化下一潜在状态。光学运动模块分离主导位移与残差运动，形成有序时间运动条件及局部运动权重；全局和运动局部预测器共同使用这些信号，局部权重构造辅助局部状态并从场景演化扩展到选择性空间动态预测。逐 patch 运动加权聚焦局部变化，同时保留解剖上下文；过去运动窗口 dropout 则降低对不可靠运动条件的依赖。一个共享预训练检查点在四个下游基准上表现出较强迁移。

Insight: 内窥镜视频不一定有显式动作或机器人状态标注，视觉运动本身仍可监督潜在动态。把场景级演化与局部变化结合，并随机屏蔽运动条件，可在利用光流信息的同时降低对噪声运动估计的过度依赖。

Abstract: Endoscopic video contains state transitions induced by camera displacement, deformable tissue, and instrument interaction, yet existing pre-training methods treat dynamics implicitly. Inspired by action-conditioned joint-embedding predictive world models and by the observation that endoscopic optical flow contains both shared image-plane displacement and localized residual motion, we reformulate passive endoscopic video pre-training as causal motion-guided latent-state prediction. We present EndoWorld-JEPA, to our knowledge the first latent world-model pre-training framework designed for general-purpose endoscopic video representation learning. In place of recorded actions, calibrated poses, or robot kinematics, the model conditions prediction of the next latent state on motion observed up to the current state. Its Optical Motion-guided module separates dominant displacement from residual motion and converts the resulting evidence into an ordered temporal motion condition and spatial local-motion weights. Complementary global and motion-local predictors use these outputs: the temporal condition modulates both latent transitions, whereas the local weights define an auxiliary motion-local state that extends prediction from scene-level evolution to spatially selective dynamics. Patch-wise motion weighting emphasizes localized change while retaining anatomical context, and past-motion-window dropout randomly withholds the complete motion condition to reduce dependence on unreliable motion. This global–local formulation learns predictable visual–motion dynamics in representation space without reconstructing stochastic appearance artifacts. Evaluation shows that a common pre-trained checkpoint achieves strong transfer across four downstream benchmarks, supporting motion-guided global–local latent prediction as an effective pre-training paradigm for endoscopic video.

[87] In PRAISE of Attributes: Grounding Retrieval Geometry with Query-Conditioned Subspaces for Person Re-Identification cs.CVPDF

Rajarshi Bhattacharya, Aryan Shukla, Shakeeb Murtaza, Christian Desrosiers, Jose Dolz

TL;DR: PRAISE 从可迁移属性提示构造查询条件低秩子空间，以重塑 VLM 行人重识别的查询—图库相似度并进行轻量测试时更新；在多个人像检索基准上持续改善骨干模型。

Details

Motivation: 行人重识别需按图像或文本查询排序图库。视角、光照、遮挡和背景变化会干扰图像检索；文本描述又可能不完整或含糊。衣着颜色、随身物品等属性可提供细粒度线索，但直接将模板属性提示的相似度当检索分数，容易受到提示偏差、相关性和校准问题影响。

Result: PRAISE 是 VLM 重识别的查询侧测试时适配方法。它不把属性提示直接作为分数，而用可迁移属性提示库中与当前查询最匹配的提示构造属性条件子空间（ACS），形成查询依赖的低秩几何，用于调整查询—图库亲和度并引导轻量推理时更新；无需身份或属性标签。在多个图像到图像与文本到图像重识别基准上，PRAISE 持续提升 VLM 检索骨干表现，并超过通用及重识别专用的测试时适配基线。

Insight: 属性提示更适合作为调整检索几何的条件，而非未经校准的独立相似度分数。根据当前查询选择属性并构造子空间，可在无身份标签下细化匹配关系，避免模板提示偏差直接主导排序。

Abstract: Person re-identification (ReID) ranks an image gallery using either an image query or a textual query. In image-to-image (I2I) ReID, viewpoint, illumination, occlusion, and background changes can make distractors appear more similar than the true match. In text-to-image (T2I) ReID, incomplete or ambiguous descriptions may omit key visual evidence. We study this problem for vision-language model (VLM) based ReID, where attributes such as clothing color and carried objects provide useful fine-grained matching cues. However, directly using attribute-prompt similarities as retrieval scores is unreliable because templated prompts can be biased, correlated, and poorly calibrated. We therefore propose \textbf{PR}ompt-guided \textbf{A}ttribute-based \textbf{I}nference-time \textbf{S}imilarity \textbf{E}nhancement (\texttt{PRAISE}), a query-side test-time adaptation framework for VLM-based ReID. Instead of treating prompts as scores, \texttt{PRAISE} uses a transferable attribute-prompt bank to construct an \emph{Attribute-Conditioned Subspace} (ACS): a query-dependent low-rank subspace induced by the most compatible attribute prompts. ACS provides a controlled attribute-conditioned geometry for reshaping query–gallery affinities and guiding lightweight inference-time updates without identity or attribute labels. Experiments across multiple I2I- and T2I-ReID benchmarks show that \texttt{PRAISE} consistently improves VLM retrieval backbones and outperforms both generic and ReID-specific TTA baselines.

[88] Decoupling Action from Egocentric Observation for World Simulation cs.CVPDF

Yue Ma, Pengjie Song, Xinyu Wang, Yi He, Zeqian Long

TL;DR: EgoACT 直接在视频扩散去噪过程中迁移第一人称动作，以早期结构锚定和中后期稀疏对应校准保留手物关系；在 EgoActionBench 上生成更连贯、物理合理的交互视频。

Details

Motivation: 第一人称动作迁移要从观察视频中分离动作语义，并在新视觉场景中重现。基于几何控制的方法需估计手姿或网格，误差会破坏物理合理交互；只提取运动模式又难表达丰富接触动态，容易出现手部结构崩坏和接触布局不合理。

Result: EgoACT 是测试时框架，直接作用于视频扩散模型去噪过程，无需额外几何估计器。速度引导结构锚定在去噪早期稳定与参考一致的手—物结构；稀疏对应校准则在中后期细化可靠局部对应。二者共同保留可迁移动作语义并改善时间连贯性和交互真实感。作者建立 EgoActionBench，在多样第一人称操作场景下评估动作保留、视觉质量和手物合理性；实验显示 EgoACT 生成的视频比强基线更连贯且物理上更可信。

Insight: 动作迁移需要同时保持动作语义、手部结构和接触关系；单独几何估计或运动特征都可能遗漏其中一部分。按扩散去噪阶段分别稳定全局结构并细化局部对应，可以在无需额外几何网络的情况下改善交互真实感。

Abstract: Egocentric action transfer aims to decouple the semantic action from egocentric observations and reproduce them in new visual contexts, enabling scalable world simulation, embodied policy learning, and robotic data generation. Existing approaches to transferring actions rely on condition-guided video generation, which converts the observation video into explicit geometric controls (e.g., hand poses or meshes) to drive synthesis. However, these methods introduce geometric estimation errors, making it difficult to preserve physically plausible interactions when transferred to new scenes. Alternatively, motion transfer methods directly extract motion patterns from the observation video, yet motion-level features alone cannot encode rich contact dynamics, frequently leading to severe hand structural collapse and implausible contact layout. To address both limitations, we present EgoACT, a test-time framework for egocentric action transfer that operates directly on the denoising process of video diffusion models without requiring additional geometric estimators. EgoACT uses Velocity-guided Structure Anchoring to stabilize reference-consistent hand-object structure in the early denoising stage, and Sparse Correspondence Calibration to refine reliable local correspondences in the mid-to-late denoising stages. Together, these two components preserve transferable action semantics while improving temporal coherence and interaction realism. We further establish EgoActionBench, a benchmark for evaluating action preservation, visual quality, and hand-object plausibility across diverse egocentric manipulation scenarios. Experiments show that EgoACT generates more coherent and physically plausible interaction videos than strong baselines.

[89] Edit in Sync: Unified End-to-End Audio-Visual Editing for Human-Centric Videos cs.CVPDF

Ziye Yuan, Minghong Cai, Xu He, Ruchang Yao, Xiao Fu

TL;DR: AVE 将参考引导的人物替换、插入和删除统一为端到端音视频编辑，不需空间掩码；新建含 10 万对的 AVE-Dataset，方法在真实感、时间一致性和视听对齐上优于分离式流程。

Details

Motivation: 以人物为中心的音视频编辑需精确同步口型、手势、表情和语音。现有方法常把视频编辑与音频配音放入独立流程，缺乏跨模态交互，且依赖掩码修复，因此容易出现口型与音频不同步、级联误差以及掩码尺寸两难。

Result: AVE 是统一端到端框架，可根据参考对音频和视频同时执行人物替换、插入与删除，不需要空间掩码。为缓解数据不足，作者设计合成流程并构建 AVE-Dataset，包含 100,000 对带外观与声音参考的样本。合成到真实重建和音频预热结合，以突破合成流程限制并缓解音视频 token 不平衡。实验显示，AVE 在编辑真实感、时间一致性和视听对齐方面优于模态分离的音视频编辑流水线。

Insight: 联合编辑可以让视觉人物变化与配音共享同一生成流程，减少独立流水线带来的同步误差和级联问题。无需掩码也避免了区域大小选择的限制；合成数据与真实重建策略用于应对训练数据和合成域差。

Abstract: Human-centric audio-visual editing requires precise alignment of lip movements, gestures, and expressions with speech. Existing methods process inputs through independent video and audio pipelines, preventing cross-modal interaction between visual editing and audio dubbing. Many of these pipelines further rely on mask-based inpainting. As a result, they suffer from poor lip-audio synchronization, cumulative pipeline errors, and an inherent mask-size dilemma. We present AVE, the first unified end-to-end framework that jointly performs reference-guided person swapping, insertion, and deletion across both audio and video modalities without requiring spatial masks. To overcome data scarcity, we design a synthesis pipeline and introduce AVE-Dataset, the first audio-visual editing dataset to provide 100K pairs with appearance and voice references. By combining Synthetic-to-Real reconstruction with preliminary audio warm-up, our framework transcends synthetic pipeline limits and mitigates audio-video token imbalance. AVE outperforms modality-separate audio-visual editing pipelines in editing realism, temporal consistency, and audio-visual alignment.

[90] Media Intelligence Platform: Multimodal Detection of Synthetic and Manipulated Content cs.CV | cs.MMPDF

David Fischinger, Marcel Hasenbalg, Silvia Poletti, Davide Antonutti, Mina Schütz

TL;DR: Media Intelligence Platform 将假视频、人脸变形、AI 图像、音频深伪、局部图像篡改和文本分析整合为模块化取证平台，并在代表性基准上展示多媒体检测能力。

Details

Motivation: 生成式 AI 推动了合成脸、伪造视频、AI 图像、假音频和局部篡改图像等多种媒体伪造内容增长。多数检测方法只针对一种篡改类型，难以应对真实取证中来源和模态各异的媒体。

Result: Media Intelligence Platform（MIP）是统一的网页多模态媒体取证框架，集成假视频检测、人脸变形检测、AI 生成图像检测、音频深伪检测、局部图像篡改检测和文本分析模块。模块化架构支持组合异构模型并扩展到新型伪造技术。代表性基准实验表明平台在多个媒体模态上具有可靠检测表现，并提供面向取证调查的实用界面；论文随 workshop 投稿发布公开演示系统以支持复现和社区评测。

Insight: 真实取证需在一个流程中处理多种媒体和篡改类型；模块化平台让专门检测器能够协同使用并可逐步扩展。摘要强调系统整合和演示用途，但没有提供各模块的具体定量结果。

Abstract: The rapid progress of generative artificial intelligence has led to a significant increase in manipulated multimedia content, including synthetic faces, forged videos, AI-generated images, fake audio, and locally edited images. Existing detection approaches are typically designed for a single manipulation type, limiting their applicability in real-world scenarios involving heterogeneous media sources. In this work, we present the Media Intelligence Platform (MIP), a unified web-based framework for multimodal media forensics integrating specialized modules for fake video detection, face morphing detection, AI-generated image detection, audio deepfake detection, localized image manipulation detection, and text analysis. Its modular architecture enables flexible integration of heterogeneous models and supports future extensions for emerging manipulation techniques. Experimental results on representative benchmark datasets demonstrate reliable detection performance across multiple media modalities while providing a practical and user-friendly interface for forensic investigations. The platform highlights the potential of unified multimodal systems for comprehensive deepfake detection in real-world environments, and is accompanied by a public demonstrator released with this workshop submission to support reproducibility and community evaluation.

[91] Beyond the Frame: Redundancy, Not Trajectory, Carries the Privacy Leak in Video Unlearning cs.CVPDF

Kavyansh Tyagi, Paolo Russo

TL;DR: 视频分割遗忘评测若逐帧检查会低估泄漏：攻击者平均两秒片段的输出即可恢复被遗忘类别。PACE 直接抑制跨帧冗余，在 VSPW 和 Virtual KITTI 2 降低攻击 AP，同时保留可用分割性能。

Details

Motivation: 视频分割中的类别遗忘要求部署模型输出无法重构已删除类别。现有泄漏评测逐帧检查，可能忽略多帧输出聚合后暴露的信号，甚至在单帧预测看似与从头训练模型一致时仍存在恢复风险。

Result: 研究显示，在 VSPW 及多数 Virtual KITTI 2 方法中，攻击者对两秒片段输出场进行平均即可恢复被遗忘类别；时间打乱控制仍保留泄漏，说明信号主要来自跨帧冗余而非物体轨迹。作者提出 PACE，以严格置换不变的池化对抗判别器和双向时间一致性目标直接抑制冗余。在 VSPW 上，池化攻击者对 person 和 car 的 AP 分别降至 18.79 和 12.10；Virtual KITTI 2 上 car 为 9.11。后者在保留可用效用且通过判定安全的方案中抑制最强；VSPW car 的 mIoU 保持 19.8，而达到相似遗忘效果的基线最高仅 8.3。

Insight: 逐帧看不出明显差异，并不代表视频级信息已被遗忘；跨帧冗余可在时间聚合后泄露类别线索。评估需使用时序攻击者，遗忘方法也应针对输出冗余进行优化，并同时报告删除效果与剩余任务效用。

Abstract: Class unlearning for video segmentation aims to ensure that a removed category cannot be reconstructed from a deployed model’s outputs. Current leakage evaluation algorithms inspect one frame at a time, and we show that this understates leakage by a wide margin: an attacker that averages a model’s output field over a two-second clip recovers the forgotten class from every method we evaluate on VSPW and most on Virtual KITTI2, including models whose per-frame predictions are visually indistinguishable from a retrain oracle (a model trained from scratch without the forgotten class). We attribute the recoverable signal to cross-frame redundancy rather than object trajectory, establish this with a time-shuffled control that leaves leakage intact, and introduce PACE, an unlearning method that suppresses redundancy directly using an exactly permutation-invariant pooled adversarial discriminator and a two-sided temporal consistency objective. Across VSPW and Virtual KITTI2, PACE lowers pooled attacker AP to $18.79$ (\texttt{person}) and $12.10$ (\texttt{car}) on VSPW and $9.11$ (\texttt{car}) on Virtual KITTI~2, achieving on the latter the strongest suppression among verdict-safe methods retaining usable utility, while retaining $19.8$ mIoU on VSPW \texttt{car} against at most $8.3$ for any baseline achieving comparable erasure.

[92] Recast the Past: Stable Long Video Generation with Full Context Memory cs.CV | cs.AIPDF

Yukuo Ma, Cong Liu, Junke Wang, Junqi Liu, Haibin Huang

TL;DR: ReCam 将完整历史视频潜变量按局部时空块压缩成可被 DiT 注意力访问的记忆 token，并用双指针去噪减轻自回归时间漂移；VBench-Long 总分 80.1，离屏主体重现一致性指标均领先。

Details

Motivation: 长时视频生成要保留不断增长的历史，但直接使用整段 token 序列成本高；限制或压缩历史上下文又可能丢失未来生成所需信息。自回归展开还容易累积时间漂移。

Result: ReCam 把历史潜变量的局部时空块分组成向量，直接映射到扩散 Transformer 的高维隐藏空间，形成数量较少的记忆 token。模型通过原生自注意力使用这些 token，降低 token 数同时保留对完整历史各块的访问。为缓解漂移，作者提出双指针去噪，为近期上下文和目标帧设置不同噪声日程。在评估方法中，ReCam 的 VBench-Long 总分最高，为 80.1；在 R2M-Bench 静态场景重访上有竞争力，并在主体离屏后重现的四项一致性指标全部领先，其中服装一致性 4.09，最佳基线为 3.03。

Insight: 长视频记忆需要同时控制序列长度和保留历史访问能力；按时空块形成记忆 token 可以压缩表示但不只保留最近片段。将近期上下文与目标帧使用不同去噪日程，有助于减少自回归生成的时间漂移。

Abstract: Long-horizon video generation requires retaining an ever-expanding history, but conditioning on its growing token sequence is costly. Existing methods restrict or compress historical context, potentially losing information needed for future generation. This work proposes ReCam, which groups local spatiotemporal blocks of historical latents into vectors and projects them directly into the high-dimensional hidden space of a Diffusion Transformer. The model learns to use the resulting memory tokens through native self-attention, reducing token count while retaining block-level access to the full history. To mitigate temporal drift during autoregressive rollout, we further introduce dual-pointer denoising with separate noise schedules for recent context and target frames. Among the evaluated methods, ReCam achieves the highest VBench-Long overall score of 80.1 and competitive static-scene revisitation performance on R2M-Bench. It also leads on all four consistency metrics for off-screen subject reappearance, including clothing consistency of 4.09 versus 3.03 for the best baseline.

[93] Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds cs.CV | cs.GRPDF

Jihai Zhang, Runjia Qian, Kaiqin Kong, Biao Jiang, Puyi Wang

TL;DR: Matrix-Game 4.0 将游戏状态与规则交给轻量引擎执行，再用自回归视频模型渲染细节，实现可修改的实时游戏世界；单 RTX 5090 上支持 480p、60 FPS，按键到显示延迟 112 毫秒。

Details

Motivation: 从可控视频迈向真正可玩的世界，需要持久状态、可执行游戏规则和低延迟交互。若仅依赖视频生成，难以保证玩法规则和世界状态持续一致。

Result: Matrix-Game 4.0 以可执行游戏框架分离游戏执行和视觉生成：轻量引擎维护世界状态并执行交互规则；多模态代码智能体把玩家想法转为游戏代码和动态场景描述；基于自回归视频模型的渲染器将引擎绘制的低多边形代理转为细节画面，并利用动态描述与记忆参考持续引导生成。渲染器在对齐的低多边形—高保真视频对上训练并蒸馏为因果生成器，每次生成四帧，只需一至两步去噪。单张 RTX 5090 上可实现 480p、60 FPS，按键到显示延迟 112 ms；单步生成稳定吞吐 83 FPS、峰值显存 18.2 GiB。RTX 5080 和 RTX 5070 Ti 分别达 67 与 58 FPS。系统展示了规则由引擎执行的可定制射击和驾驶游戏，并开放代码、权重及资产。

Insight: 把可执行状态和玩法规则交给游戏引擎，视觉生成模型则专注提供高保真画面，可避免让视频模型独自承担规则一致性。因果分块渲染与推理优化使自然语言创建和修改游戏能达到实时交互速度。

Abstract: Moving from controllable videos to genuinely playable worlds requires persistent world state, executable game rules, and low-latency interaction. We outline a roadmap for the next generation of Matrix-Game that separates game execution from visual generation through an executable game harness, and introduce Matrix-Game 4.0 as the first system built on this design. A lightweight game engine maintains world state and executes interaction rules, a multimodal coding agent translates player ideas into game code and dynamic scene captions, and a renderer based on autoregressive video model transforms engine-rendered low-poly proxies into detailed visuals, conditioned on dynamic captions and memory references. This framework provides continuous guidance for visual generation and enables natural-language creation and modification of scenes and gameplay. Our renderer is trained on aligned low-poly and high-fidelity video pairs and distilled into a causal generator that generates in four-frame chunks with one or two denoising steps. Together with targeted inference optimizations, Matrix-Game 4.0 enables 480p, 60 FPS gameplay on a single NVIDIA RTX5090 with a key-press-to-display latency of 112ms. Single-step generation achieves 83FPS steady-state throughput with 18.2GiB of peak GPU memory usage. With fixed prompts, steady-state throughput also reaches 67FPS on an RTX5080 and 58FPS on an RTX5070Ti. We demonstrate customizable shooter and driving games with engine-enforced mechanics, and release code, model weights, and low-poly game assets to support research and creation of playable game worlds.

[94] Beyond the Evidence Boundary: Behavioral Mirage Under Progressive Degradation in Medical VLMs cs.CV | cs.CLPDF

Edric Castel C. Hao, Rez Samantha Z. Floresca

TL;DR: 该研究在医学 VLM 上逐步降低图像证据并定义持续作答的“行为幻象”；残差流探针能以 0.895–0.994 AUROC 识别边界处坚持作答或弃答，但输出熵未必能反映这种行为。

Details

Motivation: 医学图像模型通常在干净输入上评估，较少模拟临床观察中证据逐渐丢失的情况。已有鲁棒性研究发现性能下降时模型仍可能自信，却未明确一个原本可靠的模型—病例何时开始失去可靠性。

Result: 作者提出以基线正确病例为锚点，逐步退化图像以寻找经验性证据边界，并把模型在该边界继续坚持回答定义为 mirage（行为幻象），无论答案是否正确。三个 VLM、三个医学数据集的分析中，只有 MedGemma 提供足够大的基线正确样本池。唯一问题文本变化的 VQA-RAD 上，仅凭语言即可答题与基线正确相关（AUROC 0.677），也与边界处坚持作答相关（AUROC 0.653–0.670）。不同数据集—模态组合的 mirage 比例为 16.0%–100.0%，边界后行为包括持续幻象、恢复正确、幻象消退、持续弃答和摇摆。尽管行为异质，残差流探针在嵌套交叉验证下以 0.895–0.994 AUROC 解码边界处坚持或弃答。

Insight: 逐步损失视觉证据时，模型可能持续承诺答案，而输出熵和弃答行为不一定揭示这一风险。边界感知评估、选项顺序控制和更好的弃答机制，有助于检验医学基础模型在部分观察下的可靠性。

Abstract: VLMs for medical image interpretation are typically evaluated on clean inputs, despite the progressive evidence loss that can occur in high stakes clinical settings. Existing robustness studies show that performance can degrade while confidence remains high, but do not establish when a previously reliable model-case pair ceases to behave reliably. We introduce a baseline-anchored framework that traces baseline-correct cases through progressive image degradation to identify an empirical evidence boundary, and define mirage as continued commitment at this boundary, regardless of correctness. Across three VLMs on three medical datasets, only MedGemma provides a sufficiently large baseline-correct pool for trajectory analysis. On VQA-RAD, the only dataset in which the question text varies, language-only answerability is associated with baseline correctness (AUROC 0.677) and with commitment at the boundary (AUROC 0.653 to 0.670). MedGemma’s post-boundary behavior is heterogeneous, including direct mirage, correct recovery, mirage dissolution, consistent abstention, and oscillation, with mirage rates of 16.0 to 100.0% across dataset-modality pairs. Despite this behavioral heterogeneity, residual-stream probes decode commit-versus-abstain behavior at the boundary with AUROC of 0.895 to 0.994 under nested cross-validation. These results show that progressive evidence loss can produce persistent commitment that output entropy and abstention behavior do not consistently reflect, motivating boundary-aware evaluation, option-order controls, and improved abstention mechanisms for reliable medical foundation models operating under partial observation.

[95] Differentiable Task-Driven Coded Aperture Camera Design with 3D Gaussian Scene Representations cs.CVPDF

Chengyang Yan, Donald G. Dansereau

TL;DR: 该可微框架用真实采集重建的 3D Gaussian 场景端到端联合设计编码孔径相机和深度网络，涵盖单目与双目离焦深度相机，并优于现有编码孔径及非可微相机设计基线。

Details

Motivation: 相机设计会显著影响感知任务表现，但通常由专家通过昂贵实验完成，且与下游任务分开优化。现有可微联合设计多依赖预先采集的 2D 图像，只适用于光学或图像处理环节；非可微模拟器则需无梯度或强化学习优化，难以扩展到大量设计参数。

Result: 作者提出可微框架联合设计复杂相机系统和下游感知任务，并据此设计单目及双目两种编码孔径离焦深度相机。框架以真实采集重建的 3D Gaussian Splatting 表示场景，提供可微图像形成过程，从而可用梯度优化联合调整编码孔径掩模、相机参数和深度估计网络。实验显示，该方法优于现有编码孔径设计及非可微相机设计基线。

Insight: 用可微三维场景表示取代仅基于预采集二维图像的模拟，可让光学参数和感知模型在真实场景分布上端到端共同优化。梯度法因而能探索以往难以处理的相机设计空间，推动任务驱动的自动相机设计。

Abstract: Camera design heavily influences perception task performance, yet cameras are typically designed by domain experts through costly experimentation, in isolation from the tasks they serve. Existing joint-design methods either rely on differentiable simulation limited to pre-captured 2D images, restricting them to optics or image-processing pipeline design, or use non-differentiable camera simulators optimised with derivative-free or reinforcement-learning methods that scale poorly with the number of design parameters. We present a differentiable framework for jointly designing complex camera systems and downstream perception tasks. We use it to design two coded-aperture depth-from-defocus cameras, a monocular and a stereo configuration, by jointly optimising the coded aperture mask, camera parameters, and a depth estimation network end-to-end. Our framework represents scenes with 3D Gaussian Splatting reconstructed from real-world captures, providing a differentiable image formation process for gradient-based optimisation over design spaces intractable for prior differentiable approaches. Results demonstrate that our differentiable method improves over existing coded aperture design and non-differentiable camera design baselines, offering a step forward in automated and principled camera design for autonomous systems.

[96] P$^3$-VLM: A Point-based Alternative for Grounded 3D Vision-Language Models cs.CVPDF

Anna-Maria Halacheva, Jan-Nico Zaech, Sombit Dey, Luc Van Gool, Danda Pani Paudel

TL;DR: P³-VLM 指出 3D VLM 的框提示会泄漏物体类别信息，改用单点提示评估空间落地；三路径模型在点提示设定下定位描述准确率达 52.1%，并改善鲁棒性和 OOD 泛化。

Details

Motivation: 3D 视觉语言模型的空间落地基准常用边界框作为提示或表示。由于框形状和范围本身可能泄漏类别线索，模型可能依赖框而忽略真实 3D 视觉信息，导致评测和训练中的语义捷径。

Result: 作者提出点式落地提示，以单个 3D 点替代边界框。仅看框坐标的盲 LLM 在 ScanNet Nr3D 上准确率从 36.4% 降至 18.0%，LL3DA 等 3D VLM 也出现类似下降。基于这一观察，P³-VLM 设计位置、任务和上下文三条互补路径，不依赖检测器和边界框，以场景为中心并支持 3D Gaussian Splatting 输入。在点提示设定下，定位描述准确率达到 52.1% 的最先进结果；此外在鲁棒性、分布外泛化及无落地场景 3D VQA 上也有改善。

Insight: 用点而非框作提示，可减少框的类别信息泄漏，更直接测试模型是否真正利用场景视觉内容进行空间推理。点式训练带来的收益不仅体现在该落地协议，也延伸到鲁棒性和其他场景中心任务。

Abstract: Examining existing benchmarks for grounding in 3D VLMs reveals a pervasive “semantic leakage” in the evaluation and prompting protocols: a heavy reliance on bounding boxes as spatial prompts or representation primitives. Because bounding boxes are highly informative of object categories, they introduce a shortcut for the models to neglect visual information during 3D VLM training. We demonstrate this with a “blind” LLM that, prompted only with the box coordinates, can perform surprisingly well. To further analyze this shortcut, we propose point-based grounding prompting - querying models with a single 3D point instead of a box. Under this protocol, the accuracy of the blind LLM drops from 36.4% to 18.0% on ScanNet’s Nr3D, and similarly degrades for 3D VLMs (e.g. LL3DA). Building on this insight, we introduce P$^3$-VLM, a novel tri-pathway 3D VLM that supports point-based prompts and achieves 52.1% state-of-the-art accuracy on location-grounded captioning under this setting. To achieve this, we redesign the architecture while keeping it detector-free, scene-centric, and suitable for 3D GS inputs. P$^3$-VLM utilizes three complementary pathways (location-, task-, and context-aware), enabling strong reasoning about scenes without any bounding box dependencies. The key benefit of point-based learning is a consistent improvement across settings: P$^3$-VLM achieves state-of-the-art performance under point-based grounding while also improving robustness, OOD generalization, and performance on ungrounded scene-centric 3D VQA benchmarks, reflecting its reduced reliance on bounding-box shortcuts and resulting stronger visual-spatial reasoning.

[97] Spherical Geometry-Aware Panoptic Scene Graph Generation for Equirectangular Panoramas cs.CVPDF

Zhe Wu, Xiaoyan Fei, Xinyi Jiang, Yanxu Wei, Junming Rao

TL;DR: 该球面几何感知全景场景图方法融合重叠透视视图并在关系推理中考虑纬度面积和经度接缝；自建 340 张全景图数据集，多个 PSGG 指标显著提升。

Details

Motivation: 全景图的等距柱状投影会引入几何畸变、随纬度变化的像素面积及人工接缝，对全景全景分割场景图生成造成挑战；普通图像方法难以直接正确融合全景区域和关系。

Result: 方法分两阶段处理球面几何：依据观测可靠性、球面重叠和角距离融合重叠透视视图预测；关系推理则结合球面面积感知聚合、加权无关系监督和双经度得分融合。作者构建包含 340 张高分辨率全景图的数据集，含 10,571 个节点和 6,632 条有向关系。对照相应基线，在视图匹配时球面融合使 PQ 提升 36.03%；PredCls（真值掩码和物体标签）下关系推理使 mR@50 提升 11.20%；完整框架在 SGDet（预测全景分割段）下使 mR@50 提升 52.99%。

Insight: 全景图关系识别需要在球面而非平面像素几何上处理视图重叠、面积差异和经度接缝。分离改进全景实体融合与关系推理后，两者都带来增益，完整系统在更综合的预测分割场景图设置下收益最大。

Abstract: Panoptic scene graph generation (PSGG) represents scene entities with segmentation masks and directed relations. Equirectangular projection (ERP) panoramas challenge PSGG through distortion, latitude-dependent pixel areas, and an artificial seam. We propose a two-stage spherical geometry-aware framework that fuses overlapping perspective-view predictions using observation reliability, spherical overlap, and angular proximity. Relation reasoning combines spherical-area-aware aggregation, weighted no-relation supervision, and dual-longitude score fusion. We also construct a dataset of 340 high-resolution panoramas with 10,571 nodes and 6,632 directed relations. Against corresponding baselines, spherical fusion improves PQ by 36.03% under matched views, while relation reasoning improves mR@50 by 11.20% under PredCls with ground-truth masks and object labels. The full framework improves mR@50 by 52.99% under SGDet with predicted panoptic segments. These results demonstrate the value of spherical geometry for panoramic PSGG.

[98] A Process-Informed, Photorealistic Digital Twin for Vision-Based Inline Inspection of C-SMC Strip Deposition cs.CV | cs.GRPDF

Patrick Flore, Fabian Röder, Kevin Chen, Andreas Gebhard

TL;DR: 该工艺感知数字孪生用刚体仿真与物理偏振渲染生成真实碳纤维 SMC 铺带图像和精确多格式标注；纯合成训练的模型在真实制造图像上减少人工标注需求。

Details

Motivation: 片状模塑料（SMC）制造的在线质量检测缺少大规模且标注准确的图像数据，限制了机器学习视觉检测。多条纤维带的重叠分布难以解析式生成，而人工标注也难以提供密集、彼此一致的真值。

Result: 作者构建工艺感知、照片级碳纤维 SMC 铺带数字孪生：刚体仿真重现落料、摩擦和传送带运动，物理偏振渲染生成逼真外观，并为每张图同步给出旋转框、点、密度图和偏振角/线偏振度标注。孪生生成超过 16,000 张图、跨 3,300 帧；合成纤维方向近各向同性（轴向集中度 r<0.05），与商业 SMC 铺放状态一致。仅用合成数据训练时，YOLOv11 和 CSRNet 的 mAP50 最高达 0.91，专用旋转框检测器 mAP50 为 0.83。真实数据中合成到真实边缘与纹理差异，与同一材料两次真实采集之间差异量级相近。

Insight: 工艺仿真提供外观和运动机制，物理渲染再生成跨任务一致的精确标签，能扩展人工难以标注的密集监督。纯合成训练在真实制造图像上的结果显示其具有实用潜力，但摘要量化的跨域差异仍提示合成与真实数据并非完全相同。

Abstract: Inline quality assurance for Sheet Molding Compound (SMC) manufacturing is hindered by the lack of large-scale, accurately labeled image datasets for training machine-learning models. This work presents a process-informed, photorealistic digital twin for carbon-fiber SMC strip deposition. A rigid-body simulation reproduces the deposition kinematics (settling, friction, belt motion), while a physically grounded polarization-rendering model produces realistic appearance, so that every image carries exact, mutually consistent labels in synchronized formats: oriented bounding boxes, point annotations, density maps, and polarization renderings (Angle and Degree of Linear Polarization). Because the joint distribution of many overlapping strips cannot be specified analytically, simulation yields exact, scalable ground truth that manual annotation cannot provide. The twin produces over 16,000 images across 3,300 frames, and the synthetic data replicate near-isotropic fiber orientation (axial concentration r < 0.05) consistent with as-deposited commercial SMC. Trained purely on synthetic data, YOLOv11 and CSRNet reach detection mAP50 up to 0.91, with a dedicated oriented-bounding-box detector confirming the oriented labels are directly trainable (mAP50 = 0.83); on real manufacturing images, the synthetic-to-real difference in edge and texture structure (Kolmogorov-Smirnov distance 0.46, distribution overlap 0.56) is of the same magnitude as the difference between two real acquisition series of the same material (0.41, overlap 0.57). The approach substantially reduces the labeling burden for camera-based inline inspection of fiber orientation and volume content.

[99] Assessing Representation Semantics Under Language Pretraining in Fine-Grained Classification cs.CV | cs.AIPDF

Md Raisul Kibria, Sébastien Lafond

TL;DR: 该解释性框架在统一分类训练条件下比较分类监督与图注监督的细粒度图像表示；图注监督更依赖显著目标区域、对齐物体部件且较少利用背景，趋势也在 Oxford-IIIT Pet 消融中复现。

Details

Motivation: 监督信号如何塑造视觉语义表示，尤其在细粒度、低数据场景下仍不易理解。仅看下游准确率可能无法揭示不同训练目标学到的表示结构差异。

Result: 作者在 CUB-200 上提出紧凑的可解释性比较框架，对比分类监督和图注生成监督编码器，并采用两阶段控制协议，最终让两者都优化相同分类任务。通过 attention rollout 和梯度加权 rollout 生成显著图，以五个指标衡量忠实度（正、负扰动）和定位（关键点强调、背景归因、Earth Mover 距离）。跨随机种子和解释方法，图注监督的表示对移除显著区域更敏感、更贴合标注物体部件、较少依赖背景；分类监督对移除低显著区域则略更稳健。Oxford-IIIT Pet 消融在主要指标上呈现一致趋势。

Insight: 不同监督方式可能产生准确率相似但结构特性不同的表示；解释性指标能补充下游分类分数，测出模型实际依据哪些区域。图注监督更重视显著部件，分类监督则对低显著区域移除略稳健，说明训练目标决定了不同的表示偏好。

Abstract: Understanding how supervision signals shape semantic visual representations remains challenging, particularly in fine-grained, low-data settings. Standard evaluations of vision models rely on downstream accuracy, which often fails to capture structural differences in learned representations. We propose a compact explainability-driven framework for comparing encoders trained with classification-only and caption-generation supervision on CUB-200. Using a controlled two-stage protocol in which both encoders are ultimately optimized for the same classification task, we enable a direct comparison of the resulting representations. Saliency maps are generated using attention rollout and gradient-weighted rollout and evaluated with five metrics covering faithfulness (positive and negative perturbation) and localization (keypoint emphasis, background attribution, and Earth Mover’s Distance). Across random seeds and explanation methods, caption supervision yields representations that are more sensitive to the removal of salient regions, better aligned with annotated object parts, and less reliant on background regions, whereas classification supervision produces representations that are slightly more robust to the removal of low-saliency regions. An ablation study on the Oxford-IIIT Pet dataset shows consistent trends across key metrics. These results demonstrate that the proposed framework makes supervision-induced representational differences observable and quantifiable beyond downstream accuracy alone. More broadly, it provides a systematic basis for assessing learned representations and comparing alternative training and transfer-learning strategies.

[100] Auditing Where Concept Bottleneck Accuracy Comes From on CUB cs.CV | cs.AI | cs.LGPDF

Sascha Saralajew, Eleonora Poeta, Eliana Pastor, Ammar Shaker

TL;DR: 对 CUB 概念瓶颈模型的审计发现，类别准确率和概念准确率不能证明预测确由可见概念支撑；限制模型使用局部特征可减少概念分数中的类别信息泄漏，但不能保证真实部件定位。

Details

Motivation: 概念瓶颈模型希望通过“弯曲的喙”等概念让人检查和纠正分类，但常规 CUB 基准只测类别和概念准确率，无法说明类别预测是否来自公开概念分数，也不能确认概念是否由对应视觉证据而非物种共现特征支持。

Result: 作者审计 CUB-200-2011 上的概念瓶颈模型（CBM）和概念嵌入模型（CEM）。标注噪声较大：类别级训练标签与逐图概念标注仅在约 82% 图像—概念对上一致；仅用逐图概念标注训练的分类器物种准确率约 37%。泄漏探针发现 CEM 的预测无法由概念分数重构，缺失类别信息藏在内部嵌入中。消融将概念分数中的类别信息来源归纳为感受野、共享/专属表示、依赖范数的评分和任务监督。将 ResNet50 限制为局部 BagNet patch 后，概念分数可恢复的准确率从 72% 降至 43%，接近真值标注所支持水平；联合训练又提高该分数，但牺牲概念准确率。定位与遮挡实验还显示局部概念分数会用头部代替身体、翅膀或尾部概念，遮挡支持部件时 CEM 分数反应很小。

Insight: 高类别或概念准确率并不代表模型决策可解释；类别信息可能泄漏进概念分数或隐藏嵌入，概念也可能由相关部件代理而非目标证据支撑。CUB 标注噪声较高，因此不应过度解读不同模型的准确率差距，评估需检查证据定位和信息流。

Abstract: Concept Bottleneck Models (CBMs) promise predictions that humans can inspect and correct through concepts such as “curved beak”. Yet on CUB-200-2011, their standard benchmark, progress is measured like that of ordinary classifiers: by task and concept accuracy. Neither reveals whether the label is predicted from the exposed concept scores, or whether a concept is supported by visual evidence of that concept rather than by co-occurring features such as cues to the species as a whole. We audit where the accuracy of CBMs and Concept Embedding Models (CEMs) on CUB comes from. The CUB annotations are too noisy to explain it: class-level training labels agree with per-image annotations on only ~82% of image–concept pairs, and classifiers trained on per-image annotations reach only ~37% species accuracy. Leakage probes show that CEM predictions cannot be reconstructed from their concept scores; the missing class information sits in internal embeddings. We identify four design axes through which class information can enter concept scores—receptive field, shared versus concept-specific representations, norm-dependent scoring, and task supervision. An ablation shows that most of it enters through non-local features: restricting a ResNet50 backbone to local BagNet patches lowers the accuracy recoverable from concept scores from 72% to 43%, close to what ground-truth annotations support, while joint training raises it again at the cost of concept accuracy. Localization and occlusion show that locality makes grounding measurable but does not guarantee it: under class-level labels, local concept scores use the head as a proxy for body, wing, and tail concepts, and CEM concept scores barely respond to occluding their supporting part. Task and concept accuracy should thus support, not drive, the evaluation of CBMs, and given the noisy annotations, CUB accuracy gaps should not be overinterpreted.

[101] MoDDiT: Simple Token Routing in Diffusion Transformers cs.CV | cs.AIPDF

Jarek Liesen, Matthew T. Jackson, Benjamin Ellis, Shimon Whiteson, Jakob N. Foerster

TL;DR: MoDDiT 为扩散 Transformer 加入动态 token 路由，让不同图像、token 和去噪阶段分配不同 MLP/注意力计算；图像生成最多仅处理 12.5% token，并扩展到视频生成与稀疏蒸馏。

Details

Motivation: 高质量扩散 Transformer 的瓶颈逐渐转向模型吞吐。自然图像常有大面积背景，许多 token 对场景贡献小、容易去噪，但标准 DiT 仍对所有 token 静态、均匀地执行计算，没有利用图像稀疏性。

Result: MoDDiT 在架构上学习将 token 分别路由通过 MLP 和自注意力模块，让 MLP 的计算分配随 token、图像和去噪时间动态变化。使用 MoDDiT 从头训练图像生成模型时，训练和推理计算成本显著下降，最稀疏设置仅处理 12.5% token；提高稀疏度与模型深度后，相比不路由基线可降低成本并改善生成表现。学习到的分配可解释地反映视觉内容和噪声水平。方法也用于视频生成，路由分配与运动相关，并用于把稠密双向视频模型蒸馏成稀疏自回归学生。

Insight: 不同视觉区域及去噪阶段对计算需求不同，动态 token 路由可把算力集中在更重要或更难处理的部分。该机制不仅节省图像生成计算，也与视频运动结构相关，并可支持从稠密双向模型向稀疏自回归模型蒸馏。

Abstract: Real-time video generation, interactive world models, and on-device image synthesis are almost a reality. Diffusion Transformers (DiT) achieve excellent sample quality, shifting the bottleneck to the throughput of the models themselves. Natural images are inherently sparse, as large portions of an image are often background, contribute little to the scene content, and are easy to denoise. DiTs fail to exploit this sparsity, as they process image tokens statically and uniformly. We propose MoDDiT, a simple architecture modification that learns to route tokens through both MLP and self-attention operations. By routing tokens through both blocks independently, MoDDiT allows for dynamic compute allocation in MLPs that varies across tokens, images, and denoising timesteps. Using MoDDiT to train image generation models from scratch significantly reduces computational costs of training and inference, processing as few as 12.5% of the tokens. By increasing sparsity and model depth, MoDDiT reduces costs and improves generation performance over unrouted baselines. The learned allocation is interpretable, revealing how computation varies with visual content and noise level. We also use MoDDiT to train video generation models, where allocation correlates with motion, and to distill a dense bidirectional video model into a sparse autoregressive student.

[102] WildAIGC-Bench: Can AI Image Detectors Handle the Wild? A Benchmark of Generated and Edited Images in Online Circulation cs.CVPDF

Zijian Yu, Hangwei Zhang, Jun Lan, Huijia Zhu, Weiqiang Wang

TL;DR: WildAIGC-Bench 收录 407 张来自新闻、事实核查和社交媒体传播的经核验 AI 生成或编辑图像，并保留压缩、截图和翻拍等网络流通痕迹；现有检测器在该野外基准上召回不足。

Details

Motivation: 与新闻事件和网络说法相关的 AI 图像可能误导公众、助长欺诈或引发争议。常见检测基准不一定保留图像在真实网络传播中经历的压缩、截图和再次拍摄等变化，因此难以反映真实部署表现。

Result: WildAIGC-Bench 通过持续收集新闻网站、事实核查来源及相关社交媒体内容构建，流程包含定期发现、自动筛查与初步标注，再由人工核验图像特定证据。基准含 407 张确认属于 AI 生成或编辑的图像，每张附来源网页链接和证据摘要，并保留线上流通时的压缩、截图和重拍条件。专用视觉检测器、多模态大模型及简单 Perception Encoder 基线的评估显示，相比现有基准，这些方法在该数据集上的召回率存在明显缺口。

Insight: 检测模型在干净或策展基准上的表现可能高估真实网络流通图像上的召回能力。保留来源链接、证据说明和传播痕迹，使基准既可测实用检测难度，也支持基于来源的核验及后续扩展。

Abstract: AI-generated images linked to news events and online claims can mislead audiences, enable fraud, or cause public controversy. We introduce WildAIGC-Bench, built through recurring collection across news websites, fact-checking sources, and related social media content. The pipeline combines broad coverage, timely updates, and human-verified labels through scheduled discovery, automatic screening and preliminary annotation, and human review of image-specific evidence. The benchmark contains 407 verified AI-generated or edited images, each accompanied by a source webpage link and an evidence summary. Images retain the conditions encountered online, including compression, screenshots, and recapture. Evaluation of dedicated visual detectors, multimodal large language models, and a simple Perception Encoder baseline reveals substantial recall gaps relative to existing benchmarks. WildAIGC-Bench provides both a practical detection challenge and a basis for continued data expansion and source-based verification. The dataset is released at https://github.com/YuZijian/WildAIGC-Bench.

[103] LatticeRank: Spacing-Ranked Consistency for Native-Grid 3D Medical Image Segmentation cs.CVPDF

Jingjia Yan, Yue Zhuo, Zhonghua Xie

TL;DR: LatticeRank 在训练阶段按体素间距排序分配原生网格一致性监督，推理仍只需单次网络前向；MSD Task04 上粗网格 Extra Dice 较均匀一致性提升 0.03436，并满足预设参考网格非劣标准。

Details

Motivation: 体素间距变化不仅改变分辨率，也改变三维分割网络面对的离散采样格、张量几何和可见解剖证据。传统流程将图像重采样到统一网格，而直接在原生网格部署则要求模型自身适应变化。不同候选网格并非等价：粗网格丢失的结构信息更多，常规一致性目标却往往赋予相同权重。

Result: LatticeRank 是仅用于训练的框架，在物理空间对齐候选网格后，按体素间距顺序分配一致性监督：对端点匹配候选，将辅助损失集中在请求的最粗网格；推理时不保留候选分支或集成，仍是一次网络前向。在 MSD Task04 上，五个随机种子平均结果显示粗网格 Extra Dice 比均匀一致性提高 0.03436，同时满足预先设定的参考网格非劣标准。受控阶梯实验显示，网格暴露贡献最大恢复，一致性再带来提升，间距排序分配取得最强直接网格结果。

Insight: 候选网格间的信息损失具有顺序性，可利用请求间距这一简单信号，而不是把所有尺度视为同等一致性样本。分阶段实验分辨出网格覆盖、后验一致性和间距排序各自作用，且训练时的复杂监督不增加推理分支。

Abstract: Variable voxel spacing changes more than image resolution: it alters the discrete sampling lattice, tensor geometry, and anatomical evidence available to a 3D segmentation network. While conventional pipelines restore images to a canonical grid, direct-grid deployment requires the model itself to tolerate these changes. We observe that candidate grids are not exchangeable views – a coarse grid removes more structural information than a mildly resampled one – yet standard consistency objectives assign them equal influence. We therefore propose LatticeRank, a training-only framework that aligns candidate posteriors in physical space and allocates consistency supervision by voxel-spacing order: among endpoint-matched candidates, the auxiliary loss concentrates on the coarsest requested grid, while inference retains a single network forward with no candidate branch or ensemble. On MSD Task04, LatticeRank improves coarse-grid Extra Dice over mean consistency by 0.03436 across five seeds while meeting the prespecified reference-grid noninferiority criterion. A controlled ladder shows that grid exposure provides the largest recovery, posterior consistency adds a second gain, and spacing-ranked allocation yields the strongest direct-grid result; requested spacing thus provides a simple, model-independent ordering signal for direct-grid consistency learning.

[104] Reliability-Guided Vision-Language Decoding with Text-Aware Skip Refinement for Medical Image Segmentation cs.CVPDF

Sivan Talaei, Fatemeh Daneshfar, Mustaqeem Khan, Abdulhady Abas Abdullah, Mourad Oussalah

TL;DR: RELiF 用可靠性门控控制医学文本对分割视觉特征的跨模态更新，并以文本引导高分辨率跳连细化；在 X 光、CT 和内窥镜分割中表现有竞争力，可靠性不确定度与错误像素相关。

Details

Motivation: 医学图像分割在目标视觉差异弱、结构不规则或成像模态差异大时很困难。文本信息可帮助消除歧义，但无差别融合可能引入不可靠的语义指导。

Result: RELiF 是视觉—语言分割框架，使用可靠性引导融合门（RFG）自适应控制跨模态更新，并以文本引导跳连细化适配器（TSRA）利用文本增强高分辨率特征。作者在放射影像、CT 和内窥镜分割任务上评估，报告在不同成像特性和目标外观下表现有竞争力，并补充分析效率与稳定性。由可靠性响应构造的互补不确定性表示与预测难度有关：分割错误像素中较高不确定值更常见。

Insight: 语言线索有帮助但并非总可靠，因此应由模型估计何时采纳文本信息，并把文本作用到需要细节的高分辨率特征上。可靠性响应也可作为像素不确定度信号，帮助定位潜在分割错误。

Abstract: Medical image segmentation remains challenging when targets exhibit limited visual distinction, irregular structure, or substantial variation across imaging modalities. Medical text can reduce this ambiguity, but indiscriminate fusion may introduce unreliable guidance. We present RELiF, a vision–language framework that integrates text through reliability-guided decoding. Its Reliability-guided Fusion Gate (RFG) adaptively controls cross-modal updates, while the Text-guided Skip Refinement Adapter (TSRA) refines high-resolution features using text guidance. RELiF is evaluated on radiographic, CT, and endoscopic segmentation tasks, where it shows competitive performance across diverse imaging characteristics and target appearances. Additional analyses examine efficiency and stability. The complementary uncertainty representation derived from the reliability response also shows an association with prediction difficulty, with higher uncertainty values occurring more frequently in pixels associated with segmentation errors. Code: https://github.com/SeivanTalaie/RELiF.

[105] PointForward V2: Point-Aligned Interaction for Feedforward Driving Reconstruction cs.CVPDF

Xianqi Wang, Cheng Chi, Yuechuan Pu, Hongcheng Luo, Junda Cheng

TL;DR: PointForward V2 用静态场景寄存器跨帧聚合背景信息，并以实例专属动态寄存器交互对齐后的物体点查询，在 Waymo、nuScenes 和 Argoverse 2 上达到前馈驾驶重建 SOTA。

Details

Motivation: 动态驾驶场景前馈重建需融合多视角、多时刻观测为一致三维表示。PointForward 将图像提升为稀疏 3D 点查询，但查询多被独立处理，时空信息交换有限；对数万查询直接做全局注意力又计算昂贵。

Result: PointForward V2 将点对齐表示扩展为点对齐交互，通过紧凑、场景结构化寄存器中介查询交互。静态背景使用逐帧静态场景寄存器压缩点信息、跨帧通信并把聚合上下文传回查询；动态目标则先把不同帧查询对齐到物体中心规范空间，再通过实例专属动态寄存器交互。4D 位置编码将对齐空间坐标与原始时间戳结合，使空间对齐的信息仍能区分时间。Waymo、nuScenes 和 Argoverse 2 实验显示，该方法在大规模驾驶基准上达到最先进表现。

Insight: 寄存器能在不对所有点查询执行稠密全局注意力的前提下交换时空上下文。静态背景和动态实例采用不同交互机制，并显式区分空间对齐与时间先后，支持可扩展的驾驶场景重建。

Abstract: Feedforward reconstruction of dynamic driving scenes requires integrating observations across multiple views and time steps into a coherent 3D representation. PointForward established state-of-the-art feedforward driving reconstruction by lifting image observations into sparse 3D queries, demonstrating the effectiveness of point-aligned scene representations. However, these queries are largely processed independently, limiting information exchange across space and time, while direct global attention among tens of thousands of point queries is computationally prohibitive. In this work, we present \textbf{PointForward V2}, which advances point-aligned representation to point-aligned interaction. Our key idea is to mediate query interaction through compact, scene-structured registers. For the static background, frame-wise Static Scene Registers compress point information, communicate across frames, and propagate the aggregated context back to the queries. For each dynamic instance, queries from different frames are aligned in an object-centric canonical space and interact through instance-specific Dynamic Instance Registers. We further employ 4D positional encoding that combines aligned spatial coordinates with original timestamps, enabling spatially aligned yet temporally distinguishable interactions. In this way, PointForward V2 enables scalable spatio-temporal reasoning directly among lifted 3D queries without dense global attention. Experiments on Waymo, nuScenes, and Argoverse 2 demonstrate state-of-the-art performance across large-scale driving benchmarks.

[106] GAMF-Net: Grouped Availability-Aware Multimodal Fusion for Smartphone Skin Lesion Classification cs.CVPDF

Yue Zhuo, Jingjia Yan, Fangyu Liu, Lingjun Liu, Zongjun Chen

TL;DR: GAMF-Net 将十项临床变量分成三组并显式编码字段可用性，只融合当前可用的图像条件临床证据；在 PAD-UFES-20 患者互斥五折协议下优于统一重实现的图像及多模态基线。

Details

Motivation: 资源受限场景中的智能手机皮肤病灶图像成本较低，但图像无法涵盖病史和症状。临床变量异质、观测值与填充值易混淆，而且临床信息可能干扰视觉证据，需要在缺失信息时可靠融合。

Result: GAMF-Net 将十项临床变量分为人口统计、病史风险和病灶表现三组，每组同时编码字段值与可用性掩码。图像分支生成基础分类 logits，各临床组产生以图像为条件的类别残差信息；仅融合可用组并按可用组数归一化、等权组合。当临床信息全部缺失时，模型严格退化为图像单模态路径。在 PAD-UFES-20 患者互斥五折评估中，准确率 74.17±2.85%、平衡准确率 70.11±2.11%、Macro-F1 68.85±0.85%、Macro-AUROC 93.42±1.20%，优于统一协议下重实现的图像及多模态基线。对最强基线 MetaBlock 分别提高 2.37、2.59、4.14 和 1.02 个百分点。消融显示临床信息明显改善类别平衡性能，受约束等权融合优于动态融合，病灶表现组提供最有价值的临床补充。

Insight: 将字段是否观测作为输入的一部分，能区分真实测量与缺失/插补值；按可用组融合还保证全缺失时行为等同图像模型。临床线索适合作为图像条件化的补充证据，而不是不受约束地覆盖视觉证据。

Abstract: Smartphone clinical images provide a low-cost data source for computer-aided skin lesion classification in resource-constrained settings, but images alone cannot fully capture patients’ medical histories and lesion symptoms. To address the lack of structured organization among heterogeneous clinical variables, the ambiguity between observed and imputed values, and the risk that clinical information may interfere with visual evidence, we propose GAMF-Net, a grouped availability-aware multimodal fusion network. Ten clinical variables are divided into three semantic groups—demographics, history-related risk, and lesion presentation—and each group jointly encodes field values and field-level availability masks. The image branch produces the base classification logits, while each clinical group generates image-conditioned class-level residual evidence. Only available groups participate in availability-normalized equal-weight fusion; when all clinical information is unavailable, the model reduces exactly to the image-only pathway. We evaluate the method on PAD-UFES-20 under a patient-disjoint five-fold protocol with separate training, validation, and test partitions. GAMF-Net achieves an Accuracy of $74.17\pm2.85%$, a balanced accuracy (BACC) of $70.11\pm2.11%$, a Macro-F1 of $68.85\pm0.85%$, and a Macro-AUROC of $93.42\pm1.20%$, outperforming all image-only and multimodal baselines reimplemented under a unified protocol. Compared with the strongest baseline, MetaBlock, the corresponding improvements are 2.37, 2.59, 4.14, and 1.02 percentage points, respectively. Ablation results show that clinical information substantially improves class-balanced performance, constrained equal-weight fusion is more effective than dynamic fusion, and the lesion-presentation group provides the most informative clinical complement.

[107] Offline Makes Online Better: Calibrated Cache Compression for Video Generation cs.CV | cs.AI | cs.LGPDF

Zhen Wang, Ning Lai, Qingtao Yu

TL;DR: CALM 先离线标定自回归视频模型各注意力层—头的合并风险，再按推理时缓存预算动态分配 token 合并比例；三个模型上同等内存预算下，视频 LPIPS 相对原视频约降低 21%。

Details

Motivation: token 合并可将时序冗余 token 聚类并保留少量代表，降低自回归视频生成的 KV 缓存占用。但现有方法通常对所有层和注意力头使用相同比例，而不同层头对合并敏感度不同且相互相关。

Result: CALM（层—头合并校准分配）通过离线校准改进在线缓存压缩。由于穷举所有层头预算分配代价过高，作者发现注意力输出误差与端到端视频质量强相关，可作为分配风险的轻量代理；据此评估策略并构造固定层头风险图。推理时给定缓存预算，CALM 使用动态规划确定各层头的合并比例。在三种自回归视频模型上，同等内存预算下均优于均匀 token 合并：生成视频相对原视频的 LPIPS 约降低 21%，且视频质量分数更高。

Insight: 不同层头对 token 合并的容忍度既不相同也并非独立，因此统一合并比例会浪费缓存预算或损害质量。离线风险标定把昂贵的质量评估转成轻量代理，在线再依据缓存约束求解分配。

Abstract: Token merging is an effective approach to reducing KV-cache memory consumption in autoregressive video generation by clustering temporally redundant tokens and retaining only a small set of representatives. Existing methods, however, typically apply a uniform merging ratio across all attention layers and heads. We observe that different layers and heads exhibit substantially different yet jointly correlated sensitivities to token merging, and that these sensitivity patterns remain consistent across prompts. Based on this observation, we introduce CALM, a Calibrated Allocation for Layer-Head Merging that uses offline calibration to improve online cache compression. Exhaustively evaluating all possible layer-head allocations is prohibitively expensive. To enable efficient calibration, we show that attention-output error strongly correlates with end-to-end video quality and can therefore serve as a lightweight proxy for allocation risk assessment. We evaluate different allocation strategies using this proxy and construct a fixed layer-head risk map offline. Given a cache budget at inference time, CALM uses dynamic programming to determine the best allocation of merging ratios. Experiments across three different autoregressive video models demonstrate that CALM consistently outperforms uniform token merging under the same memory budget, by reducing the LPIPS to original videos by around 21% with higher video-quality scores.

[108] Region-Guided Food-Package Evidence Extraction and Abstention-Aware Draft R3337 Screening with Selective VLM Review cs.CV | cs.AIPDF

Mayimunah Nagayi, Alice Scaria Khan, Tamryn Frank, Rina Swart, Clement Nyirenda

TL;DR: 该工作流从食品包装照片检测营养、配料和产品身份区域，以 OCR 与结构化抽取执行南非草案 R3337 规则；65 个验证产品中，选择性 VLM 复核将覆盖率从 51.7% 提升至 65.0%，准确率保持 97.4%。

Details

Motivation: 依据南非草案 R3337 对食品包装照片筛查警示，需要营养成分、配料和产品形态等多类证据。证据不完整、冲突或不确定时，强行自动判定可能产生不安全遗漏或错误警示。

Result: 流程先以三类检测器定位营养信息面板、配料表和产品身份区域，再用 PaddleOCR 和结构化抽取获取营养值、配料依据和产品形态，最后用确定性草案规则判定。证据不全或冲突时输出“需复核”或“证据不足”，而不是强制自动结论；符合条件的未决案例再由 Qwen3-VL 8B Instruct 选择性复核，合并采纳的证据并重新运行相同规则。流程应用于 442 个产品、3,929 张图像；人工验证集含 65 个产品。复核前，60 个可判定产品中 31 个获自动结论、其中 30 个正确，覆盖率 51.7%、自动结果准确率 96.8%。选择性 VLM 又解决 8 个产品，使覆盖率升至 65.0%；39 个自动结论中 38 个正确，准确率 97.4%。唯一错误警示来自规则流程，复核后未出现不安全的警示遗漏；但证据级评估仍发现 VLM 恢复的营养、配料和形态信息有误。

Insight: 将检测、证据抽取、确定性规则和选择性 VLM 复核分层，可在提高自动处理覆盖率的同时保留弃答机制。高总体准确率并不意味着恢复证据全都正确，因此需单独审计证据级错误，并在不确定时允许人工复核。

Abstract: Applying South Africa’s draft R3337 warning criteria to food-package photographs requires nutrition, ingredient and product-form evidence. This study presents a region-guided evidence extraction and abstention-aware screening workflow for draft R3337. A three-class detector localises nutrition information panels, ingredient lists and product-identity regions, after which PaddleOCR and structured extraction recover nutrient values, ingredient evidence and product-form information. Recovered evidence is aggregated and assessed using deterministic draft R3337 rules. When evidence is incomplete, uncertain or conflicting, the workflow abstains through Review or Insufficient evidence rather than forcing an automatic outcome. For qualifying unresolved cases, a selective vision-language model (VLM) review stage using Qwen3-VL 8B Instruct reassesses unresolved evidence. Accepted evidence is merged and the same deterministic rules are reapplied. The workflow was applied to 442 products represented by 3,929 images. Evaluation used a manual validation set of 65 products. Before selective VLM review, 31 of 60 decidable products received automatic outcomes and 30 were correct, giving 51.7% coverage and 96.8% accuracy among automatic outcomes (selective accuracy). Selective VLM review resolved eight additional products, increasing coverage to 65.0%. Of 39 automatic outcomes, 38 were correct, giving 97.4% selective accuracy. The single false warning was retained from the rules-only workflow, while no unsafe warning omissions occurred after selective review. Evidence-level evaluation nevertheless identified incorrect VLM-recovered nutrition, ingredient and product-form evidence. These findings show that selective VLM review can recover unresolved evidence, while deterministic screening and explicit abstention remain necessary for reliable image-based draft R3337 screening.

[109] Convergent Performance, Divergent Mechanisms in LoRA-Adapted Vision Foundation Models for Brain MRI cs.CV | cs.LGPDF

Cecilia Diana-Albelda, Fiona Kekwick, Raghav Mehta, Aleksandra Kulbaka, Paul M. Matthews

TL;DR: 研究发现四种 LoRA 适配视觉基础模型都能将脑肿瘤分割 Dice 收敛到 78–81%，但对阿尔茨海默病分类迁移效果方向不同；将 LoRA 限于早中层可保持分割效果并减轻分类退化。

Details

Motivation: 用 LoRA 将视觉基础模型适配到医学影像已较常见，但模型选择多依赖下游任务指标，容易把性能相近的骨干视为可互换。相同分割效果是否对应相同内部表示变化和跨任务影响，尚不清楚。

Result: 作者分析以不同目标和领域预训练的四种 ViT-B/16：DINOv3、SigLIP2、MerMED-FM 和 BiomedCLIP。它们用 LoRA 适配脑肿瘤分割，再在六个数据集上评估分割及阿尔茨海默病分类，并结合注意力散度、权重变化和激活 patching 分析。四者分割均值 Dice 相近，为 78–81%，但迁移方向不同：适配提升 DINOv3 的阿尔茨海默病分类，却损害其余三者。修改幅度最大层并非因果关键层，早中层已足以恢复分割。仅在这些层使用 LoRA 可匹配或接近全层分割表现，同时减轻三个受影响骨干的分类退化。

Insight: 任务指标相近不代表内部适配机制相同，也不代表跨任务迁移效应一致。追踪因果相关层后进行局部 LoRA 更新，可以更省参数地维持目标分割，并降低对其他医学任务的负迁移。

Abstract: Adapting Vision Foundation Models (VFMs) to medical imaging via LoRA has become standard practice, yet model selection is guided almost entirely by downstream task metrics, treating backbones with similar performance as interchangeable. We investigate whether equal performance implies equal internal representational shift. We analyse four ViT-B/16 backbones, DINOv3, SigLIP2, MerMED-FM, and BiomedCLIP, pre-trained with different objectives (self-distillation vs. contrastive vision-language) and on different data domains (natural vs. medical images). We adapt each to brain tumour segmentation and evaluate on six datasets covering both segmentation and Alzheimer’s disease classification. Using attention divergence, weight-change analysis, and activation patching, we find that the four models converge to similar segmentation performance (mean Dice 78-81%) through markedly different internal dynamics, yet diverge in cross-task transfer: segmentation adaptation improves Alzheimer’s disease classification for DINOv3 but degrades it for the other three backbones. We reveal a dissociation between modification magnitude and causal importance: the most heavily modified layers are not the causally relevant ones, with early-to-mid layers identified as sufficient for segmentation recovery. Restricting LoRA to these layers matches or approaches full-layer segmentation while reducing classification degradation in the three affected backbones, providing a mechanistically grounded strategy that is more parameter-efficient and more robust than standard full-layer adaptation.

[110] SplatFlux: Feed-Forward 4D Gaussian Reconstruction and Generation from Video Latents cs.CVPDF

Runmin Zhang, Binglin Ren, Zhu Yu, Fudong Wang, Jiangke Lin

TL;DR: SplatFlux 将观察视频与条件生成内容统一映射到预训练视频潜空间，再前馈解码为 4D Gaussian；静动态解耦表示和蒸馏伪标签帮助构建时序一致场景，在重建与生成基准上达到 SOTA。

Details

Motivation: 视频 4D 重建和条件 4D 生成常被分开处理，但观察视频与条件生成内容都可表示于同一预训练视频潜空间。如何从该潜表示高效构建紧凑、时序连贯的 4D 场景是关键。

Result: SplatFlux 是前馈潜变量到 4D Gaussian Splatting 框架，同时支持视频 4D 重建和条件生成。它采用静态—动态解耦的 4D Gaussian 表示，为每个高斯原语显式预测动态概率，从而分离静态结构与运动区域，并通过静态聚合和动态运动插值前馈构建完整 4D 场景。为避免昂贵标注，作者设计辅助蒸馏策略生成动态掩码和光流伪线索，以学习静动态分解与动态高斯运动。多项 3D/4D 重建和生成实验显示，SplatFlux 达到最先进表现。

Insight: 共享视频潜空间允许把重建和条件生成统一为同一解码问题；显式动态概率再将稳定背景与运动区域拆开处理。伪动态掩码和光流蒸馏降低了时空分解对人工标注的依赖。

Abstract: This work presents SplatFlux, a feed-forward latent-to-4DGS framework for both video-based 4D reconstruction and conditional 4D generation. Our key observation is that observed videos and conditionally generated content can be represented in the same pretrained video latent space, allowing both tasks to be formulated as latent-to-4DGS decoding. To construct compact and temporally coherent 4D scenes, SplatFlux introduces a static-dynamic decoupled 4D Gaussian representation that explicitly predicts dynamic probabilities for Gaussian primitives. This representation separates static scene structures from moving regions, enabling complete 4D scene construction in a feed-forward manner through static aggregation and dynamic motion interpolation. To learn static-dynamic decomposition and dynamic Gaussian motion without costly annotations, we further develop an auxiliary distillation strategy that provides pseudo dynamic masks and optical-flow cues. Extensive experiments across 3D and 4D reconstruction and generation demonstrate that SplatFlux achieves state-of-the-art performance.

[111] PI-MLLM: Psychophysics-Inspired Multimodal Large Language Model for Oddly Satisfying Video Emotion Analysis cs.CV | cs.AIPDF

Yuheng Zhang, Jie Zhang, Yuecong Min, Yunwei Zhao, Meichen Liu

TL;DR: PI-MLLM 用心理物理启发的动态对齐和 Shapley 模态归因分析“令人解压”视频情绪，配套构建 12,000 段带多模态情绪及感官证据解释的 OSVD，提升情绪预测和解释质量。

Details

Motivation: 重复动作、视觉触感和类似 ASMR 的声音可让“令人解压”视频产生强烈情绪反应，但其中显式语义线索较少。现有视频情绪分析多聚焦语义内容，较少建模影响观众反应的物理感官动态。

Result: 作者构建 Oddly Satisfying Video Dataset（OSVD），含 12,000 段带标注的 5 秒片段；每段分别提供纯视频、纯音频和视听条件下的观众情绪标签，以及基于视觉和声学感官证据的解释。心理物理启发模型 PI-MLLM 包含模态特定动态对齐（MSDA），以辅助预测目标对齐模态表示与视觉运动和声学能量起始动态；联盟式视听归因（CAVA）则比较不同模态联盟的情绪分数并用 Shapley 归因识别主导模态及视听证据是协同还是冲突。实验显示，PI-MLLM 改善观众情绪预测和感官证据支撑的解释质量。

Insight: 这类视频的情绪来自运动、触觉感和声音等物理线索，不一定能由语义内容解释。分别建模各模态动态并比较模态组合贡献，有助于说明观众反应由何种感官证据主导或共同产生。

Abstract: Oddly Satisfying Videos (OSVs) can evoke strong viewer responses through repetitive motion, visual tactility, and ASMR-like sounds despite containing few explicit semantic emotion cues. This makes OSVs a challenging setting for Video Emotion Analysis (VEA), since most existing methods focus on semantic video content and under-model the physical sensory dynamics that shape viewer responses. To support Oddly Satisfying Video Emotion Analysis (OSVEA), we construct the Oddly Satisfying Video Dataset (OSVD), comprising 12,000 annotated 5-second clips. Each clip provides viewer-emotion labels under video-only, audio-only, and audio-visual conditions, together with explanations grounded in visual and acoustic sensory evidence. Building on OSVD, we propose PI-MLLM, a psychophysics-inspired multimodal large language model that integrates Modality-Specific Dynamics Alignment (MSDA) and Coalition-Based Audio-Visual Attribution (CAVA). MSDA uses auxiliary prediction objectives to align modality representations with visual motion and acoustic energy-onset dynamics. CAVA evaluates emotion scores across modality coalitions and applies Shapley attribution to identify the dominant modality and determine whether visual and auditory evidence is synergistic or conflicting. Experiments show that PI-MLLM improves both viewer-side emotion prediction and sensory-grounded explanation quality, suggesting the value of physical sensory cues to video emotion analysis.

[112] VGL-stGen: Learning a shared multimodal model for lung histology and spatial transcriptomics cs.CV | cs.AI | q-bio.QMPDF

Haenara Shin, Dongjoo Lee, Sungwoo Bae, Kwon Joong Na, Daeseung Lee

TL;DR: VGL-stGen 将医学视觉语言骨干适配到肺组织 H&E 与空间转录组数据，单一检查点支持 13 项组织、细胞类型和基因任务；配对图像确实补充了已观测表达之外的信息。

Details

Motivation: 组织形态与分子状态之间的关系可由 H&E 图像和空间转录组共同反映，但如何把组织图像、基因表达及细胞类型信息整合到统一生成模型仍具挑战。

Result: VGL-stGen 从预训练医学 VLM 适配而来，使用配对肺部 H&E 与空间转录组数据及单细胞参考训练；联合图像—表达、表达—细胞类型样本，并以基因条件伪标签把转录组细胞类型监督迁移到组织图像。一个部署检查点支持 13 项评估任务，包括组织和细胞类型分类、基因预测，以及根据组织图像、细胞身份和已观测基因表达组合进行条件表达补全。任务专用解码器输出类别、基因列表或结构化表达值；补全时固定查询基因身份并自回归预测其表达水平可改善结构化预测，只监督请求的表达 token 也进一步提升图像条件补全。图像置换实验表明，正确配对的组织图像能提供已观测表达之外的信息。外部分类部分依赖标注来源共享的计算参考，且部分 H&E 来源在癌症训练或开发期间已暴露。

Insight: 共享生成模型可把组织形态与空间分子状态连接起来，并用单一检查点覆盖多种分类和表达预测任务。图像配对确有增量信息，但外部验证受到参考标注谱系重叠和图像来源暴露的限制，解读迁移结果时需考虑这些条件。

Abstract: VGL-stGen is a multimodal large language model adapted from a pretrained medical vision-language model using paired lung H&E and spatial transcriptomics with single-cell references. Training integrates image-expression and expression-cell-type pairs, and gene-conditioned pseudo-labels transfer transcriptomic cell-type supervision to histology images. One deployed checkpoint supports thirteen evaluated tasks spanning tissue and cell-type classification, gene prediction and conditional expression completion from combinations of histology, cell identity and observed gene expression. Task-specific decoding produces categorical labels, gene lists and structured expression levels. For conditional completion, fixing queried gene identities and predicting their levels autoregressively improves structured prediction. Controlled adaptation shows that restricting supervision to requested expression-level tokens can further improve image-conditioned completion. Image-permutation experiments indicate that correctly paired histology adds information beyond observed expression. External classification relies partly on computational references with shared annotation lineage, and some H&E sources were exposed during cancer training or model development. Within these conditions, VGL-stGen demonstrates how a medical vision-language backbone can learn from spatial transcriptomics and histology to connect tissue morphology and molecular states through shared generative modeling.

[113] ABACUS: A Benchmark for Image Editing Models to Assess Object Category and Counting Under Scene Conservation cs.CV | cs.AI | cs.LGPDF

Aymen Lassoued, Angelique Loesch, Romaric Audigier

TL;DR: ABACUS 以实例级真值检查图像编辑是否达到指定物体数量并保留其余场景，不依赖 VLM/MLLM 评审计数；评测显示编辑模型的数量错误会随场景复杂度和目标数量增加而加剧。

Details

Motivation: 指令式图像编辑模型能按要求添加、删除物体或改变类别，同时保留场景，但常无法生成正确数量，复杂场景和更大计数要求会让问题更突出。现有基准依赖整体相似度或不擅长计数的 VLM 评审，可能漏掉或误判数量错误。

Result: ABACUS 提供数字图像编辑基准、协议和专用评分指标。评测不让 VLM/MLLM 为编辑打分或数物体，仅在罕见歧义裁剪图的类别确认中使用 VLM；实例级协议将编辑结果与经检测器共识确认的全景真值核对，分别检查 add、remove、change 操作是否达到准确目标数量，以及其余场景是否保持。对领先图像编辑器的评测发现，数量编辑失败显著，且随场景复杂度和物体数量增加而恶化；既有基准常未发现或误判这些错误。

Insight: 图像编辑的数字要求需要实例级核验，整体图像相似度不足以验证“恰好增加/删除几个”以及场景是否保持。避免让计数能力有限的模型担任评审，可更准确测出当前编辑模型的数量控制边界。

Abstract: Instruction-based image editing models can now add, remove a specified number of objects or change their category while preserving the scene. Yet these models often fail to produce the correct number, and these failures grow sharply as scenes become more complex and the requested count increases. Current benchmarks largely miss this problem: they score edits with holistic similarity metrics or with vision-language model (VLM) judges that are themselves poor at counting, so numerical errors go unnoticed or are graded incorrectly. As a result, the true numerical ability of today’s editing models has never been accurately measured. We address this issue with ABACUS, a new benchmark, evaluation protocol and dedicated scoring metric for numerical image editing. Our protocol is judge-free: no VLM or MLLM scores an edit or counts objects (a VLM only confirms the category of rare ambiguous crops). Instead, it verifies each edit at the instance level against panoptic ground truth confirmed by detector consensus, checking both that the exact requested count was achieved and that the rest of the scene was preserved, across the add, remove and change operations. By evaluating leading image editors, our method reveals substantial numerical editing failures that worsen with increasing scene complexity and object count; failures that prior benchmarks often overlooked or misjudged.

[114] PACE: Plan, Attend, Check, and Emit for Training-Free Response Timing in Streaming Video Understanding cs.CVPDF

Siqi Guo, Yuxia Chen, Wenbo Zhu, Yangguang Ji, Zhenxiang Jiang

TL;DR: PACE 为流式视频问答提供免训练的回答时机控制：先规划需要观察的事件，再检查答案稳定性、引用帧支持度和事件是否结束；在 ProactiveVideoQA 与 OVO-Bench Forward 上提升 PAUC 和准确率。

Details

Motivation: 流式视频理解不仅要回答什么，还要决定何时回答。证据逐步到达，事件尚未结束就提前作答是常见错误。现有方法常需额外训练；免训练方法又多依赖单一标量门控，未明确表示答案何时才算最终成立。

Result: PACE 将流式错误分为三类：采样变化导致答案不稳定；答案稳定但当前视频证据不支持；当前证据支持答案但事件尚未结束。框架无需训练，先为问题制定观察计划和完成信号；视频流推进时，在信息量较高的时刻调用现成视频 LLM，并检查草稿稳定性、引用帧落地情况及事件完成状态，将核验后的观察记入事件账本。在 ProactiveVideoQA 和 OVO-Bench Forward 上，跨专有及开源骨干模型，相较官方协议最高提升平均 PAUC 5.9 点、平均准确率 6.2 点，达到最先进表现。

Insight: 回答稳定不代表已有充分视觉依据，依据充足也不代表事件已经结束；流式系统应分别检查这三种条件。先规划观测目标，再以引用帧核验和事件完成状态决定输出时机，可以避免只依赖答案置信度过早回应。

Abstract: Streaming video understanding requires a model to decide not only what to answer but also when to answer. Evidence arrives progressively, and recent benchmarks identify premature responses, issued before the queried event has concluded, as a recurring failure mode. Existing approaches often learn response timing through additional training, while training-free alternatives typically rely on scalar gating signals that do not explicitly represent when an answer becomes final. We organize chunk-wise streaming errors into three patterns: sampling variation can make an answer unstable, a stable answer may lack support in the observed video, or an answer may be supported by the current evidence while the event remains unfinished. We propose PACE (Plan, Attend, Check, and Emit), a training-free framework designed around these three failure modes. Given a question, PACE drafts a plan specifying what to observe and what will signal completion. As the stream unfolds, it invokes an off-the-shelf video LLM at informative moments, evaluates each draft for stability, grounding in its cited frames, and completion, and records verified observations in an event ledger. Experiments on ProactiveVideoQA and OVO-Bench Forward show that PACE improves over the official protocols by up to 5.9 average PAUC points and 6.2 average accuracy points across proprietary and open-source backbones, yielding state-of-the-art performance.

[115] Auto-Director: Leveraging Multi-Agent Collaboration for Autonomous Video Editing cs.CVPDF

Yuxia Chen, Wenbo Zhu, Yangguang Ji, Zhenxiang Jiang, Teng Zhong

TL;DR: Auto-Director 以规划、素材、剪辑和评论智能体模拟专业视频后期流程，并提出含 100 个主题的 VEdit-Bench；实验显示其自动指标和人工评价均优于基线。

Details

Motivation: 从开放资源自动剪辑视频仍困难：检索方法受固定素材限制、创作灵活性不足；生成模型则难维持长程连贯，容易偏离用户意图。两类方案都难复现专业后期制作的多阶段结构化推理。

Result: Auto-Director 是工具增强多智能体框架，模拟专业编辑流程：规划智能体用检索增强规划把抽象主题拆成有事实依据的脚本；素材智能体通过镜头分割和视觉标注索引开放视频；编辑智能体借助 MLLM 空间适配并组装语义匹配片段；评论智能体通过反思—修订循环检查场景匹配和节奏。作者提出 VEdit-Bench，含 100 个专家策划主题、人类标注黄金脚本及五维指标：叙事逻辑、事实准确、语义对齐、构图质量和风格连贯。实验中 Auto-Director 在自动指标和人工评价上均显著优于基线。

Insight: 把策划、素材检索、剪辑和审片分解为有工具支撑的协作阶段，能更接近专业制作流程，并在迭代中检查事实、语义、节奏和风格。专家脚本和多维人工相关指标使自动剪辑系统的评估不局限于单一视觉质量分数。

Abstract: Autonomous video editing from open-world resources remains a challenging problem in multimedia content creation. Retrieval-based methods are constrained by fixed source material and lack creative flexibility, while generative models struggle with long-horizon coherence and often diverge from user intent. Both paradigms fail to replicate the structured, multi-stage reasoning that underlies professional post-production. To address these limitations, we present Auto-Director, a tool-augmented multi-agent framework that mirrors professional editorial workflows: a Planning Agent decomposes abstract topics into fact-grounded scripts via retrieval-augmented planning; a Material Agent indexes open-world footage through shot segmentation and visual tagging; an Editor Agent assembles semantically aligned clips with MLLM-driven spatial adaptation; and a Critic Agent governs an iterative Reflect-and-Revise loop that checks scene-level alignment and pacing. To rigorously evaluate this new paradigm, we introduce VEdit-Bench, a benchmark of 100 expert-curated topics with human-annotated Golden Scripts and a five-dimensional metric suite covering Narrative Logic, Factual Accuracy, Semantic Alignment, Compositional Quality, and Stylistic Cohesion. Extensive experiments demonstrate that Auto-Director significantly outperforms baseline methods in both automated metrics and human evaluation, effectively bridging the gap between amateurs and professional-grade video production.

[116] Gated Prototype Transfer for Zero-Support Medical Vision Language Model cs.CV | cs.AIPDF

Sumaiya Fazal, Rizwan Qureshi, Laleh Behjat, Samira Ebrahimi Kahou

TL;DR: GProtoT 将已支持类别的视觉残差按 VLM 相似度和医学本体距离迁移到无支持类别，并用免验证证据门控制迁移；在 MESSIDOR 真实单样本试验中降低负迁移频率至 2%。

Details

Motivation: 现实少样本医学 VLM 适配时，低患病率类别可能没有任何带标签支持。免训练 SS-Text+ 仍可运行，但无支持类别只能退回纯文本原型，缺乏视觉适配。直接迁移知识又可能把不相关视觉证据带入缺失类别。

Result: Gated Knowledge-Guided Prototype Transfer（GProtoT）是排斥前模块，根据 VLM 相似度和基于本体的临床距离，将有支持类别的视觉残差转移给缺失类别；无需验证集的证据门依据语义相关性和残差一致性缩放迁移，限制无证据外推。在 MESSIDOR、FLAIR 特征的 50 次配对真实单样本试验中，严重及增殖性糖尿病视网膜病变始终无支持。相较 SS-Text+，GProtoT 使缺失类召回提高 5.23 点、平均类别准确率提高 1.37 点、缺失/支持类召回调和均值提高 1.83 点；负迁移频率从无门控转移的 46–48% 降到 2%。代价是支持类召回下降 1.20 点、top-1 准确率下降 0.45 点。方法无需梯度、验证数据或额外模型推理。

Insight: 在缺失类别上借用相关类别视觉知识可提升召回，但无约束迁移容易造成负迁移。以语义相关性和残差一致性作为证据门，能大幅降低负迁移风险，同时带来少量支持类性能代价。

Abstract: Realistic few-shot adaptation of medical vision-language models (VLMs) can leave low-prevalence classes without any labeled support. The training-free SS- Text+ solver remains operational in this setting, but its zero-support prototypes receive no visual adaptation and fall back to a purely textual class prototype. We in- troduce Gated Knowledge-Guided Prototype Transfer (GProtoT), a pre-repulsion module that transfers supported-class visual residuals to missing classes using VLM similarity and an ontology-based clinical distance. A validation-free evidence gate scales transfer based on semantic relevance and residual agreement, thereby limiting unsupported extrapolation. In 50 paired realistic one-shot trials on MESSIDOR with FLAIR features, severe and proliferative diabetic retinopathy were absent from every support set. Relative to SS-Text+, gated ProtoT improved missing-class recall by 5.23 points, average class accuracy by 1.37 points, and the missing/supported recall harmonic mean by 1.83 points. It reduced negative- transfer frequency from 46-48% for ungated transfer to 2%, while at the cost of reductions of 1.20 percentage points in supported-class recall and 0.45 percentage points in top-1 accuracy. These results indicate that evidence-based gating provides a safety mechanism for the knowledge source. GProtoT is based on SS- Text+ and requires no gradients, validation data, or additional model inference, of- fering a low-compute path toward accountable adaptation under incomplete clini- cal supervision. Code is available: https://github.com/sumaiyaafridi/GProtoT

[117] RayCo4D: Ray-Conditioned Continuous Motion Model for Monocular 4D Dynamic Reconstruction cs.CV | cs.AIPDF

Yuanxiang Ni, Xianliang Huang, Ruihan Hou, Feng Xie, Hao Zhang

TL;DR: RayCo4D 将单目轨迹观测与潜在 3D 运动状态分开建模，用相机射线约束参考时刻点查询，并以连续时间 SE(3) 状态和加速度先验融合间断轨迹；在快速运动和缺失轨迹下提升时空一致性。

Details

Motivation: 从单目视频重建动态 3D 场景需要从噪声且间歇可见的观测推断运动。长程轨迹可提供几何约束，但如何将覆盖零散的观测整合为共享、连续的运动仍困难。

Result: RayCo4D 将视觉测量与潜在三维运动状态显式分离。每条轨迹关联一个受相机射线约束的参考时刻 3D 查询；图像与深度观测通过局部多对多关联约束共享潜在运动节点。各节点在稀疏支持时刻维护 SE(3) 位姿和物体坐标系速度，并用加速度白噪声过程先验耦合相邻状态、定义连续时间插值，使跨可见性区间的观测共同约束同一状态序列。推断出的共享运动通过双四元数混合传递给高斯原语，参考时刻锚定的局部 SE(3) 残差再表示超出共享骨架的细粒度非刚性形变。多样单目动态场景实验显示，方法新视角合成质量有竞争力，并在快速运动和轨迹不完整时提升结构及时间一致性，支持连续时间渲染。

Insight: 通过共享潜在运动节点连接间断轨迹，可让不同可见区间共同约束连续时序状态；加速度过程先验则提供物理平滑的连续时间插值。将共享运动与局部形变分开，有利于兼顾场景整体一致性和非刚性细节。

Abstract: Reconstructing dynamic 3D scenes from monocular video requires inferring motion from noisy and intermittently visible observations. Long-range tracks provide valuable geometric constraints, but integrating their fragmented temporal coverage into shared, continuous motion remains challenging. We introduce \textbf{RayCo4D}, a ray-conditioned continuous motion model for monocular 4D reconstruction that explicitly separates visual measurements from latent 3D motion states. Each track is associated with a reference-time 3D query constrained to its camera ray, and its image and depth observations constrain shared latent motion nodes through local many-to-many associations. Each node maintains an $\mathrm{SE}(3)$ pose and body-frame velocity at sparse support times. A white-noise-on-acceleration process prior couples neighboring states and defines continuous-time interpolation, allowing observations across visibility intervals to jointly constrain the same latent state sequence.The inferred shared motion is transferred to Gaussian primitives through dual-quaternion blending, while reference-anchored local $\mathrm{SE}(3)$ residuals capture fine-scale non-rigid deformation beyond the shared scaffold. Experiments on diverse monocular dynamic scenes show that RayCo4D achieves competitive novel-view synthesis quality, improves structural and temporal consistency under rapid motion and incomplete tracks, and supports continuous-time rendering.

[118] CountVideoBench: A Benchmark to Evaluate Prediction Biases on the Object Counting task by Video-Language Models cs.CV | cs.AI | cs.LGPDF

Marc Chapus, Carlos Crispim-Junior, Véronique Eglin, Atilla Baskurt

TL;DR: CountVideoBench 用 2,600 段静态物体、受控相机运动视频覆盖 5–50 共 26 种计数，发现 16 个视频语言模型准确率均不超过 27.6%，且各模型偏好不同整数。

Details

Motivation: 现有视频问答基准虽包含计数题，但真值数量严重偏向小数值：九个基准的中位数最多为 5，三个最常见数值合计占 45%–93%。因此均值准确率被常见数量主导，稀有数量上的系统偏差不易显现。

Result: CountVideoBench 收录 2,600 段合成视频，覆盖区间 [5,50] 中 26 种数量，每种 100 段；按相邻数量分为六组，便于近邻比较。每段只含一类静止物体和受控相机运动，以排除物体运动并降低识别混淆。作者零样本评测九个架构家族的 16 个视频语言模型，没有模型 Exact Match 超过 27.6%。不同模型的准确率随数量变化形式不一，从单调下降到先升后崩溃，说明数量增大带来的难度不是失败的唯一主因；每个模型还把预测集中在自己偏好的整数上，准确率峰值出现在这些数字，邻近数量上则骤降。

Insight: 均衡覆盖数量并设计相邻数量对照，才能揭示常见数值先验导致的计数偏差。模型的偏好整数各不相同，且准确率曲线不都随数量单调下降，因此不能把计数失败简单归结为数量越大越难。

Abstract: Object counting in videos remains a poorly characterized capability of multimodal large language models. Counting questions are included in many existing VideoQA benchmarks, but the ground-truth count distributions in these benchmarks are heavily skewed toward small values. Across the nine benchmarks we survey, the median ground-truth count is at most five, and the three most frequent values together account for between 45% and 93% of the videos. The resulting mean accuracy is then dominated by the most frequent counts; a value-dependent bias at a rare count contributes negligibly to the average and remains invisible. We introduce CountVideoBench, a benchmark of 2,600 synthetic videos covering 26 cardinalities in the interval [5, 50] (100 videos each), grouped into six clusters of consecutive counts that span the range while enabling near-neighbor comparisons. Each video contains a single class of static objects under a controlled camera motion, removing object motion and reducing recognition as confounds. We evaluate sixteen video-language models from nine architecture families in a zero-shot setting. No model exceeds 27.6% Exact Match. The dependence of accuracy on cardinality varies across models, ranging from monotonic decline to a non-monotonic peak-and-collapse pattern, which rules out increasing difficulty with cardinality as the dominant explanation of counting failure. Every model further concentrates its predictions on its own set of preferred integers, with accuracy peaks coinciding with these values and collapsing at adjacent counts. These findings highlight the need for balanced, diagnostic counting benchmarks to reliably assess this fundamental visual capability.

[119] RACE: Learning Multimodal Search through Referential Abstraction and Compositional Evidence cs.CVPDF

Eric Tao, Minhao Sun, Liyan Liu, Zhijing Wu, Xiaohan Yu

TL;DR: RACE 用图像条件化任务合成建立“图像—目标—答案”依赖，并通过指代抽象和组合证据迫使搜索智能体查看视觉证据；仅用 12K 生成轨迹微调后，十个多模态基准平均准确率由 53.5 升至 56.0。

Details

Motivation: 训练多模态搜索智能体需要任务本身确实依赖视觉搜索。合成问题中的文本身份线索和未用上的目标证据可能让模型走捷径，削弱视觉搜索和证据整合学习。

Result: RACE 是图像条件任务合成框架，显式构建图像到目标、目标特定证据到答案的依赖。指代抽象将泄露身份的文字替换为具体视觉指示或需要搜索候选后才能解析的模糊关系指称；组合证据则将一张图中的多个实体事实或跨图实体事实连成联合问题，要求答案整合所有指定贡献。搜索中新发现的图像也可决定后续搜索目标或提供答案证据。仅用 RACE 生成的 12,000 条轨迹微调 Qwen3.5-27B，十个多模态基准平均准确率从 53.5 提升至 56.0，相对匹配基础智能体约提升 4.7%。

Insight: 任务监督必须让答案依赖所找到的图像及目标证据，才能避免模型靠文本线索绕过搜索。指代抽象和组合证据分别强化“找到正确实体”和“汇总多项依据”，且少量合成轨迹即可改善多个基准上的表现。

Abstract: Training multimodal search agents requires tasks that make visually grounded search necessary for determining the answer. Textual identity clues and unused target evidence allow shortcuts in synthetic questions, weakening supervision for visual search and evidence integration. We propose RACE, an image-conditioned task synthesis framework that constructs dependencies from images to targets and from target-specific evidence to answers. Referential Abstraction (RA) replaces identity-revealing text with specific visual references or ambiguous relational references resolved by searching among depicted candidates. Compositional Evidence (CE) links retrieved facts about multiple entities in one image or entities from different images into joint questions whose answers require every designated contribution. Both operations also apply to images found during search, allowing new visual observations to determine subsequent search targets or supply answer evidence. Fine-tuning Qwen3.5-27B on only 12K teacher-generated trajectories from RACE raises average accuracy across ten multimodal benchmarks from 53.5 to 56.0, a relative improvement of approximately 4.7% over the matched base agent. Our code, data, and model will be publicly available.

[120] VisualEvolve: A Skill Self-Evolution Framework for Visual Reasoning cs.CV | cs.AIPDF

Jiawei Wang, Yucun Li, Xueqi Li, Shenghao Wang, Xinquan Gong

TL;DR: VisualEvolve 以“选择—执行—进化—评估”循环更新 VLM 可复用视觉操作和工具策略，用验证集快照选择抑制回退、分层证据访问定位能力缺口；24 种设置中 23 种优于初始技能库。

Details

Motivation: 视觉工具可帮助 VLM 获取任务证据，但预定义操作和训练时学到的工具策略会限制效果。把操作与策略表示为外部技能可在不更新模型参数时自我改进，但技能修订可能造成性能回退；同时检查大量执行轨迹及进化历史也会导致证据过载。

Result: VisualEvolve 通过选择、执行、进化、评估循环更新可执行视觉操作和工具使用策略。技能库快照选择使用与执行任务不相交的固定验证集，挑选有效历史版本，限制性能回退传播；渐进证据访问（PEA）按粗到细顺序提供技能表现报告、进化日志、轨迹摘要和相关原始片段，以诊断能力缺口。在四种 VLM 骨干、三个基准的六个评测集共 24 种设置中，23 种优于初始技能库；Qwen3.5-Plus 在 VisualProbe Hard 上最高提升 15.1 个百分点。消融支持快照选择与 PEA 的作用；跨数据设定的经验可改进技能，并能在不同骨干间复用。相较代表性强化学习方法估算所需轨迹，VisualEvolve 用少一个数量级以上的任务轨迹即可进化技能。

Insight: 外部技能可在不微调 VLM 参数的情况下累积改进，但必须通过独立验证快照防止修订回退，并分层查看证据避免轨迹过载。技能跨任务经验和跨骨干复用，也让自我进化比依赖大量 RL 轨迹更节省数据。

Abstract: Visual tool use enables vision-language models (VLMs) to acquire task-relevant evidence, but its effectiveness can be limited by predefined visual operations and the tool-use strategies learned during training. Representing these operations and strategies as reusable external skills allows them to be refined through self-evolution without updating model parameters. However, skill refinement can introduce performance regressions. Meanwhile, inspecting accumulated task execution trajectories together with skill evolution history may lead to evolution evidence overload. To address these challenges, we propose VisualEvolve, a self-evolving framework that evolves executable visual operations and tool-use strategies for VLMs through a Select–Execute–Evolve–Evaluate cycle. Skill-Library Snapshot Selection uses performance on a fixed validation set disjoint from execution tasks to select an effective historical snapshot for subsequent evolution, limiting the propagation of performance regressions. Progressive Evidence Access (PEA) guides capability-gap diagnosis through a coarse-to-fine hierarchy comprising the Skill-Performance Report, Evolution Log, Trajectory Summaries, and relevant raw trajectory segments. Across four VLM backbones and six evaluation sets from three benchmarks, VisualEvolve improves over the Initial Skill Library in 23 of 24 settings, with a maximum gain of 15.1 percentage points on VisualProbe Hard using Qwen3.5-Plus. Ablation studies support the contributions of Snapshot Selection and PEA, while further experiments show that skills can be improved using experience from different data settings and directly reused across backbones. Moreover, VisualEvolve enables effective skill self-evolution with over an order of magnitude fewer task-solving trajectories than estimated for representative RL-based methods.

[121] StreamEval: Evaluating Interactive Streaming Video Generation Models cs.CVPDF

StreamEval Team

TL;DR: StreamEval 以 300 个交互案例评测 37 种流式视频生成模型，覆盖五类任务及执行、状态一致性、视觉保真和视听协调；结果显示画面质量高不等于能可靠执行持续请求。

Details

Motivation: 随着流式视频生成发展，用户与生成视频实时交互变得重要，但缺少统一评测来检验模型能否遵循持续到来的多模态请求、保持状态并协调视听内容。

Result: StreamEval 覆盖虚拟人对话、虚拟人表演、世界生成、指令编辑和参考编辑五类任务，含 300 个时长 15–300 秒的脚本案例，明确指定初始素材、逐步到达的多模态请求、状态变化及需保留内容。评测从任务执行、状态一致性、视觉保真和视听协调四方面以十项任务指标打分。对 37 种模型评估显示，较高画质和身份保留并不必然带来可靠请求执行或持续状态一致性。执行仍困难：七种虚拟人表演模型的 Following 最高 36.90，文本条件世界生成的 Following 最高 25.93，三种报告参考编辑模型的 Edit Success 最高 15.00。

Insight: 实时交互生成不能只看单帧质量或身份保持，还要看模型是否按时执行请求、维持状态并保留指定内容。当前请求执行分数偏低，说明在时间和内容约束下可靠响应仍是多模态交互系统的核心瓶颈。

Abstract: As streaming video generation advances, enabling real-time interaction with generated video is becoming increasingly important. We introduce StreamEval, a unified benchmark for interactive streaming video generation spanning five tasks: avatar dialogue, avatar performance, world generation, instruction editing, and reference editing. StreamEval comprises 300 scripted test cases lasting 15-300s, each specifying initial assets, incrementally arriving multimodal requests, and explicit requirements for state changes and content preservation. Performance is assessed along four evaluation dimensions: task execution, state consistency, visual fidelity, and audiovisual coordination, instantiated through ten task-specific metrics on a 0-100 scale. Evaluating 37 distinct models across 300 test cases, we find that high visual quality and identity retention do not necessarily coincide with reliable request execution or sustained state consistency. In particular, request execution remains challenging: the highest task-specific scores are 36.90 for Following among seven avatar-performance models, 25.93 for Following in text-conditioned world generation, and 15.00 for Edit Success among three reported reference-editing models. These findings identify reliable request execution under timing and preservation constraints as a central challenge for advancing omni-modal real-time interactive systems. The leaderboard is available at https://streameval.ai

[122] A Multi-Agent Framework for Automated Machine Learning with Evidence-based Planning for Medical Image Analysis cs.CVPDF

Yiqing Shen, Mathias Unberath

TL;DR: MedicalMLOmni 用多智能体和自然语言接口自动化多类单模态与多模态医学建模，通过检索已发表结果做证据规划并并行调参；在 20 个基准中 19 个获最高分。

Details

Motivation: 深度学习虽已成为医学图像分析常用工具，但为特定任务选架构和调超参数仍常依赖经验。通用 AutoML 缺少医学架构与预处理，医学专用方案又需要较强工程能力并局限于少数任务。

Result: MedicalMLOmni 是多智能体 AutoML 框架，通过自然语言界面自动训练多种单模态和多模态医学任务。它检索已发表结果作为模型选择和配置的证据，并让多个智能体并行探索超参数策略。20 个基准中，MedicalMLOmni 在 19 个取得最高分；例外是 PMC-VQA，由预训练范围更广的视觉语言模型领先。骨干匹配控制实验将收益归因于框架，而非主干模型。

Insight: 医学 AutoML 的难点不只在搜索算法，还在于使用合适医学架构、预处理和可复用经验。将文献证据用于规划、并行调参交给多个智能体，可减少编码门槛，使拥有数据但工程资源有限的领域研究者也能开展实验。

Abstract: Deep learning has become the default tool for medical image analysis, driven by the open-source movement. However, achieving the best performance on a given task remains difficult, with architecture selection and hyperparameter optimization (HPO) still considered “more of an art than a science”. Automated machine learning (AutoML) automates parts of model training, yet helps little in medical imaging: general-purpose approaches lack medical architectures and preprocessing, and medical-focused ones demand engineering expertise and remain confined to narrow tasks such as 3D segmentation. We introduce MedicalMLOmni, a multi-agent AutoML framework that automates model training for diverse single- and multi-modal medical tasks through a natural language interface. Specifically, MedicalMLOmni performs evidence-based planning by retrieving published results to guide model selection and configuration, and employs parallel HPO where multiple agents explore adjustment strategies concurrently. MedicalMLOmni achieves the best score on 19 of 20 benchmarks; PMC-VQA is the exception, where a vision-language model with broader pre-training leads. Backbone-matched controls attribute the gains to the framework, not the backbone. By removing coding requirements, MedicalMLOmni lowers the barrier for domain experts with rich datasets but limited engineering expertise.

[123] Code2Video-Compass: A Comprehensive Benchmark for General-Purpose Code-Based Video Generation across T2V, I2V, and V2V cs.CV | cs.AIPDF

Zhenghan Chen, Zekai Shao, Xin Lin, Leting Cheng, Siming Chen

TL;DR: Code2Video-Compass 以 2,104 项任务评估 MLLM 用代码生成完整文本、图像和视频条件视频，覆盖创作、动画和状态依赖复杂度；即使领先模型在复杂视频生成上仍不可靠。

Details

Motivation: 代码式视频生成可提供细粒度控制、定向编辑和组件复用，但要求 MLLM 将视觉与时间约束转成可执行程序。现有基准集中在专门任务，对不同创作类别和输入模态下完整视频生成评估不足。

Result: Code2Video-Compass 覆盖文本到视频、图像到视频和视频到视频，含 2,104 项任务、10 类、24 子类，并沿场景构建、动态动画和状态依赖三个维度设定复杂度。任务既包括文字指令和视觉参考，也包括从完整专业及用户视频派生的三类任务。评估结合 12 项客观指标（运行表现、视频质量、文本—视频对齐、参考保真）和五项主观指标，由 MLLM 评审指令遵循和整体质量。对九个模型家族的 15 种专有及开放模型评估发现，即使领先模型也难可靠生成同时符合文本和视觉要求的高质量完整视频，且复杂度上升时表现通常下降。

Insight: 代码控制能力需要在完整视频层面评估，不能只测专门编辑或生成操作。场景构建、动态动画和状态依赖会逐级增加难度；同时使用客观执行指标和整体主观评价，可暴露模型生成完整连贯视频的不足。

Abstract: Code-based video generation offers fine-grained control, targeted editing, and component reuse compared with direct video generation. This approach requires multimodal large language models (MLLMs) to translate visual and temporal requirements into executable programs that produce complete videos. However, existing code-based benchmarks primarily target specialized tasks, leaving complete video creation across diverse creative categories and input modalities insufficiently evaluated. We introduce Code2Video-Compass, a general-purpose benchmark for code-based video generation across text-to-video (T2V), image-to-video (I2V), and video-to-video (V2V) settings. Code2Video-Compass comprises 2,104 tasks spanning 10 categories, 24 subtypes, and three complexity dimensions covering construction, dynamic animation, and state dependency. It combines tasks curated from textual instructions and visual references with corresponding T2V, I2V, and V2V tasks derived from complete professional and user-created videos. We propose a dual-level evaluation framework combining 12 objective metrics and five subjective metrics. Objective evaluation covers operational performance, video quality, text-video alignment, and reference fidelity, while subjective evaluation uses an MLLM judge to evaluate instruction following and holistic video quality. Extensive evaluation of 15 recent proprietary and open-weight MLLMs from nine families reveals that even leading models face challenges in reliably generating high-quality complete videos aligned with textual and visual requirements, with performance generally declining as construction, dynamic animation, and state-dependency complexity increases. We anticipate that Code2Video-Compass will advance reliable, coherent, and controllable code-based video generation and inspire broader progress in programmatic visual creation.

[124] DISTRACT: Degradation-Indexed Study of Textual Reference Across Competing Targets cs.CV | cs.AI | cs.LGPDF

Dan Zlotnikov, Ohad Ben-Shahar

TL;DR: DISTRACT 用匹配干预测试 VLT 是否真正利用文本目标描述，并交叉控制四种文本先验与四级视觉退化；仅 Molmo2 和 JointNLT 显示定向文本使用证据，且作用依赖较早内部状态。

Details

Motivation: 视觉语言跟踪器接受文本描述不代表文本内容真的影响了跟踪决策，尤其在视觉证据退化时。需要控制视频、目标和干扰物，系统改变文本先验与图像退化程度，识别文本何时、何处影响跟踪。

Result: DISTRACT 在固定视频、目标和干扰物条件下，将四种文本先验与四级图像退化交叉组合，对五种 VLT、四个数据集进行行为对比、逐层表示探测和激活 patching。Molmo2 与 JointNLT 显示定向文本使用；部分作用在退化时减弱，部分端点变化经多重校正后不显著。UVLTrack、MMTrack、DUTrack 对文本语义变化反应较弱，在所测设置中没有经 FDR 校正仍显著的定向行为效应。决策附近状态中，只有 Molmo2 与 JointNLT 可解码正确/冲突文本；这些模型的可解码性在较晚状态达到峰值但替换对行为影响小，替换选定较早状态则可将冲突轨迹转向目标。匹配正确文本的供体未显著优于无关供体，因此干预仅定位到较早的可影响状态，不能证明目标特定语义救援。

Insight: 模型接收了文本并不意味着文本语义改变了跟踪；必须通过匹配干预测量行为因果效应。内部可解码也不等于对最终决策有影响，较早状态干预较晚状态替换更能改变跟踪，但研究未证明这种影响具有目标特定的语义恢复作用。

Abstract: Vision-language trackers (VLTs) accept descriptions intended to assist tracking, but accepting text does not establish that its content changes tracking decisions, particularly as visual evidence deteriorates. We introduce DISTRACT, a matched-intervention benchmark that holds video, target, and distractor fixed while crossing four text priors with four image degradations along a controlled severity axis. We evaluate five VLTs on four datasets using behavioral contrasts, layerwise representation probes, and activation patching. Molmo2 and JointNLT exhibit directed text use. Some effects contract under degradation, whereas others show no significant endpoint change after multiplicity correction. UVLTrack, MMTrack, and DUTrack respond only weakly to changes in text semantics, with no directed behavioral effect surviving FDR correction in the tested settings. Model-internal analyses reveal that at decision-near states, correct-versus-conflicting text is decodable in Molmo2 and JointNLT but not in the other three systems. In the responsive models, decodability peaks at late states where replacement produces little behavioral change, whereas replacing selected earlier states redirects conflict-associated trajectories toward the target. Because matched-correct donors do not significantly outperform unrelated donors, these interventions identify earlier intervention-sensitive states without establishing target-specific semantic rescue. DISTRACT thus exposes when and where text affects tracking under degraded visual evidence.

[125] EvaOmni: An Evidence-Grounded Benchmark for Audio-Visual Reasoning cs.CVPDF

Xiaoxing Hu, Wenxi Yao, Chaoyuan Shi, Ziqi Ye, Xiaorong Guo

TL;DR: EvaOmni 建立 392 段视频、1,027 个全人工标注问答的视听推理基准，要求同时给答案和证据区间；最高模型整体准确率 79.4%，但复杂推理级别的证据定位分仅 12.3%。

Details

Motivation: 现有视听推理基准多用选择题，只按答案正确与否打分，难以验证模型是否真的从音视频证据形成推理链；文本或单模态捷径也可能让模型碰巧答对。

Result: EvaOmni 含 392 个视频和 1,027 个人工问答，覆盖 15 项能力，分为证据检索定位、基础理解和复杂推理三级。专家标注音频与视觉证据并构建视频干扰项；人工审核问题符合严格检查标准，再由模型筛除文本和单模态捷径。模型须同时输出答案与支持证据的时间区间。Coverage Grounded Score（C.G.）衡量识别到多少标注证据，Bottleneck Grounded Score（B.G.）惩罚任一模态时间定位不准，二者均纳入答案正确评估。对 7 种开放权重和 17 种专有全模态模型测试，Gemini3.7-Flash 总体准确率 79.4%、C.G. 70.8%、B.G. 35.1% 为最高；第三级准确率 79.1%，但 B.G. 仅 12.3%。

Insight: 答对问题并不代表模型能找到支撑答案的音视频证据，尤其在复杂推理中时间定位仍然薄弱。将答案正确性与覆盖、定位同时计分，可识别纯准确率掩盖的落地推理差距。

Abstract: Omni LLMs can naturally locate key audio and visual evidence and integrate information across modalities for audiovisual reasoning. Existing audio-visual reasoning benchmarks that mainly rely on multiple-choice questions usually score models solely based on answer correctness, making it difficult to assess whether a model truly forms a reasoning chain from evidence to the correct answer. In addition, textual or unimodal shortcuts may allow models to answer correctly without analyzing the necessary audio-visual evidence, further weakening the reliability of evaluation benchmarks. To address these issues, we introduce EvaOmni, an evidence-grounded benchmark containing 392 videos and 1,027 purely human-annotated question-answer pairs, covering 15 capabilities and three levels: retrieval and localization, basic understanding, and complex reasoning. We design a series of rigorous annotation procedures in which experts annotate audio and visual evidence and construct video-based distractors; humans review whether questions meet strict inspection criteria, and finally models filter textual and unimodal shortcuts. Beyond high-quality question-answer pairs, we require models to simultaneously return the answer and supporting evidence intervals in order to evaluate the complete reasoning chain. We propose the Coverage Grounded Score (C.G.) to measure how much annotated evidence a model identifies, and the Bottleneck Grounded Score (B.G.) to penalize poor temporal localization in either modality; both are incorporated into answer correctness. Across 7 open-weight and 17 proprietary Omni LLMs, Gemini3.7-Flash achieved the highest overall accuracy (79.4%), C.G. (70.8%), and B.G. (35.1%). At Level 3, it reached 79.1% accuracy, but its B.G. was only 12.3%. These results show that even the most advanced models still have room for development in grounded audio-visual reasoning.

[126] Answering in the User’s Variety: Calibrated Accommodation Pairs for Post-Training cs.CVPDF

Zhizhuo Kou, Heming Li, Jian Yang, Junyu Luo, Jingshu Peng

TL;DR: 该研究审计后训练是否让模型适应用户方言：十个开放模型谱系中 DPO 更新对英式和澳式拼写的偏好高于 AAE 与 Singlish；校准式方言配对可改善匹配而不损害标准英语用户体验。

Details

Motivation: 人们会根据交谈对象调整表达方式，但聊天模型常无论用户使用何种方言都回复标准英语。输出审计难以看出后训练是否对不同用户群体进行了相同处理，因此需要直接检查 SFT、DPO 和强化学习各阶段偏好如何变化。

Result: 作者追踪十个开放模型谱系的后训练过程，并比较内容匹配但是否贴合用户方言不同的回复。统一回复会掩盖选择性更新：调整各回复原有可能性后，DPO 更新在十个谱系中仍更偏好匹配英式和澳式拼写，而非 AAE 和 Singlish；模型在被要求时仍能生成 AAE 特征。校准式适应配对（CAP）奖励模型匹配用户的方言密度，同时要求标准英语用户仍获标准英语回复。在全开放模型上，CAP 能提高对训练中未见特征的趋同，未检测到对标准英语用户增加方言或损害指令跟随；单向配对只有通过过度附加方言才能达到相似收益。

Insight: 相同的标准化输出可能掩盖后训练对不同方言特征的选择性偏好，因此审计不应只看生成结果，还要检查更新本身。配对数据应同时奖励对方言的适应和对标准英语用户的克制，避免把用户未使用的方言强加给他们。

Abstract: People adapt how they talk to the person in front of them. However, chat models tend to respond in Standard English regardless of the dialect used by the user. A uniform answer can hide whether training treats these users alike, and output audits cannot tell as well. We trace how each post-training stage, from supervised fine-tuning (SFT) to preference optimization (DPO) and reinforcement learning, changes a model’s tendency to match the user, and read what each update prefers from two content-matched replies, one matching the user and one not. Across 10 open model lineages, post-training standardizes replies to every informal cue, yet after adjusting for how likely each reply already was, the DPO update still favours matching British and Australian spelling over AAE and Singlish on 10 lineages, and models still produce AAE features when asked. We then introduce calibrated accommodation pairs (CAP), preference data that reward matching users’ dialect density while preserving Standard English for Standard-English users. On a fully open model, CAP raises convergence on features it was not trained on without a detectable increase in dialect for Standard-English users or a cost in instruction following. In contrast, one-sided pairs reach a similar gain only by overshooting the user and imposing dialect. Our findings show that uniform replies can hide selective updates and audits should read the update as well as the output. Code: https://github.com/kouzhizhuo/cap-accommodation.

Pengying Wu, Mingye Jiang, Yunze Hu, Zhejia Wen, Kangjie Zhou

TL;DR: CLOSER 将 ObjectNav 停止决策转化为闭环证据收集：对候选目标多视角判别、融合概率，不确定时主动移动补充观察；在 Gibson 与 HM3D 上成功率提高 3.6 点。

Details

Motivation: ObjectNav 要在陌生环境找到指定类别实例并停在附近，智能体需根据有限第一人称视频判断检测候选是否真为目标。检测器可能自信地把沙发误作床，而贪心接近策略还可能让候选持续被遮挡；对假阳性停车会导致任务失败。

Result: CLOSER 将停止视为闭环证据获取，结合 VLM 判断与主动感知。开源 VLM 微调后对跨帧跟踪候选的每个视角判为目标、非目标或不确定；基于嵌入多样性门控选择互补视角，再由轻量网络融合各视角概率。若判断仍不确定，扩散策略仅依据候选跟踪掩码和深度控制智能体靠近，直至证据足以决策。CLOSER 可本地运行并接入现有 ObjectNav 系统，无需重训导航器。在 Gibson 和 Habitat-Matterport 3D 上，平均成功率提高 3.6 个百分点，按路径长度加权成功率提高 2.0 点。

Insight: 在停止前先主动收集并融合互补视角，可以降低相似物体造成的误停；不确定时再接近候选，形成感知—行动—判别闭环。系统只需接入已有 ObjectNav，无须整体重训即可改善导航成功。

Abstract: Object-goal navigation (ObjectNav) requires an embodied agent to find an instance of a specified category in an unseen environment and stop near it. The agent typically relies on an object detector but must judge online from a limited egocentric video stream, sometimes a single frame, whether a detected candidate is the target. Detectors often confidently mistake similar objects, such as a sofa for a bed, and stopping at a false positive fails the episode. Prevailing systems also approach candidates greedily, leaving them occluded or partially observed. We present CLOSER, an evidence-aware active verification framework that treats stopping as closed-loop evidence acquisition, coupling vision-language model (VLM) verification with active perception. CLOSER fine-tunes an open-source VLM to label each view of a candidate tracked across frames as target, non-target, or uncertain, selects complementary views with an embedding-based diversity gate, and fuses their per-view probabilities with a lightweight network. If the fused judgment remains uncertain, a diffusion policy drives the agent toward the candidate using only the tracked mask and depth until the decision becomes decisive. CLOSER runs locally and plugs into existing ObjectNav systems without retraining them. On Gibson and Habitat-Matterport 3D, it raises average success rate by 3.6 points and success weighted by path length by 2.0 points, showing that verifying evidence before committing improves embodied navigation.

[128] Learning from Automatic 3D Gaussian Splatting Edits for Online Bayesian Scene Change Detection cs.CV | cs.GRPDF

Changrui Zhu, Simon Julier

TL;DR: 该方法通过自动编辑 3D Gaussian Splatting 参考场景生成带标签训练视图，学习在线场景变化证据模型与先验；在 PASLCD、CCS3D 上 mIoU 分别为 67.64% 和 75.82%，PASLCD 达 17.2 FPS。

Details

Motivation: 在线场景变化检测需要随着新图像到来持续更新参考场景哪些区域发生变化的信念，但变化先验和证据模型事先未知，数值贝叶斯推理也可能计算成本高。

Result: 作者离线自动编辑参考 3D Gaussian Splatting 场景，生成带标签训练视图，无需人工标注；再结合未变化参考观测，学习场景特定证据模型并估计有效像素先验及响应统计。在线预测将当前证据与历史支持结合，用由学习响应统计参数化的闭式局部 Bayes factor 更新累积 3D Gaussian 场，最后通过物体引导细化生成变化掩码。在 PASLCD 和 CCS3D 上分别达到 67.64% 与 75.82% mIoU，并取得最先进准确率；PASLCD 完整查询序列端到端速度为 17.2 FPS，是所评在线方法中最快。

Insight: 自动编辑 3DGS 可生成场景特定的监督视图，避免逐帧人工标注；学习到的响应统计又使在线贝叶斯更新可用闭式计算。结合历史证据和物体级掩码细化，既实现实时处理，也兼顾像素级变化判断。

Abstract: Online scene change detection requires integrating incoming observations to determine which regions have changed relative to a reference scene. We update change beliefs as new images arrive using generalised Bayesian evidence fusion. However, the prior probability of change and evidence models are unknown beforehand, and numerical Bayesian inference can be costly. We address these challenges by learning offline from automatic edits to a reference 3D Gaussian Splatting (3DGS) model. These edits generate labelled training views without manual annotations. Together with unchanged reference observations, they provide supervision for learning scene-specific evidence models and estimating the effective pixel prior and response statistics. Online prediction combines current evidence with historical support, while closed-form local Bayes factors, parameterized by the learned response statistics, update an accumulated 3D Gaussian field. Object-guided refinement produces the final change masks. Our method achieves state-of-the-art accuracy on PASLCD and CCS3D, with $67.64%$ and $75.82%$ mIoU, respectively. On PASLCD, the complete pipeline runs at $17.2$,FPS over complete query sequences, the fastest among the evaluated online methods.

[129] GazeLens for Efficient Egocentric Video Question Answering with Simple Gaze-Driven Adaptive Token Reduction cs.CVPDF

Trong-Thang Pham, Anh Nguyen, Hien Van Nguyen, Ngan Le

TL;DR: GazeLens 在视觉编码前用帧变化和清晰度筛选关键帧，再结合注视、问题和场景上下文把每帧压缩到两个 token；在 StreamGaze 上准确率高于全网格及 token 压缩基线，且 FLOPs 更低。

Details

Motivation: 智能眼镜有助理解用户活动与周围环境，但小型 VLM 计算预算有限。冗余帧会占用视觉上下文，过度空间压缩又可能丢失细节；注视反映佩戴者关注处，但问题也可能需要关注周围场景证据。

Result: GazeLens 联合帧选择与注视、问题引导 token 减少。先通过 HOG 变化和图像清晰度，在视觉编码前筛出帧；对每帧用高斯池化生成注视聚焦摘要和互补摘要，再由轻量门控根据问题相关性融合为主要 token。加上全局场景 token 后，每帧只保留两个 token，同时包含焦点和上下文信息。在 StreamGaze 上，GazeLens 的宏、微准确率均高于评测的全网格及 token 压缩基线；相较共享骨干的 token 压缩方法，输入前向 FLOPs 更低。

Insight: 只保留注视点会遗漏问题所需的周边线索，因此压缩时要联合焦点和互补场景摘要，并按问题动态融合。先筛帧再编码可避免冗余输入消耗预算，双 token 表示兼顾效率与上下文覆盖。

Abstract: Smart glasses can help users understand their activities and surroundings, but small vision-language models must preserve useful evidence within limited computation. This is difficult because redundant frames consume the visual budget, while aggressive spatial compression can discard relevant details. Although gaze identifies the wearer’s focus, the question may require evidence from the surrounding scene. To address these constraints, we propose GazeLens, which combines frame selection with gaze- and question-guided token reduction. First, HOG transitions and image sharpness select frames before visual encoding. For each selected frame, Gaussian pooling then forms gaze-focused and complementary summaries. Because their relevance depends on the question, a lightweight gate blends them into a primary token. Together with a global scene token, this retains both focused and contextual summaries within two tokens per frame. On StreamGaze, GazeLens achieves higher macro and micro accuracy than the evaluated full-grid and token-reduction baselines, with lower input-forward FLOPs than the shared-backbone token-reduction baselines.

[130] Deep Learning-Based Road Lane Quality Assessment from Egocentric Dashcam Video cs.CVPDF

Shaif Chowdhury, Akhila Yeruvasu, Moshiur Rahman Tonmoy, Ayush Goyal, Dunren Che

TL;DR: 该研究提出面向车道线质量巡检的地理标注行车记录仪数据集和三项无参考指标；在 50 张人工排序图像上，LCR 与人类质量排序达到 Spearman ρ=0.7316。

Details

Motivation: 车道线清晰度和连续性关系到驾驶安全，但维护评估仍常依赖人工。现有自动驾驶数据集主要支持车道检测与场景理解，缺少可用于维护的可见度、连续性和退化标签。

Result: 作者采集南得克萨斯州 GPS 智能手机行车记录仪数据，含 63,839 帧；其中 3,339 帧匹配 OpenStreetMap 车道数标签，用于弱监督车道数回归和地图一致性评估。提出 CSI（用 Laplacian 响应衡量车道—背景对比）、LCR（用边缘和 Hough 线索估计结构连续性）及 RLCS（衡量预测与地图车道数一致性）三项质量指标。基线模型 CSI MAE 0.039、R²=0.97，LCR MAE 0.093、R²=0.84；CSI 和 LCR 无需稠密人工标签。50 张人工排序图像试点验证中，LCR 与人类排序 Spearman ρ=0.7316、Kendall τ=0.5472，优于 PSNR、SSIM、BRISQUE、NIQE 和 LPIPS 等通用图像质量指标。

Insight: 面向道路维护的质量指标应测量车道标线本身的对比和连续性，而不是只看通用图像质量。无参考、分割派生的 CSI 与 LCR 可规模化计算；目前与人类排序的一致性验证仅是 50 张图像的试点。

Abstract: Reliable lane markings are important for both human drivers and automated driving systems, but their condition is still commonly assessed through manual inspection. Existing autonomous-driving datasets primarily support lane detection and scene understanding and usually lack maintenance-oriented labels for lane-marking visibility, continuity, or degradation. In this study, we present a geo-referenced smartphone dashcam dataset and baseline framework for lane-marking quality assessment. The dataset contains 63,839 road-facing frames collected across South Texas using a GPS-enabled dashcam application. A subset of 3,339 frames is matched with OpenStreetMap-derived lane-count labels, which are used as weak supervision for lane-count regression and map-consistency evaluation. We propose three lane-quality measures: Contrast Stability Index (CSI), which captures lane-background contrast using Laplacian responses; Line Continuity Ratio (LCR), which estimates structural continuity using edge and Hough-line evidence; and Regression Lane Confidence Score (RLCS), which measures agreement between predicted and map-derived lane counts on matched frames. The baseline prediction models attained strong performance, with CSI (MAE $0.039$, $R^2=0.97$) and LCR (MAE $0.093$, $R^2=0.84$). Notably, CSI and LCR are no-reference, segmentation-derived quality metrics that can be computed without dense human labels. In a pilot validation using 50 human-ranked images, these proposed lane-specific metrics show stronger rank agreement with human lane-quality ordering (e.g., Spearman’s $ρ=0.7316$ and Kendall’s $τ=0.5472$ for LCR) than general image-quality measures such as PSNR, SSIM, BRISQUE, NIQE, and LPIPS. We believe the dataset, metrics, and baseline provide an initial step toward scalable, low-cost, location-aware lane-marking quality assessment. Data and code: https://github.com/Shaif95/Road_Quality

[131] SenseAlign: Understanding Vision and Touch through Language at Test Time cs.CVPDF

Chuyang Ye, Qinting Jiang, Jingyan Jiang

TL;DR: SenseAlign 用类别文本嵌入作为共同语义参照，按视觉与触觉对预测类别的支持度加权模态可信度，并修正竞争类别间特征；冻结编码器下可适应未标注部署分布变化。

Details

Motivation: 视觉—触觉—语言模型在部署中可能遇到光照、接触质量或传感器硬件变化，导致视觉或触觉输入分布偏移；一旦两种模态共同参与预测，不可靠模态可能压过另一模态的正确证据，而部署时通常没有标注数据。

Result: 作者观察到，将累积的未标注观测与候选类别文本嵌入比较，可以揭示单靠置信度难以发现的模态可靠性差异；针对竞争类别细化特征也比单纯几何对齐更有助识别。SenseAlign 用共同语义参照进行测试时模态加权和特征修正：Alignment Trust 根据每个模态对共享预测类别的支持度分配权重；Anchor Realignment 利用相同类别文本嵌入拟合共享特征修正，使预测类别与替代类别分离。两模块使用同一未标注历史数据并冻结全部编码器。在多个数据集的自然分布偏移和受控污染评估中，方法表现强。

Insight: 置信度高低未必能识别哪种模态可靠；以类别语义为共同参照，可直接比较视觉和触觉证据的一致程度。用历史未标注样本同时估计可信度并修正竞争类别表示，使模型无需更新编码器就能适应部署变化。

Abstract: Tactile-visual-language models combine vision and touch through a shared language space to recognize objects and materials. In real-world deployment, changes in lighting, contact quality or sensor hardware can shift visual or tactile inputs and degrade recognition performance. When both modalities contribute to a prediction, an unreliable modality can override correct evidence from the other. Since labeled data are generally unavailable during deployment, test-time adaptation offers a way to recover recognition performance from unlabeled observations. In this setting, we find that comparing accumulated observations with the text embeddings of candidate classes reveals modality reliability differences that confidence can miss. Refining features against competing classes also improves recognition beyond geometric alignment alone. These findings motivate SenseAlign, which uses a common semantic reference for test-time modality weighting and feature correction. Alignment Trust weights each modality according to its support for shared predicted classes. Anchor Realignment uses the same class text embeddings to fit a shared feature correction that separates predicted classes from alternatives. Both modules use the same unlabeled history while keeping all encoders frozen. Extensive experiments across diverse datasets demonstrate strong recognition performance under both natural shifts and controlled corruptions.

[132] Touch-JEPA: Tactile Representation Learning from Hand-Object Video with Limited Tactile Supervision cs.CVPDF

Minseong Kweon, Qiao Feng, Yiming Huang, Lingjie Liu

TL;DR: Touch-JEPA 先用手物视频自监督预测接触区域的遮蔽视觉特征，再以少量触觉标注联合对齐接触和触觉强度；冻结特征在三个人手基准上优于监督基线，并迁移到无机器人触觉训练数据的机械手。

Details

Motivation: 理解手物交互中的接触和触觉强度是物理智能系统的重要基础，但触觉测量采集成本高、覆盖有限，限制了触觉表征学习。

Result: Touch-JEPA 提出两阶段学习框架。首先仅用手物视频进行自监督预训练，不需触觉标注：利用视频估计手部几何，从时空上下文预测对应手表面位置的遮蔽视觉特征，促使表示捕获潜在接触动态。随后扩展为联合表示学习，对所有视频做遮蔽预测，而只有已标注子集提供触觉监督，将共享表示锚定到测得的接触和强度。仅自监督预训练后，在冻结 Touch-JEPA 特征上训练简单读出器，其接触分类和触觉强度估计已超过三个人手基准的监督基线，并迁移到未用机器人触觉数据训练的机械手；加入少量触觉监督后，人手基准表现进一步提升。

Insight: 手物视频可提供可扩展的接触动态自监督信号，少量触觉测量则补充物理尺度校准。先从无标注视频学习通用表示，再用有限测量对齐接触和强度，比完全依赖昂贵触觉采集更具数据效率。

Abstract: Understanding contact and tactile magnitude in hand-object interaction is a key step toward physically intelligent systems, yet learning such representations is limited by the cost and restricted coverage of tactile measurements. We present Touch-JEPA, a framework for learning tactile representations from hand-object videos with limited tactile supervision. We first introduce a self-supervised pretraining objective that learns from video alone without tactile supervision. Using video-derived hand geometry, Touch-JEPA predicts masked visual features at corresponding hand-surface locations from spatial and temporal context, encouraging the representation to capture latent contact dynamics. We then extend this formulation to joint representation learning, where masked prediction is applied to all videos while tactile supervision is available only for a labeled subset, grounding the shared representation in measured contact and magnitude. With self-supervised pretraining alone, simple supervised readouts on frozen Touch-JEPA features outperform supervised baselines in contact discrimination and tactile magnitude estimation across three human-hand benchmarks, and transfer to robotic hands without robot tactile training data. Joint learning with limited tactile supervision further improves contact and magnitude estimation on the human-hand benchmarks. Together, these results show that hand-object video can provide scalable self-supervision for tactile representation learning, while limited tactile measurements provide complementary physical grounding.

[133] Latent Bridge: From Video Latents to 3D Geometry via Feature Alignment cs.CVPDF

Shuai Zhang, Zhanpeng Ouyang, Zhengqing Chen, Ruohong Mei, Shaoyu Chen

TL;DR: Latent Bridge 将 Wan2.1、V-RAE 视频潜空间映射到几何特征，直接从潜变量预测相机、深度和点云，省去 RGB 解码再编码；同一桥接模型可复用于图像到视频和文本到视频生成。

Details

Motivation: 视频生成与前馈 3D 重建通常使用不同表示。若从生成视频潜变量恢复几何，传统方法需先解码 RGB 再重新编码，增加计算并造成信息往返损失。

Result: Latent Bridge 将视频生成潜空间与几何特征空间连接，分别为 Wan2.1 和 V-RAE 训练表示专属桥接器，直接从潜变量前馈预测相机、深度和 3D 点云。桥接器以 RGB 视频进行特征蒸馏训练，视频编码器与几何模型保持冻结；训练不需要几何真值，也不执行下游几何聚合器或预测头。推理时同一潜变量既支持 RGB 解码，也支持几何预测；同一桥接器还可复用于同一潜空间的图像到视频和文本到视频生成，无需重训。在 Co3Dv2 和 WildRGB-D 上，方法达到有竞争力的几何重建质量，并实现高效端到端生成—重建和更快潜变量到几何解码。

Insight: 若生成潜空间与几何特征直接对齐，三维重建就不必经过 RGB 图像的完整解码和再编码。一次训练的桥接器能连接生成、重建及不同条件生成任务，提供可复用接口并减少推理步骤。

Abstract: Video generation and feed-forward 3D reconstruction typically use separate representations, requiring RGB decoding and visual re-encoding to recover geometry from generated latents. We propose Latent Bridge, which connects video generative latent spaces with geometric feature spaces to directly predict 3D geometry from video latents. We develop representation-specific bridges for Wan2.1 and V-RAE, enabling feed-forward prediction of cameras, depth, and 3D point clouds without the intermediate RGB pathway. Each bridge is trained on RGB videos through feature distillation, while the video encoder and geometry model remain frozen. Training requires neither ground-truth geometry nor execution of the downstream geometric aggregator or prediction heads. At inference, the same video latents support both RGB decoding and geometry prediction. The same trained bridge can be reused for image-to-video and text-to-video generation within the same video latent space, without bridge retraining. Experiments on Co3Dv2 and WildRGB-D demonstrate competitive geometric reconstruction quality, efficient end-to-end generation and reconstruction, and faster latent-to-geometry decoding, highlighting latent alignment as a practical and reusable interface between video generation and 3D reconstruction. Our code is available at: https://github.com/hustvl/Latent-Bridge.

[134] Copyright Leakage Detection in AI Generated Videos cs.CVPDF

Shaif Chowdhury, Moshiur Rahman Tonmoy

TL;DR: 该基准将 AI 视频版权泄漏检测建模为视频帧嵌入到版权图像库的对比检索；涵盖 50 个概念、每概念五张参考图，报告检测准确率 99.6%、仅一个漏检。

Details

Motivation: 视频生成模型可根据图像或文本提示生成逼真视频，近期进展引发了对受版权保护视觉内容被复现的担忧，但生成视频中的版权泄漏检测仍少有研究。

Result: 作者构建版权泄漏基准，含 50 个版权概念，每个概念五张图像；每个概念对应由图像加提示生成以及仅提示生成的五段视频。检测工具组采用对比检索，将视频帧嵌入聚合后与版权图像嵌入库匹配，使用单一相似度阈值，并返回最相似的版权参考图作为支持证据。实验报告检索与检测表现较强，检测准确率为 99.6%，仅出现一次假阴性。数据和代码公开。

Insight: 将版权检测表述为视频到图像检索，不仅给出是否疑似泄漏，还能提供最相似版权参考作为可解释证据。当前基准围绕 50 个概念构建，极高准确率应结合该数据覆盖范围理解，后续仍需扩展概念和生成条件。

Abstract: Video generation models can create realistic-looking video footage from images and text prompts. Some of the recent advances have raised concerns about the reproduction of copyrighted visual content. However, copyright leakage detection in generated videos remains largely unexplored. In this paper, we introduce a new benchmark data set for copyright leakage detection, comprising 50 copyrighted concepts, each with 5 images. For each concept, we have 5 videos created using the image+prompt video generation model and the prompt-only video generation model. Following that, we develop an AI toolset based on a contrastive retrieval framework that formulates copyright leakage detection as a video-to-image retrieval problem by matching aggregated video frame embeddings against a database of copyrighted image embeddings. Our method uses a single similarity threshold and retrieves the most similar copyrighted reference as supporting evidence. We conducted experiments showing strong retrieval and detection performance, achieving 99.6% detection accuracy with only a single false negative. These results show the effectiveness of the retrieval-based method for scalable and explainable copyright leakage detection in AI-generated videos. Data can be accessed publicly from https://zenodo.org/records/21386117 and the source code for this project is publicly available at https://github.com/Shaif95/video-cp-Leakage.

[135] OverSeer: Multi-Agent World Models Beyond What Agents See cs.CVPDF

Runjia Li, Kam Woh Ng, Minghao Chen, Junlin Han, Jianyuan Wang

TL;DR: OverSeer 为多智能体世界模型加入固定空间辅助摄像机视角，作为世界中心状态代理以提高多个第一人称视频流一致性；Minecraft、Doom 实验及真实多相机定性结果支持该设计。

Details

Motivation: 视频世界模型扩展到多智能体困难，因为需要生成多个角色视角下时间同步、彼此一致的视频流；仅依赖随角色位置变化的第一人称视角，难以稳定维护共同世界状态。

Result: OverSeer 在智能体自我中心视角之外增加固定空间的辅助摄像机视角。由于辅助视角位置不随智能体移动，画面变化可直接对应局部世界状态变化，充当世界中心表示代理。实验显示这些视角显著帮助模型维持一致性。辅助视角冗余且相对静态，作者用 delta-VAE 相对固定参考图编码变化，压缩其 token 数并降低生成计算开销。Minecraft 和 Doom 实验显示世界及智能体一致性提升；真实多摄像机采集的定性结果表明方法不依赖游戏引擎。

Insight: 多个角色视角之外增加固定坐标视角，可把角色运动引起的画面变化与世界自身变化分开，使跨智能体状态更易对齐。辅助视角虽提供额外信息，但通过只编码相对静态参考的差异，可控制其 token 和计算成本。

Abstract: Despite the success of video world models, extending them to multiple agents is difficult because it requires generating several agent-specific video streams that are consistent in time and between agents. To address this gap, we introduce OverSeer, a multi-agent world model that augments egocentric agent views with auxiliary camera views. We suggest that, by fixing the auxiliary views in space, they act as a proxy for a world-centric representation: Unlike the agents’ views, which can change entirely due to a simple change in agent position, changes in the auxiliary views directly map to localized changes in the world state. We show that these fixed views substantially help the model to maintain consistency. We also show that, due to their redundant and semi-static nature, the auxiliary views can be efficiently compressed with a delta-VAE that encodes only the changes relative to a static reference image, reducing the number of tokens required to process them. Experiments in Minecraft and Doom demonstrate improved world and agent consistency, with qualitative results on real-world multi-camera captures indicating that the approach is not tied to game engines. Our compression analysis further shows that delta-VAE substantially reduces the computational overhead of auxiliary-view generation. We conclude that these fixed views provide a simple and efficient way to improve multi-agent world models.

[136] Can a Display Be Used for Rapid LiDAR-Camera Extrinsic Calibration? cs.CVPDF

Zuhao Zou, Xiangcheng Hu, Jianhao Jiao, Jin Wu

TL;DR: ScreenCalib 用普通可编程显示屏上的 AprilTag 与屏幕物理边界完成 LiDAR—相机外参标定；单姿态只需静态摆放，多姿态联合精化在三种传感器平台上改善旋转、平移误差和地图对齐。

Details

Motivation: LiDAR—相机外参标定通常需专用标定板准备与测量。普通显示屏可提供已知视觉标记和几何，但相机看到屏幕上的 AprilTag、LiDAR 测到实体屏幕表面及边界，两种模态间接关联会产生歧义，室内杂物也增加提取困难。

Result: ScreenCalib 使用普通可编程显示器完成外参标定，包括标签引导的显示器提取、几何假设生成与精化，并用周围场景边缘消解歧义。单姿态模式只需一次静态放置；多姿态联合模式融合多个独立静态观测，通过跨姿态共识联合精化共享外参和标签尺度，减少标签尺寸测量误差影响，不需要连续运动或姿态间轨迹估计。仿真和三种不同传感器平台实验涵盖机械式及非重复扫描 LiDAR、干净和杂乱环境；与竞争性标定板方法相比，平移精度更高。联合多姿态进一步降低三平台平均旋转和平移误差并改善渲染地图对齐。研究还评估手机、平板、笔记本、显示器和电视等常见屏幕。

Insight: 显示屏同时提供视觉标记和可测物理边界，可替代专用标定目标；多姿态联合通过共识减少单次摆放和标签尺寸误差。方法适用不同显示设备和传感器，但仍依赖清晰提取显示区域及周围几何边缘。

Abstract: ScreenCalib enables light detection and ranging (LiDAR)–camera extrinsic calibration using an ordinary programmable display, providing known visual markers and controlled geometry while reducing dedicated target preparation. The camera observes displayed AprilTags, whereas the LiDAR measures the physical screen surface and boundary, requiring indirect cross-modal association. Display geometry introduces association ambiguities, while indoor clutter complicates extraction. ScreenCalib addresses these challenges through tag-guided display extraction, geometric hypothesis generation and refinement, and surrounding scene edges for ambiguity resolution. The single-pose mode requires only one static placement. The joint multi-pose mode combines independent static observations through cross-pose consensus and jointly refines the shared extrinsics and tag scale, reducing sensitivity to tag-size measurement errors without requiring continuous motion or inter-pose trajectory estimation. Experiments in simulation and on three different sensor platforms cover mechanical and nonrepetitive LiDARs in clean and cluttered environments. Benchmark results show that ScreenCalib outperforms competitive calibration-board-based methods in translation accuracy. Joint multi-pose refinement further reduces mean rotation and translation errors across the three platforms and improves rendered-map alignment. Evaluation across readily available displays, including cell phones, tablets, laptops, computer monitors, and televisions, further examines ScreenCalib’s versatility as a practical alternative to dedicated calibration targets. The source code is available at https://github.com/ZuhaoZou2026/ScreenCalib.

[137] Learning the 4D World through Point Trajectory Forecasting cs.CVPDF

Byungwoo Jeon, Sunghwan Hong, Dohyeon Kim, Jonghoon Lee, Jungwoo Park

TL;DR: VPM 将多视角未来视频与持续场景点的 3D 轨迹联合预测，以轨迹监督把不同相机中的外观变化锚定到共享运动；该监督同时改善视频保真、三维运动精度和机器人操作成功率。

Details

Motivation: 可靠的多视角预测要求不同相机生成的视频描述同一个演化中的三维场景。视频模型虽能生成未来画面，但单靠视频监督不一定保持跨视角空间一致，也难直接为机器人控制提供物理运动信息。

Result: Video-Point Model（VPM）以多视角视频历史和语言指令为条件，联合预测任意视点未来视频及持续场景点的三维轨迹。相机条件多视角模块整合各机位互补观察，轨迹头预测物理点随时间运动；同一点在所有视图中持续跟踪，轨迹监督因此把各相机外观变化与共同 3D 运动关联。作者构建同步多视角视频—点轨迹模拟语料 VPM-Data，以及覆盖模拟和真实环境的 VP-WorldBench。将机器人动作作为生成器 token 模态加入后，动作与未来视频在同一受点监督骨干中联合去噪。在 VP-WorldBench 和既有 4D 生成基准上，点监督同时提高视频保真和 3D 运动准确；模拟及真实机器人实验中也提升操作成功率。

Insight: 持续点轨迹提供跨视角共享的运动锚点，可将视觉生成与几何运动、机器人动作统一到同一表示。由此点监督不仅改善场景一致性，也能让动作策略基于同一 3D 感知状态。

Abstract: Reliable multi-view forecasting requires videos from different cameras to describe the same evolving 3D scene. To this end, we introduce Video-Point Model (VPM), a world model that conditions on multi-view video histories and a language instruction to jointly forecast future videos from arbitrary viewpoints and the 3D trajectories of persistent scene points. We extend a pretrained world model with camera-conditioned multi-view processing that integrates complementary observations across cameras, and add a trajectory head that predicts how physical points move through time. Each trajectory tracks a single point across all views, and supervising these trajectories alongside video generation therefore anchors appearance changes in every camera to a shared description of 3D motion. To support training and evaluation, we build VPM-Data, a simulation corpus pairing synchronized multi-view videos with persistent point trajectories, and VP-WorldBench, a forecasting benchmark spanning simulated and real environments. We further extend VPM to robot control by adding robot actions as a token modality in the generator. Action tokens share the point-supervised backbone and are denoised jointly with future videos, thereby grounding the policy in the same 3D-aware representation. On VP-WorldBench and existing 4D generation benchmarks, point supervision improves both video fidelity and 3D motion accuracy over a video-only counterpart, and in simulated and real-robot experiments, it also raises the manipulation success of the action-enabled model.

[138] MindView: Benchmarking Generative Multi-View Spatial Intelligence cs.CV | cs.AIPDF

Yanbo Wang, Siqi Luo, Siyu Zhang, Chenming Zhu, Wenzhao Zheng

TL;DR: MindView 用 513 个室内场景的 1,500 个样本、七项任务评测从部分多视角观察生成空间一致视图；BAGEL 微调总分提升 24.3 点，免训练 MindCue 还逆转了扩展上下文造成的性能下降。

Details

Motivation: 空间智能已有空间定位图像编辑等生成式评测，但根据部分多视角观察、遵循语言指令生成空间一致的新视角研究不足。模型需要同时处理相机位置/朝向变化，以及物体指代、空间关系和参考坐标系线索。

Result: MindView 覆盖三个室内数据集的 513 个场景、1,500 个样本，包含七项任务，分为几何主导（指定相机位置和朝向变化）和语义主导（定位被指物体并解释关系及参考系）两类。评测 11 种生成模型后发现仍有明显提升空间；成对上下文分析还显示所有模型在扩展上下文条件下总分下降。用训练集微调 BAGEL 后总分提高 24.3 点，七项任务均有提升，并在三个空间理解基准上也得分更高，未使用这些基准标注训练。针对扩展上下文，训练免依赖目标视角假设的空间证据选择器 MindCue，可逆转扩展上下文造成的总分下降并超过标准上下文基线。

Insight: 多视角空间生成能力既需要对几何变换建模，也需要理解目标物体关系和参考坐标；简单增加上下文反而可能干扰证据使用。目标视角假设引导的证据筛选可帮助模型从更长上下文中选取真正相关观察。

Abstract: Spatial intelligence has recently been assessed through generative tasks such as spatially grounded image editing, yet language-guided generation of spatially consistent views from partial multi-view observations remains underexplored. We introduce MindView, a benchmark for generative multi-view spatial intelligence with 1,500 samples from 513 scenes across three indoor datasets. Its seven tasks form two families: geometry-dominant tasks specify changes in camera position and orientation, while semantics-dominant tasks require inferring target viewpoints by grounding referred objects and interpreting spatial relations and reference-frame cues. Evaluation of eleven generators reveals substantial room for improvement on MindView. A paired context analysis further shows that all eleven generators obtain lower overall scores under the expanded context setting. These findings motivate us to investigate whether task-specific supervision can improve target-view generation and whether models can use additional multi-view evidence effectively. We therefore fine-tune BAGEL on the MindView training dataset, improving its overall score by 24.3 points and yielding gains across all seven MindView tasks. Beyond these generation gains, the fine-tuned model also yields higher scores on three spatial-understanding benchmarks without training on their annotations, suggesting that learning to generate spatially grounded views may benefit spatial understanding. To improve evidence utilization under expanded context, we propose MindCue, a training-free spatial evidence selector guided by a target-view hypothesis. MindCue reverses the drop in overall score under expanded context and outperforms the standard-context baseline. Overall, MindView provides a concrete testbed for generative multi-view spatial intelligence.

Heran Hu, Yuhang Dong, Zhucun Xue, Kaiwei Chen, Yong Liu

TL;DR: PsycheMME 用心理学框架构建 630 段视频、1,000 个问题的社会理解基准，分别评价理解、需求判断、互动选择、记忆与风险，并依据理由对标注线索的支持和逻辑一致性给分。

Details

Motivation: 理解人的需求和选择回应是不同判断过程，汇总准确率会掩盖两者差异。需要一种视频基准明确区分人类状态理解与响应选择，并检查模型理由是否真正受到视频线索支持。

Result: PsycheMME 受社会信息处理理论和感知—行动循环启发，覆盖八项能力，包括线索落地、状态、需求、互动决策、记忆和风险。基准从 630 段片段构造 1,000 个问题，先在不显示建议参考答案的条件下独立作答，再由专家复核。Reasoning-Verified 协议依据显式理由对标注线索的支持度和逻辑一致性加权答案得分。17 个模型评测中，Timing 的验证分和得分保留率最低，且正确 Timing 答案的支持判断较弱；需求分相似的模型在开放式回答完整度上仍有差异。输入控制和 SFT/GRPO 实验进一步考察上下文依赖及适配。

Insight: 社会视频理解与回应选择应分别评估，并检查解释是否由证据支撑。理由核验能定位模型是在理解、决策还是论证阶段失败；仅比较总体答案分会遗漏正确答案背后的支持不足及开放式回答完整度差异。

Abstract: Understanding human needs and selecting responses require distinct judgments that aggregate accuracy can obscure. We introduce PsycheMME, a video benchmark informed by psychology, with eight capabilities spanning grounding, states, needs, interaction decisions, memory, and risk. Drawing on Social Information Processing and the Perception-Action Cycle, this organization separates human understanding from response selection. We construct 1,000 questions from 630 episodes through independent answering with proposed references withheld and expert review. Our Reasoning-Verified protocol weights answer credit by the support and logical consistency of explicit rationales against annotated cues. Across 17 models, Timing has the lowest Verified scores and credit retention, with weaker support judgments for correct Timing answers. Models with similar Need scores still differ in answer completeness on open questions. Input controls and SFT/GRPO examine context dependence and adaptation. Evaluating answers alongside rationales locates where models fail across understanding, response selection, and justification.

[140] SolarRenderer: Few-Step Generative Reference Rendering cs.CVPDF

Guian Fang, Shengju Qian, Dongyue Lu, Junchao Huang, Lutao Jiang

TL;DR: SolarRenderer 以两个轻量 LoRA 将冻结的 33B 视频模型适配为结构条件渲染器，四步生成比 50 步采样快 12.3 倍；在 16 种结构表示上达到 SOTA，并泛化到 11 种未见表示。

Details

Motivation: 游戏引擎和代码智能体能指定场景布局、运动及相机，但把粗略结构转成遵循约束且外观真实的视频仍困难。现有渲染器绑定某一引擎表示、需数十步去噪或昂贵蒸馏，训练条件也常与目标视频不匹配。

Result: SolarRenderer 以冻结 MiniMax-H3 33B 为骨干，用两个轻量 LoRA 适配结构条件视频渲染。结构视频通过骨干原生参考路径注入其描述帧对应位置，不加类型标识，只用普通文本描述，使单个控制 LoRA 可处理任意结构表示。从预训练四步 LoRA 出发，结构引导分布匹配仍在四步渲染，比 50 步采样快 12.3 倍且保留控制能力；块因果变体扩展为流式生成，可实时渲染 768p 视频。训练语料含来自游戏引擎、模拟器和 YouTube 的 136K 帧对齐片段。测试及 16 种结构表示泛化基准均达 SOTA，并泛化至 11 种未见表示，包括姿态骨架、绘图和点云。

Insight: 通过原生参考通路把不同结构统一表达为带文本说明的帧，可避免为每种引擎或结构类型单独设计控制接口。四步结构引导渲染兼顾低延迟和控制保留，且跨表示泛化支持更通用的代码到视频场景渲染。

Abstract: Game engines and coding agents can specify the layout, motion, and camera of a scene, yet turning such coarse structure into realistic video requires a renderer that follows the structure and completes the appearance it leaves open. Existing renderers are tied to the representation of one engine, need tens of denoising steps or a costly distillation of their own, and learn from conditions that are not aligned with their target videos. We present SolarRenderer, a structure-conditioned video renderer that adapts a frozen MiniMax-H3 33B backbone with two lightweight LoRAs. Structural videos enter the native reference pathway of the backbone at the positions of the frames they describe, without a type identifier and described only in plain text, so that a single control LoRA follows arbitrary structural representations. Starting from a pretrained four-step LoRA, structure-guided distribution matching renders in four steps, 12.3 times faster than 50-step sampling, while preserving the learned control. A block-causal variant extends the same design to streaming and renders 768p video in real time. To train the model, we build a frame-aligned corpus of 136K clips from game engines, simulators, and YouTube videos. Experiments on an in-distribution test set and a generalization benchmark of 16 structural representations show that SolarRenderer achieves state-of-the-art results across both, and generalizes to 11 unseen representations, including pose skeletons, drawings, and point clouds.

[141] AEON: Unifying Video and 3D World Models cs.CVPDF

Weiqi Zhang, Wenyuan Zhang, Yu-Shen Liu, Junsheng Zhou

TL;DR: AEON 将视频生成潜空间与可渲染的 4D Gaussian 世界表示结合：从单目视频重建 4DGS 和相机位姿，再用蒸馏适配器连接生成与重建潜空间，在标准基准上达到 SOTA。

Details

Motivation: 显式世界模拟的世界模型常分为两条路线：视频生成外观逼真却难保持三维一致；3D 生成几何一致却可能生成静态、缺少真实感的观察。需要统一视频动态与可渲染几何表示。

Result: AEON 在文本或图像条件视频潜空间中运行生成模型，同时输出可渲染的 4D Gaussian Splatting（4DGS）作为显式世界表示。作者训练 4D 重建模型，从单目视频预测 4DGS 和相机位姿，作为初始化的 4D 解码器；再通过视频 VAE 上的蒸馏过程设计领域适配器，将生成式视频潜变量转为重建式 4D 潜变量。系统可沿预测相机轨迹渲染 4DGS，实现视频式世界建模，并构建包含场景动态的持续 4D 环境用于真实感模拟。在标准基准上达到最先进表现，并支持多类世界建模应用。

Insight: 将视频模型的动态生成能力与 4DGS 的显式几何结合，可同时保留时序变化和可渲染三维结构。生成潜空间到重建潜空间的适配器让视频条件模型输出持久世界表示，而不局限于逐段视频预测。

Abstract: Current world models for explicit world simulation typically follow two distinct pathways: (1) video generative models (e.g., Sora), which simulate realistic appearances but fail to preserve 3D consistency; and (2) 3D generative models (e.g., Marble), which generate geometrically consistent scenes but often yield static, less realistic observations. We present AEON, a unified framework that bridges video-based and 3D-based world models and combines the benefits of both. The key insight of AEON lies in a generative model that operates within the text- or image-conditioned video latent space while producing renderable 4D graphics primitives—specifically, 4D Gaussian Splatting (4DGS)—as the explicit world representation. We train a 4D reconstruction model to predict both 4DGS and camera poses from monocular videos, serving as our initialized 4D decoder. Furthermore, we design a domain adapter that translates generative video latents into reconstructive 4D latents through a distillation process on the video VAE. AEON naturally supports video-based world modeling by rendering 4DGS at predicted camera trajectories, and constructs a persistent 4D environment with scene dynamics for realistic world simulation. Consequently, AEON empowers a diverse range of world modeling applications and achieves state-of-the-art performance on standard benchmarks. Project Page: https://weiqi-zhang.github.io/AEON

[142] Joints, Camera, Action! Co-Generating 3D Motion and Video for Arbitrary Rigs cs.CV | cs.AI | cs.GR | cs.LG | cs.ROPDF

Noam Rotstein, Yoad Tewel, Chen Tessler, Haggai Maron, Gal Chechik

TL;DR: 该模型为任意骨架联合生成 3D 关节运动、场景视频和相机，并以跨注意力连接独立运动模型与预训练视频模型；近 20 万训练对支持文本动画、视频转骨架和关键帧控制。

Details

Motivation: 视频生成模型能呈现逼真运动，但难把运动转成可在指定 3D 资产和场景中重放的动画。既有视频—运动方法多限于人体骨架且常增添大量参数，或从生成的 2D 姿态图三角化 3D 运动。

Result: 模型针对任意给定骨架，联合生成视频、3D 运动及将运动注册到场景的相机。它将支持任意骨架的 3D 运动建模保持为独立模型，通过少量跨注意力层连接预训练视频模型，使运动模型可先从更易获取和增强的纯运动数据学习。模型还学习在视频帧中定位各关节，以恢复相机并把 3D 动作放入场景。训练数据方面，生成式视频编辑器将带动画的 3D 资产放入符合动作的场景，并筛选保证已知运动有效；结合人类和机器人视频后得到近 200K 训练对。评测显示，它从文本驱动多样骨架比视频优先流水线更忠实，运动会响应场景；还支持视频到骨架、骨架到视频及基于关键帧的 3D 运动控制。

Insight: 把骨架运动先验与视频外观生成分开学习，再用跨注意力连接，可以扩展到任意 rig 而不依赖海量视频—运动配对训练。关节在视频中的定位同时提供恢复相机和三维场景注册的线索。

Abstract: Video generation models can now depict remarkably realistic motion. Yet it is unclear how to use this motion beyond pixels: to animate a specific 3D asset and replay the animation in its 3D scene. For instance, a video model can show a monkey jumping over a crossbar, but it cannot return that jump as replayable 3D motion placed in the 3D scene. Here we present a model that directly co-generates the video and 3D motion for any supplied rig, along with a camera that registers this motion to the scene. Prior video-motion models either handle only human skeletons, often adding billions of parameters, or triangulate 3D motion from generated 2D pose maps. We instead keep 3D motion in a separate model that supports arbitrary skeletons, and connect it to a pretrained video model through a small set of cross-attention layers. This separation lets the motion model first learn how skeletons move from motion-only data, which is easier to obtain and augment than paired video. Additionally, our model learns to locate each joint in the video frames, which lets us recover the camera and place the 3D motion in the scene. To train across many skeletons, we use a generative video editor to place animated 3D assets in scenes suited to their actions, curating the edits so their known motion remains valid. Together with human and robot video, this yields nearly 200K training pairs. Our evaluations demonstrate that our model animates diverse rigs from text more faithfully than video-first pipelines, and its motion responds to the surrounding scene. It also turns video into rig motion, rig motion into video, and enables keyframe-based control of the 3D motion. Videos and additional results are available on our project page: https://research.nvidia.com/labs/par/projects/jca/.

cs.AI [Back]

[143] Teaching AI Agent to Play Poker Strategically Through Preference Optimization cs.AI | cs.CLPDF

Phurinat Polasa, Thanapon Thanadunpremdet, Phatthanasak Kraiduang, Saksorn Ruangtanusak

TL;DR: SPOKE 用教师相对价值惩罚、策略锚定、风险约束和结构化理由监督优化扑克智能体；三次运行中 Kuhn、Leduc 平均 exploitability 最低，六人局 top-1 一致率最高。

Details

Motivation: 扑克智能体即使走合法动作也可能策略不佳。研究检验小型智能体能否在隐信息下形成策略行为，以及偏好优化是否能超越静态策略和零样本语言模型。

Result: 作者先评估静态基线及冻结的 SmallThinker、Qwen3、Gemma-3，观察到它们在精确博弈和六人局表现差异较大。随后提出带 KL 锚定均衡的策略偏好优化（SPOKE），结合教师相对价值惩罚、策略锚定、风险约束和结构化理由监督，并与 SFT、DPO、GRPO、GSPO 比较。SmallThinker-4B-A0.6B 策略三次运行中，SPOKE 在 Kuhn 和 Leduc 的平均可利用度最低，分别为 0.213 和 1.081；六人局 top-1 一致率最高，为 0.775，同时教师 KL 为 0.522，与 SFT 的 0.523 接近。

Insight: 偏好优化可提升策略质量，但仍需约束其偏离教师策略的幅度。结果是小型策略模型上三次运行的初步证据，显示 SPOKE 在降低 exploitability 与保持教师行为之间取得折中。

Abstract: A poker agent can make a legal move and still make a strategically poor one. We ask whether compact AI agents can exhibit strategic behavior under hidden information and whether preference optimization can improve beyond static and zero-shot policies. We first evaluate a static baseline and three frozen language models: SmallThinker, Qwen3, and Gemma-3 whose performance varies substantially between exact-game and six-player evaluation. We therefore propose Strategic Preference Optimization with KL-anchored Equilibrium (SPOKE), combining teacher-relative value penalties, policy anchoring, risk constraints, and structured rationale supervision, and compare it with SFT, DPO, GRPO, and GSPO. Across three runs of a SmallThinker-4B-A0.6B policy, SPOKE achieves the lowest mean exploitability in Kuhn (0.213) and Leduc (1.081) and the highest six-max top-1 agreement (0.775), while maintaining teacher KL comparable to SFT (0.522 vs 0.523). These results provide preliminary evidence that strategic preference optimization can improve strategic quality while preserving teacher-consistent behavior.

[144] ReuF2F: Benchmarking Coding Agents on Formalized Undergraduate Research Problems cs.AI | cs.CL | cs.LGPDF

Zeyu Zheng, Yiyang Liu, Yuyang Zhao, Congmin Zheng, Jiachen Zhu

TL;DR: ReuF2F 提供 244 道来自本科生科研项目、形式化为 Lean 4 的开放数学问题及统一 coding-agent 评测框架；目前表现最好的模型也只解决约 40%。

Details

Motivation: 随着 AI 开始尝试解决开放研究问题，可靠验证越来越重要，形式化数学能提供可机检证明。但既有基准常聚焦已知定理或少数热门开放问题，答案一旦公开传播就难以公平评估，评测流程也未必符合现代 coding agent 的工作方式。

Result: ReuF2F 收录 244 道来自本科生科研体验项目（REU）的形式化开放问题，覆盖多个数学子领域的入门级研究题。作者认为这类关注较少、可能更久未解的问题适合留出评估端到端 Lean 开放问题求解。评测时在 Docker 中为每题及其逻辑否定建立 Lean 项目，并基于 mini-SWE-agent 构建 Leanimum-agent 统一比较框架。实验发现当前表现最佳的模型也仅能解决约 40% 问题，说明形式化开放研究问题仍有明显难度。

Insight: 相对少见、仍未广泛传播的开放问题可减少模型通过记忆已知答案取巧的空间；加入逻辑否定、容器隔离和统一代码智能体流程，也使评估更接近可验证的端到端数学探索。

Abstract: As AI systems begin to resolve open research problems, reliable verification becomes increasingly important. Formal mathematics provides a trusted framework for mathematical reasoning, enabling agents to produce machine-checkable proofs while conducting mathematical exploration. Existing formal mathematics benchmarks often focus on known results or a small set of prominent open problems, which can become difficult to evaluate reliably once solutions are discovered and widely disseminated. Existing evaluation protocols are also not always aligned with how modern coding agents operate. We therefore introduce ReuF2F, a Lean 4 benchmark of 244 formalized open problems drawn from Research Experiences for Undergraduates (REU), spanning entry-level open research problems across a broad range of mathematical subfields. We expect these less prominent open problems, which tend to attract less attention and may remain unsolved for longer, to be better suited for held-out evaluation of end-to-end open problem resolution in Lean. We adopt a standard coding-agent evaluation setting, placing each problem and its logical negation into a Lean project in a Docker container. We also build Leanimum-agent on mini-SWE-agent to provide a unified harness for fair comparisons across models. Our evaluation finds that even the best-performing model resolves only ~40% of the problems, leaving substantial room for improvement on formalized open research problems.

[145] Omni-Woodpecker: Hallucination Correction via Evidence-Prior Rebalancing for Omni LLMs cs.AI | cs.CL | cs.CV | cs.MMPDF

Zijian Liu, Chaoyou Fu, Yan Yang, Caifeng Shan, Ran He

TL;DR: Omni-Woodpecker 在多模态隐藏表示中分离视觉/音频依据与竞争先验，并在冲突条件下重新平衡证据；免训练地提升 Qwen2.5-Omni 与 VideoLLaMA2-AV 的幻觉基准表现。

Details

Motivation: 全模态大模型具备联合音视频推理能力，但跨模态幻觉仍突出。现有缓解方法主要修改输出，忽略融合表示中感知证据与模型先验纠缠这一成因。

Result: 免训练框架 Omni-Woodpecker（OWP）先从互补的模态特定视角识别跨模态冲突，再通过正交分解将隐藏状态中的落地证据与竞争先验分离，最后在解码前抑制误导先验、恢复被忽略证据并自适应重平衡融合表示。以 Qwen2.5-Omni-7B 为骨干，在 CMM 和 AVHBench 分别提升 12.9 与 8.6 点，在四个通用全模态推理基准上也稳定提升 0.67–2.25 点。迁移到 VideoLLaMA2-AV 后，在相同两个幻觉基准上分别提升 4.6 和 3.9 点。

Insight: 跨模态幻觉不只来自最终文本，也可能源于内部融合时模型先验压过音视频依据。针对识别出的冲突在隐藏表示中重平衡证据，可免训练应用并能迁移到不同全模态架构。

Abstract: Recent Omni LLMs (OLLMs) have demonstrated remarkable capabilities in joint audio-visual reasoning, yet cross-modal hallucinations remain a major challenge. Existing mitigation methods mainly operate at the output level, overlooking the entanglement of grounding evidence and learned priors within fused representations. To address this issue, we propose Omni-Woodpecker (OWP), a training-free framework that shifts hallucination mitigation from output-level manipulation to conflict-conditioned representation rebalancing. Specifically, OWP first identifies cross-modal conflicts from complementary modality-specific views. It then employs orthogonal decomposition to separate grounding evidence from competing priors within the hidden states. Finally, OWP adaptively rebalances fused representations by suppressing misleading priors and restoring ignored evidence before decoding. Extensive experiments demonstrate the effectiveness and strong cross-architecture generalization of OWP. Using Qwen2.5-Omni-7B as the backbone, OWP improves performance by 12.9 and 8.6 points on CMM and AVHBench, respectively, while consistently achieving gains of 0.67-2.25 points across four general OLLM reasoning benchmarks. Furthermore, OWP generalizes effectively to VideoLLaMA2-AV, improving performance by 4.6 and 3.9 points on the same benchmarks. Code is publicly available at https://github.com/ZiiJianLiu/Omni-Woodpecker

[146] TxnQA: Benchmarking Analytical Reasoning and Evidence Grounding over Transaction Event Sequences cs.AI | cs.CL | cs.LGPDF

Rabimba Karanjai, Yiming Bian, Yun-Shiuan Chuang, Jenna L. Ballard, Zijie Pan

TL;DR: TxnQA 评测模型对交易事件序列的时序筛选、实体消歧、聚合与欺诈证据归因；LoRA 适配能改善格式遵循，但欺诈判决的联合正确率最高仅约 23%。

Details

Motivation: 商户交易历史分析需要对不规则事件流做动态时间筛选、实体解析和汇总，静态表格或时间序列预测基准难以覆盖这些推理操作。仅判断欺诈结论也不够，还需提供对应证据。

Result: TxnQA 含 27 类分析问答任务（81 个模板）和五场景欺诈风险推理套件，使用经过隐私缓解的合成交易数据，同时评估结论与证据支持。真值答案由程序计算，模型表现拆分为格式遵循率、条件内容准确率和端到端正确率。对专有模型及六种 LoRA 适配开源模型的评估发现，适配可靠提升输出格式遵循，却未解决算术瓶颈：Gemma-4-31B-IT 和 Qwen3-8B 端到端分数为 0.867、0.816，而所测 MoE 检查点为 0.632–0.713。500 例欺诈套件中，判决准确率常超过 80%，但要求准确归因证据的联合准确率最高仅约 23%。

Insight: 交易问答的格式、语义计算和证据归因是彼此独立的能力瓶颈。只看欺诈结论准确率会高估可靠性；必须要求模型同时给出准确证据，并拆分评估格式、计算和归因表现。

Abstract: Analyzing merchant transaction histories requires dynamic temporal filtering, entity resolution, and aggregation over irregular event streams–operations poorly captured by static tabular or time-series forecasting benchmarks. We introduce TxnQA, an analytical QA benchmark comprising 27 task families (81 templates) alongside a 5-scenario fraud-risk reasoning suite that evaluates both verdicts and supporting evidence over synthetic, privacy-mitigated transaction data. Ground-truth answers are computed programmatically, and model performance is decomposed into format-following rate (FFR), conditional content accuracy (CA), and end-to-end correctness (E2E). Evaluating prompted proprietary baselines and six LoRA-adapted open-weight models shows that adaptation reliably enforces output schemas but leaves arithmetic bottlenecks: Gemma-4-31B-IT and Qwen3-8B attain E2E scores of 0.867 and 0.816, whereas evaluated MoE checkpoints reach only 0.632-0.713. Furthermore, on the 500-instance fraud suite, verdict accuracy frequently exceeds 80%, yet joint accuracy (requiring exact evidence attribution) collapses to at most ~23%. These findings identify schema compliance, semantic calculation, and evidence attribution as three distinct bottlenecks in transaction-sequence QA.

[147] KPHarness: Co-Evolving Knowledge and Probing for Long-Horizon Gaming Harnesses cs.AI | cs.CVPDF

Zhikang Chen, Yueqing Sun, Sen Cui, Ziang Ye, Yu Wang

TL;DR: KPHarness 通过知识与主动探测共同进化冻结 VLA 智能体的外部执行框架：失败轨迹触发诊断探测，版本需在匹配沙盒对照下改进才接受，并可跨任务复用验证过的恢复知识。

Details

Motivation: 游戏轨迹失败能说明需要干预，却未必指出执行框架应如何改变。有效适配需要主动收集诊断证据，而非仅提出不同恢复规则；同时要避免未经验证的框架修改导致回退。

Result: KPHarness 面向冻结视觉—语言—动作模型，共同进化外部 harness 与恢复知识。恢复知识提出情境化干预假设并指导主动探测；探测结果说明假设何时适用，并用于改进知识和后续探测策略。快速策略执行与较慢研究循环分离，后者把累积知识和探测证据转成有界框架修改；每项修改在匹配沙盒下与当前版本比较，配对评估有提升才接受。经进一步验证的恢复方式可跨任务复用；即时交互反馈和延迟任务成功奖励则更新动作与知识探测策略。Minecraft 采矿、战斗和制作任务上，方法较裸策略、手工固定 harness 及仅知识进化但探测不自适应的方案提高任务覆盖；未见任务评估也显示进化后的框架、知识库和探测策略固定使用时任务完成度提升。

Insight: 失败后的恢复规则需要通过探测来确定适用条件，并以配对沙盒评估防止修改回退。知识和探测策略相互提供信息，使系统不仅改善采取何种干预，也改善如何诊断失败；验证过的恢复知识还能跨任务复用。

Abstract: A failed gaming trajectory reveals that an agent needs intervention, but not necessarily how its execution harness should change. Effective harness adaptation therefore requires gathering diagnostic evidence, rather than merely proposing alternative recovery rules. We present KPHarness, a framework that adapts the external execution harness of a frozen vision-language-action model through knowledge-probing co-evolution. Recovery knowledge supplies context-specific intervention hypotheses that guide active probing; probe outcomes reveal when these hypotheses apply and provide evidence for refining both recovery knowledge and later probe selection. This reciprocal process allows the harness to improve not only which interventions it applies, but also how it investigates failures. KPHarness separates fast policy execution from a slow research loop that translates accumulated knowledge and probing evidence into bounded harness revisions. Each revision is compared with the incumbent under matched sandbox conditions and accepted only when the paired evaluation shows improvement. Recoveries supported by further validation are retained for cross-task reuse, while immediate interaction feedback and delayed episode-success credit update action- and knowledge-probing policies during adaptation. Experiments on Minecraft tasks spanning mining, combat, and crafting show improved task coverage over bare policy execution, a manually specified fixed harness, and knowledge-only harness evolution with non-adaptive probing. Evaluation on previously unseen tasks further shows improved task completion with the evolved harness, knowledge bank, and probing policies held fixed,

[148] Ask to Distill: Learning to Synthesize Data for On-Policy Distillation cs.AI | cs.CLPDF

Jiashuo Sun, Hao Zhang, Xueqiang Xu, Heng Wang, Yixuan Xie

TL;DR: Ask-to-Distill 将合成问题视作分布知识载体，在不需参考答案或逐题学生更新的情况下，优化问题以 elicitation 更有价值的教师监督，再用于标准在线策略蒸馏。

Details

Motivation: 在线策略蒸馏用少量训练问题也可能有效，但难以判断新生成的问题是否有助于知识蒸馏；更难在不知道正确答案的情况下自动生成更有价值的问题。

Result: Ask-to-Distill 以学生初始化的问题合成器生成问题，并用冻结师生模型计算问题价值的分布式代理目标，不需要参考答案、正确性奖励或对每个候选题更新学生。奖励结合师生分歧、教师在学生候选答案支持集上的概率质量，并控制问题长度和多样性。生成问题经筛选和去重后形成仅含提示的问题库，再用于标准 OPD。在数学推理、代码生成和智能体任务上，该方法较未优化的学生自生成提示及 KL 筛选真实问题提升平均表现与教师差距恢复，在所测设置中匹配或超过真实题库 OPD。分析还显示，优化问题可从更短学生回答中 elicitation 更密集且总量更多的监督信号。

Insight: 问题本身可以作为分布知识转移的载体：优质问题应暴露有价值的师生差异，而非仅追求题目正确性或难度。无答案分布代理让问题生成可优化，且短回答也能提供更密集的蒸馏监督。

Abstract: On-policy distillation (OPD) can succeed with surprisingly few training questions, motivating a view of questions as carriers of distributional knowledge transfer. How can we assess whether a newly generated question is valuable for distillation, and learn to generate better questions—without access to its correct answer? We introduce Ask-to-Distill (\method), a framework that treats synthetic questions as distribution elicitors and optimizes the teacher supervision they expose along student-generated trajectories. A student-initialized synthesizer is optimized using a distributional surrogate for question value, computed from a frozen student–teacher pair without reference answers, correctness rewards, or per-candidate student updates. The reward combines teacher–student disagreement with teacher probability mass on the student’s candidate support, together with length and diversity controls. The generated questions are filtered and deduplicated into a prompt-only bank for standard OPD. Across mathematical reasoning, code generation, and agentic tasks, our method improves average performance and teacher-gap recovery over unoptimized student-generated prompts and KL-filtered real questions, while matching or exceeding real-bank OPD in the evaluated settings. Signal analyses further show that optimized questions can elicit denser supervision and more total signal from shorter student responses, supporting elicited distributional supervision as an objective for synthetic distillation data. Our code, data and models are publicly available at https://github.com/GasolSun36/Ask_to_Distill.

[149] Give the Model a Finger: Developmentally Aligned Evaluation of Counting in Vision-Language Models cs.AI | cs.CL | cs.CV | cs.LG | cs.ROPDF

Yingxin Jia, Hui Geng, Wenxin Yang, Mohan Zhang

TL;DR: 该研究用“逐个标记物体”的简易视觉工具审计 VLM 数数过程，发现精确计数范围因模型而异（R80 为 3–150 点）；标记主要带来可审计轨迹，而非稳定准确率提升。

Details

Motivation: VLM 在少量物体上通常计数准确，数量增加后容易转向估算，类似儿童掌握计数前的表现。儿童会通过指点、移动已数物体或分组等认知动作辅助计数；研究用不含视觉智能的简单图像工具提供同类操作，以测量模型如何数数。

Result: 在 9 个模型、682 张图像、7 种工具流程条件下，模型精确计数范围呈显著个体差异，R80 从 3 到 150 个点，跨度近两个数量级。作为干预，标记对九个模型中仅四个在小数量照片上有帮助，会伤害指点不精确的模型，且很少胜过口头流程或盲点列表。作为测量，标记可暴露串行过程：精确指针模型会依标签读出答案，指点精度关联受益程度，密集场景常因漏标失败，模型看见自己的标记后很少修正。模型可遵循指令指定的遍历顺序，却常在反转顺序后改变答案；类似儿童的规则排列优势只在该流程中出现，并非行列乘法捷径。

Insight: 图像标记工具的主要价值是把隐藏的逐项计数过程变成可审计轨迹，而非普遍提高答案准确率。逐点真值可区分命中、重复、虚构和遗漏，也揭示模型对顺序和自我修正的局限；因此评测要将过程能力与最终数值分开。

Abstract: Vision-language models (VLMs) are exact on small sets and drift into estimation on larger ones, a profile reminiscent of children before they master counting. Children cross the barrier with epistemic actions: pointing at each item while reciting number words, moving counted items aside, partitioning the array. We give VLMs the same actions as dumb image tools with no visual intelligence of their own in a training-free agent loop. Our central claim is about measurement, not intervention: a model that counts by marking leaves a normally hidden serial procedure on the image, and the developmental principles of counting turn those marks into an interpretable audit of serial visual reasoning: every tag is classified against point-level ground truth as on-target, duplicate, phantom, or omitted, the answer is checked against the number of tags, and order irrelevance is tested by forcing opposite traversal orders. Across 9 models, 682 images, and 7 harness conditions we find that (i) the exact-counting range is a model-specific signature spanning nearly two orders of magnitude (R80 from 3 to 150 dots); (ii) as an intervention the finger mostly fails: tags help 4 of 9 models on small-count photographs, hurt imprecise pointers, and rarely beat a verbal routine or a blind point list; what the loop buys is an auditable trace, not accuracy; (iii) as measurement it succeeds: a tag-perturbation probe shows that precise pointers read their answers off the tags, pointing precision tracks which models benefit, dense scenes fail by omission, and models rarely revise after seeing their own tags; and (iv) the capacities dissociate: models follow an instructed traversal order yet often change their answer when it reverses, and children’s regular-over-scattered advantage appears only under the routine and survives lattices that defeat a rows-times-columns shortcut.

[150] Staged Continual Adaptation of Multimodal Foundation Models for Japanese Financial Documents cs.AI | cs.CL | cs.CVPDF

Genshin Kakimoto, Atsushi Yanagisawa

TL;DR: 对日文金融文档 8.4B 模型的三阶段后训练追踪发现，阶段间作用并非简单相加：纯数学蒸馏会覆盖早期金融知识但保留程序化数学能力，最佳检查点取决于目标任务。

Details

Motivation: 多模态基础模型常依次进行视觉—语言对齐、推理蒸馏和领域微调，但各阶段如何互相影响、提升一种能力是否损害另一种能力仍缺少细致分析。

Result: 作者从未微调基线开始，跟踪一个 8.4B 参数模型在日文金融文档上的三个训练阶段，并用五个文本输入基准评估。各阶段存在非加性作用：纯数学蒸馏会覆盖此前获得的金融知识，即便程序化数学能力仍能保留；后续领域阶段更多是在修复先前损失，而非单纯新增能力。跳过某阶段的消融最有利于领域知识，却失去数值推理增益，因此各阶段贡献不可独立拆分，最佳检查点随目标任务变化。

Insight: 后训练阶段之间会发生能力覆盖和修复，不能把每阶段增益简单相加。模型部署前应保留不同阶段检查点并按目标任务选择，同时审视训练顺序和阶段调度，而非默认多加阶段总会更好。

Abstract: Staged post-training of multimodal foundation models chains vision-language alignment, reasoning distillation, and domain tuning, yet how each phase trades capabilities against the others remains under-characterised. Tracking an 8.4B-parameter model from an un-fine-tuned baseline through three training phases on Japanese financial documents (evaluated on five text-input benchmarks), we find the phases interact non-additively: math-only distillation overwrites the financial knowledge acquired earlier even as procedural math skill survives, and the domain phase repairs more than it installs. A skip-phase ablation is best for domain knowledge but forfeits numerical-reasoning gains, so per-phase contributions are not decomposable and the best checkpoint is task-dependent, with implications for checkpoint retention and scheduling rather than added stages.

[151] ACE-Compression: An Ability-Centric Evaluation of Compressed Large Language Models cs.AI | cs.CLPDF

Jiahui Ning, Liang Chen, Yuchen Liang, Yi Zhang, Fenglei Fan

TL;DR: ACE-Compression 从四类能力评估量化和剪枝后的 35 个以上 LLM 检查点，发现压缩常保留粗粒度能力却损伤长尾和上下文依赖能力，且量化整体比剪枝保留更好。

Details

Motivation: 模型压缩让大语言模型更易部署，但常规评估多只测任务性能保留率，无法指出分布在数十亿参数中的哪些能力仍在、哪些能力已悄然崩塌。

Result: ACE-Compression 是能力中心评估框架，测试四类部署相关能力：程序化推理与约束执行、知识落地与真实性、社会认知与情感理解、角色一致性与风格稳定。在六种开放权重 LLM 的 35 个以上压缩检查点上评估量化和剪枝后，发现压缩会重排能力画像：粗粒度、局部和表层信号往往保留，细粒度、长尾及依赖上下文的能力更脆弱。总体上量化比剪枝更能保留能力，但两者差距的实际意义取决于应用需要的具体能力。

Insight: 单一排行榜平均分无法指导压缩模型是否适用于某个应用；需要按能力画像选择压缩方案。能力中心评估还能将压缩从黑箱准确率下降转为可解释干预，为改进保留重要能力的算法提供诊断信号。

Abstract: Model compression makes large language models deployable, but today’s evaluation tells an incomplete story. Standard practice measures retained task performance and stops there. This misses a critical fact: compression perturbs the distributed knowledge embedded across billions of weights, and task scores alone cannot reveal which underlying abilities survive and which quietly collapse. To solve this question, we introduce ACE-Compression, an ability-centric evaluation framework. Instead of asking only “does the compressed model still answer correctly?”, we ask “which of its core abilities remain intact?” Our framework probes four deployment-facing dimensions: procedural reasoning and constraint execution, knowledge grounding and truthfulness, social cognition and affective understanding, and persona fidelity and stylistic consistency. Across more than 35 compressed checkpoints from six open-weight LLMs-covering quantization and pruning-we find that compression redistributes ability profiles. Coarse, local, and surface-level signals often persist, while fine-grained, long-tail, and context-dependent abilities become fragile. Quantization consistently outperforms pruning in retention, but the practical meaning of that gap depends entirely on which ability an application requires. Based on our findings, deployers can choose compression methods by the ability profile their application needs, not just by a leaderboard average. And algorithm designers gain diagnostic signals to build compression methods that preserve what matters. We believe that ACE-Compression turns compression from a black-box accuracy drop into an interpretable intervention-one we can measure, understand, and ultimately improve.

[152] Lost in Recovery: Demystifying Recovery Behavior of Computer-Use Agents via Goal-Oriented Action Replay cs.AI | cs.CL | cs.LGPDF

Byeonghun Bang, Sangwoo Park, Jinheon Baek, Kangsan Kim, Youngwan Lee

TL;DR: ReTrace 用目标导向动作重放研究电脑操作智能体的模型式恢复，并定义恢复状态的一致性标准；实验证明理想恢复能释放潜在任务能力，而当前智能体尚未充分利用这一能力。

Details

Motivation: 视觉语言模型驱动的电脑操作智能体通过细粒度键鼠动作自动化工作流，但长程任务易累积错误和非预期副作用，失败后恢复能力至关重要。专有环境难以重置，长程动作重放成本高，API 回滚又局限于网页，模型式恢复研究不足。

Result: ReTrace 是可扩展的电脑使用智能体恢复评测框架，形式化定义“转移一致恢复”：从恢复状态和目标状态执行相同后续动作，结果必须一致。方法通过受控注入错误后进行目标导向动作重放来评估该标准。系统研究发现，理想恢复可释放模型潜在任务完成能力；当前智能体未能充分利用已有恢复能力；准确的模型式恢复能带来可测量的端到端收益。代码和数据公开。

Insight: 恢复不应只看界面是否回到相似状态，而要验证相同后续动作是否能产生相同结果。该一致性标准让恢复质量可操作化评估，也揭示智能体可能具备任务能力，却被未恢复的环境状态阻碍。

Abstract: Recent advances in large (vision) language models have enabled computer-use agents that automate digital workflows via fine-grained keyboard and mouse operations. However, such agents remain fragile in long-horizon settings, where errors accumulate and executed actions leave unintended side effects, making the ability to recover from failures critical. Yet, existing remedies remain inadequate: environment resets are infeasible in proprietary settings, action replay is prohibitively expensive over long horizons, and API-based rollback is limited to web environments, leaving model-based recovery largely unexplored. To address this gap, we present ReTrace, a scalable evaluation framework for systematically studying recovery behavior in computer-use agents. We formalize Transition-Consistent Recovery: identical downstream actions from the recovered and target states must yield identical outcomes. We operationalize this criterion through goal-oriented action replay following controlled error injection. Using ReTrace, we present the first systematic study of autonomous, model-based recovery, revealing that (i) ideal recovery can unlock model’s latent task completion capabilities, (ii) current computer-use agents fail to exploit their latent recovery capabilities, and (iii) accurate model-based recovery yields measurable end-to-end gains. Together, these findings establish recovery as a fundamental capability for building reliable computer-use agents. Our code and dataset is available at https://github.com/BangProx/ReTRACE.

[153] ChartEvo: Self-Evolving Agent Harnesses for Long-Tail Chart Reasoning cs.AI | cs.CVPDF

Qi Wang, Peijie Wang, Jun Cao, Haoyang Tong, Xiao-Hui Li

TL;DR: ChartEvo 让图表智能体根据长尾图表失败经验共同进化可复用技能、可执行工具及局部工具链；在 ChartBench 和 ChartX 长尾图表上，Qwen3.7-Plus 准确率分别提升 45.6% 和 32.5%。

Details

Motivation: 多模态大模型在常见图表上进步明显，但面对视觉结构和推理要求各异的长尾图表时准确率骤降。工具增强智能体能提升复杂推理，却难以靠人工为不断扩大的长尾类型逐一设计工具和策略。

Result: ChartEvo 是递归自我改进框架，通过经验驱动的 harness 级更新适配表现不佳的图表类型。它共同进化可复用的图表技能与可执行工具，并学习可复用的局部工具调用链，用于组合新能力并控制工具推理开销。在 ChartBench 与 ChartX 的长尾图表上，ChartEvo 相较基础 MLLM Qwen3.7-Plus 的准确率分别提高 45.6% 和 32.5%。

Insight: 长尾图表类型多且持续变化，静态工具库难以全面覆盖；基于失败经验递归更新技能、工具和调用组合，可让智能体适应具体薄弱类型。局部调用链也帮助在增加视觉能力时控制推理开销。

Abstract: Multimodal large language models (MLLMs) have substantially advanced chart understanding and reasoning, yet their performance remains highly uneven across chart types. While modern MLLMs perform well on common charts, their accuracy drops sharply on long-tail charts with diverse visual structures and reasoning requirements. Tool-augmented agents can improve complex chart reasoning by introducing specialized visual capabilities, but manually engineering strategies and tools for the heterogeneous and evolving long tail is difficult to scale. We introduce \textbf{ChartEvo}, a recursive self-improvement framework that enables chart agents to adapt to underperforming chart types through experience-driven harness-level self-improvement. ChartEvo jointly evolves reusable chart-specific Skills and executable Tools, while learning reusable local tool-call chains to compose evolved capabilities and control the inference overhead of tool-augmented reasoning. On long-tail charts from ChartBench and ChartX, ChartEvo improves accuracy over its base MLLM, Qwen3.7-Plus, by \textbf{45.6%} and \textbf{32.5%}, respectively, demonstrating the effectiveness of recursive self-improvement for long-tail chart adaptation.

[154] S-Agent 2.0: Spatial Reasoning with a General Coding Agent cs.AI | cs.CVPDF

Rui Gong, Ruoyu Wang, Yalun Dai, Hao Li, Sidi Yang

TL;DR: S-Agent 2.0 将通用代码智能体接入命令行 3D 感知工具，并围绕“获取证据—持久记忆—空间语言解释”闭合证据链；MMSI-Bench 和 ReVSI 上显著超过无工具版本及同骨干专用系统。

Details

Motivation: 空间推理要判断物体三维位置、相互关系和运动。智能体式 VLM 可主动调用 3D 感知工具获取证据，但即使工具给出正确测量，模型仍可能无法将原始读数转成答案，工具与模型之间的证据解释环节存在缺口。

Result: S-Agent 2.0 给现成通用代码智能体配备命令行感知工具包，设计目标是让 VLM 完成证据闭环：收集场景几何证据、写入持久场景记忆，并将每条读数解释为普通空间语言；所有被使用的读数都锚定于工具几何结果。在 MMSI-Bench 和 ReVSI 上，工具让 Qwen3.8-27B 分别提升 13.9 和 20.5 点，让 Gemini-3.8-Flash 提升 11.2 和 9.6 点。Qwen3.8-27B 上得分 66.5/82.3，高于同骨干 SpatialClaw 的 62.6/74.5；Gemini 得分 74.1/90.5，高于其 SpatialClaw 对照 67.0/79.7。骨干越强，工具增益虽缩小，但在 ReVSI 上专用系统从 +13.2 降至 +2.7，S-Agent 仍为 +9.6。系统兼容 Codex、Claude Code 等通用代码智能体框架。

Insight: 调用几何工具本身不足以完成空间推理，智能体还需保存结果并用明确空间语言解释读数。将测量、记忆和解释串成证据闭环，可以在不同通用代码智能体中复用，并比只输出工具读数更有效。

Abstract: Spatial reasoning asks a model to work out where objects are in 3D space, how they relate to one another, and how they move. Agentic VLMs have recently brought large improvements on such tasks by letting the model actively gather evidence with 3D perception tools instead of answering in a single pass. Even so, on many questions the tools return the right evidence and the model still does not arrive at the correct answer: the gap between model and tools, where raw readings become usable conclusions, is left unfilled. We present S-Agent 2.0, a spatial reasoning agent that equips an off-the-shelf general coding agent with a command-line perception toolkit, and we design the interface around one principle: help the VLM close the evidence loop: acquire scene evidence, remember it in a persistent scene memory, and interpret each reading in plain spatial language. This design keeps the full flexibility of a coding agent, and every reading it acts on stays grounded in the tools’ geometry. On MMSI-Bench and ReVSI, the toolkit improves a strong open-source model, Qwen3.8-27B, by +13.9 and +20.5 points over the same agent without tools, and a strong closed-source model, Gemini-3.8-Flash, by +11.2 and +9.6 points. With the open backbone S-Agent 2.0 reaches 66.5 on MMSI-Bench and 82.3 on ReVSI, ahead of the specialized system SpatialClaw on the same backbone (62.6 and 74.5), and with Gemini-3.8-Flash it reaches 74.1 and 90.5 against its 67.0 and 79.7. Both tool gains shrink as the backbone grows more capable, but SpatialClaw’s shrinks far more on ReVSI, from +13.2 to +2.7, while ours stays at +9.6. S-Agent 2.0 also works across different general coding agent harnesses, such as Codex and Claude Code.

cs.CR [Back]

[155] Disclosure Begets Disclosure: A Self-Reinforcing Privacy Loop in LLM Agents with Persistent Memory cs.CR | cs.CL | cs.LGPDF

Masahiro Kaneko, Hiromi Arai, Timothy Baldwin

TL;DR: 该研究发现持久记忆会形成“披露—记忆—再披露”隐私循环：模型把旧属性作为预设带入回复，用户确认或未纠正后又成为记忆；约束智能体回复可降低泄漏而保留多数质量收益。

Details

Motivation: LLM 智能体用持久记忆个性化回复，但记忆中的个人属性若被暴露会带来隐私风险。研究考察对话中调用记忆如何改变用户之后的表达，进而改变记忆揭示的信息。

Result: 在多轮会话模拟中，含 24 项个人属性的模拟用户与是否调用记忆的支持型智能体交谈；四种支持模型均显示记忆提高回复质量，也提高从完整记录正确推断属性值的实证泄漏率，且差距随会话增多而扩大。循环来自普通非对抗式协助：记忆条件回复把旧值带入后续内容，常以预设方式表达，用户确认或未纠正，于是线索和智能体猜测成为记录值。移除智能体提及某属性，后续披露下降幅度约为单轮效应预测的两倍。用户难以自行打破循环：纠正会暴露属性，拒谈会让预测转向敏感值，错误值未纠正则固化。最有效的缓解点在智能体回复：要求不陈述或预设属性，可把泄漏降至无记忆水平附近，同时保留多数质量收益；过滤或匿名化用户表达/存储内容则会损失较多收益。

Insight: 持久记忆带来的泄漏不是单次读取风险，而是智能体措辞影响用户后续表达、再反哺记忆的自我强化过程。约束智能体在回复中不主动陈述或假设属性，比事后过滤用户内容更能削弱循环并保留个性化效果。

Abstract: Large language model (LLM) agents increasingly use persistent memory to personalize responses, and personal attributes in this memory pose a privacy risk if exposed. We ask how consulting memory during dialogue changes what users go on to say, and thus what the memory comes to reveal. In multi-session simulations, a simulated user with 24 personal attributes talks with a support agent that does or does not consult memory, and in both settings attributes are inferred from the full accumulated record. Across four support models, memory raises response quality but also empirical leakage, the share of attribute values correctly inferred from the record, by a margin that widens over sessions. The cause is a loop in ordinary, non-adversarial assistance. Memory-conditioned responses carry earlier values forward, often as presuppositions, and users affirm them or leave them uncorrected, so that cues and the agent’s own guesses become recorded values. The loop reinforces itself, and removing the agent’s mentions of an attribute lowers its later disclosure about twice as much as single-turn effects predict. Users cannot leave it on their own, since correcting a value discloses the attribute, declining to discuss it shifts later predictions toward sensitive values, and incorrect values left in place become entrenched. The loop is best weakened at the agent’s response. Instructing the agent not to state or presuppose attributes brings leakage to about the no-memory level while keeping most of the quality gains, whereas filtering or anonymizing what users say or what is stored gives up much of them.

cs.GR [Back]

[156] GALA: Geometry-Aware Language Model for Controllable Object Arrangement cs.GR | cs.AI | cs.CVPDF

Chucheng Xiang, Runze Wang, Zhi Deng, Ruchao Bao, Yuanwei Zhang

TL;DR: GALA 以显式点云几何而非简化包围盒推理物体支撑和包含关系，逐个自回归预测目标物体 6D 位姿；两阶段训练优于缺少几何推理的基线，并可用于计划—摆放—验证式场景生成。

Details

Motivation: 真实 3D 场景布置需要满足支撑和包含等细粒度位置约束。依赖有向包围盒等简化物体表示的方法看不到详细几何，因此难以处理精细摆放关系。

Result: GALA 是具几何感知能力的语言模型，显式输入点云，在场景上下文和摆放指令条件下逐个自回归预测目标物体的六自由度位姿。训练分两阶段：先通过预训练任务对齐几何和文本，再针对物体布置微调。作者还整理覆盖多种房间类型和细粒度家具布局的多源场景数据集。基准实验显示 GALA 显著优于没有显式几何推理的基线；进一步构建计划—摆放—验证多阶段智能体流水线，用于文本驱动场景生成。

Insight: 支撑和包含关系依赖实际物体形状，包围盒无法表达的几何细节需要由点云显式建模。逐个预测位姿并在场景中迭代验证，可把几何语言模型接入更完整的文本生成 3D 布局流程。

Abstract: Reasoning about fine-grained placement constraints, such as support and containment, is essential for realistic 3D scene creation. It remains a significant challenge for existing methods that rely on simplified object representations like oriented bounding box (OBB), which are blind to the detailed geometry. To address this limitation, we introduce GALA, a geometry-aware language model with explicit point cloud perception for controllable object placement. Our model performs autoregressively by predicting the 6D pose of one target object at a time conditioned on the scene context and placement instruction. We utilize a two-stage training strategy: the first stage aligns geometric and textual modalities through pretraining tasks, and the second stage fine-tunes the model for placement. To facilitate this task, we also curate a multi-source scene dataset covering diverse room types and fine-grained furniture arrangements, which will be open-sourced for community benefit. Experiments on our benchmark show our model significantly outperforms baselines without explicit geometric reasoning. We further develop a multi-stage plan-place-verify agent pipeline that uses the model for text-driven scene generation. Project Page: https://xccelephant.github.io/paper/gala/

cs.LG [Back]

[157] Self-Evolving Agents through Privileged Retrospective Distillation cs.LG | cs.AI | cs.CLPDF

Yuhang Zhou, Yifan Wu, Bo Peng, Mingyi Wang, Jiayi Liu

TL;DR: RSD 将智能体自身历史轨迹与跨任务先例、反思及事后信息转为特权监督，再在线策略蒸馏回策略；ALFWorld、ScienceWorld 和 SearchQA 上相对基础模型最高提升 59.7%。

Details

Motivation: 自我进化智能体希望从部署经验中持续提升，但自然收集的轨迹常没有真值答案或验证器奖励，难以直接形成密集训练监督。

Result: 回顾式自蒸馏（RSD）在每条在线策略轨迹上让同一模型分别充当学生和教师：教师在利用跨任务先例、经验教训、逐轮反思以及完成轨迹后的未来回看信息时，重新评分学生已采取动作；再将教师分布在线策略蒸馏回策略。多轮过程中经验库增长，回顾上下文持续刷新，使模型、数据和监督共同演化。作者还提出前沿模型引导的上下文—策略进化，由更强模型对特权上下文构造方式提出受约束修改。在 Qwen3-8B 和 Qwen3-14B 的 ALFWorld、ScienceWorld、SearchQA 评估中，RSD 相对基础模型最高提升 59.7%；上下文策略进化较固定策略再相对提升最高 44.7%。

Insight: 没有外部真值轨迹或验证奖励时，已完成轨迹中的事后信息和跨任务经验仍可提供教师监督。回顾上下文能随经验库持续更新；前沿模型进一步优化上下文构造，但其增益是在所测任务和模型范围内。

Abstract: Self-evolving agents aim to improve from their own experience rather than remain fixed after deployment, but naturally collected trajectories often lack ground-truth solutions or verifier-derived rewards. We introduce Retrospective Self-Distillation (RSD), a multi-round framework that turns such experience into dense supervision using privileged retrospective context. For each on-policy trajectory, the same underlying model acts as both student and teacher: the teacher re-scores the student’s realized actions while conditioning on cross-task precedents and lessons, together with turn-level reflection and future hindsight from the completed trajectory. The resulting teacher distribution is distilled back into the policy through on-policy self-distillation. Across rounds, the experience bank grows and the retrospective context is refreshed, allowing the model, its data, and its supervision to co-evolve. We further introduce frontier-guided context-policy evolution, where a stronger frontier model proposes constrained edits to how privileged context is constructed. Across ALFWorld, ScienceWorld, and SearchQA with Qwen3-8B and Qwen3-14B, RSD improves performance by up to 59.7% relative to the base model, while frontier-guided context-policy evolution adds up to a further 44.7% relative improvement over a fixed context policy. These results show that naturally accumulated experience can be converted into persistent model capability without ground-truth trajectories or verifier-derived rewards for the core policy update.

[158] Pairwise Learning Increases Data Efficiency in Deep Neural Networks cs.LG | cs.AI | cs.CVPDF

Robert Bain, Marjan Rashidi, Elizabeth Chrastil

TL;DR: 该成对学习框架把回归改写为相对排序聚合，以少量标签构造大量比较样本；UTKFace 上从头训练的 ResNet10 年龄 MAE 为 3.64 年，STL10 小样本分类较十分类交叉熵最高提升 5.2%。

Details

Motivation: 深度网络在小样本回归中常输出低方差预测，难以捕捉个体差异。研究希望通过相对比较而非单样本绝对标签，提升不同架构和数据规模下的数据效率。

Result: 方法将回归重构为聚合相对排序的成对比较学习。在 23,000 张图像的 UTKFace 上，可由现有标签生成超过十亿条训练比较，无需新增监督；从头训练且仅用家用硬件的轻量 ResNet10 达到 3.64 年 MAE，超过包括大规模预训练在内的先前模型。对类别预测，在 STL10 仅有 500–2,000 个标注样本时，成对监督持续优于同配置的十分类交叉熵，准确率最高提高 5.2 个百分点。

Insight: 少量绝对标签可派生大量相对顺序约束，为模型提供比逐例拟合更丰富的监督，尤其有助于保留个体间差异。此策略可用于回归和分类的小样本设置，临床应用潜力仍需在具体临床数据上验证。

Abstract: Deep neural networks often fail at small-sample regression, collapsing to low-variance predictions that miss individual differences. Here, we introduce a pairwise comparison framework that reframes regression as aggregated relative rankings. This method improves data efficiency across model architectures and dataset sizes. On the UTKFace dataset (23k images), pairwise learning generates over one billion training comparisons without additional supervision. The paired ranking allows a lightweight ResNet10 trained from scratch on home hardware to achieve a 3.64-year MAE-surpassing previous models, including those with large-scale pretraining. For classification into categories, pairwise supervision consistently outperforms an otherwise identical 10-way crossentropy model on STL10 with 500-2000 labeled examples, improving accuracy by up to 5.2%. Overall, pairwise supervision enhances data efficiency and enables strong regression and classification performance when labeled data are limited, particularly in clinical settings.

[159] From RL Papers to Framework Code: Inclusion and Review in Seven Open-Source Training Frameworks cs.LG | cs.CL | cs.SEPDF

Taiheng Pan

TL;DR: 该研究追踪七个开源 RL 训练框架对 2025–2026 年通用 RL 方法论文的纳入情况：1,598 篇中仅 37 篇进入至少一个框架，180 天内新增纳入数未随论文量增长。

Details

Motivation: 研究者通常通过训练框架使用语言模型强化学习方法；一个方法被框架纳入后，用户只需调整配置即可采用。研究因此追踪方法从论文提出到进入开源框架的实际传播和评审过程。

Result: 作者分析七个开源 RL 后训练框架的提交历史，并与 2025 年 1 月至 2026 年 6 月筛选出的 6,939 篇 arXiv 论文关联。其中 1,598 篇提出通用 RL 训练方法，只有 37 篇进入至少一个框架。五个季度队列中，论文数从 72 增至 386，但 180 天内进入框架的方法仍维持每季 5–7 篇。已纳入论文更常训练 30B 及以上策略（41% 对 10%），也更常只改已有损失中的系数、裁剪、掩码或权重（29% 对 9%）；排除框架维护公司论文后差异仍在，代码发布率则相近。公开 issue/PR 很少拒绝方法，超过九成未纳入通用方法没有框架讨论记录，许多已有讨论也长期无回复。框架 issue 与 13 个大型开放模型技术报告还显示，用户少公开报告训练失败，技术报告列出 13 种常纳入方法中的 8 种。

Insight: 方法进入框架的瓶颈更像是缺乏公开讨论和维护响应，而非公开拒绝；论文数量增加也未带来纳入数量增长。框架实现、失败报告和模型技术报告的链接追踪，可帮助研究者理解新方法的实际采用路径和复现情况。

Abstract: Practitioners use reinforcement learning methods for language models through training frameworks, so a method that a framework includes is one configuration change away for its users. We measure how often this happens. We trace seven open-source frameworks for RL post-training through their commit histories and link them to 6,939 screened arXiv papers from January 2025 to June 2026. Of 1,598 papers that propose a general RL training method, 37 reached at least one framework. Across five quarterly cohorts of papers, the number included within 180 days stayed between 5 and 7 while the cohorts grew from 72 to 386 papers. Compared with papers from the same quarters, included papers more often trained policies of 30B parameters or more, at 41 against 10 percent, and more often changed a coefficient, clip, mask or weight in the existing loss, at 29 against 9 percent. Both gaps hold without papers from the companies that maintain the frameworks, while code release was equally common in both groups. The frameworks’ issues and pull requests show that few methods are turned away in public. More than nine in ten of the general methods no framework included have no thread there that cites or names them, and many proposals that do appear stay open without a reply. Two further records, the frameworks’ issues and the technical reports of 13 large open-weight models, show that users rarely report training failures in public and that the reports state 8 of the 13 widely included methods. We release the data as a tracker that links training failures to framework implementations and lists each framework’s contribution rules and earlier proposals.

[160] LocaLeJEPA: Maximum Entropy Representations under Geometric Priors cs.LG | cs.CVPDF

Kartik Tandon, Alessio Borgi, Pavel Snopov, Inés García-Redondo, Davide D’Ascenzo

TL;DR: LocaLeJEPA 将 JEPA 的熵最大化和分布匹配推广到局部欧几里得几何，提出 LocaLeReg 正则器；在双曲 ViT、等变 ResNet 及普通欧氏 ViT 上均优于 LeJEPA 的多种分类和下游任务表现。

Details

Motivation: JEPA 是有吸引力的自监督学习范式，但容易发生表示坍塌。LeJEPA 通过将嵌入匹配到各向同性高斯解决该问题，却依赖欧几里得几何，无法适配等变 CNN 或双曲 ViT 等具有非欧几里得内在结构的模型。

Result: LocaLeJEPA 从流形理论角度重构 LeJEPA 的熵最大化性质，提出局部欧几里得分布匹配正则器 LocaLeReg，以稳定且可扩展的方式实现框架。在 ImageNet-1K 上训练视觉模型的广泛实验显示，搭配双曲 ViT-S/8、等变 ResNet-50，以及普通欧氏 ViT-S/8、ViT-L/14 时，LocaLeJEPA 均显著优于 LeJEPA。优势同时体现在 ImageNet 线性分类、k-NN 分类和多个下游任务。

Insight: 自监督表示正则化应尊重数据和骨干网络的内在几何，而不应强制所有嵌入都服从全局欧氏高斯假设。局部欧几里得匹配既支持特殊几何，也能改善普通欧氏模型表现，提供更通用的 JEPA 设计。

Abstract: Joint-Embedding Predictive Architectures (JEPA) offer an appealing approach to self-supervised learning, but are typically prone to representation collapse. LeJEPA resolves this by introducing a theoretically grounded distribution-matching objective that drives the embedding towards an isotropic Gaussian. However, this approach is fundamentally tied to Euclidean assumptions, and its global target does not reflect domain-specific geometric priors, such as the use of non-Euclidean embedding geometries, e.g., equivariant CNNs or hyperbolic ViTs. We thus introduce LocaLeJEPA, a framework motivated by a manifold-theoretic reformulation of LeJEPA’s entropy-maximization property. The accompanying LocaLeReg, a novel locally Euclidean distribution-matching regularizer, enables a stable and scalable implementation of the LocaLeJEPA framework. We then perform extensive experiments in the vision setting on models trained on ImageNet-1K. LocaLeJEPA significantly outperforms LeJEPA when paired with hyperbolic ViT-S/8 and equivariant ResNet-50 backbones, and also with ordinary Euclidean ViT-S/8 and ViT-L/14 backbones. This holds both in terms of linear and k-NN classification performance on ImageNet and on a series of downstream tasks tested. We view the LocaLeJEPA formalism as a principled approach to the JEPA paradigm that better respects intrinsic data geometry while also accommodating generalizations to exotic embedding geometries. Code available at https://github.com/alessioborgi/LocaLeJEPA.

[161] Present but Hard to Read: Probing Latent Reasoning with Minimal Pairs cs.LG | cs.CLPDF

Aur Shalev Merin

TL;DR: 该研究用最小提示对测试模型内部是否包含中间计算值，发现单提示探针可能读不到实际存在的数值；两步任务中的 a+b 信号虽可读，但跨问题移植不改变最终答案，说明可读不等于被使用。

Details

Motivation: 潜在推理探针常在答案开始生成处读取模型状态，并把探针失败当作某个值不存在。研究质疑该推断，测试内部计算值是否可能存在但难以从单个提示的隐藏状态读出。

Result: 作者在循环模型 Ouro-1.4B 和标准 Transformer Qwen2.5-1.5B 上，用仅在问题某个数字上不同的最小提示对探测该数字。对照显示该值在最后提示 token 已存在，并以跨问题共享代码表征，读出率约 0.9；常见的一次只看一个提示的探针却几乎读不到，Ouro 为 0.36、Qwen 为 0.19，即使训练 5,249 道题后亦然。该数字变化幅度小而非被杂讯淹没；替换成随机词造成状态移动更大、更易读。作者提供包括通用混合合成零假设的协议，用来区分计算值与输入复制/混合。在预注册两步问题中，Ouro 写出答案末位前可检测到未写出的 a+b 小信号且符号随运算变化，但相当部分也可由混合解释。将其他问题的该中间值从第一轮起移植，不会把最终数字推向供体答案；移植答案本身则会，表明该值可读但未被使用。

Insight: 线性探针失败不等于模型状态中没有某个值，而探针成功也可能只是读到输入混合的痕迹。要证明模型实际使用中间表示，还需通过最小对照和因果移植检验；本研究发现“可读”与“参与最终计算”可以分离。

Abstract: Probing studies of latent reasoning often read a model’s state where the answer begins and take a failed probe as evidence that a value is absent. We test this with a digit copied from the question, in the looped model Ouro-1.4B and the standard transformer Qwen2.5-1.5B. Comparing prompts that differ only in that digit shows it is present at the last prompt token, in a code shared across questions (readout about 0.9). A probe that sees one prompt at a time, the usual setting, barely reads it: 0.36 in Ouro and 0.19 in Qwen even after 5,249 training questions. The digit’s change is small rather than crowded: random noise lands on equally busy directions, while a random word in its place moves the state far more and is readable. Since every varied token leaves a trace, a successful probe is ambiguous too. We give a protocol, including a synthetic null for generic mixing, for testing computed values against copies and mixtures of the inputs. In pre-registered studies of two-step problems it finds a small signal for the unwritten intermediate a+b just before Ouro writes the answer’s last digit, and its sign follows the operation, though mixing alone produces much of that sign-following part. Holding that value at another problem’s from the first loop on does not move the written digit toward the other problem’s, while the same patch of the answer does: the value is readable but not used.

[162] Binary Discrete Diffusion: Candidate-Set Diffusion for Logic and Planning Tasks cs.LG | cs.AI | cs.CL | stat.MLPDF

Rodrigo Casado Noguerales, Dimitri von Rütte, Bernhard Schölkopf, Thomas Hofmann, Aran Raoufi

TL;DR: Binary Discrete Diffusion 让每个位置的噪声状态表示一组候选 token，以候选增删逐步表达不确定性；在数独、Boxoban 和图着色难例上超过匹配的掩码/均匀扩散基线，并在语言建模上保持竞争力。

Details

Motivation: 离散扩散通过迭代去噪生成文本，具备任意顺序生成、自纠和填充潜力，但掩码或均匀扩散一次就抹去 token 身份，无法显式表示多个候选仍可能成立的部分不确定状态。

Result: Binary Discrete Diffusion 提出一类连续时间离散扩散过程，每个位置的噪声状态是候选 token 集合，用二进制成员向量表示；扩散通过增加和删除候选改变集合，使信息逐渐丢失或恢复，状态本身保留部分不确定性。在 Sudoku-Extreme、Boxoban 和图着色上，二元扩散的对称形式在匹配架构、控制训练、采样和调参预算下，持续超过调优充分的掩码及均匀扩散基线，收益在最难实例上最大。其在 Text8、TinyStories、OpenWebText 等语言建模任务上也保持竞争力。

Insight: 反向模型学到的计算方式会受前向噪声核影响；把不确定性表示为候选集合，可让模型在迭代中逐步增加或移除可能答案，而非一次抹去信息。这种中间表示对组合推理任务尤其有用。

Abstract: Discrete diffusion models iteratively denoise a noisy sequence of categorical data such as text, enabling any-order generation with self-correction and in-filling capabilities. This makes them promising candidates for reasoning, planning, and constrained-generation tasks like coding and math. Yet masked and uniform diffusion erase a token’s identity in a single corruption event, so their noisy states cannot explicitly represent partially resolved uncertainty in which several alternatives remain plausible. We close this gap with Binary Discrete Diffusion, a family of continuous-time discrete-diffusion processes whose noisy state is a set of candidate tokens per position, represented as a binary membership vector. Binary diffusion changes candidate sets through additions and removals, allowing information to be lost and recovered gradually while the diffusion state itself represents partial uncertainty. On Sudoku-Extreme, Boxoban, and graph coloring, the symmetric formulation of binary diffusion consistently outperforms strong, well-tuned masked and uniform baselines under matched architectures and controlled training, sampling, and tuning budgets, with its largest gains on the hardest instances, while remaining competitive on language modeling (Text8, TinyStories, OpenWebText). These results support candidate sets as an effective intermediate representation for iterative reasoning and show that the corruption kernel can materially change the computation learned by the reverse model.

cs.RO [Back]

[163] PLaCA: Learning Patch-Level Future Latent Change for Action Generation cs.RO | cs.CVPDF

Zhan Yi, Yuchen Wang, Chao Li, Lei Hong, Boyuan Yang

TL;DR: PLaCA 直接预测当前多模态输入对应的空间结构化未来潜变量变化，再将变化显式注入动作生成；LIBERO-Long 成功率提高至 79.0%，CALVIN 平均连续任务长度从 2.784 升至 3.564。

Details

Motivation: VLA 模型根据视觉和语言生成机器人动作，但有效操作还需要预判环境将如何变化。预测完整未来图像计算昂贵，而高度压缩的潜变量又可能丢失局部变化信息。

Result: PLaCA 是以未来潜变量变化为核心的世界到动作框架，直接从当前多模态输入预测空间结构化的 patch 级未来变化，以保留局部环境信息。变化感知监督加大对变化区域的学习权重；未来到动作接口再显式把预测变化用于动作生成。在 LIBERO-Long 上成功率为 79.0%，较仅动作基线高 5.0 个百分点；CALVIN 平均序列长度从 2.784 提升到 3.564。第二阶段仅更新 2.95% 模型参数即可取得这些收益。

Insight: 动作规划所需的未来信息不一定要通过完整视频或图像生成，可直接预测空间局部潜变量如何变化。变化区域加权监督与显式未来—动作接口，让模型以较小参数更新获得更好的长程操作表现。

Abstract: Vision-Language-Action (VLA) models generate robot actions from visual observations and language instructions, but effective manipulation also requires anticipating how the environment will change. Existing world-action models explore future image prediction and latent dynamics modeling. However, generating complete future images can be computationally expensive, while highly compressed latent representations may obscure local changes. To address these challenges, we propose PLaCA, a world-to-action framework built around future latent change. PLaCA directly predicts spatially structured patch-level future latent change from the current multimodal input, preserving local information about expected environmental changes. We introduce patch-level change-aware supervision to emphasize regions undergoing larger changes and a future-to-action interface that explicitly incorporates predicted future latent change into action generation. Experiments on LIBERO-Long show that PLaCA achieves a 79.0% success rate, improving upon the Action-only baseline by 5.0 percentage points. On CALVIN, PLaCA improves the average sequence length from 2.784 to 3.564. These improvements are achieved while updating only 2.95% of the model parameters during the second training stage, demonstrating the effectiveness of future latent change modeling for downstream robotic manipulation.

Pengying Wu, Zhejia Wen, Kang Ding, Kangjie Zhou, Chunxuan Jiao

TL;DR: CovNav 用保形预测校准快速本地 LLM 的物体共现判断，只把含糊查询升级到慢速思维链；HM3D 成功率较最强零样本基线提高 0.8–1.7 点，慢推理仅用于 12.4% 查询。

Details

Motivation: ObjectNav 需要利用物体共现等空间常识判断目标可能位置。云端大模型推理质量高但延迟和隐私成本大，小型设备模型响应快却容易产生空间幻觉；混合推理模型虽有快慢模式，但需决定何时值得支付慢推理代价。

Result: CovNav 是免训练框架，用保形预测（CP）把 System 1 快速判断与 System 2 慢速推理变成不确定性决策。快速本地 LLM 对目标是否靠近某个观测物体作结构化二元判断，CP 将 token 概率转成预测集合，只对含糊查询升级到慢速思维链。物体对表示使校准可处理，并借助现成检测器支持开放集物体。在 Gibson、HM3D 上评估，HM3D v1/v2 成功率较最强零样本基线提高 0.8/1.7 个百分点；慢推理仅用于 12.4% 查询，同时保留始终思考模式的大部分增益且延迟更低。TurtleBot 4 实机实验也验证该方法。

Insight: 慢速推理不必对每个空间判断都运行；经校准的快速模型可先筛出真正含糊的问题，再升级推理。保形预测为这种快慢切换提供了不确定性依据，使机器人在效率、隐私和判断质量间取得折中。

Abstract: In object goal navigation (ObjectNav), an embodied agent must find a target object (e.g., “find a bed”) in a previously unseen environment, relying on spatial commonsense such as object co-occurrence. Large Language Models (LLMs) encode this commonsense, but deploying them on robots exposes a trade-off between reasoning quality and efficiency: cloud-based models incur latency and privacy risks, whereas small on-device LLMs are fast but prone to hallucinated spatial judgments. Hybrid reasoning LLMs offer both a fast non-thinking mode and a slow thinking mode, which raises a key question for embodied agents: when is slow thinking worth its cost? We propose CovNav, a training-free framework that answers this question with Conformal Prediction (CP), turning dual-process (System 1 / System 2) inference into an uncertainty-aware decision. Much like recent decision models such as Jev, CovNav casts each spatial query as a structured binary decision rather than free-form generation: a local LLM in fast mode judges whether the target is likely near an observed object, CP converts its token probabilities into a prediction set, and only ambiguous queries are escalated to slow chain-of-thought reasoning. The object-pair formulation keeps calibration tractable and supports open-set objects through off-the-shelf detectors. Experiments on Gibson and HM3D show that CovNav surpasses the strongest zero-shot baseline by 0.8 and 1.7 percentage points in success rate on HM3D v1 and v2, while invoking slow reasoning for only 12.4% of queries and retaining most of the gain of always-on thinking at a fraction of its latency. Real-robot experiments on a TurtleBot 4 further validate the approach. CovNav shows how calibrated uncertainty can decide when an embodied agent should think slowly, offering a principled form of adaptive test-time reasoning for LLM-based robots.

[165] CAPSafe: A Benchmark for Contextual Action and Plan Safety Reasoning in Embodied Agents cs.RO | cs.CLPDF

Youmna Farag, Svetlana Stoyanchev, Simon Keizer, Mohan Li, Rama Doddipatla

TL;DR: CAPSafe 分别评测具身智能体单步动作安全和长程计划安全，并标注情境性、多重危害及相对严重度；九种模型表现出识别危险动作容易、规划安全长程任务更难的明显差距。

Details

Motivation: 大型语言模型驱动的具身智能体必须能在环境中推理安全。只测某个动作是否安全不足以说明智能体能否将风险意识维持到复杂家庭任务的长程规划中。

Result: CAPSafe 包含两层评测：给定环境上下文判断单个动作是否安全，以及为复杂危险家务任务生成安全的长程计划。基准中的危险需从物体属性和情境推断，同一环境可有多种风险，并标注相对严重程度以便细粒度分析。对九种闭源和开源 LLM 的评估显示，危险动作识别与安全规划之间存在显著差距：部分模型识别不安全动作的准确率超过 90%，但长程安全计划明显更难；Gemini-3-pro 安全成功率最高为 78.19%，其余模型低于 65%。

Insight: 辨认某一步危险不等于能在长行动序列中始终选择安全方案。将动作级和计划级评测分开，并记录多重情境危险及严重度，能暴露模型从局部风险识别到全程安全规划之间的能力落差。

Abstract: Reasoning about safety is essential for embodied agents powered by large language models (LLMs). We introduce the Contextual Action and Plan Safety benchmark (CAPSafe), designed to evaluate safety reasoning at two levels: (1) an action-level dataset that tests whether a single action is safe given its environmental context, and (2) a plan-level dataset that evaluates whether agents can generate safe long-horizon plans for complex hazardous household tasks. CAPSafe models safety conditions where hazards are situational (inferred from object properties), multiple hazards can co-occur within the same environment, and each is annotated with a relative severity level for fine-grained analysis. Evaluating nine closed and open-source LLMs reveals a substantial gap between hazard recognition and safe long-horizon planning. Several models achieve high accuracy in recognizing unsafe actions (exceeding 90% in the best cases), yet safe long-horizon planning remains substantially harder. Gemini-3-pro achieves the highest safe success rate (78.19%), while other models remain below 65%. These results highlight that robust safety reasoning over long action sequences remains an open challenge.

[166] GPT-6-Astra Understands Touch and Outperform Vision–Tactile–Language–Action Models cs.RO | cs.CLPDF

Ziyong Wang, Yupei Lin, Runxuan Huang, Liang Lin, Dongyu Zhang

TL;DR: GPT-as-Tactile-Policy 将专家示范压缩为任务指导和触觉参考，由 GPT-6-Astra结合多模态观察与交互历史直接控制接触丰富操作；五项 UniVTAC 任务平均成功率 93.8%，插孔任务触觉反馈将成功率从 31% 提至 99%。

Details

Motivation: 通用多模态模型可能直接用作机器人策略，但其是否理解真实交互物理并能据此指导动作仍缺少研究。接触丰富操作需要解释触觉反馈并在受阻后调整动作；既有触觉策略依赖专门预训练和逐任务优化，数据与训练成本较高。

Result: GPT-as-Tactile-Policy 将专家演示总结为任务指导和接触评估/纠错用触觉参考，GPT-6-Astra结合该上下文、多模态观察和交互历史生成控制命令，并根据触觉接触反馈修正动作。无需额外机器人专用预训练或逐任务策略微调，在五项 UniVTAC 任务上的平均成功率为 93.8%，总体可与最先进策略相比，部分任务成功率更高。插孔任务中，加入触觉反馈使成功率从 31% 提升到 99%。执行分析还展示了由接触引导的探测和修正过程。

Insight: 专家经验可被压缩为可复用任务上下文，在线触觉反馈再用于探测接触和纠正动作，使通用模型具备物理交互闭环。插孔结果说明接触反馈可在高精度任务中显著改变成功率，但总体数字来自五项特定基准任务。

Abstract: General-purpose multimodal models have shown promise as direct robot action policies, yet whether they grasp the physics underlying real-world interactions and can apply that understanding to guide action remains underexplored. We investigate this question using contact-rich manipulation as a representative testbed, examining tactile understanding as a concrete instance of this broader capability. Contact-rich manipulation requires interpreting tactile feedback and adjusting actions after obstruction. Existing learned tactile policies acquire these capabilities through specialized pretraining and per-task optimization, with substantial data and training costs. We present GPT-as-Tactile-Policy, which summarizes expert demonstrations into task guidance and tactile references for contact assessment and corrective action. GPT-6-Astra combines this context with multimodal observations and interaction history to generate control commands and adjust actions through contact feedback. Without additional robotics-specific pretraining or per-task policy fine-tuning, our method achieves 93.8% mean success across five UniVTAC tasks. Overall performance is comparable to state-of-the-art policies, with higher success on selected tasks. On Insert Hole, tactile feedback improves success from 31% to 99%. Execution analysis further demonstrates contact-guided probing and correction, supporting manipulation progress through explicit expert experience and online feedback.

[167] VLM-Guided Contact Retargeting and Generative Partner Modeling for Humanoid-Human Interaction cs.RO | cs.AI | cs.CVPDF

Yuto Shibata, Kotaro Amaya, Kashu Yamazaki, Lalit Jayanti, Yoshimitsu Aoki

TL;DR: REACT 从人—人示范学习可部署的人形机器人交互策略：VLM 引导语义接触建模与动作重定向，特权策略再蒸馏到仅用机载深度的第一人称策略，并通过生成式伙伴状态模型应对遮挡。

Details

Motivation: 近身人机接触时，人体伙伴可能被遮挡、截断或离开机器人视野，姿态估计容易失效；传统方法因此依赖外部跟踪或特权人体状态。人—人动作捕捉数据也会受严重相互遮挡影响。

Result: REACT 将语义接触结构作为演示处理、交互学习和机载控制之间的监督信号。VLM 引导接触建模与重定向识别有意义接触，并映射到人形机器人几何同时保留互动结构；特权交互策略以接触感知奖励学习物理合理动作，再蒸馏为仅通过机载感知训练的第一人称深度策略，训练中用照片级人体深度渲染。针对部分可观测性，生成式伙伴状态目标从被遮挡的第一人称视角预测伙伴运动。在仿真及 Unitree G1 实机的五类接触丰富交互中，语义接触建模改善示范互动保留，伙伴状态建模在五项中的四项提高接触召回，遮挡最重时收益最大；实机仅用机载传感器完成全部五项交互。

Insight: 可部署的人机交互策略需要从示范中保留语义接触关系，并在遮挡时推断伙伴状态。将特权交互学习蒸馏到仅凭机载深度工作的策略，使训练监督丰富而部署无需外部人体跟踪。

Abstract: Humanoid-human interaction requires robots to operate under severe partial observability: during close physical contact, the human partner is occluded, truncated, or outside the robot’s field of view, causing pose estimation to fail and often necessitating external tracking or privileged human state. At the same time, heavy mutual occlusions introduce errors into the human-human motion-capture data used for learning. We present REACT, a framework for learning deployable humanoid-human interaction policies from human-human demonstrations. REACT treats semantic contact structure as the key supervisory signal connecting demonstration processing, interaction learning, and onboard control. First, a VLM-guided contact modeling and retargeting pipeline identifies semantically meaningful contacts and transfers them onto humanoid-human geometry while preserving interaction structure. Using these annotations, privileged interaction policies learn physically grounded behaviors through interaction-aware contact rewards and are then distilled into deployable egocentric depth policies trained entirely from onboard sensing using photorealistic human depth rendering. To address severe partial observability, we introduce generative partner-state modeling objectives that predict partner motion from occluded egocentric views. We evaluate REACT in simulation and on a real Unitree G1 humanoid across five contact-rich interactions. Semantic contact modeling substantially improves preservation of demonstrated interactions, while generative partner-state modeling improves contact recall on four of five interactions, most under heavy occlusion. On real hardware, REACT performs all five interactions using onboard sensing alone.

[168] UniWALM: Unified World Action Language Model for Embodied Robot Control cs.RO | cs.AI | cs.CVPDF

Rahul Sajnani, Diego Romeres, Mingyuan Zhang, Kai Gao, Carl Qi

TL;DR: UniWALM 在单一混合 Transformer 中同步生成视频、动作和语言，将生成的子任务/文本记忆反馈到下一步；无需预训练语言模型，在 Find-the-Item 实机任务上文本记忆令成功率从 11.1% 升至 61.1%。

Details

Motivation: 人类能整合语言、感知和动作经验。现有机器人模型通常将推理或视觉语言模型附加在视频—动作骨干之前，分阶段运行；语言未必进入共享表示或作为持续记忆辅助后续动作。

Result: UniWALM 在一个共享表示中学习视频、动作和语言，使每种模态既作条件也作监督目标。单一混合 Transformer 骨干配备各模态扩散头并同步去噪，在同一次前向中生成子任务和文本记忆及动作，不需单独规划阶段；下一步再将生成文本重新输入，形成无需外部规划器或记忆库的语言记忆闭环。Flow Matching with Correction 训练目标教模型从受扰动作轨迹恢复，推理无需额外成本。相同骨干对照 FastWAM，在 MolmoSpaces 组合抓放和 RMBench 记忆子集上持续改善；RMBench 达 34.5%，无预训练语言/推理模型，超过需关键帧的 Mem-0（28.5%）。真实 Find-the-Item 任务中，文本记忆把成功率由 11.1% 提至 61.1%，最先进 VLA 不超过随机水平 33.3%。

Insight: 让模型与动作同步生成并重用语言记忆，可把多步经验带入后续控制，而不需外接规划器或记忆库。实机找物结果显示，文本记忆在依赖历史信息的任务中可显著提升成功率；纠错流匹配则帮助丰富目标下保持动作可靠性。

Abstract: Motivated by the human ability to integrate experience across language, perception, and action, we introduce UniWALM, a unified world-action-language model that learns video, action, and language in a single shared representation, where each modality is both a conditioning signal and a supervision target. We ask: can jointly generating language enrich this shared representation, improving manipulation and supporting memory-dependent behavior? Unlike prior approaches that attach a reasoning or vision-language model to a video-action backbone and run them as distinct stages, UniWALM unifies all three modalities inside a single mixture-of-transformers backbone whose per-modality diffusion heads co-denoise synchronously, decoding subtask and textual memory in the same pass as action with no separate planning stage; the generated language is re-consumed on the next step, closing a language-as-memory loop without an external planner or memory bank. To keep the action stream reliable under this richer objective, we further introduce Flow Matching with Correction (FMC), a training objective that teaches recovery from perturbed action trajectories at no inference-time cost. UniWALM consistently improves over same-backbone baselines (e.g., FastWAM) on compositional pick-and-place (MolmoSpaces) and across the memory-dependent subset of RMBench, where it reaches 34.5% without any pretrained language or reasoning model and exceeds Mem-0’s keyframe-equipped setup (28.5%) using only a single anchor frame. On a real-world Find-the-Item task, generating textual memory lifts success from 11.1% to 61.1%, while state-of-the-art VLAs stay at or below chance (<=33.3%).

[169] Learning Adaptable Dexterous Skills via Hybrid Dexterous Mimicking cs.RO | cs.CV | cs.GR | cs.LGPDF

Yuxuan Kuang, Jiashun Wang, Yixuan Sun, Yufei Ye, Sungjae Park

TL;DR: AdaDex 用单段数秒手—物轨迹同时训练动作跟踪环境与目标泛化环境，将人类灵巧动作先验转化为可适配目标条件技能；覆盖抓握、手内旋转和抛接，并展示跨模拟器及真实迁移。

Details

Motivation: 多指灵巧手可支持功能抓握、手内重定向和动态交接，但现有学习方案存在折中：目标到达强化学习可适应任意物体姿态，却缺少人类先验，容易学到不自然、不可靠的手指策略；动作跟踪能复现单段人类动作，却难以偏离参考轨迹。

Result: AdaDex 是目标条件强化学习框架，可将来自动作捕捉或野外 RGB(D) 手物交互重建的单段数秒轨迹转为可适应的灵巧技能。混合灵巧模仿在大规模并行环境中训练共享策略：动作跟踪环境用稠密跟踪目标注入人类动作先验；泛化环境扰动初始状态和目标，并仅用稀疏物体成功奖励，迫使技能在远离参考轨迹时仍可工作。由每项技能仅数秒人类动作，模型可学习功能抓握、物体重摆、带手指步态的手内旋转及抛接等动态行为。方法在泛化与功能性上超过基线，并展示跨模拟器和真实世界迁移。

Insight: 把稠密的人类动作跟踪与稀疏目标成功训练放进共享策略，可同时保留自然动作先验并鼓励偏离参考完成新目标。短时人类示范因此能被扩展为适应不同物体姿态和任务结果的灵巧技能。

Abstract: Dexterous multi-finger hands hold promise to unlock diverse skills like functional grasps, in-hand reorientation, and dynamic handover that the human-designed world assumes, yet existing learning recipes force a trade-off. Goal-reaching reinforcement learning generalizes to arbitrary object poses but, lacking any human prior, converges to unnatural and unreliable finger strategies; motion tracking reproduces human-like behavior from a single clip but cannot deviate from it. We present AdaDex, a goal-conditioned RL framework that turns a single hand-object trajectory of a few seconds—from mocap data or HOI reconstruction from in-the-wild RGB(D) video—into an adaptable dexterous skill. At the core of AdaDex is Hybrid Dexterous Mimicking: a shared policy is trained on two populations of massively parallel environments: motion tracking environments trained with dense motion tracking objective, which instill the human prior from human motion; and generalization environments with noised initial states and goals and a sparse object-success reward, which force the skill to work far off the reference. From seconds of human motion per skill, the resulting policies can learn diverse adaptable dexterous skills, such as functional grasping, object reposing, in-hand reorientation with finger gaiting, and dynamic behaviors like throw-and-catch. Our method outperforms baselines in terms of generalization and functionality, and we demonstrate transfer across simulators and to the real world. Project page: https://yuxuank.com/AdaDex/.

cs.SI [Back]

[170] Do LLMs Really Lack Difference Awareness? Uncovering Heuristic Substitution in Group-Differentiating Fairness cs.SI | cs.CLPDF

Jingshen Zhang, Bo Wang, Yanlin Fu, Yuewen Dang, Dongming Zhao

TL;DR: TDD 将公平推理拆为先识别与情境相关的群体差异、再据此决策；四个基准和十种模型上超过单阶段基线，并以机制分析支持模型可能用形式平等启发式替代复杂差异推理。

Details

Motivation: 群体差异意识指模型能否在公平决策中识别并承认社会群体间有意义的差异。既有研究发现模型在此类任务表现不佳，通常解释为缺乏差异意识；作者提出另一种可能：模型可能用更简单、易调用的形式平等启发式替代“识别差异并判断其公平含义”的复杂任务。

Result: 两阶段区分—决策框架（TDD）先辨别情境相关群体差异，再作出相应决定，以减少对一视同仁捷径的依赖。在四个基准、参数规模从十亿到万亿级的十种模型上，TDD 显著优于单阶段基线，甚至优于加入模拟测试集泄漏强化的基线。与神经元级对比探测结合后，机制分析发现与形式平等启发式一致的两个迹象：紧凑、局部协调的表示结构，以及默认推理中的显著激活偏置。阶段分解还揭示启发式挤占和阶段动态不匹配等先前被忽略的错误模式。

Insight: 低差异意识表现未必意味着模型完全没有识别差异的能力，也可能是复杂的识别—决策过程被简单形式平等规则取代。分阶段显式处理可以改善结果并暴露错误发生位置；机制证据与该假说相符，但不等同于证明所有公平错误都由该机制造成。

Abstract: In this paper, we investigate the issue of difference awareness in LLMs, defined as a model’s ability to recognize and acknowledge meaningful differences between social groups in fairness decision-making. Previous studies have consistently shown that models perform poorly on such tasks, a finding commonly attributed to a lack of difference awareness. We propose an alternative account, which we term Fairness Heuristic Substitution: difference awareness is not necessarily absent, but the complex demand of simultaneously identifying relevant group differences and determining their implications for fairness decisions may lead models to substitute the simpler, more accessible equal-treatment heuristic, i.e., formal equality. Based on this hypothesis, we introduce TDD, a Two-stage Distinguish-Decide framework that explicitly decomposes fairness reasoning into first distinguishing contextually relevant group differences and then making the corresponding decision, thereby discouraging reliance on formal-equality shortcuts. (i) Across four benchmarks and ten models ranging from billions to trillions of parameters, TDD significantly outperforms one-stage baselines, even one strengthened through simulated test-set leakage. (ii) Combining TDD with neuron-level contrastive probing provides mechanistic evidence consistent with the Fairness Heuristic Substitution hypothesis by revealing two signatures of the formal-equality: a compact, locally coordinated representational structure and a pronounced activation bias under default reasoning. (iii) TDD’s stage-wise decomposition uncovers overlooked failure modes in fairness reasoning, including heuristic displacement and misaligned stage dynamics.

eess.IV [Back]

[171] Codec-Compatible Learned Compression for 3D Gaussian Splatting eess.IV | cs.CVPDF

Feiyang Yu, Qi Yang, Wenjie Huang, Yunfeng Guan, Yiling Xu

TL;DR: CCT-GS 为 3D Gaussian Splatting 的高维非直流球谐系数学习跨场景紧凑变换，并用轻量 LoRA 恢复场景细节；在 MPEG GSC 序列上较视频编码基线平均 BD-rate 降低 51.30%。

Details

Motivation: 视频式 3DGS 压缩把高斯属性表示成 2D 图并用标准视频编码器压缩。其中高维非直流球谐（SH-AC）图通道最多、占码流大部分，但统计分布不同于自然图像，系数之间的非线性依赖也尚未充分利用。

Result: CCT-GS 是面向编解码器兼容的学习式变换框架。它先学习通用 SH-AC 变换，捕捉跨场景规律，将 SH-AC 图压缩到适合传统编解码器的紧凑瓶颈图；再以基于 LoRA 的场景适配和轻量侧信息恢复场景特定外观细节。在 MPEG GSC 序列上的实验显示，CCT-GS 持续优于代表性视频式压缩基线，较视频式锚点的平均 BD-rate 降低 51.30%。

Insight: 把跨场景可共享的球谐相关性先转成编解码器友好的低维表示，再用小型场景适配补细节，可兼顾压缩效率与个性化外观。收益主要来自原始 SH-AC 高通道数据的统计结构，不必替换标准视频编码器。

Abstract: Video-based 3D Gaussian Splatting (3DGS) compression methods provide a practical route by representing Gaussian attributes as 2D maps and coding them with standard video codecs. Among these maps, high-dimensional non-DC spherical harmonics (SH-AC) maps contain the largest number of channels and account for a dominant portion of the bitstream. However, their statistics differ substantially from those of natural images, and the nonlinear dependencies among SH-AC coefficients remain insufficiently exploited. To address these issues, we propose CCT-GS, a Codec-Compatible learned Transform framework for 3DGS compression. CCT-GS first learns a generalized SH-AC transform that captures cross-scene regularities and converts SH-AC maps into compact codec-friendly bottleneck maps. It further introduces LoRA-based scene adaptation to recover scene-specific appearance details with lightweight side information. Experiments on MPEG GSC sequences demonstrate that CCT-GS consistently outperforms representative video-based baselines, achieving an average BD-rate reduction of 51.30% over the video-based anchor.

[172] CAPS: Clinically-Verifiable Anatomy-Prioritized Synthesis for Missing MRI Imputation in Brain Tumor Segmentation eess.IV | cs.CVPDF

Cecilia Diana-Albelda, Arthur Longuefosse, Mario Rubén Paz Campos, Álvaro García-Martín, Jesus Bescos

TL;DR: CAPS 以解剖优先的多模态生成补全缺失脑肿瘤 MRI 模态，并用强度、解剖特征和双向 Dice 目标约束拓扑边界；BraTS 上分割平均 Dice 82.38%，且报告跨脑膜瘤、儿科和撒哈拉以南队列零样本泛化。

Details

Motivation: 多参数 MRI 是神经肿瘤学标准检查，但现实临床难以总是完成四模态采集。缺失模态系统常面临折中：稳健分割器绕过图像生成而难解释，常规合成模型又容易模糊，难以提供可信诊断证据。

Result: CAPS（临床可验证、解剖优先合成）采用多模态生成架构及混合目标 L1 + L_AFP + L_DualDice，显式保持深层解剖特征和严格拓扑边界，而非仅优化像素差。在 BraTS 成人胶质瘤数据集上，合成保真度的强度指标优于基线，下游分割平均 Dice 达 82.38%，恢复可检查的视觉上下文。方法还在未见的脑膜瘤、儿科及撒哈拉以南非洲队列中无需领域适配而保持较高结构保真度；盲法放射科评估确认解剖感知合成改善主观图像质量与临床效用。

Insight: 缺失 MRI 模态补全不能只追求逐像素逼真，还必须保留解剖结构和拓扑，才能为后续分割及临床复核提供可信依据。下游分割与盲法放射学评价共同支持该目标设计，跨队列结果显示其潜在迁移能力。

Abstract: Multi-parametric MRI is the gold standard for neuro-oncology, yet acquiring complete 4-modality protocols may be unfeasible in real-world clinical practice. When handling missing modalities, existing automated systems force a critical compromise: robust segmenters operate as uninterpretable “black boxes” that bypass image generation, while standard synthesis models often produce blurry reconstructions lacking diagnostic reliability. To address this issue, we propose CAPS, a Clinically-Verifiable Anatomy-Prioritized Synthesis framework that reconciles computational precision with clinical transparency. Our multi-modal generative architecture is driven by a hybrid objective function (L_1 + L_AFP + L_DualDice) that explicitly enforces the preservation of deep anatomical features and strict topological boundaries, rather than relying solely on pixel-wise optimization. Evaluated comprehensively on the BraTS Adult Glioma dataset, the framework achieves superior synthesis fidelity across intensity-based metrics, and demonstrates robust downstream segmentation performance (82.38% mean Dice), successfully restoring verifiable visual context. Furthermore, the framework exhibits exceptional zero-shot cross-domain generalization, maintaining high structural fidelity across completely unseen Meningioma, Pediatric, and Sub-Saharan African cohorts without domain-specific adaptation. Finally, a blinded radiological assessment confirms that our anatomy-aware approach significantly enhances both perceived image quality and clinical utility, providing clinicians with the reliable visual evidence required to trust downstream automated workflows.

eess.SY [Back]

[173] Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions eess.SY | cs.CV | cs.ROPDF

Zhiting Mei, Tenny Yin, Ola Shorinwa, Apurva Badithela, Zhonghe Zheng

TL;DR: 该综述梳理视频模型作为机器人具身世界模型的应用、挑战和未来方向，涵盖数据生成、策略学习、强化学习动力学/奖励建模、策略评估与视觉规划，并强调物理幻觉、安全、指令遵循及算力成本问题。

Details

Motivation: 视频世界模型可根据多模态输入生成包含细粒度交互的高保真视频，有望缓解物理模拟器难以逼真处理可变形物体和复杂交互的问题，并比语言抽象更细致地表示世界动态。但模型仍可能生成违反物理规律的未来预测。

Result: 综述回顾视频模型及其在机器人具身世界模型中的应用，包括高效数据生成与策略学习、强化学习中的动力学和奖励建模、策略评估及视觉规划。作者总结阻碍可信集成的挑战：指令遵循不足、违反物理规律等幻觉、不安全内容生成，以及显著的数据和计算开销；并提出可能的未来研究方向，推动视频模型在机器人和安全关键场景的应用。

Insight: 视频模型能以细粒度表达复杂物理交互，补足语言世界描述和部分传统仿真的局限，但逼真视频不等于可信物理预测。要用于机器人闭环，仍需解决物理一致性、安全、可控性和资源成本，并开展面向安全关键场景的验证。

Abstract: Video world models have emerged as promising candidates for high-fidelity world models, offering the potential to synthesize high-quality videos capturing fine-grained interactions between agents and their environments conditioned on multi-modal user inputs. Their impressive capabilities address many of the long-standing challenges faced by physics-based simulators, driving broad adoption in many problem domains, e.g., robotics. For example, video models can generate photorealistic, physically consistent deformable-body simulation without making prohibitive simplifying assumptions, which is a major bottleneck in physics-based simulation. Moreover, video models can serve as foundation world models that capture the dynamics of the world in a fine-grained and expressive way. They thus overcome the limited expressiveness of language-only abstractions in describing intricate physical interactions. However, despite their potential, video models still generate physics-violating future predictions, often manifesting as hallucinations. In this survey, we provide a review of video models and their applications as embodied world models in robotics, including efficient data generation and policy learning, dynamics and rewards modeling in reinforcement learning, policy evaluation, and visual planning. Further, we highlight important challenges hindering the trustworthy integration of video models, such as poor instruction following, hallucinations like violations of physics, unsafe content generation, in addition to significant data and compute overhead. We present potential future directions to address these open research challenges to motivate research and ultimately facilitate broader applications, especially in safety-critical settings. We provide a curated bibliography at https://github.com/irom-princeton/awesome-robotics-video-world-model-papers .

Table of Contents

cs.CL [Back]

[1] Multimodal Ambivalence and Hesitancy Recognition with Bidirectional Audio–Text Cross-Attention cs.CL | cs.SD | eess.ASPDF

[2] Mixture of Phonetic Experts Based Low-Rank Adaptation of Conformer Models for Accented English Speech Recognition cs.CL | cs.SD | eess.ASPDF

[3] AtomSD: Procedural Atom-Guided Self-Distillation for LLM Agents cs.CLPDF

[4] Think Before You Transcribe: Context-Steered Reasoning for Hotword-Aware Speech Recognition cs.CLPDF

[5] TRACE: Training-aware Robustness and Challenge Evaluation for Text-Vision Embedding Models cs.CLPDF

[6] Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models cs.CLPDF

[7] Cross-Lingual Reusability of LLM Pipelines: Financial Extraction, Multilingual Reasoning, and Semantic Screening cs.CL | cs.AIPDF

[8] Discrete Neural Interlingua for Ontology-Agnostic EHR Modeling cs.CL | cs.AI | cs.LGPDF

[9] ICLHerd: Herding-Based Data Selection for LLMs with In-Context Learning as a Proxy cs.CL | cs.AI | cs.LGPDF

[10] GRID: Modeling Health Influencer Discourse as Argument Networks for Credibility Assessment cs.CLPDF

[11] On the Fragility of Tasks under Composition: Implicit Budgeting in Language Models cs.CL | cs.AI | cs.LGPDF

[12] The Culture Within: Towards Mechanistic Understanding of Cultural Reasoning in LLMs cs.CLPDF

[13] MMedAgent-Plus: Scaling Multimodal Medical Agents across Modalities, Tasks and Workflows cs.CL | cs.AIPDF

[14] CEFR-oriented Russian Text Simplification Using Reinforcement Learning cs.CLPDF

[15] Diagnostic Analysis for Large Language Model Reasoning cs.CLPDF

[16] Auditing Safety Preference Supervision with Recorded Derivations cs.CL | cs.AI | cs.LG | cs.SCPDF

[17] RealControlBench: A Benchmark for Interpretability-Informed Fine-Grained Control of LLMs and Agents cs.CLPDF

[18] Explore More, Validate Less: Efficient Reflective Prompt Optimization cs.CLPDF

[19] SHAM-Bench: A Span-level Hallucination Benchmark Across Multiple Tasks cs.CLPDF

[20] DStill: Trajectory Consistency Distillation for Accelerated One-Step Drafting in Block Diffusion Speculative Decoding cs.CL | cs.LGPDF

[21] Judging the Justification: Decision Certificate Supervision for Generative Reward Models cs.CLPDF

[22] Exploring Recurrent-Depth Language Models for Multitask Clinical Text Processing cs.CLPDF

[23] AudiPsy: Evidence-Grounded Multimodal Reasoning over Spoken Counseling Conversations for Depression Assessment cs.CL | cs.AIPDF

[24] TeCoP: Accelerating Diffusion Large Language Model Decoding via Tentative Context Pipelining cs.CLPDF

[25] WORTH Benchmark: Evidence Discovery under Not-Fully-Cooperative Information – A Two-Episode Pilot cs.CL | cs.AIPDF

[26] PAR: Progress-Aligned Recurrence for Length Generalization in State Tracking cs.CLPDF

[27] Memory as Code: Declarative Retrieval over Codified Long-Term Memory cs.CLPDF

[28] Beyond Calibration: Temporal LLM Confidence Assessment Across Languages and Local Settings cs.CL | cs.AIPDF

[29] SciDiagBench: A Type-Specific Benchmark for Human-Aligned Evaluation of Scientific Diagrams cs.CLPDF

[30] Testing Associative Creativity in Humans and Multimodal LLMs with Difficult-to-Name Visual Stimuli cs.CL | cs.CVPDF

[31] Adaptive Stopping of Streamed Reasoning for Language Model Agents cs.CLPDF

[32] On-Policy Transition Distillation cs.CL | cs.AI | cs.LGPDF

[33] Africa-Papers: A 10-Billion-Token Multi-Domain Academic Corpus for African Foundation Language Models cs.CL | cs.AIPDF

[34] Temporal Evidence-Parameter Co-Alignment for LLM Reasoning over Temporal Knowledge Graphs cs.CL | cs.AIPDF

[35] Forty Questions: Identifying a Language Model from One-Word Answers cs.CLPDF

[36] Adaptive Replay Refinement: Allocating Test-Time Compute Between Revision and Resampling cs.CL | cs.LGPDF

[37] Reward Misspecification Degrades Chain-of-Thought Monitorability cs.CLPDF

[38] Beyond a Single Sentiment Score: Topical and Affective Dimensions of Emoji Meaning on Twitter cs.CL | cs.AI | cs.SIPDF

[39] Asymmetric Looped Transformers: Fixed Global Representations for an Iterative Decoder cs.CLPDF

[40] Large Flow Language Models cs.CL | cs.AIPDF

[41] Benchmarking Arabic Dialects for Math Problems cs.CL | cs.AIPDF

[42] NarraSpace: Multimodal Scene-Grounded Evidence for Picture-Description Dementia Classification cs.CLPDF

cs.CV [Back]

[43] Beckmann World Models: Direct Terminal-Map Learning for One-Step Action-Conditioned Prediction cs.CVPDF

[44] Uncertainty Gates the Gradient: Adaptive Updates for Generalized Few-Shot 3D Segmentation cs.CV | cs.AIPDF

[45] Memory Internalization via Test-Time Training for Long-Video Understanding cs.CVPDF

[46] CodecMotion-OAD: Efficient Online Action Detection with Compressed-Domain Motion cs.CVPDF

[47] SuperClip Pyramid for Video Temporal Grounding cs.CVPDF

[48] REST: Reliability-Guided Spatial Transcriptomics Supervision for Gene Expression Prediction from Histopathological HE-Stained Images cs.CVPDF

[49] Long-wave Infrared Polarimetric Remote Sensing Image Fusion for Vehicle Detection cs.CVPDF

[50] Robustness of Internal Signals for Hallucination Detection in Vision-Language Models cs.CV | cs.AIPDF

[51] VitronEdit: Universal Visual Editing across Images, Videos, and 3D Scenes cs.CVPDF

[52] BUMP: Body-driven Unified Multi-object Physics for HOI Synthesis cs.CVPDF

[53] SciFigBench: A Benchmark for Scientific Method Figure Understanding cs.CV | cs.CLPDF

[54] LVMem: Image-Augmented Memory for Long-Horizon Question Answering cs.CVPDF

[55] PRIMFLOW: Learning Trajectory Primitives for Few-Step Distillation cs.CVPDF

[56] CARLAR Influence: A Structured Hallucination Risk in Multimodal Cheque Extraction and an Exploratory Compressed-Image Countermeasure cs.CV | cs.AIPDF

[57] Language Guidance for Supervised Vision Training: An Empirical Study of Generalization cs.CV | cs.AIPDF

[58] Generalizing Multimodal Foundational Models in Context-Driven Class Incremental Learning cs.CV | cs.AIPDF

[59] Steering Vision-Language Models for Visual-Contextual Privacy in Location Disclosure cs.CV | cs.AIPDF

[60] Look Before You Reason: Implicit Visual Thinking for Efficient Multimodal Reasoning cs.CVPDF

[61] On the Limits of Scale: Inverse Scaling in Vision-Language Models cs.CV | cs.AIPDF

[62] Test-time Adaptation for Point Cloud Denoising under Unseen Noise cs.CV | cs.GRPDF

[63] FocusOVD: Geometric and Contextual Feature Refinement for Open-Vocabulary Small-Object Detection cs.CVPDF

[64] Cross-Visibility-Gap Identity Persistence for 4D Scene Graphs cs.CV | cs.AIPDF

[65] Progressive Subset Selection and Cascaded Consistency for Unsupervised Vision-Language Model Adaptation cs.CV | cs.AIPDF

[66] HealBench: A Fine-Grained Benchmark for Evaluating Psychological Comfort in Text-to-Image Generation cs.CV | cs.AIPDF

[67] Multiscale Temporal-Spectral-Spatial EEG Learning With Modality-Specific and Modality-Invariant Representations for Emotion Recognition cs.CVPDF

[68] Less is More: Concise Retrieval and Critic-based Re-ranking for Composed Image Retrieval cs.CV | cs.AIPDF

[69] SynCalib: Breaking Dataset Shortcuts in LiDAR-Camera Calibration via Extrinsic-Controllable Synthesis cs.CV | cs.ROPDF

[70] AnomalyJev: Towards Evaluating Image Anomaly Explanations via Claim-Level Verification cs.CV | cs.AI | cs.CLPDF

[71] Text-Anchored Modality Experts with Uncertainty-Guided Routing for Multimodal Sentiment Analysis cs.CVPDF

[72] Real In, Real Out: What If We Only Use Real Data for Scene Text Editing? cs.CVPDF

[73] Causal Spatiotemporal State Evolution for Monocular 4D Reconstruction cs.CVPDF

[74] HiQGS: Hierarchical Spatiotemporal Querying for Feed-Forward Gaussian Reconstruction cs.CVPDF

[75] Provisioning Robust and Efficient LiDAR Perception for Autonomous Driving cs.CVPDF

[76] NeoWorld-3: From Pixels to Code-Defined Physical Worlds cs.CVPDF

[77] A Principled Optimal Transport Framework for Frame Selection in Long Video Understanding cs.CVPDF