cs.CL [Total: 32]
cs.CV [Total: 67]
cs.LG [Total: 6]
cs.GR [Total: 1]
cs.CR [Total: 3]
cs.SI [Total: 1]
cs.AI [Total: 4]
cs.IR [Total: 1]
cs.RO [Total: 9]

cs.CL [Back]

[1] Mitigating Cross-Lingual Cultural Inconsistencies in LLMs via Consensus-Driven Preference Optimisation cs.CLPDF

Lucas Resck, Isabelle Augenstein, Anna Korhonen

TL;DR: 本文针对多语言大语言模型（MLLMs）中存在的跨语言文化不一致性问题，即模型输出会因提示语言不同而覆盖预设的系统角色（如英国角色在英语提示下输出莎士比亚，在西班牙语提示下输出塞万提斯），提出了一种新的度量标准Singleton Fleiss’s κ_S和一个名为C-3PO的共识驱动偏好优化对齐框架来缓解该问题。

Details

Motivation: 解决多语言大语言模型在提示语言改变时，其输出会不一致地覆盖用户明确设定的身份或角色（系统角色）这一关键失败问题，尤其是在文化相关的日常知识查询中。

Result: 提出的C-3PO框架在缓解跨语言文化不一致性上，相比未对齐模型，在κ_S指标上实现了高达0.10分的绝对提升，优于强提示和表示引导基线；实证评估表明该不一致性对印尼语、波斯语等低资源语言影响更大。

Insight: 创新点包括：1) 引入对幻觉具有数学鲁棒性的新度量标准κ_S来量化跨语言文化不一致性；2) 提出共识驱动的对齐框架C-3PO进行缓解；3) 通过逐层可解释性分析揭示了其底层机制：MLLMs在前向传播表示稳定过程中，会隐式地将输出个性化偏向提示语言的刻板文化。

Abstract: Despite their impressive capabilities, multilingual large language models (MLLMs) frequently exhibit inconsistent behaviour when the prompt’s language changes. While such adaptation is generally desirable, it becomes a critical failure when a user’s identity is explicitly defined. For instance, given a fixed British persona and an ambiguous everyday knowledge query about literature, the prompt’s language frequently overwrites the system persona – yielding Shakespeare in English but Cervantes in Spanish. To robustly quantify this Cross-lingual Cultural Inconsistency, we introduce Singleton Fleiss’s $κ_S$, a metric mathematically resilient to hallucinations. For mitigation, we propose Cross-lingual Cultural Consistent Preference Optimisation (C-3PO), a consensus-driven alignment framework. C-3PO achieves up to a 0.10-point absolute increase in $κ_S$ over unaligned models, outperforming strong prompting and representation steering baselines. Empirical evaluations show this inconsistency disproportionately affects lower-resource languages like Indonesian and Persian. A layer-wise interpretability analysis reveals the underlying mechanism: by early-decoding intermediate layer representations, we find that MLLMs implicitly personalise outputs towards the prompt language’s stereotypical culture as forward-pass representations stabilise.

[2] Bridging the Missing-Modality Gap: Improving Text-Only Calibration of Vision Language Models cs.CL | cs.AI | cs.CVPDF

Mingyeong Kim, Jungwon Choi, Chaeyun Jang, Juho Lee

TL;DR: 该论文针对视觉语言模型在缺失视觉模态（仅文本输入）时出现的准确率下降和置信度校准严重失准问题，提出了一种名为潜在想象模块的轻量级交叉注意力模块。该模块从文本输入预测想象的潜在嵌入，并将其输入到冻结的视觉语言模型骨干中，无需像素级图像生成，从而在多种文本基准、未见任务和缺失图像场景下提升了模型的准确性和校准可靠性。

Details

Motivation: 视觉语言模型通常在训练时结合图像，但在部署时可能仅接收文本输入，这导致模型性能（准确率和校准）大幅下降，且其行为与原始语言骨干模型不同。即使文本描述保留了关键内容，置信度依然不可靠，而通过生成图像添加视觉信号可以部分恢复性能，这表明问题不仅在于语义信息的缺失。

Result: 在多个仅文本基准测试、未见任务和缺失图像场景中，所提出的潜在想象模块提高了视觉语言模型的准确性，并减少了校准误差。

Insight: 论文的核心创新在于提出了一种轻量级的潜在模态补全方法，通过预测想象的潜在视觉嵌入来桥接缺失的视觉模态，避免了计算密集的像素级图像合成，从而实现了更可靠和高效的视觉语言模型推理。这为处理多模态模型中模态缺失问题提供了一个实用且高效的新思路。

Abstract: Vision-language models (VLMs) are often deployed on text-only inputs, although they are trained with images. We find that removing the vision modality causes large drops in accuracy and severe miscalibration, and the model does not behave like its original language backbone under text-only prompting. This failure is not explained only by missing semantic information. Even when text descriptions preserve key content, confidence becomes unreliable, while adding a visual signal through generated images partially restores accuracy and calibration. We propose the Latent Imagination Module (LIM), a lightweight cross-attention module that predicts imagined latent embeddings from textual input and feeds them into a frozen VLM backbone without pixel-level image synthesis. Across text-only benchmarks, unseen tasks, and missing-image scenarios, LIM improves accuracy and reduces calibration error. These results suggest that latent modality completion is a practical approach for reliable VLM inference under missing-modality.

[3] TimelineReasoner: Advancing Timeline Summarization with Large Reasoning Models cs.CL | cs.AIPDF

Liancheng Zhang, Xiaoxi Li, Zhicheng Dou

TL;DR: 本文提出了TimelineReasoner框架，将时间线摘要任务从静态生成转变为主动推理驱动过程。该框架采用两阶段设计：全局认知阶段宏观追踪事件并更新全局事件记忆，细节探索阶段识别信息缺口并通过针对性文档检索优化时间线。实验表明，该方法在开放域时间线摘要数据集上显著优于现有基于大语言模型的方法，在封闭域数据集上达到或超越最先进水平。

Details

Motivation: 现有基于大语言模型的时间线摘要方法主要将模型视为被动生成器，未能充分利用主动推理能力。大型推理模型的出现为主动推理事件、迭代获取证据、检测缺失事件和验证时间一致性提供了机会。

Result: 在开放域时间线摘要数据集上，TimelineReasoner在时间线准确性、覆盖率和连贯性方面显著优于现有基于大语言模型的方法。在封闭域数据集上，该方法达到或超越了最先进方法的性能。

Insight: 创新点在于将时间线摘要重构为主动推理过程，通过两阶段框架（全局认知与细节探索）结合专门机制（事件抓取器、时间线更新器和监督器）实现迭代优化。这展示了基于大型推理模型的推理框架在时间线摘要中的潜力，推动了该领域从生成到推理的范式转变。

Abstract: The proliferation of online news poses a challenge to extracting structured timelines from unstructured content. While recent studies have shown that Large Language Models (LLMs) can assist Timeline Summarization (TLS), these approaches primarily treat models as passive generators. The emergence of Large Reasoning Models (LRMs) presents an opportunity to reason over events actively, enabling iterative evidence acquisition, the detection of missing events, and the validation of temporal consistency. To systematically leverage the reasoning capabilities of LRMs, we propose TimelineReasoner, a novel framework that shifts TLS from static generation to an active, reasoning-driven process. Unlike prior work, TimelineReasoner adopts a two-stage framework: Global Cognition, which tracks events at a macroscopic level and continuously updates a global event memory, and Detail Exploration, which identifies informational gaps and refines the timeline via targeted document retrieval. To support this, TimelineReasoner incorporates several specialized mechanisms, including an Event Scraper for retrieving temporal event descriptions, a Timeline Updater for refining the timeline, and a Supervisor for detecting gaps in the timeline and guiding retrieval. Experimental results on open-domain TLS datasets demonstrate that TimelineReasoner significantly outperforms existing LLM-based TLS methods in terms of timeline accuracy, coverage, and coherence. On closed-domain TLS datasets, our method performs on par with or exceeds state-of-the-art approaches. This work not only pushes the boundaries of TLS but also highlights the broader potential of LRM-based reasoning frameworks for timeline summarization.

[4] Correct Answers from Sound Reasoning: Verifiable Process Supervision for Language Models cs.CL | cs.AIPDF

Kyuyoung Kim, Kevin Wang, Yunfei Xie, Peiyang Xu, Peiyao Sheng

TL;DR: 本文提出了一种可验证过程监督（VPS）的后训练框架，旨在联合优化语言模型的预测准确性和推理质量。该方法首先通过监督微调引导模型生成结构化推理格式，从而语法提取中间主张，并根据真实信号评估形成过程级奖励。通过引入自适应奖励加权来优先处理剩余误差最大的推理子任务，VPS在象棋等可验证领域显著提升了推理的可靠性和内部一致性，同时保持了预测准确性。

Details

Motivation: 当前训练语言模型同时产生正确答案和可靠推理仍是一个开放挑战。仅优化最终结果的强化学习可能导致任务准确率提升而推理质量下降，出现内部不一致等问题。

Result: 在象棋（一个可确定性验证推理步骤的受控测试平台）上评估，仅优化准确性的强化学习虽然提高了走棋准确率，但严重降低了推理质量（胜率误差增加高达112%，内部一致性降低高达69%）。相比之下，VPS在保持准确性的同时显著改善了推理质量（胜率误差降低高达30%，内部一致性恢复到接近饱和水平）。在相同准确率下，评判评估也更偏好过程监督模型。

Insight: 创新点在于提出了可验证过程监督（VPS）框架，通过结构化推理格式提取和评估中间主张来形成过程级奖励，并引入自适应奖励加权以创建隐式课程，有效引导模型进行可靠的多步推理而非依赖任务特定的捷径。

Abstract: Training language models to produce both correct answers and sound reasoning remains an open challenge. Reinforcement learning with verifiable rewards typically optimizes only final outcomes, which can lead to a failure mode where task accuracy improves while reasoning becomes less accurate, less complete, or even internally inconsistent. We propose verifiable process supervision (VPS), a post-training framework for verifiable domains that jointly optimizes prediction accuracy and reasoning quality. We first apply supervised fine-tuning to induce a structured reasoning format, enabling syntactic extraction of intermediate claims that are evaluated against ground-truth signals to form process-level rewards. To address the heterogeneous difficulty of reasoning subtasks, we introduce adaptive reward weighting that prioritizes components with the largest remaining errors, creating an implicit curriculum. We evaluate VPS on chess, a controlled testbed where reasoning steps can be deterministically verified against engine signals. While accuracy-only RL improves move accuracy, it sharply degrades reasoning quality, increasing win-rate error by up to 112% and reducing internal consistency by up to 69%. In contrast, VPS preserves accuracy while significantly improving reasoning quality, reducing win-rate error by up to 30% and restoring consistency to near saturation. At matched accuracy, judge evaluation also prefers the process-supervised models. A reasoning-space analysis further shows that, without a structured prior, accuracy-only RL converges to budget-dependent shortcuts rather than sound multi-step reasoning. These results show that VPS enables language models to reason both accurately and reliably in verifiable domains.

[5] BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibration cs.CL | cs.AIPDF

Yancheng Ling, Zhenlin Qin, Leizhen Wang, Zhenliang Ma

TL;DR: BoostTaxo是一个用于零样本分类法归纳的增强式大语言模型框架，通过检索增强的定义细化、混合父候选选择、候选评分和结构感知分数校准，以从粗到细的方式执行父节点识别，从而构建语义层次结构。

Details

Motivation: 现有分类法归纳方法在泛化性、结构可靠性和效率方面存在局限，影响了其在零样本和大规模场景下的性能，BoostTaxo旨在克服这些限制。

Result: 在WordNet、DBLP和SemEval-Sci三个公共基准数据集上评估，BoostTaxo在零样本分类法归纳中实现了优于或可比于最先进方法的性能。

Insight: 创新点包括采用增强式代理推理框架、混合父候选选择策略（结合轻量级和大规模LLM的分工）以及结构感知分数校准，以提高分类法构建的准确性和可靠性。

Abstract: Taxonomy induction is crucial for organizing concepts into explicit and interpretable semantic hierarchies. While existing methods have achieved promising results, their generalization, structural reliability, and efficiency remain limited, hindering their performance in zero-shot and large-scale scenarios. To overcome these limitations, we introduce BoostTaxo, a boosting-style LLM framework for zero-shot taxonomy induction. It takes a set of domain terms as inputs and performs parent identification in a coarse-to-fine manner, employing retrieval-augmented definition refinement, hybrid parent candidate selection, candidate rating, and structure-aware score calibration to improve taxonomy construction. Specifically, a lightweight LLM is used to efficiently filter candidate parents, while a large-scale LLM is employed to rank and score candidate parents for fine-grained parent selection. Structural features are further incorporated to calibrate candidate edge weights and enhance the reliability of the induced taxonomy. The unified BoostTaxo is evaluated on three public benchmark datasets, namely WordNet, DBLP, and SemEval-Sci, and achieves superior or comparable performance to state-of-the-art methods in zero-shot taxonomy induction. The ablation study validates the contribution of the hybrid parent candidate selection and the structure-aware score calibration to the overall performance. Further analysis investigates the impact of candidate selection size on taxonomy quality and presents representative case and failure studies, providing deeper insights into the effectiveness and limitations of the proposed framework.

[6] Training LLMs with Reinforcement Learning for Intent-Aware Personalized Question Answering cs.CL | cs.AIPDF

Maryam Amirizaniani, Benjamin Charles Germain Lee, Jevin West, Nicholas Weber

TL;DR: 本文提出了一种名为IAP的强化学习框架，用于训练语言模型在单轮问答中推断用户的隐含意图，并通过基于标签的思维链机制生成个性化、意图驱动的回答。

Details

Motivation: 现有意图感知的个性化问答方法依赖多轮对话上下文或丰富的用户画像，且未在推理过程中显式建模用户意图，限制了其在单轮场景下的有效性。

Result: 在LaMP-QA基准测试的六个模型上，IAP均优于所有基线方法，平均宏分数比最强竞争对手提升了约7.5%，达到了SOTA水平。

Insight: 创新点在于通过强化学习框架，将隐含用户意图的推断和整合直接纳入模型的训练目标，并使用基于标签的思维链模式来显式化意图并指导个性化回答的生成。

Abstract: Effective personalized question answering (PQA) in language models requires grounding responses in the user’s underlying intent, where intent refers to the implicit ``why’’ behind a query beyond its explicit wording. However, existing approaches to intent-aware personalization rely on multi-turn conversational context or rich user profiles, and do not explicitly model user intent during the reasoning process. This limits their effectiveness in single-turn settings, where the user’s latent goal must be inferred from minimal input and integrated into the thinking and reasoning process. To bridge this gap, we propose IAP (Intent-Aware Personalization), a reinforcement learning framework that trains models to infer implicit user intent directly from a single-turn question and incorporate it into thinking steps through a tag-based schema for generating personalized, intent-grounded answers. By optimizing intent-aware answer trajectories under a personalized reward function, IAP reinforces generation paths that make implicit user intent explicit and produce responses that better align with the user’s underlying goal. Through experiments on the LaMP-QA benchmark across six models, IAP consistently outperforms all baselines, achieving an average macro-score gain of around 7.5% over the strongest competitor, demonstrating that modeling implicit user intent within the training objective is a promising direction for PQA.

[7] Simulating Students or Sycophantic Problem Solving? On Misconception Faithfulness of LLM Simulators cs.CL | cs.AI | cs.CY | cs.LGPDF

Heejin Do, Shashank Sonkar, Mrinmaya Sachan

TL;DR: 本文研究了大型语言模型作为模拟学生在AI导师训练中的可靠性，发现现有模型在交互中无法保持连贯的错误概念信念，而是倾向于根据任何纠正信号重新解决问题，表现出一种’谄媚’的失败模式。作者提出了一个评估框架和选择性翻转分数来量化这一问题，并通过微调方法展示了改进的可能性。

Details

Motivation: 动机在于评估LLM作为模拟学生时是否能在互动中保持基于错误概念的连贯信念状态，并在反馈针对底层错误概念时才更新答案，而不是仅通过输出相似性来评估模拟效果。

Result: 在七个LLM模型上的实验表明，选择性翻转分数接近零，模型无论反馈相关性如何都以高概率修正答案；通过监督微调可将SFS提升高达+0.56，而基于SFS奖励的强化学习比偏好优化提供更一致的改进。

Insight: 创新点在于提出了’错误概念忠实性’这一交互式评估属性，设计了包含对比反馈的评估框架和选择性翻转分数指标，并揭示了LLM模拟学生时存在的’谄媚问题解决’模式；客观来看，该研究推动了学生建模从静态输出匹配转向动态信念感知的评估范式。

Abstract: Large language models (LLMs) can fluently generate student-like responses, making them attractive as simulated students for training and evaluating AI tutors and human educators. Yet such simulators are typically evaluated by output similarity to real students, not by whether they behave like students with coherent misconceptions during interaction. We introduce a controlled framework for evaluating misconception faithfulness, whether a simulator maintains a misconception-driven belief state and updates selectively when feedback addresses the underlying misconception. Central to our framework is a misconception-contrastive feedback protocol that compares targeted feedback against two controls: misaligned feedback (targeting a different but plausible misconception) and generic feedback (only identifying answer is wrong). We propose Selective Flip Score (SFS), which quantifies how much more often a simulator flips its answer under targeted feedback than under contrastive controls. Across seven LLMs (4B-120B), multiple datasets, and prompting strategies, simulators exhibit near-zero SFS, correcting their answers at similarly high rates regardless of feedback relevance. Further analyses reveal a sycophantic failure mode: models behave less like students with misconceptions but more like problem-solvers who treat any corrective signal as a cue to abandon the simulated belief and re-solve from internal knowledge. To address this, we develop a post-training pipeline spanning supervised fine-tuning (SFT), preference optimization, and reinforcement learning (RL) with an SFS-aligned reward; SFT yields notable gains up to +0.56, and SFS-aligned RL provides more consistent improvements than preference optimization. Our results establish misconception faithfulness as a challenging yet trainable property, motivating a shift from static output matching toward interactive, belief-aware student modeling.

[8] REALISTA: Realistic Latent Adversarial Attacks that Elicit LLM Hallucinations cs.CL | cs.AI | cs.CR | cs.LGPDF

Buyun Liang, Jinqi Luo, Liangzu Peng, Kwan Ho Ryan Chan, Darshan Thaker

TL;DR: 本文提出了一种名为REALISTA的现实潜在对抗攻击框架，旨在生成语义连贯且与原始用户提示等价的对抗性提示，以有效引发大型语言模型（LLM）的幻觉。该方法通过构建输入相关的有效编辑方向字典，并在潜在空间中优化这些方向的连续组合，从而结合了连续攻击的优化灵活性和基于离散重述攻击的语义真实性。

Details

Motivation: 大型语言模型（LLM）虽在许多任务上表现出色，但仍易受幻觉影响。现有方法存在局限：基于离散提示的攻击虽能保持语义等价性和连贯性，但搜索空间有限；而连续潜在空间攻击探索空间更丰富，但解码后的提示往往不再是有效的重述。因此，需要一种能兼顾优化灵活性和语义真实性的攻击方法。

Result: 实验表明，REALISTA在开源LLMs上实现了与最先进（SOTA）的现实攻击相当或更优的性能。关键的是，在自由形式响应设置下，它成功攻击了大型推理模型，而先前的现实攻击在此设置下均告失败。

Insight: 论文的创新点在于将幻觉引发问题形式化为约束优化问题，并提出了一个结合连续潜在空间优化与离散语义约束的混合框架。其核心洞察是构建输入相关的有效编辑方向字典，确保优化过程始终在语义等价且连贯的重述空间内进行，从而在保持攻击有效性的同时，保证了生成提示的‘现实性’（即对人类而言的自然性和合理性）。

Abstract: Large language models (LLMs) achieve strong performance across many tasks but remain vulnerable to hallucinations, motivating the need for realistic adversarial prompts that elicit such failures. We formulate hallucination elicitation as a constrained optimization problem, where the goal is to find semantically coherent adversarial prompts that are equivalent to benign user prompts. Existing methods remain limited: discrete prompt-based attacks preserve semantic equivalence and coherence but search only over a limited set of prompt variations, while continuous latent-space attacks explore a richer space but often decode into prompts that are no longer valid rephrasings. To address these limitations, we propose REALISTA, a realistic latent-space attack framework. REALISTA constructs an input-dependent dictionary of valid editing directions, each corresponding to a semantically equivalent and coherent rephrasing, and optimizes continuous combinations of these directions in latent space. This design combines the optimization flexibility of continuous attacks with the semantic realism of discrete rephrasing-based attacks. Experiments demonstrate that REALISTA achieves superior or comparable performance to state-of-the-art realistic attacks on open-source LLMs and, crucially, succeeds in attacking large reasoning models under free-form response settings, where prior realistic attacks fail. Code is available at https://github.com/Buyun-Liang/REALISTA.

[9] CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence cs.CL | cs.CVPDF

Dongsheng Ma, Jiayu Li, Zhengren Wang, Yijie Wang, Jiahao Kong

TL;DR: 论文提出了CiteVQA基准测试，用于评估多模态大语言模型在文档问答中的证据归因能力，要求模型在给出答案的同时提供元素级的边界框引用，以解决现有评估只关注答案正确性而忽略证据支持的问题。

Details

Motivation: 当前文档问答评估仅关注最终答案的正确性，而忽略了模型是否基于正确的证据段落进行推理，这在法律、金融和医疗等高风险领域存在关键风险，因为每个结论都必须可追溯到具体的来源区域。

Result: 在CiteVQA基准上评估了20个MLLM，发现普遍存在归因幻觉问题，即模型经常给出正确答案但引用错误区域。最强的系统（Gemini-3.1-Pro-Preview）的严格归因准确率（SAA）仅为76.0，最强的开源MLLM仅为22.5。

Insight: 创新点在于引入了要求联合评估答案和证据引用的基准测试，并提出了严格归因准确率（SAA）这一新评估指标，揭示了仅评估答案会掩盖的可靠性差距，为构建可信的文档智能系统提供了关键工具。

Abstract: Multimodal Large Language Models (MLLMs) have significantly advanced document understanding, yet current Doc-VQA evaluations score only the final answer and leave the supporting evidence unchecked. This answer-only approach masks a critical failure mode: a model can land on the correct answer while grounding it in the wrong passage – a critical risk in high-stakes domains like law, finance, and medicine, where every conclusion must be traceable to a specific source region. To address this, we introduce CiteVQA, a benchmark that requires models to return element-level bounding-box citations alongside each answer, evaluating both jointly. CiteVQA comprises 1,897 questions across 711 PDFs spanning seven domains and two languages, averaging 40.6 pages per document. To ensure fidelity and scalability, the ground-truth citations are generated by an automated pipeline-which identifies crucial evidence via masking ablation-and are subsequently validated through expert review. At the core of our evaluation is Strict Attributed Accuracy (SAA), which credits a prediction only when the answer and the cited region are both correct. Auditing 20 MLLMs reveals a pervasive Attribution Hallucination: models frequently produce the right answer while citing the wrong region. The strongest system (Gemini-3.1-Pro-Preview) achieves an SAA of only 76.0, and the strongest open-source MLLM reaches just 22.5. Ultimately, towards trustworthy document intelligence, CiteVQA exposes a reliability gap that answer-only evaluations overlook, providing the instrumentation needed to close it. Our repository is available at https://github.com/opendatalab/CiteVQA.

[10] CommonWhy: A Dataset for Evaluating Entity-Based Causal Commonsense Reasoning in Large Language Models cs.CLPDF

Armin Toroghi, Faeze Moradi Kalarde, Scott Sanner

TL;DR: 本文介绍了CommonWhy数据集，包含15,000个’为什么’问题，旨在评估大型语言模型在基于实体的因果常识推理能力，并作为知识图谱问答基准，实验发现当前先进模型在事实幻觉和因果推理方面存在显著不足。

Details

Motivation: 现有评估大型语言模型基于实体的常识推理的数据集多集中于判断题或多选题，缺乏对模型在因果溯因推理和解释生成能力的直接评估，因此需要构建专门的数据集来填补这一空白。

Result: 在CommonWhy数据集上对先进大型语言模型和基于LLM的知识图谱问答方法进行实验，结果显示它们在事实幻觉和因果推理方面表现不佳，突显了现有方法的局限性。

Insight: 创新点在于构建了专注于因果常识推理的问答数据集，并将知识图谱问答从简单的事实检索扩展到复杂的因果推理任务，为评估模型深层推理能力提供了新范式。

Abstract: To effectively interact with the real world, Large Language Models (LLMs) require entity-based commonsense reasoning, a challenging task that necessitates integrating factual knowledge about specific entities with commonsense inference. Existing datasets for evaluating LLM entity-based commonsense reasoning have largely focused on True/False or multiple-choice questions, leaving the explicit assessment of the model’s ability in abductive reasoning about causes and effects and generating explanations largely unexamined. In this work, we introduce CommonWhy, a dataset of 15,000 why questions designed to evaluate entity-based commonsense reasoning about causal relationships in LLMs. CommonWhy also serves as a Knowledge Graph Question Answering (KGQA) benchmark, as all supporting knowledge required to answer its queries is available in the Wikidata knowledge graph. Unlike existing KGQA datasets, which primarily test fact retrieval, CommonWhy targets causal commonsense reasoning, establishing a new paradigm for KGQA evaluation. Experiments with state-of-the-art LLMs and LLM-based KGQA methods reveal their significant shortcomings, including frequent factual hallucinations and failures in causal reasoning.

[11] DiM\textsuperscript{3}: Bridging Multilingual and Multimodal Models via Direction- and Magnitude-Aware Merging cs.CLPDF

Zijing Wang, Mingyang Wang, Ercong Nie, Yongkang Liu, Shi Feng

TL;DR: DiM3提出了一种无需训练的方法，通过方向与幅度感知的合并技术，将多语言能力注入现有的多模态模型中，避免了昂贵的多语言多模态数据构建和端到端重新训练。

Details

Motivation: 为了解决扩展现有多模态模型至多语言场景时，需要昂贵数据构建和重复训练的问题，研究一种无需训练的替代方案。

Result: 在基于LLaVA和Qwen的骨干网络上，覆盖57种语言的文本和视觉语言基准测试中，DiM3一致优于现有合并基线，显著提升了原始多模态模型的多语言性能，并与专用的多语言多模态微调方法保持竞争力，同时基本保留了通用多模态能力。

Insight: 创新点在于提出方向与幅度感知的合并方法，选择性地组合多语言和多模态更新，同时保留原始视觉编码器和多模态投影器；客观分析表明，该方法主要重塑中间层语义表示，在文本和多模态输入下加强跨语言对齐，同时保留高层任务敏感结构。

Abstract: Towards more general and human-like intelligence, large language models should seamlessly integrate both multilingual and multimodal capabilities; however, extending an existing multimodal model to many languages typically requires expensive multilingual multimodal data construction and repeated end-to-end retraining. We study a training-free alternative: injecting multilingual capability into an existing multimodal model by composing residual updates in the shared language model backbone. The key challenge is that multilingual and multimodal updates are heterogeneous, reflecting different functional roles in the shared model. To address this, we propose Direction- and Magnitude-aware Multilingual Multimodal merging (DiM3), which selectively composes the two updates at each parameter dimension while preserving the original vision encoder and multimodal projector. Experiments on multilingual benchmarks in both text-only and vision-language settings, covering 57 languages across LLaVA- and Qwen-based backbones, show that DiM3 consistently outperforms existing merging baselines, substantially improves multilingual performance over the original multimodal model, and remains competitive with dedicated multilingual multimodal fine-tuning while largely retaining general multimodal ability. We further show that DiM3 can be directly applied to already trained multilingual multimodal models and still yield additional gains. Further interpretability analysis shows that DiM3 primarily reshapes intermediate-layer semantic representations, strengthening cross-lingual alignment under both text-only and multimodal inputs while preserving higher-layer task-sensitive structure. Our repository is on https://github.com/wzj1718/DiM3.

[12] Leveraging Multimodal Self-Consistency Reasoning in Coding Motivational Interviewing for Alcohol Use Reduction cs.CLPDF

Guangzeng Han, James G. Murphy, Benjamin O. Ladd, Xiaolei Huang, Brian Borsari

TL;DR: 本研究提出了一种基于音频-语言模型（ALMs）的自动动机性访谈（MI）编码方法，通过整合多模态行为信号（如言语和声学线索）并利用自一致性推理（从多个推理轨迹中通过多数投票得出最终预测）来提高编码的鲁棒性。

Details

Motivation: 动机性访谈（MI）会话的人工编码耗时耗力，需要专业训练。本研究旨在利用先进的音频-语言模型（ALMs）来自动化这一过程，通过分析原始音频和多模态线索来更可靠地理解客户行为。

Result: 在五个去识别化MI录音会话上的实验表明，所提出的多模态自一致性方法在准确率（52.56%）、精确率（54.03%）、召回率（47.45%）和宏平均F1分数（46.40%）上均超过了基线方法。系统消融实验证实了各模块的有效性。

Insight: 创新点在于将多模态分析（言语与声学线索）与自一致性推理（通过多种提示生成多个推理轨迹并进行多数投票）相结合，用于自动MI编码。这为利用大语言模型处理复杂、依赖上下文和多模态线索的临床对话分析提供了可借鉴的思路。

Abstract: BACKGROUND: Coding Motivational Interviewing (MI) sessions is essential for understanding client behaviors and predicting outcomes, but it requires substantial time and labor from trained MI professionals. Recent advances in audio-language models (ALMs) offer new opportunities to automate MI coding by capturing multimodal behavioral signals. OBJECTIVE: This study aims to develop an automatic MI coding approach based on ALMs that analyzes raw audio input and integrates predictions from multiple reasoning trajectories using self-consistency to improve coding robustness. METHODS: We experimented with five recorded sessions from de-identified MI audio tapes. We deployed ALMs with four complementary analytic prompts to support utterance-level reasoning: analytic prompting for verbal cues, prosody-aware prompting for acoustic cues, evidence-scoring prompting for quantitative hypothesis testing, and comparative prompting for contrastive reasoning. Three stochastic samples were drawn for each prompt, generating 12 independent reasoning trajectories per utterance. Final predictions were determined by majority voting across all trajectories. RESULTS: Performance was evaluated using accuracy, precision, recall, and macro-F1 scores. The proposed multimodal self-consistency approach achieved 52.56% accuracy, 54.03% precision, 47.45% recall, and a macro-F1 score of 46.40%, exceeding baseline methods. Systematic ablation experiments that removed individual modules consistently degraded performance on the primary metrics. CONCLUSIONS: Multimodal self-consistency outperforms single-pass baseline prompting approaches for MI coding. These findings suggest that incorporating both what clients say and how they say it can support more reliable automatic MI coding.

[13] Context Training with Active Information Seeking cs.CL | cs.AIPDF

Zeyu Huang, Adhiguna Kuncoro, Qixuan Feng, Jiajun Shen, Lucio Dery

TL;DR: 本文提出了一种结合主动信息搜索的上下文训练方法，通过为大型语言模型配备维基百科搜索和浏览器工具，使其能够在无需更新模型权重的情况下，通过优化上下文来适应下游任务。研究发现，简单的工具集成会降低性能，但结合基于搜索的训练流程（维护和修剪多个候选上下文）后，该方法在多个领域实现了显著提升。

Details

Motivation: 现有大型语言模型在部署后难以适应需要新信息或小众领域知识的任务，且现有上下文优化方法多为闭环，依赖模型固有知识，缺乏主动信息获取能力。

Result: 在低资源翻译（Flores+）、健康场景（HealthBench）和推理密集型任务（LiveCodeBench和Humanity’s Last Exam）等多个领域，该方法相比基线实现了持续且显著的性能提升，表现出数据高效性、超参数鲁棒性，并能生成可泛化到不同模型的有效文本上下文。

Insight: 创新点在于将主动信息搜索工具与上下文优化结合，并通过基于搜索的训练流程（多候选上下文维护与修剪）克服了简单集成的性能下降问题，为无需权重更新的任务适应提供了新思路。

Abstract: Most existing large language models (LLMs) are expensive to adapt after deployment, especially when a task requires newly produced information or niche domain knowledge. Recent work has shown that, by manipulating and optimizing their context, LLMs can be tailored to downstream tasks without updating their weights. However, most existing methods remain closed-loop, relying solely on the model’s intrinsic knowledge. In this paper, we equip these context optimizers with Wikipedia search and browser tools for active information seeking. We show that naively adding these tools to a standard sequential context optimization pipeline can actually degrade performance compared to baselines. However, when paired with a search-based training procedure that maintains and prunes multiple candidate contexts, active information seeking delivers consistent and substantial gains. We demonstrate these improvements across diverse domains, including low-resource translation (Flores+), health scenarios (HealthBench), and reasoning-heavy tasks (LiveCodeBench and Humanity’s Last Exam). Furthermore, our method proves to be data-efficient, robust across different hyperparameters, and capable of generating effective textual contexts that generalize well across different models.

[14] The Cost of Perfect English: Pragmatic Flattening and the Erasure of Authorial Voice in L2 Writing Supported by GenAI cs.CL | cs.CYPDF

Ao Liu, Shanhua Zhu

TL;DR: 本研究探讨了生成式AI（GenAI）在辅助二语（L2）写作时，虽然能优化文本的词汇语法准确性，但会导致‘语用扁平化’现象，即系统性地抹去作者独特的文化礼貌策略和立场表达，使其修辞身份同质化为单一的英美范式。

Details

Motivation: 解决GenAI工具在追求语言流利度时，牺牲社会语用多样性、侵蚀二语写作者个人声音和修辞身份的问题。

Result: 基于ICNALE语料库中中国B2水平大学生议论文的分析发现，四大主流大语言模型在零温度设置下修改文本时，均导致互动维度上对话性参与标记的急剧减少，而在认知立场维度上，不同模型架构表现出可变性，有的激进清除认知标记，有的则强化了脱离语境的谨慎表达。

Insight: 创新点在于提出了‘语用扁平化’和‘语义保存悖论中的维度分歧’概念，揭示了GenAI修改文本时在语法准确性和语用多样性之间的权衡；客观来看，研究强调了未来语言教学需超越纠错，培养‘批判性AI素养’，以帮助多语写作者在使用AI增强语言能力的同时，保护其社会语用多样性和修辞自主性。

Abstract: The integration of Generative AI (GenAI) into language learning offers second language (L2) writers powerful tools for text optimization. However, pursuing native-like fluency often sacrifices sociopragmatic diversity. Investigating “pragmatic flattening” - the systematic erasure of culturally preferred politeness and authorial stance - this study conducts a comparative analysis of argumentative essays by Chinese B2-level university students from the ICNALE corpus. The original texts were polished via the APIs of four leading Large Language Models at a zero-temperature setting for reproducibility. Findings reveal a nuanced “dimensional divergence” within the Semantic Preservation Paradox. While models corrected lexicogrammatical errors and retained propositional meaning, sociopragmatic interventions were bifurcated. In the interactive dimension, all models showed a drastic collapse of dialogic engagement markers, turning negotiated discourse into monologic assertions. Conversely, in the epistemic stance dimension, models showed architecture-based variability: some aggressively scrubbed epistemic markers, while others reinforced tentative hedging as decontextualized algorithmic caution. This confirms that while GenAI enhances accuracy, it systematically overwrites L2 writers’ unique rhetorical identities into a homogenized Anglo-American paradigm. We argue that future instruction must move beyond error correction, advocating for Critical AI Literacy to empower multilingual writers to use GenAI for linguistic enhancement while safeguarding sociopragmatic diversity and rhetorical agency.

[15] GateKD: Confidence-Gated Closed-Loop Distillation for Robust Reasoning cs.CLPDF

Kasidit Sermsri, Teerapong Panboonyuen

TL;DR: 本文提出了一种名为GateKD的置信度门控闭环蒸馏框架，旨在将大型语言模型的多步推理能力稳健地迁移到紧凑的学生模型中。该方法通过将教师模型视为动态的守门员而非静态的预言家，引入了三种互补机制：置信度门控的软监督、门控的隐藏状态演化以及可靠性过滤的注意力蒸馏，共同形成一个闭环反馈，以减少幻觉传递并稳定学生推理。

Details

Motivation: 现有推理蒸馏方法（包括基于导师的方法）主要在开环模式下运行，隐含地假设教师模型具有均匀的可靠性，从而传播错误的中间推理。这导致从大型语言模型向小型学生模型蒸馏多步推理能力面临噪声推理链、幻觉监督和静态师生交互的挑战。

Result: 在常识、逻辑和符号推理基准上，使用不同大小的T5和Flan-T5骨干网络进行的广泛实验表明，GateKD始终优于强大的开环蒸馏基线。特别是在逻辑和符号推理方面取得了显著提升，在低资源蒸馏设置下保持稳健，并且当移除任何门控组件时都表现出明显的性能下降。

Insight: 论文宣称的创新点在于提出了一个置信度门控的闭环蒸馏框架，通过动态的教师置信度来调制蒸馏过程。从客观角度看，其核心创新是将闭环反馈和置信度门控机制系统性地引入推理蒸馏，通过软监督、隐藏状态对齐和注意力蒸馏三个组件的协同，有效抑制噪声并提升蒸馏的稳健性和可扩展性。

Abstract: Distilling multi-step reasoning abilities from large language models (LLMs) into compact student models remains challenging due to noisy rationales, hallucinated supervision, and static teacher-student interactions. Existing reasoning distillation methods, including mentor-based approaches, predominantly operate in an open-loop manner, implicitly assuming uniform teacher reliability and consequently propagating erroneous intermediate reasoning. We propose GateKD, a confidence-gated closed-loop distillation framework that enables robust reasoning transfer by treating the teacher as a dynamic gatekeeper rather than a static oracle. GateKD introduces three complementary mechanisms: (i) confidence-gated soft supervision that selectively distills reliable predictive signals, (ii) gated hidden-state evolution that aligns intermediate representations only when teacher confidence is high, and (iii) reliability-filtered attention distillation that preserves stable reasoning structures while suppressing noisy patterns. These components jointly form a closed feedback loop in which teacher confidence continuously modulates the distillation process, reducing hallucination transfer and stabilizing student reasoning. Extensive experiments across commonsense, logical, and symbolic reasoning benchmarks, using T5 and Flan-T5 backbones of varying sizes, demonstrate that GateKD consistently outperforms strong open-loop distillation baselines. Notably, GateKD yields substantial gains in logical and symbolic reasoning, remains robust under low-resource distillation settings, and shows clear performance degradation when any gating component is removed. Our results highlight that confidence-gated closed-loop supervision is critical for building reliable and scalable small reasoning models.

[16] STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimes cs.CLPDF

Chenjun Xu, Zhennan Zhou, Zhan Su, Bill Howe, Lucy Lu Wang

TL;DR: 本文提出了一种名为STOP（结构化策略内剪枝）的算法，用于分析和剪枝长链思维推理轨迹，以解决模型在低数据微调场景下因过度思考而产生的推理冗余问题。该方法通过构建自蒸馏轨迹、节点分割、分类标注和推理树构建，将轨迹映射为结构化接口，并引入最早正确节点（ECN）来保留最短的正确推理前缀，从而在保持准确性的同时显著减少生成令牌数量。

Details

Motivation: 长链思维推理虽能提升多步问题解决性能，但会导致模型过度思考，产生低效推理，增加推理成本和延迟。这一问题在低数据微调场景中尤为突出，因为实际应用无法依赖大规模教师蒸馏或繁重的测试时控制。

Result: 在DeepSeek-R1-Distill-Qwen-7B和DeepSeek-R1-Distill-LLaMA-3-8B模型上，于GSM8K、Math 500和AIME 2024基准测试中，STOP将生成令牌减少了19.4%至42.4%，同时基本保持了准确性。

Insight: 创新点在于提出了一种策略内剪枝方法，通过结构化接口和ECN机制，在低数据场景下有效去除冗余的后解决方案推理，减少分布偏移，并优化推理结构，将计算资源从冗余验证和回溯重新分配到更有益的探索上。

Abstract: Long chain-of-thought (Long CoT) reasoning improves performance on multi-step problems, but it also induces overthinking: models often generate low-yield reasoning that increases inference cost and latency. This inefficiency is especially problematic in low-data fine-tuning regimes, where real applications adapt reasoning models with limited supervision and cannot rely on large-scale teacher distillation or heavy test-time control. To address this, we propose STOP (Structured On-policy Pruning), an on-policy algorithm for analyzing and pruning long-form reasoning traces. STOP constructs self-distilled traces from the model. Then it maps each trace into a structured reasoning interface through node segmentation, taxonomy annotation, and reasoning-tree construction. On top of this interface, we introduce ECN (Earliest Correct Node), which retains the shortest prefix ending at the earliest node that both functions as an answering conclusion and yields the correct final answer, removing redundant post-solution reasoning while preserving semantic continuity. Experiments on DeepSeek-R1-Distill-Qwen-7B and DeepSeek-R1-Distill-LLaMA-3-8B across GSM8K, Math 500, and AIME 2024 show that STOP reduces generated tokens by 19.4-42.4% while largely preserving accuracy in low-data fine-tuning. Beyond efficiency, our analyses show that STOP induces much smaller distributional shift than teacher-guided pruning, improves the structural efficiency of generated reasoning, and reallocates reasoning effort away from redundant verification and backtracking toward more productive exploration.

[17] GeoBuildBench: A Benchmark for Interactive and Executable Geometry Construction from Natural Language cs.CLPDF

Jinwoong Kim, Rui Yang, Huishuai Zhang

TL;DR: 本文提出了GeoBuildBench基准测试，用于评估大语言模型和多模态智能体能否将非正式的自然语言平面几何问题转化为可执行的几何构造任务。该基准包含489个中国教科书风格的几何问题，要求智能体根据文本描述生成领域特定语言（DSL）程序来构建满足几何对象和可验证约束的图形。

Details

Motivation: 现有几何基准主要关注答案正确性或静态图表解释，而本文旨在评估智能体在交互式几何构造任务中的可执行推理能力，即从自然语言问题生成可执行程序以构建几何图形。

Result: 在有限迭代设置下评估了多个最先进的多模态模型，结果显示模型虽有一定成功率，但频繁出现结构幻觉、对象缺失和几何约束不满足等问题，且利用视觉和约束反馈进行自我纠正的能力有限。

Insight: 创新点在于将几何问题视为交互式构造任务，通过DSL程序生成来评估可执行推理；该基准可作为超越文本或视觉合理性的严格测试平台，揭示当前模型在结构化、可验证任务中的局限性。

Abstract: We introduce GeoBuildBench, a benchmark designed to evaluate whether large language models and multimodal agents can ground informal natural-language plane geometry problems into executable geometric constructions. Unlike existing geometry benchmarks that focus on answer correctness or static diagram interpretation, GeoBuildBench treats geometry diagram as an interactive construction task: given a textual problem, an agent must generate a domain-specific language (DSL) program to produce a diagram satisfying explicitly specified geometric objects and verifiable constraints. The benchmark features 489 Chinese textbook-style problems, curated through automated filtering and human validation to ensure text-complete, constructible problem specifications. We evaluate several state-of-the-art multimodal models in a bounded iterative setting and show that, despite reasonable success rates, models frequently exhibit structural hallucinations, missing objects, and failures to satisfy geometric constraints, with limited ability to exploit visual and constraint-based feedback for self-correction. These results highlight geometry construction as a rigorous testbed for grounded, executable reasoning beyond textual or visual plausibility. Our benchmark and code are publicly available.

[18] GAGPO: Generalized Advantage Grouped Policy Optimization cs.CL | cs.LGPDF

Siyuan Zhu, Chao Yu, Rongxin Yang, Zongkai Liu, Jinjun Hu

TL;DR: 本文提出了一种名为GAGPO的无Critic强化学习方法，用于解决多轮环境中稀疏奖励带来的信用分配难题。该方法通过从采样轨迹中构建非参数化的分组价值代理，递归地传播延迟的奖励信号，从而为每个决策步骤提供精确的时序优势估计。

Details

Motivation: 动机在于解决大语言模型智能体在多轮环境中因仅获得稀疏的轨迹级奖励而面临的信用分配挑战，即难以确定哪些中间动作对最终成功或失败负责，且希望避免依赖计算成本高昂的辅助价值模型。

Result: 在ALFWorld和WebShop基准测试上的实验表明，GAGPO超越了其他强化的学习基线方法。进一步分析显示其具有更快的早期学习速度、更高的交互效率和更平滑的优化动态。

Insight: 主要创新点在于提出了一种无Critic的、基于分组价值代理的信用分配框架，通过递归传播结果监督来计算时序优势，并结合组间优势归一化和动作级重要性比率，直接从多轮轨迹中提取稳定、局部化的优化信号。这为多轮智能体强化学习提供了一个简单而有效的解决方案。

Abstract: Reinforcement learning has become a powerful paradigm for post-training large language model agents, yet credit assignment in multi-turn environments remains a challenge. Agents often receive sparse, trajectory-level rewards only at the end of an episode, making it difficult to determine which intermediate actions contributed to success or failure. As a result, propagating delayed outcomes back to individual decision steps without relying on costly auxiliary value models remains an open problem. We propose Generalized Advantage Grouped Policy Optimization (GAGPO), a critic-free reinforcement learning method for precise, step-aligned temporal credit assignment. GAGPO constructs a non-parametric grouped value proxy from sampled rollouts and uses it to compute TD/GAE-style temporal advantages, recursively propagating outcome supervision backward through time. Combined with group-wise advantage normalization and an action-level importance ratio, GAGPO extracts stable, localized optimization signals directly from multi-turn trajectories. Experiments on ALFWorld and WebShop show that GAGPO outperforms strong reinforcement learning baselines. Further analyses demonstrate faster early-stage learning, improved interaction efficiency, and smoother optimization dynamics, suggesting that GAGPO offers a simple yet effective framework for multi-turn agentic reinforcement learning.

[19] A Hybrid Framework for Natural Language Querying of IFC Models with Relational and Graph Representations cs.CLPDF

Rabindra Lamsal, Sisi Zlatanova, Haowen Xu, Yafei Sun, Johnson Xuesong Shen

TL;DR: 本文提出了IfcLLM，一个用于自然语言查询IFC模型的混合框架。该框架将IFC模型转换为两种互补的表示形式：用于结构化元素属性和几何的关系表示，以及用于拓扑关系的图表示。通过迭代重试和精炼的LLM推理整合这两种表示，实现了对基于IFC的BIM模型的高效自然语言交互。

Details

Motivation: 解决建筑信息模型（BIM）中工业基础类（IFC）格式的复杂性，该复杂性限制了非专业用户的可访问性，旨在通过自然语言交互使IFC数据查询更易于使用。

Result: 在三个IFC模型上，使用源自30个场景的查询进行评估，首次尝试准确率达到93.3%-100%，所有失败案例均通过备用LLM恢复。结果表明该方法能有效支持常规BIM分析任务。

Insight: 主要创新点在于将IFC模型转换为关系表示和图表示这两种互补的表示形式，并通过迭代的LLM推理机制进行整合。从客观角度看，这种混合表示方法结合了结构化数据和拓扑关系的优势，为复杂领域特定数据的自然语言查询提供了一个可复现且面向部署的通用框架思路。

Abstract: Building Information Modeling (BIM) is widely used in the Architecture, Engineering, and Construction (AEC) industry, but the complexity of Industry Foundation Classes (IFC) limits accessibility for non-expert users. To address this, we introduce IfcLLM, a hybrid framework for natural language interaction with IFC-based BIM models. It transforms IFC models into complementary representations: a relational representation for structured element properties and geometry, and a graph representation for topological relationships. These representations are integrated through iterative retry-and-refine LLM reasoning. We implement the framework using an open-weight LLM (GPT OSS 120B), supporting reproducible and deployment-oriented workflows. Evaluation on three IFC models with queries derived from 30 scenarios shows first-attempt accuracy of 93.3%-100%, with all failures recovered using a fallback LLM. The results show that combining complementary representations with iterative reasoning enables more accessible natural language querying of IFC data while supporting routine BIM analysis tasks.

[20] Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation cs.CL | cs.AI | cs.CV | cs.IR | cs.LGPDF

Weiqing Luo, Zongye Hu, Xiao Wang, Zhiyuan Yu, Haofeng Zhang

TL;DR: 本文提出了一种面向效用的视觉证据选择方法，用于多模态检索增强生成。该方法从信息论角度重新定义证据效用，引入潜在帮助性概念，并设计了一个无需训练、代理加速的框架来高效估计效用，在多个基准测试中超越了现有方法并显著降低了计算成本。

Details

Motivation: 现有多模态证据选择方法主要依赖语义相关性或表面相似性，与下游推理的实际效用不匹配，因此需要一种更直接衡量证据对模型输出信息增益的方法。

Result: 在MRAG-Bench和Visual-RAG基准测试上，该方法在多个模型家族上均一致优于最先进的RAG基线方法，同时实现了计算成本的大幅降低。

Insight: 从信息论角度将证据效用定义为对模型输出分布的信息增益，并引入潜在帮助性变量作为优化代理，使得无需在答案空间进行难以处理的优化即可有效排序证据；提出的训练免费、代理加速框架利用轻量级多模态模型高效估计效用，兼具性能与效率优势。

Abstract: Visual evidence selection is a critical component of multimodal retrieval-augmented generation (RAG), yet existing methods typically rely on semantic relevance or surface-level similarity, which are often misaligned with the actual utility of visual evidence for downstream reasoning. We reformulate multimodal evidence selection from an information-theoretic perspective by defining evidence utility as the information gain induced on a model’s output distribution. To overcome the intractability of answer-space optimization, we introduce a latent notion of evidence helpfulness and theoretically show that, under mild assumptions, ranking evidence by information gain on this latent variable is equivalent to answer-space utility. We further propose a training-free, surrogate-accelerated framework that efficiently estimates evidence utility using lightweight multimodal models. Experiments on MRAG-Bench and Visual-RAG across multiple model families demonstrate that our method consistently outperforms state-of-the-art RAG baselines while achieving substantial reductions in computational cost.

[21] CANTANTE: Optimizing Agentic Systems via Contrastive Credit Attribution cs.CL | cs.AI | cs.MAPDF

Tom Zehle

TL;DR: 本文提出CANTANTE框架，通过对比同一查询下多个联合配置的rollouts，将基于LLM的多智能体系统的系统级奖励分解为每个智能体的更新信号，从而解决系统配置自动化中的信用分配问题，并将其应用于智能体提示优化。

Details

Motivation: 基于LLM的多智能体系统在复杂任务中表现出色，但其配置自动化面临结构性挑战，因为得分仅在系统层面可用，而控制智能体行为的参数是局部的，优化这些系统本质上是一个信用分配问题。

Result: 在编程（MBPP）、数学推理（GSM8K）和多跳问答（HotpotQA）基准测试中，CANTANTE在所有评估的优化器中取得了最佳平均排名，并始终优于未优化的提示。它在MBPP上比最强基线提高了18.9个百分点，在GSM8K上提高了12.5个百分点，同时推理成本更低；在HotpotQA上保持在最强基线的一个标准差范围内。

Insight: 创新点在于将系统级奖励分解为每个智能体的信用信号，通过对比不同联合配置的rollouts实现，这为多智能体系统的参数优化提供了一种可扩展且高效的方法；客观分析认为，其信用相关性分析验证了分配器产生有意义的个体信号而非简单回显全局得分，增强了方法的可信度。

Abstract: LLM-based multi-agent systems have demonstrated strong performance across complex real-world tasks, such as software engineering, predictive modeling, and retrieval-augmented generation. Yet automating their configuration remains a structural challenge, as scores are available only at the system level, whereas the parameters governing agent behavior are local. We argue that optimizing these systems is fundamentally a credit-assignment problem. We therefore introduce CANTANTE, a framework that decomposes system-level rewards into per-agent update signals by contrasting rollouts of multiple joint configurations on the same query. We instantiate it for prompt optimization, treating agent prompts as learnable system parameters. We evaluate CANTANTE against GEPA and MIPROv2 on programming (MBPP), mathematical reasoning (GSM8K), and multi-hop question answering (HotpotQA). Across these benchmarks, CANTANTE achieves the best average rank among all evaluated optimizers and consistently outperforms unoptimized prompts. It improves over the strongest baseline by +18.9 percentage points on MBPP and +12.5 percentage points on GSM8K, while incurring a lower inference cost. It remains within one standard deviation of the strongest baseline on HotpotQA. Crucially, our credit correlation analysis confirms that the attributer produces meaningful per-agent signals rather than echoing the global system score.

[22] FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages cs.CLPDF

Sarmistha Das, Vaibhav Vishal, Syed Ibrahim Ahmad, Manish Gupta, Sriparna Saha

TL;DR: 本文针对印度语言的多模态金融推理与问答，提出了FinVQA基准数据集和FIND框架。FinVQA涵盖六种语言、14个金融领域，包含18,900个样本和四种问题格式，旨在评估多语言环境下的金融数值与多模态推理能力。FIND框架结合监督微调和约束感知解码，以提升数值推理的忠实性、多模态基础的鲁棒性以及结构化决策能力。

Details

Motivation: 现有基准大多忽视了多语言环境下基于多模态的准确数值推理这一高风险现实挑战，尤其是在印度语言领域，因此需要构建专门的评估基准和建模方法。

Result: 论文提出了FinVQA基准数据集，并设计了FIND框架进行应对，但摘要中未提及具体的定量实验结果（如准确率）或与现有SOTA模型的对比。

Insight: 创新点在于构建了首个针对印度语言的多模态金融推理基准FinVQA，并提出了结合监督微调与约束感知解码的FIND框架，以促进忠实的数值推理和鲁棒的多模态基础，为高风险多语言多模态金融推理建立了严格的评估与建模范式。

Abstract: Financial decision-making in multilingual settings demands accurate numerical reasoning grounded in diverse modalities, yet existing benchmarks largely overlook this high-stakes, real-world challenge, especially for Indic languages. We introduce FinVQA, a benchmark for evaluating financial numerical and multimodal reasoning in multilingual Indic contexts. FinVQA spans English, Hindi, Bengali, Marathi, Gujarati, and Tamil, and comprises 18,900 samples across 14 financial domains. The dataset captures diverse reasoning paradigms under realistic constraints, and is structured across three difficulty levels (easy, moderate, hard) and four question formats: multiple choice, fill-in-the-blank, table matching, and true/false. To address these challenges, we propose FIND, a framework that combines supervised fine-tuning with constraint-aware decoding to promote faithful numerical reasoning, robust multimodal grounding, and structured decision-making. Together, FinVQA and FIND establish a rigorous evaluation and modeling paradigm for high-stakes multilingual multimodal financial reasoning.

[23] Query-Conditioned Test-Time Self-Training for Large Language Models cs.CL | cs.AI | cs.LGPDF

Chaehee Song, Minseok Seo, Yeeun Seong, Doyi Kim, Changick Kim

TL;DR: 本文提出了Query-Conditioned Test-Time Self-Training (QueST)框架，用于在推理时对大型语言模型进行参数高效微调。其核心是利用输入查询本身来构建结构相关的问题-解决方案对，并以此作为监督信号，实现无需外部数据的查询特定自适应。

Details

Motivation: 现有的大型语言模型通常以固定参数部署，推理时计算扩展虽能提升性能，但无法纠正模型误解或适应特定查询的结构。现有的测试时优化方法要么依赖外部数据，要么优化缺乏查询对齐的通用自监督目标，存在局限性。

Result: 在七个数学推理基准测试和GPQA-Diamond科学推理基准测试上，QueST均持续优于强大的测试时优化基线方法，证明了其有效性。

Insight: 创新点在于揭示了输入查询本身编码了足够构建结构相关问题-解决方案对的潜在信号，并据此提出了一种无需外部数据、查询条件化的自训练范式，实现了推理时针对特定查询的参数自适应微调。

Abstract: Large language models (LLMs) are typically deployed with fixed parameters, and their performance is often improved by allocating more computation at inference time. While such test-time scaling can be effective, it cannot correct model misconceptions or adapt the model to the specific structure of an individual query. Test-time optimization addresses this limitation by enabling parameter updates during inference, but existing approaches either rely on external data or optimize generic self-supervised objectives that lack query-specific alignment. In this work, we propose Query-Conditioned Test-Time Self-Training (QueST), a framework that adapts model parameters during inference using supervision derived directly from the input query. Our key insight is that the input query itself encodes latent signals sufficient for constructing structurally related problem–solution pairs. Based on this, QueST generates such query-conditioned pairs and uses them as supervision for parameter-efficient fine-tuning at test time. The adapted model is then used to produce the final answer, enabling query-specific adaptation without any external data. Across seven mathematical reasoning benchmarks and the GPQA-Diamond scientific reasoning benchmark, QueST consistently outperforms strong test-time optimization baselines. These results demonstrate that query-conditioned self-training is an effective and practical paradigm for test-time adaptation in LLMs.

[24] From Rosetta to Match-Up: A Paired Corpus of Linguistic Puzzles with Human and LLM Benchmarks cs.CLPDF

Neh Majmudar, Anne Huang, Jinfan Frank Hu, Elena Filatova

TL;DR: 本文研究了高中语言学竞赛中常见的两种谜题格式——罗塞塔石碑（Rosetta Stone）和配对（Match-Up），提出了一种将现有罗塞塔石碑谜题系统性地转换为配对谜题的方法，以加速新谜题的生成。通过人类参与者和大型语言模型（LLMs）对成对谜题进行评估，发现专家人类解谜者和LLMs在配对谜题上表现出全有或全无的模式。

Details

Motivation: 语言学谜题创作复杂且耗时，本文旨在通过系统转换现有谜题格式来高效生成新谜题，并评估不同格式下谜题的难度。

Result: 在人类和LLMs的评估中，专家人类解谜者和LLMs在配对谜题上均表现出全有或全无的解决模式，即要么完全解决，要么完全失败。

Insight: 创新点在于提出了罗塞塔石碑到配对谜题的系统转换方法，并贡献了一个成对谜题数据集，为人类和机器语言推理研究提供了新视角。

Abstract: In this paper, we examine linguistic puzzles used in high school linguistics competitions, focusing on two common formats: Rosetta Stone and Match-Up. We propose a systematic procedure for converting existing Rosetta Stone puzzles into corresponding Match-Up counterparts. Because linguistic puzzle creation is complex and time-consuming, our method provides an efficient way to accelerate the generation of new puzzles. We evaluate the resulting Rosetta Stone-Match-Up pairs with both human participants and large language models (LLMs). Our results show that both expert human solvers and LLMs display an all-or-nothing pattern on Match-Up puzzles, either solving them completely or failing entirely. This work contributes a new dataset of paired puzzles and provides a detailed evaluation of puzzle difficulty across formats, offering insights into both human and machine linguistic reasoning.

[25] PDCR: Perception-Decomposed Confidence Reward for Vision-Language Reasoning cs.CLPDF

Hee Suk Yoon, Eunseop Yoon, Ji Woo Hong, SooHwan Eom, Gwanhyeong Koo

TL;DR: 本文提出了一种名为PDCR（感知分解置信度奖励）的框架，用于解决在视觉-语言推理任务中，传统基于全局置信度增长的奖励信号因任务异质性（稀疏视觉感知与密集文本推理混合）而导致信号退化的问题。PDCR通过无监督技能分解，量化视觉依赖度并分离感知与推理步骤，然后在每个技能簇内进行置信度增益归一化，从而为两种技能提供稳定且尺度正确的训练信号。

Details

Motivation: 传统基于结果的稀疏奖励和近期基于模型内部置信度增长的细粒度奖励在纯文本推理中有效，但直接应用于视觉-语言推理任务时，由于任务混合了稀疏的视觉感知和密集的文本推理，全局归一化会导致视觉步骤的训练信号被占主导的文本步骤统计扭曲，即产生混合诱导的信号退化问题。

Result: 在关键的视觉-语言推理基准测试中，PDCR的表现优于天真的全局奖励公式和稀疏奖励基线方法。

Insight: 核心创新点在于将奖励结构与任务的异质性对齐，通过无监督技能分解（引入视觉依赖度评分和聚类）和簇内归一化，解决了混合任务中不同技能类型（感知与推理）奖励信号尺度不匹配的问题。这为多模态任务中的强化学习奖励设计提供了新思路，即奖励信号应针对任务的不同组成部分进行分解和适配。

Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) traditionally relies on a sparse, outcome-based signal. Recent work shows that providing a fine-grained, model-intrinsic signal (rewarding the confidence growth in the ground-truth answer) effectively improves language reasoning training by providing step-level guidance without costly external models. While effective for unimodal text, we find that naively applying this global reward to vision-language (V-L) reasoning is a suboptimal strategy, as the task is a heterogeneous mix of sparse visual perception and dense textual reasoning. This global normalization creates mixture-induced signal degradation, where the training signal for visual steps is statistically distorted by the predominant textual steps. We propose Perception-Decomposed Confidence Reward (PDCR), a framework that solves this by aligning the reward structure with the task’s heterogeneous nature. PDCR first performs an unsupervised skill decomposition, introducing a model-internal Visual Dependence Score to quantify visual reliance and applying a clustering algorithm to separate perception and reasoning steps. Based on this, PDCR computes a decomposed advantage by normalizing confidence gains within each skill cluster. This intra-cluster normalization provides a stable, correctly-scaled signal for both perception and reasoning. We demonstrate that PDCR outperforms the naive, global-reward formulation and sparse-reward baselines on key V-L reasoning benchmarks.

[26] PersonalAI 2.0: Enhancing knowledge graph traversal/retrieval with planning mechanism for Personalized LLM Agents cs.CLPDF

Mikhail Menschikov, Matvey Iskornev, Alexander Kharitonov, Alina Bogdanova, Mikhail Belkin

TL;DR: 论文提出了PersonalAI 2.0（PAI-2）框架，通过整合外部知识图谱（KG）来增强基于大语言模型（LLM）的系统。该方法通过引入动态、多阶段的查询处理流水线，解决了现有图检索增强生成（GraphRAG）方法的关键局限。其核心是能够基于提取的实体、匹配的图顶点和生成的线索查询，执行自适应的迭代信息搜索。

Details

Motivation: 解决现有图检索增强生成（GraphRAG）方法在知识检索和利用方面的局限性，旨在通过更动态、迭代的查询处理来提升LLM系统的事实正确性和减少幻觉。

Result: 在六个基准测试（Natural Questions, TriviaQA, HotpotQA, 2WikiMultihopQA, MuSiQue和DiaASQ）上评估，相比LightRAG、RAPTOR和HippoRAG 2等方法，在生成答案的事实正确性上有所提升。使用LLM-as-a-Judge在四个基准上平均获得4%的增益，图遍历算法（如BeamSearch, WaterCircles）比标准扁平检索器平均提升6%，搜索计划增强机制相比禁用时在六个数据集上获得18%的提升。此外，在MINE-1基准上达到了SOTA结果，信息保留分数为89%，使用了7B-14B级别的LLM。

Insight: 创新点在于将动态、多阶段的查询处理与知识图谱遍历相结合，通过自适应迭代搜索（利用实体、图顶点和线索查询）来增强检索和推理能力。从客观角度看，其将规划机制（搜索计划增强）集成到图检索流程中，可能为构建更可扩展、上下文感知的个性化AI智能体提供了新的架构思路。

Abstract: We introduce PersonalAI 2.0 (PAI-2), a novel framework, designed to enhance large language model (LLM) based systems through integration of external knowledge graphs (KG). The proposed approach addresses key limitations of existing Graph Retrieval-Augmented Generation (GraphRAG) methods by incorporating a dynamic, multistage query processing pipeline. The central point of PAI-2 design is its ability to perform adaptive, iterative information search, guided by extracted entities, matched graph vertices and generated clue-queries. Conducted evaluation over six benchmarks (Natural Questions, TriviaQA, HotpotQA, 2WikiMultihopQA, MuSiQue and DiaASQ) demonstrates improvement in factual correctness of generating answers compared to analogues methods (LightRAG, RAPTOR, and HippoRAG 2). PAI-2 achieves 4% average gain by LLM-as-a-Judge across four benchmarks, reflecting its effectiveness in reducing hallucination rates and increasing precision. We show that use of graph traversal algorithms (e.g. BeamSearch, WaterCircles) gain superior results compared to standard flatten retriever on average 6%, while enabled search plan enhancement mechanism gain 18% boost compared to disabled one by LLM-as-a-Judge across six datasets. In addition, ablation study reveals that PAI-2 achieves the SOTA result on MINE-1 benchmark, achieving 89% information-retention score, using LLMs from 7-14B tiers. Collectively, these findings underscore the potential of PAI-2 to serve as a foundational model for next-generation personalized AI applications, requiring scalable, context-aware knowledge representation and reasoning capabilities.

[27] Many-Shot CoT-ICL: Making In-Context Learning Truly Learn cs.CL | cs.AIPDF

Tsz Ting Chung, Lemao Liu, Mo Yu, Dit-Yan Yeung

TL;DR: 本文研究了大规模上下文模型中的多示例思维链上下文学习（Many-Shot CoT-ICL），发现其在推理任务上的扩展规律与非推理任务不同。论文揭示了模型类型、示例检索和排序对性能的影响，并提出将长上下文窗口视为结构化课程而非检索缓冲区的观点，进而提出了一种简单的示例排序方法CDS以提升性能。

Details

Motivation: 当前对多示例上下文学习扩展行为的理解主要基于非推理任务，而其在推理任务（尤其是使用思维链）上的表现尚不明确。本文旨在探究多示例思维链上下文学习在推理任务上的真实学习行为与扩展规律。

Result: 在几何等推理任务上，使用64个示例时，提出的CDS排序方法能带来高达5.42个百分点的性能提升。

Insight: 创新点在于将多示例CoT-ICL重新定义为上下文测试时学习，并提出了两个核心原则：示例应易于模型理解，且应按支持平滑概念进展的顺序排列。这为利用长上下文进行有效的上下文学习提供了新的结构化视角和方法指导。

Abstract: In-context learning (ICL) adapts large language models (LLMs) to new tasks by conditioning on demonstrations in the prompt without parameter updates. With long-context models, many-shot ICL can use dozens to hundreds of examples and achieve performance comparable to fine-tuning, yet current understanding of its scaling behavior is largely derived from non-reasoning tasks. We study many-shot chain-of-thought in-context learning (CoT-ICL) for reasoning and show that standard many-shot rules do not transfer. Across non-reasoning and reasoning-oriented LLMs and across non-reasoning and reasoning tasks, we find: (i) a setting-dependent scaling effect, where increasing the number of CoT demonstrations is unstable for non-reasoning LLMs and benefits mainly reasoning-oriented LLMs; (ii) similarity-based retrieval helps on non-reasoning tasks but fails on reasoning, since semantic similarity poorly predicts procedural (i.e., CoT) compatibility; and (iii) an order-scaling effect, where performance variance grows with more CoT demonstrations. We interpret these behaviors by viewing many-shot CoT-ICL as in-context test-time learning rather than scaled pattern matching, and suggests two principles: (i) demonstrations should be easy for the target model to understand, and (ii) they should be ordered to support a smooth conceptual progression. Guided by the principle, we propose Curvilinear Demonstration Selection (CDS), a simple ordering method that yields up to a 5.42 percentage-point gain on geometry with 64 demonstrations. Overall, our results reframe the long context window from a retrieval buffer into a structured curriculum for in-context test-time learning.

[28] Prefix Teach, Suffix Fade: Local Teachability Collapse in Strong-to-Weak On-Policy Distillation cs.CLPDF

Kaiyuan Liu, Ziyuan Zhuang, Yang Bai, Bing Wang, Rongxiang Weng

TL;DR: 本文研究了强到弱策略蒸馏中的局部可教性崩溃现象，发现在生成轨迹的后期部分，尽管教师模型仍具优势，但缺乏有效的局部对比度，导致密集反馈失效。作者提出了一种基于轨迹特定释放规则的方法，通过测量教师与学生候选集之间的边际差异，并在检测到显著下降时截断监督，从而将监督集中在反馈具有区分度的区域。

Details

Motivation: 解决强到弱策略蒸馏中，对完整响应序列进行密集监督不一定能单调提升学生性能的问题，即局部可教性崩溃，旨在更有效地利用教师反馈。

Result: 在基于Qwen3模型家族的强到弱蒸馏任务中，该方法在五个领域内基准测试上均优于标准的全轨迹策略蒸馏，且在不同学生规模下表现一致，同时在领域外任务上更好地保持了模型能力。

Insight: 创新点在于识别了局部可教性崩溃现象，并提出了轨迹特定释放规则来动态调整监督范围，强调有效蒸馏需评估教师反馈的局部效用而非仅其可用性，为策略蒸馏提供了新的优化视角。

Abstract: On-policy distillation (OPD) trains a student model on its own rollouts using dense feedback from a stronger teacher. Prior literature suggests that, provided teacher feedback is available, supervising the full sequence of response tokens should monotonically improve performance. However, we demonstrate that this assumption sometimes fails to hold in strong-to-weak OPD settings. While later segments of a generated trajectory may still exhibit a non-zero teacher-student advantage, they frequently lack the local contrast that makes dense feedback effective for prioritizing student learning. We term this failure mode local teachability collapse. The resulting principle is straightforward: supervision should concentrate on trajectory regions where the teacher’s feedback remains discriminative, rather than uniformly covering the entire response. We operationalize this principle through a trajectory-specific release rule. This rule measures the teacher’s margin over the student’s top-$K$ candidate set, aggregates this margin across NLTK-tokenized sentence segments, and truncates dense OPD supervision upon detecting a BIC-style downward change point. Experimental results across strong-to-weak distillation tasks using the Qwen3 model family indicate that this release rule consistently outperforms standard full-trajectory OPD across five in-domain benchmarks at various student scales. Furthermore, compared to baseline distillation methods, our approach better preserves model capabilities on out-of-domain task. These results suggest that effective strong-to-weak OPD requires evaluating not only the availability of teacher guidance but also its local utility, ensuring that the generated feedback remains teachable.

[29] FlowCompile: An Optimizing Compiler for Structured LLM Workflows cs.CLPDF

Junyan Li, Zhang-Wei Hong, Maohao Shen, Yang Zhang, Chuang Gan

TL;DR: 本文提出了FlowCompile，一个针对结构化LLM工作流的优化编译器。它通过编译时设计空间探索，为工作流中的每个子代理选择配置，以在准确性和延迟之间权衡，生成可重用的配置集，从而在部署前全局优化工作流。

Details

Motivation: 现有方法将工作流优化视为路由问题，在推理时根据训练目标为每个查询选择配置，但结构化LLM工作流（由预定义图中执行的专用LLM子代理组成）的优化面临组合设计空间（模型选择、推理预算和工作流结构）的挑战，需要从编译角度进行全局优化。

Result: 在多样化工作流和具有挑战性的基准测试中，FlowCompile始终优于启发式优化的工作流配置和基于路由的基线方法，实现了高达6.4倍的加速。

Insight: 创新点在于将机器学习编译器的思想引入LLM工作流优化，通过编译时分解、性能分析和结构感知代理组合，一次性识别高质量、多样化的权衡配置集，无需重新训练或在线适应，该配置集可作为可重用的优化工件，支持灵活部署和下游选择或路由。

Abstract: Structured LLM workflows, where specialized LLM sub-agents execute according to a predefined graph, have become a powerful abstraction for solving complex tasks. Optimizing such workflows, i.e., selecting configurations for each sub-agent to balance accuracy and latency, is challenging due to the combinatorial design space over model choices, reasoning budgets, and workflow structures. Existing cost-aware methods largely treat workflow optimization as a routing problem, selecting a configuration at inference time for each query according to the accuracy-latency objective used during training. We argue that structured LLM workflows can also be optimized from a compilation perspective: before deployment, the system can globally explore the workflow design space and construct a reusable set of workflow-level configurations spanning diverse accuracy-latency trade-offs. Drawing inspiration from machine learning compilers, we introduce FlowCompile, a structured LLM workflow compiler that performs compile-time design space exploration to identify a high-quality, reusable trade-off set. FlowCompile decomposes a workflow into sub-agents, profiles each sub-agent under diverse configurations, and composes these measurements through a structure-aware proxy to estimate workflow-level accuracy and latency. It then identifies diverse high-quality configurations in a single compile-time pass, without retraining or online adaptation. Experiments across diverse workflows and challenging benchmarks show that FlowCompile consistently outperforms heuristically optimized workflow configurations and routing-based baselines, delivering up to 6.4x speedup. The compiled configuration set further serves as a reusable optimization artifact, enabling flexible deployment under varying runtime preferences and supporting downstream selection or routing.

[30] RTLC – Research, Teach-to-Learn, Critique: A three-stage prompting paradigm inspired by the Feynman Learning Technique that lifts LLM-as-judge accuracy on JudgeBench with no fine-tuning cs.CL | cs.AIPDF

Andrea Morandi

TL;DR: 本文提出了RTLC（研究、教学式学习、批判）三阶段提示范式，灵感来源于费曼学习法，旨在无需微调即可提升LLM作为评判者在JudgeBench基准上的准确性。该方法通过教学式脚手架、多候选生成和自批判机制，将单一黑盒LLM转化为思维集成评判者。

Details

Motivation: 当前LLM作为评判者已成为开放式生成任务的标准评估工具，但在公开的JudgeBench基准上，即使是经过指令微调的强模型在客观正确性成对项目上的表现也仅略高于随机水平，因此需要一种无需微调、检索或外部工具的方法来提升评判准确性。

Result: 在JudgeBench-GPT（包含350个困难成对项目）上，Claude 3.7 Sonnet的成对准确率从单次普通提示的64.6%提升至RTLC批判10个候选的78.6%，绝对增益达14.0个百分点，优于N=10的自一致性多数投票（77.7%）和零样本首个候选（74.0%）。消融实验显示，教学式学习脚手架贡献+9.4个百分点，N=10边缘化贡献+3.7个百分点，显式批判贡献+0.9个百分点。

Insight: 创新点包括将费曼学习法（学习→教学→发现差距→简化）转化为LLM提示的教学式脚手架，通过多候选生成实现思维集成，并引入自批判机制进行交叉比较。该方法在成本-准确性边界上优于自一致性，且与后验评判分数校准正交组合，在实践中产生乘性增益。

Abstract: LLM-as-a-judge is now the default measurement instrument for open-ended generation, but on the public JudgeBench benchmark even strong instruction-tuned judges barely scrape past random on objective-correctness pairwise items. We introduce RTLC, a three-stage prompting recipe – Research, Teach-to-Learn, Critique – that promotes a single black-box LLM into an ensemble-of-thought judge with no fine-tuning, retrieval, or external tools. Stage 1 wraps the input in a fixed pedagogical scaffold porting the Feynman Learning Technique (study $\to$ teach $\to$ find gaps $\to$ simplify) into LLM prompting. Stage 2 draws N=10 independent candidate verdicts at temperature 0.4. Stage 3 acts as its own critic, cross-comparing the candidate set against the original question to emit one critiqued verdict at temperature 0. On JudgeBench-GPT (350 hard pairwise items), Claude 3.7 Sonnet’s pairwise accuracy climbs from 64.6% (single-shot vanilla prompt) to 78.6% (RTLC critique-of-10) – an absolute 14.0-percentage-point gain. RTLC also beats N=10 self-consistency majority voting (77.7%) and a zero-shot first candidate (74.0%). A clean three-step ablation attributes +9.4 pp to the Teach-to-Learn scaffold, +3.7 pp to N=10 marginalisation, and +0.9 pp to explicit critique. We discuss the cost-accuracy frontier (RTLC sits above self-consistency at every working point), the error-budget breakdown across the four JudgeBench categories (knowledge, reasoning, math, coding), and how RTLC composes orthogonally with post-hoc judge-score calibration, with the two interventions compounding multiplicatively in practice.

[31] Where Does Reasoning Break? Step-Level Hallucination Detection via Hidden-State Transport Geometry cs.CL | cs.AIPDF

Tyler Alvarez, Ali Baheri

TL;DR: 该论文提出了一种基于隐藏状态轨迹几何特性的单次前向传播检测方法，用于定位多步推理中的首次错误（幻觉）。通过对比主成分分析构建特定轨迹的几何透镜，提取七个几何转移特征来评分每个推理步骤，并训练一个可部署的双向长短期记忆学生模型。

Details

Motivation: 现有幻觉检测器大多在轨迹级别操作，无法定位首次错误且通常需要多次采样完成，因此需要一种能在单次前向传播中定位推理过程中首次错误的方法。

Result: 在ProcessBench、PRM800K、HaluEval和TruthfulQA基准测试中，该方法优于基于熵、探测和注意力的基线模型；教师模型在不同语言模型和数据集间稳定迁移，而学生模型在分布偏移下性能下降。

Insight: 将步骤级幻觉检测重新定义为轨迹动力学问题，创新点在于利用隐藏状态的传输几何来识别首次错误，并揭示了部署中的核心挑战：在分布偏移下保持对比传输边界。

Abstract: Large language models hallucinate during multi-step reasoning, but most existing detectors operate at the trace level: they assign one confidence score to a full output, fail to localize the first error, and often require multiple sampled completions. We frame hallucination instead as a property of the hidden-state trajectory produced during a single forward pass. Correct reasoning moves through a stable manifold of locally coherent transitions; a first error appears as a localized excursion in transport cost away from this manifold. We operationalize this view with a label-conditioned teacher that builds a trace-specific contrastive PCA lens and scores each step with seven geometric transition features, and a deployable BiLSTM student distilled from the teacher that operates on raw hidden states without inference-time labels. We prove that contrastive PCA is the optimal projection for a transport-separation objective between first error and correct states, and that single-pass first error localization holds whenever the first error creates a positive transport margin over preceding correct transitions. On ProcessBench, PRM800K, HaluEval, and TruthfulQA, both models outperform entropy-based, probing-based, and attention-based baselines in-domain; the teacher transfers stably across language models and datasets, while the student collapses under shift, a gap our distillation theory predicts. These results recast step-level hallucination detection as a problem of trajectory dynamics and identify the central obstacle to deployment: preserving the contrastive transport margin under distribution shift.

[32] An LLM-Based System for Argument Reconstruction cs.CLPDF

Paulo Pirozelli, Victor Hugo Nascimento Rocha, Fabio G. Cozman, Douglas Aldred

TL;DR: 本文提出了一种基于大型语言模型（LLM）的端到端系统，用于从自然语言文本中重构出抽象论证图。该系统采用多阶段流程，逐步识别论证组件、选择相关元素并揭示其逻辑关系，最终表示为包含前提与结论两种组件以及支持、攻击和削弱三种关系的有向无环图。

Details

Motivation: 论证是人类推理的基本方面，但自动从文本中重构论证结构具有挑战性。本文旨在开发一个可扩展的LLM系统，以系统化地恢复文本中的论证性结构。

Result: 在论证理论教科书案例上进行的人工评估表明，系统能够充分恢复论证结构；在基准数据集上的定量评估显示，通过将输出映射到现有标注方案，系统在不同数据集上取得了合理的性能。

Insight: 创新点在于设计了一个基于LLM的多阶段端到端管道，用于系统化地重构论证图，并展示了其在不同标注方案下的适应性和可扩展潜力。

Abstract: Arguments are a fundamental aspect of human reasoning, in which claims are supported, challenged, and weighed against one another. We present an end-to-end large language model (LLM)-based system for reconstructing arguments from natural language text into abstract argument graphs. The system follows a multi-stage pipeline that progressively identifies argumentative components, selects relevant elements, and uncovers their logical relations. These elements are represented as directed acyclic graphs consisting of two component types (premises and conclusions) and three relation types (support, attack, and undercut). We conduct two complementary experiments to evaluate the system. First, we perform a manual evaluation on arguments drawn from an argumentation theory textbook to assess the system’s ability to recover argumentative structure. Second, we conduct a quantitative evaluation on benchmark datasets, allowing comparison with prior work by mapping our outputs to established annotation schemes. Results show that the system can adequately recover argumentative structures and, when adapted to different annotation schemes, achieve reasonable performance across benchmark datasets. These findings highlight the potential of LLM-based pipelines for scalable argument reconstruction.

cs.CV [Back]

[33] CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference cs.CV | cs.AIPDF

Zhitong Dong, Chao Li, Jie Yu, Hao Chen

TL;DR: 本文提出了一种名为CROP的新方法，用于美学图像裁剪，该方法将美学裁剪重新定义为多模态推理任务，通过引导视觉语言模型像专业摄影师一样思考，逐步分析场景元素和构图原则，并结合专家偏好对齐模块，使模型决策与人类专家美学一致。

Details

Motivation: 现有美学图像裁剪方法主要依赖显著性预测或检索增强，忽略了任务核心——对构图和美学的深度理解，导致在复杂场景中难以做出构图权衡或缺乏对独特场景的自适应推理，无法与人类专家的裁剪结果对齐。

Result: 在多个数据集上的广泛实验验证了该方法的优越性及其组件的有效性。

Insight: 创新点在于将主观美学问题解构为“分析-提议-决策”的逐步推理过程，并引入专家偏好对齐模块，从而激活视觉语言模型在美学领域的分析和理解能力，实现与人类专家美学的对齐。

Abstract: Aesthetic image cropping aims to enhance the aesthetic quality of an image by improving its composition through spatial cropping. Previous methods often rely on saliency prediction or retrieval augmentation, ignoring the task’s core requirement: a deep understanding of composition and aesthetics. Consequently, saliency-based methods struggle to make compositional trade-offs in complex scenes, while retrieval-based methods blindly refer to similar cases, lacking adaptive reasoning for unique scenes. Both approaches fail to align their automated cropping results with those of human experts. To address the above issues, we propose a novel paradigm that reformulates aesthetic cropping as a multimodal reasoning task, aiming to activate the VLM’s analytical and comprehension capabilities in aesthetics. We design a Compositional Reasoning and Optimizing Preference method (CROP) that directs the VLM to think like a professional photographer. It deconstructs a complex and subjective aesthetic problem into an “analysis-proposal-decision” process, reasoning step by step through the analysis of scene elements and compositional principles. Meanwhile, our expert preference alignment module makes the model’s decision consistent with human expert aesthetics. Extensive experiments across multiple datasets validate our method’s superiority and component effectiveness.

[34] What Happens Before Decoding? Prefill Determines GUI Grounding in VLMs cs.CVPDF

Jiaping Lin, Fei Shen, Junzhe Li, Ping Nie, Fei Yu

TL;DR: 本文研究了视觉语言模型在GUI接地任务中的内部机制，发现接地过程遵循两阶段范式：预填充阶段决定候选UI元素，解码阶段随后细化最终坐标。基于此，作者提出了Re-Prefill方法，这是一种无需训练的技术，通过引入一个注意力引导的第二次预填充阶段来优化目标选择，从而提升性能。

Details

Motivation: 现有无需训练的GUI接地方法通常依赖多次推理运行，但每次前向传递仍独立解释指令和解析视觉布局，缺乏视觉标记之间的渐进交互。本文旨在识别并解决这一过程中的瓶颈。

Result: 在四个VLMs和五个基准测试上的实验表明，该方法无需额外训练即可带来一致改进，在ScreenSpot-Pro上最高提升4.3%。

Insight: 核心创新点在于揭示了GUI接地中预填充阶段的关键瓶颈作用，并提出了一种通过注意力机制引导二次预填充来修正候选目标假设的训练免费推理策略，这为理解并改进VLMs在视觉推理任务中的内部决策过程提供了新视角。

Abstract: Existing training-free approaches for GUI grounding often rely on multiple inference runs, such as iterative cropping or candidate aggregation, to identify target elements. Despite this additional computation, each forward pass still independently interprets the instruction and parses the visual layout, without enabling progressive interaction among visual tokens. In this paper, we study what happens during GUI grounding in Vision-Language Models (VLMs) and identify a previously overlooked bottleneck. We show that grounding follows a two-stage paradigm: the prefill stage determines candidate UI elements, while the decoding stage subsequently refines the final coordinates. This asymmetry establishes prefill as the critical step, as errors in candidate selection cannot be effectively corrected during decoding. Based on this observation, we propose Re-Prefill, a training-free method that revisits inference by introducing an attention-guided second prefill stage to refine target selection. Specifically, visual tokens that consistently receive high attention from the query position, i.e., the final token, across layers are extracted as a preliminary target hypothesis and appended to the input, together with the instruction hidden states, enabling the model to deeply re-think its decision before coordinate generation. Experiments across four VLMs and five benchmarks, including ScreenSpot-Pro, ScreenSpot-V2, OSWorld-G, UI-Vision, and MMBench-GUI, demonstrate consistent improvements without additional training, with gains of up to 4.3% on ScreenSpot-Pro. Code will be available at https://github.com/linjiaping1/Re-Prefill.

[35] SSDA: Bridging Spectral and Structural Gaps via Dual Adaptation for Vision-Based Time Series Forecasting cs.CV | cs.AIPDF

Mingrui Zhang, Hanchen Yang, Wengen Li, Xudong Jiang, Yichao Zhang

TL;DR: 本文提出SSDA方法，通过谱域和结构域的双重适配，弥合视觉大模型在时间序列预测任务中存在的谱域差异和结构差异，从而提升预测性能。

Details

Motivation: 现有方法将时间序列数据转换为图像后，利用预训练视觉大模型进行预测，但转换后的图像与自然图像在谱域分布和结构连续性上存在显著差异，限制了模型性能。

Result: 在七个真实世界基准测试上，SSDA在完整样本和少样本设置下均优于基于视觉大模型和语言大模型的基线方法。

Insight: 创新点包括：提出谱域幅度对齐器（SMA）选择性增强幅度谱以匹配自然图像统计特性；提出结构引导的低秩适配（SG-LoRA）注入位置感知的时间编码并低秩更新注意力机制；以及两个分支的自适应融合机制。

Abstract: Large vision models (LVMs) have recently proven to be surprisingly effective time series forecasters, simply by rendering temporal data as images. This success, how ever, rests on a largely unexamined premise: the rendered time series images are sufficiently close to natural images for knowledge in pre-trained models to transfer effectively. We argue that two gaps still remain, i.e., spectral and structural gaps, fundamentally limiting the potential of LVMs for time series forecasting. Spectrally, we systematically reveal that rendered time series images exhibit a markedly shallower power spectrum than the natural images LVMs are pre-trained to recognize. Structurally, reshaping 1D temporal sequences into 2D grids fabricates spurious spatial adjacencies while severing genuine temporal continuities, misleading the spatial inductive biases of pre-trained LVMs. To bridge these gaps, we propose SSDA, a dual-branch network that spectrally and structurally adapts to unlock the full potential of LVMs for time series forecasting. At the data level, a Spectral Magnitude Aligner (SMA) applies 2D FFT to selectively enhance the magnitude spectrum toward natural-image statistics while preserving phase. At the model level, a Structural-Guided Low-Rank Adaptation (SG-LoRA) injects position-aware temporal encodings into patch embeddings and adapts at tention via low-rank updates. The two branches are further adaptively fused to produce the final forecast. Extensive experiments on seven real-world benchmarks demonstrate that SSDA consistently outperforms strong LVM- and LLM-based baselines under both full-shot and few-shot settings. Code is publicly available at https://anonymous.4open.science/r/SSDA-8C5B.

Youssef Aboelwafa, Hicham G. Elmongui, Marwan Torki

TL;DR: M2Retinexformer是一种用于低光图像增强的新型多模态框架，通过整合深度、亮度和语义特征来扩展Retinexformer模型，以解决复杂退化问题。

Details

Motivation: 现有基于Retinex的深度学习方法主要依赖单模态RGB信息，难以处理噪声、伪影和颜色失真等复杂退化，因此需要引入多模态信息提供更鲁棒的增强指导。

Result: 在LOL、SID、SMID和SDSD基准测试中，该方法整体上超越了Retinexformer和近期最先进（SOTA）方法。

Insight: 创新点在于将深度（几何上下文）、亮度先验和语义特征等多模态信息通过跨注意力机制融合，并采用自适应门控动态平衡基于照明的自注意力和跨注意力，提升了模型对光照变化的鲁棒性和场景理解能力。

Abstract: Low-light image enhancement is challenging due to complex degradations, including amplified noise, artifacts, and color distortion. While Retinex-based deep learning methods have achieved promising results, they primarily rely on single-modality RGB information. We propose M2Retinexformer (Multi-Modal Retinexformer), a novel framework that extends Retinexformer by incorporating depth cues, luminance priors, and semantic features within a progressive refinement pipeline. Depth provides geometric context that is invariant to lighting variations, while luminance and semantic features offer explicit guidance on brightness distribution and scene understanding. Modalities are extracted at multiple scales and fused through cross-attention, with adaptive gating dynamically balancing illumination-guided self-attention and cross-attention based on the reliability of auxiliary cues. Evaluations on the LOL, SID, SMID, and SDSD benchmarks demonstrate overall improvements over Retinexformer and recent state-of-the-art methods. Code and pretrained weights are available at https://github.com/YoussefAboelwafa/M2Retinexformer

[37] VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority cs.CV | cs.AIPDF

Chenhao Qiu, Yechao Zhang, Xin Luo, Shien Song, Xusheng Liu

TL;DR: 本文针对长视频问答任务中存在的证据错位问题，提出了一种解耦规划器-检查器框架VideoSEAL。该框架将长时程规划与答案生成权分离，并通过像素级验证来确保最终答案与检索证据的一致性，从而在多个长视频基准测试上提升了答案准确性和证据对齐度。

Details

Motivation: 现有长视频理解智能体在长时程搜索和验证过程中，常产生与检索证据不匹配的正确答案，即‘证据错位’问题。论文旨在通过诊断该问题的根源（如推理时的提示压力和训练时的奖励压力），并设计新框架来解决此问题。

Result: 在LVBench和LongVideoBench等四个长视频基准测试上，所提框架将答案准确率分别提升至55.1%和62.0%，同时改善了证据对齐度，并展示了可扩展性和无需重新训练规划器的即插即用升级能力。

Insight: 核心创新在于将传统耦合的智能体范式解耦为独立的规划器和检查器，分离了长时程规划与答案生成权，并通过像素级验证门控最终答案，这为解决证据错位问题提供了结构化的解决方案，并增强了系统的可解释性和模块化升级能力。

Abstract: Long video question answering requires locating sparse, time-scattered visual evidence within highly redundant content. Although current MLLMs perform well on short videos, long videos introduce long-horizon search and verification, which often necessitates multi-turn, agentic interaction. We show that existing LVU agents can exhibit “evidence misalignment”: they produce correct answers that are not supported by the retrieved or inspected evidence. To characterize this failure, we introduce two diagnostics (temporal groundedness and semantic groundedness) and use them to reveal two pressures that amplify misalignment: prompt pressure from shared-context saturation at inference time and reward pressure from outcome-only optimization during training. These findings point to a structural root cause: the coupled agent paradigm conflates long-horizon planning with answer authority. We therefore propose the decoupled planner-inspector framework, which separates planning from answer authority and gates final answering on pixel-level verification. Across four long-video benchmarks, our framework improves both answer accuracy and evidence alignment, achieving 55.1% on LVBench and 62.0% on LongVideoBench while producing interpretable search trajectories. Moreover, the decoupled architecture scales consistently with increased search budgets and supports plug-and-play upgrades of the MLLM backbone without retraining the planner. Code and models are available at https://github.com/Echochef/VideoSEAL.

[38] DistractMIA: Black-Box Membership Inference on Vision-Language Models via Semantic Distraction cs.CV | cs.AIPDF

Hongyi Tang, Zhihao Zhu, Yi Yang

TL;DR: 本文提出DistractMIA，一种针对视觉语言模型的黑盒成员推理攻击方法，通过语义干扰来审计训练数据。该方法在保留原始图像的同时插入已知语义干扰物，并测量生成文本响应的变化，从而推断样本是否属于训练集。

Details

Motivation: 视觉语言模型通常在包含私有或敏感数据的大规模图像-文本语料库上训练，因此需要成员推理作为训练数据审计工具。现有方法要么依赖概率级信号（在部署模型中不可用），要么依赖于基于掩码的语义预测任务（其有效性受限于以对象为中心的视觉假设）。

Result: 在多个视觉语言模型和基准测试上的实验表明，DistractMIA一致地优于仅输出访问和更强访问权限的基线方法。在医学基准测试上的性能进一步证明了其超越以对象为中心的自然图像的适用性。

Insight: 创新点在于提出基于语义干扰的成员推理框架，通过校准干扰物配置和利用重复文本生成来捕获响应稳定性和干扰物吸收，无需访问logits、概率或隐藏状态。客观来看，该方法将成员推理从依赖模型内部信号转向利用生成文本的语义稳定性，具有更好的黑盒适用性。

Abstract: Vision-language models (VLMs) are trained on large-scale image-text corpora that may contain private, copyrighted, or otherwise sensitive data, motivating membership inference as a tool for training-data auditing. This is especially challenging for deployed VLMs, where auditors typically observe only generated textual responses. Existing VLM membership inference attacks either rely on probability-level signals unavailable in such settings, or use mask-based semantic prediction tasks whose effectiveness depends on object-centric visual assumptions. To address these limitations, we propose DistractMIA, an output-only black-box framework based on semantic distraction. Rather than removing visual evidence, DistractMIA preserves the original image, inserts a known semantic distractor, and measures how generated responses change. This design is motivated by the intuition that member samples remain more anchored to the original image semantics, while non-member samples are more easily redirected toward the distractor. To make this signal reliable, DistractMIA calibrates distractor configurations on a reference set and derives membership scores from repeated textual generations, capturing response stability and distractor uptake without accessing logits, probabilities, or hidden states. Experiments across multiple VLMs and benchmarks show that DistractMIA consistently outperforms both output-only and stronger-access baselines. Its performance on a medical benchmark further demonstrates applicability beyond object-centric natural images.

[39] 3D Primitives are a Spatial Language for VLMs cs.CV | cs.AI | cs.DBPDF

Junze Liu, Kun Qian, Florian Dubost, Kai Zhong, Arvind Srinivasan

TL;DR: 该论文揭示了视觉语言模型（VLMs）在空间理解上的一个悖论：它们能生成可执行代码来重建3D场景（包含正确的物体数量、类别和近似位置），却在同一图像的简单空间问题上失败。论文提出将3D几何基元（如立方体、球体、圆柱体，以代码形式表达）作为空间理解的中间表示，并基于此提出了三个贡献：一个名为SpatialBabel的基准测试、一种名为Code-CoT的无训练推理策略，以及一种名为S³-FT的自监督微调方法。

Details

Motivation: 解决VLMs在空间理解上的不一致性问题，即它们能通过代码生成处理复杂的3D场景重建，却难以回答简单的空间问题，旨在探索3D几何基元作为一种有效的中间表示来提升VLMs的空间推理能力。

Result: 在SpatialBabel基准上，Code-CoT将SpatialBabel-QA-Score提升了高达+6.4%（针对基元场景），在CV-Bench-3D真实照片上准确率提升了+5.0%；S³-FT自监督微调方法在无人类标注和教师模型的情况下，显著提升了多个模型的性能，例如将Qwen3-VL-8B在SpatialBabel-Primitive-QA上提升了+4.6%到+8.6%，在CV-Bench-2D上提升了+9.7%，在HallusionBench上提升了+17%。

Insight: 创新点包括：1）提出3D几何基元作为可转移的空间词汇，用于诊断和增强VLMs的空间理解；2）引入Code-CoT，通过代码生成链式思考进行无训练的空间推理；3）开发S³-FT，一种自监督方法，通过解析模型自身的3D重建输出生成标注数据来微调模型，无需额外标注。从客观角度看，这为VLMs的空间能力评估和提升提供了一种新颖、可扩展的框架。

Abstract: Vision-language models (VLMs) exhibit a striking paradox: they can generate executable code that reconstructs a 3D scene from geometric primitives with correct object counts, classes, and approximate positions, yet the same models fail at simpler spatial questions on the same image. We show that 3D geometric primitives (cubes, spheres, cylinders, expressed in executable code) serve as a powerful intermediate representation for spatial understanding, and exploit this through three contributions. First, we introduce \textbf{\textsc{SpatialBabel}}, a benchmark evaluating fourteen VLMs on primitive-based 3D scene reconstruction across six \emph{scene-code languages} (programming languages and declarative formats for 3D primitive scenes), revealing that a single model’s object-detection F1 can vary by up to $5.7\times$ across languages. Second, we propose \textbf{Code-CoT} (Code Chain-of-Thought), a training-free inference strategy that routes spatial reasoning through primitive-based code generation. Code-CoT lifts the SpatialBabel-QA-Score by up to $+6.4$% on primitive scenes and real-photo CV-Bench-3D accuracy by $+5.0$% for VLMs with strong coding capabilities. Third, we propose \textbf{S$^{3}$-FT} (Self-Supervised Spatial Fine-Tuning), which self-supervisedly distills primitive spatial knowledge into general visual reasoning by parsing the model’s own Three.js primitive-reconstructions into structured annotations and fine-tuning on the result, with \emph{no human labels and no teacher model}. Training on primitive images alone, S$^3$-FT improves Qwen3-VL-8B by $+4.6$ to $+8.6$% on SpatialBabel-Primitive-QA, $+9.7$% on CV-Bench-2D, and $+17$% on HallusionBench; the recipe transfers across model families. These results establish geometric primitives in code as both a diagnostic and a transferable spatial vocabulary for VLMs. We will release all artifacts upon publication.

[40] TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking cs.CVPDF

Jisu Nam, Jahyeok Koo, Soowon Son, Jaewoo Jung, Honggyu An

TL;DR: TrackCraft3R是一种新颖的密集3D跟踪方法，它通过重新利用预训练的视频扩散变换器（video DiT）来实现。该方法将单目视频及其逐帧重建的点图作为输入，通过一次前向传播，预测出以参考帧为锚点的跟踪点图，从而跟踪第一帧中每个像素在时间上的运动及其可见性。

Details

Motivation: 密集3D跟踪是动态场景理解的基础，现有方法要么在合成数据上从头训练，要么基于静态多视图图像学习的3D重建模型进行微调，都缺乏从真实世界视频中学习到的强运动先验。预训练的视频DiT从互联网规模的视频中学习了丰富的时空先验，但其逐帧生成范式与以参考帧为锚点的密集3D跟踪任务存在根本性不匹配。

Result: TrackCraft3R在标准的稀疏和密集3D跟踪基准测试中达到了最先进的性能，同时运行速度比之前最强的方法快1.3倍，峰值内存使用量减少了4.6倍。该方法还展示了对大运动和长视频的鲁棒性。

Insight: 论文的核心创新点在于通过双潜在表示（结合逐帧几何潜在变量和以参考帧为锚点的跟踪潜在变量作为密集查询）和时间RoPE对齐（指定每个跟踪潜在变量的目标时间戳），将视频DiT的逐帧生成范式转换为以参考帧为锚点的跟踪范式，并通过LoRA微调实现。这为将大规模预训练的生成模型重新用于感知任务提供了新思路。

Abstract: Dense 3D tracking from monocular video is fundamental to dynamic scene understanding. While recent 3D foundation models provide reliable per-frame geometry, recovering object motion in this geometry remains challenging and benefits from strong motion priors learned from real-world videos. Existing 3D trackers either follow iterative paradigms trained from scratch on synthetic data or fine-tune 3D reconstruction models learned from static multi-view images, both lacking real-world motion priors. Pre-trained video diffusion transformers (video DiTs) offer rich spatio-temporal priors from internet-scale videos, making them a promising foundation for 3D tracking. However, their frame-anchored formulation, which generates each frame’s content, is fundamentally mismatched with reference-anchored dense 3D tracking, which must follow the same physical points from a reference frame across time. We present TrackCraft3R, the first method to repurpose a video DiT as a feed-forward dense 3D tracker. Given a monocular video and its frame-anchored reconstruction pointmap, TrackCraft3R predicts a reference-anchored tracking pointmap that follows every pixel of the first frame across time in a single forward pass, along with its visibility. We achieve this through two designs: (i) a dual-latent representation that uses per-frame geometry latents and reference-anchored track latents as dense queries, and (ii) temporal RoPE alignment, which specifies the target timestamp of each track latent. Together, these designs convert the per-frame generative paradigm of video DiTs into a reference-anchored tracking formulation with LoRA fine-tuning. TrackCraft3R achieves state-of-the-art performance on standard sparse and dense 3D tracking benchmarks, while running 1.3x faster and using 4.6x less peak memory than the strongest prior method. We further demonstrate robustness to large motions and long videos.

[41] MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation cs.CVPDF

Qing Cheng, Damiano Bertolini, Wei Zhang, Dong Wang, Niclas Zeller

TL;DR: 本文提出MambaPanoptic，一个完全基于Mamba的视觉架构，用于全景分割任务。该框架通过两个主要贡献解决现有方法的问题：一是引入MambaFPN，一个利用Mamba块以线性计算复杂度生成全局连贯多尺度特征的金字塔网络；二是采用PanopticFCN风格的核生成器，并辅以基于QuadMamba的多阶段特征细化模块，进行无提议的全景预测。

Details

Motivation: 全景分割需要同时识别可数的物体实例和无定形的背景区域，对长程上下文建模、多尺度特征表示和高效密集预测提出了联合需求。现有的卷积和Transformer方法难以同时满足这三项要求：卷积架构在建模长程依赖方面能力有限，而Transformer方法则存在二次计算成本，在高分辨率下难以承受。

Result: 在Cityscapes和COCO全景分割基准测试上的实验表明，MambaPanoptic在可比模型规模下持续优于PanopticDeepLab和PanopticFCN，并且在Cityscapes数据集上的PQ和AP指标上达到或超越了Mask2Former，同时所需参数更少。

Insight: 主要创新点在于将结构化状态空间模型（Mamba）引入全景分割，构建了首个全Mamba框架。具体创新包括：1) 设计MambaFPN以线性复杂度实现长程上下文和多尺度特征的联合建模；2) 将QuadMamba模块集成到特征细化中，增强了无提议预测流程。从客观角度看，该工作展示了Mamba架构在密集预测任务中替代卷积和Transformer的潜力，特别是在平衡性能与计算效率方面。

Abstract: Panoptic segmentation requires the simultaneous recognition of countable thing instances and amorphous stuff regions, placing joint demands on long-range context modelling, multi-scale feature representation, and efficient dense prediction. Existing convolutional and transformer-based methods struggle to satisfy all three requirements concurrently: convolutional architectures are limited in their capacity to model long-range dependencies, while transformer-based methods incur quadratic computational cost that is prohibitive at high resolutions. In this paper, we propose MambaPanoptic, a fully Mamba-based panoptic segmentation framework that addresses these limitations through two principal contributions. First, we introduce MambaFPN, a top-down feature pyramid that leverages Mamba blocks to generate globally coherent, multi-scale feature representations with linear computational complexity. Second, we adopt a PanopticFCN-style kernel generator that produces unified thing and stuff kernels for proposal-free panoptic prediction, enhanced by a QuadMamba-based feature refinement module applied at multiple network stages. Experiments on the Cityscapes and COCO panoptic segmentation benchmarks demonstrate that MambaPanoptic consistently outperforms PanopticDeepLab and PanopticFCN under comparable model sizes, and matches or surpasses Mask2Former on Cityscapes in PQ and AP while requiring fewer parameters.

[42] CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesis cs.CVPDF

Yunsung Chung, Alex El Darzi, Carlo El Khoury, Han Feng, Nassir Marrouche

TL;DR: 本文提出了CRAFT（临床奖励对齐微调）框架，用于将基础扩散模型适配到医学图像合成领域。该方法通过引入临床对齐分数（CAS）作为评估生成图像临床合理性的新指标，并利用基于奖励的微调策略，结合多模态大语言模型和视觉语言模型的医学知识，来减少合成图像中的幻觉和临床不合理内容。

Details

Motivation: 基础扩散模型在生成逼真自然图像方面表现出色，但直接应用于医学成像时，有限的标注数据会加剧幻觉和临床不合理合成问题，且现有评估指标（如FID）无法量化图像与病理相关标准的对齐程度。

Result: 在四种不同的医学成像模态上，CRAFT在临床对齐分数（CAS）和下游分类性能上均优于强基线方法。具体而言，CRAFT将经验低对齐尾部低于真实图像参考阈值的比例相对最强基线降低了5.5-34.7个百分点（平均相对减少20.4%），表明在CAS下幻觉样生成更少。结果在CheXpert数据集上的盲法医师偏好研究等评估中得到证实。

Insight: 创新点包括：1）提出了临床对齐分数（CAS），这是一个基于基础模型的代理指标，从四个互补维度评估生成图像的临床对齐性，超越了视觉保真度；2）设计了CRAFT框架，通过标签条件提示增强、临床检查表和可微分奖励优化，将多模态大模型的医学知识迁移到扩散模型微调中，以奖励驱动的方式提升合成图像的临床合理性。

Abstract: Foundation diffusion models can generate photorealistic natural images, but adapting them to medical imaging remains challenging. In medical adaptation, limited labeled data can exacerbate hallucination-like and clinically implausible synthesis, while existing metrics such as FID or Inception Score do not quantify per-image alignment with pathology-relevant criteria. We introduce the Clinical Alignment Score (CAS), a foundation-model-based proxy for clinical alignment that evaluates generated images along four complementary dimensions beyond visual fidelity. Building on CAS, we propose Clinical Reward-Aligned Finetuning (CRAFT), a reward-based adaptation framework that transfers medical knowledge from multimodal large language models and vision-language models through label-conditioned prompt enrichment, clinical checklists, and differentiable reward optimization. Across four diverse modalities, CRAFT improves CAS and downstream classification performance over strong adaptation baselines. Beyond average CAS gains, CRAFT reduces the empirical low-alignment tail below a real-image reference threshold by 5.5-34.7% points relative to the strongest baseline, corresponding to a 20.4% average relative reduction across datasets. These results indicate fewer hallucination-like generations under CAS, and are corroborated by out-of-family evaluator evaluation, structured checklist auditing, memorization analysis, and a blinded physician preference study on CheXpert.

[43] Visual Aesthetic Benchmark: Can Frontier Models Judge Beauty? cs.CV | cs.AI | cs.HCPDF

Yichen Feng, Yuetai Li, Chunjiang Liu, Yuanyuan Chen, Fengqing Jiang

TL;DR: 本文介绍了视觉美学基准（VAB），该基准将美学评估转化为对具有匹配主题的候选图像集的比较选择。研究发现，现有多模态大语言模型（MLLMs）和视觉质量奖励模型在美学判断任务上表现远低于人类专家水平，且通过少量专家示例微调可显著提升模型性能。

Details

Motivation: 现有美学评估方法通常将美学判断简化为对单张图像的标量分数预测，但研究发现这种分数无法准确反映比较性偏好，因此需要一种基于比较选择的新评估框架。

Result: 在VAB基准上，20个前沿MLLMs和6个专用视觉质量奖励模型中，最强系统仅在26.5%的任务中正确识别最佳和最差图像，远低于人类专家的68.9%。使用2,000个专家示例微调一个35B参数模型，其准确率接近397B参数的开源模型。

Insight: 论文创新点在于提出基于集合比较的美学评估基准VAB，揭示了当前多模态模型与专家美学判断之间的显著差距，并证明比较性信号具有可迁移性，为未来模型改进提供了可追踪的测试平台。

Abstract: Multimodal large language models (MLLMs) are now routinely deployed for visual understanding, generation, and curation. A substantial fraction of these applications require an explicit aesthetic judgment. Most existing solutions reduce this judgment to predicting a scalar score for a single image. We first ask whether such scores faithfully capture comparative preference: in a controlled study with eight expert annotators, score-derived rankings align poorly with the same annotators’ direct comparisons, while direct ranking yields substantially higher inter-annotator agreement on best- and worst-image labels. Motivated by this finding, we introduce the Visual Aesthetic Benchmark (VAB), which casts aesthetic evaluation as comparative selection over candidate sets with matched subject matter. VAB contains 400 tasks and 1,195 images across fine art, photography, and illustration, with labels derived from the consensus of 10 independent expert judges per task. Evaluating 20 frontier MLLMs and six dedicated visual-quality reward models, we find that the strongest system identifies both the best and the worst image correctly across three random permutations of the candidate order in only 26.5% of tasks, far below the 68.9% achieved by human experts. Fine-tuning a 35B-parameter model on 2,000 expert examples brings its accuracy close to that of a 397B-parameter open-weight model, suggesting that the comparative signal in VAB is transferable. Together, these results expose a clear and measurable gap between current multimodal models and expert aesthetic judgment, and VAB provides the first set-based, expert-grounded testbed on which that gap can be tracked and closed.

[44] MMCL-Bench: Multimodal Context Learning from Visual Rules, Procedures, and Evidence cs.CV | cs.AIPDF

Yifan Chen, Fei Yin, Qingyan Bai, Zicheng Lin, Yujiu Yang

TL;DR: 本文介绍了MMCL-Bench，这是一个用于评估多模态上下文学习能力的基准测试，要求模型从视觉或混合模态的教学上下文中学习任务相关的规则、程序和经验模式，并将其应用于新的视觉实例。该基准包含102个任务，涵盖规则系统应用、程序任务执行和经验发现与归纳三类。评估发现，当前前沿多模态模型在此类任务上表现不佳，即使在严格评估下最强模型也只能解决不到三分之一的任务。

Details

Motivation: 解决当前多模态模型在从视觉或混合模态上下文中学习并应用任务相关知识的能力不足的问题，现有基准如纯文本上下文学习或多模态问答无法充分评估这种需要视觉证据定位和推理的复杂能力。

Result: 在MMCL-Bench基准上，当前最强的多模态模型在严格基于规则的评分下，只能解决不到三分之一的任务，表明其远未达到稳健的多模态上下文学习水平。诊断性消融和错误分析显示，失败贯穿于从上下文锚定到响应构建的整个流程。

Insight: 论文的创新点在于提出了首个专注于多模态上下文学习的基准MMCL-Bench，它强调了从视觉材料中提取、定位证据并进行推理的综合能力，揭示了当前模型在此能力上的瓶颈，为未来研究指明了方向。

Abstract: We introduce MMCL-Bench, a benchmark for multimodal context learning: learning task-local rules, procedures, and empirical patterns from visual or mixed-modality teaching context and applying them to new visual instances. Unlike text-only context learning or standard multimodal question answering, this setting requires models to recover and localize relevant evidence from images, screenshots, manuals, videos, and frame sequences before they can reason over the learned context. MMCL-Bench contains 102 tasks spanning three categories: rule system application, procedural task execution, and empirical discovery and induction. We evaluate frontier multimodal models with strict rubric-based scoring and find that current systems remain far from robust multimodal context learning, with even the strongest model solving fewer than one-third of tasks under strict evaluation. Diagnostic ablations and error analysis show that failures arise throughout the context-to-answer pipeline, including context anchoring, visual evidence extraction, context reasoning, and response construction. MMCL-Bench thus highlights multimodal context learning as an important unsolved capability bottleneck for current multimodal models.

[45] Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models cs.CVPDF

Furkan Mumcu, Michael J. Jones, Anoop Cherian, Yasin Yilmaz

TL;DR: 本文质疑当前视频异常检测（VAD）领域的主流研究方向，认为其过度依赖跨场景通用模型、视频级弱监督以及多模态大语言模型（MLLM）的预训练表示，导致模型偏离了真实场景中正常行为的特定性和上下文依赖性。论文通过视觉分析和实证评估，论证了这种趋势会抑制空间定位、引入语义偏见，并将异常检测简化为动作识别。作者主张VAD研究应回归到关注单场景、空间感知且可解释的建模方法，以捕捉个体环境中正常行为的细微结构。

Details

Motivation: 当前VAD研究强调跨场景通用性，但忽视了真实场景中正常行为是高度场景特定和上下文依赖的这一核心特性。主流方法依赖弱监督和MLLM表示，导致模型对语义异常类别敏感，而非对特定环境正常模式的偏离，这不符合实际应用需求。

Result: 通过针对性的视觉分析和实证评估，论文展示了当前主流方法在空间定位、语义偏见和问题简化方面的实际局限性，并论证了单场景、空间感知方法的重要性。

Insight: 创新点在于系统性地批判了当前VAD领域的研究框架，指出其与真实需求（单场景、空间感知、可解释性）的错位，并呼吁研究重心回归到对个体环境内正常行为细微结构的建模。这为未来VAD研究提供了重要的方向性反思和理论依据。

Abstract: Recent video anomaly detection research has expanded rapidly with an emphasis on general models of normality intended to work across many different scenes. While this focus has led to improvements in scalability and multi-scene generalization, it has also shifted the field away from modeling the scene-specific and context-dependent nature of normal behavior. Contemporary approaches frequently rely on video-level weak supervision and opaque pretrained representations from multi-modal large language models (MLLMs), which encourage models to respond to familiar semantic anomaly categories rather than to deviations from the normal patterns of a particular environment. This trend suppresses spatial localization, introduces semantic bias, and reduces anomaly detection to a form of action recognition. In this paper, we examine whether these prevailing formulations align with the core requirements of real-world VAD, which is typically performed within a single scene where normality is determined by local geometry, semantics, and activity patterns. Through targeted visual analyses and empirical evaluations, we demonstrate the practical consequences of these limitations and show that meaningful progress in VAD requires renewed focus on single-scene, spatially-aware, and explainable formulations that capture the nuanced structure of normality within individual environments.

[46] WildPose: A Unified Framework for Robust Pose Estimation in the Wild cs.CVPDF

Jianhao Zheng, Liyuan Zhu, Zihan Zhu, Iro Armeni

TL;DR: WildPose是一个统一的单目相机姿态估计框架，旨在解决动态环境中的鲁棒姿态估计问题。它通过结合前馈模型的丰富感知前端与可微分光束法平差（BA）的端到端优化，利用基于预训练MASt3R特征骨干的3D感知更新算子和多级3D感知特征的运动掩码检测器，在动态、静态和低自运动数据集上均实现了优越性能。

Details

Motivation: 现有的大多数视觉SLAM和SfM方法假设静态场景，在动态环境中估计相机姿态面临挑战；现有的动态感知方法往往不统一，如基于语义的方法脆弱、逐序列优化方法在短序列上失败，而其他学习模型在纯静态场景上可能性能下降。

Result: 在动态基准（Wild-SLAM, Bonn）、静态基准（TUM, 7-Scenes）和低自运动基准（Sintel）上的广泛实验表明，WildPose始终优于先前方法，在静态和低自运动数据集上保持了最先进的性能。

Insight: 论文的创新点在于将前馈模型的感知前端与可微分BA的优化范式统一起来，利用预训练特征骨干的3D感知能力构建更新算子和运动掩码检测器，实现了在动态环境中的鲁棒性而不牺牲静态场景性能。

Abstract: Estimating camera pose in dynamic environments is a critical challenge, as most visual SLAM and SfM methods assume static scenes. While recent dynamic-aware methods exist, they are often not unified: semantic-based approaches are brittle, per-sequence optimization methods fail on short sequences, and other learned models may degrade on static-only scenes. We present WildPose, a unified monocular pose estimation framework that is robust in dynamic environments while maintaining state-of-the-art performance on static and low-ego-motion datasets. Our key insight is to connect two powerful paradigms in modern 3D vision: the rich perceptual frontend of feedforward models and the end-to-end optimization of differentiable bundle adjustment (BA). We achieve this with a 3D-aware update operator built on a frozen, pre-trained MASt3R feature backbone, together with a high-capacity motion mask detector that uses multi-level 3D-aware features from the same backbone. Extensive experiments show WildPose consistently outperforms prior methods across dynamic (Wild-SLAM, Bonn), static (TUM, 7-Scenes), and low-ego-motion (Sintel) benchmarks.

[47] FRAME: Forensic Routing and Adaptive Multi-path Evidence Fusion for Image Manipulation Detection cs.CV | cs.AIPDF

Kaixiang Zhao, Tianrun Yu, Aoxu Zhang, Junhao Su, Porter Jenkins

TL;DR: 本文提出了FRAME方法，用于图像篡改检测。该方法将多种取证算法组织成一个多路径分析空间，为每个输入图像自适应地选择信息丰富的取证路径，并融合互补证据以提高检测和定位性能。

Details

Motivation: 解决现有图像篡改检测方法（无论是手工方法还是基于深度学习的方法）普遍存在的鲁棒性有限、证据碎片化以及跨篡改类型和图像条件的泛化能力弱的问题。

Result: 实验结果表明，FRAME方法在多种篡改场景下均有效。

Insight: 核心创新点在于超越了单一方法分析和固定融合策略，通过构建多路径分析空间和自适应路径选择与证据融合，提供了一种更鲁棒、灵活且可解释的图像取证推理框架。

Abstract: The proliferation of sophisticated image editing tools and generative artificial intelligence models has made verifying the authenticity of digital images increasingly challenging, with important implications for journalism, forensic analysis, and public trust. Although numerous forensic algorithms, ranging from handcrafted methods to deep learning-based detectors, have been developed for manipulation detection, individual methods often suffer from limited robustness, fragmented evidence, or weak generalization across manipulation types and image conditions. To address these limitations, we present \textbf{FRAME}, a method for \textbf{F}orensic \textbf{R}outing and \textbf{A}daptive \textbf{M}ulti-path \textbf{E}vidence fusion for image manipulation detection. FRAME organizes diverse forensic algorithms into a multi-path analysis space, adaptively selects informative forensic paths for each input image, and fuses complementary evidence to improve detection and localization performance. By moving beyond single-method analysis and fixed fusion strategies, FRAME provides a more robust and flexible approach to image forensic reasoning while preserving interpretable forensic cues from multiple evidence sources. Experimental results demonstrate the effectiveness of FRAME across diverse manipulation scenarios. Code is available at \href{https://github.com/kzhao5/FRAME}{https://github.com/kzhao5/FRAME}.

[48] AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects cs.CV | cs.AIPDF

Danrui Li, Jiahao Zhang, Bernhard Egger, Moitreya Chatterjee, Suhas Lohit

TL;DR: 本文提出了AssemblyBench数据集，包含2789个工业对象的合成数据，涵盖多模态说明书、3D零件模型和装配轨迹，并提出了基于Transformer的AssemblyDyno模型，用于联合预测装配顺序和零件装配轨迹。

Details

Motivation: 现有数据集过于简化，忽略了工业装配中的形状复杂性和装配轨迹，因此需要更全面的数据集和模型来支持复杂工业对象的物理感知装配。

Result: AssemblyDyno在装配姿态估计和轨迹可行性方面优于先前工作，后者通过基于物理的模拟进行评估，实现了SOTA性能。

Insight: 创新点在于整合多模态指令和3D形状信息来联合预测装配顺序和轨迹，并通过物理模拟验证轨迹可行性，为工业装配任务提供了更真实的基准。

Abstract: Assembling objects from parts requires understanding multimodal instructions, linking them to 3D components, and predicting physically plausible 6-DoF motions for each assembly step. Existing datasets focus on simplified scenarios, overlooking shape complexities and assembly trajectories in industrial assemblies. We introduce AssemblyBench, a synthetic dataset of 2,789 industrial objects with multimodal instruction manuals, corresponding 3D part models, and part assembly trajectories. We also propose a transformer-based model, AssemblyDyno, which uses the instructional manual and the 3D shape of each part to jointly predict assembly order and part assembly trajectories. AssemblyDyno outperforms prior works in both assembly pose estimation and trajectory feasibility, where the latter is evaluated by our physics-based simulations.

[49] Anatomy-Slot: Unsupervised Anatomical Factorization for Homologous Bilateral Reasoning in Retinal Diagnosis cs.CV | cs.AIPDF

Yingzhe Ma, Xiao Yang, Yuguo Yin, Zheyu Wang

TL;DR: 论文提出Anatomy-Slot方法，通过无监督解剖学瓶颈将视网膜图像分解为解剖槽位，并利用双向交叉注意力对齐双眼间的对应结构，以改进基于双侧同源结构比较的视网膜诊断。

Details

Motivation: 解决现有深度模型主要依赖单眼表示进行视网膜诊断，而临床诊断本质上是双侧的，需要比较双眼间同源结构（如视盘不对称性）的问题。

Result: 在ODIR-5K数据集上，该方法相比匹配的ViT-L基线将AUC提升了4.2%（95%置信区间；Wilcoxon符号秩检验，W=0，p=0.002），并在REFUGE数据集上进行了视盘定位的定量评估。

Insight: 创新点在于引入无监督解剖学槽位分解和跨眼双向交叉注意力对齐机制，实现了对双侧同源结构的显式建模，为医学图像分析中的结构对应性建模提供了新思路。

Abstract: Retinal diagnosis is inherently bilateral: clinicians compare homologous structures across eyes (e.g., optic disc asymmetry), yet most deep models operate on monocular representations. We investigate whether explicit structural correspondence improves diagnosis, and propose Anatomy-Slot to operationalize this hypothesis. Anatomy-Slot introduces an unsupervised anatomical bottleneck by decomposing patch tokens into slots and aligning slots across eyes via bidirectional cross-attention. On ODIR-5K with $n=10$ seeds, the method improves AUC by 4.2% over a matched ViT-L baseline (95% CIs; Wilcoxon signed-rank test, $W=0$, $p=0.002$). Pairing disruption and stress testing under Gaussian noise provide controlled tests of correspondence dependence and robustness under corruption. We further report quantitative optic disc grounding on REFUGE and cross-attention localization analysis.

[50] AuraMask: An Extensible Pipeline for Developing Aesthetic Anti-Facial Recognition Image Filters cs.CV | cs.AI | cs.HCPDF

Jacob Lagogiannis, William Agnew, Rosa I. Arriaga, Sauvik Das

TL;DR: 本文提出AuraMask，一种可扩展的管道，用于开发既具有对抗有效性又符合审美可接受性的反面部识别（AFR）图像滤镜。该方法生成了40种模仿流行Instagram一键滤镜的“审美”滤镜，在对抗开源面部识别模型方面达到或超越了先前方法的有效性，并通过在线用户研究（N=630）证实了其显著更高的用户接受度。

Details

Motivation: 现有AFR滤镜虽然能干扰计算机视觉，但其“微妙”的修改往往仍可见，与用户的自我呈现目标冲突，导致实际使用率低，因此需要开发同时满足对抗有效性和审美可接受性的滤镜。

Result: AuraMask滤镜在对抗开源面部识别模型时，其对抗有效性达到或超越了先前方法；在在线用户研究中，用户接受度显著高于先前方法。

Insight: 创新点在于将审美可接受性作为核心设计目标，通过模仿流行社交媒体滤镜风格来平衡对抗有效性与视觉美观，并提供可扩展的管道以加速社区研究，为实际部署AFR技术提供了新思路。

Abstract: Anti-facial recognition (AFR) image filters alter images in ways that are subtle to people but blinding to computer vision. Yet, despite widespread interest in these technologies to subvert surveillance, users rarely use them in practice – because the subtle'' alterations are visible enough to conflict with users' self-presentation goals. To address this challenge, we propose AuraMask: a novel approach to creating AFR filters that are both adversarially effective and aesthetically acceptable. Using AuraMask, we produce 40 aesthetic’’ filters that emulate popular ``one-click’’ Instagram image filters. We show that AuraMask filters meet or exceed the adversarial effectiveness of prior methods against open-source facial recognition models. Moreover, in a controlled online user study ($N=630$) we confirm these filters achieve significantly higher user acceptance than prior methods. Lastly, we provide our AFR pipeline to the community for accelerated research in adversarially effective and aesthetically acceptable protections.

[51] CRePE: Curved Ray Expectation Positional Encoding for Unified-Camera-Controlled Video Generation cs.CV | cs.AI | cs.LGPDF

Seonghyun Jin, Youngmin Kim, Sunwoo Park, Jong Chul Ye

TL;DR: 本文提出了一种名为CRePE（Curved Ray Expectation Positional Encoding）的位置编码方法，用于统一相机模型（UCM）下的相机条件视频生成。该方法通过将每个图像token表示为沿其源射线的深度感知位置分布，来捕获广角和鱼眼相机引起的投影路径几何，从而提供与UCM兼容的位置编码。CRePE通过一个几何注意力适配器注入到冻结的视频DiTs中，利用单目几何基础模型的伪监督进行稳定，实现了更稳定的相机控制，并在多个几何感知和感知质量指标上有所提升。

Details

Motivation: 现有注意力层级的相机编码要么仅提供射线信号，要么依赖于针孔相机几何，限制了其在统一相机模型（包括广角和鱼眼镜头）下通用相机控制的应用。

Result: CRePE在多个几何感知和感知质量指标上得到改善，同时在视频质量指标上保持竞争力。受控的位置编码消融实验显示，其整体平均排名优于RayRoPE风格的端点PE基线，证明了UCM感知的投影路径集成在不同相机模型中的有效性。

Insight: 创新点在于提出了一个深度感知的、与统一相机模型兼容的位置编码CRePE，通过几何注意力适配器和伪监督机制，将token级的场景距离信息注入到注意力层，从而更好地建模广角和鱼眼相机的投影几何，并支持外部径向图控制和源视频运动迁移。

Abstract: Camera-conditioned video generation requires positional encoding that remains reliable under changes in camera motion, lens configuration, and scene structure. However, existing attention-level camera encodings either provide ray-only camera signals or rely on pinhole camera geometry, limiting their applicability to general camera control under the Unified Camera Model, including wide-angle and fisheye lenses. To address this limitation, we propose Curved Ray Expectation Positional Encoding (CRePE). CRePE represents each image token as a depth-aware positional distribution along its source ray, providing a Unified Camera Model-compatible positional encoding that captures the projected-path geometry induced by wide-angle and fisheye cameras. CRePE is implemented through a Geometric Attention Adapter added to frozen video DiTs, injecting token-wise scene-distance information into selected attention layers and stabilizing it with pseudo supervision from a monocular geometry foundation model. This design leads to more stable camera control and improves several geometry-aware and perceptual-quality metrics, while remaining competitive on video-quality metrics. Controlled positional-encoding ablations show a better overall average rank than a RayRoPE-style endpoint PE baseline, demonstrating the effectiveness of UCM-aware projected-path integration across diverse camera models. Furthermore, by extending the same positional-encoding pathway to external geometry control through Radial MixForcing, CRePE supports external radial-map control for scene-geometry-conditioned generation and source-video motion transfer beyond camera control.

[52] Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation cs.CV | cs.AIPDF

Chao Hao, Jun Xu, Ji Du, Shuo Ye, Ziyue Qiao

TL;DR: 本文提出Seg-Agent，一种无需训练的语言引导分割框架，通过引入显式多模态推理链，在测试时结合视觉反馈进行迭代推理，实现了与基于训练的方法相当的性能。

Details

Motivation: 现有语言引导分割方法依赖大规模数据集训练，且多模态大语言模型的空间定位能力有限，现有推理机制主要局限于文本域，缺乏直接的视觉反馈。

Result: 在提出的新基准Various-LangSeg上进行广泛实验，Seg-Agent实现了与最先进的基于训练方法相当的性能，无需任何参数更新。

Insight: 创新点在于提出了显式多模态推理链，通过Set-of-Mark视觉提示将候选区域直接渲染在图像上，使MLLM能在视觉域进行迭代推理，而非仅依赖抽象文本表示，从而实现了训练无关的高性能分割。

Abstract: Language-guided segmentation transcends the scope limitations of traditional semantic segmentation, enabling models to segment arbitrary target regions based on natural language instructions. Existing approaches typically adopt a two-stage framework: employing Multimodal Large Language Models (MLLMs) to interpret instructions and generate visual prompts, followed by foundational segmentation models (e.g., SAM) to produce masks. However, due to the limited spatial grounding capabilities of off-the-shelf MLLMs, these methods often rely on extensive training on large-scale datasets to achieve satisfactory accuracy. While recent advances have introduced reasoning mechanisms to improve performance, they predominantly operate within the textual domain, performing chain-of-thought reasoning solely based on abstract text representations without direct visual feedback. In this paper, we propose Seg-Agent, a completely training-free framework that pioneers Explicit Multimodal Chain-of-Reasoning. Unlike prior text-only reasoning, our approach constructs an interactive visual reasoning loop comprising three stages: generation, selection, and refinement. Specifically, we leverage Set-of-Mark (SoM) visual prompting to render candidate regions directly onto the image, allowing the MLLM to ``see’’ and iteratively reason about spatial relationships in the visual domain rather than just the textual one. This explicit multimodal interaction enables Seg-Agent to achieve performance comparable to state-of-the-art training-based methods without any parameter updates. Furthermore, to comprehensively evaluate generalization across diverse scenarios, we introduce Various-LangSeg, a novel benchmark covering explicit semantic, generic object, and reasoning-guided segmentation tasks. Extensive experiments demonstrate the effectiveness and robustness of our method.

[53] AdaFocus: Adaptive Relevance-Diversity Sampling with Zero-Cache Look-back for Efficient Long Video Understanding cs.CV | cs.AIPDF

Xiao Yang, Yingzhe Ma, Haoxuan Yu, Zixin Li, Ning Qin

TL;DR: AdaFocus是一个高效的长视频理解框架，通过渐进式证据获取而非一次性编码来平衡时间覆盖、视觉细节和计算效率。它包含查询感知的自适应相关性-多样性采样器（AdaRD）和不确定性触发的零缓存回溯机制，仅在模型不确定时从磁盘检索高分辨率证据。

Details

Motivation: 解决长视频理解中现有方法在密集编码（内存和延迟成本高）与稀疏帧压缩（丢失细粒度证据）之间的权衡困境，实现时间覆盖、视觉细节和计算效率的平衡。

Result: 在七个标准长视频基准测试中，AdaFocus相比传统密集编码在任务性能上提升（如VideoMME准确率+2.59，Charades-STA mIoU +8.39），同时视觉令牌消耗减少约33倍，并通过零缓存设计消除了内存中帧预缓存需求。

Insight: 创新点包括：将长视频理解重构为渐进式证据获取；AdaRD采样器自适应切换全局聚类与局部采样；零缓存I/O设计实现按需证据检索，将丢弃的视觉细节转化为可恢复资源，无需预加载成本。

Abstract: Long video understanding is heavily bottlenecked by a rigid one-shot paradigm: existing methods either densely encode videos at prohibitive memory and latency costs, or aggressively compress them into sparse frame sets that irreversibly discard fine-grained evidence needed for downstream reasoning. Consequently, current models struggle to simultaneously balance temporal coverage, visual details, and computational efficiency. We propose AdaFocus, an efficient framework that rethinks long-video understanding as progressive evidence acquisition rather than one-pass encoding. AdaFocus relies on two tightly coupled components. First, a Query-Aware Adaptive Relevance-Diversity sampler (AdaRD) produces a compact yet informative video preview, adaptively switching to global clustering when the query lacks reliable local grounding. Second, instead of caching exhaustive frame sequences in memory, AdaFocus introduces an uncertainty-triggered refinement mechanism. It performs targeted look-back only when the model is not confident, retrieving high-resolution evidence directly from disk via a zero-cache I/O design. This turns discarded visual details from an irreversible loss into on-demand recoverable evidence without paying the cost of exhaustive preloading. Experiments on seven standard long-video benchmarks show that AdaFocus delivers a substantially better efficiency-accuracy trade-off than strong baselines. Compared with conventional dense encoding, AdaFocus achieves improved task performance (e.g., +2.59 accuracy on VideoMME, +8.39 mIoU on Charades-STA over single-pass inference) while reducing visual token consumption by ~33x and eliminating the need for in-memory frame pre-caching through its zero-cache disk retrieval design. These findings suggest that progressive preview combined with zero-cache evidence refinement is a highly effective paradigm for scalable multimedia reasoning.

[54] GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusion cs.CVPDF

Hanxin Zhu, Cong Wang, Peiyan Tu, Jiayi Luo, Tianyu He

TL;DR: 本文提出了一种名为GTA的新型图像到3D世界生成方法，遵循‘先几何后外观’的范式。该方法采用两阶段框架，首先使用视频扩散模型从新视角生成粗略的几何结构，然后基于预测的几何结构合成细粒度的外观，以解决现有方法因忽视几何建模而导致的结构不可靠和跨视图一致性差的问题。

Details

Motivation: 现有3D世界生成方法通常优先预测外观，而对底层几何建模有限，导致场景结构估计不可靠和跨视图一致性下降。受人类视觉感知从粗到细特性的启发，本文旨在解决这些局限性。

Result: 大量实验表明，所提出的GTA方法在保真度、视觉质量和几何精度方面持续优于现有方法。它还能作为通用增强模块，提升现有图像到3D世界生成流程的质量，并支持多种下游应用，在模型训练中表现出良好的数据效率。

Insight: 核心创新点是‘先几何后外观’的两阶段生成范式，以及用于增强跨视图一致性的随机潜在洗牌训练策略和测试时缩放方案。从客观角度看，该方法将几何建模明确分离并优先处理，为解决3D生成中的结构一致性问题提供了一个系统性的框架，具有通用性和可扩展性。

Abstract: Recent developments in generative models and large-scale datasets have substantially advanced 3D world generation, facilitating a broad range of domains including spatial intelligence, embodied intelligence, and autonomous driving. While achieving remarkable progress, existing approaches to 3D world generation typically prioritize appearance prediction with limited modeling of the underlying geometry, leading to issues such as unreliable scene structure estimation and degraded cross-view consistency. To address these limitations, motivated by the coarse-to-fine nature of human visual perception, we propose GTA, a novel image-to-3D world generation method following a Geometry-Then-Appearance paradigm. Specifically, given a single input image, to improve the structural fidelity of synthesized 3D scenes, GTA adopts a two-stage framework with two dedicated video diffusion models, which first generate coarse geometric structure from novel viewpoints and then synthesize fine-grained appearance conditioned on the predicted geometry. To further enhance cross-view appearance consistency, we introduce a random latent shuffle strategy during the training process, along with a test-time scaling scheme that improves perceptual quality without compromising quantitative performance. Extensive experiments have demonstrated that our proposed method consistently outperforms existing approaches in terms of fidelity, visual quality, and geometric accuracy. Moreover, GTA is shown to be effective as a general enhancement module that further improves the generation quality of existing image-to-3D world pipelines, as well as supporting multiple downstream applications and exhibiting favorable data efficiency during model training, highlighting its versatility and broad applicability. Project page: https://hanxinzhu-lab.github.io/GTA/.

[55] Reducing Bias and Variance: Generative Semantic Guidance and Bi-Layer Ensemble for Image Clustering cs.CV | cs.LGPDF

Feijiang Li, Zhenxiong Li, Jieting Wang, Zizheng Jiu, Saixiong Liu

TL;DR: 本文提出了一种名为GSEC的图像聚类框架，通过生成式语义引导减少偏差，并通过双层集成学习降低方差。该方法利用多模态大语言模型生成语义描述并加权平均得到图像嵌入，同时采用内层BatchEnsemble集成跨模态信息和外层对齐机制整合输出的双层集成策略。实验表明，GSEC在六个基准数据集上超越了18种最先进方法。

Details

Motivation: 现有图像聚类方法通常依赖基于预定义词汇的匹配技术引入语义先验，但有限的匹配空间限制了其在下游聚类任务中的适应性，且主要关注减少偏差而忽视了方差降低的重要性。

Result: GSEC在六个基准数据集上的比较实验显示，其性能超越了18种最先进方法（达到SOTA水平），进一步分析证实了其在同时减少偏差和方差方面的有效性。

Insight: 创新点在于结合生成式语义引导（利用MLLMs动态生成语义描述，而非依赖静态词汇匹配）和双层集成策略（内层集成跨模态信息，外层对齐输出）来协同降低偏差和方差，提升了聚类方法的适应性和鲁棒性。

Abstract: Image clustering aims to partition unlabeled image datasets into distinct groups. A core aspect of this task is constructing and leveraging prior knowledge to guide the clustering process. Recent approaches introduce semantic descriptions as prior information, most of which typically relying on matching-based techniques with predefined vocabularies. However, the limited matching space restricts their adaptability to downstream clustering tasks. Moreover, these methods primarily focus on reducing bias to improve performance, frequently overlooking the importance of variance reduction. To address these limitations, we propose GSEC (Image Clustering based on Generative Semantic Guidance and Bi-Layer Ensemble), a framework designed to reduce bias through generative semantic guidance and mitigate variance via ensemble learning. Our method employs Multimodal Large Language Models to generate semantic descriptions and derive image embeddings via weighted averaging. Additionally, a bi-layer ensemble strategy integrates cross-modal information through BatchEnsemble in the inner layer and aligns outputs via an alignment mechanism in the outer layer. Comparative experiments demonstrate that GSEC outperforms 18 state-of-the-art methods across six benchmark datasets, while further analysis confirms its effectiveness in simultaneously reducing both bias and variance. The code is available at https://github.com/2017LI/GSEC.git.

[56] OCH3R: Object-Centric Holistic 3D Reconstruction cs.CVPDF

Yi Du, Yang You, Xiang Wan, Leonidas Guibas

TL;DR: OCH3R是一个从单张RGB图像进行以物体为中心的整体三维重建的统一框架。它通过一次前向传播，同时预测所有物体实例的6D姿态和详细三维重建，避免了传统多阶段流程的计算开销和分割错误传播问题。

Details

Motivation: 解决现有以物体为中心的场景理解方法依赖多阶段流程（先分割后重建）导致的计算成本高、对分割错误敏感、以及难以扩展至复杂场景的问题。

Result: 在标准室内基准测试上，OCH3R在单目深度估计、开放词汇语义分割和仅使用RGB的类别级6D姿态估计任务上均达到了最先进的性能，并在杂乱场景中实现了数量级的速度提升。

Insight: 核心创新在于使用统一的Transformer架构，通过预测像素级属性（如CLIP嵌入、深度、NOCS和固定数量的3D高斯）来同时表征所有物体，并利用预测的6D姿态将高斯投影到规范空间与预渲染真值对齐，避免了昂贵的逐图像高斯标签生成，实现了前馈式、与物体数量无关的高效推理和高保真重建。

Abstract: Object-centric scene understanding is a fundamental challenge in computer vision. Existing approaches often rely on multi-stage pipelines that first apply pre-trained segmentors to extract individual objects, followed by per-object 3D reconstruction. Such methods are computationally expensive, fragile to segmentation errors, and scale poorly with scene complexity. We introduce OCH3R, a unified framework for Object-Centric Holistic 3D Reconstruction from a single RGB image. OCH3R performs one forward pass to simultaneously predict all object instances with their 6D poses and detailed 3D reconstructions. The key idea is a transformer architecture that predicts per-pixel attributes, including CLIP-based category embeddings, metric depth, normalized object coordinates (NOCS), and a fixed number of 3D Gaussians representing each object. To supervise these Gaussian reconstructions, we transform them into canonical space using the predicted 6D poses and align them with pre-rendered canonical ground truth, avoiding costly per-image Gaussian label generation. On standard indoor benchmarks, OCH3R achieves state-of-the-art performance across monocular depth estimation, open-vocabulary semantic segmentation, and RGB-only category-level 6D pose estimation, while producing high-fidelity, editable per-object reconstructions. Crucially, inference is fully feed-forward and scales independently of the number of objects, offering orders-of-magnitude speedups over conventional multi-stage pipelines in cluttered scenes.

[57] ViDR: Grounding Multimodal Deep Research Reports in Source Visual Evidence cs.CV | cs.IRPDF

Zhuofan Shi, Peilun Jia, Baoqin Sun, Haiyang Shen, Sixiong Xie

TL;DR: 本文提出了ViDR，一个多模态深度研究框架，旨在将长篇报告的生成过程与源图像证据进行有效关联。ViDR将源图像视为可检索、可解释、可路由和可验证的证据对象，通过构建证据索引大纲、对网络图像进行上下文感知过滤和重排序，并结合视觉语言模型进行视觉分析，生成每个章节时使用特定的证据。此外，ViDR还引入了MMR Bench+基准来评估深度研究报告中视觉证据的使用情况。

Details

Motivation: 当前基于文本的深度研究系统主要依赖文本证据，而多模态系统往往对图像检索较弱或自行生成图表，导致源图像证据未被充分利用。ViDR旨在解决这一问题，通过更好地整合源图像证据来增强报告的可靠性和视觉支持。

Result: 实验表明，ViDR在整体报告质量、源图像整合和可验证性方面优于强大的商业和开源基线模型，在MMR Bench+基准上取得了改进。

Insight: ViDR的创新点在于将源图像视为结构化证据对象，并通过上下文感知过滤、大纲感知重排序和VLM视觉分析来优化证据使用，同时引入验证机制减少幻觉或错误放置的图像。这强调了源视觉证据对于多模态深度研究的重要性，可借鉴其证据索引和验证策略来提升多模态生成系统的可靠性。

Abstract: Recent deep research systems have improved the ability of large language models to produce long, grounded reports through iterative retrieval and reasoning. However, most text-centered systems rely mainly on textual evidence, while multimodal systems often retrieve images only weakly or generate charts themselves, leaving source figures underused as evidence. We present ViDR, a multimodal deep research framework that grounds long-form reports in source figures. ViDR treats source figures as retrievable, interpretable, routable, and verifiable evidence objects, while still generating analytical charts when needed. It builds an evidence-indexed outline linking claims to textual and visual evidence, refines noisy web images into source-figure evidence atoms through context-aware filtering, outline-aware reranking, and VLM-based visual analysis, and generates each section with section-specific evidence. ViDR further validates visual references to reduce hallucinated or misplaced figures. We also introduce MMR Bench+, a benchmark for evaluating visual evidence use in deep research reports, covering source-figure retrieval, placement, interpretation, verifiability, and analytical chart generation. Experiments show that ViDR improves overall report quality, source-figure integration, and verifiability over strong commercial and open-source baselines. These results suggest that source visual evidence is important for multimodal deep research, as it strengthens evidential grounding, visual support, and report verifiability.

[58] CoGE: Sim-to-Real Online Geometric Estimation for Monocular Colonoscopy cs.CV | cs.AIPDF

Liangjing Shao, Beilei Cui, Hongliang Ren

TL;DR: 本文提出CoGE框架，用于结肠镜单目在线几何估计（深度估计与场景重建）。该框架通过基于Retinex理论的照明感知监督模块处理不同结肠镜场景的照明变化，并利用基于小波分解的结构感知模块提取结肠的通用结构与局部特征。模型仅在模拟数据上训练，却在模拟和真实场景的几何估计中均达到最先进性能。

Details

Motivation: 结肠镜几何估计对提供3D空间感知与导航至关重要，但结肠狭窄封闭的环境难以获取几何真值，且模拟数据与真实数据因伪影和照明差异存在显著特征鸿沟。

Result: 定量与定性结果表明，所提模型仅在模拟数据上训练，就在模拟和真实场景的几何估计中实现了最先进的性能。

Insight: 创新点包括：基于Retinex理论的照明感知监督模块以应对照明多样性，以及基于小波分解的结构感知模块来提取跨场景的通用结构特征；从客观角度看，该工作通过模拟到真实的在线估计框架，有效缓解了数据获取难题与域差异问题。

Abstract: Geometric estimation including depth estimation and scene reconstruction is a crucial technique for colonoscopy which can provide surgeons with 3D spatial perception and navigation. However, geometric ground truth in colonoscopy is difficult to obtain due to narrow and enclosed space of the colon, while there is a large feature gap between simulated data and realistic data caused by artifacts and illumination. In this paper, we present CoGE, a novel framework for online monocular geometric estimation during colonoscopy. Firstly, we propose an illumination-aware supervision module based on the Retinex theory to address illumination diversity in different colonoscopy scenes. Moreover, a structure-aware perception module is proposed based on wavelet decomposition to extract common structural and local features of the colon. Both quantitative and qualitative results demonstrate that the proposed model solely trained on simulated data achieves state-of-the-art performance in geometric estimation for both simulated and realistic scenes.

[59] Revealing the Gap in Human and VLM Scene Perception through Counterfactual Semantic Saliency cs.CV | cs.AIPDF

Ziqi Wen, Parsa Madinei, Miguel P. Eckstein

TL;DR: 本文提出了一种名为Counterfactual Semantic Saliency (CSS)的黑盒、模型无关框架，用于评估大型视觉语言模型(VLMs)与人类在高层次语义场景理解上的对齐程度。通过因果消融场景中的对象并测量其引发的语义偏移，该框架量化了对象的重要性。研究基于包含307个复杂自然场景和1,306个高保真反事实变体的人类心理物理学基线（16,289个有效响应），测试了多个主流VLMs，揭示了模型与人类之间存在普遍的场景理解差距。

Details

Motivation: 评估大型视觉语言模型(VLMs)在高层次语义场景理解上是否与人类感知对齐仍然是一个挑战。传统的白盒可解释性方法不适用于闭源架构，而被动的度量标准无法分离因果特征。

Result: 在人类心理物理学基线（307个复杂自然场景，1,306个反事实变体，16,289个有效响应）上测试了多个主流VLMs。分析表明，模型与人类存在普遍的场景理解差距：模型（相对于人类）过度依赖大物体（尺寸偏差）、图像中心的物体（中心偏差）和高显著性物体；相反，模型在描述图像时比人类参与者更少依赖场景中的人物。模型的尺寸偏差是解释模型与人类语义差异变化的主要驱动因素。

Insight: 创新点在于提出了Counterfactual Semantic Saliency (CSS)这一黑盒、模型无关的评估框架，通过因果干预量化对象对模型输出的重要性，从而系统性地揭示了VLMs与人类在场景感知上的具体偏差模式（如尺寸偏差、中心偏差）。该方法为评估和诊断AI模型与人类认知的对齐提供了新的可解释性工具。

Abstract: Evaluating whether large vision-language models (VLMs) align with human perception for high-level semantic scene comprehension remains a challenge. Traditional white-box interpretability methods are inapplicable to closed-source architectures and passive metrics fail to isolate causal features. We introduce Counterfactual Semantic Saliency (CSS). This black-box, model-agnostic framework quantifies the importance of objects by measuring the semantic shift induced by their causal ablation from a scene. To evaluate AI-human semantic alignment, we tested prominent VLMs against a human psychophysics baseline comprising 16,289 valid responses across 307 complex natural scenes and 1,306 high-fidelity counterfactual variants. Our analysis reveals a pervasive scene comprehension gap: models exhibit an overreliance (relative to humans) on large objects (size bias), objects at the center of the image (center bias), and high saliency objects. In contrast, models rely less on people in the scenes than our human participants to describe the images. A model’s size bias is a primary driver explaining variations in model-human semantic divergence. Code and data will be available at https://github.com/starsky77/Counterfactual-Semantic-Saliency.

Guangqian Yang, Tong Ding, Wenlong Hou, Yue Xun, Ye Du

TL;DR: 本文提出了BrainAnytime，一个用于脑图像分析的统一预训练框架。该框架通过跨模态蒸馏和基于图谱的课程掩码策略，在共享的3D掩码自编码器架构上进行预训练，使其能够处理任意可用模态（从单一T1扫描到完整多模态组合）的输入，从而适应临床实践中常见的异质且不完整的模态子集。

Details

Motivation: 临床诊断流程中，患者通常接受不同且不完整的成像模态子集，而现有AI模型大多假设输入模态固定。本文旨在解决在任意模态可用性下进行脑图像分析的挑战。

Result: 在四个下游任务和五种临床驱动的模态设置下，BrainAnytime在大多数模态设置上显著优于模态专用模型、缺失模态基线以及大规模脑MRI预训练基础模型。例如，在CN vs. AD和CN vs. MCI分类任务中，其平均准确率分别比最强的缺失模态基线相对提升了6.2%和7.0%。

Insight: 主要创新点在于提出了一个统一的、模态灵活的预训练框架，结合了跨模态蒸馏（RCMD）来学习MRI与PET之间的结构-分子对应关系，以及图谱引导的课程掩码（PACM）来优先关注疾病易感解剖区域。这为处理临床现实中不完整的多模态数据提供了新思路。

Abstract: Clinical diagnostic workups typically follow a modality escalation pathway: after initial clinical evaluation, clinicians begin with routine structural imaging (e.g., MRI), selectively add sequences such as FLAIR or T2 to refine the differential, and reserve molecular imaging (e.g., amyloid-PET) for cases that remain uncertain after standard evaluation. Consequently, patients are observed with heterogeneous and often incomplete modality subsets. However, most current AI models assume fixed data modalities as the model inputs. In this paper, we present BrainAnytime, a unified pretraining framework pretrained on 34,899 3D brain scans from five datasets that support brain image analysis under arbitrary modality availability spanning multi-sequence MRI and amyloid-PET. A single model accepts whatever imaging is available, from a lone T1 scan to a full multimodal workup. Pretraining learns structural-molecular correspondences between MRI and PET via cross-modal distillation (RCMD) and prioritizes disease-vulnerable anatomy via atlas-guided curriculum masking (PACM), all within a shared 3D masked autoencoder (Multi-MAE3D). Across four downstream tasks and five clinically motivated modality settings, BrainAnytime largely outperforms modality-specific models, missing-modality baselines, and large-scale brain MRI pretrained foundation models on most modality settings. Notably, it surpasses the strongest missing-modality baselines with relative improvements of 6.2% and 7.0% in average accuracy on CN vs. AD and CN vs. MCI classification, respectively. Code is available at https://github.com/SDH-Lab/BrainAnytime.

[61] Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling cs.CVPDF

Xuehai Bai, Yang Shi, Yi-Fan Zhang, Xuanyu Zhu, Yuran Wang

TL;DR: 本文提出了Edit-Compass和EditReward-Compass，这是一个用于图像编辑和奖励建模的统一评估套件。Edit-Compass包含2,388个精心标注的实例，涵盖六个难度递增的任务类别，用于评估图像编辑模型；EditReward-Compass包含2,251个偏好对，用于模拟强化学习优化中的实际奖励建模场景。

Details

Motivation: 现有图像编辑基准由于任务难度有限和评估协议粗糙，无法准确反映人类判断，尤其是对于前沿模型；同时，现有奖励模型基准依赖于不切实际的评估设置，偏离了实际强化学习场景，这些限制阻碍了对图像编辑模型和奖励模型的可靠评估。

Result: 论文构建了包含2,388个实例的Edit-Compass基准和2,251个偏好对的EditReward-Compass基准，采用基于结构化推理和精心设计评分规则的细粒度多维评估框架，但摘要未提及具体定量结果或与SOTA的比较。

Insight: 创新点在于提出了一个统一的、细粒度的评估套件，覆盖了从世界知识推理到多图像编辑的渐进挑战性任务，并模拟了实际强化学习优化中的奖励建模场景，为图像编辑和奖励模型提供了更可靠和实用的评估基准。

Abstract: Recent image editing models have achieved remarkable progress in instruction following, multimodal understanding, and complex visual editing. However, existing benchmarks often fail to faithfully reflect human judgment, especially for strong frontier models, due to limited task difficulty and coarse-grained evaluation protocols. In parallel, reward models have become increasingly important for RL-based image editing optimization, yet existing reward model benchmarks still rely on unrealistic evaluation settings that deviate from practical RL scenarios. These limitations hinder reliable assessment of both image editing models and reward models. To address these challenges, we introduce Edit-Compass and EditReward-Compass, a unified evaluation suite for image editing and reward modeling. Edit-Compass contains 2,388 carefully annotated instances spanning six progressively challenging task categories, covering capabilities such as world knowledge reasoning, visual reasoning, and multi-image editing. Beyond broad task coverage, Edit-Compass adopts a fine-grained multidimensional evaluation framework based on structured reasoning and carefully designed scoring rubrics. In parallel, EditReward-Compass contains 2,251 preference pairs that simulate realistic reward modeling scenarios during RL optimization.

[62] HarmoGS: Robust 3D Gaussian Splatting in the Wild via Conflict-Aware Gradient Harmonization cs.CVPDF

Yulei Kang, Tianze Zhu, Jian-Fang Hu, Jianhuang Lai, Wei-Shi Zheng

TL;DR: 本文提出了HarmoGS，一种用于野外场景的鲁棒3D高斯溅射框架，旨在解决由瞬时干扰物和光照引起的跨视图外观不一致性所带来的挑战。该方法通过语义一致性引导的掩码学习和冲突感知的梯度协调策略，从图像空间监督和梯度级优化两个层面处理跨视图梯度冲突，从而稳定高斯优化并提升重建质量。

Details

Motivation: 野外3D高斯溅射面临瞬时干扰物和光照不一致的挑战，现有基于图像级掩码的方法无法完全消除残留遮挡或解决光照不一致性，导致跨视图梯度冲突，进而破坏高斯优化并产生重建伪影。

Result: 在标准野外场景基准测试上的大量实验表明，该方法在复杂瞬时干扰物和跨视图不一致条件下，实现了最先进的渲染质量。

Insight: 创新点在于从梯度层面协调冲突，提出了语义一致性引导的掩码学习和双视图冲突感知梯度协调策略，将特定视图梯度旋转至正交配置以减少干扰，并引入了冲突感知的致密化和剪枝以稳定高斯基元管理。

Abstract: In-the-wild 3D Gaussian Splatting remains challenging due to transient distractors and illumination-induced cross-view appearance inconsistencies. Existing methods mainly rely on image-level masking to suppress unreliable supervision, but masking alone cannot fully eliminate residual occlusions or resolve illumination-induced inconsistencies, both of which can introduce conflicting cross-view gradients. These unresolved conflicts may destabilize Gaussian optimization and lead to visible reconstruction artifacts. We propose a conflict-aware 3DGS framework that addresses this problem from both image-space supervision and gradient-level optimization. Semantic Consistency-Guided Masking learns pixel-wise consistency scores to adaptively refine prior masks and suppress unreliable supervision before gradient formation. A dual-view Conflict-Aware Gradient Harmonization strategy further reconciles view-specific gradients by mutually rotating them into an orthogonal configuration, reducing negative directional interference across views. We also introduce conflict-aware densification and pruning to stabilize Gaussian growth and remove persistently conflicting primitives. Extensive experiments on standard in-the-wild benchmarks demonstrate that our method achieves state-of-the-art rendering quality under complex transient distractors and cross-view inconsistencies.

[63] Learning to See What You Need: Gaze Attention for Multimodal Large Language Models cs.CVPDF

Junha Song, Byeongho Heo, Geonmo Gu, Jaegul Choo, Dongyoon Han

TL;DR: 本文提出了一种名为Gaze Attention的新颖注意力机制，用于多模态大语言模型（MLLMs）。该机制通过将视觉嵌入空间分组为紧凑的注视区域，并在每个解码步骤中动态选择最相关的区域进行注意力计算，从而减少冗余计算并增强模型对任务相关视觉区域的关注。同时，通过引入可学习的上下文令牌来弥补局部注意力可能导致的全局上下文损失。

Details

Motivation: 当前的多模态大语言模型在生成描述时，通常对所有视觉令牌进行均匀处理，这导致注意力分散和不必要的计算开销。而人类在描述视觉场景时，会选择性地注视与描述意图相关的区域。因此，本文旨在模拟人类的视觉注意机制，使MLLMs能够更高效、更聚焦地处理视觉信息。

Result: 在图像和视频理解基准测试上的广泛实验表明，Gaze Attention在注意力计算中使用的视觉KV条目减少了高达90%的情况下，其性能与密集注意力基线相当或更优。

Insight: 创新点在于引入了动态选择视觉区域的注意力机制，模拟人类注视行为，并结合可学习的上下文令牌以保持全局视觉感知。这为多模态模型的高效注意力设计提供了新思路，特别是在减少计算开销的同时保持或提升性能方面具有借鉴意义。

Abstract: When humans describe a visual scene, they do not process the entire image uniformly; instead, they selectively fixate on regions relevant to their intended description. In contrast, current multimodal large language models (MLLMs) attend to all visual tokens at each generation step, leading to diluted focus and unnecessary computational overhead. In this work, we introduce Gaze Attention, a novel mechanism that enables MLLMs to selectively attend to task-relevant visual regions during generation. Specifically, we spatially group visual embeddings-stored as key-value caches-into compact gaze regions, each represented by a lightweight descriptor. At each decoding step, the model dynamically selects the most relevant regions and restricts attention to them, reducing redundant computation while enhancing focus. To mitigate the loss of global context caused by localized attention, we further propose learnable context tokens appended to each image or frame, allowing the model to maintain holistic visual awareness. Extensive experiments on image and video understanding benchmarks demonstrate that Gaze Attention matches or surpasses dense-attention baselines, while using up to 90% fewer visual KV entries in the attention computation.

[64] PRA-PoE: Robust Alzheimer’s Diagnosis with Arbitrary Missing Modalities cs.CVPDF

Guangqian Yang, Ye Du, Wenlong Hou, Qian Niu, Shujun Wang

TL;DR: 本文提出了一种名为PRA-PoE的不完整多模态学习框架，用于鲁棒的阿尔茨海默病诊断。该框架通过原型锚定表示对齐（PRA）和不确定性感知专家乘积（UA-PoE）融合机制，处理训练与部署中模态缺失模式不匹配导致的表示偏移问题，并在自然缺失数据上训练、所有非空模态组合上测试的临床现实协议下进行评估。

Details

Motivation: 解决现实世界阿尔茨海默病评估中普遍存在的模态缺失问题，特别是当训练和部署时观察到的模态子集分布不同时，缺失模式不匹配会导致跨模态子集的条件表示偏移，而现有基于隐式插补或模态合成的方法未能显式建模模态可用性和不确定性，导致对合成特征的过度依赖、鲁棒性降低和不确定性估计失准。

Result: 在ADNI数据集上，PRA-PoE相比最强基线在所有非空模态子集上平均准确率相对提升5.4%；在OASIS-3数据集上，平均F1分数相对提升10.9%，均优于现有最先进方法（SOTA）。

Insight: 创新点包括：1）使用可学习的全局原型和可用性条件令牌来编码模态可用性、区分观察与缺失模态、重新合成缺失模态特征，并自适应细化观察表示以对齐跨模态子集的潜在空间，减少表示偏移；2）将每个模态建模为高斯专家，并通过封闭形式的专家乘积融合，其中不确定性较高的专家通过较低精度自动降权，提高不确定性可靠性。从客观角度看，该方法显式处理模态缺失和不确定性，增强了多模态学习在临床现实场景中的鲁棒性和校准性。

Abstract: Missing modalities are prevalent in real-world Alzheimer’s disease (AD) assessment and pose a significant challenge to multimodal learning, particularly when the distribution of observed modality subsets differs between training and deployment. Such missingness pattern mismatch induces a conditional representation shift across modality subsets. Existing approaches that rely on implicit imputation or modality synthesis often fail to explicitly model modality availability and uncertainty, leading to overconfident dependence on synthesized features, reduced robustness, and miscalibrated uncertainty estimates. To address these limitations, we propose PRA-PoE, an incomplete multimodal learning framework that is equipped with Prototype-anchored Representation Alignment (PRA) and an Uncertainty-aware Product of Experts (UA-PoE) fusion mechanism. First, PRA uses learnable global prototypes and availability-conditioned tokens to encode modality availability, distinguish observed from missing modalities, re-synthesize features for missing modalities, and adaptively refine observed representations to align latent spaces across modality subsets, with the goal of reducing representation shift under varying missingness patterns. Second, UA-PoE models each modality as a Gaussian expert and performs closed-form Product of Experts fusion, where experts with higher uncertainty are automatically down-weighted via lower precision, improving uncertainty reliability. We evaluate PRA-PoE under a clinically realistic protocol by training with naturally missing data and testing on all non-empty modality combinations. PRA-PoE consistently outperforms the state-of-the-art across datasets, achieving a 5.4% relative improvement in average accuracy on ADNI and a 10.9% relative gain in average F1 on OASIS-3 over the strongest baseline across all non-empty modality subsets.

[65] RoSplat: Robust Feed-Forward Pixel-wise Gaussian Splatting for Varying Input Views and High-Resolution Rendering cs.CVPDF

Hoang Chuong Nguyen, Renjie Wu, Jose M. Alvarez, Miaomiao Liu

TL;DR: 本文提出了RoSplat方法，旨在解决现有基于像素的前馈式3D高斯溅射方法在推理时输入视图数量变化导致的渲染过亮问题，以及高斯尺度估计不准确导致高分辨率渲染中出现空洞伪影的问题。方法包括一个简单的alpha归一化策略以保持亮度一致性，以及一个基于3D采样的辅助正则化器来改进高斯尺度估计。

Details

Motivation: 现有像素级前馈式3D高斯溅射方法在输入视图数量变化时会产生过亮渲染，且高斯尺度估计监督不足导致高分辨率渲染出现空洞伪影，本文旨在解决这两个问题。

Result: 在基准数据集上的实验表明，该方法在输入视图数量变化和高分辨率渲染设置下显著改进了基线模型。

Insight: 创新点在于识别出过亮问题源于重叠高斯数量的变化，并提出了alpha归一化策略；同时引入基于3D采样的辅助正则化器来改进高斯尺度估计，从而提升渲染鲁棒性和质量。

Abstract: Generalizable 3D Gaussian Splatting has recently emerged as an efficient approach for novel-view synthesis, enabling feed-forward synthesis from only a few input views. However, existing pixel-wise feed-forward methods suffer from over-bright renderings when the number of input views varies during inference, as well as insufficient supervision for accurate Gaussian scale estimation, which leads to hole artifacts, particularly in high-resolution renderings. To address these issues, we identify that the over-brightness is caused by the varying number of overlapping Gaussians and propose a simple alpha normalization strategy to maintain brightness consistency across different number of input views. In addition, we introduce an auxiliary 3D sampling-based regularizer to improve Gaussian scale estimation, thereby mitigating hole artifacts in high-resolution rendering. Experiments on benchmark datasets demonstrate that our method significantly improves baseline models under varying input-view and high-resolution rendering settings.

[66] Pyramid Forcing: Head-Aware Pyramid KV Cache Policy for High-Quality Long Video Generation cs.CVPDF

Jiayu Chen, Junbei Tang, Wenbiao Zhao, Maoliang Li, Jiayi Luo

TL;DR: 本文提出了一种名为Pyramid Forcing的头部感知金字塔KV缓存框架，用于解决自回归视频生成中长期退化的问题。该方法通过离线识别注意力头部的三种不同类型（锚点头、波动头和面纱头），并为每种类型分配特定的缓存策略，实现了异构的缓存长度管理，从而提升了长视频生成的质量。

Details

Motivation: 现有KV缓存策略通常采用统一的历史帧保留方式，隐含假设所有注意力头具有同质的历史依赖性，这无法有效缓解自回归视频生成中因误差累积导致的长时退化问题。

Result: 在VBench-Long基准测试中，Pyramid Forcing将60秒Self Forcing的得分从77.87提升至81.21，并在运动动态、视觉保真度和语义一致性方面均有改善，证明了其有效性。

Insight: 核心创新在于揭示了注意力头在历史帧依赖上的异质性，并据此设计了头感知的、支持异构缓存长度的金字塔KV缓存策略。这为优化长序列生成模型的记忆机制提供了新的视角和高效实现方案。

Abstract: Autoregressive video generation enables streaming and open-ended long video synthesis, but still suffers from long-term degradation caused by accumulated errors. Existing KVCache strategies usually apply unified historical-frame retention, implicitly assuming homogeneous historical dependencies across attention heads. We revisit historical-frame attention and reveal three distinct head types: Anchor Heads require broad long-range context, Wave Heads exhibit periodic temporal dependencies, and Veil Heads focus on initial and adjacent frames. Based on this finding, we propose Pyramid Forcing, a head-aware pyramidal KVCache framework that identifies head types offline, assigns behavior-specific cache policies, and supports heterogeneous cache lengths via efficient ragged-cache attention. Experiments on Self Forcing and Causal Forcing show that Pyramid Forcing consistently improves long-horizon generation quality on VBench-Long, increasing the 60-second Self Forcing score from 77.87 to 81.21 while enhancing motion dynamics, visual fidelity, and semantic consistency. Project: https://if-lab-pku.github.io/Pyramid-Forcing/.

Sangin Lee, Seokjun Kwon, Jeongmin Shin, Namil Kim, Yukyung Choi

TL;DR: 本文提出了一种名为MS-DePro的多模态引导多源域自适应目标检测方法，该方法通过深度引导定位和多模态引导提示学习，利用深度图和文本等域无关输入模态来编码域无关特征，以提升目标域中与训练分布不同的物体检测性能。

Details

Motivation: 解决通用目标检测在目标域与训练分布不同时性能下降的问题，现有MSDA方法从域特定的RGB图像中学习域无关特征，但保留了域无关特征图中的域特定信息，存在矛盾。

Result: 在MSDA基准测试中达到了最先进的性能，综合消融实验证明了所提方法的有效性。

Insight: 创新点在于利用深度图生成域无关区域建议进行定位，并整合多模态特征以对齐可学习文本嵌入进行分类，从而更有效地分离域特定和域无关信息，提升跨域检测的泛化能力。

Abstract: General object detection (OD) struggles to detect objects in the target domain that differ from the training distribution. To address this, recent studies demonstrate that training from multiple source domains and explicitly processing them separately for multi-source domain adaptation (MSDA) outperforms blending them for unsupervised domain adaptation (UDA). However, existing MSDA methods learn domain-agnostic features from domain-specific RGB images while preserving domain-specific information from the domain-agnostic feature map. To address this, we propose MS-DePro: Multi-Source Detector with Depth and Prompt, composed of (1) depth-guided localization and (2) multi-modal guided prompt learning. We leverage domain-agnostic input modalities, namely depth maps and text, to encode domain-agnostic characteristics. Specifically, we utilize depth maps to generate domain-agnostic region proposals for localization and integrate multi-modal features to align learnable text embeddings for classification. MS-DePro achieves state-of-the-art performance on MSDA benchmarks, and comprehensive ablations demonstrate the effectiveness of our contributions. Our code is available on https://github.com/sejong-rcv/Multi-Modal-Guided-Multi-Source-Domain-Adaptation-for-Object-Detection.

[68] EvObj: Learning Evolving Object-centric Representations for 3D Instance Segmentation without Scene Supervision cs.CV | cs.AI | cs.LG | cs.ROPDF

Jiahao Chen, Zihui Zhang, Yafei Yang, Jinxi Li, Shenxing Wei

TL;DR: EvObj是一种无监督的3D实例分割方法，旨在解决合成预训练数据与真实点云之间的几何域差距问题。该方法通过动态优化对象候选和补全部分几何结构，实现了在无需场景监督的情况下，将对象先验知识从合成数据集（如ShapeNet）有效迁移到真实扫描数据（如ScanNet）。

Details

Motivation: 当前方法在将对象先验从合成数据集迁移到真实点云时，由于形态变化和遮挡伪影导致结构差异，性能受限。EvObj旨在克服这一几何域差距，实现无监督的3D实例分割。

Result: 在真实和合成数据集上的广泛实验表明，EvObj在所有基线方法中表现出优越的3D对象分割性能，并达到了最先进（SOTA）水平。

Insight: 创新点包括：动态优化对象候选的对象辨别模块，以及发现对象后重建部分几何的对象补全模块。从客观角度看，该方法通过结合自适应先验调整和几何补全，有效提升了无监督3D实例分割的鲁棒性和准确性。

Abstract: We introduce EvObj for unsupervised 3D instance segmentation that bridges the geometric domain gap between synthetic pretraining data and real-world point clouds. Current methods suffer from structural discrepancies when transferring object priors from synthetic datasets (e.g., ShapeNet) to real scans (e.g., ScanNet), particularly due to morphological variations and occlusion artifacts. To address this, EvObj integrates two innovative modules: (1) An object discerning module that dynamically refines object candidates, enabling continuous adaptation of object priors to target domains; and (2) An object completion module that reconstructs partial geometries after discovering objects. We conduct extensive experiments on both real-world and synthetic datasets, demonstrating superior 3D object segmentation performance over all baselines while achieving state-of-the-art results.

[69] Dual-Pathway Circuits of Object Hallucination in Vision-Language Models cs.CVPDF

Jiaxin Liu, Ding Zhong, Yue Wang, Zhidong Yang, Zhaolu Kang

TL;DR: 本文提出了一种名为双通路电路分析（Dual-Pathway Circuit Analysis）的框架，用于识别和理解视觉语言模型（VLMs）中导致物体幻觉（object hallucination）的机制。该框架通过激活修补技术，在五种不同架构的VLMs中识别出支持正确预测的视觉基础通路和驱动错误输出的幻觉通路，并进一步通过条件通路分析揭示了通路间的交互模式。研究表明，对幻觉通路组件进行针对性抑制，可显著减少幻觉现象，且该电路在不同架构和幻觉类型间具有选择性的可迁移性。

Details

Motivation: 视觉语言模型（VLMs）虽然能力强大，但经常产生物体幻觉（即描述输入图像中不存在的内容），这限制了其可靠性和可解释性。本文旨在从机制上理解和解决这一问题。

Result: 在POPE-adversarial和AMBER基准上的评估表明，所识别的电路在不同模型架构中保持一致，支持因果干预。通过针对性抑制幻觉通路组件，物体幻觉最多可减少76%，且准确性损失最小。该电路可选择性迁移到关系幻觉，但不适用于属性幻觉。

Insight: 创新点在于提出了一个用于机制性理解VLM幻觉的双通路电路分析框架，特别是引入了条件通路分析（CPA）来刻画通路级交互，并发现基础组件在正确与幻觉样本中均保持强冗余性，但会发生一致的极性翻转。这为通过针对性干预减少幻觉提供了可解释的因果路径，且证明了幻觉电路在不同任务间的选择性迁移特性。

Abstract: Vision-language models (VLMs) have demonstrated remarkable capabilities in bridging visual perception and natural language understanding, enabling a wide range of multimodal reasoning tasks. However, they often produce object hallucinations, describing content absent from the input image, which limits their reliability and interpretability. To address this limitation, we propose Dual-Pathway Circuit Analysis, a framework that identifies and characterizes hallucination-related circuits in VLMs for mechanistic understanding and causal probing. We first apply activation patching across five architecturally diverse VLMs to identify a visual grounding pathway that supports correct predictions and a hallucination pathway that drives erroneous outputs. We then introduce Conditional Pathway Analysis (CPA) to characterize pathway-level interactions, revealing that grounding components remain strongly redundant in both correct and hallucinating samples but undergo a consistent polarity flip, shifting from supporting the ground truth on correct samples to aligning with the hallucinated answer on erroneous ones. We further perform targeted suppression of hallucination-pathway components, showing that scaling these components reduces object hallucination by up to 76% with minimal accuracy cost, and validate that the same circuit selectively transfers to relational but not attribute hallucination. Evaluations on POPE-adversarial and AMBER show that the identified circuits are consistent across architectures, support causal intervention, and transfer selectively across hallucination types.

[70] A$_3$B$_2$: Adaptive Asymmetric Adapter for Alleviating Branch Bias in Vision-Language Image Classification with Few-Shot Learning cs.CV | cs.LGPDF

Yiyun Zhou, Zhonghua Jiang, Wenkang Han, Kunxi Li, Mingjing Xu

TL;DR: 本文提出了一种名为A$_3$B$_2$的自适应非对称适配器，用于缓解视觉-语言模型在少样本图像分类中存在的分支偏差问题。该方法通过不确定性感知的适配器阻尼机制，在预测不确定性高时自动抑制图像分支的适应，并结合轻量级非对称架构与负载均衡正则化，在多个少样本分类任务上超越了现有基于提示和适配器的基线方法。

Details

Motivation: 现有的大规模视觉-语言模型（如CLIP）少样本迁移方法通常遵循固定的微调范式，隐含地假设图像和文本分支具有同等重要性。本文通过分析揭示了视觉-语言图像分类中存在的分支偏差问题：在分布外场景下，适应图像编码器并不总能提升性能。

Result: 在涵盖11个数据集的三个少样本图像分类任务上的大量实验表明，A$_3$B$_2$持续优于11个基于提示和适配器的竞争性基线方法。

Insight: 核心创新点在于揭示了分支偏差问题，并提出了不确定性感知适配器阻尼（UAAD）机制，实现了无需人工干预的、数据驱动的软性控制。其架构设计借鉴了专家混合思想，采用轻量级非对称设计并辅以负载均衡正则化，以高效缓解偏差。

Abstract: Efficient transfer learning methods for large-scale vision-language models ($e.g.$, CLIP) enable strong few-shot transfer, yet existing adaptation methods follow a fixed fine-tuning paradigm that implicitly assumes a uniform importance of the image and text branches, which has not been systematically studied in image classification. Through extensive analysis, we reveal a Branch Bias issue in vision-language image classification: adapting the image encoder does not always improve performance under out-of-distribution settings. Motivated by this observation, we propose A$_3$B$_2$, an Adaptive Asymmetric Adapter that alleviates Branch Bias in few-shot learning. A$_3$B$_2$ introduces Uncertainty-Aware Adapter Dampening (UAAD), which automatically suppresses image-branch adaptation when prediction uncertainty is high, enabling soft and data-driven control without manual intervention. Architecturally, A$_3$B$_2$ adopts a lightweight asymmetric design inspired by mixture-of-experts with Load Balancing Regularization. Extensive experiments on three few-shot image classification tasks across 11 datasets demonstrate that A$_3$B$_2$ consistently outperforms 11 competitive prompt- and adapter-based baselines.

[71] PanoWorld: Towards Spatial Supersensing in 360$^\circ$ Panorama World cs.CV | cs.AIPDF

Changpeng Wang, Xin Lin, Junhan Liu, Yuheng Liu, Zhen Wang

TL;DR: 本文提出了PanoWorld，一个用于360度全景图像空间超感知的多模态大语言模型。它通过引入球面空间交叉注意力机制，将球面几何结构显式注入视觉流，并构建了大规模、几何感知、语言对齐的指令调优数据集，以支持全景原生理解。

Details

Motivation: 当前多模态大语言模型在主导的透视图像范式下，因继承人类狭窄视野而难以进行空间理解。对于导航、机器人搜索和3D场景理解，360度全景感知能一次性捕获整个环境，但现有方法通常将全景图分解为多个透视视图，忽略了等距柱状投影的球面结构。

Result: PanoWorld在PanoSpace-Bench、H* Bench和R2R-CE Val-Unseen基准测试中显著优于专有和开源基线模型，证明了其在全景空间推理任务上的有效性。

Insight: 论文的创新点在于提出了‘全景原生理解’的概念，并定义了其关键能力；构建了大规模、几何感知的指令调优数据生成流程；以及设计了显式编码球面几何的Spherical Spatial Cross-Attention机制，为全景空间推理提供了专用监督和模型适配方案。

Abstract: Multimodal large laboratory models (MLLMs) still struggle with spatial understanding under the dominant perspective-image paradigm, which inherits the narrow field of view of human-like perception. For navigation, robotic search, and 3D scene understanding, 360-degree panoramic sensing offers a form of supersensing by capturing the entire surrounding environment at once. However, existing MLLM pipelines typically decompose panoramas into multiple perspective views, leaving the spherical structure of equirectangular projection (ERP) largely implicit. In this paper, we study pano-native understanding, which requires an MLLM to reason over an ERP panorama as a continuous, observer-centered space. To this end, we first define the key abilities for pano-native understanding, including semantic anchoring, spherical localization, reference-frame transformation, and depth-aware 3D spatial reasoning. We then build a large-scale metadata construction pipeline that converts mixed-source ERP panoramas into geometry-aware, language-grounded, and depth-aware supervision, and instantiate these signals as capability-aligned instruction tuning data. On the model side, we introduce PanoWorld with Spherical Spatial Cross-Attention, which injects spherical geometry into the visual stream. We further construct PanoSpace-Bench, a diagnostic benchmark for evaluating ERP-native spatial reasoning. Experiments show that PanoWorld substantially outperforms both proprietary and open-source baselines on PanoSpace-Bench, H* Bench, and R2R-CE Val-Unseen benchmarks. These results demonstrate that robust panoramic reasoning requires dedicated pano-native supervision and geometry-aware model adaptation. All source code and proposed data will be publicly released.

[72] CLIP Tricks You: Training-free Token Pruning for Efficient Pixel Grounding in Large VIsion-Language Models cs.CV | cs.AIPDF

Sangin Lee, Yukyung Choi

TL;DR: 本文提出了一种名为LiteLVLM的训练无关、文本引导的视觉令牌剪枝策略，旨在提升大型视觉语言模型在像素定位任务中的推理效率。通过反转CLIP视觉-文本相似度排名，该方法能够有效保留覆盖参考区域的视觉令牌，同时恢复上下文令牌以实现清晰的前景-背景分离。

Details

Motivation: 大型视觉语言模型中视觉令牌通常占输入令牌的多数，导致计算开销巨大；现有剪枝方法在像素定位任务中表现不佳，因为令牌重要性高度依赖于输入文本。研究发现CLIP中参考区域内的视觉令牌与文本表示相似度较低，这启发了本文提出一种无需训练、文本引导的剪枝方法。

Result: LiteLVLM在多种令牌预算下显著优于现有方法超过5%；无需任何训练或微调，在保持原始性能90%的同时，实现了22%的速度提升和2.3倍的内存减少。

Insight: 创新点在于利用CLIP视觉-文本相似度的反转排名来指导令牌剪枝，这是一种训练无关且文本感知的方法；客观分析认为，该方法通过结合参考区域保留和上下文恢复，有效解决了像素定位任务中令牌重要性依赖文本的挑战，为高效推理提供了新思路。

Abstract: In large vision-language models, visual tokens typically constitute the majority of input tokens, leading to substantial computational overhead. To address this, recent studies have explored pruning redundant or less informative visual tokens for image understanding tasks. However, these methods struggle with pixel grounding tasks, where token importance is highly contingent on the input text. Through an in-depth analysis of CLIP, we observe that visual tokens located within referent regions often exhibit low similarity to the textual representation. Motivated by this insight, we introduce LiteLVLM, a training-free, text-guided token pruning strategy for efficient pixel grounding inference. By reversing the ranking of CLIP’s visual-text similarity, LiteLVLM effectively retains visual tokens covering the referent regions, while recovering context tokens to enable clear foreground-background separation. Extensive experiments demonstrate that LiteLVLM significantly outperforms existing methods by over 5% across diverse token budgets. Without any training or fine-tuning, LiteLVLM maintains 90% of the original performance with a 22% speedup and a 2.3x memory reduction. Our code is available at https://github.com/sejong-rcv/LiteLVLM.

[73] Does Engram Do Memory Retrieval in Autoregressive Image Generation? cs.CVPDF

Jinghao Wang, Qiyuan He, Chunbin Gu, Pheng-Ann Heng

TL;DR: 本文研究了Engram模块在自回归图像生成中的作用，发现其并非作为内容寻址的记忆检索器，而是作为一种门控架构侧路径，主要通过路径本身而非学习到的记忆表来提升模型性能。

Details

Motivation: 探讨Engram模块在自回归图像生成中是否像在语言模型中一样提供内容寻址的快捷方式，还是通过其他机制带来增益。

Result: 在ImageNet 256x256数据集上，所有Engram增强变体在FID指标上均落后于纯自回归基线；实验表明，即使将记忆表冻结为噪声，FID仅轻微下降（ΔFID=0.10），且Inception Score有所提升。

Insight: Engram模块在图像生成中主要作为门控残差流路径发挥作用，其学习到的记忆表贡献有限；这挑战了其作为内容寻址检索器的解释，为架构设计提供了新视角。

Abstract: The Engram module – a hash-keyed, O(1) associative memory injected into Transformer layers – was recently shown to improve large language model pretraining, with the appealing interpretation that it provides a content-addressed shortcut to recurring local token patterns. We ask whether this interpretation transfers to autoregressive (AR) image generation, or whether the observed gains, if any, come from a different mechanism. We adapt the Engram module to vision with 2D spatial $n$-gram hashing, gated fusion, and KV-cache-compatible incremental inference, and inject it into a class-conditional AR generator trained on ImageNet 256x256. Across a sweep of backbone-to-memory budget ratios $ρ{\in}[0.17, 0.90]$, every Engram-augmented variant trails the pure AR baseline in FID, indicating that the module saves backbone FLOPs but does not, by itself, improve sample quality. We then probe how the module is used. A gate-clamp sweep shows that disabling the Engram pathway entirely is catastrophic, yet a tiny constant gate (g=0.10) matches or beats the learned gate – inconsistent with a heavily content-addressed recall mechanism. A donor-probe experiment shows that swapping the hash inputs for matched, adversarial, or random same-class exemplars produces statistically indistinguishable next-token distributions, while collapsing or randomising the table degrades them by two to three orders of magnitude. Finally, training a model from scratch with the entire memory table frozen to $\mathcal{N}(0, 1)$ noise costs only $Δ\text{FID}{=}0.10$ and actually raises Inception Score. Together, these findings indicate that the Engram in AR image generation behaves not as a content-addressed retriever but as a gated architectural side-pathway: a hash-keyed residual stream whose benefit is dominated by the pathway itself, with the learned table contributing only a small distributional refinement.

[74] DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution cs.CVPDF

Zheng Chen, Ruofan Yang, Jin Han, Dehua Song, Zichen Zou

TL;DR: 本文提出DiffST，一种高效的时空感知视频扩散框架，用于解决真实世界中的时空视频超分辨率（STVSR）任务。该方法通过一步采样和全视频处理提升推理效率，并引入跨帧上下文聚合（CFCA）和视频表示引导（VRG）模块来增强时空信息利用。

Details

Motivation: 现有基于扩散模型的STVSR方法存在推理效率低和时空信息利用不足的问题，限制了实际部署。本文旨在解决这两个问题，提出一个高效且能充分挖掘时空信息的框架。

Result: 在真实世界STVSR任务上取得了领先结果，推理速度比之前的扩散方法快约17倍。

Insight: 创新点包括：将预训练扩散模型适配为一步采样以提升效率；设计CFCA模块聚合多关键帧信息生成中间帧；引入VRG模块提取视频级全局特征引导扩散过程。这些设计平衡了性能与效率，对视频生成任务有借鉴意义。

Abstract: Diffusion-based models have shown strong performance in video super-resolution (VSR) and video frame interpolation (VFI). However, their role in the coupled space-time video super-resolution (STVSR) setting remains limited. Existing diffusion-based STVSR approaches suffer from two issues: (1) low inference efficiency and (2) insufficient utilization of spatiotemporal information. These limitations impede deployment. To address these issues, we introduce DiffST, an efficient spatiotemporal-aware video diffusion framework for real-world STVSR. To improve efficiency, we adapt a pre-trained diffusion model for one-step sampling and process the entire video directly rather than operating on individual frames. Furthermore, to enhance spatiotemporal information utilization, we introduce cross-frame context aggregation (CFCA) and video representation guidance (VRG). The CFCA module aggregates information across multiple keyframes to produce intermediate frames. The VRG module extracts video-level global features to guide the diffusion process. Extensive experiments show that DiffST obtains leading results on real-world STVSR tasks. It also maintains high inference efficiency, running about 17$\times$ faster than previous diffusion-based STVSR methods. Code is available at: https://github.com/zhengchen1999/DiffST.

[75] FIKA-Bench: From Fine-grained Recognition to Fine-Grained Knowledge Acquisition cs.CVPDF

Geng Li, Yuxin Peng

TL;DR: 该论文提出了FIKA-Bench，一个用于评估细粒度知识获取能力的基准测试，重点关注系统在开放性问题中如何主动搜索、验证和利用外部证据进行细粒度识别。

Details

Motivation: 现有基准主要评估视觉识别能力，而忽略了主动获取外部知识的能力，特别是在面对陌生物体时人类会进行搜索和验证的过程，因此需要一个新的基准来研究细粒度知识获取。

Result: 在FIKA-Bench上评估最新的大型多模态模型和智能体，最佳系统准确率仅为25.1%，所有模型均未超过30%，表明该任务仍极具挑战性。

Insight: 创新点在于构建了一个防泄漏、基于证据的真实世界细粒度知识获取基准，并发现仅提供工具不足以提升性能，智能体失败主要源于实体检索错误和视觉判断能力不足，强调了需要针对细粒度识别优化智能体设计。

Abstract: Fine-grained recognition in everyday life is often not a closed-book classification problem: when encountering unfamiliar objects, humans actively search, compare visual details, and verify evidence before deciding. Existing benchmarks primarily evaluate visually recognition, leaving this active external knowledge acquisition ability underexplored. We study fine-grained knowledge acquisition, where a system must seek, verify, and use external evidence to answer open-ended fine-grained recognition questions. We introduce FIKA-Bench, a leakage-aware and evidence-grounded collection of 311 public-source and real-life instances. To ensure high quality, every example is filtered against frontier closed-book models to remove memorized cases and audited to eliminate image-answer leakage, retaining only samples supported by verified evidence. Our evaluation of latest Large Multimodal Models (LMMs) and agents reveals that the task remains a formidable challenge: the best system reaches only 25.1% accuracy, with no model exceeding 30%. Crucially, we find that merely equipping models with tools is insufficient to bridge this gap; agent failures are predominantly driven by wrong entity retrieval and poor visual judgement. These results show that reliable knowledge acquisition needs better agent designs that focus on fine-grained recognition.

[76] STAR: Semantic-Temporal Adaptive Representation Learning for Few-Shot Action Recognition cs.CV | cs.AIPDF

Hongli Liu, Yu Wang, Shengjie Zhao

TL;DR: 本文提出了一种名为STAR（语义-时序自适应表征学习）的统一框架，用于解决小样本动作识别中的语义-时序错位问题。该框架包含语义对齐和时序感知两个组件，通过时序语义注意力机制和结合语义引导Mamba块的原型精炼器，实现了细粒度的跨模态对齐与多尺度时序动态建模，并在多个基准测试上取得了显著的性能提升。

Details

Motivation: 现有小样本动作识别方法存在语义-时序错位问题，即静态文本提示无法捕捉视频序列中稀疏出现的关键视觉线索，且对多尺度时序动态（如短期判别性线索和长期依赖）建模不足，导致信息被过度平滑或碎片化。

Result: 在五个小样本动作识别基准测试上，STAR方法均优于现有最先进方法。例如，在1-shot设置下，在SSv2-Full和SSv2-Small数据集上分别取得了高达8.1%和6.7%的性能提升，在HMDB51数据集上提升了7.3%。

Insight: 创新点在于将序列建模能力强的Mamba模型引入小样本动作识别，并设计了时序语义注意力机制进行帧级跨模态对齐，以及结合语义引导Mamba块与多频率时序采样的原型精炼器，有效弥合了语义与时序的鸿沟，提升了表征的判别性和一致性。

Abstract: Few-shot action recognition (FSAR) requires models to generalize to novel action categories from only a handful of annotated samples. Despite progress with vision-language models, existing approaches still suffer from semantic-temporal misalignment, where static textual prompts fail to capture decisive visual cues that appear sparsely across sequences, and from inadequate modeling of multi-scale temporal dynamics, as short-term discriminative cues and long-range dependencies are often either oversmoothed or fragmented. To address these challenges, we propose Semantic Temporal Adaptive Representation Learning (STAR), a unified framework, consisting of a semantic-alignment component and a temporal-aware component, effectively bridging the semantic and temporal gaps and transferring the sequence modeling capability of Mamba into the FSAR. The semantic alignment module introduces a Temporal Semantic Attention (TSA) mechanism, which performs frame-level cross-modal alignment with textual cues, ensuring fine-grained semantic-temporal consistency. The temporal-aware module incorporates a Semantic Temporal Prototype Refiner (STPR) that integrates semantic-guided Mamba blocks with multi-frequency temporal sampling and bidirectional state-space refinement, yielding semantically aligned prototypes with enhanced discriminative fidelity and temporal consistency. Furthermore, temporally dependent class descriptors derived from large language models (LLMs) provide long-range semantic guidance. Extensive experiments on five FSAR benchmarks demonstrate the consistent superiority of STAR over state-of-the-art methods. For instance, STAR achieves up to 8.1% and 6.7% gains on the SSv2-Full and SSv2-Small datasets under the 1-shot setting, and 7.3% on HMDB51, validating its effectiveness under limited supervision. The code is available at https://github.com/HongliLiu1/STAR-main.

[77] ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding cs.CV | cs.AIPDF

Xiao Liu, Nayu Liu, Junnan Zhu, Ruirui Chen, Guohui Xiang

TL;DR: 本文提出了ReTool-Video，一种递归使用工具的视频代理方法，通过构建包含134个工具的MetaAug-Video工具库（MVTL）来增强视频理解能力。该方法能够将高级视频意图递归地转化为可执行的工具链，从而支持时序推理、跨模态理解和复杂问答任务。

Details

Motivation: 现有视频代理在工具使用上存在两个主要限制：一是工具空间粗糙，缺乏用于组合推理的细粒度操作；二是动作空间扁平，迫使高级视频意图被强制映射为原始可执行工具调用。本文旨在解决这些问题，以提升视频推理的灵活性和准确性。

Result: 在MVBench、MLVU和Video-MME w/o sub.等基准测试中，ReTool-Video均优于强基线模型，表现出更优的稳定性和有效性，实现了SOTA水平的性能。

Insight: 创新点包括构建了支持双级访问（结构化视频信息和原始模态证据）的可扩展工具库MVTL，以及提出递归工具使用方法，通过参数修复、工具替换或分解来处理不匹配意图，从而动态地将抽象动作转化为具体多模态操作。

Abstract: Video understanding requires active evidence seeking, motivating tool-augmented video agents for temporal reasoning, cross-modal understanding, and complex question answering. Existing video agents have improved video reasoning with retrieval, memory, frame inspection, and verifier tools, but they still face two limitations: (1) a coarse tool space that lacks fine-grained operations for compositional reasoning; and (2) a flat action space that forces high-level video intents into primitive executable tool calls. In this paper, we address these challenges with two complementary designs. First, we construct a MetaAug-Video Tool Library (MVTL), an extensible tool library with 134 registered tools, including 26 base tools for general multimodal signal processing and 108 meta tools for filtering, aggregation, reranking, formatting, and other intermediate-result operations. MVTL supports dual-level access to both structured video information and raw modal evidence, enabling diverse video reasoning scenarios. Second, we propose ReTool-Video, a recursive tool-using method that grounds high-level video intents into executable tool chains. In ReTool-Video, matched actions are executed directly, while unmatched intents are delegated to a resolver for parameter repair, tool substitution, or decomposition. This allows abstract actions such as temporal merging, cross-modal verification, or repeated-event aggregation to be progressively translated into concrete multimodal operations at runtime. Experiments on MVBench, MLVU, and Video-MME w/o sub. show that ReTool-Video consistently outperforms strong baselines. Further analysis demonstrates that recursive grounding and fine-grained meta tools improve the stability and effectiveness of complex video understanding.

[78] KamonBench: A Grammar-Based Dataset for Evaluating Compositional Factor Recovery in Vision-Language Models cs.CV | cs.LGPDF

Richard Sproat, Stefano Peluchetti

TL;DR: 本文介绍了KamonBench，这是一个基于语法的图像到结构基准数据集，包含20,000个合成的日本家纹（Kamon）复合图案，用于评估视觉语言模型在稀疏组合视觉识别和因子恢复方面的能力。每个图案都配有正式的家纹描述语言、日语分析、英语翻译和非语言程序代码，支持超越标题级准确性的评估，如直接因子度量、受控因子对重组分割、反事实敏感性组和线性探针。

Details

Motivation: 解决视觉语言模型在组合视觉识别和因子恢复方面的评估问题，特别是针对稀疏描述空间中的符号组合，利用日本家纹作为自然测试案例。

Result: 提供了基于ViT编码器/Transformer解码器和两个VGG n-gram解码器的基线结果，包括有无学习位置掩码的情况，但未具体提及定量性能水平或与SOTA的比较。

Insight: 创新点在于引入基于语法的合成数据集，支持多粒度评估（如因子级度量和反事实分析），为稀疏组合视觉识别提供了可控测试平台，可借鉴用于模型因子可解释性研究。

Abstract: Kamon (family crests) are an important part of Japanese culture and a natural test case for compositional visual recognition: each crest combines a small number of symbolic choices, but the space of possible descriptions is sparse. We introduce KamonBench, a grammar-based image-to-structure benchmark with 20,000 synthetic composite crests and auxiliary component examples. Each composite crest is paired with a formal kamon description language - “kamon yōgo” - description, a segmented Japanese analysis, an English translation, and a non-linguistic program code. Because each synthetic crest is generated from known factors, namely container, modifier, and motif, KamonBench supports evaluation beyond caption-level accuracy: direct program-code factor metrics, controlled factor-pair recombination splits, counterfactual motif-sensitivity groups under fixed container-modifier contexts, and linear probes of factor accessibility. We include baseline results for a ViT encoder/Transformer decoder and two VGG n-gram decoders, with and without learned positional masks. KamonBench therefore provides a controlled testbed for sparse compositional visual recognition and factor recovery in vision-language models.

[79] GRIP-VLM: Group-Relative Importance Pruning for Efficient Vision-Language Models cs.CV | cs.AIPDF

Mingzhe Huang, Weijun Wang, Xin Ding, Liang Mi, Hao Wen

TL;DR: 本文提出GRIP-VLM，一种基于强化学习的组相对重要性剪枝框架，用于高效压缩视觉语言模型。该方法将视觉令牌剪枝建模为马尔可夫决策过程，通过组相对策略优化直接探索离散选择空间，并集成预算感知评分器动态评估令牌重要性，无需重新训练即可适应任意压缩比。

Details

Motivation: 视觉语言模型中处理大量视觉令牌带来过高计算开销，现有基于连续梯度近似的训练感知剪枝方法在处理离散非凸组合问题时易陷入局部最优，尤其在激进压缩预算下表现不佳。

Result: 在多个多模态基准测试上的广泛实验表明，GRIP-VLM持续优于启发式和监督学习基线方法，实现了更优的帕累托前沿，在同等准确率下推理速度提升最高达15%。

Insight: 创新点在于将视觉令牌剪枝重新定义为离散优化问题，采用强化学习直接探索选择空间，避免了连续近似的局限性；同时通过预算感知评分器实现动态自适应压缩，提升了方法的通用性和效率。

Abstract: In Vision-Language Models (VLMs), processing a massive number of visual tokens incurs prohibitive computational overhead. While recent training-aware pruning methods attempt to selectively discard redundant tokens, they largely rely on continuous-gradient relaxations. However, visual token pruning is inherently a discrete, non-convex combinatorial problem; consequently, these continuous approximations frequently trap the optimization in sub-optimal local minima, especially under aggressive compression budgets. To overcome this fundamental bottleneck, we propose GRIP-VLM, a Group-Relative Importance Pruning framework driven by Reinforcement Learning. Rather than relying on smooth-gradient assumptions, GRIP-VLM formulates pruning as a Markov Decision Process, employing a Group Relative Policy Optimization (GRPO) paradigm anchored by supervised warm-up to directly explore the discrete selection space. Integrated with a budget-aware scorer, our lightweight agent dynamically evaluates per-token importance and adapts to arbitrary compression ratios without retraining. Extensive experiments across diverse multimodal benchmarks demonstrate that GRIP-VLM consistently outperforms heuristic and supervised-learning baselines, achieving a superior Pareto frontier and delivering up to a 15% inference speedup at equal accuracy.

[80] Backbone is All You Need: Assessing Vulnerabilities of Frozen Foundation Models in Synthetic Image Forensics cs.CV | cs.MMPDF

Chiara Musso, Joy Battocchio, Andrea Montibeller, Giulia Boato

TL;DR: 本文提出了Surrogate Iterative Adversarial Attack (SIAA)，一种灰盒攻击方法，它仅利用目标检测器Vision Transformer (ViT)骨干网络的知识，在特征空间中生成对抗样本，有效攻击了依赖冻结预训练骨干网络的深度伪造检测器。实验表明，该方法在多种灰盒场景下攻击成功率很高，接近白盒性能，揭示了此类检测器的关键漏洞。

Details

Motivation: 随着AI生成的合成图像日益逼真，ViT成为深度伪造检测的核心。然而，当前检测器普遍依赖冻结的预训练骨干网络，这引入了一个微妙但关键的脆弱性。本文旨在探究仅利用骨干网络知识是否能有效攻击此类检测器。

Result: 在涉及多个基于ViT的检测器和多样灰盒场景（包括少样本学习、完全训练失配和攻击可迁移性测试）的实验中，SIAA攻击方法始终能实现很高的攻击成功率，通常接近白盒攻击的性能水平。

Insight: 论文宣称的创新点是SIAA攻击方法，它仅依赖骨干网络知识，完全在目标检测器的特征空间内操作，无需访问分类头或训练数据。从客观角度看，这揭示了依赖冻结预训练骨干网络的检测器存在一个普遍且严重的脆弱性，强调了对抗性多媒体取证领域需要更具鲁棒性的防御机制。

Abstract: As AI-generated synthetic images become increasingly realistic, Vision Transformers (ViTs) have emerged as a cornerstone of modern deepfake detection. However, the prevailing reliance on frozen, pre-trained backbones introduces a subtle yet critical vulnerability. In this work, we present the Surrogate Iterative Adversarial Attack (SIAA), a gray-box attack that exploits knowledge of the detector’s ViT backbone alone and operates entirely within the target detector’s feature space to craft highly effective adversarial examples. Through our experiments, involving multiple ViT-based detectors and diverse gray-box scenarios, including few-shot learning, complete training misalignment and attack transferability tests, we demonstrate that this vulnerability consistently yields high attack success rates, often approaching white-box performance. By doing so, we reveal that backbone knowledge alone is sufficient to undermine detector reliability, highlighting the urgent need for more resilient defenses in adversarial multimedia forensics.

[81] PreFIQs: Face Image Quality Is What Survives Pruning cs.CVPDF

Jan Niklas Kolf, Guray Ozgur, Andrea Atzori, Žiga Babnik, Vitomir Štruc

TL;DR: 本文提出了一种名为PreFIQs的无监督、无需训练的Face Image Quality Assessment (FIQA)框架。该方法基于Pruning Identified Exemplar (PIE)假设，通过计算人脸图像在预训练人脸识别模型及其剪枝版本上的嵌入向量之间的欧氏距离来评估图像质量。理论分析表明该距离是嵌入流形几何敏感性的高效近似。实验在多个基准和模型上验证了其性能，达到了与最先进方法相当或更优的水平。

Details

Motivation: 解决现有FIQA方法通常需要监督训练或复杂计算的问题，旨在提供一个无需训练、计算高效且性能优越的无监督质量评估方案。

Result: 在八个基准测试和四个人脸识别模型上的广泛实验表明，PreFIQs达到了与最先进的FIQA方法相当或更优的性能，并在多个基准上创造了新的SOTA结果，且无需任何训练或监督。

Insight: 核心创新点在于将人脸图像质量定义为‘在模型剪枝后幸存下来的部分’，并提出了一种基于模型剪枝的、理论驱动的无监督质量评估信号。这为FIQA提供了一个全新的、计算高效且原理清晰的视角。

Abstract: Face Image Quality Assessment (FIQA) evaluates the utility of a face image for automated face recognition (FR) systems. In this work, we propose PreFIQs, an unsupervised and training-free FIQA framework grounded in the Pruning Identified Exemplar (PIE) hypothesis. We hypothesize that low-utility face images rely disproportionately on fragile network parameters, resulting in larger geometric displacement of their embeddings under model sparsification. Accordingly, PreFIQs quantifies image utility as the Euclidean distance between L2-normalized embeddings extracted from a pre-trained FR model and its pruned counterpart. We provide a first-order theoretical justification via a Jacobian-vector product analysis, demonstrating that this empirical drift serves as a computationally efficient approximation of the exact geometric sensitivity of the latent embedding manifold. Extensive experiments across eight benchmarks and four FR models demonstrate that PreFIQs achieves competitive or superior performance compared to state-of-the-art FIQA methods, including establishing new state-of-the-art results on several benchmarks, without any training or supervision. These results validate parameter sparsification as a principled and practically efficient signal for face image utility, and demonstrate that quality is, in essence, what survives pruning.

[82] Fast and Compact Graph Cuts for the Boykov-Kolmogorov Algorithm cs.CV | cs.DSPDF

Christian Møller Mikkelstrup, Anders Bjorholm Dahl, Philip Bille, Vedrana Andersen Dahl, Inge Li Gørtz

TL;DR: 本文从理论和实践角度重新审视了Boykov-Kolmogorov（BK）最小割算法，提出了改进的时间复杂度分析，并设计了一种新的快速紧凑BK（fcBK）算法，其时间复杂度为O(m|C|)，同时提出了一种紧凑的图表示方法，使得算法能在有限内存下处理超大规模图（如10^9顶点和10^10边）。

Details

Motivation: 解决BK算法在处理大规模图时的时间和内存效率问题，以更高效地支持计算机视觉中广泛使用的最小割计算。

Result: 在多个基准数据集上评估，该实现是当前最快的BK算法实现，并能在128GB内存的机器上处理高达10^9顶点和10^10边的图。

Insight: 创新点包括改进BK算法的时间复杂度分析、提出fcBK算法降低复杂度至O(m|C|)，以及紧凑图表示方法提升内存效率，为大规模图割计算提供了实用的高效解决方案。

Abstract: Computing a minimum $s$-$t$ cut in a graph is a solution to a wide range of computer vision problems, and is often done using the Boykov-Kolmogorov (BK) algorithm. In this paper, we revisit the BK algorithm from both a theoretical and practical point of view. We improve the analysis of the time complexity of the BK algorithm to $O(mn|C|)$ and propose a new algorithm, the fast and compact BK (fcBK) algorithm, with a time complexity of $O(m|C|)$, where $m$, $n$, and $|C|$ are the number of edges, number of vertices, and the capacity of the cut, respectively. We additionally propose a compact graph representation that allows our implementation to find a minimum $s$-$t$ cut in a graph with upwards of $10^9$ vertices and $10^{10}$ edges on a machine with 128 GB of memory. We find our implementation of the BK algorithm to be the fastest available implementation of the BK algorithm when evaluating on a comprehensive set of benchmark datasets, highlighting the importance of memory-efficient implementations. We make our implementations publicly available for further research and implementation development within minimum $s$-$t$ cut algorithms.

[83] Neural Video Compression with Domain Transfer cs.CVPDF

Tiange Zhang, Rongqun Lin, Xiandong Meng, Haofeng Wang, Xing Tian

TL;DR: 本文提出DCVC-DT，一种结合领域迁移增强的神经视频压缩框架，通过轻量级在线领域迁移机制动态适应编码潜在表示，并引入帧级动态率失真调整方案，以提升对未见测试数据的泛化能力和压缩性能。

Details

Motivation: 解决神经视频编码中训练与测试数据间的领域差距问题，该差距会导致测试内容与训练分布不同时性能显著下降。

Result: 在基准模型DCVC-DC上实现了高达6.21%的码率节省，显著增强了对未见测试数据的泛化能力并减轻了误差传播。

Insight: 创新点包括轻量级在线领域迁移机制（无需修改编解码器参数）和帧级动态率失真调整方案，有效桥接领域差距并优化率失真权衡。

Abstract: Content-adaptive compression has always been a key direction in neural video coding (NVC), aiming to mitigate the domain gap between training and testing data. Such gaps often arise from distributional discrepancies between training and inference data, which may cause noticeable performance degradation when the testing content differs from the training distribution. To tackle this challenge, we propose DCVC-DT, a domain transfer enhanced neural video compression framework. Specifically, we design a lightweight online domain transfer (DT) mechanism that dynamically adapts the encoded latent representation during inference, effectively bridging the domain gap without modifying the encoder or decoder parameters. In addition, we develop a frame-level dynamic RD (Rate and Distortion) adjustment scheme that actively regulates the ratio of R and D in the loss function based on quality fluctuation, thereby improving rate-distortion performance. Extensive experiments demonstrate that DCVC-DT achieves up to 6.21% bitrate savings over the baseline DCVC-DC, while significantly enhancing generalization to unseen testing data and alleviating error propagation. Our code is available at https://github.com/SunnyMass/DCVC-DT.

[84] Towards Unified Surgical Scene Understanding:Bridging Reasoning and Grounding via MLLMs cs.CV | cs.AIPDF

Jincai Huang, Shihao Zou, Yuchen Guo, Jingjing Li, Wei Ji

TL;DR: 本文提出SurgMLLM，一个统一的手术场景理解框架，通过微调多模态大语言模型（MLLM）来桥接高层次推理（如手术阶段、器械-动词-目标三元组识别）与低层次视觉定位（像素级分割）。该框架使用统一的训练目标进行端到端训练，并在扩展数据集CholecT45-Scene上验证了其有效性。

Details

Motivation: 现有手术场景理解方法通常孤立地处理程序上下文、语义推理和视觉定位，导致表示碎片化和语义一致性有限。本文旨在通过一个统一模型实现更全面的手术场景理解。

Result: 在扩展数据集CholecT45-Scene上的实验表明，SurgMLLM显著提升了手术场景理解性能：主要三元组识别指标AP_IVT从40.7%提升至46.0%，并在手术阶段识别和分割任务上持续优于先前方法。

Insight: 创新点在于将MLLM用于结构化可解释推理，并联合建模手术阶段、IVT三元组及分割标记，通过统一的端到端训练目标促进跨任务一致性学习；客观来看，其提出的推理与定位桥接机制及扩展数据集为手术AI提供了更全面的评估基准。

Abstract: Surgical scene understanding is a cornerstone of computer-assisted intervention. While recent advances, particularly in surgical image segmentation, have driven progress, real-world clinical applications require a more holistic understanding that jointly captures procedural context, semantic reasoning, and precise visual grounding. However, existing approaches typically address these components in isolation, leading to fragmented representations and limited semantic consistency. To address this limitation, we propose SurgMLLM, a unified surgical scene understanding framework that bridges high-level reasoning and low-level visual grounding within a single model. Given surgical videos, SurgMLLM fine-tunes a multimodal large language model (MLLM) to support structured interpretability reasoning, which is used to jointly model phases, instrument-verb-target (IVT) triplets, and triplet-entity segmentation tokens. These tokens are then temporally aggregated and serve as prompts for a segmentation network, enabling accurate pixel-wise grounding of triplet instruments and targets. The entire framework is trained end-to-end with a unified objective that couples language-based reasoning supervision with visual grounding losses, promoting coherent cross-task learning and clinically consistent scene representations. To facilitate unified evaluation, we introduce CholecT45-Scene, extending CholecT45 dataset with 64,299 frames of pixel-level mask annotations for instruments and targets, aligned with existing triplet labels. Extensive experiments show that SurgMLLM significantly advances surgical scene understanding, improving the primary triplet recognition metric AP_IVT from 40.7% to 46.0% and consistently outperforming prior methods in phase recognition and segmentation. These results highlight the effectiveness of unified reasoning-and-grounding for reliable, context-aware surgical assistance.

[85] CA-GCL: Cross-Anatomy Global-Local Contrastive Learning for Robust 3D Medical Image Understanding cs.CVPDF

Hanwen Zhang, Yao Liu, Die Dai, Jiaye Yang, Qiao Liu

TL;DR: 本文提出了一种名为CA-GCL（跨解剖结构全局-局部对比学习）的新框架，旨在解决3D医学图像理解中细粒度视觉语言预训练（FVLP）存在的文本嵌入空间表示塌陷问题。该框架通过引入全局对比目标来分离不同解剖结构类别，并结合临床感知的文本增强策略，以提升模型对提示词变化的鲁棒性和跨数据集泛化能力。

Details

Motivation: 现有细粒度视觉语言预训练（FVLP）方法在3D医学图像理解中存在文本嵌入空间表示塌陷的问题，导致不同解剖结构的文本嵌入高度聚集而难以区分，使得模型对提示词变化过于敏感，阻碍了可靠的临床部署。

Result: 在CT-RATE和Rad-ChestCT数据集上的广泛评估表明，CA-GCL在零样本异常检测任务中持续优于现有的视觉语言预训练（VLP）范式，实现了卓越的性能并展现出强大的跨数据集泛化能力。关键的是，CA-GCL减少了不同提示模板下的性能方差，并将塌陷的文本相似度分布转变为钟形分布。

Insight: 论文的创新点在于提出了一个结合全局对比学习（强制解剖类别在潜在空间中分离）与局部对齐的框架，并引入了基于排列不变性和部分完整性的临床感知文本增强策略。从客观角度看，该方法通过显式地建模解剖类别间的差异来缓解表示塌陷，是一种提升医学视觉语言模型鲁棒性和泛化性的有效途径。

Abstract: Fine-grained Vision-Language Pre-training (FVLP) demonstrates significant potential in 3D medical image understanding by aligning anatomy-level visual representations with corresponding textual descriptions. However, existing FVLP paradigms often suffer from severe representation collapse in the textual embedding space, where text embeddings of distinct anatomical structures become highly clustered and indistinguishable. This distributional degeneracy renders the model hypersensitive to prompt variations, hindering reliable clinical deployment. To address these challenges, we propose a novel Cross-Anatomy Global-Local Contrastive Learning framework (CA-GCL). CA-GCL introduces a global contrastive objective that enforces separation between anatomical categories in the latent space, effectively counteracting the aggregation tendency induced by local alignment. Furthermore, we incorporate a clinical-aware text augmentation strategy based on permutation invariance and partial completeness to enhance robustness against descriptive incompleteness. Extensive evaluations on the CT-RATE and Rad-ChestCT datasets demonstrate that CA-GCL consistently outperforms existing VLP paradigms in zero-shot abnormality detection, achieving superior performance while exhibiting strong cross-dataset generalization. Crucially, CA-GCL reduces performance variance across diverse prompt templates, transforming the collapsed textual similarity distribution into a bell-shaped distribution. These results validate CA-GCL as an effective framework for robust 3D medical image understanding.

[86] Sparse Code Uplifting for Efficient 3D Language Gaussian Splatting cs.CVPDF

Lovre Antonio Budimir, Yushi Guan, Steve Ryhner, Sven Lončarić, Nandita Vijaykumar

TL;DR: 本文提出SCOUP方法，通过解耦语言表示学习与3D高斯优化，利用2D图像区域的稀疏编码表示，并将其提升至3D高斯，实现了高效的3D语言高斯泼溅（3DLGS），在训练速度、内存效率和渲染速度上显著优于现有方法。

Details

Motivation: 解决3D语言高斯泼溅中高维视觉语言嵌入与数百万3D高斯关联时的高存储成本、慢渲染速度问题，以及现有方法无法同时实现快速3D语义重建、高效存储和快速渲染的挑战。

Result: 在多个基准测试中，SCOUP在开放词汇查询准确率上匹配或优于现有方法；训练速度提升高达400倍，训练时内存效率提高3倍，达到渲染速度的SOTA水平。

Insight: 创新点在于将语言表示学习从3D高斯优化中解耦，基于2D图像区域学习稀疏编码表示，并通过加权稀疏聚合和Top-K过滤提升至3D高斯，实现了存储、训练和渲染效率的同步优化。

Abstract: 3D Language Gaussian Splatting (3DLGS) augments 3D Gaussian Splatting with language-aligned visual features for open-vocabulary 3D scene understanding. A core challenge is efficiently associating high-dimensional vision-language embeddings with millions of 3D Gaussians while preserving efficient feature rendering for text-based querying. Existing methods either store dense features directly on Gaussians, causing high storage costs and slow rendering, or learn compact representations through expensive per-scene optimization with repeated feature rasterization. No existing method simultaneously achieves fast 3D semantic reconstruction, efficient storage, and fast rendering. We propose SCOUP (Sparse COde UPlifting), which addresses all three by decoupling language representation learning from 3D Gaussian optimization. Rather than working directly in 3D, we learn sparse codebook-based representations entirely using features associated with 2D image regions, associating each region with a sparse set of codebook coefficients. We then uplift these coefficients to 3D Gaussians with our weighted sparse aggregation using Gaussian-to-pixel associations, where each Gaussian accumulates coefficients over codebook atoms across views. Top-$K$ filtering then extracts the most dominant multi-view coefficients per Gaussian, enabling efficient storage and fast rendering. Our method achieves up to $400\times$ training speedup while being $3\times$ more memory efficient during training compared to the state-of-the-art in rendering speed. Across multiple benchmarks, SCOUP matches or outperforms existing methods in open-vocabulary querying accuracy.

[87] WD-FQDet: Multispectral Detection Transformer via Wavelet Decomposition and Frequency-aware Query Learning cs.CVPDF

Chunjin Yang, Xiwei Zhang, Yiming Xiao, Fanman Meng

TL;DR: 本文提出了一种名为WD-FQDet的新型多光谱目标检测框架，通过小波分解将红外与可见光图像信息解耦到低频和高频域，并设计针对性模块进行特征对齐与保留，同时引入频率感知查询选择机制动态调整不同特征的贡献，在多个数据集上实现了SOTA性能。

Details

Motivation: 现有基于红外-可见光融合的目标检测方法存在模态共享特征偏差严重和模态特定特征不足的问题，需要一种能更好解耦并融合这两种信息的新框架。

Result: 在FLIR、LLVIP和M3FD数据集上的实验结果表明，WD-FQDet在多个评估指标上均达到了最先进的性能水平。

Insight: 创新点在于从频域（低频/高频）新视角解耦模态共享与特定特征，并设计了对应的对齐、保留、增强及动态调节模块；其将小波分解与Transformer检测器结合，并利用频率感知机制自适应融合的策略具有借鉴意义。

Abstract: Infrared-visible object detection improves detection performance by combining complementary features from multispectral images. Existing backbone-specific and backbone-shared approaches still suffer from the problems of severe bias of modality-shared features and the insufficiency of modality-specific features. To address these issues, we propose a novel detection framework WD-FQDet that explicitly decouples modality-shared and modality-specific information from infrared and visible modalities in the new view of low- and high-frequency domains, allowing fusion strategies tailored to their frequency characteristics. Specifically, a low-frequency homogeneity alignment module is proposed to align modality-shared features across modalities via a cross-modal attention mechanism, and a high-frequency specificity retention module is proposed to preserve modality-specific features through the multi-scale gradient consistency loss. To reinforce the feature representation in the frequency domain, we propose a hybrid feature enhancement module that incorporates spatial cues. Furthermore, considering that the contributions of homogeneous and modality-specific features to object detection vary across scenarios, we propose a frequency-aware query selection module to dynamically regulate their contributions. Experimental results on the FLIR, LLVIP, and M3FD datasets demonstrate that WD-FQDet achieves state-of-the-art performance across multiple evaluation metrics.

[88] SceneGraphVLM: Dynamic Scene Graph Generation from Video with Vision-Language Models cs.CVPDF

Vladislav Makarov, Mark Gizetdinov, Dmitry Yudin

TL;DR: SceneGraphVLM是一种利用小型视觉语言模型（VLM）进行图像和视频场景图生成的紧凑方法。它采用高效的TOON格式序列化图结构，并通过两阶段训练（监督微调+基于幻觉感知奖励的强化学习）来平衡关系覆盖率和精度。对于视频，模型可选择性地利用前一帧生成的图作为上下文，实现轻量级短期建模。该方法在PSG、PVSG和Action Genome基准上实现了质量与速度的良好权衡，在保持合理召回率的同时提升了精度导向的指标，并以约一秒的延迟生成完整场景图。

Details

Motivation: 现有的基于VLM的端到端场景图生成方法常产生冗长输出，包含大量无关对象和关系，且准确快速的图像/视频图预测仍具挑战性。本文旨在开发一种紧凑高效的VLM方法，以生成更精确、结构化的场景图表示。

Result: 在PSG、PVSG和Action Genome基准测试中，SceneGraphVLM实现了强大的质量-速度权衡，提升了精度导向的场景图生成（SGG）指标，同时保持了合理的召回率，并利用vLLM加速解码实现了约一秒的生成延迟。

Insight: 创新点包括：1) 采用token高效的TOON格式进行图序列化；2) 两阶段训练策略，结合监督微调和基于幻觉感知奖励的强化学习，以惩罚未支持的对象/关系并平衡覆盖与精度；3) 为视频生成引入轻量级短期上下文机制，无需跟踪或后处理即可利用前一帧图信息。这些设计使得小型VLM也能高效生成高质量的场景图。

Abstract: Scene graph generation provides a compact structured representation for visual perception, but accurate and fast graph prediction from images and videos remains challenging. Recent VLM-based methods can generate scene graphs end-to-end as structured text, yet often produce long outputs with irrelevant objects and relations. We present SceneGraphVLM, a compact method for image and video scene graph generation with small visual language models. SceneGraphVLM serializes graphs in a token-efficient TOON format and trains the model in two stages: supervised fine-tuning followed by reinforcement learning with hallucination-aware rewards that balance relation coverage and precision while penalizing unsupported objects and relations. For videos, the model can optionally condition each frame on the previously generated graph, providing lightweight short-term context without tracking or post-processing. We evaluate SceneGraphVLM on PSG, PVSG, and Action Genome. With compact VLMs and vLLM-accelerated decoding, SceneGraphVLM achieves a strong quality-speed trade-off, improves precision-oriented SGG metrics while preserving reasonable recall, and generates complete scene graphs with approximately one-second latency. Code and implementation details are available at: https://github.com/markus0440/SceneGraphVLM.git.

[89] Weakly Supervised Segmentation as Semantic-Based Regularization cs.CV | cs.AIPDF

Stefano Colamonaco, Andrei-Bogdan Florea, Jaron Maene

TL;DR: 本文提出一种神经符号化方法，将可微模糊逻辑与深度分割模型结合，通过弱标注和领域先验知识构建连续逻辑约束来微调SAM模型，生成高质量伪标签，并训练无提示的第二阶段分割模型，在Pascal VOC 2012和REFUGE2数据集上实现了超越全监督基线的SOTA分割精度。

Details

Motivation: 解决现有弱监督语义分割方法依赖启发式提示选择、难以融入先验知识或异构标签的问题，通过神经符号化框架统一弱标注与领域先验。

Result: 在Pascal VOC 2012和REFUGE2视盘/视杯分割数据集上达到最先进的分割精度，其逻辑引导微调生成的伪标签质量更高，性能常超过全监督基线。

Insight: 创新点在于将弱监督约束形式化为可微模糊逻辑规则，实现先验知识与基础模型（SAM）的协同微调，避免了传统伪标签方法对提示工程的依赖，提升了弱监督场景的泛化能力。

Abstract: Weakly supervised semantic segmentation (WSSS) trains dense pixel-level segmentation models from partial or coarse annotations such as bounding boxes, scribbles, or image-level tags. While recent work leverages foundation models such as the Segment Anything Model (SAM) to generate pseudo-labels, these approaches typically depend on heuristic prompt choices and offer limited ways to incorporate prior knowledge or heterogeneous labels. We address this gap by taking a neurosymbolic perspective: integrating differentiable fuzzy logic with deep segmentation models. Weak annotations and domain-specific priors are unified as continuous logical constraints that fine-tune SAM under weak supervision. The refined foundation model then produces improved pseudo-labels, from which we train a second-stage prompt-free segmentation model. Experiments on Pascal VOC 2012 and the REFUGE2 optic disc/cup segmentation dataset show that our logic-guided fine-tuning yields higher-quality pseudo-labels, leading to state-of-the-art segmentation accuracy that often exceeds densely supervised baselines.

[90] Characterizing Universal Object Representations Across Vision Models cs.CV | cs.LG | q-bio.NCPDF

Florian P. Mahner, Johannes Roth, Ka Chun Lam, Michael F. Bonner, Francisco Pereira

TL;DR: 本文通过分解162个不同视觉模型的物体相似性结构，识别出少量非负维度，区分了通用维度和模型特定维度。研究发现通用维度更具可解释性且更受概念图像属性驱动，其出现不受架构、目标函数、训练数据等因素影响，但与生物视觉（如猕猴IT活动和人类相似性判断）的预测能力相关。

Details

Motivation: 研究动机是探究不同深度神经网络在视觉表示上的收敛现象，明确模型实际收敛于哪些视觉属性以及影响收敛的因素。

Result: 在162个多样化视觉模型上，通用维度与模型特定维度相比，更可解释且与语义内容相关；通用维度与架构、目标等无关，但能更好地预测猕猴IT活动和人类相似性判断。

Insight: 创新点在于通过分解相似性结构量化通用表示，揭示可解释性和语义内容是驱动通用性的隐含因素，并建立通用维度与生物视觉的相关性，为理解DNN涌现表示及其与生物视觉的对齐提供新视角。

Abstract: Deep neural networks trained with different architectures, objectives, and datasets have been reported to converge on similar visual representations. However, what remains unknown is which visual properties models actually converge on and which factors may underlie this convergence. To address this, we decompose the object similarity structure of 162 diverse vision models into a small set of non-negative dimensions. To determine universal versus model-specific dimensions, we then estimate how often each dimension reappears across models. In contrast to model-specific dimensions, universal dimensions are more interpretable and more strongly driven by conceptual image properties, indicating the relevance of interpretability and semantic content as implicit factors driving universality across models. Differences in architecture, objective function, training data, model size, and model performance do not explain the emergence of universal dimensions. However, models with more universal dimensions also better predict macaque IT activity and human similarity judgments, suggesting that universality reflects representations relevant to biological vision. These findings have important implications for understanding the emergent representations underlying deep neural network models and their alignment with biological vision.

[91] AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillation cs.CV | cs.AIPDF

Yuchao Gu, Guian Fang, Yuxin Jiang, Weijia Mao, Song Han

TL;DR: 本文提出了AnyFlow，一种基于流图（flow map）的任意步长视频扩散蒸馏框架，旨在解决一致性蒸馏模型在测试时增加采样步长时性能下降的问题。该方法通过将蒸馏目标从端点一致性映射转向任意时间间隔的流图转移学习，并结合流图反向模拟，实现了对完整ODE采样轨迹的优化，从而在少步采样和因果生成中均表现出色。

Details

Motivation: 一致性蒸馏模型在测试时增加采样步长时性能会下降，这限制了其在任意步长视频扩散中的应用，因为一致性采样轨迹削弱了ODE采样的理想测试时缩放行为。

Result: 在双向和因果架构上，参数规模从1.3B到14B的广泛实验中，AnyFlow在少步采样场景下性能匹配或超越基于一致性的方法，并能随采样步长预算扩展。

Insight: 创新点在于将蒸馏目标从固定的端点一致性映射扩展为任意时间间隔的流图转移学习，并引入流图反向模拟来分解完整的欧拉展开，实现高效的在策略蒸馏，减少了测试时的离散化误差和因果生成中的曝光偏差。

Abstract: Few-step video generation has been significantly advanced by consistency distillation. However, the performance of consistency-distilled models often degrades as more sampling steps are allocated at test time, limiting their effectiveness for any-step video diffusion. This limitation arises because consistency distillation replaces the original probability-flow ODE trajectory with a consistency-sampling trajectory, weakening the desirable test-time scaling behavior of ODE sampling. To address this limitation, we introduce AnyFlow, the first any-step video diffusion distillation framework based on flow maps. Instead of distilling a model for only a few fixed sampling steps, AnyFlow optimizes the full ODE sampling trajectory. To this end, we shift the distillation target from endpoint consistency mapping $(z_{t}\rightarrow z_{0})$ to flow-map transition learning $(z_{t}\rightarrow z_{r})$ over arbitrary time intervals. We further propose Flow Map Backward Simulation, which decomposes a full Euler rollout into shortcut flow-map transitions, enabling efficient on-policy distillation that reduces test-time errors (i.e., discretization error in few-step sampling and exposure bias in causal generation). Extensive experiments across both bidirectional and causal architectures, at scales ranging from 1.3B to 14B parameters, demonstrate that AnyFlow achieves performance matches or surpasses consistency-based counterparts in the few-step regime, while scaling with sampling step budgets.

[92] Coordinating Multiple Conditions for Trajectory-Controlled Human Motion Generation cs.CV | cs.AIPDF

Deli Cai, Haoyang Ma, Changxing Ding

TL;DR: 本文提出了一种名为CMC的解耦框架，用于协调文本描述和空间轨迹两种条件，以生成高质量、轨迹可控的人体运动。该方法采用分治策略，通过轨迹控制阶段和运动补全阶段，分别处理轨迹条件和文本条件，并引入选择性修复机制来缓解数据过拟合问题。

Details

Motivation: 现有轨迹控制人体运动生成方法存在两个关键局限：文本与轨迹条件在去噪过程中相互冲突，导致运动质量下降或轨迹跟随不准确；冗余的运动表示导致组件间不一致，轨迹控制不稳定。

Result: 在HumanML3D和KIT数据集上的实验表明，CMC在控制精度和运动质量方面达到了最先进的性能。

Insight: 创新点在于提出了一种分阶段解耦的条件协调框架，将轨迹控制与文本驱动的运动补全分离，并通过选择性修复机制增强训练鲁棒性。这为解决多模态条件冲突和表示不一致问题提供了有效思路。

Abstract: Trajectory-controlled human motion generation aims to synthesize realistic human motions conditioned on both textual descriptions and spatial trajectories. However, existing methods suffer from two critical limitations: first, the conflict between text and trajectory conditions disrupts the denoising process, resulting in compromised motion quality or inaccurate trajectory following; second, the use of redundant motion representations introduces inconsistencies between motion components, leading to instability during trajectory control. To address these challenges, we propose CMC, a decoupled framework that effectively coordinates text and trajectory conditions through a divide-and-conquer strategy. CMC follows a divide-and-conquer paradigm, comprising two cascaded stages: Trajectory Control and Motion Completion. In the first stage, a diffusion model generates a simplified representation of the controlled joints under trajectory guidance, based on the given trajectories, ensuring accurate and stable trajectory following. In the second stage, a text-conditioned diffusion inpainting model generates full-body motions using the simplified representation from the first stage as partial observations. To mitigate overfitting caused by limited inpainting training data, we further introduce the Selective Inpainting Mechanism (SIM), which alternates between text-to-motion generation and motion inpainting tasks during training. Experiments on HumanML3D and KIT datasets demonstrate that CMC achieves state-of-the-art performance in control accuracy and motion quality, demonstrating its effectiveness in coordinating multimodal conditions and representations.

[93] Weakly-Supervised Spatiotemporal Anomaly Detection cs.CV | cs.AIPDF

Urvi Gianchandani, Praveen Tirupattur, Mubarak Shah

TL;DR: 本文提出了一种弱监督时空异常检测方法，仅利用视频级别的正常/异常标签进行训练，无需精细标注。通过将正常和异常视频片段分别视为正负包，应用多示例排序损失（MIL）来学习特征，并同时检测时空区域的异常。

Details

Motivation: 由于视频标注耗时，本文旨在仅使用弱监督（视频级标签）来解决时空异常检测问题，避免依赖精细的帧级或区域级标注。

Result: 在UCF Crime2Local数据集（包含UCF Crime数据集的部分时空标注）上展示了实验结果，但摘要未具体说明定量结果或是否达到SOTA水平。

Insight: 创新点在于结合多示例学习（MIL）框架处理弱监督标签，并同时关注时空维度的异常定位，可借鉴于其他需要减少标注成本的视频分析任务。

Abstract: In this paper, we explore a weakly supervised method for anomaly detection. Since annotating videos is time-consuming, we only look at weak video-level labels during training. This means that given a video, we know that it is either normal or contains an anomaly, but no further annotations are used to train the network. Features are extracted from video clips that are either normal or anomalous. These features are used to determine anomaly scores for spatiotemporal regions of the clips based on a classifier and the implementation of a multiple instance ranking loss (MIL). We represent both anomalous and normal video clips as positive and negative bags, respectively, to apply MIL. Furthermore, since anomalies are usually localized to a part of a frame rather than the whole frame, we chose to explore temporal as well as spatial anomaly detection. We show our results on the UCF Crime2Local Dataset, which contains spatiotemporal annotations for a portion of the UCF Crime Dataset.

[94] VoxCor: Training-Free Volumetric Features for Multimodal Voxel Correspondence cs.CVPDF

Guney Tombak, Ertunc Erdil, Ender Konukoglu

TL;DR: 本文提出了一种名为VoxCor的训练免费方法，用于从冻结的2D视觉Transformer基础模型中生成可重用的三维体素特征表示。该方法通过结合三平面ViT推理和加权偏最小二乘投影，在离线拟合阶段利用体素对应关系选择模态稳定的解剖方向，从而在变换阶段无需微调或配准即可为新体积生成特征。

Details

Motivation: 解决跨模态3D医学图像分析中体素表示需要在不同成像对比度、扫描仪和采集协议下保持解剖一致性的问题，克服现有方法仅使用单一解剖轴、特征不可重用且无法迁移到新体积的局限性。

Result: 在受试者内腹部MR-CT和受试者间HCP T2w-T1w任务上，通过可变形配准、体素k近邻分割和分割中心地标定位进行评估，VoxCor在最具挑战性的跨受试者、跨模态迁移设置中表现提升，降低了编码器敏感性，并在配准性能上与手工描述符和学习的3D特征相当。

Insight: 创新点在于提出了一种无需训练的三平面特征融合与投影框架，通过加权偏最小二乘投影提取模态稳定的解剖方向，实现了可重用、可迁移的体素对应特征，为下游多模态分析提供了通用特征层。

Abstract: Cross-modal 3D medical image analysis requires voxelwise representations that remain anatomically consistent across imaging contrasts, scanners, and acquisition protocols. Recent work has shown that frozen 2D Vision Transformer (ViT) foundation models can support such representations, but typical pipelines extract features along a single anatomical axis and adapt those features inside a registration solver for one image pair at a time, leaving complementary viewing directions unused and producing representations that do not transfer to new volumes. We introduce VoxCor, a training-free fit–transform method for reusable volumetric feature representations from frozen 2D ViT foundation models. During an offline fitting phase, VoxCor combines triplanar ViT inference with a compact closed-form weighted partial least squares (WPLS) projection that uses fitting-time voxel correspondences to select modality-stable anatomical directions in the triplanar feature space. At transform time, new volumes are mapped by triplanar ViT inference and linear projection alone, without fine-tuning or registration. Voxel correspondences can then be queried directly by nearest-neighbor search. We evaluate VoxCor on intra-subject Abdomen MR–CT and inter-subject HCP T2w–T1w tasks using deformable registration, voxelwise k-nearest-neighbor segmentation, and segmentation-center landmark localization. VoxCor improves the hardest cross-subject, cross-modality transfer settings, reduces encoder sensitivity for dense correspondence transfer, and yields registration performance competitive with handcrafted descriptors and learned 3D features. This positions VoxCor as a reusable feature layer for downstream multimodal analysis beyond pairwise registration. Code, configuration files, and implementation details are publicly available on GitHub at \href{https://github.com/guneytombak/VoxCor}{guneytombak/VoxCor}.

[95] EvoGround: Self-Evolving Video Agents for Video Temporal Grounding cs.CVPDF

Minjoon Jung, Byoung-Tak Zhang, Lorenzo Torresani

TL;DR: EvoGround是一个由提议者和求解者两个自进化智能体组成的框架，用于视频时序定位任务。该框架无需人工标注数据，通过强化学习循环从原始视频中学习，在多个基准测试中达到或超越了全监督模型的性能，并成为无需人工标签的细粒度视频描述生成SOTA方法。

Details

Motivation: 解决视频时序定位任务依赖大规模、任务特定且标注成本高昂的数据集的问题，旨在实现无需人工标注数据的自监督学习。

Result: 在仅使用2.5K个未标注视频训练后，EvoGround在多个VTG基准测试中达到或超越了全监督模型的性能，并成为细粒度视频描述生成的SOTA方法。

Insight: 创新性地提出了由提议者和求解者组成的耦合自进化智能体框架，通过自增强的强化学习循环实现从原始视频的无监督学习，并展示了在视频理解和生成任务上的强大泛化能力。

Abstract: Video temporal grounding (VTG) takes an untrimmed video and a natural-language query as input and localizes the temporal moment that best matches the query. Existing methods rely on large, task-specific datasets requiring costly manual annotation. We introduce EvoGround, a framework of two coupled self-evolving agents, a proposer and a solver, that learn temporal grounding from raw videos without any human-labeled data. The proposer generates query–moment pairs from raw videos, while the solver learns to ground them and feeds back signals that improve the proposer in return. Through this self-reinforcing reinforcement-learning loop, the two agents are initialized from the same backbone and mutually improve across iterations. Trained on 2.5K unlabeled videos, EvoGround matches or surpasses fully supervised models across multiple VTG benchmarks, while emerging as a state-of-the-art fine-grained video captioner without manual labels.

[96] JANUS: Anatomy-Conditioned Gating for Robust CT Triage Under Distribution Shift cs.CVPDF

Lavsen Dahal, Yubraj Bhandari, Geoffrey Rubin, Joseph Y. Lo

TL;DR: JANUS是一种用于CT分诊的生理学引导双流架构，通过解剖学引导门控将视觉嵌入与宏观放射组学先验条件化，以提高模型在不同病理和机构分布偏移下的准确性和可靠性。

Details

Motivation: 自动化CT分诊需要模型在多种病理下保持准确，并在机构分布偏移下保持可靠，而现有视觉Transformer模型主要依赖外观特征，忽略了临床重要的定量成像生物标志物。

Result: 在MERLIN测试集（N=5082）上，JANUS实现了宏观AUROC 0.88和AUPRC 0.74，优于所有复现基线；在外部数据集（N=2000）上AUROC为0.87，在尺寸和衰减定义的发现上提升最大，并在两个数据集上改善了校准。

Insight: 创新点包括引入生理学引导的双流架构和Anatomical Guided Gating机制，将宏观放射组学先验与视觉表示结合，通过Physiological Veto Rate量化预测抑制，有效减少分布偏移下的高置信度假阳性，提升模型的判别性和可靠性。

Abstract: Automated CT triage requires models that are simultaneously accurate across diverse pathologies and reliable under institutional shift. While Vision Transformers provide strong visual representations, many clinically significant findings are defined by quantitative imaging biomarkers rather than appearance alone. We introduce JANUS, a physiology-guided dual-stream architecture that conditions visual embeddings on macro-radiomic priors via Anatomically Guided Gating. On the MERLIN test set (N=5082), JANUS attains macro-AUROC 0.88 and AUPRC 0.74, outperforming all reproduced baselines. It generalizes to an external dataset N=2000; AUROC 0.87), with the largest gains on findings defined by size and attenuation as well as improved calibration on both datasets. We further quantify prediction suppression using the Physiological Veto Rate (PVR), showing that under domain shift JANUS reduces high-confidence false positives substantially more often than true positives. Together, these results are consistent with physically grounded conditioning that improves both discrimination and reliability in CT triage. Code is made publicly available at github repository https://github.com/lavsendahal/janus and model weights are at https://huggingface.co/lavsendahal/janus.

[97] Training Long-Context Vision-Language Models Effectively with Generalization Beyond 128K Context cs.CVPDF

Zhaowei Wang, Lishu Luo, Haodong Duan, Weiwei Liu, Sijin Wu

TL;DR: 本文系统研究了大型视觉语言模型的长上下文持续预训练方法，提出了一种名为MMProLong的模型，该模型通过仅使用50亿token的预算，将Qwen2.5-VL-7B模型的上下文长度从32K扩展到128K，并在长文档VQA任务上取得了显著提升，同时展现出超越训练窗口的泛化能力。

Details

Motivation: 长上下文建模已成为现代大型视觉语言模型的核心能力，但在实际训练方法上，特别是长上下文数据混合的设计与平衡方面，仍缺乏充分探索。

Result: 提出的MMProLong模型在长文档VQA任务上提升了7.1%的得分，并在未经额外训练的情况下，在256K和512K的上下文长度上保持了强劲性能，超越了其128K的训练窗口。

Insight: 研究发现：1）平衡的数据分布优于聚焦目标长度（如128K）的数据；2）检索是主要瓶颈，需要富含检索任务的数据混合；3）纯长文档VQA数据能较好地保留短上下文能力。这些发现构成了实用的LongPT训练方案和实证基础。

Abstract: Long-context modeling is becoming a core capability of modern large vision-language models (LVLMs), enabling sustained context management across long-document understanding, video analysis, and multi-turn tool use in agentic workflows. Yet practical training recipes remain insufficiently explored, particularly for designing and balancing long-context data mixtures. In this work, we present a systematic study of long-context continued pre-training for LVLMs, extending a 7B model from 32K to 128K context with extensive ablations on long-document data. We first show that long-document VQA is substantially more effective than OCR transcription. Building on this observation, our ablations further yield three key findings: i) for sequence-length distribution, balanced data outperforms target-length-focused data (e.g., 128K), suggesting that long-context ability requires generalizable key-information retrieval across various lengths and positions; ii) retrieval remains the primary bottleneck, favoring retrieval-heavy mixtures with modest reasoning data for task diversity; and iii) pure long-document VQA largely preserves short-context capabilities, suggesting that instruction-formatted long data reduces the need for short-data mixing. Based on these findings, we introduce MMProLong, obtained by long-context continued pre-training from Qwen2.5-VL-7B with only a 5B-token budget. MMProLong improves long-document VQA scores by 7.1% and maintains strong performance at 256K and 512K contexts beyond its 128K training window, without additional training. It further generalizes to webpage-based multimodal needle retrieval, long-context vision-text compression, and long-video understanding without task-specific supervision. Overall, our study establishes a practical LongPT recipe and an empirical foundation for advancing long-context vision-language models.

[98] Unlocking Patch-Level Features for CLIP-Based Class-Incremental Learning cs.CVPDF

Hao Sun, Zi-Jun Ding, Da-Wei Zhou

TL;DR: 本文提出SPA方法，通过挖掘CLIP模型中长期被忽视的局部（patch-level）语义信息来增强基于CLIP的类增量学习性能。该方法利用GPT-5生成类别语义描述来指导选择判别性局部视觉特征，并通过最优传输进行跨模态对齐，同时引入任务特定投影器和基于高斯统计的伪特征采样来缓解灾难性遗忘。

Details

Motivation: 现有基于CLIP的类增量学习方法主要关注全局图像嵌入与文本提示的对齐，丢弃了CLIP编码器中丰富的局部（patch-level）语义信息，而这些局部线索（如识别兔子时的长耳朵、毛茸茸尾巴）能提供互补的识别证据。

Result: 大量实验表明，SPA方法在类增量学习基准上取得了最先进的（state-of-the-art）性能。

Insight: 创新点在于首次系统性地挖掘并利用CLIP预训练模型中蕴含的局部语义信息进行类增量学习，通过语义引导的局部特征选择与跨模态对齐来增强识别能力，并结合任务自适应和特征校准来缓解遗忘。

Abstract: Class-Incremental Learning (CIL) enables models to continuously integrate new knowledge while mitigating catastrophic forgetting. Driven by the remarkable generalization of CLIP, leveraging pre-trained vision-language models has become a dominant paradigm in CIL. However, current work primarily focuses on aligning global image embeddings (i.e., [CLS] token) with their corresponding text prompts (i.e., [EOS] token). Despite their good performance, we find that they discard the rich patch-level semantic information inherent in CLIP’s encoders. For instance, when recognizing a rabbit, local patches may encode its distinctive cues, such as long ears and a fluffy tail, which can provide complementary evidence for recognition. Based on the above observation, we propose SPA (Semantic-guided Patch-level Alignment) for CLIP-based CIL, which aims to awaken long-neglected local representations within CLIP. Specifically, for each class, we first construct representative and diverse visual samples and feed them to GPT-5 as visual guidance to generate class-wise semantic descriptions. These descriptions are used to guide the selection of discriminative patch-level visual features. Building upon these selected patches, we further employ optimal transport to align selected patch tokens with semantic tokens from class-wise descriptions, yielding a structured cross-modal alignment that improves recognition. Furthermore, we introduce task-specific projectors for effective adaptation to downstream incremental tasks, and sample pseudo-features from stored class-wise Gaussian statistics to calibrate old-class representations, thereby mitigating catastrophic forgetting. Extensive experiments demonstrate that SPA achieves state-of-the-art performance.

[99] R-DMesh: Video-Guided 3D Animation via Rectified Dynamic Mesh Flow cs.CV | cs.GR | cs.LGPDF

Zijie Wu, Lixin Xu, Puhua Jiang, Sicong Liu, Chunchao Guo

TL;DR: 本文提出了R-DMesh框架，用于解决视频引导3D动画中的姿态错位问题。该方法通过一个变分自编码器（VAE）将输入解耦为条件基础网格、相对运动轨迹和关键的校正偏移量，并利用Triflow Attention机制和基于Rectified Flow的扩散Transformer，生成与视频上下文对齐的高保真4D网格序列。

Details

Motivation: 解决视频引导3D动画中常见的姿态错位问题，即用户提供的静态网格初始姿态与参考视频起始帧不匹配，导致直接运动迁移产生严重几何失真或动画失败。

Result: 在构建的大规模数据集Video-RDMesh（包含超过50万个动态网格序列）上进行实验，结果表明R-DMesh不仅能有效解决对齐问题，还支持姿态重定向和整体4D生成等下游应用。

Insight: 创新点在于引入显式解耦的VAE来学习校正偏移量，实现输入网格姿态与视频初始状态的自动对齐；采用Triflow Attention机制调制三个正交流，保证校正和动画过程中的物理一致性和局部刚性；利用基于Rectified Flow的扩散Transformer，将预训练视频潜空间中的时空先验有效迁移到3D域。

Abstract: Video-guided 3D animation holds immense potential for content creation, offering intuitive and precise control over dynamic assets. However, practical deployment faces a critical yet frequently overlooked hurdle: the pose misalignment dilemma. In real-world scenarios, the initial pose of a user-provided static mesh rarely aligns with the starting frame of a reference video. Naively forcing a mesh to follow a mismatched trajectory inevitably leads to severe geometric distortion or animation failure. To address this, we present Rectified Dynamic Mesh (R-DMesh), a unified framework designed to generate high-fidelity 4D meshes that are ``rectified’’ to align with video context. Unlike standard motion transfer approaches, our method introduces a novel VAE that explicitly disentangles the input into a conditional base mesh, relative motion trajectories, and a crucial rectification jump offset. This offset is learned to automatically transform the arbitrary pose of the input mesh to match the video’s initial state before animation begins. We process these components via a Triflow Attention mechanism, which leverages vertex-wise geometric features to modulate the three orthogonal flows, ensuring physical consistency and local rigidity during the rectification and animation process. For generation, we employ a Rectified Flow-based Diffusion Transformer conditioned on pre-trained video latents, effectively transferring rich spatio-temporal priors to the 3D domain. To support this task, we construct Video-RDMesh, a large-scale dataset of over 500k dynamic mesh sequences specifically curated to simulate pose misalignment. Extensive experiments demonstrate that R-DMesh not only solves the alignment problem but also enables robust downstream applications, including pose retargeting and holistic 4D generation.

cs.LG [Back]

[100] Training Large Language Models to Predict Clinical Events cs.LG | cs.AI | cs.CLPDF

Benjamin Turtel, Paul Wilczewski, Kris Skotheim

TL;DR: 本文提出了一种利用纵向临床笔记训练大型语言模型进行临床事件预测的方法，通过将MIMIC-III中的时序笔记转化为包含患者历史上下文、关于未来事件的自然语言问题及后续文档标签的示例，构建了包含6900个预测示例的数据集。使用LoRA适配器微调基础模型，显著提升了预测校准度和准确性。

Details

Motivation: 解决如何将纵向临床笔记中丰富的时序信号有效转化为临床预测任务的监督信息，避免依赖人工设计的结构化特征或特定终点的分类器。

Result: 在包含702次住院的MIMIC-III数据集上，LoRA微调模型相比基础提示模型，将预期校准误差从0.1269降至0.0398，Brier分数从0.199降至0.145，并在保留问题上略微优于GPT-5的点估计结果。

Insight: 创新点在于将Foresight Learning框架扩展至临床预测，通过自然语言问答形式构建监督数据，实现了从纵向笔记中生成可重用的预测监督信号；方法上采用轻量级LoRA适配器进行高效微调，在保持模型通用性的同时提升了专业领域性能。

Abstract: Longitudinal clinical notes contain rich evidence of how patients evolve over time, but converting this signal into training supervision for clinical prediction remains challenging. We extend Foresight Learning to clinical prediction by converting time-ordered MIMIC-III notes into examples consisting of past patient context, a natural-language question about a possible future event, and a label resolved from later documentation. This process yields 6,900 prediction examples from 702 admissions across medications, procedures, organ support, microbiology, and mortality. A small LoRA adapter trained on these examples improves over the prompted base model, reducing expected calibration error from 0.1269 to 0.0398 and Brier score from 0.199 to 0.145, while slightly outperforming GPT-5 point estimates on held-out questions. The approach enables reusable clinical prediction supervision from longitudinal notes without hand-engineered structured features or endpoint-specific classifiers.

[101] From Instance Selection to Fixed-Pool Data Recipe Search for Supervised Fine-Tuning cs.LG | cs.CLPDF

Haodong Wu, Jiahao Zhang, Lijie Hu, Yongqi Zhang

TL;DR: 本文提出了一种名为AutoSelection的两层求解器，用于解决监督微调（SFT）数据选择问题，将其重新定义为固定池数据配方搜索问题。该方法通过解耦基于缓存信号的数据池具体化和昂贵的完整评估，在90K指令池上实现了优于全数据训练、随机配方搜索、随机top-k和单操作符选择器的性能。

Details

Motivation: 现有SFT数据选择通常简化为实例排序（如top-k选择），但有效的SFT训练子集往往通过有序的整理配方（包括过滤、混合和去重等操作）来构建，因此需要一种更系统的方法来搜索高质量的数据配方。

Result: 在90K指令池上的实验表明，AutoSelection在三个基础模型上实现了最强的分布内推理平均性能，优于全数据训练、随机配方搜索、随机top-k和单操作符选择器。额外的分布外图推理结果、搜索稳定性分析、结构消融实验和1.5B到7B模型的迁移检查进一步证明了配方结构的重要性。

Insight: 创新点在于将SFT数据选择问题重新定义为固定池数据配方搜索，并提出了一个解耦具体化和评估的两层求解器。客观来看，该方法强调了数据整理流程（配方结构）的整体优化比单个选择操作符更重要，为数据选择提供了新的系统化视角。

Abstract: Supervised fine-tuning (SFT) data selection is commonly formulated as instance ranking: score each example and retain a top-$k$ subset. However, effective SFT training subsets are often produced through ordered curation recipes, where filtering, mixing, and deduplication operators jointly shape the final data distribution. We formulate this problem as fixed-pool data recipe search: given a raw instruction pool and a library of grounded operators, the goal is to discover an executable recipe that constructs a high-quality selected subset under a limited budget of full SFT evaluations, without generating, rewriting, or augmenting training samples. We introduce AutoSelection, a two-layer solver that decouples fixed-pool materialization based on cached task-, data-, and model-side signals from expensive full evaluation, using warmup probes, realized subset states, local recipe edits, Gaussian-process-assisted ranking, and stagnation-triggered reseeding. Experiments on a 90K instruction pool show that AutoSelection achieves the strongest in-distribution reasoning average across three base models, outperforming full-data training, random recipe search, random top-$k$, and single-operator selectors. Additional Out-of-distribution graph-reasoning results, search-stability analyses, structural ablations, and 1.5B-to-7B transfer checks further show that recipe structure matters beyond individual selection operators. Code is available at https://github.com/w253/AutoSelection.

[102] Effective Context in Transformers: An Analysis of Fragmentation and Tokenization cs.LG | cs.CL | cs.ITPDF

Amirmehdi Jafari Fesharaki, Mohammadamin Rami, Aslan Tchamkerten

TL;DR: 本文研究了Transformer模型中不同数据表示（如字节、字符、子词标记）对有限上下文预测能力的影响，揭示了两种互补现象：碎片化（fragmentation）会损害预测性能，而贪婪标记化（如BPE）则能提升有限上下文的有效性。

Details

Motivation: 解决在固定上下文窗口下，不同数据表示如何影响有限上下文预测器的性能这一基本问题，特别是解释字节/字符级模型（如ByT5、CANINE）与子词标记化模型之间的性能差距。

Result: 理论分析表明，碎片化会严格增加最优有限上下文对数损失；贪婪标记化则能使短标记窗口模拟更长的源上下文窗口，并给出了损失保证条件。

Insight: 提出了一个基于有限上下文信息论的框架来分析表示选择，创新点包括引入’碎片化’概念解释性能下降，以及通过’可靠上下文覆盖’诊断实际标记化方法。

Abstract: Transformers predict over a representation of a sequence. The same data can be written as bytes, characters, or subword tokens, and these representations may be lossless. Yet, under a fixed context window, they need not expose the same information to the model. This raises a basic question: how does the choice of representation change what a finite-context predictor can achieve? We study this question on Markov sources and uncover two complementary phenomena. First, we observe that moving to smaller representation units can hurt prediction even when the context window is enlarged to cover the relevant source history. To explain this, we introduce fragmentation: a lossless recoding that replaces each source symbol by several smaller units. We prove that fragmentation can strictly increase the optimal finite-context log-loss, showing that the gap is not merely an optimization or capacity issue, but can be intrinsic to the representation. This gives a theoretical account of the finite-context gap observed in byte- and character-level models such as ByT5 and CANINE relative to subword-tokenized models. Second, we study the opposite direction: greedy tokenization – BPE, WordPiece, and related methods – which groups source symbols into larger units. We show that tokenization can make a short token window behave like a longer source-context window, and we give a loss guarantee describing when this is achievable. The guarantee depends on how reliably token windows span the needed source history, together with the compression rate of the tokenizer. This also yields a simple diagnostic for real tokenizers: measuring how much source context a fixed token window reliably contains. Together, the two directions establish a finite-context information-theoretic framework for reasoning about representation choices in Transformers.

[103] Temper and Tilt Lead to SLOP: Reward Hacking Mitigation with Inference-Time Alignment cs.LG | cs.AI | cs.CLPDF

Ye Wang, Jing Liu, Toshiaki Koike-Akino

TL;DR: 本文提出了一种名为SLOP的推理时对齐方法，通过结合参考模型温度调整和集成多个生成式奖励模型，以缓解奖励黑客问题，并提供了校准权重的算法来提升鲁棒性。

Details

Motivation: 旨在提供一种轻量级的推理时对齐技术，以替代或补充昂贵的强化学习，并实现随着对齐目标和奖励目标变化而持续适应，同时解决现有方法中的奖励黑客问题。

Result: 实验表明，所提出的校准算法在保持对齐性能的同时提高了鲁棒性，但摘要未具体说明基准测试或与SOTA的比较结果。

Insight: 创新点在于将参考模型温度调整与集成奖励模型（SLOP）相结合，并引入权重校准算法来减轻奖励黑客，这为推理时对齐提供了更通用和稳健的框架。

Abstract: Inference-time alignment techniques offer a lightweight alternative or complement to costly reinforcement learning, while enabling continual adaptation as alignment objectives and reward targets evolve. Existing theoretical analyses justify these methods as approximations to sampling from distributions optimally tilted toward a given reward model. We extend these techniques by introducing reference-model temperature adjustment, which leads to further generalization of inference-time alignment to ensembles of generative reward models combined as a sharpened logarithmic opinion pool (SLOP). To mitigate reward hacking, we propose an algorithm for calibrating SLOP weight parameters and experimentally demonstrate that it improves robustness while preserving alignment performance.

[104] Multi-Objective and Mixed-Reward Reinforcement Learning via Reward-Decorrelated Policy Optimization cs.LG | cs.CLPDF

Yang Bai, Kaiyuan Liu, Ziyuan Zhuang, Jiahong Zhou, Rongxiang Weng

TL;DR: 本文提出了一种名为奖励解耦策略优化（RDPO）的方法，旨在解决多目标和混合奖励强化学习环境中，由于奖励分布异质性和维度相关性导致的优势函数计算不稳定问题。RDPO通过幅度感知分位数归一化稳定不同尺度奖励的优势分配，并使用马氏白化处理奖励维度间的相关性。在LongCat-Flash模型的后训练中应用RDPO，提升了指令遵循、写作质量和对抗硬提示的鲁棒性。

Details

Motivation: 解决多任务和混合奖励强化学习环境中，异质奖励分布和相关奖励维度导致标量优势函数计算不稳定、影响策略优化的核心挑战。

Result: 在LongCat-Flash模型的后训练中应用RDPO，在指令遵循、写作质量和对抗硬提示的鲁棒性方面得到提升，同时在推理和代码评估任务上保持了广泛的竞争力。

Insight: 创新点在于将奖励处理分解为两个明确步骤：针对奖励幅度的归一化和针对维度相关性的白化处理，从而系统性地稳定优势估计，为处理复杂奖励结构提供了一种模块化、可解释的解决方案。

Abstract: Complex reinforcement learning environments frequently employ multi-task and mixed-reward formulations. In these settings, heterogeneous reward distributions and correlated reward dimensions often destabilize the construction of scalar advantages. To address these challenges, we propose Reward-Decorrelated Policy Optimization (RDPO), a reward-processing method designed to explicitly target both failure modes. RDPO first utilizes Magnitude-Aware Quantile normalization to stabilize prompt-level advantage allocation across binary, fractional, and continuous rewards. It then applies Mahalanobis whitening within each active reward subspace to mitigate correlation redundancy prior to aggregation. When applied during the post-training of LongCat-Flash, RDPO enhances instruction following, writing quality, and robustness to hard prompts while remaining broadly competitive on reasoning and coding evaluations.

[105] Robust and Explainable Bicuspid Aortic Valve Diagnosis Using Stacked Ensembles on Echocardiography cs.LG | cs.AI | cs.CVPDF

Christos Chrysanthos Nikolaidis, Vasileios Sachpekidis, Nikolas Moustakidis, Theofilos Moustakidis, Pavlos S. Efraimidis

TL;DR: 本文提出了一种基于经胸超声心动图（TTE）视频的可解释AI模型，用于区分二叶式主动脉瓣（BAV）和三叶式主动脉瓣（TAV）。该模型采用多主干视频集成方法，在90例患者数据上通过防泄漏的分层外部交叉验证进行评估，实现了高F1分数和召回率，并通过Grad-CAM和SHAP提供可视化解释。

Details

Motivation: 经胸超声心动图是诊断二叶式主动脉瓣的一线成像方式，但其诊断性能受操作者专业知识和图像质量影响较大。因此，需要开发一种可靠且可解释的AI模型，以支持在非专科或资源有限的临床环境中实现更早、更准确的诊断。

Result: 在校准的堆叠集成模型上，在固定的外部数据分割和10个随机种子下，外部交叉验证的F1分数达到0.907，召回率达到0.877。

Insight: 创新点在于结合了多主干视频集成与可解释性技术（如帧级Grad-CAM和全局聚合的SHAP值），不仅提升了分类性能，还实现了病例级别的透明可审计性，有助于临床信任和模型部署。

Abstract: Transthoracic echocardiography (TTE) is the first-line imaging modality for diagnosing bicuspid aortic valve (BAV), yet diagnostic performance varies with operator expertise and image quality. We developed an explainable AI model that distinguishes BAV from tricuspid aortic valves (TAV) using routinely acquired parasternal long-axis (PLAX) cine loops. A multi-backbone video ensemble was trained and evaluated using a leakage-aware, stratified outer cross-validation protocol on $N{=}90$ patient studies (48 BAV, 42 TAV). Across fixed outer splits and 10 random seeds, the calibrated stacked ensemble achieved an outer-CV F1-score of $0.907$ and recall of $0.877$. Frame-level Grad-CAM localized salient evidence to the aortic root and leaflet plane, while globally aggregated SHAP values quantified each video backbone’s contribution to the stacked prediction, enabling transparent, case-level auditability. These findings indicate that PLAX-based video ensembles can support reliable BAV/TAV classification from routine echocardiographic cine loops and may facilitate earlier detection in non-specialist or resource-limited clinical settings.

cs.GR [Back]

[106] Rigel3D: Rig-aware Latents for Animation-Ready 3D Asset Generation cs.GR | cs.CVPDF

Nikitas Chatzis, Marios Loizou, Evangelos Kalogerakis

TL;DR: Rigel3D是一种生成动画就绪3D资产（即带有骨骼绑定、关节层次结构和蒙皮权重的网格）的生成方法。它通过耦合的表面和骨骼结构化潜在表示联合建模几何与骨骼结构，并引入开放词汇关节标注模块，以支持下游动画工作流。

Details

Motivation: 现有3D生成模型通常输出静态资产，缺乏动画所需的骨骼绑定等结构，限制了其在游戏、电影、模拟等需要角色运动的应用中的使用。

Result: 在大规模绑定资产数据集上的实验表明，该方法能生成多样化、高质量的动画就绪资产，并在多个指标上优于现有的绑定基线方法。

Insight: 核心创新在于通过耦合的潜在表示联合生成几何与骨骼结构，而非后处理绑定；同时，开放词汇关节标注模块利用视觉-语言空间实现了与任意重定向模板的对应，增强了实用性。

Abstract: Recent 3D generative models can synthesize high-quality assets, but their outputs are typically static: they lack the skeletal rigs, joint hierarchies, and skinning weights required for animation. This limits their use in games, film, simulation, virtual agents, and embodied AI, where assets must not only look plausible but also move plausibly. We introduce Rigel3D, a generative method for animation-ready 3D assets represented as rigged meshes. Unlike post-hoc auto-rigging methods that attach rigs to completed shapes, our method jointly models geometry and rig structure through coupled surface and skeleton structured latent representations. A rig-aware autoencoder decodes these representations into mesh geometry, skeleton topology, joint coordinates, and skinning weights, while a two-stage latent generative model synthesizes both surface and skeleton representations for image-conditioned generation. To support downstream animation workflows, we further introduce an open-vocabulary joint labeling module that embeds generated joints into a shared vision-language space, enabling correspondence to arbitrary retargeting templates. Experiments on large-scale rigged asset datasets demonstrate that our method generates diverse, high-quality animation-ready assets and outperforms existing rigging baselines across multiple metrics.

cs.CR [Back]

[107] Model-Agnostic Lifelong LLM Safety via Externalized Attack-Defense Co-Evolution cs.CR | cs.CLPDF

Xiaozhe Zhang, Chaozhuo Li, Hui Liu, Shaocheng Yan, Bingyu Yan

TL;DR: 本文提出了EvoSafety，一个模型无关的终身LLM安全框架，通过外部化的攻防协同进化来解决大语言模型对抗性提示的脆弱性问题。该框架包含一个带有对抗性技能库的攻击策略以持续探测漏洞，以及一个轻量级、可检索记忆的辅助防御模型，支持Steer和Guard两种防御模式，实现高效、可迁移的安全增强。

Details

Motivation: 现有LLM安全范式通常将红队测试和后训练耦合在一个封闭的、以策略为中心的循环中，导致攻击发现迅速饱和，防御效率低下、僵化且难以跨模型迁移，无法持续暴露新的失效模式。

Result: 在Guard模式下，EvoSafety实现了99.61%的防御成功率，仅用Qwen3Guard-8B 37.5%的参数，性能超出其14.13%，同时在良性查询上保持了推理性能。

Insight: 核心创新在于将安全机制外部化、持久化和模块化：通过外部对抗技能库支持攻击的持续进化，通过轻量级辅助防御模型（结合记忆检索）实现模型无关、可迁移的安全增强，并统一了引导（Steer）和守卫（Guard）两种防御模式。这为构建开放、可进化的终身安全系统提供了新思路。

Abstract: Large language models remain vulnerable to adversarial prompts that elicit harmful outputs. Existing safety paradigms typically couple red-teaming and post-training in a closed, policy-centric loop, causing attack discovery to suffer from rapid saturation and limiting the exposure of novel failure modes, while leaving defenses inefficient, rigid, and difficult to transfer across victim models. To this end, we propose EvoSafety, an LLM safety framework built around persistent, inspectable, and reusable external structures. For red teaming, EvoSafety equips the attack policy with an adversarial skill library, enabling continued vulnerability probing through simple library expansion after saturation, while supporting the evolution of adversarial vectors. For defense learning, EvoSafety replaces model-specific safety fine-tuning with a lightweight auxiliary defense model augmented with memory retrieval. This enables efficient, transferable, and model-agnostic safety improvements, while allowing robustness to be enhanced solely through memory updates. With a single training procedure, the defense policy can operate in both Steer and Guard modes: the former activates the victim model’s intrinsic defense mechanisms, while the latter directly filters harmful inputs. Extensive experiments demonstrate the superiority of EvoSafety: in Guard mode, it achieves a 99.61% defense success rate, outperforming Qwen3Guard-8B by 14.13% with only 37.5% of its parameters, while preserving reasoning performance on benign queries. Warning: This paper contains potentially harmful text.

[108] Still Camouflage, Moving Illusion: View-Induced Trajectory Manipulation in Autonomous Driving cs.CR | cs.CVPDF

Shuo Ju, Qingzhao Zhang, Huashan Chen, Xuheng Wang, Haotang Li

TL;DR: 本文提出了一种针对自动驾驶视觉系统的新型物理对抗攻击方法，利用视角变化本身作为攻击工具。通过在车辆上部署静态、被动的对抗性伪装，其外观随相对运动自然演变，从而在连续帧中诱导一致的特征漂移，使系统推断出物理上合理但错误的轨迹（如虚假切入），进而触发不必要的紧急制动。

Details

Motivation: 现有物理对抗攻击通常将视角变化视为挑战，需要复杂的多视角优化来确保攻击在变化视角下持续有效。本文的动机是探索能否将视角变化本身转化为攻击工具，从而简化攻击部署并利用自动驾驶的正常动态。

Result: 在nuScenes数据集上进行了演示，攻击成功率（以触发紧急制动事件衡量）最高可达87.5%，并且在不同场景背景、受害者车辆速度和感知模型上均表现出鲁棒性。

Insight: 创新点在于将视角变化从需要克服的挑战转变为攻击的核心机制，提出了一种静态被动伪装即可诱导动态感知错误的攻击范式。该方法无需主动干预或多视角鲁棒性优化，易于部署，揭示了自动驾驶系统在正常驾驶动态中存在的潜在安全漏洞。

Abstract: Existing physical adversarial attacks on vision-based autonomous driving induce time-evolving perception errors, including biased object tracking or trajectory prediction, through (i) sophisticated physical patch inducing detection box drift when entering the view distance, or (ii) dynamically changing patches that cause different perception errors at different time. In both cases, viewing-angle variation is treated as a challenge, requiring adversarial patches to remain effective across frames under varying views, leading to complex multi-view optimization. In contrast, we show that viewing-angle variation itself can be turned into an attack tool. We design a new attack paradigm where a static, passive adversarial camouflage is mounted on a vehicle whose view-dependent appearance naturally evolves with relative motion, inducing consistent feature drift across frames. This causes the system to infer a physically plausible but incorrect trajectory, such as a false cut-in, which propagates to downstream decision-making and triggers unnecessary braking. Unlike prior approaches that require multi-view robustness or active intervention, our attack emerges from normal driving dynamics and is easy to deploy: a parked vehicle with a natural camouflage can induce hard braking in passing autonomous vehicles. We demonstrate the novel attack on nuScenes dataset, showing the effectiveness with an end-to-end success rate of up to 87.5%, measured by hard-braking events, and robustness across different scene backgrounds, victim vehicle speeds, and perception models.

[109] ThermalTap: Passive Application Fingerprinting in VR Headsets via Thermal Side Channels cs.CR | cs.CV | cs.HCPDF

Mahsin Bin Akram, A H M Nazmus Sakib, OFM Riaz Rahman Aranya, Raveen Wijewickrama, Kevin Desai

TL;DR: 本文提出了ThermalTap，一种针对独立VR头显的被动非接触式侧信道攻击方法，通过分析头显外壳发射的长波红外辐射来识别正在运行的应用程序。该系统结合商用热成像相机和多模态传感器套件以消除环境噪声，在室内环境下仅需10秒热成像数据即可实现超过90%的识别准确率，揭示了热辐射作为沉浸式系统固有且无法避免的隐私风险。

Details

Motivation: 独立VR头显处理高度敏感的个人、职业和健康数据，但其对非接触物理侧信道的易感性尚未被充分探索。现有侧信道攻击通常需要恶意软件执行或物理接触外围设备，这使得攻击明显且可修补，因此需要研究更隐蔽的攻击方式。

Result: 在三个商用独立头显上使用六个应用程序进行评估。室内环境下，仅需10秒热成像数据，应用识别准确率超过90%；户外条件下，通过更长的会话级观察，尽管存在环境变化，多个应用仍可被识别，最强户外应用准确率达到81%。

Insight: 创新点在于首次将热辐射作为高保真代理来推断内部计算负载，实现无需设备交互的远程应用指纹识别。客观来看，该方法通过多模态传感器进行环境噪声归一化，在现实场景中实现了鲁棒性能，暴露了绕过当前软件级保护和物理访问控制的关键安全漏洞。

Abstract: Standalone virtual reality (VR) headsets process highly sensitive personal, professional, and health-related data, yet their susceptibility to non-contact physical side channels remains largely unexplored. Existing side-channel attacks typically require malicious software execution or physical access to peripherals, making them conspicuous and potentially patchable. This paper introduces ThermalTap, the first passive, non-contact side-channel attack that fingerprints VR applications solely from the long-wave infrared (LWIR) radiation emitted by the headset chassis. By treating a headset’s thermal signature as a high-fidelity proxy for internal computational workloads, ThermalTap enables remote application inference at meter-scale distances without any device interaction. To achieve robust performance in real-world settings, the system combines a commodity thermal camera with a multi-modal sensor suite (capturing ambient temperature, humidity, and airflow) to normalize environmental noise. We evaluate ThermalTap using six applications across three commercial standalone headsets. In indoor settings, ThermalTap identifies applications with over 90% accuracy using only 10 seconds of thermal camera data. Under outdoor conditions, with longer session-level observations, several applications remain identifiable despite environmental variability, with the strongest outdoor application reaching 81% accuracy. Our findings establish thermal radiation as a fundamental and unavoidable privacy risk for immersive systems, exposing a critical security gap that bypasses current software-level protections and physical access controls.

cs.SI [Back]

Jian Liao, Yujin Zheng, Suge Wang, Jianxing Zheng, Deyu Li

TL;DR: 论文提出了PERCEIVE基准，这是一个用于社交媒体上个性化情感和沟通行为理解的双语大规模数据集。它首次整合了作者内容、读者真实情感反馈、沟通行为、用户属性和社交图谱五个维度，旨在推动从作者中心到读者中心的个性化情感分析范式转变。

Details

Motivation: 当前社交媒体情感分析主要是作者中心的，忽略了不同读者对相同内容的主观情感反应，以及个体感知、沟通行为和社交网络之间的关键联系。

Result: 论文建立了全面的评估协议，测试了包括具有高级推理增强功能的大语言模型在内的最先进方法。结果表明，现有方法在处理这种多方面的、用户感知的任务时存在显著不足。

Insight: 创新点在于构建了一个整合多维度社交感知的基准，将情感分析与真实读者反馈、沟通意图和社交图谱相结合，为社交智能NLP研究提供了基础资源和明确方向，推动模型对社交媒体情感进行更统一的理解。

Abstract: Current emotion analysis in social media is predominantly author-centric, failing to capture the subjective nature of emotional responses across diverse readers. This paradigm overlooks the crucial link between individual perception, communication behavior, and the underlying social network. To bridge this gap, we introduce PERCEIVE, a novel bilingual (English and Chinese) large-scale benchmark that, to the best of our knowledge, is the first to integrate five critical dimensions for social perception: author-created content, genuine readers’ emotional feedback (derived from their comments), communication behavior, user attributes, and the social graph. This benchmark enables a paradigm shift towards truly personalized, reader-centric analysis, where different readers’ emotional responses to the same content are naturally captured through their real-world interactions. By annotating emotions from reader comments and synchronously capturing communication intent, PERCEIVE provides a unique resource to model the intrinsic coupling between emotion and behavior, grounded in social context. We establish a comprehensive evaluation protocol, testing state-of-the-art methods, including large language models (LLMs) with advanced reasoning enhancement. Our findings reveal significant shortcomings in existing approaches when handling this multifaceted, user-aware task. PERCEIVE offers a foundational resource and clear direction for future research in socially-intelligent NLP, pushing models towards a more unified understanding of emotion on social media.

cs.AI [Back]

[111] Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling cs.AI | cs.CLPDF

Yafu Li, Runzhe Zhan, Haoran Zhang, Shunkai Zhang, Yizhuo Li

TL;DR: 本文提出了一种简单统一的训练方法，将经过后训练（post-trained）的推理骨干模型转化为能在国际数学奥林匹克（IMO）和物理奥林匹克（IPhO）等竞赛中达到金牌水平的求解器。该方法采用基于反向困惑度的课程学习进行监督微调（SFT），以灌输严谨的证明搜索和自我检查行为，然后通过一个两阶段的强化学习（RL）流程进行扩展，最后利用测试时扩展（test-time scaling）提升性能。应用此方法训练的30B参数模型SU-01，能够在超过10万token的长轨迹上稳定推理，并在多项奥赛问题上达到金牌水平，同时展现出向数学和物理之外领域的科学推理泛化能力。

Details

Motivation: 尽管当前推理模型在长视野数学和科学问题求解上取得了显著进展，但如何系统地将一个通用的后训练推理骨干模型提升到国际奥赛金牌级别的严谨求解水平，仍需要一个统一且有效的训练方案。

Result: 所训练的模型SU-01在IMO 2025/USAMO 2026和IPhO 2024/2025等数学和物理奥林匹克竞赛问题上达到了金牌级别的性能（即SOTA水平）。同时，它能在超过10万token的困难问题轨迹上稳定推理，并展现出跨领域的科学推理泛化能力。

Insight: 论文宣称的创新点在于提出了一套简单统一的训练“配方”，其核心是结合了基于反向困惑度（reverse-perplexity）的SFT课程学习、从可验证奖励到证明级奖励的两阶段RL扩展流程，以及测试时扩展。从客观角度看，这种将课程学习、多阶段RL和推理时技术系统整合以专门提升复杂、严谨推理能力的方法，为构建高性能专业求解器提供了可借鉴的工程化路径。

Abstract: Recent progress in reasoning models has substantially advanced long-horizon mathematical and scientific problem solving, with several systems now reaching gold-medal-level performance on International Mathematical Olympiad (IMO) and International Physics Olympiad (IPhO) problems. In this paper, we introduce a simple and unified recipe for converting a post-trained reasoning backbone into a rigorous olympiad-level solver. The recipe first uses a reverse-perplexity curriculum for SFT to instill rigorous proof-search and self-checking behaviors, then scales these behaviors through a two-stage RL pipeline that progresses from RL with verifiable rewards to more delicate proof-level RL, and finally boosts solving performance with test-time scaling. Applying this recipe, we train a 30B-A3B backbone with SFT on around 340K sub-8K-token trajectories followed by 200 RL steps. The resulting model, SU-01, supports stable reasoning on difficult problems with trajectories exceeding 100K tokens, while achieving gold-medal-level performance on mathematical and physical olympiad competitions, including IMO 2025/USAMO 2026 and IPhO 2024/2025. It also demonstrates strong generalization of scientific reasoning to domains beyond mathematics and physics.

[112] RealICU: Do LLM Agents Understand Long-Context ICU Data? A Benchmark Beyond Behavior Imitation cs.AI | cs.CL | cs.LG | cs.MAPDF

Chengzhi Shen, Weixiang Shen, Tobias Susetzky, Chen, Chen

TL;DR: 该论文提出了RealICU基准，用于评估大型语言模型在重症监护室（ICU）长时序临床数据下的真实推理能力，通过后见之明标注创建了包含患者状态评估、急性问题识别、推荐行动和危险信号行动四项任务的测试集，并揭示了现有模型在召回-安全权衡和锚定偏差方面的失败模式。

Details

Motivation: 现有ICU基准通常将历史临床行为视为真实标签，但这些行为基于不完整信息和有限时间上下文，可能不是最优的，难以评估AI系统的真实推理能力，因此需要构建更贴近现实的评估基准。

Result: 在RealICU基准上，包括记忆增强模型在内的现有LLM表现不佳，暴露了召回-安全权衡和锚定偏差两种失败模式；提出的ICU-Evo结构化记忆智能体改善了长时序推理，但未能完全消除安全失败。

Insight: 创新点在于通过后见之明标注构建了更真实的ICU评估基准，强调了在临床决策支持中超越行为模仿、关注完整患者轨迹推理的重要性，并揭示了LLM在长上下文医疗数据中的特定失败模式，为改进AI序列决策提供了方向。

Abstract: Intensive care units (ICU) generate long, dense and evolving streams of clinical information, where physicians must repeatedly reassess patient states under time pressure, underscoring a clear need for reliable AI decision support. Existing ICU benchmarks typically treat historical clinician actions as ground truth. However, these actions are made under incomplete information and limited temporal context of the underlying patient state, and may therefore be suboptimal, making it difficult to assess the true reasoning capabilities of AI systems. We introduce RealICU, a hindsight-annotated benchmark for evaluating large language models (LLMs) under realistic ICU conditions, where labels are created after senior physicians review the full patient trajectory. We formulate four physician-motivated tasks: assess Patient Status, Acute Problems, Recommended Actions, and Red Flag actions that risk unsafe outcomes. We partition each trajectory with 30-min windows and release two datasets: RealICU-Gold with 930-window annotations from 94 MIMIC-IV patients, and RealICU-Scale with 11,862 windows extended by Oracle, a physician-validated LLM hindsight labeler. Existing LLMs including memory-augmented ones performed poorly on RealICU, exposing two failure modes: a recall-safety tradeoff for clinical recommendations, and an anchoring bias to early interpretations of the patient. We further introduce ICU-Evo to study structured-memory agents that improves long-horizon reasoning but does not fully eliminate safety failures. Together, RealICU provides a clinically grounded testbed for measuring and improving AI sequential decision-support in high-stakes care. Project page: https://chengzhi-leo.github.io/RealICU-Bench/

[113] Senses Wide Shut: A Representation-Action Gap in Omnimodal LLMs cs.AI | cs.CLPDF

Trung Nguyen Quang, Yiming Gao, Fanyi Pu, Kaichen Zhang, Shuo Sun

TL;DR: 本文研究了全模态大语言模型在感知与行动之间的不一致性，即模型能够在其隐藏状态中编码文本前提与感知输入（视觉或音频）之间的冲突，但在输出中却很少拒绝错误的文本前提。作者提出了IMAVB基准测试，包含500个长视频片段，通过交叉目标模态（视觉、音频）和前提条件（标准、误导）来独立测量冲突检测能力。研究发现，八个开源全模态LLM和Gemini 3.1 Pro均存在‘表示-行动差距’，模型行为表现为两种失败模式：拒绝不足（将误导问题当作真实前提回答）和过度拒绝（牺牲普通理解准确性）。作者提出了一种探针引导的logit调整方法，通过将编码的冲突信号重新注入解码过程来改善拒绝行为。

Details

Motivation: 研究动机是测试全模态大语言模型在感知与行动之间的基本接地能力，即检测文本前提与模型自身感官输入（视觉或音频）之间的冲突，以确定失败是源于感知还是行动。

Result: 在IMAVB基准测试上，所有测试模型（包括八个开源全模态LLM和Gemini 3.1 Pro）均表现出‘表示-行动差距’，即隐藏状态能可靠编码冲突，但输出中很少拒绝错误前提。模型行为分为拒绝不足和过度拒绝两种失败模式，且音频接地性能低于视觉。通过探针引导的logit调整方法，能一致性地改善拒绝行为。

Insight: 创新点在于提出了IMAVB基准来独立评估全模态模型的冲突检测能力，并揭示了‘表示-行动差距’现象，表明全模态接地的瓶颈在于从表示到行动的翻译过程，而非感知本身。提出的PGLA方法作为一种诊断性干预，通过重新注入编码的冲突信号来改善模型行为，为模型优化提供了新思路。

Abstract: When an omnimodal large language model accepts a question whose textual premise contradicts what it actually sees or hears, does the failure lie in perception or in action? Recent omnimodal models are positioned as perception-grounded agents that jointly process video, audio, and text, yet a basic form of grounding remains untested: catching a textual claim that conflicts with the model’s own sensory input. We introduce IMAVB, a curated 500-clip benchmark of long-form movies with a 2x2 design crossing target modality (vision, audio) and premise condition (standard, misleading), which lets us measure conflict detection separately from ordinary multimodal comprehension. Across eight open-source omnimodal LLMs and Gemini 3.1 Pro, we document a Representation-Action Gap: hidden states reliably encode premise-perception mismatches even when the same models almost never reject the false claim in their outputs. Behaviorally, models fall into two failure modes: under-rejection, in which they answer misleading questions as if the false premise were true; and over-rejection, in which they reject more often but also reject standard questions, sacrificing ordinary comprehension accuracy. The gap is modality-asymmetric (audio grounding underperforms vision) and prompt-resistant across seven variants. As an initial diagnostic intervention, a probe-guided logit adjustment (PGLA) re-injects the encoded mismatch signal into decoding and consistently improves rejection behavior. Together, these results suggest the bottleneck for omnimodal grounding lies in translation, not perception.

[114] Ego2World: Compiling Egocentric Cooking Videos into Executable Worlds for Belief-State Planning cs.AI | cs.CVPDF

Qinchuan Cheng, Zhantao Gong, Pengzhan Sun, Angela Yao, Xulei Yang

TL;DR: 该论文提出了Ego2World，一个将第一人称烹饪视频编译成可执行符号世界的基准测试平台，用于评估具身智能体在部分可观测环境下的信念状态规划能力。它通过从视频标注中提取可重用的状态转移规则，在隐藏的世界图中执行，迫使智能体仅依赖局部观察和反馈来更新记忆和重新规划。

Details

Motivation: 现有基准测试在评估具身智能体在部分可观测家庭环境下的规划能力方面存在不足：视频数据集是被动的，而交互式模拟器则依赖合成场景和手工制作的动态，存在模拟到现实的差距，且通常假设状态完全可观测。

Result: 实验表明，仅基于动作重叠的评分会高估物理状态的成功率，而持久的信念记忆能提高任务完成率，同时减少重复的视觉探索。这暗示信念维护应成为具身智能体评估的核心目标。

Insight: 核心创新在于构建了一个连接真实世界视频与可执行符号世界的基准，通过分离隐藏的真实世界图与智能体的部分信念图，强制智能体进行信念状态规划。这为评估智能体的记忆、状态跟踪和从失败中恢复的能力提供了更真实的测试环境。

Abstract: Embodied agents in household environments must plan under partial observation: they need to remember objects, track state changes, and recover when actions fail. Existing benchmarks only partially test this ability. Egocentric video datasets capture realistic human activities but remain passive, while interactive simulators support execution but rely on synthetic scenes and hand-crafted dynamics, introducing a sim-to-real gap and often assuming fully observable state. We introduce Ego2World, an executable benchmark that turns egocentric cooking videos into executable symbolic worlds governed by graph-transition rules. Built on HD-EPIC, Ego2World derives reusable transition rules from video annotations and executes them in a hidden symbolic world graph. During evaluation, the simulator maintains the hidden world graph, while the agent plans over its own partial belief graph using only local observations and execution feedback. This separation forces agents to update memory and replan without observing the true world state. Experiments show that action-overlap scores overestimate physical-state success, and that persistent belief memory improves task completion while reducing repeated visual exploration – suggesting that belief maintenance should be a first-class target of embodied-agent evaluation.

cs.IR [Back]

[115] RAG-Enhanced Large Language Models for Dynamic Content Expiration Prediction in Web Search cs.IR | cs.CLPDF

Tingyu Chen, Wenkai Zhang, Li Gao, Lixin Su, Ge Chen

TL;DR: 本文提出了一种基于检索增强生成（RAG）和大语言模型（LLM）的查询感知动态内容过期预测框架，用于解决商业网络搜索中信息生命周期差异大、传统静态时间窗口过滤方法导致内容语义过期的问题。该框架从文档中提取细粒度时间上下文，利用LLM推断出与查询相关的“有效性边界”，并将其部署于百度搜索中，通过线上线下的A/B测试验证了其有效性。

Details

Motivation: 解决商业网络搜索中，传统静态时间窗口过滤方法（如按时间排序）导致的“一刀切”排名问题，即内容可能时间上新鲜但语义上已过期，无法根据用户查询意图动态判断信息有效性。

Result: 在真实生产流量上进行的离线和在线A/B测试结果表明，该方法在搜索新鲜度和用户体验指标上取得了显著提升，验证了LLM驱动推理在工业规模解决语义过期问题上的有效性。

Insight: 核心创新在于将时效性问题重新定义为动态有效性推理任务，并提出了“查询感知的有效性边界”这一概念，利用LLM根据用户查询意图动态推断信息何时过时，而非依赖固定的时间窗口。同时，结合了RAG和稳健的幻觉缓解策略来确保推理的可靠性，为工业级应用提供了可行方案。

Abstract: In commercial web search, aligning content freshness with user intent remains challenging due to the highly varied lifespans of information. Traditional industrial approaches rely on static time-window filtering, resulting in “one-size-fits-all” rankings where content may be chronologically recent but semantically expired. To address the limitation, we present a novel Large Language Models (LLMs)-based Query-Aware Dynamic Content Expiration Prediction Framework deployed in Baidu search, reformulating timeliness as a dynamic validity inference task. Our framework extracts fine-grained temporal contexts from documents and leverages LLMs to deduce a query-specific “validity horizon”-a semantic boundary defining when information becomes obsolete based on user intent. Integrated with robust hallucination mitigation strategies to ensure reliability, our approach has been evaluated through offline and online A/B testing on live production traffic. Results demonstrate significant improvements in search freshness and user experience metrics, validating the effectiveness of LLM-driven reasoning for solving semantic expiration at an industrial scale.

cs.RO [Back]

Yunheng Wang, Yuetong Fang, Taowen Wang, Lusong Li, Kun Liu

TL;DR: 本文提出了StereoNav，一个旨在提升真实世界导航一致性的视觉-语言-动作框架。该框架通过引入目标位置先验来弥合合成训练与物理执行之间的差距，并利用立体视觉构建语义与几何的统一表示以减轻视觉干扰。

Details

Motivation: 当前视觉与语言导航（VLN）智能体从仿真环境迁移到真实世界部署时，常因感知不稳定（如光照变化、运动模糊）和指令不明确而导致性能显著下降。现有方法试图通过扩大模型规模和训练数据来弥补这一差距，但作者认为瓶颈在于缺乏鲁棒的空间基础和跨领域先验。

Result: 在R2R-CE和RxR-CE基准测试上的大量实验表明，StereoNav在仅使用RGB输入的情况下取得了最先进的性能，其SR和SPL分数分别为81.1%/68.3%和67.5%/52.0%，且参数量和训练数据量远少于先前基于规模扩展的方法。真实世界机器人部署也证实了其在复杂非结构化环境中显著提高了导航可靠性。

Insight: 论文的创新点在于提出了目标位置先验作为跨领域的稳定视觉引导，以及利用立体视觉构建统一的语义-几何表示来增强深度感知。这为解决VLN中仿真到真实的迁移问题提供了一种高效且数据需求较低的替代方案，而非单纯依赖模型和数据规模的扩展。

Abstract: Vision-and-Language Navigation (VLN) is a cornerstone of embodied intelligence. However, current agents often suffer from significant performance degradation when transitioning from simulation to real-world deployment, primarily due to perceptual instability (e.g., lighting variations and motion blur) and under-specified instructions. While existing methods attempt to bridge this gap by scaling up model size and training data, we argue that the bottleneck lies in the lack of robust spatial grounding and cross-domain priors. In this paper, we propose StereoNav, a robust Vision-Language-Action framework designed to enhance real-world navigation consistency. To address the inherent gap between synthetic training and physical execution, we introduce Target-Location Priors as a persistent bridge. These priors provide stable visual guidance that remains invariant across domains, effectively grounding the agent even when instructions are vague. Furthermore, to mitigate visual disturbances like motion blur and illumination shifts, StereoNav leverages stereo vision to construct a unified representation of semantics and geometry, enabling precise action prediction through enhanced depth awareness. Extensive experiments on R2R-CE and RxR-CE demonstrate that StereoNav achieves state-of-the-art egocentric RGB performance, with SR and SPL scores of 81.1% and 68.3%, and 67.5% and 52.0%, respectively, while using significantly fewer parameters and less training data than prior scaling-based approaches. More importantly, real-world robotic deployments confirm that StereoNav substantially improves navigation reliability in complex, unstructured environments. Project page: https://yunheng-wang.github.io/stereonav-public.github.io.

[117] Action Emergence from Streaming Intent cs.RO | cs.CVPDF

Pengfei Jing, Victor Shea-Jay Huang, Hengtong Lu, Jifeng Dai, Xie Yan

TL;DR: 该论文提出了一种名为’流式意图’的新范式，旨在实现端到端自动驾驶中的’动作涌现’能力，即模型能够基于场景理解进行推理，生成物理可行、语义恰当且安全合规的动作，而非简单检索或插值。作者构建了一个名为SI的视觉语言动作模型，通过自回归解码一个四步思维链来生成意图令牌，并利用该意图驱动基于流匹配的动作头进行无分类器引导，最终生成轨迹。

Details

Motivation: 论文的动机是解决现有端到端自动驾驶范式无法实现’动作涌现’的问题。现有方法，如自回归轨迹解码器会坍缩多模态未来为单一平均输出，而扩散或流匹配生成器虽能表达多模态但无法通过推理意图进行引导。

Result: 在Waymo端到端基准测试中，SI模型在验证集上取得了7.96的RFS分数，在测试集上取得了7.74的分数，展现了有竞争力的综合性能。更重要的是，该模型首次在全端到端VLA中展示了意图可控性：对于同一场景，在推理时改变意图类别能产生定性上不同但质量始终很高的规划。

Insight: 论文的核心创新点是提出了’流式意图’机制，它将驾驶意图在语义上通过连续的思维链从场景理解中因果推导出来，并在时间上跨片段流式传播以确保意图在驾驶视野内保持连贯。这实现了从数据驱动学习中直接产生多样化、高质量规划的能力，无需预建轨迹库或手动编码的后选择器。

Abstract: We formalize action emergence as a target capability for end-to-end autonomous driving: the ability to generate physically feasible, semantically appropriate, and safety-compliant actions in arbitrary, long-tail traffic scenes through scene-conditioned reasoning rather than retrieval or interpolation of learned scene-action mappings. We show that previous paradigms cannot deliver action emergence: autoregressive trajectory decoders collapse the inherently multimodal future into a single averaged output, while diffusion and flow-matching generators express multimodality but are not steerable by reasoned intent. We propose Streaming Intent as a concrete way to approach action emergence: a mechanism that makes driving intent (i) semantically streamed through a continuous chain-of-thought that causally derives the intent from scene understanding, and (ii) temporally streamed across clips so that intent commitments remain coherent along the driving horizon. We realize Streaming Intent in a VLA model we call SI (Streaming Intent). SI autoregressively decodes a four-step chain-of-thought and emits an intent token; the decoded intent then drives classifier-free guidance (CFG) on a flow-matching action head, requiring only two denoising steps to generate the final trajectory. On the Waymo End-to-End benchmark, SI achieves competitive aggregate performance, with an RFS score of 7.96 on the validation set and 7.74 on the test set. Beyond aggregate metrics, the model demonstrates – to our knowledge for the first time in a fully end-to-end VLA – intent-faithful controllability: for a fixed scene, varying the intent class at inference yields qualitatively distinct yet consistently high-quality plans, arising purely from data-driven learning without any pre-built trajectory bank or hand-coded post-hoc selector.

[118] MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving cs.RO | cs.CVPDF

Yuzhou Huang, Benjin Zhu, Hengtong Lu, Victor Shea-Jay Huang, Haiming Zhang

TL;DR: MindVLA-U1是首个用于自动驾驶的统一流式视觉-语言-动作（VLA）架构，通过单一前向传播同时生成语言令牌和连续动作轨迹，在WOD-E2E基准测试中首次超越人类驾驶员表现，并达到最先进的规划精度和接近VA模型的吞吐量。

Details

Motivation: 当前自动驾驶VLA模型在规划质量上常落后于纯视觉到动作（VA）模型，作者认为问题在于VLA通常由孤立子任务改进拼接而成，而非一个统一的架构，导致语义推理、时序上下文和连续控制难以有效结合。

Result: 在长尾WOD-E2E基准测试中，MindVLA-U1首次超越经验丰富的人类驾驶员（8.20 RFS vs. 8.13 GT RFS），仅用2个扩散步骤就在规划ADE上大幅领先之前的VA/VLA方法达到SOTA，同时保持了16 FPS的吞吐量，与VA类模型（如RAP-DINO的18 FPS）相当。

Insight: 创新点包括：1）统一的流式架构，通过单一共享表示同时输出语言和连续动作，保留了各模态的自然输出形式；2）流式设计配合可学习的记忆通道处理逐帧视频，避免冗余的多帧VLM建模，实现平滑轨迹演化；3）利用基于语言预测的驾驶意图通过无分类器引导（CFG）来引导动作扩散，将语言侧意图转化为连续轨迹生成的控制信号；4）灵活的注意力上下文管理支持在稠密/稀疏混合Transformer（MoT）骨干上实现快/慢执行。

Abstract: Autonomous driving has progressed from modular pipelines toward end-to-end unification, and Vision-Language-Action (VLA) models are a natural extension of this journey beyond Vision-to-Action (VA). In practice, driving VLAs have often trailed VA on planning quality, suggesting that the difficulty is not simply model scale but the interface through which semantic reasoning, temporal context, and continuous control are combined. We argue that this gap reflects how VLA has been built – as isolated subtask improvements that fail to compose into coherent driving capabilities – rather than what VLA is. We present MindVLA-U1, the first unified streaming VLA architecture for autonomous driving. A unified VLM backbone produces autoregressive language tokens and flow-matching continuous action trajectories in a single forward pass over one shared representation, preserving the natural output form of each modality. A streaming design processes the driving video framewise rather than as fixed video-action chunks, while a learned memory channel carries temporal context across frames so planned trajectories evolve smoothly without redundant multi-frame VLM modeling. The unified architecture admits fast/slow execution on dense/sparse Mixture-of-Transformers (MoT) backbones via flexible self-attention context management, and exposes a measurable language-to-action route: a language-predicted driving intent steers action diffusion through classifier-free guidance (CFG), turning language-side intent into a control signal for continuous trajectory generation. On the long-tail WOD-E2E benchmark, MindVLA-U1 surpasses experienced human drivers for the first time (8.20 RFS vs. 8.13 GT RFS) with 2 diffusion steps, achieves state-of-the-art planning ADEs over prior VA/VLA methods by large margins, and matches VA-class throughput (16 FPS vs. RAP-DINO’s 18 FPS) while preserving natural-language interfaces.

[119] Driving Intents Amplify Planning-Oriented Reinforcement Learning cs.RO | cs.CVPDF

Hengtong Lu, Victor Shea-Jay Huang, Chengmin Yang, Pengfei Jing, Jifeng Dai

TL;DR: 本文提出了DIAL框架，一个两阶段的驾驶意图增强强化学习框架，旨在解决基于单条演示轨迹训练的连续动作策略的模式崩溃问题。该框架通过意图条件化流匹配和分类器无关引导来扩展采样分布，并利用多意图GRPO在偏好强化学习中保持分布多样性，从而提升端到端驾驶策略的性能。

Details

Motivation: 解决基于单条演示轨迹训练的连续动作策略的模式崩溃问题，即策略样本聚集在演示的驾驶操作周围，无法表示语义上不同的替代方案，这限制了在偏好评估下的最佳性能。

Result: 在WOD-E2E基准测试中，DIAL框架超越了现有方法：意图-CFG采样在best-of-128时达到Rater Feedback Score (RFS) 9.14，首次超过了先前最佳方法RAP（RFS 8.5）和人类驾驶演示（RFS 8.13）；多意图GRPO将保留集的RFS从7.681提升到8.211，而所有单意图基线均表现更差且训练后期性能下降。

Insight: 创新点在于通过离散意图标签和分类器无关引导来扩展采样分布以打破模式崩溃，并在偏好强化学习中引入多意图GRPO来防止分布重新塌缩。核心洞察是偏好强化学习的瓶颈不仅在于如何更新策略，更在于扩展和保持被优化的采样分布。

Abstract: Continuous-action policies trained on a single demonstrated trajectory per scene suffer from mode collapse: samples cluster around the demonstrated maneuver and the policy cannot represent semantically distinct alternatives. Under preference-based evaluation, this caps best-of-N performance – even oracle selection cannot recover what the sampling distribution does not contain. We introduce DIAL, a two-stage Driving-Intent-Amplified reinforcement Learning framework for preference-aligned continuous-action driving policies. In the first stage, DIAL conditions the flow-matching action head on a discrete intent label with classifier-free guidance (CFG), which expands the sampling distribution along distinct maneuver modes and breaks single-demonstration mode collapse. In the second stage, DIAL carries this expanded distribution into preference RL through multi-intent GRPO, which spans all intent classes within every preference group and prevents fine-tuning from re-collapsing around the currently preferred mode. Instantiated for end-to-end driving with eight rule-derived intents and evaluated on WOD-E2E: competitive Vision-to-Action (VA) and Vision-Language-Action (VLA) Supervised Finetuning (SFT) baselines plateau below the human-driven demonstration at best-of-128, with the strongest prior (RAP) capping at Rater Feedback Score (RFS) 8.5 even with best-of-64; intent-CFG sampling lifts this ceiling to RFS 9.14 at best-of-128, surpassing both the prior best (RAP 8.5) and the human-driven demonstration (8.13) for the first time; and multi-intent GRPO improves held-out RFS from 7.681 to 8.211, while every single-intent baseline peaks lower and degrades by training end. These results suggest that the bottleneck of preference RL on continuous-action policies trained from demonstrations is not only how to update the policy, but to expand and preserve the sampling distribution being optimized.

[120] Towards Long-horizon Embodied Agents with Tool-Aligned Vision-Language-Action Models cs.RO | cs.AI | cs.CVPDF

Zixing Lei, Changxing Liu, Yichen Xiong, Minhao Xiong, Yuanzhuo Ding

TL;DR: 本文提出VLAs-as-Tools策略，以解决VLA模型在长视野任务中面临的长期闭环规划与多样化物理操作的双重负担。该策略通过一个高层VLM代理负责时序推理和全局规划，并利用一组专门的VLA工具执行局部物理操作，通过引入工具族接口和工具对齐后训练方法，实现了高效的触发式重规划和工具调用保真度。

Details

Motivation: 解决当前视觉-语言-动作模型在执行长视野任务时，因需同时处理长期闭环规划和多样化物理操作而能力受限的问题。

Result: 在LIBERO-Long和RoboTwin基准测试上，该方法将π0.5的成功率分别提升了4.8个百分点和23.1个百分点，并通过无偏率指标将调用保真度提升了15.0个百分点。

Insight: 创新点在于将长视野任务分解为高层规划与专用工具执行的层次化架构，并设计了工具族接口以实现事件触发的代理重规划，以及工具对齐后训练方法以提升工具调用的准确性和专业化效率。

Abstract: Vision-language-action (VLA) models are effective robot action executors, but they remain limited on long-horizon tasks due to the dual burden of extended closed-loop planning and diverse physical operations. We therefore propose VLAs-as-Tools, a strategy that distributes this burden across a high-level vision language model (VLM) agent for temporal reasoning and a family of specialized VLA tools for diverse local physical operations. The VLM handles scene analysis, global planning, and recovery, while each VLA tool executes a bounded subtask. To tightly couple agent planning with VLA tool execution in long-horizon tasks, we introduce a VLA tool-family interface that exposes explicit tool selection and in-execution progress feedback, enabling efficient event-triggered agent replanning without continuous agent polling. To obtain diverse specialized VLA tools that faithfully follow agent invocations, we further propose Tool-Aligned Post-Training (TAPT), which constructs invocation-aligned training units for instruction following and adopts tool-family residual adapters for efficient tool specialization. Experiments show that VLAs-as-Tools improves the success rate of $π_{0.5}$ by 4.8 points on LIBERO-Long and 23.1 points on RoboTwin, and further enhances invocation fidelity by 15.0 points as measured by Non-biased Rate. Code will be released.

[121] RotVLA: Rotational Latent Action for Vision-Language-Action Model cs.RO | cs.CVPDF

Qiwei Li, Xicheng Gong, Xinghang Li, Peiyan Li, Quanyun Zhou

TL;DR: RotVLA是一个基于连续旋转潜在动作表示的视觉-语言-动作模型框架。它通过将潜在动作建模为SO(n)群中的元素，提供了连续性、组合性和与真实世界动作动态对齐的结构化几何。该框架包含一个VLM主干和一个流匹配动作头，在大规模跨具身机器人数据集和带潜在动作监督的人类视频上进行预训练。在下游机器人控制中，流匹配头被扩展为一个统一动作专家，联合去噪潜在动作和机器人动作，其中潜在动作充当高级规划器。

Details

Motivation: 现有潜在动作模型通常依赖离散量化编码-解码流程，这可能导致琐碎的帧重建行为、有限的表示能力以及缺乏物理意义的结构。RotVLA旨在解决这些问题，通过引入连续的、具有几何结构的潜在动作表示来提升VLA模型的性能。

Result: 在仅使用17亿参数和1700+小时预训练数据的情况下，RotVLA在LIBERO基准上达到98.2%的成功率，在RoboTwin2.0基准的干净和随机化设置下分别达到89.6%和88.5%的成功率。它还在真实世界操作任务中表现出强大性能，持续超越现有VLA模型。

Insight: 创新点在于将潜在动作建模为连续旋转群SO(n)中的元素，这为动作表示提供了固有的连续性、组合性和几何结构。此外，提出的三元组帧学习框架避免了模型退化并强制了有意义的时间动态，而将流匹配头扩展为统一动作专家，使潜在动作能够作为条件高级规划器指导动作生成，这是一个新颖的架构设计。

Abstract: Latent Action Models (LAMs) have emerged as an effective paradigm for handling heterogeneous datasets during Vision-Language-Action (VLA) model pretraining, offering a unified action space across embodiments. However, existing LAMs often rely on discrete quantization encode and decode pipelines, which can lead to trivial frame reconstruction behavior, limited representational capacity, and a lack of physically meaningful structure. We introduce RotVLA, a VLA framework built on a continuous rotational latent action representation. Latent actions are modeled as elements of SO(n), providing continuity, compositionality, and structured geometry aligned with real-world action dynamics. A triplet frame learning framework further enforces meaningful temporal dynamics while avoiding degeneration. RotVLA consists of a VLM backbone and a flow-matching action head, pretrained on large-scale cross-embodiment robotic datasets and human videos with latent-action supervision. For downstream robot control, the flow-matching head is extended into a unified action expert that jointly denoises latent and robot actions. Here, latent actions serve as a latent planner, providing high-level guidance that conditions action generation. With only 1.7B parameters and 1700+ hours of pretraining data, RotVLA achieves 98.2% on LIBERO and 89.6% / 88.5% on RoboTwin2.0 under clean and randomized settings, respectively. It also demonstrates strong real-world performance on manipulation tasks, consistently outperforming existing VLA models.

[122] Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models cs.RO | cs.CVPDF

Yiran Ling, Qing Lian, Jinghang Li, Qing Jiang, Tianming Zhang

TL;DR: 本文提出了GTA-VLA（Guide, Think, Act）框架，这是一个交互式的视觉-语言-动作（VLA）模型，通过允许用户使用显式视觉提示（如可操作点、边界框和轨迹）来引导机器人策略，实现了空间可引导的具身推理。该框架将外部空间先验与内部任务规划相结合，生成统一的视觉空间思维链，并耦合轻量级反应式动作头进行高效执行。

Details

Motivation: 现有VLA模型学习从多模态观察到机器人动作的直接’感知到行动’映射，虽然在训练分布内有效，但在分布外（OOD）变化下脆弱且难以纠正错误。尽管最近的具身思维链（CoT）方法暴露了中间推理，但仍缺乏整合人类空间引导的机制，限制了其解决视觉模糊性或从错误中恢复的能力。

Result: 在领域内基准SimperEnv WidowX上，该框架达到了81.2%的成功率，实现了最先进（SOTA）性能。在OOD视觉变化和空间模糊性下，单次视觉交互显著提升了任务成功率，优于现有方法。

Insight: 核心创新在于引入了交互式空间引导机制，允许用户提供空间先验来修正和增强模型的推理过程，从而将人类视觉意图与自主决策对齐。这通过生成统一的视觉空间思维链和耦合轻量级动作头实现，提高了在分布外场景下的鲁棒性和可纠正性。

Abstract: In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied reasoning by allowing users to guide robot policies with explicit visual cues. Existing VLA models learn a direct “Sense-to-Act” mapping from multimodal observations to robot actions. While effective within the training distribution, such tightly coupled policies are brittle under out-of-domain (OOD) shifts and difficult to correct when failures occur. Although recent embodied Chain-of-Thought (CoT) approaches expose intermediate reasoning, they still lack a mechanism for incorporating human spatial guidance, limiting their ability to resolve visual ambiguities or recover from mistakes. To address this gap, our framework allows users to optionally guide the policy with spatial priors, such as affordance points, boxes, and traces, which the subsequent reasoning process can directly condition on. Based on these inputs, the model generates a unified spatial-visual Chain-of-Thought that integrates external guidance with internal task planning, aligning human visual intent with autonomous decision-making. For practical deployment, we further couple the reasoning module with a lightweight reactive action head for efficient action execution. Extensive experiments demonstrate the effectiveness of our approach. On the in-domain SimplerEnv WidowX benchmark, our framework achieves a state-of-the-art 81.2% success rate. Under OOD visual shifts and spatial ambiguities, a single visual interaction substantially improves task success over existing methods, highlighting the value of interactive reasoning for failure recovery in embodied control. Details of the project can be found here: https://signalispupupu.github.io/GTA-VLA_ProjPage/

[123] RoboEvolve: Co-Evolving Planner-Simulator for Robotic Manipulation with Limited Data cs.RO | cs.CVPDF

Harold Haodong Chen, Sirui Chen, Yingjie Xu, Wenhang Ge, Ying-Cong Chen

TL;DR: 本文提出了RoboEvolve框架，通过将视觉语言模型规划器与视频生成模型模拟器耦合在一个协同进化的循环中，来解决机器人操作任务中物理交互数据稀缺的问题。该框架利用未标注的种子图像，通过一个受认知启发的双阶段机制（日间探索和夜间巩固）和自主渐进式课程，从简单动作扩展到复杂任务。

Details

Motivation: 机器人操作的可扩展性受到任务对齐的物理交互数据稀缺的根本性制约。现有的视觉语言模型和视频生成模型在自主数据合成方面分别存在语义-空间错位和物理幻觉的问题，需要一种方法来解决这一差距。

Result: 大量实验表明，RoboEvolve在有效性上显著提升，将基础规划器的性能提高了30个绝对百分点，并将模拟器的平均成功率放大了48%；在数据效率上表现极佳，仅用500个未标注种子（减少50倍）就超越了全监督基线；并展示了稳健的持续学习能力，没有灾难性遗忘。

Insight: 核心创新点在于提出了一个规划器与模拟器相互强化的协同进化框架，以及一个受认知启发的双阶段机制（探索与巩固）来生成物理上合理的数据。从客观角度看，其利用“近失误”失败来稳定策略优化和自主渐进式课程的设计，是解决数据稀缺和提升学习效率的有效且新颖的思路。

Abstract: The scalability of robotic manipulation is fundamentally bottlenecked by the scarcity of task-aligned physical interaction data. While vision-language models (VLMs) and video generation models (VGMs) hold promise for autonomous data synthesis, they suffer from semantic-spatial misalignment and physical hallucinations, respectively. To bridge this gap, we introduce RoboEvolve, a novel framework that couples a VLM planner and a VGM simulator into a mutually reinforcing co-evolutionary loop. Operating purely on unlabeled seed images, RoboEvolve leverages a cognitive-inspired dual-phase mechanism: (i) daytime exploration fosters physically grounded behavioral discovery through a semantic-controlled multi-granular reward, and (ii) nighttime consolidation mines “near-miss” failures to stabilize policy optimization. Guided by an autonomous progressive curriculum, the system naturally scales from simple atomic actions to complex tasks. Extensive experiments demonstrate that RoboEvolve (I) achieves superior effectiveness, elevating base planners by 30 absolute points and amplifying simulator success by 48% on average; (II) exhibits extreme data efficiency, surpassing fully supervised baselines with merely 500 unlabeled seeds–a 50x reduction; and (III) demonstrates robust continual learning without catastrophic forgetting.

[124] Realtime-VLA FLASH: Speculative Inference Framework for Diffusion-based VLAs cs.RO | cs.CVPDF

Jiahui Niu, Kefan Gu, Yucheng Zhao, Shengwen Liang, Tiancai Wang

TL;DR: 本文提出Realtime-VLA FLASH，一个用于基于扩散的视觉-语言-动作模型的推测推理框架，旨在解决其全推理延迟高、难以实时部署的问题。该框架通过引入轻量级草稿模型进行并行验证，并结合阶段感知回退机制，在保持任务可靠性的同时大幅降低重规划延迟。

Details

Motivation: 基于扩散的视觉-语言-动作模型在具身智能中前景广阔，但其全推理过程的高延迟严重限制了实时部署。本文旨在设计一个框架，在重规划时减少昂贵的全推理调用，实现低延迟、高频率的决策。

Result: 在LIBERO基准测试中，FLASH将许多58.0毫秒的全推理轮次替换为快至7.8毫秒的推测轮次，将任务级平均推理延迟降至19.1毫秒，实现了3.04倍的加速，同时基本保持了任务性能。在真实世界的传送带分拣任务中也验证了其有效性。

Insight: 核心创新点在于为扩散型VLA模型设计了推测推理框架，结合轻量草稿模型、主模型动作专家的并行验证以及智能回退机制。这为延迟敏感的具身任务提供了一种在不显著牺牲性能的前提下，将计算密集型模型推理“轻量化”的实用思路。

Abstract: Diffusion-based vision-language-action models (dVLAs) are promising for embodied intelligence but are fundamentally limited in real-time deployment by the high latency of full inference. We propose Realtime-VLA FLASH, a speculative inference framework that eliminates most full inference calls during replanning by introducing a lightweight draft model with parallel verification via the main model’s Action Expert and a phase-aware fallback mechanism that reverts to the full inference pipeline when needed. This design enables low-latency, high-frequency replanning without sacrificing reliability. Experiments show that on LIBERO, FLASH largely preserves task performance by replacing many 58.0 ms full-inference rounds with speculative rounds as fast as 7.8 ms, lowering task-level average inference latency to 19.1 ms (3.04x speedup). We additionally demonstrate effectiveness on real-world conveyor-belt sorting, highlighting its practical impact for latency-critical embodied tasks.

Table of Contents

cs.CL [Back]

[1] Mitigating Cross-Lingual Cultural Inconsistencies in LLMs via Consensus-Driven Preference Optimisation cs.CLPDF

[2] Bridging the Missing-Modality Gap: Improving Text-Only Calibration of Vision Language Models cs.CL | cs.AI | cs.CVPDF

[3] TimelineReasoner: Advancing Timeline Summarization with Large Reasoning Models cs.CL | cs.AIPDF

[4] Correct Answers from Sound Reasoning: Verifiable Process Supervision for Language Models cs.CL | cs.AIPDF

[5] BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibration cs.CL | cs.AIPDF

[6] Training LLMs with Reinforcement Learning for Intent-Aware Personalized Question Answering cs.CL | cs.AIPDF

[7] Simulating Students or Sycophantic Problem Solving? On Misconception Faithfulness of LLM Simulators cs.CL | cs.AI | cs.CY | cs.LGPDF

[8] REALISTA: Realistic Latent Adversarial Attacks that Elicit LLM Hallucinations cs.CL | cs.AI | cs.CR | cs.LGPDF

[9] CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence cs.CL | cs.CVPDF

[10] CommonWhy: A Dataset for Evaluating Entity-Based Causal Commonsense Reasoning in Large Language Models cs.CLPDF

[11] DiM\textsuperscript{3}: Bridging Multilingual and Multimodal Models via Direction- and Magnitude-Aware Merging cs.CLPDF

[12] Leveraging Multimodal Self-Consistency Reasoning in Coding Motivational Interviewing for Alcohol Use Reduction cs.CLPDF

[13] Context Training with Active Information Seeking cs.CL | cs.AIPDF

[14] The Cost of Perfect English: Pragmatic Flattening and the Erasure of Authorial Voice in L2 Writing Supported by GenAI cs.CL | cs.CYPDF

[15] GateKD: Confidence-Gated Closed-Loop Distillation for Robust Reasoning cs.CLPDF

[16] STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimes cs.CLPDF

[17] GeoBuildBench: A Benchmark for Interactive and Executable Geometry Construction from Natural Language cs.CLPDF

[18] GAGPO: Generalized Advantage Grouped Policy Optimization cs.CL | cs.LGPDF

[19] A Hybrid Framework for Natural Language Querying of IFC Models with Relational and Graph Representations cs.CLPDF

[20] Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation cs.CL | cs.AI | cs.CV | cs.IR | cs.LGPDF

[21] CANTANTE: Optimizing Agentic Systems via Contrastive Credit Attribution cs.CL | cs.AI | cs.MAPDF

[22] FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages cs.CLPDF

[23] Query-Conditioned Test-Time Self-Training for Large Language Models cs.CL | cs.AI | cs.LGPDF

[24] From Rosetta to Match-Up: A Paired Corpus of Linguistic Puzzles with Human and LLM Benchmarks cs.CLPDF

[25] PDCR: Perception-Decomposed Confidence Reward for Vision-Language Reasoning cs.CLPDF

[26] PersonalAI 2.0: Enhancing knowledge graph traversal/retrieval with planning mechanism for Personalized LLM Agents cs.CLPDF

[27] Many-Shot CoT-ICL: Making In-Context Learning Truly Learn cs.CL | cs.AIPDF

[28] Prefix Teach, Suffix Fade: Local Teachability Collapse in Strong-to-Weak On-Policy Distillation cs.CLPDF

[29] FlowCompile: An Optimizing Compiler for Structured LLM Workflows cs.CLPDF

[30] RTLC – Research, Teach-to-Learn, Critique: A three-stage prompting paradigm inspired by the Feynman Learning Technique that lifts LLM-as-judge accuracy on JudgeBench with no fine-tuning cs.CL | cs.AIPDF

[31] Where Does Reasoning Break? Step-Level Hallucination Detection via Hidden-State Transport Geometry cs.CL | cs.AIPDF

[32] An LLM-Based System for Argument Reconstruction cs.CLPDF

cs.CV [Back]

[33] CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference cs.CV | cs.AIPDF

[34] What Happens Before Decoding? Prefill Determines GUI Grounding in VLMs cs.CVPDF

[35] SSDA: Bridging Spectral and Structural Gaps via Dual Adaptation for Vision-Based Time Series Forecasting cs.CV | cs.AIPDF

[36] M2Retinexformer: Multi-Modal Retinexformer for Low-Light Image Enhancement cs.CVPDF

[37] VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority cs.CV | cs.AIPDF

[38] DistractMIA: Black-Box Membership Inference on Vision-Language Models via Semantic Distraction cs.CV | cs.AIPDF

[39] 3D Primitives are a Spatial Language for VLMs cs.CV | cs.AI | cs.DBPDF

[40] TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking cs.CVPDF

[41] MambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation cs.CVPDF

[42] CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesis cs.CVPDF

[43] Visual Aesthetic Benchmark: Can Frontier Models Judge Beauty? cs.CV | cs.AI | cs.HCPDF

[44] MMCL-Bench: Multimodal Context Learning from Visual Rules, Procedures, and Evidence cs.CV | cs.AIPDF

[45] Is Video Anomaly Detection Misframed? Evidence from LLM-Based and Multi-Scene Models cs.CVPDF

[46] WildPose: A Unified Framework for Robust Pose Estimation in the Wild cs.CVPDF

[47] FRAME: Forensic Routing and Adaptive Multi-path Evidence Fusion for Image Manipulation Detection cs.CV | cs.AIPDF

[48] AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects cs.CV | cs.AIPDF

[49] Anatomy-Slot: Unsupervised Anatomical Factorization for Homologous Bilateral Reasoning in Retinal Diagnosis cs.CV | cs.AIPDF

[50] AuraMask: An Extensible Pipeline for Developing Aesthetic Anti-Facial Recognition Image Filters cs.CV | cs.AI | cs.HCPDF

[51] CRePE: Curved Ray Expectation Positional Encoding for Unified-Camera-Controlled Video Generation cs.CV | cs.AI | cs.LGPDF

[52] Seg-Agent: Test-Time Multimodal Reasoning for Training-Free Language-Guided Segmentation cs.CV | cs.AIPDF

[53] AdaFocus: Adaptive Relevance-Diversity Sampling with Zero-Cache Look-back for Efficient Long Video Understanding cs.CV | cs.AIPDF

[54] GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusion cs.CVPDF

[55] Reducing Bias and Variance: Generative Semantic Guidance and Bi-Layer Ensemble for Image Clustering cs.CV | cs.LGPDF

[56] OCH3R: Object-Centric Holistic 3D Reconstruction cs.CVPDF

[57] ViDR: Grounding Multimodal Deep Research Reports in Source Visual Evidence cs.CV | cs.IRPDF

[58] CoGE: Sim-to-Real Online Geometric Estimation for Monocular Colonoscopy cs.CV | cs.AIPDF

[59] Revealing the Gap in Human and VLM Scene Perception through Counterfactual Semantic Saliency cs.CV | cs.AIPDF

[60] BrainAnytime: Anatomy-Aware Cross-Modal Pretraining for Brain Image Analysis with Arbitrary Modality Availability cs.CVPDF

[61] Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling cs.CVPDF

[62] HarmoGS: Robust 3D Gaussian Splatting in the Wild via Conflict-Aware Gradient Harmonization cs.CVPDF

[63] Learning to See What You Need: Gaze Attention for Multimodal Large Language Models cs.CVPDF

[64] PRA-PoE: Robust Alzheimer’s Diagnosis with Arbitrary Missing Modalities cs.CVPDF

[65] RoSplat: Robust Feed-Forward Pixel-wise Gaussian Splatting for Varying Input Views and High-Resolution Rendering cs.CVPDF

[66] Pyramid Forcing: Head-Aware Pyramid KV Cache Policy for High-Quality Long Video Generation cs.CVPDF

[67] Multi-Modal Guided Multi-Source Domain Adaptation for Object Detection cs.CVPDF

[68] EvObj: Learning Evolving Object-centric Representations for 3D Instance Segmentation without Scene Supervision cs.CV | cs.AI | cs.LG | cs.ROPDF

[69] Dual-Pathway Circuits of Object Hallucination in Vision-Language Models cs.CVPDF

[70] A$_3$B$_2$: Adaptive Asymmetric Adapter for Alleviating Branch Bias in Vision-Language Image Classification with Few-Shot Learning cs.CV | cs.LGPDF

[71] PanoWorld: Towards Spatial Supersensing in 360$^\circ$ Panorama World cs.CV | cs.AIPDF

[72] CLIP Tricks You: Training-free Token Pruning for Efficient Pixel Grounding in Large VIsion-Language Models cs.CV | cs.AIPDF

[73] Does Engram Do Memory Retrieval in Autoregressive Image Generation? cs.CVPDF

[74] DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution cs.CVPDF

[75] FIKA-Bench: From Fine-grained Recognition to Fine-Grained Knowledge Acquisition cs.CVPDF

[76] STAR: Semantic-Temporal Adaptive Representation Learning for Few-Shot Action Recognition cs.CV | cs.AIPDF

[77] ReTool-Video: Recursive Tool-Using Video Agents with Meta-Augmented Tool Grounding cs.CV | cs.AIPDF