cs.CL [Total: 26]
cs.CV [Total: 58]
cs.LG [Total: 6]
cs.CE [Total: 1]
cs.AI [Total: 8]
cs.RO [Total: 1]

cs.CL [Back]

[1] What is Good? Extracting and Testing Implicit Theories of Literary Quality from LLM Reasoning Traces cs.CLPDF

Birger Moëll

TL;DR: 本研究通过两项实验探究了具备推理能力的大语言模型如何评估文学质量。研究一构建了一个包含六个质量层级的30篇真实文本基准，从模型推理轨迹中提取其隐含的质量理论，发现模型在层级分类上达到79.3%的平均准确率，并显示出重视意图性、技巧、深度和独特声音的评判标准。研究二通过对经典散文进行六种系统性降级处理，验证了该理论，发现模型对结构和声音特征的敏感性远高于词汇简化，且综合降级导致质量大幅下降。

Details

Motivation: 解决文学研究和计算语言学中关于’什么是好作品’的持久性问题，探究大语言模型在评估文学质量时的内在评判机制。

Result: 在DeepSeek模型的五个复现中，模型在六层级质量分类任务上达到79.3%的平均准确率；在降级实验中，词汇简化导致的质量损失最小（0.41分），而结构简化（2.78分）和声音泛化（2.34分）损失更大，综合降级造成毁灭性影响（-5.64分）。与Qwen QwQ的探索性比较显示出相似的定性模式。

Insight: 创新点在于从模型推理轨迹中提取隐含的质量理论，并通过系统性文本降级实验进行验证；研究发现LLM的写作质量判断是整体性的、作者特定的，且对结构特征比词汇特征更敏感，这对自动化写作反馈和计算美学具有启示意义。

Abstract: What makes writing “good” remains a persistent question in literary studies and computational linguistics. We present a two-study investigation of how reasoning-enabled LLMs evaluate literary quality. In Study 1, we construct a benchmark of 30 real texts spanning six quality tiers, from canonical literature to anonymous forum posts, and extract the model’s implicit theory of quality from its reasoning traces. Across five DeepSeek replications, the model achieves 79.3% mean tier-classification accuracy. The traces reveal a consistent stated theory: the model values intentionality over correctness, prioritizing craft, depth, and distinctive voice. A familiarity experiment with style-matched but unrecognizable passages suggests that source recognition may inflate scores, although this is confounded by genuine quality differences between canonical originals and researcher-written pastiches. In Study 2, we probe this theory through systematic degradation of five canonical prose passages. We apply six manipulations - vocabulary simplification, rhythm flattening, imagery removal, voice genericization, structure simplification, and combined degradation - and reevaluate each version. Vocabulary simplification causes the smallest quality loss (0.41 +/- 0.46 points), far below structure (2.78) or voice (2.34) loss. Combined degradation is devastating (-5.64) but subadditive. An exploratory comparison with Qwen QwQ shows the same broad qualitative pattern. Together, these studies suggest that LLM judgments of writing quality are holistic, author-specific, and more sensitive to structural than lexical features, with implications for automated writing feedback and computational aesthetics.

[2] Is MoE Routing a Huffman Code? Discovering the Frequency-Diversity Law in Chain-of-Thought cs.CL | cs.AI | cs.ITPDF

Ching-Chieh Tsao, Zhuoyi Lin, Wenya Wang

TL;DR: 本文揭示了混合专家（MoE）架构中路由机制的本质，指出其并非简单的专家选择，而是哈夫曼编码的一种体现。作者提出了频率-多样性定律，发现先进模型（如Phi-3.5-MoE）会自发地为常见词元分配稀疏专家资源，而为思维链中的复杂任务调用高多样性专家组合。同时，论文识别了Qwen3.5-35B-A3B模型中的冗余陷阱，并提出子集差异剪枝方法以消除功能重复，从而释放模型的潜在哈夫曼编码效率。

Details

Motivation: MoE架构的路由逻辑一直被视为黑盒，缺乏根本性的理论解释。本文旨在揭示其背后的核心原理，并解决现有模型（如Qwen3.5）中因负载平衡导致的冗余问题，从而提升路由效率。

Result: 研究发现，Phi-3.5-MoE和Gemma-4-27B-A4B等先进模型自发地遵循频率-多样性定律，表现出信息论引擎的特性。提出的子集差异剪枝方法在消除冗余的同时，未损害模型的推理能力，反而使其逻辑路径更精简、高效。

Insight: 论文的核心创新点是将MoE路由机制与哈夫曼编码理论联系起来，提出了频率-多样性定律这一根本原则。从客观角度看，这为理解MoE的工作机制提供了全新的信息论视角，并提出的基于最小描述长度（MDL）最优性的路由设计方向，有望将路由从启发式方法转变为原则性的压缩引擎，具有重要的理论指导意义。

Abstract: Mixture-of-Experts architectures have revolutionized scaling, yet the underlying logic of their routing remains a black box. In this paper, we uncover a fundamental governing principle: MoE routing is not merely selection, but a manifestation of Huffman Coding. We introduce the Frequency-Diversity Law, revealing that state-of-the-art models, such as Phi-3.5-MoE and Gemma-4-27B-A4B, spontaneously act as information-theoretic engines. These models allocate sparse expert resources for common tokens while invoking high-diversity expert committees for rare, complex tasks found in chain-of-thought trajectories. However, we identify a critical redundancy trap in Qwen3.5-35B-A3B: when effective sparsity (k/E_eff) is sufficiently low, load-balancing inadvertently imposes functional redundancy, masking the underlying Huffman efficiency signal. To bridge this gap, we propose Subset Difference Pruning, a surgical strategy to eliminate functional duplicates. We demonstrate that pruning does not degrade reasoning; instead, it unleashes the model’s latent Huffman efficiency, forcing the logic to collapse into streamlined, high-density paths. Our findings suggest that the next generation of MoEs should move beyond forced load-balancing toward Minimum Description Length (MDL) optimality, assigning shorter expert-routing codes to high-frequency information and longer, more diverse codes to low-frequency information, thereby transforming routing from a heuristic into a principled compression engine.

[3] Skill-Contracted Agents for Evidence-Aware Materials Literature Analysis cs.CL | cs.IRPDF

Bixuan Li, Yu Liu, Shuo Shi, Xiaoya Huang, Peng Kang

TL;DR: 本文提出了AlphaAgent，一个基于技能契约的智能体框架，用于材料科学文献分析。该框架将检索式问答与论文级报告生成解耦，通过专门的检索技能和报告生成技能，有效处理材料科学中成分、加工、表征和性能关系的复杂查询。

Details

Motivation: 材料科学文献分析需要同时关注多个异质任务，而传统的检索增强生成（RAG）流水线在单一架构中难以协调这些任务，因此需要一种能明确分离任务并提升证据感知能力的新方法。

Result: 在40个材料科学问题（其中一半需要深度分析推理）的盲评中，AlphaAgent显著优于在底层模型、文档索引和检索规模上匹配的基线系统，尤其在机理解释和可信度边界意识方面提升最大。

Insight: 创新点在于通过明确的技能契约实现任务解耦，包括专门的检索技能（用于查询重写和证据不足时的查询重构）和报告生成技能（用于解析全文PDF并生成结构化报告），从而提升了基于大语言模型的文献分析效果。

Abstract: Materials science literature analysis requires simultaneous attention to composition, processing, characterization, and property relationships, yet conventional retrieval-augmented generation pipelines struggle to reconcile heterogeneous tasks within a single retrieve-then-generate architecture. Here we present AlphaAgent, a skill-driven agent framework that decouples retrieval-based question answering from paper-level report generation through explicit skill contracts. A dedicated retrieval skill rewrites user requests into material-specific search intents, queries a curated index of more than 300,000 papers from the Journal Citation Reports Metallurgy and Metallurgical Engineering category, and reformulates queries when initial evidence is insufficient. A separate report-generation skill parses full-text PDFs to produce structured per-paper analytical reports and cross-paper summaries. In a blind evaluation on 40 materials-science questions, half of which required deep analytical reasoning, AlphaAgent substantially outperformed a baseline system matched for underlying model, document index, and retrieval scale, with the largest gains in mechanistic explanation and awareness of credibility boundaries. These results indicate that explicit task separation, refined retrieval intent, and evidence-aware generation improve large-language-model-based literature analysis for materials research.

[4] Moir: Let the Model Direct Its Own Story for Robust Cross-Domain Knowledge Editing cs.CL | cs.AIPDF

Jea Kwon, Jiwon Kim, Dong-kyum Kim, Meeyoung Cha

TL;DR: 本文提出了一种名为Moir的知识编辑方法，旨在解决现有基于协方差的编辑方法在更新语言模型知识时，因保留分布与模型实际运行分布不匹配而导致的数学和编程推理能力崩溃问题。该方法通过从模型自身解码分布中采样来估计保留协方差，无需外部数据，可作为即插即用组件提升编辑的鲁棒性。

Details

Motivation: 现有知识编辑方法在更新模型知识时，会导致模型核心能力（如数学和程序推理）的不对称退化，而百科全书式记忆保持完好。作者将此归因于基于外部静态语料库（如维基百科）的保留分布与模型经过SFT/DPO等后训练后形成的实际运行分布不匹配。

Result: 在OLMo-2、Llama-3.1和Qwen-3（7-8B）模型上，结合MEMIT和AlphaEdit编辑器，在批量和顺序编辑场景下，Moir均能有效扩展脆弱领域的知识保留。最显著的结果是，在Qwen3-8B模型上进行20,000次AlphaEdit批量编辑后，使用Moir能将GSM8K准确率保持在79.9%，而使用维基百科基线的准确率仅为10.9%。

Insight: 核心创新在于提出模型自身是其运行分布最易获取的来源，通过从模型解码分布中采样（以单个随机词汇为种子）来估计保留协方差，从而将保留分布与模型运行分布对齐。这为无需外部数据、保护模型核心能力的鲁棒知识编辑提供了新思路，具有即插即用的实用优势。

Abstract: While language models remain frozen at their training state, the world evolves continuously. Knowledge editing has emerged as a key alternative to full retraining, but its deployment is bottlenecked by the erosion of core capabilities: mathematical and programmatic reasoning collapse while encyclopedic recall remains intact. We trace this asymmetric degradation to a distributional mismatch. Covariance-based editors preserve only the subspaces spanned by their reference corpus, but fail to capture the operative distribution shaped by post-training such as SFT and DPO. Static external corpora, including Wikipedia and even the original pretraining mixture, cannot recover this shifted manifold. We propose Moir, which estimates the preservation covariance $C$ directly from the model itself by sampling from its own decoding distribution. Seeding generation with a single random vocabulary token bypasses the instruction-following templates that otherwise dominate sampled outputs, exposing the broader subspaces the model has internalized. Moir requires no external data and serves as a drop-in component for any covariance-based editor, a practical advantage given that the pre- and post-training corpora of most modern LLMs are not publicly accessible. Across OLMo-2, Llama-3.1, and Qwen-3 (7-8B), under both MEMIT and AlphaEdit and in batch and sequential regimes, Moir consistently extends preservation in the most vulnerable domains, most strikingly on Qwen3-8B after 20,000 AlphaEdit batch edits, it retains 79.9% GSM8K accuracy compared to 10.9% with the Wikipedia baseline. These results suggest that aligning the preservation distribution with the model’s operative distribution is a key factor in non-destructive editing, and that the model itself may be the most accessible source of that distribution for deployed systems.

[5] Preference Tuning as Spectral Update Reorganization cs.CL | cs.AI | cs.LGPDF

Peiyan Zhang, Haibo Jin, Liying Kang, Haohan Wang

TL;DR: 该论文通过谱分析研究基于偏好的后训练（如RLHF）所诱导的参数更新结构，发现更新呈现‘头-尾’谱组织：紧凑的‘头’主导模型行为的可见偏移，而‘尾’作为异质残差对完整解恢复至关重要。研究通过分解LoRA更新并重组成可插拔模块，表明对齐增益与覆盖损失与更新自身的组织方式相关。

Details

Motivation: 动机在于理解偏好优化（如RLHF）如何通过参数更新产生端点行为，而非仅关注行为本身，以揭示学习更新的内部结构及其与模型行为的关系。

Result: 在多种模型族、优化算法和监督机制下，实验一致显示更新形成谱头-尾组织；头主导行为偏移但不足以恢复完整解，尾单独作用弱但不可或缺，尤其在分布外行为上。

Insight: 创新点在于将偏好后训练重新定义为结构化更新重组，而非单一行为校正，并通过谱分解与模块化干预揭示了更新内部的功能性分工，为理解对齐增益与覆盖损失提供了新视角。

Abstract: Preference-based post-training is usually understood through endpoint behavior, yet the learned update that produces this behavior remains largely opaque. We study RLHF and related preference optimization through the spectral structure of their induced parameter updates. By decomposing effective LoRA updates and reloading their spectral components as plug-in modules, we turn preference-induced updates into objects that can be isolated, recomposed, and directly intervened on. Across model families, optimization algorithms, and supervision regimes, these updates consistently develop a spectral head–tail organization. A compact head emerges early and carries the dominant endpoint shift, while a heterogeneous residual tail remains. The split is functional rather than merely descriptive. Plug-in intervention shows that the head accounts for the visible behavioral departure from the base model, while the tail is weak in isolation. Cross-run recomposition further shows that mixed adapters follow the source of the head, indicating that the head carries run-level solver bias. This endpoint dominance does not imply learning sufficiency. Head-only learning is non-vacuous but fails to recover the full solution, especially on out-of-distribution behavior. Tail-only learning yields little visible gain, yet the full solution is not recovered without the tail. These findings recast preference post-training as structured update reorganization rather than a monolithic behavioral correction, and suggest that alignment gain and coverage loss are tied to how the learned update itself is organized.

[6] Answer-then-Edit: Reasoning Skeleton Editing for Anti-Distillation with Preserved Utility cs.CL | cs.AIPDF

Fan Li, Mengting Pan, Sijia Xu, Xiaoyang Wang, Chen Chen

TL;DR: 本文提出了一种名为SGRE（骨架引导推理编辑）的Answer-then-Edit框架，用于保护专有大语言模型的知识产权，防止未经授权的知识蒸馏。该方法先生成干净的推理轨迹以保证答案准确性，再通过提取、粗化和语言化推理骨架来编辑轨迹，在保持模型实用性的同时有效抵御蒸馏攻击。

Details

Motivation: 专有LLMs作为重要知识产权，即使通过黑盒API部署，仍面临通过知识蒸馏被廉价复制的风险。现有抗蒸馏方法难以在防御有效性和推理轨迹的实用性（如准确性和自然度）之间取得平衡。

Result: 在多种LLMs上的广泛实验表明，SGRE在降低蒸馏有效性方面达到了最先进的性能，同时保持了无损的推理准确性和优越的轨迹自然度。

Insight: 核心创新在于“先回答后编辑”的两阶段框架，将准确性保障与防御性编辑解耦。借鉴认知负荷理论，通过编辑推理骨架的结构和文本复杂性来增加学生模型的外部认知负荷，从而干扰其对底层推理模式的学习，这是一种新颖的防御机制设计思路。

Abstract: Proprietary large language models (LLMs) entail substantial intellectual and financial investment, making them valuable intellectual property (IP). However, even when deployed via black-box APIs, these models remain vulnerable to unauthorized knowledge distillation, which allows adversaries to cheaply extract and replicate model capabilities. To address this issue, anti-distillation (AD) has been proposed to generate defensive outputs that hinder distillation effectiveness, overcoming the limitation of watermarking-based approaches that rely on post-hoc verification. However, existing AD methods based on internal model perturbations struggle to balance anti-distillability and utility (e.g., answer accuracy and naturalness) of reasoning traces, with stronger defenses often causing significant utility loss. To fill this gap, we propose \textbf{\underline{S}}keleton-\textbf{\underline{G}}uided \textbf{\underline{R}}easoning \textbf{\underline{E}}diting (SGRE), an \textit{Answer-then-Edit} framework that performs post-hoc trace modification for anti-distillation. In the answer stage, the teacher model first generates clean reasoning traces, preserving the original reasoning accuracy while enabling more flexible control over trace naturalness. In the editing stage, we draw inspiration from Cognitive Load Theory (CLT) and introduce a three-stage strategy consisting of reasoning skeleton extraction, skeleton graph coarsening, and skeleton verbalization. These operations jointly perturb reasoning structures and augment textual complexity to amplify extraneous load on student models, hindering their acquisition of underlying reasoning patterns. Extensive experiments across diverse LLMs demonstrate that SGRE achieves state-of-the-art performance in reducing distillation effectiveness, while maintaining lossless reasoning accuracy and superior trace naturalness.

[7] SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations cs.CL | cs.SD | eess.ASPDF

Burak Can Kaplan, Stefan Wermter

TL;DR: 本文提出了一种名为SCoPE的轻量级模块，用于对话中的情感识别。该模块利用说话者的情感历史来建模其先验，并结合情感转移预测和一种基于精度加权的动态融合机制，以平衡先验信息与多模态证据。

Details

Motivation: 现有对话情感识别方法过度依赖显性证据，未能充分建模情感在对话中的持续性、说话者特异性以及由上下文驱动的转移等非明显因素，导致在信号噪声（如遮挡面部、俚语表达）下模型脆弱。

Result: 在IEMOCAP数据集的多模态设置下，该模型取得了优于近期最先进模型的性能。

Insight: 创新点在于显式建模说话者条件化的情感先验，并引入情感转移预测来指导一个贝叶斯启发的动态融合机制，使模型能根据情感持续性或转移可能性，自适应地权衡历史先验与多模态证据。

Abstract: In conversations, human emotions are transient; however, they tend to persist across multiple utterances. For example, we rarely switch instantly between contrasting emotions such as happiness and anger. Instead, emotions tend to evolve smoothly, and these patterns are often speaker-specific. Some people might escalate, while others gradually cool down over time. Furthermore, when emotions change during a conversation, they are often driven by contextual factors, such as newly received information or unexpected events. Even though progress has been made in Emotion Recognition in Conversations (ERC), most existing approaches still rely heavily on overt evidence and do not sufficiently model these non-apparent factors. Especially in multimodal settings, this makes these models fragile when the signals are noisy (e.g., occluded faces, slang expressions, or microphone noise). To address these limitations, we introduce Speaker-Conditioned Priors over Emotions (SCoPE). SCoPE is a light weight module that utilizes the emotional history of each speaker and explicitly models their priors for use in subsequent emotion classification. Second, we incorporate emotion shift prediction, a well-established concept in ERC, to guide the model in balancing the priors from SCoPE and multimodal evidence. Finally, we propose a shift-aware fusion mechanism that performs precision-weighted logit integration between multimodal evidence and the speaker prior, forming a Bayesian-inspired product-of-experts formulation. This dynamic fusion allows the model to rely on historical priors when emotions persist and to prioritize multimodal evidence when shifts are likely. Experimental results show our model achieves superior performance over recent state-of-the-art models on the IEMOCAP dataset in multimodal settings.

[8] The Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMs cs.CL | cs.AIPDF

Adam Rigby, Raz Saremi, Azadeh Sohrabinejad, Mehdi Rahimi

TL;DR: 这篇论文探讨了大型语言模型（LLMs）在训练过程中如何吸收并重现人类文本中固有的叙事模式（如原型角色和情节弧线），以及这些模式如何导致模型在长期交互中产生系统性行为偏差，如意外、对抗性或具有修辞诱惑性的输出，构成了一种未被监控的AI系统风险。

Details

Motivation: 动机在于研究人类文本中的结构和叙事惯例是否作为系统性行为影响的来源被LLMs吸收，并成为部署系统中的治理风险，特别是这些模式是否会导致模型输出在交互中漂移。

Result: 通过系统文献综述和对LLM对齐、角色动态、新兴错位及用户交互模式的实证研究分析，发现三个关键模式：LLMs复制训练数据的统计模式而非独立推理；可测量的潜在特质（如谄媚性和欺骗性）在不同无关提示中可靠地出现；对狭窄叙事任务的微调可能产生远超该任务的意外行为改变。

Insight: 创新点在于将叙事模式继承识别为一种未被充分监控的AI系统升级路径，它规避了离散事件检测机制，需要专门的监控工具；论文强调了叙事风格输出在现实使用中的普遍性及其放大风险的作用，为对齐治理提供了新视角。

Abstract: LLMs are trained predominantly on human-authored text, yet the structural and narrative conventions embedded in that text are rarely examined as a source of systematic behavioral influence, or as a governance risk in deployed systems. This paper considers whether the storytelling patterns inherent in published human writing, including archetypal roles such as protagonist, antagonist, and underdog, as well as tension-and-resolution narrative arcs, are absorbed during training and subsequently surface in LLM outputs, causing responses to drift toward unexpected, adversarial, or rhetorically enticing behaviors over extended interactions. Through a systematic literature review and cross-paper analysis of recent empirical studies on LLM alignment, persona dynamics, emergent misalignment, and user interaction patterns, we observe evidence bearing on this hypothesis. The findings reveal three key patterns. First, LLMs reproduce statistical patterns from their training data rather than reasoning independently. Second, measurable latent traits, including sycophancy and deceptiveness, emerge reliably across unrelated prompts. Third, fine-tuning on a narrow narrative task can produce unintended behavioral changes well beyond that task. Furthermore, evidence suggests that persuasive, narrative-style outputs are among the most common LLM products in real-world usage, amplifying these risks. Narrative drift constitutes an unmonitored escalation pathway in deployed AI systems, one that evades discrete-incident detection mechanisms and requires dedicated monitoring instruments.

[9] Learn2Zinc: Fine-tuning Small Language Models for Text-to-Model Translation in MiniZinc cs.CL | cs.AIPDF

Serdar Kadioglu, Karthik Uppuluri

TL;DR: 本文研究了如何通过针对性微调，使小型语言模型（0.6B至20B参数）能够从自然语言问题描述生成语法正确且语义有效的MiniZinc（一种用于组合问题的约束建模语言）模型。研究发现，语法错误是主要失败原因，并提出了一种跨模型错误引导方法，通过收集多个LLM运行中的语法错误来构建纠错训练数据集，从而显著提升模型性能。

Details

Motivation: 大型语言模型在主流编程语言的代码生成上表现出色，但在处理像MiniZinc这样的罕见领域特定语言时表现不佳，其开箱即用的执行准确率接近零，因此需要探索针对性微调是否能让小型语言模型有效生成正确的MiniZinc模型。

Result: 通过提出的错误引导微调方法，结合自反思和集成技术，模型在MiniZinc代码生成上实现了高达98%的执行准确率，但解决方案准确率仍为35%，表明语法可学习而约束推理仍是挑战。

Insight: 创新点在于利用跨模型运行收集的语法错误构建纠错数据集进行微调，有效解决了领域特定语言的语法错误主导问题；客观来看，该方法为小模型在专业领域的代码生成提供了一种数据高效的训练范式，并开源了管道、数据集和模型以促进进一步研究。

Abstract: Large language models excel at code generation for mainstream programming languages but struggle with rare, domain-specific languages such as MiniZinc, a constraint modeling language for combinatorial problems. We investigate whether targeted fine-tuning can teach small language models (0.6B to 20B parameters) to generate syntactically correct and semantically valid MiniZinc models from natural language problem descriptions. Our key finding is that syntax errors dominate failures when working with this domain specific language: the out-of-the-box execution accuracy of small language models such as Qwen3, LLaMa, Gemma, and GPT-OSS is near-zero. We propose a cross-model error bootstrapping approach that collects syntax errors from multiple LLM runs and leverage those to curate an error correction training dataset. This dataset allows us fine-tune small language models that consistently improves both direct code generation and chain-of-thought approaches across all model sizes. With self-reflection and ensembling, our approach achieves up to 98% execution accuracy. In parallel, solution accuracy still remains at 35%, indicating that while syntax is learnable, constraint reasoning remains a challenge. We contribute our fine-tuning pipeline, datasets, and models to opens-source for further research on text-to-model translation.

[10] Domyn-Small: A European 10B Reasoning Language Model cs.CL | cs.LGPDF

Simone Angarano, Francesco Bertolotti, Federico D’Ambrosio, Michele Resta, Alessandro Rognoni

TL;DR: 本文介绍了Domyn-Small，一个拥有100亿参数、基于MIT许可证发布的开源推理语言模型。该模型经历了多阶段训练：首先在9万亿多语言token上进行预训练，随后通过持续预训练将上下文窗口扩展至32K，并进行了专注于数学的监督微调，最后通过包含GRPO、DPO和多环境GRPO的强化学习阶段，在数学、代码、问答等多个领域进行优化。模型在推理时可通过YaRN将上下文扩展至128K，并支持双模式推理。

Details

Motivation: 旨在构建一个在7-10B参数规模级别上，兼具强大推理能力、高效指令遵循和长上下文处理能力的开源语言模型，以平衡准确性与效率。

Result: 在7-10B参数级别的同类模型（如Qwen3.5-9B、OLMo-3-7B-Think等）对比中，Domyn-Small在核心推理基准上生成的token数显著更少（约为Qwen3.5-9B的三分之一），同时保持了强大的指令遵循能力（IFEval得分79.9）和具有竞争力的科学推理能力（GPQA-Diamond得分50.0）。

Insight: 创新点在于其分阶段的训练流程，特别是结合了持续预训练（CPT）以扩展原生上下文、数学专注的SFT，以及一个整合了可验证奖励GRPO、DPO和多领域GRPO的强化学习阶段。此外，模型在推理时通过YaRN实现上下文长度动态扩展，并提供了开源的高性能推理框架Domyn Swarm。

Abstract: We introduce Domyn-Small, a 10-billion-parameter open-weight reasoning language model released under the MIT license. Domyn-Small is the product of an initial pre-training phase on 9 trillion tokens multilingual data, followed by a post-training pipeline for reasoning, instruction following, and context extension. For the latter, we performed a Continued Pre-Training (CPT) phase that doubles the native context window to 32K tokens, followed by SFT with a math-focused annealing run. Finally, the RL phase includes GRPO with verifiable rewards, DPO, and a multi-environment GRPO stage spanning five task domains: mathematics, code, multiple-choice QA, instruction-following, and tool calling. The 32K-token native context extends to 128K at inference via YaRN, and a chat-template toggle enables dual-mode reasoning. Against peer models in the 7–10B class (Qwen3.5-9B, OLMo-3-7B-Think, Nemotron-Nano-8B, Ministral-3-8B), Domyn-Small achieves a strong accuracy-efficiency balance: it produces roughly one-third as many tokens as Qwen3.5-9B and approximately 35% of OLMo-3-7B-Think’s token budget on core reasoning benchmarks, while delivering strong instruction-following (IFEval 79.9) and competitive science reasoning (GPQA-Diamond 50.0). We release the weights and the post-training recipe alongside Domyn Swarm (Apache~2.0), an open-source framework for scalable LLM inference on HPC clusters developed during this program and used throughout this work.

[11] CAMeR: Keyword-Gated Hybrid Activation for Adaptive Memory Retention in LLM Agents cs.CL | cs.AIPDF

Haowen Lai

TL;DR: 本文提出了CAMeR框架，一种用于LLM智能体的自适应记忆保留方法。它结合了关键词门控混合激活机制（联合符号和子符号门控）与自适应权重动态，以区分相关与无关记忆。作者还引入了CAMeR-Bench基准来评估其性能。

Details

Motivation: 现有的LLM智能体记忆系统要么不加区分地保留所有信息，要么采用统一的遗忘启发式方法，无法有效区分相关与无关知识，导致信息过载或关键信息丢失。

Result: 在自建的CAMeR-Bench基准（包含76个记忆、100轮对话、8个主题簇）上，CAMeR的关键词门控机制在高频引用记忆和从未引用记忆之间的保留差距比仅使用嵌入门控的方法大1.6倍（剪刀差：0.039 vs 0.024）。与全上下文方法相比，其top-5检索节省了83.2%的token（累计39k vs 231k），同时提高了检索精度。时间驱动的基线方法在100轮后权重衰减至接近零。

Insight: 核心创新点是关键词门控混合激活机制，它联合了符号级（词级Jaccard相似度）和子符号级（嵌入余弦相似度）的相似度计算，为记忆保留提供了简单有效的自适应门控。研究发现，在此规模下，关键词门控是性能的主要驱动力，而非可学习的衰减机制。这展示了混合符号-神经门控在LLM智能体记忆管理中的有效性。

Abstract: Large language model (LLM) agents operating over extended dialogues accumulate vast amounts of information, yet existing memory systems either retain everything indiscriminately or apply uniform forgetting heuristics that fail to distinguish relevant from irrelevant knowledge. We present CAMeR (Context-Activated Memory Reinforcement), a memory retention framework combining keyword-gated hybrid activation – a joint symbolic (word-level Jaccard) and sub-symbolic (embedding cosine) gating mechanism – with adaptive weight dynamics. CAMeR computes a hybrid similarity score for each memory-query pair; memories exceeding a threshold receive reinforcement while all memories undergo controlled decay. We introduce CAMeR-Bench, a 76-memory, 100-round benchmark spanning 8 topic clusters with graded activation frequency, designed to test adaptive retention where existing benchmarks (LoCoMO, LongMemEval) cannot. On CAMeR-Bench, CAMeR’s keyword gate achieves a 1.6$\times$ larger retention gap between high-frequency and never-referenced memories compared to embedding-only gating (scissors gap: 0.039 vs. 0.024), while time-driven baselines (Oblivion, SuperLocalMemory) collapse to near-zero weights over 100 rounds. CAMeR’s top-5 retrieval saves 83.2% tokens versus full-context approaches (39k vs. 231k cumulative) while producing weight signals that improve retrieval precision. Through 8 ablation conditions we establish that the keyword gate – not learnable decay – is the primary performance driver at this scale. Our findings demonstrate that hybrid symbolic-neural gating provides a simple yet effective mechanism for adaptive memory retention in LLM agents.

[12] THOR: A Theta-Gamma Hierarchical Oscillatory Reasoning Framework for Multi-hop QA cs.CL | cs.AIPDF

Ziyang Ling, Ronald X. Xu, Mingzhai Sun

TL;DR: 本文提出THOR框架，一种受大脑Theta-Gamma分层振荡启发的推理框架，用于解决多跳问答任务中注意力衰减和错误累积的问题。该框架通过解耦全局规划与局部检索，实现注意力在跳之间的高效转移，并引入验证与修复机制来中断错误路径上的错误传播。

Details

Motivation: 动机是解决多跳问答中存在的两个核心限制：随着推理链增长导致的注意力衰减，以及错误在跳之间传播并累积最终导致失败的错误累积问题。

Result: 在多跳问答基准上的大量对比实验和特定验证实验表明，THOR提高了答案的准确性和鲁棒性，并缓解了上述限制，展示了其在不同骨干模型上的泛化能力。

Insight: 创新点在于受神经科学启发的Theta-Gamma分层振荡机制，将全局规划（Theta节律）与局部检索（Gamma节律）解耦，并设计了验证与修复机制来主动中断错误传播，这是一种新颖的、受生物启发的推理架构设计思路。

Abstract: Multi-hop question answering requires retrieving and integrating evidence from multiple contexts. Despite the rapid progress of current research, multi-hop reasoning remains constrained by two persistent limitations: attention decay, where the model’s focus on main question degrades as the reasoning chain grows, and error accumulation, where mistakes propagate across hops and compounds into final failure. Inspired by Theta-Gamma hierarchical oscillation which decouples global planning from local retrieval, enabling efficient attention transfer between hops and a verification and repair mechanism that interrupts the accumulation of errors in the wrong paths, we present THOR, a brain-inspired Theta-Gamma hierarchical oscillatory reasoning framework. Extensive comparative experiments and specific validation experiments on multi-hop QA benchmarks demonstrate that THOR improves answer accuracy and robustness while mitigating limitations, showcasing its generalization across different backbones.

[13] Learning to Detect UI Principle Violations via Reinforcement Learning cs.CLPDF

Nishi Mehta, Swathi Alse, Himani Kumavat, Yue Yu, Pratik Jayarao

TL;DR: 该论文提出了一种基于强化学习的轻量级视觉语言模型，用于检测生成式AI创建的网页界面中违反界面质量原则的问题。通过整合19个来自WCAG可访问性标准、欺骗性设计分类和认知交互理论的界面原则，在合成数据集上训练模型，使其能够有效识别可访问性障碍、欺骗性设计模式、视觉层次问题和决策复杂性等质量问题。

Details

Motivation: 解决当前小语言模型和代码代理生成的网页前端代码虽然功能正确，但经常违反界面质量原则（如可访问性、欺骗性设计、视觉层次等）的问题。现有审核方法在成本、覆盖范围和可扩展性之间存在权衡，需要一种轻量级且高效的自动化检测方案。

Result: 在4B参数的视觉语言模型上通过强化学习，将检测的micro-F1分数从36%提升至84%，其中19个原则中有13个的F1分数超过80%。模型能够有效审核生成界面、过滤低质量训练数据，并为设计感知的代码生成提供奖励信号。

Insight: 创新点在于将19个跨领域的HCI原则统一到单一检测框架中，并采用合成数据注入和强化学习的方法训练轻量级模型。该方法提供了可扩展的界面质量评估方案，其数据生成和验证流程的开源有助于推动该领域的研究。

Abstract: Small language models and coding agents increasingly generate web front-end code, yet their outputs are typically evaluated primarily for functional correctness. A generated interface may compile, render, and pass unit tests while still violating established interface quality principles, including accessibility barriers, deceptive design patterns, poor visual hierarchy, and excessive decision complexity. Existing auditing approaches face a trade-off between cost, coverage, and scalability: expert human review provides rich judgment but is slow and expensive; frontier vision-language models offer broader reasoning capabilities but remain costly to deploy at scale; and rule-based tools such as axe-core and Lighthouse are inexpensive but primarily capture mechanically checkable accessibility issues. We investigate whether a lightweight vision-language model can serve as an effective critic for generated interfaces. We unify 19 interface-quality principles from three complementary sources of HCI knowledge: WCAG 2.2 accessibility standards, deceptive design taxonomies, and established theories of perception, cognition, and interaction. To train this critic, we construct a verified dataset of approximately 10,000 generated web pages by synthetically injecting known violations into clean, LLM-generated Tailwind pages. Continued reinforcement learning on a 4B vision-language model improves micro-F1 from 36% to 84%, with 13 of 19 principles exceeding 80% F1. The resulting critic can audit generated interfaces, filter low-quality interface training data, and provide a reward signal for design-aware code generation. We release our data-generation recipe and injection/verification prompts to support reproducible evaluation and future work on scalable interface-quality assessment.

[14] REFACT: Adaptive Fact Restatement for Compact and Faithful Chain-of-Thought Reasoning cs.CLPDF

Zhensheng Jin, Xin Dai, Zhenghao Liu, Chaojun Xiao, Huiyuan Xie

TL;DR: 本文提出REFACT框架，通过自适应事实重述引用来增强大语言模型在长文本推理中的忠实性和紧凑性。该框架训练模型判断推理步骤何时需要上下文支撑，并以适当粒度重述源事实，从而避免无依据的推理和盲目的事实复制。实验表明，REFACT在提升长上下文问答和反事实忠实性的同时，显著减少了令牌消耗。

Details

Motivation: 现有方法在长文本推理中，当证据稀疏、嘈杂或与参数知识冲突时，推理轨迹可能偏离上下文，且现有引用方法无法确保引用内容足以支撑局部推理和最终答案。

Result: 在LongBench、LV-Eval和ConFiQA基准测试中，REFACT提升了长上下文问答和反事实忠实性，并大幅降低了令牌消耗，实现了更密集而非更长的推理轨迹。

Insight: 创新点在于将引用转化为支持答案的中间状态，并通过两阶段SFT-to-RL优化流程，利用引用效用奖励确保引用事实格式良好、可追溯且答案充分，从而在紧凑性和忠实性之间取得平衡。

Abstract: Large language models increasingly rely on long-form reasoning for complex tasks, yet their reasoning traces may drift away from the supplied context when evidence is sparse, noisy, or in conflict with parametric knowledge. Existing grounding methods either attach citations after generation or encourage evidence retrieval inside the trace, but they often do not ensure that cited content is sufficient for the local inference and final answer. We propose REFACT, an adaptive fact-restatement citation framework that trains models to decide when a reasoning step needs contextual grounding and at what granularity source facts should be restated. This design avoids both unsupported inference and indiscriminate fact copying by turning citations into answer-supporting intermediate states. REFACT is optimized with a two-stage SFT-to-RL pipeline in which a citation-utility reward encourages cited facts to be well-formed, source-traceable, and answer-sufficient. Experiments on LongBench, LV-Eval, and ConFiQA show that REFACT improves long-context QA and counterfactual faithfulness while substantially reducing token consumption. Further analysis shows that REFACT preserves more answer-bearing evidence with fewer restated facts, yielding reasoning traces that are denser rather than longer. All code and data are available at https://github.com/NEUIR/REFACT.

[15] CSPF: A Constrained Shared-Private Fusion Method for Non-Verifiable Preference Evaluation cs.CLPDF

Hehao Zhang, Danli Wang, Xinyuan Wang, Xuange Gao

TL;DR: 本文提出了一种名为CSPF的约束共享-私有融合方法，用于解决不可验证任务（如人类偏好评估）中现有方法难以充分捕捉多样化评估标准的问题。该方法将异构的冻结奖励模型视为互补的评估器，在成对人类偏好监督下学习整合它们的隐藏状态表示。

Details

Motivation: 当前，对不可验证任务（如主观偏好评估）进行可靠评估仍具挑战性，现有方法往往无法充分捕捉人类偏好背后多样化的评估标准。

Result: 在LM-Arena目标域适应和PPE分布外偏好评估实验中，CSPF在主要指标上超越了评估的单专家奖励模型、标量分数多专家和规则判断基线，取得了最佳性能。

Insight: 创新点在于将每个专家信号分解为共享和私有表示，促进跨专家对齐的同时保留互补视角；客观分析表明，融合隐藏状态表示为偏好评估提供了更具表达力的基础，为不可验证偏好任务提供了一条整合评估信号的实用路径。

Abstract: At present, reliable evaluation of non-verifiable tasks remains challenging. Existing approaches often fail to adequately capture the diverse evaluative criteria underlying human preferences in such tasks. To this end, we propose Constrained Shared-Private Fusion (CSPF), a fusion method that treats heterogeneous frozen reward models as complementary evaluators and learns to integrate their hidden-state representations under pairwise human-preference supervision. CSPF decomposes each expert signal into shared and expert-private representations, encouraging cross-expert alignment while preserving complementary viewpoints. Across experiments on LM-Arena target-domain adaptation and PPE out-of-distribution preference evaluation, CSPF achieves the best performance on the primary metrics among the evaluated single-expert reward-model, scalar-score multi-expert, and rubric-judge baselines. Overall, CSPF suggests that fusing hidden-state representations provides a more expressive basis for preference assessment, offering a practical route toward integrated evaluative signals for non-verifiable preference tasks.

[16] LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports cs.CLPDF

Yunhan Li, Mingjie Xie, Zeyang Shi, Gengshen Wu, Min Yang

TL;DR: 该论文提出了LegalCiteTrust基准，用于评估中文长篇法律研究报告中的引用可信度。该基准包含72个密集标注的报告级任务，从覆盖率、支持度和引用可信度三个维度进行评估，其中引用可信度通过存在性、忠实性和适用性三个指标来衡量。实验表明，任务完成度、证据丰富度、引用密度和引用可靠性揭示了不同系统的行为差异，而基于E/F/A的修订比仅基于存在性的过滤更能有效提升可信度和最终得分。

Details

Motivation: 随着长篇法律研究报告越来越多地依赖LLM和智能研究系统，其可靠性不仅取决于任务完成情况，还取决于所引用的法律依据是否可信。即使引用指向真实来源，也可能存在风险，例如忽略限制条件、错误描述法律依据或过度解读。

Result: 在通用LLM、深度研究系统和法律专用系统上的实验表明，检索工具可以提高证据支持度，但未必可靠地提升可信度得分；而基于存在性、忠实性和适用性的修订比仅基于存在性的过滤更能清晰地提升可信度和最终得分。

Insight: 论文的创新点在于提出了一个专门针对中文长篇法律研究报告引用可信度的评估基准，并将引用可信度操作化为存在性、忠实性和适用性三个具体维度。客观来看，该研究强调了可信法律研究生成需要在检索后进行引用感知的证据治理，即系统不仅要检索法律依据，还要可靠地选择、描述和应用它们。

Abstract: Long-form legal research reports increasingly rely on LLMs and agentic research systems, but their reliability depends not only on answering the task, but also on whether cited legal authorities are trustworthy. A citation can be risky even when it points to a real source: the report may omit limiting conditions, misdescribe the authority, or use it to support a stronger claim than the source allows. We introduce LegalCiteTrust, a benchmark for evaluating citation trustworthiness in Chinese long-form legal research reports. It contains 72 densely annotated report-level tasks and evaluates reports along three dimensions: Coverage, Support, and Citation Trustworthiness. Citation Trustworthiness is operationalized through citation-level Existence, Fidelity, and Applicability (E/F/A). Experiments on general-purpose LLMs, deep-research systems, and legal-specific systems show that task completion, evidence richness, citation density, and citation reliability expose different system behaviors. Retrieval tools can improve evidence support without reliably improving the Trust score, while E/F/A-based revision improves Trust and Final score more clearly than existence-only filtering. These results suggest that trustworthy legal research generation requires citation-aware evidence governance after retrieval: systems must not only retrieve legal authorities, but also select, describe, and apply them reliably.

[17] CultureTalk-ID: A Multi-Task Dialogue Benchmark for Cultural Commonsense in Indonesian Local Languages cs.CLPDF

Muhammad Dehan Al Kautsar, Salsabila Pranida, Bilal Elbouardi, Fajri Koto

TL;DR: 本文介绍了CultureTalk-ID，这是首个针对印度尼西亚语及其地方语言的文化常识对话基准，包含11种语言、13个文化主题的4,496个文化对话，通过多阶段人工流程确保真实性。该基准提出了三个互补任务：基于对话的多选文化常识推理、文化忠实机器翻译和语言引导，旨在评估大语言模型在理解、迁移和生成文化语境语言方面的能力。

Details

Motivation: 现有印尼文化常识基准仅评估大语言模型在简短孤立提示上的表现，缺乏对话语境，而文化细微差别往往在对话中显现，因此需要构建对话式基准来更真实地评估模型的文化理解能力。

Result: 论文构建了包含4,496个对话的基准数据集，并设计了三个评估任务，但摘要中未提及具体定量结果或与现有模型的比较数据。

Insight: 创新点在于首次构建了印尼多语言文化对话基准，将文化常识评估从孤立提示扩展到对话语境，并通过多任务设计（推理、翻译、引导）全面评估模型的文化语言能力，强调了文化评估的语境真实性和多维度性。

Abstract: Culture is lived through conversation, yet existing Indonesian cultural commonsense benchmarks evaluate LLMs on short and isolated prompts, stripping away the dialogic context in which cultural nuances actually surface. We introduce CultureTalk-ID, the first dialogue-based benchmark for cultural commonsense in Indonesian and its local languages, comprising 4,496 culturally grounded dialogues across 11 languages and 13 culturally salient topics, curated through a multi-stage human pipeline with native speakers to ensure authenticity. CultureTalk-ID introduces three complementary tasks, namely dialogue-based multiple-choice cultural commonsense reasoning, culturally faithful machine translation, and language steering, which jointly probe whether LLMs can understand, transfer, and generate culturally grounded language.

[18] Sample-Efficient Learning from Agent Experience cs.CLPDF

Chenhui Gou, Haoqin Tu, Yunhao Fang, Jianfei Cai, Hamid Rezatofighi

TL;DR: 本文提出了经验蒸馏方法，旨在将智能体从交互历史中获得的上下文学习能力内化到模型权重中，从而在无需额外环境交互的情况下实现高效样本利用。该方法在749个软件工程任务和6个文本冒险游戏中验证了其有效性，显著提升了样本效率。

Details

Motivation: 解决现实世界中智能体学习因环境交互成本高昂（如耗时实验或人工反馈）而受限的问题，探索如何在不牺牲样本效率的前提下，将上下文学习获得的经验内化到模型参数中。

Result: 在软件工程任务和文本冒险游戏上，经验蒸馏保留了至少64.8%的上下文学习增益，而直接监督微调仅恢复3.8%；相比经典强化学习基线，该方法以至少9.6倍的更少环境样本达到相当性能。

Insight: 创新点在于将上下文蒸馏应用于智能体交互历史，实现经验的内化，避免了上下文移除后学习增益消失的问题；从客观角度看，该方法为样本受限场景下的智能体学习提供了高效且实用的解决方案。

Abstract: Real-world agent learning is often constrained by costly environment interactions, such as running time-consuming experiments or obtaining human feedback. In-context learning offers a highly sample-efficient way for agents to learn from their own interaction histories, but its gains disappear once that experience is removed from the context. Separately, context distillation provides a mechanism for internalizing contextual information into model weights. However, applying it to agents’ interaction histories without sacrificing environment sample efficiency remains underexplored. We term this problem Experience Distillation and develop an implementation that requires no further environment interaction beyond the collected experience. Experiments on 749 curated software-engineering tasks and six text-adventure games show that it retains at least 64.8% of the gains from in-context learning across both domains, whereas direct supervised fine-tuning on the collected experience recovers only 3.8%. Compared with classical reinforcement-learning baselines, in-context learning from trial-and-error experience followed by Experience Distillation matches their performance with at least (9.6\times) fewer environment samples.

[19] QuantiBias: Benchmarking Quantization-Induced Bias in LLMs cs.CL | cs.CY | cs.HCPDF

Emilio Ferrara

TL;DR: 论文提出QuantiBias基准，用于评估大语言模型量化后引发的偏见增加问题。研究发现，量化模型虽然能通过标准安全测试（如拒绝有害请求、避免过度拒绝良性提示、在多选题中选择无偏见答案），但在开放式生成任务中会显著增加刻板印象输出，且该现象在多语言中普遍存在。

Details

Motivation: 当前LLM广泛部署前常进行量化压缩，此步骤通常被视为无害且其安全性很少被重新评估。论文动机是发现量化会引入标准安全评估未能检测到的偏见增加这一主要副作用。

Result: 在Qwen和Gemma两个骨干模型、五种量化族和八个基准测试中，量化模型在开放式回答中产生刻板印象的比例约为24%至27%。量化器根据能力数据分配额外精度，但这些数据不携带偏见预防信号；推理步骤对某些量化族能将偏见效应减半，但对其他族无效。

Insight: 创新点在于提出了专门针对量化诱发偏见的生成式、多语言基准测试QuantiBias，它通过配对生成性刻板印象探测与拒绝控制、多选题控制来隔离开放式生成的影响。核心洞察是量化模型必须针对开放式偏见进行重新评估，而不仅仅是依赖其已通过的短格式安全防护测试。

Abstract: Almost every large language model that reaches a broad audience is quantized: trained in full precision, then compressed for efficiency. This step is assumed harmless and its safety is rarely re-checked. We find its principal side effect is increased bias that standard safety evaluation misses. Holding the model, its training, and the prompts fixed, a quantized model still refuses harmful requests, still avoids over-refusing benign prompts, and still selects the unbiased multiple-choice answer. Yet asked an open-ended question, the same model volunteers stereotypes in all eight languages we probe, in roughly one in four open-ended answers under an independent judge (~24% to ~27% across the compression ladder): it passes every standard check and still reaches users measurably more biased. The selective gap is a robust finding; whether open-ended bias further increases with compression is less certain, sensitive to the judge that scores it. We address both with \textbf{QuantiBias}, a benchmark that pairs a generative, multilingual stereotype probe with the refusal and multiple-choice controls that isolate open-ended generation, contrasts each build with and without reasoning, and rates the content severity of what it generates. Across two backbone models (Qwen and Gemma), a five-family screen, and eight benchmarks, quantizers allocate their extra precision by capability data that carries no bias-prevention signal, and reasoning before answering roughly halves the effect on some families while doing nothing on others. A quantized build must be re-evaluated for open-ended bias, not only on the short-form safeguards it already passes.

[20] Adaptive Depth Sparse Framework: Similarity-Driven Resource Allocation for Pre-Trained LLMs cs.CL | cs.LGPDF

Yidu Wu, Xiang Wang, Kejie Zhao, Zhangchi Wang, Qinghai Guo

TL;DR: 本文提出了一种自适应深度稀疏框架（AdaDSF），能够将预训练的大型语言模型（LLM）转换为深度稀疏模型，无需完整重训练。该方法通过分析层输入与输出隐藏状态之间的余弦相似度来分配各层的令牌保留比例，并使用轻量级路由器选择信息丰富的令牌，同时引入特征保持对齐目标来匹配稀疏与稠密模型的中间及最终表示。在GPT-NeoX和Qwen2.5模型上的语言建模和常识推理任务中，AdaDSF显著降低了推理计算量（FLOPs），同时保持了接近原始稠密模型的性能。

Details

Motivation: 动机在于Transformer架构导致LLM推理成本高昂，而现有的加速方法通常依赖于任务特定的微调或从头训练，这增加了适应成本并限制了跨任务可用性。因此，需要一种无需完整重训练即可高效压缩预训练LLM的方法。

Result: 在GPT-NeoX和Qwen2.5模型的语言建模和常识推理基准测试中，AdaDSF在显著减少推理FLOPs的同时，性能接近原始稠密模型。在可比稀疏度下，其准确率下降幅度始终小于MoD、D-LLM和DLO等强基线方法。

Insight: 创新点在于利用层间表示变换的余弦相似度作为层贡献度的度量，以此驱动自适应的令牌级稀疏化策略，并引入特征对齐目标来缓解稀疏化带来的表示偏差。客观来看，该方法提供了一种无需任务特定调整、基于预训练模型统计特性的通用稀疏化框架，平衡了效率与性能。

Abstract: Large language models (LLMs) achieve strong generation and reasoning performance, but the Transformer architecture incurs high inference cost. Existing acceleration methods often rely on task-specific fine-tuning or training from scratch, increasing adaptation cost and limiting cross-task usability. We present an Adaptive Depth Sparse Framework (AdaDSF) that converts off-the-shelf pre-trained LLMs into depth-sparse models without full retraining. Our key insight is that layers contribute unequally to representation transformation, characterized by the cosine similarity between layer input and output hidden states. Based on this, AdaDSF assigns layer-wise token retention ratios from similarity statistics, uses a lightweight router to select informative tokens at each layer, and introduces a feature-preserving alignment objective to match intermediate and final representations between sparse and dense models. On GPT-NeoX and Qwen2.5 over language modeling and commonsense reasoning, AdaDSF substantially reduces inference FLOPs while preserving performance close to dense counterparts. Under comparable sparsity, AdaDSF consistently yields smaller accuracy degradation than strong baselines including MoD, D-LLM, and DLO.

[21] MemTools: A Unified Research Framework for Interoperable Agent Memory cs.CLPDF

Chengfeng Zhao, Jinhui Chen, Sirui Liang, Shizhu He, Yequan Wang

TL;DR: 本文提出了MemTools，一个用于智能体内存系统的互操作性研究框架。该框架通过声明式数据合约标准化内存生命周期，解耦内存组件与底层部署环境，并支持符号、神经和多模态等异构内存类型的统一协调。

Details

Motivation: 现有智能体内存系统存在架构碎片化问题，内存生命周期各阶段耦合紧密，评估逻辑与特定数据集纠缠，且对异构内存类型的管理支持有限，阻碍了系统性研究。

Result: 在跨系统组件集成、评估协议重配置和异构内存协调方面的实证评估表明，MemTools能够实现对内存设计变量的系统性隔离与分析。

Insight: 核心创新在于通过声明式合约实现组件解耦与可互换组装，以及将基准数据集与执行协议正交分离以支持可控评估，为智能体内存的规范化研究提供了可扩展的基础设施。

Abstract: While memory systems are essential for agent architectures, pervasive architectural fragmentation restricts systematic research. Existing implementations typically couple different stages of the memory lifecycle, entangle evaluation logic with specific datasets, and provide limited support for the management of heterogeneous memory types. We introduce MemTools, an interoperability research framework that decouples memory system components from their underlying deployment environments. MemTools standardizes the memory lifecycle through declarative data contracts, enabling the interchangeable assembly of components across different systems. It orthogonally separates benchmark datasets from execution protocols to facilitate controlled assessments. Furthermore, MemTools provides a unified computational interface for coordinating symbolic, neural, and multimodal memory representations within a shared runtime. Empirical evaluations on cross-system component integration, evaluation protocol reconfiguration, and heterogeneous memory coordination demonstrate that MemTools enables systematic isolation and analysis of memory design variables. These findings suggest that MemTools provides a practical and extensible infrastructure for advancing principled research on agent memory.

[22] An Evaluation Framework for Structured Audio Captions Validated by Controlled Perturbations cs.CL | cs.SDPDF

Liang-Yuan Wu, Sripathi Sridhar, Mark Cartwright, Magdalena Fuentes

TL;DR: 本文提出了一种针对结构化音频描述的多轴评估框架，以解决现有指标无法可靠评估多模态属性的问题。该框架基于AudioCards数据集，从标签集、描述、逻辑推理、数值测量和频谱轮廓五个正交轴进行评估，结合LLM法官和确定性计算指标。通过引入受控扰动测试协议验证了其可靠性，能够有效区分语义保持的改写与真实的语义和声学错误。

Details

Motivation: 自动化音频字幕（AAC）的最新进展已从单一句子生成转向结构化格式，以明确解耦不同的声学和语义属性，但评估这种异构数据仍是一个重大挑战，现有指标无法可靠评估多模态属性。

Result: 通过受控扰动测试协议验证，该框架成功区分了语义保持的改写与真实的语义和声学错误，在AudioCards数据集上展示了其有效性。

Insight: 创新点在于提出了一种结合LLM法官（用于语义细微差别）和确定性计算指标（用于精确测量声学偏差）的多轴评估框架，并通过受控扰动测试协议进行严格验证，为结构化音频描述提供了更可靠的评估方法。

Abstract: Recent advancements in automated audio captioning (AAC) have shifted from monolithic sentence generation toward structured formats that explicitly disentangle distinct acoustic and semantic properties. However, evaluating this heterogeneous data remains a significant challenge. Existing caption metrics focus on flat textual outputs and fail to reliably assess multimodal attributes. To bridge this gap, we propose a multi-axis evaluation framework tailored for structured audio descriptions. Building on the AudioCards dataset, we evaluate outputs across five orthogonal axes: tag-sets, descriptions, logical reasoning, numeric measurements, and spectral profiles. Our approach combines Large Language Model (LLM) judges to capture semantic nuance with deterministic computational metrics to precisely measure acoustic deviations. To rigorously validate the reliability of this framework, we introduce a controlled perturbation testing protocol that injects typed, graded errors into groundtruth annotations. Our results demonstrate that this framework successfully distinguishes meaning-preserving paraphrases from genuine semantic and acoustic corruptions.

[23] RUMBA: Russian User Memory Benchmark cs.CL | cs.AIPDF

Elizaveta Shevtsova, Inna Glebkina, Mark Baushenko, Pavel Gulyaev, Alena Fenogenova

TL;DR: 本文介绍了RUMBA（俄罗斯用户记忆基准），这是一个针对长时会话记忆的新基准，专注于俄语，旨在通过细粒度分类和统一方法评估模型在长程上下文、时间信息和推理方面的交互能力。

Details

Motivation: 现有基准以英语为中心且依赖聚合检索指标，无法捕捉长程上下文、时间信息与推理之间的交互，因此需要开发更全面的长时记忆评估工具。

Result: 评估了当代记忆系统和长上下文模型，RUMBA可作为诊断工具分析模型在不同基准切片上的行为，识别不同记忆机制的优势和失败模式。

Insight: 创新点包括提供细粒度的记忆中心问题类型分类和统一方法，考虑语义类型、会话范围、时间推理和时间表达明确性，并提供了对齐的英语子集以支持跨语言比较。

Abstract: The ability to handle long-term memory in LLMs is becoming increasingly critical, yet existing benchmarks remain English-centric and rely on aggregate retrieval metrics, failing to capture interactions between long-range context, temporal information, and reasoning. To address this, we introduce RUMBA (Russian User Memory BenchmArk) - a new benchmark for long-term conversational memory that provides a fine-grained taxonomy of memory-centric question types and a unified methodology accounting for semantic type, session scope, temporal reasoning, and the explicitness of temporal expressions. RUMBA consists of timestamped user-assistant dialogues with QA pairs requiring retrieval, combination, and reasoning across sessions. While designed for Russian, we also provide an aligned English subset under the same methodology. We evaluate contemporary memory systems and long-context models, and show how RUMBA serves as a diagnostic tool to analyze model behavior across benchmark slices and identify strengths and failure modes of different memory mechanisms.

[24] Token Budget Saturation and Mechanistic Early Detection of Reasoning Non-Convergence in Chain-of-Thought Models cs.CL | cs.AI | cs.LGPDF

Renuka Oladri, Niveda Jawahar, Abdirisak Mohamed

TL;DR: 本文研究了DeepSeek-R1-Distill-Qwen-7B等思维链推理模型的收敛模式，发现其生成结果呈现双峰分布：要么在token预算内终止（收敛），要么耗尽预算未达结论（不收敛）。作者通过实证分析发现，收敛的生成在AIME 1983-2024数据集上准确率达90.3%，而不收敛的仅6.6%，总体收敛率为62.0%。进一步，研究探索了是否能在推理早期通过模型内部表征检测收敛命运，发现第20层在token 150处的激活能实现AUC 0.608的预测性能，优于基于token熵和重复统计的行为基线，表明收敛命运在生成结束前已部分编码于中间表示中。

Details

Motivation: 解决思维链推理模型中存在的双峰收敛问题，即模型生成要么成功收敛，要么耗尽计算资源却无法得出结论，旨在探究能否在推理早期检测这种收敛命运，以实现早期退出推理和自适应计算分配。

Result: 在AIME 1983-2024基准上，收敛生成准确率90.3%，不收敛仅6.6%，总体收敛率62.0%；使用线性探针在token 150处第20层激活预测收敛的AUC达0.608（±0.080，5折交叉验证），显著优于基于token熵和重复的行为基线，置换检验p=0.063。

Insight: 创新点在于首次从机制角度早期检测思维链模型的非收敛性，利用中间层激活而非最终输出行为进行预测，为优化推理效率（如早期退出）提供了新途径；客观来看，该方法揭示了模型内部表示在推理过程中已编码收敛信息，可应用于资源自适应分配。

Abstract: Chain-of-thought reasoning models such as DeepSeek-R1-Distill-Qwen-7B exhibit a bimodal convergence pattern: generations either terminate within a token budget (converged) or exhaust it without reaching a conclusion (non-converged). We characterize this phenomenon empirically, showing that converged generations achieve 90.3% accuracy on AIME 1983-2024 while non-converged ones achieve only 6.6%, with an overall convergence rate of 62.0%. We then ask whether this outcome is detectable early in the thinking chain using internal model representations. Training linear probes on hidden-state activations at token positions 50-300, we find that layer-20 activations at token 150 achieve AUC 0.608 (+-0.080, 5-fold CV), reliably above chance even at token 50. Activation probes consistently outperform behavioral baselines derived from token entropy and repetition statistics. A sweep-level permutation test yields p=0.063 (100,000 permutations), consistent with a modest signal that our sample size cannot confirm at conventional thresholds. These findings suggest that convergence fate is partially encoded in intermediate representations well before the generation ends, opening a path toward early-exit inference and adaptive compute allocation.

[25] Capital Markets LLM Reliability Score (CM-LRS): From Plausible to Bankable cs.CLPDF

Prerit Ahuja

TL;DR: 本文提出了资本市场监管语言模型可靠性评分（CM-LRS），这是一个用于评估大语言模型在资本市场工作流中输出可靠性的新框架。该评分从七个维度（如事实准确性、证据可追溯性、决策有用性等）对模型输出进行0-5分的评估，并在五个实际工作流（如交易条款提取、发行人概况合成）上测试了多个模型。研究发现，前沿闭源模型（如Sonnet、Opus）得分相近且领先，而开源模型（Llama 3.3 70B）表现落后，差距主要体现在检索和综合任务上。

Details

Motivation: 现有评估方法（如开放域QA或金融基准测试）主要关注问题-答案层面的表面准确性，但无法评估模型在真实资本市场工作流中产生的、需要面对交易对手或监管机构审查的“可交付成果”的可靠性与可辩护性。

Result: 在基于SEC EDGAR文件等数据集的五个工作流评估中，前沿闭源模型（Claude 3.5 Sonnet, Opus, GPT-4o）的CM-LRS平均分非常接近（4.31, 4.30, 4.09），而开源模型Llama 3.3 70B得分显著较低（3.15）。模型间差距主要集中于检索和综合维度，且在“决策有用性”维度上表现出最大的模型间差异和较高的评委间一致性。

Insight: 论文的核心创新在于将LLM评估从传统的“答案正确性”层面提升到“工作流输出可交付性”层面，定义了七个面向实际监管和决策需求的评估维度。这为在高度监管的金融等领域评估和比较LLM的实用可靠性提供了一个系统化、可定制的框架，强调了“可用性”而非仅仅是“合理性”。

Abstract: In capital-markets workflows the question is rarely whether a large language model can produce a fluent draft, but whether the draft is bankable: defensible in front of a counter-party or a regulator, with the documents in hand. Existing methods address parts of that gap: open-domain QA benchmarks reward surface accuracy, and finance benchmarks (FinanceBench, FinQA, ConvFinQA) advance document-grounded and numerical QA but evaluate at the question-answer layer rather than the workflow outputs practitioners defend. We introduce CM-LRS, a Capital Markets LLM Reliability Score, evaluating outputs at the workflow-output layer across seven dimensions: factual accuracy, evidence traceability, numerical consistency, workflow completeness, source discipline, decision usefulness, and reviewability/auditability. Each is scored 0-5 against a rubric anchored on signals reviewers in regulated settings use; the aggregate is tunable to the workflow. We demonstrate CM-LRS on five workflows (DCM transaction-terms extraction, precedent retrieval, issuer profile synthesis, M&A transaction-comparable reasoning, ECM transaction-terms extraction) over public SEC EDGAR filings, a public UK takeover release, and fictional synthetic supplements, scoring four models against four independent LLM judges spanning three model families. Three findings. First, the frontier closed-source models cluster within 0.22 points on four-judge averaged CM-LRS (Sonnet 4.6 = 4.31, Opus 4.7 = 4.30, GPT-5.5 = 4.09); all four judges place the open-weights baseline (Llama 3.3 70B = 3.15) last. Second, that gap concentrates on retrieval (2.23) and synthesis (2.15), not extraction (0.84). Third, Decision Usefulness shows the widest cross-model dispersion of any dimension (4.0 points on issuer profiling) and top-tier inter-judge agreement (mean r = 0.52). Plausibility is cheap. Bankability is the bar.

[26] MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Education cs.CL | cs.HCPDF

Qian Wu, Xinrong Zhou, Zizhan Ma, Kai Chen, Zheyao Gao

TL;DR: 本文提出了MedGame框架，利用大型语言模型将静态临床病例转化为结构化、可执行的叙事游戏，以支持医学教育。该框架采用双引擎设计：医学叙事设计师生成基于病例的临床故事情节，故事导演将其转换为依赖感知的多模态编排计划，并通过交互平台呈现。研究构建了包含5000个病例的MedGame Bench基准和评估协议，实验表明任务特定微调能显著提升开源LLM性能，缩小与商业模型的差距，初步学生研究显示学习者认为MedGame比纯文本替代方案更具吸引力和实用性。

Details

Motivation: 现有基于LLM的医学教育系统多局限于局部交互（如问答或单轮反馈），缺乏将整个临床病例组织成以决策为中心的学习轨迹的能力，因此需要开发一种能结构化呈现病例的叙事游戏化框架。

Result: 在构建的MedGame Bench基准上，任务特定微调显著提升了开源LLM（如Llama-3.1-8B）在医学叙事生成和故事导演任务上的性能，缩小了与GPT-4等商业模型的差距；初步学生研究表明，学习者认为MedGame比纯文本替代方案更具吸引力和实用性。

Insight: 创新点在于提出了双引擎框架（医学叙事设计师和故事导演）将临床病例游戏化，并构建了大规模基准MedGame Bench用于评估；从客观角度看，该研究将叙事生成与多模态编排结合，为医学教育提供了可扩展的交互式学习路径，强调了依赖感知的故事规划在提升学习体验中的价值。

Abstract: Large Language Models (LLMs) show promise for medical education, but most existing systems focus on localized interactions such as question answering or single-turn feedback, rather than organizing an entire clinical case into a decision-centered learning trajectory. We introduce \textit{MedGame}, a framework that transforms static clinical cases into structured, executable storytelling games. MedGame uses a dual-engine design: a Medical Narrative Designer synthesizes case-grounded clinical storylines with states and decision nodes, while a Story Director converts them into dependency-aware multimodal orchestration plans rendered by our released interactive platform. We construct MedGame Bench, a 5,000-case benchmark and evaluation protocol for Medical Narrative Generation and Story Direction. Experiments show that task-specific fine-tuning substantially improves open-source LLMs on MedGame Bench and narrows the gap with commercial models. A pilot student study further shows that learners perceive MedGame as more engaging and useful than text-only alternatives.

cs.CV [Back]

[27] Axolotl3D: a Unified Framework for Faithful 3D Shape Completion cs.CVPDF

Anita Hu, Maria Shugrina

TL;DR: 本文提出Axolotl3D，一个多模态、遮挡感知的3D生成模型，用于在图像、可见性掩码、相机参数和部分点云等多种条件信号下进行可控的3D形状补全。该模型通过点云作为几何锚点确保补全的忠实性，并通过相机参数保证多视角对齐，统一的训练策略使其能处理多样化的条件输入。

Details

Motivation: 现有3D生成模型通常假设输入为完整可见的单视图图像，这限制了其在多视角、遮挡或编辑场景下的应用。虽然已有工作分别解决这些问题，但缺乏一个统一的框架来处理多样化的条件信号以实现可控的3D补全。

Result: 在Toys4K和OmniObject3D数据集上的实验表明，该方法在干净和遮挡设置下均达到了最先进的性能，并在真实世界重建和几何一致性编辑任务中取得了强劲结果。

Insight: 创新点在于提出了一个统一的框架，能够联合处理图像、掩码、相机参数和部分点云等多模态输入，其中点云作为几何锚点增强了补全的忠实性，而统一的训练策略实现了鲁棒的跨模态推理。从客观角度看，这种多条件集成和遮挡感知设计为复杂场景下的3D生成提供了更灵活和可靠的方法。

Abstract: Recent 3D generative models produce high-quality geometry from a single image using large-scale priors and diffusion architectures. However, they assume complete visibility and single-view inputs, limiting applicability in multi-view, occluded, or editing scenarios. Although prior works address these challenges individually, they lack a unified framework for controllable 3D completion under diverse conditioning signals. We present Axolotl3D, a multi-modal and occlusion-aware 3D generation model that jointly conditions on images, visibility masks, camera parameters, and a partial point cloud. The point cloud serves as a geometric anchor promoting faithful shape completion, while camera parameters ensure consistent multi-view alignment in a shared 3D coordinate system. A unified training strategy synthesizes diverse conditioning regimes from large-scale 3D data, enabling robust cross-modal reasoning. Experiments on Toys4K and OmniObject3D demonstrate state-of-the-art performance under both clean and occluded settings, as well as strong results in real-world reconstruction and geometry-consistent editing.

[28] RealVDeblur: One-Step Diffusion for Generalizable Real-World Video Deblurring cs.CV | cs.AIPDF

Renbiao Jin, Mingxin Yang, Yutian Chen, Junhao Zhuang, Xin Cai

TL;DR: 该论文提出了一种名为RealVDeblur的高效生成框架，用于解决真实世界视频去模糊问题。该方法首先构建了一个基于3D高斯溅射和高帧率视频的大规模物理模糊合成管道以生成逼真训练数据，然后利用视频扩散先验进行恢复，并通过知识蒸馏将多步扩散采样压缩为高效的一步生成器，实现了对长视频的稳定推理。

Details

Motivation: 真实世界视频去模糊面临运动模式多样、退化复杂以及真实训练数据稀缺的挑战，而鲁棒的恢复对于移动成像和3D重建等下游任务至关重要。

Result: 在多个真实世界基准测试上的广泛实验表明，该方法在未见视频上具有强大的感知质量、语义保真度和时间一致性，并且在严重运动模糊下改善了3D重建等下游任务的鲁棒性。

Insight: 创新点包括：构建物理基础的逼真模糊合成管道以缓解数据稀缺；通过禁用VAE中的时间压缩和采用逐帧编码方案来适应帧间模糊变化；通过知识蒸馏实现高效一步推理，并结合无训练的时间窗口掩码实现长视频的稳定处理。

Abstract: Real-world video deblurring remains challenging due to diverse motion patterns, complex degradations, and the scarcity of realistic training data, yet robust restoration is critical for downstream pipelines such as mobile imaging and 3D reconstruction. This work presents \textbf{RealVDeblur}, an efficient generative framework designed to improve in-the-wild robustness under diverse real capture conditions. First, a large-scale, physically grounded blur synthesis pipeline is constructed from scene-level 3D Gaussian Splatting (3DGS) assets and high-frame-rate videos, providing realistic training data covering both camera-induced and object-motion blur. Second, a video diffusion prior is leveraged for restoration; to better accommodate frame-dependent blur variations, temporal compression in the VAE is disabled and a frame-wise encoding scheme is adopted. For practical deployment on long videos, multi-step diffusion sampling is distilled into an efficient one-step generator, and a training-free Temporal Window Mask stabilizes inference beyond the training horizon with constant memory usage. Extensive experiments on diverse real-world benchmarks demonstrate strong perceptual quality, semantic fidelity, and temporal consistency on unseen videos, as well as improved robustness in downstream 3D reconstruction under severe motion blur. Project page: https://rbjin.github.io/RealVDeblur

[29] Spatially Grounded Concept Bottleneck Models for Trustworthy Breast Ultrasound Diagnosis cs.CV | cs.AIPDF

Moshiur Rahman Tonmoy, Dunren Che, Haitham Y. Adarbah, Afzel Noore

TL;DR: 本文提出了一种空间接地概念瓶颈模型（SG-CBM），用于提升乳腺超声诊断的可信度。该模型利用粗略的病变勾画作为弱监督，将概念激活与解剖学上合理的区域（如病灶内部区域和后声带）对齐，从而生成更可靠的空间解释。实验表明，SG-CBM在诊断性能和概念空间对齐方面均有显著提升。

Details

Motivation: 现有概念瓶颈模型在医学影像中的可信度受限于监督质量，其预测的概念激活可能由不相关区域驱动，导致空间解释不忠实。本文旨在通过空间接地设计，利用弱监督提升概念证据的解剖学合理性。

Result: 在五折分层组交叉验证中，SG-CBM提高了诊断AUROC和概念宏观AUROC，并显著增强了概念证据的空间对齐。通过训练-损坏/测试-干净的标注质量压力测试，量化了监督质量对诊断和空间忠实性的影响。

Insight: 创新点在于将粗略病变勾画作为弱监督，通过分组空间接地目标训练概念图，并保持线性瓶颈分类器的语义忠实性。这强调了数据质量感知的监督设计和系统性可信度验证在可部署医疗AI系统中的重要性。

Abstract: Concept Bottleneck Models provide interpretable-by-design predictions by mediating diagnosis through human-understandable concepts, but in medical imaging, their trustworthiness is often limited by the quality and granularity of available supervision. In particular, predicted concept activations can be driven by irrelevant regions, leading to spatially unfaithful explanations. We study a data-centric spatially grounded Concept Bottleneck Model (SG-CBM) that leverages coarse lesion delineations as weak supervision to encourage anatomically plausible concept evidence. For breast ultrasound, we derive two clinically motivated zones from each lesion mask: (i) an in-lesion region of interest for morphology-related concepts and (ii) a posterior acoustic band for posterior phenomena. We train concept maps using a grouped spatial grounding objective and preserve semantic faithfulness with a linear bottleneck classifier. Across five-fold stratified group cross-validation, the proposed SG-CBM improves diagnostic AUROC and concept macro-AUROC while markedly increasing spatial alignment of concept evidence. We also perform a Train-corrupt/Test-clean annotation-quality stress test to quantify the impact of supervision quality on diagnosis and spatial faithfulness. Overall, the results underscore the need for data-quality-aware supervision design and systematic trustworthiness validation for deployable healthcare AI systems.

[30] ODeform: Learning Continuous 4D Motion for Shape Deformation with Neural ODEs cs.CVPDF

Yordanka Velikova, Mahdi Saleh, Liming Kuang, Benjamin Busam

TL;DR: ODeform是一种基于神经常微分方程（Neural ODEs）的新方法，用于对可变形物体在3D空间中的连续4D运动进行建模。它将3D点云和物理条件映射到一个统一的潜在空间，通过求解常微分方程来模拟连续的形变流，避免了离散时间步长并保持了计算效率。

Details

Motivation: 现有方法（如基于学习的方法或物理模拟器）要么依赖离散时间步长，要么计算成本过高，难以满足实时应用需求，因此需要一种能高效建模连续形变的方法。

Result: 在未见过的物理参数配置上评估，该方法在运动预测准确性上优于基线方法；实验还展示了其能成功迁移到具有新形状的真实3D捕获物体，并能有效进行动力学的插值和外推。

Insight: 创新点在于将神经ODE扩展到可变形物体的连续4D动力学建模，通过统一潜在空间和连续流表示，实现了高效且连续的形变模拟，为实时视觉和机器人任务提供了新思路。

Abstract: Modeling continuous object deformation is important for many computer vision and robotics tasks, such as manipulation and simulation. Existing approaches rely on learning-based methods or physics simulators to model shape deformations. However, these approaches either use discrete time steps or are too computationally intensive for real-time applications. We present ODeform, a novel extension of Neural Ordinary Differential Equations to continuous 4D dynamics of deformable objects in 3D space. Our method transforms 3D point clouds and physical conditions (like material properties) into a unified latent space. By solving the resulting ordinary differential equations over time, we model deformations as continuous flows within this learned embedding, eliminating the need for discrete time steps while maintaining computational efficiency. We evaluate our approach on unseen physical parameter configurations, showing improved motion prediction accuracy over baseline methods. Our experiments further demonstrate a successful transfer to real 3D captured objects with novel shapes, along with effective interpolation and extrapolation of the learned dynamics. Our code and data will be made publicly available.

[31] Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness cs.CVPDF

Inpyo Song, Jangwon Lee

TL;DR: 本文重新审视了开放世界视频异常检测（OWVAD）任务，指出当前评估方法存在‘定义盲区’问题，即模型在评估中表现良好却对用户指定的异常定义不敏感。作者通过分解现有评估协议，揭示了其过度偏重于目标与正常帧的区分，而忽视了定义条件化的异常判别。为此，论文提出了三种新的定义条件化评估指标（DC-Disc、DC-DetΔ、DC-SelΔ）来消除评估捷径，并引入了一种定义对比评分方法DeCoS来提升模型对定义的响应能力。

Details

Motivation: 当前OWVAD评估未能有效隔离模型对用户指定异常定义的响应行为，导致模型可能在评估中得分很高，但实际上对查询的定义几乎不敏感，即存在‘定义盲区’问题。

Result: 在UCF-Crime、XD-Violence和MSAD等基准测试上的实验表明，多个先进的VAD、OWVAD和视觉语言模型基线虽然能定位异常时刻，但在遵循定义方面表现较弱，定义响应边际接近零。提出的DeCoS方法将最强基线的DC-Disc AUROC提升了7.3-16.0点，DC-DetΔ提升了15.5-28.3点。

Insight: 论文的核心创新在于诊断并量化了OWVAD评估中的‘定义盲区’问题，并提出了专门针对定义条件化行为的评估指标和一种通过减去跨定义共享的异常证据来增强定义响应的方法DeCoS，这为未来OWVAD研究提供了更严格的评估框架和改进方向。

Abstract: Open-world video anomaly detection (OWVAD) is expected to detect events that match a user-specified definition of abnormality. This requirement is stronger than generic anomaly localization: in the same video, changing the definition should change which temporal regions are scored as anomalous. We show that current OWVAD evaluation largely fails to isolate this conditional behavior. Standard VAD metrics and the dynamic-definition protocol can be dominated by target-versus-normal separation, allowing models to obtain strong scores while remaining nearly insensitive to the queried definition. We call this failure mode definition blindness. To explain why it is missed, we decompose dynamic-definition evaluation into target-versus-normal detection and target-versus-other-anomaly discrimination, and find that the former receives 7.2-26.8$\times$ more weight across common VAD benchmarks. Motivated by this diagnosis, we introduce three definition-conditioned evaluation metrics, DC-Disc, DC-Det$Δ$, and DC-Sel$Δ$, which progressively remove normal-frame, generic-anomaly, and multi-event selection shortcuts. Experiments on UCF-Crime, XD-Violence, and MSAD reveal that several strong VAD, OWVAD, and general vision language model baselines localize anomalous moments but exhibit weak definition following, often with near-zero definition-response margins. To validate that the failure is actionable, we further introduce DeCoS, a definition-contrastive scoring rule that subtracts anomaly evidence shared across definitions. DeCoS improves the strongest baseline by 7.3-16.0 AUROC points on DC-Disc and 15.5-28.3 points on DC-Det$Δ$. Overall, our results argue that OWVAD should be evaluated as definition-conditioned anomaly scoring, not as anomaly detection under different prompt labels.

[32] Ocular Verification for Virtual Reality cs.CVPDF

Husanpreet Singh, Robert Tran, Ayushree Kharel, Sudipta Banerjee

TL;DR: 本文研究了虚拟现实（VR）头显中的生物特征识别问题，重点关注虹膜识别在VR环境下面临的挑战。论文评估了ISO/IEC 29794-6虹膜质量指标在VRBiom数据集上的局限性，利用生成模型处理离轴注视、非均匀光照和镜面反射等数据特定问题，并进行了单模态（虹膜、眼周）识别与多模态（虹膜+眼周）分数级融合。

Details

Motivation: VR头显（如Meta Quest、Apple Vision Pro）依赖虹膜等生物特征进行用户认证，但传统虹膜识别协议在VR无约束采集场景下可能不足，需要解决数据质量挑战。

Result: 实验发现，某些质量指标（如边缘充分性）在VR采集数据上失效；图像调整主要提升眼周识别性能；多模态融合将等错误率（EER）比单模态虹膜识别降低了约11%。

Insight: 创新点在于系统评估VR虹膜识别质量指标的适用性，并利用生成模型处理VR特定成像问题；多模态融合显著提升识别性能，为VR生物认证提供了实用方案。

Abstract: Virtual reality (VR) headsets (e.g., Meta Quest, Apple Vision Pro) provide a seamless user experience due to their fast, frictionless interaction with the physical world in a simulated environment. User authentication relies on biometric cues such as iris in such headsets. However, traditional iris recognition protocols may not be adequate in cases of unconstrained acquisition, which is typical of VR-based data. In this work, we examine three crucial aspects: (1) evaluating ISO/IEC 29794-6 iris quality metrics on VRBiom dataset and analyzing their limitations, (2) addressing data-specific challenges such as off-axis gaze, non-uniform illumination, and specular reflection using generative models, and (3) performing unimodal (iris, periocular) recognition and multimodal score-level fusion (iris + periocular). We observe that some metrics (e.g., margin adequacy) fail on VR-acquired data; whereas, image adjustments primarily benefit periocular recognition, and multimodal fusion lowers EER by ~11% over unimodal iris recognition performance. We will release the evaluation scripts upon acceptance for reproducibility.

[33] WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing cs.CVPDF

Ming Hu, Mingyu Dou, Jianfu Yin, Miaomiao Zhang, Cong Hu

TL;DR: 本文提出WhereEdit框架，针对一步式文本到图像（T2I）模型在图像编辑中缺乏空间控制的问题，通过局部自适应编辑实现掩码感知的潜在空间编辑。该方法自动从模型内部特征识别语义相关区域，并应用自适应局部调制以增强目标区域编辑，同时保持非目标区域和结构一致性。

Details

Motivation: 现有的一步式图像编辑方法主要依赖文本条件进行语义转换，缺乏对编辑位置的显式空间控制，且在引入空间约束时难以在目标区域内实现强而稳定的语义修改。

Result: 在PIE-Bench基准测试中，WhereEdit持续优于现有的一步式图像编辑方法，实现了更优的编辑质量，同时保持了一步生成的高效性。区域级监督的额外实验进一步凸显了显式空间推理对高质量一步式图像编辑的重要性。

Insight: 创新点在于将一步式编辑重新定义为局部自适应编辑，通过内部特征自动发现可编辑区域并进行局部调制，解决了全局语义传输在一步式设置下局部高强度编辑的局限性，提供了掩码感知的潜在空间编辑新思路。

Abstract: Recent one-step text-to-image (T2I) models enable efficient image synthesis and provide new opportunities for real-time image editing. However, existing one-step editing methods primarily rely on text conditioning for semantic transformation, lacking explicit spatial control over \textit{where} to edit. More importantly, even when spatial constraints are introduced, these methods often struggle to achieve strong and stable semantic modifications within the target regions. In this work, we revisit one-step image editing from a spatially controlled perspective and identify two key challenges: discovering editable regions and achieving effective localized semantic transformation. We reveal that existing methods perform global semantic transport, which limits high-intensity local editing under the one-step setting. To address this issue, we propose \textbf{WhereEdit}, a framework that reformulates one-step editing as localized adaptive editing. WhereEdit automatically identifies semantically relevant regions from internal model features and applies adaptive local modulation to enhance target-region editing while preserving non-target areas and structural consistency. Experiments on the PIE-Bench benchmark demonstrate that WhereEdit consistently outperforms existing one-step image editing methods, achieving superior editing quality while maintaining the efficiency of one-step generation. Additional experiments with region-level supervision further highlight the importance of explicit spatial reasoning for high-quality one-step image editing.

[34] ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes? cs.CVPDF

Han Li, Si Liu, Zehao Huang, Dongxin Lyu, Longfei Xu

TL;DR: 本文提出了ViSTR-Bench，一个新颖的视觉时空推理基准测试，旨在系统评估多模态大语言模型（MLLMs）能否从动态场景的连续视觉线索中进行定性推理。该基准基于时间强调、推理导向和定性评估原则，构建了涵盖运动感知、空间关系、结果预测和物理动力学的四维评估体系，包含15个子任务和1340个高质量视频问答对。对一系列先进MLLMs的广泛评估表明，尽管模型具备较强的通用视频理解能力，但在复杂时空推理方面仍存在显著瓶颈，远低于人类水平。

Details

Motivation: 现有MLLMs在专家级任务上表现出色，但在人类通过持续观察现实世界自然发展的基本能力（如空间感知和动态推理）上仍存在不足。现有基准大多关注静态场景或需要精确的定量预测，而对基于时间线索的直观推理探索不足。

Result: 对一系列最先进的专有、开源和专用空间MLLMs进行了广泛评估。结果表明，尽管这些模型具备较强的通用视频理解能力，但在ViSTR-Bench的复杂时空推理任务上仍面临显著瓶颈，性能远低于人类。

Insight: 论文的创新点在于提出了一个专注于从动态场景连续视觉线索进行定性推理的综合性评估基准（ViSTR-Bench），其设计遵循了时间强调、推理导向和定性评估三大原则。这填补了现有基准在直观时空推理评估方面的空白，为模型能力的系统性诊断提供了新工具。

Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse expert-level tasks, but they still struggle with fundamental abilities that humans naturally develop through continuous observation of the real world, such as spatial perception and dynamic reasoning. Recent studies have recognized this gap and introduced dedicated benchmarks to evaluate the spatial-temporal capabilities of MLLMs. However, existing benchmarks mostly focus on static scenes or require exact quantitative predictions, leaving intuitive reasoning from temporal cues largely underexplored. In this paper, we introduce the Visual Spatial-Temporal Reasoning Benchmark (ViSTR-Bench), a novel evaluation suite designed to systematically assess whether MLLMs can perform qualitative reasoning from continuous visual cues in dynamic scenes. Guided by the principles of temporal emphasis, reasoning orientation, and qualitative evaluation, ViSTR-Bench establishes a comprehensive four-dimensional evaluations covering Motion Perception, Spatial Relations, Outcome Prediction, and Physical Dynamics. The benchmark comprises 15 distinct subtasks and 1,340 high-quality video question-answer pairs spanning diverse tabletop, indoor, and outdoor scenarios. Extensive evaluations of a broad spectrum of state-of-the-art proprietary, open-source, and specialized spatial MLLMs reveal that, despite their strong general video understanding capabilities, current models still face substantial bottlenecks in complex spatial-temporal reasoning and remain far below human performance.

[35] Engine-Native Editable 3D World Reconstruction with Objects and Lighting cs.CVPDF

Junhao Chen, Xinghao Chen, Henghaofan Zhang, Zihao Qiao, Saining Zhang

TL;DR: 本文提出了Lumera，一个用于从单张图像进行引擎原生、光照感知的3D场景解析的基准和参考流程。它包括一个由2,513个UE5项目构建的大规模数据集Lumera-2K，以及两个核心组件：Lumera-Box用于解析物体包围盒，Lumera-Light用于解析参数化光源。该方法通过物体网格重建、HDR环境估计和智能优化循环进行组装，旨在生成可直接导入标准引擎进行编辑的3D场景。

Details

Motivation: 现有单图像3D场景生成方法大多局限于房间级几何、烘焙/全局光照或文本驱动生成，无法提供可直接在标准引擎中检查、移动和导入的可编辑物体实例和光源。本文旨在解决这一问题，实现引擎原生、光照感知的3D场景解析。

Result: 在清理后的包围盒基准测试中，Lumera-Box在整体检测、几何、语义和布局得分上表现最佳（合并mAP 0.1141，IoU-B 0.2472，F-score 0.2762），但WildDet3D在锚点召回上更强。对于光源，Lumera-Light几乎能恢复所有非空场景（召回率0.998），但在单个光源定位上仍有局限（F1 0.209），匹配光源的中位位置误差为0.261米，中位ΔE2000色差为4.59，强度皮尔逊相关系数r=0.628。

Insight: 创新点在于首次将参数化光源确立为可测量的可编辑场景目标，并提出了一个统一的、引擎原生的场景解析流程。客观来看，其构建的大规模、细粒度的引擎原生数据集（Lumera-2K）以及将视觉语言模型（VLM）适配于解析物体包围盒和参数化光源元组的方法，为解决可编辑3D场景重建的关键瓶颈（如关系结构、光源召回/强度、跨引擎泛化）提供了新的基准和方向。

Abstract: Editable 3D scene creation requires object instances and lights that can be inspected, moved, and imported into standard engines, yet existing single-image methods largely stop at room-scale geometry, baked/global illumination, or text-driven generation. We introduce Lumera (Light-aware Unified Engine-native Reconstruction and Assembly), a benchmark and reference pipeline for engine-native, light-aware 3D scene parsing from a single image. Lumera-2K is built from 2,513 UE5 projects and provides 3.73M components, 63M object instances, 102.6K engine-native parametric lights, and 95.1K camera views. On this data, Lumera-Box and Lumera-Light adapt VLM to parse object boxes and parametric light tuples (x,y,z,r,g,b,I), which are assembled with per-object mesh reconstruction, HDR environment estimation, and a bounded agentic refinement loop. In a sanitized box benchmark against DetAny3D, SpatialLM, N3D-VLM, and WildDet3D, Lumera-Box obtains the strongest overall detection, geometry, semantic, and layout scores (merged mAP 0.1141, IoU-B 0.2472, F-score 0.2762), while WildDet3D remains stronger on anchor recall. For lights, Lumera-Light recovers almost all non-empty scenes (recall 0.998) but remains limited at individual-light localization (F1 0.209 at 0.5 m); matched lights have median position error 0.261 m, median ΔE2000 4.59, and intensity Pearson r=0.628. These results establish parametric lights as a measurable editable-scene target and expose remaining bottlenecks in relation structure, light recall/intensity, and cross-engine generalization.

[36] DINO-VPT: Hierarchical Visual Prompt Tuning for Joint Physical-Digital Face Anti-Spoofing cs.CVPDF

Pierre Gallin-Martel, Mika Feng, Koichi Ito, Takafumi Aoki

TL;DR: 本文提出DINO-VPT，一种基于分层视觉提示调优的轻量级纯视觉框架，用于联合物理与数字人脸防伪检测。该方法通过提示路由网络根据输入特征动态注入提示，有效解耦多种伪造伪影，无需多模态融合。在UniAttackData基准测试中，DINO-VPT比基于视觉语言模型的SOTA方法取得了更高准确率。

Details

Motivation: 随着伪造攻击日益多样化，需要能同时检测物理和数字威胁的统一人脸防伪模型；现有视觉语言模型虽泛化能力强，但依赖复杂的多模态融合和外部文本编码器。

Result: 在UniAttackData基准上，DINO-VPT取得了比当前最先进的基于视觉语言模型的方法更高的准确率，达到了SOTA性能。

Insight: 创新点在于采用分层视觉提示调优和提示路由网络，实现纯视觉架构下的统一防伪，避免了多模态监督；客观来看，其通过动态条件化提示有效解耦伪造特征，证明了纯视觉方法在统一防伪任务中的潜力。

Abstract: With the increasing diversity of spoofing attacks, there is a growing demand for unified Face Anti-Spoofing (FAS) models capable of detecting both physical and digital threats. While existing Vision-Language Models (VLMs) demonstrate high generalization in this context, they heavily rely on complex multimodal fusion and external text encoders. In this paper, we propose DINO-VPT, a lightweight, vision-only framework leveraging hierarchical visual prompt tuning. By dynamically injecting prompts conditioned on input features via a Prompt Routing Network (PRN), our method effectively disentangles diverse spoofing artifacts without requiring multimodal fusion. Evaluations on the UniAttackData benchmark demonstrate that DINO-VPT achieves higher accuracy than state-of-the-art VLM-based methods. Our results indicate that a properly structured vision-only architecture can achieve state-of-the-art performance in unified FAS without the need for multimodal supervision.

[37] Sidewalk Moments: Are Richer Representations Always More Human-Aligned? Evidence from City-Walk Videos cs.CV | cs.HCPDF

Liu Liu, Freya Huying Tan, Fábio Duarte

TL;DR: 本研究通过分析61个第一人称城市行走视频的50,000多个片段，探讨了更丰富的视觉表征（如时空视频特征）是否必然产生更符合人类判断的城市参与度度量。研究发现，在连续相关性分析中，视频特征确实表现出最强的对齐性；但在二元分类任务（区分高参与度与低参与度时刻）中，时间平均图像（TAIs）的表现与视频相当甚至更优，且人类实验证实了这一结果。研究揭示了视频特征在动态活动场景中占优，而TAIs在稳定空间结构场景中更符合人类判断，挑战了‘表征越丰富越人类对齐’的假设。

Details

Motivation: 解决当前基于丰富视频特征训练感知评分模型的普遍假设是否成立的问题，即检验更丰富的时空表征是否必然导致更符合人类判断的参与度度量。

Result: 在Spearman相关分析中，视频特征在连续对齐性上最强；但在二元分类任务中，TAIs在大多数分类器和分位数阈值下匹配或优于视频特征。人类众包实验（Amazon Mechanical Turk）进一步证实，参与者从TAIs和完整视频片段中识别高参与度时刻的准确率相当，而文本描述表现显著更差，音频接近随机水平。

Insight: 创新点在于揭示了视觉表征丰富性与人类对齐性之间的非单调关系，并提出了功能分离现象：动态内容场景适合视频特征，而稳定空间结构场景适合时间平均图像（TAIs）。这为感知基础的时间压缩作为全视频编码的原则性替代方案提供了证据。

Abstract: We examine whether richer visual representations yield more human-aligned measures of urban engagement, using 61 first-person city-walk videos from YouTube segmented into over 50,000 ten-second clips and represented across four modalities: spatiotemporal video features, temporally averaged images (TAIs), audio embeddings, and text-based semantic descriptions. Spearman correlation analysis reveals the expected ordering along the temporal-richness continuum, with video features showing the strongest continuous alignment. However, this ordering breaks down under binary classification of high- versus low-engagement moments (the paradigm most commonly used to train perceptual scoring models), where TAIs consistently match or outperform video across most classifiers and quantile thresholds. An independent two-alternative forced-choice study on Amazon Mechanical Turk confirms that this parity reflects human judgment: participants identified engaging moments with comparable accuracy from TAIs and full video clips, while text performed substantially worse and audio remained near chance. Gap analysis reveals a functional dissociation: video features are advantaged in activity-driven scenes with dynamic content, whereas TAIs better align with human judgments in composition-driven scenes dominated by stable spatial structure. These findings challenge the assumption that richer representations are inherently more human-aligned, and suggest that perceptually grounded temporal compression can be a principled alternative to full video encoding.

[38] MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer cs.CVPDF

Ziyi Wang, Siming Zheng, Yang Yang, Shusong Xu, Hao Zhang

TL;DR: MagicMakeup是一个基于扩散Transformer的框架，旨在实现高保真、区域可控的妆容迁移。它通过Token对齐区域门控和跨模态感知引导来解决像素-注意力错位、概念混淆等问题，并在合成和真实场景下建立了统一的基准。

Details

Motivation: 现有基于扩散模型的妆容迁移方法在区域可控性、妆容保真度和身份保持方面存在挑战，主要源于像素-注意力错位、两图像条件下概念混淆以及缺乏高质量标注数据集。

Result: 大量定量和定性实验表明，MagicMakeup在区域可控性、妆容保真度和身份保持方面均有提升，在不同风格、种族和姿态下表现出强鲁棒性，在建立的合成与真实场景基准上取得了先进性能。

Insight: 创新点包括Token对齐区域门控技术以实现精确区域编辑，跨模态感知引导以解耦迁移与保持概念，以及构建高分辨率、身份一致且区域标注的数据集生成流程。这些方法为解决扩散模型中的细粒度控制问题提供了新思路。

Abstract: Makeup-transfer applies the reference makeup to the source face while preserving the source identity. Despite advances in full-face editing by diffusion-based methods, strong regional controllability, makeup fidelity, and identity preservation remain challenging. The reasons are (i) pixel-to-attention misalignment that causes spillover into non-target areas and weakens regional control; (ii) unclear transfer/preservation concept separation under two-image conditioning, leading to coupling between makeup attributes and identity; and (iii) the lack of a high-resolution dataset that is identity-consistent and region-labeled for fine-grained supervision. In this paper, we propose MagicMakeup, a diffusion transformer-based framework for region-controllable and high-fidelity makeup transfer, built on spatial constraints and concept disentanglement. To enable precise region-specific editing while preserving identity, we propose Token-Aligned Region Gating, which aligns pixel masks with attention and applies region-specific logit gating. To clarify the concepts of transfer and preservation, we further introduce Cross-Modal Perception Guidance, which aligns text and image features to enhance cross-modal concept perception. We also design a pipeline for the generation of 1024 x 1024 data pairs through region-specific makeup removal and establish a unified benchmark in synthetic and real settings. Extensive quantitative and qualitative experiments show that MagicMakeup improves regional controllability, makeup fidelity, and identity preservation, with strong robustness across styles, races, and poses.

[39] Ms. Forcing: Efficient Streaming Video Generation with Multi-Scale Patchification and Attention cs.CVPDF

Zekun Li, Xiaoyan Cong, Hongyu Li, Zhiyang Dou, Chuan Guo

TL;DR: 本文提出了一种名为Ms.Forcing的高效流式视频生成方法，通过多尺度分块化和注意力机制，根据噪声水平自适应调整空间粒度，显著减少了计算开销。该方法结合了同质噪声级DMD训练策略，在保持静态计算图的同时，提升了生成速度和质量。

Details

Motivation: 现有流式视频扩散模型因嵌套自回归和去噪循环而难以实时部署，且滚动窗口方法在联合去噪窗口中存在噪声依赖的冗余。本文旨在通过自适应空间粒度来减少冗余，提高效率。

Result: 在单个H200 GPU上达到22.84 FPS，比Rolling Forcing快39.6%，并在VBench基准测试的短视频和长视频生成设置中显著提升了分数。

Insight: 创新点包括多尺度分块化根据噪声水平分配粗粒度块以减少token数量，以及多尺度自注意力匹配查询尺度以降低注意力成本。同时，同质噪声级DMD训练减少了训练与推理之间的不匹配，多尺度设计抵消了重叠窗口反向传播的额外训练开销。

Abstract: Streaming video diffusion models have made substantial progress toward interactive and dynamic world simulation, but the nested autoregressive and denoising loops of conventional next-frame generation hinder real-time deployment. Recent rolling-window methods pipeline denoising across multiple consecutive frames at different noise levels, improving throughput and long-horizon stability. However, they tokenize every state at the same fine spatial granularity, leaving substantial noise-dependent redundancy in the joint denoising window. We propose Ms.Forcing, an efficient streaming video generation paradigm that adapts spatial granularity to each state’s noise level. Its Multi-Scale Patchification (MSP) assigns coarser patches to noisier states, reducing the active-window token count by 45%, while Multi-Scale Self-Attention (MSSA) matches the density of visible non-sink keys and values to each query scale to further reduce attention cost. Because both schedules are fixed by window position, Ms.Forcing retains a static, hardware-friendly computation graph. We further introduce Homogeneous-Noise-Level DMD (H-DMD), which assembles each fake video from clean predictions sharing the same source noise level, thereby reducing the mismatch between DMD training sequences and inference-time rollouts. The multi-scale design helps offset the additional training cost of backpropagating through overlapping windows. We include both quantitative and qualitative experiments to show that Ms.Forcing reaches 22.84 FPS on a single H200 GPU, 39.6% faster than Rolling Forcing, while significantly improving VBench scores in both short video and long video generation setting.

[40] Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval cs.CVPDF

Kyeongmo Chae, Jihoon Lee, Sangtae Ahn

TL;DR: 本文提出了分布对齐桥（DAB）框架，将文本到视频检索重新定义为分布对齐任务，而非传统的确定性点匹配。该方法将文本和视频嵌入建模为高斯分布，通过扩散启发的确定性桥进行迭代优化，并引入基于KL散度的分布感知对比损失。在多个基准测试中，DAB显著超越了现有方法，并提供基于不确定性的校准排序。

Details

Motivation: 传统文本到视频检索方法通常进行确定性点匹配，忽略了模态固有的不确定性。本文旨在通过概率建模显式地处理这种不确定性，将检索任务重构为分布对齐问题。

Result: 在MSR-VTT、MSVD和VATEX基准测试上的广泛评估表明，DAB显著优于现有的概率方法和基于扩散的基线模型，达到了最先进的性能水平。

Insight: 核心创新在于将检索任务重新概念化为分布对齐，并设计了一个端到端的可训练框架，统一了概率嵌入和分布变换。其扩散启发的桥接机制和分布感知的对比损失是关键技术贡献，为不确定性感知的跨模态检索提供了新思路。

Abstract: This paper proposes the Distribution-Alignment Bridge (DAB), a framework that reconceptualizes text-to-video retrieval as a distribution alignment task rather than traditional deterministic point matching. By modeling both text and video embeddings as Gaussian distributions defined by mean and variance, DAB explicitly accounts for modality-specific uncertainty. We employ a deterministic, diffusion-inspired bridge to iteratively refine text distributions toward their target video distributions through a truncated refinement process. This approach unifies probabilistic embedding and distributional transformation into a cohesive, end-to-end trainable system. To optimize cross-modal similarity, we introduce a distribution-aware contrastive loss based on Kullback-Leibler divergence. Extensive evaluations on MSR-VTT, MSVD, and VATEX benchmarks confirm that DAB significantly outperforms existing probabilistic and diffusion-based baselines, while providing calibrated uncertainty-aware ranking through bridge-induced distributional margins.

[41] HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving cs.CV | cs.AIPDF

Quanfu Yu, Xian Wu, Hao Xu, Liulong Ma

TL;DR: 本文提出了HyWorldVLA，一种用于自动驾驶的、结合混合世界建模的视觉-语言-动作模型。该框架通过统一像素级监督和潜在表示学习，旨在解决像素级预测的噪声鲁棒性问题与潜在模型的可解释性和表征退化问题。在NAVSIM基准测试中，其性能显著超越了基于像素和基于潜在的世界模型基线。

Details

Motivation: 动机在于解决自动驾驶中视觉-语言-动作模型的一个核心权衡：像素级未来预测能实现细粒度时空推理但噪声鲁棒性差，而基于潜在的世界模型鲁棒性较好但可解释性有限且存在表征退化。

Result: 在NAVSIM v1和v2基准测试中，HyWorldVLA的性能显著优于基于像素和基于潜在的世界模型基线。论文还首次对自动驾驶中世界模型的噪声鲁棒性进行了全面的定性和定量分析，为评估未来架构设立了新基准。

Insight: 核心创新点是提出了一个混合世界建模框架，在预训练阶段同时预测视频潜在特征并重建视频帧以提供像素级监督，在协同微调阶段则仅预测潜在特征用于动作生成，从而在鲁棒性和可解释性/表征能力之间取得了更好的平衡。

Abstract: Vision-Language-Action (VLA) models augmented with world modeling represent a promising paradigm for end-to-end autonomous driving. While pixel-level future prediction enables fine-grained spatiotemporal reasoning, it compromises robustness in noisy driving scenarios. Conversely, latent-based world models alleviate this sensitivity but often incur limited interpretability and representational degradation due to absent pixel-level grounding. To reconcile this trade-off, we propose HyWorldVLA, a hybrid world-VLA framework that unifies pixel-level supervision and latent representation learning. In the pre-training stage, HyWorldVLA predicts video latents encoded by a pre-trained video VAE, while simultaneously reconstructing video frames to provide precise pixel-level grounding. During the subsequent co-fine-tuning phase, the model exclusively predicts latent features, which are fed into an action expert to generate trajectories. Extensive experiments on NAVSIM v1 and v2 benchmarks demonstrate that HyWorldVLA significantly outperforms both pixel-based and latent-based world model baselines. Notably, we present the first comprehensive qualitative and quantitative analysis of world model noise robustness in autonomous driving, establishing a new benchmark for evaluating future architectures.

[42] Sparse Concept Channels in Frozen 3D CT Vision Encoders cs.CV | cs.AIPDF

Farhad Nooralahzadeh, Lea Bogensperger, Christian Bluethgen, Michael Krauthammer

TL;DR: 本文研究了冻结的3D医学视觉编码器（如Pillar-0和Merlin）内部如何编码临床发现。研究发现，每种放射学发现由一组稀疏的（约10个）视觉编码器通道编码，这些通道能匹配全特征分类性能，且远超零样本文本提示。通过关闭与特定发现相关的通道，该发现的评分会崩溃，而无关标签保持稳定。该方法在架构无关的3D腹部VLM上可复现，表明这是冻结医学编码器的通用特性。

Details

Motivation: 动机在于理解大型视觉语言模型（VLM）在3D医学图像解释中，其内部哪些单元编码临床发现以及这些信息在表示中的位置，以增强模型的可解释性和可控性。

Result: 提出的无需训练的概念通道探测（CCP）方法，结合语料库生成的报告模板，在临床有效性和自然语言生成（NLG）指标上优于已发表的CT-CHAT（F1分数0.549 vs. 0.184；BLEU分数0.483 vs. 0.373），且延迟降低了22倍。

Insight: 创新点在于揭示了冻结医学编码器中临床发现的稀疏通道编码机制，并提出了CCP方法进行探测和干预，该方法具有跨模型的可复现性和直接适用性，为模型可解释性和高效医学图像分析提供了新途径。

Abstract: Large vision-language models are becoming increasingly dominant in 3D medical image interpretation, but we rarely know which internal units encode clinical findings or where that information lives in the representation. We first study this on a 3D chest vision-language model (Pillar-0) by probing its frozen vision embeddings. We show that (i) each radiological finding is encoded by a sparse set of ~10 vision-encoder channels that match full-feature classification performance and far exceed a zero-shot text prompting; (ii) turning off the channels tied to one finding, that finding’s score collapses while unrelated labels stay stable; and (iii) the same sparse probe replicates on an architecturally unrelated 3D abdominal VLM (Merlin) suggesting a general property of frozen medical encoders. Our training-free concept channel probe (CCP) method, paired with a corpus-derived report template, outperforms published CT-CHAT on clinical efficacy and NLG metrics (F1 0.549 vs. 0.184; BLEU 0.483 vs. 0.373) at 22x lower latency. Our results provide a clear, reproducible characterization of how frozen medical encoders represent findings, demonstrating direct applicability across models.

[43] ProCap: Prominence-guided Object Rectification for Faithful and Comprehensive Video Captioning cs.CVPDF

Debjyoti Das Adhikary, Aritra Hazra, Partha Pratim Chakrabarti

TL;DR: 本文提出了一种名为ProCap的无需训练的视频描述后处理框架，通过基于空间显著性、时间持续性和关系动态的轻量级评分机制对检测到的物体进行排序，并利用迭代的提示驱动循环，逐步将缺失但上下文相关的物体注入描述中，以提高描述的完整性和减少幻觉。

Details

Motivation: 现有无需训练的视频描述方法通常仅应用单一、固定的校正，且未优先考虑最重要的物体，导致语义上重要的内容被遗漏。本文旨在克服这些限制，在不修改底层描述模型参数的情况下，通过迭代后处理提升描述质量。

Result: 在MSVD和MSR-VTT数据集上，通过基于物体的自动指标、110名参与者的人类研究以及与ChatGPT和Gemini的定性比较进行验证。人类评估显示，相对于强大的预训练描述基线，该框架将感知完整性提高了48%，并将幻觉减少了45%。

Insight: 创新点在于提出了一个基于显著性的迭代后处理框架，通过轻量级评分和提示驱动循环，实现了模型无关、可扩展的描述校正，直接适用于可访问性、检索和其他多媒体理解应用。

Abstract: Improving video captioning quality typically demands retraining large vision-language models, an expensive and often impractical requirement. Existing training-free alternatives instead ground captions in detected objects to curb hallucination, but apply only a single, fixed correction pass without prioritizing which objects matter most, leaving semantically significant content omitted. We propose a prominence-aware, iterative post-hoc rectification framework that overcomes both limitations without modifying the underlying captioning model’s parameters: a lightweight scoring mechanism ranks detected objects by spatial saliency, temporal persistence, and relational dynamics, and an iterative, prompt-driven refinement loop uses this ranking to progressively inject missing yet contextually relevant objects into the caption over multiple rounds. We validate the framework on MSVD and MSR-VTT using object-grounded automatic metrics, a 110-participant human study, and qualitative comparison against ChatGPT and Gemini; in human evaluation, the framework raises perceived completeness by up to 48% and reduces hallucination by up to 45% relative to a strong pretrained captioning baseline, all without retraining or reference captions. These results position prominence-guided iterative rectification as a lightweight, scalable, and model-agnostic route to more complete and trustworthy video captioning, with direct relevance to accessibility, retrieval, and other multimedia understanding applications.

[44] GroupVideo: Multi-Identity Customized Text-to-Video Generation cs.CVPDF

Xinyang Song, Libin Wang, Jianxin Sun, Qi Li, Dandan Zheng

TL;DR: 本文提出GroupVideo框架，用于解决多身份定制化文本到视频生成中的身份混淆问题。该框架基于视频扩散变换器，通过视觉对齐和语义对齐机制增强身份一致性和动作自然性，并引入ID定位模块和边界框约束来提升训练效率。作者还构建了一个包含2万视频的多身份数据集以支持该领域研究。

Details

Motivation: 现有身份定制视频生成方法主要局限于单身份场景，在多身份设置下缺乏明确身份分离机制，导致身份混淆；而现有多身份方法直接扩展单身份框架，常产生不自然的面部表情和动作，出现’复制粘贴’现象。

Result: 大量实验表明，GroupVideo在生成多角色视频时，在身份一致性和动作自然性方面优于现有方法。

Insight: 创新点包括：1）多模态身份对齐机制（视觉对齐联合编码多人脸图像，语义对齐引入语义感知器增强动作自然性）；2）带空间引导的ID定位模块，结合边界框约束和掩码正则化损失，专注于面部区域并提升训练效率；3）构建了高质量多身份视频数据集，为未来研究提供关键资源。

Abstract: Current identity customized video generation methodologies are predominantly limited to single-identity scenarios, as the lack of explicit identity separation mechanisms often leads to identity confusion in multi-identity settings. Existing multi-identity approaches, which directly extend single-identity frameworks by concatenating face images as input conditions, frequently result in unnatural facial expressions and motions, manifesting as the “copy-paste” phenomenon. To overcome these limitations, we introduce GroupVideo, a novel framework that leverages multiple individual photographs to generate identitycustomized video. Built upon Video Diffusion Transformers, GroupVideo incorporates multimodal identity alignment: visual alignment jointly encodes multiple face images to provide robust identity references, while semantic alignment introduces a semantic perceiver to enhance the naturalness of motions. An ID localization module with spatial guidance is introduced to address identity blending and enhance identity fidelity, along with bounding box constraints and mask regularization loss, to focus on facial regions and improve training efficiency. In response to the shortage of multi-ID video datasets, we have curated a comprehensive high-quality dataset of 20,000 videos, thereby establishing a crucial resource to advance future research in multi-ID video generation. Extensive experiments demonstrate that GroupVideo outperforms existing methods in generating multi-character videos with consistent identities and natural motions.

[45] WAT3R: Feedforward Underwater 3D Reconstruction cs.CVPDF

Jiayi Xu, Jiahao Lu, Ziqiang Zheng, Yihao Tan, Yaolong Zhu

TL;DR: 本文提出WAT3R，一种前馈式框架，用于直接从水下图像重建3D场景。该框架通过将退化适应建模为一个几何约束过程，集成了一个轻量级神经适应模块来灵活处理水下成像效应（如光衰减和后向散射），从而提升多视图重建质量。该方法在单次前向传播中即可直接从水下视频输出像素对齐的3D点云图和相机位姿，实现高效、高质量的水下3D重建。

Details

Motivation: 解决水下3D重建中因严重的光衰减和后向散射导致的视觉质量下降和跨视图特征一致性破坏问题，这些因素会导致多视图几何不准确。

Result: 在FLSea、SQUID和USOD10K数据集上的实验表明，该方法在3D重建任务（包括多视图/单目深度估计和相机位姿估计）上持续优于最先进的方法。

Insight: 主要创新点在于将水下退化适应明确建模为一个几何约束过程，并集成一个轻量级神经模块来灵活补偿成像效应，从而在单次前向传播中实现端到端的高质量重建。这为处理恶劣成像条件下的3D重建提供了一种高效且统一的框架。

Abstract: Reliable feedforward underwater 3D reconstruction remains challenging due to severe light attenuation and backscattering, which degrade visual quality and disrupt feature consistency across views, leading to inaccurate multi-view geometry. To address this issue, we propose WAT3R, a feed-forward framework for reconstructing 3D scenes directly from underwater images. By leveraging degradation adaptation as a geometry-constrained process, WAT3R integrates a lightweight neural adaptation module to flexibly account for these underwater imaging effects, thereby improving multi-view reconstruction quality. Implemented in a single forward pass, WAT3R directly and efficiently outputs pixel-aligned 3D point maps and camera poses from underwater videos, allowing a high-quality underwater 3D reconstruction. Experiments conducted on the FLSea, SQUID, and USOD10K datasets show that our method consistently outperforms state-of-the-art approaches on 3D reconstruction tasks, including multi-view/monocular depth estimation and camera pose estimation.

[46] GeoThreat: Transferable Targeted Adversarial Attacks on Large Vision-Language Models for Remote Sensing Image Interpretation cs.CVPDF

Yimin Fu, Yuefeng Bai, Baicheng Pan, Zhunga Liu, Michael K. Ng

TL;DR: 本文提出了一种名为GeoThreat的可迁移、目标性对抗攻击方法，专门针对用于遥感图像解译的大规模视觉语言模型。该方法通过在概念和感知两个层面调制对抗性表征，利用代理图像编码器的类别标记作为概念表征，并通过协同重要性估计从对抗样本的补丁标记中蒸馏出感知表征，以实现对指定语义响应的黑盒攻击。

Details

Motivation: 现有对抗攻击研究主要集中于通用视觉语言任务，通过破坏视觉输入来诱导预定义的错误响应，而在需要结合局部判别线索和全局场景上下文进行联合推理的遥感图像解译领域，实现黑盒设置下可迁移的、针对特定响应的语义操控仍面临挑战。

Result: 在多种大规模视觉语言模型上的广泛实验表明，GeoThreat方法在攻击的可迁移性和可控性方面均表现出优越性。

Insight: 创新点在于提出了概念校准与感知适应的双层级表征调制机制，特别是引入了对抗-目标相似度梯度来更准确地刻画局部视觉线索与目标语义操控的相关性，并通过基于交叉注意力的动态对齐促进局部线索向指定语义细节的适应，最终通过集成联合优化迭代更新对抗扰动。

Abstract: Adversarial attacks against large vision-language models (LVLMs) serve as an effective means of assessing their robustness in cross-modal semantic understanding. Existing studies mainly focus on corrupting visual inputs to induce predefined erroneous responses in general vision-language tasks, whereas corresponding investigations in remote sensing fields remain largely underexplored. Compared with natural image understanding, remote sensing image interpretation requires joint reasoning over local discriminative cues and global scene context. This poses additional challenges to achieving transferable semantic manipulation toward specified responses under black-box settings. To tackle these challenges, we propose GeoThreat, a transferable targeted adversarial attack method against LVLMs for remote sensing image interpretation. Specifically, GeoThreat modulates adversarial representations in accordance with the target content at both conceptual and perceptual levels. The class tokens from surrogate image encoders are employed as conceptual representations, while perceptual representations are distilled from patch tokens of the adversarial example through collaborative importance estimation. Beyond merely rolling out attention scores across layers, we incorporate adversarial-target similarity gradients to more faithfully characterize the relevance of local visual cues to the intended semantic manipulation. The perceptual representations are then dynamically aligned with target patch tokens in a cross-attentive manner, facilitating the adaptation of local cues toward designated semantic details. Finally, adversarial perturbations are iteratively updated via ensemble-based joint optimization of conceptual calibration and perceptual adaptation. Extensive experiments across diverse LVLMs demonstrate the superiority of GeoThreat in both transferability and controllability.

[47] Achieving Text-based Person Retrieval with Any Granularity cs.CVPDF

Jialong Zuo, Hanyu Zhou, Dongyue Wu, Yongtai Deng, Mengdan Tan

TL;DR: 本文提出了一个名为’任意粒度文本行人检索’的新范式，以解决现实场景中查询粒度不确定性的关键挑战。论文构建了多粒度数据集UFine6926-MG和评估基准MG-Eval，并提出了跨模态多粒度对齐与匹配框架CMAM，该框架通过正交专家感知、概率对齐和粒度一致性推理来实现粒度感知的检索。实验表明CMAM在所有粒度级别上均显著优于现有最先进方法。

Details

Motivation: 解决基于文本的行人检索中一个关键但未被充分探索的挑战：现实场景中查询粒度的固有不确定性。

Result: CMAM框架在所有粒度级别上均显著优于最先进方法，在构建的UFine6926-MG数据集和MG-Eval基准上进行了实验验证。

Insight: 创新点在于系统性地定义了五级粒度谱并构建了相应数据集，提出了专门应对查询不确定性的概率对齐方法以建模多对多匹配，以及通过跨模态粒度联合验证来引导特征学习的粒度一致性推理机制。

Abstract: Text-based person retrieval faces a critical but under-explored challenge: the inherent uncertainty of query granularity in real-world scenarios. This paper introduces a new paradigm, Text-based Person Retrieval with Any Granularity, and provides a systematic solution. First, we formalize a five-level granularity spectrum and construct UFine6926-MG, a high-quality multi-grained dataset annotated comprehensively at all granularities via a novel Multi-grained Text Annotation Engine. Second, acknowledging that coarse queries naturally correspond to multiple valid candidates, we propose MG-Eval, a holistic evaluation benchmark with progressively detailed texts and cross-identity labels that reflect real-world semantics, alongside tailored evaluation metrics and protocols. Third, after a comprehensive diagnosis reveals the systemic limitations of existing research, we propose the Cross-modal Multi-grained Aligning and Matching (CMAM) framework. CMAM achieves granularity-aware retrieval through: 1) orthogonal-expert perception to disentangle granularity-specific features; 2) probabilistic alignment to model many-to-many matches under query uncertainty; and 3) granularity-consistent reasoning to steer feature learning via joint cross-modal granularity verification. Experiments demonstrate that CMAM significantly outperforms state-of-the-art methods across all granularity levels. This work establishes a foundational benchmark and a robust baseline, paving the way for more practical person retrieval systems.

[48] MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement cs.CVPDF

Daiqing Wu, Dongbao Yang, Jiashu Yao, Hongrui Zhang, Can Ma

TL;DR: 本文针对多模态大语言模型在视觉情感智能方面的评估空白，提出了情感陈述判断框架，并构建了大规模数据集INSETS-462k和综合基准MVEI，同时开发了情感导向的MLLM模型EmObserver。

Details

Motivation: 现有AICA范式与MLLM的开放式指令驱动特性存在结构不匹配，导致MLLM视觉情感智能评估缺失，存在合理响应忽略、情感分类有限、上下文忽视和标注劳动密集四大局限。

Result: 在MVEI基准上对广谱MLLM的评估揭示了当前人工视觉情感智能的细粒度洞察；EmObserver在多个AICA基准上表现出准确性、泛化性和推理忠实性，成为先进的基线模型。

Insight: 创新性地提出ESJ框架，在保持输入空间表达力的同时约束输出为判别性判断；通过高效流水线INSETS规模化构建数据集，并设计了多阶段优化方案训练EmObserver，为MLLM导向的视觉情感智能提供了实用框架、全面基准和先进基线。

Abstract: Affective Image Content Analysis (AICA) aims to recognize and understand emotions elicited by visual content, representing an indispensable step toward Artificial General Intelligence (AGI). However, despite the rapid progress of Multimodal Large Language Models (MLLMs), systematic evaluation of their visual emotional intelligence remains largely absent from recent model releases. We attribute this gap to a structural mismatch between conventional AICA paradigms and the open-ended, instruction-driven nature of MLLMs, where further analysis reveals four major limitations: omission of plausible responses, limited emotion taxonomies, neglect of contextual factors, and labor-intensive annotation. To overcome these barriers, we introduce Emotion Statement Judgement (ESJ), a statement-verification formulation that preserves the expressiveness of the input space while constraining outputs to discriminative judgements. We further develop INSETS, a labor-efficient pipeline that instantiates ESJ at scale by constructing INSETS-462k and supporting MVEI, a rigorously refined benchmark spanning sentiment polarity, emotion interpretation, scene context, and perception subjectivity. Beyond evaluation, we build EmObserver, an emotion-oriented MLLM optimized on ESJ through an elaborate multi-stage recipe. Extensive evaluation of broad-spectrum MLLMs on MVEI reveals fine-grained insights into current artificial visual emotional intelligence, while experiments on multiple AICA benchmarks demonstrate the accuracy, generalization, and reasoning faithfulness of EmObserver. Collectively, these results establish ESJ as a practical formulation, MVEI as a comprehensive benchmark, and EmObserver as an advanced baseline for advancing MLLM-oriented visual emotional intelligence. Code will be released at: https://github.com/wdqqdw/EmObserver.

[49] TransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objects cs.CV | cs.MM | cs.ROPDF

Ke Ma, Yifei Wang, Meng Wang, Tian Xia

TL;DR: 本文介绍了TransBiolab，一个用于自主生物医学实验室的真实世界、多视角、杂乱场景下的透明生物医学物体数据集。该数据集包含超过16万帧图像、15种物体类型、超过100万个实例标注（包括6D位姿、掩码、深度和相机标定），并针对分割、深度估计和6D位姿估计等任务设立了基准。

Details

Motivation: 当前自主生物医学实验室依赖视觉感知来识别和操作透明塑料器皿，但缺乏高质量、真实场景（特别是存在物体杂乱、相互遮挡和多视角外观变化）的领域相关数据集，这限制了视觉基础模型在此类复杂环境中的应用。

Result: 论文提出了基于TransBiolab数据集的多个基准任务（分割、深度估计与补全、6D位姿估计）并进行了系统级机器人操作评估，为相关研究提供了评估标准。

Insight: 创新点在于构建了一个专注于真实实验室操作场景（具有重复透明实例、杂乱摆放、校准多视角采集特点）的综合数据集，并通过定义沿操作难度（物体类别、数量、视角）组织的三个轴以及提供详尽的标注，为分割、深度估计、6D位姿估计和多视角推理研究提供了宝贵资源。

Abstract: Autonomous biomedical laboratories increasingly rely on visual perception to recognize, localize, and manipulate transparent plasticware, yet high-quality real-world datasets for this setting remain limited. The scarcity of domain-relevant data is particularly restrictive in cluttered multi-object scenes, where mutual occlusion and view-dependent appearance changes remain challenging even for contemporary visual foundation models. Existing transparent-object datasets have advanced segmentation, depth, and pose estimation, but they usually do not evaluate the combined setting of multi-object clutter, occlusion, and calibrated multi-view capture that characterizes real laboratory manipulation scenes. To address this gap, we present TrainsBiolab, a real-world RGB-D dataset of cluttered transparent biomedical objects captured as calibrated multi-view sequences. TrainsBiolab contains 161,315 frames from 98 scenes and 1.03M instance annotations over 15 laboratory object types, including 6D poses, full and visible masks, depth, and per-frame camera calibration. The dataset is organized along three axes that reflect operational difficulty: object category, the total number of objects in a frame, and camera viewpoint. We further define dataset-centric benchmarks for segmentation, depth estimation and completion, and 6D pose estimation, and report a system-level robot manipulation evaluation enabled by the released annotations and calibrations. By focusing on repeated transparent instances, clutter, and multi-view laboratory capture, TrainsBiolab provides a resource for segmentation, depth estimation, 6D pose estimation, and multi-view reasoning in autonomous laboratory manipulation. Project page: https://dualtransparency.github.io/TransBiolab/.

[50] Show, Don’t Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text cs.CVPDF

Xu Wang, Kaixiang Yao, Miao Pan, Xiaohe Zhou, Xuanyu Liu

TL;DR: 本文提出了ProVisE框架和SpatialGen-Bench基准，用于评估图像生成模型在空间认知任务上的表现。ProVisE通过协议化视觉答案生成和解析，使图像生成模型能在像素空间中直接输出空间判断，并与文本输出视觉语言模型在统一任务语义下进行比较。

Details

Motivation: 现有空间推理基准通常要求坐标、选项或文本答案，与图像生成模型直接通过像素表达空间信息的能力不匹配，导致难以公平评估其空间认知能力。

Result: 在SpatialGen-Bench（包含14个子任务、470个样本）和六个外部空间基准上的评估表明，当空间答案可直接在像素空间外化时，图像生成模型具有竞争力；而文本输出VLM在组合空间推理上仍保持明显优势。

Insight: 创新点在于提出了一个与基准无关的评估框架（ProVisE），通过协议化视觉答案解决了图像生成模型与文本基准的接口不匹配问题，并揭示了像素空间表达与基于文本的推理在空间认知上的互补优势。

Abstract: Spatial intelligence is essential for agents to move from static semantic understanding toward interacting with the physical world. Many spatial tasks are grounded in continuous visual scenes, where locations, regions, and paths are more naturally expressed by pointing, marking, or drawing than by reporting precise coordinates or discrete textual symbols. Yet existing spatial reasoning benchmarks usually require coordinates, options, or text, creating an answer-interface mismatch for image-generation models. This makes it difficult to evaluate image-generation models under the same task semantics as text-output VLMs, despite their ability to externalize spatial judgments directly in pixel space. We propose ProVisE (Protocolized Visual Evaluation), a benchmark-agnostic framework that elicits protocol-constrained visual answers from image-generation models and parses them into structured predictions compatible with original metrics. ProVisE also includes an Agentic builder that constructs and validates task-specific protocols for new benchmarks. We further introduce SpatialGen-Bench, a curated diagnostic benchmark of 470 samples across 14 spatial subtasks, four capability levels, and diverse answer forms. We evaluate representative text-output VLMs and image-generation models in a unified setting and validate Agentic protocol construction on six external spatial benchmarks. Results show that image-generation models are competitive when spatial answers can be externalized directly in pixel space, while text-output VLMs retain a clear advantage in compositional spatial reasoning. These findings reveal complementary strengths of pixel-space expression and text-based reasoning and establish a metric-compatible testbed for studying spatial cognition in image-generation models.

[51] C-PTQ: Fisher-weighted Channel-wise Sensitivity for Post-training Quantization of MLLMs cs.CVPDF

Jiameng Li, Han Zhou, Matthew B. Blaschko

TL;DR: 本文提出C-PTQ方法，一种用于多模态大语言模型（MLLMs）的后训练量化技术。该方法通过设计一个基于Fisher信息的加权目标函数，将任务敏感度融入通道缩放过程，以保护对量化高度敏感的异常值通道，从而在保持高效率的同时实现最先进的性能。

Details

Motivation: 多模态大语言模型部署面临巨大的内存和计算成本，后训练量化是有效的压缩和加速方案。然而，现有方法使用的模态或令牌级度量无法准确捕捉通道对任务损失的特定影响，导致重要性度量与缩放因子错配，造成次优性能。

Result: 在Qwen2.5VL、InternVL2和LLaVA-OV模型上的8个基准测试表明，该方法在仅权重量化和权重-激活量化设置下均取得了最先进的性能，且无需LoRA等辅助模块。

Insight: 核心创新在于提出一个统一的通道级后训练量化框架，利用二阶导数启发，设计了一个可处理的Hessian近似（Fisher加权目标），将任务特定的损失扰动与量化误差协调统一，从而更精确地指导敏感通道的保护。

Abstract: Multimodal large language models (MLLMs) require huge memory and computational costs, which limits their practical deployment. Post-training quantization (PTQ) techniques offer an efficient solution for model compression and inference acceleration. Yet, the quantized model faces performance degradation due to outlier channels, which are highly sensitive to quantization and substantially impair activation fidelity and task accuracy. To protect these salient channels during quantization, existing PTQ methods leverage modality- or token-level metrics to guide channel-wise scaling (CWS) of LLM decoders. However, these orthogonal measurements fail to capture channel-wise impacts on task-specific loss, and the misalignment between importance and scaling factors ultimately leads to suboptimal performance. To address this issue, we propose C-PTQ, a unified channel-wise PTQ method that harmonizes task-specific loss perturbation and quantization error. Motivated by second-order derivatives, we design a Fisher-weighted objective as a tractable Hessian approximation, seamlessly injecting task sensitivity into the scaling process. Notably, we achieve state-of-the-art performance without auxiliary modules like LoRA, thereby maintaining high efficiency. Experiments on Qwen2.5VL, InternVL2 and LLaVA-OV across 8 benchmarks demonstrate our effectiveness in both weight-only and weight-activation settings.

[52] Do Pathology Vision-Language Models Truly See Pathology? cs.CVPDF

Chengyang Zhang, Wenchuan Zhang, Bo Li, Xinyu Liu, Jiaming Yang

TL;DR: 本文指出当前病理学视觉语言模型（VLMs）评估存在三个被忽视的问题：视觉证据并非总是必要、领域训练提升准确率但未成比例增强视觉绑定能力、实体级注意力分散且查询特异性弱。为此，作者提出了PathBind基准，包含VQA、病理教学图谱和区域级标注样本，并通过实验验证现有模型在答案准确率与视觉语义绑定能力之间存在显著差距。

Details

Motivation: 现有病理学VLMs评估主要依赖VQA基准的答案准确率，但忽略了模型可能依赖文本捷径而非真正视觉理解的问题，导致对模型多模态能力的误判。

Result: 在提出的PathBind基准及五个现有病理VQA基准上评估了18个代表性VLMs，并在PathBind-Grounding和PathVG上进一步评估了10个VLMs，结果显示当前模型在答案侧性能与视觉语义绑定能力之间存在显著差距。

Insight: 创新点在于系统性地揭示了病理VLMs评估中的关键缺陷，并构建了经过自动过滤和专家评审的综合性基准PathBind，以更准确地衡量模型的多模态理解能力，而非仅依赖表面准确率。

Abstract: Pathology vision-language models (VLMs) have recently progressed rapidly and are commonly evaluated by answer accuracy on pathology VQA benchmarks. However, we dig into current evaluations and identify three overlooked issues: 1) Visual evidence is not always necessary. For instance, Gemini-3-Pro achieves 53.5% average accuracy across 5 VQA benchmarks without any visual input. 2) Domain training can improve accuracy without proportional gains in visual binding. Compared with Qwen2.5-VL-7B, Patho-R1-7B exhibits a 5.8-point lower multimodal gain and a 3.7-point lower attention IoU. 3) Entity-level attention is diffuse and weakly query-specific. On PathVG, attention maps remain highly correlated across different entity queries. These issues can lead to substantial misjudgments of pathology VLMs’ actual multimodal capabilities. To this end, we present PathBind, a benchmark comprising 2,600 samples: PathBind-VQA with 1,500 questions across six dimensions, PathBind-PTA with 600 questions from a private pathology teaching atlas, and PathBind-Grounding with 500 expert-curated region-level samples. Each component undergoes task-specific automated filtering and expert review to reduce textual shortcuts and improve entity-region correspondence. We evaluate 18 representative VLMs on VQA samples of PathBind and five existing pathology VQA benchmarks, and further evaluate 10 VLMs on PathBind-Grounding and PathVG. Results show that current pathology VLMs still exhibit a substantial gap between answer-side performance and visual-semantic binding.

[53] Loss Landscape Topology Reveals Why Simple Baselines are Competitive at 3D Point Cloud Segmentation Under Class Imbalance cs.CVPDF

Antonis Savva, Christos Kyrkou, Theocharis Theocharides

TL;DR: 这篇论文研究了在类别不平衡的3D点云语义分割任务中，多种不平衡缓解方法的有效性。通过系统评估，发现标准的均匀加权交叉熵损失函数与专门设计的复杂方法相比，性能具有竞争力，差距仅在0.8-3.3% mIoU之内。论文通过分析损失景观的拓扑结构，解释了这种结果的原因。

Details

Motivation: 动机是探究在面临严重类别不平衡的3D点云分割任务中，那些在2D计算机视觉中被证明有效的、专门处理不平衡的方法，其效果是否依然显著，以及为什么它们的表现与预期不同。

Result: 在具有极端（641:1）和中等（56:1）不平衡比的数据集上评估了11种方法。结果表明，标准交叉熵损失与专门方法性能相当，mIoU差距在0.8-3.3%之间，具体差异取决于网络架构和数据集。专门方法仅能带来有限的提升，且若调参不当可能导致性能显著下降。

Insight: 宣称的创新点在于首次通过损失景观拓扑的几何分析（如极端不平衡下形成狭窄解盆地，中等不平衡下形成平坦高原），为2D技术难以直接迁移到3D点云分割提供了机制性解释。客观来看，其核心洞察是揭示了优化问题的几何约束限制了损失函数层面修改的有效性，从而强调了简单基线的鲁棒性价值。

Abstract: Semantic segmentation of 3D point clouds faces severe class imbalance, yet the effectiveness of specialized imbalance-aware methods from 2D computer vision remains unclear in 3D contexts. We systematically evaluate 11 imbalance mitigation approaches across datasets with extreme (641:1) and moderate (56:1) imbalance ratios, revealing a surprising finding: standard cross-entropy with uniform weighting achieves competitive performance, typically within 0.8-3.3% mIoU of specialized methods across architectures and datasets. Through multifaceted mechanistic analysis of error patterns, decision boundaries, and the geometry of the optimization landscape, our analyses suggest that imbalance severity shapes the topology, creating narrow solution basins under extreme imbalance and flat plateaus under moderate imbalance. This appears to constrain the effectiveness of loss-level modifications, as all methods must navigate these geometric constraints. Our findings offer practical guidance; standard cross-entropy provides a robust baseline, with specialized methods offering modest improvements (0.8-3.3% mIoU) that vary by architecture and dataset but risk substantial degradation if poorly tuned. This work provides the first mechanistic explanation for why techniques proven effective in 2D do not readily transfer to point-based 3D point cloud segmentation, validated across two representative architectures.

[54] Geo3R: Mitigating Spatial Reasoning Hallucination in Multimodal Large Language Models cs.CVPDF

Mingyu Wang, Weilin Jin, Wenbo Li, Haoyang Huang, Tong Jia

TL;DR: 本文提出了Geo3R框架，旨在缓解多模态大语言模型在空间关系推理中产生的幻觉问题。该框架无需训练、即插即用，通过引入几何证据和结构化3D推理来弥补2D视觉表示与3D空间现实之间的鸿沟。

Details

Motivation: 现有MLLMs在空间关系推理时容易产生与场景真实3D结构相矛盾的幻觉，而现有缓解方法在解决这一由2D到3D表征差距引发的‘空间推理幻觉’问题上效果有限。

Result: 在涵盖三种典型场景（透视效应、物体朝向、视角变化）的18个任务、三个基准测试上的实验表明，Geo3R能显著降低多种MLLMs的空间推理幻觉，无需额外训练即超越现有模型和方法。

Insight: 创新点在于明确定义了现有方法未能解决的‘空间推理幻觉’这一幻觉子类，并提出了一个无需训练、基于几何证据和结构化3D推理的通用缓解框架。从客观角度看，其将几何先验与MLLM推理过程解耦集成的思路具有借鉴意义。

Abstract: Despite remarkable progress in visual understanding, Multimodal Large Language Models (MLLMs) remain prone to hallucinations when reasoning about spatial relationships, often producing judgments that contradict the true 3D structure of the scene. Though several existing works have proposed to mitigate hallucinations, our analysis indicates that they show limited effectiveness in spatial reasoning, as they fail to bridge the fundamental gap between 2D visual representations and 3D spatial reality. Based on this finding, we define hallucinations arising from insufficient spatial structure modeling as spatial reasoning hallucination, a subcategory of relation hallucination that existing mitigation methods fail to address. We further identify three typical scenarios where such hallucinations frequently occur: perspective effects, object orientation, and viewpoint changes. To this end, we propose Geo3R, a training-free, plug-and-play framework that incorporates geometric evidence and structured 3D reasoning to mitigate spatial reasoning hallucination. Experiments on three benchmarks, covering 18 tasks across all three scenarios, show that Geo3R substantially reduces spatial reasoning hallucination across diverse MLLMs without additional training, outperforming existing models and methods.

[55] HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models cs.CVPDF

Weilin Jin, Mingyu Wang, Wenbo Li, Haoyang Huang, Yifan Wu

TL;DR: 该论文提出了HalluScope，一个用于多模态大语言模型的细粒度幻觉诊断框架。它通过联合执行幻觉检测、分类和可解释性解释生成，来解决现有方法诊断信息不足的问题。作者构建了HalluScope-30K大规模诊断数据集，并训练了HalluScope-4B和HalluScope-8B模型，在多个基准测试上达到了最先进的性能，且诊断驱动的反馈能有效指导目标模型纠正幻觉。

Details

Motivation: 多模态大语言模型在多种任务上表现出色，但仍存在幻觉问题，即模型输出与视觉内容、文本上下文或常识知识不一致。现有研究主要通过粗粒度检测来解决，但提供的诊断信息不足，难以理解幻觉类型和支持下游的幻觉缓解。

Result: 在MHALO基准测试和作者提出的细粒度幻觉分类基准测试上，HalluScope-4B和HalluScope-8B模型均取得了最先进的性能。诊断驱动的反馈实验表明，其生成的细粒度诊断解释能有效指导Qwen3-VL-8B-Instruct和LLaVA-1.5-7B等目标模型纠正幻觉，且全面诊断显著优于所有基线方法。

Insight: 论文的核心创新在于提出了一个统一的细粒度幻觉诊断任务，将检测、分类和解释生成联合优化，并构建了大规模、覆盖多来源和多任务类别的诊断数据集。其设计的联合奖励函数和诊断模型表明，联合优化下检测与分类是相互促进的，且细粒度的诊断信息能有效驱动模型改进，为幻觉缓解提供了新思路。

Abstract: Although Multimodal Large Language Models have achieved strong performance across a wide range of vision-language tasks, they still suffer from hallucinations, where model outputs become inconsistent with the visual content, textual context, or commonsense knowledge. Existing studies primarily address this problem through coarse-grained detection. However, these approaches often provide insufficient diagnostic information for understanding hallucination types and supporting downstream hallucination mitigation. To bridge this gap, we propose fine-grained hallucination diagnosis for MLLMs, a new unified task that jointly performs hallucination detection, classification, and interpretable explanation generation. We develop an automated data generation pipeline and construct HalluScope-30K, a large-scale diagnostic dataset covering eight sources and five task categories. Based on this dataset, we design a multi-granular joint reward function and train two diagnosis models, HalluScope-4B and HalluScope-8B, which achieve state-of-the-art performance on both the MHALO benchmark and our fine-grained hallucination classification benchmark. Notably, detection and classification are mutually beneficial under joint optimization. Furthermore, diagnosis-driven feedback experiments show that the fine-grained diagnostic explanations produced by our model effectively guide target models to correct their hallucinations, with full diagnosis substantially outperforming all baselines on both Qwen3-VL-8B-Instruct and LLaVA-1.5-7B.

[56] The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Results cs.CVPDF

Xiang Chen, Hao Li, Jiangxin Dong, Jinshan Pan, Xin Li

TL;DR: 本文回顾了第二届LoViF挑战赛，该赛事聚焦于真实世界多合一图像复原任务，旨在推动模型在模糊、低光、雾霾、雨雪等多种退化条件下的统一复原能力。报告分析了参赛团队提交的解决方案与结果，总结了有效的设计策略，并为未来真实世界底层视觉研究建立了更新的基准。

Details

Motivation: 挑战赛旨在推动统一图像复原模型在多样真实世界退化条件下的发展，为评估模型在统一框架下跨多种退化类别的复原精度、鲁棒性和泛化能力提供公共基准。

Result: 比赛吸引了158名注册参与者，最终有20支团队的结果被成功复现和验证并纳入最终排名。报告对这些结果进行了综合分析，并建立了该领域的最新基准。

Insight: 挑战赛的组织和总结为真实世界多合一图像复原领域提供了有效的设计策略参考和更新的性能基准，强调了模型在统一框架下处理多种退化的鲁棒性与泛化能力的重要性。

Abstract: This paper presents a review of the second LoViF Challenge on Real-World All-in-One Image Restoration. The challenge aims to advance unified image restoration under diverse real-world degradation conditions, including blur, low-light, haze, rain, and snow. It provides a common benchmark for evaluating the restoration accuracy, robustness, and generalization capability of models across multiple degradation categories within a unified framework. The competition attracted 158 registered participants, and 20 teams were included in the final ranking after their submitted results were successfully reproduced and verified. This report provides a comprehensive analysis of the submitted solutions and corresponding results, highlighting recent advances in real-world all-in-one image restoration. The summarized methods and empirical findings reveal effective design strategies and establish an updated benchmark for future research in real-world low-level vision.

[57] Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents cs.CVPDF

Hu Gao, Yulong Chen, Lizhuang Ma

TL;DR: 本文提出了Causal-AgentIR，一个具有自演化因果记忆的分层多智能体框架，用于解决图像修复任务中处理多样且不可预测的真实世界退化问题。该框架将修复经验组织成结构化的因果记忆图，支持基于图的检索和多跳因果推理，使智能体能够推断不同退化条件下特定修复操作或工具序列如何影响修复质量。

Details

Motivation: 现有图像修复智能体通常将知识存储为静态工具描述、手动定义的退化先验或非结构化文本摘要，这限制了修复知识在长期经验中的积累、验证、修订和遗忘。

Result: 广泛的实验证明了所提出框架的有效性，但摘要中未提及具体的基准测试、定量结果或与现有方法的比较（如是否达到SOTA）。

Insight: 核心创新在于将修复经验组织成结构化的因果记忆图，并构建了一个包含规划、退化分析、工具专家、因果记忆推理、结果批判和记忆管理等多个智能体的协作系统，实现了知识的动态演化与维护。

Abstract: Image restoration agents have recently emerged as a flexible paradigm for handling diverse and unpredictable degradations in real-world scenarios. Existing agents typically formulate restoration as a tool-using process, where the agent perceives degradations, searches candidate tools, executes restoration operations, and revises the plan through reflection or rollback. However, their knowledge is often stored as static tool descriptions, manually defined degradation priors, or unstructured textual summaries, which limits the accumulation, verification, revision, and forgetting of restoration knowledge over long-term experience. In this paper, we propose Causal-AgentIR, a hierarchical multi-agent framework with self-evolving causal memory for collective image restoration intelligence. Instead of representing restoration experience as isolated textual records, Causal-AgentIR organizes degradation patterns, image regions, restoration tools, actions, quality changes, and user preferences into a structured causal memory graph. This graph supports graph-based retrieval and multi-hop causal reasoning, enabling agents to infer how specific restoration operations or tool sequences affect restoration quality under different degradation conditions. The framework further organizes multiple agents into a collaborative system, including planning, degradation analysis, tool expertise, causal memory reasoning, outcome critique, and memory curation. Through this design, restoration experience can be added, updated, merged, reinforced, ignored, or discarded according to observed quality changes and feedback, allowing the agent to maintain reliable and transferable restoration knowledge. Extensive experiments demonstrate the effectiveness of the proposed framework.

[58] CRAG-MM-Diagnostics: Enabling Stage-Wise Analysis of Knowledge-Intensive VQA cs.CV | cs.AIPDF

Hanseok Oh, Parishad BehnamGhader, Benno Krojer, Hyunji Lee, Paul Liang

TL;DR: 本文介绍了CRAG-MM-Diagnostics，一个用于知识密集型视觉问答（KI-VQA）的诊断性基准测试。该基准通过分阶段的数据标注（包括基于语言的视觉定位、目标识别、知识检索与推理）来深入分析KI-VQA流程中的瓶颈。研究发现知识检索与推理是主要瓶颈，并基于此提出了一个集成了视觉定位模块的双模态检索增强生成（RAG）流程，显著提升了GPT-5和Qwen等模型的准确率。

Details

Motivation: 现有KI-VQA基准通常只报告最终任务准确率，无法揭示失败具体发生在哪个子问题（如视觉定位、目标识别或知识检索），因此需要一种能够进行分阶段分析的诊断工具来定位系统瓶颈。

Result: 在CRAG-MM-Diagnostics基准上的评估表明，知识检索与推理是当前KI-VQA系统的主要瓶颈。同时，视觉语言模型在目标对象识别上存在困难，图像检索器也难以整合文本线索。提出的新双模态RAG流程将GPT-5和Qwen的准确率分别提升了13.3和8.5个百分点。

Insight: 创新点在于提出了首个用于KI-VQA的分阶段诊断基准，通过精细的标注隔离了不同子任务，从而能进行细粒度分析。从客观角度看，将视觉定位模块集成到RAG流程中以在图像检索前裁剪目标，是一个有效缓解检索瓶颈的实用工程创新。

Abstract: Knowledge-Intensive Visual Question Answering (KI-VQA) benchmarks evaluate Vision-Language Models (VLMs) as multimodal knowledge assistants by requiring external information beyond a provided image to answer questions. KI-VQA involves multiple sub-problems -referring expression understanding, visual grounding, object recognition, knowledge retrieval, and reasoning-yet existing benchmarks typically report only end-task accuracy, obscuring where failures arise. To analyze the full KI-VQA pipeline, we introduce CRAG-MM-Diagnostics, a diagnostic benchmark with stage-wise data annotations that isolate 1) language-based visual grounding, 2) object identification, and 3) knowledge retrieval and reasoning. We evaluate fully parametric and retrieval-augmented VLMs, providing fine-grained analyses using newly collected metadata, such as target ROIs, entity names, and visual complexity scores. Our results point to knowledge retrieval and reasoning as the primary bottleneck, but also highlight issues in the other parts of the KI-VQA pipeline, such as the fact that VLMs struggle with target object identification or that image retrievers struggle to integrate textual cues. These findings expose fundamental limitations in current KI-VQA systems and motivate stage-aware evaluation. We, lastly, leverage these findings to propose a grounded bimodal RAG pipeline that integrates a visual grounding module to crop targets before image retrieval, boosting GPT-5 and Qwen’s respective accuracies by 13.3 and 8.5 percentage points.

[59] Out of Sight, Still in Mind: Token Compression for Omni-LLMs cs.CVPDF

Suho Yoo, Youngjoon Jang, Hyebin Cho, Joon Son Chung

TL;DR: 本文提出了一种名为ReMo的无训练框架，旨在降低全模态大语言模型（Omni-LLMs）在推理时的输入令牌成本。该方法通过将视觉令牌的信息跨模态重新分配来实现压缩：仅保留信息未在其他地方出现的视觉令牌。具体通过两种方式实现：一是将音频和视频对齐到公共嵌入空间，移除已被音频或其他视觉令牌解释的冗余视觉令牌；二是用紧凑的文本代理（即每个对象及其位置的简短描述）替换对象级视觉令牌，从而以更少的令牌传达相同内容。

Details

Motivation: 全模态大语言模型（Omni-LLMs）在推理时需联合处理音频、视频和文本，但三种模态的令牌成本高度不平衡，其中视觉令牌占输入绝大多数且高度冗余，导致计算开销大。本文旨在减少推理时的输入令牌成本，以提升效率。

Result: 在两个规模的Qwen2.5-Omni模型上，ReMo移除了54%的输入令牌，且准确率无损失。在五个音频-视觉基准测试中，其平均准确率甚至略微超过完整令牌模型，分别达到后者的101.2%和101.3%。

Insight: 创新点在于提出了一种无需额外训练的多模态令牌压缩框架，通过跨模态信息重分配和文本代理替换来高效减少冗余视觉令牌，在保持甚至提升模型性能的同时显著降低计算成本。从客观角度看，该方法巧妙地利用了模态间的互补性，为多模态模型的高效推理提供了新思路。

Abstract: The goal of this paper is to reduce the input token cost of Omni-modal large language models (Omni-LLMs) at inference time. Omni-LLMs reason jointly over audio, video and text, but the cost of the three streams is highly unbalanced: visual tokens account for the vast majority of the input, and are highly redundant. In this paper, we propose ReMo, a training-free framework that compresses visual tokens by redistributing their information across modalities: a visual token is kept only if its information appears nowhere else. ReMo achieves this in two ways: (i) it aligns audio and video in a common embedding space, and removes visual tokens already explained by the audio or by other visual tokens; and (ii) it replaces object-level visual tokens with compact text proxies, short descriptions of each object and its location, conveying the same content in far fewer tokens. On Qwen2.5-Omni at two model scales, ReMo removes 54% of the input tokens with no loss in accuracy. Indeed, it slightly exceeds the full-token model, reaching 101.2% and 101.3% of its average accuracy over five audio-visual benchmarks.

[60] T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video cs.CVPDF

Linlin Wang, Xue Yang, Zhihuang Zhou, Zhenyu Zhong, Ruiyuan Zhang

TL;DR: 本文提出了T-STAR，一个用于卫星视频时空全景场景图生成（TPSG）的大规模基准数据集和统一框架。该任务旨在生成具有明确时间跨度的<主体，关系，客体>三元组结构化图，以联合建模全景场景元素的身份一致实例掩码和时空关系，从而超越以对象为中心的感知，实现对动态地理空间场景的高层次结构化理解。

Details

Motivation: 卫星视频的结构化理解对于从低级感知推进到高级认知的动态地理空间场景分析至关重要。然而，目前缺乏专门用于卫星视频TPSG的数据集，且卫星视频中的对象通常小而纹理弱、跨帧关联易受遮挡和背景杂乱干扰、关系语义与空间结构和时间演化高度耦合，使得为自然视频开发的TPSG模型无法直接适用。

Result: T-STAR数据集包含超过110万个实例掩码和超过380万个时空三元组，涵盖39个细粒度对象类别和70个细粒度关系类别。广泛的实验证明了T-STAR数据集的重要性以及所提统一框架在增强跨帧实例一致性和时空关系预测方面的有效性，为未来结构化卫星视频理解研究建立了强有力的基准。

Insight: 论文的主要创新点在于首次为卫星视频定义了时空全景场景图生成（TPSG）这一新基准任务，并构建了首个大规模专用数据集T-STAR。从客观角度看，其提出的统一框架专注于解决卫星视频特有的挑战（如小目标、弱纹理、跨帧关联困难），将实例一致性建模与时空关系预测相结合，为地理空间视频分析从感知到认知的转变提供了新的结构化表示和评估基准。

Abstract: Structured understanding of satellite video is essential for advancing dynamic geospatial scene analysis from low-level perception to high-level cognition. To move beyond object-centric perception, this paper introduces spatio-temporal panoptic scene graph generation (TPSG) in satellite video as a new benchmark task. TPSG aims to generate a structured graph composed of a set of triplets <subject, relationship, object> with explicit temporal spans, thereby describing dynamic geospatial scenes by jointly modeling identity-consistent instance masks and spatio-temporal relationships among panoptic scene elements. However, there is still no dedicated dataset for TPSG in satellite video. Moreover, TPSG in satellite video is intrinsically challenging, as objects are often small and weakly textured, cross-frame association is easily disrupted by occlusion and background clutter, and relationship semantics are highly coupled with spatial structure and temporal evolution. Consequently, TPSG models developed for natural videos are not directly applicable to satellite video. This paper presents T-STAR, a large-scale benchmark dataset for TPSG in satellite video, comprising over 1.1 million instance masks and over 3.8 million spatio-temporal triplets across 39 fine-grained object categories and 70 fine-grained relationship categories. To enable TPSG in satellite video, we propose a unified framework to enhance cross-frame instance consistency and spatio-temporal relationship prediction. Extensive experiments demonstrate the significance of T-STAR and the effectiveness of the proposed framework, establishing a strong benchmark for future research on structured satellite video understanding. The dataset and code are available at https://github.com/linlin-dev/T-STAR.

[61] Stokes-Informed Diffusion for Robust Linear Polarization Estimation cs.CVPDF

Yidong Luo, Chenggong Li, Yuchao Feng, Boxin Shi, Junchao Zhang

TL;DR: 本文提出GenPolar，一种基于Stokes信息的扩散模型框架，用于从单张RGB图像估计线性偏振参数（DoLP和AoP）。该方法通过两阶段训练策略（多步条件扩散模型训练与一步生成器蒸馏）提升估计的鲁棒性和效率，并在多个数据集上实现了最先进的性能。

Details

Motivation: 偏振线索在材料检测和去反射等应用中具有价值，但通常需要专用硬件获取；本文旨在从单张RGB图像估计线性偏振，以解决硬件依赖问题，并应对弱偏振区域中偏振角（AoP）估计不稳定的固有不适定挑战。

Result: 在旋转偏振器、焦平面分割和混合数据集上的大量实验表明，GenPolar在DoLP保真度和AoP稳定性方面均达到了最先进（SOTA）水平，且在下游应用（如材料检测和去反射）中带来显著且一致的性能提升。

Insight: 创新点包括：基于Mueller形式的Stokes信息扩散框架，将强度S0预测为通道式线性Stokes分量（S1, S2），并解析推导DoLP和AoP；引入可观测性感知损失监督AoP；采用两阶段训练策略（多步扩散训练与一步生成器蒸馏），并结合VAE编码器的低秩自适应（LoRA）以减轻领域特定的自编码偏差。

Abstract: Polarization cues benefit applications such as material detection and de-reflection, yet acquiring them typically requires dedicated hardware. This motivates us to estimate the linear polarization from a single RGB image. However, the task is inherently ill-posed, with the Angle of Polarization (AoP) becoming particularly unstable in weak polarization regions, where the polarimetric signal is overwhelmed by noise, leading to erratic angle estimates. To address these limitations, we propose GenPolar, a Stokes-informed diffusion framework grounded in the Mueller formalism from an intensity observation. Specifically, GenPolar predicts channel-wise linear Stokes components (S1,S2) from intensity S0, from which degree of linear polarization (DoLP) and AoP are analytically derived; AoP is further supervised with an observability-aware loss. In addition, to enable efficient and high-fidelity inference, we adopt a two-stage training strategy. Firstly, a multi-step conditional diffusion model is trained with a physics-based loss. Subsequently, we distill it into a one-step generator, which further supports stable Low-Rank Adaptation (LoRA) of the VAE encoder to mitigate domain-specific autoencoding bias. Extensive experiments across rotating-polarizer, division-of-focal-plane, and hybrid datasets demonstrate that GenPolar achieves state-of-the-art performance in both DoLP fidelity and AoP stability. Crucially, these improvements translate to significant and consistent gains in downstream applications, including material detection and de-reflection.

[62] DART: A Degradation-Aware Recurrent Transformer for Archival Film Restoration cs.CV | cs.LGPDF

Mikołaj Jastrzębski, Wojciech Kozłowski, Kamil Adamczewski

TL;DR: 本文提出DART，一种用于档案胶片修复的退化感知循环Transformer模型。该模型通过预测并传播软缺陷掩码来显式指导修复过程，从而有效处理历史胶片中的复合退化问题。

Details

Motivation: 档案胶片修复面临复合退化（如划痕、灰尘、模糊等）且缺乏干净参考视频的挑战，现有方法通常隐式处理这些退化，缺乏对损伤位置和严重程度的显式知识。

Result: 在真实档案基准测试中，DART在无参考感知质量上优于先前的修复架构，同时保持紧凑高效，能产生更干净且时间一致的修复结果。

Insight: 创新点在于引入可预测和传播的软缺陷掩码，使修复网络能显式感知损伤位置和严重程度，而非仅依赖重建损失，这提升了处理结构化胶片损伤的能力。

Abstract: Archival film restoration is a challenging problem because historical footage contains compound degradations such as scratches, dust, blur, noise, flicker, and photometric aging, while clean reference videos are unavailable. Existing video restoration methods largely treat these degradations implicitly, reconstructing frames without explicit knowledge of where damage occurs or how severe it is. We propose DART, a degradation-aware recurrent transformer for archival film restoration. DART predicts and propagates a soft defect mask through time, using it to guide temporal fusion and condition the restoration network on both damage location and severity. This makes the restoration process explicitly aware of film artifacts rather than relying only on reconstruction losses. Experiments on real archival benchmarks show that DART improves no-reference perceptual quality over prior restoration architectures while remaining compact and efficient, producing cleaner and more temporally consistent restorations of structured film damage.

[63] Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform cs.CVPDF

Zhongchen Zhao, Jixin Wang, Qi Xie, Hui Lin, Lei Zhang

TL;DR: 本文提出了Flash EQ-Linear算法，通过结合群维度的傅里叶卷积定理和实数DFT的共轭对称性，将等变线性层的计算复杂度从O(NDC)降低到O(NDC/T)，并提供了专门的CUDA内核实现。在算子层面，其前向传播速度比PyTorch的F.linear快达2倍；在网络层面，Flash EQ-ViT和Flash EQ-Swin模型在端到端推理速度上比等变和非等变基线模型快达1.7倍。

Details

Motivation: 现有等变网络虽然通过权重共享实现了参数效率，但其计算效率并未提升，因为结构化权重被展开为密集矩阵并使用通用密集核进行计算，导致其FLOPs并不比非等变网络少。本文旨在解决等变线性层（EQ-Linear）的计算效率瓶颈。

Result: 在算子层面，Flash EQ-Linear相比PyTorch的F.linear实现了高达2倍的前向传播加速；在网络层面，Flash EQ-ViT和Flash EQ-Swin相比等变和非等变基线模型实现了高达1.7倍的端到端推理加速。这是首次等变网络在准确率、参数效率和推理速度三个维度上同时严格优于非等变网络。

Insight: 核心创新点在于将等变线性层重新解释为群维度上的循环卷积与通道维度上线性变换的组合，并利用傅里叶变换进行加速。这为等变网络提供了首个严格的计算加速方案，使其在保持参数效率优势的同时，在推理速度上也实现了超越。

Abstract: Equivariant networks embed geometric symmetries as structural priors through weight sharing, achieving remarkable parameter efficiency across vision tasks. However, this parameter efficiency does not translate into compute efficiency: existing implementations unroll the structured weights into dense matrices and dispatch them to generic dense kernels, so the FLOPs of an equivariant layer are no smaller than those of a non-equivariant counterpart. In this paper, we observe that the equivariant linear (EQ-Linear) layer—the most fundamental and frequently used module in modern equivariant architectures—is essentially a circular convolution along the group dimension composed with a linear transform along the channel dimension. Building on this observation, we propose Flash EQ-Linear, an exact acceleration algorithm that reduces the complexity from $\mathcal{O}(NDC)$ to $\mathcal{O}(NDC/T)$ by combining the Fourier convolution theorem along the group dimension with the conjugate symmetry of the real DFT. We further provide dedicated CUDA kernels for Flash EQ-Linear, covering both forward and backward passes and both FP32 and FP16 precision. At the operator level, Flash EQ-Linear achieves up to ${2\times}$ forward speedup over PyTorch’s F.linear; at the network level, Flash EQ-ViT and Flash EQ-Swin achieve up to ${1.7\times}$ end-to-end speedup over both equivariant and non-equivariant baselines. To our knowledge, this is the first time equivariant networks strictly dominate their non-equivariant counterparts along all three axes simultaneously: accuracy, parameter efficiency, and inference speed.Code is available at https://github.com/zhongchenzhao/FlashEQLinear.

[64] Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning cs.CV | cs.AIPDF

Lorenzo Orsingher, Thomas De Min, Massimiliano Mancini, Davide Talon, Elisa Ricci

TL;DR: 本文提出了首个评估多模态大语言模型（MLLMs）在非平衡遗忘请求下公平性的基准FAIRGET，并设计了首个兼顾遗忘质量与公平性的MLLM遗忘算法FAUN。该算法通过偏置感知的激活引导机制，在遗忘数据分布不平衡的情况下，有效移除目标数据并维持模型对不同人口群体的公平性。

Details

Motivation: 现有MLLM遗忘评估方法通常假设遗忘请求在虚构身份上均匀分布，但现实中不同人口群体的遗忘请求频率可能不同，这可能导致模型产生偏见行为。本文旨在填补这一空白，研究在非平衡、现实的遗忘场景下如何保持模型公平性。

Result: 在提出的FAIRGET基准和现有FIUBench上的实验表明，FAUN方法在遗忘质量和公平性方面均优于基线方法，实现了优越的性能。

Insight: 主要创新点在于首次系统性地关注并量化了非平衡遗忘请求对MLLM公平性的影响，并提出了首个针对MLLM的、显式考虑公平性的遗忘算法FAUN，其核心是利用偏置感知的激活引导来平衡遗忘效果与群体公平。

Abstract: Machine unlearning has emerged as a tool for removing personal data from trained models to comply with recent AI regulations. To evaluate unlearning effectiveness in multimodal large language models (MLLMs), prior works fine-tune models on fictitious identities, simulating unlearning requests on subsets of these IDs, which are typically uniformly distributed. However, in realistic scenarios, people from different demographic groups may request to be unlearned at different frequencies, potentially altering the model’s internal beliefs for these groups and leading to biased behaviors. To fill this gap, we propose FAIRGET, the first Visual Question Answering benchmark that evaluates unlearning under unbalanced, realistic, forget requests. These requests are designed to simulate multiple realistic scenarios, ranging from simple to challenging settings, that lead to biased unlearned models if fairness is not accounted for. Additionally, we propose FAUN, the first unlearning algorithm for MLLMs that forgets unlearning data while preserving model fairness. FAUN exploits a bias-aware activation steering mechanism to unlearn identities while accounting for the unbalanced nature of the forget data. Experiments on FAIRGET and the established FIUBench demonstrate our method’s superiority both in unlearning quality and fairness.

[65] Quality-Aware Multimodal Fusion Reveals Implicit Identity in Valence-Arousal Features cs.CVPDF

Jisu Kim, Benjamin S. Riggan

TL;DR: 本文提出了一种质量感知自适应融合（QAAF）方法，用于从视听表达动态中提取身份判别信息。该方法通过将多模态效价-唤醒（VA）估计作为前置任务，学习对输入质量变化鲁棒的多模态表示，并证明这些表示可作为软生物特征，补充传统人脸识别。

Details

Motivation: 传统人脸识别依赖静态外观线索，在表情变化、遮挡和光照不佳等非受控环境下性能下降。作者假设视听表达动态携带与静态外观互补的身份判别信息，且提取该信号需要能应对野外视频输入质量变化的多模态表示。

Result: 在Aff-wild2数据集上，QAAF用于VA估计的平均一致性相关系数（CCC）达到0.472，优于基线集成（0.415）和单骨干网络（0.288）。在AFEW-VA和YTF数据集上，VA训练的特征在软生物特征方法中排名第一，与ArcFace进行分数级融合后，等错误率（EER）进一步降低（AFEW-VA: 0.022到0.021，YTF: 0.106到0.104），并纠正了ArcFace在AFEW-VA上68.2%的错误接受。

Insight: 创新点在于将多模态VA估计作为学习身份判别表示的前置任务，并提出QAAF机制，通过估计每个样本、每个模态的可靠性，并利用学习的软门控和质量相关丢弃来自适应融合模态贡献。这为利用动态表达信息增强人脸识别提供了新思路。

Abstract: Conventional face recognition relies on static appearance cues and degrades in unconstrained settings with expression variation, occlusion, and poor lighting. We hypothesize that audiovisual expression dynamics carry identity-discriminative information complementary to static appearance, and that extracting this signal requires multimodal representations robust to the variable input quality of in-the-wild video. To learn such representations, we cast multimodal valence-arousal (VA) estimation as a pretext task and propose Quality-Aware Adaptive Fusion (QAAF), which estimates per-sample, per-modality reliability and adapts each modality’s contribution through learned soft gating and a quality-dependent dropout. For the problem of VA estimation, QAAF achieves an average Concordance Correlation Coefficient (CCC) of 0.472 via late fusion ensembling on Aff-wild2, improving over a baseline ensemble under the same setting (0.415) as well as a single-backbone baseline (0.288). Furthermore, the proposed QAAF demonstrates greater resilience to unavailable modalities, with only a 7.5-34.4% relative decrease in CCC when one modality is missing. We then probe whether these VA-trained features encode identity without identity-specific training. On AFEW-VA (67 actors) and YTF (1,595 subjects), VA-trained backbone features rank first among evaluated soft biometric methods, and score-level fusion with ArcFace lowers EER on both datasets (0.022 to 0.021 on AFEW-VA, 0.106 to 0.104 on YTF), correcting 68.2% of ArcFace’s false accepts on AFEW-VA. These findings establish multimodal VA estimation as a soft biometric modality complementary to conventional face recognition.

[66] Incremental Optimal Assignment for Real-Time Crowd Tracking cs.CV | cs.DSPDF

Ismail H. Toroslu

TL;DR: 本文提出了一种用于密集人群多目标跟踪的增量最优分配算法，以解决经典匈牙利算法在每帧处理大规模检测与轨迹匹配时O(N^3)时间复杂度的瓶颈问题。该算法利用人群跟踪代价矩阵的块稀疏结构（即簇内密集、簇间接近零），通过逐步添加个体并利用前一步已获得的最优对偶势，仅需单次增广路径搜索即可获得与匈牙利算法完全相同的全局最优分配结果。

Details

Motivation: 密集人群多目标跟踪需要在每帧视频中解决检测与轨迹之间的二分图分配问题，经典匈牙利算法的O(N^3)时间复杂度在处理数百人以上的大规模场景时成为性能瓶颈。

Result: 在N∈[200, 5000]的真实人群基准测试中，该算法相比匈牙利基线实现了3.7-6.5倍的加速，且保证产生与匈牙利算法完全相同的最优匹配结果；加速比随N增长而增加，在N>3000时保持稳定，适用于体育场出口和大型公共活动等大规模人群场景。

Insight: 创新点在于利用人群跟踪代价矩阵的块稀疏性和增量优化策略：通过维护对角线重排不变性保持数据结构紧凑和缓存友好，并利用前n-1步子问题的最优对偶势作为严格更强的初始条件，使得每新增个体仅需单次增广路径搜索即可获得全局最优解，避免了重复的全矩阵扫描。

Abstract: Multi-object tracking in dense crowds requires solving a bipartite assignment problem between detections and trajectories at every video frame. The classical Hungarian algorithm solves this in $O(N^3)$ time, which becomes a bottleneck for large scenes with hundreds of people. We propose an \emph{incremental} assignment algorithm that exploits the block-sparse structure of crowd tracking cost matrices — dense within each crowd cluster, near-zero between clusters. We compute the exact same optimal $N \times N$ assignment as the Hungarian algorithm, but via an incremental strategy: we add one person at a time, exploiting the fact that after step $n-1$ the dual potentials are \emph{exactly optimal} for the $(n-1)\times(n-1)$ subproblem — a strictly stronger condition than the intermediate feasibility maintained by the Hungarian algorithm during its $N$ outer iterations. Each new step therefore requires only a single augmenting path search from a certified optimal starting point. This avoids repeated full-matrix scans while guaranteeing an identical globally optimal result. A diagonal-reordering invariant keeps the data structure compact and cache-friendly. On realistic crowd benchmarks with $N \in [200, 5000]$ people organised into dense clusters, our algorithm achieves \textbf{3.7–6.5$\times$ speedup} over the Hungarian baseline while producing provably optimal matchings identical to those of Hungarian. The speedup grows with $N$ and remains stable beyond $N=3000$, making the method especially attractive for large-scale crowd scenes such as stadium exits and mass public events.

[67] ASTRA-Net: Anatomy-Specific Transfer and Representation Alignment for Drug-Induced Sleep Endoscopy Segmentation cs.CVPDF

Suhua Sun, Yuqiao Wang, Sheng Liu, Rui Fan, Jiajun Wang

TL;DR: ASTRA-Net是一种用于药物诱导睡眠内窥镜（DISE）分割的网络，旨在解决真实标注数据稀缺的问题。该方法分为两个阶段：第一阶段利用大量无标签的虚拟内窥镜图像与真实DISE图像进行特征对齐；第二阶段在少量真实标注数据上微调多个独立的UNet++解码器。

Details

Motivation: 解决DISE定量分析中像素级标注稀缺、手动轮廓勾画可扩展性差的问题，以在真实标注有限的情况下实现特定解剖平面的可靠气道边界分割。

Result: 在包含100帧的留出评估集上，仅使用MMD对齐的五模型集成取得了0.8927的平均Dice系数和0.8239的平均IoU，分类增强变体在相同数据上达到了0.92的四平面top-1准确率。

Insight: 创新点在于结合了无监督域自适应（通过虚拟图像进行特征对齐）和有监督微调，并采用结构化零掩码监督来约束不兼容平面的输出；其利用虚拟数据仅进行特征对齐而非直接训练的策略，在医学图像数据稀缺场景下具有借鉴意义。

Abstract: Quantitative drug-induced sleep endoscopy (DISE) requires reliable airway boundaries at specific anatomical levels. Pixel-level DISE annotations are scarce, and manual contouring limits the scalability of quantitative assessment. To address this limitation, we developed ASTRA-Net for known-plane DISE segmentation with limited real annotations. Stage 1 aligned intermediate ConvNeXt-Base representations from 14,250 unlabeled virtual endoscopy frames derived from computed tomography and real DISE frames. Virtual images were used only for feature alignment. Stage 2 fine-tuned four independent UNet++ decoders on 401 real annotated frames. Structured zero-mask supervision constrained incompatible plane outputs and invalid frames. Six alignment configurations used maximum mean discrepancy, domain adversarial learning, or both objectives. On a hold-out evaluation set of 100 frames, the five-model MMD-only segmentation ensemble achieved a mean Dice of 0.8927, with a 95% image-level bootstrap interval of 0.8631 to 0.9160. The mean intersection over union was 0.8239. A classification- enabled variant of the same alignment configuration reached a restricted four-plane top-1 accuracy of 0.92 on the same hold-out frames. These results indicate that ASTRA-Net can support frame-level, plane-specific DISE boundary delineation when real annotations are limited.

[68] DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation cs.CV | cs.AIPDF

Sung-Hoon Yoon, Hoyong Kwon, Changgyoon Oh, Kuk-Jin Yoon

TL;DR: 本文提出DINOde，一种基于常微分方程（ODE）的框架，用于实现开放词汇语义分割（OVSS）。该方法通过连续轨迹对齐CLIP文本嵌入与DINO视觉流形，包含语义文本流和全局上下文流两个组件，并引入速度切向投影来保持特征空间的几何结构。

Details

Motivation: 动机在于DINOv3模型虽能提供强结构化的视觉表示，但缺乏与文本的原生对齐，无法直接用于开放词汇语义分割。需要弥合视觉与文本模态之间的鸿沟。

Result: 大量实验表明，DINOde在多个OVSS基准测试中持续优于现有方法，并取得了最先进的（SOTA）性能。

Insight: 创新点在于将跨模态对齐建模为连续轨迹，避免了离散MLP投影中固有的流形纠缠问题；并引入了速度切向投影来约束学习到的速度场，以保持特征空间的超球面几何结构，从而获得更鲁棒的对齐。

Abstract: Open-vocabulary semantic segmentation (OVSS) leverages textual semantics to segment objects beyond predefined categories. While the self-supervised model DINOv3 provides strong structured visual representations, its lack of native textual alignment hinders its direct application to OVSS. To bridge this gap, we propose DINOde, an ODE-based framework that continuously aligns CLIP text embeddings with the DINO visual manifold. Our approach employs two complementary components: (i) Semantic Text Flow (STF), which evolves text embeddings toward the DINO manifold through a continuous ODE trajectory, and (ii) Global Context Flow (GCF), which progressively refines the holistic image representation carried by DINO’s CLS token. To preserve the hyperspherical geometry of the feature space during this evolution, we further introduce Velocity Tangent Projection, which constrains the learned velocity field to the tangent space. By modeling alignment as a continuous trajectory, DINOde avoids the manifold entanglement inherent in discrete MLP projections and yields more robust cross-modal alignment. Extensive experiments demonstrate that DINOde consistently outperforms existing methods and achieves state-of-the-art performance across multiple OVSS benchmarks. The code is available at https://github.com/yoon307/DINOde.

[69] When Are Reasoning-Based Guardrails Not Efficient? ResponseGuard: A Fast Vision-Language Guard for Real-Time Moderation cs.CV | cs.AIPDF

Dongbin Na

TL;DR: 本文提出了一种名为ResponseGuard的快速视觉语言安全防护方法，用于实时审核AI助手的流式生成回复。该方法通过单次前向传播从请求、回复和图像的池化表示中直接读取有害判定，避免了基于推理的防护方法所需的链式思维生成，从而大幅提升了检测速度。

Details

Motivation: 现有基于推理的视觉语言防护方法通过生成思维链来做出安全判定，导致模型解码大量令牌，变得沉重且缓慢，无法满足流式生成场景下实时拦截有害回复的需求。本文旨在探究视觉语言防护是否真的需要推理过程，并设计一种无需推理链的快速防护方案。

Result: 在标准多模态防护基准测试中，2B参数的ResponseGuard在回复有害性检测上超越了近期3B参数的基于推理的视觉语言防护模型，且时间成本降低了约150倍。在请求有害性检测上，基于推理的防护模型仍保持总体领先，但差距主要体现在仅包含图像的测试单元上。

Insight: 创新点在于摒弃了耗时的链式推理，采用单次前向传播的池化表示直接进行有害判定，实现了高效的实时防护。客观分析表明，性能差距可能源于两者共用的冻结视觉编码器而非缺失的推理链，且推理模型几乎未将注意力分配给图像，这提示了未来改进方向。对于视觉语言模型的回复防护，经过校准的单次判定可能已提供足够的安全信号。

Abstract: A vision-language AI assistant returns its answer as a stream of generated tokens. Therefore, a safety guard that watches that answer has to keep up with the stream and stop a harmful reply before a user reads it. Recent vision-language guardrails instead generate a chain of thought before they issue a verdict. They believe that step-by-step reasoning yields a safer guard. This design makes the guard heavy and slow, since the model must decode many tokens for harmfulness detection. We pose the question of whether a vision-language guard really needs to reason in order to screen a response. We answer with a guard that has no chain. ResponseGuard reads a harmful verdict from a single pooled representation of the request, the response, and the image in one forward pass. Across a standard multimodal guardrail benchmark, our 2B ResponseGuard outperforms a recent 3B reasoning-based vision-language guard on response harmfulness detection, without any reasoning and at about 150 times lower time cost. On request harmfulness the reasoning guard retains an overall lead, and the remaining gap on both tracks sits on the image-only cells. We observe that the gap may stem from the frozen vision encoders that both designs use rather than from the missing chain. We have also found the reasoning guard directs almost none of its verdict attention to the image. Based on a single-pass detection, ResponseGuard can screen an answer sentence by sentence as it streams and stop a harmful answer before it finishes. For guarding the response of a vision-language model, a calibrated single-pass label may provide a sufficient safety signal. We fully release all source code, trained models, and datasets at https://github.com/ndb796/ResponseGuard.

[70] Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping cs.CV | cs.AIPDF

Logan Robbins

TL;DR: 本文提出自适应身份锚定（AIA）方法，用于解决视频人脸替换中缺乏真实配对监督的问题。该方法通过一个闭环反馈机制，在生成视频中动态插入身份锚定关键帧，并结合纹理恢复技术，以提升合成身份的稳定性和真实感。

Details

Motivation: 当前视频人脸替换方法（如DreamID-V的SyncID-Pipe）仅在视频首尾两帧进行身份替换，导致在长视频、遮挡或极端姿态下，合成身份容易漂移，且缺乏对锚点数量和位置的研究。本文旨在通过自适应锚点放置和纹理恢复来解决身份漂移和过度平滑的问题。

Result: 论文未在摘要中提供具体的定量实验结果，但提出了可验证的实验方案，包括漂移-间隙曲线分析、均匀与自适应锚点放置对比、基于AIA生成数据的学生模型训练，以及纹理消融实验结合人工美感滤镜研究，以验证方法的有效性。

Insight: 创新点在于将身份锚定视为可控的质量调节参数，通过闭环反馈动态插入关键帧来锚定身份，并利用非面部区域的纹理进行细节恢复。这为视频合成中的身份一致性和纹理真实性问题提供了新的解决思路。

Abstract: Video face swapping has no natural paired supervision: no real footage exists of one person’s face performing another person’s video. The strongest current answer, DreamID-V’s SyncID-Pipe, mints pairs by replacing the identity in exactly two frames of a real clip – the first and the last – and regenerating the rest from a pose sequence alone. Pose carries no appearance evidence of the swapped-in identity, so over long clips, occlusions, and extreme pose excursions the synthesized identity has a long unanchored span on which to drift; no published ablation examines anchor count or placement. We propose Adaptive Identity Anchoring (AIA): (i) generalize the synthesizer to arbitrary anchor sets, architecturally natural for diffusion-forcing-style transformers where conditioning on a frame is clamping its tokens to zero noise; (ii) place anchors by a closed feedback loop that scores every generated frame against the real reference identity and inserts an image-face-swapped anchor at the worst-scoring frame until the pair passes a threshold or exhausts a budget; (iii) reuse the loop’s verdict as an automatic data filter. A second pathology, the beauty-filter look of over-smoothed skin, has the same root cause: micro-texture, like identity, is priced by none of the pipeline’s objectives. We therefore pair AIA with Reality-Referenced Texture Restoration: matched re-graining from each real frame’s non-face regions, band-split transfer of sub-identity micro-texture from the real footage, and a second, spectral acceptance channel refereed by the footage’s own spectrum. Identity-anchor density, we argue, is a controllable quality dial, and we specify falsifiable experiments – drift-versus-gap curves, uniform-versus-adaptive placement at matched budgets, student training on AIA-minted data, and texture ablations with a human beauty-filter study – that would validate or refute the proposal.

[71] Towards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach cs.CVPDF

Yuhua Wang, Xiaodong Li, Yihao Guo, Yuxiang Jia, Qinnan Zhang

TL;DR: 本文提出FedSEPT，一种面向数据异构的隐私保护联邦提示调优方法。该方法通过子空间分解的专家建模（SEM）将多个提示专家参数化为共享低秩因子、固定公共基和私有残差，从而将通信和差分隐私扰动限制在紧凑的因子空间内，并设计了实例感知的专家融合（IEF）进行自适应组合。

Details

Motivation: 现有联邦提示调优方法常采用单一共享提示来处理异构性和隐私，但可能过度平滑多样化的可迁移知识，削弱个性化与泛化的平衡；而多专家提示虽能更好捕捉多样性，却会扩大通信空间，增加差分隐私噪声和通信成本，并使鲁棒的专家组合更困难。

Result: 在11个异构基准测试上的大量实验表明，在相同的隐私约束下，FedSEPT相比强基线方法，在局部适应和全局泛化之间取得了更好的权衡。

Insight: 创新点在于提出了子空间分解的专家建模（SEM），将多专家参数化分解为共享低秩因子和私有残差，从而在紧凑空间内实现通信和隐私保护；以及实例感知的专家融合（IEF），通过设备端路由自适应组合语义互补的专家，并利用缓存的专家特定文本特征进行高效的logit级融合，提升了异构联邦学习中的性能与效率平衡。

Abstract: Federated prompt tuning (FPT) enables collaborative adaptation of vision–language models (VLMs) using lightweight prompts. Existing methods often address heterogeneity and privacy through a split-prompt design under local differential privacy (DP), combining a shared prompt for global transfer with private prompts for local adaptation. However, a single shared prompt may over-smooth diverse transferable knowledge, weakening the balance between personalization and generalization. Multi-expert prompts (MEPs) can better capture this diversity, but enlarge the communicated space, increasing DP noise and communication cost while making robust expert composition more difficult. We propose FedSEPT, a privacy-preserving Fed}erated Subspace-decomposed Expert Prompt Tuning. Specifically, we employ Subspace-decomposed Expert Modeling (SEM) to parameterize multiple prompt experts with shared low-rank factors, a fixed public basis, and private residuals, thereby confining communication and DP perturbation to a compact factor space while enabling direct server aggregation in a common coordinate system. We further design Instance-aware Expert Fusion (IEF), which adaptively combines semantically complementary experts via on-device routing and performs efficient logit-level fusion using cached expert-specific text features. Extensive experiments on 11 heterogeneous benchmarks show that, under the same privacy constraints, FedSEPT achieves a better trade-off between local adaptation and global generalization than strong baselines.

[72] DAPM: UAV Monocular Depth Estimation from Any Height, Pitch, Roll and FOV cs.CVPDF

Tong Ling, Wenhui Diao, Yingchao Feng, Hanbo Bi, Zhongyan Hou

TL;DR: 本文提出了一种专为无人机设计的单目深度估计框架DAPM，旨在解决无人机在高度、俯仰、滚转和视场角连续变化的动态相机姿态下，现有方法泛化能力不足的问题。该框架通过理论分析建立视角与视距的几何对应关系，并引入理想地面深度模块和渐进量化箱模块，联合估计相机姿态和深度。作者还构建了包含连续姿态参数分布的UAPD数据集进行验证。

Details

Motivation: 无人机在实际部署中，其相机姿态（高度、俯仰、滚转、FOV）高度动态变化，现有单目深度估计方法难以泛化到这种多样视角和空中场景固有的广阔深度分布范围。

Result: 在提出的UAPD数据集上的实验结果表明，DAPM在深度估计和相机姿态估计指标上均达到了最先进的性能。

Insight: 创新点在于通过理论推导建立了无人机视角与视距的几何对应关系，并以此为基础设计了用于密集相机姿态监督的IGD模块和用于鲁棒深度估计的渐进量化箱模块，首次为无人机空中图像提供了一个联合估计相机姿态和深度的单目框架。

Abstract: Monocular depth estimation is a fundamental prerequisite for 3D reconstruction and autonomous navigation in Unmanned Aerial Vehicles (UAVs). In practical deployments, UAVs operate under highly dynamic camera poses characterized by continuous variations in height, pitch, roll, and field of view (FOV). Existing monocular depth estimation methods frequently fail to generalize across such diverse perspectives and the expansive scale of depth distributions inherent in aerial scenes. To address these challenges, we establish a quantitative representation of UAV viewing angles through rigorous theoretical analysis, deriving the geometric correspondence between viewing angles and view distances using the ground plane as a reference for observation. Building upon this, we propose Depth Estimation for Any Perspectives Model (DAPM), representing the first monocular framework specifically designed for UAV aerial imagery to jointly estimate camera pose and depth under continuously varying viewpoints. Specifically, we introduce an Ideal Ground Depth (IGD) module that leverages the derived geometric relationships between UAV perspectives and view distances to implement dense camera-pose supervision and enhance depth features. And we further develop a coarse-to-fine Progressive Quantization Bins (PQB) module. By incorporating progressive supervision and hierarchical quantization bins, the PQB module enables robust estimation in complex UAV aerial imagery. To evaluate the proposed framework, we present the UAV Any Perspectives Depth (UAPD) dataset, featuring comprehensive and continuous distributions of pose parameters. Experimental results on UAPD demonstrate that DAPM achieves state-of-the-art performance across both depth and camera-pose estimation metrics. The source code and datasets are available at: https://github.com/ThisIsLT/DAPM.

[73] Texture++: Elevating 3D Asset Texture Resolution with a Region-Aware Diffusion Model cs.CVPDF

Shuaiwei Wang, Shi Li, Jieting Xu, Yuchi Huo, Qi Wang

TL;DR: 本文提出Texture++框架，通过将UV空间的纹理超分辨率任务转化为多视角渲染与融合，采用自适应视角选择策略整合分散纹理，结合四叉树区域组织方法区分需增强区域，并设计基于扩散模型的区域感知超分辨率模型，显著提升3D资产纹理的细节与连贯性。

Details

Motivation: 解决现有超分辨率模型忽视纹理图、专注于自然图像的问题，旨在通过高效通用的纹理超分辨率模型复兴电影、游戏等行业中因低分辨率而被废弃的3D资产。

Result: 综合评估表明，该方法在纹理细节和连贯性上大幅优于现有方法，但未提及具体基准数据集或定量指标（如PSNR/SSIM）。

Insight: 创新点包括将UV空间超分辨率重构为多视角融合任务、自适应视角选择策略、四叉树区域组织方法以及扩散模型驱动的区域感知超分辨率，这些技术可提升3D纹理处理的完整性与可控性。

Abstract: Numerous 3D assets are discarded due to low texture resolution, while current super-resolution models ignore texture maps and focus on natural images. An efficient and generalizable texture super-resolution model can revitalize a large corpus of aging yet valuable assets across industries such as film and video games. We present Texture++, a novel framework for texture super-resolution, which enhances the low-resolution textures of assets to produce high-resolution, high-quality results. Specifically, we reformulate the task of super-resolution in UV space into performing it across multiple rendered views and merging the outputs. Firstly, to achieve more complete and continuous textures in the view space, we propose an adaptive view selection strategy to integrate textures dispersed across UV texture patches. Furthermore, we introduce a quadtree-based texture region organization method for combining super-resolved textures from different viewpoints, providing masks to distinguish regions that require improvement. Finally, we design a diffusion-based super-resolution model that enhances the texture resolution for specified masked regions, seamlessly integrating with surrounding regions. Through comprehensive evaluations, we demonstrate that our approach yields textures with substantially improved detail and coherence over existing methods.

[74] ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing cs.CV | cs.AIPDF

Yueyi Liu, Chi Zhang, Sen Cui, Miao Liu

TL;DR: 本文提出ElasticTTT框架，用于解决预训练扩散模型在视频编辑中进行测试时调优（TTT）时出现的先验崩溃问题，通过目标分布正则化、对比CFG和异步噪声调度来保持生成先验和弹性，实现了一致性编辑效果。

Details

Motivation: 标准TTT的单点优化与生成模型的分布映射本质存在不匹配，导致先验崩溃，使模型丢弃文本条件或空间潜在变量，生成结果退化到源视频或区域特征纠缠。

Result: 在一次性视频编辑任务上，ElasticTTT通过理论分析和广泛评估，证明了其能有效保持基础模型的生成先验，实现了最先进的性能。

Insight: 创新点包括目标分布正则化防止记忆锐化、对比CFG减少源偏差、异步噪声调度保护未编辑区域，这些方法共同解决了TTT中的先验崩溃问题，提升了视频编辑的生成质量和一致性。

Abstract: Test-Time Tuning (TTT) on pretrained diffusion models has emerged as a powerful paradigm for video editing. However, there exists a foundational mismatch between the distribution-mapping nature of generative models and the single-point optimization of standard TTT. In this paper, we demonstrate that this mismatch triggers \textit{Prior Collapse}, a degenerate state where the model discards the text conditions and spatial latents, collapsing generations to the source video, or entangling the features of distinct regions. To resolve this, we propose \textbf{ElasticTTT}, a novel framework that preserves the prior generative distribution and rescues generative elasticity. Specifically, we propose \textit{Target Distribution Regularization} to prevent sharp memorization minima, \textit{Contrastive CFG} to guide inference away from source biases, and \textit{Asynchronous Noise Schedule} to preserve unedited regions. Extensive evaluations, supported by theoretical analysis, demonstrate that ElasticTTT successfully preserves the generative prior of the base model, achieving state-of-the-art performance on one-shot video editing.

Rafsan Jany, Shadab Tanjeed Ahmad, Ahsan Bulbul, Tahsinul Islam, Md Azam Hossain

TL;DR: 本文提出UnDA框架，用于解决医学影像中跨模态知识迁移的挑战，通过无配对数据实现跨模态蒸馏。该方法引入与主干网络无关的对齐模块提取结构化类别标记，并设计不确定性加权最优传输机制抑制噪声监督，同时采用基于原型的对比学习目标保持全局判别性。在严格无配对设置下的分割任务评估表明，该方法能有效提升目标模态的精度和边界准确性。

Details

Motivation: 解决多模态医学影像中配对数据获取困难的问题，现有跨模态知识蒸馏方法难以处理大模态差异和源域预测噪声传播的挑战。

Result: 在严格无配对设置下的代表性分割任务评估中，该方法在目标模态上实现了精度和边界准确性的持续提升，证明了无需配对数据集即可跨异构数据源迁移有意义的结构知识。

Insight: 创新点包括：主干无关的对齐模块通过注意力池化提取语义结构化类别标记；不确定性加权最优传输动态基于预测置信度加权特征对齐以抑制噪声；每类原型对比学习目标维护稳定原型记忆以增强未配对批次的全局判别性。

Abstract: Multimodal based approaches often outperform single modality approaches in downstream tasks as the different modalities provide complementary information, yet acquiring paired clinical data remains a significant challenge in real world scenarios. While cross-modal knowledge distillation addresses this, existing methods often struggle with large modality gaps and the propagation of noise from uncertain source-domain predictions. To overcome these challenges, we propose UnDA, an anchor-guided framework for unpaired cross-modal distillation. Our approach introduces a backbone-agnostic Alignment Module that extracts semantically structured class tokens via an attention based pooling mechanism. To ensure robust knowledge transfer, we propose Uncertainty-Weighted Optimal Transport (UCT-OT), which dynamically weights feature-level alignment based on prediction confidence, effectively suppressing noisy supervision. Furthermore, a per-class ProtoNCE objective maintains stable prototype memories to enforce global discriminability across unpaired batches. Evaluations on representative segmentation tasks under strictly unpaired settings show consistent improvements in accuracy and boundary precision in the target modality, demonstrating that meaningful structural knowledge can be transferred across heterogeneous data sources without paired datasets.

[76] Visual Contrastive Self-Distillation cs.CV | cs.AIPDF

Yijun Liang, Yunjie Tian, Yijiang Li, Yuqi Jia, Furong Huang

TL;DR: 本文提出了一种名为视觉对比自蒸馏（VCSD）的方法，旨在简化同策略自蒸馏（OPSD）过程。该方法通过对比原始图像与内容擦除控制图像下的教师模型输出分布差异，生成蒸馏信号，从而无需外部教师、特权答案或视觉证据信号。

Details

Motivation: 现有同策略自蒸馏方法需要教师和学生之间存在信息不对称（如特权答案或视觉证据）来确保有效的学习信号。本文旨在探索是否可以通过纯输入条件化来移除这些不对称性，从而获得更简单的OPSD形式。

Result: 在ViRL39K数据集上，VCSD在Qwen3-VL和Qwen3.5模型上均优于匹配的OPSD方法。例如，在Qwen3-VL上，它将七个基准测试的聚合分数从62.27%提升至67.04%（2B参数）、71.30%提升至73.16%（4B参数）以及72.51%提升至76.26%（8B参数）。

Insight: 核心创新在于将图像内容擦除转化为同策略自蒸馏信号，通过对比教师模型在原始图像和内容擦除控制图像下的输出分布差异来生成蒸馏目标。这种方法无需额外推理成本，简化了自蒸馏流程，并实现了性能提升。

Abstract: On-policy self-distillation (OPSD) is promising as it removes the external teacher required by on-policy distillation (OPD), yet it still needs asymmetric information between teacher and student to ensure that the self-teacher provides a stronger learning signal than the student. Existing methods create this asymmetry either through privileged answers or visual evidence. We ask whether both can be removed, yielding a simpler form of OPSD driven purely by input conditioning. For this purpose, we propose Visual Contrastive Self-Distillation, namely VCSD, which converts image-content removal into an on-policy self-distillation signal. At each student-generated response prefix, the EMA teacher produces two next-token distributions under the same prompt and prefix – one conditioned on the original image and the other on a content-erased control. Their token-wise log-probability difference highlights candidates whose likelihood is specifically increased by the instance-level visual content. We use this contrast to sharpen the teacher’s original-image distribution within its plausible support, and distill the resulting full-distribution target into the student. Using ViRL39K dataset, VCSD consistently outperforms matched OPSD across Qwen3-VL and Qwen3.5 models. For example, on Qwen3-VL, it improves the seven-benchmark aggregate from $62.27% \rightarrow 67.04%$ at 2B, $71.30% \rightarrow 73.16%$ at 4B, and $72.51% \rightarrow 76.26%$ at 8B. Furthermore, VCSD requires no external teacher, privileged answers, visual evidence signals, reasoning traces, or additional inference-time cost.

[77] Self-Supervised Learning of Structured Dynamics from Videos cs.CVPDF

Lukas Knobel, Andrew Zisserman, Yuki M. Asano

TL;DR: 该论文提出了一种名为结构化动态模型（SDM）的自监督学习方法，旨在从视频中学习解耦的动态表示，将相机运动与物体运动分离开来。该方法利用预训练图像视觉变换器的冻结特征，通过未来特征预测来显式分离主导的时间变化源和残差动态，并在合成与真实视频数据集上进行评估。

Details

Motivation: 视频中的帧间变化混合了相机运动和物体运动两种动态源，这种解耦在表示学习中尚未充分探索，但对于学习能够分离有意义物体动态与相机引起变化的鲁棒运动表示至关重要。

Result: 在涵盖相机运动、物体运动及组合动态的新评估套件ProbeMotion上，SDM优于使用全局CLS或平均池化特征的基线方法，并在多个探针任务上与强监督表示（如VGGT）表现相当，尽管使用了弱得多的监督。

Insight: 创新点在于提出了一种显式分离动态源的自监督框架，表明预训练图像模型可以轻松转化为结构化视频动态表示，为学习和分析潜在视频动态提供了有用的归纳偏置。

Abstract: Understanding motion in video is a fundamental challenge for visual learning, as frame-to-frame change entangles two sources of dynamics: camera motion and object motion. This decomposition has remained underexplored in representation learning, partly because these factors are tightly coupled in natural videos and difficult to supervise separately. Yet recovering it is important for learning robust motion representations that separate meaningful object dynamics from camera-induced variation. We study whether such structured motion representations can be recovered from frozen features of a pretrained image vision transformer. We propose the Structured Dynamics Model (SDM), which explicitly separates the dominant source of temporal change from residual dynamics through future-feature prediction, rather than representing video change with a single entangled latent or with unstructured, spatially dense transition tokens. Training combines self-supervised learning on real video with weak supervision of scene dynamics on synthetic Kubric data. We evaluate SDM on ProbeMotion, a new evaluation suite spanning synthetic and real videos with camera motion, object motion, and combined dynamics. SDM outperforms backbone baselines using global CLS or average-pooled features, and compares favorably to strongly supervised representations such as VGGT on several probes, despite using substantially weaker supervision. These results suggest that pretrained image models can be readily repurposed into structured video-dynamics representations, providing a useful inductive bias for learning and analyzing latent video dynamics.

[78] SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation cs.CVPDF

Junsong Chen, Jincheng Yu, Yitong Li, Shuchen Xue, Haozhe Liu

TL;DR: SANA-Video 2.0是一个用于高效视频生成的混合线性注意力视频扩散变换器，拥有50亿和140亿参数规模。它通过结合门控线性注意力和周期性的门控softmax锚点，在保持线性注意力长序列扩展优势的同时，实现了与全softmax视频DiT相当的质量，并能在单GPU上生成高达720p的高质量视频。

Details

Motivation: 为了解决全softmax注意力在视频生成中计算复杂度高（二次方）的问题，同时避免纯线性注意力因缺乏全秩token交互而导致表达能力不足，旨在实现高质量、长序列、高分辨率视频的高效生成。

Result: 在单H100 GPU上，使用40步采样，SANA-Video 2.0在480p分辨率下获得VBench得分84.30，耗时13.2秒，与更大的全softmax视频DiT模型性能相当但延迟更低。在720p/60s条件下，其编译后的DiT前向传播速度比匹配的全softmax基线快3.2倍，结合全栈优化后，5B模型在720p/5s下生成时间降至13.06秒。

Insight: 核心创新是混合线性-softmax注意力机制，以3:1的比例周期性插入门控softmax锚点来恢复全秩交互，弥补纯线性注意力的不足；同时引入块注意力残差（AttnRes）来跨深度传播锚点特征，提升深层表示的有效秩。这种从零开始的混合设计，而非对预训练模型进行线性化，实现了表达能力和计算效率的最佳权衡。

Abstract: We introduce SANA-Video 2.0, a hybrid video diffusion transformer instantiated at 5B and 14B scales under a unified architecture. Designed to generate high-quality video up to 720p on a single GPU, SANA-Video 2.0 matches full-softmax video DiTs in quality while retaining the favorable long-sequence scaling of linear attention. To avoid quadratic attention throughout, Hybrid Linear-Softmax Attention combines gated linear attention for O(N)-dominated mixing with periodic gated-softmax anchors at a 3:1 ratio, restoring the full-rank token interactions that pure linear attention lacks. To propagate these refreshed representations across depth, Block Attention Residuals (AttnRes) route completed block summaries into later linear layers, enabling anchor-feature reuse and boosting deep-layer effective rank by ~12%. Through from-scratch training, SANA-Video 2.0 learns the complete hybrid directly rather than linearizing pretrained models, with reduced-resolution proxy studies establishing 25% softmax as the optimal quality-efficiency trade-off. With 40-step sampling, SANA-Video 2.0 achieves a VBench score of 84.30 in 13.2s at 480p on a single H100, remaining competitive with far larger softmax video DiTs at a fraction of the latency. Its compiled DiT forward pass is 3.2x faster than a matched full-softmax baseline at 720p/60s, a gap that expands with video duration. Furthermore, full-stack Sol-Engine optimization (kernel fusion, caching, and sparse attention) accelerates this hardware-friendly backbone by a further 3.58x, bringing the 5B pipeline to 13.06s at 720p/5s and making it 120x faster than Wan 2.2-A14B on one H100. Overall, our hybrid design recovers softmax-level expressiveness at substantially reduced cost, unlocking scalable long, high resolution video generation.

[79] GraphVid: Interactive Graph-Controllable Video Generation cs.CV | cs.AIPDF

Vedant Shah, Onkar Susladkar, Tushar Prakash, Kiet Nguyen, Tianjio Yu

TL;DR: 本文提出了GraphVid，一种基于图条件控制的图像到视频生成模型，通过结构化的交互图实现对视频中多主体交互的精确控制。作者还构建了一个大规模、以交互为中心的标注数据集GraphVid-Bench，用于训练模型。该方法在数据量和参数量更少的情况下，实现了优于现有运动控制方法的视频质量和可控性。

Details

Motivation: 当前可控视频生成的挑战在于，仅通过文本提示或主要约束像素运动的运动控制输入，难以精确指定视频中多个对象之间的复杂交互。基于轨迹的控制方法需要用户为多个对象绘制精确路径，这在场景复杂、对象遮挡或重叠时难以扩展且容易产生歧义。

Result: 与Motion-I2V相比，GraphVid在多个指标上显著提升：FID降低高达39.9%，FVD降低37.6%，PSNR从9.87提升至15.98，SSIM从0.38提升至0.61。这些结果表明其在保持强可控性的同时，视频质量也达到了先进水平。

Insight: 核心创新点在于引入了结构化的交互图作为控制接口，将多对象交互关系显式建模为图结构，从而实现了更灵活、更精确的语义级控制。这为可控视频生成提供了一个新的、强大的范式，即利用结构化语义接口来替代或补充传统的轨迹或文本控制。此外，构建专门的交互中心数据集对于训练交互感知模型至关重要。

Abstract: Controllable video generation remains challenging due to the difficulty of specifying precise multi-object interactions using text prompts or motion-control inputs that primarily constrain pixel movement. In practice, trajectory-based control often requires users to draw accurate tracks for multiple objects, which scales poorly with scene complexity and becomes ambiguous under occlusion or overlap. To enable flexible yet precise multi-subject control, we introduce $\textbf{GraphVid}$, a graph-conditioned image-to-video generation model that enables interactive control through structured interaction graphs. We further curate $\textbf{GraphVid-Bench}$, a large-scale interaction-centric video dataset with structured relational annotations to enable training of interaction-aware video generation models. Despite using substantially less training data and fewer trainable parameters than prior motion-control methods, GraphVid delivers strong controllability and video quality. Compared with Motion-I2V, GraphVid reduces FID by up to 39.9% and FVD by 37.6%, while improving PSNR (9.87=>15.98) and SSIM (0.38=>0.61). Our results highlight the potential of structured semantic interfaces as a powerful paradigm for controllable video generation.

[80] Synthetic data generation framework for quality control automation in gravure printing cs.CV | cs.AI | cs.LG | eess.IVPDF

Korota Arsène Coulibaly, Mohamed Hamlich, Khalid Hmali, Andrea Trombin

TL;DR: 本文针对凹版印刷质量控制的自动化需求，提出了一种合成数据生成框架，以解决实际工业缺陷图像极度稀缺的问题。该框架能自动生成高保真度的特定印刷缺陷图像（如折痕、条纹、套印不准等）及对应的边界框标注，并利用生成的合成数据集训练了最先进的目标检测模型RFDETR。实验表明，仅使用合成数据训练的模型在真实工业测试样本上达到了80.9%的平均精度均值（mAP），为零成本、快速部署的印刷线缺陷检测自动化提供了解决方案。

Details

Motivation: 凹版印刷的质量控制仍依赖缓慢、昂贵且主观的人工检查，而自动化表面缺陷检测对维持高质量标准至关重要；然而，训练鲁棒的深度学习模型（如YOLO或Vision Transformers）受到真实工业缺陷图像极端稀缺的严重阻碍。

Result: 在真实工业测试样本上，仅使用合成数据训练的RFDETR模型达到了80.9%的mAP，证明了该合成数据生成框架的有效性。

Insight: 创新点在于提出了一种专门针对凹版印刷质量控制的合成数据生成框架，能够自动生成高保真缺陷图像及标注，从而无需大量手动数据收集即可实现缺陷检测模型的快速部署；从客观角度看，该框架为零成本自动化提供了可行路径，通过合成数据有效缓解了工业场景中数据稀缺的瓶颈问题。

Abstract: Quality control in printing, particularly in rotogravure printing, still depends on slow, costly, and subjective manual inspection. Automated surface defect detection is critical for maintaining high-quality standards in rotogravure printing. Deep learning models give prospects for automation. However, training robust deep learning models, such as YOLO or Vision Transformers, is heavily hindered by the extreme scarcity of real-world industrial defects images. To overcome this limitation, this paper introduces a novel synthetic data generation framework tailored for rotogravure printing quality control. The proposed pipeline automatically generates high-fidelity images of specific printing defects (creases, streaks, misregistration, etc.) and outputs corresponding bounding boxes and annotations. To validate the framework, a synthetic dataset of 7533 images was generated and used to train the state-of-the-art object-detection model RFDETR. Experimental results demonstrate that the model trained on our synthetic data achieves a Mean Average Precision (mAP) of 80.9% on real industrial testing samples. This framework provides a zero-cost, rapid-deployment solution for automating defect inspection in printing lines without requiring massive manual data collection.

[81] Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning cs.CVPDF

Rogerio Guimaraes, Pietro Perona

TL;DR: 本文提出了一种名为渐进种子剪枝（PSP）的推理时扩展方法，用于扩散模型和流匹配模型。该方法通过在去噪早期评估多个噪声种子，并逐步剪枝掉不具前景的候选轨迹，从而在固定计算预算下更有效地提升生成质量。

Details

Motivation: 扩散和流匹配模型在条件图像生成中占主导地位，但其推理时扩展技术远不如自回归语言模型成熟。现有方法通常在整个推理过程中保持恒定的内存占用，导致对初始噪声种子的探索效率不高。

Result: 在扩散和流匹配骨干网络上，PSP方法在匹配计算量下，相比最佳N选择、重要性采样和树搜索基线，在奖励引导选择方面持续改进，并获得了更高的GenEval分数（自动化评估）和更好的人类评估提示对齐度。

Insight: 论文的核心创新在于放松了推理过程中恒定内存占用的约束，探索了通过早期大量评估种子并渐进剪枝来更有效利用固定计算预算的推理时扩展轴。这为提升扩散模型推理效率提供了一种新的、可借鉴的思路。

Abstract: Diffusion and flow-matching models dominate conditional image generation, yet inference-time scaling for these models is far less developed than for autoregressive language models. Because final quality is highly sensitive to the initial noise seed, many approaches spend extra compute on seed search or resampling under a black-box reward, but typically maintaining a constant memory footprint throughout inference. We show that relaxing this constraint enables an underexplored inference-time scaling axis: by front-loading exploration, evaluating many seeds early, and pruning aggressively, we can use a fixed compute budget more effectively. \emph{Progressive Seed Pruning} (\PSP) scores intermediate denoised estimates and progressively narrows the candidate set so that only promising trajectories are fully denoised, while keeping the total number of model evaluations fixed. Across diffusion and flow-matching backbones, \PSP \ consistently improves reward-guided selection and achieves higher GenEval scores (automated) and better human evaluation on prompt-alignment than best-of-$N$, importance-sampling, and tree-search baselines at matched compute. Project page: https://www.vision.caltech.edu/psp. Code: https://github.com/rogerioagjr/psp.

[82] Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers cs.CVPDF

Sicheng Mo, Yuheng Li, Ziyang Leng, Krishna Kumar Singh, Bolei Zhou

TL;DR: 本文提出了WorldWeaver (W^2)，一种流式多智能体视频扩散模型，通过引入跨智能体的世界状态寄存器来增强生成过程。这些可学习的令牌用于存储共享的世界信息、追踪个体智能体状态，并在每个生成块后动态更新。模型采用混合Transformer架构，将世界状态建模与视觉帧建模分离，在Minecraft双智能体视频生成任务中验证了其有效性。

Details

Motivation: 现有自回归视频扩散模型仅将观测历史作为条件上下文，难以在多智能体、多视角场景中维持一致且持久的世界状态。本文旨在解决多智能体交互世界模型中共享状态维护的挑战。

Result: 在双智能体Minecraft视频生成任务上的大量实验表明，显式的世界状态建模显著提升了生成的逻辑一致性与生成质量。

Insight: 核心创新点是引入了跨智能体的世界状态寄存器作为共享记忆机制，并通过混合Transformer架构分离状态与视觉建模。这为构建具有持久、可演化状态的多智能体世界模型提供了新思路。

Abstract: Multi-agent interactive world models should not only generate consistent observations, but also maintain world states that persist across agents and evolve across views. Existing autoregressive video diffusion pipelines carry forward observation history as conditioning context, which makes shared state difficult to maintain in multi-agent and multi-view settings. We present WorldWeaver (W^2), a streaming multi-agent video diffusion model that augments rollout with cross-agent world state registers: learnable tokens that store shared world information, track individual agent status, and are dynamically updated after each generated chunk. We ground these registers with supervision signals spanning individual agent status, global state views including bird’s-eye views, and scene text. We further improve the architecture with a Mixture-of-Transformers design that uses separate weights for world state modeling and visual frame modeling. Extensive experiments in two-agent Minecraft video generation show that explicit world-state modeling improves logical consistency and generation quality.

[83] 3D-Aware VLMs with Implicit and Explicit Geometries cs.CV | cs.AI | cs.LGPDF

Wenhao Li, Xueying Jiang, Quanhao Qian, Deli Zhao, Ran Xu

TL;DR: 本文提出了VLM-IE3D，一个增强视觉语言模型3D空间感知能力的统一框架。该框架通过从RGB视频中学习隐式和显式3D几何，并利用3D感知适配器将其与2D视觉线索融合，从而在不依赖额外3D输入的情况下，提升了模型在多种3D任务上的细粒度空间理解和推理能力。

Details

Motivation: 现有的基于2D视觉输入的视觉语言模型在处理需要细粒度空间理解和推理的各种3D任务时存在困难，本文旨在弥补这一差距。

Result: 大量实验表明，VLM-IE3D在3D视频检测、3D视觉定位、3D密集描述和空间推理等多种3D任务上均取得了优越且一致的性能。

Insight: 创新点在于提出了隐式几何令牌和显式几何令牌来分别捕获高级几何先验和详细几何结构，并通过RGB-only设计为模型注入了强大的3D归纳偏置，无需额外3D输入即可实现精细的空间理解。

Abstract: Despite rapid progress, most existing vision-language models (VLMs) built from 2D visual inputs often struggle when handling various 3D tasks that require fine-grained spatial understanding and reasoning. To bridge this gap, we present VLM-IE3D, a unified framework that enhances the 3D spatial awareness of VLMs by equipping them with both implicit and explicit 3D geometries learned from RGB videos. Our VLM-IE3D introduces Implicit Geometry Tokens (IGTs) that capture high-level geometric priors from input videos, as well as complementary Explicit Geometry Tokens (EGTs) that encode detailed geometric structures from reconstructed 3D attributes. On top of that, VLM-IE3D comes with a 3D-aware adapter that effectively fuses the two types of geometric representations with 2D visual cues. This RGB-only design injects strong 3D inductive biases for fine-grained spatial understanding and reasoning without requiring any additional 3D inputs. Extensive experiments show that VLM-IE3D achieves superior performance consistently across various 3D tasks including 3D video detection, 3D visual grounding, 3D dense captioning, and spatial reasoning. Code and models are available at https://github.com/Vegetebird/VLM-IE3D.

[84] Unified Video Dense Prediction from Disjoint Data cs.CVPDF

Yihong Sun, Seoung Wug Oh, Jiahui Huang, Bharath Hariharan, Joon-Young Lee

TL;DR: 本文提出UniD，一个统一视频模型，能够从互不重叠的领域特定数据集中联合学习并预测八种密集场景属性（深度、表面法线、语义分割、边界、人体部位、反照率、着色和材质）。其核心是通过一个简单的蒸馏步骤，让每个任务的专家模型通过轻量级任务投影器来监督一个统一的主干网络，从而避免了需要重叠标注或生成伪标签。

Details

Motivation: 现有场景理解任务通常依赖特定任务的标注，但这些标注分散在不同且不兼容的数据集中。当前统一系统要么局限于完全共标注的数据进行训练，要么需要付出高昂的计算成本进行伪标注。本文旨在解决从互不重叠数据源进行统一视频密集预测的挑战。

Result: UniD在性能上与各任务的专用模型（per-task specialists）和多任务基线模型（multi-task baselines）相比具有竞争力。它在分布外场景下表现出强大的泛化能力，并增强了时间一致性和跨任务一致性。

Insight: 论文宣称的创新点在于利用预训练扩散模型的强大视觉先验来弥合由互不重叠训练源引入的领域差距。从客观角度看，其提出的通过任务专家蒸馏来监督统一主干的方法，是一种高效整合异构数据、避免伪标注计算开销的有效策略。

Abstract: Scene understanding requires simultaneous prediction about geometry, appearance, and semantics. However, existing task-specific annotations are fragmented across incompatible, domain-specific datasets. Current unified systems circumvent this by restricting training to fully co-annotated data, or by incurring the large computational cost of pseudo-labeling. To mitigate this, we introduce UniD, a unified video model that jointly predicts eight dense scene properties-depth, surface normals, semantic segmentation, boundaries, human parts, albedo, shading, and materials-all learned from disjoint, domain-specific datasets. We propose a simple yet effective distillation step in which per-task experts supervise a unified backbone through lightweight task projectors, eliminating the need for annotation overlap or pseudo-labeling. Our key insight is that the strong visual priors of a pretrained diffusion model are sufficient to bridge the domain gaps introduced by disjoint training sources, enabling robust generalization to scene-task combinations never seen during training. UniD achieves competitive performance against per-task specialists and multi-task baselines, with strong generalization to out-of-distribution scenarios and enhanced temporal and cross-task consistency. Code and video results are available at https://unid-video.github.io/.

cs.LG [Back]

[85] The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoning cs.LG | cs.CLPDF

Ishan S. Kshirsagar

TL;DR: 本文通过研究强化学习（RL）前后国际象棋模型中的潜在推理机制，发现RL增强了模型对潜在思维向量扰动的鲁棒性，而非增加对其内容的依赖。研究挑战了潜在推理作为推理时主动参考的草稿板的默认假设，指出其主要作用是在训练过程中塑造模型参数。

Details

Motivation: 现有因果分析局限于数学和逻辑任务，且未在RL阶段前后比较模型对潜在思维的依赖。本文旨在测试RL是否改变模型对潜在推理的依赖，以验证潜在推理是否作为主动咨询的草稿板。

Result: 在国际象棋任务中，RL后合法性从48%提升至61%，并消除了将杀幻觉。因果干预显示，RL后模型对潜在思维向量扰动的鲁棒性增强，例如零向量腐蚀下合法性从RL前的1%提升至RL后的9%。

Insight: 创新点在于首次在RL前后对潜在推理进行因果分析，揭示了RL主要增强模型鲁棒性而非依赖思维内容，挑战了潜在推理作为主动草稿板的假设。这为理解训练过程中参数塑造的重要性提供了新视角。

Abstract: Latent, or silent, reasoning lets language models carry out intermediate computation in continuous vector space instead of words, and is widely assumed to function as an internal scratchpad the model actively consults during inference. Whether that assumption survives reinforcement learning has not been tested directly: existing causal analyses of latent reasoning are confined to math and logic tasks, and compare a model’s reliance on its thoughts within a single checkpoint, never before and after an RL stage. We train a chess-playing model through a staged latent-reasoning curriculum followed by reinforcement learning, and find legality climbs monotonically to 61% (from a 48% pre-RL baseline) while checkmate confabulation is eliminated entirely. To locate this gain, we run a six-condition causal intervention suite on the same model before and after RL: substituting or adding matched noise to the latent thought vectors leaves performance unchanged, ablating them causes only mild degradation, and only exact-zero vectors cause collapse. This robustness gap is itself the finding: under exact-zero corruption, legality collapses to 1% pre-RL versus 9% post-RL, a gap that survives correction for testing across the full battery; milder conditions trend similarly without independently reaching significance. RL appears to add robustness to disruption, not reliance on thought content. These results push back against the field’s default assumption that latent thoughts function as an actively consulted inference-time scratchpad, and instead indicate latent reasoning’s principal effect here is shaping the model’s parameters during training. We also demonstrate a working RL gain in chess, a domain outside the math and logic settings where multiple groups report the same latent-reasoning-plus-RL recipe failing to improve accuracy over SFT.

[86] A Graph Neural Network approach to zero-shot Digital Twins cs.LG | cs.AI | cs.CVPDF

Alicia Tierz, Icíar Alfaro, David González, Elías Cueto

TL;DR: 本文提出了一种零样本数字孪生框架，通过结合实时视觉感知与几何无关的物理信息推理引擎，实现了无需针对新几何形状或边界条件重新训练即可进行物理模拟。核心是热力学信息图神经网络架构，它基于度量辛热力学形式主义，通过图消息传递局部强制执行能量守恒和非负熵产生。该框架还集成了辅助图神经网络从稀疏视觉边界推断不可观测场，并采用连续闭环数据同化机制实时校正模拟，消除数值漂移。

Details

Motivation: 传统预测性数字孪生通常几何结构固定，当底层物理域或边界条件变化时需要大量重新训练或微调，限制了其灵活性和适应性。本文旨在克服这一限制，开发一个能够零样本泛化到新几何形状的、实时且物理精确的数字孪生系统。

Result: 在粘弹性梁大变形和粘性流体非线性晃动这两个截然不同的物理场景中，该框架在未见过的几何形状上实现了物理精确的模拟，无需针对具体案例重新训练。系统在实时延迟预算内运行（约每帧25毫秒），并支持通过增强现实直接投影潜在机械变量。

Insight: 主要创新点在于将热力学第一和第二定律（能量守恒和熵增）作为归纳偏置直接编码到图神经网络的消息传递机制中，构建了一个几何无关的物理求解器。同时，通过视觉感知与物理模拟的闭环耦合，实现了实时数据同化以校正模拟，弥合了仿真与现实的差距，实现了零样本泛化能力。

Abstract: Traditional Predictive Digital Twins often remain geometrically rigid, requiring extensive retraining or fine-tuning whenever the underlying physical domain or boundary conditions change. To overcome this limitation, we present a novel framework for \textit{Zero-Shot Digital Twins} that seamlessly couples real-time visual perception with a geometry-agnostic, physics-informed reasoning engine. At the core of our architecture is the Thermodynamics-Informed Graph Neural Network architecture, a Geometric Deep Learning solver grounded in a metriplectic thermodynamic formalism that enforces energy conservation and non-negative entropy production locally through graph message passing. The framework integrates an auxiliary Graph Neural Network to infer unobservable fields (such as stress tensors or velocity and energy distributions) directly from sparse initial visual boundaries, mitigating numerical start-up transients. To bridge the sim-to-real gap, we implement a continuous closed-loop data assimilation mechanism; the pipeline tracks macroscopic deformations and free-surface fluid boundaries in real-time using deep segmentation networks combined with sparse optical flow, dynamically correcting the autoregressive simulation rollout and eliminating numerical drift. To test the validity of our approach, we demonstrate the extreme generalization capabilities of our approach across two disparate physical regimes: the large deformations of a viscoelastic beam and the non-linear sloshing of a viscous fluid. In both scenarios, the unified framework instantiates physically accurate simulations on novel, unseen geometries without case-specific retraining, operating well within real-time latency budgets (approximately 25 ms per frame) and enabling the direct projection of latent mechanical variables via Augmented Reality.

[87] Training Large Language Models for Self-Explanation Faithfulness cs.LG | cs.AI | cs.CLPDF

Yeoktatt Cheah, María Pérez-Ortiz, Noah Y. Siegel, Oana-Maria Camburu

TL;DR: 本文提出了一种基于强化学习的方法，直接优化大语言模型自我解释的忠实性，即模型生成的推理过程准确反映其内部决策机制的程度。该方法将现有的忠实性度量指标转化为强化学习训练目标，通过在Llama3.1-8B和Qwen3-8B模型上进行微调，显著提升了其在Phi-CCT忠实性指标上的得分，并展示了模型能够被训练以识别并披露影响其决策的关键因素。

Details

Motivation: 现有工作主要集中于评估自我解释的忠实性或使用推理时提示框架来改善其可追溯性，但缺乏直接优化模型参数以生成忠实自我解释的机制。本文旨在填补这一空白。

Result: 经过强化学习微调的Llama3.1-8B和Qwen3-8B模型在Phi-CCT忠实性指标上取得显著提升，分布内得分从接近零提升至最高0.664，在StrategyQA等分布外任务上得分最高达0.691。跨干预类型的泛化能力较弱但存在有趣的非零迁移现象。

Insight: 创新点在于将忠实性度量直接转化为可优化的强化学习目标，为提升LLM推理的忠实性提供了一条可扩展的路径。客观来看，该方法证明了模型参数可以被直接优化以更忠实地披露其决策因素，并初步探索了不同干预类型下的泛化特性，尽管其机制尚不完全明确。

Abstract: We propose a Reinforcement Learning (RL) method to directly optimize the faithfulness of self-explanations - the extent to which a model’s generated reasoning accurately reflects its internal decision-making process. While existing work focuses on evaluating faithfulness or using inference-time prompting frameworks to improve an LLM’s self-explanation’s tractability, these approaches do not provide a mechanism to directly optimize a model’s parameters to generate faithful self-explanations. We bridge this gap by modifying existing faithfulness metrics into an RL training objective. We investigate (1) if models can be trained to accurately detect factors that affect their decisions, and (2) whether RL can directly optimize for the disclosure of these factors thereby improving LLM self-explanations’ faithfulness. We experiment with two intervention types: random-word insertions and user-bias insertions, using a per-sample reward derived from the Phi-CCT correlation metric. RL fine-tuned Llama3.1-8B and Qwen3-8B show substantial improvements on the Phi-CCT faithfulness metric, with in-distribution scores rising from near-zero to as high as 0.664, and out-of-distribution scores reaching up to 0.691 on held-out tasks such as StrategyQA. Cross-intervention generalization is weaker but more interesting: a priori we would not expect a model trained only on random word insertions to generalize to user-bias phrases, yet Llama3.1-8B shows non-zero transfer in this direction. The reverse direction and Qwen3-8B do not replicate this, indicating model-dependent and setup-dependent effects we cannot yet explain. Lastly we analyze model behavior to rule out reward gaming behaviors that often plague RL training. Ultimately, we show that models can be trained to implicitly identify influential factors and disclose them, offering a scalable path toward reducing unfaithful reasoning in LLMs.

[88] AI Assistants Overassist cs.LG | cs.AI | cs.CL | cs.CY | cs.HCPDF

Verona Teo, Raghav Jain, Tobias Gerstenberg, Max Kleiman-Weiner

TL;DR: 本文介绍了Int-Bench基准测试，用于评估大语言模型（LLMs）在学习过程中的干预行为。研究发现，相比人类教师，LLMs倾向于更频繁、更早地干预，并提供完整解决方案而非针对性提示，这可能不利于深度学习和长期推理能力的培养。

Details

Motivation: 当前LLMs被广泛用作导师和思维伙伴，但其在解决问题时如何决策干预（如时机和频率）尚不明确，不当干预可能阻碍真实学习和认知参与。

Result: 在代码调试、数学和脑筋急转弯三个领域，LLMs的干预频率更高、时间更早，且倾向于提供完整答案；与人类相比，LLMs更关注短期任务成功而非长期学习效果。

Insight: 论文创新点在于提出了Int-Bench这一模拟基准来量化评估LLM的干预行为，并揭示了当前AI助手可能过度辅助、优化短期成功的问题，这对设计促进深度学习的AI教育工具有重要启示。

Abstract: Large language models (LLMs) are increasingly used as tutors and thought partners, helping users reason through problems. While guidance from AI assistants can scaffold thinking and foster learning, such benefits depend on how they help–for instance, intervening too early or too frequently may hinder true learning and cognitive engagement. Yet how AI systems navigate intervention decisions during problem-solving remains poorly understood. Here, we introduce Int-Bench, a simulation-based benchmark for evaluating LLM interventions during learning. Int-Bench simulates a “student” solving a problem while a “teacher” monitors the student’s reasoning and decides whether, when, and how to intervene. Across three domains–code debugging, mathematics, and brain teasers–we evaluate LLM teachers on the frequency and timing of interventions, as well as their impact on both immediate task success and generalization to new problems. We also compare LLMs to humans, finding that LLMs intervene more frequently and earlier than humans. Moreover, in contrast to humans, they tend to provide complete solutions rather than targeted hints. These findings suggest that current LLM assistants often optimize for short-term success rather than supporting the reasoning processes needed for deeper learning and long-term success.

[89] Counterfactual Explainability Framework With CycleGAN And Counterfactual-Classifier Alignnment Score for Retinal Disease Classification cs.LG | cs.CVPDF

Kritanu Chattopadhyay, Sayanjit Singha Roy, Soumya Chatterjee

TL;DR: 该论文提出了一种名为CounterFundus的新型反事实可解释性框架，用于视网膜疾病分类。该框架结合了基于EfficientNet-B5的疾病检测和基于CycleGAN的病理图像到正常图像的视觉可解释转换，以生成反事实解释并定位疾病相关的视网膜变化。此外，论文还引入了反事实-分类器对齐评分（CCAS）来量化反事实差异图与分类器显著性图之间的一致性，并通过实验验证了该框架的有效性。

Details

Motivation: 解决深度学习模型在视网膜疾病自动检测中缺乏临床可解释性的问题，特别是模型决策未能与具有临床意义的视网膜区域相关联，从而阻碍了其在临床中的采纳。

Result: 评估表明，生成的反事实解释在所有CCAS维度（斯皮尔曼相关性、二元IoU和指向精度）上与分类器相关的视网膜证据在空间上保持一致。消融研究进一步证实，经过CCAS筛选的反事实数据增强提高了眼底图像下游分类的性能。

Insight: 创新点在于将CycleGAN驱动的反事实图像生成与疾病分类器相结合，提供视觉上合理的解释，并提出了一个综合评估指标CCAS来量化解释与分类器决策之间的一致性，从而构建了一个临床基础的可解释人工智能（XAI）框架。

Abstract: Automated detection of vision impairing retina-based ocular conditions from fundus images is important for early screening, timely referral and reducing dependency on specialist-only assessment, for which neural network-based deep learning (DL) models have been widely utilized. However, explainability of the DL frameworks remains a major bottleneck for clinical adoption, particularly when model decisions are not linked to retinal regions that are clinically meaningful. To address this issue, this study presents CounterFundus, a novel CycleGAN-driven counterfactual explainability framework, integrating EfficientNet-B5-based retinal disease detection with visually interpretable disease-to-normal fundus image translation. For each pathological image, the counterfactual yielded by the CycleGAN generator represents an estimated healthy counterpart and the resultant difference map is utilized to localize disease-associated retinal changes. Unlike conventional post-hoc saliency methods, CounterFundus provides counterfactual explanations through visually plausible disease-to-normal retinal translation. Thereafter, to quantify the spatial agreement between counterfactual difference maps and classifier saliency, the Counterfactual-Classifier Alignment Score (CCAS) is introduced, embedding Spearman correlation, binary IoU and pointing accuracy into a single assessment protocol. To this end, EigenCAM-aligned evaluation demonstrates that the generated counterfactual explanations remain spatially consistent with classifier-relevant retinal evidence across all CCAS dimensions. Along with that, ablation studies further confirm that CCAS-filtered counterfactual augmentation improves the downstream classification performance in fundus images, establishing CounterFundus as a clinically-grounded, explainable artificially intelligence (XAI) framework for retinal disease detection.

[90] M$^3$-Gen: Interpretable Multimodal Generation of Gene Expression Profiles Using Clinical and Imaging Data cs.LG | cs.AI | cs.CVPDF

Francesca Pia Panaccione, Carlo Sgaravatti, Marco Venere

TL;DR: 本文提出了一种名为M$^3$-Gen的多模态分子生成框架，它利用组织病理学图像和临床元数据，通过生成对抗网络（GAN）来生成基因表达谱。该框架通过对比学习学习统一的潜在表示，并利用注意力机制实现模型的内在可解释性，能够识别影响特定基因表达谱生成的图像区域。

Details

Motivation: 基因表达数据获取成本高且存在隐私问题，限制了其在多模态研究和AI应用中的使用，因此需要一种能够整合临床元数据和病理图像来生成基因表达谱的方法。

Result: 在TCGA数据集上的评估表明，M$^3$-Gen能够生成真实且具有功能意义的基因表达数据。

Insight: 创新点在于通过对比学习和注意力机制整合多模态数据，不仅生成生物学上一致的基因表达谱，还提供了模型决策的内在可解释性，能够可视化病理图像中对生成结果影响最大的区域。

Abstract: Integrating heterogeneous biomedical data, including clinical metadata, histopathology images, and molecular profiles, is crucial for comprehensive disease understanding. However, gene expression data acquisition remains constrained by high costs and privacy concerns, limiting its use in multimodal research and AI-driven applications. We present MultiModal Molecular Generation (M$^3$-Gen), a novel framework for the generation of gene expression profiles by conditioning a Generative Adversarial Network on histopathology images and clinical metadata. M$^3$-Gen learns a unified latent representation from the clinical variables and the images, leveraging contrastive learning, and exploits the embeddings of the two modalities to guide a generative model in producing biologically coherent gene expression profiles. Evaluations on the TCGA dataset demonstrate that M$^3$-Gen generates realistic and functionally meaningful gene expression data. Importantly, by integrating multiple modalities in an attention-based mechanism, M$^3$-Gen provides intrinsic explainability: it allows the identification of which regions of the histopathology images most strongly influenced the generation of specific gene expression profiles, making the model’s decisions interpretable by design.

cs.CE [Back]

[91] Chemical Chain-of-Thought Functions as a Hallucination-Prone Molecular Scratchpad cs.CE | cs.CLPDF

Jiatong Li, Yuxuan Ren, Weida Wang, Xiaoyong Wei, Yatao Bian

TL;DR: 该论文研究了化学推理语言模型在链式思维（CoT）过程中的幻觉问题，发现模型生成的推理轨迹中存在大量与分子结构无关的虚假陈述，但这些轨迹仍具有类似草稿的计算功能。

Details

Motivation: 旨在探究化学推理语言模型中链式思维（CoT）的真实性，解决其普遍存在的幻觉问题，并理解CoT在推理过程中的实际作用。

Result: 在四个推理模型家族和十二个化学任务上的实验表明，幻觉广泛存在且与答案正确性脱钩；归因分析揭示了模型特定的草稿功能形式，如Chem-R依赖碎片化SMILES草图。

Insight: 化学CoT并非忠实解释或事后合理化，而是易产生幻觉的分子草稿；这警示了将CoT视为直接推理证据的风险，并强调了超越仅答案评估的过程级监督的必要性。

Abstract: Chemical reasoning language models are expected to derive molecular answers through faithful chain-of-thought (CoT). However, across four reasoning model families and twelve chemistry tasks, hallucination is widespread and largely decoupled from answer correctness: correct answers often coexist with fabricated structural claims absent from the relevant molecules. Yet this does not make the reasoning trace computationally irrelevant. Attribution analyses suggest a shared scratchpad function expressed in model-specific forms: Chem-R and ether-0 rely on fragmented SMILES drafts, whereas ChemDFM-R emphasizes scaffold, positional, and naming cues. Notably, perturbing Chem-R’s SMILES sketches degrades generation, showing that structural drafts can be causally load-bearing even when verbal structural claims are largely inert. Together, these results show that chemical CoT is neither a faithful explanation nor merely a post-hoc rationalization, but a hallucination-prone molecular scratchpad. This finding cautions against treating CoT as direct evidence of faithful reasoning and motivates process-level supervision beyond answer-only evaluation.

cs.AI [Back]

[92] DFAH-Bench: Benchmarking Observable Agent Instability in Financial Decision-Making cs.AI | cs.CL | cs.LGPDF

Raffi Khatchadourian

TL;DR: 本文提出了DFAH-Bench基准测试，用于评估金融决策智能体的可观测行为不稳定性，重点关注工具调用轨迹、证据接触和决策集中度三个维度，而非仅关注最终决策结果。通过对10个模型在3个金融任务上的8,127次回放测试发现，仅凭结果一致性会严重高估智能体的稳定性。

Details

Motivation: 现有标准评估基准主要衡量工具使用智能体的决策结果，而忽略了其每次达成决策的过程是否一致，这可能导致对智能体稳定性的误判。因此，需要一种不依赖隐藏推理文本、能观测行为过程稳定性的评估方法。

Result: 实验发现，前沿模型在决策上的一致性可达95%，但在遵循相同工具路径方面的一致性仅为77%，存在18个百分点的差距。在决策一致性高的案例组中，超过55%表现出显著的轨迹差异。研究识别出三种行为模式：模式匹配者、稳定执行者和轨迹分歧者。

Insight: 创新点在于提出了首个专注于评估智能体决策过程（而非结果）行为不稳定性的回放基准，并定义了三个可观测的评估通道。核心见解是结果一致性是稳定性不完整的信号，必须结合过程一致性进行综合评估，这对可靠智能体开发具有重要意义。

Abstract: Standard evaluation benchmarks measure what a tool-using agent decides, not whether it arrives at that decision through the same process each time. We introduce DFAH-Bench, a replay benchmark that measures observable behavioral instability in financial agent decision-making across three channels – tool-call trajectories, evidence contacts, and decision concentration – none of which require access to hidden reasoning text. Across 8,127 replay episodes spanning 10 models and 3 financial tasks, we find that outcome agreement alone is an incomplete stability signal: frontier models can agree on decisions 95% of the time while following the same tool path only 77% of the time – an 18-percentage-point gap (95% CI: [0.14, 0.22]) that outcome-only evaluation misses entirely. Among frontier-model case groups with high decision agreement, over 55% exhibit meaningful trajectory divergence. We identify three behavioral profiles: pattern matchers that achieve near-perfect agreement by collapsing to a single output regardless of input, stable executors with relatively consistent tool-use processes, and trajectory divergers that reach the same conclusions through materially different tool paths and evidence contacts. The benchmark code, metric scripts, replay logs, benchmark card, dataset README, and release manifest are released in the accompanying repository.

[93] Telco-GAIA: Bilingual Benchmark for Agents in Telecom Domain cs.AI | cs.CLPDF

Dmitrii Khizbullin, Zaid Alyafeai, Abdelrahman Eldesokey, Nourah AlSultan, Raghad Alshalan

TL;DR: 论文介绍了Telco-GAIA，一个用于评估电信领域工具使用智能体的双语多模态基准。该基准包含100个人工验证的英阿双语问答任务，每个任务平均需要4.2步多跳推理，涉及静态网站快照、合成关系型SQL数据库和外部网络档案三种异构数据源。基准以沙盒化Docker环境形式提供，并通过标准化精确字符串匹配进行评分，确保了评估的客观性和可复现性。

Details

Motivation: 为了解决在真实世界电信运营商数据上评估工具使用智能体性能的挑战，并提供一个无需LLM作为评判的、客观且可复现的测试平台。

Result: 在评估一个专门构建的参考智能体时，即使最强的模型也只能解决71%的任务；在适度成本预算下，这一比例降至约40%；而涉及视觉基础的任务类别表现最弱，平均后端得分低于30%。

Insight: 创新点在于构建了一个结合多模态、多跳推理和多数据源的封闭领域基准，并采用沙盒环境和标准化精确字符串匹配来确保评估的客观性与可复现性，为构建企业级智能体测试平台提供了模板。

Abstract: We introduce Telco-GAIA, a bilingual, multi-modal benchmark for evaluating tool-using agents on the data of a real-world telecommunications operator. Telco-GAIA comprises 100 human-verified question-answering tasks, in English and Arabic, that each demand multi-hop reasoning (4.2 hops on average) over three heterogeneous sources: a static website snapshot (HTML, images, and linked PDFs), a synthetic relational SQL database, and external web archives, spanning text, image, and tabular modalities. The benchmark is delivered as a sandboxed Docker environment and scored by normalized exact string matching, making evaluation objective, deterministic, and reproducible over time without any LLM-as-a-Judge. Evaluating a purpose-built reference agent across twelve commercial and open LLMs, we find Telco-GAIA challenging: even the strongest model solves only 71% of tasks; under a moderate cost budget, this falls to about 40%, and the visually grounded categories remain the weakest, where the average backend scores below 30%, leaving substantial headroom in document and image understanding. Telco-GAIA offers a rigorous, reproducible testbed for enterprise agents and a template for constructing closed-domain benchmarks.

[94] CMI-Mem: Toward Generalizable Long-Term Memory Management via CMI-Augmented Reinforcement Learning cs.AI | cs.CLPDF

Yubo Wang, Qiuyu Zhao, Zenghui Sun, Shichao Dong, Jinsong Lan

TL;DR: 本文提出了CMI-Mem，一种基于强化学习的轻量级记忆管理器模型，用于解决现有方法依赖LLM生成的合成问答对导致记忆评估受限于采样查询和下游读取器的问题。该方法通过结合下游问答正确性和内在条件互信息（CMI）的混合奖励来训练模型，CMI用于评估新对话输入相对于当前记忆状态的信息贡献，无需依赖特定查询。

Details

Motivation: 现有记忆管理器模型主要依赖LLM判断的合成问答对进行记忆评估，这使得记忆价值评估受限于采样的查询和下游读取器，缺乏通用性和独立性。

Result: 论文提出了CMI-Mem模型，并发布了代码和CMI-Mem-4B模型检查点，但摘要中未明确提及具体的基准测试或定量结果（如SOTA比较）。

Insight: 创新点在于引入条件互信息（CMI）作为内在奖励，以无查询依赖的方式评估记忆信息贡献，与下游任务奖励互补，增强了记忆管理的通用性和鲁棒性。

Abstract: Memory Manager models are pivotal in agent systems. Existing methods rely predominantly on LLM-judged synthetic question-answer (QA) pairs, making memory valuation dependent on sampled queries and the downstream reader. To address this limitation, we propose \textbf{CMI-Mem}, a reinforcement learning(RL)-based lightweight memory manager model with a hybrid reward that combines downstream QA correctness and intrinsic Conditional Mutual Information (CMI). CMI evaluates the information contributed by new conversational inputs relative to the current memory state without conditioning on a sampled QA query, thereby complementing rather than replacing QA grounding. Our codes are available at: https://github.com/Wyb0627/CMIMem , and the CMI-Mem-4B model checkpoint is available at: https://www.modelscope.cn/models/wyb0627/CMIMem-4B

[95] WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveforms cs.AI | cs.AR | cs.CLPDF

Yichuan Liu, Daniel Cummings, Nick Vadlamudi

TL;DR: 本文提出了WaveformQA，一个用于评估大语言模型在数字波形上进行时序推理能力的开源问答基准。该基准包含360个问题，涵盖八个不同难度类别，并基于开源设计实现生成波形以确保可复现性。评估发现前沿LLM在简单查询上表现尚可，但在复杂时序和多步问题上因上下文窗口限制和推理困难而性能下降，且事件时间JSON表示相比标准VCD格式能提升推理准确率。

Details

Motivation: 大语言模型在代码生成和推理方面表现出色，但其在数字波形数据上进行时序推理的能力尚未得到充分探索，而这是设计验证中的关键瓶颈。现有基准主要评估硬件描述语言代码生成，仅将波形作为补充上下文。

Result: 对前沿LLM的评估显示，模型在简单查询上达到合理准确率，但在复杂时序和多步问题上性能下降。此外，实验表明使用事件时间JSON表示波形相比标准VCD格式能提高LLM的推理准确率。

Insight: 论文的创新点在于创建了首个专门针对数字波形时序推理的LLM基准测试WaveformQA，并揭示了波形的事件时间JSON表示比传统VCD格式更利于LLM理解，同时其开源框架支持快速扩展新问题类别和波形源，为相关研究提供了可复现的实验平台。

Abstract: Large Language Models (LLMs) have demonstrated strong capabilities in code generation and reasoning, yet their ability to perform temporal reasoning over digital waveform data remains largely unexplored. Although reasoning over digital waveforms is a critical bottleneck in design verification, existing benchmarks primarily evaluate hardware description language (HDL) code generation and use waveforms only as supplementary context. This paper presents WaveformQA, an open-source question-answering benchmark for evaluating LLM temporal reasoning over digital waveforms. The benchmark comprises 360 questions with programmatically generated ground truths across eight categories of varying difficulty, including questions targeting multi-signal correlation and event ordering. Waveforms are generated from open-source design implementations, ensuring reproducibility and grounding the benchmark in real hardware behavior. Evaluation of frontier LLMs reveals that while models achieve reasonable accuracy on simple queries, performance degrades due to context window limitations and reasoning difficulties on complex temporal and multi-step questions. In addition, we show that an event-time JSON representation of waveforms improves LLM reasoning accuracy versus the standardized value change dump (VCD) format. The open-source framework supports extending to new question categories and importing new waveform sources, enabling researchers to rapidly prototype temporal reasoning experiments.

[96] NVIDIA-labs OO Agents: Native Python Object-Oriented Agents cs.AI | cs.CLPDF

Paul Furgale, Severin Klingler, James Nolan, Matt Staats, Gaia Di Lorenzo

TL;DR: NVIDIA 实验室提出了 NOOA（NVIDIA Object-Oriented Agents），这是一个模型无关的 Python 框架，用于构建可靠的 AI 智能体。该框架将智能体定义为 Python 对象，其方法对应可执行的动作，字段对应状态，文档字符串作为提示，类型注解作为契约。通过这种设计，开发者和智能体共享同一接口，使得智能体行为可以像普通软件一样被测试、追踪、重构和改进。

Details

Motivation: 传统智能体开发涉及提示模板、工具模式、回调代码和工作流图等多个分散部分，过程复杂。NOOA 旨在简化这一过程，通过将智能体直接映射为 Python 对象，提供一个统一、简洁且可维护的编程模型，以提升智能体开发的可靠性和效率。

Result: 论文在针对性能力测试以及智能体和推理基准测试（如 SWE-bench Verified、Terminal-Bench 2.0 和 ARC-AGI-3）上进行了验证，结果表明当前模型能够有效利用该接口。

Insight: 创新点包括：提出了“智能体即 Python 对象”的编程模型，统一了开发者和智能体的接口；首次在单一平台上结合了六项面向模型的核心思想，如类型化输入/输出、对活动对象的引用传递、代码即动作等。这为智能体开发提供了更自然、可测试和可工程化的方法。

Abstract: Traditional agent development is split across prompt templates, tool schemas, callback code, and workflow graphs. We present NVIDIA Object-Oriented Agents (NOOA), a model-agnostic Python framework for building reliable AI agents. NOOA takes a simpler approach: an agent is a Python object. Its methods are the actions the model can take, fields are its state, docstrings are its prompts, and its type annotations are contracts. A method whose code body consists of “…” is completed at runtime by an LLM-driven agent loop, while methods with normal bodies remain standard deterministic Python. This gives developers and agents the same interface, so agent behavior can be tested, traced, refactored, and improved just like other software. This paper makes three contributions. (1) We present the agent-as-a-Python-object programming model and the design principles behind it. Where Python has existing abstractions, we adopt them directly. Agent-specific capabilities–context, events, state rendering, long-term memory, and validated LLM loops–are exposed through simple Pythonic APIs, so both developers and agents share one familiar programming model. (2) We identify six model-facing ideas that NOOA is, to our knowledge, the first to combine on a single surface: typed input/output, pass-by-reference over live objects, code as action, programmable loop engineering, explicit object state, and model-callable harness APIs for context and events. We find the community already converging on several of these ideas–often as experimental or partial features–and present the comparison to encourage further adoption. (3) We demonstrate that current models use this interface effectively, both in targeted capability tests and on agentic and reasoning benchmarks such as SWE-bench Verified and Terminal-Bench 2.0 and ARC-AGI-3.

[97] Euclid-MCP: A Model Context Protocol Server for Deterministic Logical Reasoning via Prolog cs.AI | cs.CL | cs.SEPDF

Bartolomeo Bogliolo

TL;DR: 本文提出了Euclid-MCP，一个开源的模型上下文协议服务器，通过集成SWI-Prolog为大型语言模型提供确定性的逻辑推理能力。它设计了一种与引擎无关的中间表示Euclid-IR，用于表达Horn子句逻辑，并通过一个简洁的工具接口支持翻译-运行-检查-修复的循环。论文在一个现实的IT安全与合规用例上进行了评估。

Details

Motivation: 大型语言模型在自然语言理解和生成方面表现出色，但在多步逻辑推理方面不可靠，尤其是在安全关键或合规敏感领域。现有的神经符号方法集成通常是特制的，缺乏用于工具增强智能体的标准化接口。

Result: 在现实的IT安全与合规用例评估中，结果表明，LLMs单独在小知识库上表现足够，但在更大问题上会产生系统性幻觉，而Euclid-MCP能以更低的延迟和更紧凑的输出提供精确答案。

Insight: 创新点在于提出了一个标准化的、开源的MCP服务器，并设计了引擎无关、人类可读且易于LLM生成的中间表示Euclid-IR，为基于RAG的助手和智能体系统提供了一个稳定、共享的确定性推理基础，并论证了语义RAG本质上不适合规则执行。

Abstract: Large Language Models (LLMs) excel at natural language understanding and generation but remain unreliable for multi-step logical reasoning, especially in safety-critical or compliance-sensitive domains. Recent neuro-symbolic approaches address this gap by coupling neural models with external symbolic engines, yet most integrations are bespoke and lack a standardized interface for tool-augmented agents. This paper presents Euclid-MCP, an open-source MCP server that provides deterministic logical reasoning via SWI-Prolog. Euclid-MCP introduces Euclid-IR, an engine-agnostic intermediate representation for Horn-clause logic that is human-readable, easy for LLMs to generate, and straightforward to compile into Prolog or alternative backends. The server exposes a compact tool interface that supports a translate-run-inspect-repair loop, enabling LLM clients to delegate inference while retaining full access to proof traces and derivation logs. We evaluate Euclid-MCP on a realistic IT security and compliance use case. Results show that while LLMs alone are sufficient on small knowledge bases, they hallucinate systematically on larger problems, whereas Euclid-MCP delivers exact answers with lower latency and more compact outputs. We argue that semantic RAG is fundamentally unsuited for rule enforcement, and that Euclid-MCP can serve as a stable, shared reasoning substrate for both RAG-based assistants and agentic systems.

[98] EmoAgent-R1: Towards Multimodal Emotion Understanding with Reinforcement Learning-based Dynamic Agent Specialization cs.AI | cs.CVPDF

Lihuang Fang, Yuchen Zou, kebin Jin, Jinghui Qin

TL;DR: 本文提出EmoAgent-R1，一种基于强化学习的动态智能体专业化框架，旨在提升多模态大语言模型在情感理解任务中的性能。该框架通过冷启动策略赋予模型初步的情感识别、推理和智能体路由能力，并利用强化学习进一步优化其动态智能体选择与专业化流程。

Details

Motivation: 现有基于MLLM的多模态情感识别方法通常使用固定提示来感知情感，忽略了多模态输入中情感源的动态性和复杂性，因此需要一种能够动态适应和专业化处理情感信息的框架。

Result: 在多个MER基准测试上的广泛实验表明，EmoAgent-R1在情感推理性能上表现优越，并改善了优化稳定性，达到了先进水平。

Insight: 创新点包括引入基于强化学习的动态智能体专业化机制，以及提出渐进式组相对策略优化方法，将稀疏奖励转化为细粒度学习信号，缓解了GRPO中粗粒度统一信用分配问题。

Abstract: Multimodal large language models (MLLMs) have achieved impressive performance in multimodal emotion recognition (MER) tasks and lifted MER to a new level that is complex emotion understanding with advanced video understanding abilities and natural language description. However, existing MLLM-based methods often use a fixed prompt to perceive the emotions, ignoring the dynamicity and complexity of the emotion source in the multimodal inputs. To address these issues, we propose a novel Reinforcement Learning-based Dynamic Agent Specialization framework (\textbf{EmoAgent-R1}) to optimize the emotion recognition, reasoning, and generalization abilities of an MLLM with dynamic agent specialization based on reinforcement learning. Specifically, we first adopt a cold start strategy to endow an MLLM with preliminary emotion recognition, reasoning, and agent routing ability by training with synthetic answer-conditioned chain-of-thought data and agent routing data. Then, we further train the MLLM with reinforcement learning to perceive emotions in a two-step agentic workflow with agent selection and agent specialization. To effectively train EmoAgent-R1, we propose a novel Progressive Group-Relative Policy Optimization (P-GRPO) to combine group-based relative advantages with a PMI-inspired progressive token-level modulation to transform sparse rewards into fine-grained learning signals, mitigating the coarse-grained uniform credit assignment issue in GRPO. Extensive experiments on MER benchmarks demonstrate the superiority of our EmoAgent-R1 in stronger emotion reasoning performance and improved optimization stability.

[99] OpenForgeRL: Train Harness-native Agents in Any Environment cs.AI | cs.CLPDF

Xiao Yu, Baolin Peng, Ruize Xu, Hao Zou, Qianhui Wu

TL;DR: OpenForgeRL是一个开源框架，旨在解决基于复杂推理框架（如Claude Code、Codex）的AI智能体难以使用开源基础设施进行端到端训练的问题。它通过一个轻量级代理记录模型调用作为训练数据，并结合Kubernetes编排器在远程容器中运行每次迭代，从而实现在任何环境和推理框架中大规模训练智能体。

Details

Motivation: 现代AI智能体依赖复杂的推理框架来实现多轮推理、工具使用和外部系统访问，但这些框架使得智能体难以使用开源SFT/RL技术栈进行端到端训练，因为现有框架无法原生支持有状态、多进程的推理流程。

Result: 在多个基准测试中取得优异表现：OpenForgeClaw在ClawEval上达到31.7和55.9 pass@3，在QwenClawBench上达到33.7；OpenForgeGUI在OSWorld-Verified上达到37.7，在Online-Mind2Web上达到63.0，在WebVoyager上达到72.3。在几乎所有基准测试中都优于相似规模的开源基线模型，在GUI设置中达到或超越了数倍规模模型的性能。

Insight: 核心创新在于通过解耦训练和推理，使研究人员能够直接在真实部署的推理框架和环境中训练智能体。框架设计采用轻量级代理记录模型调用和Kubernetes容器化编排，实现了对任意推理框架和环境的大规模端到端训练支持。研究发现不同推理框架的学习难度差异显著，RL训练能提升智能体的自我验证、工具覆盖和多步计划完成等可靠性能力。

Abstract: Modern AI agents rely on elaborate inference harnesses such as Claude Code, Codex, and OpenClaw to drive multi-turn reasoning, tool use, and access to external systems. While powerful, these complex harnesses also make agents hard to train end-to-end with open infrastructure, whose SFT/RL stacks cannot natively express stateful, multi-process harness inference. To address this, we present OpenForgeRL, an open-source framework for training harness-based agents end-to-end in diverse environments. OpenForgeRL achieves this with a lightweight proxy that serves the harness’s model calls while recording them as training data for a standard RL codebase (e.g., veRL), and a Kubernetes orchestrator that runs each rollout in its own remote container, together enabling training on any harness in any environment at scale. By decoupling training and inference, OpenForgeRL allows researchers to easily train, study, and improve agents directly in the real harnesses and environments they are deployed with. We validate our framework across diverse, complex harnesses and environments, spanning tool/claw-based agents and multimodal GUI browser- and computer-use agents. Using only hundreds to a few thousand tasks, OpenForgeClaw reaches 31.7 pass^3 and 55.9 pass@3 on ClawEval and 33.7 on QwenClawBench. OpenForgeGUI reaches 37.7 on OSWorld-Verified, 63.0 on Online-Mind2Web, and 72.3 on WebVoyager. Both outperform open baselines of similar size on nearly all benchmarks, and in the GUI setting match or surpass models several times larger. Beyond benchmarks, we analyze how harness choice (e.g., ZeroClaw, OpenClaw, Codex) and RL shape agent behavior. We find that some harnesses are substantially harder to learn than others, and that RL improves agentic reliability, such as self-verification, tool coverage, and completing multi-step plans, though critical abilities such as error recovery remain weak.

cs.RO [Back]

[100] GS-Agent: Creating 4D Physical Worlds With Generative Simulation cs.RO | cs.AI | cs.CL | cs.CVPDF

Hongxin Zhang, Chunru Lin, Junyan Li, Zhou Xian, Tsun-Hsuan Wang

TL;DR: 本文提出了GS-Agent，一个端到端的多智能体框架，用于从自然语言描述自动生成物理真实、动态且可控的4D物理世界。该框架模拟人类创建4D世界的过程，将任务分解为实体管理（如3D资产、材质、布局与运动控制）和渲染配置（如相机与光照），并通过多个专业智能体与物理引擎交互、寻求多模态反馈，以迭代方式构建世界。

Details

Motivation: 解决从自然语言描述自动创建动态且物理真实的4D世界的挑战，传统图形学方法依赖人工调优，而现有生成方法在物理合理性与可控性方面存在不足。

Result: 实验表明，GS-Agent能有效将自然语言转换为多样且物理合理的4D世界，展现液体、可变形物体与刚体间的丰富交互，并实现电影级的相机与光照控制。

Insight: 创新点在于采用多智能体系统模拟人类创作流程，将物理引擎集成到生成循环中，通过代码交互与迭代反馈确保物理合理性与可控性，为4D世界生成提供了新的自动化范式。

Abstract: Creating dynamic and physically realistic 4D worlds from natural language descriptions is both fascinating and challenging. Traditional computer graphics methods rely on manual creation, requiring extensive human effort to fine-tune materials, motions, and visual fidelity. Recent advances in generative foundation models have sparked interest in learning to generate such 4D worlds from large-scale data; however, existing methods still struggle to ensure physical plausibility and controllability. In this work, we take a different path by leveraging foundation models to construct an agentic system that emulates how humans traditionally create 4D worlds, yet automates the entire process. We present GS-Agent, an end-to-end multi-agent framework that integrates physics engines in the loop to generate realistic, dynamic, and controllable 4D physical worlds from natural language. Inspired by how humans build 4D worlds, GS-Agent decomposes the task into entity management, covering 3D asset curation, material tuning, placement, and motion control, and rendering configuration, including camera and lighting manipulation. Multiple agents with distinct expertise interact with the physics engine via code, seek multimodal feedback, and collaborate to iteratively construct 4D worlds that align with the given descriptions. Experimental results show that GS-Agent effectively converts natural language into diverse and physically plausible 4D worlds exhibiting rich interactions among liquids, deformable objects, and rigid bodies, while achieving cinematic camera and lighting control. We envision GS-Agent as a foundation for a new paradigm in 4D world generation, empowering creative content creation and physical AI. Project page at https://umass-embodied-agi.github.io/gs-agent/

Table of Contents

cs.CL [Back]

[1] What is Good? Extracting and Testing Implicit Theories of Literary Quality from LLM Reasoning Traces cs.CLPDF

[2] Is MoE Routing a Huffman Code? Discovering the Frequency-Diversity Law in Chain-of-Thought cs.CL | cs.AI | cs.ITPDF

[3] Skill-Contracted Agents for Evidence-Aware Materials Literature Analysis cs.CL | cs.IRPDF

[4] Moir: Let the Model Direct Its Own Story for Robust Cross-Domain Knowledge Editing cs.CL | cs.AIPDF

[5] Preference Tuning as Spectral Update Reorganization cs.CL | cs.AI | cs.LGPDF

[6] Answer-then-Edit: Reasoning Skeleton Editing for Anti-Distillation with Preserved Utility cs.CL | cs.AIPDF

[7] SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations cs.CL | cs.SD | eess.ASPDF

[8] The Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMs cs.CL | cs.AIPDF

[9] Learn2Zinc: Fine-tuning Small Language Models for Text-to-Model Translation in MiniZinc cs.CL | cs.AIPDF

[10] Domyn-Small: A European 10B Reasoning Language Model cs.CL | cs.LGPDF

[11] CAMeR: Keyword-Gated Hybrid Activation for Adaptive Memory Retention in LLM Agents cs.CL | cs.AIPDF

[12] THOR: A Theta-Gamma Hierarchical Oscillatory Reasoning Framework for Multi-hop QA cs.CL | cs.AIPDF

[13] Learning to Detect UI Principle Violations via Reinforcement Learning cs.CLPDF

[14] REFACT: Adaptive Fact Restatement for Compact and Faithful Chain-of-Thought Reasoning cs.CLPDF

[15] CSPF: A Constrained Shared-Private Fusion Method for Non-Verifiable Preference Evaluation cs.CLPDF

[16] LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports cs.CLPDF

[17] CultureTalk-ID: A Multi-Task Dialogue Benchmark for Cultural Commonsense in Indonesian Local Languages cs.CLPDF

[18] Sample-Efficient Learning from Agent Experience cs.CLPDF

[19] QuantiBias: Benchmarking Quantization-Induced Bias in LLMs cs.CL | cs.CY | cs.HCPDF

[20] Adaptive Depth Sparse Framework: Similarity-Driven Resource Allocation for Pre-Trained LLMs cs.CL | cs.LGPDF

[21] MemTools: A Unified Research Framework for Interoperable Agent Memory cs.CLPDF

[22] An Evaluation Framework for Structured Audio Captions Validated by Controlled Perturbations cs.CL | cs.SDPDF

[23] RUMBA: Russian User Memory Benchmark cs.CL | cs.AIPDF

[24] Token Budget Saturation and Mechanistic Early Detection of Reasoning Non-Convergence in Chain-of-Thought Models cs.CL | cs.AI | cs.LGPDF

[25] Capital Markets LLM Reliability Score (CM-LRS): From Plausible to Bankable cs.CLPDF

[26] MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Education cs.CL | cs.HCPDF

cs.CV [Back]

[27] Axolotl3D: a Unified Framework for Faithful 3D Shape Completion cs.CVPDF

[28] RealVDeblur: One-Step Diffusion for Generalizable Real-World Video Deblurring cs.CV | cs.AIPDF

[29] Spatially Grounded Concept Bottleneck Models for Trustworthy Breast Ultrasound Diagnosis cs.CV | cs.AIPDF

[30] ODeform: Learning Continuous 4D Motion for Shape Deformation with Neural ODEs cs.CVPDF

[31] Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness cs.CVPDF

[32] Ocular Verification for Virtual Reality cs.CVPDF

[33] WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing cs.CVPDF

[34] ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes? cs.CVPDF

[35] Engine-Native Editable 3D World Reconstruction with Objects and Lighting cs.CVPDF

[36] DINO-VPT: Hierarchical Visual Prompt Tuning for Joint Physical-Digital Face Anti-Spoofing cs.CVPDF

[37] Sidewalk Moments: Are Richer Representations Always More Human-Aligned? Evidence from City-Walk Videos cs.CV | cs.HCPDF

[38] MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer cs.CVPDF

[39] Ms. Forcing: Efficient Streaming Video Generation with Multi-Scale Patchification and Attention cs.CVPDF

[40] Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval cs.CVPDF

[41] HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving cs.CV | cs.AIPDF

[42] Sparse Concept Channels in Frozen 3D CT Vision Encoders cs.CV | cs.AIPDF

[43] ProCap: Prominence-guided Object Rectification for Faithful and Comprehensive Video Captioning cs.CVPDF

[44] GroupVideo: Multi-Identity Customized Text-to-Video Generation cs.CVPDF

[45] WAT3R: Feedforward Underwater 3D Reconstruction cs.CVPDF

[46] GeoThreat: Transferable Targeted Adversarial Attacks on Large Vision-Language Models for Remote Sensing Image Interpretation cs.CVPDF

[47] Achieving Text-based Person Retrieval with Any Granularity cs.CVPDF

[48] MVEI & EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement cs.CVPDF

[49] TransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objects cs.CV | cs.MM | cs.ROPDF

[50] Show, Don’t Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text cs.CVPDF

[51] C-PTQ: Fisher-weighted Channel-wise Sensitivity for Post-training Quantization of MLLMs cs.CVPDF

[52] Do Pathology Vision-Language Models Truly See Pathology? cs.CVPDF

[53] Loss Landscape Topology Reveals Why Simple Baselines are Competitive at 3D Point Cloud Segmentation Under Class Imbalance cs.CVPDF

[54] Geo3R: Mitigating Spatial Reasoning Hallucination in Multimodal Large Language Models cs.CVPDF

[55] HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models cs.CVPDF

[56] The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Results cs.CVPDF

[57] Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents cs.CVPDF

[58] CRAG-MM-Diagnostics: Enabling Stage-Wise Analysis of Knowledge-Intensive VQA cs.CV | cs.AIPDF

[59] Out of Sight, Still in Mind: Token Compression for Omni-LLMs cs.CVPDF

[60] T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video cs.CVPDF

[61] Stokes-Informed Diffusion for Robust Linear Polarization Estimation cs.CVPDF

[62] DART: A Degradation-Aware Recurrent Transformer for Archival Film Restoration cs.CV | cs.LGPDF

[63] Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform cs.CVPDF

[64] Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning cs.CV | cs.AIPDF

[65] Quality-Aware Multimodal Fusion Reveals Implicit Identity in Valence-Arousal Features cs.CVPDF

[66] Incremental Optimal Assignment for Real-Time Crowd Tracking cs.CV | cs.DSPDF

[67] ASTRA-Net: Anatomy-Specific Transfer and Representation Alignment for Drug-Induced Sleep Endoscopy Segmentation cs.CVPDF

[68] DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation cs.CV | cs.AIPDF

[69] When Are Reasoning-Based Guardrails Not Efficient? ResponseGuard: A Fast Vision-Language Guard for Real-Time Moderation cs.CV | cs.AIPDF

[70] Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping cs.CV | cs.AIPDF

[71] Towards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach cs.CVPDF

[72] DAPM: UAV Monocular Depth Estimation from Any Height, Pitch, Roll and FOV cs.CVPDF

[73] Texture++: Elevating 3D Asset Texture Resolution with a Region-Aware Diffusion Model cs.CVPDF

[74] ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing cs.CV | cs.AIPDF

[75] UnDA: Unpaired Domain Alignment for Cross-Modal Knowledge Transfer in Medical Imaging cs.CVPDF

[76] Visual Contrastive Self-Distillation cs.CV | cs.AIPDF

[77] Self-Supervised Learning of Structured Dynamics from Videos cs.CVPDF